Thu 16 Jan 2014 15:57:25 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 15:57:29 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 15:57:29 - Housekeeping: checking database for timed out jobs..
Thu 16 Jan 2014 15:57:29 - Housekeeping: Found 0 timed out jobs in database: closing entries
Thu 16 Jan 2014 15:57:29 - Housekeeping: done.
Thu 16 Jan 2014 15:57:29 - Housekeeping: checking database for stale jobs..
Thu 16 Jan 2014 15:57:29 - Housekeeping: Found 465 stale jobs in database: deleting entries
Thu 16 Jan 2014 15:57:29 - Housekeeping: done.
Thu 16 Jan 2014 15:57:29 - XML: Handler created
Thu 16 Jan 2014 15:57:29 - Housekeeping: checking RRD archive for cluster LISA Cluster (may take a while)..
Thu 16 Jan 2014 15:57:29 - Housekeeping: RRD check complete for cluster LISA Cluster.
Thu 16 Jan 2014 15:57:29 - Housekeeping: checking RRD archive for cluster Render Cluster (may take a while)..
Thu 16 Jan 2014 15:57:29 - Housekeeping: RRD check complete for cluster Render Cluster.
Thu 16 Jan 2014 15:57:29 - job_xml_thread(): started.
Thu 16 Jan 2014 15:57:29 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 15:57:29 - job_xml_thread(): Done retrieving: data size 43933751
Thu 16 Jan 2014 15:57:29 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 15:57:29 - XML: Start document: iteration 1
Thu 16 Jan 2014 15:57:30 - main threading started.
Thu 16 Jan 2014 15:57:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 15:57:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 15:57:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 15:57:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43933751
Thu 16 Jan 2014 15:57:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 15:57:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 15:57:30 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 15:57:30 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 15:57:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 15:57:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 15:57:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43933751
Thu 16 Jan 2014 15:57:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 15:57:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 15:57:30 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 15:57:30 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 15:57:30 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 15:57:30 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 15:57:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 15:57:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 15:57:31 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 15:57:31 - size of cluster 'Render Cluster': 0 hosts 0 metrics 0 values 0 bits 0 bytes 
Thu 16 Jan 2014 15:57:31 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 15:57:31 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 15:57:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 15:57:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 15:57:31 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 15:57:31 - size of cluster 'LISA Cluster': 0 hosts 0 metrics 0 values 0 bits 0 bytes 
Thu 16 Jan 2014 15:57:31 - Leaving storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 15:57:31 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Thu 16 Jan 2014 15:57:31 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 15:57:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 15:57:46 - XML: Processed 655501 elements - found 890 jobs
Thu 16 Jan 2014 15:57:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 15:57:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 15:57:46 - job_xml_thread(): Found 887 updated jobs.
Thu 16 Jan 2014 15:57:46 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 15:57:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 15:57:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 15:57:47 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 15:57:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 15:57:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 15:57:48 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 15:57:48 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 15:57:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 15:57:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 15:57:48 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 15:57:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 15:57:51 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 15:57:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 15:57:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 15:57:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 15:57:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 15:57:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 15:57:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 15:57:52 - job_xml_thread(): Done storing. succesfully stored: 887 jobs
Thu 16 Jan 2014 15:57:52 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 15:57:52 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 15:57:54 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 15:57:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43931581
Thu 16 Jan 2014 15:57:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 15:57:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43931581
Thu 16 Jan 2014 15:57:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 15:58:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 15:58:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 15:58:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 15:58:03 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 15:58:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 15:58:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 15:58:04 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 15:58:04 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 15:58:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 15:58:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 15:58:04 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 15:58:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 15:58:06 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 15:58:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 15:58:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 15:58:07 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 15:58:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 15:58:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 15:58:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 15:58:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 15:58:11 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 15:58:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43926340
Thu 16 Jan 2014 15:58:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 15:58:11 - job_xml_thread(): Done retrieving: data size 43926340
Thu 16 Jan 2014 15:58:11 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 15:58:11 - XML: Start document: iteration 2
Thu 16 Jan 2014 15:58:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43926340
Thu 16 Jan 2014 15:58:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 15:58:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 15:58:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 15:58:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 15:58:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 15:58:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 15:58:27 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 15:58:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 15:58:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 15:58:28 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 15:58:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 15:58:28 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 15:58:28 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 15:58:29 - XML: Processed 655501 elements - found 890 jobs
Thu 16 Jan 2014 15:58:29 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 15:58:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 15:58:29 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 15:58:29 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 15:58:29 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 15:58:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 15:58:30 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 15:58:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 15:58:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 15:58:30 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 15:58:30 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 15:58:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 15:58:31 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 15:58:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 15:58:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 15:58:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 15:58:31 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 15:58:31 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 15:58:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 15:58:31 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 15:58:31 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 15:58:31 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 15:58:31 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 238467 values 3762316 bits 470289 bytes 
Thu 16 Jan 2014 15:58:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 15:58:32 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 15:58:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 15:58:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 15:58:32 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 15:58:32 - size of cluster 'Render Cluster': 20 hosts 3139 metrics 9417 values 148503 bits 18562 bytes 
Thu 16 Jan 2014 15:58:34 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 15:58:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43931449
Thu 16 Jan 2014 15:58:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 15:58:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43931449
Thu 16 Jan 2014 15:58:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 15:58:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 15:58:44 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 15:58:44 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 15:58:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 15:58:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 15:58:44 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 15:58:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 15:58:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 15:58:45 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 15:58:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 15:58:45 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 15:58:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 15:58:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 15:58:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 15:58:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 15:58:47 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 15:58:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 15:58:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 15:58:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 15:58:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 15:58:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 15:58:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 15:58:49 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 15:58:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 15:58:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 15:58:50 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 15:58:50 - job_xml_thread(): Done retrieving: data size 43934353
Thu 16 Jan 2014 15:58:50 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 15:58:50 - XML: Start document: iteration 3
Thu 16 Jan 2014 15:58:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43934353
Thu 16 Jan 2014 15:58:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 15:58:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43934353
Thu 16 Jan 2014 15:58:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 15:59:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 15:59:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 15:59:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 15:59:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 15:59:10 - XML: Processed 655503 elements - found 891 jobs
Thu 16 Jan 2014 15:59:10 - job 7346364 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 15:59:10 - job 7346315 appears to have finished
Thu 16 Jan 2014 15:59:10 - job_xml_thread(): Found 3 updated jobs.
Thu 16 Jan 2014 15:59:10 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 15:59:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 15:59:10 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 15:59:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 15:59:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 15:59:11 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 15:59:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 15:59:11 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 15:59:11 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 15:59:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 15:59:11 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Thu 16 Jan 2014 15:59:11 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 15:59:11 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 15:59:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 15:59:11 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 15:59:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 15:59:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 15:59:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 15:59:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 15:59:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 15:59:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 15:59:13 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 15:59:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43860679
Thu 16 Jan 2014 15:59:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 15:59:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43860679
Thu 16 Jan 2014 15:59:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 15:59:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 15:59:21 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 15:59:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 15:59:24 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 15:59:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 15:59:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 15:59:26 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 15:59:26 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 15:59:26 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 15:59:26 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 15:59:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 15:59:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 15:59:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 15:59:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 15:59:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 15:59:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 15:59:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 15:59:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 15:59:27 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 15:59:27 - job_xml_thread(): Done retrieving: data size 43494569
Thu 16 Jan 2014 15:59:27 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 15:59:27 - XML: Start document: iteration 4
Thu 16 Jan 2014 15:59:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43494569
Thu 16 Jan 2014 15:59:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 15:59:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43494569
Thu 16 Jan 2014 15:59:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 15:59:31 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 15:59:31 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 15:59:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 15:59:32 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 15:59:33 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 15:59:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 15:59:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 15:59:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 15:59:34 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 15:59:34 - size of cluster 'Render Cluster': 20 hosts 3139 metrics 11060 values 174397 bits 21799 bytes 
Thu 16 Jan 2014 15:59:41 - XML: Processed 650225 elements - found 891 jobs
Thu 16 Jan 2014 15:59:41 - job 7346284 appears to have finished
Thu 16 Jan 2014 15:59:41 - job 7346365 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 15:59:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 15:59:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 15:59:41 - job_xml_thread(): Found 3 updated jobs.
Thu 16 Jan 2014 15:59:41 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 15:59:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 15:59:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 15:59:43 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Thu 16 Jan 2014 15:59:43 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 15:59:43 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 15:59:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 15:59:44 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 15:59:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 15:59:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 15:59:45 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 15:59:45 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 15:59:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 15:59:45 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 15:59:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 15:59:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 15:59:46 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 15:59:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 15:59:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 15:59:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 15:59:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 15:59:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 15:59:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 15:59:48 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 15:59:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 15:59:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 15:59:49 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 15:59:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43281331
Thu 16 Jan 2014 15:59:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 15:59:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43281331
Thu 16 Jan 2014 15:59:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 15:59:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 15:59:57 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 15:59:58 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 15:59:58 - job_xml_thread(): Done retrieving: data size 43281331
Thu 16 Jan 2014 15:59:58 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 15:59:58 - XML: Start document: iteration 5
Thu 16 Jan 2014 16:00:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:00:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:00:01 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:00:01 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:00:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:00:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:00:01 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:00:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:00:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:00:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:00:05 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:00:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:00:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:00:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:00:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:00:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:00:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:00:08 - XML: Processed 647607 elements - found 891 jobs
Thu 16 Jan 2014 16:00:08 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 16:00:08 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 16:00:08 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:00:08 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:00:10 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:00:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43281766
Thu 16 Jan 2014 16:00:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:00:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43281766
Thu 16 Jan 2014 16:00:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:00:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:00:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:00:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:00:18 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:00:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:00:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:00:21 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:00:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:00:22 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:00:22 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:00:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:00:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:00:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:00:24 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:00:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:00:24 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:00:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:00:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:00:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:00:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:00:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:00:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:00:26 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:00:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43324665
Thu 16 Jan 2014 16:00:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:00:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43324665
Thu 16 Jan 2014 16:00:27 - job_xml_thread(): Done retrieving: data size 43324665
Thu 16 Jan 2014 16:00:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:00:27 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:00:27 - XML: Start document: iteration 6
Thu 16 Jan 2014 16:00:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:00:34 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:00:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:00:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 16:00:35 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:00:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 16:00:35 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:00:35 - size of cluster 'Render Cluster': 20 hosts 3139 metrics 9245 values 145807 bits 18225 bytes 
Thu 16 Jan 2014 16:00:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:00:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:00:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:00:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:00:43 - XML: Processed 648208 elements - found 890 jobs
Thu 16 Jan 2014 16:00:43 - job 7346290 appears to have finished
Thu 16 Jan 2014 16:00:43 - job 7346366 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:00:43 - job 7346367 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:00:43 - job 7346365 field 'start_timestamp' changed since saved from: 1389884328 to: 1389884279
Thu 16 Jan 2014 16:00:43 - job 7346368 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:00:43 - job 7346369 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:00:43 - job_xml_thread(): Found 6 updated jobs.
Thu 16 Jan 2014 16:00:43 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 16:00:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:00:44 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:00:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:00:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:00:45 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:00:45 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:00:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:00:45 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:00:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:00:46 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Thu 16 Jan 2014 16:00:46 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:00:46 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:00:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:00:46 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:00:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:00:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:00:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:00:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:00:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:00:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:00:49 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:00:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43843271
Thu 16 Jan 2014 16:00:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:00:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43843271
Thu 16 Jan 2014 16:00:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:00:51 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:00:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 16:00:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:01:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:01:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:01:01 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:01:01 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:01:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:01:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:01:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:01:03 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:01:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:01:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:01:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:01:04 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:01:04 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:01:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:01:04 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:01:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:01:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:01:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:01:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:01:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:01:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:01:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:01:06 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:01:06 - job_xml_thread(): Done retrieving: data size 43931914
Thu 16 Jan 2014 16:01:06 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:01:06 - XML: Start document: iteration 7
Thu 16 Jan 2014 16:01:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43931914
Thu 16 Jan 2014 16:01:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:01:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43931914
Thu 16 Jan 2014 16:01:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:01:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:01:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:01:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:01:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:01:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:01:24 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:01:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:01:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:01:25 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:01:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:01:25 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:01:25 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:01:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:01:26 - XML: Processed 655479 elements - found 889 jobs
Thu 16 Jan 2014 16:01:26 - job 7346294 appears to have finished
Thu 16 Jan 2014 16:01:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:01:26 - job_xml_thread(): Found 1 updated jobs.
Thu 16 Jan 2014 16:01:26 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 16:01:26 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:01:26 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Thu 16 Jan 2014 16:01:26 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:01:26 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:01:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:01:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:01:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:01:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:01:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:01:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:01:28 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:01:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43922338
Thu 16 Jan 2014 16:01:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:01:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43922338
Thu 16 Jan 2014 16:01:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:01:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:01:35 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:01:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:01:36 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:01:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 16:01:36 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:01:36 - size of cluster 'Render Cluster': 20 hosts 3139 metrics 9417 values 148673 bits 18584 bytes 
Thu 16 Jan 2014 16:01:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 16:01:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:01:39 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:01:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:01:40 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:01:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:01:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:01:41 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:01:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:01:41 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:01:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:01:41 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:01:41 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:01:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:01:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:01:42 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:01:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 16:01:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:01:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:01:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:01:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:01:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:01:44 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:01:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43928481
Thu 16 Jan 2014 16:01:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:01:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43928481
Thu 16 Jan 2014 16:01:44 - job_xml_thread(): Done retrieving: data size 43928481
Thu 16 Jan 2014 16:01:44 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:01:44 - XML: Start document: iteration 8
Thu 16 Jan 2014 16:01:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:01:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:01:55 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:01:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:01:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:01:58 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:01:58 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:01:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:01:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:01:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:01:58 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:01:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:02:01 - XML: Processed 655499 elements - found 889 jobs
Thu 16 Jan 2014 16:02:01 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 16:02:01 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 16:02:01 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:02:01 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:02:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:02:05 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:02:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:02:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:02:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:02:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:02:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:02:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:02:07 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:02:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43924453
Thu 16 Jan 2014 16:02:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:02:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43924453
Thu 16 Jan 2014 16:02:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:02:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:02:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:02:16 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:02:16 - job_xml_thread(): Done retrieving: data size 43924453
Thu 16 Jan 2014 16:02:16 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:02:16 - XML: Start document: iteration 9
Thu 16 Jan 2014 16:02:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:02:21 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:02:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:02:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:02:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:02:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:02:23 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:02:23 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:02:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:02:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:02:23 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:02:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:02:29 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:02:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:02:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:02:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:02:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:02:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:02:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:02:31 - XML: Processed 655487 elements - found 888 jobs
Thu 16 Jan 2014 16:02:31 - job 36797 appears to have finished
Thu 16 Jan 2014 16:02:31 - job_xml_thread(): Found 1 updated jobs.
Thu 16 Jan 2014 16:02:31 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 16:02:31 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Thu 16 Jan 2014 16:02:31 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:02:31 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:02:33 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:02:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43909164
Thu 16 Jan 2014 16:02:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:02:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43909164
Thu 16 Jan 2014 16:02:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:02:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:02:37 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:02:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:02:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:02:38 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:02:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:02:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 16:02:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 16:02:38 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:02:39 - size of cluster 'Render Cluster': 20 hosts 3139 metrics 9415 values 148910 bits 18613 bytes 
Thu 16 Jan 2014 16:02:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:02:43 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:02:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:02:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:02:45 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:02:45 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:02:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:02:45 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:02:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:02:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:02:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:02:46 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:02:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:02:47 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:02:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:02:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:02:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:02:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:02:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:02:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:02:50 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:02:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43927632
Thu 16 Jan 2014 16:02:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:02:50 - job_xml_thread(): Done retrieving: data size 43927632
Thu 16 Jan 2014 16:02:50 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:02:50 - XML: Start document: iteration 10
Thu 16 Jan 2014 16:02:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43927632
Thu 16 Jan 2014 16:02:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:03:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:03:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:03:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:03:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:03:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:03:04 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:03:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:03:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:03:05 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:03:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:03:05 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:03:05 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:03:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:03:10 - XML: Processed 655497 elements - found 888 jobs
Thu 16 Jan 2014 16:03:10 - job 7346370 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:03:10 - job 7346339 appears to have finished
Thu 16 Jan 2014 16:03:10 - job 7346337 appears to have finished
Thu 16 Jan 2014 16:03:10 - job 7346331 appears to have finished
Thu 16 Jan 2014 16:03:10 - job 7346332 appears to have finished
Thu 16 Jan 2014 16:03:10 - job_xml_thread(): Found 8 updated jobs.
Thu 16 Jan 2014 16:03:10 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 16:03:13 - job_xml_thread(): Done storing. succesfully stored: 8 jobs
Thu 16 Jan 2014 16:03:13 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:03:13 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:03:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:03:13 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:03:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:03:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:03:13 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:03:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 16:03:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:03:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:03:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:03:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:03:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:03:15 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:03:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43894426
Thu 16 Jan 2014 16:03:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:03:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43894426
Thu 16 Jan 2014 16:03:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:03:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:03:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:03:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:03:24 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:03:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:03:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:03:24 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:03:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:03:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43894426
Thu 16 Jan 2014 16:03:24 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:03:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:03:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:03:28 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:03:28 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:03:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:03:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:03:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:03:35 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:03:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:03:37 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:03:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:03:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:03:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:03:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:03:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:03:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:03:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:03:38 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:03:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:03:39 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:03:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 16:03:39 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:03:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 16:03:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5888 values 93190 bits 11648 bytes 
Thu 16 Jan 2014 16:03:39 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:03:39 - job_xml_thread(): Done retrieving: data size 43915055
Thu 16 Jan 2014 16:03:39 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:03:39 - XML: Start document: iteration 11
Thu 16 Jan 2014 16:03:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:03:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:03:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43915055
Thu 16 Jan 2014 16:03:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:03:41 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:03:41 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:03:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:03:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:03:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43915055
Thu 16 Jan 2014 16:03:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:03:51 - XML: Processed 655500 elements - found 886 jobs
Thu 16 Jan 2014 16:03:51 - job 7344495 appears to have finished
Thu 16 Jan 2014 16:03:51 - job 36797 appears to have finished
Thu 16 Jan 2014 16:03:51 - job_xml_thread(): Found 2 updated jobs.
Thu 16 Jan 2014 16:03:51 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 16:03:52 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Thu 16 Jan 2014 16:03:52 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:03:52 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:03:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:03:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:03:53 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:03:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:03:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:03:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:03:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:03:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:03:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:03:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:03:53 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:03:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:03:56 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:03:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:03:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:03:57 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:03:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:03:57 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:03:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:03:58 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:03:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 16:03:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:03:58 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:03:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43925175
Thu 16 Jan 2014 16:03:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:03:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43925175
Thu 16 Jan 2014 16:03:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:04:07 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:04:07 - job_xml_thread(): Done retrieving: data size 43925175
Thu 16 Jan 2014 16:04:07 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:04:07 - XML: Start document: iteration 12
Thu 16 Jan 2014 16:04:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:04:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:04:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:04:10 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:04:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:04:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:04:13 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:04:13 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:04:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:04:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:04:13 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:04:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:04:17 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:04:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:04:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:04:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:04:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:04:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:04:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:04:19 - XML: Processed 655500 elements - found 886 jobs
Thu 16 Jan 2014 16:04:19 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 16:04:19 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 16:04:19 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:04:19 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:04:21 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:04:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43920996
Thu 16 Jan 2014 16:04:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:04:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43920996
Thu 16 Jan 2014 16:04:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:04:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:04:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:04:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:04:30 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:04:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:04:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:04:31 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:04:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:04:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43920996
Thu 16 Jan 2014 16:04:31 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:04:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:04:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:04:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:04:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:04:34 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:04:34 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:04:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:04:35 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:04:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:04:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:04:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:04:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:04:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:04:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:04:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:04:39 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:04:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:04:39 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:04:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:04:40 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:04:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 16:04:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 16:04:40 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:04:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6717 values 106004 bits 13250 bytes 
Thu 16 Jan 2014 16:04:42 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:04:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 16:04:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:04:42 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:04:42 - job_xml_thread(): Done retrieving: data size 43913604
Thu 16 Jan 2014 16:04:42 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:04:42 - XML: Start document: iteration 13
Thu 16 Jan 2014 16:04:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43913604
Thu 16 Jan 2014 16:04:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:04:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:04:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:04:47 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:04:47 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:04:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:04:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43913604
Thu 16 Jan 2014 16:04:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:04:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:04:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:04:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:04:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:04:54 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:05:00 - XML: Processed 655508 elements - found 890 jobs
Thu 16 Jan 2014 16:05:00 - job 7346371 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:05:00 - job 7346370 field 'start_timestamp' changed since saved from: 1389884563 to: 1389884514
Thu 16 Jan 2014 16:05:00 - job 7346373 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:05:00 - job 7346372 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:05:00 - job 7346508 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:05:00 - job_xml_thread(): Found 9 updated jobs.
Thu 16 Jan 2014 16:05:00 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 16:05:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:05:02 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:05:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:05:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:05:02 - job_xml_thread(): Done storing. succesfully stored: 9 jobs
Thu 16 Jan 2014 16:05:02 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:05:02 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:05:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:05:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:05:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:05:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:05:03 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:05:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:05:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:05:04 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:05:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:05:04 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:05:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:05:05 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:05:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43924001
Thu 16 Jan 2014 16:05:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:05:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43924001
Thu 16 Jan 2014 16:05:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:05:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:05:16 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:05:17 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:05:17 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:05:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:05:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:05:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:05:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:05:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:05:19 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:05:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:05:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:05:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:05:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:05:19 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:05:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:05:19 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:05:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:05:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:05:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:05:22 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:05:22 - job_xml_thread(): Done retrieving: data size 43864154
Thu 16 Jan 2014 16:05:22 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:05:22 - XML: Start document: iteration 14
Thu 16 Jan 2014 16:05:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43864154
Thu 16 Jan 2014 16:05:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43864154
Thu 16 Jan 2014 16:05:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:05:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:05:31 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Thu 16 Jan 2014 16:05:31 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:05:33 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:05:33 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 16:05:33 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 16:05:33 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:05:33 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 16:05:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:05:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:05:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:05:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:05:37 - size of cluster 'LISA Cluster': 624 hosts 79481 metrics 1052205 values 16626691 bits 2078336 bytes 
Thu 16 Jan 2014 16:05:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:05:40 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:05:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:05:40 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:05:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:05:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:05:41 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:05:41 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:05:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:05:41 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:05:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:05:41 - XML: Processed 654758 elements - found 889 jobs
Thu 16 Jan 2014 16:05:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:05:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 16:05:41 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:05:41 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:05:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 16:05:41 - job 7346373 field 'start_timestamp' changed since saved from: 1389884638 to: 1389884636
Thu 16 Jan 2014 16:05:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148645 bits 18580 bytes 
Thu 16 Jan 2014 16:05:41 - job 7346257 appears to have finished
Thu 16 Jan 2014 16:05:41 - job_xml_thread(): Found 2 updated jobs.
Thu 16 Jan 2014 16:05:41 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 16:05:41 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Thu 16 Jan 2014 16:05:41 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:05:42 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:05:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:05:42 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:05:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:05:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:05:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:05:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:05:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:05:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:05:45 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:05:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43333047
Thu 16 Jan 2014 16:05:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:05:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43333047
Thu 16 Jan 2014 16:05:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:05:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:05:53 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:05:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:05:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:05:57 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:05:57 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:05:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:05:57 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:05:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:05:57 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:05:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:05:58 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:05:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:05:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:05:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:05:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:05:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:05:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:05:59 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:05:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 16:05:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:06:01 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:06:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43272368
Thu 16 Jan 2014 16:06:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:06:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43272368
Thu 16 Jan 2014 16:06:02 - job_xml_thread(): Done retrieving: data size 43272368
Thu 16 Jan 2014 16:06:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:06:02 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:06:02 - XML: Start document: iteration 15
Thu 16 Jan 2014 16:06:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:06:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:06:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:06:12 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:06:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:06:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:06:13 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:06:13 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:06:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:06:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:06:13 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:06:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:06:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:06:19 - XML: Processed 647306 elements - found 889 jobs
Thu 16 Jan 2014 16:06:19 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 16:06:19 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 16:06:19 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:06:19 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:06:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:06:21 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:06:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:06:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:06:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:06:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:06:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:06:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:06:24 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:06:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43315515
Thu 16 Jan 2014 16:06:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:06:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43315515
Thu 16 Jan 2014 16:06:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:06:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:06:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:06:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:06:34 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:06:34 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:06:34 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 16:06:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:06:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:06:35 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:06:35 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:06:35 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:06:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:06:35 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:06:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:06:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:06:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:06:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:06:37 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:06:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:06:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:06:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:06:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:06:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:06:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:06:39 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:06:39 - job_xml_thread(): Done retrieving: data size 43639204
Thu 16 Jan 2014 16:06:39 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:06:39 - XML: Start document: iteration 16
Thu 16 Jan 2014 16:06:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43639204
Thu 16 Jan 2014 16:06:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:06:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43639204
Thu 16 Jan 2014 16:06:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:06:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:06:41 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:06:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:06:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 16:06:42 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:06:43 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:06:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 16:06:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 11563 values 182364 bits 22795 bytes 
Thu 16 Jan 2014 16:06:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:06:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:06:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:06:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:06:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:06:58 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:06:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:06:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:06:58 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:06:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:06:58 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:06:58 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:06:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:06:59 - XML: Processed 652036 elements - found 889 jobs
Thu 16 Jan 2014 16:06:59 - job 7346375 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:06:59 - job 7346374 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:06:59 - job 7346377 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:06:59 - job 7346376 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:06:59 - job_xml_thread(): Found 4 updated jobs.
Thu 16 Jan 2014 16:06:59 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 16:07:00 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Thu 16 Jan 2014 16:07:00 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:07:00 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:07:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:07:01 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:07:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:07:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:07:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:07:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:07:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:07:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:07:05 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:07:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43916925
Thu 16 Jan 2014 16:07:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:07:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43916925
Thu 16 Jan 2014 16:07:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:07:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:07:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:07:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:07:14 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:07:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:07:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:07:15 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:07:15 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:07:15 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:07:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:07:15 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:07:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:07:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:07:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:07:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:07:19 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:07:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:07:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:07:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:07:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:07:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:07:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:07:20 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:07:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 16:07:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:07:22 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:07:22 - job_xml_thread(): Done retrieving: data size 43915455
Thu 16 Jan 2014 16:07:22 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:07:22 - XML: Start document: iteration 17
Thu 16 Jan 2014 16:07:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43915455
Thu 16 Jan 2014 16:07:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:07:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43915455
Thu 16 Jan 2014 16:07:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:07:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:07:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:07:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:07:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:07:36 - XML: Processed 655500 elements - found 886 jobs
Thu 16 Jan 2014 16:07:36 - job 7346293 appears to have finished
Thu 16 Jan 2014 16:07:36 - job 7346244 appears to have finished
Thu 16 Jan 2014 16:07:36 - job 7345979 appears to have finished
Thu 16 Jan 2014 16:07:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:07:36 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:07:36 - job 7346305 appears to have finished
Thu 16 Jan 2014 16:07:36 - job_xml_thread(): Found 5 updated jobs.
Thu 16 Jan 2014 16:07:36 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 16:07:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:07:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:07:37 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:07:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:07:37 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:07:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:07:37 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:07:39 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Thu 16 Jan 2014 16:07:39 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:07:39 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:07:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:07:41 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:07:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:07:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:07:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:07:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:07:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:07:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:07:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:07:43 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:07:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:07:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 16:07:44 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:07:44 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:07:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 16:07:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5765 values 90941 bits 11367 bytes 
Thu 16 Jan 2014 16:07:45 - Leaving storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 16:07:45 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Thu 16 Jan 2014 16:07:45 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:07:45 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:07:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43916878
Thu 16 Jan 2014 16:07:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43916878
Thu 16 Jan 2014 16:07:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:07:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:07:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:07:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:07:54 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:07:54 - job_xml_thread(): Done retrieving: data size 43916878
Thu 16 Jan 2014 16:07:55 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:07:55 - XML: Start document: iteration 18
Thu 16 Jan 2014 16:07:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:07:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:08:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:08:01 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:08:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:08:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:08:01 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:08:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:08:01 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:08:01 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:08:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:08:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:08:05 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:08:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:08:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:08:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:08:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:08:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:08:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:08:08 - XML: Processed 655500 elements - found 886 jobs
Thu 16 Jan 2014 16:08:08 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 16:08:08 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 16:08:08 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:08:08 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:08:10 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:08:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43899702
Thu 16 Jan 2014 16:08:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:08:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43899702
Thu 16 Jan 2014 16:08:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:08:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:08:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:08:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:08:21 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:08:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:08:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:08:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:08:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:08:22 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:08:22 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:08:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:08:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:08:22 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:08:23 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:08:25 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:08:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 16:08:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:08:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:08:25 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:08:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:08:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:08:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:08:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:08:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:08:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:08:27 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:08:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43919434
Thu 16 Jan 2014 16:08:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:08:27 - job_xml_thread(): Done retrieving: data size 43919434
Thu 16 Jan 2014 16:08:27 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:08:27 - XML: Start document: iteration 19
Thu 16 Jan 2014 16:08:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43919434
Thu 16 Jan 2014 16:08:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:08:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:08:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:08:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:08:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:08:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:08:41 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:08:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:08:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:08:43 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:08:43 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:08:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:08:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:08:43 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:08:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:08:44 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:08:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:08:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 16:08:46 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:08:46 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:08:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7080 values 111675 bits 13959 bytes 
Thu 16 Jan 2014 16:08:46 - XML: Processed 655502 elements - found 887 jobs
Thu 16 Jan 2014 16:08:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 16:08:46 - job 7346378 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:08:46 - job 7346377 field 'start_timestamp' changed since saved from: 1389884802 to: 1389884736
Thu 16 Jan 2014 16:08:46 - job 7346299 appears to have finished
Thu 16 Jan 2014 16:08:46 - job_xml_thread(): Found 5 updated jobs.
Thu 16 Jan 2014 16:08:46 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 16:08:47 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Thu 16 Jan 2014 16:08:47 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:08:47 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:08:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:08:47 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:08:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:08:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:08:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:08:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:08:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:08:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:08:49 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:08:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43932151
Thu 16 Jan 2014 16:08:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:08:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43932151
Thu 16 Jan 2014 16:08:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:08:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:08:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:09:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:09:00 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:09:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:09:01 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:09:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:09:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:09:02 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:09:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:09:02 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:09:02 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:09:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:09:02 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:09:02 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:09:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 16:09:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:09:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:09:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:09:03 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:09:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43938796
Thu 16 Jan 2014 16:09:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:09:04 - job_xml_thread(): Done retrieving: data size 43938796
Thu 16 Jan 2014 16:09:04 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:09:04 - XML: Start document: iteration 20
Thu 16 Jan 2014 16:09:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:09:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:09:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:09:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:09:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43938796
Thu 16 Jan 2014 16:09:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:09:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:09:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:09:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:09:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:09:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:09:23 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:09:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:09:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:09:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:09:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:09:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:09:24 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:09:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:09:25 - XML: Processed 655502 elements - found 887 jobs
Thu 16 Jan 2014 16:09:25 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 16:09:25 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 16:09:25 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:09:26 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:09:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:09:26 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:09:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:09:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:09:26 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:09:26 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:09:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:09:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:09:28 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:09:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43930613
Thu 16 Jan 2014 16:09:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:09:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43930613
Thu 16 Jan 2014 16:09:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:09:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:09:39 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:09:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:09:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:09:41 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:09:41 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:09:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:09:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:09:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:09:41 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:09:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:09:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:09:42 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:09:42 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:09:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:09:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:09:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:09:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:09:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:09:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:09:43 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:09:43 - job_xml_thread(): Done retrieving: data size 43938314
Thu 16 Jan 2014 16:09:43 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:09:43 - Housekeeping: checking database for timed out jobs..
Thu 16 Jan 2014 16:09:43 - Housekeeping: Found 0 timed out jobs in database: closing entries
Thu 16 Jan 2014 16:09:43 - Housekeeping: done.
Thu 16 Jan 2014 16:09:43 - XML: Start document: iteration 0
Thu 16 Jan 2014 16:09:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43938314
Thu 16 Jan 2014 16:09:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:09:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43938314
Thu 16 Jan 2014 16:09:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:09:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:09:46 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:09:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:09:47 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:09:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 16:09:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 16:09:47 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:09:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 10967 values 173009 bits 21626 bytes 
Thu 16 Jan 2014 16:09:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:09:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:09:57 - XML: Processed 655500 elements - found 886 jobs
Thu 16 Jan 2014 16:09:57 - job 7346350 appears to have finished
Thu 16 Jan 2014 16:09:57 - job 7344491 appears to have finished
Thu 16 Jan 2014 16:09:57 - job 7346346 appears to have finished
Thu 16 Jan 2014 16:09:57 - job_xml_thread(): Found 5 updated jobs.
Thu 16 Jan 2014 16:09:57 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 16:09:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:09:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:10:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:10:00 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:10:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:10:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:10:00 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:10:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:10:00 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:10:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:10:00 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:10:00 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Thu 16 Jan 2014 16:10:00 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:10:00 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:10:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:10:04 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:10:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:10:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:10:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:10:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:10:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:10:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:10:06 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:10:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43939410
Thu 16 Jan 2014 16:10:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:10:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43939410
Thu 16 Jan 2014 16:10:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:10:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:10:14 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:10:15 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:10:15 - job_xml_thread(): Done retrieving: data size 43939410
Thu 16 Jan 2014 16:10:15 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:10:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:10:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:10:16 - XML: Start document: iteration 1
Thu 16 Jan 2014 16:10:16 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:10:16 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:10:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:10:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:10:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43939410
Thu 16 Jan 2014 16:10:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:10:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:10:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:10:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:10:20 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:10:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:10:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:10:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:10:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:10:22 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:10:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:10:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:10:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:10:30 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:10:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:10:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:10:32 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:10:32 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:10:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:10:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:10:32 - XML: Processed 655500 elements - found 886 jobs
Thu 16 Jan 2014 16:10:32 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 16:10:32 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 16:10:32 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:10:32 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:10:33 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:10:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 16:10:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:10:34 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:10:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43903396
Thu 16 Jan 2014 16:10:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:10:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43903396
Thu 16 Jan 2014 16:10:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:10:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:10:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:10:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:10:44 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:10:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:10:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:10:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:10:47 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:10:48 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:10:48 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:10:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:10:48 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:10:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:10:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:10:48 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:10:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:10:48 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:10:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:10:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:10:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 16:10:48 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:10:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5953 values 93921 bits 11740 bytes 
Thu 16 Jan 2014 16:10:48 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:10:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 16:10:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:10:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:10:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:10:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:10:50 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:10:50 - job_xml_thread(): Done retrieving: data size 43940299
Thu 16 Jan 2014 16:10:50 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:10:50 - XML: Start document: iteration 2
Thu 16 Jan 2014 16:10:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43940299
Thu 16 Jan 2014 16:10:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:10:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43940299
Thu 16 Jan 2014 16:10:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:11:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:11:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:11:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:11:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:11:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:11:07 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:11:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:11:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:11:08 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:11:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:11:08 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:11:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:11:09 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:11:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:11:13 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:11:14 - XML: Processed 655498 elements - found 885 jobs
Thu 16 Jan 2014 16:11:14 - job 7346379 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:11:14 - job 7346381 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:11:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:11:14 - job 7346380 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:11:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:11:14 - job 7346314 appears to have finished
Thu 16 Jan 2014 16:11:14 - job 7346510 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:11:14 - job 7346509 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:11:14 - job_xml_thread(): Found 6 updated jobs.
Thu 16 Jan 2014 16:11:14 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 16:11:14 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Thu 16 Jan 2014 16:11:14 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:11:14 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:11:14 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:11:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 16:11:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:11:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:11:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:11:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:11:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:11:16 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:11:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43844099
Thu 16 Jan 2014 16:11:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:11:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43844099
Thu 16 Jan 2014 16:11:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:11:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:11:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:11:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:11:24 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:11:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:11:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:11:25 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:11:25 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:11:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:11:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:11:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43844099
Thu 16 Jan 2014 16:11:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:11:29 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:11:29 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:11:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:11:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:11:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:11:34 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:11:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:11:36 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:11:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:11:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:11:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:11:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:11:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:11:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:11:38 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:11:38 - job_xml_thread(): Done retrieving: data size 43373873
Thu 16 Jan 2014 16:11:38 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:11:38 - XML: Start document: iteration 3
Thu 16 Jan 2014 16:11:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43373873
Thu 16 Jan 2014 16:11:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:11:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:11:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:11:41 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:11:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:11:41 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:11:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43373873
Thu 16 Jan 2014 16:11:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:11:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:11:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:11:48 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:11:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:11:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 16:11:50 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:11:50 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:11:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 16:11:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9066 values 143040 bits 17880 bytes 
Thu 16 Jan 2014 16:11:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:11:51 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:11:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:11:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:11:54 - XML: Processed 648812 elements - found 883 jobs
Thu 16 Jan 2014 16:11:54 - job 7346270 appears to have finished
Thu 16 Jan 2014 16:11:54 - job 7344493 appears to have finished
Thu 16 Jan 2014 16:11:54 - job_xml_thread(): Found 2 updated jobs.
Thu 16 Jan 2014 16:11:54 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 16:11:54 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Thu 16 Jan 2014 16:11:54 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:11:54 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:11:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:11:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:11:57 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:11:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:11:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:11:57 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:11:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:11:57 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:11:57 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:11:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:11:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:11:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:11:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:11:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:11:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:11:59 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:11:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43274845
Thu 16 Jan 2014 16:11:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:12:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43274845
Thu 16 Jan 2014 16:12:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:12:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:12:10 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:12:10 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:12:10 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:12:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:12:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:12:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:12:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:12:14 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:12:14 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:12:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:12:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:12:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:12:14 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:12:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:12:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:12:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:12:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:12:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:12:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:12:15 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:12:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 16:12:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:12:16 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:12:16 - job_xml_thread(): Done retrieving: data size 43312714
Thu 16 Jan 2014 16:12:16 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:12:16 - XML: Start document: iteration 4
Thu 16 Jan 2014 16:12:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43312714
Thu 16 Jan 2014 16:12:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43312714
Thu 16 Jan 2014 16:12:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:12:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:12:28 - XML: Processed 647968 elements - found 883 jobs
Thu 16 Jan 2014 16:12:28 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 16:12:28 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 16:12:28 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:12:28 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:12:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:12:28 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:12:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:12:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:12:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:12:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:12:30 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:12:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:12:30 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:12:30 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:12:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:12:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:12:33 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:12:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:12:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:12:34 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Thu 16 Jan 2014 16:12:34 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:12:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:12:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:12:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:12:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:12:34 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:12:34 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:12:34 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 16:12:34 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 16:12:34 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 16:12:35 - size of cluster 'LISA Cluster': 624 hosts 79476 metrics 929156 values 14662928 bits 1832866 bytes 
Thu 16 Jan 2014 16:12:36 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:12:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43330822
Thu 16 Jan 2014 16:12:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:12:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43330822
Thu 16 Jan 2014 16:12:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:12:43 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:12:43 - job_xml_thread(): Done retrieving: data size 43330822
Thu 16 Jan 2014 16:12:43 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:12:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:12:44 - XML: Start document: iteration 5
Thu 16 Jan 2014 16:12:44 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:12:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:12:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:12:46 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:12:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:12:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43330822
Thu 16 Jan 2014 16:12:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:12:46 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:12:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:12:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:12:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:12:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:12:50 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:12:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:12:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 16:12:51 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:12:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8299 values 130918 bits 16364 bytes 
Thu 16 Jan 2014 16:12:51 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:12:51 - XML: Processed 648046 elements - found 879 jobs
Thu 16 Jan 2014 16:12:51 - job 7346338 appears to have finished
Thu 16 Jan 2014 16:12:51 - job 7346382 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:12:51 - job 7337037 appears to have finished
Thu 16 Jan 2014 16:12:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 16:12:51 - job 7346383 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:12:51 - job 7344498 appears to have finished
Thu 16 Jan 2014 16:12:51 - job 7344496 appears to have finished
Thu 16 Jan 2014 16:12:51 - job_xml_thread(): Found 6 updated jobs.
Thu 16 Jan 2014 16:12:51 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 16:12:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:12:56 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:12:57 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Thu 16 Jan 2014 16:12:57 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:12:57 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:12:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:12:58 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:12:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:12:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:12:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:12:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:12:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:12:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:12:58 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:13:01 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:13:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43919243
Thu 16 Jan 2014 16:13:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:13:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:13:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:13:02 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:13:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:13:02 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:13:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:13:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43919243
Thu 16 Jan 2014 16:13:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:13:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:13:09 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:13:12 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:13:12 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:13:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:13:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:13:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:13:15 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:13:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:13:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:13:15 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:13:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 16:13:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:13:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:13:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:13:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:13:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:13:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:13:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:13:17 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:13:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:13:17 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:13:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:13:19 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:13:19 - job_xml_thread(): Done retrieving: data size 43911580
Thu 16 Jan 2014 16:13:19 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:13:19 - XML: Start document: iteration 6
Thu 16 Jan 2014 16:13:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43911580
Thu 16 Jan 2014 16:13:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:13:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43911580
Thu 16 Jan 2014 16:13:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:13:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:13:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:13:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:13:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:13:34 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:13:34 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 16:13:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:13:35 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:13:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:13:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:13:36 - XML: Processed 655488 elements - found 880 jobs
Thu 16 Jan 2014 16:13:36 - job_xml_thread(): Found 1 updated jobs.
Thu 16 Jan 2014 16:13:36 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 16:13:36 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:13:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:13:36 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:13:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:13:36 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Thu 16 Jan 2014 16:13:36 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:13:36 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:13:36 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:13:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:13:41 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:13:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:13:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:13:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:13:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:13:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:13:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:13:44 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:13:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43907550
Thu 16 Jan 2014 16:13:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:13:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43907550
Thu 16 Jan 2014 16:13:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:13:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:13:51 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:13:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:13:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:13:51 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:13:52 - job_xml_thread(): Done retrieving: data size 43907550
Thu 16 Jan 2014 16:13:52 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:13:52 - XML: Start document: iteration 7
Thu 16 Jan 2014 16:13:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:13:53 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:13:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 16:13:53 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:13:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 16:13:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8982 values 141644 bits 17705 bytes 
Thu 16 Jan 2014 16:13:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:13:56 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:13:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:13:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:13:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:13:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:13:57 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:13:57 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:13:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:13:57 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:13:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:14:06 - XML: Processed 655488 elements - found 880 jobs
Thu 16 Jan 2014 16:14:06 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 16:14:06 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 16:14:06 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:14:06 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:14:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:14:06 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:14:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:14:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:14:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:14:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:14:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:14:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:14:10 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:14:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43896507
Thu 16 Jan 2014 16:14:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:14:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43896507
Thu 16 Jan 2014 16:14:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:14:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:14:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:14:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:14:19 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:14:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:14:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:14:20 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:14:20 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:14:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:14:20 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:14:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:14:21 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:14:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:14:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:14:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:14:25 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:14:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:14:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:14:26 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:14:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 16:14:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:14:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:14:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:14:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:14:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:14:28 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:14:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43901245
Thu 16 Jan 2014 16:14:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:14:29 - job_xml_thread(): Done retrieving: data size 43901245
Thu 16 Jan 2014 16:14:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43901245
Thu 16 Jan 2014 16:14:29 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:14:29 - XML: Start document: iteration 8
Thu 16 Jan 2014 16:14:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:14:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:14:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:14:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:14:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:14:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:14:46 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:14:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:14:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:14:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:14:47 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:14:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:14:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:14:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:14:48 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:14:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:14:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:14:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:14:49 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:14:49 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:14:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:14:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:14:49 - XML: Processed 655488 elements - found 880 jobs
Thu 16 Jan 2014 16:14:49 - job 7346384 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:14:49 - job 7346385 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:14:49 - job_xml_thread(): Found 2 updated jobs.
Thu 16 Jan 2014 16:14:49 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 16:14:49 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Thu 16 Jan 2014 16:14:49 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:14:49 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:14:52 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:14:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43939887
Thu 16 Jan 2014 16:14:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:14:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:14:53 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:14:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43939887
Thu 16 Jan 2014 16:14:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:14:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:14:54 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:14:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 16:14:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 16:14:55 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:14:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7512 values 118451 bits 14806 bytes 
Thu 16 Jan 2014 16:15:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:15:03 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:15:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:15:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:15:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:15:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:15:05 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:15:05 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:15:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:15:05 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:15:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:15:05 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:15:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:15:08 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:15:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:15:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:15:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:15:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:15:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:15:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:15:11 - Leaving storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 16:15:11 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Thu 16 Jan 2014 16:15:11 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:15:12 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:15:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43905006
Thu 16 Jan 2014 16:15:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:15:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43905006
Thu 16 Jan 2014 16:15:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:15:13 - job_xml_thread(): Done retrieving: data size 43905006
Thu 16 Jan 2014 16:15:13 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:15:13 - XML: Start document: iteration 9
Thu 16 Jan 2014 16:15:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:15:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:15:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:15:24 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:15:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:15:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:15:24 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:15:24 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:15:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:15:24 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:15:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:15:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:15:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:15:28 - XML: Processed 655490 elements - found 881 jobs
Thu 16 Jan 2014 16:15:28 - job_xml_thread(): Found 1 updated jobs.
Thu 16 Jan 2014 16:15:28 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 16:15:29 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Thu 16 Jan 2014 16:15:29 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:15:29 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:15:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:15:34 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:15:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:15:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:15:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:15:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:15:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:15:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:15:34 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:15:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 16:15:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:15:35 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:15:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43912106
Thu 16 Jan 2014 16:15:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:15:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43912106
Thu 16 Jan 2014 16:15:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:15:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:15:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:15:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:15:42 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:15:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:15:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:15:43 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:15:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:15:43 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:15:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43912106
Thu 16 Jan 2014 16:15:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:15:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:15:44 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:15:44 - job_xml_thread(): Done retrieving: data size 43912106
Thu 16 Jan 2014 16:15:44 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:15:44 - XML: Start document: iteration 10
Thu 16 Jan 2014 16:15:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:15:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:15:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:15:55 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:15:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:15:55 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:15:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 16:15:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 16:15:55 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:15:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5803 values 91521 bits 11440 bytes 
Thu 16 Jan 2014 16:15:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:15:56 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:15:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:15:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:15:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:15:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:15:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:15:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:15:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:15:57 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:15:58 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:15:58 - XML: Processed 655486 elements - found 879 jobs
Thu 16 Jan 2014 16:15:58 - job 7344323 appears to have finished
Thu 16 Jan 2014 16:15:58 - job 7344497 appears to have finished
Thu 16 Jan 2014 16:15:58 - job_xml_thread(): Found 2 updated jobs.
Thu 16 Jan 2014 16:15:58 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 16:15:58 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Thu 16 Jan 2014 16:15:58 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:15:58 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:15:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:15:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:15:58 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:15:58 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:15:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:15:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:16:00 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:16:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43933453
Thu 16 Jan 2014 16:16:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:16:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43933453
Thu 16 Jan 2014 16:16:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:16:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:16:09 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:16:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:16:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:16:13 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:16:13 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:16:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:16:13 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:16:13 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:16:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 16:16:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:16:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:16:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:16:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:16:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:16:14 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:16:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:16:14 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:16:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:16:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:16:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:16:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:16:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:16:15 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:16:15 - job_xml_thread(): Done retrieving: data size 43930965
Thu 16 Jan 2014 16:16:15 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:16:15 - XML: Start document: iteration 11
Thu 16 Jan 2014 16:16:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43930965
Thu 16 Jan 2014 16:16:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:16:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43930965
Thu 16 Jan 2014 16:16:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:16:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:16:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:16:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:16:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:16:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:16:38 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:16:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:16:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:16:38 - XML: Processed 655486 elements - found 879 jobs
Thu 16 Jan 2014 16:16:38 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 16:16:38 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 16:16:38 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:16:38 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:16:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:16:39 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:16:39 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:16:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:16:39 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:16:39 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:16:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:16:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:16:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:16:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:16:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:16:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:16:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:16:41 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:16:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43935084
Thu 16 Jan 2014 16:16:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:16:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43935084
Thu 16 Jan 2014 16:16:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:16:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:16:52 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:16:54 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:16:54 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:16:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:16:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:16:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:16:54 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:16:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:16:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:16:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:16:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:16:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:16:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:16:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:16:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:16:55 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:16:55 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:16:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:16:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:16:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:16:55 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:16:55 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:16:55 - job_xml_thread(): Done retrieving: data size 43934818
Thu 16 Jan 2014 16:16:55 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:16:55 - XML: Start document: iteration 12
Thu 16 Jan 2014 16:16:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43934818
Thu 16 Jan 2014 16:16:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43934818
Thu 16 Jan 2014 16:16:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:16:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:16:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:16:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 16:16:56 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:16:56 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:16:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9120 values 144125 bits 18015 bytes 
Thu 16 Jan 2014 16:16:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 16:17:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:17:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:17:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:17:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:17:12 - XML: Processed 655484 elements - found 878 jobs
Thu 16 Jan 2014 16:17:12 - job 7346387 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:17:12 - job 7346386 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:17:12 - job 7346226 appears to have finished
Thu 16 Jan 2014 16:17:12 - job_xml_thread(): Found 3 updated jobs.
Thu 16 Jan 2014 16:17:12 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 16:17:15 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Thu 16 Jan 2014 16:17:15 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:17:15 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:17:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:17:17 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:17:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:17:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:17:18 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:17:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:17:18 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:17:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:17:18 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:17:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:17:20 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:17:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:17:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:17:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:17:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:17:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:17:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:17:22 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:17:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875827
Thu 16 Jan 2014 16:17:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:17:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875827
Thu 16 Jan 2014 16:17:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:17:30 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:17:31 - job_xml_thread(): Done retrieving: data size 43875827
Thu 16 Jan 2014 16:17:31 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:17:31 - XML: Start document: iteration 13
Thu 16 Jan 2014 16:17:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:17:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:17:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:17:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:17:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:17:35 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:17:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:17:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:17:36 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:17:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:17:36 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:17:36 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:17:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:17:42 - XML: Processed 654734 elements - found 877 jobs
Thu 16 Jan 2014 16:17:42 - job 7346496 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7335259 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7346485 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7344343 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7344436 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7344341 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7344430 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7344433 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7346246 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7346413 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7335271 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7346387 field 'start_timestamp' changed since saved from: 1389885362 to: 1389885339
Thu 16 Jan 2014 16:17:42 - job 7346453 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7344338 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7346428 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7344419 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7346463 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7344492 appears to have finished
Thu 16 Jan 2014 16:17:42 - job 7337272 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7346462 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7335485 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7346487 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7346486 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7338343 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7346484 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7346483 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7346482 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7346481 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7346480 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7346489 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7335239 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7338025 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7341063 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7336194 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7345909 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7345647 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7337345 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7346300 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7346302 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7335250 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7335254 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7335255 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7344342 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7344340 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7344348 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7344349 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7344438 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7344439 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7343754 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7343751 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7346396 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7346238 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7346237 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7335197 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7336870 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7344337 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7344336 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7344335 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7343472 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7344333 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7344332 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7344331 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7344330 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7344339 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7339484 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7346436 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7346437 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7346434 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7346435 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7346432 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7346433 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7346430 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7346431 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7338784 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7346438 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7346439 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7337572 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7346528 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7335198 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7342714 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7344344 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7340972 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7337799 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7346520 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7344657 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7346521 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7335424 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7335423 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7335422 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7335421 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7346523 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7337400 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7336871 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7335196 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7335195 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7335194 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7335193 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7335192 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7335191 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7335190 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7336879 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7346097 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job 7335199 report time 1389885361 does not match current heartbeat 1389885405 : ignoring job
Thu 16 Jan 2014 16:17:42 - job_xml_thread(): Found 2 updated jobs.
Thu 16 Jan 2014 16:17:42 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 16:17:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:17:44 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:17:44 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Thu 16 Jan 2014 16:17:44 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:17:44 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:17:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:17:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:17:44 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:17:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 16:17:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:17:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:17:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:17:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:17:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:17:45 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:17:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43330230
Thu 16 Jan 2014 16:17:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:17:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43330230
Thu 16 Jan 2014 16:17:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:17:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:17:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:17:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:17:56 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:17:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:17:56 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:17:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:17:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:17:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:17:57 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:17:57 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:17:57 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:17:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:17:57 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:17:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 16:17:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:17:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:17:57 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:17:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 16:17:57 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:17:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5970 values 94507 bits 11813 bytes 
Thu 16 Jan 2014 16:17:59 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:17:59 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:17:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43264566
Thu 16 Jan 2014 16:17:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:18:00 - job_xml_thread(): Done retrieving: data size 43264566
Thu 16 Jan 2014 16:18:00 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:18:00 - XML: Start document: iteration 14
Thu 16 Jan 2014 16:18:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:18:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:18:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:18:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:18:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:18:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43264566
Thu 16 Jan 2014 16:18:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:18:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:18:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:18:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:18:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:18:16 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:18:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:18:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:18:16 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:18:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:18:16 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:18:16 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:18:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:18:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:18:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:18:18 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:18:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 16:18:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:18:19 - XML: Processed 647282 elements - found 877 jobs
Thu 16 Jan 2014 16:18:19 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 16:18:19 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 16:18:19 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:18:19 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:18:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:18:23 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:18:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:18:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:18:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:18:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:18:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:18:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:18:24 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:18:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43313378
Thu 16 Jan 2014 16:18:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:18:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43313378
Thu 16 Jan 2014 16:18:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:18:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:18:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:18:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:18:34 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:18:34 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:18:34 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:18:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:18:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:18:34 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:18:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:18:34 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:18:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:18:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:18:38 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:18:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:18:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:18:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:18:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:18:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:18:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:18:39 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:18:39 - job_xml_thread(): Done retrieving: data size 43695207
Thu 16 Jan 2014 16:18:39 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:18:39 - XML: Start document: iteration 15
Thu 16 Jan 2014 16:18:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43695207
Thu 16 Jan 2014 16:18:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:18:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43695207
Thu 16 Jan 2014 16:18:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:18:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:18:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:18:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:18:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:18:55 - XML: Processed 652760 elements - found 876 jobs
Thu 16 Jan 2014 16:18:55 - job 7346388 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:18:55 - job 7346311 appears to have finished
Thu 16 Jan 2014 16:18:55 - job_xml_thread(): Found 2 updated jobs.
Thu 16 Jan 2014 16:18:56 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 16:18:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:18:57 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:18:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:18:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:18:57 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:18:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:18:57 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:18:57 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:18:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:18:57 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:18:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:18:57 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Thu 16 Jan 2014 16:18:57 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:18:57 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:18:58 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:18:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:18:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 16:18:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 16:18:58 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:18:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9184 values 145091 bits 18136 bytes 
Thu 16 Jan 2014 16:18:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:18:59 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:18:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:18:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:19:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:19:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:19:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:19:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:19:02 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:19:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43914974
Thu 16 Jan 2014 16:19:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:19:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43914974
Thu 16 Jan 2014 16:19:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:19:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:19:09 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:19:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:19:12 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:19:13 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:19:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:19:13 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:19:13 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:19:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:19:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:19:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:19:13 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:19:13 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:19:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 16:19:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:19:15 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:19:15 - job_xml_thread(): Done retrieving: data size 43920875
Thu 16 Jan 2014 16:19:15 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:19:15 - XML: Start document: iteration 16
Thu 16 Jan 2014 16:19:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43920875
Thu 16 Jan 2014 16:19:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:19:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:19:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:19:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:19:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:19:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:19:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:19:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43920875
Thu 16 Jan 2014 16:19:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:19:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:19:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:19:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:19:29 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:19:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:19:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:19:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:19:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:19:31 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:19:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:19:31 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:19:31 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:19:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:19:34 - XML: Processed 655478 elements - found 875 jobs
Thu 16 Jan 2014 16:19:34 - job 7344321 appears to have finished
Thu 16 Jan 2014 16:19:34 - job_xml_thread(): Found 1 updated jobs.
Thu 16 Jan 2014 16:19:34 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 16:19:34 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Thu 16 Jan 2014 16:19:34 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:19:35 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:19:35 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 16:19:35 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 16:19:35 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Thu 16 Jan 2014 16:19:35 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:19:35 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 16:19:35 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:19:35 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:19:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:19:38 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:19:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:19:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:19:38 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 874657 values 13825736 bits 1728217 bytes 
Thu 16 Jan 2014 16:19:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:19:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:19:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:19:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:19:41 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:19:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43883904
Thu 16 Jan 2014 16:19:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:19:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43883904
Thu 16 Jan 2014 16:19:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:19:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:19:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:19:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:19:49 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:19:50 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:19:50 - job_xml_thread(): Done retrieving: data size 43883904
Thu 16 Jan 2014 16:19:50 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:19:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:19:50 - XML: Start document: iteration 17
Thu 16 Jan 2014 16:19:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:19:51 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:19:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:19:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43883904
Thu 16 Jan 2014 16:19:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:19:51 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:19:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:19:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:19:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:19:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:19:58 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:20:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:20:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 16:20:00 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:20:00 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:20:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 16:20:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8879 values 140037 bits 17504 bytes 
Thu 16 Jan 2014 16:20:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:20:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:20:06 - XML: Processed 655478 elements - found 875 jobs
Thu 16 Jan 2014 16:20:06 - job 7346389 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:20:06 - job_xml_thread(): Found 1 updated jobs.
Thu 16 Jan 2014 16:20:06 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 16:20:06 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Thu 16 Jan 2014 16:20:06 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:20:06 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:20:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:20:08 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:20:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:20:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:20:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:20:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:20:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:20:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:20:08 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:20:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:20:08 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:20:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:20:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:20:08 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:20:08 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:20:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:20:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:20:11 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:20:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43920910
Thu 16 Jan 2014 16:20:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:20:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43920910
Thu 16 Jan 2014 16:20:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:20:15 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:20:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 16:20:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:20:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:20:21 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:20:22 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:20:22 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:20:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:20:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:20:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:20:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:20:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:20:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:20:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:20:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:20:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:20:25 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:20:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:20:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:20:25 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:20:25 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:20:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:20:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:20:27 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:20:27 - job_xml_thread(): Done retrieving: data size 43920543
Thu 16 Jan 2014 16:20:27 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:20:27 - XML: Start document: iteration 18
Thu 16 Jan 2014 16:20:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43920543
Thu 16 Jan 2014 16:20:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:20:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43920543
Thu 16 Jan 2014 16:20:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:20:35 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:20:35 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 16:20:38 - XML: Processed 655480 elements - found 876 jobs
Thu 16 Jan 2014 16:20:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:20:38 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 16:20:38 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 16:20:38 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:20:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:20:38 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:20:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:20:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:20:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:20:45 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:20:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:20:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:20:46 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:20:46 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:20:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:20:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:20:46 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:20:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:20:46 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:20:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:20:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:20:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:20:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:20:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:20:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:20:50 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:20:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43937048
Thu 16 Jan 2014 16:20:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:20:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43937048
Thu 16 Jan 2014 16:20:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:20:53 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:20:54 - job_xml_thread(): Done retrieving: data size 43937048
Thu 16 Jan 2014 16:20:54 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:20:54 - XML: Start document: iteration 19
Thu 16 Jan 2014 16:21:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:21:00 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:21:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:21:00 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:21:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:21:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 16:21:01 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:21:01 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:21:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 16:21:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:21:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:21:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9367 values 147844 bits 18480 bytes 
Thu 16 Jan 2014 16:21:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:21:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:21:02 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:21:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:21:03 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:21:03 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:21:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:21:06 - XML: Processed 655480 elements - found 876 jobs
Thu 16 Jan 2014 16:21:07 - job 7346392 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:21:07 - job 7346391 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:21:07 - job 7346390 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:21:07 - job_xml_thread(): Found 3 updated jobs.
Thu 16 Jan 2014 16:21:07 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 16:21:07 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Thu 16 Jan 2014 16:21:07 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:21:07 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:21:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:21:12 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:21:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:21:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:21:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:21:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:21:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:21:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:21:15 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:21:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43895190
Thu 16 Jan 2014 16:21:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:21:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43895190
Thu 16 Jan 2014 16:21:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:21:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:21:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:21:22 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:21:22 - job_xml_thread(): Done retrieving: data size 43895190
Thu 16 Jan 2014 16:21:22 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:21:22 - XML: Start document: iteration 20
Thu 16 Jan 2014 16:21:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:21:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:21:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:21:30 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:21:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:21:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:21:31 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:21:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:21:31 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:21:31 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:21:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:21:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:21:38 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:21:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:21:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:21:38 - XML: Processed 655480 elements - found 876 jobs
Thu 16 Jan 2014 16:21:38 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 16:21:38 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 16:21:38 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:21:38 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:21:38 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:21:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 16:21:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:21:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:21:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:21:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:21:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:21:41 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:21:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43894964
Thu 16 Jan 2014 16:21:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:21:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43894964
Thu 16 Jan 2014 16:21:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:21:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:21:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:21:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:21:52 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:21:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:21:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:21:53 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:21:53 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:21:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:21:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:21:53 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:21:53 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:21:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:21:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:21:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:21:55 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:21:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:21:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:21:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:21:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:21:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:21:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:21:58 - Leaving storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 16:21:58 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Thu 16 Jan 2014 16:21:58 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:21:58 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:21:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43916531
Thu 16 Jan 2014 16:21:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:21:59 - job_xml_thread(): Done retrieving: data size 43916531
Thu 16 Jan 2014 16:21:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43916531
Thu 16 Jan 2014 16:21:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:21:59 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:21:59 - Housekeeping: checking database for timed out jobs..
Thu 16 Jan 2014 16:22:00 - Housekeeping: Found 0 timed out jobs in database: closing entries
Thu 16 Jan 2014 16:22:01 - Housekeeping: done.
Thu 16 Jan 2014 16:22:01 - XML: Start document: iteration 0
Thu 16 Jan 2014 16:22:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:22:02 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:22:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:22:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 16:22:05 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:22:05 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:22:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 16:22:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8845 values 139607 bits 17450 bytes 
Thu 16 Jan 2014 16:22:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:22:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:22:08 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:22:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:22:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:22:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:22:10 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:22:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:22:10 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:22:10 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:22:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:22:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:22:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:22:19 - XML: Processed 655475 elements - found 874 jobs
Thu 16 Jan 2014 16:22:19 - job 7344322 appears to have finished
Thu 16 Jan 2014 16:22:20 - job 7344494 appears to have finished
Thu 16 Jan 2014 16:22:20 - job_xml_thread(): Found 2 updated jobs.
Thu 16 Jan 2014 16:22:20 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 16:22:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:22:20 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:22:20 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Thu 16 Jan 2014 16:22:20 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:22:20 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:22:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:22:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:22:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:22:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:22:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:22:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:22:22 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:22:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 16:22:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:22:22 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:22:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43908315
Thu 16 Jan 2014 16:22:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:22:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43908315
Thu 16 Jan 2014 16:22:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:22:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:22:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:22:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:22:30 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:22:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:22:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:22:32 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:22:32 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:22:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:22:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:22:33 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:22:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:22:34 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:22:35 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:22:36 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:22:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43941251
Thu 16 Jan 2014 16:22:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:22:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:22:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:22:36 - job_xml_thread(): Done retrieving: data size 43941251
Thu 16 Jan 2014 16:22:36 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:22:37 - XML: Start document: iteration 1
Thu 16 Jan 2014 16:22:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:22:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:22:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43941251
Thu 16 Jan 2014 16:22:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:22:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:22:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:22:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:22:44 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:22:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:22:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:22:50 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:22:50 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:22:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:22:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:22:50 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:22:52 - XML: Processed 655476 elements - found 874 jobs
Thu 16 Jan 2014 16:22:52 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 16:22:52 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 16:22:52 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:22:52 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:22:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:22:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:22:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:22:56 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:22:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:22:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:22:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:22:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:22:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:22:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:22:57 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:22:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43912686
Thu 16 Jan 2014 16:22:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:22:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43912686
Thu 16 Jan 2014 16:22:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:23:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:23:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:23:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:23:05 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:23:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:23:06 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:23:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:23:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:23:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:23:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 16:23:07 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:23:07 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:23:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148698 bits 18587 bytes 
Thu 16 Jan 2014 16:23:07 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:23:07 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:23:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:23:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:23:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 16:23:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43912686
Thu 16 Jan 2014 16:23:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:23:07 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:23:07 - job_xml_thread(): Done retrieving: data size 43912686
Thu 16 Jan 2014 16:23:07 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:23:07 - XML: Start document: iteration 2
Thu 16 Jan 2014 16:23:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:23:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:23:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:23:19 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:23:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:23:20 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:23:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:23:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:23:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:23:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:23:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:23:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:23:22 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:23:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:23:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:23:23 - XML: Processed 655484 elements - found 878 jobs
Thu 16 Jan 2014 16:23:23 - job 36798 appears to have finished
Thu 16 Jan 2014 16:23:23 - job_xml_thread(): Found 6 updated jobs.
Thu 16 Jan 2014 16:23:23 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 16:23:23 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Thu 16 Jan 2014 16:23:23 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:23:23 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:23:23 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:23:23 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:23:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:23:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:23:25 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:23:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 16:23:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:23:25 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:23:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43860919
Thu 16 Jan 2014 16:23:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:23:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43860919
Thu 16 Jan 2014 16:23:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:23:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:23:36 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:23:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:23:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:23:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:23:38 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:23:38 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:23:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:23:39 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:23:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:23:39 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:23:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:23:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:23:39 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:23:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:23:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:23:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:23:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:23:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:23:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:23:41 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:23:41 - job_xml_thread(): Done retrieving: data size 43330416
Thu 16 Jan 2014 16:23:41 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:23:41 - XML: Start document: iteration 3
Thu 16 Jan 2014 16:23:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43330416
Thu 16 Jan 2014 16:23:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:23:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43330416
Thu 16 Jan 2014 16:23:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:23:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:23:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:23:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:23:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:23:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:23:55 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:23:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:23:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:23:56 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:23:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:23:56 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:23:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:23:56 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:23:57 - XML: Processed 648182 elements - found 881 jobs
Thu 16 Jan 2014 16:23:57 - job 7346366 appears to have finished
Thu 16 Jan 2014 16:23:57 - job 7346367 appears to have finished
Thu 16 Jan 2014 16:23:57 - job 7346364 appears to have finished
Thu 16 Jan 2014 16:23:57 - job_xml_thread(): Found 9 updated jobs.
Thu 16 Jan 2014 16:23:57 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 16:23:59 - job_xml_thread(): Done storing. succesfully stored: 9 jobs
Thu 16 Jan 2014 16:23:59 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:23:59 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:23:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:23:59 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:23:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:23:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:23:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:23:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:23:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:23:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:24:00 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:24:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43252487
Thu 16 Jan 2014 16:24:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:24:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43252487
Thu 16 Jan 2014 16:24:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:24:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:24:08 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:24:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:24:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 16:24:10 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:24:10 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:24:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9426 values 148703 bits 18587 bytes 
Thu 16 Jan 2014 16:24:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 16:24:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:24:11 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:24:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:24:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:24:12 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:24:12 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:24:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:24:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:24:12 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:24:14 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:24:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:24:14 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:24:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:24:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:24:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:24:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:24:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:24:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:24:16 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:24:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43323011
Thu 16 Jan 2014 16:24:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:24:17 - job_xml_thread(): Done retrieving: data size 43323011
Thu 16 Jan 2014 16:24:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43323011
Thu 16 Jan 2014 16:24:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:24:17 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:24:17 - XML: Start document: iteration 4
Thu 16 Jan 2014 16:24:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:24:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:24:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:24:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:24:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:24:30 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:24:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:24:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:24:32 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:24:32 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:24:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:24:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:24:33 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:24:34 - XML: Processed 648024 elements - found 881 jobs
Thu 16 Jan 2014 16:24:34 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 16:24:34 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 16:24:34 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:24:34 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:24:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:24:36 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:24:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:24:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:24:36 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:24:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 16:24:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:24:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:24:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:24:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:24:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:24:38 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:24:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43447574
Thu 16 Jan 2014 16:24:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:24:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43447574
Thu 16 Jan 2014 16:24:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:24:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:24:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:24:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:24:48 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:24:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:24:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:24:49 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:24:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:24:49 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:24:49 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:24:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:24:50 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:24:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:24:52 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:24:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:24:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:24:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:24:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:24:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:24:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:24:53 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:24:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870719
Thu 16 Jan 2014 16:24:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:24:54 - job_xml_thread(): Done retrieving: data size 43870719
Thu 16 Jan 2014 16:24:54 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:24:54 - XML: Start document: iteration 5
Thu 16 Jan 2014 16:24:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870719
Thu 16 Jan 2014 16:24:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:25:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:25:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:25:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:25:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:25:08 - XML: Processed 654908 elements - found 882 jobs
Thu 16 Jan 2014 16:25:10 - job_xml_thread(): Found 1 updated jobs.
Thu 16 Jan 2014 16:25:10 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 16:25:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:25:10 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:25:10 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Thu 16 Jan 2014 16:25:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:25:10 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:25:10 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:25:10 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:25:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 16:25:10 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:25:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9131 values 144042 bits 18005 bytes 
Thu 16 Jan 2014 16:25:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 16:25:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:25:11 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:25:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:25:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:25:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:25:12 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:25:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:25:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:25:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:25:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:25:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:25:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:25:12 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:25:12 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:25:12 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:25:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:25:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:25:15 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:25:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43914457
Thu 16 Jan 2014 16:25:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:25:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43914457
Thu 16 Jan 2014 16:25:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:25:18 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:25:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 16:25:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:25:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:25:24 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:25:25 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:25:26 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:25:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:25:27 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:25:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:25:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:25:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:25:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:25:27 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:25:27 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:25:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:25:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:25:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:25:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:25:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:25:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:25:28 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:25:28 - job_xml_thread(): Done retrieving: data size 43928714
Thu 16 Jan 2014 16:25:28 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:25:28 - XML: Start document: iteration 6
Thu 16 Jan 2014 16:25:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43928714
Thu 16 Jan 2014 16:25:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43928714
Thu 16 Jan 2014 16:25:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:25:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:25:38 - XML: Processed 655494 elements - found 883 jobs
Thu 16 Jan 2014 16:25:38 - job 7346393 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:25:39 - job 7346394 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:25:39 - job_xml_thread(): Found 3 updated jobs.
Thu 16 Jan 2014 16:25:39 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 16:25:40 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Thu 16 Jan 2014 16:25:40 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:25:40 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:25:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:25:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:25:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:25:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:25:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:25:43 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:25:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:25:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:25:43 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:25:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:25:43 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:25:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:25:44 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:25:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:25:46 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:25:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:25:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:25:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:25:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:25:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:25:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:25:48 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:25:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43918883
Thu 16 Jan 2014 16:25:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:25:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43918883
Thu 16 Jan 2014 16:25:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:25:55 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:25:55 - job_xml_thread(): Done retrieving: data size 43918883
Thu 16 Jan 2014 16:25:55 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:25:55 - XML: Start document: iteration 7
Thu 16 Jan 2014 16:25:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:25:58 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:25:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:25:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:26:00 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:26:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:26:00 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:26:00 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:26:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:26:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:26:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:26:08 - XML: Processed 655494 elements - found 883 jobs
Thu 16 Jan 2014 16:26:08 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 16:26:08 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 16:26:08 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:26:08 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:26:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:26:10 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:26:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:26:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:26:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:26:10 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:26:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:26:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 16:26:10 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:26:10 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:26:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 16:26:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9417 values 148512 bits 18564 bytes 
Thu 16 Jan 2014 16:26:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:26:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:26:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:26:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:26:12 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:26:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43888549
Thu 16 Jan 2014 16:26:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:26:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43888549
Thu 16 Jan 2014 16:26:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:26:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:26:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:26:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:26:21 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:26:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:26:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:26:22 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:26:22 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:26:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:26:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:26:22 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:26:23 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:26:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:26:25 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:26:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:26:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:26:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:26:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:26:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:26:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:26:26 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:26:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 16:26:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:26:28 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:26:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43913181
Thu 16 Jan 2014 16:26:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:26:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43913181
Thu 16 Jan 2014 16:26:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:26:29 - job_xml_thread(): Done retrieving: data size 43913181
Thu 16 Jan 2014 16:26:29 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:26:29 - XML: Start document: iteration 8
Thu 16 Jan 2014 16:26:37 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Thu 16 Jan 2014 16:26:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:26:37 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:26:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:26:39 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:26:39 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:26:39 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 16:26:39 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 16:26:39 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 16:26:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:26:39 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:26:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:26:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:26:40 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:26:40 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:26:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:26:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:26:41 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:26:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:26:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:26:45 - XML: Processed 655494 elements - found 883 jobs
Thu 16 Jan 2014 16:26:45 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 16:26:45 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 16:26:45 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:26:45 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:26:48 - size of cluster 'LISA Cluster': 624 hosts 79468 metrics 844198 values 13317696 bits 1664712 bytes 
Thu 16 Jan 2014 16:26:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:26:50 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:26:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:26:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:26:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:26:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:26:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:26:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:26:54 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:26:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43911490
Thu 16 Jan 2014 16:26:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:26:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43911490
Thu 16 Jan 2014 16:26:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:26:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:26:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:27:00 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:27:00 - job_xml_thread(): Done retrieving: data size 43911490
Thu 16 Jan 2014 16:27:00 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:27:00 - XML: Start document: iteration 9
Thu 16 Jan 2014 16:27:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:27:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:27:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:27:06 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:27:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:27:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:27:06 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:27:06 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:27:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:27:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:27:06 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:27:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:27:11 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:27:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:27:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 16:27:11 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:27:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 16:27:11 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:27:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8167 values 128726 bits 16090 bytes 
Thu 16 Jan 2014 16:27:13 - XML: Processed 655498 elements - found 885 jobs
Thu 16 Jan 2014 16:27:13 - job 7346395 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:27:13 - job 7346394 field 'start_timestamp' changed since saved from: 1389885916 to: 1389885862
Thu 16 Jan 2014 16:27:13 - job_xml_thread(): Found 4 updated jobs.
Thu 16 Jan 2014 16:27:13 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 16:27:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:27:13 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:27:13 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Thu 16 Jan 2014 16:27:13 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:27:13 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:27:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:27:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:27:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:27:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:27:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:27:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:27:16 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:27:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43909624
Thu 16 Jan 2014 16:27:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:27:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43909624
Thu 16 Jan 2014 16:27:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:27:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:27:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:27:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:27:25 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:27:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:27:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:27:26 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:27:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:27:26 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:27:26 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:27:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:27:28 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:27:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:27:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:27:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:27:29 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:27:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:27:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:27:30 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:27:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 16:27:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:27:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:27:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:27:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:27:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:27:32 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:27:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43912457
Thu 16 Jan 2014 16:27:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:27:33 - job_xml_thread(): Done retrieving: data size 43912457
Thu 16 Jan 2014 16:27:33 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:27:33 - XML: Start document: iteration 10
Thu 16 Jan 2014 16:27:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43912457
Thu 16 Jan 2014 16:27:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:27:39 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:27:39 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 16:27:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:27:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:27:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:27:43 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:27:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:27:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:27:45 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:27:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:27:45 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:27:45 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:27:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:27:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:27:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:27:51 - XML: Processed 655500 elements - found 886 jobs
Thu 16 Jan 2014 16:27:52 - job 7346396 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:27:52 - job_xml_thread(): Found 2 updated jobs.
Thu 16 Jan 2014 16:27:52 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 16:27:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:27:52 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:27:52 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Thu 16 Jan 2014 16:27:52 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:27:52 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:27:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:27:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:27:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:27:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:27:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:27:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:27:54 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:27:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43923424
Thu 16 Jan 2014 16:27:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:27:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43923424
Thu 16 Jan 2014 16:27:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:28:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:28:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:28:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:28:05 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:28:07 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:28:07 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:28:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:28:07 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:28:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:28:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:28:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:28:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:28:08 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:28:08 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:28:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:28:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:28:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:28:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:28:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:28:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:28:09 - Leaving storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 16:28:09 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Thu 16 Jan 2014 16:28:09 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:28:09 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:28:09 - job_xml_thread(): Done retrieving: data size 43944763
Thu 16 Jan 2014 16:28:09 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:28:09 - XML: Start document: iteration 11
Thu 16 Jan 2014 16:28:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43944763
Thu 16 Jan 2014 16:28:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:28:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43944763
Thu 16 Jan 2014 16:28:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:28:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:28:12 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:28:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:28:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 16:28:14 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:28:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 11873 values 187224 bits 23403 bytes 
Thu 16 Jan 2014 16:28:15 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:28:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 16:28:18 - XML: Processed 655500 elements - found 886 jobs
Thu 16 Jan 2014 16:28:18 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 16:28:18 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 16:28:18 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:28:18 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:28:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:28:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:28:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:28:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:28:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:28:26 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:28:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:28:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:28:28 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:28:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:28:28 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:28:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:28:28 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:28:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:28:29 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:28:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:28:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:28:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:28:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:28:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:28:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:28:32 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:28:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43926315
Thu 16 Jan 2014 16:28:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:28:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43926315
Thu 16 Jan 2014 16:28:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:28:33 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:28:33 - job_xml_thread(): Done retrieving: data size 43926315
Thu 16 Jan 2014 16:28:33 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:28:34 - XML: Start document: iteration 12
Thu 16 Jan 2014 16:28:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:28:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:28:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:28:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:28:46 - XML: Processed 655496 elements - found 884 jobs
Thu 16 Jan 2014 16:28:46 - job 7346323 appears to have finished
Thu 16 Jan 2014 16:28:47 - job 7346347 appears to have finished
Thu 16 Jan 2014 16:28:47 - job_xml_thread(): Found 2 updated jobs.
Thu 16 Jan 2014 16:28:47 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 16:28:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:28:49 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:28:49 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Thu 16 Jan 2014 16:28:49 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:28:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:28:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:28:49 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:28:49 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:28:49 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:28:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:28:49 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:28:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:28:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:28:51 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:28:51 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:28:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 16:28:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:28:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:28:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:28:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:28:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:28:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:28:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:28:53 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:28:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43940896
Thu 16 Jan 2014 16:28:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:28:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43940896
Thu 16 Jan 2014 16:28:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:29:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:29:01 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:29:04 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:29:04 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:29:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:29:04 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:29:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:29:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:29:05 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:29:05 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:29:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:29:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:29:06 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:29:06 - job_xml_thread(): Done retrieving: data size 43870900
Thu 16 Jan 2014 16:29:06 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:29:06 - XML: Start document: iteration 13
Thu 16 Jan 2014 16:29:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:29:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:29:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870900
Thu 16 Jan 2014 16:29:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:29:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:29:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:29:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:29:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870900
Thu 16 Jan 2014 16:29:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:29:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:29:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:29:15 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:29:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:29:17 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:29:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 16:29:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 16:29:17 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:29:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8958 values 141269 bits 17658 bytes 
Thu 16 Jan 2014 16:29:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:29:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:29:21 - XML: Processed 654766 elements - found 885 jobs
Thu 16 Jan 2014 16:29:21 - job 7346397 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:29:21 - job_xml_thread(): Found 2 updated jobs.
Thu 16 Jan 2014 16:29:21 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 16:29:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:29:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:29:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:29:22 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:29:22 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Thu 16 Jan 2014 16:29:22 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:29:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:29:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:29:22 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:29:23 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:29:23 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:29:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:29:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:29:23 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:29:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:29:25 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:29:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:29:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:29:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:29:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:29:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:29:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:29:27 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:29:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856209
Thu 16 Jan 2014 16:29:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:29:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43856209
Thu 16 Jan 2014 16:29:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:29:37 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:29:38 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:29:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:29:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:29:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:29:39 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:29:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:29:40 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:29:40 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:29:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 16:29:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:29:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:29:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:29:40 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:29:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:29:40 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:29:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:29:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:29:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:29:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:29:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:29:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:29:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:29:41 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:29:41 - job_xml_thread(): Done retrieving: data size 43342640
Thu 16 Jan 2014 16:29:41 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:29:41 - XML: Start document: iteration 14
Thu 16 Jan 2014 16:29:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43342640
Thu 16 Jan 2014 16:29:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43342640
Thu 16 Jan 2014 16:29:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:29:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:29:49 - XML: Processed 648336 elements - found 883 jobs
Thu 16 Jan 2014 16:29:49 - job 7346372 appears to have finished
Thu 16 Jan 2014 16:29:49 - job 7346400 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:29:49 - job 7346399 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:29:49 - job 7346398 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:29:49 - job 7346317 appears to have finished
Thu 16 Jan 2014 16:29:49 - job_xml_thread(): Found 5 updated jobs.
Thu 16 Jan 2014 16:29:49 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 16:29:52 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Thu 16 Jan 2014 16:29:52 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:29:52 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:29:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:29:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:29:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:29:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:29:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:29:57 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:29:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:29:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:29:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:29:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:29:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:29:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:29:59 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:30:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:30:00 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:30:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:30:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:30:01 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:30:01 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:30:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:30:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:30:01 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:30:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43276016
Thu 16 Jan 2014 16:30:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:30:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43276016
Thu 16 Jan 2014 16:30:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:30:07 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:30:08 - job_xml_thread(): Done retrieving: data size 43276016
Thu 16 Jan 2014 16:30:08 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:30:08 - XML: Start document: iteration 15
Thu 16 Jan 2014 16:30:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:30:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:30:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:30:14 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:30:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:30:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:30:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:30:17 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:30:18 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:30:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:30:18 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:30:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:30:18 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:30:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:30:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 16:30:18 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:30:18 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:30:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9300 values 146674 bits 18334 bytes 
Thu 16 Jan 2014 16:30:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 16:30:21 - XML: Processed 647294 elements - found 883 jobs
Thu 16 Jan 2014 16:30:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:30:21 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 16:30:21 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:30:21 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 16:30:21 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:30:21 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:30:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:30:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:30:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:30:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:30:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:30:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:30:24 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:30:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43339986
Thu 16 Jan 2014 16:30:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:30:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43339986
Thu 16 Jan 2014 16:30:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:30:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:30:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:30:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:30:35 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:30:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:30:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:30:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:30:37 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:30:37 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:30:37 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:30:37 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:30:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:30:37 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:30:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:30:37 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:30:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 16:30:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:30:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:30:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:30:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:30:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:30:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:30:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:30:38 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:30:38 - job_xml_thread(): Done retrieving: data size 43433078
Thu 16 Jan 2014 16:30:38 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:30:38 - XML: Start document: iteration 16
Thu 16 Jan 2014 16:30:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43433078
Thu 16 Jan 2014 16:30:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:30:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43433078
Thu 16 Jan 2014 16:30:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:30:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:30:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:30:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:30:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:30:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:30:54 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:30:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:30:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:30:55 - XML: Processed 649134 elements - found 882 jobs
Thu 16 Jan 2014 16:30:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:30:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:30:55 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:30:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:30:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:30:55 - job 7346304 appears to have finished
Thu 16 Jan 2014 16:30:55 - job_xml_thread(): Found 1 updated jobs.
Thu 16 Jan 2014 16:30:55 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 16:30:55 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Thu 16 Jan 2014 16:30:55 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:30:55 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:30:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:30:58 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:30:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:30:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:30:59 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:30:59 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:30:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:30:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:30:59 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:30:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43912588
Thu 16 Jan 2014 16:30:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:31:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43912588
Thu 16 Jan 2014 16:31:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:31:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:31:09 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:31:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:31:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:31:11 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:31:11 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:31:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:31:11 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:31:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:31:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:31:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:31:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:31:13 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:31:13 - job_xml_thread(): Done retrieving: data size 43923959
Thu 16 Jan 2014 16:31:13 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:31:13 - XML: Start document: iteration 17
Thu 16 Jan 2014 16:31:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43923959
Thu 16 Jan 2014 16:31:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:31:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:31:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:31:15 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:31:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:31:15 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:31:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:31:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43923959
Thu 16 Jan 2014 16:31:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:31:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:31:20 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:31:20 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:31:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:31:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 16:31:20 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:31:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 16:31:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 12298 values 194207 bits 24275 bytes 
Thu 16 Jan 2014 16:31:23 - XML: Processed 655490 elements - found 881 jobs
Thu 16 Jan 2014 16:31:23 - job 7346292 appears to have finished
Thu 16 Jan 2014 16:31:23 - job_xml_thread(): Found 1 updated jobs.
Thu 16 Jan 2014 16:31:23 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 16:31:24 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Thu 16 Jan 2014 16:31:24 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:31:24 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:31:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:31:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:31:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:31:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:31:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:31:30 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:31:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:31:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:31:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:31:31 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:31:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:31:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:31:31 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:31:31 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:31:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:31:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:31:31 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:31:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:31:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:31:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:31:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:31:33 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:31:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43922687
Thu 16 Jan 2014 16:31:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:31:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43922687
Thu 16 Jan 2014 16:31:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:31:39 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:31:39 - job_xml_thread(): Done retrieving: data size 43922687
Thu 16 Jan 2014 16:31:39 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:31:39 - XML: Start document: iteration 18
Thu 16 Jan 2014 16:31:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:31:44 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:31:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:31:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:31:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:31:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:31:47 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:31:47 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:31:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:31:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:31:47 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:31:51 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:31:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 16:31:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:31:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:31:54 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:31:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:31:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:31:55 - XML: Processed 655488 elements - found 880 jobs
Thu 16 Jan 2014 16:31:55 - job 7346402 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:31:55 - job 7346401 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:31:55 - job 7344500 appears to have finished
Thu 16 Jan 2014 16:31:55 - job_xml_thread(): Found 3 updated jobs.
Thu 16 Jan 2014 16:31:55 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 16:31:55 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Thu 16 Jan 2014 16:31:55 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:31:55 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:31:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:31:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:31:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:31:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:31:56 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:31:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43912413
Thu 16 Jan 2014 16:31:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:31:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43912413
Thu 16 Jan 2014 16:31:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:32:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:32:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:32:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:32:06 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:32:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:32:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:32:08 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:32:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:32:08 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:32:08 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:32:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:32:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:32:08 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:32:10 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:32:10 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:32:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43946310
Thu 16 Jan 2014 16:32:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:32:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:32:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:32:11 - job_xml_thread(): Done retrieving: data size 43946310
Thu 16 Jan 2014 16:32:11 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:32:12 - XML: Start document: iteration 19
Thu 16 Jan 2014 16:32:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:32:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:32:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43946310
Thu 16 Jan 2014 16:32:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:32:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:32:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:32:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:32:21 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:32:22 - XML: Processed 655488 elements - found 880 jobs
Thu 16 Jan 2014 16:32:22 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 16:32:22 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 16:32:22 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:32:22 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:32:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:32:23 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:32:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 16:32:23 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:32:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 16:32:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:32:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:32:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9302 values 147124 bits 18390 bytes 
Thu 16 Jan 2014 16:32:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:32:24 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:32:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:32:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:32:25 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:32:25 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:32:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:32:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:32:25 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:32:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:32:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:32:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:32:28 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:32:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:32:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:32:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:32:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:32:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:32:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:32:30 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:32:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43920539
Thu 16 Jan 2014 16:32:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:32:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43920539
Thu 16 Jan 2014 16:32:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:32:38 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:32:38 - job_xml_thread(): Done retrieving: data size 43920539
Thu 16 Jan 2014 16:32:38 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:32:38 - XML: Start document: iteration 20
Thu 16 Jan 2014 16:32:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:32:38 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:32:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:32:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:32:41 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:32:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:32:41 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:32:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:32:41 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:32:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:32:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:32:47 - XML: Processed 655478 elements - found 880 jobs
Thu 16 Jan 2014 16:32:47 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 16:32:47 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 16:32:47 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:32:47 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:32:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:32:49 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:32:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:32:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:32:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:32:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:32:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:32:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:32:50 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:32:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 16:32:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:32:51 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:32:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43906717
Thu 16 Jan 2014 16:32:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:32:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43906717
Thu 16 Jan 2014 16:32:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:32:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:32:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:33:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:33:02 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:33:02 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:33:02 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:33:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:33:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:33:02 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:33:02 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:33:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:33:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:33:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:33:05 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:33:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:33:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:33:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:33:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:33:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:33:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:33:06 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:33:06 - job_xml_thread(): Done retrieving: data size 43924455
Thu 16 Jan 2014 16:33:06 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:33:06 - Housekeeping: checking database for timed out jobs..
Thu 16 Jan 2014 16:33:06 - Housekeeping: Found 0 timed out jobs in database: closing entries
Thu 16 Jan 2014 16:33:06 - Housekeeping: done.
Thu 16 Jan 2014 16:33:06 - XML: Start document: iteration 0
Thu 16 Jan 2014 16:33:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43924455
Thu 16 Jan 2014 16:33:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43924455
Thu 16 Jan 2014 16:33:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:33:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:33:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:33:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:33:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:33:19 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:33:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:33:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:33:22 - XML: Processed 655486 elements - found 879 jobs
Thu 16 Jan 2014 16:33:22 - job 7346404 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:33:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:33:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:33:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:33:22 - job 7346402 field 'start_timestamp' changed since saved from: 1389886292 to: 1389886239
Thu 16 Jan 2014 16:33:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:33:22 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:33:22 - job 7346403 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:33:23 - job 7346289 appears to have finished
Thu 16 Jan 2014 16:33:23 - job_xml_thread(): Found 4 updated jobs.
Thu 16 Jan 2014 16:33:23 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 16:33:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:33:24 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:33:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:33:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 16:33:25 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:33:25 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:33:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 16:33:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8573 values 135537 bits 16942 bytes 
Thu 16 Jan 2014 16:33:25 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Thu 16 Jan 2014 16:33:25 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:33:25 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:33:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:33:26 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:33:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:33:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:33:27 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:33:27 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:33:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:33:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:33:28 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:33:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43924357
Thu 16 Jan 2014 16:33:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:33:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43924357
Thu 16 Jan 2014 16:33:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:33:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:33:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:33:39 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Thu 16 Jan 2014 16:33:39 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:33:40 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:33:40 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 16:33:40 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 16:33:40 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:33:40 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 16:33:41 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:33:41 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:33:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:33:41 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:33:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:33:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:33:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:33:42 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:33:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:33:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:33:42 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 933418 values 14754545 bits 1844318 bytes 
Thu 16 Jan 2014 16:33:42 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:33:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:33:42 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:33:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:33:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:33:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:33:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:33:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:33:43 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:33:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 16:33:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:33:45 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:33:45 - job_xml_thread(): Done retrieving: data size 43927162
Thu 16 Jan 2014 16:33:45 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:33:45 - XML: Start document: iteration 1
Thu 16 Jan 2014 16:33:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43927162
Thu 16 Jan 2014 16:33:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:33:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43927162
Thu 16 Jan 2014 16:33:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:33:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:33:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:33:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:33:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:33:59 - XML: Processed 655486 elements - found 879 jobs
Thu 16 Jan 2014 16:33:59 - job 7346403 field 'start_timestamp' changed since saved from: 1389886339 to: 1389886253
Thu 16 Jan 2014 16:33:59 - job 7346512 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:33:59 - job_xml_thread(): Found 2 updated jobs.
Thu 16 Jan 2014 16:33:59 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 16:34:00 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Thu 16 Jan 2014 16:34:00 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:34:00 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:34:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:34:03 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:34:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:34:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:34:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:34:03 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:34:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:34:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:34:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:34:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:34:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:34:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:34:04 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:34:04 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:34:04 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:34:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:34:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:34:06 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:34:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43932509
Thu 16 Jan 2014 16:34:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:34:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43932509
Thu 16 Jan 2014 16:34:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:34:15 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:34:15 - job_xml_thread(): Done retrieving: data size 43932509
Thu 16 Jan 2014 16:34:15 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:34:15 - XML: Start document: iteration 2
Thu 16 Jan 2014 16:34:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:34:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:34:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:34:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:34:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:34:22 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:34:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:34:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:34:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:34:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:34:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:34:22 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:34:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:34:23 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:34:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:34:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:34:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:34:24 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:34:24 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:34:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:34:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:34:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:34:25 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:34:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:34:25 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:34:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 16:34:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 16:34:25 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:34:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8861 values 139980 bits 17497 bytes 
Thu 16 Jan 2014 16:34:26 - XML: Processed 655476 elements - found 879 jobs
Thu 16 Jan 2014 16:34:26 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 16:34:26 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 16:34:26 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:34:26 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:34:30 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:34:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43933041
Thu 16 Jan 2014 16:34:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:34:30 - Leaving storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 16:34:30 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Thu 16 Jan 2014 16:34:30 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:34:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43933041
Thu 16 Jan 2014 16:34:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:34:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:34:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:34:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:34:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:34:41 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:34:41 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:34:41 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:34:41 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 16:34:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:34:41 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:34:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:34:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:34:41 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:34:42 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:34:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:34:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:34:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:34:44 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:34:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:34:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:34:44 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:34:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 16:34:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:34:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:34:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:34:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:34:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:34:45 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:34:45 - job_xml_thread(): Done retrieving: data size 43926299
Thu 16 Jan 2014 16:34:45 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:34:45 - XML: Start document: iteration 3
Thu 16 Jan 2014 16:34:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43926299
Thu 16 Jan 2014 16:34:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43926299
Thu 16 Jan 2014 16:34:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:34:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:34:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:34:54 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:34:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:34:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:34:57 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:34:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:34:57 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:34:57 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:34:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:35:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:35:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:35:03 - XML: Processed 655481 elements - found 877 jobs
Thu 16 Jan 2014 16:35:04 - job 7346172 appears to have finished
Thu 16 Jan 2014 16:35:04 - job 7344501 appears to have finished
Thu 16 Jan 2014 16:35:04 - job_xml_thread(): Found 2 updated jobs.
Thu 16 Jan 2014 16:35:04 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 16:35:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:35:04 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:35:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:35:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:35:05 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Thu 16 Jan 2014 16:35:05 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:35:05 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:35:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:35:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:35:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:35:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:35:06 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:35:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43907830
Thu 16 Jan 2014 16:35:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:35:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43907830
Thu 16 Jan 2014 16:35:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:35:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:35:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:35:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:35:15 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:35:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:35:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:35:16 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:35:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:35:16 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:35:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43907830
Thu 16 Jan 2014 16:35:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:35:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:35:20 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:35:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:35:20 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:35:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:35:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:35:26 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:35:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:35:26 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:35:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 16:35:26 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:35:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 16:35:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9015 values 142216 bits 17777 bytes 
Thu 16 Jan 2014 16:35:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:35:28 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:35:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:35:29 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:35:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:35:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:35:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:35:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:35:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:35:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:35:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:35:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:35:31 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:35:31 - job_xml_thread(): Done retrieving: data size 43830693
Thu 16 Jan 2014 16:35:31 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:35:31 - XML: Start document: iteration 4
Thu 16 Jan 2014 16:35:31 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:35:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:35:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43830693
Thu 16 Jan 2014 16:35:31 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:35:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:35:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:35:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43830693
Thu 16 Jan 2014 16:35:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:35:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:35:40 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:35:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:35:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:35:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:35:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:35:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:35:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:35:46 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:35:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:35:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:35:47 - XML: Processed 654730 elements - found 875 jobs
Thu 16 Jan 2014 16:35:47 - job 7346379 appears to have finished
Thu 16 Jan 2014 16:35:47 - job 7346409 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:35:47 - job 7346408 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:35:47 - job 7346407 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:35:47 - job 7346406 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:35:47 - job 7346157 appears to have finished
Thu 16 Jan 2014 16:35:47 - job 7346405 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:35:47 - job 7346512 field 'start_timestamp' changed since saved from: 1389886422 to: 1389886358
Thu 16 Jan 2014 16:35:47 - job_xml_thread(): Found 8 updated jobs.
Thu 16 Jan 2014 16:35:47 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 16:35:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:35:49 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:35:49 - job_xml_thread(): Done storing. succesfully stored: 8 jobs
Thu 16 Jan 2014 16:35:49 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:35:49 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:35:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:35:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:35:50 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:35:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 16:35:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:35:50 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:35:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:35:50 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:35:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:35:51 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:35:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43271380
Thu 16 Jan 2014 16:35:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:35:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43271380
Thu 16 Jan 2014 16:35:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:36:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:36:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:36:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:36:01 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:36:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:36:04 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:36:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:36:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:36:04 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:36:04 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:36:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:36:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:36:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:36:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:36:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:36:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:36:06 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:36:06 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:36:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:36:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:36:06 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:36:06 - job_xml_thread(): Done retrieving: data size 43274938
Thu 16 Jan 2014 16:36:06 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:36:06 - XML: Start document: iteration 5
Thu 16 Jan 2014 16:36:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43274938
Thu 16 Jan 2014 16:36:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:36:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43274938
Thu 16 Jan 2014 16:36:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:36:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:36:20 - XML: Processed 647352 elements - found 875 jobs
Thu 16 Jan 2014 16:36:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:36:20 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 16:36:20 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 16:36:20 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:36:20 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:36:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:36:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:36:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:36:22 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:36:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:36:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:36:23 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:36:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:36:23 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:36:23 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:36:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:36:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:36:25 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:36:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:36:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:36:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:36:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:36:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:36:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:36:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:36:26 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:36:27 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:36:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43352099
Thu 16 Jan 2014 16:36:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:36:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43352099
Thu 16 Jan 2014 16:36:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:36:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 16:36:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:36:27 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:36:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8877 values 139982 bits 17497 bytes 
Thu 16 Jan 2014 16:36:27 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:36:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 16:36:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:36:35 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:36:36 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:36:36 - job_xml_thread(): Done retrieving: data size 43352099
Thu 16 Jan 2014 16:36:36 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:36:36 - XML: Start document: iteration 6
Thu 16 Jan 2014 16:36:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:36:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:36:40 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:36:40 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:36:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:36:40 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:36:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:36:41 - XML: Processed 648026 elements - found 875 jobs
Thu 16 Jan 2014 16:36:41 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 16:36:41 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 16:36:41 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:36:41 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:36:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:36:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:36:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:36:45 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:36:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:36:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:36:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:36:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:36:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:36:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:36:47 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:36:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 16:36:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:36:47 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:36:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43824338
Thu 16 Jan 2014 16:36:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:36:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43824338
Thu 16 Jan 2014 16:36:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:36:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:36:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:36:56 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:36:56 - job_xml_thread(): Done retrieving: data size 43824338
Thu 16 Jan 2014 16:36:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:36:56 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:36:56 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:36:56 - XML: Start document: iteration 7
Thu 16 Jan 2014 16:36:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:36:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:36:59 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:36:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:36:59 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:36:59 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:36:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:37:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:37:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:37:04 - XML: Processed 654512 elements - found 874 jobs
Thu 16 Jan 2014 16:37:04 - job 7346410 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:37:04 - job 7346411 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:37:04 - job 7346229 appears to have finished
Thu 16 Jan 2014 16:37:04 - job_xml_thread(): Found 3 updated jobs.
Thu 16 Jan 2014 16:37:04 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 16:37:07 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Thu 16 Jan 2014 16:37:07 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:37:07 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:37:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:37:08 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:37:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:37:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:37:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:37:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:37:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:37:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:37:09 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:37:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43907597
Thu 16 Jan 2014 16:37:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:37:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43907597
Thu 16 Jan 2014 16:37:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:37:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:37:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:37:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:37:18 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:37:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:37:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:37:19 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:37:19 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:37:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:37:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:37:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43907597
Thu 16 Jan 2014 16:37:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:37:22 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:37:22 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:37:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:37:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:37:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:37:28 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:37:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:37:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 16:37:29 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:37:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6282 values 99137 bits 12392 bytes 
Thu 16 Jan 2014 16:37:29 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:37:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:37:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 16:37:30 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:37:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:37:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:37:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:37:31 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:37:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:37:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:37:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:37:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:37:33 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:37:33 - job_xml_thread(): Done retrieving: data size 43887211
Thu 16 Jan 2014 16:37:33 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:37:33 - XML: Start document: iteration 8
Thu 16 Jan 2014 16:37:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43887211
Thu 16 Jan 2014 16:37:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:37:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:37:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:37:35 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:37:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:37:35 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:37:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:37:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43887211
Thu 16 Jan 2014 16:37:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:37:39 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:37:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 16:37:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:37:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:37:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:37:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:37:50 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:37:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:37:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:37:51 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:37:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:37:51 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:37:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:37:51 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:37:53 - XML: Processed 655470 elements - found 871 jobs
Thu 16 Jan 2014 16:37:53 - job 7344325 appears to have finished
Thu 16 Jan 2014 16:37:53 - job 7346356 appears to have finished
Thu 16 Jan 2014 16:37:53 - job 7346267 appears to have finished
Thu 16 Jan 2014 16:37:53 - job_xml_thread(): Found 3 updated jobs.
Thu 16 Jan 2014 16:37:53 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 16:37:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:37:54 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:37:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:37:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:37:54 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Thu 16 Jan 2014 16:37:54 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:37:54 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:37:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:37:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:37:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:37:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:37:56 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:37:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43943296
Thu 16 Jan 2014 16:37:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:37:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43943296
Thu 16 Jan 2014 16:37:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:38:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:38:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:38:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:38:07 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:38:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:38:08 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:38:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:38:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:38:09 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:38:09 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:38:09 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:38:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:38:09 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:38:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:38:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:38:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:38:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:38:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:38:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:38:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:38:15 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:38:15 - job_xml_thread(): Done retrieving: data size 43929531
Thu 16 Jan 2014 16:38:15 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:38:15 - XML: Start document: iteration 9
Thu 16 Jan 2014 16:38:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43929531
Thu 16 Jan 2014 16:38:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43929531
Thu 16 Jan 2014 16:38:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:38:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:38:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:38:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:38:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:38:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:38:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:38:30 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:38:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:38:30 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:38:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 16:38:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 16:38:30 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:38:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9398 values 148280 bits 18535 bytes 
Thu 16 Jan 2014 16:38:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:38:30 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:38:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:38:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:38:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:38:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:38:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:38:31 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:38:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:38:33 - XML: Processed 655470 elements - found 871 jobs
Thu 16 Jan 2014 16:38:33 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 16:38:33 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 16:38:33 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:38:33 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:38:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:38:34 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:38:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:38:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:38:34 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:38:34 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:38:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:38:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:38:36 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:38:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 16:38:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:38:37 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:38:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43925542
Thu 16 Jan 2014 16:38:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:38:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43925542
Thu 16 Jan 2014 16:38:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:38:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:38:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:38:48 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:38:48 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:38:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:38:48 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:38:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:38:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:38:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:38:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:38:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:38:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:38:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:38:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:38:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:38:50 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:38:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:38:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:38:50 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:38:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:38:50 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:38:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:38:51 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:38:51 - job_xml_thread(): Done retrieving: data size 43927111
Thu 16 Jan 2014 16:38:51 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:38:51 - XML: Start document: iteration 10
Thu 16 Jan 2014 16:38:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43927111
Thu 16 Jan 2014 16:38:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:38:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43927111
Thu 16 Jan 2014 16:38:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:39:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:39:04 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:39:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:39:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:39:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:39:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:39:07 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:39:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:39:07 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:39:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:39:07 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:39:07 - XML: Processed 655470 elements - found 871 jobs
Thu 16 Jan 2014 16:39:07 - job 7344324 appears to have finished
Thu 16 Jan 2014 16:39:07 - job 7346412 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:39:07 - job 7346413 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:39:07 - job_xml_thread(): Found 4 updated jobs.
Thu 16 Jan 2014 16:39:07 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 16:39:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:39:08 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:39:08 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Thu 16 Jan 2014 16:39:08 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:39:08 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:39:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:39:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:39:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:39:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:39:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:39:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:39:10 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:39:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43940479
Thu 16 Jan 2014 16:39:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:39:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43940479
Thu 16 Jan 2014 16:39:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:39:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:39:21 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:39:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:39:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:39:23 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:39:23 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:39:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:39:23 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:39:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:39:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:39:23 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:39:23 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:39:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:39:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:39:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:39:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:39:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:39:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:39:25 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:39:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43936749
Thu 16 Jan 2014 16:39:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:39:25 - job_xml_thread(): Done retrieving: data size 43936749
Thu 16 Jan 2014 16:39:25 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:39:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43936749
Thu 16 Jan 2014 16:39:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:39:26 - XML: Start document: iteration 11
Thu 16 Jan 2014 16:39:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:39:30 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:39:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:39:33 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:39:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 16:39:33 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:39:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 16:39:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 12560 values 198075 bits 24759 bytes 
Thu 16 Jan 2014 16:39:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:39:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:39:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:39:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:39:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:39:43 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:39:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:39:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:39:43 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:39:43 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:39:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:39:43 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:39:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:39:44 - XML: Processed 655466 elements - found 869 jobs
Thu 16 Jan 2014 16:39:44 - job 7346378 appears to have finished
Thu 16 Jan 2014 16:39:44 - job 7346358 appears to have finished
Thu 16 Jan 2014 16:39:44 - job_xml_thread(): Found 2 updated jobs.
Thu 16 Jan 2014 16:39:44 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 16:39:44 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Thu 16 Jan 2014 16:39:44 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:39:44 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:39:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:39:45 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:39:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:39:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:39:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:39:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:39:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:39:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:39:47 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:39:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43905528
Thu 16 Jan 2014 16:39:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:39:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43905528
Thu 16 Jan 2014 16:39:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:39:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:39:57 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:39:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:39:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:39:59 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:39:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:39:59 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:39:59 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:39:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:39:59 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:40:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:40:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:40:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:40:01 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:40:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:40:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:40:01 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:40:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 16:40:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:40:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:40:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:40:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:40:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:40:03 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:40:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43906898
Thu 16 Jan 2014 16:40:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:40:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43906898
Thu 16 Jan 2014 16:40:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:40:04 - job_xml_thread(): Done retrieving: data size 43906898
Thu 16 Jan 2014 16:40:04 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:40:05 - XML: Start document: iteration 12
Thu 16 Jan 2014 16:40:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:40:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:40:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:40:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:40:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:40:16 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:40:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:40:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:40:17 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:40:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:40:18 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:40:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:40:19 - XML: Processed 655468 elements - found 870 jobs
Thu 16 Jan 2014 16:40:19 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:40:19 - job 7346413 field 'start_timestamp' changed since saved from: 1389886719 to: 1389886668
Thu 16 Jan 2014 16:40:19 - job_xml_thread(): Found 2 updated jobs.
Thu 16 Jan 2014 16:40:20 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 16:40:21 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Thu 16 Jan 2014 16:40:21 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:40:21 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:40:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:40:22 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:40:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:40:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:40:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:40:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:40:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:40:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:40:24 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:40:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43933659
Thu 16 Jan 2014 16:40:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:40:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43933659
Thu 16 Jan 2014 16:40:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:40:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:40:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:40:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:40:34 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:40:35 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:40:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 16:40:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:40:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 16:40:35 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:40:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8847 values 139525 bits 17440 bytes 
Thu 16 Jan 2014 16:40:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:40:35 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:40:36 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:40:36 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:40:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:40:37 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:40:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:40:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:40:38 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:40:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:40:38 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:40:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:40:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:40:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:40:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:40:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:40:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:40:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:40:39 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:40:39 - job_xml_thread(): Done retrieving: data size 43937591
Thu 16 Jan 2014 16:40:39 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:40:39 - XML: Start document: iteration 13
Thu 16 Jan 2014 16:40:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43937591
Thu 16 Jan 2014 16:40:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:40:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43937591
Thu 16 Jan 2014 16:40:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:40:41 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Thu 16 Jan 2014 16:40:41 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:40:43 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:40:43 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 16:40:43 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:40:43 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 16:40:43 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 16:40:44 - size of cluster 'LISA Cluster': 624 hosts 79470 metrics 906175 values 14293973 bits 1786746 bytes 
Thu 16 Jan 2014 16:40:51 - XML: Processed 655468 elements - found 870 jobs
Thu 16 Jan 2014 16:40:51 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 16:40:52 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 16:40:52 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:40:52 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:40:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:40:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:40:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:40:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:40:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:40:56 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:40:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:40:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:40:57 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:40:57 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:40:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:40:57 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:40:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:41:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:41:00 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:41:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:41:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:41:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:41:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:41:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:41:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:41:01 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:41:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 16:41:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:41:03 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:41:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43906600
Thu 16 Jan 2014 16:41:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:41:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43906600
Thu 16 Jan 2014 16:41:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:41:07 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:41:07 - job_xml_thread(): Done retrieving: data size 43906600
Thu 16 Jan 2014 16:41:07 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:41:07 - XML: Start document: iteration 14
Thu 16 Jan 2014 16:41:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:41:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:41:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:41:13 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:41:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:41:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:41:14 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:41:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:41:15 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:41:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:41:15 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:41:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:41:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:41:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:41:20 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:41:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:41:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:41:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:41:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:41:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:41:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:41:22 - XML: Processed 655468 elements - found 870 jobs
Thu 16 Jan 2014 16:41:22 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 16:41:22 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 16:41:22 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:41:22 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:41:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:41:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:41:30 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:41:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43824607
Thu 16 Jan 2014 16:41:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:41:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43824607
Thu 16 Jan 2014 16:41:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:41:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:41:35 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:41:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:41:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 16:41:35 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:41:35 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:41:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8616 values 135831 bits 16978 bytes 
Thu 16 Jan 2014 16:41:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 16:41:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:41:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:41:38 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:41:38 - job_xml_thread(): Done retrieving: data size 43824607
Thu 16 Jan 2014 16:41:38 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:41:38 - XML: Start document: iteration 15
Thu 16 Jan 2014 16:41:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:41:41 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:41:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:41:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:41:43 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:41:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:41:43 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:41:43 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:41:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:41:43 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:41:43 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 16:41:48 - XML: Processed 654718 elements - found 869 jobs
Thu 16 Jan 2014 16:41:48 - job 7336746 appears to have finished
Thu 16 Jan 2014 16:41:48 - job_xml_thread(): Found 1 updated jobs.
Thu 16 Jan 2014 16:41:48 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 16:41:48 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Thu 16 Jan 2014 16:41:48 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:41:48 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:41:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:41:49 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:41:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:41:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:41:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:41:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:41:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:41:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:41:52 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:41:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43294334
Thu 16 Jan 2014 16:41:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:41:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43294334
Thu 16 Jan 2014 16:41:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:41:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:41:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:42:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:42:00 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:42:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:42:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:42:00 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:42:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:42:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43294334
Thu 16 Jan 2014 16:42:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:42:00 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:42:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:42:03 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:42:04 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:42:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:42:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:42:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:42:12 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:42:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:42:14 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:42:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:42:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:42:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:42:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:42:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:42:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:42:14 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:42:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 16:42:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:42:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:42:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:42:15 - Leaving storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 16:42:15 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Thu 16 Jan 2014 16:42:15 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:42:16 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:42:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:42:16 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:42:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:42:16 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:42:16 - job_xml_thread(): Done retrieving: data size 43282285
Thu 16 Jan 2014 16:42:16 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:42:16 - XML: Start document: iteration 16
Thu 16 Jan 2014 16:42:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43282285
Thu 16 Jan 2014 16:42:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43282285
Thu 16 Jan 2014 16:42:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:42:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:42:24 - XML: Processed 647952 elements - found 869 jobs
Thu 16 Jan 2014 16:42:24 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 16:42:24 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 16:42:24 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:42:24 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:42:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:42:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:42:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:42:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:42:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:42:34 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:42:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:42:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:42:36 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:42:36 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:42:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:42:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:42:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:42:36 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:42:36 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:42:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:42:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 16:42:36 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:42:36 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:42:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 16:42:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6021 values 95006 bits 11875 bytes 
Thu 16 Jan 2014 16:42:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:42:37 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:42:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:42:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:42:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:42:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:42:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:42:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:42:39 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:42:40 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:42:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43646319
Thu 16 Jan 2014 16:42:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:42:40 - job_xml_thread(): Done retrieving: data size 43646319
Thu 16 Jan 2014 16:42:41 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:42:41 - XML: Start document: iteration 17
Thu 16 Jan 2014 16:42:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43646319
Thu 16 Jan 2014 16:42:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:42:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:42:49 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:42:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:42:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:42:51 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:42:51 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:42:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:42:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:42:51 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:42:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:42:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:42:55 - XML: Processed 651782 elements - found 869 jobs
Thu 16 Jan 2014 16:42:55 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 16:42:55 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 16:42:56 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:42:56 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:42:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:42:59 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:42:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:42:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:43:00 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:43:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 16:43:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:43:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:43:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:43:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:43:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:43:01 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:43:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43881021
Thu 16 Jan 2014 16:43:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:43:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43881021
Thu 16 Jan 2014 16:43:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:43:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:43:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:43:11 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:43:11 - job_xml_thread(): Done retrieving: data size 43881021
Thu 16 Jan 2014 16:43:11 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:43:11 - XML: Start document: iteration 18
Thu 16 Jan 2014 16:43:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:43:11 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:43:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:43:15 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:43:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:43:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:43:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:43:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:43:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:43:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:43:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:43:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:43:16 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:43:17 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:43:17 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:43:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:43:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:43:17 - XML: Processed 655466 elements - found 869 jobs
Thu 16 Jan 2014 16:43:17 - job 7346414 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:43:17 - job 7346415 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:43:17 - job 7346412 field 'start_timestamp' changed since saved from: 1389886899 to: 1389886668
Thu 16 Jan 2014 16:43:17 - job_xml_thread(): Found 3 updated jobs.
Thu 16 Jan 2014 16:43:17 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 16:43:17 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Thu 16 Jan 2014 16:43:17 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:43:17 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:43:19 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:43:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43919471
Thu 16 Jan 2014 16:43:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:43:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43919471
Thu 16 Jan 2014 16:43:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:43:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:43:31 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:43:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:43:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:43:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:43:33 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:43:33 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:43:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:43:33 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:43:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:43:33 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:43:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:43:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:43:33 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:43:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:43:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:43:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:43:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:43:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:43:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:43:36 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:43:36 - job_xml_thread(): Done retrieving: data size 43928455
Thu 16 Jan 2014 16:43:36 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:43:36 - XML: Start document: iteration 19
Thu 16 Jan 2014 16:43:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43928455
Thu 16 Jan 2014 16:43:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:43:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:43:37 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:43:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43928455
Thu 16 Jan 2014 16:43:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:43:39 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:43:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:43:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 16:43:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 16:43:39 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:43:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 11703 values 184512 bits 23064 bytes 
Thu 16 Jan 2014 16:43:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:43:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:43:49 - XML: Processed 655466 elements - found 869 jobs
Thu 16 Jan 2014 16:43:49 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 16:43:49 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 16:43:49 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:43:49 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:43:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:43:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:43:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:43:54 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:43:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:43:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:43:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:43:55 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:43:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:43:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:43:55 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:43:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:43:55 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:43:55 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:43:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:43:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:43:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:43:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:43:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:43:57 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:43:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 16:43:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:43:57 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:43:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43915041
Thu 16 Jan 2014 16:43:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:43:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43915041
Thu 16 Jan 2014 16:43:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:44:04 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:44:04 - job_xml_thread(): Done retrieving: data size 43915041
Thu 16 Jan 2014 16:44:04 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:44:04 - XML: Start document: iteration 20
Thu 16 Jan 2014 16:44:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:44:10 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:44:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:44:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:44:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:44:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:44:12 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:44:12 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:44:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:44:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:44:12 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:44:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:44:14 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:44:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:44:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:44:15 - XML: Processed 655461 elements - found 869 jobs
Thu 16 Jan 2014 16:44:15 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 16:44:15 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 16:44:15 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:44:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:44:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:44:15 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:44:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:44:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:44:17 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:44:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43911584
Thu 16 Jan 2014 16:44:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:44:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43911584
Thu 16 Jan 2014 16:44:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:44:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:44:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:44:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:44:27 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:44:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:44:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:44:29 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:44:29 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:44:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:44:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:44:29 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:44:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:44:30 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:44:30 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:44:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:44:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:44:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:44:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:44:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:44:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:44:31 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:44:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43924768
Thu 16 Jan 2014 16:44:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:44:32 - job_xml_thread(): Done retrieving: data size 43924768
Thu 16 Jan 2014 16:44:32 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:44:32 - Housekeeping: checking database for timed out jobs..
Thu 16 Jan 2014 16:44:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43924768
Thu 16 Jan 2014 16:44:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:44:34 - Housekeeping: Found 0 timed out jobs in database: closing entries
Thu 16 Jan 2014 16:44:35 - Housekeeping: done.
Thu 16 Jan 2014 16:44:35 - XML: Start document: iteration 0
Thu 16 Jan 2014 16:44:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:44:40 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:44:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:44:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 16:44:40 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:44:40 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:44:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148567 bits 18570 bytes 
Thu 16 Jan 2014 16:44:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 16:44:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:44:44 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:44:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:44:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:44:45 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:44:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:44:45 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:44:45 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:44:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:44:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:44:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:44:52 - XML: Processed 655463 elements - found 869 jobs
Thu 16 Jan 2014 16:44:52 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 16:44:52 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 16:44:52 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:44:52 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:44:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:44:53 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:44:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:44:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:44:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:44:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:44:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:44:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:44:56 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:44:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43906328
Thu 16 Jan 2014 16:44:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:44:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43906328
Thu 16 Jan 2014 16:44:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:45:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:45:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:45:03 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:45:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 16:45:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:45:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:45:04 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:45:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:45:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:45:05 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:45:05 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:45:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:45:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:45:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43906328
Thu 16 Jan 2014 16:45:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:45:08 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:45:08 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:45:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:45:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:45:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:45:15 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:45:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:45:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:45:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:45:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:45:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:45:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:45:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:45:16 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:45:18 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:45:18 - job_xml_thread(): Done retrieving: data size 43904871
Thu 16 Jan 2014 16:45:18 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:45:18 - XML: Start document: iteration 1
Thu 16 Jan 2014 16:45:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43904871
Thu 16 Jan 2014 16:45:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:45:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:45:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:45:23 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:45:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:45:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43904871
Thu 16 Jan 2014 16:45:23 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:45:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:45:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:45:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:45:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:45:33 - XML: Processed 655468 elements - found 870 jobs
Thu 16 Jan 2014 16:45:33 - job 7346416 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:45:33 - job 7346417 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:45:33 - job_xml_thread(): Found 3 updated jobs.
Thu 16 Jan 2014 16:45:33 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 16:45:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:45:36 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Thu 16 Jan 2014 16:45:36 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:45:36 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:45:36 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:45:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:45:40 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:45:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:45:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:45:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:45:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:45:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:45:40 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:45:41 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:45:41 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:45:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:45:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:45:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:45:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:45:41 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:45:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:45:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:45:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:45:41 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:45:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 16:45:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 16:45:41 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:45:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99039 bits 12379 bytes 
Thu 16 Jan 2014 16:45:43 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:45:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43917681
Thu 16 Jan 2014 16:45:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:45:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43917681
Thu 16 Jan 2014 16:45:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:45:50 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:45:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 16:45:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:45:52 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:45:52 - job_xml_thread(): Done retrieving: data size 43917681
Thu 16 Jan 2014 16:45:52 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:45:52 - XML: Start document: iteration 2
Thu 16 Jan 2014 16:45:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:45:52 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:45:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:45:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:45:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:45:56 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:45:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:45:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:45:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:45:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:45:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:45:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:45:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:45:57 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:45:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:45:58 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:45:58 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:45:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:45:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:46:00 - XML: Processed 655464 elements - found 868 jobs
Thu 16 Jan 2014 16:46:00 - job 7346418 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:46:00 - job 7346419 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:46:00 - job 7341258 appears to have finished
Thu 16 Jan 2014 16:46:00 - job 7336912 appears to have finished
Thu 16 Jan 2014 16:46:00 - job_xml_thread(): Found 4 updated jobs.
Thu 16 Jan 2014 16:46:00 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 16:46:00 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Thu 16 Jan 2014 16:46:00 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:46:00 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:46:02 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:46:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43915914
Thu 16 Jan 2014 16:46:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:46:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43915914
Thu 16 Jan 2014 16:46:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:46:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:46:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:46:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:46:12 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:46:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:46:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:46:14 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:46:14 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:46:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:46:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:46:14 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:46:15 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:46:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:46:15 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:46:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:46:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:46:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:46:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:46:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:46:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:46:17 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:46:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43930000
Thu 16 Jan 2014 16:46:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:46:17 - job_xml_thread(): Done retrieving: data size 43930000
Thu 16 Jan 2014 16:46:17 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:46:17 - XML: Start document: iteration 3
Thu 16 Jan 2014 16:46:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43930000
Thu 16 Jan 2014 16:46:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:46:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:46:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:46:30 - XML: Processed 655464 elements - found 868 jobs
Thu 16 Jan 2014 16:46:30 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 16:46:30 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 16:46:30 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:46:30 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:46:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:46:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:46:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:46:34 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:46:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:46:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:46:34 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:46:34 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:46:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:46:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:46:34 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:46:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:46:37 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:46:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:46:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:46:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:46:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:46:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:46:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:46:39 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:46:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43941723
Thu 16 Jan 2014 16:46:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:46:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43941723
Thu 16 Jan 2014 16:46:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:46:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:46:42 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:46:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:46:43 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:46:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 16:46:43 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:46:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 16:46:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 12332 values 194818 bits 24352 bytes 
Thu 16 Jan 2014 16:46:46 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:46:46 - job_xml_thread(): Done retrieving: data size 43941723
Thu 16 Jan 2014 16:46:46 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:46:46 - XML: Start document: iteration 4
Thu 16 Jan 2014 16:46:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:46:47 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:46:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:46:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:46:51 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:46:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:46:51 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:46:51 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:46:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:46:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:46:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:46:58 - XML: Processed 655464 elements - found 868 jobs
Thu 16 Jan 2014 16:46:58 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 16:46:58 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 16:46:58 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:46:58 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:47:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:47:01 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:47:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:47:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:47:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:47:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:47:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:47:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:47:03 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:47:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 16:47:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:47:03 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:47:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43893775
Thu 16 Jan 2014 16:47:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:47:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43893775
Thu 16 Jan 2014 16:47:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:47:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:47:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:47:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:47:11 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:47:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:47:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:47:13 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:47:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:47:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43893775
Thu 16 Jan 2014 16:47:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:47:13 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:47:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:47:13 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:47:13 - job_xml_thread(): Done retrieving: data size 43893775
Thu 16 Jan 2014 16:47:13 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:47:13 - XML: Start document: iteration 5
Thu 16 Jan 2014 16:47:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:47:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:47:25 - XML: Processed 655464 elements - found 868 jobs
Thu 16 Jan 2014 16:47:25 - job 7346419 field 'start_timestamp' changed since saved from: 1389887136 to: 1389887071
Thu 16 Jan 2014 16:47:25 - job 7346421 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:47:25 - job 7346420 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:47:25 - job_xml_thread(): Found 3 updated jobs.
Thu 16 Jan 2014 16:47:25 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 16:47:27 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Thu 16 Jan 2014 16:47:27 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:47:27 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:47:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:47:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:47:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:47:29 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:47:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:47:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:47:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:47:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:47:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:47:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:47:29 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:47:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:47:30 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:47:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:47:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:47:30 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:47:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:47:30 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:47:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:47:32 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:47:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43394607
Thu 16 Jan 2014 16:47:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:47:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43394607
Thu 16 Jan 2014 16:47:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:47:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:47:42 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:47:43 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:47:43 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:47:44 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Thu 16 Jan 2014 16:47:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:47:44 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:47:44 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:47:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:47:44 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:47:44 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 16:47:44 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:47:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:47:44 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 16:47:44 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 16:47:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:47:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 16:47:44 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:47:44 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:47:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 16:47:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99291 bits 12411 bytes 
Thu 16 Jan 2014 16:47:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:47:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:47:46 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:47:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:47:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:47:46 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:47:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:47:46 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:47:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:47:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:47:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:47:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:47:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:47:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:47:47 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 1020484 values 16118931 bits 2014866 bytes 
Thu 16 Jan 2014 16:47:52 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:47:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 16:47:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:47:53 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:47:53 - job_xml_thread(): Done retrieving: data size 43290544
Thu 16 Jan 2014 16:47:53 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:47:53 - XML: Start document: iteration 6
Thu 16 Jan 2014 16:47:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43290544
Thu 16 Jan 2014 16:47:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43290544
Thu 16 Jan 2014 16:47:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:47:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:48:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:48:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:48:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:48:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:48:06 - XML: Processed 647660 elements - found 864 jobs
Thu 16 Jan 2014 16:48:07 - job 7346065 appears to have finished
Thu 16 Jan 2014 16:48:07 - job 7346422 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:48:07 - job 7346420 field 'start_timestamp' changed since saved from: 1389887183 to: 1389887134
Thu 16 Jan 2014 16:48:07 - job 7344502 appears to have finished
Thu 16 Jan 2014 16:48:07 - job 7344503 appears to have finished
Thu 16 Jan 2014 16:48:07 - job 7346296 appears to have finished
Thu 16 Jan 2014 16:48:08 - job_xml_thread(): Found 6 updated jobs.
Thu 16 Jan 2014 16:48:08 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 16:48:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:48:09 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:48:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:48:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:48:11 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:48:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:48:11 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:48:11 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:48:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:48:11 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Thu 16 Jan 2014 16:48:11 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:48:11 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:48:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:48:12 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:48:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:48:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:48:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:48:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:48:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:48:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:48:15 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:48:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43315571
Thu 16 Jan 2014 16:48:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:48:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43315571
Thu 16 Jan 2014 16:48:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:48:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:48:25 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:48:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:48:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:48:26 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:48:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:48:27 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:48:27 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:48:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:48:27 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:48:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:48:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:48:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:48:30 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:48:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:48:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:48:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:48:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:48:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:48:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:48:34 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:48:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43411661
Thu 16 Jan 2014 16:48:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:48:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43411661
Thu 16 Jan 2014 16:48:35 - job_xml_thread(): Done retrieving: data size 43411661
Thu 16 Jan 2014 16:48:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:48:35 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:48:35 - XML: Start document: iteration 7
Thu 16 Jan 2014 16:48:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:48:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:48:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:48:45 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:48:45 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:48:45 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 16:48:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:48:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:48:46 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:48:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 16:48:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:48:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 16:48:46 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:48:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148828 bits 18603 bytes 
Thu 16 Jan 2014 16:48:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:48:49 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:48:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:48:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:48:49 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:48:49 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:48:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:48:49 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:48:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:48:52 - XML: Processed 649210 elements - found 864 jobs
Thu 16 Jan 2014 16:48:52 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 16:48:52 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 16:48:52 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:48:52 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:48:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:48:54 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:48:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:48:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:48:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:48:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:48:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:48:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:48:59 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:48:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 16:48:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:48:59 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:48:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43871707
Thu 16 Jan 2014 16:48:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:49:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43871707
Thu 16 Jan 2014 16:49:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:49:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:49:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:49:07 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:49:07 - job_xml_thread(): Done retrieving: data size 43871707
Thu 16 Jan 2014 16:49:07 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:49:07 - XML: Start document: iteration 8
Thu 16 Jan 2014 16:49:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:49:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:49:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:49:13 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:49:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:49:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:49:14 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:49:14 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:49:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:49:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:49:14 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:49:17 - XML: Processed 655172 elements - found 864 jobs
Thu 16 Jan 2014 16:49:17 - job 7346423 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:49:17 - job_xml_thread(): Found 1 updated jobs.
Thu 16 Jan 2014 16:49:17 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 16:49:18 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Thu 16 Jan 2014 16:49:18 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:49:18 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:49:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:49:19 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:49:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:49:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:49:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:49:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:49:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:49:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:49:23 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:49:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43909764
Thu 16 Jan 2014 16:49:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:49:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43909764
Thu 16 Jan 2014 16:49:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:49:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:49:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:49:33 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:49:33 - job_xml_thread(): Done retrieving: data size 43909764
Thu 16 Jan 2014 16:49:33 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:49:33 - XML: Start document: iteration 9
Thu 16 Jan 2014 16:49:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:49:34 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:49:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:49:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:49:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:49:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:49:36 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:49:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:49:36 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:49:36 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:49:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:49:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:49:47 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:49:47 - XML: Processed 655456 elements - found 864 jobs
Thu 16 Jan 2014 16:49:47 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 16:49:47 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 16:49:47 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:49:47 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:49:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:49:47 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:49:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:49:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:49:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:49:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:49:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:49:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:49:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:49:48 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:49:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 16:49:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 16:49:48 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:49:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99051 bits 12381 bytes 
Thu 16 Jan 2014 16:49:50 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:49:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43928800
Thu 16 Jan 2014 16:49:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:49:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43928800
Thu 16 Jan 2014 16:49:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:49:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:49:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:50:02 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:50:02 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:50:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:50:02 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:50:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:50:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:50:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:50:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:50:03 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:50:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:50:03 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:50:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:50:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:50:08 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:50:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:50:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:50:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:50:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:50:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:50:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:50:09 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:50:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 16:50:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:50:10 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:50:10 - job_xml_thread(): Done retrieving: data size 43968297
Thu 16 Jan 2014 16:50:10 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:50:10 - XML: Start document: iteration 10
Thu 16 Jan 2014 16:50:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43968297
Thu 16 Jan 2014 16:50:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43968297
Thu 16 Jan 2014 16:50:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:50:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:50:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:50:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:50:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:50:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:50:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:50:27 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:50:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:50:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:50:28 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:50:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:50:28 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:50:28 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:50:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:50:29 - XML: Processed 655710 elements - found 991 jobs
Thu 16 Jan 2014 16:50:29 - job 7336909 appears to have finished
Thu 16 Jan 2014 16:50:29 - job 7346333 appears to have finished
Thu 16 Jan 2014 16:50:29 - job 7346423 field 'start_timestamp' changed since saved from: 1389887324 to: 1389887286
Thu 16 Jan 2014 16:50:29 - job_xml_thread(): Found 132 updated jobs.
Thu 16 Jan 2014 16:50:29 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 16:50:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:50:34 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:50:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:50:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:50:34 - job_xml_thread(): Done storing. succesfully stored: 132 jobs
Thu 16 Jan 2014 16:50:34 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:50:34 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:50:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:50:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:50:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:50:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:50:37 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:50:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43961191
Thu 16 Jan 2014 16:50:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:50:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43961191
Thu 16 Jan 2014 16:50:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:50:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:50:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:50:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:50:47 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:50:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:50:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:50:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:50:48 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:50:48 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:50:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:50:48 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:50:48 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:50:48 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:50:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:50:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 16:50:48 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:50:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:50:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 16:50:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8322 values 131176 bits 16397 bytes 
Thu 16 Jan 2014 16:50:50 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:50:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:50:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:50:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:50:52 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:50:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:50:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:50:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:50:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:50:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:50:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:50:55 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:50:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43973058
Thu 16 Jan 2014 16:50:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:50:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43973058
Thu 16 Jan 2014 16:50:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:50:56 - job_xml_thread(): Done retrieving: data size 43973058
Thu 16 Jan 2014 16:50:56 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:50:56 - XML: Start document: iteration 11
Thu 16 Jan 2014 16:51:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:51:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:51:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:51:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:51:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:51:10 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:51:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:51:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:51:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:51:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:51:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:51:11 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:51:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:51:11 - XML: Processed 655712 elements - found 992 jobs
Thu 16 Jan 2014 16:51:11 - job 7344504 appears to have finished
Thu 16 Jan 2014 16:51:12 - job_xml_thread(): Found 3 updated jobs.
Thu 16 Jan 2014 16:51:12 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 16:51:12 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Thu 16 Jan 2014 16:51:12 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:51:12 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:51:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:51:14 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:51:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:51:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:51:14 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:51:14 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:51:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:51:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:51:15 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:51:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 16:51:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:51:16 - Leaving storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 16:51:16 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Thu 16 Jan 2014 16:51:16 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:51:17 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:51:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43952675
Thu 16 Jan 2014 16:51:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:51:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43952675
Thu 16 Jan 2014 16:51:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:51:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:51:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:51:27 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:51:27 - job_xml_thread(): Done retrieving: data size 43952675
Thu 16 Jan 2014 16:51:27 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:51:27 - XML: Start document: iteration 12
Thu 16 Jan 2014 16:51:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:51:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:51:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:51:30 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:51:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:51:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:51:31 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:51:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:51:31 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:51:31 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:51:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:51:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:51:37 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:51:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:51:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:51:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:51:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:51:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:51:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:51:39 - XML: Processed 655712 elements - found 992 jobs
Thu 16 Jan 2014 16:51:39 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 16:51:39 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 16:51:39 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:51:39 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:51:41 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:51:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43947847
Thu 16 Jan 2014 16:51:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:51:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43947847
Thu 16 Jan 2014 16:51:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:51:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:51:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:51:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:51:48 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:51:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:51:48 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:51:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 16:51:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 16:51:48 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:51:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8740 values 137783 bits 17222 bytes 
Thu 16 Jan 2014 16:51:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:51:53 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:51:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:51:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:51:54 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:51:54 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:51:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:51:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:51:54 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:51:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:51:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:51:55 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:51:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:51:55 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:51:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:51:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:51:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:51:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:51:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:51:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:51:58 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:51:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43959629
Thu 16 Jan 2014 16:51:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:51:58 - job_xml_thread(): Done retrieving: data size 43959629
Thu 16 Jan 2014 16:51:58 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:51:58 - XML: Start document: iteration 13
Thu 16 Jan 2014 16:51:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43959629
Thu 16 Jan 2014 16:51:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:52:09 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:52:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 16:52:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:52:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:52:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:52:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:52:10 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:52:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:52:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:52:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:52:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:52:11 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:52:11 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:52:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:52:11 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:52:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:52:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:52:15 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:52:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:52:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:52:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:52:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:52:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:52:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:52:17 - XML: Processed 655712 elements - found 992 jobs
Thu 16 Jan 2014 16:52:17 - job 7346424 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:52:17 - job 7337039 appears to have finished
Thu 16 Jan 2014 16:52:17 - job 7346425 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:52:17 - job_xml_thread(): Found 4 updated jobs.
Thu 16 Jan 2014 16:52:17 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 16:52:17 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Thu 16 Jan 2014 16:52:17 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:52:17 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:52:18 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:52:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43950287
Thu 16 Jan 2014 16:52:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:52:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43950287
Thu 16 Jan 2014 16:52:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:52:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:52:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:52:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:52:28 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:52:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:52:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:52:29 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:52:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:52:29 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:52:29 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:52:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:52:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:52:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:52:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:52:32 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:52:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:52:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:52:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:52:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:52:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:52:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:52:32 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:52:34 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:52:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43967586
Thu 16 Jan 2014 16:52:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:52:34 - job_xml_thread(): Done retrieving: data size 43967586
Thu 16 Jan 2014 16:52:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43967586
Thu 16 Jan 2014 16:52:34 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:52:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:52:34 - XML: Start document: iteration 14
Thu 16 Jan 2014 16:52:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:52:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:52:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:52:47 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:52:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:52:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:52:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:52:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:52:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:52:48 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:52:48 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:52:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:52:48 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:52:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:52:48 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:52:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:52:49 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:52:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 16:52:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 16:52:50 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:52:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9208 values 145197 bits 18149 bytes 
Thu 16 Jan 2014 16:52:52 - XML: Processed 655712 elements - found 992 jobs
Thu 16 Jan 2014 16:52:52 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 16:52:52 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 16:52:52 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:52:52 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:52:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:52:56 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:52:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:52:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:52:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:52:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:52:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:52:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:52:58 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:52:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43936413
Thu 16 Jan 2014 16:52:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:52:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43936413
Thu 16 Jan 2014 16:52:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:53:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:53:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:53:07 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:53:07 - job_xml_thread(): Done retrieving: data size 43936413
Thu 16 Jan 2014 16:53:07 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:53:07 - XML: Start document: iteration 15
Thu 16 Jan 2014 16:53:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:53:09 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:53:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:53:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:53:12 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:53:12 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:53:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:53:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:53:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:53:12 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:53:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:53:17 - XML: Processed 655709 elements - found 993 jobs
Thu 16 Jan 2014 16:53:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:53:17 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:53:17 - job 7346424 field 'start_timestamp' changed since saved from: 1389887461 to: 1389887419
Thu 16 Jan 2014 16:53:17 - job 7346428 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:53:17 - job 7346426 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:53:17 - job 7346427 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:53:17 - job_xml_thread(): Found 5 updated jobs.
Thu 16 Jan 2014 16:53:17 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 16:53:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:53:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:53:17 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Thu 16 Jan 2014 16:53:17 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:53:17 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:53:17 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:53:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 16:53:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:53:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:53:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:53:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:53:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:53:19 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:53:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43884272
Thu 16 Jan 2014 16:53:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:53:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43884272
Thu 16 Jan 2014 16:53:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:53:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:53:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:53:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:53:31 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:53:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:53:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:53:32 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:53:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:53:32 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:53:32 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:53:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:53:32 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:53:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:53:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:53:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:53:34 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:53:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:53:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:53:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:53:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:53:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:53:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:53:36 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:53:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43426295
Thu 16 Jan 2014 16:53:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:53:36 - job_xml_thread(): Done retrieving: data size 43426295
Thu 16 Jan 2014 16:53:36 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:53:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43426295
Thu 16 Jan 2014 16:53:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:53:36 - XML: Start document: iteration 16
Thu 16 Jan 2014 16:53:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:53:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:53:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:53:50 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:53:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:53:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:53:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:53:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 16:53:51 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:53:51 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:53:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 16:53:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8950 values 141079 bits 17634 bytes 
Thu 16 Jan 2014 16:53:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:53:54 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:53:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:53:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:53:54 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:53:54 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:53:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:53:54 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:53:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:53:55 - XML: Processed 649000 elements - found 991 jobs
Thu 16 Jan 2014 16:53:56 - job 7346426 field 'start_timestamp' changed since saved from: 1389887555 to: 1389887480
Thu 16 Jan 2014 16:53:56 - job 7346164 appears to have finished
Thu 16 Jan 2014 16:53:56 - job 7346288 appears to have finished
Thu 16 Jan 2014 16:53:56 - job_xml_thread(): Found 3 updated jobs.
Thu 16 Jan 2014 16:53:56 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 16:53:56 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Thu 16 Jan 2014 16:53:56 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:53:56 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:53:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:53:57 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:53:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:53:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:53:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:53:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:53:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:53:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:53:59 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:53:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43282244
Thu 16 Jan 2014 16:53:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:53:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43282244
Thu 16 Jan 2014 16:53:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:54:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:54:07 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:54:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:54:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:54:11 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:54:11 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:54:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:54:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:54:11 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:54:11 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:54:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:54:12 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:54:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:54:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:54:12 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:54:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 16:54:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:54:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:54:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:54:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:54:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:54:14 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:54:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43352431
Thu 16 Jan 2014 16:54:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:54:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43352431
Thu 16 Jan 2014 16:54:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:54:15 - job_xml_thread(): Done retrieving: data size 43352431
Thu 16 Jan 2014 16:54:16 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:54:16 - XML: Start document: iteration 17
Thu 16 Jan 2014 16:54:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:54:24 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:54:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:54:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:54:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:54:28 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:54:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:54:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:54:28 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:54:28 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:54:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:54:34 - XML: Processed 648258 elements - found 991 jobs
Thu 16 Jan 2014 16:54:34 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 16:54:34 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 16:54:34 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:54:34 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:54:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:54:36 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:54:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:54:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:54:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:54:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:54:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:54:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:54:38 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:54:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43488153
Thu 16 Jan 2014 16:54:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:54:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43488153
Thu 16 Jan 2014 16:54:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:54:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:54:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:54:45 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Thu 16 Jan 2014 16:54:46 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:54:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:54:47 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:54:47 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:54:47 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:54:47 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 16:54:47 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 16:54:47 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 16:54:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:54:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:54:47 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:54:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:54:47 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:54:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:54:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43488153
Thu 16 Jan 2014 16:54:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:54:49 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:54:49 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:54:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:54:51 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:54:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:54:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:54:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:54:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 16:54:52 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:54:52 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:54:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 16:54:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8806 values 138830 bits 17353 bytes 
Thu 16 Jan 2014 16:54:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:54:58 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:54:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:54:59 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:54:59 - size of cluster 'LISA Cluster': 624 hosts 79481 metrics 883124 values 13939124 bits 1742390 bytes 
Thu 16 Jan 2014 16:54:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:54:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:55:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:55:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:55:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:55:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:55:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:55:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:55:03 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:55:03 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:55:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:55:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:55:03 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:55:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 16:55:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:55:05 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:55:05 - job_xml_thread(): Done retrieving: data size 43919671
Thu 16 Jan 2014 16:55:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43919671
Thu 16 Jan 2014 16:55:05 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:55:05 - XML: Start document: iteration 18
Thu 16 Jan 2014 16:55:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:55:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43919671
Thu 16 Jan 2014 16:55:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:55:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:55:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:55:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:55:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:55:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:55:19 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:55:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:55:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:55:20 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:55:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:55:20 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:55:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:55:20 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:55:25 - XML: Processed 655694 elements - found 989 jobs
Thu 16 Jan 2014 16:55:25 - job 7346403 appears to have finished
Thu 16 Jan 2014 16:55:25 - job 7346399 appears to have finished
Thu 16 Jan 2014 16:55:25 - job 7341459 appears to have finished
Thu 16 Jan 2014 16:55:25 - job 7346429 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:55:25 - job_xml_thread(): Found 5 updated jobs.
Thu 16 Jan 2014 16:55:25 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 16:55:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:55:27 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:55:27 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Thu 16 Jan 2014 16:55:27 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:55:27 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:55:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:55:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:55:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:55:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:55:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:55:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:55:31 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:55:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43924876
Thu 16 Jan 2014 16:55:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:55:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43924876
Thu 16 Jan 2014 16:55:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:55:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:55:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:55:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:55:42 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:55:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:55:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:55:43 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:55:43 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:55:43 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:55:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:55:43 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:55:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:55:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:55:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:55:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:55:45 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:55:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:55:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:55:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:55:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:55:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:55:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:55:47 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:55:47 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 16:55:49 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:55:49 - job_xml_thread(): Done retrieving: data size 43971251
Thu 16 Jan 2014 16:55:49 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:55:49 - XML: Start document: iteration 19
Thu 16 Jan 2014 16:55:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43971251
Thu 16 Jan 2014 16:55:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43971251
Thu 16 Jan 2014 16:55:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:55:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:55:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:55:52 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:55:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:55:54 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:55:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 16:55:54 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:55:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 16:55:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148585 bits 18573 bytes 
Thu 16 Jan 2014 16:55:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:55:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:56:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:56:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:56:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:56:04 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:56:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:56:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:56:05 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:56:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:56:05 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:56:05 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:56:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:56:11 - XML: Processed 655938 elements - found 990 jobs
Thu 16 Jan 2014 16:56:11 - job_xml_thread(): Found 1 updated jobs.
Thu 16 Jan 2014 16:56:11 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 16:56:11 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Thu 16 Jan 2014 16:56:11 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:56:11 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:56:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:56:13 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:56:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:56:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:56:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:56:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:56:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:56:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:56:16 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:56:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43955840
Thu 16 Jan 2014 16:56:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:56:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43955840
Thu 16 Jan 2014 16:56:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:56:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:56:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:56:27 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:56:27 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:56:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:56:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:56:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:56:29 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:56:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:56:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:56:29 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:56:29 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:56:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:56:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:56:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:56:33 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:56:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:56:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:56:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:56:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:56:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:56:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:56:34 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:56:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 16:56:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:56:36 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:56:36 - job_xml_thread(): Done retrieving: data size 43976174
Thu 16 Jan 2014 16:56:36 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:56:36 - XML: Start document: iteration 20
Thu 16 Jan 2014 16:56:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43976174
Thu 16 Jan 2014 16:56:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43976174
Thu 16 Jan 2014 16:56:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:56:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:56:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:56:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:56:48 - XML: Processed 655938 elements - found 990 jobs
Thu 16 Jan 2014 16:56:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:56:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:56:49 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 16:56:49 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 16:56:50 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:56:50 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:56:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:56:55 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:56:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:56:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:56:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:56:56 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:56:56 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:56:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:56:56 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:56:56 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:56:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:56:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:56:56 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:56:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 16:56:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 16:56:56 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:56:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5501 values 86714 bits 10839 bytes 
Thu 16 Jan 2014 16:56:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:56:56 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:56:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:56:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:56:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:56:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:56:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:56:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:57:01 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:57:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43974550
Thu 16 Jan 2014 16:57:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:57:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43974550
Thu 16 Jan 2014 16:57:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:57:05 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:57:05 - job_xml_thread(): Done retrieving: data size 43974550
Thu 16 Jan 2014 16:57:05 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:57:05 - Housekeeping: checking database for timed out jobs..
Thu 16 Jan 2014 16:57:05 - Housekeeping: Found 0 timed out jobs in database: closing entries
Thu 16 Jan 2014 16:57:06 - Housekeeping: done.
Thu 16 Jan 2014 16:57:06 - XML: Start document: iteration 0
Thu 16 Jan 2014 16:57:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:57:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:57:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:57:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:57:12 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:57:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 16:57:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:57:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:57:13 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:57:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:57:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:57:14 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:57:14 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:57:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:57:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:57:14 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:57:19 - XML: Processed 655940 elements - found 991 jobs
Thu 16 Jan 2014 16:57:19 - job 7346430 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:57:19 - job_xml_thread(): Found 2 updated jobs.
Thu 16 Jan 2014 16:57:19 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 16:57:20 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Thu 16 Jan 2014 16:57:20 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:57:20 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:57:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:57:22 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:57:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:57:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:57:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:57:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:57:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:57:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:57:25 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:57:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43987624
Thu 16 Jan 2014 16:57:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:57:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43987624
Thu 16 Jan 2014 16:57:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:57:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:57:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:57:35 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:57:36 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:57:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:57:37 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:57:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:57:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:57:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:57:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:57:38 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:57:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:57:38 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:57:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:57:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:57:40 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:57:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:57:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:57:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:57:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:57:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:57:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:57:44 - Leaving storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 16:57:44 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Thu 16 Jan 2014 16:57:44 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:57:44 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:57:44 - job_xml_thread(): Done retrieving: data size 43976487
Thu 16 Jan 2014 16:57:44 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:57:44 - XML: Start document: iteration 1
Thu 16 Jan 2014 16:57:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43976487
Thu 16 Jan 2014 16:57:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:57:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43976487
Thu 16 Jan 2014 16:57:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:57:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:57:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:57:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:57:56 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:57:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:57:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:57:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:57:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 16:57:57 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:57:57 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:57:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 16:57:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9216 values 145336 bits 18167 bytes 
Thu 16 Jan 2014 16:58:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:58:00 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:58:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:58:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:58:01 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:58:01 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:58:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:58:01 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:58:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:58:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:58:06 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:58:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:58:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:58:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:58:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:58:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:58:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:58:08 - XML: Processed 656178 elements - found 990 jobs
Thu 16 Jan 2014 16:58:08 - job 7346313 appears to have finished
Thu 16 Jan 2014 16:58:08 - job 7346432 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:58:08 - job 7346433 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:58:08 - job 7346431 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:58:08 - job_xml_thread(): Found 4 updated jobs.
Thu 16 Jan 2014 16:58:08 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 16:58:08 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Thu 16 Jan 2014 16:58:08 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:58:08 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:58:10 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:58:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43985056
Thu 16 Jan 2014 16:58:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:58:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43985056
Thu 16 Jan 2014 16:58:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:58:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:58:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:58:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:58:22 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:58:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:58:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:58:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:58:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:58:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:58:22 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:58:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:58:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:58:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:58:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:58:23 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:58:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:58:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:58:23 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:58:23 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:58:23 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:58:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:58:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:58:23 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:58:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 16:58:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:58:25 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:58:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 44009068
Thu 16 Jan 2014 16:58:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:58:25 - job_xml_thread(): Done retrieving: data size 44009068
Thu 16 Jan 2014 16:58:25 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:58:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 44009068
Thu 16 Jan 2014 16:58:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:58:25 - XML: Start document: iteration 2
Thu 16 Jan 2014 16:58:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:58:35 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:58:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:58:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:58:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:58:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:58:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:58:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:58:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:58:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:58:39 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:58:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:58:44 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:58:44 - XML: Processed 656175 elements - found 990 jobs
Thu 16 Jan 2014 16:58:44 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 16:58:44 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 16:58:44 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:58:44 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:58:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:58:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:58:45 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:58:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:58:45 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:58:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:58:45 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:58:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43981393
Thu 16 Jan 2014 16:58:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:58:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43981393
Thu 16 Jan 2014 16:58:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:58:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:58:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:58:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:58:56 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:58:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:58:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:58:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:58:57 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:58:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:58:57 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:58:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:58:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:58:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:58:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:58:58 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:58:58 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:58:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 16:58:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:58:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 16:58:58 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:58:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9093 values 143439 bits 17929 bytes 
Thu 16 Jan 2014 16:58:59 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:59:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:59:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:59:00 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:59:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:59:00 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:59:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:59:00 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:59:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 16:59:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:59:01 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:59:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43990634
Thu 16 Jan 2014 16:59:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:59:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43990634
Thu 16 Jan 2014 16:59:02 - job_xml_thread(): Done retrieving: data size 43990634
Thu 16 Jan 2014 16:59:02 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:59:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:59:02 - XML: Start document: iteration 3
Thu 16 Jan 2014 16:59:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:59:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:59:15 - XML: Processed 656176 elements - found 989 jobs
Thu 16 Jan 2014 16:59:15 - job 7346271 appears to have finished
Thu 16 Jan 2014 16:59:15 - job 7346434 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:59:15 - job 7346431 field 'start_timestamp' changed since saved from: 1389887835 to: 1389887812
Thu 16 Jan 2014 16:59:15 - job_xml_thread(): Found 3 updated jobs.
Thu 16 Jan 2014 16:59:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:59:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:59:15 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 16:59:18 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Thu 16 Jan 2014 16:59:18 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:59:19 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:59:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:59:21 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:59:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 16:59:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:59:22 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:59:22 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:59:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:59:22 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:59:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:59:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:59:22 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:59:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:59:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:59:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:59:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:59:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:59:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:59:25 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:59:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43932879
Thu 16 Jan 2014 16:59:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:59:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43932879
Thu 16 Jan 2014 16:59:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:59:34 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 16:59:35 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:59:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:59:35 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:59:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:59:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:59:38 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:59:38 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:59:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:59:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:59:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:59:38 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:59:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:59:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:59:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:59:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:59:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 16:59:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:59:40 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 16:59:40 - job_xml_thread(): Done retrieving: data size 43399983
Thu 16 Jan 2014 16:59:40 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 16:59:40 - XML: Start document: iteration 4
Thu 16 Jan 2014 16:59:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43399983
Thu 16 Jan 2014 16:59:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 16:59:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43399983
Thu 16 Jan 2014 16:59:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 16:59:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 16:59:49 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 16:59:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:59:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:59:54 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:59:54 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:59:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 16:59:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 16:59:54 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 16:59:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 16:59:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 16:59:55 - XML: Processed 648938 elements - found 988 jobs
Thu 16 Jan 2014 16:59:55 - job 7344506 appears to have finished
Thu 16 Jan 2014 16:59:55 - job 7346434 field 'start_timestamp' changed since saved from: 1389887899 to: 1389887897
Thu 16 Jan 2014 16:59:55 - job 7346435 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 16:59:55 - job_xml_thread(): Found 3 updated jobs.
Thu 16 Jan 2014 16:59:55 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 16:59:56 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Thu 16 Jan 2014 16:59:56 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 16:59:56 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 16:59:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 16:59:58 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 16:59:58 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:59:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 16:59:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 16:59:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 16:59:58 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 16:59:59 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9268 values 146123 bits 18265 bytes 
Thu 16 Jan 2014 16:59:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 16:59:59 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 16:59:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 16:59:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 16:59:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:59:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 16:59:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 16:59:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:00:01 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:00:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43310348
Thu 16 Jan 2014 17:00:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:00:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43310348
Thu 16 Jan 2014 17:00:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:00:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:00:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:00:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:00:10 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:00:11 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:00:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:00:11 - job_xml_thread(): Done retrieving: data size 43310348
Thu 16 Jan 2014 17:00:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:00:11 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:00:11 - XML: Start document: iteration 5
Thu 16 Jan 2014 17:00:12 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:00:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:00:12 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:00:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:00:12 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:00:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:00:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:00:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:00:22 - XML: Processed 647986 elements - found 988 jobs
Thu 16 Jan 2014 17:00:22 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:00:22 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 17:00:22 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 17:00:22 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:00:22 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:00:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:00:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:00:22 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:00:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 17:00:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:00:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:00:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:00:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:00:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:00:24 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:00:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43367837
Thu 16 Jan 2014 17:00:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:00:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43367837
Thu 16 Jan 2014 17:00:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:00:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:00:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:00:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:00:32 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:00:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:00:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:00:34 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:00:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:00:34 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:00:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:00:34 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:00:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:00:36 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:00:37 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:00:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:00:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:00:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:00:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:00:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:00:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:00:38 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:00:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43447856
Thu 16 Jan 2014 17:00:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:00:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43447856
Thu 16 Jan 2014 17:00:39 - job_xml_thread(): Done retrieving: data size 43447856
Thu 16 Jan 2014 17:00:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:00:39 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:00:39 - XML: Start document: iteration 6
Thu 16 Jan 2014 17:00:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:00:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:00:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:00:49 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:00:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:00:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:00:50 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:00:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:00:50 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:00:50 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:00:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:00:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:00:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:00:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:00:56 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:00:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:00:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:00:57 - XML: Processed 649234 elements - found 988 jobs
Thu 16 Jan 2014 17:00:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:00:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:00:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:00:57 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 17:00:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:00:57 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 17:00:57 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:00:57 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:00:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:00:58 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:00:59 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:00:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43966665
Thu 16 Jan 2014 17:00:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:00:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43966665
Thu 16 Jan 2014 17:00:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:01:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:01:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 17:01:00 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:01:00 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:01:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8848 values 139461 bits 17432 bytes 
Thu 16 Jan 2014 17:01:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 17:01:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:01:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:01:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:01:12 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:01:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:01:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:01:12 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:01:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:01:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:01:12 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:01:12 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:01:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:01:12 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:01:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:01:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:01:14 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:01:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:01:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:01:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:01:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:01:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:01:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:01:17 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:01:17 - job_xml_thread(): Done retrieving: data size 43980488
Thu 16 Jan 2014 17:01:17 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:01:17 - XML: Start document: iteration 7
Thu 16 Jan 2014 17:01:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43980488
Thu 16 Jan 2014 17:01:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43980488
Thu 16 Jan 2014 17:01:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:01:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:01:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:01:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:01:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:01:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:01:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:01:31 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:01:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:01:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:01:31 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:01:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:01:31 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:01:31 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:01:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:01:36 - XML: Processed 656172 elements - found 987 jobs
Thu 16 Jan 2014 17:01:36 - job 7345025 appears to have finished
Thu 16 Jan 2014 17:01:36 - job 7344505 appears to have finished
Thu 16 Jan 2014 17:01:36 - job 7346436 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:01:36 - job 7346437 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:01:36 - job 7346438 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:01:36 - job 7346439 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:01:36 - job_xml_thread(): Found 7 updated jobs.
Thu 16 Jan 2014 17:01:36 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 17:01:38 - job_xml_thread(): Done storing. succesfully stored: 7 jobs
Thu 16 Jan 2014 17:01:38 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:01:38 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:01:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:01:40 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:01:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:01:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:01:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:01:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:01:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:01:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:01:41 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:01:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 17:01:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:01:42 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:01:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43960567
Thu 16 Jan 2014 17:01:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:01:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43960567
Thu 16 Jan 2014 17:01:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:01:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:01:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:01:47 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Thu 16 Jan 2014 17:01:47 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:01:47 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:01:48 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 17:01:48 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:01:48 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 17:01:48 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 17:01:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:01:52 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:01:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:01:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:01:53 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:01:53 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:01:53 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:01:53 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:01:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:01:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Thu 16 Jan 2014 17:01:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:01:55 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:01:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:01:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:01:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:01:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:01:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:01:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:01:56 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:01:56 - job_xml_thread(): Done retrieving: data size 43988916
Thu 16 Jan 2014 17:01:56 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:01:56 - XML: Start document: iteration 8
Thu 16 Jan 2014 17:01:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43988916
Thu 16 Jan 2014 17:01:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:01:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43988916
Thu 16 Jan 2014 17:01:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:02:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:02:01 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:02:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:02:03 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:02:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 17:02:04 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:02:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 17:02:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:02:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:02:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:02:11 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:02:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8222 values 130003 bits 16250 bytes 
Thu 16 Jan 2014 17:02:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:02:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:02:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:02:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:02:11 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:02:11 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:02:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:02:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:02:12 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:02:14 - XML: Processed 656168 elements - found 986 jobs
Thu 16 Jan 2014 17:02:14 - job 7345677 appears to have finished
Thu 16 Jan 2014 17:02:15 - job_xml_thread(): Found 1 updated jobs.
Thu 16 Jan 2014 17:02:15 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 17:02:15 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Thu 16 Jan 2014 17:02:15 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:02:15 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:02:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:02:19 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:02:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:02:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:02:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:02:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:02:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:02:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:02:21 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:02:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 17:02:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:02:21 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:02:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43987785
Thu 16 Jan 2014 17:02:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:02:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43987785
Thu 16 Jan 2014 17:02:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:02:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:02:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:02:30 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:02:31 - job_xml_thread(): Done retrieving: data size 43987785
Thu 16 Jan 2014 17:02:31 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:02:31 - XML: Start document: iteration 9
Thu 16 Jan 2014 17:02:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:02:32 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:02:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:02:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:02:33 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:02:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:02:33 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:02:33 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:02:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:02:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:02:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:02:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:02:37 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:02:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:02:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:02:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:02:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:02:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:02:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:02:40 - XML: Processed 656170 elements - found 986 jobs
Thu 16 Jan 2014 17:02:40 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 17:02:40 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 17:02:40 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:02:40 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:02:41 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:02:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43971152
Thu 16 Jan 2014 17:02:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:02:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43971152
Thu 16 Jan 2014 17:02:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:02:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:02:48 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:02:48 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:02:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:02:49 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:02:49 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:02:49 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 17:02:49 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 17:02:49 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 17:02:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:02:50 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:02:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:02:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:02:51 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:02:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:02:51 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:02:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:02:51 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:02:52 - size of cluster 'LISA Cluster': 624 hosts 79481 metrics 915156 values 14457376 bits 1807172 bytes 
Thu 16 Jan 2014 17:02:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:02:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:02:55 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:02:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:02:55 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:02:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:02:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:02:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:02:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:02:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:02:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:02:59 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:02:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43971786
Thu 16 Jan 2014 17:02:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:02:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43971786
Thu 16 Jan 2014 17:02:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:02:59 - job_xml_thread(): Done retrieving: data size 43971786
Thu 16 Jan 2014 17:03:00 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:03:01 - XML: Start document: iteration 10
Thu 16 Jan 2014 17:03:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:03:06 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:03:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:03:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 17:03:06 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:03:06 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:03:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9268 values 146582 bits 18322 bytes 
Thu 16 Jan 2014 17:03:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 17:03:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:03:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:03:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:03:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:03:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:03:14 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:03:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:03:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:03:15 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:03:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:03:15 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:03:15 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:03:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:03:16 - XML: Processed 656168 elements - found 985 jobs
Thu 16 Jan 2014 17:03:16 - job 7346443 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:03:16 - job 7346441 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:03:16 - job 7346440 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:03:16 - job 7346444 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:03:16 - job 7346442 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:03:16 - job 7344507 appears to have finished
Thu 16 Jan 2014 17:03:16 - job_xml_thread(): Found 6 updated jobs.
Thu 16 Jan 2014 17:03:16 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 17:03:17 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Thu 16 Jan 2014 17:03:17 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:03:17 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:03:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:03:19 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:03:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:03:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:03:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:03:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:03:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:03:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:03:22 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:03:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43994138
Thu 16 Jan 2014 17:03:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:03:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43994138
Thu 16 Jan 2014 17:03:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:03:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:03:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:03:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:03:32 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:03:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:03:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:03:32 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:03:32 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:03:33 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:03:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:03:33 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:03:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:03:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:03:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:03:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:03:37 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:03:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:03:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:03:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:03:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:03:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:03:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:03:37 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:03:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 17:03:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:03:40 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:03:40 - job_xml_thread(): Done retrieving: data size 43983818
Thu 16 Jan 2014 17:03:40 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:03:40 - XML: Start document: iteration 11
Thu 16 Jan 2014 17:03:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43983818
Thu 16 Jan 2014 17:03:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43983818
Thu 16 Jan 2014 17:03:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:03:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:03:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:03:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:03:49 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:03:49 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 17:03:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:03:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:03:57 - XML: Processed 656162 elements - found 983 jobs
Thu 16 Jan 2014 17:03:57 - job 7346445 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:03:57 - job 7343265 appears to have finished
Thu 16 Jan 2014 17:03:57 - job 7344510 appears to have finished
Thu 16 Jan 2014 17:03:57 - job_xml_thread(): Found 3 updated jobs.
Thu 16 Jan 2014 17:03:57 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 17:03:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:03:57 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:03:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:03:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:03:58 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:03:58 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:03:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:03:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:03:58 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:03:58 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Thu 16 Jan 2014 17:03:58 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:03:58 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:04:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:04:00 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:04:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:04:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:04:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:04:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:04:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:04:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:04:01 - Leaving storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 17:04:01 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Thu 16 Jan 2014 17:04:01 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:04:02 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:04:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43991335
Thu 16 Jan 2014 17:04:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:04:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43991335
Thu 16 Jan 2014 17:04:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:04:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:04:06 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:04:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:04:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 17:04:08 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:04:08 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:04:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 17:04:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8759 values 138306 bits 17288 bytes 
Thu 16 Jan 2014 17:04:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:04:11 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:04:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:04:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:04:13 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:04:13 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:04:13 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:04:13 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:04:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:04:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:04:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:04:15 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:04:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:04:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:04:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:04:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:04:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:04:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:04:18 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:04:18 - job_xml_thread(): Done retrieving: data size 43993624
Thu 16 Jan 2014 17:04:18 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:04:18 - XML: Start document: iteration 12
Thu 16 Jan 2014 17:04:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43993624
Thu 16 Jan 2014 17:04:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:04:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43993624
Thu 16 Jan 2014 17:04:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:04:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:04:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:04:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:04:29 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:04:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:04:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:04:31 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:04:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:04:31 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:04:31 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:04:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:04:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:04:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:04:38 - XML: Processed 656164 elements - found 983 jobs
Thu 16 Jan 2014 17:04:38 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 17:04:38 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 17:04:38 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:04:38 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:04:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:04:39 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:04:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:04:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:04:39 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:04:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 17:04:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:04:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:04:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:04:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:04:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:04:41 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:04:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43966259
Thu 16 Jan 2014 17:04:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:04:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43966259
Thu 16 Jan 2014 17:04:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:04:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:04:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:04:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:04:52 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:04:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:04:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:04:53 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:04:53 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:04:54 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:04:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:04:54 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:04:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:04:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:04:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:04:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:04:55 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:04:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:04:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:04:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:04:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:04:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:04:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:04:57 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:04:57 - job_xml_thread(): Done retrieving: data size 43986631
Thu 16 Jan 2014 17:04:57 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:04:57 - XML: Start document: iteration 13
Thu 16 Jan 2014 17:04:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43986631
Thu 16 Jan 2014 17:04:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43986631
Thu 16 Jan 2014 17:04:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:04:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:05:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:05:08 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:05:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:05:10 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:05:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 17:05:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:05:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 17:05:10 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:05:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:05:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8790 values 138665 bits 17333 bytes 
Thu 16 Jan 2014 17:05:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:05:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:05:13 - XML: Processed 656160 elements - found 981 jobs
Thu 16 Jan 2014 17:05:13 - job 7344499 appears to have finished
Thu 16 Jan 2014 17:05:13 - job 7346341 appears to have finished
Thu 16 Jan 2014 17:05:13 - job_xml_thread(): Found 2 updated jobs.
Thu 16 Jan 2014 17:05:13 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 17:05:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:05:15 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:05:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:05:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:05:15 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Thu 16 Jan 2014 17:05:15 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:05:15 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:05:16 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:05:16 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:05:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:05:16 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:05:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:05:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:05:17 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:05:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:05:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:05:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:05:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:05:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:05:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:05:19 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:05:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43933880
Thu 16 Jan 2014 17:05:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:05:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43933880
Thu 16 Jan 2014 17:05:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:05:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:05:29 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:05:30 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:05:30 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:05:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:05:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:05:32 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:05:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:05:32 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:05:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:05:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:05:33 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:05:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:05:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:05:34 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:05:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 17:05:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:05:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:05:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:05:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:05:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:05:34 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:05:34 - job_xml_thread(): Done retrieving: data size 43475603
Thu 16 Jan 2014 17:05:34 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:05:34 - XML: Start document: iteration 14
Thu 16 Jan 2014 17:05:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43475603
Thu 16 Jan 2014 17:05:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43475603
Thu 16 Jan 2014 17:05:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:05:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:05:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:05:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:05:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:05:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:05:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:05:50 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:05:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:05:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:05:51 - XML: Processed 649674 elements - found 978 jobs
Thu 16 Jan 2014 17:05:51 - job 7346371 appears to have finished
Thu 16 Jan 2014 17:05:51 - job 7345026 appears to have finished
Thu 16 Jan 2014 17:05:51 - job 7346396 appears to have finished
Thu 16 Jan 2014 17:05:51 - job_xml_thread(): Found 3 updated jobs.
Thu 16 Jan 2014 17:05:51 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 17:05:51 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:05:51 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:05:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:05:51 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:05:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:05:51 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Thu 16 Jan 2014 17:05:51 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:05:51 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:05:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:05:55 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:05:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:05:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:05:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:05:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:05:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:05:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:05:57 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:05:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43328766
Thu 16 Jan 2014 17:05:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:05:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43328766
Thu 16 Jan 2014 17:05:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:06:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:06:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:06:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:06:06 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:06:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:06:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:06:07 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:06:07 - job_xml_thread(): Done retrieving: data size 43328766
Thu 16 Jan 2014 17:06:07 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:06:07 - XML: Start document: iteration 15
Thu 16 Jan 2014 17:06:08 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:06:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:06:08 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:06:08 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:06:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:06:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:06:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:06:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:06:11 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:06:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:06:11 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:06:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 17:06:11 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:06:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 17:06:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8093 values 127652 bits 15956 bytes 
Thu 16 Jan 2014 17:06:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:06:14 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:06:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:06:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:06:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:06:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:06:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:06:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:06:16 - XML: Processed 648066 elements - found 980 jobs
Thu 16 Jan 2014 17:06:16 - job_xml_thread(): Found 2 updated jobs.
Thu 16 Jan 2014 17:06:16 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 17:06:16 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Thu 16 Jan 2014 17:06:16 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:06:16 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:06:18 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:06:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43380242
Thu 16 Jan 2014 17:06:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:06:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43380242
Thu 16 Jan 2014 17:06:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:06:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:06:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:06:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:06:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:06:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:06:31 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:06:31 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:06:31 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:06:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:06:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:06:32 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:06:32 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:06:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:06:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:06:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:06:33 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:06:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:06:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:06:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:06:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:06:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:06:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:06:33 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:06:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 17:06:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:06:35 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:06:35 - job_xml_thread(): Done retrieving: data size 43555262
Thu 16 Jan 2014 17:06:35 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:06:35 - XML: Start document: iteration 16
Thu 16 Jan 2014 17:06:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555262
Thu 16 Jan 2014 17:06:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555262
Thu 16 Jan 2014 17:06:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:06:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:06:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:06:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:06:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:06:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:06:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:06:52 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:06:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:06:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:06:53 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:06:53 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:06:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:06:53 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:06:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:06:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:06:56 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:06:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:06:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:06:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:06:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:06:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:06:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:06:57 - XML: Processed 650708 elements - found 980 jobs
Thu 16 Jan 2014 17:06:57 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 17:06:57 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 17:06:57 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:06:57 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:07:00 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:07:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43965675
Thu 16 Jan 2014 17:07:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:07:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43965675
Thu 16 Jan 2014 17:07:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:07:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:07:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:07:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:07:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:07:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:07:12 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:07:12 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:07:12 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:07:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:07:12 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:07:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:07:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:07:13 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:07:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:07:13 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:07:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:07:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:07:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 17:07:13 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:07:13 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:07:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 17:07:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:07:13 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:07:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8392 values 132323 bits 16540 bytes 
Thu 16 Jan 2014 17:07:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:07:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:07:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:07:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:07:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:07:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:07:15 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:07:15 - job_xml_thread(): Done retrieving: data size 43989266
Thu 16 Jan 2014 17:07:15 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:07:15 - XML: Start document: iteration 17
Thu 16 Jan 2014 17:07:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43989266
Thu 16 Jan 2014 17:07:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:07:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43989266
Thu 16 Jan 2014 17:07:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:07:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:07:27 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:07:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:07:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:07:28 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:07:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:07:28 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:07:28 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:07:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:07:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:07:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:07:33 - XML: Processed 656158 elements - found 980 jobs
Thu 16 Jan 2014 17:07:33 - job 7346446 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:07:33 - job 7346344 appears to have finished
Thu 16 Jan 2014 17:07:33 - job_xml_thread(): Found 3 updated jobs.
Thu 16 Jan 2014 17:07:33 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 17:07:34 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Thu 16 Jan 2014 17:07:34 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:07:34 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:07:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:07:36 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:07:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:07:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:07:36 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:07:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 17:07:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:07:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:07:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:07:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:07:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:07:38 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:07:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43949746
Thu 16 Jan 2014 17:07:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:07:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43949746
Thu 16 Jan 2014 17:07:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:07:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:07:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:07:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:07:49 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:07:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:07:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:07:49 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:07:49 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:07:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:07:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:07:49 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:07:49 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:07:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:07:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:07:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:07:53 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:07:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:07:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:07:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:07:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:07:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:07:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:07:55 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:07:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43972936
Thu 16 Jan 2014 17:07:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:07:55 - job_xml_thread(): Done retrieving: data size 43972936
Thu 16 Jan 2014 17:07:55 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:07:55 - XML: Start document: iteration 18
Thu 16 Jan 2014 17:07:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43972936
Thu 16 Jan 2014 17:07:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:08:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:08:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:08:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:08:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:08:12 - XML: Processed 656158 elements - found 980 jobs
Thu 16 Jan 2014 17:08:12 - job 7346447 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:08:12 - job 7346446 field 'start_timestamp' changed since saved from: 1389888405 to: 1389888353
Thu 16 Jan 2014 17:08:12 - job 7346448 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:08:12 - job_xml_thread(): Found 3 updated jobs.
Thu 16 Jan 2014 17:08:12 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 17:08:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:08:13 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:08:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:08:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 17:08:13 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:08:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9125 values 143953 bits 17994 bytes 
Thu 16 Jan 2014 17:08:13 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:08:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 17:08:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:08:14 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:08:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:08:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:08:14 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Thu 16 Jan 2014 17:08:14 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:08:14 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:08:14 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:08:14 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:08:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:08:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:08:14 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:08:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:08:17 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:08:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:08:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:08:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:08:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:08:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:08:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:08:20 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:08:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43990046
Thu 16 Jan 2014 17:08:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:08:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43990046
Thu 16 Jan 2014 17:08:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:08:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:08:30 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:08:30 - job_xml_thread(): Done retrieving: data size 43990046
Thu 16 Jan 2014 17:08:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:08:30 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:08:30 - XML: Start document: iteration 19
Thu 16 Jan 2014 17:08:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:08:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:08:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:08:37 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:08:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:08:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:08:39 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:08:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:08:39 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:08:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:08:40 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:08:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:08:41 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:08:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:08:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:08:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:08:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:08:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:08:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:08:44 - XML: Processed 656155 elements - found 980 jobs
Thu 16 Jan 2014 17:08:44 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 17:08:44 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 17:08:44 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:08:44 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:08:44 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:08:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 17:08:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:08:46 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:08:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43989947
Thu 16 Jan 2014 17:08:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:08:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43989947
Thu 16 Jan 2014 17:08:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:08:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:08:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:08:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:08:57 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:08:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:08:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:08:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:08:57 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:08:57 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:08:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:08:57 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:08:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:08:57 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:08:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:08:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:08:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:08:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:08:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:08:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:08:59 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:08:59 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:08:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43999648
Thu 16 Jan 2014 17:08:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:09:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43999648
Thu 16 Jan 2014 17:09:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:09:00 - job_xml_thread(): Done retrieving: data size 43999648
Thu 16 Jan 2014 17:09:01 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:09:01 - XML: Start document: iteration 20
Thu 16 Jan 2014 17:09:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:09:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:09:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:09:13 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:09:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:09:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:09:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:09:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:09:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:09:14 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:09:15 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:09:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:09:15 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:09:15 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:09:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:09:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:09:15 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:09:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 17:09:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 17:09:15 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:09:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9274 values 146237 bits 18279 bytes 
Thu 16 Jan 2014 17:09:20 - XML: Processed 656158 elements - found 980 jobs
Thu 16 Jan 2014 17:09:20 - job 7346447 field 'start_timestamp' changed since saved from: 1389888497 to: 1389888414
Thu 16 Jan 2014 17:09:20 - job 7346448 field 'start_timestamp' changed since saved from: 1389888499 to: 1389888423
Thu 16 Jan 2014 17:09:20 - job_xml_thread(): Found 2 updated jobs.
Thu 16 Jan 2014 17:09:20 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 17:09:22 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Thu 16 Jan 2014 17:09:22 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:09:22 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:09:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:09:22 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:09:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:09:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:09:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:09:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:09:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:09:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:09:25 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:09:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43958010
Thu 16 Jan 2014 17:09:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:09:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43958010
Thu 16 Jan 2014 17:09:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:09:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:09:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:09:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:09:34 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:09:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:09:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:09:35 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:09:35 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:09:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:09:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43958010
Thu 16 Jan 2014 17:09:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:09:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:09:37 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:09:38 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:09:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:09:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:09:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:09:44 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:09:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:09:47 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:09:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:09:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:09:47 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:09:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 17:09:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:09:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:09:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:09:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:09:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:09:49 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Thu 16 Jan 2014 17:09:49 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:09:49 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:09:49 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 17:09:49 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:09:49 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 17:09:49 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 17:09:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:09:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:09:50 - size of cluster 'LISA Cluster': 624 hosts 79458 metrics 984284 values 15538338 bits 1942292 bytes 
Thu 16 Jan 2014 17:09:51 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:09:51 - job_xml_thread(): Done retrieving: data size 43981886
Thu 16 Jan 2014 17:09:51 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:09:51 - Housekeeping: checking database for timed out jobs..
Thu 16 Jan 2014 17:09:51 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:09:51 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:09:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:09:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:09:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43981886
Thu 16 Jan 2014 17:09:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:09:51 - Housekeeping: Found 0 timed out jobs in database: closing entries
Thu 16 Jan 2014 17:09:51 - Housekeeping: done.
Thu 16 Jan 2014 17:09:51 - XML: Start document: iteration 0
Thu 16 Jan 2014 17:09:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43981886
Thu 16 Jan 2014 17:09:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:10:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:10:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:10:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:10:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:10:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:10:06 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:10:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:10:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:10:09 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:10:09 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:10:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:10:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:10:09 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:10:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:10:09 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:10:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:10:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:10:11 - XML: Processed 656154 elements - found 978 jobs
Thu 16 Jan 2014 17:10:11 - job 7346088 appears to have finished
Thu 16 Jan 2014 17:10:11 - job 7346449 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:10:11 - job 7346310 appears to have finished
Thu 16 Jan 2014 17:10:11 - job 7346450 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:10:11 - job_xml_thread(): Found 4 updated jobs.
Thu 16 Jan 2014 17:10:11 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 17:10:11 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Thu 16 Jan 2014 17:10:11 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:10:11 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:10:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:10:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:10:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:10:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:10:15 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:10:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43985109
Thu 16 Jan 2014 17:10:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:10:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43985109
Thu 16 Jan 2014 17:10:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:10:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:10:16 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:10:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:10:17 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:10:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 17:10:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 17:10:18 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:10:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8937 values 140941 bits 17617 bytes 
Thu 16 Jan 2014 17:10:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:10:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:10:26 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:10:26 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:10:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:10:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:10:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:10:29 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:10:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:10:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:10:30 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:10:30 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:10:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:10:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:10:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:10:32 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:10:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:10:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:10:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:10:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:10:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:10:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:10:36 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:10:36 - job_xml_thread(): Done retrieving: data size 43977257
Thu 16 Jan 2014 17:10:36 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:10:36 - XML: Start document: iteration 1
Thu 16 Jan 2014 17:10:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43977257
Thu 16 Jan 2014 17:10:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:10:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43977257
Thu 16 Jan 2014 17:10:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:10:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:10:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:10:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:10:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:10:49 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:10:49 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 17:10:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:10:52 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:10:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:10:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:10:53 - XML: Processed 656154 elements - found 978 jobs
Thu 16 Jan 2014 17:10:53 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 17:10:53 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:10:53 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:10:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:10:53 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:10:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:10:53 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 17:10:53 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:10:53 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:10:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:10:57 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:10:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:10:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:10:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:10:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:10:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:10:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:10:57 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:10:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 17:10:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:11:00 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:11:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43984640
Thu 16 Jan 2014 17:11:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:11:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43984640
Thu 16 Jan 2014 17:11:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:11:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:11:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:11:08 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:11:08 - job_xml_thread(): Done retrieving: data size 43984640
Thu 16 Jan 2014 17:11:08 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:11:08 - XML: Start document: iteration 2
Thu 16 Jan 2014 17:11:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:11:11 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:11:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:11:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:11:12 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:11:12 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:11:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:11:12 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:11:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:11:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:11:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:11:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:11:16 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:11:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:11:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:11:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:11:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:11:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:11:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:11:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:11:18 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:11:18 - XML: Processed 656154 elements - found 978 jobs
Thu 16 Jan 2014 17:11:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:11:18 - job 7346450 field 'start_timestamp' changed since saved from: 1389888593 to: 1389888532
Thu 16 Jan 2014 17:11:18 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:11:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 17:11:18 - job 7346451 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:11:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 17:11:18 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:11:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5876 values 92652 bits 11581 bytes 
Thu 16 Jan 2014 17:11:18 - job 7346452 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:11:18 - job 7346453 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:11:18 - job 7346550 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:11:18 - job 7346515 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:11:18 - job 7346342 appears to have finished
Thu 16 Jan 2014 17:11:18 - job_xml_thread(): Found 8 updated jobs.
Thu 16 Jan 2014 17:11:18 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 17:11:18 - job_xml_thread(): Done storing. succesfully stored: 8 jobs
Thu 16 Jan 2014 17:11:18 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:11:18 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:11:23 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:11:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43894720
Thu 16 Jan 2014 17:11:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:11:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43894720
Thu 16 Jan 2014 17:11:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:11:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:11:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:11:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:11:31 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:11:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:11:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:11:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:11:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:11:32 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:11:32 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:11:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:11:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:11:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43894720
Thu 16 Jan 2014 17:11:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:11:33 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:11:33 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:11:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:11:42 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:11:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:11:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:11:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:11:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:11:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:11:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:11:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:11:45 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:11:45 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:11:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 17:11:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:11:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:11:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:11:48 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:11:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:11:48 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:11:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:11:49 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:11:49 - job_xml_thread(): Done retrieving: data size 43396183
Thu 16 Jan 2014 17:11:49 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:11:49 - XML: Start document: iteration 3
Thu 16 Jan 2014 17:11:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43396183
Thu 16 Jan 2014 17:11:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:11:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43396183
Thu 16 Jan 2014 17:11:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:11:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:11:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:12:01 - XML: Processed 649120 elements - found 978 jobs
Thu 16 Jan 2014 17:12:01 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 17:12:01 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 17:12:01 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:12:01 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:12:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:12:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:12:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:12:08 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:12:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:12:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:12:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:12:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:12:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:12:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:12:09 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:12:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:12:09 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:12:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:12:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:12:10 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:12:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:12:10 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:12:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:12:13 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:12:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43332752
Thu 16 Jan 2014 17:12:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:12:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43332752
Thu 16 Jan 2014 17:12:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:12:17 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:12:17 - job_xml_thread(): Done retrieving: data size 43332752
Thu 16 Jan 2014 17:12:17 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:12:18 - XML: Start document: iteration 4
Thu 16 Jan 2014 17:12:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:12:19 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:12:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:12:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 17:12:21 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:12:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 17:12:21 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:12:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9049 values 142744 bits 17843 bytes 
Thu 16 Jan 2014 17:12:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:12:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:12:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:12:25 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:12:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:12:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:12:25 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:12:25 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:12:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:12:25 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:12:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:12:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:12:33 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:12:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:12:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:12:33 - XML: Processed 647994 elements - found 978 jobs
Thu 16 Jan 2014 17:12:33 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 17:12:33 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 17:12:33 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:12:33 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:12:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:12:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:12:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:12:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:12:37 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:12:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43831514
Thu 16 Jan 2014 17:12:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:12:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43831514
Thu 16 Jan 2014 17:12:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:12:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:12:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:12:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:12:43 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:12:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:12:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:12:44 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:12:44 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:12:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:12:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43831514
Thu 16 Jan 2014 17:12:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:12:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:12:48 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:12:48 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:12:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:12:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:12:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:12:55 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:12:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:12:56 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:12:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:12:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:12:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:12:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:12:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:12:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:12:57 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:12:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 17:12:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:12:58 - Leaving storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 17:12:58 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Thu 16 Jan 2014 17:12:58 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:12:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:12:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:12:59 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:12:59 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:12:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:12:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:12:59 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:12:59 - job_xml_thread(): Done retrieving: data size 43954252
Thu 16 Jan 2014 17:12:59 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:12:59 - XML: Start document: iteration 5
Thu 16 Jan 2014 17:13:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43954252
Thu 16 Jan 2014 17:13:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:13:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43954252
Thu 16 Jan 2014 17:13:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:13:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:13:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:13:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:13:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:13:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:13:16 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:13:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:13:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:13:17 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:13:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:13:17 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:13:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:13:17 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:13:18 - XML: Processed 655916 elements - found 996 jobs
Thu 16 Jan 2014 17:13:18 - job 7346681 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:13:19 - job 7344511 appears to have finished
Thu 16 Jan 2014 17:13:19 - job 7344508 appears to have finished
Thu 16 Jan 2014 17:13:19 - job_xml_thread(): Found 23 updated jobs.
Thu 16 Jan 2014 17:13:19 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 17:13:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:13:21 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:13:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:13:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:13:21 - job_xml_thread(): Done storing. succesfully stored: 23 jobs
Thu 16 Jan 2014 17:13:21 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:13:21 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:13:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:13:21 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:13:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:13:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:13:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:13:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:13:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:13:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 17:13:22 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:13:22 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:13:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5864 values 92509 bits 11563 bytes 
Thu 16 Jan 2014 17:13:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 17:13:23 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:13:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43977592
Thu 16 Jan 2014 17:13:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:13:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43977592
Thu 16 Jan 2014 17:13:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:13:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:13:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:13:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:13:33 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:13:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:13:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:13:35 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:13:35 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:13:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:13:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:13:35 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:13:36 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:13:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:13:36 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:13:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:13:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:13:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:13:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:13:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:13:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:13:38 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:13:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 17:13:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:13:38 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:13:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43987234
Thu 16 Jan 2014 17:13:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:13:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43987234
Thu 16 Jan 2014 17:13:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:13:39 - job_xml_thread(): Done retrieving: data size 43987234
Thu 16 Jan 2014 17:13:39 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:13:40 - XML: Start document: iteration 6
Thu 16 Jan 2014 17:13:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:13:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:13:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:13:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:13:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:13:54 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:13:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:13:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:13:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:13:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:13:54 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:13:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:13:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:13:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:13:55 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:13:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:13:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:13:56 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:13:56 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:13:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:13:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:13:57 - XML: Processed 656182 elements - found 992 jobs
Thu 16 Jan 2014 17:13:57 - job 7346249 appears to have finished
Thu 16 Jan 2014 17:13:57 - job 7325659 appears to have finished
Thu 16 Jan 2014 17:13:57 - job 7346252 appears to have finished
Thu 16 Jan 2014 17:13:57 - job 7346250 appears to have finished
Thu 16 Jan 2014 17:13:57 - job 7346251 appears to have finished
Thu 16 Jan 2014 17:13:57 - job 7346551 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:13:57 - job_xml_thread(): Found 7 updated jobs.
Thu 16 Jan 2014 17:13:57 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 17:13:57 - job_xml_thread(): Done storing. succesfully stored: 7 jobs
Thu 16 Jan 2014 17:13:57 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:13:57 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:13:59 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:13:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43994018
Thu 16 Jan 2014 17:13:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:13:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43994018
Thu 16 Jan 2014 17:14:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:14:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:14:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:14:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:14:10 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:14:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:14:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:14:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:14:12 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:14:12 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:14:12 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:14:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:14:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:14:12 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:14:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:14:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:14:13 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:14:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:14:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:14:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:14:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:14:14 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:14:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 44007424
Thu 16 Jan 2014 17:14:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:14:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 44007424
Thu 16 Jan 2014 17:14:15 - job_xml_thread(): Done retrieving: data size 44007424
Thu 16 Jan 2014 17:14:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:14:15 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:14:15 - XML: Start document: iteration 7
Thu 16 Jan 2014 17:14:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:14:22 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:14:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:14:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 17:14:23 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:14:23 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:14:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 17:14:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 10279 values 162082 bits 20260 bytes 
Thu 16 Jan 2014 17:14:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:14:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:14:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:14:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:14:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:14:33 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:14:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:14:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:14:34 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:14:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:14:34 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:14:34 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:14:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:14:38 - XML: Processed 656182 elements - found 992 jobs
Thu 16 Jan 2014 17:14:39 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 17:14:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:14:39 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:14:39 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 17:14:39 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:14:39 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:14:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:14:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:14:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:14:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:14:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:14:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:14:41 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:14:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43978776
Thu 16 Jan 2014 17:14:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:14:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43978776
Thu 16 Jan 2014 17:14:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:14:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:14:47 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:14:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:14:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:14:50 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:14:50 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:14:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:14:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:14:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43978776
Thu 16 Jan 2014 17:14:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:14:54 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:14:54 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:14:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:14:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:14:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:14:56 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:14:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:14:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:14:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:14:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:14:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:14:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:14:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:14:59 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:15:00 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:15:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 17:15:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:15:01 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:15:01 - job_xml_thread(): Done retrieving: data size 43995031
Thu 16 Jan 2014 17:15:01 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:15:01 - XML: Start document: iteration 8
Thu 16 Jan 2014 17:15:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43995031
Thu 16 Jan 2014 17:15:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:15:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:15:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:15:08 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:15:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:15:08 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:15:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43995031
Thu 16 Jan 2014 17:15:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:15:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:15:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:15:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:15:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:15:18 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:15:20 - XML: Processed 656182 elements - found 992 jobs
Thu 16 Jan 2014 17:15:20 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 17:15:20 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 17:15:20 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:15:20 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:15:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:15:21 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:15:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:15:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:15:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:15:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:15:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:15:22 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:15:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:15:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:15:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:15:23 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:15:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:15:23 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:15:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:15:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:15:23 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:15:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:15:24 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:15:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 17:15:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 17:15:24 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:15:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5369 values 84661 bits 10582 bytes 
Thu 16 Jan 2014 17:15:24 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:15:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43992108
Thu 16 Jan 2014 17:15:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:15:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43992108
Thu 16 Jan 2014 17:15:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:15:35 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:15:35 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:15:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:15:36 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:15:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:15:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:15:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:15:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:15:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:15:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:15:38 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:15:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:15:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:15:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:15:39 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:15:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:15:39 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:15:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:15:40 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:15:40 - job_xml_thread(): Done retrieving: data size 43989616
Thu 16 Jan 2014 17:15:40 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:15:40 - XML: Start document: iteration 9
Thu 16 Jan 2014 17:15:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43989616
Thu 16 Jan 2014 17:15:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:15:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43989616
Thu 16 Jan 2014 17:15:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:15:51 - XML: Processed 656178 elements - found 990 jobs
Thu 16 Jan 2014 17:15:51 - job 7346325 appears to have finished
Thu 16 Jan 2014 17:15:51 - job 7346428 appears to have finished
Thu 16 Jan 2014 17:15:51 - job 7346554 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:15:51 - job 7346553 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:15:51 - job 7346552 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:15:51 - job_xml_thread(): Found 5 updated jobs.
Thu 16 Jan 2014 17:15:51 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 17:15:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:15:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:15:54 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Thu 16 Jan 2014 17:15:54 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:15:54 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:15:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:15:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:15:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:15:58 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:15:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:15:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:15:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:15:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:15:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:15:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:15:59 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:15:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:15:59 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:15:59 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:15:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 17:15:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:15:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:15:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:16:00 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:16:00 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:16:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:16:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:16:00 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:16:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 44015672
Thu 16 Jan 2014 17:16:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:16:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 44015672
Thu 16 Jan 2014 17:16:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:16:09 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:16:09 - job_xml_thread(): Done retrieving: data size 44015672
Thu 16 Jan 2014 17:16:09 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:16:09 - XML: Start document: iteration 10
Thu 16 Jan 2014 17:16:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:16:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:16:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:16:14 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:16:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:16:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:16:16 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:16:16 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:16:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:16:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:16:16 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:16:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:16:21 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:16:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:16:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:16:21 - XML: Processed 656178 elements - found 990 jobs
Thu 16 Jan 2014 17:16:21 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 17:16:21 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 17:16:21 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:16:21 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:16:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:16:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:16:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:16:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:16:23 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:16:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43980161
Thu 16 Jan 2014 17:16:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:16:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43980161
Thu 16 Jan 2014 17:16:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:16:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:16:24 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:16:25 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:16:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 17:16:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:16:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 17:16:25 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:16:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9077 values 143239 bits 17904 bytes 
Thu 16 Jan 2014 17:16:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:16:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:16:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:16:36 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:16:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:16:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:16:36 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:16:36 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:16:36 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:16:36 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:16:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:16:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:16:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:16:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:16:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:16:38 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:16:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:16:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:16:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:16:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:16:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:16:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:16:40 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:16:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 17:16:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:16:40 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:16:40 - job_xml_thread(): Done retrieving: data size 43989227
Thu 16 Jan 2014 17:16:40 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:16:40 - XML: Start document: iteration 11
Thu 16 Jan 2014 17:16:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43989227
Thu 16 Jan 2014 17:16:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:16:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43989227
Thu 16 Jan 2014 17:16:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:16:50 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Thu 16 Jan 2014 17:16:51 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:16:51 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:16:51 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:16:51 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 17:16:51 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 17:16:51 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 17:16:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:16:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:16:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:16:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:16:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:16:56 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:16:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:16:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:16:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:16:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:16:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:16:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:16:57 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:16:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:16:57 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:16:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:16:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:16:58 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:16:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:16:58 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:16:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:17:00 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 921422 values 14548428 bits 1818553 bytes 
Thu 16 Jan 2014 17:17:01 - XML: Processed 656178 elements - found 990 jobs
Thu 16 Jan 2014 17:17:01 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 17:17:01 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 17:17:01 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:17:01 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:17:04 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:17:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 44009946
Thu 16 Jan 2014 17:17:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:17:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 44009946
Thu 16 Jan 2014 17:17:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:17:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:17:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:17:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:17:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:17:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:17:16 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:17:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:17:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:17:16 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:17:16 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:17:16 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:17:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:17:16 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:17:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:17:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:17:18 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:17:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:17:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:17:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:17:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:17:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:17:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:17:20 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:17:20 - job_xml_thread(): Done retrieving: data size 43928876
Thu 16 Jan 2014 17:17:20 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:17:20 - XML: Start document: iteration 12
Thu 16 Jan 2014 17:17:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43928876
Thu 16 Jan 2014 17:17:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:17:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43928876
Thu 16 Jan 2014 17:17:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:17:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:17:27 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:17:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:17:29 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:17:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 17:17:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 17:17:30 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:17:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:17:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:17:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 149059 bits 18632 bytes 
Thu 16 Jan 2014 17:17:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:17:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:17:34 - XML: Processed 655420 elements - found 990 jobs
Thu 16 Jan 2014 17:17:34 - job 7346554 field 'start_timestamp' changed since saved from: 1389888936 to: 1389888904
Thu 16 Jan 2014 17:17:34 - job_xml_thread(): Found 1 updated jobs.
Thu 16 Jan 2014 17:17:34 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 17:17:35 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Thu 16 Jan 2014 17:17:35 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:17:35 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:17:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:17:36 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:17:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:17:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:17:36 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:17:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:17:36 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:17:36 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:17:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:17:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:17:40 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:17:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:17:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:17:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:17:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:17:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:17:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:17:44 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:17:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43419062
Thu 16 Jan 2014 17:17:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:17:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43419062
Thu 16 Jan 2014 17:17:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:17:50 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:17:50 - job_xml_thread(): Done retrieving: data size 43419062
Thu 16 Jan 2014 17:17:50 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:17:50 - XML: Start document: iteration 13
Thu 16 Jan 2014 17:17:51 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:17:51 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 17:17:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:17:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:17:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:17:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:17:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:17:57 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:17:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:17:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:17:59 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:17:59 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:17:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:17:59 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:17:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:18:04 - XML: Processed 649154 elements - found 990 jobs
Thu 16 Jan 2014 17:18:04 - job 7346555 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:18:04 - job_xml_thread(): Found 1 updated jobs.
Thu 16 Jan 2014 17:18:04 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 17:18:04 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Thu 16 Jan 2014 17:18:04 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:18:04 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:18:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:18:07 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:18:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:18:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:18:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:18:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:18:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:18:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:18:07 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:18:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 17:18:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:18:11 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:18:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43357922
Thu 16 Jan 2014 17:18:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:18:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43357922
Thu 16 Jan 2014 17:18:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:18:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:18:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:18:20 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:18:20 - job_xml_thread(): Done retrieving: data size 43357922
Thu 16 Jan 2014 17:18:20 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:18:20 - XML: Start document: iteration 14
Thu 16 Jan 2014 17:18:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:18:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:18:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:18:23 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:18:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:18:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:18:25 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:18:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:18:25 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:18:25 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:18:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:18:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:18:30 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:18:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:18:31 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:18:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 17:18:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 17:18:31 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:18:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5872 values 92909 bits 11613 bytes 
Thu 16 Jan 2014 17:18:31 - XML: Processed 648602 elements - found 990 jobs
Thu 16 Jan 2014 17:18:32 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 17:18:32 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 17:18:32 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:18:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:18:32 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:18:32 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:18:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:18:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:18:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:18:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:18:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:18:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:18:37 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:18:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43755534
Thu 16 Jan 2014 17:18:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:18:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43755534
Thu 16 Jan 2014 17:18:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:18:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:18:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:18:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:18:46 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:18:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:18:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:18:48 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:18:48 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:18:48 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:18:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:18:48 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:18:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:18:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:18:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:18:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:18:50 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:18:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:18:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:18:50 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:18:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 17:18:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:18:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:18:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:18:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:18:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:18:53 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:18:53 - job_xml_thread(): Done retrieving: data size 43971354
Thu 16 Jan 2014 17:18:53 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:18:53 - XML: Start document: iteration 15
Thu 16 Jan 2014 17:18:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43971354
Thu 16 Jan 2014 17:18:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:18:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43971354
Thu 16 Jan 2014 17:18:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:19:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:19:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:19:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:19:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:19:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:19:06 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:19:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:19:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:19:07 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:19:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:19:07 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:19:07 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:19:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:19:08 - XML: Processed 656022 elements - found 987 jobs
Thu 16 Jan 2014 17:19:08 - job 7344512 appears to have finished
Thu 16 Jan 2014 17:19:08 - job 7346362 appears to have finished
Thu 16 Jan 2014 17:19:08 - job 7346309 appears to have finished
Thu 16 Jan 2014 17:19:08 - job_xml_thread(): Found 3 updated jobs.
Thu 16 Jan 2014 17:19:08 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 17:19:09 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Thu 16 Jan 2014 17:19:09 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:19:10 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:19:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:19:11 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:19:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:19:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:19:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:19:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:19:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:19:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:19:14 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:19:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43980510
Thu 16 Jan 2014 17:19:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:19:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43980510
Thu 16 Jan 2014 17:19:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:19:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:19:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:19:25 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:19:25 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:19:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:19:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:19:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:19:29 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:19:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:19:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:19:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:19:29 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:19:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:19:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:19:29 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:19:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:19:29 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:19:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:19:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:19:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:19:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:19:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:19:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:19:31 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:19:31 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:19:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:19:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 17:19:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 17:19:31 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:19:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8938 values 141014 bits 17626 bytes 
Thu 16 Jan 2014 17:19:33 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:19:33 - job_xml_thread(): Done retrieving: data size 43985641
Thu 16 Jan 2014 17:19:33 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:19:33 - XML: Start document: iteration 16
Thu 16 Jan 2014 17:19:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43985641
Thu 16 Jan 2014 17:19:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43985641
Thu 16 Jan 2014 17:19:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:19:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:19:43 - XML: Processed 656172 elements - found 987 jobs
Thu 16 Jan 2014 17:19:43 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 17:19:43 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 17:19:44 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:19:44 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:19:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:19:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:19:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:19:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:19:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:19:49 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:19:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:19:50 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:19:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:19:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:19:50 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:19:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:19:50 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:19:50 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:19:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:19:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:19:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:19:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:19:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:19:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:19:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:19:52 - Leaving storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 17:19:52 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Thu 16 Jan 2014 17:19:52 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:19:53 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:19:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 17:19:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:19:53 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:19:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43987199
Thu 16 Jan 2014 17:19:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:19:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43987199
Thu 16 Jan 2014 17:19:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:19:59 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:19:59 - job_xml_thread(): Done retrieving: data size 43987199
Thu 16 Jan 2014 17:19:59 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:19:59 - XML: Start document: iteration 17
Thu 16 Jan 2014 17:20:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:20:04 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:20:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:20:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:20:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:20:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:20:06 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:20:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:20:06 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:20:06 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:20:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:20:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:20:09 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:20:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:20:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:20:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:20:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:20:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:20:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:20:12 - XML: Processed 656176 elements - found 989 jobs
Thu 16 Jan 2014 17:20:12 - job_xml_thread(): Found 2 updated jobs.
Thu 16 Jan 2014 17:20:12 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 17:20:12 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Thu 16 Jan 2014 17:20:12 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:20:12 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:20:14 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:20:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43978467
Thu 16 Jan 2014 17:20:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:20:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43978467
Thu 16 Jan 2014 17:20:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:20:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:20:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:20:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:20:24 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:20:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:20:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:20:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:20:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:20:25 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:20:25 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:20:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:20:25 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:20:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:20:27 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:20:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:20:28 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:20:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:20:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:20:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:20:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:20:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:20:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:20:29 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:20:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43997158
Thu 16 Jan 2014 17:20:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:20:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43997158
Thu 16 Jan 2014 17:20:29 - job_xml_thread(): Done retrieving: data size 43997158
Thu 16 Jan 2014 17:20:29 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:20:29 - XML: Start document: iteration 18
Thu 16 Jan 2014 17:20:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:20:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:20:32 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:20:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:20:33 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:20:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 17:20:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 17:20:33 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:20:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 10145 values 160041 bits 20005 bytes 
Thu 16 Jan 2014 17:20:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:20:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:20:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:20:41 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:20:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:20:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:20:42 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:20:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:20:42 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:20:42 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:20:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:20:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:20:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:20:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:20:49 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:20:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:20:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:20:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:20:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:20:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:20:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:20:52 - XML: Processed 656176 elements - found 989 jobs
Thu 16 Jan 2014 17:20:52 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 17:20:52 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 17:20:52 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:20:52 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:20:53 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:20:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 17:20:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:20:54 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:20:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43950793
Thu 16 Jan 2014 17:20:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:20:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43950793
Thu 16 Jan 2014 17:20:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:20:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:20:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:21:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:21:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:21:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:21:06 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:21:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:21:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:21:06 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:21:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:21:06 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:21:06 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:21:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:21:07 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:21:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:21:09 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:21:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:21:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:21:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:21:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:21:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:21:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:21:10 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:21:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43982720
Thu 16 Jan 2014 17:21:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:21:11 - job_xml_thread(): Done retrieving: data size 43982720
Thu 16 Jan 2014 17:21:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43982720
Thu 16 Jan 2014 17:21:11 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:21:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:21:12 - XML: Start document: iteration 19
Thu 16 Jan 2014 17:21:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:21:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:21:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:21:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:21:30 - XML: Processed 656174 elements - found 988 jobs
Thu 16 Jan 2014 17:21:30 - job 7346329 appears to have finished
Thu 16 Jan 2014 17:21:30 - job 7346556 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:21:31 - job 7346713 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:21:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:21:31 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:21:31 - job_xml_thread(): Found 3 updated jobs.
Thu 16 Jan 2014 17:21:31 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 17:21:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:21:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:21:31 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:21:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:21:31 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:21:31 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:21:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:21:33 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Thu 16 Jan 2014 17:21:33 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:21:33 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:21:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:21:33 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:21:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:21:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:21:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:21:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:21:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:21:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:21:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:21:34 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:21:35 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:21:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 44007312
Thu 16 Jan 2014 17:21:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:21:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 44007312
Thu 16 Jan 2014 17:21:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:21:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:21:35 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:21:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 17:21:35 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:21:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7433 values 117282 bits 14660 bytes 
Thu 16 Jan 2014 17:21:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 17:21:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:21:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:21:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:21:48 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:21:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:21:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:21:48 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:21:48 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:21:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:21:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:21:49 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:21:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:21:49 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:21:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:21:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:21:50 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:21:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:21:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:21:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:21:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:21:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:21:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:21:52 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:21:52 - job_xml_thread(): Done retrieving: data size 43995590
Thu 16 Jan 2014 17:21:52 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:21:52 - XML: Start document: iteration 20
Thu 16 Jan 2014 17:21:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43995590
Thu 16 Jan 2014 17:21:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:21:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43995590
Thu 16 Jan 2014 17:21:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:22:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:22:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:22:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:22:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:22:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:22:09 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:22:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:22:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:22:11 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:22:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:22:11 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:22:11 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:22:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:22:11 - XML: Processed 656171 elements - found 988 jobs
Thu 16 Jan 2014 17:22:11 - job 7346557 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:22:11 - job 7346556 field 'start_timestamp' changed since saved from: 1389889255 to: 1389889199
Thu 16 Jan 2014 17:22:11 - job 7346713 field 'start_timestamp' changed since saved from: 1389889254 to: 1389889199
Thu 16 Jan 2014 17:22:11 - job_xml_thread(): Found 3 updated jobs.
Thu 16 Jan 2014 17:22:11 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 17:22:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:22:13 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:22:13 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Thu 16 Jan 2014 17:22:13 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:22:13 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:22:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:22:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:22:13 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:22:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 17:22:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:22:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:22:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:22:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:22:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:22:15 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:22:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 44002043
Thu 16 Jan 2014 17:22:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:22:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 44002043
Thu 16 Jan 2014 17:22:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:22:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:22:25 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:22:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:22:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:22:27 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:22:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:22:27 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:22:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:22:27 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:22:27 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:22:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:22:28 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:22:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:22:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:22:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:22:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:22:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:22:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:22:30 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:22:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 44004409
Thu 16 Jan 2014 17:22:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:22:30 - job_xml_thread(): Done retrieving: data size 44004409
Thu 16 Jan 2014 17:22:30 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:22:30 - Housekeeping: checking database for timed out jobs..
Thu 16 Jan 2014 17:22:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 44004409
Thu 16 Jan 2014 17:22:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:22:31 - Housekeeping: Found 0 timed out jobs in database: closing entries
Thu 16 Jan 2014 17:22:31 - Housekeeping: done.
Thu 16 Jan 2014 17:22:32 - XML: Start document: iteration 0
Thu 16 Jan 2014 17:22:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:22:36 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:22:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:22:38 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:22:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 17:22:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 17:22:39 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:22:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9211 values 145310 bits 18163 bytes 
Thu 16 Jan 2014 17:22:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:22:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:22:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:22:42 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:22:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:22:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:22:43 - XML: Processed 656174 elements - found 988 jobs
Thu 16 Jan 2014 17:22:43 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 17:22:43 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 17:22:43 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:22:43 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:22:43 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:22:43 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:22:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:22:43 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:22:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:22:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:22:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:22:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:22:48 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:22:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:22:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:22:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:22:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:22:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:22:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:22:50 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:22:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 44003749
Thu 16 Jan 2014 17:22:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:22:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 44003749
Thu 16 Jan 2014 17:22:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:22:59 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:22:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:22:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:22:59 - job_xml_thread(): Done retrieving: data size 44003749
Thu 16 Jan 2014 17:22:59 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:22:59 - XML: Start document: iteration 1
Thu 16 Jan 2014 17:23:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:23:00 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:23:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:23:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:23:03 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:23:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:23:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:23:03 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:23:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:23:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:23:03 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:23:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:23:10 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:23:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:23:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:23:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:23:12 - XML: Processed 656174 elements - found 988 jobs
Thu 16 Jan 2014 17:23:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:23:12 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 17:23:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:23:12 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 17:23:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:23:12 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:23:12 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:23:12 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:23:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 17:23:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:23:13 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:23:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43961991
Thu 16 Jan 2014 17:23:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:23:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43961991
Thu 16 Jan 2014 17:23:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:23:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:23:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:23:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:23:22 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:23:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:23:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:23:23 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:23:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:23:23 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:23:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:23:23 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:23:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:23:27 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:23:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:23:27 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:23:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:23:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:23:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:23:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:23:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:23:29 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:23:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43871656
Thu 16 Jan 2014 17:23:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:23:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43871656
Thu 16 Jan 2014 17:23:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:23:30 - job_xml_thread(): Done retrieving: data size 43871656
Thu 16 Jan 2014 17:23:30 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:23:30 - XML: Start document: iteration 2
Thu 16 Jan 2014 17:23:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:23:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:23:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:23:39 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:23:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:23:41 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:23:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 17:23:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 17:23:41 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:23:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8981 values 141630 bits 17703 bytes 
Thu 16 Jan 2014 17:23:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:23:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:23:48 - XML: Processed 654812 elements - found 987 jobs
Thu 16 Jan 2014 17:23:48 - job 7343686 appears to have finished
Thu 16 Jan 2014 17:23:48 - job_xml_thread(): Found 1 updated jobs.
Thu 16 Jan 2014 17:23:48 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 17:23:48 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Thu 16 Jan 2014 17:23:49 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:23:49 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:23:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:23:49 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:23:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:23:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:23:50 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:23:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:23:50 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:23:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:23:50 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:23:52 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Thu 16 Jan 2014 17:23:52 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:23:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:23:52 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:23:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:23:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:23:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:23:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:23:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:23:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:23:52 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:23:52 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:23:52 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 17:23:52 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 17:23:52 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 17:23:53 - size of cluster 'LISA Cluster': 624 hosts 79485 metrics 902004 values 14236716 bits 1779589 bytes 
Thu 16 Jan 2014 17:23:56 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:23:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 17:23:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:23:57 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:23:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43317996
Thu 16 Jan 2014 17:23:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:23:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43317996
Thu 16 Jan 2014 17:23:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:24:04 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:24:05 - job_xml_thread(): Done retrieving: data size 43317996
Thu 16 Jan 2014 17:24:05 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:24:05 - XML: Start document: iteration 3
Thu 16 Jan 2014 17:24:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:24:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:24:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:24:07 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:24:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:24:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:24:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:24:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:24:08 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:24:08 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:24:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:24:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:24:09 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:24:18 - XML: Processed 648048 elements - found 986 jobs
Thu 16 Jan 2014 17:24:18 - job 7346563 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:24:18 - job 7346360 appears to have finished
Thu 16 Jan 2014 17:24:18 - job 7346560 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:24:19 - job 7346562 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:24:19 - job 7346564 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:24:19 - job 7346457 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:24:19 - job 7346558 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:24:20 - job 7346694 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:24:20 - job 7346559 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:24:20 - job 7346565 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:24:20 - job 7346432 appears to have finished
Thu 16 Jan 2014 17:24:20 - job 7346561 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:24:20 - job_xml_thread(): Found 13 updated jobs.
Thu 16 Jan 2014 17:24:20 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 17:24:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:24:20 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:24:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:24:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:24:20 - job_xml_thread(): Done storing. succesfully stored: 13 jobs
Thu 16 Jan 2014 17:24:20 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:24:20 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:24:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:24:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:24:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:24:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:24:22 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:24:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43372554
Thu 16 Jan 2014 17:24:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:24:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43372554
Thu 16 Jan 2014 17:24:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:24:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:24:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:24:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:24:30 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:24:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:24:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:24:31 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:24:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:24:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43372554
Thu 16 Jan 2014 17:24:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:24:32 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:24:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:24:35 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:24:35 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:24:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:24:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:24:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:24:41 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:24:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:24:41 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:24:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:24:42 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:24:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 17:24:42 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:24:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 17:24:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99070 bits 12383 bytes 
Thu 16 Jan 2014 17:24:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:24:42 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:24:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:24:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:24:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:24:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:24:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:24:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:24:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:24:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:24:47 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:24:47 - job_xml_thread(): Done retrieving: data size 43878283
Thu 16 Jan 2014 17:24:47 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:24:47 - XML: Start document: iteration 4
Thu 16 Jan 2014 17:24:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43878283
Thu 16 Jan 2014 17:24:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:24:48 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:24:48 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:24:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:24:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43878283
Thu 16 Jan 2014 17:24:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:24:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:24:53 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:24:53 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 17:24:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:24:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:25:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:25:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:25:05 - XML: Processed 655036 elements - found 986 jobs
Thu 16 Jan 2014 17:25:06 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 17:25:06 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 17:25:06 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:25:06 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:25:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:25:07 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:25:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:25:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:25:08 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:25:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:25:08 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:25:08 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:25:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:25:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:25:11 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:25:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:25:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:25:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:25:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:25:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:25:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:25:11 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:25:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 17:25:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:25:15 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:25:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43973040
Thu 16 Jan 2014 17:25:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:25:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43973040
Thu 16 Jan 2014 17:25:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:25:22 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:25:22 - job_xml_thread(): Done retrieving: data size 43973040
Thu 16 Jan 2014 17:25:22 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:25:22 - XML: Start document: iteration 5
Thu 16 Jan 2014 17:25:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:25:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:25:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:25:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:25:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:25:28 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:25:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:25:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:25:29 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:25:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:25:29 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:25:29 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:25:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:25:35 - XML: Processed 656170 elements - found 986 jobs
Thu 16 Jan 2014 17:25:35 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 17:25:35 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 17:25:35 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:25:35 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:25:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:25:38 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:25:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:25:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:25:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:25:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:25:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:25:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:25:40 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:25:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43963811
Thu 16 Jan 2014 17:25:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:25:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43963811
Thu 16 Jan 2014 17:25:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:25:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:25:42 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:25:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:25:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 17:25:43 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:25:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8770 values 138240 bits 17280 bytes 
Thu 16 Jan 2014 17:25:43 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:25:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 17:25:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:25:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:25:50 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:25:50 - job_xml_thread(): Done retrieving: data size 43963811
Thu 16 Jan 2014 17:25:50 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:25:50 - XML: Start document: iteration 6
Thu 16 Jan 2014 17:25:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:25:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:25:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:25:56 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:25:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:25:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:25:57 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:25:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:25:57 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:25:57 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:25:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:26:06 - XML: Processed 656178 elements - found 990 jobs
Thu 16 Jan 2014 17:26:06 - job 7346563 field 'start_timestamp' changed since saved from: 1389889404 to: 1389889365
Thu 16 Jan 2014 17:26:06 - job 7346562 field 'start_timestamp' changed since saved from: 1389889447 to: 1389889365
Thu 16 Jan 2014 17:26:06 - job 7346566 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:26:06 - job 7346567 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:26:06 - job 7346568 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:26:06 - job 7346458 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:26:06 - job 7346694 field 'start_timestamp' changed since saved from: 1389889441 to: 1389889365
Thu 16 Jan 2014 17:26:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:26:06 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:26:06 - job 7346559 field 'start_timestamp' changed since saved from: 1389889441 to: 1389889365
Thu 16 Jan 2014 17:26:06 - job 7346561 field 'start_timestamp' changed since saved from: 1389889445 to: 1389889365
Thu 16 Jan 2014 17:26:06 - job_xml_thread(): Found 13 updated jobs.
Thu 16 Jan 2014 17:26:06 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 17:26:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:26:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:26:06 - job_xml_thread(): Done storing. succesfully stored: 13 jobs
Thu 16 Jan 2014 17:26:06 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:26:06 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:26:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:26:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:26:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:26:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:26:10 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:26:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43976510
Thu 16 Jan 2014 17:26:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:26:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43976510
Thu 16 Jan 2014 17:26:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:26:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:26:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:26:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:26:22 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:26:22 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:26:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:26:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:26:24 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:26:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:26:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:26:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:26:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:26:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:26:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:26:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:26:26 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:26:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:26:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:26:27 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:26:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 17:26:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:26:27 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:26:27 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:26:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:26:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:26:30 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:26:30 - job_xml_thread(): Done retrieving: data size 43969592
Thu 16 Jan 2014 17:26:30 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:26:30 - XML: Start document: iteration 7
Thu 16 Jan 2014 17:26:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43969592
Thu 16 Jan 2014 17:26:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43969592
Thu 16 Jan 2014 17:26:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:26:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:26:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:26:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:26:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:26:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:26:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:26:44 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:26:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:26:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 17:26:46 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:26:46 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:26:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 17:26:47 - XML: Processed 656168 elements - found 985 jobs
Thu 16 Jan 2014 17:26:47 - job 7346418 appears to have finished
Thu 16 Jan 2014 17:26:47 - job 7338496 appears to have finished
Thu 16 Jan 2014 17:26:47 - job 7346437 appears to have finished
Thu 16 Jan 2014 17:26:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6021 values 94983 bits 11872 bytes 
Thu 16 Jan 2014 17:26:47 - job 7346435 appears to have finished
Thu 16 Jan 2014 17:26:47 - job 7345952 appears to have finished
Thu 16 Jan 2014 17:26:48 - job_xml_thread(): Found 5 updated jobs.
Thu 16 Jan 2014 17:26:48 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 17:26:51 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Thu 16 Jan 2014 17:26:51 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:26:51 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:26:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:26:53 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:26:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:26:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:26:54 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:26:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:26:54 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:26:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:26:54 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:26:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:26:55 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:26:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:26:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:26:56 - Leaving storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 17:26:56 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Thu 16 Jan 2014 17:26:56 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:26:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:26:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:26:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:26:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:26:58 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:26:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43984995
Thu 16 Jan 2014 17:26:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:26:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43984995
Thu 16 Jan 2014 17:26:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:27:07 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:27:07 - job_xml_thread(): Done retrieving: data size 43984995
Thu 16 Jan 2014 17:27:07 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:27:07 - XML: Start document: iteration 8
Thu 16 Jan 2014 17:27:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:27:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:27:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:27:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:27:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:27:13 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:27:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:27:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:27:14 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:27:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:27:14 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:27:14 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:27:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:27:19 - XML: Processed 656168 elements - found 985 jobs
Thu 16 Jan 2014 17:27:19 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 17:27:19 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 17:27:19 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:27:19 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:27:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:27:22 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:27:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:27:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:27:22 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:27:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 17:27:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:27:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:27:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:27:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:27:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:27:24 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:27:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43989119
Thu 16 Jan 2014 17:27:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:27:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43989119
Thu 16 Jan 2014 17:27:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:27:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:27:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:27:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:27:33 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:27:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:27:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:27:35 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:27:35 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:27:35 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:27:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:27:35 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:27:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:27:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:27:37 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:27:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:27:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:27:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:27:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:27:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:27:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:27:38 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:27:38 - job_xml_thread(): Done retrieving: data size 44007061
Thu 16 Jan 2014 17:27:38 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:27:38 - XML: Start document: iteration 9
Thu 16 Jan 2014 17:27:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 44007061
Thu 16 Jan 2014 17:27:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 44007061
Thu 16 Jan 2014 17:27:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:27:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:27:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:27:47 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:27:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:27:48 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:27:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 17:27:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 17:27:49 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:27:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:27:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:27:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9024 values 142389 bits 17798 bytes 
Thu 16 Jan 2014 17:27:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:27:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:27:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:27:54 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:27:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:27:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:27:55 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:27:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:27:55 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:27:55 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:27:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:27:56 - XML: Processed 656160 elements - found 981 jobs
Thu 16 Jan 2014 17:27:56 - job 7343688 appears to have finished
Thu 16 Jan 2014 17:27:56 - job 7346445 appears to have finished
Thu 16 Jan 2014 17:27:56 - job 7346442 appears to have finished
Thu 16 Jan 2014 17:27:56 - job 7346425 appears to have finished
Thu 16 Jan 2014 17:27:56 - job_xml_thread(): Found 4 updated jobs.
Thu 16 Jan 2014 17:27:56 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 17:27:57 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Thu 16 Jan 2014 17:27:57 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:27:57 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:28:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:28:02 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:28:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:28:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:28:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:28:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:28:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:28:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:28:04 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:28:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43983358
Thu 16 Jan 2014 17:28:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:28:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43983358
Thu 16 Jan 2014 17:28:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:28:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:28:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:28:12 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:28:12 - job_xml_thread(): Done retrieving: data size 43983358
Thu 16 Jan 2014 17:28:12 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:28:12 - XML: Start document: iteration 10
Thu 16 Jan 2014 17:28:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:28:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:28:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:28:20 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:28:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:28:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:28:20 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:28:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:28:20 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:28:20 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:28:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:28:25 - XML: Processed 656162 elements - found 982 jobs
Thu 16 Jan 2014 17:28:25 - job 7346569 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:28:25 - job_xml_thread(): Found 2 updated jobs.
Thu 16 Jan 2014 17:28:25 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 17:28:26 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Thu 16 Jan 2014 17:28:26 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:28:27 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:28:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:28:28 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:28:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:28:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:28:28 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:28:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 17:28:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:28:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:28:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:28:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:28:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:28:29 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:28:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43961378
Thu 16 Jan 2014 17:28:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:28:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43961378
Thu 16 Jan 2014 17:28:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:28:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:28:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:28:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:28:39 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:28:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:28:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:28:40 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:28:40 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:28:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:28:40 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:28:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:28:42 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:28:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:28:43 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:28:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:28:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:28:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:28:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:28:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:28:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:28:45 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:28:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43980689
Thu 16 Jan 2014 17:28:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:28:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43980689
Thu 16 Jan 2014 17:28:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:28:46 - job_xml_thread(): Done retrieving: data size 43980689
Thu 16 Jan 2014 17:28:46 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:28:46 - XML: Start document: iteration 11
Thu 16 Jan 2014 17:28:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:28:49 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:28:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:28:50 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:28:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 17:28:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 17:28:50 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:28:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8998 values 141905 bits 17738 bytes 
Thu 16 Jan 2014 17:28:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:28:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:28:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:28:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:29:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:29:02 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:29:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:29:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:29:04 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:29:04 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:29:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:29:04 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:29:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:29:05 - XML: Processed 656162 elements - found 982 jobs
Thu 16 Jan 2014 17:29:05 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 17:29:05 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 17:29:05 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:29:05 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:29:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:29:09 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:29:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:29:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:29:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:29:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:29:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:29:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:29:11 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:29:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43907863
Thu 16 Jan 2014 17:29:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:29:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43907863
Thu 16 Jan 2014 17:29:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:29:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:29:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:29:21 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:29:21 - job_xml_thread(): Done retrieving: data size 43907863
Thu 16 Jan 2014 17:29:21 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:29:21 - XML: Start document: iteration 12
Thu 16 Jan 2014 17:29:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:29:21 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:29:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:29:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:29:23 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:29:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:29:23 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:29:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:29:23 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:29:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:29:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:29:34 - XML: Processed 655414 elements - found 982 jobs
Thu 16 Jan 2014 17:29:34 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 17:29:34 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 17:29:34 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:29:34 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:29:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:29:34 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:29:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:29:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:29:34 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:29:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 17:29:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:29:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:29:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:29:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:29:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:29:36 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:29:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43905310
Thu 16 Jan 2014 17:29:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:29:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43905310
Thu 16 Jan 2014 17:29:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:29:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:29:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:29:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:29:42 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:29:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:29:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:29:44 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:29:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:29:44 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:29:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:29:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43905310
Thu 16 Jan 2014 17:29:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:29:49 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:29:49 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:29:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:29:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:29:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:29:51 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:29:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:29:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 17:29:52 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:29:52 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:29:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 17:29:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5824 values 91849 bits 11481 bytes 
Thu 16 Jan 2014 17:29:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:29:55 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:29:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:29:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:29:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:29:55 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:29:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:29:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:29:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:29:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:29:58 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:29:58 - job_xml_thread(): Done retrieving: data size 43312216
Thu 16 Jan 2014 17:29:58 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:29:58 - XML: Start document: iteration 13
Thu 16 Jan 2014 17:29:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43312216
Thu 16 Jan 2014 17:29:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:29:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:29:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:30:00 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:30:00 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:30:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:30:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:30:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43312216
Thu 16 Jan 2014 17:30:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:30:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:30:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:30:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:30:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:30:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:30:19 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:30:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:30:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:30:20 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:30:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:30:20 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:30:20 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:30:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:30:20 - XML: Processed 648098 elements - found 982 jobs
Thu 16 Jan 2014 17:30:20 - job 7346569 field 'start_timestamp' changed since saved from: 1389889641 to: 1389889586
Thu 16 Jan 2014 17:30:20 - job 7346570 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:30:20 - job 7346447 appears to have finished
Thu 16 Jan 2014 17:30:20 - job 7346571 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:30:20 - job 7346340 appears to have finished
Thu 16 Jan 2014 17:30:20 - job_xml_thread(): Found 7 updated jobs.
Thu 16 Jan 2014 17:30:20 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 17:30:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:30:22 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:30:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:30:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:30:22 - job_xml_thread(): Done storing. succesfully stored: 7 jobs
Thu 16 Jan 2014 17:30:22 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:30:22 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:30:22 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:30:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 17:30:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:30:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:30:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:30:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:30:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:30:24 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:30:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43408384
Thu 16 Jan 2014 17:30:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:30:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43408384
Thu 16 Jan 2014 17:30:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:30:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:30:32 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:30:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:30:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:30:37 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:30:37 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:30:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:30:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:30:37 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:30:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:30:37 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:30:37 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:30:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:30:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:30:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:30:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:30:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:30:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:30:39 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:30:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43505255
Thu 16 Jan 2014 17:30:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:30:39 - job_xml_thread(): Done retrieving: data size 43505255
Thu 16 Jan 2014 17:30:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43505255
Thu 16 Jan 2014 17:30:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:30:40 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:30:40 - XML: Start document: iteration 14
Thu 16 Jan 2014 17:30:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:30:50 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:30:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:30:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:30:52 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:30:52 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:30:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:30:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:30:52 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:30:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:30:53 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:30:53 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Thu 16 Jan 2014 17:30:53 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:30:53 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:30:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 17:30:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:30:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 17:30:53 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:30:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:30:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:30:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8982 values 141671 bits 17708 bytes 
Thu 16 Jan 2014 17:30:54 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:30:54 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:30:54 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 17:30:54 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 17:30:54 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 17:30:58 - XML: Processed 649862 elements - found 982 jobs
Thu 16 Jan 2014 17:30:58 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 17:30:58 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 17:30:58 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:30:58 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:30:59 - size of cluster 'LISA Cluster': 624 hosts 79473 metrics 914777 values 14435525 bits 1804440 bytes 
Thu 16 Jan 2014 17:31:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:31:02 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:31:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:31:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:31:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:31:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:31:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:31:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:31:06 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:31:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43963056
Thu 16 Jan 2014 17:31:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:31:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43963056
Thu 16 Jan 2014 17:31:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:31:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:31:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:31:14 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:31:14 - job_xml_thread(): Done retrieving: data size 43963056
Thu 16 Jan 2014 17:31:14 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:31:14 - XML: Start document: iteration 15
Thu 16 Jan 2014 17:31:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:31:16 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:31:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:31:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:31:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:31:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:31:17 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:31:17 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:31:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:31:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:31:17 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:31:25 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:31:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 17:31:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:31:25 - XML: Processed 656150 elements - found 982 jobs
Thu 16 Jan 2014 17:31:25 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 17:31:25 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 17:31:25 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:31:25 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:31:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:31:27 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:31:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:31:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:31:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:31:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:31:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:31:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:31:30 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:31:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43954184
Thu 16 Jan 2014 17:31:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:31:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43954184
Thu 16 Jan 2014 17:31:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:31:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:31:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:31:40 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:31:41 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:31:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:31:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:31:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:31:44 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:31:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:31:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:31:45 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:31:45 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:31:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:31:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:31:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:31:45 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:31:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:31:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:31:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:31:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:31:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:31:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:31:49 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:31:49 - job_xml_thread(): Done retrieving: data size 43994694
Thu 16 Jan 2014 17:31:49 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:31:49 - XML: Start document: iteration 16
Thu 16 Jan 2014 17:31:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43994694
Thu 16 Jan 2014 17:31:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:31:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43994694
Thu 16 Jan 2014 17:31:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:31:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:31:53 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:31:54 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:31:54 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 17:31:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:31:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 17:31:54 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:31:54 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:31:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 17:31:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8793 values 138951 bits 17368 bytes 
Thu 16 Jan 2014 17:32:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:32:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:32:01 - XML: Processed 656158 elements - found 980 jobs
Thu 16 Jan 2014 17:32:01 - job 7346336 appears to have finished
Thu 16 Jan 2014 17:32:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:32:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:32:01 - job 7346301 appears to have finished
Thu 16 Jan 2014 17:32:01 - job_xml_thread(): Found 2 updated jobs.
Thu 16 Jan 2014 17:32:01 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 17:32:03 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Thu 16 Jan 2014 17:32:03 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:32:03 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:32:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:32:07 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:32:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:32:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:32:08 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:32:08 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:32:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:32:08 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:32:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:32:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:32:12 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:32:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:32:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:32:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:32:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:32:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:32:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:32:17 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:32:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43990450
Thu 16 Jan 2014 17:32:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:32:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43990450
Thu 16 Jan 2014 17:32:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:32:18 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:32:18 - job_xml_thread(): Done retrieving: data size 43990450
Thu 16 Jan 2014 17:32:18 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:32:18 - XML: Start document: iteration 17
Thu 16 Jan 2014 17:32:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:32:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:32:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:32:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:32:34 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:32:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 17:32:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:32:37 - XML: Processed 656160 elements - found 981 jobs
Thu 16 Jan 2014 17:32:37 - job 7346572 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:32:37 - job_xml_thread(): Found 2 updated jobs.
Thu 16 Jan 2014 17:32:37 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 17:32:38 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Thu 16 Jan 2014 17:32:38 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:32:38 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:32:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:32:40 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:32:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:32:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:32:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:32:41 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:32:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:32:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:32:41 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:32:41 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:32:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:32:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:32:41 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:32:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:32:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:32:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:32:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:32:45 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:32:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 44000794
Thu 16 Jan 2014 17:32:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:32:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 44000794
Thu 16 Jan 2014 17:32:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:32:53 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:32:53 - job_xml_thread(): Done retrieving: data size 44000794
Thu 16 Jan 2014 17:32:53 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:32:53 - XML: Start document: iteration 18
Thu 16 Jan 2014 17:32:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:32:54 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:32:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:32:55 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:32:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:32:56 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:32:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 17:32:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 17:32:56 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:32:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:32:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:32:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:32:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:32:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6119 values 96805 bits 12100 bytes 
Thu 16 Jan 2014 17:32:58 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:32:58 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:32:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:32:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:32:58 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:33:03 - XML: Processed 656160 elements - found 981 jobs
Thu 16 Jan 2014 17:33:03 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 17:33:03 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 17:33:03 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:33:03 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:33:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:33:05 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:33:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:33:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:33:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:33:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:33:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:33:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:33:09 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:33:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 17:33:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:33:09 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:33:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43960826
Thu 16 Jan 2014 17:33:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:33:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43960826
Thu 16 Jan 2014 17:33:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:33:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:33:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:33:18 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:33:18 - job_xml_thread(): Done retrieving: data size 43960826
Thu 16 Jan 2014 17:33:18 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:33:18 - XML: Start document: iteration 19
Thu 16 Jan 2014 17:33:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:33:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:33:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:33:22 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:33:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:33:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:33:23 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:33:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:33:23 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:33:23 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:33:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:33:29 - XML: Processed 656158 elements - found 981 jobs
Thu 16 Jan 2014 17:33:29 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 17:33:29 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 17:33:29 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:33:29 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:33:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:33:34 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:33:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:33:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:33:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:33:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:33:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:33:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:33:37 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:33:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43965173
Thu 16 Jan 2014 17:33:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:33:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43965173
Thu 16 Jan 2014 17:33:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:33:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:33:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:33:45 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:33:45 - job_xml_thread(): Done retrieving: data size 43965173
Thu 16 Jan 2014 17:33:45 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:33:45 - XML: Start document: iteration 20
Thu 16 Jan 2014 17:33:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:33:48 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:33:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:33:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:33:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:33:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:33:50 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:33:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:33:50 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:33:50 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:33:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:33:55 - XML: Processed 656160 elements - found 981 jobs
Thu 16 Jan 2014 17:33:55 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 17:33:55 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 17:33:55 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:33:55 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:33:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:33:56 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:33:57 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:33:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 17:33:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:33:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 17:33:57 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:33:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99253 bits 12406 bytes 
Thu 16 Jan 2014 17:34:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:34:00 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:34:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:34:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:34:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:34:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:34:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:34:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:34:03 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:34:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43972097
Thu 16 Jan 2014 17:34:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:34:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43972097
Thu 16 Jan 2014 17:34:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:34:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:34:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:34:10 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:34:11 - job_xml_thread(): Done retrieving: data size 43972097
Thu 16 Jan 2014 17:34:11 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:34:11 - Housekeeping: checking database for timed out jobs..
Thu 16 Jan 2014 17:34:11 - Housekeeping: Found 0 timed out jobs in database: closing entries
Thu 16 Jan 2014 17:34:11 - Housekeeping: done.
Thu 16 Jan 2014 17:34:11 - XML: Start document: iteration 0
Thu 16 Jan 2014 17:34:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:34:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:34:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:34:18 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:34:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:34:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:34:19 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:34:19 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:34:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:34:19 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:34:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:34:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:34:27 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:34:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:34:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:34:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:34:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:34:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:34:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:34:28 - XML: Processed 656160 elements - found 981 jobs
Thu 16 Jan 2014 17:34:28 - job 7346576 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:34:28 - job 7346575 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:34:28 - job 7346573 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:34:28 - job 7346574 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:34:28 - job 7346578 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:34:28 - job 7346579 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:34:28 - job 7346577 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:34:28 - job 7346461 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:34:28 - job_xml_thread(): Found 8 updated jobs.
Thu 16 Jan 2014 17:34:28 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 17:34:28 - job_xml_thread(): Done storing. succesfully stored: 8 jobs
Thu 16 Jan 2014 17:34:28 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:34:28 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:34:29 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:34:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 17:34:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:34:32 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:34:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43967941
Thu 16 Jan 2014 17:34:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:34:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43967941
Thu 16 Jan 2014 17:34:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:34:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:34:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:34:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:34:42 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:34:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:34:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:34:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:34:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:34:43 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:34:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:34:43 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:34:43 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:34:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:34:43 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:34:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:34:48 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:34:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:34:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:34:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:34:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:34:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:34:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:34:52 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:34:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43996968
Thu 16 Jan 2014 17:34:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:34:52 - job_xml_thread(): Done retrieving: data size 43996968
Thu 16 Jan 2014 17:34:52 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:34:52 - XML: Start document: iteration 1
Thu 16 Jan 2014 17:34:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43996968
Thu 16 Jan 2014 17:34:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:34:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:34:57 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:34:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:34:57 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:34:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 17:34:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 17:34:57 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:34:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:34:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:35:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8624 values 136015 bits 17001 bytes 
Thu 16 Jan 2014 17:35:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:35:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:35:09 - XML: Processed 656160 elements - found 981 jobs
Thu 16 Jan 2014 17:35:09 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 17:35:09 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 17:35:09 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:35:09 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:35:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:35:13 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:35:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:35:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:35:14 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:35:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:35:14 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:35:14 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:35:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:35:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:35:17 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:35:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:35:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:35:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:35:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:35:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:35:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:35:20 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:35:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43932437
Thu 16 Jan 2014 17:35:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:35:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43932437
Thu 16 Jan 2014 17:35:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:35:24 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:35:24 - job_xml_thread(): Done retrieving: data size 43932437
Thu 16 Jan 2014 17:35:24 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:35:24 - XML: Start document: iteration 2
Thu 16 Jan 2014 17:35:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:35:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:35:31 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:35:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 17:35:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:35:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:35:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:35:36 - Leaving storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 17:35:36 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Thu 16 Jan 2014 17:35:36 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:35:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:35:37 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:35:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:35:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:35:38 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:35:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:35:38 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:35:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:35:38 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:35:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:35:42 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:35:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:35:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:35:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:35:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:35:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:35:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:35:44 - XML: Processed 655412 elements - found 981 jobs
Thu 16 Jan 2014 17:35:44 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 17:35:44 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 17:35:44 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:35:44 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:35:45 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:35:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43382211
Thu 16 Jan 2014 17:35:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:35:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43382211
Thu 16 Jan 2014 17:35:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:35:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:35:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:35:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:35:56 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:35:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:35:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:35:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:35:57 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:35:58 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:35:58 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:35:58 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:35:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:35:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:35:58 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:35:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:35:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 17:35:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:35:59 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:35:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:35:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 17:35:59 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6120 values 96584 bits 12073 bytes 
Thu 16 Jan 2014 17:35:59 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:36:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:36:00 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:36:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:36:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:36:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:36:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:36:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:36:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:36:02 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:36:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43343294
Thu 16 Jan 2014 17:36:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:36:03 - job_xml_thread(): Done retrieving: data size 43343294
Thu 16 Jan 2014 17:36:03 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:36:03 - XML: Start document: iteration 3
Thu 16 Jan 2014 17:36:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43343294
Thu 16 Jan 2014 17:36:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:36:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:36:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:36:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:36:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:36:25 - XML: Processed 647946 elements - found 974 jobs
Thu 16 Jan 2014 17:36:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:36:25 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:36:25 - job 7346498 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:36:25 - job 7346449 appears to have finished
Thu 16 Jan 2014 17:36:25 - job 7346578 field 'start_timestamp' changed since saved from: 1389890019 to: 1389889953
Thu 16 Jan 2014 17:36:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:36:26 - job 7346357 appears to have finished
Thu 16 Jan 2014 17:36:26 - job 7346452 appears to have finished
Thu 16 Jan 2014 17:36:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:36:26 - job 7345023 appears to have finished
Thu 16 Jan 2014 17:36:26 - job 7346580 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:36:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:36:26 - job 7346550 appears to have finished
Thu 16 Jan 2014 17:36:26 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:36:26 - job 7346269 appears to have finished
Thu 16 Jan 2014 17:36:26 - job 7336743 appears to have finished
Thu 16 Jan 2014 17:36:26 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:36:26 - job 7346547 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:36:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:36:26 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:36:26 - job_xml_thread(): Found 11 updated jobs.
Thu 16 Jan 2014 17:36:26 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 17:36:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:36:26 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:36:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:36:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:36:26 - job_xml_thread(): Done storing. succesfully stored: 11 jobs
Thu 16 Jan 2014 17:36:26 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:36:26 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:36:26 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:36:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 17:36:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:36:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:36:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:36:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:36:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:36:28 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:36:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43396855
Thu 16 Jan 2014 17:36:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:36:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43396855
Thu 16 Jan 2014 17:36:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:36:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:36:38 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:36:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:36:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:36:41 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:36:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:36:41 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:36:41 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:36:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:36:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:36:42 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:36:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:36:42 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:36:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:36:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:36:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:36:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:36:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:36:43 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:36:43 - job_xml_thread(): Done retrieving: data size 43907716
Thu 16 Jan 2014 17:36:43 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:36:43 - XML: Start document: iteration 4
Thu 16 Jan 2014 17:36:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43907716
Thu 16 Jan 2014 17:36:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:36:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43907716
Thu 16 Jan 2014 17:36:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:36:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:36:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:36:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:36:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:36:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:37:01 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:37:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:37:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 17:37:02 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:37:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 17:37:02 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:37:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9126 values 143995 bits 17999 bytes 
Thu 16 Jan 2014 17:37:03 - XML: Processed 655138 elements - found 974 jobs
Thu 16 Jan 2014 17:37:03 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 17:37:04 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 17:37:04 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:37:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:37:04 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:37:04 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:37:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:37:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:37:05 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:37:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:37:05 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:37:05 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:37:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:37:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:37:07 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:37:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:37:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:37:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:37:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:37:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:37:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:37:09 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:37:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 17:37:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:37:09 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:37:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43988203
Thu 16 Jan 2014 17:37:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:37:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43988203
Thu 16 Jan 2014 17:37:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:37:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:37:18 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:37:19 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:37:19 - job_xml_thread(): Done retrieving: data size 43988203
Thu 16 Jan 2014 17:37:19 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:37:19 - XML: Start document: iteration 5
Thu 16 Jan 2014 17:37:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:37:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:37:21 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:37:21 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:37:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:37:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:37:22 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:37:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:37:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:37:28 - XML: Processed 656112 elements - found 974 jobs
Thu 16 Jan 2014 17:37:28 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 17:37:28 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 17:37:28 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:37:28 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:37:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:37:29 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:37:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:37:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:37:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:37:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:37:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:37:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:37:31 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:37:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43970572
Thu 16 Jan 2014 17:37:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:37:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43970572
Thu 16 Jan 2014 17:37:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:37:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:37:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:37:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:37:42 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:37:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:37:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:37:43 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:37:43 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:37:44 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:37:44 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:37:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:37:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:37:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:37:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:37:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:37:45 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:37:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:37:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:37:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:37:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:37:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:37:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:37:47 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:37:47 - job_xml_thread(): Done retrieving: data size 43989082
Thu 16 Jan 2014 17:37:47 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:37:47 - XML: Start document: iteration 6
Thu 16 Jan 2014 17:37:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43989082
Thu 16 Jan 2014 17:37:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:37:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43989082
Thu 16 Jan 2014 17:37:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:37:55 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Thu 16 Jan 2014 17:37:55 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:37:59 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:37:59 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 17:37:59 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 17:37:59 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:37:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:37:59 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 17:37:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:38:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:38:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:38:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:38:02 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:38:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:38:03 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:38:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 17:38:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 17:38:03 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:38:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:38:04 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:38:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:38:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:38:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148722 bits 18590 bytes 
Thu 16 Jan 2014 17:38:04 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:38:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:38:05 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:38:05 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:38:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:38:06 - XML: Processed 656140 elements - found 971 jobs
Thu 16 Jan 2014 17:38:06 - job 7345024 appears to have finished
Thu 16 Jan 2014 17:38:06 - job 7345737 appears to have finished
Thu 16 Jan 2014 17:38:06 - job 7346433 appears to have finished
Thu 16 Jan 2014 17:38:06 - job_xml_thread(): Found 3 updated jobs.
Thu 16 Jan 2014 17:38:06 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 17:38:07 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Thu 16 Jan 2014 17:38:07 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:38:08 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:38:08 - size of cluster 'LISA Cluster': 624 hosts 79470 metrics 761247 values 12020523 bits 1502565 bytes 
Thu 16 Jan 2014 17:38:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:38:12 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:38:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:38:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:38:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:38:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:38:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:38:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:38:16 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:38:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43966679
Thu 16 Jan 2014 17:38:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:38:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43966679
Thu 16 Jan 2014 17:38:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:38:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:38:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:38:23 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:38:23 - job_xml_thread(): Done retrieving: data size 43966679
Thu 16 Jan 2014 17:38:23 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:38:23 - XML: Start document: iteration 7
Thu 16 Jan 2014 17:38:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:38:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:38:33 - XML: Processed 656140 elements - found 971 jobs
Thu 16 Jan 2014 17:38:33 - job 7346580 field 'start_timestamp' changed since saved from: 1389890158 to: 1389890091
Thu 16 Jan 2014 17:38:33 - job_xml_thread(): Found 1 updated jobs.
Thu 16 Jan 2014 17:38:33 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 17:38:34 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Thu 16 Jan 2014 17:38:34 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:38:34 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:38:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:38:35 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:38:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:38:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:38:35 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:38:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:38:35 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:38:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:38:35 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:38:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:38:39 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:38:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:38:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:38:39 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:38:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 17:38:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:38:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:38:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:38:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:38:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:38:43 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:38:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43972415
Thu 16 Jan 2014 17:38:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:38:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43972415
Thu 16 Jan 2014 17:38:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:38:49 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:38:49 - job_xml_thread(): Done retrieving: data size 43972415
Thu 16 Jan 2014 17:38:49 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:38:49 - XML: Start document: iteration 8
Thu 16 Jan 2014 17:38:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:38:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:38:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:38:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:38:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:38:59 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:39:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:39:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:39:00 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:39:00 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 17:39:00 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:39:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:39:00 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:39:00 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:39:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:39:03 - XML: Processed 656140 elements - found 971 jobs
Thu 16 Jan 2014 17:39:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:39:03 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:39:03 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 17:39:03 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 17:39:03 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:39:03 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:39:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:39:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 17:39:04 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:39:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5788 values 91256 bits 11407 bytes 
Thu 16 Jan 2014 17:39:04 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:39:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 17:39:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:39:07 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:39:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:39:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:39:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:39:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:39:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:39:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:39:11 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:39:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 17:39:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:39:11 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:39:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43959954
Thu 16 Jan 2014 17:39:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:39:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43959954
Thu 16 Jan 2014 17:39:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:39:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:39:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:39:18 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:39:18 - job_xml_thread(): Done retrieving: data size 43959954
Thu 16 Jan 2014 17:39:18 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:39:18 - XML: Start document: iteration 9
Thu 16 Jan 2014 17:39:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:39:20 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:39:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:39:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:39:22 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:39:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:39:22 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:39:22 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:39:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:39:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:39:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:39:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:39:33 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:39:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:39:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:39:34 - XML: Processed 656140 elements - found 971 jobs
Thu 16 Jan 2014 17:39:34 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 17:39:34 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 17:39:34 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:39:34 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:39:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:39:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:39:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:39:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:39:37 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:39:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43970631
Thu 16 Jan 2014 17:39:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:39:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43970631
Thu 16 Jan 2014 17:39:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:39:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:39:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:39:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:39:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:39:49 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:39:49 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:39:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:39:50 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:39:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:39:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:39:50 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:39:50 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:39:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:39:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:39:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:39:53 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:39:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:39:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:39:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:39:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:39:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:39:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:39:56 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:39:56 - job_xml_thread(): Done retrieving: data size 43984149
Thu 16 Jan 2014 17:39:56 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:39:56 - XML: Start document: iteration 10
Thu 16 Jan 2014 17:39:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43984149
Thu 16 Jan 2014 17:39:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43984149
Thu 16 Jan 2014 17:39:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:39:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:40:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:40:04 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:40:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:40:05 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:40:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 17:40:05 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:40:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 17:40:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:40:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:40:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148632 bits 18579 bytes 
Thu 16 Jan 2014 17:40:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:40:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:40:15 - XML: Processed 656140 elements - found 971 jobs
Thu 16 Jan 2014 17:40:15 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 17:40:15 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 17:40:15 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:40:15 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:40:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:40:17 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:40:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:40:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:40:18 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:40:18 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:40:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:40:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:40:18 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:40:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:40:21 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:40:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:40:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:40:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:40:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:40:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:40:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:40:25 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:40:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43994048
Thu 16 Jan 2014 17:40:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:40:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43994048
Thu 16 Jan 2014 17:40:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:40:30 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:40:30 - job_xml_thread(): Done retrieving: data size 43994048
Thu 16 Jan 2014 17:40:30 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:40:30 - XML: Start document: iteration 11
Thu 16 Jan 2014 17:40:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:40:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:40:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:40:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:40:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:40:42 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:40:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:40:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:40:44 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:40:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:40:44 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:40:44 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:40:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:40:49 - XML: Processed 656140 elements - found 971 jobs
Thu 16 Jan 2014 17:40:50 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 17:40:50 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 17:40:50 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:40:50 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:40:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:40:50 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:40:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:40:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:40:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:40:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:40:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:40:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:40:50 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:40:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 17:40:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:40:53 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:40:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43981214
Thu 16 Jan 2014 17:40:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:40:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43981214
Thu 16 Jan 2014 17:40:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:40:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:40:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:41:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:41:04 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:41:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:41:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:41:05 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:41:05 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:41:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:41:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:41:05 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:41:05 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:41:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:41:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:41:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:41:06 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:41:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:41:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 17:41:07 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:41:07 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:41:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 17:41:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5765 values 90870 bits 11358 bytes 
Thu 16 Jan 2014 17:41:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:41:08 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:41:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:41:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:41:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:41:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:41:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:41:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:41:12 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:41:12 - job_xml_thread(): Done retrieving: data size 43898104
Thu 16 Jan 2014 17:41:12 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:41:12 - XML: Start document: iteration 12
Thu 16 Jan 2014 17:41:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43898104
Thu 16 Jan 2014 17:41:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:41:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43898104
Thu 16 Jan 2014 17:41:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:41:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:41:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:41:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:41:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:41:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:41:30 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:41:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:41:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:41:30 - XML: Processed 655392 elements - found 971 jobs
Thu 16 Jan 2014 17:41:30 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 17:41:30 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 17:41:30 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:41:30 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:41:30 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:41:30 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:41:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:41:31 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:41:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:41:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:41:35 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:41:35 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:41:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 17:41:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:41:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:41:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:41:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:41:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:41:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:41:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:41:39 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:41:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43444158
Thu 16 Jan 2014 17:41:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:41:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43444158
Thu 16 Jan 2014 17:41:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:41:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:41:46 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:41:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:41:46 - job_xml_thread(): Done retrieving: data size 43444158
Thu 16 Jan 2014 17:41:46 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:41:46 - XML: Start document: iteration 13
Thu 16 Jan 2014 17:41:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:41:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:41:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:41:54 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:41:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:41:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:41:54 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:41:54 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:41:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:41:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:41:54 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:41:59 - XML: Processed 649440 elements - found 971 jobs
Thu 16 Jan 2014 17:41:59 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 17:41:59 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 17:41:59 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:41:59 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:42:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:42:02 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:42:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:42:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:42:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:42:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:42:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:42:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:42:04 - Leaving storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 17:42:04 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Thu 16 Jan 2014 17:42:04 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:42:05 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:42:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43313020
Thu 16 Jan 2014 17:42:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:42:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43313020
Thu 16 Jan 2014 17:42:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:42:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:42:07 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:42:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:42:09 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:42:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 17:42:09 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:42:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 17:42:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8939 values 141012 bits 17626 bytes 
Thu 16 Jan 2014 17:42:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:42:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:42:14 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:42:14 - job_xml_thread(): Done retrieving: data size 43313020
Thu 16 Jan 2014 17:42:14 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:42:14 - XML: Start document: iteration 14
Thu 16 Jan 2014 17:42:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:42:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:42:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:42:19 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:42:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:42:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:42:20 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:42:20 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:42:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:42:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:42:20 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:42:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:42:25 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:42:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:42:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:42:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:42:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:42:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:42:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:42:27 - XML: Processed 647940 elements - found 971 jobs
Thu 16 Jan 2014 17:42:27 - job 7346581 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:42:27 - job_xml_thread(): Found 1 updated jobs.
Thu 16 Jan 2014 17:42:27 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 17:42:27 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Thu 16 Jan 2014 17:42:27 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:42:27 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:42:29 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:42:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43365533
Thu 16 Jan 2014 17:42:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:42:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43365533
Thu 16 Jan 2014 17:42:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:42:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:42:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:42:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:42:39 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:42:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:42:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:42:40 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:42:40 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:42:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:42:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:42:40 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:42:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:42:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:42:42 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:42:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:42:45 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:42:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:42:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:42:45 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:42:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 17:42:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:42:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:42:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:42:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:42:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:42:46 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:42:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43909607
Thu 16 Jan 2014 17:42:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:42:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43909607
Thu 16 Jan 2014 17:42:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:42:47 - job_xml_thread(): Done retrieving: data size 43909607
Thu 16 Jan 2014 17:42:48 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:42:48 - XML: Start document: iteration 15
Thu 16 Jan 2014 17:42:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:42:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:42:55 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:42:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:42:56 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:42:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:42:56 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:42:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:42:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43909607
Thu 16 Jan 2014 17:42:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:43:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:43:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:43:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:43:07 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:43:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:43:09 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:43:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:43:11 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:43:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 17:43:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 17:43:11 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:43:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5594 values 88214 bits 11026 bytes 
Thu 16 Jan 2014 17:43:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:43:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:43:12 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:43:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:43:12 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:43:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:43:12 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:43:14 - XML: Processed 655226 elements - found 971 jobs
Thu 16 Jan 2014 17:43:14 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 17:43:14 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 17:43:15 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:43:15 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:43:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:43:16 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:43:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:43:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:43:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:43:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:43:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:43:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:43:18 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:43:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43982965
Thu 16 Jan 2014 17:43:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:43:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43982965
Thu 16 Jan 2014 17:43:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:43:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:43:27 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:43:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:43:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:43:28 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:43:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:43:28 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:43:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43982965
Thu 16 Jan 2014 17:43:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:43:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:43:30 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:43:30 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:43:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:43:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:43:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:43:38 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:43:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:43:42 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:43:42 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:43:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 17:43:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:43:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:43:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:43:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:43:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:43:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:43:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:43:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:43:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:43:44 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:43:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:43:44 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:43:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:43:44 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:43:44 - job_xml_thread(): Done retrieving: data size 43947914
Thu 16 Jan 2014 17:43:44 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:43:44 - XML: Start document: iteration 16
Thu 16 Jan 2014 17:43:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43947914
Thu 16 Jan 2014 17:43:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43947914
Thu 16 Jan 2014 17:43:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:43:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:43:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:43:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:43:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:43:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:44:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:44:01 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:44:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:44:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:44:02 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:44:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:44:02 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:44:02 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:44:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:44:04 - XML: Processed 656140 elements - found 971 jobs
Thu 16 Jan 2014 17:44:04 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 17:44:04 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 17:44:04 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:44:04 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:44:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:44:06 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:44:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:44:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:44:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:44:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:44:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:44:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:44:08 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:44:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43978555
Thu 16 Jan 2014 17:44:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:44:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43978555
Thu 16 Jan 2014 17:44:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:44:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:44:12 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:44:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:44:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 17:44:14 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:44:14 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:44:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9021 values 142254 bits 17781 bytes 
Thu 16 Jan 2014 17:44:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 17:44:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:44:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:44:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:44:18 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:44:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:44:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:44:19 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:44:19 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:44:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:44:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:44:19 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:44:19 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:44:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:44:22 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:44:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:44:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:44:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:44:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:44:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:44:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:44:25 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:44:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43979679
Thu 16 Jan 2014 17:44:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:44:25 - job_xml_thread(): Done retrieving: data size 43979679
Thu 16 Jan 2014 17:44:25 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:44:25 - XML: Start document: iteration 17
Thu 16 Jan 2014 17:44:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43979679
Thu 16 Jan 2014 17:44:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:44:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:44:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:44:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:44:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:44:40 - XML: Processed 656138 elements - found 970 jobs
Thu 16 Jan 2014 17:44:40 - job 7346584 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:44:40 - job 7346582 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:44:40 - job 7346583 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:44:40 - job 7346556 appears to have finished
Thu 16 Jan 2014 17:44:40 - job_xml_thread(): Found 4 updated jobs.
Thu 16 Jan 2014 17:44:40 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 17:44:43 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Thu 16 Jan 2014 17:44:43 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:44:43 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:44:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:44:43 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:44:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:44:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:44:43 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:44:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:44:43 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:44:43 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:44:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:44:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:44:48 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:44:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:44:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:44:48 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:44:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 17:44:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:44:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:44:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:44:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:44:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:44:49 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:44:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43994542
Thu 16 Jan 2014 17:44:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:44:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43994542
Thu 16 Jan 2014 17:44:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:44:58 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:44:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:44:58 - job_xml_thread(): Done retrieving: data size 43994542
Thu 16 Jan 2014 17:44:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:44:58 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:44:58 - XML: Start document: iteration 18
Thu 16 Jan 2014 17:45:00 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Thu 16 Jan 2014 17:45:01 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:45:01 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:45:01 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 17:45:01 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 17:45:01 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:45:01 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 17:45:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:45:02 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:45:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:45:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:45:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:45:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:45:04 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:45:04 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:45:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:45:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:45:04 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:45:13 - XML: Processed 656135 elements - found 970 jobs
Thu 16 Jan 2014 17:45:13 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 17:45:13 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 17:45:13 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:45:13 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:45:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:45:14 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:45:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:45:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:45:14 - size of cluster 'LISA Cluster': 624 hosts 79480 metrics 825086 values 13019249 bits 1627406 bytes 
Thu 16 Jan 2014 17:45:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:45:15 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:45:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:45:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:45:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:45:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:45:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:45:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 17:45:15 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:45:15 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:45:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5782 values 91191 bits 11398 bytes 
Thu 16 Jan 2014 17:45:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 17:45:18 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:45:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43971655
Thu 16 Jan 2014 17:45:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:45:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43971655
Thu 16 Jan 2014 17:45:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:45:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:45:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:45:28 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:45:28 - job_xml_thread(): Done retrieving: data size 43971655
Thu 16 Jan 2014 17:45:28 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:45:28 - XML: Start document: iteration 19
Thu 16 Jan 2014 17:45:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:45:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:45:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:45:32 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:45:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:45:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:45:33 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:45:33 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:45:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:45:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:45:33 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:45:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:45:38 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:45:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:45:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:45:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:45:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:45:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:45:40 - XML: Processed 656138 elements - found 970 jobs
Thu 16 Jan 2014 17:45:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:45:40 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 17:45:40 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 17:45:40 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:45:40 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:45:42 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:45:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 17:45:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:45:43 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:45:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43965134
Thu 16 Jan 2014 17:45:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:45:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43965134
Thu 16 Jan 2014 17:45:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:45:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:45:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:45:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:45:53 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:45:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:45:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:45:53 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:45:53 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:45:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:45:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:45:53 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:45:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:45:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:45:55 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:45:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:45:58 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:45:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:45:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:45:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:45:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:45:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:45:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:46:01 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:46:01 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 17:46:02 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:46:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43984412
Thu 16 Jan 2014 17:46:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:46:02 - job_xml_thread(): Done retrieving: data size 43984412
Thu 16 Jan 2014 17:46:02 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:46:02 - XML: Start document: iteration 20
Thu 16 Jan 2014 17:46:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43984412
Thu 16 Jan 2014 17:46:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:46:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:46:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:46:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:46:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:46:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:46:16 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:46:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:46:16 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:46:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 17:46:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 17:46:16 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:46:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8036 values 126750 bits 15843 bytes 
Thu 16 Jan 2014 17:46:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:46:17 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:46:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:46:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:46:18 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:46:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:46:18 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:46:18 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:46:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:46:23 - XML: Processed 656140 elements - found 971 jobs
Thu 16 Jan 2014 17:46:23 - job 7346369 appears to have finished
Thu 16 Jan 2014 17:46:23 - job 7346586 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:46:23 - job 7346585 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:46:23 - job 7346582 field 'start_timestamp' changed since saved from: 1389890612 to: 1389890564
Thu 16 Jan 2014 17:46:23 - job 7346557 appears to have finished
Thu 16 Jan 2014 17:46:23 - job 7346348 appears to have finished
Thu 16 Jan 2014 17:46:23 - job_xml_thread(): Found 10 updated jobs.
Thu 16 Jan 2014 17:46:23 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 17:46:24 - job_xml_thread(): Done storing. succesfully stored: 10 jobs
Thu 16 Jan 2014 17:46:24 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:46:24 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:46:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:46:25 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:46:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:46:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:46:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:46:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:46:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:46:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:46:29 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:46:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43969325
Thu 16 Jan 2014 17:46:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:46:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43969325
Thu 16 Jan 2014 17:46:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:46:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:46:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:46:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:46:39 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:46:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:46:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:46:39 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:46:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:46:39 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:46:39 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:46:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:46:40 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:46:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:46:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:46:41 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:46:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 17:46:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:46:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:46:45 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:46:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:46:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:46:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:46:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:46:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:46:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:46:48 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:46:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43992462
Thu 16 Jan 2014 17:46:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:46:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43992462
Thu 16 Jan 2014 17:46:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:46:49 - job_xml_thread(): Done retrieving: data size 43992462
Thu 16 Jan 2014 17:46:49 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:46:49 - Housekeeping: checking database for timed out jobs..
Thu 16 Jan 2014 17:46:49 - Housekeeping: Found 0 timed out jobs in database: closing entries
Thu 16 Jan 2014 17:46:49 - Housekeeping: done.
Thu 16 Jan 2014 17:46:49 - XML: Start document: iteration 0
Thu 16 Jan 2014 17:46:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:46:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:47:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:47:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:47:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:47:02 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:47:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:47:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:47:03 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:47:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:47:03 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:47:03 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:47:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:47:08 - XML: Processed 656140 elements - found 971 jobs
Thu 16 Jan 2014 17:47:08 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 17:47:08 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 17:47:08 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:47:08 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:47:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:47:11 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:47:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:47:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:47:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:47:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:47:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:47:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:47:13 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:47:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43932325
Thu 16 Jan 2014 17:47:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:47:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43932325
Thu 16 Jan 2014 17:47:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:47:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:47:17 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:47:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:47:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 17:47:18 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:47:18 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:47:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 17:47:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8990 values 142220 bits 17777 bytes 
Thu 16 Jan 2014 17:47:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:47:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:47:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:47:23 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:47:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:47:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:47:23 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:47:23 - job_xml_thread(): Done retrieving: data size 43932325
Thu 16 Jan 2014 17:47:23 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:47:23 - XML: Start document: iteration 1
Thu 16 Jan 2014 17:47:24 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:47:24 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:47:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:47:24 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:47:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:47:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:47:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:47:34 - XML: Processed 655742 elements - found 971 jobs
Thu 16 Jan 2014 17:47:34 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 17:47:34 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 17:47:34 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:47:34 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:47:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:47:36 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:47:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:47:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:47:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:47:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:47:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:47:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:47:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:47:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:47:40 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:47:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 17:47:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:47:40 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:47:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43767746
Thu 16 Jan 2014 17:47:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:47:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43767746
Thu 16 Jan 2014 17:47:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:47:50 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:47:50 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:47:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:47:51 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:47:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:47:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:47:52 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:47:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:47:52 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:47:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:47:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:47:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:47:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:47:56 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:47:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:47:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:47:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:47:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:47:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:47:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:47:58 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:47:58 - job_xml_thread(): Done retrieving: data size 43315755
Thu 16 Jan 2014 17:47:58 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:47:58 - XML: Start document: iteration 2
Thu 16 Jan 2014 17:47:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43315755
Thu 16 Jan 2014 17:47:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:47:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43315755
Thu 16 Jan 2014 17:47:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:48:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:48:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:48:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:48:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:48:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:48:16 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:48:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:48:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:48:17 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:48:17 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:48:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:48:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:48:17 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:48:18 - XML: Processed 648044 elements - found 969 jobs
Thu 16 Jan 2014 17:48:18 - job 7346591 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:48:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:48:18 - job 7346590 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:48:18 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:48:18 - job 7346564 appears to have finished
Thu 16 Jan 2014 17:48:18 - job 7346588 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:48:18 - job 7346589 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:48:18 - job 7346587 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:48:18 - job 7344514 appears to have finished
Thu 16 Jan 2014 17:48:19 - job 7346592 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:48:19 - job_xml_thread(): Found 8 updated jobs.
Thu 16 Jan 2014 17:48:19 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 17:48:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:48:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 17:48:19 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:48:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 17:48:19 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:48:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99299 bits 12412 bytes 
Thu 16 Jan 2014 17:48:20 - job_xml_thread(): Done storing. succesfully stored: 8 jobs
Thu 16 Jan 2014 17:48:20 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:48:20 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:48:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:48:21 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:48:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:48:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:48:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:48:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:48:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:48:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:48:25 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:48:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43378195
Thu 16 Jan 2014 17:48:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:48:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43378195
Thu 16 Jan 2014 17:48:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:48:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:48:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:48:36 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:48:36 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:48:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:48:36 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:48:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:48:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:48:36 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:48:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:48:36 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:48:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:48:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:48:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:48:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:48:42 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:48:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:48:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:48:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:48:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:48:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:48:43 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:48:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 17:48:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:48:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:48:45 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:48:45 - job_xml_thread(): Done retrieving: data size 43875337
Thu 16 Jan 2014 17:48:45 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:48:45 - XML: Start document: iteration 3
Thu 16 Jan 2014 17:48:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875337
Thu 16 Jan 2014 17:48:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:48:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875337
Thu 16 Jan 2014 17:48:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:48:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:48:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:48:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:48:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:48:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:48:58 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:48:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:48:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:48:59 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:48:59 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:48:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:48:59 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:48:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:49:04 - XML: Processed 654964 elements - found 969 jobs
Thu 16 Jan 2014 17:49:04 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 17:49:04 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 17:49:04 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:49:04 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:49:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:49:07 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:49:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:49:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:49:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:49:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:49:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:49:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:49:10 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:49:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43951684
Thu 16 Jan 2014 17:49:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:49:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43951684
Thu 16 Jan 2014 17:49:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:49:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:49:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:49:19 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:49:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:49:20 - job_xml_thread(): Done retrieving: data size 43951684
Thu 16 Jan 2014 17:49:20 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:49:20 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:49:20 - XML: Start document: iteration 4
Thu 16 Jan 2014 17:49:21 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:49:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:49:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 17:49:21 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:49:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 17:49:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8630 values 136101 bits 17012 bytes 
Thu 16 Jan 2014 17:49:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:49:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:49:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:49:24 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:49:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:49:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:49:25 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:49:25 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:49:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:49:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:49:25 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:49:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:49:34 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:49:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:49:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:49:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:49:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:49:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:49:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:49:35 - XML: Processed 656136 elements - found 969 jobs
Thu 16 Jan 2014 17:49:35 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 17:49:35 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 17:49:35 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:49:35 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:49:38 - Leaving storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 17:49:38 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Thu 16 Jan 2014 17:49:38 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:49:38 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:49:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 17:49:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:49:38 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:49:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43960676
Thu 16 Jan 2014 17:49:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:49:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43960676
Thu 16 Jan 2014 17:49:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:49:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:49:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:49:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:49:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:49:50 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:49:50 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:49:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:49:51 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:49:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:49:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:49:51 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:49:51 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:49:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:49:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:49:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:49:53 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:49:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:49:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:49:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:49:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:49:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:49:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:49:55 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:49:55 - job_xml_thread(): Done retrieving: data size 43975664
Thu 16 Jan 2014 17:49:55 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:49:55 - XML: Start document: iteration 5
Thu 16 Jan 2014 17:49:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43975664
Thu 16 Jan 2014 17:49:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:49:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43975664
Thu 16 Jan 2014 17:49:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:50:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:50:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:50:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:50:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:50:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:50:15 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:50:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:50:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:50:16 - XML: Processed 656124 elements - found 963 jobs
Thu 16 Jan 2014 17:50:16 - job 7346563 appears to have finished
Thu 16 Jan 2014 17:50:16 - job 7346593 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:50:16 - job 7346595 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:50:16 - job 7346590 field 'start_timestamp' changed since saved from: 1389890853 to: 1389890804
Thu 16 Jan 2014 17:50:16 - job 7346594 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:50:16 - job 7346596 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:50:16 - job 7346562 appears to have finished
Thu 16 Jan 2014 17:50:16 - job 7346450 appears to have finished
Thu 16 Jan 2014 17:50:16 - job 7346453 appears to have finished
Thu 16 Jan 2014 17:50:16 - job 7346555 appears to have finished
Thu 16 Jan 2014 17:50:16 - job 7345959 appears to have finished
Thu 16 Jan 2014 17:50:16 - job_xml_thread(): Found 11 updated jobs.
Thu 16 Jan 2014 17:50:16 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 17:50:16 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:50:16 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:50:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:50:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:50:16 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:50:17 - job_xml_thread(): Done storing. succesfully stored: 11 jobs
Thu 16 Jan 2014 17:50:17 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:50:17 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:50:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:50:19 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:50:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:50:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:50:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:50:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:50:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:50:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:50:21 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:50:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43996535
Thu 16 Jan 2014 17:50:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:50:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43996535
Thu 16 Jan 2014 17:50:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:50:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:50:22 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:50:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:50:23 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:50:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 17:50:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 17:50:24 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:50:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148632 bits 18579 bytes 
Thu 16 Jan 2014 17:50:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:50:31 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:50:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:50:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:50:32 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:50:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:50:32 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:50:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:50:32 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:50:32 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:50:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:50:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:50:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:50:35 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:50:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:50:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:50:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:50:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:50:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:50:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:50:37 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:50:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43981541
Thu 16 Jan 2014 17:50:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:50:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43981541
Thu 16 Jan 2014 17:50:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:50:38 - job_xml_thread(): Done retrieving: data size 43981541
Thu 16 Jan 2014 17:50:39 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:50:39 - XML: Start document: iteration 6
Thu 16 Jan 2014 17:50:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:50:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:50:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:50:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:50:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:50:58 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:50:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:50:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:50:58 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:50:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:50:58 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:50:58 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:50:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:51:00 - XML: Processed 656119 elements - found 963 jobs
Thu 16 Jan 2014 17:51:00 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 17:51:00 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 17:51:00 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:51:00 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:51:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:51:01 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:51:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:51:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:51:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:51:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:51:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:51:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:51:02 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:51:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 17:51:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:51:03 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:51:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43997785
Thu 16 Jan 2014 17:51:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:51:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43997785
Thu 16 Jan 2014 17:51:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:51:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:51:13 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:51:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:51:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:51:14 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:51:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:51:14 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:51:15 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:51:15 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:51:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:51:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:51:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:51:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:51:17 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:51:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:51:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:51:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:51:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:51:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:51:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:51:19 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:51:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43994487
Thu 16 Jan 2014 17:51:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:51:19 - job_xml_thread(): Done retrieving: data size 43994487
Thu 16 Jan 2014 17:51:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43994487
Thu 16 Jan 2014 17:51:19 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:51:19 - XML: Start document: iteration 7
Thu 16 Jan 2014 17:51:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:51:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:51:25 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:51:27 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:51:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:51:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 17:51:27 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:51:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 17:51:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8859 values 139707 bits 17463 bytes 
Thu 16 Jan 2014 17:51:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:51:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:51:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:51:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:51:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:51:38 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:51:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:51:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:51:39 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:51:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:51:39 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:51:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:51:39 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:51:41 - XML: Processed 656123 elements - found 963 jobs
Thu 16 Jan 2014 17:51:42 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 17:51:42 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 17:51:42 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:51:42 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:51:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:51:43 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:51:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:51:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:51:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:51:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:51:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:51:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:51:45 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:51:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43987630
Thu 16 Jan 2014 17:51:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:51:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43987630
Thu 16 Jan 2014 17:51:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:51:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:51:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:51:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:51:55 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:51:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:51:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:51:56 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:51:56 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:51:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:51:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:51:56 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:51:57 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:51:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:51:59 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:51:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:51:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:51:59 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:51:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 17:51:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:51:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:51:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:51:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:51:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:52:01 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:52:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43993131
Thu 16 Jan 2014 17:52:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:52:01 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Thu 16 Jan 2014 17:52:01 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:52:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43993131
Thu 16 Jan 2014 17:52:02 - job_xml_thread(): Done retrieving: data size 43993131
Thu 16 Jan 2014 17:52:02 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:52:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:52:02 - XML: Start document: iteration 8
Thu 16 Jan 2014 17:52:05 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:52:06 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:52:06 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 17:52:06 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 17:52:06 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 17:52:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:52:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:52:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:52:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:52:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:52:16 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:52:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:52:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:52:18 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:52:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:52:18 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:52:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:52:18 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:52:19 - XML: Processed 656116 elements - found 959 jobs
Thu 16 Jan 2014 17:52:19 - job 7346599 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:52:19 - job 7346598 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:52:19 - job 7346398 appears to have finished
Thu 16 Jan 2014 17:52:19 - job 7346571 appears to have finished
Thu 16 Jan 2014 17:52:19 - job 7346553 appears to have finished
Thu 16 Jan 2014 17:52:19 - job 7346345 appears to have finished
Thu 16 Jan 2014 17:52:19 - job 7346597 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:52:19 - job_xml_thread(): Found 7 updated jobs.
Thu 16 Jan 2014 17:52:19 - job_xml_thread(): Storing jobs to database..
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Thu 16 Jan 2014 17:52:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:52:22 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:52:22 - job_xml_thread(): Done storing. succesfully stored: 7 jobs
Thu 16 Jan 2014 17:52:22 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:52:22 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:52:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:52:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:52:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:52:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:52:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:52:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:52:24 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:52:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43967428
Thu 16 Jan 2014 17:52:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:52:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43967428
Thu 16 Jan 2014 17:52:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:52:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:52:28 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:52:29 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:52:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:52:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 17:52:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 17:52:29 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:52:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8705 values 137251 bits 17156 bytes 
Thu 16 Jan 2014 17:52:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:52:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:52:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:52:36 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:52:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:52:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:52:37 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:52:37 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:52:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:52:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:52:37 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:52:37 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:52:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:52:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:52:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:52:38 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:52:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:52:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:52:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:52:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:52:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:52:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:52:40 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:52:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43989587
Thu 16 Jan 2014 17:52:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:52:41 - job_xml_thread(): Done retrieving: data size 43989587
Thu 16 Jan 2014 17:52:41 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:52:41 - XML: Start document: iteration 9
Thu 16 Jan 2014 17:52:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43989587
Thu 16 Jan 2014 17:52:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:52:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:52:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:52:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:52:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:52:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:52:59 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:52:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:52:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:53:00 - XML: Processed 656116 elements - found 959 jobs
Thu 16 Jan 2014 17:53:00 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 17:53:00 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 17:53:00 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:53:00 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:53:00 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:53:00 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:53:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:53:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:53:00 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:53:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:53:03 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:53:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:53:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:53:03 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:53:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 17:53:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:53:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:53:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:53:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:53:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:53:05 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:53:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43996464
Thu 16 Jan 2014 17:53:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:53:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43996464
Thu 16 Jan 2014 17:53:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:53:06 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:53:06 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:53:08 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:53:08 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 17:53:08 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 17:53:08 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:53:08 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Thu 16 Jan 2014 17:53:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:53:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:53:15 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:53:15 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:53:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:53:18 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:53:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:53:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:53:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:53:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:53:19 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:53:19 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:53:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:53:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:53:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:53:20 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:53:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:53:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:53:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:53:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:53:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:53:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:53:21 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:53:21 - job_xml_thread(): Done retrieving: data size 43909728
Thu 16 Jan 2014 17:53:21 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:53:21 - XML: Start document: iteration 10
Thu 16 Jan 2014 17:53:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43909728
Thu 16 Jan 2014 17:53:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43909728
Thu 16 Jan 2014 17:53:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:53:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:53:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:53:30 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:53:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:53:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 17:53:31 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:53:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 17:53:31 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:53:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8672 values 136693 bits 17086 bytes 
Thu 16 Jan 2014 17:53:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:53:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:53:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:53:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:53:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:53:39 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:53:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:53:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:53:39 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:53:39 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:53:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:53:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:53:39 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:53:40 - XML: Processed 655368 elements - found 959 jobs
Thu 16 Jan 2014 17:53:40 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 17:53:40 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 17:53:40 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:53:40 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:53:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:53:44 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:53:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:53:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:53:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:53:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:53:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:53:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:53:46 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:53:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43380317
Thu 16 Jan 2014 17:53:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:53:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43380317
Thu 16 Jan 2014 17:53:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:53:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:53:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:53:55 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:53:55 - job_xml_thread(): Done retrieving: data size 43380317
Thu 16 Jan 2014 17:53:55 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:53:55 - XML: Start document: iteration 11
Thu 16 Jan 2014 17:54:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:54:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:54:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:54:03 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:54:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:54:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:54:04 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:54:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:54:04 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:54:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:54:04 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:54:06 - XML: Processed 648712 elements - found 959 jobs
Thu 16 Jan 2014 17:54:06 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 17:54:06 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 17:54:06 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:54:06 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:54:08 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:54:08 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:54:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:54:08 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:54:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:54:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:54:09 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:54:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 17:54:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:54:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:54:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:54:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:54:09 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:54:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:54:09 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 17:54:09 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:54:09 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 17:54:09 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 17:54:10 - size of cluster 'LISA Cluster': 624 hosts 79483 metrics 990574 values 15636200 bits 1954525 bytes 
Thu 16 Jan 2014 17:54:13 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:54:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43364700
Thu 16 Jan 2014 17:54:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:54:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43364700
Thu 16 Jan 2014 17:54:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:54:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:54:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:54:21 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:54:21 - job_xml_thread(): Done retrieving: data size 43364700
Thu 16 Jan 2014 17:54:21 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:54:21 - XML: Start document: iteration 12
Thu 16 Jan 2014 17:54:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:54:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:54:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:54:28 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:54:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:54:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:54:28 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:54:28 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:54:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:54:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:54:28 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:54:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:54:32 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:54:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:54:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 17:54:32 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:54:32 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:54:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5753 values 90656 bits 11332 bytes 
Thu 16 Jan 2014 17:54:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 17:54:34 - XML: Processed 648654 elements - found 956 jobs
Thu 16 Jan 2014 17:54:34 - job 7346343 appears to have finished
Thu 16 Jan 2014 17:54:34 - job 7346601 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:54:34 - job 7346600 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:54:34 - job 7344509 appears to have finished
Thu 16 Jan 2014 17:54:34 - job 7346565 appears to have finished
Thu 16 Jan 2014 17:54:34 - job_xml_thread(): Found 5 updated jobs.
Thu 16 Jan 2014 17:54:34 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 17:54:34 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Thu 16 Jan 2014 17:54:34 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:54:34 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:54:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:54:37 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:54:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:54:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:54:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:54:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:54:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:54:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:54:40 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:54:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43869490
Thu 16 Jan 2014 17:54:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:54:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43869490
Thu 16 Jan 2014 17:54:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:54:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:54:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:54:50 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:54:50 - job_xml_thread(): Done retrieving: data size 43869490
Thu 16 Jan 2014 17:54:50 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:54:50 - XML: Start document: iteration 13
Thu 16 Jan 2014 17:54:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:54:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:54:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:54:54 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:54:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:54:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:54:55 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:54:55 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:54:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:54:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:54:55 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:55:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:55:03 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:55:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:55:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:55:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:55:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:55:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:55:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:55:05 - XML: Processed 655168 elements - found 956 jobs
Thu 16 Jan 2014 17:55:05 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 17:55:05 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 17:55:05 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:55:05 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:55:05 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:55:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 17:55:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:55:08 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:55:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43948874
Thu 16 Jan 2014 17:55:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:55:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43948874
Thu 16 Jan 2014 17:55:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:55:09 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:55:09 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 17:55:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:55:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:55:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:55:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:55:20 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:55:20 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:55:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:55:22 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:55:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:55:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:55:24 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:55:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:55:24 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:55:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:55:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:55:25 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:55:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:55:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:55:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:55:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:55:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:55:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:55:28 - Leaving storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 17:55:28 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Thu 16 Jan 2014 17:55:28 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:55:29 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:55:29 - job_xml_thread(): Done retrieving: data size 43956652
Thu 16 Jan 2014 17:55:29 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:55:29 - XML: Start document: iteration 14
Thu 16 Jan 2014 17:55:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43956652
Thu 16 Jan 2014 17:55:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:55:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43956652
Thu 16 Jan 2014 17:55:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:55:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:55:33 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:55:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:55:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 17:55:35 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:55:35 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:55:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 17:55:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8486 values 133772 bits 16721 bytes 
Thu 16 Jan 2014 17:55:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:55:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:55:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:55:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:55:42 - XML: Processed 656110 elements - found 956 jobs
Thu 16 Jan 2014 17:55:42 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 17:55:42 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 17:55:42 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:55:42 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:55:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:55:50 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:55:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:55:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:55:51 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:55:51 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:55:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:55:51 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:55:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:55:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:55:53 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:55:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:55:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:55:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:55:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:55:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:55:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:55:56 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:55:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43978230
Thu 16 Jan 2014 17:55:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:55:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43978230
Thu 16 Jan 2014 17:55:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:55:57 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:55:57 - job_xml_thread(): Done retrieving: data size 43978230
Thu 16 Jan 2014 17:55:57 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:55:57 - XML: Start document: iteration 15
Thu 16 Jan 2014 17:56:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:56:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:56:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:56:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:56:08 - XML: Processed 656106 elements - found 954 jobs
Thu 16 Jan 2014 17:56:09 - job 7346376 appears to have finished
Thu 16 Jan 2014 17:56:09 - job 7346569 appears to have finished
Thu 16 Jan 2014 17:56:09 - job 7346602 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:56:09 - job_xml_thread(): Found 3 updated jobs.
Thu 16 Jan 2014 17:56:09 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 17:56:11 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Thu 16 Jan 2014 17:56:11 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:56:11 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:56:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:56:15 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:56:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:56:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:56:16 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:56:16 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:56:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:56:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:56:16 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:56:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:56:18 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:56:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:56:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:56:19 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:56:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 17:56:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:56:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:56:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:56:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:56:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:56:21 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:56:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43984927
Thu 16 Jan 2014 17:56:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:56:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43984927
Thu 16 Jan 2014 17:56:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:56:26 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:56:26 - job_xml_thread(): Done retrieving: data size 43984927
Thu 16 Jan 2014 17:56:26 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:56:26 - XML: Start document: iteration 16
Thu 16 Jan 2014 17:56:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:56:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:56:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:56:31 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:56:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:56:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:56:32 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:56:32 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:56:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:56:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:56:32 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:56:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:56:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:56:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:56:35 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:56:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:56:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 17:56:36 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:56:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5944 values 93734 bits 11716 bytes 
Thu 16 Jan 2014 17:56:36 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:56:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 17:56:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:56:39 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:56:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:56:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:56:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:56:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:56:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:56:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:56:43 - XML: Processed 656106 elements - found 954 jobs
Thu 16 Jan 2014 17:56:43 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 17:56:43 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 17:56:43 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:56:43 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:56:45 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:56:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43960363
Thu 16 Jan 2014 17:56:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:56:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43960363
Thu 16 Jan 2014 17:56:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:56:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:56:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:56:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:56:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:56:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:56:55 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:56:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:56:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:56:56 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:56:56 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:56:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:56:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:56:56 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:56:58 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:56:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:56:59 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:56:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:56:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:56:59 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:56:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 17:56:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:56:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:56:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:56:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:56:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:57:01 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:57:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43992099
Thu 16 Jan 2014 17:57:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:57:01 - job_xml_thread(): Done retrieving: data size 43992099
Thu 16 Jan 2014 17:57:01 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:57:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43992099
Thu 16 Jan 2014 17:57:02 - XML: Start document: iteration 17
Thu 16 Jan 2014 17:57:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:57:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:57:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:57:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:57:11 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:57:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:57:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:57:13 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:57:13 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:57:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:57:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:57:14 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:57:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:57:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:57:20 - XML: Processed 656106 elements - found 954 jobs
Thu 16 Jan 2014 17:57:21 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 17:57:21 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 17:57:21 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:57:21 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:57:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:57:23 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:57:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:57:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:57:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:57:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:57:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:57:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:57:26 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:57:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43955446
Thu 16 Jan 2014 17:57:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:57:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43955446
Thu 16 Jan 2014 17:57:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:57:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:57:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:57:36 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:57:36 - job_xml_thread(): Done retrieving: data size 43955446
Thu 16 Jan 2014 17:57:36 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:57:36 - XML: Start document: iteration 18
Thu 16 Jan 2014 17:57:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:57:36 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:57:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:57:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 17:57:38 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:57:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 17:57:38 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:57:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:57:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:57:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9014 values 142172 bits 17771 bytes 
Thu 16 Jan 2014 17:57:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:57:39 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:57:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:57:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:57:40 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:57:40 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:57:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:57:40 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:57:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:57:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:57:47 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:57:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:57:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:57:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:57:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:57:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:57:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:57:49 - XML: Processed 656106 elements - found 954 jobs
Thu 16 Jan 2014 17:57:49 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 17:57:49 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 17:57:49 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:57:49 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:57:52 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:57:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43954239
Thu 16 Jan 2014 17:57:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:57:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43954239
Thu 16 Jan 2014 17:57:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:57:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:57:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:58:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:58:02 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:58:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:58:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:58:03 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:58:03 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:58:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:58:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:58:03 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:58:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:58:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:58:05 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:58:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:58:07 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:58:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:58:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:58:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:58:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:58:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:58:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:58:08 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:58:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 17:58:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:58:11 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:58:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43981299
Thu 16 Jan 2014 17:58:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:58:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43981299
Thu 16 Jan 2014 17:58:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:58:11 - job_xml_thread(): Done retrieving: data size 43981299
Thu 16 Jan 2014 17:58:12 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:58:12 - XML: Start document: iteration 19
Thu 16 Jan 2014 17:58:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:58:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:58:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:58:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:58:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:58:24 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:58:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:58:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:58:26 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:58:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:58:26 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:58:26 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:58:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:58:29 - XML: Processed 656106 elements - found 954 jobs
Thu 16 Jan 2014 17:58:29 - job 7346605 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:58:29 - job 7346575 appears to have finished
Thu 16 Jan 2014 17:58:29 - job 7346604 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:58:29 - job 7346607 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:58:29 - job 7346606 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:58:29 - job 7346603 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 17:58:29 - job_xml_thread(): Found 7 updated jobs.
Thu 16 Jan 2014 17:58:29 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 17:58:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:58:32 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:58:32 - job_xml_thread(): Done storing. succesfully stored: 7 jobs
Thu 16 Jan 2014 17:58:32 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:58:32 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:58:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:58:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:58:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:58:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:58:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:58:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:58:34 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:58:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43956555
Thu 16 Jan 2014 17:58:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:58:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43956555
Thu 16 Jan 2014 17:58:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:58:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:58:38 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:58:39 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:58:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:58:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 17:58:40 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:58:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 17:58:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8536 values 134539 bits 16817 bytes 
Thu 16 Jan 2014 17:58:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:58:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:58:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:58:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:58:48 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:58:48 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:58:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:58:49 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:58:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:58:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:58:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:58:50 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:58:50 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:58:50 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:58:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:58:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:58:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:58:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:58:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:58:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:58:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:58:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:58:54 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:58:54 - job_xml_thread(): Done retrieving: data size 43981222
Thu 16 Jan 2014 17:58:54 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:58:54 - XML: Start document: iteration 20
Thu 16 Jan 2014 17:58:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43981222
Thu 16 Jan 2014 17:58:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:58:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43981222
Thu 16 Jan 2014 17:58:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:59:05 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:59:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:59:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 17:59:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:59:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:59:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:59:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:59:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:59:14 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:59:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:59:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:59:15 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:59:15 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:59:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:59:15 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:59:15 - XML: Processed 656106 elements - found 954 jobs
Thu 16 Jan 2014 17:59:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:59:15 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 17:59:15 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 17:59:15 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:59:15 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:59:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:59:18 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:59:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:59:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:59:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:59:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:59:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:59:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:59:21 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:59:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43892877
Thu 16 Jan 2014 17:59:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:59:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43892877
Thu 16 Jan 2014 17:59:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:59:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:59:30 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:59:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:59:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:59:31 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:59:31 - job_xml_thread(): Done retrieving: data size 43892877
Thu 16 Jan 2014 17:59:31 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 17:59:31 - Housekeeping: checking database for timed out jobs..
Thu 16 Jan 2014 17:59:31 - Housekeeping: Found 0 timed out jobs in database: closing entries
Thu 16 Jan 2014 17:59:31 - Housekeeping: done.
Thu 16 Jan 2014 17:59:31 - XML: Start document: iteration 0
Thu 16 Jan 2014 17:59:31 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:59:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:59:32 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:59:32 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:59:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:59:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:59:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:59:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:59:36 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:59:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:59:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:59:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:59:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:59:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:59:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 17:59:39 - XML: Processed 655358 elements - found 954 jobs
Thu 16 Jan 2014 17:59:39 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 17:59:39 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 17:59:39 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 17:59:39 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 17:59:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:59:40 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:59:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:59:41 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:59:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 17:59:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 17:59:41 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 17:59:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6231 values 98242 bits 12280 bytes 
Thu 16 Jan 2014 17:59:43 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 17:59:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43392726
Thu 16 Jan 2014 17:59:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 17:59:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43392726
Thu 16 Jan 2014 17:59:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 17:59:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 17:59:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:59:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 17:59:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 17:59:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 17:59:53 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 17:59:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 17:59:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 17:59:54 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:59:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 17:59:54 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 17:59:54 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 17:59:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 17:59:54 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 17:59:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 17:59:58 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 17:59:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 17:59:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 17:59:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:59:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 17:59:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 17:59:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:00:01 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:00:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 18:00:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:00:01 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:00:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43318152
Thu 16 Jan 2014 18:00:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:00:02 - job_xml_thread(): Done retrieving: data size 43318152
Thu 16 Jan 2014 18:00:02 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:00:02 - XML: Start document: iteration 1
Thu 16 Jan 2014 18:00:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43318152
Thu 16 Jan 2014 18:00:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:00:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:00:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:00:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:00:10 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:00:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:00:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:00:12 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:00:12 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:00:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:00:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:00:12 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:00:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:00:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:00:20 - XML: Processed 647894 elements - found 949 jobs
Thu 16 Jan 2014 18:00:20 - job 7346377 appears to have finished
Thu 16 Jan 2014 18:00:20 - job 7346365 appears to have finished
Thu 16 Jan 2014 18:00:20 - job 7346573 appears to have finished
Thu 16 Jan 2014 18:00:20 - job 7346387 appears to have finished
Thu 16 Jan 2014 18:00:20 - job 7346386 appears to have finished
Thu 16 Jan 2014 18:00:20 - job_xml_thread(): Found 5 updated jobs.
Thu 16 Jan 2014 18:00:20 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 18:00:21 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Thu 16 Jan 2014 18:00:21 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:00:21 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:00:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:00:22 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:00:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:00:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:00:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:00:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:00:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:00:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:00:25 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:00:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43342062
Thu 16 Jan 2014 18:00:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:00:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43342062
Thu 16 Jan 2014 18:00:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:00:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:00:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:00:36 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:00:36 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:00:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:00:38 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:00:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:00:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:00:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:00:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:00:39 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:00:39 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:00:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:00:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:00:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:00:39 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:00:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:00:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:00:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:00:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:00:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:00:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:00:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:00:41 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:00:42 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:00:42 - job_xml_thread(): Done retrieving: data size 43847287
Thu 16 Jan 2014 18:00:42 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:00:42 - XML: Start document: iteration 2
Thu 16 Jan 2014 18:00:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43847287
Thu 16 Jan 2014 18:00:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:00:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43847287
Thu 16 Jan 2014 18:00:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:00:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:00:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 18:00:42 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:00:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 18:00:43 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:00:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 10516 values 165847 bits 20730 bytes 
Thu 16 Jan 2014 18:00:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:00:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:00:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:00:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:00:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:00:57 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:00:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:00:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:00:58 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:00:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:00:58 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:00:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:00:58 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:00:58 - XML: Processed 654514 elements - found 950 jobs
Thu 16 Jan 2014 18:00:59 - job 7346608 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:00:59 - job 7346606 field 'start_timestamp' changed since saved from: 1389891470 to: 1389891400
Thu 16 Jan 2014 18:00:59 - job_xml_thread(): Found 3 updated jobs.
Thu 16 Jan 2014 18:00:59 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 18:00:59 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Thu 16 Jan 2014 18:00:59 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:00:59 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:01:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:01:03 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:01:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:01:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:01:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:01:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:01:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:01:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:01:05 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:01:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43949062
Thu 16 Jan 2014 18:01:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:01:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43949062
Thu 16 Jan 2014 18:01:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:01:10 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Thu 16 Jan 2014 18:01:10 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:01:10 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:01:10 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 18:01:10 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 18:01:10 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:01:10 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 18:01:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:01:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:01:14 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:01:14 - job_xml_thread(): Done retrieving: data size 43949062
Thu 16 Jan 2014 18:01:14 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:01:14 - XML: Start document: iteration 3
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Thu 16 Jan 2014 18:01:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:01:18 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:01:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:01:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:01:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:01:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:01:19 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:01:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:01:19 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:01:19 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:01:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:01:26 - XML: Processed 656064 elements - found 950 jobs
Thu 16 Jan 2014 18:01:26 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 18:01:26 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 18:01:26 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:01:26 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:01:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:01:29 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:01:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:01:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:01:29 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:01:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 18:01:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:01:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:01:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:01:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:01:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:01:31 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:01:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43953561
Thu 16 Jan 2014 18:01:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:01:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43953561
Thu 16 Jan 2014 18:01:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:01:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:01:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:01:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:01:40 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:01:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:01:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:01:41 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:01:42 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:01:43 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:01:43 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:01:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:01:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:01:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:01:43 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:01:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:01:44 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:01:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:01:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 18:01:44 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:01:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5613 values 88555 bits 11069 bytes 
Thu 16 Jan 2014 18:01:44 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:01:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 18:01:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:01:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:01:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:01:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:01:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:01:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:01:47 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:01:47 - job_xml_thread(): Done retrieving: data size 43985367
Thu 16 Jan 2014 18:01:47 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:01:47 - XML: Start document: iteration 4
Thu 16 Jan 2014 18:01:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43985367
Thu 16 Jan 2014 18:01:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:01:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43985367
Thu 16 Jan 2014 18:01:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:01:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:01:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:02:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:02:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:02:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:02:04 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:02:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:02:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:02:06 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:02:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:02:06 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:02:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:02:07 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:02:07 - XML: Processed 656098 elements - found 950 jobs
Thu 16 Jan 2014 18:02:07 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 18:02:07 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 18:02:07 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:02:07 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:02:10 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:02:10 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:02:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:02:10 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:02:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:02:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:02:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:02:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:02:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:02:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:02:11 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:02:11 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 18:02:11 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:02:11 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 18:02:11 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 18:02:12 - size of cluster 'LISA Cluster': 624 hosts 79485 metrics 1047133 values 16532847 bits 2066605 bytes 
Thu 16 Jan 2014 18:02:12 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:02:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 18:02:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:02:15 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:02:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43985001
Thu 16 Jan 2014 18:02:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:02:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43985001
Thu 16 Jan 2014 18:02:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:02:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:02:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:02:22 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:02:22 - job_xml_thread(): Done retrieving: data size 43985001
Thu 16 Jan 2014 18:02:22 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:02:23 - XML: Start document: iteration 5
Thu 16 Jan 2014 18:02:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:02:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:02:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:02:29 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:02:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:02:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:02:32 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:02:32 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:02:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:02:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:02:32 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:02:37 - XML: Processed 656096 elements - found 949 jobs
Thu 16 Jan 2014 18:02:37 - job 7346613 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:02:37 - job 7346400 appears to have finished
Thu 16 Jan 2014 18:02:37 - job 7346609 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:02:37 - job 7346612 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:02:37 - job 7346610 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:02:37 - job 7346611 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:02:37 - job_xml_thread(): Found 6 updated jobs.
Thu 16 Jan 2014 18:02:37 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 18:02:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:02:38 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:02:38 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Thu 16 Jan 2014 18:02:38 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:02:38 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:02:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:02:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:02:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:02:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:02:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:02:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:02:43 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:02:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43976293
Thu 16 Jan 2014 18:02:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:02:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43976293
Thu 16 Jan 2014 18:02:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:02:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:02:44 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:02:46 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:02:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:02:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 18:02:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 18:02:47 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:02:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8737 values 138205 bits 17275 bytes 
Thu 16 Jan 2014 18:02:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:02:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:02:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:02:52 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:02:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:02:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:02:53 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:02:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:02:53 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:02:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:02:53 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:02:53 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:02:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:02:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:02:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:02:58 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:02:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:02:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:02:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:02:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:02:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:02:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:03:03 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:03:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43981949
Thu 16 Jan 2014 18:03:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:03:03 - job_xml_thread(): Done retrieving: data size 43981949
Thu 16 Jan 2014 18:03:03 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:03:03 - XML: Start document: iteration 6
Thu 16 Jan 2014 18:03:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43981949
Thu 16 Jan 2014 18:03:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:03:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:03:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:03:11 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:03:11 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 18:03:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:03:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:03:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:03:18 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:03:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:03:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:03:20 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:03:20 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:03:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:03:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:03:20 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:03:20 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:03:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 18:03:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:03:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:03:27 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:03:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:03:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:03:27 - XML: Processed 656095 elements - found 949 jobs
Thu 16 Jan 2014 18:03:27 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 18:03:27 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 18:03:27 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:03:27 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:03:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:03:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:03:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:03:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:03:31 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:03:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43971466
Thu 16 Jan 2014 18:03:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:03:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43971466
Thu 16 Jan 2014 18:03:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:03:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:03:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:03:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:03:39 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:03:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:03:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:03:41 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:03:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:03:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43971466
Thu 16 Jan 2014 18:03:41 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:03:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:03:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:03:42 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:03:42 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:03:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:03:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:03:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:03:47 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:03:48 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:03:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 18:03:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:03:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 18:03:48 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:03:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6042 values 95481 bits 11935 bytes 
Thu 16 Jan 2014 18:03:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:03:52 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:03:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:03:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:03:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:03:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:03:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:03:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:03:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:03:53 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:03:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:03:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:03:57 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:03:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:03:57 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:03:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:03:58 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:03:58 - job_xml_thread(): Done retrieving: data size 43949125
Thu 16 Jan 2014 18:03:58 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:03:58 - XML: Start document: iteration 7
Thu 16 Jan 2014 18:03:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43949125
Thu 16 Jan 2014 18:03:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:03:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43949125
Thu 16 Jan 2014 18:03:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:04:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:04:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:04:10 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:04:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 18:04:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:04:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:04:11 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:04:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:04:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:04:12 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:04:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:04:12 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:04:12 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:04:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:04:20 - XML: Processed 656096 elements - found 949 jobs
Thu 16 Jan 2014 18:04:20 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 18:04:20 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 18:04:20 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:04:20 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:04:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:04:23 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:04:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:04:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:04:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:04:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:04:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:04:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:04:27 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:04:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:04:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:04:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43951065
Thu 16 Jan 2014 18:04:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:04:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43951065
Thu 16 Jan 2014 18:04:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:04:35 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:04:35 - job_xml_thread(): Done retrieving: data size 43951065
Thu 16 Jan 2014 18:04:35 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:04:35 - XML: Start document: iteration 8
Thu 16 Jan 2014 18:04:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:04:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:04:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:04:44 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:04:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:04:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:04:46 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:04:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:04:46 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:04:46 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:04:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:04:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:04:48 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:04:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:04:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 18:04:48 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:04:48 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:04:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 18:04:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6107 values 96350 bits 12043 bytes 
Thu 16 Jan 2014 18:04:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:04:50 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:04:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:04:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:04:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:04:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:04:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:04:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:04:51 - XML: Processed 656086 elements - found 944 jobs
Thu 16 Jan 2014 18:04:51 - job 7346566 appears to have finished
Thu 16 Jan 2014 18:04:51 - job 7346612 field 'start_timestamp' changed since saved from: 1389891707 to: 1389891665
Thu 16 Jan 2014 18:04:51 - job 7346581 appears to have finished
Thu 16 Jan 2014 18:04:51 - job 7346614 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:04:51 - job 7346615 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:04:51 - job 7346384 appears to have finished
Thu 16 Jan 2014 18:04:51 - job 7346335 appears to have finished
Thu 16 Jan 2014 18:04:51 - job 7346326 appears to have finished
Thu 16 Jan 2014 18:04:51 - job_xml_thread(): Found 8 updated jobs.
Thu 16 Jan 2014 18:04:51 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 18:04:52 - job_xml_thread(): Done storing. succesfully stored: 8 jobs
Thu 16 Jan 2014 18:04:52 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:04:52 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:04:56 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:04:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43973797
Thu 16 Jan 2014 18:04:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:04:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43973797
Thu 16 Jan 2014 18:04:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:05:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:05:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:05:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:05:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:05:07 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:05:07 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:05:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:05:07 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:05:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:05:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:05:08 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:05:08 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:05:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:05:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:05:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:05:13 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:05:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:05:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:05:13 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:05:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 18:05:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:05:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:05:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:05:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:05:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:05:14 - Leaving storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 18:05:14 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Thu 16 Jan 2014 18:05:14 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:05:16 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:05:16 - job_xml_thread(): Done retrieving: data size 43908658
Thu 16 Jan 2014 18:05:16 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:05:16 - XML: Start document: iteration 9
Thu 16 Jan 2014 18:05:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43908658
Thu 16 Jan 2014 18:05:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:05:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43908658
Thu 16 Jan 2014 18:05:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:05:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:05:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:05:25 - XML: Processed 655338 elements - found 944 jobs
Thu 16 Jan 2014 18:05:25 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 18:05:25 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 18:05:25 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:05:25 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:05:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:05:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:05:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:05:32 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:05:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:05:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:05:33 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:05:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:05:33 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:05:33 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:05:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:05:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:05:36 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:05:41 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:05:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:05:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:05:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:05:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:05:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:05:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:05:43 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:05:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43409098
Thu 16 Jan 2014 18:05:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:05:44 - job_xml_thread(): Done retrieving: data size 43409098
Thu 16 Jan 2014 18:05:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43409098
Thu 16 Jan 2014 18:05:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:05:44 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:05:44 - XML: Start document: iteration 10
Thu 16 Jan 2014 18:05:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:05:48 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:05:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:05:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:05:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:05:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 18:05:49 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:05:49 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:05:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 18:05:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8845 values 139536 bits 17442 bytes 
Thu 16 Jan 2014 18:05:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:05:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:05:59 - XML: Processed 649254 elements - found 944 jobs
Thu 16 Jan 2014 18:05:59 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 18:05:59 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 18:05:59 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:05:59 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:06:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:06:01 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:06:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:06:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:06:03 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:06:03 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:06:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:06:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:06:03 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:06:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:06:05 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:06:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:06:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:06:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:06:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:06:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:06:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:06:07 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:06:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43307193
Thu 16 Jan 2014 18:06:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:06:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43307193
Thu 16 Jan 2014 18:06:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:06:14 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:06:14 - job_xml_thread(): Done retrieving: data size 43307193
Thu 16 Jan 2014 18:06:14 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:06:14 - XML: Start document: iteration 11
Thu 16 Jan 2014 18:06:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:06:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:06:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:06:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:06:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:06:24 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:06:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:06:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:06:25 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:06:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:06:25 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:06:25 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:06:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:06:30 - XML: Processed 647886 elements - found 944 jobs
Thu 16 Jan 2014 18:06:30 - job 7346572 appears to have finished
Thu 16 Jan 2014 18:06:30 - job 7344513 appears to have finished
Thu 16 Jan 2014 18:06:30 - job 7346617 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:06:30 - job 7346616 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:06:30 - job_xml_thread(): Found 6 updated jobs.
Thu 16 Jan 2014 18:06:30 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 18:06:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:06:31 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:06:31 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Thu 16 Jan 2014 18:06:31 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:06:31 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:06:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:06:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:06:31 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:06:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 18:06:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:06:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:06:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:06:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:06:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:06:33 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:06:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43635596
Thu 16 Jan 2014 18:06:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:06:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43635596
Thu 16 Jan 2014 18:06:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:06:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:06:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:06:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:06:44 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:06:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:06:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:06:45 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:06:45 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:06:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:06:45 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:06:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:06:46 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:06:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:06:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:06:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:06:47 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:06:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:06:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:06:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:06:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:06:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:06:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:06:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:06:49 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:06:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:06:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 18:06:50 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:06:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 18:06:50 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:06:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5684 values 89605 bits 11200 bytes 
Thu 16 Jan 2014 18:06:52 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:06:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43941247
Thu 16 Jan 2014 18:06:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:06:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43941247
Thu 16 Jan 2014 18:06:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:06:53 - job_xml_thread(): Done retrieving: data size 43941247
Thu 16 Jan 2014 18:06:53 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:06:53 - XML: Start document: iteration 12
Thu 16 Jan 2014 18:07:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:07:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:07:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:07:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:07:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:07:12 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:07:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:07:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:07:13 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:07:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:07:13 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:07:13 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:07:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:07:14 - XML: Processed 655868 elements - found 944 jobs
Thu 16 Jan 2014 18:07:14 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 18:07:14 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 18:07:14 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:07:14 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:07:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:07:17 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:07:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:07:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:07:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:07:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:07:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:07:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:07:19 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:07:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 18:07:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:07:19 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:07:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43952923
Thu 16 Jan 2014 18:07:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:07:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43952923
Thu 16 Jan 2014 18:07:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:07:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:07:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:07:29 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:07:30 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:07:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:07:31 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:07:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:07:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:07:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:07:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:07:32 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:07:32 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:07:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:07:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:07:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:07:34 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:07:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:07:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:07:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:07:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:07:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:07:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:07:36 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:07:36 - job_xml_thread(): Done retrieving: data size 43958302
Thu 16 Jan 2014 18:07:36 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:07:36 - XML: Start document: iteration 13
Thu 16 Jan 2014 18:07:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43958302
Thu 16 Jan 2014 18:07:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:07:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43958302
Thu 16 Jan 2014 18:07:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:07:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:07:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:07:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:07:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:07:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:07:51 - XML: Processed 656086 elements - found 944 jobs
Thu 16 Jan 2014 18:07:51 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 18:07:51 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 18:07:51 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:07:51 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:07:51 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:07:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:07:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 18:07:52 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:07:52 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:07:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 18:07:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6669 values 105149 bits 13143 bytes 
Thu 16 Jan 2014 18:07:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:07:53 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:07:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:07:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:07:54 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:07:54 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:07:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:07:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:07:54 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:07:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:07:59 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:07:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:07:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:08:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:08:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:08:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:08:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:08:04 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:08:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43961149
Thu 16 Jan 2014 18:08:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:08:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43961149
Thu 16 Jan 2014 18:08:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:08:06 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:08:06 - job_xml_thread(): Done retrieving: data size 43961149
Thu 16 Jan 2014 18:08:06 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:08:06 - XML: Start document: iteration 14
Thu 16 Jan 2014 18:08:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:08:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:08:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:08:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:08:19 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:08:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 18:08:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:08:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:08:20 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:08:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:08:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:08:21 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:08:21 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:08:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:08:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:08:22 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:08:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:08:27 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:08:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:08:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:08:28 - XML: Processed 656084 elements - found 943 jobs
Thu 16 Jan 2014 18:08:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:08:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:08:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:08:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:08:28 - job 7345991 appears to have finished
Thu 16 Jan 2014 18:08:28 - job 7346621 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:08:28 - job 7346620 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:08:28 - job 7346619 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:08:28 - job 7346353 appears to have finished
Thu 16 Jan 2014 18:08:28 - job 7346618 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:08:28 - job_xml_thread(): Found 7 updated jobs.
Thu 16 Jan 2014 18:08:28 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 18:08:28 - job_xml_thread(): Done storing. succesfully stored: 7 jobs
Thu 16 Jan 2014 18:08:28 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:08:28 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:08:30 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:08:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43976820
Thu 16 Jan 2014 18:08:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:08:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43976820
Thu 16 Jan 2014 18:08:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:08:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:08:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:08:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:08:39 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:08:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:08:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:08:40 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:08:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:08:41 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:08:41 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:08:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:08:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:08:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:08:43 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:08:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:08:43 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:08:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:08:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:08:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:08:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:08:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:08:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:08:45 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:08:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43991631
Thu 16 Jan 2014 18:08:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:08:45 - job_xml_thread(): Done retrieving: data size 43991631
Thu 16 Jan 2014 18:08:45 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:08:45 - XML: Start document: iteration 15
Thu 16 Jan 2014 18:08:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43991631
Thu 16 Jan 2014 18:08:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:08:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:08:52 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:08:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:08:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 18:08:53 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:08:53 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:08:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9067 values 142952 bits 17869 bytes 
Thu 16 Jan 2014 18:08:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 18:08:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:08:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:08:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:08:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:09:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:09:02 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:09:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:09:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:09:03 - XML: Processed 656084 elements - found 943 jobs
Thu 16 Jan 2014 18:09:03 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 18:09:03 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 18:09:03 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:09:03 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:09:03 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:09:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:09:03 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:09:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:09:03 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:09:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:09:06 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:09:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:09:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:09:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:09:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:09:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:09:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:09:08 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:09:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43973787
Thu 16 Jan 2014 18:09:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:09:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43973787
Thu 16 Jan 2014 18:09:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:09:11 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Thu 16 Jan 2014 18:09:12 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:09:13 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:09:13 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 18:09:13 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 18:09:13 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:09:13 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 18:09:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:09:17 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:09:18 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:09:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:09:18 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:09:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:09:19 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:09:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:09:19 - size of cluster 'LISA Cluster': 624 hosts 79471 metrics 842314 values 13296874 bits 1662109 bytes 
Thu 16 Jan 2014 18:09:20 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:09:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:09:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:09:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:09:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:09:24 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:09:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:09:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:09:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:09:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:09:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:09:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:09:25 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:09:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 18:09:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:09:29 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:09:29 - job_xml_thread(): Done retrieving: data size 43957386
Thu 16 Jan 2014 18:09:29 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:09:29 - XML: Start document: iteration 16
Thu 16 Jan 2014 18:09:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43957386
Thu 16 Jan 2014 18:09:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:09:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43957386
Thu 16 Jan 2014 18:09:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:09:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:09:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:09:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:09:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:09:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:09:48 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:09:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:09:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:09:49 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:09:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:09:49 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:09:49 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:09:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:09:52 - XML: Processed 656084 elements - found 943 jobs
Thu 16 Jan 2014 18:09:52 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 18:09:52 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 18:09:52 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:09:52 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:09:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:09:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:09:54 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:09:54 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:09:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:09:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:09:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:09:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:09:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:09:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:09:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:09:54 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:09:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 18:09:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 18:09:54 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:09:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5773 values 90963 bits 11370 bytes 
Thu 16 Jan 2014 18:09:58 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:09:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43963857
Thu 16 Jan 2014 18:09:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:09:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43963857
Thu 16 Jan 2014 18:09:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:10:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:10:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:10:07 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:10:07 - job_xml_thread(): Done retrieving: data size 43963857
Thu 16 Jan 2014 18:10:07 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:10:07 - XML: Start document: iteration 17
Thu 16 Jan 2014 18:10:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:10:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:10:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:10:12 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:10:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:10:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:10:13 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:10:13 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 18:10:13 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:10:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:10:13 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:10:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:10:13 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:10:22 - XML: Processed 656084 elements - found 943 jobs
Thu 16 Jan 2014 18:10:22 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 18:10:22 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 18:10:22 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:10:22 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:10:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:10:22 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:10:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:10:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:10:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:10:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:10:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:10:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:10:23 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:10:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 18:10:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:10:26 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:10:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43943850
Thu 16 Jan 2014 18:10:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:10:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43943850
Thu 16 Jan 2014 18:10:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:10:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:10:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:10:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:10:37 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:10:37 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:10:37 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:10:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:10:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:10:37 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:10:37 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:10:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:10:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:10:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:10:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:10:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:10:40 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:10:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:10:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:10:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:10:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:10:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:10:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:10:43 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:10:43 - job_xml_thread(): Done retrieving: data size 43980324
Thu 16 Jan 2014 18:10:43 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:10:43 - XML: Start document: iteration 18
Thu 16 Jan 2014 18:10:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43980324
Thu 16 Jan 2014 18:10:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:10:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43980324
Thu 16 Jan 2014 18:10:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:10:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:10:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:10:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:10:55 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:10:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:10:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:10:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:10:56 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:10:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 18:10:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 18:10:56 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:10:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8250 values 130005 bits 16250 bytes 
Thu 16 Jan 2014 18:11:03 - XML: Processed 656080 elements - found 941 jobs
Thu 16 Jan 2014 18:11:03 - job 7346390 appears to have finished
Thu 16 Jan 2014 18:11:03 - job 7346629 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:11:04 - job 7346623 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:11:04 - job 7346628 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:11:04 - job 7346620 field 'start_timestamp' changed since saved from: 1389892083 to: 1389892024
Thu 16 Jan 2014 18:11:04 - job 7346627 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:11:04 - job 7346626 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:11:04 - job 7346577 appears to have finished
Thu 16 Jan 2014 18:11:04 - job 7346694 appears to have finished
Thu 16 Jan 2014 18:11:04 - job 7346622 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:11:04 - job 7346625 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:11:04 - job 7346624 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:11:04 - job_xml_thread(): Found 13 updated jobs.
Thu 16 Jan 2014 18:11:04 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 18:11:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:11:05 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:11:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:11:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:11:05 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:11:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:11:05 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:11:05 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:11:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:11:07 - job_xml_thread(): Done storing. succesfully stored: 13 jobs
Thu 16 Jan 2014 18:11:07 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:11:07 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:11:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:11:07 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:11:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:11:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:11:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:11:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:11:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:11:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:11:11 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:11:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43903667
Thu 16 Jan 2014 18:11:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:11:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43903667
Thu 16 Jan 2014 18:11:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:11:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:11:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:11:22 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:11:22 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:11:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:11:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:11:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:11:23 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:11:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:11:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:11:24 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:11:24 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:11:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:11:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:11:25 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:11:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 18:11:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:11:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:11:28 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:11:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:11:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:11:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:11:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:11:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:11:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:11:31 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:11:31 - job_xml_thread(): Done retrieving: data size 43896367
Thu 16 Jan 2014 18:11:31 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:11:31 - XML: Start document: iteration 19
Thu 16 Jan 2014 18:11:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43896367
Thu 16 Jan 2014 18:11:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43896367
Thu 16 Jan 2014 18:11:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:11:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:11:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:11:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:11:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:11:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:11:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:11:48 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:11:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:11:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:11:49 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:11:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:11:49 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:11:49 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:11:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:11:50 - XML: Processed 655322 elements - found 941 jobs
Thu 16 Jan 2014 18:11:51 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 18:11:51 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 18:11:51 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:11:51 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:11:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:11:54 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:11:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:11:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:11:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:11:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:11:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:11:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:11:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:11:56 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:11:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:11:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 18:11:57 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:11:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5984 values 94380 bits 11797 bytes 
Thu 16 Jan 2014 18:11:57 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:11:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 18:11:57 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:11:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43313292
Thu 16 Jan 2014 18:11:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:11:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43313292
Thu 16 Jan 2014 18:11:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:12:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:12:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:12:06 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:12:06 - job_xml_thread(): Done retrieving: data size 43313292
Thu 16 Jan 2014 18:12:07 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:12:07 - XML: Start document: iteration 20
Thu 16 Jan 2014 18:12:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:12:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:12:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:12:13 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:12:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:12:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:12:14 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:12:14 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:12:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:12:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:12:14 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:12:16 - XML: Processed 648002 elements - found 941 jobs
Thu 16 Jan 2014 18:12:16 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 18:12:16 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 18:12:16 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:12:16 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:12:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:12:20 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:12:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:12:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:12:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:12:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:12:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:12:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:12:23 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:12:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 18:12:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:12:24 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:12:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43349550
Thu 16 Jan 2014 18:12:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:12:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43349550
Thu 16 Jan 2014 18:12:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:12:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:12:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:12:31 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:12:31 - job_xml_thread(): Done retrieving: data size 43349550
Thu 16 Jan 2014 18:12:31 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:12:31 - Housekeeping: checking database for timed out jobs..
Thu 16 Jan 2014 18:12:32 - Housekeeping: Found 0 timed out jobs in database: closing entries
Thu 16 Jan 2014 18:12:32 - Housekeeping: done.
Thu 16 Jan 2014 18:12:32 - XML: Start document: iteration 0
Thu 16 Jan 2014 18:12:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:12:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:12:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:12:40 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:12:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:12:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:12:41 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:12:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:12:41 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:12:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:12:41 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:12:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:12:43 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:12:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:12:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:12:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:12:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:12:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:12:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:12:47 - XML: Processed 648610 elements - found 932 jobs
Thu 16 Jan 2014 18:12:47 - job 7346631 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:12:47 - job 7346630 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:12:47 - job 7346591 appears to have finished
Thu 16 Jan 2014 18:12:47 - job 7346444 appears to have finished
Thu 16 Jan 2014 18:12:47 - job 7346392 appears to have finished
Thu 16 Jan 2014 18:12:47 - job 7346391 appears to have finished
Thu 16 Jan 2014 18:12:47 - job 7346629 field 'start_timestamp' changed since saved from: 1389892171 to: 1389892169
Thu 16 Jan 2014 18:12:47 - job 7346623 field 'start_timestamp' changed since saved from: 1389892224 to: 1389892169
Thu 16 Jan 2014 18:12:47 - job 7346628 field 'start_timestamp' changed since saved from: 1389892171 to: 1389892169
Thu 16 Jan 2014 18:12:47 - job 7346352 appears to have finished
Thu 16 Jan 2014 18:12:47 - job 7346589 appears to have finished
Thu 16 Jan 2014 18:12:47 - job 7345027 appears to have finished
Thu 16 Jan 2014 18:12:47 - job 7346733 appears to have finished
Thu 16 Jan 2014 18:12:47 - job 7346592 appears to have finished
Thu 16 Jan 2014 18:12:47 - job_xml_thread(): Found 14 updated jobs.
Thu 16 Jan 2014 18:12:47 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 18:12:47 - job_xml_thread(): Done storing. succesfully stored: 14 jobs
Thu 16 Jan 2014 18:12:47 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:12:47 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:12:51 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:12:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43895504
Thu 16 Jan 2014 18:12:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:12:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43895504
Thu 16 Jan 2014 18:12:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:12:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:12:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:12:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:12:57 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:12:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:12:57 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:12:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 18:12:57 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:12:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 18:12:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6764 values 106686 bits 13335 bytes 
Thu 16 Jan 2014 18:12:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:12:59 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:12:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:12:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:12:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:12:59 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:12:59 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:12:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:12:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:12:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:12:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43895504
Thu 16 Jan 2014 18:12:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:13:02 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:13:02 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:13:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:13:11 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:13:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:13:13 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:13:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:13:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:13:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:13:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:13:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:13:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:13:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:13:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:13:15 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:13:15 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:13:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:13:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:13:16 - Leaving storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 18:13:16 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Thu 16 Jan 2014 18:13:16 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:13:17 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:13:17 - job_xml_thread(): Done retrieving: data size 43947428
Thu 16 Jan 2014 18:13:17 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:13:17 - XML: Start document: iteration 1
Thu 16 Jan 2014 18:13:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43947428
Thu 16 Jan 2014 18:13:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43947428
Thu 16 Jan 2014 18:13:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:13:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:13:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:13:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:13:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:13:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:13:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:13:36 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:13:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:13:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:13:38 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:13:38 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:13:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:13:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:13:38 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:13:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:13:39 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:13:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:13:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:13:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:13:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:13:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:13:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:13:40 - XML: Processed 656062 elements - found 932 jobs
Thu 16 Jan 2014 18:13:40 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 18:13:40 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 18:13:40 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:13:40 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:13:40 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:13:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 18:13:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:13:42 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:13:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43974009
Thu 16 Jan 2014 18:13:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:13:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43974009
Thu 16 Jan 2014 18:13:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:13:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:13:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:13:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:13:54 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:13:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:13:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:13:55 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:13:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:13:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:13:55 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:13:55 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:13:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:13:55 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:13:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:13:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:13:57 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:13:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:13:57 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:13:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:13:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:13:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:13:58 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:13:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 18:13:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:13:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 18:13:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:13:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:13:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:13:58 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:13:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5993 values 94499 bits 11812 bytes 
Thu 16 Jan 2014 18:13:59 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:13:59 - job_xml_thread(): Done retrieving: data size 43989521
Thu 16 Jan 2014 18:13:59 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:13:59 - XML: Start document: iteration 2
Thu 16 Jan 2014 18:14:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43989521
Thu 16 Jan 2014 18:14:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:14:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43989521
Thu 16 Jan 2014 18:14:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:14:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:14:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:14:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:14:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:14:17 - XML: Processed 656058 elements - found 930 jobs
Thu 16 Jan 2014 18:14:17 - job 7346402 appears to have finished
Thu 16 Jan 2014 18:14:17 - job 7346394 appears to have finished
Thu 16 Jan 2014 18:14:17 - job_xml_thread(): Found 2 updated jobs.
Thu 16 Jan 2014 18:14:17 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 18:14:19 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Thu 16 Jan 2014 18:14:19 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:14:19 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:14:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:14:21 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:14:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:14:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:14:21 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:14:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:14:21 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:14:21 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:14:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:14:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:14:23 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:14:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:14:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:14:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:14:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:14:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:14:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:14:25 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:14:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 18:14:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:14:26 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:14:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43970335
Thu 16 Jan 2014 18:14:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:14:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43970335
Thu 16 Jan 2014 18:14:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:14:34 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:14:34 - job_xml_thread(): Done retrieving: data size 43970335
Thu 16 Jan 2014 18:14:34 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:14:34 - XML: Start document: iteration 3
Thu 16 Jan 2014 18:14:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:14:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:14:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:14:38 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:14:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:14:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:14:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:14:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:14:39 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:14:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:14:40 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:14:40 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:14:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:14:48 - XML: Processed 656060 elements - found 931 jobs
Thu 16 Jan 2014 18:14:48 - job 7346632 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:14:48 - job 7346630 field 'start_timestamp' changed since saved from: 1389892328 to: 1389892240
Thu 16 Jan 2014 18:14:48 - job 7346633 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:14:48 - job 7346634 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:14:48 - job_xml_thread(): Found 5 updated jobs.
Thu 16 Jan 2014 18:14:48 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 18:14:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:14:49 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:14:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:14:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:14:49 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Thu 16 Jan 2014 18:14:49 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:14:49 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:14:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:14:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:14:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:14:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:14:51 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:14:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43962535
Thu 16 Jan 2014 18:14:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:14:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43962535
Thu 16 Jan 2014 18:14:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:14:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:14:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:14:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:14:59 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:15:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:15:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 18:15:00 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:15:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 18:15:00 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:15:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:15:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7385 values 116437 bits 14554 bytes 
Thu 16 Jan 2014 18:15:00 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:15:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:15:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:15:01 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:15:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:15:01 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:15:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:15:02 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:15:04 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:15:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:15:04 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:15:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:15:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:15:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:15:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:15:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:15:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:15:07 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:15:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 18:15:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:15:07 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:15:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43970862
Thu 16 Jan 2014 18:15:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:15:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43970862
Thu 16 Jan 2014 18:15:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:15:08 - job_xml_thread(): Done retrieving: data size 43970862
Thu 16 Jan 2014 18:15:08 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:15:08 - XML: Start document: iteration 4
Thu 16 Jan 2014 18:15:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:15:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:15:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:15:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:15:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:15:28 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:15:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:15:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:15:29 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:15:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:15:29 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:15:29 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:15:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:15:29 - XML: Processed 656060 elements - found 931 jobs
Thu 16 Jan 2014 18:15:30 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 18:15:30 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 18:15:30 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:15:30 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:15:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:15:31 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:15:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:15:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:15:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:15:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:15:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:15:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:15:32 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:15:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43981966
Thu 16 Jan 2014 18:15:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:15:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43981966
Thu 16 Jan 2014 18:15:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:15:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:15:41 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:15:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:15:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:15:45 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:15:45 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:15:45 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:15:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:15:45 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:15:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:15:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:15:46 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:15:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:15:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:15:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:15:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:15:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:15:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:15:48 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:15:48 - job_xml_thread(): Done retrieving: data size 43989034
Thu 16 Jan 2014 18:15:48 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:15:48 - XML: Start document: iteration 5
Thu 16 Jan 2014 18:15:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43989034
Thu 16 Jan 2014 18:15:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:15:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43989034
Thu 16 Jan 2014 18:15:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:16:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:16:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:16:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:16:01 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:16:01 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:16:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 18:16:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:16:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 18:16:02 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:16:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148578 bits 18572 bytes 
Thu 16 Jan 2014 18:16:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:16:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:16:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:16:04 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:16:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:16:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:16:04 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:16:04 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:16:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:16:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:16:04 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:16:09 - XML: Processed 656057 elements - found 931 jobs
Thu 16 Jan 2014 18:16:09 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 18:16:09 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 18:16:09 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:16:09 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:16:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:16:10 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:16:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:16:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:16:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:16:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:16:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:16:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:16:12 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:16:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43965794
Thu 16 Jan 2014 18:16:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:16:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43965794
Thu 16 Jan 2014 18:16:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:16:13 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Thu 16 Jan 2014 18:16:13 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:16:15 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:16:15 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 18:16:15 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 18:16:15 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:16:15 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 18:16:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:16:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:16:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:16:22 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:16:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:16:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:16:23 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:16:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:16:23 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:16:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:16:23 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:16:24 - size of cluster 'LISA Cluster': 624 hosts 79471 metrics 799173 values 12610565 bits 1576320 bytes 
Thu 16 Jan 2014 18:16:24 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:16:25 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:16:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 18:16:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:16:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:16:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:16:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:16:29 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:16:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:16:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:16:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:16:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:16:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:16:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:16:32 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:16:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43974288
Thu 16 Jan 2014 18:16:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:16:33 - job_xml_thread(): Done retrieving: data size 43974288
Thu 16 Jan 2014 18:16:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43974288
Thu 16 Jan 2014 18:16:33 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:16:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:16:33 - XML: Start document: iteration 6
Thu 16 Jan 2014 18:16:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:16:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:16:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:16:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:16:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:16:53 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:16:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:16:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:16:55 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:16:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:16:55 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:16:55 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:16:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:16:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:16:55 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:16:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:16:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:16:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:16:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:16:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:16:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:16:56 - XML: Processed 656054 elements - found 928 jobs
Thu 16 Jan 2014 18:16:56 - job 7346636 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:16:56 - job 7346634 field 'start_timestamp' changed since saved from: 1389892426 to: 1389892388
Thu 16 Jan 2014 18:16:56 - job 7346635 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:16:56 - job 7335155 appears to have finished
Thu 16 Jan 2014 18:16:56 - job 7346582 appears to have finished
Thu 16 Jan 2014 18:16:56 - job 7346597 appears to have finished
Thu 16 Jan 2014 18:16:56 - job_xml_thread(): Found 6 updated jobs.
Thu 16 Jan 2014 18:16:56 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 18:16:56 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Thu 16 Jan 2014 18:16:56 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:16:56 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:17:00 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:17:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43987396
Thu 16 Jan 2014 18:17:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:17:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43987396
Thu 16 Jan 2014 18:17:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:17:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:17:02 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:17:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:17:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 18:17:03 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:17:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9196 values 145428 bits 18178 bytes 
Thu 16 Jan 2014 18:17:03 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:17:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 18:17:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:17:09 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:17:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:17:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:17:10 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:17:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:17:10 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:17:10 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:17:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:17:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:17:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:17:11 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:17:15 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:17:15 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 18:17:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:17:15 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:17:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:17:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:17:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:17:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:17:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:17:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:17:19 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:17:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43908317
Thu 16 Jan 2014 18:17:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:17:20 - job_xml_thread(): Done retrieving: data size 43908317
Thu 16 Jan 2014 18:17:20 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:17:20 - XML: Start document: iteration 7
Thu 16 Jan 2014 18:17:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43908317
Thu 16 Jan 2014 18:17:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:17:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:17:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:17:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:17:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:17:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:17:39 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:17:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:17:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:17:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:17:39 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:17:39 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:17:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:17:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:17:39 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:17:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:17:40 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:17:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:17:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:17:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:17:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:17:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:17:43 - XML: Processed 655301 elements - found 928 jobs
Thu 16 Jan 2014 18:17:43 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 18:17:43 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 18:17:43 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:17:43 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:17:43 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:17:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 18:17:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:17:47 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:17:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43380902
Thu 16 Jan 2014 18:17:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:17:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43380902
Thu 16 Jan 2014 18:17:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:17:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:17:54 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:17:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:17:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:17:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:17:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:17:56 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:17:56 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:17:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:17:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43380902
Thu 16 Jan 2014 18:17:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:17:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:17:58 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:17:58 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:18:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:18:03 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:18:04 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:18:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:18:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 18:18:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 18:18:05 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:18:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5942 values 93997 bits 11749 bytes 
Thu 16 Jan 2014 18:18:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:18:07 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:18:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:18:08 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:18:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:18:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:18:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:18:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:18:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:18:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:18:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:18:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:18:12 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:18:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:18:12 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:18:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:18:12 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:18:12 - job_xml_thread(): Done retrieving: data size 43277913
Thu 16 Jan 2014 18:18:12 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:18:12 - XML: Start document: iteration 8
Thu 16 Jan 2014 18:18:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43277913
Thu 16 Jan 2014 18:18:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:18:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43277913
Thu 16 Jan 2014 18:18:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:18:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:18:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:18:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:18:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:18:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:18:27 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:18:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:18:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:18:28 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:18:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:18:28 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:18:28 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:18:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:18:33 - XML: Processed 647848 elements - found 925 jobs
Thu 16 Jan 2014 18:18:33 - job 7346370 appears to have finished
Thu 16 Jan 2014 18:18:33 - job 7346639 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:18:33 - job 7325961 appears to have finished
Thu 16 Jan 2014 18:18:33 - job 7346637 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:18:33 - job 7346638 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:18:33 - job 7325895 appears to have finished
Thu 16 Jan 2014 18:18:33 - job 7346640 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:18:33 - job 7346641 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:18:33 - job_xml_thread(): Found 8 updated jobs.
Thu 16 Jan 2014 18:18:33 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 18:18:34 - job_xml_thread(): Done storing. succesfully stored: 8 jobs
Thu 16 Jan 2014 18:18:34 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:18:34 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:18:35 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:18:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 18:18:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:18:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:18:36 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:18:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:18:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:18:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:18:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:18:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:18:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:18:39 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:18:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43846138
Thu 16 Jan 2014 18:18:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43846138
Thu 16 Jan 2014 18:18:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:18:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:18:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:18:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:18:50 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:18:50 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:18:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:18:51 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:18:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:18:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:18:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:18:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:18:53 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:18:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:18:53 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:18:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:18:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:18:54 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:18:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:18:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:18:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:18:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:18:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:18:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:18:58 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:18:58 - job_xml_thread(): Done retrieving: data size 43944190
Thu 16 Jan 2014 18:18:58 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:18:58 - XML: Start document: iteration 9
Thu 16 Jan 2014 18:18:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43944190
Thu 16 Jan 2014 18:18:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43944190
Thu 16 Jan 2014 18:18:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:18:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:19:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:19:05 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:19:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:19:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 18:19:06 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:19:06 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:19:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 18:19:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9049 values 142877 bits 17859 bytes 
Thu 16 Jan 2014 18:19:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:19:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:19:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:19:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:19:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:19:17 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:19:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:19:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:19:18 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:19:18 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:19:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:19:18 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:19:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:19:18 - XML: Processed 655772 elements - found 925 jobs
Thu 16 Jan 2014 18:19:19 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 18:19:19 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 18:19:19 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:19:19 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:19:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:19:21 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:19:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:19:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:19:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:19:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:19:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:19:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:19:25 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:19:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 18:19:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:19:25 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:19:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43952548
Thu 16 Jan 2014 18:19:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:19:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43952548
Thu 16 Jan 2014 18:19:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:19:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:19:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:19:34 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:19:34 - job_xml_thread(): Done retrieving: data size 43952548
Thu 16 Jan 2014 18:19:34 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:19:34 - XML: Start document: iteration 10
Thu 16 Jan 2014 18:19:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:19:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:19:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:19:37 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:19:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:19:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:19:39 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:19:39 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:19:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:19:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:19:39 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:19:44 - XML: Processed 656048 elements - found 925 jobs
Thu 16 Jan 2014 18:19:44 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 18:19:44 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 18:19:44 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:19:44 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:19:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:19:48 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:19:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:19:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:19:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:19:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:19:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:19:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:19:51 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:19:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43933930
Thu 16 Jan 2014 18:19:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:19:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43933930
Thu 16 Jan 2014 18:19:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:19:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:19:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:19:59 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:19:59 - job_xml_thread(): Done retrieving: data size 43933930
Thu 16 Jan 2014 18:19:59 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:19:59 - XML: Start document: iteration 11
Thu 16 Jan 2014 18:20:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:20:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:20:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:20:07 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:20:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:20:08 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:20:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:20:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:20:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:20:08 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:20:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 18:20:08 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:20:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 18:20:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6128 values 96631 bits 12078 bytes 
Thu 16 Jan 2014 18:20:09 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:20:09 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:20:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:20:09 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:20:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:20:13 - XML: Processed 656048 elements - found 925 jobs
Thu 16 Jan 2014 18:20:13 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 18:20:13 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 18:20:13 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:20:13 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:20:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:20:16 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:20:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:20:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:20:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:20:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:20:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:20:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:20:19 - Leaving storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 18:20:19 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Thu 16 Jan 2014 18:20:19 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:20:19 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:20:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 18:20:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:20:20 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:20:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43950894
Thu 16 Jan 2014 18:20:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:20:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43950894
Thu 16 Jan 2014 18:20:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:20:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:20:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:20:28 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:20:28 - job_xml_thread(): Done retrieving: data size 43950894
Thu 16 Jan 2014 18:20:28 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:20:29 - XML: Start document: iteration 12
Thu 16 Jan 2014 18:20:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:20:31 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:20:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:20:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:20:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:20:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:20:32 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:20:32 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:20:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:20:32 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:20:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:20:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:20:37 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:20:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:20:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:20:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:20:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:20:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:20:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:20:40 - XML: Processed 656044 elements - found 923 jobs
Thu 16 Jan 2014 18:20:40 - job 7346407 appears to have finished
Thu 16 Jan 2014 18:20:40 - job 7346404 appears to have finished
Thu 16 Jan 2014 18:20:40 - job 7346645 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:20:40 - job 7346397 appears to have finished
Thu 16 Jan 2014 18:20:40 - job 7346644 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:20:40 - job 7346583 appears to have finished
Thu 16 Jan 2014 18:20:40 - job 7346643 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:20:40 - job 7346642 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:20:40 - job 7346641 field 'start_timestamp' changed since saved from: 1389892665 to: 1389892626
Thu 16 Jan 2014 18:20:40 - job_xml_thread(): Found 11 updated jobs.
Thu 16 Jan 2014 18:20:40 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 18:20:40 - job_xml_thread(): Done storing. succesfully stored: 11 jobs
Thu 16 Jan 2014 18:20:40 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:20:40 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:20:42 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:20:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43951433
Thu 16 Jan 2014 18:20:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:20:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43951433
Thu 16 Jan 2014 18:20:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:20:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:20:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:20:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:20:51 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:20:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:20:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:20:52 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:20:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:20:52 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:20:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:20:52 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:20:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:20:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:20:55 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:20:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:20:55 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:20:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:20:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:20:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:20:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:20:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:20:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:20:58 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:20:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43964442
Thu 16 Jan 2014 18:20:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:20:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43964442
Thu 16 Jan 2014 18:20:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:20:59 - job_xml_thread(): Done retrieving: data size 43964442
Thu 16 Jan 2014 18:20:59 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:20:59 - XML: Start document: iteration 13
Thu 16 Jan 2014 18:21:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:21:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:21:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:21:09 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:21:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:21:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 18:21:10 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:21:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148566 bits 18570 bytes 
Thu 16 Jan 2014 18:21:10 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:21:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 18:21:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:21:10 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:21:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:21:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:21:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:21:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:21:13 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:21:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:21:13 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:21:13 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:21:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:21:17 - XML: Processed 656044 elements - found 923 jobs
Thu 16 Jan 2014 18:21:17 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 18:21:17 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 18:21:17 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:21:17 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:21:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:21:22 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:21:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:21:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:21:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:21:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:21:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:21:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:21:24 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:21:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43937465
Thu 16 Jan 2014 18:21:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:21:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43937465
Thu 16 Jan 2014 18:21:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:21:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:21:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:21:32 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:21:32 - job_xml_thread(): Done retrieving: data size 43937465
Thu 16 Jan 2014 18:21:32 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:21:32 - XML: Start document: iteration 14
Thu 16 Jan 2014 18:21:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:21:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:21:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:21:38 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:21:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:21:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:21:39 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:21:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:21:39 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:21:39 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:21:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:21:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:21:45 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:21:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:21:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:21:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:21:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:21:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:21:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:21:47 - XML: Processed 656044 elements - found 923 jobs
Thu 16 Jan 2014 18:21:47 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 18:21:47 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 18:21:47 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:21:47 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:21:47 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:21:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 18:21:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:21:48 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:21:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43951775
Thu 16 Jan 2014 18:21:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:21:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43951775
Thu 16 Jan 2014 18:21:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:21:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:21:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:21:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:21:58 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:21:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:21:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:21:59 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:21:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:21:59 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:21:59 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:21:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:22:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:22:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:22:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:22:02 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:22:02 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:22:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:22:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:22:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:22:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:22:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:22:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:22:03 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:22:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43969560
Thu 16 Jan 2014 18:22:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:22:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43969560
Thu 16 Jan 2014 18:22:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:22:04 - job_xml_thread(): Done retrieving: data size 43969560
Thu 16 Jan 2014 18:22:04 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:22:04 - XML: Start document: iteration 15
Thu 16 Jan 2014 18:22:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:22:11 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:22:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:22:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 18:22:13 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:22:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 18:22:13 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:22:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8947 values 141089 bits 17636 bytes 
Thu 16 Jan 2014 18:22:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:22:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:22:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:22:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:22:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:22:24 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:22:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:22:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:22:25 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:22:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:22:25 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:22:25 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:22:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:22:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:22:26 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:22:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:22:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:22:27 - XML: Processed 656036 elements - found 919 jobs
Thu 16 Jan 2014 18:22:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:22:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:22:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:22:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:22:27 - job 7346739 report time 1389892775 does not match current heartbeat 1389892895 : ignoring job
Thu 16 Jan 2014 18:22:27 - job 7346649 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:22:27 - job 7346648 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:22:27 - job 7346646 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:22:27 - job 7343266 appears to have finished
Thu 16 Jan 2014 18:22:27 - job 7346609 appears to have finished
Thu 16 Jan 2014 18:22:27 - job 7337041 appears to have finished
Thu 16 Jan 2014 18:22:27 - job 7346650 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:22:27 - job 7346647 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:22:27 - job 7346604 appears to have finished
Thu 16 Jan 2014 18:22:27 - job_xml_thread(): Found 9 updated jobs.
Thu 16 Jan 2014 18:22:27 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 18:22:27 - job_xml_thread(): Done storing. succesfully stored: 9 jobs
Thu 16 Jan 2014 18:22:27 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:22:27 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:22:29 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:22:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43981580
Thu 16 Jan 2014 18:22:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:22:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43981580
Thu 16 Jan 2014 18:22:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:22:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:22:38 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:22:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:22:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:22:41 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:22:41 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:22:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:22:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:22:41 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:22:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:22:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:22:42 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:22:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:22:43 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:22:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:22:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:22:43 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:22:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 18:22:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:22:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:22:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:22:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:22:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:22:45 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:22:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43983396
Thu 16 Jan 2014 18:22:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:22:45 - job_xml_thread(): Done retrieving: data size 43983396
Thu 16 Jan 2014 18:22:45 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:22:45 - XML: Start document: iteration 16
Thu 16 Jan 2014 18:22:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43983396
Thu 16 Jan 2014 18:22:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:22:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:22:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:22:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:22:57 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:22:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:22:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:22:57 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:22:57 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:22:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:22:57 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:22:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:22:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:22:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:23:04 - XML: Processed 656036 elements - found 919 jobs
Thu 16 Jan 2014 18:23:04 - job 7346739 report time 1389892775 does not match current heartbeat 1389892895 : ignoring job
Thu 16 Jan 2014 18:23:04 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 18:23:04 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 18:23:04 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:23:04 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:23:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:23:07 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:23:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:23:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:23:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:23:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:23:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:23:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:23:09 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:23:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43936018
Thu 16 Jan 2014 18:23:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:23:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43936018
Thu 16 Jan 2014 18:23:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:23:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:23:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:23:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:23:13 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:23:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:23:14 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:23:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 18:23:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 18:23:14 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:23:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8792 values 138602 bits 17325 bytes 
Thu 16 Jan 2014 18:23:17 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Thu 16 Jan 2014 18:23:17 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:23:17 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:23:17 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 18:23:17 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 18:23:17 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:23:17 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 18:23:19 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:23:19 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:23:20 - size of cluster 'LISA Cluster': 624 hosts 79470 metrics 802108 values 12661496 bits 1582687 bytes 
Thu 16 Jan 2014 18:23:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:23:21 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:23:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:23:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:23:21 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:23:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:23:21 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:23:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:23:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:23:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:23:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:23:25 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:23:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:23:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:23:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:23:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:23:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:23:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:23:30 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:23:30 - job_xml_thread(): Done retrieving: data size 43883769
Thu 16 Jan 2014 18:23:30 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:23:30 - XML: Start document: iteration 17
Thu 16 Jan 2014 18:23:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43883769
Thu 16 Jan 2014 18:23:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:23:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43883769
Thu 16 Jan 2014 18:23:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:23:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:23:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:23:37 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:23:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 18:23:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:23:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:23:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:23:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:23:48 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:23:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:23:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:23:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:23:51 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:23:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:23:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:23:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:23:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:23:51 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:23:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:23:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:23:52 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:23:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:23:52 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:23:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:23:53 - XML: Processed 655288 elements - found 919 jobs
Thu 16 Jan 2014 18:23:53 - job 7346739 report time 1389892775 does not match current heartbeat 1389892895 : ignoring job
Thu 16 Jan 2014 18:23:53 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 18:23:53 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 18:23:53 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:23:53 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:23:56 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:23:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43311054
Thu 16 Jan 2014 18:23:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:23:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43311054
Thu 16 Jan 2014 18:23:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:24:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:24:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:24:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:24:08 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:24:08 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:24:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:24:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:24:10 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:24:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:24:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:24:11 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:24:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:24:11 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:24:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:24:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:24:11 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:24:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:24:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:24:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:24:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:24:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:24:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:24:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:24:14 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:24:15 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:24:15 - job_xml_thread(): Done retrieving: data size 43313905
Thu 16 Jan 2014 18:24:15 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:24:15 - XML: Start document: iteration 18
Thu 16 Jan 2014 18:24:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43313905
Thu 16 Jan 2014 18:24:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43313905
Thu 16 Jan 2014 18:24:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:24:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:24:16 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:24:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 18:24:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:24:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 18:24:17 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:24:17 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:24:17 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 18:24:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9368 values 147726 bits 18465 bytes 
Thu 16 Jan 2014 18:24:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:24:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:24:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:24:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:24:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:24:28 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:24:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:24:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:24:30 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:24:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:24:30 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:24:30 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:24:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:24:37 - XML: Processed 647970 elements - found 915 jobs
Thu 16 Jan 2014 18:24:37 - job 7346652 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:24:37 - job 7346648 field 'start_timestamp' changed since saved from: 1389892904 to: 1389892845
Thu 16 Jan 2014 18:24:37 - job 7346415 appears to have finished
Thu 16 Jan 2014 18:24:37 - job 7346410 appears to have finished
Thu 16 Jan 2014 18:24:37 - job 7346411 appears to have finished
Thu 16 Jan 2014 18:24:37 - job 7346654 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:24:37 - job 7346655 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:24:37 - job 7346651 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:24:37 - job 7346653 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:24:38 - job_xml_thread(): Found 9 updated jobs.
Thu 16 Jan 2014 18:24:38 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 18:24:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:24:38 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:24:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:24:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:24:38 - job_xml_thread(): Done storing. succesfully stored: 9 jobs
Thu 16 Jan 2014 18:24:38 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:24:38 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:24:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:24:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:24:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:24:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:24:42 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:24:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43810011
Thu 16 Jan 2014 18:24:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:24:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43810011
Thu 16 Jan 2014 18:24:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:24:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:24:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:24:53 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:24:53 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:24:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:24:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:24:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:24:54 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:24:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:24:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:24:55 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:24:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:24:55 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:24:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:24:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:24:59 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:24:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:24:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:24:59 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:24:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 18:24:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:24:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:24:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:24:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:24:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:25:01 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:25:01 - job_xml_thread(): Done retrieving: data size 43942560
Thu 16 Jan 2014 18:25:01 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:25:01 - XML: Start document: iteration 19
Thu 16 Jan 2014 18:25:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43942560
Thu 16 Jan 2014 18:25:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:25:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43942560
Thu 16 Jan 2014 18:25:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:25:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:25:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:25:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:25:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:25:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:25:17 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:25:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:25:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 18:25:18 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:25:18 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:25:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5771 values 90960 bits 11370 bytes 
Thu 16 Jan 2014 18:25:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 18:25:19 - XML: Processed 655770 elements - found 915 jobs
Thu 16 Jan 2014 18:25:19 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 18:25:19 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 18:25:19 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:25:19 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:25:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:25:21 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:25:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:25:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:25:23 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:25:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:25:23 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:25:23 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:25:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:25:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:25:26 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:25:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:25:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:25:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:25:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:25:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:25:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:25:32 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:25:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43957057
Thu 16 Jan 2014 18:25:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:25:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43957057
Thu 16 Jan 2014 18:25:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:25:34 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:25:34 - job_xml_thread(): Done retrieving: data size 43957057
Thu 16 Jan 2014 18:25:34 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:25:35 - XML: Start document: iteration 20
Thu 16 Jan 2014 18:25:37 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:25:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 18:25:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:25:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:25:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:25:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:25:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:25:47 - XML: Processed 656028 elements - found 915 jobs
Thu 16 Jan 2014 18:25:47 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 18:25:47 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 18:25:47 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:25:47 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:25:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:25:48 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:25:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:25:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:25:48 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:25:48 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:25:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:25:48 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:25:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:25:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:25:52 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:25:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:25:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:25:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:25:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:25:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:25:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:25:56 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:25:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43952193
Thu 16 Jan 2014 18:25:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:25:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43952193
Thu 16 Jan 2014 18:25:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:26:02 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:26:02 - job_xml_thread(): Done retrieving: data size 43952193
Thu 16 Jan 2014 18:26:02 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:26:02 - Housekeeping: checking database for timed out jobs..
Thu 16 Jan 2014 18:26:02 - Housekeeping: Found 0 timed out jobs in database: closing entries
Thu 16 Jan 2014 18:26:02 - Housekeeping: done.
Thu 16 Jan 2014 18:26:02 - XML: Start document: iteration 0
Thu 16 Jan 2014 18:26:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:26:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:26:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:26:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:26:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:26:09 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:26:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:26:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:26:10 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:26:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:26:10 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:26:10 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:26:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:26:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:26:18 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:26:19 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:26:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:26:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 18:26:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 18:26:19 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:26:19 - XML: Processed 656028 elements - found 915 jobs
Thu 16 Jan 2014 18:26:19 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 18:26:19 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 18:26:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6082 values 95891 bits 11986 bytes 
Thu 16 Jan 2014 18:26:19 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:26:19 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:26:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:26:19 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:26:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:26:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:26:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:26:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:26:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:26:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:26:23 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:26:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43928860
Thu 16 Jan 2014 18:26:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:26:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43928860
Thu 16 Jan 2014 18:26:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:26:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:26:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:26:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:26:33 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:26:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:26:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:26:34 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:26:34 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:26:34 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:26:34 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:26:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:26:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:26:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:26:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:26:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:26:37 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:26:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:26:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:26:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:26:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:26:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:26:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:26:39 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:26:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 18:26:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:26:43 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:26:43 - job_xml_thread(): Done retrieving: data size 43960879
Thu 16 Jan 2014 18:26:43 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:26:43 - XML: Start document: iteration 1
Thu 16 Jan 2014 18:26:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43960879
Thu 16 Jan 2014 18:26:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:26:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43960879
Thu 16 Jan 2014 18:26:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:26:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:26:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:26:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:26:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:27:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:27:03 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:27:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:27:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:27:03 - XML: Processed 656018 elements - found 910 jobs
Thu 16 Jan 2014 18:27:03 - job 7346408 appears to have finished
Thu 16 Jan 2014 18:27:04 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:27:04 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:27:04 - job 7346596 appears to have finished
Thu 16 Jan 2014 18:27:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:27:04 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:27:04 - job 7346574 appears to have finished
Thu 16 Jan 2014 18:27:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:27:04 - job 7346656 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:27:04 - job 7346558 appears to have finished
Thu 16 Jan 2014 18:27:04 - job 7343561 appears to have finished
Thu 16 Jan 2014 18:27:04 - job_xml_thread(): Found 6 updated jobs.
Thu 16 Jan 2014 18:27:04 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 18:27:05 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Thu 16 Jan 2014 18:27:05 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:27:05 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:27:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:27:07 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:27:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:27:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:27:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:27:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:27:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:27:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:27:09 - Leaving storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 18:27:09 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Thu 16 Jan 2014 18:27:09 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:27:09 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:27:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43962859
Thu 16 Jan 2014 18:27:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:27:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43962859
Thu 16 Jan 2014 18:27:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:27:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:27:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:27:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:27:20 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:27:20 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:27:20 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:27:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:27:21 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:27:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 18:27:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 18:27:21 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:27:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8678 values 136809 bits 17101 bytes 
Thu 16 Jan 2014 18:27:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:27:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:27:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:27:23 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:27:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:27:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:27:24 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:27:24 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:27:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:27:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:27:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:27:25 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:27:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:27:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:27:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:27:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:27:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:27:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:27:27 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:27:27 - job_xml_thread(): Done retrieving: data size 43949504
Thu 16 Jan 2014 18:27:27 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:27:27 - XML: Start document: iteration 2
Thu 16 Jan 2014 18:27:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43949504
Thu 16 Jan 2014 18:27:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:27:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43949504
Thu 16 Jan 2014 18:27:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:27:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:27:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:27:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:27:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:27:47 - XML: Processed 656018 elements - found 910 jobs
Thu 16 Jan 2014 18:27:47 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 18:27:48 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 18:27:48 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:27:49 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:27:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:27:49 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:27:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:27:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:27:50 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:27:50 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:27:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:27:50 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:27:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:27:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:27:52 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:27:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:27:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:27:52 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:27:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 18:27:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:27:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:27:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:27:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:27:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:27:54 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:27:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43968408
Thu 16 Jan 2014 18:27:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:27:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43968408
Thu 16 Jan 2014 18:27:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:28:04 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:28:04 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:28:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:28:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:28:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:28:05 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:28:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:28:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:28:07 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:28:07 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:28:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:28:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:28:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:28:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:28:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:28:08 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:28:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:28:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:28:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:28:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:28:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:28:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:28:11 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:28:11 - job_xml_thread(): Done retrieving: data size 43965653
Thu 16 Jan 2014 18:28:11 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:28:11 - XML: Start document: iteration 3
Thu 16 Jan 2014 18:28:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43965653
Thu 16 Jan 2014 18:28:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:28:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43965653
Thu 16 Jan 2014 18:28:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:28:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:28:21 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:28:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:28:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:28:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:28:24 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:28:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 18:28:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:28:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:28:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 18:28:25 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:28:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8838 values 139286 bits 17410 bytes 
Thu 16 Jan 2014 18:28:29 - XML: Processed 656017 elements - found 910 jobs
Thu 16 Jan 2014 18:28:29 - job 7346401 appears to have finished
Thu 16 Jan 2014 18:28:29 - job 7346659 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:28:29 - job 7346657 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:28:29 - job 7346658 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:28:29 - job_xml_thread(): Found 5 updated jobs.
Thu 16 Jan 2014 18:28:29 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 18:28:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:28:29 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:28:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:28:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:28:30 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Thu 16 Jan 2014 18:28:30 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:28:30 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:28:31 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:28:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:28:31 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:28:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:28:31 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:28:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:28:34 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:28:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:28:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:28:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:28:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:28:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:28:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:28:36 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:28:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 18:28:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:28:36 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:28:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43968092
Thu 16 Jan 2014 18:28:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:28:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43968092
Thu 16 Jan 2014 18:28:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:28:45 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:28:45 - job_xml_thread(): Done retrieving: data size 43968092
Thu 16 Jan 2014 18:28:45 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:28:45 - XML: Start document: iteration 4
Thu 16 Jan 2014 18:28:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:28:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:28:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:28:47 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:28:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:28:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:28:48 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:28:48 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:28:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:28:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:28:48 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:28:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:28:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:28:55 - XML: Processed 656018 elements - found 910 jobs
Thu 16 Jan 2014 18:28:55 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 18:28:55 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 18:28:55 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:28:55 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:28:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:28:57 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:28:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:28:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:28:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:28:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:28:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:28:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:28:59 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:28:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43941831
Thu 16 Jan 2014 18:28:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:29:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43941831
Thu 16 Jan 2014 18:29:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:29:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:29:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:29:10 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:29:10 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:29:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:29:11 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:29:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:29:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:29:12 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:29:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:29:12 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:29:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:29:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:29:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:29:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:29:14 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:29:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:29:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:29:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:29:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:29:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:29:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:29:17 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:29:17 - job_xml_thread(): Done retrieving: data size 43899674
Thu 16 Jan 2014 18:29:17 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:29:17 - XML: Start document: iteration 5
Thu 16 Jan 2014 18:29:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43899674
Thu 16 Jan 2014 18:29:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:29:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43899674
Thu 16 Jan 2014 18:29:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:29:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:29:24 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:29:25 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:29:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 18:29:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:29:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 18:29:26 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:29:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148529 bits 18566 bytes 
Thu 16 Jan 2014 18:29:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:29:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:29:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:29:29 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:29:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:29:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:29:29 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:29:29 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:29:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:29:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:29:29 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:29:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:29:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:29:36 - XML: Processed 655270 elements - found 910 jobs
Thu 16 Jan 2014 18:29:36 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 18:29:37 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 18:29:37 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:29:37 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:29:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:29:39 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:29:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:29:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:29:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:29:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:29:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:29:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:29:41 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:29:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43430127
Thu 16 Jan 2014 18:29:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:29:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43430127
Thu 16 Jan 2014 18:29:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:29:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:29:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:29:52 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:29:52 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:29:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:29:52 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:29:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:29:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:29:53 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:29:53 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:29:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:29:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:29:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:29:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:29:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:29:57 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:29:57 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:29:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 18:29:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:29:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:29:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:29:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:29:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:29:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:29:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:29:59 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:29:59 - job_xml_thread(): Done retrieving: data size 43298129
Thu 16 Jan 2014 18:29:59 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:29:59 - XML: Start document: iteration 6
Thu 16 Jan 2014 18:29:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43298129
Thu 16 Jan 2014 18:29:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43298129
Thu 16 Jan 2014 18:29:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:29:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:30:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:30:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:30:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:30:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:30:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:30:15 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:30:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:30:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:30:16 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:30:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:30:16 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:30:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:30:16 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:30:18 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Thu 16 Jan 2014 18:30:18 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:30:18 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:30:18 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 18:30:18 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:30:18 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 18:30:18 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 18:30:20 - XML: Processed 647884 elements - found 910 jobs
Thu 16 Jan 2014 18:30:20 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 18:30:20 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 18:30:20 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:30:20 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:30:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:30:22 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 844952 values 13329379 bits 1666172 bytes 
Thu 16 Jan 2014 18:30:22 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:30:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:30:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:30:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:30:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:30:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:30:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:30:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:30:26 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:30:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:30:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 18:30:26 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:30:26 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:30:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5735 values 90415 bits 11301 bytes 
Thu 16 Jan 2014 18:30:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 18:30:27 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:30:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43337538
Thu 16 Jan 2014 18:30:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:30:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43337538
Thu 16 Jan 2014 18:30:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:30:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:30:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:30:35 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:30:35 - job_xml_thread(): Done retrieving: data size 43337538
Thu 16 Jan 2014 18:30:35 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:30:35 - XML: Start document: iteration 7
Thu 16 Jan 2014 18:30:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:30:37 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:30:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:30:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:30:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:30:38 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:30:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:30:38 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:30:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:30:38 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:30:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:30:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:30:46 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:30:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:30:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:30:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:30:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:30:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:30:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:30:50 - XML: Processed 648564 elements - found 909 jobs
Thu 16 Jan 2014 18:30:50 - job 7346406 appears to have finished
Thu 16 Jan 2014 18:30:50 - job 7346419 appears to have finished
Thu 16 Jan 2014 18:30:50 - job 7346660 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:30:50 - job 7326501 appears to have finished
Thu 16 Jan 2014 18:30:50 - job_xml_thread(): Found 6 updated jobs.
Thu 16 Jan 2014 18:30:50 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 18:30:50 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Thu 16 Jan 2014 18:30:50 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:30:50 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:30:53 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:30:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 18:30:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:30:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:30:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:30:53 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:30:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43897577
Thu 16 Jan 2014 18:30:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:30:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43897577
Thu 16 Jan 2014 18:30:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:31:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:31:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:31:05 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:31:05 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:31:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:31:05 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:31:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:31:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:31:06 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:31:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:31:06 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:31:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:31:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:31:09 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:31:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:31:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:31:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:31:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:31:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:31:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:31:12 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:31:12 - job_xml_thread(): Done retrieving: data size 43948927
Thu 16 Jan 2014 18:31:12 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:31:12 - XML: Start document: iteration 8
Thu 16 Jan 2014 18:31:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43948927
Thu 16 Jan 2014 18:31:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:31:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43948927
Thu 16 Jan 2014 18:31:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:31:18 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:31:18 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 18:31:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:31:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:31:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:31:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:31:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:31:26 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:31:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:31:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 18:31:27 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:31:27 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:31:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 18:31:28 - XML: Processed 656016 elements - found 909 jobs
Thu 16 Jan 2014 18:31:28 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 18:31:28 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 18:31:28 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:31:28 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:31:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6799 values 107277 bits 13409 bytes 
Thu 16 Jan 2014 18:31:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:31:29 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:31:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:31:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:31:30 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:31:30 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:31:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:31:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:31:30 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:31:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:31:33 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:31:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:31:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:31:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:31:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:31:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:31:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:31:37 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:31:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43970826
Thu 16 Jan 2014 18:31:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:31:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43970826
Thu 16 Jan 2014 18:31:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:31:44 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:31:45 - job_xml_thread(): Done retrieving: data size 43970826
Thu 16 Jan 2014 18:31:45 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:31:45 - XML: Start document: iteration 9
Thu 16 Jan 2014 18:31:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:31:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:31:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:31:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:31:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:31:52 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:31:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:31:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:31:54 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:31:54 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:31:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:31:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:31:54 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:31:58 - XML: Processed 656013 elements - found 909 jobs
Thu 16 Jan 2014 18:31:58 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 18:31:58 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 18:31:58 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:31:58 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:32:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:32:02 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:32:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:32:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:32:03 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:32:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 18:32:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:32:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:32:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:32:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:32:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:32:06 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:32:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43961120
Thu 16 Jan 2014 18:32:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:32:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43961120
Thu 16 Jan 2014 18:32:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:32:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:32:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:32:13 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:32:13 - job_xml_thread(): Done retrieving: data size 43961120
Thu 16 Jan 2014 18:32:13 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:32:13 - XML: Start document: iteration 10
Thu 16 Jan 2014 18:32:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:32:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:32:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:32:20 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:32:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:32:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:32:21 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:32:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:32:21 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:32:21 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:32:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:32:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:32:27 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:32:27 - XML: Processed 656013 elements - found 909 jobs
Thu 16 Jan 2014 18:32:27 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 18:32:27 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 18:32:27 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:32:27 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:32:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:32:28 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:32:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 18:32:28 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:32:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5897 values 93242 bits 11655 bytes 
Thu 16 Jan 2014 18:32:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 18:32:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:32:29 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:32:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:32:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:32:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:32:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:32:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:32:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:32:32 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:32:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43951532
Thu 16 Jan 2014 18:32:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:32:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43951532
Thu 16 Jan 2014 18:32:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:32:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:32:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:32:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:32:42 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:32:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:32:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:32:43 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:32:43 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:32:43 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:32:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:32:43 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:32:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:32:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:32:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:32:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:32:48 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:32:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:32:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:32:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:32:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:32:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:32:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:32:48 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:32:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 18:32:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:32:51 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:32:51 - job_xml_thread(): Done retrieving: data size 43977421
Thu 16 Jan 2014 18:32:51 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:32:51 - XML: Start document: iteration 11
Thu 16 Jan 2014 18:32:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43977421
Thu 16 Jan 2014 18:32:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:32:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43977421
Thu 16 Jan 2014 18:32:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:32:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:32:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:33:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:33:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:33:05 - XML: Processed 656010 elements - found 906 jobs
Thu 16 Jan 2014 18:33:05 - job 7346417 appears to have finished
Thu 16 Jan 2014 18:33:05 - job 7346413 appears to have finished
Thu 16 Jan 2014 18:33:05 - job 7346665 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:33:05 - job 7346662 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:33:05 - job 7346661 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:33:05 - job 7346621 appears to have finished
Thu 16 Jan 2014 18:33:05 - job 7346603 appears to have finished
Thu 16 Jan 2014 18:33:05 - job 7346664 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:33:06 - job 7346663 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:33:06 - job_xml_thread(): Found 10 updated jobs.
Thu 16 Jan 2014 18:33:06 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 18:33:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:33:11 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:33:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:33:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:33:12 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:33:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:33:12 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:33:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:33:12 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:33:12 - job_xml_thread(): Done storing. succesfully stored: 10 jobs
Thu 16 Jan 2014 18:33:12 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:33:12 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:33:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:33:14 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:33:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:33:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:33:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:33:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:33:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:33:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:33:18 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:33:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43968372
Thu 16 Jan 2014 18:33:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:33:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43968372
Thu 16 Jan 2014 18:33:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:33:27 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:33:27 - job_xml_thread(): Done retrieving: data size 43968372
Thu 16 Jan 2014 18:33:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:33:27 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:33:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:33:27 - XML: Start document: iteration 12
Thu 16 Jan 2014 18:33:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:33:28 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:33:29 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:33:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:33:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 18:33:29 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:33:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8615 values 136190 bits 17023 bytes 
Thu 16 Jan 2014 18:33:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 18:33:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:33:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:33:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:33:36 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:33:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:33:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:33:36 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:33:36 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:33:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:33:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:33:37 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:33:40 - XML: Processed 656010 elements - found 906 jobs
Thu 16 Jan 2014 18:33:40 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 18:33:40 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 18:33:40 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:33:40 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:33:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:33:41 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:33:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:33:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:33:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:33:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:33:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:33:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:33:45 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:33:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43954512
Thu 16 Jan 2014 18:33:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:33:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43954512
Thu 16 Jan 2014 18:33:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:33:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:33:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:33:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:33:54 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:33:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:33:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:33:54 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:33:54 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:33:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:33:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:33:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43954512
Thu 16 Jan 2014 18:33:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:33:55 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:33:55 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:33:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:33:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:34:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:34:02 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:34:03 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:34:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 18:34:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:34:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:34:07 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:34:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:34:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:34:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:34:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:34:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:34:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:34:08 - Leaving storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 18:34:08 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Thu 16 Jan 2014 18:34:08 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:34:09 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:34:09 - job_xml_thread(): Done retrieving: data size 43934641
Thu 16 Jan 2014 18:34:09 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:34:09 - XML: Start document: iteration 13
Thu 16 Jan 2014 18:34:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:34:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:34:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43934641
Thu 16 Jan 2014 18:34:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:34:10 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:34:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:34:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43934641
Thu 16 Jan 2014 18:34:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:34:10 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:34:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:34:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:34:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:34:23 - XML: Processed 656010 elements - found 906 jobs
Thu 16 Jan 2014 18:34:23 - job 7346667 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:34:24 - job 7346668 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:34:24 - job 7346732 report time 1389893499 does not match current heartbeat 1389893620 : ignoring job
Thu 16 Jan 2014 18:34:24 - job 7346666 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:34:24 - job 7346745 field 'start_timestamp' changed since saved from: 1389893500 to: 1389893498
Thu 16 Jan 2014 18:34:24 - job_xml_thread(): Found 4 updated jobs.
Thu 16 Jan 2014 18:34:24 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 18:34:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:34:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:34:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:34:30 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:34:30 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Thu 16 Jan 2014 18:34:30 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:34:30 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:34:30 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:34:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:34:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 18:34:30 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:34:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 18:34:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6077 values 95907 bits 11988 bytes 
Thu 16 Jan 2014 18:34:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:34:31 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:34:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:34:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:34:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:34:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:34:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:34:32 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:34:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:34:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:34:32 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:34:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:34:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:34:33 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:34:33 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:34:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:34:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:34:35 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:34:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43986683
Thu 16 Jan 2014 18:34:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:34:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43986683
Thu 16 Jan 2014 18:34:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:34:45 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:34:45 - job_xml_thread(): Done retrieving: data size 43986683
Thu 16 Jan 2014 18:34:45 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:34:45 - XML: Start document: iteration 14
Thu 16 Jan 2014 18:34:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:34:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:34:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:34:48 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:34:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:34:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:34:49 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:34:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:34:49 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:34:49 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:34:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:34:55 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:34:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 18:34:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:34:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:34:57 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:34:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:34:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:34:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:34:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:34:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:34:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:34:58 - XML: Processed 656004 elements - found 903 jobs
Thu 16 Jan 2014 18:34:58 - job 7346414 appears to have finished
Thu 16 Jan 2014 18:34:58 - job 7346628 appears to have finished
Thu 16 Jan 2014 18:34:58 - job 7346732 report time 1389893499 does not match current heartbeat 1389893620 : ignoring job
Thu 16 Jan 2014 18:34:58 - job 7346744 appears to have finished
Thu 16 Jan 2014 18:34:58 - job_xml_thread(): Found 3 updated jobs.
Thu 16 Jan 2014 18:34:58 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 18:34:58 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Thu 16 Jan 2014 18:34:58 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:34:58 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:35:00 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:35:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43940061
Thu 16 Jan 2014 18:35:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:35:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43940061
Thu 16 Jan 2014 18:35:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:35:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:35:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:35:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:35:10 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:35:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:35:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:35:11 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:35:11 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:35:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:35:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:35:12 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:35:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:35:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:35:13 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:35:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:35:14 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:35:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:35:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:35:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:35:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:35:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:35:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:35:16 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:35:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43900270
Thu 16 Jan 2014 18:35:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:35:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43900270
Thu 16 Jan 2014 18:35:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:35:17 - job_xml_thread(): Done retrieving: data size 43900270
Thu 16 Jan 2014 18:35:17 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:35:17 - XML: Start document: iteration 15
Thu 16 Jan 2014 18:35:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:35:26 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:35:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:35:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:35:28 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:35:28 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:35:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:35:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:35:28 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:35:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:35:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:35:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:35:30 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:35:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:35:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 18:35:32 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:35:32 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:35:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 18:35:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9168 values 144656 bits 18082 bytes 
Thu 16 Jan 2014 18:35:34 - XML: Processed 655256 elements - found 903 jobs
Thu 16 Jan 2014 18:35:34 - job 7346732 report time 1389893499 does not match current heartbeat 1389893620 : ignoring job
Thu 16 Jan 2014 18:35:34 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 18:35:34 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 18:35:34 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:35:34 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:35:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:35:37 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:35:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:35:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:35:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:35:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:35:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:35:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:35:39 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:35:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 18:35:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:35:40 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:35:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43405635
Thu 16 Jan 2014 18:35:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:35:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43405635
Thu 16 Jan 2014 18:35:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:35:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:35:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:35:49 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:35:49 - job_xml_thread(): Done retrieving: data size 43405635
Thu 16 Jan 2014 18:35:49 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:35:49 - XML: Start document: iteration 16
Thu 16 Jan 2014 18:35:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:35:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:35:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:35:54 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:35:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:35:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:35:55 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:35:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:35:55 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:35:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:35:55 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:35:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:35:59 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:35:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:35:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:35:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:35:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:35:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:35:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:36:02 - XML: Processed 649382 elements - found 903 jobs
Thu 16 Jan 2014 18:36:02 - job 7346732 report time 1389893499 does not match current heartbeat 1389893620 : ignoring job
Thu 16 Jan 2014 18:36:02 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 18:36:02 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 18:36:02 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:36:02 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:36:03 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:36:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43290752
Thu 16 Jan 2014 18:36:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:36:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43290752
Thu 16 Jan 2014 18:36:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:36:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:36:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:36:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:36:11 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:36:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:36:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:36:13 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:36:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:36:13 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:36:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43290752
Thu 16 Jan 2014 18:36:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:36:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:36:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:36:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:36:17 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:36:17 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:36:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:36:23 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:36:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:36:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:36:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:36:24 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:36:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:36:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:36:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:36:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:36:26 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:36:26 - job_xml_thread(): Done retrieving: data size 43352182
Thu 16 Jan 2014 18:36:26 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:36:26 - XML: Start document: iteration 17
Thu 16 Jan 2014 18:36:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43352182
Thu 16 Jan 2014 18:36:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:36:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:36:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:36:30 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:36:30 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:36:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:36:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:36:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43352182
Thu 16 Jan 2014 18:36:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:36:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:36:32 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:36:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:36:32 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:36:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 18:36:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 18:36:33 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:36:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6529 values 103037 bits 12879 bytes 
Thu 16 Jan 2014 18:36:37 - XML: Processed 648548 elements - found 900 jobs
Thu 16 Jan 2014 18:36:37 - job 7346671 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:36:37 - job 7346424 appears to have finished
Thu 16 Jan 2014 18:36:37 - job 7346422 appears to have finished
Thu 16 Jan 2014 18:36:37 - job 7346670 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:36:37 - job 7346669 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:36:37 - job 7346668 field 'start_timestamp' changed since saved from: 1389893664 to: 1389893602
Thu 16 Jan 2014 18:36:37 - job 7346624 appears to have finished
Thu 16 Jan 2014 18:36:37 - job_xml_thread(): Found 8 updated jobs.
Thu 16 Jan 2014 18:36:37 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 18:36:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:36:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:36:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:36:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:36:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:36:47 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:36:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:36:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:36:47 - job_xml_thread(): Done storing. succesfully stored: 8 jobs
Thu 16 Jan 2014 18:36:47 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:36:47 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:36:48 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:36:48 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:36:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:36:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:36:48 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:36:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:36:49 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:36:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:36:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:36:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:36:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:36:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:36:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:36:51 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:36:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43917338
Thu 16 Jan 2014 18:36:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:36:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43917338
Thu 16 Jan 2014 18:36:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:37:02 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:37:02 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:37:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:37:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:37:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:37:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:37:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:37:06 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:37:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:37:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:37:06 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:37:06 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:37:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:37:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:37:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:37:07 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:37:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:37:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:37:07 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:37:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 18:37:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:37:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:37:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:37:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:37:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:37:09 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:37:09 - job_xml_thread(): Done retrieving: data size 43971620
Thu 16 Jan 2014 18:37:09 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:37:09 - XML: Start document: iteration 18
Thu 16 Jan 2014 18:37:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43971620
Thu 16 Jan 2014 18:37:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:37:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43971620
Thu 16 Jan 2014 18:37:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:37:18 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Thu 16 Jan 2014 18:37:18 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:37:21 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:37:21 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:37:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:37:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:37:21 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 18:37:21 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 18:37:22 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 18:37:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:37:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:37:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:37:25 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:37:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:37:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Thu 16 Jan 2014 18:37:28 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:37:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:37:28 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:37:28 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:37:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:37:29 - XML: Processed 655982 elements - found 900 jobs
Thu 16 Jan 2014 18:37:29 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 18:37:29 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 18:37:29 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:37:29 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:37:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:37:32 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:37:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:37:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:37:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:37:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:37:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:37:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:37:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:37:33 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:37:33 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:37:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:37:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 18:37:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 18:37:33 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:37:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5961 values 94057 bits 11757 bytes 
Thu 16 Jan 2014 18:37:34 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:37:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43957153
Thu 16 Jan 2014 18:37:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:37:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43957153
Thu 16 Jan 2014 18:37:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:37:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:37:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:37:44 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:37:44 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:37:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:37:45 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:37:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:37:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:37:45 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:37:45 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:37:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:37:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:37:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:37:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:37:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:37:48 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:37:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:37:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:37:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:37:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:37:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:37:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:37:50 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:37:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 18:37:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:37:50 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:37:50 - job_xml_thread(): Done retrieving: data size 43962213
Thu 16 Jan 2014 18:37:50 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:37:50 - XML: Start document: iteration 19
Thu 16 Jan 2014 18:37:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43962213
Thu 16 Jan 2014 18:37:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:37:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43962213
Thu 16 Jan 2014 18:37:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:38:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:38:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:38:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:38:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:38:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:38:04 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:38:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:38:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:38:05 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:38:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:38:05 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:38:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:38:05 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:38:12 - XML: Processed 655998 elements - found 900 jobs
Thu 16 Jan 2014 18:38:12 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 18:38:12 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 18:38:12 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:38:12 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:38:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:38:13 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:38:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:38:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:38:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:38:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:38:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:38:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:38:15 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:38:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43939858
Thu 16 Jan 2014 18:38:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:38:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43939858
Thu 16 Jan 2014 18:38:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:38:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:38:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:38:22 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:38:22 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:38:24 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:38:24 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:38:24 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 18:38:24 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 18:38:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:38:24 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 18:38:25 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:38:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:38:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:38:26 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:38:26 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:38:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:38:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:38:26 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:38:27 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:38:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:38:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:38:29 - size of cluster 'LISA Cluster': 624 hosts 79483 metrics 923906 values 14587751 bits 1823468 bytes 
Thu 16 Jan 2014 18:38:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:38:30 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:38:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:38:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:38:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:38:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:38:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:38:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:38:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:38:33 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:38:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:38:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 18:38:33 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:38:33 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:38:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7307 values 115237 bits 14404 bytes 
Thu 16 Jan 2014 18:38:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 18:38:34 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:38:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43952922
Thu 16 Jan 2014 18:38:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:38:35 - job_xml_thread(): Done retrieving: data size 43952922
Thu 16 Jan 2014 18:38:35 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:38:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43952922
Thu 16 Jan 2014 18:38:35 - XML: Start document: iteration 20
Thu 16 Jan 2014 18:38:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:38:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:38:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:38:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:38:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:38:48 - XML: Processed 655992 elements - found 897 jobs
Thu 16 Jan 2014 18:38:48 - job 7346421 appears to have finished
Thu 16 Jan 2014 18:38:48 - job 7346420 appears to have finished
Thu 16 Jan 2014 18:38:48 - job 7346439 appears to have finished
Thu 16 Jan 2014 18:38:48 - job 7346745 appears to have finished
Thu 16 Jan 2014 18:38:48 - job_xml_thread(): Found 5 updated jobs.
Thu 16 Jan 2014 18:38:48 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 18:38:51 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Thu 16 Jan 2014 18:38:51 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:38:51 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:38:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:38:53 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:38:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:38:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:38:55 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:38:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:38:55 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:38:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:38:55 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:38:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:38:57 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:38:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:38:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:38:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:38:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:38:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:38:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:39:00 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:39:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 18:39:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:39:01 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:39:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43949295
Thu 16 Jan 2014 18:39:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:39:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43949295
Thu 16 Jan 2014 18:39:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:39:06 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:39:06 - job_xml_thread(): Done retrieving: data size 43949295
Thu 16 Jan 2014 18:39:06 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:39:06 - Housekeeping: checking database for timed out jobs..
Thu 16 Jan 2014 18:39:06 - Housekeeping: Found 0 timed out jobs in database: closing entries
Thu 16 Jan 2014 18:39:06 - Housekeeping: done.
Thu 16 Jan 2014 18:39:06 - XML: Start document: iteration 0
Thu 16 Jan 2014 18:39:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:39:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:39:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:39:10 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:39:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:39:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:39:11 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:39:11 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:39:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:39:11 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:39:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:39:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:39:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:39:20 - XML: Processed 655992 elements - found 897 jobs
Thu 16 Jan 2014 18:39:21 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 18:39:21 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 18:39:21 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:39:21 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:39:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:39:24 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:39:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:39:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:39:24 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:39:24 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 18:39:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:39:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:39:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:39:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:39:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:39:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:39:27 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:39:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43932511
Thu 16 Jan 2014 18:39:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:39:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43932511
Thu 16 Jan 2014 18:39:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:39:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:39:33 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:39:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:39:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 18:39:34 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:39:34 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:39:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 18:39:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6894 values 108754 bits 13594 bytes 
Thu 16 Jan 2014 18:39:36 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:39:36 - job_xml_thread(): Done retrieving: data size 43932511
Thu 16 Jan 2014 18:39:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:39:36 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:39:36 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:39:36 - XML: Start document: iteration 1
Thu 16 Jan 2014 18:39:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:39:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:39:37 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:39:37 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:39:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:39:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:39:38 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:39:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:39:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:39:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:39:47 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:39:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:39:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:39:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:39:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:39:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:39:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:39:50 - XML: Processed 655992 elements - found 897 jobs
Thu 16 Jan 2014 18:39:50 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 18:39:50 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 18:39:50 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:39:50 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:39:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:39:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:39:54 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:39:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43930205
Thu 16 Jan 2014 18:39:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:39:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43930205
Thu 16 Jan 2014 18:39:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:40:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:40:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:40:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:40:04 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:40:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:40:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:40:05 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:40:05 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:40:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:40:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:40:05 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:40:05 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:40:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:40:10 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:40:10 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:40:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 18:40:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:40:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:40:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:40:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:40:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:40:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:40:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:40:13 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:40:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43951097
Thu 16 Jan 2014 18:40:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:40:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43951097
Thu 16 Jan 2014 18:40:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:40:14 - job_xml_thread(): Done retrieving: data size 43951097
Thu 16 Jan 2014 18:40:15 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:40:15 - XML: Start document: iteration 2
Thu 16 Jan 2014 18:40:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:40:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:40:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:40:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:40:34 - XML: Processed 655990 elements - found 896 jobs
Thu 16 Jan 2014 18:40:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:40:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:40:35 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:40:35 - job 7346674 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:40:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:40:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:40:35 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:40:35 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:40:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:40:35 - job 7346672 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:40:35 - job 7346673 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:40:35 - job 7346675 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:40:35 - job 7345056 appears to have finished
Thu 16 Jan 2014 18:40:35 - job 7346676 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:40:35 - job_xml_thread(): Found 6 updated jobs.
Thu 16 Jan 2014 18:40:35 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 18:40:35 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Thu 16 Jan 2014 18:40:35 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:40:35 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:40:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:40:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:40:35 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:40:35 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:40:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:40:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:40:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:40:35 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:40:35 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:40:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 18:40:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 18:40:35 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:40:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5934 values 93621 bits 11702 bytes 
Thu 16 Jan 2014 18:40:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:40:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:40:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:40:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:40:40 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:40:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43977391
Thu 16 Jan 2014 18:40:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:40:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43977391
Thu 16 Jan 2014 18:40:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:40:50 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:40:50 - job_xml_thread(): Done retrieving: data size 43977391
Thu 16 Jan 2014 18:40:50 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:40:50 - XML: Start document: iteration 3
Thu 16 Jan 2014 18:40:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:40:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:40:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:40:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:40:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:40:53 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:40:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:40:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:40:55 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:40:55 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:40:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:40:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:40:55 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:41:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:41:04 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:41:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:41:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:41:05 - XML: Processed 655990 elements - found 896 jobs
Thu 16 Jan 2014 18:41:05 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 18:41:05 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 18:41:05 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:41:05 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:41:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:41:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:41:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:41:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:41:05 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:41:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 18:41:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:41:09 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:41:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43938925
Thu 16 Jan 2014 18:41:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:41:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43938925
Thu 16 Jan 2014 18:41:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:41:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:41:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:41:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:41:18 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:41:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:41:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:41:19 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:41:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:41:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43938925
Thu 16 Jan 2014 18:41:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:41:19 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:41:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:41:20 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:41:20 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:41:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:41:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:41:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:41:30 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:41:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:41:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:41:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:41:30 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:41:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:41:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:41:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:41:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:41:31 - Leaving storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 18:41:31 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Thu 16 Jan 2014 18:41:31 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:41:33 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:41:33 - job_xml_thread(): Done retrieving: data size 43838575
Thu 16 Jan 2014 18:41:33 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:41:33 - XML: Start document: iteration 4
Thu 16 Jan 2014 18:41:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43838575
Thu 16 Jan 2014 18:41:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:41:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:41:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:41:35 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:41:35 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:41:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:41:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:41:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43838575
Thu 16 Jan 2014 18:41:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:41:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:41:36 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:41:38 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:41:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:41:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 18:41:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 18:41:39 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:41:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7994 values 126019 bits 15752 bytes 
Thu 16 Jan 2014 18:41:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:41:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:41:47 - XML: Processed 654966 elements - found 896 jobs
Thu 16 Jan 2014 18:41:47 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 18:41:47 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 18:41:48 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:41:48 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:41:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:41:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:41:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:41:55 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:41:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:41:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:41:56 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:41:56 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:41:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:41:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:41:56 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:41:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:41:57 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:41:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:41:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:41:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:41:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:41:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:41:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:41:59 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:41:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 18:41:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:41:59 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:41:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43292797
Thu 16 Jan 2014 18:41:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:42:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43292797
Thu 16 Jan 2014 18:42:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:42:03 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:42:03 - job_xml_thread(): Done retrieving: data size 43292797
Thu 16 Jan 2014 18:42:03 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:42:03 - XML: Start document: iteration 5
Thu 16 Jan 2014 18:42:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:42:11 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:42:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:42:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:42:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:42:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:42:12 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:42:12 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:42:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:42:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:42:12 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:42:22 - XML: Processed 647790 elements - found 896 jobs
Thu 16 Jan 2014 18:42:22 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 18:42:22 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 18:42:22 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:42:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:42:22 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:42:22 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:42:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:42:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:42:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:42:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:42:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:42:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:42:24 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:42:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43347156
Thu 16 Jan 2014 18:42:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:42:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43347156
Thu 16 Jan 2014 18:42:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:42:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:42:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:42:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:42:34 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:42:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:42:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:42:35 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:42:35 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:42:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:42:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:42:35 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:42:37 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:42:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:42:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:42:38 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:42:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:42:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:42:38 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:42:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:42:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:42:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:42:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 18:42:38 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:42:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99074 bits 12384 bytes 
Thu 16 Jan 2014 18:42:38 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:42:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 18:42:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:42:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:42:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:42:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:42:41 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:42:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43760825
Thu 16 Jan 2014 18:42:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:42:42 - job_xml_thread(): Done retrieving: data size 43760825
Thu 16 Jan 2014 18:42:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43760825
Thu 16 Jan 2014 18:42:42 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:42:42 - XML: Start document: iteration 6
Thu 16 Jan 2014 18:42:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:42:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:42:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:42:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:42:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:42:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:42:57 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:42:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:42:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:42:59 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:42:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:42:59 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:42:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:42:59 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:42:59 - XML: Processed 653242 elements - found 894 jobs
Thu 16 Jan 2014 18:43:00 - job 7346678 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:43:00 - job 7346677 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:43:00 - job 7346637 appears to have finished
Thu 16 Jan 2014 18:43:00 - job 7346441 appears to have finished
Thu 16 Jan 2014 18:43:00 - job 7346446 appears to have finished
Thu 16 Jan 2014 18:43:00 - job 7346676 field 'start_timestamp' changed since saved from: 1389893995 to: 1389893975
Thu 16 Jan 2014 18:43:00 - job 7346713 appears to have finished
Thu 16 Jan 2014 18:43:00 - job_xml_thread(): Found 9 updated jobs.
Thu 16 Jan 2014 18:43:00 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 18:43:03 - job_xml_thread(): Done storing. succesfully stored: 9 jobs
Thu 16 Jan 2014 18:43:03 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:43:03 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:43:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:43:04 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:43:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:43:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:43:04 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:43:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 18:43:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:43:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:43:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:43:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:43:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:43:07 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:43:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43945720
Thu 16 Jan 2014 18:43:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:43:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43945720
Thu 16 Jan 2014 18:43:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:43:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:43:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:43:18 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:43:18 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:43:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:43:19 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:43:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:43:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:43:20 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:43:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:43:20 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:43:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:43:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:43:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:43:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:43:22 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:43:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:43:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:43:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:43:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:43:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:43:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:43:26 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:43:26 - job_xml_thread(): Done retrieving: data size 43966071
Thu 16 Jan 2014 18:43:26 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:43:26 - XML: Start document: iteration 7
Thu 16 Jan 2014 18:43:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43966071
Thu 16 Jan 2014 18:43:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43966071
Thu 16 Jan 2014 18:43:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:43:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:43:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:43:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:43:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:43:39 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:43:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:43:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:43:39 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:43:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:43:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 18:43:39 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:43:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 18:43:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8800 values 138709 bits 17338 bytes 
Thu 16 Jan 2014 18:43:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:43:42 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:43:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:43:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:43:43 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:43:43 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:43:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:43:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:43:43 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:43:48 - XML: Processed 655986 elements - found 894 jobs
Thu 16 Jan 2014 18:43:48 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 18:43:48 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 18:43:48 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:43:49 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:43:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:43:50 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:43:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:43:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:43:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:43:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:43:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:43:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:43:52 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:43:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43942961
Thu 16 Jan 2014 18:43:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:43:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43942961
Thu 16 Jan 2014 18:43:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:43:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:43:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:44:04 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:44:04 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:44:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:44:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:44:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:44:06 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:44:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:44:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:44:07 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:44:07 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:44:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:44:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:44:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:44:08 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:44:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:44:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:44:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:44:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:44:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:44:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:44:09 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:44:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 18:44:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:44:10 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:44:10 - job_xml_thread(): Done retrieving: data size 43975553
Thu 16 Jan 2014 18:44:10 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:44:10 - XML: Start document: iteration 8
Thu 16 Jan 2014 18:44:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43975553
Thu 16 Jan 2014 18:44:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43975553
Thu 16 Jan 2014 18:44:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:44:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:44:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:44:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:44:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:44:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:44:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:44:25 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:44:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:44:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:44:26 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:44:26 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:44:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:44:26 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:44:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:44:33 - XML: Processed 655986 elements - found 894 jobs
Thu 16 Jan 2014 18:44:33 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 18:44:33 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 18:44:33 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:44:33 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:44:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:44:34 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:44:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:44:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:44:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:44:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:44:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:44:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:44:36 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:44:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43939940
Thu 16 Jan 2014 18:44:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:44:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43939940
Thu 16 Jan 2014 18:44:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:44:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:44:40 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:44:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:44:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:44:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:44:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 18:44:42 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:44:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 18:44:42 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:44:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8632 values 136101 bits 17012 bytes 
Thu 16 Jan 2014 18:44:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:44:47 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:44:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:44:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:44:47 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:44:47 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:44:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:44:47 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:44:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:44:49 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:44:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:44:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:44:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:44:50 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:44:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:44:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:44:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:44:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:44:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:44:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:44:52 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:44:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43970239
Thu 16 Jan 2014 18:44:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:44:53 - job_xml_thread(): Done retrieving: data size 43970239
Thu 16 Jan 2014 18:44:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43970239
Thu 16 Jan 2014 18:44:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:44:53 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:44:53 - XML: Start document: iteration 9
Thu 16 Jan 2014 18:45:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:45:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:45:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:45:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:45:11 - XML: Processed 655982 elements - found 892 jobs
Thu 16 Jan 2014 18:45:11 - job 7346544 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:45:11 - job 7346725 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:45:11 - job 7346643 appears to have finished
Thu 16 Jan 2014 18:45:11 - job 7346642 appears to have finished
Thu 16 Jan 2014 18:45:11 - job_xml_thread(): Found 4 updated jobs.
Thu 16 Jan 2014 18:45:11 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 18:45:13 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Thu 16 Jan 2014 18:45:13 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:45:13 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:45:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:45:14 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:45:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:45:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:45:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:45:16 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:45:16 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:45:16 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:45:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:45:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:45:16 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:45:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:45:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:45:17 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:45:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 18:45:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:45:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:45:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:45:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:45:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:45:18 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:45:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43953239
Thu 16 Jan 2014 18:45:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:45:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43953239
Thu 16 Jan 2014 18:45:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:45:24 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Thu 16 Jan 2014 18:45:25 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:45:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:45:26 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:45:27 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:45:27 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:45:27 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 18:45:27 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 18:45:27 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 18:45:28 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:45:28 - XMLGatherer.retrieveData(): actually retrieving data..
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Thu 16 Jan 2014 18:45:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:45:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:45:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:45:32 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:45:32 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:45:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:45:32 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:45:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:45:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:45:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:45:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:45:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:45:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:45:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:45:34 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:45:34 - job_xml_thread(): Done retrieving: data size 43946639
Thu 16 Jan 2014 18:45:34 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:45:34 - XML: Start document: iteration 10
Thu 16 Jan 2014 18:45:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43946639
Thu 16 Jan 2014 18:45:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:45:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43946639
Thu 16 Jan 2014 18:45:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:45:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:45:42 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:45:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:45:43 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:45:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 18:45:43 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:45:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8707 values 137261 bits 17157 bytes 
Thu 16 Jan 2014 18:45:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 18:45:44 - XML: Processed 655982 elements - found 892 jobs
Thu 16 Jan 2014 18:45:45 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 18:45:45 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 18:45:45 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:45:45 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:45:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:45:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:45:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:45:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:45:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:45:52 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:45:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:45:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:45:53 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:45:53 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:45:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:45:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:45:53 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:45:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:45:54 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:45:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:45:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:45:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:45:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:45:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:45:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:45:57 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:45:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43983128
Thu 16 Jan 2014 18:45:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:45:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43983128
Thu 16 Jan 2014 18:45:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:46:00 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:46:00 - job_xml_thread(): Done retrieving: data size 43983128
Thu 16 Jan 2014 18:46:01 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:46:01 - XML: Start document: iteration 11
Thu 16 Jan 2014 18:46:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:46:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:46:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:46:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:46:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:46:17 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:46:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:46:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:46:19 - XML: Processed 655982 elements - found 892 jobs
Thu 16 Jan 2014 18:46:19 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 18:46:19 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 18:46:19 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:46:19 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:46:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:46:19 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:46:19 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:46:19 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:46:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:46:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:46:20 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:46:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:46:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:46:20 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:46:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 18:46:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:46:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:46:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:46:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:46:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:46:22 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:46:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43961754
Thu 16 Jan 2014 18:46:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:46:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43961754
Thu 16 Jan 2014 18:46:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:46:28 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:46:28 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:46:30 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:46:30 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 18:46:30 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 18:46:30 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:46:30 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 18:46:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:46:33 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:46:34 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:46:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:46:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:46:34 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:46:36 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:46:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:46:36 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:46:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:46:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:46:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:46:37 - size of cluster 'LISA Cluster': 624 hosts 79482 metrics 942692 values 14876870 bits 1859608 bytes 
Thu 16 Jan 2014 18:46:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:46:39 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:46:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:46:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:46:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:46:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:46:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:46:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:46:42 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:46:42 - job_xml_thread(): Done retrieving: data size 43966802
Thu 16 Jan 2014 18:46:42 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:46:42 - XML: Start document: iteration 12
Thu 16 Jan 2014 18:46:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43966802
Thu 16 Jan 2014 18:46:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:46:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43966802
Thu 16 Jan 2014 18:46:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:46:43 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:46:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:46:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:46:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 18:46:46 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:46:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9018 values 142474 bits 17809 bytes 
Thu 16 Jan 2014 18:46:46 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:46:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 18:46:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:46:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:46:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:46:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:47:01 - XML: Processed 655978 elements - found 890 jobs
Thu 16 Jan 2014 18:47:01 - job 7346748 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:47:01 - job 7344326 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:47:01 - job 7344327 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:47:01 - job 7344328 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:47:01 - job 7345062 appears to have finished
Thu 16 Jan 2014 18:47:01 - job 7346544 field 'start_timestamp' changed since saved from: 1389894226 to: 1389894200
Thu 16 Jan 2014 18:47:01 - job 7346617 appears to have finished
Thu 16 Jan 2014 18:47:01 - job_xml_thread(): Found 7 updated jobs.
Thu 16 Jan 2014 18:47:01 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 18:47:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:47:01 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:47:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:47:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:47:02 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:47:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:47:02 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:47:02 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:47:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:47:03 - job_xml_thread(): Done storing. succesfully stored: 7 jobs
Thu 16 Jan 2014 18:47:03 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:47:03 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:47:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:47:07 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:47:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:47:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:47:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:47:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:47:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:47:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:47:11 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:47:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43954665
Thu 16 Jan 2014 18:47:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:47:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43954665
Thu 16 Jan 2014 18:47:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:47:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:47:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:47:18 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:47:18 - job_xml_thread(): Done retrieving: data size 43954665
Thu 16 Jan 2014 18:47:18 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:47:18 - XML: Start document: iteration 13
Thu 16 Jan 2014 18:47:21 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:47:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 18:47:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:47:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:47:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:47:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:47:23 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:47:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:47:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:47:24 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:47:24 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:47:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:47:24 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:47:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:47:30 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:47:30 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 18:47:34 - XML: Processed 655978 elements - found 890 jobs
Thu 16 Jan 2014 18:47:34 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 18:47:34 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 18:47:34 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:47:34 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:47:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:47:35 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:47:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:47:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:47:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:47:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:47:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:47:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:47:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:47:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:47:39 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:47:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43719886
Thu 16 Jan 2014 18:47:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:47:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43719886
Thu 16 Jan 2014 18:47:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:47:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:47:46 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:47:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:47:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 18:47:47 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:47:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6224 values 98467 bits 12308 bytes 
Thu 16 Jan 2014 18:47:48 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:47:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 18:47:50 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:47:50 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:47:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:47:50 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:47:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:47:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:47:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:47:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:47:51 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:47:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:47:51 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:47:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:47:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:47:56 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:47:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:47:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:47:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:47:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:47:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:47:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:48:00 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:48:00 - job_xml_thread(): Done retrieving: data size 43304291
Thu 16 Jan 2014 18:48:00 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:48:00 - XML: Start document: iteration 14
Thu 16 Jan 2014 18:48:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43304291
Thu 16 Jan 2014 18:48:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:48:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43304291
Thu 16 Jan 2014 18:48:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:48:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:48:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:48:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:48:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:48:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:48:17 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:48:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:48:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:48:18 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:48:18 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:48:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:48:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:48:18 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:48:24 - XML: Processed 647838 elements - found 890 jobs
Thu 16 Jan 2014 18:48:24 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 18:48:24 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 18:48:24 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:48:24 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:48:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:48:25 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:48:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:48:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:48:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:48:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:48:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:48:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:48:25 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:48:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 18:48:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:48:29 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:48:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43349851
Thu 16 Jan 2014 18:48:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:48:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43349851
Thu 16 Jan 2014 18:48:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:48:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:48:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:48:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:48:37 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:48:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:48:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:48:38 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:48:38 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:48:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:48:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:48:39 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:48:40 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:48:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:48:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:48:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:48:42 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:48:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:48:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:48:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:48:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:48:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:48:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:48:46 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:48:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43844475
Thu 16 Jan 2014 18:48:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:48:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43844475
Thu 16 Jan 2014 18:48:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:48:47 - job_xml_thread(): Done retrieving: data size 43844475
Thu 16 Jan 2014 18:48:47 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:48:47 - XML: Start document: iteration 15
Thu 16 Jan 2014 18:48:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:48:48 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:48:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:48:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 18:48:49 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:48:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8819 values 139195 bits 17399 bytes 
Thu 16 Jan 2014 18:48:50 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:48:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 18:48:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:48:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:48:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:48:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:49:08 - XML: Processed 654388 elements - found 886 jobs
Thu 16 Jan 2014 18:49:08 - job 7344326 field 'start_timestamp' changed since saved from: 1389894356 to: 1389894333
Thu 16 Jan 2014 18:49:08 - job 7344329 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:49:08 - job 7346727 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:49:08 - job 7346650 appears to have finished
Thu 16 Jan 2014 18:49:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:49:08 - job 7346502 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:49:08 - job 7346726 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:49:08 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:49:08 - job 7346653 appears to have finished
Thu 16 Jan 2014 18:49:08 - job 7346004 appears to have finished
Thu 16 Jan 2014 18:49:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:49:09 - job 7346500 report time 1389894345 does not match current heartbeat 1389894465 : ignoring job
Thu 16 Jan 2014 18:49:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:49:09 - job 7346501 report time 1389894345 does not match current heartbeat 1389894465 : ignoring job
Thu 16 Jan 2014 18:49:09 - job 7344330 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:49:09 - job 7346436 appears to have finished
Thu 16 Jan 2014 18:49:09 - job_xml_thread(): Found 10 updated jobs.
Thu 16 Jan 2014 18:49:09 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 18:49:09 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:49:09 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:49:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:49:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:49:09 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:49:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:49:10 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:49:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:49:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:49:10 - job_xml_thread(): Done storing. succesfully stored: 10 jobs
Thu 16 Jan 2014 18:49:10 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:49:10 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:49:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:49:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:49:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:49:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:49:12 - Leaving storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 18:49:12 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Thu 16 Jan 2014 18:49:12 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:49:14 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:49:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43967988
Thu 16 Jan 2014 18:49:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:49:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43967988
Thu 16 Jan 2014 18:49:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:49:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:49:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:49:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:49:24 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:49:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:49:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:49:25 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:49:25 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:49:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:49:25 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:49:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:49:25 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:49:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:49:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:49:28 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:49:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 18:49:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:49:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:49:29 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:49:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:49:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:49:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:49:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:49:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:49:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:49:31 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:49:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43970535
Thu 16 Jan 2014 18:49:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:49:32 - job_xml_thread(): Done retrieving: data size 43970535
Thu 16 Jan 2014 18:49:32 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:49:32 - XML: Start document: iteration 16
Thu 16 Jan 2014 18:49:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43970535
Thu 16 Jan 2014 18:49:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:49:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:49:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:49:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:49:45 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:49:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:49:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:49:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:49:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:49:46 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:49:46 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:49:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:49:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:49:46 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:49:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:49:50 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:49:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:49:50 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:49:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 18:49:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 18:49:50 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:49:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6096 values 96183 bits 12022 bytes 
Thu 16 Jan 2014 18:49:53 - XML: Processed 655965 elements - found 886 jobs
Thu 16 Jan 2014 18:49:53 - job 7346500 report time 1389894345 does not match current heartbeat 1389894465 : ignoring job
Thu 16 Jan 2014 18:49:53 - job 7346501 report time 1389894345 does not match current heartbeat 1389894465 : ignoring job
Thu 16 Jan 2014 18:49:53 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 18:49:53 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 18:49:53 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:49:53 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:49:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:49:55 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:49:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:49:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:49:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:49:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:49:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:49:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:49:57 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:49:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43934763
Thu 16 Jan 2014 18:49:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:49:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43934763
Thu 16 Jan 2014 18:49:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:50:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:50:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:50:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:50:08 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:50:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:50:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:50:08 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:50:08 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:50:09 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:50:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:50:09 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:50:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:50:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:50:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:50:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:50:11 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:50:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:50:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:50:12 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:50:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 18:50:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:50:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:50:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:50:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:50:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:50:13 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:50:13 - job_xml_thread(): Done retrieving: data size 43971736
Thu 16 Jan 2014 18:50:13 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:50:13 - XML: Start document: iteration 17
Thu 16 Jan 2014 18:50:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43971736
Thu 16 Jan 2014 18:50:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:50:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43971736
Thu 16 Jan 2014 18:50:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:50:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:50:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:50:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:50:27 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:50:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:50:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:50:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:50:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:50:29 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:50:29 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:50:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:50:29 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:50:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:50:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:50:35 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:50:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:50:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:50:36 - XML: Processed 655958 elements - found 880 jobs
Thu 16 Jan 2014 18:50:36 - job 7346368 appears to have finished
Thu 16 Jan 2014 18:50:36 - job 7346416 appears to have finished
Thu 16 Jan 2014 18:50:36 - job 7346623 appears to have finished
Thu 16 Jan 2014 18:50:36 - job 7346658 appears to have finished
Thu 16 Jan 2014 18:50:36 - job_xml_thread(): Found 4 updated jobs.
Thu 16 Jan 2014 18:50:36 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 18:50:36 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Thu 16 Jan 2014 18:50:36 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:50:36 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:50:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:50:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:50:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:50:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:50:38 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:50:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43939097
Thu 16 Jan 2014 18:50:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:50:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43939097
Thu 16 Jan 2014 18:50:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:50:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:50:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:50:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:50:50 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:50:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:50:51 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:50:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 18:50:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 18:50:51 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:50:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8975 values 141552 bits 17694 bytes 
Thu 16 Jan 2014 18:50:51 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:50:51 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:50:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:50:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:50:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:50:52 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:50:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:50:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:50:53 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:50:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:50:53 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:50:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:50:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:50:54 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:50:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:50:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:50:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:50:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:50:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:50:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:50:57 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:50:57 - job_xml_thread(): Done retrieving: data size 43961059
Thu 16 Jan 2014 18:50:57 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:50:57 - XML: Start document: iteration 18
Thu 16 Jan 2014 18:50:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43961059
Thu 16 Jan 2014 18:50:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:50:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43961059
Thu 16 Jan 2014 18:50:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:51:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:51:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:51:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:51:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:51:10 - XML: Processed 655966 elements - found 884 jobs
Thu 16 Jan 2014 18:51:10 - job 7346503 report time 1389894465 does not match current heartbeat 1389894586 : ignoring job
Thu 16 Jan 2014 18:51:10 - job 7346456 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:51:10 - job 7346504 report time 1389894465 does not match current heartbeat 1389894586 : ignoring job
Thu 16 Jan 2014 18:51:10 - job_xml_thread(): Found 5 updated jobs.
Thu 16 Jan 2014 18:51:10 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 18:51:11 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Thu 16 Jan 2014 18:51:11 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:51:11 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:51:15 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:51:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 18:51:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:51:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:51:16 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:51:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:51:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:51:18 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:51:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:51:18 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:51:18 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:51:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:51:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:51:20 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:51:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:51:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:51:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:51:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:51:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:51:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:51:22 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:51:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43946625
Thu 16 Jan 2014 18:51:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:51:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43946625
Thu 16 Jan 2014 18:51:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:51:26 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:51:26 - job_xml_thread(): Done retrieving: data size 43946625
Thu 16 Jan 2014 18:51:26 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:51:26 - XML: Start document: iteration 19
Thu 16 Jan 2014 18:51:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:51:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:51:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:51:35 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:51:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:51:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:51:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:51:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:51:36 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:51:36 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:51:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:51:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:51:36 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:51:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:51:42 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:51:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:51:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:51:43 - XML: Processed 655966 elements - found 884 jobs
Thu 16 Jan 2014 18:51:43 - job 7346503 report time 1389894465 does not match current heartbeat 1389894586 : ignoring job
Thu 16 Jan 2014 18:51:43 - job 7346504 report time 1389894465 does not match current heartbeat 1389894586 : ignoring job
Thu 16 Jan 2014 18:51:43 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 18:51:43 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 18:51:43 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:51:43 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:51:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:51:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:51:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:51:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:51:45 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:51:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43960903
Thu 16 Jan 2014 18:51:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:51:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43960903
Thu 16 Jan 2014 18:51:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:51:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:51:51 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:51:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:51:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:51:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:51:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 18:51:51 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:51:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9267 values 146163 bits 18270 bytes 
Thu 16 Jan 2014 18:51:52 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:51:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 18:51:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:51:54 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:51:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:51:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:51:55 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:51:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:51:55 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:51:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:51:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43960903
Thu 16 Jan 2014 18:51:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:51:58 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:51:58 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:51:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:51:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:52:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:52:08 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:52:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:52:08 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:52:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:52:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:52:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:52:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:52:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:52:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:52:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:52:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:52:10 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:52:10 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:52:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:52:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:52:11 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:52:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 18:52:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:52:12 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:52:12 - job_xml_thread(): Done retrieving: data size 43934242
Thu 16 Jan 2014 18:52:12 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:52:12 - XML: Start document: iteration 20
Thu 16 Jan 2014 18:52:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43934242
Thu 16 Jan 2014 18:52:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43934242
Thu 16 Jan 2014 18:52:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:52:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:52:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:52:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:52:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:52:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:52:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:52:28 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:52:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:52:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:52:29 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:52:29 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:52:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:52:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:52:29 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:52:29 - XML: Processed 655966 elements - found 884 jobs
Thu 16 Jan 2014 18:52:29 - job 7346503 report time 1389894465 does not match current heartbeat 1389894586 : ignoring job
Thu 16 Jan 2014 18:52:29 - job 7346504 report time 1389894465 does not match current heartbeat 1389894586 : ignoring job
Thu 16 Jan 2014 18:52:30 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 18:52:30 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 18:52:30 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:52:30 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:52:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:52:34 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:52:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:52:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:52:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:52:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:52:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:52:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:52:36 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:52:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43938077
Thu 16 Jan 2014 18:52:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:52:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43938077
Thu 16 Jan 2014 18:52:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:52:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:52:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:52:45 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:52:45 - job_xml_thread(): Done retrieving: data size 43938077
Thu 16 Jan 2014 18:52:45 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:52:45 - Housekeeping: checking database for timed out jobs..
Thu 16 Jan 2014 18:52:45 - Housekeeping: Found 0 timed out jobs in database: closing entries
Thu 16 Jan 2014 18:52:45 - Housekeeping: done.
Thu 16 Jan 2014 18:52:45 - XML: Start document: iteration 0
Thu 16 Jan 2014 18:52:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:52:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:52:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:52:52 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:52:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:52:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:52:52 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:52:52 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:52:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:52:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:52:52 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:52:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:52:52 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:52:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:52:52 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:52:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:52:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:52:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:52:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:52:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:52:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:52:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:52:53 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:52:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 18:52:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 18:52:53 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:52:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6349 values 100178 bits 12522 bytes 
Thu 16 Jan 2014 18:52:56 - XML: Processed 655962 elements - found 882 jobs
Thu 16 Jan 2014 18:52:56 - job 7346537 report time 1389894586 does not match current heartbeat 1389894707 : ignoring job
Thu 16 Jan 2014 18:52:56 - job 7346536 report time 1389894586 does not match current heartbeat 1389894707 : ignoring job
Thu 16 Jan 2014 18:52:56 - job 7346363 appears to have finished
Thu 16 Jan 2014 18:52:56 - job 7346456 field 'start_timestamp' changed since saved from: 1389894590 to: 1389894531
Thu 16 Jan 2014 18:52:56 - job 7346502 appears to have finished
Thu 16 Jan 2014 18:52:56 - job 7346539 report time 1389894586 does not match current heartbeat 1389894707 : ignoring job
Thu 16 Jan 2014 18:52:56 - job 7346538 report time 1389894586 does not match current heartbeat 1389894707 : ignoring job
Thu 16 Jan 2014 18:52:56 - job 7346532 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:52:56 - job 7346531 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:52:56 - job 7346530 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:52:56 - job_xml_thread(): Found 8 updated jobs.
Thu 16 Jan 2014 18:52:56 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 18:52:56 - job_xml_thread(): Done storing. succesfully stored: 8 jobs
Thu 16 Jan 2014 18:52:56 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:52:56 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:52:58 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:52:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43961759
Thu 16 Jan 2014 18:52:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:52:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43961759
Thu 16 Jan 2014 18:52:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:53:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:53:07 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:53:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:53:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:53:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:53:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:53:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:53:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:53:08 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:53:08 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:53:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:53:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:53:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43961759
Thu 16 Jan 2014 18:53:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:53:11 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:53:11 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:53:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:53:21 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:53:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:53:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:53:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:53:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:53:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:53:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:53:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:53:22 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:53:22 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:53:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 18:53:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:53:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:53:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:53:24 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:53:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:53:24 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:53:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:53:24 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:53:24 - job_xml_thread(): Done retrieving: data size 43851695
Thu 16 Jan 2014 18:53:24 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:53:24 - XML: Start document: iteration 1
Thu 16 Jan 2014 18:53:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851695
Thu 16 Jan 2014 18:53:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:53:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851695
Thu 16 Jan 2014 18:53:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:53:30 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Thu 16 Jan 2014 18:53:30 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:53:32 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:53:32 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 18:53:32 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:53:32 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 18:53:32 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 18:53:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:53:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:53:37 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:53:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:53:38 - size of cluster 'LISA Cluster': 624 hosts 79466 metrics 847684 values 13390953 bits 1673869 bytes 
Thu 16 Jan 2014 18:53:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:53:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:53:40 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:53:40 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:53:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:53:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:53:40 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:53:43 - XML: Processed 655214 elements - found 882 jobs
Thu 16 Jan 2014 18:53:43 - job 7346539 report time 1389894586 does not match current heartbeat 1389894707 : ignoring job
Thu 16 Jan 2014 18:53:43 - job 7346538 report time 1389894586 does not match current heartbeat 1389894707 : ignoring job
Thu 16 Jan 2014 18:53:43 - job 7346537 report time 1389894586 does not match current heartbeat 1389894707 : ignoring job
Thu 16 Jan 2014 18:53:43 - job 7346536 report time 1389894586 does not match current heartbeat 1389894707 : ignoring job
Thu 16 Jan 2014 18:53:43 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 18:53:43 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 18:53:43 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:53:43 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:53:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:53:48 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:53:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:53:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:53:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:53:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:53:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:53:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:53:51 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:53:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43332427
Thu 16 Jan 2014 18:53:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:53:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43332427
Thu 16 Jan 2014 18:53:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:53:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:53:53 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:53:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:53:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 18:53:55 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:53:55 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:53:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 18:53:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8888 values 140101 bits 17512 bytes 
Thu 16 Jan 2014 18:53:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:53:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:53:58 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:53:58 - job_xml_thread(): Done retrieving: data size 43332427
Thu 16 Jan 2014 18:53:58 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:53:58 - XML: Start document: iteration 2
Thu 16 Jan 2014 18:54:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:54:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:54:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:54:05 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:54:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:54:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:54:06 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:54:06 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:54:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:54:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:54:06 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:54:12 - XML: Processed 648598 elements - found 882 jobs
Thu 16 Jan 2014 18:54:12 - job 7346539 report time 1389894586 does not match current heartbeat 1389894707 : ignoring job
Thu 16 Jan 2014 18:54:12 - job 7346538 report time 1389894586 does not match current heartbeat 1389894707 : ignoring job
Thu 16 Jan 2014 18:54:12 - job 7346537 report time 1389894586 does not match current heartbeat 1389894707 : ignoring job
Thu 16 Jan 2014 18:54:12 - job 7346536 report time 1389894586 does not match current heartbeat 1389894707 : ignoring job
Thu 16 Jan 2014 18:54:12 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 18:54:12 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 18:54:12 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:54:12 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:54:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:54:13 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:54:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:54:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:54:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:54:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:54:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:54:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:54:16 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:54:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43295017
Thu 16 Jan 2014 18:54:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:54:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43295017
Thu 16 Jan 2014 18:54:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:54:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:54:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:54:28 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:54:28 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:54:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:54:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:54:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:54:28 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:54:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:54:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:54:29 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:54:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:54:29 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:54:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:54:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:54:32 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:54:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:54:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:54:32 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:54:32 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 18:54:32 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:54:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 18:54:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:54:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:54:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:54:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:54:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:54:35 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:54:35 - job_xml_thread(): Done retrieving: data size 43679793
Thu 16 Jan 2014 18:54:35 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:54:35 - XML: Start document: iteration 3
Thu 16 Jan 2014 18:54:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43679793
Thu 16 Jan 2014 18:54:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43679793
Thu 16 Jan 2014 18:54:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:54:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:54:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:54:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:54:46 - XML: Processed 652664 elements - found 872 jobs
Thu 16 Jan 2014 18:54:46 - job 7346746 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:54:46 - job 7346748 appears to have finished
Thu 16 Jan 2014 18:54:46 - job 7346754 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:54:46 - job 7346660 appears to have finished
Thu 16 Jan 2014 18:54:46 - job 7346712 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:54:46 - job 7346685 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:54:46 - job 7346540 report time 1389894707 does not match current heartbeat 1389894828 : ignoring job
Thu 16 Jan 2014 18:54:46 - job 7346755 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:54:46 - job 7346427 appears to have finished
Thu 16 Jan 2014 18:54:46 - job 7346657 appears to have finished
Thu 16 Jan 2014 18:54:46 - job 7346728 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:54:47 - job 7346534 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:54:47 - job 7346533 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:54:47 - job 7346532 field 'start_timestamp' changed since saved from: 1389894742 to: 1389894677
Thu 16 Jan 2014 18:54:47 - job 7346625 appears to have finished
Thu 16 Jan 2014 18:54:47 - job 7346438 appears to have finished
Thu 16 Jan 2014 18:54:47 - job_xml_thread(): Found 15 updated jobs.
Thu 16 Jan 2014 18:54:47 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 18:54:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:54:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:54:52 - job_xml_thread(): Done storing. succesfully stored: 15 jobs
Thu 16 Jan 2014 18:54:52 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:54:52 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:54:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:54:53 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:54:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:54:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:54:54 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:54:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:54:54 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:54:54 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:54:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:54:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:54:55 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:54:56 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:54:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 18:54:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:54:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 18:54:56 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:54:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5694 values 89738 bits 11217 bytes 
Thu 16 Jan 2014 18:54:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:54:56 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:54:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:54:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:54:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:54:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:54:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:54:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:55:02 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:55:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43950203
Thu 16 Jan 2014 18:55:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:55:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43950203
Thu 16 Jan 2014 18:55:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:55:08 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:55:08 - job_xml_thread(): Done retrieving: data size 43950203
Thu 16 Jan 2014 18:55:08 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:55:08 - XML: Start document: iteration 4
Thu 16 Jan 2014 18:55:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:55:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:55:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:55:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:55:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:55:12 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:55:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:55:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:55:13 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:55:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:55:13 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:55:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:55:13 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:55:20 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:55:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 18:55:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:55:22 - XML: Processed 655840 elements - found 872 jobs
Thu 16 Jan 2014 18:55:22 - job 7346540 report time 1389894707 does not match current heartbeat 1389894828 : ignoring job
Thu 16 Jan 2014 18:55:22 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 18:55:22 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 18:55:22 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:55:22 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:55:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:55:24 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:55:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:55:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:55:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:55:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:55:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:55:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:55:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:55:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:55:28 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:55:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43910594
Thu 16 Jan 2014 18:55:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:55:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43910594
Thu 16 Jan 2014 18:55:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:55:37 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:55:37 - job_xml_thread(): Done retrieving: data size 43910594
Thu 16 Jan 2014 18:55:37 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:55:37 - XML: Start document: iteration 5
Thu 16 Jan 2014 18:55:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:55:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:55:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:55:44 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:55:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:55:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:55:46 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:55:46 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:55:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:55:47 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:55:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:55:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:55:47 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:55:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:55:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:55:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:55:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:55:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:55:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:55:50 - XML: Processed 655942 elements - found 872 jobs
Thu 16 Jan 2014 18:55:50 - job 7346540 report time 1389894707 does not match current heartbeat 1389894828 : ignoring job
Thu 16 Jan 2014 18:55:50 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 18:55:50 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 18:55:50 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:55:50 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:55:53 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:55:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43930332
Thu 16 Jan 2014 18:55:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:55:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43930332
Thu 16 Jan 2014 18:55:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:55:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:55:56 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:55:57 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:55:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:55:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 18:55:57 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:55:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8947 values 141098 bits 17637 bytes 
Thu 16 Jan 2014 18:55:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 18:56:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:56:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:56:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:56:03 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:56:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:56:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:56:04 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:56:04 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:56:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:56:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:56:04 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:56:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:56:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:56:05 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:56:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:56:10 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:56:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:56:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:56:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:56:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:56:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:56:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:56:14 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:56:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43939552
Thu 16 Jan 2014 18:56:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:56:14 - job_xml_thread(): Done retrieving: data size 43939552
Thu 16 Jan 2014 18:56:14 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:56:14 - XML: Start document: iteration 6
Thu 16 Jan 2014 18:56:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43939552
Thu 16 Jan 2014 18:56:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:56:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:56:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:56:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:56:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:56:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:56:34 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:56:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:56:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:56:35 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:56:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:56:35 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:56:35 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:56:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:56:36 - XML: Processed 655942 elements - found 872 jobs
Thu 16 Jan 2014 18:56:36 - job 7346540 report time 1389894707 does not match current heartbeat 1389894828 : ignoring job
Thu 16 Jan 2014 18:56:36 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 18:56:36 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 18:56:36 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:56:36 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:56:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:56:38 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:56:38 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:56:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 18:56:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:56:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:56:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:56:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:56:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:56:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:56:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:56:42 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:56:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43947966
Thu 16 Jan 2014 18:56:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:56:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43947966
Thu 16 Jan 2014 18:56:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:56:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:56:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:56:51 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:56:52 - job_xml_thread(): Done retrieving: data size 43947966
Thu 16 Jan 2014 18:56:52 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:56:52 - XML: Start document: iteration 7
Thu 16 Jan 2014 18:56:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:56:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:56:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:56:57 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:56:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:56:57 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:56:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 18:56:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 18:56:58 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:56:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5793 values 91338 bits 11417 bytes 
Thu 16 Jan 2014 18:56:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:56:59 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:56:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:56:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:57:00 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:57:00 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:57:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:57:00 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:57:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:57:04 - XML: Processed 655932 elements - found 867 jobs
Thu 16 Jan 2014 18:57:04 - job 7346679 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:57:04 - job 7346747 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:57:04 - job 7346443 appears to have finished
Thu 16 Jan 2014 18:57:04 - job 7346440 appears to have finished
Thu 16 Jan 2014 18:57:04 - job 7346717 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:57:04 - job 7346541 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:57:04 - job 7346662 appears to have finished
Thu 16 Jan 2014 18:57:05 - job 7346718 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:57:05 - job 7346716 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:57:05 - job 7346647 appears to have finished
Thu 16 Jan 2014 18:57:05 - job 7346464 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:57:05 - job 7346719 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:57:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:57:05 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:57:05 - job_xml_thread(): Found 12 updated jobs.
Thu 16 Jan 2014 18:57:05 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 18:57:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:57:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:57:05 - job_xml_thread(): Done storing. succesfully stored: 12 jobs
Thu 16 Jan 2014 18:57:05 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:57:05 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:57:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:57:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:57:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:57:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:57:09 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:57:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43932079
Thu 16 Jan 2014 18:57:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:57:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43932079
Thu 16 Jan 2014 18:57:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:57:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:57:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:57:21 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:57:21 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:57:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:57:21 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:57:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:57:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:57:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:57:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:57:22 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:57:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:57:22 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:57:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:57:25 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:57:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 18:57:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:57:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:57:26 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:57:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:57:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:57:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:57:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:57:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:57:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:57:27 - Leaving storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 18:57:27 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Thu 16 Jan 2014 18:57:27 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:57:29 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:57:29 - job_xml_thread(): Done retrieving: data size 43943634
Thu 16 Jan 2014 18:57:29 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:57:29 - XML: Start document: iteration 8
Thu 16 Jan 2014 18:57:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43943634
Thu 16 Jan 2014 18:57:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43943634
Thu 16 Jan 2014 18:57:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:57:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:57:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:57:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:57:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:57:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:57:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:57:45 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:57:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:57:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:57:46 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:57:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:57:46 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:57:46 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:57:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:57:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:57:49 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:57:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:57:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:57:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:57:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:57:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:57:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:57:51 - XML: Processed 655932 elements - found 867 jobs
Thu 16 Jan 2014 18:57:51 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 18:57:51 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 18:57:51 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:57:51 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:57:52 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:57:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43948219
Thu 16 Jan 2014 18:57:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:57:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43948219
Thu 16 Jan 2014 18:57:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:57:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:57:58 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:57:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:58:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 18:58:00 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:58:00 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:58:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 18:58:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:58:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9016 values 142237 bits 17779 bytes 
Thu 16 Jan 2014 18:58:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:58:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:58:02 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:58:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:58:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:58:03 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:58:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:58:03 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:58:03 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:58:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:58:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:58:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:58:06 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:58:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:58:07 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:58:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:58:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:58:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:58:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:58:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:58:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:58:09 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:58:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43938702
Thu 16 Jan 2014 18:58:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:58:10 - job_xml_thread(): Done retrieving: data size 43938702
Thu 16 Jan 2014 18:58:10 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:58:10 - XML: Start document: iteration 9
Thu 16 Jan 2014 18:58:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43938702
Thu 16 Jan 2014 18:58:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:58:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:58:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:58:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:58:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:58:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:58:30 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:58:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:58:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:58:32 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:58:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:58:32 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:58:32 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:58:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:58:33 - XML: Processed 655932 elements - found 867 jobs
Thu 16 Jan 2014 18:58:33 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 18:58:33 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 18:58:33 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:58:33 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:58:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:58:34 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:58:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:58:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:58:34 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:58:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 18:58:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:58:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:58:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:58:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:58:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:58:36 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:58:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43952986
Thu 16 Jan 2014 18:58:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:58:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43952986
Thu 16 Jan 2014 18:58:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:58:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:58:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:58:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:58:47 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:58:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:58:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:58:48 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:58:48 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:58:48 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:58:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:58:48 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:58:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:58:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:58:49 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:58:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:58:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:58:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:58:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:58:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:58:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:58:51 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:58:51 - job_xml_thread(): Done retrieving: data size 43951825
Thu 16 Jan 2014 18:58:51 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:58:51 - XML: Start document: iteration 10
Thu 16 Jan 2014 18:58:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43951825
Thu 16 Jan 2014 18:58:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:58:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43951825
Thu 16 Jan 2014 18:58:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:59:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:59:00 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:59:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:59:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 18:59:01 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:59:01 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:59:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 18:59:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8880 values 140007 bits 17500 bytes 
Thu 16 Jan 2014 18:59:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:59:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:59:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:59:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:59:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:59:10 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:59:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:59:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:59:11 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:59:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:59:11 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:59:11 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:59:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:59:13 - XML: Processed 655918 elements - found 860 jobs
Thu 16 Jan 2014 18:59:13 - job 7346671 appears to have finished
Thu 16 Jan 2014 18:59:13 - job 7346470 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:59:13 - job 7344537 appears to have finished
Thu 16 Jan 2014 18:59:13 - job 7346717 field 'start_timestamp' changed since saved from: 1389894977 to: 1389894907
Thu 16 Jan 2014 18:59:13 - job 7346541 field 'start_timestamp' changed since saved from: 1389894985 to: 1389894942
Thu 16 Jan 2014 18:59:13 - job 7346667 appears to have finished
Thu 16 Jan 2014 18:59:13 - job 7346567 appears to have finished
Thu 16 Jan 2014 18:59:13 - job 7346351 appears to have finished
Thu 16 Jan 2014 18:59:13 - job 7346455 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:59:13 - job 7346554 appears to have finished
Thu 16 Jan 2014 18:59:13 - job 7346468 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:59:13 - job 7346460 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:59:13 - job 7346552 appears to have finished
Thu 16 Jan 2014 18:59:13 - job 7346469 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:59:13 - job 7346465 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:59:13 - job 7346464 field 'start_timestamp' changed since saved from: 1389895011 to: 1389894938
Thu 16 Jan 2014 18:59:13 - job 7346467 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:59:13 - job 7346466 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 18:59:13 - job 7346719 field 'start_timestamp' changed since saved from: 1389894981 to: 1389894914
Thu 16 Jan 2014 18:59:13 - job 7346523 report time 1389894948 does not match current heartbeat 1389895069 : ignoring job
Thu 16 Jan 2014 18:59:13 - job_xml_thread(): Found 19 updated jobs.
Thu 16 Jan 2014 18:59:13 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 18:59:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:59:14 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:59:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:59:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:59:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:59:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:59:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:59:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:59:14 - job_xml_thread(): Done storing. succesfully stored: 19 jobs
Thu 16 Jan 2014 18:59:14 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:59:14 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:59:16 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:59:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43894613
Thu 16 Jan 2014 18:59:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:59:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43894613
Thu 16 Jan 2014 18:59:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:59:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:59:25 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:59:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:59:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:59:27 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:59:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:59:27 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:59:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:59:27 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:59:29 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 18:59:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:59:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:59:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:59:30 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:59:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:59:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:59:30 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 18:59:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 18:59:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:59:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:59:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:59:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:59:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:59:32 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:59:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43474418
Thu 16 Jan 2014 18:59:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:59:32 - job_xml_thread(): Done retrieving: data size 43474418
Thu 16 Jan 2014 18:59:32 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 18:59:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43474418
Thu 16 Jan 2014 18:59:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 18:59:33 - XML: Start document: iteration 11
Thu 16 Jan 2014 18:59:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 18:59:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:59:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 18:59:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 18:59:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 18:59:50 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 18:59:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 18:59:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 18:59:52 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:59:52 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 18:59:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 18:59:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 18:59:52 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 18:59:55 - XML: Processed 649964 elements - found 860 jobs
Thu 16 Jan 2014 18:59:55 - job 7346523 report time 1389894948 does not match current heartbeat 1389895069 : ignoring job
Thu 16 Jan 2014 18:59:55 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 18:59:55 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 18:59:55 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 18:59:55 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 18:59:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 18:59:56 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 18:59:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 18:59:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 18:59:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:59:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 18:59:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 18:59:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 18:59:57 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 18:59:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43276188
Thu 16 Jan 2014 18:59:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 18:59:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43276188
Thu 16 Jan 2014 18:59:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:00:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:00:01 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:00:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:00:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 19:00:02 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:00:02 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:00:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 19:00:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9224 values 145528 bits 18191 bytes 
Thu 16 Jan 2014 19:00:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:00:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:00:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:00:08 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:00:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:00:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:00:09 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:00:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:00:09 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:00:09 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:00:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:00:10 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:00:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:00:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:00:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:00:12 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:00:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:00:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:00:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:00:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:00:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:00:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:00:15 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:00:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43340342
Thu 16 Jan 2014 19:00:15 - job_xml_thread(): Done retrieving: data size 43340342
Thu 16 Jan 2014 19:00:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:00:15 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:00:15 - XML: Start document: iteration 12
Thu 16 Jan 2014 19:00:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43340342
Thu 16 Jan 2014 19:00:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:00:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:00:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:00:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:00:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:00:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:00:29 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:00:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:00:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:00:30 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:00:30 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:00:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:00:30 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:00:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:00:32 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Thu 16 Jan 2014 19:00:32 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:00:33 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:00:33 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 19:00:33 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 19:00:33 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:00:33 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 19:00:34 - XML: Processed 648348 elements - found 860 jobs
Thu 16 Jan 2014 19:00:35 - job 7346523 report time 1389894948 does not match current heartbeat 1389895069 : ignoring job
Thu 16 Jan 2014 19:00:35 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 19:00:35 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 19:00:35 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:00:35 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:00:38 - size of cluster 'LISA Cluster': 624 hosts 79481 metrics 865896 values 13663891 bits 1707986 bytes 
Thu 16 Jan 2014 19:00:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:00:39 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:00:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:00:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:00:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:00:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:00:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:00:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:00:40 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:00:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 19:00:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:00:43 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:00:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43787989
Thu 16 Jan 2014 19:00:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:00:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43787989
Thu 16 Jan 2014 19:00:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:00:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:00:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:00:50 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:00:50 - job_xml_thread(): Done retrieving: data size 43787989
Thu 16 Jan 2014 19:00:50 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:00:50 - XML: Start document: iteration 13
Thu 16 Jan 2014 19:00:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:00:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:00:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:00:56 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:00:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:00:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:00:57 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:00:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:00:57 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:00:57 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:00:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:01:03 - XML: Processed 654422 elements - found 849 jobs
Thu 16 Jan 2014 19:01:03 - job 7346672 appears to have finished
Thu 16 Jan 2014 19:01:03 - job 7346472 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:01:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:01:03 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:01:03 - job 7346473 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:01:03 - job 7346471 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:01:03 - job 7346570 appears to have finished
Thu 16 Jan 2014 19:01:03 - job 7346746 appears to have finished
Thu 16 Jan 2014 19:01:03 - job 7346747 appears to have finished
Thu 16 Jan 2014 19:01:03 - job 7346474 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:01:03 - job 7346587 appears to have finished
Thu 16 Jan 2014 19:01:03 - job 7346455 field 'start_timestamp' changed since saved from: 1389895083 to: 1389895028
Thu 16 Jan 2014 19:01:03 - job 7346551 appears to have finished
Thu 16 Jan 2014 19:01:03 - job 7346670 appears to have finished
Thu 16 Jan 2014 19:01:03 - job 7346460 field 'start_timestamp' changed since saved from: 1389895093 to: 1389895055
Thu 16 Jan 2014 19:01:03 - job 7346462 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:01:03 - job 7346532 appears to have finished
Thu 16 Jan 2014 19:01:03 - job 7346531 appears to have finished
Thu 16 Jan 2014 19:01:03 - job 7346530 appears to have finished
Thu 16 Jan 2014 19:01:03 - job_xml_thread(): Found 17 updated jobs.
Thu 16 Jan 2014 19:01:04 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 19:01:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:01:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 19:01:05 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:01:05 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:01:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 19:01:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5721 values 90178 bits 11272 bytes 
Thu 16 Jan 2014 19:01:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:01:05 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:01:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:01:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:01:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:01:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:01:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:01:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:01:05 - job_xml_thread(): Done storing. succesfully stored: 17 jobs
Thu 16 Jan 2014 19:01:05 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:01:05 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:01:09 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:01:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43905942
Thu 16 Jan 2014 19:01:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:01:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43905942
Thu 16 Jan 2014 19:01:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:01:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:01:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:01:21 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:01:21 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:01:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:01:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:01:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:01:23 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:01:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:01:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:01:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:01:24 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:01:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:01:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:01:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:01:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:01:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:01:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:01:25 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:01:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:01:25 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:01:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:01:25 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:01:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 19:01:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:01:29 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:01:29 - job_xml_thread(): Done retrieving: data size 43931034
Thu 16 Jan 2014 19:01:29 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:01:29 - XML: Start document: iteration 14
Thu 16 Jan 2014 19:01:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43931034
Thu 16 Jan 2014 19:01:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:01:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43931034
Thu 16 Jan 2014 19:01:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:01:33 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:01:33 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 19:01:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:01:39 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:01:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:01:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:01:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:01:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:01:41 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:01:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:01:41 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:01:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:01:41 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:01:49 - XML: Processed 655896 elements - found 849 jobs
Thu 16 Jan 2014 19:01:49 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 19:01:49 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 19:01:49 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:01:49 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:01:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:01:52 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:01:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:01:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:01:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:01:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:01:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:01:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:01:55 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:01:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43907456
Thu 16 Jan 2014 19:01:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:01:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:01:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:01:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43907456
Thu 16 Jan 2014 19:01:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:02:05 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:02:05 - job_xml_thread(): Done retrieving: data size 43907456
Thu 16 Jan 2014 19:02:05 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:02:05 - XML: Start document: iteration 15
Thu 16 Jan 2014 19:02:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:02:05 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:02:07 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:02:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:02:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 19:02:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 19:02:07 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:02:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8823 values 139336 bits 17417 bytes 
Thu 16 Jan 2014 19:02:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:02:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:02:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:02:12 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:02:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:02:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:02:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:02:12 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:02:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:02:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:02:13 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:02:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:02:13 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:02:13 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:02:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:02:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:02:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:02:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:02:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:02:17 - XML: Processed 655896 elements - found 849 jobs
Thu 16 Jan 2014 19:02:17 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 19:02:17 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 19:02:17 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:02:17 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:02:21 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:02:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43943552
Thu 16 Jan 2014 19:02:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:02:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43943552
Thu 16 Jan 2014 19:02:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:02:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:02:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:02:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:02:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:02:32 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:02:32 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:02:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:02:34 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:02:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:02:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:02:34 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:02:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:02:34 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:02:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:02:37 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:02:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 19:02:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:02:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:02:39 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:02:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:02:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:02:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:02:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:02:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:02:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:02:42 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:02:42 - job_xml_thread(): Done retrieving: data size 43925671
Thu 16 Jan 2014 19:02:42 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:02:42 - XML: Start document: iteration 16
Thu 16 Jan 2014 19:02:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43925671
Thu 16 Jan 2014 19:02:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:02:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43925671
Thu 16 Jan 2014 19:02:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:02:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:02:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:02:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:02:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:02:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:02:56 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:02:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:02:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:02:58 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:02:59 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:02:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:02:59 - XML: Processed 655884 elements - found 843 jobs
Thu 16 Jan 2014 19:02:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:02:59 - job 7346675 appears to have finished
Thu 16 Jan 2014 19:02:59 - job 7346475 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:02:59 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:02:59 - job 7346576 appears to have finished
Thu 16 Jan 2014 19:02:59 - job 7346578 appears to have finished
Thu 16 Jan 2014 19:02:59 - job 7346426 appears to have finished
Thu 16 Jan 2014 19:02:59 - job 7346534 appears to have finished
Thu 16 Jan 2014 19:02:59 - job 7346533 appears to have finished
Thu 16 Jan 2014 19:02:59 - job_xml_thread(): Found 7 updated jobs.
Thu 16 Jan 2014 19:02:59 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 19:03:01 - job_xml_thread(): Done storing. succesfully stored: 7 jobs
Thu 16 Jan 2014 19:03:01 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:03:01 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:03:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:03:05 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:03:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:03:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:03:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:03:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:03:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:03:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:03:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:03:07 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:03:07 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:03:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:03:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 19:03:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 19:03:07 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:03:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5991 values 94804 bits 11850 bytes 
Thu 16 Jan 2014 19:03:08 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:03:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43921640
Thu 16 Jan 2014 19:03:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:03:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43921640
Thu 16 Jan 2014 19:03:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:03:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:03:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:03:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:03:16 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:03:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:03:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:03:16 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:03:16 - job_xml_thread(): Done retrieving: data size 43921640
Thu 16 Jan 2014 19:03:16 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:03:17 - XML: Start document: iteration 17
Thu 16 Jan 2014 19:03:17 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:03:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:03:17 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:03:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:03:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43921640
Thu 16 Jan 2014 19:03:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:03:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:03:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:03:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:03:30 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:03:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:03:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:03:33 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:03:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:03:33 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:03:33 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:03:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:03:35 - XML: Processed 655882 elements - found 843 jobs
Thu 16 Jan 2014 19:03:35 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 19:03:35 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 19:03:35 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:03:35 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:03:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:03:38 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:03:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:03:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:03:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:03:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:03:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:03:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:03:42 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:03:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 19:03:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:03:42 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:03:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43922597
Thu 16 Jan 2014 19:03:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:03:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43922597
Thu 16 Jan 2014 19:03:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:03:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:03:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:03:51 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:03:51 - job_xml_thread(): Done retrieving: data size 43922597
Thu 16 Jan 2014 19:03:51 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:03:51 - XML: Start document: iteration 18
Thu 16 Jan 2014 19:03:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:03:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:03:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:03:56 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:03:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:03:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:03:57 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:03:57 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:03:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:03:57 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:03:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:04:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:04:00 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:04:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:04:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:04:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:04:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:04:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:04:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:04:03 - XML: Processed 655884 elements - found 843 jobs
Thu 16 Jan 2014 19:04:03 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 19:04:03 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 19:04:03 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:04:03 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:04:06 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:04:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43933775
Thu 16 Jan 2014 19:04:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:04:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43933775
Thu 16 Jan 2014 19:04:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:04:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:04:08 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:04:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:04:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 19:04:08 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:04:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 19:04:08 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:04:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6728 values 106162 bits 13270 bytes 
Thu 16 Jan 2014 19:04:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:04:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:04:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:04:15 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:04:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:04:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:04:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:04:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:04:16 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:04:16 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:04:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:04:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:04:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43933775
Thu 16 Jan 2014 19:04:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:04:18 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:04:18 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:04:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:04:27 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:04:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:04:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:04:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:04:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:04:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:04:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:04:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:04:30 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:04:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:04:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:04:32 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:04:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:04:32 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:04:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:04:33 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:04:33 - job_xml_thread(): Done retrieving: data size 43913560
Thu 16 Jan 2014 19:04:33 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:04:33 - XML: Start document: iteration 19
Thu 16 Jan 2014 19:04:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43913560
Thu 16 Jan 2014 19:04:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:04:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43913560
Thu 16 Jan 2014 19:04:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:04:43 - XML: Processed 655884 elements - found 843 jobs
Thu 16 Jan 2014 19:04:43 - job 7346674 appears to have finished
Thu 16 Jan 2014 19:04:43 - job 7346463 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:04:43 - job_xml_thread(): Found 3 updated jobs.
Thu 16 Jan 2014 19:04:43 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 19:04:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:04:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:04:44 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Thu 16 Jan 2014 19:04:44 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:04:44 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:04:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:04:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:04:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:04:52 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:04:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:04:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:04:53 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:04:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:04:53 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:04:53 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:04:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:04:56 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:04:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 19:04:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:04:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:04:58 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:04:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:04:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:04:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:04:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:04:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:04:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:04:59 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:05:00 - Leaving storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 19:05:00 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Thu 16 Jan 2014 19:05:00 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:05:01 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:05:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43939075
Thu 16 Jan 2014 19:05:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:05:01 - job_xml_thread(): Done retrieving: data size 43939075
Thu 16 Jan 2014 19:05:01 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:05:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43939075
Thu 16 Jan 2014 19:05:02 - XML: Start document: iteration 20
Thu 16 Jan 2014 19:05:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:05:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:05:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:05:08 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:05:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:05:09 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:05:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 19:05:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:05:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 19:05:10 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:05:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5938 values 93656 bits 11707 bytes 
Thu 16 Jan 2014 19:05:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:05:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:05:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:05:16 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:05:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:05:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:05:17 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:05:17 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:05:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:05:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:05:17 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:05:23 - XML: Processed 655884 elements - found 843 jobs
Thu 16 Jan 2014 19:05:23 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 19:05:23 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 19:05:23 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:05:23 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:05:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:05:24 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:05:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:05:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:05:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:05:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:05:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:05:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:05:27 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:05:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43669491
Thu 16 Jan 2014 19:05:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:05:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43669491
Thu 16 Jan 2014 19:05:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:05:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:05:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:05:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:05:35 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:05:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:05:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:05:37 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:05:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:05:38 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:05:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:05:38 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:05:38 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:05:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:05:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:05:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:05:41 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:05:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:05:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:05:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:05:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:05:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:05:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:05:41 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:05:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 19:05:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:05:43 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:05:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43359121
Thu 16 Jan 2014 19:05:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:05:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43359121
Thu 16 Jan 2014 19:05:44 - job_xml_thread(): Done retrieving: data size 43359121
Thu 16 Jan 2014 19:05:44 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:05:44 - Housekeeping: checking database for timed out jobs..
Thu 16 Jan 2014 19:05:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:05:46 - Housekeeping: Found 0 timed out jobs in database: closing entries
Thu 16 Jan 2014 19:05:46 - Housekeeping: done.
Thu 16 Jan 2014 19:05:47 - XML: Start document: iteration 0
Thu 16 Jan 2014 19:05:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:05:51 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:05:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:05:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:05:54 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:05:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:05:54 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:05:54 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:05:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:05:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:05:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:06:01 - XML: Processed 648748 elements - found 843 jobs
Thu 16 Jan 2014 19:06:01 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 19:06:01 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 19:06:01 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:06:01 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:06:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:06:04 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:06:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:06:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:06:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:06:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:06:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:06:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:06:06 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:06:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43269976
Thu 16 Jan 2014 19:06:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:06:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43269976
Thu 16 Jan 2014 19:06:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:06:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:06:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:06:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:06:10 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:06:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:06:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 19:06:10 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:06:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 19:06:10 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:06:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9062 values 142922 bits 17865 bytes 
Thu 16 Jan 2014 19:06:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:06:15 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:06:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:06:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:06:16 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:06:16 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:06:16 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:06:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:06:16 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:06:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:06:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:06:19 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:06:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:06:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:06:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:06:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:06:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:06:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:06:22 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:06:22 - job_xml_thread(): Done retrieving: data size 43342055
Thu 16 Jan 2014 19:06:22 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:06:22 - XML: Start document: iteration 1
Thu 16 Jan 2014 19:06:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43342055
Thu 16 Jan 2014 19:06:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:06:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43342055
Thu 16 Jan 2014 19:06:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:06:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:06:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:06:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:06:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:06:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:06:36 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:06:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:06:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:06:37 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:06:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:06:37 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:06:37 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:06:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:06:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:06:41 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:06:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:06:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:06:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:06:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:06:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:06:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:06:46 - XML: Processed 648426 elements - found 841 jobs
Thu 16 Jan 2014 19:06:46 - job 7346678 appears to have finished
Thu 16 Jan 2014 19:06:46 - job 7346462 appears to have finished
Thu 16 Jan 2014 19:06:46 - job_xml_thread(): Found 2 updated jobs.
Thu 16 Jan 2014 19:06:46 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 19:06:46 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Thu 16 Jan 2014 19:06:46 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:06:46 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:06:46 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:06:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 19:06:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:06:47 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:06:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43842913
Thu 16 Jan 2014 19:06:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:06:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43842913
Thu 16 Jan 2014 19:06:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:06:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:06:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:06:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:06:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:07:01 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:07:01 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:07:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:07:01 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:07:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:07:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:07:02 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:07:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:07:02 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:07:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:07:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:07:03 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:07:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:07:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:07:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:07:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:07:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:07:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:07:05 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:07:05 - job_xml_thread(): Done retrieving: data size 43945663
Thu 16 Jan 2014 19:07:05 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:07:05 - XML: Start document: iteration 2
Thu 16 Jan 2014 19:07:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43945663
Thu 16 Jan 2014 19:07:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:07:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43945663
Thu 16 Jan 2014 19:07:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:07:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:07:10 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:07:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:07:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 19:07:11 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:07:11 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:07:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 19:07:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8794 values 138661 bits 17332 bytes 
Thu 16 Jan 2014 19:07:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:07:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:07:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:07:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:07:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:07:22 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:07:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:07:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:07:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:07:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:07:24 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:07:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:07:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:07:27 - XML: Processed 655760 elements - found 841 jobs
Thu 16 Jan 2014 19:07:28 - job 7346495 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:07:28 - job 7346463 field 'start_timestamp' changed since saved from: 1389895459 to: 1389895402
Thu 16 Jan 2014 19:07:28 - job_xml_thread(): Found 2 updated jobs.
Thu 16 Jan 2014 19:07:28 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 19:07:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:07:28 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:07:28 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Thu 16 Jan 2014 19:07:28 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:07:28 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:07:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:07:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:07:29 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:07:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:07:29 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:07:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:07:31 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:07:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43932905
Thu 16 Jan 2014 19:07:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:07:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43932905
Thu 16 Jan 2014 19:07:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:07:34 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Thu 16 Jan 2014 19:07:34 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:07:37 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:07:37 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 19:07:37 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:07:37 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 19:07:37 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 19:07:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:07:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:07:39 - size of cluster 'LISA Cluster': 624 hosts 79473 metrics 803147 values 12683904 bits 1585488 bytes 
Thu 16 Jan 2014 19:07:43 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:07:43 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:07:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:07:43 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:07:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:07:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:07:45 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:07:45 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:07:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:07:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:07:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:07:46 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:07:46 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:07:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 19:07:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:07:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:07:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:07:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:07:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:07:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:07:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:07:49 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:07:49 - job_xml_thread(): Done retrieving: data size 43950257
Thu 16 Jan 2014 19:07:49 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:07:49 - XML: Start document: iteration 3
Thu 16 Jan 2014 19:07:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43950257
Thu 16 Jan 2014 19:07:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43950257
Thu 16 Jan 2014 19:07:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:07:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:08:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:08:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:08:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:08:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:08:07 - XML: Processed 655880 elements - found 841 jobs
Thu 16 Jan 2014 19:08:07 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 19:08:07 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 19:08:07 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:08:07 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:08:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:08:11 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:08:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:08:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 19:08:12 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:08:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6108 values 96384 bits 12048 bytes 
Thu 16 Jan 2014 19:08:12 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:08:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 19:08:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:08:12 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:08:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:08:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:08:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:08:13 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:08:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:08:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:08:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:08:14 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:08:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:08:14 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:08:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:08:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:08:14 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:08:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:08:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:08:20 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:08:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43962650
Thu 16 Jan 2014 19:08:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:08:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43962650
Thu 16 Jan 2014 19:08:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:08:23 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:08:23 - job_xml_thread(): Done retrieving: data size 43962650
Thu 16 Jan 2014 19:08:23 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:08:24 - XML: Start document: iteration 4
Thu 16 Jan 2014 19:08:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:08:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:08:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:08:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:08:34 - XML: Processed 655876 elements - found 839 jobs
Thu 16 Jan 2014 19:08:34 - job 7343660 appears to have finished
Thu 16 Jan 2014 19:08:34 - job 7346611 appears to have finished
Thu 16 Jan 2014 19:08:34 - job_xml_thread(): Found 2 updated jobs.
Thu 16 Jan 2014 19:08:34 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 19:08:37 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:08:37 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 19:08:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:08:38 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:08:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:08:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:08:39 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Thu 16 Jan 2014 19:08:39 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:08:39 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:08:40 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:08:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:08:40 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:08:40 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:08:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:08:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:08:42 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:08:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:08:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:08:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:08:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:08:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:08:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:08:42 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:08:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 19:08:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:08:45 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:08:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43944123
Thu 16 Jan 2014 19:08:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:08:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43944123
Thu 16 Jan 2014 19:08:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:08:55 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:08:55 - job_xml_thread(): Done retrieving: data size 43944123
Thu 16 Jan 2014 19:08:55 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:08:55 - XML: Start document: iteration 5
Thu 16 Jan 2014 19:08:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:08:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:08:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:08:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:08:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:08:58 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:08:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:08:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:08:59 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:08:59 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:08:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:08:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:08:59 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:09:06 - XML: Processed 655876 elements - found 839 jobs
Thu 16 Jan 2014 19:09:07 - job 7346476 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:09:07 - job 7346495 field 'start_timestamp' changed since saved from: 1389895568 to: 1389895500
Thu 16 Jan 2014 19:09:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:09:07 - job_xml_thread(): Found 2 updated jobs.
Thu 16 Jan 2014 19:09:07 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 19:09:07 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:09:07 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Thu 16 Jan 2014 19:09:07 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:09:07 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:09:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:09:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:09:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:09:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:09:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:09:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:09:10 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:09:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43914629
Thu 16 Jan 2014 19:09:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:09:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43914629
Thu 16 Jan 2014 19:09:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:09:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:09:12 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:09:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:09:13 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:09:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 19:09:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 19:09:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:09:14 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:09:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:09:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8760 values 138025 bits 17253 bytes 
Thu 16 Jan 2014 19:09:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:09:21 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:09:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:09:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:09:22 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:09:22 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:09:22 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:09:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:09:22 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:09:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:09:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:09:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:09:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:09:26 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:09:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:09:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:09:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:09:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:09:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:09:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:09:31 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:09:31 - job_xml_thread(): Done retrieving: data size 43929134
Thu 16 Jan 2014 19:09:31 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:09:31 - XML: Start document: iteration 6
Thu 16 Jan 2014 19:09:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43929134
Thu 16 Jan 2014 19:09:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43929134
Thu 16 Jan 2014 19:09:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:09:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:09:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:09:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:09:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:09:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:09:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:09:43 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:09:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:09:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:09:44 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:09:44 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:09:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:09:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:09:44 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:09:50 - XML: Processed 655876 elements - found 839 jobs
Thu 16 Jan 2014 19:09:50 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 19:09:50 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 19:09:50 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:09:50 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:09:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:09:54 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:09:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:09:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:09:54 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:09:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 19:09:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:09:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:09:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:09:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:09:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:09:57 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:09:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43903592
Thu 16 Jan 2014 19:09:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43903592
Thu 16 Jan 2014 19:09:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:09:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:09:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:09:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:10:06 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:10:06 - job_xml_thread(): Done retrieving: data size 43903592
Thu 16 Jan 2014 19:10:07 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:10:07 - XML: Start document: iteration 7
Thu 16 Jan 2014 19:10:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:10:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:10:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:10:11 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:10:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:10:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:10:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:10:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:10:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:10:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:10:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:10:13 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:10:13 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:10:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:10:13 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:10:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:10:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:10:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:10:14 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:10:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:10:14 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:10:14 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:10:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:10:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 19:10:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 19:10:14 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:10:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5799 values 91421 bits 11427 bytes 
Thu 16 Jan 2014 19:10:19 - XML: Processed 655876 elements - found 839 jobs
Thu 16 Jan 2014 19:10:19 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 19:10:19 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 19:10:19 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:10:19 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:10:22 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:10:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43935211
Thu 16 Jan 2014 19:10:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:10:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43935211
Thu 16 Jan 2014 19:10:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:10:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:10:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:10:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:10:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:10:34 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:10:34 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:10:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:10:35 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:10:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:10:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:10:36 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:10:36 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:10:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:10:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:10:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:10:38 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:10:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:10:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:10:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:10:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:10:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:10:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:10:38 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:10:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 19:10:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:10:43 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:10:43 - job_xml_thread(): Done retrieving: data size 43919372
Thu 16 Jan 2014 19:10:43 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:10:43 - XML: Start document: iteration 8
Thu 16 Jan 2014 19:10:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43919372
Thu 16 Jan 2014 19:10:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43919372
Thu 16 Jan 2014 19:10:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:10:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:10:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:10:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:10:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:10:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:10:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:10:57 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:10:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:10:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:10:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:10:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:10:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:10:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:10:59 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:11:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:11:05 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:11:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:11:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:11:06 - XML: Processed 655872 elements - found 837 jobs
Thu 16 Jan 2014 19:11:06 - job 7346586 appears to have finished
Thu 16 Jan 2014 19:11:06 - job 7346666 appears to have finished
Thu 16 Jan 2014 19:11:06 - job_xml_thread(): Found 2 updated jobs.
Thu 16 Jan 2014 19:11:06 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 19:11:06 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Thu 16 Jan 2014 19:11:06 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:11:06 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:11:06 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:11:06 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:11:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:11:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:11:10 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:11:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43909857
Thu 16 Jan 2014 19:11:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:11:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43909857
Thu 16 Jan 2014 19:11:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:11:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:11:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:11:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:11:15 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:11:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:11:17 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:11:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 19:11:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 19:11:18 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:11:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8856 values 139556 bits 17444 bytes 
Thu 16 Jan 2014 19:11:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:11:19 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:11:21 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:11:21 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:11:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:11:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:11:22 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:11:22 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:11:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:11:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:11:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:11:23 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:11:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:11:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:11:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:11:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:11:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:11:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:11:26 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:11:26 - job_xml_thread(): Done retrieving: data size 43856554
Thu 16 Jan 2014 19:11:26 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:11:26 - XML: Start document: iteration 9
Thu 16 Jan 2014 19:11:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43856554
Thu 16 Jan 2014 19:11:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:11:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856554
Thu 16 Jan 2014 19:11:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:11:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:11:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:11:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:11:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:11:43 - XML: Processed 655095 elements - found 837 jobs
Thu 16 Jan 2014 19:11:43 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 19:11:43 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 19:11:43 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:11:43 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:11:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:11:49 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:11:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:11:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:11:50 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:11:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:11:50 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:11:50 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:11:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:11:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:11:51 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:11:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:11:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:11:52 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:11:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 19:11:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:11:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:11:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:11:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:11:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:11:52 - Leaving storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 19:11:52 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Thu 16 Jan 2014 19:11:52 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:11:53 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:11:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43278697
Thu 16 Jan 2014 19:11:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:11:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43278697
Thu 16 Jan 2014 19:11:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:11:59 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:11:59 - job_xml_thread(): Done retrieving: data size 43278697
Thu 16 Jan 2014 19:11:59 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:11:59 - XML: Start document: iteration 10
Thu 16 Jan 2014 19:12:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:12:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:12:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:12:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:12:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:12:07 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:12:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:12:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:12:08 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:12:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:12:08 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:12:08 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:12:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:12:14 - XML: Processed 647802 elements - found 837 jobs
Thu 16 Jan 2014 19:12:14 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 19:12:14 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 19:12:15 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:12:15 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:12:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:12:15 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:12:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:12:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:12:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:12:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:12:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:12:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:12:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:12:17 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:12:18 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:12:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43338269
Thu 16 Jan 2014 19:12:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:12:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43338269
Thu 16 Jan 2014 19:12:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:12:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:12:19 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:12:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 19:12:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 19:12:19 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:12:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5799 values 91425 bits 11428 bytes 
Thu 16 Jan 2014 19:12:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:12:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:12:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:12:28 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:12:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:12:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:12:28 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:12:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:12:28 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:12:28 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:12:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:12:30 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:12:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:12:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:12:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:12:33 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:12:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:12:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:12:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:12:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:12:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:12:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:12:35 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:12:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43410455
Thu 16 Jan 2014 19:12:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:12:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43410455
Thu 16 Jan 2014 19:12:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:12:36 - job_xml_thread(): Done retrieving: data size 43410455
Thu 16 Jan 2014 19:12:36 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:12:36 - XML: Start document: iteration 11
Thu 16 Jan 2014 19:12:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:12:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:12:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:12:47 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:12:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:12:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:12:47 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:12:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:12:47 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:12:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:12:47 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:12:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:12:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:12:54 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:12:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 19:12:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:12:54 - XML: Processed 649220 elements - found 835 jobs
Thu 16 Jan 2014 19:12:54 - job 7346477 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:12:54 - job 7346478 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:12:54 - job 7346479 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:12:54 - job 7346559 appears to have finished
Thu 16 Jan 2014 19:12:54 - job 7346480 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:12:54 - job 7346561 appears to have finished
Thu 16 Jan 2014 19:12:54 - job_xml_thread(): Found 6 updated jobs.
Thu 16 Jan 2014 19:12:54 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 19:12:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:12:56 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:12:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:12:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:12:57 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Thu 16 Jan 2014 19:12:57 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:12:57 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:12:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:12:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:12:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:12:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:12:59 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:12:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43893582
Thu 16 Jan 2014 19:12:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:12:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43893582
Thu 16 Jan 2014 19:12:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:13:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:13:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:13:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:13:11 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:13:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:13:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:13:12 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:13:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:13:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:13:12 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:13:13 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:13:13 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:13:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:13:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:13:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:13:14 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:13:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:13:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:13:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:13:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:13:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:13:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:13:15 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:13:15 - job_xml_thread(): Done retrieving: data size 43943877
Thu 16 Jan 2014 19:13:15 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:13:15 - XML: Start document: iteration 12
Thu 16 Jan 2014 19:13:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43943877
Thu 16 Jan 2014 19:13:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:13:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43943877
Thu 16 Jan 2014 19:13:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:13:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:13:19 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:13:20 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:13:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 19:13:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:13:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 19:13:20 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:13:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6581 values 103796 bits 12974 bytes 
Thu 16 Jan 2014 19:13:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:13:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:13:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:13:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:13:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:13:31 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:13:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:13:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:13:32 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:13:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:13:32 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:13:32 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:13:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:13:35 - XML: Processed 655868 elements - found 835 jobs
Thu 16 Jan 2014 19:13:36 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 19:13:36 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 19:13:36 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:13:36 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:13:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:13:40 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:13:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:13:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:13:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:13:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:13:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:13:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:13:42 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:13:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 19:13:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:13:42 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:13:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43908049
Thu 16 Jan 2014 19:13:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:13:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43908049
Thu 16 Jan 2014 19:13:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:13:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:13:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:13:51 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:13:51 - job_xml_thread(): Done retrieving: data size 43908049
Thu 16 Jan 2014 19:13:51 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:13:51 - XML: Start document: iteration 13
Thu 16 Jan 2014 19:13:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:13:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:13:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:13:58 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:13:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:13:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:13:59 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:13:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:13:59 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:13:59 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:13:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:14:00 - XML: Processed 655868 elements - found 835 jobs
Thu 16 Jan 2014 19:14:00 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 19:14:01 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 19:14:01 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:14:01 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:14:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:14:03 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:14:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:14:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:14:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:14:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:14:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:14:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:14:06 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:14:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43947933
Thu 16 Jan 2014 19:14:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:14:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43947933
Thu 16 Jan 2014 19:14:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:14:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:14:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:14:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:14:14 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:14:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:14:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:14:15 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:14:15 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:14:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:14:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:14:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43947933
Thu 16 Jan 2014 19:14:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:14:16 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:14:16 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:14:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:14:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:14:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:14:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:14:22 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:14:22 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:14:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:14:22 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:14:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 19:14:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 19:14:23 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:14:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99032 bits 12379 bytes 
Thu 16 Jan 2014 19:14:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:14:25 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:14:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:14:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:14:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:14:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:14:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:14:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:14:29 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:14:29 - job_xml_thread(): Done retrieving: data size 43900381
Thu 16 Jan 2014 19:14:29 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:14:29 - XML: Start document: iteration 14
Thu 16 Jan 2014 19:14:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43900381
Thu 16 Jan 2014 19:14:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:14:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:14:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:14:33 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:14:33 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:14:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:14:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:14:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43900381
Thu 16 Jan 2014 19:14:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:14:37 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Thu 16 Jan 2014 19:14:37 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:14:39 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:14:39 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:14:39 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 19:14:39 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 19:14:39 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 19:14:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:14:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:14:44 - XML: Processed 655858 elements - found 830 jobs
Thu 16 Jan 2014 19:14:45 - job 7346635 appears to have finished
Thu 16 Jan 2014 19:14:45 - job 7346568 appears to have finished
Thu 16 Jan 2014 19:14:45 - job 7344646 appears to have finished
Thu 16 Jan 2014 19:14:45 - job 7346481 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:14:45 - job 7346129 appears to have finished
Thu 16 Jan 2014 19:14:45 - job 7346431 appears to have finished
Thu 16 Jan 2014 19:14:45 - job_xml_thread(): Found 6 updated jobs.
Thu 16 Jan 2014 19:14:45 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 19:14:46 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:14:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 19:14:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:14:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Thu 16 Jan 2014 19:14:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:14:52 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Thu 16 Jan 2014 19:14:52 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:14:52 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:14:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:14:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:14:53 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:14:53 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:14:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:14:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:14:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:14:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:14:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:14:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:14:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:14:54 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:14:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:14:54 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:14:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:14:54 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:14:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:14:56 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:14:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43934305
Thu 16 Jan 2014 19:14:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:14:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43934305
Thu 16 Jan 2014 19:14:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:15:08 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:15:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:15:08 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:15:08 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:15:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:15:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:15:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:15:09 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:15:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:15:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:15:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:15:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:15:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:15:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:15:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:15:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:15:10 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:15:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:15:10 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:15:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:15:12 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:15:12 - job_xml_thread(): Done retrieving: data size 43934189
Thu 16 Jan 2014 19:15:12 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:15:12 - XML: Start document: iteration 15
Thu 16 Jan 2014 19:15:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43934189
Thu 16 Jan 2014 19:15:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:15:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43934189
Thu 16 Jan 2014 19:15:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:15:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:15:23 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:15:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:15:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:15:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:15:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:15:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:15:26 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:15:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 19:15:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 19:15:26 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:15:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9145 values 144232 bits 18029 bytes 
Thu 16 Jan 2014 19:15:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:15:30 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:15:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:15:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:15:31 - XML: Processed 655858 elements - found 830 jobs
Thu 16 Jan 2014 19:15:32 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 19:15:32 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 19:15:32 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:15:32 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:15:33 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:15:33 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:15:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:15:33 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:15:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:15:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:15:34 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:15:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:15:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:15:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:15:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:15:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:15:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:15:36 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:15:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43955844
Thu 16 Jan 2014 19:15:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:15:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43955844
Thu 16 Jan 2014 19:15:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:15:39 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:15:40 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:15:41 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:15:41 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 19:15:41 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 19:15:41 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:15:41 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 19:15:47 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:15:47 - XMLGatherer.retrieveData(): actually retrieving data..
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Thu 16 Jan 2014 19:15:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:15:47 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:15:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:15:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:15:49 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:15:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:15:49 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:15:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:15:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:15:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:15:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:15:51 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:15:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:15:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:15:52 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:15:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 19:15:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:15:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:15:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:15:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:15:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:15:53 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:15:53 - job_xml_thread(): Done retrieving: data size 43930164
Thu 16 Jan 2014 19:15:53 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:15:53 - XML: Start document: iteration 16
Thu 16 Jan 2014 19:15:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43930164
Thu 16 Jan 2014 19:15:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:15:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43930164
Thu 16 Jan 2014 19:15:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:16:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:16:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:16:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:16:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:16:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:16:07 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:16:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:16:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:16:08 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:16:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:16:08 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:16:08 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:16:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:16:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:16:15 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:16:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:16:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:16:16 - XML: Processed 655858 elements - found 830 jobs
Thu 16 Jan 2014 19:16:16 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 19:16:16 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 19:16:16 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:16:16 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:16:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:16:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:16:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:16:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:16:17 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:16:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43932070
Thu 16 Jan 2014 19:16:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:16:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43932070
Thu 16 Jan 2014 19:16:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:16:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:16:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:16:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:16:26 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:16:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:16:27 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:16:27 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:16:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:16:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 19:16:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 19:16:27 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:16:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:16:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:16:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8725 values 137636 bits 17204 bytes 
Thu 16 Jan 2014 19:16:29 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:16:29 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:16:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:16:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:16:29 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:16:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:16:30 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:16:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:16:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:16:31 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:16:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:16:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:16:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:16:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:16:32 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:16:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43955683
Thu 16 Jan 2014 19:16:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:16:33 - job_xml_thread(): Done retrieving: data size 43955683
Thu 16 Jan 2014 19:16:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43955683
Thu 16 Jan 2014 19:16:33 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:16:33 - XML: Start document: iteration 17
Thu 16 Jan 2014 19:16:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:16:41 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:16:41 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:16:41 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:16:41 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 19:16:41 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:16:41 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 19:16:41 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 19:16:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:16:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:16:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:16:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:16:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:16:50 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:16:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:16:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:16:51 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:16:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:16:51 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:16:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:16:51 - XMLGatherer.retrieveData(): actually retrieving data..
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Thu 16 Jan 2014 19:16:56 - XML: Processed 655854 elements - found 828 jobs
Thu 16 Jan 2014 19:16:56 - job 7346497 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:16:56 - job 7345758 appears to have finished
Thu 16 Jan 2014 19:16:56 - job 7346560 appears to have finished
Thu 16 Jan 2014 19:16:56 - job 7346483 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:16:56 - job 7346482 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:16:56 - job_xml_thread(): Found 5 updated jobs.
Thu 16 Jan 2014 19:16:56 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 19:16:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:16:57 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:16:57 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Thu 16 Jan 2014 19:16:57 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:16:57 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:16:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:16:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:16:57 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:16:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 19:16:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:16:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:16:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:16:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:16:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:16:59 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:16:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43924065
Thu 16 Jan 2014 19:16:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:16:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43924065
Thu 16 Jan 2014 19:16:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:17:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:17:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:17:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:17:10 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:17:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:17:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:17:12 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:17:12 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:17:12 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:17:12 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:17:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:17:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:17:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:17:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:17:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:17:13 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:17:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:17:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:17:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:17:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:17:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:17:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:17:15 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:17:15 - job_xml_thread(): Done retrieving: data size 43880260
Thu 16 Jan 2014 19:17:15 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:17:15 - XML: Start document: iteration 18
Thu 16 Jan 2014 19:17:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43880260
Thu 16 Jan 2014 19:17:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:17:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43880260
Thu 16 Jan 2014 19:17:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:17:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:17:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:17:28 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:17:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:17:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:17:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 19:17:29 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:17:29 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:17:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 19:17:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:17:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:17:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8865 values 140174 bits 17521 bytes 
Thu 16 Jan 2014 19:17:33 - XML: Processed 655106 elements - found 828 jobs
Thu 16 Jan 2014 19:17:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:17:34 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:17:34 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 19:17:34 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 19:17:34 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:17:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:17:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:17:34 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:17:35 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:17:35 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:17:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:17:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:17:35 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:17:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:17:37 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:17:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:17:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:17:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:17:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:17:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:17:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:17:38 - Leaving storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 19:17:38 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Thu 16 Jan 2014 19:17:38 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:17:38 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:17:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 19:17:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:17:39 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:17:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43378205
Thu 16 Jan 2014 19:17:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:17:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43378205
Thu 16 Jan 2014 19:17:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:17:41 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:17:41 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:17:43 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:17:43 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:17:43 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 19:17:44 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 19:17:44 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 19:17:49 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:17:50 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:17:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:17:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:17:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:17:51 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:17:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Thu 16 Jan 2014 19:17:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:17:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:17:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:17:52 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:17:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:17:52 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:17:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:17:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:17:54 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:17:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:17:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:17:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:17:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:17:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:17:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:17:57 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:17:57 - job_xml_thread(): Done retrieving: data size 43269184
Thu 16 Jan 2014 19:17:57 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:17:57 - XML: Start document: iteration 19
Thu 16 Jan 2014 19:17:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43269184
Thu 16 Jan 2014 19:17:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:17:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43269184
Thu 16 Jan 2014 19:17:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:18:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:18:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:18:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:18:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:18:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:18:12 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:18:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:18:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:18:13 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:18:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:18:13 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:18:13 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:18:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:18:16 - XML: Processed 647799 elements - found 828 jobs
Thu 16 Jan 2014 19:18:16 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 19:18:16 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 19:18:16 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:18:16 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:18:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:18:19 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:18:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:18:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:18:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:18:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:18:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:18:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:18:23 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:18:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43337005
Thu 16 Jan 2014 19:18:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:18:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43337005
Thu 16 Jan 2014 19:18:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:18:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:18:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:18:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:18:29 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:18:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:18:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 19:18:30 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:18:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 19:18:30 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:18:31 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:18:31 - job_xml_thread(): Done retrieving: data size 43337005
Thu 16 Jan 2014 19:18:31 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:18:31 - XML: Start document: iteration 20
Thu 16 Jan 2014 19:18:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148875 bits 18609 bytes 
Thu 16 Jan 2014 19:18:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:18:34 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:18:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:18:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:18:35 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:18:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:18:35 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:18:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:18:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:18:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:18:35 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:18:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:18:40 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:18:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:18:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:18:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:18:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:18:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:18:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:18:43 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:18:43 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:18:44 - XML: Processed 648402 elements - found 828 jobs
Thu 16 Jan 2014 19:18:44 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:18:44 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:18:44 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 19:18:44 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 19:18:44 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 19:18:44 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 19:18:44 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 19:18:44 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:18:44 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:18:45 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 1249127 values 19735391 bits 2466923 bytes 
Thu 16 Jan 2014 19:18:48 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:18:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 19:18:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:18:48 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:18:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43861501
Thu 16 Jan 2014 19:18:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:18:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43861501
Thu 16 Jan 2014 19:18:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:18:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:18:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:18:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:18:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:18:59 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:18:59 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:19:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:19:01 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:19:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:19:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:19:01 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:19:01 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:19:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:19:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:19:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:19:03 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:19:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:19:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:19:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:19:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:19:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:19:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:19:06 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:19:06 - job_xml_thread(): Done retrieving: data size 43944050
Thu 16 Jan 2014 19:19:06 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:19:06 - Housekeeping: checking database for timed out jobs..
Thu 16 Jan 2014 19:19:06 - Housekeeping: Found 0 timed out jobs in database: closing entries
Thu 16 Jan 2014 19:19:06 - Housekeeping: done.
Thu 16 Jan 2014 19:19:06 - XML: Start document: iteration 0
Thu 16 Jan 2014 19:19:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43944050
Thu 16 Jan 2014 19:19:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:19:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43944050
Thu 16 Jan 2014 19:19:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:19:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:19:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:19:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:19:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:19:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:19:25 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:19:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:19:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:19:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:19:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:19:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:19:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:19:26 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:19:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:19:27 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:19:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:19:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:19:28 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:19:28 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:19:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:19:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:19:28 - XML: Processed 655863 elements - found 833 jobs
Thu 16 Jan 2014 19:19:28 - job 7346677 appears to have finished
Thu 16 Jan 2014 19:19:28 - job 7346627 appears to have finished
Thu 16 Jan 2014 19:19:28 - job 7346423 appears to have finished
Thu 16 Jan 2014 19:19:28 - job_xml_thread(): Found 11 updated jobs.
Thu 16 Jan 2014 19:19:28 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 19:19:28 - job_xml_thread(): Done storing. succesfully stored: 11 jobs
Thu 16 Jan 2014 19:19:28 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:19:28 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:19:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:19:30 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:19:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:19:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 19:19:31 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:19:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 19:19:31 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:19:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6139 values 96860 bits 12107 bytes 
Thu 16 Jan 2014 19:19:32 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:19:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43921839
Thu 16 Jan 2014 19:19:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:19:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43921839
Thu 16 Jan 2014 19:19:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:19:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:19:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:19:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:19:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:19:44 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:19:44 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:19:44 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:19:44 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 19:19:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:19:48 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:19:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:19:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:19:48 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:19:48 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:19:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:19:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:19:48 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:19:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:19:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:19:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:19:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:19:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:19:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:19:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:19:51 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:19:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 19:19:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:19:52 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:19:52 - job_xml_thread(): Done retrieving: data size 43936448
Thu 16 Jan 2014 19:19:52 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:19:52 - XML: Start document: iteration 1
Thu 16 Jan 2014 19:19:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43936448
Thu 16 Jan 2014 19:19:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:19:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43936448
Thu 16 Jan 2014 19:19:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:20:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:20:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:20:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:20:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:20:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:20:08 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:20:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:20:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:20:09 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:20:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:20:09 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:20:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:20:09 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:20:10 - XML: Processed 655864 elements - found 833 jobs
Thu 16 Jan 2014 19:20:10 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 19:20:10 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 19:20:10 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:20:10 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:20:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:20:13 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:20:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:20:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:20:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:20:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:20:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:20:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:20:15 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:20:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43923756
Thu 16 Jan 2014 19:20:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:20:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43923756
Thu 16 Jan 2014 19:20:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:20:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:20:23 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:20:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:20:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:20:26 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:20:26 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:20:26 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:20:26 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:20:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:20:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:20:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:20:28 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:20:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:20:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:20:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:20:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:20:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:20:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:20:30 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:20:30 - job_xml_thread(): Done retrieving: data size 43928476
Thu 16 Jan 2014 19:20:30 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:20:30 - XML: Start document: iteration 2
Thu 16 Jan 2014 19:20:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:20:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43928476
Thu 16 Jan 2014 19:20:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43928476
Thu 16 Jan 2014 19:20:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:20:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:20:31 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:20:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:20:32 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:20:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 19:20:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 19:20:32 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:20:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7043 values 111056 bits 13882 bytes 
Thu 16 Jan 2014 19:20:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:20:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:20:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:20:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:20:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:20:45 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:20:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:20:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:20:46 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:20:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:20:46 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:20:46 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:20:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:20:49 - XML: Processed 655864 elements - found 833 jobs
Thu 16 Jan 2014 19:20:49 - job 7346757 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:20:49 - job 7346585 appears to have finished
Thu 16 Jan 2014 19:20:49 - job 7346758 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:20:49 - job_xml_thread(): Found 4 updated jobs.
Thu 16 Jan 2014 19:20:49 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 19:20:49 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Thu 16 Jan 2014 19:20:49 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:20:49 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:20:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:20:54 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:20:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:20:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:20:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:20:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:20:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:20:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:20:56 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:20:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43926987
Thu 16 Jan 2014 19:20:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:20:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43926987
Thu 16 Jan 2014 19:20:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:21:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:21:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:21:05 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:21:05 - job_xml_thread(): Done retrieving: data size 43926987
Thu 16 Jan 2014 19:21:05 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:21:05 - XML: Start document: iteration 3
Thu 16 Jan 2014 19:21:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:21:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:21:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:21:10 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:21:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:21:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:21:10 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:21:10 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:21:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:21:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:21:10 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:21:18 - XML: Processed 655863 elements - found 833 jobs
Thu 16 Jan 2014 19:21:18 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 19:21:18 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 19:21:18 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:21:18 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:21:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:21:20 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:21:20 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:21:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 19:21:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:21:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:21:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:21:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:21:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:21:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:21:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:21:22 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:21:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43926780
Thu 16 Jan 2014 19:21:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:21:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43926780
Thu 16 Jan 2014 19:21:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:21:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:21:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:21:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:21:32 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:21:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:21:33 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:21:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:21:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:21:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:21:33 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:21:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 19:21:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 19:21:33 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:21:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6141 values 96813 bits 12101 bytes 
Thu 16 Jan 2014 19:21:34 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:21:34 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:21:34 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:21:34 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:21:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:21:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:21:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:21:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:21:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:21:37 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:21:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:21:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:21:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:21:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:21:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:21:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:21:40 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:21:40 - job_xml_thread(): Done retrieving: data size 43945151
Thu 16 Jan 2014 19:21:40 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:21:40 - XML: Start document: iteration 4
Thu 16 Jan 2014 19:21:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43945151
Thu 16 Jan 2014 19:21:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:21:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43945151
Thu 16 Jan 2014 19:21:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:21:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:21:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:21:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:21:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:21:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:21:55 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:21:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:21:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:21:56 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:21:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:21:56 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:21:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:21:56 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:21:56 - XML: Processed 655864 elements - found 833 jobs
Thu 16 Jan 2014 19:21:56 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 19:21:56 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 19:21:56 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:21:56 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:22:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:22:01 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:22:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:22:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:22:01 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:22:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 19:22:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:22:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:22:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:22:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:22:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:22:03 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:22:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43930840
Thu 16 Jan 2014 19:22:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:22:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43930840
Thu 16 Jan 2014 19:22:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:22:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:22:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:22:11 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:22:11 - job_xml_thread(): Done retrieving: data size 43930840
Thu 16 Jan 2014 19:22:11 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:22:11 - XML: Start document: iteration 5
Thu 16 Jan 2014 19:22:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:22:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:22:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:22:19 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:22:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:22:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:22:21 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:22:21 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:22:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:22:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:22:21 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:22:25 - XML: Processed 655864 elements - found 833 jobs
Thu 16 Jan 2014 19:22:25 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 19:22:25 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 19:22:25 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:22:25 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:22:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:22:25 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:22:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:22:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:22:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:22:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:22:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:22:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:22:28 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:22:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43929459
Thu 16 Jan 2014 19:22:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:22:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43929459
Thu 16 Jan 2014 19:22:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:22:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:22:33 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:22:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:22:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 19:22:35 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:22:35 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:22:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 19:22:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8929 values 140819 bits 17602 bytes 
Thu 16 Jan 2014 19:22:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:22:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:22:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:22:40 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:22:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:22:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:22:40 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:22:40 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:22:41 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:22:41 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:22:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:22:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:22:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:22:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:22:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:22:43 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:22:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:22:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:22:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:22:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:22:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:22:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:22:45 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:22:45 - job_xml_thread(): Done retrieving: data size 43928146
Thu 16 Jan 2014 19:22:45 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:22:45 - XML: Start document: iteration 6
Thu 16 Jan 2014 19:22:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43928146
Thu 16 Jan 2014 19:22:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:22:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43928146
Thu 16 Jan 2014 19:22:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:22:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:22:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:22:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:22:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:23:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:23:07 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:23:07 - XML: Processed 655860 elements - found 831 jobs
Thu 16 Jan 2014 19:23:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:23:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:23:08 - job 7346584 appears to have finished
Thu 16 Jan 2014 19:23:08 - job 7346455 appears to have finished
Thu 16 Jan 2014 19:23:08 - job 7346760 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:23:08 - job 7346761 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:23:08 - job 7346759 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:23:08 - job 7346758 field 'start_timestamp' changed since saved from: 1389896454 to: 1389896378
Thu 16 Jan 2014 19:23:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:23:08 - job_xml_thread(): Found 6 updated jobs.
Thu 16 Jan 2014 19:23:08 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:23:08 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 19:23:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:23:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:23:08 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Thu 16 Jan 2014 19:23:08 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:23:08 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:23:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:23:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:23:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:23:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:23:08 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:23:09 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:23:09 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:23:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:23:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:23:10 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:23:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 19:23:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:23:11 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:23:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43880655
Thu 16 Jan 2014 19:23:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:23:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43880655
Thu 16 Jan 2014 19:23:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:23:23 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:23:23 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:23:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:23:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:23:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:23:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:23:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:23:26 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:23:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:23:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:23:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:23:27 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:23:27 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:23:27 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:23:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:23:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:23:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:23:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:23:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:23:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:23:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:23:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:23:29 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:23:29 - job_xml_thread(): Done retrieving: data size 43619186
Thu 16 Jan 2014 19:23:29 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:23:29 - XML: Start document: iteration 7
Thu 16 Jan 2014 19:23:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43619186
Thu 16 Jan 2014 19:23:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:23:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43619186
Thu 16 Jan 2014 19:23:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:23:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:23:35 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:23:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:23:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 19:23:36 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:23:36 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:23:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 19:23:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8233 values 129733 bits 16216 bytes 
Thu 16 Jan 2014 19:23:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:23:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:23:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:23:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:23:43 - XML: Processed 652206 elements - found 831 jobs
Thu 16 Jan 2014 19:23:43 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 19:23:43 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 19:23:43 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:23:44 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:23:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:23:47 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:23:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:23:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:23:48 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:23:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:23:48 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:23:48 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:23:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:23:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:23:51 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:23:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:23:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:23:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:23:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:23:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:23:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:23:54 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:23:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 19:23:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:23:54 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:23:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43286362
Thu 16 Jan 2014 19:23:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:23:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43286362
Thu 16 Jan 2014 19:23:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:23:59 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:23:59 - job_xml_thread(): Done retrieving: data size 43286362
Thu 16 Jan 2014 19:23:59 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:23:59 - XML: Start document: iteration 8
Thu 16 Jan 2014 19:24:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:24:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:24:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:24:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:24:12 - XML: Processed 647762 elements - found 831 jobs
Thu 16 Jan 2014 19:24:12 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 19:24:12 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 19:24:12 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:24:12 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:24:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:24:13 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:24:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:24:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:24:14 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:24:14 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:24:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:24:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:24:14 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:24:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:24:15 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:24:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:24:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:24:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:24:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:24:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:24:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:24:18 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:24:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43345590
Thu 16 Jan 2014 19:24:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:24:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43345590
Thu 16 Jan 2014 19:24:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:24:27 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:24:27 - job_xml_thread(): Done retrieving: data size 43345590
Thu 16 Jan 2014 19:24:27 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:24:27 - XML: Start document: iteration 9
Thu 16 Jan 2014 19:24:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:24:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:24:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:24:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:24:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:24:30 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:24:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:24:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:24:32 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:24:32 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:24:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:24:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:24:32 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:24:36 - XML: Processed 648408 elements - found 831 jobs
Thu 16 Jan 2014 19:24:36 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 19:24:36 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 19:24:36 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:24:36 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:24:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:24:36 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:24:36 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:24:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:24:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 19:24:36 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:24:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99024 bits 12378 bytes 
Thu 16 Jan 2014 19:24:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 19:24:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:24:40 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:24:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:24:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:24:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:24:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:24:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:24:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:24:42 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:24:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43744238
Thu 16 Jan 2014 19:24:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:24:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43744238
Thu 16 Jan 2014 19:24:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:24:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:24:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:24:51 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:24:51 - job_xml_thread(): Done retrieving: data size 43744238
Thu 16 Jan 2014 19:24:51 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:24:51 - XML: Start document: iteration 10
Thu 16 Jan 2014 19:24:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:24:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:25:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:25:00 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:25:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:25:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:25:02 - XML: Processed 653662 elements - found 828 jobs
Thu 16 Jan 2014 19:25:02 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:25:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:25:02 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:25:02 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:25:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:25:02 - job 7346738 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:25:02 - job 7346594 appears to have finished
Thu 16 Jan 2014 19:25:03 - job 7346579 appears to have finished
Thu 16 Jan 2014 19:25:03 - job 7346580 appears to have finished
Thu 16 Jan 2014 19:25:03 - job 7346484 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:25:03 - job 7346762 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:25:04 - job 7346763 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:25:04 - job 7346764 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:25:04 - job_xml_thread(): Found 8 updated jobs.
Thu 16 Jan 2014 19:25:04 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 19:25:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:25:05 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:25:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:25:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:25:05 - job_xml_thread(): Done storing. succesfully stored: 8 jobs
Thu 16 Jan 2014 19:25:05 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:25:05 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:25:05 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:25:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 19:25:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:25:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:25:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:25:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:25:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:25:07 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:25:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43932569
Thu 16 Jan 2014 19:25:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:25:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43932569
Thu 16 Jan 2014 19:25:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:25:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:25:16 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:25:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:25:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:25:20 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:25:20 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:25:20 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:25:20 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:25:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:25:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:25:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:25:20 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:25:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:25:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:25:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:25:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:25:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:25:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:25:22 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:25:22 - job_xml_thread(): Done retrieving: data size 43936244
Thu 16 Jan 2014 19:25:22 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:25:22 - XML: Start document: iteration 11
Thu 16 Jan 2014 19:25:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43936244
Thu 16 Jan 2014 19:25:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:25:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43936244
Thu 16 Jan 2014 19:25:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:25:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:25:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:25:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:25:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:25:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:25:36 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:25:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:25:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 19:25:37 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:25:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8060 values 127073 bits 15884 bytes 
Thu 16 Jan 2014 19:25:37 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:25:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 19:25:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:25:42 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:25:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:25:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:25:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:25:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:25:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:25:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:25:43 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:25:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:25:44 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:25:44 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Thu 16 Jan 2014 19:25:44 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:25:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:25:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:25:45 - XML: Processed 655854 elements - found 828 jobs
Thu 16 Jan 2014 19:25:45 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 19:25:45 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 19:25:45 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:25:45 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:25:45 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:25:45 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:25:45 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 19:25:45 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 19:25:45 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 19:25:46 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:25:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:25:46 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:25:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:25:47 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 1146357 values 18100402 bits 2262550 bytes 
Thu 16 Jan 2014 19:25:51 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:25:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43926690
Thu 16 Jan 2014 19:25:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:25:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43926690
Thu 16 Jan 2014 19:25:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:25:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:25:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:26:00 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:26:00 - job_xml_thread(): Done retrieving: data size 43926690
Thu 16 Jan 2014 19:26:00 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:26:00 - XML: Start document: iteration 12
Thu 16 Jan 2014 19:26:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:26:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:26:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:26:08 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:26:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:26:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:26:10 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:26:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:26:10 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:26:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:26:10 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:26:14 - XML: Processed 655854 elements - found 828 jobs
Thu 16 Jan 2014 19:26:14 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 19:26:14 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 19:26:14 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:26:14 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:26:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:26:15 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:26:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:26:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:26:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:26:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:26:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:26:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:26:16 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:26:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 19:26:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:26:19 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:26:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43925023
Thu 16 Jan 2014 19:26:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:26:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43925023
Thu 16 Jan 2014 19:26:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:26:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:26:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:26:29 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:26:29 - job_xml_thread(): Done retrieving: data size 43925023
Thu 16 Jan 2014 19:26:29 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:26:29 - XML: Start document: iteration 13
Thu 16 Jan 2014 19:26:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:26:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:26:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:26:33 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:26:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:26:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:26:34 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:26:34 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:26:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:26:34 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:26:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:26:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:26:37 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:26:38 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:26:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:26:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 19:26:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 19:26:38 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:26:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5670 values 89286 bits 11160 bytes 
Thu 16 Jan 2014 19:26:42 - XML: Processed 655854 elements - found 828 jobs
Thu 16 Jan 2014 19:26:43 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 19:26:43 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 19:26:43 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:26:43 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:26:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:26:44 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:26:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:26:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:26:45 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:26:45 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 19:26:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:26:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:26:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:26:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:26:49 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:26:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43900695
Thu 16 Jan 2014 19:26:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:26:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:26:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43900695
Thu 16 Jan 2014 19:26:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:26:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:26:58 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:26:58 - job_xml_thread(): Done retrieving: data size 43900695
Thu 16 Jan 2014 19:26:58 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:26:58 - XML: Start document: iteration 14
Thu 16 Jan 2014 19:27:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:27:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:27:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:27:02 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:27:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:27:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:27:03 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:27:03 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:27:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:27:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:27:03 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:27:10 - XML: Processed 655850 elements - found 826 jobs
Thu 16 Jan 2014 19:27:10 - job 7346012 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:27:10 - job 7346011 report time 1389896639 does not match current heartbeat 1389896759 : ignoring job
Thu 16 Jan 2014 19:27:10 - job 7346499 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:27:10 - job 7346692 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:27:10 - job 7346691 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:27:10 - job 7346743 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:27:10 - job 7346485 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:27:10 - job 7346010 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:27:10 - job 7344569 appears to have finished
Thu 16 Jan 2014 19:27:10 - job 7346697 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:27:10 - job 7346696 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:27:10 - job 7346715 appears to have finished
Thu 16 Jan 2014 19:27:10 - job 7346008 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:27:10 - job 7346005 report time 1389896639 does not match current heartbeat 1389896759 : ignoring job
Thu 16 Jan 2014 19:27:10 - job 7346487 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:27:10 - job 7346486 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:27:10 - job 7346489 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:27:10 - job 7346488 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:27:10 - job 7346693 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:27:10 - job 7346695 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:27:10 - job_xml_thread(): Found 18 updated jobs.
Thu 16 Jan 2014 19:27:10 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 19:27:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:27:13 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:27:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:27:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:27:13 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:27:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 19:27:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:27:13 - job_xml_thread(): Done storing. succesfully stored: 18 jobs
Thu 16 Jan 2014 19:27:13 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:27:13 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:27:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:27:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:27:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:27:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:27:16 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:27:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43904351
Thu 16 Jan 2014 19:27:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:27:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43904351
Thu 16 Jan 2014 19:27:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:27:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:27:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:27:28 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:27:28 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:27:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:27:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:27:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:27:29 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:27:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:27:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:27:30 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:27:31 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:27:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:27:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:27:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:27:32 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:27:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:27:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:27:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:27:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:27:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:27:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:27:35 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:27:35 - job_xml_thread(): Done retrieving: data size 43932459
Thu 16 Jan 2014 19:27:35 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:27:35 - XML: Start document: iteration 15
Thu 16 Jan 2014 19:27:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43932459
Thu 16 Jan 2014 19:27:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:27:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43932459
Thu 16 Jan 2014 19:27:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:27:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:27:39 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:27:40 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:27:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 19:27:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:27:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 19:27:40 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:27:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7962 values 125564 bits 15695 bytes 
Thu 16 Jan 2014 19:27:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:27:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:27:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:27:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:27:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:27:55 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:27:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:27:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:27:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:27:57 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:27:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:27:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:27:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:27:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:27:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:27:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:27:57 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:27:58 - XML: Processed 655850 elements - found 826 jobs
Thu 16 Jan 2014 19:27:58 - job 7346011 report time 1389896639 does not match current heartbeat 1389896759 : ignoring job
Thu 16 Jan 2014 19:27:58 - job 7346005 report time 1389896639 does not match current heartbeat 1389896759 : ignoring job
Thu 16 Jan 2014 19:27:58 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 19:27:58 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 19:27:58 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:27:58 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:27:58 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:27:58 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:27:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:27:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:28:02 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:28:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43928705
Thu 16 Jan 2014 19:28:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:28:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43928705
Thu 16 Jan 2014 19:28:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:28:11 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:28:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 19:28:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:28:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:28:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:28:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:28:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:28:13 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:28:13 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:28:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:28:15 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:28:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:28:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:28:15 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:28:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:28:15 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:28:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:28:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:28:19 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:28:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:28:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:28:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:28:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:28:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:28:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:28:23 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:28:23 - job_xml_thread(): Done retrieving: data size 43930965
Thu 16 Jan 2014 19:28:23 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:28:23 - XML: Start document: iteration 16
Thu 16 Jan 2014 19:28:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43930965
Thu 16 Jan 2014 19:28:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:28:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43930965
Thu 16 Jan 2014 19:28:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:28:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:28:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:28:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:28:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:28:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:28:40 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:28:41 - XML: Processed 655850 elements - found 826 jobs
Thu 16 Jan 2014 19:28:41 - job 7346011 report time 1389896639 does not match current heartbeat 1389896759 : ignoring job
Thu 16 Jan 2014 19:28:41 - job 7346005 report time 1389896639 does not match current heartbeat 1389896759 : ignoring job
Thu 16 Jan 2014 19:28:41 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 19:28:41 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 19:28:41 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:28:41 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:28:42 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:28:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 19:28:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:28:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 19:28:42 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:28:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6214 values 97983 bits 12247 bytes 
Thu 16 Jan 2014 19:28:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:28:42 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:28:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:28:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:28:43 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:28:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:28:43 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:28:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:28:43 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:28:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:28:46 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:28:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:28:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:28:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:28:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:28:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:28:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:28:51 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:28:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43943792
Thu 16 Jan 2014 19:28:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:28:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43943792
Thu 16 Jan 2014 19:28:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:28:56 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:28:56 - job_xml_thread(): Done retrieving: data size 43943792
Thu 16 Jan 2014 19:28:56 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:28:56 - XML: Start document: iteration 17
Thu 16 Jan 2014 19:28:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:28:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:29:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:29:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:29:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:29:02 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:29:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:29:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:29:03 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:29:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:29:03 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:29:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:29:03 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:29:11 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:29:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 19:29:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:29:11 - XML: Processed 655840 elements - found 821 jobs
Thu 16 Jan 2014 19:29:11 - job 7346012 field 'start_timestamp' changed since saved from: 1389896762 to: 1389896701
Thu 16 Jan 2014 19:29:11 - job 7346738 appears to have finished
Thu 16 Jan 2014 19:29:11 - job 7346588 appears to have finished
Thu 16 Jan 2014 19:29:11 - job 7346601 appears to have finished
Thu 16 Jan 2014 19:29:11 - job_xml_thread(): Found 4 updated jobs.
Thu 16 Jan 2014 19:29:11 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 19:29:13 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Thu 16 Jan 2014 19:29:13 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:29:13 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:29:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:29:14 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:29:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:29:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:29:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:29:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:29:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:29:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:29:18 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:29:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875143
Thu 16 Jan 2014 19:29:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:29:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875143
Thu 16 Jan 2014 19:29:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:29:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:29:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:29:28 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:29:28 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:29:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:29:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:29:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:29:33 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:29:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:29:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:29:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:29:34 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:29:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:29:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:29:34 - Leaving storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 19:29:34 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Thu 16 Jan 2014 19:29:34 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:29:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:29:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:29:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:29:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:29:35 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:29:35 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:29:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:29:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:29:37 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:29:37 - job_xml_thread(): Done retrieving: data size 43466893
Thu 16 Jan 2014 19:29:37 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:29:37 - XML: Start document: iteration 18
Thu 16 Jan 2014 19:29:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43466893
Thu 16 Jan 2014 19:29:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:29:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43466893
Thu 16 Jan 2014 19:29:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:29:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:29:42 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:29:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:29:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 19:29:44 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:29:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 19:29:44 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:29:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8828 values 139136 bits 17392 bytes 
Thu 16 Jan 2014 19:29:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:29:47 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:29:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:29:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:29:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:29:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:29:51 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:29:51 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:29:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:29:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:29:51 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:29:59 - XML: Processed 650100 elements - found 821 jobs
Thu 16 Jan 2014 19:29:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:29:59 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:29:59 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 19:29:59 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 19:29:59 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:29:59 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:29:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:29:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:30:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:30:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:30:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:30:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:30:02 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:30:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43253663
Thu 16 Jan 2014 19:30:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:30:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43253663
Thu 16 Jan 2014 19:30:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:30:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:30:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:30:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:30:10 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:30:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:30:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:30:12 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:30:12 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:30:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:30:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:30:13 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:30:14 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:30:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:30:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:30:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:30:16 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:30:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:30:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:30:16 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:30:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 19:30:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:30:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:30:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:30:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:30:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:30:18 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:30:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43338242
Thu 16 Jan 2014 19:30:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:30:18 - job_xml_thread(): Done retrieving: data size 43338242
Thu 16 Jan 2014 19:30:18 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:30:18 - XML: Start document: iteration 19
Thu 16 Jan 2014 19:30:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43338242
Thu 16 Jan 2014 19:30:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:30:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:30:28 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:30:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:30:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:30:30 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:30:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:30:30 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:30:30 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:30:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:30:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:30:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:30:34 - XML: Processed 648314 elements - found 821 jobs
Thu 16 Jan 2014 19:30:34 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 19:30:35 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 19:30:35 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:30:35 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:30:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:30:38 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:30:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:30:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:30:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:30:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:30:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:30:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:30:40 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:30:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43627393
Thu 16 Jan 2014 19:30:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:30:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43627393
Thu 16 Jan 2014 19:30:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:30:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:30:44 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:30:45 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:30:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:30:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:30:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 19:30:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:30:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 19:30:46 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:30:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9055 values 142773 bits 17846 bytes 
Thu 16 Jan 2014 19:30:50 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:30:50 - job_xml_thread(): Done retrieving: data size 43627393
Thu 16 Jan 2014 19:30:50 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:30:50 - XML: Start document: iteration 20
Thu 16 Jan 2014 19:30:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:30:51 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:30:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:30:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:30:53 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:30:53 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:30:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:30:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:30:53 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:30:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:30:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:31:00 - XML: Processed 652268 elements - found 821 jobs
Thu 16 Jan 2014 19:31:00 - job 7346698 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:31:00 - job 7346699 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:31:00 - job 7346700 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:31:00 - job_xml_thread(): Found 3 updated jobs.
Thu 16 Jan 2014 19:31:00 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 19:31:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:31:02 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:31:02 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Thu 16 Jan 2014 19:31:02 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:31:02 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:31:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:31:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:31:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:31:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:31:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:31:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:31:04 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:31:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43915964
Thu 16 Jan 2014 19:31:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:31:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43915964
Thu 16 Jan 2014 19:31:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:31:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:31:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:31:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:31:13 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:31:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:31:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:31:14 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:31:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:31:14 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:31:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:31:14 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:31:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:31:17 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:31:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:31:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:31:18 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:31:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:31:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:31:18 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:31:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 19:31:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:31:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:31:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:31:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:31:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:31:19 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:31:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43933089
Thu 16 Jan 2014 19:31:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:31:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43933089
Thu 16 Jan 2014 19:31:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:31:20 - job_xml_thread(): Done retrieving: data size 43933089
Thu 16 Jan 2014 19:31:20 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:31:21 - Housekeeping: checking database for timed out jobs..
Thu 16 Jan 2014 19:31:23 - Housekeeping: Found 0 timed out jobs in database: closing entries
Thu 16 Jan 2014 19:31:23 - Housekeeping: done.
Thu 16 Jan 2014 19:31:23 - XML: Start document: iteration 0
Thu 16 Jan 2014 19:31:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:31:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:31:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:31:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:31:37 - XML: Processed 655840 elements - found 821 jobs
Thu 16 Jan 2014 19:31:37 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 19:31:37 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 19:31:37 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:31:37 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:31:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:31:37 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:31:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:31:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:31:38 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:31:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:31:38 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:31:38 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:31:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:31:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:31:40 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:31:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:31:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:31:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:31:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:31:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:31:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:31:42 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:31:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43933673
Thu 16 Jan 2014 19:31:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:31:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43933673
Thu 16 Jan 2014 19:31:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:31:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:31:46 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:31:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:31:50 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:31:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 19:31:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 19:31:51 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:31:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9262 values 146206 bits 18275 bytes 
Thu 16 Jan 2014 19:31:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:31:52 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:31:52 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:31:52 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:31:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:31:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:31:54 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:31:54 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:31:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:31:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:31:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:31:55 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:31:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:31:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:31:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:31:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:31:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:31:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:31:59 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:31:59 - job_xml_thread(): Done retrieving: data size 43923889
Thu 16 Jan 2014 19:31:59 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:31:59 - XML: Start document: iteration 1
Thu 16 Jan 2014 19:31:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43923889
Thu 16 Jan 2014 19:32:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43923889
Thu 16 Jan 2014 19:32:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:32:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:32:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:32:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:32:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:32:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:32:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:32:20 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:32:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:32:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:32:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:32:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:32:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:32:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:32:22 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:32:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:32:22 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:32:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:32:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:32:22 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:32:22 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:32:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:32:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:32:23 - XML: Processed 655840 elements - found 821 jobs
Thu 16 Jan 2014 19:32:23 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 19:32:23 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 19:32:23 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:32:23 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:32:23 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:32:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 19:32:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:32:25 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:32:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43958757
Thu 16 Jan 2014 19:32:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:32:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43958757
Thu 16 Jan 2014 19:32:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:32:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:32:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:32:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:32:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:32:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:32:38 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:32:38 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:32:38 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:32:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:32:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:32:38 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:32:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:32:38 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:32:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:32:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:32:40 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:32:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:32:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:32:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:32:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:32:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:32:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:32:41 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:32:41 - job_xml_thread(): Done retrieving: data size 43952168
Thu 16 Jan 2014 19:32:41 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:32:41 - XML: Start document: iteration 2
Thu 16 Jan 2014 19:32:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43952168
Thu 16 Jan 2014 19:32:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:32:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43952168
Thu 16 Jan 2014 19:32:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:32:46 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Thu 16 Jan 2014 19:32:46 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:32:49 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:32:49 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 19:32:49 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 19:32:49 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:32:49 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 19:32:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:32:52 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:32:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:32:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Thu 16 Jan 2014 19:32:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:32:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 19:32:55 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:32:55 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:32:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 19:32:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9143 values 144626 bits 18078 bytes 
Thu 16 Jan 2014 19:32:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:32:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:32:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:32:57 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:32:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:32:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:32:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:32:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:32:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:32:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:32:58 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:33:01 - XML: Processed 655834 elements - found 818 jobs
Thu 16 Jan 2014 19:33:01 - job 7346595 appears to have finished
Thu 16 Jan 2014 19:33:01 - job 7346629 appears to have finished
Thu 16 Jan 2014 19:33:01 - job 7346610 appears to have finished
Thu 16 Jan 2014 19:33:01 - job 7346506 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:33:01 - job_xml_thread(): Found 4 updated jobs.
Thu 16 Jan 2014 19:33:01 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 19:33:02 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Thu 16 Jan 2014 19:33:02 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:33:02 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:33:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:33:03 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:33:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:33:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:33:04 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:33:04 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:33:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:33:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:33:06 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:33:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43926932
Thu 16 Jan 2014 19:33:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:33:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43926932
Thu 16 Jan 2014 19:33:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:33:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:33:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:33:17 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:33:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:33:18 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:33:18 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:33:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:33:19 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:33:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:33:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:33:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:33:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:33:20 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:33:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 19:33:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:33:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:33:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:33:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:33:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:33:20 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:33:20 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:33:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:33:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:33:21 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:33:21 - job_xml_thread(): Done retrieving: data size 43947247
Thu 16 Jan 2014 19:33:21 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:33:21 - XML: Start document: iteration 3
Thu 16 Jan 2014 19:33:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43947247
Thu 16 Jan 2014 19:33:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:33:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43947247
Thu 16 Jan 2014 19:33:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:33:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:33:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:33:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:33:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:33:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:33:36 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:33:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:33:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:33:39 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:33:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:33:39 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:33:39 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:33:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:33:44 - XML: Processed 655831 elements - found 818 jobs
Thu 16 Jan 2014 19:33:44 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 19:33:44 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 19:33:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:33:45 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:33:45 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:33:45 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:33:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:33:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:33:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:33:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:33:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:33:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:33:47 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:33:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43925961
Thu 16 Jan 2014 19:33:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:33:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43925961
Thu 16 Jan 2014 19:33:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:33:50 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:33:50 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:33:50 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:33:50 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 19:33:50 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 19:33:50 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:33:51 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 19:33:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:33:53 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:33:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:33:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:33:54 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:33:54 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:33:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:33:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:33:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43925961
Thu 16 Jan 2014 19:33:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:33:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:33:55 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:33:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:33:55 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:33:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 19:33:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 19:33:55 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:33:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8701 values 137334 bits 17166 bytes 
Thu 16 Jan 2014 19:34:00 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:34:00 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:34:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:34:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:34:03 - size of cluster 'LISA Cluster': 624 hosts 79467 metrics 943567 values 14914583 bits 1864322 bytes 
Thu 16 Jan 2014 19:34:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:34:05 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:34:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:34:08 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:34:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:34:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:34:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:34:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:34:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:34:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:34:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:34:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:34:10 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:34:10 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:34:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:34:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:34:12 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:34:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 19:34:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:34:12 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:34:12 - job_xml_thread(): Done retrieving: data size 43925648
Thu 16 Jan 2014 19:34:12 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:34:12 - XML: Start document: iteration 4
Thu 16 Jan 2014 19:34:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43925648
Thu 16 Jan 2014 19:34:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:34:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43925648
Thu 16 Jan 2014 19:34:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:34:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:34:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:34:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:34:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:34:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:34:26 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:34:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:34:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:34:28 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:34:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:34:28 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:34:28 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:34:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:34:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:34:33 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:34:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:34:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:34:34 - XML: Processed 655834 elements - found 818 jobs
Thu 16 Jan 2014 19:34:34 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 19:34:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:34:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:34:34 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 19:34:34 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:34:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:34:34 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:34:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:34:38 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:34:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43928967
Thu 16 Jan 2014 19:34:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:34:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43928967
Thu 16 Jan 2014 19:34:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:34:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:34:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:34:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:34:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:34:49 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:34:49 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:34:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:34:51 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:34:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:34:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:34:52 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:34:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:34:52 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:34:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:34:52 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:34:52 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 19:34:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:34:54 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:34:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:34:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:34:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:34:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:34:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:34:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:34:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:34:55 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:34:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:34:56 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:34:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 19:34:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 19:34:56 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:34:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99077 bits 12384 bytes 
Thu 16 Jan 2014 19:34:57 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:34:57 - job_xml_thread(): Done retrieving: data size 43938620
Thu 16 Jan 2014 19:34:57 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:34:57 - XML: Start document: iteration 5
Thu 16 Jan 2014 19:34:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43938620
Thu 16 Jan 2014 19:34:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:34:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43938620
Thu 16 Jan 2014 19:34:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:35:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:35:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:35:08 - XML: Processed 655832 elements - found 817 jobs
Thu 16 Jan 2014 19:35:08 - job 7346701 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:35:08 - job 7346448 appears to have finished
Thu 16 Jan 2014 19:35:08 - job 7346511 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:35:08 - job 7346702 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:35:08 - job_xml_thread(): Found 4 updated jobs.
Thu 16 Jan 2014 19:35:08 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 19:35:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:35:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:35:13 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Thu 16 Jan 2014 19:35:13 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:35:13 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:35:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:35:17 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:35:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:35:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:35:18 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:35:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:35:18 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:35:18 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:35:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:35:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:35:19 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:35:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:35:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:35:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:35:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:35:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:35:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:35:24 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:35:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 19:35:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:35:24 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:35:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870626
Thu 16 Jan 2014 19:35:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:35:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870626
Thu 16 Jan 2014 19:35:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:35:28 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:35:28 - job_xml_thread(): Done retrieving: data size 43870626
Thu 16 Jan 2014 19:35:28 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:35:28 - XML: Start document: iteration 6
Thu 16 Jan 2014 19:35:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:35:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:35:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:35:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:35:43 - XML: Processed 655084 elements - found 817 jobs
Thu 16 Jan 2014 19:35:43 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 19:35:43 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 19:35:43 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:35:43 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:35:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:35:45 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:35:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:35:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:35:46 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:35:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:35:46 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:35:46 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:35:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:35:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:35:48 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:35:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:35:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:35:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:35:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:35:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:35:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:35:52 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:35:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43287116
Thu 16 Jan 2014 19:35:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:35:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43287116
Thu 16 Jan 2014 19:35:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:35:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:35:57 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:35:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:35:57 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:35:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 19:35:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 19:35:58 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:35:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6633 values 104579 bits 13072 bytes 
Thu 16 Jan 2014 19:35:58 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:35:58 - job_xml_thread(): Done retrieving: data size 43287116
Thu 16 Jan 2014 19:35:58 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:35:58 - XML: Start document: iteration 7
Thu 16 Jan 2014 19:36:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:36:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:36:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:36:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:36:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:36:08 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:36:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:36:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:36:09 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:36:09 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:36:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:36:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:36:09 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:36:15 - XML: Processed 647812 elements - found 817 jobs
Thu 16 Jan 2014 19:36:15 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 19:36:15 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 19:36:15 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:36:15 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:36:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:36:17 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:36:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:36:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:36:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:36:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:36:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:36:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:36:21 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:36:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43315891
Thu 16 Jan 2014 19:36:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:36:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43315891
Thu 16 Jan 2014 19:36:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:36:22 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:36:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 19:36:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:36:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:36:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:36:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:36:29 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:36:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:36:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:36:30 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:36:30 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:36:30 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:36:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:36:30 - job_xml_thread(): Done retrieving: data size 43315891
Thu 16 Jan 2014 19:36:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:36:30 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:36:30 - XML: Start document: iteration 8
Thu 16 Jan 2014 19:36:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43315891
Thu 16 Jan 2014 19:36:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:36:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:36:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:36:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:36:43 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:36:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:36:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:36:45 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:36:45 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:36:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:36:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:36:45 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:36:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:36:50 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:36:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:36:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:36:51 - XML: Processed 648306 elements - found 817 jobs
Thu 16 Jan 2014 19:36:51 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 19:36:51 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 19:36:51 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:36:51 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:36:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:36:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:36:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:36:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:36:55 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:36:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870512
Thu 16 Jan 2014 19:36:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:36:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870512
Thu 16 Jan 2014 19:36:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:36:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:36:58 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:36:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:36:59 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:36:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 19:36:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 19:36:59 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:36:59 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99037 bits 12379 bytes 
Thu 16 Jan 2014 19:37:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:37:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:37:06 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:37:06 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:37:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:37:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:37:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:37:08 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:37:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:37:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:37:10 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:37:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:37:10 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:37:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:37:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:37:11 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:37:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:37:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:37:12 - Leaving storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 19:37:12 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Thu 16 Jan 2014 19:37:12 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:37:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:37:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:37:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:37:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:37:14 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:37:14 - job_xml_thread(): Done retrieving: data size 43913687
Thu 16 Jan 2014 19:37:14 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:37:14 - XML: Start document: iteration 9
Thu 16 Jan 2014 19:37:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43913687
Thu 16 Jan 2014 19:37:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:37:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43913687
Thu 16 Jan 2014 19:37:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:37:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:37:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:37:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:37:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:37:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:37:33 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:37:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:37:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:37:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:37:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:37:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:37:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:37:34 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:37:35 - XML: Processed 655826 elements - found 814 jobs
Thu 16 Jan 2014 19:37:35 - job 7346590 appears to have finished
Thu 16 Jan 2014 19:37:35 - job 7346703 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:37:35 - job 7346513 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:37:35 - job 7346612 appears to have finished
Thu 16 Jan 2014 19:37:35 - job 7346616 appears to have finished
Thu 16 Jan 2014 19:37:35 - job_xml_thread(): Found 5 updated jobs.
Thu 16 Jan 2014 19:37:35 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 19:37:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:37:36 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:37:36 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Thu 16 Jan 2014 19:37:36 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:37:36 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:37:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:37:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:37:36 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:37:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 19:37:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:37:36 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:37:36 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:37:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:37:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:37:38 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:37:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43943065
Thu 16 Jan 2014 19:37:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:37:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43943065
Thu 16 Jan 2014 19:37:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:37:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:37:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:37:51 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:37:51 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:37:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:37:51 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:37:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:37:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:37:52 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:37:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:37:52 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:37:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:37:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:37:53 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:37:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:37:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:37:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:37:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:37:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:37:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:37:56 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:37:56 - job_xml_thread(): Done retrieving: data size 43936790
Thu 16 Jan 2014 19:37:56 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:37:56 - XML: Start document: iteration 10
Thu 16 Jan 2014 19:37:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43936790
Thu 16 Jan 2014 19:37:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:37:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43936790
Thu 16 Jan 2014 19:37:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:37:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:37:59 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:38:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:38:01 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:38:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 19:38:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 19:38:02 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:38:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9093 values 143426 bits 17928 bytes 
Thu 16 Jan 2014 19:38:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:38:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:38:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:38:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:38:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:38:11 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:38:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:38:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:38:13 - XML: Processed 655826 elements - found 814 jobs
Thu 16 Jan 2014 19:38:13 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 19:38:13 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 19:38:13 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:38:13 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:38:13 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:38:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:38:13 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:38:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:38:13 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:38:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:38:18 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:38:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:38:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:38:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:38:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:38:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:38:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:38:21 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:38:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 19:38:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:38:21 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:38:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43934871
Thu 16 Jan 2014 19:38:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:38:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43934871
Thu 16 Jan 2014 19:38:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:38:28 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:38:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:38:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:38:28 - job_xml_thread(): Done retrieving: data size 43934871
Thu 16 Jan 2014 19:38:28 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:38:28 - XML: Start document: iteration 11
Thu 16 Jan 2014 19:38:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:38:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:38:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:38:39 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:38:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:38:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:38:40 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:38:40 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:38:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:38:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:38:40 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:38:42 - XML: Processed 655826 elements - found 814 jobs
Thu 16 Jan 2014 19:38:42 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 19:38:42 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 19:38:42 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:38:42 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:38:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:38:45 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:38:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:38:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:38:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:38:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:38:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:38:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:38:46 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:38:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43936596
Thu 16 Jan 2014 19:38:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:38:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43936596
Thu 16 Jan 2014 19:38:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:38:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:38:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:38:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:38:57 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:38:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:38:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:38:57 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:38:57 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:38:58 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:38:58 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:38:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:38:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:39:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:39:00 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:39:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:39:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:39:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:39:01 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:39:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:39:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:39:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:39:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:39:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:39:02 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:39:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 19:39:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 19:39:02 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:39:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6139 values 96793 bits 12099 bytes 
Thu 16 Jan 2014 19:39:02 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:39:02 - job_xml_thread(): Done retrieving: data size 43937688
Thu 16 Jan 2014 19:39:02 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:39:02 - XML: Start document: iteration 12
Thu 16 Jan 2014 19:39:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43937688
Thu 16 Jan 2014 19:39:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:39:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43937688
Thu 16 Jan 2014 19:39:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:39:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:39:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:39:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:39:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:39:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:39:17 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:39:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:39:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:39:18 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:39:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:39:18 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:39:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:39:18 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:39:22 - XML: Processed 655822 elements - found 812 jobs
Thu 16 Jan 2014 19:39:22 - job 7346605 appears to have finished
Thu 16 Jan 2014 19:39:22 - job 7346704 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:39:22 - job 7346593 appears to have finished
Thu 16 Jan 2014 19:39:22 - job_xml_thread(): Found 3 updated jobs.
Thu 16 Jan 2014 19:39:22 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 19:39:22 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Thu 16 Jan 2014 19:39:23 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:39:23 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:39:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:39:25 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:39:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:39:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:39:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:39:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:39:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:39:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:39:27 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:39:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43899458
Thu 16 Jan 2014 19:39:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:39:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43899458
Thu 16 Jan 2014 19:39:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:39:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:39:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:39:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:39:38 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:39:38 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:39:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:39:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:39:38 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:39:39 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:39:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:39:39 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:39:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:39:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:39:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:39:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:39:43 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:39:43 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:39:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 19:39:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:39:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:39:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:39:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:39:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:39:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:39:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:39:45 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:39:45 - job_xml_thread(): Done retrieving: data size 43916329
Thu 16 Jan 2014 19:39:45 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:39:45 - XML: Start document: iteration 13
Thu 16 Jan 2014 19:39:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43916329
Thu 16 Jan 2014 19:39:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:39:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43916329
Thu 16 Jan 2014 19:39:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:39:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:39:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:39:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:39:58 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:39:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:39:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:39:58 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:39:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:39:58 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:39:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:39:59 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:39:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:39:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:40:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:40:02 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:40:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:40:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 19:40:03 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:40:03 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:40:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 19:40:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6467 values 101963 bits 12745 bytes 
Thu 16 Jan 2014 19:40:04 - XML: Processed 655822 elements - found 812 jobs
Thu 16 Jan 2014 19:40:04 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 19:40:04 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 19:40:05 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:40:05 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:40:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:40:08 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:40:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:40:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:40:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:40:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:40:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:40:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:40:11 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:40:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43910530
Thu 16 Jan 2014 19:40:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:40:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43910530
Thu 16 Jan 2014 19:40:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:40:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:40:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:40:20 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:40:20 - job_xml_thread(): Done retrieving: data size 43910530
Thu 16 Jan 2014 19:40:20 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:40:20 - XML: Start document: iteration 14
Thu 16 Jan 2014 19:40:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:40:23 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:40:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:40:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:40:23 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:40:23 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:40:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:40:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:40:24 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:40:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:40:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:40:33 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:40:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 19:40:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:40:33 - XML: Processed 655822 elements - found 812 jobs
Thu 16 Jan 2014 19:40:33 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 19:40:33 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 19:40:33 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:40:33 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:40:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:40:35 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:40:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:40:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:40:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:40:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:40:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:40:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:40:37 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:40:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43908586
Thu 16 Jan 2014 19:40:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:40:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43908586
Thu 16 Jan 2014 19:40:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:40:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:40:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:40:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:40:47 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:40:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:40:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:40:47 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:40:47 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:40:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:40:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:40:48 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:40:48 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:40:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:40:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:40:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:40:51 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:40:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:40:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:40:52 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Thu 16 Jan 2014 19:40:52 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:40:52 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:40:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:40:52 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:40:52 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 19:40:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:40:52 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 19:40:52 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 19:40:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:40:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:40:53 - size of cluster 'LISA Cluster': 624 hosts 79477 metrics 860753 values 13583595 bits 1697949 bytes 
Thu 16 Jan 2014 19:40:55 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:40:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43929465
Thu 16 Jan 2014 19:40:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:40:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43929465
Thu 16 Jan 2014 19:40:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:40:57 - job_xml_thread(): Done retrieving: data size 43929465
Thu 16 Jan 2014 19:40:57 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:40:57 - XML: Start document: iteration 15
Thu 16 Jan 2014 19:41:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:41:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:41:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:41:03 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:41:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:41:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 19:41:04 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:41:04 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:41:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 19:41:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8993 values 141817 bits 17727 bytes 
Thu 16 Jan 2014 19:41:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:41:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:41:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:41:10 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:41:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:41:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:41:11 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:41:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:41:11 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:41:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:41:11 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:41:14 - XML: Processed 655820 elements - found 811 jobs
Thu 16 Jan 2014 19:41:14 - job 7346689 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:41:14 - job 7346705 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:41:14 - job 7346514 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:41:14 - job 7346706 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:41:14 - job 7346602 appears to have finished
Thu 16 Jan 2014 19:41:14 - job 7346686 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:41:14 - job_xml_thread(): Found 6 updated jobs.
Thu 16 Jan 2014 19:41:14 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 19:41:15 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Thu 16 Jan 2014 19:41:15 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:41:15 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:41:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:41:18 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:41:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:41:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:41:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:41:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:41:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:41:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:41:21 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:41:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 19:41:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:41:21 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:41:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43859073
Thu 16 Jan 2014 19:41:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:41:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43859073
Thu 16 Jan 2014 19:41:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:41:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:41:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:41:30 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:41:30 - job_xml_thread(): Done retrieving: data size 43859073
Thu 16 Jan 2014 19:41:31 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:41:31 - XML: Start document: iteration 16
Thu 16 Jan 2014 19:41:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:41:32 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:41:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:41:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:41:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:41:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:41:35 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:41:35 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:41:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:41:35 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:41:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:41:43 - XML: Processed 655072 elements - found 811 jobs
Thu 16 Jan 2014 19:41:43 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 19:41:43 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 19:41:43 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:41:43 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:41:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:41:45 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:41:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:41:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:41:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:41:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:41:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:41:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:41:49 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:41:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43340986
Thu 16 Jan 2014 19:41:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:41:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43340986
Thu 16 Jan 2014 19:41:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:41:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:41:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:41:52 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:41:53 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 19:41:59 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:41:59 - job_xml_thread(): Done retrieving: data size 43340986
Thu 16 Jan 2014 19:41:59 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:41:59 - XML: Start document: iteration 17
Thu 16 Jan 2014 19:42:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:42:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:42:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:42:01 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:42:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:42:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:42:02 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:42:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:42:02 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:42:02 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:42:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:42:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:42:04 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:42:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:42:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 19:42:05 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:42:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 19:42:05 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:42:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99062 bits 12382 bytes 
Thu 16 Jan 2014 19:42:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:42:12 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:42:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:42:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:42:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:42:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:42:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:42:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:42:13 - XML: Processed 648894 elements - found 811 jobs
Thu 16 Jan 2014 19:42:13 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 19:42:13 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 19:42:13 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:42:13 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:42:16 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:42:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43294377
Thu 16 Jan 2014 19:42:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:42:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43294377
Thu 16 Jan 2014 19:42:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:42:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:42:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:42:21 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:42:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 19:42:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:42:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:42:26 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:42:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:42:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:42:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:42:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:42:27 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:42:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:42:27 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:42:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:42:27 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:42:28 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:42:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:42:31 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:42:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:42:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:42:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:42:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:42:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:42:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:42:34 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:42:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43700964
Thu 16 Jan 2014 19:42:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:42:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43700964
Thu 16 Jan 2014 19:42:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:42:35 - job_xml_thread(): Done retrieving: data size 43700964
Thu 16 Jan 2014 19:42:35 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:42:35 - XML: Start document: iteration 18
Thu 16 Jan 2014 19:42:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:42:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:42:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:42:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:42:51 - XML: Processed 653080 elements - found 806 jobs
Thu 16 Jan 2014 19:42:51 - job 7346599 appears to have finished
Thu 16 Jan 2014 19:42:51 - job 7346598 appears to have finished
Thu 16 Jan 2014 19:42:51 - job 7346665 appears to have finished
Thu 16 Jan 2014 19:42:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:42:51 - job 7346619 appears to have finished
Thu 16 Jan 2014 19:42:51 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:42:51 - job 7346600 appears to have finished
Thu 16 Jan 2014 19:42:51 - job_xml_thread(): Found 5 updated jobs.
Thu 16 Jan 2014 19:42:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:42:51 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 19:42:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:42:51 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:42:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:42:51 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:42:51 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:42:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:42:52 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Thu 16 Jan 2014 19:42:52 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:42:52 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:42:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:42:56 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:42:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:42:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:42:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:42:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:42:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:42:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:42:59 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:42:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43892651
Thu 16 Jan 2014 19:42:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:42:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43892651
Thu 16 Jan 2014 19:42:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:43:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:43:06 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:43:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:43:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:43:07 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:43:07 - job_xml_thread(): Done retrieving: data size 43892651
Thu 16 Jan 2014 19:43:07 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:43:07 - XML: Start document: iteration 19
Thu 16 Jan 2014 19:43:07 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:43:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:43:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 19:43:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 19:43:08 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:43:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9348 values 147425 bits 18428 bytes 
Thu 16 Jan 2014 19:43:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:43:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:43:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:43:14 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:43:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:43:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:43:15 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:43:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:43:15 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:43:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:43:15 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:43:21 - XML: Processed 655683 elements - found 807 jobs
Thu 16 Jan 2014 19:43:21 - job 7346706 field 'start_timestamp' changed since saved from: 1389897610 to: 1389897590
Thu 16 Jan 2014 19:43:21 - job 7346707 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:43:21 - job_xml_thread(): Found 3 updated jobs.
Thu 16 Jan 2014 19:43:21 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 19:43:22 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Thu 16 Jan 2014 19:43:22 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:43:22 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:43:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:43:23 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:43:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:43:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:43:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:43:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:43:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:43:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:43:26 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:43:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 19:43:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:43:27 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:43:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43917142
Thu 16 Jan 2014 19:43:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:43:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43917142
Thu 16 Jan 2014 19:43:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:43:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:43:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:43:37 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:43:37 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:43:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:43:38 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:43:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:43:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:43:39 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:43:39 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:43:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:43:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:43:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:43:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:43:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:43:42 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:43:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:43:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:43:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:43:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:43:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:43:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:43:46 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:43:46 - job_xml_thread(): Done retrieving: data size 43903808
Thu 16 Jan 2014 19:43:46 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:43:46 - XML: Start document: iteration 20
Thu 16 Jan 2014 19:43:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43903808
Thu 16 Jan 2014 19:43:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:43:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43903808
Thu 16 Jan 2014 19:43:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:43:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:43:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:43:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:43:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:44:00 - XML: Processed 655812 elements - found 807 jobs
Thu 16 Jan 2014 19:44:00 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 19:44:00 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 19:44:00 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:44:00 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:44:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:44:05 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:44:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:44:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:44:07 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:44:07 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:44:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:44:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:44:07 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:44:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:44:08 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:44:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:44:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 19:44:08 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:44:08 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:44:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 19:44:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99027 bits 12378 bytes 
Thu 16 Jan 2014 19:44:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:44:09 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:44:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:44:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:44:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:44:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:44:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:44:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:44:12 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:44:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43926337
Thu 16 Jan 2014 19:44:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:44:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43926337
Thu 16 Jan 2014 19:44:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:44:15 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:44:15 - job_xml_thread(): Done retrieving: data size 43926337
Thu 16 Jan 2014 19:44:15 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:44:15 - Housekeeping: checking database for timed out jobs..
Thu 16 Jan 2014 19:44:16 - Housekeeping: Found 0 timed out jobs in database: closing entries
Thu 16 Jan 2014 19:44:16 - Housekeeping: done.
Thu 16 Jan 2014 19:44:16 - XML: Start document: iteration 0
Thu 16 Jan 2014 19:44:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:44:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:44:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:44:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:44:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:44:27 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:44:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:44:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:44:28 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:44:28 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:44:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:44:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:44:28 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:44:35 - XML: Processed 655810 elements - found 807 jobs
Thu 16 Jan 2014 19:44:35 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 19:44:35 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 19:44:35 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:44:35 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:44:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:44:37 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:44:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:44:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:44:38 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:44:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 19:44:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:44:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:44:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:44:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:44:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:44:41 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:44:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43919505
Thu 16 Jan 2014 19:44:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:44:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43919505
Thu 16 Jan 2014 19:44:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:44:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:44:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:44:50 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:44:50 - job_xml_thread(): Done retrieving: data size 43919505
Thu 16 Jan 2014 19:44:50 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:44:50 - XML: Start document: iteration 1
Thu 16 Jan 2014 19:44:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:44:52 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:44:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:44:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:44:52 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:44:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:44:52 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:44:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:44:52 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:44:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:44:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:45:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:45:01 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:45:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:45:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:45:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:45:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:45:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:45:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:45:03 - XML: Processed 655806 elements - found 804 jobs
Thu 16 Jan 2014 19:45:03 - job 7346620 appears to have finished
Thu 16 Jan 2014 19:45:03 - job 7346615 appears to have finished
Thu 16 Jan 2014 19:45:03 - job 7346463 appears to have finished
Thu 16 Jan 2014 19:45:03 - job_xml_thread(): Found 3 updated jobs.
Thu 16 Jan 2014 19:45:03 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 19:45:03 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Thu 16 Jan 2014 19:45:03 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:45:03 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:45:05 - Leaving storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 19:45:05 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Thu 16 Jan 2014 19:45:05 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:45:06 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:45:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43909510
Thu 16 Jan 2014 19:45:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:45:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43909510
Thu 16 Jan 2014 19:45:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:45:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:45:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:45:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:45:09 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:45:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:45:12 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:45:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 19:45:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 19:45:12 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:45:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8627 values 135981 bits 16997 bytes 
Thu 16 Jan 2014 19:45:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:45:15 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:45:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:45:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:45:16 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:45:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:45:16 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:45:16 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:45:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:45:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:45:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:45:18 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:45:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:45:20 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:45:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:45:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:45:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:45:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:45:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:45:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:45:23 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:45:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43929653
Thu 16 Jan 2014 19:45:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:45:23 - job_xml_thread(): Done retrieving: data size 43929653
Thu 16 Jan 2014 19:45:24 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:45:24 - XML: Start document: iteration 2
Thu 16 Jan 2014 19:45:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43929653
Thu 16 Jan 2014 19:45:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:45:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:45:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:45:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:45:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:45:40 - XML: Processed 655808 elements - found 805 jobs
Thu 16 Jan 2014 19:45:40 - job 7346708 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:45:40 - job 7346709 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:45:40 - job 7346519 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:45:40 - job 7346734 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:45:40 - job 7346516 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:45:40 - job 7346710 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:45:40 - job_xml_thread(): Found 7 updated jobs.
Thu 16 Jan 2014 19:45:40 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 19:45:43 - job_xml_thread(): Done storing. succesfully stored: 7 jobs
Thu 16 Jan 2014 19:45:43 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:45:43 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:45:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:45:44 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:45:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:45:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:45:45 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:45:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:45:45 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:45:45 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:45:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:45:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:45:46 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:45:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:45:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:45:46 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:45:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 19:45:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:45:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:45:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:45:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:45:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:45:48 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:45:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43941328
Thu 16 Jan 2014 19:45:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:45:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43941328
Thu 16 Jan 2014 19:45:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:45:58 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:45:58 - job_xml_thread(): Done retrieving: data size 43941328
Thu 16 Jan 2014 19:45:58 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:45:58 - XML: Start document: iteration 3
Thu 16 Jan 2014 19:46:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:46:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:46:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:46:01 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:46:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:46:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:46:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:46:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:46:03 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:46:03 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:46:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:46:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:46:03 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:46:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:46:07 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:46:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:46:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:46:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:46:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:46:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:46:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:46:08 - XML: Processed 655808 elements - found 805 jobs
Thu 16 Jan 2014 19:46:08 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 19:46:08 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 19:46:08 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:46:08 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:46:11 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:46:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43922061
Thu 16 Jan 2014 19:46:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:46:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:46:12 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:46:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43922061
Thu 16 Jan 2014 19:46:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:46:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:46:14 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:46:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 19:46:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 19:46:14 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:46:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8998 values 141932 bits 17741 bytes 
Thu 16 Jan 2014 19:46:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:46:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:46:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:46:19 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:46:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:46:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:46:19 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:46:19 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:46:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:46:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:46:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43922061
Thu 16 Jan 2014 19:46:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:46:23 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:46:24 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:46:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:46:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:46:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:46:31 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:46:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:46:33 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:46:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:46:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:46:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:46:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:46:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:46:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:46:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:46:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:46:35 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:46:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:46:35 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:46:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:46:36 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:46:36 - job_xml_thread(): Done retrieving: data size 43917872
Thu 16 Jan 2014 19:46:36 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:46:36 - XML: Start document: iteration 4
Thu 16 Jan 2014 19:46:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43917872
Thu 16 Jan 2014 19:46:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:46:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43917872
Thu 16 Jan 2014 19:46:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:46:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:46:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:46:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:46:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:46:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:46:52 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:46:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:46:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:46:53 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:46:53 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:46:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:46:53 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:46:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:46:58 - XML: Processed 655808 elements - found 805 jobs
Thu 16 Jan 2014 19:46:58 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 19:46:58 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 19:46:58 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:46:58 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:46:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:46:59 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:46:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:46:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:46:59 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:46:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 19:46:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:47:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:47:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:47:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:47:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:47:01 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:47:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43915524
Thu 16 Jan 2014 19:47:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:47:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43915524
Thu 16 Jan 2014 19:47:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:47:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:47:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:47:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:47:10 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:47:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:47:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:47:11 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:47:11 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:47:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:47:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:47:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43915524
Thu 16 Jan 2014 19:47:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:47:13 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:47:13 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:47:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:47:14 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:47:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:47:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:47:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:47:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 19:47:15 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:47:15 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:47:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 19:47:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5710 values 90192 bits 11274 bytes 
Thu 16 Jan 2014 19:47:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:47:19 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:47:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:47:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:47:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:47:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:47:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:47:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:47:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:47:23 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:47:25 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:47:25 - job_xml_thread(): Done retrieving: data size 43851538
Thu 16 Jan 2014 19:47:25 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:47:25 - XML: Start document: iteration 5
Thu 16 Jan 2014 19:47:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851538
Thu 16 Jan 2014 19:47:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:47:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:47:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:47:28 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:47:28 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:47:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:47:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:47:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851538
Thu 16 Jan 2014 19:47:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:47:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:47:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:47:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:47:40 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:47:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:47:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:47:44 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:47:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:47:44 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:47:44 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:47:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:47:45 - XML: Processed 655051 elements - found 801 jobs
Thu 16 Jan 2014 19:47:45 - job 7345759 appears to have finished
Thu 16 Jan 2014 19:47:45 - job 7346521 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:47:45 - job 7346495 appears to have finished
Thu 16 Jan 2014 19:47:45 - job 7346519 field 'start_timestamp' changed since saved from: 1389897866 to: 1389897840
Thu 16 Jan 2014 19:47:45 - job 7346518 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:47:45 - job 7346750 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:47:45 - job 7346517 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:47:45 - job 7346710 field 'start_timestamp' changed since saved from: 1389897888 to: 1389897840
Thu 16 Jan 2014 19:47:45 - job 7346669 appears to have finished
Thu 16 Jan 2014 19:47:45 - job 7346622 appears to have finished
Thu 16 Jan 2014 19:47:45 - job 7346520 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:47:45 - job_xml_thread(): Found 11 updated jobs.
Thu 16 Jan 2014 19:47:45 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 19:47:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:47:46 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:47:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:47:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:47:46 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:47:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 19:47:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:47:46 - job_xml_thread(): Done storing. succesfully stored: 11 jobs
Thu 16 Jan 2014 19:47:46 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:47:46 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:47:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:47:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:47:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:47:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:47:48 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:47:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43309188
Thu 16 Jan 2014 19:47:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:47:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43309188
Thu 16 Jan 2014 19:47:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:47:53 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Thu 16 Jan 2014 19:47:53 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:47:54 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:47:54 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:47:54 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 19:47:54 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 19:47:54 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 19:47:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:47:58 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:48:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:48:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:48:01 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:48:01 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:48:01 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:48:01 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:48:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:48:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:48:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:48:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:48:02 - size of cluster 'LISA Cluster': 624 hosts 79473 metrics 797397 values 12598867 bits 1574858 bytes 
Thu 16 Jan 2014 19:48:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:48:04 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:48:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:48:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:48:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:48:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:48:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:48:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:48:08 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:48:08 - job_xml_thread(): Done retrieving: data size 43271067
Thu 16 Jan 2014 19:48:08 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:48:08 - XML: Start document: iteration 6
Thu 16 Jan 2014 19:48:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43271067
Thu 16 Jan 2014 19:48:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:48:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43271067
Thu 16 Jan 2014 19:48:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:48:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:48:15 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:48:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:48:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 19:48:16 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:48:16 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:48:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 19:48:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:48:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:48:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8912 values 140957 bits 17619 bytes 
Thu 16 Jan 2014 19:48:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:48:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:48:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:48:21 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:48:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:48:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:48:22 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:48:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:48:22 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:48:22 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:48:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:48:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:48:29 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:48:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:48:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:48:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:48:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:48:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:48:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:48:32 - XML: Processed 647600 elements - found 801 jobs
Thu 16 Jan 2014 19:48:32 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 19:48:32 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 19:48:32 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:48:32 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:48:35 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:48:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43517544
Thu 16 Jan 2014 19:48:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:48:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43517544
Thu 16 Jan 2014 19:48:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:48:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:48:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:48:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:48:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:48:46 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:48:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 19:48:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:48:47 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:48:47 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:48:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:48:49 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:48:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:48:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:48:49 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:48:49 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:48:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:48:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:48:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:48:52 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:48:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:48:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:48:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:48:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:48:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:48:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:48:54 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:48:54 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 19:48:55 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:48:55 - job_xml_thread(): Done retrieving: data size 43862834
Thu 16 Jan 2014 19:48:55 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:48:55 - XML: Start document: iteration 7
Thu 16 Jan 2014 19:48:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862834
Thu 16 Jan 2014 19:48:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862834
Thu 16 Jan 2014 19:48:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:48:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:49:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:49:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:49:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:49:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:49:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:49:15 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:49:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:49:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:49:15 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:49:15 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:49:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:49:16 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:49:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:49:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:49:16 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:49:16 - XML: Processed 655030 elements - found 796 jobs
Thu 16 Jan 2014 19:49:16 - job 7346632 appears to have finished
Thu 16 Jan 2014 19:49:16 - job 7346636 appears to have finished
Thu 16 Jan 2014 19:49:16 - job 7346613 appears to have finished
Thu 16 Jan 2014 19:49:16 - job 7346522 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:49:16 - job 7346524 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:49:16 - job 7346607 appears to have finished
Thu 16 Jan 2014 19:49:16 - job 7346606 appears to have finished
Thu 16 Jan 2014 19:49:16 - job_xml_thread(): Found 7 updated jobs.
Thu 16 Jan 2014 19:49:16 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 19:49:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:49:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 19:49:17 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:49:17 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:49:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6164 values 97258 bits 12157 bytes 
Thu 16 Jan 2014 19:49:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 19:49:17 - job_xml_thread(): Done storing. succesfully stored: 7 jobs
Thu 16 Jan 2014 19:49:17 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:49:17 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:49:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:49:19 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:49:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:49:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:49:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:49:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:49:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:49:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:49:24 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:49:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43923571
Thu 16 Jan 2014 19:49:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:49:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43923571
Thu 16 Jan 2014 19:49:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:49:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:49:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:49:32 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:49:32 - job_xml_thread(): Done retrieving: data size 43923571
Thu 16 Jan 2014 19:49:32 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:49:32 - XML: Start document: iteration 8
Thu 16 Jan 2014 19:49:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:49:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:49:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:49:39 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:49:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:49:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:49:40 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:49:40 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:49:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:49:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:49:40 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:49:45 - XML: Processed 655790 elements - found 796 jobs
Thu 16 Jan 2014 19:49:45 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 19:49:45 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 19:49:45 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:49:45 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:49:46 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:49:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 19:49:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:49:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:49:48 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:49:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:49:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:49:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:49:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:49:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:49:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:49:51 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:49:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43914798
Thu 16 Jan 2014 19:49:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:49:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43914798
Thu 16 Jan 2014 19:49:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:49:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:49:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:50:00 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:50:00 - job_xml_thread(): Done retrieving: data size 43914798
Thu 16 Jan 2014 19:50:00 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:50:01 - XML: Start document: iteration 9
Thu 16 Jan 2014 19:50:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:50:01 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:50:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:50:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:50:02 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:50:02 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:50:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:50:02 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:50:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:50:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:50:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:50:13 - XML: Processed 655790 elements - found 796 jobs
Thu 16 Jan 2014 19:50:13 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 19:50:13 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 19:50:13 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:50:13 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:50:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:50:14 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:50:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:50:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:50:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:50:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:50:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:50:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:50:16 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:50:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43887194
Thu 16 Jan 2014 19:50:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:50:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:50:17 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:50:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:50:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:50:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43887194
Thu 16 Jan 2014 19:50:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:50:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:50:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 19:50:18 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:50:18 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:50:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9118 values 143830 bits 17978 bytes 
Thu 16 Jan 2014 19:50:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 19:50:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:50:27 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:50:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:50:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:50:28 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:50:28 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:50:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:50:28 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:50:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:50:28 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:50:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:50:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:50:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:50:31 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:50:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:50:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:50:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:50:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:50:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:50:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:50:34 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:50:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43929330
Thu 16 Jan 2014 19:50:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:50:34 - job_xml_thread(): Done retrieving: data size 43929330
Thu 16 Jan 2014 19:50:34 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:50:34 - XML: Start document: iteration 10
Thu 16 Jan 2014 19:50:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43929330
Thu 16 Jan 2014 19:50:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:50:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:50:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:50:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:50:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:50:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:50:54 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:50:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:50:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:50:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:50:55 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:50:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:50:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:50:56 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:50:56 - XML: Processed 655790 elements - found 796 jobs
Thu 16 Jan 2014 19:50:56 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:50:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:50:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:50:56 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:50:56 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 19:50:56 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 19:50:56 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:50:56 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:50:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:50:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:50:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:50:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:50:57 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:50:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 19:50:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:51:02 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:51:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43916441
Thu 16 Jan 2014 19:51:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:51:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43916441
Thu 16 Jan 2014 19:51:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:51:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:51:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:51:12 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:51:12 - job_xml_thread(): Done retrieving: data size 43916441
Thu 16 Jan 2014 19:51:12 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:51:12 - XML: Start document: iteration 11
Thu 16 Jan 2014 19:51:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:51:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:51:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:51:13 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:51:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:51:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:51:13 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:51:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:51:13 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:51:13 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:51:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:51:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:51:19 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:51:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:51:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 19:51:19 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:51:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 19:51:20 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:51:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5693 values 89698 bits 11212 bytes 
Thu 16 Jan 2014 19:51:21 - XML: Processed 655786 elements - found 794 jobs
Thu 16 Jan 2014 19:51:21 - job 7346645 appears to have finished
Thu 16 Jan 2014 19:51:21 - job 7346529 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:51:21 - job 7346640 appears to have finished
Thu 16 Jan 2014 19:51:21 - job 7346542 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:51:21 - job 7346528 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:51:21 - job_xml_thread(): Found 5 updated jobs.
Thu 16 Jan 2014 19:51:22 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 19:51:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:51:22 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:51:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:51:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:51:23 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Thu 16 Jan 2014 19:51:23 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:51:23 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:51:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:51:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:51:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:51:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:51:28 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:51:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43911358
Thu 16 Jan 2014 19:51:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:51:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:51:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:51:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43911358
Thu 16 Jan 2014 19:51:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:51:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:51:38 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:51:38 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:51:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:51:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:51:43 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:51:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:51:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:51:43 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:51:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:51:43 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:51:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:51:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:51:45 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:51:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:51:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:51:45 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:51:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 19:51:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:51:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:51:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:51:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:51:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:51:48 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:51:48 - job_xml_thread(): Done retrieving: data size 43909014
Thu 16 Jan 2014 19:51:48 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:51:48 - XML: Start document: iteration 12
Thu 16 Jan 2014 19:51:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43909014
Thu 16 Jan 2014 19:51:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43909014
Thu 16 Jan 2014 19:51:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:51:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:51:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:51:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:52:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:52:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:52:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:52:07 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:52:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:52:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:52:08 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:52:09 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:52:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:52:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:52:09 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:52:11 - XML: Processed 655786 elements - found 794 jobs
Thu 16 Jan 2014 19:52:11 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 19:52:11 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 19:52:11 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:52:11 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:52:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:52:12 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:52:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:52:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:52:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:52:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:52:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:52:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:52:14 - Leaving storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 19:52:14 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Thu 16 Jan 2014 19:52:14 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:52:14 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:52:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43926437
Thu 16 Jan 2014 19:52:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:52:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43926437
Thu 16 Jan 2014 19:52:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:52:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:52:20 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:52:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:52:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 19:52:22 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:52:22 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:52:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8862 values 139704 bits 17463 bytes 
Thu 16 Jan 2014 19:52:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 19:52:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:52:23 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:52:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:52:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:52:24 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:52:24 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:52:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:52:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:52:24 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:52:26 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:52:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:52:27 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:52:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:52:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:52:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:52:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:52:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:52:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:52:29 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:52:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43925598
Thu 16 Jan 2014 19:52:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:52:29 - job_xml_thread(): Done retrieving: data size 43925598
Thu 16 Jan 2014 19:52:29 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:52:29 - XML: Start document: iteration 13
Thu 16 Jan 2014 19:52:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43925598
Thu 16 Jan 2014 19:52:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:52:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:52:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:52:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:52:43 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:52:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:52:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:52:43 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:52:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:52:43 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:52:43 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:52:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:52:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:52:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:52:45 - XML: Processed 655786 elements - found 794 jobs
Thu 16 Jan 2014 19:52:45 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 19:52:45 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 19:52:45 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:52:45 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:52:49 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:52:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 19:52:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:52:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:52:52 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:52:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:52:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:52:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:52:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:52:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:52:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:52:53 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:52:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43910148
Thu 16 Jan 2014 19:52:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:52:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43910148
Thu 16 Jan 2014 19:52:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:52:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:52:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:53:01 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:53:01 - job_xml_thread(): Done retrieving: data size 43910148
Thu 16 Jan 2014 19:53:01 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:53:01 - XML: Start document: iteration 14
Thu 16 Jan 2014 19:53:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:53:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:53:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:53:08 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:53:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:53:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:53:08 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:53:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:53:08 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:53:08 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:53:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:53:11 - XML: Processed 655780 elements - found 791 jobs
Thu 16 Jan 2014 19:53:11 - job 7346634 appears to have finished
Thu 16 Jan 2014 19:53:11 - job 7346543 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:53:11 - job 7346608 appears to have finished
Thu 16 Jan 2014 19:53:11 - job 7346664 appears to have finished
Thu 16 Jan 2014 19:53:11 - job_xml_thread(): Found 4 updated jobs.
Thu 16 Jan 2014 19:53:12 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 19:53:12 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Thu 16 Jan 2014 19:53:12 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:53:12 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:53:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:53:14 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:53:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:53:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:53:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:53:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:53:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:53:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:53:16 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:53:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43831956
Thu 16 Jan 2014 19:53:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:53:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43831956
Thu 16 Jan 2014 19:53:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:53:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:53:22 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:53:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:53:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:53:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:53:24 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:53:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 19:53:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 19:53:24 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:53:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9227 values 145533 bits 18191 bytes 
Thu 16 Jan 2014 19:53:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:53:25 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:53:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:53:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:53:26 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:53:26 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:53:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:53:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:53:27 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:53:27 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:53:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:53:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:53:30 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:53:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:53:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:53:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:53:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:53:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:53:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:53:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:53:32 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:53:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43471143
Thu 16 Jan 2014 19:53:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:53:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43471143
Thu 16 Jan 2014 19:53:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:53:33 - job_xml_thread(): Done retrieving: data size 43471143
Thu 16 Jan 2014 19:53:33 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:53:33 - XML: Start document: iteration 15
Thu 16 Jan 2014 19:53:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:53:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:53:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:53:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:53:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:53:46 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:53:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:53:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:53:46 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:53:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:53:46 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:53:46 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:53:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:53:49 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:53:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 19:53:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:53:50 - XML: Processed 650360 elements - found 791 jobs
Thu 16 Jan 2014 19:53:50 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 19:53:50 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 19:53:50 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:53:50 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:53:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:53:54 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:53:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:53:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:53:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:53:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:53:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:53:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:53:57 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:53:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43279748
Thu 16 Jan 2014 19:53:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:53:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43279748
Thu 16 Jan 2014 19:53:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:54:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:54:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:54:05 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:54:05 - job_xml_thread(): Done retrieving: data size 43279748
Thu 16 Jan 2014 19:54:05 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:54:05 - XML: Start document: iteration 16
Thu 16 Jan 2014 19:54:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:54:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:54:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:54:11 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:54:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:54:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:54:12 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:54:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:54:12 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:54:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:54:12 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:54:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:54:16 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:54:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:54:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:54:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:54:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:54:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:54:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:54:18 - XML: Processed 647880 elements - found 791 jobs
Thu 16 Jan 2014 19:54:18 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 19:54:18 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 19:54:18 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:54:18 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:54:20 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:54:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43330056
Thu 16 Jan 2014 19:54:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:54:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43330056
Thu 16 Jan 2014 19:54:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:54:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:54:24 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:54:26 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:54:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 19:54:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:54:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 19:54:27 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:54:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:54:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:54:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9228 values 145546 bits 18193 bytes 
Thu 16 Jan 2014 19:54:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:54:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:54:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:54:32 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:54:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:54:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:54:33 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:54:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:54:33 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:54:33 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:54:33 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:54:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:54:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:54:35 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:54:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:54:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:54:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:54:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:54:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:54:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:54:38 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:54:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43695727
Thu 16 Jan 2014 19:54:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:54:38 - job_xml_thread(): Done retrieving: data size 43695727
Thu 16 Jan 2014 19:54:38 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:54:38 - XML: Start document: iteration 17
Thu 16 Jan 2014 19:54:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43695727
Thu 16 Jan 2014 19:54:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:54:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:54:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:54:51 - XML: Processed 652789 elements - found 790 jobs
Thu 16 Jan 2014 19:54:51 - job 7346618 appears to have finished
Thu 16 Jan 2014 19:54:51 - job_xml_thread(): Found 1 updated jobs.
Thu 16 Jan 2014 19:54:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:54:51 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 19:54:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:54:52 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Thu 16 Jan 2014 19:54:52 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:54:52 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:54:54 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Thu 16 Jan 2014 19:54:54 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:54:55 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:54:55 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 19:54:55 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:54:55 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 19:54:55 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 19:54:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:54:57 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:54:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:54:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:54:58 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:54:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:54:58 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:54:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:54:58 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:55:00 - size of cluster 'LISA Cluster': 624 hosts 79479 metrics 791916 values 12500276 bits 1562534 bytes 
Thu 16 Jan 2014 19:55:01 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:55:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 19:55:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:55:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:55:02 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:55:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:55:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:55:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:55:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:55:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:55:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:55:05 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:55:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43914221
Thu 16 Jan 2014 19:55:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:55:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43914221
Thu 16 Jan 2014 19:55:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:55:07 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:55:07 - job_xml_thread(): Done retrieving: data size 43914221
Thu 16 Jan 2014 19:55:07 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:55:07 - XML: Start document: iteration 18
Thu 16 Jan 2014 19:55:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:55:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:55:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:55:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:55:23 - XML: Processed 655786 elements - found 794 jobs
Thu 16 Jan 2014 19:55:23 - job 7346546 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:55:23 - job 7346683 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:55:23 - job 7346680 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:55:23 - job 7346549 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:55:23 - job 7346545 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:55:24 - job_xml_thread(): Found 9 updated jobs.
Thu 16 Jan 2014 19:55:24 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 19:55:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:55:26 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:55:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:55:26 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:55:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:55:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:55:27 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:55:27 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:55:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 19:55:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:55:27 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:55:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:55:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:55:27 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:55:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 19:55:27 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:55:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6061 values 95577 bits 11947 bytes 
Thu 16 Jan 2014 19:55:27 - job_xml_thread(): Done storing. succesfully stored: 9 jobs
Thu 16 Jan 2014 19:55:27 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:55:27 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:55:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:55:29 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:55:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:55:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:55:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:55:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:55:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:55:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:55:32 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:55:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43912629
Thu 16 Jan 2014 19:55:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:55:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43912629
Thu 16 Jan 2014 19:55:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:55:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:55:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:55:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:55:42 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:55:42 - job_xml_thread(): Done retrieving: data size 43912629
Thu 16 Jan 2014 19:55:42 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:55:42 - XML: Start document: iteration 19
Thu 16 Jan 2014 19:55:42 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:55:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:55:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:55:43 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:55:43 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:55:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:55:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:55:43 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:55:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:55:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:55:45 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:55:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 19:55:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:55:54 - XML: Processed 655786 elements - found 794 jobs
Thu 16 Jan 2014 19:55:54 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 19:55:54 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 19:55:54 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:55:54 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:55:56 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:55:56 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 19:55:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:55:56 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:55:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:55:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:55:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:55:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:55:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:55:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:55:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:55:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:55:59 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:55:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43894179
Thu 16 Jan 2014 19:55:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:56:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43894179
Thu 16 Jan 2014 19:56:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:56:09 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:56:09 - job_xml_thread(): Done retrieving: data size 43894179
Thu 16 Jan 2014 19:56:09 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:56:09 - XML: Start document: iteration 20
Thu 16 Jan 2014 19:56:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:56:12 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:56:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:56:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:56:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:56:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:56:13 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:56:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:56:13 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:56:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:56:13 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:56:18 - XML: Processed 655786 elements - found 794 jobs
Thu 16 Jan 2014 19:56:18 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 19:56:18 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 19:56:18 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:56:18 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:56:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:56:22 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:56:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:56:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:56:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:56:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:56:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:56:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:56:25 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:56:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43915585
Thu 16 Jan 2014 19:56:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:56:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43915585
Thu 16 Jan 2014 19:56:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:56:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:56:27 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:56:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:56:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 19:56:28 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:56:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:56:28 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:56:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 19:56:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9261 values 145989 bits 18248 bytes 
Thu 16 Jan 2014 19:56:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:56:33 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:56:33 - job_xml_thread(): Done retrieving: data size 43915585
Thu 16 Jan 2014 19:56:33 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:56:33 - Housekeeping: checking database for timed out jobs..
Thu 16 Jan 2014 19:56:34 - Housekeeping: Found 0 timed out jobs in database: closing entries
Thu 16 Jan 2014 19:56:34 - Housekeeping: done.
Thu 16 Jan 2014 19:56:34 - XML: Start document: iteration 0
Thu 16 Jan 2014 19:56:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:56:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:56:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:56:45 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:56:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:56:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:56:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:56:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:56:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:56:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:56:46 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:56:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:56:47 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:56:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:56:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:56:48 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:56:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:56:48 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:56:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:56:49 - XML: Processed 655786 elements - found 794 jobs
Thu 16 Jan 2014 19:56:49 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 19:56:49 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 19:56:49 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:56:49 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:56:53 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:56:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43933621
Thu 16 Jan 2014 19:56:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:56:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43933621
Thu 16 Jan 2014 19:56:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:57:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:57:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:57:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:57:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:57:04 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:57:04 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:57:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:57:09 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:57:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:57:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:57:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:57:09 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:57:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:57:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:57:09 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:57:09 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:57:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:57:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:57:10 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:57:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 19:57:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:57:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:57:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:57:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:57:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:57:12 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:57:12 - job_xml_thread(): Done retrieving: data size 43929996
Thu 16 Jan 2014 19:57:12 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:57:12 - XML: Start document: iteration 1
Thu 16 Jan 2014 19:57:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43929996
Thu 16 Jan 2014 19:57:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:57:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43929996
Thu 16 Jan 2014 19:57:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:57:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:57:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:57:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:57:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:57:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:57:28 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:57:29 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:57:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 19:57:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:57:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 19:57:29 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:57:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5904 values 93087 bits 11635 bytes 
Thu 16 Jan 2014 19:57:31 - XML: Processed 655778 elements - found 790 jobs
Thu 16 Jan 2014 19:57:32 - job 7346649 appears to have finished
Thu 16 Jan 2014 19:57:32 - job 7346546 field 'start_timestamp' changed since saved from: 1389898460 to: 1389898412
Thu 16 Jan 2014 19:57:32 - job 7346683 field 'start_timestamp' changed since saved from: 1389898464 to: 1389898412
Thu 16 Jan 2014 19:57:32 - job 7346626 appears to have finished
Thu 16 Jan 2014 19:57:32 - job 7346529 appears to have finished
Thu 16 Jan 2014 19:57:32 - job 7346614 appears to have finished
Thu 16 Jan 2014 19:57:32 - job 7346771 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:57:32 - job 7346684 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:57:32 - job 7346506 appears to have finished
Thu 16 Jan 2014 19:57:32 - job 7343574 appears to have finished
Thu 16 Jan 2014 19:57:32 - job 7346688 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:57:32 - job_xml_thread(): Found 13 updated jobs.
Thu 16 Jan 2014 19:57:32 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 19:57:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:57:33 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:57:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:57:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:57:34 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:57:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:57:34 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:57:34 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:57:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:57:34 - job_xml_thread(): Done storing. succesfully stored: 13 jobs
Thu 16 Jan 2014 19:57:34 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:57:34 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:57:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:57:36 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:57:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:57:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:57:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:57:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:57:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:57:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:57:41 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:57:41 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:57:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 19:57:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43938555
Thu 16 Jan 2014 19:57:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:57:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:57:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43938555
Thu 16 Jan 2014 19:57:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:57:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:57:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:57:49 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:57:49 - job_xml_thread(): Done retrieving: data size 43938555
Thu 16 Jan 2014 19:57:50 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:57:50 - XML: Start document: iteration 2
Thu 16 Jan 2014 19:57:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:57:50 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:57:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:57:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:57:51 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:57:51 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:57:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:57:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:57:51 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:57:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:57:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:58:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:58:03 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:58:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:58:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:58:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:58:04 - XML: Processed 655778 elements - found 790 jobs
Thu 16 Jan 2014 19:58:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:58:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:58:04 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 19:58:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:58:04 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 19:58:04 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:58:04 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:58:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:58:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:58:07 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:58:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43895169
Thu 16 Jan 2014 19:58:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:58:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43895169
Thu 16 Jan 2014 19:58:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:58:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:58:17 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:58:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:58:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:58:19 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:58:19 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:58:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:58:19 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:58:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:58:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:58:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:58:20 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:58:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:58:22 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:58:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:58:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:58:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:58:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:58:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:58:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:58:25 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:58:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43933742
Thu 16 Jan 2014 19:58:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:58:26 - job_xml_thread(): Done retrieving: data size 43933742
Thu 16 Jan 2014 19:58:26 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:58:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43933742
Thu 16 Jan 2014 19:58:26 - XML: Start document: iteration 3
Thu 16 Jan 2014 19:58:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:58:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:58:29 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:58:29 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:58:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:58:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 19:58:29 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:58:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 19:58:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148580 bits 18572 bytes 
Thu 16 Jan 2014 19:58:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:58:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:58:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:58:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:58:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:58:39 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:58:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:58:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:58:40 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:58:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:58:40 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:58:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:58:40 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:58:45 - XML: Processed 655778 elements - found 790 jobs
Thu 16 Jan 2014 19:58:45 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 19:58:45 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 19:58:45 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:58:45 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:58:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:58:49 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:58:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:58:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:58:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:58:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:58:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:58:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:58:52 - Leaving storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 19:58:52 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Thu 16 Jan 2014 19:58:52 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:58:52 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:58:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43900061
Thu 16 Jan 2014 19:58:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:58:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43900061
Thu 16 Jan 2014 19:58:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:58:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:58:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:59:00 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:59:00 - job_xml_thread(): Done retrieving: data size 43900061
Thu 16 Jan 2014 19:59:00 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:59:00 - XML: Start document: iteration 4
Thu 16 Jan 2014 19:59:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:59:00 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:59:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 19:59:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:59:01 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:59:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 19:59:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:59:01 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:59:02 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:59:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:59:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:59:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43900061
Thu 16 Jan 2014 19:59:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:59:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:59:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:59:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:59:15 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:59:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:59:17 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:59:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:59:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:59:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:59:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:59:18 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:59:18 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:59:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:59:18 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:59:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:59:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:59:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:59:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:59:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:59:18 - XML: Processed 655770 elements - found 786 jobs
Thu 16 Jan 2014 19:59:18 - job 7346723 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:59:18 - job 7346631 appears to have finished
Thu 16 Jan 2014 19:59:18 - job 7346754 appears to have finished
Thu 16 Jan 2014 19:59:18 - job 7346541 appears to have finished
Thu 16 Jan 2014 19:59:18 - job 7346712 appears to have finished
Thu 16 Jan 2014 19:59:18 - job 7346772 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:59:18 - job 7346460 appears to have finished
Thu 16 Jan 2014 19:59:18 - job 7346641 appears to have finished
Thu 16 Jan 2014 19:59:18 - job 7346765 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:59:18 - job 7346756 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 19:59:18 - job_xml_thread(): Found 12 updated jobs.
Thu 16 Jan 2014 19:59:18 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 19:59:19 - job_xml_thread(): Done storing. succesfully stored: 12 jobs
Thu 16 Jan 2014 19:59:19 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:59:19 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:59:20 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:59:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43852450
Thu 16 Jan 2014 19:59:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:59:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43852450
Thu 16 Jan 2014 19:59:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:59:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:59:28 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:59:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:59:30 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:59:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:59:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 19:59:31 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:59:31 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:59:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 19:59:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99027 bits 12378 bytes 
Thu 16 Jan 2014 19:59:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:59:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:59:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:59:33 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:59:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:59:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:59:34 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:59:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:59:34 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:59:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:59:34 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:59:34 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 19:59:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:59:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:59:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:59:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:59:36 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 19:59:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43348301
Thu 16 Jan 2014 19:59:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 19:59:37 - job_xml_thread(): Done retrieving: data size 43348301
Thu 16 Jan 2014 19:59:37 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 19:59:37 - XML: Start document: iteration 5
Thu 16 Jan 2014 19:59:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43348301
Thu 16 Jan 2014 19:59:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 19:59:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 19:59:47 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 19:59:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 19:59:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 19:59:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 19:59:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 19:59:50 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:59:50 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 19:59:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 19:59:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 19:59:50 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 19:59:55 - XML: Processed 648634 elements - found 786 jobs
Thu 16 Jan 2014 19:59:55 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 19:59:55 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 19:59:55 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 19:59:55 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 19:59:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 19:59:58 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 19:59:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 19:59:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 19:59:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:59:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 19:59:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 19:59:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 19:59:58 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 19:59:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 19:59:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:00:00 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:00:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43247246
Thu 16 Jan 2014 20:00:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:00:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43247246
Thu 16 Jan 2014 20:00:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:00:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:00:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:00:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:00:08 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:00:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:00:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:00:09 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:00:09 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:00:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:00:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:00:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43247246
Thu 16 Jan 2014 20:00:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:00:11 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:00:11 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:00:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:00:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:00:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:00:19 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:00:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:00:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:00:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:00:20 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:00:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:00:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:00:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:00:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:00:22 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:00:22 - job_xml_thread(): Done retrieving: data size 43295708
Thu 16 Jan 2014 20:00:22 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:00:22 - XML: Start document: iteration 6
Thu 16 Jan 2014 20:00:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43295708
Thu 16 Jan 2014 20:00:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:00:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:00:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:00:26 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:00:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:00:26 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:00:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:00:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43295708
Thu 16 Jan 2014 20:00:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:00:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:00:32 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:00:33 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:00:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 20:00:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:00:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 20:00:33 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:00:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8972 values 141470 bits 17683 bytes 
Thu 16 Jan 2014 20:00:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:00:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:00:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:00:37 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:00:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:00:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:00:42 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:00:42 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:00:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:00:42 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:00:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:00:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:00:43 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:00:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:00:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:00:44 - XML: Processed 648318 elements - found 786 jobs
Thu 16 Jan 2014 20:00:44 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:00:44 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:00:44 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:00:44 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:00:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:00:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:00:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:00:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:00:46 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:00:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 20:00:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:00:46 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:00:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43813576
Thu 16 Jan 2014 20:00:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:00:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43813576
Thu 16 Jan 2014 20:00:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:00:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:00:56 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:00:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:00:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:00:58 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:00:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:00:58 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:00:58 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:00:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:00:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:00:59 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:00:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:01:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:01:00 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:01:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:01:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:01:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:01:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:01:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:01:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:01:02 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:01:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43896139
Thu 16 Jan 2014 20:01:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:01:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43896139
Thu 16 Jan 2014 20:01:03 - job_xml_thread(): Done retrieving: data size 43896139
Thu 16 Jan 2014 20:01:03 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:01:03 - XML: Start document: iteration 7
Thu 16 Jan 2014 20:01:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:01:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:01:13 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:01:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:01:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:01:15 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:01:15 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:01:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:01:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:01:15 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:01:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:01:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:01:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:01:19 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:01:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:01:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:01:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:01:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:01:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:01:21 - XML: Processed 655626 elements - found 785 jobs
Thu 16 Jan 2014 20:01:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:01:21 - job 7346683 appears to have finished
Thu 16 Jan 2014 20:01:21 - job 7346513 appears to have finished
Thu 16 Jan 2014 20:01:21 - job 7346770 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 20:01:21 - job 7346773 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 20:01:21 - job 7346767 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 20:01:21 - job 7346765 field 'start_timestamp' changed since saved from: 1389898718 to: 1389898670
Thu 16 Jan 2014 20:01:21 - job 7346768 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 20:01:21 - job 7346769 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 20:01:21 - job_xml_thread(): Found 9 updated jobs.
Thu 16 Jan 2014 20:01:21 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 20:01:22 - job_xml_thread(): Done storing. succesfully stored: 9 jobs
Thu 16 Jan 2014 20:01:22 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:01:22 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:01:24 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:01:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43907260
Thu 16 Jan 2014 20:01:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:01:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43907260
Thu 16 Jan 2014 20:01:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:01:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:01:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:01:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:01:33 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:01:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:01:34 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:01:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:01:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 20:01:34 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:01:34 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:01:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 20:01:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:01:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:01:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148729 bits 18591 bytes 
Thu 16 Jan 2014 20:01:35 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:01:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:01:35 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:01:35 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:01:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:01:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:01:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:01:38 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:01:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:01:38 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:01:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:01:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:01:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:01:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:01:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:01:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:01:41 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:01:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43933883
Thu 16 Jan 2014 20:01:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:01:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43933883
Thu 16 Jan 2014 20:01:42 - job_xml_thread(): Done retrieving: data size 43933883
Thu 16 Jan 2014 20:01:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:01:42 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:01:42 - XML: Start document: iteration 8
Thu 16 Jan 2014 20:01:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:01:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:01:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:01:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:01:56 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Thu 16 Jan 2014 20:01:56 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:01:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:01:57 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:01:57 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:01:57 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 20:01:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:01:57 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:01:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:01:57 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 20:01:57 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 20:01:57 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:01:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 20:01:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:01:57 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:01:57 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:01:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:01:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:01:57 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:02:02 - XML: Processed 655768 elements - found 785 jobs
Thu 16 Jan 2014 20:02:02 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:02:02 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:02:02 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:02:02 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:02:03 - size of cluster 'LISA Cluster': 624 hosts 79478 metrics 804948 values 12710072 bits 1588759 bytes 
Thu 16 Jan 2014 20:02:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:02:05 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:02:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:02:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:02:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:02:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:02:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:02:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:02:08 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:02:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43902557
Thu 16 Jan 2014 20:02:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:02:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43902557
Thu 16 Jan 2014 20:02:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:02:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:02:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:02:17 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:02:17 - job_xml_thread(): Done retrieving: data size 43902557
Thu 16 Jan 2014 20:02:17 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:02:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:02:17 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:02:17 - XML: Start document: iteration 9
Thu 16 Jan 2014 20:02:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:02:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:02:19 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:02:19 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:02:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:02:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:02:19 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:02:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:02:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:02:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:02:31 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:02:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:02:31 - XML: Processed 655768 elements - found 785 jobs
Thu 16 Jan 2014 20:02:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:02:31 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:02:31 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:02:31 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:02:31 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:02:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:02:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:02:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:02:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:02:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:02:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:02:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:02:35 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:02:35 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:02:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43885472
Thu 16 Jan 2014 20:02:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:02:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43885472
Thu 16 Jan 2014 20:02:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:02:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:02:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 20:02:35 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:02:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 20:02:35 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:02:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6142 values 97079 bits 12134 bytes 
Thu 16 Jan 2014 20:02:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:02:43 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:02:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:02:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:02:43 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:02:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:02:43 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:02:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:02:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43885472
Thu 16 Jan 2014 20:02:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:02:46 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:02:46 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:02:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:02:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:02:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:02:57 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:02:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:02:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:02:57 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:02:57 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 20:02:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:02:58 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:02:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:02:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:02:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:02:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:02:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:02:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:02:59 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:02:59 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:02:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:02:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:03:02 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:03:02 - job_xml_thread(): Done retrieving: data size 43887547
Thu 16 Jan 2014 20:03:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43887547
Thu 16 Jan 2014 20:03:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:03:02 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:03:02 - XML: Start document: iteration 10
Thu 16 Jan 2014 20:03:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43887547
Thu 16 Jan 2014 20:03:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:03:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:03:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:03:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:03:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:03:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:03:21 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:03:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:03:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:03:21 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:03:21 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:03:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:03:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:03:21 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:03:23 - XML: Processed 655756 elements - found 779 jobs
Thu 16 Jan 2014 20:03:23 - job 7346673 appears to have finished
Thu 16 Jan 2014 20:03:23 - job 7346630 appears to have finished
Thu 16 Jan 2014 20:03:23 - job 7346661 appears to have finished
Thu 16 Jan 2014 20:03:23 - job 7346644 appears to have finished
Thu 16 Jan 2014 20:03:23 - job 7346646 appears to have finished
Thu 16 Jan 2014 20:03:23 - job 7346775 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 20:03:23 - job 7346774 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 20:03:23 - job 7346769 field 'start_timestamp' changed since saved from: 1389898816 to: 1389898791
Thu 16 Jan 2014 20:03:23 - job 7346549 appears to have finished
Thu 16 Jan 2014 20:03:23 - job_xml_thread(): Found 9 updated jobs.
Thu 16 Jan 2014 20:03:23 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 20:03:23 - job_xml_thread(): Done storing. succesfully stored: 9 jobs
Thu 16 Jan 2014 20:03:23 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:03:23 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:03:24 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:03:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 20:03:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:03:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:03:26 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:03:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:03:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:03:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:03:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:03:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:03:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:03:30 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:03:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43912941
Thu 16 Jan 2014 20:03:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:03:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43912941
Thu 16 Jan 2014 20:03:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:03:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:03:35 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:03:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:03:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 20:03:36 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:03:36 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:03:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 20:03:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:03:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:03:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5994 values 94703 bits 11837 bytes 
Thu 16 Jan 2014 20:03:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:03:39 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:03:39 - job_xml_thread(): Done retrieving: data size 43912941
Thu 16 Jan 2014 20:03:39 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:03:39 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:03:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:03:39 - XML: Start document: iteration 11
Thu 16 Jan 2014 20:03:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:03:40 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:03:40 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:03:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:03:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:03:40 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:03:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:03:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:03:48 - XML: Processed 655756 elements - found 779 jobs
Thu 16 Jan 2014 20:03:48 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:03:48 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:03:48 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:03:48 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:03:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:03:51 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:03:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:03:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:03:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:03:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:03:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:03:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:03:54 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:03:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43897246
Thu 16 Jan 2014 20:03:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:03:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:03:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:03:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43897246
Thu 16 Jan 2014 20:03:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:04:03 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:04:03 - job_xml_thread(): Done retrieving: data size 43897246
Thu 16 Jan 2014 20:04:03 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:04:03 - XML: Start document: iteration 12
Thu 16 Jan 2014 20:04:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:04:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:04:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:04:12 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:04:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:04:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:04:14 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:04:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:04:14 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:04:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:04:14 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:04:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:04:15 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:04:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:04:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:04:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:04:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:04:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:04:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:04:17 - XML: Processed 655756 elements - found 779 jobs
Thu 16 Jan 2014 20:04:17 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:04:17 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:04:17 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:04:17 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:04:18 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:04:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 20:04:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:04:21 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:04:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43917611
Thu 16 Jan 2014 20:04:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:04:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43917611
Thu 16 Jan 2014 20:04:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:04:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:04:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:04:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:04:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:04:32 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:04:32 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:04:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:04:34 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:04:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:04:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:04:35 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:04:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:04:35 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:04:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:04:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:04:36 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:04:37 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:04:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 20:04:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:04:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 20:04:37 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:04:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:04:38 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:04:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5796 values 91458 bits 11432 bytes 
Thu 16 Jan 2014 20:04:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:04:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:04:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:04:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:04:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:04:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:04:41 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:04:41 - job_xml_thread(): Done retrieving: data size 43924848
Thu 16 Jan 2014 20:04:41 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:04:41 - XML: Start document: iteration 13
Thu 16 Jan 2014 20:04:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43924848
Thu 16 Jan 2014 20:04:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43924848
Thu 16 Jan 2014 20:04:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:04:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:04:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:04:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:04:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:04:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:04:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:04:57 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:04:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:04:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:04:58 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:04:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:04:58 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:04:58 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:04:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:04:59 - XML: Processed 655755 elements - found 779 jobs
Thu 16 Jan 2014 20:04:59 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:04:59 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:04:59 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:04:59 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:05:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:05:04 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:05:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:05:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:05:04 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:05:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 20:05:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:05:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:05:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:05:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:05:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:05:07 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:05:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43910343
Thu 16 Jan 2014 20:05:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:05:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43910343
Thu 16 Jan 2014 20:05:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:05:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:05:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:05:14 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:05:14 - job_xml_thread(): Done retrieving: data size 43910343
Thu 16 Jan 2014 20:05:14 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:05:14 - XML: Start document: iteration 14
Thu 16 Jan 2014 20:05:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:05:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:05:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:05:23 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:05:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:05:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:05:24 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:05:24 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:05:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:05:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:05:24 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:05:27 - XML: Processed 655756 elements - found 779 jobs
Thu 16 Jan 2014 20:05:27 - job 7346496 report time 1389898932 does not match current heartbeat 1389899053 : ignoring job
Thu 16 Jan 2014 20:05:27 - job 7346639 appears to have finished
Thu 16 Jan 2014 20:05:27 - job 7346633 appears to have finished
Thu 16 Jan 2014 20:05:28 - job 7346777 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 20:05:28 - job 7346776 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 20:05:28 - job_xml_thread(): Found 6 updated jobs.
Thu 16 Jan 2014 20:05:28 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 20:05:29 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Thu 16 Jan 2014 20:05:29 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:05:29 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:05:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:05:31 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:05:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:05:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:05:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:05:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:05:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:05:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:05:34 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:05:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43533433
Thu 16 Jan 2014 20:05:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:05:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43533433
Thu 16 Jan 2014 20:05:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:05:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:05:37 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:05:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:05:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 20:05:39 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:05:39 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:05:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 20:05:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8749 values 137975 bits 17246 bytes 
Thu 16 Jan 2014 20:05:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:05:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:05:44 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:05:44 - job_xml_thread(): Done retrieving: data size 43533433
Thu 16 Jan 2014 20:05:44 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:05:44 - XML: Start document: iteration 15
Thu 16 Jan 2014 20:05:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:05:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:05:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:05:47 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:05:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:05:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:05:47 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:05:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:05:47 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:05:47 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:05:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:05:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:05:52 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:05:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:05:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:05:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:05:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:05:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:05:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:05:57 - XML: Processed 651320 elements - found 779 jobs
Thu 16 Jan 2014 20:05:57 - job 7346496 report time 1389898932 does not match current heartbeat 1389899053 : ignoring job
Thu 16 Jan 2014 20:05:57 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:05:57 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:05:57 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:05:57 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:05:59 - Leaving storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 20:05:59 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Thu 16 Jan 2014 20:05:59 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:06:00 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:06:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43256823
Thu 16 Jan 2014 20:06:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:06:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43256823
Thu 16 Jan 2014 20:06:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:06:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:06:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:06:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:06:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:06:12 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:06:12 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:06:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:06:14 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:06:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:06:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:06:15 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:06:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:06:15 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:06:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:06:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:06:16 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:06:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:06:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:06:16 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:06:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 20:06:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:06:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:06:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:06:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:06:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:06:18 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:06:18 - job_xml_thread(): Done retrieving: data size 43302986
Thu 16 Jan 2014 20:06:18 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:06:18 - XML: Start document: iteration 16
Thu 16 Jan 2014 20:06:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43302986
Thu 16 Jan 2014 20:06:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:06:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43302986
Thu 16 Jan 2014 20:06:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:06:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:06:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:06:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:06:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:06:32 - XML: Processed 648242 elements - found 779 jobs
Thu 16 Jan 2014 20:06:32 - job 7346496 report time 1389898932 does not match current heartbeat 1389899053 : ignoring job
Thu 16 Jan 2014 20:06:33 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:06:33 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:06:33 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:06:33 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:06:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:06:39 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:06:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:06:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:06:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:06:39 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:06:40 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:06:40 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:06:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:06:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:06:40 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:06:40 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:06:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:06:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 20:06:40 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:06:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 20:06:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6051 values 95460 bits 11932 bytes 
Thu 16 Jan 2014 20:06:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:06:42 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:06:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:06:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:06:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:06:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:06:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:06:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:06:45 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:06:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 20:06:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:06:46 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:06:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43817813
Thu 16 Jan 2014 20:06:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:06:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43817813
Thu 16 Jan 2014 20:06:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:06:48 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:06:48 - job_xml_thread(): Done retrieving: data size 43817813
Thu 16 Jan 2014 20:06:48 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:06:48 - XML: Start document: iteration 17
Thu 16 Jan 2014 20:06:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:06:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:06:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:06:58 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:06:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:06:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:06:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:06:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:06:59 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:06:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:06:59 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:06:59 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:06:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:07:05 - XML: Processed 654734 elements - found 774 jobs
Thu 16 Jan 2014 20:07:05 - job 7346779 field 'start_timestamp' changed since saved from: 1389899061 to: 1389899007
Thu 16 Jan 2014 20:07:05 - job 7346638 appears to have finished
Thu 16 Jan 2014 20:07:05 - job 7346514 appears to have finished
Thu 16 Jan 2014 20:07:05 - job 7346648 appears to have finished
Thu 16 Jan 2014 20:07:05 - job 7346511 appears to have finished
Thu 16 Jan 2014 20:07:05 - job 7346776 field 'start_timestamp' changed since saved from: 1389899055 to: 1389899007
Thu 16 Jan 2014 20:07:05 - job 7346778 field 'start_timestamp' changed since saved from: 1389899059 to: 1389899007
Thu 16 Jan 2014 20:07:05 - job 7346668 appears to have finished
Thu 16 Jan 2014 20:07:05 - job 7346548 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 20:07:05 - job_xml_thread(): Found 10 updated jobs.
Thu 16 Jan 2014 20:07:05 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 20:07:08 - job_xml_thread(): Done storing. succesfully stored: 10 jobs
Thu 16 Jan 2014 20:07:08 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:07:08 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:07:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:07:09 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:07:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:07:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:07:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:07:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:07:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:07:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:07:11 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:07:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43900602
Thu 16 Jan 2014 20:07:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:07:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43900602
Thu 16 Jan 2014 20:07:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:07:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:07:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:07:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:07:22 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:07:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:07:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:07:23 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:07:23 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:07:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:07:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:07:23 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:07:23 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:07:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:07:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:07:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:07:25 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:07:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:07:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:07:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:07:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:07:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:07:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:07:27 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:07:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43928360
Thu 16 Jan 2014 20:07:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:07:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43928360
Thu 16 Jan 2014 20:07:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:07:28 - job_xml_thread(): Done retrieving: data size 43928360
Thu 16 Jan 2014 20:07:28 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:07:29 - XML: Start document: iteration 18
Thu 16 Jan 2014 20:07:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:07:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:07:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:07:40 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:07:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:07:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:07:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:07:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 20:07:41 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:07:41 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:07:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 20:07:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148587 bits 18573 bytes 
Thu 16 Jan 2014 20:07:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:07:43 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:07:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:07:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:07:44 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:07:44 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:07:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:07:44 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:07:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:07:48 - XML: Processed 655745 elements - found 774 jobs
Thu 16 Jan 2014 20:07:48 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:07:48 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:07:48 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:07:48 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:07:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:07:51 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:07:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:07:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:07:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:07:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:07:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:07:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:07:54 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:07:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 20:07:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:07:54 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:07:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43901143
Thu 16 Jan 2014 20:07:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:07:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43901143
Thu 16 Jan 2014 20:07:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:07:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:07:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:08:03 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:08:03 - job_xml_thread(): Done retrieving: data size 43901143
Thu 16 Jan 2014 20:08:03 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:08:03 - XML: Start document: iteration 19
Thu 16 Jan 2014 20:08:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:08:04 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:08:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:08:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:08:05 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:08:05 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:08:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:08:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:08:05 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:08:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:08:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:08:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:08:16 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:08:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:08:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:08:16 - XML: Processed 655746 elements - found 774 jobs
Thu 16 Jan 2014 20:08:17 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:08:17 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:08:17 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:08:17 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:08:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:08:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:08:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:08:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:08:19 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:08:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43877181
Thu 16 Jan 2014 20:08:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:08:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:08:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43877181
Thu 16 Jan 2014 20:08:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:08:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:08:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:08:29 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:08:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:08:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:08:30 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:08:30 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:08:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:08:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:08:30 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:08:32 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:08:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:08:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:08:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:08:33 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:08:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:08:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:08:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:08:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:08:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:08:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:08:35 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:08:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43920519
Thu 16 Jan 2014 20:08:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:08:35 - job_xml_thread(): Done retrieving: data size 43920519
Thu 16 Jan 2014 20:08:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43920519
Thu 16 Jan 2014 20:08:36 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:08:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:08:36 - XML: Start document: iteration 20
Thu 16 Jan 2014 20:08:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:08:43 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:08:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:08:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 20:08:43 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:08:43 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:08:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 20:08:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148543 bits 18567 bytes 
Thu 16 Jan 2014 20:08:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:08:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:08:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:08:48 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:08:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:08:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:08:49 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:08:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:08:49 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:08:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:08:49 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:08:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:08:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:08:53 - XML: Processed 655746 elements - found 774 jobs
Thu 16 Jan 2014 20:08:53 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:08:53 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:08:53 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:08:53 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:08:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:08:57 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:08:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:08:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:08:57 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Thu 16 Jan 2014 20:08:57 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:08:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:08:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:08:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:08:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:08:57 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:08:57 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 20:08:57 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 20:08:57 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:08:57 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 20:08:58 - size of cluster 'LISA Cluster': 624 hosts 79487 metrics 779073 values 12298497 bits 1537312 bytes 
Thu 16 Jan 2014 20:09:01 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:09:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43892109
Thu 16 Jan 2014 20:09:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:09:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43892109
Thu 16 Jan 2014 20:09:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:09:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:09:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:09:09 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:09:09 - job_xml_thread(): Done retrieving: data size 43892109
Thu 16 Jan 2014 20:09:09 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:09:09 - Housekeeping: checking database for timed out jobs..
Thu 16 Jan 2014 20:09:09 - Housekeeping: Found 0 timed out jobs in database: closing entries
Thu 16 Jan 2014 20:09:09 - Housekeeping: done.
Thu 16 Jan 2014 20:09:09 - XML: Start document: iteration 0
Thu 16 Jan 2014 20:09:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:09:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:09:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:09:12 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:09:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:09:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:09:12 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:09:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:09:12 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:09:12 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:09:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:09:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:09:23 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:09:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:09:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:09:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:09:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:09:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:09:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:09:25 - XML: Processed 655742 elements - found 772 jobs
Thu 16 Jan 2014 20:09:25 - job 7346497 appears to have finished
Thu 16 Jan 2014 20:09:25 - job 7346781 field 'start_timestamp' changed since saved from: 1389899200 to: 1389899129
Thu 16 Jan 2014 20:09:25 - job 7346752 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 20:09:25 - job 7346751 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 20:09:25 - job 7346525 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 20:09:25 - job 7346654 appears to have finished
Thu 16 Jan 2014 20:09:25 - job 7346505 report time 1389899174 does not match current heartbeat 1389899295 : ignoring job
Thu 16 Jan 2014 20:09:25 - job 7346548 field 'start_timestamp' changed since saved from: 1389899184 to: 1389899129
Thu 16 Jan 2014 20:09:25 - job_xml_thread(): Found 7 updated jobs.
Thu 16 Jan 2014 20:09:25 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 20:09:25 - job_xml_thread(): Done storing. succesfully stored: 7 jobs
Thu 16 Jan 2014 20:09:25 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:09:25 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:09:25 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:09:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 20:09:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:09:28 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:09:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43893061
Thu 16 Jan 2014 20:09:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:09:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:09:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:09:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43893061
Thu 16 Jan 2014 20:09:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:09:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:09:36 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:09:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:09:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:09:37 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:09:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:09:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43893061
Thu 16 Jan 2014 20:09:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:09:37 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:09:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:09:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:09:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:09:40 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:09:40 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:09:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:09:44 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:09:45 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:09:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 20:09:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:09:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 20:09:45 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:09:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5897 values 93012 bits 11626 bytes 
Thu 16 Jan 2014 20:09:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:09:47 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:09:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:09:49 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:09:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:09:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:09:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:09:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:09:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:09:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:09:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:09:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:09:53 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:09:53 - job_xml_thread(): Done retrieving: data size 43898260
Thu 16 Jan 2014 20:09:53 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:09:53 - XML: Start document: iteration 1
Thu 16 Jan 2014 20:09:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43898260
Thu 16 Jan 2014 20:09:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:09:53 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:09:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:09:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43898260
Thu 16 Jan 2014 20:09:53 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:09:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:09:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:09:57 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:09:58 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 20:10:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:10:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:10:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:10:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:10:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:10:13 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:10:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:10:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:10:15 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:10:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:10:15 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:10:15 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:10:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:10:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:10:16 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:10:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:10:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:10:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:10:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:10:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:10:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:10:17 - XML: Processed 655742 elements - found 772 jobs
Thu 16 Jan 2014 20:10:17 - job 7346505 report time 1389899174 does not match current heartbeat 1389899295 : ignoring job
Thu 16 Jan 2014 20:10:17 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:10:17 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:10:17 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:10:17 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:10:17 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:10:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 20:10:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:10:21 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:10:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43912541
Thu 16 Jan 2014 20:10:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:10:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43912541
Thu 16 Jan 2014 20:10:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:10:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:10:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:10:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:10:30 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:10:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:10:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:10:32 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:10:32 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:10:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:10:32 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:10:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:10:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:10:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:10:32 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:10:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:10:35 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:10:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:10:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:10:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:10:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:10:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:10:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:10:39 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:10:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43924717
Thu 16 Jan 2014 20:10:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:10:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43924717
Thu 16 Jan 2014 20:10:40 - job_xml_thread(): Done retrieving: data size 43924717
Thu 16 Jan 2014 20:10:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:10:40 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:10:40 - XML: Start document: iteration 2
Thu 16 Jan 2014 20:10:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:10:46 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:10:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:10:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 20:10:46 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:10:46 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:10:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 20:10:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:10:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:10:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9038 values 142534 bits 17816 bytes 
Thu 16 Jan 2014 20:10:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:10:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:10:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:10:50 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:10:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:10:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:10:52 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:10:52 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:10:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:10:52 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:10:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:11:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:11:00 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:11:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:11:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:11:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:11:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:11:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:11:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:11:01 - XML: Processed 655742 elements - found 772 jobs
Thu 16 Jan 2014 20:11:01 - job 7346505 report time 1389899174 does not match current heartbeat 1389899295 : ignoring job
Thu 16 Jan 2014 20:11:01 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:11:01 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:11:01 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:11:01 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:11:05 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:11:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43880395
Thu 16 Jan 2014 20:11:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:11:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43880395
Thu 16 Jan 2014 20:11:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:11:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:11:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:11:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:11:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:11:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:11:16 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:11:16 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:11:16 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:11:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:11:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:11:17 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:11:17 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:11:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:11:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:11:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:11:21 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:11:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:11:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:11:21 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:11:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 20:11:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:11:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:11:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:11:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:11:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:11:24 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:11:24 - job_xml_thread(): Done retrieving: data size 43847047
Thu 16 Jan 2014 20:11:24 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:11:24 - XML: Start document: iteration 3
Thu 16 Jan 2014 20:11:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43847047
Thu 16 Jan 2014 20:11:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:11:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43847047
Thu 16 Jan 2014 20:11:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:11:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:11:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:11:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:11:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:11:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:11:42 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:11:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:11:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:11:43 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:11:43 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:11:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:11:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:11:43 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:11:45 - XML: Processed 654990 elements - found 770 jobs
Thu 16 Jan 2014 20:11:45 - job 7346014 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 20:11:45 - job 7346526 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 20:11:45 - job 7346527 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 20:11:45 - job 7346652 appears to have finished
Thu 16 Jan 2014 20:11:45 - job 7346690 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 20:11:45 - job 7346682 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 20:11:45 - job 7344467 appears to have finished
Thu 16 Jan 2014 20:11:45 - job 7346507 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 20:11:45 - job_xml_thread(): Found 9 updated jobs.
Thu 16 Jan 2014 20:11:45 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 20:11:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:11:47 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:11:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:11:47 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:11:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 20:11:47 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:11:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 20:11:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5821 values 91789 bits 11473 bytes 
Thu 16 Jan 2014 20:11:48 - job_xml_thread(): Done storing. succesfully stored: 9 jobs
Thu 16 Jan 2014 20:11:48 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:11:48 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:11:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:11:49 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:11:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:11:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:11:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:11:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:11:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:11:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:11:53 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:11:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43275960
Thu 16 Jan 2014 20:11:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:11:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43275960
Thu 16 Jan 2014 20:11:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:11:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:11:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:12:03 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:12:03 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:12:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:12:04 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:12:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:12:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:12:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:12:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:12:05 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:12:05 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:12:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:12:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:12:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:12:09 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:12:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:12:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:12:09 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:12:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 20:12:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:12:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:12:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:12:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:12:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:12:12 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:12:12 - job_xml_thread(): Done retrieving: data size 43247446
Thu 16 Jan 2014 20:12:12 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:12:12 - XML: Start document: iteration 4
Thu 16 Jan 2014 20:12:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43247446
Thu 16 Jan 2014 20:12:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:12:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43247446
Thu 16 Jan 2014 20:12:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:12:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:12:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:12:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:12:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:12:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:12:28 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:12:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:12:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:12:29 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:12:29 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:12:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:12:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:12:29 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:12:33 - XML: Processed 647538 elements - found 770 jobs
Thu 16 Jan 2014 20:12:33 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:12:33 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:12:33 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:12:33 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:12:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:12:35 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:12:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:12:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:12:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:12:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:12:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:12:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:12:38 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:12:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43716021
Thu 16 Jan 2014 20:12:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:12:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43716021
Thu 16 Jan 2014 20:12:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:12:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:12:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:12:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:12:47 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:12:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:12:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:12:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:12:47 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:12:48 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:12:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:12:48 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:12:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:12:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43716021
Thu 16 Jan 2014 20:12:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:12:48 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:12:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:12:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 20:12:48 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:12:48 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:12:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 20:12:48 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:12:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8788 values 138549 bits 17318 bytes 
Thu 16 Jan 2014 20:12:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:12:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:12:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:12:58 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:13:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:13:01 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:13:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:13:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:13:02 - Leaving storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 20:13:02 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Thu 16 Jan 2014 20:13:02 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:13:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:13:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:13:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:13:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:13:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:13:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:13:04 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:13:04 - job_xml_thread(): Done retrieving: data size 43864037
Thu 16 Jan 2014 20:13:04 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:13:04 - XML: Start document: iteration 5
Thu 16 Jan 2014 20:13:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43864037
Thu 16 Jan 2014 20:13:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:13:05 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:13:06 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:13:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:13:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43864037
Thu 16 Jan 2014 20:13:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:13:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:13:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:13:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:13:20 - XML: Processed 655732 elements - found 767 jobs
Thu 16 Jan 2014 20:13:20 - job 7346014 field 'start_timestamp' changed since saved from: 1389899421 to: 1389899390
Thu 16 Jan 2014 20:13:20 - job 7344538 appears to have finished
Thu 16 Jan 2014 20:13:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:13:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:13:21 - job 7346782 field 'start_timestamp' changed since saved from: 1389899427 to: 1389899375
Thu 16 Jan 2014 20:13:21 - job 7346777 appears to have finished
Thu 16 Jan 2014 20:13:21 - job 7346655 appears to have finished
Thu 16 Jan 2014 20:13:21 - job 7346651 appears to have finished
Thu 16 Jan 2014 20:13:21 - job 7346720 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 20:13:21 - job 7346001 appears to have finished
Thu 16 Jan 2014 20:13:21 - job_xml_thread(): Found 10 updated jobs.
Thu 16 Jan 2014 20:13:21 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 20:13:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:13:22 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:13:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:13:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:13:23 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:13:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:13:23 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:13:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:13:23 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:13:23 - job_xml_thread(): Done storing. succesfully stored: 10 jobs
Thu 16 Jan 2014 20:13:23 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:13:23 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:13:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:13:27 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:13:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:13:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:13:28 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:13:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 20:13:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:13:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:13:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:13:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:13:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:13:29 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:13:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43902685
Thu 16 Jan 2014 20:13:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:13:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43902685
Thu 16 Jan 2014 20:13:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:13:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:13:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:13:38 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:13:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:13:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:13:38 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:13:39 - job_xml_thread(): Done retrieving: data size 43902685
Thu 16 Jan 2014 20:13:39 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:13:39 - XML: Start document: iteration 6
Thu 16 Jan 2014 20:13:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:13:40 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:13:40 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:13:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:13:40 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:13:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:13:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:13:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:13:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:13:48 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:13:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:13:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 20:13:49 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:13:49 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:13:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 20:13:49 - XML: Processed 655732 elements - found 767 jobs
Thu 16 Jan 2014 20:13:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5712 values 90054 bits 11256 bytes 
Thu 16 Jan 2014 20:13:49 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:13:49 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:13:49 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:13:49 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:13:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:13:51 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:13:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:13:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:13:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:13:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:13:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:13:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:13:53 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:13:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43887472
Thu 16 Jan 2014 20:13:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:13:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43887472
Thu 16 Jan 2014 20:13:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:13:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:13:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:14:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:14:03 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:14:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:14:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:14:04 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:14:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:14:04 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:14:04 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:14:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:14:04 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:14:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:14:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:14:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:14:07 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:14:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:14:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:14:08 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:14:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 20:14:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:14:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:14:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:14:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:14:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:14:09 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:14:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43916728
Thu 16 Jan 2014 20:14:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:14:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43916728
Thu 16 Jan 2014 20:14:10 - job_xml_thread(): Done retrieving: data size 43916728
Thu 16 Jan 2014 20:14:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:14:10 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:14:10 - XML: Start document: iteration 7
Thu 16 Jan 2014 20:14:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:14:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:14:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:14:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:14:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:14:26 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:14:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:14:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:14:26 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:14:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:14:26 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:14:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:14:26 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:14:30 - XML: Processed 655732 elements - found 767 jobs
Thu 16 Jan 2014 20:14:30 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:14:30 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:14:30 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:14:30 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:14:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:14:33 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:14:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:14:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:14:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:14:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:14:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:14:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:14:35 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:14:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43892463
Thu 16 Jan 2014 20:14:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:14:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43892463
Thu 16 Jan 2014 20:14:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:14:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:14:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:14:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:14:45 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:14:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:14:45 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:14:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:14:45 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:14:46 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:14:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:14:46 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:14:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:14:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:14:49 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:14:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:14:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:14:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:14:49 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:14:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:14:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:14:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:14:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:14:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:14:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:14:50 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:14:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:14:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 20:14:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 20:14:50 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:14:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8303 values 130914 bits 16364 bytes 
Thu 16 Jan 2014 20:14:51 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:14:51 - job_xml_thread(): Done retrieving: data size 43911532
Thu 16 Jan 2014 20:14:51 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:14:51 - XML: Start document: iteration 8
Thu 16 Jan 2014 20:14:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43911532
Thu 16 Jan 2014 20:14:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:14:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43911532
Thu 16 Jan 2014 20:14:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:15:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:15:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:15:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:15:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:15:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:15:06 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:15:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:15:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:15:07 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:15:07 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:15:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:15:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:15:07 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:15:11 - XML: Processed 655728 elements - found 765 jobs
Thu 16 Jan 2014 20:15:12 - job 7345754 appears to have finished
Thu 16 Jan 2014 20:15:12 - job 7346783 field 'start_timestamp' changed since saved from: 1389899564 to: 1389899519
Thu 16 Jan 2014 20:15:12 - job 7346722 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 20:15:12 - job 7346687 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 20:15:12 - job 7346520 appears to have finished
Thu 16 Jan 2014 20:15:12 - job_xml_thread(): Found 5 updated jobs.
Thu 16 Jan 2014 20:15:12 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 20:15:13 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Thu 16 Jan 2014 20:15:13 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:15:13 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:15:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:15:14 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:15:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:15:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:15:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:15:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:15:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:15:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:15:16 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:15:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 20:15:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:15:16 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:15:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43890208
Thu 16 Jan 2014 20:15:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:15:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43890208
Thu 16 Jan 2014 20:15:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:15:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:15:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:15:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:15:27 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:15:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:15:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:15:27 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:15:27 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:15:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:15:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:15:27 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:15:28 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:15:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:15:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:15:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:15:31 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:15:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:15:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:15:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:15:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:15:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:15:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:15:32 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:15:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43902742
Thu 16 Jan 2014 20:15:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:15:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43902742
Thu 16 Jan 2014 20:15:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:15:33 - job_xml_thread(): Done retrieving: data size 43902742
Thu 16 Jan 2014 20:15:33 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:15:33 - XML: Start document: iteration 9
Thu 16 Jan 2014 20:15:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:15:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:15:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:15:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:15:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:15:49 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:15:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:15:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:15:50 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:15:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:15:50 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:15:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:15:50 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:15:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:15:50 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:15:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:15:51 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:15:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 20:15:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 20:15:51 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:15:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7755 values 122250 bits 15281 bytes 
Thu 16 Jan 2014 20:15:53 - XML: Processed 655725 elements - found 765 jobs
Thu 16 Jan 2014 20:15:53 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:15:53 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:15:53 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:15:53 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:15:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:15:54 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:15:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:15:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:15:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:15:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:15:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:15:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:15:56 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:15:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43917600
Thu 16 Jan 2014 20:15:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:15:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43917600
Thu 16 Jan 2014 20:15:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:15:58 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Thu 16 Jan 2014 20:15:58 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:16:00 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:16:00 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:16:00 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 20:16:00 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 20:16:00 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 20:16:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:16:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:16:06 - size of cluster 'LISA Cluster': 624 hosts 79469 metrics 850718 values 13425037 bits 1678129 bytes 
Thu 16 Jan 2014 20:16:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:16:08 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:16:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:16:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:16:08 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:16:08 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:16:09 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:16:09 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:16:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:16:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:16:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:16:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:16:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:16:15 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:16:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:16:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:16:15 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:16:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 20:16:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:16:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:16:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:16:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:16:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:16:17 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:16:17 - job_xml_thread(): Done retrieving: data size 43906121
Thu 16 Jan 2014 20:16:17 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:16:17 - XML: Start document: iteration 10
Thu 16 Jan 2014 20:16:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43906121
Thu 16 Jan 2014 20:16:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43906121
Thu 16 Jan 2014 20:16:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:16:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:16:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:16:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:16:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:16:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:16:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:16:35 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:16:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:16:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:16:36 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:16:36 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:16:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:16:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:16:36 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:16:37 - XML: Processed 655722 elements - found 765 jobs
Thu 16 Jan 2014 20:16:37 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:16:37 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:16:37 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:16:37 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:16:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:16:41 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:16:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:16:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:16:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:16:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:16:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:16:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:16:44 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:16:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43921931
Thu 16 Jan 2014 20:16:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:16:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43921931
Thu 16 Jan 2014 20:16:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:16:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:16:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:16:51 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:16:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:16:52 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:16:52 - job_xml_thread(): Done retrieving: data size 43921931
Thu 16 Jan 2014 20:16:52 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:16:52 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:16:52 - XML: Start document: iteration 11
Thu 16 Jan 2014 20:16:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:16:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 20:16:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 20:16:52 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:16:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8863 values 140039 bits 17504 bytes 
Thu 16 Jan 2014 20:16:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:16:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:17:00 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:17:00 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 20:17:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:17:01 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:17:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:17:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:17:02 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:17:02 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:17:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:17:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:17:02 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:17:08 - XML: Processed 655728 elements - found 765 jobs
Thu 16 Jan 2014 20:17:08 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:17:08 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:17:08 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:17:08 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:17:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:17:09 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:17:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:17:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:17:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:17:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:17:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:17:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:17:12 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:17:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43882547
Thu 16 Jan 2014 20:17:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:17:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43882547
Thu 16 Jan 2014 20:17:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:17:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:17:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:17:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:17:22 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:17:22 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:17:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 20:17:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:17:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:17:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:17:23 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:17:23 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:17:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:17:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:17:23 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:17:23 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:17:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:17:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:17:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:17:27 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:17:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:17:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:17:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:17:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:17:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:17:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:17:30 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:17:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583347
Thu 16 Jan 2014 20:17:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:17:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583347
Thu 16 Jan 2014 20:17:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:17:31 - job_xml_thread(): Done retrieving: data size 43583347
Thu 16 Jan 2014 20:17:32 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:17:32 - XML: Start document: iteration 12
Thu 16 Jan 2014 20:17:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:17:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:17:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:17:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:17:50 - XML: Processed 651609 elements - found 765 jobs
Thu 16 Jan 2014 20:17:50 - job 7346017 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 20:17:51 - job 7346743 appears to have finished
Thu 16 Jan 2014 20:17:51 - job 7346656 appears to have finished
Thu 16 Jan 2014 20:17:51 - job 7346730 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 20:17:51 - job 7346729 report time 1389899657 does not match current heartbeat 1389899777 : ignoring job
Thu 16 Jan 2014 20:17:51 - job_xml_thread(): Found 6 updated jobs.
Thu 16 Jan 2014 20:17:51 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 20:17:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:17:52 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:17:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:17:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:17:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:17:52 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:17:52 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:17:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:17:52 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:17:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 20:17:52 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:17:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:17:52 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:17:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:17:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 20:17:52 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:17:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6132 values 97000 bits 12125 bytes 
Thu 16 Jan 2014 20:17:52 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Thu 16 Jan 2014 20:17:52 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:17:52 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:17:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:17:54 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:17:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:17:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:17:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:17:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:17:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:17:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:17:59 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:17:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43272699
Thu 16 Jan 2014 20:17:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:18:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43272699
Thu 16 Jan 2014 20:18:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:18:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:18:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:18:07 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:18:07 - job_xml_thread(): Done retrieving: data size 43272699
Thu 16 Jan 2014 20:18:07 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:18:07 - XML: Start document: iteration 13
Thu 16 Jan 2014 20:18:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:18:09 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:18:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:18:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:18:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:18:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:18:11 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:18:11 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:18:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:18:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:18:11 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:18:13 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:18:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 20:18:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:18:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:18:21 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:18:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:18:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:18:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:18:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:18:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:18:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:18:23 - XML: Processed 647678 elements - found 765 jobs
Thu 16 Jan 2014 20:18:23 - job 7346729 report time 1389899657 does not match current heartbeat 1389899777 : ignoring job
Thu 16 Jan 2014 20:18:23 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:18:23 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:18:23 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:18:23 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:18:26 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:18:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43289692
Thu 16 Jan 2014 20:18:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:18:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:18:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:18:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43289692
Thu 16 Jan 2014 20:18:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:18:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:18:36 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:18:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:18:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:18:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:18:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:18:36 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:18:36 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:18:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:18:36 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:18:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:18:38 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:18:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:18:41 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:18:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:18:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:18:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:18:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:18:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:18:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:18:44 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:18:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43810086
Thu 16 Jan 2014 20:18:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:18:45 - job_xml_thread(): Done retrieving: data size 43810086
Thu 16 Jan 2014 20:18:45 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:18:45 - XML: Start document: iteration 14
Thu 16 Jan 2014 20:18:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43810086
Thu 16 Jan 2014 20:18:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:18:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:18:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:18:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:18:52 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:18:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:18:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 20:18:53 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:18:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9203 values 145399 bits 18174 bytes 
Thu 16 Jan 2014 20:18:53 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:18:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 20:18:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:18:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:19:04 - XML: Processed 654396 elements - found 765 jobs
Thu 16 Jan 2014 20:19:04 - job 7346729 report time 1389899657 does not match current heartbeat 1389899777 : ignoring job
Thu 16 Jan 2014 20:19:04 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:19:04 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:19:04 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:19:04 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:19:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:19:05 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:19:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:19:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:19:06 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:19:06 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:19:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:19:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:19:06 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:19:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:19:08 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:19:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:19:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:19:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:19:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:19:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:19:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:19:12 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:19:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43913303
Thu 16 Jan 2014 20:19:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:19:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43913303
Thu 16 Jan 2014 20:19:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:19:20 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:19:20 - job_xml_thread(): Done retrieving: data size 43913303
Thu 16 Jan 2014 20:19:20 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:19:20 - XML: Start document: iteration 15
Thu 16 Jan 2014 20:19:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:19:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:19:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:19:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:19:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:19:32 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:19:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:19:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:19:33 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:19:33 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:19:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:19:33 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:19:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:19:35 - XML: Processed 655722 elements - found 762 jobs
Thu 16 Jan 2014 20:19:35 - job 7346785 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 20:19:35 - job 7346786 report time 1389899777 does not match current heartbeat 1389899898 : ignoring job
Thu 16 Jan 2014 20:19:35 - job 7346543 appears to have finished
Thu 16 Jan 2014 20:19:35 - job 7337047 appears to have finished
Thu 16 Jan 2014 20:19:35 - job 7345980 appears to have finished
Thu 16 Jan 2014 20:19:35 - job_xml_thread(): Found 5 updated jobs.
Thu 16 Jan 2014 20:19:35 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 20:19:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:19:36 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:19:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:19:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:19:36 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Thu 16 Jan 2014 20:19:36 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:19:36 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:19:37 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:19:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 20:19:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:19:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:19:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:19:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:19:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:19:40 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:19:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43898470
Thu 16 Jan 2014 20:19:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:19:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43898470
Thu 16 Jan 2014 20:19:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:19:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:19:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:19:51 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:19:51 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:19:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:19:52 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:19:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:19:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:19:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:19:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:19:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:19:53 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:19:54 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:19:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:19:54 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:19:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:19:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:19:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 20:19:54 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:19:54 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:19:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5836 values 92060 bits 11507 bytes 
Thu 16 Jan 2014 20:19:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 20:19:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:19:57 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:19:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:19:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:19:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:19:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:19:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:19:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:20:01 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:20:01 - job_xml_thread(): Done retrieving: data size 43903849
Thu 16 Jan 2014 20:20:01 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:20:01 - XML: Start document: iteration 16
Thu 16 Jan 2014 20:20:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43903849
Thu 16 Jan 2014 20:20:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43903849
Thu 16 Jan 2014 20:20:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:20:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:20:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:20:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:20:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:20:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:20:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:20:20 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:20:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:20:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:20:21 - XML: Processed 655722 elements - found 762 jobs
Thu 16 Jan 2014 20:20:21 - job 7346786 report time 1389899777 does not match current heartbeat 1389899898 : ignoring job
Thu 16 Jan 2014 20:20:22 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:20:22 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:20:22 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:20:22 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:20:22 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:20:22 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:20:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:20:22 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:20:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:20:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:20:25 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:20:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:20:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:20:25 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:20:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 20:20:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:20:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:20:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:20:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:20:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:20:27 - Leaving storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 20:20:27 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Thu 16 Jan 2014 20:20:27 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:20:28 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:20:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43915284
Thu 16 Jan 2014 20:20:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:20:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43915284
Thu 16 Jan 2014 20:20:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:20:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:20:37 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:20:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:20:37 - job_xml_thread(): Done retrieving: data size 43915284
Thu 16 Jan 2014 20:20:37 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:20:37 - XML: Start document: iteration 17
Thu 16 Jan 2014 20:20:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:20:40 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:20:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:20:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:20:41 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:20:41 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:20:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:20:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:20:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:20:41 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:20:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:20:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:20:47 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:20:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:20:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:20:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:20:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:20:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:20:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:20:49 - XML: Processed 655722 elements - found 762 jobs
Thu 16 Jan 2014 20:20:49 - job 7346786 report time 1389899777 does not match current heartbeat 1389899898 : ignoring job
Thu 16 Jan 2014 20:20:49 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:20:49 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:20:49 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:20:49 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:20:51 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:20:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43883942
Thu 16 Jan 2014 20:20:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:20:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43883942
Thu 16 Jan 2014 20:20:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:20:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:20:54 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:20:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:20:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 20:20:55 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:20:55 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:20:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 20:20:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8936 values 140926 bits 17615 bytes 
Thu 16 Jan 2014 20:20:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:20:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:21:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:21:02 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:21:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:21:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:21:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:21:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:21:02 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:21:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:21:02 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:21:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:21:02 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:21:04 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:21:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:21:06 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:21:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:21:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:21:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:21:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:21:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:21:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:21:10 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:21:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43910391
Thu 16 Jan 2014 20:21:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:21:11 - job_xml_thread(): Done retrieving: data size 43910391
Thu 16 Jan 2014 20:21:11 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:21:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43910391
Thu 16 Jan 2014 20:21:11 - XML: Start document: iteration 18
Thu 16 Jan 2014 20:21:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:21:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:21:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:21:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:21:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:21:30 - XML: Processed 655712 elements - found 757 jobs
Thu 16 Jan 2014 20:21:30 - job 7346659 appears to have finished
Thu 16 Jan 2014 20:21:30 - job 7346731 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 20:21:30 - job 7337045 appears to have finished
Thu 16 Jan 2014 20:21:30 - job 7346676 appears to have finished
Thu 16 Jan 2014 20:21:30 - job 7346542 appears to have finished
Thu 16 Jan 2014 20:21:30 - job 7346663 appears to have finished
Thu 16 Jan 2014 20:21:30 - job_xml_thread(): Found 7 updated jobs.
Thu 16 Jan 2014 20:21:30 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 20:21:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:21:31 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:21:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:21:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:21:32 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:21:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:21:32 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:21:32 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:21:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:21:32 - job_xml_thread(): Done storing. succesfully stored: 7 jobs
Thu 16 Jan 2014 20:21:32 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:21:32 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:21:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:21:35 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:21:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:21:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:21:35 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:21:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 20:21:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:21:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:21:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:21:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:21:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:21:37 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:21:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43912805
Thu 16 Jan 2014 20:21:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:21:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43912805
Thu 16 Jan 2014 20:21:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:21:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:21:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:21:48 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:21:48 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:21:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:21:50 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:21:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:21:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:21:51 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:21:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:21:51 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:21:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:21:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:21:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:21:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:21:52 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:21:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:21:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:21:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:21:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:21:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:21:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:21:54 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:21:54 - job_xml_thread(): Done retrieving: data size 43918080
Thu 16 Jan 2014 20:21:54 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:21:54 - XML: Start document: iteration 19
Thu 16 Jan 2014 20:21:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43918080
Thu 16 Jan 2014 20:21:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:21:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:21:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43918080
Thu 16 Jan 2014 20:21:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:21:55 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:21:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:21:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 20:21:56 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:21:56 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:21:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 20:21:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5844 values 92165 bits 11520 bytes 
Thu 16 Jan 2014 20:22:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:22:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:22:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:22:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:22:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:22:14 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:22:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:22:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:22:15 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:22:15 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:22:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:22:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:22:15 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:22:18 - XML: Processed 655712 elements - found 757 jobs
Thu 16 Jan 2014 20:22:18 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:22:18 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:22:18 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:22:18 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:22:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:22:19 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:22:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:22:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:22:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:22:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:22:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:22:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:22:21 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:22:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43903718
Thu 16 Jan 2014 20:22:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:22:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43903718
Thu 16 Jan 2014 20:22:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:22:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:22:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:22:33 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:22:33 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:22:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:22:34 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:22:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:22:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:22:34 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:22:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:22:34 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:22:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:22:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:22:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:22:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:22:37 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:22:37 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:22:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 20:22:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:22:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:22:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:22:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:22:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:22:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:22:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:22:39 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:22:39 - job_xml_thread(): Done retrieving: data size 43919134
Thu 16 Jan 2014 20:22:39 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:22:39 - XML: Start document: iteration 20
Thu 16 Jan 2014 20:22:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43919134
Thu 16 Jan 2014 20:22:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:22:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43919134
Thu 16 Jan 2014 20:22:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:22:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:22:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:22:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:22:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:22:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:22:56 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:22:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:22:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 20:22:58 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:22:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5949 values 93822 bits 11727 bytes 
Thu 16 Jan 2014 20:22:58 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:22:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 20:23:00 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Thu 16 Jan 2014 20:23:00 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:23:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:23:00 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:23:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:23:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:23:00 - XML: Processed 655712 elements - found 757 jobs
Thu 16 Jan 2014 20:23:01 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:23:01 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:23:01 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:23:01 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:23:01 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:23:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:23:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:23:01 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:23:01 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:23:01 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 20:23:01 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 20:23:01 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 20:23:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:23:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:23:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:23:02 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:23:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:23:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:23:02 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:23:02 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:23:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:23:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:23:03 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 806829 values 12742948 bits 1592868 bytes 
Thu 16 Jan 2014 20:23:07 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:23:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43909180
Thu 16 Jan 2014 20:23:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:23:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43909180
Thu 16 Jan 2014 20:23:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:23:16 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:23:16 - job_xml_thread(): Done retrieving: data size 43909180
Thu 16 Jan 2014 20:23:16 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:23:16 - Housekeeping: checking database for timed out jobs..
Thu 16 Jan 2014 20:23:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:23:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:23:16 - Housekeeping: Found 0 timed out jobs in database: closing entries
Thu 16 Jan 2014 20:23:16 - Housekeeping: done.
Thu 16 Jan 2014 20:23:16 - XML: Start document: iteration 0
Thu 16 Jan 2014 20:23:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:23:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:23:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:23:24 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:23:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:23:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:23:25 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:23:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:23:25 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:23:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:23:25 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:23:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:23:27 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:23:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:23:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:23:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:23:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:23:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:23:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:23:32 - XML: Processed 655710 elements - found 756 jobs
Thu 16 Jan 2014 20:23:32 - job 7346522 appears to have finished
Thu 16 Jan 2014 20:23:32 - job 7346237 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 20:23:32 - job_xml_thread(): Found 2 updated jobs.
Thu 16 Jan 2014 20:23:32 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 20:23:32 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Thu 16 Jan 2014 20:23:32 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:23:32 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:23:32 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:23:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 20:23:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:23:35 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:23:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43409561
Thu 16 Jan 2014 20:23:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:23:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43409561
Thu 16 Jan 2014 20:23:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:23:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:23:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:23:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:23:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:23:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:23:47 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:23:47 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:23:47 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:23:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:23:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:23:47 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:23:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:23:47 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:23:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:23:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:23:50 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:23:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:23:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:23:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:23:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:23:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:23:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:23:54 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:23:54 - job_xml_thread(): Done retrieving: data size 43262995
Thu 16 Jan 2014 20:23:54 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:23:54 - XML: Start document: iteration 1
Thu 16 Jan 2014 20:23:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43262995
Thu 16 Jan 2014 20:23:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:23:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43262995
Thu 16 Jan 2014 20:23:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:23:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:23:59 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:23:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:23:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 20:23:59 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:23:59 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6532 values 103134 bits 12891 bytes 
Thu 16 Jan 2014 20:23:59 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:23:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 20:24:01 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:24:01 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 20:24:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:24:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:24:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:24:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:24:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:24:12 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:24:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:24:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:24:12 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:24:12 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:24:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:24:12 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:24:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:24:15 - XML: Processed 647718 elements - found 756 jobs
Thu 16 Jan 2014 20:24:15 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:24:15 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:24:15 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:24:15 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:24:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:24:18 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:24:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:24:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:24:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:24:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:24:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:24:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:24:22 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:24:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43297879
Thu 16 Jan 2014 20:24:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:24:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43297879
Thu 16 Jan 2014 20:24:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:24:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:24:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:24:31 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:24:31 - job_xml_thread(): Done retrieving: data size 43297879
Thu 16 Jan 2014 20:24:31 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:24:31 - XML: Start document: iteration 2
Thu 16 Jan 2014 20:24:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:24:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:24:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:24:39 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:24:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:24:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:24:41 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:24:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:24:41 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:24:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:24:41 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:24:47 - XML: Processed 648258 elements - found 756 jobs
Thu 16 Jan 2014 20:24:47 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:24:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:24:47 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:24:47 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:24:47 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:24:47 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:24:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:24:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:24:48 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:24:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 20:24:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:24:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:24:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:24:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:24:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:24:51 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:24:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43846938
Thu 16 Jan 2014 20:24:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:24:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43846938
Thu 16 Jan 2014 20:24:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:24:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:24:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:24:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:24:59 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:25:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:25:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 20:25:00 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:25:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 20:25:00 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:25:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5905 values 93104 bits 11638 bytes 
Thu 16 Jan 2014 20:25:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:25:01 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:25:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:25:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:25:02 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:25:02 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:25:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:25:02 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:25:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:25:02 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:25:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:25:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:25:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:25:07 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:25:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:25:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:25:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:25:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:25:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:25:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:25:11 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:25:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43897937
Thu 16 Jan 2014 20:25:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:25:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43897937
Thu 16 Jan 2014 20:25:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:25:12 - job_xml_thread(): Done retrieving: data size 43897937
Thu 16 Jan 2014 20:25:12 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:25:12 - XML: Start document: iteration 3
Thu 16 Jan 2014 20:25:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:25:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:25:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:25:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:25:33 - XML: Processed 655712 elements - found 757 jobs
Thu 16 Jan 2014 20:25:33 - job 7345982 appears to have finished
Thu 16 Jan 2014 20:25:33 - job_xml_thread(): Found 3 updated jobs.
Thu 16 Jan 2014 20:25:33 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 20:25:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:25:34 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:25:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:25:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:25:34 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Thu 16 Jan 2014 20:25:34 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:25:34 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:25:35 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:25:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:25:35 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:25:35 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:25:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:25:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:25:35 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:25:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:25:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:25:36 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:25:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 20:25:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:25:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:25:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:25:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:25:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:25:39 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:25:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43917139
Thu 16 Jan 2014 20:25:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:25:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43917139
Thu 16 Jan 2014 20:25:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:25:49 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:25:49 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:25:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:25:49 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:25:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:25:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:25:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:25:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:25:51 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:25:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:25:51 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:25:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:25:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:25:54 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:25:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:25:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:25:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:25:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:25:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:25:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:25:57 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:25:57 - job_xml_thread(): Done retrieving: data size 43900976
Thu 16 Jan 2014 20:25:57 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:25:57 - XML: Start document: iteration 4
Thu 16 Jan 2014 20:25:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43900976
Thu 16 Jan 2014 20:25:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:25:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43900976
Thu 16 Jan 2014 20:25:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:26:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:26:02 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:26:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:26:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 20:26:03 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:26:03 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:26:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9011 values 142137 bits 17767 bytes 
Thu 16 Jan 2014 20:26:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 20:26:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:26:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:26:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:26:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:26:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:26:11 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:26:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:26:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:26:11 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:26:11 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:26:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:26:11 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:26:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:26:15 - XML: Processed 655712 elements - found 757 jobs
Thu 16 Jan 2014 20:26:16 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:26:16 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:26:16 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:26:16 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:26:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:26:19 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:26:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:26:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:26:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:26:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:26:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:26:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:26:23 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:26:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43888068
Thu 16 Jan 2014 20:26:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:26:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43888068
Thu 16 Jan 2014 20:26:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:26:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:26:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:26:31 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:26:31 - job_xml_thread(): Done retrieving: data size 43888068
Thu 16 Jan 2014 20:26:31 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:26:32 - XML: Start document: iteration 5
Thu 16 Jan 2014 20:26:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:26:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:26:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:26:36 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:26:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:26:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:26:37 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:26:37 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:26:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:26:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:26:37 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:26:41 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:26:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 20:26:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:26:47 - XML: Processed 655712 elements - found 757 jobs
Thu 16 Jan 2014 20:26:47 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:26:47 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:26:47 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:26:47 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:26:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:26:48 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:26:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:26:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:26:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:26:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:26:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:26:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:26:51 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:26:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43874053
Thu 16 Jan 2014 20:26:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:26:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43874053
Thu 16 Jan 2014 20:26:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:26:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:26:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:27:02 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:27:02 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:27:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:27:03 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:27:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:27:03 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:27:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:27:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:27:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:27:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:27:04 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:27:04 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:27:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:27:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 20:27:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:27:04 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:27:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:27:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 20:27:04 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:27:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6032 values 95149 bits 11893 bytes 
Thu 16 Jan 2014 20:27:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:27:07 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:27:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:27:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:27:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:27:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:27:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:27:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:27:12 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:27:12 - job_xml_thread(): Done retrieving: data size 43903870
Thu 16 Jan 2014 20:27:12 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:27:12 - XML: Start document: iteration 6
Thu 16 Jan 2014 20:27:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43903870
Thu 16 Jan 2014 20:27:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:27:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43903870
Thu 16 Jan 2014 20:27:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:27:15 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:27:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 20:27:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:27:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:27:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:27:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:27:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:27:27 - XML: Processed 655704 elements - found 753 jobs
Thu 16 Jan 2014 20:27:27 - job 7346685 appears to have finished
Thu 16 Jan 2014 20:27:28 - job 7346519 appears to have finished
Thu 16 Jan 2014 20:27:28 - job 7346720 appears to have finished
Thu 16 Jan 2014 20:27:28 - job 7346765 appears to have finished
Thu 16 Jan 2014 20:27:28 - job 7346248 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 20:27:28 - job_xml_thread(): Found 5 updated jobs.
Thu 16 Jan 2014 20:27:28 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 20:27:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:27:29 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:27:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:27:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:27:30 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:27:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:27:30 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:27:30 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:27:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:27:30 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Thu 16 Jan 2014 20:27:30 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:27:30 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:27:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:27:32 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:27:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:27:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:27:33 - Leaving storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 20:27:33 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Thu 16 Jan 2014 20:27:33 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:27:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:27:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:27:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:27:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:27:35 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:27:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43901404
Thu 16 Jan 2014 20:27:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:27:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43901404
Thu 16 Jan 2014 20:27:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:27:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:27:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:27:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:27:45 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:27:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:27:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:27:45 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:27:45 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:27:46 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:27:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:27:46 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:27:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:27:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:27:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:27:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:27:49 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:27:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:27:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:27:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:27:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:27:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:27:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:27:51 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:27:51 - job_xml_thread(): Done retrieving: data size 43908953
Thu 16 Jan 2014 20:27:51 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:27:51 - XML: Start document: iteration 7
Thu 16 Jan 2014 20:27:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43908953
Thu 16 Jan 2014 20:27:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:27:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43908953
Thu 16 Jan 2014 20:27:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:28:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:28:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:28:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:28:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:28:04 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:28:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:28:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:28:05 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:28:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 20:28:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 20:28:05 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:28:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9418 values 148592 bits 18574 bytes 
Thu 16 Jan 2014 20:28:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:28:06 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:28:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:28:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:28:06 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:28:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:28:06 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:28:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:28:07 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:28:10 - XML: Processed 655704 elements - found 753 jobs
Thu 16 Jan 2014 20:28:11 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:28:11 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:28:11 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:28:11 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:28:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:28:13 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:28:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:28:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:28:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:28:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:28:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:28:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:28:16 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:28:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 20:28:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:28:16 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:28:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43895962
Thu 16 Jan 2014 20:28:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:28:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43895962
Thu 16 Jan 2014 20:28:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:28:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:28:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:28:26 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:28:26 - job_xml_thread(): Done retrieving: data size 43895962
Thu 16 Jan 2014 20:28:26 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:28:26 - XML: Start document: iteration 8
Thu 16 Jan 2014 20:28:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:28:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:28:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:28:29 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:28:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:28:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:28:29 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:28:29 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:28:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:28:29 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:28:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:28:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:28:37 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:28:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:28:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:28:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:28:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:28:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:28:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:28:39 - XML: Processed 655704 elements - found 753 jobs
Thu 16 Jan 2014 20:28:39 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:28:39 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:28:39 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:28:39 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:28:40 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:28:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43899001
Thu 16 Jan 2014 20:28:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:28:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43899001
Thu 16 Jan 2014 20:28:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:28:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:28:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:28:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:28:51 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:28:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:28:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:28:53 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:28:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:28:53 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:28:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:28:53 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:28:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:28:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:28:54 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:28:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:28:54 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:28:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:28:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:28:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:28:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:28:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:28:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:28:57 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:28:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43921379
Thu 16 Jan 2014 20:28:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:28:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43921379
Thu 16 Jan 2014 20:28:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:28:59 - job_xml_thread(): Done retrieving: data size 43921379
Thu 16 Jan 2014 20:28:59 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:28:59 - XML: Start document: iteration 9
Thu 16 Jan 2014 20:29:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:29:05 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:29:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:29:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 20:29:08 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:29:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148509 bits 18563 bytes 
Thu 16 Jan 2014 20:29:08 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:29:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:29:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 20:29:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:29:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:29:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:29:14 - XML: Processed 655702 elements - found 752 jobs
Thu 16 Jan 2014 20:29:14 - job 7335213 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:14 - job 7335227 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:14 - job 7346017 appears to have finished
Thu 16 Jan 2014 20:29:14 - job 7335375 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:14 - job 7340333 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:14 - job 7335544 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:14 - job 7335395 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:14 - job 7335397 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:14 - job 7337899 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:14 - job 7345910 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:14 - job 7345911 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:14 - job 7345912 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:14 - job 7345913 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:14 - job 7345914 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:14 - job 7342698 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:14 - job 7337749 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:14 - job 7335260 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:14 - job 7344395 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:14 - job 7337590 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:14 - job 7335061 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:14 - job 7343918 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:14 - job 7346742 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:14 - job 7344401 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:14 - job 7344400 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:14 - job 7344403 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:14 - job 7344402 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:14 - job 7344405 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:14 - job 7344404 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:14 - job 7344407 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:14 - job 7335259 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:14 - job 7344409 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:14 - job 7343768 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:14 - job 7341823 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7346308 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344533 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7346749 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7346064 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7336565 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7338790 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344356 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7337640 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7337641 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7337643 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7337645 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7337646 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335699 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7345099 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344351 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7345031 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344434 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344343 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344436 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344341 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344430 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335439 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335184 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335185 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335186 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344433 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335188 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335189 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7345967 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7345969 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344334 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344359 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7346535 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7346246 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335232 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7343923 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7343921 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7343920 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7343927 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7343926 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7343929 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7343928 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344368 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344369 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344360 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344361 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344362 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344363 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344364 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344365 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344366 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344367 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335376 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344440 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344382 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7339776 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7346784 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335389 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335576 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344435 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7345925 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7345926 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7346263 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335215 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335216 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335273 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335271 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335276 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344418 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7340781 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344415 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344412 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344413 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344410 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344411 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344431 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335207 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335206 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335204 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335203 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335202 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335201 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335200 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7339391 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335209 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335208 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7339156 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7342415 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7346312 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344354 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7338775 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7343789 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7343788 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7343787 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335246 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7337863 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344338 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335401 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335400 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335403 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335402 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335405 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335404 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335406 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7341721 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7346264 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7338208 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344422 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335249 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335248 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344353 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7346254 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7343930 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7343931 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7343932 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7343933 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7343935 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7343936 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335866 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344355 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344426 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344357 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344424 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344423 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344350 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344421 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344352 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344358 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344429 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335187 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344428 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7337217 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7346753 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335183 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7338514 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7346047 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7346724 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7334710 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7334711 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7334715 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344419 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7339232 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344414 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7337500 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7336991 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7340310 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7336999 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344427 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7337261 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7343941 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344645 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7346714 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7341893 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344425 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335361 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335364 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335365 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344399 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344398 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344391 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344390 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344393 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344392 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344394 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344397 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344396 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335214 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7346260 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335211 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335212 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7346268 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335218 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335219 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7340330 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7338411 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7346162 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7337272 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335485 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7337341 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7338343 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335239 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7338025 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7341063 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7346266 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335230 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335231 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7336194 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7345909 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7345647 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7337345 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7346300 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7346302 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335250 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335254 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335255 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344420 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344342 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344340 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344437 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344346 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344347 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344432 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344345 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344348 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344349 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344438 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344439 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344416 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7343754 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7343751 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344417 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7346238 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7336871 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7336870 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344337 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344336 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344335 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7343472 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344333 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344332 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344331 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344339 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7339484 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7338784 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7337572 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335903 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335217 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335198 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7342714 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344406 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335210 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344344 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344408 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7340972 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7337799 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7344657 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335424 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335423 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335422 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335421 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7337400 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335197 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335196 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335195 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335194 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335193 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335192 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335191 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335190 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7336879 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7346097 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7335199 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job 7340327 report time 1389900381 does not match current heartbeat 1389900501 : ignoring job
Thu 16 Jan 2014 20:29:15 - job_xml_thread(): Found 1 updated jobs.
Thu 16 Jan 2014 20:29:15 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 20:29:16 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Thu 16 Jan 2014 20:29:16 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:29:16 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:29:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:29:16 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:29:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:29:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:29:17 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:29:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:29:17 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:29:17 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:29:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:29:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:29:19 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:29:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:29:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:29:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:29:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:29:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:29:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:29:22 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:29:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43842211
Thu 16 Jan 2014 20:29:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:29:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43842211
Thu 16 Jan 2014 20:29:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:29:31 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:29:31 - job_xml_thread(): Done retrieving: data size 43842211
Thu 16 Jan 2014 20:29:31 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:29:32 - XML: Start document: iteration 10
Thu 16 Jan 2014 20:29:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:29:32 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:29:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:29:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:29:34 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:29:34 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:29:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:29:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:29:34 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:29:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:29:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:29:40 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:29:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 20:29:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:29:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:29:43 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:29:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:29:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:29:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:29:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:29:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:29:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:29:44 - XML: Processed 654954 elements - found 752 jobs
Thu 16 Jan 2014 20:29:44 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:29:44 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:29:44 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:29:44 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:29:45 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:29:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43316944
Thu 16 Jan 2014 20:29:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:29:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43316944
Thu 16 Jan 2014 20:29:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:29:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:29:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:29:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:29:56 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:29:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:29:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:29:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:29:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:29:59 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:29:59 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:29:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:29:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:29:59 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:29:59 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:30:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:30:01 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:30:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:30:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:30:01 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Thu 16 Jan 2014 20:30:01 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:30:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:30:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:30:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:30:02 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:30:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:30:02 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:30:02 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 20:30:02 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 20:30:02 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 20:30:02 - size of cluster 'LISA Cluster': 624 hosts 79480 metrics 804774 values 12697468 bits 1587183 bytes 
Thu 16 Jan 2014 20:30:04 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:30:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43237360
Thu 16 Jan 2014 20:30:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:30:05 - job_xml_thread(): Done retrieving: data size 43237360
Thu 16 Jan 2014 20:30:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43237360
Thu 16 Jan 2014 20:30:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:30:05 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:30:06 - XML: Start document: iteration 11
Thu 16 Jan 2014 20:30:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:30:08 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:30:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:30:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 20:30:09 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:30:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9092 values 143355 bits 17919 bytes 
Thu 16 Jan 2014 20:30:09 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:30:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 20:30:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:30:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:30:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:30:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:30:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:30:24 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:30:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:30:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:30:26 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:30:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:30:26 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:30:26 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:30:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:30:27 - XML: Processed 647502 elements - found 752 jobs
Thu 16 Jan 2014 20:30:27 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:30:27 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:30:27 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:30:28 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:30:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:30:29 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:30:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:30:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:30:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:30:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:30:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:30:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:30:32 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:30:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43635150
Thu 16 Jan 2014 20:30:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:30:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43635150
Thu 16 Jan 2014 20:30:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:30:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:30:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:30:43 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:30:43 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:30:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:30:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:30:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:30:45 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:30:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:30:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:30:45 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:30:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:30:45 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:30:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:30:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:30:47 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:30:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:30:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:30:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:30:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:30:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:30:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:30:48 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:30:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 20:30:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:30:51 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:30:51 - job_xml_thread(): Done retrieving: data size 43857828
Thu 16 Jan 2014 20:30:51 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:30:51 - XML: Start document: iteration 12
Thu 16 Jan 2014 20:30:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43857828
Thu 16 Jan 2014 20:30:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43857828
Thu 16 Jan 2014 20:30:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:30:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:31:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:31:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:31:02 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:31:02 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 20:31:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:31:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:31:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:31:07 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:31:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:31:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:31:08 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:31:08 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:31:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:31:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:31:08 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:31:10 - XML: Processed 655200 elements - found 752 jobs
Thu 16 Jan 2014 20:31:10 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:31:10 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:31:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:31:10 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:31:10 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:31:10 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:31:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:31:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 20:31:11 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:31:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5607 values 88344 bits 11043 bytes 
Thu 16 Jan 2014 20:31:11 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:31:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 20:31:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:31:13 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:31:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:31:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:31:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:31:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:31:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:31:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:31:18 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:31:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43881302
Thu 16 Jan 2014 20:31:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:31:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43881302
Thu 16 Jan 2014 20:31:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:31:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:31:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:31:25 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:31:25 - job_xml_thread(): Done retrieving: data size 43881302
Thu 16 Jan 2014 20:31:25 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:31:25 - XML: Start document: iteration 13
Thu 16 Jan 2014 20:31:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:31:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:31:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:31:31 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:31:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:31:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:31:33 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:31:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:31:33 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:31:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:31:33 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:31:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:31:40 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:31:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:31:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:31:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:31:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:31:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:31:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:31:41 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:31:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 20:31:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:31:42 - XML: Processed 655700 elements - found 751 jobs
Thu 16 Jan 2014 20:31:42 - job 7346722 appears to have finished
Thu 16 Jan 2014 20:31:42 - job_xml_thread(): Found 1 updated jobs.
Thu 16 Jan 2014 20:31:42 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 20:31:42 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Thu 16 Jan 2014 20:31:42 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:31:42 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:31:46 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:31:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873416
Thu 16 Jan 2014 20:31:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:31:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873416
Thu 16 Jan 2014 20:31:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:31:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:31:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:31:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:31:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:31:57 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:31:58 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:31:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:31:58 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:31:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:31:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:32:00 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:32:00 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:32:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:32:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:32:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:32:02 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:32:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:32:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:32:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:32:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:32:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:32:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:32:06 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:32:06 - job_xml_thread(): Done retrieving: data size 43903601
Thu 16 Jan 2014 20:32:06 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:32:06 - XML: Start document: iteration 14
Thu 16 Jan 2014 20:32:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43903601
Thu 16 Jan 2014 20:32:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:32:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43903601
Thu 16 Jan 2014 20:32:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:32:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:32:11 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:32:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:32:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 20:32:12 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:32:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8787 values 138941 bits 17367 bytes 
Thu 16 Jan 2014 20:32:12 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:32:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 20:32:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:32:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:32:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:32:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:32:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:32:24 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:32:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:32:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:32:25 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:32:25 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:32:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:32:25 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:32:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:32:26 - XML: Processed 655700 elements - found 751 jobs
Thu 16 Jan 2014 20:32:26 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:32:26 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:32:26 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:32:26 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:32:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:32:28 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:32:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:32:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:32:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:32:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:32:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:32:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:32:32 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:32:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43902077
Thu 16 Jan 2014 20:32:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:32:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43902077
Thu 16 Jan 2014 20:32:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:32:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:32:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:32:41 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:32:41 - job_xml_thread(): Done retrieving: data size 43902077
Thu 16 Jan 2014 20:32:41 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:32:41 - XML: Start document: iteration 15
Thu 16 Jan 2014 20:32:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:32:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:32:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:32:48 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:32:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:32:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:32:49 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:32:49 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:32:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:32:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:32:49 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:32:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:32:54 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:32:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:32:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:32:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:32:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:32:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:32:56 - XML: Processed 655700 elements - found 751 jobs
Thu 16 Jan 2014 20:32:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:32:56 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:32:56 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:32:56 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:32:56 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:32:56 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:32:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 20:32:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:33:00 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:33:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43887185
Thu 16 Jan 2014 20:33:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:33:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43887185
Thu 16 Jan 2014 20:33:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:33:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:33:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:33:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:33:09 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:33:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:33:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:33:10 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:33:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:33:10 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:33:10 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:33:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:33:11 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:33:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:33:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:33:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:33:13 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:33:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:33:13 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:33:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 20:33:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 20:33:14 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:33:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5907 values 93366 bits 11670 bytes 
Thu 16 Jan 2014 20:33:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:33:16 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:33:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:33:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:33:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:33:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:33:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:33:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:33:21 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:33:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43892241
Thu 16 Jan 2014 20:33:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:33:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43892241
Thu 16 Jan 2014 20:33:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:33:22 - job_xml_thread(): Done retrieving: data size 43892241
Thu 16 Jan 2014 20:33:22 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:33:22 - XML: Start document: iteration 16
Thu 16 Jan 2014 20:33:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:33:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:33:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:33:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:33:41 - XML: Processed 655704 elements - found 753 jobs
Thu 16 Jan 2014 20:33:41 - job_xml_thread(): Found 2 updated jobs.
Thu 16 Jan 2014 20:33:41 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 20:33:42 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Thu 16 Jan 2014 20:33:43 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:33:43 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:33:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:33:44 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:33:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:33:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:33:45 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:33:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:33:45 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:33:45 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:33:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:33:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:33:46 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:33:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:33:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:33:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:33:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:33:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:33:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:33:46 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:33:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 20:33:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:33:50 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:33:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43913141
Thu 16 Jan 2014 20:33:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:33:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43913141
Thu 16 Jan 2014 20:33:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:33:58 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:33:58 - job_xml_thread(): Done retrieving: data size 43913141
Thu 16 Jan 2014 20:33:59 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:33:59 - XML: Start document: iteration 17
Thu 16 Jan 2014 20:34:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:34:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:34:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:34:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:34:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:34:10 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:34:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:34:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:34:11 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:34:11 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:34:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:34:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:34:11 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:34:13 - XML: Processed 655704 elements - found 753 jobs
Thu 16 Jan 2014 20:34:13 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:34:13 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:34:13 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:34:13 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:34:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:34:14 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:34:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:34:14 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:34:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:34:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:34:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:34:14 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:34:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 20:34:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 20:34:14 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:34:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5895 values 93032 bits 11629 bytes 
Thu 16 Jan 2014 20:34:14 - Leaving storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 20:34:14 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Thu 16 Jan 2014 20:34:14 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:34:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:34:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:34:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:34:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:34:16 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:34:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43900728
Thu 16 Jan 2014 20:34:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:34:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43900728
Thu 16 Jan 2014 20:34:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:34:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:34:25 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:34:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:34:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:34:28 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:34:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:34:28 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:34:28 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:34:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:34:28 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:34:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:34:29 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:34:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:34:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:34:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:34:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:34:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:34:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:34:30 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:34:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 20:34:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:34:32 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:34:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43905537
Thu 16 Jan 2014 20:34:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:34:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43905537
Thu 16 Jan 2014 20:34:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:34:33 - job_xml_thread(): Done retrieving: data size 43905537
Thu 16 Jan 2014 20:34:33 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:34:33 - XML: Start document: iteration 18
Thu 16 Jan 2014 20:34:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:34:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:34:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:34:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:34:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:34:50 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:34:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:34:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:34:52 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:34:52 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:34:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:34:52 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:34:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:34:55 - XML: Processed 655704 elements - found 753 jobs
Thu 16 Jan 2014 20:34:55 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:34:55 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:34:55 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:34:55 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:34:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:34:55 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:34:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:34:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:34:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:34:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:34:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:34:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:34:58 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:34:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43906093
Thu 16 Jan 2014 20:34:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:35:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43906093
Thu 16 Jan 2014 20:35:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:35:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:35:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:35:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:35:08 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:35:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:35:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:35:09 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:35:09 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:35:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:35:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:35:10 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:35:10 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:35:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:35:11 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:35:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:35:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:35:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:35:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:35:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:35:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:35:13 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:35:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43840846
Thu 16 Jan 2014 20:35:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:35:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43840846
Thu 16 Jan 2014 20:35:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:35:14 - job_xml_thread(): Done retrieving: data size 43840846
Thu 16 Jan 2014 20:35:14 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:35:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:35:15 - XML: Start document: iteration 19
Thu 16 Jan 2014 20:35:15 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:35:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:35:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 20:35:18 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:35:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 11212 values 176760 bits 22095 bytes 
Thu 16 Jan 2014 20:35:19 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:35:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 20:35:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:35:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:35:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:35:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:35:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:35:34 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:35:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:35:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:35:34 - XML: Processed 654952 elements - found 752 jobs
Thu 16 Jan 2014 20:35:34 - job 7346779 appears to have finished
Thu 16 Jan 2014 20:35:34 - job 7346507 appears to have finished
Thu 16 Jan 2014 20:35:34 - job_xml_thread(): Found 3 updated jobs.
Thu 16 Jan 2014 20:35:34 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 20:35:34 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Thu 16 Jan 2014 20:35:34 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:35:34 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:35:35 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:35:35 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:35:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:35:35 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:35:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:35:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:35:36 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:35:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:35:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:35:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:35:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:35:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:35:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:35:38 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:35:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43338600
Thu 16 Jan 2014 20:35:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:35:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43338600
Thu 16 Jan 2014 20:35:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:35:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:35:49 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:35:50 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:35:50 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:35:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:35:50 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:35:50 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:35:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 20:35:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:35:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:35:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:35:50 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:35:50 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:35:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:35:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:35:51 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:35:51 - job_xml_thread(): Done retrieving: data size 43279978
Thu 16 Jan 2014 20:35:51 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:35:51 - XML: Start document: iteration 20
Thu 16 Jan 2014 20:35:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43279978
Thu 16 Jan 2014 20:35:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:35:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:35:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:35:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:35:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:35:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:35:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:35:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43279978
Thu 16 Jan 2014 20:35:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:36:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:36:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:36:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:36:07 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:36:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:36:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:36:08 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:36:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:36:08 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:36:09 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:36:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:36:09 - XML: Processed 647602 elements - found 752 jobs
Thu 16 Jan 2014 20:36:09 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:36:09 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:36:09 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:36:09 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:36:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:36:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:36:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:36:13 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:36:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:36:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:36:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:36:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:36:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:36:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:36:15 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:36:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43295900
Thu 16 Jan 2014 20:36:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:36:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43295900
Thu 16 Jan 2014 20:36:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:36:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:36:19 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:36:21 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:36:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 20:36:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:36:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 20:36:21 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:36:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9228 values 145496 bits 18187 bytes 
Thu 16 Jan 2014 20:36:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:36:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:36:24 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:36:24 - job_xml_thread(): Done retrieving: data size 43295900
Thu 16 Jan 2014 20:36:24 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:36:24 - Housekeeping: checking database for timed out jobs..
Thu 16 Jan 2014 20:36:24 - Housekeeping: Found 0 timed out jobs in database: closing entries
Thu 16 Jan 2014 20:36:24 - Housekeeping: done.
Thu 16 Jan 2014 20:36:24 - XML: Start document: iteration 0
Thu 16 Jan 2014 20:36:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:36:26 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:36:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:36:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:36:28 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:36:28 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:36:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:36:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:36:28 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:36:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:36:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:36:36 - XML: Processed 648188 elements - found 752 jobs
Thu 16 Jan 2014 20:36:36 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:36:37 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:36:37 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:36:37 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:36:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:36:38 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:36:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:36:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:36:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:36:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:36:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:36:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:36:40 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:36:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43430489
Thu 16 Jan 2014 20:36:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:36:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43430489
Thu 16 Jan 2014 20:36:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:36:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:36:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:36:52 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:36:52 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:36:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:36:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:36:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:36:54 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:36:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:36:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:36:55 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:36:55 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:36:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:36:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:36:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:36:56 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:36:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:36:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:36:56 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:36:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 20:36:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:36:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:36:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:36:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:36:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:36:58 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:36:58 - job_xml_thread(): Done retrieving: data size 43872331
Thu 16 Jan 2014 20:36:58 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:36:58 - XML: Start document: iteration 1
Thu 16 Jan 2014 20:36:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43872331
Thu 16 Jan 2014 20:36:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:36:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43872331
Thu 16 Jan 2014 20:37:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:37:02 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Thu 16 Jan 2014 20:37:02 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:37:03 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:37:03 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 20:37:03 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:37:03 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 20:37:03 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 20:37:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:37:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:37:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:37:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:37:14 - size of cluster 'LISA Cluster': 624 hosts 79464 metrics 810361 values 12804226 bits 1600528 bytes 
Thu 16 Jan 2014 20:37:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:37:17 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:37:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:37:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:37:18 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:37:18 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:37:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:37:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:37:19 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:37:20 - XML: Processed 655370 elements - found 754 jobs
Thu 16 Jan 2014 20:37:20 - job 7346516 appears to have finished
Thu 16 Jan 2014 20:37:20 - job_xml_thread(): Found 4 updated jobs.
Thu 16 Jan 2014 20:37:20 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 20:37:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:37:21 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:37:21 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Thu 16 Jan 2014 20:37:21 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:37:21 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:37:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:37:22 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:37:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 20:37:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 20:37:22 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:37:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5854 values 92310 bits 11538 bytes 
Thu 16 Jan 2014 20:37:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:37:24 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:37:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:37:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:37:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:37:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:37:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:37:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:37:28 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:37:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43899699
Thu 16 Jan 2014 20:37:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:37:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43899699
Thu 16 Jan 2014 20:37:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:37:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:37:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:37:36 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:37:36 - job_xml_thread(): Done retrieving: data size 43899699
Thu 16 Jan 2014 20:37:36 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:37:36 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:37:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 20:37:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:37:36 - XML: Start document: iteration 2
Thu 16 Jan 2014 20:37:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:37:39 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:37:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:37:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:37:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:37:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:37:41 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:37:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:37:41 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:37:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:37:41 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:37:50 - XML: Processed 655703 elements - found 754 jobs
Thu 16 Jan 2014 20:37:50 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:37:50 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:37:50 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:37:50 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:37:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:37:52 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:37:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:37:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:37:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:37:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:37:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:37:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:37:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:37:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:37:56 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:37:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43888122
Thu 16 Jan 2014 20:37:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:37:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43888122
Thu 16 Jan 2014 20:37:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:38:03 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:38:03 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 20:38:05 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:38:05 - job_xml_thread(): Done retrieving: data size 43888122
Thu 16 Jan 2014 20:38:05 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:38:05 - XML: Start document: iteration 3
Thu 16 Jan 2014 20:38:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:38:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:38:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:38:12 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:38:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:38:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:38:13 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:38:13 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:38:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:38:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:38:13 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:38:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:38:20 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:38:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:38:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:38:20 - XML: Processed 655706 elements - found 754 jobs
Thu 16 Jan 2014 20:38:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:38:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:38:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:38:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:38:20 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:38:20 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:38:20 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:38:20 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:38:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:38:22 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:38:22 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:38:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:38:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 20:38:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 20:38:22 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:38:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6162 values 97152 bits 12144 bytes 
Thu 16 Jan 2014 20:38:24 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:38:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43905523
Thu 16 Jan 2014 20:38:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:38:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43905523
Thu 16 Jan 2014 20:38:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:38:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:38:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:38:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:38:34 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:38:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:38:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:38:35 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:38:35 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:38:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:38:35 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:38:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:38:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:38:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:38:36 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:38:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:38:41 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:38:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:38:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:38:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:38:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:38:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:38:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:38:43 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:38:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 20:38:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:38:45 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:38:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43893054
Thu 16 Jan 2014 20:38:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:38:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43893054
Thu 16 Jan 2014 20:38:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:38:45 - job_xml_thread(): Done retrieving: data size 43893054
Thu 16 Jan 2014 20:38:45 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:38:45 - XML: Start document: iteration 4
Thu 16 Jan 2014 20:38:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:38:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:38:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:38:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:39:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:39:00 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:39:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:39:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:39:00 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:39:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:39:00 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:39:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:39:00 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:39:04 - XML: Processed 655706 elements - found 754 jobs
Thu 16 Jan 2014 20:39:04 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:39:04 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:39:04 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:39:04 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:39:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:39:08 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:39:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:39:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:39:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:39:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:39:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:39:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:39:11 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:39:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43883237
Thu 16 Jan 2014 20:39:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:39:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43883237
Thu 16 Jan 2014 20:39:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:39:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:39:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:39:19 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:39:19 - job_xml_thread(): Done retrieving: data size 43883237
Thu 16 Jan 2014 20:39:19 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:39:19 - XML: Start document: iteration 5
Thu 16 Jan 2014 20:39:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:39:23 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:39:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:39:24 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:39:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 20:39:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 20:39:24 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:39:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7634 values 120359 bits 15044 bytes 
Thu 16 Jan 2014 20:39:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:39:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:39:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:39:27 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:39:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:39:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:39:28 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:39:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:39:28 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:39:28 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:39:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:39:34 - XML: Processed 655696 elements - found 749 jobs
Thu 16 Jan 2014 20:39:34 - job 7346798 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 20:39:34 - job 7346797 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 20:39:34 - job 7346796 field 'start_timestamp' changed since saved from: 1389900985 to: 1389900927
Thu 16 Jan 2014 20:39:34 - job 7346793 appears to have finished
Thu 16 Jan 2014 20:39:34 - job 7346521 appears to have finished
Thu 16 Jan 2014 20:39:34 - job 7346753 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 20:39:34 - job 7346546 appears to have finished
Thu 16 Jan 2014 20:39:34 - job 7346784 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 20:39:34 - job 7346185 appears to have finished
Thu 16 Jan 2014 20:39:34 - job 7345087 appears to have finished
Thu 16 Jan 2014 20:39:34 - job 7346768 appears to have finished
Thu 16 Jan 2014 20:39:34 - job_xml_thread(): Found 12 updated jobs.
Thu 16 Jan 2014 20:39:34 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 20:39:36 - job_xml_thread(): Done storing. succesfully stored: 12 jobs
Thu 16 Jan 2014 20:39:36 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:39:36 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:39:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:39:37 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:39:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:39:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:39:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:39:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:39:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:39:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:39:40 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:39:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 20:39:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:39:41 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:39:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43876318
Thu 16 Jan 2014 20:39:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:39:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43876318
Thu 16 Jan 2014 20:39:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:39:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:39:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:39:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:39:51 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:39:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:39:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:39:51 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:39:51 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:39:52 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:39:52 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:39:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:39:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:39:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:39:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:39:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:39:57 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:39:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:39:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:39:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:39:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:39:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:39:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:40:00 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:40:00 - job_xml_thread(): Done retrieving: data size 43888737
Thu 16 Jan 2014 20:40:00 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:40:00 - XML: Start document: iteration 6
Thu 16 Jan 2014 20:40:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43888737
Thu 16 Jan 2014 20:40:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:40:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43888737
Thu 16 Jan 2014 20:40:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:40:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:40:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:40:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:40:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:40:20 - XML: Processed 655696 elements - found 749 jobs
Thu 16 Jan 2014 20:40:20 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:40:20 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:40:20 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:40:20 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:40:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:40:22 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:40:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:40:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:40:23 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:40:23 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:40:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:40:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:40:23 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:40:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:40:24 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:40:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:40:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 20:40:24 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:40:24 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:40:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 20:40:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99042 bits 12380 bytes 
Thu 16 Jan 2014 20:40:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:40:25 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:40:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:40:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:40:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:40:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:40:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:40:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:40:29 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:40:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43892745
Thu 16 Jan 2014 20:40:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:40:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43892745
Thu 16 Jan 2014 20:40:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:40:36 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:40:36 - job_xml_thread(): Done retrieving: data size 43892745
Thu 16 Jan 2014 20:40:36 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:40:36 - XML: Start document: iteration 7
Thu 16 Jan 2014 20:40:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:40:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:40:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:40:38 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:40:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:40:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:40:39 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:40:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:40:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43892745
Thu 16 Jan 2014 20:40:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:40:39 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:40:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:40:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:40:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:40:50 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:40:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 20:40:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:40:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:40:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:40:57 - XML: Processed 655695 elements - found 749 jobs
Thu 16 Jan 2014 20:40:57 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:40:57 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:40:57 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:40:57 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:41:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:41:00 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:41:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:41:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:41:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:41:01 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:41:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:41:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:41:01 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:41:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:41:01 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:41:01 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:41:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:41:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:41:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:41:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:41:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:41:04 - Leaving storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 20:41:04 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Thu 16 Jan 2014 20:41:04 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:41:04 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:41:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43930439
Thu 16 Jan 2014 20:41:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:41:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43930439
Thu 16 Jan 2014 20:41:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:41:12 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:41:12 - job_xml_thread(): Done retrieving: data size 43930439
Thu 16 Jan 2014 20:41:13 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:41:13 - XML: Start document: iteration 8
Thu 16 Jan 2014 20:41:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:41:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:41:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:41:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:41:22 - XML: Processed 655700 elements - found 751 jobs
Thu 16 Jan 2014 20:41:22 - job 7335183 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 20:41:22 - job 7346775 appears to have finished
Thu 16 Jan 2014 20:41:22 - job_xml_thread(): Found 5 updated jobs.
Thu 16 Jan 2014 20:41:22 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 20:41:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:41:25 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:41:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:41:25 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:41:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:41:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:41:26 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:41:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:41:26 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:41:26 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:41:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:41:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:41:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 20:41:26 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:41:26 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:41:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 20:41:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6172 values 97283 bits 12160 bytes 
Thu 16 Jan 2014 20:41:26 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Thu 16 Jan 2014 20:41:26 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:41:26 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:41:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:41:28 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:41:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:41:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:41:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:41:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:41:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:41:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:41:31 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:41:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43466596
Thu 16 Jan 2014 20:41:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:41:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43466596
Thu 16 Jan 2014 20:41:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:41:41 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:41:41 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:41:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:41:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:41:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:41:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:41:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:41:45 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:41:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:41:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:41:46 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:41:46 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:41:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:41:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:41:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:41:46 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:41:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:41:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:41:46 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:41:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 20:41:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:41:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:41:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:41:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:41:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:41:48 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:41:48 - job_xml_thread(): Done retrieving: data size 43304509
Thu 16 Jan 2014 20:41:48 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:41:48 - XML: Start document: iteration 9
Thu 16 Jan 2014 20:41:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43304509
Thu 16 Jan 2014 20:41:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43304509
Thu 16 Jan 2014 20:41:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:41:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:42:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:42:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:42:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:42:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:42:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:42:02 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:42:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:42:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:42:03 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:42:03 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:42:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:42:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:42:03 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:42:08 - XML: Processed 648158 elements - found 751 jobs
Thu 16 Jan 2014 20:42:08 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:42:08 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:42:08 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:42:08 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:42:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:42:10 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:42:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:42:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:42:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:42:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:42:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:42:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:42:12 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:42:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43288965
Thu 16 Jan 2014 20:42:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:42:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43288965
Thu 16 Jan 2014 20:42:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:42:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:42:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:42:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:42:21 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:42:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:42:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:42:22 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:42:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:42:22 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:42:22 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:42:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:42:23 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:42:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:42:25 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:42:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:42:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:42:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:42:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:42:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:42:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:42:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:42:26 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:42:27 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:42:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43305385
Thu 16 Jan 2014 20:42:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:42:27 - job_xml_thread(): Done retrieving: data size 43305385
Thu 16 Jan 2014 20:42:27 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:42:27 - XML: Start document: iteration 10
Thu 16 Jan 2014 20:42:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43305385
Thu 16 Jan 2014 20:42:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:42:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 20:42:27 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:42:27 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:42:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 20:42:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:42:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9062 values 142954 bits 17869 bytes 
Thu 16 Jan 2014 20:42:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:42:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:42:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:42:38 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:42:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:42:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:42:39 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:42:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:42:39 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:42:39 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:42:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:42:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:42:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:42:50 - XML: Processed 648256 elements - found 751 jobs
Thu 16 Jan 2014 20:42:50 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:42:50 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:42:50 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:42:50 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:42:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:42:51 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:42:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:42:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:42:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:42:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:42:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:42:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:42:53 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:42:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853554
Thu 16 Jan 2014 20:42:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:42:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853554
Thu 16 Jan 2014 20:42:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:42:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:42:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:43:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:43:02 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:43:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:43:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:43:02 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:43:02 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:43:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:43:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:43:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853554
Thu 16 Jan 2014 20:43:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:43:05 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:43:06 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:43:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:43:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:43:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:43:12 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:43:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:43:15 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:43:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:43:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:43:15 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:43:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 20:43:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:43:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:43:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:43:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:43:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:43:16 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:43:16 - job_xml_thread(): Done retrieving: data size 43891300
Thu 16 Jan 2014 20:43:16 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:43:16 - XML: Start document: iteration 11
Thu 16 Jan 2014 20:43:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43891300
Thu 16 Jan 2014 20:43:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:43:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:43:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:43:20 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:43:20 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:43:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:43:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:43:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43891300
Thu 16 Jan 2014 20:43:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:43:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:43:27 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:43:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:43:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 20:43:28 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:43:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6095 values 96116 bits 12014 bytes 
Thu 16 Jan 2014 20:43:28 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:43:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 20:43:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:43:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:43:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:43:35 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:43:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:43:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:43:36 - XML: Processed 655696 elements - found 749 jobs
Thu 16 Jan 2014 20:43:36 - job 7346499 appears to have finished
Thu 16 Jan 2014 20:43:36 - job 7346803 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 20:43:36 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:43:36 - job 7345925 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 20:43:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:43:36 - job 7344745 appears to have finished
Thu 16 Jan 2014 20:43:36 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:43:36 - job 7346767 appears to have finished
Thu 16 Jan 2014 20:43:36 - job 7346545 appears to have finished
Thu 16 Jan 2014 20:43:36 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:43:36 - job_xml_thread(): Found 8 updated jobs.
Thu 16 Jan 2014 20:43:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:43:36 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 20:43:38 - job_xml_thread(): Done storing. succesfully stored: 8 jobs
Thu 16 Jan 2014 20:43:38 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:43:38 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:43:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:43:39 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:43:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:43:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:43:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:43:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:43:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:43:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:43:41 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:43:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43892511
Thu 16 Jan 2014 20:43:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:43:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43892511
Thu 16 Jan 2014 20:43:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:43:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:43:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:43:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:43:51 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:43:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:43:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:43:53 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:43:53 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:43:53 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:43:53 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:43:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:43:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:43:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:43:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:43:55 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:43:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 20:43:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:43:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:43:56 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:43:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:43:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:43:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:43:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:43:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:43:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:43:58 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:43:58 - job_xml_thread(): Done retrieving: data size 43898252
Thu 16 Jan 2014 20:43:58 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:43:58 - XML: Start document: iteration 12
Thu 16 Jan 2014 20:43:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43898252
Thu 16 Jan 2014 20:43:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:43:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43898252
Thu 16 Jan 2014 20:43:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:44:03 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Thu 16 Jan 2014 20:44:03 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:44:05 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:44:05 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:44:05 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 20:44:05 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 20:44:05 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 20:44:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:44:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:44:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:44:09 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:44:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:44:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:44:10 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:44:10 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:44:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:44:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:44:10 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:44:11 - size of cluster 'LISA Cluster': 624 hosts 79469 metrics 779695 values 12303178 bits 1537897 bytes 
Thu 16 Jan 2014 20:44:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:44:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:44:19 - XML: Processed 655696 elements - found 749 jobs
Thu 16 Jan 2014 20:44:19 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:44:19 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:44:19 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:44:19 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:44:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:44:21 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:44:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:44:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:44:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:44:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:44:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:44:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:44:24 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:44:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873137
Thu 16 Jan 2014 20:44:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:44:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873137
Thu 16 Jan 2014 20:44:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:44:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:44:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:44:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:44:29 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:44:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:44:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 20:44:30 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:44:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 20:44:30 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:44:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9185 values 144847 bits 18105 bytes 
Thu 16 Jan 2014 20:44:34 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:44:34 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:44:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:44:34 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:44:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:44:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:44:35 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:44:35 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:44:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:44:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:44:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:44:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:44:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:44:40 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:44:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:44:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:44:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:44:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:44:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:44:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:44:44 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:44:44 - job_xml_thread(): Done retrieving: data size 43897816
Thu 16 Jan 2014 20:44:44 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:44:44 - XML: Start document: iteration 13
Thu 16 Jan 2014 20:44:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43897816
Thu 16 Jan 2014 20:44:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:44:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43897816
Thu 16 Jan 2014 20:44:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:44:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:44:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:44:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:44:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:45:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:45:03 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:45:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:45:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:45:04 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:45:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:45:04 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:45:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:45:04 - XML: Processed 655696 elements - found 749 jobs
Thu 16 Jan 2014 20:45:04 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:45:04 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:45:04 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:45:04 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:45:04 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:45:05 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:45:05 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 20:45:06 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:45:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 20:45:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:45:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:45:08 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:45:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:45:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:45:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:45:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:45:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:45:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:45:11 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:45:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43903944
Thu 16 Jan 2014 20:45:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:45:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43903944
Thu 16 Jan 2014 20:45:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:45:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:45:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:45:19 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:45:19 - job_xml_thread(): Done retrieving: data size 43903944
Thu 16 Jan 2014 20:45:19 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:45:19 - XML: Start document: iteration 14
Thu 16 Jan 2014 20:45:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:45:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:45:29 - XML: Processed 655696 elements - found 749 jobs
Thu 16 Jan 2014 20:45:29 - job 7346723 appears to have finished
Thu 16 Jan 2014 20:45:29 - job 7346805 field 'start_timestamp' changed since saved from: 1389901363 to: 1389901296
Thu 16 Jan 2014 20:45:29 - job 7346783 appears to have finished
Thu 16 Jan 2014 20:45:29 - job 7345925 field 'start_timestamp' changed since saved from: 1389901358 to: 1389901296
Thu 16 Jan 2014 20:45:29 - job_xml_thread(): Found 6 updated jobs.
Thu 16 Jan 2014 20:45:29 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 20:45:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:45:29 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:45:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:45:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:45:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:45:30 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:45:30 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:45:30 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:45:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:45:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:45:30 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:45:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:45:30 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:45:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 20:45:30 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:45:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5864 values 92523 bits 11565 bytes 
Thu 16 Jan 2014 20:45:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 20:45:31 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Thu 16 Jan 2014 20:45:31 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:45:31 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:45:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:45:34 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:45:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:45:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:45:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:45:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:45:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:45:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:45:37 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:45:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43902484
Thu 16 Jan 2014 20:45:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:45:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43902484
Thu 16 Jan 2014 20:45:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:45:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:45:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:45:46 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:45:46 - job_xml_thread(): Done retrieving: data size 43902484
Thu 16 Jan 2014 20:45:46 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:45:46 - XML: Start document: iteration 15
Thu 16 Jan 2014 20:45:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:45:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:45:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:45:53 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:45:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:45:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:45:53 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:45:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:45:53 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:45:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:45:53 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:45:57 - XML: Processed 655694 elements - found 749 jobs
Thu 16 Jan 2014 20:45:57 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:45:57 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:45:57 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:45:57 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:46:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:46:02 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:46:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:46:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:46:02 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:46:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 20:46:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:46:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:46:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:46:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:46:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:46:04 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:46:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43902723
Thu 16 Jan 2014 20:46:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:46:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43902723
Thu 16 Jan 2014 20:46:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:46:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:46:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:46:13 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:46:13 - job_xml_thread(): Done retrieving: data size 43902723
Thu 16 Jan 2014 20:46:13 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:46:13 - XML: Start document: iteration 16
Thu 16 Jan 2014 20:46:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:46:17 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:46:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:46:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:46:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:46:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:46:18 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:46:18 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:46:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:46:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:46:18 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:46:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:46:24 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:46:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:46:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:46:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:46:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:46:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:46:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:46:27 - XML: Processed 655696 elements - found 749 jobs
Thu 16 Jan 2014 20:46:27 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:46:27 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:46:27 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:46:27 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:46:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:46:30 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:46:30 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:46:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43889241
Thu 16 Jan 2014 20:46:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:46:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43889241
Thu 16 Jan 2014 20:46:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:46:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:46:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 20:46:31 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:46:32 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:46:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7062 values 111452 bits 13931 bytes 
Thu 16 Jan 2014 20:46:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 20:46:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:46:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:46:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:46:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:46:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:46:40 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:46:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:46:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:46:41 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:46:41 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:46:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:46:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:46:41 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:46:42 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:46:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:46:46 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:46:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:46:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:46:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:46:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:46:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:46:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:46:50 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:46:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43917497
Thu 16 Jan 2014 20:46:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:46:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43917497
Thu 16 Jan 2014 20:46:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:46:50 - job_xml_thread(): Done retrieving: data size 43917497
Thu 16 Jan 2014 20:46:50 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:46:50 - XML: Start document: iteration 17
Thu 16 Jan 2014 20:46:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:46:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:46:57 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:46:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 20:46:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:47:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:47:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:47:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:47:12 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:47:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:47:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:47:12 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:47:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:47:12 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:47:12 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:47:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:47:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:47:14 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:47:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:47:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:47:14 - XML: Processed 655696 elements - found 749 jobs
Thu 16 Jan 2014 20:47:14 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:47:14 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:47:14 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:47:14 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:47:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:47:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:47:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:47:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:47:17 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:47:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858126
Thu 16 Jan 2014 20:47:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:47:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43858126
Thu 16 Jan 2014 20:47:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:47:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:47:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:47:29 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:47:29 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:47:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:47:29 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:47:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:47:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:47:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:47:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:47:30 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:47:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:47:30 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:47:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:47:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:47:32 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:47:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:47:32 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:47:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 20:47:32 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:47:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 20:47:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6251 values 98918 bits 12364 bytes 
Thu 16 Jan 2014 20:47:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:47:33 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:47:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:47:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:47:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:47:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:47:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:47:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:47:37 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:47:37 - job_xml_thread(): Done retrieving: data size 43376450
Thu 16 Jan 2014 20:47:37 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:47:37 - XML: Start document: iteration 18
Thu 16 Jan 2014 20:47:37 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:47:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 20:47:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:47:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43376450
Thu 16 Jan 2014 20:47:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:47:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43376450
Thu 16 Jan 2014 20:47:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:47:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:47:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:47:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:47:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:47:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:47:55 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:47:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:47:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:47:56 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:47:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:47:56 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:47:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:47:56 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:48:01 - XML: Processed 649148 elements - found 749 jobs
Thu 16 Jan 2014 20:48:01 - job 7346807 field 'start_timestamp' changed since saved from: 1389901502 to: 1389901425
Thu 16 Jan 2014 20:48:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:48:01 - job 7346770 appears to have finished
Thu 16 Jan 2014 20:48:01 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:48:01 - job 7346528 appears to have finished
Thu 16 Jan 2014 20:48:01 - job_xml_thread(): Found 5 updated jobs.
Thu 16 Jan 2014 20:48:01 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 20:48:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:48:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:48:01 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Thu 16 Jan 2014 20:48:01 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:48:01 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:48:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:48:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:48:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:48:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:48:04 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:48:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43247886
Thu 16 Jan 2014 20:48:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:48:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43247886
Thu 16 Jan 2014 20:48:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:48:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:48:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:48:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:48:14 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:48:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:48:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:48:15 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:48:15 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:48:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:48:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:48:15 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:48:16 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:48:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:48:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:48:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:48:18 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:48:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:48:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:48:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:48:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:48:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:48:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:48:22 - Leaving storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 20:48:22 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Thu 16 Jan 2014 20:48:22 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:48:22 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:48:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43298832
Thu 16 Jan 2014 20:48:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:48:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43298832
Thu 16 Jan 2014 20:48:22 - job_xml_thread(): Done retrieving: data size 43298832
Thu 16 Jan 2014 20:48:22 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:48:22 - XML: Start document: iteration 19
Thu 16 Jan 2014 20:48:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:48:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:48:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:48:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:48:33 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:48:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:48:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 20:48:33 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:48:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 20:48:34 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:48:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:48:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:48:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148944 bits 18618 bytes 
Thu 16 Jan 2014 20:48:40 - XML: Processed 648144 elements - found 749 jobs
Thu 16 Jan 2014 20:48:40 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:48:40 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:48:40 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:48:40 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:48:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:48:41 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:48:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:48:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:48:41 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:48:41 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:48:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:48:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:48:41 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:48:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:48:45 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:48:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:48:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:48:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:48:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:48:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:48:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:48:48 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:48:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43807060
Thu 16 Jan 2014 20:48:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:48:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43807060
Thu 16 Jan 2014 20:48:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:48:55 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:48:55 - job_xml_thread(): Done retrieving: data size 43807060
Thu 16 Jan 2014 20:48:55 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:48:55 - XML: Start document: iteration 20
Thu 16 Jan 2014 20:48:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:48:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:49:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:49:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:49:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:49:05 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:49:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:49:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:49:06 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:49:06 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:49:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:49:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:49:06 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:49:08 - XML: Processed 654376 elements - found 749 jobs
Thu 16 Jan 2014 20:49:08 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:49:08 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:49:08 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:49:08 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:49:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:49:11 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:49:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:49:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:49:12 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:49:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 20:49:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:49:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:49:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:49:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:49:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:49:13 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:49:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43893809
Thu 16 Jan 2014 20:49:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:49:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43893809
Thu 16 Jan 2014 20:49:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:49:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:49:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:49:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:49:23 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:49:23 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:49:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:49:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:49:23 - job_xml_thread(): Done retrieving: data size 43893809
Thu 16 Jan 2014 20:49:23 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:49:23 - Housekeeping: checking database for timed out jobs..
Thu 16 Jan 2014 20:49:24 - Housekeeping: Found 0 timed out jobs in database: closing entries
Thu 16 Jan 2014 20:49:24 - Housekeeping: done.
Thu 16 Jan 2014 20:49:24 - XML: Start document: iteration 0
Thu 16 Jan 2014 20:49:24 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:49:24 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:49:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:49:25 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:49:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:49:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:49:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:49:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:49:33 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:49:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:49:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:49:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:49:33 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:49:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:49:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 20:49:34 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:49:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6020 values 95034 bits 11879 bytes 
Thu 16 Jan 2014 20:49:34 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:49:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 20:49:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:49:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:49:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:49:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:49:36 - XML: Processed 655692 elements - found 747 jobs
Thu 16 Jan 2014 20:49:36 - job 7346787 appears to have finished
Thu 16 Jan 2014 20:49:36 - job 7346809 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 20:49:36 - job 7346788 appears to have finished
Thu 16 Jan 2014 20:49:36 - job_xml_thread(): Found 3 updated jobs.
Thu 16 Jan 2014 20:49:36 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 20:49:36 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Thu 16 Jan 2014 20:49:36 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:49:36 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:49:38 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:49:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867670
Thu 16 Jan 2014 20:49:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:49:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43867670
Thu 16 Jan 2014 20:49:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:49:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:49:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:49:51 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:49:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:49:51 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:49:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:49:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:49:52 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:49:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:49:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:49:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:49:53 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:49:53 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:49:53 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:49:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:49:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:49:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:49:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:49:53 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:49:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 20:49:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:49:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:49:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:49:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:49:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:49:55 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:49:55 - job_xml_thread(): Done retrieving: data size 43910947
Thu 16 Jan 2014 20:49:55 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:49:55 - XML: Start document: iteration 1
Thu 16 Jan 2014 20:49:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43910947
Thu 16 Jan 2014 20:49:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43910947
Thu 16 Jan 2014 20:49:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:49:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:50:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:50:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:50:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:50:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:50:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:50:14 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:50:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:50:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:50:16 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:50:16 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:50:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:50:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:50:16 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:50:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:50:18 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:50:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:50:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:50:19 - XML: Processed 655692 elements - found 747 jobs
Thu 16 Jan 2014 20:50:19 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:50:19 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:50:19 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:50:19 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:50:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:50:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:50:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:50:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:50:22 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:50:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43899846
Thu 16 Jan 2014 20:50:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:50:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43899846
Thu 16 Jan 2014 20:50:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:50:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:50:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:50:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:50:33 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:50:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:50:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:50:34 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:50:34 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:50:34 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:50:34 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:50:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:50:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:50:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:50:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:50:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:50:34 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:50:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:50:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 20:50:35 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:50:35 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:50:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8329 values 131326 bits 16415 bytes 
Thu 16 Jan 2014 20:50:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 20:50:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:50:37 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:50:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:50:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:50:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:50:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:50:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:50:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:50:39 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:50:39 - job_xml_thread(): Done retrieving: data size 43909511
Thu 16 Jan 2014 20:50:39 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:50:39 - XML: Start document: iteration 2
Thu 16 Jan 2014 20:50:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43909511
Thu 16 Jan 2014 20:50:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:50:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43909511
Thu 16 Jan 2014 20:50:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:50:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:50:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:50:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:50:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:50:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:50:55 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:50:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:50:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:50:55 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:50:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:50:55 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:50:55 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:50:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:50:59 - XML: Processed 655692 elements - found 747 jobs
Thu 16 Jan 2014 20:50:59 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:50:59 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:50:59 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:50:59 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:51:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:51:03 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:51:03 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:51:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 20:51:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:51:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:51:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:51:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:51:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:51:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:51:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:51:04 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:51:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43884293
Thu 16 Jan 2014 20:51:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:51:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43884293
Thu 16 Jan 2014 20:51:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:51:05 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Thu 16 Jan 2014 20:51:05 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:51:08 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:51:08 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 20:51:08 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 20:51:08 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:51:08 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 20:51:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:51:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:51:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:51:14 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:51:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:51:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:51:14 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:51:14 - job_xml_thread(): Done retrieving: data size 43884293
Thu 16 Jan 2014 20:51:15 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:51:15 - XML: Start document: iteration 3
Thu 16 Jan 2014 20:51:15 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:51:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:51:15 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:51:15 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:51:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:51:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:51:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:51:19 - size of cluster 'LISA Cluster': 624 hosts 79477 metrics 773704 values 12226256 bits 1528282 bytes 
Thu 16 Jan 2014 20:51:25 - XML: Processed 655696 elements - found 749 jobs
Thu 16 Jan 2014 20:51:25 - job_xml_thread(): Found 2 updated jobs.
Thu 16 Jan 2014 20:51:25 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 20:51:25 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Thu 16 Jan 2014 20:51:25 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:51:25 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:51:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:51:28 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:51:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:51:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:51:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:51:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:51:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:51:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:51:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:51:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:51:31 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:51:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43883060
Thu 16 Jan 2014 20:51:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:51:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43883060
Thu 16 Jan 2014 20:51:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:51:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:51:35 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:51:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:51:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 20:51:36 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:51:36 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:51:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 20:51:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8889 values 140173 bits 17521 bytes 
Thu 16 Jan 2014 20:51:40 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:51:40 - job_xml_thread(): Done retrieving: data size 43883060
Thu 16 Jan 2014 20:51:40 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:51:40 - XML: Start document: iteration 4
Thu 16 Jan 2014 20:51:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:51:41 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:51:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:51:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:51:41 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:51:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:51:41 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:51:41 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:51:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:51:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:51:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:51:53 - XML: Processed 655696 elements - found 749 jobs
Thu 16 Jan 2014 20:51:53 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:51:53 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:51:53 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:51:53 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:51:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:51:56 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:51:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:51:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:51:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:51:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:51:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:51:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:51:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:51:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:51:59 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:51:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43874730
Thu 16 Jan 2014 20:51:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:52:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43874730
Thu 16 Jan 2014 20:52:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:52:08 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:52:08 - job_xml_thread(): Done retrieving: data size 43874730
Thu 16 Jan 2014 20:52:08 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:52:08 - XML: Start document: iteration 5
Thu 16 Jan 2014 20:52:09 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:52:09 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 20:52:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:52:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:52:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:52:18 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:52:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:52:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:52:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:52:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:52:19 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:52:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:52:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:52:19 - XML: Processed 655696 elements - found 749 jobs
Thu 16 Jan 2014 20:52:19 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:52:19 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:52:20 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:52:20 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:52:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:52:20 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:52:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:52:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:52:21 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:52:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 20:52:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:52:21 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:52:21 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:52:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:52:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:52:24 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:52:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43909868
Thu 16 Jan 2014 20:52:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:52:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43909868
Thu 16 Jan 2014 20:52:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:52:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:52:32 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:52:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:52:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:52:35 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:52:35 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:52:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:52:36 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:52:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:52:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:52:37 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:52:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:52:37 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:52:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:52:37 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:52:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:52:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 20:52:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 20:52:38 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:52:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5993 values 94512 bits 11814 bytes 
Thu 16 Jan 2014 20:52:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:52:38 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:52:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:52:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:52:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:52:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:52:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:52:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:52:42 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:52:42 - job_xml_thread(): Done retrieving: data size 43912720
Thu 16 Jan 2014 20:52:42 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:52:42 - XML: Start document: iteration 6
Thu 16 Jan 2014 20:52:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43912720
Thu 16 Jan 2014 20:52:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43912720
Thu 16 Jan 2014 20:52:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:52:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:52:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:52:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:52:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:52:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:52:54 - XML: Processed 655694 elements - found 749 jobs
Thu 16 Jan 2014 20:52:54 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:52:55 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:52:55 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:52:55 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:53:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:53:03 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:53:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:53:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:53:04 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:53:04 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:53:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:53:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:53:04 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:53:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:53:06 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:53:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:53:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:53:06 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:53:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 20:53:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:53:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:53:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:53:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:53:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:53:09 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:53:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43836537
Thu 16 Jan 2014 20:53:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:53:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43836537
Thu 16 Jan 2014 20:53:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:53:10 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:53:10 - job_xml_thread(): Done retrieving: data size 43836537
Thu 16 Jan 2014 20:53:10 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:53:10 - XML: Start document: iteration 7
Thu 16 Jan 2014 20:53:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:53:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:53:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:53:21 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:53:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:53:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:53:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:53:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:53:23 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:53:23 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:53:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:53:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:53:23 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:53:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:53:32 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:53:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:53:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:53:33 - XML: Processed 654948 elements - found 749 jobs
Thu 16 Jan 2014 20:53:33 - job 7335184 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 20:53:33 - job 7346300 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 20:53:33 - job 7346791 appears to have finished
Thu 16 Jan 2014 20:53:33 - job_xml_thread(): Found 4 updated jobs.
Thu 16 Jan 2014 20:53:33 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 20:53:33 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Thu 16 Jan 2014 20:53:33 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:53:33 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:53:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:53:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:53:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:53:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:53:35 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:53:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43372224
Thu 16 Jan 2014 20:53:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:53:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43372224
Thu 16 Jan 2014 20:53:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:53:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:53:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:53:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:53:38 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:53:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:53:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 20:53:41 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:53:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8822 values 139093 bits 17386 bytes 
Thu 16 Jan 2014 20:53:41 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:53:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 20:53:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:53:44 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:53:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:53:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:53:44 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:53:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:53:44 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:53:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43372224
Thu 16 Jan 2014 20:53:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:53:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:53:48 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:53:48 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:53:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:53:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:53:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:53:57 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:53:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:53:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:53:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:53:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:53:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:53:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:53:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:53:58 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:53:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:53:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:54:00 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:54:00 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:54:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:54:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:54:02 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:54:02 - job_xml_thread(): Done retrieving: data size 43242573
Thu 16 Jan 2014 20:54:02 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:54:02 - XML: Start document: iteration 8
Thu 16 Jan 2014 20:54:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43242573
Thu 16 Jan 2014 20:54:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:54:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43242573
Thu 16 Jan 2014 20:54:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:54:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:54:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:54:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:54:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:54:21 - XML: Processed 647752 elements - found 749 jobs
Thu 16 Jan 2014 20:54:21 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:54:21 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:54:21 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:54:21 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:54:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:54:26 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:54:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:54:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:54:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:54:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:54:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:54:27 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:54:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:54:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:54:27 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:54:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:54:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:54:27 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:54:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 20:54:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:54:27 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:54:27 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:54:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:54:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:54:30 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:54:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43327069
Thu 16 Jan 2014 20:54:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:54:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43327069
Thu 16 Jan 2014 20:54:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:54:36 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:54:37 - job_xml_thread(): Done retrieving: data size 43327069
Thu 16 Jan 2014 20:54:37 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:54:37 - XML: Start document: iteration 9
Thu 16 Jan 2014 20:54:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:54:39 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:54:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:54:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:54:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:54:42 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:54:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:54:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:54:43 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:54:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:54:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 20:54:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 20:54:43 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:54:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5902 values 93024 bits 11628 bytes 
Thu 16 Jan 2014 20:54:44 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:54:44 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:54:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:54:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:54:44 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:54:52 - XML: Processed 648244 elements - found 749 jobs
Thu 16 Jan 2014 20:54:52 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:54:52 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:54:52 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:54:52 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:54:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:54:54 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:54:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:54:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:54:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:54:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:54:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:54:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:54:58 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:54:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43861048
Thu 16 Jan 2014 20:54:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:54:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43861048
Thu 16 Jan 2014 20:54:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:54:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:54:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:55:07 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:55:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:55:08 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:55:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:55:08 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:55:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:55:09 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:55:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:55:09 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:55:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:55:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:55:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:55:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:55:13 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:55:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:55:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:55:13 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:55:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 20:55:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:55:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:55:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:55:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:55:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:55:17 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:55:17 - job_xml_thread(): Done retrieving: data size 43898978
Thu 16 Jan 2014 20:55:17 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:55:17 - XML: Start document: iteration 10
Thu 16 Jan 2014 20:55:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43898978
Thu 16 Jan 2014 20:55:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:55:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43898978
Thu 16 Jan 2014 20:55:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:55:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:55:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:55:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:55:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:55:30 - XML: Processed 655694 elements - found 748 jobs
Thu 16 Jan 2014 20:55:30 - job 7346734 appears to have finished
Thu 16 Jan 2014 20:55:30 - job 7346774 appears to have finished
Thu 16 Jan 2014 20:55:30 - job 7346002 appears to have finished
Thu 16 Jan 2014 20:55:30 - job_xml_thread(): Found 5 updated jobs.
Thu 16 Jan 2014 20:55:30 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 20:55:35 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Thu 16 Jan 2014 20:55:35 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:55:35 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:55:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:55:37 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:55:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:55:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:55:38 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:55:38 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:55:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:55:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:55:38 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:55:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:55:39 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:55:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:55:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:55:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:55:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:55:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:55:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:55:39 - Leaving storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 20:55:39 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Thu 16 Jan 2014 20:55:39 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:55:41 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:55:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43921667
Thu 16 Jan 2014 20:55:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:55:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43921667
Thu 16 Jan 2014 20:55:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:55:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:55:43 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:55:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:55:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 20:55:46 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:55:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 20:55:46 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:55:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8910 values 140486 bits 17560 bytes 
Thu 16 Jan 2014 20:55:50 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:55:50 - job_xml_thread(): Done retrieving: data size 43921667
Thu 16 Jan 2014 20:55:50 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:55:51 - XML: Start document: iteration 11
Thu 16 Jan 2014 20:55:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:55:52 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:55:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:55:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:55:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:55:54 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:55:54 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:55:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:55:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:55:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:55:56 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:56:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:56:01 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:56:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:56:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:56:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:56:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:56:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:56:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:56:03 - XML: Processed 655694 elements - found 748 jobs
Thu 16 Jan 2014 20:56:03 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:56:03 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:56:03 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:56:03 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:56:05 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:56:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43897142
Thu 16 Jan 2014 20:56:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:56:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43897142
Thu 16 Jan 2014 20:56:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:56:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:56:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:56:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:56:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:56:17 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:56:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:56:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:56:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:56:17 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:56:17 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:56:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:56:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:56:17 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:56:18 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:56:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:56:21 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:56:21 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:56:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 20:56:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:56:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:56:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:56:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:56:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:56:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:56:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:56:23 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:56:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43905080
Thu 16 Jan 2014 20:56:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:56:23 - job_xml_thread(): Done retrieving: data size 43905080
Thu 16 Jan 2014 20:56:23 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:56:23 - XML: Start document: iteration 12
Thu 16 Jan 2014 20:56:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43905080
Thu 16 Jan 2014 20:56:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:56:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:56:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:56:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:56:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:56:39 - XML: Processed 655694 elements - found 748 jobs
Thu 16 Jan 2014 20:56:39 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:56:39 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:56:39 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:56:39 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:56:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:56:43 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:56:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:56:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:56:45 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:56:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:56:45 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:56:45 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:56:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:56:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:56:45 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:56:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:56:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:56:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:56:46 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:56:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:56:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:56:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:56:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:56:47 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:56:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:56:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 20:56:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 20:56:47 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:56:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5858 values 92356 bits 11544 bytes 
Thu 16 Jan 2014 20:56:49 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:56:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43916353
Thu 16 Jan 2014 20:56:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:56:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43916353
Thu 16 Jan 2014 20:56:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:56:54 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:56:54 - job_xml_thread(): Done retrieving: data size 43916353
Thu 16 Jan 2014 20:56:54 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:56:54 - XML: Start document: iteration 13
Thu 16 Jan 2014 20:56:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:56:59 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:57:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:57:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:57:01 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:57:01 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:57:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:57:01 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:57:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:57:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:57:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:57:10 - XML: Processed 655694 elements - found 748 jobs
Thu 16 Jan 2014 20:57:10 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:57:10 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:57:10 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:57:10 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:57:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:57:12 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:57:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:57:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:57:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:57:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:57:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:57:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:57:13 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:57:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 20:57:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:57:14 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:57:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43894514
Thu 16 Jan 2014 20:57:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:57:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43894514
Thu 16 Jan 2014 20:57:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:57:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:57:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:57:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:57:25 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:57:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:57:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:57:26 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:57:26 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:57:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:57:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:57:27 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:57:27 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:57:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:57:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:57:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:57:29 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:57:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:57:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:57:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:57:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:57:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:57:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:57:31 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:57:31 - job_xml_thread(): Done retrieving: data size 43909267
Thu 16 Jan 2014 20:57:31 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:57:31 - XML: Start document: iteration 14
Thu 16 Jan 2014 20:57:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43909267
Thu 16 Jan 2014 20:57:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43909267
Thu 16 Jan 2014 20:57:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:57:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:57:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:57:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:57:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:57:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:57:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:57:47 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:57:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:57:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:57:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:57:47 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:57:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:57:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:57:48 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:57:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:57:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:57:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:57:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 20:57:48 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:57:48 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:57:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 20:57:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7862 values 124040 bits 15505 bytes 
Thu 16 Jan 2014 20:57:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:57:54 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:57:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:57:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:57:55 - XML: Processed 655691 elements - found 747 jobs
Thu 16 Jan 2014 20:57:55 - job 7346778 appears to have finished
Thu 16 Jan 2014 20:57:55 - job 7346815 field 'start_timestamp' changed since saved from: 1389902103 to: 1389902069
Thu 16 Jan 2014 20:57:55 - job 7346769 appears to have finished
Thu 16 Jan 2014 20:57:55 - job_xml_thread(): Found 4 updated jobs.
Thu 16 Jan 2014 20:57:55 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 20:57:55 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Thu 16 Jan 2014 20:57:55 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:57:55 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:57:55 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:57:55 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:57:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:57:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:57:58 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:57:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43904723
Thu 16 Jan 2014 20:57:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:57:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43904723
Thu 16 Jan 2014 20:57:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:58:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:58:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:58:09 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Thu 16 Jan 2014 20:58:09 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:58:09 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:58:09 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 20:58:09 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:58:09 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 20:58:09 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 20:58:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:58:10 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:58:10 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:58:10 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:58:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:58:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:58:12 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:58:12 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:58:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:58:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:58:12 - size of cluster 'LISA Cluster': 624 hosts 79480 metrics 832979 values 13144208 bits 1643026 bytes 
Thu 16 Jan 2014 20:58:13 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:58:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 20:58:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:58:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:58:14 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:58:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:58:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:58:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:58:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:58:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:58:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:58:18 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:58:18 - job_xml_thread(): Done retrieving: data size 43899328
Thu 16 Jan 2014 20:58:18 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:58:18 - XML: Start document: iteration 15
Thu 16 Jan 2014 20:58:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43899328
Thu 16 Jan 2014 20:58:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:58:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43899328
Thu 16 Jan 2014 20:58:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:58:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:58:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:58:28 - XML: Processed 655692 elements - found 747 jobs
Thu 16 Jan 2014 20:58:28 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:58:28 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:58:28 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:58:28 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:58:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:58:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:58:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:58:35 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:58:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:58:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:58:36 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:58:36 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:58:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:58:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:58:36 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:58:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:58:38 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:58:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:58:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:58:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:58:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:58:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:58:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:58:42 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:58:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43934242
Thu 16 Jan 2014 20:58:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:58:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43934242
Thu 16 Jan 2014 20:58:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:58:43 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:58:43 - job_xml_thread(): Done retrieving: data size 43934242
Thu 16 Jan 2014 20:58:43 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:58:43 - XML: Start document: iteration 16
Thu 16 Jan 2014 20:58:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:58:50 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:58:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:58:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:58:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:58:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 20:58:52 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:58:52 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:58:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 20:58:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:58:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:58:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9184 values 144830 bits 18103 bytes 
Thu 16 Jan 2014 20:58:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:58:56 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:58:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:58:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:58:57 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:58:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:58:58 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:58:58 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:58:58 - XML: Processed 655692 elements - found 747 jobs
Thu 16 Jan 2014 20:58:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:58:58 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:58:58 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:58:58 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:58:58 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:59:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:59:04 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:59:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:59:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:59:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:59:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:59:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:59:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:59:09 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:59:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43889492
Thu 16 Jan 2014 20:59:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:59:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43889492
Thu 16 Jan 2014 20:59:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:59:09 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:59:09 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 20:59:13 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:59:13 - job_xml_thread(): Done retrieving: data size 43889492
Thu 16 Jan 2014 20:59:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:59:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:59:13 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:59:13 - XML: Start document: iteration 17
Thu 16 Jan 2014 20:59:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:59:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:59:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:59:26 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:59:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:59:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:59:27 - XML: Processed 655690 elements - found 746 jobs
Thu 16 Jan 2014 20:59:27 - job 7346705 appears to have finished
Thu 16 Jan 2014 20:59:27 - job 7346785 appears to have finished
Thu 16 Jan 2014 20:59:27 - job_xml_thread(): Found 3 updated jobs.
Thu 16 Jan 2014 20:59:27 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 20:59:27 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:59:27 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:59:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:59:27 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:59:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:59:28 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Thu 16 Jan 2014 20:59:28 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:59:28 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 20:59:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:59:32 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:59:32 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:59:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 20:59:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:59:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:59:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:59:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:59:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:59:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:59:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:59:36 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 20:59:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43370812
Thu 16 Jan 2014 20:59:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 20:59:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43370812
Thu 16 Jan 2014 20:59:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 20:59:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:59:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:59:43 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 20:59:43 - job_xml_thread(): Done retrieving: data size 43370812
Thu 16 Jan 2014 20:59:44 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 20:59:44 - XML: Start document: iteration 18
Thu 16 Jan 2014 20:59:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 20:59:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 20:59:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 20:59:49 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 20:59:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 20:59:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:59:49 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:59:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 20:59:49 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 20:59:49 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:59:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 20:59:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 20:59:52 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 20:59:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:59:53 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 20:59:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 20:59:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 20:59:53 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 20:59:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5875 values 92695 bits 11586 bytes 
Thu 16 Jan 2014 20:59:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 20:59:55 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 20:59:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 20:59:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 20:59:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:59:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 20:59:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 20:59:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 20:59:59 - XML: Processed 649400 elements - found 746 jobs
Thu 16 Jan 2014 20:59:59 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 20:59:59 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 20:59:59 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 20:59:59 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:00:02 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:00:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43237382
Thu 16 Jan 2014 21:00:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:00:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43237382
Thu 16 Jan 2014 21:00:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:00:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:00:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:00:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:00:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:00:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:00:13 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:00:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:00:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:00:13 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:00:13 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:00:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:00:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:00:13 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:00:14 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:00:17 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:00:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 21:00:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:00:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:00:18 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:00:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:00:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:00:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:00:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:00:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:00:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:00:22 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:00:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43287261
Thu 16 Jan 2014 21:00:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:00:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43287261
Thu 16 Jan 2014 21:00:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:00:22 - job_xml_thread(): Done retrieving: data size 43287261
Thu 16 Jan 2014 21:00:22 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:00:22 - XML: Start document: iteration 19
Thu 16 Jan 2014 21:00:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:00:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:00:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:00:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:00:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:00:38 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:00:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:00:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:00:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:00:39 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:00:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:00:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:00:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:00:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:00:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:00:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:00:40 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:00:40 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:00:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:00:40 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:00:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:00:42 - XML: Processed 648238 elements - found 746 jobs
Thu 16 Jan 2014 21:00:42 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:00:42 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:00:42 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:00:42 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:00:45 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:00:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43802171
Thu 16 Jan 2014 21:00:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:00:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43802171
Thu 16 Jan 2014 21:00:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:00:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:00:53 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:00:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:00:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 21:00:54 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:00:54 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:00:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 21:00:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:00:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:00:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8802 values 138776 bits 17347 bytes 
Thu 16 Jan 2014 21:00:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:00:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:00:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:00:57 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:00:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:00:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:00:57 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:00:57 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:00:58 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:00:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:00:58 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:00:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:01:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:01:01 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:01:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:01:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:01:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:01:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:01:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:01:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:01:04 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:01:04 - job_xml_thread(): Done retrieving: data size 43885580
Thu 16 Jan 2014 21:01:04 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:01:04 - XML: Start document: iteration 20
Thu 16 Jan 2014 21:01:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43885580
Thu 16 Jan 2014 21:01:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:01:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43885580
Thu 16 Jan 2014 21:01:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:01:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:01:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:01:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:01:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:01:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:01:23 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:01:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:01:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:01:23 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:01:23 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:01:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:01:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:01:24 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:01:27 - XML: Processed 655624 elements - found 745 jobs
Thu 16 Jan 2014 21:01:27 - job 7346781 appears to have finished
Thu 16 Jan 2014 21:01:27 - job 7343576 appears to have finished
Thu 16 Jan 2014 21:01:27 - job 7345946 appears to have finished
Thu 16 Jan 2014 21:01:27 - job_xml_thread(): Found 5 updated jobs.
Thu 16 Jan 2014 21:01:27 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 21:01:28 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Thu 16 Jan 2014 21:01:28 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:01:28 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:01:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:01:29 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:01:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:01:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:01:29 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:01:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 21:01:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:01:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:01:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:01:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:01:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:01:33 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:01:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43898199
Thu 16 Jan 2014 21:01:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:01:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43898199
Thu 16 Jan 2014 21:01:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:01:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:01:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:01:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:01:43 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:01:43 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:01:43 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:01:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:01:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:01:43 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:01:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:01:43 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:01:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:01:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:01:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:01:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:01:48 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:01:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:01:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:01:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:01:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:01:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:01:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:01:50 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:01:50 - job_xml_thread(): Done retrieving: data size 43888347
Thu 16 Jan 2014 21:01:50 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:01:50 - Housekeeping: checking database for timed out jobs..
Thu 16 Jan 2014 21:01:50 - Housekeeping: Found 0 timed out jobs in database: closing entries
Thu 16 Jan 2014 21:01:50 - Housekeeping: done.
Thu 16 Jan 2014 21:01:50 - XML: Start document: iteration 0
Thu 16 Jan 2014 21:01:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43888347
Thu 16 Jan 2014 21:01:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:01:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43888347
Thu 16 Jan 2014 21:01:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:01:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:01:55 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:01:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:01:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 21:01:56 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:01:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8678 values 137188 bits 17148 bytes 
Thu 16 Jan 2014 21:01:56 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:01:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 21:01:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:01:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:02:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:02:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:02:08 - XML: Processed 655688 elements - found 745 jobs
Thu 16 Jan 2014 21:02:08 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:02:08 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:02:08 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:02:08 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:02:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:02:09 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:02:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:02:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:02:10 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:02:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:02:10 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:02:10 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:02:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:02:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:02:13 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:02:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:02:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:02:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:02:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:02:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:02:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:02:17 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:02:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43923340
Thu 16 Jan 2014 21:02:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:02:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43923340
Thu 16 Jan 2014 21:02:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:02:23 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:02:23 - job_xml_thread(): Done retrieving: data size 43923340
Thu 16 Jan 2014 21:02:23 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:02:23 - XML: Start document: iteration 1
Thu 16 Jan 2014 21:02:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:02:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:02:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:02:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:02:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:02:29 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:02:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:02:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:02:30 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:02:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:02:30 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:02:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:02:30 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:02:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:02:40 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:02:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:02:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:02:41 - XML: Processed 655688 elements - found 745 jobs
Thu 16 Jan 2014 21:02:41 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:02:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:02:41 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:02:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:02:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:02:41 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:02:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:02:41 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:02:41 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:02:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 21:02:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:02:44 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:02:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43886393
Thu 16 Jan 2014 21:02:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:02:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:02:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:02:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43886393
Thu 16 Jan 2014 21:02:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:02:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:02:56 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:02:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:02:56 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:02:56 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:02:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:02:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:02:57 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:02:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 21:02:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 21:02:57 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:02:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5966 values 94397 bits 11799 bytes 
Thu 16 Jan 2014 21:02:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:02:57 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:02:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:02:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:02:58 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:02:58 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:02:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:02:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:03:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:03:01 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:03:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:03:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:03:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:03:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:03:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:03:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:03:04 - Leaving storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 21:03:04 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Thu 16 Jan 2014 21:03:04 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:03:06 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:03:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 21:03:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:03:06 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:03:06 - job_xml_thread(): Done retrieving: data size 43887599
Thu 16 Jan 2014 21:03:06 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:03:06 - XML: Start document: iteration 2
Thu 16 Jan 2014 21:03:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43887599
Thu 16 Jan 2014 21:03:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43887599
Thu 16 Jan 2014 21:03:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:03:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:03:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:03:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:03:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:03:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:03:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:03:20 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:03:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:03:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:03:21 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:03:21 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:03:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:03:21 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:03:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:03:26 - XML: Processed 655683 elements - found 743 jobs
Thu 16 Jan 2014 21:03:27 - job 7346395 appears to have finished
Thu 16 Jan 2014 21:03:27 - job 7346756 appears to have finished
Thu 16 Jan 2014 21:03:27 - job_xml_thread(): Found 2 updated jobs.
Thu 16 Jan 2014 21:03:27 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 21:03:27 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Thu 16 Jan 2014 21:03:27 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:03:27 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:03:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:03:29 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:03:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:03:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:03:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:03:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:03:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:03:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:03:31 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:03:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43899044
Thu 16 Jan 2014 21:03:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:03:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43899044
Thu 16 Jan 2014 21:03:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:03:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:03:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:03:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:03:42 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:03:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:03:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:03:42 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:03:42 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:03:42 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:03:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:03:42 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:03:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:03:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:03:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:03:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:03:46 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:03:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:03:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:03:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:03:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:03:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:03:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:03:47 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:03:47 - job_xml_thread(): Done retrieving: data size 43915605
Thu 16 Jan 2014 21:03:47 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:03:47 - XML: Start document: iteration 3
Thu 16 Jan 2014 21:03:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43915605
Thu 16 Jan 2014 21:03:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:03:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43915605
Thu 16 Jan 2014 21:03:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:03:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:03:57 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:03:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:03:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:03:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:03:58 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:03:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:03:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:03:59 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:03:59 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:03:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:03:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:03:59 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:03:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:03:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 21:03:59 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:03:59 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:03:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 21:04:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148781 bits 18597 bytes 
Thu 16 Jan 2014 21:04:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:04:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:04:03 - XML: Processed 655683 elements - found 743 jobs
Thu 16 Jan 2014 21:04:03 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:04:03 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:04:03 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:04:03 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:04:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:04:08 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:04:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:04:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:04:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:04:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:04:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:04:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:04:11 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:04:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43888353
Thu 16 Jan 2014 21:04:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:04:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43888353
Thu 16 Jan 2014 21:04:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:04:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:04:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:04:18 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:04:18 - job_xml_thread(): Done retrieving: data size 43888353
Thu 16 Jan 2014 21:04:18 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:04:18 - XML: Start document: iteration 4
Thu 16 Jan 2014 21:04:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:04:23 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:04:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:04:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:04:24 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:04:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:04:24 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:04:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:04:24 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:04:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:04:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:04:31 - XML: Processed 655684 elements - found 743 jobs
Thu 16 Jan 2014 21:04:31 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:04:31 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:04:31 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:04:31 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:04:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:04:33 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:04:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:04:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:04:33 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:04:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 21:04:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:04:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:04:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:04:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:04:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:04:35 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:04:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43880744
Thu 16 Jan 2014 21:04:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:04:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43880744
Thu 16 Jan 2014 21:04:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:04:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:04:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:04:46 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:04:46 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:04:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:04:46 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:04:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:04:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:04:47 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:04:47 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:04:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:04:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:04:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:04:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:04:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:04:49 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:04:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:04:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:04:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:04:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:04:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:04:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:04:51 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:04:51 - job_xml_thread(): Done retrieving: data size 43894216
Thu 16 Jan 2014 21:04:51 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:04:51 - XML: Start document: iteration 5
Thu 16 Jan 2014 21:04:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43894216
Thu 16 Jan 2014 21:04:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:04:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43894216
Thu 16 Jan 2014 21:04:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:04:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:05:00 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:05:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:05:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 21:05:00 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:05:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9022 values 142391 bits 17798 bytes 
Thu 16 Jan 2014 21:05:00 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:05:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 21:05:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:05:01 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:05:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:05:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:05:04 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:05:04 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:05:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:05:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:05:04 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:05:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:05:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:05:09 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Thu 16 Jan 2014 21:05:09 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:05:11 - XML: Processed 655684 elements - found 743 jobs
Thu 16 Jan 2014 21:05:11 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:05:11 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:05:11 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:05:11 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:05:11 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 21:05:11 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 21:05:11 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:05:11 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:05:11 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Thu 16 Jan 2014 21:05:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:05:13 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:05:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:05:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:05:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:05:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:05:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:05:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:05:15 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:05:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43829766
Thu 16 Jan 2014 21:05:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:05:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43829766
Thu 16 Jan 2014 21:05:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:05:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:05:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:05:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:05:26 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:05:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:05:26 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:05:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:05:26 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:05:28 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:05:28 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:05:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:05:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:05:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:05:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:05:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:05:30 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:05:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:05:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:05:30 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:05:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 21:05:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:05:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:05:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:05:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:05:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:05:31 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:05:31 - job_xml_thread(): Done retrieving: data size 43430594
Thu 16 Jan 2014 21:05:31 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:05:31 - XML: Start document: iteration 6
Thu 16 Jan 2014 21:05:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43430594
Thu 16 Jan 2014 21:05:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:05:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43430594
Thu 16 Jan 2014 21:05:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:05:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:05:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:05:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:05:47 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:05:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:05:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:05:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:05:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:05:50 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:05:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:05:50 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:05:50 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:05:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:05:50 - XML: Processed 649770 elements - found 744 jobs
Thu 16 Jan 2014 21:05:50 - job 7346128 appears to have finished
Thu 16 Jan 2014 21:05:50 - job 7346695 appears to have finished
Thu 16 Jan 2014 21:05:50 - job_xml_thread(): Found 5 updated jobs.
Thu 16 Jan 2014 21:05:50 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 21:05:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:05:53 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:05:53 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Thu 16 Jan 2014 21:05:53 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:05:53 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:05:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:05:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:05:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:05:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:05:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:05:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:05:55 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:05:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43251414
Thu 16 Jan 2014 21:05:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:05:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43251414
Thu 16 Jan 2014 21:05:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:06:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:06:00 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:06:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:06:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 21:06:00 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:06:01 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:06:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 21:06:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8957 values 141362 bits 17670 bytes 
Thu 16 Jan 2014 21:06:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:06:02 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:06:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:06:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:06:06 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:06:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:06:06 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:06:06 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:06:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:06:08 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:06:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:06:08 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:06:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:06:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:06:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:06:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:06:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:06:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:06:10 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:06:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43299857
Thu 16 Jan 2014 21:06:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:06:10 - job_xml_thread(): Done retrieving: data size 43299857
Thu 16 Jan 2014 21:06:10 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:06:10 - XML: Start document: iteration 7
Thu 16 Jan 2014 21:06:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43299857
Thu 16 Jan 2014 21:06:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:06:11 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:06:11 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:06:14 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:06:14 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 21:06:14 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:06:14 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 21:06:14 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 21:06:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:06:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:06:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:06:23 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:06:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:06:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:06:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:06:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:06:26 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:06:26 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:06:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:06:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:06:27 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:06:29 - XML: Processed 648160 elements - found 744 jobs
Thu 16 Jan 2014 21:06:29 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:06:29 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:06:29 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:06:29 - job_xml_thread(): Sleeping.. (15s)
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Thu 16 Jan 2014 21:06:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:06:33 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:06:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:06:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:06:33 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:06:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 21:06:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:06:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:06:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:06:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:06:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:06:34 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:06:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43315885
Thu 16 Jan 2014 21:06:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:06:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43315885
Thu 16 Jan 2014 21:06:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:06:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:06:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:06:45 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:06:45 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:06:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:06:46 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:06:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:06:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:06:47 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:06:47 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:06:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:06:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:06:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:06:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:06:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:06:49 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:06:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:06:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:06:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:06:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:06:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:06:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:06:51 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:06:51 - job_xml_thread(): Done retrieving: data size 43855262
Thu 16 Jan 2014 21:06:51 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:06:51 - XML: Start document: iteration 8
Thu 16 Jan 2014 21:06:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855262
Thu 16 Jan 2014 21:06:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:06:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855262
Thu 16 Jan 2014 21:06:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:07:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:07:01 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:07:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:07:02 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:07:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 21:07:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 21:07:02 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:07:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:07:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8568 values 135253 bits 16906 bytes 
Thu 16 Jan 2014 21:07:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:07:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:07:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:07:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:07:07 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:07:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:07:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:07:09 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:07:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:07:09 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:07:09 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:07:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:07:11 - XML: Processed 655000 elements - found 744 jobs
Thu 16 Jan 2014 21:07:12 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:07:12 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:07:12 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:07:12 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:07:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:07:13 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:07:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:07:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:07:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:07:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:07:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:07:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:07:14 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:07:14 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:07:15 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:07:15 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:07:15 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 21:07:15 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 21:07:15 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 21:07:16 - size of cluster 'LISA Cluster': 624 hosts 79471 metrics 952823 values 15048277 bits 1881034 bytes 
Thu 16 Jan 2014 21:07:16 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:07:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43904039
Thu 16 Jan 2014 21:07:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:07:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43904039
Thu 16 Jan 2014 21:07:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:07:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:07:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:07:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:07:27 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:07:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:07:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:07:27 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:07:27 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:07:28 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:07:28 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:07:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:07:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:07:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:07:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:07:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:07:30 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:07:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:07:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:07:31 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:07:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 21:07:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:07:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:07:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:07:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:07:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:07:34 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:07:34 - job_xml_thread(): Done retrieving: data size 43903611
Thu 16 Jan 2014 21:07:34 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:07:34 - XML: Start document: iteration 9
Thu 16 Jan 2014 21:07:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43903611
Thu 16 Jan 2014 21:07:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43903611
Thu 16 Jan 2014 21:07:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:07:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:07:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:07:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:07:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:07:46 - XML: Processed 655684 elements - found 743 jobs
Thu 16 Jan 2014 21:07:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:07:47 - job 7346795 appears to have finished
Thu 16 Jan 2014 21:07:47 - job 7346776 appears to have finished
Thu 16 Jan 2014 21:07:48 - job 7346822 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 21:07:48 - job_xml_thread(): Found 4 updated jobs.
Thu 16 Jan 2014 21:07:48 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 21:07:51 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Thu 16 Jan 2014 21:07:51 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:07:51 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:07:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:07:56 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:07:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:07:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:07:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:07:57 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:07:57 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:07:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:07:57 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:07:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:07:57 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:07:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:07:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:07:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:07:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:07:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:07:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:08:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:08:02 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:08:03 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:08:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43912379
Thu 16 Jan 2014 21:08:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:08:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43912379
Thu 16 Jan 2014 21:08:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:08:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:08:04 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:08:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 21:08:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 21:08:04 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:08:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5598 values 88299 bits 11037 bytes 
Thu 16 Jan 2014 21:08:06 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:08:06 - job_xml_thread(): Done retrieving: data size 43912379
Thu 16 Jan 2014 21:08:06 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:08:07 - XML: Start document: iteration 10
Thu 16 Jan 2014 21:08:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:08:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:08:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:08:12 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:08:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:08:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:08:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:08:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:08:16 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:08:16 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 21:08:16 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:08:16 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:08:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:08:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:08:16 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:08:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:08:25 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:08:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:08:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:08:26 - XML: Processed 655684 elements - found 743 jobs
Thu 16 Jan 2014 21:08:26 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:08:26 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:08:26 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:08:26 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:08:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:08:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:08:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:08:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:08:30 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:08:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43879436
Thu 16 Jan 2014 21:08:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:08:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43879436
Thu 16 Jan 2014 21:08:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:08:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:08:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:08:41 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:08:41 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:08:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:08:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:08:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:08:44 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:08:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:08:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:08:45 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:08:45 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:08:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:08:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:08:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:08:46 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:08:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:08:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:08:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:08:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:08:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:08:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:08:47 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:08:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 21:08:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:08:48 - Leaving storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 21:08:48 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Thu 16 Jan 2014 21:08:48 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:08:49 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:08:49 - job_xml_thread(): Done retrieving: data size 43908734
Thu 16 Jan 2014 21:08:49 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:08:49 - XML: Start document: iteration 11
Thu 16 Jan 2014 21:08:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43908734
Thu 16 Jan 2014 21:08:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:08:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43908734
Thu 16 Jan 2014 21:08:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:09:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:09:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:09:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:09:01 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:09:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:09:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:09:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:09:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:09:02 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:09:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:09:02 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:09:02 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:09:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:09:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:09:05 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:09:06 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:09:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:09:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 21:09:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 21:09:07 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:09:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5710 values 90055 bits 11256 bytes 
Thu 16 Jan 2014 21:09:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:09:11 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:09:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:09:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:09:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:09:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:09:12 - XML: Processed 655684 elements - found 743 jobs
Thu 16 Jan 2014 21:09:12 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:09:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:09:12 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:09:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:09:12 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:09:12 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:09:14 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:09:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43887856
Thu 16 Jan 2014 21:09:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:09:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43887856
Thu 16 Jan 2014 21:09:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:09:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:09:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:09:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:09:25 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:09:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:09:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:09:26 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:09:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:09:26 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:09:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:09:26 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:09:27 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:09:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:09:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:09:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:09:28 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:09:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:09:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:09:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:09:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:09:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:09:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:09:28 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:09:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 21:09:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:09:31 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:09:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43928557
Thu 16 Jan 2014 21:09:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:09:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43928557
Thu 16 Jan 2014 21:09:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:09:32 - job_xml_thread(): Done retrieving: data size 43928557
Thu 16 Jan 2014 21:09:32 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:09:32 - XML: Start document: iteration 12
Thu 16 Jan 2014 21:09:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:09:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:09:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:09:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:09:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:09:48 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:09:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:09:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:09:50 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:09:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:09:50 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:09:50 - XML: Processed 655680 elements - found 741 jobs
Thu 16 Jan 2014 21:09:50 - job 7346524 appears to have finished
Thu 16 Jan 2014 21:09:50 - job 7346168 appears to have finished
Thu 16 Jan 2014 21:09:50 - job_xml_thread(): Found 2 updated jobs.
Thu 16 Jan 2014 21:09:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:09:50 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 21:09:50 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:09:51 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Thu 16 Jan 2014 21:09:51 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:09:51 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:09:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:09:54 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:09:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:09:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:09:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:09:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:09:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:09:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:09:56 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:09:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43902139
Thu 16 Jan 2014 21:09:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:09:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43902139
Thu 16 Jan 2014 21:09:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:10:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:10:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:10:07 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:10:07 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:10:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:10:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:10:07 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:10:07 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:10:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:10:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:10:08 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:10:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:10:08 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:10:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:10:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:10:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 21:10:08 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:10:08 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:10:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 21:10:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9078 values 143385 bits 17923 bytes 
Thu 16 Jan 2014 21:10:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:10:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:10:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:10:12 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:10:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:10:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:10:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:10:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:10:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:10:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:10:15 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:10:15 - job_xml_thread(): Done retrieving: data size 43908147
Thu 16 Jan 2014 21:10:15 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:10:15 - XML: Start document: iteration 13
Thu 16 Jan 2014 21:10:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43908147
Thu 16 Jan 2014 21:10:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:10:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43908147
Thu 16 Jan 2014 21:10:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:10:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:10:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:10:26 - XML: Processed 655680 elements - found 741 jobs
Thu 16 Jan 2014 21:10:26 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:10:26 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:10:26 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:10:26 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:10:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:10:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:10:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:10:34 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:10:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:10:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:10:35 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:10:35 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:10:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:10:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:10:35 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:10:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:10:37 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:10:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:10:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:10:37 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:10:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 21:10:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:10:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:10:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:10:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:10:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:10:38 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:10:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43903098
Thu 16 Jan 2014 21:10:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:10:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43903098
Thu 16 Jan 2014 21:10:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:10:41 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:10:41 - job_xml_thread(): Done retrieving: data size 43903098
Thu 16 Jan 2014 21:10:41 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:10:41 - XML: Start document: iteration 14
Thu 16 Jan 2014 21:10:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:10:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:10:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:10:51 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:10:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:10:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:10:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:10:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:10:52 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:10:52 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:10:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:10:52 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:10:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:10:55 - XML: Processed 655680 elements - found 741 jobs
Thu 16 Jan 2014 21:10:55 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:10:55 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:10:55 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:10:55 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:10:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:10:59 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:10:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:10:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:11:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:11:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:11:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:11:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:11:01 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:11:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43911536
Thu 16 Jan 2014 21:11:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:11:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43911536
Thu 16 Jan 2014 21:11:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:11:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:11:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:11:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:11:08 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:11:08 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:11:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 21:11:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:11:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 21:11:08 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:11:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9263 values 146254 bits 18281 bytes 
Thu 16 Jan 2014 21:11:10 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:11:10 - job_xml_thread(): Done retrieving: data size 43911536
Thu 16 Jan 2014 21:11:10 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:11:10 - XML: Start document: iteration 15
Thu 16 Jan 2014 21:11:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:11:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:11:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:11:17 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:11:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:11:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:11:17 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:11:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:11:17 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:11:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:11:17 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:11:22 - XML: Processed 655680 elements - found 741 jobs
Thu 16 Jan 2014 21:11:22 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:11:22 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:11:22 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:11:22 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:11:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:11:24 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:11:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:11:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:11:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:11:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:11:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:11:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:11:26 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:11:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43823653
Thu 16 Jan 2014 21:11:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:11:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43823653
Thu 16 Jan 2014 21:11:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:11:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:11:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:11:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:11:37 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:11:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:11:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:11:37 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:11:37 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:11:38 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:11:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:11:38 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:11:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:11:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:11:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:11:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:11:42 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:11:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:11:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:11:42 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:11:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 21:11:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:11:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:11:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:11:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:11:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:11:44 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:11:44 - job_xml_thread(): Done retrieving: data size 43307630
Thu 16 Jan 2014 21:11:44 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:11:44 - XML: Start document: iteration 16
Thu 16 Jan 2014 21:11:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43307630
Thu 16 Jan 2014 21:11:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43307630
Thu 16 Jan 2014 21:11:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:11:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:11:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:11:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:11:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:11:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:12:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:12:00 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:12:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:12:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:12:00 - XML: Processed 648226 elements - found 740 jobs
Thu 16 Jan 2014 21:12:00 - job 7346681 appears to have finished
Thu 16 Jan 2014 21:12:00 - job_xml_thread(): Found 1 updated jobs.
Thu 16 Jan 2014 21:12:00 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 21:12:00 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Thu 16 Jan 2014 21:12:00 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:12:00 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:12:01 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:12:01 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:12:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:12:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:12:01 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:12:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:12:05 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:12:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:12:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:12:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:12:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:12:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:12:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:12:07 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:12:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43229043
Thu 16 Jan 2014 21:12:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:12:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:12:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43229043
Thu 16 Jan 2014 21:12:08 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:12:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:12:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:12:11 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:12:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 21:12:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 21:12:11 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:12:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8799 values 138799 bits 17349 bytes 
Thu 16 Jan 2014 21:12:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:12:14 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:12:16 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:12:16 - job_xml_thread(): Done retrieving: data size 43229043
Thu 16 Jan 2014 21:12:16 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:12:16 - XML: Start document: iteration 17
Thu 16 Jan 2014 21:12:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:12:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:12:17 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:12:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:12:17 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:12:17 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:12:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:12:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:12:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:12:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:12:22 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:12:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:12:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:12:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:12:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:12:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:12:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:12:25 - XML: Processed 647478 elements - found 740 jobs
Thu 16 Jan 2014 21:12:25 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:12:25 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:12:25 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:12:25 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:12:28 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:12:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 21:12:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:12:28 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:12:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43294738
Thu 16 Jan 2014 21:12:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:12:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43294738
Thu 16 Jan 2014 21:12:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:12:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:12:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:12:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:12:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:12:38 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:12:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:12:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:12:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:12:41 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:12:41 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:12:41 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:12:41 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:12:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:12:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:12:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:12:43 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:12:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:12:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:12:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:12:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:12:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:12:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:12:45 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:12:45 - job_xml_thread(): Done retrieving: data size 43799634
Thu 16 Jan 2014 21:12:45 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:12:45 - XML: Start document: iteration 18
Thu 16 Jan 2014 21:12:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43799634
Thu 16 Jan 2014 21:12:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43799634
Thu 16 Jan 2014 21:12:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:12:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:12:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:12:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:12:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:12:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:13:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:13:01 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:13:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:13:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:13:01 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:13:01 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:13:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:13:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:13:01 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:13:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:13:06 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:13:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:13:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:13:07 - XML: Processed 654070 elements - found 740 jobs
Thu 16 Jan 2014 21:13:08 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:13:08 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:13:08 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:13:08 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:13:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:13:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:13:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:13:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:13:10 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:13:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43885508
Thu 16 Jan 2014 21:13:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:13:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43885508
Thu 16 Jan 2014 21:13:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:13:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:13:12 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:13:14 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:13:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:13:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 21:13:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 21:13:16 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:13:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148781 bits 18597 bytes 
Thu 16 Jan 2014 21:13:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:13:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:13:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:13:21 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:13:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:13:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:13:21 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:13:21 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:13:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:13:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:13:21 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:13:23 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:13:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:13:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:13:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:13:25 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:13:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:13:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:13:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:13:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:13:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:13:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:13:27 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:13:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 21:13:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:13:28 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:13:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43899624
Thu 16 Jan 2014 21:13:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:13:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43899624
Thu 16 Jan 2014 21:13:28 - job_xml_thread(): Done retrieving: data size 43899624
Thu 16 Jan 2014 21:13:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:13:28 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:13:28 - XML: Start document: iteration 19
Thu 16 Jan 2014 21:13:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:13:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:13:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:13:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:13:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:13:41 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:13:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:13:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:13:42 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:13:42 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:13:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:13:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:13:43 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:13:48 - XML: Processed 655678 elements - found 740 jobs
Thu 16 Jan 2014 21:13:48 - job 7346702 appears to have finished
Thu 16 Jan 2014 21:13:48 - job_xml_thread(): Found 2 updated jobs.
Thu 16 Jan 2014 21:13:48 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 21:13:50 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Thu 16 Jan 2014 21:13:50 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:13:50 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:13:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:13:51 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:13:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:13:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:13:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:13:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:13:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:13:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:13:53 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:13:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43876010
Thu 16 Jan 2014 21:13:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:13:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43876010
Thu 16 Jan 2014 21:13:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:13:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:13:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:14:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:14:03 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:14:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:14:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:14:04 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:14:04 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:14:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:14:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:14:05 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:14:06 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:14:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:14:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:14:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:14:07 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:14:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:14:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:14:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:14:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:14:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:14:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:14:10 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:14:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43909002
Thu 16 Jan 2014 21:14:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:14:10 - job_xml_thread(): Done retrieving: data size 43909002
Thu 16 Jan 2014 21:14:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43909002
Thu 16 Jan 2014 21:14:10 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:14:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:14:10 - XML: Start document: iteration 20
Thu 16 Jan 2014 21:14:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:14:15 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:14:16 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Thu 16 Jan 2014 21:14:16 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:14:16 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:14:16 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:14:16 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 21:14:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:14:17 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:14:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 21:14:17 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 21:14:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 21:14:17 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:14:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148742 bits 18592 bytes 
Thu 16 Jan 2014 21:14:17 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 21:14:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:14:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:14:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:14:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Thu 16 Jan 2014 21:14:27 - XML: Processed 655678 elements - found 740 jobs
Thu 16 Jan 2014 21:14:27 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:14:27 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:14:27 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:14:27 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:14:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:14:30 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:14:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:14:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:14:32 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:14:32 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:14:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:14:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:14:32 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:14:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:14:33 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:14:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:14:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:14:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:14:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:14:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:14:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:14:36 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:14:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43900548
Thu 16 Jan 2014 21:14:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:14:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43900548
Thu 16 Jan 2014 21:14:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:14:42 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:14:42 - job_xml_thread(): Done retrieving: data size 43900548
Thu 16 Jan 2014 21:14:42 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:14:42 - Housekeeping: checking database for timed out jobs..
Thu 16 Jan 2014 21:14:43 - Housekeeping: Found 0 timed out jobs in database: closing entries
Thu 16 Jan 2014 21:14:43 - Housekeeping: done.
Thu 16 Jan 2014 21:14:43 - XML: Start document: iteration 0
Thu 16 Jan 2014 21:14:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:14:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:14:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:14:47 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:14:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:14:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:14:47 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:14:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:14:47 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:14:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:14:48 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:14:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:14:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:14:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:14:55 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:14:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:14:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:14:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:14:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:14:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:14:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:14:58 - XML: Processed 655678 elements - found 740 jobs
Thu 16 Jan 2014 21:14:58 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:14:58 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:14:58 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:14:58 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:14:58 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:14:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 21:14:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:15:01 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:15:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43895465
Thu 16 Jan 2014 21:15:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:15:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43895465
Thu 16 Jan 2014 21:15:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:15:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:15:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:15:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:15:11 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:15:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:15:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:15:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:15:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:15:12 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:15:12 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:15:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:15:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:15:12 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:15:13 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:15:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:15:15 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:15:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:15:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:15:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:15:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:15:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:15:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:15:16 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:15:16 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:15:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:15:17 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:15:17 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:15:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43912863
Thu 16 Jan 2014 21:15:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:15:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43912863
Thu 16 Jan 2014 21:15:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:15:18 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:15:18 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 21:15:18 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 21:15:18 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:15:18 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 21:15:18 - job_xml_thread(): Done retrieving: data size 43912863
Thu 16 Jan 2014 21:15:18 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:15:18 - XML: Start document: iteration 1
Thu 16 Jan 2014 21:15:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:15:18 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:15:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 21:15:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 21:15:18 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:15:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8951 values 141289 bits 17661 bytes 
Thu 16 Jan 2014 21:15:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:15:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:15:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:15:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:15:34 - size of cluster 'LISA Cluster': 624 hosts 79473 metrics 967601 values 15265972 bits 1908246 bytes 
Thu 16 Jan 2014 21:15:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:15:36 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:15:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:15:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:15:36 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:15:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:15:36 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:15:36 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:15:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:15:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:15:40 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:15:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:15:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:15:41 - XML: Processed 655676 elements - found 739 jobs
Thu 16 Jan 2014 21:15:41 - job 7346810 appears to have finished
Thu 16 Jan 2014 21:15:41 - job 7346731 appears to have finished
Thu 16 Jan 2014 21:15:41 - job 7346811 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 21:15:41 - job_xml_thread(): Found 4 updated jobs.
Thu 16 Jan 2014 21:15:41 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 21:15:41 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Thu 16 Jan 2014 21:15:41 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:15:41 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:15:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:15:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:15:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:15:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:15:44 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:15:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43913335
Thu 16 Jan 2014 21:15:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:15:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43913335
Thu 16 Jan 2014 21:15:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:15:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:15:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:15:56 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:15:56 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:15:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:15:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:15:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:15:57 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:15:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:15:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:15:57 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:15:57 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:15:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:15:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:16:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:16:00 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:16:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:16:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:16:00 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:16:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 21:16:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:16:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:16:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:16:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:16:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:16:03 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:16:03 - job_xml_thread(): Done retrieving: data size 43904827
Thu 16 Jan 2014 21:16:03 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:16:03 - XML: Start document: iteration 2
Thu 16 Jan 2014 21:16:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43904827
Thu 16 Jan 2014 21:16:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43904827
Thu 16 Jan 2014 21:16:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:16:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:16:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:16:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:16:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:16:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:16:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:16:19 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:16:19 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:16:19 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 21:16:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:16:20 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:16:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:16:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 21:16:21 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:16:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5871 values 92661 bits 11582 bytes 
Thu 16 Jan 2014 21:16:21 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:16:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 21:16:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:16:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:16:21 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:16:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:16:21 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:16:21 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:16:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:16:25 - XML: Processed 655676 elements - found 739 jobs
Thu 16 Jan 2014 21:16:25 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:16:25 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:16:25 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:16:25 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:16:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:16:28 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:16:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:16:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:16:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:16:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:16:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:16:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:16:34 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:16:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43883061
Thu 16 Jan 2014 21:16:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:16:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43883061
Thu 16 Jan 2014 21:16:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:16:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:16:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:16:40 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:16:40 - job_xml_thread(): Done retrieving: data size 43883061
Thu 16 Jan 2014 21:16:40 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:16:40 - XML: Start document: iteration 3
Thu 16 Jan 2014 21:16:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:16:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:16:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:16:52 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:16:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:16:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:16:53 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:16:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:16:53 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:16:53 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:16:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:16:54 - XML: Processed 655676 elements - found 739 jobs
Thu 16 Jan 2014 21:16:54 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:16:54 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:16:54 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:16:54 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:16:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:16:57 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:16:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:16:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:16:58 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:16:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 21:16:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:16:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:16:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:16:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:16:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:17:01 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:17:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43916519
Thu 16 Jan 2014 21:17:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:17:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43916519
Thu 16 Jan 2014 21:17:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:17:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:17:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:17:10 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:17:10 - job_xml_thread(): Done retrieving: data size 43916519
Thu 16 Jan 2014 21:17:10 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:17:10 - XML: Start document: iteration 4
Thu 16 Jan 2014 21:17:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:17:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:17:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:17:21 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:17:21 - XML: Processed 655676 elements - found 739 jobs
Thu 16 Jan 2014 21:17:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:17:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 21:17:21 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:17:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5818 values 92069 bits 11508 bytes 
Thu 16 Jan 2014 21:17:21 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:17:21 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:17:21 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:17:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 21:17:21 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:17:22 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:17:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:17:23 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:17:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:17:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:17:24 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:17:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:17:24 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:17:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:17:24 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:17:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:17:26 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:17:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:17:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:17:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:17:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:17:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:17:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:17:30 - Leaving storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 21:17:30 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Thu 16 Jan 2014 21:17:30 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:17:30 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:17:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43829257
Thu 16 Jan 2014 21:17:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:17:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43829257
Thu 16 Jan 2014 21:17:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:17:37 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:17:37 - job_xml_thread(): Done retrieving: data size 43829257
Thu 16 Jan 2014 21:17:37 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:17:37 - XML: Start document: iteration 5
Thu 16 Jan 2014 21:17:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:17:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:17:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:17:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:17:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:17:44 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:17:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:17:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:17:46 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:17:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:17:46 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:17:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:17:46 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:17:51 - XML: Processed 654638 elements - found 737 jobs
Thu 16 Jan 2014 21:17:51 - job 7346809 appears to have finished
Thu 16 Jan 2014 21:17:52 - job 7345926 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 21:17:52 - job 7346687 appears to have finished
Thu 16 Jan 2014 21:17:52 - job_xml_thread(): Found 3 updated jobs.
Thu 16 Jan 2014 21:17:52 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 21:17:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:17:53 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:17:53 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Thu 16 Jan 2014 21:17:53 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:17:53 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:17:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:17:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:17:53 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:17:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 21:17:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:17:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:17:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:17:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:17:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:17:55 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:17:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43258001
Thu 16 Jan 2014 21:17:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:17:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43258001
Thu 16 Jan 2014 21:17:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:18:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:18:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:18:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:18:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:18:08 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:18:08 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:18:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:18:09 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:18:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:18:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:18:09 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:18:09 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:18:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:18:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:18:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:18:11 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:18:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:18:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:18:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:18:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:18:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:18:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:18:14 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:18:14 - job_xml_thread(): Done retrieving: data size 43271891
Thu 16 Jan 2014 21:18:14 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:18:14 - XML: Start document: iteration 6
Thu 16 Jan 2014 21:18:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43271891
Thu 16 Jan 2014 21:18:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:18:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43271891
Thu 16 Jan 2014 21:18:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:18:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:18:22 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:18:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:18:23 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:18:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 21:18:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 21:18:23 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:18:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8831 values 139677 bits 17459 bytes 
Thu 16 Jan 2014 21:18:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:18:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:18:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:18:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:18:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:18:33 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:18:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:18:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:18:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:18:35 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:18:35 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:18:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:18:35 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:18:35 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:18:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:18:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:18:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:18:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:18:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:18:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:18:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:18:36 - XML: Processed 647668 elements - found 737 jobs
Thu 16 Jan 2014 21:18:36 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:18:36 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:18:36 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:18:36 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:18:41 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:18:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43740090
Thu 16 Jan 2014 21:18:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:18:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43740090
Thu 16 Jan 2014 21:18:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:18:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:18:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:18:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:18:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:18:51 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:18:52 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:18:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:18:52 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:18:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:18:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:18:53 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:18:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:18:53 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:18:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:18:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:18:56 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:18:56 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:18:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 21:18:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:18:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:18:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:18:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:18:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:18:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:18:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:18:58 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:18:58 - job_xml_thread(): Done retrieving: data size 43882263
Thu 16 Jan 2014 21:18:58 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:18:58 - XML: Start document: iteration 7
Thu 16 Jan 2014 21:18:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43882263
Thu 16 Jan 2014 21:18:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43882263
Thu 16 Jan 2014 21:18:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:18:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:19:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:19:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:19:09 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:19:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:19:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:19:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:19:11 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:19:11 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:19:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:19:11 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:19:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:19:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:19:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:19:19 - XML: Processed 655238 elements - found 737 jobs
Thu 16 Jan 2014 21:19:19 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:19:19 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:19:19 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:19:19 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:19:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:19:21 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:19:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:19:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:19:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:19:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:19:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:19:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:19:23 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:19:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43877978
Thu 16 Jan 2014 21:19:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:19:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43877978
Thu 16 Jan 2014 21:19:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:19:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:19:23 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:19:24 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:19:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:19:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 21:19:24 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:19:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9013 values 142382 bits 17797 bytes 
Thu 16 Jan 2014 21:19:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 21:19:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:19:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:19:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:19:34 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:19:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:19:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:19:34 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:19:34 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:19:35 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:19:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:19:35 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:19:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:19:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:19:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:19:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:19:39 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:19:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:19:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:19:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:19:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:19:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:19:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:19:42 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:19:42 - job_xml_thread(): Done retrieving: data size 43903892
Thu 16 Jan 2014 21:19:42 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:19:42 - XML: Start document: iteration 8
Thu 16 Jan 2014 21:19:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43903892
Thu 16 Jan 2014 21:19:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:19:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43903892
Thu 16 Jan 2014 21:19:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:19:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:19:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:19:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:19:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:19:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:19:59 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:20:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:20:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:20:01 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:20:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:20:01 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:20:01 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:20:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:20:02 - XML: Processed 655668 elements - found 735 jobs
Thu 16 Jan 2014 21:20:02 - job 7345926 field 'start_timestamp' changed since saved from: 1389903430 to: 1389903356
Thu 16 Jan 2014 21:20:02 - job 7346690 appears to have finished
Thu 16 Jan 2014 21:20:02 - job 7346755 appears to have finished
Thu 16 Jan 2014 21:20:03 - job 7343171 appears to have finished
Thu 16 Jan 2014 21:20:03 - job_xml_thread(): Found 5 updated jobs.
Thu 16 Jan 2014 21:20:03 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 21:20:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:20:05 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:20:05 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Thu 16 Jan 2014 21:20:05 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:20:05 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:20:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:20:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:20:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:20:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:20:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:20:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:20:05 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:20:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 21:20:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:20:07 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:20:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43894740
Thu 16 Jan 2014 21:20:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:20:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43894740
Thu 16 Jan 2014 21:20:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:20:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:20:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:20:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:20:19 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:20:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:20:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:20:20 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:20:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:20:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:20:20 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:20:21 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:20:21 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:20:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:20:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:20:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:20:23 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:20:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:20:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:20:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:20:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:20:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:20:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:20:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:20:24 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:20:24 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:20:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 21:20:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:20:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 21:20:24 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:20:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5619 values 88616 bits 11077 bytes 
Thu 16 Jan 2014 21:20:25 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:20:25 - job_xml_thread(): Done retrieving: data size 43910878
Thu 16 Jan 2014 21:20:25 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:20:25 - XML: Start document: iteration 9
Thu 16 Jan 2014 21:20:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43910878
Thu 16 Jan 2014 21:20:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43910878
Thu 16 Jan 2014 21:20:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:20:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:20:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:20:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:20:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:20:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:20:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:20:39 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:20:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:20:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:20:40 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:20:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:20:40 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:20:40 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:20:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:20:45 - XML: Processed 655668 elements - found 735 jobs
Thu 16 Jan 2014 21:20:46 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:20:46 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:20:46 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:20:46 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:20:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:20:47 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:20:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:20:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:20:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:20:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:20:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:20:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:20:49 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:20:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 21:20:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:20:49 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:20:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43888875
Thu 16 Jan 2014 21:20:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:20:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43888875
Thu 16 Jan 2014 21:20:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:20:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:20:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:21:02 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:21:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:21:02 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:21:02 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:21:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:21:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:21:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:21:04 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:21:04 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:21:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:21:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:21:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:21:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:21:05 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:21:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:21:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:21:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:21:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:21:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:21:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:21:07 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:21:07 - job_xml_thread(): Done retrieving: data size 43905647
Thu 16 Jan 2014 21:21:07 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:21:07 - XML: Start document: iteration 10
Thu 16 Jan 2014 21:21:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43905647
Thu 16 Jan 2014 21:21:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:21:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43905647
Thu 16 Jan 2014 21:21:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:21:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:21:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:21:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:21:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:21:20 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:21:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:21:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:21:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:21:21 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:21:21 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:21:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:21:21 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:21:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:21:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:21:24 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:21:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:21:25 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:21:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 21:21:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 21:21:26 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:21:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7032 values 110984 bits 13873 bytes 
Thu 16 Jan 2014 21:21:28 - XML: Processed 655666 elements - found 734 jobs
Thu 16 Jan 2014 21:21:28 - job 7346799 appears to have finished
Thu 16 Jan 2014 21:21:28 - job_xml_thread(): Found 1 updated jobs.
Thu 16 Jan 2014 21:21:28 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 21:21:28 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Thu 16 Jan 2014 21:21:28 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:21:28 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:21:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:21:30 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:21:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:21:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:21:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:21:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:21:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:21:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:21:33 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:21:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43877024
Thu 16 Jan 2014 21:21:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:21:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43877024
Thu 16 Jan 2014 21:21:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:21:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:21:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:21:43 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:21:43 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:21:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:21:46 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:21:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:21:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:21:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:21:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:21:46 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:21:46 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:21:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:21:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:21:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:21:47 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:21:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:21:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:21:47 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:21:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 21:21:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:21:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:21:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:21:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:21:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:21:49 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:21:49 - job_xml_thread(): Done retrieving: data size 43895373
Thu 16 Jan 2014 21:21:49 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:21:49 - XML: Start document: iteration 11
Thu 16 Jan 2014 21:21:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43895373
Thu 16 Jan 2014 21:21:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:21:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43895373
Thu 16 Jan 2014 21:21:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:22:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:22:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:22:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:22:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:22:06 - XML: Processed 655671 elements - found 737 jobs
Thu 16 Jan 2014 21:22:06 - job_xml_thread(): Found 3 updated jobs.
Thu 16 Jan 2014 21:22:06 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 21:22:08 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Thu 16 Jan 2014 21:22:08 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:22:08 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:22:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:22:08 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:22:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:22:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:22:09 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:22:09 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:22:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:22:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:22:09 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:22:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:22:11 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:22:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:22:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:22:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:22:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:22:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:22:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:22:12 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:22:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43912969
Thu 16 Jan 2014 21:22:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:22:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43912969
Thu 16 Jan 2014 21:22:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:22:19 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Thu 16 Jan 2014 21:22:19 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:22:21 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:22:21 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:22:21 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 21:22:21 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 21:22:21 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 21:22:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:22:21 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:22:23 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:22:23 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:22:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:22:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:22:25 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:22:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:22:25 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:22:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:22:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:22:26 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:22:26 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:22:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 21:22:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:22:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 21:22:26 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:22:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9093 values 143617 bits 17952 bytes 
Thu 16 Jan 2014 21:22:26 - size of cluster 'LISA Cluster': 624 hosts 79478 metrics 958068 values 15130391 bits 1891298 bytes 
Thu 16 Jan 2014 21:22:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:22:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:22:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:22:28 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:22:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:22:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:22:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:22:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:22:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:22:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:22:32 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:22:32 - job_xml_thread(): Done retrieving: data size 43889662
Thu 16 Jan 2014 21:22:32 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:22:32 - XML: Start document: iteration 12
Thu 16 Jan 2014 21:22:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43889662
Thu 16 Jan 2014 21:22:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:22:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43889662
Thu 16 Jan 2014 21:22:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:22:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:22:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:22:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:22:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:22:53 - XML: Processed 655672 elements - found 737 jobs
Thu 16 Jan 2014 21:22:53 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:22:53 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:22:53 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:22:53 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:22:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:22:56 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:22:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:22:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:22:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:22:57 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:22:57 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:22:57 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:22:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:22:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:22:57 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:22:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:22:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:22:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:22:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:22:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:22:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:22:57 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:22:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 21:22:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:23:00 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:23:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43909859
Thu 16 Jan 2014 21:23:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:23:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43909859
Thu 16 Jan 2014 21:23:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:23:08 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:23:08 - job_xml_thread(): Done retrieving: data size 43909859
Thu 16 Jan 2014 21:23:08 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:23:08 - XML: Start document: iteration 13
Thu 16 Jan 2014 21:23:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:23:09 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:23:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:23:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:23:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:23:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:23:13 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:23:13 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:23:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:23:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:23:13 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:23:18 - XML: Processed 655672 elements - found 737 jobs
Thu 16 Jan 2014 21:23:18 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:23:18 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:23:18 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:23:18 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:23:21 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:23:21 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 21:23:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:23:22 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:23:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:23:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:23:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:23:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:23:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:23:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:23:26 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:23:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43825796
Thu 16 Jan 2014 21:23:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:23:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43825796
Thu 16 Jan 2014 21:23:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:23:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:23:27 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:23:28 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:23:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:23:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 21:23:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 21:23:28 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:23:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8791 values 138656 bits 17332 bytes 
Thu 16 Jan 2014 21:23:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:23:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:23:33 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:23:33 - job_xml_thread(): Done retrieving: data size 43825796
Thu 16 Jan 2014 21:23:33 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:23:33 - XML: Start document: iteration 14
Thu 16 Jan 2014 21:23:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:23:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:23:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:23:41 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:23:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:23:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:23:42 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:23:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:23:42 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:23:42 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:23:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:23:47 - XML: Processed 654926 elements - found 738 jobs
Thu 16 Jan 2014 21:23:48 - job 7346797 appears to have finished
Thu 16 Jan 2014 21:23:48 - job 7335185 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 21:23:48 - job 7335101 appears to have finished
Thu 16 Jan 2014 21:23:48 - job 7346814 appears to have finished
Thu 16 Jan 2014 21:23:48 - job_xml_thread(): Found 8 updated jobs.
Thu 16 Jan 2014 21:23:48 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 21:23:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:23:48 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:23:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:23:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:23:49 - job_xml_thread(): Done storing. succesfully stored: 8 jobs
Thu 16 Jan 2014 21:23:49 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:23:49 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:23:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:23:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:23:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:23:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:23:52 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:23:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43273686
Thu 16 Jan 2014 21:23:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43273686
Thu 16 Jan 2014 21:23:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:23:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:23:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:23:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:24:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:24:03 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:24:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:24:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:24:04 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:24:04 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:24:04 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:24:04 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:24:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:24:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:24:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:24:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:24:07 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:24:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 21:24:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:24:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:24:08 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:24:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:24:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:24:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:24:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:24:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:24:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:24:11 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:24:11 - job_xml_thread(): Done retrieving: data size 43250645
Thu 16 Jan 2014 21:24:11 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:24:11 - XML: Start document: iteration 15
Thu 16 Jan 2014 21:24:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43250645
Thu 16 Jan 2014 21:24:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:24:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43250645
Thu 16 Jan 2014 21:24:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:24:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:24:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:24:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:24:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:24:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:24:29 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:24:29 - XML: Processed 647474 elements - found 738 jobs
Thu 16 Jan 2014 21:24:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:24:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 21:24:29 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:24:29 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:24:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 21:24:29 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:24:29 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:24:29 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:24:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5749 values 90696 bits 11337 bytes 
Thu 16 Jan 2014 21:24:29 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:24:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:24:35 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:24:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:24:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:24:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:24:36 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:24:36 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:24:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:24:36 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:24:36 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:24:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:24:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:24:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:24:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:24:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:24:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:24:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:24:41 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:24:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43689968
Thu 16 Jan 2014 21:24:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:24:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43689968
Thu 16 Jan 2014 21:24:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:24:43 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:24:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 21:24:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:24:44 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:24:45 - job_xml_thread(): Done retrieving: data size 43689968
Thu 16 Jan 2014 21:24:45 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:24:45 - XML: Start document: iteration 16
Thu 16 Jan 2014 21:24:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:24:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:24:51 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:24:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:24:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:24:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:24:53 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:24:53 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:24:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:24:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:24:53 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:24:58 - XML: Processed 652810 elements - found 738 jobs
Thu 16 Jan 2014 21:24:58 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:24:58 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:24:58 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:24:58 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:25:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:25:01 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:25:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:25:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:25:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:25:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:25:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:25:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:25:05 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:25:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873667
Thu 16 Jan 2014 21:25:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:25:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873667
Thu 16 Jan 2014 21:25:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:25:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:25:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:25:13 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:25:13 - job_xml_thread(): Done retrieving: data size 43873667
Thu 16 Jan 2014 21:25:13 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:25:13 - XML: Start document: iteration 17
Thu 16 Jan 2014 21:25:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:25:14 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:25:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:25:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:25:15 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:25:15 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:25:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:25:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:25:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873667
Thu 16 Jan 2014 21:25:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:25:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:25:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:25:28 - XML: Processed 655674 elements - found 738 jobs
Thu 16 Jan 2014 21:25:28 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:25:28 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:25:28 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:25:28 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:25:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:25:29 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:25:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:25:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:25:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:25:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 21:25:31 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:25:31 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:25:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 21:25:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6266 values 98943 bits 12367 bytes 
Thu 16 Jan 2014 21:25:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:25:33 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:25:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:25:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:25:34 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:25:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:25:34 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:25:34 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:25:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:25:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:25:35 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:25:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:25:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:25:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:25:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:25:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:25:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:25:40 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:25:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43904870
Thu 16 Jan 2014 21:25:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:25:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43904870
Thu 16 Jan 2014 21:25:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:25:44 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:25:44 - job_xml_thread(): Done retrieving: data size 43904870
Thu 16 Jan 2014 21:25:44 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:25:44 - XML: Start document: iteration 18
Thu 16 Jan 2014 21:25:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:25:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:25:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:25:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:25:58 - XML: Processed 655672 elements - found 737 jobs
Thu 16 Jan 2014 21:25:58 - job 7346808 appears to have finished
Thu 16 Jan 2014 21:25:58 - job 7346684 appears to have finished
Thu 16 Jan 2014 21:25:58 - job 7346800 appears to have finished
Thu 16 Jan 2014 21:25:58 - job 7346832 field 'start_timestamp' changed since saved from: 1389903802 to: 1389903715
Thu 16 Jan 2014 21:25:58 - job 7346831 field 'start_timestamp' changed since saved from: 1389903800 to: 1389903715
Thu 16 Jan 2014 21:25:58 - job_xml_thread(): Found 7 updated jobs.
Thu 16 Jan 2014 21:25:58 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 21:26:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:26:01 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:26:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:26:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:26:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:26:01 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:26:01 - job_xml_thread(): Done storing. succesfully stored: 7 jobs
Thu 16 Jan 2014 21:26:01 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:26:01 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:26:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:26:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:26:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:26:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:26:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:26:01 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:26:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:26:01 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:26:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:26:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:26:01 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:26:01 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:26:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 21:26:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:26:05 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:26:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43910507
Thu 16 Jan 2014 21:26:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:26:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43910507
Thu 16 Jan 2014 21:26:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:26:16 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:26:16 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:26:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:26:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:26:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:26:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:26:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:26:17 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:26:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:26:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:26:18 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:26:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:26:18 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:26:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:26:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:26:20 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:26:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:26:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:26:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:26:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:26:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:26:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:26:23 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:26:23 - job_xml_thread(): Done retrieving: data size 43898813
Thu 16 Jan 2014 21:26:23 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:26:23 - XML: Start document: iteration 19
Thu 16 Jan 2014 21:26:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43898813
Thu 16 Jan 2014 21:26:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:26:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43898813
Thu 16 Jan 2014 21:26:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:26:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:26:31 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:26:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:26:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 21:26:32 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:26:32 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:26:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 21:26:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8908 values 140543 bits 17567 bytes 
Thu 16 Jan 2014 21:26:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:26:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:26:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:26:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:26:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:26:44 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:26:44 - XML: Processed 655672 elements - found 737 jobs
Thu 16 Jan 2014 21:26:44 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:26:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:26:44 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:26:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:26:44 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:26:44 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:26:44 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:26:44 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:26:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:26:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:26:45 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:26:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:26:48 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:26:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:26:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:26:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:26:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:26:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:26:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:26:49 - Leaving storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 21:26:49 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Thu 16 Jan 2014 21:26:49 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:26:51 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:26:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43908858
Thu 16 Jan 2014 21:26:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:26:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43908858
Thu 16 Jan 2014 21:26:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:26:59 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:26:59 - job_xml_thread(): Done retrieving: data size 43908858
Thu 16 Jan 2014 21:26:59 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:26:59 - XML: Start document: iteration 20
Thu 16 Jan 2014 21:27:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:27:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:27:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:27:02 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:27:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:27:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:27:02 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:27:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:27:02 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:27:02 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:27:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:27:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:27:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:27:10 - XML: Processed 655672 elements - found 737 jobs
Thu 16 Jan 2014 21:27:10 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:27:10 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:27:10 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:27:10 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:27:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:27:13 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:27:13 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:27:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 21:27:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:27:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:27:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:27:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:27:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:27:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:27:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:27:14 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:27:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43881754
Thu 16 Jan 2014 21:27:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:27:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43881754
Thu 16 Jan 2014 21:27:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:27:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:27:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:27:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:27:23 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:27:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:27:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:27:24 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:27:24 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:27:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:27:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43881754
Thu 16 Jan 2014 21:27:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:27:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:27:25 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:27:25 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:27:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:27:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:27:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:27:32 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:27:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:27:33 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:27:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:27:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:27:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:27:33 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:27:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 21:27:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 21:27:33 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:27:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5982 values 94431 bits 11803 bytes 
Thu 16 Jan 2014 21:27:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:27:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:27:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:27:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:27:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:27:35 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:27:38 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:27:38 - job_xml_thread(): Done retrieving: data size 43878629
Thu 16 Jan 2014 21:27:38 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:27:38 - Housekeeping: checking database for timed out jobs..
Thu 16 Jan 2014 21:27:38 - Housekeeping: Found 0 timed out jobs in database: closing entries
Thu 16 Jan 2014 21:27:38 - Housekeeping: done.
Thu 16 Jan 2014 21:27:38 - XML: Start document: iteration 0
Thu 16 Jan 2014 21:27:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43878629
Thu 16 Jan 2014 21:27:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:27:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:27:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:27:44 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:27:44 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:27:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:27:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:27:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43878629
Thu 16 Jan 2014 21:27:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:27:48 - XML: Processed 655672 elements - found 737 jobs
Thu 16 Jan 2014 21:27:48 - job 7346798 appears to have finished
Thu 16 Jan 2014 21:27:48 - job 7346805 appears to have finished
Thu 16 Jan 2014 21:27:48 - job 7346835 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 21:27:48 - job_xml_thread(): Found 5 updated jobs.
Thu 16 Jan 2014 21:27:48 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 21:27:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:27:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:27:51 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Thu 16 Jan 2014 21:27:51 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:27:51 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:27:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:27:58 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:27:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:27:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:28:00 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:28:00 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:28:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:28:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:28:00 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:28:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:28:01 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:28:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:28:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:28:02 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:28:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 21:28:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:28:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:28:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:28:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:28:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:28:03 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:28:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43908306
Thu 16 Jan 2014 21:28:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:28:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43908306
Thu 16 Jan 2014 21:28:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:28:06 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:28:06 - job_xml_thread(): Done retrieving: data size 43908306
Thu 16 Jan 2014 21:28:06 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:28:06 - XML: Start document: iteration 1
Thu 16 Jan 2014 21:28:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:28:13 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:28:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:28:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:28:16 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:28:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:28:16 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:28:16 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:28:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:28:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:28:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:28:25 - XML: Processed 655672 elements - found 737 jobs
Thu 16 Jan 2014 21:28:25 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:28:25 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:28:25 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:28:25 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:28:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:28:26 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:28:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:28:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:28:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:28:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:28:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:28:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:28:27 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:28:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43892831
Thu 16 Jan 2014 21:28:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:28:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43892831
Thu 16 Jan 2014 21:28:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:28:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:28:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:28:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:28:34 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:28:36 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:28:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:28:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 21:28:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 21:28:37 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:28:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8981 values 141744 bits 17718 bytes 
Thu 16 Jan 2014 21:28:40 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:28:40 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:28:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:28:40 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:28:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:28:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:28:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:28:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:28:42 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:28:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:28:42 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:28:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:28:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:28:42 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:28:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:28:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:28:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:28:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:28:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:28:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:28:45 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:28:45 - job_xml_thread(): Done retrieving: data size 43901893
Thu 16 Jan 2014 21:28:45 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:28:45 - XML: Start document: iteration 2
Thu 16 Jan 2014 21:28:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43901893
Thu 16 Jan 2014 21:28:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:28:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43901893
Thu 16 Jan 2014 21:28:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:28:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:28:55 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:28:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:28:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:28:57 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:28:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:28:57 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:28:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:28:57 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:28:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:28:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:29:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:29:01 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:29:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:29:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:29:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:29:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:29:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:29:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:29:03 - XML: Processed 655672 elements - found 737 jobs
Thu 16 Jan 2014 21:29:03 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:29:03 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:29:03 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:29:03 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:29:04 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:29:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 21:29:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:29:06 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:29:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43897319
Thu 16 Jan 2014 21:29:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:29:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43897319
Thu 16 Jan 2014 21:29:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:29:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:29:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:29:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:29:16 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:29:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:29:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:29:17 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:29:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:29:17 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:29:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:29:18 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:29:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:29:18 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:29:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:29:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:29:20 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:29:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:29:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:29:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:29:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:29:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:29:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:29:21 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:29:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853039
Thu 16 Jan 2014 21:29:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:29:22 - job_xml_thread(): Done retrieving: data size 43853039
Thu 16 Jan 2014 21:29:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853039
Thu 16 Jan 2014 21:29:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:29:22 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:29:22 - XML: Start document: iteration 3
Thu 16 Jan 2014 21:29:23 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Thu 16 Jan 2014 21:29:23 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:29:25 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:29:25 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:29:26 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 21:29:26 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 21:29:26 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 21:29:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:29:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:29:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:29:34 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:29:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:29:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:29:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:29:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Thu 16 Jan 2014 21:29:36 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:29:36 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:29:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:29:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:29:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:29:37 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:29:37 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:29:38 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:29:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 21:29:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:29:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 21:29:38 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:29:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8949 values 141232 bits 17654 bytes 
Thu 16 Jan 2014 21:29:43 - XML: Processed 654920 elements - found 735 jobs
Thu 16 Jan 2014 21:29:43 - job 7346782 appears to have finished
Thu 16 Jan 2014 21:29:43 - job 7346807 appears to have finished
Thu 16 Jan 2014 21:29:43 - job_xml_thread(): Found 2 updated jobs.
Thu 16 Jan 2014 21:29:43 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 21:29:44 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Thu 16 Jan 2014 21:29:44 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:29:44 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:29:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:29:45 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:29:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:29:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:29:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:29:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:29:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:29:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:29:47 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:29:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43307785
Thu 16 Jan 2014 21:29:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:29:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43307785
Thu 16 Jan 2014 21:29:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:29:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:29:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:29:59 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:29:59 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:30:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:30:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:30:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:30:02 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:30:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:30:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:30:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:30:03 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:30:03 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:30:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:30:03 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:30:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:30:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:30:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:30:03 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:30:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 21:30:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:30:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:30:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:30:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:30:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:30:05 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:30:05 - job_xml_thread(): Done retrieving: data size 43239055
Thu 16 Jan 2014 21:30:05 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:30:05 - XML: Start document: iteration 4
Thu 16 Jan 2014 21:30:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43239055
Thu 16 Jan 2014 21:30:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:30:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43239055
Thu 16 Jan 2014 21:30:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:30:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:30:18 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:30:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:30:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:30:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:30:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:30:19 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:30:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:30:19 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:30:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:30:19 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:30:21 - XML: Processed 647468 elements - found 735 jobs
Thu 16 Jan 2014 21:30:21 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:30:21 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:30:21 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:30:21 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:30:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:30:26 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:30:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:30:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:30:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:30:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:30:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:30:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:30:27 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:30:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43452195
Thu 16 Jan 2014 21:30:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:30:28 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:30:28 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:30:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43452195
Thu 16 Jan 2014 21:30:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:30:29 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:30:29 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 21:30:29 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 21:30:29 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:30:30 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 21:30:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:30:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:30:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:30:36 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:30:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:30:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:30:36 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:30:36 - job_xml_thread(): Done retrieving: data size 43452195
Thu 16 Jan 2014 21:30:37 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:30:37 - XML: Start document: iteration 5
Thu 16 Jan 2014 21:30:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:30:38 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:30:39 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:30:39 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:30:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:30:39 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:30:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:30:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:30:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 21:30:40 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:30:40 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:30:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8899 values 140434 bits 17554 bytes 
Thu 16 Jan 2014 21:30:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 21:30:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:30:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:30:46 - XML: Processed 650280 elements - found 735 jobs
Thu 16 Jan 2014 21:30:46 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:30:46 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:30:46 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:30:46 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:30:47 - size of cluster 'LISA Cluster': 624 hosts 79485 metrics 916674 values 14456633 bits 1807079 bytes 
Thu 16 Jan 2014 21:30:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:30:49 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:30:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:30:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:30:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:30:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:30:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:30:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:30:53 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:30:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43837498
Thu 16 Jan 2014 21:30:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:30:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43837498
Thu 16 Jan 2014 21:30:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:30:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:30:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:31:01 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:31:01 - job_xml_thread(): Done retrieving: data size 43837498
Thu 16 Jan 2014 21:31:01 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:31:01 - XML: Start document: iteration 6
Thu 16 Jan 2014 21:31:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:31:02 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:31:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:31:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:31:03 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:31:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:31:03 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:31:03 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:31:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:31:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:31:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:31:04 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:31:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 21:31:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:31:08 - XML: Processed 655144 elements - found 735 jobs
Thu 16 Jan 2014 21:31:08 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:31:08 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:31:08 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:31:08 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:31:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:31:11 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:31:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:31:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:31:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:31:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:31:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:31:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:31:14 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:31:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873466
Thu 16 Jan 2014 21:31:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:31:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873466
Thu 16 Jan 2014 21:31:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:31:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:31:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:31:23 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:31:23 - job_xml_thread(): Done retrieving: data size 43873466
Thu 16 Jan 2014 21:31:23 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:31:23 - XML: Start document: iteration 7
Thu 16 Jan 2014 21:31:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:31:25 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:31:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:31:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:31:26 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:31:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:31:26 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:31:26 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:31:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:31:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:31:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:31:31 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:31:31 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 21:31:33 - XML: Processed 655670 elements - found 736 jobs
Thu 16 Jan 2014 21:31:33 - job_xml_thread(): Found 1 updated jobs.
Thu 16 Jan 2014 21:31:33 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 21:31:33 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Thu 16 Jan 2014 21:31:33 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:31:33 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:31:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:31:37 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:31:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:31:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:31:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:31:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:31:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:31:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:31:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:31:40 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:31:40 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:31:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43881194
Thu 16 Jan 2014 21:31:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:31:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43881194
Thu 16 Jan 2014 21:31:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:31:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:31:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:31:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 21:31:42 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:31:42 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:31:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 21:31:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:31:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9066 values 143353 bits 17919 bytes 
Thu 16 Jan 2014 21:31:48 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:31:48 - job_xml_thread(): Done retrieving: data size 43881194
Thu 16 Jan 2014 21:31:48 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:31:49 - XML: Start document: iteration 8
Thu 16 Jan 2014 21:31:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:31:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:31:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:31:54 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:31:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:31:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:31:55 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:31:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:31:55 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:31:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:31:55 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:32:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:32:05 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:32:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:32:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:32:05 - XML: Processed 655668 elements - found 735 jobs
Thu 16 Jan 2014 21:32:05 - job 7346710 appears to have finished
Thu 16 Jan 2014 21:32:05 - job_xml_thread(): Found 1 updated jobs.
Thu 16 Jan 2014 21:32:05 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 21:32:05 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Thu 16 Jan 2014 21:32:05 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:32:05 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:32:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:32:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:32:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:32:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:32:08 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:32:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43885002
Thu 16 Jan 2014 21:32:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:32:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43885002
Thu 16 Jan 2014 21:32:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:32:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:32:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:32:20 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:32:20 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:32:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:32:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:32:21 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:32:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 21:32:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:32:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:32:26 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:32:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:32:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:32:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:32:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:32:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:32:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:32:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:32:26 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:32:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:32:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:32:27 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:32:27 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:32:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:32:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:32:29 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:32:29 - job_xml_thread(): Done retrieving: data size 43878552
Thu 16 Jan 2014 21:32:29 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:32:29 - XML: Start document: iteration 9
Thu 16 Jan 2014 21:32:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43878552
Thu 16 Jan 2014 21:32:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:32:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43878552
Thu 16 Jan 2014 21:32:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:32:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:32:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:32:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:32:42 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:32:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:32:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:32:42 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:32:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 21:32:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:32:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 21:32:42 - XML: Processed 655668 elements - found 735 jobs
Thu 16 Jan 2014 21:32:42 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:32:42 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:32:42 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:32:42 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:32:43 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:32:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6205 values 98275 bits 12284 bytes 
Thu 16 Jan 2014 21:32:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:32:47 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:32:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:32:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:32:47 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:32:47 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:32:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:32:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:32:47 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:32:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:32:53 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:32:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:32:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:32:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:32:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:32:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:32:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:32:57 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:32:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 21:32:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:32:57 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:32:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43905673
Thu 16 Jan 2014 21:32:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:32:57 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:32:58 - job_xml_thread(): Done retrieving: data size 43905673
Thu 16 Jan 2014 21:32:58 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:32:58 - XML: Start document: iteration 10
Thu 16 Jan 2014 21:32:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43905673
Thu 16 Jan 2014 21:32:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:33:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:33:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:33:08 - XML: Processed 655668 elements - found 735 jobs
Thu 16 Jan 2014 21:33:08 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:33:08 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:33:08 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:33:08 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:33:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:33:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:33:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:33:17 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:33:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:33:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:33:17 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:33:17 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:33:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:33:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:33:17 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:33:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:33:20 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:33:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:33:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:33:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:33:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:33:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:33:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:33:23 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:33:24 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:33:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43905614
Thu 16 Jan 2014 21:33:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:33:24 - job_xml_thread(): Done retrieving: data size 43905614
Thu 16 Jan 2014 21:33:24 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:33:24 - XML: Start document: iteration 11
Thu 16 Jan 2014 21:33:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43905614
Thu 16 Jan 2014 21:33:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:33:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:33:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:33:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:33:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:33:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:33:41 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:33:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:33:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:33:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:33:42 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:33:44 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:33:44 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:33:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:33:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:33:44 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:33:44 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:33:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:33:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 21:33:44 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:33:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 21:33:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99414 bits 12426 bytes 
Thu 16 Jan 2014 21:33:45 - XML: Processed 655668 elements - found 735 jobs
Thu 16 Jan 2014 21:33:45 - job 7346758 appears to have finished
Thu 16 Jan 2014 21:33:45 - job_xml_thread(): Found 2 updated jobs.
Thu 16 Jan 2014 21:33:45 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 21:33:46 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Thu 16 Jan 2014 21:33:46 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:33:46 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:33:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:33:48 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:33:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:33:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:33:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:33:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:33:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:33:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:33:52 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:33:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43902076
Thu 16 Jan 2014 21:33:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:33:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43902076
Thu 16 Jan 2014 21:33:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:33:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:33:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:34:00 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:34:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 21:34:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:34:01 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:34:02 - job_xml_thread(): Done retrieving: data size 43902076
Thu 16 Jan 2014 21:34:02 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:34:02 - XML: Start document: iteration 12
Thu 16 Jan 2014 21:34:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:34:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:34:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:34:10 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:34:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:34:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:34:10 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:34:10 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:34:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:34:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:34:10 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:34:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:34:15 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:34:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:34:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:34:16 - XML: Processed 655668 elements - found 735 jobs
Thu 16 Jan 2014 21:34:16 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:34:16 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:34:16 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:34:16 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:34:16 - Leaving storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 21:34:16 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Thu 16 Jan 2014 21:34:16 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:34:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:34:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:34:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:34:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:34:18 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:34:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43898204
Thu 16 Jan 2014 21:34:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:34:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43898204
Thu 16 Jan 2014 21:34:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:34:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:34:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:34:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:34:26 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:34:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:34:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:34:28 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:34:28 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:34:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:34:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:34:29 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:34:31 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:34:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:34:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:34:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:34:32 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:34:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:34:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:34:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:34:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:34:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:34:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:34:34 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:34:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43900162
Thu 16 Jan 2014 21:34:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:34:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43900162
Thu 16 Jan 2014 21:34:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:34:35 - job_xml_thread(): Done retrieving: data size 43900162
Thu 16 Jan 2014 21:34:35 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:34:35 - XML: Start document: iteration 13
Thu 16 Jan 2014 21:34:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:34:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:34:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:34:45 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:34:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:34:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 21:34:46 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:34:46 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:34:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 21:34:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9165 values 144741 bits 18092 bytes 
Thu 16 Jan 2014 21:34:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:34:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:34:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:34:50 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:34:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:34:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:34:51 - XML: Processed 655668 elements - found 735 jobs
Thu 16 Jan 2014 21:34:51 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:34:51 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:34:51 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:34:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:34:51 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:34:51 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:34:51 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:34:51 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:34:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:34:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:34:57 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:34:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:34:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:34:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:34:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:34:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:34:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:34:59 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:34:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 21:34:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:34:59 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:34:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43883873
Thu 16 Jan 2014 21:34:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:35:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43883873
Thu 16 Jan 2014 21:35:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:35:06 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:35:06 - job_xml_thread(): Done retrieving: data size 43883873
Thu 16 Jan 2014 21:35:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:35:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:35:07 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:35:07 - XML: Start document: iteration 14
Thu 16 Jan 2014 21:35:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:35:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:35:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:35:15 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:35:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:35:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:35:15 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:35:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:35:15 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:35:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:35:15 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:35:22 - XML: Processed 655668 elements - found 735 jobs
Thu 16 Jan 2014 21:35:22 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:35:22 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:35:22 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:35:22 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:35:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:35:23 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:35:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:35:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:35:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:35:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:35:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:35:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:35:25 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:35:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43830720
Thu 16 Jan 2014 21:35:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:35:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43830720
Thu 16 Jan 2014 21:35:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:35:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:35:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:35:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:35:33 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:35:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:35:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:35:34 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:35:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:35:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43830720
Thu 16 Jan 2014 21:35:34 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:35:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:35:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:35:37 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:35:37 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:35:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:35:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:35:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:35:44 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:35:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:35:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:35:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:35:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:35:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:35:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:35:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:35:46 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:35:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:35:46 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:35:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:35:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 21:35:47 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:35:47 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:35:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 21:35:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99150 bits 12393 bytes 
Thu 16 Jan 2014 21:35:48 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:35:48 - job_xml_thread(): Done retrieving: data size 43284024
Thu 16 Jan 2014 21:35:48 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:35:48 - XML: Start document: iteration 15
Thu 16 Jan 2014 21:35:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43284024
Thu 16 Jan 2014 21:35:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:35:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:35:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:35:50 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:35:50 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:35:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:35:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43284024
Thu 16 Jan 2014 21:35:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:35:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:36:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:36:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:36:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:36:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:36:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:36:05 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:36:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:36:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:36:06 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:36:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:36:06 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:36:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:36:06 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:36:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:36:11 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:36:12 - XML: Processed 648274 elements - found 736 jobs
Thu 16 Jan 2014 21:36:12 - job 7335186 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 21:36:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:36:12 - job 7346803 appears to have finished
Thu 16 Jan 2014 21:36:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:36:12 - job 7346709 appears to have finished
Thu 16 Jan 2014 21:36:12 - job_xml_thread(): Found 6 updated jobs.
Thu 16 Jan 2014 21:36:12 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 21:36:12 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Thu 16 Jan 2014 21:36:12 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:36:12 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:36:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:36:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:36:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:36:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:36:13 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:36:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 21:36:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:36:14 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:36:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43276548
Thu 16 Jan 2014 21:36:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:36:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43276548
Thu 16 Jan 2014 21:36:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:36:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:36:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:36:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:36:23 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:36:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:36:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:36:26 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:36:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:36:26 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:36:26 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:36:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:36:27 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:36:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:36:28 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:36:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:36:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:36:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:36:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:36:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:36:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:36:29 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:36:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43546724
Thu 16 Jan 2014 21:36:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:36:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43546724
Thu 16 Jan 2014 21:36:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:36:30 - job_xml_thread(): Done retrieving: data size 43546724
Thu 16 Jan 2014 21:36:30 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:36:31 - XML: Start document: iteration 16
Thu 16 Jan 2014 21:36:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:36:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:36:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:36:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:36:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:36:46 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:36:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:36:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:36:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:36:47 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:36:47 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:36:47 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:36:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:36:47 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:36:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:36:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:36:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 21:36:48 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:36:48 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:36:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 21:36:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7735 values 122041 bits 15255 bytes 
Thu 16 Jan 2014 21:36:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:36:52 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:36:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:36:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:36:53 - XML: Processed 651302 elements - found 736 jobs
Thu 16 Jan 2014 21:36:53 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:36:53 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:36:53 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:36:53 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:36:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:36:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:36:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:36:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:36:56 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:36:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43857048
Thu 16 Jan 2014 21:36:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:36:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43857048
Thu 16 Jan 2014 21:36:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:37:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:37:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:37:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:37:06 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:37:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:37:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:37:07 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:37:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:37:07 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:37:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:37:07 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:37:08 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:37:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:37:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:37:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:37:09 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:37:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:37:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:37:09 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:37:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 21:37:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:37:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:37:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:37:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:37:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:37:10 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:37:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43913208
Thu 16 Jan 2014 21:37:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:37:11 - job_xml_thread(): Done retrieving: data size 43913208
Thu 16 Jan 2014 21:37:11 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:37:11 - XML: Start document: iteration 17
Thu 16 Jan 2014 21:37:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43913208
Thu 16 Jan 2014 21:37:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:37:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:37:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:37:23 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:37:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:37:23 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:37:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:37:23 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:37:24 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:37:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:37:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:37:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:37:30 - XML: Processed 655668 elements - found 735 jobs
Thu 16 Jan 2014 21:37:30 - job 7335147 appears to have finished
Thu 16 Jan 2014 21:37:30 - job_xml_thread(): Found 1 updated jobs.
Thu 16 Jan 2014 21:37:30 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 21:37:30 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Thu 16 Jan 2014 21:37:30 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:37:30 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:37:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:37:31 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Thu 16 Jan 2014 21:37:31 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:37:31 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:37:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:37:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:37:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:37:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:37:32 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:37:32 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:37:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:37:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:37:32 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 21:37:32 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 21:37:32 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 21:37:33 - size of cluster 'LISA Cluster': 624 hosts 79476 metrics 855498 values 13513896 bits 1689237 bytes 
Thu 16 Jan 2014 21:37:34 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:37:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43882711
Thu 16 Jan 2014 21:37:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:37:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43882711
Thu 16 Jan 2014 21:37:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:37:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:37:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:37:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:37:42 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:37:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:37:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:37:43 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:37:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:37:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43882711
Thu 16 Jan 2014 21:37:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:37:43 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:37:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:37:45 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:37:45 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:37:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:37:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:37:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:37:48 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:37:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:37:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 21:37:49 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:37:49 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:37:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 21:37:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9120 values 144061 bits 18007 bytes 
Thu 16 Jan 2014 21:37:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:37:51 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:37:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:37:55 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:37:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:37:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:37:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:37:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:37:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:37:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:37:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:37:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:37:59 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:37:59 - job_xml_thread(): Done retrieving: data size 43885412
Thu 16 Jan 2014 21:37:59 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:37:59 - XML: Start document: iteration 18
Thu 16 Jan 2014 21:38:00 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:38:00 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:38:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43885412
Thu 16 Jan 2014 21:38:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:38:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:38:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:38:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43885412
Thu 16 Jan 2014 21:38:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:38:09 - XML: Processed 655674 elements - found 738 jobs
Thu 16 Jan 2014 21:38:09 - job 7346842 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 21:38:09 - job 7346302 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 21:38:09 - job_xml_thread(): Found 5 updated jobs.
Thu 16 Jan 2014 21:38:09 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 21:38:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:38:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:38:15 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Thu 16 Jan 2014 21:38:15 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:38:15 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:38:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:38:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:38:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:38:21 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:38:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:38:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:38:21 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:38:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:38:21 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:38:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:38:21 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:38:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:38:23 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:38:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:38:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:38:23 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:38:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 21:38:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:38:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:38:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:38:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:38:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:38:27 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:38:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43919207
Thu 16 Jan 2014 21:38:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:38:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43919207
Thu 16 Jan 2014 21:38:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:38:30 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:38:30 - job_xml_thread(): Done retrieving: data size 43919207
Thu 16 Jan 2014 21:38:30 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:38:30 - XML: Start document: iteration 19
Thu 16 Jan 2014 21:38:32 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:38:32 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 21:38:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:38:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:38:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:38:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:38:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:38:40 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:38:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:38:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:38:41 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:38:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:38:41 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:38:41 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:38:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:38:45 - XML: Processed 655674 elements - found 738 jobs
Thu 16 Jan 2014 21:38:45 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:38:45 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:38:45 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:38:45 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:38:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:38:49 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:38:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:38:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:38:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:38:49 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:38:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:38:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:38:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:38:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:38:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 21:38:50 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:38:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:38:50 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:38:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 21:38:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5745 values 90686 bits 11335 bytes 
Thu 16 Jan 2014 21:38:52 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:38:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43889789
Thu 16 Jan 2014 21:38:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:38:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43889789
Thu 16 Jan 2014 21:38:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:38:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:38:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:39:00 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:39:00 - job_xml_thread(): Done retrieving: data size 43889789
Thu 16 Jan 2014 21:39:00 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:39:00 - XML: Start document: iteration 20
Thu 16 Jan 2014 21:39:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:39:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:39:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:39:06 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:39:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:39:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:39:06 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:39:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:39:06 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:39:06 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:39:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:39:15 - XML: Processed 655674 elements - found 738 jobs
Thu 16 Jan 2014 21:39:15 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:39:15 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:39:15 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:39:15 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:39:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:39:16 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:39:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:39:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:39:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:39:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:39:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:39:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:39:18 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:39:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 21:39:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:39:20 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:39:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43869476
Thu 16 Jan 2014 21:39:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:39:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43869476
Thu 16 Jan 2014 21:39:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:39:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:39:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:39:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:39:31 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:39:31 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:39:31 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:39:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:39:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:39:31 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:39:31 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:39:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:39:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:39:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:39:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:39:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:39:35 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:39:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:39:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:39:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:39:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:39:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:39:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:39:39 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:39:39 - job_xml_thread(): Done retrieving: data size 43896487
Thu 16 Jan 2014 21:39:39 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:39:39 - Housekeeping: checking database for timed out jobs..
Thu 16 Jan 2014 21:39:39 - Housekeeping: Found 0 timed out jobs in database: closing entries
Thu 16 Jan 2014 21:39:39 - Housekeeping: done.
Thu 16 Jan 2014 21:39:39 - XML: Start document: iteration 0
Thu 16 Jan 2014 21:39:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43896487
Thu 16 Jan 2014 21:39:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43896487
Thu 16 Jan 2014 21:39:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:39:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:39:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:39:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:39:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:39:50 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:39:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:39:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:39:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:39:51 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:39:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 21:39:51 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:39:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 21:39:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7976 values 125893 bits 15736 bytes 
Thu 16 Jan 2014 21:39:55 - XML: Processed 655668 elements - found 735 jobs
Thu 16 Jan 2014 21:39:55 - job 7346844 field 'start_timestamp' changed since saved from: 1389904636 to: 1389904600
Thu 16 Jan 2014 21:39:55 - job 7346840 appears to have finished
Thu 16 Jan 2014 21:39:55 - job 7346820 appears to have finished
Thu 16 Jan 2014 21:39:55 - job 7346838 appears to have finished
Thu 16 Jan 2014 21:39:56 - job 7346248 appears to have finished
Thu 16 Jan 2014 21:39:56 - job_xml_thread(): Found 6 updated jobs.
Thu 16 Jan 2014 21:39:56 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 21:39:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:39:57 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:39:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:39:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:39:58 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Thu 16 Jan 2014 21:39:58 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:39:58 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:39:58 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:39:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:39:58 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:39:58 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:39:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:40:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:40:03 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:40:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:40:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:40:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:40:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:40:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:40:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:40:06 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:40:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43896633
Thu 16 Jan 2014 21:40:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:40:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43896633
Thu 16 Jan 2014 21:40:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:40:13 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:40:13 - job_xml_thread(): Done retrieving: data size 43896633
Thu 16 Jan 2014 21:40:13 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:40:13 - XML: Start document: iteration 1
Thu 16 Jan 2014 21:40:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:40:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:40:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:40:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:40:24 - XML: Processed 655668 elements - found 735 jobs
Thu 16 Jan 2014 21:40:24 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:40:24 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:40:25 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:40:25 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:40:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:40:26 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:40:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:40:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:40:27 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:40:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:40:27 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:40:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:40:27 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:40:28 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:40:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 21:40:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:40:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:40:30 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:40:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:40:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:40:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:40:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:40:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:40:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:40:33 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:40:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43890329
Thu 16 Jan 2014 21:40:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:40:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43890329
Thu 16 Jan 2014 21:40:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:40:40 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:40:40 - job_xml_thread(): Done retrieving: data size 43890329
Thu 16 Jan 2014 21:40:40 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:40:40 - XML: Start document: iteration 2
Thu 16 Jan 2014 21:40:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:40:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:40:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:40:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:40:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:40:49 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:40:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:40:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:40:50 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:40:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:40:50 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:40:50 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:40:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:40:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:40:52 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:40:53 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:40:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:40:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 21:40:53 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:40:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6020 values 95099 bits 11887 bytes 
Thu 16 Jan 2014 21:40:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 21:40:55 - XML: Processed 655668 elements - found 735 jobs
Thu 16 Jan 2014 21:40:55 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:40:55 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:40:55 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:40:55 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:40:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:40:56 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:40:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:40:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:40:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:40:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:40:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:40:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:41:00 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:41:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43892220
Thu 16 Jan 2014 21:41:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:41:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43892220
Thu 16 Jan 2014 21:41:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:41:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:41:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:41:11 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:41:11 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:41:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:41:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:41:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:41:12 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:41:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:41:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:41:14 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:41:14 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:41:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:41:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:41:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:41:16 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:41:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:41:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:41:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:41:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:41:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:41:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:41:17 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:41:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 21:41:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:41:21 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:41:21 - job_xml_thread(): Done retrieving: data size 43819730
Thu 16 Jan 2014 21:41:21 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:41:21 - XML: Start document: iteration 3
Thu 16 Jan 2014 21:41:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43819730
Thu 16 Jan 2014 21:41:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:41:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43819730
Thu 16 Jan 2014 21:41:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:41:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:41:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:41:31 - XML: Processed 654916 elements - found 733 jobs
Thu 16 Jan 2014 21:41:31 - job 7346842 appears to have finished
Thu 16 Jan 2014 21:41:31 - job 7346845 appears to have finished
Thu 16 Jan 2014 21:41:32 - job_xml_thread(): Found 2 updated jobs.
Thu 16 Jan 2014 21:41:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:41:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:41:32 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 21:41:34 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Thu 16 Jan 2014 21:41:34 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:41:34 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:41:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:41:44 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:41:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:41:44 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:41:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:41:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:41:44 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:41:44 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:41:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:41:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:41:44 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:41:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:41:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:41:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:41:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:41:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:41:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:41:48 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:41:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43274310
Thu 16 Jan 2014 21:41:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:41:49 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:41:49 - job_xml_thread(): Done retrieving: data size 43274310
Thu 16 Jan 2014 21:41:49 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:41:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43274310
Thu 16 Jan 2014 21:41:49 - XML: Start document: iteration 4
Thu 16 Jan 2014 21:41:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:41:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:41:53 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:41:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:41:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 21:41:54 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:41:54 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:41:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 21:41:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8884 values 140225 bits 17528 bytes 
Thu 16 Jan 2014 21:42:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:42:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:42:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:42:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:42:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:42:07 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:42:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:42:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:42:09 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:42:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:42:09 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:42:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:42:09 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:42:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:42:09 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:42:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:42:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:42:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:42:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:42:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:42:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:42:10 - XML: Processed 647900 elements - found 733 jobs
Thu 16 Jan 2014 21:42:10 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:42:10 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:42:10 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:42:10 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:42:13 - Leaving storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 21:42:13 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Thu 16 Jan 2014 21:42:13 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:42:13 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:42:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43264958
Thu 16 Jan 2014 21:42:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:42:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43264958
Thu 16 Jan 2014 21:42:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:42:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:42:24 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:42:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:42:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:42:25 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:42:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:42:25 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:42:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:42:25 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:42:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:42:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:42:25 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:42:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:42:27 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:42:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:42:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:42:27 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:42:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 21:42:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:42:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:42:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:42:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:42:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:42:29 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:42:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43423699
Thu 16 Jan 2014 21:42:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:42:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43423699
Thu 16 Jan 2014 21:42:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:42:29 - job_xml_thread(): Done retrieving: data size 43423699
Thu 16 Jan 2014 21:42:29 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:42:30 - XML: Start document: iteration 5
Thu 16 Jan 2014 21:42:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:42:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:42:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:42:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:42:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:42:44 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:42:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:42:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:42:45 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:42:45 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:42:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:42:45 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:42:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:42:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:42:52 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:42:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:42:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:42:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:42:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:42:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:42:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:42:52 - XML: Processed 649600 elements - found 733 jobs
Thu 16 Jan 2014 21:42:52 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:42:52 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:42:52 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:42:52 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:42:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:42:54 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:42:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:42:54 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:42:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 21:42:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 21:42:54 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:42:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5501 values 86847 bits 10855 bytes 
Thu 16 Jan 2014 21:42:56 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:42:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43860545
Thu 16 Jan 2014 21:42:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:42:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43860545
Thu 16 Jan 2014 21:42:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:43:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:43:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:43:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:43:06 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:43:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:43:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:43:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:43:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:43:07 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:43:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:43:07 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:43:07 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:43:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:43:07 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:43:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:43:11 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:43:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:43:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:43:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:43:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:43:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:43:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:43:12 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:43:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 21:43:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:43:13 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:43:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43900195
Thu 16 Jan 2014 21:43:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:43:13 - job_xml_thread(): Done retrieving: data size 43900195
Thu 16 Jan 2014 21:43:13 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:43:14 - XML: Start document: iteration 6
Thu 16 Jan 2014 21:43:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43900195
Thu 16 Jan 2014 21:43:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:43:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:43:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:43:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:43:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:43:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:43:31 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:43:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:43:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:43:32 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:43:33 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:43:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:43:33 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:43:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:43:33 - XML: Processed 655664 elements - found 733 jobs
Thu 16 Jan 2014 21:43:33 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:43:33 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:43:33 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:43:33 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:43:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:43:34 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:43:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:43:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:43:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:43:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:43:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:43:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:43:36 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:43:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43915052
Thu 16 Jan 2014 21:43:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:43:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43915052
Thu 16 Jan 2014 21:43:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:43:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:43:44 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:43:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:43:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:43:48 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:43:48 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:43:49 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:43:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:43:49 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:43:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:43:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:43:49 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:43:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:43:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:43:50 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:43:50 - job_xml_thread(): Done retrieving: data size 43917250
Thu 16 Jan 2014 21:43:50 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:43:50 - XML: Start document: iteration 7
Thu 16 Jan 2014 21:43:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43917250
Thu 16 Jan 2014 21:43:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:43:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:43:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:43:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:43:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43917250
Thu 16 Jan 2014 21:43:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:43:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:43:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:43:55 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:43:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:43:57 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:43:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 21:43:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 21:43:58 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:44:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 10580 values 167040 bits 20880 bytes 
Thu 16 Jan 2014 21:44:03 - XML: Processed 655664 elements - found 733 jobs
Thu 16 Jan 2014 21:44:03 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:44:03 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:44:03 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:44:03 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:44:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:44:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:44:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:44:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:44:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:44:09 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:44:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:44:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:44:10 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:44:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:44:10 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:44:10 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:44:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:44:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:44:13 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:44:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:44:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:44:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:44:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:44:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:44:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:44:15 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:44:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 21:44:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:44:16 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:44:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43891577
Thu 16 Jan 2014 21:44:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:44:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43891577
Thu 16 Jan 2014 21:44:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:44:19 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:44:19 - job_xml_thread(): Done retrieving: data size 43891577
Thu 16 Jan 2014 21:44:19 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:44:19 - XML: Start document: iteration 8
Thu 16 Jan 2014 21:44:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:44:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:44:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:44:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:44:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:44:31 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:44:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:44:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:44:32 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Thu 16 Jan 2014 21:44:33 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:44:34 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:44:34 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:44:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:44:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:44:34 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:44:34 - XML: Processed 655664 elements - found 733 jobs
Thu 16 Jan 2014 21:44:34 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:44:34 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:44:34 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 21:44:34 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:44:34 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:44:34 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 21:44:34 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:44:34 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:44:34 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Thu 16 Jan 2014 21:44:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:44:39 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:44:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:44:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:44:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:44:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:44:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:44:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:44:41 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:44:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43911626
Thu 16 Jan 2014 21:44:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:44:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43911626
Thu 16 Jan 2014 21:44:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:44:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:44:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:44:49 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:44:50 - job_xml_thread(): Done retrieving: data size 43911626
Thu 16 Jan 2014 21:44:50 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:44:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:44:50 - XML: Start document: iteration 9
Thu 16 Jan 2014 21:44:50 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:44:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:44:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:44:51 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:44:51 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:44:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:44:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43911626
Thu 16 Jan 2014 21:44:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:44:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:44:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:44:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:44:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:44:57 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:44:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:44:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 21:44:58 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:44:58 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:44:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 21:44:59 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99171 bits 12396 bytes 
Thu 16 Jan 2014 21:45:04 - XML: Processed 655664 elements - found 733 jobs
Thu 16 Jan 2014 21:45:04 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:45:04 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:45:04 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:45:04 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:45:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:45:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:45:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:45:10 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:45:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:45:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:45:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:45:11 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:45:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:45:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:45:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:45:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:45:11 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:45:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:45:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:45:12 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:45:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:45:12 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:45:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:45:14 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:45:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43911536
Thu 16 Jan 2014 21:45:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:45:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43911536
Thu 16 Jan 2014 21:45:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:45:19 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:45:19 - job_xml_thread(): Done retrieving: data size 43911536
Thu 16 Jan 2014 21:45:19 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:45:19 - XML: Start document: iteration 10
Thu 16 Jan 2014 21:45:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:45:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:45:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:45:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:45:28 - XML: Processed 655662 elements - found 732 jobs
Thu 16 Jan 2014 21:45:28 - job 7346380 appears to have finished
Thu 16 Jan 2014 21:45:28 - job_xml_thread(): Found 1 updated jobs.
Thu 16 Jan 2014 21:45:28 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 21:45:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:45:29 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:45:29 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Thu 16 Jan 2014 21:45:29 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:45:29 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:45:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:45:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:45:30 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:45:30 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:45:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:45:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:45:30 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:45:33 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:45:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 21:45:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:45:34 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:45:34 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:45:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:45:35 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:45:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:45:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:45:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:45:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:45:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:45:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:45:35 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:45:35 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 21:45:35 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 21:45:35 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:45:35 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 21:45:36 - size of cluster 'LISA Cluster': 624 hosts 79478 metrics 844885 values 13328034 bits 1666004 bytes 
Thu 16 Jan 2014 21:45:38 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:45:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43897234
Thu 16 Jan 2014 21:45:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:45:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43897234
Thu 16 Jan 2014 21:45:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:45:44 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:45:44 - job_xml_thread(): Done retrieving: data size 43897234
Thu 16 Jan 2014 21:45:44 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:45:44 - XML: Start document: iteration 11
Thu 16 Jan 2014 21:45:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:45:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:45:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:45:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:45:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:45:51 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:45:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:45:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:45:53 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:45:53 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:45:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:45:53 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:45:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:45:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:45:58 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:45:58 - XML: Processed 655664 elements - found 733 jobs
Thu 16 Jan 2014 21:45:58 - job_xml_thread(): Found 1 updated jobs.
Thu 16 Jan 2014 21:45:58 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 21:45:59 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Thu 16 Jan 2014 21:45:59 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:45:59 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:45:59 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:45:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 21:45:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:45:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 21:45:59 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:45:59 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5955 values 94062 bits 11757 bytes 
Thu 16 Jan 2014 21:46:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:46:00 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:46:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:46:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:46:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:46:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:46:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:46:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:46:04 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:46:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873438
Thu 16 Jan 2014 21:46:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:46:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873438
Thu 16 Jan 2014 21:46:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:46:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:46:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:46:14 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:46:15 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:46:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:46:15 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:46:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:46:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:46:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:46:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:46:16 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:46:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:46:16 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:46:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:46:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:46:18 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:46:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:46:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:46:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:46:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:46:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:46:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:46:19 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:46:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 21:46:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:46:22 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:46:22 - job_xml_thread(): Done retrieving: data size 43907604
Thu 16 Jan 2014 21:46:22 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:46:22 - XML: Start document: iteration 12
Thu 16 Jan 2014 21:46:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43907604
Thu 16 Jan 2014 21:46:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43907604
Thu 16 Jan 2014 21:46:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:46:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:46:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:46:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:46:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:46:32 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:46:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:46:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:46:33 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:46:33 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:46:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:46:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:46:33 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:46:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:46:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:46:36 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:46:37 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 21:46:43 - XML: Processed 655664 elements - found 733 jobs
Thu 16 Jan 2014 21:46:43 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:46:43 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:46:44 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:46:44 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:46:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:46:44 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:46:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:46:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:46:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:46:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:46:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:46:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:46:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:46:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:46:51 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:46:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865709
Thu 16 Jan 2014 21:46:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:46:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43865709
Thu 16 Jan 2014 21:46:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:46:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:46:59 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:46:59 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:46:59 - job_xml_thread(): Done retrieving: data size 43865709
Thu 16 Jan 2014 21:47:00 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:47:00 - XML: Start document: iteration 13
Thu 16 Jan 2014 21:47:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:47:00 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:47:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 21:47:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 21:47:00 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:47:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:47:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8819 values 139382 bits 17422 bytes 
Thu 16 Jan 2014 21:47:00 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:47:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:47:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:47:02 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:47:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:47:02 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:47:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:47:02 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:47:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:47:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:47:13 - XML: Processed 655664 elements - found 733 jobs
Thu 16 Jan 2014 21:47:13 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:47:13 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:47:13 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:47:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:47:13 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:47:13 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:47:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:47:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:47:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:47:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:47:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:47:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:47:16 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:47:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43876671
Thu 16 Jan 2014 21:47:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:47:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43876671
Thu 16 Jan 2014 21:47:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:47:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:47:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:47:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:47:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:47:29 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:47:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:47:29 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:47:29 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:47:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:47:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:47:30 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:47:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:47:30 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:47:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:47:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:47:33 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:47:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:47:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:47:33 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:47:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 21:47:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:47:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:47:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:47:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:47:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:47:36 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:47:36 - job_xml_thread(): Done retrieving: data size 43327749
Thu 16 Jan 2014 21:47:36 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:47:36 - XML: Start document: iteration 14
Thu 16 Jan 2014 21:47:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43327749
Thu 16 Jan 2014 21:47:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43327749
Thu 16 Jan 2014 21:47:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:47:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:47:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:47:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:47:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:47:49 - XML: Processed 648622 elements - found 733 jobs
Thu 16 Jan 2014 21:47:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:47:49 - job 7345926 appears to have finished
Thu 16 Jan 2014 21:47:49 - job 7346812 appears to have finished
Thu 16 Jan 2014 21:47:49 - job_xml_thread(): Found 4 updated jobs.
Thu 16 Jan 2014 21:47:49 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 21:47:51 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Thu 16 Jan 2014 21:47:51 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:47:51 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:47:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:47:54 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:47:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:47:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:47:55 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:47:55 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:47:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:47:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:47:55 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:47:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:47:58 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:47:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:47:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:47:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:47:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:47:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:47:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:48:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:48:00 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:48:00 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:48:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43230998
Thu 16 Jan 2014 21:48:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:48:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43230998
Thu 16 Jan 2014 21:48:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:48:02 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:48:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 21:48:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:48:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 21:48:02 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:48:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9014 values 142750 bits 17843 bytes 
Thu 16 Jan 2014 21:48:06 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:48:07 - job_xml_thread(): Done retrieving: data size 43230998
Thu 16 Jan 2014 21:48:07 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:48:07 - XML: Start document: iteration 15
Thu 16 Jan 2014 21:48:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:48:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:48:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:48:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:48:20 - XML: Processed 647464 elements - found 733 jobs
Thu 16 Jan 2014 21:48:20 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:48:20 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:48:20 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:48:20 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:48:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:48:20 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:48:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:48:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:48:22 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:48:22 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:48:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:48:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:48:22 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:48:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:48:25 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:48:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:48:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:48:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:48:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:48:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:48:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:48:29 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:48:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43380625
Thu 16 Jan 2014 21:48:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:48:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43380625
Thu 16 Jan 2014 21:48:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:48:35 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:48:35 - job_xml_thread(): Done retrieving: data size 43380625
Thu 16 Jan 2014 21:48:35 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:48:35 - XML: Start document: iteration 16
Thu 16 Jan 2014 21:48:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:48:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:48:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:48:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:48:41 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:48:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 21:48:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:48:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:48:42 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:48:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:48:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:48:43 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:48:43 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:48:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:48:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:48:43 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:48:49 - XML: Processed 649076 elements - found 733 jobs
Thu 16 Jan 2014 21:48:50 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:48:50 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:48:50 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:48:50 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:48:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:48:53 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:48:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:48:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:48:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:48:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:48:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:48:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:48:56 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:48:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43830807
Thu 16 Jan 2014 21:48:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:48:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43830807
Thu 16 Jan 2014 21:48:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:48:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:48:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:49:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:49:02 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:49:03 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:49:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:49:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 21:49:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 21:49:04 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:49:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6046 values 95481 bits 11935 bytes 
Thu 16 Jan 2014 21:49:05 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:49:05 - job_xml_thread(): Done retrieving: data size 43830807
Thu 16 Jan 2014 21:49:05 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:49:05 - XML: Start document: iteration 17
Thu 16 Jan 2014 21:49:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:49:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:49:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:49:11 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:49:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:49:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:49:14 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:49:14 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:49:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:49:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:49:14 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:49:20 - XML: Processed 654982 elements - found 733 jobs
Thu 16 Jan 2014 21:49:20 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:49:20 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:49:20 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:49:20 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:49:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:49:21 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:49:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:49:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:49:21 - Leaving storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 21:49:21 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Thu 16 Jan 2014 21:49:21 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:49:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:49:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:49:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:49:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:49:24 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:49:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 21:49:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:49:25 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:49:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43889333
Thu 16 Jan 2014 21:49:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:49:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43889333
Thu 16 Jan 2014 21:49:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:49:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:49:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:49:35 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:49:35 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:49:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:49:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:49:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:49:37 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:49:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:49:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:49:38 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:49:38 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:49:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:49:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:49:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:49:39 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:49:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:49:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:49:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:49:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:49:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:49:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:49:42 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:49:42 - job_xml_thread(): Done retrieving: data size 43908571
Thu 16 Jan 2014 21:49:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43908571
Thu 16 Jan 2014 21:49:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:49:42 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:49:42 - XML: Start document: iteration 18
Thu 16 Jan 2014 21:49:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43908571
Thu 16 Jan 2014 21:49:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:49:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:49:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:49:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:49:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:50:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:50:03 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:50:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:50:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:50:03 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:50:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:50:03 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:50:03 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:50:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:50:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:50:04 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:50:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:50:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 21:50:04 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:50:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99118 bits 12389 bytes 
Thu 16 Jan 2014 21:50:04 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:50:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 21:50:04 - XML: Processed 655658 elements - found 730 jobs
Thu 16 Jan 2014 21:50:04 - job 7346698 appears to have finished
Thu 16 Jan 2014 21:50:05 - job 7346801 appears to have finished
Thu 16 Jan 2014 21:50:05 - job 7346327 appears to have finished
Thu 16 Jan 2014 21:50:05 - job 7346850 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 21:50:05 - job 7346816 appears to have finished
Thu 16 Jan 2014 21:50:05 - job_xml_thread(): Found 6 updated jobs.
Thu 16 Jan 2014 21:50:05 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 21:50:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:50:05 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:50:05 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Thu 16 Jan 2014 21:50:05 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:50:05 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:50:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:50:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:50:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:50:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:50:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:50:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:50:08 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:50:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43908832
Thu 16 Jan 2014 21:50:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:50:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43908832
Thu 16 Jan 2014 21:50:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:50:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:50:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:50:20 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:50:20 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:50:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:50:20 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:50:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:50:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:50:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:50:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:50:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:50:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:50:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:50:22 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:50:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:50:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:50:23 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:50:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 21:50:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:50:23 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:50:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:50:23 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:50:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:50:24 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:50:24 - job_xml_thread(): Done retrieving: data size 43911088
Thu 16 Jan 2014 21:50:24 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:50:24 - XML: Start document: iteration 19
Thu 16 Jan 2014 21:50:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43911088
Thu 16 Jan 2014 21:50:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43911088
Thu 16 Jan 2014 21:50:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:50:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:50:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:50:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:50:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:50:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:50:44 - XML: Processed 655658 elements - found 730 jobs
Thu 16 Jan 2014 21:50:44 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:50:44 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:50:44 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:50:44 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:50:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:50:47 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:50:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:50:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:50:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:50:47 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:50:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:50:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:50:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:50:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:50:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:50:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:50:47 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:50:48 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:50:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:50:48 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:50:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:50:49 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:50:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43918214
Thu 16 Jan 2014 21:50:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:50:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43918214
Thu 16 Jan 2014 21:50:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:51:00 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:51:00 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:51:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:51:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:51:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:51:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:51:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:51:03 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:51:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:51:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:51:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:51:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:51:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:51:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:51:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:51:04 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:51:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:51:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:51:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:51:05 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:51:05 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:51:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:51:05 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:51:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:51:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:51:05 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:51:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 21:51:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 21:51:05 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:51:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8646 values 136430 bits 17053 bytes 
Thu 16 Jan 2014 21:51:06 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:51:06 - job_xml_thread(): Done retrieving: data size 43905568
Thu 16 Jan 2014 21:51:06 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:51:06 - XML: Start document: iteration 20
Thu 16 Jan 2014 21:51:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43905568
Thu 16 Jan 2014 21:51:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43905568
Thu 16 Jan 2014 21:51:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:51:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:51:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:51:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:51:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:51:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:51:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:51:24 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:51:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:51:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:51:24 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:51:24 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:51:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:51:24 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:51:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:51:26 - XML: Processed 655658 elements - found 730 jobs
Thu 16 Jan 2014 21:51:26 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:51:26 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:51:26 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:51:26 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:51:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:51:29 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:51:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:51:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:51:30 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:51:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 21:51:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:51:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:51:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:51:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:51:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:51:31 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:51:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43884061
Thu 16 Jan 2014 21:51:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:51:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43884061
Thu 16 Jan 2014 21:51:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:51:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:51:41 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:51:41 - job_xml_thread(): Done retrieving: data size 43884061
Thu 16 Jan 2014 21:51:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:51:41 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:51:41 - Housekeeping: checking database for timed out jobs..
Thu 16 Jan 2014 21:51:41 - Housekeeping: Found 0 timed out jobs in database: closing entries
Thu 16 Jan 2014 21:51:41 - Housekeeping: done.
Thu 16 Jan 2014 21:51:41 - XML: Start document: iteration 0
Thu 16 Jan 2014 21:51:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:51:42 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:51:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:51:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:51:42 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:51:42 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:51:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:51:42 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:51:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:51:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:51:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:51:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:51:50 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:51:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:51:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:51:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:51:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:51:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:51:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:51:51 - XML: Processed 655660 elements - found 731 jobs
Thu 16 Jan 2014 21:51:51 - job 7343617 appears to have finished
Thu 16 Jan 2014 21:51:51 - job_xml_thread(): Found 3 updated jobs.
Thu 16 Jan 2014 21:51:51 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 21:51:51 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Thu 16 Jan 2014 21:51:51 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:51:51 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:51:53 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:51:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43893136
Thu 16 Jan 2014 21:51:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:51:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43893136
Thu 16 Jan 2014 21:51:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:51:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:51:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:52:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:52:05 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:52:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:52:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:52:06 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:52:06 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:52:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:52:07 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:52:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 21:52:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 21:52:07 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:52:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:52:08 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:52:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7668 values 120997 bits 15124 bytes 
Thu 16 Jan 2014 21:52:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:52:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:52:09 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:52:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:52:09 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:52:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:52:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:52:09 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:52:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:52:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:52:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:52:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:52:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:52:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:52:12 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:52:12 - job_xml_thread(): Done retrieving: data size 43915493
Thu 16 Jan 2014 21:52:12 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:52:12 - XML: Start document: iteration 1
Thu 16 Jan 2014 21:52:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43915493
Thu 16 Jan 2014 21:52:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:52:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43915493
Thu 16 Jan 2014 21:52:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:52:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:52:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:52:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:52:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:52:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:52:27 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:52:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:52:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:52:28 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:52:28 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:52:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:52:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:52:28 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:52:29 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:52:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 21:52:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:52:31 - XML: Processed 655659 elements - found 731 jobs
Thu 16 Jan 2014 21:52:32 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:52:32 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:52:32 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:52:32 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:52:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:52:34 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:52:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:52:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:52:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:52:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:52:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:52:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:52:36 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:52:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43896091
Thu 16 Jan 2014 21:52:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:52:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43896091
Thu 16 Jan 2014 21:52:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:52:38 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Thu 16 Jan 2014 21:52:38 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:52:39 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:52:39 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:52:39 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 21:52:39 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 21:52:40 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 21:52:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:52:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:52:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:52:46 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:52:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:52:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:52:47 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:52:47 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:52:47 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:52:47 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:52:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:52:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:52:49 - size of cluster 'LISA Cluster': 624 hosts 79470 metrics 845797 values 13358087 bits 1669760 bytes 
Thu 16 Jan 2014 21:52:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:52:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:52:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:52:53 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:52:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:52:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:52:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:52:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:52:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:52:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:52:55 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:52:55 - job_xml_thread(): Done retrieving: data size 43903899
Thu 16 Jan 2014 21:52:55 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:52:55 - XML: Start document: iteration 2
Thu 16 Jan 2014 21:52:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43903899
Thu 16 Jan 2014 21:52:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43903899
Thu 16 Jan 2014 21:52:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:52:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:53:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:53:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:53:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:53:07 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:53:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:53:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:53:09 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:53:10 - XML: Processed 655660 elements - found 731 jobs
Thu 16 Jan 2014 21:53:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 21:53:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:53:10 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:53:10 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:53:10 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:53:10 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:53:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 21:53:10 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:53:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9036 values 142619 bits 17827 bytes 
Thu 16 Jan 2014 21:53:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:53:13 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:53:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:53:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:53:14 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:53:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:53:14 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:53:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:53:14 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:53:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:53:19 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:53:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:53:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:53:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:53:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:53:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:53:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:53:22 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:53:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43834413
Thu 16 Jan 2014 21:53:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:53:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43834413
Thu 16 Jan 2014 21:53:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:53:25 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:53:25 - job_xml_thread(): Done retrieving: data size 43834413
Thu 16 Jan 2014 21:53:25 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:53:25 - XML: Start document: iteration 3
Thu 16 Jan 2014 21:53:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:53:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:53:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:53:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:53:38 - XML: Processed 654960 elements - found 755 jobs
Thu 16 Jan 2014 21:53:39 - job 7346843 appears to have finished
Thu 16 Jan 2014 21:53:39 - job 7346828 appears to have finished
Thu 16 Jan 2014 21:53:39 - job 7346097 report time 1389905450 does not match current heartbeat 1389905570 : ignoring job
Thu 16 Jan 2014 21:53:39 - job 7337272 report time 1389905450 does not match current heartbeat 1389905570 : ignoring job
Thu 16 Jan 2014 21:53:39 - job 7338025 report time 1389905450 does not match current heartbeat 1389905570 : ignoring job
Thu 16 Jan 2014 21:53:39 - job 7346824 appears to have finished
Thu 16 Jan 2014 21:53:39 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:53:39 - job 7335198 report time 1389905450 does not match current heartbeat 1389905570 : ignoring job
Thu 16 Jan 2014 21:53:39 - job 7340972 report time 1389905450 does not match current heartbeat 1389905570 : ignoring job
Thu 16 Jan 2014 21:53:39 - job 7337799 report time 1389905450 does not match current heartbeat 1389905570 : ignoring job
Thu 16 Jan 2014 21:53:39 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 21:53:39 - job 7344657 report time 1389905450 does not match current heartbeat 1389905570 : ignoring job
Thu 16 Jan 2014 21:53:39 - job 7335424 report time 1389905450 does not match current heartbeat 1389905570 : ignoring job
Thu 16 Jan 2014 21:53:39 - job 7335423 report time 1389905450 does not match current heartbeat 1389905570 : ignoring job
Thu 16 Jan 2014 21:53:39 - job 7335422 report time 1389905450 does not match current heartbeat 1389905570 : ignoring job
Thu 16 Jan 2014 21:53:39 - job 7335421 report time 1389905450 does not match current heartbeat 1389905570 : ignoring job
Thu 16 Jan 2014 21:53:39 - job 7337400 report time 1389905450 does not match current heartbeat 1389905570 : ignoring job
Thu 16 Jan 2014 21:53:40 - job 7335197 report time 1389905450 does not match current heartbeat 1389905570 : ignoring job
Thu 16 Jan 2014 21:53:40 - job 7335196 report time 1389905450 does not match current heartbeat 1389905570 : ignoring job
Thu 16 Jan 2014 21:53:40 - job 7335195 report time 1389905450 does not match current heartbeat 1389905570 : ignoring job
Thu 16 Jan 2014 21:53:40 - job 7335194 report time 1389905450 does not match current heartbeat 1389905570 : ignoring job
Thu 16 Jan 2014 21:53:40 - job 7335193 report time 1389905450 does not match current heartbeat 1389905570 : ignoring job
Thu 16 Jan 2014 21:53:40 - job 7335192 report time 1389905450 does not match current heartbeat 1389905570 : ignoring job
Thu 16 Jan 2014 21:53:40 - job 7335191 report time 1389905450 does not match current heartbeat 1389905570 : ignoring job
Thu 16 Jan 2014 21:53:40 - job 7336879 report time 1389905450 does not match current heartbeat 1389905570 : ignoring job
Thu 16 Jan 2014 21:53:40 - job 7335199 report time 1389905450 does not match current heartbeat 1389905570 : ignoring job
Thu 16 Jan 2014 21:53:40 - job_xml_thread(): Found 30 updated jobs.
Thu 16 Jan 2014 21:53:40 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 21:53:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:53:42 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:53:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:53:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:53:43 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:53:43 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:53:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:53:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:53:43 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:53:45 - job_xml_thread(): Done storing. succesfully stored: 30 jobs
Thu 16 Jan 2014 21:53:45 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:53:45 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:53:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:53:47 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:53:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:53:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:53:47 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:53:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 21:53:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:53:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:53:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:53:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:53:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:53:51 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:53:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43296195
Thu 16 Jan 2014 21:53:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:53:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43296195
Thu 16 Jan 2014 21:53:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:53:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:53:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:54:00 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:54:00 - job_xml_thread(): Done retrieving: data size 43296195
Thu 16 Jan 2014 21:54:00 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:54:00 - XML: Start document: iteration 4
Thu 16 Jan 2014 21:54:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:54:01 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:54:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:54:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:54:02 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:54:02 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:54:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:54:02 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:54:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:54:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:54:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:54:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:54:10 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:54:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:54:10 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:54:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 21:54:10 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:54:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 21:54:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5649 values 89072 bits 11134 bytes 
Thu 16 Jan 2014 21:54:12 - XML: Processed 648150 elements - found 755 jobs
Thu 16 Jan 2014 21:54:12 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:54:12 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:54:12 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:54:12 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:54:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:54:13 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:54:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:54:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:54:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:54:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:54:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:54:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:54:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:54:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:54:17 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:54:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43271497
Thu 16 Jan 2014 21:54:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:54:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43271497
Thu 16 Jan 2014 21:54:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:54:27 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:54:27 - job_xml_thread(): Done retrieving: data size 43271497
Thu 16 Jan 2014 21:54:27 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:54:27 - XML: Start document: iteration 5
Thu 16 Jan 2014 21:54:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:54:28 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:54:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:54:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:54:29 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:54:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:54:29 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:54:29 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:54:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:54:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:54:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:54:40 - XML: Processed 648170 elements - found 755 jobs
Thu 16 Jan 2014 21:54:40 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:54:40 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:54:40 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:54:40 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:54:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:54:42 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:54:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:54:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:54:42 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:54:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 21:54:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:54:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:54:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:54:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:54:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:54:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:54:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:54:45 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:54:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43784861
Thu 16 Jan 2014 21:54:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:54:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43784861
Thu 16 Jan 2014 21:54:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:54:55 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:54:55 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:54:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:54:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:55:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:55:01 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:55:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:55:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:55:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:55:01 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:55:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:55:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:55:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:55:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:55:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:55:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:55:02 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:55:02 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:55:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:55:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:55:05 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:55:05 - job_xml_thread(): Done retrieving: data size 43895754
Thu 16 Jan 2014 21:55:05 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:55:05 - XML: Start document: iteration 6
Thu 16 Jan 2014 21:55:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43895754
Thu 16 Jan 2014 21:55:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43895754
Thu 16 Jan 2014 21:55:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:55:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:55:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:55:11 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:55:11 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:55:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:55:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 21:55:11 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:55:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 21:55:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8708 values 137390 bits 17173 bytes 
Thu 16 Jan 2014 21:55:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:55:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:55:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:55:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:55:20 - XML: Processed 655708 elements - found 755 jobs
Thu 16 Jan 2014 21:55:20 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:55:20 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:55:20 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:55:20 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:55:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:55:27 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:55:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:55:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:55:28 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:55:28 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:55:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:55:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:55:28 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:55:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:55:29 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:55:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:55:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:55:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:55:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:55:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:55:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:55:32 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:55:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43944186
Thu 16 Jan 2014 21:55:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:55:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43944186
Thu 16 Jan 2014 21:55:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:55:35 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:55:35 - job_xml_thread(): Done retrieving: data size 43944186
Thu 16 Jan 2014 21:55:35 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:55:35 - XML: Start document: iteration 7
Thu 16 Jan 2014 21:55:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:55:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:55:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:55:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:55:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:55:49 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:55:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:55:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:55:51 - XML: Processed 655868 elements - found 835 jobs
Thu 16 Jan 2014 21:55:51 - job 7346915 report time 1389905570 does not match current heartbeat 1389905691 : ignoring job
Thu 16 Jan 2014 21:55:51 - job 7346917 report time 1389905570 does not match current heartbeat 1389905691 : ignoring job
Thu 16 Jan 2014 21:55:51 - job 7346920 report time 1389905570 does not match current heartbeat 1389905691 : ignoring job
Thu 16 Jan 2014 21:55:51 - job 7346922 report time 1389905570 does not match current heartbeat 1389905691 : ignoring job
Thu 16 Jan 2014 21:55:51 - job 7346923 report time 1389905570 does not match current heartbeat 1389905691 : ignoring job
Thu 16 Jan 2014 21:55:51 - job 7346924 report time 1389905570 does not match current heartbeat 1389905691 : ignoring job
Thu 16 Jan 2014 21:55:53 - job 7346916 report time 1389905570 does not match current heartbeat 1389905691 : ignoring job
Thu 16 Jan 2014 21:55:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:55:53 - job 7346921 report time 1389905570 does not match current heartbeat 1389905691 : ignoring job
Thu 16 Jan 2014 21:55:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:55:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:55:53 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:55:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:55:54 - job 7346925 report time 1389905570 does not match current heartbeat 1389905691 : ignoring job
Thu 16 Jan 2014 21:55:54 - job 7346926 report time 1389905570 does not match current heartbeat 1389905691 : ignoring job
Thu 16 Jan 2014 21:55:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:55:54 - job 7346927 report time 1389905570 does not match current heartbeat 1389905691 : ignoring job
Thu 16 Jan 2014 21:55:54 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:55:54 - job 7346919 report time 1389905570 does not match current heartbeat 1389905691 : ignoring job
Thu 16 Jan 2014 21:55:54 - job 7346918 report time 1389905570 does not match current heartbeat 1389905691 : ignoring job
Thu 16 Jan 2014 21:55:54 - job 7346928 report time 1389905570 does not match current heartbeat 1389905691 : ignoring job
Thu 16 Jan 2014 21:55:54 - job 7346929 report time 1389905570 does not match current heartbeat 1389905691 : ignoring job
Thu 16 Jan 2014 21:55:54 - job 7346931 report time 1389905570 does not match current heartbeat 1389905691 : ignoring job
Thu 16 Jan 2014 21:55:54 - job 7346930 report time 1389905570 does not match current heartbeat 1389905691 : ignoring job
Thu 16 Jan 2014 21:55:54 - job_xml_thread(): Found 80 updated jobs.
Thu 16 Jan 2014 21:55:54 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 21:55:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:55:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:55:55 - job_xml_thread(): Done storing. succesfully stored: 80 jobs
Thu 16 Jan 2014 21:55:55 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:55:55 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:55:55 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:55:55 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:55:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:55:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:55:56 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:55:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 21:55:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:55:58 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:55:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43935051
Thu 16 Jan 2014 21:55:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:55:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43935051
Thu 16 Jan 2014 21:55:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:56:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:56:08 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:56:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:56:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:56:10 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:56:10 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:56:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:56:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:56:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:56:11 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:56:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:56:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:56:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:56:11 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:56:12 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:56:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:56:12 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:56:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:56:12 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:56:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 21:56:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:56:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 21:56:12 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:56:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5468 values 86203 bits 10775 bytes 
Thu 16 Jan 2014 21:56:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:56:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:56:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:56:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:56:15 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:56:15 - job_xml_thread(): Done retrieving: data size 43941859
Thu 16 Jan 2014 21:56:15 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:56:15 - XML: Start document: iteration 8
Thu 16 Jan 2014 21:56:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43941859
Thu 16 Jan 2014 21:56:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:56:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43941859
Thu 16 Jan 2014 21:56:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:56:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:56:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:56:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:56:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:56:30 - XML: Processed 655865 elements - found 835 jobs
Thu 16 Jan 2014 21:56:30 - job 7346915 report time 1389905570 does not match current heartbeat 1389905691 : ignoring job
Thu 16 Jan 2014 21:56:30 - job 7346917 report time 1389905570 does not match current heartbeat 1389905691 : ignoring job
Thu 16 Jan 2014 21:56:30 - job 7346920 report time 1389905570 does not match current heartbeat 1389905691 : ignoring job
Thu 16 Jan 2014 21:56:30 - job 7346922 report time 1389905570 does not match current heartbeat 1389905691 : ignoring job
Thu 16 Jan 2014 21:56:30 - job 7346923 report time 1389905570 does not match current heartbeat 1389905691 : ignoring job
Thu 16 Jan 2014 21:56:30 - job 7346924 report time 1389905570 does not match current heartbeat 1389905691 : ignoring job
Thu 16 Jan 2014 21:56:31 - job 7346916 report time 1389905570 does not match current heartbeat 1389905691 : ignoring job
Thu 16 Jan 2014 21:56:31 - job 7346921 report time 1389905570 does not match current heartbeat 1389905691 : ignoring job
Thu 16 Jan 2014 21:56:31 - job 7346925 report time 1389905570 does not match current heartbeat 1389905691 : ignoring job
Thu 16 Jan 2014 21:56:31 - job 7346926 report time 1389905570 does not match current heartbeat 1389905691 : ignoring job
Thu 16 Jan 2014 21:56:31 - job 7346927 report time 1389905570 does not match current heartbeat 1389905691 : ignoring job
Thu 16 Jan 2014 21:56:31 - job 7346919 report time 1389905570 does not match current heartbeat 1389905691 : ignoring job
Thu 16 Jan 2014 21:56:31 - job 7346918 report time 1389905570 does not match current heartbeat 1389905691 : ignoring job
Thu 16 Jan 2014 21:56:32 - job 7346928 report time 1389905570 does not match current heartbeat 1389905691 : ignoring job
Thu 16 Jan 2014 21:56:32 - job 7346929 report time 1389905570 does not match current heartbeat 1389905691 : ignoring job
Thu 16 Jan 2014 21:56:32 - job 7346931 report time 1389905570 does not match current heartbeat 1389905691 : ignoring job
Thu 16 Jan 2014 21:56:32 - job 7346930 report time 1389905570 does not match current heartbeat 1389905691 : ignoring job
Thu 16 Jan 2014 21:56:32 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:56:32 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:56:32 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:56:33 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:56:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:56:34 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:56:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:56:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:56:36 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:56:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:56:36 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:56:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:56:36 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:56:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:56:38 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:56:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:56:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:56:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:56:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:56:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:56:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:56:39 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:56:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 21:56:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:56:41 - Leaving storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 21:56:41 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Thu 16 Jan 2014 21:56:41 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:56:41 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:56:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43940277
Thu 16 Jan 2014 21:56:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:56:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43940277
Thu 16 Jan 2014 21:56:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:56:48 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:56:48 - job_xml_thread(): Done retrieving: data size 43940277
Thu 16 Jan 2014 21:56:48 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:56:48 - XML: Start document: iteration 9
Thu 16 Jan 2014 21:56:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:56:50 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:56:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:56:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:56:53 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:56:53 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:56:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:56:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:56:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:56:53 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:56:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:56:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:56:59 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:57:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:57:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:57:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:57:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:57:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:57:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:57:02 - XML: Processed 655868 elements - found 835 jobs
Thu 16 Jan 2014 21:57:02 - job 7346915 report time 1389905570 does not match current heartbeat 1389905691 : ignoring job
Thu 16 Jan 2014 21:57:02 - job 7346917 report time 1389905570 does not match current heartbeat 1389905691 : ignoring job
Thu 16 Jan 2014 21:57:02 - job 7346920 report time 1389905570 does not match current heartbeat 1389905691 : ignoring job
Thu 16 Jan 2014 21:57:02 - job 7346922 report time 1389905570 does not match current heartbeat 1389905691 : ignoring job
Thu 16 Jan 2014 21:57:02 - job 7346923 report time 1389905570 does not match current heartbeat 1389905691 : ignoring job
Thu 16 Jan 2014 21:57:02 - job 7346924 report time 1389905570 does not match current heartbeat 1389905691 : ignoring job
Thu 16 Jan 2014 21:57:02 - job 7346916 report time 1389905570 does not match current heartbeat 1389905691 : ignoring job
Thu 16 Jan 2014 21:57:02 - job 7346921 report time 1389905570 does not match current heartbeat 1389905691 : ignoring job
Thu 16 Jan 2014 21:57:02 - job 7346925 report time 1389905570 does not match current heartbeat 1389905691 : ignoring job
Thu 16 Jan 2014 21:57:02 - job 7346926 report time 1389905570 does not match current heartbeat 1389905691 : ignoring job
Thu 16 Jan 2014 21:57:02 - job 7346927 report time 1389905570 does not match current heartbeat 1389905691 : ignoring job
Thu 16 Jan 2014 21:57:02 - job 7346919 report time 1389905570 does not match current heartbeat 1389905691 : ignoring job
Thu 16 Jan 2014 21:57:02 - job 7346918 report time 1389905570 does not match current heartbeat 1389905691 : ignoring job
Thu 16 Jan 2014 21:57:02 - job 7346928 report time 1389905570 does not match current heartbeat 1389905691 : ignoring job
Thu 16 Jan 2014 21:57:02 - job 7346929 report time 1389905570 does not match current heartbeat 1389905691 : ignoring job
Thu 16 Jan 2014 21:57:02 - job 7346931 report time 1389905570 does not match current heartbeat 1389905691 : ignoring job
Thu 16 Jan 2014 21:57:02 - job 7346930 report time 1389905570 does not match current heartbeat 1389905691 : ignoring job
Thu 16 Jan 2014 21:57:02 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:57:02 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:57:02 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:57:02 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:57:04 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:57:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43932764
Thu 16 Jan 2014 21:57:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:57:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43932764
Thu 16 Jan 2014 21:57:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:57:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:57:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:57:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:57:12 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:57:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:57:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 21:57:13 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:57:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 21:57:13 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:57:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8514 values 134352 bits 16794 bytes 
Thu 16 Jan 2014 21:57:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:57:14 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:57:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:57:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:57:15 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:57:15 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:57:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:57:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:57:15 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:57:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:57:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:57:17 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:57:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:57:19 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:57:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:57:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:57:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:57:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:57:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:57:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:57:21 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:57:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43934608
Thu 16 Jan 2014 21:57:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:57:21 - job_xml_thread(): Done retrieving: data size 43934608
Thu 16 Jan 2014 21:57:22 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:57:22 - XML: Start document: iteration 10
Thu 16 Jan 2014 21:57:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43934608
Thu 16 Jan 2014 21:57:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:57:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:57:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:57:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:57:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:57:41 - XML: Processed 655810 elements - found 806 jobs
Thu 16 Jan 2014 21:57:41 - job 7346908 appears to have finished
Thu 16 Jan 2014 21:57:41 - job 7346909 appears to have finished
Thu 16 Jan 2014 21:57:41 - job 7346907 appears to have finished
Thu 16 Jan 2014 21:57:41 - job 7346905 appears to have finished
Thu 16 Jan 2014 21:57:41 - job 7346906 appears to have finished
Thu 16 Jan 2014 21:57:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:57:42 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:57:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:57:42 - job 7346806 appears to have finished
Thu 16 Jan 2014 21:57:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:57:42 - job 7346914 appears to have finished
Thu 16 Jan 2014 21:57:42 - job 7346910 appears to have finished
Thu 16 Jan 2014 21:57:42 - job 7346913 appears to have finished
Thu 16 Jan 2014 21:57:42 - job 7346912 appears to have finished
Thu 16 Jan 2014 21:57:42 - job 7346911 appears to have finished
Thu 16 Jan 2014 21:57:42 - job 7346817 appears to have finished
Thu 16 Jan 2014 21:57:42 - job_xml_thread(): Found 12 updated jobs.
Thu 16 Jan 2014 21:57:42 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 21:57:42 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:57:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:57:42 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:57:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:57:42 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:57:44 - job_xml_thread(): Done storing. succesfully stored: 12 jobs
Thu 16 Jan 2014 21:57:44 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:57:44 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:57:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:57:45 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:57:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:57:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:57:46 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:57:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 21:57:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:57:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:57:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:57:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:57:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:57:47 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:57:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43942422
Thu 16 Jan 2014 21:57:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:57:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43942422
Thu 16 Jan 2014 21:57:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:57:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:57:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:57:59 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:58:00 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:58:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:58:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:58:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:58:01 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:58:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:58:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:58:03 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:58:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:58:03 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:58:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:58:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:58:03 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:58:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:58:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:58:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:58:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:58:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:58:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:58:05 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:58:05 - job_xml_thread(): Done retrieving: data size 43954174
Thu 16 Jan 2014 21:58:05 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:58:05 - XML: Start document: iteration 11
Thu 16 Jan 2014 21:58:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43954174
Thu 16 Jan 2014 21:58:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43954174
Thu 16 Jan 2014 21:58:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:58:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:58:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:58:13 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:58:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:58:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 21:58:14 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:58:14 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:58:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 21:58:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8646 values 136384 bits 17048 bytes 
Thu 16 Jan 2014 21:58:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:58:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:58:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:58:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:58:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:58:21 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:58:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:58:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:58:23 - XML: Processed 655814 elements - found 808 jobs
Thu 16 Jan 2014 21:58:23 - job 7346936 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 21:58:23 - job 7346938 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 21:58:23 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:58:23 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:58:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:58:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:58:23 - job 7346941 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 21:58:23 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:58:23 - job 7346940 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 21:58:23 - job 7346946 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 21:58:23 - job 7346945 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 21:58:23 - job 7346943 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 21:58:23 - job 7346948 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 21:58:23 - job 7346949 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 21:58:23 - job 7346950 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 21:58:23 - job 7346947 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 21:58:23 - job 7346942 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 21:58:23 - job 7346937 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 21:58:23 - job 7346935 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 21:58:23 - job 7346934 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 21:58:23 - job 7346939 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 21:58:23 - job 7346944 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 21:58:23 - job_xml_thread(): Found 19 updated jobs.
Thu 16 Jan 2014 21:58:23 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 21:58:25 - job_xml_thread(): Done storing. succesfully stored: 19 jobs
Thu 16 Jan 2014 21:58:25 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:58:25 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:58:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:58:27 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:58:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:58:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:58:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:58:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:58:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:58:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:58:30 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:58:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43922593
Thu 16 Jan 2014 21:58:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:58:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43922593
Thu 16 Jan 2014 21:58:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:58:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:58:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:58:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:58:40 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:58:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:58:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:58:40 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:58:40 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:58:41 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:58:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:58:41 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:58:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:58:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:58:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:58:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:58:45 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:58:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:58:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:58:45 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:58:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 21:58:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:58:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:58:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:58:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:58:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:58:47 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:58:47 - job_xml_thread(): Done retrieving: data size 43932672
Thu 16 Jan 2014 21:58:47 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:58:47 - XML: Start document: iteration 12
Thu 16 Jan 2014 21:58:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43932672
Thu 16 Jan 2014 21:58:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:58:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43932672
Thu 16 Jan 2014 21:58:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:58:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:58:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:59:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:59:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:59:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:59:05 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:59:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:59:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:59:06 - XML: Processed 655814 elements - found 808 jobs
Thu 16 Jan 2014 21:59:06 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 21:59:06 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 21:59:06 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:59:07 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:59:09 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:59:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:59:09 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:59:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:59:09 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:59:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:59:09 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:59:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:59:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:59:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:59:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:59:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:59:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:59:11 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:59:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43877099
Thu 16 Jan 2014 21:59:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:59:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43877099
Thu 16 Jan 2014 21:59:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:59:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:59:15 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:59:15 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:59:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:59:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 21:59:15 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:59:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8859 values 139765 bits 17470 bytes 
Thu 16 Jan 2014 21:59:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 21:59:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:59:21 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:59:22 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 21:59:22 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:59:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:59:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:59:24 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:59:24 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:59:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:59:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:59:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:59:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:59:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:59:26 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:59:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:59:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:59:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:59:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:59:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:59:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:59:28 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 21:59:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 21:59:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:59:28 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:59:28 - job_xml_thread(): Done retrieving: data size 43851751
Thu 16 Jan 2014 21:59:28 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 21:59:28 - XML: Start document: iteration 13
Thu 16 Jan 2014 21:59:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851751
Thu 16 Jan 2014 21:59:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851751
Thu 16 Jan 2014 21:59:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:59:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:59:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:59:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:59:40 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Thu 16 Jan 2014 21:59:40 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:59:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 21:59:40 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 21:59:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 21:59:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 21:59:41 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:59:41 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 21:59:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 21:59:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 21:59:41 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 21:59:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 21:59:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 21:59:43 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:59:43 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:59:43 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 21:59:43 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 21:59:43 - Entering storeMetrics(): cluster LISA Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Thu 16 Jan 2014 21:59:49 - XML: Processed 655061 elements - found 808 jobs
Thu 16 Jan 2014 21:59:50 - job 7346804 appears to have finished
Thu 16 Jan 2014 21:59:50 - job 7346951 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 21:59:50 - job 7346952 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 21:59:50 - job 7346535 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 21:59:50 - job_xml_thread(): Found 5 updated jobs.
Thu 16 Jan 2014 21:59:50 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 21:59:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 21:59:52 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 21:59:52 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Thu 16 Jan 2014 21:59:52 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 21:59:52 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 21:59:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 21:59:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 21:59:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:59:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 21:59:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 21:59:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 21:59:54 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 21:59:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43295590
Thu 16 Jan 2014 21:59:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 21:59:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43295590
Thu 16 Jan 2014 21:59:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 21:59:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 21:59:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:00:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:00:04 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:00:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:00:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:00:06 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:00:06 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:00:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:00:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:00:06 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:00:08 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:00:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:00:08 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:00:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:00:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:00:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:00:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:00:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:00:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:00:10 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:00:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43284573
Thu 16 Jan 2014 22:00:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:00:10 - job_xml_thread(): Done retrieving: data size 43284573
Thu 16 Jan 2014 22:00:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43284573
Thu 16 Jan 2014 22:00:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:00:10 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:00:10 - XML: Start document: iteration 14
Thu 16 Jan 2014 22:00:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:00:16 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:00:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:00:19 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:00:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 22:00:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 22:00:19 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:00:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148643 bits 18580 bytes 
Thu 16 Jan 2014 22:00:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:00:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:00:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:00:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:00:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:00:24 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:00:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:00:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:00:25 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:00:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:00:25 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:00:25 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:00:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:00:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:00:27 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:00:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:00:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:00:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:00:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:00:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:00:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:00:32 - XML: Processed 647674 elements - found 808 jobs
Thu 16 Jan 2014 22:00:32 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:00:32 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:00:32 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:00:32 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:00:33 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:00:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43402833
Thu 16 Jan 2014 22:00:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:00:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43402833
Thu 16 Jan 2014 22:00:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:00:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:00:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:00:41 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:00:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:00:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:00:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:00:43 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:00:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:00:43 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:00:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:00:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:00:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43402833
Thu 16 Jan 2014 22:00:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:00:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:00:43 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:00:43 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:00:45 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:00:45 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 22:00:45 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 22:00:45 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:00:45 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 22:00:47 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:00:47 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:00:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:00:51 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:00:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:00:53 - ganglia_parse_thread(): finished: LISA Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Thu 16 Jan 2014 22:00:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:00:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:00:53 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:00:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 22:00:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:00:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:00:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:00:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:00:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:00:54 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:00:54 - job_xml_thread(): Done retrieving: data size 43866320
Thu 16 Jan 2014 22:00:54 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:00:54 - XML: Start document: iteration 15
Thu 16 Jan 2014 22:00:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43866320
Thu 16 Jan 2014 22:00:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:00:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:00:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:01:00 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:01:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:01:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43866320
Thu 16 Jan 2014 22:01:00 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:01:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:01:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:01:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:01:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:01:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:01:14 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:01:14 - XML: Processed 655008 elements - found 808 jobs
Thu 16 Jan 2014 22:01:14 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:01:14 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:01:15 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:01:15 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:01:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:01:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:01:16 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:01:16 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:01:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:01:16 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:01:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:01:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:01:17 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:01:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:01:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:01:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:01:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:01:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:01:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:01:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:01:19 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:01:20 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:01:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:01:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 22:01:20 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:01:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 22:01:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5944 values 93831 bits 11728 bytes 
Thu 16 Jan 2014 22:01:21 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:01:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43936687
Thu 16 Jan 2014 22:01:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:01:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43936687
Thu 16 Jan 2014 22:01:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:01:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:01:30 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:01:30 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:01:30 - job_xml_thread(): Done retrieving: data size 43936687
Thu 16 Jan 2014 22:01:30 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:01:31 - XML: Start document: iteration 16
Thu 16 Jan 2014 22:01:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:01:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:01:32 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:01:32 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:01:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:01:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:01:33 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:01:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:01:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:01:38 - XML: Processed 655792 elements - found 797 jobs
Thu 16 Jan 2014 22:01:38 - job 7346938 appears to have finished
Thu 16 Jan 2014 22:01:38 - job 7346946 appears to have finished
Thu 16 Jan 2014 22:01:38 - job 7346945 appears to have finished
Thu 16 Jan 2014 22:01:38 - job 7346948 appears to have finished
Thu 16 Jan 2014 22:01:38 - job 7345091 appears to have finished
Thu 16 Jan 2014 22:01:38 - job 7346947 appears to have finished
Thu 16 Jan 2014 22:01:38 - job 7346300 appears to have finished
Thu 16 Jan 2014 22:01:38 - job 7346937 appears to have finished
Thu 16 Jan 2014 22:01:38 - job 7346939 appears to have finished
Thu 16 Jan 2014 22:01:38 - job 7346832 appears to have finished
Thu 16 Jan 2014 22:01:38 - job 7346836 appears to have finished
Thu 16 Jan 2014 22:01:38 - job_xml_thread(): Found 11 updated jobs.
Thu 16 Jan 2014 22:01:38 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 22:01:40 - job_xml_thread(): Done storing. succesfully stored: 11 jobs
Thu 16 Jan 2014 22:01:40 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:01:40 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:01:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:01:41 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:01:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:01:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:01:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:01:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:01:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:01:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:01:44 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:01:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 22:01:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:01:44 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:01:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43895486
Thu 16 Jan 2014 22:01:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:01:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43895486
Thu 16 Jan 2014 22:01:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:01:45 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:01:45 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:01:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:01:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:01:48 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:01:48 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 22:01:48 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 22:01:48 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:01:48 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 22:01:55 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:01:55 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:01:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:01:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:01:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:01:57 - size of cluster 'LISA Cluster': 624 hosts 79478 metrics 948086 values 14964080 bits 1870510 bytes 
Thu 16 Jan 2014 22:01:57 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:01:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:01:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:01:57 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:01:57 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:01:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:01:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:01:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:01:59 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:01:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:01:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:01:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:01:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:01:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:01:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:02:03 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:02:03 - job_xml_thread(): Done retrieving: data size 43920906
Thu 16 Jan 2014 22:02:03 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:02:03 - XML: Start document: iteration 17
Thu 16 Jan 2014 22:02:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43920906
Thu 16 Jan 2014 22:02:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43920906
Thu 16 Jan 2014 22:02:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:02:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:02:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:02:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:02:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:02:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:02:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:02:17 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:02:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:02:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:02:17 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:02:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:02:17 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:02:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:02:18 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:02:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:02:20 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:02:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:02:21 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:02:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 22:02:21 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:02:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 22:02:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6583 values 104208 bits 13026 bytes 
Thu 16 Jan 2014 22:02:23 - XML: Processed 655792 elements - found 797 jobs
Thu 16 Jan 2014 22:02:23 - job 7346967 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:02:23 - job 7346970 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:02:23 - job 7346963 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:02:23 - job 7346968 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:02:23 - job 7346969 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:02:23 - job 7346959 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:02:23 - job 7346958 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:02:23 - job 7335187 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:02:23 - job 7346955 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:02:23 - job 7346954 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:02:23 - job 7346957 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:02:23 - job 7346956 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:02:23 - job 7346953 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:02:23 - job 7346535 field 'start_timestamp' changed since saved from: 1389905953 to: 1389905894
Thu 16 Jan 2014 22:02:23 - job 7346964 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:02:23 - job 7346965 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:02:23 - job 7346966 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:02:23 - job 7346960 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:02:23 - job 7346961 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:02:23 - job 7346962 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:02:23 - job_xml_thread(): Found 20 updated jobs.
Thu 16 Jan 2014 22:02:23 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 22:02:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:02:26 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:02:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:02:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:02:26 - job_xml_thread(): Done storing. succesfully stored: 20 jobs
Thu 16 Jan 2014 22:02:26 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:02:26 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:02:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:02:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:02:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:02:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:02:30 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:02:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43895444
Thu 16 Jan 2014 22:02:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:02:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43895444
Thu 16 Jan 2014 22:02:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:02:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:02:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:02:43 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:02:43 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:02:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:02:44 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:02:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:02:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:02:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:02:44 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:02:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:02:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:02:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:02:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:02:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:02:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:02:44 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:02:44 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:02:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:02:44 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:02:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 22:02:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:02:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:02:48 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:02:48 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 22:02:49 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:02:49 - job_xml_thread(): Done retrieving: data size 43941601
Thu 16 Jan 2014 22:02:49 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:02:49 - XML: Start document: iteration 18
Thu 16 Jan 2014 22:02:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43941601
Thu 16 Jan 2014 22:02:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43941601
Thu 16 Jan 2014 22:02:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:02:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:02:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:02:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:02:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:02:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:03:06 - XML: Processed 655792 elements - found 797 jobs
Thu 16 Jan 2014 22:03:06 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:03:06 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:03:06 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:03:06 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:03:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:03:12 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:03:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:03:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:03:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:03:12 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:03:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:03:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:03:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:03:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:03:12 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:03:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:03:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:03:13 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:03:13 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:03:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:03:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:03:15 - Leaving storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 22:03:15 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Thu 16 Jan 2014 22:03:15 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:03:16 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:03:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43929581
Thu 16 Jan 2014 22:03:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:03:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43929581
Thu 16 Jan 2014 22:03:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:03:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:03:21 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:03:22 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:03:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:03:22 - job_xml_thread(): Done retrieving: data size 43929581
Thu 16 Jan 2014 22:03:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 22:03:22 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:03:22 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:03:22 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:03:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 22:03:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9064 values 143317 bits 17914 bytes 
Thu 16 Jan 2014 22:03:22 - XML: Start document: iteration 19
Thu 16 Jan 2014 22:03:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:03:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:03:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:03:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:03:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:03:33 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:03:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:03:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:03:35 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:03:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:03:35 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:03:35 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:03:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:03:40 - XML: Processed 655792 elements - found 797 jobs
Thu 16 Jan 2014 22:03:40 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:03:40 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:03:40 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:03:40 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:03:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:03:40 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:03:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:03:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:03:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:03:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:03:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:03:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:03:42 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:03:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 22:03:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:03:43 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:03:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43905055
Thu 16 Jan 2014 22:03:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:03:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43905055
Thu 16 Jan 2014 22:03:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:03:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:03:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:03:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:03:54 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:03:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:03:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:03:55 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:03:55 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:03:56 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:03:56 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:03:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:03:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:03:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:03:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:03:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:03:58 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:03:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:03:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:03:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:03:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:03:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:03:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:04:01 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:04:01 - job_xml_thread(): Done retrieving: data size 43916880
Thu 16 Jan 2014 22:04:01 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:04:01 - XML: Start document: iteration 20
Thu 16 Jan 2014 22:04:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43916880
Thu 16 Jan 2014 22:04:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43916880
Thu 16 Jan 2014 22:04:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:04:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:04:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:04:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:04:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:04:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:04:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:04:20 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:04:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:04:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:04:22 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:04:22 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:04:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:04:22 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:04:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:04:22 - XML: Processed 655774 elements - found 788 jobs
Thu 16 Jan 2014 22:04:22 - job 7346936 appears to have finished
Thu 16 Jan 2014 22:04:22 - job 7346941 appears to have finished
Thu 16 Jan 2014 22:04:22 - job 7346940 appears to have finished
Thu 16 Jan 2014 22:04:22 - job 7346973 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:04:22 - job 7346972 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:04:22 - job 7346970 field 'start_timestamp' changed since saved from: 1389906058 to: 1389906028
Thu 16 Jan 2014 22:04:22 - job 7346943 appears to have finished
Thu 16 Jan 2014 22:04:22 - job 7346949 appears to have finished
Thu 16 Jan 2014 22:04:22 - job 7346969 field 'start_timestamp' changed since saved from: 1389906056 to: 1389906028
Thu 16 Jan 2014 22:04:22 - job 7346971 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:04:22 - job 7346950 appears to have finished
Thu 16 Jan 2014 22:04:22 - job 7346942 appears to have finished
Thu 16 Jan 2014 22:04:22 - job 7346935 appears to have finished
Thu 16 Jan 2014 22:04:22 - job 7346934 appears to have finished
Thu 16 Jan 2014 22:04:22 - job 7346944 appears to have finished
Thu 16 Jan 2014 22:04:22 - job_xml_thread(): Found 16 updated jobs.
Thu 16 Jan 2014 22:04:22 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 22:04:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:04:23 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:04:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:04:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 22:04:23 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:04:23 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:04:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 22:04:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99148 bits 12393 bytes 
Thu 16 Jan 2014 22:04:23 - job_xml_thread(): Done storing. succesfully stored: 16 jobs
Thu 16 Jan 2014 22:04:23 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:04:23 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:04:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:04:25 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:04:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:04:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:04:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:04:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:04:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:04:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:04:28 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:04:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43910644
Thu 16 Jan 2014 22:04:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:04:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43910644
Thu 16 Jan 2014 22:04:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:04:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:04:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:04:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:04:38 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:04:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:04:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:04:39 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:04:39 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:04:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:04:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:04:39 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:04:39 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:04:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:04:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:04:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:04:42 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:04:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:04:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:04:43 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:04:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 22:04:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:04:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:04:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:04:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:04:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:04:45 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:04:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43918074
Thu 16 Jan 2014 22:04:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:04:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43918074
Thu 16 Jan 2014 22:04:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:04:45 - job_xml_thread(): Done retrieving: data size 43918074
Thu 16 Jan 2014 22:04:45 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:04:45 - Housekeeping: checking database for timed out jobs..
Thu 16 Jan 2014 22:04:46 - Housekeeping: Found 0 timed out jobs in database: closing entries
Thu 16 Jan 2014 22:04:46 - Housekeeping: done.
Thu 16 Jan 2014 22:04:46 - XML: Start document: iteration 0
Thu 16 Jan 2014 22:04:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:04:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:04:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:04:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:04:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:04:58 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:04:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:04:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:04:59 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:04:59 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:04:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:04:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:04:59 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:05:05 - XML: Processed 655774 elements - found 788 jobs
Thu 16 Jan 2014 22:05:05 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:05:06 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:05:06 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:05:06 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:05:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:05:08 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:05:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:05:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:05:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:05:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:05:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:05:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:05:11 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:05:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43905182
Thu 16 Jan 2014 22:05:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:05:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43905182
Thu 16 Jan 2014 22:05:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:05:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:05:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:05:21 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:05:21 - job_xml_thread(): Done retrieving: data size 43905182
Thu 16 Jan 2014 22:05:21 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:05:21 - XML: Start document: iteration 1
Thu 16 Jan 2014 22:05:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:05:23 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:05:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:05:24 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:05:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:05:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:05:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:05:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:05:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:05:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 22:05:26 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:05:26 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:05:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 22:05:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9020 values 142357 bits 17794 bytes 
Thu 16 Jan 2014 22:05:27 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:05:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:05:27 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:05:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:05:27 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:05:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:05:28 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:05:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:05:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:05:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:05:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:05:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:05:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:05:32 - XML: Processed 655770 elements - found 788 jobs
Thu 16 Jan 2014 22:05:32 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:05:32 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:05:32 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:05:32 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:05:35 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:05:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43403482
Thu 16 Jan 2014 22:05:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:05:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43403482
Thu 16 Jan 2014 22:05:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:05:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:05:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:05:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:05:43 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:05:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:05:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:05:44 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:05:44 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:05:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:05:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43403482
Thu 16 Jan 2014 22:05:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:05:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:05:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:05:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:05:47 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:05:47 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:05:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:05:57 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:05:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:05:57 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:05:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:05:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:05:57 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:05:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 22:05:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:05:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:05:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:05:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:05:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:05:59 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:05:59 - job_xml_thread(): Done retrieving: data size 43248417
Thu 16 Jan 2014 22:05:59 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:05:59 - XML: Start document: iteration 2
Thu 16 Jan 2014 22:06:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:06:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:06:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43248417
Thu 16 Jan 2014 22:06:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:06:03 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:06:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:06:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43248417
Thu 16 Jan 2014 22:06:03 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:06:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:06:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:06:09 - XML: Processed 647884 elements - found 787 jobs
Thu 16 Jan 2014 22:06:09 - job 7346979 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:06:09 - job 7346978 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:06:09 - job 7346977 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:06:10 - job 7346976 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:06:10 - job 7346973 field 'start_timestamp' changed since saved from: 1389906199 to: 1389906153
Thu 16 Jan 2014 22:06:10 - job 7346972 field 'start_timestamp' changed since saved from: 1389906197 to: 1389906153
Thu 16 Jan 2014 22:06:10 - job 7346827 appears to have finished
Thu 16 Jan 2014 22:06:10 - job 7346975 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:06:10 - job 7346974 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:06:10 - job 7346951 appears to have finished
Thu 16 Jan 2014 22:06:10 - job 7346952 appears to have finished
Thu 16 Jan 2014 22:06:10 - job 7346980 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:06:10 - job 7346982 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:06:10 - job 7346983 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:06:10 - job 7346981 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:06:10 - job 7346986 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:06:10 - job 7346987 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:06:10 - job 7346984 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:06:10 - job 7346985 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:06:10 - job 7346988 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:06:10 - job 7346989 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:06:10 - job_xml_thread(): Found 23 updated jobs.
Thu 16 Jan 2014 22:06:10 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 22:06:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:06:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:06:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:06:15 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:06:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:06:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:06:18 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:06:18 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:06:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:06:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:06:18 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:06:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:06:19 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:06:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:06:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:06:19 - job_xml_thread(): Done storing. succesfully stored: 23 jobs
Thu 16 Jan 2014 22:06:19 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:06:19 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:06:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:06:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:06:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:06:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:06:21 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:06:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43349272
Thu 16 Jan 2014 22:06:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:06:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43349272
Thu 16 Jan 2014 22:06:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:06:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:06:27 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:06:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:06:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 22:06:28 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:06:28 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:06:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 22:06:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9101 values 143633 bits 17954 bytes 
Thu 16 Jan 2014 22:06:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:06:30 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:06:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:06:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:06:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:06:34 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:06:34 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:06:34 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:06:34 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:06:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:06:34 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:06:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:06:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:06:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:06:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:06:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:06:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:06:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:06:38 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:06:38 - job_xml_thread(): Done retrieving: data size 43356829
Thu 16 Jan 2014 22:06:38 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:06:38 - XML: Start document: iteration 3
Thu 16 Jan 2014 22:06:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43356829
Thu 16 Jan 2014 22:06:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:06:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43356829
Thu 16 Jan 2014 22:06:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:06:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:06:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:06:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:06:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:06:50 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:06:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:06:51 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:06:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:06:51 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:06:51 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:06:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:06:56 - XML: Processed 648538 elements - found 787 jobs
Thu 16 Jan 2014 22:06:56 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:06:56 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:06:56 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:06:56 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:06:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:06:59 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:06:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:06:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:06:59 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:06:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 22:06:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:06:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:06:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:06:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:06:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:07:01 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:07:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43893334
Thu 16 Jan 2014 22:07:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:07:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43893334
Thu 16 Jan 2014 22:07:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:07:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:07:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:07:11 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:07:11 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:07:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:07:13 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:07:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:07:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:07:14 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:07:14 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:07:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:07:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:07:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:07:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:07:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:07:16 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:07:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:07:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:07:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:07:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:07:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:07:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:07:19 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:07:19 - job_xml_thread(): Done retrieving: data size 43922265
Thu 16 Jan 2014 22:07:19 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:07:19 - XML: Start document: iteration 4
Thu 16 Jan 2014 22:07:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43922265
Thu 16 Jan 2014 22:07:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:07:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43922265
Thu 16 Jan 2014 22:07:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:07:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:07:29 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:07:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:07:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:07:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:07:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 22:07:29 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:07:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8890 values 140258 bits 17532 bytes 
Thu 16 Jan 2014 22:07:30 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:07:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 22:07:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:07:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:07:32 - XML: Processed 655772 elements - found 787 jobs
Thu 16 Jan 2014 22:07:32 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:07:32 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:07:32 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:07:32 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:07:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:07:38 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:07:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:07:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:07:39 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:07:39 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:07:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:07:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:07:39 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:07:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:07:42 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:07:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:07:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:07:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:07:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:07:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:07:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:07:45 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:07:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43904497
Thu 16 Jan 2014 22:07:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:07:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43904497
Thu 16 Jan 2014 22:07:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:07:47 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:07:47 - job_xml_thread(): Done retrieving: data size 43904497
Thu 16 Jan 2014 22:07:47 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:07:48 - XML: Start document: iteration 5
Thu 16 Jan 2014 22:07:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:07:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:07:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:07:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:08:03 - XML: Processed 655732 elements - found 767 jobs
Thu 16 Jan 2014 22:08:03 - job 7347000 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:08:03 - job 7346999 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:08:03 - job 7346967 appears to have finished
Thu 16 Jan 2014 22:08:03 - job 7346970 appears to have finished
Thu 16 Jan 2014 22:08:03 - job 7346963 appears to have finished
Thu 16 Jan 2014 22:08:03 - job 7346968 appears to have finished
Thu 16 Jan 2014 22:08:03 - job 7346969 appears to have finished
Thu 16 Jan 2014 22:08:03 - job 7347001 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:08:04 - job 7347002 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:08:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:08:04 - job 7346995 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:08:04 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:08:04 - job 7346994 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:08:04 - job 7346997 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:08:04 - job 7346996 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:08:04 - job 7346991 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:08:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:08:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:08:04 - job 7346990 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:08:04 - job 7346993 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:08:04 - job 7346992 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:08:04 - job 7346815 appears to have finished
Thu 16 Jan 2014 22:08:04 - job 7346971 appears to have finished
Thu 16 Jan 2014 22:08:04 - job 7346959 appears to have finished
Thu 16 Jan 2014 22:08:04 - job 7346958 appears to have finished
Thu 16 Jan 2014 22:08:04 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:08:04 - job 7346955 appears to have finished
Thu 16 Jan 2014 22:08:04 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:08:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:08:04 - job 7346954 appears to have finished
Thu 16 Jan 2014 22:08:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:08:04 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:08:04 - job 7346957 appears to have finished
Thu 16 Jan 2014 22:08:04 - job 7346956 appears to have finished
Thu 16 Jan 2014 22:08:04 - job 7346953 appears to have finished
Thu 16 Jan 2014 22:08:04 - job 7346984 field 'start_timestamp' changed since saved from: 1389906311 to: 1389906266
Thu 16 Jan 2014 22:08:04 - job 7346985 field 'start_timestamp' changed since saved from: 1389906313 to: 1389906266
Thu 16 Jan 2014 22:08:04 - job 7346989 field 'start_timestamp' changed since saved from: 1389906321 to: 1389906266
Thu 16 Jan 2014 22:08:04 - job 7346998 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:08:04 - job 7346964 appears to have finished
Thu 16 Jan 2014 22:08:04 - job 7346965 appears to have finished
Thu 16 Jan 2014 22:08:04 - job 7346966 appears to have finished
Thu 16 Jan 2014 22:08:04 - job 7346960 appears to have finished
Thu 16 Jan 2014 22:08:04 - job 7346961 appears to have finished
Thu 16 Jan 2014 22:08:04 - job 7346962 appears to have finished
Thu 16 Jan 2014 22:08:04 - job 7346835 appears to have finished
Thu 16 Jan 2014 22:08:04 - job_xml_thread(): Found 38 updated jobs.
Thu 16 Jan 2014 22:08:04 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 22:08:06 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:08:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 22:08:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:08:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:08:08 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:08:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:08:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:08:09 - job_xml_thread(): Done storing. succesfully stored: 38 jobs
Thu 16 Jan 2014 22:08:09 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:08:09 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:08:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:08:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:08:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:08:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:08:10 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:08:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43901635
Thu 16 Jan 2014 22:08:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:08:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43901635
Thu 16 Jan 2014 22:08:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:08:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:08:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:08:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:08:21 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:08:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:08:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:08:23 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:08:23 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:08:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:08:23 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:08:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:08:24 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:08:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:08:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:08:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:08:25 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:08:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:08:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:08:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:08:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:08:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:08:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:08:27 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:08:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43904042
Thu 16 Jan 2014 22:08:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:08:27 - job_xml_thread(): Done retrieving: data size 43904042
Thu 16 Jan 2014 22:08:27 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:08:27 - XML: Start document: iteration 6
Thu 16 Jan 2014 22:08:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43904042
Thu 16 Jan 2014 22:08:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:08:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:08:30 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:08:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:08:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 22:08:31 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:08:31 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:08:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 22:08:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9111 values 143785 bits 17973 bytes 
Thu 16 Jan 2014 22:08:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:08:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:08:39 - XML: Processed 655732 elements - found 767 jobs
Thu 16 Jan 2014 22:08:39 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:08:39 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:08:39 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:08:39 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:08:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:08:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:08:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:08:44 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:08:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:08:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:08:44 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:08:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:08:44 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:08:44 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:08:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:08:48 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Thu 16 Jan 2014 22:08:48 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:08:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:08:48 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:08:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:08:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:08:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:08:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:08:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:08:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:08:49 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:08:49 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:08:49 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 22:08:49 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 22:08:49 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 22:08:50 - size of cluster 'LISA Cluster': 624 hosts 79482 metrics 1010729 values 15960538 bits 1995067 bytes 
Thu 16 Jan 2014 22:08:53 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:08:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43917625
Thu 16 Jan 2014 22:08:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:08:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43917625
Thu 16 Jan 2014 22:08:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:08:54 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:08:54 - job_xml_thread(): Done retrieving: data size 43917625
Thu 16 Jan 2014 22:08:54 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:08:54 - XML: Start document: iteration 7
Thu 16 Jan 2014 22:09:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:09:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:09:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:09:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:09:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:09:09 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:09:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:09:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:09:11 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:09:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:09:11 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:09:11 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:09:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:09:14 - XML: Processed 655732 elements - found 767 jobs
Thu 16 Jan 2014 22:09:14 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:09:14 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:09:14 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:09:14 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:09:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:09:15 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:09:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:09:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:09:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:09:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:09:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:09:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:09:16 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:09:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 22:09:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:09:19 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:09:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43919568
Thu 16 Jan 2014 22:09:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:09:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43919568
Thu 16 Jan 2014 22:09:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:09:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:09:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:09:29 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:09:29 - job_xml_thread(): Done retrieving: data size 43919568
Thu 16 Jan 2014 22:09:29 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:09:29 - XML: Start document: iteration 8
Thu 16 Jan 2014 22:09:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:09:30 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:09:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:09:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:09:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:09:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:09:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:09:31 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:09:32 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:09:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:09:32 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:09:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:09:32 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:09:32 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:09:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:09:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 22:09:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 22:09:32 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:09:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5580 values 87969 bits 10996 bytes 
Thu 16 Jan 2014 22:09:41 - XML: Processed 655732 elements - found 767 jobs
Thu 16 Jan 2014 22:09:41 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:09:41 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:09:42 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:09:42 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:09:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:09:43 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:09:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:09:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:09:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:09:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:09:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:09:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:09:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:09:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:09:48 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:09:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43884346
Thu 16 Jan 2014 22:09:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:09:49 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:09:49 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 22:09:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43884346
Thu 16 Jan 2014 22:09:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:09:57 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:09:57 - job_xml_thread(): Done retrieving: data size 43884346
Thu 16 Jan 2014 22:09:58 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:09:58 - XML: Start document: iteration 9
Thu 16 Jan 2014 22:09:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:09:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:10:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:10:00 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:10:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:10:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:10:01 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:10:01 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:10:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:10:01 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:10:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:10:09 - XML: Processed 655724 elements - found 763 jobs
Thu 16 Jan 2014 22:10:09 - job 7347000 field 'start_timestamp' changed since saved from: 1389906433 to: 1389906412
Thu 16 Jan 2014 22:10:09 - job 7346978 appears to have finished
Thu 16 Jan 2014 22:10:09 - job 7346977 appears to have finished
Thu 16 Jan 2014 22:10:09 - job 7346976 appears to have finished
Thu 16 Jan 2014 22:10:09 - job 7346973 appears to have finished
Thu 16 Jan 2014 22:10:09 - job 7346972 appears to have finished
Thu 16 Jan 2014 22:10:09 - job 7347005 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:10:09 - job 7347007 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:10:09 - job 7347001 field 'start_timestamp' changed since saved from: 1389906415 to: 1389906414
Thu 16 Jan 2014 22:10:09 - job 7347002 field 'start_timestamp' changed since saved from: 1389906482 to: 1389906415
Thu 16 Jan 2014 22:10:09 - job 7347003 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:10:09 - job 7347004 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:10:09 - job 7347006 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:10:09 - job 7347008 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:10:09 - job 7346997 field 'start_timestamp' changed since saved from: 1389906427 to: 1389906408
Thu 16 Jan 2014 22:10:09 - job 7346975 appears to have finished
Thu 16 Jan 2014 22:10:09 - job 7346974 appears to have finished
Thu 16 Jan 2014 22:10:09 - job 7346998 field 'start_timestamp' changed since saved from: 1389906429 to: 1389906408
Thu 16 Jan 2014 22:10:09 - job 7346831 appears to have finished
Thu 16 Jan 2014 22:10:09 - job_xml_thread(): Found 23 updated jobs.
Thu 16 Jan 2014 22:10:09 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 22:10:10 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:10:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 22:10:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:10:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:10:11 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:10:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:10:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:10:11 - job_xml_thread(): Done storing. succesfully stored: 23 jobs
Thu 16 Jan 2014 22:10:11 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:10:11 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:10:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:10:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:10:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:10:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:10:15 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:10:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43880106
Thu 16 Jan 2014 22:10:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:10:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43880106
Thu 16 Jan 2014 22:10:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:10:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:10:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:10:26 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:10:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:10:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:10:26 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:10:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:10:28 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:10:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:10:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:10:29 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:10:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:10:29 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:10:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:10:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:10:32 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:10:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:10:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:10:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:10:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:10:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:10:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:10:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:10:33 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:10:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:10:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 22:10:33 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:10:33 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:10:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5935 values 93688 bits 11711 bytes 
Thu 16 Jan 2014 22:10:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 22:10:38 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:10:38 - job_xml_thread(): Done retrieving: data size 43915492
Thu 16 Jan 2014 22:10:38 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:10:38 - XML: Start document: iteration 10
Thu 16 Jan 2014 22:10:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43915492
Thu 16 Jan 2014 22:10:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43915492
Thu 16 Jan 2014 22:10:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:10:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:10:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:10:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:10:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:10:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:10:55 - XML: Processed 655724 elements - found 763 jobs
Thu 16 Jan 2014 22:10:55 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:10:55 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:10:55 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:10:55 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:10:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:10:57 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:10:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:10:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:10:58 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:10:58 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:10:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:10:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:10:58 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:11:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:11:02 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:11:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:11:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:11:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:11:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:11:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:11:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:11:05 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:11:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 22:11:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:11:06 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:11:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43911305
Thu 16 Jan 2014 22:11:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:11:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43911305
Thu 16 Jan 2014 22:11:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:11:10 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:11:10 - job_xml_thread(): Done retrieving: data size 43911305
Thu 16 Jan 2014 22:11:10 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:11:10 - XML: Start document: iteration 11
Thu 16 Jan 2014 22:11:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:11:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:11:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:11:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:11:27 - XML: Processed 655724 elements - found 763 jobs
Thu 16 Jan 2014 22:11:27 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:11:27 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:11:27 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:11:28 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:11:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:11:29 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:11:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:11:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:11:29 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:11:29 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:11:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:11:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:11:29 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:11:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:11:30 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:11:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:11:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:11:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:11:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:11:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:11:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:11:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:11:33 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:11:34 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:11:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43401143
Thu 16 Jan 2014 22:11:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:11:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43401143
Thu 16 Jan 2014 22:11:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:11:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:11:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 22:11:35 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:11:35 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:11:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 22:11:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7537 values 118873 bits 14859 bytes 
Thu 16 Jan 2014 22:11:43 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:11:43 - job_xml_thread(): Done retrieving: data size 43401143
Thu 16 Jan 2014 22:11:43 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:11:43 - XML: Start document: iteration 12
Thu 16 Jan 2014 22:11:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:11:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:11:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:11:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:11:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:11:51 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:11:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:11:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:11:53 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:11:53 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:11:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:11:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:11:53 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:11:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:11:56 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:11:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:11:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:11:58 - XML: Processed 649352 elements - found 750 jobs
Thu 16 Jan 2014 22:11:58 - job 7346979 appears to have finished
Thu 16 Jan 2014 22:11:58 - job 7347013 report time 1389906536 does not match current heartbeat 1389906657 : ignoring job
Thu 16 Jan 2014 22:11:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:11:58 - job 7347012 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:11:58 - job 7347010 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:11:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:11:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:11:58 - job 7347017 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:11:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:11:58 - job 7347014 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:11:58 - job 7347019 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:11:58 - job 7347018 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:11:58 - job 7346826 appears to have finished
Thu 16 Jan 2014 22:11:58 - job 7347009 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:11:58 - job 7347016 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:11:58 - job 7346980 appears to have finished
Thu 16 Jan 2014 22:11:58 - job 7346982 appears to have finished
Thu 16 Jan 2014 22:11:58 - job 7346983 appears to have finished
Thu 16 Jan 2014 22:11:58 - job 7346981 appears to have finished
Thu 16 Jan 2014 22:11:58 - job 7346986 appears to have finished
Thu 16 Jan 2014 22:11:58 - job 7346987 appears to have finished
Thu 16 Jan 2014 22:11:58 - job 7346984 appears to have finished
Thu 16 Jan 2014 22:11:58 - job 7346985 appears to have finished
Thu 16 Jan 2014 22:11:58 - job 7346988 appears to have finished
Thu 16 Jan 2014 22:11:58 - job 7346989 appears to have finished
Thu 16 Jan 2014 22:11:58 - job 7347011 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:11:58 - job 7346822 appears to have finished
Thu 16 Jan 2014 22:11:58 - job 7346839 appears to have finished
Thu 16 Jan 2014 22:11:58 - job 7347022 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:11:58 - job 7347023 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:11:58 - job 7347020 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:11:58 - job 7347021 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:11:58 - job_xml_thread(): Found 28 updated jobs.
Thu 16 Jan 2014 22:11:58 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 22:11:58 - job_xml_thread(): Done storing. succesfully stored: 28 jobs
Thu 16 Jan 2014 22:11:58 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:11:58 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:12:02 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:12:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43229429
Thu 16 Jan 2014 22:12:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:12:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43229429
Thu 16 Jan 2014 22:12:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:12:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:12:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:12:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:12:11 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:12:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:12:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:12:13 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:12:13 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:12:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:12:13 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:12:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:12:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:12:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:12:13 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:12:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:12:16 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:12:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:12:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:12:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:12:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:12:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:12:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:12:17 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:12:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 22:12:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:12:21 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:12:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43308739
Thu 16 Jan 2014 22:12:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:12:21 - job_xml_thread(): Done retrieving: data size 43308739
Thu 16 Jan 2014 22:12:21 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:12:21 - XML: Start document: iteration 13
Thu 16 Jan 2014 22:12:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43308739
Thu 16 Jan 2014 22:12:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:12:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:12:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:12:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:12:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:12:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:12:34 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:12:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:12:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:12:35 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:12:35 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:12:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:12:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:12:35 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:12:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:12:36 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:12:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:12:36 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:12:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 22:12:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 22:12:36 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:12:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5831 values 91980 bits 11497 bytes 
Thu 16 Jan 2014 22:12:39 - XML: Processed 648246 elements - found 750 jobs
Thu 16 Jan 2014 22:12:39 - job 7347013 report time 1389906536 does not match current heartbeat 1389906657 : ignoring job
Thu 16 Jan 2014 22:12:39 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:12:39 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:12:39 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:12:39 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:12:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:12:43 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:12:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:12:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:12:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:12:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:12:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:12:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:12:49 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:12:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43816164
Thu 16 Jan 2014 22:12:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:12:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43816164
Thu 16 Jan 2014 22:12:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:12:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:12:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:12:54 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:12:54 - job_xml_thread(): Done retrieving: data size 43816164
Thu 16 Jan 2014 22:12:54 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:12:54 - XML: Start document: iteration 14
Thu 16 Jan 2014 22:12:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:12:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:12:59 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:12:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 22:12:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:13:03 - XML: Processed 655016 elements - found 750 jobs
Thu 16 Jan 2014 22:13:03 - job 7347013 report time 1389906536 does not match current heartbeat 1389906657 : ignoring job
Thu 16 Jan 2014 22:13:03 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:13:03 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:13:03 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:13:03 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:13:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:13:08 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:13:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:13:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:13:09 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:13:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:13:09 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:13:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:13:09 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:13:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:13:12 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:13:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:13:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:13:12 - Leaving storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 22:13:12 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Thu 16 Jan 2014 22:13:12 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:13:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:13:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:13:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:13:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:13:13 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:13:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43898618
Thu 16 Jan 2014 22:13:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:13:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43898618
Thu 16 Jan 2014 22:13:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:13:18 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:13:18 - job_xml_thread(): Done retrieving: data size 43898618
Thu 16 Jan 2014 22:13:18 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:13:18 - XML: Start document: iteration 15
Thu 16 Jan 2014 22:13:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:13:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:13:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:13:25 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:13:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:13:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:13:27 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:13:27 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:13:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:13:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:13:27 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:13:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:13:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:13:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:13:35 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:13:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:13:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:13:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:13:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:13:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:13:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:13:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:13:36 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:13:36 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:13:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 22:13:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:13:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 22:13:37 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:13:37 - XML: Processed 655698 elements - found 750 jobs
Thu 16 Jan 2014 22:13:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6117 values 96513 bits 12064 bytes 
Thu 16 Jan 2014 22:13:37 - job 7347013 report time 1389906536 does not match current heartbeat 1389906657 : ignoring job
Thu 16 Jan 2014 22:13:37 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:13:37 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:13:37 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:13:37 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:13:39 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:13:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43881630
Thu 16 Jan 2014 22:13:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:13:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43881630
Thu 16 Jan 2014 22:13:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:13:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:13:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:13:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:13:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:13:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:13:51 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:13:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:13:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:13:52 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:13:52 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:13:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:13:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:13:52 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:13:52 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:13:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:13:55 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:13:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:13:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:13:55 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:13:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 22:13:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:13:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:13:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:13:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:13:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:13:56 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:13:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43907889
Thu 16 Jan 2014 22:13:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:13:56 - job_xml_thread(): Done retrieving: data size 43907889
Thu 16 Jan 2014 22:13:56 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:13:56 - XML: Start document: iteration 16
Thu 16 Jan 2014 22:13:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43907889
Thu 16 Jan 2014 22:13:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:14:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:14:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:14:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:14:09 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:14:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:14:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:14:10 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:14:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:14:10 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:14:10 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:14:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:14:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:14:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:14:16 - XML: Processed 655670 elements - found 736 jobs
Thu 16 Jan 2014 22:14:16 - job 7347000 appears to have finished
Thu 16 Jan 2014 22:14:16 - job 7346999 appears to have finished
Thu 16 Jan 2014 22:14:16 - job 7346308 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:14:16 - job 7347005 appears to have finished
Thu 16 Jan 2014 22:14:16 - job 7347001 appears to have finished
Thu 16 Jan 2014 22:14:16 - job 7347002 appears to have finished
Thu 16 Jan 2014 22:14:17 - job 7347003 appears to have finished
Thu 16 Jan 2014 22:14:17 - job 7347004 appears to have finished
Thu 16 Jan 2014 22:14:17 - job 7346995 appears to have finished
Thu 16 Jan 2014 22:14:17 - job 7346994 appears to have finished
Thu 16 Jan 2014 22:14:17 - job 7346997 appears to have finished
Thu 16 Jan 2014 22:14:17 - job 7346996 appears to have finished
Thu 16 Jan 2014 22:14:17 - job 7346991 appears to have finished
Thu 16 Jan 2014 22:14:17 - job 7346990 appears to have finished
Thu 16 Jan 2014 22:14:17 - job 7346993 appears to have finished
Thu 16 Jan 2014 22:14:17 - job 7346992 appears to have finished
Thu 16 Jan 2014 22:14:17 - job 7346998 appears to have finished
Thu 16 Jan 2014 22:14:17 - job 7347023 field 'start_timestamp' changed since saved from: 1389906659 to: 1389906619
Thu 16 Jan 2014 22:14:17 - job_xml_thread(): Found 21 updated jobs.
Thu 16 Jan 2014 22:14:17 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 22:14:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:14:19 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:14:19 - job_xml_thread(): Done storing. succesfully stored: 21 jobs
Thu 16 Jan 2014 22:14:19 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:14:19 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:14:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:14:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:14:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:14:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:14:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:14:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:14:21 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:14:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43895456
Thu 16 Jan 2014 22:14:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:14:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43895456
Thu 16 Jan 2014 22:14:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:14:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:14:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:14:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:14:32 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:14:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:14:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:14:34 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:14:34 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:14:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:14:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:14:34 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:14:34 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:14:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:14:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:14:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:14:36 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:14:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:14:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:14:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:14:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:14:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:14:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:14:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:14:37 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:14:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:14:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 22:14:37 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:14:37 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:14:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 22:14:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8955 values 141210 bits 17651 bytes 
Thu 16 Jan 2014 22:14:38 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:14:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43915053
Thu 16 Jan 2014 22:14:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:14:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43915053
Thu 16 Jan 2014 22:14:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:14:38 - job_xml_thread(): Done retrieving: data size 43915053
Thu 16 Jan 2014 22:14:39 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:14:39 - XML: Start document: iteration 17
Thu 16 Jan 2014 22:14:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:14:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:14:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:14:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:14:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:14:58 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:14:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:14:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:14:59 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:14:59 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:14:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:14:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:14:59 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:15:01 - XML: Processed 655670 elements - found 736 jobs
Thu 16 Jan 2014 22:15:01 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:15:01 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:15:01 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:15:01 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:15:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:15:02 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:15:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:15:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:15:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:15:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:15:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:15:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:15:03 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:15:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 22:15:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:15:04 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:15:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43910327
Thu 16 Jan 2014 22:15:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:15:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43910327
Thu 16 Jan 2014 22:15:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:15:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:15:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:15:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:15:15 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:15:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:15:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:15:16 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:15:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:15:16 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:15:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:15:16 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:15:16 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:15:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:15:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:15:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:15:19 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:15:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:15:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:15:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:15:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:15:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:15:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:15:21 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:15:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43903147
Thu 16 Jan 2014 22:15:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:15:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43903147
Thu 16 Jan 2014 22:15:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:15:22 - job_xml_thread(): Done retrieving: data size 43903147
Thu 16 Jan 2014 22:15:22 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:15:22 - XML: Start document: iteration 18
Thu 16 Jan 2014 22:15:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:15:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:15:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:15:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:15:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:15:37 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:15:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:15:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:15:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:15:37 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:15:38 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:15:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:15:38 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:15:38 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:15:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:15:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:15:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 22:15:38 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:15:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 22:15:38 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:15:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7714 values 121724 bits 15215 bytes 
Thu 16 Jan 2014 22:15:39 - XML: Processed 655670 elements - found 736 jobs
Thu 16 Jan 2014 22:15:40 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:15:40 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:15:40 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:15:40 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:15:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:15:44 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:15:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:15:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:15:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:15:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:15:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:15:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:15:47 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:15:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43882152
Thu 16 Jan 2014 22:15:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:15:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43882152
Thu 16 Jan 2014 22:15:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:15:49 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Thu 16 Jan 2014 22:15:49 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:15:51 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:15:51 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:15:51 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 22:15:51 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 22:15:51 - Entering storeMetrics(): cluster LISA Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Thu 16 Jan 2014 22:15:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:15:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:15:55 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:15:55 - job_xml_thread(): Done retrieving: data size 43882152
Thu 16 Jan 2014 22:15:55 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:15:55 - XML: Start document: iteration 19
Thu 16 Jan 2014 22:15:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:15:59 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:15:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:15:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:15:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:15:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:16:00 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:16:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:16:00 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:16:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:16:00 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:16:01 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:16:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 22:16:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:16:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:16:05 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:16:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:16:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:16:06 - XML: Processed 655658 elements - found 730 jobs
Thu 16 Jan 2014 22:16:06 - job 7346014 appears to have finished
Thu 16 Jan 2014 22:16:06 - job 7346821 appears to have finished
Thu 16 Jan 2014 22:16:06 - job 7347007 appears to have finished
Thu 16 Jan 2014 22:16:06 - job 7347006 appears to have finished
Thu 16 Jan 2014 22:16:06 - job 7347008 appears to have finished
Thu 16 Jan 2014 22:16:06 - job 7335102 appears to have finished
Thu 16 Jan 2014 22:16:06 - job 7347011 appears to have finished
Thu 16 Jan 2014 22:16:06 - job 7347026 report time 1389906778 does not match current heartbeat 1389906898 : ignoring job
Thu 16 Jan 2014 22:16:06 - job_xml_thread(): Found 8 updated jobs.
Thu 16 Jan 2014 22:16:06 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 22:16:06 - job_xml_thread(): Done storing. succesfully stored: 8 jobs
Thu 16 Jan 2014 22:16:06 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:16:06 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:16:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:16:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:16:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:16:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:16:07 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:16:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43899986
Thu 16 Jan 2014 22:16:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:16:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43899986
Thu 16 Jan 2014 22:16:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:16:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:16:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:16:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:16:18 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:16:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:16:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:16:20 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:16:20 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:16:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:16:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:16:20 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:16:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:16:21 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:16:21 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:16:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:16:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:16:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:16:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:16:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:16:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:16:24 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:16:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43919745
Thu 16 Jan 2014 22:16:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:16:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43919745
Thu 16 Jan 2014 22:16:24 - job_xml_thread(): Done retrieving: data size 43919745
Thu 16 Jan 2014 22:16:24 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:16:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:16:25 - XML: Start document: iteration 20
Thu 16 Jan 2014 22:16:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:16:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:16:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:16:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:16:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:16:38 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:16:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:16:40 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:16:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:16:40 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:16:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 22:16:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 22:16:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:16:40 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:16:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9121 values 144136 bits 18017 bytes 
Thu 16 Jan 2014 22:16:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:16:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:16:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:16:40 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:16:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:16:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:16:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:16:46 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:16:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:16:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:16:47 - XML: Processed 655658 elements - found 730 jobs
Thu 16 Jan 2014 22:16:47 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:16:47 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:16:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:16:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:16:47 - job 7347026 report time 1389906778 does not match current heartbeat 1389906898 : ignoring job
Thu 16 Jan 2014 22:16:47 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:16:47 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:16:47 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:16:47 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:16:49 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:16:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43895049
Thu 16 Jan 2014 22:16:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:16:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43895049
Thu 16 Jan 2014 22:16:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:16:51 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:16:51 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:16:51 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:16:51 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 22:16:51 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 22:16:51 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:16:51 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 22:16:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:16:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:16:56 - size of cluster 'LISA Cluster': 624 hosts 79474 metrics 851065 values 13431061 bits 1678882 bytes 
Thu 16 Jan 2014 22:17:02 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:17:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:17:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:17:02 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:17:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:17:05 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:17:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:17:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:17:06 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:17:06 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:17:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:17:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:17:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:17:08 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:17:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:17:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:17:08 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:17:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 22:17:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:17:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:17:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:17:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:17:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:17:11 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:17:11 - job_xml_thread(): Done retrieving: data size 43902085
Thu 16 Jan 2014 22:17:11 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:17:11 - Housekeeping: checking database for timed out jobs..
Thu 16 Jan 2014 22:17:11 - Housekeeping: Found 0 timed out jobs in database: closing entries
Thu 16 Jan 2014 22:17:11 - Housekeeping: done.
Thu 16 Jan 2014 22:17:11 - XML: Start document: iteration 0
Thu 16 Jan 2014 22:17:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43902085
Thu 16 Jan 2014 22:17:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:17:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43902085
Thu 16 Jan 2014 22:17:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:17:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:17:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:17:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:17:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:17:23 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:17:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:17:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:17:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:17:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:17:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:17:24 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:17:32 - XML: Processed 655584 elements - found 730 jobs
Thu 16 Jan 2014 22:17:32 - job 7347026 report time 1389906778 does not match current heartbeat 1389906898 : ignoring job
Thu 16 Jan 2014 22:17:32 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:17:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:17:32 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:17:32 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:17:32 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:17:32 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:17:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:17:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:17:32 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:17:32 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:17:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:17:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:17:35 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:17:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43589552
Thu 16 Jan 2014 22:17:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:17:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43589552
Thu 16 Jan 2014 22:17:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:17:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:17:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:17:40 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:17:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:17:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:17:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 22:17:40 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:17:40 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:17:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 22:17:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8727 values 138059 bits 17257 bytes 
Thu 16 Jan 2014 22:17:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:17:45 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:17:47 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:17:47 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:17:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:17:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:17:48 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:17:48 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:17:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:17:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:17:51 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:17:51 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 22:17:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:17:51 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:17:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:17:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:17:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:17:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:17:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:17:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:17:55 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:17:55 - job_xml_thread(): Done retrieving: data size 43261615
Thu 16 Jan 2014 22:17:55 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:17:55 - XML: Start document: iteration 1
Thu 16 Jan 2014 22:17:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43261615
Thu 16 Jan 2014 22:17:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:17:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43261615
Thu 16 Jan 2014 22:17:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:18:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:18:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:18:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:18:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:18:12 - XML: Processed 647646 elements - found 727 jobs
Thu 16 Jan 2014 22:18:12 - job 7347010 appears to have finished
Thu 16 Jan 2014 22:18:12 - job 7346834 appears to have finished
Thu 16 Jan 2014 22:18:12 - job 7347009 appears to have finished
Thu 16 Jan 2014 22:18:12 - job_xml_thread(): Found 4 updated jobs.
Thu 16 Jan 2014 22:18:12 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 22:18:14 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Thu 16 Jan 2014 22:18:14 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:18:14 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:18:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:18:15 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:18:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:18:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:18:16 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:18:16 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:18:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:18:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:18:16 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:18:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:18:18 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:18:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:18:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:18:18 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:18:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 22:18:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:18:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:18:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:18:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:18:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:18:22 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:18:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43320568
Thu 16 Jan 2014 22:18:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:18:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43320568
Thu 16 Jan 2014 22:18:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:18:29 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:18:29 - job_xml_thread(): Done retrieving: data size 43320568
Thu 16 Jan 2014 22:18:29 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:18:29 - XML: Start document: iteration 2
Thu 16 Jan 2014 22:18:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:18:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:18:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:18:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:18:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:18:39 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:18:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:18:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:18:40 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:18:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:18:40 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:18:40 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:18:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:18:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:18:40 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:18:41 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:18:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 22:18:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:18:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 22:18:41 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:18:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5781 values 91372 bits 11421 bytes 
Thu 16 Jan 2014 22:18:46 - XML: Processed 648200 elements - found 727 jobs
Thu 16 Jan 2014 22:18:46 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:18:46 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:18:46 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:18:46 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:18:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:18:46 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:18:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:18:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:18:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:18:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:18:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:18:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:18:50 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:18:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43842023
Thu 16 Jan 2014 22:18:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:18:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43842023
Thu 16 Jan 2014 22:18:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:18:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:18:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:19:01 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:19:01 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:19:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:19:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:19:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:19:02 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:19:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:19:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:19:03 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:19:03 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:19:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:19:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:19:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:19:05 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:19:05 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:19:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 22:19:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:19:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:19:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:19:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:19:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:19:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:19:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:19:09 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:19:09 - job_xml_thread(): Done retrieving: data size 43899386
Thu 16 Jan 2014 22:19:09 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:19:09 - XML: Start document: iteration 3
Thu 16 Jan 2014 22:19:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43899386
Thu 16 Jan 2014 22:19:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43899386
Thu 16 Jan 2014 22:19:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:19:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:19:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:19:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:19:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:19:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:19:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:19:29 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:19:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:19:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:19:29 - XML: Processed 655652 elements - found 727 jobs
Thu 16 Jan 2014 22:19:29 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:19:29 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:19:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:19:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:19:29 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:19:29 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:19:29 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:19:29 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:19:29 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:19:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:19:32 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:19:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:19:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:19:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:19:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:19:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:19:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:19:35 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:19:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43892569
Thu 16 Jan 2014 22:19:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:19:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43892569
Thu 16 Jan 2014 22:19:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:19:38 - Leaving storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 22:19:38 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Thu 16 Jan 2014 22:19:39 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:19:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:19:42 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:19:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:19:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 22:19:43 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:19:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9009 values 142250 bits 17781 bytes 
Thu 16 Jan 2014 22:19:43 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:19:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 22:19:44 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:19:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:19:44 - job_xml_thread(): Done retrieving: data size 43892569
Thu 16 Jan 2014 22:19:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:19:44 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:19:44 - XML: Start document: iteration 4
Thu 16 Jan 2014 22:19:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:19:45 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:19:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:19:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:19:46 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:19:46 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:19:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:19:46 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:19:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:19:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:19:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:19:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:19:58 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:19:59 - XML: Processed 655650 elements - found 726 jobs
Thu 16 Jan 2014 22:19:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:19:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:19:59 - job 7346699 appears to have finished
Thu 16 Jan 2014 22:19:59 - job 7346823 appears to have finished
Thu 16 Jan 2014 22:19:59 - job 7346237 appears to have finished
Thu 16 Jan 2014 22:19:59 - job_xml_thread(): Found 5 updated jobs.
Thu 16 Jan 2014 22:19:59 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 22:19:59 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Thu 16 Jan 2014 22:19:59 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:19:59 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:19:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:19:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:19:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:19:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:20:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:20:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:20:01 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:20:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855983
Thu 16 Jan 2014 22:20:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:20:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855983
Thu 16 Jan 2014 22:20:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:20:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:20:14 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:20:14 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:20:14 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:20:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:20:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:20:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:20:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:20:15 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:20:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:20:15 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:20:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:20:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:20:17 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:20:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:20:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:20:17 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:20:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 22:20:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:20:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:20:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:20:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:20:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:20:19 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:20:19 - job_xml_thread(): Done retrieving: data size 43904804
Thu 16 Jan 2014 22:20:19 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:20:19 - XML: Start document: iteration 5
Thu 16 Jan 2014 22:20:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43904804
Thu 16 Jan 2014 22:20:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:20:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43904804
Thu 16 Jan 2014 22:20:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:20:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:20:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:20:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:20:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:20:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:20:37 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:20:38 - XML: Processed 655650 elements - found 726 jobs
Thu 16 Jan 2014 22:20:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:20:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:20:38 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:20:38 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:20:38 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:20:38 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:20:38 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:20:38 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:20:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:20:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:20:38 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:20:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:20:41 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:20:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:20:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:20:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:20:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:20:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:20:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:20:43 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:20:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43892154
Thu 16 Jan 2014 22:20:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:20:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:20:43 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:20:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43892154
Thu 16 Jan 2014 22:20:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:20:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:20:44 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:20:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 22:20:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 22:20:44 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:20:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9034 values 142566 bits 17820 bytes 
Thu 16 Jan 2014 22:20:53 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:20:53 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:20:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:20:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:20:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:20:54 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:20:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:20:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:20:55 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:20:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:20:55 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:20:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:20:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:20:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:20:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:20:58 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:20:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:20:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:20:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:20:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:20:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:20:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:21:00 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:21:00 - job_xml_thread(): Done retrieving: data size 43880163
Thu 16 Jan 2014 22:21:00 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:21:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43880163
Thu 16 Jan 2014 22:21:00 - XML: Start document: iteration 6
Thu 16 Jan 2014 22:21:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:21:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43880163
Thu 16 Jan 2014 22:21:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:21:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:21:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:21:11 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:21:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:21:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:21:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:21:13 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:21:13 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:21:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:21:13 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:21:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:21:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:21:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:21:21 - XML: Processed 655650 elements - found 726 jobs
Thu 16 Jan 2014 22:21:21 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:21:21 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:21:21 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:21:21 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:21:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:21:23 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:21:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:21:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:21:23 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:21:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 22:21:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:21:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:21:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:21:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:21:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:21:25 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:21:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43886556
Thu 16 Jan 2014 22:21:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:21:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43886556
Thu 16 Jan 2014 22:21:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:21:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:21:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:21:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:21:35 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:21:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:21:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:21:36 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:21:36 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:21:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:21:36 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:21:36 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:21:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:21:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:21:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:21:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:21:39 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:21:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:21:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:21:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:21:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:21:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:21:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:21:40 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:21:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43910041
Thu 16 Jan 2014 22:21:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:21:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43910041
Thu 16 Jan 2014 22:21:41 - job_xml_thread(): Done retrieving: data size 43910041
Thu 16 Jan 2014 22:21:41 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:21:41 - XML: Start document: iteration 7
Thu 16 Jan 2014 22:21:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:21:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:21:44 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:21:46 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:21:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 22:21:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:21:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 22:21:47 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:21:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9262 values 146208 bits 18276 bytes 
Thu 16 Jan 2014 22:21:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:21:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:21:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:21:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:21:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:21:56 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:21:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:21:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:21:57 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:21:57 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:21:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:21:57 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:21:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:21:59 - XML: Processed 655646 elements - found 724 jobs
Thu 16 Jan 2014 22:21:59 - job 7346818 appears to have finished
Thu 16 Jan 2014 22:21:59 - job 7346825 appears to have finished
Thu 16 Jan 2014 22:21:59 - job_xml_thread(): Found 2 updated jobs.
Thu 16 Jan 2014 22:21:59 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 22:21:59 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Thu 16 Jan 2014 22:21:59 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:21:59 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:22:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:22:04 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:22:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:22:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:22:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:22:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:22:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:22:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:22:06 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:22:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43887125
Thu 16 Jan 2014 22:22:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:22:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43887125
Thu 16 Jan 2014 22:22:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:22:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:22:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:22:14 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:22:14 - job_xml_thread(): Done retrieving: data size 43887125
Thu 16 Jan 2014 22:22:14 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:22:14 - XML: Start document: iteration 8
Thu 16 Jan 2014 22:22:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:22:18 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:22:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:22:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:22:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:22:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:22:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:22:20 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:22:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:22:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:22:27 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:22:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:22:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:22:28 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:22:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:22:28 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:22:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:22:29 - XML: Processed 655646 elements - found 724 jobs
Thu 16 Jan 2014 22:22:29 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:22:29 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:22:29 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:22:29 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:22:30 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:22:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 22:22:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:22:31 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:22:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43864399
Thu 16 Jan 2014 22:22:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:22:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43864399
Thu 16 Jan 2014 22:22:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:22:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:22:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:22:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:22:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:22:45 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:22:45 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:22:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:22:45 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:22:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:22:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:22:45 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:22:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:22:45 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:22:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:22:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:22:47 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:22:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:22:47 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:22:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:22:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:22:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:22:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:22:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:22:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:22:47 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:22:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:22:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 22:22:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 22:22:47 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:22:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5631 values 88806 bits 11100 bytes 
Thu 16 Jan 2014 22:22:50 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:22:50 - job_xml_thread(): Done retrieving: data size 43905788
Thu 16 Jan 2014 22:22:50 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:22:50 - XML: Start document: iteration 9
Thu 16 Jan 2014 22:22:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43905788
Thu 16 Jan 2014 22:22:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:22:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43905788
Thu 16 Jan 2014 22:22:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:23:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:23:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:23:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:23:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:23:08 - XML: Processed 655646 elements - found 724 jobs
Thu 16 Jan 2014 22:23:08 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:23:08 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:23:08 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:23:08 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:23:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:23:10 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:23:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:23:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:23:11 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:23:11 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:23:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:23:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:23:11 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:23:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:23:13 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:23:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:23:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:23:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:23:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:23:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:23:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:23:15 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:23:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 22:23:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:23:16 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:23:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43830567
Thu 16 Jan 2014 22:23:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:23:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43830567
Thu 16 Jan 2014 22:23:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:23:23 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:23:23 - job_xml_thread(): Done retrieving: data size 43830567
Thu 16 Jan 2014 22:23:23 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:23:23 - XML: Start document: iteration 10
Thu 16 Jan 2014 22:23:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:23:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:23:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:23:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:23:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:23:35 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:23:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:23:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:23:36 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:23:36 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:23:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:23:36 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:23:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:23:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:23:38 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:23:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:23:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:23:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:23:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:23:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:23:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:23:40 - XML: Processed 654896 elements - found 724 jobs
Thu 16 Jan 2014 22:23:40 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:23:40 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:23:40 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:23:40 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:23:42 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:23:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43305042
Thu 16 Jan 2014 22:23:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:23:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43305042
Thu 16 Jan 2014 22:23:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:23:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:23:48 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:23:48 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:23:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 22:23:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:23:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 22:23:49 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:23:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8132 values 128248 bits 16031 bytes 
Thu 16 Jan 2014 22:23:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:23:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:23:51 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Thu 16 Jan 2014 22:23:51 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:23:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:23:52 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:23:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:23:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:23:52 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:23:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:23:52 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:23:52 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:23:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:23:52 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:23:52 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:23:52 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 22:23:52 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 22:23:52 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 22:23:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:23:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:23:55 - job_xml_thread(): Retrieving XML data..
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Thu 16 Jan 2014 22:23:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:23:56 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:23:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:23:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:23:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:23:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:23:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:23:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:23:58 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:23:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43234729
Thu 16 Jan 2014 22:23:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:23:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43234729
Thu 16 Jan 2014 22:23:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:23:59 - job_xml_thread(): Done retrieving: data size 43234729
Thu 16 Jan 2014 22:24:00 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:24:00 - XML: Start document: iteration 11
Thu 16 Jan 2014 22:24:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:24:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:24:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:24:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:24:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:24:11 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:24:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:24:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:24:14 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:24:14 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:24:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:24:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:24:14 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:24:17 - XML: Processed 647516 elements - found 726 jobs
Thu 16 Jan 2014 22:24:17 - job 7346312 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:24:17 - job_xml_thread(): Found 3 updated jobs.
Thu 16 Jan 2014 22:24:17 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 22:24:17 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Thu 16 Jan 2014 22:24:17 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:24:17 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:24:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:24:21 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:24:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:24:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:24:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:24:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:24:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:24:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:24:22 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:24:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 22:24:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:24:23 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:24:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43295646
Thu 16 Jan 2014 22:24:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:24:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43295646
Thu 16 Jan 2014 22:24:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:24:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:24:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:24:32 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:24:32 - job_xml_thread(): Done retrieving: data size 43295646
Thu 16 Jan 2014 22:24:32 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:24:32 - XML: Start document: iteration 12
Thu 16 Jan 2014 22:24:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:24:35 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:24:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:24:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:24:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:24:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:24:36 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:24:36 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:24:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:24:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:24:37 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:24:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:24:42 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:24:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:24:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:24:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:24:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:24:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:24:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:24:45 - XML: Processed 648198 elements - found 726 jobs
Thu 16 Jan 2014 22:24:45 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:24:45 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:24:45 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:24:45 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:24:47 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:24:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43816531
Thu 16 Jan 2014 22:24:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:24:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43816531
Thu 16 Jan 2014 22:24:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:24:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:24:49 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:24:49 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:24:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 22:24:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:24:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 22:24:50 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:24:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8428 values 132899 bits 16612 bytes 
Thu 16 Jan 2014 22:24:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:24:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:24:52 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:24:52 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:24:53 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:24:53 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:24:53 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 22:24:53 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 22:24:54 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 22:24:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:24:57 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:24:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:24:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:24:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:24:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:24:59 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:24:59 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:24:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:24:59 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:24:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:25:00 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:25:01 - size of cluster 'LISA Cluster': 624 hosts 79482 metrics 974267 values 15376245 bits 1922030 bytes 
Thu 16 Jan 2014 22:25:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:25:03 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:25:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:25:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:25:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:25:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:25:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:25:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:25:08 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:25:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43887740
Thu 16 Jan 2014 22:25:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:25:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43887740
Thu 16 Jan 2014 22:25:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:25:08 - job_xml_thread(): Done retrieving: data size 43887740
Thu 16 Jan 2014 22:25:08 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:25:08 - XML: Start document: iteration 13
Thu 16 Jan 2014 22:25:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:25:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:25:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:25:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:25:23 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:25:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 22:25:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:25:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:25:24 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:25:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:25:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:25:24 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:25:24 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:25:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:25:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:25:25 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:25:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:25:26 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:25:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:25:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:25:28 - XML: Processed 655650 elements - found 726 jobs
Thu 16 Jan 2014 22:25:28 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:25:28 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:25:28 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:25:28 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:25:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:25:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:25:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:25:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:25:31 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:25:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43892611
Thu 16 Jan 2014 22:25:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:25:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43892611
Thu 16 Jan 2014 22:25:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:25:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:25:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:25:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:25:43 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:25:43 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:25:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:25:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:25:46 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:25:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:25:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:25:46 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:25:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:25:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:25:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:25:47 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:25:47 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:25:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:25:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:25:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:25:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:25:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:25:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:25:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:25:49 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:25:50 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:25:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 22:25:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:25:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 22:25:50 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:25:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6149 values 97051 bits 12131 bytes 
Thu 16 Jan 2014 22:25:51 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:25:51 - job_xml_thread(): Done retrieving: data size 43886112
Thu 16 Jan 2014 22:25:51 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:25:51 - XML: Start document: iteration 14
Thu 16 Jan 2014 22:25:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43886112
Thu 16 Jan 2014 22:25:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:25:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43886112
Thu 16 Jan 2014 22:25:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:25:53 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:25:53 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 22:26:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:26:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:26:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:26:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:26:08 - XML: Processed 655648 elements - found 725 jobs
Thu 16 Jan 2014 22:26:08 - job 7346708 appears to have finished
Thu 16 Jan 2014 22:26:08 - job 7346220 appears to have finished
Thu 16 Jan 2014 22:26:08 - job 7347032 report time 1389907381 does not match current heartbeat 1389907502 : ignoring job
Thu 16 Jan 2014 22:26:08 - job 7347028 appears to have finished
Thu 16 Jan 2014 22:26:08 - job 7347022 appears to have finished
Thu 16 Jan 2014 22:26:08 - job_xml_thread(): Found 7 updated jobs.
Thu 16 Jan 2014 22:26:08 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 22:26:10 - job_xml_thread(): Done storing. succesfully stored: 7 jobs
Thu 16 Jan 2014 22:26:10 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:26:10 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:26:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:26:11 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:26:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:26:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:26:11 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:26:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:26:11 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:26:11 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:26:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:26:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:26:15 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:26:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:26:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:26:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:26:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:26:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:26:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:26:18 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:26:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 22:26:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:26:19 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:26:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43882669
Thu 16 Jan 2014 22:26:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:26:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43882669
Thu 16 Jan 2014 22:26:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:26:25 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:26:25 - job_xml_thread(): Done retrieving: data size 43882669
Thu 16 Jan 2014 22:26:26 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:26:26 - XML: Start document: iteration 15
Thu 16 Jan 2014 22:26:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:26:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:26:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:26:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:26:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:26:32 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:26:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:26:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:26:32 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:26:32 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:26:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:26:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:26:32 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:26:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:26:42 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:26:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:26:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:26:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:26:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:26:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:26:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:26:43 - XML: Processed 655648 elements - found 725 jobs
Thu 16 Jan 2014 22:26:43 - job 7347032 report time 1389907381 does not match current heartbeat 1389907502 : ignoring job
Thu 16 Jan 2014 22:26:43 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:26:43 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:26:43 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:26:43 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:26:46 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:26:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867308
Thu 16 Jan 2014 22:26:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:26:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43867308
Thu 16 Jan 2014 22:26:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:26:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:26:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:26:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:26:50 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:26:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:26:51 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:26:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 22:26:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 22:26:51 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:26:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6768 values 106692 bits 13336 bytes 
Thu 16 Jan 2014 22:26:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:26:57 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:26:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:26:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:26:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:26:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:26:58 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:26:58 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:26:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:26:58 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:26:58 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:26:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:27:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:27:02 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:27:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:27:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:27:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:27:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:27:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:27:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:27:09 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:27:09 - job_xml_thread(): Done retrieving: data size 43883764
Thu 16 Jan 2014 22:27:09 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:27:09 - XML: Start document: iteration 16
Thu 16 Jan 2014 22:27:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43883764
Thu 16 Jan 2014 22:27:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:27:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43883764
Thu 16 Jan 2014 22:27:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:27:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:27:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:27:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:27:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:27:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:27:22 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:27:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:27:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:27:22 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:27:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:27:22 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:27:22 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:27:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:27:27 - XML: Processed 655648 elements - found 725 jobs
Thu 16 Jan 2014 22:27:27 - job 7347032 report time 1389907381 does not match current heartbeat 1389907502 : ignoring job
Thu 16 Jan 2014 22:27:27 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:27:27 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:27:27 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:27:27 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:27:28 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:27:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 22:27:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:27:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:27:30 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:27:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:27:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:27:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:27:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:27:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:27:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:27:34 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:27:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867668
Thu 16 Jan 2014 22:27:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:27:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43867668
Thu 16 Jan 2014 22:27:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:27:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:27:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:27:42 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:27:42 - job_xml_thread(): Done retrieving: data size 43867668
Thu 16 Jan 2014 22:27:43 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:27:43 - XML: Start document: iteration 17
Thu 16 Jan 2014 22:27:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:27:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:27:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:27:51 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:27:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:27:52 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:27:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 22:27:52 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:27:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 22:27:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6034 values 95240 bits 11905 bytes 
Thu 16 Jan 2014 22:27:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:27:53 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:27:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:27:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:27:53 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:27:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:27:53 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:27:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:27:53 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:27:56 - XML: Processed 655650 elements - found 726 jobs
Thu 16 Jan 2014 22:27:56 - job 7347035 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:27:56 - job 7347034 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:27:56 - job 7347032 report time 1389907381 does not match current heartbeat 1389907622 : ignoring job
Thu 16 Jan 2014 22:27:56 - job_xml_thread(): Found 3 updated jobs.
Thu 16 Jan 2014 22:27:56 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 22:27:56 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Thu 16 Jan 2014 22:27:56 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:27:56 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:27:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:27:58 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:27:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:27:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:27:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:27:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:27:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:27:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:28:00 - Leaving storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 22:28:00 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Thu 16 Jan 2014 22:28:00 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:28:01 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:28:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43897314
Thu 16 Jan 2014 22:28:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:28:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43897314
Thu 16 Jan 2014 22:28:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:28:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:28:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:28:11 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:28:11 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:28:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:28:12 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:28:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:28:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:28:12 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:28:12 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:28:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:28:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:28:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:28:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:28:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:28:16 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:28:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:28:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:28:16 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:28:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 22:28:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:28:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:28:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:28:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:28:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:28:18 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:28:18 - job_xml_thread(): Done retrieving: data size 43890039
Thu 16 Jan 2014 22:28:18 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:28:18 - XML: Start document: iteration 18
Thu 16 Jan 2014 22:28:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43890039
Thu 16 Jan 2014 22:28:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:28:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43890039
Thu 16 Jan 2014 22:28:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:28:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:28:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:28:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:28:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:28:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:28:39 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:28:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:28:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:28:40 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:28:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:28:40 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:28:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:28:40 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:28:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:28:42 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:28:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:28:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:28:42 - XML: Processed 655644 elements - found 723 jobs
Thu 16 Jan 2014 22:28:42 - job 7346852 appears to have finished
Thu 16 Jan 2014 22:28:42 - job 7346688 appears to have finished
Thu 16 Jan 2014 22:28:42 - job_xml_thread(): Found 2 updated jobs.
Thu 16 Jan 2014 22:28:42 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 22:28:42 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Thu 16 Jan 2014 22:28:42 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:28:42 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:28:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:28:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:28:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:28:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:28:44 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:28:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43916492
Thu 16 Jan 2014 22:28:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:28:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43916492
Thu 16 Jan 2014 22:28:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:28:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:28:53 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:28:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:28:54 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:28:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 22:28:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 22:28:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:28:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:28:55 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:28:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8878 values 140018 bits 17502 bytes 
Thu 16 Jan 2014 22:28:57 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:28:57 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:28:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:28:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:28:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:28:58 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:28:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:28:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:28:59 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:28:59 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:28:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:28:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:29:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:29:00 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:29:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:29:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:29:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:29:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:29:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:29:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:29:03 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:29:03 - job_xml_thread(): Done retrieving: data size 43893137
Thu 16 Jan 2014 22:29:03 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:29:03 - XML: Start document: iteration 19
Thu 16 Jan 2014 22:29:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43893137
Thu 16 Jan 2014 22:29:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:29:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43893137
Thu 16 Jan 2014 22:29:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:29:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:29:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:29:15 - XML: Processed 655644 elements - found 723 jobs
Thu 16 Jan 2014 22:29:15 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:29:15 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:29:15 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:29:15 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:29:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:29:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:29:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:29:21 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:29:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:29:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:29:22 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:29:22 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:29:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:29:22 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:29:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:29:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:29:25 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:29:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:29:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:29:25 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:29:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 22:29:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:29:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:29:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:29:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:29:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:29:27 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:29:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851108
Thu 16 Jan 2014 22:29:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:29:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851108
Thu 16 Jan 2014 22:29:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:29:30 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:29:30 - job_xml_thread(): Done retrieving: data size 43851108
Thu 16 Jan 2014 22:29:30 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:29:30 - XML: Start document: iteration 20
Thu 16 Jan 2014 22:29:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:29:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:29:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:29:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:29:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:29:41 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:29:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:29:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:29:43 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:29:43 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:29:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:29:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:29:43 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:29:50 - XML: Processed 654896 elements - found 723 jobs
Thu 16 Jan 2014 22:29:50 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:29:50 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:29:50 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:29:50 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:29:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:29:50 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:29:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:29:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:29:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:29:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:29:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:29:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:29:52 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:29:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43257539
Thu 16 Jan 2014 22:29:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:29:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43257539
Thu 16 Jan 2014 22:29:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:29:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:29:55 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:29:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:29:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:29:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:29:58 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:29:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 22:29:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 22:29:58 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:29:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9101 values 143591 bits 17948 bytes 
Thu 16 Jan 2014 22:30:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:30:04 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:30:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:30:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:30:05 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:30:05 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:30:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:30:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:30:06 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:30:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:30:06 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:30:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:30:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:30:08 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:30:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:30:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:30:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:30:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:30:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:30:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:30:10 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:30:10 - job_xml_thread(): Done retrieving: data size 43238979
Thu 16 Jan 2014 22:30:10 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:30:10 - Housekeeping: checking database for timed out jobs..
Thu 16 Jan 2014 22:30:10 - Housekeeping: Found 0 timed out jobs in database: closing entries
Thu 16 Jan 2014 22:30:10 - Housekeeping: done.
Thu 16 Jan 2014 22:30:10 - XML: Start document: iteration 0
Thu 16 Jan 2014 22:30:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43238979
Thu 16 Jan 2014 22:30:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:30:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43238979
Thu 16 Jan 2014 22:30:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:30:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:30:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:30:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:30:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:30:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:30:27 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:30:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:30:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:30:28 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:30:28 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:30:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:30:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:30:28 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:30:30 - XML: Processed 647442 elements - found 722 jobs
Thu 16 Jan 2014 22:30:30 - job 7335188 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:30:30 - job 7346456 appears to have finished
Thu 16 Jan 2014 22:30:30 - job 7343754 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:30:30 - job 7347021 appears to have finished
Thu 16 Jan 2014 22:30:30 - job_xml_thread(): Found 5 updated jobs.
Thu 16 Jan 2014 22:30:30 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 22:30:32 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Thu 16 Jan 2014 22:30:32 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:30:32 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:30:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:30:33 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:30:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:30:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:30:33 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:30:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 22:30:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:30:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:30:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:30:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:30:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:30:35 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:30:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43742146
Thu 16 Jan 2014 22:30:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:30:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43742146
Thu 16 Jan 2014 22:30:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:30:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:30:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:30:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:30:45 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:30:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:30:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:30:46 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:30:46 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:30:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:30:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:30:46 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:30:47 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:30:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:30:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:30:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:30:49 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:30:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:30:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:30:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:30:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:30:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:30:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:30:51 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:30:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43864026
Thu 16 Jan 2014 22:30:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:30:51 - job_xml_thread(): Done retrieving: data size 43864026
Thu 16 Jan 2014 22:30:51 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:30:51 - XML: Start document: iteration 1
Thu 16 Jan 2014 22:30:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43864026
Thu 16 Jan 2014 22:30:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:30:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:30:59 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:31:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:31:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:31:01 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:31:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 22:31:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:31:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 22:31:02 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:31:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:31:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8860 values 139731 bits 17466 bytes 
Thu 16 Jan 2014 22:31:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:31:06 - XML: Processed 655340 elements - found 722 jobs
Thu 16 Jan 2014 22:31:07 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:31:07 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:31:07 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:31:07 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:31:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:31:07 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:31:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:31:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:31:08 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:31:08 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:31:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:31:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:31:08 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:31:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:31:12 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:31:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:31:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:31:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:31:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:31:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:31:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:31:15 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:31:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43906591
Thu 16 Jan 2014 22:31:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:31:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43906591
Thu 16 Jan 2014 22:31:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:31:22 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:31:22 - job_xml_thread(): Done retrieving: data size 43906591
Thu 16 Jan 2014 22:31:22 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:31:22 - XML: Start document: iteration 2
Thu 16 Jan 2014 22:31:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:31:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:31:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:31:24 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:31:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:31:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:31:27 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:31:27 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:31:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:31:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:31:27 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:31:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:31:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:31:33 - XML: Processed 655642 elements - found 722 jobs
Thu 16 Jan 2014 22:31:33 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:31:33 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:31:33 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:31:33 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:31:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:31:37 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:31:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:31:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:31:37 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:31:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 22:31:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:31:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:31:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:31:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:31:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:31:39 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:31:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43866072
Thu 16 Jan 2014 22:31:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:31:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43866072
Thu 16 Jan 2014 22:31:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:31:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:31:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:31:48 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:31:48 - job_xml_thread(): Done retrieving: data size 43866072
Thu 16 Jan 2014 22:31:48 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:31:48 - XML: Start document: iteration 3
Thu 16 Jan 2014 22:31:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:31:50 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:31:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:31:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:31:50 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:31:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:31:50 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:31:50 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:31:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:31:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:31:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:31:53 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Thu 16 Jan 2014 22:31:53 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:31:54 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:31:54 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 22:31:54 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 22:31:54 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:31:54 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 22:31:58 - size of cluster 'LISA Cluster': 624 hosts 79468 metrics 853265 values 13463561 bits 1682945 bytes 
Thu 16 Jan 2014 22:31:59 - XML: Processed 655640 elements - found 721 jobs
Thu 16 Jan 2014 22:31:59 - job 7345092 appears to have finished
Thu 16 Jan 2014 22:31:59 - job 7347031 appears to have finished
Thu 16 Jan 2014 22:31:59 - job_xml_thread(): Found 3 updated jobs.
Thu 16 Jan 2014 22:31:59 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 22:32:00 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Thu 16 Jan 2014 22:32:00 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:32:00 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:32:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:32:02 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:32:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:32:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 22:32:03 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:32:03 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:32:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 22:32:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5850 values 92522 bits 11565 bytes 
Thu 16 Jan 2014 22:32:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:32:04 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:32:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:32:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:32:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:32:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:32:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:32:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:32:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:32:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:32:08 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:32:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856728
Thu 16 Jan 2014 22:32:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:32:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43856728
Thu 16 Jan 2014 22:32:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:32:15 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:32:15 - job_xml_thread(): Done retrieving: data size 43856728
Thu 16 Jan 2014 22:32:15 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:32:15 - XML: Start document: iteration 4
Thu 16 Jan 2014 22:32:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:32:18 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:32:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:32:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:32:18 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:32:18 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:32:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:32:18 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:32:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:32:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:32:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:32:29 - XML: Processed 655640 elements - found 721 jobs
Thu 16 Jan 2014 22:32:29 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:32:30 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:32:30 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:32:30 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:32:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:32:31 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:32:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:32:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:32:32 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:32:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 22:32:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:32:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:32:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:32:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:32:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:32:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:32:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:32:34 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:32:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855731
Thu 16 Jan 2014 22:32:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:32:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855731
Thu 16 Jan 2014 22:32:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:32:45 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:32:45 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:32:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:32:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:32:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:32:48 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:32:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:32:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:32:48 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:32:49 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:32:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:32:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:32:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:32:50 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:32:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:32:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:32:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:32:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:32:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:32:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:32:54 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:32:54 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 22:32:54 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:32:54 - job_xml_thread(): Done retrieving: data size 43888618
Thu 16 Jan 2014 22:32:54 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:32:54 - XML: Start document: iteration 5
Thu 16 Jan 2014 22:32:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43888618
Thu 16 Jan 2014 22:32:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43888618
Thu 16 Jan 2014 22:32:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:32:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:33:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:33:03 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:33:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:33:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:33:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:33:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 22:33:04 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:33:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8599 values 136021 bits 17002 bytes 
Thu 16 Jan 2014 22:33:04 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:33:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 22:33:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:33:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:33:08 - XML: Processed 655640 elements - found 721 jobs
Thu 16 Jan 2014 22:33:08 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:33:08 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:33:08 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:33:08 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:33:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:33:12 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:33:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:33:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:33:13 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:33:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:33:13 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:33:13 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:33:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:33:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:33:19 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:33:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:33:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:33:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:33:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:33:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:33:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:33:23 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:33:23 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:33:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43880753
Thu 16 Jan 2014 22:33:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:33:24 - job_xml_thread(): Done retrieving: data size 43880753
Thu 16 Jan 2014 22:33:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43880753
Thu 16 Jan 2014 22:33:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:33:24 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:33:24 - XML: Start document: iteration 6
Thu 16 Jan 2014 22:33:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:33:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:33:32 - XML: Processed 655640 elements - found 721 jobs
Thu 16 Jan 2014 22:33:32 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:33:32 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:33:32 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:33:32 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:33:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:33:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:33:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:33:42 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:33:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:33:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:33:43 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:33:43 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:33:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:33:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:33:43 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:33:47 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:33:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:33:47 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:33:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:33:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:33:47 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:33:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 22:33:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:33:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:33:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:33:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:33:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:33:51 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:33:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43881787
Thu 16 Jan 2014 22:33:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:33:51 - job_xml_thread(): Done retrieving: data size 43881787
Thu 16 Jan 2014 22:33:51 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:33:51 - XML: Start document: iteration 7
Thu 16 Jan 2014 22:33:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43881787
Thu 16 Jan 2014 22:33:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:33:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:33:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:34:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:34:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:34:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:34:04 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:34:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:34:05 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:34:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 22:34:05 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:34:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 22:34:06 - XML: Processed 655636 elements - found 719 jobs
Thu 16 Jan 2014 22:34:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6031 values 95280 bits 11910 bytes 
Thu 16 Jan 2014 22:34:06 - job 7346003 appears to have finished
Thu 16 Jan 2014 22:34:06 - job 7346833 appears to have finished
Thu 16 Jan 2014 22:34:06 - job_xml_thread(): Found 2 updated jobs.
Thu 16 Jan 2014 22:34:06 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 22:34:08 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Thu 16 Jan 2014 22:34:08 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:34:08 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:34:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:34:11 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:34:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:34:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:34:12 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:34:12 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:34:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:34:12 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:34:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:34:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:34:15 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:34:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:34:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:34:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:34:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:34:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:34:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:34:20 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:34:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43886601
Thu 16 Jan 2014 22:34:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:34:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43886601
Thu 16 Jan 2014 22:34:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:34:23 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:34:24 - job_xml_thread(): Done retrieving: data size 43886601
Thu 16 Jan 2014 22:34:24 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:34:24 - XML: Start document: iteration 8
Thu 16 Jan 2014 22:34:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:34:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:34:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:34:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:34:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:34:40 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:34:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:34:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:34:41 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:34:41 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:34:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:34:41 - XML: Processed 655636 elements - found 719 jobs
Thu 16 Jan 2014 22:34:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:34:41 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:34:41 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:34:41 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:34:41 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:34:41 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:34:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:34:45 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:34:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:34:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:34:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:34:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:34:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:34:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:34:46 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:34:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 22:34:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:34:49 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:34:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43877884
Thu 16 Jan 2014 22:34:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:34:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43877884
Thu 16 Jan 2014 22:34:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:34:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:34:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:34:56 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:34:56 - job_xml_thread(): Done retrieving: data size 43877884
Thu 16 Jan 2014 22:34:56 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:34:56 - XML: Start document: iteration 9
Thu 16 Jan 2014 22:35:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:35:00 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:35:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:35:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:35:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:35:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:35:01 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:35:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:35:01 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:35:01 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:35:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:35:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:35:05 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:35:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:35:06 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:35:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 22:35:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 22:35:06 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:35:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5813 values 91719 bits 11464 bytes 
Thu 16 Jan 2014 22:35:09 - XML: Processed 655633 elements - found 719 jobs
Thu 16 Jan 2014 22:35:09 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:35:09 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:35:09 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:35:09 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:35:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:35:12 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:35:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:35:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:35:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:35:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:35:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:35:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:35:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:35:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:35:16 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:35:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875699
Thu 16 Jan 2014 22:35:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:35:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875699
Thu 16 Jan 2014 22:35:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:35:24 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:35:24 - job_xml_thread(): Done retrieving: data size 43875699
Thu 16 Jan 2014 22:35:24 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:35:24 - XML: Start document: iteration 10
Thu 16 Jan 2014 22:35:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:35:27 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:35:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:35:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:35:28 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:35:28 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:35:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:35:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:35:28 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:35:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:35:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:35:37 - XML: Processed 655635 elements - found 719 jobs
Thu 16 Jan 2014 22:35:37 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:35:37 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:35:37 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:35:37 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:35:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:35:39 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:35:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:35:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:35:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:35:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:35:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:35:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:35:39 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:35:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 22:35:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:35:43 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:35:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43294399
Thu 16 Jan 2014 22:35:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:35:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43294399
Thu 16 Jan 2014 22:35:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:35:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:35:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:35:52 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:35:52 - job_xml_thread(): Done retrieving: data size 43294399
Thu 16 Jan 2014 22:35:52 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:35:52 - XML: Start document: iteration 11
Thu 16 Jan 2014 22:35:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:35:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:35:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:35:56 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:35:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:35:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:35:58 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:35:58 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:35:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:35:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:35:59 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:36:02 - XML: Processed 648452 elements - found 719 jobs
Thu 16 Jan 2014 22:36:02 - job 7347033 appears to have finished
Thu 16 Jan 2014 22:36:02 - job 7346302 appears to have finished
Thu 16 Jan 2014 22:36:02 - job_xml_thread(): Found 4 updated jobs.
Thu 16 Jan 2014 22:36:02 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 22:36:03 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Thu 16 Jan 2014 22:36:03 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:36:03 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:36:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:36:06 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:36:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:36:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:36:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:36:06 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:36:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:36:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:36:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:36:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:36:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:36:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 22:36:06 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:36:06 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:36:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5620 values 88631 bits 11078 bytes 
Thu 16 Jan 2014 22:36:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 22:36:08 - Leaving storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 22:36:08 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Thu 16 Jan 2014 22:36:08 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:36:09 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:36:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43219926
Thu 16 Jan 2014 22:36:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:36:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43219926
Thu 16 Jan 2014 22:36:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:36:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:36:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:36:18 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:36:18 - job_xml_thread(): Done retrieving: data size 43219926
Thu 16 Jan 2014 22:36:18 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:36:18 - XML: Start document: iteration 12
Thu 16 Jan 2014 22:36:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:36:21 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:36:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:36:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:36:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:36:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:36:23 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:36:23 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:36:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:36:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:36:23 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:36:32 - XML: Processed 647436 elements - found 719 jobs
Thu 16 Jan 2014 22:36:32 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:36:32 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:36:32 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:36:32 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:36:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:36:33 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:36:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:36:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:36:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:36:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:36:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:36:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:36:33 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:36:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 22:36:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:36:34 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:36:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43681996
Thu 16 Jan 2014 22:36:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:36:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43681996
Thu 16 Jan 2014 22:36:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:36:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:36:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:36:47 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:36:47 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:36:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:36:48 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:36:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:36:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:36:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:36:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:36:49 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:36:49 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:36:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:36:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:36:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:36:50 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:36:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:36:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:36:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:36:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:36:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:36:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:36:51 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:36:51 - job_xml_thread(): Done retrieving: data size 43843422
Thu 16 Jan 2014 22:36:51 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:36:51 - XML: Start document: iteration 13
Thu 16 Jan 2014 22:36:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43843422
Thu 16 Jan 2014 22:36:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:36:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43843422
Thu 16 Jan 2014 22:36:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:37:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:37:05 - XML: Processed 655036 elements - found 719 jobs
Thu 16 Jan 2014 22:37:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:37:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:37:05 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:37:05 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:37:05 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:37:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:37:05 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:37:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:37:06 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:37:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:37:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 22:37:09 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:37:09 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:37:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 22:37:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8455 values 133377 bits 16672 bytes 
Thu 16 Jan 2014 22:37:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:37:12 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:37:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:37:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:37:13 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:37:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:37:13 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:37:13 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:37:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:37:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:37:14 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:37:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:37:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:37:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:37:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:37:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:37:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:37:18 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:37:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43896435
Thu 16 Jan 2014 22:37:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:37:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43896435
Thu 16 Jan 2014 22:37:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:37:20 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:37:20 - job_xml_thread(): Done retrieving: data size 43896435
Thu 16 Jan 2014 22:37:20 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:37:20 - XML: Start document: iteration 14
Thu 16 Jan 2014 22:37:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:37:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:37:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:37:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:37:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:37:34 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:37:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:37:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:37:34 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:37:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:37:34 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:37:34 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:37:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:37:38 - XML: Processed 655635 elements - found 719 jobs
Thu 16 Jan 2014 22:37:38 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:37:38 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:37:38 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:37:38 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:37:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:37:40 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:37:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:37:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:37:40 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:37:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 22:37:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:37:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:37:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:37:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:37:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:37:42 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:37:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43901529
Thu 16 Jan 2014 22:37:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:37:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43901529
Thu 16 Jan 2014 22:37:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:37:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:37:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:37:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:37:52 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:37:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:37:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:37:54 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:37:54 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:37:54 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:37:54 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:37:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:37:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:37:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:37:55 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:37:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:37:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:37:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:37:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:37:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:37:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:37:58 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:37:58 - job_xml_thread(): Done retrieving: data size 43920642
Thu 16 Jan 2014 22:37:58 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:37:58 - XML: Start document: iteration 15
Thu 16 Jan 2014 22:37:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43920642
Thu 16 Jan 2014 22:37:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:37:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43920642
Thu 16 Jan 2014 22:37:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:38:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:38:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:38:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:38:09 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:38:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:38:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 22:38:11 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:38:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9098 values 143600 bits 17950 bytes 
Thu 16 Jan 2014 22:38:11 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:38:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 22:38:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:38:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:38:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:38:14 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:38:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:38:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:38:16 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:38:16 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:38:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:38:16 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:38:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:38:19 - XML: Processed 655638 elements - found 720 jobs
Thu 16 Jan 2014 22:38:20 - job 7346850 appears to have finished
Thu 16 Jan 2014 22:38:20 - job_xml_thread(): Found 3 updated jobs.
Thu 16 Jan 2014 22:38:20 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 22:38:20 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Thu 16 Jan 2014 22:38:21 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:38:21 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:38:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:38:22 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:38:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:38:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:38:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:38:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:38:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:38:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:38:25 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:38:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43894363
Thu 16 Jan 2014 22:38:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:38:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43894363
Thu 16 Jan 2014 22:38:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:38:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:38:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:38:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:38:34 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:38:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:38:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:38:35 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:38:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:38:35 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:38:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:38:35 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:38:36 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:38:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:38:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:38:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:38:39 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:38:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:38:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:38:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:38:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:38:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:38:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:38:39 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:38:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 22:38:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:38:41 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:38:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43913622
Thu 16 Jan 2014 22:38:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:38:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43913622
Thu 16 Jan 2014 22:38:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:38:41 - job_xml_thread(): Done retrieving: data size 43913622
Thu 16 Jan 2014 22:38:41 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:38:41 - XML: Start document: iteration 16
Thu 16 Jan 2014 22:38:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:38:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:38:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:38:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:38:54 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Thu 16 Jan 2014 22:38:54 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:38:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:38:54 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:38:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:38:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:38:55 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:38:55 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:38:55 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:38:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:38:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:38:55 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:38:55 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 22:38:55 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 22:38:55 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:38:55 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 22:39:02 - XML: Processed 655638 elements - found 720 jobs
Thu 16 Jan 2014 22:39:02 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:39:02 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:39:02 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:39:02 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:39:02 - size of cluster 'LISA Cluster': 624 hosts 79479 metrics 818389 values 12919152 bits 1614894 bytes 
Thu 16 Jan 2014 22:39:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:39:05 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:39:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:39:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:39:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:39:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:39:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:39:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:39:08 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:39:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43864530
Thu 16 Jan 2014 22:39:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:39:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43864530
Thu 16 Jan 2014 22:39:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:39:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:39:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:39:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:39:11 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:39:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:39:11 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:39:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 22:39:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 22:39:11 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:39:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8772 values 138329 bits 17291 bytes 
Thu 16 Jan 2014 22:39:17 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:39:18 - job_xml_thread(): Done retrieving: data size 43864530
Thu 16 Jan 2014 22:39:18 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:39:18 - XML: Start document: iteration 17
Thu 16 Jan 2014 22:39:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:39:19 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:39:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:39:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:39:20 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:39:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:39:21 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:39:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:39:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:39:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:39:22 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:39:28 - XML: Processed 655638 elements - found 720 jobs
Thu 16 Jan 2014 22:39:29 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:39:29 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:39:29 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:39:29 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:39:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:39:32 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:39:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:39:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:39:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:39:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:39:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:39:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:39:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:39:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:39:36 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:39:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43859337
Thu 16 Jan 2014 22:39:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:39:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43859337
Thu 16 Jan 2014 22:39:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:39:42 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:39:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 22:39:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:39:44 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:39:44 - job_xml_thread(): Done retrieving: data size 43859337
Thu 16 Jan 2014 22:39:44 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:39:44 - XML: Start document: iteration 18
Thu 16 Jan 2014 22:39:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:39:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:39:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:39:55 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:39:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:39:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:39:56 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:39:56 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 22:39:58 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:39:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:39:59 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:39:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:39:59 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:39:59 - XML: Processed 655638 elements - found 720 jobs
Thu 16 Jan 2014 22:39:59 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:39:59 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:39:59 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:39:59 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:40:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:40:00 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:40:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:40:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:40:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:40:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:40:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:40:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:40:04 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:40:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43893952
Thu 16 Jan 2014 22:40:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:40:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43893952
Thu 16 Jan 2014 22:40:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:40:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:40:12 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:40:12 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:40:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 22:40:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:40:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 22:40:13 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:40:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6253 values 98704 bits 12338 bytes 
Thu 16 Jan 2014 22:40:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:40:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:40:15 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:40:15 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:40:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:40:15 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:40:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:40:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:40:16 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:40:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:40:16 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:40:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:40:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:40:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:40:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:40:20 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:40:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:40:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:40:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:40:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:40:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:40:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:40:24 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:40:24 - job_xml_thread(): Done retrieving: data size 43874224
Thu 16 Jan 2014 22:40:24 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:40:24 - XML: Start document: iteration 19
Thu 16 Jan 2014 22:40:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43874224
Thu 16 Jan 2014 22:40:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:40:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43874224
Thu 16 Jan 2014 22:40:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:40:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:40:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:40:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:40:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:40:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:40:43 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:40:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:40:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:40:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:40:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:40:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:40:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:40:44 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:40:45 - XML: Processed 655636 elements - found 719 jobs
Thu 16 Jan 2014 22:40:46 - job 7346933 appears to have finished
Thu 16 Jan 2014 22:40:46 - job_xml_thread(): Found 1 updated jobs.
Thu 16 Jan 2014 22:40:46 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 22:40:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:40:47 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:40:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:40:48 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Thu 16 Jan 2014 22:40:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:40:48 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:40:48 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:40:49 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:40:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:40:49 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:40:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:40:50 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:40:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 22:40:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:40:52 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:40:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43869506
Thu 16 Jan 2014 22:40:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:40:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43869506
Thu 16 Jan 2014 22:40:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:40:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:40:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:41:03 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:41:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:41:04 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:41:04 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:41:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:41:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:41:06 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:41:06 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:41:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:41:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:41:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:41:07 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:41:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:41:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:41:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:41:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:41:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:41:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:41:11 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:41:11 - job_xml_thread(): Done retrieving: data size 43822913
Thu 16 Jan 2014 22:41:11 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:41:11 - XML: Start document: iteration 20
Thu 16 Jan 2014 22:41:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43822913
Thu 16 Jan 2014 22:41:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43822913
Thu 16 Jan 2014 22:41:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:41:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:41:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:41:13 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:41:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:41:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 22:41:14 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:41:14 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:41:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 22:41:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5679 values 89552 bits 11194 bytes 
Thu 16 Jan 2014 22:41:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:41:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:41:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:41:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:41:26 - XML: Processed 654888 elements - found 719 jobs
Thu 16 Jan 2014 22:41:26 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:41:26 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:41:26 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:41:26 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:41:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:41:30 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:41:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:41:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:41:31 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:41:31 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:41:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:41:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:41:31 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:41:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:41:34 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:41:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:41:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:41:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:41:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:41:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:41:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:41:38 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:41:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43321714
Thu 16 Jan 2014 22:41:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:41:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43321714
Thu 16 Jan 2014 22:41:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:41:41 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:41:41 - job_xml_thread(): Done retrieving: data size 43321714
Thu 16 Jan 2014 22:41:41 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:41:41 - Housekeeping: checking database for timed out jobs..
Thu 16 Jan 2014 22:41:41 - Housekeeping: Found 0 timed out jobs in database: closing entries
Thu 16 Jan 2014 22:41:41 - Housekeeping: done.
Thu 16 Jan 2014 22:41:41 - XML: Start document: iteration 0
Thu 16 Jan 2014 22:41:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:41:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:41:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:41:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:41:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:41:51 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:41:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:41:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:41:53 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:41:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:41:53 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:41:53 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:41:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:42:00 - XML: Processed 648742 elements - found 720 jobs
Thu 16 Jan 2014 22:42:01 - job_xml_thread(): Found 1 updated jobs.
Thu 16 Jan 2014 22:42:01 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 22:42:01 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Thu 16 Jan 2014 22:42:01 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:42:01 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:42:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:42:03 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:42:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:42:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:42:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:42:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:42:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:42:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:42:03 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:42:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 22:42:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:42:05 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:42:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43210569
Thu 16 Jan 2014 22:42:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:42:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43210569
Thu 16 Jan 2014 22:42:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:42:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:42:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:42:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:42:14 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:42:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:42:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 22:42:15 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:42:15 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:42:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 22:42:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5827 values 91929 bits 11491 bytes 
Thu 16 Jan 2014 22:42:17 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:42:17 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:42:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:42:17 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:42:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:42:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:42:18 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:42:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:42:18 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:42:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:42:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:42:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:42:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:42:21 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:42:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:42:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:42:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:42:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:42:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:42:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:42:26 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:42:26 - job_xml_thread(): Done retrieving: data size 43287684
Thu 16 Jan 2014 22:42:26 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:42:26 - XML: Start document: iteration 1
Thu 16 Jan 2014 22:42:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43287684
Thu 16 Jan 2014 22:42:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:42:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43287684
Thu 16 Jan 2014 22:42:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:42:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:42:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:42:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:42:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:42:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:42:47 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:42:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:42:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:42:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:42:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:42:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:42:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:42:48 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:42:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:42:50 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:42:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:42:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:42:50 - XML: Processed 648186 elements - found 720 jobs
Thu 16 Jan 2014 22:42:50 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:42:50 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:42:50 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:42:50 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:42:50 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:42:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 22:42:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:42:50 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:42:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:42:50 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:42:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:42:53 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:42:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873041
Thu 16 Jan 2014 22:42:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:42:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873041
Thu 16 Jan 2014 22:42:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:43:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:43:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:43:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:43:05 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:43:05 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:43:05 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:43:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:43:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:43:06 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:43:06 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:43:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:43:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:43:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:43:09 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:43:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:43:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:43:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:43:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:43:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:43:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:43:12 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:43:12 - job_xml_thread(): Done retrieving: data size 43889194
Thu 16 Jan 2014 22:43:12 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:43:12 - XML: Start document: iteration 2
Thu 16 Jan 2014 22:43:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43889194
Thu 16 Jan 2014 22:43:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:43:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43889194
Thu 16 Jan 2014 22:43:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:43:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:43:16 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:43:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:43:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 22:43:19 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:43:19 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:43:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 22:43:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9059 values 142951 bits 17868 bytes 
Thu 16 Jan 2014 22:43:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:43:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:43:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:43:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:43:28 - XML: Processed 655638 elements - found 720 jobs
Thu 16 Jan 2014 22:43:28 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:43:28 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:43:28 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:43:28 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:43:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:43:32 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:43:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:43:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:43:34 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:43:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:43:34 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:43:34 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:43:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:43:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:43:36 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:43:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:43:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:43:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:43:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:43:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:43:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:43:41 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:43:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43886336
Thu 16 Jan 2014 22:43:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:43:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43886336
Thu 16 Jan 2014 22:43:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:43:43 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:43:43 - job_xml_thread(): Done retrieving: data size 43886336
Thu 16 Jan 2014 22:43:43 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:43:43 - XML: Start document: iteration 3
Thu 16 Jan 2014 22:43:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:43:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:43:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:43:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:43:56 - XML: Processed 655640 elements - found 721 jobs
Thu 16 Jan 2014 22:43:56 - job_xml_thread(): Found 1 updated jobs.
Thu 16 Jan 2014 22:43:56 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 22:43:56 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Thu 16 Jan 2014 22:43:56 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:43:56 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:44:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:44:00 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:44:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:44:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:44:01 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:44:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:44:01 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:44:01 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:44:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:44:01 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:44:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 22:44:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:44:03 - Leaving storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 22:44:03 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Thu 16 Jan 2014 22:44:03 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:44:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:44:04 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:44:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:44:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:44:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:44:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:44:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:44:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:44:06 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:44:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43879702
Thu 16 Jan 2014 22:44:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:44:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43879702
Thu 16 Jan 2014 22:44:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:44:11 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:44:11 - job_xml_thread(): Done retrieving: data size 43879702
Thu 16 Jan 2014 22:44:11 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:44:11 - XML: Start document: iteration 4
Thu 16 Jan 2014 22:44:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:44:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:44:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:44:19 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:44:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:44:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:44:21 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:44:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:44:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 22:44:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 22:44:21 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:44:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6097 values 96235 bits 12029 bytes 
Thu 16 Jan 2014 22:44:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:44:23 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:44:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:44:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:44:25 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:44:25 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:44:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:44:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:44:25 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:44:28 - XML: Processed 655637 elements - found 721 jobs
Thu 16 Jan 2014 22:44:28 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:44:28 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:44:28 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:44:28 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:44:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:44:30 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:44:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:44:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:44:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:44:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:44:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:44:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:44:32 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:44:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43898984
Thu 16 Jan 2014 22:44:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:44:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43898984
Thu 16 Jan 2014 22:44:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:44:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:44:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:44:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:44:42 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:44:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:44:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:44:43 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:44:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:44:43 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:44:43 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:44:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:44:43 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:44:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:44:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:44:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:44:48 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:44:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:44:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:44:48 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:44:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 22:44:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:44:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:44:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:44:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:44:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:44:50 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:44:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43880371
Thu 16 Jan 2014 22:44:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:44:50 - job_xml_thread(): Done retrieving: data size 43880371
Thu 16 Jan 2014 22:44:50 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:44:50 - XML: Start document: iteration 5
Thu 16 Jan 2014 22:44:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43880371
Thu 16 Jan 2014 22:44:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:44:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:44:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:45:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:45:03 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:45:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:45:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:45:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:45:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:45:04 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:45:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:45:04 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:45:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:45:04 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:45:09 - XML: Processed 655635 elements - found 721 jobs
Thu 16 Jan 2014 22:45:09 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:45:09 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:45:09 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:45:09 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:45:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:45:13 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:45:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:45:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:45:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:45:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:45:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:45:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:45:14 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:45:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43888399
Thu 16 Jan 2014 22:45:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:45:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43888399
Thu 16 Jan 2014 22:45:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:45:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:45:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:45:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:45:21 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:45:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:45:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 22:45:21 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:45:21 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:45:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 22:45:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8905 values 140498 bits 17562 bytes 
Thu 16 Jan 2014 22:45:25 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:45:25 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:45:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:45:25 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:45:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:45:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:45:25 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:45:25 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:45:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:45:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:45:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:45:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:45:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:45:30 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:45:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:45:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:45:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:45:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:45:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:45:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:45:32 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:45:32 - job_xml_thread(): Done retrieving: data size 43898309
Thu 16 Jan 2014 22:45:32 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:45:32 - XML: Start document: iteration 6
Thu 16 Jan 2014 22:45:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43898309
Thu 16 Jan 2014 22:45:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43898309
Thu 16 Jan 2014 22:45:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:45:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:45:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:45:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:45:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:45:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:45:49 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:45:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 22:45:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:45:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:45:50 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:45:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:45:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:45:50 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:45:50 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:45:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:45:50 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:45:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:45:52 - XML: Processed 655640 elements - found 721 jobs
Thu 16 Jan 2014 22:45:52 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:45:52 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:45:52 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:45:52 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:45:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:45:54 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:45:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:45:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:45:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:45:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:45:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:45:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:45:56 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:45:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43902286
Thu 16 Jan 2014 22:45:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:45:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43902286
Thu 16 Jan 2014 22:45:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:45:58 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Thu 16 Jan 2014 22:45:58 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:46:01 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:46:01 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:46:01 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 22:46:01 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 22:46:01 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 22:46:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:46:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:46:05 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:46:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:46:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:46:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:46:07 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:46:07 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:46:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:46:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:46:07 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:46:07 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:46:07 - size of cluster 'LISA Cluster': 624 hosts 79470 metrics 757028 values 11942303 bits 1492787 bytes 
Thu 16 Jan 2014 22:46:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:46:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:46:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:46:11 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:46:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:46:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:46:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:46:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:46:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:46:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:46:14 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:46:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43915545
Thu 16 Jan 2014 22:46:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:46:14 - job_xml_thread(): Done retrieving: data size 43915545
Thu 16 Jan 2014 22:46:14 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:46:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43915545
Thu 16 Jan 2014 22:46:15 - XML: Start document: iteration 7
Thu 16 Jan 2014 22:46:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:46:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:46:21 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:46:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:46:21 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:46:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 22:46:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 22:46:22 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:46:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:46:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:46:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9042 values 142777 bits 17847 bytes 
Thu 16 Jan 2014 22:46:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:46:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:46:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:46:36 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:46:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:46:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:46:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:46:37 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:46:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:46:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:46:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:46:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:46:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:46:37 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:46:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:46:38 - XML: Processed 655640 elements - found 721 jobs
Thu 16 Jan 2014 22:46:38 - job 7329928 appears to have finished
Thu 16 Jan 2014 22:46:38 - job 7334710 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:46:38 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:46:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:46:38 - job 7347024 appears to have finished
Thu 16 Jan 2014 22:46:38 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:46:38 - job_xml_thread(): Found 5 updated jobs.
Thu 16 Jan 2014 22:46:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:46:38 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 22:46:39 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Thu 16 Jan 2014 22:46:39 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:46:39 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:46:42 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:46:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43916269
Thu 16 Jan 2014 22:46:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:46:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43916269
Thu 16 Jan 2014 22:46:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:46:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:46:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:46:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:46:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:46:54 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:46:54 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:46:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:46:54 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:46:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:46:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:46:55 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:46:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:46:55 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:46:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:46:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:46:58 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:46:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:46:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:46:59 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:46:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 22:46:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:46:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:46:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:46:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:46:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:47:01 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:47:01 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 22:47:03 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:47:03 - job_xml_thread(): Done retrieving: data size 43900085
Thu 16 Jan 2014 22:47:03 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:47:03 - XML: Start document: iteration 8
Thu 16 Jan 2014 22:47:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43900085
Thu 16 Jan 2014 22:47:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:47:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43900085
Thu 16 Jan 2014 22:47:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:47:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:47:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:47:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:47:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:47:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:47:21 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:47:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:47:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:47:22 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:47:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:47:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:47:23 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:47:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 22:47:23 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:47:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5905 values 93446 bits 11680 bytes 
Thu 16 Jan 2014 22:47:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 22:47:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:47:24 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:47:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:47:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:47:24 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:47:24 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:47:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:47:24 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:47:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:47:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:47:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:47:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:47:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:47:25 - XML: Processed 655640 elements - found 721 jobs
Thu 16 Jan 2014 22:47:25 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:47:25 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:47:25 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:47:25 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:47:30 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:47:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43765989
Thu 16 Jan 2014 22:47:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:47:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43765989
Thu 16 Jan 2014 22:47:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:47:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:47:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:47:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:47:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:47:40 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:47:40 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:47:45 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:47:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 22:47:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:47:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:47:45 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:47:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:47:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:47:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:47:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:47:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:47:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:47:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:47:46 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:47:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:47:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:47:47 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:47:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:47:47 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:47:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:47:49 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:47:49 - job_xml_thread(): Done retrieving: data size 43260316
Thu 16 Jan 2014 22:47:49 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:47:49 - XML: Start document: iteration 9
Thu 16 Jan 2014 22:47:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43260316
Thu 16 Jan 2014 22:47:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:47:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43260316
Thu 16 Jan 2014 22:47:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:48:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:48:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:48:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:48:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:48:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:48:04 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:48:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:48:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:48:05 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:48:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:48:05 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:48:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:48:06 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:48:08 - XML: Processed 647980 elements - found 720 jobs
Thu 16 Jan 2014 22:48:08 - job 7347019 appears to have finished
Thu 16 Jan 2014 22:48:08 - job 7346853 appears to have finished
Thu 16 Jan 2014 22:48:08 - job_xml_thread(): Found 3 updated jobs.
Thu 16 Jan 2014 22:48:08 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 22:48:09 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Thu 16 Jan 2014 22:48:09 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:48:09 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:48:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:48:13 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:48:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:48:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:48:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:48:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:48:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:48:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:48:15 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:48:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43234484
Thu 16 Jan 2014 22:48:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:48:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43234484
Thu 16 Jan 2014 22:48:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:48:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:48:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:48:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:48:23 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:48:24 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:48:24 - job_xml_thread(): Done retrieving: data size 43234484
Thu 16 Jan 2014 22:48:24 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:48:24 - XML: Start document: iteration 10
Thu 16 Jan 2014 22:48:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:48:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 22:48:25 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:48:25 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:48:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 22:48:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9109 values 144116 bits 18014 bytes 
Thu 16 Jan 2014 22:48:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:48:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:48:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:48:28 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:48:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:48:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:48:29 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:48:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:48:29 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:48:29 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:48:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:48:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:48:38 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:48:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:48:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:48:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:48:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:48:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:48:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:48:39 - XML: Processed 647486 elements - found 720 jobs
Thu 16 Jan 2014 22:48:39 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:48:39 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:48:39 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:48:39 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:48:43 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:48:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43727146
Thu 16 Jan 2014 22:48:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:48:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43727146
Thu 16 Jan 2014 22:48:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:48:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:48:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:48:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:48:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:48:55 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:48:55 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:48:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:48:56 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:48:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:48:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:48:57 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:48:57 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:48:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:48:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:49:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:49:00 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:49:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:49:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:49:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:49:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:49:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:49:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:49:01 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:49:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 22:49:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:49:04 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:49:04 - job_xml_thread(): Done retrieving: data size 43859542
Thu 16 Jan 2014 22:49:04 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:49:04 - XML: Start document: iteration 11
Thu 16 Jan 2014 22:49:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43859542
Thu 16 Jan 2014 22:49:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:49:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43859542
Thu 16 Jan 2014 22:49:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:49:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:49:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:49:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:49:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:49:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:49:24 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:49:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:49:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:49:25 - XML: Processed 655416 elements - found 720 jobs
Thu 16 Jan 2014 22:49:25 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:49:25 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:49:25 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:49:25 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:49:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:49:25 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:49:26 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:49:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:49:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:49:26 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:49:26 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:49:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 22:49:26 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:49:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:49:26 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:49:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5818 values 91829 bits 11478 bytes 
Thu 16 Jan 2014 22:49:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 22:49:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:49:28 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:49:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:49:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:49:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:49:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:49:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:49:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:49:32 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:49:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43895052
Thu 16 Jan 2014 22:49:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:49:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43895052
Thu 16 Jan 2014 22:49:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:49:40 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:49:40 - job_xml_thread(): Done retrieving: data size 43895052
Thu 16 Jan 2014 22:49:40 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:49:40 - XML: Start document: iteration 12
Thu 16 Jan 2014 22:49:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:49:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:49:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:49:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:49:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:49:46 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:49:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:49:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:49:47 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:49:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:49:47 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:49:47 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:49:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:49:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:49:54 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:49:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:49:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:49:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:49:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:49:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:49:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:49:56 - XML: Processed 655638 elements - found 720 jobs
Thu 16 Jan 2014 22:49:56 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:49:56 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:49:56 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:49:56 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:49:56 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:49:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 22:49:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:50:01 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:50:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43882944
Thu 16 Jan 2014 22:50:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:50:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43882944
Thu 16 Jan 2014 22:50:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:50:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:50:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:50:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:50:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:50:11 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:50:11 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:50:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:50:11 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:50:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:50:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:50:12 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:50:12 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:50:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:50:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:50:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:50:16 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:50:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:50:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:50:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:50:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:50:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:50:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:50:19 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:50:19 - job_xml_thread(): Done retrieving: data size 43886074
Thu 16 Jan 2014 22:50:19 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:50:19 - XML: Start document: iteration 13
Thu 16 Jan 2014 22:50:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43886074
Thu 16 Jan 2014 22:50:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:50:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43886074
Thu 16 Jan 2014 22:50:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:50:25 - Leaving storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 22:50:25 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Thu 16 Jan 2014 22:50:25 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:50:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:50:27 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:50:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:50:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:50:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:50:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 22:50:27 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:50:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8913 values 140650 bits 17581 bytes 
Thu 16 Jan 2014 22:50:27 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:50:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 22:50:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:50:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:50:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:50:34 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:50:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:50:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:50:35 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:50:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:50:35 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:50:35 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:50:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:50:38 - XML: Processed 655636 elements - found 719 jobs
Thu 16 Jan 2014 22:50:38 - job 7346837 appears to have finished
Thu 16 Jan 2014 22:50:38 - job 7346544 appears to have finished
Thu 16 Jan 2014 22:50:38 - job 7334711 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:50:38 - job_xml_thread(): Found 4 updated jobs.
Thu 16 Jan 2014 22:50:38 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 22:50:39 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Thu 16 Jan 2014 22:50:39 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:50:39 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:50:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:50:41 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:50:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:50:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:50:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:50:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:50:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:50:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:50:44 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:50:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43912009
Thu 16 Jan 2014 22:50:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:50:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43912009
Thu 16 Jan 2014 22:50:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:50:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:50:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:50:54 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:50:54 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:50:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:50:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:50:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:50:57 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:50:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:50:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:50:58 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:50:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:50:58 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:50:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:50:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:50:59 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:50:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:50:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:50:59 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:50:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 22:50:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:51:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:51:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:51:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:51:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:51:01 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:51:01 - job_xml_thread(): Done retrieving: data size 43909014
Thu 16 Jan 2014 22:51:01 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:51:01 - XML: Start document: iteration 14
Thu 16 Jan 2014 22:51:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43909014
Thu 16 Jan 2014 22:51:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:51:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43909014
Thu 16 Jan 2014 22:51:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:51:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:51:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:51:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:51:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:51:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:51:19 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:51:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:51:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:51:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:51:20 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:51:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:51:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:51:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:51:21 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:51:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:51:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:51:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:51:22 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:51:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:51:22 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:51:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:51:23 - XML: Processed 655636 elements - found 719 jobs
Thu 16 Jan 2014 22:51:23 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:51:23 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:51:23 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:51:23 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:51:26 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:51:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43908202
Thu 16 Jan 2014 22:51:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:51:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43908202
Thu 16 Jan 2014 22:51:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:51:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:51:28 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:51:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:51:30 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:51:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 22:51:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 22:51:30 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:51:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9012 values 142193 bits 17774 bytes 
Thu 16 Jan 2014 22:51:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:51:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:51:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:51:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:51:38 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:51:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:51:38 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:51:38 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:51:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:51:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:51:39 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:51:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:51:39 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:51:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:51:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:51:41 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:51:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:51:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:51:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:51:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:51:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:51:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:51:43 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:51:43 - job_xml_thread(): Done retrieving: data size 43917204
Thu 16 Jan 2014 22:51:43 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:51:43 - XML: Start document: iteration 15
Thu 16 Jan 2014 22:51:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43917204
Thu 16 Jan 2014 22:51:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43917204
Thu 16 Jan 2014 22:51:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:51:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:51:52 - XML: Processed 655628 elements - found 715 jobs
Thu 16 Jan 2014 22:51:52 - job 7346691 appears to have finished
Thu 16 Jan 2014 22:51:52 - job 7346849 appears to have finished
Thu 16 Jan 2014 22:51:52 - job 7345922 appears to have finished
Thu 16 Jan 2014 22:51:52 - job 7346535 appears to have finished
Thu 16 Jan 2014 22:51:52 - job_xml_thread(): Found 4 updated jobs.
Thu 16 Jan 2014 22:51:52 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 22:51:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:51:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:51:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:51:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:51:57 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Thu 16 Jan 2014 22:51:57 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:51:57 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:52:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:52:00 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:52:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:52:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:52:00 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:52:00 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:52:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:52:00 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:52:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:52:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:52:05 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:52:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:52:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:52:05 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:52:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 22:52:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:52:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:52:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:52:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:52:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:52:07 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:52:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43890374
Thu 16 Jan 2014 22:52:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:52:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43890374
Thu 16 Jan 2014 22:52:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:52:12 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:52:12 - job_xml_thread(): Done retrieving: data size 43890374
Thu 16 Jan 2014 22:52:13 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:52:13 - XML: Start document: iteration 16
Thu 16 Jan 2014 22:52:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:52:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:52:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:52:21 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:52:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:52:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:52:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:52:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:52:23 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:52:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:52:23 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:52:23 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:52:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:52:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:52:30 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:52:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:52:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:52:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:52:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:52:30 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:52:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:52:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:52:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:52:30 - XML: Processed 655632 elements - found 717 jobs
Thu 16 Jan 2014 22:52:30 - job_xml_thread(): Found 2 updated jobs.
Thu 16 Jan 2014 22:52:30 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 22:52:30 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Thu 16 Jan 2014 22:52:30 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:52:30 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:52:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:52:31 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:52:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 22:52:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 22:52:31 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:52:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5702 values 89954 bits 11244 bytes 
Thu 16 Jan 2014 22:52:33 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:52:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43889277
Thu 16 Jan 2014 22:52:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:52:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43889277
Thu 16 Jan 2014 22:52:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:52:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:52:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:52:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:52:42 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:52:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:52:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:52:43 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:52:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:52:43 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:52:43 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:52:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:52:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:52:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:52:46 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:52:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:52:46 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:52:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:52:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:52:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:52:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:52:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:52:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:52:46 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:52:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 22:52:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:52:48 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:52:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43896960
Thu 16 Jan 2014 22:52:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:52:49 - job_xml_thread(): Done retrieving: data size 43896960
Thu 16 Jan 2014 22:52:49 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:52:49 - XML: Start document: iteration 17
Thu 16 Jan 2014 22:52:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43896960
Thu 16 Jan 2014 22:52:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:52:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:52:58 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:52:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:52:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:52:59 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:52:59 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:52:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:52:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:52:59 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:53:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:53:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:53:02 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Thu 16 Jan 2014 22:53:02 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:53:02 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:53:02 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 22:53:02 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:53:02 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 22:53:02 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 22:53:11 - XML: Processed 655632 elements - found 717 jobs
Thu 16 Jan 2014 22:53:11 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:53:11 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:53:11 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:53:11 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:53:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:53:12 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:53:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:53:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:53:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:53:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:53:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:53:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:53:12 - size of cluster 'LISA Cluster': 624 hosts 79481 metrics 812550 values 12827248 bits 1603406 bytes 
Thu 16 Jan 2014 22:53:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:53:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:53:15 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:53:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43872701
Thu 16 Jan 2014 22:53:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:53:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43872701
Thu 16 Jan 2014 22:53:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:53:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:53:25 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:53:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:53:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:53:26 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:53:26 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:53:26 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:53:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:53:27 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:53:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:53:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:53:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:53:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:53:30 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:53:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:53:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:53:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:53:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:53:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:53:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:53:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:53:31 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:53:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:53:31 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:53:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 22:53:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 22:53:31 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:53:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8760 values 138196 bits 17274 bytes 
Thu 16 Jan 2014 22:53:34 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:53:34 - job_xml_thread(): Done retrieving: data size 43426961
Thu 16 Jan 2014 22:53:34 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:53:34 - XML: Start document: iteration 18
Thu 16 Jan 2014 22:53:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43426961
Thu 16 Jan 2014 22:53:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43426961
Thu 16 Jan 2014 22:53:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:53:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:53:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:53:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:53:45 - XML: Processed 650005 elements - found 717 jobs
Thu 16 Jan 2014 22:53:45 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:53:45 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:53:45 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:53:45 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:53:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:53:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:53:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:53:57 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:53:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:53:58 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:53:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:53:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:53:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:53:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:53:59 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:53:59 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:53:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:53:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:53:59 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:53:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:53:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:53:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:53:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:54:00 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:54:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 22:54:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:54:00 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:54:02 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:54:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43233681
Thu 16 Jan 2014 22:54:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:54:02 - job_xml_thread(): Done retrieving: data size 43233681
Thu 16 Jan 2014 22:54:02 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:54:02 - XML: Start document: iteration 19
Thu 16 Jan 2014 22:54:02 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:54:02 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 22:54:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43233681
Thu 16 Jan 2014 22:54:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:54:11 - XML: Processed 647434 elements - found 718 jobs
Thu 16 Jan 2014 22:54:11 - job 7347014 appears to have finished
Thu 16 Jan 2014 22:54:11 - job 7347018 appears to have finished
Thu 16 Jan 2014 22:54:11 - job_xml_thread(): Found 5 updated jobs.
Thu 16 Jan 2014 22:54:11 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 22:54:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:54:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:54:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:54:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:54:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:54:19 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:54:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:54:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:54:19 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:54:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:54:19 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:54:19 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:54:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:54:20 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Thu 16 Jan 2014 22:54:20 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:54:20 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:54:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:54:24 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:54:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:54:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:54:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:54:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:54:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:54:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:54:27 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:54:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43304734
Thu 16 Jan 2014 22:54:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:54:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43304734
Thu 16 Jan 2014 22:54:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:54:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:54:31 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:54:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:54:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 22:54:34 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:54:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 22:54:34 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:54:35 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:54:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:54:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:54:35 - job_xml_thread(): Done retrieving: data size 43304734
Thu 16 Jan 2014 22:54:35 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:54:35 - XML: Start document: iteration 20
Thu 16 Jan 2014 22:54:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7738 values 122108 bits 15263 bytes 
Thu 16 Jan 2014 22:54:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:54:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:54:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:54:42 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:54:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:54:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:54:42 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:54:42 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:54:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:54:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:54:43 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:54:48 - XML: Processed 648182 elements - found 718 jobs
Thu 16 Jan 2014 22:54:48 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:54:48 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:54:48 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:54:48 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:54:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:54:49 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:54:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:54:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:54:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:54:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:54:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:54:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:54:53 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:54:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43835332
Thu 16 Jan 2014 22:54:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:54:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43835332
Thu 16 Jan 2014 22:54:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:54:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:54:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:55:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:55:02 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:55:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:55:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:55:03 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:55:03 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:55:03 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:55:03 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:55:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:55:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:55:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:55:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:55:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:55:08 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:55:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:55:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:55:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:55:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:55:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:55:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:55:08 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:55:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 22:55:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:55:12 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:55:12 - job_xml_thread(): Done retrieving: data size 43891694
Thu 16 Jan 2014 22:55:12 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:55:12 - Housekeeping: checking database for timed out jobs..
Thu 16 Jan 2014 22:55:12 - Housekeeping: Found 0 timed out jobs in database: closing entries
Thu 16 Jan 2014 22:55:12 - Housekeeping: done.
Thu 16 Jan 2014 22:55:12 - XML: Start document: iteration 0
Thu 16 Jan 2014 22:55:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43891694
Thu 16 Jan 2014 22:55:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:55:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43891694
Thu 16 Jan 2014 22:55:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:55:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:55:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:55:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:55:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:55:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:55:28 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:55:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:55:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:55:29 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:55:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:55:29 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:55:29 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:55:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:55:33 - XML: Processed 655634 elements - found 718 jobs
Thu 16 Jan 2014 22:55:33 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:55:33 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:55:33 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:55:33 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:55:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:55:34 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:55:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:55:35 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:55:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:55:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:55:35 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:55:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 22:55:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:55:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 22:55:35 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:55:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5679 values 89583 bits 11197 bytes 
Thu 16 Jan 2014 22:55:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:55:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:55:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:55:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:55:38 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:55:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 22:55:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:55:39 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:55:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43878149
Thu 16 Jan 2014 22:55:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:55:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43878149
Thu 16 Jan 2014 22:55:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:55:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:55:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:55:48 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:55:48 - job_xml_thread(): Done retrieving: data size 43878149
Thu 16 Jan 2014 22:55:48 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:55:48 - XML: Start document: iteration 1
Thu 16 Jan 2014 22:55:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:55:50 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:55:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:55:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:55:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:55:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:55:51 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:55:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:55:52 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:55:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:55:52 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:56:00 - XML: Processed 655634 elements - found 718 jobs
Thu 16 Jan 2014 22:56:00 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:56:00 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:56:00 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:56:00 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:56:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:56:03 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:56:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:56:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:56:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:56:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:56:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:56:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:56:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:56:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:56:08 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:56:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43857994
Thu 16 Jan 2014 22:56:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:56:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43857994
Thu 16 Jan 2014 22:56:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:56:15 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:56:15 - job_xml_thread(): Done retrieving: data size 43857994
Thu 16 Jan 2014 22:56:15 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:56:15 - XML: Start document: iteration 2
Thu 16 Jan 2014 22:56:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:56:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:56:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:56:22 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:56:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:56:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:56:24 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:56:24 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:56:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:56:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:56:24 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:56:26 - XML: Processed 655626 elements - found 714 jobs
Thu 16 Jan 2014 22:56:26 - job 7346847 appears to have finished
Thu 16 Jan 2014 22:56:26 - job 7347049 appears to have finished
Thu 16 Jan 2014 22:56:26 - job 7346792 appears to have finished
Thu 16 Jan 2014 22:56:26 - job 7346232 appears to have finished
Thu 16 Jan 2014 22:56:26 - job 7347054 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 22:56:26 - job_xml_thread(): Found 5 updated jobs.
Thu 16 Jan 2014 22:56:26 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 22:56:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:56:30 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:56:30 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Thu 16 Jan 2014 22:56:30 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:56:30 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:56:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:56:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:56:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:56:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:56:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:56:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:56:33 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:56:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43877253
Thu 16 Jan 2014 22:56:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:56:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43877253
Thu 16 Jan 2014 22:56:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:56:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:56:35 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:56:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:56:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 22:56:36 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:56:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148724 bits 18590 bytes 
Thu 16 Jan 2014 22:56:36 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:56:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 22:56:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:56:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:56:45 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:56:45 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:56:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:56:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:56:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:56:50 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:56:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:56:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:56:50 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:56:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:56:50 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:56:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:56:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:56:51 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:56:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:56:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:56:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:56:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:56:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:56:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:56:54 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:56:54 - job_xml_thread(): Done retrieving: data size 43891578
Thu 16 Jan 2014 22:56:54 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:56:54 - XML: Start document: iteration 3
Thu 16 Jan 2014 22:56:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43891578
Thu 16 Jan 2014 22:56:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43891578
Thu 16 Jan 2014 22:56:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:56:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:57:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:57:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:57:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:57:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:57:12 - XML: Processed 655626 elements - found 714 jobs
Thu 16 Jan 2014 22:57:12 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:57:12 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:57:12 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:57:12 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:57:14 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:57:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 22:57:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:57:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:57:16 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:57:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:57:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:57:17 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:57:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:57:17 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:57:17 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:57:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:57:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:57:18 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:57:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:57:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:57:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:57:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:57:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:57:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:57:19 - Leaving storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 22:57:19 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Thu 16 Jan 2014 22:57:19 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:57:21 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:57:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43897224
Thu 16 Jan 2014 22:57:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:57:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43897224
Thu 16 Jan 2014 22:57:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:57:28 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:57:28 - job_xml_thread(): Done retrieving: data size 43897224
Thu 16 Jan 2014 22:57:28 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:57:28 - XML: Start document: iteration 4
Thu 16 Jan 2014 22:57:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:57:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:57:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:57:34 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:57:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:57:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:57:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:57:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:57:35 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:57:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:57:35 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:57:35 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:57:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:57:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:57:36 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:57:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:57:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 22:57:38 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:57:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 22:57:38 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:57:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5997 values 94671 bits 11833 bytes 
Thu 16 Jan 2014 22:57:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:57:40 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:57:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:57:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:57:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:57:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:57:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:57:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:57:44 - XML: Processed 655626 elements - found 714 jobs
Thu 16 Jan 2014 22:57:44 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:57:44 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:57:44 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:57:44 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:57:47 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:57:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43880426
Thu 16 Jan 2014 22:57:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:57:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43880426
Thu 16 Jan 2014 22:57:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:57:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:57:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:57:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:57:55 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:57:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:57:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:57:56 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:57:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:57:56 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:57:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:57:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43880426
Thu 16 Jan 2014 22:57:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:57:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:57:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:57:59 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:57:59 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:58:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:58:05 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:58:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:58:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:58:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:58:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:58:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:58:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:58:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:58:08 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:58:09 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:58:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 22:58:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:58:10 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:58:10 - job_xml_thread(): Done retrieving: data size 43889263
Thu 16 Jan 2014 22:58:10 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:58:10 - XML: Start document: iteration 5
Thu 16 Jan 2014 22:58:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43889263
Thu 16 Jan 2014 22:58:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:58:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:58:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:58:13 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:58:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:58:13 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:58:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:58:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43889263
Thu 16 Jan 2014 22:58:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:58:21 - XML: Processed 655630 elements - found 716 jobs
Thu 16 Jan 2014 22:58:21 - job_xml_thread(): Found 2 updated jobs.
Thu 16 Jan 2014 22:58:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:58:21 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 22:58:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:58:23 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Thu 16 Jan 2014 22:58:23 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:58:23 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:58:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:58:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:58:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:58:29 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:58:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:58:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:58:29 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:58:29 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:58:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:58:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:58:29 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:58:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:58:33 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:58:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:58:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:58:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:58:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:58:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:58:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:58:34 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:58:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43885245
Thu 16 Jan 2014 22:58:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:58:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43885245
Thu 16 Jan 2014 22:58:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:58:38 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:58:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:58:38 - job_xml_thread(): Done retrieving: data size 43885245
Thu 16 Jan 2014 22:58:38 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:58:38 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:58:38 - XML: Start document: iteration 6
Thu 16 Jan 2014 22:58:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:58:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 22:58:39 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:58:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8955 values 141266 bits 17658 bytes 
Thu 16 Jan 2014 22:58:39 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:58:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 22:58:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:58:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:58:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:58:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:58:50 - XML: Processed 655630 elements - found 716 jobs
Thu 16 Jan 2014 22:58:50 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:58:50 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:58:50 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:58:50 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:58:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:58:53 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:58:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:58:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:58:55 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:58:55 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:58:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:58:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:58:55 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:58:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:58:55 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:58:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:58:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:58:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:58:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:58:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:58:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:58:59 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:58:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43923284
Thu 16 Jan 2014 22:58:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:58:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43923284
Thu 16 Jan 2014 22:58:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:59:06 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:59:06 - job_xml_thread(): Done retrieving: data size 43923284
Thu 16 Jan 2014 22:59:06 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:59:06 - XML: Start document: iteration 7
Thu 16 Jan 2014 22:59:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:59:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:59:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:59:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:59:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:59:18 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:59:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:59:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:59:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:59:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:59:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:59:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:59:20 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:59:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:59:21 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:59:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 22:59:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:59:23 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:59:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:59:23 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:59:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:59:23 - XML: Processed 655630 elements - found 716 jobs
Thu 16 Jan 2014 22:59:23 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 22:59:23 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 22:59:23 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 22:59:23 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 22:59:23 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:59:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 22:59:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:59:25 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:59:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43830791
Thu 16 Jan 2014 22:59:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:59:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43830791
Thu 16 Jan 2014 22:59:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:59:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:59:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:59:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 22:59:37 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 22:59:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:59:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:59:38 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 22:59:38 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 22:59:38 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:59:38 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:59:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 22:59:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 22:59:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 22:59:38 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 22:59:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 22:59:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 22:59:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:59:39 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 22:59:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:59:39 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 22:59:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 22:59:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 22:59:39 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 22:59:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6068 values 95745 bits 11968 bytes 
Thu 16 Jan 2014 22:59:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:59:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 22:59:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 22:59:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 22:59:42 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 22:59:42 - job_xml_thread(): Done retrieving: data size 43313911
Thu 16 Jan 2014 22:59:42 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 22:59:42 - XML: Start document: iteration 8
Thu 16 Jan 2014 22:59:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43313911
Thu 16 Jan 2014 22:59:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43313911
Thu 16 Jan 2014 22:59:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 22:59:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 22:59:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 22:59:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:59:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 22:59:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 22:59:58 - XML: Processed 648260 elements - found 713 jobs
Thu 16 Jan 2014 22:59:58 - job 7347017 appears to have finished
Thu 16 Jan 2014 22:59:58 - job 7347044 appears to have finished
Thu 16 Jan 2014 22:59:58 - job 7347029 appears to have finished
Thu 16 Jan 2014 22:59:58 - job_xml_thread(): Found 3 updated jobs.
Thu 16 Jan 2014 22:59:58 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 23:00:01 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Thu 16 Jan 2014 23:00:01 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:00:01 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:00:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:00:01 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:00:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:00:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:00:02 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:00:02 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:00:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:00:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:00:02 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:00:05 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Thu 16 Jan 2014 23:00:05 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:00:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:00:05 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:00:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:00:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:00:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:00:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:00:05 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:00:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:00:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:00:05 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:00:05 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 23:00:05 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 23:00:05 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 23:00:06 - size of cluster 'LISA Cluster': 624 hosts 79485 metrics 815531 values 12865654 bits 1608206 bytes 
Thu 16 Jan 2014 23:00:07 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:00:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 23:00:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:00:09 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:00:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43230375
Thu 16 Jan 2014 23:00:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:00:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43230375
Thu 16 Jan 2014 23:00:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:00:16 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:00:16 - job_xml_thread(): Done retrieving: data size 43230375
Thu 16 Jan 2014 23:00:16 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:00:17 - XML: Start document: iteration 9
Thu 16 Jan 2014 23:00:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:00:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:00:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:00:18 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:00:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:00:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:00:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:00:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:00:20 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:00:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:00:20 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:00:20 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:00:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:00:31 - XML: Processed 647426 elements - found 714 jobs
Thu 16 Jan 2014 23:00:31 - job 7347056 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 23:00:31 - job_xml_thread(): Found 2 updated jobs.
Thu 16 Jan 2014 23:00:31 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 23:00:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:00:32 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:00:32 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Thu 16 Jan 2014 23:00:32 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:00:32 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:00:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:00:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:00:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:00:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:00:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:00:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:00:35 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:00:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43652466
Thu 16 Jan 2014 23:00:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:00:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43652466
Thu 16 Jan 2014 23:00:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:00:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:00:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:00:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:00:39 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:00:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:00:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 23:00:40 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:00:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 23:00:40 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:00:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8085 values 127548 bits 15943 bytes 
Thu 16 Jan 2014 23:00:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:00:45 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:00:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:00:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:00:46 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:00:46 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:00:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:00:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:00:46 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:00:47 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:00:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:00:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:00:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:00:50 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:00:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:00:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:00:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:00:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:00:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:00:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:00:54 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:00:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43847189
Thu 16 Jan 2014 23:00:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:00:54 - job_xml_thread(): Done retrieving: data size 43847189
Thu 16 Jan 2014 23:00:54 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:00:54 - XML: Start document: iteration 10
Thu 16 Jan 2014 23:00:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43847189
Thu 16 Jan 2014 23:00:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:01:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:01:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:01:05 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:01:05 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 23:01:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:01:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:01:10 - XML: Processed 655248 elements - found 714 jobs
Thu 16 Jan 2014 23:01:10 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:01:10 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:01:10 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:01:10 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:01:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:01:16 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:01:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:01:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:01:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:01:16 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:01:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:01:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:01:17 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:01:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 23:01:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:01:17 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:01:17 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:01:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:01:17 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:01:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:01:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:01:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:01:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:01:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:01:21 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:01:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43882839
Thu 16 Jan 2014 23:01:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:01:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43882839
Thu 16 Jan 2014 23:01:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:01:25 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:01:25 - job_xml_thread(): Done retrieving: data size 43882839
Thu 16 Jan 2014 23:01:25 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:01:25 - XML: Start document: iteration 11
Thu 16 Jan 2014 23:01:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:01:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:01:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:01:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:01:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:01:33 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:01:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:01:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:01:33 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:01:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:01:33 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:01:33 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:01:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:01:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:01:40 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:01:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:01:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 23:01:40 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:01:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 23:01:40 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:01:41 - XML: Processed 655626 elements - found 714 jobs
Thu 16 Jan 2014 23:01:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5943 values 93921 bits 11740 bytes 
Thu 16 Jan 2014 23:01:41 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:01:41 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:01:41 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:01:41 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:01:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:01:45 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:01:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:01:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:01:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:01:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:01:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:01:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:01:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:01:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:01:48 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:01:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43868999
Thu 16 Jan 2014 23:01:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:01:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43868999
Thu 16 Jan 2014 23:01:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:01:56 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:01:56 - job_xml_thread(): Done retrieving: data size 43868999
Thu 16 Jan 2014 23:01:56 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:01:56 - XML: Start document: iteration 12
Thu 16 Jan 2014 23:02:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:02:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:02:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:02:01 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:02:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:02:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:02:03 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:02:03 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:02:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:02:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:02:03 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:02:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:02:12 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:02:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:02:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:02:13 - XML: Processed 655626 elements - found 714 jobs
Thu 16 Jan 2014 23:02:13 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:02:13 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:02:13 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:02:13 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:02:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:02:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:02:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:02:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:02:13 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:02:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 23:02:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:02:16 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:02:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43889329
Thu 16 Jan 2014 23:02:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:02:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43889329
Thu 16 Jan 2014 23:02:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:02:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:02:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:02:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:02:26 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:02:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:02:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:02:27 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:02:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:02:27 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:02:27 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:02:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:02:28 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:02:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:02:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:02:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:02:33 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:02:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:02:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:02:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:02:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:02:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:02:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:02:36 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:02:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43883463
Thu 16 Jan 2014 23:02:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:02:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43883463
Thu 16 Jan 2014 23:02:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:02:36 - job_xml_thread(): Done retrieving: data size 43883463
Thu 16 Jan 2014 23:02:36 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:02:36 - XML: Start document: iteration 13
Thu 16 Jan 2014 23:02:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:02:40 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:02:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:02:42 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:02:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 23:02:42 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:02:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 23:02:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8500 values 134493 bits 16811 bytes 
Thu 16 Jan 2014 23:02:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:02:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:02:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:02:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:02:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:02:52 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:02:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:02:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:02:53 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:02:53 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:02:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:02:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:02:53 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:02:56 - XML: Processed 655627 elements - found 716 jobs
Thu 16 Jan 2014 23:02:56 - job 7347016 appears to have finished
Thu 16 Jan 2014 23:02:56 - job_xml_thread(): Found 4 updated jobs.
Thu 16 Jan 2014 23:02:56 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 23:02:57 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Thu 16 Jan 2014 23:02:57 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:02:57 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:03:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:03:01 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:03:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:03:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:03:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:03:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:03:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:03:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:03:04 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:03:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875022
Thu 16 Jan 2014 23:03:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:03:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875022
Thu 16 Jan 2014 23:03:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:03:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:03:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:03:12 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:03:12 - job_xml_thread(): Done retrieving: data size 43875022
Thu 16 Jan 2014 23:03:12 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:03:12 - XML: Start document: iteration 14
Thu 16 Jan 2014 23:03:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:03:13 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:03:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:03:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:03:14 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:03:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:03:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875022
Thu 16 Jan 2014 23:03:14 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:03:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:03:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:03:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:03:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:03:25 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:03:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 23:03:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:03:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:03:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:03:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:03:32 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:03:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:03:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:03:33 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:03:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:03:33 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:03:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:03:33 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:03:34 - XML: Processed 655630 elements - found 716 jobs
Thu 16 Jan 2014 23:03:34 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:03:34 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:03:34 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:03:34 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:03:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:03:35 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:03:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:03:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:03:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:03:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:03:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:03:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:03:39 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:03:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43890273
Thu 16 Jan 2014 23:03:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:03:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43890273
Thu 16 Jan 2014 23:03:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:03:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:03:43 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:03:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:03:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 23:03:45 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:03:45 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:03:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 23:03:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6192 values 97882 bits 12235 bytes 
Thu 16 Jan 2014 23:03:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:03:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:03:49 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:03:49 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:03:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:03:51 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:03:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:03:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:03:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:03:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:03:52 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:03:52 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:03:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:03:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:03:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:03:54 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:03:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:03:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:03:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:03:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:03:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:03:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:03:57 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:03:57 - job_xml_thread(): Done retrieving: data size 43900234
Thu 16 Jan 2014 23:03:57 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:03:57 - XML: Start document: iteration 15
Thu 16 Jan 2014 23:03:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43900234
Thu 16 Jan 2014 23:03:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43900234
Thu 16 Jan 2014 23:03:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:03:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:04:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:04:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:04:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:04:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:04:14 - XML: Processed 655622 elements - found 712 jobs
Thu 16 Jan 2014 23:04:14 - job 7347040 appears to have finished
Thu 16 Jan 2014 23:04:14 - job 7346819 appears to have finished
Thu 16 Jan 2014 23:04:14 - job 7347027 appears to have finished
Thu 16 Jan 2014 23:04:14 - job 7347025 appears to have finished
Thu 16 Jan 2014 23:04:14 - job_xml_thread(): Found 4 updated jobs.
Thu 16 Jan 2014 23:04:14 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 23:04:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:04:15 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:04:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:04:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:04:15 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:04:15 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:04:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:04:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:04:15 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:04:16 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Thu 16 Jan 2014 23:04:16 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:04:16 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:04:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:04:19 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:04:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:04:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:04:19 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:04:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 23:04:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:04:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:04:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:04:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:04:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:04:22 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:04:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43884652
Thu 16 Jan 2014 23:04:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:04:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43884652
Thu 16 Jan 2014 23:04:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:04:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:04:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:04:31 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:04:31 - job_xml_thread(): Done retrieving: data size 43884652
Thu 16 Jan 2014 23:04:31 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:04:31 - XML: Start document: iteration 16
Thu 16 Jan 2014 23:04:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:04:34 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:04:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:04:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:04:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:04:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:04:35 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:04:35 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:04:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:04:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:04:35 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:04:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:04:45 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:04:45 - XML: Processed 655619 elements - found 712 jobs
Thu 16 Jan 2014 23:04:45 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:04:45 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:04:45 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:04:45 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:04:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:04:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 23:04:46 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:04:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 23:04:46 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:04:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5872 values 92687 bits 11585 bytes 
Thu 16 Jan 2014 23:04:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:04:46 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:04:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:04:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:04:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:04:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:04:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:04:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:04:49 - Leaving storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 23:04:49 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Thu 16 Jan 2014 23:04:49 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:04:50 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:04:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43859882
Thu 16 Jan 2014 23:04:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:04:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43859882
Thu 16 Jan 2014 23:04:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:04:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:04:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:05:01 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:05:01 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:05:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:05:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:05:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:05:04 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:05:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:05:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:05:05 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:05:05 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:05:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:05:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:05:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:05:07 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:05:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:05:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:05:07 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:05:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 23:05:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:05:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:05:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:05:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:05:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:05:09 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:05:09 - job_xml_thread(): Done retrieving: data size 43884027
Thu 16 Jan 2014 23:05:09 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:05:09 - XML: Start document: iteration 17
Thu 16 Jan 2014 23:05:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43884027
Thu 16 Jan 2014 23:05:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:05:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43884027
Thu 16 Jan 2014 23:05:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:05:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:05:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:05:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:05:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:05:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:05:29 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:05:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:05:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:05:31 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:05:31 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:05:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:05:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:05:31 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:05:32 - XML: Processed 655620 elements - found 712 jobs
Thu 16 Jan 2014 23:05:32 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:05:32 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:05:32 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:05:32 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:05:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:05:33 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:05:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:05:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:05:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:05:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:05:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:05:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:05:35 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:05:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43353994
Thu 16 Jan 2014 23:05:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:05:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43353994
Thu 16 Jan 2014 23:05:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:05:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:05:46 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:05:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:05:46 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:05:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:05:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:05:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:05:47 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:05:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 23:05:47 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:05:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8678 values 136922 bits 17115 bytes 
Thu 16 Jan 2014 23:05:47 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:05:47 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:05:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 23:05:48 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:05:48 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:05:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:05:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:05:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:05:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:05:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:05:49 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:05:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:05:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:05:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:05:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:05:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:05:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:05:52 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:05:52 - job_xml_thread(): Done retrieving: data size 43247987
Thu 16 Jan 2014 23:05:52 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:05:52 - XML: Start document: iteration 18
Thu 16 Jan 2014 23:05:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43247987
Thu 16 Jan 2014 23:05:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43247987
Thu 16 Jan 2014 23:05:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:05:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:06:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:06:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:06:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:06:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:06:05 - XML: Processed 647668 elements - found 712 jobs
Thu 16 Jan 2014 23:06:05 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:06:05 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:06:05 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:06:05 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:06:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:06:14 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:06:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:06:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:06:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:06:15 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:06:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:06:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:06:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:06:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:06:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:06:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:06:15 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:06:15 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:06:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 23:06:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:06:16 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:06:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:06:16 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:06:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:06:18 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:06:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43305682
Thu 16 Jan 2014 23:06:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:06:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43305682
Thu 16 Jan 2014 23:06:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:06:21 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:06:21 - job_xml_thread(): Done retrieving: data size 43305682
Thu 16 Jan 2014 23:06:21 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:06:22 - XML: Start document: iteration 19
Thu 16 Jan 2014 23:06:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:06:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:06:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:06:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:06:38 - XML: Processed 648170 elements - found 712 jobs
Thu 16 Jan 2014 23:06:38 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:06:38 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:06:38 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:06:38 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:06:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:06:38 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:06:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:06:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:06:39 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:06:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:06:39 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:06:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:06:39 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:06:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:06:41 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:06:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:06:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:06:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:06:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:06:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:06:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:06:42 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:06:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43733413
Thu 16 Jan 2014 23:06:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:06:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43733413
Thu 16 Jan 2014 23:06:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:06:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:06:47 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:06:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:06:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 23:06:49 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:06:49 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:06:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 23:06:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9029 values 142438 bits 17804 bytes 
Thu 16 Jan 2014 23:06:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:06:52 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:06:54 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:06:54 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:06:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:06:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:06:55 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:06:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:06:55 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:06:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:06:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:06:56 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:06:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:06:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:06:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:06:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:06:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:06:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:06:58 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:06:58 - job_xml_thread(): Done retrieving: data size 43879244
Thu 16 Jan 2014 23:06:58 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:06:58 - XML: Start document: iteration 20
Thu 16 Jan 2014 23:06:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43879244
Thu 16 Jan 2014 23:06:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:06:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43879244
Thu 16 Jan 2014 23:06:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:07:06 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Thu 16 Jan 2014 23:07:06 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:07:08 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:07:08 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 23:07:08 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 23:07:09 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:07:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:07:10 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:07:10 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 23:07:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:07:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:07:12 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:07:12 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:07:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:07:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:07:13 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:07:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:07:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:07:15 - XML: Processed 655404 elements - found 712 jobs
Thu 16 Jan 2014 23:07:15 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:07:15 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:07:15 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:07:15 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:07:16 - size of cluster 'LISA Cluster': 624 hosts 79470 metrics 751411 values 11865257 bits 1483157 bytes 
Thu 16 Jan 2014 23:07:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:07:20 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:07:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:07:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:07:21 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:07:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 23:07:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:07:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:07:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:07:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:07:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:07:23 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:07:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43878596
Thu 16 Jan 2014 23:07:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:07:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43878596
Thu 16 Jan 2014 23:07:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:07:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:07:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:07:30 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:07:30 - job_xml_thread(): Done retrieving: data size 43878596
Thu 16 Jan 2014 23:07:30 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:07:30 - Housekeeping: checking database for timed out jobs..
Thu 16 Jan 2014 23:07:31 - Housekeeping: Found 0 timed out jobs in database: closing entries
Thu 16 Jan 2014 23:07:31 - Housekeeping: done.
Thu 16 Jan 2014 23:07:31 - XML: Start document: iteration 0
Thu 16 Jan 2014 23:07:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:07:34 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:07:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:07:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:07:35 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:07:35 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:07:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:07:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:07:35 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:07:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:07:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:07:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:07:46 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:07:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:07:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:07:47 - XML: Processed 655622 elements - found 712 jobs
Thu 16 Jan 2014 23:07:47 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:07:47 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:07:47 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:07:47 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:07:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:07:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:07:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:07:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:07:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:07:49 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:07:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:07:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 23:07:50 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:07:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 23:07:50 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:07:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5692 values 89791 bits 11223 bytes 
Thu 16 Jan 2014 23:07:50 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:07:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856712
Thu 16 Jan 2014 23:07:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:07:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:07:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:07:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43856712
Thu 16 Jan 2014 23:07:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:08:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:08:01 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:08:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:08:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:08:02 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:08:02 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:08:02 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:08:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:08:02 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:08:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:08:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:08:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:08:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:08:06 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:08:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:08:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:08:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:08:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:08:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:08:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:08:10 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:08:10 - job_xml_thread(): Done retrieving: data size 43899179
Thu 16 Jan 2014 23:08:10 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:08:10 - XML: Start document: iteration 1
Thu 16 Jan 2014 23:08:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43899179
Thu 16 Jan 2014 23:08:10 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:08:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43899179
Thu 16 Jan 2014 23:08:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:08:10 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 23:08:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:08:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:08:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:08:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:08:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:08:23 - XML: Processed 655624 elements - found 713 jobs
Thu 16 Jan 2014 23:08:24 - job_xml_thread(): Found 1 updated jobs.
Thu 16 Jan 2014 23:08:24 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 23:08:25 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Thu 16 Jan 2014 23:08:25 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:08:25 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:08:26 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:08:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 23:08:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:08:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:08:27 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:08:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:08:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:08:28 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:08:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:08:28 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:08:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:08:28 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:08:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:08:33 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:08:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:08:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:08:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:08:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:08:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:08:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:08:36 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:08:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43886663
Thu 16 Jan 2014 23:08:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:08:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43886663
Thu 16 Jan 2014 23:08:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:08:40 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:08:40 - job_xml_thread(): Done retrieving: data size 43886663
Thu 16 Jan 2014 23:08:40 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:08:40 - XML: Start document: iteration 2
Thu 16 Jan 2014 23:08:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:08:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:08:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:08:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:08:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:08:50 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:08:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:08:51 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:08:52 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:08:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 23:08:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:08:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 23:08:52 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:08:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6161 values 97301 bits 12162 bytes 
Thu 16 Jan 2014 23:08:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:08:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:08:53 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:08:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:08:53 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:08:53 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:08:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:08:58 - XML: Processed 655624 elements - found 713 jobs
Thu 16 Jan 2014 23:08:58 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:08:58 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:08:58 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:08:58 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:08:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:08:59 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:08:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:08:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:09:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:09:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:09:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:09:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:09:03 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:09:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43871768
Thu 16 Jan 2014 23:09:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:09:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43871768
Thu 16 Jan 2014 23:09:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:09:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:09:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:09:13 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:09:13 - job_xml_thread(): Done retrieving: data size 43871768
Thu 16 Jan 2014 23:09:13 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:09:14 - XML: Start document: iteration 3
Thu 16 Jan 2014 23:09:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:09:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:09:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:09:20 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:09:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:09:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:09:20 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:09:20 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:09:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:09:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:09:21 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:09:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:09:26 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:09:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:09:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:09:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:09:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:09:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:09:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:09:28 - XML: Processed 655624 elements - found 713 jobs
Thu 16 Jan 2014 23:09:28 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:09:28 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:09:28 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:09:28 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:09:28 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:09:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 23:09:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:09:31 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:09:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43874175
Thu 16 Jan 2014 23:09:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:09:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43874175
Thu 16 Jan 2014 23:09:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:09:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:09:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:09:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:09:41 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:09:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:09:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:09:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:09:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:09:42 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:09:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:09:42 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:09:42 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:09:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:09:43 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:09:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:09:46 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:09:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:09:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:09:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:09:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:09:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:09:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:09:50 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:09:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43888160
Thu 16 Jan 2014 23:09:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:09:50 - job_xml_thread(): Done retrieving: data size 43888160
Thu 16 Jan 2014 23:09:50 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:09:50 - XML: Start document: iteration 4
Thu 16 Jan 2014 23:09:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43888160
Thu 16 Jan 2014 23:09:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:09:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:09:52 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:09:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:09:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 23:09:53 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:09:53 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:09:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 23:09:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8940 values 141082 bits 17635 bytes 
Thu 16 Jan 2014 23:09:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:09:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:10:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:10:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:10:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:10:10 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:10:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:10:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:10:11 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:10:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:10:11 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:10:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:10:11 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:10:12 - XML: Processed 655622 elements - found 712 jobs
Thu 16 Jan 2014 23:10:12 - job 7346796 appears to have finished
Thu 16 Jan 2014 23:10:12 - job_xml_thread(): Found 1 updated jobs.
Thu 16 Jan 2014 23:10:12 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 23:10:12 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Thu 16 Jan 2014 23:10:12 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:10:12 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:10:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:10:13 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:10:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:10:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:10:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:10:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:10:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:10:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:10:18 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:10:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43887426
Thu 16 Jan 2014 23:10:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:10:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43887426
Thu 16 Jan 2014 23:10:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:10:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:10:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:10:27 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:10:27 - job_xml_thread(): Done retrieving: data size 43887426
Thu 16 Jan 2014 23:10:27 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:10:27 - XML: Start document: iteration 5
Thu 16 Jan 2014 23:10:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:10:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:10:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:10:30 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:10:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:10:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:10:32 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:10:32 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:10:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:10:32 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:10:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:10:39 - XML: Processed 655622 elements - found 712 jobs
Thu 16 Jan 2014 23:10:39 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:10:39 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:10:39 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:10:39 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:10:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:10:41 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:10:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:10:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:10:41 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:10:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 23:10:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:10:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:10:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:10:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:10:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:10:44 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:10:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865186
Thu 16 Jan 2014 23:10:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:10:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43865186
Thu 16 Jan 2014 23:10:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:10:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:10:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:10:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:10:54 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:10:54 - job_xml_thread(): Done retrieving: data size 43865186
Thu 16 Jan 2014 23:10:54 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:10:54 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:10:54 - XML: Start document: iteration 6
Thu 16 Jan 2014 23:10:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:10:54 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:10:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:10:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:10:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:10:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 23:10:55 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:10:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5869 values 92616 bits 11577 bytes 
Thu 16 Jan 2014 23:10:55 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:10:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 23:10:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:10:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:10:57 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:10:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:10:57 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:10:57 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:10:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:11:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:11:03 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:11:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:11:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:11:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:11:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:11:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:11:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:11:07 - XML: Processed 655622 elements - found 712 jobs
Thu 16 Jan 2014 23:11:07 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:11:07 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:11:07 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:11:07 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:11:10 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:11:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43877989
Thu 16 Jan 2014 23:11:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:11:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43877989
Thu 16 Jan 2014 23:11:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:11:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:11:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:11:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:11:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:11:22 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:11:23 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:11:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:11:23 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:11:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:11:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:11:24 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:11:24 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:11:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:11:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:11:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:11:26 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:11:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:11:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:11:26 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:11:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 23:11:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:11:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:11:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:11:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:11:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:11:28 - Leaving storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 23:11:28 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Thu 16 Jan 2014 23:11:28 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:11:29 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:11:29 - job_xml_thread(): Done retrieving: data size 43819817
Thu 16 Jan 2014 23:11:29 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:11:29 - XML: Start document: iteration 7
Thu 16 Jan 2014 23:11:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43819817
Thu 16 Jan 2014 23:11:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:11:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43819817
Thu 16 Jan 2014 23:11:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:11:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:11:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:11:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:11:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:11:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:11:48 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:11:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:11:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:11:50 - XML: Processed 654868 elements - found 712 jobs
Thu 16 Jan 2014 23:11:51 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:11:51 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:11:51 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:11:51 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:11:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:11:51 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:11:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:11:51 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:11:51 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:11:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:11:52 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:11:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:11:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:11:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:11:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:11:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:11:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:11:54 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:11:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43242429
Thu 16 Jan 2014 23:11:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:11:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43242429
Thu 16 Jan 2014 23:11:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:11:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:11:56 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:12:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:12:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 23:12:01 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:12:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 23:12:01 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:12:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8957 values 141355 bits 17669 bytes 
Thu 16 Jan 2014 23:12:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:12:02 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:12:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:12:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:12:06 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:12:06 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:12:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:12:07 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:12:07 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:12:07 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:12:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:12:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:12:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:12:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:12:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:12:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:12:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:12:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:12:10 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:12:10 - job_xml_thread(): Done retrieving: data size 43265781
Thu 16 Jan 2014 23:12:11 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:12:11 - XML: Start document: iteration 8
Thu 16 Jan 2014 23:12:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43265781
Thu 16 Jan 2014 23:12:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:12:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43265781
Thu 16 Jan 2014 23:12:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:12:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:12:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:12:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:12:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:12:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:12:27 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:12:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:12:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:12:28 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:12:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:12:28 - XML: Processed 647812 elements - found 713 jobs
Thu 16 Jan 2014 23:12:28 - job 7336925 appears to have finished
Thu 16 Jan 2014 23:12:28 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:12:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:12:28 - job_xml_thread(): Found 3 updated jobs.
Thu 16 Jan 2014 23:12:28 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 23:12:28 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:12:29 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Thu 16 Jan 2014 23:12:29 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:12:29 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:12:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:12:32 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:12:32 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:12:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 23:12:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:12:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:12:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:12:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:12:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:12:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:12:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:12:34 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:12:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43297245
Thu 16 Jan 2014 23:12:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:12:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43297245
Thu 16 Jan 2014 23:12:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:12:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:12:43 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:12:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:12:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:12:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:12:44 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:12:44 - job_xml_thread(): Done retrieving: data size 43297245
Thu 16 Jan 2014 23:12:44 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:12:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:12:44 - XML: Start document: iteration 9
Thu 16 Jan 2014 23:12:45 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:12:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:12:45 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:12:45 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:12:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:12:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:12:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:12:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:12:53 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:12:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:12:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:12:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:12:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:12:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:12:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:12:56 - XML: Processed 648178 elements - found 713 jobs
Thu 16 Jan 2014 23:12:56 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:12:56 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:12:56 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:12:56 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:12:58 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:12:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43848054
Thu 16 Jan 2014 23:12:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:12:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43848054
Thu 16 Jan 2014 23:12:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:13:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:13:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:13:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:13:01 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:13:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:13:01 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:13:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 23:13:01 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:13:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 23:13:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9068 values 143141 bits 17892 bytes 
Thu 16 Jan 2014 23:13:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:13:07 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:13:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:13:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:13:08 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:13:08 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:13:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:13:08 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:13:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:13:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:13:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:13:11 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:13:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:13:12 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:13:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:13:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:13:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:13:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:13:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:13:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:13:14 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:13:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 23:13:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:13:15 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:13:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43881503
Thu 16 Jan 2014 23:13:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:13:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43881503
Thu 16 Jan 2014 23:13:15 - job_xml_thread(): Done retrieving: data size 43881503
Thu 16 Jan 2014 23:13:15 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:13:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:13:15 - XML: Start document: iteration 10
Thu 16 Jan 2014 23:13:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:13:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:13:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:13:27 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:13:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:13:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:13:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:13:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:13:29 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:13:29 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:13:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:13:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:13:29 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:13:34 - XML: Processed 655624 elements - found 713 jobs
Thu 16 Jan 2014 23:13:34 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:13:34 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:13:34 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:13:34 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:13:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:13:37 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:13:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:13:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:13:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:13:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:13:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:13:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:13:39 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:13:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875456
Thu 16 Jan 2014 23:13:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:13:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875456
Thu 16 Jan 2014 23:13:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:13:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:13:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:13:49 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:13:49 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:13:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:13:50 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:13:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:13:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:13:50 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:13:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:13:50 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:13:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:13:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:13:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:13:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:13:54 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:13:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:13:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:13:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:13:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:13:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:13:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:13:55 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:13:55 - job_xml_thread(): Done retrieving: data size 43879142
Thu 16 Jan 2014 23:13:55 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:13:55 - XML: Start document: iteration 11
Thu 16 Jan 2014 23:13:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43879142
Thu 16 Jan 2014 23:13:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:13:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43879142
Thu 16 Jan 2014 23:13:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:14:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:14:01 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:14:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:14:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 23:14:02 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:14:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 23:14:02 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:14:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148694 bits 18586 bytes 
Thu 16 Jan 2014 23:14:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:14:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:14:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:14:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:14:10 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Thu 16 Jan 2014 23:14:10 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:14:11 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:14:11 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:14:11 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 23:14:11 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 23:14:11 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 23:14:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:14:11 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:14:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:14:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:14:12 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:14:12 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:14:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:14:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:14:12 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:14:14 - XML: Processed 655620 elements - found 711 jobs
Thu 16 Jan 2014 23:14:14 - job 7347035 appears to have finished
Thu 16 Jan 2014 23:14:14 - job 7347036 appears to have finished
Thu 16 Jan 2014 23:14:14 - job 7347063 field 'start_timestamp' changed since saved from: 1389910294 to: 1389910275
Thu 16 Jan 2014 23:14:14 - job_xml_thread(): Found 3 updated jobs.
Thu 16 Jan 2014 23:14:14 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 23:14:16 - size of cluster 'LISA Cluster': 624 hosts 79474 metrics 793954 values 12523071 bits 1565383 bytes 
Thu 16 Jan 2014 23:14:16 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Thu 16 Jan 2014 23:14:16 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:14:16 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:14:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:14:20 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:14:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:14:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:14:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:14:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:14:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:14:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:14:23 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:14:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 23:14:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:14:24 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:14:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43885511
Thu 16 Jan 2014 23:14:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:14:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43885511
Thu 16 Jan 2014 23:14:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:14:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:14:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:14:32 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:14:32 - job_xml_thread(): Done retrieving: data size 43885511
Thu 16 Jan 2014 23:14:32 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:14:32 - XML: Start document: iteration 12
Thu 16 Jan 2014 23:14:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:14:35 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:14:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:14:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:14:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:14:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:14:36 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:14:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:14:36 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:14:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:14:36 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:14:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:14:41 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:14:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:14:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:14:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:14:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:14:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:14:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:14:46 - XML: Processed 655620 elements - found 711 jobs
Thu 16 Jan 2014 23:14:46 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:14:46 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:14:46 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:14:46 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:14:49 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:14:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870254
Thu 16 Jan 2014 23:14:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:14:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870254
Thu 16 Jan 2014 23:14:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:14:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:14:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:14:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:14:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:15:01 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:15:01 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:15:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:15:01 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:15:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:15:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:15:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:15:02 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:15:02 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:15:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:15:03 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:15:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:15:03 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:15:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:15:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 23:15:03 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:15:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 23:15:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99091 bits 12386 bytes 
Thu 16 Jan 2014 23:15:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:15:05 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:15:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:15:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:15:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:15:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:15:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:15:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:15:10 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:15:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 23:15:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:15:10 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:15:10 - job_xml_thread(): Done retrieving: data size 43890610
Thu 16 Jan 2014 23:15:10 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:15:10 - XML: Start document: iteration 13
Thu 16 Jan 2014 23:15:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43890610
Thu 16 Jan 2014 23:15:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43890610
Thu 16 Jan 2014 23:15:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:15:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:15:13 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:15:13 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 23:15:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:15:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:15:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:15:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:15:22 - XML: Processed 655620 elements - found 711 jobs
Thu 16 Jan 2014 23:15:22 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:15:22 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:15:22 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:15:22 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:15:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:15:28 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:15:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:15:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:15:29 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:15:29 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:15:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:15:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:15:29 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:15:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:15:33 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:15:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:15:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:15:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:15:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:15:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:15:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:15:35 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:15:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43893330
Thu 16 Jan 2014 23:15:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:15:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43893330
Thu 16 Jan 2014 23:15:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:15:37 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:15:38 - job_xml_thread(): Done retrieving: data size 43893330
Thu 16 Jan 2014 23:15:38 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:15:38 - XML: Start document: iteration 14
Thu 16 Jan 2014 23:15:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:15:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:15:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:15:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:15:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:15:53 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:15:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:15:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:15:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:15:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:15:54 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:15:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:15:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:15:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:15:55 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:15:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:15:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:15:56 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:15:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:15:56 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:15:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:16:00 - XML: Processed 655620 elements - found 711 jobs
Thu 16 Jan 2014 23:16:00 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:16:00 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:16:00 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:16:00 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:16:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:16:03 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:16:03 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:16:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 23:16:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:16:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 23:16:03 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:16:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99101 bits 12387 bytes 
Thu 16 Jan 2014 23:16:04 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:16:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43891081
Thu 16 Jan 2014 23:16:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:16:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43891081
Thu 16 Jan 2014 23:16:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:16:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:16:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:16:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:16:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:16:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:16:15 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:16:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:16:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:16:15 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:16:15 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:16:16 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:16:16 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:16:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:16:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:16:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:16:17 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:16:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:16:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:16:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:16:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:16:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:16:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:16:23 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:16:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 23:16:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:16:23 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:16:23 - job_xml_thread(): Done retrieving: data size 43902093
Thu 16 Jan 2014 23:16:23 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:16:23 - XML: Start document: iteration 15
Thu 16 Jan 2014 23:16:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43902093
Thu 16 Jan 2014 23:16:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43902093
Thu 16 Jan 2014 23:16:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:16:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:16:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:16:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:16:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:16:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:16:38 - XML: Processed 655622 elements - found 712 jobs
Thu 16 Jan 2014 23:16:38 - job_xml_thread(): Found 1 updated jobs.
Thu 16 Jan 2014 23:16:38 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 23:16:39 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Thu 16 Jan 2014 23:16:39 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:16:39 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:16:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:16:43 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:16:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:16:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:16:44 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:16:44 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:16:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:16:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:16:44 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:16:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:16:45 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:16:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:16:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:16:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:16:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:16:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:16:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:16:48 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:16:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43921936
Thu 16 Jan 2014 23:16:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:16:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43921936
Thu 16 Jan 2014 23:16:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:16:55 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:16:55 - job_xml_thread(): Done retrieving: data size 43921936
Thu 16 Jan 2014 23:16:55 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:16:55 - XML: Start document: iteration 16
Thu 16 Jan 2014 23:16:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:16:58 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:17:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:17:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:17:00 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:17:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:17:00 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:17:00 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:17:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:17:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:17:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:17:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:17:04 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:17:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:17:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 23:17:05 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:17:05 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:17:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 23:17:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6464 values 102222 bits 12777 bytes 
Thu 16 Jan 2014 23:17:10 - XML: Processed 655622 elements - found 712 jobs
Thu 16 Jan 2014 23:17:10 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:17:10 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:17:10 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:17:10 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:17:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:17:12 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:17:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:17:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:17:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:17:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:17:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:17:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:17:15 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:17:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865791
Thu 16 Jan 2014 23:17:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:17:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:17:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:17:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43865791
Thu 16 Jan 2014 23:17:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:17:25 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:17:25 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:17:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:17:26 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:17:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:17:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:17:27 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:17:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:17:27 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:17:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:17:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:17:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:17:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:17:31 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:17:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:17:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:17:32 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:17:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 23:17:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:17:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:17:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:17:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:17:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:17:35 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:17:35 - job_xml_thread(): Done retrieving: data size 43573913
Thu 16 Jan 2014 23:17:35 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:17:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573913
Thu 16 Jan 2014 23:17:35 - XML: Start document: iteration 17
Thu 16 Jan 2014 23:17:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:17:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573913
Thu 16 Jan 2014 23:17:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:17:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:17:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:17:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:17:46 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:17:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:17:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:17:47 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:17:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:17:47 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:17:47 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:17:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:17:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:17:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:17:57 - XML: Processed 651854 elements - found 712 jobs
Thu 16 Jan 2014 23:17:57 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:17:57 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:17:57 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:17:57 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:17:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:17:58 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:17:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:17:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:17:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:17:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:17:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:17:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:18:00 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:18:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43220159
Thu 16 Jan 2014 23:18:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:18:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43220159
Thu 16 Jan 2014 23:18:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:18:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:18:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:18:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:18:05 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:18:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:18:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 23:18:07 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:18:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8825 values 139603 bits 17450 bytes 
Thu 16 Jan 2014 23:18:07 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:18:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 23:18:12 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:18:12 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:18:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:18:12 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:18:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:18:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:18:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:18:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:18:14 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:18:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:18:14 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:18:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:18:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:18:16 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:18:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:18:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:18:16 - Leaving storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 23:18:16 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Thu 16 Jan 2014 23:18:16 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:18:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:18:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:18:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:18:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:18:21 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:18:21 - job_xml_thread(): Done retrieving: data size 43287896
Thu 16 Jan 2014 23:18:21 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:18:21 - XML: Start document: iteration 18
Thu 16 Jan 2014 23:18:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43287896
Thu 16 Jan 2014 23:18:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:18:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43287896
Thu 16 Jan 2014 23:18:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:18:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:18:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:18:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:18:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:18:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:18:40 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:18:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:18:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:18:41 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:18:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:18:41 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:18:41 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:18:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:18:43 - XML: Processed 648166 elements - found 710 jobs
Thu 16 Jan 2014 23:18:43 - job 7346679 appears to have finished
Thu 16 Jan 2014 23:18:44 - job 7347047 appears to have finished
Thu 16 Jan 2014 23:18:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:18:44 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:18:44 - job_xml_thread(): Found 2 updated jobs.
Thu 16 Jan 2014 23:18:44 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 23:18:44 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Thu 16 Jan 2014 23:18:44 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:18:44 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:18:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:18:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:18:44 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:18:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 23:18:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:18:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:18:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:18:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:18:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:18:45 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:18:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43817630
Thu 16 Jan 2014 23:18:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:18:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43817630
Thu 16 Jan 2014 23:18:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:18:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:18:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:18:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:18:57 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:18:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:18:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:18:59 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:18:59 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:19:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:19:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:19:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:19:00 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:19:00 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:19:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:19:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:19:00 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:19:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:19:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:19:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:19:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:19:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:19:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:19:03 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:19:03 - job_xml_thread(): Done retrieving: data size 43886128
Thu 16 Jan 2014 23:19:03 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:19:03 - XML: Start document: iteration 19
Thu 16 Jan 2014 23:19:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43886128
Thu 16 Jan 2014 23:19:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43886128
Thu 16 Jan 2014 23:19:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:19:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:19:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:19:08 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:19:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:19:10 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:19:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 23:19:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 23:19:10 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:19:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8933 values 141052 bits 17631 bytes 
Thu 16 Jan 2014 23:19:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:19:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:19:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:19:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:19:22 - XML: Processed 655618 elements - found 710 jobs
Thu 16 Jan 2014 23:19:23 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:19:23 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:19:23 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:19:23 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:19:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:19:26 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:19:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:19:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:19:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:19:26 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:19:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:19:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:19:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:19:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:19:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:19:26 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:19:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:19:26 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:19:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:19:26 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:19:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:19:29 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:19:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43901658
Thu 16 Jan 2014 23:19:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:19:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43901658
Thu 16 Jan 2014 23:19:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:19:38 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:19:38 - job_xml_thread(): Done retrieving: data size 43901658
Thu 16 Jan 2014 23:19:38 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:19:38 - XML: Start document: iteration 20
Thu 16 Jan 2014 23:19:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:19:41 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:19:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:19:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:19:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:19:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:19:42 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:19:42 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:19:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:19:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:19:42 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:19:46 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:19:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 23:19:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:19:48 - XML: Processed 655618 elements - found 710 jobs
Thu 16 Jan 2014 23:19:48 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:19:48 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:19:48 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:19:48 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:19:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:19:52 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:19:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:19:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:19:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:19:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:19:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:19:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:19:53 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:19:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43868092
Thu 16 Jan 2014 23:19:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:19:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43868092
Thu 16 Jan 2014 23:19:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:19:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:19:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:20:03 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:20:03 - job_xml_thread(): Done retrieving: data size 43868092
Thu 16 Jan 2014 23:20:03 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:20:03 - Housekeeping: checking database for timed out jobs..
Thu 16 Jan 2014 23:20:03 - Housekeeping: Found 0 timed out jobs in database: closing entries
Thu 16 Jan 2014 23:20:04 - Housekeeping: done.
Thu 16 Jan 2014 23:20:04 - XML: Start document: iteration 0
Thu 16 Jan 2014 23:20:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:20:05 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:20:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:20:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:20:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:20:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:20:07 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:20:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:20:07 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:20:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:20:07 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:20:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:20:10 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:20:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:20:11 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:20:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 23:20:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 23:20:11 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:20:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6074 values 95881 bits 11985 bytes 
Thu 16 Jan 2014 23:20:15 - XML: Processed 655620 elements - found 711 jobs
Thu 16 Jan 2014 23:20:15 - job 7334715 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 23:20:15 - job_xml_thread(): Found 2 updated jobs.
Thu 16 Jan 2014 23:20:15 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 23:20:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:20:16 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:20:16 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Thu 16 Jan 2014 23:20:16 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:20:16 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:20:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:20:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:20:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:20:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:20:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:20:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:20:19 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:20:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43863202
Thu 16 Jan 2014 23:20:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:20:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43863202
Thu 16 Jan 2014 23:20:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:20:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:20:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:20:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:20:28 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:20:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:20:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:20:29 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:20:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:20:29 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:20:29 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:20:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:20:31 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:20:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:20:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:20:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:20:33 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:20:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:20:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:20:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:20:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:20:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:20:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:20:33 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:20:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 23:20:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:20:35 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:20:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43882288
Thu 16 Jan 2014 23:20:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:20:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43882288
Thu 16 Jan 2014 23:20:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:20:36 - job_xml_thread(): Done retrieving: data size 43882288
Thu 16 Jan 2014 23:20:36 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:20:36 - XML: Start document: iteration 1
Thu 16 Jan 2014 23:20:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:20:44 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:20:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:20:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:20:46 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:20:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:20:47 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:20:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:20:47 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:20:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:20:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:20:58 - XML: Processed 655620 elements - found 711 jobs
Thu 16 Jan 2014 23:20:58 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:20:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:20:58 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:20:58 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:20:58 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:20:58 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:20:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:20:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:20:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:20:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:20:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:20:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:20:59 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:20:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870243
Thu 16 Jan 2014 23:20:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:21:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870243
Thu 16 Jan 2014 23:21:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:21:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:21:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:21:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:21:11 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:21:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:21:11 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:21:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:21:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:21:12 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:21:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 23:21:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:21:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 23:21:12 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:21:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8651 values 136409 bits 17051 bytes 
Thu 16 Jan 2014 23:21:13 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:21:13 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:21:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:21:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:21:13 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:21:13 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:21:13 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Thu 16 Jan 2014 23:21:13 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:21:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:21:14 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:21:14 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:21:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:21:14 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 23:21:14 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 23:21:14 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 23:21:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:21:14 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:21:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:21:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:21:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:21:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:21:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:21:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:21:15 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 858891 values 13569084 bits 1696135 bytes 
Thu 16 Jan 2014 23:21:19 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:21:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43889479
Thu 16 Jan 2014 23:21:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:21:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43889479
Thu 16 Jan 2014 23:21:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:21:20 - job_xml_thread(): Done retrieving: data size 43889479
Thu 16 Jan 2014 23:21:20 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:21:20 - XML: Start document: iteration 2
Thu 16 Jan 2014 23:21:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:21:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:21:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:21:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:21:33 - XML: Processed 655620 elements - found 711 jobs
Thu 16 Jan 2014 23:21:34 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:21:34 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:21:34 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:21:34 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:21:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:21:38 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:21:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:21:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:21:39 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:21:39 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:21:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:21:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:21:39 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:21:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:21:42 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:21:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:21:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:21:43 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:21:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 23:21:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:21:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:21:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:21:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:21:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:21:45 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:21:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43885665
Thu 16 Jan 2014 23:21:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:21:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43885665
Thu 16 Jan 2014 23:21:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:21:49 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:21:49 - job_xml_thread(): Done retrieving: data size 43885665
Thu 16 Jan 2014 23:21:49 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:21:49 - XML: Start document: iteration 3
Thu 16 Jan 2014 23:21:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:21:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:21:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:21:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:21:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:21:59 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:21:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:22:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:22:01 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:22:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:22:01 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:22:01 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:22:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:22:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:22:07 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:22:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:22:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:22:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:22:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:22:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:22:08 - XML: Processed 655619 elements - found 711 jobs
Thu 16 Jan 2014 23:22:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:22:08 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:22:08 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:22:08 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:22:08 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:22:11 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:22:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43886521
Thu 16 Jan 2014 23:22:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:22:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:22:12 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:22:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43886521
Thu 16 Jan 2014 23:22:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:22:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:22:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 23:22:14 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:22:14 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:22:14 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:22:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 23:22:14 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 23:22:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8807 values 138924 bits 17365 bytes 
Thu 16 Jan 2014 23:22:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:22:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:22:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:22:19 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:22:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:22:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:22:20 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:22:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:22:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43886521
Thu 16 Jan 2014 23:22:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:22:20 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:22:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:22:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:22:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:22:23 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:22:23 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:22:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:22:26 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:22:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:22:30 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:22:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:22:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:22:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:22:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:22:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:22:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:22:34 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:22:34 - job_xml_thread(): Done retrieving: data size 43879264
Thu 16 Jan 2014 23:22:34 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:22:34 - XML: Start document: iteration 4
Thu 16 Jan 2014 23:22:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43879264
Thu 16 Jan 2014 23:22:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:22:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:22:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:22:36 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:22:36 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:22:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:22:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:22:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43879264
Thu 16 Jan 2014 23:22:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:22:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:22:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:22:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:22:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:22:53 - XML: Processed 655620 elements - found 711 jobs
Thu 16 Jan 2014 23:22:54 - job 7334715 field 'start_timestamp' changed since saved from: 1389910786 to: 1389910741
Thu 16 Jan 2014 23:22:54 - job 7347023 appears to have finished
Thu 16 Jan 2014 23:22:54 - job_xml_thread(): Found 3 updated jobs.
Thu 16 Jan 2014 23:22:54 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 23:22:56 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Thu 16 Jan 2014 23:22:56 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:22:56 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:22:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:22:57 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:22:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:22:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:22:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:22:57 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:22:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:22:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:22:57 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:22:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 23:22:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:22:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:22:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:22:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:22:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:22:57 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:22:57 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:22:57 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:22:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:22:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:23:01 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:23:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43894599
Thu 16 Jan 2014 23:23:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:23:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43894599
Thu 16 Jan 2014 23:23:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:23:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:23:13 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:23:13 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:23:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:23:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:23:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:23:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:23:14 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:23:15 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:23:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 23:23:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:23:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 23:23:15 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:23:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:23:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5815 values 91674 bits 11459 bytes 
Thu 16 Jan 2014 23:23:15 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:23:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:23:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:23:16 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:23:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:23:16 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:23:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:23:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:23:16 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:23:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:23:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:23:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:23:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:23:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:23:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:23:20 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:23:20 - job_xml_thread(): Done retrieving: data size 43818452
Thu 16 Jan 2014 23:23:20 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:23:20 - XML: Start document: iteration 5
Thu 16 Jan 2014 23:23:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43818452
Thu 16 Jan 2014 23:23:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:23:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43818452
Thu 16 Jan 2014 23:23:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:23:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:23:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:23:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:23:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:23:32 - XML: Processed 654872 elements - found 711 jobs
Thu 16 Jan 2014 23:23:32 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:23:32 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:23:32 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:23:32 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:23:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:23:42 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:23:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:23:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:23:42 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:23:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:23:42 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:23:42 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:23:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:23:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:23:44 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:23:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:23:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:23:44 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:23:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 23:23:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:23:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:23:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:23:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:23:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:23:47 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:23:48 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:23:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43272349
Thu 16 Jan 2014 23:23:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:23:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43272349
Thu 16 Jan 2014 23:23:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:23:48 - job_xml_thread(): Done retrieving: data size 43272349
Thu 16 Jan 2014 23:23:48 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:23:48 - XML: Start document: iteration 6
Thu 16 Jan 2014 23:23:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:23:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:23:59 - XML: Processed 647973 elements - found 711 jobs
Thu 16 Jan 2014 23:24:00 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:24:00 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:24:00 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:24:00 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:24:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:24:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:24:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:24:08 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:24:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:24:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:24:08 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:24:08 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:24:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:24:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:24:08 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:24:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:24:11 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:24:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:24:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:24:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:24:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:24:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:24:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:24:15 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:24:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:24:15 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:24:15 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:24:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43285801
Thu 16 Jan 2014 23:24:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:24:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43285801
Thu 16 Jan 2014 23:24:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:24:16 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:24:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 23:24:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:24:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 23:24:16 - job_xml_thread(): Done retrieving: data size 43285801
Thu 16 Jan 2014 23:24:16 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:24:16 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:24:16 - XML: Start document: iteration 7
Thu 16 Jan 2014 23:24:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5898 values 93045 bits 11630 bytes 
Thu 16 Jan 2014 23:24:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:24:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:24:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:24:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:24:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:24:34 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:24:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:24:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:24:34 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:24:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:24:34 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:24:34 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:24:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:24:35 - XML: Processed 648166 elements - found 710 jobs
Thu 16 Jan 2014 23:24:35 - job 7347050 appears to have finished
Thu 16 Jan 2014 23:24:35 - job_xml_thread(): Found 1 updated jobs.
Thu 16 Jan 2014 23:24:35 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 23:24:36 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Thu 16 Jan 2014 23:24:36 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:24:36 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:24:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:24:39 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:24:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:24:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:24:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:24:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:24:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:24:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:24:42 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:24:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43617172
Thu 16 Jan 2014 23:24:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:24:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43617172
Thu 16 Jan 2014 23:24:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:24:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:24:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:24:51 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:24:51 - job_xml_thread(): Done retrieving: data size 43617172
Thu 16 Jan 2014 23:24:51 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:24:51 - XML: Start document: iteration 8
Thu 16 Jan 2014 23:24:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:24:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:24:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:24:57 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:24:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:24:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:24:59 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:24:59 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:24:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:24:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:24:59 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:25:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:25:04 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:25:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:25:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:25:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:25:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:25:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:25:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:25:06 - XML: Processed 652340 elements - found 710 jobs
Thu 16 Jan 2014 23:25:06 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:25:06 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:25:06 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:25:06 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:25:07 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:25:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 23:25:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:25:09 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:25:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43883590
Thu 16 Jan 2014 23:25:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:25:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43883590
Thu 16 Jan 2014 23:25:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:25:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:25:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:25:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:25:16 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:25:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:25:17 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:25:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 23:25:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 23:25:17 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:25:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5452 values 85970 bits 10746 bytes 
Thu 16 Jan 2014 23:25:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:25:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:25:21 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:25:21 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:25:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:25:24 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:25:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:25:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:25:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:25:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:25:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:25:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:25:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:25:26 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:25:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:25:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:25:26 - Leaving storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 23:25:26 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Thu 16 Jan 2014 23:25:26 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:25:26 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:25:26 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:25:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:25:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:25:28 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:25:28 - job_xml_thread(): Done retrieving: data size 43869755
Thu 16 Jan 2014 23:25:28 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:25:28 - XML: Start document: iteration 9
Thu 16 Jan 2014 23:25:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43869755
Thu 16 Jan 2014 23:25:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:25:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43869755
Thu 16 Jan 2014 23:25:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:25:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:25:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:25:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:25:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:25:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:25:43 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:25:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:25:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:25:44 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:25:44 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:25:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:25:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:25:44 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:25:46 - XML: Processed 655616 elements - found 710 jobs
Thu 16 Jan 2014 23:25:46 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:25:46 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:25:46 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:25:46 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:25:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:25:51 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:25:51 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:25:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 23:25:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:25:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:25:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:25:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:25:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:25:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:25:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:25:53 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:25:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43884060
Thu 16 Jan 2014 23:25:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:25:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43884060
Thu 16 Jan 2014 23:25:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:25:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:25:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:26:01 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:26:01 - job_xml_thread(): Done retrieving: data size 43884060
Thu 16 Jan 2014 23:26:02 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:26:02 - XML: Start document: iteration 10
Thu 16 Jan 2014 23:26:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:26:06 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:26:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:26:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:26:07 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:26:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:26:07 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:26:07 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:26:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:26:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:26:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:26:15 - XML: Processed 655612 elements - found 708 jobs
Thu 16 Jan 2014 23:26:15 - job 7346829 appears to have finished
Thu 16 Jan 2014 23:26:16 - job 7346717 appears to have finished
Thu 16 Jan 2014 23:26:16 - job_xml_thread(): Found 2 updated jobs.
Thu 16 Jan 2014 23:26:16 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 23:26:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:26:16 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:26:16 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Thu 16 Jan 2014 23:26:16 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:26:16 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:26:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:26:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:26:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:26:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:26:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:26:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:26:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:26:17 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:26:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:26:17 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:26:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 23:26:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 23:26:17 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:26:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5761 values 90813 bits 11351 bytes 
Thu 16 Jan 2014 23:26:19 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:26:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43866802
Thu 16 Jan 2014 23:26:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:26:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43866802
Thu 16 Jan 2014 23:26:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:26:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:26:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:26:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:26:28 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:26:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:26:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:26:29 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:26:29 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:26:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:26:29 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:26:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:26:31 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:26:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:26:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:26:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:26:33 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:26:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:26:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:26:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:26:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:26:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:26:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:26:35 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:26:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 23:26:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:26:36 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:26:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43887233
Thu 16 Jan 2014 23:26:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:26:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43887233
Thu 16 Jan 2014 23:26:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:26:37 - job_xml_thread(): Done retrieving: data size 43887233
Thu 16 Jan 2014 23:26:38 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:26:38 - XML: Start document: iteration 11
Thu 16 Jan 2014 23:26:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:26:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:26:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:26:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:26:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:26:53 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:26:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:26:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:26:55 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:26:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:26:55 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:26:55 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:26:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:26:57 - XML: Processed 655614 elements - found 709 jobs
Thu 16 Jan 2014 23:26:57 - job_xml_thread(): Found 1 updated jobs.
Thu 16 Jan 2014 23:26:57 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 23:26:58 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Thu 16 Jan 2014 23:26:58 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:26:58 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:26:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:26:59 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:26:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:26:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:26:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:26:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:26:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:26:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:27:01 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:27:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43890525
Thu 16 Jan 2014 23:27:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:27:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43890525
Thu 16 Jan 2014 23:27:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:27:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:27:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:27:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:27:12 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:27:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:27:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:27:13 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:27:13 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:27:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:27:13 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:27:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:27:13 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:27:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:27:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:27:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:27:14 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:27:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:27:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:27:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:27:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:27:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:27:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:27:16 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:27:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43897399
Thu 16 Jan 2014 23:27:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:27:17 - job_xml_thread(): Done retrieving: data size 43897399
Thu 16 Jan 2014 23:27:17 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:27:17 - XML: Start document: iteration 12
Thu 16 Jan 2014 23:27:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43897399
Thu 16 Jan 2014 23:27:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:27:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:27:17 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:27:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:27:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 23:27:19 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:27:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 10725 values 169214 bits 21151 bytes 
Thu 16 Jan 2014 23:27:19 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:27:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 23:27:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:27:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:27:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:27:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:27:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:27:35 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:27:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:27:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:27:36 - XML: Processed 655614 elements - found 709 jobs
Thu 16 Jan 2014 23:27:36 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:27:37 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:27:37 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:27:37 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:27:37 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:27:37 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:27:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:27:37 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:27:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:27:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:27:38 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:27:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:27:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:27:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:27:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:27:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:27:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:27:41 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:27:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 23:27:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:27:41 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:27:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43912652
Thu 16 Jan 2014 23:27:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:27:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43912652
Thu 16 Jan 2014 23:27:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:27:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:27:52 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:27:52 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:27:52 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:27:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:27:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:27:53 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:27:53 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:27:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:27:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:27:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:27:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:27:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:27:55 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:27:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:27:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:27:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:27:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:27:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:27:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:27:58 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:27:58 - job_xml_thread(): Done retrieving: data size 43908972
Thu 16 Jan 2014 23:27:58 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:27:58 - XML: Start document: iteration 13
Thu 16 Jan 2014 23:27:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43908972
Thu 16 Jan 2014 23:27:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:27:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43908972
Thu 16 Jan 2014 23:27:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:28:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:28:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:28:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:28:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:28:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:28:14 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Thu 16 Jan 2014 23:28:14 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:28:14 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:28:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:28:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:28:16 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:28:16 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:28:16 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:28:16 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 23:28:16 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:28:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:28:16 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 23:28:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:28:16 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 23:28:16 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:28:17 - XML: Processed 655610 elements - found 707 jobs
Thu 16 Jan 2014 23:28:17 - job 7345061 appears to have finished
Thu 16 Jan 2014 23:28:17 - job 7347039 appears to have finished
Thu 16 Jan 2014 23:28:17 - job_xml_thread(): Found 2 updated jobs.
Thu 16 Jan 2014 23:28:17 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 23:28:18 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Thu 16 Jan 2014 23:28:18 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:28:18 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:28:19 - size of cluster 'LISA Cluster': 624 hosts 79478 metrics 806587 values 12720074 bits 1590009 bytes 
Thu 16 Jan 2014 23:28:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:28:19 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:28:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:28:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 23:28:20 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:28:20 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:28:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 23:28:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99120 bits 12390 bytes 
Thu 16 Jan 2014 23:28:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:28:21 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:28:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:28:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:28:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:28:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:28:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:28:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:28:26 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:28:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43885744
Thu 16 Jan 2014 23:28:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:28:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43885744
Thu 16 Jan 2014 23:28:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:28:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:28:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:28:33 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:28:33 - job_xml_thread(): Done retrieving: data size 43885744
Thu 16 Jan 2014 23:28:33 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:28:34 - XML: Start document: iteration 14
Thu 16 Jan 2014 23:28:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:28:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:28:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:28:45 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:28:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:28:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:28:46 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:28:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:28:46 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:28:46 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:28:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:28:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:28:47 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:28:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:28:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:28:49 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:28:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:28:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:28:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 23:28:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:28:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:28:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:28:50 - XML: Processed 655616 elements - found 710 jobs
Thu 16 Jan 2014 23:28:50 - job 7345967 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 23:28:50 - job_xml_thread(): Found 4 updated jobs.
Thu 16 Jan 2014 23:28:50 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 23:28:50 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Thu 16 Jan 2014 23:28:50 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:28:50 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:28:53 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:28:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43889339
Thu 16 Jan 2014 23:28:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:28:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43889339
Thu 16 Jan 2014 23:28:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:29:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:29:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:29:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:29:01 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:29:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:29:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:29:01 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:29:01 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:29:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:29:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43889339
Thu 16 Jan 2014 23:29:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:29:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:29:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:29:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:29:05 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:29:05 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:29:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:29:14 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:29:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:29:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:29:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:29:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:29:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:29:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:29:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:29:15 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:29:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:29:17 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:29:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:29:17 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 23:29:18 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:29:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:29:18 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:29:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:29:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:29:20 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:29:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:29:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 23:29:21 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:29:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 23:29:21 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:29:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5928 values 93535 bits 11691 bytes 
Thu 16 Jan 2014 23:29:21 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:29:21 - job_xml_thread(): Done retrieving: data size 43790581
Thu 16 Jan 2014 23:29:21 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:29:21 - XML: Start document: iteration 15
Thu 16 Jan 2014 23:29:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43790581
Thu 16 Jan 2014 23:29:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:29:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43790581
Thu 16 Jan 2014 23:29:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:29:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:29:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:29:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:29:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:29:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:29:36 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:29:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:29:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:29:36 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:29:36 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:29:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:29:36 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:29:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:29:40 - XML: Processed 654864 elements - found 710 jobs
Thu 16 Jan 2014 23:29:41 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:29:41 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:29:41 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:29:41 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:29:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:29:44 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:29:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:29:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:29:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:29:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:29:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:29:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:29:48 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:29:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 23:29:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:29:48 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:29:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43288913
Thu 16 Jan 2014 23:29:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:29:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43288913
Thu 16 Jan 2014 23:29:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:29:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:29:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:29:56 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:29:56 - job_xml_thread(): Done retrieving: data size 43288913
Thu 16 Jan 2014 23:29:56 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:29:56 - XML: Start document: iteration 16
Thu 16 Jan 2014 23:29:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:29:58 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:29:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:29:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:29:59 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:29:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:29:59 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:29:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:29:59 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:30:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:30:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:30:09 - XML: Processed 648540 elements - found 710 jobs
Thu 16 Jan 2014 23:30:09 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:30:09 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:30:09 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:30:09 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:30:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:30:09 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:30:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:30:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:30:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:30:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:30:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:30:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:30:11 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:30:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43209780
Thu 16 Jan 2014 23:30:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:30:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43209780
Thu 16 Jan 2014 23:30:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:30:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:30:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:30:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:30:20 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:30:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:30:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:30:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:30:21 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:30:21 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:30:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:30:22 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:30:22 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:30:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:30:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:30:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 23:30:22 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:30:22 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:30:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 23:30:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6461 values 101943 bits 12742 bytes 
Thu 16 Jan 2014 23:30:24 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:30:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:30:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:30:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:30:26 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:30:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:30:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:30:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:30:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:30:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:30:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:30:30 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:30:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43485629
Thu 16 Jan 2014 23:30:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:30:30 - job_xml_thread(): Done retrieving: data size 43485629
Thu 16 Jan 2014 23:30:30 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:30:30 - XML: Start document: iteration 17
Thu 16 Jan 2014 23:30:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43485629
Thu 16 Jan 2014 23:30:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:30:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:30:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:30:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:30:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:30:43 - XML: Processed 650632 elements - found 709 jobs
Thu 16 Jan 2014 23:30:43 - job 7347045 appears to have finished
Thu 16 Jan 2014 23:30:43 - job 7335103 appears to have finished
Thu 16 Jan 2014 23:30:43 - job 7346383 appears to have finished
Thu 16 Jan 2014 23:30:43 - job 7347051 appears to have finished
Thu 16 Jan 2014 23:30:43 - job_xml_thread(): Found 7 updated jobs.
Thu 16 Jan 2014 23:30:43 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 23:30:45 - job_xml_thread(): Done storing. succesfully stored: 7 jobs
Thu 16 Jan 2014 23:30:45 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:30:45 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:30:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:30:47 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:30:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:30:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:30:48 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:30:48 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:30:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:30:48 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:30:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:30:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:30:51 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:30:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:30:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:30:52 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:30:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 23:30:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:30:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:30:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:30:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:30:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:30:55 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:30:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853431
Thu 16 Jan 2014 23:30:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:30:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853431
Thu 16 Jan 2014 23:30:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:31:00 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:31:00 - job_xml_thread(): Done retrieving: data size 43853431
Thu 16 Jan 2014 23:31:00 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:31:00 - XML: Start document: iteration 18
Thu 16 Jan 2014 23:31:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:31:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:31:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:31:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:31:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:31:07 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:31:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:31:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:31:08 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:31:08 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:31:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:31:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:31:08 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:31:18 - XML: Processed 655110 elements - found 709 jobs
Thu 16 Jan 2014 23:31:18 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:31:18 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:31:18 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:31:18 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:31:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:31:19 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:31:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:31:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:31:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:31:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:31:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:31:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:31:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:31:22 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:31:22 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:31:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:31:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 23:31:22 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:31:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5779 values 91223 bits 11402 bytes 
Thu 16 Jan 2014 23:31:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 23:31:23 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:31:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858823
Thu 16 Jan 2014 23:31:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43858823
Thu 16 Jan 2014 23:31:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:31:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:31:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:31:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:31:33 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:31:33 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:31:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:31:33 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:31:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:31:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:31:34 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:31:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:31:34 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:31:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:31:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:31:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:31:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:31:39 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:31:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:31:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:31:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:31:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:31:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:31:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:31:43 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:31:43 - job_xml_thread(): Done retrieving: data size 43879008
Thu 16 Jan 2014 23:31:43 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:31:43 - XML: Start document: iteration 19
Thu 16 Jan 2014 23:31:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43879008
Thu 16 Jan 2014 23:31:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:31:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43879008
Thu 16 Jan 2014 23:31:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:31:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:31:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:31:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:31:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:31:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:31:58 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:31:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:31:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:31:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:31:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:31:59 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:31:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:31:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:32:01 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:32:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 23:32:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:32:04 - XML: Processed 655613 elements - found 709 jobs
Thu 16 Jan 2014 23:32:04 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:32:04 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:32:04 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:32:04 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:32:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:32:06 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:32:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:32:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:32:07 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:32:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:32:07 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:32:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:32:09 - Leaving storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 23:32:09 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Thu 16 Jan 2014 23:32:09 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:32:09 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:32:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43884474
Thu 16 Jan 2014 23:32:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:32:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43884474
Thu 16 Jan 2014 23:32:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:32:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:32:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:32:19 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:32:19 - job_xml_thread(): Done retrieving: data size 43884474
Thu 16 Jan 2014 23:32:19 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:32:20 - XML: Start document: iteration 20
Thu 16 Jan 2014 23:32:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:32:22 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:32:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:32:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:32:23 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:32:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 23:32:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:32:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 23:32:23 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:32:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:32:25 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:32:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6569 values 103817 bits 12977 bytes 
Thu 16 Jan 2014 23:32:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:32:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:32:26 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:32:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:32:26 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:32:26 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:32:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:32:29 - XML: Processed 655616 elements - found 709 jobs
Thu 16 Jan 2014 23:32:29 - job 7347012 appears to have finished
Thu 16 Jan 2014 23:32:29 - job 7346680 appears to have finished
Thu 16 Jan 2014 23:32:29 - job 7347072 field 'start_timestamp' changed since saved from: 1389911392 to: 1389911358
Thu 16 Jan 2014 23:32:29 - job_xml_thread(): Found 5 updated jobs.
Thu 16 Jan 2014 23:32:29 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 23:32:31 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Thu 16 Jan 2014 23:32:31 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:32:31 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:32:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:32:31 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:32:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:32:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:32:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:32:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:32:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:32:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:32:34 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:32:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 23:32:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:32:34 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:32:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43886543
Thu 16 Jan 2014 23:32:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:32:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43886543
Thu 16 Jan 2014 23:32:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:32:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:32:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:32:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:32:44 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:32:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:32:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:32:46 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:32:46 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:32:46 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:32:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:32:46 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:32:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:32:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:32:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:32:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:32:48 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:32:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:32:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:32:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:32:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:32:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:32:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:32:50 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:32:50 - job_xml_thread(): Done retrieving: data size 43912532
Thu 16 Jan 2014 23:32:50 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:32:50 - Housekeeping: checking database for timed out jobs..
Thu 16 Jan 2014 23:32:50 - Housekeeping: Found 0 timed out jobs in database: closing entries
Thu 16 Jan 2014 23:32:50 - Housekeeping: done.
Thu 16 Jan 2014 23:32:50 - XML: Start document: iteration 0
Thu 16 Jan 2014 23:32:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43912532
Thu 16 Jan 2014 23:32:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:32:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43912532
Thu 16 Jan 2014 23:32:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:33:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:33:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:33:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:33:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:33:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:33:10 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:33:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:33:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:33:11 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:33:11 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:33:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:33:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:33:11 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:33:11 - XML: Processed 655616 elements - found 709 jobs
Thu 16 Jan 2014 23:33:11 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:33:11 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:33:11 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:33:11 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:33:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:33:13 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:33:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:33:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:33:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:33:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:33:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:33:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:33:15 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:33:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43885609
Thu 16 Jan 2014 23:33:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:33:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43885609
Thu 16 Jan 2014 23:33:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:33:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:33:23 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:33:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:33:24 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:33:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 23:33:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 23:33:25 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:33:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 149088 bits 18636 bytes 
Thu 16 Jan 2014 23:33:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:33:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:33:27 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:33:27 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:33:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:33:29 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:33:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:33:29 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:33:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:33:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:33:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:33:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:33:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:33:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:33:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:33:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:33:30 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:33:30 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:33:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:33:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:33:32 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:33:32 - job_xml_thread(): Done retrieving: data size 43892728
Thu 16 Jan 2014 23:33:32 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:33:32 - XML: Start document: iteration 1
Thu 16 Jan 2014 23:33:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43892728
Thu 16 Jan 2014 23:33:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:33:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43892728
Thu 16 Jan 2014 23:33:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:33:44 - XML: Processed 655616 elements - found 709 jobs
Thu 16 Jan 2014 23:33:44 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:33:44 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:33:44 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:33:44 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:33:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:33:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:33:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:33:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:33:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:33:52 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:33:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:33:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:33:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:33:53 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:33:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:33:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:33:53 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:33:53 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:33:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:33:53 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:33:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:33:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:33:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:33:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:33:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:33:53 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:33:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 23:33:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:33:56 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:33:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43904903
Thu 16 Jan 2014 23:33:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:33:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43904903
Thu 16 Jan 2014 23:33:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:33:59 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:33:59 - job_xml_thread(): Done retrieving: data size 43904903
Thu 16 Jan 2014 23:33:59 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:33:59 - XML: Start document: iteration 2
Thu 16 Jan 2014 23:34:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:34:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:34:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:34:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:34:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:34:09 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:34:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:34:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:34:10 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:34:10 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:34:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:34:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:34:10 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:34:13 - XML: Processed 655604 elements - found 703 jobs
Thu 16 Jan 2014 23:34:13 - job 7345102 appears to have finished
Thu 16 Jan 2014 23:34:13 - job 7346330 appears to have finished
Thu 16 Jan 2014 23:34:13 - job 7345964 appears to have finished
Thu 16 Jan 2014 23:34:13 - job 7347046 appears to have finished
Thu 16 Jan 2014 23:34:13 - job 7345150 appears to have finished
Thu 16 Jan 2014 23:34:13 - job 7347030 appears to have finished
Thu 16 Jan 2014 23:34:13 - job_xml_thread(): Found 6 updated jobs.
Thu 16 Jan 2014 23:34:13 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 23:34:15 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Thu 16 Jan 2014 23:34:15 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:34:15 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:34:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:34:18 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:34:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:34:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:34:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:34:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:34:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:34:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:34:20 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:34:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43881538
Thu 16 Jan 2014 23:34:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:34:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43881538
Thu 16 Jan 2014 23:34:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:34:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:34:24 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:34:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:34:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:34:26 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:34:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:34:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 23:34:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 23:34:27 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:34:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8973 values 141631 bits 17703 bytes 
Thu 16 Jan 2014 23:34:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:34:29 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:34:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:34:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:34:30 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:34:30 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:34:30 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:34:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:34:30 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:34:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:34:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:34:33 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:34:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:34:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:34:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:34:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:34:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:34:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:34:35 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:34:35 - job_xml_thread(): Done retrieving: data size 43906063
Thu 16 Jan 2014 23:34:35 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:34:35 - XML: Start document: iteration 3
Thu 16 Jan 2014 23:34:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43906063
Thu 16 Jan 2014 23:34:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:34:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43906063
Thu 16 Jan 2014 23:34:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:34:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:34:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:34:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:34:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:34:52 - XML: Processed 655606 elements - found 704 jobs
Thu 16 Jan 2014 23:34:52 - job 7347074 field 'start_timestamp' changed since saved from: 1389911486 to: 1389911419
Thu 16 Jan 2014 23:34:52 - job_xml_thread(): Found 2 updated jobs.
Thu 16 Jan 2014 23:34:52 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 23:34:53 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Thu 16 Jan 2014 23:34:53 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:34:53 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:34:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:34:56 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:34:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:34:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:34:57 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:34:57 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:34:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:34:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:34:57 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:34:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:34:58 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:34:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:34:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:34:58 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:34:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 23:34:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:34:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:34:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:34:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:34:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:35:00 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:35:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43890842
Thu 16 Jan 2014 23:35:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:35:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43890842
Thu 16 Jan 2014 23:35:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:35:09 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:35:09 - job_xml_thread(): Done retrieving: data size 43890842
Thu 16 Jan 2014 23:35:09 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:35:09 - XML: Start document: iteration 4
Thu 16 Jan 2014 23:35:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:35:10 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:35:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:35:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:35:13 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:35:13 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:35:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:35:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:35:13 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:35:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:35:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:35:17 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Thu 16 Jan 2014 23:35:17 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:35:17 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:35:17 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:35:17 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 23:35:17 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 23:35:17 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 23:35:20 - XML: Processed 655606 elements - found 704 jobs
Thu 16 Jan 2014 23:35:20 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:35:20 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:35:20 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:35:20 - job_xml_thread(): Sleeping.. (15s)
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Thu 16 Jan 2014 23:35:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:35:22 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:35:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:35:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:35:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:35:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:35:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:35:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:35:24 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:35:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43811222
Thu 16 Jan 2014 23:35:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:35:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43811222
Thu 16 Jan 2014 23:35:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:35:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:35:27 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:35:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:35:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:35:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:35:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 23:35:29 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:35:29 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:35:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 23:35:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9022 values 142356 bits 17794 bytes 
Thu 16 Jan 2014 23:35:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:35:34 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:35:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:35:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:35:35 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:35:35 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:35:35 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:35:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:35:35 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:35:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:35:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:35:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:35:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:35:39 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:35:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:35:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:35:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:35:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:35:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:35:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:35:41 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:35:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 23:35:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:35:41 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:35:41 - job_xml_thread(): Done retrieving: data size 43300235
Thu 16 Jan 2014 23:35:41 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:35:41 - XML: Start document: iteration 5
Thu 16 Jan 2014 23:35:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43300235
Thu 16 Jan 2014 23:35:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43300235
Thu 16 Jan 2014 23:35:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:35:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:35:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:35:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:35:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:35:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:35:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:35:56 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:35:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:35:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:35:57 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:35:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:35:57 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:35:57 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:35:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:36:01 - XML: Processed 648223 elements - found 704 jobs
Thu 16 Jan 2014 23:36:01 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:36:01 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:36:01 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:36:01 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:36:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:36:03 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:36:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:36:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:36:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:36:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:36:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:36:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:36:05 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:36:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43225575
Thu 16 Jan 2014 23:36:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:36:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43225575
Thu 16 Jan 2014 23:36:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:36:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:36:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:36:17 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:36:17 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:36:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:36:17 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:36:17 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:36:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:36:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:36:17 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:36:18 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:36:18 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:36:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:36:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:36:18 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:36:18 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:36:18 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 23:36:18 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 23:36:18 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 23:36:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:36:19 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:36:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:36:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:36:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:36:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:36:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:36:20 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 919795 values 14527933 bits 1815991 bytes 
Thu 16 Jan 2014 23:36:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:36:23 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:36:23 - job_xml_thread(): Done retrieving: data size 43300070
Thu 16 Jan 2014 23:36:23 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:36:23 - XML: Start document: iteration 6
Thu 16 Jan 2014 23:36:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43300070
Thu 16 Jan 2014 23:36:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:36:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43300070
Thu 16 Jan 2014 23:36:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:36:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:36:30 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:36:31 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:36:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 23:36:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:36:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 23:36:32 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:36:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:36:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:36:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148693 bits 18586 bytes 
Thu 16 Jan 2014 23:36:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:36:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:36:37 - XML: Processed 648156 elements - found 705 jobs
Thu 16 Jan 2014 23:36:37 - job 7347062 appears to have finished
Thu 16 Jan 2014 23:36:37 - job_xml_thread(): Found 3 updated jobs.
Thu 16 Jan 2014 23:36:37 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 23:36:39 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Thu 16 Jan 2014 23:36:39 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:36:39 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:36:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:36:42 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:36:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:36:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:36:43 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:36:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:36:43 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:36:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:36:43 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:36:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:36:45 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:36:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:36:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:36:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:36:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:36:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:36:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:36:49 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:36:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43838449
Thu 16 Jan 2014 23:36:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:36:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43838449
Thu 16 Jan 2014 23:36:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:36:54 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:36:54 - job_xml_thread(): Done retrieving: data size 43838449
Thu 16 Jan 2014 23:36:54 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:36:54 - XML: Start document: iteration 7
Thu 16 Jan 2014 23:36:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:36:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:37:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:37:00 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:37:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:37:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:37:01 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:37:01 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:37:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:37:01 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:37:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:37:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:37:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:37:10 - XML: Processed 654924 elements - found 705 jobs
Thu 16 Jan 2014 23:37:10 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:37:10 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:37:10 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:37:10 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:37:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:37:12 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:37:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:37:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:37:13 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:37:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 23:37:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:37:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:37:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:37:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:37:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:37:15 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:37:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867159
Thu 16 Jan 2014 23:37:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:37:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:37:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:37:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43867159
Thu 16 Jan 2014 23:37:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:37:19 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:37:19 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 23:37:25 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:37:25 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:37:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:37:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:37:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:37:28 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:37:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:37:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:37:29 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:37:29 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:37:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:37:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:37:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:37:31 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:37:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:37:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:37:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:37:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:37:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:37:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:37:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:37:32 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:37:32 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:37:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:37:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 23:37:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 23:37:32 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:37:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5725 values 90331 bits 11291 bytes 
Thu 16 Jan 2014 23:37:34 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:37:34 - job_xml_thread(): Done retrieving: data size 43876308
Thu 16 Jan 2014 23:37:34 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:37:35 - XML: Start document: iteration 8
Thu 16 Jan 2014 23:37:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43876308
Thu 16 Jan 2014 23:37:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:37:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43876308
Thu 16 Jan 2014 23:37:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:37:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:37:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:37:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:37:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:37:48 - XML: Processed 655608 elements - found 705 jobs
Thu 16 Jan 2014 23:37:48 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:37:48 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:37:48 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:37:48 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:37:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:37:52 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:37:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:37:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:37:54 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:37:54 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:37:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:37:54 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:37:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:37:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:37:57 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:37:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:37:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:37:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:37:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:37:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:37:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:38:01 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:38:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 23:38:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:38:03 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:38:03 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:38:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43871390
Thu 16 Jan 2014 23:38:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:38:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43871390
Thu 16 Jan 2014 23:38:04 - job_xml_thread(): Done retrieving: data size 43871390
Thu 16 Jan 2014 23:38:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:38:04 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:38:04 - XML: Start document: iteration 9
Thu 16 Jan 2014 23:38:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:38:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:38:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:38:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:38:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:38:18 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:38:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:38:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:38:19 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:38:19 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:38:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:38:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:38:20 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:38:23 - XML: Processed 655602 elements - found 702 jobs
Thu 16 Jan 2014 23:38:23 - job 7346932 appears to have finished
Thu 16 Jan 2014 23:38:23 - job 7347072 appears to have finished
Thu 16 Jan 2014 23:38:23 - job 7346548 appears to have finished
Thu 16 Jan 2014 23:38:23 - job_xml_thread(): Found 3 updated jobs.
Thu 16 Jan 2014 23:38:23 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 23:38:24 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Thu 16 Jan 2014 23:38:24 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:38:24 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:38:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:38:27 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:38:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:38:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:38:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:38:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:38:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:38:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:38:30 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:38:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870033
Thu 16 Jan 2014 23:38:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:38:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870033
Thu 16 Jan 2014 23:38:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:38:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:38:33 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:38:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:38:34 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:38:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 23:38:34 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:38:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 23:38:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7493 values 118214 bits 14776 bytes 
Thu 16 Jan 2014 23:38:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:38:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:38:39 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:38:39 - job_xml_thread(): Done retrieving: data size 43870033
Thu 16 Jan 2014 23:38:39 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:38:39 - XML: Start document: iteration 10
Thu 16 Jan 2014 23:38:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:38:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:38:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:38:44 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:38:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:38:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:38:44 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:38:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:38:44 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:38:44 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:38:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:38:44 - Leaving storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 23:38:44 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Thu 16 Jan 2014 23:38:44 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:38:55 - XML: Processed 655600 elements - found 702 jobs
Thu 16 Jan 2014 23:38:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:38:55 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:38:55 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:38:55 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:38:55 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:38:55 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:38:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:38:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:38:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:38:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:38:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:38:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:38:58 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:38:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873161
Thu 16 Jan 2014 23:38:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:38:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873161
Thu 16 Jan 2014 23:38:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:38:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:38:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:39:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:39:11 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:39:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:39:11 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:39:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:39:11 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:39:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:39:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:39:12 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:39:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:39:12 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:39:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:39:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:39:13 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:39:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:39:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:39:13 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:39:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 23:39:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:39:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:39:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:39:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:39:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:39:15 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:39:15 - job_xml_thread(): Done retrieving: data size 43882314
Thu 16 Jan 2014 23:39:15 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:39:15 - XML: Start document: iteration 11
Thu 16 Jan 2014 23:39:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43882314
Thu 16 Jan 2014 23:39:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:39:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43882314
Thu 16 Jan 2014 23:39:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:39:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:39:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:39:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:39:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:39:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:39:31 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:39:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:39:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:39:31 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:39:31 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:39:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:39:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:39:31 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:39:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:39:34 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:39:35 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:39:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:39:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 23:39:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 23:39:35 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:39:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5882 values 92803 bits 11600 bytes 
Thu 16 Jan 2014 23:39:38 - XML: Processed 655602 elements - found 702 jobs
Thu 16 Jan 2014 23:39:38 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:39:38 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:39:39 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:39:39 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:39:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:39:39 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:39:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:39:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:39:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:39:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:39:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:39:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:39:42 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:39:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43883044
Thu 16 Jan 2014 23:39:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:39:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43883044
Thu 16 Jan 2014 23:39:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:39:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:39:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:39:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:39:52 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:39:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:39:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:39:53 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:39:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:39:53 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:39:53 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:39:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:39:54 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:39:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:39:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:39:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:39:57 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:39:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:39:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:39:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:39:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:39:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:39:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:39:58 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:39:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 23:39:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:39:59 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:39:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43876068
Thu 16 Jan 2014 23:39:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:40:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43876068
Thu 16 Jan 2014 23:40:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:40:00 - job_xml_thread(): Done retrieving: data size 43876068
Thu 16 Jan 2014 23:40:00 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:40:00 - XML: Start document: iteration 12
Thu 16 Jan 2014 23:40:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:40:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:40:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:40:10 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:40:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:40:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:40:12 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:40:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:40:12 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:40:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:40:12 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:40:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:40:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:40:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:40:22 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:40:22 - XML: Processed 655602 elements - found 702 jobs
Thu 16 Jan 2014 23:40:22 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:40:22 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:40:22 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:40:22 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:40:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:40:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:40:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:40:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:40:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:40:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:40:24 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:40:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43872458
Thu 16 Jan 2014 23:40:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:40:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43872458
Thu 16 Jan 2014 23:40:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:40:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:40:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:40:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:40:34 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:40:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:40:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:40:34 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:40:34 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:40:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:40:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:40:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43872458
Thu 16 Jan 2014 23:40:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:40:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:40:35 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:40:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:40:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 23:40:35 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:40:35 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:40:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 23:40:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8793 values 138639 bits 17329 bytes 
Thu 16 Jan 2014 23:40:37 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:40:37 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:40:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:40:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:40:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:40:44 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:40:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:40:45 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:40:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:40:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:40:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:40:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:40:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:40:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:40:48 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:40:48 - job_xml_thread(): Done retrieving: data size 43857804
Thu 16 Jan 2014 23:40:48 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:40:48 - XML: Start document: iteration 13
Thu 16 Jan 2014 23:40:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43857804
Thu 16 Jan 2014 23:40:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:40:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:40:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:40:50 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:40:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:40:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43857804
Thu 16 Jan 2014 23:40:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:40:50 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:40:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:41:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:41:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:41:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:41:03 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:41:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:41:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:41:06 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:41:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 23:41:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:41:06 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:41:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:41:06 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:41:06 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:41:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:41:08 - XML: Processed 655602 elements - found 702 jobs
Thu 16 Jan 2014 23:41:08 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:41:08 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:41:08 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:41:08 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:41:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:41:11 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:41:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:41:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:41:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:41:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:41:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:41:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:41:12 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:41:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43830205
Thu 16 Jan 2014 23:41:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:41:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43830205
Thu 16 Jan 2014 23:41:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:41:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:41:21 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:41:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:41:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:41:22 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:41:22 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:41:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:41:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:41:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43830205
Thu 16 Jan 2014 23:41:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:41:23 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:41:24 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:41:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:41:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:41:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:41:33 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:41:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:41:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:41:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:41:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:41:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:41:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:41:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:41:34 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:41:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:41:36 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:41:36 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:41:36 - job_xml_thread(): Done retrieving: data size 43447979
Thu 16 Jan 2014 23:41:36 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:41:36 - XML: Start document: iteration 14
Thu 16 Jan 2014 23:41:37 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:41:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 23:41:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:41:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 23:41:37 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:41:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5937 values 93668 bits 11708 bytes 
Thu 16 Jan 2014 23:41:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43447979
Thu 16 Jan 2014 23:41:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:41:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:41:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:41:39 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:41:39 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:41:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:41:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:41:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43447979
Thu 16 Jan 2014 23:41:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:41:49 - XML: Processed 650440 elements - found 702 jobs
Thu 16 Jan 2014 23:41:49 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:41:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:41:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:41:49 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:41:49 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:41:49 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:41:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:41:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:41:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:41:57 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:41:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:41:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:41:58 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:41:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:41:58 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:41:58 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:41:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:41:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:41:59 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:41:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:41:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:42:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:42:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:42:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:42:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:42:02 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:42:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43224445
Thu 16 Jan 2014 23:42:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:42:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43224445
Thu 16 Jan 2014 23:42:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:42:04 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:42:04 - job_xml_thread(): Done retrieving: data size 43224445
Thu 16 Jan 2014 23:42:04 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:42:04 - XML: Start document: iteration 15
Thu 16 Jan 2014 23:42:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:42:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:42:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:42:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:42:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:42:20 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:42:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:42:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:42:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:42:21 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:42:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:42:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:42:21 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:42:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:42:21 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:42:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:42:21 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:42:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:42:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:42:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:42:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:42:24 - XML: Processed 647404 elements - found 703 jobs
Thu 16 Jan 2014 23:42:24 - job_xml_thread(): Found 1 updated jobs.
Thu 16 Jan 2014 23:42:24 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 23:42:24 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Thu 16 Jan 2014 23:42:24 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:42:24 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:42:24 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:42:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 23:42:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:42:26 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:42:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43300659
Thu 16 Jan 2014 23:42:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:42:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43300659
Thu 16 Jan 2014 23:42:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:42:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:42:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:42:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:42:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:42:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:42:37 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:42:38 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:42:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 23:42:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:42:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 23:42:38 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:42:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5783 values 91178 bits 11397 bytes 
Thu 16 Jan 2014 23:42:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:42:39 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:42:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:42:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:42:39 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:42:39 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:42:40 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:42:40 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:42:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:42:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:42:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:42:41 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:42:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:42:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:42:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:42:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:42:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:42:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:42:46 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:42:46 - job_xml_thread(): Done retrieving: data size 43779557
Thu 16 Jan 2014 23:42:46 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:42:46 - XML: Start document: iteration 16
Thu 16 Jan 2014 23:42:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43779557
Thu 16 Jan 2014 23:42:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43779557
Thu 16 Jan 2014 23:42:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:42:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:42:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:42:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:42:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:42:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:42:58 - XML: Processed 654092 elements - found 703 jobs
Thu 16 Jan 2014 23:42:58 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:42:58 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:42:58 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:42:58 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:43:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:43:05 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:43:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:43:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:43:05 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:43:05 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:43:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:43:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:43:05 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:43:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:43:09 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:43:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:43:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:43:09 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:43:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 23:43:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:43:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:43:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:43:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:43:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:43:11 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:43:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43889305
Thu 16 Jan 2014 23:43:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:43:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43889305
Thu 16 Jan 2014 23:43:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:43:13 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:43:13 - job_xml_thread(): Done retrieving: data size 43889305
Thu 16 Jan 2014 23:43:14 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:43:14 - XML: Start document: iteration 17
Thu 16 Jan 2014 23:43:20 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Thu 16 Jan 2014 23:43:21 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:43:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:43:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:43:21 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:43:21 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:43:21 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 23:43:21 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 23:43:21 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 23:43:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:43:23 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:43:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:43:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Thu 16 Jan 2014 23:43:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:43:24 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:43:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:43:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:43:25 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:43:25 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:43:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:43:31 - XML: Processed 655604 elements - found 703 jobs
Thu 16 Jan 2014 23:43:31 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:43:31 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:43:31 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:43:31 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:43:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:43:33 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:43:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:43:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:43:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:43:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:43:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:43:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:43:36 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:43:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855321
Thu 16 Jan 2014 23:43:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:43:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855321
Thu 16 Jan 2014 23:43:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:43:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:43:38 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:43:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:43:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 23:43:39 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:43:39 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:43:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 23:43:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9097 values 143555 bits 17944 bytes 
Thu 16 Jan 2014 23:43:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:43:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:43:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:43:46 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:43:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:43:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:43:46 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:43:46 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:43:47 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:43:47 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:43:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:43:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:43:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:43:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:43:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:43:50 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:43:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:43:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:43:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:43:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:43:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:43:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:43:52 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:43:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 23:43:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:43:52 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:43:52 - job_xml_thread(): Done retrieving: data size 43882993
Thu 16 Jan 2014 23:43:52 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:43:52 - XML: Start document: iteration 18
Thu 16 Jan 2014 23:43:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43882993
Thu 16 Jan 2014 23:43:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43882993
Thu 16 Jan 2014 23:43:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:43:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:44:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:44:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:44:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:44:06 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:44:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:44:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:44:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:44:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:44:08 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:44:08 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:44:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:44:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:44:08 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:44:12 - XML: Processed 655604 elements - found 703 jobs
Thu 16 Jan 2014 23:44:12 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:44:12 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:44:12 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:44:12 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:44:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:44:16 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:44:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:44:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:44:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:44:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:44:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:44:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:44:18 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:44:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867767
Thu 16 Jan 2014 23:44:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:44:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43867767
Thu 16 Jan 2014 23:44:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:44:21 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:44:21 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:44:22 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:44:22 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:44:22 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 23:44:23 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 23:44:23 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 23:44:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:44:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:44:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:44:27 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:44:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:44:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:44:27 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:44:27 - job_xml_thread(): Done retrieving: data size 43867767
Thu 16 Jan 2014 23:44:27 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:44:28 - XML: Start document: iteration 19
Thu 16 Jan 2014 23:44:29 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:44:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:44:29 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:44:29 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:44:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:44:31 - size of cluster 'LISA Cluster': 624 hosts 79474 metrics 906472 values 14295620 bits 1786952 bytes 
Thu 16 Jan 2014 23:44:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:44:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:44:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:44:40 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:44:40 - XML: Processed 655612 elements - found 707 jobs
Thu 16 Jan 2014 23:44:40 - job 7346846 appears to have finished
Thu 16 Jan 2014 23:44:40 - job 7345909 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 23:44:40 - job_xml_thread(): Found 7 updated jobs.
Thu 16 Jan 2014 23:44:40 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 23:44:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:44:40 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:44:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 23:44:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 23:44:40 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:44:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99087 bits 12385 bytes 
Thu 16 Jan 2014 23:44:41 - job_xml_thread(): Done storing. succesfully stored: 7 jobs
Thu 16 Jan 2014 23:44:41 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:44:41 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:44:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:44:43 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:44:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:44:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:44:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:44:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:44:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:44:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:44:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:44:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:44:46 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:44:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867606
Thu 16 Jan 2014 23:44:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:44:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43867606
Thu 16 Jan 2014 23:44:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:44:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:44:55 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:44:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:44:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:44:56 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:44:56 - job_xml_thread(): Done retrieving: data size 43867606
Thu 16 Jan 2014 23:44:56 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:44:56 - XML: Start document: iteration 20
Thu 16 Jan 2014 23:44:57 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:44:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:44:57 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:44:57 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:44:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:44:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:44:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:45:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:45:08 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:45:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:45:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:45:09 - XML: Processed 655612 elements - found 707 jobs
Thu 16 Jan 2014 23:45:09 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:45:09 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:45:09 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:45:09 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:45:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:45:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:45:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:45:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:45:09 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:45:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 23:45:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:45:12 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:45:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43864639
Thu 16 Jan 2014 23:45:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:45:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:45:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43864639
Thu 16 Jan 2014 23:45:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:45:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:45:22 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:45:22 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 23:45:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:45:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:45:24 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:45:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:45:24 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:45:24 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:45:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:45:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:45:25 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:45:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:45:25 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:45:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:45:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:45:27 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:45:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:45:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:45:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:45:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:45:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:45:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:45:31 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:45:31 - job_xml_thread(): Done retrieving: data size 43899564
Thu 16 Jan 2014 23:45:31 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:45:31 - Housekeeping: checking database for timed out jobs..
Thu 16 Jan 2014 23:45:31 - Housekeeping: Found 0 timed out jobs in database: closing entries
Thu 16 Jan 2014 23:45:31 - Housekeeping: done.
Thu 16 Jan 2014 23:45:31 - XML: Start document: iteration 0
Thu 16 Jan 2014 23:45:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43899564
Thu 16 Jan 2014 23:45:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43899564
Thu 16 Jan 2014 23:45:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:45:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:45:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:45:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:45:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:45:41 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:45:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:45:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:45:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:45:43 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:45:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 23:45:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 23:45:43 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:45:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8825 values 139212 bits 17401 bytes 
Thu 16 Jan 2014 23:45:49 - XML: Processed 655606 elements - found 707 jobs
Thu 16 Jan 2014 23:45:49 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:45:49 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:45:49 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:45:49 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:45:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:45:50 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:45:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:45:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:45:51 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:45:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:45:51 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:45:51 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:45:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:45:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:45:52 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:45:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:45:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:45:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:45:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:45:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:45:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:45:56 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:45:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43897608
Thu 16 Jan 2014 23:45:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:45:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43897608
Thu 16 Jan 2014 23:45:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:46:05 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:46:05 - job_xml_thread(): Done retrieving: data size 43897608
Thu 16 Jan 2014 23:46:05 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:46:05 - XML: Start document: iteration 1
Thu 16 Jan 2014 23:46:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:46:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:46:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:46:06 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:46:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:46:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:46:06 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:46:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:46:06 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:46:06 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:46:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:46:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:46:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:46:09 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:46:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 23:46:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:46:18 - XML: Processed 655596 elements - found 699 jobs
Thu 16 Jan 2014 23:46:18 - job 7346794 appears to have finished
Thu 16 Jan 2014 23:46:18 - job 7347048 appears to have finished
Thu 16 Jan 2014 23:46:18 - job 7345967 appears to have finished
Thu 16 Jan 2014 23:46:18 - job 7345992 appears to have finished
Thu 16 Jan 2014 23:46:18 - job 7347078 appears to have finished
Thu 16 Jan 2014 23:46:18 - job 7347034 appears to have finished
Thu 16 Jan 2014 23:46:18 - job 7347059 appears to have finished
Thu 16 Jan 2014 23:46:18 - job 7347058 appears to have finished
Thu 16 Jan 2014 23:46:18 - job_xml_thread(): Found 8 updated jobs.
Thu 16 Jan 2014 23:46:18 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 23:46:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:46:19 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:46:19 - job_xml_thread(): Done storing. succesfully stored: 8 jobs
Thu 16 Jan 2014 23:46:19 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:46:19 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:46:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:46:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:46:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:46:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:46:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:46:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:46:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:46:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:46:23 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:46:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43854076
Thu 16 Jan 2014 23:46:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:46:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43854076
Thu 16 Jan 2014 23:46:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:46:35 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:46:35 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:46:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:46:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:46:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:46:37 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:46:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:46:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:46:37 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:46:37 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:46:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:46:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:46:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:46:38 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:46:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:46:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:46:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:46:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:46:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:46:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:46:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:46:43 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:46:44 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:46:44 - job_xml_thread(): Done retrieving: data size 43899627
Thu 16 Jan 2014 23:46:44 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:46:44 - XML: Start document: iteration 2
Thu 16 Jan 2014 23:46:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43899627
Thu 16 Jan 2014 23:46:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:46:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:46:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 23:46:45 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:46:45 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:46:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43899627
Thu 16 Jan 2014 23:46:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:46:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 23:46:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5994 values 94689 bits 11836 bytes 
Thu 16 Jan 2014 23:46:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:46:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:46:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:46:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:47:04 - XML: Processed 655596 elements - found 699 jobs
Thu 16 Jan 2014 23:47:04 - job 7347083 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 23:47:05 - job_xml_thread(): Found 1 updated jobs.
Thu 16 Jan 2014 23:47:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:47:05 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:47:05 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 23:47:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:47:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:47:05 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Thu 16 Jan 2014 23:47:05 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:47:05 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:47:05 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:47:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:47:05 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:47:05 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:47:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:47:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:47:07 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:47:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:47:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:47:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:47:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:47:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:47:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:47:11 - Leaving storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 23:47:11 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Thu 16 Jan 2014 23:47:11 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:47:11 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:47:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43826989
Thu 16 Jan 2014 23:47:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:47:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43826989
Thu 16 Jan 2014 23:47:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:47:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:47:20 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:47:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:47:20 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:47:20 - job_xml_thread(): Done retrieving: data size 43826989
Thu 16 Jan 2014 23:47:20 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:47:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:47:20 - XML: Start document: iteration 3
Thu 16 Jan 2014 23:47:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:47:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:47:22 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:47:22 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:47:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:47:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:47:22 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:47:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:47:29 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:47:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:47:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:47:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:47:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:47:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:47:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:47:32 - XML: Processed 654848 elements - found 699 jobs
Thu 16 Jan 2014 23:47:32 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:47:32 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:47:32 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:47:32 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:47:32 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:47:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 23:47:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:47:34 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:47:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43788295
Thu 16 Jan 2014 23:47:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:47:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43788295
Thu 16 Jan 2014 23:47:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:47:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:47:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:47:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:47:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:47:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:47:45 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:47:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:47:45 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:47:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:47:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:47:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:47:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 23:47:46 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:47:46 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:47:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5932 values 93931 bits 11741 bytes 
Thu 16 Jan 2014 23:47:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 23:47:47 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:47:47 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:47:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:47:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:47:47 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:47:47 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:47:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:47:48 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:47:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:47:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:47:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:47:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:47:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:47:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:47:51 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:47:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43233231
Thu 16 Jan 2014 23:47:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:47:51 - job_xml_thread(): Done retrieving: data size 43233231
Thu 16 Jan 2014 23:47:52 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:47:52 - XML: Start document: iteration 4
Thu 16 Jan 2014 23:47:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43233231
Thu 16 Jan 2014 23:47:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:48:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:48:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:48:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:48:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:48:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:48:07 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:48:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:48:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:48:09 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:48:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:48:09 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:48:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:48:09 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:48:14 - XML: Processed 647500 elements - found 699 jobs
Thu 16 Jan 2014 23:48:14 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:48:14 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:48:14 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:48:14 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:48:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:48:15 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:48:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:48:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:48:15 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:48:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 23:48:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:48:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:48:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:48:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:48:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:48:18 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:48:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43266881
Thu 16 Jan 2014 23:48:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:48:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43266881
Thu 16 Jan 2014 23:48:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:48:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:48:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:48:29 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:48:29 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:48:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:48:30 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:48:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:48:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:48:31 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:48:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:48:31 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:48:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:48:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:48:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:48:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:48:32 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:48:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:48:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:48:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:48:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:48:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:48:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:48:33 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:48:33 - job_xml_thread(): Done retrieving: data size 43724121
Thu 16 Jan 2014 23:48:33 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:48:33 - XML: Start document: iteration 5
Thu 16 Jan 2014 23:48:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43724121
Thu 16 Jan 2014 23:48:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:48:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43724121
Thu 16 Jan 2014 23:48:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:48:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:48:44 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:48:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:48:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:48:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:48:47 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:48:47 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:48:47 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:48:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:48:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:48:47 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:48:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:48:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 23:48:47 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:48:47 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:48:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 23:48:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:48:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:48:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8948 values 141419 bits 17677 bytes 
Thu 16 Jan 2014 23:48:52 - XML: Processed 653630 elements - found 703 jobs
Thu 16 Jan 2014 23:48:52 - job_xml_thread(): Found 4 updated jobs.
Thu 16 Jan 2014 23:48:53 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 23:48:53 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Thu 16 Jan 2014 23:48:53 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:48:53 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:48:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:48:55 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:48:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:48:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:48:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:48:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:48:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:48:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:48:58 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:48:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43840692
Thu 16 Jan 2014 23:48:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:48:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43840692
Thu 16 Jan 2014 23:48:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:49:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:49:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:49:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:49:08 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:49:08 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:49:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:49:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:49:08 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:49:09 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:49:09 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:49:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:49:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:49:10 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:49:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 23:49:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:49:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:49:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:49:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:49:12 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:49:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:49:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:49:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:49:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:49:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:49:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:49:14 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:49:14 - job_xml_thread(): Done retrieving: data size 43896081
Thu 16 Jan 2014 23:49:14 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:49:14 - XML: Start document: iteration 6
Thu 16 Jan 2014 23:49:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43896081
Thu 16 Jan 2014 23:49:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:49:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43896081
Thu 16 Jan 2014 23:49:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:49:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:49:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:49:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:49:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:49:30 - XML: Processed 655601 elements - found 703 jobs
Thu 16 Jan 2014 23:49:30 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:49:30 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:49:30 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:49:30 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:49:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:49:32 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:49:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:49:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:49:33 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:49:33 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:49:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:49:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:49:34 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:49:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:49:35 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:49:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:49:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:49:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:49:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:49:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:49:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:49:38 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:49:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43891898
Thu 16 Jan 2014 23:49:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:49:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43891898
Thu 16 Jan 2014 23:49:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:49:45 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:49:45 - job_xml_thread(): Done retrieving: data size 43891898
Thu 16 Jan 2014 23:49:45 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:49:45 - XML: Start document: iteration 7
Thu 16 Jan 2014 23:49:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:49:47 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:49:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:49:48 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:49:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:49:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:49:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:49:49 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:49:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 23:49:49 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:49:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 23:49:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9114 values 143950 bits 17993 bytes 
Thu 16 Jan 2014 23:49:51 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:49:51 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:49:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:49:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:49:51 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:49:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:49:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:50:01 - XML: Processed 655604 elements - found 703 jobs
Thu 16 Jan 2014 23:50:01 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:50:01 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:50:01 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:50:01 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:50:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:50:01 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:50:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:50:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:50:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:50:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:50:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:50:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:50:04 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:50:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855259
Thu 16 Jan 2014 23:50:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:50:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855259
Thu 16 Jan 2014 23:50:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:50:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:50:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:50:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:50:14 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:50:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:50:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:50:16 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:50:16 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:50:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:50:16 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:50:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:50:16 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:50:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:50:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:50:17 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:50:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 23:50:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:50:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:50:18 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:50:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:50:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:50:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:50:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:50:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:50:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:50:20 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:50:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43883567
Thu 16 Jan 2014 23:50:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:50:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43883567
Thu 16 Jan 2014 23:50:21 - job_xml_thread(): Done retrieving: data size 43883567
Thu 16 Jan 2014 23:50:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:50:21 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:50:21 - XML: Start document: iteration 8
Thu 16 Jan 2014 23:50:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:50:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:50:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:50:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:50:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:50:36 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:50:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:50:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:50:37 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:50:37 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:50:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:50:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:50:37 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:50:38 - XML: Processed 655591 elements - found 698 jobs
Thu 16 Jan 2014 23:50:38 - job 7346375 appears to have finished
Thu 16 Jan 2014 23:50:38 - job 7347087 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 23:50:38 - job 7347037 appears to have finished
Thu 16 Jan 2014 23:50:38 - job 7347064 appears to have finished
Thu 16 Jan 2014 23:50:38 - job 7347068 appears to have finished
Thu 16 Jan 2014 23:50:39 - job 7347055 appears to have finished
Thu 16 Jan 2014 23:50:39 - job_xml_thread(): Found 6 updated jobs.
Thu 16 Jan 2014 23:50:39 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 23:50:40 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Thu 16 Jan 2014 23:50:40 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:50:40 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:50:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:50:42 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:50:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:50:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:50:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:50:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:50:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:50:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:50:45 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:50:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43902968
Thu 16 Jan 2014 23:50:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:50:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43902968
Thu 16 Jan 2014 23:50:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:50:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:50:49 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:50:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:50:51 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:50:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 23:50:51 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:50:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 23:50:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9355 values 147639 bits 18454 bytes 
Thu 16 Jan 2014 23:50:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:50:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:50:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:50:55 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:50:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:50:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:50:55 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:50:55 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:50:56 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:50:56 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:50:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:50:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:50:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:50:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:51:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:51:00 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:51:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:51:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:51:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:51:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:51:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:51:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:51:02 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:51:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 23:51:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:51:02 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:51:02 - job_xml_thread(): Done retrieving: data size 43877769
Thu 16 Jan 2014 23:51:02 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:51:02 - XML: Start document: iteration 9
Thu 16 Jan 2014 23:51:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43877769
Thu 16 Jan 2014 23:51:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:51:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43877769
Thu 16 Jan 2014 23:51:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:51:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:51:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:51:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:51:14 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:51:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:51:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:51:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:51:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:51:16 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:51:16 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:51:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:51:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:51:16 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:51:21 - XML: Processed 655593 elements - found 698 jobs
Thu 16 Jan 2014 23:51:21 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:51:21 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:51:21 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:51:21 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:51:22 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Thu 16 Jan 2014 23:51:23 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:51:24 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:51:24 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 23:51:24 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:51:24 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 23:51:24 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 23:51:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:51:24 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:51:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:51:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:51:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:51:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:51:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:51:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:51:25 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 915270 values 14457321 bits 1807165 bytes 
Thu 16 Jan 2014 23:51:29 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:51:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875932
Thu 16 Jan 2014 23:51:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:51:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875932
Thu 16 Jan 2014 23:51:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:51:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:51:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:51:36 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:51:36 - job_xml_thread(): Done retrieving: data size 43875932
Thu 16 Jan 2014 23:51:36 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:51:36 - XML: Start document: iteration 10
Thu 16 Jan 2014 23:51:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:51:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:51:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:51:40 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:51:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:51:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:51:41 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:51:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:51:41 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:51:41 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:51:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:51:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:51:51 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:51:52 - XML: Processed 655594 elements - found 698 jobs
Thu 16 Jan 2014 23:51:52 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:51:52 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:51:52 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:51:52 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:51:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:51:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 23:51:52 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:51:52 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:51:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 23:51:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99132 bits 12391 bytes 
Thu 16 Jan 2014 23:51:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:51:53 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:51:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:51:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:51:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:51:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:51:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:51:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:51:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:51:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:51:57 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:51:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865570
Thu 16 Jan 2014 23:51:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:51:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43865570
Thu 16 Jan 2014 23:51:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:52:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:52:06 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:52:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:52:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:52:07 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:52:07 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:52:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:52:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:52:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865570
Thu 16 Jan 2014 23:52:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:52:07 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:52:07 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:52:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:52:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:52:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:52:17 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:52:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:52:20 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:52:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:52:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:52:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:52:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:52:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:52:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:52:21 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:52:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 23:52:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:52:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:52:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:52:23 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:52:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:52:23 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:52:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:52:24 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:52:24 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 23:52:26 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:52:26 - job_xml_thread(): Done retrieving: data size 43851549
Thu 16 Jan 2014 23:52:26 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:52:26 - XML: Start document: iteration 11
Thu 16 Jan 2014 23:52:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851549
Thu 16 Jan 2014 23:52:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:52:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851549
Thu 16 Jan 2014 23:52:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:52:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:52:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:52:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:52:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:52:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:52:45 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:52:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:52:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:52:45 - XML: Processed 655594 elements - found 698 jobs
Thu 16 Jan 2014 23:52:45 - job 7346701 appears to have finished
Thu 16 Jan 2014 23:52:45 - job_xml_thread(): Found 2 updated jobs.
Thu 16 Jan 2014 23:52:45 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 23:52:46 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Thu 16 Jan 2014 23:52:46 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:52:46 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:52:46 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:52:46 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:52:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:52:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:52:46 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:52:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:52:50 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:52:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:52:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:52:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:52:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:52:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:52:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:52:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:52:52 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:52:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:52:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 23:52:53 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:52:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 23:52:53 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:52:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5790 values 91348 bits 11418 bytes 
Thu 16 Jan 2014 23:52:53 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:52:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43874651
Thu 16 Jan 2014 23:52:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:52:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43874651
Thu 16 Jan 2014 23:52:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:53:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:53:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:53:01 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:53:01 - job_xml_thread(): Done retrieving: data size 43874651
Thu 16 Jan 2014 23:53:01 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:53:01 - XML: Start document: iteration 12
Thu 16 Jan 2014 23:53:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:53:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:53:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:53:08 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:53:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:53:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:53:09 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:53:09 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:53:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:53:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:53:09 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:53:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:53:15 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:53:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:53:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:53:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:53:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:53:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:53:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:53:17 - XML: Processed 655594 elements - found 698 jobs
Thu 16 Jan 2014 23:53:17 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:53:17 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:53:17 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:53:17 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:53:20 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:53:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 23:53:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:53:21 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:53:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43796821
Thu 16 Jan 2014 23:53:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:53:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43796821
Thu 16 Jan 2014 23:53:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:53:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:53:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:53:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:53:30 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:53:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:53:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:53:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:53:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:53:31 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:53:32 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:53:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:53:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:53:32 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:53:32 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:53:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:53:36 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:53:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:53:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:53:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:53:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:53:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:53:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:53:39 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:53:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43323234
Thu 16 Jan 2014 23:53:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:53:40 - job_xml_thread(): Done retrieving: data size 43323234
Thu 16 Jan 2014 23:53:40 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:53:40 - XML: Start document: iteration 13
Thu 16 Jan 2014 23:53:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43323234
Thu 16 Jan 2014 23:53:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:53:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:53:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:53:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:53:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:53:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:53:53 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:53:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:53:54 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:53:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 23:53:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 23:53:54 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:53:54 - XML: Processed 648826 elements - found 698 jobs
Thu 16 Jan 2014 23:53:54 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:53:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6429 values 101407 bits 12675 bytes 
Thu 16 Jan 2014 23:53:55 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:53:55 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:53:55 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:53:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:53:57 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:53:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:53:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:53:57 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:53:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:53:57 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:53:57 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:53:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:54:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:54:02 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:54:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:54:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:54:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:54:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:54:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:54:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:54:06 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:54:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 23:54:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:54:06 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:54:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43231338
Thu 16 Jan 2014 23:54:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:54:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43231338
Thu 16 Jan 2014 23:54:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:54:10 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:54:10 - job_xml_thread(): Done retrieving: data size 43231338
Thu 16 Jan 2014 23:54:10 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:54:10 - XML: Start document: iteration 14
Thu 16 Jan 2014 23:54:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:54:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:54:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:54:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:54:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:54:19 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:54:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:54:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:54:21 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:54:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:54:21 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:54:21 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:54:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:54:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:54:28 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:54:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:54:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:54:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:54:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:54:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:54:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:54:30 - XML: Processed 647660 elements - found 697 jobs
Thu 16 Jan 2014 23:54:30 - job 7345910 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 23:54:30 - job 7346700 appears to have finished
Thu 16 Jan 2014 23:54:30 - job 7346130 appears to have finished
Thu 16 Jan 2014 23:54:30 - job 7347061 appears to have finished
Thu 16 Jan 2014 23:54:30 - job_xml_thread(): Found 6 updated jobs.
Thu 16 Jan 2014 23:54:30 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 23:54:30 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Thu 16 Jan 2014 23:54:30 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:54:30 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:54:33 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:54:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43276945
Thu 16 Jan 2014 23:54:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:54:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43276945
Thu 16 Jan 2014 23:54:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:54:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:54:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:54:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:54:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:54:45 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:54:45 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:54:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:54:46 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:54:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:54:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:54:46 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:54:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:54:46 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:54:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:54:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:54:49 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:54:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:54:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:54:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:54:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:54:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:54:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:54:53 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:54:53 - job_xml_thread(): Done retrieving: data size 43830960
Thu 16 Jan 2014 23:54:53 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:54:53 - XML: Start document: iteration 15
Thu 16 Jan 2014 23:54:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43830960
Thu 16 Jan 2014 23:54:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:54:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43830960
Thu 16 Jan 2014 23:54:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:54:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:54:55 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:54:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:54:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 23:54:56 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:54:56 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:54:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7303 values 115288 bits 14411 bytes 
Thu 16 Jan 2014 23:54:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 23:55:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:55:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:55:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:55:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:55:15 - XML: Processed 655124 elements - found 697 jobs
Thu 16 Jan 2014 23:55:15 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:55:16 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:55:16 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:55:16 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:55:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:55:16 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:55:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:55:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:55:17 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:55:17 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:55:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:55:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:55:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:55:17 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:55:17 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:55:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:55:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:55:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:55:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:55:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:55:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:55:20 - Leaving storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 23:55:20 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Thu 16 Jan 2014 23:55:20 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:55:22 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:55:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43872446
Thu 16 Jan 2014 23:55:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:55:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43872446
Thu 16 Jan 2014 23:55:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:55:31 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:55:31 - job_xml_thread(): Done retrieving: data size 43872446
Thu 16 Jan 2014 23:55:31 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:55:31 - XML: Start document: iteration 16
Thu 16 Jan 2014 23:55:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:55:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:55:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:55:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:55:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:55:34 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:55:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:55:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:55:34 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:55:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:55:34 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:55:34 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:55:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:55:36 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:55:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 23:55:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:55:42 - XML: Processed 655592 elements - found 697 jobs
Thu 16 Jan 2014 23:55:42 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:55:42 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:55:42 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:55:42 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:55:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:55:44 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:55:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:55:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:55:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:55:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:55:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:55:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:55:46 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:55:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43869435
Thu 16 Jan 2014 23:55:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:55:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43869435
Thu 16 Jan 2014 23:55:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:55:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:55:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:55:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:55:55 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:55:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:55:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:55:55 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:55:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:55:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43869435
Thu 16 Jan 2014 23:55:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:55:55 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:55:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:55:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:55:56 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:55:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:55:57 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:55:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 23:55:57 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:55:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 23:55:57 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:55:57 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:55:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6125 values 96637 bits 12079 bytes 
Thu 16 Jan 2014 23:56:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:56:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:56:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:56:06 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:56:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:56:09 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:56:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:56:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:56:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:56:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:56:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:56:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:56:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:56:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:56:11 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:56:11 - job_xml_thread(): Done retrieving: data size 43851869
Thu 16 Jan 2014 23:56:11 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:56:11 - XML: Start document: iteration 17
Thu 16 Jan 2014 23:56:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851869
Thu 16 Jan 2014 23:56:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:56:12 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:56:12 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:56:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:56:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:56:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851869
Thu 16 Jan 2014 23:56:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:56:24 - XML: Processed 655588 elements - found 695 jobs
Thu 16 Jan 2014 23:56:24 - job 7347063 appears to have finished
Thu 16 Jan 2014 23:56:24 - job 7345909 appears to have finished
Thu 16 Jan 2014 23:56:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:56:24 - job 7347090 field 'status' changed since saved from: R to: Q
Thu 16 Jan 2014 23:56:24 - job_xml_thread(): Found 3 updated jobs.
Thu 16 Jan 2014 23:56:24 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 23:56:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:56:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:56:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:56:28 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Thu 16 Jan 2014 23:56:28 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:56:29 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:56:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:56:31 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:56:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:56:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:56:31 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:56:32 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:56:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:56:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:56:32 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:56:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:56:34 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:56:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:56:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:56:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:56:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:56:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:56:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:56:35 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:56:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 23:56:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:56:36 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:56:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43884205
Thu 16 Jan 2014 23:56:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:56:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43884205
Thu 16 Jan 2014 23:56:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:56:44 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:56:44 - job_xml_thread(): Done retrieving: data size 43884205
Thu 16 Jan 2014 23:56:44 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:56:44 - XML: Start document: iteration 18
Thu 16 Jan 2014 23:56:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:56:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:56:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:56:47 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:56:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:56:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:56:48 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:56:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:56:48 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:56:49 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:56:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:56:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:56:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:56:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:56:57 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:56:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:56:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 23:56:58 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:56:58 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:56:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5749 values 90669 bits 11333 bytes 
Thu 16 Jan 2014 23:56:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 23:56:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:56:58 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:56:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:56:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:56:59 - XML: Processed 655588 elements - found 695 jobs
Thu 16 Jan 2014 23:56:59 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:56:59 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:56:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:56:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:56:59 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:56:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:56:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:56:59 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:57:01 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:57:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43879731
Thu 16 Jan 2014 23:57:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:57:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43879731
Thu 16 Jan 2014 23:57:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:57:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:57:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:57:14 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:57:14 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:57:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:57:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:57:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:57:16 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:57:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:57:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:57:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:57:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:57:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:57:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:57:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:57:18 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:57:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:57:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:57:18 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:57:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 23:57:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:57:18 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:57:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:57:18 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:57:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:57:20 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:57:20 - job_xml_thread(): Done retrieving: data size 43890576
Thu 16 Jan 2014 23:57:20 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:57:20 - XML: Start document: iteration 19
Thu 16 Jan 2014 23:57:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43890576
Thu 16 Jan 2014 23:57:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:57:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43890576
Thu 16 Jan 2014 23:57:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:57:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:57:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:57:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:57:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:57:39 - XML: Processed 655588 elements - found 695 jobs
Thu 16 Jan 2014 23:57:39 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:57:39 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:57:39 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:57:39 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:57:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:57:40 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:57:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:57:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:57:41 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:57:41 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:57:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:57:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:57:41 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:57:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:57:42 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:57:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:57:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:57:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:57:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:57:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:57:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:57:45 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:57:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43909879
Thu 16 Jan 2014 23:57:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:57:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43909879
Thu 16 Jan 2014 23:57:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:57:54 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:57:54 - job_xml_thread(): Done retrieving: data size 43909879
Thu 16 Jan 2014 23:57:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:57:54 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:57:54 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:57:55 - XML: Start document: iteration 20
Thu 16 Jan 2014 23:57:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:57:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:57:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:57:58 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:57:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:57:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:57:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:57:59 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:57:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 23:57:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 23:57:59 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:57:59 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:57:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:57:59 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:57:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:57:59 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:57:59 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8944 values 141105 bits 17638 bytes 
Thu 16 Jan 2014 23:58:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:58:04 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:58:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:58:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:58:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:58:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:58:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:58:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:58:06 - XML: Processed 655588 elements - found 695 jobs
Thu 16 Jan 2014 23:58:06 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:58:06 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:58:06 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:58:06 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:58:10 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:58:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43863071
Thu 16 Jan 2014 23:58:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:58:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43863071
Thu 16 Jan 2014 23:58:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:58:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:58:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:58:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:58:17 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:58:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:58:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:58:19 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:58:19 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:58:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:58:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:58:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43863071
Thu 16 Jan 2014 23:58:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:58:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:58:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:58:21 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:58:21 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:58:25 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Thu 16 Jan 2014 23:58:25 - ganglia_store_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:58:25 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:58:25 - ganglia_store_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:58:25 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Thu 16 Jan 2014 23:58:25 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Thu 16 Jan 2014 23:58:25 - Entering storeMetrics(): cluster LISA Cluster
Thu 16 Jan 2014 23:58:27 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:58:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 23:58:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:58:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:58:28 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:58:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:58:31 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:58:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:58:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:58:32 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 802606 values 12659916 bits 1582489 bytes 
Thu 16 Jan 2014 23:58:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:58:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:58:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:58:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:58:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:58:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:58:34 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:58:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:58:34 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:58:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:58:35 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:58:35 - job_xml_thread(): Done retrieving: data size 43865803
Thu 16 Jan 2014 23:58:35 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:58:35 - Housekeeping: checking database for timed out jobs..
Thu 16 Jan 2014 23:58:35 - Housekeeping: Found 0 timed out jobs in database: closing entries
Thu 16 Jan 2014 23:58:35 - Housekeeping: done.
Thu 16 Jan 2014 23:58:35 - XML: Start document: iteration 0
Thu 16 Jan 2014 23:58:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865803
Thu 16 Jan 2014 23:58:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:58:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43865803
Thu 16 Jan 2014 23:58:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:58:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:58:44 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:58:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:58:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:58:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:58:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:58:50 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:58:50 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:58:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:58:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:58:50 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:58:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:58:54 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:58:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:58:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:58:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:58:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:58:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:58:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:58:55 - XML: Processed 655584 elements - found 693 jobs
Thu 16 Jan 2014 23:58:56 - job 7346716 appears to have finished
Thu 16 Jan 2014 23:58:56 - job 7347053 appears to have finished
Thu 16 Jan 2014 23:58:56 - job_xml_thread(): Found 2 updated jobs.
Thu 16 Jan 2014 23:58:56 - job_xml_thread(): Storing jobs to database..
Thu 16 Jan 2014 23:58:56 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Thu 16 Jan 2014 23:58:56 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:58:56 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:58:59 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:58:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43885583
Thu 16 Jan 2014 23:58:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:58:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43885583
Thu 16 Jan 2014 23:58:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:58:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:58:59 - ganglia_store_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:59:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:59:00 - ganglia_store_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:59:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Thu 16 Jan 2014 23:59:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Thu 16 Jan 2014 23:59:01 - Entering storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:59:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9123 values 143906 bits 17988 bytes 
Thu 16 Jan 2014 23:59:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:59:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:59:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:59:07 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:59:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:59:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:59:09 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:59:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:59:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43885583
Thu 16 Jan 2014 23:59:09 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:59:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:59:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:59:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:59:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:59:11 - job_xml_thread(): Retrieving XML data..
Thu 16 Jan 2014 23:59:11 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:59:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:59:16 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:59:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:59:20 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:59:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:59:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:59:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:59:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:59:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:59:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:59:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:59:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:59:24 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:59:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:59:24 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:59:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:59:24 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:59:24 - job_xml_thread(): Done retrieving: data size 43781695
Thu 16 Jan 2014 23:59:24 - job_xml_thread(): Parsing XML..
Thu 16 Jan 2014 23:59:24 - XML: Start document: iteration 1
Thu 16 Jan 2014 23:59:25 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:59:25 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Thu 16 Jan 2014 23:59:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43781695
Thu 16 Jan 2014 23:59:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:59:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43781695
Thu 16 Jan 2014 23:59:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:59:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Thu 16 Jan 2014 23:59:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:59:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Thu 16 Jan 2014 23:59:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Thu 16 Jan 2014 23:59:44 - XML: Processed 654836 elements - found 693 jobs
Thu 16 Jan 2014 23:59:44 - job_xml_thread(): Found 0 updated jobs.
Thu 16 Jan 2014 23:59:44 - job_xml_thread(): No jobs to store.
Thu 16 Jan 2014 23:59:45 - job_xml_thread(): Done parsing.
Thu 16 Jan 2014 23:59:45 - job_xml_thread(): Sleeping.. (15s)
Thu 16 Jan 2014 23:59:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:59:46 - ganglia_parse_thread(): finished: Render Cluster
Thu 16 Jan 2014 23:59:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Thu 16 Jan 2014 23:59:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:59:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Thu 16 Jan 2014 23:59:47 - ganglia_parse_thread(): finished: LISA Cluster
Thu 16 Jan 2014 23:59:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Thu 16 Jan 2014 23:59:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Thu 16 Jan 2014 23:59:47 - ganglia_parse_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:59:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Thu 16 Jan 2014 23:59:47 - ganglia_xml_thread(): started: cluster Render Cluster
Thu 16 Jan 2014 23:59:47 - XMLGatherer.retrieveData(): actually retrieving data..
Thu 16 Jan 2014 23:59:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Thu 16 Jan 2014 23:59:47 - Leaving storeMetrics(): cluster Render Cluster
Thu 16 Jan 2014 23:59:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Thu 16 Jan 2014 23:59:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Thu 16 Jan 2014 23:59:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:59:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Thu 16 Jan 2014 23:59:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Thu 16 Jan 2014 23:59:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Thu 16 Jan 2014 23:59:50 - XMLGatherer.retrieveData(): Done retrieving data.
Thu 16 Jan 2014 23:59:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43238470
Thu 16 Jan 2014 23:59:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Thu 16 Jan 2014 23:59:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43238470
Thu 16 Jan 2014 23:59:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Thu 16 Jan 2014 23:59:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Thu 16 Jan 2014 23:59:58 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:00:00 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:00:00 - job_xml_thread(): Done retrieving: data size 43238470
Fri 17 Jan 2014 00:00:00 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:00:00 - XML: Start document: iteration 2
Fri 17 Jan 2014 00:00:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:00:00 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:00:01 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:00:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:00:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 00:00:01 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:00:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 00:00:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6143 values 96910 bits 12113 bytes 
Fri 17 Jan 2014 00:00:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:00:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:00:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:00:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:00:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:00:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:00:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:00:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:00:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:00:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:00:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:00:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:00:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:00:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:00:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:00:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:00:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:00:13 - XML: Processed 647532 elements - found 693 jobs
Fri 17 Jan 2014 00:00:13 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 00:00:13 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 00:00:13 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:00:13 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:00:17 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:00:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43256442
Fri 17 Jan 2014 00:00:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:00:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43256442
Fri 17 Jan 2014 00:00:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:00:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:00:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:00:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:00:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:00:28 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:00:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:00:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:00:29 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:00:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:00:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:00:30 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:00:30 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:00:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:00:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:00:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:00:33 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:00:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:00:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:00:33 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:00:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 00:00:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:00:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:00:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:00:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:00:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:00:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:00:36 - job_xml_thread(): Done retrieving: data size 43569520
Fri 17 Jan 2014 00:00:36 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:00:36 - XML: Start document: iteration 3
Fri 17 Jan 2014 00:00:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569520
Fri 17 Jan 2014 00:00:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:00:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569520
Fri 17 Jan 2014 00:00:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:00:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:00:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:00:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:00:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:00:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:00:56 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:00:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:00:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:00:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:00:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:00:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:00:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:00:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:00:58 - XML: Processed 651880 elements - found 692 jobs
Fri 17 Jan 2014 00:00:58 - job 7346718 appears to have finished
Fri 17 Jan 2014 00:00:58 - job 7346719 appears to have finished
Fri 17 Jan 2014 00:00:58 - job 7325668 appears to have finished
Fri 17 Jan 2014 00:00:58 - job_xml_thread(): Found 5 updated jobs.
Fri 17 Jan 2014 00:00:58 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 00:01:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:01:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:01:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:01:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:01:00 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Fri 17 Jan 2014 00:01:00 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:01:00 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:01:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:01:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:01:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:01:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:01:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:01:02 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:01:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:01:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 00:01:02 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:01:02 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:01:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 00:01:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5904 values 93152 bits 11644 bytes 
Fri 17 Jan 2014 00:01:03 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:01:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870006
Fri 17 Jan 2014 00:01:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:01:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870006
Fri 17 Jan 2014 00:01:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:01:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:01:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:01:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:01:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:01:12 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:01:12 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:01:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:01:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:01:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870006
Fri 17 Jan 2014 00:01:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:01:15 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:01:15 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:01:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:01:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:01:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:01:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:01:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:01:25 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:01:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:01:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:01:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:01:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:01:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:01:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:01:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:01:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:01:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:01:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:01:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:01:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:01:28 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:01:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 00:01:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:01:29 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:01:29 - job_xml_thread(): Done retrieving: data size 43856156
Fri 17 Jan 2014 00:01:29 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:01:29 - XML: Start document: iteration 4
Fri 17 Jan 2014 00:01:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856156
Fri 17 Jan 2014 00:01:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43856156
Fri 17 Jan 2014 00:01:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:01:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:01:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:01:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:01:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:01:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:01:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:01:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:01:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:01:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:01:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:01:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:01:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:01:48 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:01:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:01:51 - XML: Processed 655582 elements - found 692 jobs
Fri 17 Jan 2014 00:01:51 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 00:01:52 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 00:01:52 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:01:52 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:01:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:01:53 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:01:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:01:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:01:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:01:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:01:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:01:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:01:55 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:01:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870035
Fri 17 Jan 2014 00:01:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:01:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870035
Fri 17 Jan 2014 00:01:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:02:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:02:02 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:02:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:02:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:02:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:02:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 00:02:04 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:02:04 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:02:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7024 values 111146 bits 13893 bytes 
Fri 17 Jan 2014 00:02:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 00:02:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:02:06 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:02:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:02:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:02:07 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:02:07 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:02:07 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:02:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:02:07 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:02:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:02:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:02:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:02:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:02:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:02:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:02:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:02:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:02:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:02:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:02:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:02:14 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:02:14 - job_xml_thread(): Done retrieving: data size 43889949
Fri 17 Jan 2014 00:02:14 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:02:14 - XML: Start document: iteration 5
Fri 17 Jan 2014 00:02:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43889949
Fri 17 Jan 2014 00:02:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:02:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43889949
Fri 17 Jan 2014 00:02:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:02:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:02:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:02:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:02:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:02:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:02:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:02:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:02:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:02:35 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:02:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:02:35 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:02:35 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:02:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:02:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:02:37 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:02:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:02:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:02:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:02:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:02:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:02:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:02:38 - XML: Processed 655578 elements - found 690 jobs
Fri 17 Jan 2014 00:02:38 - job 7347057 appears to have finished
Fri 17 Jan 2014 00:02:38 - job 7347056 appears to have finished
Fri 17 Jan 2014 00:02:38 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 00:02:38 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 00:02:38 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:02:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 00:02:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:02:39 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 00:02:39 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:02:39 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:02:39 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 00:02:39 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 00:02:39 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:02:41 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:02:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43881133
Fri 17 Jan 2014 00:02:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:02:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43881133
Fri 17 Jan 2014 00:02:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:02:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:02:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:02:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:02:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:02:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:02:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:02:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:02:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:02:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:02:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:02:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:02:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:02:52 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:02:54 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:02:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:02:55 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:02:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:02:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:02:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:02:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:02:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:02:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:02:57 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:02:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43892038
Fri 17 Jan 2014 00:02:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:02:57 - job_xml_thread(): Done retrieving: data size 43892038
Fri 17 Jan 2014 00:02:57 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:02:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43892038
Fri 17 Jan 2014 00:02:57 - XML: Start document: iteration 6
Fri 17 Jan 2014 00:02:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:03:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:03:04 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:03:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:03:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:03:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:03:08 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:03:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 00:03:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 00:03:08 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:03:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8981 values 142154 bits 17769 bytes 
Fri 17 Jan 2014 00:03:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:03:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:03:15 - XML: Processed 655580 elements - found 691 jobs
Fri 17 Jan 2014 00:03:16 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 00:03:16 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 00:03:17 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 00:03:17 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:03:17 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:03:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:03:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:03:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:03:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:03:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:03:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:03:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:03:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:03:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:03:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:03:20 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:03:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:03:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:03:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:03:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:03:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:03:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:03:22 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:03:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43880488
Fri 17 Jan 2014 00:03:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:03:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43880488
Fri 17 Jan 2014 00:03:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:03:32 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:03:32 - job_xml_thread(): Done retrieving: data size 43880488
Fri 17 Jan 2014 00:03:32 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:03:32 - XML: Start document: iteration 7
Fri 17 Jan 2014 00:03:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:03:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:03:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:03:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:03:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:03:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:03:35 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:03:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:03:35 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:03:35 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:03:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:03:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:03:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:03:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:03:45 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:03:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:03:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:03:46 - XML: Processed 655580 elements - found 691 jobs
Fri 17 Jan 2014 00:03:46 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 00:03:46 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 00:03:46 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:03:46 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:03:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:03:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:03:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:03:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:03:46 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:03:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 00:03:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:03:48 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:03:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43871629
Fri 17 Jan 2014 00:03:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:03:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43871629
Fri 17 Jan 2014 00:03:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:03:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:03:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:03:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:03:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:03:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:03:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:03:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:03:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:03:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:03:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43871629
Fri 17 Jan 2014 00:03:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:03:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:04:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:04:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:04:01 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:04:01 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:04:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:04:08 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:04:10 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:04:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:04:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 00:04:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 00:04:10 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:04:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5598 values 88359 bits 11044 bytes 
Fri 17 Jan 2014 00:04:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:04:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:04:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:04:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:04:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:04:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:04:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:04:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:04:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:04:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:04:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:04:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:04:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:04:13 - job_xml_thread(): Done retrieving: data size 43866723
Fri 17 Jan 2014 00:04:13 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:04:13 - XML: Start document: iteration 8
Fri 17 Jan 2014 00:04:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43866723
Fri 17 Jan 2014 00:04:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:04:14 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:04:14 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:04:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:04:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:04:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43866723
Fri 17 Jan 2014 00:04:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:04:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:04:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:04:29 - XML: Processed 655582 elements - found 692 jobs
Fri 17 Jan 2014 00:04:29 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 00:04:29 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 00:04:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:04:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:04:30 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 00:04:30 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:04:30 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:04:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:04:31 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:04:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:04:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:04:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:04:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:04:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:04:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:04:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:04:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:04:35 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:04:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:04:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:04:36 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:04:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 00:04:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:04:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:04:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:04:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:04:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:04:37 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:04:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43880182
Fri 17 Jan 2014 00:04:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:04:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43880182
Fri 17 Jan 2014 00:04:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:04:45 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:04:45 - job_xml_thread(): Done retrieving: data size 43880182
Fri 17 Jan 2014 00:04:45 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:04:45 - XML: Start document: iteration 9
Fri 17 Jan 2014 00:04:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:04:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:04:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:04:49 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:04:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:04:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:04:50 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:04:50 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:04:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:04:50 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:04:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:04:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:04:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:04:58 - XML: Processed 655582 elements - found 692 jobs
Fri 17 Jan 2014 00:04:58 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 00:04:58 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 00:04:58 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:04:58 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:05:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:05:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:05:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:05:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:05:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:05:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:05:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:05:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:05:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:05:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875208
Fri 17 Jan 2014 00:05:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:05:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875208
Fri 17 Jan 2014 00:05:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:05:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:05:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:05:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:05:10 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:05:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:05:11 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:05:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 00:05:11 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:05:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 00:05:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:05:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:05:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:05:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9089 values 143438 bits 17929 bytes 
Fri 17 Jan 2014 00:05:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:05:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:05:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:05:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:05:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:05:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:05:13 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:05:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:05:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:05:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:05:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:05:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:05:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:05:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:05:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:05:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:05:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:05:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:05:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43830756
Fri 17 Jan 2014 00:05:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:05:18 - job_xml_thread(): Done retrieving: data size 43830756
Fri 17 Jan 2014 00:05:18 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:05:18 - XML: Start document: iteration 10
Fri 17 Jan 2014 00:05:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43830756
Fri 17 Jan 2014 00:05:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:05:25 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 00:05:25 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:05:27 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:05:27 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:05:27 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 00:05:28 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 00:05:28 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 00:05:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:05:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:05:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:05:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:05:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:05:38 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:05:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:05:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:05:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:05:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:05:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:05:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:05:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Fri 17 Jan 2014 00:05:42 - XML: Processed 654854 elements - found 702 jobs
Fri 17 Jan 2014 00:05:42 - job_xml_thread(): Found 10 updated jobs.
Fri 17 Jan 2014 00:05:42 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 00:05:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:05:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:05:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:05:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:05:43 - job_xml_thread(): Done storing. succesfully stored: 10 jobs
Fri 17 Jan 2014 00:05:43 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:05:43 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:05:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:05:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:05:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:05:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:05:43 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:05:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 00:05:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:05:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:05:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43299601
Fri 17 Jan 2014 00:05:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:05:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43299601
Fri 17 Jan 2014 00:05:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:05:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:05:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:05:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:05:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:05:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:05:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:05:58 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:05:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:05:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:05:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:05:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:05:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:05:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:05:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:05:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:05:59 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:05:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:05:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:06:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:06:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:06:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:06:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:06:01 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:06:01 - job_xml_thread(): Done retrieving: data size 43249693
Fri 17 Jan 2014 00:06:01 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:06:01 - XML: Start document: iteration 11
Fri 17 Jan 2014 00:06:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43249693
Fri 17 Jan 2014 00:06:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:06:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43249693
Fri 17 Jan 2014 00:06:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:06:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:06:12 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:06:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:06:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:06:14 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:06:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:06:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 00:06:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 00:06:14 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:06:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8692 values 137113 bits 17139 bytes 
Fri 17 Jan 2014 00:06:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:06:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:06:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:06:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:06:19 - XML: Processed 647400 elements - found 701 jobs
Fri 17 Jan 2014 00:06:19 - job 7347069 appears to have finished
Fri 17 Jan 2014 00:06:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:06:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:06:19 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 00:06:19 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 00:06:20 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 00:06:20 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:06:20 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:06:20 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:06:20 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:06:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:06:20 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:06:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:06:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:06:24 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:06:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:06:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:06:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:06:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:06:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:06:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:06:26 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:06:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43282735
Fri 17 Jan 2014 00:06:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:06:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43282735
Fri 17 Jan 2014 00:06:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:06:27 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:06:27 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:06:29 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:06:29 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:06:29 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 00:06:29 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 00:06:29 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 00:06:35 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:06:36 - job_xml_thread(): Done retrieving: data size 43282735
Fri 17 Jan 2014 00:06:36 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:06:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:06:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:06:36 - XML: Start document: iteration 12
Fri 17 Jan 2014 00:06:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:06:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Fri 17 Jan 2014 00:06:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:06:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:06:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:06:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:06:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:06:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:06:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:06:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:06:44 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:06:47 - XML: Processed 648148 elements - found 701 jobs
Fri 17 Jan 2014 00:06:47 - job 7347102 field 'start_timestamp' changed since saved from: 1389913477 to: 1389913424
Fri 17 Jan 2014 00:06:47 - job 7347098 field 'start_timestamp' changed since saved from: 1389913469 to: 1389913424
Fri 17 Jan 2014 00:06:47 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 00:06:47 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 00:06:49 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 00:06:49 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:06:49 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:06:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:06:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:06:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:06:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:06:50 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:06:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 00:06:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:06:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:06:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:06:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:06:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:06:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:06:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43828874
Fri 17 Jan 2014 00:06:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:06:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43828874
Fri 17 Jan 2014 00:06:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:07:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:07:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:07:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:07:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:07:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:07:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:07:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:07:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:07:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:07:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:07:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:07:04 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:07:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:07:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:07:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:07:06 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:07:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:07:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:07:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:07:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:07:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:07:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:07:07 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:07:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43874819
Fri 17 Jan 2014 00:07:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:07:08 - job_xml_thread(): Done retrieving: data size 43874819
Fri 17 Jan 2014 00:07:08 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:07:08 - XML: Start document: iteration 13
Fri 17 Jan 2014 00:07:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43874819
Fri 17 Jan 2014 00:07:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:07:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:07:14 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:07:15 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:07:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 00:07:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:07:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 00:07:16 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:07:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8812 values 139015 bits 17376 bytes 
Fri 17 Jan 2014 00:07:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:07:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:07:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:07:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:07:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:07:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:07:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:07:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:07:23 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:07:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:07:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:07:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:07:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:07:27 - XML: Processed 655575 elements - found 702 jobs
Fri 17 Jan 2014 00:07:27 - job 7347066 appears to have finished
Fri 17 Jan 2014 00:07:27 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 00:07:27 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 00:07:29 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 00:07:29 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:07:29 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:07:29 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:07:29 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:07:29 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:07:29 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 00:07:29 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 00:07:29 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:07:30 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 00:07:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:07:33 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:07:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:07:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:07:33 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 1002873 values 15841850 bits 1980231 bytes 
Fri 17 Jan 2014 00:07:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:07:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:07:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:07:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:07:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:07:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867007
Fri 17 Jan 2014 00:07:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:07:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43867007
Fri 17 Jan 2014 00:07:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:07:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:07:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:07:44 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:07:44 - job_xml_thread(): Done retrieving: data size 43867007
Fri 17 Jan 2014 00:07:44 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:07:44 - XML: Start document: iteration 14
Fri 17 Jan 2014 00:07:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:07:49 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:07:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:07:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:07:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:07:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:07:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:07:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:07:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:07:49 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:07:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:07:59 - XML: Processed 655602 elements - found 702 jobs
Fri 17 Jan 2014 00:07:59 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 00:07:59 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 00:07:59 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:07:59 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:08:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:08:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:08:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:08:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:08:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:08:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:08:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:08:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:08:00 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:08:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 00:08:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:08:03 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:08:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43866427
Fri 17 Jan 2014 00:08:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:08:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43866427
Fri 17 Jan 2014 00:08:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:08:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:08:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:08:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:08:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:08:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:08:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:08:14 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:08:14 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:08:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:08:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:08:14 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:08:14 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:08:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:08:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:08:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:08:16 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:08:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:08:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:08:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:08:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:08:17 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:08:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 00:08:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:08:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 00:08:17 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:08:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5578 values 87937 bits 10992 bytes 
Fri 17 Jan 2014 00:08:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:08:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:08:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:08:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:08:22 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:08:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43899658
Fri 17 Jan 2014 00:08:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:08:23 - job_xml_thread(): Done retrieving: data size 43899658
Fri 17 Jan 2014 00:08:23 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:08:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43899658
Fri 17 Jan 2014 00:08:23 - XML: Start document: iteration 15
Fri 17 Jan 2014 00:08:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:08:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:08:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:08:30 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:08:30 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 00:08:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:08:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:08:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:08:34 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:08:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:08:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:08:35 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:08:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:08:35 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:08:35 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:08:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:08:40 - XML: Processed 655604 elements - found 703 jobs
Fri 17 Jan 2014 00:08:40 - job 7345911 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 00:08:40 - job 7347106 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 00:08:40 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 00:08:40 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 00:08:42 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 00:08:42 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:08:42 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:08:45 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:08:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 00:08:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:08:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:08:46 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:08:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:08:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:08:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:08:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:08:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:08:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:08:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:08:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43871526
Fri 17 Jan 2014 00:08:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:08:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43871526
Fri 17 Jan 2014 00:08:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:08:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:08:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:08:57 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:08:58 - job_xml_thread(): Done retrieving: data size 43871526
Fri 17 Jan 2014 00:08:58 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:08:58 - XML: Start document: iteration 16
Fri 17 Jan 2014 00:09:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:09:00 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:09:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:09:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:09:01 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:09:01 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:09:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:09:01 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:09:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:09:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:09:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:09:09 - XML: Processed 655604 elements - found 703 jobs
Fri 17 Jan 2014 00:09:10 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 00:09:10 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 00:09:10 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:09:10 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:09:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:09:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:09:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:09:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:09:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:09:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:09:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:09:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:09:14 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:09:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43861333
Fri 17 Jan 2014 00:09:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:09:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43861333
Fri 17 Jan 2014 00:09:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:09:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:09:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:09:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:09:17 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:09:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:09:17 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:09:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 00:09:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 00:09:17 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:09:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8720 values 137518 bits 17189 bytes 
Fri 17 Jan 2014 00:09:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:09:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:09:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:09:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:09:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:09:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:09:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:09:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:09:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:09:25 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:09:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:09:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:09:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:09:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:09:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:09:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:09:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:09:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:09:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:09:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:09:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:09:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43888346
Fri 17 Jan 2014 00:09:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:09:33 - job_xml_thread(): Done retrieving: data size 43888346
Fri 17 Jan 2014 00:09:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43888346
Fri 17 Jan 2014 00:09:33 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:09:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:09:33 - XML: Start document: iteration 17
Fri 17 Jan 2014 00:09:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:09:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:09:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:09:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:09:44 - XML: Processed 655606 elements - found 704 jobs
Fri 17 Jan 2014 00:09:44 - job 7347107 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 00:09:44 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 00:09:44 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 00:09:45 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 00:09:45 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:09:45 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:09:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:09:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:09:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:09:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:09:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:09:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:09:52 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:09:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:09:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:09:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:09:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:09:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:09:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:09:56 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:09:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 00:09:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:09:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:09:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:09:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:09:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:09:57 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 00:09:57 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 00:09:57 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:09:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:09:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43888576
Fri 17 Jan 2014 00:09:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:10:00 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:10:00 - job_xml_thread(): Done retrieving: data size 43888576
Fri 17 Jan 2014 00:10:00 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:10:00 - XML: Start document: iteration 18
Fri 17 Jan 2014 00:10:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43888576
Fri 17 Jan 2014 00:10:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:10:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:10:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:10:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:10:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:10:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:10:16 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:10:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:10:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:10:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:10:18 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:10:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:10:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:10:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:10:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:10:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:10:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:10:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 00:10:18 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:10:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5704 values 89933 bits 11241 bytes 
Fri 17 Jan 2014 00:10:18 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:10:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 00:10:21 - XML: Processed 655606 elements - found 704 jobs
Fri 17 Jan 2014 00:10:21 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 00:10:21 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 00:10:21 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:10:21 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:10:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:10:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:10:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:10:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:10:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:10:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:10:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:10:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:10:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:10:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43871342
Fri 17 Jan 2014 00:10:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:10:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43871342
Fri 17 Jan 2014 00:10:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:10:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:10:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:10:36 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:10:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:10:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:10:38 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:10:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:10:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:10:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:10:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:10:39 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:10:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:10:39 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:10:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:10:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:10:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:10:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:10:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:10:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:10:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:10:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:10:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:10:41 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:10:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 00:10:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:10:44 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:10:44 - job_xml_thread(): Done retrieving: data size 43879092
Fri 17 Jan 2014 00:10:44 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:10:44 - XML: Start document: iteration 19
Fri 17 Jan 2014 00:10:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43879092
Fri 17 Jan 2014 00:10:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:10:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43879092
Fri 17 Jan 2014 00:10:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:10:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:10:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:10:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:10:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:10:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:10:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:10:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:10:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:11:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:11:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:11:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:11:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:11:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:11:05 - XML: Processed 655602 elements - found 702 jobs
Fri 17 Jan 2014 00:11:05 - job 7345912 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 00:11:05 - job 7347107 field 'start_timestamp' changed since saved from: 1389913712 to: 1389913673
Fri 17 Jan 2014 00:11:05 - job 7347103 appears to have finished
Fri 17 Jan 2014 00:11:05 - job 7346312 appears to have finished
Fri 17 Jan 2014 00:11:05 - job 7347097 appears to have finished
Fri 17 Jan 2014 00:11:05 - job 7347096 appears to have finished
Fri 17 Jan 2014 00:11:05 - job 7347095 appears to have finished
Fri 17 Jan 2014 00:11:05 - job 7347074 appears to have finished
Fri 17 Jan 2014 00:11:05 - job 7347101 appears to have finished
Fri 17 Jan 2014 00:11:05 - job 7347100 appears to have finished
Fri 17 Jan 2014 00:11:05 - job 7347102 appears to have finished
Fri 17 Jan 2014 00:11:05 - job 7347104 appears to have finished
Fri 17 Jan 2014 00:11:05 - job 7347099 appears to have finished
Fri 17 Jan 2014 00:11:05 - job 7347098 appears to have finished
Fri 17 Jan 2014 00:11:05 - job_xml_thread(): Found 24 updated jobs.
Fri 17 Jan 2014 00:11:05 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 00:11:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:11:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:11:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:11:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:11:07 - job_xml_thread(): Done storing. succesfully stored: 24 jobs
Fri 17 Jan 2014 00:11:07 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:11:07 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:11:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:11:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:11:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:11:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:11:08 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:11:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43882756
Fri 17 Jan 2014 00:11:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:11:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43882756
Fri 17 Jan 2014 00:11:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:11:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:11:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:11:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:11:18 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:11:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:11:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:11:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:11:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:11:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:11:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:11:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:11:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:11:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:11:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:11:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 00:11:19 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:11:19 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:11:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 00:11:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9012 values 142189 bits 17773 bytes 
Fri 17 Jan 2014 00:11:22 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:11:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:11:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:11:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:11:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:11:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:11:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:11:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:11:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:11:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:11:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43813148
Fri 17 Jan 2014 00:11:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:11:25 - job_xml_thread(): Done retrieving: data size 43813148
Fri 17 Jan 2014 00:11:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43813148
Fri 17 Jan 2014 00:11:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:11:25 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:11:25 - XML: Start document: iteration 20
Fri 17 Jan 2014 00:11:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:11:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:11:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:11:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:11:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:11:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:11:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:11:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:11:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:11:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:11:40 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:11:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:11:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:11:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:11:45 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:11:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:11:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:11:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:11:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:11:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:11:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:11:47 - XML: Processed 654852 elements - found 701 jobs
Fri 17 Jan 2014 00:11:47 - job 7347075 appears to have finished
Fri 17 Jan 2014 00:11:47 - job 7347118 field 'start_timestamp' changed since saved from: 1389913779 to: 1389913734
Fri 17 Jan 2014 00:11:47 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 00:11:47 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 00:11:47 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 00:11:47 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:11:47 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:11:47 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:11:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 00:11:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:11:48 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:11:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43260556
Fri 17 Jan 2014 00:11:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:11:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43260556
Fri 17 Jan 2014 00:11:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:11:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:11:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:11:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:11:58 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:11:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:11:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:12:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:12:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:12:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:12:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:12:01 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:12:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:12:01 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:12:02 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:12:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:12:03 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:12:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:12:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:12:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:12:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:12:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:12:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:12:06 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:12:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43236509
Fri 17 Jan 2014 00:12:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:12:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43236509
Fri 17 Jan 2014 00:12:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:12:07 - job_xml_thread(): Done retrieving: data size 43236509
Fri 17 Jan 2014 00:12:07 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:12:07 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 00:12:09 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 00:12:09 - Housekeeping: done.
Fri 17 Jan 2014 00:12:10 - XML: Start document: iteration 0
Fri 17 Jan 2014 00:12:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:12:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:12:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:12:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:12:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:12:19 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:12:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:12:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 00:12:20 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:12:20 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:12:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 00:12:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8819 values 139125 bits 17390 bytes 
Fri 17 Jan 2014 00:12:26 - XML: Processed 647391 elements - found 700 jobs
Fri 17 Jan 2014 00:12:27 - job 7347065 appears to have finished
Fri 17 Jan 2014 00:12:28 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 00:12:28 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 00:12:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:12:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:12:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:12:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:12:28 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 00:12:28 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:12:28 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:12:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:12:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:12:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:12:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:12:29 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:12:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:12:29 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:12:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:12:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:12:30 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:12:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:12:30 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:12:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:12:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:12:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43310648
Fri 17 Jan 2014 00:12:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:12:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43310648
Fri 17 Jan 2014 00:12:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:12:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:12:42 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:12:43 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:12:43 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:12:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:12:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:12:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:12:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:12:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:12:46 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:12:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:12:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:12:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:12:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:12:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:12:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:12:46 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:12:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 00:12:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:12:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:12:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:12:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:12:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:12:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:12:49 - job_xml_thread(): Done retrieving: data size 43802393
Fri 17 Jan 2014 00:12:49 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:12:49 - XML: Start document: iteration 1
Fri 17 Jan 2014 00:12:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43802393
Fri 17 Jan 2014 00:12:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:12:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43802393
Fri 17 Jan 2014 00:12:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:13:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:13:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:13:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:13:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:13:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:13:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:13:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:13:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:13:12 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:13:12 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:13:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:13:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:13:12 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:13:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:13:16 - XML: Processed 654505 elements - found 701 jobs
Fri 17 Jan 2014 00:13:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:13:16 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 00:13:16 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 00:13:16 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 00:13:16 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:13:16 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:13:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:13:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:13:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:13:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:13:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:13:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:13:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:13:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43889507
Fri 17 Jan 2014 00:13:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:13:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43889507
Fri 17 Jan 2014 00:13:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:13:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:13:20 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:13:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:13:21 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:13:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 00:13:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 00:13:21 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:13:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8941 values 141079 bits 17634 bytes 
Fri 17 Jan 2014 00:13:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:13:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:13:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:13:28 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:13:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:13:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:13:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:13:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:13:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:13:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:13:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:13:31 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:13:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:13:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:13:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:13:33 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:13:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:13:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:13:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:13:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:13:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:13:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:13:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:13:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43879443
Fri 17 Jan 2014 00:13:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:13:36 - job_xml_thread(): Done retrieving: data size 43879443
Fri 17 Jan 2014 00:13:36 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:13:36 - XML: Start document: iteration 2
Fri 17 Jan 2014 00:13:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43879443
Fri 17 Jan 2014 00:13:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:13:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:13:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:13:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:13:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:13:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:13:49 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:13:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:13:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:13:50 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:13:50 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:13:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:13:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:13:50 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:13:54 - XML: Processed 655596 elements - found 699 jobs
Fri 17 Jan 2014 00:13:54 - job 7345910 appears to have finished
Fri 17 Jan 2014 00:13:54 - job 7346382 appears to have finished
Fri 17 Jan 2014 00:13:54 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 00:13:54 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 00:13:54 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 00:13:54 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:13:54 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:13:56 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:13:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 00:13:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:13:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:13:59 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:13:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:13:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:13:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:13:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:13:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:13:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:14:00 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:14:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43864042
Fri 17 Jan 2014 00:14:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:14:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43864042
Fri 17 Jan 2014 00:14:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:14:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:14:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:14:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:14:09 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:14:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:14:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:14:10 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:14:10 - job_xml_thread(): Done retrieving: data size 43864042
Fri 17 Jan 2014 00:14:10 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:14:10 - XML: Start document: iteration 3
Fri 17 Jan 2014 00:14:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:14:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:14:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:14:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43864042
Fri 17 Jan 2014 00:14:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:14:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:14:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:14:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:14:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:14:21 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:14:22 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:14:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:14:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 00:14:22 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:14:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5727 values 90309 bits 11288 bytes 
Fri 17 Jan 2014 00:14:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 00:14:23 - XML: Processed 655596 elements - found 699 jobs
Fri 17 Jan 2014 00:14:23 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 00:14:23 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 00:14:23 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:14:23 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:14:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:14:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:14:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:14:29 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:14:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:14:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:14:29 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:14:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:14:29 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:14:29 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:14:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:14:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:14:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:14:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:14:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:14:30 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 00:14:30 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:14:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:14:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:14:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:14:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:14:30 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:14:30 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:14:30 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 00:14:30 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 00:14:30 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 00:14:31 - size of cluster 'LISA Cluster': 624 hosts 79483 metrics 958900 values 15127648 bits 1890956 bytes 
Fri 17 Jan 2014 00:14:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:14:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43895850
Fri 17 Jan 2014 00:14:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:14:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43895850
Fri 17 Jan 2014 00:14:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:14:38 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:14:38 - job_xml_thread(): Done retrieving: data size 43895850
Fri 17 Jan 2014 00:14:38 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:14:38 - XML: Start document: iteration 4
Fri 17 Jan 2014 00:14:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:14:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:14:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:14:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:14:50 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:14:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 00:14:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:14:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:14:56 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:14:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:14:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:14:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:14:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:14:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:14:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:14:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:14:58 - XML: Processed 655596 elements - found 699 jobs
Fri 17 Jan 2014 00:14:58 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 00:14:58 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 00:14:58 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:14:58 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:14:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:14:59 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:14:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:14:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:14:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:14:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:14:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:14:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:15:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:15:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43901689
Fri 17 Jan 2014 00:15:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:15:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43901689
Fri 17 Jan 2014 00:15:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:15:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:15:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:15:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:15:13 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:15:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:15:13 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:15:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:15:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:15:14 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:15:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:15:14 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:15:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:15:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:15:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:15:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:15:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:15:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:15:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:15:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:15:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:15:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:15:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:15:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:15:20 - job_xml_thread(): Done retrieving: data size 43887235
Fri 17 Jan 2014 00:15:20 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:15:20 - XML: Start document: iteration 5
Fri 17 Jan 2014 00:15:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43887235
Fri 17 Jan 2014 00:15:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43887235
Fri 17 Jan 2014 00:15:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:15:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:15:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:15:22 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:15:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:15:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 00:15:23 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:15:23 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:15:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 00:15:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9270 values 146273 bits 18284 bytes 
Fri 17 Jan 2014 00:15:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:15:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:15:30 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:15:30 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 00:15:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:15:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:15:36 - XML: Processed 655596 elements - found 699 jobs
Fri 17 Jan 2014 00:15:36 - job 7347052 appears to have finished
Fri 17 Jan 2014 00:15:36 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 00:15:36 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 00:15:37 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 00:15:37 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:15:37 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:15:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:15:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:15:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:15:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:15:39 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:15:39 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:15:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:15:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:15:39 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:15:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:15:44 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:15:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:15:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:15:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:15:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:15:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:15:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:15:48 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:15:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43880514
Fri 17 Jan 2014 00:15:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:15:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43880514
Fri 17 Jan 2014 00:15:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:15:52 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:15:52 - job_xml_thread(): Done retrieving: data size 43880514
Fri 17 Jan 2014 00:15:52 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:15:52 - XML: Start document: iteration 6
Fri 17 Jan 2014 00:15:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:15:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:16:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:16:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:16:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:16:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:16:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:16:08 - XML: Processed 655596 elements - found 699 jobs
Fri 17 Jan 2014 00:16:08 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 00:16:08 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 00:16:08 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:16:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:16:08 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:16:08 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:16:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:16:08 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:16:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:16:08 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:16:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:16:12 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:16:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:16:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:16:12 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:16:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 00:16:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:16:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:16:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:16:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:16:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:16:16 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:16:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43894015
Fri 17 Jan 2014 00:16:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:16:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43894015
Fri 17 Jan 2014 00:16:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:16:23 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:16:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:16:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:16:23 - job_xml_thread(): Done retrieving: data size 43894015
Fri 17 Jan 2014 00:16:23 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:16:23 - XML: Start document: iteration 7
Fri 17 Jan 2014 00:16:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:16:24 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:16:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:16:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 00:16:26 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:16:26 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:16:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 00:16:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5888 values 92987 bits 11623 bytes 
Fri 17 Jan 2014 00:16:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:16:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:16:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:16:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:16:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:16:27 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:16:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:16:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:16:27 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:16:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:16:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:16:33 - XML: Processed 655593 elements - found 699 jobs
Fri 17 Jan 2014 00:16:33 - job 7347120 field 'start_timestamp' changed since saved from: 1389914098 to: 1389914024
Fri 17 Jan 2014 00:16:33 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 00:16:33 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 00:16:34 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 00:16:34 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:16:34 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:16:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:16:35 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:16:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:16:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:16:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:16:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:16:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:16:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:16:38 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:16:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 00:16:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:16:39 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:16:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43871134
Fri 17 Jan 2014 00:16:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:16:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43871134
Fri 17 Jan 2014 00:16:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:16:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:16:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:16:49 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:16:49 - job_xml_thread(): Done retrieving: data size 43871134
Fri 17 Jan 2014 00:16:49 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:16:49 - XML: Start document: iteration 8
Fri 17 Jan 2014 00:16:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:16:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:16:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:16:53 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:16:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:16:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:16:53 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:16:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:16:53 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:16:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:16:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:17:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:17:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:17:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:17:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:17:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:17:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:17:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:17:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:17:03 - XML: Processed 655596 elements - found 699 jobs
Fri 17 Jan 2014 00:17:03 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 00:17:03 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 00:17:03 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:17:03 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:17:07 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:17:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43869904
Fri 17 Jan 2014 00:17:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:17:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43869904
Fri 17 Jan 2014 00:17:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:17:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:17:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:17:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:17:16 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:17:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:17:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:17:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:17:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:17:16 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:17:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:17:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43869904
Fri 17 Jan 2014 00:17:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:17:16 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:17:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:17:18 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:17:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:17:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:17:26 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:17:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:17:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:17:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:17:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 00:17:27 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:17:27 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:17:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 00:17:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99378 bits 12422 bytes 
Fri 17 Jan 2014 00:17:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:17:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:17:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:17:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:17:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:17:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:17:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:17:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:17:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:17:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:17:32 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:17:32 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:17:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:17:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:17:34 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:17:34 - job_xml_thread(): Done retrieving: data size 43794002
Fri 17 Jan 2014 00:17:34 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:17:34 - XML: Start document: iteration 9
Fri 17 Jan 2014 00:17:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43794002
Fri 17 Jan 2014 00:17:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:17:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43794002
Fri 17 Jan 2014 00:17:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:17:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:17:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:17:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:17:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:17:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:17:49 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:17:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:17:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:17:50 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:17:50 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:17:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:17:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:17:50 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:17:53 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:17:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 00:17:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:17:57 - XML: Processed 654824 elements - found 687 jobs
Fri 17 Jan 2014 00:17:57 - job 7346704 appears to have finished
Fri 17 Jan 2014 00:17:57 - job 7347116 appears to have finished
Fri 17 Jan 2014 00:17:57 - job 7347117 appears to have finished
Fri 17 Jan 2014 00:17:57 - job 7347115 appears to have finished
Fri 17 Jan 2014 00:17:57 - job 7346728 appears to have finished
Fri 17 Jan 2014 00:17:57 - job 7347109 appears to have finished
Fri 17 Jan 2014 00:17:57 - job 7347113 appears to have finished
Fri 17 Jan 2014 00:17:58 - job 7347114 appears to have finished
Fri 17 Jan 2014 00:17:58 - job 7347112 appears to have finished
Fri 17 Jan 2014 00:17:58 - job 7347110 appears to have finished
Fri 17 Jan 2014 00:17:58 - job 7347111 appears to have finished
Fri 17 Jan 2014 00:17:58 - job 7347118 appears to have finished
Fri 17 Jan 2014 00:17:58 - job_xml_thread(): Found 12 updated jobs.
Fri 17 Jan 2014 00:17:58 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 00:17:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:17:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:17:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:17:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:17:58 - job_xml_thread(): Done storing. succesfully stored: 12 jobs
Fri 17 Jan 2014 00:17:58 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:17:58 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:17:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:17:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:17:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:17:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:18:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:18:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43218751
Fri 17 Jan 2014 00:18:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:18:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43218751
Fri 17 Jan 2014 00:18:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:18:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:18:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:18:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:18:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:18:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:18:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:18:12 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:18:12 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:18:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:18:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:18:12 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:18:14 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:18:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:18:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:18:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:18:15 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:18:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:18:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:18:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:18:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:18:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:18:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:18:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:18:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43289046
Fri 17 Jan 2014 00:18:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:18:20 - job_xml_thread(): Done retrieving: data size 43289046
Fri 17 Jan 2014 00:18:20 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:18:20 - XML: Start document: iteration 10
Fri 17 Jan 2014 00:18:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43289046
Fri 17 Jan 2014 00:18:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:18:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:18:27 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:18:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:18:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:18:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:18:28 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:18:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 00:18:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 00:18:28 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:18:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8855 values 140005 bits 17500 bytes 
Fri 17 Jan 2014 00:18:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:18:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:18:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:18:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:18:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:18:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:18:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:18:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:18:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:18:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:18:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:18:39 - XML: Processed 648116 elements - found 686 jobs
Fri 17 Jan 2014 00:18:39 - job 7347082 appears to have finished
Fri 17 Jan 2014 00:18:39 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 00:18:39 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 00:18:40 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 00:18:40 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:18:40 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:18:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:18:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:18:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:18:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:18:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:18:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:18:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:18:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:18:46 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 00:18:46 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 00:18:46 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:18:47 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:18:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43798700
Fri 17 Jan 2014 00:18:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:18:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43798700
Fri 17 Jan 2014 00:18:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:18:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:18:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:18:55 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:18:55 - job_xml_thread(): Done retrieving: data size 43798700
Fri 17 Jan 2014 00:18:55 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:18:55 - XML: Start document: iteration 11
Fri 17 Jan 2014 00:18:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:18:58 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:18:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:18:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:18:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:18:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:18:59 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:18:59 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:18:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:18:59 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:18:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:19:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:19:08 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:19:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:19:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:19:09 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:19:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 00:19:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:19:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:19:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:19:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:19:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:19:10 - XML: Processed 654862 elements - found 686 jobs
Fri 17 Jan 2014 00:19:10 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 00:19:10 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 00:19:10 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:19:10 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:19:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:19:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43841172
Fri 17 Jan 2014 00:19:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:19:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43841172
Fri 17 Jan 2014 00:19:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:19:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:19:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:19:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:19:21 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:19:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:19:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:19:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:19:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:19:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:19:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:19:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43841172
Fri 17 Jan 2014 00:19:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:19:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:19:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:19:25 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:19:25 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:19:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:19:28 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:19:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:19:29 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:19:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 00:19:29 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:19:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 00:19:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5900 values 93107 bits 11638 bytes 
Fri 17 Jan 2014 00:19:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:19:33 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:19:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:19:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:19:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:19:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:19:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:19:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:19:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:19:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:19:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:19:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:19:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:19:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:19:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:19:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:19:40 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:19:40 - job_xml_thread(): Done retrieving: data size 43847228
Fri 17 Jan 2014 00:19:40 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:19:40 - XML: Start document: iteration 12
Fri 17 Jan 2014 00:19:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43847228
Fri 17 Jan 2014 00:19:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:19:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43847228
Fri 17 Jan 2014 00:19:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:19:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:19:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:19:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:19:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:19:58 - XML: Processed 655570 elements - found 686 jobs
Fri 17 Jan 2014 00:19:58 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 00:19:58 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 00:19:58 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:19:58 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:20:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:20:00 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:20:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:20:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:20:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:20:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:20:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:20:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:20:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:20:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:20:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:20:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:20:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:20:05 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:20:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 00:20:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:20:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:20:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:20:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:20:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:20:06 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:20:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43889848
Fri 17 Jan 2014 00:20:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:20:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43889848
Fri 17 Jan 2014 00:20:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:20:13 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:20:13 - job_xml_thread(): Done retrieving: data size 43889848
Fri 17 Jan 2014 00:20:13 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:20:13 - XML: Start document: iteration 13
Fri 17 Jan 2014 00:20:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:20:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:20:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:20:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:20:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:20:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:20:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:20:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:20:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:20:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:20:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:20:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:20:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:20:29 - XML: Processed 655570 elements - found 686 jobs
Fri 17 Jan 2014 00:20:29 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 00:20:29 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 00:20:29 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:20:29 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:20:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:20:29 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:20:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:20:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:20:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:20:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:20:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:20:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 00:20:29 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:20:29 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:20:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 00:20:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5907 values 93228 bits 11653 bytes 
Fri 17 Jan 2014 00:20:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:20:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:20:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:20:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:20:31 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:20:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865996
Fri 17 Jan 2014 00:20:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:20:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43865996
Fri 17 Jan 2014 00:20:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:20:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:20:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:20:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:20:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:20:44 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:20:44 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:20:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:20:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:20:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:20:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:20:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:20:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:20:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:20:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:20:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:20:46 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:20:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:20:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:20:47 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:20:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 00:20:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:20:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:20:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:20:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:20:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:20:48 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:20:48 - job_xml_thread(): Done retrieving: data size 43889537
Fri 17 Jan 2014 00:20:48 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:20:48 - XML: Start document: iteration 14
Fri 17 Jan 2014 00:20:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43889537
Fri 17 Jan 2014 00:20:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:20:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43889537
Fri 17 Jan 2014 00:20:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:20:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:20:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:21:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:21:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:21:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:21:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:21:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:21:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:21:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:21:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:21:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:21:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:21:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:21:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:21:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:21:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:21:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:21:11 - XML: Processed 655570 elements - found 686 jobs
Fri 17 Jan 2014 00:21:11 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 00:21:11 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 00:21:11 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:21:11 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:21:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:21:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:21:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:21:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:21:14 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:21:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43859744
Fri 17 Jan 2014 00:21:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:21:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43859744
Fri 17 Jan 2014 00:21:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:21:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:21:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:21:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:21:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:21:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:21:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:21:25 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:21:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:21:25 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:21:25 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:21:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:21:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:21:27 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:21:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:21:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:21:27 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:21:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:21:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:21:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:21:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:21:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:21:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:21:29 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:21:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43891526
Fri 17 Jan 2014 00:21:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:21:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43891526
Fri 17 Jan 2014 00:21:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:21:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:21:29 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:21:30 - job_xml_thread(): Done retrieving: data size 43891526
Fri 17 Jan 2014 00:21:30 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:21:30 - XML: Start document: iteration 15
Fri 17 Jan 2014 00:21:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:21:31 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:21:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 00:21:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 00:21:31 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 00:21:31 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:21:31 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:21:33 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:21:33 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 00:21:33 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 00:21:33 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:21:33 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 00:21:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 11743 values 185194 bits 23149 bytes 
Fri 17 Jan 2014 00:21:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:21:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Fri 17 Jan 2014 00:21:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:21:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:21:48 - XML: Processed 655570 elements - found 686 jobs
Fri 17 Jan 2014 00:21:48 - job 7336870 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 00:21:48 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 00:21:48 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 00:21:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:21:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:21:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:21:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:21:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:21:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:21:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:21:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:21:52 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:21:52 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 00:21:52 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:21:52 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:21:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:21:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:21:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:21:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:21:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:21:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:21:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:21:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:21:56 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:21:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43881209
Fri 17 Jan 2014 00:21:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:21:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43881209
Fri 17 Jan 2014 00:21:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:22:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:22:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:22:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:22:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:22:07 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:22:07 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:22:08 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:22:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:22:08 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:22:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:22:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:22:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:22:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:22:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:22:10 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:22:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 00:22:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:22:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:22:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:22:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:22:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:22:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:22:12 - job_xml_thread(): Done retrieving: data size 43884994
Fri 17 Jan 2014 00:22:12 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:22:12 - XML: Start document: iteration 16
Fri 17 Jan 2014 00:22:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43884994
Fri 17 Jan 2014 00:22:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43884994
Fri 17 Jan 2014 00:22:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:22:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:22:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:22:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:22:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:22:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:22:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:22:31 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:22:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:22:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:22:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:22:31 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:22:32 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:22:32 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:22:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:22:32 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:22:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:22:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:22:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 00:22:32 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:22:32 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:22:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 00:22:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5419 values 85459 bits 10682 bytes 
Fri 17 Jan 2014 00:22:34 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:22:34 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:22:34 - XML: Processed 655570 elements - found 686 jobs
Fri 17 Jan 2014 00:22:34 - job 7336870 field 'start_timestamp' changed since saved from: 1389914447 to: 1389914406
Fri 17 Jan 2014 00:22:34 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 00:22:34 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 00:22:34 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 00:22:34 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:22:34 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:22:35 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:22:35 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:22:35 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 00:22:35 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 00:22:35 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 00:22:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:22:36 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:22:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:22:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:22:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:22:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:22:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:22:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:22:36 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 878593 values 13872122 bits 1734015 bytes 
Fri 17 Jan 2014 00:22:39 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:22:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43893230
Fri 17 Jan 2014 00:22:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:22:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43893230
Fri 17 Jan 2014 00:22:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:22:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:22:46 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:22:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:22:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:22:47 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:22:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:22:47 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:22:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:22:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43893230
Fri 17 Jan 2014 00:22:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:22:49 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:22:49 - job_xml_thread(): Done retrieving: data size 43893230
Fri 17 Jan 2014 00:22:49 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:22:49 - XML: Start document: iteration 17
Fri 17 Jan 2014 00:22:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:22:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:23:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:23:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:23:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:23:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:23:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:23:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:23:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:23:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:23:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:23:05 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:23:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 00:23:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:23:08 - XML: Processed 655570 elements - found 686 jobs
Fri 17 Jan 2014 00:23:08 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 00:23:08 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 00:23:08 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:23:08 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:23:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:23:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:23:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:23:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:23:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:23:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:23:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:23:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:23:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:23:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43805871
Fri 17 Jan 2014 00:23:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:23:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43805871
Fri 17 Jan 2014 00:23:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:23:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:23:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:23:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:23:21 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:23:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:23:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:23:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:23:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:23:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:23:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43805871
Fri 17 Jan 2014 00:23:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:23:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:23:24 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:23:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:23:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:23:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:23:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:23:29 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:23:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:23:32 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:23:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:23:33 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:23:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:23:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:23:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:23:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:23:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:23:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:23:33 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:23:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:23:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 00:23:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 00:23:33 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:23:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5829 values 91959 bits 11494 bytes 
Fri 17 Jan 2014 00:23:35 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:23:35 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 00:23:37 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:23:37 - job_xml_thread(): Done retrieving: data size 43516842
Fri 17 Jan 2014 00:23:37 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:23:37 - XML: Start document: iteration 18
Fri 17 Jan 2014 00:23:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:23:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:23:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43516842
Fri 17 Jan 2014 00:23:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:23:37 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:23:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:23:37 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:23:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:23:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43516842
Fri 17 Jan 2014 00:23:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:23:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:23:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:23:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:23:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:23:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:23:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:23:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:23:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:23:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:23:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:23:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:23:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:23:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:23:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:23:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:24:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:24:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:24:00 - XML: Processed 651246 elements - found 686 jobs
Fri 17 Jan 2014 00:24:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:24:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:24:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:24:00 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 00:24:00 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 00:24:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:24:01 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:24:01 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:24:02 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:24:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 00:24:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:24:04 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:24:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43215358
Fri 17 Jan 2014 00:24:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:24:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43215358
Fri 17 Jan 2014 00:24:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:24:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:24:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:24:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:24:16 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:24:16 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:24:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:24:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:24:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:24:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:24:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:24:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:24:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:24:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:24:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:24:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:24:19 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:24:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:24:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:24:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:24:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:24:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:24:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:24:23 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:24:23 - job_xml_thread(): Done retrieving: data size 43293197
Fri 17 Jan 2014 00:24:23 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:24:23 - XML: Start document: iteration 19
Fri 17 Jan 2014 00:24:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43293197
Fri 17 Jan 2014 00:24:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43293197
Fri 17 Jan 2014 00:24:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:24:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:24:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:24:33 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:24:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:24:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:24:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:24:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 00:24:34 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:24:34 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:24:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 00:24:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8527 values 134462 bits 16807 bytes 
Fri 17 Jan 2014 00:24:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:24:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:24:37 - XML: Processed 648116 elements - found 685 jobs
Fri 17 Jan 2014 00:24:37 - job 7346844 appears to have finished
Fri 17 Jan 2014 00:24:37 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 00:24:37 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 00:24:38 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 00:24:38 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:24:38 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:24:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:24:41 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:24:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:24:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:24:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:24:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:24:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:24:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:24:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:24:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:24:45 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:24:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:24:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:24:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:24:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:24:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:24:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:24:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:24:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43798487
Fri 17 Jan 2014 00:24:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:24:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43798487
Fri 17 Jan 2014 00:24:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:24:53 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:24:53 - job_xml_thread(): Done retrieving: data size 43798487
Fri 17 Jan 2014 00:24:53 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:24:53 - XML: Start document: iteration 20
Fri 17 Jan 2014 00:24:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:24:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:25:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:25:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:25:09 - XML: Processed 654700 elements - found 685 jobs
Fri 17 Jan 2014 00:25:10 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 00:25:10 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 00:25:10 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:25:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:25:10 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:25:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:25:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:25:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:25:12 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:25:12 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:25:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:25:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:25:12 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:25:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:25:13 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:25:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:25:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:25:13 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:25:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 00:25:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:25:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:25:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:25:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:25:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:25:17 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:25:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870370
Fri 17 Jan 2014 00:25:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:25:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870370
Fri 17 Jan 2014 00:25:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:25:26 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:25:26 - job_xml_thread(): Done retrieving: data size 43870370
Fri 17 Jan 2014 00:25:26 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:25:26 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 00:25:26 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 00:25:26 - Housekeeping: done.
Fri 17 Jan 2014 00:25:26 - XML: Start document: iteration 0
Fri 17 Jan 2014 00:25:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:25:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:25:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:25:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:25:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:25:32 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:25:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:25:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:25:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:25:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:25:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:25:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:25:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:25:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:25:35 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:25:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:25:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:25:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:25:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:25:35 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:25:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:25:35 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:25:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:25:35 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:25:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 00:25:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:25:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 00:25:35 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:25:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5946 values 93890 bits 11736 bytes 
Fri 17 Jan 2014 00:25:40 - XML: Processed 655568 elements - found 685 jobs
Fri 17 Jan 2014 00:25:40 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 00:25:40 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 00:25:40 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:25:40 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:25:42 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 00:25:42 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 00:25:42 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:25:43 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:25:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 00:25:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:25:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:25:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43865376
Fri 17 Jan 2014 00:25:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:25:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865376
Fri 17 Jan 2014 00:25:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:25:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:25:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:25:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:25:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:25:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:25:55 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:25:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:25:55 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:25:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:25:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:25:56 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:25:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:25:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:25:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:25:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:25:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:25:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:25:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:25:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:25:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:25:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:25:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:26:01 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:26:01 - job_xml_thread(): Done retrieving: data size 43873699
Fri 17 Jan 2014 00:26:01 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:26:01 - XML: Start document: iteration 1
Fri 17 Jan 2014 00:26:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873699
Fri 17 Jan 2014 00:26:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:26:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873699
Fri 17 Jan 2014 00:26:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:26:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:26:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:26:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:26:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:26:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:26:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:26:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:26:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:26:17 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:26:17 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:26:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:26:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:26:17 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:26:21 - XML: Processed 655568 elements - found 685 jobs
Fri 17 Jan 2014 00:26:21 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 00:26:21 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 00:26:21 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:26:21 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:26:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:26:23 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:26:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:26:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:26:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:26:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:26:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:26:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:26:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:26:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43888465
Fri 17 Jan 2014 00:26:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:26:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43888465
Fri 17 Jan 2014 00:26:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:26:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:26:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:26:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:26:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:26:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:26:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:26:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:26:36 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:26:36 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:26:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:26:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:26:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:26:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:26:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:26:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:26:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 00:26:37 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:26:37 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:26:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 00:26:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148628 bits 18578 bytes 
Fri 17 Jan 2014 00:26:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:26:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:26:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:26:40 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:26:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:26:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:26:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:26:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:26:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:26:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:26:42 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:26:42 - job_xml_thread(): Done retrieving: data size 43897812
Fri 17 Jan 2014 00:26:42 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:26:42 - XML: Start document: iteration 2
Fri 17 Jan 2014 00:26:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43897812
Fri 17 Jan 2014 00:26:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:26:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43897812
Fri 17 Jan 2014 00:26:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:26:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:26:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:26:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:26:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:26:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:26:58 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:26:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:26:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:26:59 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:26:59 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:26:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:26:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:26:59 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:27:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:27:06 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:27:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:27:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:27:07 - XML: Processed 655572 elements - found 687 jobs
Fri 17 Jan 2014 00:27:07 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 00:27:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:27:07 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 00:27:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:27:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:27:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:27:07 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 00:27:07 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:27:07 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:27:07 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:27:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 00:27:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:27:08 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:27:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870152
Fri 17 Jan 2014 00:27:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:27:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870152
Fri 17 Jan 2014 00:27:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:27:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:27:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:27:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:27:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:27:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:27:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:27:20 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:27:20 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:27:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:27:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:27:20 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:27:22 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:27:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:27:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:27:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:27:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:27:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:27:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:27:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:27:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:27:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:27:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:27:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:27:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43893881
Fri 17 Jan 2014 00:27:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:27:26 - job_xml_thread(): Done retrieving: data size 43893881
Fri 17 Jan 2014 00:27:26 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:27:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43893881
Fri 17 Jan 2014 00:27:26 - XML: Start document: iteration 3
Fri 17 Jan 2014 00:27:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:27:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:27:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:27:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:27:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:27:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:27:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:27:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:27:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:27:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:27:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:27:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:27:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:27:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:27:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:27:37 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:27:39 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:27:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:27:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 00:27:39 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:27:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 00:27:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8949 values 141211 bits 17651 bytes 
Fri 17 Jan 2014 00:27:44 - XML: Processed 655572 elements - found 687 jobs
Fri 17 Jan 2014 00:27:44 - job 7345913 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 00:27:44 - job 7345914 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 00:27:44 - job 7347122 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 00:27:44 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 00:27:44 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 00:27:45 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 00:27:45 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:27:45 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:27:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:27:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:27:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:27:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:27:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:27:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:27:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:27:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:27:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:27:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43852591
Fri 17 Jan 2014 00:27:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:27:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43852591
Fri 17 Jan 2014 00:27:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:27:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:27:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:28:00 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:28:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:28:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:28:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:28:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:28:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:28:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:28:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:28:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:28:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:28:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:28:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:28:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:28:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:28:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:28:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:28:04 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:28:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 00:28:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:28:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:28:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:28:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:28:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:28:06 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:28:06 - job_xml_thread(): Done retrieving: data size 43878753
Fri 17 Jan 2014 00:28:06 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:28:06 - XML: Start document: iteration 4
Fri 17 Jan 2014 00:28:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43878753
Fri 17 Jan 2014 00:28:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43878753
Fri 17 Jan 2014 00:28:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:28:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:28:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:28:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:28:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:28:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:28:25 - XML: Processed 655572 elements - found 687 jobs
Fri 17 Jan 2014 00:28:25 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 00:28:25 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 00:28:25 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:28:25 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:28:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:28:28 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:28:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:28:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:28:29 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:28:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:28:29 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:28:29 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:28:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:28:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:28:30 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:28:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:28:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:28:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:28:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:28:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:28:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:28:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:28:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43881793
Fri 17 Jan 2014 00:28:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:28:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43881793
Fri 17 Jan 2014 00:28:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:28:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:28:39 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:28:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:28:40 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:28:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 00:28:40 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:28:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 00:28:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8907 values 140448 bits 17556 bytes 
Fri 17 Jan 2014 00:28:40 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:28:40 - job_xml_thread(): Done retrieving: data size 43881793
Fri 17 Jan 2014 00:28:41 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:28:41 - XML: Start document: iteration 5
Fri 17 Jan 2014 00:28:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:28:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:28:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:28:45 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:28:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:28:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:28:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:28:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:28:47 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:28:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:28:47 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:28:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:28:47 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:28:51 - XML: Processed 655569 elements - found 686 jobs
Fri 17 Jan 2014 00:28:51 - job 7345054 appears to have finished
Fri 17 Jan 2014 00:28:51 - job 7336871 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 00:28:51 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 00:28:51 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 00:28:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:28:53 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:28:53 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 00:28:53 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:28:53 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:28:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:28:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:28:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:28:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:28:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:28:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:28:56 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:28:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43884401
Fri 17 Jan 2014 00:28:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:28:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43884401
Fri 17 Jan 2014 00:28:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:29:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:29:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:29:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:29:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:29:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:29:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:29:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:29:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:29:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:29:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:29:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43884401
Fri 17 Jan 2014 00:29:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:29:08 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:29:08 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:29:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:29:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:29:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:29:14 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:29:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:29:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:29:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:29:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:29:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:29:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:29:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:29:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:29:17 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:29:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 00:29:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:29:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:29:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:29:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:29:20 - job_xml_thread(): Done retrieving: data size 43785751
Fri 17 Jan 2014 00:29:20 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:29:20 - XML: Start document: iteration 6
Fri 17 Jan 2014 00:29:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43785751
Fri 17 Jan 2014 00:29:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:29:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:29:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:29:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:29:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:29:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43785751
Fri 17 Jan 2014 00:29:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:29:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:29:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:29:35 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 00:29:35 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:29:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:29:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:29:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:29:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:29:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:29:37 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:29:37 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:29:37 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 00:29:37 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 00:29:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:29:37 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 00:29:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:29:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:29:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:29:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:29:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:29:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:29:40 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:29:40 - XML: Processed 654816 elements - found 683 jobs
Fri 17 Jan 2014 00:29:40 - job 7345912 appears to have finished
Fri 17 Jan 2014 00:29:40 - job 7347085 appears to have finished
Fri 17 Jan 2014 00:29:40 - job 7347093 appears to have finished
Fri 17 Jan 2014 00:29:40 - job 7336871 field 'start_timestamp' changed since saved from: 1389914899 to: 1389914832
Fri 17 Jan 2014 00:29:40 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 00:29:40 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 00:29:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:29:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 00:29:41 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:29:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6012 values 94854 bits 11856 bytes 
Fri 17 Jan 2014 00:29:41 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:29:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 00:29:42 - size of cluster 'LISA Cluster': 624 hosts 79481 metrics 901520 values 14219896 bits 1777487 bytes 
Fri 17 Jan 2014 00:29:43 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 00:29:43 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:29:43 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:29:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:29:45 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:29:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:29:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:29:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:29:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:29:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:29:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:29:48 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:29:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43260711
Fri 17 Jan 2014 00:29:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:29:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43260711
Fri 17 Jan 2014 00:29:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:29:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:29:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:29:58 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:29:58 - job_xml_thread(): Done retrieving: data size 43260711
Fri 17 Jan 2014 00:29:58 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:29:58 - XML: Start document: iteration 7
Fri 17 Jan 2014 00:30:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:30:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:30:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:30:07 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:30:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:30:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:30:07 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:30:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:30:07 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:30:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:30:07 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:30:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:30:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:30:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:30:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:30:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:30:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:30:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:30:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:30:12 - XML: Processed 648220 elements - found 683 jobs
Fri 17 Jan 2014 00:30:12 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 00:30:12 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 00:30:12 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:30:12 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:30:13 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:30:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 00:30:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:30:15 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:30:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43237946
Fri 17 Jan 2014 00:30:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:30:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43237946
Fri 17 Jan 2014 00:30:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:30:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:30:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:30:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:30:25 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:30:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:30:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:30:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:30:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:30:26 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:30:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:30:26 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:30:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:30:26 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:30:27 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:30:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:30:30 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:30:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:30:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:30:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:30:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:30:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:30:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:30:34 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:30:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43642796
Fri 17 Jan 2014 00:30:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:30:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43642796
Fri 17 Jan 2014 00:30:34 - job_xml_thread(): Done retrieving: data size 43642796
Fri 17 Jan 2014 00:30:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:30:34 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:30:34 - XML: Start document: iteration 8
Fri 17 Jan 2014 00:30:38 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:30:38 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 00:30:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:30:41 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:30:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:30:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:30:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:30:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 00:30:42 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:30:42 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:30:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 00:30:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8756 values 138100 bits 17262 bytes 
Fri 17 Jan 2014 00:30:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:30:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:30:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:30:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:30:45 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:30:45 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:30:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:30:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:30:45 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:30:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:30:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:30:52 - XML: Processed 652846 elements - found 681 jobs
Fri 17 Jan 2014 00:30:52 - job 7345911 appears to have finished
Fri 17 Jan 2014 00:30:52 - job 7329921 appears to have finished
Fri 17 Jan 2014 00:30:52 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 00:30:52 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 00:30:53 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 00:30:53 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:30:53 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:30:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:30:55 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:30:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:30:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:30:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:30:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:30:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:30:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:30:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:30:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43844373
Fri 17 Jan 2014 00:30:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:30:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43844373
Fri 17 Jan 2014 00:30:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:31:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:31:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:31:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:31:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:31:08 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:31:08 - job_xml_thread(): Done retrieving: data size 43844373
Fri 17 Jan 2014 00:31:08 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:31:08 - XML: Start document: iteration 9
Fri 17 Jan 2014 00:31:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:31:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:31:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:31:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:31:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:31:09 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:31:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:31:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:31:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:31:19 - XML: Processed 655316 elements - found 681 jobs
Fri 17 Jan 2014 00:31:19 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 00:31:19 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 00:31:19 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:31:19 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:31:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:31:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:31:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:31:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:31:23 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:31:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 00:31:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:31:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:31:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:31:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:31:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:31:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:31:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:31:26 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:31:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43845425
Fri 17 Jan 2014 00:31:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:31:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43845425
Fri 17 Jan 2014 00:31:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:31:34 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:31:34 - job_xml_thread(): Done retrieving: data size 43845425
Fri 17 Jan 2014 00:31:34 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:31:34 - XML: Start document: iteration 10
Fri 17 Jan 2014 00:31:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:31:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:31:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:31:43 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:31:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:31:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:31:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:31:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:31:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:31:44 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:31:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 00:31:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 00:31:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:31:45 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:31:45 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:31:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5662 values 89443 bits 11180 bytes 
Fri 17 Jan 2014 00:31:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:31:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:31:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:31:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:31:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:31:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:31:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:31:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:31:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:31:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:31:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:31:48 - XML: Processed 655562 elements - found 682 jobs
Fri 17 Jan 2014 00:31:48 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 00:31:48 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 00:31:48 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 00:31:48 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:31:48 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:31:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:31:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43876905
Fri 17 Jan 2014 00:31:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:31:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43876905
Fri 17 Jan 2014 00:31:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:32:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:32:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:32:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:32:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:32:03 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:32:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 00:32:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:32:03 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:32:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:32:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:32:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:32:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:32:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:32:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:32:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:32:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:32:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:32:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:32:08 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:32:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:32:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:32:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:32:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:32:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:32:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:32:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:32:11 - job_xml_thread(): Done retrieving: data size 43879627
Fri 17 Jan 2014 00:32:11 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:32:11 - XML: Start document: iteration 11
Fri 17 Jan 2014 00:32:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43879627
Fri 17 Jan 2014 00:32:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:32:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43879627
Fri 17 Jan 2014 00:32:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:32:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:32:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:32:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:32:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:32:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:32:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:32:23 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:32:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:32:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:32:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:32:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:32:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:32:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:32:30 - XML: Processed 655562 elements - found 682 jobs
Fri 17 Jan 2014 00:32:31 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 00:32:31 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 00:32:31 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:32:31 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:32:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:32:32 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:32:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:32:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:32:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:32:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:32:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:32:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:32:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:32:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43849801
Fri 17 Jan 2014 00:32:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:32:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43849801
Fri 17 Jan 2014 00:32:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:32:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:32:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:32:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:32:45 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:32:46 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:32:46 - job_xml_thread(): Done retrieving: data size 43849801
Fri 17 Jan 2014 00:32:46 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:32:46 - XML: Start document: iteration 12
Fri 17 Jan 2014 00:32:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:32:46 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:32:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 00:32:46 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:32:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 00:32:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9287 values 147071 bits 18383 bytes 
Fri 17 Jan 2014 00:32:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:32:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:32:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:32:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:32:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:32:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:32:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:32:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:32:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:32:48 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:32:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:33:00 - XML: Processed 655562 elements - found 682 jobs
Fri 17 Jan 2014 00:33:00 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 00:33:00 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 00:33:00 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:33:00 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:33:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:33:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:33:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:33:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:33:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:33:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:33:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:33:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:33:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:33:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:33:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:33:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43844167
Fri 17 Jan 2014 00:33:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:33:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43844167
Fri 17 Jan 2014 00:33:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:33:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:33:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:33:16 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:33:16 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:33:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:33:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:33:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:33:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:33:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:33:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:33:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:33:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:33:20 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:33:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 00:33:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:33:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:33:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:33:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:33:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:33:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:33:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:33:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:33:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:33:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:33:25 - job_xml_thread(): Done retrieving: data size 43872792
Fri 17 Jan 2014 00:33:25 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:33:25 - XML: Start document: iteration 13
Fri 17 Jan 2014 00:33:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43872792
Fri 17 Jan 2014 00:33:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:33:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43872792
Fri 17 Jan 2014 00:33:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:33:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:33:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:33:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:33:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:33:44 - XML: Processed 655562 elements - found 682 jobs
Fri 17 Jan 2014 00:33:44 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 00:33:44 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 00:33:44 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:33:44 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:33:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:33:46 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:33:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:33:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:33:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:33:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:33:47 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:33:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:33:47 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:33:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:33:47 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:33:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:33:47 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:33:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 00:33:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 00:33:47 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:33:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5822 values 91971 bits 11496 bytes 
Fri 17 Jan 2014 00:33:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:33:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:33:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:33:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:33:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:33:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:33:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:33:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:33:54 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:33:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43876898
Fri 17 Jan 2014 00:33:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:33:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43876898
Fri 17 Jan 2014 00:33:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:34:00 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:34:00 - job_xml_thread(): Done retrieving: data size 43876898
Fri 17 Jan 2014 00:34:00 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:34:00 - XML: Start document: iteration 14
Fri 17 Jan 2014 00:34:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:34:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:34:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:34:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:34:10 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 00:34:10 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 00:34:10 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:34:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:34:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:34:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:34:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:34:14 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:34:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:34:14 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:34:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:34:14 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:34:16 - XML: Processed 655562 elements - found 682 jobs
Fri 17 Jan 2014 00:34:16 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 00:34:16 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 00:34:16 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:34:16 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:34:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:34:19 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:34:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:34:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:34:19 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:34:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 00:34:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:34:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:34:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:34:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:34:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:34:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:34:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867560
Fri 17 Jan 2014 00:34:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:34:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43867560
Fri 17 Jan 2014 00:34:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:34:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:34:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:34:31 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:34:31 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:34:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:34:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:34:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:34:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:34:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:34:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:34:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:34:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:34:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:34:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:34:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:34:36 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:34:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:34:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:34:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:34:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:34:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:34:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:34:38 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:34:38 - job_xml_thread(): Done retrieving: data size 43875370
Fri 17 Jan 2014 00:34:38 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:34:38 - XML: Start document: iteration 15
Fri 17 Jan 2014 00:34:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875370
Fri 17 Jan 2014 00:34:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:34:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875370
Fri 17 Jan 2014 00:34:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:34:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:34:47 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:34:47 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:34:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:34:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 00:34:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 00:34:48 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:34:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8829 values 139302 bits 17412 bytes 
Fri 17 Jan 2014 00:34:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:34:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:34:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:34:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:34:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:34:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:34:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:34:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:34:56 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:34:56 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:34:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:34:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:34:56 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:35:01 - XML: Processed 655562 elements - found 682 jobs
Fri 17 Jan 2014 00:35:01 - job 7347081 appears to have finished
Fri 17 Jan 2014 00:35:02 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 00:35:02 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 00:35:02 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 00:35:02 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:35:02 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:35:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:35:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:35:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:35:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:35:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:35:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:35:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:35:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:35:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:35:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870765
Fri 17 Jan 2014 00:35:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:35:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870765
Fri 17 Jan 2014 00:35:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:35:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:35:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:35:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:35:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:35:18 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:35:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:35:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:35:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:35:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:35:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:35:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:35:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:35:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:35:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:35:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:35:20 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:35:20 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:35:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 00:35:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:35:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:35:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:35:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:35:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:35:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:35:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:35:22 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:35:22 - job_xml_thread(): Done retrieving: data size 43805642
Fri 17 Jan 2014 00:35:22 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:35:22 - XML: Start document: iteration 16
Fri 17 Jan 2014 00:35:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43805642
Fri 17 Jan 2014 00:35:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:35:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43805642
Fri 17 Jan 2014 00:35:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:35:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:35:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:35:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:35:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:35:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:35:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:35:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:35:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:35:37 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:35:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:35:37 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:35:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:35:37 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:35:43 - XML: Processed 654814 elements - found 682 jobs
Fri 17 Jan 2014 00:35:43 - job 7335189 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 00:35:43 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 00:35:43 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 00:35:43 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 00:35:43 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:35:43 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:35:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:35:44 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:35:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:35:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:35:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:35:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:35:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:35:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:35:46 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:35:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43264638
Fri 17 Jan 2014 00:35:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:35:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43264638
Fri 17 Jan 2014 00:35:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:35:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:35:48 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:35:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:35:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 00:35:50 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:35:50 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:35:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 00:35:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9048 values 142776 bits 17847 bytes 
Fri 17 Jan 2014 00:35:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:35:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:35:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:35:56 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:35:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:35:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:35:56 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:35:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:35:56 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:35:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:35:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43264638
Fri 17 Jan 2014 00:35:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:35:58 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:35:59 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:36:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:36:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:36:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:36:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:36:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:36:09 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:36:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:36:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:36:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:36:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:36:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:36:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:36:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:36:11 - job_xml_thread(): Done retrieving: data size 43198328
Fri 17 Jan 2014 00:36:11 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:36:11 - XML: Start document: iteration 17
Fri 17 Jan 2014 00:36:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:36:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:36:11 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:36:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:36:11 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:36:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:36:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43198328
Fri 17 Jan 2014 00:36:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:36:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43198328
Fri 17 Jan 2014 00:36:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:36:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:36:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:36:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:36:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:36:29 - XML: Processed 647362 elements - found 682 jobs
Fri 17 Jan 2014 00:36:29 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 00:36:29 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 00:36:29 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:36:29 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:36:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:36:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:36:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:36:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:36:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:36:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:36:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:36:31 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:36:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:36:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:36:33 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:36:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:36:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:36:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:36:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:36:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:36:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:36:34 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:36:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 00:36:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:36:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:36:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564573
Fri 17 Jan 2014 00:36:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:36:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564573
Fri 17 Jan 2014 00:36:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:36:38 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 00:36:38 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:36:41 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:36:41 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:36:41 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 00:36:41 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 00:36:41 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 00:36:45 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:36:45 - job_xml_thread(): Done retrieving: data size 43564573
Fri 17 Jan 2014 00:36:45 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:36:45 - XML: Start document: iteration 18
Fri 17 Jan 2014 00:36:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:36:46 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:36:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:36:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:36:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:36:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:36:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:36:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:36:48 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:36:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:36:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:36:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:36:50 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:36:50 - size of cluster 'LISA Cluster': 624 hosts 79472 metrics 801891 values 12662912 bits 1582864 bytes 
Fri 17 Jan 2014 00:36:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:36:51 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:36:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 00:36:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 00:36:51 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:36:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5700 values 89854 bits 11231 bytes 
Fri 17 Jan 2014 00:36:55 - XML: Processed 651606 elements - found 683 jobs
Fri 17 Jan 2014 00:36:55 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 00:36:55 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 00:36:56 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 00:36:56 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:36:56 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:36:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:36:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:36:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:36:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:36:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:36:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:36:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:36:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:37:03 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:37:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43846635
Fri 17 Jan 2014 00:37:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:37:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43846635
Fri 17 Jan 2014 00:37:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:37:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:37:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:37:11 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:37:11 - job_xml_thread(): Done retrieving: data size 43846635
Fri 17 Jan 2014 00:37:11 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:37:11 - XML: Start document: iteration 19
Fri 17 Jan 2014 00:37:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:37:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:37:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:37:21 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:37:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:37:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:37:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:37:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:37:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:37:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:37:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:37:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:37:26 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:37:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:37:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:37:27 - XML: Processed 655311 elements - found 683 jobs
Fri 17 Jan 2014 00:37:27 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 00:37:27 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 00:37:27 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:37:27 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:37:27 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:37:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 00:37:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:37:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:37:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:37:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:37:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:37:31 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:37:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43880221
Fri 17 Jan 2014 00:37:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:37:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43880221
Fri 17 Jan 2014 00:37:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:37:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:37:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:37:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:37:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:37:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:37:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:37:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:37:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:37:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:37:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:37:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43880221
Fri 17 Jan 2014 00:37:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:37:41 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:37:41 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 00:37:42 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:37:42 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:37:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:37:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:37:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:37:48 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:37:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:37:51 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:37:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:37:52 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:37:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 00:37:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 00:37:52 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:37:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5943 values 93805 bits 11725 bytes 
Fri 17 Jan 2014 00:37:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:37:52 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:37:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:37:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:37:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:37:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:37:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:37:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:37:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:37:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:37:56 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:37:56 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:37:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:37:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:37:57 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:37:57 - job_xml_thread(): Done retrieving: data size 43852721
Fri 17 Jan 2014 00:37:57 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:37:57 - XML: Start document: iteration 20
Fri 17 Jan 2014 00:37:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43852721
Fri 17 Jan 2014 00:37:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:37:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43852721
Fri 17 Jan 2014 00:37:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:38:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:38:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:38:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:38:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:38:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:38:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:38:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:38:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:38:12 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:38:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:38:12 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:38:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:38:12 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:38:17 - XML: Processed 655564 elements - found 683 jobs
Fri 17 Jan 2014 00:38:17 - job 7347089 appears to have finished
Fri 17 Jan 2014 00:38:17 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 00:38:17 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 00:38:17 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 00:38:17 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:38:17 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:38:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:38:20 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:38:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:38:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:38:20 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:38:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 00:38:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:38:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:38:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:38:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:38:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:38:24 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:38:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858674
Fri 17 Jan 2014 00:38:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:38:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43858674
Fri 17 Jan 2014 00:38:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:38:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:38:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:38:33 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:38:33 - job_xml_thread(): Done retrieving: data size 43858674
Fri 17 Jan 2014 00:38:33 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:38:33 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 00:38:34 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 00:38:34 - Housekeeping: done.
Fri 17 Jan 2014 00:38:34 - XML: Start document: iteration 0
Fri 17 Jan 2014 00:38:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:38:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:38:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:38:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:38:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:38:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:38:42 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:38:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:38:42 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:38:42 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:38:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:38:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:38:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:38:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:38:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:38:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:38:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:38:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:38:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:38:45 - XML: Processed 655566 elements - found 684 jobs
Fri 17 Jan 2014 00:38:45 - job 7343550 appears to have finished
Fri 17 Jan 2014 00:38:45 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 00:38:45 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 00:38:45 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 00:38:45 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:38:45 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:38:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:38:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43892445
Fri 17 Jan 2014 00:38:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:38:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43892445
Fri 17 Jan 2014 00:38:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:38:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:38:52 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:38:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:38:53 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:38:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 00:38:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 00:38:54 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:38:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8995 values 141871 bits 17733 bytes 
Fri 17 Jan 2014 00:38:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:38:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:38:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:38:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:39:01 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:39:01 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:39:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:39:01 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:39:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:39:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:39:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:39:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:39:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:39:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:39:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:39:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:39:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:39:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:39:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:39:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:39:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:39:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:39:08 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:39:08 - job_xml_thread(): Done retrieving: data size 43864716
Fri 17 Jan 2014 00:39:08 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:39:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43864716
Fri 17 Jan 2014 00:39:08 - XML: Start document: iteration 1
Fri 17 Jan 2014 00:39:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:39:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43864716
Fri 17 Jan 2014 00:39:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:39:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:39:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:39:20 - XML: Processed 655564 elements - found 683 jobs
Fri 17 Jan 2014 00:39:20 - job 7347129 field 'start_timestamp' changed since saved from: 1389915466 to: 1389915455
Fri 17 Jan 2014 00:39:20 - job 7347092 appears to have finished
Fri 17 Jan 2014 00:39:20 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 00:39:20 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 00:39:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:39:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:39:23 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 00:39:23 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:39:23 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:39:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:39:30 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:39:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:39:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:39:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:39:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:39:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:39:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:39:31 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:39:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:39:31 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:39:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:39:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:39:32 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:39:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:39:32 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:39:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:39:32 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:39:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 00:39:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:39:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:39:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43885228
Fri 17 Jan 2014 00:39:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:39:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43885228
Fri 17 Jan 2014 00:39:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:39:38 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:39:38 - job_xml_thread(): Done retrieving: data size 43885228
Fri 17 Jan 2014 00:39:38 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:39:38 - XML: Start document: iteration 2
Fri 17 Jan 2014 00:39:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:39:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:39:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:39:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:39:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:39:53 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:39:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:39:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:39:54 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:39:54 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:39:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:39:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:39:54 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:39:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:39:55 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:39:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:39:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 00:39:55 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:39:55 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:39:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 00:39:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5537 values 87275 bits 10909 bytes 
Fri 17 Jan 2014 00:39:57 - XML: Processed 655564 elements - found 683 jobs
Fri 17 Jan 2014 00:39:57 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 00:39:57 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 00:39:57 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:39:57 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:39:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:39:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:39:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:39:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:39:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:39:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:39:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:39:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:40:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:40:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43884291
Fri 17 Jan 2014 00:40:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:40:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43884291
Fri 17 Jan 2014 00:40:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:40:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:40:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:40:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:40:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:40:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:40:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:40:12 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:40:12 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:40:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:40:12 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:40:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:40:12 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:40:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:40:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:40:17 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:40:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 00:40:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:40:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:40:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:40:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:40:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:40:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:40:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:40:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:40:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:40:21 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:40:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43864161
Fri 17 Jan 2014 00:40:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:40:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43864161
Fri 17 Jan 2014 00:40:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:40:21 - job_xml_thread(): Done retrieving: data size 43864161
Fri 17 Jan 2014 00:40:21 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:40:21 - XML: Start document: iteration 3
Fri 17 Jan 2014 00:40:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:40:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:40:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:40:31 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:40:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:40:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:40:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:40:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:40:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:40:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:40:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:40:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:40:41 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:40:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:40:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:40:42 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:40:42 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:40:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:40:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:40:42 - XML: Processed 655560 elements - found 681 jobs
Fri 17 Jan 2014 00:40:42 - job 7347080 appears to have finished
Fri 17 Jan 2014 00:40:42 - job 7346064 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 00:40:42 - job 7347042 appears to have finished
Fri 17 Jan 2014 00:40:42 - job 7346047 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 00:40:42 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 00:40:42 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 00:40:42 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 00:40:42 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:40:42 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:40:46 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:40:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875318
Fri 17 Jan 2014 00:40:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:40:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875318
Fri 17 Jan 2014 00:40:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:40:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:40:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:40:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:40:55 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:40:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:40:56 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:40:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 00:40:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 00:40:56 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:40:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:40:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:40:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8760 values 138142 bits 17267 bytes 
Fri 17 Jan 2014 00:40:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:40:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:40:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:40:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:40:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:40:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:40:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:40:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:40:57 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:40:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:41:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:41:00 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:41:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:41:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:41:01 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:41:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:41:01 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:41:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:41:03 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 00:41:03 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 00:41:03 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:41:04 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:41:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43887871
Fri 17 Jan 2014 00:41:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:41:04 - job_xml_thread(): Done retrieving: data size 43887871
Fri 17 Jan 2014 00:41:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43887871
Fri 17 Jan 2014 00:41:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:41:04 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:41:04 - XML: Start document: iteration 4
Fri 17 Jan 2014 00:41:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:41:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:41:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:41:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:41:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:41:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:41:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:41:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:41:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:41:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:41:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:41:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:41:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:41:25 - XML: Processed 655560 elements - found 681 jobs
Fri 17 Jan 2014 00:41:25 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 00:41:25 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 00:41:25 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:41:25 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:41:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:41:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:41:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:41:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:41:28 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:41:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 00:41:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:41:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:41:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:41:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:41:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:41:29 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:41:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43798892
Fri 17 Jan 2014 00:41:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:41:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43798892
Fri 17 Jan 2014 00:41:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:41:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:41:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:41:40 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:41:40 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:41:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:41:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:41:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:41:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:41:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:41:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:41:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:41:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:41:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:41:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:41:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:41:45 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:41:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:41:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:41:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:41:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:41:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:41:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:41:48 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:41:48 - job_xml_thread(): Done retrieving: data size 43284216
Fri 17 Jan 2014 00:41:48 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:41:48 - XML: Start document: iteration 5
Fri 17 Jan 2014 00:41:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43284216
Fri 17 Jan 2014 00:41:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43284216
Fri 17 Jan 2014 00:41:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:41:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:41:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:41:56 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:41:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:41:56 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:41:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 00:41:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 00:41:57 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:41:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8795 values 138658 bits 17332 bytes 
Fri 17 Jan 2014 00:41:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:42:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:42:00 - XML: Processed 648112 elements - found 681 jobs
Fri 17 Jan 2014 00:42:00 - job 7346692 appears to have finished
Fri 17 Jan 2014 00:42:01 - job 7347073 appears to have finished
Fri 17 Jan 2014 00:42:01 - job 7347087 appears to have finished
Fri 17 Jan 2014 00:42:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:42:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:42:01 - job_xml_thread(): Found 6 updated jobs.
Fri 17 Jan 2014 00:42:01 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 00:42:02 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Fri 17 Jan 2014 00:42:02 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:42:02 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:42:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:42:07 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:42:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:42:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:42:08 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:42:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:42:08 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:42:08 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:42:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:42:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:42:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:42:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:42:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:42:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:42:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:42:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:42:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:42:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:42:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43284087
Fri 17 Jan 2014 00:42:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:42:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43284087
Fri 17 Jan 2014 00:42:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:42:18 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:42:18 - job_xml_thread(): Done retrieving: data size 43284087
Fri 17 Jan 2014 00:42:18 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:42:18 - XML: Start document: iteration 6
Fri 17 Jan 2014 00:42:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:42:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:42:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:42:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:42:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:42:29 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:42:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:42:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:42:30 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:42:30 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:42:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:42:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:42:30 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:42:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:42:31 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:42:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:42:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:42:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:42:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:42:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:42:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:42:34 - XML: Processed 648034 elements - found 681 jobs
Fri 17 Jan 2014 00:42:34 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 00:42:34 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 00:42:34 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:42:34 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:42:35 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:42:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 00:42:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:42:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:42:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43433335
Fri 17 Jan 2014 00:42:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:42:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43433335
Fri 17 Jan 2014 00:42:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:42:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:42:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:42:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:42:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:42:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:42:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:42:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:42:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:42:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:42:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:42:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:42:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:42:48 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:42:49 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:42:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:42:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:42:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:42:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:42:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:42:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:42:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:42:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:42:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:42:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43852277
Fri 17 Jan 2014 00:42:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:42:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43852277
Fri 17 Jan 2014 00:42:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:42:53 - job_xml_thread(): Done retrieving: data size 43852277
Fri 17 Jan 2014 00:42:53 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:42:54 - XML: Start document: iteration 7
Fri 17 Jan 2014 00:42:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:42:57 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:42:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:42:59 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:42:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 00:43:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 00:43:02 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:43:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8229 values 129736 bits 16217 bytes 
Fri 17 Jan 2014 00:43:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:43:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:43:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:43:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:43:07 - XML: Processed 655274 elements - found 681 jobs
Fri 17 Jan 2014 00:43:07 - job 7346087 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 00:43:07 - job 7347130 field 'start_timestamp' changed since saved from: 1389915648 to: 1389915623
Fri 17 Jan 2014 00:43:07 - job 7347131 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 00:43:08 - job 7346763 appears to have finished
Fri 17 Jan 2014 00:43:08 - job_xml_thread(): Found 5 updated jobs.
Fri 17 Jan 2014 00:43:08 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 00:43:10 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Fri 17 Jan 2014 00:43:10 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:43:10 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:43:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:43:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:43:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:43:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:43:11 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:43:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:43:11 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:43:11 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:43:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:43:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:43:15 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:43:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:43:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:43:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:43:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:43:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:43:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:43:17 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:43:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43877036
Fri 17 Jan 2014 00:43:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:43:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43877036
Fri 17 Jan 2014 00:43:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:43:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:43:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:43:26 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:43:26 - job_xml_thread(): Done retrieving: data size 43877036
Fri 17 Jan 2014 00:43:26 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:43:26 - XML: Start document: iteration 8
Fri 17 Jan 2014 00:43:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:43:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:43:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:43:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:43:27 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:43:27 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:43:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:43:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:43:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:43:36 - XML: Processed 655558 elements - found 680 jobs
Fri 17 Jan 2014 00:43:36 - job 7345913 appears to have finished
Fri 17 Jan 2014 00:43:36 - job 7345914 appears to have finished
Fri 17 Jan 2014 00:43:36 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 00:43:36 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 00:43:36 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 00:43:36 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:43:37 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:43:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:43:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:43:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:43:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:43:39 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:43:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 00:43:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:43:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:43:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:43:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:43:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:43:40 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:43:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43845466
Fri 17 Jan 2014 00:43:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:43:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43845466
Fri 17 Jan 2014 00:43:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:43:42 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 00:43:42 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:43:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:43:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:43:43 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:43:43 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 00:43:43 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:43:43 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 00:43:43 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 00:43:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:43:50 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:43:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:43:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:43:52 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:43:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:43:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:43:52 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:43:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:43:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:43:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:43:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:43:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:43:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:43:56 - size of cluster 'LISA Cluster': 624 hosts 79487 metrics 803461 values 12670727 bits 1583840 bytes 
Fri 17 Jan 2014 00:43:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:43:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:43:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:43:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:43:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:43:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:44:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:44:00 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:44:01 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:44:01 - job_xml_thread(): Done retrieving: data size 43868713
Fri 17 Jan 2014 00:44:01 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:44:01 - XML: Start document: iteration 9
Fri 17 Jan 2014 00:44:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43868713
Fri 17 Jan 2014 00:44:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43868713
Fri 17 Jan 2014 00:44:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:44:02 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:44:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 00:44:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:44:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:44:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 00:44:02 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:44:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5735 values 90490 bits 11311 bytes 
Fri 17 Jan 2014 00:44:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:44:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:44:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:44:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:44:13 - XML: Processed 655558 elements - found 680 jobs
Fri 17 Jan 2014 00:44:13 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 00:44:13 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 00:44:13 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:44:13 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:44:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:44:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:44:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:44:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:44:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:44:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:44:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:44:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:44:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:44:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:44:23 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:44:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:44:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:44:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:44:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:44:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:44:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:44:27 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:44:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43886352
Fri 17 Jan 2014 00:44:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:44:28 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:44:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43886352
Fri 17 Jan 2014 00:44:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:44:28 - job_xml_thread(): Done retrieving: data size 43886352
Fri 17 Jan 2014 00:44:28 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:44:28 - XML: Start document: iteration 10
Fri 17 Jan 2014 00:44:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:44:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:44:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:44:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:44:44 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:44:44 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 00:44:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:44:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:44:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:44:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:44:46 - XML: Processed 655552 elements - found 677 jobs
Fri 17 Jan 2014 00:44:46 - job 7335104 appears to have finished
Fri 17 Jan 2014 00:44:46 - job 7347105 appears to have finished
Fri 17 Jan 2014 00:44:46 - job 7347091 appears to have finished
Fri 17 Jan 2014 00:44:46 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 00:44:46 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 00:44:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:44:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:44:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:44:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:44:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:44:47 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 00:44:47 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:44:47 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:44:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:44:52 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:44:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:44:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:44:52 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:44:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 00:44:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:44:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:44:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:44:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:44:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:44:55 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:44:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862020
Fri 17 Jan 2014 00:44:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:44:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862020
Fri 17 Jan 2014 00:44:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:45:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:45:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:45:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:45:02 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:45:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:45:02 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:45:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 00:45:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 00:45:02 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:45:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5781 values 91136 bits 11392 bytes 
Fri 17 Jan 2014 00:45:02 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:45:03 - job_xml_thread(): Done retrieving: data size 43862020
Fri 17 Jan 2014 00:45:03 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:45:03 - XML: Start document: iteration 11
Fri 17 Jan 2014 00:45:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:45:06 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:45:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:45:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:45:07 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:45:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:45:07 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:45:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:45:07 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:45:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:45:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:45:18 - XML: Processed 655552 elements - found 677 jobs
Fri 17 Jan 2014 00:45:18 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 00:45:18 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 00:45:18 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:45:18 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:45:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:45:19 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:45:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:45:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:45:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:45:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:45:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:45:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:45:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:45:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:45:24 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:45:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43841349
Fri 17 Jan 2014 00:45:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:45:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43841349
Fri 17 Jan 2014 00:45:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:45:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:45:33 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:45:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:45:33 - job_xml_thread(): Done retrieving: data size 43841349
Fri 17 Jan 2014 00:45:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:45:34 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:45:34 - XML: Start document: iteration 12
Fri 17 Jan 2014 00:45:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:45:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:45:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:45:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:45:34 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:45:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:45:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:45:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:45:38 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:45:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 00:45:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:45:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:45:45 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:45:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:45:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:45:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:45:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:45:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:45:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:45:46 - XML: Processed 655550 elements - found 676 jobs
Fri 17 Jan 2014 00:45:46 - job 7347084 appears to have finished
Fri 17 Jan 2014 00:45:46 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 00:45:46 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 00:45:46 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 00:45:46 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:45:46 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:45:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:45:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43859361
Fri 17 Jan 2014 00:45:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:45:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43859361
Fri 17 Jan 2014 00:45:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:45:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:45:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:46:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:46:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:46:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:46:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:46:01 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:46:01 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:46:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:46:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:46:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:46:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:46:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:46:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:46:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:46:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:46:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:46:02 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:46:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:46:02 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:46:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:46:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 00:46:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:46:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:46:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 00:46:02 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:46:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6129 values 96739 bits 12092 bytes 
Fri 17 Jan 2014 00:46:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:46:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:46:05 - job_xml_thread(): Done retrieving: data size 43888677
Fri 17 Jan 2014 00:46:05 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:46:05 - XML: Start document: iteration 13
Fri 17 Jan 2014 00:46:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43888677
Fri 17 Jan 2014 00:46:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:46:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43888677
Fri 17 Jan 2014 00:46:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:46:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:46:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:46:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:46:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:46:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:46:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:46:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:46:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:46:23 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:46:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:46:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:46:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:46:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:46:29 - XML: Processed 655548 elements - found 676 jobs
Fri 17 Jan 2014 00:46:29 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 00:46:29 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 00:46:29 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:46:29 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:46:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:46:30 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:46:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:46:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:46:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:46:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:46:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:46:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:46:31 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:46:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 00:46:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:46:34 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:46:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43876726
Fri 17 Jan 2014 00:46:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:46:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43876726
Fri 17 Jan 2014 00:46:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:46:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:46:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:46:44 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:46:44 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:46:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:46:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:46:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:46:50 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:46:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:46:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:46:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:46:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:46:50 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:46:50 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:46:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:46:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:46:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:46:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:46:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:46:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:46:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:46:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:46:55 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:46:55 - job_xml_thread(): Done retrieving: data size 43865436
Fri 17 Jan 2014 00:46:55 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:46:55 - XML: Start document: iteration 14
Fri 17 Jan 2014 00:46:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865436
Fri 17 Jan 2014 00:46:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:46:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43865436
Fri 17 Jan 2014 00:46:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:47:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:47:03 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:47:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:47:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 00:47:03 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:47:03 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:47:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 00:47:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8516 values 134584 bits 16823 bytes 
Fri 17 Jan 2014 00:47:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:47:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:47:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:47:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:47:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:47:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:47:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:47:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:47:12 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:47:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:47:12 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:47:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:47:12 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:47:12 - XML: Processed 655568 elements - found 685 jobs
Fri 17 Jan 2014 00:47:12 - job 7347107 appears to have finished
Fri 17 Jan 2014 00:47:12 - job_xml_thread(): Found 11 updated jobs.
Fri 17 Jan 2014 00:47:12 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 00:47:16 - job_xml_thread(): Done storing. succesfully stored: 11 jobs
Fri 17 Jan 2014 00:47:16 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:47:16 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:47:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:47:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:47:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:47:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:47:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:47:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:47:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:47:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:47:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:47:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43805881
Fri 17 Jan 2014 00:47:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:47:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43805881
Fri 17 Jan 2014 00:47:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:47:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:47:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:47:31 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:47:31 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:47:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:47:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:47:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:47:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:47:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:47:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:47:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:47:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:47:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:47:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:47:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:47:37 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:47:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:47:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:47:37 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:47:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 00:47:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:47:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:47:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:47:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:47:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:47:39 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 00:47:39 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 00:47:39 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:47:39 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:47:39 - job_xml_thread(): Done retrieving: data size 43307819
Fri 17 Jan 2014 00:47:39 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:47:39 - XML: Start document: iteration 15
Fri 17 Jan 2014 00:47:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43307819
Fri 17 Jan 2014 00:47:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:47:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43307819
Fri 17 Jan 2014 00:47:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:47:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:47:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:47:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:47:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:47:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:47:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:47:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:47:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:47:58 - XML: Processed 648596 elements - found 685 jobs
Fri 17 Jan 2014 00:47:58 - job 7347142 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 00:47:58 - job 7347137 field 'start_timestamp' changed since saved from: 1389915977 to: 1389915938
Fri 17 Jan 2014 00:47:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:47:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:47:58 - job 7347141 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 00:47:58 - job 7347143 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 00:47:58 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 00:47:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:47:58 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 00:47:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:47:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:48:01 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 00:48:01 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:48:01 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:48:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:48:01 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:48:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:48:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:48:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:48:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:48:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:48:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:48:03 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:48:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43223077
Fri 17 Jan 2014 00:48:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:48:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:48:03 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:48:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43223077
Fri 17 Jan 2014 00:48:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:48:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:48:05 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:48:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 00:48:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 00:48:06 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:48:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9114 values 144260 bits 18032 bytes 
Fri 17 Jan 2014 00:48:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:48:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:48:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:48:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:48:14 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:48:14 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:48:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:48:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:48:14 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:48:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:48:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:48:16 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:48:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:48:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:48:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:48:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:48:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:48:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:48:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:48:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43252490
Fri 17 Jan 2014 00:48:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:48:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43252490
Fri 17 Jan 2014 00:48:19 - job_xml_thread(): Done retrieving: data size 43252490
Fri 17 Jan 2014 00:48:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:48:19 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:48:19 - XML: Start document: iteration 16
Fri 17 Jan 2014 00:48:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:48:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:48:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:48:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:48:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:48:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:48:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:48:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:48:37 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:48:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:48:37 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:48:37 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:48:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:48:40 - XML: Processed 647710 elements - found 685 jobs
Fri 17 Jan 2014 00:48:40 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 00:48:40 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 00:48:40 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:48:41 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:48:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:48:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:48:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:48:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:48:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:48:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:48:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:48:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:48:42 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:48:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 00:48:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:48:44 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:48:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43768271
Fri 17 Jan 2014 00:48:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:48:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43768271
Fri 17 Jan 2014 00:48:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:48:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:48:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:48:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:48:54 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:48:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:48:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:48:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:48:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:48:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:48:55 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:48:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:48:56 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:48:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:48:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:48:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:48:57 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:48:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:48:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:48:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:48:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:48:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:48:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:49:00 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:49:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870125
Fri 17 Jan 2014 00:49:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:49:00 - job_xml_thread(): Done retrieving: data size 43870125
Fri 17 Jan 2014 00:49:00 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:49:00 - XML: Start document: iteration 17
Fri 17 Jan 2014 00:49:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870125
Fri 17 Jan 2014 00:49:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:49:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:49:05 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:49:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:49:07 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:49:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 00:49:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 00:49:08 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:49:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9111 values 143922 bits 17990 bytes 
Fri 17 Jan 2014 00:49:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:49:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:49:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:49:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:49:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:49:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:49:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:49:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:49:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:49:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:49:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:49:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:49:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:49:22 - XML: Processed 655198 elements - found 685 jobs
Fri 17 Jan 2014 00:49:22 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 00:49:22 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 00:49:22 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:49:22 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:49:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:49:24 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:49:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:49:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:49:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:49:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:49:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:49:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:49:26 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:49:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43857374
Fri 17 Jan 2014 00:49:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:49:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43857374
Fri 17 Jan 2014 00:49:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:49:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:49:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:49:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:49:37 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:49:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:49:37 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:49:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:49:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:49:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:49:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:49:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:49:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:49:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:49:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:49:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:49:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:49:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:49:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:49:41 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:49:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 00:49:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:49:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:49:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:49:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:49:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:49:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:49:43 - job_xml_thread(): Done retrieving: data size 43893918
Fri 17 Jan 2014 00:49:43 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:49:43 - XML: Start document: iteration 18
Fri 17 Jan 2014 00:49:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43893918
Fri 17 Jan 2014 00:49:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43893918
Fri 17 Jan 2014 00:49:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:49:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:49:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:49:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:49:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:49:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:50:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:50:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:50:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:50:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:50:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:50:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:50:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:50:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:50:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:50:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:50:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:50:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:50:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:50:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:50:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:50:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:50:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:50:06 - XML: Processed 655568 elements - found 685 jobs
Fri 17 Jan 2014 00:50:06 - job 7347141 field 'start_timestamp' changed since saved from: 1389916075 to: 1389915999
Fri 17 Jan 2014 00:50:06 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 00:50:06 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 00:50:07 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 00:50:07 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:50:07 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:50:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:50:07 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:50:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:50:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 00:50:08 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:50:08 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:50:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 00:50:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5928 values 93564 bits 11695 bytes 
Fri 17 Jan 2014 00:50:08 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:50:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43881962
Fri 17 Jan 2014 00:50:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:50:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43881962
Fri 17 Jan 2014 00:50:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:50:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:50:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:50:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:50:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:50:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:50:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:50:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:50:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:50:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:50:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:50:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:50:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:50:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:50:22 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:50:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:50:23 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:50:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:50:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:50:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:50:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:50:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:50:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:50:25 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:50:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 00:50:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:50:26 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:50:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43885348
Fri 17 Jan 2014 00:50:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:50:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43885348
Fri 17 Jan 2014 00:50:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:50:27 - job_xml_thread(): Done retrieving: data size 43885348
Fri 17 Jan 2014 00:50:27 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:50:27 - XML: Start document: iteration 19
Fri 17 Jan 2014 00:50:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:50:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:50:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:50:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:50:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:50:41 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:50:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:50:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:50:42 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:50:42 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:50:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:50:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:50:42 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:50:44 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 00:50:44 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:50:45 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:50:45 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 00:50:45 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 00:50:45 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:50:45 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 00:50:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:50:48 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:50:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:50:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:50:49 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 879505 values 13893455 bits 1736681 bytes 
Fri 17 Jan 2014 00:50:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:50:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:50:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:50:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:50:50 - XML: Processed 655570 elements - found 686 jobs
Fri 17 Jan 2014 00:50:50 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 00:50:50 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 00:50:50 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 00:50:50 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:50:50 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:50:54 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:50:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862885
Fri 17 Jan 2014 00:50:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:50:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862885
Fri 17 Jan 2014 00:50:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:50:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:50:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:51:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:51:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:51:06 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:51:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:51:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:51:08 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:51:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:51:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:51:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:51:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:51:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:51:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:51:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:51:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:51:09 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:51:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:51:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 00:51:09 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:51:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 00:51:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7059 values 111431 bits 13928 bytes 
Fri 17 Jan 2014 00:51:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:51:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:51:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:51:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:51:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:51:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:51:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:51:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:51:15 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:51:15 - job_xml_thread(): Done retrieving: data size 43888947
Fri 17 Jan 2014 00:51:15 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:51:15 - XML: Start document: iteration 20
Fri 17 Jan 2014 00:51:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43888947
Fri 17 Jan 2014 00:51:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43888947
Fri 17 Jan 2014 00:51:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:51:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:51:17 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:51:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 00:51:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:51:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:51:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:51:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:51:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:51:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:51:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:51:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:51:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:51:32 - XML: Processed 655570 elements - found 686 jobs
Fri 17 Jan 2014 00:51:33 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 00:51:33 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 00:51:33 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:51:33 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:51:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:51:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:51:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:51:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:51:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:51:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:51:38 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:51:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:51:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:51:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:51:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:51:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:51:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:51:42 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:51:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43879526
Fri 17 Jan 2014 00:51:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:51:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43879526
Fri 17 Jan 2014 00:51:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:51:46 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:51:46 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 00:51:48 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:51:48 - job_xml_thread(): Done retrieving: data size 43879526
Fri 17 Jan 2014 00:51:48 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:51:48 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 00:51:49 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 00:51:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:51:49 - Housekeeping: done.
Fri 17 Jan 2014 00:51:49 - XML: Start document: iteration 0
Fri 17 Jan 2014 00:51:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:51:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:51:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:51:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:51:54 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:51:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:51:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:51:56 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:51:56 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:51:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:51:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:51:56 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:52:04 - XML: Processed 655572 elements - found 687 jobs
Fri 17 Jan 2014 00:52:04 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 00:52:04 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 00:52:05 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 00:52:05 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:52:05 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:52:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:52:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:52:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:52:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:52:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:52:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:52:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:52:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:52:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:52:09 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:52:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:52:09 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:52:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 00:52:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 00:52:09 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:52:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99141 bits 12392 bytes 
Fri 17 Jan 2014 00:52:10 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:52:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858580
Fri 17 Jan 2014 00:52:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:52:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:52:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:52:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43858580
Fri 17 Jan 2014 00:52:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:52:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:52:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:52:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:52:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:52:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:52:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:52:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:52:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858580
Fri 17 Jan 2014 00:52:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:52:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:52:20 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:52:20 - job_xml_thread(): Done retrieving: data size 43858580
Fri 17 Jan 2014 00:52:20 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:52:20 - XML: Start document: iteration 1
Fri 17 Jan 2014 00:52:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:52:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:52:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:52:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:52:37 - XML: Processed 655572 elements - found 687 jobs
Fri 17 Jan 2014 00:52:37 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 00:52:37 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 00:52:37 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:52:37 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:52:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:52:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:52:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:52:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:52:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:52:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:52:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:52:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:52:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:52:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:52:40 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:52:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:52:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:52:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:52:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:52:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:52:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:52:43 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:52:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 00:52:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:52:44 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:52:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43902581
Fri 17 Jan 2014 00:52:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:52:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43902581
Fri 17 Jan 2014 00:52:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:52:52 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:52:52 - job_xml_thread(): Done retrieving: data size 43902581
Fri 17 Jan 2014 00:52:52 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:52:52 - XML: Start document: iteration 2
Fri 17 Jan 2014 00:52:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:52:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:52:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:52:54 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:52:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:52:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:52:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:52:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:52:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:52:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:52:55 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:52:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:52:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:53:04 - XML: Processed 655574 elements - found 688 jobs
Fri 17 Jan 2014 00:53:04 - job 7340327 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 00:53:04 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 00:53:05 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 00:53:06 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 00:53:06 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:53:06 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:53:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:53:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:53:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:53:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:53:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:53:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:53:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:53:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:53:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:53:09 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:53:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:53:09 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:53:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 00:53:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 00:53:09 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:53:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 4038 values 63687 bits 7960 bytes 
Fri 17 Jan 2014 00:53:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:53:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:53:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:53:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43854652
Fri 17 Jan 2014 00:53:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:53:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43854652
Fri 17 Jan 2014 00:53:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:53:21 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:53:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:53:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:53:21 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:53:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:53:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:53:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:53:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:53:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:53:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:53:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:53:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:53:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:53:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:53:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:53:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:53:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:53:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:53:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:53:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:53:30 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:53:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 00:53:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:53:31 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:53:31 - job_xml_thread(): Done retrieving: data size 43814858
Fri 17 Jan 2014 00:53:31 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:53:31 - XML: Start document: iteration 3
Fri 17 Jan 2014 00:53:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43814858
Fri 17 Jan 2014 00:53:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43814858
Fri 17 Jan 2014 00:53:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:53:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:53:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:53:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:53:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:53:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:53:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:53:45 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:53:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:53:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:53:47 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:53:47 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:53:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:53:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:53:47 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:53:50 - XML: Processed 654822 elements - found 688 jobs
Fri 17 Jan 2014 00:53:50 - job 7347146 field 'start_timestamp' changed since saved from: 1389916355 to: 1389916284
Fri 17 Jan 2014 00:53:50 - job 7340327 field 'start_timestamp' changed since saved from: 1389916348 to: 1389916284
Fri 17 Jan 2014 00:53:50 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 00:53:50 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 00:53:51 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 00:53:51 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:53:51 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:53:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:53:55 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:53:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:53:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:53:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:53:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:53:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:53:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:53:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:53:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43239369
Fri 17 Jan 2014 00:53:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:53:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43239369
Fri 17 Jan 2014 00:53:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:54:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:54:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:54:06 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:54:06 - job_xml_thread(): Done retrieving: data size 43239369
Fri 17 Jan 2014 00:54:06 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:54:06 - XML: Start document: iteration 4
Fri 17 Jan 2014 00:54:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:54:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:54:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:54:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:54:08 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:54:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:54:08 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:54:08 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:54:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:54:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:54:09 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:54:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:54:11 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:54:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 00:54:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:54:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:54:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 00:54:11 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:54:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7142 values 112597 bits 14074 bytes 
Fri 17 Jan 2014 00:54:17 - XML: Processed 647712 elements - found 688 jobs
Fri 17 Jan 2014 00:54:17 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 00:54:17 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 00:54:17 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:54:17 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:54:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:54:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:54:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:54:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:54:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:54:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:54:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:54:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:54:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:54:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:54:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:54:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43244485
Fri 17 Jan 2014 00:54:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:54:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43244485
Fri 17 Jan 2014 00:54:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:54:32 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:54:32 - job_xml_thread(): Done retrieving: data size 43244485
Fri 17 Jan 2014 00:54:32 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:54:32 - XML: Start document: iteration 5
Fri 17 Jan 2014 00:54:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:54:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:54:45 - XML: Processed 648060 elements - found 688 jobs
Fri 17 Jan 2014 00:54:45 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 00:54:45 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 00:54:45 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:54:45 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:54:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:54:46 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:54:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:54:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:54:47 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:54:47 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:54:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:54:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:54:47 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:54:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:54:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:54:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:54:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:54:50 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:54:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 00:54:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:54:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:54:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:54:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:54:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:54:53 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:54:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43854191
Fri 17 Jan 2014 00:54:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:54:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43854191
Fri 17 Jan 2014 00:54:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:55:00 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:55:00 - job_xml_thread(): Done retrieving: data size 43854191
Fri 17 Jan 2014 00:55:00 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:55:00 - XML: Start document: iteration 6
Fri 17 Jan 2014 00:55:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:55:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:55:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:55:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:55:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:55:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:55:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:55:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:55:06 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:55:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:55:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:55:06 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:55:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:55:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:55:11 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:55:11 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:55:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 00:55:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:55:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 00:55:12 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:55:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5749 values 90616 bits 11327 bytes 
Fri 17 Jan 2014 00:55:13 - XML: Processed 655308 elements - found 687 jobs
Fri 17 Jan 2014 00:55:13 - job 7347086 appears to have finished
Fri 17 Jan 2014 00:55:13 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 00:55:13 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 00:55:14 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 00:55:14 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:55:14 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:55:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:55:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:55:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:55:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:55:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:55:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:55:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:55:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:55:19 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 00:55:19 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 00:55:19 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:55:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:55:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43842943
Fri 17 Jan 2014 00:55:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:55:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43842943
Fri 17 Jan 2014 00:55:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:55:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:55:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:55:29 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:55:29 - job_xml_thread(): Done retrieving: data size 43842943
Fri 17 Jan 2014 00:55:29 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:55:29 - XML: Start document: iteration 7
Fri 17 Jan 2014 00:55:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:55:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:55:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:55:34 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:55:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:55:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:55:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:55:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:55:37 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:55:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:55:37 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:55:38 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:55:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 00:55:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:55:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:55:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:55:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:55:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:55:44 - XML: Processed 655570 elements - found 686 jobs
Fri 17 Jan 2014 00:55:44 - job 7347020 appears to have finished
Fri 17 Jan 2014 00:55:44 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 00:55:44 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 00:55:44 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 00:55:44 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:55:44 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:55:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:55:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:55:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:55:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:55:46 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:55:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43877377
Fri 17 Jan 2014 00:55:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:55:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43877377
Fri 17 Jan 2014 00:55:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:55:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:55:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:55:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:55:54 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:55:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:55:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:55:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:55:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:55:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:55:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:55:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:55:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:55:59 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:55:59 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:55:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:55:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:56:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:56:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:56:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:56:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:56:00 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:56:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43898034
Fri 17 Jan 2014 00:56:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:56:01 - job_xml_thread(): Done retrieving: data size 43898034
Fri 17 Jan 2014 00:56:01 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:56:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43898034
Fri 17 Jan 2014 00:56:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:56:01 - XML: Start document: iteration 8
Fri 17 Jan 2014 00:56:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:56:12 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:56:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:56:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:56:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:56:13 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:56:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:56:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:56:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:56:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 00:56:13 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:56:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9177 values 144771 bits 18096 bytes 
Fri 17 Jan 2014 00:56:14 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:56:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 00:56:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:56:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:56:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:56:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:56:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:56:15 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:56:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:56:23 - XML: Processed 655570 elements - found 686 jobs
Fri 17 Jan 2014 00:56:23 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 00:56:23 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 00:56:23 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:56:23 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:56:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:56:24 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:56:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:56:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:56:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:56:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:56:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:56:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:56:26 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:56:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43872936
Fri 17 Jan 2014 00:56:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:56:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43872936
Fri 17 Jan 2014 00:56:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:56:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:56:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:56:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:56:36 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:56:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:56:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:56:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:56:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:56:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:56:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:56:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:56:38 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:56:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:56:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:56:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:56:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:56:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:56:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:56:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:56:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:56:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:56:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:56:41 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:56:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 00:56:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:56:42 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:56:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43908225
Fri 17 Jan 2014 00:56:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:56:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43908225
Fri 17 Jan 2014 00:56:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:56:45 - job_xml_thread(): Done retrieving: data size 43908225
Fri 17 Jan 2014 00:56:46 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:56:46 - XML: Start document: iteration 9
Fri 17 Jan 2014 00:56:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:56:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:56:53 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:56:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:56:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:56:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:56:56 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:56:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:56:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:56:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:56:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:56:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:56:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:56:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:56:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:56:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:56:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:56:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:56:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:57:00 - XML: Processed 655570 elements - found 686 jobs
Fri 17 Jan 2014 00:57:00 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 00:57:00 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 00:57:00 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:57:00 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:57:03 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:57:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43881449
Fri 17 Jan 2014 00:57:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:57:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43881449
Fri 17 Jan 2014 00:57:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:57:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:57:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:57:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:57:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:57:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:57:14 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:57:15 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:57:15 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:57:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:57:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 00:57:15 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:57:16 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:57:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 00:57:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8869 values 139868 bits 17483 bytes 
Fri 17 Jan 2014 00:57:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:57:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:57:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:57:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:57:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:57:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:57:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:57:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:57:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:57:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:57:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:57:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:57:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:57:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:57:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:57:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:57:21 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:57:21 - job_xml_thread(): Done retrieving: data size 43875290
Fri 17 Jan 2014 00:57:21 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:57:21 - XML: Start document: iteration 10
Fri 17 Jan 2014 00:57:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875290
Fri 17 Jan 2014 00:57:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:57:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875290
Fri 17 Jan 2014 00:57:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:57:32 - XML: Processed 655572 elements - found 687 jobs
Fri 17 Jan 2014 00:57:32 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 00:57:32 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 00:57:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:57:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:57:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:57:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:57:34 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 00:57:34 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:57:34 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:57:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:57:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:57:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:57:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:57:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:57:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:57:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:57:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:57:43 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:57:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:57:45 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:57:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:57:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:57:45 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:57:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 00:57:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:57:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:57:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:57:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:57:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:57:46 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:57:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43896306
Fri 17 Jan 2014 00:57:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:57:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43896306
Fri 17 Jan 2014 00:57:47 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 00:57:47 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:57:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:57:47 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:57:47 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 00:57:47 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 00:57:47 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:57:47 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 00:57:49 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:57:49 - job_xml_thread(): Done retrieving: data size 43896306
Fri 17 Jan 2014 00:57:49 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:57:49 - XML: Start document: iteration 11
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Fri 17 Jan 2014 00:57:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:57:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:58:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:58:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:58:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:58:03 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:58:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:58:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:58:04 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:58:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:58:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:58:04 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:58:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:58:08 - XML: Processed 655572 elements - found 687 jobs
Fri 17 Jan 2014 00:58:08 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 00:58:08 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 00:58:08 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:58:08 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:58:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:58:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:58:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:58:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:58:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:58:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:58:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:58:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:58:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:58:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43887850
Fri 17 Jan 2014 00:58:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:58:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43887850
Fri 17 Jan 2014 00:58:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:58:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:58:16 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:58:17 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:58:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:58:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 00:58:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 00:58:17 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:58:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9133 values 144102 bits 18012 bytes 
Fri 17 Jan 2014 00:58:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:58:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:58:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:58:21 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:58:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:58:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:58:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:58:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:58:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:58:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:58:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:58:23 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:58:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:58:25 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:58:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:58:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:58:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:58:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:58:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:58:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:58:28 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:58:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43901728
Fri 17 Jan 2014 00:58:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:58:29 - job_xml_thread(): Done retrieving: data size 43901728
Fri 17 Jan 2014 00:58:29 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:58:30 - XML: Start document: iteration 12
Fri 17 Jan 2014 00:58:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43901728
Fri 17 Jan 2014 00:58:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:58:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:58:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:58:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:58:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:58:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:58:45 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:58:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:58:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:58:45 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:58:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:58:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:58:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:58:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:58:46 - XML: Processed 655574 elements - found 688 jobs
Fri 17 Jan 2014 00:58:46 - job 7347147 field 'start_timestamp' changed since saved from: 1389916672 to: 1389916587
Fri 17 Jan 2014 00:58:46 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 00:58:46 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 00:58:47 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 00:58:47 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:58:47 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:58:47 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:58:47 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:58:48 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:58:48 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:58:48 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 00:58:48 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 00:58:48 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 00:58:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:58:52 - size of cluster 'LISA Cluster': 624 hosts 79485 metrics 879793 values 13876018 bits 1734502 bytes 
Fri 17 Jan 2014 00:58:52 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:58:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:58:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:58:53 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:58:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 00:58:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:58:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:58:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:58:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:58:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:58:55 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:58:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43880068
Fri 17 Jan 2014 00:58:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:58:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43880068
Fri 17 Jan 2014 00:58:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:59:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:59:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:59:03 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:59:03 - job_xml_thread(): Done retrieving: data size 43880068
Fri 17 Jan 2014 00:59:03 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:59:03 - XML: Start document: iteration 13
Fri 17 Jan 2014 00:59:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:59:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:59:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:59:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:59:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:59:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:59:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:59:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:59:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:59:09 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:59:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:59:17 - XML: Processed 655574 elements - found 688 jobs
Fri 17 Jan 2014 00:59:17 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 00:59:17 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 00:59:17 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:59:17 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:59:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:59:17 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:59:18 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:59:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 00:59:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:59:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 00:59:18 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:59:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5640 values 88857 bits 11107 bytes 
Fri 17 Jan 2014 00:59:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:59:20 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:59:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:59:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:59:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:59:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:59:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:59:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:59:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:59:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:59:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:59:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43777155
Fri 17 Jan 2014 00:59:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:59:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43777155
Fri 17 Jan 2014 00:59:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:59:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 00:59:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 00:59:33 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:59:33 - job_xml_thread(): Done retrieving: data size 43777155
Fri 17 Jan 2014 00:59:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 00:59:33 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:59:33 - XML: Start document: iteration 14
Fri 17 Jan 2014 00:59:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:59:35 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:59:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 00:59:35 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 00:59:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 00:59:35 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 00:59:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:59:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:59:42 - XML: Processed 654828 elements - found 689 jobs
Fri 17 Jan 2014 00:59:42 - job 7346238 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 00:59:42 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 00:59:42 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 00:59:42 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 00:59:42 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 00:59:42 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 00:59:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 00:59:46 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 00:59:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 00:59:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 00:59:47 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 00:59:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 00:59:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 00:59:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:59:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 00:59:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 00:59:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 00:59:48 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 00:59:48 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 00:59:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 00:59:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 00:59:50 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 00:59:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43219420
Fri 17 Jan 2014 00:59:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 00:59:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43219420
Fri 17 Jan 2014 00:59:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 00:59:57 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 00:59:58 - job_xml_thread(): Done retrieving: data size 43219420
Fri 17 Jan 2014 00:59:58 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 00:59:58 - XML: Start document: iteration 15
Fri 17 Jan 2014 01:00:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:00:00 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:00:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:00:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:00:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:00:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:00:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:00:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:00:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:00:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:00:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:00:11 - XML: Processed 647860 elements - found 689 jobs
Fri 17 Jan 2014 01:00:11 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 01:00:11 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 01:00:11 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:00:11 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:00:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:00:13 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:00:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:00:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:00:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:00:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:00:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:00:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:00:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:00:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:00:16 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:00:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43203842
Fri 17 Jan 2014 01:00:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:00:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43203842
Fri 17 Jan 2014 01:00:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:00:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:00:19 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:00:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:00:19 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:00:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 01:00:19 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:00:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 01:00:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8846 values 139493 bits 17436 bytes 
Fri 17 Jan 2014 01:00:26 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:00:26 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:00:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:00:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:00:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:00:31 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:00:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:00:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:00:32 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:00:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:00:32 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:00:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:00:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:00:32 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:00:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:00:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:00:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:00:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:00:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:00:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:00:37 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:00:37 - job_xml_thread(): Done retrieving: data size 43700776
Fri 17 Jan 2014 01:00:37 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:00:37 - XML: Start document: iteration 16
Fri 17 Jan 2014 01:00:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43700776
Fri 17 Jan 2014 01:00:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:00:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43700776
Fri 17 Jan 2014 01:00:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:00:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:00:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:00:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:00:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:00:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:00:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:00:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:00:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:00:56 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:00:56 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:00:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:00:56 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:00:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:00:58 - XML: Processed 653740 elements - found 688 jobs
Fri 17 Jan 2014 01:00:58 - job 7347083 appears to have finished
Fri 17 Jan 2014 01:00:58 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 01:00:58 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 01:00:58 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 01:00:58 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:00:58 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:01:01 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:01:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 01:01:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:01:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:01:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:01:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:01:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:01:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:01:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:01:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:01:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:01:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:01:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853830
Fri 17 Jan 2014 01:01:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:01:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853830
Fri 17 Jan 2014 01:01:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:01:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:01:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:01:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:01:13 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:01:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:01:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:01:13 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:01:13 - job_xml_thread(): Done retrieving: data size 43853830
Fri 17 Jan 2014 01:01:13 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:01:13 - XML: Start document: iteration 17
Fri 17 Jan 2014 01:01:14 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:01:14 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:01:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:01:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:01:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853830
Fri 17 Jan 2014 01:01:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:01:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:01:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:01:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:01:20 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:01:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:01:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 01:01:21 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:01:22 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:01:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5735 values 90397 bits 11299 bytes 
Fri 17 Jan 2014 01:01:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 01:01:26 - XML: Processed 655542 elements - found 688 jobs
Fri 17 Jan 2014 01:01:26 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 01:01:26 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 01:01:26 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:01:26 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:01:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:01:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:01:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:01:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:01:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:01:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:01:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:01:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:01:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:01:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:01:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:01:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:01:33 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:01:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:01:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:01:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:01:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:01:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:01:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:01:38 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:01:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 01:01:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:01:38 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:01:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43877099
Fri 17 Jan 2014 01:01:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:01:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43877099
Fri 17 Jan 2014 01:01:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:01:41 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:01:41 - job_xml_thread(): Done retrieving: data size 43877099
Fri 17 Jan 2014 01:01:41 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:01:41 - XML: Start document: iteration 18
Fri 17 Jan 2014 01:01:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:01:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:01:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:01:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:01:56 - XML: Processed 655570 elements - found 686 jobs
Fri 17 Jan 2014 01:01:56 - job 7336755 appears to have finished
Fri 17 Jan 2014 01:01:56 - job 7347054 appears to have finished
Fri 17 Jan 2014 01:01:56 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 01:01:57 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 01:01:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:01:58 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:01:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:01:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:01:58 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 01:01:58 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:01:58 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:01:59 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:01:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:01:59 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:01:59 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:01:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:02:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:02:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:02:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:02:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:02:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:02:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:02:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:02:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:02:06 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 01:02:06 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 01:02:06 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:02:06 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:02:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43872929
Fri 17 Jan 2014 01:02:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:02:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43872929
Fri 17 Jan 2014 01:02:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:02:13 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:02:13 - job_xml_thread(): Done retrieving: data size 43872929
Fri 17 Jan 2014 01:02:13 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:02:13 - XML: Start document: iteration 19
Fri 17 Jan 2014 01:02:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:02:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:02:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:02:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:02:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:02:22 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:02:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:02:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 01:02:23 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:02:23 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:02:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 01:02:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99388 bits 12423 bytes 
Fri 17 Jan 2014 01:02:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:02:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:02:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:02:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:02:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:02:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:02:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:02:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:02:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:02:25 - XML: Processed 655570 elements - found 686 jobs
Fri 17 Jan 2014 01:02:25 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 01:02:26 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 01:02:26 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:02:26 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:02:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:02:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:02:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:02:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:02:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:02:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:02:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:02:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:02:31 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:02:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43903211
Fri 17 Jan 2014 01:02:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:02:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43903211
Fri 17 Jan 2014 01:02:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:02:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:02:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:02:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:02:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:02:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:02:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:02:41 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:02:41 - job_xml_thread(): Done retrieving: data size 43903211
Fri 17 Jan 2014 01:02:41 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:02:41 - XML: Start document: iteration 20
Fri 17 Jan 2014 01:02:42 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:02:42 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:02:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:02:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:02:42 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:02:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:02:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:02:52 - XML: Processed 655566 elements - found 684 jobs
Fri 17 Jan 2014 01:02:52 - job 7346087 appears to have finished
Fri 17 Jan 2014 01:02:52 - job 7347076 appears to have finished
Fri 17 Jan 2014 01:02:52 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 01:02:52 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 01:02:53 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:02:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 01:02:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:02:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:02:53 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:02:53 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 01:02:53 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:02:53 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:02:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:02:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:02:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:02:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:02:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:02:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:02:55 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:02:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865635
Fri 17 Jan 2014 01:02:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:02:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43865635
Fri 17 Jan 2014 01:02:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:02:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:02:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:03:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:03:07 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:03:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:03:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:03:08 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:03:08 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:03:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:03:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:03:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:03:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:03:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:03:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:03:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:03:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:03:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:03:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:03:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:03:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:03:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:03:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:03:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:03:12 - job_xml_thread(): Done retrieving: data size 43896339
Fri 17 Jan 2014 01:03:12 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:03:12 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 01:03:13 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 01:03:13 - Housekeeping: done.
Fri 17 Jan 2014 01:03:13 - XML: Start document: iteration 0
Fri 17 Jan 2014 01:03:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43896339
Fri 17 Jan 2014 01:03:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:03:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43896339
Fri 17 Jan 2014 01:03:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:03:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:03:23 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:03:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:03:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:03:25 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:03:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:03:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 01:03:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 01:03:25 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:03:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9229 values 145957 bits 18244 bytes 
Fri 17 Jan 2014 01:03:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:03:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:03:31 - XML: Processed 655564 elements - found 683 jobs
Fri 17 Jan 2014 01:03:31 - job 7342252 appears to have finished
Fri 17 Jan 2014 01:03:31 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 01:03:31 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 01:03:32 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 01:03:32 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:03:32 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:03:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:03:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:03:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:03:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:03:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:03:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:03:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:03:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:03:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:03:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:03:36 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:03:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:03:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:03:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:03:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:03:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:03:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:03:38 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:03:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43885071
Fri 17 Jan 2014 01:03:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:03:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43885071
Fri 17 Jan 2014 01:03:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:03:47 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:03:47 - job_xml_thread(): Done retrieving: data size 43885071
Fri 17 Jan 2014 01:03:47 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:03:47 - XML: Start document: iteration 1
Fri 17 Jan 2014 01:03:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:03:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:03:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:03:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:03:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:03:56 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:03:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:03:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:03:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:03:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:03:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:03:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:03:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:03:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:03:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:03:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:03:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:03:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:03:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:03:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:03:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:04:01 - XML: Processed 655564 elements - found 683 jobs
Fri 17 Jan 2014 01:04:01 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 01:04:01 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 01:04:01 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:04:01 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:04:01 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:04:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 01:04:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:04:03 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:04:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43879587
Fri 17 Jan 2014 01:04:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:04:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43879587
Fri 17 Jan 2014 01:04:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:04:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:04:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:04:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:04:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:04:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:04:14 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:04:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:04:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:04:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:04:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:04:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:04:15 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:04:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:04:16 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:04:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:04:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:04:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:04:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:04:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:04:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:04:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:04:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:04:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:04:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43887216
Fri 17 Jan 2014 01:04:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:04:18 - job_xml_thread(): Done retrieving: data size 43887216
Fri 17 Jan 2014 01:04:18 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:04:18 - XML: Start document: iteration 2
Fri 17 Jan 2014 01:04:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43887216
Fri 17 Jan 2014 01:04:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:04:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:04:28 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:04:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:04:29 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:04:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:04:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:04:30 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:04:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 01:04:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:04:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 01:04:30 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:04:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8864 values 140024 bits 17503 bytes 
Fri 17 Jan 2014 01:04:32 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:04:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:04:32 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:04:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:04:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:04:32 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:04:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:04:39 - XML: Processed 655564 elements - found 683 jobs
Fri 17 Jan 2014 01:04:39 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 01:04:39 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 01:04:39 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:04:39 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:04:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:04:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:04:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:04:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:04:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:04:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:04:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:04:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:04:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:04:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43877943
Fri 17 Jan 2014 01:04:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:04:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43877943
Fri 17 Jan 2014 01:04:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:04:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:04:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:04:54 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:04:54 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:04:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:04:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:04:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:04:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:04:56 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:04:56 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:04:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:04:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:04:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:04:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:04:58 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:04:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 01:04:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:04:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:04:59 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:04:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:04:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:05:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:05:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:05:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:05:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:05:01 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:05:01 - job_xml_thread(): Done retrieving: data size 43875712
Fri 17 Jan 2014 01:05:01 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:05:01 - XML: Start document: iteration 3
Fri 17 Jan 2014 01:05:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875712
Fri 17 Jan 2014 01:05:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:05:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875712
Fri 17 Jan 2014 01:05:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:05:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:05:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:05:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:05:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:05:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:05:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:05:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:05:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:05:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:05:24 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:05:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:05:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:05:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:05:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:05:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:05:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:05:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:05:25 - XML: Processed 655566 elements - found 684 jobs
Fri 17 Jan 2014 01:05:25 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 01:05:25 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 01:05:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:05:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:05:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:05:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:05:25 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 01:05:25 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:05:25 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:05:28 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:05:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43799848
Fri 17 Jan 2014 01:05:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:05:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43799848
Fri 17 Jan 2014 01:05:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:05:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:05:30 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:05:31 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:05:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 01:05:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:05:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 01:05:31 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:05:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9060 values 143015 bits 17876 bytes 
Fri 17 Jan 2014 01:05:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:05:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:05:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:05:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:05:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:05:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:05:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:05:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:05:40 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:05:40 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:05:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:05:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:05:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:05:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:05:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:05:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:05:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:05:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:05:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:05:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:05:46 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:05:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 01:05:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:05:46 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:05:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43271675
Fri 17 Jan 2014 01:05:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:05:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43271675
Fri 17 Jan 2014 01:05:47 - job_xml_thread(): Done retrieving: data size 43271675
Fri 17 Jan 2014 01:05:47 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:05:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:05:47 - XML: Start document: iteration 4
Fri 17 Jan 2014 01:05:48 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 01:05:48 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:05:50 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:05:50 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 01:05:50 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 01:05:50 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:05:50 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 01:05:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:05:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:05:58 - size of cluster 'LISA Cluster': 624 hosts 79469 metrics 853218 values 13477402 bits 1684675 bytes 
Fri 17 Jan 2014 01:05:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:05:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:06:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:06:01 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:06:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:06:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:06:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:06:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:06:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:06:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:06:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:06:08 - XML: Processed 648188 elements - found 685 jobs
Fri 17 Jan 2014 01:06:08 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 01:06:08 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 01:06:09 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 01:06:09 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:06:09 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:06:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:06:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:06:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:06:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:06:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:06:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:06:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:06:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:06:14 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:06:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43218330
Fri 17 Jan 2014 01:06:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:06:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43218330
Fri 17 Jan 2014 01:06:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:06:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:06:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:06:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:06:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:06:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:06:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:06:24 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:06:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:06:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:06:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:06:25 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:06:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:06:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:06:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:06:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:06:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:06:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:06:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:06:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:06:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:06:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:06:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:06:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:06:31 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:06:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:06:31 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:06:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 01:06:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 01:06:31 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:06:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99124 bits 12390 bytes 
Fri 17 Jan 2014 01:06:33 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:06:33 - job_xml_thread(): Done retrieving: data size 43584059
Fri 17 Jan 2014 01:06:33 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:06:33 - XML: Start document: iteration 5
Fri 17 Jan 2014 01:06:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584059
Fri 17 Jan 2014 01:06:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:06:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584059
Fri 17 Jan 2014 01:06:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:06:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:06:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:06:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:06:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:06:50 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:06:50 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 01:06:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:06:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:06:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:06:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:06:53 - XML: Processed 652018 elements - found 685 jobs
Fri 17 Jan 2014 01:06:53 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:06:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:06:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:06:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:06:53 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:06:53 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 01:06:53 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 01:06:53 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:06:53 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:06:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:06:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:06:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:06:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:06:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:06:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:06:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:06:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:07:00 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:07:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 01:07:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:07:01 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:07:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43864482
Fri 17 Jan 2014 01:07:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:07:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43864482
Fri 17 Jan 2014 01:07:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:07:08 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:07:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:07:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:07:08 - job_xml_thread(): Done retrieving: data size 43864482
Fri 17 Jan 2014 01:07:08 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:07:08 - XML: Start document: iteration 6
Fri 17 Jan 2014 01:07:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:07:09 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:07:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:07:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:07:11 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:07:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:07:11 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:07:11 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:07:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:07:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:07:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:07:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:07:23 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:07:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:07:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:07:23 - XML: Processed 655336 elements - found 685 jobs
Fri 17 Jan 2014 01:07:23 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 01:07:23 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 01:07:23 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:07:23 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:07:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:07:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:07:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:07:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:07:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:07:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:07:27 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:07:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853776
Fri 17 Jan 2014 01:07:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:07:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853776
Fri 17 Jan 2014 01:07:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:07:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:07:32 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:07:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:07:34 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:07:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 01:07:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 01:07:34 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:07:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7008 values 110574 bits 13821 bytes 
Fri 17 Jan 2014 01:07:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:07:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:07:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:07:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:07:38 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:07:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:07:39 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:07:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:07:39 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:07:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:07:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:07:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:07:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:07:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:07:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:07:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:07:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:07:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:07:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:07:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:07:46 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:07:46 - job_xml_thread(): Done retrieving: data size 43888117
Fri 17 Jan 2014 01:07:46 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:07:46 - XML: Start document: iteration 7
Fri 17 Jan 2014 01:07:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43888117
Fri 17 Jan 2014 01:07:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:07:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43888117
Fri 17 Jan 2014 01:07:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:07:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:07:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:07:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:07:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:08:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:08:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:08:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:08:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:08:10 - XML: Processed 655568 elements - found 685 jobs
Fri 17 Jan 2014 01:08:10 - job 7347120 appears to have finished
Fri 17 Jan 2014 01:08:10 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 01:08:10 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 01:08:11 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:08:11 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:08:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:08:11 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:08:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:08:11 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 01:08:11 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:08:11 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:08:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:08:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:08:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:08:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:08:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:08:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:08:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:08:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:08:12 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:08:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 01:08:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:08:16 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:08:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43900382
Fri 17 Jan 2014 01:08:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:08:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43900382
Fri 17 Jan 2014 01:08:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:08:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:08:25 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:08:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:08:26 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:08:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:08:26 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:08:26 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:08:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:08:26 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:08:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:08:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:08:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:08:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:08:31 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:08:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:08:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:08:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:08:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:08:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:08:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:08:34 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:08:34 - job_xml_thread(): Done retrieving: data size 43857723
Fri 17 Jan 2014 01:08:34 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:08:34 - XML: Start document: iteration 8
Fri 17 Jan 2014 01:08:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:08:34 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:08:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43857723
Fri 17 Jan 2014 01:08:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43857723
Fri 17 Jan 2014 01:08:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:08:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:08:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:08:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 01:08:36 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:08:36 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:08:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 01:08:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5799 values 91498 bits 11437 bytes 
Fri 17 Jan 2014 01:08:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:08:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:08:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:08:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:08:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:08:54 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:08:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:08:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:08:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:08:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:08:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:08:55 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:08:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:08:57 - XML: Processed 655564 elements - found 684 jobs
Fri 17 Jan 2014 01:08:57 - job 7347152 field 'start_timestamp' changed since saved from: 1389917208 to: 1389917207
Fri 17 Jan 2014 01:08:57 - job 7347119 appears to have finished
Fri 17 Jan 2014 01:08:57 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 01:08:57 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 01:08:57 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 01:08:57 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:08:57 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:08:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:08:57 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:08:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:08:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:08:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:08:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:08:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:08:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:09:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:09:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43895866
Fri 17 Jan 2014 01:09:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:09:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43895866
Fri 17 Jan 2014 01:09:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:09:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:09:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:09:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:09:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:09:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:09:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:09:12 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:09:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:09:12 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:09:12 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:09:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:09:12 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:09:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:09:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:09:13 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:09:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 01:09:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:09:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:09:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:09:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:09:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:09:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:09:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:09:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:09:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:09:21 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:09:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855260
Fri 17 Jan 2014 01:09:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:09:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855260
Fri 17 Jan 2014 01:09:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:09:21 - job_xml_thread(): Done retrieving: data size 43855260
Fri 17 Jan 2014 01:09:21 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:09:22 - XML: Start document: iteration 9
Fri 17 Jan 2014 01:09:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:09:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:09:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:09:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:09:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:09:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:09:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:09:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:09:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:09:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:09:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:09:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:09:34 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:09:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:09:37 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:09:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:09:37 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:09:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 01:09:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 01:09:37 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:09:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6007 values 94770 bits 11846 bytes 
Fri 17 Jan 2014 01:09:39 - XML: Processed 655566 elements - found 684 jobs
Fri 17 Jan 2014 01:09:39 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 01:09:39 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 01:09:39 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:09:39 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:09:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:09:44 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:09:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:09:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:09:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:09:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:09:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:09:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:09:48 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:09:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43860420
Fri 17 Jan 2014 01:09:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:09:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43860420
Fri 17 Jan 2014 01:09:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:09:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:09:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:09:54 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:09:54 - job_xml_thread(): Done retrieving: data size 43860420
Fri 17 Jan 2014 01:09:54 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:09:54 - XML: Start document: iteration 10
Fri 17 Jan 2014 01:09:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:09:58 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:09:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:09:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:09:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:09:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:09:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:09:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:09:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:10:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:10:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:10:09 - XML: Processed 655564 elements - found 684 jobs
Fri 17 Jan 2014 01:10:09 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 01:10:09 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 01:10:09 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:10:09 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:10:10 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:10:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 01:10:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:10:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:10:13 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:10:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:10:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:10:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:10:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:10:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:10:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:10:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:10:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:10:16 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:10:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858132
Fri 17 Jan 2014 01:10:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:10:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43858132
Fri 17 Jan 2014 01:10:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:10:23 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 01:10:23 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 01:10:23 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:10:24 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:10:24 - job_xml_thread(): Done retrieving: data size 43858132
Fri 17 Jan 2014 01:10:24 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:10:24 - XML: Start document: iteration 11
Fri 17 Jan 2014 01:10:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:10:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:10:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:10:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:10:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:10:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:10:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:10:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:10:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:10:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:10:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:10:35 - XML: Processed 655566 elements - found 684 jobs
Fri 17 Jan 2014 01:10:35 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 01:10:35 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 01:10:35 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:10:35 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:10:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:10:37 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:10:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:10:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:10:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:10:37 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:10:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:10:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 01:10:37 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:10:37 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:10:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 01:10:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5894 values 93019 bits 11627 bytes 
Fri 17 Jan 2014 01:10:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:10:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:10:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:10:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:10:40 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:10:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43864240
Fri 17 Jan 2014 01:10:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:10:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43864240
Fri 17 Jan 2014 01:10:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:10:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:10:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:10:50 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:10:50 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:10:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:10:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:10:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:10:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:10:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:10:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:10:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:10:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:10:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:10:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:10:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:10:55 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:10:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:10:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:10:55 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:10:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 01:10:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:10:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:10:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:10:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:10:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:10:57 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:10:57 - job_xml_thread(): Done retrieving: data size 43890142
Fri 17 Jan 2014 01:10:57 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:10:57 - XML: Start document: iteration 12
Fri 17 Jan 2014 01:10:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43890142
Fri 17 Jan 2014 01:10:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:10:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43890142
Fri 17 Jan 2014 01:10:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:11:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:11:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:11:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:11:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:11:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:11:13 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:11:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:11:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:11:14 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:11:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:11:14 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:11:14 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:11:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:11:15 - XML: Processed 655576 elements - found 689 jobs
Fri 17 Jan 2014 01:11:15 - job_xml_thread(): Found 5 updated jobs.
Fri 17 Jan 2014 01:11:15 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 01:11:15 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Fri 17 Jan 2014 01:11:15 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:11:15 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:11:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:11:19 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:11:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:11:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:11:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:11:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:11:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:11:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:11:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:11:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43796143
Fri 17 Jan 2014 01:11:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:11:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43796143
Fri 17 Jan 2014 01:11:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:11:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:11:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:11:30 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:11:31 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:11:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:11:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:11:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:11:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:11:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:11:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:11:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:11:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:11:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:11:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:11:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:11:35 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:11:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:11:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:11:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:11:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:11:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:11:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:11:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:11:36 - job_xml_thread(): Done retrieving: data size 43300273
Fri 17 Jan 2014 01:11:36 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:11:36 - XML: Start document: iteration 13
Fri 17 Jan 2014 01:11:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43300273
Fri 17 Jan 2014 01:11:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:11:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43300273
Fri 17 Jan 2014 01:11:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:11:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:11:37 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:11:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:11:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 01:11:41 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:11:41 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:11:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 11886 values 187511 bits 23438 bytes 
Fri 17 Jan 2014 01:11:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 01:11:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:11:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:11:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:11:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:11:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:11:54 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:11:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:11:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:11:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:11:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:11:55 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:11:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:11:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:11:56 - XML: Processed 648540 elements - found 688 jobs
Fri 17 Jan 2014 01:11:56 - job 7347150 appears to have finished
Fri 17 Jan 2014 01:11:56 - job 7347156 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 01:11:56 - job 7347157 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 01:11:56 - job 7347154 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 01:11:56 - job 7347155 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 01:11:56 - job_xml_thread(): Found 5 updated jobs.
Fri 17 Jan 2014 01:11:56 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 01:11:58 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Fri 17 Jan 2014 01:11:58 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:11:58 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:12:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:12:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:12:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:12:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:12:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:12:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:12:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:12:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:12:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:12:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43220672
Fri 17 Jan 2014 01:12:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:12:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43220672
Fri 17 Jan 2014 01:12:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:12:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:12:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:12:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:12:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:12:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:12:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:12:12 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:12:12 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:12:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:12:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:12:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43220672
Fri 17 Jan 2014 01:12:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:12:13 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:12:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:12:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:12:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:12:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:12:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:12:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:12:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:12:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:12:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:12:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:12:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:12:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:12:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:12:23 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:12:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 01:12:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:12:24 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:12:24 - job_xml_thread(): Done retrieving: data size 43271135
Fri 17 Jan 2014 01:12:24 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:12:24 - XML: Start document: iteration 14
Fri 17 Jan 2014 01:12:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43271135
Fri 17 Jan 2014 01:12:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:12:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:12:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:12:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:12:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:12:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:12:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:12:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43271135
Fri 17 Jan 2014 01:12:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:12:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:12:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:12:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:12:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:12:42 - XML: Processed 648122 elements - found 688 jobs
Fri 17 Jan 2014 01:12:42 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 01:12:42 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 01:12:42 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:12:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:12:42 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:12:42 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:12:43 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:12:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 01:12:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:12:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 01:12:43 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:12:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5759 values 90847 bits 11355 bytes 
Fri 17 Jan 2014 01:12:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:12:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:12:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:12:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:12:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:12:44 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:12:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:12:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:12:45 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:12:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:12:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:12:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:12:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:12:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:12:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:12:48 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:12:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43810095
Fri 17 Jan 2014 01:12:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:12:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43810095
Fri 17 Jan 2014 01:12:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:12:51 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 01:12:52 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:12:53 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:12:53 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 01:12:53 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 01:12:53 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:12:53 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 01:12:57 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:12:57 - job_xml_thread(): Done retrieving: data size 43810095
Fri 17 Jan 2014 01:12:57 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:12:57 - XML: Start document: iteration 15
Fri 17 Jan 2014 01:12:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:12:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:13:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:13:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:13:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:13:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:13:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:13:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:13:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:13:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:13:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:13:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:13:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:13:08 - XML: Processed 654744 elements - found 689 jobs
Fri 17 Jan 2014 01:13:09 - job 7347157 field 'start_timestamp' changed since saved from: 1389917457 to: 1389917398
Fri 17 Jan 2014 01:13:09 - job 7347155 field 'start_timestamp' changed since saved from: 1389917453 to: 1389917398
Fri 17 Jan 2014 01:13:09 - job 7346246 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 01:13:09 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 01:13:09 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 01:13:09 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:13:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 01:13:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:13:10 - size of cluster 'LISA Cluster': 624 hosts 79474 metrics 782584 values 12343770 bits 1542971 bytes 
Fri 17 Jan 2014 01:13:10 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 01:13:10 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:13:10 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:13:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:13:13 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:13:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:13:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:13:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:13:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:13:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:13:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:13:16 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:13:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43859618
Fri 17 Jan 2014 01:13:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:13:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43859618
Fri 17 Jan 2014 01:13:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:13:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:13:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:13:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:13:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:13:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:13:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:13:25 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:13:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:13:25 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:13:25 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:13:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:13:25 - job_xml_thread(): Done retrieving: data size 43859618
Fri 17 Jan 2014 01:13:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43859618
Fri 17 Jan 2014 01:13:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:13:26 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:13:26 - XML: Start document: iteration 16
Fri 17 Jan 2014 01:13:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:13:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:13:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:13:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:13:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:13:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:13:42 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:13:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:13:42 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:13:42 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:13:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:13:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:13:43 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:13:44 - XML: Processed 655576 elements - found 689 jobs
Fri 17 Jan 2014 01:13:44 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 01:13:44 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 01:13:44 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:13:44 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:13:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:13:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 01:13:44 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:13:44 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:13:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6109 values 96393 bits 12049 bytes 
Fri 17 Jan 2014 01:13:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 01:13:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:13:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:13:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:13:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:13:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:13:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:13:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:13:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:13:50 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:13:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862219
Fri 17 Jan 2014 01:13:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:13:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862219
Fri 17 Jan 2014 01:13:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:13:53 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:13:53 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 01:13:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:13:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:13:59 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:13:59 - job_xml_thread(): Done retrieving: data size 43862219
Fri 17 Jan 2014 01:13:59 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:13:59 - XML: Start document: iteration 17
Fri 17 Jan 2014 01:14:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:14:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:14:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:14:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:14:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:14:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:14:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:14:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:14:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:14:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:14:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:14:12 - XML: Processed 655568 elements - found 685 jobs
Fri 17 Jan 2014 01:14:12 - job 7347094 appears to have finished
Fri 17 Jan 2014 01:14:12 - job 7347129 appears to have finished
Fri 17 Jan 2014 01:14:12 - job 7347124 appears to have finished
Fri 17 Jan 2014 01:14:12 - job 7347130 appears to have finished
Fri 17 Jan 2014 01:14:12 - job 7347132 appears to have finished
Fri 17 Jan 2014 01:14:12 - job_xml_thread(): Found 6 updated jobs.
Fri 17 Jan 2014 01:14:12 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 01:14:13 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Fri 17 Jan 2014 01:14:13 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:14:13 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:14:13 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:14:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 01:14:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:14:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:14:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:14:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:14:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:14:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:14:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:14:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:14:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:14:17 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:14:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43863992
Fri 17 Jan 2014 01:14:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:14:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43863992
Fri 17 Jan 2014 01:14:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:14:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:14:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:14:28 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:14:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:14:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:14:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:14:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:14:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:14:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:14:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:14:30 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:14:30 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:14:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:14:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:14:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:14:33 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:14:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:14:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:14:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:14:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:14:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:14:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:14:37 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:14:37 - job_xml_thread(): Done retrieving: data size 43857726
Fri 17 Jan 2014 01:14:37 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:14:37 - XML: Start document: iteration 18
Fri 17 Jan 2014 01:14:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43857726
Fri 17 Jan 2014 01:14:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:14:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43857726
Fri 17 Jan 2014 01:14:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:14:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:14:45 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:14:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:14:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:14:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:14:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 01:14:47 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:14:47 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:14:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 01:14:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8856 values 139650 bits 17456 bytes 
Fri 17 Jan 2014 01:14:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:14:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:14:51 - XML: Processed 655568 elements - found 685 jobs
Fri 17 Jan 2014 01:14:51 - job 7345028 appears to have finished
Fri 17 Jan 2014 01:14:51 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 01:14:51 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 01:14:52 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 01:14:52 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:14:52 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:14:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:14:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:14:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:14:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:14:56 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:14:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:14:56 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:14:56 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:14:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:14:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:14:59 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:15:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:15:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:15:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:15:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:15:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:15:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:15:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:15:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855830
Fri 17 Jan 2014 01:15:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:15:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855830
Fri 17 Jan 2014 01:15:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:15:07 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:15:07 - job_xml_thread(): Done retrieving: data size 43855830
Fri 17 Jan 2014 01:15:07 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:15:07 - XML: Start document: iteration 19
Fri 17 Jan 2014 01:15:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:15:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:15:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:15:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:15:20 - XML: Processed 655568 elements - found 685 jobs
Fri 17 Jan 2014 01:15:20 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 01:15:20 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 01:15:20 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:15:20 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:15:21 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:15:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 01:15:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:15:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:15:25 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:15:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:15:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:15:26 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:15:26 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:15:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:15:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:15:26 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:15:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:15:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:15:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:15:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:15:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:15:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:15:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:15:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:15:31 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:15:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43885322
Fri 17 Jan 2014 01:15:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:15:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43885322
Fri 17 Jan 2014 01:15:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:15:35 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:15:35 - job_xml_thread(): Done retrieving: data size 43885322
Fri 17 Jan 2014 01:15:35 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:15:35 - XML: Start document: iteration 20
Fri 17 Jan 2014 01:15:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:15:38 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:15:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:15:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:15:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:15:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:15:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:15:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:15:43 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:15:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:15:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:15:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:15:48 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:15:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:15:48 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:15:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 01:15:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 01:15:48 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:15:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6110 values 96426 bits 12053 bytes 
Fri 17 Jan 2014 01:15:49 - XML: Processed 655566 elements - found 684 jobs
Fri 17 Jan 2014 01:15:49 - job 7347122 appears to have finished
Fri 17 Jan 2014 01:15:49 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 01:15:49 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 01:15:49 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 01:15:49 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:15:49 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:15:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:15:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:15:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:15:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:15:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:15:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:15:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:15:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:15:54 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:15:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43868834
Fri 17 Jan 2014 01:15:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:15:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43868834
Fri 17 Jan 2014 01:15:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:15:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:15:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:16:04 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:16:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:16:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:16:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:16:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:16:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:16:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:16:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:16:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:16:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:16:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:16:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:16:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:16:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:16:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:16:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:16:12 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:16:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 01:16:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:16:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:16:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:16:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:16:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:16:15 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:16:15 - job_xml_thread(): Done retrieving: data size 43878514
Fri 17 Jan 2014 01:16:15 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:16:15 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 01:16:15 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 01:16:15 - Housekeeping: done.
Fri 17 Jan 2014 01:16:15 - XML: Start document: iteration 0
Fri 17 Jan 2014 01:16:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43878514
Fri 17 Jan 2014 01:16:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:16:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43878514
Fri 17 Jan 2014 01:16:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:16:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:16:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:16:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:16:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:16:36 - XML: Processed 655566 elements - found 684 jobs
Fri 17 Jan 2014 01:16:37 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 01:16:37 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 01:16:37 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:16:37 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:16:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:16:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:16:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:16:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:16:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:16:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:16:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:16:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:16:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:16:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:16:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:16:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:16:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:16:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:16:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:16:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:16:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:16:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:16:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43911390
Fri 17 Jan 2014 01:16:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:16:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43911390
Fri 17 Jan 2014 01:16:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:16:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:16:48 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:16:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:16:50 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:16:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 01:16:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 01:16:50 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:16:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9095 values 143728 bits 17966 bytes 
Fri 17 Jan 2014 01:16:52 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:16:52 - job_xml_thread(): Done retrieving: data size 43911390
Fri 17 Jan 2014 01:16:52 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:16:52 - XML: Start document: iteration 1
Fri 17 Jan 2014 01:16:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:16:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:16:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:16:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:16:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:16:56 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:16:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:16:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:16:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:16:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:16:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:16:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:16:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:17:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:17:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:17:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:17:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:17:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:17:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:17:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:17:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:17:05 - XML: Processed 655564 elements - found 683 jobs
Fri 17 Jan 2014 01:17:05 - job 7347090 appears to have finished
Fri 17 Jan 2014 01:17:05 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 01:17:05 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 01:17:05 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 01:17:05 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:17:05 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:17:09 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:17:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865539
Fri 17 Jan 2014 01:17:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:17:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43865539
Fri 17 Jan 2014 01:17:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:17:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:17:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:17:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:17:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:17:20 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:17:20 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:17:23 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:17:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 01:17:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:17:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:17:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:17:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:17:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:17:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:17:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:17:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:17:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:17:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:17:25 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:17:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:17:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:17:25 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 01:17:25 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 01:17:25 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:17:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:17:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:17:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:17:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:17:27 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:17:27 - job_xml_thread(): Done retrieving: data size 43828607
Fri 17 Jan 2014 01:17:27 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:17:27 - XML: Start document: iteration 2
Fri 17 Jan 2014 01:17:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43828607
Fri 17 Jan 2014 01:17:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:17:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43828607
Fri 17 Jan 2014 01:17:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:17:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:17:38 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:17:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:17:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:17:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:17:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:17:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:17:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:17:40 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:17:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:17:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:17:48 - XML: Processed 654814 elements - found 682 jobs
Fri 17 Jan 2014 01:17:48 - job 7347127 appears to have finished
Fri 17 Jan 2014 01:17:48 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 01:17:48 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 01:17:49 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 01:17:49 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:17:49 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:17:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:17:50 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:17:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:17:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:17:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:17:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:17:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:17:51 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:17:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 01:17:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 01:17:51 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:17:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5926 values 93854 bits 11731 bytes 
Fri 17 Jan 2014 01:17:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:17:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:17:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:17:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:17:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:17:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43256699
Fri 17 Jan 2014 01:17:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:17:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43256699
Fri 17 Jan 2014 01:17:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:17:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:17:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:18:04 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:18:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:18:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:18:06 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:18:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:18:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:18:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:18:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:18:07 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:18:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:18:07 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:18:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:18:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:18:08 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:18:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:18:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:18:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:18:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:18:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:18:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:18:09 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:18:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 01:18:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:18:10 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:18:10 - job_xml_thread(): Done retrieving: data size 43230169
Fri 17 Jan 2014 01:18:10 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:18:10 - XML: Start document: iteration 3
Fri 17 Jan 2014 01:18:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43230169
Fri 17 Jan 2014 01:18:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43230169
Fri 17 Jan 2014 01:18:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:18:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:18:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:18:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:18:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:18:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:18:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:18:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:18:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:18:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:18:25 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:18:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:18:26 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:18:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:18:26 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:18:30 - XML: Processed 647362 elements - found 682 jobs
Fri 17 Jan 2014 01:18:30 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 01:18:30 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 01:18:31 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:18:31 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:18:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:18:33 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:18:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:18:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:18:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:18:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:18:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:18:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:18:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:18:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43692593
Fri 17 Jan 2014 01:18:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:18:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43692593
Fri 17 Jan 2014 01:18:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:18:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:18:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:18:47 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:18:47 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:18:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:18:48 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:18:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:18:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:18:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:18:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:18:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:18:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:18:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:18:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:18:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:18:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:18:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:18:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:18:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:18:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:18:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:18:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:18:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:18:51 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:18:51 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:18:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:18:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 01:18:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 01:18:51 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:18:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7979 values 126104 bits 15763 bytes 
Fri 17 Jan 2014 01:18:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:18:52 - job_xml_thread(): Done retrieving: data size 43843494
Fri 17 Jan 2014 01:18:52 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:18:52 - XML: Start document: iteration 4
Fri 17 Jan 2014 01:18:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43843494
Fri 17 Jan 2014 01:18:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:18:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43843494
Fri 17 Jan 2014 01:18:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:19:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:19:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:19:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:19:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:19:07 - XML: Processed 655090 elements - found 682 jobs
Fri 17 Jan 2014 01:19:07 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 01:19:07 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 01:19:07 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:19:07 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:19:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:19:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:19:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:19:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:19:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:19:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:19:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:19:10 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:19:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:19:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:19:15 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:19:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:19:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:19:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:19:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:19:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:19:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:19:16 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:19:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 01:19:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:19:17 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:19:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43859482
Fri 17 Jan 2014 01:19:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:19:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43859482
Fri 17 Jan 2014 01:19:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:19:23 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:19:24 - job_xml_thread(): Done retrieving: data size 43859482
Fri 17 Jan 2014 01:19:24 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:19:25 - XML: Start document: iteration 5
Fri 17 Jan 2014 01:19:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:19:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:19:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:19:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:19:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:19:34 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:19:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:19:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:19:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:19:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:19:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:19:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:19:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:19:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:19:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:19:39 - XML: Processed 655562 elements - found 682 jobs
Fri 17 Jan 2014 01:19:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:19:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:19:39 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 01:19:39 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 01:19:39 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:19:39 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:19:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:19:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:19:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:19:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:19:42 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:19:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43893353
Fri 17 Jan 2014 01:19:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:19:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43893353
Fri 17 Jan 2014 01:19:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:19:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:19:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:19:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:19:51 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:19:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:19:52 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:19:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 01:19:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:19:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 01:19:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:19:52 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:19:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:19:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:19:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7861 values 124055 bits 15506 bytes 
Fri 17 Jan 2014 01:19:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:19:53 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:19:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:19:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:19:53 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:19:53 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 01:19:53 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:19:54 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:19:54 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:19:54 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 01:19:54 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 01:19:54 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 01:19:54 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:19:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:19:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:19:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:19:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:19:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:19:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:19:58 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 796498 values 12583953 bits 1572994 bytes 
Fri 17 Jan 2014 01:19:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:19:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:19:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:19:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:20:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:20:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851736
Fri 17 Jan 2014 01:20:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:20:02 - job_xml_thread(): Done retrieving: data size 43851736
Fri 17 Jan 2014 01:20:02 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:20:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851736
Fri 17 Jan 2014 01:20:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:20:03 - XML: Start document: iteration 6
Fri 17 Jan 2014 01:20:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:20:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:20:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:20:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:20:21 - XML: Processed 655564 elements - found 683 jobs
Fri 17 Jan 2014 01:20:21 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 01:20:21 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 01:20:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:20:21 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:20:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:20:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:20:21 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 01:20:21 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:20:21 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:20:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:20:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:20:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:20:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:20:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:20:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:20:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:20:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:20:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:20:29 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:20:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 01:20:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:20:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:20:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:20:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:20:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:20:31 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:20:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862204
Fri 17 Jan 2014 01:20:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862204
Fri 17 Jan 2014 01:20:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:20:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:20:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:20:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:20:37 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:20:37 - job_xml_thread(): Done retrieving: data size 43862204
Fri 17 Jan 2014 01:20:37 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:20:37 - XML: Start document: iteration 7
Fri 17 Jan 2014 01:20:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:20:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:20:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:20:45 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:20:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:20:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:20:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:20:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:20:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:20:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:20:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:20:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:20:52 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:20:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:20:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 01:20:52 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:20:52 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:20:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 01:20:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5722 values 90263 bits 11282 bytes 
Fri 17 Jan 2014 01:20:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:20:53 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:20:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:20:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:20:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:20:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:20:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:20:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:20:54 - XML: Processed 655564 elements - found 683 jobs
Fri 17 Jan 2014 01:20:54 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 01:20:54 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 01:20:54 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:20:54 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:20:54 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:20:54 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 01:20:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:20:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873542
Fri 17 Jan 2014 01:20:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:20:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873542
Fri 17 Jan 2014 01:20:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:21:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:21:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:21:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:21:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:21:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:21:09 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:21:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:21:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:21:09 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:21:09 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:21:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:21:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:21:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:21:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:21:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:21:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:21:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:21:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:21:14 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:21:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 01:21:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:21:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:21:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:21:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:21:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:21:17 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:21:17 - job_xml_thread(): Done retrieving: data size 43870370
Fri 17 Jan 2014 01:21:17 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:21:17 - XML: Start document: iteration 8
Fri 17 Jan 2014 01:21:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870370
Fri 17 Jan 2014 01:21:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870370
Fri 17 Jan 2014 01:21:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:21:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:21:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:21:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:21:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:21:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:21:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:21:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:21:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:21:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:21:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:21:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:21:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:21:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:21:34 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:21:36 - XML: Processed 655564 elements - found 683 jobs
Fri 17 Jan 2014 01:21:36 - job 7347161 field 'start_timestamp' changed since saved from: 1389917960 to: 1389917910
Fri 17 Jan 2014 01:21:36 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 01:21:36 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 01:21:36 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 01:21:36 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:21:36 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:21:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:21:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:21:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:21:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:21:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:21:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:21:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:21:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:21:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:21:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43878594
Fri 17 Jan 2014 01:21:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:21:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43878594
Fri 17 Jan 2014 01:21:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:21:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:21:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:21:51 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:21:51 - job_xml_thread(): Done retrieving: data size 43878594
Fri 17 Jan 2014 01:21:51 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:21:51 - XML: Start document: iteration 9
Fri 17 Jan 2014 01:21:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:21:54 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:21:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:21:56 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:21:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 01:21:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 01:21:56 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:21:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8988 values 141823 bits 17727 bytes 
Fri 17 Jan 2014 01:21:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:21:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:21:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:21:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:21:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:21:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:22:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:22:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:22:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:22:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:22:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:22:05 - XML: Processed 655564 elements - found 683 jobs
Fri 17 Jan 2014 01:22:05 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 01:22:05 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 01:22:05 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:22:05 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:22:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:22:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:22:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:22:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:22:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:22:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:22:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:22:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:22:10 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:22:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43878603
Fri 17 Jan 2014 01:22:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:22:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43878603
Fri 17 Jan 2014 01:22:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:22:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:22:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:22:20 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:22:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:22:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:22:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:22:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:22:25 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:22:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:22:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:22:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:22:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:22:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:22:27 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:22:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:22:27 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:22:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:22:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:22:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:22:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:22:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:22:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:22:27 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:22:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 01:22:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:22:30 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:22:30 - job_xml_thread(): Done retrieving: data size 43888967
Fri 17 Jan 2014 01:22:30 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:22:30 - XML: Start document: iteration 10
Fri 17 Jan 2014 01:22:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43888967
Fri 17 Jan 2014 01:22:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:22:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43888967
Fri 17 Jan 2014 01:22:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:22:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:22:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:22:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:22:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:22:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:22:48 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:22:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:22:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:22:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:22:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:22:51 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:22:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:22:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:22:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:22:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:22:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:22:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:22:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:22:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:22:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:22:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:22:53 - XML: Processed 655555 elements - found 683 jobs
Fri 17 Jan 2014 01:22:53 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 01:22:53 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 01:22:53 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:22:53 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:22:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:22:56 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:22:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:22:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 01:22:57 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:22:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5802 values 91570 bits 11446 bytes 
Fri 17 Jan 2014 01:22:57 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:22:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 01:22:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:22:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43898886
Fri 17 Jan 2014 01:22:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:22:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43898886
Fri 17 Jan 2014 01:22:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:23:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:23:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:23:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:23:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:23:09 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:23:09 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:23:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:23:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:23:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:23:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:23:12 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:23:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:23:12 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:23:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:23:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:23:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:23:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:23:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:23:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:23:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:23:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:23:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:23:19 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:23:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 01:23:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:23:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:23:19 - job_xml_thread(): Done retrieving: data size 43790654
Fri 17 Jan 2014 01:23:19 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:23:19 - XML: Start document: iteration 11
Fri 17 Jan 2014 01:23:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43790654
Fri 17 Jan 2014 01:23:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:23:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43790654
Fri 17 Jan 2014 01:23:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:23:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:23:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:23:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:23:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:23:33 - XML: Processed 654814 elements - found 682 jobs
Fri 17 Jan 2014 01:23:33 - job 7347121 appears to have finished
Fri 17 Jan 2014 01:23:33 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 01:23:33 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 01:23:34 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 01:23:34 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:23:35 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:23:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:23:41 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:23:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:23:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:23:42 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:23:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:23:43 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:23:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:23:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:23:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:23:44 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:23:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:23:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:23:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:23:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:23:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:23:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:23:47 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:23:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43260946
Fri 17 Jan 2014 01:23:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:23:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43260946
Fri 17 Jan 2014 01:23:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:23:50 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:23:50 - job_xml_thread(): Done retrieving: data size 43260946
Fri 17 Jan 2014 01:23:50 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:23:51 - XML: Start document: iteration 12
Fri 17 Jan 2014 01:23:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:23:57 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:23:58 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:23:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 01:23:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:23:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 01:23:58 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:23:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:23:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:23:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6793 values 107159 bits 13394 bytes 
Fri 17 Jan 2014 01:23:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:23:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:24:03 - XML: Processed 647866 elements - found 682 jobs
Fri 17 Jan 2014 01:24:03 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 01:24:03 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 01:24:03 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:24:03 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:24:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:24:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:24:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:24:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:24:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:24:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:24:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:24:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:24:05 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:24:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:24:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:24:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:24:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:24:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:24:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:24:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:24:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:24:13 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 01:24:13 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 01:24:13 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:24:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:24:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43225512
Fri 17 Jan 2014 01:24:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:24:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43225512
Fri 17 Jan 2014 01:24:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:24:18 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:24:18 - job_xml_thread(): Done retrieving: data size 43225512
Fri 17 Jan 2014 01:24:18 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:24:18 - XML: Start document: iteration 13
Fri 17 Jan 2014 01:24:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:24:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:24:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:24:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:24:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:24:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:24:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:24:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:24:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:24:27 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:24:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:24:27 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:24:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:24:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:24:34 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:24:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:24:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:24:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:24:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:24:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:24:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:24:36 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:24:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 01:24:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:24:36 - XML: Processed 647368 elements - found 682 jobs
Fri 17 Jan 2014 01:24:36 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 01:24:36 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 01:24:36 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:24:36 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:24:38 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:24:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43682450
Fri 17 Jan 2014 01:24:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:24:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43682450
Fri 17 Jan 2014 01:24:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:24:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:24:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:24:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:24:50 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:24:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:24:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:24:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:24:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:24:51 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:24:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:24:51 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:24:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:24:51 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:24:51 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:24:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:24:52 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:24:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:24:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:24:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:24:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:24:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:24:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:24:56 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:24:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43848004
Fri 17 Jan 2014 01:24:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:24:57 - job_xml_thread(): Done retrieving: data size 43848004
Fri 17 Jan 2014 01:24:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43848004
Fri 17 Jan 2014 01:24:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:24:57 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:24:57 - XML: Start document: iteration 14
Fri 17 Jan 2014 01:24:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:24:58 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:24:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:24:59 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:24:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 01:24:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 01:24:59 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:25:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8981 values 141687 bits 17710 bytes 
Fri 17 Jan 2014 01:25:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:25:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:25:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:25:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:25:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:25:16 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:25:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:25:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:25:17 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:25:17 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:25:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:25:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:25:17 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:25:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:25:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:25:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:25:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:25:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:25:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:25:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:25:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:25:19 - XML: Processed 654994 elements - found 683 jobs
Fri 17 Jan 2014 01:25:19 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 01:25:19 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 01:25:19 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 01:25:19 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:25:19 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:25:21 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:25:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43868406
Fri 17 Jan 2014 01:25:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:25:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43868406
Fri 17 Jan 2014 01:25:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:25:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:25:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:25:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:25:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:25:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:25:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:25:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:25:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:25:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:25:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:25:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:25:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:25:34 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:25:34 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:25:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:25:37 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:25:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:25:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:25:37 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:25:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 01:25:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:25:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:25:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:25:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:25:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:25:39 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:25:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875889
Fri 17 Jan 2014 01:25:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:25:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875889
Fri 17 Jan 2014 01:25:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:25:40 - job_xml_thread(): Done retrieving: data size 43875889
Fri 17 Jan 2014 01:25:41 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:25:41 - XML: Start document: iteration 15
Fri 17 Jan 2014 01:25:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:25:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:25:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:25:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:25:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:25:53 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:25:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:25:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:25:54 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:25:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:25:54 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:25:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:25:54 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:25:59 - XML: Processed 655566 elements - found 684 jobs
Fri 17 Jan 2014 01:25:59 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 01:25:59 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 01:26:00 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 01:26:00 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:26:00 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:26:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:26:00 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:26:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:26:01 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:26:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 01:26:01 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:26:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 01:26:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5623 values 88670 bits 11083 bytes 
Fri 17 Jan 2014 01:26:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:26:01 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:26:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:26:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:26:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:26:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:26:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:26:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:26:04 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:26:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43847380
Fri 17 Jan 2014 01:26:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:26:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43847380
Fri 17 Jan 2014 01:26:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:26:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:26:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:26:15 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:26:15 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:26:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:26:16 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:26:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:26:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:26:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:26:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:26:17 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:26:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:26:17 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:26:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:26:18 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:26:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 01:26:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:26:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:26:19 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:26:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:26:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:26:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:26:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:26:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:26:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:26:21 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:26:22 - job_xml_thread(): Done retrieving: data size 43868330
Fri 17 Jan 2014 01:26:22 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:26:22 - XML: Start document: iteration 16
Fri 17 Jan 2014 01:26:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43868330
Fri 17 Jan 2014 01:26:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:26:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43868330
Fri 17 Jan 2014 01:26:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:26:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:26:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:26:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:26:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:26:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:26:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:26:35 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:26:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:26:35 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:26:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:26:35 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:26:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:26:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:26:41 - XML: Processed 655566 elements - found 684 jobs
Fri 17 Jan 2014 01:26:41 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 01:26:41 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 01:26:41 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:26:41 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:26:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:26:44 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:26:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:26:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:26:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:26:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:26:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:26:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:26:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:26:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43880422
Fri 17 Jan 2014 01:26:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:26:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43880422
Fri 17 Jan 2014 01:26:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:26:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:26:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:26:55 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 01:26:55 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:26:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:26:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:26:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:26:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:26:56 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:26:56 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:26:56 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:26:56 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 01:26:56 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:26:56 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:26:56 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:26:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:26:56 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 01:26:56 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 01:26:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:26:59 - size of cluster 'LISA Cluster': 624 hosts 79482 metrics 810031 values 12772522 bits 1596565 bytes 
Fri 17 Jan 2014 01:27:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:27:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:27:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:27:01 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:27:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:27:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:27:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:27:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:27:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:27:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:27:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:27:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:27:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:27:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 01:27:02 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:27:02 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:27:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 01:27:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9173 values 144768 bits 18096 bytes 
Fri 17 Jan 2014 01:27:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:27:05 - job_xml_thread(): Done retrieving: data size 43858095
Fri 17 Jan 2014 01:27:05 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:27:05 - XML: Start document: iteration 17
Fri 17 Jan 2014 01:27:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43858095
Fri 17 Jan 2014 01:27:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:27:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858095
Fri 17 Jan 2014 01:27:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:27:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:27:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:27:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:27:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:27:21 - XML: Processed 655566 elements - found 684 jobs
Fri 17 Jan 2014 01:27:21 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 01:27:21 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 01:27:21 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:27:21 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:27:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:27:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:27:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:27:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:27:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:27:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:27:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:27:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:27:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:27:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:27:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:27:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:27:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:27:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:27:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:27:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:27:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:27:31 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:27:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 01:27:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:27:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:27:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43884014
Fri 17 Jan 2014 01:27:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:27:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43884014
Fri 17 Jan 2014 01:27:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:27:36 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:27:36 - job_xml_thread(): Done retrieving: data size 43884014
Fri 17 Jan 2014 01:27:36 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:27:36 - XML: Start document: iteration 18
Fri 17 Jan 2014 01:27:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:27:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:27:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:27:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:27:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:27:48 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:27:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:27:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:27:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:27:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:27:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:27:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:27:49 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:27:50 - XML: Processed 655566 elements - found 684 jobs
Fri 17 Jan 2014 01:27:50 - job 7347126 appears to have finished
Fri 17 Jan 2014 01:27:50 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 01:27:50 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 01:27:51 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 01:27:51 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:27:51 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:27:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:27:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:27:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:27:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:27:57 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:27:57 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 01:27:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:27:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:27:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:27:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:28:01 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:28:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873128
Fri 17 Jan 2014 01:28:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:28:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873128
Fri 17 Jan 2014 01:28:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:28:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:28:03 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:28:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:28:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 01:28:03 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:28:03 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:28:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7328 values 115607 bits 14450 bytes 
Fri 17 Jan 2014 01:28:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 01:28:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:28:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:28:06 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:28:06 - job_xml_thread(): Done retrieving: data size 43873128
Fri 17 Jan 2014 01:28:06 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:28:06 - XML: Start document: iteration 19
Fri 17 Jan 2014 01:28:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:28:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:28:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:28:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:28:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:28:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:28:17 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:28:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:28:17 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:28:17 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:28:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:28:22 - XML: Processed 655566 elements - found 684 jobs
Fri 17 Jan 2014 01:28:23 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 01:28:23 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 01:28:23 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:28:23 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:28:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:28:25 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:28:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:28:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:28:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:28:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:28:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:28:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:28:29 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:28:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43868623
Fri 17 Jan 2014 01:28:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:28:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43868623
Fri 17 Jan 2014 01:28:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:28:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:28:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:28:38 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:28:38 - job_xml_thread(): Done retrieving: data size 43868623
Fri 17 Jan 2014 01:28:38 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:28:38 - XML: Start document: iteration 20
Fri 17 Jan 2014 01:28:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:28:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:28:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:28:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:28:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:28:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:28:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:28:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:28:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:28:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:28:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:28:44 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:28:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 01:28:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:28:47 - XML: Processed 655566 elements - found 684 jobs
Fri 17 Jan 2014 01:28:47 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 01:28:47 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 01:28:47 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:28:47 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:28:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:28:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:28:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:28:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:28:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:28:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:28:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:28:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:28:53 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:28:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43854290
Fri 17 Jan 2014 01:28:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:28:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43854290
Fri 17 Jan 2014 01:28:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:28:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:28:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:29:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:29:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:29:02 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:29:02 - job_xml_thread(): Done retrieving: data size 43854290
Fri 17 Jan 2014 01:29:02 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:29:02 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 01:29:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:29:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:29:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:29:03 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:29:04 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 01:29:04 - Housekeeping: done.
Fri 17 Jan 2014 01:29:04 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:29:04 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:29:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:29:04 - XML: Start document: iteration 0
Fri 17 Jan 2014 01:29:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:29:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:29:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:29:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 01:29:04 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:29:04 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:29:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 01:29:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6002 values 94667 bits 11833 bytes 
Fri 17 Jan 2014 01:29:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:29:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:29:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:29:13 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:29:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:29:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:29:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:29:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:29:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:29:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:29:16 - XML: Processed 655564 elements - found 683 jobs
Fri 17 Jan 2014 01:29:16 - job 7347133 appears to have finished
Fri 17 Jan 2014 01:29:16 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 01:29:16 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 01:29:16 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 01:29:16 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:29:16 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:29:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:29:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43788794
Fri 17 Jan 2014 01:29:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:29:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43788794
Fri 17 Jan 2014 01:29:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:29:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:29:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:29:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:29:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:29:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:29:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:29:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:29:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:29:31 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:29:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:29:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:29:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:29:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:29:32 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:29:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:29:34 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:29:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:29:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:29:35 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:29:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 01:29:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:29:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:29:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:29:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:29:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:29:39 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:29:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43330253
Fri 17 Jan 2014 01:29:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:29:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43330253
Fri 17 Jan 2014 01:29:39 - job_xml_thread(): Done retrieving: data size 43330253
Fri 17 Jan 2014 01:29:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:29:40 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:29:40 - XML: Start document: iteration 1
Fri 17 Jan 2014 01:29:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:29:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:29:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:29:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:29:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:29:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:29:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:29:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:29:53 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:29:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:29:53 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:29:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:29:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:29:56 - XML: Processed 648900 elements - found 684 jobs
Fri 17 Jan 2014 01:29:56 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 01:29:57 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 01:29:57 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 01:29:57 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:29:57 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:30:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:30:01 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:30:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:30:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:30:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:30:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:30:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:30:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:30:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:30:04 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:30:04 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:30:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:30:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 01:30:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 01:30:04 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:30:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5653 values 89147 bits 11143 bytes 
Fri 17 Jan 2014 01:30:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:30:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43196388
Fri 17 Jan 2014 01:30:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:30:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43196388
Fri 17 Jan 2014 01:30:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:30:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:30:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:30:12 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:30:12 - job_xml_thread(): Done retrieving: data size 43196388
Fri 17 Jan 2014 01:30:12 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:30:12 - XML: Start document: iteration 2
Fri 17 Jan 2014 01:30:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:30:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:30:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:30:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:30:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:30:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:30:20 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:30:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:30:20 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:30:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:30:20 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:30:28 - XML: Processed 647426 elements - found 684 jobs
Fri 17 Jan 2014 01:30:28 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 01:30:28 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 01:30:28 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:30:28 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:30:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:30:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:30:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:30:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:30:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:30:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:30:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:30:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:30:33 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:30:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 01:30:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:30:33 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:30:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43371619
Fri 17 Jan 2014 01:30:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:30:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43371619
Fri 17 Jan 2014 01:30:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:30:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:30:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:30:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:30:42 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:30:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:30:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:30:43 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:30:43 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:30:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:30:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:30:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:30:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:30:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:30:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:30:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:30:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:30:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:30:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:30:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:30:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:30:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:30:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:30:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:30:49 - job_xml_thread(): Done retrieving: data size 43842540
Fri 17 Jan 2014 01:30:49 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:30:49 - XML: Start document: iteration 3
Fri 17 Jan 2014 01:30:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43842540
Fri 17 Jan 2014 01:30:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43842540
Fri 17 Jan 2014 01:30:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:30:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:30:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:30:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:31:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:31:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:31:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:31:05 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:31:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:31:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 01:31:05 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:31:05 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:31:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 01:31:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:31:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:31:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:31:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:31:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6689 values 105566 bits 13195 bytes 
Fri 17 Jan 2014 01:31:06 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:31:06 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:31:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:31:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:31:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:31:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:31:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:31:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:31:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:31:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:31:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:31:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:31:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:31:10 - XML: Processed 655094 elements - found 684 jobs
Fri 17 Jan 2014 01:31:10 - job 7347131 appears to have finished
Fri 17 Jan 2014 01:31:10 - job 7347165 field 'start_timestamp' changed since saved from: 1389918553 to: 1389918495
Fri 17 Jan 2014 01:31:10 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 01:31:10 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 01:31:10 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 01:31:10 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:31:10 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:31:12 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 01:31:12 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 01:31:12 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:31:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:31:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43876248
Fri 17 Jan 2014 01:31:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:31:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43876248
Fri 17 Jan 2014 01:31:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:31:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:31:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:31:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:31:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:31:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:31:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:31:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:31:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:31:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:31:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:31:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:31:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:31:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:31:25 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:31:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:31:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:31:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:31:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:31:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:31:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:31:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:31:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:31:29 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:31:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 01:31:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:31:31 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:31:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43884417
Fri 17 Jan 2014 01:31:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:31:31 - job_xml_thread(): Done retrieving: data size 43884417
Fri 17 Jan 2014 01:31:31 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:31:31 - XML: Start document: iteration 4
Fri 17 Jan 2014 01:31:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43884417
Fri 17 Jan 2014 01:31:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:31:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:31:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:31:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:31:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:31:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:31:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:31:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:31:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:31:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:31:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:31:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:31:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:31:49 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:31:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:31:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:31:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:31:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:31:55 - XML: Processed 655566 elements - found 684 jobs
Fri 17 Jan 2014 01:31:55 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 01:31:55 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 01:31:55 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:31:55 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:31:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:31:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:31:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:31:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:31:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:31:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43879713
Fri 17 Jan 2014 01:31:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:31:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43879713
Fri 17 Jan 2014 01:31:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:32:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:32:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:32:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:32:05 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:32:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:32:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 01:32:06 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:32:06 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:32:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8874 values 140229 bits 17528 bytes 
Fri 17 Jan 2014 01:32:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 01:32:10 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:32:10 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:32:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:32:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:32:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:32:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:32:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:32:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:32:11 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:32:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:32:11 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:32:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:32:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:32:13 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:32:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:32:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:32:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:32:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:32:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:32:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:32:16 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:32:16 - job_xml_thread(): Done retrieving: data size 43904330
Fri 17 Jan 2014 01:32:16 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:32:16 - XML: Start document: iteration 5
Fri 17 Jan 2014 01:32:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43904330
Fri 17 Jan 2014 01:32:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:32:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43904330
Fri 17 Jan 2014 01:32:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:32:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:32:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:32:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:32:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:32:33 - XML: Processed 655568 elements - found 685 jobs
Fri 17 Jan 2014 01:32:33 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 01:32:33 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 01:32:34 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 01:32:34 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:32:34 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:32:34 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:32:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 01:32:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:32:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:32:34 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:32:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:32:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:32:35 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:32:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:32:35 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:32:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:32:35 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:32:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:32:37 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:32:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:32:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:32:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:32:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:32:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:32:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:32:38 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:32:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43885572
Fri 17 Jan 2014 01:32:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:32:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43885572
Fri 17 Jan 2014 01:32:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:32:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:32:48 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:32:49 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:32:49 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:32:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:32:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:32:51 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:32:51 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:32:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:32:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:32:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:32:52 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:32:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:32:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:32:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:32:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:32:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:32:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:32:54 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:32:54 - job_xml_thread(): Done retrieving: data size 43880049
Fri 17 Jan 2014 01:32:54 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:32:54 - XML: Start document: iteration 6
Fri 17 Jan 2014 01:32:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43880049
Fri 17 Jan 2014 01:32:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:32:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43880049
Fri 17 Jan 2014 01:32:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:33:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:33:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:33:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:33:07 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:33:08 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:33:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 01:33:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:33:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 01:33:08 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:33:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:33:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:33:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9193 values 145549 bits 18193 bytes 
Fri 17 Jan 2014 01:33:10 - XML: Processed 655566 elements - found 684 jobs
Fri 17 Jan 2014 01:33:10 - job 7347079 appears to have finished
Fri 17 Jan 2014 01:33:10 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 01:33:10 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 01:33:10 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 01:33:11 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:33:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:33:11 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:33:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:33:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:33:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:33:12 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:33:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:33:12 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:33:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:33:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:33:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:33:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:33:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:33:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:33:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:33:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:33:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:33:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:33:18 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:33:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 01:33:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:33:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:33:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43893483
Fri 17 Jan 2014 01:33:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:33:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43893483
Fri 17 Jan 2014 01:33:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:33:26 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:33:27 - job_xml_thread(): Done retrieving: data size 43893483
Fri 17 Jan 2014 01:33:27 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:33:27 - XML: Start document: iteration 7
Fri 17 Jan 2014 01:33:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:33:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:33:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:33:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:33:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:33:31 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:33:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:33:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:33:32 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:33:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:33:32 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:33:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:33:32 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:33:41 - XML: Processed 655562 elements - found 684 jobs
Fri 17 Jan 2014 01:33:41 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 01:33:42 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 01:33:42 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:33:42 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:33:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:33:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:33:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:33:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:33:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:33:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:33:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:33:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:33:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:33:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870395
Fri 17 Jan 2014 01:33:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:33:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870395
Fri 17 Jan 2014 01:33:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:33:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:33:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:33:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:33:53 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:33:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:33:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:33:54 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:33:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:33:54 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:33:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870395
Fri 17 Jan 2014 01:33:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:33:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:33:57 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:33:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:33:58 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 01:33:58 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:33:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:33:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:33:59 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:33:59 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 01:33:59 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 01:33:59 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:33:59 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 01:34:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:34:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:34:05 - size of cluster 'LISA Cluster': 624 hosts 79476 metrics 792580 values 12523110 bits 1565388 bytes 
Fri 17 Jan 2014 01:34:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:34:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:34:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:34:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:34:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:34:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:34:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:34:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:34:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:34:08 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:34:08 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:34:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:34:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 01:34:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 01:34:08 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:34:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99222 bits 12402 bytes 
Fri 17 Jan 2014 01:34:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:34:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:34:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:34:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:34:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:34:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:34:10 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:34:10 - job_xml_thread(): Done retrieving: data size 43853032
Fri 17 Jan 2014 01:34:10 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:34:11 - XML: Start document: iteration 8
Fri 17 Jan 2014 01:34:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853032
Fri 17 Jan 2014 01:34:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:34:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853032
Fri 17 Jan 2014 01:34:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:34:20 - XML: Processed 655560 elements - found 683 jobs
Fri 17 Jan 2014 01:34:21 - job 7347146 appears to have finished
Fri 17 Jan 2014 01:34:21 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 01:34:21 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 01:34:21 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 01:34:21 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:34:21 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:34:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:34:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:34:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:34:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:34:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:34:31 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:34:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:34:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:34:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:34:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:34:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:34:31 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:34:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:34:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:34:34 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:34:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:34:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:34:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:34:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:34:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:34:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:34:36 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:34:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 01:34:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:34:36 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:34:38 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:34:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43876527
Fri 17 Jan 2014 01:34:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:34:38 - job_xml_thread(): Done retrieving: data size 43876527
Fri 17 Jan 2014 01:34:38 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:34:39 - XML: Start document: iteration 9
Fri 17 Jan 2014 01:34:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43876527
Fri 17 Jan 2014 01:34:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:34:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:34:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:34:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:34:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:34:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:34:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:34:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:34:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:34:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:34:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:34:50 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:34:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:34:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:34:59 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:34:59 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 01:35:00 - XML: Processed 655562 elements - found 682 jobs
Fri 17 Jan 2014 01:35:00 - job 7345753 appears to have finished
Fri 17 Jan 2014 01:35:00 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 01:35:00 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 01:35:00 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 01:35:00 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:35:00 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:35:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:35:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:35:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:35:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:35:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:35:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:35:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:35:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:35:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:35:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:35:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:35:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43845653
Fri 17 Jan 2014 01:35:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:35:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43845653
Fri 17 Jan 2014 01:35:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:35:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:35:08 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:35:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:35:10 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:35:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 01:35:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 01:35:10 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:35:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8159 values 128748 bits 16093 bytes 
Fri 17 Jan 2014 01:35:15 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:35:15 - job_xml_thread(): Done retrieving: data size 43845653
Fri 17 Jan 2014 01:35:15 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:35:15 - XML: Start document: iteration 10
Fri 17 Jan 2014 01:35:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:35:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:35:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:35:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:35:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:35:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:35:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:35:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:35:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:35:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:35:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:35:28 - XML: Processed 655562 elements - found 682 jobs
Fri 17 Jan 2014 01:35:28 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 01:35:28 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 01:35:28 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:35:28 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:35:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:35:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:35:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:35:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:35:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:35:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:35:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:35:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:35:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:35:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43802905
Fri 17 Jan 2014 01:35:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:35:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43802905
Fri 17 Jan 2014 01:35:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:35:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:35:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:35:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:35:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:35:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:35:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:35:42 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:35:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:35:42 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:35:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:35:42 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:35:42 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:35:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 01:35:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:35:43 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:35:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:35:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:35:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:35:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:35:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:35:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:35:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:35:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:35:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:35:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:35:51 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:35:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43236488
Fri 17 Jan 2014 01:35:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:35:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43236488
Fri 17 Jan 2014 01:35:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:35:52 - job_xml_thread(): Done retrieving: data size 43236488
Fri 17 Jan 2014 01:35:52 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:35:52 - XML: Start document: iteration 11
Fri 17 Jan 2014 01:35:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:35:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:36:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:36:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:36:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:36:10 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:36:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:36:12 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:36:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 01:36:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 01:36:12 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:36:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6015 values 94931 bits 11866 bytes 
Fri 17 Jan 2014 01:36:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:36:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:36:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:36:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:36:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:36:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:36:14 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:36:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:36:14 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:36:14 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:36:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:36:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:36:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:36:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:36:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:36:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:36:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:36:15 - XML: Processed 647734 elements - found 682 jobs
Fri 17 Jan 2014 01:36:15 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 01:36:15 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 01:36:15 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:36:15 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:36:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:36:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43269058
Fri 17 Jan 2014 01:36:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:36:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43269058
Fri 17 Jan 2014 01:36:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:36:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:36:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:36:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:36:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:36:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:36:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:36:30 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:36:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:36:30 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:36:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:36:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:36:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:36:32 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:36:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:36:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:36:36 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:36:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:36:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:36:36 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:36:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 01:36:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:36:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:36:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:36:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:36:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:36:40 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:36:40 - job_xml_thread(): Done retrieving: data size 43736978
Fri 17 Jan 2014 01:36:40 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:36:40 - XML: Start document: iteration 12
Fri 17 Jan 2014 01:36:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43736978
Fri 17 Jan 2014 01:36:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43736978
Fri 17 Jan 2014 01:36:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:36:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:36:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:36:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:36:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:36:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:36:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:36:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:36:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:36:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:36:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:36:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:36:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:36:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:36:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:36:59 - XML: Processed 653996 elements - found 683 jobs
Fri 17 Jan 2014 01:36:59 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 01:36:59 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 01:37:00 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 01:37:00 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:37:00 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:37:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:37:03 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:37:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:37:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:37:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:37:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:37:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:37:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:37:06 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:37:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43860265
Fri 17 Jan 2014 01:37:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:37:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43860265
Fri 17 Jan 2014 01:37:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:37:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:37:12 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:37:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:37:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:37:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 01:37:12 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:37:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8898 values 140401 bits 17550 bytes 
Fri 17 Jan 2014 01:37:12 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:37:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:37:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 01:37:15 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:37:15 - job_xml_thread(): Done retrieving: data size 43860265
Fri 17 Jan 2014 01:37:15 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:37:15 - XML: Start document: iteration 13
Fri 17 Jan 2014 01:37:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:37:16 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:37:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:37:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:37:17 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:37:17 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:37:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:37:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:37:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:37:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:37:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:37:28 - XML: Processed 655564 elements - found 683 jobs
Fri 17 Jan 2014 01:37:28 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 01:37:28 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 01:37:28 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:37:28 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:37:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:37:30 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:37:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:37:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:37:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:37:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:37:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:37:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:37:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:37:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:37:33 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:37:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851760
Fri 17 Jan 2014 01:37:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:37:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851760
Fri 17 Jan 2014 01:37:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:37:43 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:37:43 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:37:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:37:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:37:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:37:45 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:37:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:37:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:37:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:37:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:37:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:37:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:37:49 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:37:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 01:37:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:37:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:37:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:37:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:37:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:37:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:37:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:37:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:37:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:37:52 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 01:37:52 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 01:37:52 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:37:53 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:37:53 - job_xml_thread(): Done retrieving: data size 43867201
Fri 17 Jan 2014 01:37:53 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:37:53 - XML: Start document: iteration 14
Fri 17 Jan 2014 01:37:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43867201
Fri 17 Jan 2014 01:37:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:37:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867201
Fri 17 Jan 2014 01:37:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:38:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:38:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:38:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:38:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:38:07 - XML: Processed 655566 elements - found 684 jobs
Fri 17 Jan 2014 01:38:07 - job 7347168 field 'start_timestamp' changed since saved from: 1389919009 to: 1389918954
Fri 17 Jan 2014 01:38:07 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 01:38:07 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 01:38:08 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 01:38:08 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:38:08 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:38:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:38:13 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:38:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:38:13 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:38:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 01:38:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 01:38:13 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:38:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:38:14 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:38:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5809 values 91655 bits 11456 bytes 
Fri 17 Jan 2014 01:38:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:38:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:38:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:38:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:38:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:38:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:38:15 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:38:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:38:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:38:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:38:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:38:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:38:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:38:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:38:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:38:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:38:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43885819
Fri 17 Jan 2014 01:38:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:38:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43885819
Fri 17 Jan 2014 01:38:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:38:24 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:38:24 - job_xml_thread(): Done retrieving: data size 43885819
Fri 17 Jan 2014 01:38:24 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:38:24 - XML: Start document: iteration 15
Fri 17 Jan 2014 01:38:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:38:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:38:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:38:31 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:38:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:38:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:38:32 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:38:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:38:32 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:38:32 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:38:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:38:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:38:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:38:40 - XML: Processed 655566 elements - found 684 jobs
Fri 17 Jan 2014 01:38:40 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 01:38:40 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 01:38:40 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:38:40 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:38:42 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:38:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 01:38:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:38:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:38:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:38:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:38:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:38:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:38:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:38:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:38:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:38:44 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:38:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43872148
Fri 17 Jan 2014 01:38:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:38:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43872148
Fri 17 Jan 2014 01:38:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:38:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:38:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:38:55 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:38:55 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:38:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:38:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:38:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:38:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:38:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:38:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:38:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:38:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:38:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:38:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:39:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:39:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:39:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:39:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:39:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:39:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:39:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:39:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:39:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:39:02 - job_xml_thread(): Done retrieving: data size 43865061
Fri 17 Jan 2014 01:39:02 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:39:02 - XML: Start document: iteration 16
Fri 17 Jan 2014 01:39:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43865061
Fri 17 Jan 2014 01:39:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:39:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865061
Fri 17 Jan 2014 01:39:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:39:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:39:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:39:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:39:14 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:39:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:39:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 01:39:15 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:39:15 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:39:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 01:39:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:39:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:39:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8767 values 138220 bits 17277 bytes 
Fri 17 Jan 2014 01:39:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:39:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:39:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:39:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:39:20 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:39:20 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:39:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:39:20 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:39:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:39:24 - XML: Processed 655568 elements - found 685 jobs
Fri 17 Jan 2014 01:39:24 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 01:39:24 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 01:39:24 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 01:39:24 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:39:24 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:39:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:39:26 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:39:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:39:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:39:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:39:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:39:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:39:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:39:28 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:39:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43878092
Fri 17 Jan 2014 01:39:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:39:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43878092
Fri 17 Jan 2014 01:39:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:39:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:39:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:39:39 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:39:39 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:39:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:39:41 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:39:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:39:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:39:42 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:39:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:39:42 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:39:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:39:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:39:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:39:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:39:44 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:39:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:39:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:39:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:39:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:39:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:39:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:39:44 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:39:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 01:39:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:39:46 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:39:46 - job_xml_thread(): Done retrieving: data size 43876895
Fri 17 Jan 2014 01:39:46 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:39:46 - XML: Start document: iteration 17
Fri 17 Jan 2014 01:39:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43876895
Fri 17 Jan 2014 01:39:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:39:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43876895
Fri 17 Jan 2014 01:39:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:39:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:39:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:39:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:39:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:39:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:39:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:39:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:39:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:40:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:40:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:40:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:40:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:40:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:40:06 - XML: Processed 655563 elements - found 684 jobs
Fri 17 Jan 2014 01:40:06 - job 7347043 appears to have finished
Fri 17 Jan 2014 01:40:06 - job 7346162 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 01:40:06 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 01:40:06 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 01:40:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:40:08 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:40:08 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 01:40:08 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:40:08 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:40:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:40:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:40:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:40:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:40:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:40:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:40:10 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:40:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867777
Fri 17 Jan 2014 01:40:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:40:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43867777
Fri 17 Jan 2014 01:40:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:40:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:40:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:40:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:40:15 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:40:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:40:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 01:40:16 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:40:16 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:40:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 01:40:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8659 values 136565 bits 17070 bytes 
Fri 17 Jan 2014 01:40:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:40:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:40:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:40:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:40:20 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:40:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:40:20 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:40:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:40:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867777
Fri 17 Jan 2014 01:40:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:40:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:40:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:40:24 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:40:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:40:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:40:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:40:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:40:33 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:40:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:40:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:40:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:40:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:40:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:40:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:40:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:40:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:40:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:40:35 - job_xml_thread(): Done retrieving: data size 43849223
Fri 17 Jan 2014 01:40:35 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:40:35 - XML: Start document: iteration 18
Fri 17 Jan 2014 01:40:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43849223
Fri 17 Jan 2014 01:40:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:40:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:40:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:40:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43849223
Fri 17 Jan 2014 01:40:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:40:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:40:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:40:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:40:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:40:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:40:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:40:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:40:57 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:40:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:40:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:40:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:40:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:40:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:40:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:40:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:40:59 - XML: Processed 655566 elements - found 684 jobs
Fri 17 Jan 2014 01:40:59 - job 7346162 field 'start_timestamp' changed since saved from: 1389919157 to: 1389919137
Fri 17 Jan 2014 01:40:59 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 01:40:59 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 01:40:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:40:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:40:59 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 01:40:59 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:40:59 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:40:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:40:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:40:59 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:40:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 01:40:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:40:59 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 01:40:59 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:41:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:41:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:41:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:41:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:41:00 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:41:00 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:41:00 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 01:41:00 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 01:41:00 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 01:41:01 - size of cluster 'LISA Cluster': 624 hosts 79473 metrics 823157 values 12986249 bits 1623281 bytes 
Fri 17 Jan 2014 01:41:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:41:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43877425
Fri 17 Jan 2014 01:41:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:41:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43877425
Fri 17 Jan 2014 01:41:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:41:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:41:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:41:14 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:41:14 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:41:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:41:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:41:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:41:16 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:41:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:41:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:41:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:41:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:41:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:41:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:41:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:41:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:41:18 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:41:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:41:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 01:41:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 01:41:18 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:41:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6056 values 95542 bits 11942 bytes 
Fri 17 Jan 2014 01:41:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:41:19 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:41:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:41:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:41:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:41:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:41:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:41:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:41:23 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:41:23 - job_xml_thread(): Done retrieving: data size 43808095
Fri 17 Jan 2014 01:41:23 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:41:23 - XML: Start document: iteration 19
Fri 17 Jan 2014 01:41:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43808095
Fri 17 Jan 2014 01:41:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:41:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43808095
Fri 17 Jan 2014 01:41:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:41:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:41:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:41:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:41:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:41:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:41:42 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:41:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:41:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:41:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:41:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:41:43 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:41:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:41:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:41:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:41:46 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:41:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:41:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:41:47 - XML: Processed 654818 elements - found 684 jobs
Fri 17 Jan 2014 01:41:47 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 01:41:47 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 01:41:47 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:41:47 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:41:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:41:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:41:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:41:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:41:48 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:41:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 01:41:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:41:51 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:41:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43253968
Fri 17 Jan 2014 01:41:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:41:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43253968
Fri 17 Jan 2014 01:41:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:41:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:41:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:42:00 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:42:00 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 01:42:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:42:01 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:42:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:42:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:42:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:42:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:42:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:42:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:42:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:42:02 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:42:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:42:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:42:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:42:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:42:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:42:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:42:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:42:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:42:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:42:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:42:09 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:42:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43226533
Fri 17 Jan 2014 01:42:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:42:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43226533
Fri 17 Jan 2014 01:42:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:42:09 - job_xml_thread(): Done retrieving: data size 43226533
Fri 17 Jan 2014 01:42:09 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:42:09 - XML: Start document: iteration 20
Fri 17 Jan 2014 01:42:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:42:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:42:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:42:18 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:42:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:42:19 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:42:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 01:42:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 01:42:19 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:42:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8657 values 136547 bits 17068 bytes 
Fri 17 Jan 2014 01:42:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:42:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:42:25 - XML: Processed 647362 elements - found 682 jobs
Fri 17 Jan 2014 01:42:25 - job 7334709 appears to have finished
Fri 17 Jan 2014 01:42:25 - job 7347077 appears to have finished
Fri 17 Jan 2014 01:42:25 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 01:42:25 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 01:42:28 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 01:42:28 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:42:28 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:42:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:42:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:42:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:42:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:42:30 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:42:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:42:30 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:42:30 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:42:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:42:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:42:32 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:42:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:42:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:42:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:42:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:42:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:42:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:42:38 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:42:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43692215
Fri 17 Jan 2014 01:42:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:42:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43692215
Fri 17 Jan 2014 01:42:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:42:44 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:42:44 - job_xml_thread(): Done retrieving: data size 43692215
Fri 17 Jan 2014 01:42:44 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:42:44 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 01:42:44 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 01:42:44 - Housekeeping: done.
Fri 17 Jan 2014 01:42:45 - XML: Start document: iteration 0
Fri 17 Jan 2014 01:42:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:42:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:42:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:42:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:42:50 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:42:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 01:42:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:42:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:42:59 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:42:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:42:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:42:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:42:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:42:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:43:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:43:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:43:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:43:01 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:43:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:43:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:43:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:43:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:43:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:43:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:43:02 - XML: Processed 653270 elements - found 682 jobs
Fri 17 Jan 2014 01:43:03 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 01:43:03 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 01:43:03 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:43:03 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:43:06 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:43:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43872606
Fri 17 Jan 2014 01:43:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:43:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43872606
Fri 17 Jan 2014 01:43:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:43:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:43:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:43:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:43:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:43:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:43:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:43:18 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:43:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:43:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:43:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:43:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:43:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:43:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:43:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:43:19 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:43:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:43:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:43:19 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:43:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:43:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:43:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:43:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 01:43:20 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:43:20 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:43:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6220 values 98172 bits 12271 bytes 
Fri 17 Jan 2014 01:43:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 01:43:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:43:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:43:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:43:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:43:23 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:43:23 - job_xml_thread(): Done retrieving: data size 43886054
Fri 17 Jan 2014 01:43:23 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:43:23 - XML: Start document: iteration 1
Fri 17 Jan 2014 01:43:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43886054
Fri 17 Jan 2014 01:43:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43886054
Fri 17 Jan 2014 01:43:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:43:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:43:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:43:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:43:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:43:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:43:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:43:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:43:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:43:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:43:40 - XML: Processed 655562 elements - found 682 jobs
Fri 17 Jan 2014 01:43:40 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 01:43:40 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 01:43:40 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:43:40 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:43:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:43:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:43:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:43:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:43:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:43:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:43:45 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:43:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:43:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:43:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:43:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:43:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:43:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:43:46 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:43:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 01:43:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:43:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:43:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862359
Fri 17 Jan 2014 01:43:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:43:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862359
Fri 17 Jan 2014 01:43:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:43:55 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:43:55 - job_xml_thread(): Done retrieving: data size 43862359
Fri 17 Jan 2014 01:43:55 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:43:55 - XML: Start document: iteration 2
Fri 17 Jan 2014 01:43:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:43:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:44:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:44:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:44:06 - XML: Processed 655564 elements - found 683 jobs
Fri 17 Jan 2014 01:44:06 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 01:44:06 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 01:44:06 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 01:44:06 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:44:06 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:44:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:44:07 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:44:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:44:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:44:07 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:44:07 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:44:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:44:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:44:07 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:44:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:44:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:44:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:44:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:44:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:44:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:44:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:44:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:44:14 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:44:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43888023
Fri 17 Jan 2014 01:44:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:44:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43888023
Fri 17 Jan 2014 01:44:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:44:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:44:20 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:44:21 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:44:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:44:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 01:44:21 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:44:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 01:44:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8613 values 135808 bits 16976 bytes 
Fri 17 Jan 2014 01:44:22 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:44:22 - job_xml_thread(): Done retrieving: data size 43888023
Fri 17 Jan 2014 01:44:22 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:44:22 - XML: Start document: iteration 3
Fri 17 Jan 2014 01:44:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:44:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:44:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:44:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:44:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:44:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:44:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:44:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:44:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:44:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:44:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:44:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:44:31 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:44:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:44:37 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:44:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:44:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:44:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:44:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:44:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:44:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:44:39 - XML: Processed 655564 elements - found 683 jobs
Fri 17 Jan 2014 01:44:39 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 01:44:39 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 01:44:39 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:44:39 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:44:42 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:44:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 01:44:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:44:42 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:44:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873773
Fri 17 Jan 2014 01:44:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:44:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873773
Fri 17 Jan 2014 01:44:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:44:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:44:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:44:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:44:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:44:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:44:53 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:44:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:44:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:44:54 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:44:54 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:44:54 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:44:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:44:54 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:44:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:44:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:44:57 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:44:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:44:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:44:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:44:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:44:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:44:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:45:00 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:45:00 - job_xml_thread(): Done retrieving: data size 43874242
Fri 17 Jan 2014 01:45:00 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:45:00 - XML: Start document: iteration 4
Fri 17 Jan 2014 01:45:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43874242
Fri 17 Jan 2014 01:45:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:45:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43874242
Fri 17 Jan 2014 01:45:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:45:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:45:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:45:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:45:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:45:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:45:16 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:45:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:45:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:45:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:45:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:45:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:45:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:45:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:45:21 - XML: Processed 655564 elements - found 683 jobs
Fri 17 Jan 2014 01:45:21 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 01:45:21 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 01:45:21 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:45:21 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:45:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:45:21 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:45:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:45:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 01:45:22 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:45:22 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:45:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 01:45:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6139 values 96913 bits 12114 bytes 
Fri 17 Jan 2014 01:45:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:45:25 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:45:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:45:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:45:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:45:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:45:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:45:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:45:28 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 01:45:28 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 01:45:28 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:45:29 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:45:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43876396
Fri 17 Jan 2014 01:45:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:45:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43876396
Fri 17 Jan 2014 01:45:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:45:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:45:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:45:36 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:45:36 - job_xml_thread(): Done retrieving: data size 43876396
Fri 17 Jan 2014 01:45:36 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:45:36 - XML: Start document: iteration 5
Fri 17 Jan 2014 01:45:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:45:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:45:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:45:42 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:45:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:45:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:45:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:45:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:45:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:45:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:45:44 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:45:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:45:46 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:45:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:45:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:45:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:45:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:45:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:45:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:45:50 - XML: Processed 655563 elements - found 683 jobs
Fri 17 Jan 2014 01:45:50 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 01:45:50 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 01:45:50 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:45:50 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:45:51 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:45:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 01:45:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:45:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:45:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875598
Fri 17 Jan 2014 01:45:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:45:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875598
Fri 17 Jan 2014 01:45:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:45:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:45:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:46:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:46:01 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:46:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:46:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:46:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:46:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:46:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:46:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:46:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:46:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:46:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:46:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:46:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:46:05 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:46:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:46:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:46:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:46:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:46:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:46:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:46:07 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:46:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43892326
Fri 17 Jan 2014 01:46:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:46:08 - job_xml_thread(): Done retrieving: data size 43892326
Fri 17 Jan 2014 01:46:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43892326
Fri 17 Jan 2014 01:46:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:46:08 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:46:08 - XML: Start document: iteration 6
Fri 17 Jan 2014 01:46:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:46:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:46:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:46:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:46:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:46:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:46:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:46:20 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:46:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:46:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:46:20 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:46:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:46:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:46:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:46:22 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:46:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:46:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 01:46:24 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:46:24 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:46:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8669 values 136780 bits 17097 bytes 
Fri 17 Jan 2014 01:46:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 01:46:29 - XML: Processed 655564 elements - found 683 jobs
Fri 17 Jan 2014 01:46:29 - job 7347169 appears to have finished
Fri 17 Jan 2014 01:46:29 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 01:46:29 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 01:46:30 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 01:46:30 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:46:30 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:46:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:46:31 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:46:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:46:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:46:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:46:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:46:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:46:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:46:33 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:46:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43847304
Fri 17 Jan 2014 01:46:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:46:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43847304
Fri 17 Jan 2014 01:46:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:46:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:46:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:46:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:46:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:46:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:46:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:46:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:46:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:46:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:46:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:46:44 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:46:45 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:46:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:46:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:46:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:46:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:46:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:46:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:46:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:46:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:46:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:46:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:46:48 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:46:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 01:46:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:46:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:46:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43886650
Fri 17 Jan 2014 01:46:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:46:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43886650
Fri 17 Jan 2014 01:46:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:46:50 - job_xml_thread(): Done retrieving: data size 43886650
Fri 17 Jan 2014 01:46:50 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:46:50 - XML: Start document: iteration 7
Fri 17 Jan 2014 01:46:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:46:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:47:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:47:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:47:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:47:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:47:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:47:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:47:06 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:47:06 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:47:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:47:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:47:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:47:13 - XML: Processed 655564 elements - found 683 jobs
Fri 17 Jan 2014 01:47:14 - job 7347172 field 'start_timestamp' changed since saved from: 1389919512 to: 1389919466
Fri 17 Jan 2014 01:47:14 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 01:47:14 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 01:47:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:47:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:47:14 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 01:47:14 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:47:14 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:47:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:47:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:47:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:47:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:47:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:47:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:47:16 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:47:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43791111
Fri 17 Jan 2014 01:47:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:47:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43791111
Fri 17 Jan 2014 01:47:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:47:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:47:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:47:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:47:24 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:47:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:47:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 01:47:25 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:47:25 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:47:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 01:47:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:47:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:47:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8722 values 137931 bits 17241 bytes 
Fri 17 Jan 2014 01:47:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:47:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:47:27 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:47:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:47:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:47:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:47:27 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:47:29 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:47:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:47:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:47:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:47:31 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:47:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:47:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:47:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:47:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:47:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:47:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:47:33 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:47:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43446613
Fri 17 Jan 2014 01:47:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:47:33 - job_xml_thread(): Done retrieving: data size 43446613
Fri 17 Jan 2014 01:47:33 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:47:33 - XML: Start document: iteration 8
Fri 17 Jan 2014 01:47:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43446613
Fri 17 Jan 2014 01:47:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:47:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:47:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:47:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:47:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:47:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:47:50 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:47:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:47:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:47:51 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:47:51 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:47:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:47:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:47:51 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:47:52 - XML: Processed 650306 elements - found 683 jobs
Fri 17 Jan 2014 01:47:52 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 01:47:52 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 01:47:52 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:47:52 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:47:53 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:47:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 01:47:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:47:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:47:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:47:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:47:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:47:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:47:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:47:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:47:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:47:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:47:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43208992
Fri 17 Jan 2014 01:47:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:47:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43208992
Fri 17 Jan 2014 01:47:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:48:01 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 01:48:01 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:48:03 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:48:03 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:48:03 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 01:48:03 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 01:48:03 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 01:48:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:48:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:48:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:48:06 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:48:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:48:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:48:07 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:48:08 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:48:08 - job_xml_thread(): Done retrieving: data size 43208992
Fri 17 Jan 2014 01:48:08 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:48:08 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:48:08 - XML: Start document: iteration 9
Fri 17 Jan 2014 01:48:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:48:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:48:08 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:48:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:48:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:48:13 - size of cluster 'LISA Cluster': 624 hosts 79471 metrics 781502 values 12344081 bits 1543010 bytes 
Fri 17 Jan 2014 01:48:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:48:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:48:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:48:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:48:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:48:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:48:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:48:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:48:20 - XML: Processed 647442 elements - found 683 jobs
Fri 17 Jan 2014 01:48:20 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 01:48:20 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 01:48:20 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:48:20 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:48:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:48:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:48:24 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:48:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43257927
Fri 17 Jan 2014 01:48:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:48:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43257927
Fri 17 Jan 2014 01:48:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:48:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:48:25 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:48:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:48:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 01:48:25 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:48:25 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:48:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7173 values 113516 bits 14189 bytes 
Fri 17 Jan 2014 01:48:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 01:48:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:48:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:48:36 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:48:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:48:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:48:36 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:48:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:48:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:48:37 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:48:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:48:37 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:48:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:48:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:48:40 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:48:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:48:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:48:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:48:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:48:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:48:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:48:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:48:46 - job_xml_thread(): Done retrieving: data size 43741414
Fri 17 Jan 2014 01:48:46 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:48:46 - XML: Start document: iteration 10
Fri 17 Jan 2014 01:48:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43741414
Fri 17 Jan 2014 01:48:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:48:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43741414
Fri 17 Jan 2014 01:48:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:48:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:48:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:48:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:48:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:49:03 - XML: Processed 654070 elements - found 682 jobs
Fri 17 Jan 2014 01:49:03 - job 7347153 appears to have finished
Fri 17 Jan 2014 01:49:03 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 01:49:03 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 01:49:03 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 01:49:03 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:49:03 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:49:04 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:49:04 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 01:49:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:49:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:49:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:49:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:49:09 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:49:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:49:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:49:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:49:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:49:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:49:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:49:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:49:10 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:49:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:49:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:49:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:49:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:49:10 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:49:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 01:49:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:49:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:49:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873211
Fri 17 Jan 2014 01:49:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:49:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873211
Fri 17 Jan 2014 01:49:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:49:18 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:49:18 - job_xml_thread(): Done retrieving: data size 43873211
Fri 17 Jan 2014 01:49:19 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:49:19 - XML: Start document: iteration 11
Fri 17 Jan 2014 01:49:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:49:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:49:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:49:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:49:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:49:26 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:49:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:49:27 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:49:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 01:49:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 01:49:27 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:49:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5681 values 89600 bits 11200 bytes 
Fri 17 Jan 2014 01:49:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:49:29 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:49:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:49:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:49:29 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:49:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:49:29 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:49:29 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:49:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:49:35 - XML: Processed 655562 elements - found 682 jobs
Fri 17 Jan 2014 01:49:35 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 01:49:35 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 01:49:35 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:49:35 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:49:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:49:37 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:49:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:49:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:49:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:49:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:49:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:49:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:49:42 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:49:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43863986
Fri 17 Jan 2014 01:49:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:49:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43863986
Fri 17 Jan 2014 01:49:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:49:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:49:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:49:50 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:49:50 - job_xml_thread(): Done retrieving: data size 43863986
Fri 17 Jan 2014 01:49:50 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:49:50 - XML: Start document: iteration 12
Fri 17 Jan 2014 01:49:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:49:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:49:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:49:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:49:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:49:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:49:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:49:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:49:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:49:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:49:55 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:50:03 - XML: Processed 655555 elements - found 681 jobs
Fri 17 Jan 2014 01:50:03 - job 7344174 appears to have finished
Fri 17 Jan 2014 01:50:03 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 01:50:03 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 01:50:03 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 01:50:04 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:50:04 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:50:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:50:06 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:50:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:50:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:50:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:50:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:50:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:50:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:50:06 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:50:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 01:50:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:50:09 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:50:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865897
Fri 17 Jan 2014 01:50:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:50:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43865897
Fri 17 Jan 2014 01:50:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:50:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:50:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:50:19 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:50:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:50:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:50:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:50:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:50:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:50:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:50:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:50:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:50:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:50:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:50:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:50:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:50:24 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:50:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:50:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:50:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:50:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:50:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:50:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:50:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:50:27 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:50:27 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:50:27 - job_xml_thread(): Done retrieving: data size 43861231
Fri 17 Jan 2014 01:50:27 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:50:27 - XML: Start document: iteration 13
Fri 17 Jan 2014 01:50:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43861231
Fri 17 Jan 2014 01:50:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43861231
Fri 17 Jan 2014 01:50:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:50:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:50:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:50:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 01:50:28 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:50:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5819 values 91817 bits 11477 bytes 
Fri 17 Jan 2014 01:50:28 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:50:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 01:50:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:50:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:50:39 - XML: Processed 655560 elements - found 681 jobs
Fri 17 Jan 2014 01:50:39 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 01:50:39 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 01:50:39 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:50:39 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:50:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:50:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:50:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:50:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:50:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:50:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:50:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:50:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:50:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:50:44 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:50:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:50:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:50:49 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:50:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:50:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:50:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:50:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:50:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:50:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:50:53 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:50:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43882622
Fri 17 Jan 2014 01:50:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:50:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43882622
Fri 17 Jan 2014 01:50:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:50:54 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:50:54 - job_xml_thread(): Done retrieving: data size 43882622
Fri 17 Jan 2014 01:50:54 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:50:54 - XML: Start document: iteration 14
Fri 17 Jan 2014 01:50:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:50:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:51:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:51:03 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:51:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:51:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:51:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:51:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:51:05 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:51:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:51:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:51:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:51:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:51:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:51:15 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:51:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:51:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:51:16 - XML: Processed 655557 elements - found 682 jobs
Fri 17 Jan 2014 01:51:16 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 01:51:16 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 01:51:16 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 01:51:16 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:51:16 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:51:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:51:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:51:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:51:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:51:17 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:51:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 01:51:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:51:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:51:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858375
Fri 17 Jan 2014 01:51:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:51:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:51:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:51:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43858375
Fri 17 Jan 2014 01:51:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:51:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:51:28 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:51:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:51:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 01:51:29 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:51:29 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:51:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 01:51:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5759 values 90785 bits 11348 bytes 
Fri 17 Jan 2014 01:51:31 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:51:31 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:51:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:51:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:51:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:51:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:51:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:51:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:51:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:51:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:51:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:51:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:51:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:51:36 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:51:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:51:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:51:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:51:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:51:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:51:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:51:40 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:51:40 - job_xml_thread(): Done retrieving: data size 43875971
Fri 17 Jan 2014 01:51:40 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:51:40 - XML: Start document: iteration 15
Fri 17 Jan 2014 01:51:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875971
Fri 17 Jan 2014 01:51:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:51:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875971
Fri 17 Jan 2014 01:51:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:51:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:51:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:51:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:51:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:51:58 - XML: Processed 655560 elements - found 681 jobs
Fri 17 Jan 2014 01:51:59 - job 7347171 appears to have finished
Fri 17 Jan 2014 01:51:59 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 01:51:59 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 01:51:59 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 01:51:59 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:51:59 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:52:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:52:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:52:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:52:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:52:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:52:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:52:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:52:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:52:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:52:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:52:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:52:05 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:52:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 01:52:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:52:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:52:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:52:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:52:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:52:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:52:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:52:07 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 01:52:07 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 01:52:07 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:52:08 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:52:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43905143
Fri 17 Jan 2014 01:52:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:52:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43905143
Fri 17 Jan 2014 01:52:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:52:14 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:52:15 - job_xml_thread(): Done retrieving: data size 43905143
Fri 17 Jan 2014 01:52:15 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:52:15 - XML: Start document: iteration 16
Fri 17 Jan 2014 01:52:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:52:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:52:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:52:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:52:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:52:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:52:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:52:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:52:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:52:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:52:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:52:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:52:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:52:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:52:27 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:52:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:52:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:52:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:52:29 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:52:29 - XML: Processed 655560 elements - found 681 jobs
Fri 17 Jan 2014 01:52:29 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 01:52:29 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 01:52:29 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:52:29 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:52:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:52:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:52:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:52:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:52:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:52:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 01:52:30 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:52:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5974 values 94271 bits 11783 bytes 
Fri 17 Jan 2014 01:52:30 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:52:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 01:52:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:52:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43860812
Fri 17 Jan 2014 01:52:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:52:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43860812
Fri 17 Jan 2014 01:52:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:52:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:52:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:52:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:52:41 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:52:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:52:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:52:42 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:52:42 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:52:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:52:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:52:42 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:52:44 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:52:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:52:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:52:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:52:46 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:52:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:52:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:52:47 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:52:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 01:52:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:52:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:52:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:52:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:52:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:52:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:52:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43884035
Fri 17 Jan 2014 01:52:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:52:49 - job_xml_thread(): Done retrieving: data size 43884035
Fri 17 Jan 2014 01:52:49 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:52:49 - XML: Start document: iteration 17
Fri 17 Jan 2014 01:52:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43884035
Fri 17 Jan 2014 01:52:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:52:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:52:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:53:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:53:00 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:53:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:53:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:53:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:53:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:53:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:53:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:53:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:53:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:53:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:53:06 - XML: Processed 655560 elements - found 681 jobs
Fri 17 Jan 2014 01:53:06 - job 7346254 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 01:53:06 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 01:53:06 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 01:53:07 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 01:53:07 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:53:07 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:53:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:53:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:53:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:53:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:53:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:53:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:53:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:53:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:53:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:53:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43848388
Fri 17 Jan 2014 01:53:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:53:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43848388
Fri 17 Jan 2014 01:53:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:53:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:53:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:53:22 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:53:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:53:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:53:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:53:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:53:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:53:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:53:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:53:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:53:28 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:53:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:53:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:53:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:53:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:53:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:53:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:53:29 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:53:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:53:29 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:53:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:53:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:53:30 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:53:30 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:53:30 - job_xml_thread(): Done retrieving: data size 43798885
Fri 17 Jan 2014 01:53:30 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:53:30 - XML: Start document: iteration 18
Fri 17 Jan 2014 01:53:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43798885
Fri 17 Jan 2014 01:53:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:53:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43798885
Fri 17 Jan 2014 01:53:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:53:31 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:53:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 01:53:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:53:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 01:53:31 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:53:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8741 values 137885 bits 17235 bytes 
Fri 17 Jan 2014 01:53:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:53:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:53:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:53:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:53:45 - XML: Processed 654808 elements - found 681 jobs
Fri 17 Jan 2014 01:53:45 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 01:53:45 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 01:53:45 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:53:45 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:53:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:53:49 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:53:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:53:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:53:50 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:53:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:53:50 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:53:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:53:50 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:53:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:53:53 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:53:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:53:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:53:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:53:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:53:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:53:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:53:55 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:53:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43243589
Fri 17 Jan 2014 01:53:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:53:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43243589
Fri 17 Jan 2014 01:53:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:54:01 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:54:01 - job_xml_thread(): Done retrieving: data size 43243589
Fri 17 Jan 2014 01:54:01 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:54:01 - XML: Start document: iteration 19
Fri 17 Jan 2014 01:54:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:54:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:54:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:54:06 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:54:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:54:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:54:07 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:54:07 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:54:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:54:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:54:08 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:54:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:54:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:54:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:54:13 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:54:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:54:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:54:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:54:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:54:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:54:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:54:16 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:54:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 01:54:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:54:16 - XML: Processed 647526 elements - found 680 jobs
Fri 17 Jan 2014 01:54:16 - job 7347154 appears to have finished
Fri 17 Jan 2014 01:54:16 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 01:54:16 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 01:54:16 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 01:54:16 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:54:16 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:54:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:54:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43258719
Fri 17 Jan 2014 01:54:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:54:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43258719
Fri 17 Jan 2014 01:54:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:54:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:54:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:54:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:54:27 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:54:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:54:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:54:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:54:29 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:54:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:54:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:54:29 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:54:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:54:29 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:54:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:54:31 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:54:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:54:31 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:54:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:54:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 01:54:31 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:54:31 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:54:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 01:54:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5901 values 93093 bits 11636 bytes 
Fri 17 Jan 2014 01:54:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:54:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:54:31 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:54:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:54:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:54:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:54:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:54:34 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:54:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43459320
Fri 17 Jan 2014 01:54:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:54:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43459320
Fri 17 Jan 2014 01:54:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:54:34 - job_xml_thread(): Done retrieving: data size 43459320
Fri 17 Jan 2014 01:54:34 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:54:34 - XML: Start document: iteration 20
Fri 17 Jan 2014 01:54:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:54:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:54:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:54:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:54:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:54:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:54:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:54:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:54:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:54:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:54:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:54:52 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:54:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:54:57 - XML: Processed 650310 elements - found 680 jobs
Fri 17 Jan 2014 01:54:57 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 01:54:57 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 01:54:57 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:54:57 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:54:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:54:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:54:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:54:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:54:58 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:54:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 01:54:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:54:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:54:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:54:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:54:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:55:00 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:55:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858631
Fri 17 Jan 2014 01:55:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:55:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43858631
Fri 17 Jan 2014 01:55:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:55:05 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 01:55:06 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:55:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:55:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:55:08 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:55:08 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:55:08 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 01:55:08 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 01:55:08 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 01:55:10 - size of cluster 'LISA Cluster': 624 hosts 79464 metrics 800348 values 12625736 bits 1578217 bytes 
Fri 17 Jan 2014 01:55:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:55:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:55:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:55:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:55:11 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:55:11 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:55:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:55:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:55:11 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:55:12 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:55:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:55:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:55:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:55:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:55:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:55:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:55:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:55:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:55:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:55:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:55:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:55:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858357
Fri 17 Jan 2014 01:55:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:55:19 - job_xml_thread(): Done retrieving: data size 43858357
Fri 17 Jan 2014 01:55:19 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:55:19 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 01:55:20 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 01:55:20 - Housekeeping: done.
Fri 17 Jan 2014 01:55:20 - XML: Start document: iteration 0
Fri 17 Jan 2014 01:55:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43858357
Fri 17 Jan 2014 01:55:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:55:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:55:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:55:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:55:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:55:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:55:31 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:55:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:55:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 01:55:32 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:55:32 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:55:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 01:55:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:55:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:55:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:55:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:55:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:55:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:55:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:55:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:55:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:55:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9026 values 142439 bits 17804 bytes 
Fri 17 Jan 2014 01:55:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:55:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:55:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:55:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:55:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:55:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:55:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:55:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:55:42 - XML: Processed 655558 elements - found 680 jobs
Fri 17 Jan 2014 01:55:42 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 01:55:42 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 01:55:42 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:55:42 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:55:46 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:55:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 01:55:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:55:46 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:55:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43847574
Fri 17 Jan 2014 01:55:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:55:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43847574
Fri 17 Jan 2014 01:55:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:55:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:55:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:55:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:55:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:55:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:55:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:55:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:55:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:55:58 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:55:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:55:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:55:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:55:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:55:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:56:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:56:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:56:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:56:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:56:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:56:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:56:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:56:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:56:04 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:56:04 - job_xml_thread(): Done retrieving: data size 43873215
Fri 17 Jan 2014 01:56:04 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:56:04 - XML: Start document: iteration 1
Fri 17 Jan 2014 01:56:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873215
Fri 17 Jan 2014 01:56:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:56:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873215
Fri 17 Jan 2014 01:56:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:56:08 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:56:08 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 01:56:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:56:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:56:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:56:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:56:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:56:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:56:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:56:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:56:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:56:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:56:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:56:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:56:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:56:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:56:27 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:56:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:56:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:56:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:56:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:56:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:56:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:56:28 - XML: Processed 655556 elements - found 679 jobs
Fri 17 Jan 2014 01:56:28 - job 7346238 appears to have finished
Fri 17 Jan 2014 01:56:28 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 01:56:28 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 01:56:28 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 01:56:28 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:56:28 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:56:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:56:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43871770
Fri 17 Jan 2014 01:56:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:56:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43871770
Fri 17 Jan 2014 01:56:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:56:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:56:32 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:56:33 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:56:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 01:56:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:56:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 01:56:33 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:56:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148672 bits 18584 bytes 
Fri 17 Jan 2014 01:56:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:56:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:56:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:56:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:56:43 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:56:43 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:56:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:56:45 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:56:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:56:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:56:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:56:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:56:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:56:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:56:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:56:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:56:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:56:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:56:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:56:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:56:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:56:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:56:51 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:56:51 - job_xml_thread(): Done retrieving: data size 43883682
Fri 17 Jan 2014 01:56:51 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:56:51 - XML: Start document: iteration 2
Fri 17 Jan 2014 01:56:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43883682
Fri 17 Jan 2014 01:56:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:56:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43883682
Fri 17 Jan 2014 01:56:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:57:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:57:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:57:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:57:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:57:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:57:07 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:57:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:57:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:57:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:57:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:57:09 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:57:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:57:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:57:13 - XML: Processed 655558 elements - found 680 jobs
Fri 17 Jan 2014 01:57:13 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 01:57:13 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 01:57:13 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 01:57:13 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:57:13 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:57:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:57:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:57:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:57:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:57:15 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:57:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 01:57:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:57:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:57:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:57:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:57:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:57:17 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:57:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873829
Fri 17 Jan 2014 01:57:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:57:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873829
Fri 17 Jan 2014 01:57:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:57:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:57:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:57:29 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:57:29 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:57:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:57:29 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:57:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:57:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:57:30 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:57:30 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:57:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:57:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:57:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:57:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:57:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:57:32 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:57:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:57:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:57:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:57:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:57:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:57:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:57:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:57:33 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:57:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:57:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 01:57:34 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:57:34 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:57:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5760 values 90869 bits 11358 bytes 
Fri 17 Jan 2014 01:57:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 01:57:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:57:35 - job_xml_thread(): Done retrieving: data size 43890154
Fri 17 Jan 2014 01:57:35 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:57:35 - XML: Start document: iteration 3
Fri 17 Jan 2014 01:57:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43890154
Fri 17 Jan 2014 01:57:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43890154
Fri 17 Jan 2014 01:57:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:57:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:57:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:57:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:57:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:57:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:57:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:57:50 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:57:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:57:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:57:51 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:57:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:57:51 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:57:51 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:57:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:57:56 - XML: Processed 655558 elements - found 680 jobs
Fri 17 Jan 2014 01:57:56 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 01:57:56 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 01:57:56 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:57:56 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:57:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:57:59 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:57:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:57:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:57:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:57:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:57:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:57:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:58:01 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:58:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 01:58:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:58:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:58:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862112
Fri 17 Jan 2014 01:58:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:58:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862112
Fri 17 Jan 2014 01:58:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:58:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:58:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:58:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:58:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:58:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:58:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:58:11 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:58:11 - job_xml_thread(): Done retrieving: data size 43862112
Fri 17 Jan 2014 01:58:11 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:58:11 - XML: Start document: iteration 4
Fri 17 Jan 2014 01:58:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:58:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:58:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:58:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:58:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:58:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:58:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:58:20 - XML: Processed 655560 elements - found 681 jobs
Fri 17 Jan 2014 01:58:20 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 01:58:20 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 01:58:20 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 01:58:20 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:58:20 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:58:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:58:23 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:58:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:58:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:58:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:58:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:58:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:58:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:58:26 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:58:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43860850
Fri 17 Jan 2014 01:58:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:58:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43860850
Fri 17 Jan 2014 01:58:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:58:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:58:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:58:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:58:34 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:58:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:58:35 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:58:35 - job_xml_thread(): Done retrieving: data size 43860850
Fri 17 Jan 2014 01:58:35 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:58:35 - XML: Start document: iteration 5
Fri 17 Jan 2014 01:58:35 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:58:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 01:58:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 01:58:35 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:58:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7447 values 117489 bits 14686 bytes 
Fri 17 Jan 2014 01:58:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:58:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:58:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:58:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:58:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:58:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:58:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:58:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:58:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:58:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:58:43 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:58:47 - XML: Processed 655560 elements - found 681 jobs
Fri 17 Jan 2014 01:58:47 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 01:58:47 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 01:58:47 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:58:47 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:58:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:58:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:58:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:58:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:58:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:58:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:58:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:58:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:58:53 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:58:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43887622
Fri 17 Jan 2014 01:58:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:58:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43887622
Fri 17 Jan 2014 01:58:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:58:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:58:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:59:02 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:59:03 - job_xml_thread(): Done retrieving: data size 43887622
Fri 17 Jan 2014 01:59:03 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:59:03 - XML: Start document: iteration 6
Fri 17 Jan 2014 01:59:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:59:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:59:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:59:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:59:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:59:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:59:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:59:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:59:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:59:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:59:10 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:59:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:59:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:59:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:59:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:59:17 - XML: Processed 655562 elements - found 682 jobs
Fri 17 Jan 2014 01:59:17 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 01:59:17 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 01:59:17 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 01:59:17 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:59:17 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:59:17 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:59:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 01:59:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:59:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:59:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:59:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:59:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:59:19 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 01:59:19 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 01:59:19 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:59:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:59:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43796112
Fri 17 Jan 2014 01:59:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:59:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43796112
Fri 17 Jan 2014 01:59:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:59:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:59:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:59:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:59:31 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:59:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:59:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:59:32 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:59:32 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:59:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:59:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:59:32 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 01:59:32 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 01:59:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:59:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:59:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 01:59:34 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 01:59:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 01:59:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 01:59:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:59:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 01:59:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 01:59:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 01:59:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:59:35 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:59:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:59:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 01:59:35 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 01:59:35 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:59:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5854 values 92346 bits 11543 bytes 
Fri 17 Jan 2014 01:59:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 01:59:37 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 01:59:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43333971
Fri 17 Jan 2014 01:59:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 01:59:37 - job_xml_thread(): Done retrieving: data size 43333971
Fri 17 Jan 2014 01:59:37 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 01:59:38 - XML: Start document: iteration 7
Fri 17 Jan 2014 01:59:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43333971
Fri 17 Jan 2014 01:59:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 01:59:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 01:59:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:59:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 01:59:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 01:59:55 - XML: Processed 648654 elements - found 681 jobs
Fri 17 Jan 2014 01:59:55 - job 7347147 appears to have finished
Fri 17 Jan 2014 01:59:55 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 01:59:55 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 01:59:56 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 01:59:57 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 01:59:57 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 01:59:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 01:59:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 01:59:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 01:59:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 01:59:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:59:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 01:59:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 01:59:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 01:59:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:00:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:00:01 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:00:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:00:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:00:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:00:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:00:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:00:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:00:02 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:00:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 02:00:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:00:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:00:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43211061
Fri 17 Jan 2014 02:00:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:00:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43211061
Fri 17 Jan 2014 02:00:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:00:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:00:13 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:00:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:00:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:00:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:00:14 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:00:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:00:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:00:14 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:00:14 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:00:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:00:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:00:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:00:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:00:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:00:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:00:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:00:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:00:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:00:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:00:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:00:18 - job_xml_thread(): Done retrieving: data size 43274817
Fri 17 Jan 2014 02:00:18 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:00:18 - XML: Start document: iteration 8
Fri 17 Jan 2014 02:00:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43274817
Fri 17 Jan 2014 02:00:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43274817
Fri 17 Jan 2014 02:00:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:00:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:00:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:00:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:00:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:00:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:00:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:00:35 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:00:35 - XML: Processed 648108 elements - found 681 jobs
Fri 17 Jan 2014 02:00:36 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 02:00:36 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 02:00:36 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:00:36 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:00:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:00:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 02:00:36 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:00:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7989 values 126049 bits 15756 bytes 
Fri 17 Jan 2014 02:00:36 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:00:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 02:00:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:00:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:00:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:00:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:00:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:00:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:00:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:00:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:00:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:00:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:00:38 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:00:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:00:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:00:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:00:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:00:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:00:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:00:40 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:00:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 02:00:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:00:41 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:00:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43630765
Fri 17 Jan 2014 02:00:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:00:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43630765
Fri 17 Jan 2014 02:00:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:00:51 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:00:51 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:00:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:00:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:00:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:00:54 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:00:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:00:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:00:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:00:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:00:54 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:00:54 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:00:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:00:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:00:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:00:55 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:00:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:00:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:00:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:00:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:00:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:00:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:00:56 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:00:56 - job_xml_thread(): Done retrieving: data size 43851469
Fri 17 Jan 2014 02:00:56 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:00:56 - XML: Start document: iteration 9
Fri 17 Jan 2014 02:00:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851469
Fri 17 Jan 2014 02:00:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:00:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851469
Fri 17 Jan 2014 02:00:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:01:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:01:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:01:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:01:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:01:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:01:13 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:01:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:01:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:01:14 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:01:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:01:14 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:01:14 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:01:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:01:16 - XML: Processed 655176 elements - found 681 jobs
Fri 17 Jan 2014 02:01:16 - job 7347155 appears to have finished
Fri 17 Jan 2014 02:01:16 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 02:01:16 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 02:01:16 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 02:01:16 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:01:16 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:01:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:01:19 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:01:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:01:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:01:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:01:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:01:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:01:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:01:21 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:01:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873408
Fri 17 Jan 2014 02:01:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:01:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873408
Fri 17 Jan 2014 02:01:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:01:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:01:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:01:31 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:01:31 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:01:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:01:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:01:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:01:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:01:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:01:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:01:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:01:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:01:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:01:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:01:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:01:35 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:01:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:01:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:01:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:01:36 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:01:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:01:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:01:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:01:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:01:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:01:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 02:01:36 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:01:36 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:01:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148791 bits 18598 bytes 
Fri 17 Jan 2014 02:01:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 02:01:38 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:01:38 - job_xml_thread(): Done retrieving: data size 43886552
Fri 17 Jan 2014 02:01:38 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:01:38 - XML: Start document: iteration 10
Fri 17 Jan 2014 02:01:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43886552
Fri 17 Jan 2014 02:01:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:01:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43886552
Fri 17 Jan 2014 02:01:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:01:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:01:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:01:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:01:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:01:56 - XML: Processed 655558 elements - found 680 jobs
Fri 17 Jan 2014 02:01:56 - job 7347108 appears to have finished
Fri 17 Jan 2014 02:01:56 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 02:01:56 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 02:01:57 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 02:01:57 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:01:57 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:01:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:01:58 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:01:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:01:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:01:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:01:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:01:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:01:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:01:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:02:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:02:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:02:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:02:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:02:03 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:02:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 02:02:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:02:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:02:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:02:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:02:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:02:04 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:02:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43877214
Fri 17 Jan 2014 02:02:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:02:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43877214
Fri 17 Jan 2014 02:02:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:02:08 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 02:02:08 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:02:10 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:02:10 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 02:02:10 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:02:11 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 02:02:11 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 02:02:12 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:02:12 - job_xml_thread(): Done retrieving: data size 43877214
Fri 17 Jan 2014 02:02:12 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:02:12 - XML: Start document: iteration 11
Fri 17 Jan 2014 02:02:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:02:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:02:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:02:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:02:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:02:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:02:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:02:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:02:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:02:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:02:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:02:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:02:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:02:23 - XML: Processed 655560 elements - found 681 jobs
Fri 17 Jan 2014 02:02:23 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 02:02:23 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 02:02:23 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 02:02:23 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:02:23 - job_xml_thread(): Sleeping.. (15s)
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Fri 17 Jan 2014 02:02:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:02:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:02:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:02:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:02:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:02:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:02:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:02:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:02:29 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:02:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43869752
Fri 17 Jan 2014 02:02:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:02:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43869752
Fri 17 Jan 2014 02:02:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:02:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:02:36 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:02:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:02:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:02:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:02:37 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:02:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 02:02:37 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:02:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 02:02:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8218 values 130120 bits 16265 bytes 
Fri 17 Jan 2014 02:02:38 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:02:39 - job_xml_thread(): Done retrieving: data size 43869752
Fri 17 Jan 2014 02:02:39 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:02:39 - XML: Start document: iteration 12
Fri 17 Jan 2014 02:02:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:02:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:02:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:02:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:02:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:02:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:02:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:02:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:02:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:02:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:02:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:02:48 - XML: Processed 655560 elements - found 681 jobs
Fri 17 Jan 2014 02:02:48 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 02:02:48 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 02:02:48 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:02:48 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:02:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:02:52 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:02:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:02:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:02:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:02:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:02:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:02:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:02:54 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:02:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875768
Fri 17 Jan 2014 02:02:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:02:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875768
Fri 17 Jan 2014 02:02:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:02:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:02:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:03:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:03:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:03:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:03:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:03:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:03:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:03:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:03:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:03:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875768
Fri 17 Jan 2014 02:03:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:03:04 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:03:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:03:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:03:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:03:11 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:03:11 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:03:12 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:03:12 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 02:03:12 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 02:03:12 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:03:12 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Fri 17 Jan 2014 02:03:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:03:14 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:03:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:03:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:03:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:03:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:03:17 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:03:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 02:03:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:03:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:03:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:03:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:03:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:03:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:03:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:03:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:03:18 - job_xml_thread(): Done retrieving: data size 43849376
Fri 17 Jan 2014 02:03:18 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:03:18 - XML: Start document: iteration 13
Fri 17 Jan 2014 02:03:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43849376
Fri 17 Jan 2014 02:03:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:03:20 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:03:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:03:20 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:03:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:03:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43849376
Fri 17 Jan 2014 02:03:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:03:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:03:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:03:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:03:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:03:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:03:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:03:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:03:37 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:03:37 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:03:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:03:37 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:03:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:03:37 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:03:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:03:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 02:03:37 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:03:38 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:03:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5901 values 93354 bits 11669 bytes 
Fri 17 Jan 2014 02:03:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 02:03:40 - XML: Processed 655564 elements - found 683 jobs
Fri 17 Jan 2014 02:03:40 - job 7347178 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 02:03:40 - job 7347177 field 'start_timestamp' changed since saved from: 1389920467 to: 1389920408
Fri 17 Jan 2014 02:03:40 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 02:03:40 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 02:03:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:03:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:03:41 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 02:03:41 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:03:41 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:03:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:03:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:03:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:03:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:03:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:03:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:03:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:03:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43883692
Fri 17 Jan 2014 02:03:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:03:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43883692
Fri 17 Jan 2014 02:03:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:03:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:03:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:03:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:03:53 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:03:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:03:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:03:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:03:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:03:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:03:55 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:03:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:03:56 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:03:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:03:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:03:57 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:03:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 02:03:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:03:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:03:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:03:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:03:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:03:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:03:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:03:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:03:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43883649
Fri 17 Jan 2014 02:03:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:03:58 - job_xml_thread(): Done retrieving: data size 43883649
Fri 17 Jan 2014 02:03:59 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:03:59 - XML: Start document: iteration 14
Fri 17 Jan 2014 02:03:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43883649
Fri 17 Jan 2014 02:03:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:04:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:04:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:04:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:04:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:04:12 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:04:13 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:04:14 - XML: Processed 655562 elements - found 682 jobs
Fri 17 Jan 2014 02:04:14 - job 7347158 appears to have finished
Fri 17 Jan 2014 02:04:14 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 02:04:14 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 02:04:14 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:04:14 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:04:14 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 02:04:14 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 02:04:15 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 02:04:15 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 02:04:15 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:04:15 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:04:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:04:16 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:04:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:04:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:04:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:04:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:04:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:04:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:04:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:04:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:04:21 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:04:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:04:21 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 1003628 values 15850010 bits 1981251 bytes 
Fri 17 Jan 2014 02:04:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:04:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:04:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:04:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:04:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:04:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:04:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43905308
Fri 17 Jan 2014 02:04:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:04:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43905308
Fri 17 Jan 2014 02:04:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:04:30 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:04:30 - job_xml_thread(): Done retrieving: data size 43905308
Fri 17 Jan 2014 02:04:30 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:04:30 - XML: Start document: iteration 15
Fri 17 Jan 2014 02:04:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:04:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:04:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:04:34 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:04:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:04:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:04:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:04:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:04:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:04:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:04:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:04:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:04:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:04:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:04:38 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:04:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:04:39 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:04:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 02:04:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 02:04:39 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:04:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8905 values 140631 bits 17578 bytes 
Fri 17 Jan 2014 02:04:42 - XML: Processed 655562 elements - found 682 jobs
Fri 17 Jan 2014 02:04:42 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 02:04:42 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 02:04:42 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:04:42 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:04:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:04:45 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:04:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:04:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:04:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:04:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:04:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:04:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:04:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:04:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43854170
Fri 17 Jan 2014 02:04:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:04:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43854170
Fri 17 Jan 2014 02:04:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:04:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:04:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:04:57 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:04:57 - job_xml_thread(): Done retrieving: data size 43854170
Fri 17 Jan 2014 02:04:57 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:04:57 - XML: Start document: iteration 16
Fri 17 Jan 2014 02:05:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:05:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:05:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:05:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:05:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:05:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:05:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:05:14 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:05:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:05:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:05:14 - XML: Processed 655564 elements - found 683 jobs
Fri 17 Jan 2014 02:05:14 - job 7347161 appears to have finished
Fri 17 Jan 2014 02:05:14 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 02:05:14 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 02:05:14 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 02:05:14 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:05:14 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:05:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:05:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:05:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:05:14 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:05:14 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:05:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:05:14 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:05:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:05:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:05:14 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:05:14 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 02:05:15 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:05:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 02:05:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:05:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:05:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43813313
Fri 17 Jan 2014 02:05:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:05:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43813313
Fri 17 Jan 2014 02:05:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:05:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:05:28 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:05:29 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:05:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:05:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:05:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:05:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:05:29 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:05:30 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:05:30 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:05:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:05:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:05:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:05:32 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:05:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:05:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:05:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:05:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:05:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:05:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:05:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:05:35 - job_xml_thread(): Done retrieving: data size 43371031
Fri 17 Jan 2014 02:05:35 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:05:35 - XML: Start document: iteration 17
Fri 17 Jan 2014 02:05:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43371031
Fri 17 Jan 2014 02:05:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43371031
Fri 17 Jan 2014 02:05:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:05:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:05:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:05:39 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:05:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:05:41 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:05:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 02:05:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 02:05:41 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:05:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8653 values 136553 bits 17069 bytes 
Fri 17 Jan 2014 02:05:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:05:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:05:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:05:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:05:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:05:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:05:57 - XML: Processed 649348 elements - found 681 jobs
Fri 17 Jan 2014 02:05:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:05:57 - job 7347156 appears to have finished
Fri 17 Jan 2014 02:05:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:05:57 - job 7347145 appears to have finished
Fri 17 Jan 2014 02:05:57 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 02:05:57 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 02:05:58 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 02:05:58 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:05:58 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:05:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:05:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:05:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:05:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:05:59 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:05:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:05:59 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:05:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:05:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:06:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:06:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:06:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:06:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:06:00 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 02:06:00 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 02:06:00 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:06:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:06:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43215197
Fri 17 Jan 2014 02:06:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:06:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43215197
Fri 17 Jan 2014 02:06:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:06:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:06:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:06:13 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:06:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:06:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:06:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:06:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:06:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:06:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:06:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:06:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:06:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:06:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:06:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:06:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:06:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:06:16 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:06:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 02:06:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:06:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:06:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:06:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:06:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:06:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:06:18 - job_xml_thread(): Done retrieving: data size 43270967
Fri 17 Jan 2014 02:06:18 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:06:18 - XML: Start document: iteration 18
Fri 17 Jan 2014 02:06:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43270967
Fri 17 Jan 2014 02:06:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43270967
Fri 17 Jan 2014 02:06:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:06:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:06:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:06:29 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:06:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:06:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:06:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:06:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:06:31 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:06:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:06:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:06:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:06:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:06:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:06:40 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:06:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:06:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:06:41 - XML: Processed 648046 elements - found 681 jobs
Fri 17 Jan 2014 02:06:41 - job 7347183 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 02:06:41 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 02:06:41 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 02:06:41 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 02:06:41 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:06:41 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:06:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:06:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:06:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:06:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:06:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:06:41 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:06:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:06:42 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:06:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 02:06:42 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:06:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5841 values 92162 bits 11520 bytes 
Fri 17 Jan 2014 02:06:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 02:06:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:06:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43670803
Fri 17 Jan 2014 02:06:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:06:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43670803
Fri 17 Jan 2014 02:06:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:06:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:06:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:06:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:06:53 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:06:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:06:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:06:54 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:06:54 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:06:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:06:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:06:54 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:06:56 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:06:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:06:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:06:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:06:57 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:06:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:06:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:06:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:06:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:06:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:06:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:06:59 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:06:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 02:06:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:07:00 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:07:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851808
Fri 17 Jan 2014 02:07:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:07:00 - job_xml_thread(): Done retrieving: data size 43851808
Fri 17 Jan 2014 02:07:00 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:07:00 - XML: Start document: iteration 19
Fri 17 Jan 2014 02:07:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851808
Fri 17 Jan 2014 02:07:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:07:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:07:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:07:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:07:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:07:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:07:13 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:07:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:07:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:07:14 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:07:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:07:14 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:07:14 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:07:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:07:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:07:23 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:07:23 - XML: Processed 655434 elements - found 681 jobs
Fri 17 Jan 2014 02:07:23 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 02:07:23 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 02:07:23 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:07:23 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:07:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:07:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:07:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:07:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:07:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:07:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:07:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:07:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43863280
Fri 17 Jan 2014 02:07:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:07:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43863280
Fri 17 Jan 2014 02:07:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:07:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:07:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:07:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:07:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:07:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:07:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:07:39 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:07:39 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:07:39 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:07:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:07:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:07:39 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:07:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:07:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:07:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:07:40 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:07:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:07:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:07:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:07:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:07:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:07:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:07:41 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:07:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43883881
Fri 17 Jan 2014 02:07:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:07:42 - job_xml_thread(): Done retrieving: data size 43883881
Fri 17 Jan 2014 02:07:42 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:07:42 - XML: Start document: iteration 20
Fri 17 Jan 2014 02:07:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43883881
Fri 17 Jan 2014 02:07:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:07:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:07:43 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:07:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:07:44 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:07:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 02:07:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 02:07:44 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:07:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9829 values 155176 bits 19397 bytes 
Fri 17 Jan 2014 02:07:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:07:53 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:07:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:07:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:07:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:07:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:07:55 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:07:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:07:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:07:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:07:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:08:01 - XML: Processed 655554 elements - found 679 jobs
Fri 17 Jan 2014 02:08:01 - job 7347160 appears to have finished
Fri 17 Jan 2014 02:08:01 - job 7347172 appears to have finished
Fri 17 Jan 2014 02:08:01 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 02:08:01 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 02:08:02 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 02:08:02 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:08:02 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:08:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:08:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:08:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:08:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:08:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:08:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:08:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:08:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:08:07 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:08:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43859206
Fri 17 Jan 2014 02:08:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:08:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43859206
Fri 17 Jan 2014 02:08:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:08:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:08:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:08:17 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:08:17 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:08:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:08:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:08:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:08:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:08:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:08:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:08:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:08:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:08:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:08:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:08:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:08:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:08:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:08:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:08:22 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:08:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 02:08:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:08:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:08:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:08:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:08:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:08:24 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:08:24 - job_xml_thread(): Done retrieving: data size 43881222
Fri 17 Jan 2014 02:08:24 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:08:24 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 02:08:24 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 02:08:24 - Housekeeping: done.
Fri 17 Jan 2014 02:08:24 - XML: Start document: iteration 0
Fri 17 Jan 2014 02:08:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43881222
Fri 17 Jan 2014 02:08:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43881222
Fri 17 Jan 2014 02:08:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:08:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:08:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:08:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:08:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:08:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:08:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:08:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:08:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:08:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:08:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:08:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:08:42 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:08:42 - XML: Processed 655556 elements - found 679 jobs
Fri 17 Jan 2014 02:08:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:08:42 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 02:08:42 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:08:42 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 02:08:42 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:08:42 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:08:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:08:44 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:08:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:08:45 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:08:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 02:08:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 02:08:45 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:08:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6018 values 94993 bits 11874 bytes 
Fri 17 Jan 2014 02:08:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:08:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:08:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:08:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:08:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:08:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:08:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:08:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:08:50 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:08:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873587
Fri 17 Jan 2014 02:08:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:08:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873587
Fri 17 Jan 2014 02:08:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:08:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:08:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:08:57 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:08:57 - job_xml_thread(): Done retrieving: data size 43873587
Fri 17 Jan 2014 02:08:57 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:08:57 - XML: Start document: iteration 1
Fri 17 Jan 2014 02:08:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:08:58 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:09:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:09:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:09:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:09:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:09:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:09:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:09:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:09:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:09:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:09:07 - XML: Processed 655558 elements - found 680 jobs
Fri 17 Jan 2014 02:09:07 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 02:09:07 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 02:09:07 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 02:09:07 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:09:07 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:09:10 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:09:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 02:09:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:09:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:09:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:09:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:09:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:09:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:09:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:09:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:09:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:09:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:09:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851994
Fri 17 Jan 2014 02:09:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:09:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851994
Fri 17 Jan 2014 02:09:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:09:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:09:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:09:23 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:09:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:09:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:09:25 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:09:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:09:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:09:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:09:26 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:09:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:09:26 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:09:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:09:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:09:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:09:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:09:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:09:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:09:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:09:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:09:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:09:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:09:30 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:09:30 - job_xml_thread(): Done retrieving: data size 43860218
Fri 17 Jan 2014 02:09:30 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:09:30 - XML: Start document: iteration 2
Fri 17 Jan 2014 02:09:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43860218
Fri 17 Jan 2014 02:09:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:09:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43860218
Fri 17 Jan 2014 02:09:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:09:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:09:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:09:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:09:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:09:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:09:46 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:09:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:09:47 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:09:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 02:09:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 02:09:47 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:09:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8883 values 140165 bits 17520 bytes 
Fri 17 Jan 2014 02:09:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:09:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:09:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:09:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:09:48 - XML: Processed 655558 elements - found 680 jobs
Fri 17 Jan 2014 02:09:48 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 02:09:48 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 02:09:48 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:09:48 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:09:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:09:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:09:49 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:09:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:09:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:09:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:09:52 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:09:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:09:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:09:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:09:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:09:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:09:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:09:54 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:09:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43893464
Fri 17 Jan 2014 02:09:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:09:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43893464
Fri 17 Jan 2014 02:09:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:10:03 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:10:03 - job_xml_thread(): Done retrieving: data size 43893464
Fri 17 Jan 2014 02:10:03 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:10:03 - XML: Start document: iteration 3
Fri 17 Jan 2014 02:10:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:10:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:10:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:10:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:10:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:10:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:10:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:10:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:10:08 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:10:08 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:10:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:10:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:10:08 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:10:13 - XML: Processed 655560 elements - found 681 jobs
Fri 17 Jan 2014 02:10:13 - job 7347184 field 'start_timestamp' changed since saved from: 1389920931 to: 1389920874
Fri 17 Jan 2014 02:10:13 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 02:10:13 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 02:10:14 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 02:10:14 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:10:14 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:10:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:10:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:10:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:10:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:10:18 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:10:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 02:10:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:10:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:10:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:10:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:10:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:10:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:10:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862529
Fri 17 Jan 2014 02:10:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:10:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862529
Fri 17 Jan 2014 02:10:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:10:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:10:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:10:29 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:10:29 - job_xml_thread(): Done retrieving: data size 43862529
Fri 17 Jan 2014 02:10:29 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:10:29 - XML: Start document: iteration 4
Fri 17 Jan 2014 02:10:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:10:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:10:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:10:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:10:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:10:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:10:35 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:10:35 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:10:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:10:35 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:10:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:10:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:10:37 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:10:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:10:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:10:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:10:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:10:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:10:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:10:40 - XML: Processed 655560 elements - found 681 jobs
Fri 17 Jan 2014 02:10:40 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 02:10:40 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 02:10:40 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:10:40 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:10:42 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:10:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870343
Fri 17 Jan 2014 02:10:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:10:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870343
Fri 17 Jan 2014 02:10:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:10:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:10:47 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:10:49 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:10:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:10:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 02:10:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 02:10:49 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:10:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8888 values 140206 bits 17525 bytes 
Fri 17 Jan 2014 02:10:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:10:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:10:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:10:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:10:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:10:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:10:51 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:10:51 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:10:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:10:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870343
Fri 17 Jan 2014 02:10:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:10:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:10:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:10:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:10:55 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:10:55 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:11:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:11:01 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:11:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:11:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:11:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:11:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:11:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:11:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:11:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:11:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:11:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:11:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:11:07 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:11:07 - job_xml_thread(): Done retrieving: data size 43868266
Fri 17 Jan 2014 02:11:07 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:11:07 - XML: Start document: iteration 5
Fri 17 Jan 2014 02:11:08 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:11:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:11:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43868266
Fri 17 Jan 2014 02:11:08 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:11:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:11:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:11:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43868266
Fri 17 Jan 2014 02:11:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:11:15 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 02:11:16 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:11:18 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:11:18 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 02:11:18 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:11:18 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 02:11:18 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 02:11:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:11:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:11:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:11:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:11:23 - XML: Processed 655560 elements - found 681 jobs
Fri 17 Jan 2014 02:11:23 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 02:11:23 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 02:11:23 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:11:23 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:11:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:11:27 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:11:27 - size of cluster 'LISA Cluster': 624 hosts 79473 metrics 957682 values 15108633 bits 1888579 bytes 
Fri 17 Jan 2014 02:11:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:11:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:11:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:11:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:11:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:11:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:11:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:11:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:11:31 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:11:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:11:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:11:31 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:11:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 02:11:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:11:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:11:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:11:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:11:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:11:34 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:11:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43408839
Fri 17 Jan 2014 02:11:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:11:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43408839
Fri 17 Jan 2014 02:11:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:11:38 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:11:39 - job_xml_thread(): Done retrieving: data size 43408839
Fri 17 Jan 2014 02:11:39 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:11:39 - XML: Start document: iteration 6
Fri 17 Jan 2014 02:11:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:11:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:11:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:11:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:11:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:11:49 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:11:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:11:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:11:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:11:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:11:49 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:11:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:11:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:11:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:11:49 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:11:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:11:50 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:11:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 02:11:50 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:11:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 02:11:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5880 values 92811 bits 11601 bytes 
Fri 17 Jan 2014 02:11:57 - XML: Processed 649850 elements - found 681 jobs
Fri 17 Jan 2014 02:11:57 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 02:11:57 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 02:11:57 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:11:57 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:11:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:11:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:11:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:11:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:11:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:11:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:11:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:11:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:12:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:12:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43191681
Fri 17 Jan 2014 02:12:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:12:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43191681
Fri 17 Jan 2014 02:12:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:12:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:12:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:12:08 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:12:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 02:12:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:12:12 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:12:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:12:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:12:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:12:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:12:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:12:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:12:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:12:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:12:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:12:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:12:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:12:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:12:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:12:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:12:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:12:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:12:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:12:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:12:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:12:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:12:19 - job_xml_thread(): Done retrieving: data size 43285305
Fri 17 Jan 2014 02:12:19 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:12:19 - XML: Start document: iteration 7
Fri 17 Jan 2014 02:12:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43285305
Fri 17 Jan 2014 02:12:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:12:20 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:12:20 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 02:12:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43285305
Fri 17 Jan 2014 02:12:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:12:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:12:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:12:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:12:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:12:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:12:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:12:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:12:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:12:37 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:12:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:12:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:12:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:12:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:12:39 - XML: Processed 648106 elements - found 680 jobs
Fri 17 Jan 2014 02:12:39 - job 7347159 appears to have finished
Fri 17 Jan 2014 02:12:39 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 02:12:39 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 02:12:40 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 02:12:40 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:12:40 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:12:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:12:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:12:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:12:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:12:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:12:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:12:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:12:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:12:47 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:12:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43795018
Fri 17 Jan 2014 02:12:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:12:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43795018
Fri 17 Jan 2014 02:12:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:12:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:12:51 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:12:52 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:12:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 02:12:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:12:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 02:12:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:12:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:12:53 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:12:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9153 values 144407 bits 18050 bytes 
Fri 17 Jan 2014 02:12:55 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:12:55 - job_xml_thread(): Done retrieving: data size 43795018
Fri 17 Jan 2014 02:12:55 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:12:55 - XML: Start document: iteration 8
Fri 17 Jan 2014 02:12:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:12:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:13:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:13:00 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:13:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:13:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:13:01 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:13:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:13:01 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:13:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:13:01 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:13:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:13:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:13:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:13:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:13:10 - XML: Processed 654852 elements - found 680 jobs
Fri 17 Jan 2014 02:13:10 - job 7347151 appears to have finished
Fri 17 Jan 2014 02:13:10 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 02:13:10 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 02:13:10 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 02:13:10 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:13:10 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:13:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:13:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:13:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:13:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:13:14 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:13:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862834
Fri 17 Jan 2014 02:13:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:13:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862834
Fri 17 Jan 2014 02:13:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:13:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:13:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:13:25 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:13:25 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:13:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:13:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:13:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:13:28 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:13:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:13:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:13:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:13:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:13:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:13:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:13:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:13:30 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:13:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:13:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:13:30 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:13:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 02:13:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:13:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:13:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:13:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:13:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:13:33 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:13:33 - job_xml_thread(): Done retrieving: data size 43857644
Fri 17 Jan 2014 02:13:33 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:13:33 - XML: Start document: iteration 9
Fri 17 Jan 2014 02:13:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43857644
Fri 17 Jan 2014 02:13:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:13:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43857644
Fri 17 Jan 2014 02:13:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:13:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:13:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:13:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:13:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:13:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:13:53 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:13:53 - XML: Processed 655558 elements - found 680 jobs
Fri 17 Jan 2014 02:13:53 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 02:13:53 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 02:13:53 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:13:53 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:13:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:13:53 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:13:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:13:53 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:13:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:13:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 02:13:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 02:13:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:13:53 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:13:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5786 values 91231 bits 11403 bytes 
Fri 17 Jan 2014 02:13:54 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:13:54 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:13:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:13:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:13:54 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:13:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:13:57 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:13:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:13:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:13:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:13:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:13:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:13:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:14:00 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:14:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43860042
Fri 17 Jan 2014 02:14:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:14:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43860042
Fri 17 Jan 2014 02:14:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:14:08 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:14:08 - job_xml_thread(): Done retrieving: data size 43860042
Fri 17 Jan 2014 02:14:08 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:14:08 - XML: Start document: iteration 10
Fri 17 Jan 2014 02:14:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:14:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:14:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:14:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:14:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:14:14 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:14:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:14:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:14:14 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:14:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:14:14 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:14:14 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:14:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:14:19 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:14:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 02:14:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:14:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:14:23 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:14:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:14:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:14:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:14:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:14:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:14:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:14:24 - XML: Processed 655560 elements - found 681 jobs
Fri 17 Jan 2014 02:14:24 - job 7347186 field 'start_timestamp' changed since saved from: 1389921160 to: 1389921105
Fri 17 Jan 2014 02:14:24 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 02:14:24 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 02:14:24 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 02:14:24 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:14:24 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:14:27 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:14:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43869197
Fri 17 Jan 2014 02:14:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:14:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43869197
Fri 17 Jan 2014 02:14:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:14:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:14:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:14:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:14:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:14:39 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:14:40 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:14:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:14:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:14:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:14:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:14:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:14:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:14:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:14:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:14:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:14:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:14:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:14:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:14:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:14:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:14:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:14:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:14:44 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 02:14:44 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 02:14:44 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:14:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:14:45 - job_xml_thread(): Done retrieving: data size 43873191
Fri 17 Jan 2014 02:14:45 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:14:45 - XML: Start document: iteration 11
Fri 17 Jan 2014 02:14:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873191
Fri 17 Jan 2014 02:14:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:14:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873191
Fri 17 Jan 2014 02:14:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:14:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:14:53 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:14:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:14:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:14:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:14:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 02:14:55 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:14:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 02:14:55 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:14:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8967 values 141502 bits 17687 bytes 
Fri 17 Jan 2014 02:14:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:14:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:15:03 - XML: Processed 655557 elements - found 681 jobs
Fri 17 Jan 2014 02:15:03 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 02:15:03 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 02:15:03 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:15:03 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:15:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:15:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:15:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:15:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:15:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:15:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:15:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:15:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:15:05 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:15:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:15:08 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:15:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:15:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:15:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:15:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:15:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:15:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:15:10 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:15:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43883381
Fri 17 Jan 2014 02:15:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:15:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43883381
Fri 17 Jan 2014 02:15:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:15:19 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:15:19 - job_xml_thread(): Done retrieving: data size 43883381
Fri 17 Jan 2014 02:15:19 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:15:19 - XML: Start document: iteration 12
Fri 17 Jan 2014 02:15:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:15:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:15:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:15:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:15:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:15:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:15:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:15:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:15:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:15:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:15:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:15:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:15:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:15:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:15:30 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:15:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:15:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:15:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:15:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:15:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:15:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:15:32 - XML: Processed 655560 elements - found 681 jobs
Fri 17 Jan 2014 02:15:32 - job 7347187 field 'start_timestamp' changed since saved from: 1389921252 to: 1389921183
Fri 17 Jan 2014 02:15:32 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 02:15:32 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 02:15:32 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 02:15:32 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:15:32 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:15:32 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:15:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 02:15:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:15:34 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:15:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43854111
Fri 17 Jan 2014 02:15:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:15:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43854111
Fri 17 Jan 2014 02:15:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:15:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:15:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:15:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:15:45 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:15:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:15:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:15:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:15:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:15:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:15:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:15:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:15:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:15:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:15:47 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:15:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:15:48 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:15:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:15:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:15:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:15:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:15:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:15:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:15:50 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:15:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43891151
Fri 17 Jan 2014 02:15:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:15:50 - job_xml_thread(): Done retrieving: data size 43891151
Fri 17 Jan 2014 02:15:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43891151
Fri 17 Jan 2014 02:15:50 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:15:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:15:51 - XML: Start document: iteration 13
Fri 17 Jan 2014 02:15:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:15:56 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:15:57 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:15:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 02:15:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:15:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 02:15:57 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:15:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8817 values 139139 bits 17392 bytes 
Fri 17 Jan 2014 02:16:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:16:01 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:16:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:16:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:16:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:16:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:16:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:16:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:16:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:16:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:16:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:16:11 - XML: Processed 655558 elements - found 680 jobs
Fri 17 Jan 2014 02:16:11 - job 7347168 appears to have finished
Fri 17 Jan 2014 02:16:11 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 02:16:11 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 02:16:11 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 02:16:11 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:16:11 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:16:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:16:13 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:16:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:16:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:16:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:16:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:16:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:16:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:16:15 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:16:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 02:16:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:16:15 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:16:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43872738
Fri 17 Jan 2014 02:16:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:16:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43872738
Fri 17 Jan 2014 02:16:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:16:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:16:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:16:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:16:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:16:26 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:16:26 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:16:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:16:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:16:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:16:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:16:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:16:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:16:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:16:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:16:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:16:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:16:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:16:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:16:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:16:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:16:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:16:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:16:31 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:16:31 - job_xml_thread(): Done retrieving: data size 43890729
Fri 17 Jan 2014 02:16:31 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:16:31 - XML: Start document: iteration 14
Fri 17 Jan 2014 02:16:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43890729
Fri 17 Jan 2014 02:16:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43890729
Fri 17 Jan 2014 02:16:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:16:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:16:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:16:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:16:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:16:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:16:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:16:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:16:45 - XML: Processed 655558 elements - found 680 jobs
Fri 17 Jan 2014 02:16:45 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 02:16:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:16:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:16:45 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 02:16:45 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:16:45 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:16:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:16:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:16:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:16:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:16:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:16:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:16:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:16:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:16:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:16:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:16:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:16:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:16:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:16:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:16:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43892327
Fri 17 Jan 2014 02:16:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:16:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43892327
Fri 17 Jan 2014 02:16:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:16:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:16:57 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:17:00 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:17:00 - job_xml_thread(): Done retrieving: data size 43892327
Fri 17 Jan 2014 02:17:00 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:17:00 - XML: Start document: iteration 15
Fri 17 Jan 2014 02:17:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:17:00 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:17:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 02:17:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 02:17:01 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:17:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148979 bits 18622 bytes 
Fri 17 Jan 2014 02:17:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:17:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:17:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:17:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:17:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:17:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:17:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:17:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:17:07 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:17:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:17:08 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:17:08 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:17:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:17:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:17:12 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:17:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:17:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:17:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:17:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:17:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:17:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:17:13 - XML: Processed 655556 elements - found 679 jobs
Fri 17 Jan 2014 02:17:13 - job 7347163 appears to have finished
Fri 17 Jan 2014 02:17:13 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 02:17:13 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 02:17:13 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 02:17:13 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:17:13 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:17:16 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:17:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43811478
Fri 17 Jan 2014 02:17:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:17:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43811478
Fri 17 Jan 2014 02:17:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:17:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:17:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:17:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:17:27 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:17:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:17:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:17:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:17:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:17:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:17:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:17:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:17:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:17:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:17:29 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:17:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:17:31 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:17:31 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:17:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 02:17:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:17:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:17:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:17:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:17:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:17:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:17:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:17:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:17:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43399955
Fri 17 Jan 2014 02:17:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:17:33 - job_xml_thread(): Done retrieving: data size 43399955
Fri 17 Jan 2014 02:17:33 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:17:33 - XML: Start document: iteration 16
Fri 17 Jan 2014 02:17:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43399955
Fri 17 Jan 2014 02:17:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:17:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:17:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:17:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:17:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:17:49 - XML: Processed 649702 elements - found 679 jobs
Fri 17 Jan 2014 02:17:49 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 02:17:49 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 02:17:49 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:17:50 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:17:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:17:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:17:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:17:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:17:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:17:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:17:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:17:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:17:53 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:17:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:17:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:17:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:17:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:17:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:17:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:17:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:17:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:17:56 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:17:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43241164
Fri 17 Jan 2014 02:17:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:17:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43241164
Fri 17 Jan 2014 02:17:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:18:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:18:01 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:18:02 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:18:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 02:18:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:18:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 02:18:02 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:18:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9035 values 142955 bits 17869 bytes 
Fri 17 Jan 2014 02:18:05 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:18:05 - job_xml_thread(): Done retrieving: data size 43241164
Fri 17 Jan 2014 02:18:05 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:18:05 - XML: Start document: iteration 17
Fri 17 Jan 2014 02:18:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:18:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:18:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:18:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:18:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:18:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:18:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:18:09 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:18:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:18:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:18:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:18:14 - XML: Processed 647416 elements - found 679 jobs
Fri 17 Jan 2014 02:18:14 - job 7346025 appears to have finished
Fri 17 Jan 2014 02:18:14 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 02:18:14 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 02:18:14 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 02:18:14 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:18:14 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:18:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:18:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:18:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:18:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:18:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:18:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:18:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:18:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:18:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:18:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43264446
Fri 17 Jan 2014 02:18:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:18:21 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 02:18:21 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:18:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43264446
Fri 17 Jan 2014 02:18:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:18:22 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:18:22 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:18:22 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 02:18:22 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 02:18:22 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 02:18:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:18:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:18:29 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:18:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 02:18:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:18:29 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:18:29 - job_xml_thread(): Done retrieving: data size 43264446
Fri 17 Jan 2014 02:18:29 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:18:29 - XML: Start document: iteration 18
Fri 17 Jan 2014 02:18:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:18:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:18:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:18:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:18:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:18:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:18:35 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:18:35 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:18:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:18:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:18:35 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:18:35 - size of cluster 'LISA Cluster': 624 hosts 79469 metrics 875656 values 13833542 bits 1729192 bytes 
Fri 17 Jan 2014 02:18:43 - XML: Processed 648104 elements - found 679 jobs
Fri 17 Jan 2014 02:18:43 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 02:18:43 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 02:18:43 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:18:43 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:18:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:18:44 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:18:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:18:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:18:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:18:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:18:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:18:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:18:47 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:18:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43801471
Fri 17 Jan 2014 02:18:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:18:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43801471
Fri 17 Jan 2014 02:18:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:18:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:18:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:18:59 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:18:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:18:59 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:18:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:18:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:19:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:19:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:19:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:19:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:19:01 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:19:01 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:19:01 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:19:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:19:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:19:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:19:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:19:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:19:02 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:19:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:19:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:19:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:19:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:19:02 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:19:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:19:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 02:19:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 02:19:02 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:19:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6246 values 98696 bits 12337 bytes 
Fri 17 Jan 2014 02:19:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:19:05 - job_xml_thread(): Done retrieving: data size 43870505
Fri 17 Jan 2014 02:19:05 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:19:05 - XML: Start document: iteration 19
Fri 17 Jan 2014 02:19:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870505
Fri 17 Jan 2014 02:19:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:19:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870505
Fri 17 Jan 2014 02:19:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:19:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:19:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:19:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:19:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:19:22 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:19:22 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 02:19:24 - XML: Processed 655556 elements - found 679 jobs
Fri 17 Jan 2014 02:19:24 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 02:19:24 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 02:19:24 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:19:24 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:19:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:19:25 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:19:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:19:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:19:26 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:19:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:19:26 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:19:26 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:19:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:19:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:19:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:19:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:19:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:19:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:19:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:19:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:19:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:19:30 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:19:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 02:19:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:19:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:19:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43866707
Fri 17 Jan 2014 02:19:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:19:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43866707
Fri 17 Jan 2014 02:19:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:19:39 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:19:39 - job_xml_thread(): Done retrieving: data size 43866707
Fri 17 Jan 2014 02:19:39 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:19:39 - XML: Start document: iteration 20
Fri 17 Jan 2014 02:19:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:19:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:19:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:19:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:19:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:19:46 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:19:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:19:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:19:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:19:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:19:48 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:19:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:19:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:19:55 - XML: Processed 655556 elements - found 679 jobs
Fri 17 Jan 2014 02:19:55 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 02:19:55 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 02:19:55 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:19:55 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:19:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:19:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:19:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:19:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:19:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:19:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:19:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:19:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:19:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:19:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43869088
Fri 17 Jan 2014 02:19:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:20:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43869088
Fri 17 Jan 2014 02:20:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:20:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:20:02 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:20:03 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:20:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:20:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 02:20:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:20:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:20:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 02:20:03 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:20:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8122 values 128176 bits 16022 bytes 
Fri 17 Jan 2014 02:20:10 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:20:10 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:20:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:20:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:20:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:20:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:20:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:20:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:20:12 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:20:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:20:12 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:20:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:20:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:20:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:20:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:20:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:20:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:20:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:20:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:20:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:20:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:20:19 - job_xml_thread(): Done retrieving: data size 43858987
Fri 17 Jan 2014 02:20:19 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:20:19 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 02:20:19 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 02:20:19 - Housekeeping: done.
Fri 17 Jan 2014 02:20:19 - XML: Start document: iteration 0
Fri 17 Jan 2014 02:20:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43858987
Fri 17 Jan 2014 02:20:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:20:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858987
Fri 17 Jan 2014 02:20:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:20:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:20:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:20:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:20:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:20:39 - XML: Processed 655556 elements - found 679 jobs
Fri 17 Jan 2014 02:20:39 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 02:20:39 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 02:20:39 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:20:39 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:20:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:20:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:20:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:20:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:20:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:20:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:20:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:20:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:20:40 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:20:41 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:20:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 02:20:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:20:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:20:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:20:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:20:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:20:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:20:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:20:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:20:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:20:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:20:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43894388
Fri 17 Jan 2014 02:20:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:20:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43894388
Fri 17 Jan 2014 02:20:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:20:54 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:20:54 - job_xml_thread(): Done retrieving: data size 43894388
Fri 17 Jan 2014 02:20:54 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:20:55 - XML: Start document: iteration 1
Fri 17 Jan 2014 02:20:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:20:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:20:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:20:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:20:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:20:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:20:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:20:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:21:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:21:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:21:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:21:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:21:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:21:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:21:03 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:21:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:21:05 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:21:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 02:21:05 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:21:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 02:21:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5947 values 93894 bits 11736 bytes 
Fri 17 Jan 2014 02:21:08 - XML: Processed 655554 elements - found 678 jobs
Fri 17 Jan 2014 02:21:08 - job 7347162 appears to have finished
Fri 17 Jan 2014 02:21:08 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 02:21:08 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 02:21:08 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 02:21:08 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:21:08 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:21:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:21:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:21:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:21:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:21:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:21:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:21:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:21:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:21:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:21:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43866757
Fri 17 Jan 2014 02:21:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:21:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43866757
Fri 17 Jan 2014 02:21:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:21:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:21:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:21:23 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:21:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:21:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:21:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:21:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:21:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:21:25 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:21:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:21:25 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:21:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:21:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:21:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:21:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:21:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:21:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:21:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:21:28 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:21:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 02:21:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:21:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:21:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:21:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:21:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:21:31 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:21:31 - job_xml_thread(): Done retrieving: data size 43878756
Fri 17 Jan 2014 02:21:31 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:21:31 - XML: Start document: iteration 2
Fri 17 Jan 2014 02:21:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43878756
Fri 17 Jan 2014 02:21:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:21:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43878756
Fri 17 Jan 2014 02:21:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:21:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:21:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:21:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:21:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:21:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:21:48 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:21:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:21:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:21:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:21:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:21:49 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:21:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:21:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:21:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:21:52 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:21:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:21:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:21:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:21:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:21:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:21:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:21:55 - XML: Processed 655556 elements - found 679 jobs
Fri 17 Jan 2014 02:21:55 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 02:21:55 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 02:21:55 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 02:21:55 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:21:55 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:21:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:21:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43880437
Fri 17 Jan 2014 02:21:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:21:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43880437
Fri 17 Jan 2014 02:21:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:22:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:22:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:22:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:22:05 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:22:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:22:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 02:22:06 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:22:06 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:22:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 02:22:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8836 values 139415 bits 17426 bytes 
Fri 17 Jan 2014 02:22:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:22:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:22:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:22:07 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:22:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:22:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:22:08 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:22:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:22:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43880437
Fri 17 Jan 2014 02:22:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:22:08 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:22:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:22:10 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:22:10 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:22:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:22:21 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:22:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:22:21 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:22:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:22:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:22:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:22:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:22:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:22:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:22:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:22:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:22:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:22:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:22:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:22:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:22:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:22:25 - job_xml_thread(): Done retrieving: data size 43858929
Fri 17 Jan 2014 02:22:25 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:22:25 - XML: Start document: iteration 3
Fri 17 Jan 2014 02:22:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858929
Fri 17 Jan 2014 02:22:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43858929
Fri 17 Jan 2014 02:22:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:22:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:22:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:22:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:22:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:22:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:22:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:22:41 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:22:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:22:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:22:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:22:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:22:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:22:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:22:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:22:46 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:22:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 02:22:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:22:49 - XML: Processed 655558 elements - found 680 jobs
Fri 17 Jan 2014 02:22:49 - job 7346263 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 02:22:49 - job 7346260 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 02:22:49 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 02:22:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:22:49 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 02:22:49 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:22:50 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 02:22:50 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:22:50 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:22:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:22:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:22:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:22:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:22:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:22:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:22:50 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 02:22:50 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 02:22:50 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:22:51 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:22:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867217
Fri 17 Jan 2014 02:22:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:22:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43867217
Fri 17 Jan 2014 02:22:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:22:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:22:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:23:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:23:00 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:23:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:23:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:23:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:23:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:23:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:23:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:23:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:23:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:23:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:23:05 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:23:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:23:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:23:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:23:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:23:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:23:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:23:06 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:23:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43890745
Fri 17 Jan 2014 02:23:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:23:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:23:07 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:23:07 - job_xml_thread(): Done retrieving: data size 43890745
Fri 17 Jan 2014 02:23:07 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:23:07 - XML: Start document: iteration 4
Fri 17 Jan 2014 02:23:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43890745
Fri 17 Jan 2014 02:23:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:23:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:23:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 02:23:07 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:23:07 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:23:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 02:23:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7978 values 125888 bits 15736 bytes 
Fri 17 Jan 2014 02:23:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:23:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:23:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:23:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:23:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:23:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:23:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:23:20 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:23:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:23:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:23:20 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:23:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:23:20 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:23:25 - XML: Processed 655548 elements - found 681 jobs
Fri 17 Jan 2014 02:23:25 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 02:23:25 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 02:23:25 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 02:23:25 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:23:25 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:23:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:23:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:23:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:23:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:23:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:23:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:23:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:23:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:23:30 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:23:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43796798
Fri 17 Jan 2014 02:23:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:23:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43796798
Fri 17 Jan 2014 02:23:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:23:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:23:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:23:40 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:23:40 - job_xml_thread(): Done retrieving: data size 43796798
Fri 17 Jan 2014 02:23:40 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:23:40 - XML: Start document: iteration 5
Fri 17 Jan 2014 02:23:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:23:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:23:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:23:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:23:45 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:23:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:23:45 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:23:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:23:45 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:23:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:23:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:23:49 - XML: Processed 654800 elements - found 681 jobs
Fri 17 Jan 2014 02:23:49 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 02:23:49 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 02:23:49 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:23:49 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:23:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:23:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:23:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:23:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:23:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:23:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:23:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:23:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:23:51 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:23:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 02:23:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:23:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:23:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43235982
Fri 17 Jan 2014 02:23:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:23:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43235982
Fri 17 Jan 2014 02:23:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:24:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:24:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:24:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:24:00 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:24:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:24:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:24:01 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:24:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:24:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43235982
Fri 17 Jan 2014 02:24:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:24:01 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:24:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:24:04 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:24:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:24:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:24:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:24:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:24:08 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:24:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:24:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 02:24:09 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:24:09 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:24:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5362 values 84536 bits 10567 bytes 
Fri 17 Jan 2014 02:24:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 02:24:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:24:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:24:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:24:12 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:24:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:24:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:24:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:24:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:24:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:24:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:24:14 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:24:14 - job_xml_thread(): Done retrieving: data size 43234142
Fri 17 Jan 2014 02:24:14 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:24:14 - XML: Start document: iteration 6
Fri 17 Jan 2014 02:24:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43234142
Fri 17 Jan 2014 02:24:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:24:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:24:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:24:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:24:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:24:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:24:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:24:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43234142
Fri 17 Jan 2014 02:24:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:24:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:24:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:24:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:24:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:24:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:24:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:24:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:24:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:24:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:24:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:24:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:24:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:24:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:24:38 - XML: Processed 647632 elements - found 679 jobs
Fri 17 Jan 2014 02:24:38 - job 7346751 appears to have finished
Fri 17 Jan 2014 02:24:38 - job 7347149 appears to have finished
Fri 17 Jan 2014 02:24:38 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 02:24:38 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 02:24:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:24:38 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:24:38 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 02:24:38 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:24:38 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:24:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:24:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:24:39 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:24:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 02:24:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:24:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:24:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:24:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:24:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:24:40 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:24:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43700933
Fri 17 Jan 2014 02:24:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:24:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43700933
Fri 17 Jan 2014 02:24:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:24:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:24:49 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:24:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:24:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:24:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:24:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:24:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:24:52 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:24:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:24:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:24:53 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:24:53 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:24:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:24:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:24:55 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:24:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43841958
Fri 17 Jan 2014 02:24:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:24:55 - job_xml_thread(): Done retrieving: data size 43841958
Fri 17 Jan 2014 02:24:55 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:24:55 - XML: Start document: iteration 7
Fri 17 Jan 2014 02:24:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:24:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:24:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:24:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:24:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43841958
Fri 17 Jan 2014 02:24:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:25:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:25:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:25:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:25:09 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:25:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:25:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:25:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:25:10 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:25:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:25:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:25:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:25:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:25:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:25:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:25:13 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:25:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 02:25:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:25:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:25:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 02:25:13 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:25:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5741 values 90497 bits 11312 bytes 
Fri 17 Jan 2014 02:25:14 - XML: Processed 654936 elements - found 677 jobs
Fri 17 Jan 2014 02:25:14 - job 7347157 appears to have finished
Fri 17 Jan 2014 02:25:14 - job 7346753 appears to have finished
Fri 17 Jan 2014 02:25:14 - job 7344331 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 02:25:14 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 02:25:14 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 02:25:15 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 02:25:15 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:25:15 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:25:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:25:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:25:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:25:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:25:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:25:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:25:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:25:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:25:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:25:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43863827
Fri 17 Jan 2014 02:25:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:25:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43863827
Fri 17 Jan 2014 02:25:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:25:23 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 02:25:23 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:25:24 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:25:24 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:25:24 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 02:25:24 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 02:25:24 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 02:25:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:25:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:25:28 - size of cluster 'LISA Cluster': 624 hosts 79469 metrics 798081 values 12587099 bits 1573387 bytes 
Fri 17 Jan 2014 02:25:30 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:25:30 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:25:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:25:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:25:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:25:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:25:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:25:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:25:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:25:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:25:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:25:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:25:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:25:35 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:25:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:25:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:25:36 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:25:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 02:25:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:25:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:25:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:25:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:25:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:25:38 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:25:38 - job_xml_thread(): Done retrieving: data size 43864374
Fri 17 Jan 2014 02:25:38 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:25:38 - XML: Start document: iteration 8
Fri 17 Jan 2014 02:25:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43864374
Fri 17 Jan 2014 02:25:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:25:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43864374
Fri 17 Jan 2014 02:25:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:25:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:25:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:25:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:25:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:25:58 - XML: Processed 655552 elements - found 677 jobs
Fri 17 Jan 2014 02:25:58 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 02:25:58 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 02:25:58 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:25:58 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:26:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:26:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:26:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:26:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:26:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:26:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:26:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:26:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:26:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:26:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:26:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:26:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:26:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:26:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:26:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:26:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:26:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:26:06 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:26:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43886497
Fri 17 Jan 2014 02:26:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:26:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43886497
Fri 17 Jan 2014 02:26:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:26:13 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:26:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:26:13 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:26:13 - job_xml_thread(): Done retrieving: data size 43886497
Fri 17 Jan 2014 02:26:13 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:26:13 - XML: Start document: iteration 9
Fri 17 Jan 2014 02:26:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:26:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 02:26:14 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:26:14 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:26:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 02:26:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8933 values 140888 bits 17611 bytes 
Fri 17 Jan 2014 02:26:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:26:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:26:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:26:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:26:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:26:21 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:26:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:26:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:26:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:26:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:26:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:26:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:26:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:26:24 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:26:24 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 02:26:27 - XML: Processed 655550 elements - found 676 jobs
Fri 17 Jan 2014 02:26:27 - job 7347152 appears to have finished
Fri 17 Jan 2014 02:26:27 - job 7337572 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 02:26:27 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 02:26:27 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 02:26:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:26:30 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:26:30 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 02:26:30 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:26:30 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:26:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:26:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:26:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:26:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:26:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:26:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:26:33 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:26:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43854635
Fri 17 Jan 2014 02:26:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:26:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43854635
Fri 17 Jan 2014 02:26:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:26:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:26:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:26:45 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:26:45 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:26:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:26:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:26:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:26:46 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:26:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:26:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:26:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:26:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:26:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:26:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:26:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:26:48 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:26:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:26:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:26:49 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:26:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 02:26:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:26:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:26:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:26:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:26:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:26:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:26:52 - job_xml_thread(): Done retrieving: data size 43878620
Fri 17 Jan 2014 02:26:52 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:26:52 - XML: Start document: iteration 10
Fri 17 Jan 2014 02:26:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43878620
Fri 17 Jan 2014 02:26:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43878620
Fri 17 Jan 2014 02:26:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:26:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:27:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:27:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:27:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:27:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:27:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:27:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:27:08 - XML: Processed 655548 elements - found 676 jobs
Fri 17 Jan 2014 02:27:09 - job 7337572 field 'start_timestamp' changed since saved from: 1389921971 to: 1389921905
Fri 17 Jan 2014 02:27:09 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 02:27:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:27:09 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 02:27:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:27:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:27:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:27:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:27:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:27:09 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:27:10 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 02:27:10 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:27:10 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:27:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:27:13 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:27:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:27:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:27:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:27:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:27:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:27:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:27:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:27:14 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:27:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:27:14 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:27:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 02:27:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 02:27:14 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:27:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5772 values 91030 bits 11378 bytes 
Fri 17 Jan 2014 02:27:16 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:27:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870932
Fri 17 Jan 2014 02:27:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:27:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870932
Fri 17 Jan 2014 02:27:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:27:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:27:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:27:25 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:27:25 - job_xml_thread(): Done retrieving: data size 43870932
Fri 17 Jan 2014 02:27:25 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:27:25 - XML: Start document: iteration 11
Fri 17 Jan 2014 02:27:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:27:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:27:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:27:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:27:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:27:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:27:32 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:27:32 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:27:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:27:32 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:27:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:27:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:27:40 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:27:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:27:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:27:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:27:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:27:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:27:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:27:41 - XML: Processed 655550 elements - found 676 jobs
Fri 17 Jan 2014 02:27:41 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 02:27:41 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 02:27:41 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:27:41 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:27:42 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:27:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 02:27:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:27:44 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:27:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867523
Fri 17 Jan 2014 02:27:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:27:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43867523
Fri 17 Jan 2014 02:27:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:27:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:27:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:27:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:27:53 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:27:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:27:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:27:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:27:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:27:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:27:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:27:55 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:27:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:27:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:27:56 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:27:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:27:57 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:27:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:27:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:27:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:27:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:27:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:27:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:28:00 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:28:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43872016
Fri 17 Jan 2014 02:28:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:28:01 - job_xml_thread(): Done retrieving: data size 43872016
Fri 17 Jan 2014 02:28:01 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:28:01 - XML: Start document: iteration 12
Fri 17 Jan 2014 02:28:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43872016
Fri 17 Jan 2014 02:28:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:28:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:28:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:28:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:28:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:28:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:28:14 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:28:15 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:28:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 02:28:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:28:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 02:28:15 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:28:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8196 values 129282 bits 16160 bytes 
Fri 17 Jan 2014 02:28:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:28:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:28:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:28:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:28:17 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:28:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:28:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:28:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:28:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:28:21 - XML: Processed 655548 elements - found 675 jobs
Fri 17 Jan 2014 02:28:21 - job 7329965 appears to have finished
Fri 17 Jan 2014 02:28:21 - job 7344329 appears to have finished
Fri 17 Jan 2014 02:28:21 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 02:28:21 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 02:28:22 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 02:28:22 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:28:22 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:28:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:28:26 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:28:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:28:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:28:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:28:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:28:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:28:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:28:29 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:28:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 02:28:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:28:29 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:28:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865730
Fri 17 Jan 2014 02:28:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:28:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43865730
Fri 17 Jan 2014 02:28:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:28:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:28:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:28:37 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:28:37 - job_xml_thread(): Done retrieving: data size 43865730
Fri 17 Jan 2014 02:28:37 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:28:37 - XML: Start document: iteration 13
Fri 17 Jan 2014 02:28:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:28:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:28:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:28:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:28:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:28:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:28:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:28:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:28:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:28:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:28:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:28:51 - XML: Processed 655548 elements - found 675 jobs
Fri 17 Jan 2014 02:28:51 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 02:28:51 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 02:28:51 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:28:51 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:28:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:28:53 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:28:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:28:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:28:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:28:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:28:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:28:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:28:56 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:28:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43863105
Fri 17 Jan 2014 02:28:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:28:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43863105
Fri 17 Jan 2014 02:28:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:28:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:28:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:29:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:29:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:29:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:29:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:29:06 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:29:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:29:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43863105
Fri 17 Jan 2014 02:29:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:29:06 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:29:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:29:06 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:29:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:29:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:29:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:29:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:29:15 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:29:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:29:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:29:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:29:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 02:29:16 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:29:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 02:29:16 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:29:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99092 bits 12386 bytes 
Fri 17 Jan 2014 02:29:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:29:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:29:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:29:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:29:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:29:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:29:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:29:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:29:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:29:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:29:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:29:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:29:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:29:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:29:22 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:29:22 - job_xml_thread(): Done retrieving: data size 43784514
Fri 17 Jan 2014 02:29:22 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:29:22 - XML: Start document: iteration 14
Fri 17 Jan 2014 02:29:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43784514
Fri 17 Jan 2014 02:29:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:29:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43784514
Fri 17 Jan 2014 02:29:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:29:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:29:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:29:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:29:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:29:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:29:41 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:29:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:29:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:29:42 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:29:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:29:43 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:29:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:29:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:29:43 - XML: Processed 654804 elements - found 677 jobs
Fri 17 Jan 2014 02:29:43 - job 7344332 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 02:29:43 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 02:29:43 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 02:29:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:29:46 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:29:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:29:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:29:46 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:29:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 02:29:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:29:46 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 02:29:46 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:29:46 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:29:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:29:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:29:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:29:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:29:47 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 02:29:47 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 02:29:47 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:29:48 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:29:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43250830
Fri 17 Jan 2014 02:29:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:29:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43250830
Fri 17 Jan 2014 02:29:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:29:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:29:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:30:01 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:30:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:30:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:30:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:30:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:30:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:30:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:30:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:30:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:30:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:30:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:30:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:30:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:30:03 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:30:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:30:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:30:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:30:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:30:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:30:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:30:06 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:30:06 - job_xml_thread(): Done retrieving: data size 43230248
Fri 17 Jan 2014 02:30:06 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:30:06 - XML: Start document: iteration 15
Fri 17 Jan 2014 02:30:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43230248
Fri 17 Jan 2014 02:30:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:30:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43230248
Fri 17 Jan 2014 02:30:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:30:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:30:16 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:30:17 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:30:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 02:30:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:30:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 02:30:18 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:30:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:30:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:30:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8897 values 140317 bits 17539 bytes 
Fri 17 Jan 2014 02:30:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:30:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:30:21 - XML: Processed 647354 elements - found 678 jobs
Fri 17 Jan 2014 02:30:21 - job 7335190 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 02:30:21 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 02:30:21 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 02:30:22 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 02:30:22 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:30:22 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:30:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:30:25 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:30:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:30:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:30:26 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:30:26 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:30:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:30:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:30:26 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:30:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:30:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:30:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:30:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:30:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:30:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:30:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:30:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:30:30 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:30:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 02:30:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:30:31 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:30:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43528314
Fri 17 Jan 2014 02:30:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:30:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43528314
Fri 17 Jan 2014 02:30:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:30:37 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:30:38 - job_xml_thread(): Done retrieving: data size 43528314
Fri 17 Jan 2014 02:30:38 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:30:38 - XML: Start document: iteration 16
Fri 17 Jan 2014 02:30:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:30:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:30:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:30:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:30:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:30:49 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:30:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:30:49 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:30:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:30:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:30:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:30:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:30:50 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:30:50 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:30:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:30:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:30:50 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:30:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:30:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:30:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:30:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:30:52 - XML: Processed 651318 elements - found 678 jobs
Fri 17 Jan 2014 02:30:52 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 02:30:52 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 02:30:52 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:30:52 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:30:54 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:30:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43845894
Fri 17 Jan 2014 02:30:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:30:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43845894
Fri 17 Jan 2014 02:30:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:31:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:31:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:31:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:31:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:31:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:31:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:31:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:31:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:31:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:31:06 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:31:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:31:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:31:07 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:31:07 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:31:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:31:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:31:07 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:31:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:31:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:31:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:31:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:31:07 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:31:08 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:31:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43893866
Fri 17 Jan 2014 02:31:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:31:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43893866
Fri 17 Jan 2014 02:31:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:31:09 - job_xml_thread(): Done retrieving: data size 43893866
Fri 17 Jan 2014 02:31:09 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:31:09 - XML: Start document: iteration 17
Fri 17 Jan 2014 02:31:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:31:18 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:31:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:31:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:31:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:31:19 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:31:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 02:31:19 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:31:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 02:31:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9268 values 146306 bits 18288 bytes 
Fri 17 Jan 2014 02:31:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:31:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:31:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:31:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:31:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:31:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:31:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:31:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:31:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:31:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:31:31 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:31:31 - XML: Processed 655550 elements - found 676 jobs
Fri 17 Jan 2014 02:31:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:31:31 - job 7344326 appears to have finished
Fri 17 Jan 2014 02:31:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:31:31 - job 7344334 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 02:31:31 - job 7347175 appears to have finished
Fri 17 Jan 2014 02:31:31 - job 7344333 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 02:31:31 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 02:31:31 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 02:31:31 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 02:31:31 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:31:31 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:31:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:31:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:31:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:31:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:31:33 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:31:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43850064
Fri 17 Jan 2014 02:31:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:31:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43850064
Fri 17 Jan 2014 02:31:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:31:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:31:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:31:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:31:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:31:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:31:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:31:45 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:31:45 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:31:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:31:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:31:45 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:31:46 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:31:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:31:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:31:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:31:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:31:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:31:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:31:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:31:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:31:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:31:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:31:47 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:31:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 02:31:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:31:48 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:31:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43884340
Fri 17 Jan 2014 02:31:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:31:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43884340
Fri 17 Jan 2014 02:31:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:31:49 - job_xml_thread(): Done retrieving: data size 43884340
Fri 17 Jan 2014 02:31:49 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:31:49 - XML: Start document: iteration 18
Fri 17 Jan 2014 02:32:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:32:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:32:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:32:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:32:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:32:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:32:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:32:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:32:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:32:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:32:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:32:05 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:32:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:32:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:32:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:32:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:32:11 - XML: Processed 655546 elements - found 674 jobs
Fri 17 Jan 2014 02:32:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:32:11 - job 7344334 field 'start_timestamp' changed since saved from: 1389922235 to: 1389922181
Fri 17 Jan 2014 02:32:11 - job 7347165 appears to have finished
Fri 17 Jan 2014 02:32:11 - job 7347060 appears to have finished
Fri 17 Jan 2014 02:32:11 - job 7344333 field 'start_timestamp' changed since saved from: 1389922232 to: 1389922181
Fri 17 Jan 2014 02:32:11 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 02:32:11 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 02:32:11 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 02:32:11 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:32:11 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:32:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:32:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:32:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:32:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:32:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:32:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43880729
Fri 17 Jan 2014 02:32:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:32:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43880729
Fri 17 Jan 2014 02:32:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:32:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:32:19 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:32:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:32:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:32:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:32:20 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:32:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 02:32:20 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:32:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 02:32:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8826 values 139617 bits 17452 bytes 
Fri 17 Jan 2014 02:32:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:32:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:32:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:32:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:32:25 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 02:32:25 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:32:25 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:32:25 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 02:32:25 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 02:32:25 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:32:25 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:32:26 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:32:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:32:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:32:26 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 02:32:26 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:32:26 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:32:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:32:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:32:28 - size of cluster 'LISA Cluster': 624 hosts 79487 metrics 807851 values 12755428 bits 1594428 bytes 
Fri 17 Jan 2014 02:32:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:32:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:32:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:32:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:32:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:32:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:32:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:32:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:32:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:32:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870880
Fri 17 Jan 2014 02:32:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:32:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870880
Fri 17 Jan 2014 02:32:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:32:33 - job_xml_thread(): Done retrieving: data size 43870880
Fri 17 Jan 2014 02:32:33 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:32:33 - XML: Start document: iteration 19
Fri 17 Jan 2014 02:32:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:32:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:32:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:32:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:32:54 - XML: Processed 655546 elements - found 674 jobs
Fri 17 Jan 2014 02:32:54 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 02:32:54 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 02:32:55 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:32:55 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:32:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:32:56 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:32:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:32:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:32:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:32:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:32:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:32:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:32:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:32:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:32:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:32:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:32:56 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:32:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:32:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:32:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:32:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:32:57 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:32:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 02:32:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:32:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:32:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43885903
Fri 17 Jan 2014 02:32:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:33:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43885903
Fri 17 Jan 2014 02:33:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:33:10 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:33:11 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:33:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:33:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:33:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:33:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:33:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:33:14 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:33:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:33:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:33:14 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:33:14 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:33:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:33:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:33:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:33:15 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:33:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:33:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:33:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:33:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:33:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:33:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:33:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:33:18 - job_xml_thread(): Done retrieving: data size 43863795
Fri 17 Jan 2014 02:33:18 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:33:18 - XML: Start document: iteration 20
Fri 17 Jan 2014 02:33:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43863795
Fri 17 Jan 2014 02:33:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43863795
Fri 17 Jan 2014 02:33:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:33:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:33:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:33:21 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:33:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:33:24 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:33:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 02:33:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 02:33:26 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:33:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8773 values 138723 bits 17340 bytes 
Fri 17 Jan 2014 02:33:26 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:33:26 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 02:33:28 - XML: Processed 655542 elements - found 672 jobs
Fri 17 Jan 2014 02:33:28 - job 7344327 appears to have finished
Fri 17 Jan 2014 02:33:28 - job 7335185 appears to have finished
Fri 17 Jan 2014 02:33:28 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 02:33:28 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 02:33:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:33:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:33:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:33:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:33:32 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 02:33:33 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:33:33 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:33:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:33:38 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:33:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:33:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:33:39 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:33:39 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:33:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:33:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:33:39 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:33:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:33:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:33:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:33:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:33:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:33:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:33:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:33:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:33:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:33:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43877304
Fri 17 Jan 2014 02:33:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:33:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43877304
Fri 17 Jan 2014 02:33:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:33:48 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:33:48 - job_xml_thread(): Done retrieving: data size 43877304
Fri 17 Jan 2014 02:33:49 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:33:49 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 02:33:49 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 02:33:49 - Housekeeping: done.
Fri 17 Jan 2014 02:33:49 - XML: Start document: iteration 0
Fri 17 Jan 2014 02:33:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:33:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:33:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:33:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:34:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:34:03 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:34:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:34:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:34:04 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:34:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:34:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:34:04 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:34:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:34:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:34:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:34:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:34:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:34:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:34:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:34:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:34:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:34:07 - XML: Processed 655540 elements - found 671 jobs
Fri 17 Jan 2014 02:34:07 - job 7344330 appears to have finished
Fri 17 Jan 2014 02:34:07 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 02:34:07 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 02:34:07 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 02:34:07 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:34:07 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:34:07 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:34:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 02:34:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:34:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:34:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43898246
Fri 17 Jan 2014 02:34:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:34:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43898246
Fri 17 Jan 2014 02:34:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:34:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:34:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:34:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:34:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:34:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:34:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:34:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:34:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:34:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:34:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:34:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:34:22 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:34:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:34:23 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:34:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:34:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:34:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:34:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:34:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:34:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:34:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:34:25 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:34:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:34:25 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:34:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 02:34:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 02:34:25 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:34:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5981 values 94442 bits 11805 bytes 
Fri 17 Jan 2014 02:34:27 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:34:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43891526
Fri 17 Jan 2014 02:34:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43891526
Fri 17 Jan 2014 02:34:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:34:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:34:27 - job_xml_thread(): Done retrieving: data size 43891526
Fri 17 Jan 2014 02:34:28 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:34:28 - XML: Start document: iteration 1
Fri 17 Jan 2014 02:34:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:34:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:34:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:34:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:34:48 - XML: Processed 655533 elements - found 671 jobs
Fri 17 Jan 2014 02:34:48 - job 7346266 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 02:34:48 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 02:34:48 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 02:34:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:34:48 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:34:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:34:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:34:48 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 02:34:48 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:34:48 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:34:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:34:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:34:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:34:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:34:49 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:34:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:34:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:34:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:34:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:34:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:34:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:34:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:34:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:34:54 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:34:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 02:34:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:34:55 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:34:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43903439
Fri 17 Jan 2014 02:34:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:34:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43903439
Fri 17 Jan 2014 02:34:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:35:03 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:35:04 - job_xml_thread(): Done retrieving: data size 43903439
Fri 17 Jan 2014 02:35:04 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:35:04 - XML: Start document: iteration 2
Fri 17 Jan 2014 02:35:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:35:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:35:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:35:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:35:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:35:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:35:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:35:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:35:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:35:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:35:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:35:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:35:09 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:35:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:35:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:35:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:35:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:35:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:35:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:35:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:35:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:35:18 - XML: Processed 655540 elements - found 671 jobs
Fri 17 Jan 2014 02:35:18 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 02:35:18 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 02:35:18 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:35:18 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:35:21 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:35:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43791875
Fri 17 Jan 2014 02:35:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:35:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43791875
Fri 17 Jan 2014 02:35:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:35:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:35:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:35:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:35:25 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:35:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:35:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 02:35:26 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:35:26 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:35:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 02:35:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7500 values 118347 bits 14793 bytes 
Fri 17 Jan 2014 02:35:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:35:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:35:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:35:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:35:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:35:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:35:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:35:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43791875
Fri 17 Jan 2014 02:35:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:35:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:35:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:35:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:35:34 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:35:34 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:35:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:35:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:35:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:35:44 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:35:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:35:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:35:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:35:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:35:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:35:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:35:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:35:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:35:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:35:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:35:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:35:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:35:48 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:35:48 - job_xml_thread(): Done retrieving: data size 43223966
Fri 17 Jan 2014 02:35:48 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:35:48 - XML: Start document: iteration 3
Fri 17 Jan 2014 02:35:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43223966
Fri 17 Jan 2014 02:35:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:35:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43223966
Fri 17 Jan 2014 02:35:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:36:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:36:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:36:01 - XML: Processed 647834 elements - found 672 jobs
Fri 17 Jan 2014 02:36:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:36:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:36:01 - job 7346266 field 'start_timestamp' changed since saved from: 1389922425 to: 1389922360
Fri 17 Jan 2014 02:36:01 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 02:36:01 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 02:36:03 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 02:36:03 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:36:03 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:36:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:36:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:36:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:36:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:36:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:36:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:36:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:36:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:36:11 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:36:11 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:36:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:36:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:36:11 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:36:11 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:36:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 02:36:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:36:11 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 02:36:11 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 02:36:11 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:36:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:36:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:36:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:36:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:36:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:36:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43265257
Fri 17 Jan 2014 02:36:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:36:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43265257
Fri 17 Jan 2014 02:36:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:36:18 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:36:18 - job_xml_thread(): Done retrieving: data size 43265257
Fri 17 Jan 2014 02:36:18 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:36:18 - XML: Start document: iteration 4
Fri 17 Jan 2014 02:36:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:36:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:36:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:36:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:36:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:36:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:36:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:36:27 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:36:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:36:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:36:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:36:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:36:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:36:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:36:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 02:36:29 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:36:30 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:36:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 02:36:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5914 values 93321 bits 11665 bytes 
Fri 17 Jan 2014 02:36:35 - XML: Processed 647834 elements - found 672 jobs
Fri 17 Jan 2014 02:36:35 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 02:36:35 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 02:36:35 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:36:35 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:36:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:36:36 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:36:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:36:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:36:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:36:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:36:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:36:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:36:38 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:36:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564640
Fri 17 Jan 2014 02:36:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:36:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564640
Fri 17 Jan 2014 02:36:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:36:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:36:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:36:50 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:36:50 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:36:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:36:50 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:36:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:36:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:36:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:36:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:36:51 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:36:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:36:51 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:36:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:36:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:36:53 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:36:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:36:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:36:54 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:36:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 02:36:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:36:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:36:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:36:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:36:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:36:55 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:36:55 - job_xml_thread(): Done retrieving: data size 43830834
Fri 17 Jan 2014 02:36:55 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:36:55 - XML: Start document: iteration 5
Fri 17 Jan 2014 02:36:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43830834
Fri 17 Jan 2014 02:36:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:36:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43830834
Fri 17 Jan 2014 02:36:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:37:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:37:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:37:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:37:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:37:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:37:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:37:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:37:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:37:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:37:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:37:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:37:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:37:10 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:37:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:37:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:37:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:37:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:37:18 - XML: Processed 654641 elements - found 671 jobs
Fri 17 Jan 2014 02:37:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:37:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:37:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:37:18 - job 7346752 appears to have finished
Fri 17 Jan 2014 02:37:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:37:18 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 02:37:18 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 02:37:18 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 02:37:18 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:37:18 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:37:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:37:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862119
Fri 17 Jan 2014 02:37:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:37:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862119
Fri 17 Jan 2014 02:37:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:37:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:37:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:37:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:37:29 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:37:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:37:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:37:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:37:31 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:37:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:37:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:37:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:37:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:37:31 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:37:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:37:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 02:37:32 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:37:32 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:37:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8935 values 141013 bits 17626 bytes 
Fri 17 Jan 2014 02:37:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 02:37:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:37:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:37:33 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:37:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:37:34 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:37:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:37:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:37:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:37:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:37:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:37:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:37:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:37:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43885585
Fri 17 Jan 2014 02:37:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:37:36 - job_xml_thread(): Done retrieving: data size 43885585
Fri 17 Jan 2014 02:37:36 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:37:36 - XML: Start document: iteration 6
Fri 17 Jan 2014 02:37:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43885585
Fri 17 Jan 2014 02:37:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:37:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:37:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:37:48 - XML: Processed 655542 elements - found 672 jobs
Fri 17 Jan 2014 02:37:48 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 02:37:48 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 02:37:49 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 02:37:49 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:37:49 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:37:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:37:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:37:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:37:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:37:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:37:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:37:56 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:37:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:37:56 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:37:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:37:56 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:37:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:37:59 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:37:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:37:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:37:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:37:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:37:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:37:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:38:00 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:38:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 02:38:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:38:01 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:38:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43871934
Fri 17 Jan 2014 02:38:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:38:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43871934
Fri 17 Jan 2014 02:38:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:38:05 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:38:05 - job_xml_thread(): Done retrieving: data size 43871934
Fri 17 Jan 2014 02:38:05 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:38:05 - XML: Start document: iteration 7
Fri 17 Jan 2014 02:38:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:38:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:38:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:38:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:38:12 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:38:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:38:12 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:38:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:38:12 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:38:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:38:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:38:22 - XML: Processed 655542 elements - found 672 jobs
Fri 17 Jan 2014 02:38:22 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 02:38:22 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 02:38:22 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:38:23 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:38:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:38:24 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:38:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:38:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:38:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:38:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:38:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:38:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:38:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:38:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43860355
Fri 17 Jan 2014 02:38:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:38:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43860355
Fri 17 Jan 2014 02:38:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:38:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:38:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:38:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:38:32 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:38:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:38:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 02:38:33 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:38:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 02:38:33 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:38:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8797 values 138729 bits 17341 bytes 
Fri 17 Jan 2014 02:38:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:38:38 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:38:38 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:38:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:38:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:38:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:38:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:38:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:38:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:38:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:38:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:38:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:38:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:38:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:38:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:38:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:38:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:38:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:38:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:38:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:38:43 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:38:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 02:38:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:38:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:38:43 - job_xml_thread(): Done retrieving: data size 43868270
Fri 17 Jan 2014 02:38:43 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:38:43 - XML: Start document: iteration 8
Fri 17 Jan 2014 02:38:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43868270
Fri 17 Jan 2014 02:38:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:38:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43868270
Fri 17 Jan 2014 02:38:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:38:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:38:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:38:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:38:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:38:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:38:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:38:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:38:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:38:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:38:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:38:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:38:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:38:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:39:03 - XML: Processed 655540 elements - found 672 jobs
Fri 17 Jan 2014 02:39:03 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 02:39:03 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 02:39:03 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:39:03 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:39:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:39:06 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:39:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:39:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:39:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:39:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:39:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:39:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:39:07 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:39:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43877503
Fri 17 Jan 2014 02:39:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:39:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43877503
Fri 17 Jan 2014 02:39:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:39:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:39:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:39:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:39:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:39:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:39:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:39:18 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:39:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:39:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:39:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:39:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:39:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:39:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:39:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:39:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:39:21 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:39:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:39:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:39:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:39:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:39:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:39:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:39:23 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:39:23 - job_xml_thread(): Done retrieving: data size 43894714
Fri 17 Jan 2014 02:39:23 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:39:23 - XML: Start document: iteration 9
Fri 17 Jan 2014 02:39:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43894714
Fri 17 Jan 2014 02:39:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:39:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43894714
Fri 17 Jan 2014 02:39:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:39:26 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 02:39:26 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:39:27 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:39:27 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:39:27 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 02:39:27 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 02:39:27 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 02:39:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:39:33 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:39:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:39:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:39:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:39:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 02:39:36 - Entering storeMetrics(): cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Fri 17 Jan 2014 02:39:37 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:39:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 02:39:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:39:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:39:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148636 bits 18579 bytes 
Fri 17 Jan 2014 02:39:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:39:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:39:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:39:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:39:42 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:39:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:39:42 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:39:42 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:39:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:39:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:39:46 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:39:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:39:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:39:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:39:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:39:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:39:47 - XML: Processed 655544 elements - found 673 jobs
Fri 17 Jan 2014 02:39:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:39:47 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 02:39:47 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 02:39:47 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 02:39:47 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:39:47 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:39:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:39:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43881023
Fri 17 Jan 2014 02:39:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:39:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43881023
Fri 17 Jan 2014 02:39:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:39:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:39:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:39:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:39:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:40:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:40:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:40:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:40:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:40:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:40:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:40:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:40:03 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:40:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:40:03 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:40:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:40:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:40:03 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:40:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 02:40:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:40:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:40:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:40:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:40:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:40:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:40:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43883302
Fri 17 Jan 2014 02:40:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:40:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43883302
Fri 17 Jan 2014 02:40:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:40:06 - job_xml_thread(): Done retrieving: data size 43883302
Fri 17 Jan 2014 02:40:06 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:40:06 - XML: Start document: iteration 10
Fri 17 Jan 2014 02:40:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:40:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:40:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:40:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:40:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:40:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:40:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:40:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:40:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:40:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:40:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:40:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:40:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:40:26 - XML: Processed 655542 elements - found 672 jobs
Fri 17 Jan 2014 02:40:26 - job 7347173 appears to have finished
Fri 17 Jan 2014 02:40:26 - job 7347164 appears to have finished
Fri 17 Jan 2014 02:40:26 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 02:40:26 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 02:40:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:40:28 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:40:28 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:40:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:40:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:40:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:40:28 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 02:40:28 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:40:28 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:40:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:40:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:40:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:40:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:40:28 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:40:28 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:40:28 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 02:40:28 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 02:40:28 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 02:40:29 - size of cluster 'LISA Cluster': 624 hosts 79481 metrics 939242 values 14815284 bits 1851910 bytes 
Fri 17 Jan 2014 02:40:31 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:40:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43838236
Fri 17 Jan 2014 02:40:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:40:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43838236
Fri 17 Jan 2014 02:40:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:40:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:40:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:40:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:40:37 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:40:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:40:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 02:40:39 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:40:39 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:40:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 02:40:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8935 values 140955 bits 17619 bytes 
Fri 17 Jan 2014 02:40:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:40:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:40:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:40:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:40:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:40:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:40:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:40:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:40:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43838236
Fri 17 Jan 2014 02:40:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:40:43 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:40:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:40:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:40:44 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:40:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:40:50 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:40:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:40:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:40:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:40:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:40:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:40:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:40:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:40:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:40:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:40:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:40:56 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:40:56 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:40:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:40:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:40:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:40:58 - job_xml_thread(): Done retrieving: data size 43849206
Fri 17 Jan 2014 02:40:58 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:40:58 - XML: Start document: iteration 11
Fri 17 Jan 2014 02:40:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43849206
Fri 17 Jan 2014 02:40:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:40:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43849206
Fri 17 Jan 2014 02:40:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:41:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:41:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:41:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:41:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:41:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:41:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:41:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:41:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:41:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:41:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:41:15 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:41:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:41:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:41:18 - XML: Processed 655539 elements - found 672 jobs
Fri 17 Jan 2014 02:41:18 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 02:41:18 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 02:41:18 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:41:18 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:41:19 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:41:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 02:41:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:41:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:41:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:41:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:41:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:41:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:41:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:41:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:41:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:41:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:41:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43810333
Fri 17 Jan 2014 02:41:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:41:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43810333
Fri 17 Jan 2014 02:41:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:41:28 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:41:28 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 02:41:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:41:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:41:33 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:41:33 - job_xml_thread(): Done retrieving: data size 43810333
Fri 17 Jan 2014 02:41:33 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:41:33 - XML: Start document: iteration 12
Fri 17 Jan 2014 02:41:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:41:34 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:41:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:41:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:41:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:41:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:41:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:41:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:41:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:41:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:41:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:41:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:41:39 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:41:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:41:39 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:41:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 02:41:39 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:41:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 02:41:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5879 values 92686 bits 11585 bytes 
Fri 17 Jan 2014 02:41:48 - XML: Processed 654794 elements - found 672 jobs
Fri 17 Jan 2014 02:41:48 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 02:41:48 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 02:41:48 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:41:48 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:41:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:41:49 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:41:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:41:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:41:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:41:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:41:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:41:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:41:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:41:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:41:53 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:41:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43223101
Fri 17 Jan 2014 02:41:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:41:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43223101
Fri 17 Jan 2014 02:41:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:42:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:42:01 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:42:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:42:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:42:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:42:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:42:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:42:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:42:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43223101
Fri 17 Jan 2014 02:42:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:42:03 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:42:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:42:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:42:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:42:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:42:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:42:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:42:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:42:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:42:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:42:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:42:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:42:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:42:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:42:15 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:42:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 02:42:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:42:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:42:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:42:17 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:42:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:42:17 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:42:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:42:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:42:19 - job_xml_thread(): Done retrieving: data size 43238714
Fri 17 Jan 2014 02:42:19 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:42:19 - XML: Start document: iteration 13
Fri 17 Jan 2014 02:42:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43238714
Fri 17 Jan 2014 02:42:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:42:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43238714
Fri 17 Jan 2014 02:42:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:42:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:42:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:42:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:42:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:42:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:42:39 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:42:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:42:41 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:42:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 02:42:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 02:42:41 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:42:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5979 values 94339 bits 11792 bytes 
Fri 17 Jan 2014 02:42:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:42:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:42:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:42:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:42:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:42:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:42:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:42:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:42:43 - XML: Processed 648016 elements - found 672 jobs
Fri 17 Jan 2014 02:42:43 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:42:43 - job 7347184 appears to have finished
Fri 17 Jan 2014 02:42:43 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 02:42:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:42:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:42:43 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 02:42:43 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 02:42:43 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:42:43 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:42:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:42:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:42:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:42:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:42:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:42:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:42:47 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:42:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43820890
Fri 17 Jan 2014 02:42:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:42:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43820890
Fri 17 Jan 2014 02:42:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:42:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:42:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:42:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:42:58 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:42:58 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:42:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:42:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:42:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:43:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:43:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:43:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:43:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:43:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:43:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:43:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:43:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:43:02 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:43:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 02:43:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:43:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:43:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:43:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:43:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:43:06 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:43:06 - job_xml_thread(): Done retrieving: data size 43868627
Fri 17 Jan 2014 02:43:06 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:43:06 - XML: Start document: iteration 14
Fri 17 Jan 2014 02:43:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43868627
Fri 17 Jan 2014 02:43:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43868627
Fri 17 Jan 2014 02:43:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:43:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:43:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:43:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:43:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:43:16 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:43:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:43:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:43:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:43:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:43:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:43:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:43:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:43:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:43:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:43:25 - XML: Processed 655538 elements - found 670 jobs
Fri 17 Jan 2014 02:43:26 - job 7347181 appears to have finished
Fri 17 Jan 2014 02:43:26 - job 7346307 appears to have finished
Fri 17 Jan 2014 02:43:26 - job 7335191 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 02:43:26 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 02:43:26 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 02:43:26 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 02:43:26 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:43:26 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:43:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:43:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:43:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:43:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:43:28 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 02:43:28 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 02:43:28 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:43:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:43:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:43:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:43:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:43:30 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:43:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43837601
Fri 17 Jan 2014 02:43:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:43:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43837601
Fri 17 Jan 2014 02:43:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:43:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:43:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:43:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:43:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:43:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:43:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:43:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:43:41 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:43:42 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:43:42 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:43:42 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:43:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:43:42 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:43:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:43:42 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:43:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:43:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 02:43:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 02:43:42 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:43:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9039 values 142618 bits 17827 bytes 
Fri 17 Jan 2014 02:43:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:43:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:43:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:43:44 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:43:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:43:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:43:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:43:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:43:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:43:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:43:46 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:43:47 - job_xml_thread(): Done retrieving: data size 43867579
Fri 17 Jan 2014 02:43:47 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:43:47 - XML: Start document: iteration 15
Fri 17 Jan 2014 02:43:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867579
Fri 17 Jan 2014 02:43:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:43:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43867579
Fri 17 Jan 2014 02:43:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:43:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:43:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:44:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:44:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:44:06 - XML: Processed 655538 elements - found 670 jobs
Fri 17 Jan 2014 02:44:07 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 02:44:07 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 02:44:07 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:44:07 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:44:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:44:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:44:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:44:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:44:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:44:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:44:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:44:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:44:09 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:44:10 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:44:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 02:44:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:44:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:44:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:44:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:44:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:44:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:44:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:44:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:44:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:44:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:44:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43883244
Fri 17 Jan 2014 02:44:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:44:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43883244
Fri 17 Jan 2014 02:44:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:44:22 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:44:22 - job_xml_thread(): Done retrieving: data size 43883244
Fri 17 Jan 2014 02:44:22 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:44:22 - XML: Start document: iteration 16
Fri 17 Jan 2014 02:44:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:44:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:44:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:44:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:44:25 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:44:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:44:25 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:44:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:44:25 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:44:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:44:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:44:32 - XML: Processed 655538 elements - found 670 jobs
Fri 17 Jan 2014 02:44:32 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 02:44:32 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 02:44:32 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:44:32 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:44:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:44:34 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:44:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:44:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:44:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:44:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:44:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:44:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:44:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:44:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865460
Fri 17 Jan 2014 02:44:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:44:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43865460
Fri 17 Jan 2014 02:44:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:44:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:44:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:44:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:44:42 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:44:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:44:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 02:44:43 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:44:43 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:44:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 02:44:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9029 values 142454 bits 17806 bytes 
Fri 17 Jan 2014 02:44:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:44:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:44:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:44:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:44:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:44:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:44:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865460
Fri 17 Jan 2014 02:44:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:44:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:44:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:44:47 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:44:47 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:44:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:44:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:44:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:44:54 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:44:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:44:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:44:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:44:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:44:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:44:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:44:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:44:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:44:58 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:44:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 02:44:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:44:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:44:58 - job_xml_thread(): Done retrieving: data size 43848422
Fri 17 Jan 2014 02:44:58 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:44:58 - XML: Start document: iteration 17
Fri 17 Jan 2014 02:44:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43848422
Fri 17 Jan 2014 02:44:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:44:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:44:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:45:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:45:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:45:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43848422
Fri 17 Jan 2014 02:45:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:45:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:45:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:45:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:45:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:45:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:45:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:45:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:45:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:45:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:45:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:45:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:45:21 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:45:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:45:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:45:22 - XML: Processed 655540 elements - found 671 jobs
Fri 17 Jan 2014 02:45:22 - job 7346268 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 02:45:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:45:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:45:22 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 02:45:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:45:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:45:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:45:22 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 02:45:22 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 02:45:22 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:45:22 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:45:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:45:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:45:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:45:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:45:23 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:45:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43886093
Fri 17 Jan 2014 02:45:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:45:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43886093
Fri 17 Jan 2014 02:45:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:45:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:45:34 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:45:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:45:36 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:45:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:45:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:45:37 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:45:37 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:45:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:45:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:45:37 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:45:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:45:37 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:45:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:45:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:45:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:45:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:45:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:45:38 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:45:38 - job_xml_thread(): Done retrieving: data size 43884700
Fri 17 Jan 2014 02:45:38 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:45:38 - XML: Start document: iteration 18
Fri 17 Jan 2014 02:45:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43884700
Fri 17 Jan 2014 02:45:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:45:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43884700
Fri 17 Jan 2014 02:45:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:45:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:45:44 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:45:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:45:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 02:45:46 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:45:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9509 values 150001 bits 18750 bytes 
Fri 17 Jan 2014 02:45:46 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:45:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 02:45:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:45:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:45:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:45:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:45:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:45:56 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:45:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:45:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:45:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:45:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:45:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:45:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:45:58 - XML: Processed 655536 elements - found 669 jobs
Fri 17 Jan 2014 02:45:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:45:58 - job 7347198 appears to have finished
Fri 17 Jan 2014 02:45:59 - job 7341625 appears to have finished
Fri 17 Jan 2014 02:45:59 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 02:45:59 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 02:45:59 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 02:45:59 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:45:59 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:46:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:46:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:46:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:46:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:46:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:46:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:46:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:46:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:46:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:46:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43878342
Fri 17 Jan 2014 02:46:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:46:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43878342
Fri 17 Jan 2014 02:46:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:46:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:46:13 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:46:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:46:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:46:14 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:46:14 - job_xml_thread(): Done retrieving: data size 43878342
Fri 17 Jan 2014 02:46:14 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:46:14 - XML: Start document: iteration 19
Fri 17 Jan 2014 02:46:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:46:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:46:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:46:15 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:46:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:46:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:46:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:46:26 - XML: Processed 655532 elements - found 667 jobs
Fri 17 Jan 2014 02:46:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:46:26 - job 7346727 appears to have finished
Fri 17 Jan 2014 02:46:26 - job 7346260 appears to have finished
Fri 17 Jan 2014 02:46:26 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:46:26 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 02:46:26 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 02:46:26 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 02:46:26 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:46:26 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:46:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:46:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:46:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:46:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:46:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:46:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:46:27 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:46:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 02:46:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:46:28 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:46:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43845608
Fri 17 Jan 2014 02:46:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:46:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43845608
Fri 17 Jan 2014 02:46:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:46:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:46:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:46:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:46:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:46:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:46:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:46:39 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:46:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:46:39 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:46:39 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:46:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:46:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:46:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:46:41 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:46:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:46:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:46:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:46:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:46:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:46:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:46:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:46:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43892066
Fri 17 Jan 2014 02:46:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:46:43 - job_xml_thread(): Done retrieving: data size 43892066
Fri 17 Jan 2014 02:46:43 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:46:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43892066
Fri 17 Jan 2014 02:46:43 - XML: Start document: iteration 20
Fri 17 Jan 2014 02:46:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:46:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:46:47 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:46:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:46:48 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:46:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 02:46:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 02:46:48 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:46:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8707 values 137573 bits 17196 bytes 
Fri 17 Jan 2014 02:46:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:46:53 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:46:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:46:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:46:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:46:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:46:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:46:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:46:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:46:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:46:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:47:02 - XML: Processed 655532 elements - found 667 jobs
Fri 17 Jan 2014 02:47:02 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 02:47:02 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 02:47:02 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:47:02 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:47:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:47:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:47:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:47:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:47:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:47:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:47:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:47:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:47:06 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:47:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43876146
Fri 17 Jan 2014 02:47:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:47:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43876146
Fri 17 Jan 2014 02:47:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:47:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:47:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:47:17 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:47:17 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:47:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:47:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:47:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:47:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:47:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:47:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:47:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:47:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:47:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:47:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:47:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:47:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:47:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:47:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:47:22 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:47:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 02:47:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:47:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:47:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:47:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:47:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:47:23 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:47:23 - job_xml_thread(): Done retrieving: data size 43794273
Fri 17 Jan 2014 02:47:23 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:47:23 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 02:47:23 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 02:47:23 - Housekeeping: done.
Fri 17 Jan 2014 02:47:23 - XML: Start document: iteration 0
Fri 17 Jan 2014 02:47:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43794273
Fri 17 Jan 2014 02:47:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:47:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43794273
Fri 17 Jan 2014 02:47:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:47:29 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 02:47:30 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:47:32 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:47:32 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 02:47:32 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 02:47:32 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:47:32 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 02:47:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:47:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:47:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:47:39 - size of cluster 'LISA Cluster': 624 hosts 79476 metrics 917562 values 14485718 bits 1810714 bytes 
Fri 17 Jan 2014 02:47:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:47:46 - XML: Processed 654786 elements - found 668 jobs
Fri 17 Jan 2014 02:47:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:47:46 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 02:47:46 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:47:46 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 02:47:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:47:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:47:46 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 02:47:46 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:47:46 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:47:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:47:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:47:48 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:47:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:47:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:47:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:47:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:47:48 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:47:48 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:47:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:47:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:47:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:47:49 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:47:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 02:47:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 02:47:49 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:47:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5540 values 87687 bits 10960 bytes 
Fri 17 Jan 2014 02:47:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:47:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:47:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:47:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:47:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:47:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43231936
Fri 17 Jan 2014 02:47:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:47:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43231936
Fri 17 Jan 2014 02:47:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:48:01 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:48:01 - job_xml_thread(): Done retrieving: data size 43231936
Fri 17 Jan 2014 02:48:01 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:48:01 - XML: Start document: iteration 1
Fri 17 Jan 2014 02:48:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:48:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:48:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:48:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:48:04 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:48:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:48:04 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:48:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:48:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:48:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:48:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:48:11 - XML: Processed 647433 elements - found 667 jobs
Fri 17 Jan 2014 02:48:11 - job 7335163 appears to have finished
Fri 17 Jan 2014 02:48:11 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 02:48:11 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 02:48:11 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 02:48:11 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:48:11 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:48:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:48:15 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:48:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:48:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:48:15 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:48:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 02:48:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:48:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:48:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:48:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:48:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:48:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:48:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43258651
Fri 17 Jan 2014 02:48:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:48:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43258651
Fri 17 Jan 2014 02:48:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:48:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:48:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:48:26 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:48:26 - job_xml_thread(): Done retrieving: data size 43258651
Fri 17 Jan 2014 02:48:26 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:48:26 - XML: Start document: iteration 2
Fri 17 Jan 2014 02:48:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:48:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:48:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:48:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:48:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:48:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:48:32 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:48:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:48:32 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:48:32 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:48:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:48:32 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:48:32 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 02:48:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:48:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:48:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:48:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:48:42 - XML: Processed 648082 elements - found 668 jobs
Fri 17 Jan 2014 02:48:42 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 02:48:42 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 02:48:42 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 02:48:42 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:48:42 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:48:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:48:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:48:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:48:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:48:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:48:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43758494
Fri 17 Jan 2014 02:48:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:48:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43758494
Fri 17 Jan 2014 02:48:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:48:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:48:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:48:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:48:49 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:48:50 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:48:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:48:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 02:48:50 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:48:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 02:48:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8498 values 134212 bits 16776 bytes 
Fri 17 Jan 2014 02:48:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:48:54 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:48:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:48:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:48:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:48:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:48:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:48:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:48:55 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:48:57 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:48:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:48:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:49:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:49:01 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:49:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:49:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:49:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:49:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:49:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:49:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:49:04 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:49:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43857898
Fri 17 Jan 2014 02:49:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:49:05 - job_xml_thread(): Done retrieving: data size 43857898
Fri 17 Jan 2014 02:49:05 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:49:05 - XML: Start document: iteration 3
Fri 17 Jan 2014 02:49:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43857898
Fri 17 Jan 2014 02:49:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:49:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:49:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:49:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:49:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:49:20 - XML: Processed 655408 elements - found 669 jobs
Fri 17 Jan 2014 02:49:20 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 02:49:20 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 02:49:21 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 02:49:21 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:49:21 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:49:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:49:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:49:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:49:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:49:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:49:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:49:23 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:49:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:49:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:49:27 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:49:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 02:49:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:49:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:49:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:49:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:49:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:49:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:49:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:49:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:49:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:49:31 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:49:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43861238
Fri 17 Jan 2014 02:49:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:49:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43861238
Fri 17 Jan 2014 02:49:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:49:36 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:49:37 - job_xml_thread(): Done retrieving: data size 43861238
Fri 17 Jan 2014 02:49:37 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:49:37 - XML: Start document: iteration 4
Fri 17 Jan 2014 02:49:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:49:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:49:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:49:41 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:49:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:49:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:49:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:49:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:49:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:49:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:49:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:49:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:49:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:49:49 - XML: Processed 655536 elements - found 669 jobs
Fri 17 Jan 2014 02:49:49 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 02:49:49 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 02:49:49 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:49:49 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:49:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:49:50 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:49:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:49:51 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:49:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 02:49:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 02:49:51 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:49:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5755 values 90768 bits 11346 bytes 
Fri 17 Jan 2014 02:49:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:49:53 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:49:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:49:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:49:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:49:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:49:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:49:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:49:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:49:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:49:57 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:49:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43838246
Fri 17 Jan 2014 02:49:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:49:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43838246
Fri 17 Jan 2014 02:49:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:50:04 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:50:04 - job_xml_thread(): Done retrieving: data size 43838246
Fri 17 Jan 2014 02:50:04 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:50:04 - XML: Start document: iteration 5
Fri 17 Jan 2014 02:50:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:50:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:50:20 - XML: Processed 655536 elements - found 669 jobs
Fri 17 Jan 2014 02:50:20 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 02:50:20 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 02:50:20 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:50:20 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:50:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:50:20 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:50:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:50:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:50:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:50:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:50:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:50:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:50:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:50:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:50:21 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:50:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:50:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:50:21 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:50:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 02:50:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:50:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:50:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:50:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:50:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:50:24 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:50:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43893567
Fri 17 Jan 2014 02:50:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:50:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43893567
Fri 17 Jan 2014 02:50:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:50:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:50:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:50:35 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:50:35 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:50:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:50:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:50:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:50:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:50:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:50:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:50:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:50:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:50:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:50:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:50:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:50:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:50:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:50:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:50:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:50:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:50:42 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:50:42 - job_xml_thread(): Done retrieving: data size 43874496
Fri 17 Jan 2014 02:50:42 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:50:42 - XML: Start document: iteration 6
Fri 17 Jan 2014 02:50:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43874496
Fri 17 Jan 2014 02:50:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43874496
Fri 17 Jan 2014 02:50:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:50:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:50:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:50:52 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:50:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:50:53 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:50:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 02:50:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 02:50:53 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:50:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9073 values 143199 bits 17899 bytes 
Fri 17 Jan 2014 02:50:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:50:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:50:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:50:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:50:55 - XML: Processed 655534 elements - found 668 jobs
Fri 17 Jan 2014 02:50:56 - job 7347177 appears to have finished
Fri 17 Jan 2014 02:50:56 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 02:50:56 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 02:50:56 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 02:50:56 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:50:56 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:51:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:51:00 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:51:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:51:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:51:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:51:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:51:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:51:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:51:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:51:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:51:06 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:51:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:51:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:51:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:51:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:51:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:51:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:51:09 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:51:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875802
Fri 17 Jan 2014 02:51:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:51:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875802
Fri 17 Jan 2014 02:51:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:51:11 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:51:11 - job_xml_thread(): Done retrieving: data size 43875802
Fri 17 Jan 2014 02:51:11 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:51:11 - XML: Start document: iteration 7
Fri 17 Jan 2014 02:51:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:51:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:51:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:51:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:51:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:51:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:51:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:51:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:51:23 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:51:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:51:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:51:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:51:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:51:27 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:51:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 02:51:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:51:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:51:32 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:51:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:51:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:51:33 - XML: Processed 655532 elements - found 667 jobs
Fri 17 Jan 2014 02:51:33 - job 7347180 appears to have finished
Fri 17 Jan 2014 02:51:33 - job 7344651 appears to have finished
Fri 17 Jan 2014 02:51:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:51:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:51:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:51:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:51:33 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 02:51:33 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 02:51:33 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 02:51:33 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:51:33 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:51:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:51:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43861305
Fri 17 Jan 2014 02:51:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:51:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43861305
Fri 17 Jan 2014 02:51:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:51:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:51:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:51:38 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 02:51:38 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 02:51:38 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:51:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:51:46 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:51:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:51:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:51:47 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:51:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:51:47 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:51:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:51:47 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:51:48 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:51:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:51:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:51:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:51:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:51:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:51:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:51:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:51:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:51:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:51:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:51:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:51:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43894208
Fri 17 Jan 2014 02:51:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:51:52 - job_xml_thread(): Done retrieving: data size 43894208
Fri 17 Jan 2014 02:51:52 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:51:52 - XML: Start document: iteration 8
Fri 17 Jan 2014 02:51:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43894208
Fri 17 Jan 2014 02:51:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:51:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:51:53 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:51:55 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:51:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:51:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 02:51:56 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:51:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 02:51:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8838 values 139470 bits 17433 bytes 
Fri 17 Jan 2014 02:52:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:52:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:52:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:52:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:52:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:52:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:52:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:52:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:52:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:52:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:52:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:52:10 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:52:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:52:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:52:13 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:52:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:52:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:52:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:52:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:52:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:52:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:52:15 - XML: Processed 655528 elements - found 665 jobs
Fri 17 Jan 2014 02:52:15 - job 7347088 appears to have finished
Fri 17 Jan 2014 02:52:15 - job 7341624 appears to have finished
Fri 17 Jan 2014 02:52:15 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 02:52:15 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 02:52:15 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 02:52:15 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:52:15 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:52:17 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:52:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 02:52:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:52:17 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:52:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870010
Fri 17 Jan 2014 02:52:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:52:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870010
Fri 17 Jan 2014 02:52:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:52:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:52:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:52:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:52:27 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:52:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:52:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:52:29 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:52:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:52:29 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:52:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:52:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:52:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:52:29 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:52:30 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:52:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:52:31 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:52:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:52:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:52:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:52:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:52:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:52:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:52:33 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:52:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43880878
Fri 17 Jan 2014 02:52:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:52:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43880878
Fri 17 Jan 2014 02:52:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:52:34 - job_xml_thread(): Done retrieving: data size 43880878
Fri 17 Jan 2014 02:52:34 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:52:34 - XML: Start document: iteration 9
Fri 17 Jan 2014 02:52:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:52:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:52:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:52:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:52:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:52:50 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:52:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:52:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:52:51 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:52:51 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:52:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:52:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:52:51 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:52:54 - XML: Processed 655528 elements - found 665 jobs
Fri 17 Jan 2014 02:52:54 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 02:52:54 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 02:52:54 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:52:54 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:52:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:52:56 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:52:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:52:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:52:56 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:52:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:52:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 02:52:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 02:52:56 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:52:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99145 bits 12393 bytes 
Fri 17 Jan 2014 02:52:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:52:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:52:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:52:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:52:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:52:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:52:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:52:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43857469
Fri 17 Jan 2014 02:52:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:52:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43857469
Fri 17 Jan 2014 02:52:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:53:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:53:06 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:53:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:53:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:53:06 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:53:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:53:06 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:53:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:53:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43857469
Fri 17 Jan 2014 02:53:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:53:09 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:53:09 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:53:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:53:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:53:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:53:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:53:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:53:20 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:53:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:53:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:53:20 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:53:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 02:53:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:53:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:53:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:53:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:53:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:53:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:53:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:53:22 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:53:22 - job_xml_thread(): Done retrieving: data size 43796163
Fri 17 Jan 2014 02:53:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43796163
Fri 17 Jan 2014 02:53:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:53:22 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:53:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:53:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:53:22 - XML: Start document: iteration 10
Fri 17 Jan 2014 02:53:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:53:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:53:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43796163
Fri 17 Jan 2014 02:53:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:53:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:53:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:53:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:53:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:53:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:53:41 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:53:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:53:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:53:42 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:53:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:53:42 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:53:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:53:42 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:53:42 - XML: Processed 654780 elements - found 665 jobs
Fri 17 Jan 2014 02:53:42 - job 7344335 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 02:53:42 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 02:53:42 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 02:53:43 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 02:53:43 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:53:43 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:53:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:53:44 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:53:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:53:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:53:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:53:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:53:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:53:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:53:46 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:53:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43257357
Fri 17 Jan 2014 02:53:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:53:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43257357
Fri 17 Jan 2014 02:53:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:53:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:53:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:53:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:53:56 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:53:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:53:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:53:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:53:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 02:53:57 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:53:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 02:53:57 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:53:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8856 values 139699 bits 17462 bytes 
Fri 17 Jan 2014 02:53:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:53:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:53:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:53:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:53:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:53:58 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:53:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:53:59 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:54:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:54:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:54:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:54:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:54:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:54:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:54:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:54:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43212824
Fri 17 Jan 2014 02:54:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:54:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43212824
Fri 17 Jan 2014 02:54:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:54:03 - job_xml_thread(): Done retrieving: data size 43212824
Fri 17 Jan 2014 02:54:03 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:54:03 - XML: Start document: iteration 11
Fri 17 Jan 2014 02:54:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:54:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:54:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:54:16 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:54:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:54:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:54:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:54:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:54:17 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:54:17 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:54:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:54:17 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:54:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:54:21 - XML: Processed 647326 elements - found 664 jobs
Fri 17 Jan 2014 02:54:21 - job 7347178 appears to have finished
Fri 17 Jan 2014 02:54:21 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 02:54:21 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 02:54:21 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 02:54:21 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:54:21 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:54:24 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:54:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 02:54:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:54:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:54:25 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:54:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:54:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:54:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:54:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:54:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:54:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:54:26 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:54:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43254235
Fri 17 Jan 2014 02:54:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:54:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43254235
Fri 17 Jan 2014 02:54:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:54:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:54:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:54:32 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 02:54:32 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:54:33 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:54:33 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 02:54:33 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:54:33 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 02:54:33 - Entering storeMetrics(): cluster LISA Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Fri 17 Jan 2014 02:54:36 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:54:37 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:54:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:54:38 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:54:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:54:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:54:39 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:54:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:54:39 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:54:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:54:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:54:40 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:54:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:54:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:54:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:54:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:54:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:54:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:54:41 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:54:41 - job_xml_thread(): Done retrieving: data size 43790359
Fri 17 Jan 2014 02:54:41 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:54:41 - XML: Start document: iteration 12
Fri 17 Jan 2014 02:54:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43790359
Fri 17 Jan 2014 02:54:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43790359
Fri 17 Jan 2014 02:54:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:54:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:54:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:54:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:54:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:54:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:54:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:54:57 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:54:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:54:58 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:54:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 02:54:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 02:54:58 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:54:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:54:58 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:54:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9062 values 142996 bits 17874 bytes 
Fri 17 Jan 2014 02:54:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:54:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:54:59 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:54:59 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:54:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:54:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:54:59 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:55:02 - XML: Processed 654522 elements - found 664 jobs
Fri 17 Jan 2014 02:55:02 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 02:55:02 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 02:55:02 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:55:02 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:55:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:55:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:55:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:55:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:55:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:55:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:55:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:55:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:55:07 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:55:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875095
Fri 17 Jan 2014 02:55:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:55:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875095
Fri 17 Jan 2014 02:55:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:55:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:55:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:55:17 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:55:17 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:55:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:55:19 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:55:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:55:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 02:55:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:55:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:55:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:55:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:55:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:55:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:55:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:55:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:55:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:55:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:55:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:55:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:55:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:55:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:55:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:55:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:55:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:55:23 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:55:23 - job_xml_thread(): Done retrieving: data size 43869170
Fri 17 Jan 2014 02:55:23 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:55:23 - XML: Start document: iteration 13
Fri 17 Jan 2014 02:55:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43869170
Fri 17 Jan 2014 02:55:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43869170
Fri 17 Jan 2014 02:55:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:55:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:55:33 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:55:33 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:55:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:55:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:55:35 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:55:35 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:55:35 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 02:55:36 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 02:55:36 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Fri 17 Jan 2014 02:55:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:55:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:55:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:55:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:55:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:55:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:55:39 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:55:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:55:39 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:55:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:55:40 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:55:43 - XML: Processed 655526 elements - found 664 jobs
Fri 17 Jan 2014 02:55:44 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 02:55:44 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 02:55:44 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:55:44 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:55:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:55:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:55:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:55:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:55:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:55:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:55:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:55:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:55:48 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:55:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862362
Fri 17 Jan 2014 02:55:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:55:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862362
Fri 17 Jan 2014 02:55:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:55:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:55:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:55:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:55:58 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:55:59 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:55:59 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:55:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:55:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 02:55:59 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:55:59 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:55:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 02:55:59 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9373 values 147929 bits 18491 bytes 
Fri 17 Jan 2014 02:56:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:56:01 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:56:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:56:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:56:01 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:56:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:56:01 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:56:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:56:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:56:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:56:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:56:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:56:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:56:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:56:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:56:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:56:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:56:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:56:06 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:56:06 - job_xml_thread(): Done retrieving: data size 43881689
Fri 17 Jan 2014 02:56:06 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:56:06 - XML: Start document: iteration 14
Fri 17 Jan 2014 02:56:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43881689
Fri 17 Jan 2014 02:56:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43881689
Fri 17 Jan 2014 02:56:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:56:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:56:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:56:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:56:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:56:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:56:24 - XML: Processed 655526 elements - found 665 jobs
Fri 17 Jan 2014 02:56:24 - job 7344328 appears to have finished
Fri 17 Jan 2014 02:56:24 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 02:56:24 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 02:56:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:56:25 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:56:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:56:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:56:26 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 02:56:26 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:56:26 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:56:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:56:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:56:27 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:56:27 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:56:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:56:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:56:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:56:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:56:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:56:28 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:56:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 02:56:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:56:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:56:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:56:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:56:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:56:30 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:56:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43883348
Fri 17 Jan 2014 02:56:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:56:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43883348
Fri 17 Jan 2014 02:56:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:56:36 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:56:36 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:56:39 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:56:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:56:39 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:56:39 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 02:56:39 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 02:56:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:56:39 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 02:56:41 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:56:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:56:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:56:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:56:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:56:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:56:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:56:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:56:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:56:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:56:44 - size of cluster 'LISA Cluster': 624 hosts 79479 metrics 991680 values 15645112 bits 1955639 bytes 
Fri 17 Jan 2014 02:56:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:56:45 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:56:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:56:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:56:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:56:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:56:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:56:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:56:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:56:49 - job_xml_thread(): Done retrieving: data size 43881997
Fri 17 Jan 2014 02:56:49 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:56:49 - XML: Start document: iteration 15
Fri 17 Jan 2014 02:56:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43881997
Fri 17 Jan 2014 02:56:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:56:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43881997
Fri 17 Jan 2014 02:56:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:56:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:56:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:57:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:57:00 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:57:01 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:57:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:57:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 02:57:01 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:57:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 02:57:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9031 values 142534 bits 17816 bytes 
Fri 17 Jan 2014 02:57:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:57:01 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:57:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:57:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:57:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:57:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:57:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:57:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:57:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:57:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:57:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:57:10 - XML: Processed 655528 elements - found 665 jobs
Fri 17 Jan 2014 02:57:10 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 02:57:10 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 02:57:10 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:57:10 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:57:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:57:13 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:57:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:57:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:57:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:57:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:57:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:57:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:57:16 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:57:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43846745
Fri 17 Jan 2014 02:57:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:57:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43846745
Fri 17 Jan 2014 02:57:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:57:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:57:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:57:25 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:57:25 - job_xml_thread(): Done retrieving: data size 43846745
Fri 17 Jan 2014 02:57:25 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:57:25 - XML: Start document: iteration 16
Fri 17 Jan 2014 02:57:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:57:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:57:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:57:29 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:57:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:57:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:57:29 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:57:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:57:29 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:57:29 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:57:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:57:36 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:57:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 02:57:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:57:40 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:57:40 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 02:57:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:57:40 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:57:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:57:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:57:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:57:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:57:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:57:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:57:42 - XML: Processed 655528 elements - found 665 jobs
Fri 17 Jan 2014 02:57:42 - job 7347207 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 02:57:42 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 02:57:42 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 02:57:42 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 02:57:42 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:57:42 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:57:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:57:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:57:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:57:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43846246
Fri 17 Jan 2014 02:57:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:57:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43846246
Fri 17 Jan 2014 02:57:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:57:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:57:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:57:57 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:57:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:57:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:57:58 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:57:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:57:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:57:59 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:57:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:57:59 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:57:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:58:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:58:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:58:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:58:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:58:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:58:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:58:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:58:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:58:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:58:01 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:58:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:58:02 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:58:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 02:58:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 02:58:02 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:58:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5752 values 90751 bits 11343 bytes 
Fri 17 Jan 2014 02:58:04 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:58:04 - job_xml_thread(): Done retrieving: data size 43877944
Fri 17 Jan 2014 02:58:04 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:58:04 - XML: Start document: iteration 17
Fri 17 Jan 2014 02:58:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43877944
Fri 17 Jan 2014 02:58:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:58:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43877944
Fri 17 Jan 2014 02:58:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:58:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:58:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:58:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:58:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:58:21 - XML: Processed 655536 elements - found 669 jobs
Fri 17 Jan 2014 02:58:21 - job 7346264 report time 1389923790 does not match current heartbeat 1389923843 : ignoring job
Fri 17 Jan 2014 02:58:21 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 02:58:21 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 02:58:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:58:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:58:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:58:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:58:24 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 02:58:24 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:58:24 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:58:25 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:58:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:58:25 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:58:25 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:58:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:58:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:58:26 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:58:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:58:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:58:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:58:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:58:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:58:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:58:29 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 02:58:29 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 02:58:29 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:58:29 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:58:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 02:58:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:58:30 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:58:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43874939
Fri 17 Jan 2014 02:58:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:58:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43874939
Fri 17 Jan 2014 02:58:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:58:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:58:40 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:58:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:58:40 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:58:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:58:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:58:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:58:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:58:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:58:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:58:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:58:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:58:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:58:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:58:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:58:44 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:58:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:58:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:58:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:58:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:58:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:58:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:58:46 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:58:46 - job_xml_thread(): Done retrieving: data size 43878759
Fri 17 Jan 2014 02:58:46 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:58:46 - XML: Start document: iteration 18
Fri 17 Jan 2014 02:58:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43878759
Fri 17 Jan 2014 02:58:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:58:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43878759
Fri 17 Jan 2014 02:58:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:58:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:58:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:59:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:59:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:59:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:59:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:59:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:59:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:59:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:59:02 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:59:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:59:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:59:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:59:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:59:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:59:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 02:59:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:59:02 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:59:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7595 values 119773 bits 14971 bytes 
Fri 17 Jan 2014 02:59:02 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:59:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 02:59:04 - XML: Processed 655536 elements - found 669 jobs
Fri 17 Jan 2014 02:59:04 - job 7346264 report time 1389923790 does not match current heartbeat 1389923843 : ignoring job
Fri 17 Jan 2014 02:59:04 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 02:59:04 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 02:59:04 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:59:04 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:59:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:59:08 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:59:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:59:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:59:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:59:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:59:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:59:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:59:10 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 02:59:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 02:59:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:59:10 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:59:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851989
Fri 17 Jan 2014 02:59:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:59:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851989
Fri 17 Jan 2014 02:59:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:59:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:59:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:59:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:59:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:59:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:59:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:59:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:59:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:59:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851989
Fri 17 Jan 2014 02:59:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:59:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:59:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:59:19 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:59:19 - job_xml_thread(): Done retrieving: data size 43851989
Fri 17 Jan 2014 02:59:19 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:59:19 - XML: Start document: iteration 19
Fri 17 Jan 2014 02:59:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:59:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:59:27 - XML: Processed 655480 elements - found 666 jobs
Fri 17 Jan 2014 02:59:27 - job 7347187 appears to have finished
Fri 17 Jan 2014 02:59:27 - job 7347210 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 02:59:27 - job 7347176 appears to have finished
Fri 17 Jan 2014 02:59:27 - job 7347071 appears to have finished
Fri 17 Jan 2014 02:59:27 - job 7346264 report time 1389923790 does not match current heartbeat 1389923911 : ignoring job
Fri 17 Jan 2014 02:59:27 - job 7346714 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 02:59:27 - job 7347211 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 02:59:27 - job_xml_thread(): Found 6 updated jobs.
Fri 17 Jan 2014 02:59:27 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 02:59:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:59:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:59:36 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Fri 17 Jan 2014 02:59:36 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 02:59:36 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 02:59:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:59:36 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:59:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:59:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:59:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:59:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:59:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 02:59:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:59:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:59:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:59:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:59:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:59:37 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:59:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:59:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:59:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:59:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:59:39 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:59:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43298547
Fri 17 Jan 2014 02:59:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:59:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43298547
Fri 17 Jan 2014 02:59:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 02:59:51 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 02:59:51 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 02:59:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 02:59:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 02:59:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 02:59:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 02:59:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 02:59:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 02:59:54 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:59:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 02:59:54 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 02:59:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 02:59:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 02:59:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 02:59:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 02:59:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 02:59:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:59:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 02:59:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 02:59:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 02:59:56 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 02:59:56 - job_xml_thread(): Done retrieving: data size 43208680
Fri 17 Jan 2014 02:59:56 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 02:59:56 - XML: Start document: iteration 20
Fri 17 Jan 2014 02:59:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43208680
Fri 17 Jan 2014 02:59:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 02:59:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43208680
Fri 17 Jan 2014 02:59:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:00:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:00:03 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:00:05 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:00:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:00:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 03:00:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 03:00:05 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:00:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9279 values 146399 bits 18299 bytes 
Fri 17 Jan 2014 03:00:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:00:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:00:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:00:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:00:12 - XML: Processed 647362 elements - found 665 jobs
Fri 17 Jan 2014 03:00:12 - job 7346246 appears to have finished
Fri 17 Jan 2014 03:00:12 - job 7347210 field 'start_timestamp' changed since saved from: 1389923953 to: 1389923883
Fri 17 Jan 2014 03:00:12 - job 7346264 report time 1389923790 does not match current heartbeat 1389923964 : ignoring job
Fri 17 Jan 2014 03:00:12 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 03:00:12 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 03:00:14 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 03:00:14 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:00:14 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:00:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:00:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:00:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:00:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:00:16 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:00:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:00:16 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:00:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:00:16 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:00:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:00:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:00:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:00:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:00:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:00:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:00:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:00:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:00:21 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:00:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 03:00:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:00:21 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:00:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43286855
Fri 17 Jan 2014 03:00:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:00:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43286855
Fri 17 Jan 2014 03:00:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:00:29 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:00:29 - job_xml_thread(): Done retrieving: data size 43286855
Fri 17 Jan 2014 03:00:29 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:00:29 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 03:00:31 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 03:00:31 - Housekeeping: done.
Fri 17 Jan 2014 03:00:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:00:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:00:31 - XML: Start document: iteration 0
Fri 17 Jan 2014 03:00:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:00:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:00:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:00:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:00:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:00:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:00:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:00:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:00:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:00:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:00:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:00:41 - XML: Processed 648076 elements - found 665 jobs
Fri 17 Jan 2014 03:00:41 - job 7346264 report time 1389923790 does not match current heartbeat 1389923964 : ignoring job
Fri 17 Jan 2014 03:00:41 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 03:00:41 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 03:00:41 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:00:41 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:00:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:00:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:00:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:00:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:00:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:00:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:00:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:00:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:00:44 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:00:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43755973
Fri 17 Jan 2014 03:00:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:00:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43755973
Fri 17 Jan 2014 03:00:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:00:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:00:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:00:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:00:53 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:00:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:00:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:00:54 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:00:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:00:54 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:00:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:00:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43755973
Fri 17 Jan 2014 03:00:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:00:56 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:00:56 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:00:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:00:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:01:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:01:01 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:01:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:01:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:01:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:01:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:01:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:01:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:01:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:01:03 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:01:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:01:05 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:01:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:01:05 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:01:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 03:01:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 03:01:05 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:01:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99083 bits 12385 bytes 
Fri 17 Jan 2014 03:01:06 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:01:06 - job_xml_thread(): Done retrieving: data size 43863883
Fri 17 Jan 2014 03:01:06 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:01:06 - XML: Start document: iteration 1
Fri 17 Jan 2014 03:01:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43863883
Fri 17 Jan 2014 03:01:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:01:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:01:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:01:11 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:01:11 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:01:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:01:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:01:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43863883
Fri 17 Jan 2014 03:01:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:01:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:01:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:01:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:01:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:01:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:01:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:01:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:01:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:01:27 - XML: Processed 655486 elements - found 663 jobs
Fri 17 Jan 2014 03:01:27 - job 7347190 appears to have finished
Fri 17 Jan 2014 03:01:28 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 03:01:28 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 03:01:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:01:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:01:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:01:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:01:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:01:28 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 03:01:28 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:01:28 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:01:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:01:30 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:01:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:01:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:01:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:01:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:01:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:01:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:01:33 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:01:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 03:01:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:01:33 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:01:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870488
Fri 17 Jan 2014 03:01:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:01:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870488
Fri 17 Jan 2014 03:01:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:01:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:01:43 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:01:44 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:01:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:01:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:01:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:01:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:01:46 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:01:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:01:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:01:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:01:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:01:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:01:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:01:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:01:49 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:01:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:01:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:01:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:01:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:01:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:01:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:01:51 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:01:51 - job_xml_thread(): Done retrieving: data size 43878296
Fri 17 Jan 2014 03:01:51 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:01:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43878296
Fri 17 Jan 2014 03:01:51 - XML: Start document: iteration 2
Fri 17 Jan 2014 03:01:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:01:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43878296
Fri 17 Jan 2014 03:01:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:02:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:02:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:02:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:02:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:02:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:02:05 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:02:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:02:06 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:02:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 03:02:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 03:02:06 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:02:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6920 values 109430 bits 13678 bytes 
Fri 17 Jan 2014 03:02:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:02:10 - XML: Processed 655524 elements - found 663 jobs
Fri 17 Jan 2014 03:02:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:02:10 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 03:02:10 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 03:02:10 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:02:10 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:02:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:02:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:02:11 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:02:11 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:02:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:02:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:02:11 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:02:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:02:15 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:02:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:02:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:02:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:02:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:02:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:02:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:02:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:02:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43876690
Fri 17 Jan 2014 03:02:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:02:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43876690
Fri 17 Jan 2014 03:02:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:02:25 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:02:25 - job_xml_thread(): Done retrieving: data size 43876690
Fri 17 Jan 2014 03:02:25 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:02:25 - XML: Start document: iteration 3
Fri 17 Jan 2014 03:02:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:02:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:02:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:02:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:02:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:02:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:02:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:02:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:02:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:02:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:02:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:02:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:02:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:02:40 - XML: Processed 655520 elements - found 661 jobs
Fri 17 Jan 2014 03:02:40 - job 7347183 appears to have finished
Fri 17 Jan 2014 03:02:40 - job 7347148 appears to have finished
Fri 17 Jan 2014 03:02:40 - job 7346306 appears to have finished
Fri 17 Jan 2014 03:02:40 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 03:02:41 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 03:02:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:02:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:02:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:02:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:02:42 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:02:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 03:02:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:02:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:02:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:02:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:02:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:02:46 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 03:02:46 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:02:46 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:02:47 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:02:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43850111
Fri 17 Jan 2014 03:02:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:02:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:02:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:02:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43850111
Fri 17 Jan 2014 03:02:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:02:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:02:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:02:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:02:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:02:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:02:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:02:59 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:02:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:02:59 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:02:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:02:59 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:03:01 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:03:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:03:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:03:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:03:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:03:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:03:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:03:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:03:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:03:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:03:07 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:03:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:03:08 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:03:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 03:03:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 03:03:08 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:03:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5783 values 91500 bits 11437 bytes 
Fri 17 Jan 2014 03:03:10 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:03:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43872830
Fri 17 Jan 2014 03:03:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:03:11 - job_xml_thread(): Done retrieving: data size 43872830
Fri 17 Jan 2014 03:03:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43872830
Fri 17 Jan 2014 03:03:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:03:11 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:03:11 - XML: Start document: iteration 4
Fri 17 Jan 2014 03:03:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:03:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:03:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:03:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:03:30 - XML: Processed 655520 elements - found 661 jobs
Fri 17 Jan 2014 03:03:30 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 03:03:30 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 03:03:30 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:03:30 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:03:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:03:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:03:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:03:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:03:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:03:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:03:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:03:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:03:31 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:03:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:03:34 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:03:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:03:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:03:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:03:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:03:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:03:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:03:35 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:03:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 03:03:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:03:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:03:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43890641
Fri 17 Jan 2014 03:03:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:03:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43890641
Fri 17 Jan 2014 03:03:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:03:40 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 03:03:40 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:03:42 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:03:42 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 03:03:42 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 03:03:42 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:03:42 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 03:03:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:03:45 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:03:45 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:03:45 - job_xml_thread(): Done retrieving: data size 43890641
Fri 17 Jan 2014 03:03:46 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:03:46 - XML: Start document: iteration 5
Fri 17 Jan 2014 03:03:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:03:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:03:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:03:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:03:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:03:48 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:03:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:03:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:03:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Fri 17 Jan 2014 03:03:56 - XML: Processed 655526 elements - found 664 jobs
Fri 17 Jan 2014 03:03:57 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 03:03:57 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 03:03:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:03:57 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:03:57 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 03:03:57 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:03:57 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:03:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:03:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:03:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:03:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:03:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:03:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:03:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:03:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856746
Fri 17 Jan 2014 03:03:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:04:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43856746
Fri 17 Jan 2014 03:04:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:04:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:04:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:04:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:04:09 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:04:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:04:09 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:04:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 03:04:09 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:04:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7738 values 122142 bits 15267 bytes 
Fri 17 Jan 2014 03:04:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 03:04:12 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:04:12 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:04:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:04:13 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:04:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:04:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:04:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:04:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:04:14 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:04:14 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:04:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:04:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:04:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:04:15 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:04:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:04:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:04:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:04:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:04:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:04:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:04:17 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:04:17 - job_xml_thread(): Done retrieving: data size 43877685
Fri 17 Jan 2014 03:04:17 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:04:17 - XML: Start document: iteration 6
Fri 17 Jan 2014 03:04:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43877685
Fri 17 Jan 2014 03:04:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:04:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43877685
Fri 17 Jan 2014 03:04:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:04:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:04:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:04:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:04:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:04:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:04:38 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:04:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:04:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:04:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:04:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:04:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:04:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:04:40 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:04:41 - XML: Processed 655528 elements - found 665 jobs
Fri 17 Jan 2014 03:04:41 - job 7347215 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 03:04:41 - job 7347214 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 03:04:41 - job 7347213 field 'start_timestamp' changed since saved from: 1389924184 to: 1389924127
Fri 17 Jan 2014 03:04:41 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 03:04:41 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 03:04:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:04:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:04:42 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 03:04:42 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:04:42 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:04:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:04:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:04:42 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:04:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 03:04:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:04:42 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:04:42 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:04:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:04:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:04:42 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:04:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:04:42 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 03:04:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:04:42 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:04:42 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 03:04:42 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 03:04:44 - size of cluster 'LISA Cluster': 624 hosts 79484 metrics 990960 values 15654345 bits 1956793 bytes 
Fri 17 Jan 2014 03:04:47 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:04:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43869533
Fri 17 Jan 2014 03:04:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:04:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43869533
Fri 17 Jan 2014 03:04:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:04:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:04:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:04:57 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:04:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:04:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:04:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:04:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:04:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:05:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:05:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:05:01 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:05:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:05:01 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:05:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:05:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:05:03 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:05:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:05:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:05:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:05:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:05:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:05:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:05:06 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:05:06 - job_xml_thread(): Done retrieving: data size 43878683
Fri 17 Jan 2014 03:05:06 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:05:06 - XML: Start document: iteration 7
Fri 17 Jan 2014 03:05:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43878683
Fri 17 Jan 2014 03:05:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:05:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43878683
Fri 17 Jan 2014 03:05:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:05:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:05:11 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:05:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:05:14 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:05:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 03:05:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 03:05:14 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:05:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8939 values 141049 bits 17631 bytes 
Fri 17 Jan 2014 03:05:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:05:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:05:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:05:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:05:23 - XML: Processed 655526 elements - found 664 jobs
Fri 17 Jan 2014 03:05:23 - job 7347174 appears to have finished
Fri 17 Jan 2014 03:05:24 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 03:05:24 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 03:05:25 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 03:05:26 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:05:26 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:05:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:05:28 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:05:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:05:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:05:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:05:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:05:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:05:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:05:29 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:05:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:05:30 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:05:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:05:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:05:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:05:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:05:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:05:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:05:35 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:05:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 03:05:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:05:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:05:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43357014
Fri 17 Jan 2014 03:05:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:05:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43357014
Fri 17 Jan 2014 03:05:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:05:43 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:05:43 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 03:05:43 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:05:43 - job_xml_thread(): Done retrieving: data size 43357014
Fri 17 Jan 2014 03:05:43 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:05:43 - XML: Start document: iteration 8
Fri 17 Jan 2014 03:05:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:05:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:05:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:05:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:05:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:05:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:05:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:05:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43357014
Fri 17 Jan 2014 03:05:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:05:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:05:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:05:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:05:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:05:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:06:04 - XML: Processed 649152 elements - found 664 jobs
Fri 17 Jan 2014 03:06:04 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 03:06:04 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 03:06:04 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:06:04 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:06:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:06:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:06:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:06:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:06:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:06:06 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:06:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:06:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:06:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:06:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:06:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:06:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:06:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:06:06 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:06:06 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:06:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:06:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:06:09 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:06:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43242319
Fri 17 Jan 2014 03:06:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:06:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43242319
Fri 17 Jan 2014 03:06:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:06:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:06:14 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:06:15 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:06:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:06:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 03:06:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 03:06:15 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:06:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99119 bits 12389 bytes 
Fri 17 Jan 2014 03:06:19 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:06:19 - job_xml_thread(): Done retrieving: data size 43242319
Fri 17 Jan 2014 03:06:19 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:06:19 - XML: Start document: iteration 9
Fri 17 Jan 2014 03:06:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:06:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:06:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:06:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:06:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:06:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:06:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:06:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:06:25 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:06:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:06:25 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:06:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:06:25 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:06:31 - XML: Processed 647464 elements - found 662 jobs
Fri 17 Jan 2014 03:06:31 - job 7347188 appears to have finished
Fri 17 Jan 2014 03:06:31 - job 7347170 appears to have finished
Fri 17 Jan 2014 03:06:31 - job 7347214 field 'start_timestamp' changed since saved from: 1389924276 to: 1389924188
Fri 17 Jan 2014 03:06:31 - job 7347067 appears to have finished
Fri 17 Jan 2014 03:06:31 - job_xml_thread(): Found 5 updated jobs.
Fri 17 Jan 2014 03:06:31 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 03:06:31 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Fri 17 Jan 2014 03:06:31 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:06:31 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:06:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:06:33 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:06:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:06:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:06:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:06:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:06:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:06:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:06:37 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:06:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43347874
Fri 17 Jan 2014 03:06:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:06:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43347874
Fri 17 Jan 2014 03:06:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:06:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:06:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:06:47 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:06:47 - job_xml_thread(): Done retrieving: data size 43347874
Fri 17 Jan 2014 03:06:47 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:06:47 - XML: Start document: iteration 10
Fri 17 Jan 2014 03:06:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:06:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:06:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:06:50 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:06:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:06:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:06:51 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:06:51 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:06:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:06:51 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:06:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:06:53 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:06:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 03:06:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:06:59 - XML: Processed 649172 elements - found 662 jobs
Fri 17 Jan 2014 03:06:59 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 03:06:59 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 03:06:59 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:06:59 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:07:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:07:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:07:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:07:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:07:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:07:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:07:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:07:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:07:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:07:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:07:08 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:07:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43842448
Fri 17 Jan 2014 03:07:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:07:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43842448
Fri 17 Jan 2014 03:07:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:07:14 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:07:15 - job_xml_thread(): Done retrieving: data size 43842448
Fri 17 Jan 2014 03:07:15 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:07:16 - XML: Start document: iteration 11
Fri 17 Jan 2014 03:07:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:07:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:07:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:07:16 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:07:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:07:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 03:07:18 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:07:18 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:07:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6064 values 95739 bits 11967 bytes 
Fri 17 Jan 2014 03:07:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 03:07:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:07:29 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:07:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:07:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:07:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:07:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:07:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:07:31 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:07:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:07:35 - XML: Processed 655522 elements - found 662 jobs
Fri 17 Jan 2014 03:07:35 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 03:07:35 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 03:07:35 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:07:35 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:07:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:07:37 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:07:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:07:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:07:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:07:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:07:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:07:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:07:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:07:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:07:50 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:07:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:07:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:07:55 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:07:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43836119
Fri 17 Jan 2014 03:07:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:07:55 - job_xml_thread(): Done retrieving: data size 43836119
Fri 17 Jan 2014 03:07:55 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:07:56 - XML: Start document: iteration 12
Fri 17 Jan 2014 03:07:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43836119
Fri 17 Jan 2014 03:07:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:08:07 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 03:08:07 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 03:08:07 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:08:13 - XML: Processed 655522 elements - found 662 jobs
Fri 17 Jan 2014 03:08:13 - job 7347070 appears to have finished
Fri 17 Jan 2014 03:08:13 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 03:08:13 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 03:08:15 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 03:08:15 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:08:15 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:08:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:08:16 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:08:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:08:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:08:16 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:08:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:08:16 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:08:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:08:16 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:08:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:08:19 - ganglia_store_thread(): storemetricthread() (cluster Render Cluster) still running, waiting to finish..
Fri 17 Jan 2014 03:08:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:08:20 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:08:20 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:08:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 03:08:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:08:20 - ganglia_store_thread(): Done waiting: storemetricthread() has finished: cluster Render Cluster
Fri 17 Jan 2014 03:08:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:08:20 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:08:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:08:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:08:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:08:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:08:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:08:20 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:08:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 03:08:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:08:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 03:08:20 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:08:20 - size of cluster 'Render Cluster': 20 hosts 3138 metrics 2820 values 44528 bits 5566 bytes 
Fri 17 Jan 2014 03:08:24 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:08:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43874342
Fri 17 Jan 2014 03:08:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:08:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43874342
Fri 17 Jan 2014 03:08:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:08:30 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:08:30 - job_xml_thread(): Done retrieving: data size 43874342
Fri 17 Jan 2014 03:08:30 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:08:30 - XML: Start document: iteration 13
Fri 17 Jan 2014 03:08:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:08:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:08:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:08:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:08:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:08:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:08:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:08:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:08:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:08:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:08:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43874342
Fri 17 Jan 2014 03:08:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:08:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:08:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:08:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:08:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:08:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:08:50 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:08:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:08:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:08:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:08:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:08:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:08:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:08:51 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:08:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:08:51 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:08:51 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:08:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:08:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:08:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:08:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:08:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:08:54 - XML: Processed 655522 elements - found 662 jobs
Fri 17 Jan 2014 03:08:54 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 03:08:54 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 03:08:54 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:08:54 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:08:55 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:08:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 03:08:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:08:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:08:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43888569
Fri 17 Jan 2014 03:08:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:09:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43888569
Fri 17 Jan 2014 03:09:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:09:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:09:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:09:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:09:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:09:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:09:09 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:09:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:09:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:09:09 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:09:09 - job_xml_thread(): Done retrieving: data size 43888569
Fri 17 Jan 2014 03:09:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:09:09 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:09:09 - XML: Start document: iteration 14
Fri 17 Jan 2014 03:09:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:09:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:09:10 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:09:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:09:20 - XML: Processed 655522 elements - found 662 jobs
Fri 17 Jan 2014 03:09:20 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 03:09:20 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 03:09:20 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:09:20 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:09:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:09:20 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:09:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:09:21 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:09:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 03:09:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 03:09:21 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:09:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5705 values 89970 bits 11246 bytes 
Fri 17 Jan 2014 03:09:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:09:23 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:09:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:09:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:09:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:09:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:09:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:09:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:09:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:09:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:09:26 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:09:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851615
Fri 17 Jan 2014 03:09:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:09:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851615
Fri 17 Jan 2014 03:09:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:09:35 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:09:35 - job_xml_thread(): Done retrieving: data size 43851615
Fri 17 Jan 2014 03:09:35 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:09:35 - XML: Start document: iteration 15
Fri 17 Jan 2014 03:09:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:09:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:09:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:09:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:09:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:09:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:09:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:09:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:09:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:09:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:09:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:09:45 - XML: Processed 655522 elements - found 662 jobs
Fri 17 Jan 2014 03:09:45 - job 7347185 appears to have finished
Fri 17 Jan 2014 03:09:45 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 03:09:45 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 03:09:47 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 03:09:47 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:09:47 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:09:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:09:48 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:09:48 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:09:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 03:09:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:09:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:09:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:09:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:09:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:09:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:09:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:09:51 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:09:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43854357
Fri 17 Jan 2014 03:09:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:09:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43854357
Fri 17 Jan 2014 03:09:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:09:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:09:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:10:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:10:00 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:10:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:10:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:10:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:10:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:10:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:10:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:10:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:10:02 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:10:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:10:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:10:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:10:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:10:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:10:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:10:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:10:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:10:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:10:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:10:09 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:10:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43881503
Fri 17 Jan 2014 03:10:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:10:09 - job_xml_thread(): Done retrieving: data size 43881503
Fri 17 Jan 2014 03:10:09 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:10:09 - XML: Start document: iteration 16
Fri 17 Jan 2014 03:10:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43881503
Fri 17 Jan 2014 03:10:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:10:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:10:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:10:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:10:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:10:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:10:21 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:10:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:10:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 03:10:22 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:10:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9061 values 142983 bits 17872 bytes 
Fri 17 Jan 2014 03:10:22 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:10:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 03:10:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:10:25 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:10:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:10:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:10:26 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:10:26 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:10:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:10:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:10:26 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:10:30 - XML: Processed 655522 elements - found 662 jobs
Fri 17 Jan 2014 03:10:30 - job 7347123 appears to have finished
Fri 17 Jan 2014 03:10:30 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 03:10:30 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 03:10:30 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 03:10:30 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:10:30 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:10:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:10:33 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:10:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:10:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:10:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:10:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:10:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:10:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:10:35 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:10:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 03:10:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:10:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:10:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853226
Fri 17 Jan 2014 03:10:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:10:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853226
Fri 17 Jan 2014 03:10:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:10:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:10:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:10:45 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:10:45 - job_xml_thread(): Done retrieving: data size 43853226
Fri 17 Jan 2014 03:10:45 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:10:45 - XML: Start document: iteration 17
Fri 17 Jan 2014 03:10:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:10:48 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:10:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:10:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:10:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:10:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:10:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:10:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:10:49 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:10:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:10:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:10:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:11:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:11:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:11:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:11:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:11:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:11:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:11:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:11:01 - XML: Processed 655522 elements - found 662 jobs
Fri 17 Jan 2014 03:11:01 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 03:11:01 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 03:11:01 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:11:01 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:11:03 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:11:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43836070
Fri 17 Jan 2014 03:11:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:11:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43836070
Fri 17 Jan 2014 03:11:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:11:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:11:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:11:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:11:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:11:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:11:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:11:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:11:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:11:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:11:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:11:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:11:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:11:15 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:11:16 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:11:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:11:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:11:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:11:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:11:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:11:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:11:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:11:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:11:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:11:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43803853
Fri 17 Jan 2014 03:11:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:11:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43803853
Fri 17 Jan 2014 03:11:20 - job_xml_thread(): Done retrieving: data size 43803853
Fri 17 Jan 2014 03:11:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:11:20 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:11:22 - XML: Start document: iteration 18
Fri 17 Jan 2014 03:11:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:11:22 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:11:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:11:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 03:11:24 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:11:24 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:11:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 03:11:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148629 bits 18578 bytes 
Fri 17 Jan 2014 03:11:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:11:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:11:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:11:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:11:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:11:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:11:40 - XML: Processed 654776 elements - found 663 jobs
Fri 17 Jan 2014 03:11:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:11:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:11:41 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 03:11:41 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 03:11:41 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 03:11:41 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:11:41 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:11:42 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:11:42 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:11:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:11:42 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:11:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:11:43 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 03:11:43 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:11:43 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:11:43 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 03:11:43 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:11:43 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 03:11:43 - Entering storeMetrics(): cluster LISA Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Fri 17 Jan 2014 03:11:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:11:45 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:11:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:11:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:11:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:11:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:11:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:11:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:11:47 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:11:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43240824
Fri 17 Jan 2014 03:11:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:11:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43240824
Fri 17 Jan 2014 03:11:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:11:56 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:11:56 - job_xml_thread(): Done retrieving: data size 43240824
Fri 17 Jan 2014 03:11:56 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:11:56 - XML: Start document: iteration 19
Fri 17 Jan 2014 03:11:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:11:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:11:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:11:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:11:59 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:11:59 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:12:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:12:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:12:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:12:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:12:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:12:09 - XML: Processed 647830 elements - found 663 jobs
Fri 17 Jan 2014 03:12:09 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 03:12:09 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 03:12:09 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:12:09 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:12:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:12:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:12:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:12:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:12:10 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:12:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 03:12:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:12:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:12:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:12:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:12:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:12:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:12:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43201836
Fri 17 Jan 2014 03:12:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:12:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43201836
Fri 17 Jan 2014 03:12:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:12:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:12:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:12:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:12:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:12:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:12:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:12:23 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:12:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:12:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:12:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:12:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:12:24 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:12:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:12:24 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:12:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:12:25 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:12:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 03:12:25 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:12:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 03:12:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5809 values 91658 bits 11457 bytes 
Fri 17 Jan 2014 03:12:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:12:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:12:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:12:26 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:12:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:12:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:12:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:12:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:12:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:12:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:12:28 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:12:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43325300
Fri 17 Jan 2014 03:12:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:12:29 - job_xml_thread(): Done retrieving: data size 43325300
Fri 17 Jan 2014 03:12:29 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:12:29 - XML: Start document: iteration 20
Fri 17 Jan 2014 03:12:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43325300
Fri 17 Jan 2014 03:12:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:12:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:12:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:12:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:12:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:12:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:12:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:12:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:12:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:12:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:12:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:12:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:12:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:12:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:12:44 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:12:44 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:12:45 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:12:45 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:12:45 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 03:12:45 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 03:12:45 - Entering storeMetrics(): cluster LISA Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Fri 17 Jan 2014 03:12:48 - XML: Processed 648557 elements - found 662 jobs
Fri 17 Jan 2014 03:12:48 - job 7347216 appears to have finished
Fri 17 Jan 2014 03:12:48 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 03:12:48 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 03:12:48 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 03:12:48 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:12:48 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:12:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:12:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:12:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:12:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:12:50 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:12:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 03:12:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:12:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:12:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:12:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:12:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:12:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:12:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43803149
Fri 17 Jan 2014 03:12:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:12:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43803149
Fri 17 Jan 2014 03:12:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:12:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:12:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:13:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:13:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:13:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:13:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:13:04 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:13:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:13:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:13:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:13:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:13:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:13:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:13:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:13:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:13:06 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:13:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:13:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:13:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:13:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:13:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:13:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:13:08 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:13:08 - job_xml_thread(): Done retrieving: data size 43876970
Fri 17 Jan 2014 03:13:08 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:13:08 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 03:13:08 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 03:13:08 - Housekeeping: done.
Fri 17 Jan 2014 03:13:08 - XML: Start document: iteration 0
Fri 17 Jan 2014 03:13:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43876970
Fri 17 Jan 2014 03:13:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:13:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43876970
Fri 17 Jan 2014 03:13:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:13:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:13:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:13:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:13:21 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:13:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:13:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:13:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:13:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:13:23 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:13:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:13:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:13:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:13:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:13:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:13:25 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:13:25 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:13:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:13:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 03:13:25 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:13:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 03:13:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9107 values 143740 bits 17967 bytes 
Fri 17 Jan 2014 03:13:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:13:26 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:13:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:13:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:13:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:13:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:13:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:13:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:13:30 - XML: Processed 655520 elements - found 661 jobs
Fri 17 Jan 2014 03:13:30 - job 7347186 appears to have finished
Fri 17 Jan 2014 03:13:30 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 03:13:30 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 03:13:30 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 03:13:30 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:13:30 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:13:33 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:13:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43840746
Fri 17 Jan 2014 03:13:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:13:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43840746
Fri 17 Jan 2014 03:13:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:13:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:13:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:13:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:13:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:13:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:13:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:13:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:13:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:13:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:13:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:13:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43840746
Fri 17 Jan 2014 03:13:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:13:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:13:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:13:45 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:13:45 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:13:45 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:13:45 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:13:46 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:13:46 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 03:13:46 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 03:13:46 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:13:46 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 03:13:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:13:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:13:55 - size of cluster 'LISA Cluster': 624 hosts 79485 metrics 1028062 values 16216594 bits 2027074 bytes 
Fri 17 Jan 2014 03:13:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:13:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:13:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:13:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:13:56 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:13:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 03:13:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:13:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:13:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:13:56 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:13:56 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:13:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:13:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:13:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:13:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:13:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:13:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:14:00 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:14:00 - job_xml_thread(): Done retrieving: data size 43855460
Fri 17 Jan 2014 03:14:00 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:14:00 - XML: Start document: iteration 1
Fri 17 Jan 2014 03:14:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855460
Fri 17 Jan 2014 03:14:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:14:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855460
Fri 17 Jan 2014 03:14:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:14:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:14:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:14:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:14:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:14:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:14:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:14:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:14:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:14:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:14:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:14:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:14:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:14:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:14:17 - XML: Processed 655520 elements - found 661 jobs
Fri 17 Jan 2014 03:14:17 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 03:14:17 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 03:14:18 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:14:18 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:14:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:14:21 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:14:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:14:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:14:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:14:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:14:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:14:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:14:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:14:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43861373
Fri 17 Jan 2014 03:14:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:14:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:14:25 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:14:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43861373
Fri 17 Jan 2014 03:14:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:14:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:14:26 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:14:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 03:14:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 03:14:26 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:14:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9185 values 144920 bits 18115 bytes 
Fri 17 Jan 2014 03:14:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:14:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:14:33 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:14:33 - job_xml_thread(): Done retrieving: data size 43861373
Fri 17 Jan 2014 03:14:33 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:14:33 - XML: Start document: iteration 2
Fri 17 Jan 2014 03:14:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:14:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:14:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:14:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:14:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:14:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:14:42 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:14:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:14:42 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:14:42 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:14:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:14:46 - XML: Processed 655518 elements - found 660 jobs
Fri 17 Jan 2014 03:14:46 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:14:46 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 03:14:47 - job 7347196 appears to have finished
Fri 17 Jan 2014 03:14:47 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 03:14:47 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 03:14:47 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 03:14:47 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:14:47 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:14:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:14:49 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:14:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:14:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:14:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:14:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:14:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:14:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:14:54 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:14:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43860360
Fri 17 Jan 2014 03:14:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:14:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43860360
Fri 17 Jan 2014 03:14:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:14:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:14:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:15:02 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:15:02 - job_xml_thread(): Done retrieving: data size 43860360
Fri 17 Jan 2014 03:15:02 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:15:03 - XML: Start document: iteration 3
Fri 17 Jan 2014 03:15:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:15:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:15:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:15:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:15:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:15:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:15:11 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:15:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:15:11 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:15:11 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:15:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:15:16 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:15:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 03:15:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:15:17 - XML: Processed 655518 elements - found 660 jobs
Fri 17 Jan 2014 03:15:17 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 03:15:17 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 03:15:17 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:15:18 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:15:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:15:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:15:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:15:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:15:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:15:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:15:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:15:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:15:22 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:15:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43852623
Fri 17 Jan 2014 03:15:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:15:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43852623
Fri 17 Jan 2014 03:15:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:15:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:15:26 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:15:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:15:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:15:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:15:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 03:15:27 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:15:27 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:15:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 03:15:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5929 values 93563 bits 11695 bytes 
Fri 17 Jan 2014 03:15:33 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:15:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:15:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:15:34 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:15:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:15:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:15:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:15:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:15:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:15:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:15:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:15:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:15:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:15:38 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:15:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:15:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:15:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:15:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:15:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:15:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:15:42 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:15:42 - job_xml_thread(): Done retrieving: data size 43881847
Fri 17 Jan 2014 03:15:42 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:15:42 - XML: Start document: iteration 4
Fri 17 Jan 2014 03:15:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43881847
Fri 17 Jan 2014 03:15:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:15:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43881847
Fri 17 Jan 2014 03:15:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:15:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:15:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:15:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:15:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:15:58 - XML: Processed 655518 elements - found 660 jobs
Fri 17 Jan 2014 03:15:58 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 03:15:58 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 03:15:58 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:15:58 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:16:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:16:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:16:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:16:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:16:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:16:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:16:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:16:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:16:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:16:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:16:06 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:16:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:16:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:16:06 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:16:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 03:16:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:16:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:16:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:16:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:16:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:16:10 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:16:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43884031
Fri 17 Jan 2014 03:16:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:16:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43884031
Fri 17 Jan 2014 03:16:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:16:13 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:16:13 - job_xml_thread(): Done retrieving: data size 43884031
Fri 17 Jan 2014 03:16:13 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:16:13 - XML: Start document: iteration 5
Fri 17 Jan 2014 03:16:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:16:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:16:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:16:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:16:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:16:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:16:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:16:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:16:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:16:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:16:27 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:16:27 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:16:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:16:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:16:28 - XML: Processed 655518 elements - found 660 jobs
Fri 17 Jan 2014 03:16:28 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:16:28 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 03:16:28 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 03:16:28 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:16:28 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:16:29 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:16:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:16:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 03:16:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 03:16:29 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:16:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5675 values 89566 bits 11195 bytes 
Fri 17 Jan 2014 03:16:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:16:34 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:16:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:16:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:16:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:16:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:16:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:16:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:16:37 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:16:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862656
Fri 17 Jan 2014 03:16:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:16:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862656
Fri 17 Jan 2014 03:16:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:16:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:16:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:16:43 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:16:43 - job_xml_thread(): Done retrieving: data size 43862656
Fri 17 Jan 2014 03:16:43 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:16:43 - XML: Start document: iteration 6
Fri 17 Jan 2014 03:16:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:16:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:16:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:16:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:16:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:16:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:16:56 - XML: Processed 655518 elements - found 660 jobs
Fri 17 Jan 2014 03:16:56 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 03:16:56 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 03:16:56 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:16:56 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:16:56 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:16:56 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:16:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:16:56 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:16:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:17:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:17:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:17:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:17:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:17:00 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:17:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 03:17:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:17:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:17:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:17:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:17:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:17:03 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:17:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43866290
Fri 17 Jan 2014 03:17:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:17:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43866290
Fri 17 Jan 2014 03:17:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:17:11 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:17:11 - job_xml_thread(): Done retrieving: data size 43866290
Fri 17 Jan 2014 03:17:11 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:17:11 - XML: Start document: iteration 7
Fri 17 Jan 2014 03:17:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:17:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:17:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:17:14 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:17:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:17:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:17:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:17:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:17:15 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:17:16 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:17:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:17:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:17:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:17:24 - XML: Processed 655518 elements - found 660 jobs
Fri 17 Jan 2014 03:17:24 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 03:17:24 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 03:17:24 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:17:24 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:17:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:17:26 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:17:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:17:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:17:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:17:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:17:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:17:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:17:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:17:29 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:17:29 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:17:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 03:17:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:17:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 03:17:29 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:17:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5572 values 88045 bits 11005 bytes 
Fri 17 Jan 2014 03:17:29 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 03:17:29 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 03:17:29 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:17:29 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:17:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43797782
Fri 17 Jan 2014 03:17:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:17:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43797782
Fri 17 Jan 2014 03:17:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:17:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:17:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:17:39 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:17:39 - job_xml_thread(): Done retrieving: data size 43797782
Fri 17 Jan 2014 03:17:40 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:17:40 - XML: Start document: iteration 8
Fri 17 Jan 2014 03:17:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:17:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:17:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:17:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:17:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:17:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:17:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:17:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:17:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:17:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:17:44 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:17:53 - XML: Processed 654769 elements - found 661 jobs
Fri 17 Jan 2014 03:17:53 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 03:17:53 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 03:17:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:17:53 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:17:53 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 03:17:53 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:17:53 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:17:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:17:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:17:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:17:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:17:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:17:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:17:56 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:17:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43227904
Fri 17 Jan 2014 03:17:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:17:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43227904
Fri 17 Jan 2014 03:17:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:17:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:17:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:18:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:18:08 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:18:08 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:18:08 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:18:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:18:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:18:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:18:09 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:18:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:18:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:18:09 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:18:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 03:18:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:18:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:18:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:18:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:18:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:18:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:18:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:18:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:18:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:18:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:18:11 - job_xml_thread(): Done retrieving: data size 43248945
Fri 17 Jan 2014 03:18:11 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:18:11 - XML: Start document: iteration 9
Fri 17 Jan 2014 03:18:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43248945
Fri 17 Jan 2014 03:18:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43248945
Fri 17 Jan 2014 03:18:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:18:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:18:25 - XML: Processed 647384 elements - found 662 jobs
Fri 17 Jan 2014 03:18:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:18:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:18:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:18:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:18:25 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 03:18:25 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 03:18:26 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 03:18:26 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:18:26 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:18:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:18:29 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:18:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:18:30 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:18:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 03:18:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 03:18:30 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:18:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:18:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:18:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:18:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:18:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5995 values 94707 bits 11838 bytes 
Fri 17 Jan 2014 03:18:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:18:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:18:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:18:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:18:31 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:18:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:18:33 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:18:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:18:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:18:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:18:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:18:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:18:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:18:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:18:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43706974
Fri 17 Jan 2014 03:18:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:18:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43706974
Fri 17 Jan 2014 03:18:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:18:42 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:18:42 - job_xml_thread(): Done retrieving: data size 43706974
Fri 17 Jan 2014 03:18:42 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:18:42 - XML: Start document: iteration 10
Fri 17 Jan 2014 03:18:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:18:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:18:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:18:46 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:18:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:18:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:18:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:18:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:18:48 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:18:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:18:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:18:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:18:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:18:58 - XML: Processed 653450 elements - found 662 jobs
Fri 17 Jan 2014 03:18:58 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 03:18:58 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 03:18:58 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:18:58 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:18:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:18:59 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:18:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:18:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:18:59 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:18:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 03:18:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:19:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:19:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:19:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:19:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:19:01 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:19:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43833905
Fri 17 Jan 2014 03:19:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:19:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43833905
Fri 17 Jan 2014 03:19:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:19:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:19:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:19:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:19:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:19:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:19:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:19:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:19:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:19:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:19:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:19:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:19:13 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:19:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:19:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:19:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:19:15 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:19:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:19:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:19:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:19:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:19:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:19:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:19:17 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:19:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862908
Fri 17 Jan 2014 03:19:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:19:17 - job_xml_thread(): Done retrieving: data size 43862908
Fri 17 Jan 2014 03:19:17 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:19:17 - XML: Start document: iteration 11
Fri 17 Jan 2014 03:19:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862908
Fri 17 Jan 2014 03:19:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:19:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:19:28 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:19:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:19:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:19:29 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:19:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:19:29 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:19:29 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:19:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:19:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:19:31 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:19:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:19:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:19:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:19:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 03:19:31 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:19:31 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:19:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 03:19:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9026 values 142438 bits 17804 bytes 
Fri 17 Jan 2014 03:19:39 - XML: Processed 655520 elements - found 661 jobs
Fri 17 Jan 2014 03:19:39 - job 7341628 appears to have finished
Fri 17 Jan 2014 03:19:39 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 03:19:39 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 03:19:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:19:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:19:39 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 03:19:39 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:19:39 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:19:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:19:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:19:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:19:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:19:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:19:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:19:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:19:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43848928
Fri 17 Jan 2014 03:19:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:19:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:19:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:19:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43848928
Fri 17 Jan 2014 03:19:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:19:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:19:53 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:19:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:19:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:19:54 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:19:54 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:19:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:19:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:19:54 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:19:55 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:19:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:19:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:19:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:19:57 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:19:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:19:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:19:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:19:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:19:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:19:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:19:58 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:19:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 03:19:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:19:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:19:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875309
Fri 17 Jan 2014 03:19:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:20:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875309
Fri 17 Jan 2014 03:20:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:20:00 - job_xml_thread(): Done retrieving: data size 43875309
Fri 17 Jan 2014 03:20:00 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:20:00 - XML: Start document: iteration 12
Fri 17 Jan 2014 03:20:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:20:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:20:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:20:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:20:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:20:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:20:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:20:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:20:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:20:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:20:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:20:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:20:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:20:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:20:19 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:20:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:20:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:20:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:20:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:20:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:20:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:20:21 - XML: Processed 655518 elements - found 660 jobs
Fri 17 Jan 2014 03:20:21 - job 7347179 appears to have finished
Fri 17 Jan 2014 03:20:21 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 03:20:21 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 03:20:21 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 03:20:21 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:20:21 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:20:23 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:20:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43852134
Fri 17 Jan 2014 03:20:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:20:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43852134
Fri 17 Jan 2014 03:20:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:20:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:20:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:20:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:20:31 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:20:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:20:33 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:20:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 03:20:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 03:20:33 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:20:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8703 values 137262 bits 17157 bytes 
Fri 17 Jan 2014 03:20:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:20:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:20:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:20:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:20:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:20:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:20:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:20:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:20:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:20:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:20:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:20:36 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:20:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:20:38 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:20:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:20:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:20:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:20:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:20:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:20:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:20:40 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:20:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43889757
Fri 17 Jan 2014 03:20:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:20:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43889757
Fri 17 Jan 2014 03:20:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:20:41 - job_xml_thread(): Done retrieving: data size 43889757
Fri 17 Jan 2014 03:20:42 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:20:42 - XML: Start document: iteration 13
Fri 17 Jan 2014 03:20:47 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 03:20:47 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:20:48 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:20:48 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 03:20:48 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:20:48 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 03:20:48 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 03:20:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:20:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:20:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:20:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:20:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:20:58 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:20:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:20:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:20:59 - XML: Processed 655518 elements - found 660 jobs
Fri 17 Jan 2014 03:20:59 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 03:20:59 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 03:20:59 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:20:59 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:21:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:21:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:21:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:21:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:21:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:21:01 - size of cluster 'LISA Cluster': 624 hosts 79474 metrics 857086 values 13539087 bits 1692385 bytes 
Fri 17 Jan 2014 03:21:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:21:06 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:21:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:21:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:21:06 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:21:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 03:21:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:21:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:21:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:21:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:21:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:21:09 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:21:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43861070
Fri 17 Jan 2014 03:21:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:21:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43861070
Fri 17 Jan 2014 03:21:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:21:14 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:21:14 - job_xml_thread(): Done retrieving: data size 43861070
Fri 17 Jan 2014 03:21:14 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:21:14 - XML: Start document: iteration 14
Fri 17 Jan 2014 03:21:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:21:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:21:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:21:21 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:21:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:21:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:21:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:21:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:21:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:21:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:21:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:21:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:21:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:21:27 - XML: Processed 655514 elements - found 658 jobs
Fri 17 Jan 2014 03:21:27 - job 7347167 appears to have finished
Fri 17 Jan 2014 03:21:27 - job 7347197 appears to have finished
Fri 17 Jan 2014 03:21:27 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 03:21:27 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 03:21:27 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 03:21:27 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:21:27 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:21:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:21:31 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:21:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:21:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:21:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:21:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:21:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:21:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:21:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:21:33 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:21:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:21:34 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:21:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 03:21:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 03:21:34 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:21:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5756 values 90828 bits 11353 bytes 
Fri 17 Jan 2014 03:21:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:21:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43845072
Fri 17 Jan 2014 03:21:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:21:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43845072
Fri 17 Jan 2014 03:21:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:21:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:21:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:21:42 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:21:42 - job_xml_thread(): Done retrieving: data size 43845072
Fri 17 Jan 2014 03:21:42 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:21:42 - XML: Start document: iteration 15
Fri 17 Jan 2014 03:21:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:21:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:21:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:21:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:21:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:21:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:21:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:21:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:21:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:21:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:21:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:21:48 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:21:48 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 03:21:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:21:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:21:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:21:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:21:59 - XML: Processed 655514 elements - found 659 jobs
Fri 17 Jan 2014 03:21:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:21:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:21:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:21:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:21:59 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 03:21:59 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 03:21:59 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 03:21:59 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:21:59 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:22:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:22:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:22:01 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:22:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 03:22:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:22:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:22:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858366
Fri 17 Jan 2014 03:22:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:22:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43858366
Fri 17 Jan 2014 03:22:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:22:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:22:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:22:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:22:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:22:12 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:22:12 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:22:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:22:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:22:12 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:22:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:22:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:22:14 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:22:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:22:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:22:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:22:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:22:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:22:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:22:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:22:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:22:21 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:22:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855374
Fri 17 Jan 2014 03:22:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:22:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855374
Fri 17 Jan 2014 03:22:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:22:21 - job_xml_thread(): Done retrieving: data size 43855374
Fri 17 Jan 2014 03:22:21 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:22:21 - XML: Start document: iteration 16
Fri 17 Jan 2014 03:22:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:22:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:22:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:22:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:22:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:22:34 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:22:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:22:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 03:22:36 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:22:36 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:22:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 03:22:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6924 values 109319 bits 13664 bytes 
Fri 17 Jan 2014 03:22:37 - XML: Processed 655514 elements - found 658 jobs
Fri 17 Jan 2014 03:22:37 - job 7346693 appears to have finished
Fri 17 Jan 2014 03:22:37 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 03:22:37 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 03:22:38 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 03:22:38 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:22:38 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:22:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:22:41 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:22:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:22:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:22:42 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:22:42 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:22:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:22:42 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:22:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:22:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:22:45 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:22:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:22:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:22:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:22:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:22:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:22:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:22:48 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:22:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875489
Fri 17 Jan 2014 03:22:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:22:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875489
Fri 17 Jan 2014 03:22:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:22:55 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:22:55 - job_xml_thread(): Done retrieving: data size 43875489
Fri 17 Jan 2014 03:22:55 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:22:56 - XML: Start document: iteration 17
Fri 17 Jan 2014 03:22:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:22:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:22:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:22:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:22:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:22:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:23:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:23:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:23:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:23:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:23:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:23:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:23:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:23:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:23:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:23:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:23:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:23:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:23:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:23:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:23:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:23:09 - XML: Processed 655514 elements - found 658 jobs
Fri 17 Jan 2014 03:23:09 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 03:23:09 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 03:23:09 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:23:09 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:23:09 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:23:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 03:23:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:23:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:23:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858350
Fri 17 Jan 2014 03:23:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:23:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43858350
Fri 17 Jan 2014 03:23:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:23:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:23:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:23:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:23:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:23:24 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:23:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:23:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:23:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:23:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:23:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:23:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:23:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:23:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:23:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:23:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:23:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:23:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:23:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:23:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:23:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:23:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:23:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:23:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:23:32 - job_xml_thread(): Done retrieving: data size 43778591
Fri 17 Jan 2014 03:23:32 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:23:32 - XML: Start document: iteration 18
Fri 17 Jan 2014 03:23:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43778591
Fri 17 Jan 2014 03:23:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:23:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43778591
Fri 17 Jan 2014 03:23:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:23:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:23:36 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:23:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:23:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 03:23:37 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:23:37 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:23:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 03:23:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8803 values 138864 bits 17358 bytes 
Fri 17 Jan 2014 03:23:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:23:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:23:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:23:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:23:51 - XML: Processed 654372 elements - found 658 jobs
Fri 17 Jan 2014 03:23:51 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 03:23:51 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 03:23:51 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:23:51 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:23:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:23:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:23:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:23:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:23:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:23:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:23:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:23:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:23:55 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:23:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:23:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:23:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:23:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:23:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:23:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:23:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:23:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:24:00 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:24:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 03:24:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:24:00 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:24:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43221341
Fri 17 Jan 2014 03:24:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:24:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43221341
Fri 17 Jan 2014 03:24:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:24:06 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:24:06 - job_xml_thread(): Done retrieving: data size 43221341
Fri 17 Jan 2014 03:24:06 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:24:06 - XML: Start document: iteration 19
Fri 17 Jan 2014 03:24:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:24:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:24:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:24:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:24:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:24:21 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:24:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:24:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:24:23 - XML: Processed 647312 elements - found 657 jobs
Fri 17 Jan 2014 03:24:23 - job 7347199 appears to have finished
Fri 17 Jan 2014 03:24:24 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 03:24:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:24:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:24:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:24:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:24:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:24:24 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 03:24:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:24:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:24:24 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 03:24:24 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:24:24 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:24:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:24:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:24:25 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:24:25 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:24:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:24:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:24:27 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:24:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43304030
Fri 17 Jan 2014 03:24:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:24:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43304030
Fri 17 Jan 2014 03:24:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:24:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:24:38 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:24:39 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:24:39 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:24:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:24:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:24:39 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:24:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:24:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 03:24:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 03:24:39 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:24:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99140 bits 12392 bytes 
Fri 17 Jan 2014 03:24:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:24:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:24:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:24:41 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:24:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:24:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:24:42 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:24:42 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:24:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:24:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:24:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:24:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:24:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:24:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:24:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:24:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:24:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:24:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:24:47 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:24:47 - job_xml_thread(): Done retrieving: data size 43769921
Fri 17 Jan 2014 03:24:47 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:24:47 - XML: Start document: iteration 20
Fri 17 Jan 2014 03:24:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43769921
Fri 17 Jan 2014 03:24:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:24:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43769921
Fri 17 Jan 2014 03:24:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:24:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:24:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:24:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:24:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:25:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:25:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:25:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:25:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:25:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:25:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:25:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:25:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:25:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:25:11 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:25:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:25:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:25:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:25:12 - XML: Processed 654336 elements - found 657 jobs
Fri 17 Jan 2014 03:25:12 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 03:25:12 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 03:25:12 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:25:12 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:25:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:25:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:25:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:25:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:25:13 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:25:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 03:25:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:25:14 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 03:25:14 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 03:25:14 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:25:15 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:25:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43877185
Fri 17 Jan 2014 03:25:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:25:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43877185
Fri 17 Jan 2014 03:25:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:25:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:25:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:25:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:25:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:25:27 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:25:27 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:25:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:25:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:25:29 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:25:29 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:25:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:25:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:25:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:25:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:25:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:25:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:25:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:25:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:25:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:25:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:25:31 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:25:31 - job_xml_thread(): Done retrieving: data size 43870076
Fri 17 Jan 2014 03:25:31 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:25:31 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 03:25:31 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 03:25:31 - Housekeeping: done.
Fri 17 Jan 2014 03:25:31 - XML: Start document: iteration 0
Fri 17 Jan 2014 03:25:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870076
Fri 17 Jan 2014 03:25:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:25:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870076
Fri 17 Jan 2014 03:25:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:25:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:25:39 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:25:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:25:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 03:25:41 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:25:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 03:25:42 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:25:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8746 values 138005 bits 17250 bytes 
Fri 17 Jan 2014 03:25:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:25:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:25:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:25:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:25:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:25:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:25:44 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:25:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:25:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:25:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:25:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:25:53 - XML: Processed 655516 elements - found 659 jobs
Fri 17 Jan 2014 03:25:53 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 03:25:53 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 03:25:53 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 03:25:53 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:25:53 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:25:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:25:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:25:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:25:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:25:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:25:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:25:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:25:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:25:56 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:25:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853780
Fri 17 Jan 2014 03:25:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:25:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853780
Fri 17 Jan 2014 03:25:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:26:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:26:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:26:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:26:06 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:26:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:26:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:26:08 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:26:08 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:26:08 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:26:08 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:26:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:26:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:26:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:26:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:26:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:26:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:26:10 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:26:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 03:26:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:26:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:26:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:26:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:26:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:26:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:26:12 - job_xml_thread(): Done retrieving: data size 43900896
Fri 17 Jan 2014 03:26:12 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:26:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43900896
Fri 17 Jan 2014 03:26:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:26:12 - XML: Start document: iteration 1
Fri 17 Jan 2014 03:26:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43900896
Fri 17 Jan 2014 03:26:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:26:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:26:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:26:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:26:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:26:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:26:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:26:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:26:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:26:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:26:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:26:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:26:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:26:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:26:35 - XML: Processed 655518 elements - found 660 jobs
Fri 17 Jan 2014 03:26:35 - job 7347226 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 03:26:35 - job 7346724 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 03:26:35 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 03:26:35 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 03:26:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:26:36 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:26:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:26:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:26:36 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 03:26:36 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:26:36 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:26:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:26:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:26:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:26:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:26:37 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:26:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43838419
Fri 17 Jan 2014 03:26:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:26:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43838419
Fri 17 Jan 2014 03:26:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:26:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:26:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:26:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:26:42 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:26:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:26:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 03:26:43 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:26:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8865 values 139860 bits 17482 bytes 
Fri 17 Jan 2014 03:26:43 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:26:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 03:26:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:26:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:26:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:26:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:26:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:26:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:26:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:26:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:26:48 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:26:51 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:26:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:26:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:26:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:26:52 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:26:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:26:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:26:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:26:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:26:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:26:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:26:54 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:26:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43872429
Fri 17 Jan 2014 03:26:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:26:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43872429
Fri 17 Jan 2014 03:26:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:26:55 - job_xml_thread(): Done retrieving: data size 43872429
Fri 17 Jan 2014 03:26:55 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:26:55 - XML: Start document: iteration 2
Fri 17 Jan 2014 03:27:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:27:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:27:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:27:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:27:11 - XML: Processed 655518 elements - found 660 jobs
Fri 17 Jan 2014 03:27:11 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 03:27:11 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 03:27:11 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:27:11 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:27:14 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:27:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 03:27:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:27:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:27:14 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:27:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:27:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:27:16 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:27:16 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:27:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:27:16 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:27:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:27:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:27:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:27:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:27:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:27:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:27:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:27:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:27:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:27:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:27:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43877963
Fri 17 Jan 2014 03:27:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:27:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43877963
Fri 17 Jan 2014 03:27:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:27:27 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:27:27 - job_xml_thread(): Done retrieving: data size 43877963
Fri 17 Jan 2014 03:27:27 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:27:28 - XML: Start document: iteration 3
Fri 17 Jan 2014 03:27:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:27:31 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:27:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:27:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:27:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:27:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:27:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:27:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:27:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:27:34 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:27:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:27:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:27:36 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:27:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:27:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:27:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:27:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:27:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:27:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:27:39 - XML: Processed 655518 elements - found 660 jobs
Fri 17 Jan 2014 03:27:39 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 03:27:39 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 03:27:39 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:27:39 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:27:40 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:27:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43872795
Fri 17 Jan 2014 03:27:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:27:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43872795
Fri 17 Jan 2014 03:27:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:27:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:27:43 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:27:45 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:27:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:27:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 03:27:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 03:27:45 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:27:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9230 values 145721 bits 18215 bytes 
Fri 17 Jan 2014 03:27:49 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 03:27:49 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:27:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:27:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:27:50 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:27:50 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:27:50 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 03:27:50 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 03:27:50 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 03:27:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:27:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:27:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:27:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:27:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:27:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:27:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:27:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:27:51 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:27:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:27:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:27:54 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:27:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:27:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:27:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:27:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:27:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:27:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:27:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:27:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:27:55 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 843473 values 13299005 bits 1662375 bytes 
Fri 17 Jan 2014 03:27:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:27:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43883822
Fri 17 Jan 2014 03:27:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:28:00 - job_xml_thread(): Done retrieving: data size 43883822
Fri 17 Jan 2014 03:28:00 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:28:00 - XML: Start document: iteration 4
Fri 17 Jan 2014 03:28:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43883822
Fri 17 Jan 2014 03:28:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:28:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:28:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:28:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:28:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:28:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:28:13 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:28:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:28:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:28:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:28:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:28:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:28:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:28:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:28:20 - XML: Processed 655520 elements - found 661 jobs
Fri 17 Jan 2014 03:28:20 - job 7347227 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 03:28:20 - job 7346724 field 'start_timestamp' changed since saved from: 1389925546 to: 1389925513
Fri 17 Jan 2014 03:28:20 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 03:28:20 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 03:28:21 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 03:28:21 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:28:21 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:28:22 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:28:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 03:28:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:28:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:28:24 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:28:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:28:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:28:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:28:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:28:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:28:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:28:27 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:28:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851356
Fri 17 Jan 2014 03:28:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:28:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851356
Fri 17 Jan 2014 03:28:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:28:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:28:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:28:36 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:28:36 - job_xml_thread(): Done retrieving: data size 43851356
Fri 17 Jan 2014 03:28:36 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:28:36 - XML: Start document: iteration 5
Fri 17 Jan 2014 03:28:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:28:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:28:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:28:42 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:28:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:28:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:28:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:28:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:28:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:28:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:28:43 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:28:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:28:45 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:28:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:28:46 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:28:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 03:28:46 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:28:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 03:28:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5842 values 92113 bits 11514 bytes 
Fri 17 Jan 2014 03:28:50 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:28:50 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 03:28:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:28:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:28:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:28:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:28:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:28:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:28:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:28:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:28:52 - XML: Processed 655514 elements - found 658 jobs
Fri 17 Jan 2014 03:28:52 - job 7347206 appears to have finished
Fri 17 Jan 2014 03:28:52 - job 7347228 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 03:28:52 - job 7346696 appears to have finished
Fri 17 Jan 2014 03:28:52 - job 7347191 appears to have finished
Fri 17 Jan 2014 03:28:52 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 03:28:52 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 03:28:52 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 03:28:52 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:28:52 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:28:56 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:28:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43852392
Fri 17 Jan 2014 03:28:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:28:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43852392
Fri 17 Jan 2014 03:28:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:28:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:28:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:29:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:29:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:29:07 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:29:07 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:29:08 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:29:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 03:29:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:29:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:29:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:29:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:29:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:29:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:29:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:29:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:29:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:29:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:29:12 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:29:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:29:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:29:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:29:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:29:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:29:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:29:16 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:29:16 - job_xml_thread(): Done retrieving: data size 43815735
Fri 17 Jan 2014 03:29:16 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:29:16 - XML: Start document: iteration 6
Fri 17 Jan 2014 03:29:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43815735
Fri 17 Jan 2014 03:29:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:29:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43815735
Fri 17 Jan 2014 03:29:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:29:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:29:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:29:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:29:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:29:32 - XML: Processed 654762 elements - found 656 jobs
Fri 17 Jan 2014 03:29:32 - job 7347203 appears to have finished
Fri 17 Jan 2014 03:29:32 - job 7346697 appears to have finished
Fri 17 Jan 2014 03:29:32 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 03:29:32 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 03:29:34 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 03:29:34 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:29:34 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:29:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:29:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:29:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:29:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:29:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:29:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:29:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:29:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:29:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:29:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:29:38 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:29:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:29:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:29:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:29:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:29:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:29:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:29:41 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:29:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43300750
Fri 17 Jan 2014 03:29:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:29:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43300750
Fri 17 Jan 2014 03:29:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:29:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:29:46 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:29:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:29:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 03:29:47 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:29:47 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:29:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9339 values 147344 bits 18418 bytes 
Fri 17 Jan 2014 03:29:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 03:29:49 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:29:49 - job_xml_thread(): Done retrieving: data size 43300750
Fri 17 Jan 2014 03:29:49 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:29:50 - XML: Start document: iteration 7
Fri 17 Jan 2014 03:29:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:29:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:29:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:29:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:29:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:29:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:29:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:29:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:29:52 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:29:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:29:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:29:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:29:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:30:02 - XML: Processed 648434 elements - found 656 jobs
Fri 17 Jan 2014 03:30:02 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 03:30:02 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 03:30:02 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:30:02 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:30:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:30:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:30:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:30:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:30:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:30:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:30:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:30:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:30:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:30:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:30:08 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:30:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43187501
Fri 17 Jan 2014 03:30:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:30:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43187501
Fri 17 Jan 2014 03:30:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:30:17 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:30:17 - job_xml_thread(): Done retrieving: data size 43187501
Fri 17 Jan 2014 03:30:17 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:30:17 - XML: Start document: iteration 8
Fri 17 Jan 2014 03:30:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:30:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:30:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:30:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:30:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:30:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:30:25 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:30:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:30:25 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:30:25 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:30:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:30:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:30:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:30:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:30:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:30:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:30:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:30:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:30:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:30:30 - XML: Processed 647440 elements - found 656 jobs
Fri 17 Jan 2014 03:30:30 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 03:30:30 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 03:30:30 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:30:30 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:30:31 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:30:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 03:30:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:30:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:30:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43487285
Fri 17 Jan 2014 03:30:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:30:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43487285
Fri 17 Jan 2014 03:30:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:30:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:30:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:30:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:30:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:30:45 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:30:45 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:30:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:30:48 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:30:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:30:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 03:30:48 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:30:48 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:30:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 03:30:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5837 values 92064 bits 11508 bytes 
Fri 17 Jan 2014 03:30:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:30:49 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:30:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:30:50 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:30:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:30:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:30:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:30:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:30:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:30:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:30:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:30:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:30:50 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:30:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:30:50 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:30:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:30:54 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:30:54 - job_xml_thread(): Done retrieving: data size 43836771
Fri 17 Jan 2014 03:30:54 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:30:54 - XML: Start document: iteration 9
Fri 17 Jan 2014 03:30:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43836771
Fri 17 Jan 2014 03:30:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:30:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43836771
Fri 17 Jan 2014 03:30:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:31:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:31:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:31:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:31:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:31:08 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:31:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 03:31:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:31:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:31:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:31:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:31:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:31:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:31:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:31:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:31:09 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:31:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:31:15 - XML: Processed 655336 elements - found 656 jobs
Fri 17 Jan 2014 03:31:15 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 03:31:15 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 03:31:15 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:31:15 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:31:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:31:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:31:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:31:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:31:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:31:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:31:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:31:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:31:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:31:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856444
Fri 17 Jan 2014 03:31:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:31:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43856444
Fri 17 Jan 2014 03:31:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:31:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:31:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:31:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:31:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:31:30 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:31:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:31:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:31:30 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:31:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:31:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:31:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:31:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:31:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:31:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:31:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:31:32 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:31:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:31:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:31:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:31:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:31:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:31:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:31:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:31:35 - job_xml_thread(): Done retrieving: data size 43862207
Fri 17 Jan 2014 03:31:35 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:31:35 - XML: Start document: iteration 10
Fri 17 Jan 2014 03:31:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862207
Fri 17 Jan 2014 03:31:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:31:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862207
Fri 17 Jan 2014 03:31:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:31:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:31:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:31:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:31:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:31:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:31:49 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:31:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:31:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 03:31:50 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:31:50 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:31:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 03:31:51 - XML: Processed 655508 elements - found 655 jobs
Fri 17 Jan 2014 03:31:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9218 values 145621 bits 18202 bytes 
Fri 17 Jan 2014 03:31:51 - job 7347192 appears to have finished
Fri 17 Jan 2014 03:31:51 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 03:31:51 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 03:31:52 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 03:31:52 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:31:52 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:31:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:31:54 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:31:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:31:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:31:54 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:31:54 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:31:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:31:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:31:55 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:31:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:31:59 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:31:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:31:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:31:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:31:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:31:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:31:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:32:00 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 03:32:00 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 03:32:00 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:32:01 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:32:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 03:32:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:32:01 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:32:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43881787
Fri 17 Jan 2014 03:32:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:32:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43881787
Fri 17 Jan 2014 03:32:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:32:07 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:32:07 - job_xml_thread(): Done retrieving: data size 43881787
Fri 17 Jan 2014 03:32:07 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:32:07 - XML: Start document: iteration 11
Fri 17 Jan 2014 03:32:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:32:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:32:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:32:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:32:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:32:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:32:12 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:32:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:32:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:32:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:32:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:32:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:32:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:32:24 - XML: Processed 655508 elements - found 655 jobs
Fri 17 Jan 2014 03:32:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:32:24 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:32:24 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 03:32:24 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 03:32:24 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:32:24 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:32:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:32:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:32:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:32:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:32:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:32:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:32:26 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:32:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43850139
Fri 17 Jan 2014 03:32:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:32:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43850139
Fri 17 Jan 2014 03:32:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:32:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:32:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:32:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:32:38 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:32:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:32:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:32:39 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:32:39 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:32:39 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:32:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:32:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:32:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:32:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:32:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:32:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:32:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:32:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:32:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:32:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:32:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:32:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:32:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:32:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:32:43 - job_xml_thread(): Done retrieving: data size 43905960
Fri 17 Jan 2014 03:32:43 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:32:43 - XML: Start document: iteration 12
Fri 17 Jan 2014 03:32:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43905960
Fri 17 Jan 2014 03:32:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:32:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43905960
Fri 17 Jan 2014 03:32:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:32:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:32:51 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:32:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:32:52 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:32:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 03:32:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 03:32:52 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:32:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 149190 bits 18648 bytes 
Fri 17 Jan 2014 03:32:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:32:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:32:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:32:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:32:59 - XML: Processed 655508 elements - found 655 jobs
Fri 17 Jan 2014 03:32:59 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 03:32:59 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 03:32:59 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:32:59 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:33:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:33:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:33:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:33:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:33:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:33:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:33:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:33:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:33:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:33:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:33:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:33:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:33:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:33:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:33:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:33:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:33:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:33:08 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:33:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865865
Fri 17 Jan 2014 03:33:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:33:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43865865
Fri 17 Jan 2014 03:33:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:33:15 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:33:15 - job_xml_thread(): Done retrieving: data size 43865865
Fri 17 Jan 2014 03:33:15 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:33:15 - XML: Start document: iteration 13
Fri 17 Jan 2014 03:33:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:33:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:33:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:33:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:33:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:33:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:33:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:33:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:33:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:33:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:33:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:33:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:33:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:33:31 - XML: Processed 655508 elements - found 655 jobs
Fri 17 Jan 2014 03:33:31 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 03:33:31 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 03:33:31 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:33:31 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:33:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:33:32 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:33:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:33:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:33:32 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:33:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 03:33:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:33:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:33:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:33:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:33:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:33:34 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:33:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43871196
Fri 17 Jan 2014 03:33:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:33:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43871196
Fri 17 Jan 2014 03:33:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:33:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:33:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:33:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:33:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:33:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:33:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:33:45 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:33:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:33:45 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:33:45 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:33:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:33:46 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:33:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:33:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:33:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:33:48 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:33:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:33:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:33:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:33:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:33:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:33:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:33:50 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:33:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43876357
Fri 17 Jan 2014 03:33:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:33:50 - job_xml_thread(): Done retrieving: data size 43876357
Fri 17 Jan 2014 03:33:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43876357
Fri 17 Jan 2014 03:33:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:33:51 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:33:51 - XML: Start document: iteration 14
Fri 17 Jan 2014 03:33:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:33:53 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:33:53 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:33:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 03:33:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:33:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 03:33:53 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:33:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9091 values 143656 bits 17957 bytes 
Fri 17 Jan 2014 03:34:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:34:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:34:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:34:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:34:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:34:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:34:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:34:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:34:06 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:34:06 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:34:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:34:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:34:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:34:11 - XML: Processed 655510 elements - found 656 jobs
Fri 17 Jan 2014 03:34:11 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 03:34:11 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 03:34:11 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 03:34:11 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:34:11 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:34:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:34:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:34:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:34:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:34:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:34:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:34:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:34:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:34:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:34:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873568
Fri 17 Jan 2014 03:34:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:34:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873568
Fri 17 Jan 2014 03:34:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:34:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:34:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:34:26 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:34:26 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:34:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:34:27 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:34:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:34:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:34:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:34:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:34:27 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:34:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:34:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:34:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:34:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:34:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:34:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:34:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:34:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:34:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:34:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:34:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:34:30 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:34:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 03:34:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:34:31 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:34:31 - job_xml_thread(): Done retrieving: data size 43885675
Fri 17 Jan 2014 03:34:31 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:34:31 - XML: Start document: iteration 15
Fri 17 Jan 2014 03:34:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43885675
Fri 17 Jan 2014 03:34:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:34:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43885675
Fri 17 Jan 2014 03:34:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:34:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:34:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:34:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:34:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:34:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:34:46 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:34:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:34:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:34:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:34:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:34:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:34:48 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:34:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:34:50 - XML: Processed 655510 elements - found 656 jobs
Fri 17 Jan 2014 03:34:50 - job 7347229 field 'start_timestamp' changed since saved from: 1389925971 to: 1389925911
Fri 17 Jan 2014 03:34:50 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 03:34:50 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 03:34:50 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 03:34:50 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:34:50 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:34:51 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 03:34:51 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:34:52 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:34:52 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 03:34:52 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:34:52 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 03:34:52 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 03:34:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:34:53 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:34:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:34:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:34:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:34:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:34:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:34:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:34:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:34:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:34:54 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:34:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 03:34:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:34:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 03:34:54 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:34:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 4810 values 75853 bits 9481 bytes 
Fri 17 Jan 2014 03:34:54 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 829866 values 13111389 bits 1638923 bytes 
Fri 17 Jan 2014 03:34:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:34:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43863084
Fri 17 Jan 2014 03:34:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:34:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43863084
Fri 17 Jan 2014 03:34:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:35:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:35:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:35:05 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:35:05 - job_xml_thread(): Done retrieving: data size 43863084
Fri 17 Jan 2014 03:35:05 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:35:05 - XML: Start document: iteration 16
Fri 17 Jan 2014 03:35:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:35:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:35:17 - XML: Processed 655510 elements - found 656 jobs
Fri 17 Jan 2014 03:35:17 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 03:35:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:35:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:35:18 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 03:35:18 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:35:18 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:35:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:35:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:35:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:35:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:35:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:35:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:35:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:35:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:35:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:35:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:35:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:35:20 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:35:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:35:20 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:35:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:35:20 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:35:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 03:35:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:35:23 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:35:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43799233
Fri 17 Jan 2014 03:35:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:35:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43799233
Fri 17 Jan 2014 03:35:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:35:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:35:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:35:33 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:35:33 - job_xml_thread(): Done retrieving: data size 43799233
Fri 17 Jan 2014 03:35:33 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:35:33 - XML: Start document: iteration 17
Fri 17 Jan 2014 03:35:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:35:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:35:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:35:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:35:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:35:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:35:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:35:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:35:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:35:43 - XML: Processed 654762 elements - found 656 jobs
Fri 17 Jan 2014 03:35:43 - job 7335192 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 03:35:43 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 03:35:43 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 03:35:43 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 03:35:43 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:35:43 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:35:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:35:44 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:35:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:35:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:35:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:35:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:35:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:35:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:35:47 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:35:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43264889
Fri 17 Jan 2014 03:35:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:35:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43264889
Fri 17 Jan 2014 03:35:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:35:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:35:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:35:52 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:35:52 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 03:35:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:35:54 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:35:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:35:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 03:35:54 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:35:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 03:35:54 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:35:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8693 values 137127 bits 17140 bytes 
Fri 17 Jan 2014 03:35:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:35:56 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:35:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:35:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:35:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:35:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:35:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:35:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43264889
Fri 17 Jan 2014 03:35:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:35:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:35:58 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:35:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:36:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:36:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:36:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:36:07 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:36:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:36:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:36:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:36:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:36:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:36:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:36:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:36:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:36:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:36:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:36:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:36:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:36:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:36:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:36:14 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:36:14 - job_xml_thread(): Done retrieving: data size 43236737
Fri 17 Jan 2014 03:36:14 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:36:14 - XML: Start document: iteration 18
Fri 17 Jan 2014 03:36:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43236737
Fri 17 Jan 2014 03:36:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:36:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43236737
Fri 17 Jan 2014 03:36:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:36:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:36:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:36:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:36:27 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:36:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:36:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:36:30 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:36:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:36:30 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:36:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:36:30 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:36:35 - XML: Processed 647914 elements - found 656 jobs
Fri 17 Jan 2014 03:36:35 - job 7347207 appears to have finished
Fri 17 Jan 2014 03:36:35 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 03:36:35 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 03:36:35 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 03:36:35 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:36:35 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:36:35 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:36:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 03:36:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:36:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:36:37 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:36:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:36:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:36:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:36:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:36:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:36:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:36:40 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:36:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43741000
Fri 17 Jan 2014 03:36:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:36:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43741000
Fri 17 Jan 2014 03:36:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:36:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:36:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:36:50 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:36:51 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:36:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:36:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:36:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:36:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:36:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:36:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:36:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:36:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:36:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:36:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:36:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:36:54 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:36:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:36:55 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:36:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 03:36:55 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:36:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6190 values 97677 bits 12209 bytes 
Fri 17 Jan 2014 03:36:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 03:36:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:36:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:36:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:36:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:36:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:36:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:36:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:36:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:36:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:36:59 - job_xml_thread(): Done retrieving: data size 43859071
Fri 17 Jan 2014 03:36:59 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:36:59 - XML: Start document: iteration 19
Fri 17 Jan 2014 03:36:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43859071
Fri 17 Jan 2014 03:36:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:37:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43859071
Fri 17 Jan 2014 03:37:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:37:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:37:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:37:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:37:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:37:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:37:21 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:37:21 - XML: Processed 655318 elements - found 656 jobs
Fri 17 Jan 2014 03:37:21 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 03:37:21 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 03:37:21 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:37:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:37:21 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:37:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:37:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:37:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:37:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:37:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:37:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:37:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:37:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:37:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:37:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:37:23 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:37:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 03:37:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:37:23 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:37:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:37:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:37:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:37:26 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:37:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43874463
Fri 17 Jan 2014 03:37:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:37:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43874463
Fri 17 Jan 2014 03:37:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:37:36 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:37:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:37:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:37:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:37:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:37:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:37:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:37:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:37:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:37:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:37:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:37:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:37:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:37:40 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:37:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:37:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:37:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:37:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:37:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:37:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:37:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:37:45 - job_xml_thread(): Done retrieving: data size 43875620
Fri 17 Jan 2014 03:37:45 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:37:45 - XML: Start document: iteration 20
Fri 17 Jan 2014 03:37:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875620
Fri 17 Jan 2014 03:37:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875620
Fri 17 Jan 2014 03:37:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:37:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:37:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:37:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:37:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:37:55 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:37:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:37:56 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:37:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 03:37:56 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:37:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 03:37:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:37:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:37:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8562 values 134981 bits 16872 bytes 
Fri 17 Jan 2014 03:38:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:38:00 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:38:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:38:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:38:01 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:38:01 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:38:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:38:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:38:01 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:38:03 - XML: Processed 655516 elements - found 659 jobs
Fri 17 Jan 2014 03:38:04 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 03:38:04 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 03:38:06 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 03:38:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:38:06 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:38:06 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:38:06 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:38:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:38:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:38:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:38:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:38:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:38:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:38:10 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:38:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855165
Fri 17 Jan 2014 03:38:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:38:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855165
Fri 17 Jan 2014 03:38:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:38:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:38:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:38:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:38:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:38:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:38:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:38:20 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:38:20 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:38:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:38:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:38:20 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:38:21 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:38:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:38:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:38:21 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:38:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 03:38:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:38:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:38:25 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:38:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:38:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:38:26 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 03:38:26 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 03:38:26 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:38:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:38:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:38:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:38:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:38:27 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:38:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43871093
Fri 17 Jan 2014 03:38:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:38:28 - job_xml_thread(): Done retrieving: data size 43871093
Fri 17 Jan 2014 03:38:28 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:38:28 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 03:38:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43871093
Fri 17 Jan 2014 03:38:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:38:29 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 03:38:29 - Housekeeping: done.
Fri 17 Jan 2014 03:38:29 - XML: Start document: iteration 0
Fri 17 Jan 2014 03:38:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:38:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:38:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:38:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:38:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:38:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:38:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:38:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:38:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:38:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:38:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:38:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:38:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:38:47 - XML: Processed 655514 elements - found 658 jobs
Fri 17 Jan 2014 03:38:47 - job 7347233 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 03:38:47 - job 7347234 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 03:38:47 - job 7346064 appears to have finished
Fri 17 Jan 2014 03:38:47 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 03:38:47 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 03:38:49 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 03:38:49 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:38:49 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:38:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:38:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:38:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:38:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:38:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:38:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:38:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:38:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:38:51 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:38:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43861924
Fri 17 Jan 2014 03:38:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:38:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43861924
Fri 17 Jan 2014 03:38:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:38:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:38:56 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:38:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:38:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:38:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:38:56 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:38:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 03:38:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 03:38:56 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:38:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9167 values 144614 bits 18076 bytes 
Fri 17 Jan 2014 03:39:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:39:03 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:39:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:39:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:39:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:39:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:39:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:39:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:39:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:39:04 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:39:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:39:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:39:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:39:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:39:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:39:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:39:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:39:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:39:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:39:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:39:09 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:39:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856004
Fri 17 Jan 2014 03:39:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:39:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43856004
Fri 17 Jan 2014 03:39:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:39:10 - job_xml_thread(): Done retrieving: data size 43856004
Fri 17 Jan 2014 03:39:10 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:39:10 - XML: Start document: iteration 1
Fri 17 Jan 2014 03:39:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:39:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:39:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:39:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:39:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:39:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:39:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:39:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:39:23 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:39:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:39:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:39:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:39:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:39:28 - XML: Processed 655514 elements - found 658 jobs
Fri 17 Jan 2014 03:39:28 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 03:39:28 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 03:39:28 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:39:28 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:39:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:39:31 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:39:31 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:39:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 03:39:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:39:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:39:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:39:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:39:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:39:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:39:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:39:33 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:39:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862119
Fri 17 Jan 2014 03:39:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:39:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862119
Fri 17 Jan 2014 03:39:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:39:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:39:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:39:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:39:41 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:39:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:39:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:39:43 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:39:43 - job_xml_thread(): Done retrieving: data size 43862119
Fri 17 Jan 2014 03:39:43 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:39:43 - XML: Start document: iteration 2
Fri 17 Jan 2014 03:39:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:39:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:39:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:39:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:39:44 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:39:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:39:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:39:52 - XML: Processed 655512 elements - found 657 jobs
Fri 17 Jan 2014 03:39:52 - job 7347210 appears to have finished
Fri 17 Jan 2014 03:39:52 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 03:39:52 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 03:39:53 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 03:39:53 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:39:53 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:39:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:39:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:39:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:39:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:39:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:39:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:39:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:39:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:39:56 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:39:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43842920
Fri 17 Jan 2014 03:39:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:39:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43842920
Fri 17 Jan 2014 03:39:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:39:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:39:57 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:39:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:39:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 03:39:58 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:39:58 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:39:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 03:39:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8923 values 140707 bits 17588 bytes 
Fri 17 Jan 2014 03:39:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:39:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:40:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:40:07 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:40:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:40:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:40:07 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:40:07 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:40:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:40:07 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:40:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:40:08 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:40:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:40:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:40:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:40:12 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:40:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:40:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:40:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:40:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:40:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:40:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:40:14 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:40:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867586
Fri 17 Jan 2014 03:40:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:40:14 - job_xml_thread(): Done retrieving: data size 43867586
Fri 17 Jan 2014 03:40:14 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:40:15 - XML: Start document: iteration 3
Fri 17 Jan 2014 03:40:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43867586
Fri 17 Jan 2014 03:40:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:40:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:40:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:40:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:40:25 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:40:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:40:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:40:26 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:40:26 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:40:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:40:27 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:40:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:40:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:40:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:40:32 - XML: Processed 655506 elements - found 654 jobs
Fri 17 Jan 2014 03:40:33 - job 7346703 appears to have finished
Fri 17 Jan 2014 03:40:33 - job 7347217 appears to have finished
Fri 17 Jan 2014 03:40:33 - job 7347220 appears to have finished
Fri 17 Jan 2014 03:40:33 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 03:40:33 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 03:40:33 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 03:40:33 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:40:33 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:40:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:40:35 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:40:35 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:40:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 03:40:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:40:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:40:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:40:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:40:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:40:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:40:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:40:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:40:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43860407
Fri 17 Jan 2014 03:40:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:40:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43860407
Fri 17 Jan 2014 03:40:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:40:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:40:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:40:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:40:46 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:40:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:40:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:40:47 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:40:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:40:47 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:40:47 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:40:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:40:48 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:40:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:40:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:40:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:40:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:40:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:40:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:40:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:40:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:40:51 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:40:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43874811
Fri 17 Jan 2014 03:40:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:40:51 - job_xml_thread(): Done retrieving: data size 43874811
Fri 17 Jan 2014 03:40:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43874811
Fri 17 Jan 2014 03:40:52 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:40:52 - XML: Start document: iteration 4
Fri 17 Jan 2014 03:40:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:40:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:40:59 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:41:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:41:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 03:41:00 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:41:00 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:41:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 03:41:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9113 values 143815 bits 17976 bytes 
Fri 17 Jan 2014 03:41:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:41:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:41:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:41:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:41:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:41:09 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:41:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:41:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:41:11 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:41:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:41:12 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:41:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:41:12 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:41:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:41:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:41:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:41:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:41:15 - XML: Processed 655506 elements - found 654 jobs
Fri 17 Jan 2014 03:41:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:41:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:41:15 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 03:41:15 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 03:41:15 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:41:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:41:15 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:41:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:41:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:41:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43805253
Fri 17 Jan 2014 03:41:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:41:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43805253
Fri 17 Jan 2014 03:41:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:41:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:41:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:41:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:41:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:41:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:41:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:41:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:41:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:41:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:41:30 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:41:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:41:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:41:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:41:31 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:41:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:41:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:41:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:41:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:41:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:41:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:41:32 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:41:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 03:41:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:41:33 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:41:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43404314
Fri 17 Jan 2014 03:41:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:41:33 - job_xml_thread(): Done retrieving: data size 43404314
Fri 17 Jan 2014 03:41:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43404314
Fri 17 Jan 2014 03:41:33 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:41:33 - XML: Start document: iteration 5
Fri 17 Jan 2014 03:41:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:41:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:41:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:41:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:41:46 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:41:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:41:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:41:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:41:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:41:47 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:41:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:41:47 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:41:47 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:41:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:41:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:41:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:41:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:41:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:41:52 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 03:41:52 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:41:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:41:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:41:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:41:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:41:53 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:41:53 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:41:53 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 03:41:53 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 03:41:53 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 03:41:56 - XML: Processed 649726 elements - found 653 jobs
Fri 17 Jan 2014 03:41:57 - job 7347205 appears to have finished
Fri 17 Jan 2014 03:41:57 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 03:41:57 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 883813 values 13939402 bits 1742425 bytes 
Fri 17 Jan 2014 03:41:57 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 03:41:57 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 03:41:57 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:41:57 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:42:00 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:42:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43202467
Fri 17 Jan 2014 03:42:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:42:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43202467
Fri 17 Jan 2014 03:42:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:42:01 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:42:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:42:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:42:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 03:42:01 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:42:01 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:42:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 03:42:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9021 values 142348 bits 17793 bytes 
Fri 17 Jan 2014 03:42:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:42:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:42:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:42:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:42:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:42:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:42:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:42:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:42:12 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:42:12 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:42:12 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:42:12 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:42:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:42:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:42:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:42:15 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:42:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:42:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:42:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:42:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:42:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:42:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:42:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:42:19 - job_xml_thread(): Done retrieving: data size 43275444
Fri 17 Jan 2014 03:42:19 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:42:19 - XML: Start document: iteration 6
Fri 17 Jan 2014 03:42:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43275444
Fri 17 Jan 2014 03:42:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43275444
Fri 17 Jan 2014 03:42:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:42:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:42:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:42:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:42:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:42:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:42:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:42:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:42:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:42:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:42:39 - XML: Processed 647978 elements - found 653 jobs
Fri 17 Jan 2014 03:42:39 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 03:42:39 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 03:42:39 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:42:40 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:42:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:42:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:42:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:42:40 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:42:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:42:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:42:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:42:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:42:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:42:42 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:42:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 03:42:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:42:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:42:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:42:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:42:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:42:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:42:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43804072
Fri 17 Jan 2014 03:42:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:42:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43804072
Fri 17 Jan 2014 03:42:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:42:53 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:42:53 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 03:42:55 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:42:55 - job_xml_thread(): Done retrieving: data size 43804072
Fri 17 Jan 2014 03:42:55 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:42:55 - XML: Start document: iteration 7
Fri 17 Jan 2014 03:42:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:42:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:42:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:42:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:43:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:43:01 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:43:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:43:01 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:43:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:43:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:43:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:43:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:43:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:43:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:43:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:43:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 03:43:02 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:43:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:43:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 03:43:02 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:43:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5852 values 92353 bits 11544 bytes 
Fri 17 Jan 2014 03:43:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:43:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:43:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:43:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:43:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:43:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:43:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:43:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:43:08 - XML: Processed 654500 elements - found 653 jobs
Fri 17 Jan 2014 03:43:08 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 03:43:08 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 03:43:08 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:43:08 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:43:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:43:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43849133
Fri 17 Jan 2014 03:43:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:43:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43849133
Fri 17 Jan 2014 03:43:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:43:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:43:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:43:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:43:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:43:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:43:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:43:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:43:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:43:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:43:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:43:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:43:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:43:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:43:23 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:43:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:43:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:43:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:43:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:43:28 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:43:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 03:43:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:43:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:43:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:43:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:43:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:43:31 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:43:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862149
Fri 17 Jan 2014 03:43:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:43:31 - job_xml_thread(): Done retrieving: data size 43862149
Fri 17 Jan 2014 03:43:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862149
Fri 17 Jan 2014 03:43:31 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:43:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:43:32 - XML: Start document: iteration 8
Fri 17 Jan 2014 03:43:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:43:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:43:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:43:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:43:44 - XML: Processed 655506 elements - found 654 jobs
Fri 17 Jan 2014 03:43:44 - job 7347106 appears to have finished
Fri 17 Jan 2014 03:43:44 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 03:43:44 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 03:43:47 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 03:43:47 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:43:47 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:43:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:43:50 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:43:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:43:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:43:51 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:43:51 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:43:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:43:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:43:51 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:43:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:43:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:43:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:43:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:43:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:43:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:43:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:43:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:44:00 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:44:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43872614
Fri 17 Jan 2014 03:44:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:44:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43872614
Fri 17 Jan 2014 03:44:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:44:02 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:44:02 - job_xml_thread(): Done retrieving: data size 43872614
Fri 17 Jan 2014 03:44:02 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:44:02 - XML: Start document: iteration 9
Fri 17 Jan 2014 03:44:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:44:02 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:44:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:44:03 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:44:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 03:44:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 03:44:03 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:44:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8872 values 139881 bits 17485 bytes 
Fri 17 Jan 2014 03:44:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:44:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:44:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:44:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:44:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:44:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:44:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:44:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:44:12 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:44:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:44:12 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:44:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:44:12 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:44:22 - XML: Processed 655506 elements - found 654 jobs
Fri 17 Jan 2014 03:44:23 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 03:44:23 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 03:44:23 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:44:23 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:44:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:44:24 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:44:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:44:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:44:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:44:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:44:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:44:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:44:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:44:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:44:27 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:44:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43838523
Fri 17 Jan 2014 03:44:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:44:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43838523
Fri 17 Jan 2014 03:44:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:44:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:44:38 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:44:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:44:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:44:38 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:44:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:44:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:44:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:44:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:44:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:44:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:44:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:44:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:44:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:44:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:44:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:44:42 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:44:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 03:44:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:44:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:44:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:44:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:44:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:44:46 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:44:46 - job_xml_thread(): Done retrieving: data size 43879318
Fri 17 Jan 2014 03:44:46 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:44:46 - XML: Start document: iteration 10
Fri 17 Jan 2014 03:44:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43879318
Fri 17 Jan 2014 03:44:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:44:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43879318
Fri 17 Jan 2014 03:44:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:44:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:44:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:44:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:44:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:45:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:45:03 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:45:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:45:04 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:45:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 03:45:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 03:45:04 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:45:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5699 values 89883 bits 11235 bytes 
Fri 17 Jan 2014 03:45:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:45:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:45:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:45:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:45:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:45:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:45:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:45:05 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:45:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:45:07 - XML: Processed 655504 elements - found 653 jobs
Fri 17 Jan 2014 03:45:07 - job 7347236 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 03:45:07 - job 7346706 appears to have finished
Fri 17 Jan 2014 03:45:07 - job 7346707 appears to have finished
Fri 17 Jan 2014 03:45:07 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 03:45:07 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 03:45:08 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 03:45:08 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:45:08 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:45:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:45:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:45:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:45:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:45:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:45:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:45:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:45:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:45:13 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 03:45:13 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 03:45:13 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:45:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:45:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867521
Fri 17 Jan 2014 03:45:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:45:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43867521
Fri 17 Jan 2014 03:45:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:45:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:45:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:45:24 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:45:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:45:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:45:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:45:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:45:25 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:45:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:45:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:45:25 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:45:25 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:45:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:45:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:45:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:45:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:45:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:45:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:45:29 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:45:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 03:45:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:45:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:45:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:45:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:45:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:45:30 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:45:30 - job_xml_thread(): Done retrieving: data size 43882955
Fri 17 Jan 2014 03:45:30 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:45:30 - XML: Start document: iteration 11
Fri 17 Jan 2014 03:45:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43882955
Fri 17 Jan 2014 03:45:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:45:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43882955
Fri 17 Jan 2014 03:45:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:45:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:45:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:45:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:45:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:45:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:45:45 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:45:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:45:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:45:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:45:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:45:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:45:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:45:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:45:51 - XML: Processed 655504 elements - found 653 jobs
Fri 17 Jan 2014 03:45:51 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 03:45:51 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 03:45:51 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:45:51 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:45:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:45:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:45:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:45:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:45:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:45:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:45:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:45:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:45:54 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:45:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853147
Fri 17 Jan 2014 03:45:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:45:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853147
Fri 17 Jan 2014 03:45:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:46:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:46:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:46:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:46:04 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:46:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:46:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:46:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:46:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:46:05 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:46:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 03:46:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:46:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 03:46:05 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:46:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8877 values 140035 bits 17504 bytes 
Fri 17 Jan 2014 03:46:06 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:46:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:46:06 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:46:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:46:06 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:46:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:46:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:46:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:46:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:46:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:46:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:46:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:46:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:46:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:46:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:46:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:46:11 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:46:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 03:46:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:46:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:46:11 - job_xml_thread(): Done retrieving: data size 43870305
Fri 17 Jan 2014 03:46:11 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:46:11 - XML: Start document: iteration 12
Fri 17 Jan 2014 03:46:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870305
Fri 17 Jan 2014 03:46:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:46:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870305
Fri 17 Jan 2014 03:46:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:46:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:46:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:46:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:46:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:46:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:46:31 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:46:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:46:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:46:32 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:46:32 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:46:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:46:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:46:32 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:46:33 - XML: Processed 655502 elements - found 652 jobs
Fri 17 Jan 2014 03:46:33 - job 7347202 appears to have finished
Fri 17 Jan 2014 03:46:33 - job 7347200 appears to have finished
Fri 17 Jan 2014 03:46:33 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 03:46:33 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 03:46:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:46:35 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:46:35 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 03:46:35 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:46:35 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:46:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:46:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:46:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:46:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:46:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:46:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:46:37 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:46:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43861657
Fri 17 Jan 2014 03:46:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:46:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43861657
Fri 17 Jan 2014 03:46:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:46:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:46:46 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:46:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:46:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:46:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:46:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:46:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:46:49 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:46:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:46:50 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:46:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:46:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:46:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:46:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:46:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:46:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:46:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:46:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:46:53 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:46:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873115
Fri 17 Jan 2014 03:46:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:46:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873115
Fri 17 Jan 2014 03:46:54 - job_xml_thread(): Done retrieving: data size 43873115
Fri 17 Jan 2014 03:46:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:46:54 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:46:54 - XML: Start document: iteration 13
Fri 17 Jan 2014 03:47:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:47:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:47:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:47:05 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:47:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:47:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:47:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:47:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:47:06 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:47:06 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:47:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:47:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:47:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:47:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:47:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 03:47:06 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:47:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 149012 bits 18626 bytes 
Fri 17 Jan 2014 03:47:06 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:47:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 03:47:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:47:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:47:10 - XML: Processed 655502 elements - found 652 jobs
Fri 17 Jan 2014 03:47:10 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 03:47:10 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 03:47:10 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:47:10 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:47:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:47:13 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:47:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:47:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:47:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:47:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:47:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:47:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:47:15 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:47:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43808136
Fri 17 Jan 2014 03:47:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:47:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43808136
Fri 17 Jan 2014 03:47:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:47:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:47:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:47:25 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:47:25 - job_xml_thread(): Done retrieving: data size 43808136
Fri 17 Jan 2014 03:47:25 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:47:25 - XML: Start document: iteration 14
Fri 17 Jan 2014 03:47:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:47:27 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:47:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:47:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:47:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:47:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:47:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:47:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:47:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:47:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:47:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:47:35 - XML: Processed 654754 elements - found 652 jobs
Fri 17 Jan 2014 03:47:35 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 03:47:35 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 03:47:35 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:47:35 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:47:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:47:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:47:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:47:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:47:39 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:47:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 03:47:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:47:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:47:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:47:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:47:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:47:41 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:47:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43370306
Fri 17 Jan 2014 03:47:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:47:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43370306
Fri 17 Jan 2014 03:47:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:47:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:47:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:47:50 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:47:51 - job_xml_thread(): Done retrieving: data size 43370306
Fri 17 Jan 2014 03:47:51 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:47:51 - XML: Start document: iteration 15
Fri 17 Jan 2014 03:47:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:47:54 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:47:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:47:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:47:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:47:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:47:56 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:47:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:47:56 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:47:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:47:56 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:48:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:48:03 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:48:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:48:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:48:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:48:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:48:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:48:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:48:04 - XML: Processed 649652 elements - found 651 jobs
Fri 17 Jan 2014 03:48:04 - job 7347208 appears to have finished
Fri 17 Jan 2014 03:48:04 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 03:48:04 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 03:48:04 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 03:48:04 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:48:04 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:48:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:48:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43189215
Fri 17 Jan 2014 03:48:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:48:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43189215
Fri 17 Jan 2014 03:48:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:48:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:48:06 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:48:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:48:06 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:48:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 03:48:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 03:48:06 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:48:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8532 values 135028 bits 16878 bytes 
Fri 17 Jan 2014 03:48:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:48:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:48:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:48:14 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:48:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:48:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:48:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:48:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:48:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:48:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:48:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43189215
Fri 17 Jan 2014 03:48:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:48:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:48:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:48:19 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:48:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:48:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:48:25 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:48:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:48:26 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:48:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:48:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:48:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:48:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:48:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:48:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:48:29 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:48:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 03:48:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:48:29 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:48:29 - job_xml_thread(): Done retrieving: data size 43272016
Fri 17 Jan 2014 03:48:29 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:48:29 - XML: Start document: iteration 16
Fri 17 Jan 2014 03:48:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43272016
Fri 17 Jan 2014 03:48:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:48:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:48:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:48:32 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:48:32 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:48:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:48:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:48:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43272016
Fri 17 Jan 2014 03:48:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:48:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:48:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:48:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:48:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:48:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:48:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:48:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:48:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:48:48 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:48:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:48:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:48:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:48:52 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:48:52 - XML: Processed 648048 elements - found 651 jobs
Fri 17 Jan 2014 03:48:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:48:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:48:52 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 03:48:52 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 03:48:52 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:48:52 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:48:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:48:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:48:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:48:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:48:53 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:48:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43848613
Fri 17 Jan 2014 03:48:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:48:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43848613
Fri 17 Jan 2014 03:48:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:48:54 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 03:48:54 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:48:56 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:48:56 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 03:48:56 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:48:56 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 03:48:56 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 03:49:00 - size of cluster 'LISA Cluster': 624 hosts 79465 metrics 829582 values 13107091 bits 1638386 bytes 
Fri 17 Jan 2014 03:49:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:49:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:49:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:49:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:49:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:49:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:49:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:49:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:49:05 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:49:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:49:06 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:49:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:49:06 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:49:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 03:49:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 03:49:06 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:49:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6356 values 100345 bits 12543 bytes 
Fri 17 Jan 2014 03:49:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:49:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:49:08 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:49:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:49:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:49:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:49:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:49:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:49:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:49:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:49:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:49:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:49:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43864198
Fri 17 Jan 2014 03:49:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:49:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43864198
Fri 17 Jan 2014 03:49:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:49:13 - job_xml_thread(): Done retrieving: data size 43864198
Fri 17 Jan 2014 03:49:13 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:49:13 - XML: Start document: iteration 17
Fri 17 Jan 2014 03:49:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:49:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:49:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:49:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:49:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:49:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:49:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:49:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:49:25 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:49:25 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:49:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:49:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:49:25 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:49:31 - XML: Processed 655488 elements - found 651 jobs
Fri 17 Jan 2014 03:49:31 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 03:49:31 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 03:49:31 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:49:31 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:49:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:49:35 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:49:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:49:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:49:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:49:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:49:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:49:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:49:35 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:49:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 03:49:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:49:38 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:49:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43832153
Fri 17 Jan 2014 03:49:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:49:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43832153
Fri 17 Jan 2014 03:49:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:49:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:49:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:49:46 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:49:46 - job_xml_thread(): Done retrieving: data size 43832153
Fri 17 Jan 2014 03:49:46 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:49:46 - XML: Start document: iteration 18
Fri 17 Jan 2014 03:49:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:49:48 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:49:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:49:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:49:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:49:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:49:48 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:49:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:49:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:49:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:49:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:49:56 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:49:56 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 03:49:56 - XML: Processed 655496 elements - found 649 jobs
Fri 17 Jan 2014 03:49:56 - job 7346024 appears to have finished
Fri 17 Jan 2014 03:49:56 - job 7347214 appears to have finished
Fri 17 Jan 2014 03:49:56 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 03:49:56 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 03:50:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:50:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:50:00 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 03:50:00 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:50:00 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:50:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:50:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:50:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:50:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:50:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:50:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:50:03 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:50:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43850212
Fri 17 Jan 2014 03:50:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:50:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:50:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:50:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43850212
Fri 17 Jan 2014 03:50:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:50:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:50:07 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:50:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:50:08 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:50:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 03:50:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 03:50:08 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:50:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8721 values 137559 bits 17194 bytes 
Fri 17 Jan 2014 03:50:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:50:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:50:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:50:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:50:15 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:50:15 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:50:16 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:50:16 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:50:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:50:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:50:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:50:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:50:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:50:20 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:50:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:50:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:50:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:50:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:50:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:50:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:50:24 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:50:24 - job_xml_thread(): Done retrieving: data size 43851619
Fri 17 Jan 2014 03:50:24 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:50:24 - XML: Start document: iteration 19
Fri 17 Jan 2014 03:50:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851619
Fri 17 Jan 2014 03:50:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:50:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851619
Fri 17 Jan 2014 03:50:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:50:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:50:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:50:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:50:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:50:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:50:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:50:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:50:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:50:37 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:50:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 03:50:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:50:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:50:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:50:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:50:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:50:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:50:43 - XML: Processed 655498 elements - found 650 jobs
Fri 17 Jan 2014 03:50:43 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 03:50:44 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 03:50:44 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 03:50:44 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:50:44 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:50:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:50:45 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:50:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:50:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:50:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:50:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:50:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:50:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:50:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:50:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865053
Fri 17 Jan 2014 03:50:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:50:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43865053
Fri 17 Jan 2014 03:50:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:50:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:50:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:50:59 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:50:59 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:51:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:51:00 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:51:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:51:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:51:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:51:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:51:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:51:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:51:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:51:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:51:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:51:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:51:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:51:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:51:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:51:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:51:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:51:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:51:07 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:51:07 - job_xml_thread(): Done retrieving: data size 43852064
Fri 17 Jan 2014 03:51:07 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:51:07 - XML: Start document: iteration 20
Fri 17 Jan 2014 03:51:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43852064
Fri 17 Jan 2014 03:51:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:51:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:51:08 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:51:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43852064
Fri 17 Jan 2014 03:51:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:51:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:51:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 03:51:09 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:51:09 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:51:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 03:51:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6179 values 97481 bits 12185 bytes 
Fri 17 Jan 2014 03:51:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:51:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:51:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:51:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:51:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:51:21 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:51:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:51:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:51:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:51:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:51:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:51:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:51:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:51:26 - XML: Processed 655498 elements - found 650 jobs
Fri 17 Jan 2014 03:51:26 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 03:51:26 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 03:51:26 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:51:26 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:51:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:51:31 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:51:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:51:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:51:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:51:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:51:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:51:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:51:34 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:51:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851265
Fri 17 Jan 2014 03:51:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:51:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851265
Fri 17 Jan 2014 03:51:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:51:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:51:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:51:41 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:51:41 - job_xml_thread(): Done retrieving: data size 43851265
Fri 17 Jan 2014 03:51:41 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:51:41 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 03:51:41 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 03:51:41 - Housekeeping: done.
Fri 17 Jan 2014 03:51:41 - XML: Start document: iteration 0
Fri 17 Jan 2014 03:51:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:51:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:51:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:51:50 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:51:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:51:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:51:51 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:51:51 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:51:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:51:51 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:51:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:51:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:51:57 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:51:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:51:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:51:58 - XML: Processed 655500 elements - found 651 jobs
Fri 17 Jan 2014 03:51:58 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 03:51:58 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 03:51:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:51:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:51:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:51:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:51:58 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 03:51:58 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:51:58 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:51:59 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:51:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 03:51:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:52:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:52:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865224
Fri 17 Jan 2014 03:52:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:52:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43865224
Fri 17 Jan 2014 03:52:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:52:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:52:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:52:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:52:09 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:52:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:52:09 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:52:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 03:52:09 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:52:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 03:52:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5782 values 91142 bits 11392 bytes 
Fri 17 Jan 2014 03:52:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:52:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:52:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:52:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:52:12 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:52:12 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:52:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:52:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:52:12 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:52:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:52:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:52:13 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:52:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:52:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:52:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:52:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:52:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:52:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:52:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:52:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:52:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:52:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43866614
Fri 17 Jan 2014 03:52:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:52:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43866614
Fri 17 Jan 2014 03:52:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:52:21 - job_xml_thread(): Done retrieving: data size 43866614
Fri 17 Jan 2014 03:52:21 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:52:21 - XML: Start document: iteration 1
Fri 17 Jan 2014 03:52:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:52:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:52:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:52:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:52:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:52:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:52:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:52:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:52:39 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:52:39 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:52:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:52:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:52:39 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:52:40 - XML: Processed 655500 elements - found 651 jobs
Fri 17 Jan 2014 03:52:40 - job 7335227 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7345099 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7335375 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7344384 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7340333 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7335544 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7338870 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7335395 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7335397 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7337899 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7342698 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7337749 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7335260 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7337590 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7335061 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7343918 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7346742 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7344401 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7344400 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7344403 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7344402 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7344405 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7344404 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7344407 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7344406 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7344409 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7343768 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7341823 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7344533 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7346749 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7336565 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7338797 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7338790 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7344356 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7337640 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7337641 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7337643 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7337645 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7337646 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7335699 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7344351 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7345031 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7344434 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7344435 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7344436 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7344341 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7344430 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7335439 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7344431 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7344433 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7345969 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7344348 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7335232 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7335230 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7335231 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7343923 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7343921 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7343920 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7343927 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7343926 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7343929 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7343928 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7344368 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7344369 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7344360 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7344361 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7344362 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7344363 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7344364 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7344365 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7344366 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7344367 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:40 - job 7346097 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7344440 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7344382 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7339776 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7335389 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7335576 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7337217 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7335214 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7335273 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7335271 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7335276 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7344418 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7340781 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7344416 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7344414 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7344415 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7344412 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7344413 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7344410 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7344411 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7335207 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7335206 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7335205 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7335204 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7335203 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7335202 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7335201 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7335200 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7339391 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7335209 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7335208 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7339156 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7342415 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7338775 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7343789 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7343788 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7343787 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7337863 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7344338 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7335401 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7335400 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7335403 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7335402 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7335405 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7335404 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7335406 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7344354 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7335376 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7338208 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7344422 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7335249 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7335248 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7344421 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7344420 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7335246 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7343930 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7343931 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7343932 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7343933 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7343935 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7343936 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7344355 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7344426 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7344357 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7344424 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7344423 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7344350 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7344353 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7344352 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7335866 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7344359 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7344358 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7344429 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7344428 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7338514 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7336194 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7344419 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7339232 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7337500 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7336991 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7340310 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7336999 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7344427 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7337261 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7343941 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7344645 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7341893 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7344425 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7335361 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7335364 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7335365 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:41 - job 7344399 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7344398 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7344016 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7344391 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7344390 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7344393 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7344392 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7344395 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7344394 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7344397 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7344396 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7338953 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7335215 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7335216 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7335210 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7335211 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7335212 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7335213 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7335218 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7335219 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7338411 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7337272 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7337345 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7335485 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7337341 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7338343 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7335239 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7338025 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7341063 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7338806 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7345647 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7335259 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7335250 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7335254 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7335255 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7344342 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7344343 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7344340 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7344437 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7344346 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7344347 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7344432 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7344345 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7344349 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7344438 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7344439 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7343751 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7344417 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7344337 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7344336 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7343472 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7344339 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7339484 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7338784 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7335903 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7335217 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7342714 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7344344 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7344408 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7340972 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7346830 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7337799 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7344657 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7335424 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7335423 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7335422 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7335421 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7337400 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7335197 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7335196 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7335195 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7335194 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7335193 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7336879 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7335199 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job 7335198 report time 1389927047 does not match current heartbeat 1389927100 : ignoring job
Fri 17 Jan 2014 03:52:42 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 03:52:42 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 03:52:42 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:52:42 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:52:44 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:52:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 03:52:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:52:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:52:45 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:52:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:52:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:52:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:52:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:52:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:52:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:52:47 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 03:52:47 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 03:52:47 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:52:48 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:52:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873938
Fri 17 Jan 2014 03:52:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:52:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873938
Fri 17 Jan 2014 03:52:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:52:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:52:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:52:57 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:52:58 - job_xml_thread(): Done retrieving: data size 43873938
Fri 17 Jan 2014 03:52:58 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:52:58 - XML: Start document: iteration 2
Fri 17 Jan 2014 03:52:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:52:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:52:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:52:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:53:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:53:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:53:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:53:01 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:53:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:53:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:53:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:53:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:53:09 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:53:09 - XML: Processed 655495 elements - found 652 jobs
Fri 17 Jan 2014 03:53:09 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 03:53:09 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 03:53:10 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 03:53:10 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:53:10 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:53:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:53:10 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:53:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 03:53:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 03:53:10 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:53:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5770 values 91021 bits 11377 bytes 
Fri 17 Jan 2014 03:53:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:53:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:53:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:53:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:53:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:53:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:53:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:53:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:53:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:53:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851002
Fri 17 Jan 2014 03:53:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:53:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851002
Fri 17 Jan 2014 03:53:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:53:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:53:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:53:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:53:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:53:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:53:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:53:25 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:53:25 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:53:25 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:53:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:53:25 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:53:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:53:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:53:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:53:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:53:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:53:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:53:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:53:28 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:53:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 03:53:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:53:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:53:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:53:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:53:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:53:31 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:53:31 - job_xml_thread(): Done retrieving: data size 43637877
Fri 17 Jan 2014 03:53:31 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:53:31 - XML: Start document: iteration 3
Fri 17 Jan 2014 03:53:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43637877
Fri 17 Jan 2014 03:53:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:53:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43637877
Fri 17 Jan 2014 03:53:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:53:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:53:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:53:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:53:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:53:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:53:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:53:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:53:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:53:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:53:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:53:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:53:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:53:48 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:53:49 - XML: Processed 652480 elements - found 652 jobs
Fri 17 Jan 2014 03:53:49 - job 7347204 appears to have finished
Fri 17 Jan 2014 03:53:49 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 03:53:49 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 03:53:51 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 03:53:51 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:53:51 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:53:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:53:53 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:53:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:53:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:53:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:53:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:53:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:53:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:53:55 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:53:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43213015
Fri 17 Jan 2014 03:53:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:53:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43213015
Fri 17 Jan 2014 03:53:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:54:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:54:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:54:06 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:54:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:54:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:54:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:54:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:54:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:54:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:54:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:54:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:54:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:54:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:54:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:54:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:54:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:54:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:54:10 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:54:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:54:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:54:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:54:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 03:54:11 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:54:11 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:54:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 03:54:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8876 values 139983 bits 17497 bytes 
Fri 17 Jan 2014 03:54:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:54:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:54:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:54:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:54:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:54:12 - job_xml_thread(): Done retrieving: data size 43213691
Fri 17 Jan 2014 03:54:12 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:54:12 - XML: Start document: iteration 4
Fri 17 Jan 2014 03:54:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43213691
Fri 17 Jan 2014 03:54:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43213691
Fri 17 Jan 2014 03:54:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:54:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:54:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:54:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:54:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:54:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:54:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:54:31 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:54:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:54:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:54:32 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:54:32 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:54:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:54:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:54:32 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:54:35 - XML: Processed 647346 elements - found 650 jobs
Fri 17 Jan 2014 03:54:35 - job 7341630 appears to have finished
Fri 17 Jan 2014 03:54:35 - job 7347218 appears to have finished
Fri 17 Jan 2014 03:54:35 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 03:54:35 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 03:54:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:54:36 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:54:36 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 03:54:36 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:54:36 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:54:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:54:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:54:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:54:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:54:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:54:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:54:37 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:54:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 03:54:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:54:38 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:54:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43744554
Fri 17 Jan 2014 03:54:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:54:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43744554
Fri 17 Jan 2014 03:54:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:54:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:54:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:54:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:54:49 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:54:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:54:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:54:50 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:54:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:54:50 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:54:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:54:50 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:54:51 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:54:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:54:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:54:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:54:53 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:54:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:54:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:54:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:54:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:54:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:54:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:54:56 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:54:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43852834
Fri 17 Jan 2014 03:54:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:54:57 - job_xml_thread(): Done retrieving: data size 43852834
Fri 17 Jan 2014 03:54:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43852834
Fri 17 Jan 2014 03:54:57 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:54:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:54:57 - XML: Start document: iteration 5
Fri 17 Jan 2014 03:55:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:55:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:55:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:55:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:55:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:55:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:55:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:55:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:55:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:55:11 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:55:12 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:55:12 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:55:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:55:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:55:12 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:55:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:55:12 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:55:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 03:55:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 03:55:12 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:55:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7731 values 121958 bits 15244 bytes 
Fri 17 Jan 2014 03:55:17 - XML: Processed 655380 elements - found 650 jobs
Fri 17 Jan 2014 03:55:17 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 03:55:17 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 03:55:17 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:55:17 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:55:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:55:19 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:55:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:55:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:55:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:55:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:55:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:55:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:55:21 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:55:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43849945
Fri 17 Jan 2014 03:55:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:55:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43849945
Fri 17 Jan 2014 03:55:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:55:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:55:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:55:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:55:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:55:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:55:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:55:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:55:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:55:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:55:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:55:31 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:55:32 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:55:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:55:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:55:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:55:35 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:55:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:55:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:55:36 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:55:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 03:55:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:55:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:55:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:55:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:55:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:55:37 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:55:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43848682
Fri 17 Jan 2014 03:55:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:55:38 - job_xml_thread(): Done retrieving: data size 43848682
Fri 17 Jan 2014 03:55:38 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:55:38 - XML: Start document: iteration 6
Fri 17 Jan 2014 03:55:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43848682
Fri 17 Jan 2014 03:55:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:55:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:55:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:55:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:55:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:55:56 - XML: Processed 655496 elements - found 649 jobs
Fri 17 Jan 2014 03:55:56 - job 7347224 appears to have finished
Fri 17 Jan 2014 03:55:56 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 03:55:56 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:55:56 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 03:55:56 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 03:55:57 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:55:57 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 03:55:57 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:55:57 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 03:55:57 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 03:55:58 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 03:55:58 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:55:58 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:56:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:56:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:56:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:56:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:56:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:56:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:56:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:56:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:56:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:56:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:56:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:56:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:56:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:56:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:56:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:56:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:56:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:56:02 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 864784 values 13643848 bits 1705481 bytes 
Fri 17 Jan 2014 03:56:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:56:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870967
Fri 17 Jan 2014 03:56:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:56:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870967
Fri 17 Jan 2014 03:56:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:56:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:56:12 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:56:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:56:13 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:56:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 03:56:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 03:56:13 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:56:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8762 values 138176 bits 17272 bytes 
Fri 17 Jan 2014 03:56:13 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:56:13 - job_xml_thread(): Done retrieving: data size 43870967
Fri 17 Jan 2014 03:56:13 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:56:13 - XML: Start document: iteration 7
Fri 17 Jan 2014 03:56:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:56:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:56:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:56:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:56:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:56:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:56:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:56:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:56:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:56:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:56:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:56:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:56:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:56:27 - XML: Processed 655496 elements - found 649 jobs
Fri 17 Jan 2014 03:56:27 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 03:56:27 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 03:56:27 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:56:27 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:56:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:56:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:56:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:56:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:56:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:56:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:56:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:56:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:56:33 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:56:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858616
Fri 17 Jan 2014 03:56:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:56:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43858616
Fri 17 Jan 2014 03:56:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:56:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:56:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:56:42 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:56:42 - job_xml_thread(): Done retrieving: data size 43858616
Fri 17 Jan 2014 03:56:42 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:56:42 - XML: Start document: iteration 8
Fri 17 Jan 2014 03:56:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:56:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:56:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:56:49 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:56:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:56:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:56:50 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:56:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:56:50 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:56:50 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:56:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:56:53 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:56:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 03:56:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:56:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:56:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:56:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:56:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:56:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:56:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:56:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:56:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:56:57 - XML: Processed 655492 elements - found 647 jobs
Fri 17 Jan 2014 03:56:57 - job 7347189 appears to have finished
Fri 17 Jan 2014 03:56:57 - job 7345050 appears to have finished
Fri 17 Jan 2014 03:56:57 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 03:56:57 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 03:56:57 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 03:56:57 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:56:57 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:56:57 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:56:57 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 03:57:00 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:57:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43868350
Fri 17 Jan 2014 03:57:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:57:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43868350
Fri 17 Jan 2014 03:57:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:57:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:57:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:57:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:57:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:57:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:57:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:57:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:57:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:57:11 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:57:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:57:11 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:57:11 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:57:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:57:12 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:57:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:57:13 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:57:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:57:13 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:57:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 03:57:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 03:57:13 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:57:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5907 values 93212 bits 11651 bytes 
Fri 17 Jan 2014 03:57:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:57:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:57:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:57:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:57:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:57:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:57:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:57:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:57:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:57:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870307
Fri 17 Jan 2014 03:57:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:57:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870307
Fri 17 Jan 2014 03:57:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:57:20 - job_xml_thread(): Done retrieving: data size 43870307
Fri 17 Jan 2014 03:57:21 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:57:21 - XML: Start document: iteration 9
Fri 17 Jan 2014 03:57:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:57:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:57:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:57:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:57:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:57:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:57:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:57:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:57:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:57:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:57:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:57:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:57:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:57:41 - XML: Processed 655492 elements - found 647 jobs
Fri 17 Jan 2014 03:57:41 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 03:57:41 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 03:57:41 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:57:41 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:57:43 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:57:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 03:57:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:57:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:57:44 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:57:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:57:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:57:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:57:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:57:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:57:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:57:47 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:57:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43871168
Fri 17 Jan 2014 03:57:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:57:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43871168
Fri 17 Jan 2014 03:57:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:57:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:57:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:57:56 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:57:56 - job_xml_thread(): Done retrieving: data size 43871168
Fri 17 Jan 2014 03:57:56 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:57:56 - XML: Start document: iteration 10
Fri 17 Jan 2014 03:57:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:57:58 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:57:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:57:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:57:59 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:57:59 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:57:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:57:59 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:57:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:58:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:58:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:58:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:58:08 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:58:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:58:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:58:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:58:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:58:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:58:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:58:11 - XML: Processed 655494 elements - found 648 jobs
Fri 17 Jan 2014 03:58:11 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 03:58:11 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 03:58:11 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 03:58:11 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:58:11 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:58:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:58:13 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:58:14 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:58:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43844776
Fri 17 Jan 2014 03:58:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:58:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43844776
Fri 17 Jan 2014 03:58:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:58:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:58:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:58:15 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:58:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 03:58:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:58:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 03:58:15 - Entering storeMetrics(): cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Fri 17 Jan 2014 03:58:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:58:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:58:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:58:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:58:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:58:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:58:25 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:58:25 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:58:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:58:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:58:25 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:58:26 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:58:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:58:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:58:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:58:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:58:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:58:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:58:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:58:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:58:30 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:58:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43893016
Fri 17 Jan 2014 03:58:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:58:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43893016
Fri 17 Jan 2014 03:58:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:58:31 - job_xml_thread(): Done retrieving: data size 43893016
Fri 17 Jan 2014 03:58:31 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:58:31 - XML: Start document: iteration 11
Fri 17 Jan 2014 03:58:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:58:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:58:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:58:42 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:58:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:58:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:58:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:58:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:58:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:58:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:58:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:58:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:58:44 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:58:53 - XML: Processed 655496 elements - found 649 jobs
Fri 17 Jan 2014 03:58:53 - job 7347243 field 'start_timestamp' changed since saved from: 1389927439 to: 1389927398
Fri 17 Jan 2014 03:58:53 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 03:58:53 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 03:58:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:58:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:58:54 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 03:58:54 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:58:54 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:58:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:58:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:58:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:58:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:58:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:58:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:58:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:58:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43845519
Fri 17 Jan 2014 03:58:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:58:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43845519
Fri 17 Jan 2014 03:58:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:58:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:59:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:59:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:59:09 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:59:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:59:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:59:09 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:59:10 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:59:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:59:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:59:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:59:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:59:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:59:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:59:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:59:13 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:59:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:59:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:59:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:59:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:59:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:59:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:59:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:59:15 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:59:15 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:59:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:59:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 03:59:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 03:59:15 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 03:59:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 15259 values 240714 bits 30089 bytes 
Fri 17 Jan 2014 03:59:17 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:59:17 - job_xml_thread(): Done retrieving: data size 43811164
Fri 17 Jan 2014 03:59:17 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:59:17 - XML: Start document: iteration 12
Fri 17 Jan 2014 03:59:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43811164
Fri 17 Jan 2014 03:59:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43811164
Fri 17 Jan 2014 03:59:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:59:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:59:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:59:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:59:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:59:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:59:39 - XML: Processed 654748 elements - found 649 jobs
Fri 17 Jan 2014 03:59:40 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 03:59:40 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 03:59:40 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 03:59:40 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 03:59:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 03:59:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 03:59:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 03:59:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 03:59:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 03:59:41 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 03:59:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 03:59:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 03:59:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:59:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 03:59:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 03:59:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 03:59:42 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 03:59:42 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:59:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 03:59:42 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 03:59:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 03:59:47 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 03:59:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43264492
Fri 17 Jan 2014 03:59:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 03:59:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43264492
Fri 17 Jan 2014 03:59:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 03:59:55 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 03:59:55 - job_xml_thread(): Done retrieving: data size 43264492
Fri 17 Jan 2014 03:59:55 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 03:59:55 - XML: Start document: iteration 13
Fri 17 Jan 2014 03:59:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 03:59:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 03:59:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 03:59:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:00:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:00:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:00:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:00:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:00:06 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:00:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:00:06 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:00:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:00:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:00:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:00:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:00:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:00:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:00:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:00:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:00:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:00:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:00:11 - XML: Processed 647794 elements - found 649 jobs
Fri 17 Jan 2014 04:00:11 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 04:00:11 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 04:00:11 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:00:11 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:00:13 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:00:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 04:00:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:00:15 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:00:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43232382
Fri 17 Jan 2014 04:00:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:00:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43232382
Fri 17 Jan 2014 04:00:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:00:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:00:15 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:00:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:00:17 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:00:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 04:00:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 04:00:17 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:00:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5905 values 93047 bits 11630 bytes 
Fri 17 Jan 2014 04:00:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:00:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:00:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:00:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:00:26 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:00:26 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:00:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:00:28 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:00:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:00:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:00:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:00:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:00:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:00:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:00:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:00:32 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:00:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:00:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:00:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:00:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:00:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:00:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:00:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:00:36 - job_xml_thread(): Done retrieving: data size 43409840
Fri 17 Jan 2014 04:00:36 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:00:36 - XML: Start document: iteration 14
Fri 17 Jan 2014 04:00:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43409840
Fri 17 Jan 2014 04:00:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:00:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43409840
Fri 17 Jan 2014 04:00:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:00:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:00:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:00:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:00:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:00:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:00:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:00:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:00:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:00:51 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:00:51 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:00:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:00:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:00:51 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:00:51 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:00:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 04:00:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:00:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:00:57 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:00:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:00:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:00:58 - XML: Processed 649950 elements - found 648 jobs
Fri 17 Jan 2014 04:00:58 - job 7347128 appears to have finished
Fri 17 Jan 2014 04:00:58 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 04:00:58 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 04:00:58 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 04:00:58 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:00:58 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:00:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:00:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:00:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:00:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:01:01 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:01:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43845053
Fri 17 Jan 2014 04:01:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:01:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43845053
Fri 17 Jan 2014 04:01:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:01:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:01:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:01:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:01:09 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:01:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:01:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:01:12 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:01:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:01:12 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:01:12 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:01:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:01:13 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:01:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:01:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:01:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:01:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:01:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:01:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:01:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:01:17 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:01:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:01:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:01:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:01:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:01:17 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:01:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:01:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 04:01:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 04:01:17 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:01:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5870 values 92653 bits 11581 bytes 
Fri 17 Jan 2014 04:01:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:01:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875041
Fri 17 Jan 2014 04:01:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:01:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875041
Fri 17 Jan 2014 04:01:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:01:20 - job_xml_thread(): Done retrieving: data size 43875041
Fri 17 Jan 2014 04:01:20 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:01:20 - XML: Start document: iteration 15
Fri 17 Jan 2014 04:01:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:01:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:01:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:01:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:01:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:01:38 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:01:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:01:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:01:39 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:01:39 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:01:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:01:39 - XML: Processed 655486 elements - found 648 jobs
Fri 17 Jan 2014 04:01:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:01:39 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:01:39 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 04:01:39 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 04:01:39 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:01:39 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:01:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:01:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:01:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:01:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:01:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:01:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:01:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:01:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:01:43 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 04:01:43 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 04:01:43 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:01:44 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:01:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 04:01:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:01:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:01:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867348
Fri 17 Jan 2014 04:01:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:01:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43867348
Fri 17 Jan 2014 04:01:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:01:54 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:01:55 - job_xml_thread(): Done retrieving: data size 43867348
Fri 17 Jan 2014 04:01:55 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:01:55 - XML: Start document: iteration 16
Fri 17 Jan 2014 04:01:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:01:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:01:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:01:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:01:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:01:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:01:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:01:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:02:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:02:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:02:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:02:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:02:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:02:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:02:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:02:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:02:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:02:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:02:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:02:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:02:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:02:07 - XML: Processed 655492 elements - found 647 jobs
Fri 17 Jan 2014 04:02:07 - job 7347225 appears to have finished
Fri 17 Jan 2014 04:02:07 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 04:02:07 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 04:02:07 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 04:02:07 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:02:07 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:02:09 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:02:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43845916
Fri 17 Jan 2014 04:02:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:02:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43845916
Fri 17 Jan 2014 04:02:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:02:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:02:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:02:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:02:17 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:02:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:02:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 04:02:18 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:02:18 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:02:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 04:02:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7839 values 123943 bits 15492 bytes 
Fri 17 Jan 2014 04:02:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:02:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:02:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:02:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:02:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:02:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:02:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:02:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:02:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:02:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:02:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:02:22 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:02:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:02:23 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:02:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:02:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:02:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:02:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:02:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:02:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:02:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:02:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870115
Fri 17 Jan 2014 04:02:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:02:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870115
Fri 17 Jan 2014 04:02:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:02:26 - job_xml_thread(): Done retrieving: data size 43870115
Fri 17 Jan 2014 04:02:26 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:02:26 - XML: Start document: iteration 17
Fri 17 Jan 2014 04:02:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:02:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:02:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:02:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:02:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:02:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:02:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:02:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:02:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:02:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:02:40 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:02:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:02:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:02:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:02:46 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:02:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:02:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:02:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:02:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:02:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:02:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:02:50 - XML: Processed 655494 elements - found 648 jobs
Fri 17 Jan 2014 04:02:50 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 04:02:50 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 04:02:50 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 04:02:50 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:02:50 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:02:50 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:02:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 04:02:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:02:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:02:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43859482
Fri 17 Jan 2014 04:02:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:02:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43859482
Fri 17 Jan 2014 04:02:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:02:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:02:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:02:57 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 04:02:57 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:03:00 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:03:00 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 04:03:00 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:03:00 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 04:03:00 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 04:03:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:03:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:03:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:03:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:03:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:03:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:03:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:03:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:03:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:03:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:03:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:03:05 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:03:07 - size of cluster 'LISA Cluster': 624 hosts 79484 metrics 1073121 values 16944729 bits 2118091 bytes 
Fri 17 Jan 2014 04:03:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:03:08 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:03:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:03:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:03:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:03:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:03:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:03:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:03:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:03:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43848988
Fri 17 Jan 2014 04:03:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:03:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43848988
Fri 17 Jan 2014 04:03:12 - job_xml_thread(): Done retrieving: data size 43848988
Fri 17 Jan 2014 04:03:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:03:12 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:03:12 - XML: Start document: iteration 18
Fri 17 Jan 2014 04:03:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:03:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:03:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:03:18 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:03:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:03:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 04:03:19 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:03:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8737 values 138093 bits 17261 bytes 
Fri 17 Jan 2014 04:03:19 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:03:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 04:03:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:03:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:03:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:03:29 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:03:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:03:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:03:29 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:03:29 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:03:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:03:29 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:03:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:03:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:03:35 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:03:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:03:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:03:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:03:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:03:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:03:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:03:36 - XML: Processed 655494 elements - found 648 jobs
Fri 17 Jan 2014 04:03:36 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 04:03:36 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 04:03:36 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:03:36 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:03:40 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:03:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43838547
Fri 17 Jan 2014 04:03:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:03:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43838547
Fri 17 Jan 2014 04:03:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:03:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:03:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:03:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:03:50 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:03:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:03:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:03:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:03:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:03:51 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:03:51 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:03:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:03:51 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:03:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:03:51 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:03:55 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:03:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 04:03:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:03:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:03:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:03:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:03:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:03:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:03:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:03:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:03:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:03:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:03:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867890
Fri 17 Jan 2014 04:03:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:04:00 - job_xml_thread(): Done retrieving: data size 43867890
Fri 17 Jan 2014 04:04:00 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:04:00 - XML: Start document: iteration 19
Fri 17 Jan 2014 04:04:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43867890
Fri 17 Jan 2014 04:04:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:04:00 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:04:00 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 04:04:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:04:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:04:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:04:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:04:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:04:16 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:04:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:04:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:04:17 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:04:17 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:04:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:04:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:04:17 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:04:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:04:19 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:04:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:04:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 04:04:20 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:04:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 04:04:20 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:04:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5779 values 91209 bits 11401 bytes 
Fri 17 Jan 2014 04:04:21 - XML: Processed 655494 elements - found 648 jobs
Fri 17 Jan 2014 04:04:21 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 04:04:21 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 04:04:21 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:04:21 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:04:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:04:24 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:04:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:04:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:04:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:04:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:04:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:04:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:04:28 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:04:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43845780
Fri 17 Jan 2014 04:04:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:04:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43845780
Fri 17 Jan 2014 04:04:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:04:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:04:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:04:36 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:04:36 - job_xml_thread(): Done retrieving: data size 43845780
Fri 17 Jan 2014 04:04:36 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:04:36 - XML: Start document: iteration 20
Fri 17 Jan 2014 04:04:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:04:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:04:41 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:04:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 04:04:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:04:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:04:46 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:04:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:04:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:04:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:04:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:04:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:04:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:04:47 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:04:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:04:49 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:04:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:04:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:04:50 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:04:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:04:50 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:04:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:04:51 - XML: Processed 655496 elements - found 649 jobs
Fri 17 Jan 2014 04:04:51 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 04:04:51 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 04:04:51 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 04:04:51 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:04:51 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:04:55 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:04:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853280
Fri 17 Jan 2014 04:04:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:04:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853280
Fri 17 Jan 2014 04:04:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:05:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:05:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:05:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:05:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:05:06 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:05:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:05:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:05:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:05:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:05:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:05:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:05:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:05:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:05:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:05:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:05:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:05:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:05:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:05:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:05:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:05:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:05:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:05:17 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:05:17 - job_xml_thread(): Done retrieving: data size 43795438
Fri 17 Jan 2014 04:05:17 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:05:17 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 04:05:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43795438
Fri 17 Jan 2014 04:05:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:05:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43795438
Fri 17 Jan 2014 04:05:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:05:19 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 04:05:19 - Housekeeping: done.
Fri 17 Jan 2014 04:05:19 - XML: Start document: iteration 0
Fri 17 Jan 2014 04:05:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:05:20 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:05:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:05:22 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:05:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 04:05:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 04:05:23 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:05:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9247 values 145914 bits 18239 bytes 
Fri 17 Jan 2014 04:05:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:05:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:05:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:05:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:05:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:05:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:05:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:05:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:05:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:05:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:05:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:05:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:05:34 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:05:36 - XML: Processed 654748 elements - found 649 jobs
Fri 17 Jan 2014 04:05:36 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 04:05:36 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 04:05:36 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:05:36 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:05:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:05:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:05:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:05:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:05:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:05:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:05:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:05:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:05:46 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:05:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43305142
Fri 17 Jan 2014 04:05:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:05:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43305142
Fri 17 Jan 2014 04:05:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:05:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:05:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:05:51 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:05:51 - job_xml_thread(): Done retrieving: data size 43305142
Fri 17 Jan 2014 04:05:51 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:05:51 - XML: Start document: iteration 1
Fri 17 Jan 2014 04:05:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:05:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:06:03 - XML: Processed 648738 elements - found 650 jobs
Fri 17 Jan 2014 04:06:03 - job 7347221 appears to have finished
Fri 17 Jan 2014 04:06:03 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 04:06:03 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 04:06:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:06:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:06:05 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 04:06:05 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:06:05 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:06:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:06:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:06:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:06:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:06:05 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:06:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:06:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:06:06 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:06:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 04:06:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:06:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:06:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:06:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:06:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:06:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:06:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:06:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:06:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:06:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:06:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43255531
Fri 17 Jan 2014 04:06:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:06:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43255531
Fri 17 Jan 2014 04:06:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:06:20 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:06:20 - job_xml_thread(): Done retrieving: data size 43255531
Fri 17 Jan 2014 04:06:20 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:06:20 - XML: Start document: iteration 2
Fri 17 Jan 2014 04:06:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:06:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:06:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:06:23 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:06:25 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:06:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 04:06:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:06:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 04:06:25 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:06:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:06:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:06:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6019 values 94962 bits 11870 bytes 
Fri 17 Jan 2014 04:06:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:06:29 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:06:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:06:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:06:30 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:06:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:06:30 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:06:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:06:30 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:06:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:06:36 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:06:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:06:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:06:37 - XML: Processed 647972 elements - found 650 jobs
Fri 17 Jan 2014 04:06:37 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 04:06:37 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 04:06:37 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:06:37 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:06:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:06:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:06:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:06:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:06:41 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:06:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43757944
Fri 17 Jan 2014 04:06:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:06:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43757944
Fri 17 Jan 2014 04:06:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:06:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:06:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:06:52 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:06:52 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:06:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:06:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:06:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:06:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:06:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:06:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:06:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:06:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:06:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:06:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:06:58 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:06:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 04:06:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:06:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:06:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:06:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:06:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:06:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:06:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:06:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:06:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:07:01 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:07:01 - job_xml_thread(): Done retrieving: data size 43858835
Fri 17 Jan 2014 04:07:01 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:07:01 - XML: Start document: iteration 3
Fri 17 Jan 2014 04:07:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858835
Fri 17 Jan 2014 04:07:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:07:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43858835
Fri 17 Jan 2014 04:07:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:07:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:07:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:07:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:07:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:07:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:07:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:07:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:07:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:07:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:07:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:07:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:07:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:07:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:07:23 - XML: Processed 655414 elements - found 650 jobs
Fri 17 Jan 2014 04:07:23 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 04:07:23 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 04:07:23 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:07:23 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:07:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:07:24 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:07:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:07:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:07:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:07:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:07:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:07:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:07:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:07:25 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:07:25 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:07:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:07:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 04:07:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 04:07:25 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:07:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5968 values 94130 bits 11766 bytes 
Fri 17 Jan 2014 04:07:28 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:07:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43849829
Fri 17 Jan 2014 04:07:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:07:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43849829
Fri 17 Jan 2014 04:07:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:07:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:07:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:07:38 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:07:38 - job_xml_thread(): Done retrieving: data size 43849829
Fri 17 Jan 2014 04:07:38 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:07:38 - XML: Start document: iteration 4
Fri 17 Jan 2014 04:07:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:07:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:07:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:07:42 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:07:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:07:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:07:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:07:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:07:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:07:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:07:43 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:07:53 - XML: Processed 655498 elements - found 650 jobs
Fri 17 Jan 2014 04:07:53 - job 7347215 appears to have finished
Fri 17 Jan 2014 04:07:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:07:53 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:07:53 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 04:07:53 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 04:07:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:07:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:07:53 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 04:07:53 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:07:53 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:07:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:07:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:07:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:07:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:07:55 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:07:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 04:07:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:07:57 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:07:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43839094
Fri 17 Jan 2014 04:07:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:07:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43839094
Fri 17 Jan 2014 04:07:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:07:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:07:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:08:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:08:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:08:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:08:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:08:08 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:08:08 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:08:08 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:08:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:08:08 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:08:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:08:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:08:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:08:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:08:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:08:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:08:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:08:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:08:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:08:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:08:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:08:17 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:08:17 - job_xml_thread(): Done retrieving: data size 43870253
Fri 17 Jan 2014 04:08:17 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:08:17 - XML: Start document: iteration 5
Fri 17 Jan 2014 04:08:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870253
Fri 17 Jan 2014 04:08:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870253
Fri 17 Jan 2014 04:08:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:08:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:08:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:08:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:08:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:08:25 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:08:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:08:26 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:08:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 04:08:26 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:08:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 04:08:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8075 values 127301 bits 15912 bytes 
Fri 17 Jan 2014 04:08:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:08:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:08:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:08:31 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:08:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:08:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:08:32 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:08:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:08:32 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:08:32 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:08:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:08:37 - XML: Processed 655494 elements - found 648 jobs
Fri 17 Jan 2014 04:08:37 - job 7347231 appears to have finished
Fri 17 Jan 2014 04:08:37 - job 7347226 appears to have finished
Fri 17 Jan 2014 04:08:37 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 04:08:37 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 04:08:38 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 04:08:38 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:08:38 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:08:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:08:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:08:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:08:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:08:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:08:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:08:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:08:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:08:46 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:08:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43848894
Fri 17 Jan 2014 04:08:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:08:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43848894
Fri 17 Jan 2014 04:08:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:08:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:08:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:08:53 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:08:53 - job_xml_thread(): Done retrieving: data size 43848894
Fri 17 Jan 2014 04:08:53 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:08:53 - XML: Start document: iteration 6
Fri 17 Jan 2014 04:08:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:08:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:08:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:08:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:08:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:08:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:09:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:09:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:09:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:09:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:09:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:09:01 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:09:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 04:09:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:09:08 - XML: Processed 655494 elements - found 648 jobs
Fri 17 Jan 2014 04:09:08 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 04:09:08 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 04:09:08 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:09:08 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:09:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:09:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:09:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:09:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:09:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:09:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:09:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:09:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:09:15 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:09:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43837279
Fri 17 Jan 2014 04:09:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:09:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43837279
Fri 17 Jan 2014 04:09:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:09:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:09:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:09:23 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:09:23 - job_xml_thread(): Done retrieving: data size 43837279
Fri 17 Jan 2014 04:09:23 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:09:23 - XML: Start document: iteration 7
Fri 17 Jan 2014 04:09:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:09:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:09:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:09:27 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:09:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:09:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 04:09:28 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:09:28 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:09:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 04:09:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6056 values 95478 bits 11934 bytes 
Fri 17 Jan 2014 04:09:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:09:34 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:09:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:09:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:09:35 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:09:35 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:09:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:09:35 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:09:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:09:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:09:40 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:09:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:09:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:09:40 - XML: Processed 655494 elements - found 648 jobs
Fri 17 Jan 2014 04:09:40 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 04:09:40 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 04:09:40 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:09:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:09:40 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:09:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:09:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:09:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:09:44 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:09:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43860787
Fri 17 Jan 2014 04:09:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:09:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43860787
Fri 17 Jan 2014 04:09:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:09:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:09:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:09:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:09:54 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:09:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:09:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:09:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:09:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:09:55 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:09:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:09:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 04:09:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:09:55 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:09:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:09:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:09:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:09:55 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:10:01 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 04:10:01 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:10:01 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:10:01 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 04:10:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:10:01 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:10:01 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 04:10:01 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:10:01 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 04:10:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:10:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:10:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:10:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:10:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:10:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:10:02 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 1072108 values 16920458 bits 2115057 bytes 
Fri 17 Jan 2014 04:10:07 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:10:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43852944
Fri 17 Jan 2014 04:10:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:10:07 - job_xml_thread(): Done retrieving: data size 43852944
Fri 17 Jan 2014 04:10:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43852944
Fri 17 Jan 2014 04:10:07 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:10:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:10:07 - XML: Start document: iteration 8
Fri 17 Jan 2014 04:10:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:10:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:10:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:10:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:10:25 - XML: Processed 655494 elements - found 648 jobs
Fri 17 Jan 2014 04:10:25 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 04:10:25 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 04:10:25 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:10:25 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:10:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:10:25 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:10:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:10:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:10:26 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:10:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:10:26 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:10:26 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:10:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:10:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:10:28 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:10:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:10:29 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:10:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 04:10:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 04:10:29 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:10:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6210 values 97919 bits 12239 bytes 
Fri 17 Jan 2014 04:10:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:10:30 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:10:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:10:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:10:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:10:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:10:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:10:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:10:34 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:10:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43871520
Fri 17 Jan 2014 04:10:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:10:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43871520
Fri 17 Jan 2014 04:10:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:10:40 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:10:40 - job_xml_thread(): Done retrieving: data size 43871520
Fri 17 Jan 2014 04:10:40 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:10:40 - XML: Start document: iteration 9
Fri 17 Jan 2014 04:10:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:10:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:10:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:10:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:10:54 - XML: Processed 655492 elements - found 647 jobs
Fri 17 Jan 2014 04:10:54 - job 7347212 appears to have finished
Fri 17 Jan 2014 04:10:54 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 04:10:54 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 04:10:54 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 04:10:54 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:10:54 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:10:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:10:54 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:10:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:10:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:10:54 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:10:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:10:54 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:10:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:10:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:11:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:11:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:11:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:11:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:11:00 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:11:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 04:11:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:11:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:11:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:11:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:11:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:11:01 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:11:01 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 04:11:04 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:11:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43871926
Fri 17 Jan 2014 04:11:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:11:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43871926
Fri 17 Jan 2014 04:11:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:11:09 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:11:09 - job_xml_thread(): Done retrieving: data size 43871926
Fri 17 Jan 2014 04:11:09 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:11:09 - XML: Start document: iteration 10
Fri 17 Jan 2014 04:11:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:11:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:11:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:11:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:11:24 - XML: Processed 655492 elements - found 647 jobs
Fri 17 Jan 2014 04:11:24 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 04:11:24 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 04:11:24 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:11:24 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:11:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:11:28 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:11:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:11:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:11:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:11:29 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:11:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:11:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:11:29 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:11:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 04:11:29 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:11:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:11:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:11:29 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:11:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 04:11:29 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:11:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5523 values 87046 bits 10880 bytes 
Fri 17 Jan 2014 04:11:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:11:29 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:11:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:11:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:11:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:11:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:11:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:11:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:11:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:11:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43345483
Fri 17 Jan 2014 04:11:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:11:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43345483
Fri 17 Jan 2014 04:11:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:11:39 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:11:39 - job_xml_thread(): Done retrieving: data size 43345483
Fri 17 Jan 2014 04:11:39 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:11:39 - XML: Start document: iteration 11
Fri 17 Jan 2014 04:11:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:11:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:11:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:11:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:11:55 - XML: Processed 649024 elements - found 648 jobs
Fri 17 Jan 2014 04:11:55 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 04:11:55 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 04:11:56 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 04:11:56 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:11:56 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:11:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:11:59 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:11:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:11:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:12:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:12:00 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:12:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:12:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:12:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:12:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:12:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:12:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:12:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:12:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:12:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:12:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:12:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:12:01 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:12:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 04:12:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:12:08 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:12:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43206911
Fri 17 Jan 2014 04:12:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:12:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43206911
Fri 17 Jan 2014 04:12:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:12:12 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:12:12 - job_xml_thread(): Done retrieving: data size 43206911
Fri 17 Jan 2014 04:12:12 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:12:12 - XML: Start document: iteration 12
Fri 17 Jan 2014 04:12:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:12:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:12:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:12:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:12:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:12:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:12:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:12:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:12:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:12:27 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:12:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:12:27 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:12:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:12:29 - XML: Processed 647401 elements - found 648 jobs
Fri 17 Jan 2014 04:12:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:12:29 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:12:29 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 04:12:29 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 04:12:29 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:12:29 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:12:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:12:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 04:12:30 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:12:30 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:12:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 04:12:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5749 values 90626 bits 11328 bytes 
Fri 17 Jan 2014 04:12:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:12:31 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:12:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:12:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:12:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:12:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:12:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:12:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:12:38 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:12:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43432507
Fri 17 Jan 2014 04:12:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:12:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43432507
Fri 17 Jan 2014 04:12:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:12:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:12:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:12:44 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:12:44 - job_xml_thread(): Done retrieving: data size 43432507
Fri 17 Jan 2014 04:12:44 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:12:45 - XML: Start document: iteration 13
Fri 17 Jan 2014 04:12:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:12:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:12:48 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:12:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 04:12:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:12:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:12:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:12:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:12:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:13:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:13:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:13:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:13:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:13:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:13:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:13:03 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:13:04 - XML: Processed 650128 elements - found 650 jobs
Fri 17 Jan 2014 04:13:04 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 04:13:04 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 04:13:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:13:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:13:04 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 04:13:04 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:13:04 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:13:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:13:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:13:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:13:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:13:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:13:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43840204
Fri 17 Jan 2014 04:13:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:13:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43840204
Fri 17 Jan 2014 04:13:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:13:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:13:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:13:19 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:13:19 - job_xml_thread(): Done retrieving: data size 43840204
Fri 17 Jan 2014 04:13:19 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:13:19 - XML: Start document: iteration 14
Fri 17 Jan 2014 04:13:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:13:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:13:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:13:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:13:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:13:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:13:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:13:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:13:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:13:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:13:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:13:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:13:30 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:13:31 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:13:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 04:13:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:13:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 04:13:31 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:13:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5886 values 92833 bits 11604 bytes 
Fri 17 Jan 2014 04:13:33 - XML: Processed 655498 elements - found 650 jobs
Fri 17 Jan 2014 04:13:33 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 04:13:33 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 04:13:33 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:13:33 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:13:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:13:35 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:13:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:13:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:13:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:13:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:13:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:13:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:13:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:13:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:13:40 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:13:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43825288
Fri 17 Jan 2014 04:13:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:13:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43825288
Fri 17 Jan 2014 04:13:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:13:48 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:13:48 - job_xml_thread(): Done retrieving: data size 43825288
Fri 17 Jan 2014 04:13:48 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:13:48 - XML: Start document: iteration 15
Fri 17 Jan 2014 04:13:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:13:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:13:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:13:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:13:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:13:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:13:56 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:13:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:13:56 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:13:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:13:56 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:14:00 - XML: Processed 655503 elements - found 653 jobs
Fri 17 Jan 2014 04:14:00 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 04:14:00 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 04:14:00 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 04:14:00 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:14:00 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:14:02 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:14:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 04:14:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:14:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:14:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:14:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:14:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:14:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:14:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:14:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:14:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:14:06 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:14:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43857133
Fri 17 Jan 2014 04:14:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:14:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43857133
Fri 17 Jan 2014 04:14:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:14:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:14:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:14:16 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:14:16 - job_xml_thread(): Done retrieving: data size 43857133
Fri 17 Jan 2014 04:14:16 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:14:16 - XML: Start document: iteration 16
Fri 17 Jan 2014 04:14:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:14:16 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:14:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:14:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:14:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:14:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:14:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:14:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:14:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:14:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:14:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:14:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:14:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:14:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:14:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:14:29 - XML: Processed 655504 elements - found 653 jobs
Fri 17 Jan 2014 04:14:30 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 04:14:30 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 04:14:30 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:14:30 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:14:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:14:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:14:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:14:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:14:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:14:31 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:14:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:14:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 04:14:32 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:14:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 04:14:32 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:14:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5901 values 93038 bits 11629 bytes 
Fri 17 Jan 2014 04:14:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:14:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:14:34 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:14:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43854208
Fri 17 Jan 2014 04:14:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:14:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43854208
Fri 17 Jan 2014 04:14:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:14:45 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:14:45 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:14:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:14:45 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:14:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:14:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:14:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:14:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:14:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:14:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:14:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:14:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:14:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:14:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:14:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:14:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:14:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:14:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:14:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:14:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:14:53 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:14:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 04:14:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:14:56 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:14:56 - job_xml_thread(): Done retrieving: data size 43849220
Fri 17 Jan 2014 04:14:56 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:14:56 - XML: Start document: iteration 17
Fri 17 Jan 2014 04:14:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43849220
Fri 17 Jan 2014 04:14:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43849220
Fri 17 Jan 2014 04:14:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:14:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:15:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:15:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:15:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:15:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:15:11 - XML: Processed 655501 elements - found 653 jobs
Fri 17 Jan 2014 04:15:11 - job 7347253 field 'start_timestamp' changed since saved from: 1389928404 to: 1389928357
Fri 17 Jan 2014 04:15:11 - job 7347255 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 04:15:11 - job 7347254 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 04:15:12 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 04:15:12 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 04:15:13 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 04:15:13 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:15:13 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:15:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:15:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:15:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:15:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:15:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:15:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:15:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:15:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:15:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:15:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:15:21 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:15:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:15:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:15:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:15:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:15:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:15:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:15:23 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 04:15:23 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 04:15:23 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:15:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:15:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858853
Fri 17 Jan 2014 04:15:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:15:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43858853
Fri 17 Jan 2014 04:15:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:15:28 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:15:28 - job_xml_thread(): Done retrieving: data size 43858853
Fri 17 Jan 2014 04:15:28 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:15:28 - XML: Start document: iteration 18
Fri 17 Jan 2014 04:15:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:15:32 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:15:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:15:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:15:33 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:15:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 04:15:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:15:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:15:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 04:15:33 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:15:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:15:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:15:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7676 values 120996 bits 15124 bytes 
Fri 17 Jan 2014 04:15:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:15:35 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:15:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:15:35 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:15:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:15:35 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:15:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:15:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:15:45 - XML: Processed 655499 elements - found 652 jobs
Fri 17 Jan 2014 04:15:45 - job 7346742 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 04:15:45 - job 7347223 appears to have finished
Fri 17 Jan 2014 04:15:45 - job 7347227 appears to have finished
Fri 17 Jan 2014 04:15:45 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 04:15:45 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 04:15:46 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 04:15:46 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:15:46 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:15:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:15:48 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:15:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:15:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:15:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:15:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:15:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:15:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:15:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:15:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851258
Fri 17 Jan 2014 04:15:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:15:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:15:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:15:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851258
Fri 17 Jan 2014 04:15:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:16:01 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:16:01 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:16:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:16:03 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:16:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:16:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:16:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:16:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:16:04 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:16:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:16:04 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:16:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:16:05 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:16:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 04:16:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:16:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:16:06 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:16:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:16:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:16:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:16:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:16:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:16:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:16:08 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:16:08 - job_xml_thread(): Done retrieving: data size 43854358
Fri 17 Jan 2014 04:16:08 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:16:08 - XML: Start document: iteration 19
Fri 17 Jan 2014 04:16:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43854358
Fri 17 Jan 2014 04:16:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:16:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43854358
Fri 17 Jan 2014 04:16:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:16:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:16:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:16:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:16:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:16:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:16:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:16:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:16:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:16:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:16:27 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:16:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:16:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:16:27 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:16:29 - XML: Processed 655502 elements - found 652 jobs
Fri 17 Jan 2014 04:16:29 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 04:16:29 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 04:16:29 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:16:29 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:16:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:16:31 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:16:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:16:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:16:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:16:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:16:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:16:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:16:32 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 04:16:32 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 04:16:32 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:16:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:16:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43887826
Fri 17 Jan 2014 04:16:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:16:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43887826
Fri 17 Jan 2014 04:16:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:16:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:16:34 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:16:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:16:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 04:16:34 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:16:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9172 values 144928 bits 18116 bytes 
Fri 17 Jan 2014 04:16:34 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:16:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 04:16:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:16:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:16:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:16:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:16:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:16:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:16:45 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:16:45 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:16:45 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:16:45 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:16:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:16:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:16:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:16:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:16:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:16:48 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:16:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:16:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:16:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:16:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:16:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:16:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:16:50 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:16:50 - job_xml_thread(): Done retrieving: data size 43874037
Fri 17 Jan 2014 04:16:50 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:16:50 - XML: Start document: iteration 20
Fri 17 Jan 2014 04:16:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43874037
Fri 17 Jan 2014 04:16:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:16:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43874037
Fri 17 Jan 2014 04:16:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:17:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:17:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:17:01 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 04:17:01 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:17:02 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:17:02 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 04:17:02 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:17:02 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 04:17:02 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 04:17:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:17:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:17:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:17:03 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:17:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:17:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:17:06 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:17:06 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:17:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:17:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:17:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:17:08 - size of cluster 'LISA Cluster': 624 hosts 79483 metrics 603760 values 9532270 bits 1191533 bytes 
Fri 17 Jan 2014 04:17:13 - XML: Processed 655494 elements - found 649 jobs
Fri 17 Jan 2014 04:17:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:17:14 - job 7347234 appears to have finished
Fri 17 Jan 2014 04:17:14 - job 7347219 appears to have finished
Fri 17 Jan 2014 04:17:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:17:14 - job 7347255 field 'start_timestamp' changed since saved from: 1389928498 to: 1389928418
Fri 17 Jan 2014 04:17:14 - job 7347193 appears to have finished
Fri 17 Jan 2014 04:17:14 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 04:17:14 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 04:17:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:17:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:17:14 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 04:17:14 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:17:14 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:17:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:17:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:17:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:17:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:17:14 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:17:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 04:17:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:17:16 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:17:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43799219
Fri 17 Jan 2014 04:17:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:17:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43799219
Fri 17 Jan 2014 04:17:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:17:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:17:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:17:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:17:29 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:17:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:17:29 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:17:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:17:31 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:17:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:17:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:17:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:17:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:17:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:17:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:17:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:17:32 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:17:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:17:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:17:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:17:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:17:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:17:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:17:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:17:34 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:17:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:17:35 - job_xml_thread(): Done retrieving: data size 43372231
Fri 17 Jan 2014 04:17:35 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:17:35 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 04:17:35 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 04:17:35 - Housekeeping: done.
Fri 17 Jan 2014 04:17:35 - XML: Start document: iteration 0
Fri 17 Jan 2014 04:17:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43372231
Fri 17 Jan 2014 04:17:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:17:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43372231
Fri 17 Jan 2014 04:17:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:17:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:17:35 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:17:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 04:17:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 04:17:35 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:17:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5691 values 89939 bits 11242 bytes 
Fri 17 Jan 2014 04:17:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:17:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:17:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:17:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:17:49 - XML: Processed 649414 elements - found 648 jobs
Fri 17 Jan 2014 04:17:49 - job 7347250 appears to have finished
Fri 17 Jan 2014 04:17:49 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 04:17:49 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 04:17:51 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 04:17:51 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:17:51 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:17:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:17:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:17:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:17:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:17:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:17:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:17:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:17:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:17:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:17:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:17:59 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:17:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:17:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:17:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:17:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:17:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:17:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:18:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:18:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43224736
Fri 17 Jan 2014 04:18:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:18:03 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:18:03 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 04:18:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43224736
Fri 17 Jan 2014 04:18:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:18:06 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:18:06 - job_xml_thread(): Done retrieving: data size 43224736
Fri 17 Jan 2014 04:18:06 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:18:06 - XML: Start document: iteration 1
Fri 17 Jan 2014 04:18:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:18:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:18:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:18:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:18:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:18:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:18:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:18:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:18:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:18:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:18:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:18:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:18:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:18:23 - XML: Processed 647294 elements - found 648 jobs
Fri 17 Jan 2014 04:18:23 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 04:18:23 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 04:18:23 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:18:23 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:18:24 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:18:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 04:18:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:18:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:18:26 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:18:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:18:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:18:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:18:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:18:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:18:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:18:28 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:18:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43264874
Fri 17 Jan 2014 04:18:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:18:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43264874
Fri 17 Jan 2014 04:18:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:18:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:18:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:18:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:18:36 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:18:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:18:36 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:18:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 04:18:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 04:18:36 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:18:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5899 values 93185 bits 11648 bytes 
Fri 17 Jan 2014 04:18:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:18:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:18:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:18:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:18:37 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:18:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:18:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43264874
Fri 17 Jan 2014 04:18:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:18:37 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:18:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:18:38 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:18:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:18:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:18:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:18:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:18:48 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:18:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:18:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:18:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:18:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:18:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:18:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:18:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:18:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:18:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:18:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:18:53 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:18:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:18:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:18:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:18:54 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:18:54 - job_xml_thread(): Done retrieving: data size 43819422
Fri 17 Jan 2014 04:18:54 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:18:54 - XML: Start document: iteration 2
Fri 17 Jan 2014 04:18:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43819422
Fri 17 Jan 2014 04:18:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:18:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43819422
Fri 17 Jan 2014 04:18:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:19:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:19:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:19:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:19:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:19:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:19:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:19:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:19:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:19:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:19:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:19:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:19:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:19:10 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:19:12 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:19:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 04:19:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:19:16 - XML: Processed 655364 elements - found 646 jobs
Fri 17 Jan 2014 04:19:16 - job 7347228 appears to have finished
Fri 17 Jan 2014 04:19:16 - job 7346750 appears to have finished
Fri 17 Jan 2014 04:19:16 - job 7346811 appears to have finished
Fri 17 Jan 2014 04:19:16 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 04:19:16 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 04:19:16 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 04:19:16 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:19:16 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:19:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:19:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:19:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:19:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:19:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:19:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:19:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:19:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:19:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:19:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43845137
Fri 17 Jan 2014 04:19:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:19:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43845137
Fri 17 Jan 2014 04:19:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:19:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:19:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:19:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:19:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:19:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:19:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:19:31 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:19:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:19:31 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:19:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:19:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:19:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:19:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:19:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:19:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:19:34 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:19:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:19:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:19:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:19:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:19:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:19:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:19:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:19:36 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:19:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:19:36 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:19:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 04:19:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 04:19:36 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:19:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5843 values 92153 bits 11519 bytes 
Fri 17 Jan 2014 04:19:37 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:19:37 - job_xml_thread(): Done retrieving: data size 43850983
Fri 17 Jan 2014 04:19:37 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:19:37 - XML: Start document: iteration 3
Fri 17 Jan 2014 04:19:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43850983
Fri 17 Jan 2014 04:19:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:19:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43850983
Fri 17 Jan 2014 04:19:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:19:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:19:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:19:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:19:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:19:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:19:53 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:19:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:19:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:19:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:19:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:19:53 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:19:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:19:53 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:20:00 - XML: Processed 655492 elements - found 647 jobs
Fri 17 Jan 2014 04:20:00 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 04:20:00 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 04:20:00 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 04:20:00 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:20:00 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:20:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:20:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:20:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:20:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:20:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:20:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:20:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:20:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:20:06 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:20:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 04:20:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:20:07 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:20:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43833110
Fri 17 Jan 2014 04:20:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:20:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43833110
Fri 17 Jan 2014 04:20:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:20:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:20:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:20:15 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:20:15 - job_xml_thread(): Done retrieving: data size 43833110
Fri 17 Jan 2014 04:20:15 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:20:15 - XML: Start document: iteration 4
Fri 17 Jan 2014 04:20:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:20:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:20:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:20:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:20:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:20:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:20:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:20:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:20:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:20:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:20:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:20:25 - XML: Processed 655492 elements - found 647 jobs
Fri 17 Jan 2014 04:20:25 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 04:20:25 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 04:20:25 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:20:25 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:20:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:20:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:20:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:20:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:20:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:20:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:20:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:20:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:20:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:20:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43848762
Fri 17 Jan 2014 04:20:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:20:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43848762
Fri 17 Jan 2014 04:20:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:20:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:20:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:20:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:20:37 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:20:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:20:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 04:20:37 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:20:37 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:20:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6893 values 108710 bits 13588 bytes 
Fri 17 Jan 2014 04:20:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 04:20:40 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:20:40 - job_xml_thread(): Done retrieving: data size 43848762
Fri 17 Jan 2014 04:20:40 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:20:40 - XML: Start document: iteration 5
Fri 17 Jan 2014 04:20:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:20:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:20:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:20:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:20:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:20:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:20:44 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:20:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:20:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:20:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:20:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:20:54 - XML: Processed 655492 elements - found 647 jobs
Fri 17 Jan 2014 04:20:54 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 04:20:54 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 04:20:54 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:20:54 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:20:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:20:57 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:20:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:20:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:20:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:20:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:20:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:20:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:21:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:21:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:21:00 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:21:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43842319
Fri 17 Jan 2014 04:21:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:21:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43842319
Fri 17 Jan 2014 04:21:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:21:09 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:21:09 - job_xml_thread(): Done retrieving: data size 43842319
Fri 17 Jan 2014 04:21:09 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:21:09 - XML: Start document: iteration 6
Fri 17 Jan 2014 04:21:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:21:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:21:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:21:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:21:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:21:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:21:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:21:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:21:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:21:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:21:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:21:22 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:21:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 04:21:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:21:23 - XML: Processed 655492 elements - found 647 jobs
Fri 17 Jan 2014 04:21:23 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 04:21:23 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 04:21:23 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:21:23 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:21:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:21:23 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:21:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:21:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:21:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:21:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:21:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:21:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:21:27 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:21:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43869702
Fri 17 Jan 2014 04:21:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:21:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43869702
Fri 17 Jan 2014 04:21:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:21:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:21:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:21:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:21:38 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:21:38 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:21:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:21:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:21:38 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:21:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:21:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:21:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:21:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:21:39 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:21:39 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:21:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:21:39 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:21:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 04:21:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:21:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 04:21:39 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:21:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:21:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6100 values 96219 bits 12027 bytes 
Fri 17 Jan 2014 04:21:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:21:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:21:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:21:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:21:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:21:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:21:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:21:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:21:43 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 04:21:43 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 04:21:43 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:21:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:21:45 - job_xml_thread(): Done retrieving: data size 43873498
Fri 17 Jan 2014 04:21:45 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:21:45 - XML: Start document: iteration 7
Fri 17 Jan 2014 04:21:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873498
Fri 17 Jan 2014 04:21:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:21:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873498
Fri 17 Jan 2014 04:21:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:21:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:21:54 - XML: Processed 655492 elements - found 647 jobs
Fri 17 Jan 2014 04:21:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:21:54 - job 7346730 appears to have finished
Fri 17 Jan 2014 04:21:55 - job 7347211 appears to have finished
Fri 17 Jan 2014 04:21:55 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 04:21:55 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 04:21:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:21:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:21:58 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 04:21:58 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:21:58 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:22:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:22:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:22:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:22:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:22:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:22:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:22:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:22:05 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:22:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:22:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:22:08 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:22:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:22:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:22:08 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:22:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 04:22:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:22:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:22:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:22:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:22:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:22:09 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:22:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873429
Fri 17 Jan 2014 04:22:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:22:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873429
Fri 17 Jan 2014 04:22:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:22:13 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:22:13 - job_xml_thread(): Done retrieving: data size 43873429
Fri 17 Jan 2014 04:22:13 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:22:13 - XML: Start document: iteration 8
Fri 17 Jan 2014 04:22:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:22:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:22:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:22:21 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:22:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:22:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:22:23 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:22:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:22:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:22:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:22:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:22:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:22:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:22:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:22:30 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:22:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:22:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:22:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:22:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:22:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:22:31 - XML: Processed 655492 elements - found 647 jobs
Fri 17 Jan 2014 04:22:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:22:31 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 04:22:31 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 04:22:31 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:22:31 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:22:33 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:22:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43863772
Fri 17 Jan 2014 04:22:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:22:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43863772
Fri 17 Jan 2014 04:22:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:22:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:22:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:22:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:22:39 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:22:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:22:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 04:22:40 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:22:40 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:22:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8769 values 138284 bits 17285 bytes 
Fri 17 Jan 2014 04:22:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 04:22:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:22:42 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:22:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:22:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:22:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:22:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:22:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:22:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:22:43 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:22:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:22:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:22:46 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:22:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:22:46 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:22:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:22:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:22:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:22:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:22:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:22:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:22:48 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:22:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43877674
Fri 17 Jan 2014 04:22:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:22:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43877674
Fri 17 Jan 2014 04:22:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:22:49 - job_xml_thread(): Done retrieving: data size 43877674
Fri 17 Jan 2014 04:22:49 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:22:49 - XML: Start document: iteration 9
Fri 17 Jan 2014 04:22:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:22:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:23:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:23:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:23:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:23:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:23:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:23:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:23:06 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:23:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:23:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:23:06 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:23:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:23:07 - XML: Processed 655492 elements - found 647 jobs
Fri 17 Jan 2014 04:23:07 - job 7347260 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 04:23:07 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 04:23:07 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 04:23:08 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 04:23:08 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:23:08 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:23:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:23:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:23:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:23:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:23:11 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:23:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 04:23:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:23:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:23:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:23:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:23:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:23:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:23:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43804840
Fri 17 Jan 2014 04:23:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:23:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43804840
Fri 17 Jan 2014 04:23:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:23:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:23:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:23:23 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:23:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:23:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:23:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:23:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:23:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:23:25 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:23:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:23:25 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:23:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:23:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:23:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:23:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:23:27 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:23:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:23:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:23:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:23:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:23:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:23:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:23:28 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:23:28 - job_xml_thread(): Done retrieving: data size 43809719
Fri 17 Jan 2014 04:23:28 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:23:28 - XML: Start document: iteration 10
Fri 17 Jan 2014 04:23:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43809719
Fri 17 Jan 2014 04:23:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:23:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43809719
Fri 17 Jan 2014 04:23:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:23:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:23:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:23:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:23:41 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:23:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:23:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:23:43 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:23:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 04:23:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:23:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 04:23:43 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:23:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9008 values 142061 bits 17757 bytes 
Fri 17 Jan 2014 04:23:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:23:45 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:23:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:23:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:23:46 - XML: Processed 654734 elements - found 646 jobs
Fri 17 Jan 2014 04:23:46 - job 7347229 appears to have finished
Fri 17 Jan 2014 04:23:46 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 04:23:46 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 04:23:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:23:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:23:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:23:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:23:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:23:46 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 04:23:46 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:23:46 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:23:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:23:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:23:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:23:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:23:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:23:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:23:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:23:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:23:53 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:23:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 04:23:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:23:54 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:23:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43194737
Fri 17 Jan 2014 04:23:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:23:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43194737
Fri 17 Jan 2014 04:23:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:24:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:24:01 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:24:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:24:01 - job_xml_thread(): Done retrieving: data size 43194737
Fri 17 Jan 2014 04:24:01 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:24:01 - XML: Start document: iteration 11
Fri 17 Jan 2014 04:24:03 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 04:24:03 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:24:04 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:24:04 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 04:24:04 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:24:04 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 04:24:04 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 04:24:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:24:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:24:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:24:13 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:24:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:24:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:24:14 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:24:14 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:24:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:24:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:24:14 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:24:14 - XML: Processed 647390 elements - found 648 jobs
Fri 17 Jan 2014 04:24:14 - job 7347209 report time 1389928909 does not match current heartbeat 1389928977 : ignoring job
Fri 17 Jan 2014 04:24:14 - job 7346749 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 04:24:14 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 04:24:14 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 04:24:14 - size of cluster 'LISA Cluster': 624 hosts 79480 metrics 756576 values 11931462 bits 1491432 bytes 
Fri 17 Jan 2014 04:24:15 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 04:24:15 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:24:15 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:24:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:24:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:24:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:24:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:24:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:24:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:24:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:24:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:24:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:24:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43278932
Fri 17 Jan 2014 04:24:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:24:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43278932
Fri 17 Jan 2014 04:24:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:24:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:24:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:24:30 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:24:30 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:24:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:24:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:24:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:24:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:24:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:24:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:24:32 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:24:32 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:24:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:24:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:24:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:24:35 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:24:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:24:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:24:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:24:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:24:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:24:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:24:37 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:24:37 - job_xml_thread(): Done retrieving: data size 43674589
Fri 17 Jan 2014 04:24:37 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:24:37 - XML: Start document: iteration 12
Fri 17 Jan 2014 04:24:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43674589
Fri 17 Jan 2014 04:24:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:24:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43674589
Fri 17 Jan 2014 04:24:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:24:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:24:43 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:24:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:24:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 04:24:44 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:24:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148560 bits 18570 bytes 
Fri 17 Jan 2014 04:24:45 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:24:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 04:24:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:24:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:24:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:24:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:24:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:24:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:24:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:24:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:24:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:24:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:24:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:24:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:24:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:24:58 - XML: Processed 653388 elements - found 647 jobs
Fri 17 Jan 2014 04:24:58 - job 7347209 report time 1389928909 does not match current heartbeat 1389929030 : ignoring job
Fri 17 Jan 2014 04:24:58 - job 7347262 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 04:24:58 - job 7347222 appears to have finished
Fri 17 Jan 2014 04:24:58 - job 7347241 appears to have finished
Fri 17 Jan 2014 04:24:58 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 04:24:58 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 04:24:58 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 04:24:58 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:24:58 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:25:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:25:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:25:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:25:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:25:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:25:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:25:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:25:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:25:04 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:25:04 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 04:25:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:25:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855894
Fri 17 Jan 2014 04:25:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:25:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855894
Fri 17 Jan 2014 04:25:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:25:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:25:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:25:13 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:25:13 - job_xml_thread(): Done retrieving: data size 43855894
Fri 17 Jan 2014 04:25:13 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:25:13 - XML: Start document: iteration 13
Fri 17 Jan 2014 04:25:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:25:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:25:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:25:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:25:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:25:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:25:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:25:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:25:23 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:25:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:25:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:25:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:25:25 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:25:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:25:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:25:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:25:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:25:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:25:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:25:29 - XML: Processed 655282 elements - found 647 jobs
Fri 17 Jan 2014 04:25:29 - job 7347209 report time 1389928909 does not match current heartbeat 1389929030 : ignoring job
Fri 17 Jan 2014 04:25:29 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 04:25:29 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 04:25:29 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:25:29 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:25:29 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:25:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 04:25:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:25:31 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:25:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851632
Fri 17 Jan 2014 04:25:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:25:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851632
Fri 17 Jan 2014 04:25:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:25:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:25:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:25:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:25:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:25:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:25:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:25:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:25:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:25:44 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:25:44 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:25:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:25:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:25:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:25:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:25:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:25:45 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:25:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:25:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:25:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:25:45 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:25:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:25:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:25:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:25:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:25:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:25:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 04:25:46 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:25:46 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:25:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 04:25:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5579 values 87894 bits 10986 bytes 
Fri 17 Jan 2014 04:25:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:25:49 - job_xml_thread(): Done retrieving: data size 43875745
Fri 17 Jan 2014 04:25:49 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:25:49 - XML: Start document: iteration 14
Fri 17 Jan 2014 04:25:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875745
Fri 17 Jan 2014 04:25:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:25:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875745
Fri 17 Jan 2014 04:25:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:25:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:25:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:26:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:26:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:26:08 - XML: Processed 655490 elements - found 646 jobs
Fri 17 Jan 2014 04:26:08 - job 7347209 report time 1389928909 does not match current heartbeat 1389929098 : ignoring job
Fri 17 Jan 2014 04:26:08 - job 7347261 report time 1389929030 does not match current heartbeat 1389929098 : ignoring job
Fri 17 Jan 2014 04:26:08 - job 7347263 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 04:26:09 - job 7346254 appears to have finished
Fri 17 Jan 2014 04:26:09 - job 7346263 appears to have finished
Fri 17 Jan 2014 04:26:09 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 04:26:09 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 04:26:10 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 04:26:10 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:26:10 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:26:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:26:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:26:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:26:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:26:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:26:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:26:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:26:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:26:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:26:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:26:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:26:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:26:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:26:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:26:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:26:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:26:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:26:14 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:26:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 04:26:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:26:17 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:26:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43880822
Fri 17 Jan 2014 04:26:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:26:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43880822
Fri 17 Jan 2014 04:26:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:26:25 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:26:25 - job_xml_thread(): Done retrieving: data size 43880822
Fri 17 Jan 2014 04:26:26 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:26:26 - XML: Start document: iteration 15
Fri 17 Jan 2014 04:26:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:26:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:26:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:26:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:26:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:26:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:26:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:26:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:26:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:26:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:26:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:26:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:26:31 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:26:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:26:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:26:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:26:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:26:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:26:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:26:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:26:40 - XML: Processed 655482 elements - found 642 jobs
Fri 17 Jan 2014 04:26:40 - job 7347142 appears to have finished
Fri 17 Jan 2014 04:26:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:26:40 - job 7347261 report time 1389929030 does not match current heartbeat 1389929098 : ignoring job
Fri 17 Jan 2014 04:26:40 - job 7347136 appears to have finished
Fri 17 Jan 2014 04:26:40 - job 7347258 appears to have finished
Fri 17 Jan 2014 04:26:40 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 04:26:40 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 04:26:40 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 04:26:40 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:26:40 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:26:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:26:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43844089
Fri 17 Jan 2014 04:26:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:26:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43844089
Fri 17 Jan 2014 04:26:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:26:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:26:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:26:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:26:46 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:26:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:26:46 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:26:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 04:26:46 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:26:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 04:26:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8886 values 140081 bits 17510 bytes 
Fri 17 Jan 2014 04:26:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:26:54 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:26:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:26:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:26:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:26:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:26:55 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:26:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:26:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:26:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:26:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:26:55 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:26:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:26:57 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:26:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:26:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:26:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:26:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:26:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:26:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:27:00 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:27:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43863900
Fri 17 Jan 2014 04:27:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:27:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43863900
Fri 17 Jan 2014 04:27:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:27:01 - job_xml_thread(): Done retrieving: data size 43863900
Fri 17 Jan 2014 04:27:01 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:27:01 - XML: Start document: iteration 16
Fri 17 Jan 2014 04:27:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:27:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:27:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:27:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:27:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:27:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:27:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:27:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:27:14 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:27:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:27:14 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:27:14 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:27:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:27:17 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:27:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 04:27:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:27:17 - XML: Processed 655486 elements - found 644 jobs
Fri 17 Jan 2014 04:27:17 - job 7347264 report time 1389929098 does not match current heartbeat 1389929150 : ignoring job
Fri 17 Jan 2014 04:27:17 - job 7347261 report time 1389929030 does not match current heartbeat 1389929150 : ignoring job
Fri 17 Jan 2014 04:27:17 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 04:27:17 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 04:27:18 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 04:27:18 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:27:18 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:27:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:27:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:27:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:27:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:27:23 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 04:27:23 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 04:27:23 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:27:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:27:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:27:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:27:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:27:24 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:27:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43838380
Fri 17 Jan 2014 04:27:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:27:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43838380
Fri 17 Jan 2014 04:27:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:27:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:27:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:27:33 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:27:33 - job_xml_thread(): Done retrieving: data size 43838380
Fri 17 Jan 2014 04:27:33 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:27:33 - XML: Start document: iteration 17
Fri 17 Jan 2014 04:27:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:27:34 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:27:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:27:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:27:35 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:27:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:27:35 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:27:35 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:27:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:27:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:27:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:27:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:27:46 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:27:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:27:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:27:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:27:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:27:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:27:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:27:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:27:47 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:27:47 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:27:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:27:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 04:27:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 04:27:47 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:27:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5942 values 93715 bits 11714 bytes 
Fri 17 Jan 2014 04:27:48 - XML: Processed 655486 elements - found 644 jobs
Fri 17 Jan 2014 04:27:48 - job 7347264 report time 1389929098 does not match current heartbeat 1389929150 : ignoring job
Fri 17 Jan 2014 04:27:48 - job 7347261 report time 1389929030 does not match current heartbeat 1389929150 : ignoring job
Fri 17 Jan 2014 04:27:48 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 04:27:48 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 04:27:48 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:27:48 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:27:50 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:27:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43848939
Fri 17 Jan 2014 04:27:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:27:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:27:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43848939
Fri 17 Jan 2014 04:27:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:27:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:27:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:27:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:27:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:27:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:28:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:28:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:28:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:28:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43848939
Fri 17 Jan 2014 04:28:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:28:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:28:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:28:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:28:03 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:28:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:28:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:28:09 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:28:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:28:12 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:28:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:28:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:28:12 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:28:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 04:28:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:28:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:28:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:28:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:28:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:28:14 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:28:14 - job_xml_thread(): Done retrieving: data size 43848421
Fri 17 Jan 2014 04:28:14 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:28:14 - XML: Start document: iteration 18
Fri 17 Jan 2014 04:28:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43848421
Fri 17 Jan 2014 04:28:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:28:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:28:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:28:16 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:28:16 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:28:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:28:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43848421
Fri 17 Jan 2014 04:28:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:28:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:28:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:28:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:28:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:28:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:28:31 - XML: Processed 655488 elements - found 645 jobs
Fri 17 Jan 2014 04:28:31 - job 7347237 appears to have finished
Fri 17 Jan 2014 04:28:31 - job 7347264 report time 1389929098 does not match current heartbeat 1389929219 : ignoring job
Fri 17 Jan 2014 04:28:31 - job 7347265 report time 1389929150 does not match current heartbeat 1389929219 : ignoring job
Fri 17 Jan 2014 04:28:31 - job 7347266 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 04:28:31 - job 7347261 report time 1389929030 does not match current heartbeat 1389929219 : ignoring job
Fri 17 Jan 2014 04:28:31 - job 7347138 appears to have finished
Fri 17 Jan 2014 04:28:31 - job_xml_thread(): Found 6 updated jobs.
Fri 17 Jan 2014 04:28:31 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 04:28:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:28:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:28:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:28:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:28:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:28:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:28:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:28:34 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Fri 17 Jan 2014 04:28:34 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:28:34 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:28:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:28:35 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:28:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:28:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:28:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:28:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:28:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:28:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:28:37 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:28:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865801
Fri 17 Jan 2014 04:28:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:28:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43865801
Fri 17 Jan 2014 04:28:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:28:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:28:47 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:28:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:28:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:28:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:28:48 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:28:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:28:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:28:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:28:48 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:28:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 04:28:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 04:28:48 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:28:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:28:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:28:48 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:28:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:28:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8586 values 135286 bits 16910 bytes 
Fri 17 Jan 2014 04:28:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:28:49 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:28:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:28:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:28:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:28:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:28:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:28:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:28:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:28:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:28:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:28:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:28:53 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:28:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 04:28:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:28:54 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:28:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43859623
Fri 17 Jan 2014 04:28:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:28:54 - job_xml_thread(): Done retrieving: data size 43859623
Fri 17 Jan 2014 04:28:54 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:28:54 - XML: Start document: iteration 19
Fri 17 Jan 2014 04:28:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43859623
Fri 17 Jan 2014 04:28:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:29:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:29:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:29:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:29:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:29:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:29:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:29:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:29:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:29:11 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:29:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:29:11 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:29:11 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:29:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:29:16 - XML: Processed 655486 elements - found 644 jobs
Fri 17 Jan 2014 04:29:16 - job 7347264 report time 1389929098 does not match current heartbeat 1389929271 : ignoring job
Fri 17 Jan 2014 04:29:16 - job 7347265 report time 1389929150 does not match current heartbeat 1389929271 : ignoring job
Fri 17 Jan 2014 04:29:17 - job 7347268 report time 1389929219 does not match current heartbeat 1389929271 : ignoring job
Fri 17 Jan 2014 04:29:17 - job 7347269 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 04:29:17 - job 7347139 appears to have finished
Fri 17 Jan 2014 04:29:17 - job 7347135 appears to have finished
Fri 17 Jan 2014 04:29:17 - job_xml_thread(): Found 5 updated jobs.
Fri 17 Jan 2014 04:29:17 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 04:29:17 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Fri 17 Jan 2014 04:29:17 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:29:17 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:29:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:29:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:29:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:29:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:29:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:29:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:29:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:29:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:29:21 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:29:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43785324
Fri 17 Jan 2014 04:29:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:29:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43785324
Fri 17 Jan 2014 04:29:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:29:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:29:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:29:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:29:31 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:29:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:29:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:29:33 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:29:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:29:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:29:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:29:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:29:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:29:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:29:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:29:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:29:36 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:29:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:29:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:29:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:29:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:29:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:29:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:29:37 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:29:37 - job_xml_thread(): Done retrieving: data size 43306493
Fri 17 Jan 2014 04:29:37 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:29:37 - XML: Start document: iteration 20
Fri 17 Jan 2014 04:29:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43306493
Fri 17 Jan 2014 04:29:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:29:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43306493
Fri 17 Jan 2014 04:29:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:29:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:29:48 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:29:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:29:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:29:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:29:49 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:29:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 04:29:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 04:29:49 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:29:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148616 bits 18577 bytes 
Fri 17 Jan 2014 04:29:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:29:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:29:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:29:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:29:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:29:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:29:53 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:29:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:29:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:29:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:29:53 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:29:56 - XML: Processed 648722 elements - found 645 jobs
Fri 17 Jan 2014 04:29:56 - job 7347271 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 04:29:57 - job 7347270 report time 1389929271 does not match current heartbeat 1389929339 : ignoring job
Fri 17 Jan 2014 04:29:57 - job 7347265 report time 1389929150 does not match current heartbeat 1389929339 : ignoring job
Fri 17 Jan 2014 04:29:57 - job 7347268 report time 1389929219 does not match current heartbeat 1389929339 : ignoring job
Fri 17 Jan 2014 04:29:57 - job 7347134 appears to have finished
Fri 17 Jan 2014 04:29:57 - job_xml_thread(): Found 5 updated jobs.
Fri 17 Jan 2014 04:29:57 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 04:29:58 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Fri 17 Jan 2014 04:29:58 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:29:58 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:30:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:30:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:30:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:30:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:30:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:30:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:30:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:30:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:30:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:30:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43203973
Fri 17 Jan 2014 04:30:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:30:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43203973
Fri 17 Jan 2014 04:30:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:30:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:30:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:30:13 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:30:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:30:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:30:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:30:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:30:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:30:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:30:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:30:16 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:30:16 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:30:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:30:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:30:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:30:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:30:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:30:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:30:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:30:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:30:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:30:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:30:18 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:30:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 04:30:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:30:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:30:20 - job_xml_thread(): Done retrieving: data size 43249791
Fri 17 Jan 2014 04:30:20 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:30:20 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 04:30:20 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 04:30:20 - Housekeeping: done.
Fri 17 Jan 2014 04:30:20 - XML: Start document: iteration 0
Fri 17 Jan 2014 04:30:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43249791
Fri 17 Jan 2014 04:30:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:30:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43249791
Fri 17 Jan 2014 04:30:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:30:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:30:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:30:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:30:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:30:33 - XML: Processed 647866 elements - found 640 jobs
Fri 17 Jan 2014 04:30:33 - job 7347270 report time 1389929271 does not match current heartbeat 1389929339 : ignoring job
Fri 17 Jan 2014 04:30:33 - job 7347260 appears to have finished
Fri 17 Jan 2014 04:30:33 - job 7347268 report time 1389929219 does not match current heartbeat 1389929339 : ignoring job
Fri 17 Jan 2014 04:30:33 - job 7347141 appears to have finished
Fri 17 Jan 2014 04:30:33 - job 7347240 appears to have finished
Fri 17 Jan 2014 04:30:33 - job 7347235 appears to have finished
Fri 17 Jan 2014 04:30:33 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 04:30:33 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 04:30:38 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 04:30:39 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:30:39 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:30:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:30:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:30:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:30:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:30:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:30:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:30:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:30:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:30:39 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:30:39 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:30:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:30:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:30:39 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:30:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:30:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:30:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:30:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:30:40 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:30:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43801311
Fri 17 Jan 2014 04:30:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:30:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43801311
Fri 17 Jan 2014 04:30:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:30:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:30:49 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:30:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:30:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 04:30:51 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:30:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 04:30:51 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:30:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8934 values 140882 bits 17610 bytes 
Fri 17 Jan 2014 04:30:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:30:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:30:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:30:54 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:30:54 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:30:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:30:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:30:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:30:54 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:30:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:30:54 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:30:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:30:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:30:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:30:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:30:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:30:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:30:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:30:56 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:30:56 - job_xml_thread(): Done retrieving: data size 43860035
Fri 17 Jan 2014 04:30:56 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:30:56 - XML: Start document: iteration 1
Fri 17 Jan 2014 04:30:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43860035
Fri 17 Jan 2014 04:30:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:30:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43860035
Fri 17 Jan 2014 04:30:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:31:06 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 04:31:06 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:31:06 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:31:06 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 04:31:06 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:31:06 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 04:31:06 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Fri 17 Jan 2014 04:31:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:31:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:31:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:31:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:31:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:31:13 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:31:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:31:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:31:14 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:31:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:31:14 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:31:14 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:31:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:31:15 - XML: Processed 655296 elements - found 641 jobs
Fri 17 Jan 2014 04:31:15 - job 7347274 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 04:31:15 - job 7347273 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 04:31:15 - job 7347272 report time 1389929339 does not match current heartbeat 1389929391 : ignoring job
Fri 17 Jan 2014 04:31:15 - job 7347270 report time 1389929271 does not match current heartbeat 1389929391 : ignoring job
Fri 17 Jan 2014 04:31:15 - job 7347268 report time 1389929219 does not match current heartbeat 1389929391 : ignoring job
Fri 17 Jan 2014 04:31:15 - job 7343788 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 04:31:15 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 04:31:15 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 04:31:15 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 04:31:15 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:31:15 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:31:19 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:31:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 04:31:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:31:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:31:20 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:31:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:31:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:31:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:31:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:31:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:31:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:31:22 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:31:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43842308
Fri 17 Jan 2014 04:31:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:31:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43842308
Fri 17 Jan 2014 04:31:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:31:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:31:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:31:30 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:31:30 - job_xml_thread(): Done retrieving: data size 43842308
Fri 17 Jan 2014 04:31:30 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:31:31 - XML: Start document: iteration 2
Fri 17 Jan 2014 04:31:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:31:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:31:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:31:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:31:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:31:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:31:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:31:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:31:34 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:31:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:31:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:31:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:31:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:31:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:31:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:31:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:31:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:31:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:31:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:31:43 - XML: Processed 655480 elements - found 641 jobs
Fri 17 Jan 2014 04:31:43 - job 7347272 report time 1389929339 does not match current heartbeat 1389929391 : ignoring job
Fri 17 Jan 2014 04:31:43 - job 7347270 report time 1389929271 does not match current heartbeat 1389929391 : ignoring job
Fri 17 Jan 2014 04:31:44 - job 7347268 report time 1389929219 does not match current heartbeat 1389929391 : ignoring job
Fri 17 Jan 2014 04:31:44 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 04:31:44 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 04:31:44 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:31:44 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:31:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:31:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851343
Fri 17 Jan 2014 04:31:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:31:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851343
Fri 17 Jan 2014 04:31:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:31:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:31:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:31:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:31:51 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:31:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:31:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:31:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:31:52 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:31:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:31:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 04:31:52 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:31:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 04:31:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8841 values 139662 bits 17457 bytes 
Fri 17 Jan 2014 04:31:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:31:54 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:31:54 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:31:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:31:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851343
Fri 17 Jan 2014 04:31:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:31:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:31:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:31:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:31:59 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:31:59 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:32:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:32:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:32:06 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:32:06 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:32:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:32:06 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:32:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:32:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:32:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:32:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:32:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:32:07 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:32:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:32:07 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 04:32:07 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:32:07 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 04:32:07 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 04:32:08 - size of cluster 'LISA Cluster': 624 hosts 79484 metrics 858751 values 13549862 bits 1693732 bytes 
Fri 17 Jan 2014 04:32:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:32:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:32:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:32:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:32:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:32:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:32:10 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:32:10 - job_xml_thread(): Done retrieving: data size 43838438
Fri 17 Jan 2014 04:32:10 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:32:10 - XML: Start document: iteration 3
Fri 17 Jan 2014 04:32:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43838438
Fri 17 Jan 2014 04:32:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43838438
Fri 17 Jan 2014 04:32:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:32:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:32:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:32:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:32:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:32:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:32:27 - XML: Processed 655476 elements - found 639 jobs
Fri 17 Jan 2014 04:32:27 - job 7347275 report time 1389929391 does not match current heartbeat 1389929460 : ignoring job
Fri 17 Jan 2014 04:32:27 - job 7347272 report time 1389929339 does not match current heartbeat 1389929460 : ignoring job
Fri 17 Jan 2014 04:32:27 - job 7347270 report time 1389929271 does not match current heartbeat 1389929460 : ignoring job
Fri 17 Jan 2014 04:32:27 - job 7347140 appears to have finished
Fri 17 Jan 2014 04:32:27 - job 7347166 appears to have finished
Fri 17 Jan 2014 04:32:28 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 04:32:28 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 04:32:28 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 04:32:28 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:32:28 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:32:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:32:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:32:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:32:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:32:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:32:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:32:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:32:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:32:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:32:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:32:34 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:32:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:32:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:32:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:32:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:32:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:32:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:32:35 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:32:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 04:32:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:32:38 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:32:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43860851
Fri 17 Jan 2014 04:32:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:32:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43860851
Fri 17 Jan 2014 04:32:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:32:43 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:32:43 - job_xml_thread(): Done retrieving: data size 43860851
Fri 17 Jan 2014 04:32:43 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:32:43 - XML: Start document: iteration 4
Fri 17 Jan 2014 04:32:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:32:49 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:32:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:32:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:32:50 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:32:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:32:50 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:32:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:32:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:32:50 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:32:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:32:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:32:52 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:32:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:32:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 04:32:53 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:32:53 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:32:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 04:32:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5464 values 86402 bits 10800 bytes 
Fri 17 Jan 2014 04:32:58 - XML: Processed 655470 elements - found 636 jobs
Fri 17 Jan 2014 04:32:58 - job 7347276 report time 1389929460 does not match current heartbeat 1389929512 : ignoring job
Fri 17 Jan 2014 04:32:58 - job 7347275 report time 1389929391 does not match current heartbeat 1389929512 : ignoring job
Fri 17 Jan 2014 04:32:58 - job 7347272 report time 1389929339 does not match current heartbeat 1389929512 : ignoring job
Fri 17 Jan 2014 04:32:58 - job 7344747 appears to have finished
Fri 17 Jan 2014 04:32:58 - job 7347233 appears to have finished
Fri 17 Jan 2014 04:32:58 - job 7347232 appears to have finished
Fri 17 Jan 2014 04:32:58 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 04:32:58 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 04:32:58 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 04:32:58 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:32:58 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:33:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:33:01 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:33:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:33:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:33:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:33:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:33:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:33:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:33:04 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:33:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 04:33:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:33:04 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:33:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43852405
Fri 17 Jan 2014 04:33:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:33:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43852405
Fri 17 Jan 2014 04:33:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:33:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:33:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:33:07 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:33:07 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 04:33:13 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:33:13 - job_xml_thread(): Done retrieving: data size 43852405
Fri 17 Jan 2014 04:33:13 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:33:13 - XML: Start document: iteration 5
Fri 17 Jan 2014 04:33:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:33:14 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:33:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:33:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:33:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:33:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:33:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:33:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:33:15 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:33:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:33:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:33:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:33:26 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:33:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:33:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:33:27 - XML: Processed 655470 elements - found 636 jobs
Fri 17 Jan 2014 04:33:27 - job 7347276 report time 1389929460 does not match current heartbeat 1389929512 : ignoring job
Fri 17 Jan 2014 04:33:27 - job 7347275 report time 1389929391 does not match current heartbeat 1389929512 : ignoring job
Fri 17 Jan 2014 04:33:27 - job 7347272 report time 1389929339 does not match current heartbeat 1389929512 : ignoring job
Fri 17 Jan 2014 04:33:27 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 04:33:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:33:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:33:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:33:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:33:27 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 04:33:27 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:33:27 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:33:28 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 04:33:28 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 04:33:28 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:33:29 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:33:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43838457
Fri 17 Jan 2014 04:33:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:33:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:33:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:33:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43838457
Fri 17 Jan 2014 04:33:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:33:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:33:38 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:33:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:33:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:33:39 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:33:39 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:33:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:33:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:33:40 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:33:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:33:42 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:33:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:33:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:33:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:33:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:33:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:33:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:33:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:33:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:33:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:33:44 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:33:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43880894
Fri 17 Jan 2014 04:33:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:33:44 - job_xml_thread(): Done retrieving: data size 43880894
Fri 17 Jan 2014 04:33:44 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:33:44 - XML: Start document: iteration 6
Fri 17 Jan 2014 04:33:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43880894
Fri 17 Jan 2014 04:33:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:33:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:33:54 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:33:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:33:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:33:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:33:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 04:33:56 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:33:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 04:33:56 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:33:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148864 bits 18608 bytes 
Fri 17 Jan 2014 04:33:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:33:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:34:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:34:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:34:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:34:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:34:04 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:34:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:34:04 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:34:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:34:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:34:04 - XML: Processed 655468 elements - found 635 jobs
Fri 17 Jan 2014 04:34:04 - job 7347276 report time 1389929460 does not match current heartbeat 1389929580 : ignoring job
Fri 17 Jan 2014 04:34:04 - job 7347275 report time 1389929391 does not match current heartbeat 1389929580 : ignoring job
Fri 17 Jan 2014 04:34:04 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 04:34:04 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 04:34:04 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:34:04 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:34:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:34:08 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:34:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:34:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:34:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:34:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:34:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:34:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:34:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:34:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856218
Fri 17 Jan 2014 04:34:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:34:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43856218
Fri 17 Jan 2014 04:34:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:34:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:34:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:34:20 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:34:20 - job_xml_thread(): Done retrieving: data size 43856218
Fri 17 Jan 2014 04:34:20 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:34:20 - XML: Start document: iteration 7
Fri 17 Jan 2014 04:34:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:34:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:34:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:34:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:34:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:34:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:34:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:34:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:34:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:34:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:34:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:34:27 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:34:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 04:34:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:34:31 - XML: Processed 655468 elements - found 635 jobs
Fri 17 Jan 2014 04:34:31 - job 7347276 report time 1389929460 does not match current heartbeat 1389929580 : ignoring job
Fri 17 Jan 2014 04:34:31 - job 7347275 report time 1389929391 does not match current heartbeat 1389929580 : ignoring job
Fri 17 Jan 2014 04:34:31 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 04:34:31 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 04:34:31 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:34:31 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:34:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:34:34 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:34:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:34:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:34:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:34:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:34:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:34:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:34:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:34:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43842079
Fri 17 Jan 2014 04:34:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:34:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43842079
Fri 17 Jan 2014 04:34:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:34:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:34:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:34:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:34:45 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:34:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:34:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:34:46 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:34:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:34:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:34:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:34:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:34:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:34:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:34:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:34:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:34:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:34:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:34:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:34:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:34:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:34:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:34:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:34:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:34:52 - job_xml_thread(): Done retrieving: data size 43854526
Fri 17 Jan 2014 04:34:52 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:34:52 - XML: Start document: iteration 8
Fri 17 Jan 2014 04:34:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43854526
Fri 17 Jan 2014 04:34:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:34:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43854526
Fri 17 Jan 2014 04:34:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:34:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:34:56 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:34:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:34:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 04:34:57 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:34:57 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:34:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 04:34:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9027 values 142456 bits 17807 bytes 
Fri 17 Jan 2014 04:35:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:35:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:35:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:35:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:35:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:35:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:35:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:35:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:35:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:35:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:35:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:35:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:35:09 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:35:10 - XML: Processed 655464 elements - found 636 jobs
Fri 17 Jan 2014 04:35:10 - job 7347277 report time 1389929580 does not match current heartbeat 1389929633 : ignoring job
Fri 17 Jan 2014 04:35:10 - job 7347276 report time 1389929460 does not match current heartbeat 1389929633 : ignoring job
Fri 17 Jan 2014 04:35:10 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 04:35:10 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 04:35:10 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 04:35:10 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:35:11 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:35:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:35:15 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:35:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:35:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:35:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:35:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:35:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:35:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:35:17 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:35:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43798893
Fri 17 Jan 2014 04:35:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:35:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43798893
Fri 17 Jan 2014 04:35:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:35:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:35:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:35:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:35:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:35:26 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:35:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:35:26 - job_xml_thread(): Done retrieving: data size 43798893
Fri 17 Jan 2014 04:35:26 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:35:26 - XML: Start document: iteration 9
Fri 17 Jan 2014 04:35:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:35:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:35:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:35:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:35:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:35:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:35:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:35:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:35:38 - XML: Processed 654722 elements - found 636 jobs
Fri 17 Jan 2014 04:35:38 - job 7347277 report time 1389929580 does not match current heartbeat 1389929633 : ignoring job
Fri 17 Jan 2014 04:35:38 - job 7347276 report time 1389929460 does not match current heartbeat 1389929633 : ignoring job
Fri 17 Jan 2014 04:35:38 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 04:35:38 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 04:35:38 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:35:38 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:35:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:35:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:35:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:35:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:35:39 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:35:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 04:35:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:35:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:35:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:35:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:35:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:35:42 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:35:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43363590
Fri 17 Jan 2014 04:35:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:35:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43363590
Fri 17 Jan 2014 04:35:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:35:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:35:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:35:53 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:35:54 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:35:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:35:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:35:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:35:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:35:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:35:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:35:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:35:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:35:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:35:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:35:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:35:57 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:35:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:35:57 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:35:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 04:35:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 04:35:57 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:35:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5793 values 91401 bits 11425 bytes 
Fri 17 Jan 2014 04:35:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:35:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:35:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:35:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:35:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:35:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:35:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:35:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:36:00 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:36:00 - job_xml_thread(): Done retrieving: data size 43213641
Fri 17 Jan 2014 04:36:00 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:36:00 - XML: Start document: iteration 10
Fri 17 Jan 2014 04:36:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43213641
Fri 17 Jan 2014 04:36:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43213641
Fri 17 Jan 2014 04:36:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:36:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:36:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:36:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:36:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:36:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:36:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:36:14 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:36:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:36:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:36:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:36:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:36:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:36:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:36:15 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:36:20 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:36:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 04:36:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:36:20 - XML: Processed 647296 elements - found 637 jobs
Fri 17 Jan 2014 04:36:20 - job 7347277 report time 1389929580 does not match current heartbeat 1389929701 : ignoring job
Fri 17 Jan 2014 04:36:20 - job 7347279 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 04:36:20 - job 7347278 report time 1389929633 does not match current heartbeat 1389929701 : ignoring job
Fri 17 Jan 2014 04:36:20 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 04:36:20 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 04:36:22 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 04:36:22 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:36:22 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:36:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:36:24 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:36:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:36:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:36:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:36:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:36:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:36:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:36:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:36:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43242789
Fri 17 Jan 2014 04:36:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:36:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43242789
Fri 17 Jan 2014 04:36:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:36:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:36:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:36:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:36:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:36:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:36:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:36:35 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:36:35 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:36:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:36:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:36:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43242789
Fri 17 Jan 2014 04:36:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:36:37 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:36:37 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:36:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:36:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:36:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:36:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:36:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:36:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:36:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:36:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:36:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:36:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:36:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:36:45 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:36:47 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:36:47 - job_xml_thread(): Done retrieving: data size 43751556
Fri 17 Jan 2014 04:36:47 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:36:47 - XML: Start document: iteration 11
Fri 17 Jan 2014 04:36:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43751556
Fri 17 Jan 2014 04:36:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:36:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:36:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:36:51 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:36:51 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:36:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:36:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43751556
Fri 17 Jan 2014 04:36:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:36:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:36:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:36:57 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:36:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:36:58 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:36:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 04:36:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 04:36:58 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:36:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:36:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:37:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8730 values 137744 bits 17218 bytes 
Fri 17 Jan 2014 04:37:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:37:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:37:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:37:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:37:07 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:37:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:37:07 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:37:07 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:37:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:37:08 - XML: Processed 654130 elements - found 637 jobs
Fri 17 Jan 2014 04:37:08 - job 7347277 report time 1389929580 does not match current heartbeat 1389929753 : ignoring job
Fri 17 Jan 2014 04:37:08 - job 7347279 field 'start_timestamp' changed since saved from: 1389929716 to: 1389929655
Fri 17 Jan 2014 04:37:08 - job 7347278 report time 1389929633 does not match current heartbeat 1389929753 : ignoring job
Fri 17 Jan 2014 04:37:08 - job 7347281 report time 1389929701 does not match current heartbeat 1389929753 : ignoring job
Fri 17 Jan 2014 04:37:08 - job 7343789 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 04:37:08 - job 7347143 appears to have finished
Fri 17 Jan 2014 04:37:08 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 04:37:08 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 04:37:08 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 04:37:08 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:37:08 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:37:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:37:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:37:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:37:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:37:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:37:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:37:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:37:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:37:12 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:37:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 04:37:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:37:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:37:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43863530
Fri 17 Jan 2014 04:37:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:37:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43863530
Fri 17 Jan 2014 04:37:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:37:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:37:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:37:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:37:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:37:23 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:37:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:37:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:37:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:37:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:37:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:37:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:37:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:37:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:37:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:37:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:37:26 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:37:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:37:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:37:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:37:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:37:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:37:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:37:28 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:37:28 - job_xml_thread(): Done retrieving: data size 43871094
Fri 17 Jan 2014 04:37:28 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:37:28 - XML: Start document: iteration 12
Fri 17 Jan 2014 04:37:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43871094
Fri 17 Jan 2014 04:37:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43871094
Fri 17 Jan 2014 04:37:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:37:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:37:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:37:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:37:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:37:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:37:45 - XML: Processed 655463 elements - found 634 jobs
Fri 17 Jan 2014 04:37:45 - job 7347278 report time 1389929633 does not match current heartbeat 1389929753 : ignoring job
Fri 17 Jan 2014 04:37:45 - job 7346018 appears to have finished
Fri 17 Jan 2014 04:37:45 - job 7347281 report time 1389929701 does not match current heartbeat 1389929753 : ignoring job
Fri 17 Jan 2014 04:37:45 - job 7347236 appears to have finished
Fri 17 Jan 2014 04:37:45 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 04:37:45 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 04:37:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:37:48 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:37:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:37:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:37:49 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 04:37:49 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:37:49 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:37:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:37:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:37:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:37:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:37:49 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:37:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:37:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:37:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:37:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:37:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:37:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:37:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:37:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:37:53 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:37:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862163
Fri 17 Jan 2014 04:37:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:37:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862163
Fri 17 Jan 2014 04:37:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:37:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:37:58 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:38:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:38:02 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:38:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 04:38:02 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:38:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 04:38:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148745 bits 18593 bytes 
Fri 17 Jan 2014 04:38:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:38:03 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:38:04 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:38:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:38:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:38:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:38:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:38:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:38:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:38:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:38:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:38:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:38:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:38:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:38:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:38:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:38:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:38:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:38:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:38:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:38:09 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:38:09 - job_xml_thread(): Done retrieving: data size 43854177
Fri 17 Jan 2014 04:38:09 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:38:09 - XML: Start document: iteration 13
Fri 17 Jan 2014 04:38:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43854177
Fri 17 Jan 2014 04:38:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:38:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43854177
Fri 17 Jan 2014 04:38:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:38:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:38:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:38:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:38:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:38:26 - XML: Processed 655466 elements - found 634 jobs
Fri 17 Jan 2014 04:38:26 - job 7347278 report time 1389929633 does not match current heartbeat 1389929822 : ignoring job
Fri 17 Jan 2014 04:38:26 - job 7347281 report time 1389929701 does not match current heartbeat 1389929822 : ignoring job
Fri 17 Jan 2014 04:38:27 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 04:38:27 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 04:38:27 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:38:27 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:38:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:38:27 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:38:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:38:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:38:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:38:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:38:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:38:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:38:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:38:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:38:32 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:38:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:38:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:38:33 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:38:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 04:38:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:38:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:38:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:38:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:38:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:38:34 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:38:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43872498
Fri 17 Jan 2014 04:38:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:38:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43872498
Fri 17 Jan 2014 04:38:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:38:42 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:38:42 - job_xml_thread(): Done retrieving: data size 43872498
Fri 17 Jan 2014 04:38:42 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:38:42 - XML: Start document: iteration 14
Fri 17 Jan 2014 04:38:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:38:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:38:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:38:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:38:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:38:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:38:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:38:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:38:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:38:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:38:48 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:38:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:38:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:38:53 - XML: Processed 655464 elements - found 633 jobs
Fri 17 Jan 2014 04:38:53 - job 7347282 report time 1389929822 does not match current heartbeat 1389929874 : ignoring job
Fri 17 Jan 2014 04:38:53 - job 7347281 report time 1389929701 does not match current heartbeat 1389929874 : ignoring job
Fri 17 Jan 2014 04:38:53 - job 7347239 appears to have finished
Fri 17 Jan 2014 04:38:53 - job 7335061 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 04:38:53 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 04:38:53 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 04:38:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:38:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:38:56 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 04:38:56 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:38:56 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:38:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:38:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:38:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:38:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:38:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:38:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:38:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:38:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853334
Fri 17 Jan 2014 04:38:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:38:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853334
Fri 17 Jan 2014 04:38:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:39:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:39:02 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:39:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:39:03 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:39:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 04:39:03 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:39:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8811 values 138970 bits 17371 bytes 
Fri 17 Jan 2014 04:39:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 04:39:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:39:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:39:07 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 04:39:07 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:39:08 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:39:08 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:39:08 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 04:39:08 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 04:39:08 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 04:39:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:39:09 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:39:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:39:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:39:10 - size of cluster 'LISA Cluster': 624 hosts 79472 metrics 943128 values 14887040 bits 1860880 bytes 
Fri 17 Jan 2014 04:39:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:39:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:39:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:39:10 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:39:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:39:11 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:39:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:39:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:39:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:39:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:39:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:39:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:39:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:39:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:39:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:39:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:39:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:39:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43866080
Fri 17 Jan 2014 04:39:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:39:18 - job_xml_thread(): Done retrieving: data size 43866080
Fri 17 Jan 2014 04:39:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43866080
Fri 17 Jan 2014 04:39:18 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:39:18 - XML: Start document: iteration 15
Fri 17 Jan 2014 04:39:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:39:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:39:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:39:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:39:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:39:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:39:31 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:39:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:39:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:39:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:39:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:39:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:39:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:39:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:39:35 - XML: Processed 655464 elements - found 633 jobs
Fri 17 Jan 2014 04:39:35 - job 7347282 report time 1389929822 does not match current heartbeat 1389929874 : ignoring job
Fri 17 Jan 2014 04:39:35 - job 7347281 report time 1389929701 does not match current heartbeat 1389929874 : ignoring job
Fri 17 Jan 2014 04:39:35 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 04:39:35 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 04:39:35 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:39:35 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:39:39 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:39:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 04:39:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:39:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:39:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:39:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:39:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:39:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:39:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:39:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:39:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:39:44 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:39:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851741
Fri 17 Jan 2014 04:39:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:39:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851741
Fri 17 Jan 2014 04:39:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:39:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:39:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:39:50 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:39:50 - job_xml_thread(): Done retrieving: data size 43851741
Fri 17 Jan 2014 04:39:50 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:39:50 - XML: Start document: iteration 16
Fri 17 Jan 2014 04:39:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:39:56 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:39:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:39:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:39:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:39:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:39:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:39:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:39:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:39:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:39:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:40:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:40:03 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:40:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:40:04 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:40:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 04:40:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 04:40:05 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:40:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5715 values 90142 bits 11267 bytes 
Fri 17 Jan 2014 04:40:07 - XML: Processed 655462 elements - found 632 jobs
Fri 17 Jan 2014 04:40:07 - job 7347282 report time 1389929822 does not match current heartbeat 1389929942 : ignoring job
Fri 17 Jan 2014 04:40:07 - job 7347283 report time 1389929874 does not match current heartbeat 1389929942 : ignoring job
Fri 17 Jan 2014 04:40:07 - job 7335061 field 'start_timestamp' changed since saved from: 1389929900 to: 1389929838
Fri 17 Jan 2014 04:40:07 - job 7346266 appears to have finished
Fri 17 Jan 2014 04:40:07 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 04:40:07 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 04:40:08 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:40:08 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 04:40:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:40:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:40:09 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 04:40:09 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:40:09 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:40:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:40:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:40:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:40:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:40:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:40:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:40:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:40:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:40:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:40:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43827292
Fri 17 Jan 2014 04:40:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:40:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43827292
Fri 17 Jan 2014 04:40:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:40:24 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:40:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:40:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:40:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:40:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:40:25 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:40:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:40:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:40:26 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:40:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:40:26 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:40:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:40:28 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:40:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 04:40:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:40:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:40:30 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:40:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:40:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:40:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:40:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:40:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:40:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:40:33 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:40:33 - job_xml_thread(): Done retrieving: data size 43862086
Fri 17 Jan 2014 04:40:33 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:40:33 - XML: Start document: iteration 17
Fri 17 Jan 2014 04:40:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862086
Fri 17 Jan 2014 04:40:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862086
Fri 17 Jan 2014 04:40:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:40:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:40:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:40:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:40:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:40:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:40:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:40:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:40:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:40:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:40:44 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:40:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:40:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:40:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:40:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:40:52 - XML: Processed 655464 elements - found 633 jobs
Fri 17 Jan 2014 04:40:52 - job 7347282 report time 1389929822 does not match current heartbeat 1389929994 : ignoring job
Fri 17 Jan 2014 04:40:52 - job 7347283 report time 1389929874 does not match current heartbeat 1389929994 : ignoring job
Fri 17 Jan 2014 04:40:52 - job 7347284 report time 1389929942 does not match current heartbeat 1389929994 : ignoring job
Fri 17 Jan 2014 04:40:52 - job 7336649 appears to have finished
Fri 17 Jan 2014 04:40:52 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 04:40:52 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 04:40:53 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 04:40:53 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:40:53 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:40:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:40:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:40:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:40:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:40:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:40:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:40:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:40:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:40:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:40:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:40:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:40:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43839218
Fri 17 Jan 2014 04:40:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:41:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43839218
Fri 17 Jan 2014 04:41:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:41:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:41:04 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:41:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:41:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 04:41:05 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:41:05 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:41:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9007 values 142132 bits 17766 bytes 
Fri 17 Jan 2014 04:41:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 04:41:08 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:41:08 - job_xml_thread(): Done retrieving: data size 43839218
Fri 17 Jan 2014 04:41:08 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:41:08 - XML: Start document: iteration 18
Fri 17 Jan 2014 04:41:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:41:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:41:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:41:16 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:41:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:41:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:41:17 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:41:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:41:17 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:41:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:41:17 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:41:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:41:23 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:41:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:41:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:41:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:41:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:41:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:41:24 - XML: Processed 655464 elements - found 633 jobs
Fri 17 Jan 2014 04:41:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:41:24 - job 7347282 report time 1389929822 does not match current heartbeat 1389929994 : ignoring job
Fri 17 Jan 2014 04:41:24 - job 7347283 report time 1389929874 does not match current heartbeat 1389929994 : ignoring job
Fri 17 Jan 2014 04:41:24 - job 7347284 report time 1389929942 does not match current heartbeat 1389929994 : ignoring job
Fri 17 Jan 2014 04:41:24 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 04:41:24 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 04:41:24 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:41:24 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:41:28 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:41:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43781213
Fri 17 Jan 2014 04:41:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:41:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43781213
Fri 17 Jan 2014 04:41:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:41:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:41:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:41:39 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:41:39 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:41:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:41:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:41:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:41:41 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:41:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:41:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:41:42 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:41:42 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:41:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:41:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:41:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:41:45 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:41:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:41:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:41:45 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:41:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 04:41:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:41:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:41:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:41:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:41:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:41:48 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:41:48 - job_xml_thread(): Done retrieving: data size 43276093
Fri 17 Jan 2014 04:41:48 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:41:48 - XML: Start document: iteration 19
Fri 17 Jan 2014 04:41:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43276093
Fri 17 Jan 2014 04:41:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43276093
Fri 17 Jan 2014 04:41:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:41:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:41:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:41:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:42:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:42:00 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:42:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:42:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:42:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:42:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:42:01 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:42:01 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:42:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:42:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:42:01 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:42:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:42:05 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:42:06 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:42:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 04:42:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:42:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 04:42:06 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:42:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5711 values 90038 bits 11254 bytes 
Fri 17 Jan 2014 04:42:09 - XML: Processed 648204 elements - found 632 jobs
Fri 17 Jan 2014 04:42:09 - job 7347283 report time 1389929874 does not match current heartbeat 1389930063 : ignoring job
Fri 17 Jan 2014 04:42:09 - job 7347284 report time 1389929942 does not match current heartbeat 1389930063 : ignoring job
Fri 17 Jan 2014 04:42:09 - job 7347137 appears to have finished
Fri 17 Jan 2014 04:42:09 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 04:42:09 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 04:42:09 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 04:42:09 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:42:10 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:42:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:42:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:42:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:42:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:42:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:42:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:42:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:42:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:42:15 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:42:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43181542
Fri 17 Jan 2014 04:42:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:42:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43181542
Fri 17 Jan 2014 04:42:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:42:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:42:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:42:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:42:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:42:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:42:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:42:25 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:42:25 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:42:25 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:42:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:42:25 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:42:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:42:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:42:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:42:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:42:31 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:42:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:42:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:42:31 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:42:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 04:42:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:42:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:42:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:42:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:42:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:42:33 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 04:42:33 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 04:42:33 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:42:34 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:42:34 - job_xml_thread(): Done retrieving: data size 43501335
Fri 17 Jan 2014 04:42:34 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:42:34 - XML: Start document: iteration 20
Fri 17 Jan 2014 04:42:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43501335
Fri 17 Jan 2014 04:42:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43501335
Fri 17 Jan 2014 04:42:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:42:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:42:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:42:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:42:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:42:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:42:51 - XML: Processed 651112 elements - found 631 jobs
Fri 17 Jan 2014 04:42:51 - job 7347284 report time 1389929942 does not match current heartbeat 1389930063 : ignoring job
Fri 17 Jan 2014 04:42:51 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 04:42:51 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 04:42:51 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:42:51 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:42:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:42:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:42:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:42:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:42:54 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:42:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:42:54 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:42:54 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:42:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:42:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:42:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:42:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:42:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:42:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:42:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:42:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:42:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:43:00 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:43:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43864031
Fri 17 Jan 2014 04:43:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:43:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43864031
Fri 17 Jan 2014 04:43:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:43:06 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:43:06 - job_xml_thread(): Done retrieving: data size 43864031
Fri 17 Jan 2014 04:43:06 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:43:06 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 04:43:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:43:07 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:43:07 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 04:43:07 - Housekeeping: done.
Fri 17 Jan 2014 04:43:07 - XML: Start document: iteration 0
Fri 17 Jan 2014 04:43:08 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:43:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 04:43:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:43:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 04:43:08 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:43:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8840 values 139436 bits 17429 bytes 
Fri 17 Jan 2014 04:43:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:43:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:43:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:43:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:43:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:43:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:43:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:43:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:43:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:43:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:43:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:43:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:43:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:43:21 - XML: Processed 655338 elements - found 632 jobs
Fri 17 Jan 2014 04:43:21 - job 7347284 report time 1389929942 does not match current heartbeat 1389930115 : ignoring job
Fri 17 Jan 2014 04:43:21 - job 7347287 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 04:43:21 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 04:43:21 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 04:43:21 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 04:43:21 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:43:21 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:43:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:43:24 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:43:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:43:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:43:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:43:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:43:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:43:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:43:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:43:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43828660
Fri 17 Jan 2014 04:43:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:43:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43828660
Fri 17 Jan 2014 04:43:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:43:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:43:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:43:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:43:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:43:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:43:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:43:36 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:43:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:43:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:43:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:43:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:43:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:43:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:43:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:43:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:43:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:43:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:43:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:43:40 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:43:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 04:43:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:43:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:43:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:43:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:43:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:43:41 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:43:41 - job_xml_thread(): Done retrieving: data size 43857189
Fri 17 Jan 2014 04:43:41 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:43:41 - XML: Start document: iteration 1
Fri 17 Jan 2014 04:43:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43857189
Fri 17 Jan 2014 04:43:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:43:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43857189
Fri 17 Jan 2014 04:43:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:43:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:43:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:43:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:43:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:43:54 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:43:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:43:54 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:43:54 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:43:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:43:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:43:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:43:59 - XML: Processed 655458 elements - found 630 jobs
Fri 17 Jan 2014 04:43:59 - job 7347245 appears to have finished
Fri 17 Jan 2014 04:43:59 - job 7347288 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 04:43:59 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 04:43:59 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 04:43:59 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 04:43:59 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:43:59 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:44:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:44:03 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:44:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:44:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:44:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:44:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:44:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:44:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:44:04 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:44:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43849292
Fri 17 Jan 2014 04:44:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:44:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43849292
Fri 17 Jan 2014 04:44:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:44:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:44:08 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:44:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:44:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 04:44:08 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:44:08 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:44:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 04:44:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:44:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:44:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8933 values 140855 bits 17606 bytes 
Fri 17 Jan 2014 04:44:14 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:44:14 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:44:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:44:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:44:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:44:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:44:17 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:44:17 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:44:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:44:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:44:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:44:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:44:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:44:19 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:44:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:44:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:44:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:44:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:44:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:44:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:44:21 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:44:21 - job_xml_thread(): Done retrieving: data size 43842913
Fri 17 Jan 2014 04:44:21 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:44:21 - XML: Start document: iteration 2
Fri 17 Jan 2014 04:44:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43842913
Fri 17 Jan 2014 04:44:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:44:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43842913
Fri 17 Jan 2014 04:44:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:44:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:44:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:44:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:44:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:44:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:44:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:44:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:44:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:44:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:44:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:44:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:44:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:44:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:44:41 - XML: Processed 655458 elements - found 630 jobs
Fri 17 Jan 2014 04:44:42 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 04:44:42 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 04:44:42 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:44:42 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:44:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:44:44 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:44:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:44:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:44:45 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:44:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 04:44:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:44:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:44:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:44:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:44:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:44:46 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:44:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43889996
Fri 17 Jan 2014 04:44:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:44:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43889996
Fri 17 Jan 2014 04:44:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:44:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:44:56 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:44:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:44:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:44:57 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:44:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:44:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:44:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:44:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:44:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:45:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:45:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:45:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:45:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:45:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:45:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:45:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:45:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:45:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:45:02 - job_xml_thread(): Done retrieving: data size 43889718
Fri 17 Jan 2014 04:45:02 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:45:02 - XML: Start document: iteration 3
Fri 17 Jan 2014 04:45:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43889718
Fri 17 Jan 2014 04:45:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:45:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43889718
Fri 17 Jan 2014 04:45:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:45:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:45:09 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:45:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:45:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 04:45:11 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:45:11 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:45:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 04:45:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8837 values 139343 bits 17417 bytes 
Fri 17 Jan 2014 04:45:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:45:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:45:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:45:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:45:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:45:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:45:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:45:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:45:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:45:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:45:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:45:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:45:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:45:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:45:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:45:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:45:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:45:23 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:45:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:45:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:45:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:45:24 - XML: Processed 655462 elements - found 632 jobs
Fri 17 Jan 2014 04:45:24 - job 7347238 appears to have finished
Fri 17 Jan 2014 04:45:24 - job 7347286 report time 1389930184 does not match current heartbeat 1389930236 : ignoring job
Fri 17 Jan 2014 04:45:24 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 04:45:24 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 04:45:25 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 04:45:25 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:45:25 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:45:26 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:45:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43846176
Fri 17 Jan 2014 04:45:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:45:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43846176
Fri 17 Jan 2014 04:45:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:45:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:45:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:45:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:45:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:45:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:45:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:45:39 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:45:39 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:45:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:45:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:45:39 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:45:40 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:45:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:45:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:45:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:45:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:45:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:45:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:45:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:45:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:45:41 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:45:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 04:45:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:45:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:45:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43871306
Fri 17 Jan 2014 04:45:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:45:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43871306
Fri 17 Jan 2014 04:45:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:45:44 - job_xml_thread(): Done retrieving: data size 43871306
Fri 17 Jan 2014 04:45:44 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:45:44 - XML: Start document: iteration 4
Fri 17 Jan 2014 04:45:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:45:53 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:45:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:45:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:45:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:45:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:45:55 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:45:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:45:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:45:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:45:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:45:59 - XML: Processed 655464 elements - found 633 jobs
Fri 17 Jan 2014 04:45:59 - job 7347286 report time 1389930184 does not match current heartbeat 1389930304 : ignoring job
Fri 17 Jan 2014 04:45:59 - job 7347291 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 04:45:59 - job 7347290 report time 1389930236 does not match current heartbeat 1389930304 : ignoring job
Fri 17 Jan 2014 04:45:59 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 04:45:59 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 04:45:59 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 04:45:59 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:45:59 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:46:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:46:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:46:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:46:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:46:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:46:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:46:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:46:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:46:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:46:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43850932
Fri 17 Jan 2014 04:46:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:46:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43850932
Fri 17 Jan 2014 04:46:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:46:08 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 04:46:08 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:46:09 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:46:09 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 04:46:09 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:46:09 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 04:46:09 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 04:46:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:46:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:46:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:46:12 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:46:14 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:46:14 - job_xml_thread(): Done retrieving: data size 43850932
Fri 17 Jan 2014 04:46:14 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:46:14 - XML: Start document: iteration 5
Fri 17 Jan 2014 04:46:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:46:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 04:46:15 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:46:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 04:46:15 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:46:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8670 values 136726 bits 17090 bytes 
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Fri 17 Jan 2014 04:46:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:46:19 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:46:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:46:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:46:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:46:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:46:20 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:46:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:46:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:46:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:46:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:46:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:46:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:46:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:46:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:46:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:46:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:46:27 - XML: Processed 655464 elements - found 633 jobs
Fri 17 Jan 2014 04:46:27 - job 7347286 report time 1389930184 does not match current heartbeat 1389930304 : ignoring job
Fri 17 Jan 2014 04:46:27 - job 7347290 report time 1389930236 does not match current heartbeat 1389930304 : ignoring job
Fri 17 Jan 2014 04:46:27 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 04:46:27 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 04:46:27 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:46:27 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:46:29 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:46:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855850
Fri 17 Jan 2014 04:46:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:46:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855850
Fri 17 Jan 2014 04:46:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:46:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:46:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:46:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:46:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:46:42 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:46:42 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:46:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:46:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:46:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:46:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:46:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:46:44 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:46:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:46:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:46:45 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:46:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 04:46:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:46:45 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:46:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:46:45 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:46:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:46:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:46:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:46:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:46:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:46:47 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:46:47 - job_xml_thread(): Done retrieving: data size 43890811
Fri 17 Jan 2014 04:46:47 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:46:47 - XML: Start document: iteration 6
Fri 17 Jan 2014 04:46:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43890811
Fri 17 Jan 2014 04:46:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43890811
Fri 17 Jan 2014 04:46:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:46:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:46:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:46:58 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:47:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:47:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:47:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:47:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:47:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:47:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:47:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:47:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:47:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:47:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:47:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:47:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:47:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:47:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:47:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:47:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:47:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:47:09 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:47:09 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:47:09 - XML: Processed 655466 elements - found 634 jobs
Fri 17 Jan 2014 04:47:09 - job 7347286 report time 1389930184 does not match current heartbeat 1389930356 : ignoring job
Fri 17 Jan 2014 04:47:09 - job 7343920 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 04:47:09 - job 7347251 appears to have finished
Fri 17 Jan 2014 04:47:09 - job 7347292 report time 1389930304 does not match current heartbeat 1389930356 : ignoring job
Fri 17 Jan 2014 04:47:09 - job 7347291 field 'start_timestamp' changed since saved from: 1389930325 to: 1389930271
Fri 17 Jan 2014 04:47:09 - job 7347290 report time 1389930236 does not match current heartbeat 1389930356 : ignoring job
Fri 17 Jan 2014 04:47:09 - job_xml_thread(): Found 5 updated jobs.
Fri 17 Jan 2014 04:47:09 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 04:47:09 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Fri 17 Jan 2014 04:47:09 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:47:09 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:47:09 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:47:09 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:47:09 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 04:47:09 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 04:47:09 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 04:47:10 - size of cluster 'LISA Cluster': 624 hosts 79483 metrics 945840 values 14922829 bits 1865353 bytes 
Fri 17 Jan 2014 04:47:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:47:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43787027
Fri 17 Jan 2014 04:47:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:47:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43787027
Fri 17 Jan 2014 04:47:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:47:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:47:17 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:47:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:47:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:47:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:47:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 04:47:18 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:47:18 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:47:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 04:47:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9033 values 142857 bits 17857 bytes 
Fri 17 Jan 2014 04:47:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:47:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:47:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:47:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:47:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:47:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:47:24 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:47:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:47:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:47:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:47:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:47:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:47:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:47:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:47:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:47:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:47:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:47:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:47:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:47:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:47:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:47:32 - job_xml_thread(): Done retrieving: data size 43793421
Fri 17 Jan 2014 04:47:32 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:47:32 - XML: Start document: iteration 7
Fri 17 Jan 2014 04:47:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43793421
Fri 17 Jan 2014 04:47:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:47:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43793421
Fri 17 Jan 2014 04:47:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:47:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:47:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:47:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:47:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:47:50 - XML: Processed 654572 elements - found 634 jobs
Fri 17 Jan 2014 04:47:50 - job 7347286 report time 1389930184 does not match current heartbeat 1389930356 : ignoring job
Fri 17 Jan 2014 04:47:50 - job 7347292 report time 1389930304 does not match current heartbeat 1389930356 : ignoring job
Fri 17 Jan 2014 04:47:50 - job 7347290 report time 1389930236 does not match current heartbeat 1389930356 : ignoring job
Fri 17 Jan 2014 04:47:50 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 04:47:50 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 04:47:50 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:47:50 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:47:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:47:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:47:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:47:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:47:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:47:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:47:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:47:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:47:52 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:47:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:47:57 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:47:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:47:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:47:57 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:47:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 04:47:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:47:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:47:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:47:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:47:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:48:00 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:48:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43209293
Fri 17 Jan 2014 04:48:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:48:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43209293
Fri 17 Jan 2014 04:48:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:48:06 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:48:07 - job_xml_thread(): Done retrieving: data size 43209293
Fri 17 Jan 2014 04:48:07 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:48:07 - XML: Start document: iteration 8
Fri 17 Jan 2014 04:48:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:48:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:48:10 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:48:10 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 04:48:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:48:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:48:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:48:14 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:48:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:48:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:48:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:48:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:48:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:48:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:48:16 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:48:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:48:18 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:48:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:48:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 04:48:20 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:48:20 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:48:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 04:48:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5678 values 89789 bits 11223 bytes 
Fri 17 Jan 2014 04:48:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:48:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:48:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:48:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:48:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:48:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:48:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:48:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:48:23 - XML: Processed 647292 elements - found 632 jobs
Fri 17 Jan 2014 04:48:23 - job 7347248 appears to have finished
Fri 17 Jan 2014 04:48:23 - job 7347213 appears to have finished
Fri 17 Jan 2014 04:48:23 - job 7347293 field 'start_timestamp' changed since saved from: 1389930374 to: 1389930332
Fri 17 Jan 2014 04:48:23 - job 7347292 report time 1389930304 does not match current heartbeat 1389930425 : ignoring job
Fri 17 Jan 2014 04:48:23 - job 7347294 report time 1389930356 does not match current heartbeat 1389930425 : ignoring job
Fri 17 Jan 2014 04:48:23 - job 7347290 report time 1389930236 does not match current heartbeat 1389930425 : ignoring job
Fri 17 Jan 2014 04:48:23 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 04:48:23 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 04:48:23 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 04:48:23 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:48:23 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:48:27 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:48:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43246737
Fri 17 Jan 2014 04:48:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:48:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43246737
Fri 17 Jan 2014 04:48:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:48:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:48:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:48:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:48:36 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:48:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:48:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:48:37 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:48:37 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:48:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:48:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43246737
Fri 17 Jan 2014 04:48:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:48:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:48:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:48:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:48:38 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:48:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:48:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:48:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:48:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:48:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:48:51 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:48:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 04:48:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:48:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:48:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:48:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:48:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:48:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:48:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:48:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:48:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:48:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:48:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:48:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:48:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:48:53 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:48:53 - job_xml_thread(): Done retrieving: data size 43804223
Fri 17 Jan 2014 04:48:53 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:48:53 - XML: Start document: iteration 9
Fri 17 Jan 2014 04:48:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43804223
Fri 17 Jan 2014 04:48:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43804223
Fri 17 Jan 2014 04:48:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:48:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:49:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:49:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:49:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:49:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:49:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:49:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:49:08 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:49:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:49:08 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:49:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:49:08 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:49:14 - XML: Processed 655209 elements - found 630 jobs
Fri 17 Jan 2014 04:49:15 - job 7345981 appears to have finished
Fri 17 Jan 2014 04:49:15 - job 7347292 report time 1389930304 does not match current heartbeat 1389930477 : ignoring job
Fri 17 Jan 2014 04:49:15 - job 7347294 report time 1389930356 does not match current heartbeat 1389930477 : ignoring job
Fri 17 Jan 2014 04:49:15 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 04:49:15 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 04:49:15 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 04:49:15 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:49:15 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:49:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:49:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:49:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:49:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:49:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:49:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:49:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:49:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:49:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:49:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43838783
Fri 17 Jan 2014 04:49:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:49:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:49:20 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:49:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43838783
Fri 17 Jan 2014 04:49:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:49:21 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:49:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 04:49:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:49:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 04:49:22 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:49:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8853 values 139723 bits 17465 bytes 
Fri 17 Jan 2014 04:49:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:49:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:49:30 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:49:30 - job_xml_thread(): Done retrieving: data size 43838783
Fri 17 Jan 2014 04:49:30 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:49:30 - XML: Start document: iteration 10
Fri 17 Jan 2014 04:49:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:49:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:49:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:49:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:49:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:49:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:49:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:49:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:49:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:49:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:49:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:49:44 - XML: Processed 655458 elements - found 630 jobs
Fri 17 Jan 2014 04:49:44 - job 7347292 report time 1389930304 does not match current heartbeat 1389930477 : ignoring job
Fri 17 Jan 2014 04:49:44 - job 7347294 report time 1389930356 does not match current heartbeat 1389930477 : ignoring job
Fri 17 Jan 2014 04:49:44 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 04:49:44 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 04:49:44 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:49:44 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:49:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:49:44 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:49:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:49:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:49:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:49:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:49:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:49:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:49:45 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 04:49:45 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 04:49:45 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:49:47 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:49:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43849406
Fri 17 Jan 2014 04:49:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:49:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43849406
Fri 17 Jan 2014 04:49:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:49:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:49:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:49:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:49:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:49:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:49:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:49:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:49:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:49:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:49:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:49:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:49:59 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:50:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:50:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:50:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:50:01 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:50:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:50:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:50:01 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:50:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 04:50:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:50:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:50:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:50:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:50:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:50:03 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:50:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856647
Fri 17 Jan 2014 04:50:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:50:03 - job_xml_thread(): Done retrieving: data size 43856647
Fri 17 Jan 2014 04:50:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43856647
Fri 17 Jan 2014 04:50:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:50:03 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:50:03 - XML: Start document: iteration 11
Fri 17 Jan 2014 04:50:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:50:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:50:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:50:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:50:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:50:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:50:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:50:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:50:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:50:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:50:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:50:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:50:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:50:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:50:22 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:50:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:50:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 04:50:22 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:50:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5761 values 90864 bits 11358 bytes 
Fri 17 Jan 2014 04:50:22 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:50:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 04:50:25 - XML: Processed 655458 elements - found 630 jobs
Fri 17 Jan 2014 04:50:25 - job 7347255 appears to have finished
Fri 17 Jan 2014 04:50:25 - job 7347295 report time 1389930477 does not match current heartbeat 1389930545 : ignoring job
Fri 17 Jan 2014 04:50:25 - job 7347294 report time 1389930356 does not match current heartbeat 1389930545 : ignoring job
Fri 17 Jan 2014 04:50:25 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 04:50:25 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 04:50:26 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 04:50:26 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:50:26 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:50:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:50:27 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:50:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:50:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:50:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:50:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:50:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:50:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:50:29 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:50:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43859071
Fri 17 Jan 2014 04:50:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:50:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43859071
Fri 17 Jan 2014 04:50:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:50:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:50:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:50:33 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:50:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 04:50:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:50:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:50:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:50:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:50:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:50:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:50:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:50:40 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:50:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:50:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:50:42 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:50:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:50:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:50:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:50:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:50:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:50:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:50:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:50:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:50:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:50:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:50:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:50:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43888134
Fri 17 Jan 2014 04:50:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:50:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43888134
Fri 17 Jan 2014 04:50:45 - job_xml_thread(): Done retrieving: data size 43888134
Fri 17 Jan 2014 04:50:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:50:45 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:50:45 - XML: Start document: iteration 12
Fri 17 Jan 2014 04:50:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:50:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:50:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:50:58 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:50:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:50:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:50:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:50:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:50:59 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:50:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:50:59 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:50:59 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:51:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:51:05 - XML: Processed 655456 elements - found 629 jobs
Fri 17 Jan 2014 04:51:05 - job 7347295 report time 1389930477 does not match current heartbeat 1389930597 : ignoring job
Fri 17 Jan 2014 04:51:05 - job 7347297 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 04:51:05 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 04:51:05 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 04:51:05 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 04:51:05 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:51:05 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:51:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:51:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:51:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:51:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:51:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:51:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:51:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:51:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:51:09 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:51:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43843351
Fri 17 Jan 2014 04:51:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:51:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43843351
Fri 17 Jan 2014 04:51:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:51:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:51:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:51:20 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:51:20 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:51:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:51:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:51:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:51:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:51:22 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:51:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:51:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:51:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:51:23 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:51:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:51:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:51:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:51:23 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:51:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 04:51:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:51:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 04:51:24 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:51:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9342 values 147385 bits 18423 bytes 
Fri 17 Jan 2014 04:51:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:51:24 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:51:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:51:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:51:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:51:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:51:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:51:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:51:27 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:51:27 - job_xml_thread(): Done retrieving: data size 43867132
Fri 17 Jan 2014 04:51:27 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:51:27 - XML: Start document: iteration 13
Fri 17 Jan 2014 04:51:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867132
Fri 17 Jan 2014 04:51:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:51:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43867132
Fri 17 Jan 2014 04:51:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:51:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:51:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:51:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:51:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:51:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:51:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:51:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:51:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:51:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:51:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:51:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:51:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:51:44 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:51:45 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:51:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 04:51:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:51:48 - XML: Processed 655456 elements - found 629 jobs
Fri 17 Jan 2014 04:51:48 - job 7347295 report time 1389930477 does not match current heartbeat 1389930597 : ignoring job
Fri 17 Jan 2014 04:51:48 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 04:51:48 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 04:51:48 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:51:48 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:51:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:51:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:51:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:51:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:51:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:51:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:51:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:51:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:51:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:51:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43846539
Fri 17 Jan 2014 04:51:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:51:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43846539
Fri 17 Jan 2014 04:51:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:51:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:51:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:52:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:52:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:52:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:52:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:52:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:52:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:52:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:52:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:52:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:52:04 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:52:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:52:06 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:52:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:52:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:52:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:52:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:52:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:52:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:52:08 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:52:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856532
Fri 17 Jan 2014 04:52:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:52:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43856532
Fri 17 Jan 2014 04:52:09 - job_xml_thread(): Done retrieving: data size 43856532
Fri 17 Jan 2014 04:52:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:52:09 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:52:09 - XML: Start document: iteration 14
Fri 17 Jan 2014 04:52:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:52:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:52:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:52:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:52:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:52:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:52:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:52:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:52:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:52:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:52:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:52:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:52:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:52:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:52:24 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:52:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:52:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 04:52:25 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:52:25 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:52:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 04:52:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9283 values 146472 bits 18309 bytes 
Fri 17 Jan 2014 04:52:26 - XML: Processed 655454 elements - found 628 jobs
Fri 17 Jan 2014 04:52:26 - job 7344973 appears to have finished
Fri 17 Jan 2014 04:52:26 - job 7347295 report time 1389930477 does not match current heartbeat 1389930666 : ignoring job
Fri 17 Jan 2014 04:52:26 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 04:52:26 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 04:52:26 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 04:52:26 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:52:26 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:52:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:52:30 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:52:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:52:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:52:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:52:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:52:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:52:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:52:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:52:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862225
Fri 17 Jan 2014 04:52:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:52:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862225
Fri 17 Jan 2014 04:52:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:52:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:52:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:52:41 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:52:41 - job_xml_thread(): Done retrieving: data size 43862225
Fri 17 Jan 2014 04:52:41 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:52:41 - XML: Start document: iteration 15
Fri 17 Jan 2014 04:52:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:52:45 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:52:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:52:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:52:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:52:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:52:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:52:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:52:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:52:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:52:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:52:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:52:55 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:52:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:52:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:52:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:52:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:52:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:52:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:52:56 - XML: Processed 655450 elements - found 626 jobs
Fri 17 Jan 2014 04:52:56 - job 7347289 appears to have finished
Fri 17 Jan 2014 04:52:56 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 04:52:56 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 04:52:56 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 04:52:56 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:52:56 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:52:57 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:52:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 04:52:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:52:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:52:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43846358
Fri 17 Jan 2014 04:52:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:52:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43846358
Fri 17 Jan 2014 04:52:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:53:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:53:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:53:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:53:09 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:53:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:53:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:53:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:53:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:53:10 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:53:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:53:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:53:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:53:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:53:11 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:53:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:53:13 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:53:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:53:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:53:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:53:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:53:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:53:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:53:15 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:53:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43810690
Fri 17 Jan 2014 04:53:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:53:16 - job_xml_thread(): Done retrieving: data size 43810690
Fri 17 Jan 2014 04:53:16 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:53:16 - XML: Start document: iteration 16
Fri 17 Jan 2014 04:53:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43810690
Fri 17 Jan 2014 04:53:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:53:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:53:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:53:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:53:25 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:53:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:53:27 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:53:27 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:53:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:53:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 04:53:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 04:53:27 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:53:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:53:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:53:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8434 values 133021 bits 16627 bytes 
Fri 17 Jan 2014 04:53:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:53:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:53:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:53:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:53:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:53:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:53:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:53:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:53:38 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:53:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:53:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:53:39 - XML: Processed 654692 elements - found 627 jobs
Fri 17 Jan 2014 04:53:39 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 04:53:39 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 04:53:39 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 04:53:39 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:53:39 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:53:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:53:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:53:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:53:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:53:41 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:53:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43379017
Fri 17 Jan 2014 04:53:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:53:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43379017
Fri 17 Jan 2014 04:53:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:53:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:53:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:53:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:53:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:53:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:53:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:53:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:53:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:53:52 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:53:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:53:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:53:54 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:53:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:53:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:53:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:53:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:53:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:53:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:53:56 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:53:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 04:53:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:53:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:53:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:53:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:53:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:53:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:53:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43209779
Fri 17 Jan 2014 04:53:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:53:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43209779
Fri 17 Jan 2014 04:53:59 - job_xml_thread(): Done retrieving: data size 43209779
Fri 17 Jan 2014 04:53:59 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:53:59 - XML: Start document: iteration 17
Fri 17 Jan 2014 04:53:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:54:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:54:07 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:54:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:54:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:54:10 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 04:54:10 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:54:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:54:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:54:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:54:10 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:54:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:54:10 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:54:10 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:54:10 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 04:54:11 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 04:54:11 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 04:54:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:54:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:54:17 - XML: Processed 647382 elements - found 627 jobs
Fri 17 Jan 2014 04:54:17 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 04:54:17 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 04:54:17 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:54:17 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:54:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:54:20 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:54:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:54:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:54:21 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 949294 values 14980510 bits 1872563 bytes 
Fri 17 Jan 2014 04:54:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:54:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:54:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:54:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:54:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:54:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:54:26 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:54:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43227337
Fri 17 Jan 2014 04:54:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:54:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43227337
Fri 17 Jan 2014 04:54:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:54:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:54:27 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:54:27 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:54:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 04:54:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:54:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 04:54:27 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:54:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5858 values 92378 bits 11547 bytes 
Fri 17 Jan 2014 04:54:32 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:54:32 - job_xml_thread(): Done retrieving: data size 43227337
Fri 17 Jan 2014 04:54:32 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:54:32 - XML: Start document: iteration 18
Fri 17 Jan 2014 04:54:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:54:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:54:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:54:41 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:54:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:54:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:54:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:54:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:54:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:54:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:54:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:54:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:54:49 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:54:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:54:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:54:50 - XML: Processed 648000 elements - found 627 jobs
Fri 17 Jan 2014 04:54:50 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 04:54:50 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 04:54:50 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:54:50 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:54:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:54:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:54:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:54:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:54:53 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:54:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43812103
Fri 17 Jan 2014 04:54:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:54:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43812103
Fri 17 Jan 2014 04:54:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:54:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:54:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:55:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:55:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:55:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:55:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:55:05 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:55:05 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:55:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:55:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:55:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:55:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:55:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:55:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:55:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:55:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:55:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:55:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:55:09 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:55:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 04:55:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:55:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:55:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:55:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:55:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:55:11 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:55:11 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 04:55:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:55:12 - job_xml_thread(): Done retrieving: data size 43851505
Fri 17 Jan 2014 04:55:12 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:55:12 - XML: Start document: iteration 19
Fri 17 Jan 2014 04:55:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851505
Fri 17 Jan 2014 04:55:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851505
Fri 17 Jan 2014 04:55:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:55:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:55:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:55:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:55:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:55:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:55:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:55:27 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:55:28 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:55:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:55:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 04:55:28 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:55:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 04:55:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5821 values 91799 bits 11474 bytes 
Fri 17 Jan 2014 04:55:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:55:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:55:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:55:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:55:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:55:33 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:55:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:55:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:55:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:55:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:55:34 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:55:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:55:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:55:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:55:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:55:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:55:34 - XML: Processed 655440 elements - found 627 jobs
Fri 17 Jan 2014 04:55:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:55:34 - job 7347296 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 04:55:34 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 04:55:34 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 04:55:34 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 04:55:34 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:55:34 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:55:38 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:55:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43854901
Fri 17 Jan 2014 04:55:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:55:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43854901
Fri 17 Jan 2014 04:55:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:55:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:55:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:55:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:55:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:55:49 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:55:49 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:55:49 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:55:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 04:55:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:55:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:55:50 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:55:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:55:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:55:51 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:55:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:55:51 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:55:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:55:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:55:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:55:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:55:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:55:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:55:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:55:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:55:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:55:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:55:58 - job_xml_thread(): Done retrieving: data size 43857015
Fri 17 Jan 2014 04:55:58 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:55:58 - XML: Start document: iteration 20
Fri 17 Jan 2014 04:55:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43857015
Fri 17 Jan 2014 04:55:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:55:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43857015
Fri 17 Jan 2014 04:55:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:56:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:56:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:56:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:56:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:56:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:56:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:56:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:56:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:56:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:56:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:56:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:56:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:56:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:56:18 - XML: Processed 655454 elements - found 628 jobs
Fri 17 Jan 2014 04:56:18 - job 7347244 appears to have finished
Fri 17 Jan 2014 04:56:19 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 04:56:19 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 04:56:20 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 04:56:20 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:56:20 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:56:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:56:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:56:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:56:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:56:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:56:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:56:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:56:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:56:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:56:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43843384
Fri 17 Jan 2014 04:56:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:56:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43843384
Fri 17 Jan 2014 04:56:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:56:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:56:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:56:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:56:28 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:56:28 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:56:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 04:56:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:56:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 04:56:28 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:56:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9329 values 147158 bits 18394 bytes 
Fri 17 Jan 2014 04:56:35 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:56:35 - job_xml_thread(): Done retrieving: data size 43843384
Fri 17 Jan 2014 04:56:35 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:56:35 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 04:56:35 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 04:56:35 - Housekeeping: done.
Fri 17 Jan 2014 04:56:35 - XML: Start document: iteration 0
Fri 17 Jan 2014 04:56:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:56:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:56:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:56:41 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:56:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:56:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:56:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:56:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:56:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:56:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:56:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:56:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:56:48 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:56:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:56:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:56:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:56:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:56:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:56:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:56:51 - XML: Processed 655454 elements - found 628 jobs
Fri 17 Jan 2014 04:56:51 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 04:56:51 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 04:56:51 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:56:51 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:56:54 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:56:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43839829
Fri 17 Jan 2014 04:56:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:56:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43839829
Fri 17 Jan 2014 04:56:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:56:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:56:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:57:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:57:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:57:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:57:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:57:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:57:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:57:06 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:57:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:57:06 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:57:06 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:57:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:57:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:57:09 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:57:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 04:57:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:57:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:57:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:57:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:57:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:57:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:57:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:57:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:57:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:57:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:57:13 - job_xml_thread(): Done retrieving: data size 43869966
Fri 17 Jan 2014 04:57:13 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:57:13 - XML: Start document: iteration 1
Fri 17 Jan 2014 04:57:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43869966
Fri 17 Jan 2014 04:57:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:57:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43869966
Fri 17 Jan 2014 04:57:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:57:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:57:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:57:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:57:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:57:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:57:29 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:57:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:57:31 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:57:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:57:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 04:57:32 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:57:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 04:57:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:57:32 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:57:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:57:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5849 values 92268 bits 11533 bytes 
Fri 17 Jan 2014 04:57:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:57:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:57:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:57:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:57:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:57:33 - XML: Processed 655452 elements - found 627 jobs
Fri 17 Jan 2014 04:57:33 - job 7347301 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 04:57:33 - job 7330335 appears to have finished
Fri 17 Jan 2014 04:57:33 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 04:57:33 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 04:57:35 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 04:57:35 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:57:35 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:57:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:57:36 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:57:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:57:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:57:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:57:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:57:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:57:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:57:41 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:57:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43861790
Fri 17 Jan 2014 04:57:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:57:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43861790
Fri 17 Jan 2014 04:57:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:57:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:57:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:57:50 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:57:50 - job_xml_thread(): Done retrieving: data size 43861790
Fri 17 Jan 2014 04:57:50 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:57:51 - XML: Start document: iteration 2
Fri 17 Jan 2014 04:57:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:57:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:57:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:57:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:57:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:57:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:58:01 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:58:01 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:58:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:58:01 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:58:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:58:03 - XML: Processed 655452 elements - found 627 jobs
Fri 17 Jan 2014 04:58:04 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 04:58:04 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 04:58:04 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:58:04 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:58:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:58:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:58:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:58:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:58:05 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:58:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 04:58:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:58:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:58:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:58:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:58:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:58:06 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 04:58:06 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 04:58:06 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:58:08 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:58:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853297
Fri 17 Jan 2014 04:58:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:58:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853297
Fri 17 Jan 2014 04:58:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:58:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:58:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:58:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:58:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:58:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:58:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:58:19 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:58:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:58:20 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:58:20 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:58:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:58:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:58:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:58:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:58:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:58:21 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:58:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:58:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:58:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:58:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:58:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:58:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:58:23 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:58:23 - job_xml_thread(): Done retrieving: data size 43868182
Fri 17 Jan 2014 04:58:23 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:58:23 - XML: Start document: iteration 3
Fri 17 Jan 2014 04:58:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43868182
Fri 17 Jan 2014 04:58:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:58:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43868182
Fri 17 Jan 2014 04:58:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:58:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:58:33 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:58:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:58:35 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:58:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:58:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:58:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 04:58:35 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:58:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 04:58:35 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:58:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:58:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9259 values 146051 bits 18256 bytes 
Fri 17 Jan 2014 04:58:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:58:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:58:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:58:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:58:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:58:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:58:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:58:44 - XML: Processed 655454 elements - found 628 jobs
Fri 17 Jan 2014 04:58:45 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 04:58:45 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 04:58:45 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 04:58:45 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:58:45 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:58:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:58:46 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:58:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:58:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:58:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:58:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:58:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:58:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:58:48 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:58:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 04:58:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:58:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:58:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43836889
Fri 17 Jan 2014 04:58:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:58:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43836889
Fri 17 Jan 2014 04:58:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:58:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:58:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:58:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:58:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:59:00 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:59:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:59:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:59:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:59:01 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:59:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:59:01 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:59:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:59:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:59:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:59:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:59:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:59:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:59:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:59:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:59:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:59:04 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:59:04 - job_xml_thread(): Done retrieving: data size 43850864
Fri 17 Jan 2014 04:59:04 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:59:04 - XML: Start document: iteration 4
Fri 17 Jan 2014 04:59:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43850864
Fri 17 Jan 2014 04:59:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:59:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43850864
Fri 17 Jan 2014 04:59:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:59:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:59:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:59:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:59:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:59:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:59:21 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:59:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:59:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:59:22 - XML: Processed 655452 elements - found 627 jobs
Fri 17 Jan 2014 04:59:22 - job 7347256 appears to have finished
Fri 17 Jan 2014 04:59:22 - job 7347303 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 04:59:22 - job 7347296 appears to have finished
Fri 17 Jan 2014 04:59:22 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 04:59:22 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 04:59:23 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:59:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:59:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:59:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:59:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:59:25 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 04:59:25 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 04:59:25 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 04:59:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:59:26 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:59:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:59:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:59:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:59:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:59:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:59:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:59:28 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:59:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43799267
Fri 17 Jan 2014 04:59:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:59:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43799267
Fri 17 Jan 2014 04:59:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:59:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:59:36 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:59:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:59:37 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:59:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 04:59:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 04:59:37 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 04:59:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148578 bits 18572 bytes 
Fri 17 Jan 2014 04:59:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:59:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:59:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:59:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:59:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:59:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:59:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:59:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:59:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:59:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:59:40 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 04:59:40 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 04:59:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 04:59:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:59:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 04:59:44 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 04:59:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 04:59:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 04:59:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:59:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 04:59:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 04:59:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 04:59:46 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 04:59:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43236425
Fri 17 Jan 2014 04:59:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 04:59:46 - job_xml_thread(): Done retrieving: data size 43236425
Fri 17 Jan 2014 04:59:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43236425
Fri 17 Jan 2014 04:59:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 04:59:47 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 04:59:47 - XML: Start document: iteration 5
Fri 17 Jan 2014 04:59:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 04:59:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 04:59:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 04:59:58 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 04:59:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 04:59:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 04:59:59 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:59:59 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 04:59:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 04:59:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 04:59:59 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:00:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:00:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:00:06 - XML: Processed 647814 elements - found 626 jobs
Fri 17 Jan 2014 05:00:06 - job 7346393 appears to have finished
Fri 17 Jan 2014 05:00:06 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 05:00:07 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 05:00:07 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 05:00:07 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:00:07 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:00:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:00:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:00:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:00:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:00:10 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:00:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 05:00:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:00:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:00:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:00:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:00:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:00:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:00:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43171477
Fri 17 Jan 2014 05:00:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:00:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43171477
Fri 17 Jan 2014 05:00:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:00:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:00:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:00:23 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:00:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:00:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:00:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:00:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:00:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:00:25 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:00:25 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:00:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:00:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:00:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:00:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:00:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:00:27 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:00:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:00:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:00:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:00:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:00:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:00:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:00:29 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:00:29 - job_xml_thread(): Done retrieving: data size 43318920
Fri 17 Jan 2014 05:00:29 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:00:29 - XML: Start document: iteration 6
Fri 17 Jan 2014 05:00:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43318920
Fri 17 Jan 2014 05:00:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:00:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43318920
Fri 17 Jan 2014 05:00:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:00:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:00:37 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:00:37 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:00:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 05:00:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:00:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 05:00:39 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:00:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:00:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:00:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8713 values 137370 bits 17171 bytes 
Fri 17 Jan 2014 05:00:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:00:44 - XML: Processed 648579 elements - found 626 jobs
Fri 17 Jan 2014 05:00:44 - job 7347301 appears to have finished
Fri 17 Jan 2014 05:00:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:00:44 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 05:00:45 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 05:00:47 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 05:00:47 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:00:47 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:00:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:00:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:00:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:00:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:00:51 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:00:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:00:51 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:00:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:00:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:00:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:00:53 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:00:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:00:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:00:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:00:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:00:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:00:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:00:55 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:00:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43829403
Fri 17 Jan 2014 05:00:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:00:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43829403
Fri 17 Jan 2014 05:00:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:01:02 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:01:03 - job_xml_thread(): Done retrieving: data size 43829403
Fri 17 Jan 2014 05:01:03 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:01:03 - XML: Start document: iteration 7
Fri 17 Jan 2014 05:01:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:01:06 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:01:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:01:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:01:08 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:01:08 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:01:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:01:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:01:08 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:01:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:01:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:01:11 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 05:01:11 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:01:12 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:01:12 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:01:12 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 05:01:12 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 05:01:12 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 05:01:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:01:12 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:01:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:01:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:01:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:01:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:01:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:01:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:01:14 - XML: Processed 654962 elements - found 626 jobs
Fri 17 Jan 2014 05:01:14 - job 7347305 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 05:01:14 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 05:01:14 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 05:01:15 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 05:01:15 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:01:15 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:01:15 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 837513 values 13207140 bits 1650892 bytes 
Fri 17 Jan 2014 05:01:15 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:01:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 05:01:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:01:17 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:01:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43833061
Fri 17 Jan 2014 05:01:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:01:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43833061
Fri 17 Jan 2014 05:01:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:01:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:01:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:01:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:01:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:01:30 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:01:30 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:01:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:01:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:01:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:01:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:01:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:01:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:01:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:01:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:01:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:01:33 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:01:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:01:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:01:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:01:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:01:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:01:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:01:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:01:36 - job_xml_thread(): Done retrieving: data size 43853351
Fri 17 Jan 2014 05:01:36 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:01:36 - XML: Start document: iteration 8
Fri 17 Jan 2014 05:01:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853351
Fri 17 Jan 2014 05:01:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853351
Fri 17 Jan 2014 05:01:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:01:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:01:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:01:38 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:01:39 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:01:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:01:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 05:01:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 05:01:39 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:01:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8858 values 139837 bits 17479 bytes 
Fri 17 Jan 2014 05:01:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:01:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:01:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:01:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:01:53 - XML: Processed 655448 elements - found 625 jobs
Fri 17 Jan 2014 05:01:53 - job 7347259 appears to have finished
Fri 17 Jan 2014 05:01:53 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 05:01:53 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 05:01:54 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 05:01:54 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:01:54 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:01:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:01:56 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:01:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:01:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:01:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:01:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:01:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:01:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:01:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:02:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:02:01 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:02:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:02:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:02:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:02:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:02:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:02:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:02:04 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:02:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43846982
Fri 17 Jan 2014 05:02:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:02:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43846982
Fri 17 Jan 2014 05:02:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:02:09 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:02:09 - job_xml_thread(): Done retrieving: data size 43846982
Fri 17 Jan 2014 05:02:09 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:02:09 - XML: Start document: iteration 9
Fri 17 Jan 2014 05:02:12 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:02:12 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 05:02:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:02:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:02:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:02:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:02:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:02:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:02:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:02:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:02:20 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:02:20 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:02:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:02:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:02:20 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:02:24 - XML: Processed 655450 elements - found 626 jobs
Fri 17 Jan 2014 05:02:24 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 05:02:24 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 05:02:24 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 05:02:24 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:02:24 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:02:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:02:27 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:02:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:02:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:02:27 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:02:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 05:02:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:02:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:02:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:02:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:02:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:02:30 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:02:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43866765
Fri 17 Jan 2014 05:02:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:02:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43866765
Fri 17 Jan 2014 05:02:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:02:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:02:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:02:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:02:39 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:02:39 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:02:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:02:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 05:02:39 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:02:39 - job_xml_thread(): Done retrieving: data size 43866765
Fri 17 Jan 2014 05:02:39 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:02:39 - XML: Start document: iteration 10
Fri 17 Jan 2014 05:02:39 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:02:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5892 values 93172 bits 11646 bytes 
Fri 17 Jan 2014 05:02:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 05:02:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:02:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:02:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:02:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:02:42 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:02:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:02:42 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:02:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:02:42 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:02:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:02:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:02:51 - XML: Processed 655447 elements - found 626 jobs
Fri 17 Jan 2014 05:02:51 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 05:02:51 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 05:02:51 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:02:51 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:02:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:02:53 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:02:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:02:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:02:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:02:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:02:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:02:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:02:56 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:02:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43841268
Fri 17 Jan 2014 05:02:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:02:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43841268
Fri 17 Jan 2014 05:02:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:02:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:02:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:03:06 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:03:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:03:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:03:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:03:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:03:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:03:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:03:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:03:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:03:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:03:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:03:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:03:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:03:13 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:03:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:03:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:03:13 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:03:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 05:03:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:03:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:03:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:03:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:03:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:03:16 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:03:16 - job_xml_thread(): Done retrieving: data size 43863949
Fri 17 Jan 2014 05:03:16 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:03:16 - XML: Start document: iteration 11
Fri 17 Jan 2014 05:03:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43863949
Fri 17 Jan 2014 05:03:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:03:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43863949
Fri 17 Jan 2014 05:03:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:03:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:03:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:03:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:03:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:03:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:03:34 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:03:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:03:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:03:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:03:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:03:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:03:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:03:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:03:38 - XML: Processed 655452 elements - found 627 jobs
Fri 17 Jan 2014 05:03:38 - job 7347303 appears to have finished
Fri 17 Jan 2014 05:03:38 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 05:03:38 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 05:03:38 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 05:03:38 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:03:38 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:03:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:03:40 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:03:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:03:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:03:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:03:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:03:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:03:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:03:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:03:41 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:03:41 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:03:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 05:03:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:03:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 05:03:41 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:03:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5740 values 90738 bits 11342 bytes 
Fri 17 Jan 2014 05:03:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:03:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865627
Fri 17 Jan 2014 05:03:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:03:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43865627
Fri 17 Jan 2014 05:03:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:03:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:03:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:03:53 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:03:53 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:03:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:03:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:03:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:03:58 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:03:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:03:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:03:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:03:59 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:03:59 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:03:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:03:59 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:03:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:03:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:03:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:04:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:04:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:04:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:04:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:04:02 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:04:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 05:04:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:04:03 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:04:03 - job_xml_thread(): Done retrieving: data size 43837955
Fri 17 Jan 2014 05:04:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43837955
Fri 17 Jan 2014 05:04:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:04:03 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:04:03 - XML: Start document: iteration 12
Fri 17 Jan 2014 05:04:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43837955
Fri 17 Jan 2014 05:04:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:04:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:04:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:04:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:04:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:04:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:04:26 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:04:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:04:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:04:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:04:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:04:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:04:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:04:27 - XML: Processed 655449 elements - found 627 jobs
Fri 17 Jan 2014 05:04:27 - job 7347308 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 05:04:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:04:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:04:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:04:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:04:27 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:04:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:04:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:04:27 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:04:27 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 05:04:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:04:27 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 05:04:27 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 05:04:27 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:04:27 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:04:30 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:04:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43872329
Fri 17 Jan 2014 05:04:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:04:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43872329
Fri 17 Jan 2014 05:04:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:04:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:04:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:04:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:04:41 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:04:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:04:42 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:04:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 05:04:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 05:04:42 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:04:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7484 values 118042 bits 14755 bytes 
Fri 17 Jan 2014 05:04:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:04:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:04:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:04:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:04:42 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:04:42 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:04:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:04:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:04:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:04:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:04:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:04:44 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:04:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:04:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:04:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:04:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:04:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:04:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:04:45 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 05:04:45 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 05:04:45 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:04:47 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:04:47 - job_xml_thread(): Done retrieving: data size 43868318
Fri 17 Jan 2014 05:04:47 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:04:47 - XML: Start document: iteration 13
Fri 17 Jan 2014 05:04:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43868318
Fri 17 Jan 2014 05:04:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:04:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43868318
Fri 17 Jan 2014 05:04:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:04:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:04:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:05:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:05:00 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:05:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:05:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:05:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:05:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:05:01 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:05:01 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:05:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:05:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:05:01 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:05:08 - XML: Processed 655450 elements - found 626 jobs
Fri 17 Jan 2014 05:05:08 - job 7347305 appears to have finished
Fri 17 Jan 2014 05:05:08 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 05:05:08 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 05:05:08 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 05:05:08 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:05:08 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:05:09 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:05:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 05:05:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:05:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:05:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:05:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:05:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:05:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:05:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:05:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:05:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:05:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:05:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43845786
Fri 17 Jan 2014 05:05:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:05:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43845786
Fri 17 Jan 2014 05:05:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:05:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:05:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:05:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:05:21 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:05:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:05:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:05:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:05:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:05:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:05:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:05:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43845786
Fri 17 Jan 2014 05:05:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:05:23 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:05:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:05:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:05:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:05:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:05:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:05:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:05:34 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:05:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:05:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:05:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:05:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:05:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:05:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:05:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:05:35 - job_xml_thread(): Done retrieving: data size 43763339
Fri 17 Jan 2014 05:05:35 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:05:35 - XML: Start document: iteration 14
Fri 17 Jan 2014 05:05:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43763339
Fri 17 Jan 2014 05:05:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:05:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:05:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:05:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:05:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:05:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:05:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:05:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43763339
Fri 17 Jan 2014 05:05:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:05:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:05:42 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:05:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:05:44 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:05:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 05:05:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 05:05:44 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:05:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9076 values 143157 bits 17894 bytes 
Fri 17 Jan 2014 05:05:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:05:49 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:05:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:05:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:05:51 - XML: Processed 654686 elements - found 626 jobs
Fri 17 Jan 2014 05:05:51 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 05:05:51 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 05:05:51 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:05:51 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:05:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:05:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:05:54 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:05:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:05:54 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:05:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:05:54 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:05:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:05:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:05:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:05:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:05:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:05:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:05:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:05:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:05:58 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:05:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 05:05:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:05:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:05:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43207526
Fri 17 Jan 2014 05:05:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:05:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43207526
Fri 17 Jan 2014 05:05:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:06:06 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:06:06 - job_xml_thread(): Done retrieving: data size 43207526
Fri 17 Jan 2014 05:06:06 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:06:07 - XML: Start document: iteration 15
Fri 17 Jan 2014 05:06:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:06:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:06:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:06:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:06:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:06:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:06:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:06:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:06:17 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:06:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:06:17 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:06:17 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:06:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:06:19 - XML: Processed 647254 elements - found 625 jobs
Fri 17 Jan 2014 05:06:19 - job 7347243 appears to have finished
Fri 17 Jan 2014 05:06:19 - job 7345039 appears to have finished
Fri 17 Jan 2014 05:06:19 - job 7347306 appears to have finished
Fri 17 Jan 2014 05:06:19 - job_xml_thread(): Found 5 updated jobs.
Fri 17 Jan 2014 05:06:19 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 05:06:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:06:20 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:06:20 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Fri 17 Jan 2014 05:06:20 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:06:20 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:06:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:06:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:06:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:06:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:06:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:06:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:06:23 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:06:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43257939
Fri 17 Jan 2014 05:06:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:06:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43257939
Fri 17 Jan 2014 05:06:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:06:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:06:31 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:06:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:06:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:06:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:06:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:06:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:06:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43257939
Fri 17 Jan 2014 05:06:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:06:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:06:36 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:06:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:06:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:06:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:06:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:06:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:06:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:06:44 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:06:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:06:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:06:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:06:44 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:06:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:06:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:06:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:06:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:06:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:06:45 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:06:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 05:06:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 05:06:45 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:06:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99021 bits 12377 bytes 
Fri 17 Jan 2014 05:06:46 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:06:46 - job_xml_thread(): Done retrieving: data size 43778340
Fri 17 Jan 2014 05:06:46 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:06:46 - XML: Start document: iteration 16
Fri 17 Jan 2014 05:06:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43778340
Fri 17 Jan 2014 05:06:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:06:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:06:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:06:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:06:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:06:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:06:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:06:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43778340
Fri 17 Jan 2014 05:06:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:07:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:07:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:07:02 - XML: Processed 654817 elements - found 625 jobs
Fri 17 Jan 2014 05:07:02 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 05:07:02 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 05:07:02 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:07:02 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:07:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:07:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:07:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:07:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:07:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:07:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:07:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:07:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:07:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:07:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:07:05 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:07:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:07:08 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:07:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:07:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:07:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:07:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:07:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:07:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:07:10 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:07:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43861938
Fri 17 Jan 2014 05:07:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:07:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43861938
Fri 17 Jan 2014 05:07:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:07:17 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:07:17 - job_xml_thread(): Done retrieving: data size 43861938
Fri 17 Jan 2014 05:07:18 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:07:18 - XML: Start document: iteration 17
Fri 17 Jan 2014 05:07:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:07:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:07:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:07:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:07:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:07:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:07:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:07:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:07:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:07:24 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:07:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 05:07:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:07:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:07:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:07:33 - XML: Processed 655448 elements - found 625 jobs
Fri 17 Jan 2014 05:07:33 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 05:07:33 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 05:07:33 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:07:33 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:07:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:07:34 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:07:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:07:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:07:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:07:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:07:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:07:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:07:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:07:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43822776
Fri 17 Jan 2014 05:07:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:07:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43822776
Fri 17 Jan 2014 05:07:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:07:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:07:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:07:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:07:45 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:07:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:07:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:07:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:07:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:07:47 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:07:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:07:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 05:07:47 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:07:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7068 values 111428 bits 13928 bytes 
Fri 17 Jan 2014 05:07:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 05:07:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:07:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:07:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:07:48 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:07:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:07:48 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:07:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:07:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:07:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:07:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:07:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:07:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:07:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:07:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:07:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:07:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:07:53 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:07:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43861275
Fri 17 Jan 2014 05:07:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:07:53 - job_xml_thread(): Done retrieving: data size 43861275
Fri 17 Jan 2014 05:07:53 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:07:53 - XML: Start document: iteration 18
Fri 17 Jan 2014 05:07:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43861275
Fri 17 Jan 2014 05:07:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:08:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:08:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:08:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:08:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:08:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:08:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:08:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:08:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:08:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:08:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:08:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:08:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:08:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:08:12 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 05:08:12 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:08:12 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:08:12 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:08:12 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 05:08:12 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 05:08:12 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 05:08:16 - XML: Processed 655452 elements - found 627 jobs
Fri 17 Jan 2014 05:08:16 - job 7347307 report time 1389931562 does not match current heartbeat 1389931631 : ignoring job
Fri 17 Jan 2014 05:08:16 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 05:08:16 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 05:08:16 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 05:08:16 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:08:16 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:08:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:08:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:08:18 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 828545 values 13077087 bits 1634635 bytes 
Fri 17 Jan 2014 05:08:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:08:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:08:18 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:08:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 05:08:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:08:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:08:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:08:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:08:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:08:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:08:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:08:21 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:08:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43828353
Fri 17 Jan 2014 05:08:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:08:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43828353
Fri 17 Jan 2014 05:08:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:08:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:08:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:08:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:08:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:08:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:08:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:08:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:08:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43828353
Fri 17 Jan 2014 05:08:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:08:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:08:32 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:08:32 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:08:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:08:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:08:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:08:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:08:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:08:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:08:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:08:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:08:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:08:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:08:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:08:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:08:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:08:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:08:47 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:08:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:08:47 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:08:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:08:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:08:47 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:08:47 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:08:47 - job_xml_thread(): Done retrieving: data size 43820045
Fri 17 Jan 2014 05:08:47 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:08:47 - XML: Start document: iteration 19
Fri 17 Jan 2014 05:08:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43820045
Fri 17 Jan 2014 05:08:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43820045
Fri 17 Jan 2014 05:08:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:08:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:08:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:08:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 05:08:48 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:08:48 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:08:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 05:08:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5509 values 86819 bits 10852 bytes 
Fri 17 Jan 2014 05:09:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:09:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:09:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:09:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:09:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:09:03 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:09:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:09:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:09:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:09:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:09:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:09:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:09:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:09:06 - XML: Processed 655454 elements - found 628 jobs
Fri 17 Jan 2014 05:09:06 - job 7347307 report time 1389931562 does not match current heartbeat 1389931683 : ignoring job
Fri 17 Jan 2014 05:09:06 - job 7347312 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 05:09:06 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 05:09:06 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 05:09:07 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 05:09:07 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:09:07 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:09:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:09:12 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:09:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:09:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:09:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:09:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:09:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:09:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:09:12 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:09:12 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 05:09:15 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:09:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43840279
Fri 17 Jan 2014 05:09:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:09:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43840279
Fri 17 Jan 2014 05:09:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:09:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:09:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:09:22 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:09:22 - job_xml_thread(): Done retrieving: data size 43840279
Fri 17 Jan 2014 05:09:22 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:09:22 - XML: Start document: iteration 20
Fri 17 Jan 2014 05:09:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:09:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:09:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:09:31 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:09:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:09:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:09:32 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:09:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:09:32 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:09:32 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:09:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:09:33 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:09:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 05:09:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:09:37 - XML: Processed 655454 elements - found 628 jobs
Fri 17 Jan 2014 05:09:37 - job 7347307 report time 1389931562 does not match current heartbeat 1389931683 : ignoring job
Fri 17 Jan 2014 05:09:37 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 05:09:37 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 05:09:37 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:09:37 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:09:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:09:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:09:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:09:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:09:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:09:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:09:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:09:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:09:42 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:09:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43857960
Fri 17 Jan 2014 05:09:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:09:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43857960
Fri 17 Jan 2014 05:09:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:09:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:09:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:09:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:09:48 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:09:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:09:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 05:09:49 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:09:49 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:09:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 05:09:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5986 values 94465 bits 11808 bytes 
Fri 17 Jan 2014 05:09:52 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:09:52 - job_xml_thread(): Done retrieving: data size 43857960
Fri 17 Jan 2014 05:09:52 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:09:52 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 05:09:52 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 05:09:52 - Housekeeping: done.
Fri 17 Jan 2014 05:09:53 - XML: Start document: iteration 0
Fri 17 Jan 2014 05:09:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:09:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:09:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:09:58 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:09:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:09:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:09:59 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:09:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:09:59 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:09:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:09:59 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:10:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:10:06 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:10:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:10:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:10:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:10:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:10:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:10:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:10:07 - XML: Processed 655454 elements - found 628 jobs
Fri 17 Jan 2014 05:10:07 - job 7347307 report time 1389931562 does not match current heartbeat 1389931683 : ignoring job
Fri 17 Jan 2014 05:10:07 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 05:10:07 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 05:10:07 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:10:07 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:10:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:10:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43843094
Fri 17 Jan 2014 05:10:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:10:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43843094
Fri 17 Jan 2014 05:10:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:10:13 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:10:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 05:10:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:10:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:10:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:10:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:10:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:10:22 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:10:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:10:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:10:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:10:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:10:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:10:25 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:10:25 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:10:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:10:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:10:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:10:26 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:10:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:10:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:10:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:10:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:10:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:10:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:10:29 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:10:29 - job_xml_thread(): Done retrieving: data size 43870030
Fri 17 Jan 2014 05:10:29 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:10:29 - XML: Start document: iteration 1
Fri 17 Jan 2014 05:10:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870030
Fri 17 Jan 2014 05:10:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:10:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870030
Fri 17 Jan 2014 05:10:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:10:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:10:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:10:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:10:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:10:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:10:42 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:10:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:10:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:10:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:10:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:10:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:10:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:10:44 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:10:48 - XML: Processed 655456 elements - found 629 jobs
Fri 17 Jan 2014 05:10:48 - job 7347307 report time 1389931562 does not match current heartbeat 1389931752 : ignoring job
Fri 17 Jan 2014 05:10:48 - job 7347313 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 05:10:48 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 05:10:48 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 05:10:49 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 05:10:49 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:10:49 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:10:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:10:50 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:10:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:10:50 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:10:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 05:10:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 05:10:50 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:10:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5987 values 94407 bits 11800 bytes 
Fri 17 Jan 2014 05:10:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:10:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:10:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:10:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:10:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:10:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:10:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:10:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:10:55 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:10:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43847645
Fri 17 Jan 2014 05:10:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:10:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43847645
Fri 17 Jan 2014 05:10:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:10:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:10:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:11:04 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:11:04 - job_xml_thread(): Done retrieving: data size 43847645
Fri 17 Jan 2014 05:11:04 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:11:04 - XML: Start document: iteration 2
Fri 17 Jan 2014 05:11:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:11:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:11:07 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:11:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:11:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:11:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:11:08 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:11:08 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:11:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:11:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:11:08 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:11:17 - XML: Processed 655454 elements - found 628 jobs
Fri 17 Jan 2014 05:11:17 - job 7347314 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 05:11:17 - job 7347247 appears to have finished
Fri 17 Jan 2014 05:11:17 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 05:11:17 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 05:11:17 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 05:11:17 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:11:17 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:11:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:11:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:11:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:11:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:11:18 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:11:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 05:11:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:11:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:11:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:11:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:11:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:11:21 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:11:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43763101
Fri 17 Jan 2014 05:11:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:11:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43763101
Fri 17 Jan 2014 05:11:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:11:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:11:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:11:32 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:11:32 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:11:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:11:34 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:11:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:11:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:11:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:11:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:11:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:11:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:11:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:11:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:11:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:11:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:11:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:11:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:11:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:11:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:11:38 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 05:11:38 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 05:11:38 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:11:38 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:11:38 - job_xml_thread(): Done retrieving: data size 43279354
Fri 17 Jan 2014 05:11:38 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:11:38 - XML: Start document: iteration 3
Fri 17 Jan 2014 05:11:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43279354
Fri 17 Jan 2014 05:11:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43279354
Fri 17 Jan 2014 05:11:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:11:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:11:46 - XML: Processed 648344 elements - found 628 jobs
Fri 17 Jan 2014 05:11:46 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 05:11:46 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 05:11:47 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:11:47 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:11:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:11:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:11:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:11:50 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:11:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:11:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:11:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:11:51 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:11:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 05:11:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 05:11:52 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:11:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8836 values 139364 bits 17420 bytes 
Fri 17 Jan 2014 05:11:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:11:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:11:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:11:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:11:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:11:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:11:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:11:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:11:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:11:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:11:59 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:11:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:11:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:12:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:12:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:12:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:12:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:12:01 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:12:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43195205
Fri 17 Jan 2014 05:12:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:12:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43195205
Fri 17 Jan 2014 05:12:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:12:02 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:12:02 - job_xml_thread(): Done retrieving: data size 43195205
Fri 17 Jan 2014 05:12:02 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:12:02 - XML: Start document: iteration 4
Fri 17 Jan 2014 05:12:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:12:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:12:15 - XML: Processed 647252 elements - found 627 jobs
Fri 17 Jan 2014 05:12:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:12:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:12:15 - job 7347252 appears to have finished
Fri 17 Jan 2014 05:12:15 - job 7347310 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 05:12:15 - job 7347314 field 'start_timestamp' changed since saved from: 1389931811 to: 1389931753
Fri 17 Jan 2014 05:12:15 - job 7347315 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 05:12:15 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 05:12:15 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 05:12:20 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 05:12:20 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:12:20 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:12:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:12:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:12:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:12:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:12:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:12:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:12:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:12:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:12:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:12:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:12:24 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:12:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:12:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:12:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:12:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:12:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:12:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:12:24 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:12:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 05:12:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:12:27 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:12:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43271643
Fri 17 Jan 2014 05:12:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:12:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43271643
Fri 17 Jan 2014 05:12:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:12:35 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:12:35 - job_xml_thread(): Done retrieving: data size 43271643
Fri 17 Jan 2014 05:12:35 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:12:35 - XML: Start document: iteration 5
Fri 17 Jan 2014 05:12:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:12:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:12:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:12:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:12:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:12:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:12:39 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:12:39 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:12:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:12:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:12:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:12:39 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:12:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:12:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:12:49 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:12:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:12:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:12:49 - XML: Processed 648000 elements - found 627 jobs
Fri 17 Jan 2014 05:12:49 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 05:12:49 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 05:12:49 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:12:49 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:12:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:12:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:12:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:12:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:12:51 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:12:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43781557
Fri 17 Jan 2014 05:12:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:12:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43781557
Fri 17 Jan 2014 05:12:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:12:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:12:52 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:12:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:12:54 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:12:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:12:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:12:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 05:12:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 05:12:54 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:12:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8723 values 137573 bits 17196 bytes 
Fri 17 Jan 2014 05:13:04 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:13:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:13:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:13:05 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:13:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:13:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:13:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:13:07 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:13:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:13:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:13:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:13:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:13:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:13:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:13:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:13:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:13:08 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:13:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:13:08 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:13:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:13:10 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:13:10 - job_xml_thread(): Done retrieving: data size 43861613
Fri 17 Jan 2014 05:13:10 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:13:10 - XML: Start document: iteration 6
Fri 17 Jan 2014 05:13:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43861613
Fri 17 Jan 2014 05:13:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:13:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43861613
Fri 17 Jan 2014 05:13:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:13:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:13:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:13:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:13:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:13:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:13:25 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:13:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:13:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:13:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:13:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:13:27 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:13:27 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:13:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:13:27 - XML: Processed 655454 elements - found 628 jobs
Fri 17 Jan 2014 05:13:28 - job 7347311 report time 1389931872 does not match current heartbeat 1389931924 : ignoring job
Fri 17 Jan 2014 05:13:28 - job 7347287 appears to have finished
Fri 17 Jan 2014 05:13:28 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 05:13:28 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 05:13:28 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 05:13:28 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:13:28 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:13:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:13:32 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:13:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:13:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:13:32 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:13:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 05:13:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:13:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:13:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:13:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:13:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:13:34 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:13:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43836110
Fri 17 Jan 2014 05:13:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:13:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43836110
Fri 17 Jan 2014 05:13:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:13:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:13:42 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:13:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:13:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:13:43 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:13:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:13:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:13:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:13:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:13:43 - job_xml_thread(): Done retrieving: data size 43836110
Fri 17 Jan 2014 05:13:43 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:13:43 - XML: Start document: iteration 7
Fri 17 Jan 2014 05:13:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43836110
Fri 17 Jan 2014 05:13:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:13:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:13:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:13:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:13:55 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:13:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:13:56 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:13:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:13:56 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:13:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 05:13:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 05:13:56 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:13:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5963 values 94060 bits 11757 bytes 
Fri 17 Jan 2014 05:13:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:13:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:14:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:14:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:14:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:14:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:14:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:14:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:14:01 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:14:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:14:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:14:02 - XML: Processed 655454 elements - found 628 jobs
Fri 17 Jan 2014 05:14:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:14:02 - job 7347311 report time 1389931872 does not match current heartbeat 1389931924 : ignoring job
Fri 17 Jan 2014 05:14:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:14:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:14:02 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 05:14:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:14:02 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 05:14:02 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:14:02 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:14:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:14:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43849361
Fri 17 Jan 2014 05:14:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:14:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43849361
Fri 17 Jan 2014 05:14:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:14:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:14:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:14:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:14:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:14:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:14:17 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:14:17 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:14:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:14:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:14:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:14:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:14:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:14:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:14:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:14:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:14:20 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:14:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:14:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:14:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:14:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:14:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:14:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:14:20 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:14:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 05:14:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:14:21 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:14:21 - job_xml_thread(): Done retrieving: data size 43864676
Fri 17 Jan 2014 05:14:21 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:14:21 - XML: Start document: iteration 8
Fri 17 Jan 2014 05:14:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43864676
Fri 17 Jan 2014 05:14:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43864676
Fri 17 Jan 2014 05:14:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:14:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:14:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:14:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:14:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:14:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:14:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:14:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:14:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:14:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:14:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:14:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:14:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:14:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:14:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:14:41 - XML: Processed 655452 elements - found 627 jobs
Fri 17 Jan 2014 05:14:41 - job 7347269 appears to have finished
Fri 17 Jan 2014 05:14:41 - job 7347317 report time 1389931924 does not match current heartbeat 1389931993 : ignoring job
Fri 17 Jan 2014 05:14:41 - job 7347311 report time 1389931872 does not match current heartbeat 1389931993 : ignoring job
Fri 17 Jan 2014 05:14:41 - job 7347309 appears to have finished
Fri 17 Jan 2014 05:14:41 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 05:14:41 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 05:14:43 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 05:14:43 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:14:43 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:14:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:14:44 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:14:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:14:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:14:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:14:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:14:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:14:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:14:46 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:14:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43860241
Fri 17 Jan 2014 05:14:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:14:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43860241
Fri 17 Jan 2014 05:14:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:14:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:14:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:14:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:14:57 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:14:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:14:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:14:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:14:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:14:58 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:14:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:14:59 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:14:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:14:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 05:14:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 05:14:59 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:14:59 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:14:59 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:14:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:14:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:14:59 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9076 values 143155 bits 17894 bytes 
Fri 17 Jan 2014 05:15:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:15:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:15:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:15:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:15:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:15:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:15:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:15:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:15:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:15:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:15:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:15:02 - job_xml_thread(): Done retrieving: data size 43860727
Fri 17 Jan 2014 05:15:02 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:15:02 - XML: Start document: iteration 9
Fri 17 Jan 2014 05:15:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43860727
Fri 17 Jan 2014 05:15:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:15:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43860727
Fri 17 Jan 2014 05:15:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:15:13 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 05:15:13 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:15:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:15:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:15:15 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:15:15 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 05:15:15 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:15:15 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 05:15:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:15:16 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 05:15:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Fri 17 Jan 2014 05:15:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:15:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:15:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:15:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:15:25 - XML: Processed 655452 elements - found 627 jobs
Fri 17 Jan 2014 05:15:25 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:15:25 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:15:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:15:25 - job 7347317 report time 1389931924 does not match current heartbeat 1389932045 : ignoring job
Fri 17 Jan 2014 05:15:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:15:25 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:15:25 - job 7347311 report time 1389931872 does not match current heartbeat 1389932045 : ignoring job
Fri 17 Jan 2014 05:15:25 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 05:15:26 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 05:15:26 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:15:26 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:15:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:15:27 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:15:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:15:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:15:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:15:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:15:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:15:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:15:28 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:15:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 05:15:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:15:29 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:15:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873226
Fri 17 Jan 2014 05:15:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:15:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873226
Fri 17 Jan 2014 05:15:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:15:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:15:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:15:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:15:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:15:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:15:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:15:41 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:15:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:15:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:15:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:15:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:15:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:15:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:15:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:15:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:15:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:15:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:15:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:15:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:15:45 - job_xml_thread(): Done retrieving: data size 43876970
Fri 17 Jan 2014 05:15:45 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:15:45 - XML: Start document: iteration 10
Fri 17 Jan 2014 05:15:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43876970
Fri 17 Jan 2014 05:15:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:15:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43876970
Fri 17 Jan 2014 05:15:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:15:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:15:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:15:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:15:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:15:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:15:59 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:16:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:16:00 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:16:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 05:16:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 05:16:01 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:16:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8281 values 130602 bits 16325 bytes 
Fri 17 Jan 2014 05:16:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:16:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:16:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:16:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:16:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:16:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:16:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:16:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:16:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:16:06 - XML: Processed 655448 elements - found 625 jobs
Fri 17 Jan 2014 05:16:06 - job 7347263 appears to have finished
Fri 17 Jan 2014 05:16:06 - job 7347317 report time 1389931924 does not match current heartbeat 1389932045 : ignoring job
Fri 17 Jan 2014 05:16:06 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 05:16:06 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 05:16:07 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 05:16:07 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:16:07 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:16:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:16:08 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:16:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:16:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:16:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:16:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:16:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:16:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:16:10 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:16:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 05:16:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:16:10 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:16:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43852342
Fri 17 Jan 2014 05:16:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:16:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43852342
Fri 17 Jan 2014 05:16:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:16:15 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:16:15 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:16:17 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:16:18 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:16:18 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 05:16:18 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 05:16:18 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 05:16:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:16:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:16:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:16:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:16:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:16:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:16:21 - size of cluster 'LISA Cluster': 624 hosts 79473 metrics 886986 values 13987300 bits 1748412 bytes 
Fri 17 Jan 2014 05:16:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:16:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:16:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:16:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:16:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:16:22 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:16:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:16:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:16:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:16:25 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:16:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:16:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:16:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:16:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:16:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:16:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:16:28 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:16:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43868099
Fri 17 Jan 2014 05:16:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:16:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43868099
Fri 17 Jan 2014 05:16:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:16:29 - job_xml_thread(): Done retrieving: data size 43868099
Fri 17 Jan 2014 05:16:29 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:16:29 - XML: Start document: iteration 11
Fri 17 Jan 2014 05:16:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:16:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:16:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:16:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:16:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:16:45 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:16:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:16:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:16:47 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:16:47 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:16:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:16:47 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:16:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:16:50 - XML: Processed 655448 elements - found 625 jobs
Fri 17 Jan 2014 05:16:50 - job 7347317 report time 1389931924 does not match current heartbeat 1389932113 : ignoring job
Fri 17 Jan 2014 05:16:50 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 05:16:50 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 05:16:50 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:16:50 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:16:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:16:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:16:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:16:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:16:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:16:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:16:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:16:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:16:54 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:16:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43861655
Fri 17 Jan 2014 05:16:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:16:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43861655
Fri 17 Jan 2014 05:16:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:17:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:17:00 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:17:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:17:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 05:17:02 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:17:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 05:17:02 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:17:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9279 values 146651 bits 18331 bytes 
Fri 17 Jan 2014 05:17:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:17:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:17:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:17:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:17:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:17:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:17:05 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:17:05 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:17:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:17:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:17:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:17:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:17:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:17:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:17:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:17:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:17:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:17:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:17:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:17:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:17:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:17:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:17:14 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:17:14 - job_xml_thread(): Done retrieving: data size 43799342
Fri 17 Jan 2014 05:17:14 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:17:14 - XML: Start document: iteration 12
Fri 17 Jan 2014 05:17:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43799342
Fri 17 Jan 2014 05:17:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:17:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43799342
Fri 17 Jan 2014 05:17:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:17:18 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:17:18 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 05:17:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:17:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:17:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:17:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:17:30 - XML: Processed 654698 elements - found 624 jobs
Fri 17 Jan 2014 05:17:30 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 05:17:30 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 05:17:30 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:17:30 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:17:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:17:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:17:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:17:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:17:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:17:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:17:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:17:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:17:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:17:33 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:17:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 05:17:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:17:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:17:38 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:17:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:17:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:17:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:17:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:17:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:17:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:17:42 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:17:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43302262
Fri 17 Jan 2014 05:17:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:17:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43302262
Fri 17 Jan 2014 05:17:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:17:45 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:17:46 - job_xml_thread(): Done retrieving: data size 43302262
Fri 17 Jan 2014 05:17:46 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:17:46 - XML: Start document: iteration 13
Fri 17 Jan 2014 05:17:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:17:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:17:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:17:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:17:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:17:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:17:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:17:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:17:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:17:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:17:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:17:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:17:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:18:01 - XML: Processed 648602 elements - found 624 jobs
Fri 17 Jan 2014 05:18:01 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 05:18:01 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 05:18:01 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:18:01 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:18:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:18:03 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:18:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:18:04 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:18:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 05:18:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 05:18:04 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:18:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6090 values 96372 bits 12046 bytes 
Fri 17 Jan 2014 05:18:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:18:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:18:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:18:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:18:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:18:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:18:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:18:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:18:08 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:18:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43182375
Fri 17 Jan 2014 05:18:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:18:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43182375
Fri 17 Jan 2014 05:18:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:18:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:18:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:18:16 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:18:16 - job_xml_thread(): Done retrieving: data size 43182375
Fri 17 Jan 2014 05:18:16 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:18:16 - XML: Start document: iteration 14
Fri 17 Jan 2014 05:18:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:18:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:18:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:18:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:18:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:18:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:18:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:18:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:18:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:18:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:18:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:18:28 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:18:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 05:18:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:18:31 - XML: Processed 647250 elements - found 626 jobs
Fri 17 Jan 2014 05:18:31 - job 7347318 report time 1389932165 does not match current heartbeat 1389932234 : ignoring job
Fri 17 Jan 2014 05:18:31 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 05:18:31 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 05:18:31 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 05:18:31 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:18:31 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:18:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:18:32 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:18:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:18:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:18:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:18:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:18:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:18:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:18:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:18:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43655585
Fri 17 Jan 2014 05:18:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:18:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43655585
Fri 17 Jan 2014 05:18:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:18:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:18:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:18:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:18:46 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:18:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:18:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:18:46 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:18:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:18:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:18:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:18:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:18:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:18:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:18:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:18:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:18:49 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:18:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:18:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:18:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:18:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:18:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:18:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:18:51 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 05:18:51 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 05:18:51 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:18:51 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:18:51 - job_xml_thread(): Done retrieving: data size 43841035
Fri 17 Jan 2014 05:18:51 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:18:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43841035
Fri 17 Jan 2014 05:18:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43841035
Fri 17 Jan 2014 05:18:51 - XML: Start document: iteration 15
Fri 17 Jan 2014 05:18:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:18:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:19:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:19:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:19:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:19:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:19:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:19:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:19:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:19:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:19:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:19:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:19:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:19:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:19:04 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:19:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:19:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:19:05 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:19:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:19:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 05:19:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 05:19:05 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:19:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8745 values 138168 bits 17271 bytes 
Fri 17 Jan 2014 05:19:10 - XML: Processed 655266 elements - found 626 jobs
Fri 17 Jan 2014 05:19:11 - job 7347319 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 05:19:11 - job 7347318 report time 1389932165 does not match current heartbeat 1389932286 : ignoring job
Fri 17 Jan 2014 05:19:11 - job 7347320 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 05:19:11 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 05:19:11 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 05:19:11 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 05:19:11 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:19:11 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:19:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:19:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:19:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:19:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:19:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:19:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:19:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:19:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:19:16 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:19:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43838560
Fri 17 Jan 2014 05:19:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:19:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43838560
Fri 17 Jan 2014 05:19:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:19:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:19:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:19:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:19:25 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:19:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:19:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:19:26 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:19:26 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:19:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:19:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:19:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43838560
Fri 17 Jan 2014 05:19:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:19:26 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:19:26 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:19:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:19:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:19:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:19:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:19:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:19:35 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:19:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:19:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:19:35 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:19:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 05:19:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:19:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:19:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:19:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:19:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:19:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:19:36 - job_xml_thread(): Done retrieving: data size 43824151
Fri 17 Jan 2014 05:19:36 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:19:36 - XML: Start document: iteration 16
Fri 17 Jan 2014 05:19:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43824151
Fri 17 Jan 2014 05:19:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:19:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:19:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:19:42 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:19:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:19:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43824151
Fri 17 Jan 2014 05:19:42 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:19:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:19:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:19:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:19:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:19:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:19:53 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:19:54 - XML: Processed 655450 elements - found 626 jobs
Fri 17 Jan 2014 05:19:54 - job 7347318 report time 1389932165 does not match current heartbeat 1389932286 : ignoring job
Fri 17 Jan 2014 05:19:54 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 05:19:55 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 05:19:55 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:19:55 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:19:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:19:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:19:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:19:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:19:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:19:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:19:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:19:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:19:59 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:19:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:19:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:19:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:19:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:19:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:19:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:20:00 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:20:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875714
Fri 17 Jan 2014 05:20:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:20:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875714
Fri 17 Jan 2014 05:20:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:20:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:20:05 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:20:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:20:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 05:20:06 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:20:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 05:20:06 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:20:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9039 values 142657 bits 17832 bytes 
Fri 17 Jan 2014 05:20:10 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:20:10 - job_xml_thread(): Done retrieving: data size 43875714
Fri 17 Jan 2014 05:20:10 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:20:10 - XML: Start document: iteration 17
Fri 17 Jan 2014 05:20:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:20:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:20:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:20:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:20:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:20:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:20:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:20:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:20:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:20:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:20:15 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:20:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:20:19 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:20:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:20:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:20:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:20:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:20:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:20:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:20:22 - XML: Processed 655450 elements - found 626 jobs
Fri 17 Jan 2014 05:20:22 - job 7347310 appears to have finished
Fri 17 Jan 2014 05:20:22 - job 7346334 appears to have finished
Fri 17 Jan 2014 05:20:22 - job 7347318 report time 1389932165 does not match current heartbeat 1389932355 : ignoring job
Fri 17 Jan 2014 05:20:22 - job 7347320 field 'start_timestamp' changed since saved from: 1389932318 to: 1389932278
Fri 17 Jan 2014 05:20:22 - job_xml_thread(): Found 5 updated jobs.
Fri 17 Jan 2014 05:20:22 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 05:20:22 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Fri 17 Jan 2014 05:20:22 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:20:22 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:20:24 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:20:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43840460
Fri 17 Jan 2014 05:20:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:20:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43840460
Fri 17 Jan 2014 05:20:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:20:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:20:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:20:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:20:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:20:37 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:20:37 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:20:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:20:38 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:20:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:20:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:20:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:20:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:20:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:20:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:20:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:20:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:20:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:20:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:20:39 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:20:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 05:20:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:20:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:20:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:20:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:20:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:20:41 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:20:41 - job_xml_thread(): Done retrieving: data size 43861201
Fri 17 Jan 2014 05:20:41 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:20:41 - XML: Start document: iteration 18
Fri 17 Jan 2014 05:20:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43861201
Fri 17 Jan 2014 05:20:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:20:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43861201
Fri 17 Jan 2014 05:20:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:20:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:20:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:20:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:20:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:21:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:21:03 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:21:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:21:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:21:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:21:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:21:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:21:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:21:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:21:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:21:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:21:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:21:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:21:05 - XML: Processed 655448 elements - found 625 jobs
Fri 17 Jan 2014 05:21:05 - job 7347273 appears to have finished
Fri 17 Jan 2014 05:21:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:21:05 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 05:21:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:21:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:21:05 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 05:21:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:21:05 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 05:21:05 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:21:05 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:21:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:21:06 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:21:07 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:21:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 05:21:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:21:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 05:21:07 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:21:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5898 values 93060 bits 11632 bytes 
Fri 17 Jan 2014 05:21:08 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:21:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853113
Fri 17 Jan 2014 05:21:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:21:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853113
Fri 17 Jan 2014 05:21:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:21:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:21:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:21:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:21:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:21:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:21:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:21:20 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:21:20 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:21:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:21:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:21:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:21:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:21:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:21:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:21:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:21:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:21:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:21:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:21:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:21:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:21:24 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:21:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 05:21:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:21:24 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:21:24 - job_xml_thread(): Done retrieving: data size 43858513
Fri 17 Jan 2014 05:21:24 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:21:24 - XML: Start document: iteration 19
Fri 17 Jan 2014 05:21:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43858513
Fri 17 Jan 2014 05:21:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858513
Fri 17 Jan 2014 05:21:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:21:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:21:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:21:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:21:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:21:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:21:43 - XML: Processed 655448 elements - found 625 jobs
Fri 17 Jan 2014 05:21:43 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 05:21:43 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 05:21:43 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:21:43 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:21:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:21:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:21:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:21:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:21:45 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:21:45 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:21:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:21:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:21:45 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:21:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:21:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:21:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:21:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:21:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:21:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:21:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:21:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:21:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:21:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43866865
Fri 17 Jan 2014 05:21:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:21:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43866865
Fri 17 Jan 2014 05:21:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:21:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:21:59 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:21:59 - job_xml_thread(): Done retrieving: data size 43866865
Fri 17 Jan 2014 05:21:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:21:59 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:21:59 - XML: Start document: iteration 20
Fri 17 Jan 2014 05:22:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:22:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:22:01 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:22:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:22:01 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:22:01 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:22:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:22:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:22:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:22:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:22:07 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:22:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:22:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 05:22:07 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:22:08 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:22:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 05:22:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7048 values 111216 bits 13902 bytes 
Fri 17 Jan 2014 05:22:08 - XML: Processed 655443 elements - found 624 jobs
Fri 17 Jan 2014 05:22:08 - job 7346328 appears to have finished
Fri 17 Jan 2014 05:22:08 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 05:22:08 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 05:22:09 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 05:22:09 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:22:09 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:22:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:22:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:22:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:22:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:22:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:22:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:22:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:22:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:22:12 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:22:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 05:22:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:22:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:22:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43838503
Fri 17 Jan 2014 05:22:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:22:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43838503
Fri 17 Jan 2014 05:22:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:22:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:22:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:22:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:22:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:22:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:22:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:22:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:22:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:22:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:22:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:22:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:22:24 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:22:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:22:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:22:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:22:27 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:22:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:22:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:22:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:22:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:22:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:22:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:22:29 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:22:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870559
Fri 17 Jan 2014 05:22:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:22:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870559
Fri 17 Jan 2014 05:22:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:22:30 - job_xml_thread(): Done retrieving: data size 43870559
Fri 17 Jan 2014 05:22:30 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:22:30 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 05:22:32 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 05:22:32 - Housekeeping: done.
Fri 17 Jan 2014 05:22:32 - XML: Start document: iteration 0
Fri 17 Jan 2014 05:22:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:22:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:22:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:22:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:22:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:22:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:22:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:22:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:22:48 - XML: Processed 655450 elements - found 626 jobs
Fri 17 Jan 2014 05:22:48 - job 7347321 report time 1389932407 does not match current heartbeat 1389932475 : ignoring job
Fri 17 Jan 2014 05:22:48 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 05:22:48 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 05:22:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:22:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:22:48 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:22:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:22:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:22:49 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 05:22:49 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:22:49 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:22:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:22:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:22:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:22:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:22:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:22:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:22:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:22:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:22:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:22:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867610
Fri 17 Jan 2014 05:22:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:22:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43867610
Fri 17 Jan 2014 05:22:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:23:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:23:03 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:23:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:23:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:23:04 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:23:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:23:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:23:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:23:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:23:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:23:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:23:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:23:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:23:06 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:23:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:23:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:23:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:23:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:23:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:23:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:23:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:23:08 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:23:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:23:08 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:23:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 05:23:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 05:23:08 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:23:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148659 bits 18582 bytes 
Fri 17 Jan 2014 05:23:08 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:23:08 - job_xml_thread(): Done retrieving: data size 43796128
Fri 17 Jan 2014 05:23:08 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:23:08 - XML: Start document: iteration 1
Fri 17 Jan 2014 05:23:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43796128
Fri 17 Jan 2014 05:23:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:23:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43796128
Fri 17 Jan 2014 05:23:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:23:19 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 05:23:19 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:23:20 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:23:20 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 05:23:20 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 05:23:20 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:23:20 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 05:23:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:23:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:23:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:23:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:23:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:23:25 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:23:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:23:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:23:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:23:27 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:23:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:23:27 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:23:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:23:30 - XML: Processed 654698 elements - found 624 jobs
Fri 17 Jan 2014 05:23:30 - job 7347274 appears to have finished
Fri 17 Jan 2014 05:23:30 - job 7347319 appears to have finished
Fri 17 Jan 2014 05:23:30 - job 7347325 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 05:23:30 - job 7347321 report time 1389932407 does not match current heartbeat 1389932527 : ignoring job
Fri 17 Jan 2014 05:23:30 - job 7343921 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 05:23:30 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 05:23:30 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 05:23:30 - size of cluster 'LISA Cluster': 624 hosts 79482 metrics 880565 values 13896461 bits 1737057 bytes 
Fri 17 Jan 2014 05:23:31 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 05:23:31 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:23:31 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:23:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:23:32 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:23:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:23:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:23:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:23:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:23:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:23:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:23:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:23:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43393897
Fri 17 Jan 2014 05:23:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:23:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43393897
Fri 17 Jan 2014 05:23:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:23:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:23:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:23:46 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:23:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:23:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:23:46 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:23:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:23:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:23:47 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:23:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:23:47 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:23:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:23:47 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:23:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 05:23:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:23:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:23:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:23:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:23:52 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:23:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:23:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:23:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:23:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:23:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:23:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:23:55 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:23:55 - job_xml_thread(): Done retrieving: data size 43185183
Fri 17 Jan 2014 05:23:55 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:23:55 - XML: Start document: iteration 2
Fri 17 Jan 2014 05:23:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43185183
Fri 17 Jan 2014 05:23:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43185183
Fri 17 Jan 2014 05:23:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:23:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:24:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:24:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:24:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:24:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:24:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:24:08 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:24:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:24:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 05:24:09 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:24:09 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:24:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 05:24:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6215 values 98034 bits 12254 bytes 
Fri 17 Jan 2014 05:24:11 - XML: Processed 647304 elements - found 625 jobs
Fri 17 Jan 2014 05:24:11 - job 7347254 appears to have finished
Fri 17 Jan 2014 05:24:11 - job 7347321 report time 1389932407 does not match current heartbeat 1389932596 : ignoring job
Fri 17 Jan 2014 05:24:11 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 05:24:11 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 05:24:13 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 05:24:13 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:24:13 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:24:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:24:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:24:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:24:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:24:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:24:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:24:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:24:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:24:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:24:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:24:19 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:24:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:24:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:24:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:24:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:24:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:24:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:24:20 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:24:20 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 05:24:23 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:24:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 05:24:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:24:23 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:24:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43265813
Fri 17 Jan 2014 05:24:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:24:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43265813
Fri 17 Jan 2014 05:24:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:24:28 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:24:28 - job_xml_thread(): Done retrieving: data size 43265813
Fri 17 Jan 2014 05:24:29 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:24:29 - XML: Start document: iteration 3
Fri 17 Jan 2014 05:24:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:24:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:24:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:24:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:24:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:24:40 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:24:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:24:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:24:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:24:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:24:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:24:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:24:43 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:24:43 - XML: Processed 647996 elements - found 625 jobs
Fri 17 Jan 2014 05:24:43 - job 7347321 report time 1389932407 does not match current heartbeat 1389932596 : ignoring job
Fri 17 Jan 2014 05:24:43 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 05:24:43 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 05:24:43 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:24:43 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:24:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:24:46 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:24:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:24:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:24:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:24:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:24:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:24:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:24:48 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:24:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43799444
Fri 17 Jan 2014 05:24:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:24:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43799444
Fri 17 Jan 2014 05:24:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:24:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:24:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:24:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:24:58 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:24:58 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:24:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:25:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:25:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:25:01 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:25:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:25:01 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:25:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:25:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:25:03 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:25:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:25:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:25:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:25:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:25:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:25:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:25:06 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:25:06 - job_xml_thread(): Done retrieving: data size 43839425
Fri 17 Jan 2014 05:25:06 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:25:06 - XML: Start document: iteration 4
Fri 17 Jan 2014 05:25:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43839425
Fri 17 Jan 2014 05:25:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:25:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43839425
Fri 17 Jan 2014 05:25:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:25:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:25:10 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:25:11 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:25:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:25:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 05:25:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 05:25:11 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:25:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148560 bits 18570 bytes 
Fri 17 Jan 2014 05:25:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:25:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:25:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:25:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:25:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:25:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:25:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:25:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:25:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:25:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:25:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:25:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:25:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:25:27 - XML: Processed 655430 elements - found 622 jobs
Fri 17 Jan 2014 05:25:27 - job 7347266 appears to have finished
Fri 17 Jan 2014 05:25:27 - job 7343789 appears to have finished
Fri 17 Jan 2014 05:25:27 - job 7347327 field 'start_timestamp' changed since saved from: 1389932647 to: 1389932583
Fri 17 Jan 2014 05:25:27 - job 7347328 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 05:25:27 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 05:25:27 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 05:25:28 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 05:25:28 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:25:28 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:25:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:25:30 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:25:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:25:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:25:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:25:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:25:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:25:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:25:33 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:25:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 05:25:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:25:33 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:25:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43829732
Fri 17 Jan 2014 05:25:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:25:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43829732
Fri 17 Jan 2014 05:25:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:25:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:25:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:25:43 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:25:43 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:25:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:25:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:25:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:25:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:25:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:25:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:25:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:25:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:25:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:25:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:25:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:25:48 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:25:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:25:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:25:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:25:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:25:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:25:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:25:51 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:25:51 - job_xml_thread(): Done retrieving: data size 43846923
Fri 17 Jan 2014 05:25:51 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:25:51 - XML: Start document: iteration 5
Fri 17 Jan 2014 05:25:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43846923
Fri 17 Jan 2014 05:25:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:25:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43846923
Fri 17 Jan 2014 05:25:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:25:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:26:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:26:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:26:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:26:04 - XML: Processed 655448 elements - found 625 jobs
Fri 17 Jan 2014 05:26:05 - job 7346349 appears to have finished
Fri 17 Jan 2014 05:26:05 - job 7345017 appears to have finished
Fri 17 Jan 2014 05:26:05 - job 7335193 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 05:26:05 - job_xml_thread(): Found 8 updated jobs.
Fri 17 Jan 2014 05:26:05 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 05:26:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:26:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:26:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:26:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:26:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:26:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:26:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:26:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:26:10 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:26:10 - job_xml_thread(): Done storing. succesfully stored: 8 jobs
Fri 17 Jan 2014 05:26:10 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:26:10 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:26:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:26:11 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:26:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:26:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 05:26:12 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:26:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 05:26:12 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:26:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99045 bits 12380 bytes 
Fri 17 Jan 2014 05:26:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:26:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:26:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:26:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:26:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:26:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:26:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:26:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:26:16 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 05:26:16 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 05:26:16 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:26:17 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:26:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43852942
Fri 17 Jan 2014 05:26:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:26:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43852942
Fri 17 Jan 2014 05:26:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:26:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:26:25 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:26:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:26:25 - job_xml_thread(): Done retrieving: data size 43852942
Fri 17 Jan 2014 05:26:25 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:26:25 - XML: Start document: iteration 6
Fri 17 Jan 2014 05:26:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:26:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:26:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:26:31 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:26:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:26:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:26:32 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:26:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:26:32 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:26:32 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:26:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:26:39 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:26:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 05:26:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:26:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:26:40 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:26:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:26:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:26:41 - XML: Processed 655448 elements - found 625 jobs
Fri 17 Jan 2014 05:26:41 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 05:26:41 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 05:26:41 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:26:41 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:26:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:26:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:26:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:26:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:26:42 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:26:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43848670
Fri 17 Jan 2014 05:26:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:26:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43848670
Fri 17 Jan 2014 05:26:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:26:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:26:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:26:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:26:53 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:26:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:26:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:26:53 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:26:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:26:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:26:53 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:26:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:26:56 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:26:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:26:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:26:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:26:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:26:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:26:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870523
Fri 17 Jan 2014 05:26:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:26:58 - job_xml_thread(): Done retrieving: data size 43870523
Fri 17 Jan 2014 05:26:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:26:58 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:26:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:26:58 - XML: Start document: iteration 7
Fri 17 Jan 2014 05:26:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870523
Fri 17 Jan 2014 05:26:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:26:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:26:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:27:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:27:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:27:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:27:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:27:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:27:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:27:12 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:27:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:27:12 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:27:12 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:27:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:27:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:27:12 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:27:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:27:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 05:27:13 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:27:13 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:27:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 05:27:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9041 values 142591 bits 17823 bytes 
Fri 17 Jan 2014 05:27:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:27:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:27:16 - XML: Processed 655444 elements - found 623 jobs
Fri 17 Jan 2014 05:27:16 - job 7347267 appears to have finished
Fri 17 Jan 2014 05:27:16 - job 7347325 appears to have finished
Fri 17 Jan 2014 05:27:16 - job 7347333 field 'start_timestamp' changed since saved from: 1389932749 to: 1389932704
Fri 17 Jan 2014 05:27:16 - job 7346291 appears to have finished
Fri 17 Jan 2014 05:27:16 - job 7347332 field 'start_timestamp' changed since saved from: 1389932747 to: 1389932704
Fri 17 Jan 2014 05:27:16 - job 7347331 field 'start_timestamp' changed since saved from: 1389932745 to: 1389932704
Fri 17 Jan 2014 05:27:16 - job 7347334 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 05:27:16 - job_xml_thread(): Found 8 updated jobs.
Fri 17 Jan 2014 05:27:16 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 05:27:18 - job_xml_thread(): Done storing. succesfully stored: 8 jobs
Fri 17 Jan 2014 05:27:18 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:27:18 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:27:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:27:21 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:27:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:27:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:27:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:27:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:27:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:27:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:27:23 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:27:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43836978
Fri 17 Jan 2014 05:27:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:27:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43836978
Fri 17 Jan 2014 05:27:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:27:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:27:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:27:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:27:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:27:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:27:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:27:33 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:27:33 - job_xml_thread(): Done retrieving: data size 43836978
Fri 17 Jan 2014 05:27:33 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:27:33 - XML: Start document: iteration 8
Fri 17 Jan 2014 05:27:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:27:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:27:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:27:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:27:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43836978
Fri 17 Jan 2014 05:27:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:27:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:27:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:27:46 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:27:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 05:27:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:27:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:27:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:27:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:27:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:27:50 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:27:50 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:27:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:27:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:27:50 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:27:53 - XML: Processed 655444 elements - found 623 jobs
Fri 17 Jan 2014 05:27:53 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 05:27:53 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 05:27:53 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:27:53 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:27:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:27:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:27:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:27:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:27:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:27:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:27:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:27:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:27:56 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:27:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865569
Fri 17 Jan 2014 05:27:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:27:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43865569
Fri 17 Jan 2014 05:27:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:28:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:28:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:28:08 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:28:08 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:28:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:28:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:28:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:28:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:28:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:28:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:28:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:28:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:28:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:28:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:28:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:28:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:28:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:28:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:28:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:28:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:28:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:28:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:28:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:28:13 - job_xml_thread(): Done retrieving: data size 43874243
Fri 17 Jan 2014 05:28:13 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:28:13 - XML: Start document: iteration 9
Fri 17 Jan 2014 05:28:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43874243
Fri 17 Jan 2014 05:28:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:28:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43874243
Fri 17 Jan 2014 05:28:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:28:13 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:28:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:28:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:28:14 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:28:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 05:28:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 05:28:15 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:28:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6111 values 96400 bits 12050 bytes 
Fri 17 Jan 2014 05:28:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:28:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:28:25 - XML: Processed 655450 elements - found 626 jobs
Fri 17 Jan 2014 05:28:25 - job 7347336 field 'start_timestamp' changed since saved from: 1389932800 to: 1389932765
Fri 17 Jan 2014 05:28:25 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 05:28:25 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 05:28:27 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 05:28:27 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:28:27 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:28:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:28:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:28:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:28:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:28:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:28:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:28:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:28:34 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:28:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:28:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:28:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:28:34 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:28:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:28:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:28:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:28:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:28:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:28:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:28:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:28:37 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:28:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43872412
Fri 17 Jan 2014 05:28:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:28:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43872412
Fri 17 Jan 2014 05:28:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:28:42 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:28:42 - job_xml_thread(): Done retrieving: data size 43872412
Fri 17 Jan 2014 05:28:42 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:28:42 - XML: Start document: iteration 10
Fri 17 Jan 2014 05:28:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:28:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:28:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:28:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:28:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:28:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:28:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:28:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:28:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:28:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:28:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:28:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:28:52 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:28:55 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:28:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 05:28:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:28:56 - XML: Processed 655438 elements - found 620 jobs
Fri 17 Jan 2014 05:28:57 - job 7347323 appears to have finished
Fri 17 Jan 2014 05:28:57 - job 7347288 appears to have finished
Fri 17 Jan 2014 05:28:57 - job 7347328 appears to have finished
Fri 17 Jan 2014 05:28:57 - job 7346268 appears to have finished
Fri 17 Jan 2014 05:28:57 - job 7347293 appears to have finished
Fri 17 Jan 2014 05:28:57 - job 7347291 appears to have finished
Fri 17 Jan 2014 05:28:57 - job_xml_thread(): Found 6 updated jobs.
Fri 17 Jan 2014 05:28:57 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 05:28:58 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Fri 17 Jan 2014 05:28:58 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:28:58 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:29:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:29:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:29:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:29:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:29:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:29:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:29:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:29:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:29:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:29:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43834299
Fri 17 Jan 2014 05:29:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:29:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43834299
Fri 17 Jan 2014 05:29:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:29:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:29:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:29:13 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:29:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:29:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:29:14 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:29:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:29:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:29:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:29:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:29:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:29:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:29:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:29:15 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:29:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:29:16 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:29:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:29:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 05:29:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:29:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:29:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 05:29:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:29:16 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:29:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5927 values 93491 bits 11686 bytes 
Fri 17 Jan 2014 05:29:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:29:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:29:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:29:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:29:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:29:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:29:19 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:29:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 05:29:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:29:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:29:19 - job_xml_thread(): Done retrieving: data size 43782703
Fri 17 Jan 2014 05:29:19 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:29:19 - XML: Start document: iteration 11
Fri 17 Jan 2014 05:29:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43782703
Fri 17 Jan 2014 05:29:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:29:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43782703
Fri 17 Jan 2014 05:29:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:29:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:29:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:29:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:29:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:29:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:29:35 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:29:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:29:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:29:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:29:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:29:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:29:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:29:35 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:29:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:29:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:29:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:29:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:29:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:29:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:29:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:29:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:29:41 - XML: Processed 654690 elements - found 620 jobs
Fri 17 Jan 2014 05:29:41 - job 7347340 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 05:29:41 - job 7343923 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 05:29:41 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 05:29:41 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 05:29:41 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 05:29:41 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:29:41 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:29:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:29:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43286713
Fri 17 Jan 2014 05:29:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:29:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43286713
Fri 17 Jan 2014 05:29:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:29:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:29:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:29:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:29:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:29:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:29:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:29:57 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:29:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:29:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:29:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:29:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:29:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:29:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:29:57 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:29:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:29:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:29:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:29:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:29:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:29:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:29:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:29:59 - job_xml_thread(): Done retrieving: data size 43212558
Fri 17 Jan 2014 05:29:59 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:29:59 - XML: Start document: iteration 12
Fri 17 Jan 2014 05:29:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43212558
Fri 17 Jan 2014 05:29:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:30:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43212558
Fri 17 Jan 2014 05:30:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:30:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:30:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:30:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:30:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:30:12 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:30:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:30:12 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:30:12 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:30:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:30:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:30:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:30:15 - XML: Processed 647252 elements - found 621 jobs
Fri 17 Jan 2014 05:30:15 - job 7347285 appears to have finished
Fri 17 Jan 2014 05:30:15 - job 7343923 field 'start_timestamp' changed since saved from: 1389932889 to: 1389932887
Fri 17 Jan 2014 05:30:15 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 05:30:15 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 05:30:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:30:16 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:30:16 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 05:30:16 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:30:16 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:30:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:30:17 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:30:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 05:30:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 05:30:17 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:30:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148604 bits 18575 bytes 
Fri 17 Jan 2014 05:30:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:30:20 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:30:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:30:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:30:20 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 05:30:20 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:30:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:30:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:30:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:30:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:30:20 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:30:20 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 05:30:20 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 05:30:20 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:30:20 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 05:30:21 - size of cluster 'LISA Cluster': 624 hosts 79482 metrics 885590 values 13964047 bits 1745505 bytes 
Fri 17 Jan 2014 05:30:24 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:30:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43246978
Fri 17 Jan 2014 05:30:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:30:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43246978
Fri 17 Jan 2014 05:30:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:30:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:30:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:30:32 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:30:32 - job_xml_thread(): Done retrieving: data size 43246978
Fri 17 Jan 2014 05:30:32 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:30:33 - XML: Start document: iteration 13
Fri 17 Jan 2014 05:30:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:30:34 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:30:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:30:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:30:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:30:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:30:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:30:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:30:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:30:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:30:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:30:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:30:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:30:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:30:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:30:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:30:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:30:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:30:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:30:45 - XML: Processed 648000 elements - found 621 jobs
Fri 17 Jan 2014 05:30:45 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 05:30:45 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 05:30:45 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:30:45 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:30:45 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:30:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 05:30:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:30:47 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:30:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43790014
Fri 17 Jan 2014 05:30:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:30:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43790014
Fri 17 Jan 2014 05:30:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:30:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:30:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:30:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:30:56 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:30:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:30:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:30:56 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:30:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:30:56 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:30:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43790014
Fri 17 Jan 2014 05:30:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:30:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:30:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:31:00 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:31:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:31:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:31:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:31:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:31:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:31:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:31:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:31:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:31:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:31:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:31:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:31:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:31:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:31:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:31:12 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:31:12 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:31:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:31:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:31:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:31:13 - job_xml_thread(): Done retrieving: data size 43835977
Fri 17 Jan 2014 05:31:13 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:31:13 - XML: Start document: iteration 14
Fri 17 Jan 2014 05:31:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43835977
Fri 17 Jan 2014 05:31:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:31:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43835977
Fri 17 Jan 2014 05:31:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:31:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:31:18 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:31:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:31:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 05:31:18 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:31:18 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:31:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 05:31:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8956 values 141336 bits 17667 bytes 
Fri 17 Jan 2014 05:31:21 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:31:21 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 05:31:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:31:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:31:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:31:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:31:28 - XML: Processed 655422 elements - found 618 jobs
Fri 17 Jan 2014 05:31:28 - job 7347280 appears to have finished
Fri 17 Jan 2014 05:31:29 - job 7347327 appears to have finished
Fri 17 Jan 2014 05:31:29 - job 7347334 appears to have finished
Fri 17 Jan 2014 05:31:29 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 05:31:29 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 05:31:30 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 05:31:30 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:31:30 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:31:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:31:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:31:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:31:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:31:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:31:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:31:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:31:34 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:31:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:31:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:31:36 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:31:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:31:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:31:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:31:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:31:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:31:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:31:40 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:31:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43864989
Fri 17 Jan 2014 05:31:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:31:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43864989
Fri 17 Jan 2014 05:31:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:31:45 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:31:45 - job_xml_thread(): Done retrieving: data size 43864989
Fri 17 Jan 2014 05:31:45 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:31:45 - XML: Start document: iteration 15
Fri 17 Jan 2014 05:31:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:31:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:31:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:31:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:31:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:31:53 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:31:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:31:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:31:56 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:31:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:31:56 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:31:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:31:56 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:31:59 - XML: Processed 655432 elements - found 618 jobs
Fri 17 Jan 2014 05:31:59 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 05:31:59 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 05:31:59 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:31:59 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:32:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:32:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:32:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:32:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:32:04 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:32:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 05:32:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:32:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:32:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:32:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:32:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:32:07 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:32:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43832487
Fri 17 Jan 2014 05:32:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:32:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43832487
Fri 17 Jan 2014 05:32:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:32:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:32:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:32:15 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:32:15 - job_xml_thread(): Done retrieving: data size 43832487
Fri 17 Jan 2014 05:32:15 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:32:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:32:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:32:15 - XML: Start document: iteration 16
Fri 17 Jan 2014 05:32:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:32:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:32:17 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:32:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:32:17 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:32:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:32:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:32:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:32:19 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:32:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:32:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:32:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:32:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 05:32:21 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:32:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5883 values 93070 bits 11633 bytes 
Fri 17 Jan 2014 05:32:21 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:32:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 05:32:26 - XML: Processed 655432 elements - found 617 jobs
Fri 17 Jan 2014 05:32:26 - job 7346355 appears to have finished
Fri 17 Jan 2014 05:32:26 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 05:32:26 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 05:32:28 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 05:32:28 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:32:28 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:32:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:32:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:32:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:32:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:32:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:32:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:32:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:32:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:32:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:32:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43826470
Fri 17 Jan 2014 05:32:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:32:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43826470
Fri 17 Jan 2014 05:32:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:32:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:32:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:32:43 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:32:43 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:32:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:32:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:32:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:32:46 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:32:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:32:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:32:47 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:32:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:32:47 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:32:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:32:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:32:49 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:32:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:32:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:32:50 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:32:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 05:32:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:32:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:32:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:32:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:32:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:32:53 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:32:53 - job_xml_thread(): Done retrieving: data size 43848254
Fri 17 Jan 2014 05:32:53 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:32:53 - XML: Start document: iteration 17
Fri 17 Jan 2014 05:32:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43848254
Fri 17 Jan 2014 05:32:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:32:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43848254
Fri 17 Jan 2014 05:32:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:33:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:33:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:33:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:33:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:33:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:33:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:33:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:33:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:33:11 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:33:11 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:33:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:33:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:33:11 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:33:12 - XML: Processed 655430 elements - found 616 jobs
Fri 17 Jan 2014 05:33:12 - job 7347300 appears to have finished
Fri 17 Jan 2014 05:33:12 - job 7347340 appears to have finished
Fri 17 Jan 2014 05:33:12 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 05:33:12 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 05:33:13 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 05:33:13 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:33:13 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:33:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:33:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:33:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:33:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:33:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:33:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:33:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:33:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:33:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:33:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43837042
Fri 17 Jan 2014 05:33:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:33:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43837042
Fri 17 Jan 2014 05:33:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:33:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:33:21 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:33:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:33:22 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:33:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 05:33:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 05:33:22 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:33:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8947 values 141334 bits 17666 bytes 
Fri 17 Jan 2014 05:33:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:33:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:33:28 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:33:28 - job_xml_thread(): Done retrieving: data size 43837042
Fri 17 Jan 2014 05:33:28 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:33:28 - XML: Start document: iteration 18
Fri 17 Jan 2014 05:33:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:33:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:33:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:33:34 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:33:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:33:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:33:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:33:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:33:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:33:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:33:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:33:40 - XML: Processed 655430 elements - found 616 jobs
Fri 17 Jan 2014 05:33:40 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 05:33:40 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 05:33:40 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:33:40 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:33:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:33:44 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:33:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:33:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:33:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:33:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:33:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:33:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:33:47 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:33:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43842914
Fri 17 Jan 2014 05:33:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:33:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43842914
Fri 17 Jan 2014 05:33:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:33:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:33:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:33:55 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:33:55 - job_xml_thread(): Done retrieving: data size 43842914
Fri 17 Jan 2014 05:33:55 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:33:55 - XML: Start document: iteration 19
Fri 17 Jan 2014 05:34:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:34:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:34:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:34:01 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:34:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:34:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:34:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:34:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:34:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:34:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:34:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:34:08 - XML: Processed 655430 elements - found 616 jobs
Fri 17 Jan 2014 05:34:08 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 05:34:08 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 05:34:08 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:34:08 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:34:10 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:34:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 05:34:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:34:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:34:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:34:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:34:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:34:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:34:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:34:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:34:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:34:12 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 05:34:12 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 05:34:12 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:34:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:34:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851266
Fri 17 Jan 2014 05:34:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:34:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851266
Fri 17 Jan 2014 05:34:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:34:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:34:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:34:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:34:22 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:34:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:34:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:34:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:34:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:34:23 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:34:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:34:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:34:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:34:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:34:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:34:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:34:24 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:34:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 05:34:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 05:34:24 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:34:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5640 values 88928 bits 11116 bytes 
Fri 17 Jan 2014 05:34:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:34:27 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:34:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:34:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:34:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:34:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:34:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:34:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:34:29 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:34:29 - job_xml_thread(): Done retrieving: data size 43865592
Fri 17 Jan 2014 05:34:29 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:34:29 - XML: Start document: iteration 20
Fri 17 Jan 2014 05:34:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865592
Fri 17 Jan 2014 05:34:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43865592
Fri 17 Jan 2014 05:34:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:34:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:34:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:34:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:34:42 - XML: Processed 655434 elements - found 618 jobs
Fri 17 Jan 2014 05:34:42 - job 7347343 report time 1389933130 does not match current heartbeat 1389933199 : ignoring job
Fri 17 Jan 2014 05:34:42 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 05:34:42 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 05:34:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:34:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:34:43 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 05:34:43 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:34:43 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:34:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:34:48 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:34:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:34:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:34:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:34:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:34:49 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:34:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:34:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:34:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:34:52 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:34:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:34:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:34:52 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:34:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 05:34:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:34:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:34:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:34:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:34:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:34:54 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:34:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873746
Fri 17 Jan 2014 05:34:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:34:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873746
Fri 17 Jan 2014 05:34:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:34:58 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:34:58 - job_xml_thread(): Done retrieving: data size 43873746
Fri 17 Jan 2014 05:34:58 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:34:58 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 05:34:59 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 05:34:59 - Housekeeping: done.
Fri 17 Jan 2014 05:34:59 - XML: Start document: iteration 0
Fri 17 Jan 2014 05:35:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:35:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:35:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:35:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:35:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:35:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:35:07 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:35:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:35:07 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:35:07 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:35:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:35:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:35:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:35:14 - XML: Processed 655434 elements - found 618 jobs
Fri 17 Jan 2014 05:35:14 - job 7347346 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 05:35:14 - job 7347343 report time 1389933130 does not match current heartbeat 1389933251 : ignoring job
Fri 17 Jan 2014 05:35:14 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 05:35:14 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 05:35:14 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 05:35:14 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:35:14 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:35:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:35:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:35:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:35:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:35:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:35:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:35:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:35:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:35:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:35:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43755880
Fri 17 Jan 2014 05:35:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:35:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43755880
Fri 17 Jan 2014 05:35:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:35:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:35:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:35:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:35:24 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:35:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:35:25 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:35:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 05:35:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 05:35:25 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:35:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8927 values 140779 bits 17597 bytes 
Fri 17 Jan 2014 05:35:30 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:35:30 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:35:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:35:31 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:35:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:35:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:35:32 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:35:32 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:35:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:35:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:35:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:35:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:35:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:35:34 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:35:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:35:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:35:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:35:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:35:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:35:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:35:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:35:36 - job_xml_thread(): Done retrieving: data size 43298098
Fri 17 Jan 2014 05:35:36 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:35:36 - XML: Start document: iteration 1
Fri 17 Jan 2014 05:35:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43298098
Fri 17 Jan 2014 05:35:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43298098
Fri 17 Jan 2014 05:35:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:35:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:35:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:35:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:35:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:35:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:35:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:35:54 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:35:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:35:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:35:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:35:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:35:55 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:35:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:35:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:35:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:35:59 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:35:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:35:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:35:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:35:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:35:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:35:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:35:59 - XML: Processed 648580 elements - found 618 jobs
Fri 17 Jan 2014 05:35:59 - job 7347343 report time 1389933130 does not match current heartbeat 1389933251 : ignoring job
Fri 17 Jan 2014 05:35:59 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 05:35:59 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 05:35:59 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:35:59 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:36:00 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:36:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 05:36:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:36:01 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:36:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43175570
Fri 17 Jan 2014 05:36:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:36:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43175570
Fri 17 Jan 2014 05:36:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:36:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:36:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:36:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:36:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:36:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:36:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:36:12 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:36:12 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:36:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:36:12 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:36:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:36:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:36:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:36:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:36:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:36:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:36:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:36:14 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:36:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:36:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:36:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:36:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:36:16 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:36:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43244649
Fri 17 Jan 2014 05:36:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:36:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43244649
Fri 17 Jan 2014 05:36:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:36:16 - job_xml_thread(): Done retrieving: data size 43244649
Fri 17 Jan 2014 05:36:16 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:36:16 - XML: Start document: iteration 2
Fri 17 Jan 2014 05:36:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:36:25 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:36:27 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:36:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:36:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 05:36:27 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:36:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 05:36:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:36:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:36:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8728 values 137567 bits 17195 bytes 
Fri 17 Jan 2014 05:36:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:36:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:36:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:36:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:36:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:36:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:36:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:36:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:36:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:36:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:36:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:36:39 - XML: Processed 647838 elements - found 618 jobs
Fri 17 Jan 2014 05:36:39 - job 7347271 appears to have finished
Fri 17 Jan 2014 05:36:39 - job 7347343 report time 1389933130 does not match current heartbeat 1389933320 : ignoring job
Fri 17 Jan 2014 05:36:39 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 05:36:39 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 05:36:39 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 05:36:39 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:36:39 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:36:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:36:40 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:36:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:36:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:36:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:36:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:36:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:36:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:36:42 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:36:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43693131
Fri 17 Jan 2014 05:36:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:36:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43693131
Fri 17 Jan 2014 05:36:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:36:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:36:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:36:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:36:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:36:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:36:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:36:51 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:36:51 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:36:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:36:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43693131
Fri 17 Jan 2014 05:36:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:36:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:36:54 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:36:54 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:36:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:36:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:37:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:37:00 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:37:02 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:37:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 05:37:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:37:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:37:03 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:37:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:37:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:37:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:37:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:37:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:37:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:37:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:37:05 - job_xml_thread(): Done retrieving: data size 43820355
Fri 17 Jan 2014 05:37:05 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:37:05 - XML: Start document: iteration 3
Fri 17 Jan 2014 05:37:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43820355
Fri 17 Jan 2014 05:37:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:37:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:37:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:37:08 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:37:08 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:37:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:37:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:37:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43820355
Fri 17 Jan 2014 05:37:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:37:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:37:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:37:21 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 05:37:21 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:37:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:37:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:37:24 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:37:24 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:37:24 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 05:37:24 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 05:37:24 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 05:37:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:37:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:37:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:37:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:37:26 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:37:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:37:26 - XML: Processed 655418 elements - found 616 jobs
Fri 17 Jan 2014 05:37:26 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:37:26 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:37:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:37:26 - job 7347246 appears to have finished
Fri 17 Jan 2014 05:37:27 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 05:37:27 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 05:37:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:37:27 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:37:28 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 05:37:28 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:37:28 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:37:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:37:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 05:37:28 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:37:28 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:37:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 05:37:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5946 values 93821 bits 11727 bytes 
Fri 17 Jan 2014 05:37:28 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 801453 values 12652275 bits 1581534 bytes 
Fri 17 Jan 2014 05:37:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:37:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:37:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:37:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:37:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:37:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:37:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:37:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:37:33 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:37:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 05:37:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:37:34 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:37:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43841252
Fri 17 Jan 2014 05:37:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:37:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43841252
Fri 17 Jan 2014 05:37:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:37:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:37:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:37:43 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:37:43 - job_xml_thread(): Done retrieving: data size 43841252
Fri 17 Jan 2014 05:37:44 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:37:44 - XML: Start document: iteration 4
Fri 17 Jan 2014 05:37:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:37:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:37:45 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:37:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:37:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:37:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:37:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:37:47 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:37:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:37:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:37:47 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:37:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:37:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:37:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:37:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:37:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:37:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:37:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:37:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:37:56 - XML: Processed 655430 elements - found 616 jobs
Fri 17 Jan 2014 05:37:56 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 05:37:56 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 05:37:56 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:37:56 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:37:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:37:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43844160
Fri 17 Jan 2014 05:37:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:37:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43844160
Fri 17 Jan 2014 05:37:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:38:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:38:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:38:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:38:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:38:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:38:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:38:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:38:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:38:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:38:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:38:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:38:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:38:10 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:38:11 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:38:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:38:13 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:38:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:38:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:38:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:38:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:38:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:38:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:38:16 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:38:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867955
Fri 17 Jan 2014 05:38:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:38:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43867955
Fri 17 Jan 2014 05:38:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:38:18 - job_xml_thread(): Done retrieving: data size 43867955
Fri 17 Jan 2014 05:38:18 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:38:18 - XML: Start document: iteration 5
Fri 17 Jan 2014 05:38:24 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:38:24 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 05:38:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:38:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:38:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:38:29 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:38:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:38:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:38:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:38:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 05:38:30 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:38:30 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:38:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 05:38:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148592 bits 18574 bytes 
Fri 17 Jan 2014 05:38:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:38:36 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:38:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:38:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:38:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:38:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:38:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:38:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:38:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:38:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:38:38 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:38:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:38:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:38:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:38:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:38:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:38:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:38:40 - XML: Processed 655432 elements - found 617 jobs
Fri 17 Jan 2014 05:38:40 - job 7346354 appears to have finished
Fri 17 Jan 2014 05:38:40 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 05:38:40 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 05:38:40 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 05:38:40 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:38:40 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:38:44 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:38:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43861145
Fri 17 Jan 2014 05:38:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:38:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43861145
Fri 17 Jan 2014 05:38:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:38:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:38:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:38:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:38:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:38:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:38:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:38:53 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:38:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:38:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:38:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:38:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43861145
Fri 17 Jan 2014 05:38:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:38:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:38:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:38:56 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:38:56 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:39:01 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:39:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 05:39:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:39:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:39:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:39:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:39:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:39:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:39:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:39:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:39:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:39:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:39:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:39:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:39:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:39:08 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:39:08 - job_xml_thread(): Done retrieving: data size 43824003
Fri 17 Jan 2014 05:39:08 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:39:08 - XML: Start document: iteration 6
Fri 17 Jan 2014 05:39:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43824003
Fri 17 Jan 2014 05:39:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:39:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:39:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:39:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43824003
Fri 17 Jan 2014 05:39:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:39:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:39:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:39:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:39:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:39:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:39:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:39:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:39:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:39:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:39:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:39:30 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:39:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:39:30 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:39:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:39:30 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:39:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:39:31 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:39:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:39:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 05:39:32 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:39:32 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:39:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 05:39:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6122 values 96529 bits 12066 bytes 
Fri 17 Jan 2014 05:39:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:39:32 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:39:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:39:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:39:33 - XML: Processed 655432 elements - found 617 jobs
Fri 17 Jan 2014 05:39:33 - job 7347346 appears to have finished
Fri 17 Jan 2014 05:39:33 - job 7347347 report time 1389933440 does not match current heartbeat 1389933492 : ignoring job
Fri 17 Jan 2014 05:39:33 - job 7347349 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 05:39:33 - job 7347348 field 'start_timestamp' changed since saved from: 1389933454 to: 1389933406
Fri 17 Jan 2014 05:39:33 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 05:39:33 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 05:39:33 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 05:39:33 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:39:33 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:39:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:39:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:39:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:39:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:39:37 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:39:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43847087
Fri 17 Jan 2014 05:39:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:39:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43847087
Fri 17 Jan 2014 05:39:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:39:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:39:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:39:48 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:39:48 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:39:48 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:39:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 05:39:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:39:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:39:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:39:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:39:49 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:39:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:39:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:39:51 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:39:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:39:51 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:39:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:39:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:39:52 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:39:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:39:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:39:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:39:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:39:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:39:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:39:56 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:39:56 - job_xml_thread(): Done retrieving: data size 43860353
Fri 17 Jan 2014 05:39:56 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:39:56 - XML: Start document: iteration 7
Fri 17 Jan 2014 05:39:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43860353
Fri 17 Jan 2014 05:39:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43860353
Fri 17 Jan 2014 05:39:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:39:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:40:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:40:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:40:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:40:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:40:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:40:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:40:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:40:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:40:12 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:40:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:40:12 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:40:12 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:40:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:40:13 - XML: Processed 655434 elements - found 618 jobs
Fri 17 Jan 2014 05:40:13 - job 7347347 report time 1389933440 does not match current heartbeat 1389933561 : ignoring job
Fri 17 Jan 2014 05:40:13 - job 7347350 report time 1389933492 does not match current heartbeat 1389933561 : ignoring job
Fri 17 Jan 2014 05:40:13 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 05:40:13 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 05:40:13 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 05:40:13 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:40:13 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:40:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:40:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:40:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:40:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:40:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:40:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:40:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:40:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:40:21 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:40:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43832517
Fri 17 Jan 2014 05:40:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:40:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43832517
Fri 17 Jan 2014 05:40:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:40:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:40:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:40:29 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:40:29 - job_xml_thread(): Done retrieving: data size 43832517
Fri 17 Jan 2014 05:40:29 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:40:29 - XML: Start document: iteration 8
Fri 17 Jan 2014 05:40:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:40:32 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:40:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:40:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 05:40:34 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:40:34 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:40:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 05:40:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9135 values 144044 bits 18005 bytes 
Fri 17 Jan 2014 05:40:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:40:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:40:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:40:38 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:40:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:40:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:40:39 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:40:39 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:40:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:40:39 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:40:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:40:42 - XML: Processed 655434 elements - found 618 jobs
Fri 17 Jan 2014 05:40:42 - job 7347347 report time 1389933440 does not match current heartbeat 1389933561 : ignoring job
Fri 17 Jan 2014 05:40:42 - job 7347350 report time 1389933492 does not match current heartbeat 1389933561 : ignoring job
Fri 17 Jan 2014 05:40:42 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 05:40:42 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 05:40:42 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:40:42 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:40:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:40:44 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:40:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:40:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:40:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:40:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:40:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:40:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:40:48 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:40:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43847290
Fri 17 Jan 2014 05:40:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:40:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43847290
Fri 17 Jan 2014 05:40:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:40:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:40:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:40:57 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:40:57 - job_xml_thread(): Done retrieving: data size 43847290
Fri 17 Jan 2014 05:40:57 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:40:57 - XML: Start document: iteration 9
Fri 17 Jan 2014 05:41:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:41:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:41:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:41:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:41:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:41:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:41:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:41:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:41:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:41:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:41:05 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:41:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:41:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:41:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:41:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:41:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:41:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:41:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:41:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:41:10 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 05:41:10 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 05:41:10 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:41:12 - XML: Processed 655428 elements - found 616 jobs
Fri 17 Jan 2014 05:41:12 - job 7347249 appears to have finished
Fri 17 Jan 2014 05:41:12 - job 7347347 report time 1389933440 does not match current heartbeat 1389933561 : ignoring job
Fri 17 Jan 2014 05:41:12 - job 7347350 report time 1389933492 does not match current heartbeat 1389933561 : ignoring job
Fri 17 Jan 2014 05:41:12 - job 7347298 appears to have finished
Fri 17 Jan 2014 05:41:12 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 05:41:12 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 05:41:12 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 05:41:12 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:41:12 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:41:12 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:41:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 05:41:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:41:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:41:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43785809
Fri 17 Jan 2014 05:41:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:41:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43785809
Fri 17 Jan 2014 05:41:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:41:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:41:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:41:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:41:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:41:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:41:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:41:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:41:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:41:27 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:41:27 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:41:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:41:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:41:27 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:41:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:41:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:41:27 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:41:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:41:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:41:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:41:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:41:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:41:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:41:29 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:41:29 - job_xml_thread(): Done retrieving: data size 43429439
Fri 17 Jan 2014 05:41:29 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:41:29 - XML: Start document: iteration 10
Fri 17 Jan 2014 05:41:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43429439
Fri 17 Jan 2014 05:41:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:41:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43429439
Fri 17 Jan 2014 05:41:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:41:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:41:34 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:41:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:41:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 05:41:35 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:41:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 05:41:35 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:41:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8954 values 141160 bits 17645 bytes 
Fri 17 Jan 2014 05:41:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:41:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:41:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:41:42 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:41:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:41:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:41:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:41:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:41:43 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:41:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:41:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:41:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:41:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:41:48 - XML: Processed 650026 elements - found 618 jobs
Fri 17 Jan 2014 05:41:48 - job 7347347 report time 1389933440 does not match current heartbeat 1389933613 : ignoring job
Fri 17 Jan 2014 05:41:48 - job 7347350 report time 1389933492 does not match current heartbeat 1389933613 : ignoring job
Fri 17 Jan 2014 05:41:48 - job 7347351 report time 1389933561 does not match current heartbeat 1389933613 : ignoring job
Fri 17 Jan 2014 05:41:48 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 05:41:48 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 05:41:49 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 05:41:49 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:41:49 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:41:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:41:52 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:41:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:41:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:41:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:41:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:41:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:41:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:41:54 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:41:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43236505
Fri 17 Jan 2014 05:41:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:41:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43236505
Fri 17 Jan 2014 05:41:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:41:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:41:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:42:04 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:42:04 - job_xml_thread(): Done retrieving: data size 43236505
Fri 17 Jan 2014 05:42:04 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:42:04 - XML: Start document: iteration 11
Fri 17 Jan 2014 05:42:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:42:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:42:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:42:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:42:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:42:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:42:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:42:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:42:05 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:42:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:42:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:42:15 - XML: Processed 648018 elements - found 620 jobs
Fri 17 Jan 2014 05:42:15 - job 7347347 report time 1389933440 does not match current heartbeat 1389933681 : ignoring job
Fri 17 Jan 2014 05:42:15 - job 7347350 report time 1389933492 does not match current heartbeat 1389933681 : ignoring job
Fri 17 Jan 2014 05:42:15 - job 7347351 report time 1389933561 does not match current heartbeat 1389933681 : ignoring job
Fri 17 Jan 2014 05:42:15 - job 7347353 report time 1389933613 does not match current heartbeat 1389933681 : ignoring job
Fri 17 Jan 2014 05:42:15 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 05:42:15 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 05:42:16 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 05:42:16 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:42:16 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:42:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:42:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:42:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:42:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:42:17 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:42:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 05:42:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:42:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:42:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:42:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:42:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:42:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:42:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43211307
Fri 17 Jan 2014 05:42:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:42:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43211307
Fri 17 Jan 2014 05:42:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:42:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:42:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:42:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:42:29 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:42:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:42:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:42:30 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:42:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:42:30 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:42:30 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:42:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:42:31 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:42:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:42:32 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:42:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:42:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:42:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:42:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:42:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:42:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:42:33 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:42:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43515732
Fri 17 Jan 2014 05:42:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:42:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43515732
Fri 17 Jan 2014 05:42:34 - job_xml_thread(): Done retrieving: data size 43515732
Fri 17 Jan 2014 05:42:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:42:34 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:42:34 - XML: Start document: iteration 12
Fri 17 Jan 2014 05:42:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:42:35 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:42:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:42:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 05:42:37 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:42:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8938 values 140991 bits 17623 bytes 
Fri 17 Jan 2014 05:42:37 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:42:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 05:42:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:42:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:42:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:42:46 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:42:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:42:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:42:47 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:42:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:42:47 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:42:47 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:42:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:42:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:42:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:42:53 - XML: Processed 651178 elements - found 618 jobs
Fri 17 Jan 2014 05:42:53 - job 7346361 appears to have finished
Fri 17 Jan 2014 05:42:53 - job 7347350 report time 1389933492 does not match current heartbeat 1389933681 : ignoring job
Fri 17 Jan 2014 05:42:53 - job 7347351 report time 1389933561 does not match current heartbeat 1389933681 : ignoring job
Fri 17 Jan 2014 05:42:53 - job 7347353 report time 1389933613 does not match current heartbeat 1389933681 : ignoring job
Fri 17 Jan 2014 05:42:54 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 05:42:54 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 05:42:54 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 05:42:54 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:42:54 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:42:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:42:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:42:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:42:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:42:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:42:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:42:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:42:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:42:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:42:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43825747
Fri 17 Jan 2014 05:42:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:43:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43825747
Fri 17 Jan 2014 05:43:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:43:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:43:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:43:05 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:43:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 05:43:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:43:09 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:43:09 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:43:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:43:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:43:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:43:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:43:11 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:43:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:43:11 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:43:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:43:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:43:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:43:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:43:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:43:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:43:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:43:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:43:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:43:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:43:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:43:15 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:43:15 - job_xml_thread(): Done retrieving: data size 43860984
Fri 17 Jan 2014 05:43:15 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:43:15 - XML: Start document: iteration 13
Fri 17 Jan 2014 05:43:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43860984
Fri 17 Jan 2014 05:43:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:43:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43860984
Fri 17 Jan 2014 05:43:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:43:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:43:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:43:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:43:27 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:43:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:43:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:43:29 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:43:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:43:29 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:43:29 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:43:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:43:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:43:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:43:34 - XML: Processed 655426 elements - found 618 jobs
Fri 17 Jan 2014 05:43:34 - job 7347355 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 05:43:34 - job 7347354 report time 1389933681 does not match current heartbeat 1389933733 : ignoring job
Fri 17 Jan 2014 05:43:34 - job 7347351 report time 1389933561 does not match current heartbeat 1389933733 : ignoring job
Fri 17 Jan 2014 05:43:34 - job 7347353 report time 1389933613 does not match current heartbeat 1389933733 : ignoring job
Fri 17 Jan 2014 05:43:34 - job 7346359 appears to have finished
Fri 17 Jan 2014 05:43:34 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 05:43:34 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 05:43:34 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 05:43:34 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:43:34 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:43:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:43:36 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:43:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:43:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:43:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:43:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:43:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:43:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:43:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:43:37 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:43:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:43:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 05:43:37 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:43:37 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:43:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6248 values 98560 bits 12320 bytes 
Fri 17 Jan 2014 05:43:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 05:43:38 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:43:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43831109
Fri 17 Jan 2014 05:43:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:43:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43831109
Fri 17 Jan 2014 05:43:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:43:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:43:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:43:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:43:49 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:43:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:43:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:43:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:43:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:43:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:43:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:43:49 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:43:49 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:43:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:43:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:43:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:43:52 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:43:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:43:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:43:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:43:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:43:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:43:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:43:54 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:43:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 05:43:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:43:54 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:43:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853850
Fri 17 Jan 2014 05:43:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:43:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853850
Fri 17 Jan 2014 05:43:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:43:55 - job_xml_thread(): Done retrieving: data size 43853850
Fri 17 Jan 2014 05:43:55 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:43:55 - XML: Start document: iteration 14
Fri 17 Jan 2014 05:44:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:44:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:44:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:44:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:44:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:44:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:44:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:44:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:44:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:44:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:44:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:44:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:44:09 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:44:13 - XML: Processed 655430 elements - found 616 jobs
Fri 17 Jan 2014 05:44:13 - job 7347355 field 'start_timestamp' changed since saved from: 1389933738 to: 1389933711
Fri 17 Jan 2014 05:44:13 - job 7347315 appears to have finished
Fri 17 Jan 2014 05:44:13 - job 7347354 report time 1389933681 does not match current heartbeat 1389933802 : ignoring job
Fri 17 Jan 2014 05:44:13 - job 7347356 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 05:44:13 - job 7347353 report time 1389933613 does not match current heartbeat 1389933802 : ignoring job
Fri 17 Jan 2014 05:44:13 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 05:44:13 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 05:44:14 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 05:44:14 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:44:14 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:44:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:44:15 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:44:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:44:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:44:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:44:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:44:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:44:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:44:17 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:44:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43847885
Fri 17 Jan 2014 05:44:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:44:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43847885
Fri 17 Jan 2014 05:44:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:44:24 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 05:44:24 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:44:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:44:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:44:25 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:44:25 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:44:25 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 05:44:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:44:25 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:44:25 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 05:44:25 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 05:44:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:44:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:44:26 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:44:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:44:26 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:44:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:44:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43847885
Fri 17 Jan 2014 05:44:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:44:29 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:44:29 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:44:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:44:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:44:36 - size of cluster 'LISA Cluster': 624 hosts 79478 metrics 878479 values 13854023 bits 1731752 bytes 
Fri 17 Jan 2014 05:44:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:44:37 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:44:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:44:38 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:44:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 05:44:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 05:44:38 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:44:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6966 values 109853 bits 13731 bytes 
Fri 17 Jan 2014 05:44:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:44:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:44:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:44:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:44:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:44:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:44:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:44:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:44:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:44:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:44:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:44:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:44:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:44:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:44:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:44:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:44:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:44:43 - job_xml_thread(): Done retrieving: data size 43843293
Fri 17 Jan 2014 05:44:43 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:44:43 - XML: Start document: iteration 15
Fri 17 Jan 2014 05:44:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43843293
Fri 17 Jan 2014 05:44:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:44:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43843293
Fri 17 Jan 2014 05:44:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:44:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:44:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:44:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:44:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:44:57 - XML: Processed 655430 elements - found 616 jobs
Fri 17 Jan 2014 05:44:57 - job 7347354 report time 1389933681 does not match current heartbeat 1389933802 : ignoring job
Fri 17 Jan 2014 05:44:57 - job 7347353 report time 1389933613 does not match current heartbeat 1389933802 : ignoring job
Fri 17 Jan 2014 05:44:57 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 05:44:57 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 05:44:57 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:44:57 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:45:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:45:01 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:45:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:45:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:45:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:45:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:45:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:45:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:45:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:45:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:45:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:45:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:45:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:45:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:45:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:45:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:45:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:45:05 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:45:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 05:45:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:45:08 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:45:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856811
Fri 17 Jan 2014 05:45:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:45:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43856811
Fri 17 Jan 2014 05:45:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:45:12 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:45:12 - job_xml_thread(): Done retrieving: data size 43856811
Fri 17 Jan 2014 05:45:12 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:45:12 - XML: Start document: iteration 16
Fri 17 Jan 2014 05:45:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:45:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:45:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:45:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:45:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:45:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:45:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:45:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:45:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:45:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:45:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:45:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:45:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:45:25 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:45:25 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 05:45:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:45:31 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:45:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:45:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:45:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:45:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:45:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:45:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:45:32 - XML: Processed 655428 elements - found 615 jobs
Fri 17 Jan 2014 05:45:32 - job 7347304 appears to have finished
Fri 17 Jan 2014 05:45:32 - job 7347354 report time 1389933681 does not match current heartbeat 1389933854 : ignoring job
Fri 17 Jan 2014 05:45:32 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 05:45:32 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 05:45:32 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 05:45:32 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:45:32 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:45:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:45:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43825564
Fri 17 Jan 2014 05:45:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:45:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43825564
Fri 17 Jan 2014 05:45:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:45:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:45:38 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:45:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:45:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:45:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:45:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 05:45:39 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:45:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 05:45:39 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:45:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8627 values 135971 bits 16996 bytes 
Fri 17 Jan 2014 05:45:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:45:45 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:45:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:45:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:45:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:45:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:45:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:45:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:45:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:45:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:45:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:45:47 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:45:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:45:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:45:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:45:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:45:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:45:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:45:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:45:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:45:53 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:45:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43852117
Fri 17 Jan 2014 05:45:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:45:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43852117
Fri 17 Jan 2014 05:45:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:45:53 - job_xml_thread(): Done retrieving: data size 43852117
Fri 17 Jan 2014 05:45:53 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:45:53 - XML: Start document: iteration 17
Fri 17 Jan 2014 05:46:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:46:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:46:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:46:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:46:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:46:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:46:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:46:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:46:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:46:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:46:05 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:46:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:46:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:46:13 - XML: Processed 655420 elements - found 611 jobs
Fri 17 Jan 2014 05:46:13 - job 7335124 appears to have finished
Fri 17 Jan 2014 05:46:13 - job 7346517 appears to have finished
Fri 17 Jan 2014 05:46:13 - job 7346166 appears to have finished
Fri 17 Jan 2014 05:46:13 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 05:46:13 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 05:46:13 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 05:46:13 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:46:13 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:46:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:46:15 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:46:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:46:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:46:15 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:46:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 05:46:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:46:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:46:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:46:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:46:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:46:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:46:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43831871
Fri 17 Jan 2014 05:46:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:46:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43831871
Fri 17 Jan 2014 05:46:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:46:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:46:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:46:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:46:27 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:46:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:46:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:46:29 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:46:29 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:46:29 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:46:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:46:29 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:46:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:46:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:46:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:46:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:46:32 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:46:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:46:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:46:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:46:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:46:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:46:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:46:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:46:36 - job_xml_thread(): Done retrieving: data size 43846676
Fri 17 Jan 2014 05:46:36 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:46:36 - XML: Start document: iteration 18
Fri 17 Jan 2014 05:46:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43846676
Fri 17 Jan 2014 05:46:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:46:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43846676
Fri 17 Jan 2014 05:46:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:46:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:46:39 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:46:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:46:41 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:46:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 05:46:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 05:46:42 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:46:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:46:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:46:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8779 values 138584 bits 17323 bytes 
Fri 17 Jan 2014 05:46:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:46:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:46:51 - XML: Processed 655422 elements - found 612 jobs
Fri 17 Jan 2014 05:46:51 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 05:46:51 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 05:46:51 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 05:46:51 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:46:52 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:46:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:46:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:46:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:46:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:46:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:46:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:46:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:46:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:46:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:46:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:46:59 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:46:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:46:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:47:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:47:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:47:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:47:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:47:03 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:47:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43848244
Fri 17 Jan 2014 05:47:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:47:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43848244
Fri 17 Jan 2014 05:47:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:47:07 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:47:07 - job_xml_thread(): Done retrieving: data size 43848244
Fri 17 Jan 2014 05:47:07 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:47:07 - XML: Start document: iteration 19
Fri 17 Jan 2014 05:47:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:47:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:47:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:47:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:47:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:47:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:47:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:47:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:47:20 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:47:20 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:47:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:47:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:47:20 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:47:27 - XML: Processed 655422 elements - found 612 jobs
Fri 17 Jan 2014 05:47:27 - job 7345016 appears to have finished
Fri 17 Jan 2014 05:47:27 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 05:47:27 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 05:47:28 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 05:47:28 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:47:28 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:47:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:47:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:47:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:47:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:47:28 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:47:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 05:47:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:47:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:47:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:47:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:47:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:47:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:47:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43756114
Fri 17 Jan 2014 05:47:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:47:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43756114
Fri 17 Jan 2014 05:47:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:47:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:47:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:47:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:47:41 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:47:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:47:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 05:47:41 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:47:41 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:47:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 05:47:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5713 values 90392 bits 11299 bytes 
Fri 17 Jan 2014 05:47:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:47:43 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:47:43 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:47:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:47:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:47:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:47:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:47:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:47:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:47:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:47:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:47:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:47:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:47:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:47:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:47:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:47:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:47:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:47:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:47:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:47:51 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:47:51 - job_xml_thread(): Done retrieving: data size 43214390
Fri 17 Jan 2014 05:47:51 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:47:51 - XML: Start document: iteration 20
Fri 17 Jan 2014 05:47:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43214390
Fri 17 Jan 2014 05:47:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:47:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43214390
Fri 17 Jan 2014 05:47:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:47:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:47:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:48:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:48:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:48:10 - XML: Processed 647582 elements - found 612 jobs
Fri 17 Jan 2014 05:48:10 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 05:48:10 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 05:48:10 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:48:10 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:48:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:48:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:48:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:48:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:48:12 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:48:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:48:12 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:48:12 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:48:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:48:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:48:15 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:48:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:48:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:48:15 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:48:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 05:48:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:48:15 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 05:48:15 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 05:48:15 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:48:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:48:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:48:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:48:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:48:17 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:48:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43248846
Fri 17 Jan 2014 05:48:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:48:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43248846
Fri 17 Jan 2014 05:48:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:48:25 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:48:25 - job_xml_thread(): Done retrieving: data size 43248846
Fri 17 Jan 2014 05:48:25 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:48:25 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 05:48:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:48:27 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 05:48:27 - Housekeeping: done.
Fri 17 Jan 2014 05:48:27 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:48:27 - XML: Start document: iteration 0
Fri 17 Jan 2014 05:48:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:48:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:48:29 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:48:29 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:48:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:48:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:48:29 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:48:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:48:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:48:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:48:36 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:48:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:48:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:48:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:48:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:48:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:48:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:48:39 - XML: Processed 647974 elements - found 614 jobs
Fri 17 Jan 2014 05:48:39 - job 7347253 appears to have finished
Fri 17 Jan 2014 05:48:39 - job 7343926 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 05:48:39 - job 7347359 report time 1389933974 does not match current heartbeat 1389934043 : ignoring job
Fri 17 Jan 2014 05:48:39 - job_xml_thread(): Found 5 updated jobs.
Fri 17 Jan 2014 05:48:39 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 05:48:39 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Fri 17 Jan 2014 05:48:39 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:48:39 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:48:40 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:48:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43627674
Fri 17 Jan 2014 05:48:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:48:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43627674
Fri 17 Jan 2014 05:48:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:48:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:48:42 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:48:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:48:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 05:48:42 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:48:42 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:48:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8876 values 140208 bits 17526 bytes 
Fri 17 Jan 2014 05:48:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 05:48:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:48:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:48:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:48:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:48:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:48:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:48:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:48:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:48:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:48:52 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:48:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:48:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:48:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:48:54 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:48:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:48:55 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:48:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:48:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:48:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:48:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:48:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:48:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:48:57 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:48:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43828062
Fri 17 Jan 2014 05:48:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:48:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43828062
Fri 17 Jan 2014 05:48:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:48:58 - job_xml_thread(): Done retrieving: data size 43828062
Fri 17 Jan 2014 05:48:58 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:48:58 - XML: Start document: iteration 1
Fri 17 Jan 2014 05:49:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:49:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:49:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:49:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:49:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:49:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:49:11 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:49:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:49:11 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:49:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:49:11 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:49:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:49:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:49:21 - XML: Processed 654862 elements - found 614 jobs
Fri 17 Jan 2014 05:49:21 - job 7347279 appears to have finished
Fri 17 Jan 2014 05:49:21 - job 7346373 appears to have finished
Fri 17 Jan 2014 05:49:21 - job 7347359 report time 1389933974 does not match current heartbeat 1389934095 : ignoring job
Fri 17 Jan 2014 05:49:21 - job 7347361 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 05:49:21 - job 7347360 report time 1389934043 does not match current heartbeat 1389934095 : ignoring job
Fri 17 Jan 2014 05:49:21 - job 7347362 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 05:49:21 - job_xml_thread(): Found 6 updated jobs.
Fri 17 Jan 2014 05:49:21 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 05:49:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:49:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:49:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:49:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:49:22 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:49:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 05:49:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:49:22 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Fri 17 Jan 2014 05:49:22 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:49:22 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:49:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:49:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:49:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:49:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:49:23 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:49:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43828007
Fri 17 Jan 2014 05:49:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:49:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43828007
Fri 17 Jan 2014 05:49:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:49:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:49:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:49:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:49:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:49:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:49:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:49:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:49:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:49:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:49:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:49:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:49:37 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:49:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:49:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:49:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:49:38 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:49:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:49:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:49:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:49:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:49:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:49:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:49:40 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:49:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865933
Fri 17 Jan 2014 05:49:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:49:41 - job_xml_thread(): Done retrieving: data size 43865933
Fri 17 Jan 2014 05:49:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43865933
Fri 17 Jan 2014 05:49:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:49:41 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:49:41 - XML: Start document: iteration 2
Fri 17 Jan 2014 05:49:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:49:43 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:49:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:49:44 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:49:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 05:49:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 05:49:45 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:49:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8874 values 140044 bits 17505 bytes 
Fri 17 Jan 2014 05:49:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:49:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:49:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:49:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:49:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:49:54 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:49:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:49:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:49:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:49:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:49:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:49:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:49:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:50:01 - XML: Processed 655426 elements - found 614 jobs
Fri 17 Jan 2014 05:50:01 - job 7347359 report time 1389933974 does not match current heartbeat 1389934095 : ignoring job
Fri 17 Jan 2014 05:50:01 - job 7347360 report time 1389934043 does not match current heartbeat 1389934095 : ignoring job
Fri 17 Jan 2014 05:50:01 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 05:50:01 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 05:50:01 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:50:01 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:50:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:50:03 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:50:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:50:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:50:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:50:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:50:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:50:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:50:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:50:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43830206
Fri 17 Jan 2014 05:50:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:50:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43830206
Fri 17 Jan 2014 05:50:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:50:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:50:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:50:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:50:16 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:50:16 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:50:16 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:50:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:50:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:50:17 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:50:17 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:50:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:50:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:50:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:50:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:50:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:50:20 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:50:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:50:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:50:21 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:50:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 05:50:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:50:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:50:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:50:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:50:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:50:22 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:50:22 - job_xml_thread(): Done retrieving: data size 43847057
Fri 17 Jan 2014 05:50:22 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:50:22 - XML: Start document: iteration 3
Fri 17 Jan 2014 05:50:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43847057
Fri 17 Jan 2014 05:50:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43847057
Fri 17 Jan 2014 05:50:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:50:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:50:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:50:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:50:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:50:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:50:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:50:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:50:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:50:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:50:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:50:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:50:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:50:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:50:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:50:40 - XML: Processed 655422 elements - found 612 jobs
Fri 17 Jan 2014 05:50:40 - job 7346374 appears to have finished
Fri 17 Jan 2014 05:50:40 - job 7347356 appears to have finished
Fri 17 Jan 2014 05:50:40 - job 7347359 report time 1389933974 does not match current heartbeat 1389934164 : ignoring job
Fri 17 Jan 2014 05:50:40 - job 7347360 report time 1389934043 does not match current heartbeat 1389934164 : ignoring job
Fri 17 Jan 2014 05:50:40 - job 7347363 field 'start_timestamp' changed since saved from: 1389934114 to: 1389934079
Fri 17 Jan 2014 05:50:40 - job 7347362 field 'start_timestamp' changed since saved from: 1389934112 to: 1389934079
Fri 17 Jan 2014 05:50:40 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 05:50:40 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 05:50:41 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 05:50:41 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:50:41 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:50:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:50:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:50:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:50:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:50:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:50:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:50:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:50:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:50:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:50:45 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:50:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:50:45 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:50:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 05:50:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 05:50:45 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:50:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5779 values 91155 bits 11394 bytes 
Fri 17 Jan 2014 05:50:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:50:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43850318
Fri 17 Jan 2014 05:50:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:50:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43850318
Fri 17 Jan 2014 05:50:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:50:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:50:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:50:56 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:50:56 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:50:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:50:56 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:50:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:50:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:50:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:50:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:50:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:50:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:50:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:50:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:51:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:51:01 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:51:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:51:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:51:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:51:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:51:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:51:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:51:03 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:51:03 - job_xml_thread(): Done retrieving: data size 43836138
Fri 17 Jan 2014 05:51:03 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:51:03 - XML: Start document: iteration 4
Fri 17 Jan 2014 05:51:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43836138
Fri 17 Jan 2014 05:51:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:51:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43836138
Fri 17 Jan 2014 05:51:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:51:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:51:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:51:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:51:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:51:18 - XML: Processed 655416 elements - found 609 jobs
Fri 17 Jan 2014 05:51:18 - job 7347257 appears to have finished
Fri 17 Jan 2014 05:51:18 - job 7347194 appears to have finished
Fri 17 Jan 2014 05:51:18 - job 7347360 report time 1389934043 does not match current heartbeat 1389934216 : ignoring job
Fri 17 Jan 2014 05:51:18 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 05:51:19 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 05:51:19 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 05:51:19 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:51:19 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:51:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:51:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:51:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:51:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:51:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:51:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:51:25 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:51:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:51:25 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:51:25 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 05:51:25 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:51:25 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:51:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 05:51:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:51:25 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:51:25 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 05:51:25 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 05:51:25 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:51:25 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 05:51:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:51:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:51:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:51:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:51:28 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 852340 values 13458931 bits 1682366 bytes 
Fri 17 Jan 2014 05:51:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:51:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:51:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:51:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:51:31 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:51:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43839969
Fri 17 Jan 2014 05:51:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:51:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43839969
Fri 17 Jan 2014 05:51:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:51:34 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:51:35 - job_xml_thread(): Done retrieving: data size 43839969
Fri 17 Jan 2014 05:51:35 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:51:35 - XML: Start document: iteration 5
Fri 17 Jan 2014 05:51:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:51:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:51:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:51:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:51:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:51:45 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:51:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:51:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:51:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:51:45 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:51:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:51:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 05:51:46 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:51:46 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:51:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:51:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:51:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:51:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 05:51:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:51:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:51:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6381 values 100682 bits 12585 bytes 
Fri 17 Jan 2014 05:51:53 - XML: Processed 655416 elements - found 609 jobs
Fri 17 Jan 2014 05:51:53 - job 7347360 report time 1389934043 does not match current heartbeat 1389934216 : ignoring job
Fri 17 Jan 2014 05:51:53 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 05:51:53 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 05:51:53 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:51:53 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:51:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:51:55 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:51:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:51:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:51:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:51:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:51:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:51:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:51:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:51:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43842850
Fri 17 Jan 2014 05:51:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:51:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43842850
Fri 17 Jan 2014 05:52:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:52:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:52:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:52:08 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:52:08 - job_xml_thread(): Done retrieving: data size 43842850
Fri 17 Jan 2014 05:52:08 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:52:08 - XML: Start document: iteration 6
Fri 17 Jan 2014 05:52:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:52:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:52:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:52:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:52:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:52:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:52:20 - XML: Processed 655412 elements - found 607 jobs
Fri 17 Jan 2014 05:52:20 - job 7347316 appears to have finished
Fri 17 Jan 2014 05:52:20 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 05:52:20 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 05:52:20 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:52:20 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:52:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:52:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:52:20 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:52:20 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 05:52:20 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:52:20 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:52:21 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:52:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 05:52:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:52:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:52:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:52:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:52:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:52:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:52:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:52:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:52:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:52:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:52:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43874575
Fri 17 Jan 2014 05:52:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:52:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43874575
Fri 17 Jan 2014 05:52:26 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:52:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:52:26 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 05:52:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:52:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:52:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:52:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:52:35 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:52:35 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:52:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:52:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:52:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:52:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:52:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:52:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:52:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:52:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:52:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:52:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:52:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:52:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:52:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:52:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:52:44 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:52:44 - job_xml_thread(): Done retrieving: data size 43846686
Fri 17 Jan 2014 05:52:44 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:52:44 - XML: Start document: iteration 7
Fri 17 Jan 2014 05:52:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43846686
Fri 17 Jan 2014 05:52:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:52:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43846686
Fri 17 Jan 2014 05:52:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:52:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:52:46 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:52:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:52:47 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:52:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 05:52:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 05:52:47 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:52:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5939 values 93740 bits 11717 bytes 
Fri 17 Jan 2014 05:52:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:52:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:52:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:52:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:53:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:53:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:53:07 - XML: Processed 655412 elements - found 607 jobs
Fri 17 Jan 2014 05:53:07 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 05:53:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:53:07 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 05:53:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:53:07 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:53:07 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:53:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:53:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:53:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:53:08 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:53:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:53:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:53:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:53:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:53:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:53:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:53:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:53:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:53:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:53:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:53:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43806556
Fri 17 Jan 2014 05:53:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:53:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43806556
Fri 17 Jan 2014 05:53:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:53:22 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:53:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:53:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:53:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:53:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:53:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:53:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:53:25 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:53:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:53:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:53:26 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:53:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:53:26 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:53:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:53:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:53:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:53:28 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:53:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 05:53:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:53:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:53:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:53:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:53:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:53:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:53:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:53:31 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:53:31 - job_xml_thread(): Done retrieving: data size 43760799
Fri 17 Jan 2014 05:53:31 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:53:31 - XML: Start document: iteration 8
Fri 17 Jan 2014 05:53:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43760799
Fri 17 Jan 2014 05:53:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43760799
Fri 17 Jan 2014 05:53:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:53:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:53:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:53:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:53:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:53:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:53:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:53:46 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:53:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:53:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:53:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:53:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:53:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:53:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:53:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:53:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:53:47 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:53:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:53:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 05:53:48 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:53:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 05:53:48 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:53:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5983 values 94334 bits 11791 bytes 
Fri 17 Jan 2014 05:53:51 - XML: Processed 654664 elements - found 607 jobs
Fri 17 Jan 2014 05:53:51 - job 7347364 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 05:53:51 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 05:53:51 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 05:53:51 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 05:53:51 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:53:51 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:53:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:53:53 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:53:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:53:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:53:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:53:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:53:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:53:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:53:56 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:53:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43190121
Fri 17 Jan 2014 05:53:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:53:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43190121
Fri 17 Jan 2014 05:53:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:54:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:54:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:54:06 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:54:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:54:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:54:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:54:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:54:09 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:54:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:54:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:54:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:54:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:54:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:54:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:54:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:54:12 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:54:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:54:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:54:13 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:54:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 05:54:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:54:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:54:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:54:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:54:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:54:16 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:54:16 - job_xml_thread(): Done retrieving: data size 43225317
Fri 17 Jan 2014 05:54:16 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:54:16 - XML: Start document: iteration 9
Fri 17 Jan 2014 05:54:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43225317
Fri 17 Jan 2014 05:54:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:54:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43225317
Fri 17 Jan 2014 05:54:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:54:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:54:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:54:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:54:28 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:54:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:54:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:54:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:54:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:54:29 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:54:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:54:29 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:54:29 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:54:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:54:34 - XML: Processed 647888 elements - found 608 jobs
Fri 17 Jan 2014 05:54:34 - job 7341623 appears to have finished
Fri 17 Jan 2014 05:54:34 - job 7343927 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 05:54:34 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 05:54:34 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 05:54:35 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 05:54:35 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:54:35 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:54:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:54:40 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:54:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:54:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:54:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:54:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:54:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:54:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:54:42 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:54:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43603185
Fri 17 Jan 2014 05:54:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43603185
Fri 17 Jan 2014 05:54:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:54:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:54:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:54:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:54:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:54:48 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:54:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:54:50 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:54:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 05:54:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 05:54:50 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:54:50 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:54:50 - job_xml_thread(): Done retrieving: data size 43603185
Fri 17 Jan 2014 05:54:50 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:54:50 - XML: Start document: iteration 10
Fri 17 Jan 2014 05:54:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8895 values 140255 bits 17531 bytes 
Fri 17 Jan 2014 05:54:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:54:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:54:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:54:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:54:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:54:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:54:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:54:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:54:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:54:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:54:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:55:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:55:06 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:55:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:55:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:55:06 - XML: Processed 652656 elements - found 608 jobs
Fri 17 Jan 2014 05:55:06 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 05:55:06 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 05:55:06 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:55:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:55:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:55:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:55:06 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:55:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:55:09 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 05:55:09 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 05:55:09 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:55:10 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:55:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43839308
Fri 17 Jan 2014 05:55:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:55:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43839308
Fri 17 Jan 2014 05:55:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:55:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:55:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:55:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:55:21 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:55:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:55:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:55:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:55:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:55:22 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:55:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:55:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:55:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:55:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:55:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:55:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:55:25 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:55:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:55:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:55:25 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:55:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 05:55:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:55:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:55:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:55:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:55:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:55:27 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:55:27 - job_xml_thread(): Done retrieving: data size 43854636
Fri 17 Jan 2014 05:55:27 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:55:27 - XML: Start document: iteration 11
Fri 17 Jan 2014 05:55:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43854636
Fri 17 Jan 2014 05:55:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43854636
Fri 17 Jan 2014 05:55:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:55:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:55:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:55:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:55:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:55:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:55:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:55:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:55:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:55:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:55:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:55:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:55:44 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:55:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:55:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:55:49 - XML: Processed 655422 elements - found 612 jobs
Fri 17 Jan 2014 05:55:49 - job 7343928 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 05:55:50 - job 7347365 report time 1389934405 does not match current heartbeat 1389934457 : ignoring job
Fri 17 Jan 2014 05:55:50 - job 7347366 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 05:55:50 - job_xml_thread(): Found 6 updated jobs.
Fri 17 Jan 2014 05:55:50 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 05:55:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:55:50 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:55:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:55:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:55:50 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:55:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:55:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 05:55:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 05:55:50 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:55:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5860 values 92383 bits 11547 bytes 
Fri 17 Jan 2014 05:55:50 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Fri 17 Jan 2014 05:55:50 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:55:50 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:55:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:55:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:55:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:55:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:55:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:55:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:55:53 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:55:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43848714
Fri 17 Jan 2014 05:55:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:55:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43848714
Fri 17 Jan 2014 05:55:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:55:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:55:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:56:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:56:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:56:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:56:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:56:05 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:56:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:56:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:56:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:56:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:56:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:56:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:56:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:56:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:56:08 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:56:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:56:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:56:09 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:56:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 05:56:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:56:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:56:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:56:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:56:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:56:10 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:56:10 - job_xml_thread(): Done retrieving: data size 43875820
Fri 17 Jan 2014 05:56:10 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:56:10 - XML: Start document: iteration 12
Fri 17 Jan 2014 05:56:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875820
Fri 17 Jan 2014 05:56:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:56:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875820
Fri 17 Jan 2014 05:56:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:56:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:56:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:56:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:56:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:56:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:56:25 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:56:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:56:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:56:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:56:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:56:27 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:56:27 - XML: Processed 655422 elements - found 612 jobs
Fri 17 Jan 2014 05:56:27 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:56:27 - job 7347370 report time 1389934457 does not match current heartbeat 1389934526 : ignoring job
Fri 17 Jan 2014 05:56:27 - job 7345987 appears to have finished
Fri 17 Jan 2014 05:56:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:56:27 - job 7347365 report time 1389934405 does not match current heartbeat 1389934526 : ignoring job
Fri 17 Jan 2014 05:56:27 - job 7347369 field 'start_timestamp' changed since saved from: 1389934486 to: 1389934426
Fri 17 Jan 2014 05:56:27 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 05:56:27 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 05:56:29 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 05:56:29 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:56:30 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:56:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:56:30 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:56:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:56:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:56:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:56:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:56:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:56:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:56:31 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:56:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43850886
Fri 17 Jan 2014 05:56:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:56:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43850886
Fri 17 Jan 2014 05:56:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:56:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:56:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:56:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:56:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:56:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:56:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:56:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:56:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:56:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:56:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:56:44 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:56:45 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:56:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:56:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:56:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:56:46 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:56:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:56:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:56:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:56:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:56:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:56:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:56:48 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:56:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43857337
Fri 17 Jan 2014 05:56:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:56:48 - job_xml_thread(): Done retrieving: data size 43857337
Fri 17 Jan 2014 05:56:48 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:56:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43857337
Fri 17 Jan 2014 05:56:48 - XML: Start document: iteration 13
Fri 17 Jan 2014 05:56:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:56:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:56:51 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:56:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:56:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 05:56:52 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:56:52 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:56:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 05:56:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 10914 values 172186 bits 21523 bytes 
Fri 17 Jan 2014 05:56:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:56:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:57:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:57:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:57:08 - XML: Processed 655414 elements - found 608 jobs
Fri 17 Jan 2014 05:57:08 - job 7347370 report time 1389934457 does not match current heartbeat 1389934577 : ignoring job
Fri 17 Jan 2014 05:57:08 - job 7343788 appears to have finished
Fri 17 Jan 2014 05:57:08 - job 7346381 appears to have finished
Fri 17 Jan 2014 05:57:08 - job 7347314 appears to have finished
Fri 17 Jan 2014 05:57:08 - job 7347365 report time 1389934405 does not match current heartbeat 1389934577 : ignoring job
Fri 17 Jan 2014 05:57:08 - job 7347364 appears to have finished
Fri 17 Jan 2014 05:57:08 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 05:57:08 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 05:57:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:57:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:57:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:57:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:57:10 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 05:57:10 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:57:10 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:57:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:57:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:57:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:57:10 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:57:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:57:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:57:12 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:57:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:57:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:57:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:57:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:57:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:57:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:57:15 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:57:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851129
Fri 17 Jan 2014 05:57:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:57:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851129
Fri 17 Jan 2014 05:57:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:57:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:57:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:57:25 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:57:25 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:57:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:57:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:57:26 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:57:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:57:26 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:57:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:57:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:57:27 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:57:27 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:57:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 05:57:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:57:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:57:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:57:29 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:57:29 - job_xml_thread(): Done retrieving: data size 43855583
Fri 17 Jan 2014 05:57:29 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:57:29 - XML: Start document: iteration 14
Fri 17 Jan 2014 05:57:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:57:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:57:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:57:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:57:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855583
Fri 17 Jan 2014 05:57:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:57:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855583
Fri 17 Jan 2014 05:57:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:57:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:57:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:57:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:57:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:57:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:57:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:57:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:57:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:57:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:57:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:57:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:57:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:57:44 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:57:50 - XML: Processed 655414 elements - found 608 jobs
Fri 17 Jan 2014 05:57:50 - job 7347370 report time 1389934457 does not match current heartbeat 1389934577 : ignoring job
Fri 17 Jan 2014 05:57:50 - job 7347365 report time 1389934405 does not match current heartbeat 1389934577 : ignoring job
Fri 17 Jan 2014 05:57:50 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 05:57:50 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 05:57:50 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:57:50 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:57:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:57:52 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:57:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:57:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:57:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:57:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:57:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:57:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:57:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:57:52 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:57:53 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:57:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:57:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 05:57:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 05:57:53 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:57:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6130 values 96698 bits 12087 bytes 
Fri 17 Jan 2014 05:57:54 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:57:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43852667
Fri 17 Jan 2014 05:57:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:57:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43852667
Fri 17 Jan 2014 05:57:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:57:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:57:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:58:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:58:03 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:58:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:58:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:58:04 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:58:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:58:04 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:58:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:58:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:58:05 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:58:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:58:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:58:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:58:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:58:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:58:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:58:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:58:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:58:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:58:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:58:10 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:58:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 05:58:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:58:10 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:58:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873374
Fri 17 Jan 2014 05:58:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:58:10 - job_xml_thread(): Done retrieving: data size 43873374
Fri 17 Jan 2014 05:58:10 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:58:10 - XML: Start document: iteration 15
Fri 17 Jan 2014 05:58:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873374
Fri 17 Jan 2014 05:58:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:58:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:58:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:58:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:58:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:58:25 - XML: Processed 655408 elements - found 605 jobs
Fri 17 Jan 2014 05:58:25 - job 7347370 report time 1389934457 does not match current heartbeat 1389934646 : ignoring job
Fri 17 Jan 2014 05:58:25 - job 7347371 report time 1389934577 does not match current heartbeat 1389934646 : ignoring job
Fri 17 Jan 2014 05:58:25 - job 7347312 appears to have finished
Fri 17 Jan 2014 05:58:25 - job 7347333 appears to have finished
Fri 17 Jan 2014 05:58:25 - job 7347331 appears to have finished
Fri 17 Jan 2014 05:58:25 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 05:58:25 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 05:58:27 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 05:58:27 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:58:28 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:58:28 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 05:58:28 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:58:28 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 05:58:28 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 05:58:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:58:28 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:58:28 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 05:58:28 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:58:28 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:58:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:58:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:58:29 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:58:29 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:58:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:58:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:58:29 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:58:33 - size of cluster 'LISA Cluster': 624 hosts 79485 metrics 845793 values 13339260 bits 1667407 bytes 
Fri 17 Jan 2014 05:58:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:58:34 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:58:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:58:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:58:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:58:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:58:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:58:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:58:37 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:58:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853167
Fri 17 Jan 2014 05:58:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:58:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853167
Fri 17 Jan 2014 05:58:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:58:43 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:58:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:58:44 - job_xml_thread(): Done retrieving: data size 43853167
Fri 17 Jan 2014 05:58:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:58:44 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:58:44 - XML: Start document: iteration 16
Fri 17 Jan 2014 05:58:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:58:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:58:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:58:53 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:58:54 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:58:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 05:58:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:58:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 05:58:54 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:58:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7091 values 111885 bits 13985 bytes 
Fri 17 Jan 2014 05:58:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:58:56 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:58:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:58:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:58:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:58:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:58:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:58:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:58:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:58:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:58:59 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:58:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:58:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:58:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:58:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:58:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:58:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:59:00 - XML: Processed 655408 elements - found 605 jobs
Fri 17 Jan 2014 05:59:00 - job 7347370 report time 1389934457 does not match current heartbeat 1389934646 : ignoring job
Fri 17 Jan 2014 05:59:00 - job 7347371 report time 1389934577 does not match current heartbeat 1389934646 : ignoring job
Fri 17 Jan 2014 05:59:00 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 05:59:00 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 05:59:00 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:59:00 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:59:04 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:59:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43845567
Fri 17 Jan 2014 05:59:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:59:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43845567
Fri 17 Jan 2014 05:59:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:59:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:59:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:59:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:59:13 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:59:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:59:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:59:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:59:14 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:59:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:59:14 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:59:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:59:14 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:59:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:59:15 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:59:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:59:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:59:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:59:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:59:18 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:59:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 05:59:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:59:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:59:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:59:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:59:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:59:22 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:59:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43773406
Fri 17 Jan 2014 05:59:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43773406
Fri 17 Jan 2014 05:59:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:59:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:59:22 - job_xml_thread(): Done retrieving: data size 43773406
Fri 17 Jan 2014 05:59:22 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:59:22 - XML: Start document: iteration 17
Fri 17 Jan 2014 05:59:28 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:59:28 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 05:59:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:59:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:59:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 05:59:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:59:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 05:59:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 05:59:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 05:59:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:59:41 - XML: Processed 654662 elements - found 606 jobs
Fri 17 Jan 2014 05:59:41 - job 7347372 report time 1389934646 does not match current heartbeat 1389934698 : ignoring job
Fri 17 Jan 2014 05:59:41 - job 7347371 report time 1389934577 does not match current heartbeat 1389934698 : ignoring job
Fri 17 Jan 2014 05:59:41 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 05:59:41 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 05:59:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:59:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:59:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 05:59:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 05:59:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 05:59:41 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 05:59:41 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 05:59:41 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 05:59:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 05:59:44 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 05:59:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 05:59:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 05:59:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:59:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 05:59:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 05:59:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 05:59:47 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 05:59:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43219195
Fri 17 Jan 2014 05:59:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 05:59:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43219195
Fri 17 Jan 2014 05:59:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 05:59:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:59:54 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 05:59:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:59:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 05:59:56 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 05:59:56 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 05:59:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 05:59:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9067 values 143049 bits 17881 bytes 
Fri 17 Jan 2014 05:59:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 05:59:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 05:59:57 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 05:59:57 - job_xml_thread(): Done retrieving: data size 43219195
Fri 17 Jan 2014 05:59:57 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 05:59:57 - XML: Start document: iteration 18
Fri 17 Jan 2014 06:00:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:00:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:00:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:00:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:00:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:00:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:00:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:00:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:00:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:00:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:00:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:00:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:00:08 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:00:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:00:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:00:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:00:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:00:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:00:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:00:11 - XML: Processed 647796 elements - found 606 jobs
Fri 17 Jan 2014 06:00:11 - job 7347372 report time 1389934646 does not match current heartbeat 1389934698 : ignoring job
Fri 17 Jan 2014 06:00:11 - job 7347371 report time 1389934577 does not match current heartbeat 1389934698 : ignoring job
Fri 17 Jan 2014 06:00:11 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 06:00:11 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 06:00:11 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:00:11 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:00:15 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:00:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 06:00:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:00:15 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:00:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43214148
Fri 17 Jan 2014 06:00:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:00:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43214148
Fri 17 Jan 2014 06:00:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:00:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:00:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:00:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:00:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:00:26 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:00:26 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:00:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:00:27 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:00:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:00:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:00:27 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:00:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:00:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:00:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:00:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:00:30 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:00:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:00:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:00:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:00:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:00:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:00:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:00:33 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:00:33 - job_xml_thread(): Done retrieving: data size 43591877
Fri 17 Jan 2014 06:00:33 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:00:33 - XML: Start document: iteration 19
Fri 17 Jan 2014 06:00:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43591877
Fri 17 Jan 2014 06:00:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:00:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43591877
Fri 17 Jan 2014 06:00:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:00:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:00:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:00:46 - XML: Processed 652460 elements - found 607 jobs
Fri 17 Jan 2014 06:00:46 - job 7347374 report time 1389934698 does not match current heartbeat 1389934767 : ignoring job
Fri 17 Jan 2014 06:00:46 - job 7347372 report time 1389934646 does not match current heartbeat 1389934767 : ignoring job
Fri 17 Jan 2014 06:00:46 - job 7347371 report time 1389934577 does not match current heartbeat 1389934767 : ignoring job
Fri 17 Jan 2014 06:00:46 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 06:00:46 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 06:00:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:00:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:00:46 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 06:00:46 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:00:47 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:00:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:00:55 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:00:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:00:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:00:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:00:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:00:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:00:56 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:00:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:00:56 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:00:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:00:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:00:56 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:00:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:00:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:00:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:00:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:00:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:00:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:00:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:00:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 06:00:57 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:00:57 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:00:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 06:00:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99054 bits 12381 bytes 
Fri 17 Jan 2014 06:01:00 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:01:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43849759
Fri 17 Jan 2014 06:01:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:01:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43849759
Fri 17 Jan 2014 06:01:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:01:02 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:01:02 - job_xml_thread(): Done retrieving: data size 43849759
Fri 17 Jan 2014 06:01:02 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:01:02 - XML: Start document: iteration 20
Fri 17 Jan 2014 06:01:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:01:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:01:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:01:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:01:17 - XML: Processed 655398 elements - found 606 jobs
Fri 17 Jan 2014 06:01:17 - job 7347374 report time 1389934698 does not match current heartbeat 1389934819 : ignoring job
Fri 17 Jan 2014 06:01:17 - job 7347372 report time 1389934646 does not match current heartbeat 1389934819 : ignoring job
Fri 17 Jan 2014 06:01:17 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 06:01:17 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 06:01:17 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:01:17 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:01:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:01:21 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:01:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:01:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:01:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:01:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:01:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:01:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:01:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:01:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:01:24 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:01:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:01:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:01:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:01:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:01:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:01:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:01:24 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:01:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 06:01:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:01:26 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 06:01:26 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 06:01:26 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:01:26 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:01:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43866570
Fri 17 Jan 2014 06:01:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:01:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43866570
Fri 17 Jan 2014 06:01:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:01:32 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:01:33 - job_xml_thread(): Done retrieving: data size 43866570
Fri 17 Jan 2014 06:01:33 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:01:33 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 06:01:34 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 06:01:34 - Housekeeping: done.
Fri 17 Jan 2014 06:01:34 - XML: Start document: iteration 0
Fri 17 Jan 2014 06:01:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:01:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:01:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:01:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:01:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:01:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:01:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:01:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:01:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:01:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:01:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:01:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:01:46 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:01:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:01:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:01:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:01:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:01:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:01:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:01:47 - XML: Processed 655410 elements - found 606 jobs
Fri 17 Jan 2014 06:01:47 - job 7347374 report time 1389934698 does not match current heartbeat 1389934819 : ignoring job
Fri 17 Jan 2014 06:01:47 - job 7347372 report time 1389934646 does not match current heartbeat 1389934819 : ignoring job
Fri 17 Jan 2014 06:01:47 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 06:01:47 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 06:01:47 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:01:47 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:01:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:01:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43822374
Fri 17 Jan 2014 06:01:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:01:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43822374
Fri 17 Jan 2014 06:01:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:01:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:01:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:01:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:01:57 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:01:57 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:01:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:01:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 06:01:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 06:01:57 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:01:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8819 values 139309 bits 17413 bytes 
Fri 17 Jan 2014 06:02:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:02:00 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:02:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:02:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:02:01 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:02:01 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:02:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:02:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:02:01 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:02:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:02:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:02:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:02:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:02:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:02:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:02:02 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:02:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:02:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:02:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:02:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:02:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:02:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43848237
Fri 17 Jan 2014 06:02:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:02:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43848237
Fri 17 Jan 2014 06:02:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:02:05 - job_xml_thread(): Done retrieving: data size 43848237
Fri 17 Jan 2014 06:02:05 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:02:06 - XML: Start document: iteration 1
Fri 17 Jan 2014 06:02:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:02:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:02:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:02:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:02:25 - XML: Processed 655406 elements - found 604 jobs
Fri 17 Jan 2014 06:02:25 - job 7347374 report time 1389934698 does not match current heartbeat 1389934887 : ignoring job
Fri 17 Jan 2014 06:02:25 - job 7347375 report time 1389934819 does not match current heartbeat 1389934887 : ignoring job
Fri 17 Jan 2014 06:02:25 - job 7347330 appears to have finished
Fri 17 Jan 2014 06:02:25 - job 7343929 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 06:02:25 - job 7346389 appears to have finished
Fri 17 Jan 2014 06:02:25 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 06:02:25 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 06:02:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:02:27 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:02:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:02:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:02:27 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 06:02:27 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:02:27 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:02:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:02:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:02:27 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:02:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:02:27 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:02:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:02:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:02:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:02:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:02:28 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:02:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 06:02:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:02:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:02:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:02:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:02:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:02:30 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:02:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43871314
Fri 17 Jan 2014 06:02:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:02:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43871314
Fri 17 Jan 2014 06:02:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:02:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:02:38 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:02:42 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:02:42 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:02:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:02:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:02:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:02:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:02:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:02:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:02:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:02:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:02:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:02:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:02:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:02:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:02:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:02:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:02:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:02:45 - job_xml_thread(): Done retrieving: data size 43876758
Fri 17 Jan 2014 06:02:45 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:02:45 - XML: Start document: iteration 2
Fri 17 Jan 2014 06:02:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43876758
Fri 17 Jan 2014 06:02:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:02:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43876758
Fri 17 Jan 2014 06:02:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:02:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:02:56 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:02:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:02:57 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:02:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:02:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 06:02:58 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:02:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 06:02:58 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:02:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8857 values 140049 bits 17506 bytes 
Fri 17 Jan 2014 06:02:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:02:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:02:59 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:02:59 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:02:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:02:59 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:02:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:02:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:02:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:03:05 - XML: Processed 655404 elements - found 603 jobs
Fri 17 Jan 2014 06:03:05 - job 7347375 report time 1389934819 does not match current heartbeat 1389934887 : ignoring job
Fri 17 Jan 2014 06:03:05 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 06:03:05 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 06:03:05 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:03:05 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:03:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:03:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:03:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:03:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:03:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:03:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:03:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:03:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:03:10 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:03:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 06:03:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:03:10 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:03:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43838642
Fri 17 Jan 2014 06:03:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:03:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43838642
Fri 17 Jan 2014 06:03:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:03:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:03:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:03:20 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:03:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:03:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:03:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:03:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:03:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:03:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:03:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:03:23 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:03:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:03:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:03:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:03:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:03:25 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:03:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:03:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:03:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:03:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:03:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:03:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:03:26 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:03:26 - job_xml_thread(): Done retrieving: data size 43867030
Fri 17 Jan 2014 06:03:26 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:03:26 - XML: Start document: iteration 3
Fri 17 Jan 2014 06:03:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43867030
Fri 17 Jan 2014 06:03:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:03:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867030
Fri 17 Jan 2014 06:03:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:03:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:03:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:03:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:03:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:03:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:03:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:03:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:03:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:03:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:03:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:03:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:03:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:03:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:03:45 - XML: Processed 655404 elements - found 604 jobs
Fri 17 Jan 2014 06:03:45 - job 7347376 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 06:03:45 - job 7347375 report time 1389934819 does not match current heartbeat 1389934939 : ignoring job
Fri 17 Jan 2014 06:03:45 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 06:03:45 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 06:03:45 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 06:03:45 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:03:45 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:03:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:03:48 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:03:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:03:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:03:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:03:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:03:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:03:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:03:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:03:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43834972
Fri 17 Jan 2014 06:03:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:03:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43834972
Fri 17 Jan 2014 06:03:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:03:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:03:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:03:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:03:58 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:03:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:03:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 06:03:59 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:03:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 06:03:59 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:03:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:03:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:04:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148808 bits 18601 bytes 
Fri 17 Jan 2014 06:04:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:04:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:04:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:04:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:04:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:04:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:04:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:04:00 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:04:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:04:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:04:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:04:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:04:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:04:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:04:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:04:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:04:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:04:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:04:06 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:04:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43847330
Fri 17 Jan 2014 06:04:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:04:06 - job_xml_thread(): Done retrieving: data size 43847330
Fri 17 Jan 2014 06:04:06 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:04:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43847330
Fri 17 Jan 2014 06:04:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:04:06 - XML: Start document: iteration 4
Fri 17 Jan 2014 06:04:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:04:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:04:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:04:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:04:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:04:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:04:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:04:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:04:23 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:04:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:04:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:04:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:04:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:04:25 - XML: Processed 655406 elements - found 604 jobs
Fri 17 Jan 2014 06:04:25 - job 7347375 report time 1389934819 does not match current heartbeat 1389935008 : ignoring job
Fri 17 Jan 2014 06:04:25 - job 7346689 appears to have finished
Fri 17 Jan 2014 06:04:25 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 06:04:25 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 06:04:25 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 06:04:25 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:04:25 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:04:27 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:04:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 06:04:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:04:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:04:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:04:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:04:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:04:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:04:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:04:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:04:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:04:31 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:04:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43835605
Fri 17 Jan 2014 06:04:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:04:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43835605
Fri 17 Jan 2014 06:04:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:04:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:04:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:04:40 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:04:41 - job_xml_thread(): Done retrieving: data size 43835605
Fri 17 Jan 2014 06:04:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:04:41 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:04:41 - XML: Start document: iteration 5
Fri 17 Jan 2014 06:04:41 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:04:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:04:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:04:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:04:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:04:43 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:04:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:04:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:04:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:04:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:04:52 - XML: Processed 655403 elements - found 604 jobs
Fri 17 Jan 2014 06:04:52 - job 7347375 report time 1389934819 does not match current heartbeat 1389935008 : ignoring job
Fri 17 Jan 2014 06:04:52 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 06:04:52 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 06:04:52 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:04:52 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:04:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:04:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:04:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:04:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:04:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:04:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:04:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:04:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:04:56 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:04:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43837981
Fri 17 Jan 2014 06:04:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:04:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43837981
Fri 17 Jan 2014 06:04:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:04:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:05:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:05:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:05:00 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:05:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:05:01 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:05:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 06:05:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 06:05:01 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:05:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8792 values 138681 bits 17335 bytes 
Fri 17 Jan 2014 06:05:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:05:07 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:05:07 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:05:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:05:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:05:07 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:05:08 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:05:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:05:08 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:05:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:05:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:05:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:05:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:05:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:05:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:05:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:05:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:05:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:05:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:05:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:05:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:05:13 - job_xml_thread(): Done retrieving: data size 43787633
Fri 17 Jan 2014 06:05:13 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:05:13 - XML: Start document: iteration 6
Fri 17 Jan 2014 06:05:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43787633
Fri 17 Jan 2014 06:05:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43787633
Fri 17 Jan 2014 06:05:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:05:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:05:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:05:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:05:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:05:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:05:27 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:05:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 06:05:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:05:29 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 06:05:29 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:05:29 - XML: Processed 654652 elements - found 601 jobs
Fri 17 Jan 2014 06:05:29 - job 7347379 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 06:05:29 - job 7346388 appears to have finished
Fri 17 Jan 2014 06:05:29 - job 7346385 appears to have finished
Fri 17 Jan 2014 06:05:29 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 06:05:30 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 06:05:30 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:05:30 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 06:05:30 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 06:05:30 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:05:31 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Fri 17 Jan 2014 06:05:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:05:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:05:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:05:35 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 06:05:35 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:05:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:05:35 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:05:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:05:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:05:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:05:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:05:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:05:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:05:37 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:05:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:05:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:05:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:05:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:05:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:05:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:05:38 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:05:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43283199
Fri 17 Jan 2014 06:05:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:05:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43283199
Fri 17 Jan 2014 06:05:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:05:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:05:48 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:05:50 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:05:50 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:05:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:05:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:05:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:05:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:05:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:05:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:05:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:05:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:05:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:05:52 - job_xml_thread(): Done retrieving: data size 43210399
Fri 17 Jan 2014 06:05:52 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:05:52 - XML: Start document: iteration 7
Fri 17 Jan 2014 06:05:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:05:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:05:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43210399
Fri 17 Jan 2014 06:05:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:05:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:05:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:05:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43210399
Fri 17 Jan 2014 06:05:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:05:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:05:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:06:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:06:02 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:06:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:06:03 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:06:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 06:06:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 06:06:03 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:06:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9359 values 147599 bits 18449 bytes 
Fri 17 Jan 2014 06:06:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:06:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:06:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:06:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:06:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:06:13 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:06:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:06:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:06:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:06:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:06:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:06:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:06:15 - XML: Processed 647310 elements - found 600 jobs
Fri 17 Jan 2014 06:06:15 - job 7347313 appears to have finished
Fri 17 Jan 2014 06:06:15 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 06:06:15 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 06:06:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:06:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:06:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:06:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:06:15 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:06:15 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 06:06:15 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:06:15 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:06:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:06:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:06:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:06:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:06:17 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:06:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43253620
Fri 17 Jan 2014 06:06:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:06:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43253620
Fri 17 Jan 2014 06:06:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:06:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:06:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:06:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:06:30 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:06:30 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:06:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:06:30 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:06:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:06:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:06:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:06:30 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:06:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 06:06:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:06:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:06:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:06:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:06:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:06:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:06:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:06:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:06:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:06:31 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:06:31 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:06:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:06:32 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:06:32 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:06:32 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 06:06:32 - job_xml_thread(): Done retrieving: data size 43618494
Fri 17 Jan 2014 06:06:32 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:06:32 - XML: Start document: iteration 8
Fri 17 Jan 2014 06:06:32 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 06:06:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43618494
Fri 17 Jan 2014 06:06:32 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 06:06:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:06:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43618494
Fri 17 Jan 2014 06:06:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:06:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:06:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:06:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:06:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:06:46 - size of cluster 'LISA Cluster': 624 hosts 79474 metrics 887359 values 14013281 bits 1751660 bytes 
Fri 17 Jan 2014 06:06:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:06:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:06:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:06:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:06:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:06:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:06:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:06:52 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:06:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:06:54 - XML: Processed 652470 elements - found 601 jobs
Fri 17 Jan 2014 06:06:54 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 06:06:54 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 06:06:54 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 06:06:54 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:06:54 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:06:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:06:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:06:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:06:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:06:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:06:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:06:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:06:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:06:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:06:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43825040
Fri 17 Jan 2014 06:06:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:07:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43825040
Fri 17 Jan 2014 06:07:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:07:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:07:03 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:07:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:07:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 06:07:04 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:07:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9147 values 144299 bits 18037 bytes 
Fri 17 Jan 2014 06:07:04 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:07:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 06:07:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:07:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:07:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:07:09 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:07:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:07:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:07:09 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:07:09 - job_xml_thread(): Done retrieving: data size 43825040
Fri 17 Jan 2014 06:07:09 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:07:09 - XML: Start document: iteration 9
Fri 17 Jan 2014 06:07:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:07:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:07:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:07:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:07:10 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:07:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:07:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:07:19 - XML: Processed 654954 elements - found 601 jobs
Fri 17 Jan 2014 06:07:19 - job 7347376 appears to have finished
Fri 17 Jan 2014 06:07:19 - job 7347381 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 06:07:19 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 06:07:19 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 06:07:20 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 06:07:20 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:07:20 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:07:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:07:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:07:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:07:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:07:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:07:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:07:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:07:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:07:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:07:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:07:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:07:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43824121
Fri 17 Jan 2014 06:07:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:07:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43824121
Fri 17 Jan 2014 06:07:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:07:32 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:07:32 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 06:07:35 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:07:35 - job_xml_thread(): Done retrieving: data size 43824121
Fri 17 Jan 2014 06:07:35 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:07:35 - XML: Start document: iteration 10
Fri 17 Jan 2014 06:07:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:07:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:07:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:07:38 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:07:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:07:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:07:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:07:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:07:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:07:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:07:40 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:07:48 - XML: Processed 655400 elements - found 601 jobs
Fri 17 Jan 2014 06:07:48 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 06:07:48 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 06:07:48 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:07:48 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:07:48 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:07:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 06:07:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:07:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:07:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:07:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:07:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:07:51 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 06:07:51 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 06:07:51 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:07:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:07:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:07:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:07:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:07:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:07:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43825215
Fri 17 Jan 2014 06:07:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:07:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43825215
Fri 17 Jan 2014 06:07:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:07:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:07:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:08:04 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:08:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:08:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:08:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:08:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:08:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:08:04 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:08:04 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:08:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:08:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:08:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:08:05 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:08:06 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:08:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 06:08:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:08:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:08:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 06:08:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:08:07 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:08:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:08:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5729 values 90348 bits 11293 bytes 
Fri 17 Jan 2014 06:08:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:08:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:08:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:08:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:08:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:08:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:08:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:08:09 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:08:09 - job_xml_thread(): Done retrieving: data size 43851162
Fri 17 Jan 2014 06:08:09 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:08:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851162
Fri 17 Jan 2014 06:08:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:08:09 - XML: Start document: iteration 11
Fri 17 Jan 2014 06:08:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851162
Fri 17 Jan 2014 06:08:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:08:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:08:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:08:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:08:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:08:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:08:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:08:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:08:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:08:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:08:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:08:27 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:08:27 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:08:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:08:27 - XML: Processed 655402 elements - found 602 jobs
Fri 17 Jan 2014 06:08:27 - job 7347382 field 'start_timestamp' changed since saved from: 1389935232 to: 1389935180
Fri 17 Jan 2014 06:08:27 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 06:08:27 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 06:08:28 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 06:08:28 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:08:28 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:08:28 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:08:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 06:08:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:08:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:08:32 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:08:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:08:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:08:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:08:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:08:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:08:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:08:34 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:08:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43831690
Fri 17 Jan 2014 06:08:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:08:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43831690
Fri 17 Jan 2014 06:08:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:08:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:08:43 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:08:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:08:43 - job_xml_thread(): Done retrieving: data size 43831690
Fri 17 Jan 2014 06:08:43 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:08:43 - XML: Start document: iteration 12
Fri 17 Jan 2014 06:08:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:08:46 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:08:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:08:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:08:47 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:08:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:08:47 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:08:47 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:08:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:08:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:08:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:08:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:08:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:08:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:08:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:08:56 - XML: Processed 655402 elements - found 602 jobs
Fri 17 Jan 2014 06:08:57 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 06:08:57 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 06:08:57 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:08:57 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:08:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:08:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:08:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:08:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:08:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:08:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43841810
Fri 17 Jan 2014 06:08:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:08:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43841810
Fri 17 Jan 2014 06:08:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:09:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:09:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:09:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:09:07 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:09:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:09:08 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:09:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 06:09:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 06:09:08 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:09:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9198 values 145076 bits 18134 bytes 
Fri 17 Jan 2014 06:09:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:09:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:09:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:09:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:09:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:09:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:09:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:09:10 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:09:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:09:12 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:09:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:09:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:09:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:09:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:09:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:09:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:09:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:09:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:09:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:09:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:09:16 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:09:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43848856
Fri 17 Jan 2014 06:09:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:09:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43848856
Fri 17 Jan 2014 06:09:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:09:17 - job_xml_thread(): Done retrieving: data size 43848856
Fri 17 Jan 2014 06:09:17 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:09:17 - XML: Start document: iteration 13
Fri 17 Jan 2014 06:09:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:09:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:09:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:09:29 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:09:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:09:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:09:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:09:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:09:30 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:09:30 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:09:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:09:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:09:30 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:09:36 - XML: Processed 655402 elements - found 602 jobs
Fri 17 Jan 2014 06:09:36 - job 7347379 appears to have finished
Fri 17 Jan 2014 06:09:36 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 06:09:36 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 06:09:36 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 06:09:36 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:09:36 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:09:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:09:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:09:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:09:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:09:39 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:09:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 06:09:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:09:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:09:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:09:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:09:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:09:42 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:09:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43838421
Fri 17 Jan 2014 06:09:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:09:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43838421
Fri 17 Jan 2014 06:09:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:09:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:09:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:09:51 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:09:51 - job_xml_thread(): Done retrieving: data size 43838421
Fri 17 Jan 2014 06:09:51 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:09:51 - XML: Start document: iteration 14
Fri 17 Jan 2014 06:09:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:09:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:09:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:09:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:09:53 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:09:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:09:53 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:09:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:09:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:09:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:09:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:10:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:10:01 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:10:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:10:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:10:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:10:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:10:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:10:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:10:04 - XML: Processed 655402 elements - found 602 jobs
Fri 17 Jan 2014 06:10:04 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 06:10:04 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 06:10:04 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:10:04 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:10:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:10:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43820755
Fri 17 Jan 2014 06:10:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:10:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43820755
Fri 17 Jan 2014 06:10:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:10:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:10:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:10:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:10:08 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:10:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:10:09 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:10:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 06:10:09 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:10:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 06:10:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8933 values 140883 bits 17610 bytes 
Fri 17 Jan 2014 06:10:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:10:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:10:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:10:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:10:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:10:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:10:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:10:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:10:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:10:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:10:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:10:19 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:10:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:10:21 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:10:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:10:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:10:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:10:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:10:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:10:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:10:23 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:10:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855992
Fri 17 Jan 2014 06:10:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:10:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855992
Fri 17 Jan 2014 06:10:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:10:24 - job_xml_thread(): Done retrieving: data size 43855992
Fri 17 Jan 2014 06:10:24 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:10:24 - XML: Start document: iteration 15
Fri 17 Jan 2014 06:10:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:10:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:10:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:10:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:10:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:10:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:10:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:10:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:10:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:10:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:10:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:10:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:10:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:10:42 - XML: Processed 655404 elements - found 603 jobs
Fri 17 Jan 2014 06:10:42 - job 7347377 appears to have finished
Fri 17 Jan 2014 06:10:42 - job 7347384 report time 1389935301 does not match current heartbeat 1389935370 : ignoring job
Fri 17 Jan 2014 06:10:42 - job 7343930 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 06:10:42 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 06:10:42 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 06:10:43 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 06:10:43 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:10:43 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:10:43 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:10:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 06:10:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:10:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:10:45 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:10:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:10:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:10:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:10:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:10:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:10:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:10:47 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:10:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43829649
Fri 17 Jan 2014 06:10:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:10:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43829649
Fri 17 Jan 2014 06:10:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:10:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:10:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:10:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:10:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:10:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:10:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:10:58 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:10:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:10:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:10:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:10:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:10:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:11:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:11:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:11:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:11:01 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:11:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:11:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:11:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:11:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:11:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:11:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:11:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:11:02 - job_xml_thread(): Done retrieving: data size 43846070
Fri 17 Jan 2014 06:11:02 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:11:02 - XML: Start document: iteration 16
Fri 17 Jan 2014 06:11:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43846070
Fri 17 Jan 2014 06:11:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43846070
Fri 17 Jan 2014 06:11:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:11:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:11:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:11:10 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:11:11 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:11:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:11:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 06:11:11 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:11:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9219 values 145418 bits 18177 bytes 
Fri 17 Jan 2014 06:11:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 06:11:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:11:13 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:11:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:11:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:11:16 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:11:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:11:16 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:11:16 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:11:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:11:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:11:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:11:22 - XML: Processed 655406 elements - found 604 jobs
Fri 17 Jan 2014 06:11:22 - job 7347386 field 'start_timestamp' changed since saved from: 1389935420 to: 1389935363
Fri 17 Jan 2014 06:11:22 - job 7347384 report time 1389935301 does not match current heartbeat 1389935422 : ignoring job
Fri 17 Jan 2014 06:11:22 - job 7347381 appears to have finished
Fri 17 Jan 2014 06:11:22 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 06:11:22 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 06:11:23 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 06:11:23 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:11:23 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:11:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:11:24 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:11:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:11:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:11:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:11:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:11:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:11:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:11:26 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:11:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43777307
Fri 17 Jan 2014 06:11:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:11:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43777307
Fri 17 Jan 2014 06:11:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:11:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:11:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:11:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:11:38 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:11:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:11:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:11:38 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:11:39 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:11:39 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:11:39 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:11:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:11:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:11:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:11:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:11:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:11:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:11:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:11:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:11:43 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:11:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 06:11:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:11:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:11:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:11:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:11:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:11:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:11:45 - job_xml_thread(): Done retrieving: data size 43249123
Fri 17 Jan 2014 06:11:45 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:11:45 - XML: Start document: iteration 17
Fri 17 Jan 2014 06:11:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43249123
Fri 17 Jan 2014 06:11:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:11:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43249123
Fri 17 Jan 2014 06:11:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:11:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:11:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:11:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:11:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:12:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:12:00 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:12:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:12:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:12:01 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:12:01 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:12:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:12:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:12:01 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:12:02 - XML: Processed 647910 elements - found 604 jobs
Fri 17 Jan 2014 06:12:03 - job 7347384 report time 1389935301 does not match current heartbeat 1389935422 : ignoring job
Fri 17 Jan 2014 06:12:03 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 06:12:03 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 06:12:03 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:12:03 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:12:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:12:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:12:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:12:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:12:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:12:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:12:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:12:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:12:09 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:12:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43183041
Fri 17 Jan 2014 06:12:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:12:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43183041
Fri 17 Jan 2014 06:12:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:12:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:12:13 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:12:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:12:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 06:12:15 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:12:15 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:12:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 06:12:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9000 values 141977 bits 17747 bytes 
Fri 17 Jan 2014 06:12:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:12:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:12:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:12:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:12:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:12:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:12:18 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:12:18 - job_xml_thread(): Done retrieving: data size 43183041
Fri 17 Jan 2014 06:12:18 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:12:18 - XML: Start document: iteration 18
Fri 17 Jan 2014 06:12:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:12:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:12:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:12:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:12:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43183041
Fri 17 Jan 2014 06:12:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:12:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:12:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:12:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:12:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:12:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:12:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:12:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:12:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:12:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:12:38 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:12:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:12:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:12:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:12:38 - XML: Processed 647206 elements - found 604 jobs
Fri 17 Jan 2014 06:12:38 - job 7347383 appears to have finished
Fri 17 Jan 2014 06:12:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:12:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:12:38 - job 7347387 report time 1389935422 does not match current heartbeat 1389935490 : ignoring job
Fri 17 Jan 2014 06:12:38 - job 7347384 report time 1389935301 does not match current heartbeat 1389935490 : ignoring job
Fri 17 Jan 2014 06:12:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:12:38 - job 7347388 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 06:12:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:12:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:12:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:12:38 - job 7346525 appears to have finished
Fri 17 Jan 2014 06:12:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:12:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:12:38 - job 7335194 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 06:12:38 - job_xml_thread(): Found 6 updated jobs.
Fri 17 Jan 2014 06:12:38 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 06:12:39 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Fri 17 Jan 2014 06:12:39 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:12:39 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:12:41 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:12:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 06:12:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:12:41 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:12:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43722559
Fri 17 Jan 2014 06:12:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:12:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43722559
Fri 17 Jan 2014 06:12:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:12:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:12:53 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:12:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:12:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:12:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:12:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:12:54 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:12:54 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:12:54 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:12:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:12:54 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:12:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:12:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:12:55 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:12:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:12:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:12:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:12:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:12:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:12:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:12:57 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:12:57 - job_xml_thread(): Done retrieving: data size 43824306
Fri 17 Jan 2014 06:12:57 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:12:57 - XML: Start document: iteration 19
Fri 17 Jan 2014 06:12:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43824306
Fri 17 Jan 2014 06:12:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:12:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43824306
Fri 17 Jan 2014 06:12:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:13:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:13:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:13:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:13:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:13:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:13:15 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:13:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:13:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 06:13:16 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:13:16 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:13:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 06:13:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:13:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:13:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:13:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:13:17 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:13:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:13:17 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:13:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:13:17 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:13:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6467 values 101997 bits 12749 bytes 
Fri 17 Jan 2014 06:13:19 - XML: Processed 654928 elements - found 601 jobs
Fri 17 Jan 2014 06:13:19 - job 7347387 report time 1389935422 does not match current heartbeat 1389935542 : ignoring job
Fri 17 Jan 2014 06:13:19 - job 7347342 appears to have finished
Fri 17 Jan 2014 06:13:19 - job 7346518 appears to have finished
Fri 17 Jan 2014 06:13:19 - job 7346458 appears to have finished
Fri 17 Jan 2014 06:13:20 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 06:13:20 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 06:13:20 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 06:13:20 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:13:20 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:13:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:13:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:13:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:13:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:13:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:13:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:13:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:13:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:13:24 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:13:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43840513
Fri 17 Jan 2014 06:13:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:13:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43840513
Fri 17 Jan 2014 06:13:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:13:32 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 06:13:32 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:13:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:13:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:13:33 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:13:33 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:13:33 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 06:13:33 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 06:13:33 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 06:13:36 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:13:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:13:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:13:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:13:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:13:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:13:37 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:13:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:13:37 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:13:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:13:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:13:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:13:40 - size of cluster 'LISA Cluster': 624 hosts 79479 metrics 992922 values 15658061 bits 1957257 bytes 
Fri 17 Jan 2014 06:13:41 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:13:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 06:13:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:13:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:13:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:13:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:13:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:13:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:13:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:13:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:13:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:13:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:13:45 - job_xml_thread(): Done retrieving: data size 43843712
Fri 17 Jan 2014 06:13:45 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:13:45 - XML: Start document: iteration 20
Fri 17 Jan 2014 06:13:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43843712
Fri 17 Jan 2014 06:13:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:13:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43843712
Fri 17 Jan 2014 06:13:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:13:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:13:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:13:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:13:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:14:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:14:06 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:14:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:14:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:14:06 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:14:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:14:07 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:14:07 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:14:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:14:07 - XML: Processed 655400 elements - found 601 jobs
Fri 17 Jan 2014 06:14:07 - job 7347387 report time 1389935422 does not match current heartbeat 1389935542 : ignoring job
Fri 17 Jan 2014 06:14:07 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 06:14:07 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 06:14:07 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:14:07 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:14:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:14:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:14:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:14:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:14:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:14:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:14:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:14:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:14:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:14:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43861245
Fri 17 Jan 2014 06:14:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:14:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43861245
Fri 17 Jan 2014 06:14:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:14:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:14:17 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:14:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:14:19 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:14:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 06:14:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 06:14:19 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:14:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9250 values 145908 bits 18238 bytes 
Fri 17 Jan 2014 06:14:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:14:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:14:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:14:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:14:22 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:14:22 - job_xml_thread(): Done retrieving: data size 43861245
Fri 17 Jan 2014 06:14:22 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:14:22 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 06:14:22 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 06:14:22 - Housekeeping: done.
Fri 17 Jan 2014 06:14:22 - XML: Start document: iteration 0
Fri 17 Jan 2014 06:14:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:14:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:14:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:14:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:14:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:14:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:14:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:14:33 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:14:33 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 06:14:33 - XML: Processed 655396 elements - found 599 jobs
Fri 17 Jan 2014 06:14:33 - job 7347387 report time 1389935422 does not match current heartbeat 1389935611 : ignoring job
Fri 17 Jan 2014 06:14:33 - job 7347385 appears to have finished
Fri 17 Jan 2014 06:14:33 - job 7347390 report time 1389935542 does not match current heartbeat 1389935611 : ignoring job
Fri 17 Jan 2014 06:14:34 - job 7347322 appears to have finished
Fri 17 Jan 2014 06:14:34 - job 7346526 appears to have finished
Fri 17 Jan 2014 06:14:34 - job 7346527 appears to have finished
Fri 17 Jan 2014 06:14:34 - job_xml_thread(): Found 6 updated jobs.
Fri 17 Jan 2014 06:14:34 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 06:14:34 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Fri 17 Jan 2014 06:14:34 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:14:35 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:14:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:14:35 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:14:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:14:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:14:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:14:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:14:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:14:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:14:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:14:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:14:38 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:14:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43816593
Fri 17 Jan 2014 06:14:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:14:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43816593
Fri 17 Jan 2014 06:14:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:14:50 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:14:50 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:14:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:14:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:14:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:14:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:14:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:14:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:14:51 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:14:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:14:51 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:14:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:14:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:14:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:14:56 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:14:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 06:14:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:14:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:14:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:14:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:14:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:14:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:14:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:14:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:14:59 - job_xml_thread(): Done retrieving: data size 43849326
Fri 17 Jan 2014 06:14:59 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:14:59 - XML: Start document: iteration 1
Fri 17 Jan 2014 06:14:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43849326
Fri 17 Jan 2014 06:14:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:15:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43849326
Fri 17 Jan 2014 06:15:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:15:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:15:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:15:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:15:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:15:14 - XML: Processed 655392 elements - found 597 jobs
Fri 17 Jan 2014 06:15:14 - job 7347390 report time 1389935542 does not match current heartbeat 1389935611 : ignoring job
Fri 17 Jan 2014 06:15:14 - job 7335178 appears to have finished
Fri 17 Jan 2014 06:15:14 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 06:15:14 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 06:15:16 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 06:15:16 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:15:16 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:15:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:15:16 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:15:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:15:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:15:17 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:15:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:15:17 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:15:17 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:15:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:15:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:15:19 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:15:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:15:19 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:15:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 06:15:19 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:15:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5810 values 91635 bits 11454 bytes 
Fri 17 Jan 2014 06:15:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 06:15:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:15:21 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:15:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:15:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:15:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:15:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:15:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:15:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:15:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:15:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851086
Fri 17 Jan 2014 06:15:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:15:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851086
Fri 17 Jan 2014 06:15:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:15:31 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:15:31 - job_xml_thread(): Done retrieving: data size 43851086
Fri 17 Jan 2014 06:15:31 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:15:31 - XML: Start document: iteration 2
Fri 17 Jan 2014 06:15:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:15:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:15:34 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:15:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 06:15:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:15:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:15:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:15:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:15:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:15:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:15:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:15:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:15:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:15:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:15:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:15:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:15:45 - XML: Processed 655394 elements - found 598 jobs
Fri 17 Jan 2014 06:15:45 - job 7347390 report time 1389935542 does not match current heartbeat 1389935663 : ignoring job
Fri 17 Jan 2014 06:15:45 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 06:15:45 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 06:15:45 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 06:15:45 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:15:45 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:15:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:15:45 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:15:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:15:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:15:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:15:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:15:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:15:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:15:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:15:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43837208
Fri 17 Jan 2014 06:15:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:15:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43837208
Fri 17 Jan 2014 06:15:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:15:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:15:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:15:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:15:58 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:15:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:15:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:15:59 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:15:59 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:15:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:15:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:16:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:16:00 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:16:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:16:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:16:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:16:03 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:16:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:16:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:16:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:16:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:16:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:16:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:16:06 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:16:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855193
Fri 17 Jan 2014 06:16:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:16:07 - job_xml_thread(): Done retrieving: data size 43855193
Fri 17 Jan 2014 06:16:07 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:16:07 - XML: Start document: iteration 3
Fri 17 Jan 2014 06:16:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855193
Fri 17 Jan 2014 06:16:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:16:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:16:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:16:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:16:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:16:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:16:20 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:16:22 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:16:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 06:16:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:16:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 06:16:22 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:16:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9095 values 143627 bits 17953 bytes 
Fri 17 Jan 2014 06:16:25 - XML: Processed 655392 elements - found 597 jobs
Fri 17 Jan 2014 06:16:25 - job 7347389 appears to have finished
Fri 17 Jan 2014 06:16:25 - job 7334920 appears to have finished
Fri 17 Jan 2014 06:16:25 - job 7347390 report time 1389935542 does not match current heartbeat 1389935732 : ignoring job
Fri 17 Jan 2014 06:16:25 - job 7347394 report time 1389935663 does not match current heartbeat 1389935732 : ignoring job
Fri 17 Jan 2014 06:16:25 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 06:16:25 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 06:16:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:16:27 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:16:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:16:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:16:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:16:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:16:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:16:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:16:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:16:28 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 06:16:28 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:16:28 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:16:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:16:31 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:16:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:16:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:16:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:16:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:16:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:16:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:16:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:16:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43848159
Fri 17 Jan 2014 06:16:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:16:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43848159
Fri 17 Jan 2014 06:16:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:16:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:16:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:16:44 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:16:44 - job_xml_thread(): Done retrieving: data size 43848159
Fri 17 Jan 2014 06:16:44 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:16:44 - XML: Start document: iteration 4
Fri 17 Jan 2014 06:16:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:16:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:16:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:16:49 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:16:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:16:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:16:50 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:16:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:16:50 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:16:50 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:16:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:16:59 - XML: Processed 655392 elements - found 597 jobs
Fri 17 Jan 2014 06:16:59 - job 7347390 report time 1389935542 does not match current heartbeat 1389935732 : ignoring job
Fri 17 Jan 2014 06:16:59 - job 7347394 report time 1389935663 does not match current heartbeat 1389935732 : ignoring job
Fri 17 Jan 2014 06:16:59 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 06:16:59 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 06:16:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:16:59 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:16:59 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:16:59 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:16:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:16:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:16:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:16:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:16:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:16:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:16:59 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:16:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 06:16:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:17:03 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:17:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43823907
Fri 17 Jan 2014 06:17:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:17:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43823907
Fri 17 Jan 2014 06:17:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:17:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:17:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:17:14 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:17:14 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:17:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:17:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:17:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:17:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:17:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:17:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:17:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:17:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:17:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:17:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:17:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:17:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:17:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:17:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:17:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:17:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:17:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:17:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:17:20 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 06:17:20 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 06:17:20 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:17:21 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:17:21 - job_xml_thread(): Done retrieving: data size 43788435
Fri 17 Jan 2014 06:17:21 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:17:21 - XML: Start document: iteration 5
Fri 17 Jan 2014 06:17:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43788435
Fri 17 Jan 2014 06:17:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43788435
Fri 17 Jan 2014 06:17:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:17:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:17:22 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:17:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:17:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:17:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 06:17:24 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:17:24 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:17:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8992 values 142190 bits 17773 bytes 
Fri 17 Jan 2014 06:17:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 06:17:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:17:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:17:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:17:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:17:38 - XML: Processed 654644 elements - found 597 jobs
Fri 17 Jan 2014 06:17:38 - job 7347394 report time 1389935663 does not match current heartbeat 1389935783 : ignoring job
Fri 17 Jan 2014 06:17:38 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 06:17:38 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 06:17:38 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 06:17:38 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:17:38 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:17:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:17:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:17:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:17:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:17:42 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:17:42 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:17:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:17:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:17:42 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:17:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:17:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:17:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:17:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:17:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:17:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:17:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:17:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:17:46 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:17:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43235776
Fri 17 Jan 2014 06:17:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:17:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43235776
Fri 17 Jan 2014 06:17:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:17:53 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:17:53 - job_xml_thread(): Done retrieving: data size 43235776
Fri 17 Jan 2014 06:17:54 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:17:54 - XML: Start document: iteration 6
Fri 17 Jan 2014 06:17:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:17:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:17:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:17:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:17:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:17:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:17:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:17:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:17:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:17:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:17:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:17:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:17:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:18:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:18:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:18:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:18:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:18:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:18:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:18:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:18:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:18:07 - XML: Processed 647840 elements - found 597 jobs
Fri 17 Jan 2014 06:18:07 - job 7347394 report time 1389935663 does not match current heartbeat 1389935783 : ignoring job
Fri 17 Jan 2014 06:18:07 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 06:18:07 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 06:18:07 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:18:07 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:18:07 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:18:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 06:18:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:18:09 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:18:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43178137
Fri 17 Jan 2014 06:18:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:18:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43178137
Fri 17 Jan 2014 06:18:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:18:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:18:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:18:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:18:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:18:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:18:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:18:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:18:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:18:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:18:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:18:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43178137
Fri 17 Jan 2014 06:18:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:18:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:18:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:18:22 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:18:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:18:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:18:25 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:18:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:18:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 06:18:26 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:18:26 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:18:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 06:18:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6050 values 95698 bits 11962 bytes 
Fri 17 Jan 2014 06:18:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:18:31 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:18:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:18:31 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:18:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:18:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:18:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:18:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:18:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:18:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:18:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:18:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:18:33 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:18:33 - job_xml_thread(): Done retrieving: data size 43632241
Fri 17 Jan 2014 06:18:33 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:18:33 - XML: Start document: iteration 7
Fri 17 Jan 2014 06:18:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43632241
Fri 17 Jan 2014 06:18:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:18:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:18:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:18:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:18:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43632241
Fri 17 Jan 2014 06:18:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:18:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:18:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:18:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:18:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:18:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:18:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:18:53 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:18:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:18:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:18:54 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:18:54 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:18:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:18:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:18:54 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:18:55 - XML: Processed 653046 elements - found 598 jobs
Fri 17 Jan 2014 06:18:55 - job 7347393 appears to have finished
Fri 17 Jan 2014 06:18:55 - job 7347394 report time 1389935663 does not match current heartbeat 1389935852 : ignoring job
Fri 17 Jan 2014 06:18:55 - job 7347396 report time 1389935783 does not match current heartbeat 1389935852 : ignoring job
Fri 17 Jan 2014 06:18:55 - job 7336879 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 06:18:55 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 06:18:55 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 06:18:56 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 06:18:56 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:18:56 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:18:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:18:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:18:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:18:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:18:58 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:18:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 06:18:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:18:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:18:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:18:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:18:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:19:00 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:19:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43825398
Fri 17 Jan 2014 06:19:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:19:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43825398
Fri 17 Jan 2014 06:19:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:19:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:19:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:19:11 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:19:11 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:19:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:19:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:19:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:19:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:19:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:19:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:19:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:19:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:19:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:19:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:19:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:19:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:19:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:19:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:19:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:19:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:19:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:19:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:19:16 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:19:16 - job_xml_thread(): Done retrieving: data size 43844798
Fri 17 Jan 2014 06:19:16 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:19:16 - XML: Start document: iteration 8
Fri 17 Jan 2014 06:19:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43844798
Fri 17 Jan 2014 06:19:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:19:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43844798
Fri 17 Jan 2014 06:19:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:19:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:19:26 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:19:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:19:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 06:19:28 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:19:28 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:19:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 06:19:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:19:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:19:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8873 values 139988 bits 17498 bytes 
Fri 17 Jan 2014 06:19:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:19:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:19:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:19:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:19:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:19:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:19:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:19:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:19:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:19:31 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:19:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:19:35 - XML: Processed 655394 elements - found 598 jobs
Fri 17 Jan 2014 06:19:35 - job 7347396 report time 1389935783 does not match current heartbeat 1389935904 : ignoring job
Fri 17 Jan 2014 06:19:35 - job 7347398 field 'start_timestamp' changed since saved from: 1389935853 to: 1389935851
Fri 17 Jan 2014 06:19:35 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 06:19:35 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 06:19:35 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 06:19:35 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:19:35 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:19:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:19:38 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:19:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:19:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:19:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:19:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:19:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:19:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:19:40 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:19:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43833474
Fri 17 Jan 2014 06:19:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:19:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43833474
Fri 17 Jan 2014 06:19:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:19:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:19:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:19:50 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:19:50 - job_xml_thread(): Done retrieving: data size 43833474
Fri 17 Jan 2014 06:19:50 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:19:50 - XML: Start document: iteration 9
Fri 17 Jan 2014 06:19:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:19:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:19:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:19:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:19:53 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:19:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:19:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:19:53 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:19:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:19:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:19:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:20:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:20:01 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:20:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:20:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:20:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:20:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:20:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:20:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:20:04 - XML: Processed 655394 elements - found 598 jobs
Fri 17 Jan 2014 06:20:04 - job 7347396 report time 1389935783 does not match current heartbeat 1389935904 : ignoring job
Fri 17 Jan 2014 06:20:04 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 06:20:04 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 06:20:04 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:20:04 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:20:04 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:20:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 06:20:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:20:06 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:20:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43812602
Fri 17 Jan 2014 06:20:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:20:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43812602
Fri 17 Jan 2014 06:20:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:20:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:20:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:20:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:20:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:20:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:20:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:20:16 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:20:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:20:16 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:20:16 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:20:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:20:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:20:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:20:19 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:20:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:20:20 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:20:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:20:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:20:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:20:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:20:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:20:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:20:21 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:20:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853275
Fri 17 Jan 2014 06:20:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:20:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853275
Fri 17 Jan 2014 06:20:21 - job_xml_thread(): Done retrieving: data size 43853275
Fri 17 Jan 2014 06:20:21 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:20:21 - XML: Start document: iteration 10
Fri 17 Jan 2014 06:20:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:20:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:20:28 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:20:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:20:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 06:20:30 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:20:30 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:20:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 06:20:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8919 values 140701 bits 17587 bytes 
Fri 17 Jan 2014 06:20:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:20:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:20:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:20:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:20:32 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:20:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:20:32 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:20:32 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:20:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:20:33 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 06:20:33 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:20:35 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:20:35 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:20:35 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 06:20:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:20:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:20:35 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 06:20:35 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 06:20:39 - XML: Processed 655392 elements - found 597 jobs
Fri 17 Jan 2014 06:20:39 - job 7346412 appears to have finished
Fri 17 Jan 2014 06:20:39 - job 7347395 appears to have finished
Fri 17 Jan 2014 06:20:39 - job 7347396 report time 1389935783 does not match current heartbeat 1389935973 : ignoring job
Fri 17 Jan 2014 06:20:39 - job 7347399 report time 1389935904 does not match current heartbeat 1389935973 : ignoring job
Fri 17 Jan 2014 06:20:39 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 06:20:39 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 06:20:39 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 06:20:39 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:20:40 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:20:40 - size of cluster 'LISA Cluster': 624 hosts 79474 metrics 841480 values 13294334 bits 1661791 bytes 
Fri 17 Jan 2014 06:20:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:20:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:20:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:20:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:20:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:20:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:20:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:20:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:20:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:20:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:20:47 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:20:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43814107
Fri 17 Jan 2014 06:20:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:20:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43814107
Fri 17 Jan 2014 06:20:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:20:55 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:20:55 - job_xml_thread(): Done retrieving: data size 43814107
Fri 17 Jan 2014 06:20:55 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:20:55 - XML: Start document: iteration 11
Fri 17 Jan 2014 06:20:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:20:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:20:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:20:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:20:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:20:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:21:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:21:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:21:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:21:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:21:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:21:03 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:21:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 06:21:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:21:08 - XML: Processed 655392 elements - found 597 jobs
Fri 17 Jan 2014 06:21:08 - job 7347396 report time 1389935783 does not match current heartbeat 1389935973 : ignoring job
Fri 17 Jan 2014 06:21:08 - job 7347399 report time 1389935904 does not match current heartbeat 1389935973 : ignoring job
Fri 17 Jan 2014 06:21:08 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 06:21:08 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 06:21:08 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:21:08 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:21:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:21:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:21:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:21:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:21:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:21:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:21:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:21:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:21:14 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:21:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43834537
Fri 17 Jan 2014 06:21:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:21:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43834537
Fri 17 Jan 2014 06:21:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:21:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:21:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:21:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:21:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:21:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:21:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:21:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:21:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:21:23 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:21:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:21:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43834537
Fri 17 Jan 2014 06:21:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:21:24 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:21:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:21:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:21:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:21:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:21:30 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:21:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:21:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 06:21:31 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:21:31 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:21:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 06:21:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6006 values 94762 bits 11845 bytes 
Fri 17 Jan 2014 06:21:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:21:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:21:35 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:21:35 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 06:21:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:21:37 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:21:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:21:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:21:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:21:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:21:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:21:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:21:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:21:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:21:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:21:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:21:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:21:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:21:41 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:21:41 - job_xml_thread(): Done retrieving: data size 43819758
Fri 17 Jan 2014 06:21:41 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:21:41 - XML: Start document: iteration 12
Fri 17 Jan 2014 06:21:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43819758
Fri 17 Jan 2014 06:21:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:21:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43819758
Fri 17 Jan 2014 06:21:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:21:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:21:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:21:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:21:53 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:21:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:21:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:21:54 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:21:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:21:54 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:21:54 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:21:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:21:58 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:21:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 06:21:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:22:00 - XML: Processed 655392 elements - found 597 jobs
Fri 17 Jan 2014 06:22:00 - job 7347400 report time 1389935973 does not match current heartbeat 1389936025 : ignoring job
Fri 17 Jan 2014 06:22:00 - job 7347399 report time 1389935904 does not match current heartbeat 1389936025 : ignoring job
Fri 17 Jan 2014 06:22:00 - job 7347336 appears to have finished
Fri 17 Jan 2014 06:22:00 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 06:22:00 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 06:22:00 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 06:22:00 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:22:00 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:22:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:22:06 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:22:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:22:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:22:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:22:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:22:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:22:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:22:08 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:22:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43826298
Fri 17 Jan 2014 06:22:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:22:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43826298
Fri 17 Jan 2014 06:22:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:22:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:22:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:22:16 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:22:16 - job_xml_thread(): Done retrieving: data size 43826298
Fri 17 Jan 2014 06:22:16 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:22:16 - XML: Start document: iteration 13
Fri 17 Jan 2014 06:22:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:22:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:22:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:22:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:22:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:22:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:22:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:22:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:22:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:22:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:22:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:22:29 - XML: Processed 655392 elements - found 597 jobs
Fri 17 Jan 2014 06:22:29 - job 7347400 report time 1389935973 does not match current heartbeat 1389936093 : ignoring job
Fri 17 Jan 2014 06:22:29 - job 7347402 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 06:22:29 - job 7347399 report time 1389935904 does not match current heartbeat 1389936093 : ignoring job
Fri 17 Jan 2014 06:22:29 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 06:22:29 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 06:22:30 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 06:22:30 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:22:30 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:22:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:22:31 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:22:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:22:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:22:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:22:32 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:22:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:22:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 06:22:32 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:22:32 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:22:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5913 values 93314 bits 11664 bytes 
Fri 17 Jan 2014 06:22:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 06:22:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:22:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:22:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:22:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:22:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:22:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43816898
Fri 17 Jan 2014 06:22:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:22:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43816898
Fri 17 Jan 2014 06:22:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:22:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:22:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:22:46 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:22:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:22:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:22:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:22:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:22:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:22:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:22:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:22:47 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:22:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:22:47 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:22:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:22:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:22:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:22:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:22:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:22:52 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:22:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 06:22:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:22:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:22:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:22:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:22:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:22:55 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:22:55 - job_xml_thread(): Done retrieving: data size 43842329
Fri 17 Jan 2014 06:22:55 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:22:55 - XML: Start document: iteration 14
Fri 17 Jan 2014 06:22:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43842329
Fri 17 Jan 2014 06:22:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:22:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43842329
Fri 17 Jan 2014 06:22:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:23:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:23:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:23:06 - XML: Processed 655388 elements - found 595 jobs
Fri 17 Jan 2014 06:23:06 - job 7346405 appears to have finished
Fri 17 Jan 2014 06:23:06 - job 7347400 report time 1389935973 does not match current heartbeat 1389936093 : ignoring job
Fri 17 Jan 2014 06:23:06 - job 7347397 appears to have finished
Fri 17 Jan 2014 06:23:06 - job 7347399 report time 1389935904 does not match current heartbeat 1389936093 : ignoring job
Fri 17 Jan 2014 06:23:06 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 06:23:06 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 06:23:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:23:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:23:08 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 06:23:08 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:23:08 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:23:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:23:16 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:23:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:23:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:23:16 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:23:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:23:16 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:23:16 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:23:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:23:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:23:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:23:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:23:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:23:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:23:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:23:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:23:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:23:21 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:23:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43787067
Fri 17 Jan 2014 06:23:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:23:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43787067
Fri 17 Jan 2014 06:23:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:23:23 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:23:23 - job_xml_thread(): Done retrieving: data size 43787067
Fri 17 Jan 2014 06:23:24 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:23:24 - XML: Start document: iteration 15
Fri 17 Jan 2014 06:23:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:23:31 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:23:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:23:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:23:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:23:32 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:23:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:23:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:23:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:23:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 06:23:33 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:23:33 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:23:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:23:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8861 values 139760 bits 17470 bytes 
Fri 17 Jan 2014 06:23:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 06:23:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:23:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:23:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:23:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:23:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:23:40 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:23:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:23:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:23:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:23:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:23:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:23:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:23:43 - XML: Processed 654640 elements - found 595 jobs
Fri 17 Jan 2014 06:23:43 - job 7347400 report time 1389935973 does not match current heartbeat 1389936145 : ignoring job
Fri 17 Jan 2014 06:23:43 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 06:23:43 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 06:23:43 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 06:23:43 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:23:43 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:23:46 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:23:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43252017
Fri 17 Jan 2014 06:23:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:23:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43252017
Fri 17 Jan 2014 06:23:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:23:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:23:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:23:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:23:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:23:58 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:23:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:24:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:24:00 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:24:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:24:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:24:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:24:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:24:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:24:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:24:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:24:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:24:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:24:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:24:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:24:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:24:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:24:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:24:02 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:24:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 06:24:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:24:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:24:05 - job_xml_thread(): Done retrieving: data size 43175765
Fri 17 Jan 2014 06:24:05 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:24:05 - XML: Start document: iteration 16
Fri 17 Jan 2014 06:24:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43175765
Fri 17 Jan 2014 06:24:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:24:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43175765
Fri 17 Jan 2014 06:24:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:24:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:24:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:24:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:24:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:24:24 - XML: Processed 647182 elements - found 592 jobs
Fri 17 Jan 2014 06:24:24 - job 7347355 appears to have finished
Fri 17 Jan 2014 06:24:24 - job 7347392 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 06:24:24 - job 7334825 appears to have finished
Fri 17 Jan 2014 06:24:24 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 06:24:24 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 06:24:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:24:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:24:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:24:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:24:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:24:27 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:24:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:24:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:24:27 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:24:27 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 06:24:27 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:24:27 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:24:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:24:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:24:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:24:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:24:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:24:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:24:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:24:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:24:31 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:24:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43427902
Fri 17 Jan 2014 06:24:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:24:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43427902
Fri 17 Jan 2014 06:24:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:24:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:24:34 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:24:35 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:24:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:24:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 06:24:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 06:24:35 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:24:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8826 values 139092 bits 17386 bytes 
Fri 17 Jan 2014 06:24:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:24:41 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:24:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:24:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:24:42 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:24:42 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:24:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:24:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:24:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:24:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:24:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:24:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:24:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:24:46 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:24:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:24:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:24:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:24:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:24:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:24:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:24:49 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 06:24:49 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 06:24:49 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:24:50 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:24:50 - job_xml_thread(): Done retrieving: data size 43780554
Fri 17 Jan 2014 06:24:50 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:24:50 - XML: Start document: iteration 17
Fri 17 Jan 2014 06:24:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43780554
Fri 17 Jan 2014 06:24:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:24:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43780554
Fri 17 Jan 2014 06:24:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:24:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:24:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:25:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:25:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:25:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:25:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:25:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:25:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:25:06 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:25:06 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:25:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:25:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:25:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:25:10 - XML: Processed 654722 elements - found 592 jobs
Fri 17 Jan 2014 06:25:10 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 06:25:10 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 06:25:10 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:25:10 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:25:11 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:25:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 06:25:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:25:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:25:13 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:25:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:25:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:25:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:25:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:25:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:25:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:25:14 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:25:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43830323
Fri 17 Jan 2014 06:25:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:25:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43830323
Fri 17 Jan 2014 06:25:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:25:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:25:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:25:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:25:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:25:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:25:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:25:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:25:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:25:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:25:25 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:25:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:25:25 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:25:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:25:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:25:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:25:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:25:29 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:25:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43844200
Fri 17 Jan 2014 06:25:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:25:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:25:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:25:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:25:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:25:30 - job_xml_thread(): Done retrieving: data size 43844200
Fri 17 Jan 2014 06:25:30 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:25:30 - XML: Start document: iteration 18
Fri 17 Jan 2014 06:25:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43844200
Fri 17 Jan 2014 06:25:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:25:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:25:35 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:25:35 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:25:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:25:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 06:25:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 06:25:36 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:25:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9021 values 142298 bits 17787 bytes 
Fri 17 Jan 2014 06:25:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:25:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:25:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:25:42 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:25:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:25:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:25:42 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:25:42 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:25:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:25:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:25:42 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:25:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:25:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:25:49 - XML: Processed 655382 elements - found 592 jobs
Fri 17 Jan 2014 06:25:49 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 06:25:49 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 06:25:49 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:25:49 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:25:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:25:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:25:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:25:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:25:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:25:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:25:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:25:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:25:53 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:25:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43826898
Fri 17 Jan 2014 06:25:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:25:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43826898
Fri 17 Jan 2014 06:25:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:25:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:25:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:26:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:26:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:26:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:26:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:26:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:26:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:26:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:26:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:26:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43826898
Fri 17 Jan 2014 06:26:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:26:04 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:26:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:26:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:26:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:26:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:26:14 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:26:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:26:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:26:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:26:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:26:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:26:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:26:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:26:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:26:16 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:26:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 06:26:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:26:17 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:26:17 - job_xml_thread(): Done retrieving: data size 43807999
Fri 17 Jan 2014 06:26:17 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:26:17 - XML: Start document: iteration 19
Fri 17 Jan 2014 06:26:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43807999
Fri 17 Jan 2014 06:26:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:26:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:26:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:26:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:26:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:26:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:26:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:26:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43807999
Fri 17 Jan 2014 06:26:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:26:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:26:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:26:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:26:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:26:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:26:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:26:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:26:36 - XML: Processed 655380 elements - found 591 jobs
Fri 17 Jan 2014 06:26:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:26:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:26:36 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:26:36 - job 7346409 appears to have finished
Fri 17 Jan 2014 06:26:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:26:36 - job 7347352 appears to have finished
Fri 17 Jan 2014 06:26:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:26:36 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 06:26:36 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 06:26:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:26:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:26:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 06:26:36 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:26:36 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:26:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 06:26:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5564 values 87704 bits 10963 bytes 
Fri 17 Jan 2014 06:26:37 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 06:26:37 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:26:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:26:38 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:26:38 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:26:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:26:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:26:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:26:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:26:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:26:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:26:40 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:26:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862675
Fri 17 Jan 2014 06:26:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:26:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862675
Fri 17 Jan 2014 06:26:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:26:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:26:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:26:53 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:26:53 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:26:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:26:53 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:26:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:26:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:26:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:26:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:26:54 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:26:54 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:26:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:26:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:26:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:26:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:26:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:26:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:26:56 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:26:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 06:26:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:26:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:26:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:26:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:26:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:26:57 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:26:57 - job_xml_thread(): Done retrieving: data size 43862072
Fri 17 Jan 2014 06:26:57 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:26:57 - XML: Start document: iteration 20
Fri 17 Jan 2014 06:26:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862072
Fri 17 Jan 2014 06:26:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:26:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862072
Fri 17 Jan 2014 06:26:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:27:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:27:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:27:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:27:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:27:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:27:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:27:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:27:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:27:12 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:27:12 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:27:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:27:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:27:12 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:27:15 - XML: Processed 655380 elements - found 591 jobs
Fri 17 Jan 2014 06:27:15 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 06:27:15 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 06:27:15 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:27:16 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:27:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:27:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:27:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:27:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:27:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:27:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:27:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:27:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:27:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:27:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43834799
Fri 17 Jan 2014 06:27:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:27:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43834799
Fri 17 Jan 2014 06:27:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:27:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:27:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:27:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:27:29 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:27:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:27:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:27:29 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:27:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:27:30 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:27:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:27:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43834799
Fri 17 Jan 2014 06:27:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:27:31 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:27:31 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:27:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:27:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:27:36 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 06:27:36 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:27:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:27:37 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:27:37 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:27:37 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 06:27:37 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 06:27:37 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:27:37 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 06:27:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:27:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 06:27:37 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:27:37 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:27:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 06:27:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9106 values 143659 bits 17957 bytes 
Fri 17 Jan 2014 06:27:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:27:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:27:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:27:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:27:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:27:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:27:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:27:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:27:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:27:41 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:27:42 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 853363 values 13461994 bits 1682749 bytes 
Fri 17 Jan 2014 06:27:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:27:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:27:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:27:45 - job_xml_thread(): Done retrieving: data size 43832880
Fri 17 Jan 2014 06:27:45 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:27:45 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 06:27:45 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 06:27:45 - Housekeeping: done.
Fri 17 Jan 2014 06:27:45 - XML: Start document: iteration 0
Fri 17 Jan 2014 06:27:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:27:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:27:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:27:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43832880
Fri 17 Jan 2014 06:27:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:27:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43832880
Fri 17 Jan 2014 06:27:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:27:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:27:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:27:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:28:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:28:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:28:03 - XML: Processed 655380 elements - found 591 jobs
Fri 17 Jan 2014 06:28:03 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 06:28:03 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 06:28:03 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:28:03 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:28:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:28:06 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:28:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:28:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:28:07 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:28:07 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:28:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:28:07 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:28:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:28:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:28:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:28:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:28:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:28:10 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:28:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 06:28:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:28:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:28:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:28:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:28:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:28:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:28:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858922
Fri 17 Jan 2014 06:28:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:28:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43858922
Fri 17 Jan 2014 06:28:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:28:18 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:28:18 - job_xml_thread(): Done retrieving: data size 43858922
Fri 17 Jan 2014 06:28:18 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:28:18 - XML: Start document: iteration 1
Fri 17 Jan 2014 06:28:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:28:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:28:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:28:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:28:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:28:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:28:25 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:28:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:28:25 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:28:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:28:25 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:28:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:28:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:28:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:28:33 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:28:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:28:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:28:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:28:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:28:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:28:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:28:36 - XML: Processed 655382 elements - found 592 jobs
Fri 17 Jan 2014 06:28:36 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 06:28:36 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 06:28:36 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 06:28:36 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:28:36 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:28:37 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:28:37 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 06:28:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:28:37 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:28:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:28:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 06:28:38 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:28:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 06:28:38 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:28:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5607 values 88407 bits 11050 bytes 
Fri 17 Jan 2014 06:28:39 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:28:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43822537
Fri 17 Jan 2014 06:28:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:28:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43822537
Fri 17 Jan 2014 06:28:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:28:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:28:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:28:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:28:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:28:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:28:50 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:28:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:28:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:28:51 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:28:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:28:51 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:28:51 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:28:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:28:51 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:28:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:28:55 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:28:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:28:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:28:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:28:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:28:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:28:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:28:58 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:28:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 06:28:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:28:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:28:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43857409
Fri 17 Jan 2014 06:28:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:28:59 - job_xml_thread(): Done retrieving: data size 43857409
Fri 17 Jan 2014 06:28:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43857409
Fri 17 Jan 2014 06:28:59 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:28:59 - XML: Start document: iteration 2
Fri 17 Jan 2014 06:28:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:29:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:29:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:29:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:29:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:29:18 - XML: Processed 655380 elements - found 591 jobs
Fri 17 Jan 2014 06:29:18 - job 7347338 appears to have finished
Fri 17 Jan 2014 06:29:18 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 06:29:18 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 06:29:18 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 06:29:19 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:29:19 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:29:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:29:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:29:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:29:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:29:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:29:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:29:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:29:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:29:20 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:29:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:29:21 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:29:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:29:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:29:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:29:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:29:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:29:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:29:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:29:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43790571
Fri 17 Jan 2014 06:29:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:29:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43790571
Fri 17 Jan 2014 06:29:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:29:34 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:29:34 - job_xml_thread(): Done retrieving: data size 43790571
Fri 17 Jan 2014 06:29:34 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:29:34 - XML: Start document: iteration 3
Fri 17 Jan 2014 06:29:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:29:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:29:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:29:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:29:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:29:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:29:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:29:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:29:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:29:38 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:29:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:29:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 06:29:39 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:29:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 06:29:39 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:29:39 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:29:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6874 values 108371 bits 13546 bytes 
Fri 17 Jan 2014 06:29:39 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:29:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:29:39 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:29:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:29:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:29:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:29:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:29:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:29:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:29:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:29:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:29:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:29:49 - XML: Processed 654660 elements - found 605 jobs
Fri 17 Jan 2014 06:29:49 - job_xml_thread(): Found 14 updated jobs.
Fri 17 Jan 2014 06:29:49 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 06:29:49 - job_xml_thread(): Done storing. succesfully stored: 14 jobs
Fri 17 Jan 2014 06:29:49 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:29:49 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:29:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:29:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43242367
Fri 17 Jan 2014 06:29:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:29:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43242367
Fri 17 Jan 2014 06:29:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:29:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:29:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:30:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:30:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:30:04 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:30:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:30:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:30:07 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:30:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:30:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:30:08 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:30:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:30:08 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:30:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:30:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:30:08 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:30:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:30:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:30:08 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:30:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 06:30:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:30:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:30:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:30:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:30:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:30:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:30:11 - job_xml_thread(): Done retrieving: data size 43189240
Fri 17 Jan 2014 06:30:11 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:30:11 - XML: Start document: iteration 4
Fri 17 Jan 2014 06:30:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43189240
Fri 17 Jan 2014 06:30:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:30:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43189240
Fri 17 Jan 2014 06:30:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:30:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:30:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:30:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:30:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:30:26 - XML: Processed 647208 elements - found 605 jobs
Fri 17 Jan 2014 06:30:26 - job 7347417 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:26 - job 7347416 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:26 - job 7347415 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:26 - job 7347414 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:26 - job 7347413 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:26 - job 7347412 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:26 - job 7347411 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:26 - job 7347410 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:26 - job 7347419 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:26 - job 7335211 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:26 - job 7347407 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:26 - job 7347408 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:26 - job 7347409 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:26 - job 7337345 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:26 - job 7344426 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:26 - job 7344424 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:26 - job 7344423 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:26 - job 7340972 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:26 - job 7346830 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:26 - job 7345705 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:26 - job 7337799 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:26 - job 7344657 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:26 - job 7347420 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:26 - job 7337400 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:26 - job 7344571 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:26 - job 7338475 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:26 - job 7338870 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:26 - job 7343952 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:26 - job 7344379 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:26 - job 7344378 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:26 - job 7344373 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:26 - job 7344372 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:26 - job 7344371 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:27 - job 7344370 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:27 - job 7344377 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:27 - job 7344376 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:27 - job 7344375 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:27 - job 7344374 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:27 - job 7344386 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:27 - job 7344387 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:27 - job 7344384 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:27 - job 7344385 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:27 - job 7338572 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:27 - job 7344383 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:27 - job 7344380 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:27 - job 7344381 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:27 - job 7344388 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:27 - job 7344389 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:27 - job 7335544 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:27 - job 7335395 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:27 - job 7335397 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:27 - job 7337899 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:27 - job 7342698 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:27 - job 7335260 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:27 - job 7339484 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:27 - job 7335250 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:27 - job 7336565 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:27 - job 7337641 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:27 - job 7337640 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:27 - job 7337643 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:27 - job 7337645 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:27 - job 7337646 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:27 - job 7345031 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:27 - job 7344342 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:27 - job 7344435 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:27 - job 7344340 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:27 - job 7344437 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:27 - job 7344346 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:27 - job 7344347 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:27 - job 7344344 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:27 - job 7344345 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:27 - job 7345969 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:27 - job 7344368 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:27 - job 7344369 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:27 - job 7344360 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:27 - job 7344361 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:27 - job 7344362 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:27 - job 7344363 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:28 - job 7344364 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:28 - job 7344365 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:28 - job 7344366 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:28 - job 7344367 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:28 - job 7344440 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:28 - job 7335389 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:28 - job 7335576 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:28 - job 7335273 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:28 - job 7335271 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:28 - job 7335276 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:28 - job 7335376 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:28 - job 7335375 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:28 - job 7335207 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:28 - job 7335206 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:28 - job 7335205 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:28 - job 7335204 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:28 - job 7335203 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:28 - job 7335202 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:28 - job 7335201 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:28 - job 7335200 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:28 - job 7339391 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:28 - job 7335209 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:28 - job 7335208 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:28 - job 7339156 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:28 - job 7343472 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:28 - job 7345099 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:28 - job 7343632 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:28 - job 7343634 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:28 - job 7344425 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:28 - job 7338208 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:28 - job 7344350 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:28 - job 7344353 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:28 - job 7344352 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:28 - job 7343931 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:28 - job 7343932 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:28 - job 7343933 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:28 - job 7343935 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:28 - job 7343936 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:28 - job 7344355 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:28 - job 7344357 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:28 - job 7344356 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:28 - job 7344351 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:29 - job 7344421 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:29 - job 7344420 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:29 - job 7335866 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:29 - job 7344359 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:29 - job 7344358 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:29 - job 7344429 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:29 - job 7344428 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:29 - job 7338514 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:29 - job 7335361 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:29 - job 7335364 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:29 - job 7335365 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:29 - job 7335215 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:29 - job 7335216 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:29 - job 7335217 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:29 - job 7335210 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:29 - job 7335212 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:29 - job 7335213 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:29 - job 7335218 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:29 - job 7335219 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:29 - job 7335239 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:29 - job 7341063 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:29 - job 7345647 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:30 - job 7344434 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:30 - job 7344343 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:30 - job 7344436 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:30 - job 7344341 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:30 - job 7344430 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:30 - job 7344431 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:30 - job 7344432 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:30 - job 7344433 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:30 - job 7344348 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:30 - job 7344349 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:30 - job 7344438 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:30 - job 7344439 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:30 - job 7343751 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:30 - job 7344337 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:30:30 - job 7344336 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:30:30 - job 7347418 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:30:30 - job 7344339 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:30 - job 7344338 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:30 - job 7338784 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:30:30 - job 7335903 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:30 - job 7342714 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:30 - job 7335424 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:30 - job 7335423 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:30 - job 7335422 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:30 - job 7335421 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:30 - job 7335197 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:30 - job 7335196 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:30 - job 7335195 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:30 - job 7338025 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:30 - job 7335199 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:30 - job 7335198 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:30 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 06:30:30 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 06:30:30 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:30:30 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:30:30 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:30:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:30:30 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:30:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:30:30 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:30:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:30:35 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:30:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:30:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:30:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:30:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:30:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:30:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:30:38 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:30:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43643113
Fri 17 Jan 2014 06:30:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:30:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43643113
Fri 17 Jan 2014 06:30:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:30:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:30:39 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:30:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:30:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 06:30:39 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:30:39 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:30:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9091 values 143367 bits 17920 bytes 
Fri 17 Jan 2014 06:30:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 06:30:45 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:30:45 - job_xml_thread(): Done retrieving: data size 43643113
Fri 17 Jan 2014 06:30:45 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:30:45 - XML: Start document: iteration 5
Fri 17 Jan 2014 06:30:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:30:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:30:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:30:48 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:30:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:30:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:30:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:30:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:30:49 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:30:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:30:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:30:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:30:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:30:58 - XML: Processed 652848 elements - found 605 jobs
Fri 17 Jan 2014 06:30:58 - job 7347417 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:58 - job 7347416 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:58 - job 7347415 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:58 - job 7347414 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:58 - job 7347413 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:58 - job 7347412 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:58 - job 7347411 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:58 - job 7347410 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:58 - job 7347419 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:58 - job 7347407 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:58 - job 7347408 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:58 - job 7347409 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:58 - job 7347420 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:58 - job 7347418 report time 1389936507 does not match current heartbeat 1389936576 : ignoring job
Fri 17 Jan 2014 06:30:58 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 06:30:58 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 06:30:58 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:30:58 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:31:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:31:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:31:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:31:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:31:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:31:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:31:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:31:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:31:03 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:31:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43811544
Fri 17 Jan 2014 06:31:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:31:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:31:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:31:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43811544
Fri 17 Jan 2014 06:31:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:31:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:31:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:31:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:31:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:31:13 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:31:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:31:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:31:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:31:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:31:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:31:14 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:31:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 06:31:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:31:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:31:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:31:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:31:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:31:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:31:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:31:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:31:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:31:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:31:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:31:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:31:20 - job_xml_thread(): Done retrieving: data size 43842570
Fri 17 Jan 2014 06:31:20 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:31:20 - XML: Start document: iteration 6
Fri 17 Jan 2014 06:31:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43842570
Fri 17 Jan 2014 06:31:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43842570
Fri 17 Jan 2014 06:31:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:31:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:31:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:31:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:31:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:31:31 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:31:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:31:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:31:32 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:31:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:31:32 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:31:32 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:31:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:31:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:31:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:31:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:31:40 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:31:40 - XML: Processed 655408 elements - found 605 jobs
Fri 17 Jan 2014 06:31:40 - job 7347417 report time 1389936507 does not match current heartbeat 1389936627 : ignoring job
Fri 17 Jan 2014 06:31:40 - job 7347416 report time 1389936507 does not match current heartbeat 1389936627 : ignoring job
Fri 17 Jan 2014 06:31:40 - job 7347415 report time 1389936507 does not match current heartbeat 1389936627 : ignoring job
Fri 17 Jan 2014 06:31:40 - job 7347414 report time 1389936507 does not match current heartbeat 1389936627 : ignoring job
Fri 17 Jan 2014 06:31:40 - job 7347413 report time 1389936507 does not match current heartbeat 1389936627 : ignoring job
Fri 17 Jan 2014 06:31:40 - job 7347412 report time 1389936507 does not match current heartbeat 1389936627 : ignoring job
Fri 17 Jan 2014 06:31:40 - job 7347411 report time 1389936507 does not match current heartbeat 1389936627 : ignoring job
Fri 17 Jan 2014 06:31:40 - job 7347410 report time 1389936507 does not match current heartbeat 1389936627 : ignoring job
Fri 17 Jan 2014 06:31:40 - job 7347419 report time 1389936507 does not match current heartbeat 1389936627 : ignoring job
Fri 17 Jan 2014 06:31:40 - job 7347407 report time 1389936507 does not match current heartbeat 1389936627 : ignoring job
Fri 17 Jan 2014 06:31:40 - job 7347408 report time 1389936507 does not match current heartbeat 1389936627 : ignoring job
Fri 17 Jan 2014 06:31:40 - job 7347409 report time 1389936507 does not match current heartbeat 1389936627 : ignoring job
Fri 17 Jan 2014 06:31:40 - job 7347420 report time 1389936507 does not match current heartbeat 1389936627 : ignoring job
Fri 17 Jan 2014 06:31:40 - job 7347363 appears to have finished
Fri 17 Jan 2014 06:31:40 - job 7347418 report time 1389936507 does not match current heartbeat 1389936627 : ignoring job
Fri 17 Jan 2014 06:31:40 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 06:31:40 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 06:31:40 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 06:31:40 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:31:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:31:40 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:31:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 06:31:40 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:31:40 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:31:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 06:31:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5896 values 93062 bits 11632 bytes 
Fri 17 Jan 2014 06:31:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:31:44 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:31:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:31:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:31:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:31:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:31:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:31:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:31:44 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 06:31:44 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 06:31:44 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:31:46 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:31:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43813180
Fri 17 Jan 2014 06:31:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:31:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43813180
Fri 17 Jan 2014 06:31:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:31:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:31:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:31:55 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:31:55 - job_xml_thread(): Done retrieving: data size 43813180
Fri 17 Jan 2014 06:31:55 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:31:55 - XML: Start document: iteration 7
Fri 17 Jan 2014 06:31:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:31:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:31:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:31:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:31:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:31:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:31:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:31:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:31:59 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:31:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:31:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:32:06 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:32:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 06:32:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:32:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:32:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:32:10 - XML: Processed 655408 elements - found 605 jobs
Fri 17 Jan 2014 06:32:10 - job 7347417 report time 1389936507 does not match current heartbeat 1389936627 : ignoring job
Fri 17 Jan 2014 06:32:10 - job 7347416 report time 1389936507 does not match current heartbeat 1389936627 : ignoring job
Fri 17 Jan 2014 06:32:10 - job 7347415 report time 1389936507 does not match current heartbeat 1389936627 : ignoring job
Fri 17 Jan 2014 06:32:10 - job 7347414 report time 1389936507 does not match current heartbeat 1389936627 : ignoring job
Fri 17 Jan 2014 06:32:10 - job 7347413 report time 1389936507 does not match current heartbeat 1389936627 : ignoring job
Fri 17 Jan 2014 06:32:10 - job 7347412 report time 1389936507 does not match current heartbeat 1389936627 : ignoring job
Fri 17 Jan 2014 06:32:10 - job 7347411 report time 1389936507 does not match current heartbeat 1389936627 : ignoring job
Fri 17 Jan 2014 06:32:10 - job 7347410 report time 1389936507 does not match current heartbeat 1389936627 : ignoring job
Fri 17 Jan 2014 06:32:10 - job 7347419 report time 1389936507 does not match current heartbeat 1389936627 : ignoring job
Fri 17 Jan 2014 06:32:10 - job 7347407 report time 1389936507 does not match current heartbeat 1389936627 : ignoring job
Fri 17 Jan 2014 06:32:10 - job 7347408 report time 1389936507 does not match current heartbeat 1389936627 : ignoring job
Fri 17 Jan 2014 06:32:10 - job 7347409 report time 1389936507 does not match current heartbeat 1389936627 : ignoring job
Fri 17 Jan 2014 06:32:10 - job 7347420 report time 1389936507 does not match current heartbeat 1389936627 : ignoring job
Fri 17 Jan 2014 06:32:10 - job 7347418 report time 1389936507 does not match current heartbeat 1389936627 : ignoring job
Fri 17 Jan 2014 06:32:10 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 06:32:10 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 06:32:10 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:32:10 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:32:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:32:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:32:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:32:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:32:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:32:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:32:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:32:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43841439
Fri 17 Jan 2014 06:32:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:32:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43841439
Fri 17 Jan 2014 06:32:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:32:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:32:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:32:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:32:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:32:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:32:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:32:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:32:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:32:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:32:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:32:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:32:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:32:24 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:32:25 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:32:26 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:32:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870114
Fri 17 Jan 2014 06:32:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:32:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:32:26 - job_xml_thread(): Done retrieving: data size 43870114
Fri 17 Jan 2014 06:32:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:32:26 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:32:26 - XML: Start document: iteration 8
Fri 17 Jan 2014 06:32:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:32:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:32:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:32:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:32:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870114
Fri 17 Jan 2014 06:32:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:32:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:32:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:32:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:32:40 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:32:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:32:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:32:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:32:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:32:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:32:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:32:42 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:32:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:32:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 06:32:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 06:32:42 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:32:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8878 values 140504 bits 17563 bytes 
Fri 17 Jan 2014 06:32:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:32:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:32:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:32:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:32:44 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:32:45 - XML: Processed 655406 elements - found 607 jobs
Fri 17 Jan 2014 06:32:45 - job 7347417 report time 1389936507 does not match current heartbeat 1389936696 : ignoring job
Fri 17 Jan 2014 06:32:46 - job 7347416 report time 1389936507 does not match current heartbeat 1389936696 : ignoring job
Fri 17 Jan 2014 06:32:46 - job 7347415 report time 1389936507 does not match current heartbeat 1389936696 : ignoring job
Fri 17 Jan 2014 06:32:46 - job 7347414 report time 1389936507 does not match current heartbeat 1389936696 : ignoring job
Fri 17 Jan 2014 06:32:46 - job 7347413 report time 1389936507 does not match current heartbeat 1389936696 : ignoring job
Fri 17 Jan 2014 06:32:46 - job 7347412 report time 1389936507 does not match current heartbeat 1389936696 : ignoring job
Fri 17 Jan 2014 06:32:46 - job 7347411 report time 1389936507 does not match current heartbeat 1389936696 : ignoring job
Fri 17 Jan 2014 06:32:46 - job 7347410 report time 1389936507 does not match current heartbeat 1389936696 : ignoring job
Fri 17 Jan 2014 06:32:46 - job 7347419 report time 1389936507 does not match current heartbeat 1389936696 : ignoring job
Fri 17 Jan 2014 06:32:46 - job 7347407 report time 1389936507 does not match current heartbeat 1389936696 : ignoring job
Fri 17 Jan 2014 06:32:46 - job 7347401 report time 1389936627 does not match current heartbeat 1389936696 : ignoring job
Fri 17 Jan 2014 06:32:46 - job 7347408 report time 1389936507 does not match current heartbeat 1389936696 : ignoring job
Fri 17 Jan 2014 06:32:46 - job 7347409 report time 1389936507 does not match current heartbeat 1389936696 : ignoring job
Fri 17 Jan 2014 06:32:46 - job 7347420 report time 1389936507 does not match current heartbeat 1389936696 : ignoring job
Fri 17 Jan 2014 06:32:46 - job 7347418 report time 1389936507 does not match current heartbeat 1389936696 : ignoring job
Fri 17 Jan 2014 06:32:46 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 06:32:46 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 06:32:46 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 06:32:46 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:32:46 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:32:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:32:48 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:32:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:32:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:32:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:32:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:32:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:32:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:32:51 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:32:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43859401
Fri 17 Jan 2014 06:32:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:32:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43859401
Fri 17 Jan 2014 06:32:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:32:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:32:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:32:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:32:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:32:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:32:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:33:01 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:33:01 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:33:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:33:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:33:01 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:33:02 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:33:02 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:33:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 06:33:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:33:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:33:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:33:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:33:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:33:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:33:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:33:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:33:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:33:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:33:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:33:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:33:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856978
Fri 17 Jan 2014 06:33:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:33:06 - job_xml_thread(): Done retrieving: data size 43856978
Fri 17 Jan 2014 06:33:06 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:33:06 - XML: Start document: iteration 9
Fri 17 Jan 2014 06:33:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43856978
Fri 17 Jan 2014 06:33:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:33:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:33:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:33:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:33:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:33:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:33:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:33:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:33:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:33:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:33:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:33:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:33:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:33:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:33:25 - XML: Processed 655384 elements - found 593 jobs
Fri 17 Jan 2014 06:33:25 - job 7347401 report time 1389936627 does not match current heartbeat 1389936748 : ignoring job
Fri 17 Jan 2014 06:33:25 - job 7347428 report time 1389936696 does not match current heartbeat 1389936748 : ignoring job
Fri 17 Jan 2014 06:33:25 - job 7334827 appears to have finished
Fri 17 Jan 2014 06:33:25 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 06:33:25 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 06:33:25 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 06:33:25 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:33:25 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:33:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:33:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:33:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:33:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:33:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:33:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:33:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:33:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:33:29 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:33:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43831530
Fri 17 Jan 2014 06:33:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:33:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43831530
Fri 17 Jan 2014 06:33:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:33:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:33:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:33:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:33:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:33:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:33:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:33:39 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:33:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:33:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43831530
Fri 17 Jan 2014 06:33:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:33:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:33:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:33:40 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:33:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:33:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:33:43 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:33:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:33:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:33:44 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:33:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 06:33:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:33:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 06:33:44 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:33:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9318 values 147183 bits 18397 bytes 
Fri 17 Jan 2014 06:33:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:33:50 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:33:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:33:52 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:33:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:33:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:33:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:33:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:33:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:33:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:33:54 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:33:54 - job_xml_thread(): Done retrieving: data size 43830677
Fri 17 Jan 2014 06:33:54 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:33:54 - XML: Start document: iteration 10
Fri 17 Jan 2014 06:33:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43830677
Fri 17 Jan 2014 06:33:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:33:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:33:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:33:56 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:33:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:33:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43830677
Fri 17 Jan 2014 06:33:56 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:33:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:33:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:34:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:34:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:34:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:34:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:34:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:34:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:34:12 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:34:12 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:34:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:34:12 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:34:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:34:12 - XML: Processed 655384 elements - found 593 jobs
Fri 17 Jan 2014 06:34:12 - job 7347401 report time 1389936627 does not match current heartbeat 1389936748 : ignoring job
Fri 17 Jan 2014 06:34:12 - job 7347428 report time 1389936696 does not match current heartbeat 1389936748 : ignoring job
Fri 17 Jan 2014 06:34:12 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 06:34:12 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 06:34:12 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:34:12 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:34:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:34:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:34:16 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:34:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 06:34:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:34:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:34:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:34:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:34:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:34:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:34:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:34:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:34:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43839293
Fri 17 Jan 2014 06:34:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:34:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43839293
Fri 17 Jan 2014 06:34:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:34:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:34:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:34:27 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:34:27 - job_xml_thread(): Done retrieving: data size 43839293
Fri 17 Jan 2014 06:34:28 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:34:28 - XML: Start document: iteration 11
Fri 17 Jan 2014 06:34:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:34:29 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:34:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:34:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:34:29 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:34:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:34:29 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:34:29 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:34:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:34:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:34:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:34:37 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 06:34:38 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:34:39 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:34:39 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:34:39 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 06:34:39 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 06:34:39 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 06:34:41 - XML: Processed 655388 elements - found 595 jobs
Fri 17 Jan 2014 06:34:41 - job 7347401 report time 1389936627 does not match current heartbeat 1389936817 : ignoring job
Fri 17 Jan 2014 06:34:41 - job 7347429 report time 1389936748 does not match current heartbeat 1389936817 : ignoring job
Fri 17 Jan 2014 06:34:41 - job 7347428 report time 1389936696 does not match current heartbeat 1389936817 : ignoring job
Fri 17 Jan 2014 06:34:41 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 06:34:42 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 06:34:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:34:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:34:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:34:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:34:43 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 06:34:43 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:34:43 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 857044 values 13541646 bits 1692705 bytes 
Fri 17 Jan 2014 06:34:43 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:34:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:34:44 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:34:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:34:44 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:34:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 06:34:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 06:34:44 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:34:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5912 values 93277 bits 11659 bytes 
Fri 17 Jan 2014 06:34:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:34:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:34:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:34:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:34:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:34:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:34:47 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:34:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43809729
Fri 17 Jan 2014 06:34:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:34:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43809729
Fri 17 Jan 2014 06:34:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:34:59 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:34:59 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:34:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:34:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:34:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:34:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:34:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:34:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:35:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:35:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:35:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:35:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:35:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:35:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:35:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:35:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:35:04 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:35:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 06:35:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:35:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:35:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:35:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:35:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:35:07 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:35:07 - job_xml_thread(): Done retrieving: data size 43845839
Fri 17 Jan 2014 06:35:07 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:35:07 - XML: Start document: iteration 12
Fri 17 Jan 2014 06:35:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43845839
Fri 17 Jan 2014 06:35:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43845839
Fri 17 Jan 2014 06:35:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:35:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:35:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:35:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:35:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:35:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:35:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:35:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:35:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:35:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:35:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:35:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:35:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:35:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:35:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:35:25 - XML: Processed 655388 elements - found 595 jobs
Fri 17 Jan 2014 06:35:25 - job 7347431 report time 1389936817 does not match current heartbeat 1389936869 : ignoring job
Fri 17 Jan 2014 06:35:25 - job 7347429 report time 1389936748 does not match current heartbeat 1389936869 : ignoring job
Fri 17 Jan 2014 06:35:25 - job 7347427 report time 1389936817 does not match current heartbeat 1389936869 : ignoring job
Fri 17 Jan 2014 06:35:25 - job 7347428 report time 1389936696 does not match current heartbeat 1389936869 : ignoring job
Fri 17 Jan 2014 06:35:25 - job 7347426 report time 1389936817 does not match current heartbeat 1389936869 : ignoring job
Fri 17 Jan 2014 06:35:25 - job 7345029 appears to have finished
Fri 17 Jan 2014 06:35:25 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 06:35:25 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 06:35:27 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 06:35:27 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:35:27 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:35:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:35:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:35:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:35:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:35:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:35:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:35:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:35:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:35:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:35:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43651554
Fri 17 Jan 2014 06:35:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:35:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43651554
Fri 17 Jan 2014 06:35:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:35:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:35:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:35:39 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:35:39 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 06:35:42 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:35:42 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:35:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:35:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:35:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:35:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:35:44 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:35:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:35:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:35:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:35:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:35:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 06:35:44 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:35:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:35:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:35:44 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:35:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 06:35:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8452 values 133300 bits 16662 bytes 
Fri 17 Jan 2014 06:35:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:35:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:35:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:35:48 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:35:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:35:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:35:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:35:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:35:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:35:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:35:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:35:52 - job_xml_thread(): Done retrieving: data size 43210121
Fri 17 Jan 2014 06:35:52 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:35:52 - XML: Start document: iteration 13
Fri 17 Jan 2014 06:35:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43210121
Fri 17 Jan 2014 06:35:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:35:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43210121
Fri 17 Jan 2014 06:35:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:35:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:35:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:36:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:36:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:36:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:36:06 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:36:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:36:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:36:07 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:36:07 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:36:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:36:07 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:36:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:36:12 - XML: Processed 647584 elements - found 595 jobs
Fri 17 Jan 2014 06:36:12 - job 7347431 report time 1389936817 does not match current heartbeat 1389936869 : ignoring job
Fri 17 Jan 2014 06:36:12 - job 7347429 report time 1389936748 does not match current heartbeat 1389936869 : ignoring job
Fri 17 Jan 2014 06:36:12 - job 7347427 report time 1389936817 does not match current heartbeat 1389936869 : ignoring job
Fri 17 Jan 2014 06:36:12 - job 7347428 report time 1389936696 does not match current heartbeat 1389936869 : ignoring job
Fri 17 Jan 2014 06:36:12 - job 7347426 report time 1389936817 does not match current heartbeat 1389936869 : ignoring job
Fri 17 Jan 2014 06:36:12 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 06:36:12 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 06:36:12 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:36:12 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:36:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:36:15 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:36:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:36:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:36:16 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:36:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 06:36:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:36:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:36:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:36:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:36:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:36:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:36:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43222652
Fri 17 Jan 2014 06:36:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:36:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43222652
Fri 17 Jan 2014 06:36:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:36:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:36:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:36:27 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:36:27 - job_xml_thread(): Done retrieving: data size 43222652
Fri 17 Jan 2014 06:36:27 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:36:27 - XML: Start document: iteration 14
Fri 17 Jan 2014 06:36:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:36:31 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:36:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:36:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:36:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:36:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:36:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:36:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:36:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:36:31 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:36:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:36:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:36:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:36:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:36:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:36:42 - XML: Processed 647862 elements - found 595 jobs
Fri 17 Jan 2014 06:36:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:36:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:36:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:36:42 - job 7347431 report time 1389936817 does not match current heartbeat 1389936937 : ignoring job
Fri 17 Jan 2014 06:36:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:36:42 - job 7347433 report time 1389936869 does not match current heartbeat 1389936937 : ignoring job
Fri 17 Jan 2014 06:36:42 - job 7347429 report time 1389936748 does not match current heartbeat 1389936937 : ignoring job
Fri 17 Jan 2014 06:36:42 - job 7347427 report time 1389936817 does not match current heartbeat 1389936937 : ignoring job
Fri 17 Jan 2014 06:36:42 - job 7347426 report time 1389936817 does not match current heartbeat 1389936937 : ignoring job
Fri 17 Jan 2014 06:36:42 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 06:36:42 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 06:36:42 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 06:36:42 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:36:42 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:36:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:36:45 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:36:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:36:45 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:36:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 06:36:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 06:36:45 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:36:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5564 values 87699 bits 10962 bytes 
Fri 17 Jan 2014 06:36:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:36:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43692121
Fri 17 Jan 2014 06:36:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:36:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43692121
Fri 17 Jan 2014 06:36:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:36:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:36:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:36:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:36:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:36:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:36:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:36:56 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:36:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:36:56 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:36:56 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:36:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:36:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:36:57 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:36:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:37:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:37:01 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:37:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:37:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:37:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:37:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:37:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:37:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:37:04 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:37:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 06:37:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:37:04 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:37:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43829832
Fri 17 Jan 2014 06:37:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:37:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43829832
Fri 17 Jan 2014 06:37:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:37:05 - job_xml_thread(): Done retrieving: data size 43829832
Fri 17 Jan 2014 06:37:05 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:37:05 - XML: Start document: iteration 15
Fri 17 Jan 2014 06:37:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:37:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:37:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:37:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:37:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:37:21 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:37:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:37:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:37:23 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:37:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:37:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:37:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:37:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:37:25 - XML: Processed 655384 elements - found 593 jobs
Fri 17 Jan 2014 06:37:25 - job 7347373 appears to have finished
Fri 17 Jan 2014 06:37:25 - job 7347431 report time 1389936817 does not match current heartbeat 1389936989 : ignoring job
Fri 17 Jan 2014 06:37:25 - job 7347433 report time 1389936869 does not match current heartbeat 1389936989 : ignoring job
Fri 17 Jan 2014 06:37:25 - job 7347434 report time 1389936937 does not match current heartbeat 1389936989 : ignoring job
Fri 17 Jan 2014 06:37:25 - job 7346434 appears to have finished
Fri 17 Jan 2014 06:37:25 - job 7347427 report time 1389936817 does not match current heartbeat 1389936989 : ignoring job
Fri 17 Jan 2014 06:37:25 - job 7347426 report time 1389936817 does not match current heartbeat 1389936989 : ignoring job
Fri 17 Jan 2014 06:37:25 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 06:37:25 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 06:37:26 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 06:37:26 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:37:26 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:37:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:37:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:37:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:37:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:37:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:37:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:37:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:37:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:37:30 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:37:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43828400
Fri 17 Jan 2014 06:37:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:37:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43828400
Fri 17 Jan 2014 06:37:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:37:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:37:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:37:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:37:41 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:37:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:37:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:37:41 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:37:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:37:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:37:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:37:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:37:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:37:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:37:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:37:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:37:45 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:37:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:37:45 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:37:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:37:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:37:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:37:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 06:37:45 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:37:45 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:37:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 06:37:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6482 values 102244 bits 12780 bytes 
Fri 17 Jan 2014 06:37:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:37:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:37:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:37:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:37:50 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:37:50 - job_xml_thread(): Done retrieving: data size 43835976
Fri 17 Jan 2014 06:37:50 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:37:50 - XML: Start document: iteration 16
Fri 17 Jan 2014 06:37:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43835976
Fri 17 Jan 2014 06:37:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:37:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43835976
Fri 17 Jan 2014 06:37:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:37:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:37:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:38:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:38:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:38:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:38:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:38:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:38:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:38:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:38:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:38:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:38:05 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:38:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:38:07 - XML: Processed 655384 elements - found 593 jobs
Fri 17 Jan 2014 06:38:07 - job 7347431 report time 1389936817 does not match current heartbeat 1389936989 : ignoring job
Fri 17 Jan 2014 06:38:07 - job 7347433 report time 1389936869 does not match current heartbeat 1389936989 : ignoring job
Fri 17 Jan 2014 06:38:07 - job 7347434 report time 1389936937 does not match current heartbeat 1389936989 : ignoring job
Fri 17 Jan 2014 06:38:07 - job 7347427 report time 1389936817 does not match current heartbeat 1389936989 : ignoring job
Fri 17 Jan 2014 06:38:07 - job 7347426 report time 1389936817 does not match current heartbeat 1389936989 : ignoring job
Fri 17 Jan 2014 06:38:07 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 06:38:07 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 06:38:07 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:38:07 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:38:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:38:13 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:38:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:38:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:38:13 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:38:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 06:38:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:38:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:38:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:38:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:38:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:38:16 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:38:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43829271
Fri 17 Jan 2014 06:38:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:38:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43829271
Fri 17 Jan 2014 06:38:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:38:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:38:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:38:22 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:38:22 - job_xml_thread(): Done retrieving: data size 43829271
Fri 17 Jan 2014 06:38:22 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:38:22 - XML: Start document: iteration 17
Fri 17 Jan 2014 06:38:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:38:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:38:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:38:29 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:38:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:38:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:38:29 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:38:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:38:29 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:38:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:38:29 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:38:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:38:38 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:38:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:38:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:38:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:38:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:38:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:38:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:38:40 - XML: Processed 655376 elements - found 589 jobs
Fri 17 Jan 2014 06:38:40 - job 7347433 report time 1389936869 does not match current heartbeat 1389937058 : ignoring job
Fri 17 Jan 2014 06:38:40 - job 7347434 report time 1389936937 does not match current heartbeat 1389937058 : ignoring job
Fri 17 Jan 2014 06:38:40 - job 7347367 appears to have finished
Fri 17 Jan 2014 06:38:40 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 06:38:40 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 06:38:42 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 06:38:42 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:38:42 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:38:42 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 06:38:42 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 06:38:42 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:38:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:38:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43836975
Fri 17 Jan 2014 06:38:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:38:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43836975
Fri 17 Jan 2014 06:38:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:38:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:38:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:38:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:38:46 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:38:46 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:38:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:38:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 06:38:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 06:38:47 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:38:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8989 values 141742 bits 17717 bytes 
Fri 17 Jan 2014 06:38:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:38:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:38:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:38:54 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:38:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:38:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:38:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:38:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:38:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:38:55 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:38:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:38:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:38:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:38:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:38:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:38:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:38:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:38:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:38:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:38:57 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:38:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:38:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43859200
Fri 17 Jan 2014 06:38:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:38:58 - job_xml_thread(): Done retrieving: data size 43859200
Fri 17 Jan 2014 06:38:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43859200
Fri 17 Jan 2014 06:38:58 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:38:58 - XML: Start document: iteration 18
Fri 17 Jan 2014 06:38:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:39:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:39:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:39:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:39:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:39:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:39:14 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:39:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:39:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:39:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:39:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:39:15 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:39:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:39:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:39:19 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:39:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 06:39:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:39:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:39:21 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:39:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:39:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:39:21 - XML: Processed 655374 elements - found 588 jobs
Fri 17 Jan 2014 06:39:21 - job 7347434 report time 1389936937 does not match current heartbeat 1389937058 : ignoring job
Fri 17 Jan 2014 06:39:21 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 06:39:21 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 06:39:21 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:39:21 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:39:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:39:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:39:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:39:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:39:23 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:39:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43840426
Fri 17 Jan 2014 06:39:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:39:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43840426
Fri 17 Jan 2014 06:39:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:39:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:39:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:39:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:39:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:39:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:39:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:39:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:39:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:39:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:39:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:39:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:39:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:39:37 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:39:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:39:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:39:38 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:39:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:39:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:39:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:39:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:39:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:39:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:39:39 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:39:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867590
Fri 17 Jan 2014 06:39:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:39:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43867590
Fri 17 Jan 2014 06:39:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:39:40 - job_xml_thread(): Done retrieving: data size 43867590
Fri 17 Jan 2014 06:39:40 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:39:40 - XML: Start document: iteration 19
Fri 17 Jan 2014 06:39:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:39:47 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:39:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:39:48 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:39:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 06:39:48 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:39:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8781 values 138446 bits 17305 bytes 
Fri 17 Jan 2014 06:39:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 06:39:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:39:49 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:39:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:39:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:39:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:39:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:39:53 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:39:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:39:53 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:39:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:39:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:40:01 - XML: Processed 655376 elements - found 589 jobs
Fri 17 Jan 2014 06:40:01 - job 7347435 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 06:40:01 - job 7347434 report time 1389936937 does not match current heartbeat 1389937110 : ignoring job
Fri 17 Jan 2014 06:40:01 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 06:40:01 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 06:40:01 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 06:40:01 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:40:01 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:40:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:40:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:40:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:40:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:40:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:40:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:40:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:40:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:40:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:40:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43824160
Fri 17 Jan 2014 06:40:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:40:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43824160
Fri 17 Jan 2014 06:40:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:40:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:40:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:40:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:40:16 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:40:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:40:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:40:16 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:40:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:40:16 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:40:16 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:40:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:40:16 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:40:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:40:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:40:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:40:19 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:40:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:40:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:40:19 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:40:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 06:40:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:40:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:40:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:40:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:40:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:40:21 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:40:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43845677
Fri 17 Jan 2014 06:40:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:40:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43845677
Fri 17 Jan 2014 06:40:21 - job_xml_thread(): Done retrieving: data size 43845677
Fri 17 Jan 2014 06:40:21 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:40:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:40:21 - XML: Start document: iteration 20
Fri 17 Jan 2014 06:40:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:40:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:40:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:40:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:40:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:40:38 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:40:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:40:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:40:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:40:41 - XML: Processed 655378 elements - found 590 jobs
Fri 17 Jan 2014 06:40:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:40:42 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:40:42 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:40:42 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 06:40:42 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 06:40:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:40:43 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 06:40:43 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:40:43 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:40:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:40:44 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:40:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:40:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:40:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:40:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:40:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:40:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:40:46 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:40:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43839824
Fri 17 Jan 2014 06:40:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:40:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43839824
Fri 17 Jan 2014 06:40:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:40:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:40:49 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:40:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:40:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 06:40:51 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:40:51 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:40:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 06:40:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8689 values 136946 bits 17118 bytes 
Fri 17 Jan 2014 06:40:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:40:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:40:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:40:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:40:58 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:40:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:40:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:40:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:40:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:40:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:40:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:40:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:41:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:41:01 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:41:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:41:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:41:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:41:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:41:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:41:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:41:03 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:41:03 - job_xml_thread(): Done retrieving: data size 43838233
Fri 17 Jan 2014 06:41:03 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:41:03 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 06:41:03 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 06:41:03 - Housekeeping: done.
Fri 17 Jan 2014 06:41:03 - XML: Start document: iteration 0
Fri 17 Jan 2014 06:41:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43838233
Fri 17 Jan 2014 06:41:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:41:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43838233
Fri 17 Jan 2014 06:41:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:41:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:41:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:41:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:41:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:41:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:41:21 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:41:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:41:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:41:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:41:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:41:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:41:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:41:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:41:24 - XML: Processed 655376 elements - found 589 jobs
Fri 17 Jan 2014 06:41:24 - job 7346429 appears to have finished
Fri 17 Jan 2014 06:41:24 - job 7347439 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 06:41:24 - job 7347438 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 06:41:24 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 06:41:24 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 06:41:25 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 06:41:25 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:41:25 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:41:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:41:27 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:41:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:41:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:41:27 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:41:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 06:41:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:41:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:41:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:41:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:41:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:41:29 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:41:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43765584
Fri 17 Jan 2014 06:41:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:41:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43765584
Fri 17 Jan 2014 06:41:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:41:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:41:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:41:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:41:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:41:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:41:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:41:39 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 06:41:39 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:41:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:41:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:41:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:41:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:41:40 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:41:40 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:41:42 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:41:42 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:41:42 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 06:41:42 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 06:41:42 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 06:41:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:41:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:41:44 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:41:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:41:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:41:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:41:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:41:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:41:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:41:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:41:44 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 837678 values 13209958 bits 1651244 bytes 
Fri 17 Jan 2014 06:41:47 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:41:47 - job_xml_thread(): Done retrieving: data size 43221760
Fri 17 Jan 2014 06:41:47 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:41:47 - XML: Start document: iteration 1
Fri 17 Jan 2014 06:41:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43221760
Fri 17 Jan 2014 06:41:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:41:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43221760
Fri 17 Jan 2014 06:41:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:41:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:41:52 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:41:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:41:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 06:41:53 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:41:53 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:41:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8861 values 139704 bits 17463 bytes 
Fri 17 Jan 2014 06:41:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 06:41:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:41:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:41:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:41:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:42:06 - XML: Processed 647876 elements - found 589 jobs
Fri 17 Jan 2014 06:42:07 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 06:42:07 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 06:42:07 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:42:07 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:42:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:42:09 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:42:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:42:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:42:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:42:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:42:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:42:10 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:42:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:42:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:42:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:42:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:42:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:42:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:42:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:42:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:42:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:42:16 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:42:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43227874
Fri 17 Jan 2014 06:42:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:42:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43227874
Fri 17 Jan 2014 06:42:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:42:22 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:42:22 - job_xml_thread(): Done retrieving: data size 43227874
Fri 17 Jan 2014 06:42:22 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:42:22 - XML: Start document: iteration 2
Fri 17 Jan 2014 06:42:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:42:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:42:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:42:27 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:42:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:42:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:42:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:42:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:42:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:42:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:42:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:42:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:42:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:42:36 - XML: Processed 647836 elements - found 589 jobs
Fri 17 Jan 2014 06:42:36 - job 7347348 appears to have finished
Fri 17 Jan 2014 06:42:36 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 06:42:36 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 06:42:36 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 06:42:36 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:42:36 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:42:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:42:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:42:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:42:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:42:39 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:42:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 06:42:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:42:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:42:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:42:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:42:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:42:41 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:42:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43598976
Fri 17 Jan 2014 06:42:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:42:42 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:42:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43598976
Fri 17 Jan 2014 06:42:42 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 06:42:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:42:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:42:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:42:51 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:42:51 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:42:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:42:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:42:53 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:42:53 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:42:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:42:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:42:53 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:42:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:42:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:42:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:42:53 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:42:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:42:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 06:42:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 06:42:54 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:42:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5664 values 89304 bits 11163 bytes 
Fri 17 Jan 2014 06:42:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:42:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:42:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:42:59 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:42:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:42:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:43:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:43:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:43:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:43:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:43:03 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:43:03 - job_xml_thread(): Done retrieving: data size 43816407
Fri 17 Jan 2014 06:43:03 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:43:03 - XML: Start document: iteration 3
Fri 17 Jan 2014 06:43:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43816407
Fri 17 Jan 2014 06:43:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:43:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43816407
Fri 17 Jan 2014 06:43:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:43:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:43:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:43:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:43:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:43:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:43:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:43:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:43:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:43:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:43:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:43:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:43:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:43:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:43:24 - XML: Processed 655376 elements - found 589 jobs
Fri 17 Jan 2014 06:43:24 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 06:43:24 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 06:43:24 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:43:24 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:43:25 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:43:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 06:43:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:43:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:43:27 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:43:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:43:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:43:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:43:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:43:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:43:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:43:30 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:43:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43827895
Fri 17 Jan 2014 06:43:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:43:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43827895
Fri 17 Jan 2014 06:43:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:43:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:43:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:43:39 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:43:39 - job_xml_thread(): Done retrieving: data size 43827895
Fri 17 Jan 2014 06:43:39 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:43:39 - XML: Start document: iteration 4
Fri 17 Jan 2014 06:43:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:43:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:43:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:43:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:43:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:43:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:43:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:43:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:43:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:43:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:43:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:43:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:43:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:43:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:43:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:43:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:43:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:43:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:43:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:43:53 - XML: Processed 655374 elements - found 588 jobs
Fri 17 Jan 2014 06:43:53 - job 7347435 appears to have finished
Fri 17 Jan 2014 06:43:53 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 06:43:53 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 06:43:53 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 06:43:53 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:43:53 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:43:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:43:54 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:43:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:43:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 06:43:54 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:43:54 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:43:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 06:43:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6037 values 95192 bits 11899 bytes 
Fri 17 Jan 2014 06:43:56 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:43:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43831658
Fri 17 Jan 2014 06:43:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43831658
Fri 17 Jan 2014 06:43:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:43:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:43:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:43:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:44:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:44:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:44:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:44:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:44:06 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:44:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:44:06 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:44:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:44:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:44:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:44:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:44:08 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:44:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:44:12 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:44:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:44:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:44:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:44:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:44:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:44:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:44:15 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:44:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 06:44:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:44:15 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:44:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43825122
Fri 17 Jan 2014 06:44:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:44:16 - job_xml_thread(): Done retrieving: data size 43825122
Fri 17 Jan 2014 06:44:16 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:44:16 - XML: Start document: iteration 5
Fri 17 Jan 2014 06:44:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43825122
Fri 17 Jan 2014 06:44:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:44:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:44:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:44:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:44:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:44:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:44:31 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:44:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:44:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:44:32 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:44:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:44:32 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:44:32 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:44:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:44:33 - XML: Processed 655374 elements - found 588 jobs
Fri 17 Jan 2014 06:44:34 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 06:44:34 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 06:44:34 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:44:34 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:44:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:44:38 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:44:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:44:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:44:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:44:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:44:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:44:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:44:42 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:44:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862875
Fri 17 Jan 2014 06:44:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:44:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862875
Fri 17 Jan 2014 06:44:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:44:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:44:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:44:49 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:44:49 - job_xml_thread(): Done retrieving: data size 43862875
Fri 17 Jan 2014 06:44:49 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:44:49 - XML: Start document: iteration 6
Fri 17 Jan 2014 06:44:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:44:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:44:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:44:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:44:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:44:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:44:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:44:52 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:44:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:44:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:44:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:44:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:44:55 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:44:55 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:44:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:44:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 06:44:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 06:44:55 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:44:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7214 values 113756 bits 14219 bytes 
Fri 17 Jan 2014 06:45:02 - XML: Processed 655422 elements - found 612 jobs
Fri 17 Jan 2014 06:45:02 - job_xml_thread(): Found 24 updated jobs.
Fri 17 Jan 2014 06:45:02 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 06:45:05 - job_xml_thread(): Done storing. succesfully stored: 24 jobs
Fri 17 Jan 2014 06:45:05 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:45:05 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:45:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:45:06 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:45:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:45:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:45:06 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 06:45:06 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 06:45:06 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:45:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:45:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:45:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:45:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:45:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:45:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:45:08 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:45:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43829607
Fri 17 Jan 2014 06:45:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:45:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43829607
Fri 17 Jan 2014 06:45:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:45:20 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:45:20 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:45:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:45:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:45:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:45:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:45:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:45:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:45:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:45:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:45:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:45:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:45:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:45:24 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:45:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:45:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:45:24 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:45:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 06:45:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:45:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:45:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:45:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:45:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:45:26 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:45:26 - job_xml_thread(): Done retrieving: data size 43865850
Fri 17 Jan 2014 06:45:26 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:45:26 - XML: Start document: iteration 7
Fri 17 Jan 2014 06:45:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865850
Fri 17 Jan 2014 06:45:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:45:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43865850
Fri 17 Jan 2014 06:45:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:45:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:45:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:45:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:45:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:45:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:45:46 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:45:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:45:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:45:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:45:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:45:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:45:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:45:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:45:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:45:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:45:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:45:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:45:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:45:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:45:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:45:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:45:49 - XML: Processed 655420 elements - found 611 jobs
Fri 17 Jan 2014 06:45:49 - job 7347464 field 'start_timestamp' changed since saved from: 1389937466 to: 1389937417
Fri 17 Jan 2014 06:45:49 - job 7347438 appears to have finished
Fri 17 Jan 2014 06:45:49 - job 7346430 appears to have finished
Fri 17 Jan 2014 06:45:49 - job 7347451 field 'start_timestamp' changed since saved from: 1389937440 to: 1389937417
Fri 17 Jan 2014 06:45:49 - job 7347463 field 'start_timestamp' changed since saved from: 1389937464 to: 1389937417
Fri 17 Jan 2014 06:45:49 - job 7347442 field 'start_timestamp' changed since saved from: 1389937467 to: 1389937417
Fri 17 Jan 2014 06:45:49 - job 7347443 report time 1389937420 does not match current heartbeat 1389937472 : ignoring job
Fri 17 Jan 2014 06:45:49 - job 7347444 report time 1389937420 does not match current heartbeat 1389937472 : ignoring job
Fri 17 Jan 2014 06:45:49 - job_xml_thread(): Found 7 updated jobs.
Fri 17 Jan 2014 06:45:49 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 06:45:49 - job_xml_thread(): Done storing. succesfully stored: 7 jobs
Fri 17 Jan 2014 06:45:49 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:45:49 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:45:50 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:45:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43866449
Fri 17 Jan 2014 06:45:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:45:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43866449
Fri 17 Jan 2014 06:45:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:45:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:45:55 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:45:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:45:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 06:45:56 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:45:56 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:45:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 06:45:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8683 values 136847 bits 17105 bytes 
Fri 17 Jan 2014 06:45:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:45:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:46:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:46:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:46:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:46:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:46:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:46:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:46:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:46:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:46:04 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:46:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:46:04 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:46:04 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:46:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:46:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:46:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:46:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:46:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:46:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:46:06 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:46:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 06:46:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:46:06 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:46:06 - job_xml_thread(): Done retrieving: data size 43876100
Fri 17 Jan 2014 06:46:06 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:46:06 - XML: Start document: iteration 8
Fri 17 Jan 2014 06:46:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43876100
Fri 17 Jan 2014 06:46:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:46:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43876100
Fri 17 Jan 2014 06:46:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:46:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:46:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:46:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:46:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:46:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:46:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:46:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:46:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:46:22 - XML: Processed 655420 elements - found 611 jobs
Fri 17 Jan 2014 06:46:22 - job 7347443 report time 1389937420 does not match current heartbeat 1389937472 : ignoring job
Fri 17 Jan 2014 06:46:22 - job 7347444 report time 1389937420 does not match current heartbeat 1389937472 : ignoring job
Fri 17 Jan 2014 06:46:22 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 06:46:22 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 06:46:22 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:46:22 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:46:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:46:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:46:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:46:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:46:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:46:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:46:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:46:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:46:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:46:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:46:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:46:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:46:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:46:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:46:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43879262
Fri 17 Jan 2014 06:46:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:46:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43879262
Fri 17 Jan 2014 06:46:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:46:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:46:36 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:46:38 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:46:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:46:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:46:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:46:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:46:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:46:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:46:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:46:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:46:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:46:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:46:40 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:46:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:46:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:46:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:46:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:46:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:46:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:46:42 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:46:42 - job_xml_thread(): Done retrieving: data size 43869526
Fri 17 Jan 2014 06:46:42 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:46:42 - XML: Start document: iteration 9
Fri 17 Jan 2014 06:46:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43869526
Fri 17 Jan 2014 06:46:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:46:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43869526
Fri 17 Jan 2014 06:46:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:46:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:46:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:46:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:46:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:46:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:46:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:46:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:46:56 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:46:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:46:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:46:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:46:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:46:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:46:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:46:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 06:46:58 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:46:58 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:46:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148909 bits 18613 bytes 
Fri 17 Jan 2014 06:46:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 06:47:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:47:03 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:47:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:47:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:47:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:47:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:47:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:47:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:47:05 - XML: Processed 655420 elements - found 612 jobs
Fri 17 Jan 2014 06:47:05 - job 7347465 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 06:47:05 - job 7347462 field 'start_timestamp' changed since saved from: 1389937507 to: 1389937417
Fri 17 Jan 2014 06:47:05 - job 7347440 report time 1389937472 does not match current heartbeat 1389937540 : ignoring job
Fri 17 Jan 2014 06:47:05 - job 7347460 field 'start_timestamp' changed since saved from: 1389937503 to: 1389937417
Fri 17 Jan 2014 06:47:05 - job 7347457 field 'start_timestamp' changed since saved from: 1389937497 to: 1389937417
Fri 17 Jan 2014 06:47:05 - job 7347458 field 'start_timestamp' changed since saved from: 1389937499 to: 1389937417
Fri 17 Jan 2014 06:47:05 - job 7347452 field 'start_timestamp' changed since saved from: 1389937487 to: 1389937417
Fri 17 Jan 2014 06:47:05 - job 7347459 field 'start_timestamp' changed since saved from: 1389937501 to: 1389937417
Fri 17 Jan 2014 06:47:05 - job 7347453 field 'start_timestamp' changed since saved from: 1389937489 to: 1389937417
Fri 17 Jan 2014 06:47:05 - job 7347456 field 'start_timestamp' changed since saved from: 1389937495 to: 1389937417
Fri 17 Jan 2014 06:47:05 - job 7347454 field 'start_timestamp' changed since saved from: 1389937491 to: 1389937417
Fri 17 Jan 2014 06:47:05 - job 7347449 field 'start_timestamp' changed since saved from: 1389937481 to: 1389937417
Fri 17 Jan 2014 06:47:05 - job 7347443 report time 1389937420 does not match current heartbeat 1389937540 : ignoring job
Fri 17 Jan 2014 06:47:05 - job 7347444 report time 1389937420 does not match current heartbeat 1389937540 : ignoring job
Fri 17 Jan 2014 06:47:05 - job 7347445 field 'start_timestamp' changed since saved from: 1389937473 to: 1389937417
Fri 17 Jan 2014 06:47:05 - job 7347446 field 'start_timestamp' changed since saved from: 1389937475 to: 1389937417
Fri 17 Jan 2014 06:47:05 - job_xml_thread(): Found 14 updated jobs.
Fri 17 Jan 2014 06:47:05 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 06:47:05 - job_xml_thread(): Done storing. succesfully stored: 14 jobs
Fri 17 Jan 2014 06:47:05 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:47:05 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:47:07 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:47:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43845813
Fri 17 Jan 2014 06:47:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:47:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43845813
Fri 17 Jan 2014 06:47:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:47:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:47:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:47:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:47:16 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:47:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:47:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:47:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:47:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:47:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:47:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:47:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:47:20 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:47:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:47:21 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:47:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:47:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:47:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:47:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:47:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:47:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:47:22 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:47:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 06:47:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:47:23 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:47:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43805418
Fri 17 Jan 2014 06:47:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:47:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43805418
Fri 17 Jan 2014 06:47:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:47:24 - job_xml_thread(): Done retrieving: data size 43805418
Fri 17 Jan 2014 06:47:24 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:47:24 - XML: Start document: iteration 10
Fri 17 Jan 2014 06:47:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:47:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:47:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:47:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:47:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:47:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:47:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:47:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:47:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:47:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:47:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:47:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:47:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:47:45 - XML: Processed 654668 elements - found 609 jobs
Fri 17 Jan 2014 06:47:45 - job 7347440 report time 1389937472 does not match current heartbeat 1389937592 : ignoring job
Fri 17 Jan 2014 06:47:45 - job 7337103 appears to have finished
Fri 17 Jan 2014 06:47:45 - job 7347386 appears to have finished
Fri 17 Jan 2014 06:47:45 - job 7347339 appears to have finished
Fri 17 Jan 2014 06:47:45 - job 7347443 report time 1389937420 does not match current heartbeat 1389937592 : ignoring job
Fri 17 Jan 2014 06:47:45 - job 7347444 report time 1389937420 does not match current heartbeat 1389937592 : ignoring job
Fri 17 Jan 2014 06:47:45 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 06:47:45 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 06:47:45 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 06:47:45 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:47:45 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:47:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:47:46 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:47:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:47:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:47:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:47:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:47:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:47:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:47:48 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:47:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43224957
Fri 17 Jan 2014 06:47:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:47:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43224957
Fri 17 Jan 2014 06:47:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:47:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:47:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:47:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:47:58 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:48:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:48:00 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:48:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 06:48:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 06:48:00 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:48:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8758 values 138454 bits 17306 bytes 
Fri 17 Jan 2014 06:48:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:48:00 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:48:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:48:00 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:48:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:48:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:48:01 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:48:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:48:01 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:48:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:48:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:48:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:48:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:48:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:48:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:48:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:48:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:48:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:48:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:48:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:48:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:48:05 - job_xml_thread(): Done retrieving: data size 43191898
Fri 17 Jan 2014 06:48:05 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:48:05 - XML: Start document: iteration 11
Fri 17 Jan 2014 06:48:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43191898
Fri 17 Jan 2014 06:48:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:48:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43191898
Fri 17 Jan 2014 06:48:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:48:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:48:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:48:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:48:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:48:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:48:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:48:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:48:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:48:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:48:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:48:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:48:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:48:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:48:26 - XML: Processed 647216 elements - found 609 jobs
Fri 17 Jan 2014 06:48:26 - job 7347440 report time 1389937472 does not match current heartbeat 1389937592 : ignoring job
Fri 17 Jan 2014 06:48:26 - job 7347443 report time 1389937420 does not match current heartbeat 1389937592 : ignoring job
Fri 17 Jan 2014 06:48:26 - job 7347444 report time 1389937420 does not match current heartbeat 1389937592 : ignoring job
Fri 17 Jan 2014 06:48:26 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 06:48:26 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 06:48:26 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:48:26 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:48:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:48:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:48:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:48:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:48:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:48:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:48:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:48:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:48:29 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:48:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 06:48:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:48:30 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:48:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43586728
Fri 17 Jan 2014 06:48:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:48:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43586728
Fri 17 Jan 2014 06:48:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:48:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:48:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:48:41 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:48:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:48:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:48:42 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:48:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:48:42 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 06:48:42 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:48:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:48:43 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:48:43 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 06:48:43 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 06:48:43 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:48:43 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 06:48:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:48:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:48:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:48:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:48:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:48:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:48:44 - size of cluster 'LISA Cluster': 624 hosts 79480 metrics 922969 values 14582320 bits 1822790 bytes 
Fri 17 Jan 2014 06:48:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:48:46 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:48:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:48:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:48:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:48:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:48:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:48:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:48:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:48:49 - job_xml_thread(): Done retrieving: data size 43781520
Fri 17 Jan 2014 06:48:49 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:48:49 - XML: Start document: iteration 12
Fri 17 Jan 2014 06:48:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43781520
Fri 17 Jan 2014 06:48:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43781520
Fri 17 Jan 2014 06:48:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:48:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:48:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:48:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:49:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:49:00 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:49:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:49:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 06:49:01 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:49:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 06:49:01 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:49:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8572 values 135254 bits 16906 bytes 
Fri 17 Jan 2014 06:49:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:49:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:49:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:49:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:49:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:49:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:49:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:49:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:49:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:49:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:49:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:49:08 - XML: Processed 654628 elements - found 610 jobs
Fri 17 Jan 2014 06:49:08 - job 7347440 report time 1389937472 does not match current heartbeat 1389937661 : ignoring job
Fri 17 Jan 2014 06:49:08 - job 7347466 report time 1389937592 does not match current heartbeat 1389937661 : ignoring job
Fri 17 Jan 2014 06:49:08 - job 7347368 appears to have finished
Fri 17 Jan 2014 06:49:08 - job_xml_thread(): Found 5 updated jobs.
Fri 17 Jan 2014 06:49:08 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 06:49:08 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Fri 17 Jan 2014 06:49:08 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:49:08 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:49:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:49:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:49:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:49:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:49:12 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:49:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:49:12 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:49:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:49:15 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:49:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43830277
Fri 17 Jan 2014 06:49:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:49:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43830277
Fri 17 Jan 2014 06:49:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:49:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:49:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:49:23 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:49:23 - job_xml_thread(): Done retrieving: data size 43830277
Fri 17 Jan 2014 06:49:23 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:49:23 - XML: Start document: iteration 13
Fri 17 Jan 2014 06:49:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:49:25 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:49:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:49:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:49:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:49:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:49:27 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:49:27 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:49:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:49:36 - XML: Processed 655418 elements - found 610 jobs
Fri 17 Jan 2014 06:49:36 - job 7347466 report time 1389937592 does not match current heartbeat 1389937713 : ignoring job
Fri 17 Jan 2014 06:49:36 - job 7347468 report time 1389937661 does not match current heartbeat 1389937713 : ignoring job
Fri 17 Jan 2014 06:49:36 - job 7347469 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 06:49:36 - job 7347470 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 06:49:36 - job 7343931 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 06:49:36 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 06:49:36 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 06:49:36 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 06:49:36 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:49:36 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:49:37 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:49:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 06:49:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:49:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:49:38 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:49:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:49:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:49:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:49:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:49:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:49:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:49:41 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:49:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43836143
Fri 17 Jan 2014 06:49:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:49:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43836143
Fri 17 Jan 2014 06:49:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:49:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:49:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:49:43 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:49:43 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 06:49:51 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:49:51 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:49:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:49:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:49:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:49:54 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:49:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:49:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:49:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:49:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:49:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:49:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:49:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:49:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:49:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:49:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:49:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:49:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:49:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:49:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:50:01 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:50:01 - job_xml_thread(): Done retrieving: data size 43827564
Fri 17 Jan 2014 06:50:01 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:50:01 - XML: Start document: iteration 14
Fri 17 Jan 2014 06:50:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43827564
Fri 17 Jan 2014 06:50:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:50:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43827564
Fri 17 Jan 2014 06:50:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:50:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:50:01 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:50:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:50:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 06:50:03 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:50:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6344 values 100153 bits 12519 bytes 
Fri 17 Jan 2014 06:50:04 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:50:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 06:50:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:50:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:50:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:50:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:50:16 - XML: Processed 655418 elements - found 610 jobs
Fri 17 Jan 2014 06:50:16 - job 7347466 report time 1389937592 does not match current heartbeat 1389937713 : ignoring job
Fri 17 Jan 2014 06:50:17 - job 7347468 report time 1389937661 does not match current heartbeat 1389937713 : ignoring job
Fri 17 Jan 2014 06:50:17 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 06:50:17 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 06:50:17 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:50:17 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:50:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:50:21 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:50:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:50:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:50:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:50:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:50:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:50:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:50:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:50:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:50:24 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:50:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:50:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:50:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:50:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:50:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:50:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:50:27 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:50:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 06:50:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:50:27 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:50:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43869078
Fri 17 Jan 2014 06:50:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:50:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43869078
Fri 17 Jan 2014 06:50:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:50:32 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:50:32 - job_xml_thread(): Done retrieving: data size 43869078
Fri 17 Jan 2014 06:50:32 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:50:32 - XML: Start document: iteration 15
Fri 17 Jan 2014 06:50:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:50:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:50:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:50:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:50:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:50:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:50:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:50:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:50:42 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:50:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:50:42 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:50:42 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:50:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:50:44 - XML: Processed 655458 elements - found 630 jobs
Fri 17 Jan 2014 06:50:44 - job 7347471 report time 1389937713 does not match current heartbeat 1389937782 : ignoring job
Fri 17 Jan 2014 06:50:44 - job 7347466 report time 1389937592 does not match current heartbeat 1389937782 : ignoring job
Fri 17 Jan 2014 06:50:44 - job 7347468 report time 1389937661 does not match current heartbeat 1389937782 : ignoring job
Fri 17 Jan 2014 06:50:44 - job 7345030 appears to have finished
Fri 17 Jan 2014 06:50:44 - job 7346451 appears to have finished
Fri 17 Jan 2014 06:50:44 - job_xml_thread(): Found 24 updated jobs.
Fri 17 Jan 2014 06:50:44 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 06:50:48 - job_xml_thread(): Done storing. succesfully stored: 24 jobs
Fri 17 Jan 2014 06:50:48 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:50:48 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:50:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:50:49 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:50:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:50:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:50:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:50:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:50:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:50:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:50:53 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:50:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43860928
Fri 17 Jan 2014 06:50:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:50:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43860928
Fri 17 Jan 2014 06:50:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:50:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:50:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:51:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:51:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:51:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:51:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:51:03 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:51:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:51:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:51:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:51:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:51:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:51:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:51:04 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:51:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:51:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 06:51:04 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:51:04 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:51:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6139 values 96859 bits 12107 bytes 
Fri 17 Jan 2014 06:51:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 06:51:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:51:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:51:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:51:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:51:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:51:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:51:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:51:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:51:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:51:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:51:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:51:11 - job_xml_thread(): Done retrieving: data size 43873863
Fri 17 Jan 2014 06:51:11 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:51:11 - XML: Start document: iteration 16
Fri 17 Jan 2014 06:51:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873863
Fri 17 Jan 2014 06:51:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:51:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873863
Fri 17 Jan 2014 06:51:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:51:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:51:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:51:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:51:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:51:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:51:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:51:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:51:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:51:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:51:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:51:31 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:51:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:51:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:51:32 - XML: Processed 655454 elements - found 628 jobs
Fri 17 Jan 2014 06:51:32 - job 7347471 report time 1389937713 does not match current heartbeat 1389937782 : ignoring job
Fri 17 Jan 2014 06:51:32 - job 7347468 report time 1389937661 does not match current heartbeat 1389937782 : ignoring job
Fri 17 Jan 2014 06:51:32 - job 7347332 appears to have finished
Fri 17 Jan 2014 06:51:33 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 06:51:33 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 06:51:33 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 06:51:33 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:51:33 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:51:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:51:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:51:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:51:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:51:35 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:51:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:51:35 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:51:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:51:35 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:51:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 06:51:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:51:38 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:51:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43868824
Fri 17 Jan 2014 06:51:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:51:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43868824
Fri 17 Jan 2014 06:51:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:51:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:51:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:51:48 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:51:48 - job_xml_thread(): Done retrieving: data size 43868824
Fri 17 Jan 2014 06:51:48 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:51:48 - XML: Start document: iteration 17
Fri 17 Jan 2014 06:51:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:51:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:51:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:51:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:51:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:51:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:51:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:51:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:51:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:51:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:51:52 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:52:00 - XML: Processed 655458 elements - found 630 jobs
Fri 17 Jan 2014 06:52:00 - job 7347475 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 06:52:00 - job 7347474 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 06:52:00 - job 7347471 report time 1389937713 does not match current heartbeat 1389937833 : ignoring job
Fri 17 Jan 2014 06:52:00 - job 7347473 report time 1389937782 does not match current heartbeat 1389937833 : ignoring job
Fri 17 Jan 2014 06:52:00 - job 7347477 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 06:52:00 - job 7347468 report time 1389937661 does not match current heartbeat 1389937833 : ignoring job
Fri 17 Jan 2014 06:52:00 - job 7347479 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 06:52:00 - job 7347478 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 06:52:00 - job 7347493 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 06:52:00 - job 7347492 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 06:52:00 - job 7347491 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 06:52:00 - job 7347490 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 06:52:00 - job 7347488 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 06:52:00 - job 7347484 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 06:52:00 - job 7347487 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 06:52:00 - job 7347482 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 06:52:00 - job 7347483 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 06:52:00 - job 7347489 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 06:52:00 - job 7347485 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 06:52:00 - job 7347486 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 06:52:00 - job 7347480 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 06:52:00 - job 7347481 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 06:52:00 - job 7347476 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 06:52:00 - job_xml_thread(): Found 22 updated jobs.
Fri 17 Jan 2014 06:52:00 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 06:52:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:52:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:52:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:52:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:52:02 - job_xml_thread(): Done storing. succesfully stored: 22 jobs
Fri 17 Jan 2014 06:52:02 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:52:02 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:52:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:52:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:52:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:52:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:52:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:52:04 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:52:04 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:52:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 06:52:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:52:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 06:52:04 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:52:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5645 values 89004 bits 11125 bytes 
Fri 17 Jan 2014 06:52:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:52:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43842379
Fri 17 Jan 2014 06:52:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:52:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43842379
Fri 17 Jan 2014 06:52:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:52:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:52:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:52:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:52:13 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:52:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:52:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:52:14 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:52:14 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:52:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:52:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:52:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43842379
Fri 17 Jan 2014 06:52:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:52:17 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:52:17 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:52:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:52:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:52:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:52:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:52:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:52:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:52:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:52:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:52:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:52:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:52:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:52:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:52:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:52:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:52:29 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:52:29 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:52:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:52:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:52:30 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:52:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 06:52:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:52:31 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 06:52:31 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 06:52:31 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:52:31 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:52:31 - job_xml_thread(): Done retrieving: data size 43828876
Fri 17 Jan 2014 06:52:31 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:52:31 - XML: Start document: iteration 18
Fri 17 Jan 2014 06:52:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43828876
Fri 17 Jan 2014 06:52:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:52:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43828876
Fri 17 Jan 2014 06:52:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:52:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:52:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:52:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:52:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:52:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:52:49 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:52:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:52:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:52:50 - XML: Processed 655460 elements - found 631 jobs
Fri 17 Jan 2014 06:52:50 - job 7347474 field 'start_timestamp' changed since saved from: 1389937846 to: 1389937796
Fri 17 Jan 2014 06:52:50 - job 7347471 report time 1389937713 does not match current heartbeat 1389937902 : ignoring job
Fri 17 Jan 2014 06:52:50 - job 7347473 report time 1389937782 does not match current heartbeat 1389937902 : ignoring job
Fri 17 Jan 2014 06:52:50 - job 7347477 field 'start_timestamp' changed since saved from: 1389937852 to: 1389937796
Fri 17 Jan 2014 06:52:50 - job 7347495 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 06:52:50 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:52:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:52:50 - job 7347494 report time 1389937833 does not match current heartbeat 1389937902 : ignoring job
Fri 17 Jan 2014 06:52:50 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:52:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:52:50 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:52:50 - job 7347493 field 'start_timestamp' changed since saved from: 1389937839 to: 1389937796
Fri 17 Jan 2014 06:52:51 - job 7347491 field 'start_timestamp' changed since saved from: 1389937835 to: 1389937796
Fri 17 Jan 2014 06:52:51 - job 7347484 field 'start_timestamp' changed since saved from: 1389937866 to: 1389937796
Fri 17 Jan 2014 06:52:51 - job 7347485 field 'start_timestamp' changed since saved from: 1389937868 to: 1389937796
Fri 17 Jan 2014 06:52:51 - job 7347481 field 'start_timestamp' changed since saved from: 1389937860 to: 1389937796
Fri 17 Jan 2014 06:52:51 - job 7346512 appears to have finished
Fri 17 Jan 2014 06:52:52 - job 7347476 field 'start_timestamp' changed since saved from: 1389937850 to: 1389937796
Fri 17 Jan 2014 06:52:52 - job_xml_thread(): Found 13 updated jobs.
Fri 17 Jan 2014 06:52:52 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 06:52:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:52:53 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:52:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:52:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:52:53 - job_xml_thread(): Done storing. succesfully stored: 13 jobs
Fri 17 Jan 2014 06:52:53 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:52:53 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:52:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:52:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:52:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:52:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:52:55 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:52:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43887438
Fri 17 Jan 2014 06:52:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:52:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43887438
Fri 17 Jan 2014 06:52:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:53:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:53:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:53:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:53:06 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:53:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:53:07 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:53:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:53:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:53:08 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:53:08 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:53:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:53:08 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:53:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:53:08 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:53:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:53:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 06:53:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 06:53:08 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:53:08 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:53:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6891 values 108693 bits 13586 bytes 
Fri 17 Jan 2014 06:53:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:53:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:53:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:53:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:53:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:53:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:53:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:53:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:53:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:53:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:53:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:53:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43809128
Fri 17 Jan 2014 06:53:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:53:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43809128
Fri 17 Jan 2014 06:53:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:53:13 - job_xml_thread(): Done retrieving: data size 43809128
Fri 17 Jan 2014 06:53:13 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:53:13 - XML: Start document: iteration 19
Fri 17 Jan 2014 06:53:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:53:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:53:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:53:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:53:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:53:32 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:53:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:53:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:53:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:53:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:53:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:53:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:53:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:53:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:53:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:53:34 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:53:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:53:35 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:53:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:53:35 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:53:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:53:35 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:53:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 06:53:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:53:36 - XML: Processed 654702 elements - found 629 jobs
Fri 17 Jan 2014 06:53:36 - job 7347473 report time 1389937782 does not match current heartbeat 1389937902 : ignoring job
Fri 17 Jan 2014 06:53:36 - job 7347494 report time 1389937833 does not match current heartbeat 1389937902 : ignoring job
Fri 17 Jan 2014 06:53:36 - job 7347369 appears to have finished
Fri 17 Jan 2014 06:53:36 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 06:53:36 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 06:53:36 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 06:53:36 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:53:36 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:53:38 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:53:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43310001
Fri 17 Jan 2014 06:53:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:53:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43310001
Fri 17 Jan 2014 06:53:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:53:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:53:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:53:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:53:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:53:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:53:50 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:53:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:53:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:53:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:53:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:53:51 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:53:51 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:53:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:53:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:53:51 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:53:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:53:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:53:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:53:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:53:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:53:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:53:51 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:53:53 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:53:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43236452
Fri 17 Jan 2014 06:53:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:53:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43236452
Fri 17 Jan 2014 06:53:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:53:53 - job_xml_thread(): Done retrieving: data size 43236452
Fri 17 Jan 2014 06:53:54 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:53:54 - XML: Start document: iteration 20
Fri 17 Jan 2014 06:54:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:54:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:54:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:54:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:54:07 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:54:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:54:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:54:09 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:54:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:54:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:54:09 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:54:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:54:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:54:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:54:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 06:54:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 06:54:10 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:54:10 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:54:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9172 values 144651 bits 18081 bytes 
Fri 17 Jan 2014 06:54:13 - XML: Processed 647422 elements - found 631 jobs
Fri 17 Jan 2014 06:54:13 - job 7347473 report time 1389937782 does not match current heartbeat 1389937954 : ignoring job
Fri 17 Jan 2014 06:54:13 - job 7347497 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 06:54:13 - job 7347496 report time 1389937902 does not match current heartbeat 1389937954 : ignoring job
Fri 17 Jan 2014 06:54:13 - job 7347494 report time 1389937833 does not match current heartbeat 1389937954 : ignoring job
Fri 17 Jan 2014 06:54:14 - job 7343932 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 06:54:14 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 06:54:14 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 06:54:15 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 06:54:15 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:54:15 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:54:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:54:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:54:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:54:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:54:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:54:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:54:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:54:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:54:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:54:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43251225
Fri 17 Jan 2014 06:54:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:54:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43251225
Fri 17 Jan 2014 06:54:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:54:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:54:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:54:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:54:29 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:54:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:54:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:54:29 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:54:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:54:29 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:54:29 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:54:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:54:30 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:54:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:54:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:54:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:54:34 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:54:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:54:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:54:34 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:54:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 06:54:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:54:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:54:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:54:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:54:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:54:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:54:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43392274
Fri 17 Jan 2014 06:54:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:54:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43392274
Fri 17 Jan 2014 06:54:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:54:36 - job_xml_thread(): Done retrieving: data size 43392274
Fri 17 Jan 2014 06:54:36 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:54:36 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 06:54:37 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 06:54:37 - Housekeeping: done.
Fri 17 Jan 2014 06:54:37 - XML: Start document: iteration 0
Fri 17 Jan 2014 06:54:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:54:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:54:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:54:45 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:54:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:54:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:54:45 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:54:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:54:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:54:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:54:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:54:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:54:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:54:54 - XML: Processed 649598 elements - found 632 jobs
Fri 17 Jan 2014 06:54:54 - job 7347499 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 06:54:54 - job 7347498 report time 1389937954 does not match current heartbeat 1389938023 : ignoring job
Fri 17 Jan 2014 06:54:54 - job 7347496 report time 1389937902 does not match current heartbeat 1389938023 : ignoring job
Fri 17 Jan 2014 06:54:54 - job 7347494 report time 1389937833 does not match current heartbeat 1389938023 : ignoring job
Fri 17 Jan 2014 06:54:54 - job 7347344 appears to have finished
Fri 17 Jan 2014 06:54:54 - job_xml_thread(): Found 5 updated jobs.
Fri 17 Jan 2014 06:54:54 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 06:54:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:54:57 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:54:57 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Fri 17 Jan 2014 06:54:57 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:54:57 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:54:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:54:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:54:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:54:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:54:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:54:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:54:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:54:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43820843
Fri 17 Jan 2014 06:54:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:55:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43820843
Fri 17 Jan 2014 06:55:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:55:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:55:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:55:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:55:09 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:55:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:55:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:55:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:55:10 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:55:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 06:55:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 06:55:11 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:55:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8892 values 140203 bits 17525 bytes 
Fri 17 Jan 2014 06:55:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:55:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:55:12 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:55:12 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:55:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:55:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:55:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:55:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:55:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:55:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:55:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:55:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:55:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:55:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:55:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:55:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:55:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:55:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:55:17 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:55:17 - job_xml_thread(): Done retrieving: data size 43855112
Fri 17 Jan 2014 06:55:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855112
Fri 17 Jan 2014 06:55:17 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:55:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:55:17 - XML: Start document: iteration 1
Fri 17 Jan 2014 06:55:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855112
Fri 17 Jan 2014 06:55:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:55:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:55:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:55:30 - XML: Processed 655453 elements - found 631 jobs
Fri 17 Jan 2014 06:55:30 - job 7335116 appears to have finished
Fri 17 Jan 2014 06:55:30 - job 7347499 field 'start_timestamp' changed since saved from: 1389938031 to: 1389937979
Fri 17 Jan 2014 06:55:30 - job 7347498 report time 1389937954 does not match current heartbeat 1389938075 : ignoring job
Fri 17 Jan 2014 06:55:30 - job 7347496 report time 1389937902 does not match current heartbeat 1389938075 : ignoring job
Fri 17 Jan 2014 06:55:30 - job 7347366 appears to have finished
Fri 17 Jan 2014 06:55:30 - job 7347501 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 06:55:30 - job 7347500 report time 1389938023 does not match current heartbeat 1389938075 : ignoring job
Fri 17 Jan 2014 06:55:30 - job 7347502 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 06:55:30 - job_xml_thread(): Found 7 updated jobs.
Fri 17 Jan 2014 06:55:30 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 06:55:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:55:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:55:35 - job_xml_thread(): Done storing. succesfully stored: 7 jobs
Fri 17 Jan 2014 06:55:35 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:55:35 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:55:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:55:36 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:55:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:55:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:55:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:55:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:55:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:55:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:55:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:55:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:55:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:55:39 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:55:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 06:55:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:55:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:55:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:55:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:55:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:55:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:55:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:55:41 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:55:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43864023
Fri 17 Jan 2014 06:55:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:55:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43864023
Fri 17 Jan 2014 06:55:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:55:44 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 06:55:44 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:55:48 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:55:48 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:55:48 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 06:55:48 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 06:55:48 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 06:55:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:55:49 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:55:51 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:55:51 - job_xml_thread(): Done retrieving: data size 43864023
Fri 17 Jan 2014 06:55:51 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:55:51 - XML: Start document: iteration 2
Fri 17 Jan 2014 06:55:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:55:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:55:54 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:55:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:55:54 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:55:54 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:55:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:55:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:55:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:55:59 - size of cluster 'LISA Cluster': 624 hosts 79480 metrics 836046 values 13191314 bits 1648914 bytes 
Fri 17 Jan 2014 06:56:02 - XML: Processed 655460 elements - found 631 jobs
Fri 17 Jan 2014 06:56:02 - job 7347498 report time 1389937954 does not match current heartbeat 1389938075 : ignoring job
Fri 17 Jan 2014 06:56:02 - job 7347496 report time 1389937902 does not match current heartbeat 1389938075 : ignoring job
Fri 17 Jan 2014 06:56:02 - job 7347500 report time 1389938023 does not match current heartbeat 1389938075 : ignoring job
Fri 17 Jan 2014 06:56:03 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 06:56:03 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 06:56:03 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:56:03 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:56:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:56:03 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:56:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:56:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:56:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:56:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:56:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:56:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:56:07 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:56:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43846356
Fri 17 Jan 2014 06:56:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:56:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43846356
Fri 17 Jan 2014 06:56:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:56:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:56:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:56:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:56:12 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:56:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:56:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 06:56:13 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:56:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 06:56:13 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:56:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9249 values 145898 bits 18237 bytes 
Fri 17 Jan 2014 06:56:18 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:56:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:56:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:56:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:56:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:56:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:56:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:56:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:56:20 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:56:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:56:20 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:56:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:56:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:56:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:56:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:56:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:56:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:56:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:56:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:56:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:56:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:56:25 - job_xml_thread(): Done retrieving: data size 43868826
Fri 17 Jan 2014 06:56:25 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:56:25 - XML: Start document: iteration 3
Fri 17 Jan 2014 06:56:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43868826
Fri 17 Jan 2014 06:56:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:56:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43868826
Fri 17 Jan 2014 06:56:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:56:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:56:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:56:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:56:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:56:39 - XML: Processed 655458 elements - found 630 jobs
Fri 17 Jan 2014 06:56:39 - job 7347498 report time 1389937954 does not match current heartbeat 1389938143 : ignoring job
Fri 17 Jan 2014 06:56:39 - job 7347349 appears to have finished
Fri 17 Jan 2014 06:56:39 - job 7347504 report time 1389938075 does not match current heartbeat 1389938143 : ignoring job
Fri 17 Jan 2014 06:56:39 - job 7347500 report time 1389938023 does not match current heartbeat 1389938143 : ignoring job
Fri 17 Jan 2014 06:56:39 - job 7347502 field 'start_timestamp' changed since saved from: 1389938082 to: 1389938040
Fri 17 Jan 2014 06:56:39 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 06:56:39 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 06:56:40 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 06:56:40 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:56:40 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:56:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:56:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:56:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:56:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:56:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:56:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:56:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:56:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:56:48 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:56:48 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:56:48 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 06:56:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:56:49 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:56:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:56:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:56:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:56:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:56:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:56:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:56:49 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:56:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 06:56:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:56:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:56:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43889361
Fri 17 Jan 2014 06:56:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:56:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43889361
Fri 17 Jan 2014 06:56:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:56:56 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:56:56 - job_xml_thread(): Done retrieving: data size 43889361
Fri 17 Jan 2014 06:56:56 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:56:56 - XML: Start document: iteration 4
Fri 17 Jan 2014 06:57:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:57:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:57:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:57:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:57:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:57:07 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:57:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:57:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:57:08 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:57:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:57:08 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:57:08 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:57:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:57:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:57:13 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:57:13 - XML: Processed 655453 elements - found 630 jobs
Fri 17 Jan 2014 06:57:13 - job 7347498 report time 1389937954 does not match current heartbeat 1389938143 : ignoring job
Fri 17 Jan 2014 06:57:13 - job 7347504 report time 1389938075 does not match current heartbeat 1389938143 : ignoring job
Fri 17 Jan 2014 06:57:13 - job 7347500 report time 1389938023 does not match current heartbeat 1389938143 : ignoring job
Fri 17 Jan 2014 06:57:13 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 06:57:13 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 06:57:13 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:57:13 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:57:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:57:14 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:57:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 06:57:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 06:57:14 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:57:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5818 values 91757 bits 11469 bytes 
Fri 17 Jan 2014 06:57:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:57:15 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:57:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:57:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:57:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:57:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:57:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:57:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:57:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:57:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851022
Fri 17 Jan 2014 06:57:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:57:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851022
Fri 17 Jan 2014 06:57:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:57:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:57:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:57:28 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:57:28 - job_xml_thread(): Done retrieving: data size 43851022
Fri 17 Jan 2014 06:57:28 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:57:28 - XML: Start document: iteration 5
Fri 17 Jan 2014 06:57:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:57:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:57:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:57:36 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:57:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:57:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:57:37 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:57:37 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:57:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:57:37 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:57:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:57:40 - XML: Processed 655456 elements - found 629 jobs
Fri 17 Jan 2014 06:57:40 - job 7347361 appears to have finished
Fri 17 Jan 2014 06:57:40 - job 7347505 report time 1389938143 does not match current heartbeat 1389938195 : ignoring job
Fri 17 Jan 2014 06:57:40 - job 7347504 report time 1389938075 does not match current heartbeat 1389938195 : ignoring job
Fri 17 Jan 2014 06:57:40 - job 7347500 report time 1389938023 does not match current heartbeat 1389938195 : ignoring job
Fri 17 Jan 2014 06:57:40 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 06:57:40 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 06:57:40 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 06:57:40 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:57:40 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:57:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:57:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:57:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:57:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:57:42 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:57:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 06:57:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:57:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:57:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:57:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:57:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:57:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:57:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853752
Fri 17 Jan 2014 06:57:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:57:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853752
Fri 17 Jan 2014 06:57:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:57:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:57:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:57:55 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:57:55 - job_xml_thread(): Done retrieving: data size 43853752
Fri 17 Jan 2014 06:57:55 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:57:55 - XML: Start document: iteration 6
Fri 17 Jan 2014 06:57:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:57:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:57:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:57:58 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:57:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:57:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:57:59 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:57:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:57:59 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:57:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:57:59 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:58:08 - XML: Processed 655456 elements - found 629 jobs
Fri 17 Jan 2014 06:58:08 - job 7347505 report time 1389938143 does not match current heartbeat 1389938195 : ignoring job
Fri 17 Jan 2014 06:58:08 - job 7347504 report time 1389938075 does not match current heartbeat 1389938195 : ignoring job
Fri 17 Jan 2014 06:58:08 - job 7347500 report time 1389938023 does not match current heartbeat 1389938195 : ignoring job
Fri 17 Jan 2014 06:58:08 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 06:58:08 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 06:58:08 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:58:08 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:58:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:58:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:58:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:58:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:58:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:58:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:58:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:58:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:58:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:58:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43837768
Fri 17 Jan 2014 06:58:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:58:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43837768
Fri 17 Jan 2014 06:58:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:58:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:58:14 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:58:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:58:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:58:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:58:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 06:58:15 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:58:15 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:58:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 06:58:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8704 values 137224 bits 17153 bytes 
Fri 17 Jan 2014 06:58:23 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:58:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:58:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:58:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:58:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:58:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:58:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:58:28 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:58:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:58:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:58:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:58:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:58:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:58:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:58:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:58:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:58:29 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:58:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:58:29 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:58:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:58:34 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:58:34 - job_xml_thread(): Done retrieving: data size 43856156
Fri 17 Jan 2014 06:58:34 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:58:34 - XML: Start document: iteration 7
Fri 17 Jan 2014 06:58:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856156
Fri 17 Jan 2014 06:58:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:58:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43856156
Fri 17 Jan 2014 06:58:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:58:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:58:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:58:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:58:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:58:45 - XML: Processed 655454 elements - found 628 jobs
Fri 17 Jan 2014 06:58:45 - job 7347382 appears to have finished
Fri 17 Jan 2014 06:58:45 - job 7347402 appears to have finished
Fri 17 Jan 2014 06:58:45 - job 7347505 report time 1389938143 does not match current heartbeat 1389938264 : ignoring job
Fri 17 Jan 2014 06:58:45 - job 7347504 report time 1389938075 does not match current heartbeat 1389938264 : ignoring job
Fri 17 Jan 2014 06:58:45 - job 7347506 report time 1389938195 does not match current heartbeat 1389938264 : ignoring job
Fri 17 Jan 2014 06:58:45 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 06:58:45 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 06:58:47 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 06:58:47 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:58:47 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:58:52 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:58:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 06:58:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:58:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:58:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:58:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:58:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:58:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:58:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:58:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:58:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:58:56 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:58:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:58:56 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:58:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:58:56 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:58:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:58:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:58:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:58:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:58:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:58:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870928
Fri 17 Jan 2014 06:58:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:59:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870928
Fri 17 Jan 2014 06:59:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:59:02 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:59:02 - job_xml_thread(): Done retrieving: data size 43870928
Fri 17 Jan 2014 06:59:02 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:59:02 - XML: Start document: iteration 8
Fri 17 Jan 2014 06:59:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:59:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:59:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:59:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:59:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:59:16 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:59:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:59:16 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:59:16 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:59:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 06:59:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:59:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 06:59:16 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:59:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6011 values 94802 bits 11850 bytes 
Fri 17 Jan 2014 06:59:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:59:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:59:17 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:59:17 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:59:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:59:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:59:17 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:59:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:59:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:59:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:59:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:59:23 - XML: Processed 655453 elements - found 628 jobs
Fri 17 Jan 2014 06:59:23 - job 7347505 report time 1389938143 does not match current heartbeat 1389938264 : ignoring job
Fri 17 Jan 2014 06:59:23 - job 7347504 report time 1389938075 does not match current heartbeat 1389938264 : ignoring job
Fri 17 Jan 2014 06:59:23 - job 7347506 report time 1389938195 does not match current heartbeat 1389938264 : ignoring job
Fri 17 Jan 2014 06:59:23 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 06:59:23 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 06:59:23 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 06:59:23 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 06:59:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:59:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:59:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:59:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:59:26 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 06:59:26 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 06:59:26 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:59:26 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 06:59:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 06:59:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:59:27 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:59:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43766311
Fri 17 Jan 2014 06:59:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:59:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43766311
Fri 17 Jan 2014 06:59:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:59:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:59:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:59:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:59:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:59:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 06:59:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:59:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:59:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:59:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:59:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:59:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:59:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:59:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 06:59:38 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 06:59:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 06:59:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 06:59:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 06:59:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 06:59:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:59:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 06:59:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 06:59:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 06:59:42 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 06:59:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43248910
Fri 17 Jan 2014 06:59:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 06:59:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43248910
Fri 17 Jan 2014 06:59:43 - job_xml_thread(): Done retrieving: data size 43248910
Fri 17 Jan 2014 06:59:43 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 06:59:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 06:59:43 - XML: Start document: iteration 9
Fri 17 Jan 2014 06:59:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 06:59:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 06:59:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 06:59:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 06:59:54 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:59:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 06:59:54 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 06:59:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 06:59:55 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 06:59:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 06:59:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:00:04 - XML: Processed 647880 elements - found 628 jobs
Fri 17 Jan 2014 07:00:04 - job 7343933 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 07:00:04 - job 7347508 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 07:00:04 - job 7347505 report time 1389938143 does not match current heartbeat 1389938316 : ignoring job
Fri 17 Jan 2014 07:00:04 - job 7347507 report time 1389938264 does not match current heartbeat 1389938316 : ignoring job
Fri 17 Jan 2014 07:00:04 - job 7347506 report time 1389938195 does not match current heartbeat 1389938316 : ignoring job
Fri 17 Jan 2014 07:00:04 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 07:00:04 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 07:00:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:00:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:00:05 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 07:00:05 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:00:05 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:00:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:00:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:00:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:00:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:00:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:00:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:00:07 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:00:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43196571
Fri 17 Jan 2014 07:00:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:00:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43196571
Fri 17 Jan 2014 07:00:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:00:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:00:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:00:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:00:16 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:00:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:00:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:00:16 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:00:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:00:16 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:00:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:00:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:00:16 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:00:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43196571
Fri 17 Jan 2014 07:00:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:00:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:00:18 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:00:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 07:00:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 07:00:18 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:00:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9279 values 146391 bits 18298 bytes 
Fri 17 Jan 2014 07:00:20 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:00:20 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:00:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:00:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:00:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:00:25 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:00:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:00:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:00:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:00:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:00:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:00:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:00:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:00:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:00:30 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:00:30 - job_xml_thread(): Done retrieving: data size 43250429
Fri 17 Jan 2014 07:00:30 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:00:30 - XML: Start document: iteration 10
Fri 17 Jan 2014 07:00:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43250429
Fri 17 Jan 2014 07:00:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:00:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:00:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:00:32 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:00:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:00:32 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:00:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:00:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43250429
Fri 17 Jan 2014 07:00:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:00:38 - XML: Processed 648002 elements - found 628 jobs
Fri 17 Jan 2014 07:00:39 - job 7347509 report time 1389938316 does not match current heartbeat 1389938385 : ignoring job
Fri 17 Jan 2014 07:00:39 - job 7347507 report time 1389938264 does not match current heartbeat 1389938385 : ignoring job
Fri 17 Jan 2014 07:00:39 - job 7347506 report time 1389938195 does not match current heartbeat 1389938385 : ignoring job
Fri 17 Jan 2014 07:00:39 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 07:00:39 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 07:00:40 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 07:00:40 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:00:40 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:00:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:00:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:00:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:00:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:00:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:00:48 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:00:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:00:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:00:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:00:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:00:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:00:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:00:49 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:00:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:00:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:00:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:00:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:00:51 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:00:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 07:00:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:00:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:00:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:00:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:00:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:00:53 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:00:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43832611
Fri 17 Jan 2014 07:00:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:00:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43832611
Fri 17 Jan 2014 07:00:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:00:55 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:00:55 - job_xml_thread(): Done retrieving: data size 43832611
Fri 17 Jan 2014 07:00:55 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:00:55 - XML: Start document: iteration 11
Fri 17 Jan 2014 07:01:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:01:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:01:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:01:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:01:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:01:07 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:01:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:01:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:01:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:01:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:01:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:01:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:01:09 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:01:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:01:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:01:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:01:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:01:16 - XML: Processed 655124 elements - found 628 jobs
Fri 17 Jan 2014 07:01:16 - job 7347509 report time 1389938316 does not match current heartbeat 1389938385 : ignoring job
Fri 17 Jan 2014 07:01:16 - job 7347507 report time 1389938264 does not match current heartbeat 1389938385 : ignoring job
Fri 17 Jan 2014 07:01:16 - job 7347506 report time 1389938195 does not match current heartbeat 1389938385 : ignoring job
Fri 17 Jan 2014 07:01:16 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 07:01:16 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 07:01:16 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:01:16 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:01:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:01:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:01:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:01:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:01:17 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:01:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43854358
Fri 17 Jan 2014 07:01:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:01:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:01:18 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:01:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43854358
Fri 17 Jan 2014 07:01:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:01:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:01:18 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:01:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 07:01:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 07:01:19 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:01:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8874 values 139951 bits 17493 bytes 
Fri 17 Jan 2014 07:01:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:01:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:01:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:01:29 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:01:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:01:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:01:29 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:01:29 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:01:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:01:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:01:29 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:01:31 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:01:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:01:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:01:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:01:34 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:01:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:01:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:01:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:01:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:01:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:01:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:01:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:01:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43864888
Fri 17 Jan 2014 07:01:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:01:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43864888
Fri 17 Jan 2014 07:01:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:01:37 - job_xml_thread(): Done retrieving: data size 43864888
Fri 17 Jan 2014 07:01:37 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:01:37 - XML: Start document: iteration 12
Fri 17 Jan 2014 07:01:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:01:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:01:49 - XML: Processed 655452 elements - found 627 jobs
Fri 17 Jan 2014 07:01:49 - job 7346498 appears to have finished
Fri 17 Jan 2014 07:01:49 - job 7347510 report time 1389938385 does not match current heartbeat 1389938436 : ignoring job
Fri 17 Jan 2014 07:01:49 - job 7347403 appears to have finished
Fri 17 Jan 2014 07:01:49 - job 7347509 report time 1389938316 does not match current heartbeat 1389938436 : ignoring job
Fri 17 Jan 2014 07:01:49 - job 7347507 report time 1389938264 does not match current heartbeat 1389938436 : ignoring job
Fri 17 Jan 2014 07:01:49 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 07:01:49 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 07:01:49 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 07:01:49 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:01:49 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:01:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:01:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:01:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:01:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:01:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:01:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:01:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:01:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:01:56 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:01:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:01:56 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:01:56 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:01:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:01:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:01:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:01:56 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:01:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 07:01:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:01:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:01:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:01:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:01:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:01:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:01:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43877157
Fri 17 Jan 2014 07:01:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:01:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43877157
Fri 17 Jan 2014 07:01:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:02:04 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:02:05 - job_xml_thread(): Done retrieving: data size 43877157
Fri 17 Jan 2014 07:02:05 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:02:05 - XML: Start document: iteration 13
Fri 17 Jan 2014 07:02:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:02:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:02:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:02:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:02:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:02:13 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:02:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:02:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:02:14 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:02:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:02:14 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:02:14 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:02:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:02:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:02:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:02:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:02:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:02:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:02:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:02:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:02:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:02:18 - XML: Processed 655452 elements - found 627 jobs
Fri 17 Jan 2014 07:02:18 - job 7347510 report time 1389938385 does not match current heartbeat 1389938436 : ignoring job
Fri 17 Jan 2014 07:02:18 - job 7347509 report time 1389938316 does not match current heartbeat 1389938436 : ignoring job
Fri 17 Jan 2014 07:02:18 - job 7347507 report time 1389938264 does not match current heartbeat 1389938436 : ignoring job
Fri 17 Jan 2014 07:02:18 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 07:02:18 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 07:02:18 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:02:18 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:02:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:02:19 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:02:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:02:19 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:02:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 07:02:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 07:02:19 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:02:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5632 values 89011 bits 11126 bytes 
Fri 17 Jan 2014 07:02:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:02:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43878595
Fri 17 Jan 2014 07:02:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:02:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43878595
Fri 17 Jan 2014 07:02:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:02:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:02:28 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:02:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:02:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:02:29 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:02:29 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:02:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:02:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:02:29 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:02:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:02:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:02:33 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:02:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:02:33 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:02:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:02:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:02:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:02:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:02:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:02:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:02:35 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:02:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 07:02:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:02:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:02:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43878066
Fri 17 Jan 2014 07:02:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:02:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43878066
Fri 17 Jan 2014 07:02:36 - job_xml_thread(): Done retrieving: data size 43878066
Fri 17 Jan 2014 07:02:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:02:36 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:02:37 - XML: Start document: iteration 14
Fri 17 Jan 2014 07:02:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:02:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:02:49 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 07:02:49 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:02:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:02:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:02:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:02:50 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:02:50 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:02:50 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 07:02:50 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:02:50 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 07:02:51 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 07:02:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:02:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:02:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:02:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:02:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:02:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:02:52 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:02:53 - size of cluster 'LISA Cluster': 624 hosts 79470 metrics 809606 values 12788180 bits 1598522 bytes 
Fri 17 Jan 2014 07:02:54 - XML: Processed 655452 elements - found 627 jobs
Fri 17 Jan 2014 07:02:54 - job 7347512 report time 1389938436 does not match current heartbeat 1389938505 : ignoring job
Fri 17 Jan 2014 07:02:54 - job 7347510 report time 1389938385 does not match current heartbeat 1389938505 : ignoring job
Fri 17 Jan 2014 07:02:54 - job 7347509 report time 1389938316 does not match current heartbeat 1389938505 : ignoring job
Fri 17 Jan 2014 07:02:54 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 07:02:54 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 07:02:54 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 07:02:54 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:02:54 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:02:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:02:59 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:02:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:02:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:02:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:02:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:02:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:02:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:03:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:03:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855979
Fri 17 Jan 2014 07:03:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:03:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855979
Fri 17 Jan 2014 07:03:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:03:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:03:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:03:09 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:03:10 - job_xml_thread(): Done retrieving: data size 43855979
Fri 17 Jan 2014 07:03:10 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:03:10 - XML: Start document: iteration 15
Fri 17 Jan 2014 07:03:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:03:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:03:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:03:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:03:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:03:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:03:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:03:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:03:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:03:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:03:19 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:03:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:03:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:03:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:03:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 07:03:20 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:03:20 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:03:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 07:03:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6821 values 107866 bits 13483 bytes 
Fri 17 Jan 2014 07:03:22 - XML: Processed 655452 elements - found 627 jobs
Fri 17 Jan 2014 07:03:22 - job 7347512 report time 1389938436 does not match current heartbeat 1389938505 : ignoring job
Fri 17 Jan 2014 07:03:22 - job 7347510 report time 1389938385 does not match current heartbeat 1389938505 : ignoring job
Fri 17 Jan 2014 07:03:22 - job 7347509 report time 1389938316 does not match current heartbeat 1389938505 : ignoring job
Fri 17 Jan 2014 07:03:22 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 07:03:22 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 07:03:22 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:03:22 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:03:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:03:24 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:03:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:03:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:03:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:03:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:03:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:03:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:03:27 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:03:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43845593
Fri 17 Jan 2014 07:03:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:03:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43845593
Fri 17 Jan 2014 07:03:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:03:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:03:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:03:37 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:03:37 - job_xml_thread(): Done retrieving: data size 43845593
Fri 17 Jan 2014 07:03:37 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:03:37 - XML: Start document: iteration 16
Fri 17 Jan 2014 07:03:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:03:38 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:03:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:03:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:03:39 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:03:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:03:39 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:03:39 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:03:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:03:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:03:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:03:48 - XML: Processed 655452 elements - found 627 jobs
Fri 17 Jan 2014 07:03:48 - job 7347512 report time 1389938436 does not match current heartbeat 1389938557 : ignoring job
Fri 17 Jan 2014 07:03:48 - job 7347510 report time 1389938385 does not match current heartbeat 1389938557 : ignoring job
Fri 17 Jan 2014 07:03:48 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 07:03:48 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 07:03:49 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 07:03:49 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:03:49 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:03:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:03:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:03:50 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:03:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 07:03:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:03:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:03:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:03:51 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:03:51 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 07:03:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:03:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:03:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:03:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:03:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:03:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43850700
Fri 17 Jan 2014 07:03:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:03:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43850700
Fri 17 Jan 2014 07:03:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:03:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:03:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:04:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:04:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:04:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:04:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:04:04 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:04:04 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:04:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:04:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:04:04 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:04:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:04:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:04:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:04:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:04:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:04:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:04:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:04:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:04:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:04:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:04:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:04:10 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:04:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855215
Fri 17 Jan 2014 07:04:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:04:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855215
Fri 17 Jan 2014 07:04:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:04:11 - job_xml_thread(): Done retrieving: data size 43855215
Fri 17 Jan 2014 07:04:11 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:04:11 - XML: Start document: iteration 17
Fri 17 Jan 2014 07:04:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:04:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:04:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:04:20 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:04:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:04:20 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:04:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 07:04:21 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:04:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 07:04:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:04:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:04:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8745 values 138035 bits 17254 bytes 
Fri 17 Jan 2014 07:04:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:04:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:04:23 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:04:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:04:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:04:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:04:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:04:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:04:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:04:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:04:34 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:04:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:04:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:04:35 - XML: Processed 655452 elements - found 627 jobs
Fri 17 Jan 2014 07:04:35 - job 7347512 report time 1389938436 does not match current heartbeat 1389938557 : ignoring job
Fri 17 Jan 2014 07:04:35 - job 7347510 report time 1389938385 does not match current heartbeat 1389938557 : ignoring job
Fri 17 Jan 2014 07:04:35 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 07:04:35 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 07:04:35 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:04:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:04:35 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:04:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:04:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:04:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:04:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:04:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:04:38 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:04:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43849625
Fri 17 Jan 2014 07:04:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:04:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43849625
Fri 17 Jan 2014 07:04:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:04:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:04:50 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:04:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:04:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:04:50 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:04:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:04:50 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:04:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:04:50 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:04:50 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:04:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:04:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:04:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:04:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:04:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:04:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:04:55 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:04:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 07:04:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:04:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:04:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:04:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:04:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:04:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:04:58 - job_xml_thread(): Done retrieving: data size 43851187
Fri 17 Jan 2014 07:04:58 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:04:58 - XML: Start document: iteration 18
Fri 17 Jan 2014 07:04:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851187
Fri 17 Jan 2014 07:04:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:04:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851187
Fri 17 Jan 2014 07:04:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:05:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:05:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:05:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:05:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:05:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:05:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:05:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:05:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:05:16 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:05:16 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:05:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:05:17 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:05:17 - XML: Processed 655449 elements - found 627 jobs
Fri 17 Jan 2014 07:05:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:05:17 - job 7347512 report time 1389938436 does not match current heartbeat 1389938626 : ignoring job
Fri 17 Jan 2014 07:05:17 - job 7347513 report time 1389938557 does not match current heartbeat 1389938626 : ignoring job
Fri 17 Jan 2014 07:05:17 - job 7347398 appears to have finished
Fri 17 Jan 2014 07:05:17 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 07:05:17 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 07:05:17 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 07:05:17 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:05:17 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:05:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:05:21 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:05:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:05:21 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:05:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:05:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:05:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:05:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:05:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:05:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:05:21 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:05:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:05:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 07:05:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 07:05:21 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:05:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5843 values 92148 bits 11518 bytes 
Fri 17 Jan 2014 07:05:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:05:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43795684
Fri 17 Jan 2014 07:05:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:05:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43795684
Fri 17 Jan 2014 07:05:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:05:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:05:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:05:32 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:05:32 - job_xml_thread(): Done retrieving: data size 43795684
Fri 17 Jan 2014 07:05:32 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:05:32 - XML: Start document: iteration 19
Fri 17 Jan 2014 07:05:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:05:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:05:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:05:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:05:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:05:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:05:39 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:05:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:05:39 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:05:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:05:39 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:05:47 - XML: Processed 654704 elements - found 627 jobs
Fri 17 Jan 2014 07:05:47 - job 7347513 report time 1389938557 does not match current heartbeat 1389938678 : ignoring job
Fri 17 Jan 2014 07:05:47 - job 7347516 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 07:05:47 - job 7347515 report time 1389938626 does not match current heartbeat 1389938678 : ignoring job
Fri 17 Jan 2014 07:05:47 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 07:05:47 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 07:05:48 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 07:05:48 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:05:48 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:05:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:05:49 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:05:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:05:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:05:49 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:05:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 07:05:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:05:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:05:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:05:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:05:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:05:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:05:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43255216
Fri 17 Jan 2014 07:05:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:05:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43255216
Fri 17 Jan 2014 07:05:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:05:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:05:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:06:03 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:06:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:06:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:06:03 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:06:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:06:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:06:04 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:06:04 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:06:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:06:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:06:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:06:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:06:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:06:08 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:06:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:06:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:06:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:06:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:06:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:06:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:06:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:06:11 - job_xml_thread(): Done retrieving: data size 43222648
Fri 17 Jan 2014 07:06:11 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:06:11 - XML: Start document: iteration 20
Fri 17 Jan 2014 07:06:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43222648
Fri 17 Jan 2014 07:06:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:06:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43222648
Fri 17 Jan 2014 07:06:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:06:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:06:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:06:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:06:21 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:06:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:06:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 07:06:22 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:06:22 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:06:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 07:06:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8721 values 137486 bits 17185 bytes 
Fri 17 Jan 2014 07:06:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:06:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:06:26 - XML: Processed 647581 elements - found 627 jobs
Fri 17 Jan 2014 07:06:26 - job 7347513 report time 1389938557 does not match current heartbeat 1389938678 : ignoring job
Fri 17 Jan 2014 07:06:26 - job 7347515 report time 1389938626 does not match current heartbeat 1389938678 : ignoring job
Fri 17 Jan 2014 07:06:26 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 07:06:26 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 07:06:26 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:06:26 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:06:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:06:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:06:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:06:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:06:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:06:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:06:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:06:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:06:31 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:06:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:06:35 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:06:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:06:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:06:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:06:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:06:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:06:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:06:36 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 07:06:36 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 07:06:36 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:06:37 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:06:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43322651
Fri 17 Jan 2014 07:06:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:06:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43322651
Fri 17 Jan 2014 07:06:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:06:41 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:06:42 - job_xml_thread(): Done retrieving: data size 43322651
Fri 17 Jan 2014 07:06:42 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:06:42 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 07:06:42 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 07:06:42 - Housekeeping: done.
Fri 17 Jan 2014 07:06:42 - XML: Start document: iteration 0
Fri 17 Jan 2014 07:06:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:06:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:06:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:06:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:06:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:06:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:06:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:06:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:06:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:06:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:06:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:06:52 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:06:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:06:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:06:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:06:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:06:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:06:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:06:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:06:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:06:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:07:01 - XML: Processed 648620 elements - found 627 jobs
Fri 17 Jan 2014 07:07:01 - job 7347513 report time 1389938557 does not match current heartbeat 1389938746 : ignoring job
Fri 17 Jan 2014 07:07:01 - job 7347515 report time 1389938626 does not match current heartbeat 1389938746 : ignoring job
Fri 17 Jan 2014 07:07:01 - job 7347432 appears to have finished
Fri 17 Jan 2014 07:07:01 - job 7347517 report time 1389938678 does not match current heartbeat 1389938746 : ignoring job
Fri 17 Jan 2014 07:07:01 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 07:07:01 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 07:07:01 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 07:07:01 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:07:01 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:07:01 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:07:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 07:07:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:07:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:07:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43845762
Fri 17 Jan 2014 07:07:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:07:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43845762
Fri 17 Jan 2014 07:07:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:07:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:07:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:07:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:07:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:07:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:07:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:07:14 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:07:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:07:14 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:07:14 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:07:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:07:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:07:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:07:16 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:07:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:07:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:07:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:07:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:07:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:07:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:07:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:07:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:07:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:07:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43861121
Fri 17 Jan 2014 07:07:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:07:19 - job_xml_thread(): Done retrieving: data size 43861121
Fri 17 Jan 2014 07:07:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43861121
Fri 17 Jan 2014 07:07:19 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:07:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:07:19 - XML: Start document: iteration 1
Fri 17 Jan 2014 07:07:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:07:22 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:07:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:07:25 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:07:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 07:07:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 07:07:25 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:07:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8730 values 137667 bits 17208 bytes 
Fri 17 Jan 2014 07:07:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:07:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:07:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:07:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:07:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:07:34 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:07:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:07:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:07:35 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:07:35 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:07:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:07:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:07:35 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:07:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:07:40 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:07:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:07:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:07:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:07:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:07:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:07:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:07:42 - XML: Processed 655449 elements - found 627 jobs
Fri 17 Jan 2014 07:07:42 - job 7347518 report time 1389938746 does not match current heartbeat 1389938798 : ignoring job
Fri 17 Jan 2014 07:07:42 - job 7347515 report time 1389938626 does not match current heartbeat 1389938798 : ignoring job
Fri 17 Jan 2014 07:07:42 - job 7347405 appears to have finished
Fri 17 Jan 2014 07:07:42 - job 7347517 report time 1389938678 does not match current heartbeat 1389938798 : ignoring job
Fri 17 Jan 2014 07:07:42 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 07:07:42 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 07:07:42 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 07:07:42 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:07:42 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:07:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:07:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43841703
Fri 17 Jan 2014 07:07:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:07:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43841703
Fri 17 Jan 2014 07:07:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:07:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:07:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:07:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:07:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:07:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:07:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:07:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:07:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:07:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:07:55 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:07:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:07:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:07:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:07:57 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:07:58 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:07:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 07:07:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:08:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:08:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:08:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:08:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:08:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:08:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:08:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:08:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:08:01 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:08:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43866706
Fri 17 Jan 2014 07:08:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:08:01 - job_xml_thread(): Done retrieving: data size 43866706
Fri 17 Jan 2014 07:08:01 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:08:01 - XML: Start document: iteration 2
Fri 17 Jan 2014 07:08:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43866706
Fri 17 Jan 2014 07:08:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:08:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:08:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:08:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:08:14 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:08:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:08:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:08:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:08:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:08:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:08:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:08:15 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:08:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:08:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:08:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:08:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:08:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:08:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:08:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:08:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:08:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:08:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:08:24 - XML: Processed 655452 elements - found 627 jobs
Fri 17 Jan 2014 07:08:24 - job 7347518 report time 1389938746 does not match current heartbeat 1389938798 : ignoring job
Fri 17 Jan 2014 07:08:24 - job 7347515 report time 1389938626 does not match current heartbeat 1389938798 : ignoring job
Fri 17 Jan 2014 07:08:24 - job 7347517 report time 1389938678 does not match current heartbeat 1389938798 : ignoring job
Fri 17 Jan 2014 07:08:24 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 07:08:24 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 07:08:24 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:08:24 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:08:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:08:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:08:25 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:08:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43849913
Fri 17 Jan 2014 07:08:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:08:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:08:26 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:08:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 07:08:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 07:08:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43849913
Fri 17 Jan 2014 07:08:27 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:08:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9095 values 143436 bits 17929 bytes 
Fri 17 Jan 2014 07:08:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:08:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:08:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:08:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:08:36 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:08:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:08:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:08:37 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:08:37 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:08:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:08:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:08:37 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:08:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:08:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:08:39 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:08:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:08:40 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:08:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:08:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:08:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:08:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:08:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:08:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:08:42 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:08:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856638
Fri 17 Jan 2014 07:08:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:08:42 - job_xml_thread(): Done retrieving: data size 43856638
Fri 17 Jan 2014 07:08:42 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:08:42 - XML: Start document: iteration 3
Fri 17 Jan 2014 07:08:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43856638
Fri 17 Jan 2014 07:08:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:08:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:08:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:08:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:08:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:08:59 - XML: Processed 655448 elements - found 626 jobs
Fri 17 Jan 2014 07:08:59 - job 7347518 report time 1389938746 does not match current heartbeat 1389938867 : ignoring job
Fri 17 Jan 2014 07:08:59 - job 7336645 appears to have finished
Fri 17 Jan 2014 07:08:59 - job 7347520 report time 1389938798 does not match current heartbeat 1389938867 : ignoring job
Fri 17 Jan 2014 07:08:59 - job 7347517 report time 1389938678 does not match current heartbeat 1389938867 : ignoring job
Fri 17 Jan 2014 07:08:59 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 07:08:59 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 07:08:59 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 07:08:59 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:08:59 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:09:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:09:01 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:09:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:09:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:09:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:09:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:09:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:09:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:09:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:09:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:09:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:09:05 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:09:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 07:09:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:09:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:09:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:09:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:09:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:09:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:09:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:09:07 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:09:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875968
Fri 17 Jan 2014 07:09:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:09:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875968
Fri 17 Jan 2014 07:09:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:09:15 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:09:15 - job_xml_thread(): Done retrieving: data size 43875968
Fri 17 Jan 2014 07:09:15 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:09:15 - XML: Start document: iteration 4
Fri 17 Jan 2014 07:09:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:09:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:09:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:09:21 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:09:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:09:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:09:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:09:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:09:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:09:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:09:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:09:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:09:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:09:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:09:26 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:09:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:09:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:09:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:09:27 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:09:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:09:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:09:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:09:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:09:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:09:27 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:09:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 07:09:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 07:09:27 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:09:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5807 values 91569 bits 11446 bytes 
Fri 17 Jan 2014 07:09:30 - XML: Processed 655448 elements - found 625 jobs
Fri 17 Jan 2014 07:09:30 - job 7347518 report time 1389938746 does not match current heartbeat 1389938867 : ignoring job
Fri 17 Jan 2014 07:09:30 - job 7347520 report time 1389938798 does not match current heartbeat 1389938867 : ignoring job
Fri 17 Jan 2014 07:09:30 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 07:09:30 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 07:09:30 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:09:30 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:09:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:09:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43844598
Fri 17 Jan 2014 07:09:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:09:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43844598
Fri 17 Jan 2014 07:09:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:09:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:09:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:09:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:09:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:09:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:09:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:09:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:09:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:09:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:09:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:09:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:09:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:09:44 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:09:45 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:09:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:09:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:09:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:09:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:09:47 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:09:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 07:09:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:09:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:09:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:09:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:09:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:09:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:09:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865100
Fri 17 Jan 2014 07:09:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:09:49 - job_xml_thread(): Done retrieving: data size 43865100
Fri 17 Jan 2014 07:09:49 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:09:49 - XML: Start document: iteration 5
Fri 17 Jan 2014 07:09:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43865100
Fri 17 Jan 2014 07:09:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:09:51 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 07:09:51 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:09:53 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:09:53 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:09:53 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 07:09:53 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 07:09:53 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 07:10:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:10:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:10:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:10:01 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:10:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:10:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:10:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:10:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:10:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:10:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:10:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:10:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:10:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:10:10 - size of cluster 'LISA Cluster': 624 hosts 79472 metrics 848058 values 13380181 bits 1672522 bytes 
Fri 17 Jan 2014 07:10:11 - XML: Processed 655452 elements - found 627 jobs
Fri 17 Jan 2014 07:10:11 - job 7347518 report time 1389938746 does not match current heartbeat 1389938919 : ignoring job
Fri 17 Jan 2014 07:10:11 - job 7347521 report time 1389938867 does not match current heartbeat 1389938919 : ignoring job
Fri 17 Jan 2014 07:10:11 - job 7347520 report time 1389938798 does not match current heartbeat 1389938919 : ignoring job
Fri 17 Jan 2014 07:10:11 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 07:10:11 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 07:10:12 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 07:10:12 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:10:12 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:10:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:10:12 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:10:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:10:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:10:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:10:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:10:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:10:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:10:15 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:10:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43826801
Fri 17 Jan 2014 07:10:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:10:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43826801
Fri 17 Jan 2014 07:10:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:10:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:10:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:10:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:10:27 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:10:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:10:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:10:27 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:10:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:10:27 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:10:27 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:10:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:10:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:10:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:10:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:10:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:10:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 07:10:28 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:10:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 07:10:28 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:10:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9230 values 145570 bits 18196 bytes 
Fri 17 Jan 2014 07:10:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:10:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:10:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:10:32 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:10:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:10:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:10:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:10:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:10:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:10:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:10:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:10:35 - job_xml_thread(): Done retrieving: data size 43853932
Fri 17 Jan 2014 07:10:35 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:10:35 - XML: Start document: iteration 6
Fri 17 Jan 2014 07:10:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853932
Fri 17 Jan 2014 07:10:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:10:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853932
Fri 17 Jan 2014 07:10:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:10:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:10:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:10:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:10:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:10:53 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:10:53 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 07:10:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:10:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:10:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:10:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:10:56 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:10:56 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:10:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:10:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:10:56 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:10:56 - XML: Processed 655450 elements - found 626 jobs
Fri 17 Jan 2014 07:10:56 - job 7347242 appears to have finished
Fri 17 Jan 2014 07:10:56 - job 7347523 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 07:10:56 - job 7347522 report time 1389938919 does not match current heartbeat 1389938988 : ignoring job
Fri 17 Jan 2014 07:10:56 - job 7347521 report time 1389938867 does not match current heartbeat 1389938988 : ignoring job
Fri 17 Jan 2014 07:10:56 - job 7347520 report time 1389938798 does not match current heartbeat 1389938988 : ignoring job
Fri 17 Jan 2014 07:10:56 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 07:10:56 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 07:10:56 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 07:10:56 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:10:56 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:10:58 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:10:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 07:10:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:11:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:11:01 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:11:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:11:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:11:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:11:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:11:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:11:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:11:04 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:11:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856025
Fri 17 Jan 2014 07:11:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:11:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43856025
Fri 17 Jan 2014 07:11:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:11:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:11:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:11:12 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:11:12 - job_xml_thread(): Done retrieving: data size 43856025
Fri 17 Jan 2014 07:11:12 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:11:12 - XML: Start document: iteration 7
Fri 17 Jan 2014 07:11:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:11:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:11:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:11:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:11:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:11:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:11:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:11:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:11:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:11:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:11:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:11:28 - XML: Processed 655450 elements - found 626 jobs
Fri 17 Jan 2014 07:11:28 - job 7347522 report time 1389938919 does not match current heartbeat 1389938988 : ignoring job
Fri 17 Jan 2014 07:11:28 - job 7347521 report time 1389938867 does not match current heartbeat 1389938988 : ignoring job
Fri 17 Jan 2014 07:11:28 - job 7347520 report time 1389938798 does not match current heartbeat 1389938988 : ignoring job
Fri 17 Jan 2014 07:11:28 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 07:11:28 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 07:11:28 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:11:28 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:11:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:11:28 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:11:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:11:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:11:28 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:11:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:11:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 07:11:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 07:11:28 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:11:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5679 values 89503 bits 11187 bytes 
Fri 17 Jan 2014 07:11:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:11:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:11:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:11:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:11:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:11:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:11:31 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:11:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43762317
Fri 17 Jan 2014 07:11:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:11:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43762317
Fri 17 Jan 2014 07:11:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:11:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:11:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:11:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:11:41 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:11:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:11:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:11:42 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:11:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:11:42 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:11:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:11:42 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:11:43 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:11:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:11:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:11:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:11:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:11:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:11:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:11:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:11:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:11:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:11:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:11:48 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:11:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 07:11:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:11:50 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:11:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43238343
Fri 17 Jan 2014 07:11:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:11:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43238343
Fri 17 Jan 2014 07:11:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:11:51 - job_xml_thread(): Done retrieving: data size 43238343
Fri 17 Jan 2014 07:11:51 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:11:51 - XML: Start document: iteration 8
Fri 17 Jan 2014 07:11:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:11:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:12:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:12:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:12:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:12:06 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:12:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:12:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:12:06 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:12:06 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:12:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:12:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:12:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:12:11 - XML: Processed 647780 elements - found 627 jobs
Fri 17 Jan 2014 07:12:11 - job 7347522 report time 1389938919 does not match current heartbeat 1389939039 : ignoring job
Fri 17 Jan 2014 07:12:11 - job 7347521 report time 1389938867 does not match current heartbeat 1389939039 : ignoring job
Fri 17 Jan 2014 07:12:11 - job 7347524 report time 1389938988 does not match current heartbeat 1389939039 : ignoring job
Fri 17 Jan 2014 07:12:11 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 07:12:11 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 07:12:11 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 07:12:11 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:12:11 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:12:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:12:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:12:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:12:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:12:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:12:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:12:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:12:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:12:16 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:12:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43246049
Fri 17 Jan 2014 07:12:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:12:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43246049
Fri 17 Jan 2014 07:12:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:12:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:12:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:12:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:12:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:12:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:12:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:12:25 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:12:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:12:25 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:12:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:12:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43246049
Fri 17 Jan 2014 07:12:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:12:26 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:12:26 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:12:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:12:28 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:12:28 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:12:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 07:12:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:12:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 07:12:28 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:12:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:12:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:12:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8517 values 134321 bits 16790 bytes 
Fri 17 Jan 2014 07:12:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:12:35 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:12:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:12:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:12:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:12:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:12:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:12:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:12:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:12:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:12:40 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:12:40 - job_xml_thread(): Done retrieving: data size 43382804
Fri 17 Jan 2014 07:12:40 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:12:40 - XML: Start document: iteration 9
Fri 17 Jan 2014 07:12:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:12:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:12:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43382804
Fri 17 Jan 2014 07:12:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:12:42 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:12:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:12:42 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:12:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:12:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43382804
Fri 17 Jan 2014 07:12:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:12:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:12:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:12:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:12:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:12:59 - XML: Processed 649692 elements - found 625 jobs
Fri 17 Jan 2014 07:13:00 - job 7347388 appears to have finished
Fri 17 Jan 2014 07:13:00 - job 7347522 report time 1389938919 does not match current heartbeat 1389939108 : ignoring job
Fri 17 Jan 2014 07:13:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:13:00 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:13:00 - job 7347526 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 07:13:00 - job 7347525 report time 1389939039 does not match current heartbeat 1389939108 : ignoring job
Fri 17 Jan 2014 07:13:00 - job 7347524 report time 1389938988 does not match current heartbeat 1389939108 : ignoring job
Fri 17 Jan 2014 07:13:00 - job 7341346 appears to have finished
Fri 17 Jan 2014 07:13:00 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 07:13:00 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 07:13:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:13:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:13:01 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:13:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:13:01 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:13:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:13:01 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:13:02 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 07:13:03 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:13:03 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:13:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:13:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:13:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:13:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:13:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:13:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:13:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:13:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:13:04 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:13:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 07:13:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:13:08 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:13:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43863124
Fri 17 Jan 2014 07:13:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:13:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43863124
Fri 17 Jan 2014 07:13:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:13:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:13:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:13:18 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:13:18 - job_xml_thread(): Done retrieving: data size 43863124
Fri 17 Jan 2014 07:13:18 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:13:18 - XML: Start document: iteration 10
Fri 17 Jan 2014 07:13:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:13:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:13:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:13:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:13:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:13:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:13:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:13:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:13:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:13:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:13:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:13:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:13:28 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:13:29 - XML: Processed 655444 elements - found 624 jobs
Fri 17 Jan 2014 07:13:29 - job 7347525 report time 1389939039 does not match current heartbeat 1389939108 : ignoring job
Fri 17 Jan 2014 07:13:29 - job 7347524 report time 1389938988 does not match current heartbeat 1389939108 : ignoring job
Fri 17 Jan 2014 07:13:29 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 07:13:29 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 07:13:29 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:13:29 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:13:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:13:29 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:13:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 07:13:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 07:13:29 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:13:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5679 values 89520 bits 11190 bytes 
Fri 17 Jan 2014 07:13:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:13:31 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:13:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:13:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:13:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:13:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:13:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:13:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:13:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:13:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:13:35 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:13:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 07:13:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:13:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:13:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43823128
Fri 17 Jan 2014 07:13:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:13:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43823128
Fri 17 Jan 2014 07:13:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:13:44 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:13:44 - job_xml_thread(): Done retrieving: data size 43823128
Fri 17 Jan 2014 07:13:44 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:13:44 - XML: Start document: iteration 11
Fri 17 Jan 2014 07:13:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:13:45 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:13:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:13:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:13:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:13:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:13:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:13:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:13:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:13:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:13:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:13:55 - XML: Processed 655444 elements - found 624 jobs
Fri 17 Jan 2014 07:13:55 - job 7347525 report time 1389939039 does not match current heartbeat 1389939160 : ignoring job
Fri 17 Jan 2014 07:13:55 - job 7347524 report time 1389938988 does not match current heartbeat 1389939160 : ignoring job
Fri 17 Jan 2014 07:13:55 - job 7335195 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 07:13:55 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 07:13:55 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 07:13:55 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 07:13:55 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:13:55 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:13:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:13:57 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:13:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:13:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:13:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:13:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:13:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:13:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:13:57 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 07:13:57 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 07:13:57 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:13:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:13:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43829826
Fri 17 Jan 2014 07:13:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:13:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43829826
Fri 17 Jan 2014 07:13:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:14:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:14:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:14:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:14:07 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:14:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:14:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:14:08 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:14:08 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:14:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:14:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:14:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43829826
Fri 17 Jan 2014 07:14:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:14:10 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:14:10 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:14:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:14:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:14:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:14:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:14:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:14:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:14:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:14:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:14:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:14:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:14:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:14:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:14:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:14:20 - job_xml_thread(): Done retrieving: data size 43852378
Fri 17 Jan 2014 07:14:20 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:14:20 - XML: Start document: iteration 12
Fri 17 Jan 2014 07:14:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43852378
Fri 17 Jan 2014 07:14:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:14:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:14:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:14:26 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:14:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:14:26 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:14:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43852378
Fri 17 Jan 2014 07:14:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:14:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:14:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:14:30 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:14:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:14:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 07:14:32 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:14:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148559 bits 18569 bytes 
Fri 17 Jan 2014 07:14:32 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:14:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 07:14:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:14:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:14:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:14:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:14:39 - XML: Processed 655442 elements - found 623 jobs
Fri 17 Jan 2014 07:14:39 - job 7347525 report time 1389939039 does not match current heartbeat 1389939160 : ignoring job
Fri 17 Jan 2014 07:14:39 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 07:14:39 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 07:14:39 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:14:39 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:14:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:14:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:14:42 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:14:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:14:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:14:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:14:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:14:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:14:43 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:14:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:14:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:14:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:14:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:14:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:14:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:14:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:14:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43874099
Fri 17 Jan 2014 07:14:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:14:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43874099
Fri 17 Jan 2014 07:14:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:14:54 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:14:55 - job_xml_thread(): Done retrieving: data size 43874099
Fri 17 Jan 2014 07:14:55 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:14:55 - XML: Start document: iteration 13
Fri 17 Jan 2014 07:14:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:14:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:14:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:14:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:15:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:15:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:15:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:15:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:15:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:15:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:15:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:15:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:15:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:15:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:15:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:15:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:15:05 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:15:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:15:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:15:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:15:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:15:07 - XML: Processed 655444 elements - found 624 jobs
Fri 17 Jan 2014 07:15:07 - job 7347525 report time 1389939039 does not match current heartbeat 1389939229 : ignoring job
Fri 17 Jan 2014 07:15:07 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 07:15:07 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 07:15:07 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 07:15:07 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:15:07 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:15:07 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:15:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 07:15:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:15:09 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:15:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43871052
Fri 17 Jan 2014 07:15:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:15:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43871052
Fri 17 Jan 2014 07:15:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:15:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:15:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:15:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:15:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:15:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:15:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:15:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:15:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:15:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:15:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:15:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:15:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:15:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:15:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:15:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:15:22 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:15:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:15:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:15:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:15:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:15:24 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:15:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43877962
Fri 17 Jan 2014 07:15:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:15:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43877962
Fri 17 Jan 2014 07:15:24 - job_xml_thread(): Done retrieving: data size 43877962
Fri 17 Jan 2014 07:15:24 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:15:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:15:24 - XML: Start document: iteration 14
Fri 17 Jan 2014 07:15:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:15:32 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:15:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:15:33 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:15:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 07:15:33 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:15:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 07:15:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8942 values 141011 bits 17626 bytes 
Fri 17 Jan 2014 07:15:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:15:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:15:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:15:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:15:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:15:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:15:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:15:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:15:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:15:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:15:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:15:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:15:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:15:43 - XML: Processed 655442 elements - found 623 jobs
Fri 17 Jan 2014 07:15:43 - job 7347529 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 07:15:43 - job 7347357 appears to have finished
Fri 17 Jan 2014 07:15:43 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 07:15:43 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 07:15:44 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 07:15:44 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:15:44 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:15:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:15:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:15:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:15:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:15:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:15:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:15:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:15:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:15:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:15:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855816
Fri 17 Jan 2014 07:15:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:15:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855816
Fri 17 Jan 2014 07:15:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:15:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:15:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:15:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:15:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:15:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:15:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:15:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:15:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:15:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855816
Fri 17 Jan 2014 07:15:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:15:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:15:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:15:59 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:15:59 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:16:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:16:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:16:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:16:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:16:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:16:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:16:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:16:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:16:10 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:16:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 07:16:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:16:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:16:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:16:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:16:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:16:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:16:11 - job_xml_thread(): Done retrieving: data size 43840409
Fri 17 Jan 2014 07:16:11 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:16:11 - XML: Start document: iteration 15
Fri 17 Jan 2014 07:16:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43840409
Fri 17 Jan 2014 07:16:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:16:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:16:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:16:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:16:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:16:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:16:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:16:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43840409
Fri 17 Jan 2014 07:16:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:16:25 - XML: Processed 655442 elements - found 623 jobs
Fri 17 Jan 2014 07:16:25 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 07:16:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:16:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:16:26 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 07:16:26 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:16:26 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:16:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:16:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:16:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:16:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:16:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:16:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:16:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:16:34 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:16:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:16:34 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:16:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:16:34 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:16:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 07:16:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:16:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 07:16:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:16:34 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:16:34 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:16:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:16:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:16:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5827 values 92041 bits 11505 bytes 
Fri 17 Jan 2014 07:16:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:16:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:16:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:16:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:16:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:16:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:16:37 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:16:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43886350
Fri 17 Jan 2014 07:16:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:16:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43886350
Fri 17 Jan 2014 07:16:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:16:41 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:16:41 - job_xml_thread(): Done retrieving: data size 43886350
Fri 17 Jan 2014 07:16:41 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:16:41 - XML: Start document: iteration 16
Fri 17 Jan 2014 07:16:48 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:16:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 07:16:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:16:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:16:48 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:16:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:16:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:16:50 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:16:50 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:16:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:16:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:16:50 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:16:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:16:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:16:54 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 07:16:54 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:16:54 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:16:54 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 07:16:54 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 07:16:54 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:16:54 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 07:16:55 - XML: Processed 655442 elements - found 623 jobs
Fri 17 Jan 2014 07:16:55 - job 7347530 field 'start_timestamp' changed since saved from: 1389939308 to: 1389939261
Fri 17 Jan 2014 07:16:55 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 07:16:55 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 07:16:55 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 07:16:55 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:16:55 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:16:56 - size of cluster 'LISA Cluster': 624 hosts 79470 metrics 773141 values 12199877 bits 1524984 bytes 
Fri 17 Jan 2014 07:17:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:17:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:17:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:17:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:17:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:17:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:17:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:17:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:17:03 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:17:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43844384
Fri 17 Jan 2014 07:17:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:17:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43844384
Fri 17 Jan 2014 07:17:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:17:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:17:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:17:10 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:17:11 - job_xml_thread(): Done retrieving: data size 43844384
Fri 17 Jan 2014 07:17:11 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:17:11 - XML: Start document: iteration 17
Fri 17 Jan 2014 07:17:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:17:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:17:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:17:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:17:14 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:17:14 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:17:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:17:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:17:14 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:17:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:17:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:17:25 - XML: Processed 655441 elements - found 623 jobs
Fri 17 Jan 2014 07:17:25 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 07:17:26 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 07:17:26 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:17:26 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:17:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:17:27 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:17:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:17:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:17:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:17:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:17:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:17:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:17:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:17:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:17:30 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:17:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43760802
Fri 17 Jan 2014 07:17:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:17:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43760802
Fri 17 Jan 2014 07:17:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:17:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:17:34 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:17:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:17:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 07:17:36 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:17:36 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:17:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 07:17:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9241 values 146091 bits 18261 bytes 
Fri 17 Jan 2014 07:17:41 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:17:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:17:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:17:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:17:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:17:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:17:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:17:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:17:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:17:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:17:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:17:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:17:45 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:17:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:17:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:17:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:17:45 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:17:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:17:45 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:17:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:17:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:17:49 - job_xml_thread(): Done retrieving: data size 43261965
Fri 17 Jan 2014 07:17:49 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:17:49 - XML: Start document: iteration 18
Fri 17 Jan 2014 07:17:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43261965
Fri 17 Jan 2014 07:17:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43261965
Fri 17 Jan 2014 07:17:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:17:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:17:55 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:17:55 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 07:18:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:18:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:18:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:18:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:18:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:18:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:18:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:18:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:18:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:18:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:18:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:18:05 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:18:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:18:10 - XML: Processed 648012 elements - found 622 jobs
Fri 17 Jan 2014 07:18:10 - job 7347262 appears to have finished
Fri 17 Jan 2014 07:18:10 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 07:18:10 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 07:18:10 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 07:18:10 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:18:10 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:18:11 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:18:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 07:18:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:18:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:18:12 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:18:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:18:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:18:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:18:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:18:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:18:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:18:14 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:18:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43242067
Fri 17 Jan 2014 07:18:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:18:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43242067
Fri 17 Jan 2014 07:18:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:18:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:18:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:18:25 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:18:25 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:18:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:18:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:18:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:18:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:18:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:18:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:18:27 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:18:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:18:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:18:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:18:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:18:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:18:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:18:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:18:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:18:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:18:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:18:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:18:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:18:32 - job_xml_thread(): Done retrieving: data size 43331911
Fri 17 Jan 2014 07:18:32 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:18:32 - XML: Start document: iteration 19
Fri 17 Jan 2014 07:18:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43331911
Fri 17 Jan 2014 07:18:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:18:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43331911
Fri 17 Jan 2014 07:18:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:18:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:18:36 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:18:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:18:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 07:18:37 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:18:37 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:18:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 07:18:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8933 values 141202 bits 17650 bytes 
Fri 17 Jan 2014 07:18:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:18:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:18:44 - XML: Processed 648738 elements - found 621 jobs
Fri 17 Jan 2014 07:18:44 - job 7347362 appears to have finished
Fri 17 Jan 2014 07:18:44 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 07:18:44 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 07:18:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:18:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:18:46 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 07:18:46 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:18:46 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:18:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:18:50 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:18:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:18:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:18:51 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:18:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:18:51 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:18:51 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:18:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:18:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:18:53 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:18:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:18:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:18:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:18:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:18:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:18:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:18:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:18:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43846957
Fri 17 Jan 2014 07:18:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:18:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43846957
Fri 17 Jan 2014 07:18:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:19:01 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:19:01 - job_xml_thread(): Done retrieving: data size 43846957
Fri 17 Jan 2014 07:19:01 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:19:01 - XML: Start document: iteration 20
Fri 17 Jan 2014 07:19:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:19:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:19:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:19:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:19:18 - XML: Processed 655242 elements - found 621 jobs
Fri 17 Jan 2014 07:19:18 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 07:19:18 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 07:19:18 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:19:18 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:19:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:19:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:19:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:19:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:19:20 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:19:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:19:20 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:19:20 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:19:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:19:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:19:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:19:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:19:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:19:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:19:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:19:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:19:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:19:22 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:19:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 07:19:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:19:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:19:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43866208
Fri 17 Jan 2014 07:19:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:19:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43866208
Fri 17 Jan 2014 07:19:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:19:34 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:19:34 - job_xml_thread(): Done retrieving: data size 43866208
Fri 17 Jan 2014 07:19:34 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:19:34 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 07:19:35 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 07:19:35 - Housekeeping: done.
Fri 17 Jan 2014 07:19:35 - XML: Start document: iteration 0
Fri 17 Jan 2014 07:19:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:19:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:19:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:19:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:19:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:19:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:19:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:19:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:19:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:19:38 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:19:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:19:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:19:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:19:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:19:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:19:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:19:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 07:19:40 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:19:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 07:19:40 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:19:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5794 values 91431 bits 11428 bytes 
Fri 17 Jan 2014 07:19:44 - XML: Processed 655440 elements - found 621 jobs
Fri 17 Jan 2014 07:19:44 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 07:19:44 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 07:19:45 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:19:45 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:19:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:19:49 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:19:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:19:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:19:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:19:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:19:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:19:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:19:53 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:19:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43836913
Fri 17 Jan 2014 07:19:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:19:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43836913
Fri 17 Jan 2014 07:19:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:19:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:19:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:20:00 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:20:00 - job_xml_thread(): Done retrieving: data size 43836913
Fri 17 Jan 2014 07:20:00 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:20:00 - XML: Start document: iteration 1
Fri 17 Jan 2014 07:20:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:20:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:20:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:20:09 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:20:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:20:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:20:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:20:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:20:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:20:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:20:10 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:20:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:20:13 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:20:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:20:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:20:14 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:20:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 07:20:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:20:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:20:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:20:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:20:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:20:16 - XML: Processed 655440 elements - found 621 jobs
Fri 17 Jan 2014 07:20:16 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 07:20:16 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 07:20:16 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:20:16 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:20:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:20:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43845958
Fri 17 Jan 2014 07:20:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:20:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43845958
Fri 17 Jan 2014 07:20:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:20:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:20:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:20:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:20:28 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:20:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:20:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:20:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:20:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:20:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:20:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43845958
Fri 17 Jan 2014 07:20:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:20:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:20:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:20:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:20:31 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:20:31 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:20:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:20:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:20:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:20:40 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:20:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:20:40 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:20:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 07:20:40 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:20:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6084 values 96012 bits 12001 bytes 
Fri 17 Jan 2014 07:20:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 07:20:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:20:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:20:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:20:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:20:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:20:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:20:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:20:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:20:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:20:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:20:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:20:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:20:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:20:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:20:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:20:45 - job_xml_thread(): Done retrieving: data size 43825081
Fri 17 Jan 2014 07:20:45 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:20:45 - XML: Start document: iteration 2
Fri 17 Jan 2014 07:20:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43825081
Fri 17 Jan 2014 07:20:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:20:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43825081
Fri 17 Jan 2014 07:20:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:20:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:20:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:20:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:20:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:20:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:20:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:20:59 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:20:59 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:20:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:20:59 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:20:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:21:05 - XML: Processed 655442 elements - found 622 jobs
Fri 17 Jan 2014 07:21:05 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 07:21:05 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 07:21:06 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 07:21:06 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:21:06 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:21:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:21:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:21:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:21:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:21:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:21:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:21:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:21:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:21:08 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:21:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 07:21:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:21:09 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 07:21:09 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 07:21:09 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:21:10 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:21:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862205
Fri 17 Jan 2014 07:21:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:21:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862205
Fri 17 Jan 2014 07:21:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:21:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:21:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:21:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:21:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:21:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:21:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:21:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:21:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:21:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:21:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:21:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:21:21 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:21:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:21:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:21:23 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:21:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:21:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:21:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:21:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:21:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:21:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:21:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:21:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:21:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43879120
Fri 17 Jan 2014 07:21:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:21:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43879120
Fri 17 Jan 2014 07:21:25 - job_xml_thread(): Done retrieving: data size 43879120
Fri 17 Jan 2014 07:21:25 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:21:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:21:25 - XML: Start document: iteration 3
Fri 17 Jan 2014 07:21:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:21:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:21:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:21:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:21:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:21:41 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:21:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:21:42 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:21:42 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:21:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:21:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 07:21:42 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:21:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 07:21:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:21:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:21:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8809 values 138923 bits 17365 bytes 
Fri 17 Jan 2014 07:21:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:21:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:21:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:21:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:21:43 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:21:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:21:48 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:21:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:21:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:21:49 - XML: Processed 655442 elements - found 622 jobs
Fri 17 Jan 2014 07:21:49 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 07:21:49 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 07:21:49 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:21:49 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:21:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:21:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:21:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:21:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:21:51 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:21:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43857596
Fri 17 Jan 2014 07:21:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:21:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43857596
Fri 17 Jan 2014 07:21:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:21:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:21:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:21:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:21:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:21:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:21:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:22:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:22:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:22:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:22:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:22:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43857596
Fri 17 Jan 2014 07:22:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:22:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:22:04 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:22:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:22:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:22:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:22:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:22:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:22:12 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:22:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:22:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:22:13 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:22:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 07:22:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:22:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:22:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:22:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:22:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:22:14 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:22:14 - job_xml_thread(): Done retrieving: data size 43828186
Fri 17 Jan 2014 07:22:14 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:22:14 - XML: Start document: iteration 4
Fri 17 Jan 2014 07:22:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43828186
Fri 17 Jan 2014 07:22:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:22:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:22:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:22:17 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:22:17 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:22:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:22:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:22:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43828186
Fri 17 Jan 2014 07:22:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:22:27 - XML: Processed 655442 elements - found 622 jobs
Fri 17 Jan 2014 07:22:27 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 07:22:27 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 07:22:27 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:22:27 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:22:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:22:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:22:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:22:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:22:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:22:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:22:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:22:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:22:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:22:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:22:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:22:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:22:35 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:22:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:22:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:22:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:22:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:22:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:22:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:22:37 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:22:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43874707
Fri 17 Jan 2014 07:22:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:22:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43874707
Fri 17 Jan 2014 07:22:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:22:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:22:42 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:22:43 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:22:43 - job_xml_thread(): Done retrieving: data size 43874707
Fri 17 Jan 2014 07:22:43 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:22:43 - XML: Start document: iteration 5
Fri 17 Jan 2014 07:22:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:22:44 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:22:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 07:22:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 07:22:44 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:22:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9039 values 142617 bits 17827 bytes 
Fri 17 Jan 2014 07:22:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:22:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:22:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:22:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:22:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:22:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:22:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:22:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:22:53 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:22:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:22:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:22:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:22:53 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:22:56 - XML: Processed 655446 elements - found 624 jobs
Fri 17 Jan 2014 07:22:56 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 07:22:56 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 07:22:56 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 07:22:56 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:22:56 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:23:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:23:01 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:23:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:23:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:23:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:23:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:23:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:23:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:23:03 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:23:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43842435
Fri 17 Jan 2014 07:23:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:23:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43842435
Fri 17 Jan 2014 07:23:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:23:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:23:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:23:11 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:23:11 - job_xml_thread(): Done retrieving: data size 43842435
Fri 17 Jan 2014 07:23:11 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:23:11 - XML: Start document: iteration 6
Fri 17 Jan 2014 07:23:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:23:14 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:23:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:23:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:23:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:23:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:23:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:23:15 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:23:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:23:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:23:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:23:21 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:23:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 07:23:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:23:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:23:26 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:23:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:23:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:23:27 - XML: Processed 655446 elements - found 624 jobs
Fri 17 Jan 2014 07:23:27 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 07:23:27 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 07:23:27 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:23:27 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:23:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:23:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:23:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:23:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:23:28 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:23:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43775810
Fri 17 Jan 2014 07:23:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:23:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43775810
Fri 17 Jan 2014 07:23:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:23:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:23:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:23:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:23:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:23:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:23:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:23:39 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:23:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:23:39 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:23:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:23:39 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:23:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:23:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:23:42 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:23:42 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:23:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43262996
Fri 17 Jan 2014 07:23:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:23:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:23:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:23:43 - job_xml_thread(): Done retrieving: data size 43262996
Fri 17 Jan 2014 07:23:43 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:23:43 - XML: Start document: iteration 7
Fri 17 Jan 2014 07:23:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:23:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:23:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:23:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:23:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43262996
Fri 17 Jan 2014 07:23:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:23:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:23:44 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:23:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:23:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 07:23:45 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:23:45 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:23:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 07:23:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8854 values 139670 bits 17458 bytes 
Fri 17 Jan 2014 07:23:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:23:54 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:23:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:23:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:23:54 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:23:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:23:54 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:23:54 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:23:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:23:55 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 07:23:55 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:23:56 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:23:56 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:23:56 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 07:23:56 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 07:23:56 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 07:23:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:23:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:23:58 - XML: Processed 647918 elements - found 623 jobs
Fri 17 Jan 2014 07:23:58 - job 7347530 appears to have finished
Fri 17 Jan 2014 07:23:58 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 07:23:58 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 07:23:59 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 07:23:59 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:23:59 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:24:03 - size of cluster 'LISA Cluster': 624 hosts 79478 metrics 781913 values 12337093 bits 1542136 bytes 
Fri 17 Jan 2014 07:24:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:24:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:24:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:24:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:24:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:24:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:24:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:24:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:24:08 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:24:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43173231
Fri 17 Jan 2014 07:24:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:24:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43173231
Fri 17 Jan 2014 07:24:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:24:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:24:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:24:14 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:24:14 - job_xml_thread(): Done retrieving: data size 43173231
Fri 17 Jan 2014 07:24:14 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:24:14 - XML: Start document: iteration 8
Fri 17 Jan 2014 07:24:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:24:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:24:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:24:21 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:24:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:24:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:24:23 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:24:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:24:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:24:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:24:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:24:28 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:24:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 07:24:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:24:30 - XML: Processed 647244 elements - found 623 jobs
Fri 17 Jan 2014 07:24:30 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 07:24:30 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 07:24:30 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:24:30 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:24:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:24:33 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:24:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:24:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:24:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:24:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:24:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:24:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:24:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:24:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565365
Fri 17 Jan 2014 07:24:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:24:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565365
Fri 17 Jan 2014 07:24:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:24:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:24:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:24:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:24:45 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:24:45 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:24:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:24:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:24:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:24:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:24:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 07:24:47 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:24:47 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:24:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 07:24:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5835 values 92022 bits 11502 bytes 
Fri 17 Jan 2014 07:24:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:24:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:24:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:24:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:24:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:24:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:24:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:24:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:24:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:24:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:24:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:24:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:24:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:24:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:24:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:24:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:24:54 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:24:54 - job_xml_thread(): Done retrieving: data size 43792725
Fri 17 Jan 2014 07:24:54 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:24:54 - XML: Start document: iteration 9
Fri 17 Jan 2014 07:24:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43792725
Fri 17 Jan 2014 07:24:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:24:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43792725
Fri 17 Jan 2014 07:24:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:24:56 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:24:57 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 07:25:01 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:25:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 07:25:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:25:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:25:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:25:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:25:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:25:14 - XML: Processed 654574 elements - found 623 jobs
Fri 17 Jan 2014 07:25:14 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 07:25:14 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 07:25:14 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:25:14 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:25:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:25:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:25:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:25:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:25:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:25:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:25:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:25:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:25:15 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:25:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:25:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:25:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:25:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:25:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:25:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:25:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:25:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:25:21 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:25:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43863441
Fri 17 Jan 2014 07:25:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:25:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43863441
Fri 17 Jan 2014 07:25:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:25:29 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:25:29 - job_xml_thread(): Done retrieving: data size 43863441
Fri 17 Jan 2014 07:25:29 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:25:29 - XML: Start document: iteration 10
Fri 17 Jan 2014 07:25:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:25:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:25:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:25:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:25:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:25:34 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:25:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:25:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:25:35 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:25:35 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:25:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:25:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:25:35 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:25:39 - XML: Processed 655444 elements - found 623 jobs
Fri 17 Jan 2014 07:25:39 - job 7344471 appears to have finished
Fri 17 Jan 2014 07:25:39 - job 7347404 appears to have finished
Fri 17 Jan 2014 07:25:39 - job 7347442 appears to have finished
Fri 17 Jan 2014 07:25:39 - job_xml_thread(): Found 6 updated jobs.
Fri 17 Jan 2014 07:25:39 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 07:25:40 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Fri 17 Jan 2014 07:25:40 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:25:40 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:25:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:25:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:25:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:25:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:25:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:25:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:25:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:25:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:25:46 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:25:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43823746
Fri 17 Jan 2014 07:25:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:25:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:25:47 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:25:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43823746
Fri 17 Jan 2014 07:25:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:25:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:25:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 07:25:47 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:25:47 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:25:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 07:25:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9380 values 148004 bits 18500 bytes 
Fri 17 Jan 2014 07:25:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:25:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:25:55 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:25:55 - job_xml_thread(): Done retrieving: data size 43823746
Fri 17 Jan 2014 07:25:55 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:25:55 - XML: Start document: iteration 11
Fri 17 Jan 2014 07:25:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:25:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:26:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:26:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:26:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:26:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:26:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:26:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:26:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:26:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:26:05 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:26:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:26:08 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:26:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:26:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:26:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:26:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:26:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:26:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:26:11 - XML: Processed 655444 elements - found 623 jobs
Fri 17 Jan 2014 07:26:11 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 07:26:11 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 07:26:11 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:26:11 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:26:14 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:26:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 07:26:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:26:15 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:26:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43842005
Fri 17 Jan 2014 07:26:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:26:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43842005
Fri 17 Jan 2014 07:26:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:26:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:26:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:26:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:26:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:26:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:26:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:26:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:26:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:26:26 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:26:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:26:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:26:27 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:26:27 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:26:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:26:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:26:30 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:26:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:26:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:26:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:26:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:26:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:26:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:26:33 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:26:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43854784
Fri 17 Jan 2014 07:26:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:26:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43854784
Fri 17 Jan 2014 07:26:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:26:34 - job_xml_thread(): Done retrieving: data size 43854784
Fri 17 Jan 2014 07:26:34 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:26:34 - XML: Start document: iteration 12
Fri 17 Jan 2014 07:26:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:26:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:26:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:26:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:26:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:26:47 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:26:48 - XML: Processed 655444 elements - found 623 jobs
Fri 17 Jan 2014 07:26:48 - job 7347535 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 07:26:48 - job 7347536 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 07:26:48 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 07:26:48 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 07:26:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:26:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 07:26:48 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:26:48 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:26:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 07:26:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99049 bits 12381 bytes 
Fri 17 Jan 2014 07:26:49 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 07:26:49 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:26:49 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:26:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:26:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:26:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:26:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:26:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:26:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:26:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:26:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:26:56 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:26:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:26:56 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:26:56 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:26:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:26:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:26:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:26:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:26:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:26:59 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:26:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 07:26:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:27:00 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:27:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43859540
Fri 17 Jan 2014 07:27:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:27:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43859540
Fri 17 Jan 2014 07:27:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:27:04 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:27:04 - job_xml_thread(): Done retrieving: data size 43859540
Fri 17 Jan 2014 07:27:04 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:27:04 - XML: Start document: iteration 13
Fri 17 Jan 2014 07:27:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:27:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:27:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:27:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:27:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:27:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:27:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:27:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:27:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:27:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:27:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:27:15 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:27:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:27:18 - XML: Processed 655444 elements - found 623 jobs
Fri 17 Jan 2014 07:27:18 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 07:27:18 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 07:27:18 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:27:18 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:27:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:27:23 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:27:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:27:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:27:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:27:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:27:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:27:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:27:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:27:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43857591
Fri 17 Jan 2014 07:27:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:27:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43857591
Fri 17 Jan 2014 07:27:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:27:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:27:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:27:33 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:27:33 - job_xml_thread(): Done retrieving: data size 43857591
Fri 17 Jan 2014 07:27:33 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:27:33 - XML: Start document: iteration 14
Fri 17 Jan 2014 07:27:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:27:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:27:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:27:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:27:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:27:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:27:37 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:27:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:27:37 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:27:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:27:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:27:42 - XML: Processed 655444 elements - found 623 jobs
Fri 17 Jan 2014 07:27:42 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 07:27:42 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 07:27:42 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:27:42 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:27:44 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 07:27:44 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 07:27:44 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:27:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:27:46 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:27:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:27:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:27:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:27:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:27:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:27:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:27:48 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:27:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43835958
Fri 17 Jan 2014 07:27:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:27:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43835958
Fri 17 Jan 2014 07:27:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:27:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:27:50 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:27:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:27:51 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:27:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 07:27:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 07:27:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:27:52 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:27:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:27:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148605 bits 18575 bytes 
Fri 17 Jan 2014 07:27:57 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:27:57 - job_xml_thread(): Done retrieving: data size 43835958
Fri 17 Jan 2014 07:27:58 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:27:58 - XML: Start document: iteration 15
Fri 17 Jan 2014 07:28:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:28:00 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:28:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:28:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:28:01 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:28:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:28:01 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:28:01 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:28:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:28:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:28:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:28:06 - XML: Processed 655444 elements - found 623 jobs
Fri 17 Jan 2014 07:28:06 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 07:28:06 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 07:28:06 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:28:06 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:28:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:28:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:28:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:28:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:28:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:28:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:28:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:28:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:28:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:28:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43857620
Fri 17 Jan 2014 07:28:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:28:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43857620
Fri 17 Jan 2014 07:28:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:28:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:28:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:28:21 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:28:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:28:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:28:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:28:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:28:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:28:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:28:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:28:26 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:28:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:28:26 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:28:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:28:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:28:27 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:28:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:28:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:28:28 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:28:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 07:28:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:28:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:28:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:28:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:28:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:28:29 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:28:29 - job_xml_thread(): Done retrieving: data size 43851466
Fri 17 Jan 2014 07:28:29 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:28:29 - XML: Start document: iteration 16
Fri 17 Jan 2014 07:28:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851466
Fri 17 Jan 2014 07:28:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851466
Fri 17 Jan 2014 07:28:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:28:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:28:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:28:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:28:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:28:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:28:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:28:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:28:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:28:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:28:47 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:28:47 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:28:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:28:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:28:47 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:28:48 - XML: Processed 655438 elements - found 620 jobs
Fri 17 Jan 2014 07:28:48 - job 7347497 appears to have finished
Fri 17 Jan 2014 07:28:48 - job 7347430 appears to have finished
Fri 17 Jan 2014 07:28:48 - job 7347503 appears to have finished
Fri 17 Jan 2014 07:28:48 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 07:28:48 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 07:28:49 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 07:28:49 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:28:49 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:28:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:28:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:28:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:28:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:28:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:28:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:28:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:28:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:28:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:28:52 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:28:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:28:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865484
Fri 17 Jan 2014 07:28:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:28:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43865484
Fri 17 Jan 2014 07:28:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:28:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:28:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 07:28:52 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:28:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 07:28:52 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:28:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5743 values 90510 bits 11313 bytes 
Fri 17 Jan 2014 07:29:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:29:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:29:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:29:03 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:29:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:29:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:29:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:29:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:29:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:29:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:29:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:29:04 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:29:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:29:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:29:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:29:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:29:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:29:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:29:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:29:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:29:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:29:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:29:09 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:29:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43801203
Fri 17 Jan 2014 07:29:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:29:09 - job_xml_thread(): Done retrieving: data size 43801203
Fri 17 Jan 2014 07:29:09 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:29:09 - XML: Start document: iteration 17
Fri 17 Jan 2014 07:29:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43801203
Fri 17 Jan 2014 07:29:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:29:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:29:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:29:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:29:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:29:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:29:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:29:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:29:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:29:25 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:29:25 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:29:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:29:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:29:25 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:29:32 - XML: Processed 654714 elements - found 620 jobs
Fri 17 Jan 2014 07:29:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:29:33 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:29:33 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 07:29:33 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 07:29:33 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:29:33 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:29:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:29:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:29:33 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:29:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 07:29:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:29:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:29:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:29:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:29:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:29:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:29:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566817
Fri 17 Jan 2014 07:29:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:29:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566817
Fri 17 Jan 2014 07:29:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:29:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:29:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:29:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:29:45 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:29:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:29:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:29:47 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:29:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:29:47 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:29:47 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:29:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:29:48 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:29:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:29:48 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:29:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:29:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:29:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:29:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:29:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:29:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:29:50 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:29:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43234180
Fri 17 Jan 2014 07:29:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:29:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43234180
Fri 17 Jan 2014 07:29:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:29:51 - job_xml_thread(): Done retrieving: data size 43234180
Fri 17 Jan 2014 07:29:51 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:29:51 - XML: Start document: iteration 18
Fri 17 Jan 2014 07:29:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:29:53 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:29:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:29:53 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:29:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 07:29:53 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:29:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 07:29:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8793 values 138674 bits 17334 bytes 
Fri 17 Jan 2014 07:30:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:30:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:30:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:30:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:30:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:30:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:30:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:30:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:30:12 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:30:12 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:30:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:30:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:30:12 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:30:13 - XML: Processed 647590 elements - found 620 jobs
Fri 17 Jan 2014 07:30:13 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 07:30:13 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 07:30:13 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:30:13 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:30:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:30:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:30:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:30:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:30:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:30:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:30:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:30:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:30:16 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:30:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 07:30:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:30:16 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:30:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43247676
Fri 17 Jan 2014 07:30:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:30:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43247676
Fri 17 Jan 2014 07:30:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:30:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:30:27 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:30:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:30:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:30:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:30:27 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:30:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:30:27 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:30:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:30:28 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:30:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:30:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:30:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:30:30 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:30:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:30:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:30:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:30:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:30:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:30:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:30:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:30:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43653621
Fri 17 Jan 2014 07:30:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:30:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43653621
Fri 17 Jan 2014 07:30:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:30:33 - job_xml_thread(): Done retrieving: data size 43653621
Fri 17 Jan 2014 07:30:33 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:30:33 - XML: Start document: iteration 19
Fri 17 Jan 2014 07:30:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:30:42 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:30:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:30:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:30:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:30:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:30:44 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:30:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:30:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:30:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:30:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:30:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:30:53 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:30:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:30:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:30:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:30:53 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:30:54 - XML: Processed 653000 elements - found 621 jobs
Fri 17 Jan 2014 07:30:54 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 07:30:54 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 07:30:54 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 07:30:54 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:30:54 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:30:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:30:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:30:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:30:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:30:54 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:30:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:30:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 07:30:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 07:30:54 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:30:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99061 bits 12382 bytes 
Fri 17 Jan 2014 07:30:56 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:30:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43819950
Fri 17 Jan 2014 07:30:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:30:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43819950
Fri 17 Jan 2014 07:30:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:30:57 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 07:30:57 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:30:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:30:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:31:00 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:31:00 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:31:00 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 07:31:00 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 07:31:00 - Entering storeMetrics(): cluster LISA Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Fri 17 Jan 2014 07:31:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:31:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:31:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:31:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:31:08 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:31:08 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:31:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:31:08 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:31:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:31:09 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:31:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:31:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:31:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:31:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:31:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:31:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:31:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:31:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:31:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:31:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:31:11 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:31:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 07:31:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:31:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:31:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43868268
Fri 17 Jan 2014 07:31:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:31:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43868268
Fri 17 Jan 2014 07:31:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:31:13 - job_xml_thread(): Done retrieving: data size 43868268
Fri 17 Jan 2014 07:31:13 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:31:13 - XML: Start document: iteration 20
Fri 17 Jan 2014 07:31:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:31:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:31:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:31:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:31:27 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:31:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:31:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:31:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:31:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:31:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:31:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:31:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:31:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:31:31 - XML: Processed 655437 elements - found 621 jobs
Fri 17 Jan 2014 07:31:32 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 07:31:32 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 07:31:32 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:31:32 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:31:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:31:34 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:31:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:31:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:31:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:31:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:31:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:31:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:31:37 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:31:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43846236
Fri 17 Jan 2014 07:31:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:31:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43846236
Fri 17 Jan 2014 07:31:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:31:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:31:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:31:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:31:47 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:31:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:31:47 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:31:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:31:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:31:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:31:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:31:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:31:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:31:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:31:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:31:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:31:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:31:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:31:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:31:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:31:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:31:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:31:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:31:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:31:52 - job_xml_thread(): Done retrieving: data size 43872347
Fri 17 Jan 2014 07:31:52 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:31:52 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 07:31:52 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 07:31:52 - Housekeeping: done.
Fri 17 Jan 2014 07:31:52 - XML: Start document: iteration 0
Fri 17 Jan 2014 07:31:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43872347
Fri 17 Jan 2014 07:31:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:31:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43872347
Fri 17 Jan 2014 07:31:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:31:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:31:55 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:31:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:31:55 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:31:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 07:31:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 07:31:57 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:31:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 11011 values 173920 bits 21740 bytes 
Fri 17 Jan 2014 07:32:00 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:32:00 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:32:02 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:32:02 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 07:32:02 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:32:02 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 07:32:02 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 07:32:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:32:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:32:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:32:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:32:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:32:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:32:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:32:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:32:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:32:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:32:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:32:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:32:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:32:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:32:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:32:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:32:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:32:15 - XML: Processed 655442 elements - found 622 jobs
Fri 17 Jan 2014 07:32:15 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 07:32:15 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 07:32:15 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 908495 values 14337114 bits 1792139 bytes 
Fri 17 Jan 2014 07:32:15 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 07:32:15 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:32:15 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:32:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:32:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:32:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:32:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:32:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:32:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43860282
Fri 17 Jan 2014 07:32:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:32:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43860282
Fri 17 Jan 2014 07:32:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:32:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:32:28 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:32:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:32:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:32:29 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:32:29 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:32:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:32:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:32:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43860282
Fri 17 Jan 2014 07:32:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:32:30 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:32:30 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:32:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:32:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:32:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:32:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:32:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:32:40 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:32:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:32:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:32:40 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:32:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 07:32:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:32:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:32:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:32:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:32:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:32:42 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:32:42 - job_xml_thread(): Done retrieving: data size 43855497
Fri 17 Jan 2014 07:32:42 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:32:42 - XML: Start document: iteration 1
Fri 17 Jan 2014 07:32:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855497
Fri 17 Jan 2014 07:32:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:32:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:32:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:32:45 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:32:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:32:45 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:32:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:32:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855497
Fri 17 Jan 2014 07:32:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:32:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:32:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:32:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:32:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:32:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:32:56 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:32:56 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:32:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 07:32:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:32:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 07:32:56 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:32:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5877 values 93016 bits 11627 bytes 
Fri 17 Jan 2014 07:33:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:33:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:33:01 - XML: Processed 655442 elements - found 622 jobs
Fri 17 Jan 2014 07:33:01 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 07:33:01 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 07:33:01 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:33:01 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:33:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:33:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:33:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:33:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:33:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:33:02 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:33:02 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 07:33:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:33:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:33:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:33:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:33:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:33:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:33:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:33:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:33:09 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:33:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867885
Fri 17 Jan 2014 07:33:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:33:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43867885
Fri 17 Jan 2014 07:33:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:33:16 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:33:16 - job_xml_thread(): Done retrieving: data size 43867885
Fri 17 Jan 2014 07:33:16 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:33:16 - XML: Start document: iteration 2
Fri 17 Jan 2014 07:33:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:33:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:33:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:33:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:33:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:33:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:33:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:33:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:33:25 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:33:25 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:33:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:33:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:33:25 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:33:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:33:31 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:33:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:33:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:33:32 - XML: Processed 655442 elements - found 622 jobs
Fri 17 Jan 2014 07:33:32 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 07:33:32 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 07:33:32 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:33:32 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:33:32 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:33:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 07:33:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:33:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:33:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:33:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:33:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:33:35 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 07:33:35 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 07:33:35 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:33:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:33:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43837164
Fri 17 Jan 2014 07:33:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:33:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43837164
Fri 17 Jan 2014 07:33:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:33:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:33:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:33:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:33:46 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:33:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:33:47 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:33:47 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:33:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:33:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:33:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:33:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:33:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:33:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:33:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:33:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:33:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:33:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:33:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:33:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:33:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:33:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:33:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:33:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:33:52 - job_xml_thread(): Done retrieving: data size 43869237
Fri 17 Jan 2014 07:33:52 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:33:52 - XML: Start document: iteration 3
Fri 17 Jan 2014 07:33:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43869237
Fri 17 Jan 2014 07:33:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:33:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43869237
Fri 17 Jan 2014 07:33:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:33:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:33:56 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:33:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:33:57 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:33:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 07:33:57 - Entering storeMetrics(): cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Fri 17 Jan 2014 07:33:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 07:34:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:34:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:34:04 - XML: Processed 655442 elements - found 622 jobs
Fri 17 Jan 2014 07:34:04 - job 7347358 appears to have finished
Fri 17 Jan 2014 07:34:04 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 07:34:05 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 07:34:06 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 07:34:06 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:34:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:34:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:34:06 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:34:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:34:13 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:34:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:34:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:34:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:34:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:34:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:34:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:34:14 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:34:14 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:34:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:34:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:34:14 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:34:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:34:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:34:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:34:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:34:16 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:34:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867343
Fri 17 Jan 2014 07:34:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:34:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43867343
Fri 17 Jan 2014 07:34:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:34:21 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:34:21 - job_xml_thread(): Done retrieving: data size 43867343
Fri 17 Jan 2014 07:34:21 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:34:21 - XML: Start document: iteration 4
Fri 17 Jan 2014 07:34:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:34:27 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:34:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:34:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:34:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:34:30 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:34:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:34:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:34:30 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:34:30 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:34:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:34:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:34:36 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:34:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:34:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:34:37 - XML: Processed 655442 elements - found 622 jobs
Fri 17 Jan 2014 07:34:37 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 07:34:37 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 07:34:37 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:34:37 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:34:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:34:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:34:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:34:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:34:39 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:34:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856846
Fri 17 Jan 2014 07:34:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:34:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43856846
Fri 17 Jan 2014 07:34:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:34:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:34:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:34:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:34:48 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:34:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:34:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:34:50 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:34:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:34:50 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:34:50 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:34:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:34:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:34:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:34:52 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:34:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:34:52 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:34:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:34:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:34:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:34:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:34:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:34:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:34:55 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:34:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43874847
Fri 17 Jan 2014 07:34:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:34:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43874847
Fri 17 Jan 2014 07:34:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:34:56 - job_xml_thread(): Done retrieving: data size 43874847
Fri 17 Jan 2014 07:34:56 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:34:56 - XML: Start document: iteration 5
Fri 17 Jan 2014 07:34:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:34:58 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:34:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:34:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 07:34:59 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:35:00 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:35:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 18163 values 286643 bits 35830 bytes 
Fri 17 Jan 2014 07:35:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 07:35:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:35:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:35:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:35:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:35:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:35:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:35:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:35:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:35:11 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:35:11 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:35:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:35:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:35:11 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:35:13 - XML: Processed 655441 elements - found 623 jobs
Fri 17 Jan 2014 07:35:13 - job 7347527 report time 1389940366 does not match current heartbeat 1389940435 : ignoring job
Fri 17 Jan 2014 07:35:13 - job 7347508 appears to have finished
Fri 17 Jan 2014 07:35:13 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 07:35:13 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 07:35:14 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 07:35:14 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:35:14 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:35:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:35:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:35:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:35:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:35:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:35:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:35:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:35:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:35:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:35:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43773097
Fri 17 Jan 2014 07:35:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:35:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43773097
Fri 17 Jan 2014 07:35:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:35:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:35:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:35:29 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:35:29 - job_xml_thread(): Done retrieving: data size 43773097
Fri 17 Jan 2014 07:35:29 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:35:29 - XML: Start document: iteration 6
Fri 17 Jan 2014 07:35:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:35:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:35:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:35:36 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:35:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:35:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:35:37 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:35:37 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:35:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:35:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:35:37 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:35:39 - XML: Processed 654700 elements - found 625 jobs
Fri 17 Jan 2014 07:35:39 - job 7347541 report time 1389940435 does not match current heartbeat 1389940487 : ignoring job
Fri 17 Jan 2014 07:35:39 - job 7347527 report time 1389940366 does not match current heartbeat 1389940487 : ignoring job
Fri 17 Jan 2014 07:35:39 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 07:35:39 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 07:35:39 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 07:35:39 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:35:39 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:35:40 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:35:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 07:35:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:35:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:35:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:35:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:35:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:35:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:35:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:35:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:35:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:35:44 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:35:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43255323
Fri 17 Jan 2014 07:35:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:35:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43255323
Fri 17 Jan 2014 07:35:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:35:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:35:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:35:55 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:35:55 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:35:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:35:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:35:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:35:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:35:56 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:35:56 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:35:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:35:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:35:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:35:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:35:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:35:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:35:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:35:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:35:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:35:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:35:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:35:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:35:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:35:59 - job_xml_thread(): Done retrieving: data size 43203017
Fri 17 Jan 2014 07:35:59 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:35:59 - XML: Start document: iteration 7
Fri 17 Jan 2014 07:36:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:36:00 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:36:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43203017
Fri 17 Jan 2014 07:36:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:36:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43203017
Fri 17 Jan 2014 07:36:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:36:01 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:36:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 07:36:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:36:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 07:36:01 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:36:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6072 values 95796 bits 11974 bytes 
Fri 17 Jan 2014 07:36:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:36:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:36:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:36:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:36:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:36:21 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:36:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:36:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:36:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:36:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:36:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:36:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:36:23 - XML: Processed 647248 elements - found 625 jobs
Fri 17 Jan 2014 07:36:23 - job 7347541 report time 1389940435 does not match current heartbeat 1389940487 : ignoring job
Fri 17 Jan 2014 07:36:23 - job 7347527 report time 1389940366 does not match current heartbeat 1389940487 : ignoring job
Fri 17 Jan 2014 07:36:23 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:36:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:36:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:36:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:36:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:36:23 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 07:36:23 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 07:36:23 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:36:23 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:36:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:36:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:36:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:36:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:36:26 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:36:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43284875
Fri 17 Jan 2014 07:36:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:36:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43284875
Fri 17 Jan 2014 07:36:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:36:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:36:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:36:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:36:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:36:38 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:36:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:36:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:36:38 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:36:38 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:36:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 07:36:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:36:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:36:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:36:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:36:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:36:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:36:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:36:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:36:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:36:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:36:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:36:39 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:36:39 - job_xml_thread(): Done retrieving: data size 43717537
Fri 17 Jan 2014 07:36:39 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:36:39 - XML: Start document: iteration 8
Fri 17 Jan 2014 07:36:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43717537
Fri 17 Jan 2014 07:36:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:36:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43717537
Fri 17 Jan 2014 07:36:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:36:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:36:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:36:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:36:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:36:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:36:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:36:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:36:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:36:58 - XML: Processed 653360 elements - found 624 jobs
Fri 17 Jan 2014 07:36:58 - job 7347472 appears to have finished
Fri 17 Jan 2014 07:36:58 - job 7347541 report time 1389940435 does not match current heartbeat 1389940556 : ignoring job
Fri 17 Jan 2014 07:36:58 - job 7347543 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 07:36:58 - job 7347542 report time 1389940487 does not match current heartbeat 1389940556 : ignoring job
Fri 17 Jan 2014 07:36:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:36:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:36:58 - job 7346686 appears to have finished
Fri 17 Jan 2014 07:36:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:36:58 - job 7347527 report time 1389940366 does not match current heartbeat 1389940556 : ignoring job
Fri 17 Jan 2014 07:36:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:36:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:36:58 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 07:36:58 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 07:36:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:36:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:36:59 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 07:36:59 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:36:59 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:36:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:36:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:37:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:37:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:37:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:37:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:37:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:37:01 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:37:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:37:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851934
Fri 17 Jan 2014 07:37:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:37:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851934
Fri 17 Jan 2014 07:37:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:37:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:37:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 07:37:02 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:37:02 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:37:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Fri 17 Jan 2014 07:37:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:37:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:37:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:37:14 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:37:14 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:37:14 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:37:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:37:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:37:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:37:16 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:37:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:37:16 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:37:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:37:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:37:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:37:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:37:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:37:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:37:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:37:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:37:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:37:18 - job_xml_thread(): Done retrieving: data size 43855817
Fri 17 Jan 2014 07:37:18 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:37:18 - XML: Start document: iteration 9
Fri 17 Jan 2014 07:37:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855817
Fri 17 Jan 2014 07:37:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:37:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855817
Fri 17 Jan 2014 07:37:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:37:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:37:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:37:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:37:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:37:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:37:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:37:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:37:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:37:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:37:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:37:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:37:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:37:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:37:37 - XML: Processed 655441 elements - found 623 jobs
Fri 17 Jan 2014 07:37:37 - job 7347495 appears to have finished
Fri 17 Jan 2014 07:37:37 - job 7347541 report time 1389940435 does not match current heartbeat 1389940607 : ignoring job
Fri 17 Jan 2014 07:37:37 - job 7347542 report time 1389940487 does not match current heartbeat 1389940607 : ignoring job
Fri 17 Jan 2014 07:37:37 - job 7347544 report time 1389940556 does not match current heartbeat 1389940607 : ignoring job
Fri 17 Jan 2014 07:37:37 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 07:37:37 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 07:37:38 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 07:37:38 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:37:38 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:37:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:37:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:37:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:37:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:37:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:37:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:37:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:37:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:37:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:37:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851794
Fri 17 Jan 2014 07:37:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:37:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851794
Fri 17 Jan 2014 07:37:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:37:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:37:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:37:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:37:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:37:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:37:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:37:54 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:37:54 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:37:54 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:37:54 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:37:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:37:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:37:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:37:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:37:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:37:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:37:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:37:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:37:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:37:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:37:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:37:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:37:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:37:59 - job_xml_thread(): Done retrieving: data size 43872288
Fri 17 Jan 2014 07:37:59 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:37:59 - XML: Start document: iteration 10
Fri 17 Jan 2014 07:37:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43872288
Fri 17 Jan 2014 07:37:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:38:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43872288
Fri 17 Jan 2014 07:38:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:38:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:38:03 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:38:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:38:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 07:38:06 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:38:06 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:38:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 18607 values 293647 bits 36705 bytes 
Fri 17 Jan 2014 07:38:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 07:38:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:38:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:38:10 - XML: Processed 655444 elements - found 623 jobs
Fri 17 Jan 2014 07:38:10 - job 7347541 report time 1389940435 does not match current heartbeat 1389940607 : ignoring job
Fri 17 Jan 2014 07:38:10 - job 7347542 report time 1389940487 does not match current heartbeat 1389940607 : ignoring job
Fri 17 Jan 2014 07:38:10 - job 7347544 report time 1389940556 does not match current heartbeat 1389940607 : ignoring job
Fri 17 Jan 2014 07:38:10 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 07:38:10 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 07:38:10 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:38:10 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:38:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:38:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:38:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:38:16 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:38:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:38:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:38:17 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:38:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:38:17 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:38:17 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:38:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:38:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:38:21 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:38:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:38:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:38:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:38:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:38:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:38:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:38:23 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:38:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43868958
Fri 17 Jan 2014 07:38:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:38:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43868958
Fri 17 Jan 2014 07:38:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:38:25 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:38:25 - job_xml_thread(): Done retrieving: data size 43868958
Fri 17 Jan 2014 07:38:25 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:38:25 - XML: Start document: iteration 11
Fri 17 Jan 2014 07:38:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:38:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:38:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:38:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:38:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:38:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:38:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:38:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:38:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:38:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:38:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:38:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:38:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:38:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:38:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:38:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:38:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:38:47 - XML: Processed 655444 elements - found 623 jobs
Fri 17 Jan 2014 07:38:47 - job 7347541 report time 1389940435 does not match current heartbeat 1389940607 : ignoring job
Fri 17 Jan 2014 07:38:47 - job 7347542 report time 1389940487 does not match current heartbeat 1389940607 : ignoring job
Fri 17 Jan 2014 07:38:47 - job 7347544 report time 1389940556 does not match current heartbeat 1389940607 : ignoring job
Fri 17 Jan 2014 07:38:47 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 07:38:47 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 07:38:47 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:38:47 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:38:47 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:38:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 07:38:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:38:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:38:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:38:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:38:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:38:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:38:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43849715
Fri 17 Jan 2014 07:38:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:38:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43849715
Fri 17 Jan 2014 07:38:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:38:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:38:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:39:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:39:01 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:39:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:39:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:39:02 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 07:39:02 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:39:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:39:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:39:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:39:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:39:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:39:03 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:39:03 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:39:03 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:39:03 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 07:39:03 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 07:39:03 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 07:39:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:39:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:39:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:39:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:39:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:39:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:39:04 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 1027897 values 16222351 bits 2027793 bytes 
Fri 17 Jan 2014 07:39:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:39:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:39:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:39:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:39:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:39:06 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:39:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:39:07 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:39:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 07:39:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 07:39:07 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:39:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5953 values 93942 bits 11742 bytes 
Fri 17 Jan 2014 07:39:08 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:39:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43868772
Fri 17 Jan 2014 07:39:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:39:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43868772
Fri 17 Jan 2014 07:39:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:39:09 - job_xml_thread(): Done retrieving: data size 43868772
Fri 17 Jan 2014 07:39:09 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:39:09 - XML: Start document: iteration 12
Fri 17 Jan 2014 07:39:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:39:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:39:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:39:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:39:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:39:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:39:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:39:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:39:23 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:39:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:39:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:39:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:39:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:39:31 - XML: Processed 655442 elements - found 622 jobs
Fri 17 Jan 2014 07:39:31 - job 7347516 appears to have finished
Fri 17 Jan 2014 07:39:31 - job 7347542 report time 1389940487 does not match current heartbeat 1389940676 : ignoring job
Fri 17 Jan 2014 07:39:31 - job 7347545 report time 1389940607 does not match current heartbeat 1389940676 : ignoring job
Fri 17 Jan 2014 07:39:31 - job 7347544 report time 1389940556 does not match current heartbeat 1389940676 : ignoring job
Fri 17 Jan 2014 07:39:31 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 07:39:31 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 07:39:31 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 07:39:31 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:39:31 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:39:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:39:33 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:39:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:39:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:39:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:39:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:39:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:39:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:39:35 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:39:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 07:39:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:39:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:39:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43825251
Fri 17 Jan 2014 07:39:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:39:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43825251
Fri 17 Jan 2014 07:39:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:39:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:39:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:39:46 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:39:46 - job_xml_thread(): Done retrieving: data size 43825251
Fri 17 Jan 2014 07:39:46 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:39:46 - XML: Start document: iteration 13
Fri 17 Jan 2014 07:39:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:39:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:39:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:39:50 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:39:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:39:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:39:50 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:39:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:39:50 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:39:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:39:50 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:39:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:39:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:39:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:39:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:39:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:39:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:39:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:39:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:40:01 - XML: Processed 655442 elements - found 622 jobs
Fri 17 Jan 2014 07:40:01 - job 7347545 report time 1389940607 does not match current heartbeat 1389940728 : ignoring job
Fri 17 Jan 2014 07:40:01 - job 7347544 report time 1389940556 does not match current heartbeat 1389940728 : ignoring job
Fri 17 Jan 2014 07:40:01 - job 7347546 report time 1389940676 does not match current heartbeat 1389940728 : ignoring job
Fri 17 Jan 2014 07:40:01 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 07:40:01 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 07:40:01 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 07:40:01 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:40:01 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:40:03 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:40:03 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 07:40:04 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:40:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43836383
Fri 17 Jan 2014 07:40:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:40:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43836383
Fri 17 Jan 2014 07:40:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:40:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:40:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:40:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:40:07 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:40:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:40:08 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:40:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 07:40:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 07:40:08 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:40:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7235 values 114105 bits 14263 bytes 
Fri 17 Jan 2014 07:40:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:40:14 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:40:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:40:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:40:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:40:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:40:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:40:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:40:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:40:15 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:40:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:40:16 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:40:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:40:20 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:40:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:40:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:40:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:40:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:40:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:40:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:40:24 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:40:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43849879
Fri 17 Jan 2014 07:40:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:40:25 - job_xml_thread(): Done retrieving: data size 43849879
Fri 17 Jan 2014 07:40:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43849879
Fri 17 Jan 2014 07:40:25 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:40:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:40:25 - XML: Start document: iteration 14
Fri 17 Jan 2014 07:40:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:40:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:40:35 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:40:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 07:40:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:40:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:40:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:40:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:40:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:40:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:40:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:40:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:40:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:40:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:40:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:40:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:40:43 - XML: Processed 655442 elements - found 622 jobs
Fri 17 Jan 2014 07:40:43 - job 7347545 report time 1389940607 does not match current heartbeat 1389940728 : ignoring job
Fri 17 Jan 2014 07:40:43 - job 7347544 report time 1389940556 does not match current heartbeat 1389940728 : ignoring job
Fri 17 Jan 2014 07:40:43 - job 7347546 report time 1389940676 does not match current heartbeat 1389940728 : ignoring job
Fri 17 Jan 2014 07:40:43 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 07:40:43 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 07:40:43 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:40:43 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:40:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:40:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:40:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:40:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:40:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:40:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:40:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:40:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:40:50 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:40:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43832307
Fri 17 Jan 2014 07:40:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:40:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43832307
Fri 17 Jan 2014 07:40:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:40:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:40:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:40:58 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:40:58 - job_xml_thread(): Done retrieving: data size 43832307
Fri 17 Jan 2014 07:40:58 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:40:58 - XML: Start document: iteration 15
Fri 17 Jan 2014 07:41:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:41:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:41:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:41:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:41:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:41:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:41:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:41:07 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:41:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:41:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:41:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:41:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:41:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:41:08 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:41:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:41:08 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:41:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:41:08 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:41:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:41:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:41:08 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:41:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:41:09 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:41:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 07:41:09 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:41:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 07:41:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6149 values 96974 bits 12121 bytes 
Fri 17 Jan 2014 07:41:13 - XML: Processed 655442 elements - found 622 jobs
Fri 17 Jan 2014 07:41:13 - job 7347467 appears to have finished
Fri 17 Jan 2014 07:41:13 - job 7347545 report time 1389940607 does not match current heartbeat 1389940797 : ignoring job
Fri 17 Jan 2014 07:41:13 - job 7347547 report time 1389940728 does not match current heartbeat 1389940797 : ignoring job
Fri 17 Jan 2014 07:41:13 - job 7347546 report time 1389940676 does not match current heartbeat 1389940797 : ignoring job
Fri 17 Jan 2014 07:41:13 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 07:41:13 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 07:41:13 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 07:41:13 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:41:13 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:41:17 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:41:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43788519
Fri 17 Jan 2014 07:41:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:41:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43788519
Fri 17 Jan 2014 07:41:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:41:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:41:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:41:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:41:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:41:28 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:41:29 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:41:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:41:31 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:41:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:41:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:41:32 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:41:32 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:41:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:41:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:41:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:41:33 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:41:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:41:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:41:34 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:41:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 07:41:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:41:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:41:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:41:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:41:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:41:37 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:41:37 - job_xml_thread(): Done retrieving: data size 43356164
Fri 17 Jan 2014 07:41:37 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:41:37 - XML: Start document: iteration 16
Fri 17 Jan 2014 07:41:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43356164
Fri 17 Jan 2014 07:41:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43356164
Fri 17 Jan 2014 07:41:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:41:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:41:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:41:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:41:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:41:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:41:50 - XML: Processed 649384 elements - found 622 jobs
Fri 17 Jan 2014 07:41:50 - job 7347549 report time 1389940797 does not match current heartbeat 1389940849 : ignoring job
Fri 17 Jan 2014 07:41:50 - job 7347547 report time 1389940728 does not match current heartbeat 1389940849 : ignoring job
Fri 17 Jan 2014 07:41:50 - job 7347546 report time 1389940676 does not match current heartbeat 1389940849 : ignoring job
Fri 17 Jan 2014 07:41:50 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 07:41:50 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 07:41:51 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 07:41:51 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:41:51 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:41:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:41:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:41:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:41:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:41:56 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:41:56 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:41:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:41:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:41:56 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:42:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:42:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:42:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:42:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:42:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:42:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:42:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:42:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:42:04 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:42:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43185206
Fri 17 Jan 2014 07:42:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:42:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43185206
Fri 17 Jan 2014 07:42:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:42:06 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:42:06 - job_xml_thread(): Done retrieving: data size 43185206
Fri 17 Jan 2014 07:42:06 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:42:06 - XML: Start document: iteration 17
Fri 17 Jan 2014 07:42:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:42:09 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:42:10 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:42:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 07:42:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:42:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 07:42:10 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:42:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8752 values 138011 bits 17251 bytes 
Fri 17 Jan 2014 07:42:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:42:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:42:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:42:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:42:22 - XML: Processed 647242 elements - found 622 jobs
Fri 17 Jan 2014 07:42:22 - job 7347549 report time 1389940797 does not match current heartbeat 1389940849 : ignoring job
Fri 17 Jan 2014 07:42:22 - job 7347547 report time 1389940728 does not match current heartbeat 1389940849 : ignoring job
Fri 17 Jan 2014 07:42:22 - job 7347546 report time 1389940676 does not match current heartbeat 1389940849 : ignoring job
Fri 17 Jan 2014 07:42:23 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 07:42:23 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 07:42:23 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:42:23 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:42:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:42:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:42:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:42:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:42:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:42:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:42:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:42:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:42:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:42:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:42:27 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:42:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:42:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:42:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:42:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:42:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:42:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:42:31 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:42:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43335214
Fri 17 Jan 2014 07:42:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:42:31 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:42:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 07:42:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:42:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43335214
Fri 17 Jan 2014 07:42:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:42:38 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:42:38 - job_xml_thread(): Done retrieving: data size 43335214
Fri 17 Jan 2014 07:42:38 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:42:38 - XML: Start document: iteration 18
Fri 17 Jan 2014 07:42:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:42:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:42:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:42:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:42:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:42:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:42:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:42:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:42:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:42:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:42:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:42:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:42:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:42:48 - XML: Processed 648794 elements - found 621 jobs
Fri 17 Jan 2014 07:42:48 - job 7347549 report time 1389940797 does not match current heartbeat 1389940849 : ignoring job
Fri 17 Jan 2014 07:42:48 - job 7347547 report time 1389940728 does not match current heartbeat 1389940849 : ignoring job
Fri 17 Jan 2014 07:42:48 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 07:42:48 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 07:42:48 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:42:48 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:42:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:42:52 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:42:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:42:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:42:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:42:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:42:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:42:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:42:53 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 07:42:53 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 07:42:53 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:42:54 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:42:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43824030
Fri 17 Jan 2014 07:42:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:42:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43824030
Fri 17 Jan 2014 07:42:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:43:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:43:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:43:03 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:43:03 - job_xml_thread(): Done retrieving: data size 43824030
Fri 17 Jan 2014 07:43:03 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:43:03 - XML: Start document: iteration 19
Fri 17 Jan 2014 07:43:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:43:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:43:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:43:10 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:43:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:43:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 07:43:11 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:43:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99105 bits 12388 bytes 
Fri 17 Jan 2014 07:43:12 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:43:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 07:43:13 - XML: Processed 655178 elements - found 621 jobs
Fri 17 Jan 2014 07:43:13 - job 7347549 report time 1389940797 does not match current heartbeat 1389940917 : ignoring job
Fri 17 Jan 2014 07:43:13 - job 7347547 report time 1389940728 does not match current heartbeat 1389940917 : ignoring job
Fri 17 Jan 2014 07:43:13 - job 7347550 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 07:43:13 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 07:43:13 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 07:43:14 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 07:43:14 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:43:14 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:43:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:43:14 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:43:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:43:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:43:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:43:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:43:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:43:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:43:15 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:43:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:43:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:43:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:43:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:43:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:43:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:43:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:43:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:43:18 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:43:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 07:43:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:43:21 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:43:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43850428
Fri 17 Jan 2014 07:43:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:43:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43850428
Fri 17 Jan 2014 07:43:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:43:29 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:43:29 - job_xml_thread(): Done retrieving: data size 43850428
Fri 17 Jan 2014 07:43:29 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:43:29 - XML: Start document: iteration 20
Fri 17 Jan 2014 07:43:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:43:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:43:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:43:31 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:43:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:43:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:43:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:43:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:43:35 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:43:35 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:43:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:43:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:43:35 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:43:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:43:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:43:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:43:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:43:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:43:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:43:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:43:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:43:41 - XML: Processed 655436 elements - found 619 jobs
Fri 17 Jan 2014 07:43:41 - job 7347465 appears to have finished
Fri 17 Jan 2014 07:43:41 - job 7347549 report time 1389940797 does not match current heartbeat 1389940969 : ignoring job
Fri 17 Jan 2014 07:43:41 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 07:43:41 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 07:43:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:43:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43854001
Fri 17 Jan 2014 07:43:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:43:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43854001
Fri 17 Jan 2014 07:43:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:43:44 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 07:43:44 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:43:44 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:43:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:43:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:43:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:43:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:43:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:43:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:43:53 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:43:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:43:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:43:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:43:53 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:43:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:43:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:43:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:43:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:43:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:43:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:43:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:43:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:43:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:43:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:43:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:43:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870593
Fri 17 Jan 2014 07:43:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:43:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870593
Fri 17 Jan 2014 07:43:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:43:59 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:43:59 - job_xml_thread(): Done retrieving: data size 43870593
Fri 17 Jan 2014 07:43:59 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:43:59 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 07:44:00 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 07:44:00 - Housekeeping: done.
Fri 17 Jan 2014 07:44:00 - XML: Start document: iteration 0
Fri 17 Jan 2014 07:44:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:44:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:44:09 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:44:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:44:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:44:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:44:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:44:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:44:10 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:44:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:44:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:44:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:44:12 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:44:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:44:13 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:44:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 07:44:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 07:44:13 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:44:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99046 bits 12380 bytes 
Fri 17 Jan 2014 07:44:18 - XML: Processed 655436 elements - found 619 jobs
Fri 17 Jan 2014 07:44:18 - job 7347549 report time 1389940797 does not match current heartbeat 1389940969 : ignoring job
Fri 17 Jan 2014 07:44:19 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 07:44:19 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 07:44:19 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:44:19 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:44:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:44:20 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:44:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:44:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:44:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:44:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:44:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:44:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:44:22 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:44:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43828895
Fri 17 Jan 2014 07:44:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:44:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43828895
Fri 17 Jan 2014 07:44:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:44:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:44:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:44:34 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:44:34 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:44:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:44:34 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:44:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:44:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:44:35 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:44:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:44:35 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:44:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:44:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:44:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:44:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:44:38 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:44:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:44:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:44:39 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:44:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 07:44:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:44:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:44:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:44:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:44:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:44:40 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:44:40 - job_xml_thread(): Done retrieving: data size 43859268
Fri 17 Jan 2014 07:44:40 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:44:40 - XML: Start document: iteration 1
Fri 17 Jan 2014 07:44:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43859268
Fri 17 Jan 2014 07:44:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:44:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43859268
Fri 17 Jan 2014 07:44:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:44:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:44:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:44:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:44:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:44:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:44:56 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:44:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:44:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:44:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:44:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:44:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:44:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:44:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:45:04 - XML: Processed 655438 elements - found 620 jobs
Fri 17 Jan 2014 07:45:04 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 07:45:04 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 07:45:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:45:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:45:04 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 07:45:04 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:45:04 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:45:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:45:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:45:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:45:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:45:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:45:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:45:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:45:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43839594
Fri 17 Jan 2014 07:45:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:45:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43839594
Fri 17 Jan 2014 07:45:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:45:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:45:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:45:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:45:13 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:45:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:45:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 07:45:14 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:45:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 07:45:14 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:45:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8701 values 137145 bits 17143 bytes 
Fri 17 Jan 2014 07:45:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:45:16 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:45:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:45:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:45:17 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:45:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:45:17 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:45:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:45:17 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:45:19 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:45:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:45:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:45:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:45:20 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:45:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:45:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:45:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:45:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:45:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:45:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:45:22 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:45:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855676
Fri 17 Jan 2014 07:45:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:45:23 - job_xml_thread(): Done retrieving: data size 43855676
Fri 17 Jan 2014 07:45:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855676
Fri 17 Jan 2014 07:45:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:45:23 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:45:23 - XML: Start document: iteration 2
Fri 17 Jan 2014 07:45:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:45:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:45:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:45:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:45:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:45:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:45:35 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:45:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:45:35 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:45:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:45:35 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:45:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:45:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:45:36 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:45:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 07:45:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:45:38 - XML: Processed 655442 elements - found 622 jobs
Fri 17 Jan 2014 07:45:38 - job 7347551 report time 1389941038 does not match current heartbeat 1389941090 : ignoring job
Fri 17 Jan 2014 07:45:38 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 07:45:38 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 07:45:38 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 07:45:38 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:45:38 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:45:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:45:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:45:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:45:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:45:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:45:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:45:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:45:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:45:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:45:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862455
Fri 17 Jan 2014 07:45:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:45:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862455
Fri 17 Jan 2014 07:45:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:45:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:45:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:45:53 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:45:53 - job_xml_thread(): Done retrieving: data size 43862455
Fri 17 Jan 2014 07:45:54 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:45:54 - XML: Start document: iteration 3
Fri 17 Jan 2014 07:45:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:45:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:45:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:45:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:45:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:45:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:45:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:45:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:45:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:45:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:45:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:46:03 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 07:46:03 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:46:05 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:46:05 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:46:05 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 07:46:05 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 07:46:05 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 07:46:07 - XML: Processed 655442 elements - found 622 jobs
Fri 17 Jan 2014 07:46:07 - job 7347551 report time 1389941038 does not match current heartbeat 1389941090 : ignoring job
Fri 17 Jan 2014 07:46:08 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 07:46:08 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 07:46:08 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:46:08 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:46:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:46:08 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:46:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:46:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:46:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:46:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:46:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:46:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:46:09 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 857425 values 13520591 bits 1690073 bytes 
Fri 17 Jan 2014 07:46:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:46:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43842420
Fri 17 Jan 2014 07:46:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:46:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43842420
Fri 17 Jan 2014 07:46:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:46:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:46:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:46:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:46:14 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:46:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:46:16 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:46:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 07:46:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 07:46:16 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:46:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8862 values 139797 bits 17474 bytes 
Fri 17 Jan 2014 07:46:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:46:21 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:46:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:46:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:46:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:46:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:46:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43842420
Fri 17 Jan 2014 07:46:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:46:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:46:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:46:23 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:46:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:46:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:46:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:46:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:46:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:46:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:46:34 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:46:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:46:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:46:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:46:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:46:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:46:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:46:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:46:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:46:38 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:46:38 - job_xml_thread(): Done retrieving: data size 43833509
Fri 17 Jan 2014 07:46:38 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:46:38 - XML: Start document: iteration 4
Fri 17 Jan 2014 07:46:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43833509
Fri 17 Jan 2014 07:46:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:46:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:46:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:46:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:46:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:46:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43833509
Fri 17 Jan 2014 07:46:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:46:50 - XML: Processed 655444 elements - found 623 jobs
Fri 17 Jan 2014 07:46:50 - job 7347554 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 07:46:50 - job 7347553 report time 1389941090 does not match current heartbeat 1389941159 : ignoring job
Fri 17 Jan 2014 07:46:50 - job 7347551 report time 1389941038 does not match current heartbeat 1389941159 : ignoring job
Fri 17 Jan 2014 07:46:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:46:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:46:50 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 07:46:51 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 07:46:51 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 07:46:51 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:46:51 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:46:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:46:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:46:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:46:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:46:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:46:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:46:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:46:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:46:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:46:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:46:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:47:00 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:47:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 07:47:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:47:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:47:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:47:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:47:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:47:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:47:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:47:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:47:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:47:04 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:47:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853918
Fri 17 Jan 2014 07:47:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:47:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853918
Fri 17 Jan 2014 07:47:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:47:06 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:47:06 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:47:06 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 07:47:06 - job_xml_thread(): Done retrieving: data size 43853918
Fri 17 Jan 2014 07:47:06 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:47:06 - XML: Start document: iteration 5
Fri 17 Jan 2014 07:47:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:47:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:47:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:47:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:47:16 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:47:16 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:47:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:47:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:47:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:47:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:47:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:47:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:47:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:47:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:47:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:47:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:47:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 07:47:18 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:47:18 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:47:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5947 values 93985 bits 11748 bytes 
Fri 17 Jan 2014 07:47:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 07:47:24 - XML: Processed 655444 elements - found 623 jobs
Fri 17 Jan 2014 07:47:24 - job 7347553 report time 1389941090 does not match current heartbeat 1389941159 : ignoring job
Fri 17 Jan 2014 07:47:24 - job 7347551 report time 1389941038 does not match current heartbeat 1389941159 : ignoring job
Fri 17 Jan 2014 07:47:24 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 07:47:24 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 07:47:24 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:47:24 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:47:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:47:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:47:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:47:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:47:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:47:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:47:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:47:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:47:31 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:47:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43787021
Fri 17 Jan 2014 07:47:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:47:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43787021
Fri 17 Jan 2014 07:47:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:47:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:47:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:47:39 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:47:39 - job_xml_thread(): Done retrieving: data size 43787021
Fri 17 Jan 2014 07:47:39 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:47:39 - XML: Start document: iteration 6
Fri 17 Jan 2014 07:47:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:47:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:47:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:47:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:47:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:47:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:47:45 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:47:45 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:47:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:47:45 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:47:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:47:54 - XML: Processed 654696 elements - found 623 jobs
Fri 17 Jan 2014 07:47:54 - job 7347511 appears to have finished
Fri 17 Jan 2014 07:47:54 - job 7347555 report time 1389941159 does not match current heartbeat 1389941210 : ignoring job
Fri 17 Jan 2014 07:47:54 - job 7347553 report time 1389941090 does not match current heartbeat 1389941210 : ignoring job
Fri 17 Jan 2014 07:47:54 - job 7347550 appears to have finished
Fri 17 Jan 2014 07:47:54 - job 7347551 report time 1389941038 does not match current heartbeat 1389941210 : ignoring job
Fri 17 Jan 2014 07:47:54 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 07:47:54 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 07:47:54 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:47:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 07:47:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:47:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:47:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:47:54 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 07:47:54 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:47:54 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:47:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:47:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:47:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:47:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:47:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:47:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:47:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:47:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43205243
Fri 17 Jan 2014 07:47:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:47:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43205243
Fri 17 Jan 2014 07:47:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:48:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:48:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:48:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:48:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:48:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:48:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:48:08 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:48:08 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:48:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:48:08 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:48:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:48:09 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:48:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:48:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:48:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:48:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:48:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:48:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:48:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:48:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:48:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:48:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:48:17 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:48:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43214508
Fri 17 Jan 2014 07:48:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:48:18 - job_xml_thread(): Done retrieving: data size 43214508
Fri 17 Jan 2014 07:48:18 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:48:18 - XML: Start document: iteration 7
Fri 17 Jan 2014 07:48:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43214508
Fri 17 Jan 2014 07:48:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:48:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:48:18 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:48:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:48:19 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:48:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 07:48:19 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:48:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 07:48:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8678 values 137170 bits 17146 bytes 
Fri 17 Jan 2014 07:48:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:48:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:48:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:48:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:48:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:48:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:48:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:48:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:48:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:48:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:48:34 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:48:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:48:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:48:36 - XML: Processed 647380 elements - found 623 jobs
Fri 17 Jan 2014 07:48:36 - job 7347555 report time 1389941159 does not match current heartbeat 1389941210 : ignoring job
Fri 17 Jan 2014 07:48:36 - job 7347553 report time 1389941090 does not match current heartbeat 1389941210 : ignoring job
Fri 17 Jan 2014 07:48:36 - job 7347551 report time 1389941038 does not match current heartbeat 1389941210 : ignoring job
Fri 17 Jan 2014 07:48:36 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 07:48:36 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 07:48:36 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:48:36 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:48:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:48:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:48:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:48:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:48:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:48:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:48:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:48:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:48:46 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:48:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43728930
Fri 17 Jan 2014 07:48:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:48:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43728930
Fri 17 Jan 2014 07:48:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:48:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:48:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:48:52 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:48:52 - job_xml_thread(): Done retrieving: data size 43728930
Fri 17 Jan 2014 07:48:52 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:48:52 - XML: Start document: iteration 8
Fri 17 Jan 2014 07:48:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:48:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:48:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:48:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:48:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:48:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:48:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:48:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:48:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:48:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:48:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:49:06 - XML: Processed 653922 elements - found 623 jobs
Fri 17 Jan 2014 07:49:06 - job 7347557 report time 1389941210 does not match current heartbeat 1389941279 : ignoring job
Fri 17 Jan 2014 07:49:06 - job 7347555 report time 1389941159 does not match current heartbeat 1389941279 : ignoring job
Fri 17 Jan 2014 07:49:06 - job 7347553 report time 1389941090 does not match current heartbeat 1389941279 : ignoring job
Fri 17 Jan 2014 07:49:06 - job 7347297 appears to have finished
Fri 17 Jan 2014 07:49:06 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 07:49:06 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 07:49:06 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 07:49:06 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:49:06 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:49:07 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:49:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 07:49:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:49:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:49:08 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:49:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:49:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:49:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:49:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:49:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:49:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:49:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:49:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43823412
Fri 17 Jan 2014 07:49:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:49:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43823412
Fri 17 Jan 2014 07:49:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:49:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:49:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:49:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:49:19 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:49:19 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:49:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:49:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 07:49:19 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:49:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 07:49:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5950 values 93944 bits 11743 bytes 
Fri 17 Jan 2014 07:49:21 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:49:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:49:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:49:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:49:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:49:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:49:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:49:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:49:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:49:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:49:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:49:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:49:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:49:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:49:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:49:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:49:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:49:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:49:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:49:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:49:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:49:32 - job_xml_thread(): Done retrieving: data size 43853461
Fri 17 Jan 2014 07:49:32 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:49:32 - XML: Start document: iteration 9
Fri 17 Jan 2014 07:49:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853461
Fri 17 Jan 2014 07:49:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:49:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853461
Fri 17 Jan 2014 07:49:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:49:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:49:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:49:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:49:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:49:54 - XML: Processed 655446 elements - found 624 jobs
Fri 17 Jan 2014 07:49:54 - job 7347557 report time 1389941210 does not match current heartbeat 1389941331 : ignoring job
Fri 17 Jan 2014 07:49:54 - job 7347555 report time 1389941159 does not match current heartbeat 1389941331 : ignoring job
Fri 17 Jan 2014 07:49:54 - job 7347558 report time 1389941279 does not match current heartbeat 1389941331 : ignoring job
Fri 17 Jan 2014 07:49:54 - job 7347559 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 07:49:54 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 07:49:54 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 07:49:55 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 07:49:55 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:49:55 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:49:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:49:55 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:49:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:49:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:49:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:49:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:49:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:49:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:49:56 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:49:56 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:49:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 07:49:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:49:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:49:56 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:49:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:49:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:49:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:49:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:49:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:49:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:49:59 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 07:49:59 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 07:49:59 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:49:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:49:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43874617
Fri 17 Jan 2014 07:49:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:50:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43874617
Fri 17 Jan 2014 07:50:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:50:10 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:50:10 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:50:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:50:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:50:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:50:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:50:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:50:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:50:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:50:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:50:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:50:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:50:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:50:13 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:50:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:50:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:50:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:50:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:50:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:50:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:50:15 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:50:15 - job_xml_thread(): Done retrieving: data size 43874321
Fri 17 Jan 2014 07:50:15 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:50:15 - XML: Start document: iteration 10
Fri 17 Jan 2014 07:50:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43874321
Fri 17 Jan 2014 07:50:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:50:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43874321
Fri 17 Jan 2014 07:50:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:50:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:50:19 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:50:21 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:50:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 07:50:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:50:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 07:50:22 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:50:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9158 values 144502 bits 18062 bytes 
Fri 17 Jan 2014 07:50:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:50:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:50:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:50:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:50:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:50:34 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:50:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:50:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:50:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:50:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:50:34 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:50:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:50:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:50:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:50:34 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:50:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:50:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:50:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:50:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:50:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:50:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:50:37 - XML: Processed 655446 elements - found 624 jobs
Fri 17 Jan 2014 07:50:37 - job 7347557 report time 1389941210 does not match current heartbeat 1389941331 : ignoring job
Fri 17 Jan 2014 07:50:37 - job 7347555 report time 1389941159 does not match current heartbeat 1389941331 : ignoring job
Fri 17 Jan 2014 07:50:37 - job 7347558 report time 1389941279 does not match current heartbeat 1389941331 : ignoring job
Fri 17 Jan 2014 07:50:37 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 07:50:37 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 07:50:37 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:50:37 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:50:39 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:50:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865467
Fri 17 Jan 2014 07:50:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:50:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43865467
Fri 17 Jan 2014 07:50:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:50:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:50:48 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:50:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:50:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:50:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:50:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:50:50 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:50:50 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:50:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:50:50 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:50:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:50:52 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:50:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:50:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:50:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:50:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:50:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:50:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:50:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:50:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:50:54 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:50:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 07:50:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:50:55 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:50:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43869810
Fri 17 Jan 2014 07:50:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:50:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43869810
Fri 17 Jan 2014 07:50:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:50:57 - job_xml_thread(): Done retrieving: data size 43869810
Fri 17 Jan 2014 07:50:57 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:50:57 - XML: Start document: iteration 11
Fri 17 Jan 2014 07:51:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:51:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:51:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:51:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:51:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:51:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:51:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:51:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:51:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:51:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:51:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:51:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:51:10 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:51:15 - XML: Processed 655450 elements - found 626 jobs
Fri 17 Jan 2014 07:51:16 - job 7347561 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 07:51:16 - job 7347560 report time 1389941331 does not match current heartbeat 1389941400 : ignoring job
Fri 17 Jan 2014 07:51:16 - job 7347557 report time 1389941210 does not match current heartbeat 1389941400 : ignoring job
Fri 17 Jan 2014 07:51:16 - job 7347558 report time 1389941279 does not match current heartbeat 1389941400 : ignoring job
Fri 17 Jan 2014 07:51:16 - job 7347559 field 'start_timestamp' changed since saved from: 1389941346 to: 1389941306
Fri 17 Jan 2014 07:51:16 - job 7347501 appears to have finished
Fri 17 Jan 2014 07:51:16 - job_xml_thread(): Found 7 updated jobs.
Fri 17 Jan 2014 07:51:16 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 07:51:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:51:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:51:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:51:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:51:17 - job_xml_thread(): Done storing. succesfully stored: 7 jobs
Fri 17 Jan 2014 07:51:17 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:51:17 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:51:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:51:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:51:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:51:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:51:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:51:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43854062
Fri 17 Jan 2014 07:51:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:51:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43854062
Fri 17 Jan 2014 07:51:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:51:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:51:22 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:51:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:51:23 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:51:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 07:51:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 07:51:23 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:51:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8879 values 140043 bits 17505 bytes 
Fri 17 Jan 2014 07:51:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:51:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:51:32 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:51:32 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:51:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:51:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:51:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:51:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:51:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:51:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:51:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:51:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:51:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:51:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:51:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:51:35 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:51:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:51:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:51:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:51:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:51:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:51:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:51:37 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:51:37 - job_xml_thread(): Done retrieving: data size 43855505
Fri 17 Jan 2014 07:51:37 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:51:37 - XML: Start document: iteration 12
Fri 17 Jan 2014 07:51:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855505
Fri 17 Jan 2014 07:51:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:51:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855505
Fri 17 Jan 2014 07:51:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:51:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:51:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:51:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:51:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:51:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:51:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:51:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:51:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:51:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:51:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:51:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:51:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:51:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:51:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:51:59 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:51:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:51:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:52:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:52:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:52:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:52:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:52:01 - XML: Processed 655452 elements - found 627 jobs
Fri 17 Jan 2014 07:52:01 - job 7347565 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 07:52:01 - job 7347564 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 07:52:01 - job 7347563 report time 1389941400 does not match current heartbeat 1389941452 : ignoring job
Fri 17 Jan 2014 07:52:01 - job 7347560 report time 1389941331 does not match current heartbeat 1389941452 : ignoring job
Fri 17 Jan 2014 07:52:01 - job 7347558 report time 1389941279 does not match current heartbeat 1389941452 : ignoring job
Fri 17 Jan 2014 07:52:01 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 07:52:01 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 07:52:01 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 07:52:01 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:52:01 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:52:01 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:52:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 07:52:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:52:03 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:52:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870297
Fri 17 Jan 2014 07:52:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:52:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870297
Fri 17 Jan 2014 07:52:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:52:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:52:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:52:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:52:14 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:52:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:52:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:52:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:52:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:52:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:52:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:52:15 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:52:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:52:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:52:16 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:52:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:52:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:52:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:52:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:52:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:52:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:52:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:52:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:52:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:52:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43872727
Fri 17 Jan 2014 07:52:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:52:19 - job_xml_thread(): Done retrieving: data size 43872727
Fri 17 Jan 2014 07:52:19 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:52:19 - XML: Start document: iteration 13
Fri 17 Jan 2014 07:52:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43872727
Fri 17 Jan 2014 07:52:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:52:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:52:23 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:52:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:52:24 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:52:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 07:52:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 07:52:24 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:52:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8483 values 133811 bits 16726 bytes 
Fri 17 Jan 2014 07:52:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:52:29 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:52:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:52:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:52:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:52:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:52:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:52:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:52:31 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:52:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:52:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:52:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:52:36 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:52:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:52:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:52:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:52:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:52:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:52:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:52:39 - XML: Processed 655452 elements - found 627 jobs
Fri 17 Jan 2014 07:52:39 - job 7347563 report time 1389941400 does not match current heartbeat 1389941452 : ignoring job
Fri 17 Jan 2014 07:52:39 - job 7347560 report time 1389941331 does not match current heartbeat 1389941452 : ignoring job
Fri 17 Jan 2014 07:52:39 - job 7347558 report time 1389941279 does not match current heartbeat 1389941452 : ignoring job
Fri 17 Jan 2014 07:52:39 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 07:52:39 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 07:52:39 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:52:39 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:52:41 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:52:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855751
Fri 17 Jan 2014 07:52:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:52:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855751
Fri 17 Jan 2014 07:52:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:52:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:52:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:52:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:52:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:52:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:52:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:52:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:52:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:52:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:52:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:52:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:52:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:52:53 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:52:54 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:52:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:52:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:52:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:52:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:52:56 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:52:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 07:52:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:52:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:52:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:52:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:52:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:52:57 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:52:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43872697
Fri 17 Jan 2014 07:52:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:52:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43872697
Fri 17 Jan 2014 07:52:58 - job_xml_thread(): Done retrieving: data size 43872697
Fri 17 Jan 2014 07:52:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:52:58 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:52:58 - XML: Start document: iteration 14
Fri 17 Jan 2014 07:53:06 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 07:53:06 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:53:08 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:53:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:53:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:53:08 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:53:08 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 07:53:08 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 07:53:08 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 07:53:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:53:09 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:53:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:53:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:53:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:53:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:53:10 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:53:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:53:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Fri 17 Jan 2014 07:53:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:53:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:53:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:53:20 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:53:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:53:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:53:20 - XML: Processed 655450 elements - found 626 jobs
Fri 17 Jan 2014 07:53:20 - job 7347566 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 07:53:20 - job 7347565 field 'start_timestamp' changed since saved from: 1389941493 to: 1389941428
Fri 17 Jan 2014 07:53:20 - job 7347564 field 'start_timestamp' changed since saved from: 1389941491 to: 1389941428
Fri 17 Jan 2014 07:53:20 - job 7347563 report time 1389941400 does not match current heartbeat 1389941520 : ignoring job
Fri 17 Jan 2014 07:53:20 - job 7347560 report time 1389941331 does not match current heartbeat 1389941520 : ignoring job
Fri 17 Jan 2014 07:53:20 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 07:53:20 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 07:53:20 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 07:53:20 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:53:20 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:53:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:53:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:53:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:53:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:53:22 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:53:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43765520
Fri 17 Jan 2014 07:53:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:53:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43765520
Fri 17 Jan 2014 07:53:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:53:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:53:25 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:53:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:53:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:53:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:53:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 07:53:26 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:53:26 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:53:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 07:53:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8891 values 140244 bits 17530 bytes 
Fri 17 Jan 2014 07:53:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:53:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:53:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:53:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:53:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:53:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:53:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:53:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:53:35 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:53:36 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:53:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:53:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:53:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:53:36 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:53:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:53:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:53:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:53:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:53:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:53:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:53:39 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:53:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 07:53:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:53:39 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:53:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43303723
Fri 17 Jan 2014 07:53:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:53:40 - job_xml_thread(): Done retrieving: data size 43303723
Fri 17 Jan 2014 07:53:40 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:53:40 - XML: Start document: iteration 15
Fri 17 Jan 2014 07:53:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43303723
Fri 17 Jan 2014 07:53:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:53:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:53:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:53:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:53:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:53:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:53:58 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:53:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:53:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:53:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:53:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:53:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:53:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:53:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:54:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:54:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:54:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:54:03 - XML: Processed 648496 elements - found 623 jobs
Fri 17 Jan 2014 07:54:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:54:03 - job 7347563 report time 1389941400 does not match current heartbeat 1389941572 : ignoring job
Fri 17 Jan 2014 07:54:03 - job 7345990 appears to have finished
Fri 17 Jan 2014 07:54:03 - job 7347532 appears to have finished
Fri 17 Jan 2014 07:54:03 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 07:54:03 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 07:54:03 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 07:54:03 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:54:03 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:54:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:54:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:54:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:54:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:54:04 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:54:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43188192
Fri 17 Jan 2014 07:54:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:54:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43188192
Fri 17 Jan 2014 07:54:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:54:08 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:54:08 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:54:09 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:54:09 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:54:10 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 07:54:10 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 07:54:10 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 07:54:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:54:13 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:54:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:54:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:54:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:54:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:54:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:54:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:54:15 - XMLGatherer.retrieveData(): actually retrieving data..
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Fri 17 Jan 2014 07:54:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:54:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:54:18 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:54:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:54:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:54:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:54:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:54:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:54:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:54:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:54:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43251976
Fri 17 Jan 2014 07:54:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:54:20 - job_xml_thread(): Done retrieving: data size 43251976
Fri 17 Jan 2014 07:54:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43251976
Fri 17 Jan 2014 07:54:20 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:54:20 - XML: Start document: iteration 16
Fri 17 Jan 2014 07:54:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:54:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:54:26 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:54:29 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:54:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 07:54:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:54:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 07:54:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:54:30 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:54:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148555 bits 18569 bytes 
Fri 17 Jan 2014 07:54:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:54:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:54:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:54:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:54:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:54:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:54:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:54:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:54:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:54:34 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:54:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:54:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:54:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:54:38 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:54:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:54:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:54:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:54:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:54:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:54:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:54:41 - XML: Processed 647914 elements - found 623 jobs
Fri 17 Jan 2014 07:54:41 - job 7347563 report time 1389941400 does not match current heartbeat 1389941572 : ignoring job
Fri 17 Jan 2014 07:54:41 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 07:54:41 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 07:54:41 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:54:41 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:54:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:54:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43752631
Fri 17 Jan 2014 07:54:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:54:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43752631
Fri 17 Jan 2014 07:54:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:54:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:54:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:54:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:54:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:54:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:54:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:54:53 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:54:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:54:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:54:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:54:53 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:54:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:54:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:54:56 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:54:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:54:57 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:54:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:54:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:54:58 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:54:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 07:54:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:54:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:54:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:54:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:54:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:54:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:54:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43848359
Fri 17 Jan 2014 07:54:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:55:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43848359
Fri 17 Jan 2014 07:55:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:55:01 - job_xml_thread(): Done retrieving: data size 43848359
Fri 17 Jan 2014 07:55:01 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:55:01 - XML: Start document: iteration 17
Fri 17 Jan 2014 07:55:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:55:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:55:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:55:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:55:10 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:55:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:55:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:55:10 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:55:11 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:55:11 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 07:55:11 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:55:11 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 07:55:11 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 07:55:11 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:55:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:55:12 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:55:12 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:55:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:55:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:55:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:55:22 - XML: Processed 655210 elements - found 622 jobs
Fri 17 Jan 2014 07:55:22 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 07:55:22 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 07:55:23 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:55:23 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:55:23 - size of cluster 'LISA Cluster': 624 hosts 79485 metrics 1040147 values 16412074 bits 2051509 bytes 
Fri 17 Jan 2014 07:55:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:55:23 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:55:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:55:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:55:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:55:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:55:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:55:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:55:27 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:55:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43824824
Fri 17 Jan 2014 07:55:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:55:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:55:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:55:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43824824
Fri 17 Jan 2014 07:55:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:55:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:55:30 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:55:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:55:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 07:55:31 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:55:31 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:55:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 07:55:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8964 values 141392 bits 17674 bytes 
Fri 17 Jan 2014 07:55:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:55:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:55:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:55:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:55:37 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:55:37 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:55:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:55:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:55:37 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:55:38 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:55:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:55:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:55:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:55:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:55:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:55:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:55:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:55:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:55:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:55:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:55:47 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:55:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43859952
Fri 17 Jan 2014 07:55:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:55:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43859952
Fri 17 Jan 2014 07:55:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:55:48 - job_xml_thread(): Done retrieving: data size 43859952
Fri 17 Jan 2014 07:55:48 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:55:48 - XML: Start document: iteration 18
Fri 17 Jan 2014 07:55:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:55:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:55:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:55:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:56:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:56:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:56:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:56:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:56:04 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:56:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:56:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:56:04 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:56:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:56:09 - XML: Processed 655444 elements - found 623 jobs
Fri 17 Jan 2014 07:56:09 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 07:56:09 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 07:56:10 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 07:56:10 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:56:10 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:56:10 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:56:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 07:56:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:56:11 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:56:11 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 07:56:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:56:12 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:56:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:56:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:56:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:56:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:56:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:56:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:56:16 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:56:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851396
Fri 17 Jan 2014 07:56:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:56:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851396
Fri 17 Jan 2014 07:56:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:56:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:56:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:56:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:56:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:56:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:56:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:56:25 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:56:25 - job_xml_thread(): Done retrieving: data size 43851396
Fri 17 Jan 2014 07:56:25 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:56:25 - XML: Start document: iteration 19
Fri 17 Jan 2014 07:56:25 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:56:25 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:56:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:56:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:56:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851396
Fri 17 Jan 2014 07:56:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:56:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:56:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:56:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:56:31 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:56:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:56:32 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:56:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 07:56:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 07:56:32 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:56:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6107 values 96306 bits 12038 bytes 
Fri 17 Jan 2014 07:56:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:56:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:56:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:56:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:56:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:56:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:56:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:56:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:56:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:56:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:56:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:56:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:56:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:56:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:56:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:56:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:56:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:56:45 - XML: Processed 655444 elements - found 623 jobs
Fri 17 Jan 2014 07:56:45 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 07:56:45 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 07:56:45 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:56:45 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:56:46 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 07:56:47 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 07:56:47 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:56:48 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:56:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43864415
Fri 17 Jan 2014 07:56:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:56:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43864415
Fri 17 Jan 2014 07:56:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:56:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:56:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:56:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:56:58 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:56:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:56:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:56:59 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:56:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:56:59 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:56:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:56:59 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:56:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:56:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:57:00 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:57:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:57:03 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:57:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:57:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:57:03 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:57:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 07:57:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:57:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:57:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:57:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:57:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:57:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:57:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856971
Fri 17 Jan 2014 07:57:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:57:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43856971
Fri 17 Jan 2014 07:57:06 - job_xml_thread(): Done retrieving: data size 43856971
Fri 17 Jan 2014 07:57:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:57:06 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:57:06 - XML: Start document: iteration 20
Fri 17 Jan 2014 07:57:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:57:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:57:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:57:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:57:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:57:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:57:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:57:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:57:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:57:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:57:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:57:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:57:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:57:24 - XML: Processed 655448 elements - found 625 jobs
Fri 17 Jan 2014 07:57:24 - job 7347568 field 'start_timestamp' changed since saved from: 1389941724 to: 1389941688
Fri 17 Jan 2014 07:57:24 - job 7347567 report time 1389941693 does not match current heartbeat 1389941762 : ignoring job
Fri 17 Jan 2014 07:57:24 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 07:57:24 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 07:57:26 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 07:57:26 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:57:26 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:57:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:57:27 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:57:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:57:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:57:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:57:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:57:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:57:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:57:29 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:57:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43880281
Fri 17 Jan 2014 07:57:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:57:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43880281
Fri 17 Jan 2014 07:57:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:57:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:57:33 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:57:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:57:35 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:57:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 07:57:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 07:57:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:57:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:57:36 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:57:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9120 values 143858 bits 17982 bytes 
Fri 17 Jan 2014 07:57:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:57:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:57:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:57:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:57:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:57:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:57:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:57:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:57:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:57:41 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:57:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:57:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:57:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:57:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:57:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:57:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:57:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:57:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:57:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:57:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:57:46 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:57:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43880497
Fri 17 Jan 2014 07:57:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:57:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43880497
Fri 17 Jan 2014 07:57:47 - job_xml_thread(): Done retrieving: data size 43880497
Fri 17 Jan 2014 07:57:47 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:57:47 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 07:57:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:57:47 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 07:57:47 - Housekeeping: done.
Fri 17 Jan 2014 07:57:47 - XML: Start document: iteration 0
Fri 17 Jan 2014 07:57:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:57:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:57:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:57:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:58:04 - XML: Processed 655452 elements - found 627 jobs
Fri 17 Jan 2014 07:58:04 - job 7347567 report time 1389941693 does not match current heartbeat 1389941813 : ignoring job
Fri 17 Jan 2014 07:58:04 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 07:58:04 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 07:58:05 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 07:58:05 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:58:05 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:58:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:58:06 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:58:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:58:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:58:07 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:58:07 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:58:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:58:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:58:07 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:58:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:58:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:58:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:58:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:58:10 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:58:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 07:58:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:58:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:58:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:58:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:58:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:58:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:58:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43882035
Fri 17 Jan 2014 07:58:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:58:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43882035
Fri 17 Jan 2014 07:58:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:58:21 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:58:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:58:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:58:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:58:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:58:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:58:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:58:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:58:25 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:58:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:58:25 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:58:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:58:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:58:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:58:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:58:26 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:58:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:58:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:58:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:58:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:58:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:58:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:58:28 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:58:28 - job_xml_thread(): Done retrieving: data size 43883295
Fri 17 Jan 2014 07:58:28 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:58:28 - XML: Start document: iteration 1
Fri 17 Jan 2014 07:58:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43883295
Fri 17 Jan 2014 07:58:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:58:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43883295
Fri 17 Jan 2014 07:58:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:58:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:58:36 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:58:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:58:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 07:58:36 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:58:36 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:58:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 07:58:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8737 values 137754 bits 17219 bytes 
Fri 17 Jan 2014 07:58:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:58:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:58:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:58:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:58:43 - XML: Processed 655449 elements - found 627 jobs
Fri 17 Jan 2014 07:58:43 - job 7347567 report time 1389941693 does not match current heartbeat 1389941813 : ignoring job
Fri 17 Jan 2014 07:58:43 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 07:58:43 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 07:58:43 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:58:43 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:58:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:58:46 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:58:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:58:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:58:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:58:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:58:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:58:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:58:48 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:58:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:58:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:58:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:58:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:58:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:58:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:58:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:58:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:58:52 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:58:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 07:58:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:58:53 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:58:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867515
Fri 17 Jan 2014 07:58:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:58:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43867515
Fri 17 Jan 2014 07:58:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:58:58 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:58:58 - job_xml_thread(): Done retrieving: data size 43867515
Fri 17 Jan 2014 07:58:58 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:58:58 - XML: Start document: iteration 2
Fri 17 Jan 2014 07:59:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:59:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:59:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:59:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:59:04 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:59:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:59:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:59:04 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:59:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:59:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:59:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:59:13 - XML: Processed 655447 elements - found 626 jobs
Fri 17 Jan 2014 07:59:13 - job 7347569 field 'start_timestamp' changed since saved from: 1389941816 to: 1389941748
Fri 17 Jan 2014 07:59:13 - job 7347567 report time 1389941693 does not match current heartbeat 1389941882 : ignoring job
Fri 17 Jan 2014 07:59:13 - job 7347570 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 07:59:13 - job 7347534 appears to have finished
Fri 17 Jan 2014 07:59:13 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 07:59:13 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 07:59:14 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 07:59:14 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:59:14 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:59:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:59:15 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:59:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:59:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:59:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:59:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:59:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:59:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:59:16 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:59:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43780749
Fri 17 Jan 2014 07:59:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:59:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43780749
Fri 17 Jan 2014 07:59:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:59:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:59:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:59:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:59:27 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:59:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:59:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:59:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:59:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:59:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:59:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:59:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:59:29 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 07:59:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:59:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:59:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:59:31 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:59:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:59:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:59:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:59:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:59:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:59:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:59:33 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:59:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43356393
Fri 17 Jan 2014 07:59:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:59:33 - job_xml_thread(): Done retrieving: data size 43356393
Fri 17 Jan 2014 07:59:33 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 07:59:33 - XML: Start document: iteration 3
Fri 17 Jan 2014 07:59:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43356393
Fri 17 Jan 2014 07:59:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 07:59:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:59:36 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:59:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:59:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 07:59:37 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 07:59:37 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:59:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 07:59:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9279 values 146334 bits 18291 bytes 
Fri 17 Jan 2014 07:59:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 07:59:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:59:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 07:59:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 07:59:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 07:59:49 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 07:59:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 07:59:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 07:59:50 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:59:50 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 07:59:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 07:59:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 07:59:50 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 07:59:54 - XML: Processed 649346 elements - found 626 jobs
Fri 17 Jan 2014 07:59:54 - job 7347502 appears to have finished
Fri 17 Jan 2014 07:59:54 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 07:59:54 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 07:59:54 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 07:59:54 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 07:59:54 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 07:59:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 07:59:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 07:59:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 07:59:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 07:59:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:59:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 07:59:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 07:59:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 07:59:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 07:59:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43203387
Fri 17 Jan 2014 07:59:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 07:59:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43203387
Fri 17 Jan 2014 07:59:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:00:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:00:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:00:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:00:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:00:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:00:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:00:08 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:00:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:00:08 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:00:08 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:00:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:00:09 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:00:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:00:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:00:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:00:13 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:00:13 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:00:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 08:00:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:00:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:00:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:00:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:00:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:00:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:00:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:00:15 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:00:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43201874
Fri 17 Jan 2014 08:00:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:00:15 - job_xml_thread(): Done retrieving: data size 43201874
Fri 17 Jan 2014 08:00:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43201874
Fri 17 Jan 2014 08:00:16 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:00:16 - XML: Start document: iteration 4
Fri 17 Jan 2014 08:00:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:00:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:00:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:00:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:00:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:00:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:00:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:00:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:00:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:00:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:00:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:00:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:00:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:00:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:00:35 - XML: Processed 647324 elements - found 626 jobs
Fri 17 Jan 2014 08:00:35 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 08:00:35 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 08:00:35 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:00:36 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:00:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:00:37 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:00:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:00:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:00:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:00:37 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:00:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:00:38 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:00:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 08:00:38 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:00:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5833 values 92001 bits 11500 bytes 
Fri 17 Jan 2014 08:00:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 08:00:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:00:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:00:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:00:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:00:39 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:00:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43722321
Fri 17 Jan 2014 08:00:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:00:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43722321
Fri 17 Jan 2014 08:00:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:00:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:00:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:00:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:00:48 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:00:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:00:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:00:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:00:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:00:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:00:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:00:50 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:00:51 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:00:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:00:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:00:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:00:53 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:00:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:00:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:00:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:00:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:00:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:00:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:00:54 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:00:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 08:00:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:00:55 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:00:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43838067
Fri 17 Jan 2014 08:00:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:00:56 - job_xml_thread(): Done retrieving: data size 43838067
Fri 17 Jan 2014 08:00:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43838067
Fri 17 Jan 2014 08:00:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:00:56 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:00:56 - XML: Start document: iteration 5
Fri 17 Jan 2014 08:01:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:01:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:01:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:01:09 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:01:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:01:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:01:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:01:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:01:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:01:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:01:10 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:01:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:01:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:01:17 - XML: Processed 655150 elements - found 626 jobs
Fri 17 Jan 2014 08:01:17 - job 7347574 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 08:01:17 - job 7347573 report time 1389941934 does not match current heartbeat 1389942003 : ignoring job
Fri 17 Jan 2014 08:01:17 - job 7347523 appears to have finished
Fri 17 Jan 2014 08:01:17 - job 7347538 appears to have finished
Fri 17 Jan 2014 08:01:17 - job_xml_thread(): Found 5 updated jobs.
Fri 17 Jan 2014 08:01:17 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 08:01:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:01:19 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:01:19 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Fri 17 Jan 2014 08:01:19 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:01:19 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:01:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:01:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:01:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:01:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:01:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:01:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:01:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:01:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43830975
Fri 17 Jan 2014 08:01:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:01:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43830975
Fri 17 Jan 2014 08:01:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:01:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:01:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:01:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:01:29 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:01:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:01:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:01:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:01:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:01:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:01:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:01:31 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:01:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:01:34 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:01:34 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:01:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:01:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:01:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:01:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:01:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:01:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:01:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:01:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43846590
Fri 17 Jan 2014 08:01:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:01:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43846590
Fri 17 Jan 2014 08:01:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:01:37 - job_xml_thread(): Done retrieving: data size 43846590
Fri 17 Jan 2014 08:01:37 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:01:38 - XML: Start document: iteration 6
Fri 17 Jan 2014 08:01:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:01:38 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:01:39 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:01:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:01:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 08:01:39 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:01:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 11038 values 174326 bits 21790 bytes 
Fri 17 Jan 2014 08:01:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 08:01:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:01:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:01:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:01:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:01:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:01:54 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:01:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:01:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:01:56 - XML: Processed 655454 elements - found 628 jobs
Fri 17 Jan 2014 08:01:56 - job 7347574 field 'start_timestamp' changed since saved from: 1389942006 to: 1389941941
Fri 17 Jan 2014 08:01:56 - job 7347575 field 'start_timestamp' changed since saved from: 1389942008 to: 1389941941
Fri 17 Jan 2014 08:01:56 - job 7347573 report time 1389941934 does not match current heartbeat 1389942055 : ignoring job
Fri 17 Jan 2014 08:01:57 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 08:01:57 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 08:01:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:01:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:01:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:01:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:01:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:01:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:01:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:01:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:01:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:01:58 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 08:01:58 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:01:58 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:01:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:01:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:01:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:01:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:02:01 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:02:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43882598
Fri 17 Jan 2014 08:02:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:02:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43882598
Fri 17 Jan 2014 08:02:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:02:11 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 08:02:11 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:02:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:02:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:02:12 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:02:12 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:02:12 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 08:02:12 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 08:02:12 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 08:02:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:02:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:02:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:02:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:02:13 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:02:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:02:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:02:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:02:14 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:02:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:02:14 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:02:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:02:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:02:17 - size of cluster 'LISA Cluster': 624 hosts 79484 metrics 1036005 values 16354205 bits 2044275 bytes 
Fri 17 Jan 2014 08:02:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:02:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:02:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:02:18 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:02:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 08:02:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:02:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:02:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:02:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:02:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:02:21 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:02:21 - job_xml_thread(): Done retrieving: data size 43850501
Fri 17 Jan 2014 08:02:21 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:02:21 - XML: Start document: iteration 7
Fri 17 Jan 2014 08:02:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43850501
Fri 17 Jan 2014 08:02:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:02:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43850501
Fri 17 Jan 2014 08:02:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:02:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:02:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:02:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:02:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:02:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:02:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:02:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:02:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:02:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:02:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:02:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:02:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:02:40 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:02:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:02:41 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:02:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:02:41 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:02:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 08:02:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 08:02:41 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:02:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5996 values 94824 bits 11853 bytes 
Fri 17 Jan 2014 08:02:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:02:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:02:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:02:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:02:45 - XML: Processed 655449 elements - found 628 jobs
Fri 17 Jan 2014 08:02:45 - job 7347573 report time 1389941934 does not match current heartbeat 1389942055 : ignoring job
Fri 17 Jan 2014 08:02:45 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 08:02:45 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 08:02:45 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:02:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:02:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:02:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:02:45 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:02:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:02:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:02:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43861219
Fri 17 Jan 2014 08:02:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:02:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43861219
Fri 17 Jan 2014 08:02:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:02:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:02:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:02:56 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:02:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 08:02:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:02:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:02:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:02:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:02:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:03:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:03:00 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:03:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:03:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:03:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:03:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:03:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:03:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:03:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:03:03 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:03:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:03:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:03:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:03:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:03:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:03:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:03:07 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:03:07 - job_xml_thread(): Done retrieving: data size 43847735
Fri 17 Jan 2014 08:03:07 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:03:07 - XML: Start document: iteration 8
Fri 17 Jan 2014 08:03:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43847735
Fri 17 Jan 2014 08:03:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:03:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43847735
Fri 17 Jan 2014 08:03:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:03:12 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:03:12 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 08:03:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:03:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:03:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:03:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:03:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:03:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:03:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:03:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:03:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:03:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:03:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:03:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:03:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:03:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:03:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:03:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:03:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:03:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:03:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:03:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:03:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:03:30 - XML: Processed 655452 elements - found 627 jobs
Fri 17 Jan 2014 08:03:30 - job 7347578 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 08:03:30 - job 7347570 appears to have finished
Fri 17 Jan 2014 08:03:30 - job 7347573 report time 1389941934 does not match current heartbeat 1389942123 : ignoring job
Fri 17 Jan 2014 08:03:30 - job 7347436 appears to have finished
Fri 17 Jan 2014 08:03:30 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 08:03:30 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 08:03:30 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 08:03:30 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:03:30 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:03:34 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:03:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853038
Fri 17 Jan 2014 08:03:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:03:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853038
Fri 17 Jan 2014 08:03:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:03:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:03:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:03:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:03:42 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:03:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:03:42 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:03:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:03:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:03:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:03:43 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:03:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 08:03:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 08:03:43 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:03:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9080 values 143525 bits 17940 bytes 
Fri 17 Jan 2014 08:03:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:03:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:03:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:03:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:03:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853038
Fri 17 Jan 2014 08:03:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:03:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:03:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:03:45 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:03:45 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:03:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:03:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:03:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:03:57 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:03:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:03:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:03:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:03:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:03:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:03:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:03:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:03:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:03:59 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:03:59 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:03:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:03:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:04:01 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:04:01 - job_xml_thread(): Done retrieving: data size 43846729
Fri 17 Jan 2014 08:04:01 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:04:01 - XML: Start document: iteration 9
Fri 17 Jan 2014 08:04:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43846729
Fri 17 Jan 2014 08:04:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:04:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43846729
Fri 17 Jan 2014 08:04:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:04:12 - XML: Processed 655456 elements - found 629 jobs
Fri 17 Jan 2014 08:04:12 - job 7347579 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 08:04:13 - job 7347577 report time 1389942123 does not match current heartbeat 1389942175 : ignoring job
Fri 17 Jan 2014 08:04:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:04:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:04:13 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 08:04:13 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 08:04:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:04:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:04:15 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 08:04:15 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:04:15 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:04:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:04:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:04:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:04:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:04:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:04:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:04:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:04:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:04:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:04:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:04:24 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:04:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:04:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:04:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:04:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:04:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:04:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:04:25 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:04:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 08:04:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:04:27 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:04:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43874604
Fri 17 Jan 2014 08:04:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:04:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43874604
Fri 17 Jan 2014 08:04:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:04:30 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:04:30 - job_xml_thread(): Done retrieving: data size 43874604
Fri 17 Jan 2014 08:04:30 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:04:30 - XML: Start document: iteration 10
Fri 17 Jan 2014 08:04:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:04:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:04:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:04:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:04:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:04:44 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:04:45 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:04:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 08:04:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:04:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 08:04:46 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:04:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5471 values 86334 bits 10791 bytes 
Fri 17 Jan 2014 08:04:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:04:50 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:04:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:04:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:04:50 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:04:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:04:50 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:04:50 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:04:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:04:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:04:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:04:51 - XML: Processed 655456 elements - found 629 jobs
Fri 17 Jan 2014 08:04:51 - job 7347577 report time 1389942123 does not match current heartbeat 1389942175 : ignoring job
Fri 17 Jan 2014 08:04:51 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 08:04:51 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 08:04:51 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:04:51 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:04:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:04:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:04:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:04:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:04:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:04:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:04:56 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:04:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873485
Fri 17 Jan 2014 08:04:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:04:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873485
Fri 17 Jan 2014 08:04:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:05:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:05:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:05:06 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:05:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:05:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:05:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:05:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:05:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:05:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:05:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:05:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:05:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:05:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:05:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:05:11 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:05:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 08:05:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:05:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:05:12 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:05:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:05:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:05:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:05:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:05:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:05:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:05:15 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:05:15 - job_xml_thread(): Done retrieving: data size 43803344
Fri 17 Jan 2014 08:05:15 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:05:15 - XML: Start document: iteration 11
Fri 17 Jan 2014 08:05:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43803344
Fri 17 Jan 2014 08:05:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:05:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43803344
Fri 17 Jan 2014 08:05:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:05:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:05:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:05:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:05:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:05:32 - XML: Processed 654706 elements - found 628 jobs
Fri 17 Jan 2014 08:05:32 - job 7347441 appears to have finished
Fri 17 Jan 2014 08:05:32 - job 7347576 appears to have finished
Fri 17 Jan 2014 08:05:32 - job 7347577 report time 1389942123 does not match current heartbeat 1389942244 : ignoring job
Fri 17 Jan 2014 08:05:32 - job 7347581 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 08:05:32 - job 7347580 report time 1389942175 does not match current heartbeat 1389942244 : ignoring job
Fri 17 Jan 2014 08:05:32 - job 7347582 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 08:05:32 - job_xml_thread(): Found 5 updated jobs.
Fri 17 Jan 2014 08:05:32 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 08:05:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:05:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:05:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:05:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:05:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:05:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:05:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:05:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:05:34 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:05:35 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Fri 17 Jan 2014 08:05:35 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:05:35 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:05:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:05:36 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:05:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:05:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:05:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:05:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:05:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:05:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:05:39 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:05:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43309754
Fri 17 Jan 2014 08:05:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:05:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43309754
Fri 17 Jan 2014 08:05:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:05:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:05:46 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:05:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:05:47 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:05:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 08:05:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 08:05:48 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:05:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9174 values 144803 bits 18100 bytes 
Fri 17 Jan 2014 08:05:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:05:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:05:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:05:50 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:05:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:05:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:05:51 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:05:51 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:05:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:05:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:05:51 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:05:51 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:05:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:05:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:05:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:05:55 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:05:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:05:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:05:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:05:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:05:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:05:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:05:57 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 08:05:57 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 08:05:57 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:05:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:05:58 - job_xml_thread(): Done retrieving: data size 43222983
Fri 17 Jan 2014 08:05:58 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:05:58 - XML: Start document: iteration 12
Fri 17 Jan 2014 08:05:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43222983
Fri 17 Jan 2014 08:05:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43222983
Fri 17 Jan 2014 08:05:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:05:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:06:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:06:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:06:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:06:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:06:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:06:14 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:06:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:06:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:06:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:06:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:06:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:06:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:06:15 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:06:20 - XML: Processed 647436 elements - found 629 jobs
Fri 17 Jan 2014 08:06:20 - job 7347577 report time 1389942123 does not match current heartbeat 1389942296 : ignoring job
Fri 17 Jan 2014 08:06:20 - job 7347580 report time 1389942175 does not match current heartbeat 1389942296 : ignoring job
Fri 17 Jan 2014 08:06:20 - job 7347583 report time 1389942244 does not match current heartbeat 1389942296 : ignoring job
Fri 17 Jan 2014 08:06:20 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 08:06:20 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 08:06:20 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 08:06:20 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:06:20 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:06:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:06:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:06:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:06:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:06:23 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:06:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 08:06:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:06:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:06:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:06:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:06:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:06:24 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:06:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43251171
Fri 17 Jan 2014 08:06:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:06:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43251171
Fri 17 Jan 2014 08:06:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:06:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:06:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:06:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:06:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:06:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:06:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:06:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:06:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:06:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:06:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:06:34 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:06:35 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:06:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:06:37 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:06:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:06:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:06:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:06:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:06:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:06:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:06:38 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:06:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43751143
Fri 17 Jan 2014 08:06:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:06:39 - job_xml_thread(): Done retrieving: data size 43751143
Fri 17 Jan 2014 08:06:39 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:06:39 - XML: Start document: iteration 13
Fri 17 Jan 2014 08:06:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43751143
Fri 17 Jan 2014 08:06:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:06:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:06:48 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:06:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:06:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 08:06:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:06:49 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:06:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:06:49 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:06:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8869 values 139954 bits 17494 bytes 
Fri 17 Jan 2014 08:06:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 08:06:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:06:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:06:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:06:56 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:06:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:06:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:06:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:06:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:06:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:06:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:06:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:07:00 - XML: Processed 654048 elements - found 627 jobs
Fri 17 Jan 2014 08:07:00 - job 7343935 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 08:07:00 - job 7347584 report time 1389942296 does not match current heartbeat 1389942365 : ignoring job
Fri 17 Jan 2014 08:07:00 - job 7347580 report time 1389942175 does not match current heartbeat 1389942365 : ignoring job
Fri 17 Jan 2014 08:07:00 - job 7347583 report time 1389942244 does not match current heartbeat 1389942365 : ignoring job
Fri 17 Jan 2014 08:07:00 - job 7347535 appears to have finished
Fri 17 Jan 2014 08:07:00 - job 7347536 appears to have finished
Fri 17 Jan 2014 08:07:00 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 08:07:00 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 08:07:00 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 08:07:00 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:07:00 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:07:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:07:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:07:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:07:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:07:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:07:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:07:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:07:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:07:04 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:07:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43833819
Fri 17 Jan 2014 08:07:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:07:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43833819
Fri 17 Jan 2014 08:07:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:07:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:07:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:07:15 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:07:16 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:07:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:07:16 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:07:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:07:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:07:17 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:07:17 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:07:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:07:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:07:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:07:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:07:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:07:19 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:07:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:07:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:07:20 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:07:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 08:07:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:07:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:07:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:07:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:07:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:07:21 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:07:21 - job_xml_thread(): Done retrieving: data size 43844350
Fri 17 Jan 2014 08:07:21 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:07:21 - XML: Start document: iteration 14
Fri 17 Jan 2014 08:07:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43844350
Fri 17 Jan 2014 08:07:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:07:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43844350
Fri 17 Jan 2014 08:07:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:07:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:07:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:07:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:07:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:07:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:07:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:07:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:07:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:07:40 - XML: Processed 655452 elements - found 627 jobs
Fri 17 Jan 2014 08:07:40 - job 7347584 report time 1389942296 does not match current heartbeat 1389942365 : ignoring job
Fri 17 Jan 2014 08:07:40 - job 7347580 report time 1389942175 does not match current heartbeat 1389942365 : ignoring job
Fri 17 Jan 2014 08:07:40 - job 7347583 report time 1389942244 does not match current heartbeat 1389942365 : ignoring job
Fri 17 Jan 2014 08:07:40 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 08:07:40 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 08:07:40 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:07:40 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:07:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:07:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:07:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:07:40 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:07:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:07:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:07:44 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:07:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:07:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:07:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:07:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:07:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:07:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:07:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:07:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43869124
Fri 17 Jan 2014 08:07:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:07:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43869124
Fri 17 Jan 2014 08:07:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:07:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:07:50 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:07:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:07:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 08:07:52 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:07:53 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:07:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 08:07:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8886 values 140208 bits 17526 bytes 
Fri 17 Jan 2014 08:07:55 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:07:55 - job_xml_thread(): Done retrieving: data size 43869124
Fri 17 Jan 2014 08:07:55 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:07:55 - XML: Start document: iteration 15
Fri 17 Jan 2014 08:07:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:07:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:07:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:07:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:07:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:07:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:07:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:07:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:07:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:07:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:07:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:07:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:07:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:08:06 - XML: Processed 655452 elements - found 627 jobs
Fri 17 Jan 2014 08:08:06 - job 7347585 report time 1389942365 does not match current heartbeat 1389942416 : ignoring job
Fri 17 Jan 2014 08:08:06 - job 7347584 report time 1389942296 does not match current heartbeat 1389942416 : ignoring job
Fri 17 Jan 2014 08:08:06 - job 7347583 report time 1389942244 does not match current heartbeat 1389942416 : ignoring job
Fri 17 Jan 2014 08:08:06 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 08:08:06 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 08:08:06 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 08:08:06 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:08:06 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:08:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:08:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:08:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:08:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:08:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:08:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:08:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:08:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:08:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:08:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43837097
Fri 17 Jan 2014 08:08:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:08:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43837097
Fri 17 Jan 2014 08:08:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:08:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:08:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:08:21 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:08:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:08:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:08:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:08:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:08:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:08:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:08:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:08:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:08:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:08:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:08:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:08:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:08:26 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:08:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:08:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:08:26 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:08:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 08:08:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:08:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:08:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:08:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:08:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:08:28 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:08:28 - job_xml_thread(): Done retrieving: data size 43873976
Fri 17 Jan 2014 08:08:28 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:08:28 - XML: Start document: iteration 16
Fri 17 Jan 2014 08:08:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873976
Fri 17 Jan 2014 08:08:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:08:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873976
Fri 17 Jan 2014 08:08:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:08:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:08:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:08:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:08:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:08:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:08:48 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:08:48 - XML: Processed 655452 elements - found 627 jobs
Fri 17 Jan 2014 08:08:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:08:48 - job 7347585 report time 1389942365 does not match current heartbeat 1389942416 : ignoring job
Fri 17 Jan 2014 08:08:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:08:48 - job 7347584 report time 1389942296 does not match current heartbeat 1389942416 : ignoring job
Fri 17 Jan 2014 08:08:48 - job 7347583 report time 1389942244 does not match current heartbeat 1389942416 : ignoring job
Fri 17 Jan 2014 08:08:48 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 08:08:48 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 08:08:48 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:08:48 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:08:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:08:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:08:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:08:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:08:50 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:08:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:08:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:08:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:08:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:08:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:08:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:08:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:08:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:08:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:08:53 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:08:53 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:08:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 08:08:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:08:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 08:08:53 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:08:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6070 values 95751 bits 11968 bytes 
Fri 17 Jan 2014 08:08:53 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:08:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43874854
Fri 17 Jan 2014 08:08:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:08:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43874854
Fri 17 Jan 2014 08:08:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:09:04 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:09:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:09:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:09:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:09:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:09:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:09:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:09:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:09:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:09:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:09:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:09:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:09:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:09:08 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:09:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:09:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:09:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:09:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:09:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:09:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:09:11 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:09:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 08:09:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:09:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:09:11 - job_xml_thread(): Done retrieving: data size 43864511
Fri 17 Jan 2014 08:09:11 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:09:11 - XML: Start document: iteration 17
Fri 17 Jan 2014 08:09:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43864511
Fri 17 Jan 2014 08:09:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:09:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43864511
Fri 17 Jan 2014 08:09:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:09:13 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 08:09:13 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:09:14 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:09:14 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 08:09:14 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 08:09:14 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:09:14 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 08:09:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:09:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:09:24 - size of cluster 'LISA Cluster': 624 hosts 79461 metrics 737036 values 11628385 bits 1453548 bytes 
Fri 17 Jan 2014 08:09:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:09:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:09:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:09:25 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:09:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:09:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:09:26 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:09:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:09:26 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:09:26 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:09:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:09:31 - XML: Processed 655452 elements - found 627 jobs
Fri 17 Jan 2014 08:09:31 - job 7346308 appears to have finished
Fri 17 Jan 2014 08:09:31 - job 7347585 report time 1389942365 does not match current heartbeat 1389942485 : ignoring job
Fri 17 Jan 2014 08:09:31 - job 7347584 report time 1389942296 does not match current heartbeat 1389942485 : ignoring job
Fri 17 Jan 2014 08:09:31 - job 7347586 report time 1389942416 does not match current heartbeat 1389942485 : ignoring job
Fri 17 Jan 2014 08:09:31 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 08:09:31 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 08:09:32 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 08:09:32 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:09:32 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:09:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:09:36 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:09:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:09:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:09:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:09:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:09:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:09:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:09:39 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:09:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43836122
Fri 17 Jan 2014 08:09:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:09:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43836122
Fri 17 Jan 2014 08:09:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:09:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:09:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:09:47 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:09:47 - job_xml_thread(): Done retrieving: data size 43836122
Fri 17 Jan 2014 08:09:47 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:09:47 - XML: Start document: iteration 18
Fri 17 Jan 2014 08:09:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:09:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:09:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:09:53 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:09:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:09:55 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:09:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 08:09:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 08:09:55 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:09:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6561 values 103497 bits 12937 bytes 
Fri 17 Jan 2014 08:09:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:09:58 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:09:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:09:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:10:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:10:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:10:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:10:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:10:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:10:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:10:01 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:10:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:10:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:10:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:10:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:10:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:10:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:10:03 - XML: Processed 655452 elements - found 627 jobs
Fri 17 Jan 2014 08:10:03 - job 7347585 report time 1389942365 does not match current heartbeat 1389942537 : ignoring job
Fri 17 Jan 2014 08:10:03 - job 7347587 report time 1389942485 does not match current heartbeat 1389942537 : ignoring job
Fri 17 Jan 2014 08:10:03 - job 7347586 report time 1389942416 does not match current heartbeat 1389942537 : ignoring job
Fri 17 Jan 2014 08:10:03 - job 7347588 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 08:10:03 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 08:10:03 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 08:10:03 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 08:10:03 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:10:03 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:10:07 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:10:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856276
Fri 17 Jan 2014 08:10:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:10:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43856276
Fri 17 Jan 2014 08:10:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:10:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:10:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:10:15 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:10:15 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 08:10:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:10:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:10:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:10:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:10:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:10:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:10:18 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:10:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:10:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:10:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:10:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:10:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:10:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:10:23 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:10:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:10:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:10:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:10:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:10:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:10:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:10:23 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:10:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 08:10:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:10:26 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:10:26 - job_xml_thread(): Done retrieving: data size 43865115
Fri 17 Jan 2014 08:10:26 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:10:26 - XML: Start document: iteration 19
Fri 17 Jan 2014 08:10:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43865115
Fri 17 Jan 2014 08:10:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:10:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865115
Fri 17 Jan 2014 08:10:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:10:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:10:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:10:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:10:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:10:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:10:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:10:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:10:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:10:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:10:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:10:43 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:10:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:10:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:10:48 - XML: Processed 655452 elements - found 627 jobs
Fri 17 Jan 2014 08:10:48 - job 7347585 report time 1389942365 does not match current heartbeat 1389942537 : ignoring job
Fri 17 Jan 2014 08:10:48 - job 7347587 report time 1389942485 does not match current heartbeat 1389942537 : ignoring job
Fri 17 Jan 2014 08:10:48 - job 7347586 report time 1389942416 does not match current heartbeat 1389942537 : ignoring job
Fri 17 Jan 2014 08:10:48 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 08:10:48 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 08:10:48 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:10:48 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:10:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:10:49 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:10:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:10:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:10:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:10:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:10:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:10:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:10:51 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:10:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43846938
Fri 17 Jan 2014 08:10:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:10:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43846938
Fri 17 Jan 2014 08:10:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:10:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:10:55 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:10:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:10:56 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:10:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 08:10:56 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:10:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 08:10:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8904 values 140435 bits 17554 bytes 
Fri 17 Jan 2014 08:10:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:10:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:11:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:11:01 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:11:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:11:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:11:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:11:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:11:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:11:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:11:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:11:03 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:11:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:11:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:11:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:11:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:11:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:11:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:11:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:11:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:11:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:11:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:11:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:11:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43861811
Fri 17 Jan 2014 08:11:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:11:12 - job_xml_thread(): Done retrieving: data size 43861811
Fri 17 Jan 2014 08:11:12 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:11:12 - XML: Start document: iteration 20
Fri 17 Jan 2014 08:11:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43861811
Fri 17 Jan 2014 08:11:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:11:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:11:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:11:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:11:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:11:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:11:27 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:11:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:11:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:11:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:11:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:11:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:11:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:11:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:11:31 - XML: Processed 655448 elements - found 628 jobs
Fri 17 Jan 2014 08:11:31 - job 7347587 report time 1389942485 does not match current heartbeat 1389942606 : ignoring job
Fri 17 Jan 2014 08:11:31 - job 7347586 report time 1389942416 does not match current heartbeat 1389942606 : ignoring job
Fri 17 Jan 2014 08:11:31 - job 7347589 report time 1389942537 does not match current heartbeat 1389942606 : ignoring job
Fri 17 Jan 2014 08:11:31 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 08:11:31 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 08:11:32 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 08:11:32 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:11:32 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:11:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:11:34 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:11:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:11:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:11:34 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:11:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 08:11:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:11:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:11:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:11:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:11:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:11:37 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:11:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43363399
Fri 17 Jan 2014 08:11:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:11:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43363399
Fri 17 Jan 2014 08:11:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:11:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:11:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:11:47 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:11:47 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:11:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:11:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:11:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:11:50 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:11:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:11:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:11:51 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:11:51 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:11:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:11:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:11:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:11:52 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:11:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:11:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:11:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:11:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:11:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:11:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:11:55 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 08:11:55 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 08:11:55 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:11:55 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:11:55 - job_xml_thread(): Done retrieving: data size 43211349
Fri 17 Jan 2014 08:11:55 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:11:55 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 08:11:55 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 08:11:55 - Housekeeping: done.
Fri 17 Jan 2014 08:11:55 - XML: Start document: iteration 0
Fri 17 Jan 2014 08:11:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:11:56 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:11:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43211349
Fri 17 Jan 2014 08:11:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:11:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43211349
Fri 17 Jan 2014 08:11:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:11:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:11:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 08:11:57 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:11:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5891 values 92913 bits 11614 bytes 
Fri 17 Jan 2014 08:11:57 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:11:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 08:12:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:12:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:12:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:12:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:12:09 - XML: Processed 647388 elements - found 626 jobs
Fri 17 Jan 2014 08:12:09 - job 7344474 appears to have finished
Fri 17 Jan 2014 08:12:09 - job 7347587 report time 1389942485 does not match current heartbeat 1389942658 : ignoring job
Fri 17 Jan 2014 08:12:09 - job 7347589 report time 1389942537 does not match current heartbeat 1389942658 : ignoring job
Fri 17 Jan 2014 08:12:09 - job 7347539 appears to have finished
Fri 17 Jan 2014 08:12:09 - job 7347590 report time 1389942606 does not match current heartbeat 1389942658 : ignoring job
Fri 17 Jan 2014 08:12:09 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 08:12:09 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 08:12:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:12:16 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:12:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:12:16 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 08:12:16 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:12:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:12:16 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:12:17 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:12:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:12:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:12:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:12:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:12:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:12:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:12:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:12:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:12:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:12:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:12:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:12:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:12:21 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:12:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43265884
Fri 17 Jan 2014 08:12:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:12:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43265884
Fri 17 Jan 2014 08:12:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:12:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:12:29 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:12:31 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:12:31 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:12:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:12:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:12:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:12:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:12:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:12:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:12:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:12:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:12:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:12:34 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:12:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:12:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:12:34 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:12:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 08:12:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:12:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:12:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:12:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:12:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:12:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:12:36 - job_xml_thread(): Done retrieving: data size 43713700
Fri 17 Jan 2014 08:12:36 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:12:36 - XML: Start document: iteration 1
Fri 17 Jan 2014 08:12:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43713700
Fri 17 Jan 2014 08:12:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:12:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43713700
Fri 17 Jan 2014 08:12:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:12:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:12:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:12:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:12:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:12:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:12:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:12:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:12:49 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:12:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:12:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:12:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:12:57 - XML: Processed 653714 elements - found 627 jobs
Fri 17 Jan 2014 08:12:57 - job 7347589 report time 1389942537 does not match current heartbeat 1389942726 : ignoring job
Fri 17 Jan 2014 08:12:57 - job 7347592 report time 1389942658 does not match current heartbeat 1389942726 : ignoring job
Fri 17 Jan 2014 08:12:57 - job 7347590 report time 1389942606 does not match current heartbeat 1389942726 : ignoring job
Fri 17 Jan 2014 08:12:57 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 08:12:57 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 08:12:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:12:57 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:12:58 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 08:12:58 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:12:58 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:12:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:12:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:12:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:12:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 08:12:58 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:12:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 08:12:58 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:12:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5608 values 88449 bits 11056 bytes 
Fri 17 Jan 2014 08:12:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:12:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:12:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:12:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:12:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:12:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:13:01 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:13:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43803015
Fri 17 Jan 2014 08:13:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:13:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43803015
Fri 17 Jan 2014 08:13:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:13:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:13:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:13:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:13:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:13:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:13:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:13:13 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:13:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:13:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:13:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:13:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:13:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:13:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:13:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:13:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:13:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:13:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:13:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:13:17 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:13:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 08:13:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:13:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:13:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:13:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:13:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:13:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:13:18 - job_xml_thread(): Done retrieving: data size 43845842
Fri 17 Jan 2014 08:13:18 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:13:18 - XML: Start document: iteration 2
Fri 17 Jan 2014 08:13:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43845842
Fri 17 Jan 2014 08:13:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:13:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43845842
Fri 17 Jan 2014 08:13:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:13:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:13:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:13:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:13:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:13:36 - XML: Processed 655452 elements - found 627 jobs
Fri 17 Jan 2014 08:13:36 - job 7347589 report time 1389942537 does not match current heartbeat 1389942726 : ignoring job
Fri 17 Jan 2014 08:13:36 - job 7347592 report time 1389942658 does not match current heartbeat 1389942726 : ignoring job
Fri 17 Jan 2014 08:13:36 - job 7347590 report time 1389942606 does not match current heartbeat 1389942726 : ignoring job
Fri 17 Jan 2014 08:13:36 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 08:13:37 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 08:13:37 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:13:37 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:13:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:13:38 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:13:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:13:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:13:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:13:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:13:40 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:13:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:13:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:13:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:13:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:13:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:13:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:13:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:13:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:13:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:13:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:13:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:13:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43882758
Fri 17 Jan 2014 08:13:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:13:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43882758
Fri 17 Jan 2014 08:13:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:13:52 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:13:52 - job_xml_thread(): Done retrieving: data size 43882758
Fri 17 Jan 2014 08:13:52 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:13:52 - XML: Start document: iteration 3
Fri 17 Jan 2014 08:13:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:13:53 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:13:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:13:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:13:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:13:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:13:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:13:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:13:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:13:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:13:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:13:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:13:58 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:13:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:13:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 08:13:59 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:13:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 08:13:59 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:13:59 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8837 values 139308 bits 17413 bytes 
Fri 17 Jan 2014 08:14:05 - XML: Processed 655452 elements - found 627 jobs
Fri 17 Jan 2014 08:14:05 - job 7347592 report time 1389942658 does not match current heartbeat 1389942778 : ignoring job
Fri 17 Jan 2014 08:14:05 - job 7347593 report time 1389942726 does not match current heartbeat 1389942778 : ignoring job
Fri 17 Jan 2014 08:14:05 - job 7347590 report time 1389942606 does not match current heartbeat 1389942778 : ignoring job
Fri 17 Jan 2014 08:14:05 - job 7347594 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 08:14:06 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 08:14:06 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 08:14:06 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 08:14:06 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:14:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:14:06 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:14:06 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:14:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:14:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:14:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:14:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:14:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:14:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:14:09 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:14:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43837275
Fri 17 Jan 2014 08:14:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:14:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43837275
Fri 17 Jan 2014 08:14:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:14:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:14:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:14:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:14:22 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:14:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:14:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:14:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:14:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:14:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:14:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:14:23 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:14:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:14:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:14:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:14:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:14:25 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:14:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:14:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:14:25 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:14:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 08:14:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:14:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:14:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:14:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:14:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:14:26 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:14:26 - job_xml_thread(): Done retrieving: data size 43878836
Fri 17 Jan 2014 08:14:26 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:14:26 - XML: Start document: iteration 4
Fri 17 Jan 2014 08:14:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43878836
Fri 17 Jan 2014 08:14:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:14:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43878836
Fri 17 Jan 2014 08:14:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:14:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:14:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:14:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:14:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:14:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:14:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:14:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:14:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:14:45 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:14:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:14:45 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:14:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:14:45 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:14:49 - XML: Processed 655452 elements - found 627 jobs
Fri 17 Jan 2014 08:14:49 - job 7347592 report time 1389942658 does not match current heartbeat 1389942778 : ignoring job
Fri 17 Jan 2014 08:14:49 - job 7347593 report time 1389942726 does not match current heartbeat 1389942778 : ignoring job
Fri 17 Jan 2014 08:14:50 - job 7347590 report time 1389942606 does not match current heartbeat 1389942778 : ignoring job
Fri 17 Jan 2014 08:14:50 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 08:14:50 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 08:14:50 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:14:50 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:14:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:14:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:14:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:14:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:14:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:14:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:14:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:14:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:14:51 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:14:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43848300
Fri 17 Jan 2014 08:14:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:14:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43848300
Fri 17 Jan 2014 08:14:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:14:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:14:59 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:14:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:14:59 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:14:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 08:14:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 08:14:59 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:15:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8956 values 141245 bits 17655 bytes 
Fri 17 Jan 2014 08:15:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:15:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:15:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:15:03 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:15:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:15:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:15:04 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:15:04 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:15:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:15:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:15:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:15:05 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:15:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:15:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:15:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:15:06 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:15:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:15:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:15:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:15:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:15:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:15:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:15:09 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:15:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43866191
Fri 17 Jan 2014 08:15:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:15:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43866191
Fri 17 Jan 2014 08:15:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:15:10 - job_xml_thread(): Done retrieving: data size 43866191
Fri 17 Jan 2014 08:15:10 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:15:10 - XML: Start document: iteration 5
Fri 17 Jan 2014 08:15:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:15:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:15:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:15:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:15:28 - XML: Processed 655454 elements - found 628 jobs
Fri 17 Jan 2014 08:15:28 - job 7347592 report time 1389942658 does not match current heartbeat 1389942847 : ignoring job
Fri 17 Jan 2014 08:15:28 - job 7347593 report time 1389942726 does not match current heartbeat 1389942847 : ignoring job
Fri 17 Jan 2014 08:15:29 - job 7347595 report time 1389942778 does not match current heartbeat 1389942847 : ignoring job
Fri 17 Jan 2014 08:15:29 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 08:15:29 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 08:15:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:15:30 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 08:15:30 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:15:30 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:15:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:15:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:15:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:15:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:15:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:15:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:15:31 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:15:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:15:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:15:32 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:15:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:15:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:15:32 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:15:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 08:15:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:15:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:15:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:15:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:15:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:15:34 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:15:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855199
Fri 17 Jan 2014 08:15:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:15:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855199
Fri 17 Jan 2014 08:15:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:15:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:15:42 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:15:45 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:15:45 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:15:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:15:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:15:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:15:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:15:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:15:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:15:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:15:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:15:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:15:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:15:48 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:15:48 - job_xml_thread(): Done retrieving: data size 43867386
Fri 17 Jan 2014 08:15:48 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:15:48 - XML: Start document: iteration 6
Fri 17 Jan 2014 08:15:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:15:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:15:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43867386
Fri 17 Jan 2014 08:15:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:15:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:15:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867386
Fri 17 Jan 2014 08:15:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:15:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:16:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:16:00 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:16:01 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:16:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:16:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 08:16:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 08:16:01 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:16:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7919 values 124866 bits 15608 bytes 
Fri 17 Jan 2014 08:16:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:16:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:16:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:16:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:16:05 - XML: Processed 655443 elements - found 627 jobs
Fri 17 Jan 2014 08:16:05 - job 7347499 appears to have finished
Fri 17 Jan 2014 08:16:05 - job 7347593 report time 1389942726 does not match current heartbeat 1389942899 : ignoring job
Fri 17 Jan 2014 08:16:05 - job 7347596 field 'start_timestamp' changed since saved from: 1389942860 to: 1389942794
Fri 17 Jan 2014 08:16:05 - job 7347597 report time 1389942847 does not match current heartbeat 1389942899 : ignoring job
Fri 17 Jan 2014 08:16:05 - job 7347595 report time 1389942778 does not match current heartbeat 1389942899 : ignoring job
Fri 17 Jan 2014 08:16:05 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 08:16:06 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 08:16:07 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 08:16:07 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:16:07 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:16:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:16:09 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:16:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:16:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:16:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:16:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:16:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:16:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:16:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:16:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:16:09 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:16:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:16:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:16:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:16:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:16:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:16:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:16:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:16:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43895699
Fri 17 Jan 2014 08:16:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:16:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43895699
Fri 17 Jan 2014 08:16:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:16:16 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 08:16:16 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:16:18 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:16:18 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:16:18 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 08:16:18 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 08:16:18 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 08:16:22 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:16:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:16:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:16:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:16:23 - size of cluster 'LISA Cluster': 624 hosts 79473 metrics 904568 values 14271726 bits 1783965 bytes 
Fri 17 Jan 2014 08:16:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:16:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:16:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:16:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:16:26 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:16:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:16:26 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:16:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:16:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:16:27 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:16:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:16:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:16:28 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:16:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 08:16:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:16:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:16:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:16:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:16:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:16:30 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:16:30 - job_xml_thread(): Done retrieving: data size 43872136
Fri 17 Jan 2014 08:16:30 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:16:30 - XML: Start document: iteration 7
Fri 17 Jan 2014 08:16:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43872136
Fri 17 Jan 2014 08:16:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:16:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43872136
Fri 17 Jan 2014 08:16:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:16:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:16:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:16:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:16:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:16:50 - XML: Processed 655452 elements - found 627 jobs
Fri 17 Jan 2014 08:16:50 - job 7347593 report time 1389942726 does not match current heartbeat 1389942899 : ignoring job
Fri 17 Jan 2014 08:16:51 - job 7347597 report time 1389942847 does not match current heartbeat 1389942899 : ignoring job
Fri 17 Jan 2014 08:16:51 - job 7347595 report time 1389942778 does not match current heartbeat 1389942899 : ignoring job
Fri 17 Jan 2014 08:16:51 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 08:16:51 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 08:16:51 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:16:51 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:16:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:16:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:16:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:16:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:16:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:16:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:16:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:16:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:16:52 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:16:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:16:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:16:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:16:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:16:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:16:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:16:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:16:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:16:57 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:16:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43899261
Fri 17 Jan 2014 08:16:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:16:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43899261
Fri 17 Jan 2014 08:16:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:17:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:17:01 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:17:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:17:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 08:17:02 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:17:02 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:17:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 08:17:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8823 values 139293 bits 17411 bytes 
Fri 17 Jan 2014 08:17:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:17:06 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:17:06 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:17:06 - job_xml_thread(): Done retrieving: data size 43899261
Fri 17 Jan 2014 08:17:06 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:17:06 - XML: Start document: iteration 8
Fri 17 Jan 2014 08:17:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:17:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:17:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:17:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:17:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:17:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:17:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:17:10 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:17:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:17:18 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:17:18 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 08:17:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:17:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:17:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:17:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:17:19 - XML: Processed 655456 elements - found 629 jobs
Fri 17 Jan 2014 08:17:19 - job 7347597 report time 1389942847 does not match current heartbeat 1389942968 : ignoring job
Fri 17 Jan 2014 08:17:19 - job 7347595 report time 1389942778 does not match current heartbeat 1389942968 : ignoring job
Fri 17 Jan 2014 08:17:19 - job 7347598 report time 1389942899 does not match current heartbeat 1389942968 : ignoring job
Fri 17 Jan 2014 08:17:19 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 08:17:19 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 08:17:19 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 08:17:19 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:17:19 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:17:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:17:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:17:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:17:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:17:23 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:17:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43778739
Fri 17 Jan 2014 08:17:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:17:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43778739
Fri 17 Jan 2014 08:17:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:17:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:17:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:17:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:17:34 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:17:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:17:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:17:35 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:17:35 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:17:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:17:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:17:35 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:17:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:17:35 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:17:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:17:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:17:40 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:17:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:17:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:17:40 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:17:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 08:17:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:17:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:17:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:17:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:17:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:17:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:17:43 - job_xml_thread(): Done retrieving: data size 43326816
Fri 17 Jan 2014 08:17:43 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:17:43 - XML: Start document: iteration 9
Fri 17 Jan 2014 08:17:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43326816
Fri 17 Jan 2014 08:17:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:17:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43326816
Fri 17 Jan 2014 08:17:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:17:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:17:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:17:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:17:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:18:00 - XML: Processed 648644 elements - found 628 jobs
Fri 17 Jan 2014 08:18:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:18:02 - job 7347600 report time 1389942968 does not match current heartbeat 1389943019 : ignoring job
Fri 17 Jan 2014 08:18:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:18:02 - job 7347601 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 08:18:02 - job 7347543 appears to have finished
Fri 17 Jan 2014 08:18:02 - job 7347597 report time 1389942847 does not match current heartbeat 1389943019 : ignoring job
Fri 17 Jan 2014 08:18:02 - job 7347598 report time 1389942899 does not match current heartbeat 1389943019 : ignoring job
Fri 17 Jan 2014 08:18:02 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 08:18:02 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 08:18:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:18:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:18:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:18:03 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:18:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:18:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:18:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:18:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:18:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:18:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:18:03 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:18:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 08:18:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 08:18:03 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:18:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5663 values 89524 bits 11190 bytes 
Fri 17 Jan 2014 08:18:04 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 08:18:04 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:18:04 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:18:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:18:06 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:18:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:18:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:18:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:18:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:18:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:18:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:18:10 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:18:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43203291
Fri 17 Jan 2014 08:18:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:18:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43203291
Fri 17 Jan 2014 08:18:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:18:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:18:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:18:20 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:18:20 - job_xml_thread(): Done retrieving: data size 43203291
Fri 17 Jan 2014 08:18:20 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:18:20 - XML: Start document: iteration 10
Fri 17 Jan 2014 08:18:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:18:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:18:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:18:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:18:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:18:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:18:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:18:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:18:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:18:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:18:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:18:30 - XML: Processed 647254 elements - found 628 jobs
Fri 17 Jan 2014 08:18:30 - job 7347600 report time 1389942968 does not match current heartbeat 1389943019 : ignoring job
Fri 17 Jan 2014 08:18:30 - job 7347597 report time 1389942847 does not match current heartbeat 1389943019 : ignoring job
Fri 17 Jan 2014 08:18:30 - job 7347598 report time 1389942899 does not match current heartbeat 1389943019 : ignoring job
Fri 17 Jan 2014 08:18:30 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 08:18:31 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 08:18:31 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:18:31 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:18:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:18:34 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:18:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:18:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:18:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:18:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:18:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:18:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:18:34 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:18:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 08:18:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:18:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:18:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:18:37 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:18:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43697492
Fri 17 Jan 2014 08:18:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:18:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43697492
Fri 17 Jan 2014 08:18:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:18:46 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:18:46 - job_xml_thread(): Done retrieving: data size 43697492
Fri 17 Jan 2014 08:18:46 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:18:46 - XML: Start document: iteration 11
Fri 17 Jan 2014 08:18:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:18:49 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:18:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:18:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:18:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:18:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:18:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:18:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:18:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:18:49 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:18:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:18:59 - XML: Processed 653858 elements - found 628 jobs
Fri 17 Jan 2014 08:18:59 - job 7347600 report time 1389942968 does not match current heartbeat 1389943019 : ignoring job
Fri 17 Jan 2014 08:18:59 - job 7347597 report time 1389942847 does not match current heartbeat 1389943019 : ignoring job
Fri 17 Jan 2014 08:18:59 - job 7347598 report time 1389942899 does not match current heartbeat 1389943019 : ignoring job
Fri 17 Jan 2014 08:18:59 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 08:18:59 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 08:18:59 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:18:59 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:19:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:19:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:19:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:19:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:19:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:19:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:19:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:19:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:19:03 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:19:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43824296
Fri 17 Jan 2014 08:19:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:19:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:19:03 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:19:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43824296
Fri 17 Jan 2014 08:19:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:19:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:19:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:19:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 08:19:05 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:19:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:19:05 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:19:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 08:19:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8906 values 140636 bits 17579 bytes 
Fri 17 Jan 2014 08:19:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:19:14 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:19:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:19:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:19:14 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:19:15 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:19:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:19:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:19:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:19:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:19:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:19:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:19:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:19:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:19:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:19:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:19:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:19:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:19:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:19:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:19:22 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:19:22 - job_xml_thread(): Done retrieving: data size 43841210
Fri 17 Jan 2014 08:19:22 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:19:22 - XML: Start document: iteration 12
Fri 17 Jan 2014 08:19:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43841210
Fri 17 Jan 2014 08:19:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:19:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43841210
Fri 17 Jan 2014 08:19:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:19:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:19:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:19:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:19:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:19:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:19:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:19:45 - XML: Processed 655454 elements - found 628 jobs
Fri 17 Jan 2014 08:19:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:19:45 - job 7347600 report time 1389942968 does not match current heartbeat 1389943088 : ignoring job
Fri 17 Jan 2014 08:19:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:19:45 - job 7347598 report time 1389942899 does not match current heartbeat 1389943088 : ignoring job
Fri 17 Jan 2014 08:19:45 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 08:19:45 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 08:19:45 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:19:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:19:45 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:19:45 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:19:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:19:45 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 08:19:45 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:19:45 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:19:45 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:19:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 08:19:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:19:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:19:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:19:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:19:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:19:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:19:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:19:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:19:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:19:50 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:19:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43850596
Fri 17 Jan 2014 08:19:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:19:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43850596
Fri 17 Jan 2014 08:19:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:20:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:20:00 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:20:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:20:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:20:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:20:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:20:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:20:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43850596
Fri 17 Jan 2014 08:20:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:20:00 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:20:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:20:00 - job_xml_thread(): Done retrieving: data size 43850596
Fri 17 Jan 2014 08:20:00 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:20:00 - XML: Start document: iteration 13
Fri 17 Jan 2014 08:20:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:20:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:20:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:20:05 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:20:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:20:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 08:20:05 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:20:05 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:20:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5973 values 94208 bits 11776 bytes 
Fri 17 Jan 2014 08:20:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 08:20:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:20:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:20:18 - XML: Processed 655448 elements - found 625 jobs
Fri 17 Jan 2014 08:20:18 - job 7347603 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 08:20:18 - job 7347600 report time 1389942968 does not match current heartbeat 1389943140 : ignoring job
Fri 17 Jan 2014 08:20:18 - job 7346510 appears to have finished
Fri 17 Jan 2014 08:20:18 - job 7347533 appears to have finished
Fri 17 Jan 2014 08:20:18 - job 7347591 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 08:20:18 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 08:20:18 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 08:20:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:20:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:20:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:20:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:20:20 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 08:20:20 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:20:20 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:20:20 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:20:20 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:20:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:20:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:20:20 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:20:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:20:21 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:20:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:20:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:20:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:20:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:20:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:20:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:20:22 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 08:20:22 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 08:20:22 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:20:24 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:20:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43866842
Fri 17 Jan 2014 08:20:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:20:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43866842
Fri 17 Jan 2014 08:20:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:20:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:20:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:20:35 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:20:35 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:20:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:20:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:20:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:20:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:20:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:20:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:20:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:20:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:20:36 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:20:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 08:20:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:20:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:20:40 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:20:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:20:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:20:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:20:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:20:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:20:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:20:41 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:20:41 - job_xml_thread(): Done retrieving: data size 43866396
Fri 17 Jan 2014 08:20:41 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:20:41 - XML: Start document: iteration 14
Fri 17 Jan 2014 08:20:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43866396
Fri 17 Jan 2014 08:20:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:20:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43866396
Fri 17 Jan 2014 08:20:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:20:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:20:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:20:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:20:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:21:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:21:00 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:21:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:21:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:21:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:21:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:21:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:21:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:21:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:21:02 - XML: Processed 655446 elements - found 624 jobs
Fri 17 Jan 2014 08:21:02 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 08:21:02 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 08:21:02 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:21:02 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:21:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:21:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:21:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:21:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:21:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:21:06 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:21:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:21:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:21:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:21:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:21:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:21:06 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:21:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 08:21:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 08:21:06 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:21:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6191 values 97670 bits 12208 bytes 
Fri 17 Jan 2014 08:21:07 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:21:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853069
Fri 17 Jan 2014 08:21:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:21:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853069
Fri 17 Jan 2014 08:21:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:21:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:21:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:21:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:21:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:21:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:21:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:21:17 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:21:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:21:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:21:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:21:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:21:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:21:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:21:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:21:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:21:21 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:21:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:21:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:21:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:21:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:21:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:21:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:21:23 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:21:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 08:21:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:21:23 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:21:23 - job_xml_thread(): Done retrieving: data size 43858841
Fri 17 Jan 2014 08:21:23 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:21:23 - XML: Start document: iteration 15
Fri 17 Jan 2014 08:21:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858841
Fri 17 Jan 2014 08:21:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:21:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43858841
Fri 17 Jan 2014 08:21:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:21:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:21:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:21:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:21:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:21:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:21:41 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:21:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:21:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:21:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:21:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:21:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:21:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:21:43 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:21:45 - XML: Processed 655446 elements - found 624 jobs
Fri 17 Jan 2014 08:21:45 - job 7335221 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:45 - job 7335220 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:45 - job 7335223 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:45 - job 7335222 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:45 - job 7335225 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:45 - job 7335224 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:45 - job 7335227 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:45 - job 7335226 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:45 - job 7335229 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:45 - job 7335228 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:45 - job 7339776 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:45 - job 7341100 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:45 - job 7341721 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:45 - job 7340333 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:45 - job 7340330 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:45 - job 7337749 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:45 - job 7337590 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:45 - job 7343918 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:45 - job 7344645 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:45 - job 7344401 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:45 - job 7344400 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:45 - job 7344403 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:45 - job 7344402 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:45 - job 7344405 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:45 - job 7344404 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:45 - job 7344407 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:45 - job 7344406 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:45 - job 7344409 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:45 - job 7344408 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:45 - job 7343768 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:45 - job 7341823 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:45 - job 7344533 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:45 - job 7338797 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:45 - job 7338790 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:45 - job 7344356 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:45 - job 7335699 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:45 - job 7344351 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:45 - job 7335439 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:45 - job 7335239 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:45 - job 7335232 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:45 - job 7335230 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:45 - job 7335231 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:46 - job 7347602 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:46 - job 7346097 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:46 - job 7344382 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:46 - job 7337217 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:46 - job 7344418 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:46 - job 7340781 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:46 - job 7344416 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:46 - job 7344414 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:46 - job 7344415 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:46 - job 7344412 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:46 - job 7344413 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:46 - job 7344410 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:46 - job 7344411 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:46 - job 7338953 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:46 - job 7338775 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:46 - job 7343787 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:46 - job 7337863 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:46 - job 7335401 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:46 - job 7335400 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:46 - job 7335403 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:46 - job 7335402 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:46 - job 7335405 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:46 - job 7335404 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:46 - job 7335406 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:46 - job 7340337 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:46 - job 7335249 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:46 - job 7335248 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:46 - job 7335246 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:46 - job 7337345 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:46 - job 7337341 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:46 - job 7336194 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:46 - job 7344419 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:46 - job 7339232 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:46 - job 7344417 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:46 - job 7337500 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:46 - job 7336991 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:46 - job 7340310 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:46 - job 7336999 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:46 - job 7344427 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:46 - job 7337261 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:46 - job 7343941 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:46 - job 7341893 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:46 - job 7344399 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:46 - job 7344398 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:46 - job 7344016 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:46 - job 7344391 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:46 - job 7344390 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:46 - job 7344393 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:46 - job 7344392 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:46 - job 7344395 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:46 - job 7344394 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:46 - job 7344397 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:46 - job 7344396 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:46 - job 7338806 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:46 - job 7338411 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:46 - job 7335485 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:46 - job 7338343 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:46 - job 7342415 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:46 - job 7335259 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7335254 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7335255 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7337272 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7340972 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7345705 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7337799 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344657 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7337400 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344571 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7338475 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:21:47 - job 7338870 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7343952 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344379 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344378 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344373 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344372 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344371 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344370 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344377 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344376 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344375 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:21:47 - job 7344374 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344386 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344387 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344384 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344385 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7338572 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344383 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344380 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344381 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344388 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344389 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7335544 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7335395 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7335397 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7337899 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7342698 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7335260 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7339484 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7346830 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7335250 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7336565 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7337641 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7337640 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7337643 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7337645 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7337646 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7345031 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344434 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344435 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344436 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344341 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344430 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344431 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344344 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344433 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7345969 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344368 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344369 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344360 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344361 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344362 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344363 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344364 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344365 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344366 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344367 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344440 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7335389 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7335576 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7343634 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7335273 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7335271 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7335276 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:21:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:21:47 - job 7335376 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7335375 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7335207 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7335206 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7335205 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7335204 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7335203 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7335202 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7335201 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7335200 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7339391 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7335209 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7335208 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7339156 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7343472 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7345099 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7343632 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344426 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344425 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7338208 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344350 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344421 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344420 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7343936 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344355 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344354 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344357 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344424 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344423 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344422 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344353 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344352 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7335866 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344359 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344358 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344429 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344428 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7338514 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7335361 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7335364 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7335365 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7335214 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7335215 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7335216 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7335217 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7335210 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7335211 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7335212 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7335213 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7335218 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7335219 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7341063 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7345647 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344342 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344343 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344340 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344437 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344346 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344347 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344432 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344345 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344348 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344349 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344438 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344439 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7343751 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344337 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344336 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344339 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7344338 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7338784 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7335903 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7342714 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7335424 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7335423 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7335422 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7335421 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7335197 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7335196 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7338025 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7335199 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job 7335198 report time 1389943140 does not match current heartbeat 1389943209 : ignoring job
Fri 17 Jan 2014 08:21:47 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 08:21:47 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 08:21:47 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:21:47 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:21:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:21:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:21:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:21:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:21:48 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:21:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858866
Fri 17 Jan 2014 08:21:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:21:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43858866
Fri 17 Jan 2014 08:21:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:21:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:21:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:21:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:21:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:21:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:21:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:22:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:22:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:22:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:22:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:22:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:22:02 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:22:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:22:03 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:22:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:22:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:22:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:22:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:22:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:22:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:22:04 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:22:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43859741
Fri 17 Jan 2014 08:22:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:22:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43859741
Fri 17 Jan 2014 08:22:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:22:05 - job_xml_thread(): Done retrieving: data size 43859741
Fri 17 Jan 2014 08:22:05 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:22:05 - XML: Start document: iteration 16
Fri 17 Jan 2014 08:22:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:22:06 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:22:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:22:07 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:22:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 08:22:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 08:22:07 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:22:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8889 values 140191 bits 17523 bytes 
Fri 17 Jan 2014 08:22:14 - XML: Processed 655446 elements - found 624 jobs
Fri 17 Jan 2014 08:22:14 - job 7347514 appears to have finished
Fri 17 Jan 2014 08:22:14 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 08:22:14 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 08:22:15 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 08:22:15 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:22:15 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:22:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:22:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:22:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:22:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:22:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:22:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:22:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:22:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:22:23 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:22:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:22:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:22:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:22:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:22:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:22:26 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:22:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:22:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:22:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:22:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:22:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:22:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:22:28 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:22:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43879152
Fri 17 Jan 2014 08:22:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:22:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43879152
Fri 17 Jan 2014 08:22:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:22:31 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:22:31 - job_xml_thread(): Done retrieving: data size 43879152
Fri 17 Jan 2014 08:22:31 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:22:31 - XML: Start document: iteration 17
Fri 17 Jan 2014 08:22:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:22:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:22:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:22:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:22:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:22:45 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:22:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:22:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:22:45 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:22:45 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:22:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:22:45 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:22:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:22:49 - XML: Processed 655446 elements - found 624 jobs
Fri 17 Jan 2014 08:22:49 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 08:22:49 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 08:22:49 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:22:49 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:22:51 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:22:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 08:22:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:22:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:22:52 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:22:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:22:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:22:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:22:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:22:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:22:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:22:54 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:22:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43848664
Fri 17 Jan 2014 08:22:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:22:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43848664
Fri 17 Jan 2014 08:22:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:23:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:23:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:23:05 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:23:05 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:23:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:23:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:23:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:23:07 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:23:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:23:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 08:23:08 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:23:08 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:23:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 08:23:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5986 values 94425 bits 11803 bytes 
Fri 17 Jan 2014 08:23:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:23:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:23:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:23:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:23:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:23:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:23:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:23:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:23:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:23:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:23:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:23:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:23:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:23:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:23:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:23:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:23:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:23:13 - job_xml_thread(): Done retrieving: data size 43795059
Fri 17 Jan 2014 08:23:13 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:23:13 - XML: Start document: iteration 18
Fri 17 Jan 2014 08:23:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43795059
Fri 17 Jan 2014 08:23:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:23:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43795059
Fri 17 Jan 2014 08:23:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:23:18 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 08:23:18 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:23:20 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:23:21 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:23:21 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 08:23:21 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 08:23:22 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 08:23:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:23:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:23:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:23:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:23:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:23:31 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:23:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:23:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:23:31 - XML: Processed 654698 elements - found 624 jobs
Fri 17 Jan 2014 08:23:31 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 08:23:31 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 08:23:31 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:23:31 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:23:32 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:23:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:23:32 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:23:32 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:23:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:23:32 - size of cluster 'LISA Cluster': 624 hosts 79469 metrics 824239 values 13010655 bits 1626331 bytes 
Fri 17 Jan 2014 08:23:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:23:37 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:23:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:23:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:23:37 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:23:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 08:23:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:23:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:23:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:23:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:23:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:23:40 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:23:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43280155
Fri 17 Jan 2014 08:23:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:23:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43280155
Fri 17 Jan 2014 08:23:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:23:47 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:23:47 - job_xml_thread(): Done retrieving: data size 43280155
Fri 17 Jan 2014 08:23:47 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:23:47 - XML: Start document: iteration 19
Fri 17 Jan 2014 08:23:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:23:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:23:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:23:49 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:23:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:23:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:23:50 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:23:50 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:23:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:23:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:23:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43280155
Fri 17 Jan 2014 08:23:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:23:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:23:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:24:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:24:01 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:24:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:24:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:24:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:24:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:24:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:24:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:24:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:24:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:24:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:24:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:24:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:24:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:24:08 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:24:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:24:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:24:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:24:09 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:24:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:24:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:24:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:24:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 08:24:09 - XML: Processed 648412 elements - found 624 jobs
Fri 17 Jan 2014 08:24:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:24:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 08:24:09 - job 7347568 appears to have finished
Fri 17 Jan 2014 08:24:09 - job 7347575 appears to have finished
Fri 17 Jan 2014 08:24:09 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:24:09 - job 7341626 appears to have finished
Fri 17 Jan 2014 08:24:09 - job_xml_thread(): Found 6 updated jobs.
Fri 17 Jan 2014 08:24:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5772 values 91002 bits 11375 bytes 
Fri 17 Jan 2014 08:24:09 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 08:24:09 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Fri 17 Jan 2014 08:24:09 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:24:09 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:24:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:24:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43199158
Fri 17 Jan 2014 08:24:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:24:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43199158
Fri 17 Jan 2014 08:24:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:24:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:24:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:24:22 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:24:22 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 08:24:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:24:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:24:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:24:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:24:24 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:24:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:24:25 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:24:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:24:25 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:24:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:24:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:24:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:24:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:24:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:24:29 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:24:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 08:24:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:24:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:24:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:24:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:24:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:24:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:24:32 - job_xml_thread(): Done retrieving: data size 43361273
Fri 17 Jan 2014 08:24:32 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:24:32 - XML: Start document: iteration 20
Fri 17 Jan 2014 08:24:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43361273
Fri 17 Jan 2014 08:24:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:24:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43361273
Fri 17 Jan 2014 08:24:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:24:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:24:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:24:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:24:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:24:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:24:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:24:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:24:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:24:45 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:24:45 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:24:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:24:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:24:45 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:24:56 - XML: Processed 649120 elements - found 624 jobs
Fri 17 Jan 2014 08:24:56 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 08:24:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:24:56 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 08:24:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:24:56 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:24:56 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:24:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:24:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:24:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:24:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:24:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:24:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:25:00 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:25:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43810881
Fri 17 Jan 2014 08:25:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:25:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:25:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:25:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43810881
Fri 17 Jan 2014 08:25:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:25:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:25:09 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:25:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:25:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 08:25:10 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:25:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 08:25:10 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:25:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8913 values 140547 bits 17568 bytes 
Fri 17 Jan 2014 08:25:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:25:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:25:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:25:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:25:11 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:25:11 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:25:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:25:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:25:12 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:25:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:25:12 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:25:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:25:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:25:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:25:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:25:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:25:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:25:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:25:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:25:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:25:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:25:18 - job_xml_thread(): Done retrieving: data size 43858872
Fri 17 Jan 2014 08:25:18 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:25:18 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 08:25:18 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 08:25:18 - Housekeeping: done.
Fri 17 Jan 2014 08:25:18 - XML: Start document: iteration 0
Fri 17 Jan 2014 08:25:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43858872
Fri 17 Jan 2014 08:25:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:25:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858872
Fri 17 Jan 2014 08:25:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:25:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:25:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:25:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:25:31 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:25:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:25:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:25:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:25:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:25:32 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:25:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:25:32 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:25:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:25:32 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:25:39 - XML: Processed 655435 elements - found 624 jobs
Fri 17 Jan 2014 08:25:39 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 08:25:39 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 08:25:39 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:25:39 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:25:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:25:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:25:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:25:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:25:42 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:25:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 08:25:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:25:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:25:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:25:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:25:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:25:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:25:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43841669
Fri 17 Jan 2014 08:25:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:25:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43841669
Fri 17 Jan 2014 08:25:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:25:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:25:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:25:54 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:25:54 - job_xml_thread(): Done retrieving: data size 43841669
Fri 17 Jan 2014 08:25:54 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:25:54 - XML: Start document: iteration 1
Fri 17 Jan 2014 08:25:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:25:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:25:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:25:58 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:25:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:25:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:25:59 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:26:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:26:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:26:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:26:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:26:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:26:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:26:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:26:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:26:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:26:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:26:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:26:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:26:07 - XML: Processed 655446 elements - found 624 jobs
Fri 17 Jan 2014 08:26:07 - job 7347548 appears to have finished
Fri 17 Jan 2014 08:26:07 - job 7347529 appears to have finished
Fri 17 Jan 2014 08:26:07 - job 7347308 appears to have finished
Fri 17 Jan 2014 08:26:07 - job_xml_thread(): Found 6 updated jobs.
Fri 17 Jan 2014 08:26:07 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 08:26:07 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Fri 17 Jan 2014 08:26:07 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:26:07 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:26:10 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:26:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43837246
Fri 17 Jan 2014 08:26:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:26:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43837246
Fri 17 Jan 2014 08:26:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:26:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:26:10 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:26:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:26:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 08:26:11 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:26:11 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:26:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 08:26:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8509 values 134139 bits 16767 bytes 
Fri 17 Jan 2014 08:26:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:26:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:26:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:26:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:26:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:26:21 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:26:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:26:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:26:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:26:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:26:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:26:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:26:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:26:22 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:26:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:26:27 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:26:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:26:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:26:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:26:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:26:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:26:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:26:30 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:26:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43863440
Fri 17 Jan 2014 08:26:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:26:31 - job_xml_thread(): Done retrieving: data size 43863440
Fri 17 Jan 2014 08:26:31 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:26:31 - XML: Start document: iteration 2
Fri 17 Jan 2014 08:26:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43863440
Fri 17 Jan 2014 08:26:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:26:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:26:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:26:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:26:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:26:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:26:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:26:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:26:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:26:47 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:26:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:26:47 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:26:47 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:26:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:26:48 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:26:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 08:26:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:26:53 - XML: Processed 655446 elements - found 624 jobs
Fri 17 Jan 2014 08:26:53 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 08:26:53 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 08:26:53 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:26:53 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:26:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:26:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:26:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:26:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:26:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:26:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:26:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:26:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:26:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:26:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43845010
Fri 17 Jan 2014 08:26:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43845010
Fri 17 Jan 2014 08:26:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:26:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:27:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:27:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:27:08 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:27:08 - job_xml_thread(): Done retrieving: data size 43845010
Fri 17 Jan 2014 08:27:08 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:27:08 - XML: Start document: iteration 3
Fri 17 Jan 2014 08:27:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:27:09 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:27:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:27:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:27:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:27:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:27:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:27:10 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:27:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:27:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:27:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:27:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:27:11 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:27:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:27:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 08:27:12 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:27:12 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:27:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 08:27:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6104 values 96303 bits 12037 bytes 
Fri 17 Jan 2014 08:27:20 - XML: Processed 655446 elements - found 624 jobs
Fri 17 Jan 2014 08:27:21 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 08:27:21 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 08:27:21 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:27:21 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:27:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:27:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:27:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:27:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:27:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:27:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:27:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:27:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:27:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:27:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43828680
Fri 17 Jan 2014 08:27:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:27:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:27:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:27:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43828680
Fri 17 Jan 2014 08:27:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:27:36 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:27:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:27:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:27:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:27:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:27:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:27:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:27:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:27:37 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:27:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:27:37 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:27:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:27:38 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:27:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 08:27:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:27:40 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 08:27:40 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 08:27:40 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:27:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:27:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:27:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:27:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:27:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:27:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:27:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:27:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:27:42 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:27:42 - job_xml_thread(): Done retrieving: data size 43855885
Fri 17 Jan 2014 08:27:42 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:27:42 - XML: Start document: iteration 4
Fri 17 Jan 2014 08:27:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855885
Fri 17 Jan 2014 08:27:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:27:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855885
Fri 17 Jan 2014 08:27:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:27:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:27:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:27:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:27:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:27:58 - XML: Processed 655440 elements - found 621 jobs
Fri 17 Jan 2014 08:27:58 - job 7347609 field 'start_timestamp' changed since saved from: 1389943516 to: 1389943474
Fri 17 Jan 2014 08:27:59 - job 7347469 appears to have finished
Fri 17 Jan 2014 08:27:59 - job 7347572 appears to have finished
Fri 17 Jan 2014 08:27:59 - job 7347320 appears to have finished
Fri 17 Jan 2014 08:27:59 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 08:27:59 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 08:28:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:28:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:28:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:28:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:28:02 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 08:28:03 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:28:03 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:28:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:28:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:28:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:28:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:28:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:28:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:28:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:28:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:28:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:28:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:28:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:28:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:28:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:28:07 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:28:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43848660
Fri 17 Jan 2014 08:28:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:28:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43848660
Fri 17 Jan 2014 08:28:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:28:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:28:12 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:28:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:28:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 08:28:13 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:28:14 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:28:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 08:28:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8875 values 140003 bits 17500 bytes 
Fri 17 Jan 2014 08:28:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:28:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:28:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:28:18 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:28:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:28:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:28:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:28:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:28:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:28:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:28:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:28:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:28:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:28:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:28:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:28:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:28:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:28:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:28:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:28:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:28:24 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:28:24 - job_xml_thread(): Done retrieving: data size 43851223
Fri 17 Jan 2014 08:28:24 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:28:24 - XML: Start document: iteration 5
Fri 17 Jan 2014 08:28:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851223
Fri 17 Jan 2014 08:28:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:28:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851223
Fri 17 Jan 2014 08:28:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:28:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:28:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:28:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:28:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:28:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:28:41 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:28:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:28:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:28:42 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:28:42 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:28:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:28:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:28:42 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:28:44 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:28:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 08:28:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:28:45 - XML: Processed 655440 elements - found 621 jobs
Fri 17 Jan 2014 08:28:45 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 08:28:45 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 08:28:46 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:28:46 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:28:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:28:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:28:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:28:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:28:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:28:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:28:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:28:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:28:50 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:28:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862645
Fri 17 Jan 2014 08:28:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:28:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862645
Fri 17 Jan 2014 08:28:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:28:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:28:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:29:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:29:00 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:29:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:29:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:29:02 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:29:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:29:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:29:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:29:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:29:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:29:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:29:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:29:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:29:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:29:03 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:29:03 - job_xml_thread(): Done retrieving: data size 43871641
Fri 17 Jan 2014 08:29:03 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:29:03 - XML: Start document: iteration 6
Fri 17 Jan 2014 08:29:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43871641
Fri 17 Jan 2014 08:29:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:29:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:29:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:29:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:29:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:29:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43871641
Fri 17 Jan 2014 08:29:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:29:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:29:14 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:29:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:29:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:29:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:29:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 08:29:16 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:29:16 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:29:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 08:29:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8963 values 141342 bits 17667 bytes 
Fri 17 Jan 2014 08:29:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:29:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:29:17 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:29:17 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:29:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:29:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:29:17 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:29:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:29:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:29:21 - XML: Processed 655438 elements - found 621 jobs
Fri 17 Jan 2014 08:29:21 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 08:29:21 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 08:29:21 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:29:21 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:29:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:29:25 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:29:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:29:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:29:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:29:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:29:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:29:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:29:27 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:29:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43782682
Fri 17 Jan 2014 08:29:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:29:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43782682
Fri 17 Jan 2014 08:29:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:29:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:29:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:29:36 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:29:36 - job_xml_thread(): Done retrieving: data size 43782682
Fri 17 Jan 2014 08:29:36 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:29:36 - XML: Start document: iteration 7
Fri 17 Jan 2014 08:29:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:29:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:29:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:29:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:29:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:29:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:29:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:29:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:29:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:29:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:29:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:29:48 - XML: Processed 654692 elements - found 621 jobs
Fri 17 Jan 2014 08:29:48 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 08:29:48 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 08:29:48 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:29:48 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:29:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:29:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:29:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:29:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:29:50 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:29:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 08:29:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:29:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:29:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:29:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:29:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:29:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:29:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43246230
Fri 17 Jan 2014 08:29:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:29:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43246230
Fri 17 Jan 2014 08:29:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:29:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:29:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:30:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:30:03 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:30:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:30:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:30:04 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:30:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:30:04 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:30:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:30:04 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:30:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:30:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:30:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:30:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:30:06 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:30:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:30:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:30:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:30:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:30:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:30:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:30:08 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:30:08 - job_xml_thread(): Done retrieving: data size 43241645
Fri 17 Jan 2014 08:30:08 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:30:08 - XML: Start document: iteration 8
Fri 17 Jan 2014 08:30:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43241645
Fri 17 Jan 2014 08:30:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:30:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43241645
Fri 17 Jan 2014 08:30:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:30:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:30:17 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:30:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:30:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:30:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:30:21 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:30:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 08:30:21 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:30:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 08:30:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:30:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:30:22 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 08:30:22 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:30:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8672 values 136705 bits 17088 bytes 
Fri 17 Jan 2014 08:30:23 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:30:23 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:30:23 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 08:30:23 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 08:30:23 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 08:30:29 - XML: Processed 647838 elements - found 622 jobs
Fri 17 Jan 2014 08:30:29 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 08:30:29 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 08:30:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:30:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:30:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:30:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:30:31 - size of cluster 'LISA Cluster': 624 hosts 79481 metrics 786949 values 12412788 bits 1551598 bytes 
Fri 17 Jan 2014 08:30:31 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 08:30:31 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:30:31 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:30:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:30:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:30:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:30:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:30:31 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:30:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:30:33 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:30:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:30:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:30:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:30:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:30:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:30:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:30:37 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:30:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43503052
Fri 17 Jan 2014 08:30:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:30:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43503052
Fri 17 Jan 2014 08:30:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:30:46 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:30:46 - job_xml_thread(): Done retrieving: data size 43503052
Fri 17 Jan 2014 08:30:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:30:46 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:30:46 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:30:46 - XML: Start document: iteration 9
Fri 17 Jan 2014 08:30:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:30:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:30:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:30:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:30:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:30:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:30:48 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:30:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:30:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:30:50 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:30:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 08:30:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:30:58 - XML: Processed 651024 elements - found 622 jobs
Fri 17 Jan 2014 08:30:58 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 08:30:58 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 08:30:58 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:30:58 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:31:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:31:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:31:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:31:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:31:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:31:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:31:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:31:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:31:03 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:31:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43830737
Fri 17 Jan 2014 08:31:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:31:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43830737
Fri 17 Jan 2014 08:31:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:31:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:31:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:31:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:31:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:31:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:31:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:31:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:31:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:31:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:31:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:31:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:31:13 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:31:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:31:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:31:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:31:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:31:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:31:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:31:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:31:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:31:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:31:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:31:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:31:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43866754
Fri 17 Jan 2014 08:31:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:31:20 - job_xml_thread(): Done retrieving: data size 43866754
Fri 17 Jan 2014 08:31:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43866754
Fri 17 Jan 2014 08:31:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:31:20 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:31:20 - XML: Start document: iteration 10
Fri 17 Jan 2014 08:31:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:31:22 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:31:23 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:31:24 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 08:31:25 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:31:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 08:31:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:31:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 08:31:25 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:31:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9008 values 142174 bits 17771 bytes 
Fri 17 Jan 2014 08:31:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:31:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:31:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:31:31 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:31:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:31:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:31:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:31:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:31:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:31:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:31:31 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:31:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:31:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:31:39 - XML: Processed 655439 elements - found 622 jobs
Fri 17 Jan 2014 08:31:39 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 08:31:39 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 08:31:39 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:31:39 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:31:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:31:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:31:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:31:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:31:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:31:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:31:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:31:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:31:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:31:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:31:46 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:31:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43831411
Fri 17 Jan 2014 08:31:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:31:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43831411
Fri 17 Jan 2014 08:31:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:31:54 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:31:54 - job_xml_thread(): Done retrieving: data size 43831411
Fri 17 Jan 2014 08:31:55 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:31:55 - XML: Start document: iteration 11
Fri 17 Jan 2014 08:31:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:31:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:32:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:32:03 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:32:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:32:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:32:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:32:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:32:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:32:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:32:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:32:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:32:09 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:32:10 - XML: Processed 655451 elements - found 627 jobs
Fri 17 Jan 2014 08:32:10 - job_xml_thread(): Found 5 updated jobs.
Fri 17 Jan 2014 08:32:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:32:10 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 08:32:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:32:10 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Fri 17 Jan 2014 08:32:10 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:32:10 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:32:10 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:32:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 08:32:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:32:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:32:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:32:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:32:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:32:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:32:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43863002
Fri 17 Jan 2014 08:32:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:32:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43863002
Fri 17 Jan 2014 08:32:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:32:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:32:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:32:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:32:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:32:25 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:32:25 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:32:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:32:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:32:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:32:25 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:32:26 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:32:26 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:32:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:32:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:32:26 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:32:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 08:32:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:32:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 08:32:26 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:32:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6003 values 94986 bits 11873 bytes 
Fri 17 Jan 2014 08:32:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:32:27 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:32:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:32:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:32:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:32:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:32:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:32:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:32:31 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:32:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 08:32:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:32:31 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:32:31 - job_xml_thread(): Done retrieving: data size 43876233
Fri 17 Jan 2014 08:32:31 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:32:31 - XML: Start document: iteration 12
Fri 17 Jan 2014 08:32:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43876233
Fri 17 Jan 2014 08:32:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43876233
Fri 17 Jan 2014 08:32:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:32:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:32:40 - XML: Processed 655452 elements - found 627 jobs
Fri 17 Jan 2014 08:32:40 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 08:32:40 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 08:32:40 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:32:40 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:32:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:32:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:32:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:32:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:32:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:32:50 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:32:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:32:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:32:51 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:32:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:32:51 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:32:51 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:32:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:32:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:32:53 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:32:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:32:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:32:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:32:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:32:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:32:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:32:55 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:32:56 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:32:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865309
Fri 17 Jan 2014 08:32:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:32:56 - job_xml_thread(): Done retrieving: data size 43865309
Fri 17 Jan 2014 08:32:56 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:32:57 - XML: Start document: iteration 13
Fri 17 Jan 2014 08:32:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43865309
Fri 17 Jan 2014 08:32:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:33:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:33:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:33:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:33:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:33:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:33:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:33:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:33:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:33:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:33:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:33:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:33:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:33:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:33:15 - XML: Processed 655452 elements - found 627 jobs
Fri 17 Jan 2014 08:33:15 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 08:33:15 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 08:33:15 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:33:15 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:33:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:33:19 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:33:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:33:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:33:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:33:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:33:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:33:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:33:21 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:33:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43848203
Fri 17 Jan 2014 08:33:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:33:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43848203
Fri 17 Jan 2014 08:33:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:33:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:33:26 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:33:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:33:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:33:28 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:33:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:33:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 08:33:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 08:33:28 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:33:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 149063 bits 18632 bytes 
Fri 17 Jan 2014 08:33:31 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:33:31 - job_xml_thread(): Done retrieving: data size 43848203
Fri 17 Jan 2014 08:33:31 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:33:31 - XML: Start document: iteration 14
Fri 17 Jan 2014 08:33:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:33:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:33:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:33:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:33:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:33:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:33:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:33:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:33:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:33:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:33:40 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:33:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:33:44 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:33:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:33:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:33:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:33:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:33:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:33:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:33:46 - XML: Processed 655448 elements - found 627 jobs
Fri 17 Jan 2014 08:33:46 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 08:33:46 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 08:33:46 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:33:46 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:33:49 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:33:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 08:33:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:33:50 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:33:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43860933
Fri 17 Jan 2014 08:33:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:33:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43860933
Fri 17 Jan 2014 08:33:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:33:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:33:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:34:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:34:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:34:01 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:34:01 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:34:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:34:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:34:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:34:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:34:04 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:34:04 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:34:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:34:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:34:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:34:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:34:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:34:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:34:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:34:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:34:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:34:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:34:06 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 08:34:06 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 08:34:06 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:34:07 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:34:07 - job_xml_thread(): Done retrieving: data size 43855456
Fri 17 Jan 2014 08:34:07 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:34:07 - XML: Start document: iteration 15
Fri 17 Jan 2014 08:34:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855456
Fri 17 Jan 2014 08:34:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855456
Fri 17 Jan 2014 08:34:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:34:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:34:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:34:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:34:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:34:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:34:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:34:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:34:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:34:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:34:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:34:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:34:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:34:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:34:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:34:22 - XML: Processed 655448 elements - found 625 jobs
Fri 17 Jan 2014 08:34:22 - job 7347519 appears to have finished
Fri 17 Jan 2014 08:34:22 - job 7347609 appears to have finished
Fri 17 Jan 2014 08:34:22 - job 7347537 appears to have finished
Fri 17 Jan 2014 08:34:22 - job 7347616 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 08:34:23 - job_xml_thread(): Found 5 updated jobs.
Fri 17 Jan 2014 08:34:23 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 08:34:24 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Fri 17 Jan 2014 08:34:24 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:34:24 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:34:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:34:26 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:34:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:34:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:34:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:34:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:34:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:34:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:34:28 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:34:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867841
Fri 17 Jan 2014 08:34:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:34:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:34:28 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:34:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43867841
Fri 17 Jan 2014 08:34:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:34:31 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:34:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 08:34:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:34:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 08:34:31 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:34:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148731 bits 18591 bytes 
Fri 17 Jan 2014 08:34:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:34:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:34:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:34:38 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:34:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:34:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:34:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:34:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:34:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:34:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:34:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:34:39 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:34:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:34:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:34:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:34:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:34:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:34:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:34:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:34:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:34:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:34:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:34:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:34:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43872624
Fri 17 Jan 2014 08:34:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:34:45 - job_xml_thread(): Done retrieving: data size 43872624
Fri 17 Jan 2014 08:34:45 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:34:45 - XML: Start document: iteration 16
Fri 17 Jan 2014 08:34:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43872624
Fri 17 Jan 2014 08:34:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:34:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:34:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:34:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:34:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:35:04 - XML: Processed 655448 elements - found 625 jobs
Fri 17 Jan 2014 08:35:04 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 08:35:04 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 08:35:04 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:35:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:35:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:35:04 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:35:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:35:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:35:04 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:35:04 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:35:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:35:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:35:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:35:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:35:08 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:35:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:35:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:35:08 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:35:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 08:35:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:35:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:35:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:35:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:35:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:35:10 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:35:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43786671
Fri 17 Jan 2014 08:35:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:35:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43786671
Fri 17 Jan 2014 08:35:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:35:19 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:35:19 - job_xml_thread(): Done retrieving: data size 43786671
Fri 17 Jan 2014 08:35:19 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:35:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:35:20 - XML: Start document: iteration 17
Fri 17 Jan 2014 08:35:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:35:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:35:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:35:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:35:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:35:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:35:29 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:35:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:35:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:35:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:35:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:35:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:35:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:35:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:35:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:35:31 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:35:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:35:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:35:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:35:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:35:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:35:32 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:35:32 - XML: Processed 654700 elements - found 625 jobs
Fri 17 Jan 2014 08:35:32 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 08:35:32 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 08:35:32 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:35:32 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:35:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:35:32 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:35:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 08:35:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 08:35:32 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:35:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5713 values 90132 bits 11266 bytes 
Fri 17 Jan 2014 08:35:35 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:35:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 08:35:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:35:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:35:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43297961
Fri 17 Jan 2014 08:35:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:35:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43297961
Fri 17 Jan 2014 08:35:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:35:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:35:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:35:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:35:46 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:35:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:35:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:35:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:35:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:35:47 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:35:47 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:35:47 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:35:47 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:35:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:35:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:35:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:35:49 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:35:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:35:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:35:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:35:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:35:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:35:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:35:51 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:35:51 - job_xml_thread(): Done retrieving: data size 43216524
Fri 17 Jan 2014 08:35:51 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:35:51 - XML: Start document: iteration 18
Fri 17 Jan 2014 08:35:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43216524
Fri 17 Jan 2014 08:35:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:35:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43216524
Fri 17 Jan 2014 08:35:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:36:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:36:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:36:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:36:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:36:06 - XML: Processed 647412 elements - found 627 jobs
Fri 17 Jan 2014 08:36:07 - job 7347552 appears to have finished
Fri 17 Jan 2014 08:36:07 - job 7347531 appears to have finished
Fri 17 Jan 2014 08:36:07 - job_xml_thread(): Found 6 updated jobs.
Fri 17 Jan 2014 08:36:07 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 08:36:11 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Fri 17 Jan 2014 08:36:11 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:36:11 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:36:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:36:13 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:36:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:36:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:36:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:36:14 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:36:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:36:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:36:14 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:36:14 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:36:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:36:14 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:36:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:36:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:36:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:36:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:36:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:36:16 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:36:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43280164
Fri 17 Jan 2014 08:36:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:36:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43280164
Fri 17 Jan 2014 08:36:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:36:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:36:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:36:26 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:36:26 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:36:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:36:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:36:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:36:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:36:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:36:30 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:36:30 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:36:30 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:36:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:36:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:36:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:36:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:36:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:36:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:36:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:36:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:36:31 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:36:31 - job_xml_thread(): Done retrieving: data size 43273760
Fri 17 Jan 2014 08:36:31 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:36:31 - XML: Start document: iteration 19
Fri 17 Jan 2014 08:36:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43273760
Fri 17 Jan 2014 08:36:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:36:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43273760
Fri 17 Jan 2014 08:36:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:36:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:36:33 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:36:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:36:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 08:36:35 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:36:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 08:36:35 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:36:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9127 values 143968 bits 17996 bytes 
Fri 17 Jan 2014 08:36:40 - XML: Processed 648000 elements - found 627 jobs
Fri 17 Jan 2014 08:36:40 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 08:36:40 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 08:36:40 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:36:40 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:36:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:36:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:36:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:36:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:36:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:36:49 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:36:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:36:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:36:50 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:36:50 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:36:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:36:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:36:50 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:36:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:36:52 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:36:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:36:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:36:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:36:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:36:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:36:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:36:54 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:36:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 08:36:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:36:55 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:36:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43849941
Fri 17 Jan 2014 08:36:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:36:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43849941
Fri 17 Jan 2014 08:36:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:36:55 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:36:55 - job_xml_thread(): Done retrieving: data size 43849941
Fri 17 Jan 2014 08:36:55 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:36:56 - XML: Start document: iteration 20
Fri 17 Jan 2014 08:37:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:37:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:37:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:37:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:37:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:37:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:37:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:37:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:37:18 - XML: Processed 655336 elements - found 627 jobs
Fri 17 Jan 2014 08:37:18 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 08:37:18 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 08:37:18 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:37:18 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:37:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:37:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:37:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:37:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:37:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:37:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:37:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:37:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:37:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:37:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:37:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:37:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:37:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:37:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:37:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43878587
Fri 17 Jan 2014 08:37:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:37:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43878587
Fri 17 Jan 2014 08:37:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:37:24 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 08:37:24 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:37:25 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:37:25 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:37:26 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 08:37:26 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 08:37:26 - Entering storeMetrics(): cluster LISA Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Fri 17 Jan 2014 08:37:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:37:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:37:33 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:37:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:37:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:37:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:37:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:37:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:37:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:37:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:37:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:37:35 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:37:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:37:35 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:37:35 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:37:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:37:35 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:37:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:37:35 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:37:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:37:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 08:37:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 08:37:35 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:37:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6141 values 96837 bits 12104 bytes 
Fri 17 Jan 2014 08:37:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:37:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:37:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:37:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:37:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:37:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:37:38 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:37:38 - job_xml_thread(): Done retrieving: data size 43854445
Fri 17 Jan 2014 08:37:38 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:37:38 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 08:37:38 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 08:37:38 - Housekeeping: done.
Fri 17 Jan 2014 08:37:38 - XML: Start document: iteration 0
Fri 17 Jan 2014 08:37:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43854445
Fri 17 Jan 2014 08:37:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:37:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43854445
Fri 17 Jan 2014 08:37:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:37:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:37:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:37:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:37:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:37:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:37:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:37:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:37:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:37:53 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:37:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:37:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:37:53 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:37:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:37:59 - XML: Processed 655440 elements - found 621 jobs
Fri 17 Jan 2014 08:37:59 - job 7347564 appears to have finished
Fri 17 Jan 2014 08:37:59 - job 7347439 appears to have finished
Fri 17 Jan 2014 08:37:59 - job 7347526 appears to have finished
Fri 17 Jan 2014 08:37:59 - job 7347611 appears to have finished
Fri 17 Jan 2014 08:37:59 - job 7347613 appears to have finished
Fri 17 Jan 2014 08:37:59 - job 7347615 appears to have finished
Fri 17 Jan 2014 08:37:59 - job_xml_thread(): Found 6 updated jobs.
Fri 17 Jan 2014 08:37:59 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 08:38:00 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Fri 17 Jan 2014 08:38:00 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:38:00 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:38:01 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:38:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 08:38:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:38:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:38:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:38:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:38:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:38:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:38:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:38:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:38:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:38:04 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:38:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856100
Fri 17 Jan 2014 08:38:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:38:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43856100
Fri 17 Jan 2014 08:38:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:38:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:38:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:38:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:38:14 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:38:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:38:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:38:14 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:38:14 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:38:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:38:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:38:15 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:38:15 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:38:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:38:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:38:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:38:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:38:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:38:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:38:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:38:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:38:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:38:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43882254
Fri 17 Jan 2014 08:38:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:38:19 - job_xml_thread(): Done retrieving: data size 43882254
Fri 17 Jan 2014 08:38:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43882254
Fri 17 Jan 2014 08:38:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:38:20 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:38:20 - XML: Start document: iteration 1
Fri 17 Jan 2014 08:38:27 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:38:27 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:38:28 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:38:28 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:38:28 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 08:38:28 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 08:38:28 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 08:38:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:38:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:38:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:38:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:38:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:38:35 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:38:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:38:37 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:38:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:38:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:38:37 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:38:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:38:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:38:38 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:38:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 08:38:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 08:38:39 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:38:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9114 values 143785 bits 17973 bytes 
Fri 17 Jan 2014 08:38:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:38:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:38:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:38:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:38:40 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:38:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:38:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:38:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:38:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:38:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:38:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:38:42 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 948567 values 14973674 bits 1871709 bytes 
Fri 17 Jan 2014 08:38:43 - XML: Processed 655442 elements - found 622 jobs
Fri 17 Jan 2014 08:38:43 - job 7347621 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 08:38:43 - job 7347602 report time 1389944105 does not match current heartbeat 1389944226 : ignoring job
Fri 17 Jan 2014 08:38:43 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 08:38:43 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 08:38:43 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 08:38:43 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:38:43 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:38:47 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:38:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43865919
Fri 17 Jan 2014 08:38:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:38:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865919
Fri 17 Jan 2014 08:38:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:38:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:38:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:38:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:38:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:38:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:38:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:38:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:38:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:38:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:38:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:38:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865919
Fri 17 Jan 2014 08:38:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:38:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:38:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:38:58 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:38:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:39:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:39:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:39:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:39:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:39:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:39:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:39:11 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:39:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 08:39:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:39:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:39:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:39:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:39:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:39:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:39:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:39:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:39:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:39:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:39:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:39:14 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:39:14 - job_xml_thread(): Done retrieving: data size 43823161
Fri 17 Jan 2014 08:39:14 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:39:14 - XML: Start document: iteration 2
Fri 17 Jan 2014 08:39:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43823161
Fri 17 Jan 2014 08:39:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:39:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43823161
Fri 17 Jan 2014 08:39:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:39:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:39:25 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:39:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:39:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:39:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:39:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:39:28 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:39:28 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 08:39:29 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:39:29 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:39:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:39:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:39:29 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:39:32 - XML: Processed 655442 elements - found 622 jobs
Fri 17 Jan 2014 08:39:32 - job 7347602 report time 1389944105 does not match current heartbeat 1389944226 : ignoring job
Fri 17 Jan 2014 08:39:32 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 08:39:32 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 08:39:32 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:39:32 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:39:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:39:36 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:39:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:39:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:39:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:39:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:39:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:39:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:39:39 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:39:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851499
Fri 17 Jan 2014 08:39:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:39:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:39:39 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:39:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851499
Fri 17 Jan 2014 08:39:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:39:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:39:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 08:39:41 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:39:41 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:39:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 08:39:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9016 values 142189 bits 17773 bytes 
Fri 17 Jan 2014 08:39:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:39:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:39:47 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:39:47 - job_xml_thread(): Done retrieving: data size 43851499
Fri 17 Jan 2014 08:39:47 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:39:47 - XML: Start document: iteration 3
Fri 17 Jan 2014 08:39:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:39:48 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:39:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:39:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:39:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:39:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:39:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851499
Fri 17 Jan 2014 08:39:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:39:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:39:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:39:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:39:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:40:02 - XML: Processed 655438 elements - found 620 jobs
Fri 17 Jan 2014 08:40:02 - job 7343920 appears to have finished
Fri 17 Jan 2014 08:40:02 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 08:40:02 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 08:40:03 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 08:40:03 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:40:03 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:40:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:40:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:40:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:40:09 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:40:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:40:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:40:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:40:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:40:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:40:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:40:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:40:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:40:10 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:40:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:40:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:40:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:40:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:40:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:40:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:40:14 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:40:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865678
Fri 17 Jan 2014 08:40:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:40:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43865678
Fri 17 Jan 2014 08:40:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:40:18 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:40:18 - job_xml_thread(): Done retrieving: data size 43865678
Fri 17 Jan 2014 08:40:19 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:40:19 - XML: Start document: iteration 4
Fri 17 Jan 2014 08:40:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:40:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:40:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:40:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:40:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:40:31 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:40:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:40:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:40:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:40:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:40:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:40:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:40:32 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:40:32 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:40:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 08:40:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:40:36 - XML: Processed 655442 elements - found 622 jobs
Fri 17 Jan 2014 08:40:36 - job 7347622 report time 1389944226 does not match current heartbeat 1389944346 : ignoring job
Fri 17 Jan 2014 08:40:36 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 08:40:36 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 08:40:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:40:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:40:37 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 08:40:37 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:40:37 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:40:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:40:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:40:37 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:40:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:40:37 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:40:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:40:40 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:40:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43850065
Fri 17 Jan 2014 08:40:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:40:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43850065
Fri 17 Jan 2014 08:40:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:40:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:40:41 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:40:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:40:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 08:40:42 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:40:42 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:40:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 08:40:42 - size of cluster 'Render Cluster': 20 hosts 3139 metrics 4394 values 69328 bits 8666 bytes 
Fri 17 Jan 2014 08:40:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:40:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:40:52 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:40:52 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:40:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:40:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:40:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:40:53 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:40:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:40:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:40:54 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:40:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:40:54 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:40:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:40:54 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 08:40:54 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 08:40:54 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:40:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:40:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:40:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:40:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:40:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:40:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:40:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:40:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:40:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:40:59 - job_xml_thread(): Done retrieving: data size 43859041
Fri 17 Jan 2014 08:40:59 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:40:59 - XML: Start document: iteration 5
Fri 17 Jan 2014 08:40:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43859041
Fri 17 Jan 2014 08:40:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43859041
Fri 17 Jan 2014 08:40:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:40:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:41:09 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:41:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 08:41:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:41:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:41:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:41:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:41:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:41:19 - XML: Processed 655442 elements - found 622 jobs
Fri 17 Jan 2014 08:41:20 - job 7347622 report time 1389944226 does not match current heartbeat 1389944346 : ignoring job
Fri 17 Jan 2014 08:41:20 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 08:41:20 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 08:41:20 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:41:20 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:41:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:41:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:41:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:41:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:41:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:41:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:41:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:41:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:41:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:41:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:41:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:41:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:41:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:41:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:41:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:41:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:41:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:41:24 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:41:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43803316
Fri 17 Jan 2014 08:41:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:41:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43803316
Fri 17 Jan 2014 08:41:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:41:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:41:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:41:35 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:41:35 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:41:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:41:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:41:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:41:37 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:41:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:41:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:41:37 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:41:37 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:41:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:41:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:41:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:41:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:41:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:41:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:41:39 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:41:39 - job_xml_thread(): Done retrieving: data size 43291004
Fri 17 Jan 2014 08:41:39 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:41:39 - XML: Start document: iteration 6
Fri 17 Jan 2014 08:41:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43291004
Fri 17 Jan 2014 08:41:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:41:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43291004
Fri 17 Jan 2014 08:41:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:41:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:41:42 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:41:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:41:42 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:41:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 08:41:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 08:41:43 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:41:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9400 values 148290 bits 18536 bytes 
Fri 17 Jan 2014 08:41:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:41:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:41:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:41:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:41:53 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:41:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:41:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:41:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:41:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:41:53 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:41:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:41:57 - XML: Processed 648324 elements - found 620 jobs
Fri 17 Jan 2014 08:41:57 - job 7347540 appears to have finished
Fri 17 Jan 2014 08:41:57 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 08:41:57 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 08:41:57 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 08:41:57 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:41:57 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:41:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:41:59 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:41:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:41:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:42:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:42:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:42:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:42:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:42:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:42:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43198218
Fri 17 Jan 2014 08:42:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:42:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43198218
Fri 17 Jan 2014 08:42:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:42:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:42:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:42:12 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:42:12 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:42:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:42:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:42:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:42:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:42:14 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:42:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:42:14 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:42:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:42:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:42:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:42:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:42:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:42:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:42:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:42:16 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:42:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 08:42:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:42:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:42:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:42:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:42:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:42:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:42:18 - job_xml_thread(): Done retrieving: data size 43259970
Fri 17 Jan 2014 08:42:18 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:42:18 - XML: Start document: iteration 7
Fri 17 Jan 2014 08:42:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43259970
Fri 17 Jan 2014 08:42:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43259970
Fri 17 Jan 2014 08:42:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:42:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:42:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:42:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:42:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:42:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:42:36 - XML: Processed 647922 elements - found 625 jobs
Fri 17 Jan 2014 08:42:36 - job_xml_thread(): Found 5 updated jobs.
Fri 17 Jan 2014 08:42:36 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 08:42:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:42:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:42:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:42:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:42:39 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:42:39 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:42:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:42:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:42:39 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:42:40 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Fri 17 Jan 2014 08:42:40 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:42:40 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:42:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:42:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:42:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:42:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:42:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:42:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:42:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:42:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:42:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:42:43 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:42:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:42:43 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:42:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 08:42:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 08:42:43 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:42:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5793 values 91350 bits 11418 bytes 
Fri 17 Jan 2014 08:42:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:42:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43803616
Fri 17 Jan 2014 08:42:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:42:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43803616
Fri 17 Jan 2014 08:42:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:42:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:42:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:42:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:42:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:42:55 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:42:55 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:42:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:42:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:42:56 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:42:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:42:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:42:57 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:42:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:42:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:42:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:42:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:42:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:42:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:42:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:42:59 - job_xml_thread(): Done retrieving: data size 43859995
Fri 17 Jan 2014 08:42:59 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:42:59 - XML: Start document: iteration 8
Fri 17 Jan 2014 08:43:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43859995
Fri 17 Jan 2014 08:43:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43859995
Fri 17 Jan 2014 08:43:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:43:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:43:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:43:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:43:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:43:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:43:13 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:43:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:43:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:43:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:43:14 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:43:14 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:43:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:43:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:43:14 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:43:17 - XML: Processed 655436 elements - found 625 jobs
Fri 17 Jan 2014 08:43:17 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 08:43:18 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 08:43:18 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:43:18 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:43:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:43:21 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:43:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:43:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:43:21 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:43:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 08:43:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:43:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:43:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:43:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:43:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:43:22 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:43:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855534
Fri 17 Jan 2014 08:43:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:43:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855534
Fri 17 Jan 2014 08:43:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:43:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:43:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:43:33 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:43:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:43:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:43:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:43:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:43:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:43:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:43:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:43:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:43:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:43:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:43:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:43:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:43:37 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:43:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:43:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:43:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:43:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:43:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:43:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:43:39 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:43:39 - job_xml_thread(): Done retrieving: data size 43850690
Fri 17 Jan 2014 08:43:39 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:43:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43850690
Fri 17 Jan 2014 08:43:39 - XML: Start document: iteration 9
Fri 17 Jan 2014 08:43:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43850690
Fri 17 Jan 2014 08:43:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:43:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:43:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:43:43 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:43:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:43:43 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:43:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 08:43:43 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:43:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 08:43:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9316 values 146931 bits 18366 bytes 
Fri 17 Jan 2014 08:43:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:43:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:43:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:43:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:44:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:44:01 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:44:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:44:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:44:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:44:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:44:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:44:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:44:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:44:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:44:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:44:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:44:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:44:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:44:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:44:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:44:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:44:03 - XML: Processed 655436 elements - found 619 jobs
Fri 17 Jan 2014 08:44:03 - job 7347579 appears to have finished
Fri 17 Jan 2014 08:44:03 - job 7347571 appears to have finished
Fri 17 Jan 2014 08:44:03 - job 7347582 appears to have finished
Fri 17 Jan 2014 08:44:03 - job 7347623 appears to have finished
Fri 17 Jan 2014 08:44:03 - job 7347619 appears to have finished
Fri 17 Jan 2014 08:44:03 - job 7347596 appears to have finished
Fri 17 Jan 2014 08:44:03 - job_xml_thread(): Found 6 updated jobs.
Fri 17 Jan 2014 08:44:03 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 08:44:03 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Fri 17 Jan 2014 08:44:03 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:44:03 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:44:06 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:44:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875019
Fri 17 Jan 2014 08:44:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:44:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875019
Fri 17 Jan 2014 08:44:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:44:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:44:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:44:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:44:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:44:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:44:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:44:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:44:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:44:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:44:18 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:44:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:44:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:44:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:44:20 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:44:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:44:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:44:20 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:44:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 08:44:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:44:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:44:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:44:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:44:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:44:21 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:44:21 - job_xml_thread(): Done retrieving: data size 43880134
Fri 17 Jan 2014 08:44:21 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:44:21 - XML: Start document: iteration 10
Fri 17 Jan 2014 08:44:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43880134
Fri 17 Jan 2014 08:44:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:44:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43880134
Fri 17 Jan 2014 08:44:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:44:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:44:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:44:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:44:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:44:35 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:44:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:44:35 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:44:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:44:35 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:44:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:44:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:44:41 - XML: Processed 655442 elements - found 622 jobs
Fri 17 Jan 2014 08:44:41 - job 7347630 field 'start_timestamp' changed since saved from: 1389944503 to: 1389944460
Fri 17 Jan 2014 08:44:41 - job 7347629 field 'start_timestamp' changed since saved from: 1389944501 to: 1389944460
Fri 17 Jan 2014 08:44:41 - job_xml_thread(): Found 5 updated jobs.
Fri 17 Jan 2014 08:44:41 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 08:44:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:44:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:44:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:44:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:44:42 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Fri 17 Jan 2014 08:44:42 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:44:42 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:44:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:44:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:44:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:44:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:44:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:44:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43852447
Fri 17 Jan 2014 08:44:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:44:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43852447
Fri 17 Jan 2014 08:44:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:44:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:44:45 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:44:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:44:47 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:44:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 08:44:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 08:44:48 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:44:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9204 values 145226 bits 18153 bytes 
Fri 17 Jan 2014 08:44:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:44:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:44:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:44:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:44:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:44:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:44:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:44:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:44:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:44:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:44:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43852447
Fri 17 Jan 2014 08:44:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:44:57 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:44:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:44:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:44:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:45:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:45:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:45:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:45:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:45:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:45:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:45:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:45:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:45:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:45:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:45:07 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:45:07 - job_xml_thread(): Done retrieving: data size 43856177
Fri 17 Jan 2014 08:45:07 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:45:07 - XML: Start document: iteration 11
Fri 17 Jan 2014 08:45:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:45:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:45:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43856177
Fri 17 Jan 2014 08:45:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:45:08 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:45:08 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:45:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:45:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:45:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856177
Fri 17 Jan 2014 08:45:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:45:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:45:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:45:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:45:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:45:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:45:25 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:45:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:45:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:45:26 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:45:26 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:45:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:45:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:45:26 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:45:28 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 08:45:28 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:45:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:45:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:45:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:45:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:45:29 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:45:29 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:45:29 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 08:45:29 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 08:45:29 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 08:45:30 - XML: Processed 655442 elements - found 622 jobs
Fri 17 Jan 2014 08:45:30 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 08:45:30 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 08:45:30 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:45:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:45:30 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:45:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:45:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:45:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:45:30 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 964303 values 15211631 bits 1901453 bytes 
Fri 17 Jan 2014 08:45:31 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:45:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 08:45:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:45:34 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:45:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853412
Fri 17 Jan 2014 08:45:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:45:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853412
Fri 17 Jan 2014 08:45:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:45:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:45:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:45:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:45:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:45:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:45:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:45:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:45:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:45:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:45:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:45:44 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:45:45 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:45:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:45:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:45:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:45:47 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:45:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:45:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:45:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:45:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:45:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:45:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:45:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:45:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:45:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:45:48 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:45:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 08:45:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 08:45:48 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:45:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6016 values 94838 bits 11854 bytes 
Fri 17 Jan 2014 08:45:51 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:45:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43863458
Fri 17 Jan 2014 08:45:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:45:51 - job_xml_thread(): Done retrieving: data size 43863458
Fri 17 Jan 2014 08:45:51 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:45:51 - XML: Start document: iteration 12
Fri 17 Jan 2014 08:45:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43863458
Fri 17 Jan 2014 08:45:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:45:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:45:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:46:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:46:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:46:10 - XML: Processed 655438 elements - found 620 jobs
Fri 17 Jan 2014 08:46:10 - job 7347628 appears to have finished
Fri 17 Jan 2014 08:46:10 - job 7347569 appears to have finished
Fri 17 Jan 2014 08:46:11 - job 7347581 appears to have finished
Fri 17 Jan 2014 08:46:11 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 08:46:11 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 08:46:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:46:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:46:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:46:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:46:12 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 08:46:12 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:46:12 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:46:12 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:46:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:46:12 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:46:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:46:12 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:46:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:46:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:46:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:46:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:46:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:46:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:46:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:46:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:46:17 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:46:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 08:46:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:46:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:46:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43857355
Fri 17 Jan 2014 08:46:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:46:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43857355
Fri 17 Jan 2014 08:46:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:46:27 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:46:27 - job_xml_thread(): Done retrieving: data size 43857355
Fri 17 Jan 2014 08:46:27 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:46:27 - XML: Start document: iteration 13
Fri 17 Jan 2014 08:46:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:46:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:46:29 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:46:30 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 08:46:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:46:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:46:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:46:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:46:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:46:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:46:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:46:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:46:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:46:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:46:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:46:38 - XML: Processed 655438 elements - found 620 jobs
Fri 17 Jan 2014 08:46:38 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 08:46:38 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 08:46:38 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:46:38 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:46:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:46:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:46:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:46:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:46:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:46:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:46:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:46:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:46:44 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:46:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855295
Fri 17 Jan 2014 08:46:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:46:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855295
Fri 17 Jan 2014 08:46:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:46:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:46:48 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:46:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:46:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 08:46:49 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:46:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8177 values 129155 bits 16144 bytes 
Fri 17 Jan 2014 08:46:49 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:46:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 08:46:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:46:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:46:53 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:46:53 - job_xml_thread(): Done retrieving: data size 43855295
Fri 17 Jan 2014 08:46:53 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:46:53 - XML: Start document: iteration 14
Fri 17 Jan 2014 08:46:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:46:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:47:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:47:03 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:47:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:47:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:47:04 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:47:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:47:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:47:04 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:47:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:47:05 - XML: Processed 655438 elements - found 620 jobs
Fri 17 Jan 2014 08:47:05 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 08:47:05 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 08:47:05 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:47:05 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:47:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:47:06 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:47:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:47:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:47:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:47:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:47:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:47:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:47:09 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:47:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 08:47:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:47:10 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:47:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43794924
Fri 17 Jan 2014 08:47:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:47:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43794924
Fri 17 Jan 2014 08:47:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:47:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:47:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:47:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:47:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:47:20 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:47:20 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:47:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:47:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:47:20 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:47:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:47:20 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:47:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:47:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:47:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:47:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:47:26 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:47:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:47:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:47:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:47:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:47:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:47:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:47:29 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:47:29 - job_xml_thread(): Done retrieving: data size 43779551
Fri 17 Jan 2014 08:47:29 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:47:29 - XML: Start document: iteration 15
Fri 17 Jan 2014 08:47:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43779551
Fri 17 Jan 2014 08:47:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:47:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43779551
Fri 17 Jan 2014 08:47:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:47:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:47:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:47:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:47:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:47:48 - XML: Processed 654690 elements - found 620 jobs
Fri 17 Jan 2014 08:47:48 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 08:47:48 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 08:47:48 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:47:48 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:47:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:47:49 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:47:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:47:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:47:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:47:50 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:47:50 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:47:50 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:47:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:47:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:47:50 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:47:50 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:47:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 08:47:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:47:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 08:47:50 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:47:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99539 bits 12442 bytes 
Fri 17 Jan 2014 08:47:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:47:53 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:47:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:47:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:47:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:47:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:47:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:47:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:47:56 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:47:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43200422
Fri 17 Jan 2014 08:47:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:47:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43200422
Fri 17 Jan 2014 08:47:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:48:03 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:48:03 - job_xml_thread(): Done retrieving: data size 43200422
Fri 17 Jan 2014 08:48:03 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:48:03 - XML: Start document: iteration 16
Fri 17 Jan 2014 08:48:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:48:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:48:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:48:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:48:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:48:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:48:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:48:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:48:12 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:48:12 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:48:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:48:12 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:48:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:48:17 - XML: Processed 647345 elements - found 624 jobs
Fri 17 Jan 2014 08:48:17 - job 7347633 appears to have finished
Fri 17 Jan 2014 08:48:17 - job_xml_thread(): Found 6 updated jobs.
Fri 17 Jan 2014 08:48:17 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 08:48:18 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Fri 17 Jan 2014 08:48:18 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:48:18 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:48:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:48:20 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:48:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:48:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:48:20 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:48:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 08:48:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:48:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:48:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:48:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:48:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:48:23 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:48:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43252554
Fri 17 Jan 2014 08:48:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:48:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43252554
Fri 17 Jan 2014 08:48:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:48:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:48:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:48:33 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:48:34 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:48:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:48:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:48:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:48:38 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:48:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:48:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:48:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:48:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:48:39 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:48:39 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:48:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:48:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:48:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:48:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:48:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:48:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:48:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:48:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:48:42 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:48:42 - job_xml_thread(): Done retrieving: data size 43730557
Fri 17 Jan 2014 08:48:42 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:48:42 - XML: Start document: iteration 17
Fri 17 Jan 2014 08:48:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43730557
Fri 17 Jan 2014 08:48:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:48:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43730557
Fri 17 Jan 2014 08:48:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:48:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:48:50 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:48:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:48:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 08:48:51 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:48:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8776 values 138609 bits 17326 bytes 
Fri 17 Jan 2014 08:48:51 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:48:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 08:48:54 - XML: Processed 654102 elements - found 624 jobs
Fri 17 Jan 2014 08:48:54 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 08:48:54 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 08:48:54 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:48:54 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:48:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:48:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:48:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:48:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:49:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:49:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:49:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:49:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:49:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:49:03 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:49:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:49:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:49:03 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 08:49:03 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 08:49:03 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:49:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:49:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:49:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:49:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:49:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:49:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:49:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:49:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:49:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:49:06 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:49:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 08:49:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:49:06 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:49:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870330
Fri 17 Jan 2014 08:49:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:49:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870330
Fri 17 Jan 2014 08:49:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:49:09 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:49:10 - job_xml_thread(): Done retrieving: data size 43870330
Fri 17 Jan 2014 08:49:10 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:49:10 - XML: Start document: iteration 18
Fri 17 Jan 2014 08:49:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:49:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:49:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:49:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:49:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:49:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:49:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:49:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:49:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:49:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:49:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:49:25 - XML: Processed 655414 elements - found 624 jobs
Fri 17 Jan 2014 08:49:25 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 08:49:25 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 08:49:25 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:49:25 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:49:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:49:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:49:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:49:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:49:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:49:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:49:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:49:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:49:30 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:49:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43837686
Fri 17 Jan 2014 08:49:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:49:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43837686
Fri 17 Jan 2014 08:49:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:49:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:49:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:49:40 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:49:40 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:49:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:49:41 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:49:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:49:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:49:42 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:49:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:49:42 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:49:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:49:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:49:44 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:49:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:49:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:49:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:49:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:49:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:49:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:49:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:49:45 - job_xml_thread(): Done retrieving: data size 43857611
Fri 17 Jan 2014 08:49:45 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:49:45 - XML: Start document: iteration 19
Fri 17 Jan 2014 08:49:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43857611
Fri 17 Jan 2014 08:49:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:49:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43857611
Fri 17 Jan 2014 08:49:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:49:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:49:51 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:49:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:49:51 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:49:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 08:49:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 08:49:51 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:49:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9010 values 142191 bits 17773 bytes 
Fri 17 Jan 2014 08:49:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:49:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:49:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:49:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:50:06 - XML: Processed 655438 elements - found 620 jobs
Fri 17 Jan 2014 08:50:06 - job 7347470 appears to have finished
Fri 17 Jan 2014 08:50:07 - job 7347578 appears to have finished
Fri 17 Jan 2014 08:50:07 - job 7347636 appears to have finished
Fri 17 Jan 2014 08:50:07 - job 7347632 appears to have finished
Fri 17 Jan 2014 08:50:07 - job 7347642 field 'start_timestamp' changed since saved from: 1389944887 to: 1389944826
Fri 17 Jan 2014 08:50:07 - job 7347640 report time 1389944829 does not match current heartbeat 1389944949 : ignoring job
Fri 17 Jan 2014 08:50:07 - job 7347641 field 'start_timestamp' changed since saved from: 1389944885 to: 1389944826
Fri 17 Jan 2014 08:50:07 - job 7347588 appears to have finished
Fri 17 Jan 2014 08:50:07 - job_xml_thread(): Found 8 updated jobs.
Fri 17 Jan 2014 08:50:07 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 08:50:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:50:09 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:50:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:50:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:50:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:50:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:50:09 - job_xml_thread(): Done storing. succesfully stored: 8 jobs
Fri 17 Jan 2014 08:50:09 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:50:09 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:50:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:50:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:50:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:50:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:50:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:50:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:50:10 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:50:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:50:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:50:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:50:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:50:11 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:50:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 08:50:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:50:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:50:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43866723
Fri 17 Jan 2014 08:50:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:50:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43866723
Fri 17 Jan 2014 08:50:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:50:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:50:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:50:24 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:50:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:50:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:50:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:50:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:50:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:50:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:50:25 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:50:25 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:50:25 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:50:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:50:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:50:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:50:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:50:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:50:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:50:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:50:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:50:27 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:50:27 - job_xml_thread(): Done retrieving: data size 43868894
Fri 17 Jan 2014 08:50:27 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:50:27 - XML: Start document: iteration 20
Fri 17 Jan 2014 08:50:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43868894
Fri 17 Jan 2014 08:50:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:50:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43868894
Fri 17 Jan 2014 08:50:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:50:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:50:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:50:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:50:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:50:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:50:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:50:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:50:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:50:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:50:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:50:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:50:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:50:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:50:47 - XML: Processed 655438 elements - found 620 jobs
Fri 17 Jan 2014 08:50:47 - job 7347640 report time 1389944829 does not match current heartbeat 1389944949 : ignoring job
Fri 17 Jan 2014 08:50:47 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 08:50:47 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 08:50:47 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:50:47 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:50:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:50:49 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:50:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:50:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:50:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:50:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:50:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:50:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:50:51 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:50:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43876905
Fri 17 Jan 2014 08:50:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:50:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43876905
Fri 17 Jan 2014 08:50:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:50:51 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:50:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:50:53 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:50:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:50:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 08:50:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 08:50:53 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:50:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148631 bits 18578 bytes 
Fri 17 Jan 2014 08:50:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:50:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:51:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:51:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:51:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:51:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:51:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:51:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:51:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:51:02 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:51:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:51:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:51:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:51:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:51:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:51:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:51:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:51:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:51:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:51:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:51:07 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:51:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875666
Fri 17 Jan 2014 08:51:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:51:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875666
Fri 17 Jan 2014 08:51:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:51:08 - job_xml_thread(): Done retrieving: data size 43875666
Fri 17 Jan 2014 08:51:08 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:51:08 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 08:51:10 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 08:51:10 - Housekeeping: done.
Fri 17 Jan 2014 08:51:10 - XML: Start document: iteration 0
Fri 17 Jan 2014 08:51:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:51:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:51:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:51:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:51:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:51:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:51:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:51:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:51:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:51:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:51:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:51:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:51:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:51:27 - XML: Processed 655435 elements - found 620 jobs
Fri 17 Jan 2014 08:51:27 - job 7347640 report time 1389944829 does not match current heartbeat 1389944949 : ignoring job
Fri 17 Jan 2014 08:51:27 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 08:51:27 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 08:51:27 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:51:27 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:51:29 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:51:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 08:51:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:51:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:51:30 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:51:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:51:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:51:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:51:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:51:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:51:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:51:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:51:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43836589
Fri 17 Jan 2014 08:51:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:51:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43836589
Fri 17 Jan 2014 08:51:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:51:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:51:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:51:42 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:51:42 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:51:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:51:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:51:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:51:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:51:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:51:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:51:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:51:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:51:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:51:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:51:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:51:46 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:51:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:51:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:51:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:51:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:51:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:51:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:51:48 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:51:48 - job_xml_thread(): Done retrieving: data size 43860425
Fri 17 Jan 2014 08:51:48 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:51:48 - XML: Start document: iteration 1
Fri 17 Jan 2014 08:51:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43860425
Fri 17 Jan 2014 08:51:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43860425
Fri 17 Jan 2014 08:51:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:51:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:51:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:51:55 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:51:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:51:56 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:51:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 08:51:56 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:51:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 08:51:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9003 values 142050 bits 17756 bytes 
Fri 17 Jan 2014 08:51:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:51:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:52:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:52:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:52:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:52:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:52:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:52:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:52:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:52:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:52:05 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:52:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:52:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:52:05 - XML: Processed 655438 elements - found 620 jobs
Fri 17 Jan 2014 08:52:05 - job 7347643 report time 1389944949 does not match current heartbeat 1389945070 : ignoring job
Fri 17 Jan 2014 08:52:05 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 08:52:05 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 08:52:05 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 08:52:05 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:52:05 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:52:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:52:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:52:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:52:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:52:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:52:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:52:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:52:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:52:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:52:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43850748
Fri 17 Jan 2014 08:52:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:52:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43850748
Fri 17 Jan 2014 08:52:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:52:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:52:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:52:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:52:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:52:20 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:52:20 - job_xml_thread(): Done retrieving: data size 43850748
Fri 17 Jan 2014 08:52:20 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:52:20 - XML: Start document: iteration 2
Fri 17 Jan 2014 08:52:20 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:52:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:52:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43850748
Fri 17 Jan 2014 08:52:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:52:20 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:52:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:52:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:52:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:52:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:52:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:52:30 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 08:52:30 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:52:31 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:52:31 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 08:52:31 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 08:52:31 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:52:31 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Fri 17 Jan 2014 08:52:34 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:52:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 08:52:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:52:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:52:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:52:37 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:52:37 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:52:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:52:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:52:37 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:52:37 - XML: Processed 655438 elements - found 620 jobs
Fri 17 Jan 2014 08:52:38 - job 7347643 report time 1389944949 does not match current heartbeat 1389945070 : ignoring job
Fri 17 Jan 2014 08:52:38 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 08:52:38 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 08:52:38 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:52:38 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:52:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:52:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:52:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:52:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:52:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:52:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:52:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:52:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:52:40 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:52:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43859387
Fri 17 Jan 2014 08:52:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:52:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43859387
Fri 17 Jan 2014 08:52:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:52:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:52:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:52:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:52:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:52:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:52:53 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:52:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:52:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:52:53 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:52:53 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:52:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:52:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:52:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:52:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:52:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:52:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:52:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:52:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:52:55 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:52:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862689
Fri 17 Jan 2014 08:52:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:52:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862689
Fri 17 Jan 2014 08:52:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:52:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:52:56 - job_xml_thread(): Done retrieving: data size 43862689
Fri 17 Jan 2014 08:52:56 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:52:56 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:52:56 - XML: Start document: iteration 3
Fri 17 Jan 2014 08:52:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:52:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 08:52:57 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:52:57 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:52:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 08:52:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8993 values 141855 bits 17731 bytes 
Fri 17 Jan 2014 08:53:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:53:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:53:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:53:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:53:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:53:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:53:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:53:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:53:11 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:53:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:53:11 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:53:11 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:53:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:53:16 - XML: Processed 655438 elements - found 620 jobs
Fri 17 Jan 2014 08:53:16 - job 7347643 report time 1389944949 does not match current heartbeat 1389945070 : ignoring job
Fri 17 Jan 2014 08:53:16 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 08:53:16 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 08:53:16 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:53:16 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:53:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:53:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:53:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:53:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:53:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:53:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:53:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:53:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:53:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:53:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43787265
Fri 17 Jan 2014 08:53:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:53:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43787265
Fri 17 Jan 2014 08:53:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:53:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:53:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:53:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:53:29 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:53:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:53:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:53:30 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:53:30 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:53:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:53:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:53:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43787265
Fri 17 Jan 2014 08:53:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:53:31 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:53:31 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:53:31 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:53:31 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:53:32 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:53:32 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:53:33 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 08:53:33 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 08:53:33 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 08:53:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:53:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:53:42 - size of cluster 'LISA Cluster': 624 hosts 79485 metrics 953422 values 15050751 bits 1881343 bytes 
Fri 17 Jan 2014 08:53:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:53:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:53:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:53:44 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:53:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:53:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:53:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:53:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:53:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:53:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:53:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:53:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:53:45 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:53:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 08:53:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:53:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:53:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:53:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:53:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:53:48 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:53:48 - job_xml_thread(): Done retrieving: data size 43300525
Fri 17 Jan 2014 08:53:48 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:53:48 - XML: Start document: iteration 4
Fri 17 Jan 2014 08:53:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43300525
Fri 17 Jan 2014 08:53:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:53:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43300525
Fri 17 Jan 2014 08:53:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:53:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:53:58 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:53:59 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:53:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:53:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 08:53:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 08:53:59 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:54:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5771 values 90989 bits 11373 bytes 
Fri 17 Jan 2014 08:54:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:54:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:54:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:54:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:54:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:54:06 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:54:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:54:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:54:08 - XML: Processed 648987 elements - found 621 jobs
Fri 17 Jan 2014 08:54:08 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:54:08 - job 7347643 report time 1389944949 does not match current heartbeat 1389945191 : ignoring job
Fri 17 Jan 2014 08:54:08 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:54:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:54:08 - job 7347645 report time 1389945070 does not match current heartbeat 1389945191 : ignoring job
Fri 17 Jan 2014 08:54:08 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 08:54:08 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 08:54:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:54:08 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:54:09 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 08:54:09 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:54:09 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:54:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:54:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:54:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:54:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:54:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:54:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:54:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:54:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:54:15 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:54:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43257246
Fri 17 Jan 2014 08:54:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:54:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43257246
Fri 17 Jan 2014 08:54:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:54:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:54:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:54:24 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:54:24 - job_xml_thread(): Done retrieving: data size 43257246
Fri 17 Jan 2014 08:54:24 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:54:25 - XML: Start document: iteration 5
Fri 17 Jan 2014 08:54:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:54:25 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:54:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:54:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:54:26 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:54:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:54:26 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:54:26 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:54:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:54:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:54:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:54:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:54:32 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:54:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:54:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:54:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:54:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:54:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:54:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:54:33 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:54:33 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 08:54:36 - XML: Processed 647912 elements - found 620 jobs
Fri 17 Jan 2014 08:54:36 - job 7347645 report time 1389945070 does not match current heartbeat 1389945191 : ignoring job
Fri 17 Jan 2014 08:54:36 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 08:54:36 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 08:54:36 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:54:36 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:54:37 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:54:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 08:54:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:54:40 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:54:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43440199
Fri 17 Jan 2014 08:54:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:54:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43440199
Fri 17 Jan 2014 08:54:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:54:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:54:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:54:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:54:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:54:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:54:49 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:54:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:54:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:54:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:54:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:54:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:54:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:54:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43440199
Fri 17 Jan 2014 08:54:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:54:52 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:54:52 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:54:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:54:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:54:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:54:59 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:55:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:55:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:55:00 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:55:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 08:55:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:55:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 08:55:00 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:55:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6032 values 95169 bits 11896 bytes 
Fri 17 Jan 2014 08:55:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:55:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:55:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:55:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:55:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:55:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:55:04 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:55:04 - job_xml_thread(): Done retrieving: data size 43836181
Fri 17 Jan 2014 08:55:04 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:55:04 - XML: Start document: iteration 6
Fri 17 Jan 2014 08:55:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43836181
Fri 17 Jan 2014 08:55:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:55:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:55:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:55:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:55:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:55:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:55:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:55:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43836181
Fri 17 Jan 2014 08:55:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:55:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:55:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:55:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:55:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:55:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:55:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:55:21 - XML: Processed 655402 elements - found 620 jobs
Fri 17 Jan 2014 08:55:21 - job 7347645 report time 1389945070 does not match current heartbeat 1389945191 : ignoring job
Fri 17 Jan 2014 08:55:21 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 08:55:21 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 08:55:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:55:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:55:21 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:55:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:55:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:55:21 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:55:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:55:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:55:25 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:55:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:55:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:55:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:55:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:55:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:55:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:55:26 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:55:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 08:55:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:55:28 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:55:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43841542
Fri 17 Jan 2014 08:55:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:55:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43841542
Fri 17 Jan 2014 08:55:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:55:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:55:36 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:55:36 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:55:36 - job_xml_thread(): Done retrieving: data size 43841542
Fri 17 Jan 2014 08:55:36 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:55:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:55:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:55:36 - XML: Start document: iteration 7
Fri 17 Jan 2014 08:55:37 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:55:37 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:55:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:55:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43841542
Fri 17 Jan 2014 08:55:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:55:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:55:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:55:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:55:50 - XML: Processed 655438 elements - found 620 jobs
Fri 17 Jan 2014 08:55:51 - job 7347645 report time 1389945070 does not match current heartbeat 1389945191 : ignoring job
Fri 17 Jan 2014 08:55:51 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 08:55:51 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 08:55:51 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:55:51 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:55:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:55:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:55:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:55:56 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:55:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:55:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:55:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:55:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:55:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:55:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:55:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:55:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:55:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:55:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:55:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:55:58 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 08:55:58 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 08:55:58 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:55:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:55:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:55:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:55:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:55:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:55:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43871590
Fri 17 Jan 2014 08:55:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:56:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43871590
Fri 17 Jan 2014 08:56:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:56:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:56:01 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:56:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:56:01 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:56:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 08:56:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 08:56:02 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:56:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8727 values 137611 bits 17201 bytes 
Fri 17 Jan 2014 08:56:06 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:56:07 - job_xml_thread(): Done retrieving: data size 43871590
Fri 17 Jan 2014 08:56:07 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:56:07 - XML: Start document: iteration 8
Fri 17 Jan 2014 08:56:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:56:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:56:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:56:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:56:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:56:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:56:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:56:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:56:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:56:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:56:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:56:21 - XML: Processed 655436 elements - found 619 jobs
Fri 17 Jan 2014 08:56:21 - job 7347144 appears to have finished
Fri 17 Jan 2014 08:56:21 - job 7344473 appears to have finished
Fri 17 Jan 2014 08:56:21 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 08:56:21 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 08:56:21 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 08:56:21 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:56:21 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:56:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:56:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:56:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:56:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:56:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:56:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:56:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:56:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:56:23 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:56:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 08:56:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:56:24 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:56:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43839759
Fri 17 Jan 2014 08:56:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:56:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43839759
Fri 17 Jan 2014 08:56:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:56:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:56:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:56:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:56:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:56:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:56:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:56:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:56:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:56:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:56:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:56:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:56:36 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:56:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:56:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:56:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:56:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:56:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:56:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:56:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:56:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:56:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:56:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:56:42 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:56:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853327
Fri 17 Jan 2014 08:56:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:56:42 - job_xml_thread(): Done retrieving: data size 43853327
Fri 17 Jan 2014 08:56:42 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:56:42 - XML: Start document: iteration 9
Fri 17 Jan 2014 08:56:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853327
Fri 17 Jan 2014 08:56:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:56:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:56:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:56:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:56:53 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:56:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:56:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:56:54 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:56:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:56:54 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:56:54 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:56:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:56:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:56:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:57:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:57:02 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:57:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:57:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 08:57:03 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:57:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99089 bits 12386 bytes 
Fri 17 Jan 2014 08:57:03 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:57:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 08:57:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:57:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:57:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:57:04 - XML: Processed 655436 elements - found 619 jobs
Fri 17 Jan 2014 08:57:04 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 08:57:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:57:04 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 08:57:04 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:57:04 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:57:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:57:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:57:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:57:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:57:07 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:57:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856605
Fri 17 Jan 2014 08:57:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:57:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43856605
Fri 17 Jan 2014 08:57:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:57:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:57:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:57:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:57:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:57:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:57:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:57:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:57:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:57:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:57:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:57:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856605
Fri 17 Jan 2014 08:57:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:57:20 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:57:20 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:57:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:57:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:57:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:57:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:57:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:57:26 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:57:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:57:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:57:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:57:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:57:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:57:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:57:26 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:57:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 08:57:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:57:28 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:57:28 - job_xml_thread(): Done retrieving: data size 43851309
Fri 17 Jan 2014 08:57:28 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:57:28 - XML: Start document: iteration 10
Fri 17 Jan 2014 08:57:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851309
Fri 17 Jan 2014 08:57:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:57:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:57:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:57:32 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:57:32 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:57:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:57:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851309
Fri 17 Jan 2014 08:57:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:57:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:57:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:57:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:57:46 - XML: Processed 655436 elements - found 619 jobs
Fri 17 Jan 2014 08:57:46 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 08:57:46 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 08:57:46 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:57:46 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:57:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:57:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:57:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:57:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:57:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:57:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:57:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:57:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:57:48 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:57:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:57:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:57:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:57:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:57:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:57:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:57:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:57:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:57:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:57:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:57:53 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:57:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43882116
Fri 17 Jan 2014 08:57:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:57:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43882116
Fri 17 Jan 2014 08:57:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:58:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:58:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:58:02 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:58:02 - job_xml_thread(): Done retrieving: data size 43882116
Fri 17 Jan 2014 08:58:03 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:58:03 - XML: Start document: iteration 11
Fri 17 Jan 2014 08:58:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:58:03 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:58:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:58:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:58:04 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:58:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:58:04 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:58:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:58:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 08:58:04 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:58:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 08:58:04 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:58:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:58:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8837 values 139375 bits 17421 bytes 
Fri 17 Jan 2014 08:58:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:58:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:58:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:58:15 - XML: Processed 655434 elements - found 618 jobs
Fri 17 Jan 2014 08:58:15 - job 7347345 appears to have finished
Fri 17 Jan 2014 08:58:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:58:15 - job 7347648 report time 1389945311 does not match current heartbeat 1389945432 : ignoring job
Fri 17 Jan 2014 08:58:15 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:58:15 - job 7347649 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 08:58:15 - job 7347646 appears to have finished
Fri 17 Jan 2014 08:58:15 - job 7346851 appears to have finished
Fri 17 Jan 2014 08:58:15 - job 7345096 appears to have finished
Fri 17 Jan 2014 08:58:15 - job_xml_thread(): Found 8 updated jobs.
Fri 17 Jan 2014 08:58:15 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 08:58:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:58:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:58:15 - job_xml_thread(): Done storing. succesfully stored: 8 jobs
Fri 17 Jan 2014 08:58:15 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:58:15 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:58:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:58:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:58:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:58:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:58:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:58:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43833289
Fri 17 Jan 2014 08:58:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:58:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43833289
Fri 17 Jan 2014 08:58:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:58:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:58:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:58:30 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:58:30 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:58:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:58:31 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:58:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:58:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:58:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:58:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:58:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:58:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:58:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:58:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:58:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:58:32 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:58:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:58:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:58:33 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:58:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 08:58:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:58:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:58:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:58:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:58:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:58:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:58:35 - job_xml_thread(): Done retrieving: data size 43873147
Fri 17 Jan 2014 08:58:35 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:58:35 - XML: Start document: iteration 12
Fri 17 Jan 2014 08:58:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873147
Fri 17 Jan 2014 08:58:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:58:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873147
Fri 17 Jan 2014 08:58:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:58:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:58:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:58:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:58:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:58:51 - XML: Processed 655434 elements - found 618 jobs
Fri 17 Jan 2014 08:58:51 - job 7347648 report time 1389945311 does not match current heartbeat 1389945432 : ignoring job
Fri 17 Jan 2014 08:58:51 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 08:58:51 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 08:58:51 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:58:51 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:58:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:58:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:58:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:58:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:58:53 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:58:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:58:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:58:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:58:53 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:58:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:58:55 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:58:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:58:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:58:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:58:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:58:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:58:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:58:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:58:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865603
Fri 17 Jan 2014 08:58:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:58:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43865603
Fri 17 Jan 2014 08:58:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:59:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:59:04 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:59:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:59:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 08:59:06 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:59:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 08:59:06 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:59:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8727 values 137557 bits 17194 bytes 
Fri 17 Jan 2014 08:59:07 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:59:07 - job_xml_thread(): Done retrieving: data size 43865603
Fri 17 Jan 2014 08:59:07 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:59:07 - XML: Start document: iteration 13
Fri 17 Jan 2014 08:59:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:59:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:59:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:59:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:59:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:59:13 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:59:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:59:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:59:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:59:15 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:59:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:59:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:59:16 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:59:16 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:59:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:59:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:59:17 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:59:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:59:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:59:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:59:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:59:20 - XML: Processed 655434 elements - found 618 jobs
Fri 17 Jan 2014 08:59:20 - job 7347648 report time 1389945311 does not match current heartbeat 1389945432 : ignoring job
Fri 17 Jan 2014 08:59:20 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 08:59:20 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 08:59:20 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 08:59:20 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 08:59:22 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:59:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43798761
Fri 17 Jan 2014 08:59:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:59:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43798761
Fri 17 Jan 2014 08:59:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:59:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:59:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:59:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:59:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:59:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:59:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:59:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:59:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:59:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:59:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:59:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 08:59:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:59:34 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:59:35 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 08:59:35 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 08:59:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 08:59:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:59:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 08:59:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 08:59:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 08:59:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 08:59:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:59:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 08:59:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 08:59:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 08:59:40 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 08:59:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43283599
Fri 17 Jan 2014 08:59:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 08:59:41 - job_xml_thread(): Done retrieving: data size 43283599
Fri 17 Jan 2014 08:59:41 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 08:59:41 - XML: Start document: iteration 14
Fri 17 Jan 2014 08:59:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43283599
Fri 17 Jan 2014 08:59:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 08:59:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 08:59:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:59:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 08:59:54 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 08:59:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 08:59:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 08:59:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 08:59:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 08:59:56 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:59:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 08:59:56 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 08:59:56 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 08:59:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:00:00 - XML: Processed 648308 elements - found 616 jobs
Fri 17 Jan 2014 09:00:00 - job 7347605 appears to have finished
Fri 17 Jan 2014 09:00:00 - job 7347603 appears to have finished
Fri 17 Jan 2014 09:00:00 - job 7347648 report time 1389945311 does not match current heartbeat 1389945432 : ignoring job
Fri 17 Jan 2014 09:00:00 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 09:00:00 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 09:00:01 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 09:00:02 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:00:02 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:00:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:00:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:00:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:00:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:00:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:00:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:00:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:00:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:00:04 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:00:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43181819
Fri 17 Jan 2014 09:00:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:00:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43181819
Fri 17 Jan 2014 09:00:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:00:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:00:06 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:00:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:00:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 09:00:09 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:00:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 09:00:10 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:00:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9311 values 146861 bits 18357 bytes 
Fri 17 Jan 2014 09:00:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:00:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:00:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:00:14 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:00:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:00:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:00:16 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:00:16 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:00:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:00:16 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:00:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:00:17 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:00:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:00:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:00:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:00:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:00:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:00:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:00:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:00:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:00:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:00:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43267900
Fri 17 Jan 2014 09:00:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:00:20 - job_xml_thread(): Done retrieving: data size 43267900
Fri 17 Jan 2014 09:00:20 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:00:20 - XML: Start document: iteration 15
Fri 17 Jan 2014 09:00:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43267900
Fri 17 Jan 2014 09:00:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:00:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:00:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:00:33 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 09:00:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:00:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:00:34 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:00:34 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:00:34 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 09:00:34 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 09:00:34 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:00:34 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 09:00:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:00:38 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:00:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:00:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:00:38 - size of cluster 'LISA Cluster': 624 hosts 79472 metrics 873806 values 13784758 bits 1723094 bytes 
Fri 17 Jan 2014 09:00:39 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:00:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:00:39 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:00:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:00:39 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:00:41 - XML: Processed 647978 elements - found 616 jobs
Fri 17 Jan 2014 09:00:41 - job 7347652 report time 1389945432 does not match current heartbeat 1389945552 : ignoring job
Fri 17 Jan 2014 09:00:41 - job 7347653 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 09:00:41 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 09:00:41 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 09:00:42 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 09:00:42 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:00:42 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:00:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:00:45 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:00:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:00:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:00:45 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:00:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 09:00:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:00:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:00:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:00:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:00:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:00:48 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:00:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43770406
Fri 17 Jan 2014 09:00:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:00:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43770406
Fri 17 Jan 2014 09:00:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:00:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:00:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:00:57 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:00:57 - job_xml_thread(): Done retrieving: data size 43770406
Fri 17 Jan 2014 09:00:57 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:00:57 - XML: Start document: iteration 16
Fri 17 Jan 2014 09:00:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:00:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:00:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:00:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:01:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:01:01 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:01:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:01:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:01:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:01:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:01:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:01:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:01:08 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:01:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:01:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:01:08 - XML: Processed 654590 elements - found 616 jobs
Fri 17 Jan 2014 09:01:08 - job 7347652 report time 1389945432 does not match current heartbeat 1389945552 : ignoring job
Fri 17 Jan 2014 09:01:08 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:01:08 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:01:08 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:01:08 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:01:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:01:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:01:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:01:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:01:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:01:09 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:01:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:01:10 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:01:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 09:01:10 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:01:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 09:01:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5699 values 89914 bits 11239 bytes 
Fri 17 Jan 2014 09:01:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:01:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856198
Fri 17 Jan 2014 09:01:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:01:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43856198
Fri 17 Jan 2014 09:01:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:01:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:01:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:01:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:01:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:01:24 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:01:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:01:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:01:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:01:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:01:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:01:25 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:01:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:01:25 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:01:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:01:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:01:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:01:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:01:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:01:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:01:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:01:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:01:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:01:29 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:01:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 09:01:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:01:31 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:01:31 - job_xml_thread(): Done retrieving: data size 43836766
Fri 17 Jan 2014 09:01:31 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:01:31 - XML: Start document: iteration 17
Fri 17 Jan 2014 09:01:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43836766
Fri 17 Jan 2014 09:01:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43836766
Fri 17 Jan 2014 09:01:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:01:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:01:34 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:01:34 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 09:01:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:01:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:01:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:01:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:01:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:01:49 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:01:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:01:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:01:51 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:01:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:01:51 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:01:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:01:52 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:01:54 - XML: Processed 655430 elements - found 616 jobs
Fri 17 Jan 2014 09:01:54 - job 7347652 report time 1389945432 does not match current heartbeat 1389945552 : ignoring job
Fri 17 Jan 2014 09:01:54 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:01:54 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:01:54 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:01:54 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:01:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:01:55 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:01:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:01:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:01:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:01:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:01:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:01:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:01:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:01:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43871581
Fri 17 Jan 2014 09:01:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:01:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43871581
Fri 17 Jan 2014 09:01:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:02:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:02:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:02:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:02:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:02:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:02:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:02:09 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:02:09 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:02:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:02:10 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:02:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:02:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:02:10 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:02:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 09:02:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:02:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:02:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:02:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 09:02:10 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:02:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8142 values 128646 bits 16080 bytes 
Fri 17 Jan 2014 09:02:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:02:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:02:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:02:12 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:02:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:02:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:02:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:02:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:02:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:02:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:02:16 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:02:16 - job_xml_thread(): Done retrieving: data size 43850545
Fri 17 Jan 2014 09:02:16 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:02:16 - XML: Start document: iteration 18
Fri 17 Jan 2014 09:02:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43850545
Fri 17 Jan 2014 09:02:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:02:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43850545
Fri 17 Jan 2014 09:02:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:02:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:02:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:02:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:02:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:02:36 - XML: Processed 655432 elements - found 617 jobs
Fri 17 Jan 2014 09:02:36 - job 7347654 report time 1389945552 does not match current heartbeat 1389945673 : ignoring job
Fri 17 Jan 2014 09:02:36 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 09:02:36 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 09:02:37 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 09:02:37 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:02:37 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:02:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:02:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:02:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:02:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:02:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:02:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:02:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:02:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:02:40 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:02:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:02:41 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:02:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:02:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:02:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:02:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:02:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:02:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:02:41 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:02:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 09:02:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:02:44 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:02:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43860166
Fri 17 Jan 2014 09:02:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:02:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43860166
Fri 17 Jan 2014 09:02:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:02:52 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:02:52 - job_xml_thread(): Done retrieving: data size 43860166
Fri 17 Jan 2014 09:02:52 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:02:52 - XML: Start document: iteration 19
Fri 17 Jan 2014 09:02:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:02:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:02:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:02:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:02:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:02:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:02:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:02:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:02:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:02:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:02:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:02:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:02:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:03:04 - XML: Processed 655432 elements - found 617 jobs
Fri 17 Jan 2014 09:03:04 - job 7347654 report time 1389945552 does not match current heartbeat 1389945673 : ignoring job
Fri 17 Jan 2014 09:03:04 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:03:04 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:03:04 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:03:04 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:03:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:03:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:03:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:03:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:03:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:03:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:03:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:03:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:03:10 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:03:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43852528
Fri 17 Jan 2014 09:03:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:03:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:03:11 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:03:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43852528
Fri 17 Jan 2014 09:03:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:03:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:03:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 09:03:11 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:03:11 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:03:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8838 values 139742 bits 17467 bytes 
Fri 17 Jan 2014 09:03:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 09:03:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:03:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:03:19 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:03:19 - job_xml_thread(): Done retrieving: data size 43852528
Fri 17 Jan 2014 09:03:19 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:03:20 - XML: Start document: iteration 20
Fri 17 Jan 2014 09:03:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:03:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:03:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:03:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:03:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:03:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:03:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:03:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:03:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:03:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:03:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:03:31 - XML: Processed 655432 elements - found 617 jobs
Fri 17 Jan 2014 09:03:31 - job 7347654 report time 1389945552 does not match current heartbeat 1389945673 : ignoring job
Fri 17 Jan 2014 09:03:31 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:03:31 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:03:31 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:03:31 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:03:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:03:34 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:03:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:03:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:03:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:03:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:03:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:03:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:03:38 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:03:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43843137
Fri 17 Jan 2014 09:03:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:03:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43843137
Fri 17 Jan 2014 09:03:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:03:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:03:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:03:46 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:03:46 - job_xml_thread(): Done retrieving: data size 43843137
Fri 17 Jan 2014 09:03:46 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:03:46 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 09:03:47 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 09:03:47 - Housekeeping: done.
Fri 17 Jan 2014 09:03:47 - XML: Start document: iteration 0
Fri 17 Jan 2014 09:03:49 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:03:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 09:03:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:03:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:03:49 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:03:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:03:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:03:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:03:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:03:50 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:03:50 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:03:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:03:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:03:50 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:03:57 - XML: Processed 655429 elements - found 617 jobs
Fri 17 Jan 2014 09:03:57 - job 7347654 report time 1389945552 does not match current heartbeat 1389945673 : ignoring job
Fri 17 Jan 2014 09:03:57 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:03:57 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:03:57 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:03:57 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:04:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:04:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:04:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:04:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:04:00 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 09:04:00 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 09:04:00 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:04:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:04:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:04:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:04:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:04:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:04:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43838489
Fri 17 Jan 2014 09:04:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:04:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43838489
Fri 17 Jan 2014 09:04:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:04:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:04:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:04:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:04:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:04:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:04:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:04:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:04:11 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:04:11 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:04:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:04:11 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:04:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:04:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43838489
Fri 17 Jan 2014 09:04:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:04:12 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:04:12 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:04:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:04:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 09:04:14 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:04:14 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:04:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 09:04:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6105 values 96368 bits 12046 bytes 
Fri 17 Jan 2014 09:04:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:04:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:04:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:04:23 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:04:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:04:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:04:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:04:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:04:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:04:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:04:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:04:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:04:26 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:04:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 09:04:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:04:26 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:04:26 - job_xml_thread(): Done retrieving: data size 43849094
Fri 17 Jan 2014 09:04:26 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:04:26 - XML: Start document: iteration 1
Fri 17 Jan 2014 09:04:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:04:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:04:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43849094
Fri 17 Jan 2014 09:04:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:04:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:04:27 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:04:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:04:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:04:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43849094
Fri 17 Jan 2014 09:04:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:04:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:04:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:04:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:04:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:04:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:04:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:04:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:04:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:04:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:04:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:04:43 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:04:45 - XML: Processed 655430 elements - found 616 jobs
Fri 17 Jan 2014 09:04:45 - job 7347608 appears to have finished
Fri 17 Jan 2014 09:04:45 - job 7346772 appears to have finished
Fri 17 Jan 2014 09:04:45 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 09:04:45 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 09:04:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:04:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:04:47 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 09:04:47 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:04:47 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:04:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:04:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:04:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:04:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:04:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:04:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:04:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:04:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855153
Fri 17 Jan 2014 09:04:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:04:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855153
Fri 17 Jan 2014 09:04:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:04:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:04:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:04:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:04:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:04:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:04:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:05:01 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:05:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:05:01 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:05:01 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:05:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:05:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:05:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:05:02 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:05:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:05:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:05:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:05:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:05:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:05:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:05:04 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:05:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43863851
Fri 17 Jan 2014 09:05:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:05:04 - job_xml_thread(): Done retrieving: data size 43863851
Fri 17 Jan 2014 09:05:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43863851
Fri 17 Jan 2014 09:05:05 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:05:05 - XML: Start document: iteration 2
Fri 17 Jan 2014 09:05:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:05:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:05:14 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:05:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:05:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:05:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:05:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 09:05:16 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:05:16 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:05:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 09:05:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:05:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148587 bits 18573 bytes 
Fri 17 Jan 2014 09:05:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:05:17 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:05:17 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:05:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:05:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:05:17 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:05:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:05:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:05:23 - XML: Processed 655430 elements - found 616 jobs
Fri 17 Jan 2014 09:05:23 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:05:23 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:05:23 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:05:23 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:05:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:05:26 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:05:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:05:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:05:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:05:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:05:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:05:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:05:28 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:05:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 09:05:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:05:28 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:05:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43779001
Fri 17 Jan 2014 09:05:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:05:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43779001
Fri 17 Jan 2014 09:05:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:05:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:05:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:05:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:05:38 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:05:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:05:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:05:38 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:05:39 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:05:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:05:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:05:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:05:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:05:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:05:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:05:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:05:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:05:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:05:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:05:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:05:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:05:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:05:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:05:44 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:05:44 - job_xml_thread(): Done retrieving: data size 43253393
Fri 17 Jan 2014 09:05:44 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:05:44 - XML: Start document: iteration 3
Fri 17 Jan 2014 09:05:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43253393
Fri 17 Jan 2014 09:05:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:05:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43253393
Fri 17 Jan 2014 09:05:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:05:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:05:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:05:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:05:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:05:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:05:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:05:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:05:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:05:59 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:05:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:05:59 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:05:59 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:05:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:06:03 - XML: Processed 648119 elements - found 614 jobs
Fri 17 Jan 2014 09:06:03 - job 7347574 appears to have finished
Fri 17 Jan 2014 09:06:03 - job 7347599 appears to have finished
Fri 17 Jan 2014 09:06:03 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 09:06:03 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 09:06:04 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 09:06:04 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:06:04 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:06:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:06:06 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:06:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:06:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:06:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:06:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:06:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:06:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:06:08 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:06:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43190663
Fri 17 Jan 2014 09:06:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:06:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43190663
Fri 17 Jan 2014 09:06:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:06:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:06:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:06:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:06:16 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:06:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:06:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 09:06:17 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:06:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 09:06:17 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:06:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9268 values 146147 bits 18268 bytes 
Fri 17 Jan 2014 09:06:19 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:06:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:06:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:06:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:06:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:06:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:06:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:06:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:06:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:06:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:06:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:06:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:06:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:06:23 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:06:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:06:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:06:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:06:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:06:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:06:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:06:26 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:06:26 - job_xml_thread(): Done retrieving: data size 43308667
Fri 17 Jan 2014 09:06:26 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:06:26 - XML: Start document: iteration 4
Fri 17 Jan 2014 09:06:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43308667
Fri 17 Jan 2014 09:06:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:06:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43308667
Fri 17 Jan 2014 09:06:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:06:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:06:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:06:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:06:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:06:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:06:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:06:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:06:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:06:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:06:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:06:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:06:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:06:40 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:06:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:06:46 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:06:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:06:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:06:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:06:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:06:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:06:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:06:47 - XML: Processed 648380 elements - found 616 jobs
Fri 17 Jan 2014 09:06:48 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 09:06:48 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 09:06:48 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 09:06:48 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:06:48 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:06:48 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:06:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 09:06:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:06:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:06:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43797985
Fri 17 Jan 2014 09:06:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:06:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43797985
Fri 17 Jan 2014 09:06:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:06:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:06:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:07:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:07:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:07:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:07:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:07:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:07:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:07:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:07:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:07:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:07:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:07:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:07:03 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:07:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:07:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:07:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:07:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:07:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:07:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:07:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:07:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:07:06 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:07:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867724
Fri 17 Jan 2014 09:07:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:07:07 - job_xml_thread(): Done retrieving: data size 43867724
Fri 17 Jan 2014 09:07:07 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:07:07 - XML: Start document: iteration 5
Fri 17 Jan 2014 09:07:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43867724
Fri 17 Jan 2014 09:07:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:07:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:07:16 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:07:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:07:18 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:07:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:07:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:07:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:07:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:07:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:07:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:07:18 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:07:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:07:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:07:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 09:07:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 09:07:18 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:07:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8950 values 141130 bits 17641 bytes 
Fri 17 Jan 2014 09:07:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:07:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:07:25 - XML: Processed 655430 elements - found 616 jobs
Fri 17 Jan 2014 09:07:25 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:07:25 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:07:25 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:07:25 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:07:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:07:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:07:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:07:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:07:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:07:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:07:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:07:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:07:30 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:07:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43819726
Fri 17 Jan 2014 09:07:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:07:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43819726
Fri 17 Jan 2014 09:07:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:07:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:07:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:07:36 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 09:07:36 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:07:36 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:07:36 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:07:36 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 09:07:36 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 09:07:36 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 09:07:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:07:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:07:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:07:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:07:40 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:07:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:07:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:07:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:07:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:07:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Fri 17 Jan 2014 09:07:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:07:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:07:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:07:45 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:07:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:07:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:07:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:07:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:07:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:07:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:07:45 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:07:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 09:07:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:07:47 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:07:47 - job_xml_thread(): Done retrieving: data size 43840603
Fri 17 Jan 2014 09:07:47 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:07:47 - XML: Start document: iteration 6
Fri 17 Jan 2014 09:07:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43840603
Fri 17 Jan 2014 09:07:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:07:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43840603
Fri 17 Jan 2014 09:07:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:07:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:07:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:08:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:08:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:08:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:08:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:08:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:08:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:08:06 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:08:06 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:08:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:08:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:08:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:08:07 - XML: Processed 655432 elements - found 617 jobs
Fri 17 Jan 2014 09:08:07 - job 7347556 appears to have finished
Fri 17 Jan 2014 09:08:07 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 09:08:07 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 09:08:07 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 09:08:07 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:08:07 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:08:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:08:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:08:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:08:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:08:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:08:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:08:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:08:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:08:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:08:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43860986
Fri 17 Jan 2014 09:08:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:08:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43860986
Fri 17 Jan 2014 09:08:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:08:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:08:19 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:08:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:08:21 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:08:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:08:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:08:21 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:08:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 09:08:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:08:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 09:08:23 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:08:23 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:08:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:08:23 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:08:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:08:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:08:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:08:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8689 values 136949 bits 17118 bytes 
Fri 17 Jan 2014 09:08:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:08:25 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:08:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:08:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:08:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:08:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:08:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:08:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:08:26 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:08:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 09:08:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:08:27 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:08:27 - job_xml_thread(): Done retrieving: data size 43859870
Fri 17 Jan 2014 09:08:27 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:08:27 - XML: Start document: iteration 7
Fri 17 Jan 2014 09:08:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43859870
Fri 17 Jan 2014 09:08:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:08:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43859870
Fri 17 Jan 2014 09:08:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:08:37 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:08:38 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:08:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:08:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:08:38 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:08:39 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 09:08:39 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:08:39 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 09:08:40 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 09:08:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:08:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:08:46 - XML: Processed 655432 elements - found 617 jobs
Fri 17 Jan 2014 09:08:46 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:08:47 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:08:47 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:08:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:08:47 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:08:47 - ganglia_parse_thread(): finished: Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Fri 17 Jan 2014 09:08:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:08:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:08:50 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:08:50 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:08:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:08:50 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:08:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:08:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:08:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:08:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:08:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:08:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:08:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:08:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:08:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:08:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:08:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43880748
Fri 17 Jan 2014 09:08:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:08:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43880748
Fri 17 Jan 2014 09:08:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:09:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:09:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:09:02 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:09:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:09:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:09:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:09:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:09:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:09:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:09:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:09:06 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:09:06 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:09:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:09:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:09:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:09:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:09:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:09:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:09:07 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:09:07 - job_xml_thread(): Done retrieving: data size 43876198
Fri 17 Jan 2014 09:09:07 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:09:07 - XML: Start document: iteration 8
Fri 17 Jan 2014 09:09:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43876198
Fri 17 Jan 2014 09:09:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:09:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43876198
Fri 17 Jan 2014 09:09:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:09:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:09:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:09:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:09:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:09:22 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:09:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:09:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:09:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:09:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:09:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:09:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:09:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 09:09:24 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:09:24 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:09:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148496 bits 18562 bytes 
Fri 17 Jan 2014 09:09:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 09:09:25 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:09:25 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:09:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:09:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:09:25 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:09:26 - XML: Processed 655432 elements - found 617 jobs
Fri 17 Jan 2014 09:09:26 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:09:27 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:09:27 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:09:27 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:09:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:09:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:09:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:09:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:09:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:09:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:09:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:09:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:09:31 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:09:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853932
Fri 17 Jan 2014 09:09:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:09:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853932
Fri 17 Jan 2014 09:09:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:09:39 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:09:39 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:09:41 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:09:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:09:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:09:41 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:09:41 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 09:09:41 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 09:09:41 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 09:09:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:09:42 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:09:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:09:43 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:09:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:09:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:09:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:09:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:09:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:09:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:09:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:09:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:09:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:09:46 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:09:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:09:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:09:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:09:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:09:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:09:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:09:46 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 1055088 values 16643303 bits 2080412 bytes 
Fri 17 Jan 2014 09:09:47 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:09:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 09:09:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:09:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:09:49 - job_xml_thread(): Done retrieving: data size 43863633
Fri 17 Jan 2014 09:09:49 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:09:49 - XML: Start document: iteration 9
Fri 17 Jan 2014 09:09:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43863633
Fri 17 Jan 2014 09:09:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43863633
Fri 17 Jan 2014 09:09:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:09:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:09:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:09:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:10:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:10:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:10:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:10:09 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:10:09 - XML: Processed 655428 elements - found 615 jobs
Fri 17 Jan 2014 09:10:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:10:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:10:09 - job 7347604 appears to have finished
Fri 17 Jan 2014 09:10:09 - job 7347324 appears to have finished
Fri 17 Jan 2014 09:10:09 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 09:10:09 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 09:10:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:10:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:10:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:10:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:10:09 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:10:10 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 09:10:10 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:10:10 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:10:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:10:13 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:10:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:10:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:10:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:10:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:10:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:10:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:10:17 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:10:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856186
Fri 17 Jan 2014 09:10:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:10:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43856186
Fri 17 Jan 2014 09:10:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:10:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:10:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:10:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:10:25 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:10:25 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:10:25 - job_xml_thread(): Done retrieving: data size 43856186
Fri 17 Jan 2014 09:10:25 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:10:26 - XML: Start document: iteration 10
Fri 17 Jan 2014 09:10:26 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:10:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:10:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 09:10:26 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:10:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9117 values 143760 bits 17970 bytes 
Fri 17 Jan 2014 09:10:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 09:10:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:10:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:10:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:10:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:10:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:10:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:10:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:10:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:10:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:10:31 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:10:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:10:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:10:38 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:10:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:10:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:10:39 - XML: Processed 655430 elements - found 616 jobs
Fri 17 Jan 2014 09:10:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:10:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:10:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:10:39 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 09:10:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:10:39 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 09:10:39 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 09:10:39 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:10:39 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:10:41 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:10:41 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 09:10:44 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:10:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43831196
Fri 17 Jan 2014 09:10:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:10:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43831196
Fri 17 Jan 2014 09:10:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:10:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:10:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:10:54 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:10:54 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:10:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:10:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:10:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:10:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:10:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:10:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:10:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:10:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:10:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:10:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:10:58 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:10:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 09:10:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:10:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:10:59 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:10:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:10:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:11:00 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 09:11:00 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 09:11:00 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:11:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:11:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:11:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:11:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:11:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:11:02 - job_xml_thread(): Done retrieving: data size 43854170
Fri 17 Jan 2014 09:11:02 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:11:02 - XML: Start document: iteration 11
Fri 17 Jan 2014 09:11:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43854170
Fri 17 Jan 2014 09:11:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43854170
Fri 17 Jan 2014 09:11:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:11:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:11:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:11:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:11:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:11:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:11:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:11:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:11:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:11:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:11:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:11:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:11:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:11:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:11:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:11:22 - XML: Processed 655430 elements - found 616 jobs
Fri 17 Jan 2014 09:11:22 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:11:22 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:11:22 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:11:22 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:11:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:11:24 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:11:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:11:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:11:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:11:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:11:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:11:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:11:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:11:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43777882
Fri 17 Jan 2014 09:11:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:11:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:11:26 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:11:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43777882
Fri 17 Jan 2014 09:11:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:11:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:11:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 09:11:27 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:11:27 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:11:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 09:11:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8910 values 140485 bits 17560 bytes 
Fri 17 Jan 2014 09:11:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:11:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:11:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:11:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:11:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:11:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:11:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:11:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:11:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:11:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:11:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:11:37 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:11:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:11:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:11:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:11:40 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:11:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:11:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:11:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:11:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:11:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:11:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:11:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:11:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43253355
Fri 17 Jan 2014 09:11:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:11:43 - job_xml_thread(): Done retrieving: data size 43253355
Fri 17 Jan 2014 09:11:43 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:11:43 - XML: Start document: iteration 12
Fri 17 Jan 2014 09:11:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43253355
Fri 17 Jan 2014 09:11:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:11:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:11:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:11:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:11:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:11:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:11:58 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:11:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:11:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:11:59 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:11:59 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:11:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:11:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:11:59 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:12:01 - XML: Processed 648080 elements - found 616 jobs
Fri 17 Jan 2014 09:12:01 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:12:01 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:12:01 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:12:01 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:12:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:12:06 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:12:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:12:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:12:06 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:12:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 09:12:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:12:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:12:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:12:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:12:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:12:07 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:12:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43208535
Fri 17 Jan 2014 09:12:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:12:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43208535
Fri 17 Jan 2014 09:12:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:12:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:12:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:12:16 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:12:16 - job_xml_thread(): Done retrieving: data size 43208535
Fri 17 Jan 2014 09:12:16 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:12:16 - XML: Start document: iteration 13
Fri 17 Jan 2014 09:12:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:12:16 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:12:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:12:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:12:17 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:12:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:12:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43208535
Fri 17 Jan 2014 09:12:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:12:17 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:12:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:12:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:12:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:12:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:12:27 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:12:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:12:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 09:12:29 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:12:29 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:12:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5685 values 89611 bits 11201 bytes 
Fri 17 Jan 2014 09:12:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 09:12:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:12:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:12:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:12:34 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:12:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:12:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:12:35 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:12:35 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:12:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:12:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:12:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:12:36 - XML: Processed 647412 elements - found 614 jobs
Fri 17 Jan 2014 09:12:36 - job 7347663 field 'start_timestamp' changed since saved from: 1389946189 to: 1389946103
Fri 17 Jan 2014 09:12:36 - job 7347655 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 09:12:36 - job 7345098 appears to have finished
Fri 17 Jan 2014 09:12:36 - job 7347627 appears to have finished
Fri 17 Jan 2014 09:12:36 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 09:12:36 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 09:12:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:12:37 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:12:37 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 09:12:37 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:12:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:12:37 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:12:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:12:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:12:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:12:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:12:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:12:39 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:12:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43530235
Fri 17 Jan 2014 09:12:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:12:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43530235
Fri 17 Jan 2014 09:12:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:12:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:12:48 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:12:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:12:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:12:52 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:12:52 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:12:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:12:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:12:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:12:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:12:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:12:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:12:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:12:53 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:12:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:12:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:12:53 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:12:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 09:12:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:12:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:12:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:12:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:12:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:12:55 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:12:55 - job_xml_thread(): Done retrieving: data size 43835939
Fri 17 Jan 2014 09:12:55 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:12:55 - XML: Start document: iteration 14
Fri 17 Jan 2014 09:12:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43835939
Fri 17 Jan 2014 09:12:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:12:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43835939
Fri 17 Jan 2014 09:12:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:13:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:13:06 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:13:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:13:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:13:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:13:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:13:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:13:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:13:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:13:09 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:13:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:13:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:13:13 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:13:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:13:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:13:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:13:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:13:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:13:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:13:15 - XML: Processed 655060 elements - found 614 jobs
Fri 17 Jan 2014 09:13:15 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:13:15 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:13:15 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:13:15 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:13:17 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:13:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43843464
Fri 17 Jan 2014 09:13:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:13:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43843464
Fri 17 Jan 2014 09:13:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:13:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:13:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:13:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:13:27 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:13:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:13:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:13:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:13:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:13:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:13:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:13:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:13:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:13:29 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:13:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:13:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:13:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:13:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 09:13:29 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:13:29 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:13:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 09:13:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8933 values 140880 bits 17610 bytes 
Fri 17 Jan 2014 09:13:31 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:13:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:13:31 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:13:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:13:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:13:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:13:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:13:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:13:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:13:33 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:13:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855012
Fri 17 Jan 2014 09:13:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:13:34 - job_xml_thread(): Done retrieving: data size 43855012
Fri 17 Jan 2014 09:13:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855012
Fri 17 Jan 2014 09:13:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:13:34 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:13:34 - XML: Start document: iteration 15
Fri 17 Jan 2014 09:13:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:13:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:13:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:13:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:13:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:13:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:13:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:13:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:13:51 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:13:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:13:51 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:13:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:13:51 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:13:52 - XML: Processed 655426 elements - found 614 jobs
Fri 17 Jan 2014 09:13:53 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:13:53 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:13:53 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:13:53 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:13:55 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:13:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 09:13:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:13:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:13:57 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:13:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:13:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:13:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:13:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:13:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:13:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:13:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:13:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43844860
Fri 17 Jan 2014 09:13:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:13:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43844860
Fri 17 Jan 2014 09:13:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:14:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:14:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:14:08 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:14:08 - job_xml_thread(): Done retrieving: data size 43844860
Fri 17 Jan 2014 09:14:08 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:14:08 - XML: Start document: iteration 16
Fri 17 Jan 2014 09:14:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:14:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:14:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:14:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:14:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:14:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:14:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:14:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:14:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:14:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:14:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:14:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:14:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:14:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:14:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:14:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:14:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:14:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:14:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:14:19 - XML: Processed 655430 elements - found 616 jobs
Fri 17 Jan 2014 09:14:20 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 09:14:20 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 09:14:20 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 09:14:20 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:14:20 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:14:21 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:14:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856652
Fri 17 Jan 2014 09:14:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:14:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43856652
Fri 17 Jan 2014 09:14:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:14:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:14:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:14:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:14:29 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:14:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:14:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 09:14:31 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:14:31 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:14:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 09:14:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8933 values 140805 bits 17600 bytes 
Fri 17 Jan 2014 09:14:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:14:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:14:35 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:14:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:14:35 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:14:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:14:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:14:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:14:35 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:14:35 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:14:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:14:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:14:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:14:38 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:14:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:14:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:14:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:14:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:14:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:14:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:14:40 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:14:40 - job_xml_thread(): Done retrieving: data size 43853045
Fri 17 Jan 2014 09:14:40 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:14:40 - XML: Start document: iteration 17
Fri 17 Jan 2014 09:14:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853045
Fri 17 Jan 2014 09:14:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:14:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853045
Fri 17 Jan 2014 09:14:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:14:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:14:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:14:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:14:54 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:14:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:14:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:14:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:14:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:14:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:14:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:14:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:14:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:14:55 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:15:00 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:15:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 09:15:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:15:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:15:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:15:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:15:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:15:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:15:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:15:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:15:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:15:03 - XML: Processed 655430 elements - found 616 jobs
Fri 17 Jan 2014 09:15:03 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:15:03 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:15:03 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:15:03 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:15:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:15:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43852700
Fri 17 Jan 2014 09:15:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:15:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43852700
Fri 17 Jan 2014 09:15:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:15:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:15:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:15:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:15:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:15:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:15:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:15:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:15:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:15:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:15:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:15:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:15:19 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:15:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:15:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:15:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:15:20 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:15:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:15:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:15:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:15:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:15:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:15:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:15:22 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:15:22 - job_xml_thread(): Done retrieving: data size 43868306
Fri 17 Jan 2014 09:15:22 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:15:22 - XML: Start document: iteration 18
Fri 17 Jan 2014 09:15:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43868306
Fri 17 Jan 2014 09:15:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:15:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43868306
Fri 17 Jan 2014 09:15:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:15:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:15:32 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:15:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:15:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:15:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:15:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:15:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:15:33 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:15:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 09:15:33 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:15:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 09:15:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9155 values 144406 bits 18050 bytes 
Fri 17 Jan 2014 09:15:35 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:15:35 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:15:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:15:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:15:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:15:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:15:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:15:42 - XML: Processed 655430 elements - found 616 jobs
Fri 17 Jan 2014 09:15:42 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:15:42 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:15:42 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:15:42 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:15:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:15:44 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:15:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:15:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:15:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:15:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:15:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:15:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:15:47 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:15:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43846620
Fri 17 Jan 2014 09:15:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:15:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43846620
Fri 17 Jan 2014 09:15:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:15:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:15:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:15:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:15:56 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:15:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:15:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:15:57 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:15:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:15:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:15:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:15:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:15:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:15:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:15:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:16:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:16:01 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:16:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:16:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:16:01 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:16:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 09:16:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:16:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:16:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:16:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:16:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:16:03 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:16:03 - job_xml_thread(): Done retrieving: data size 43872381
Fri 17 Jan 2014 09:16:03 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:16:03 - XML: Start document: iteration 19
Fri 17 Jan 2014 09:16:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43872381
Fri 17 Jan 2014 09:16:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:16:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43872381
Fri 17 Jan 2014 09:16:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:16:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:16:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:16:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:16:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:16:20 - XML: Processed 655430 elements - found 616 jobs
Fri 17 Jan 2014 09:16:20 - job 7347664 report time 1389946397 does not match current heartbeat 1389946517 : ignoring job
Fri 17 Jan 2014 09:16:20 - job 7347655 appears to have finished
Fri 17 Jan 2014 09:16:20 - job 7347617 appears to have finished
Fri 17 Jan 2014 09:16:20 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 09:16:20 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 09:16:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:16:21 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:16:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:16:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:16:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:16:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:16:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:16:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:16:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:16:22 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 09:16:22 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:16:22 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:16:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:16:23 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:16:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:16:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:16:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:16:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:16:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:16:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:16:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:16:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43866406
Fri 17 Jan 2014 09:16:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:16:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43866406
Fri 17 Jan 2014 09:16:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:16:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:16:34 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:16:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:16:35 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:16:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 09:16:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 09:16:35 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:16:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9003 values 142127 bits 17765 bytes 
Fri 17 Jan 2014 09:16:37 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:16:37 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:16:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:16:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:16:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:16:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:16:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:16:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:16:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:16:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:16:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:16:40 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:16:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:16:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:16:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:16:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:16:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:16:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:16:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:16:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:16:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:16:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:16:41 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 09:16:41 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:16:42 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:16:42 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:16:42 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 09:16:42 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 09:16:42 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 09:16:43 - size of cluster 'LISA Cluster': 624 hosts 79473 metrics 1032632 values 16292692 bits 2036586 bytes 
Fri 17 Jan 2014 09:16:44 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:16:44 - job_xml_thread(): Done retrieving: data size 43853619
Fri 17 Jan 2014 09:16:44 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:16:44 - XML: Start document: iteration 20
Fri 17 Jan 2014 09:16:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853619
Fri 17 Jan 2014 09:16:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:16:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853619
Fri 17 Jan 2014 09:16:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:16:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:16:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:16:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:16:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:17:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:17:00 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:17:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:17:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:17:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:17:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:17:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:17:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:17:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:17:03 - XML: Processed 655430 elements - found 616 jobs
Fri 17 Jan 2014 09:17:03 - job 7347664 report time 1389946397 does not match current heartbeat 1389946517 : ignoring job
Fri 17 Jan 2014 09:17:03 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:17:03 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:17:03 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:17:03 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:17:04 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:17:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 09:17:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:17:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:17:08 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:17:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:17:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:17:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:17:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:17:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:17:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:17:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:17:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851395
Fri 17 Jan 2014 09:17:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:17:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851395
Fri 17 Jan 2014 09:17:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:17:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:17:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:17:18 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:17:18 - job_xml_thread(): Done retrieving: data size 43851395
Fri 17 Jan 2014 09:17:18 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:17:18 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 09:17:19 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 09:17:19 - Housekeeping: done.
Fri 17 Jan 2014 09:17:19 - XML: Start document: iteration 0
Fri 17 Jan 2014 09:17:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:17:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:17:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:17:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:17:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:17:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:17:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:17:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851395
Fri 17 Jan 2014 09:17:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:17:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:17:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:17:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:17:33 - XML: Processed 655428 elements - found 616 jobs
Fri 17 Jan 2014 09:17:34 - job 7347664 report time 1389946397 does not match current heartbeat 1389946517 : ignoring job
Fri 17 Jan 2014 09:17:34 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:17:34 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:17:34 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:17:34 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:17:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:17:35 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:17:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:17:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:17:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:17:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:17:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:17:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:17:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:17:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:17:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:17:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 09:17:36 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:17:36 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:17:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5991 values 94773 bits 11846 bytes 
Fri 17 Jan 2014 09:17:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:17:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 09:17:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:17:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:17:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:17:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:17:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:17:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:17:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:17:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:17:42 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:17:42 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 09:17:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:17:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43280120
Fri 17 Jan 2014 09:17:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:17:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43280120
Fri 17 Jan 2014 09:17:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:17:49 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:17:49 - job_xml_thread(): Done retrieving: data size 43280120
Fri 17 Jan 2014 09:17:49 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:17:49 - XML: Start document: iteration 1
Fri 17 Jan 2014 09:17:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:17:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:17:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:17:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:17:58 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:17:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 09:17:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:18:01 - XML: Processed 648468 elements - found 616 jobs
Fri 17 Jan 2014 09:18:01 - job 7347664 report time 1389946397 does not match current heartbeat 1389946517 : ignoring job
Fri 17 Jan 2014 09:18:01 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:18:01 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:18:01 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:18:01 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:18:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:18:03 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:18:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:18:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:18:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:18:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:18:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:18:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:18:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:18:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:18:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:18:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:18:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:18:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:18:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:18:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:18:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:18:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:18:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43247109
Fri 17 Jan 2014 09:18:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:18:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43247109
Fri 17 Jan 2014 09:18:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:18:16 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:18:16 - job_xml_thread(): Done retrieving: data size 43247109
Fri 17 Jan 2014 09:18:16 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:18:16 - XML: Start document: iteration 2
Fri 17 Jan 2014 09:18:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:18:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:18:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:18:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:18:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:18:25 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:18:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:18:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:18:26 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:18:26 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:18:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:18:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:18:26 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:18:30 - XML: Processed 647934 elements - found 615 jobs
Fri 17 Jan 2014 09:18:30 - job 7347610 appears to have finished
Fri 17 Jan 2014 09:18:30 - job 7335196 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 09:18:30 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 09:18:30 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 09:18:31 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 09:18:31 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:18:31 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:18:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:18:35 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:18:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:18:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:18:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:18:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:18:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:18:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:18:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:18:36 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:18:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:18:37 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:18:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 09:18:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 09:18:37 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:18:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6130 values 96878 bits 12109 bytes 
Fri 17 Jan 2014 09:18:37 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:18:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43288214
Fri 17 Jan 2014 09:18:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:18:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43288214
Fri 17 Jan 2014 09:18:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:18:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:18:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:18:46 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:18:46 - job_xml_thread(): Done retrieving: data size 43288214
Fri 17 Jan 2014 09:18:47 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:18:47 - XML: Start document: iteration 3
Fri 17 Jan 2014 09:18:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:18:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:18:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:18:52 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:18:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:18:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:18:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:18:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:18:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:18:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:18:54 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:18:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:18:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:18:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:18:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:18:56 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:18:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:18:56 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:18:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:18:59 - XML: Processed 648360 elements - found 615 jobs
Fri 17 Jan 2014 09:18:59 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:18:59 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:18:59 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:18:59 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:19:03 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:19:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 09:19:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:19:03 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:19:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43850471
Fri 17 Jan 2014 09:19:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:19:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43850471
Fri 17 Jan 2014 09:19:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:19:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:19:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:19:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:19:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:19:14 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:19:14 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:19:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:19:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:19:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:19:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:19:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:19:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:19:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:19:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:19:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:19:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:19:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:19:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:19:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:19:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:19:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:19:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:19:22 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:19:22 - job_xml_thread(): Done retrieving: data size 43856886
Fri 17 Jan 2014 09:19:22 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:19:22 - XML: Start document: iteration 4
Fri 17 Jan 2014 09:19:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43856886
Fri 17 Jan 2014 09:19:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856886
Fri 17 Jan 2014 09:19:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:19:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:19:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:19:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:19:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:19:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:19:35 - XML: Processed 655428 elements - found 615 jobs
Fri 17 Jan 2014 09:19:35 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:19:35 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:19:35 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:19:35 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:19:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:19:38 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:19:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:19:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 09:19:39 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:19:39 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:19:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 09:19:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6733 values 106204 bits 13275 bytes 
Fri 17 Jan 2014 09:19:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:19:41 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:19:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:19:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:19:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:19:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:19:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:19:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:19:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:19:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:19:46 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:19:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:19:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:19:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:19:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:19:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:19:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:19:50 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:19:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43852852
Fri 17 Jan 2014 09:19:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:19:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43852852
Fri 17 Jan 2014 09:19:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:19:50 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:19:50 - job_xml_thread(): Done retrieving: data size 43852852
Fri 17 Jan 2014 09:19:50 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:19:50 - XML: Start document: iteration 5
Fri 17 Jan 2014 09:19:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:19:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:20:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:20:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:20:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:20:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:20:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:20:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:20:12 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:20:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:20:12 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:20:12 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:20:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:20:12 - XML: Processed 655428 elements - found 615 jobs
Fri 17 Jan 2014 09:20:12 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:20:12 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:20:12 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:20:12 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:20:13 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:20:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 09:20:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:20:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:20:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:20:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:20:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:20:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:20:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:20:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:20:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:20:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:20:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43859525
Fri 17 Jan 2014 09:20:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:20:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43859525
Fri 17 Jan 2014 09:20:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:20:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:20:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:20:27 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:20:27 - job_xml_thread(): Done retrieving: data size 43859525
Fri 17 Jan 2014 09:20:27 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:20:27 - XML: Start document: iteration 6
Fri 17 Jan 2014 09:20:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:20:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:20:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:20:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:20:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:20:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:20:32 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:20:32 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:20:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:20:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:20:32 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:20:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:20:37 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:20:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:20:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:20:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:20:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:20:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:20:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:20:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:20:39 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:20:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:20:40 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:20:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 09:20:40 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:20:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 09:20:40 - XML: Processed 655430 elements - found 616 jobs
Fri 17 Jan 2014 09:20:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5909 values 93254 bits 11656 bytes 
Fri 17 Jan 2014 09:20:40 - job 7347670 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 09:20:40 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 09:20:40 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 09:20:40 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 09:20:40 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:20:40 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:20:41 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 09:20:41 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 09:20:41 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:20:43 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:20:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 09:20:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:20:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:20:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43830331
Fri 17 Jan 2014 09:20:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:20:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43830331
Fri 17 Jan 2014 09:20:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:20:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:20:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:20:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:20:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:20:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:20:53 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:20:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:20:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:20:54 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:20:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:20:54 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:20:54 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:20:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:20:55 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:20:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:20:57 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:20:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:20:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:20:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:20:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:20:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:20:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:20:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:20:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867124
Fri 17 Jan 2014 09:20:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:20:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43867124
Fri 17 Jan 2014 09:20:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:20:59 - job_xml_thread(): Done retrieving: data size 43867124
Fri 17 Jan 2014 09:20:59 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:21:00 - XML: Start document: iteration 7
Fri 17 Jan 2014 09:21:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:21:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:21:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:21:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:21:15 - XML: Processed 655430 elements - found 616 jobs
Fri 17 Jan 2014 09:21:15 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:21:15 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:21:15 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:21:15 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:21:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:21:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:21:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:21:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:21:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:21:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:21:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:21:21 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:21:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:21:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:21:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:21:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:21:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:21:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:21:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:21:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:21:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:21:23 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:21:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870876
Fri 17 Jan 2014 09:21:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:21:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870876
Fri 17 Jan 2014 09:21:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:21:31 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:21:31 - job_xml_thread(): Done retrieving: data size 43870876
Fri 17 Jan 2014 09:21:31 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:21:31 - XML: Start document: iteration 8
Fri 17 Jan 2014 09:21:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:21:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:21:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:21:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:21:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:21:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:21:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:21:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:21:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:21:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:21:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:21:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:21:40 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:21:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:21:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 09:21:41 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:21:41 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:21:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 09:21:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9279 values 146336 bits 18292 bytes 
Fri 17 Jan 2014 09:21:42 - XML: Processed 655430 elements - found 616 jobs
Fri 17 Jan 2014 09:21:42 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:21:42 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:21:42 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:21:42 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:21:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:21:44 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:21:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:21:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:21:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:21:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:21:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:21:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:21:46 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:21:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43849571
Fri 17 Jan 2014 09:21:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:21:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43849571
Fri 17 Jan 2014 09:21:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:21:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:21:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:21:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:21:56 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:21:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:21:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:21:57 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:21:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:21:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:21:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:21:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:21:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:22:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:22:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:22:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:22:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:22:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:22:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:22:01 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:22:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 09:22:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:22:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:22:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:22:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:22:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:22:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:22:02 - job_xml_thread(): Done retrieving: data size 43862769
Fri 17 Jan 2014 09:22:02 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:22:02 - XML: Start document: iteration 9
Fri 17 Jan 2014 09:22:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862769
Fri 17 Jan 2014 09:22:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:22:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862769
Fri 17 Jan 2014 09:22:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:22:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:22:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:22:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:22:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:22:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:22:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:22:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:22:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:22:20 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:22:20 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:22:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:22:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:22:20 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:22:23 - XML: Processed 655426 elements - found 614 jobs
Fri 17 Jan 2014 09:22:23 - job 7347621 appears to have finished
Fri 17 Jan 2014 09:22:23 - job 7347630 appears to have finished
Fri 17 Jan 2014 09:22:23 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 09:22:23 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 09:22:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:22:24 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:22:24 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 09:22:24 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:22:24 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:22:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:22:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:22:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:22:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:22:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:22:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:22:26 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:22:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43854655
Fri 17 Jan 2014 09:22:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:22:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43854655
Fri 17 Jan 2014 09:22:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:22:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:22:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:22:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:22:36 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:22:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:22:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:22:37 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:22:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:22:37 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:22:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:22:37 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:22:39 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:22:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:22:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:22:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:22:40 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:22:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:22:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:22:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:22:41 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:22:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:22:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:22:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:22:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:22:42 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:22:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43857934
Fri 17 Jan 2014 09:22:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:22:42 - job_xml_thread(): Done retrieving: data size 43857934
Fri 17 Jan 2014 09:22:42 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:22:42 - XML: Start document: iteration 10
Fri 17 Jan 2014 09:22:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43857934
Fri 17 Jan 2014 09:22:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:22:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:22:43 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:22:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 09:22:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 09:22:44 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:22:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 10748 values 169430 bits 21178 bytes 
Fri 17 Jan 2014 09:22:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:22:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:22:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:22:54 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:22:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:22:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:22:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:22:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:22:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:22:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:22:55 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:22:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:22:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:23:03 - XML: Processed 655426 elements - found 614 jobs
Fri 17 Jan 2014 09:23:04 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:23:04 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:23:04 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:23:04 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:23:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:23:06 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:23:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:23:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:23:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:23:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:23:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:23:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:23:08 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:23:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43842433
Fri 17 Jan 2014 09:23:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:23:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43842433
Fri 17 Jan 2014 09:23:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:23:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:23:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:23:19 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:23:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:23:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:23:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:23:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:23:24 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:23:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:23:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:23:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:23:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:23:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:23:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:23:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:23:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:23:25 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:23:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:23:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:23:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:23:25 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:23:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:23:25 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:23:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 09:23:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:23:26 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:23:26 - job_xml_thread(): Done retrieving: data size 43774480
Fri 17 Jan 2014 09:23:26 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:23:26 - XML: Start document: iteration 11
Fri 17 Jan 2014 09:23:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43774480
Fri 17 Jan 2014 09:23:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43774480
Fri 17 Jan 2014 09:23:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:23:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:23:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:23:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:23:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:23:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:23:42 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 09:23:42 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:23:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:23:42 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:23:42 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:23:42 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:23:42 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 09:23:42 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 09:23:42 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 09:23:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:23:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:23:43 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:23:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:23:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:23:45 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:23:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 09:23:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 09:23:45 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:23:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5845 values 92200 bits 11525 bytes 
Fri 17 Jan 2014 09:23:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:23:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:23:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:23:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:23:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:23:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:23:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:23:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:23:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:23:49 - XML: Processed 654678 elements - found 614 jobs
Fri 17 Jan 2014 09:23:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:23:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:23:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:23:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:23:49 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:23:50 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:23:50 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:23:50 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:23:50 - size of cluster 'LISA Cluster': 624 hosts 79487 metrics 869357 values 13722640 bits 1715330 bytes 
Fri 17 Jan 2014 09:23:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:23:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43211392
Fri 17 Jan 2014 09:23:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:23:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43211392
Fri 17 Jan 2014 09:23:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:24:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:24:01 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:24:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:24:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:24:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:24:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:24:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:24:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:24:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:24:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:24:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:24:05 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:24:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:24:06 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:24:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:24:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:24:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:24:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:24:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:24:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:24:06 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:24:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 09:24:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:24:08 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:24:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43217955
Fri 17 Jan 2014 09:24:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:24:09 - job_xml_thread(): Done retrieving: data size 43217955
Fri 17 Jan 2014 09:24:09 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:24:09 - XML: Start document: iteration 12
Fri 17 Jan 2014 09:24:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43217955
Fri 17 Jan 2014 09:24:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:24:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:24:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:24:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:24:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:24:26 - XML: Processed 647480 elements - found 615 jobs
Fri 17 Jan 2014 09:24:26 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 09:24:26 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 09:24:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:24:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:24:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:24:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:24:27 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 09:24:27 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:24:27 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:24:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:24:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:24:27 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:24:27 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:24:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:24:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:24:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:24:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:24:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:24:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:24:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:24:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:24:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:24:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:24:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43268478
Fri 17 Jan 2014 09:24:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:24:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43268478
Fri 17 Jan 2014 09:24:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:24:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:24:42 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:24:42 - job_xml_thread(): Done retrieving: data size 43268478
Fri 17 Jan 2014 09:24:42 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:24:42 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:24:42 - XML: Start document: iteration 13
Fri 17 Jan 2014 09:24:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:24:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:24:43 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:24:43 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 09:24:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:24:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:24:43 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:24:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:24:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:24:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:24:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:24:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:24:46 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:24:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:24:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 09:24:46 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:24:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8876 values 139933 bits 17491 bytes 
Fri 17 Jan 2014 09:24:46 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:24:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 09:24:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:24:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:24:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:24:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:24:54 - XML: Processed 647976 elements - found 615 jobs
Fri 17 Jan 2014 09:24:54 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:24:54 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:24:54 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:24:54 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:24:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:24:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:24:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:24:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:24:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:24:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43811231
Fri 17 Jan 2014 09:24:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:24:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43811231
Fri 17 Jan 2014 09:24:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:24:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:24:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:25:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:25:09 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:25:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:25:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:25:10 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:25:10 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:25:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:25:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:25:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:25:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:25:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:25:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:25:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:25:13 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:25:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:25:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:25:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:25:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:25:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:25:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:25:14 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:25:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 09:25:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:25:17 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:25:17 - job_xml_thread(): Done retrieving: data size 43856967
Fri 17 Jan 2014 09:25:17 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:25:17 - XML: Start document: iteration 14
Fri 17 Jan 2014 09:25:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856967
Fri 17 Jan 2014 09:25:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:25:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43856967
Fri 17 Jan 2014 09:25:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:25:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:25:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:25:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:25:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:25:30 - XML: Processed 655428 elements - found 615 jobs
Fri 17 Jan 2014 09:25:30 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:25:30 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:25:30 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:25:30 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:25:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:25:34 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:25:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:25:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:25:35 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:25:35 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:25:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:25:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:25:35 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:25:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:25:38 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:25:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:25:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:25:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:25:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:25:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:25:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:25:41 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:25:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43839726
Fri 17 Jan 2014 09:25:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:25:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43839726
Fri 17 Jan 2014 09:25:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:25:45 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:25:45 - job_xml_thread(): Done retrieving: data size 43839726
Fri 17 Jan 2014 09:25:45 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:25:45 - XML: Start document: iteration 15
Fri 17 Jan 2014 09:25:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:25:47 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:25:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:25:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 09:25:48 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:25:48 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:25:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 09:25:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8633 values 136039 bits 17004 bytes 
Fri 17 Jan 2014 09:25:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:25:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:25:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:25:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:25:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:25:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:25:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:25:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:25:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:25:52 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:25:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:25:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:25:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:26:03 - XML: Processed 655428 elements - found 615 jobs
Fri 17 Jan 2014 09:26:03 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:26:03 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:26:03 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:26:03 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:26:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:26:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:26:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:26:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:26:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:26:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:26:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:26:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:26:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:26:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:26:08 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:26:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43831880
Fri 17 Jan 2014 09:26:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:26:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43831880
Fri 17 Jan 2014 09:26:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:26:09 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:26:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 09:26:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:26:18 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:26:18 - job_xml_thread(): Done retrieving: data size 43831880
Fri 17 Jan 2014 09:26:18 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:26:18 - XML: Start document: iteration 16
Fri 17 Jan 2014 09:26:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:26:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:26:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:26:21 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:26:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:26:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:26:23 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:26:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:26:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:26:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:26:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:26:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:26:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:26:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:26:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:26:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:26:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:26:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:26:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:26:31 - XML: Processed 655432 elements - found 617 jobs
Fri 17 Jan 2014 09:26:31 - job 7347634 appears to have finished
Fri 17 Jan 2014 09:26:31 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 09:26:31 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 09:26:31 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 09:26:31 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:26:31 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:26:34 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:26:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853808
Fri 17 Jan 2014 09:26:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:26:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853808
Fri 17 Jan 2014 09:26:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:26:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:26:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:26:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:26:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:26:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:26:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:26:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:26:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:26:45 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:26:45 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:26:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:26:45 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:26:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:26:46 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:26:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:26:48 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:26:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:26:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:26:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:26:48 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:26:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:26:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 09:26:48 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:26:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99021 bits 12377 bytes 
Fri 17 Jan 2014 09:26:48 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:26:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 09:26:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:26:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:26:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:26:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:26:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:26:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43871227
Fri 17 Jan 2014 09:26:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:26:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43871227
Fri 17 Jan 2014 09:26:53 - job_xml_thread(): Done retrieving: data size 43871227
Fri 17 Jan 2014 09:26:53 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:26:53 - XML: Start document: iteration 17
Fri 17 Jan 2014 09:26:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:27:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:27:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:27:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:27:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:27:11 - XML: Processed 655432 elements - found 617 jobs
Fri 17 Jan 2014 09:27:11 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:27:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:27:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:27:11 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:27:11 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:27:11 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:27:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:27:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:27:12 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:27:12 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:27:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:27:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:27:12 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:27:14 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:27:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 09:27:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:27:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:27:15 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:27:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:27:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:27:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:27:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:27:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:27:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:27:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:27:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43871159
Fri 17 Jan 2014 09:27:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:27:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43871159
Fri 17 Jan 2014 09:27:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:27:26 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:27:26 - job_xml_thread(): Done retrieving: data size 43871159
Fri 17 Jan 2014 09:27:26 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:27:26 - XML: Start document: iteration 18
Fri 17 Jan 2014 09:27:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:27:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:27:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:27:31 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:27:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:27:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:27:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:27:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:27:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:27:31 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:27:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:27:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:27:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:27:38 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 09:27:38 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 09:27:38 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:27:38 - XML: Processed 655432 elements - found 617 jobs
Fri 17 Jan 2014 09:27:39 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:27:39 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:27:39 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:27:39 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:27:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:27:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:27:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:27:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:27:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:27:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:27:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:27:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:27:42 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:27:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43832885
Fri 17 Jan 2014 09:27:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:27:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43832885
Fri 17 Jan 2014 09:27:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:27:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:27:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:27:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:27:48 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:27:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:27:49 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:27:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 09:27:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 09:27:49 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:27:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8840 values 139425 bits 17428 bytes 
Fri 17 Jan 2014 09:27:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:27:54 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:27:54 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:27:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:27:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:27:54 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:27:54 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:27:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:27:54 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:27:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:27:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:27:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:27:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:27:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:27:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:27:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:27:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:27:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:27:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:27:58 - job_xml_thread(): Done retrieving: data size 43865389
Fri 17 Jan 2014 09:27:58 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:27:58 - XML: Start document: iteration 19
Fri 17 Jan 2014 09:27:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865389
Fri 17 Jan 2014 09:27:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43865389
Fri 17 Jan 2014 09:27:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:27:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:28:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:28:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:28:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:28:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:28:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:28:14 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:28:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:28:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:28:14 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:28:14 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:28:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:28:14 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:28:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:28:21 - XML: Processed 655440 elements - found 621 jobs
Fri 17 Jan 2014 09:28:21 - job 7347674 field 'start_timestamp' changed since saved from: 1389947156 to: 1389947102
Fri 17 Jan 2014 09:28:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:28:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:28:22 - job 7347668 report time 1389947120 does not match current heartbeat 1389947241 : ignoring job
Fri 17 Jan 2014 09:28:22 - job 7347624 appears to have finished
Fri 17 Jan 2014 09:28:22 - job_xml_thread(): Found 7 updated jobs.
Fri 17 Jan 2014 09:28:22 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 09:28:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:28:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:28:22 - job_xml_thread(): Done storing. succesfully stored: 7 jobs
Fri 17 Jan 2014 09:28:22 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:28:22 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:28:22 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:28:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 09:28:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:28:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:28:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:28:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:28:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:28:23 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:28:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43838115
Fri 17 Jan 2014 09:28:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:28:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43838115
Fri 17 Jan 2014 09:28:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:28:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:28:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:28:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:28:34 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:28:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:28:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:28:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:28:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:28:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:28:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:28:35 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:28:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:28:36 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:28:37 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:28:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:28:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:28:38 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:28:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43864574
Fri 17 Jan 2014 09:28:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:28:39 - job_xml_thread(): Done retrieving: data size 43864574
Fri 17 Jan 2014 09:28:39 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:28:39 - XML: Start document: iteration 20
Fri 17 Jan 2014 09:28:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:28:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:28:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:28:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:28:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43864574
Fri 17 Jan 2014 09:28:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:28:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:28:49 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:28:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:28:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:28:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:28:50 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:28:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 09:28:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 09:28:50 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:28:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8937 values 140915 bits 17614 bytes 
Fri 17 Jan 2014 09:28:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:28:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:28:54 - XML: Processed 655440 elements - found 621 jobs
Fri 17 Jan 2014 09:28:54 - job 7347668 report time 1389947120 does not match current heartbeat 1389947241 : ignoring job
Fri 17 Jan 2014 09:28:55 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:28:55 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:28:55 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:28:55 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:28:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:28:56 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:28:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:28:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:28:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:28:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:28:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:28:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:28:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:29:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:29:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:29:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:29:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:29:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:29:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:29:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:29:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:29:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:29:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875073
Fri 17 Jan 2014 09:29:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:29:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875073
Fri 17 Jan 2014 09:29:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:29:10 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:29:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:29:10 - job_xml_thread(): Done retrieving: data size 43875073
Fri 17 Jan 2014 09:29:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:29:10 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:29:10 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 09:29:11 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 09:29:11 - Housekeeping: done.
Fri 17 Jan 2014 09:29:12 - XML: Start document: iteration 0
Fri 17 Jan 2014 09:29:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:29:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:29:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:29:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:29:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:29:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:29:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:29:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:29:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:29:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:29:19 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:29:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:29:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:29:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:29:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:29:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:29:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:29:22 - XML: Processed 655439 elements - found 621 jobs
Fri 17 Jan 2014 09:29:22 - job 7347668 report time 1389947120 does not match current heartbeat 1389947241 : ignoring job
Fri 17 Jan 2014 09:29:22 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:29:22 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:29:22 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:29:22 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:29:22 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:29:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 09:29:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:29:24 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:29:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43774145
Fri 17 Jan 2014 09:29:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:29:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43774145
Fri 17 Jan 2014 09:29:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:29:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:29:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:29:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:29:34 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:29:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:29:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:29:35 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:29:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:29:35 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:29:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:29:35 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:29:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:29:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:29:37 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:29:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:29:38 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:29:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:29:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:29:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:29:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:29:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:29:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:29:40 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:29:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43289805
Fri 17 Jan 2014 09:29:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:29:40 - job_xml_thread(): Done retrieving: data size 43289805
Fri 17 Jan 2014 09:29:40 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:29:40 - XML: Start document: iteration 1
Fri 17 Jan 2014 09:29:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43289805
Fri 17 Jan 2014 09:29:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:29:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:29:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:29:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:29:50 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:29:51 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:29:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 09:29:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:29:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 09:29:51 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:29:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9219 values 145393 bits 18174 bytes 
Fri 17 Jan 2014 09:29:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:29:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:29:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:29:56 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:29:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:29:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:29:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:29:57 - XML: Processed 648530 elements - found 621 jobs
Fri 17 Jan 2014 09:29:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:29:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:29:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:29:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:29:57 - job 7347668 report time 1389947120 does not match current heartbeat 1389947241 : ignoring job
Fri 17 Jan 2014 09:29:57 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:29:57 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:29:57 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:29:57 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:30:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:30:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:30:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:30:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:30:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:30:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:30:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:30:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:30:04 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:30:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43194897
Fri 17 Jan 2014 09:30:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:30:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43194897
Fri 17 Jan 2014 09:30:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:30:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:30:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:30:12 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:30:12 - job_xml_thread(): Done retrieving: data size 43194897
Fri 17 Jan 2014 09:30:12 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:30:12 - XML: Start document: iteration 2
Fri 17 Jan 2014 09:30:13 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:30:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 09:30:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:30:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:30:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:30:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:30:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:30:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:30:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:30:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:30:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:30:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:30:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:30:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:30:22 - XML: Processed 647230 elements - found 616 jobs
Fri 17 Jan 2014 09:30:22 - job 7347680 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 09:30:22 - job 7347606 appears to have finished
Fri 17 Jan 2014 09:30:22 - job 7347673 appears to have finished
Fri 17 Jan 2014 09:30:22 - job 7347677 report time 1389947241 does not match current heartbeat 1389947361 : ignoring job
Fri 17 Jan 2014 09:30:22 - job 7347679 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 09:30:22 - job 7347658 appears to have finished
Fri 17 Jan 2014 09:30:22 - job 7347638 appears to have finished
Fri 17 Jan 2014 09:30:22 - job 7346714 appears to have finished
Fri 17 Jan 2014 09:30:22 - job 7347594 appears to have finished
Fri 17 Jan 2014 09:30:22 - job_xml_thread(): Found 10 updated jobs.
Fri 17 Jan 2014 09:30:22 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 09:30:24 - job_xml_thread(): Done storing. succesfully stored: 10 jobs
Fri 17 Jan 2014 09:30:24 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:30:24 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:30:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:30:25 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:30:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:30:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:30:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:30:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:30:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:30:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:30:27 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:30:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43238470
Fri 17 Jan 2014 09:30:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:30:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43238470
Fri 17 Jan 2014 09:30:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:30:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:30:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:30:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:30:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:30:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:30:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:30:39 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:30:39 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:30:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:30:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:30:39 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:30:39 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:30:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:30:40 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:30:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:30:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:30:41 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:30:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43706252
Fri 17 Jan 2014 09:30:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:30:41 - job_xml_thread(): Done retrieving: data size 43706252
Fri 17 Jan 2014 09:30:41 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:30:41 - XML: Start document: iteration 3
Fri 17 Jan 2014 09:30:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:30:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:30:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:30:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:30:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43706252
Fri 17 Jan 2014 09:30:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:30:43 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 09:30:43 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:30:44 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:30:44 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 09:30:44 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 09:30:44 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:30:44 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 09:30:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:30:51 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:30:53 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:30:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 09:30:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:30:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 09:30:53 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:30:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9280 values 146362 bits 18295 bytes 
Fri 17 Jan 2014 09:30:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:30:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:30:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:30:54 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:30:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:30:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:30:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:30:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:30:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:30:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:30:56 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:30:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:30:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:31:00 - XML: Processed 653525 elements - found 616 jobs
Fri 17 Jan 2014 09:31:00 - job 7347677 report time 1389947241 does not match current heartbeat 1389947361 : ignoring job
Fri 17 Jan 2014 09:31:00 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:31:00 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:31:00 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:31:00 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:31:01 - size of cluster 'LISA Cluster': 624 hosts 79471 metrics 788143 values 12428625 bits 1553578 bytes 
Fri 17 Jan 2014 09:31:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:31:06 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:31:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:31:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:31:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:31:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:31:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:31:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:31:08 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:31:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43840752
Fri 17 Jan 2014 09:31:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:31:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43840752
Fri 17 Jan 2014 09:31:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:31:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:31:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:31:15 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:31:15 - job_xml_thread(): Done retrieving: data size 43840752
Fri 17 Jan 2014 09:31:15 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:31:15 - XML: Start document: iteration 4
Fri 17 Jan 2014 09:31:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:31:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:31:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:31:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:31:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:31:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:31:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:31:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:31:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:31:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:31:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:31:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:31:25 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:31:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:31:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:31:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:31:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:31:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:31:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:31:30 - XML: Processed 655416 elements - found 616 jobs
Fri 17 Jan 2014 09:31:30 - job 7347677 report time 1389947241 does not match current heartbeat 1389947361 : ignoring job
Fri 17 Jan 2014 09:31:30 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:31:30 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:31:30 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:31:30 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:31:30 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:31:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 09:31:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:31:33 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:31:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43840169
Fri 17 Jan 2014 09:31:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:31:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43840169
Fri 17 Jan 2014 09:31:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:31:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:31:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:31:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:31:41 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:31:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:31:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:31:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:31:42 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:31:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:31:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:31:42 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:31:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43840169
Fri 17 Jan 2014 09:31:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:31:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:31:44 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:31:44 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 09:31:45 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:31:45 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:31:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:31:50 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:31:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:31:54 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:31:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:31:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:31:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:31:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:31:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:31:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 09:31:55 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:31:55 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:31:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 09:31:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5827 values 92047 bits 11505 bytes 
Fri 17 Jan 2014 09:31:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:31:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:31:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:31:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:31:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:31:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:31:57 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:31:57 - job_xml_thread(): Done retrieving: data size 43832272
Fri 17 Jan 2014 09:31:57 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:31:57 - XML: Start document: iteration 5
Fri 17 Jan 2014 09:31:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43832272
Fri 17 Jan 2014 09:31:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:31:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:31:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:31:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43832272
Fri 17 Jan 2014 09:31:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:31:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:31:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:32:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:32:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:32:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:32:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:32:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:32:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:32:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:32:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:32:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:32:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:32:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:32:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:32:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:32:20 - XML: Processed 655424 elements - found 613 jobs
Fri 17 Jan 2014 09:32:20 - job 7341622 appears to have finished
Fri 17 Jan 2014 09:32:20 - job 7347641 appears to have finished
Fri 17 Jan 2014 09:32:20 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 09:32:20 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 09:32:20 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 09:32:20 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:32:20 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:32:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:32:21 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:32:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:32:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:32:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:32:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:32:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:32:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:32:22 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:32:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 09:32:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:32:24 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:32:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43871430
Fri 17 Jan 2014 09:32:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:32:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43871430
Fri 17 Jan 2014 09:32:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:32:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:32:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:32:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:32:34 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:32:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:32:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:32:35 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:32:35 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:32:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:32:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:32:35 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:32:35 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:32:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:32:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:32:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:32:40 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:32:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:32:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:32:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:32:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:32:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:32:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:32:42 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:32:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43847629
Fri 17 Jan 2014 09:32:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:32:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43847629
Fri 17 Jan 2014 09:32:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:32:43 - job_xml_thread(): Done retrieving: data size 43847629
Fri 17 Jan 2014 09:32:43 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:32:43 - XML: Start document: iteration 6
Fri 17 Jan 2014 09:32:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:32:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:32:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:32:55 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:32:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:32:56 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:32:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 09:32:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:32:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:32:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 09:32:56 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:32:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8419 values 133124 bits 16640 bytes 
Fri 17 Jan 2014 09:33:01 - XML: Processed 655430 elements - found 616 jobs
Fri 17 Jan 2014 09:33:01 - job 7347682 report time 1389947361 does not match current heartbeat 1389947482 : ignoring job
Fri 17 Jan 2014 09:33:01 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 09:33:01 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 09:33:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:33:03 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:33:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:33:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:33:04 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:33:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:33:04 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:33:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:33:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:33:04 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 09:33:04 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:33:04 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:33:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:33:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:33:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:33:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:33:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:33:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:33:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:33:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:33:10 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:33:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 09:33:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:33:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:33:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856506
Fri 17 Jan 2014 09:33:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:33:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43856506
Fri 17 Jan 2014 09:33:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:33:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:33:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:33:19 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:33:19 - job_xml_thread(): Done retrieving: data size 43856506
Fri 17 Jan 2014 09:33:19 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:33:19 - XML: Start document: iteration 7
Fri 17 Jan 2014 09:33:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:33:21 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:33:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:33:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:33:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:33:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:33:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:33:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:33:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:33:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:33:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:33:30 - XML: Processed 655430 elements - found 616 jobs
Fri 17 Jan 2014 09:33:30 - job 7347682 report time 1389947361 does not match current heartbeat 1389947482 : ignoring job
Fri 17 Jan 2014 09:33:30 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:33:30 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:33:30 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:33:30 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:33:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:33:33 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:33:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:33:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:33:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:33:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:33:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:33:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:33:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:33:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43842720
Fri 17 Jan 2014 09:33:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:33:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43842720
Fri 17 Jan 2014 09:33:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:33:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:33:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:33:45 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:33:45 - job_xml_thread(): Done retrieving: data size 43842720
Fri 17 Jan 2014 09:33:45 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:33:45 - XML: Start document: iteration 8
Fri 17 Jan 2014 09:33:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:33:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:33:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:33:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:33:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:33:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:33:48 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:33:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:33:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:33:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:33:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:33:55 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 09:33:55 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 09:33:55 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:33:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:33:56 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:33:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:33:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 09:33:56 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:33:56 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:33:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99071 bits 12383 bytes 
Fri 17 Jan 2014 09:33:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 09:33:57 - XML: Processed 655430 elements - found 616 jobs
Fri 17 Jan 2014 09:33:57 - job 7347682 report time 1389947361 does not match current heartbeat 1389947482 : ignoring job
Fri 17 Jan 2014 09:33:57 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:33:57 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:33:57 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:33:57 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:34:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:34:01 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:34:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:34:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:34:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:34:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:34:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:34:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:34:03 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:34:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43830671
Fri 17 Jan 2014 09:34:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:34:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43830671
Fri 17 Jan 2014 09:34:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:34:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:34:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:34:12 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:34:12 - job_xml_thread(): Done retrieving: data size 43830671
Fri 17 Jan 2014 09:34:12 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:34:12 - XML: Start document: iteration 9
Fri 17 Jan 2014 09:34:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:34:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:34:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:34:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:34:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:34:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:34:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:34:21 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:34:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:34:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:34:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:34:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:34:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:34:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:34:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:34:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:34:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:34:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:34:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:34:25 - XML: Processed 655432 elements - found 617 jobs
Fri 17 Jan 2014 09:34:25 - job 7347684 field 'start_timestamp' changed since saved from: 1389947536 to: 1389947474
Fri 17 Jan 2014 09:34:25 - job 7347653 appears to have finished
Fri 17 Jan 2014 09:34:25 - job_xml_thread(): Found 5 updated jobs.
Fri 17 Jan 2014 09:34:25 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 09:34:25 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Fri 17 Jan 2014 09:34:25 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:34:25 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:34:25 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:34:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 09:34:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:34:27 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:34:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858807
Fri 17 Jan 2014 09:34:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:34:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43858807
Fri 17 Jan 2014 09:34:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:34:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:34:36 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:34:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:34:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:34:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:34:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:34:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:34:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:34:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:34:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:34:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:34:40 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:34:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:34:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:34:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:34:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:34:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:34:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:34:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:34:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:34:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:34:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862726
Fri 17 Jan 2014 09:34:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:34:44 - job_xml_thread(): Done retrieving: data size 43862726
Fri 17 Jan 2014 09:34:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862726
Fri 17 Jan 2014 09:34:45 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:34:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:34:45 - XML: Start document: iteration 10
Fri 17 Jan 2014 09:34:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:34:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:34:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:34:57 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:34:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:34:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:34:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 09:34:58 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:34:58 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:34:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 09:34:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:34:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8837 values 139357 bits 17419 bytes 
Fri 17 Jan 2014 09:35:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:35:00 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:35:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:35:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:35:01 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:35:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:35:01 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:35:01 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:35:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:35:03 - XML: Processed 655432 elements - found 617 jobs
Fri 17 Jan 2014 09:35:03 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:35:03 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:35:03 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:35:04 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:35:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:35:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:35:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:35:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:35:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:35:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:35:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:35:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:35:08 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:35:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867421
Fri 17 Jan 2014 09:35:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:35:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43867421
Fri 17 Jan 2014 09:35:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:35:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:35:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:35:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:35:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:35:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:35:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:35:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:35:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:35:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:35:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:35:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:35:19 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:35:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:35:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:35:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:35:21 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:35:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:35:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:35:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:35:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:35:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:35:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:35:21 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:35:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 09:35:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:35:23 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:35:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43803514
Fri 17 Jan 2014 09:35:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:35:23 - job_xml_thread(): Done retrieving: data size 43803514
Fri 17 Jan 2014 09:35:23 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:35:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43803514
Fri 17 Jan 2014 09:35:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:35:23 - XML: Start document: iteration 11
Fri 17 Jan 2014 09:35:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:35:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:35:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:35:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:35:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:35:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:35:35 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:35:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:35:35 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:35:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:35:35 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:35:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:35:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:35:42 - XML: Processed 654684 elements - found 617 jobs
Fri 17 Jan 2014 09:35:42 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:35:42 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:35:42 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:35:42 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:35:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:35:44 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:35:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:35:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:35:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:35:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:35:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:35:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:35:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:35:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43240299
Fri 17 Jan 2014 09:35:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:35:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43240299
Fri 17 Jan 2014 09:35:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:35:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:35:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:35:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:35:56 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:35:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:35:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:35:57 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:35:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:35:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:35:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:35:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:35:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:35:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:35:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:35:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:35:58 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:35:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:35:59 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:35:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 09:35:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 09:35:59 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:35:59 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8802 values 138791 bits 17348 bytes 
Fri 17 Jan 2014 09:36:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:36:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:36:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:36:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:36:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:36:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:36:01 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:36:01 - job_xml_thread(): Done retrieving: data size 43202405
Fri 17 Jan 2014 09:36:01 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:36:01 - XML: Start document: iteration 12
Fri 17 Jan 2014 09:36:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43202405
Fri 17 Jan 2014 09:36:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:36:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43202405
Fri 17 Jan 2014 09:36:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:36:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:36:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:36:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:36:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:36:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:36:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:36:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:36:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:36:20 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:36:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:36:20 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:36:20 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:36:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:36:23 - XML: Processed 647232 elements - found 617 jobs
Fri 17 Jan 2014 09:36:23 - job 7347688 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 09:36:23 - job 7347687 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 09:36:23 - job 7347683 report time 1389947603 does not match current heartbeat 1389947723 : ignoring job
Fri 17 Jan 2014 09:36:23 - job 7347656 appears to have finished
Fri 17 Jan 2014 09:36:23 - job 7347616 appears to have finished
Fri 17 Jan 2014 09:36:23 - job_xml_thread(): Found 6 updated jobs.
Fri 17 Jan 2014 09:36:23 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 09:36:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:36:24 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:36:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:36:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:36:24 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Fri 17 Jan 2014 09:36:24 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:36:24 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:36:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:36:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:36:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:36:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:36:25 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:36:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 09:36:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:36:26 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:36:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43256708
Fri 17 Jan 2014 09:36:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:36:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43256708
Fri 17 Jan 2014 09:36:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:36:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:36:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:36:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:36:36 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:36:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:36:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:36:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:36:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:36:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:36:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:36:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:36:39 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:36:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:36:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:36:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:36:40 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:36:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:36:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:36:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:36:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:36:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:36:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:36:41 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:36:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43788303
Fri 17 Jan 2014 09:36:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:36:42 - job_xml_thread(): Done retrieving: data size 43788303
Fri 17 Jan 2014 09:36:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43788303
Fri 17 Jan 2014 09:36:42 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:36:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:36:42 - XML: Start document: iteration 13
Fri 17 Jan 2014 09:36:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:36:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:36:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:36:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:36:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:36:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:36:55 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:36:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:36:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:36:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:36:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:36:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:36:59 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:36:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:36:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 09:36:59 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:37:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8188 values 129116 bits 16139 bytes 
Fri 17 Jan 2014 09:37:00 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:37:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 09:37:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:37:01 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:37:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:37:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:37:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:37:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:37:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:37:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:37:04 - XML: Processed 654506 elements - found 617 jobs
Fri 17 Jan 2014 09:37:04 - job 7347683 report time 1389947603 does not match current heartbeat 1389947723 : ignoring job
Fri 17 Jan 2014 09:37:04 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:37:04 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:37:04 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:37:04 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:37:06 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:37:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43841533
Fri 17 Jan 2014 09:37:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:37:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43841533
Fri 17 Jan 2014 09:37:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:37:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:37:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:37:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:37:16 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:37:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:37:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:37:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:37:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:37:17 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:37:17 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:37:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:37:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:37:17 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:37:19 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:37:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:37:20 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:37:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:37:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:37:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:37:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:37:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:37:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:37:20 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:37:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 09:37:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:37:22 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:37:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43869733
Fri 17 Jan 2014 09:37:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:37:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43869733
Fri 17 Jan 2014 09:37:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:37:22 - job_xml_thread(): Done retrieving: data size 43869733
Fri 17 Jan 2014 09:37:22 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:37:22 - XML: Start document: iteration 14
Fri 17 Jan 2014 09:37:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:37:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:37:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:37:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:37:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:37:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:37:35 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:37:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:37:35 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:37:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:37:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:37:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:37:35 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:37:42 - XML: Processed 655432 elements - found 617 jobs
Fri 17 Jan 2014 09:37:42 - job 7347683 report time 1389947603 does not match current heartbeat 1389947723 : ignoring job
Fri 17 Jan 2014 09:37:42 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:37:42 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:37:42 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:37:42 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:37:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:37:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:37:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:37:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:37:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:37:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:37:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:37:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:37:44 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 09:37:44 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:37:44 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:37:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43844144
Fri 17 Jan 2014 09:37:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:37:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43844144
Fri 17 Jan 2014 09:37:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:37:45 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:37:45 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 09:37:46 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 09:37:47 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:37:48 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 09:37:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:37:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:37:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:37:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:37:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:37:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:37:56 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:37:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:37:56 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:37:56 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:37:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:37:57 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:37:58 - size of cluster 'LISA Cluster': 624 hosts 79481 metrics 897471 values 14171789 bits 1771473 bytes 
Fri 17 Jan 2014 09:37:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:37:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:38:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:38:00 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:38:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:38:01 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:38:01 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:38:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 09:38:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:38:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 09:38:01 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:38:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:38:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8974 values 141567 bits 17695 bytes 
Fri 17 Jan 2014 09:38:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:38:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:38:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:38:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:38:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:38:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:38:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856025
Fri 17 Jan 2014 09:38:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:38:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43856025
Fri 17 Jan 2014 09:38:05 - job_xml_thread(): Done retrieving: data size 43856025
Fri 17 Jan 2014 09:38:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:38:05 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:38:05 - XML: Start document: iteration 15
Fri 17 Jan 2014 09:38:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:38:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:38:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:38:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:38:19 - XML: Processed 655434 elements - found 618 jobs
Fri 17 Jan 2014 09:38:19 - job 7347689 report time 1389947723 does not match current heartbeat 1389947844 : ignoring job
Fri 17 Jan 2014 09:38:19 - job 7347684 appears to have finished
Fri 17 Jan 2014 09:38:19 - job 7347659 appears to have finished
Fri 17 Jan 2014 09:38:19 - job 7347690 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 09:38:20 - job_xml_thread(): Found 7 updated jobs.
Fri 17 Jan 2014 09:38:20 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 09:38:23 - job_xml_thread(): Done storing. succesfully stored: 7 jobs
Fri 17 Jan 2014 09:38:23 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:38:23 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:38:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:38:25 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:38:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:38:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:38:26 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:38:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:38:26 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:38:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:38:26 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:38:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:38:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:38:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:38:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:38:28 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:38:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 09:38:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:38:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:38:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:38:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:38:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:38:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:38:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875908
Fri 17 Jan 2014 09:38:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:38:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875908
Fri 17 Jan 2014 09:38:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:38:38 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:38:38 - job_xml_thread(): Done retrieving: data size 43875908
Fri 17 Jan 2014 09:38:38 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:38:39 - XML: Start document: iteration 16
Fri 17 Jan 2014 09:38:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:38:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:38:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:38:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:38:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:38:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:38:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:38:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:38:45 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:38:45 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:38:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:38:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:38:45 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:38:48 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:38:48 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 09:38:51 - XML: Processed 655434 elements - found 618 jobs
Fri 17 Jan 2014 09:38:51 - job 7347689 report time 1389947723 does not match current heartbeat 1389947844 : ignoring job
Fri 17 Jan 2014 09:38:51 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:38:51 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:38:51 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:38:51 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:38:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:38:55 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:38:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:38:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:38:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:38:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:38:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:38:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:38:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:38:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43832274
Fri 17 Jan 2014 09:38:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:38:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43832274
Fri 17 Jan 2014 09:38:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:39:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:39:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:39:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:39:01 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:39:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:39:02 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:39:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 09:39:02 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:39:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 09:39:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8934 values 140867 bits 17608 bytes 
Fri 17 Jan 2014 09:39:06 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:39:06 - job_xml_thread(): Done retrieving: data size 43832274
Fri 17 Jan 2014 09:39:06 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:39:06 - XML: Start document: iteration 17
Fri 17 Jan 2014 09:39:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:39:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:39:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:39:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:39:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:39:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:39:10 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:39:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:39:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:39:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:39:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:39:22 - XML: Processed 655434 elements - found 618 jobs
Fri 17 Jan 2014 09:39:22 - job 7347689 report time 1389947723 does not match current heartbeat 1389947844 : ignoring job
Fri 17 Jan 2014 09:39:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:39:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:39:22 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:39:22 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:39:22 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:39:22 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:39:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:39:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:39:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:39:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:39:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:39:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:39:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:39:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:39:25 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:39:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 09:39:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:39:26 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:39:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43831148
Fri 17 Jan 2014 09:39:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:39:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43831148
Fri 17 Jan 2014 09:39:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:39:37 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:39:37 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:39:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:39:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:39:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:39:38 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:39:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:39:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:39:39 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:39:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:39:39 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:39:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:39:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:39:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:39:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:39:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:39:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:39:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:39:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:39:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:39:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:39:45 - job_xml_thread(): Done retrieving: data size 43847195
Fri 17 Jan 2014 09:39:45 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:39:45 - XML: Start document: iteration 18
Fri 17 Jan 2014 09:39:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43847195
Fri 17 Jan 2014 09:39:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:39:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43847195
Fri 17 Jan 2014 09:39:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:39:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:39:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:39:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:39:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:40:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:40:02 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:40:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:40:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 09:40:03 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:40:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 09:40:03 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:40:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99022 bits 12377 bytes 
Fri 17 Jan 2014 09:40:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:40:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:40:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:40:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:40:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:40:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:40:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:40:06 - XML: Processed 655434 elements - found 618 jobs
Fri 17 Jan 2014 09:40:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:40:06 - job 7347689 report time 1389947723 does not match current heartbeat 1389947844 : ignoring job
Fri 17 Jan 2014 09:40:06 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:40:06 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:40:06 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:40:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:40:06 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:40:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:40:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:40:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:40:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:40:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:40:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:40:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:40:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:40:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:40:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43840418
Fri 17 Jan 2014 09:40:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:40:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43840418
Fri 17 Jan 2014 09:40:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:40:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:40:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:40:21 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:40:21 - job_xml_thread(): Done retrieving: data size 43840418
Fri 17 Jan 2014 09:40:21 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:40:21 - XML: Start document: iteration 19
Fri 17 Jan 2014 09:40:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:40:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:40:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:40:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:40:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:40:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:40:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:40:27 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:40:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:40:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:40:27 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:40:34 - XML: Processed 655436 elements - found 619 jobs
Fri 17 Jan 2014 09:40:34 - job 7347562 appears to have finished
Fri 17 Jan 2014 09:40:34 - job 7347663 appears to have finished
Fri 17 Jan 2014 09:40:34 - job 7347693 report time 1389947844 does not match current heartbeat 1389947965 : ignoring job
Fri 17 Jan 2014 09:40:34 - job 7347694 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 09:40:34 - job_xml_thread(): Found 7 updated jobs.
Fri 17 Jan 2014 09:40:34 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 09:40:35 - job_xml_thread(): Done storing. succesfully stored: 7 jobs
Fri 17 Jan 2014 09:40:35 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:40:35 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:40:36 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:40:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 09:40:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:40:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:40:38 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:40:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:40:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:40:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:40:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:40:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:40:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:40:40 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:40:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43837335
Fri 17 Jan 2014 09:40:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:40:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43837335
Fri 17 Jan 2014 09:40:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:40:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:40:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:40:50 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:40:50 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:40:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:40:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:40:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:40:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:40:51 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:40:51 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:40:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:40:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:40:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:40:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:40:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:40:55 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:40:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:40:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:40:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:40:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:40:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:40:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:40:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:40:58 - job_xml_thread(): Done retrieving: data size 43843921
Fri 17 Jan 2014 09:40:58 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:40:58 - XML: Start document: iteration 20
Fri 17 Jan 2014 09:40:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43843921
Fri 17 Jan 2014 09:40:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:40:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43843921
Fri 17 Jan 2014 09:40:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:41:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:41:04 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:41:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:41:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 09:41:06 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:41:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 09:41:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:41:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:41:07 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:41:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8720 values 137446 bits 17180 bytes 
Fri 17 Jan 2014 09:41:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:41:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:41:15 - XML: Processed 655436 elements - found 619 jobs
Fri 17 Jan 2014 09:41:15 - job 7347693 report time 1389947844 does not match current heartbeat 1389947965 : ignoring job
Fri 17 Jan 2014 09:41:15 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:41:15 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:41:15 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:41:15 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:41:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:41:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:41:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:41:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:41:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:41:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:41:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:41:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:41:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:41:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:41:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:41:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:41:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:41:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:41:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:41:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:41:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:41:24 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 09:41:24 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 09:41:24 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:41:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:41:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43783033
Fri 17 Jan 2014 09:41:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:41:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43783033
Fri 17 Jan 2014 09:41:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:41:30 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:41:30 - job_xml_thread(): Done retrieving: data size 43783033
Fri 17 Jan 2014 09:41:30 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:41:30 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 09:41:30 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 09:41:30 - Housekeeping: done.
Fri 17 Jan 2014 09:41:30 - XML: Start document: iteration 0
Fri 17 Jan 2014 09:41:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:41:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:41:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:41:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:41:46 - XML: Processed 654688 elements - found 619 jobs
Fri 17 Jan 2014 09:41:47 - job 7347693 report time 1389947844 does not match current heartbeat 1389947965 : ignoring job
Fri 17 Jan 2014 09:41:47 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:41:47 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:41:47 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:41:47 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:41:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:41:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:41:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:41:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:41:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:41:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:41:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:41:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:41:48 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:41:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:41:48 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:41:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:41:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:41:48 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:41:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 09:41:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:41:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:41:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:41:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:41:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:41:50 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:41:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43239359
Fri 17 Jan 2014 09:41:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:41:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43239359
Fri 17 Jan 2014 09:41:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:42:03 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:42:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:42:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:42:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:42:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:42:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:42:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:42:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:42:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:42:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:42:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:42:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:42:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:42:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:42:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:42:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:42:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:42:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:42:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:42:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:42:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:42:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:42:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:42:06 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:42:07 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:42:07 - job_xml_thread(): Done retrieving: data size 43209715
Fri 17 Jan 2014 09:42:07 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:42:07 - XML: Start document: iteration 1
Fri 17 Jan 2014 09:42:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43209715
Fri 17 Jan 2014 09:42:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:42:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43209715
Fri 17 Jan 2014 09:42:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:42:10 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:42:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:42:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 09:42:10 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:42:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 09:42:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9070 values 143068 bits 17883 bytes 
Fri 17 Jan 2014 09:42:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:42:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:42:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:42:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:42:24 - XML: Processed 647232 elements - found 617 jobs
Fri 17 Jan 2014 09:42:24 - job 7347561 appears to have finished
Fri 17 Jan 2014 09:42:24 - job 7347607 appears to have finished
Fri 17 Jan 2014 09:42:25 - job 7347700 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 09:42:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:42:25 - job 7347697 report time 1389947965 does not match current heartbeat 1389948085 : ignoring job
Fri 17 Jan 2014 09:42:25 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:42:25 - job 7347699 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 09:42:25 - job 7347614 appears to have finished
Fri 17 Jan 2014 09:42:25 - job_xml_thread(): Found 7 updated jobs.
Fri 17 Jan 2014 09:42:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:42:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:42:25 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 09:42:26 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:42:26 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:42:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:42:26 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:42:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:42:26 - job_xml_thread(): Done storing. succesfully stored: 7 jobs
Fri 17 Jan 2014 09:42:26 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:42:27 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:42:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:42:30 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:42:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:42:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:42:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:42:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:42:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:42:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:42:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:42:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43266811
Fri 17 Jan 2014 09:42:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:42:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43266811
Fri 17 Jan 2014 09:42:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:42:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:42:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:42:42 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:42:42 - job_xml_thread(): Done retrieving: data size 43266811
Fri 17 Jan 2014 09:42:42 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:42:42 - XML: Start document: iteration 2
Fri 17 Jan 2014 09:42:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:42:45 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:42:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:42:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:42:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:42:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:42:47 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:42:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:42:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:42:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:42:48 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:42:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:42:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:42:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:42:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:42:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:42:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:42:53 - XML: Processed 647982 elements - found 617 jobs
Fri 17 Jan 2014 09:42:53 - job 7347697 report time 1389947965 does not match current heartbeat 1389948085 : ignoring job
Fri 17 Jan 2014 09:42:53 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:42:53 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:42:53 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:42:53 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:42:53 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:42:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 09:42:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:42:55 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:42:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43825474
Fri 17 Jan 2014 09:42:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:42:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43825474
Fri 17 Jan 2014 09:42:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:43:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:43:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:43:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:43:03 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:43:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:43:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:43:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:43:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:43:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:43:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:43:05 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:43:08 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:43:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:43:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:43:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:43:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:43:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:43:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:43:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:43:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:43:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:43:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43839958
Fri 17 Jan 2014 09:43:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:43:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43839958
Fri 17 Jan 2014 09:43:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:43:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:43:11 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:43:11 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:43:11 - job_xml_thread(): Done retrieving: data size 43839958
Fri 17 Jan 2014 09:43:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:43:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 09:43:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 09:43:11 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:43:12 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:43:12 - XML: Start document: iteration 3
Fri 17 Jan 2014 09:43:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8886 values 140080 bits 17510 bytes 
Fri 17 Jan 2014 09:43:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:43:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:43:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:43:25 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:43:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:43:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:43:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:43:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:43:26 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:43:26 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:43:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:43:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:43:26 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:43:31 - XML: Processed 655426 elements - found 617 jobs
Fri 17 Jan 2014 09:43:31 - job 7347697 report time 1389947965 does not match current heartbeat 1389948085 : ignoring job
Fri 17 Jan 2014 09:43:31 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:43:31 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:43:31 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:43:31 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:43:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:43:33 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:43:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:43:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:43:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:43:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:43:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:43:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:43:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:43:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853770
Fri 17 Jan 2014 09:43:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:43:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853770
Fri 17 Jan 2014 09:43:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:43:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:43:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:43:46 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:43:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:43:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:43:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:43:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:43:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:43:47 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:43:47 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:43:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:43:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:43:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:43:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:43:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:43:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:43:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:43:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:43:51 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:43:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 09:43:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:43:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:43:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:43:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:43:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:43:53 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:43:53 - job_xml_thread(): Done retrieving: data size 43855071
Fri 17 Jan 2014 09:43:53 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:43:53 - XML: Start document: iteration 4
Fri 17 Jan 2014 09:43:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855071
Fri 17 Jan 2014 09:43:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855071
Fri 17 Jan 2014 09:43:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:43:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:44:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:44:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:44:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:44:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:44:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:44:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:44:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:44:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:44:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:44:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:44:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:44:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:44:09 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:44:11 - XML: Processed 655432 elements - found 617 jobs
Fri 17 Jan 2014 09:44:12 - job 7347697 report time 1389947965 does not match current heartbeat 1389948085 : ignoring job
Fri 17 Jan 2014 09:44:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:44:12 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:44:12 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:44:12 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:44:12 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:44:12 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:44:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:44:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 09:44:12 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:44:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 09:44:12 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:44:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5955 values 93883 bits 11735 bytes 
Fri 17 Jan 2014 09:44:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:44:15 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:44:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:44:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:44:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:44:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:44:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:44:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:44:17 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:44:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43861653
Fri 17 Jan 2014 09:44:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:44:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43861653
Fri 17 Jan 2014 09:44:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:44:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:44:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:44:27 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:44:27 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:44:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:44:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:44:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:44:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:44:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:44:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:44:32 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:44:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:44:32 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:44:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:44:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:44:34 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:44:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:44:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:44:34 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:44:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 09:44:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:44:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:44:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:44:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:44:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:44:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:44:36 - job_xml_thread(): Done retrieving: data size 43863255
Fri 17 Jan 2014 09:44:36 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:44:36 - XML: Start document: iteration 5
Fri 17 Jan 2014 09:44:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43863255
Fri 17 Jan 2014 09:44:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:44:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43863255
Fri 17 Jan 2014 09:44:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:44:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:44:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:44:49 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 09:44:49 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:44:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:44:49 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:44:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:44:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:44:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:44:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:44:51 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:44:51 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:44:51 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 09:44:51 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 09:44:51 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 09:44:51 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:44:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:44:51 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:44:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:44:51 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:44:53 - size of cluster 'LISA Cluster': 624 hosts 79471 metrics 834541 values 13163177 bits 1645397 bytes 
Fri 17 Jan 2014 09:44:56 - XML: Processed 655438 elements - found 620 jobs
Fri 17 Jan 2014 09:44:56 - job 7347704 report time 1389948085 does not match current heartbeat 1389948206 : ignoring job
Fri 17 Jan 2014 09:44:56 - job 7347703 field 'start_timestamp' changed since saved from: 1389948114 to: 1389948042
Fri 17 Jan 2014 09:44:56 - job 7347620 appears to have finished
Fri 17 Jan 2014 09:44:56 - job_xml_thread(): Found 7 updated jobs.
Fri 17 Jan 2014 09:44:56 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 09:44:57 - job_xml_thread(): Done storing. succesfully stored: 7 jobs
Fri 17 Jan 2014 09:44:57 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:44:57 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:45:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:45:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:45:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:45:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:45:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:45:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:45:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:45:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:45:03 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:45:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43844595
Fri 17 Jan 2014 09:45:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:45:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43844595
Fri 17 Jan 2014 09:45:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:45:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:45:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:45:12 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:45:12 - job_xml_thread(): Done retrieving: data size 43844595
Fri 17 Jan 2014 09:45:12 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:45:12 - XML: Start document: iteration 6
Fri 17 Jan 2014 09:45:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:45:13 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:45:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:45:13 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:45:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:45:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:45:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:45:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 09:45:14 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:45:14 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:45:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 09:45:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8963 values 141338 bits 17667 bytes 
Fri 17 Jan 2014 09:45:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:45:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:45:15 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:45:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:45:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:45:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:45:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:45:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:45:20 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:45:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:45:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:45:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:45:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:45:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:45:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:45:24 - XML: Processed 655438 elements - found 620 jobs
Fri 17 Jan 2014 09:45:24 - job 7347704 report time 1389948085 does not match current heartbeat 1389948206 : ignoring job
Fri 17 Jan 2014 09:45:24 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:45:24 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:45:24 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:45:24 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:45:27 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:45:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43827990
Fri 17 Jan 2014 09:45:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:45:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43827990
Fri 17 Jan 2014 09:45:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:45:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:45:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:45:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:45:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:45:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:45:38 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:45:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:45:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:45:39 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:45:39 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:45:39 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:45:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:45:39 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:45:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:45:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:45:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:45:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:45:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:45:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:45:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:45:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:45:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:45:44 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:45:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 09:45:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:45:46 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:45:46 - job_xml_thread(): Done retrieving: data size 43863837
Fri 17 Jan 2014 09:45:46 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:45:46 - XML: Start document: iteration 7
Fri 17 Jan 2014 09:45:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43863837
Fri 17 Jan 2014 09:45:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:45:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43863837
Fri 17 Jan 2014 09:45:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:45:51 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:45:52 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 09:45:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:45:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:45:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:45:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:46:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:46:01 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:46:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:46:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:46:03 - XML: Processed 655438 elements - found 620 jobs
Fri 17 Jan 2014 09:46:03 - job 7347704 report time 1389948085 does not match current heartbeat 1389948206 : ignoring job
Fri 17 Jan 2014 09:46:03 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:46:03 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:46:03 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:46:03 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:46:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:46:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:46:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:46:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:46:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:46:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:46:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:46:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:46:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:46:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:46:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:46:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:46:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:46:09 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:46:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43845409
Fri 17 Jan 2014 09:46:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:46:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43845409
Fri 17 Jan 2014 09:46:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:46:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:46:14 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:46:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:46:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 09:46:15 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:46:15 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:46:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8672 values 136744 bits 17093 bytes 
Fri 17 Jan 2014 09:46:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 09:46:18 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:46:18 - job_xml_thread(): Done retrieving: data size 43845409
Fri 17 Jan 2014 09:46:18 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:46:18 - XML: Start document: iteration 8
Fri 17 Jan 2014 09:46:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:46:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:46:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:46:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:46:32 - XML: Processed 655435 elements - found 619 jobs
Fri 17 Jan 2014 09:46:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:46:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:46:32 - job 7347709 report time 1389948206 does not match current heartbeat 1389948326 : ignoring job
Fri 17 Jan 2014 09:46:32 - job 7347708 field 'start_timestamp' changed since saved from: 1389948214 to: 1389948164
Fri 17 Jan 2014 09:46:32 - job 7347707 field 'start_timestamp' changed since saved from: 1389948212 to: 1389948164
Fri 17 Jan 2014 09:46:32 - job 7347710 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 09:46:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:46:32 - job 7347559 appears to have finished
Fri 17 Jan 2014 09:46:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:46:32 - job 7347626 appears to have finished
Fri 17 Jan 2014 09:46:32 - job 7347612 appears to have finished
Fri 17 Jan 2014 09:46:32 - job_xml_thread(): Found 9 updated jobs.
Fri 17 Jan 2014 09:46:32 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 09:46:32 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:46:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:46:32 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:46:32 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:46:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:46:33 - job_xml_thread(): Done storing. succesfully stored: 9 jobs
Fri 17 Jan 2014 09:46:33 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:46:33 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:46:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:46:34 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:46:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:46:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:46:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:46:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:46:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:46:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:46:38 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:46:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43863308
Fri 17 Jan 2014 09:46:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:46:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43863308
Fri 17 Jan 2014 09:46:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:46:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:46:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:46:48 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:46:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:46:49 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:46:49 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:46:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:46:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:46:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:46:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:46:50 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:46:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:46:50 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:46:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:46:51 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:46:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 09:46:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:46:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:46:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:46:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:46:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:46:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:46:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:46:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:46:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:46:57 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:46:57 - job_xml_thread(): Done retrieving: data size 43845087
Fri 17 Jan 2014 09:46:57 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:46:57 - XML: Start document: iteration 9
Fri 17 Jan 2014 09:46:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43845087
Fri 17 Jan 2014 09:46:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43845087
Fri 17 Jan 2014 09:46:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:46:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:47:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:47:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:47:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:47:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:47:12 - XML: Processed 655436 elements - found 619 jobs
Fri 17 Jan 2014 09:47:13 - job 7347709 report time 1389948206 does not match current heartbeat 1389948326 : ignoring job
Fri 17 Jan 2014 09:47:13 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:47:13 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:47:13 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:47:13 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:47:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:47:15 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:47:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:47:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:47:16 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:47:16 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:47:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 09:47:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 09:47:16 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:47:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5961 values 94266 bits 11783 bytes 
Fri 17 Jan 2014 09:47:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:47:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:47:17 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:47:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:47:17 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:47:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:47:17 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:47:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:47:20 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:47:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:47:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:47:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:47:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:47:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:47:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:47:24 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:47:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 09:47:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:47:24 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:47:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43785638
Fri 17 Jan 2014 09:47:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:47:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43785638
Fri 17 Jan 2014 09:47:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:47:28 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:47:28 - job_xml_thread(): Done retrieving: data size 43785638
Fri 17 Jan 2014 09:47:28 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:47:28 - XML: Start document: iteration 10
Fri 17 Jan 2014 09:47:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:47:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:47:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:47:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:47:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:47:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:47:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:47:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:47:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:47:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:47:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:47:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:47:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:47:43 - XML: Processed 654688 elements - found 619 jobs
Fri 17 Jan 2014 09:47:43 - job 7347709 report time 1389948206 does not match current heartbeat 1389948326 : ignoring job
Fri 17 Jan 2014 09:47:43 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:47:43 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:47:43 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:47:43 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:47:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:47:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:47:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:47:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:47:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:47:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:47:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:47:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:47:50 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:47:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43257325
Fri 17 Jan 2014 09:47:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:47:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43257325
Fri 17 Jan 2014 09:47:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:47:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:47:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:47:58 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:47:58 - job_xml_thread(): Done retrieving: data size 43257325
Fri 17 Jan 2014 09:47:58 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:47:58 - XML: Start document: iteration 11
Fri 17 Jan 2014 09:48:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:48:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:48:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:48:07 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:48:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:48:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:48:08 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:48:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:48:08 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:48:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:48:08 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:48:13 - XML: Processed 648208 elements - found 619 jobs
Fri 17 Jan 2014 09:48:13 - job 7347709 report time 1389948206 does not match current heartbeat 1389948326 : ignoring job
Fri 17 Jan 2014 09:48:13 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:48:13 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:48:13 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:48:13 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:48:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:48:13 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:48:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:48:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:48:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:48:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:48:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:48:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:48:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:48:16 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:48:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:48:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 09:48:16 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:48:16 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:48:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 09:48:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99371 bits 12421 bytes 
Fri 17 Jan 2014 09:48:16 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:48:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43263923
Fri 17 Jan 2014 09:48:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:48:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43263923
Fri 17 Jan 2014 09:48:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:48:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:48:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:48:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:48:27 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:48:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:48:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:48:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:48:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:48:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:48:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:48:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:48:28 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:48:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:48:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:48:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:48:33 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:48:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:48:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:48:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:48:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:48:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:48:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:48:37 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:48:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43327780
Fri 17 Jan 2014 09:48:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:48:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43327780
Fri 17 Jan 2014 09:48:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:48:37 - job_xml_thread(): Done retrieving: data size 43327780
Fri 17 Jan 2014 09:48:37 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:48:37 - XML: Start document: iteration 12
Fri 17 Jan 2014 09:48:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:48:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:48:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:48:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:48:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:48:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:48:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:48:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:48:53 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:48:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:48:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:48:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:48:53 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:48:57 - XML: Processed 648800 elements - found 617 jobs
Fri 17 Jan 2014 09:48:57 - job 7347714 report time 1389948326 does not match current heartbeat 1389948447 : ignoring job
Fri 17 Jan 2014 09:48:57 - job 7347651 appears to have finished
Fri 17 Jan 2014 09:48:57 - job 7347639 appears to have finished
Fri 17 Jan 2014 09:48:57 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 09:48:57 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 09:48:58 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 09:48:58 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:48:58 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:48:59 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:48:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 09:48:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:49:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:49:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:49:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:49:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:49:00 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 09:49:00 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 09:49:00 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:49:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:49:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:49:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:49:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:49:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:49:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43848964
Fri 17 Jan 2014 09:49:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:49:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43848964
Fri 17 Jan 2014 09:49:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:49:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:49:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:49:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:49:13 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:49:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:49:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:49:13 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:49:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:49:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:49:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:49:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:49:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:49:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:49:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:49:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:49:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:49:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:49:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:49:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:49:16 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:49:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:49:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:49:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:49:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:49:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:49:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 09:49:16 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:49:16 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:49:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 09:49:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5845 values 92240 bits 11530 bytes 
Fri 17 Jan 2014 09:49:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:49:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43860480
Fri 17 Jan 2014 09:49:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:49:18 - job_xml_thread(): Done retrieving: data size 43860480
Fri 17 Jan 2014 09:49:18 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:49:18 - XML: Start document: iteration 13
Fri 17 Jan 2014 09:49:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43860480
Fri 17 Jan 2014 09:49:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:49:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:49:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:49:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:49:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:49:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:49:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:49:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:49:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:49:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:49:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:49:31 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:49:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:49:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:49:39 - XML: Processed 655432 elements - found 617 jobs
Fri 17 Jan 2014 09:49:39 - job 7347714 report time 1389948326 does not match current heartbeat 1389948447 : ignoring job
Fri 17 Jan 2014 09:49:39 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:49:39 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:49:39 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:49:39 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:49:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:49:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:49:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:49:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:49:42 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:49:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 09:49:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:49:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:49:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:49:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:49:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:49:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:49:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43824558
Fri 17 Jan 2014 09:49:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:49:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43824558
Fri 17 Jan 2014 09:49:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:49:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:49:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:49:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:49:53 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:49:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:49:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:49:54 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:49:54 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:49:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:49:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:49:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:49:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:49:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:49:57 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:49:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:49:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:49:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:49:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:49:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:49:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:49:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:49:58 - job_xml_thread(): Done retrieving: data size 43863508
Fri 17 Jan 2014 09:49:58 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:49:58 - XML: Start document: iteration 14
Fri 17 Jan 2014 09:49:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43863508
Fri 17 Jan 2014 09:49:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:49:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43863508
Fri 17 Jan 2014 09:49:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:50:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:50:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:50:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:50:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:50:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:50:17 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:50:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:50:18 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:50:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 09:50:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:50:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:50:18 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:50:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 09:50:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:50:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:50:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8422 values 132771 bits 16596 bytes 
Fri 17 Jan 2014 09:50:20 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:50:20 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:50:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:50:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:50:20 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:50:21 - XML: Processed 655434 elements - found 618 jobs
Fri 17 Jan 2014 09:50:21 - job 7347716 report time 1389948447 does not match current heartbeat 1389948568 : ignoring job
Fri 17 Jan 2014 09:50:21 - job 7347698 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 09:50:21 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 09:50:21 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 09:50:21 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 09:50:21 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:50:21 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:50:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:50:23 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:50:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:50:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:50:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:50:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:50:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:50:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:50:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:50:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851218
Fri 17 Jan 2014 09:50:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:50:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851218
Fri 17 Jan 2014 09:50:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:50:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:50:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:50:37 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:50:37 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:50:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:50:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:50:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:50:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:50:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:50:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:50:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:50:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:50:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:50:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:50:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:50:40 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:50:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:50:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:50:40 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:50:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 09:50:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:50:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:50:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:50:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:50:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:50:42 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:50:42 - job_xml_thread(): Done retrieving: data size 43853733
Fri 17 Jan 2014 09:50:42 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:50:42 - XML: Start document: iteration 15
Fri 17 Jan 2014 09:50:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853733
Fri 17 Jan 2014 09:50:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853733
Fri 17 Jan 2014 09:50:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:50:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:50:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:50:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:50:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:50:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:50:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:50:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:50:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:50:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:50:59 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:50:59 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:50:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:50:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:50:59 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:51:01 - XML: Processed 655434 elements - found 618 jobs
Fri 17 Jan 2014 09:51:01 - job 7347716 report time 1389948447 does not match current heartbeat 1389948568 : ignoring job
Fri 17 Jan 2014 09:51:01 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:51:01 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:51:01 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:51:01 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:51:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:51:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:51:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:51:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:51:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:51:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:51:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:51:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:51:07 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:51:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862034
Fri 17 Jan 2014 09:51:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:51:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862034
Fri 17 Jan 2014 09:51:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:51:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:51:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:51:16 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:51:16 - job_xml_thread(): Done retrieving: data size 43862034
Fri 17 Jan 2014 09:51:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:51:16 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:51:16 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:51:16 - XML: Start document: iteration 16
Fri 17 Jan 2014 09:51:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:51:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:51:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:51:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:51:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:51:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:51:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:51:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:51:19 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:51:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:51:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:51:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:51:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 09:51:20 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:51:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 09:51:20 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:51:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8686 values 136969 bits 17121 bytes 
Fri 17 Jan 2014 09:51:26 - XML: Processed 655434 elements - found 618 jobs
Fri 17 Jan 2014 09:51:26 - job 7347716 report time 1389948447 does not match current heartbeat 1389948568 : ignoring job
Fri 17 Jan 2014 09:51:26 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:51:26 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:51:26 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:51:26 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:51:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:51:30 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:51:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:51:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:51:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:51:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:51:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:51:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:51:33 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:51:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43830421
Fri 17 Jan 2014 09:51:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:51:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:51:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:51:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43830421
Fri 17 Jan 2014 09:51:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:51:41 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:51:41 - job_xml_thread(): Done retrieving: data size 43830421
Fri 17 Jan 2014 09:51:41 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:51:41 - XML: Start document: iteration 17
Fri 17 Jan 2014 09:51:44 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:51:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 09:51:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:51:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:51:46 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:51:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:51:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:51:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:51:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:51:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:51:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:51:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:51:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:51:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:51:53 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 09:51:53 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:51:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:51:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:51:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:51:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:51:55 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:51:55 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:51:55 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 09:51:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:51:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:51:55 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 09:51:55 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 09:51:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:51:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:51:56 - XML: Processed 655434 elements - found 618 jobs
Fri 17 Jan 2014 09:51:56 - job 7347716 report time 1389948447 does not match current heartbeat 1389948568 : ignoring job
Fri 17 Jan 2014 09:51:56 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:51:56 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:51:56 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:51:56 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:51:56 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 863705 values 13643877 bits 1705484 bytes 
Fri 17 Jan 2014 09:52:00 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:52:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43835310
Fri 17 Jan 2014 09:52:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:52:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43835310
Fri 17 Jan 2014 09:52:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:52:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:52:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:52:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:52:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:52:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:52:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:52:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:52:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:52:11 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:52:11 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:52:11 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:52:11 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:52:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:52:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:52:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:52:15 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:52:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:52:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:52:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:52:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:52:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:52:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:52:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:52:18 - job_xml_thread(): Done retrieving: data size 43853611
Fri 17 Jan 2014 09:52:18 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:52:18 - XML: Start document: iteration 18
Fri 17 Jan 2014 09:52:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853611
Fri 17 Jan 2014 09:52:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853611
Fri 17 Jan 2014 09:52:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:52:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:52:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:52:21 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:52:21 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:52:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 09:52:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:52:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 09:52:21 - Entering storeMetrics(): cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Fri 17 Jan 2014 09:52:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:52:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:52:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:52:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:52:38 - XML: Processed 655434 elements - found 618 jobs
Fri 17 Jan 2014 09:52:38 - job 7341631 appears to have finished
Fri 17 Jan 2014 09:52:38 - job 7347554 appears to have finished
Fri 17 Jan 2014 09:52:38 - job_xml_thread(): Found 5 updated jobs.
Fri 17 Jan 2014 09:52:38 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 09:52:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:52:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:52:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:52:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:52:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:52:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:52:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:52:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:52:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:52:42 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Fri 17 Jan 2014 09:52:42 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:52:42 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:52:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:52:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:52:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:52:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:52:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:52:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:52:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:52:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:52:46 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:52:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856145
Fri 17 Jan 2014 09:52:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:52:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43856145
Fri 17 Jan 2014 09:52:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:52:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:52:54 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:52:55 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:52:55 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 09:52:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:52:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:52:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:52:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:52:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:52:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:52:57 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:52:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:52:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:52:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:53:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:53:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:53:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:53:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:53:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:53:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:53:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:53:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:53:03 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:53:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855987
Fri 17 Jan 2014 09:53:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:53:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855987
Fri 17 Jan 2014 09:53:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:53:03 - job_xml_thread(): Done retrieving: data size 43855987
Fri 17 Jan 2014 09:53:03 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:53:03 - XML: Start document: iteration 19
Fri 17 Jan 2014 09:53:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:53:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:53:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:53:14 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:53:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:53:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:53:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:53:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:53:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:53:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:53:15 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:53:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:53:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:53:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:53:21 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:53:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:53:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 09:53:22 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:53:22 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:53:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 09:53:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 15618 values 246333 bits 30791 bytes 
Fri 17 Jan 2014 09:53:24 - XML: Processed 655434 elements - found 618 jobs
Fri 17 Jan 2014 09:53:24 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:53:24 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:53:24 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:53:24 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:53:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:53:27 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:53:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:53:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:53:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:53:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:53:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:53:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:53:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:53:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:53:30 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:53:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43756133
Fri 17 Jan 2014 09:53:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:53:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43756133
Fri 17 Jan 2014 09:53:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:53:39 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:53:39 - job_xml_thread(): Done retrieving: data size 43756133
Fri 17 Jan 2014 09:53:39 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:53:39 - XML: Start document: iteration 20
Fri 17 Jan 2014 09:53:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:53:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:53:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:53:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:53:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:53:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:53:40 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:53:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:53:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:53:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:53:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:53:53 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:53:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 09:53:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:53:53 - XML: Processed 654686 elements - found 618 jobs
Fri 17 Jan 2014 09:53:53 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:53:53 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:53:53 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:53:53 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:53:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:53:53 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:53:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:53:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:53:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:53:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:53:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:53:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:53:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:53:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:53:55 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:53:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43240422
Fri 17 Jan 2014 09:53:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:53:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43240422
Fri 17 Jan 2014 09:53:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:54:08 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:54:08 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:54:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:54:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:54:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:54:09 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:54:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:54:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:54:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:54:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:54:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:54:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:54:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:54:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:54:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:54:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:54:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:54:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:54:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:54:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:54:14 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:54:14 - job_xml_thread(): Done retrieving: data size 43228020
Fri 17 Jan 2014 09:54:14 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:54:14 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 09:54:14 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 09:54:14 - Housekeeping: done.
Fri 17 Jan 2014 09:54:14 - XML: Start document: iteration 0
Fri 17 Jan 2014 09:54:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43228020
Fri 17 Jan 2014 09:54:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:54:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43228020
Fri 17 Jan 2014 09:54:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:54:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:54:22 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:54:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:54:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 09:54:22 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:54:22 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:54:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 09:54:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8750 values 137919 bits 17239 bytes 
Fri 17 Jan 2014 09:54:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:54:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:54:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:54:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:54:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:54:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:54:26 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:54:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:54:26 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:54:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:54:26 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:54:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:54:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:54:33 - XML: Processed 647730 elements - found 594 jobs
Fri 17 Jan 2014 09:54:33 - job 7347475 appears to have finished
Fri 17 Jan 2014 09:54:33 - job 7347474 appears to have finished
Fri 17 Jan 2014 09:54:33 - job 7347566 appears to have finished
Fri 17 Jan 2014 09:54:33 - job 7347477 appears to have finished
Fri 17 Jan 2014 09:54:33 - job 7347479 appears to have finished
Fri 17 Jan 2014 09:54:33 - job 7347478 appears to have finished
Fri 17 Jan 2014 09:54:33 - job 7347493 appears to have finished
Fri 17 Jan 2014 09:54:33 - job 7347492 appears to have finished
Fri 17 Jan 2014 09:54:33 - job 7347491 appears to have finished
Fri 17 Jan 2014 09:54:33 - job 7347490 appears to have finished
Fri 17 Jan 2014 09:54:33 - job 7347662 appears to have finished
Fri 17 Jan 2014 09:54:33 - job 7347665 appears to have finished
Fri 17 Jan 2014 09:54:33 - job 7347488 appears to have finished
Fri 17 Jan 2014 09:54:33 - job 7347484 appears to have finished
Fri 17 Jan 2014 09:54:33 - job 7347487 appears to have finished
Fri 17 Jan 2014 09:54:33 - job 7347482 appears to have finished
Fri 17 Jan 2014 09:54:33 - job 7347483 appears to have finished
Fri 17 Jan 2014 09:54:33 - job 7347489 appears to have finished
Fri 17 Jan 2014 09:54:33 - job 7347485 appears to have finished
Fri 17 Jan 2014 09:54:33 - job 7347486 appears to have finished
Fri 17 Jan 2014 09:54:33 - job 7347480 appears to have finished
Fri 17 Jan 2014 09:54:33 - job 7347481 appears to have finished
Fri 17 Jan 2014 09:54:33 - job 7347649 appears to have finished
Fri 17 Jan 2014 09:54:33 - job 7347454 appears to have finished
Fri 17 Jan 2014 09:54:33 - job 7347476 appears to have finished
Fri 17 Jan 2014 09:54:33 - job_xml_thread(): Found 26 updated jobs.
Fri 17 Jan 2014 09:54:33 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 09:54:36 - job_xml_thread(): Done storing. succesfully stored: 26 jobs
Fri 17 Jan 2014 09:54:36 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:54:36 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:54:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:54:37 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:54:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:54:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:54:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:54:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:54:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:54:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:54:40 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:54:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43481310
Fri 17 Jan 2014 09:54:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:54:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43481310
Fri 17 Jan 2014 09:54:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:54:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:54:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:54:51 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:54:51 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:54:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:54:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:54:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:54:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:54:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:54:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:54:53 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:54:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:54:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:54:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:54:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:54:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:54:56 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:54:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 09:54:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:54:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:54:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:54:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:54:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:54:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:54:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:54:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:54:58 - job_xml_thread(): Done retrieving: data size 43833048
Fri 17 Jan 2014 09:54:58 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:54:58 - XML: Start document: iteration 1
Fri 17 Jan 2014 09:54:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43833048
Fri 17 Jan 2014 09:54:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43833048
Fri 17 Jan 2014 09:54:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:54:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:55:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:55:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:55:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:55:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:55:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:55:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:55:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:55:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:55:12 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:55:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:55:12 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:55:12 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:55:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:55:18 - XML: Processed 655366 elements - found 594 jobs
Fri 17 Jan 2014 09:55:18 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:55:18 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:55:18 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:55:18 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:55:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:55:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:55:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:55:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:55:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:55:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:55:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:55:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:55:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:55:23 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:55:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:55:23 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:55:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 09:55:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 09:55:23 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:55:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6006 values 94725 bits 11840 bytes 
Fri 17 Jan 2014 09:55:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:55:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43830332
Fri 17 Jan 2014 09:55:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:55:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43830332
Fri 17 Jan 2014 09:55:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:55:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:55:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:55:33 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:55:33 - job_xml_thread(): Done retrieving: data size 43830332
Fri 17 Jan 2014 09:55:33 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:55:33 - XML: Start document: iteration 2
Fri 17 Jan 2014 09:55:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:55:36 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:55:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:55:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:55:37 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:55:37 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:55:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:55:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:55:37 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:55:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:55:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:55:44 - XML: Processed 655386 elements - found 594 jobs
Fri 17 Jan 2014 09:55:45 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:55:45 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:55:45 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:55:45 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:55:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:55:49 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:55:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:55:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:55:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:55:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:55:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:55:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:55:50 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 09:55:50 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 09:55:50 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:55:50 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:55:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 09:55:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:55:51 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:55:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43824710
Fri 17 Jan 2014 09:55:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:55:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43824710
Fri 17 Jan 2014 09:55:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:55:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:55:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:56:00 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:56:00 - job_xml_thread(): Done retrieving: data size 43824710
Fri 17 Jan 2014 09:56:00 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:56:00 - XML: Start document: iteration 3
Fri 17 Jan 2014 09:56:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:56:03 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:56:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:56:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:56:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:56:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:56:04 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:56:04 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:56:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:56:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:56:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:56:10 - XML: Processed 655386 elements - found 594 jobs
Fri 17 Jan 2014 09:56:10 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:56:10 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:56:10 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:56:10 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:56:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:56:13 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:56:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:56:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:56:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:56:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:56:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:56:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:56:15 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:56:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43821775
Fri 17 Jan 2014 09:56:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:56:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43821775
Fri 17 Jan 2014 09:56:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:56:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:56:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:56:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:56:24 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:56:25 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:56:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 09:56:25 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:56:25 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:56:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:56:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 09:56:26 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:56:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7330 values 115538 bits 14442 bytes 
Fri 17 Jan 2014 09:56:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:56:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:56:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:56:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:56:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:56:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:56:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:56:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:56:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:56:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:56:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:56:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:56:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:56:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:56:30 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:56:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:56:30 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:56:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:56:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:56:32 - job_xml_thread(): Done retrieving: data size 43837918
Fri 17 Jan 2014 09:56:32 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:56:32 - XML: Start document: iteration 4
Fri 17 Jan 2014 09:56:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43837918
Fri 17 Jan 2014 09:56:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:56:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43837918
Fri 17 Jan 2014 09:56:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:56:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:56:45 - XML: Processed 655388 elements - found 595 jobs
Fri 17 Jan 2014 09:56:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:56:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:56:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:56:45 - job 7347629 appears to have finished
Fri 17 Jan 2014 09:56:45 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 09:56:45 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 09:56:49 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 09:56:49 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:56:49 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:56:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:56:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:56:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:56:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:56:54 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:56:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:56:54 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:56:54 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:56:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:56:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:56:55 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:56:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:56:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:56:55 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:56:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 09:56:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:56:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:56:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:56:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:56:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:56:57 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:56:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43881145
Fri 17 Jan 2014 09:56:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:56:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43881145
Fri 17 Jan 2014 09:56:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:57:04 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:57:04 - job_xml_thread(): Done retrieving: data size 43881145
Fri 17 Jan 2014 09:57:04 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:57:04 - XML: Start document: iteration 5
Fri 17 Jan 2014 09:57:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:57:07 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:57:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:57:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:57:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:57:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:57:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:57:10 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:57:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:57:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:57:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:57:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:57:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:57:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:57:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:57:17 - XML: Processed 655388 elements - found 595 jobs
Fri 17 Jan 2014 09:57:17 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:57:17 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:57:17 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:57:17 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:57:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:57:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:57:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:57:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:57:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:57:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43835282
Fri 17 Jan 2014 09:57:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:57:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43835282
Fri 17 Jan 2014 09:57:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:57:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:57:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:57:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:57:25 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:57:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:57:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:57:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:57:26 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:57:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 09:57:26 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:57:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 09:57:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:57:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:57:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8700 values 137127 bits 17140 bytes 
Fri 17 Jan 2014 09:57:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:57:27 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:57:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:57:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:57:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43835282
Fri 17 Jan 2014 09:57:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:57:32 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:57:32 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:57:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:57:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:57:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:57:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:57:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:57:40 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:57:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:57:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:57:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:57:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:57:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:57:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:57:42 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:57:42 - job_xml_thread(): Done retrieving: data size 43854018
Fri 17 Jan 2014 09:57:42 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:57:42 - XML: Start document: iteration 6
Fri 17 Jan 2014 09:57:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:57:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:57:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43854018
Fri 17 Jan 2014 09:57:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:57:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:57:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:57:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:57:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43854018
Fri 17 Jan 2014 09:57:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:57:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:57:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:57:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:58:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:58:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:58:03 - XML: Processed 655388 elements - found 595 jobs
Fri 17 Jan 2014 09:58:04 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:58:04 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:58:04 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:58:04 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:58:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:58:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:58:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:58:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:58:06 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:58:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:58:06 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:58:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:58:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:58:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:58:06 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:58:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:58:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:58:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:58:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:58:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:58:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:58:07 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:58:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 09:58:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:58:08 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:58:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43872804
Fri 17 Jan 2014 09:58:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:58:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43872804
Fri 17 Jan 2014 09:58:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:58:19 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:58:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:58:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:58:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:58:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:58:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:58:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:58:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:58:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:58:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:58:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:58:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:58:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:58:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:58:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:58:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:58:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:58:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:58:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:58:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:58:24 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:58:24 - job_xml_thread(): Done retrieving: data size 43862954
Fri 17 Jan 2014 09:58:24 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:58:24 - XML: Start document: iteration 7
Fri 17 Jan 2014 09:58:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862954
Fri 17 Jan 2014 09:58:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862954
Fri 17 Jan 2014 09:58:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:58:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:58:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:58:27 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:58:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:58:29 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:58:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 09:58:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 09:58:29 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:58:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8875 values 139906 bits 17488 bytes 
Fri 17 Jan 2014 09:58:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:58:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:58:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:58:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:58:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:58:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:58:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:58:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:58:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:58:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:58:43 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:58:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:58:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:58:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:58:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:58:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:58:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:58:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:58:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:58:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:58:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:58:46 - XML: Processed 655374 elements - found 588 jobs
Fri 17 Jan 2014 09:58:46 - job 7347457 appears to have finished
Fri 17 Jan 2014 09:58:46 - job 7347672 appears to have finished
Fri 17 Jan 2014 09:58:46 - job 7347458 appears to have finished
Fri 17 Jan 2014 09:58:46 - job 7347666 appears to have finished
Fri 17 Jan 2014 09:58:46 - job 7341629 appears to have finished
Fri 17 Jan 2014 09:58:46 - job 7347724 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 09:58:46 - job 7347453 appears to have finished
Fri 17 Jan 2014 09:58:46 - job 7347456 appears to have finished
Fri 17 Jan 2014 09:58:46 - job_xml_thread(): Found 8 updated jobs.
Fri 17 Jan 2014 09:58:46 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 09:58:46 - job_xml_thread(): Done storing. succesfully stored: 8 jobs
Fri 17 Jan 2014 09:58:46 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:58:46 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:58:48 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:58:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43844150
Fri 17 Jan 2014 09:58:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:58:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43844150
Fri 17 Jan 2014 09:58:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:58:56 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 09:58:56 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:58:58 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:58:58 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 09:58:58 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 09:58:58 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:58:58 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 09:58:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:58:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:58:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:58:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Fri 17 Jan 2014 09:59:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:59:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:59:01 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:59:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:59:01 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:59:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:59:01 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:59:01 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:59:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:59:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:59:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:59:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:59:02 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:59:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 09:59:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:59:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:59:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:59:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:59:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:59:04 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:59:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43844366
Fri 17 Jan 2014 09:59:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:59:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43844366
Fri 17 Jan 2014 09:59:05 - job_xml_thread(): Done retrieving: data size 43844366
Fri 17 Jan 2014 09:59:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:59:05 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:59:05 - XML: Start document: iteration 8
Fri 17 Jan 2014 09:59:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:59:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:59:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:59:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:59:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:59:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:59:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:59:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:59:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:59:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:59:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:59:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:59:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:59:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:59:25 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:59:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:59:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:59:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:59:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:59:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:59:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:59:27 - XML: Processed 655374 elements - found 588 jobs
Fri 17 Jan 2014 09:59:27 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 09:59:27 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 09:59:27 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 09:59:27 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 09:59:29 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:59:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43765820
Fri 17 Jan 2014 09:59:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:59:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43765820
Fri 17 Jan 2014 09:59:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:59:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:59:31 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:59:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:59:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:59:35 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:59:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 09:59:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 09:59:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:59:35 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:59:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8933 values 140810 bits 17601 bytes 
Fri 17 Jan 2014 09:59:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:59:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:59:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 09:59:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:59:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:59:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:59:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:59:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:59:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43765820
Fri 17 Jan 2014 09:59:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:59:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:59:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 09:59:42 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 09:59:43 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 09:59:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 09:59:49 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 09:59:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 09:59:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:59:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 09:59:50 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 09:59:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:59:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 09:59:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 09:59:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 09:59:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 09:59:52 - job_xml_thread(): Done retrieving: data size 43199575
Fri 17 Jan 2014 09:59:52 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 09:59:52 - XML: Start document: iteration 9
Fri 17 Jan 2014 09:59:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43199575
Fri 17 Jan 2014 09:59:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 09:59:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 09:59:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 09:59:54 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:59:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 09:59:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43199575
Fri 17 Jan 2014 09:59:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 09:59:54 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 09:59:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 09:59:58 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 09:59:58 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 09:59:58 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 09:59:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 09:59:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:00:00 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:00:00 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 10:00:00 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:00:00 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 10:00:00 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 10:00:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:00:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:00:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:00:09 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:00:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:00:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:00:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:00:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:00:10 - size of cluster 'LISA Cluster': 624 hosts 79477 metrics 915543 values 14439673 bits 1804959 bytes 
Fri 17 Jan 2014 10:00:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:00:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:00:10 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:00:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:00:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:00:14 - XML: Processed 647620 elements - found 588 jobs
Fri 17 Jan 2014 10:00:14 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:00:14 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:00:14 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:00:14 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:00:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:00:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:00:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:00:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:00:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:00:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:00:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:00:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:00:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:00:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43212764
Fri 17 Jan 2014 10:00:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:00:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43212764
Fri 17 Jan 2014 10:00:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:00:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:00:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:00:29 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:00:29 - job_xml_thread(): Done retrieving: data size 43212764
Fri 17 Jan 2014 10:00:29 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:00:29 - XML: Start document: iteration 10
Fri 17 Jan 2014 10:00:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:00:29 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:00:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:00:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:00:30 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:00:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:00:30 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:00:30 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:00:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:00:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:00:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:00:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:00:35 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:00:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:00:36 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:00:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 10:00:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 10:00:36 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:00:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6255 values 98602 bits 12325 bytes 
Fri 17 Jan 2014 10:00:41 - XML: Processed 647844 elements - found 587 jobs
Fri 17 Jan 2014 10:00:41 - job 7347461 appears to have finished
Fri 17 Jan 2014 10:00:41 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 10:00:41 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 10:00:42 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 10:00:42 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:00:42 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:00:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:00:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:00:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:00:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:00:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:00:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:00:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:00:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:00:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:00:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:00:46 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:00:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43683943
Fri 17 Jan 2014 10:00:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:00:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43683943
Fri 17 Jan 2014 10:00:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:00:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:00:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:00:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:00:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:00:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:00:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:00:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43683943
Fri 17 Jan 2014 10:00:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:00:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:00:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:00:57 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:00:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:00:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:00:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:01:00 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:01:00 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 10:01:01 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:01:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 10:01:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:01:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:01:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:01:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:01:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:01:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:01:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:01:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:01:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:01:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:01:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:01:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:01:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:01:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:01:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:01:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:01:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:01:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:01:12 - job_xml_thread(): Done retrieving: data size 43817274
Fri 17 Jan 2014 10:01:12 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:01:12 - XML: Start document: iteration 11
Fri 17 Jan 2014 10:01:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43817274
Fri 17 Jan 2014 10:01:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:01:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43817274
Fri 17 Jan 2014 10:01:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:01:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:01:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:01:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:01:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:01:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:01:29 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:01:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:01:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:01:30 - XML: Processed 655372 elements - found 587 jobs
Fri 17 Jan 2014 10:01:30 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:01:30 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:01:30 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:01:30 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:01:30 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:01:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:01:30 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:01:30 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:01:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:01:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:01:35 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:01:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:01:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:01:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:01:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:01:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:01:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:01:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:01:36 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:01:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:01:37 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:01:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 10:01:37 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:01:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6137 values 96896 bits 12112 bytes 
Fri 17 Jan 2014 10:01:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 10:01:38 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:01:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43833279
Fri 17 Jan 2014 10:01:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:01:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43833279
Fri 17 Jan 2014 10:01:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:01:45 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:01:45 - job_xml_thread(): Done retrieving: data size 43833279
Fri 17 Jan 2014 10:01:45 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:01:45 - XML: Start document: iteration 12
Fri 17 Jan 2014 10:01:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:01:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:01:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:01:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:01:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:01:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:01:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:01:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:01:59 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:01:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:01:59 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:01:59 - XML: Processed 655372 elements - found 587 jobs
Fri 17 Jan 2014 10:01:59 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:01:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:01:59 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:01:59 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:01:59 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:01:59 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:02:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:02:03 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:02:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:02:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:02:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:02:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:02:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:02:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:02:05 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:02:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 10:02:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:02:06 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:02:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43837962
Fri 17 Jan 2014 10:02:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:02:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43837962
Fri 17 Jan 2014 10:02:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:02:14 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:02:14 - job_xml_thread(): Done retrieving: data size 43837962
Fri 17 Jan 2014 10:02:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:02:14 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:02:14 - XML: Start document: iteration 13
Fri 17 Jan 2014 10:02:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:02:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:02:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:02:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:02:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:02:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:02:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:02:23 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:02:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:02:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:02:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:02:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:02:27 - XML: Processed 655372 elements - found 587 jobs
Fri 17 Jan 2014 10:02:27 - job 7347452 appears to have finished
Fri 17 Jan 2014 10:02:27 - job 7341627 appears to have finished
Fri 17 Jan 2014 10:02:27 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 10:02:27 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 10:02:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:02:30 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:02:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:02:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:02:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:02:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:02:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:02:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:02:32 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 10:02:32 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:02:32 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:02:33 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 10:02:33 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 10:02:33 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:02:33 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:02:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43823162
Fri 17 Jan 2014 10:02:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:02:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43823162
Fri 17 Jan 2014 10:02:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:02:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:02:37 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:02:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:02:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 10:02:37 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:02:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 10:02:37 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:02:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7342 values 116175 bits 14521 bytes 
Fri 17 Jan 2014 10:02:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:02:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:02:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:02:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:02:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:02:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:02:45 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:02:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:02:45 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:02:45 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:02:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:02:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:02:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:02:47 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:02:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:02:48 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:02:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:02:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:02:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:02:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:02:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:02:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:02:51 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:02:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43843278
Fri 17 Jan 2014 10:02:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:02:51 - job_xml_thread(): Done retrieving: data size 43843278
Fri 17 Jan 2014 10:02:51 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:02:51 - XML: Start document: iteration 14
Fri 17 Jan 2014 10:02:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43843278
Fri 17 Jan 2014 10:02:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:03:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:03:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:03:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:03:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:03:09 - XML: Processed 655372 elements - found 587 jobs
Fri 17 Jan 2014 10:03:09 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:03:09 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:03:09 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:03:09 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:03:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:03:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:03:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:03:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:03:12 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:03:12 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:03:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:03:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:03:12 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:03:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:03:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:03:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:03:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:03:14 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:03:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 10:03:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:03:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:03:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:03:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:03:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:03:16 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:03:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43834134
Fri 17 Jan 2014 10:03:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:03:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43834134
Fri 17 Jan 2014 10:03:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:03:24 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:03:24 - job_xml_thread(): Done retrieving: data size 43834134
Fri 17 Jan 2014 10:03:24 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:03:24 - XML: Start document: iteration 15
Fri 17 Jan 2014 10:03:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:03:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:03:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:03:28 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:03:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:03:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:03:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:03:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:03:30 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:03:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:03:30 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:03:30 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:03:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:03:34 - XML: Processed 655372 elements - found 587 jobs
Fri 17 Jan 2014 10:03:34 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:03:34 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:03:34 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:03:34 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:03:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:03:37 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:03:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:03:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:03:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:03:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:03:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:03:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:03:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:03:38 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:03:38 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:03:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43850680
Fri 17 Jan 2014 10:03:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:03:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:03:38 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:03:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 10:03:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43850680
Fri 17 Jan 2014 10:03:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 10:03:39 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:03:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:03:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6343 values 100359 bits 12544 bytes 
Fri 17 Jan 2014 10:03:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:03:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:03:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:03:49 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:03:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:03:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:03:49 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:03:49 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:03:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:03:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:03:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:03:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:03:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:03:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:03:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:03:53 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:03:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:03:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:03:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:03:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:03:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:03:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:03:55 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:03:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 10:03:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:03:55 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:03:55 - job_xml_thread(): Done retrieving: data size 43860274
Fri 17 Jan 2014 10:03:55 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:03:55 - XML: Start document: iteration 16
Fri 17 Jan 2014 10:03:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43860274
Fri 17 Jan 2014 10:03:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:03:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43860274
Fri 17 Jan 2014 10:03:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:04:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:04:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:04:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:04:07 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:04:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:04:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:04:08 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:04:08 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:04:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:04:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:04:08 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:04:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:04:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:04:14 - XML: Processed 655372 elements - found 587 jobs
Fri 17 Jan 2014 10:04:14 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:04:14 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:04:14 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:04:14 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:04:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:04:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:04:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:04:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:04:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:04:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:04:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:04:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:04:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:04:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43822831
Fri 17 Jan 2014 10:04:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:04:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43822831
Fri 17 Jan 2014 10:04:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:04:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:04:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:04:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:04:29 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:04:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:04:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:04:29 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:04:29 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:04:30 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:04:30 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:04:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:04:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:04:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:04:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:04:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:04:32 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:04:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:04:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:04:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:04:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:04:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:04:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:04:34 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:04:34 - job_xml_thread(): Done retrieving: data size 43849767
Fri 17 Jan 2014 10:04:34 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:04:34 - XML: Start document: iteration 17
Fri 17 Jan 2014 10:04:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43849767
Fri 17 Jan 2014 10:04:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:04:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43849767
Fri 17 Jan 2014 10:04:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:04:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:04:39 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:04:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:04:42 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:04:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 10:04:42 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:04:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148609 bits 18576 bytes 
Fri 17 Jan 2014 10:04:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 10:04:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:04:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:04:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:04:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:04:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:04:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:04:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:04:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:04:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:04:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:04:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:04:56 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:04:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:04:57 - XML: Processed 655368 elements - found 585 jobs
Fri 17 Jan 2014 10:04:57 - job 7337065 appears to have finished
Fri 17 Jan 2014 10:04:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:04:58 - job 7347670 appears to have finished
Fri 17 Jan 2014 10:04:58 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:04:58 - job 7347726 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 10:04:58 - job 7347459 appears to have finished
Fri 17 Jan 2014 10:04:58 - job 7346509 appears to have finished
Fri 17 Jan 2014 10:04:58 - job_xml_thread(): Found 7 updated jobs.
Fri 17 Jan 2014 10:04:58 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 10:04:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:04:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:04:58 - job_xml_thread(): Done storing. succesfully stored: 7 jobs
Fri 17 Jan 2014 10:04:58 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:04:58 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:04:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:04:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:04:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:04:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:05:00 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:05:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851749
Fri 17 Jan 2014 10:05:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:05:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851749
Fri 17 Jan 2014 10:05:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:05:01 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:05:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 10:05:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:05:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:05:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:05:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:05:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:05:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:05:13 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:05:13 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:05:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:05:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:05:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:05:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:05:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:05:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:05:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:05:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:05:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:05:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:05:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:05:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:05:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:05:14 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:05:14 - job_xml_thread(): Done retrieving: data size 43783623
Fri 17 Jan 2014 10:05:14 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:05:14 - XML: Start document: iteration 18
Fri 17 Jan 2014 10:05:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43783623
Fri 17 Jan 2014 10:05:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:05:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43783623
Fri 17 Jan 2014 10:05:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:05:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:05:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:05:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:05:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:05:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:05:31 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:05:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:05:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:05:31 - XML: Processed 654620 elements - found 585 jobs
Fri 17 Jan 2014 10:05:31 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:05:31 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:05:31 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:05:31 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:05:32 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:05:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:05:32 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:05:32 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:05:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:05:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:05:35 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:05:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:05:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:05:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:05:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:05:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:05:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:05:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:05:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43304765
Fri 17 Jan 2014 10:05:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:05:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43304765
Fri 17 Jan 2014 10:05:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:05:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:05:44 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:05:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:05:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 10:05:45 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:05:45 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:05:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 10:05:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148582 bits 18572 bytes 
Fri 17 Jan 2014 10:05:47 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:05:47 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:05:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:05:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:05:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:05:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:05:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:05:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:05:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:05:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:05:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:05:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:05:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:05:52 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:05:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:05:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:05:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:05:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:05:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:05:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:05:54 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:05:54 - job_xml_thread(): Done retrieving: data size 43210918
Fri 17 Jan 2014 10:05:54 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:05:54 - XML: Start document: iteration 19
Fri 17 Jan 2014 10:05:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43210918
Fri 17 Jan 2014 10:05:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43210918
Fri 17 Jan 2014 10:05:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:05:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:06:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:06:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:06:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:06:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:06:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:06:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:06:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:06:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:06:11 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:06:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:06:11 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:06:11 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:06:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:06:11 - XML: Processed 647494 elements - found 585 jobs
Fri 17 Jan 2014 10:06:11 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:06:11 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:06:11 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:06:11 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:06:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:06:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:06:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:06:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:06:16 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:06:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 10:06:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:06:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:06:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:06:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:06:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:06:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:06:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43229605
Fri 17 Jan 2014 10:06:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:06:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43229605
Fri 17 Jan 2014 10:06:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:06:26 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:06:26 - job_xml_thread(): Done retrieving: data size 43229605
Fri 17 Jan 2014 10:06:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:06:26 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:06:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:06:26 - XML: Start document: iteration 20
Fri 17 Jan 2014 10:06:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:06:28 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:06:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:06:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:06:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:06:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:06:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:06:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:06:31 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:06:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:06:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:06:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:06:36 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:06:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:06:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:06:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:06:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:06:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:06:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:06:39 - XML: Processed 647840 elements - found 584 jobs
Fri 17 Jan 2014 10:06:39 - job 7347685 appears to have finished
Fri 17 Jan 2014 10:06:39 - job 7347728 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 10:06:39 - job 7347451 appears to have finished
Fri 17 Jan 2014 10:06:39 - job 7347455 appears to have finished
Fri 17 Jan 2014 10:06:39 - job 7347692 appears to have finished
Fri 17 Jan 2014 10:06:39 - job_xml_thread(): Found 8 updated jobs.
Fri 17 Jan 2014 10:06:39 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 10:06:39 - job_xml_thread(): Done storing. succesfully stored: 8 jobs
Fri 17 Jan 2014 10:06:39 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:06:39 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:06:41 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:06:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43607720
Fri 17 Jan 2014 10:06:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:06:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43607720
Fri 17 Jan 2014 10:06:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:06:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:06:45 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:06:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:06:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:06:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:06:46 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:06:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 10:06:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 10:06:46 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:06:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8788 values 138587 bits 17323 bytes 
Fri 17 Jan 2014 10:06:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:06:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:06:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:06:53 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:06:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:06:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:06:54 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:06:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:06:54 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:06:54 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:06:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:06:54 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:06:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:06:57 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:06:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:06:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:06:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:06:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:06:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:06:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:06:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:06:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43817880
Fri 17 Jan 2014 10:06:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:07:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43817880
Fri 17 Jan 2014 10:07:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:07:00 - job_xml_thread(): Done retrieving: data size 43817880
Fri 17 Jan 2014 10:07:00 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:07:00 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 10:07:01 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 10:07:01 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:07:01 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 10:07:01 - Housekeeping: done.
Fri 17 Jan 2014 10:07:01 - XML: Start document: iteration 0
Fri 17 Jan 2014 10:07:01 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:07:01 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 10:07:01 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 10:07:01 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:07:02 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 10:07:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:07:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Fri 17 Jan 2014 10:07:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:07:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:07:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:07:16 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:07:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:07:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:07:17 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:07:17 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:07:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:07:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:07:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:07:20 - XML: Processed 655090 elements - found 584 jobs
Fri 17 Jan 2014 10:07:21 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:07:21 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:07:21 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:07:21 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:07:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:07:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:07:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:07:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:07:23 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:07:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 10:07:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:07:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:07:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:07:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:07:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:07:24 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:07:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43846060
Fri 17 Jan 2014 10:07:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:07:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43846060
Fri 17 Jan 2014 10:07:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:07:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:07:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:07:36 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:07:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:07:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:07:36 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:07:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:07:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:07:37 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:07:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:07:37 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:07:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:07:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:07:38 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:07:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:07:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:07:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:07:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:07:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:07:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:07:39 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:07:40 - job_xml_thread(): Done retrieving: data size 43864187
Fri 17 Jan 2014 10:07:40 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:07:40 - XML: Start document: iteration 1
Fri 17 Jan 2014 10:07:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43864187
Fri 17 Jan 2014 10:07:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43864187
Fri 17 Jan 2014 10:07:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:07:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:07:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:07:46 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:07:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:07:47 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:07:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 10:07:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 10:07:47 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:07:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:07:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:07:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:07:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:07:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8683 values 136920 bits 17115 bytes 
Fri 17 Jan 2014 10:07:54 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:07:54 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:07:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:07:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:07:54 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:07:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:07:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:07:56 - XML: Processed 655366 elements - found 584 jobs
Fri 17 Jan 2014 10:07:56 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:07:56 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:07:56 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:07:56 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:08:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:08:01 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:08:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:08:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:08:02 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:08:02 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:08:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:08:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:08:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:08:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:08:02 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:08:02 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:08:02 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 10:08:02 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 10:08:02 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 10:08:03 - size of cluster 'LISA Cluster': 624 hosts 79480 metrics 973915 values 15374343 bits 1921792 bytes 
Fri 17 Jan 2014 10:08:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:08:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43820235
Fri 17 Jan 2014 10:08:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:08:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43820235
Fri 17 Jan 2014 10:08:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:08:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:08:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:08:11 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:08:11 - job_xml_thread(): Done retrieving: data size 43820235
Fri 17 Jan 2014 10:08:11 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:08:11 - XML: Start document: iteration 2
Fri 17 Jan 2014 10:08:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:08:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:08:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:08:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:08:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:08:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:08:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:08:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:08:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:08:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:08:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:08:27 - XML: Processed 655360 elements - found 581 jobs
Fri 17 Jan 2014 10:08:27 - job 7347681 appears to have finished
Fri 17 Jan 2014 10:08:27 - job 7347657 appears to have finished
Fri 17 Jan 2014 10:08:27 - job 7347730 report time 1389949532 does not match current heartbeat 1389949653 : ignoring job
Fri 17 Jan 2014 10:08:27 - job 7347731 report time 1389949532 does not match current heartbeat 1389949653 : ignoring job
Fri 17 Jan 2014 10:08:27 - job 7347447 appears to have finished
Fri 17 Jan 2014 10:08:27 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 10:08:27 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 10:08:29 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 10:08:29 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:08:29 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:08:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:08:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:08:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:08:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:08:29 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:08:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 10:08:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:08:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:08:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:08:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:08:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:08:33 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:08:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43824334
Fri 17 Jan 2014 10:08:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:08:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43824334
Fri 17 Jan 2014 10:08:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:08:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:08:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:08:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:08:44 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:08:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:08:44 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:08:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:08:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:08:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:08:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:08:45 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:08:45 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:08:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:08:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:08:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:08:47 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:08:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:08:48 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:08:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:08:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:08:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:08:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:08:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:08:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:08:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:08:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 10:08:48 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:08:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5798 values 91412 bits 11426 bytes 
Fri 17 Jan 2014 10:08:48 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:08:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 10:08:51 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:08:51 - job_xml_thread(): Done retrieving: data size 43830381
Fri 17 Jan 2014 10:08:51 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:08:51 - XML: Start document: iteration 3
Fri 17 Jan 2014 10:08:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43830381
Fri 17 Jan 2014 10:08:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:08:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43830381
Fri 17 Jan 2014 10:08:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:09:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:09:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:09:02 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:09:02 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 10:09:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:09:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:09:03 - XML: Processed 655360 elements - found 581 jobs
Fri 17 Jan 2014 10:09:03 - job 7347730 report time 1389949532 does not match current heartbeat 1389949653 : ignoring job
Fri 17 Jan 2014 10:09:04 - job 7347731 report time 1389949532 does not match current heartbeat 1389949653 : ignoring job
Fri 17 Jan 2014 10:09:04 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:09:04 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:09:04 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:09:04 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:09:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:09:09 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:09:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:09:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:09:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:09:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:09:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:09:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:09:10 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:09:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:09:13 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:09:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:09:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:09:14 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:09:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 10:09:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:09:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:09:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:09:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:09:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:09:17 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:09:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43842386
Fri 17 Jan 2014 10:09:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:09:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43842386
Fri 17 Jan 2014 10:09:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:09:19 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:09:19 - job_xml_thread(): Done retrieving: data size 43842386
Fri 17 Jan 2014 10:09:19 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:09:19 - XML: Start document: iteration 4
Fri 17 Jan 2014 10:09:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:09:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:09:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:09:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:09:33 - XML: Processed 655360 elements - found 581 jobs
Fri 17 Jan 2014 10:09:33 - job 7347730 report time 1389949532 does not match current heartbeat 1389949653 : ignoring job
Fri 17 Jan 2014 10:09:33 - job 7347731 report time 1389949532 does not match current heartbeat 1389949653 : ignoring job
Fri 17 Jan 2014 10:09:33 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:09:33 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:09:33 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:09:33 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:09:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:09:38 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:09:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:09:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:09:39 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:09:39 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:09:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:09:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:09:39 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:09:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:09:40 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:09:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:09:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:09:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:09:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:09:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:09:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:09:44 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:09:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43868854
Fri 17 Jan 2014 10:09:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:09:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43868854
Fri 17 Jan 2014 10:09:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:09:48 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:09:48 - job_xml_thread(): Done retrieving: data size 43868854
Fri 17 Jan 2014 10:09:48 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:09:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:09:48 - XML: Start document: iteration 5
Fri 17 Jan 2014 10:09:48 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:09:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:09:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 10:09:49 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:09:49 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:09:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 10:09:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8912 values 140487 bits 17560 bytes 
Fri 17 Jan 2014 10:09:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:09:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:09:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:09:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:09:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:09:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:09:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:09:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:09:59 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:09:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:09:59 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:09:59 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:09:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:10:04 - XML: Processed 655360 elements - found 581 jobs
Fri 17 Jan 2014 10:10:04 - job 7347730 report time 1389949532 does not match current heartbeat 1389949653 : ignoring job
Fri 17 Jan 2014 10:10:04 - job 7347731 report time 1389949532 does not match current heartbeat 1389949653 : ignoring job
Fri 17 Jan 2014 10:10:04 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:10:04 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:10:04 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:10:04 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:10:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:10:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:10:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:10:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:10:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:10:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:10:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:10:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:10:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:10:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43826532
Fri 17 Jan 2014 10:10:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:10:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43826532
Fri 17 Jan 2014 10:10:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:10:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:10:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:10:19 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:10:19 - job_xml_thread(): Done retrieving: data size 43826532
Fri 17 Jan 2014 10:10:19 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:10:20 - XML: Start document: iteration 6
Fri 17 Jan 2014 10:10:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:10:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:10:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:10:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:10:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:10:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:10:25 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:10:25 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:10:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:10:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:10:25 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:10:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:10:32 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:10:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:10:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:10:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:10:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:10:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:10:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:10:34 - XML: Processed 655354 elements - found 578 jobs
Fri 17 Jan 2014 10:10:34 - job 7347463 appears to have finished
Fri 17 Jan 2014 10:10:34 - job 7347445 appears to have finished
Fri 17 Jan 2014 10:10:34 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 10:10:34 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 10:10:34 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 10:10:34 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:10:34 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:10:34 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:10:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 10:10:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:10:35 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 10:10:35 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 10:10:35 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:10:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:10:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43820320
Fri 17 Jan 2014 10:10:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:10:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43820320
Fri 17 Jan 2014 10:10:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:10:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:10:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:10:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:10:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:10:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:10:48 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:10:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:10:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:10:49 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:10:49 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:10:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:10:50 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:10:50 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:10:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:10:50 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:10:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:10:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:10:50 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:10:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 10:10:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 10:10:50 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:10:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5805 values 91520 bits 11440 bytes 
Fri 17 Jan 2014 10:10:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:10:52 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:10:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:10:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:10:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:10:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:10:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:10:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:10:54 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:10:54 - job_xml_thread(): Done retrieving: data size 43857655
Fri 17 Jan 2014 10:10:54 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:10:54 - XML: Start document: iteration 7
Fri 17 Jan 2014 10:10:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43857655
Fri 17 Jan 2014 10:10:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43857655
Fri 17 Jan 2014 10:10:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:10:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:11:03 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:11:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 10:11:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:11:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:11:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:11:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:11:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:11:09 - XML: Processed 655354 elements - found 578 jobs
Fri 17 Jan 2014 10:11:09 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:11:09 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:11:09 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:11:09 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:11:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:11:13 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:11:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:11:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:11:14 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:11:14 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:11:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:11:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:11:14 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:11:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:11:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:11:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:11:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:11:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:11:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:11:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:11:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:11:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:11:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43762374
Fri 17 Jan 2014 10:11:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:11:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43762374
Fri 17 Jan 2014 10:11:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:11:25 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:11:26 - job_xml_thread(): Done retrieving: data size 43762374
Fri 17 Jan 2014 10:11:26 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:11:26 - XML: Start document: iteration 8
Fri 17 Jan 2014 10:11:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:11:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:11:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:11:31 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:11:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:11:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:11:32 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:11:32 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:11:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:11:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:11:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:11:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:11:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:11:40 - XML: Processed 654606 elements - found 578 jobs
Fri 17 Jan 2014 10:11:40 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:11:40 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:11:40 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:11:41 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:11:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:11:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:11:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:11:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:11:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:11:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:11:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:11:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:11:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:11:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43278323
Fri 17 Jan 2014 10:11:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:11:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43278323
Fri 17 Jan 2014 10:11:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:11:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:11:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:11:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:11:50 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:11:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:11:51 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:11:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 10:11:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 10:11:51 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:11:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:11:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:11:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:11:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9371 values 147819 bits 18477 bytes 
Fri 17 Jan 2014 10:11:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:11:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:11:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:11:53 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:11:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:11:53 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:11:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:11:55 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:11:56 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:11:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:11:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:11:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:11:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:11:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:11:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:11:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:11:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43207400
Fri 17 Jan 2014 10:11:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:11:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43207400
Fri 17 Jan 2014 10:11:59 - job_xml_thread(): Done retrieving: data size 43207400
Fri 17 Jan 2014 10:11:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:11:59 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:11:59 - XML: Start document: iteration 9
Fri 17 Jan 2014 10:12:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:12:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:12:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:12:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:12:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:12:14 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:12:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:12:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:12:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:12:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:12:15 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:12:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:12:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:12:16 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:12:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 10:12:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:12:17 - XML: Processed 647184 elements - found 578 jobs
Fri 17 Jan 2014 10:12:17 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:12:17 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:12:17 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:12:17 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:12:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:12:20 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:12:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:12:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:12:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:12:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:12:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:12:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:12:21 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:12:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43254381
Fri 17 Jan 2014 10:12:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:12:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43254381
Fri 17 Jan 2014 10:12:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:12:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:12:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:12:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:12:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:12:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:12:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:12:32 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:12:32 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:12:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:12:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:12:32 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:12:32 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:12:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:12:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:12:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:12:37 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:12:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:12:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:12:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:12:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:12:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:12:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:12:38 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:12:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43705050
Fri 17 Jan 2014 10:12:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:12:39 - job_xml_thread(): Done retrieving: data size 43705050
Fri 17 Jan 2014 10:12:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43705050
Fri 17 Jan 2014 10:12:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:12:39 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:12:39 - XML: Start document: iteration 10
Fri 17 Jan 2014 10:12:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:12:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:12:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:12:51 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:12:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:12:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:12:53 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:12:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 10:12:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:12:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 10:12:53 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:12:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:12:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9049 values 142740 bits 17842 bytes 
Fri 17 Jan 2014 10:12:53 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:12:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:12:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:12:54 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:12:54 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:12:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:12:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:12:54 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:12:55 - XML: Processed 653650 elements - found 627 jobs
Fri 17 Jan 2014 10:12:55 - job 7347448 appears to have finished
Fri 17 Jan 2014 10:12:55 - job 7347460 appears to have finished
Fri 17 Jan 2014 10:12:55 - job 7347449 appears to have finished
Fri 17 Jan 2014 10:12:55 - job_xml_thread(): Found 55 updated jobs.
Fri 17 Jan 2014 10:12:55 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 10:13:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:13:01 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:13:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:13:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:13:01 - job_xml_thread(): Done storing. succesfully stored: 55 jobs
Fri 17 Jan 2014 10:13:01 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:13:01 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:13:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:13:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:13:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:13:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:13:03 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:13:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43829354
Fri 17 Jan 2014 10:13:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:13:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43829354
Fri 17 Jan 2014 10:13:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:13:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:13:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:13:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:13:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:13:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:13:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:13:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:13:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:13:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:13:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:13:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:13:16 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:13:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:13:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:13:18 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:13:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 10:13:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:13:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:13:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:13:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:13:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:13:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:13:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:13:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:13:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:13:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:13:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43842594
Fri 17 Jan 2014 10:13:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:13:20 - job_xml_thread(): Done retrieving: data size 43842594
Fri 17 Jan 2014 10:13:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43842594
Fri 17 Jan 2014 10:13:21 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:13:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:13:21 - XML: Start document: iteration 11
Fri 17 Jan 2014 10:13:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:13:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:13:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:13:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:13:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:13:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:13:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:13:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:13:41 - XML: Processed 655452 elements - found 627 jobs
Fri 17 Jan 2014 10:13:41 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:13:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:13:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:13:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:13:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:13:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:13:41 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:13:41 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:13:41 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:13:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:13:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:13:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:13:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:13:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:13:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:13:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:13:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:13:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:13:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43881054
Fri 17 Jan 2014 10:13:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:13:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43881054
Fri 17 Jan 2014 10:13:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:13:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:13:53 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:13:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:13:54 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:13:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 10:13:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 10:13:54 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:13:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9102 values 143549 bits 17943 bytes 
Fri 17 Jan 2014 10:13:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:13:56 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:13:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:13:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:13:56 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:13:56 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:13:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:13:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:13:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:13:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:13:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:13:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:13:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:13:59 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:13:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:13:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:14:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:14:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:14:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:14:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:14:01 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:14:01 - job_xml_thread(): Done retrieving: data size 43865842
Fri 17 Jan 2014 10:14:01 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:14:01 - XML: Start document: iteration 12
Fri 17 Jan 2014 10:14:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43865842
Fri 17 Jan 2014 10:14:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:14:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865842
Fri 17 Jan 2014 10:14:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:14:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:14:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:14:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:14:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:14:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:14:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:14:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:14:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:14:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:14:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:14:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:14:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:14:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:14:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:14:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:14:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:14:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:14:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:14:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:14:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:14:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:14:25 - XML: Processed 655452 elements - found 627 jobs
Fri 17 Jan 2014 10:14:25 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:14:25 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:14:25 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:14:25 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:14:25 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:14:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 10:14:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:14:27 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:14:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43866456
Fri 17 Jan 2014 10:14:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:14:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43866456
Fri 17 Jan 2014 10:14:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:14:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:14:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:14:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:14:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:14:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:14:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:14:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:14:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:14:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:14:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:14:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:14:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:14:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:14:40 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:14:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:14:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:14:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:14:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:14:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:14:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:14:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:14:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:14:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:14:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43889113
Fri 17 Jan 2014 10:14:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:14:44 - job_xml_thread(): Done retrieving: data size 43889113
Fri 17 Jan 2014 10:14:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43889113
Fri 17 Jan 2014 10:14:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:14:44 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:14:44 - XML: Start document: iteration 13
Fri 17 Jan 2014 10:14:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:14:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:14:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:14:54 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:14:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:14:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:14:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:14:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 10:14:57 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:14:57 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:14:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 10:14:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8931 values 140848 bits 17606 bytes 
Fri 17 Jan 2014 10:15:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:15:01 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:15:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:15:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:15:01 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:15:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:15:01 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:15:01 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:15:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:15:02 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 10:15:02 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:15:03 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:15:03 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:15:03 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 10:15:03 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 10:15:03 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 10:15:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:15:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:15:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:15:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:15:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:15:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:15:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:15:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:15:07 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 975015 values 15386550 bits 1923318 bytes 
Fri 17 Jan 2014 10:15:09 - XML: Processed 655452 elements - found 627 jobs
Fri 17 Jan 2014 10:15:09 - job 7347751 field 'start_timestamp' changed since saved from: 1389949920 to: 1389949872
Fri 17 Jan 2014 10:15:09 - job 7347769 field 'start_timestamp' changed since saved from: 1389949911 to: 1389949872
Fri 17 Jan 2014 10:15:09 - job 7347768 field 'start_timestamp' changed since saved from: 1389949909 to: 1389949872
Fri 17 Jan 2014 10:15:09 - job 7347767 field 'start_timestamp' changed since saved from: 1389949907 to: 1389949872
Fri 17 Jan 2014 10:15:09 - job 7347787 field 'start_timestamp' changed since saved from: 1389949902 to: 1389949872
Fri 17 Jan 2014 10:15:09 - job 7347786 field 'start_timestamp' changed since saved from: 1389949900 to: 1389949872
Fri 17 Jan 2014 10:15:09 - job 7347785 field 'start_timestamp' changed since saved from: 1389949898 to: 1389949872
Fri 17 Jan 2014 10:15:09 - job 7347784 field 'start_timestamp' changed since saved from: 1389949896 to: 1389949872
Fri 17 Jan 2014 10:15:09 - job 7347773 field 'start_timestamp' changed since saved from: 1389949919 to: 1389949872
Fri 17 Jan 2014 10:15:09 - job 7347776 field 'start_timestamp' changed since saved from: 1389949925 to: 1389949872
Fri 17 Jan 2014 10:15:09 - job 7347777 field 'start_timestamp' changed since saved from: 1389949927 to: 1389949872
Fri 17 Jan 2014 10:15:09 - job 7347774 field 'start_timestamp' changed since saved from: 1389949921 to: 1389949872
Fri 17 Jan 2014 10:15:09 - job 7347775 field 'start_timestamp' changed since saved from: 1389949923 to: 1389949872
Fri 17 Jan 2014 10:15:09 - job 7347770 field 'start_timestamp' changed since saved from: 1389949913 to: 1389949872
Fri 17 Jan 2014 10:15:09 - job 7347771 field 'start_timestamp' changed since saved from: 1389949915 to: 1389949872
Fri 17 Jan 2014 10:15:09 - job 7347747 field 'start_timestamp' changed since saved from: 1389949912 to: 1389949871
Fri 17 Jan 2014 10:15:09 - job 7347746 field 'start_timestamp' changed since saved from: 1389949910 to: 1389949871
Fri 17 Jan 2014 10:15:09 - job 7344336 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 10:15:09 - job_xml_thread(): Found 18 updated jobs.
Fri 17 Jan 2014 10:15:09 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 10:15:09 - job_xml_thread(): Done storing. succesfully stored: 18 jobs
Fri 17 Jan 2014 10:15:09 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:15:09 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:15:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:15:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43848085
Fri 17 Jan 2014 10:15:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:15:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43848085
Fri 17 Jan 2014 10:15:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:15:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:15:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:15:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:15:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:15:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:15:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:15:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:15:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:15:24 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:15:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:15:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:15:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:15:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:15:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:15:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:15:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:15:29 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:15:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 10:15:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:15:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:15:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:15:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:15:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:15:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:15:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:15:31 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:15:31 - job_xml_thread(): Done retrieving: data size 43863033
Fri 17 Jan 2014 10:15:31 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:15:31 - XML: Start document: iteration 14
Fri 17 Jan 2014 10:15:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43863033
Fri 17 Jan 2014 10:15:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43863033
Fri 17 Jan 2014 10:15:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:15:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:15:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:15:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:15:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:15:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:15:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:15:48 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:15:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:15:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:15:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:15:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:15:49 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:15:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:15:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:15:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:15:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:15:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:15:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:15:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:15:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:15:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:15:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:15:54 - XML: Processed 655452 elements - found 627 jobs
Fri 17 Jan 2014 10:15:54 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:15:54 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:15:54 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:15:54 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:15:57 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:15:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43866889
Fri 17 Jan 2014 10:15:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:15:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:15:58 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:15:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43866889
Fri 17 Jan 2014 10:15:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:15:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:15:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 10:15:59 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:15:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 10:15:59 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:15:59 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6143 values 96899 bits 12112 bytes 
Fri 17 Jan 2014 10:16:03 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:16:03 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 10:16:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:16:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:16:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:16:06 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:16:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:16:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:16:08 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:16:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:16:08 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:16:08 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:16:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:16:09 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:16:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:16:13 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:16:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:16:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:16:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:16:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:16:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:16:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:16:16 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:16:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43866462
Fri 17 Jan 2014 10:16:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:16:17 - job_xml_thread(): Done retrieving: data size 43866462
Fri 17 Jan 2014 10:16:17 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:16:17 - XML: Start document: iteration 15
Fri 17 Jan 2014 10:16:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43866462
Fri 17 Jan 2014 10:16:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:16:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:16:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:16:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:16:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:16:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:16:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:16:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:16:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:16:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:16:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:16:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:16:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:16:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:16:35 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:16:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 10:16:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:16:38 - XML: Processed 655450 elements - found 627 jobs
Fri 17 Jan 2014 10:16:38 - job 7347450 appears to have finished
Fri 17 Jan 2014 10:16:38 - job 7347732 report time 1389950015 does not match current heartbeat 1389950135 : ignoring job
Fri 17 Jan 2014 10:16:38 - job 7344334 appears to have finished
Fri 17 Jan 2014 10:16:38 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 10:16:38 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 10:16:39 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 10:16:39 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:16:39 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:16:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:16:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:16:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:16:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:16:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:16:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:16:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:16:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:16:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:16:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867142
Fri 17 Jan 2014 10:16:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:16:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43867142
Fri 17 Jan 2014 10:16:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:16:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:16:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:16:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:16:53 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:16:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:16:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:16:54 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:16:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:16:54 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:16:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:16:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867142
Fri 17 Jan 2014 10:16:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:16:54 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:16:55 - job_xml_thread(): Done retrieving: data size 43867142
Fri 17 Jan 2014 10:16:55 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:16:55 - XML: Start document: iteration 16
Fri 17 Jan 2014 10:16:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:16:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:16:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:16:59 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:17:01 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:17:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 10:17:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:17:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 10:17:01 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:17:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:17:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:17:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5980 values 94503 bits 11812 bytes 
Fri 17 Jan 2014 10:17:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:17:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:17:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:17:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:17:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:17:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:17:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:17:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:17:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:17:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:17:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:17:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:17:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:17:12 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:17:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:17:12 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:17:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:17:14 - XML: Processed 655452 elements - found 627 jobs
Fri 17 Jan 2014 10:17:14 - job 7347732 report time 1389950015 does not match current heartbeat 1389950135 : ignoring job
Fri 17 Jan 2014 10:17:14 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:17:14 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:17:14 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:17:14 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:17:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:17:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43797417
Fri 17 Jan 2014 10:17:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:17:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43797417
Fri 17 Jan 2014 10:17:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:17:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:17:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:17:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:17:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:17:29 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:17:29 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:17:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:17:31 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:17:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:17:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:17:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:17:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:17:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:17:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:17:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:17:34 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:17:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:17:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:17:34 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:17:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 10:17:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:17:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:17:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:17:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:17:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:17:37 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:17:37 - job_xml_thread(): Done retrieving: data size 43332674
Fri 17 Jan 2014 10:17:37 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:17:37 - XML: Start document: iteration 17
Fri 17 Jan 2014 10:17:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43332674
Fri 17 Jan 2014 10:17:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:17:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43332674
Fri 17 Jan 2014 10:17:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:17:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:17:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:17:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:17:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:17:57 - XML: Processed 649130 elements - found 627 jobs
Fri 17 Jan 2014 10:17:57 - job 7347732 report time 1389950015 does not match current heartbeat 1389950135 : ignoring job
Fri 17 Jan 2014 10:17:57 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:17:57 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:17:57 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:17:57 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:17:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:17:58 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:17:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:17:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:17:59 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:17:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:17:59 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:17:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:17:59 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:18:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:18:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:18:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:18:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:18:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:18:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:18:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:18:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:18:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:18:01 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:18:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:18:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 10:18:02 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:18:02 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:18:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 10:18:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5867 values 92839 bits 11604 bytes 
Fri 17 Jan 2014 10:18:03 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:18:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43201602
Fri 17 Jan 2014 10:18:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:18:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43201602
Fri 17 Jan 2014 10:18:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:18:13 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:18:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:18:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:18:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:18:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:18:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:18:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:18:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:18:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:18:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:18:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:18:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:18:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:18:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:18:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:18:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:18:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:18:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:18:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:18:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:18:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:18:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:18:22 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:18:22 - job_xml_thread(): Done retrieving: data size 43241317
Fri 17 Jan 2014 10:18:22 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:18:22 - XML: Start document: iteration 18
Fri 17 Jan 2014 10:18:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43241317
Fri 17 Jan 2014 10:18:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43241317
Fri 17 Jan 2014 10:18:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:18:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:18:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:18:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:18:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:18:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:18:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:18:36 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:18:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:18:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:18:37 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:18:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:18:37 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:18:37 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:18:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:18:41 - XML: Processed 647916 elements - found 623 jobs
Fri 17 Jan 2014 10:18:41 - job 7347462 appears to have finished
Fri 17 Jan 2014 10:18:41 - job 7347464 appears to have finished
Fri 17 Jan 2014 10:18:41 - job 7347446 appears to have finished
Fri 17 Jan 2014 10:18:41 - job 7347694 appears to have finished
Fri 17 Jan 2014 10:18:41 - job 7335197 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 10:18:41 - job_xml_thread(): Found 6 updated jobs.
Fri 17 Jan 2014 10:18:41 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 10:18:43 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Fri 17 Jan 2014 10:18:43 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:18:43 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:18:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:18:46 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:18:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:18:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:18:46 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:18:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 10:18:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:18:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:18:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:18:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:18:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:18:49 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 10:18:49 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 10:18:49 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:18:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:18:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43793654
Fri 17 Jan 2014 10:18:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:18:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43793654
Fri 17 Jan 2014 10:18:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:18:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:18:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:18:58 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:18:58 - job_xml_thread(): Done retrieving: data size 43793654
Fri 17 Jan 2014 10:18:58 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:18:58 - XML: Start document: iteration 19
Fri 17 Jan 2014 10:19:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:19:01 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:19:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:19:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:19:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:19:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:19:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:19:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:19:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:19:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:19:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:19:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:19:03 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:19:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:19:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 10:19:03 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:19:03 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:19:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6083 values 96052 bits 12006 bytes 
Fri 17 Jan 2014 10:19:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 10:19:11 - XML: Processed 654798 elements - found 623 jobs
Fri 17 Jan 2014 10:19:11 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:19:11 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:19:11 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:19:11 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:19:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:19:12 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:19:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:19:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:19:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:19:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:19:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:19:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:19:15 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:19:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43836149
Fri 17 Jan 2014 10:19:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:19:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43836149
Fri 17 Jan 2014 10:19:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:19:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:19:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:19:26 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:19:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:19:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:19:27 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:19:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:19:27 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:19:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:19:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 10:19:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:19:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:19:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:19:27 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:19:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:19:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:19:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:19:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:19:30 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:19:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:19:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:19:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:19:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:19:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:19:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:19:31 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:19:31 - job_xml_thread(): Done retrieving: data size 43859896
Fri 17 Jan 2014 10:19:31 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:19:31 - XML: Start document: iteration 20
Fri 17 Jan 2014 10:19:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43859896
Fri 17 Jan 2014 10:19:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43859896
Fri 17 Jan 2014 10:19:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:19:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:19:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:19:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:19:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:19:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:19:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:19:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:19:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:19:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:19:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:19:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:19:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:19:48 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:19:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:19:50 - XML: Processed 655444 elements - found 623 jobs
Fri 17 Jan 2014 10:19:51 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:19:51 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:19:51 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:19:51 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:19:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:19:53 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:19:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:19:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:19:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:19:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:19:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:19:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:19:55 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:19:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43847245
Fri 17 Jan 2014 10:19:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:19:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43847245
Fri 17 Jan 2014 10:19:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:20:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:20:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:20:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:20:04 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:20:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:20:06 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:20:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 10:20:06 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:20:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9246 values 145887 bits 18235 bytes 
Fri 17 Jan 2014 10:20:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 10:20:06 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:20:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:20:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:20:09 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:20:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:20:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:20:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:20:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:20:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:20:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:20:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:20:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:20:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:20:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:20:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:20:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:20:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:20:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:20:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:20:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:20:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:20:13 - job_xml_thread(): Done retrieving: data size 43853122
Fri 17 Jan 2014 10:20:13 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:20:13 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 10:20:13 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 10:20:13 - Housekeeping: done.
Fri 17 Jan 2014 10:20:13 - XML: Start document: iteration 0
Fri 17 Jan 2014 10:20:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853122
Fri 17 Jan 2014 10:20:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853122
Fri 17 Jan 2014 10:20:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:20:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:20:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:20:25 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:20:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:20:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:20:25 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:20:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:20:25 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:20:25 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:20:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:20:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:20:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:20:33 - XML: Processed 655444 elements - found 623 jobs
Fri 17 Jan 2014 10:20:33 - job 7345097 appears to have finished
Fri 17 Jan 2014 10:20:33 - job 7335193 appears to have finished
Fri 17 Jan 2014 10:20:33 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 10:20:33 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 10:20:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:20:34 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:20:34 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:20:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 10:20:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:20:34 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 10:20:34 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:20:34 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:20:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:20:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:20:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:20:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:20:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:20:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:20:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:20:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43822341
Fri 17 Jan 2014 10:20:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:20:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43822341
Fri 17 Jan 2014 10:20:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:20:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:20:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:20:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:20:46 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:20:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:20:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:20:47 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:20:47 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:20:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:20:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:20:47 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:20:49 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:20:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:20:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:20:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:20:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:20:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:20:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:20:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:20:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:20:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:20:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855299
Fri 17 Jan 2014 10:20:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:20:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855299
Fri 17 Jan 2014 10:20:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:20:53 - job_xml_thread(): Done retrieving: data size 43855299
Fri 17 Jan 2014 10:20:53 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:20:53 - XML: Start document: iteration 1
Fri 17 Jan 2014 10:21:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:21:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:21:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:21:06 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:21:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:21:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:21:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:21:07 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:21:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 10:21:07 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:21:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 10:21:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9051 values 142749 bits 17843 bytes 
Fri 17 Jan 2014 10:21:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:21:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:21:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:21:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:21:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:21:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:21:09 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:21:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:21:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:21:15 - XML: Processed 655444 elements - found 623 jobs
Fri 17 Jan 2014 10:21:15 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:21:15 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:21:15 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:21:15 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:21:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:21:15 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:21:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:21:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:21:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:21:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:21:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:21:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:21:17 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:21:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43854253
Fri 17 Jan 2014 10:21:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:21:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43854253
Fri 17 Jan 2014 10:21:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:21:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:21:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:21:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:21:28 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:21:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:21:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:21:29 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:21:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:21:29 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:21:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:21:29 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:21:30 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:21:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:21:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:21:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:21:32 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:21:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:21:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:21:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:21:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:21:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:21:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:21:32 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:21:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 10:21:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:21:33 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:21:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855081
Fri 17 Jan 2014 10:21:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:21:34 - job_xml_thread(): Done retrieving: data size 43855081
Fri 17 Jan 2014 10:21:34 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:21:34 - XML: Start document: iteration 2
Fri 17 Jan 2014 10:21:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855081
Fri 17 Jan 2014 10:21:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:21:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:21:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:21:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:21:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:21:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:21:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:21:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:21:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:21:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:21:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:21:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:21:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:21:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:21:50 - XML: Processed 655439 elements - found 623 jobs
Fri 17 Jan 2014 10:21:50 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:21:50 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:21:50 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:21:50 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:21:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:21:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:21:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:21:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:21:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:21:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:21:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:21:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:21:56 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:21:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43850629
Fri 17 Jan 2014 10:21:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:21:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43850629
Fri 17 Jan 2014 10:21:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:22:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:22:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:22:03 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 10:22:03 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:22:05 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:22:05 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 10:22:05 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:22:05 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 10:22:05 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 10:22:05 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:22:06 - job_xml_thread(): Done retrieving: data size 43850629
Fri 17 Jan 2014 10:22:06 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:22:06 - XML: Start document: iteration 3
Fri 17 Jan 2014 10:22:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:22:08 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:22:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:22:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 10:22:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:22:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:22:10 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:22:10 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:22:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 10:22:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8769 values 138248 bits 17281 bytes 
Fri 17 Jan 2014 10:22:15 - size of cluster 'LISA Cluster': 624 hosts 79479 metrics 869712 values 13735516 bits 1716939 bytes 
Fri 17 Jan 2014 10:22:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:22:16 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:22:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:22:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:22:16 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:22:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:22:16 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:22:16 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:22:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:22:18 - XML: Processed 655444 elements - found 623 jobs
Fri 17 Jan 2014 10:22:18 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:22:18 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:22:18 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:22:18 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:22:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:22:20 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:22:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:22:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:22:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:22:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:22:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:22:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:22:24 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:22:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856615
Fri 17 Jan 2014 10:22:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:22:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43856615
Fri 17 Jan 2014 10:22:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:22:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:22:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:22:33 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:22:33 - job_xml_thread(): Done retrieving: data size 43856615
Fri 17 Jan 2014 10:22:33 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:22:33 - XML: Start document: iteration 4
Fri 17 Jan 2014 10:22:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:22:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:22:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:22:45 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:22:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:22:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:22:45 - XML: Processed 655446 elements - found 624 jobs
Fri 17 Jan 2014 10:22:45 - job 7347687 appears to have finished
Fri 17 Jan 2014 10:22:45 - job 7347792 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 10:22:45 - job 7344337 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 10:22:45 - job 7344333 appears to have finished
Fri 17 Jan 2014 10:22:45 - job_xml_thread(): Found 7 updated jobs.
Fri 17 Jan 2014 10:22:45 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 10:22:45 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:22:45 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:22:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:22:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:22:45 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:22:46 - job_xml_thread(): Done storing. succesfully stored: 7 jobs
Fri 17 Jan 2014 10:22:46 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:22:46 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:22:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:22:48 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:22:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:22:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:22:49 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:22:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 10:22:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:22:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:22:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:22:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:22:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:22:51 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:22:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858748
Fri 17 Jan 2014 10:22:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:22:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43858748
Fri 17 Jan 2014 10:22:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:23:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:23:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:23:01 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:23:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:23:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:23:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:23:01 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:23:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:23:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:23:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:23:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:23:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:23:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:23:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:23:05 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:23:05 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 10:23:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:23:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:23:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:23:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:23:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:23:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:23:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:23:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:23:10 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:23:10 - job_xml_thread(): Done retrieving: data size 43857473
Fri 17 Jan 2014 10:23:10 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:23:10 - XML: Start document: iteration 5
Fri 17 Jan 2014 10:23:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:23:11 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:23:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43857473
Fri 17 Jan 2014 10:23:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:23:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43857473
Fri 17 Jan 2014 10:23:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:23:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:23:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 10:23:12 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:23:12 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:23:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 10:23:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8967 values 141392 bits 17674 bytes 
Fri 17 Jan 2014 10:23:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:23:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:23:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:23:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:23:29 - XML: Processed 655446 elements - found 624 jobs
Fri 17 Jan 2014 10:23:29 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:23:29 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:23:29 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:23:29 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:23:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:23:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:23:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:23:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:23:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:23:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:23:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:23:31 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:23:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:23:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:23:33 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:23:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:23:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:23:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:23:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:23:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:23:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:23:37 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:23:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43292020
Fri 17 Jan 2014 10:23:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:23:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43292020
Fri 17 Jan 2014 10:23:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:23:44 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:23:44 - job_xml_thread(): Done retrieving: data size 43292020
Fri 17 Jan 2014 10:23:44 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:23:44 - XML: Start document: iteration 6
Fri 17 Jan 2014 10:23:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:23:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:23:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:23:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:23:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:23:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:23:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:23:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:23:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:23:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:23:48 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:23:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:23:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:23:52 - XML: Processed 648508 elements - found 624 jobs
Fri 17 Jan 2014 10:23:52 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:23:52 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:23:52 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:23:52 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:23:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:23:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:23:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:23:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:23:56 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:23:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 10:23:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:23:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:23:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:23:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:23:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:23:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:23:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43201419
Fri 17 Jan 2014 10:23:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:23:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43201419
Fri 17 Jan 2014 10:23:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:24:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:24:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:24:07 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:24:07 - job_xml_thread(): Done retrieving: data size 43201419
Fri 17 Jan 2014 10:24:07 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:24:07 - XML: Start document: iteration 7
Fri 17 Jan 2014 10:24:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:24:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:24:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:24:13 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:24:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:24:13 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:24:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 10:24:13 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:24:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 10:24:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5635 values 88777 bits 11097 bytes 
Fri 17 Jan 2014 10:24:19 - XML: Processed 647366 elements - found 624 jobs
Fri 17 Jan 2014 10:24:20 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:24:20 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:24:20 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:24:20 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:24:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:24:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:24:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:24:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:24:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:24:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:24:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:24:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:24:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:24:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:24:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:24:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:24:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:24:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:24:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:24:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:24:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:24:26 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:24:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43274066
Fri 17 Jan 2014 10:24:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:24:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43274066
Fri 17 Jan 2014 10:24:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:24:32 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:24:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 10:24:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:24:35 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:24:35 - job_xml_thread(): Done retrieving: data size 43274066
Fri 17 Jan 2014 10:24:35 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:24:35 - XML: Start document: iteration 8
Fri 17 Jan 2014 10:24:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:24:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:24:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:24:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:24:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:24:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:24:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:24:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:24:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:24:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:24:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:24:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:24:40 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:24:47 - XML: Processed 648008 elements - found 631 jobs
Fri 17 Jan 2014 10:24:47 - job 7347795 report time 1389950497 does not match current heartbeat 1389950618 : ignoring job
Fri 17 Jan 2014 10:24:47 - job 7347796 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 10:24:47 - job 7347797 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 10:24:47 - job_xml_thread(): Found 9 updated jobs.
Fri 17 Jan 2014 10:24:47 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 10:24:48 - job_xml_thread(): Done storing. succesfully stored: 9 jobs
Fri 17 Jan 2014 10:24:48 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:24:48 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:24:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:24:49 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:24:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:24:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:24:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:24:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:24:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:24:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:24:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:24:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43791512
Fri 17 Jan 2014 10:24:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:24:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43791512
Fri 17 Jan 2014 10:24:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:24:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:24:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:25:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:25:01 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:25:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:25:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:25:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:25:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:25:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43791512
Fri 17 Jan 2014 10:25:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:25:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:25:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:25:03 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:25:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:25:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:25:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:25:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:25:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:25:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:25:13 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:25:14 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:25:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 10:25:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:25:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 10:25:15 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:25:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6148 values 96960 bits 12120 bytes 
Fri 17 Jan 2014 10:25:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:25:15 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:25:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:25:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:25:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:25:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:25:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:25:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:25:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:25:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:25:17 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:25:17 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:25:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:25:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:25:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:25:18 - job_xml_thread(): Done retrieving: data size 43820472
Fri 17 Jan 2014 10:25:18 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:25:18 - XML: Start document: iteration 9
Fri 17 Jan 2014 10:25:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43820472
Fri 17 Jan 2014 10:25:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:25:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43820472
Fri 17 Jan 2014 10:25:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:25:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:25:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:25:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:25:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:25:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:25:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:25:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:25:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:25:36 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:25:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 10:25:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:25:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:25:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:25:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:25:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:25:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:25:37 - XML: Processed 655460 elements - found 631 jobs
Fri 17 Jan 2014 10:25:37 - job 7347795 report time 1389950497 does not match current heartbeat 1389950618 : ignoring job
Fri 17 Jan 2014 10:25:37 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:25:37 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:25:37 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:25:37 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:25:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:25:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:25:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:25:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:25:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:25:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:25:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:25:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:25:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:25:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853502
Fri 17 Jan 2014 10:25:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:25:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853502
Fri 17 Jan 2014 10:25:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:25:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:25:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:25:52 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:25:52 - job_xml_thread(): Done retrieving: data size 43853502
Fri 17 Jan 2014 10:25:52 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:25:52 - XML: Start document: iteration 10
Fri 17 Jan 2014 10:25:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:25:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:25:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:25:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:25:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:25:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:25:59 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:25:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:25:59 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:25:59 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:25:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:26:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:26:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:26:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:26:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:26:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:26:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:26:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:26:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:26:08 - XML: Processed 655460 elements - found 631 jobs
Fri 17 Jan 2014 10:26:08 - job 7347795 report time 1389950497 does not match current heartbeat 1389950618 : ignoring job
Fri 17 Jan 2014 10:26:08 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:26:08 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:26:08 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:26:08 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:26:10 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 10:26:10 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 10:26:10 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:26:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:26:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43848166
Fri 17 Jan 2014 10:26:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:26:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43848166
Fri 17 Jan 2014 10:26:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:26:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:26:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:26:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:26:15 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:26:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:26:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 10:26:17 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:26:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 10:26:17 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:26:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8916 values 140562 bits 17570 bytes 
Fri 17 Jan 2014 10:26:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:26:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:26:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:26:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:26:23 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:26:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:26:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:26:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:26:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:26:23 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:26:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:26:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:26:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:26:26 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:26:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:26:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:26:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:26:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:26:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:26:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:26:28 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:26:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43874956
Fri 17 Jan 2014 10:26:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:26:29 - job_xml_thread(): Done retrieving: data size 43874956
Fri 17 Jan 2014 10:26:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43874956
Fri 17 Jan 2014 10:26:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:26:29 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:26:29 - XML: Start document: iteration 11
Fri 17 Jan 2014 10:26:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:26:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:26:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:26:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:26:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:26:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:26:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:26:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:26:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:26:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:26:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:26:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:26:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:26:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:26:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:26:52 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:26:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:26:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:26:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:26:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:26:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:26:52 - XML: Processed 655472 elements - found 637 jobs
Fri 17 Jan 2014 10:26:52 - job 7347785 appears to have finished
Fri 17 Jan 2014 10:26:52 - job 7347671 appears to have finished
Fri 17 Jan 2014 10:26:52 - job 7347779 appears to have finished
Fri 17 Jan 2014 10:26:52 - job 7347773 appears to have finished
Fri 17 Jan 2014 10:26:52 - job 7347661 appears to have finished
Fri 17 Jan 2014 10:26:52 - job 7347804 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 10:26:52 - job_xml_thread(): Found 18 updated jobs.
Fri 17 Jan 2014 10:26:52 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 10:26:53 - job_xml_thread(): Done storing. succesfully stored: 18 jobs
Fri 17 Jan 2014 10:26:53 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:26:53 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:26:53 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:26:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 10:26:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:26:55 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:26:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43892454
Fri 17 Jan 2014 10:26:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:26:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43892454
Fri 17 Jan 2014 10:26:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:27:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:27:06 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:27:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:27:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:27:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:27:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:27:08 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:27:08 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:27:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:27:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:27:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:27:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:27:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:27:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:27:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:27:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:27:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:27:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:27:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:27:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:27:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:27:11 - job_xml_thread(): Done retrieving: data size 43888033
Fri 17 Jan 2014 10:27:11 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:27:11 - XML: Start document: iteration 12
Fri 17 Jan 2014 10:27:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43888033
Fri 17 Jan 2014 10:27:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43888033
Fri 17 Jan 2014 10:27:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:27:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:27:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:27:17 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:27:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:27:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 10:27:17 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:27:17 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:27:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 10:27:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8661 values 136558 bits 17069 bytes 
Fri 17 Jan 2014 10:27:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:27:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:27:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:27:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:27:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:27:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:27:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:27:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:27:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:27:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:27:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:27:29 - XML: Processed 655472 elements - found 637 jobs
Fri 17 Jan 2014 10:27:29 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:27:29 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:27:29 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:27:29 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:27:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:27:33 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:27:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:27:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:27:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:27:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:27:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:27:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:27:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:27:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43841201
Fri 17 Jan 2014 10:27:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:27:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43841201
Fri 17 Jan 2014 10:27:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:27:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:27:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:27:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:27:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:27:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:27:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:27:44 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:27:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:27:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:27:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:27:44 - job_xml_thread(): Done retrieving: data size 43841201
Fri 17 Jan 2014 10:27:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43841201
Fri 17 Jan 2014 10:27:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:27:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:27:44 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:27:44 - XML: Start document: iteration 13
Fri 17 Jan 2014 10:27:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:27:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:27:55 - XML: Processed 655472 elements - found 637 jobs
Fri 17 Jan 2014 10:27:55 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:27:55 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:27:55 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:27:55 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:27:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:28:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:28:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:28:01 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:28:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:28:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:28:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:28:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:28:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:28:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:28:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:28:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:28:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:28:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:28:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:28:04 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:28:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 10:28:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:28:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:28:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:28:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:28:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:28:06 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:28:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43871630
Fri 17 Jan 2014 10:28:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:28:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43871630
Fri 17 Jan 2014 10:28:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:28:10 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:28:10 - job_xml_thread(): Done retrieving: data size 43871630
Fri 17 Jan 2014 10:28:10 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:28:10 - XML: Start document: iteration 14
Fri 17 Jan 2014 10:28:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:28:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:28:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:28:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:28:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:28:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:28:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:28:17 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:28:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:28:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:28:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:28:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:28:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:28:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:28:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 10:28:18 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:28:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 10:28:18 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:28:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5872 values 92611 bits 11576 bytes 
Fri 17 Jan 2014 10:28:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:28:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:28:27 - XML: Processed 655452 elements - found 627 jobs
Fri 17 Jan 2014 10:28:27 - job 7347755 appears to have finished
Fri 17 Jan 2014 10:28:27 - job 7347767 appears to have finished
Fri 17 Jan 2014 10:28:27 - job 7347761 appears to have finished
Fri 17 Jan 2014 10:28:27 - job 7347675 appears to have finished
Fri 17 Jan 2014 10:28:27 - job 7347678 appears to have finished
Fri 17 Jan 2014 10:28:27 - job 7347710 appears to have finished
Fri 17 Jan 2014 10:28:27 - job 7347737 appears to have finished
Fri 17 Jan 2014 10:28:27 - job 7347738 appears to have finished
Fri 17 Jan 2014 10:28:27 - job 7347749 appears to have finished
Fri 17 Jan 2014 10:28:27 - job 7344332 appears to have finished
Fri 17 Jan 2014 10:28:28 - job_xml_thread(): Found 10 updated jobs.
Fri 17 Jan 2014 10:28:28 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 10:28:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:28:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:28:29 - job_xml_thread(): Done storing. succesfully stored: 10 jobs
Fri 17 Jan 2014 10:28:29 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:28:29 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:28:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:28:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:28:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:28:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:28:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:28:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:28:30 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:28:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43836723
Fri 17 Jan 2014 10:28:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:28:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43836723
Fri 17 Jan 2014 10:28:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:28:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:28:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:28:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:28:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:28:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:28:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:28:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:28:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:28:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:28:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:28:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:28:44 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:28:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:28:44 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:28:44 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:28:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 10:28:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:28:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:28:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:28:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:28:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:28:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:28:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:28:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:28:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43850433
Fri 17 Jan 2014 10:28:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:28:46 - job_xml_thread(): Done retrieving: data size 43850433
Fri 17 Jan 2014 10:28:46 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:28:46 - XML: Start document: iteration 15
Fri 17 Jan 2014 10:28:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43850433
Fri 17 Jan 2014 10:28:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:28:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:28:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:28:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:28:58 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:28:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:28:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:28:59 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:28:59 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:28:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:28:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:28:59 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:28:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:28:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:29:05 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 10:29:05 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:29:06 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:29:06 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 10:29:06 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 10:29:06 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:29:06 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 10:29:10 - XML: Processed 655452 elements - found 627 jobs
Fri 17 Jan 2014 10:29:10 - job 7347817 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 10:29:10 - job 7347816 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 10:29:10 - job 7344338 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 10:29:10 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 10:29:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:29:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:29:10 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 10:29:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:29:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:29:11 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 843078 values 13300798 bits 1662599 bytes 
Fri 17 Jan 2014 10:29:11 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 10:29:11 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:29:11 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:29:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:29:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:29:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:29:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:29:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:29:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:29:14 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:29:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43830275
Fri 17 Jan 2014 10:29:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:29:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43830275
Fri 17 Jan 2014 10:29:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:29:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:29:18 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:29:20 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:29:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:29:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 10:29:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 10:29:20 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:29:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9238 values 145658 bits 18207 bytes 
Fri 17 Jan 2014 10:29:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:29:25 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:29:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:29:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:29:26 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:29:26 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:29:26 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:29:26 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:29:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:29:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:29:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:29:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:29:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:29:30 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:29:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:29:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:29:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:29:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:29:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:29:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:29:34 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:29:34 - job_xml_thread(): Done retrieving: data size 43406749
Fri 17 Jan 2014 10:29:34 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:29:34 - XML: Start document: iteration 16
Fri 17 Jan 2014 10:29:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43406749
Fri 17 Jan 2014 10:29:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:29:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43406749
Fri 17 Jan 2014 10:29:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:29:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:29:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:29:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:29:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:29:49 - XML: Processed 650036 elements - found 627 jobs
Fri 17 Jan 2014 10:29:49 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:29:49 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:29:49 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:29:49 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:29:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:29:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:29:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:29:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:29:53 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:29:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:29:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:29:53 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:29:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:29:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:29:57 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:29:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:29:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:29:57 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:29:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 10:29:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:29:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:29:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:29:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:29:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:30:00 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:30:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43187325
Fri 17 Jan 2014 10:30:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:30:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43187325
Fri 17 Jan 2014 10:30:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:30:04 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:30:05 - job_xml_thread(): Done retrieving: data size 43187325
Fri 17 Jan 2014 10:30:05 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:30:05 - XML: Start document: iteration 17
Fri 17 Jan 2014 10:30:06 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:30:06 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 10:30:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:30:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:30:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:30:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:30:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:30:16 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:30:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:30:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:30:17 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:30:17 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:30:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:30:17 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:30:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:30:18 - XML: Processed 647288 elements - found 627 jobs
Fri 17 Jan 2014 10:30:18 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:30:18 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:30:18 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:30:18 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:30:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:30:20 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:30:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:30:21 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:30:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 10:30:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 10:30:21 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:30:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5679 values 89489 bits 11186 bytes 
Fri 17 Jan 2014 10:30:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:30:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:30:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:30:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:30:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:30:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:30:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:30:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:30:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:30:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43267112
Fri 17 Jan 2014 10:30:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:30:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43267112
Fri 17 Jan 2014 10:30:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:30:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:30:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:30:33 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:30:33 - job_xml_thread(): Done retrieving: data size 43267112
Fri 17 Jan 2014 10:30:33 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:30:33 - XML: Start document: iteration 18
Fri 17 Jan 2014 10:30:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:30:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:30:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:30:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:30:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:30:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:30:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:30:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:30:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:30:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:30:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:30:42 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:30:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 10:30:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:30:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:30:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:30:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:30:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:30:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:30:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:30:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:30:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:30:48 - XML: Processed 648000 elements - found 627 jobs
Fri 17 Jan 2014 10:30:48 - job 7347674 appears to have finished
Fri 17 Jan 2014 10:30:48 - job 7344969 appears to have finished
Fri 17 Jan 2014 10:30:48 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 10:30:48 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 10:30:48 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 10:30:48 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:30:48 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:30:50 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:30:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43779255
Fri 17 Jan 2014 10:30:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:30:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43779255
Fri 17 Jan 2014 10:30:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:30:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:30:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:30:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:30:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:30:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:30:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:31:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:31:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:31:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43779255
Fri 17 Jan 2014 10:31:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:31:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:31:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:31:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:31:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:31:04 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:31:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:31:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:31:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:31:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:31:13 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:31:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:31:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:31:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:31:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:31:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:31:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:31:15 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:31:15 - job_xml_thread(): Done retrieving: data size 43829707
Fri 17 Jan 2014 10:31:15 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:31:15 - XML: Start document: iteration 19
Fri 17 Jan 2014 10:31:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:31:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:31:16 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:31:16 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:31:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43829707
Fri 17 Jan 2014 10:31:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:31:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43829707
Fri 17 Jan 2014 10:31:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:31:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:31:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:31:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:31:21 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:31:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:31:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 10:31:22 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:31:22 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:31:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 10:31:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8795 values 138689 bits 17336 bytes 
Fri 17 Jan 2014 10:31:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:31:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:31:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:31:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:31:32 - XML: Processed 655452 elements - found 627 jobs
Fri 17 Jan 2014 10:31:32 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:31:32 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:31:32 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:31:32 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:31:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:31:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:31:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:31:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:31:37 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:31:37 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:31:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:31:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:31:37 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:31:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:31:37 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:31:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:31:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:31:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:31:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:31:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:31:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:31:41 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:31:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43881482
Fri 17 Jan 2014 10:31:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:31:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43881482
Fri 17 Jan 2014 10:31:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:31:47 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:31:47 - job_xml_thread(): Done retrieving: data size 43881482
Fri 17 Jan 2014 10:31:47 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:31:47 - XML: Start document: iteration 20
Fri 17 Jan 2014 10:31:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:31:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:31:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:31:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:31:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:31:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:31:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:31:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:31:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:31:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:31:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:31:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:31:59 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:32:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:32:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:32:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:32:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:32:06 - XML: Processed 655452 elements - found 627 jobs
Fri 17 Jan 2014 10:32:06 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:32:06 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:32:06 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:32:06 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:32:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:32:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:32:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:32:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:32:06 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:32:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 10:32:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:32:09 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:32:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43861793
Fri 17 Jan 2014 10:32:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:32:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43861793
Fri 17 Jan 2014 10:32:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:32:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:32:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:32:21 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:32:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:32:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:32:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:32:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:32:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:32:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:32:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:32:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:32:23 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:32:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:32:23 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:32:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:32:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:32:23 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:32:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 10:32:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:32:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 10:32:23 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:32:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5683 values 89932 bits 11241 bytes 
Fri 17 Jan 2014 10:32:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:32:25 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:32:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:32:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:32:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:32:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:32:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:32:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:32:29 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:32:29 - job_xml_thread(): Done retrieving: data size 43866343
Fri 17 Jan 2014 10:32:29 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:32:29 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 10:32:29 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 10:32:29 - Housekeeping: done.
Fri 17 Jan 2014 10:32:29 - XML: Start document: iteration 0
Fri 17 Jan 2014 10:32:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43866343
Fri 17 Jan 2014 10:32:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:32:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43866343
Fri 17 Jan 2014 10:32:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:32:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:32:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:32:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:32:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:32:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:32:42 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:32:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:32:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:32:42 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:32:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 10:32:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:32:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:32:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:32:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:32:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:32:43 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:32:50 - XML: Processed 655466 elements - found 634 jobs
Fri 17 Jan 2014 10:32:50 - job 7347719 appears to have finished
Fri 17 Jan 2014 10:32:50 - job 7347822 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 10:32:50 - job 7347821 field 'start_timestamp' changed since saved from: 1389951005 to: 1389950926
Fri 17 Jan 2014 10:32:50 - job 7344331 appears to have finished
Fri 17 Jan 2014 10:32:50 - job 7344339 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 10:32:50 - job_xml_thread(): Found 14 updated jobs.
Fri 17 Jan 2014 10:32:50 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 10:32:52 - job_xml_thread(): Done storing. succesfully stored: 14 jobs
Fri 17 Jan 2014 10:32:52 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:32:52 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:32:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:32:53 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:32:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:32:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:32:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:32:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:32:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:32:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:32:55 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:32:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43852823
Fri 17 Jan 2014 10:32:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:32:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43852823
Fri 17 Jan 2014 10:32:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:32:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:32:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:33:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:33:06 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:33:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:33:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:33:07 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:33:07 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:33:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:33:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:33:07 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:33:07 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:33:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:33:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:33:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:33:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:33:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:33:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:33:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:33:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:33:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:33:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:33:14 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:33:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43847804
Fri 17 Jan 2014 10:33:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:33:15 - job_xml_thread(): Done retrieving: data size 43847804
Fri 17 Jan 2014 10:33:15 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:33:15 - XML: Start document: iteration 1
Fri 17 Jan 2014 10:33:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43847804
Fri 17 Jan 2014 10:33:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:33:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:33:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:33:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:33:23 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:33:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:33:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 10:33:24 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:33:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9220 values 145808 bits 18226 bytes 
Fri 17 Jan 2014 10:33:24 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:33:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 10:33:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:33:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:33:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:33:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:33:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:33:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:33:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:33:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:33:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:33:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:33:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:33:34 - XML: Processed 655466 elements - found 634 jobs
Fri 17 Jan 2014 10:33:35 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:33:35 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:33:35 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:33:35 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:33:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:33:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:33:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:33:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:33:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:33:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:33:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:33:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:33:39 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 10:33:39 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 10:33:39 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:33:41 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:33:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 10:33:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:33:41 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:33:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856334
Fri 17 Jan 2014 10:33:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:33:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43856334
Fri 17 Jan 2014 10:33:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:33:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:33:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:33:50 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:33:50 - job_xml_thread(): Done retrieving: data size 43856334
Fri 17 Jan 2014 10:33:50 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:33:50 - XML: Start document: iteration 2
Fri 17 Jan 2014 10:33:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:33:50 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:33:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:33:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:33:51 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:33:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:33:51 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:33:51 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:33:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:33:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:33:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:34:02 - XML: Processed 655466 elements - found 634 jobs
Fri 17 Jan 2014 10:34:02 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:34:02 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:34:02 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:34:02 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:34:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:34:03 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:34:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:34:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:34:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:34:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:34:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:34:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:34:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:34:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43842809
Fri 17 Jan 2014 10:34:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:34:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43842809
Fri 17 Jan 2014 10:34:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:34:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:34:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:34:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:34:14 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:34:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:34:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:34:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:34:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:34:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:34:15 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:34:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:34:17 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:34:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:34:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:34:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:34:19 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:34:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:34:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:34:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:34:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:34:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:34:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:34:21 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:34:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43864710
Fri 17 Jan 2014 10:34:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:34:21 - job_xml_thread(): Done retrieving: data size 43864710
Fri 17 Jan 2014 10:34:21 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:34:21 - XML: Start document: iteration 3
Fri 17 Jan 2014 10:34:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43864710
Fri 17 Jan 2014 10:34:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:34:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:34:24 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:34:27 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:34:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:34:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 10:34:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 10:34:27 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:34:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148668 bits 18583 bytes 
Fri 17 Jan 2014 10:34:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:34:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:34:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:34:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:34:41 - XML: Processed 655460 elements - found 631 jobs
Fri 17 Jan 2014 10:34:41 - job 7347679 appears to have finished
Fri 17 Jan 2014 10:34:41 - job 7347712 appears to have finished
Fri 17 Jan 2014 10:34:41 - job 7347720 appears to have finished
Fri 17 Jan 2014 10:34:41 - job 7347727 appears to have finished
Fri 17 Jan 2014 10:34:41 - job 7347831 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 10:34:41 - job 7347830 report time 1389951100 does not match current heartbeat 1389951221 : ignoring job
Fri 17 Jan 2014 10:34:41 - job 7347826 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 10:34:41 - job 7347827 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 10:34:41 - job 7347828 report time 1389951100 does not match current heartbeat 1389951221 : ignoring job
Fri 17 Jan 2014 10:34:41 - job 7347829 report time 1389951100 does not match current heartbeat 1389951221 : ignoring job
Fri 17 Jan 2014 10:34:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:34:41 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:34:41 - job_xml_thread(): Found 8 updated jobs.
Fri 17 Jan 2014 10:34:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:34:41 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 10:34:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:34:42 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:34:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:34:42 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:34:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:34:42 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:34:43 - job_xml_thread(): Done storing. succesfully stored: 8 jobs
Fri 17 Jan 2014 10:34:43 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:34:43 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:34:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:34:44 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:34:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:34:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:34:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:34:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:34:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:34:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:34:46 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:34:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43864372
Fri 17 Jan 2014 10:34:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:34:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43864372
Fri 17 Jan 2014 10:34:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:34:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:34:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:34:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:34:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:34:58 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:34:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:34:59 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:34:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:34:59 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:34:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:34:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:34:59 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:35:00 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:35:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 10:35:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:35:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:35:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:35:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:35:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:35:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:35:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:35:01 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:35:01 - job_xml_thread(): Done retrieving: data size 43867820
Fri 17 Jan 2014 10:35:01 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:35:01 - XML: Start document: iteration 4
Fri 17 Jan 2014 10:35:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867820
Fri 17 Jan 2014 10:35:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:35:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43867820
Fri 17 Jan 2014 10:35:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:35:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:35:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:35:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:35:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:35:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:35:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:35:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:35:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:35:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:35:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:35:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:35:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:35:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:35:19 - XML: Processed 655460 elements - found 631 jobs
Fri 17 Jan 2014 10:35:19 - job 7347830 report time 1389951100 does not match current heartbeat 1389951221 : ignoring job
Fri 17 Jan 2014 10:35:19 - job 7347828 report time 1389951100 does not match current heartbeat 1389951221 : ignoring job
Fri 17 Jan 2014 10:35:19 - job 7347829 report time 1389951100 does not match current heartbeat 1389951221 : ignoring job
Fri 17 Jan 2014 10:35:19 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:35:19 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:35:19 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:35:19 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:35:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:35:23 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:35:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:35:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:35:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:35:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:35:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:35:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:35:24 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:35:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43800724
Fri 17 Jan 2014 10:35:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:35:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43800724
Fri 17 Jan 2014 10:35:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:35:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:35:27 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:35:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:35:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 10:35:30 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:35:30 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:35:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 10:35:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8933 values 140906 bits 17613 bytes 
Fri 17 Jan 2014 10:35:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:35:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:35:34 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:35:34 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:35:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:35:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:35:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:35:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:35:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:35:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:35:39 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:35:39 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:35:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:35:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:35:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:35:40 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:35:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:35:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:35:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:35:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:35:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:35:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:35:42 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:35:42 - job_xml_thread(): Done retrieving: data size 43269399
Fri 17 Jan 2014 10:35:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43269399
Fri 17 Jan 2014 10:35:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:35:42 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:35:42 - XML: Start document: iteration 5
Fri 17 Jan 2014 10:35:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43269399
Fri 17 Jan 2014 10:35:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:35:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:35:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:35:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:35:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:35:56 - XML: Processed 648234 elements - found 631 jobs
Fri 17 Jan 2014 10:35:57 - job 7347830 report time 1389951100 does not match current heartbeat 1389951221 : ignoring job
Fri 17 Jan 2014 10:35:57 - job 7347828 report time 1389951100 does not match current heartbeat 1389951221 : ignoring job
Fri 17 Jan 2014 10:35:57 - job 7347829 report time 1389951100 does not match current heartbeat 1389951221 : ignoring job
Fri 17 Jan 2014 10:35:57 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:35:57 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:35:57 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:35:57 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:36:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:36:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:36:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:36:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:36:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:36:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:36:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:36:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:36:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:36:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:36:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:36:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:36:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:36:05 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:36:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 10:36:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:36:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:36:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:36:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:36:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:36:06 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 10:36:06 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:36:07 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:36:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43215892
Fri 17 Jan 2014 10:36:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:36:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43215892
Fri 17 Jan 2014 10:36:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:36:07 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:36:07 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:36:08 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 10:36:08 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 10:36:08 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 10:36:12 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:36:12 - job_xml_thread(): Done retrieving: data size 43215892
Fri 17 Jan 2014 10:36:14 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:36:14 - XML: Start document: iteration 6
Fri 17 Jan 2014 10:36:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:36:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:36:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:36:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:36:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:36:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:36:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:36:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:36:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:36:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:36:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:36:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:36:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:36:25 - size of cluster 'LISA Cluster': 624 hosts 79462 metrics 760062 values 12005134 bits 1500641 bytes 
Fri 17 Jan 2014 10:36:26 - XML: Processed 647260 elements - found 631 jobs
Fri 17 Jan 2014 10:36:26 - job 7347830 report time 1389951100 does not match current heartbeat 1389951221 : ignoring job
Fri 17 Jan 2014 10:36:26 - job 7347828 report time 1389951100 does not match current heartbeat 1389951221 : ignoring job
Fri 17 Jan 2014 10:36:26 - job 7347829 report time 1389951100 does not match current heartbeat 1389951221 : ignoring job
Fri 17 Jan 2014 10:36:26 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:36:26 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:36:26 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:36:26 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:36:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:36:30 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:36:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:36:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:36:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:36:30 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:36:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:36:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:36:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:36:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:36:31 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:36:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:36:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 10:36:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 10:36:31 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:36:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5755 values 90737 bits 11342 bytes 
Fri 17 Jan 2014 10:36:33 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:36:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43337796
Fri 17 Jan 2014 10:36:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:36:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43337796
Fri 17 Jan 2014 10:36:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:36:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:36:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:36:42 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:36:42 - job_xml_thread(): Done retrieving: data size 43337796
Fri 17 Jan 2014 10:36:42 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:36:42 - XML: Start document: iteration 7
Fri 17 Jan 2014 10:36:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:36:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:36:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:36:46 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:36:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:36:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:36:47 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:36:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:36:47 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:36:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:36:47 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:36:58 - XML: Processed 649078 elements - found 626 jobs
Fri 17 Jan 2014 10:36:58 - job 7347700 appears to have finished
Fri 17 Jan 2014 10:36:58 - job 7347821 appears to have finished
Fri 17 Jan 2014 10:36:58 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 10:36:58 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 10:36:58 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:36:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 10:36:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:36:58 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 10:36:58 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:36:58 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:36:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:36:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:36:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:36:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:36:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:36:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:36:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:36:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:37:00 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:37:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43829855
Fri 17 Jan 2014 10:37:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:37:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43829855
Fri 17 Jan 2014 10:37:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:37:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:37:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:37:08 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:37:08 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 10:37:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:37:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:37:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:37:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:37:11 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:37:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:37:11 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:37:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:37:11 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:37:13 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:37:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:37:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:37:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:37:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:37:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:37:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:37:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:37:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:37:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:37:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:37:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:37:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851195
Fri 17 Jan 2014 10:37:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:37:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851195
Fri 17 Jan 2014 10:37:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:37:18 - job_xml_thread(): Done retrieving: data size 43851195
Fri 17 Jan 2014 10:37:18 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:37:18 - XML: Start document: iteration 8
Fri 17 Jan 2014 10:37:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:37:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:37:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:37:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:37:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:37:31 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:37:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:37:31 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:37:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 10:37:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 10:37:31 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:37:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8142 values 128419 bits 16052 bytes 
Fri 17 Jan 2014 10:37:36 - XML: Processed 655450 elements - found 626 jobs
Fri 17 Jan 2014 10:37:36 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:37:36 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:37:36 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:37:36 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:37:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:37:41 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:37:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:37:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:37:42 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:37:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:37:42 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:37:42 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:37:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:37:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:37:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:37:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:37:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:37:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:37:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:37:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:37:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:37:47 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:37:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43859739
Fri 17 Jan 2014 10:37:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:37:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43859739
Fri 17 Jan 2014 10:37:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:37:51 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:37:51 - job_xml_thread(): Done retrieving: data size 43859739
Fri 17 Jan 2014 10:37:52 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:37:52 - XML: Start document: iteration 9
Fri 17 Jan 2014 10:37:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:37:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:37:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:37:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:37:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:37:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:37:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:37:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:38:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:38:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:38:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:38:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:38:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:38:07 - XML: Processed 655450 elements - found 626 jobs
Fri 17 Jan 2014 10:38:07 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:38:07 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:38:07 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:38:07 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:38:09 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:38:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 10:38:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:38:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:38:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:38:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:38:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:38:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:38:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:38:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:38:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:38:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:38:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43833710
Fri 17 Jan 2014 10:38:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:38:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43833710
Fri 17 Jan 2014 10:38:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:38:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:38:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:38:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:38:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:38:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:38:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:38:22 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:38:22 - job_xml_thread(): Done retrieving: data size 43833710
Fri 17 Jan 2014 10:38:22 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:38:22 - XML: Start document: iteration 10
Fri 17 Jan 2014 10:38:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:38:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:38:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43833710
Fri 17 Jan 2014 10:38:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:38:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:38:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:38:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:38:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:38:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:38:31 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:38:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:38:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 10:38:33 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:38:33 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:38:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5793 values 91386 bits 11423 bytes 
Fri 17 Jan 2014 10:38:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 10:38:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:38:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:38:41 - XML: Processed 655468 elements - found 635 jobs
Fri 17 Jan 2014 10:38:42 - job_xml_thread(): Found 9 updated jobs.
Fri 17 Jan 2014 10:38:42 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 10:38:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:38:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:38:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:38:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:38:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:38:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:38:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:38:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:38:43 - job_xml_thread(): Done storing. succesfully stored: 9 jobs
Fri 17 Jan 2014 10:38:43 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:38:43 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:38:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:38:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:38:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:38:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:38:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:38:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:38:44 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:38:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:38:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:38:48 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:38:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 10:38:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:38:48 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:38:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43874588
Fri 17 Jan 2014 10:38:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:38:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43874588
Fri 17 Jan 2014 10:38:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:38:59 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:38:59 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:38:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:38:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:38:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:38:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:38:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:38:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:38:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:38:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:39:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:39:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:39:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:39:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:39:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:39:03 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:39:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:39:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:39:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:39:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:39:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:39:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:39:06 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:39:06 - job_xml_thread(): Done retrieving: data size 43870664
Fri 17 Jan 2014 10:39:06 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:39:06 - XML: Start document: iteration 11
Fri 17 Jan 2014 10:39:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870664
Fri 17 Jan 2014 10:39:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870664
Fri 17 Jan 2014 10:39:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:39:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:39:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:39:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:39:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:39:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:39:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:39:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:39:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:39:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:39:20 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:39:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:39:20 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:39:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:39:20 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:39:25 - XML: Processed 655468 elements - found 635 jobs
Fri 17 Jan 2014 10:39:25 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:39:25 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:39:25 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:39:25 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:39:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:39:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:39:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:39:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:39:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:39:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:39:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:39:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:39:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:39:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43835650
Fri 17 Jan 2014 10:39:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:39:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43835650
Fri 17 Jan 2014 10:39:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:39:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:39:35 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:39:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:39:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:39:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:39:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 10:39:36 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:39:36 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:39:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 10:39:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:39:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:39:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:39:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9279 values 146390 bits 18298 bytes 
Fri 17 Jan 2014 10:39:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:39:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:39:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:39:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:39:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:39:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43835650
Fri 17 Jan 2014 10:39:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:39:40 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:39:41 - job_xml_thread(): Done retrieving: data size 43835650
Fri 17 Jan 2014 10:39:41 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:39:41 - XML: Start document: iteration 12
Fri 17 Jan 2014 10:39:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:39:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:39:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:39:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:39:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:39:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:39:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:39:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:39:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:39:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:39:55 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:40:01 - XML: Processed 655468 elements - found 635 jobs
Fri 17 Jan 2014 10:40:01 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:40:01 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:40:01 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:40:01 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:40:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:40:01 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:40:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:40:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:40:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:40:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:40:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:40:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:40:02 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 10:40:02 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 10:40:02 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:40:04 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:40:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43850398
Fri 17 Jan 2014 10:40:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:40:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43850398
Fri 17 Jan 2014 10:40:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:40:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:40:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:40:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:40:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:40:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:40:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:40:13 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:40:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 10:40:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:40:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:40:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:40:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:40:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:40:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43850398
Fri 17 Jan 2014 10:40:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:40:16 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:40:16 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:40:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:40:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:40:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:40:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:40:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:40:24 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:40:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:40:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:40:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:40:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:40:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:40:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:40:26 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:40:26 - job_xml_thread(): Done retrieving: data size 43856335
Fri 17 Jan 2014 10:40:26 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:40:26 - XML: Start document: iteration 13
Fri 17 Jan 2014 10:40:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43856335
Fri 17 Jan 2014 10:40:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:40:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:40:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:40:30 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:40:30 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:40:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:40:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856335
Fri 17 Jan 2014 10:40:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:40:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:40:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:40:37 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:40:38 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:40:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 10:40:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:40:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 10:40:38 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:40:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6288 values 99204 bits 12400 bytes 
Fri 17 Jan 2014 10:40:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:40:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:40:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:40:41 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:40:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:40:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:40:46 - XML: Processed 655456 elements - found 632 jobs
Fri 17 Jan 2014 10:40:46 - job 7347686 appears to have finished
Fri 17 Jan 2014 10:40:46 - job 7347680 appears to have finished
Fri 17 Jan 2014 10:40:46 - job 7347676 appears to have finished
Fri 17 Jan 2014 10:40:46 - job 7347798 report time 1389951463 does not match current heartbeat 1389951583 : ignoring job
Fri 17 Jan 2014 10:40:46 - job 7347799 report time 1389951463 does not match current heartbeat 1389951583 : ignoring job
Fri 17 Jan 2014 10:40:46 - job 7336991 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 10:40:46 - job 7347809 appears to have finished
Fri 17 Jan 2014 10:40:47 - job 7347800 report time 1389951463 does not match current heartbeat 1389951583 : ignoring job
Fri 17 Jan 2014 10:40:47 - job 7347801 report time 1389951463 does not match current heartbeat 1389951583 : ignoring job
Fri 17 Jan 2014 10:40:47 - job 7347802 report time 1389951463 does not match current heartbeat 1389951583 : ignoring job
Fri 17 Jan 2014 10:40:47 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:40:47 - job 7347803 report time 1389951463 does not match current heartbeat 1389951583 : ignoring job
Fri 17 Jan 2014 10:40:47 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:40:47 - job 7347837 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 10:40:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:40:47 - job 7347836 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 10:40:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:40:47 - job 7347839 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 10:40:47 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:40:47 - job 7347838 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 10:40:47 - job 7347834 field 'start_timestamp' changed since saved from: 1389951481 to: 1389951416
Fri 17 Jan 2014 10:40:47 - job 7347844 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 10:40:47 - job 7347843 field 'start_timestamp' changed since saved from: 1389951499 to: 1389951416
Fri 17 Jan 2014 10:40:47 - job 7344340 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 10:40:47 - job 7344335 appears to have finished
Fri 17 Jan 2014 10:40:47 - job_xml_thread(): Found 16 updated jobs.
Fri 17 Jan 2014 10:40:47 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 10:40:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:40:48 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:40:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:40:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:40:48 - job_xml_thread(): Done storing. succesfully stored: 16 jobs
Fri 17 Jan 2014 10:40:48 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:40:48 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:40:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:40:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:40:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:40:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:40:50 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:40:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43874331
Fri 17 Jan 2014 10:40:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:40:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43874331
Fri 17 Jan 2014 10:40:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:40:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:40:58 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:41:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:41:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:41:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:41:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:41:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:41:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:41:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:41:03 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:41:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:41:03 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:41:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:41:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:41:04 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:41:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 10:41:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:41:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:41:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:41:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:41:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:41:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:41:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43871889
Fri 17 Jan 2014 10:41:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:41:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43871889
Fri 17 Jan 2014 10:41:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:41:05 - job_xml_thread(): Done retrieving: data size 43871889
Fri 17 Jan 2014 10:41:05 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:41:05 - XML: Start document: iteration 14
Fri 17 Jan 2014 10:41:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:41:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:41:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:41:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:41:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:41:21 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:41:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:41:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:41:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:41:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:41:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:41:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:41:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:41:24 - XML: Processed 655462 elements - found 632 jobs
Fri 17 Jan 2014 10:41:24 - job 7347798 report time 1389951463 does not match current heartbeat 1389951583 : ignoring job
Fri 17 Jan 2014 10:41:24 - job 7347799 report time 1389951463 does not match current heartbeat 1389951583 : ignoring job
Fri 17 Jan 2014 10:41:24 - job 7347800 report time 1389951463 does not match current heartbeat 1389951583 : ignoring job
Fri 17 Jan 2014 10:41:24 - job 7347801 report time 1389951463 does not match current heartbeat 1389951583 : ignoring job
Fri 17 Jan 2014 10:41:24 - job 7347802 report time 1389951463 does not match current heartbeat 1389951583 : ignoring job
Fri 17 Jan 2014 10:41:24 - job 7347803 report time 1389951463 does not match current heartbeat 1389951583 : ignoring job
Fri 17 Jan 2014 10:41:24 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:41:24 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:41:24 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:41:24 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:41:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:41:27 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:41:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:41:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:41:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:41:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:41:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:41:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:41:29 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:41:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43783172
Fri 17 Jan 2014 10:41:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:41:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43783172
Fri 17 Jan 2014 10:41:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:41:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:41:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:41:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:41:39 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:41:39 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:41:39 - job_xml_thread(): Done retrieving: data size 43783172
Fri 17 Jan 2014 10:41:39 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:41:39 - XML: Start document: iteration 15
Fri 17 Jan 2014 10:41:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:41:40 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:41:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 10:41:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 10:41:40 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:41:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8955 values 141228 bits 17653 bytes 
Fri 17 Jan 2014 10:41:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:41:42 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:41:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:41:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:41:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:41:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:41:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:41:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:41:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:41:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:41:43 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:41:50 - XML: Processed 654714 elements - found 632 jobs
Fri 17 Jan 2014 10:41:51 - job 7347798 report time 1389951463 does not match current heartbeat 1389951583 : ignoring job
Fri 17 Jan 2014 10:41:51 - job 7347799 report time 1389951463 does not match current heartbeat 1389951583 : ignoring job
Fri 17 Jan 2014 10:41:51 - job 7347800 report time 1389951463 does not match current heartbeat 1389951583 : ignoring job
Fri 17 Jan 2014 10:41:51 - job 7347801 report time 1389951463 does not match current heartbeat 1389951583 : ignoring job
Fri 17 Jan 2014 10:41:51 - job 7347802 report time 1389951463 does not match current heartbeat 1389951583 : ignoring job
Fri 17 Jan 2014 10:41:51 - job 7347803 report time 1389951463 does not match current heartbeat 1389951583 : ignoring job
Fri 17 Jan 2014 10:41:51 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:41:51 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:41:51 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:41:51 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:41:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:41:53 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:41:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:41:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:41:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:41:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:41:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:41:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:41:55 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:41:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43234663
Fri 17 Jan 2014 10:41:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:41:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43234663
Fri 17 Jan 2014 10:41:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:41:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:41:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:42:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:42:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:42:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:42:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:42:04 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:42:04 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:42:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:42:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:42:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43234663
Fri 17 Jan 2014 10:42:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:42:06 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:42:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:42:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:42:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:42:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:42:13 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:42:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:42:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:42:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:42:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:42:18 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:42:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 10:42:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:42:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:42:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:42:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:42:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:42:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:42:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:42:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:42:19 - job_xml_thread(): Done retrieving: data size 43226100
Fri 17 Jan 2014 10:42:19 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:42:19 - XML: Start document: iteration 16
Fri 17 Jan 2014 10:42:20 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:42:20 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:42:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:42:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:42:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43226100
Fri 17 Jan 2014 10:42:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:42:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43226100
Fri 17 Jan 2014 10:42:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:42:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:42:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:42:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:42:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:42:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:42:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:42:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:42:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:42:39 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:42:39 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:42:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:42:39 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:42:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:42:40 - XML: Processed 647922 elements - found 625 jobs
Fri 17 Jan 2014 10:42:40 - job 7335110 appears to have finished
Fri 17 Jan 2014 10:42:40 - job 7347601 appears to have finished
Fri 17 Jan 2014 10:42:40 - job 7336991 field 'start_timestamp' changed since saved from: 1389951589 to: 1389951538
Fri 17 Jan 2014 10:42:40 - job 7347717 report time 1389951583 does not match current heartbeat 1389951704 : ignoring job
Fri 17 Jan 2014 10:42:40 - job 7347713 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 10:42:40 - job 7334711 appears to have finished
Fri 17 Jan 2014 10:42:40 - job 7347845 field 'start_timestamp' changed since saved from: 1389951593 to: 1389951538
Fri 17 Jan 2014 10:42:40 - job_xml_thread(): Found 8 updated jobs.
Fri 17 Jan 2014 10:42:40 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 10:42:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:42:40 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:42:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:42:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 10:42:41 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:42:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 10:42:41 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:42:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5958 values 94009 bits 11751 bytes 
Fri 17 Jan 2014 10:42:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:42:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:42:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:42:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:42:42 - job_xml_thread(): Done storing. succesfully stored: 8 jobs
Fri 17 Jan 2014 10:42:42 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:42:42 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:42:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:42:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:42:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:42:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:42:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:42:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43802938
Fri 17 Jan 2014 10:42:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:42:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43802938
Fri 17 Jan 2014 10:42:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:42:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:42:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:42:57 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:42:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:42:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:42:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:43:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:43:00 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:43:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:43:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:43:01 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:43:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:43:01 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:43:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:43:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:43:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:43:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:43:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:43:02 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:43:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 10:43:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:43:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:43:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:43:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:43:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:43:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:43:05 - job_xml_thread(): Done retrieving: data size 43847756
Fri 17 Jan 2014 10:43:05 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:43:05 - XML: Start document: iteration 17
Fri 17 Jan 2014 10:43:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43847756
Fri 17 Jan 2014 10:43:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:43:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43847756
Fri 17 Jan 2014 10:43:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:43:08 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 10:43:08 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:43:09 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:43:09 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 10:43:09 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 10:43:09 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:43:09 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 10:43:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:43:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:43:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:43:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:43:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:43:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:43:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:43:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:43:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:43:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:43:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:43:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:43:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:43:23 - XML: Processed 655448 elements - found 625 jobs
Fri 17 Jan 2014 10:43:23 - job 7347717 report time 1389951583 does not match current heartbeat 1389951704 : ignoring job
Fri 17 Jan 2014 10:43:23 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:43:23 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:43:23 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:43:23 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:43:23 - size of cluster 'LISA Cluster': 624 hosts 79468 metrics 779435 values 12299551 bits 1537443 bytes 
Fri 17 Jan 2014 10:43:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:43:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:43:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:43:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:43:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:43:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:43:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:43:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:43:31 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:43:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43831933
Fri 17 Jan 2014 10:43:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:43:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43831933
Fri 17 Jan 2014 10:43:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:43:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:43:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:43:38 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:43:38 - job_xml_thread(): Done retrieving: data size 43831933
Fri 17 Jan 2014 10:43:38 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:43:38 - XML: Start document: iteration 18
Fri 17 Jan 2014 10:43:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:43:41 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:43:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:43:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:43:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:43:42 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:43:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:43:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:43:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:43:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:43:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:43:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:43:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 10:43:43 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:43:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 10:43:43 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:43:43 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:43:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:43:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9053 values 142772 bits 17846 bytes 
Fri 17 Jan 2014 10:43:52 - XML: Processed 655448 elements - found 625 jobs
Fri 17 Jan 2014 10:43:52 - job 7347717 report time 1389951583 does not match current heartbeat 1389951704 : ignoring job
Fri 17 Jan 2014 10:43:52 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:43:52 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:43:52 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:43:52 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:43:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:43:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:43:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:43:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:43:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:43:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:43:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:43:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:43:57 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:43:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43844551
Fri 17 Jan 2014 10:43:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:43:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:43:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:43:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43844551
Fri 17 Jan 2014 10:43:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:44:07 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:44:07 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:44:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:44:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:44:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:44:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:44:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:44:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:44:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:44:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:44:09 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:44:09 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 10:44:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:44:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:44:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:44:13 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:44:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:44:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:44:13 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:44:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 10:44:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:44:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:44:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:44:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:44:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:44:16 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:44:16 - job_xml_thread(): Done retrieving: data size 43834878
Fri 17 Jan 2014 10:44:16 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:44:16 - XML: Start document: iteration 19
Fri 17 Jan 2014 10:44:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43834878
Fri 17 Jan 2014 10:44:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:44:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43834878
Fri 17 Jan 2014 10:44:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:44:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:44:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:44:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:44:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:44:31 - XML: Processed 655444 elements - found 623 jobs
Fri 17 Jan 2014 10:44:31 - job 7347688 appears to have finished
Fri 17 Jan 2014 10:44:31 - job 7347660 appears to have finished
Fri 17 Jan 2014 10:44:31 - job 7334710 appears to have finished
Fri 17 Jan 2014 10:44:31 - job_xml_thread(): Found 5 updated jobs.
Fri 17 Jan 2014 10:44:31 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 10:44:35 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Fri 17 Jan 2014 10:44:35 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:44:35 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:44:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:44:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:44:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:44:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:44:37 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:44:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:44:37 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:44:37 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:44:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:44:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:44:40 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:44:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:44:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:44:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:44:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:44:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:44:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:44:42 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:44:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867082
Fri 17 Jan 2014 10:44:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:44:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43867082
Fri 17 Jan 2014 10:44:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:44:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:44:43 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:44:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:44:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 10:44:44 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:44:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8970 values 141443 bits 17680 bytes 
Fri 17 Jan 2014 10:44:44 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:44:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 10:44:50 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:44:50 - job_xml_thread(): Done retrieving: data size 43867082
Fri 17 Jan 2014 10:44:50 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:44:50 - XML: Start document: iteration 20
Fri 17 Jan 2014 10:44:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:44:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:44:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:44:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:44:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:44:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:44:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:44:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:44:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:44:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:44:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:44:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:44:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:45:01 - XML: Processed 655436 elements - found 623 jobs
Fri 17 Jan 2014 10:45:01 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:45:01 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:45:01 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:45:01 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:45:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:45:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:45:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:45:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:45:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:45:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:45:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:45:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:45:09 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:45:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856083
Fri 17 Jan 2014 10:45:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:45:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43856083
Fri 17 Jan 2014 10:45:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:45:10 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:45:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 10:45:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:45:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:45:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:45:16 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:45:16 - job_xml_thread(): Done retrieving: data size 43856083
Fri 17 Jan 2014 10:45:16 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:45:16 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 10:45:17 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 10:45:17 - Housekeeping: done.
Fri 17 Jan 2014 10:45:17 - XML: Start document: iteration 0
Fri 17 Jan 2014 10:45:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:45:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:45:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:45:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:45:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:45:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:45:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:45:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:45:27 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:45:28 - XML: Processed 655444 elements - found 623 jobs
Fri 17 Jan 2014 10:45:28 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:45:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:45:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:45:28 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:45:28 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:45:28 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:45:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:45:31 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:45:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:45:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:45:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:45:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:45:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:45:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:45:34 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:45:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853829
Fri 17 Jan 2014 10:45:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:45:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853829
Fri 17 Jan 2014 10:45:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:45:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:45:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:45:43 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:45:43 - job_xml_thread(): Done retrieving: data size 43853829
Fri 17 Jan 2014 10:45:43 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:45:43 - XML: Start document: iteration 1
Fri 17 Jan 2014 10:45:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:45:44 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:45:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:45:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 10:45:46 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:45:46 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:45:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 10:45:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:45:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:45:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99052 bits 12381 bytes 
Fri 17 Jan 2014 10:45:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:45:50 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:45:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:45:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:45:51 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:45:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:45:51 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:45:51 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:45:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:45:56 - XML: Processed 655444 elements - found 623 jobs
Fri 17 Jan 2014 10:45:56 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:45:56 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:45:56 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:45:56 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:45:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:45:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:45:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:45:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:45:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:45:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:45:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:45:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:46:01 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:46:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43835828
Fri 17 Jan 2014 10:46:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:46:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43835828
Fri 17 Jan 2014 10:46:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:46:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:46:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:46:11 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:46:11 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:46:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:46:13 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:46:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:46:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:46:14 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:46:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:46:14 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:46:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:46:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:46:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:46:15 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:46:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 10:46:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:46:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:46:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:46:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:46:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:46:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:46:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:46:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:46:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:46:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:46:19 - job_xml_thread(): Done retrieving: data size 43848259
Fri 17 Jan 2014 10:46:19 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:46:19 - XML: Start document: iteration 2
Fri 17 Jan 2014 10:46:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43848259
Fri 17 Jan 2014 10:46:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43848259
Fri 17 Jan 2014 10:46:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:46:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:46:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:46:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:46:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:46:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:46:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:46:34 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:46:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:46:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:46:35 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:46:35 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:46:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:46:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:46:35 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:46:39 - XML: Processed 655444 elements - found 623 jobs
Fri 17 Jan 2014 10:46:39 - job 7347853 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 10:46:39 - job 7347852 field 'start_timestamp' changed since saved from: 1389951832 to: 1389951785
Fri 17 Jan 2014 10:46:39 - job 7347834 appears to have finished
Fri 17 Jan 2014 10:46:39 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 10:46:39 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 10:46:42 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 10:46:42 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:46:42 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:46:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:46:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:46:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:46:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:46:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:46:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:46:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:46:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:46:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:46:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43833226
Fri 17 Jan 2014 10:46:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:46:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43833226
Fri 17 Jan 2014 10:46:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:46:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:46:46 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:46:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:46:46 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:46:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 10:46:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 10:46:46 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:46:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8959 values 141479 bits 17684 bytes 
Fri 17 Jan 2014 10:46:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:46:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:46:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:46:56 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:46:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:46:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:46:57 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:46:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:46:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:46:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:46:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:46:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:46:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:46:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:47:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:47:01 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:47:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:47:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:47:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:47:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:47:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:47:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:47:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:47:05 - job_xml_thread(): Done retrieving: data size 43855588
Fri 17 Jan 2014 10:47:05 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:47:05 - XML: Start document: iteration 3
Fri 17 Jan 2014 10:47:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855588
Fri 17 Jan 2014 10:47:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855588
Fri 17 Jan 2014 10:47:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:47:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:47:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:47:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:47:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:47:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:47:23 - XML: Processed 655444 elements - found 623 jobs
Fri 17 Jan 2014 10:47:23 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:47:23 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:47:23 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:47:23 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:47:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:47:25 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:47:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:47:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:47:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:47:27 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:47:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:47:27 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:47:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:47:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:47:27 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:47:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:47:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:47:27 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:47:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 10:47:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:47:28 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 10:47:28 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 10:47:28 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:47:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:47:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:47:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:47:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:47:28 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:47:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43414570
Fri 17 Jan 2014 10:47:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:47:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43414570
Fri 17 Jan 2014 10:47:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:47:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:47:38 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:47:38 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:47:38 - job_xml_thread(): Done retrieving: data size 43414570
Fri 17 Jan 2014 10:47:38 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:47:38 - XML: Start document: iteration 4
Fri 17 Jan 2014 10:47:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:47:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:47:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:47:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:47:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:47:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:47:43 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:47:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:47:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:47:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:47:46 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:47:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:47:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 10:47:47 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:47:47 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:47:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 10:47:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:47:48 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:47:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:47:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:47:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5679 values 89913 bits 11239 bytes 
Fri 17 Jan 2014 10:47:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:47:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:47:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:47:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:47:49 - XML: Processed 649956 elements - found 623 jobs
Fri 17 Jan 2014 10:47:49 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:47:49 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:47:49 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:47:49 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:47:51 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:47:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43213574
Fri 17 Jan 2014 10:47:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:47:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43213574
Fri 17 Jan 2014 10:47:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:47:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:47:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:48:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:48:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:48:04 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:48:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:48:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:48:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:48:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:48:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:48:06 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:48:06 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:48:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:48:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:48:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:48:08 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:48:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:48:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:48:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:48:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:48:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:48:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:48:08 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:48:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 10:48:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:48:10 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:48:10 - job_xml_thread(): Done retrieving: data size 43219818
Fri 17 Jan 2014 10:48:10 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:48:10 - XML: Start document: iteration 5
Fri 17 Jan 2014 10:48:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43219818
Fri 17 Jan 2014 10:48:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:48:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43219818
Fri 17 Jan 2014 10:48:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:48:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:48:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:48:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:48:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:48:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:48:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:48:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:48:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:48:25 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:48:25 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:48:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:48:25 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:48:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:48:26 - XML: Processed 647246 elements - found 622 jobs
Fri 17 Jan 2014 10:48:26 - job 7347845 appears to have finished
Fri 17 Jan 2014 10:48:27 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 10:48:27 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 10:48:27 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 10:48:27 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:48:27 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:48:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:48:31 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:48:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:48:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:48:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:48:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:48:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:48:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:48:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:48:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43445263
Fri 17 Jan 2014 10:48:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:48:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43445263
Fri 17 Jan 2014 10:48:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:48:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:48:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:48:42 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:48:42 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:48:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:48:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:48:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:48:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:48:45 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:48:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:48:45 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:48:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:48:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:48:46 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:48:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:48:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:48:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:48:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:48:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:48:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:48:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:48:47 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:48:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:48:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 10:48:48 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:48:48 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:48:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8661 values 136792 bits 17099 bytes 
Fri 17 Jan 2014 10:48:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 10:48:48 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:48:48 - job_xml_thread(): Done retrieving: data size 43783855
Fri 17 Jan 2014 10:48:48 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:48:48 - XML: Start document: iteration 6
Fri 17 Jan 2014 10:48:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43783855
Fri 17 Jan 2014 10:48:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43783855
Fri 17 Jan 2014 10:48:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:48:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:49:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:49:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:49:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:49:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:49:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:49:07 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:49:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:49:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:49:08 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:49:08 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:49:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:49:08 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:49:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:49:10 - XML: Processed 654560 elements - found 624 jobs
Fri 17 Jan 2014 10:49:10 - job 7347854 field 'start_timestamp' changed since saved from: 1389951971 to: 1389951907
Fri 17 Jan 2014 10:49:10 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 10:49:10 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 10:49:12 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 10:49:12 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:49:12 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:49:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:49:13 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:49:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:49:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:49:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:49:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:49:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:49:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:49:15 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:49:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 10:49:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:49:15 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:49:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43837180
Fri 17 Jan 2014 10:49:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:49:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43837180
Fri 17 Jan 2014 10:49:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:49:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:49:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:49:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:49:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:49:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:49:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:49:27 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:49:27 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:49:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:49:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:49:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:49:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:49:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:49:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:49:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:49:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:49:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:49:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:49:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:49:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:49:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:49:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:49:31 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:49:31 - job_xml_thread(): Done retrieving: data size 43851274
Fri 17 Jan 2014 10:49:31 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:49:31 - XML: Start document: iteration 7
Fri 17 Jan 2014 10:49:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851274
Fri 17 Jan 2014 10:49:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:49:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851274
Fri 17 Jan 2014 10:49:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:49:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:49:42 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:49:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:49:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:49:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:49:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:49:44 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:49:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:49:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:49:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:49:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:49:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:49:48 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:49:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:49:49 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:49:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 10:49:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 10:49:49 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:49:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6498 values 102522 bits 12815 bytes 
Fri 17 Jan 2014 10:49:50 - XML: Processed 655446 elements - found 624 jobs
Fri 17 Jan 2014 10:49:50 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:49:50 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:49:50 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:49:50 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:49:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:49:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:49:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:49:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:49:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:49:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:49:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:49:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:49:56 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:49:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43840865
Fri 17 Jan 2014 10:49:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:49:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43840865
Fri 17 Jan 2014 10:49:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:49:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:49:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:50:05 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:50:05 - job_xml_thread(): Done retrieving: data size 43840865
Fri 17 Jan 2014 10:50:05 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:50:05 - XML: Start document: iteration 8
Fri 17 Jan 2014 10:50:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:50:09 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:50:09 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 10:50:09 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:50:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:50:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:50:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:50:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:50:10 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:50:10 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:50:10 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 10:50:10 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 10:50:10 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 10:50:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:50:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:50:11 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:50:11 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:50:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:50:13 - size of cluster 'LISA Cluster': 624 hosts 79480 metrics 811534 values 12829881 bits 1603735 bytes 
Fri 17 Jan 2014 10:50:19 - XML: Processed 655446 elements - found 624 jobs
Fri 17 Jan 2014 10:50:19 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:50:19 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:50:19 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:50:19 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:50:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:50:20 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:50:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:50:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:50:21 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:50:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 10:50:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:50:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:50:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:50:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:50:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:50:24 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:50:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43852287
Fri 17 Jan 2014 10:50:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:50:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43852287
Fri 17 Jan 2014 10:50:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:50:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:50:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:50:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:50:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:50:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:50:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:50:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:50:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:50:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:50:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:50:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43852287
Fri 17 Jan 2014 10:50:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:50:34 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:50:34 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:50:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:50:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:50:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:50:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:50:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:50:45 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:50:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:50:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:50:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:50:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:50:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:50:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:50:48 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:50:48 - job_xml_thread(): Done retrieving: data size 43835206
Fri 17 Jan 2014 10:50:48 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:50:48 - XML: Start document: iteration 9
Fri 17 Jan 2014 10:50:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43835206
Fri 17 Jan 2014 10:50:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:50:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:50:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:50:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:50:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:50:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:50:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:50:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43835206
Fri 17 Jan 2014 10:50:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:50:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:50:49 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:50:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:50:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 10:50:50 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:50:50 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:50:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 10:50:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5768 values 91002 bits 11375 bytes 
Fri 17 Jan 2014 10:51:00 - XML: Processed 655464 elements - found 633 jobs
Fri 17 Jan 2014 10:51:00 - job 7347722 appears to have finished
Fri 17 Jan 2014 10:51:00 - job 7347839 appears to have finished
Fri 17 Jan 2014 10:51:00 - job 7347838 appears to have finished
Fri 17 Jan 2014 10:51:00 - job 7347856 field 'start_timestamp' changed since saved from: 1389952110 to: 1389952054
Fri 17 Jan 2014 10:51:00 - job_xml_thread(): Found 16 updated jobs.
Fri 17 Jan 2014 10:51:00 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 10:51:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:51:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:51:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:51:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:51:07 - job_xml_thread(): Done storing. succesfully stored: 16 jobs
Fri 17 Jan 2014 10:51:07 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:51:07 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:51:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:51:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:51:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:51:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:51:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:51:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:51:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:51:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:51:09 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:51:11 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:51:11 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 10:51:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:51:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:51:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:51:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:51:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:51:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:51:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:51:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:51:14 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:51:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 10:51:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:51:14 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:51:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43849611
Fri 17 Jan 2014 10:51:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:51:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43849611
Fri 17 Jan 2014 10:51:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:51:23 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:51:23 - job_xml_thread(): Done retrieving: data size 43849611
Fri 17 Jan 2014 10:51:23 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:51:23 - XML: Start document: iteration 10
Fri 17 Jan 2014 10:51:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:51:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:51:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:51:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:51:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:51:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:51:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:51:35 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:51:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:51:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:51:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:51:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:51:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:51:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:51:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:51:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:51:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:51:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:51:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:51:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:51:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:51:37 - XML: Processed 655464 elements - found 633 jobs
Fri 17 Jan 2014 10:51:37 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:51:37 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:51:37 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:51:37 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:51:40 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:51:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43887948
Fri 17 Jan 2014 10:51:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:51:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43887948
Fri 17 Jan 2014 10:51:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:51:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:51:51 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:51:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:51:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:51:51 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:51:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 10:51:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:51:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 10:51:51 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:51:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6291 values 99275 bits 12409 bytes 
Fri 17 Jan 2014 10:51:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:51:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:51:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:51:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:51:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:51:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:51:52 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:51:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:51:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:51:52 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:51:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:51:55 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:51:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:51:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:51:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:51:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:51:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:51:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:51:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:51:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43860097
Fri 17 Jan 2014 10:51:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:51:58 - job_xml_thread(): Done retrieving: data size 43860097
Fri 17 Jan 2014 10:51:58 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:51:59 - XML: Start document: iteration 11
Fri 17 Jan 2014 10:51:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43860097
Fri 17 Jan 2014 10:51:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:52:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:52:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:52:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:52:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:52:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:52:19 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:52:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:52:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:52:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:52:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:52:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:52:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:52:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:52:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:52:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:52:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:52:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:52:23 - XML: Processed 655458 elements - found 633 jobs
Fri 17 Jan 2014 10:52:23 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:52:23 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:52:23 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:52:23 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:52:23 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:52:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 10:52:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:52:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:52:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:52:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:52:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:52:26 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:52:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875258
Fri 17 Jan 2014 10:52:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:52:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875258
Fri 17 Jan 2014 10:52:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:52:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:52:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:52:38 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:52:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:52:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:52:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:52:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:52:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:52:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:52:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:52:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:52:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:52:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:52:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:52:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:52:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:52:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:52:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:52:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:52:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:52:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:52:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:52:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:52:45 - job_xml_thread(): Done retrieving: data size 43848563
Fri 17 Jan 2014 10:52:45 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:52:45 - XML: Start document: iteration 12
Fri 17 Jan 2014 10:52:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43848563
Fri 17 Jan 2014 10:52:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:52:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43848563
Fri 17 Jan 2014 10:52:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:52:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:52:51 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:52:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:52:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 10:52:54 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:52:54 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:52:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 10:52:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9012 values 142253 bits 17781 bytes 
Fri 17 Jan 2014 10:52:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:52:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:52:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:52:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:53:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:53:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:53:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:53:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:53:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:53:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:53:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:53:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:53:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:53:03 - XML: Processed 655460 elements - found 631 jobs
Fri 17 Jan 2014 10:53:03 - job 7347870 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 10:53:03 - job 7347728 appears to have finished
Fri 17 Jan 2014 10:53:03 - job 7347835 appears to have finished
Fri 17 Jan 2014 10:53:03 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 10:53:03 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 10:53:03 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 10:53:03 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:53:03 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:53:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:53:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:53:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:53:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:53:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:53:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:53:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:53:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:53:12 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:53:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 10:53:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:53:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:53:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43826483
Fri 17 Jan 2014 10:53:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:53:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43826483
Fri 17 Jan 2014 10:53:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:53:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:53:18 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:53:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:53:18 - job_xml_thread(): Done retrieving: data size 43826483
Fri 17 Jan 2014 10:53:18 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:53:18 - XML: Start document: iteration 13
Fri 17 Jan 2014 10:53:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:53:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:53:25 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:53:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:53:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:53:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:53:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:53:27 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:53:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:53:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:53:27 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:53:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:53:35 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:53:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:53:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:53:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:53:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:53:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:53:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:53:36 - XML: Processed 655168 elements - found 631 jobs
Fri 17 Jan 2014 10:53:36 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:53:36 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:53:36 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:53:36 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:53:39 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:53:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43433379
Fri 17 Jan 2014 10:53:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:53:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43433379
Fri 17 Jan 2014 10:53:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:53:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:53:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:53:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:53:50 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:53:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:53:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:53:50 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:53:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:53:50 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:53:50 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:53:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:53:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:53:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:53:51 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:53:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:53:54 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:53:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:53:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 10:53:54 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:53:54 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:53:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 10:53:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99064 bits 12383 bytes 
Fri 17 Jan 2014 10:53:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:53:55 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:53:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:53:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:53:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:53:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:53:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:53:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:53:58 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 10:53:58 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 10:53:58 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:53:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:53:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43201805
Fri 17 Jan 2014 10:53:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:53:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43201805
Fri 17 Jan 2014 10:53:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:53:59 - job_xml_thread(): Done retrieving: data size 43201805
Fri 17 Jan 2014 10:53:59 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:53:59 - XML: Start document: iteration 14
Fri 17 Jan 2014 10:54:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:54:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:54:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:54:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:54:15 - XML: Processed 647354 elements - found 631 jobs
Fri 17 Jan 2014 10:54:16 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:54:16 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:54:16 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:54:16 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:54:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:54:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:54:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:54:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:54:17 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:54:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:54:17 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:54:17 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:54:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:54:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:54:21 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:54:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:54:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:54:22 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:54:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 10:54:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:54:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:54:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:54:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:54:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:54:23 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:54:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43273404
Fri 17 Jan 2014 10:54:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:54:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43273404
Fri 17 Jan 2014 10:54:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:54:31 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:54:31 - job_xml_thread(): Done retrieving: data size 43273404
Fri 17 Jan 2014 10:54:31 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:54:31 - XML: Start document: iteration 15
Fri 17 Jan 2014 10:54:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:54:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:54:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:54:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:54:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:54:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:54:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:54:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:54:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43273404
Fri 17 Jan 2014 10:54:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:54:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:54:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:54:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:54:46 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:54:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:54:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:54:49 - XML: Processed 648006 elements - found 630 jobs
Fri 17 Jan 2014 10:54:49 - job 7347837 appears to have finished
Fri 17 Jan 2014 10:54:49 - job 7347836 appears to have finished
Fri 17 Jan 2014 10:54:49 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 10:54:49 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 10:54:50 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:54:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:54:50 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:54:50 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:54:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:54:50 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 10:54:50 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:54:50 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:54:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:54:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:54:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:54:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:54:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:54:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:54:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:54:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:54:53 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:54:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43827310
Fri 17 Jan 2014 10:54:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:54:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43827310
Fri 17 Jan 2014 10:54:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:54:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:54:54 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:54:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:54:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 10:54:56 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:54:56 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:54:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 10:54:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8623 values 135960 bits 16995 bytes 
Fri 17 Jan 2014 10:55:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:55:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:55:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:55:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:55:05 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:55:05 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:55:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:55:06 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:55:06 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:55:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:55:06 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:55:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:55:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:55:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:55:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:55:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:55:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:55:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:55:08 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:55:08 - job_xml_thread(): Done retrieving: data size 43879273
Fri 17 Jan 2014 10:55:08 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:55:08 - XML: Start document: iteration 16
Fri 17 Jan 2014 10:55:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43879273
Fri 17 Jan 2014 10:55:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43879273
Fri 17 Jan 2014 10:55:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:55:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:55:20 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:55:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 10:55:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:55:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:55:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:55:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:55:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:55:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:55:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:55:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:55:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:55:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:55:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:55:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:55:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:55:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:55:27 - XML: Processed 655452 elements - found 630 jobs
Fri 17 Jan 2014 10:55:27 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:55:27 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:55:27 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:55:27 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:55:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:55:30 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:55:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:55:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:55:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:55:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:55:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:55:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:55:31 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:55:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43842120
Fri 17 Jan 2014 10:55:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:55:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43842120
Fri 17 Jan 2014 10:55:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:55:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:55:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:55:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:55:42 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:55:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:55:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:55:42 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:55:42 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:55:42 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:55:42 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:55:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:55:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:55:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:55:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:55:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:55:45 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:55:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:55:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:55:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:55:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:55:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:55:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:55:47 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:55:47 - job_xml_thread(): Done retrieving: data size 43854037
Fri 17 Jan 2014 10:55:47 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:55:47 - XML: Start document: iteration 17
Fri 17 Jan 2014 10:55:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43854037
Fri 17 Jan 2014 10:55:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43854037
Fri 17 Jan 2014 10:55:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:55:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:55:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:55:56 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:55:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:55:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:55:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:55:58 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:55:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 10:55:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 10:55:58 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:55:59 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9259 values 146066 bits 18258 bytes 
Fri 17 Jan 2014 10:56:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:56:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:56:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:56:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:56:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:56:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:56:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:56:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:56:05 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:56:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:56:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:56:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:56:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:56:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:56:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:56:11 - XML: Processed 655458 elements - found 630 jobs
Fri 17 Jan 2014 10:56:11 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:56:11 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:56:11 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:56:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:56:11 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:56:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:56:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:56:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:56:13 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:56:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 10:56:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:56:14 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:56:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43836383
Fri 17 Jan 2014 10:56:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:56:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43836383
Fri 17 Jan 2014 10:56:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:56:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:56:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:56:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:56:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:56:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:56:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:56:26 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:56:26 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:56:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:56:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:56:26 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:56:26 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:56:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:56:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:56:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:56:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:56:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:56:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:56:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:56:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:56:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:56:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:56:30 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:56:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43859933
Fri 17 Jan 2014 10:56:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:56:30 - job_xml_thread(): Done retrieving: data size 43859933
Fri 17 Jan 2014 10:56:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43859933
Fri 17 Jan 2014 10:56:30 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:56:30 - XML: Start document: iteration 18
Fri 17 Jan 2014 10:56:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:56:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:56:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:56:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:56:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:56:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:56:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:56:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:56:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:56:45 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:56:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:56:45 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:56:45 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:56:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:56:48 - XML: Processed 655464 elements - found 633 jobs
Fri 17 Jan 2014 10:56:48 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 10:56:48 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 10:56:49 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 10:56:49 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:56:49 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:56:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:56:52 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:56:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:56:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:56:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:56:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:56:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:56:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:56:53 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:56:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43874651
Fri 17 Jan 2014 10:56:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:56:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43874651
Fri 17 Jan 2014 10:56:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:56:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:56:58 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:57:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:57:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:57:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:57:00 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:57:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 10:57:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 10:57:00 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:57:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148603 bits 18575 bytes 
Fri 17 Jan 2014 10:57:04 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:57:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:57:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:57:07 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:57:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:57:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:57:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:57:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:57:07 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:57:07 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:57:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:57:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:57:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:57:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:57:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:57:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:57:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:57:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:57:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:57:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:57:11 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 10:57:11 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:57:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:57:11 - job_xml_thread(): Done retrieving: data size 43868062
Fri 17 Jan 2014 10:57:11 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:57:11 - XML: Start document: iteration 19
Fri 17 Jan 2014 10:57:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43868062
Fri 17 Jan 2014 10:57:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:57:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43868062
Fri 17 Jan 2014 10:57:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:57:12 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:57:12 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:57:12 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 10:57:12 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 10:57:12 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 10:57:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:57:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:57:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:57:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:57:26 - XML: Processed 655459 elements - found 633 jobs
Fri 17 Jan 2014 10:57:26 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:57:26 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:57:26 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:57:26 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:57:27 - size of cluster 'LISA Cluster': 624 hosts 79465 metrics 777108 values 12260782 bits 1532597 bytes 
Fri 17 Jan 2014 10:57:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:57:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:57:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:57:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:57:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:57:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:57:31 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:57:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:57:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:57:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:57:36 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:57:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:57:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:57:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:57:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:57:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:57:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:57:37 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:57:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 10:57:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:57:39 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:57:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43878377
Fri 17 Jan 2014 10:57:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:57:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43878377
Fri 17 Jan 2014 10:57:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:57:41 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:57:41 - job_xml_thread(): Done retrieving: data size 43878377
Fri 17 Jan 2014 10:57:41 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:57:41 - XML: Start document: iteration 20
Fri 17 Jan 2014 10:57:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:57:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:57:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:57:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:57:58 - XML: Processed 655464 elements - found 633 jobs
Fri 17 Jan 2014 10:57:58 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:57:58 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:57:58 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:57:58 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:57:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:57:58 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:57:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:57:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:57:59 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:57:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:57:59 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:57:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:57:59 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:58:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:58:00 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:58:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:58:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 10:58:00 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:58:00 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:58:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 10:58:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5124 values 80784 bits 10098 bytes 
Fri 17 Jan 2014 10:58:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:58:03 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:58:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:58:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:58:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:58:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:58:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:58:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:58:07 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:58:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43868284
Fri 17 Jan 2014 10:58:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:58:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43868284
Fri 17 Jan 2014 10:58:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:58:12 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:58:12 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 10:58:13 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:58:13 - job_xml_thread(): Done retrieving: data size 43868284
Fri 17 Jan 2014 10:58:13 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:58:13 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 10:58:13 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 10:58:13 - Housekeeping: done.
Fri 17 Jan 2014 10:58:13 - XML: Start document: iteration 0
Fri 17 Jan 2014 10:58:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:58:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:58:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:58:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:58:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:58:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:58:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:58:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:58:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:58:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:58:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:58:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:58:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:58:28 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:58:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 10:58:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:58:30 - XML: Processed 655464 elements - found 633 jobs
Fri 17 Jan 2014 10:58:30 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:58:30 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:58:30 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:58:30 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:58:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:58:30 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:58:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:58:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:58:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:58:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:58:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:58:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:58:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:58:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:58:33 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:58:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43833515
Fri 17 Jan 2014 10:58:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:58:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43833515
Fri 17 Jan 2014 10:58:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:58:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:58:42 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:58:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:58:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:58:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:58:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:58:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:58:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:58:43 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:58:45 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:58:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:58:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:58:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:58:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:58:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:58:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:58:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:58:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:58:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:58:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:58:50 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:58:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870509
Fri 17 Jan 2014 10:58:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:58:50 - job_xml_thread(): Done retrieving: data size 43870509
Fri 17 Jan 2014 10:58:50 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:58:50 - XML: Start document: iteration 1
Fri 17 Jan 2014 10:58:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870509
Fri 17 Jan 2014 10:58:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:58:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:58:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:59:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:59:00 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:59:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:59:01 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:59:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 10:59:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 10:59:01 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:59:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8955 values 141206 bits 17650 bytes 
Fri 17 Jan 2014 10:59:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:59:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:59:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:59:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:59:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:59:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:59:11 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:59:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:59:11 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:59:11 - XML: Processed 655472 elements - found 637 jobs
Fri 17 Jan 2014 10:59:11 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:59:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:59:11 - job 7347898 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 10:59:11 - job 7347721 appears to have finished
Fri 17 Jan 2014 10:59:11 - job_xml_thread(): Found 7 updated jobs.
Fri 17 Jan 2014 10:59:11 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 10:59:12 - job_xml_thread(): Done storing. succesfully stored: 7 jobs
Fri 17 Jan 2014 10:59:12 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:59:12 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:59:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:59:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:59:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:59:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:59:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:59:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:59:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:59:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:59:17 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 10:59:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 10:59:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:59:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:59:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43777176
Fri 17 Jan 2014 10:59:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:59:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43777176
Fri 17 Jan 2014 10:59:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:59:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:59:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:59:27 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:59:27 - job_xml_thread(): Done retrieving: data size 43777176
Fri 17 Jan 2014 10:59:27 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 10:59:27 - XML: Start document: iteration 2
Fri 17 Jan 2014 10:59:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:59:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:59:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:59:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:59:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:59:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:59:32 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:59:32 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:59:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:59:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:59:32 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:59:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:59:35 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:59:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:59:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:59:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:59:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:59:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:59:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 10:59:40 - XML: Processed 654724 elements - found 637 jobs
Fri 17 Jan 2014 10:59:40 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 10:59:40 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 10:59:40 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 10:59:40 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 10:59:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 10:59:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43279224
Fri 17 Jan 2014 10:59:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 10:59:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43279224
Fri 17 Jan 2014 10:59:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 10:59:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 10:59:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:59:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 10:59:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 10:59:55 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 10:59:55 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 10:59:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 10:59:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 10:59:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 10:59:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 10:59:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 10:59:57 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 10:59:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 10:59:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 10:59:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:59:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 10:59:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 10:59:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 10:59:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:59:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 10:59:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 10:59:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:00:00 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:00:00 - job_xml_thread(): Done retrieving: data size 43191154
Fri 17 Jan 2014 11:00:00 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:00:00 - XML: Start document: iteration 3
Fri 17 Jan 2014 11:00:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43191154
Fri 17 Jan 2014 11:00:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:00:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43191154
Fri 17 Jan 2014 11:00:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:00:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:00:01 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:00:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:00:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 11:00:02 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:00:02 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:00:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 11:00:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99045 bits 12380 bytes 
Fri 17 Jan 2014 11:00:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:00:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:00:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:00:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:00:19 - XML: Processed 647271 elements - found 638 jobs
Fri 17 Jan 2014 11:00:19 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 11:00:19 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 11:00:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:00:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:00:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:00:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:00:19 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 11:00:19 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:00:19 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:00:20 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:00:20 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:00:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:00:20 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:00:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:00:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:00:23 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:00:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:00:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:00:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:00:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:00:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:00:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:00:23 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 11:00:23 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 11:00:23 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:00:24 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:00:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 11:00:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:00:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:00:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43285678
Fri 17 Jan 2014 11:00:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:00:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43285678
Fri 17 Jan 2014 11:00:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:00:35 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:00:35 - job_xml_thread(): Done retrieving: data size 43285678
Fri 17 Jan 2014 11:00:35 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:00:35 - XML: Start document: iteration 4
Fri 17 Jan 2014 11:00:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:00:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:00:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:00:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:00:37 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:00:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:00:37 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:00:37 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:00:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:00:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:00:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:00:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:00:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:00:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:00:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:00:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:00:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:00:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:00:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:00:44 - XML: Processed 648016 elements - found 635 jobs
Fri 17 Jan 2014 11:00:44 - job 7347707 appears to have finished
Fri 17 Jan 2014 11:00:44 - job 7347791 appears to have finished
Fri 17 Jan 2014 11:00:44 - job 7347724 appears to have finished
Fri 17 Jan 2014 11:00:44 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 11:00:44 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 11:00:44 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 11:00:44 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:00:44 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:00:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:00:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43763711
Fri 17 Jan 2014 11:00:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:00:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43763711
Fri 17 Jan 2014 11:00:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:00:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:00:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:00:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:00:53 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:00:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:00:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:00:54 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:00:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:00:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43763711
Fri 17 Jan 2014 11:00:54 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:00:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:00:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:00:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:00:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:00:59 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:00:59 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:01:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:01:02 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:01:03 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:01:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 11:01:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:01:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 11:01:03 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:01:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6283 values 99175 bits 12396 bytes 
Fri 17 Jan 2014 11:01:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:01:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:01:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:01:06 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:01:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:01:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:01:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:01:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:01:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:01:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:01:08 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:01:08 - job_xml_thread(): Done retrieving: data size 43853342
Fri 17 Jan 2014 11:01:08 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:01:08 - XML: Start document: iteration 5
Fri 17 Jan 2014 11:01:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853342
Fri 17 Jan 2014 11:01:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:01:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:01:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:01:11 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:01:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:01:11 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:01:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:01:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853342
Fri 17 Jan 2014 11:01:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:01:16 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:01:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 11:01:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:01:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:01:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:01:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:01:26 - XML: Processed 655468 elements - found 635 jobs
Fri 17 Jan 2014 11:01:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:01:26 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 11:01:26 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 11:01:26 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:01:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:01:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:01:26 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:01:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:01:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:01:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:01:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:01:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:01:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:01:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:01:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:01:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:01:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:01:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:01:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:01:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:01:30 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:01:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858038
Fri 17 Jan 2014 11:01:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:01:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43858038
Fri 17 Jan 2014 11:01:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:01:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:01:41 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:01:41 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:01:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:01:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:01:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:01:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:01:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:01:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:01:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:01:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:01:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:01:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:01:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:01:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:01:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:01:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:01:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:01:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:01:45 - job_xml_thread(): Done retrieving: data size 43857478
Fri 17 Jan 2014 11:01:45 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:01:45 - XML: Start document: iteration 6
Fri 17 Jan 2014 11:01:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43857478
Fri 17 Jan 2014 11:01:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:01:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43857478
Fri 17 Jan 2014 11:01:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:01:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:01:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:02:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:02:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:02:01 - XML: Processed 655478 elements - found 640 jobs
Fri 17 Jan 2014 11:02:01 - job_xml_thread(): Found 5 updated jobs.
Fri 17 Jan 2014 11:02:01 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 11:02:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:02:03 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:02:04 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Fri 17 Jan 2014 11:02:04 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:02:04 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:02:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:02:04 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:02:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 11:02:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 11:02:04 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:02:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9366 values 148100 bits 18512 bytes 
Fri 17 Jan 2014 11:02:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:02:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:02:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:02:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:02:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:02:08 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:02:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:02:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:02:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:02:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:02:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:02:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:02:09 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:02:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:02:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:02:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:02:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:02:10 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:02:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43885884
Fri 17 Jan 2014 11:02:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:02:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43885884
Fri 17 Jan 2014 11:02:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:02:13 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:02:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 11:02:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:02:19 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:02:19 - job_xml_thread(): Done retrieving: data size 43885884
Fri 17 Jan 2014 11:02:19 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:02:19 - XML: Start document: iteration 7
Fri 17 Jan 2014 11:02:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:02:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:02:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:02:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:02:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:02:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:02:25 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:02:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:02:25 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:02:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:02:25 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:02:32 - XML: Processed 655478 elements - found 640 jobs
Fri 17 Jan 2014 11:02:32 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 11:02:32 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 11:02:32 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:02:32 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:02:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:02:33 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:02:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:02:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:02:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:02:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:02:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:02:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:02:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:02:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851805
Fri 17 Jan 2014 11:02:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:02:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851805
Fri 17 Jan 2014 11:02:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:02:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:02:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:02:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:02:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:02:47 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:02:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:02:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:02:47 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:02:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:02:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:02:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:02:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:02:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:02:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:02:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:02:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:02:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:02:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:02:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:02:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:02:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:02:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:02:51 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:02:51 - job_xml_thread(): Done retrieving: data size 43880974
Fri 17 Jan 2014 11:02:51 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:02:51 - XML: Start document: iteration 8
Fri 17 Jan 2014 11:02:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43880974
Fri 17 Jan 2014 11:02:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:02:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43880974
Fri 17 Jan 2014 11:02:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:03:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:03:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:03:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:03:04 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:03:05 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:03:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:03:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 11:03:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 11:03:05 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:03:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:03:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:03:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9405 values 148814 bits 18601 bytes 
Fri 17 Jan 2014 11:03:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:03:07 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:03:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:03:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:03:08 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:03:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:03:08 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:03:08 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:03:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:03:12 - XML: Processed 655478 elements - found 640 jobs
Fri 17 Jan 2014 11:03:13 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 11:03:13 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 11:03:13 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:03:13 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:03:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:03:15 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:03:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:03:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:03:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:03:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:03:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:03:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:03:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:03:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43844417
Fri 17 Jan 2014 11:03:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:03:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43844417
Fri 17 Jan 2014 11:03:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:03:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:03:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:03:28 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:03:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:03:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:03:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:03:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:03:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:03:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:03:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:03:32 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:03:32 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:03:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:03:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:03:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:03:32 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:03:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:03:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:03:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:03:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:03:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:03:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:03:33 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:03:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 11:03:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:03:34 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:03:34 - job_xml_thread(): Done retrieving: data size 43868405
Fri 17 Jan 2014 11:03:34 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:03:34 - XML: Start document: iteration 9
Fri 17 Jan 2014 11:03:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43868405
Fri 17 Jan 2014 11:03:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:03:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43868405
Fri 17 Jan 2014 11:03:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:03:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:03:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:03:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:03:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:03:49 - XML: Processed 655480 elements - found 641 jobs
Fri 17 Jan 2014 11:03:49 - job 7347703 appears to have finished
Fri 17 Jan 2014 11:03:49 - job 7347723 appears to have finished
Fri 17 Jan 2014 11:03:49 - job_xml_thread(): Found 5 updated jobs.
Fri 17 Jan 2014 11:03:49 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 11:03:53 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Fri 17 Jan 2014 11:03:53 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:03:53 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:03:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:03:53 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:03:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:03:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:03:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:03:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:03:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:03:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:03:55 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:03:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:03:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:03:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:03:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:03:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:03:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:03:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:03:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:03:57 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:03:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870958
Fri 17 Jan 2014 11:03:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:03:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870958
Fri 17 Jan 2014 11:03:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:04:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:04:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:04:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:04:06 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:04:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:04:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 11:04:06 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:04:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 11:04:07 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:04:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8806 values 138944 bits 17368 bytes 
Fri 17 Jan 2014 11:04:08 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:04:08 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:04:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:04:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:04:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:04:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:04:11 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:04:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:04:11 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:04:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:04:12 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 11:04:12 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:04:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:04:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:04:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:04:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:04:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:04:12 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:04:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:04:12 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 11:04:12 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:04:12 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 11:04:12 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 11:04:13 - size of cluster 'LISA Cluster': 624 hosts 79473 metrics 840127 values 13279672 bits 1659959 bytes 
Fri 17 Jan 2014 11:04:14 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:04:14 - job_xml_thread(): Done retrieving: data size 43860663
Fri 17 Jan 2014 11:04:14 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:04:14 - XML: Start document: iteration 10
Fri 17 Jan 2014 11:04:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43860663
Fri 17 Jan 2014 11:04:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:04:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43860663
Fri 17 Jan 2014 11:04:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:04:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:04:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:04:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:04:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:04:32 - XML: Processed 655480 elements - found 641 jobs
Fri 17 Jan 2014 11:04:32 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 11:04:32 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 11:04:32 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:04:32 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:04:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:04:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:04:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:04:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:04:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:04:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:04:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:04:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:04:34 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:04:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:04:37 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:04:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:04:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:04:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:04:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:04:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:04:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:04:37 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:04:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 11:04:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:04:40 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:04:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43887125
Fri 17 Jan 2014 11:04:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:04:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43887125
Fri 17 Jan 2014 11:04:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:04:47 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:04:47 - job_xml_thread(): Done retrieving: data size 43887125
Fri 17 Jan 2014 11:04:48 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:04:48 - XML: Start document: iteration 11
Fri 17 Jan 2014 11:04:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:04:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:04:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:04:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:04:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:04:53 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:04:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:04:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:04:54 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:04:54 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:04:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:04:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:04:54 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:05:02 - XML: Processed 655480 elements - found 641 jobs
Fri 17 Jan 2014 11:05:02 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 11:05:02 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 11:05:02 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:05:02 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:05:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:05:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:05:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:05:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:05:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:05:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:05:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:05:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:05:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:05:06 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:05:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:05:07 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:05:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 11:05:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 11:05:07 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:05:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5679 values 89531 bits 11191 bytes 
Fri 17 Jan 2014 11:05:07 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:05:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851691
Fri 17 Jan 2014 11:05:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:05:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851691
Fri 17 Jan 2014 11:05:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:05:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:05:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:05:12 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:05:12 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 11:05:17 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:05:17 - job_xml_thread(): Done retrieving: data size 43851691
Fri 17 Jan 2014 11:05:17 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:05:17 - XML: Start document: iteration 12
Fri 17 Jan 2014 11:05:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:05:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:05:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:05:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:05:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:05:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:05:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:05:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:05:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:05:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:05:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:05:28 - XML: Processed 655480 elements - found 641 jobs
Fri 17 Jan 2014 11:05:28 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 11:05:28 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 11:05:28 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:05:28 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:05:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:05:32 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:05:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:05:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:05:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:05:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:05:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:05:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:05:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:05:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:05:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:05:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43766612
Fri 17 Jan 2014 11:05:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:05:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43766612
Fri 17 Jan 2014 11:05:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:05:39 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:05:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 11:05:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:05:44 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:05:44 - job_xml_thread(): Done retrieving: data size 43766612
Fri 17 Jan 2014 11:05:44 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:05:44 - XML: Start document: iteration 13
Fri 17 Jan 2014 11:05:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:05:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:05:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:05:50 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:05:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:05:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:05:51 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:05:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:05:51 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:05:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:05:51 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:05:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:05:59 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:05:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:05:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:06:00 - XML: Processed 654738 elements - found 644 jobs
Fri 17 Jan 2014 11:06:00 - job 7347897 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 11:06:00 - job 7347847 report time 1389952972 does not match current heartbeat 1389953093 : ignoring job
Fri 17 Jan 2014 11:06:00 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 11:06:00 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 11:06:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:06:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:06:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:06:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:06:00 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 11:06:00 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:06:00 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:06:03 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:06:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43186605
Fri 17 Jan 2014 11:06:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:06:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43186605
Fri 17 Jan 2014 11:06:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:06:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:06:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:06:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:06:07 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:06:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:06:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 11:06:08 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:06:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6519 values 102858 bits 12857 bytes 
Fri 17 Jan 2014 11:06:08 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:06:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 11:06:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:06:13 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:06:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:06:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:06:14 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:06:14 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:06:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:06:14 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:06:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:06:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:06:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:06:15 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:06:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:06:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:06:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:06:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:06:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:06:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:06:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:06:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:06:22 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:06:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43267274
Fri 17 Jan 2014 11:06:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:06:23 - job_xml_thread(): Done retrieving: data size 43267274
Fri 17 Jan 2014 11:06:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43267274
Fri 17 Jan 2014 11:06:23 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:06:23 - XML: Start document: iteration 14
Fri 17 Jan 2014 11:06:23 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:06:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:06:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 11:06:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:06:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:06:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:06:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:06:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:06:34 - XML: Processed 648034 elements - found 644 jobs
Fri 17 Jan 2014 11:06:34 - job 7347847 report time 1389952972 does not match current heartbeat 1389953093 : ignoring job
Fri 17 Jan 2014 11:06:34 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 11:06:34 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 11:06:34 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:06:34 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:06:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:06:41 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:06:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:06:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:06:42 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:06:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:06:42 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:06:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:06:42 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:06:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:06:44 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:06:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:06:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:06:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:06:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:06:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:06:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:06:48 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:06:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43807814
Fri 17 Jan 2014 11:06:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:06:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43807814
Fri 17 Jan 2014 11:06:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:06:49 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:06:49 - job_xml_thread(): Done retrieving: data size 43807814
Fri 17 Jan 2014 11:06:49 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:06:49 - XML: Start document: iteration 15
Fri 17 Jan 2014 11:06:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:06:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:07:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:07:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:07:04 - XML: Processed 654872 elements - found 644 jobs
Fri 17 Jan 2014 11:07:05 - job 7347847 report time 1389952972 does not match current heartbeat 1389953093 : ignoring job
Fri 17 Jan 2014 11:07:05 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 11:07:05 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 11:07:05 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:07:05 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:07:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:07:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:07:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:07:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:07:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:07:08 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:07:08 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:07:08 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:07:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:07:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:07:08 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:07:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:07:09 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:07:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 11:07:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 11:07:09 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:07:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6276 values 99036 bits 12379 bytes 
Fri 17 Jan 2014 11:07:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:07:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:07:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:07:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:07:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:07:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:07:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:07:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:07:15 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:07:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43860376
Fri 17 Jan 2014 11:07:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:07:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43860376
Fri 17 Jan 2014 11:07:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:07:20 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:07:20 - job_xml_thread(): Done retrieving: data size 43860376
Fri 17 Jan 2014 11:07:20 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:07:20 - XML: Start document: iteration 16
Fri 17 Jan 2014 11:07:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:07:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:07:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:07:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:07:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:07:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:07:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:07:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:07:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:07:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:07:31 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:07:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:07:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:07:35 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:07:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 11:07:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:07:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:07:37 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:07:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:07:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:07:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:07:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:07:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:07:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:07:39 - XML: Processed 655486 elements - found 644 jobs
Fri 17 Jan 2014 11:07:39 - job 7347847 report time 1389952972 does not match current heartbeat 1389953093 : ignoring job
Fri 17 Jan 2014 11:07:39 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 11:07:39 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 11:07:39 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:07:39 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:07:40 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 11:07:40 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 11:07:40 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:07:41 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:07:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862427
Fri 17 Jan 2014 11:07:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:07:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862427
Fri 17 Jan 2014 11:07:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:07:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:07:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:07:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:07:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:07:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:07:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:07:53 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:07:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:07:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:07:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:07:53 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:07:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:07:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:07:54 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:07:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:07:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:07:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:07:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:07:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:07:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:07:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:07:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:07:57 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:07:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43866266
Fri 17 Jan 2014 11:07:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:07:58 - job_xml_thread(): Done retrieving: data size 43866266
Fri 17 Jan 2014 11:07:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43866266
Fri 17 Jan 2014 11:07:58 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:07:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:07:58 - XML: Start document: iteration 17
Fri 17 Jan 2014 11:08:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:08:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:08:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:08:09 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:08:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:08:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 11:08:10 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:08:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 11:08:11 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:08:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9121 values 144006 bits 18000 bytes 
Fri 17 Jan 2014 11:08:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:08:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:08:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:08:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:08:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:08:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:08:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:08:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:08:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:08:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:08:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:08:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:08:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:08:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:08:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:08:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:08:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:08:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:08:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:08:20 - XML: Processed 655486 elements - found 644 jobs
Fri 17 Jan 2014 11:08:20 - job 7335111 appears to have finished
Fri 17 Jan 2014 11:08:20 - job 7345925 appears to have finished
Fri 17 Jan 2014 11:08:20 - job 7347815 appears to have finished
Fri 17 Jan 2014 11:08:20 - job 7347899 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 11:08:20 - job 7347914 report time 1389953093 does not match current heartbeat 1389953213 : ignoring job
Fri 17 Jan 2014 11:08:20 - job_xml_thread(): Found 8 updated jobs.
Fri 17 Jan 2014 11:08:20 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 11:08:20 - job_xml_thread(): Done storing. succesfully stored: 8 jobs
Fri 17 Jan 2014 11:08:20 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:08:20 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:08:23 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:08:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43886711
Fri 17 Jan 2014 11:08:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:08:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43886711
Fri 17 Jan 2014 11:08:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:08:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:08:31 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:08:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:08:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:08:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:08:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:08:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:08:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:08:34 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:08:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:08:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:08:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:08:35 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:08:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:08:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:08:35 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:08:36 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:08:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 11:08:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:08:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:08:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:08:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:08:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:08:37 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:08:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43896317
Fri 17 Jan 2014 11:08:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:08:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43896317
Fri 17 Jan 2014 11:08:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:08:39 - job_xml_thread(): Done retrieving: data size 43896317
Fri 17 Jan 2014 11:08:39 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:08:39 - XML: Start document: iteration 18
Fri 17 Jan 2014 11:08:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:08:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:08:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:08:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:08:51 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:08:51 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:08:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:08:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:08:51 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:08:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:08:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:08:56 - XML: Processed 655486 elements - found 644 jobs
Fri 17 Jan 2014 11:08:56 - job 7347914 report time 1389953093 does not match current heartbeat 1389953213 : ignoring job
Fri 17 Jan 2014 11:08:56 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 11:08:56 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 11:08:56 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:08:56 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:08:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:08:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:08:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:08:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:08:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:08:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:08:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:08:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:09:01 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:09:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43838022
Fri 17 Jan 2014 11:09:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:09:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43838022
Fri 17 Jan 2014 11:09:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:09:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:09:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:09:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:09:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:09:11 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:09:11 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:09:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:09:11 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:09:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:09:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:09:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:09:12 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:09:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 11:09:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 11:09:12 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:09:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8900 values 140335 bits 17541 bytes 
Fri 17 Jan 2014 11:09:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:09:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:09:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:09:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:09:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:09:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:09:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:09:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:09:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:09:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:09:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:09:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:09:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:09:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:09:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:09:19 - job_xml_thread(): Done retrieving: data size 43859288
Fri 17 Jan 2014 11:09:19 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:09:19 - XML: Start document: iteration 19
Fri 17 Jan 2014 11:09:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43859288
Fri 17 Jan 2014 11:09:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:09:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43859288
Fri 17 Jan 2014 11:09:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:09:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:09:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:09:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:09:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:09:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:09:34 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:09:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:09:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:09:35 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:09:35 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:09:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:09:35 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:09:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:09:37 - XML: Processed 655486 elements - found 644 jobs
Fri 17 Jan 2014 11:09:38 - job 7347914 report time 1389953093 does not match current heartbeat 1389953213 : ignoring job
Fri 17 Jan 2014 11:09:38 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 11:09:38 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 11:09:38 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:09:38 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:09:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:09:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:09:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:09:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:09:42 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:09:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 11:09:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:09:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:09:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:09:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:09:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:09:44 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:09:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43838777
Fri 17 Jan 2014 11:09:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:09:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43838777
Fri 17 Jan 2014 11:09:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:09:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:09:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:09:53 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:09:53 - job_xml_thread(): Done retrieving: data size 43838777
Fri 17 Jan 2014 11:09:53 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:09:53 - XML: Start document: iteration 20
Fri 17 Jan 2014 11:09:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:09:54 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:09:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:09:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:09:56 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:09:56 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:09:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:09:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:09:56 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:09:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:09:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:10:05 - XML: Processed 655484 elements - found 643 jobs
Fri 17 Jan 2014 11:10:05 - job 7347871 appears to have finished
Fri 17 Jan 2014 11:10:05 - job 7347893 appears to have finished
Fri 17 Jan 2014 11:10:05 - job 7347918 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 11:10:05 - job 7347919 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 11:10:05 - job 7347916 field 'start_timestamp' changed since saved from: 1389953220 to: 1389953177
Fri 17 Jan 2014 11:10:05 - job 7347917 report time 1389953213 does not match current heartbeat 1389953334 : ignoring job
Fri 17 Jan 2014 11:10:05 - job_xml_thread(): Found 7 updated jobs.
Fri 17 Jan 2014 11:10:05 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 11:10:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:10:06 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:10:06 - job_xml_thread(): Done storing. succesfully stored: 7 jobs
Fri 17 Jan 2014 11:10:06 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:10:06 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:10:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:10:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:10:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:10:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:10:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:10:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:10:08 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:10:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855631
Fri 17 Jan 2014 11:10:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:10:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855631
Fri 17 Jan 2014 11:10:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:10:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:10:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:10:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:10:12 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:10:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:10:13 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:10:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 11:10:13 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:10:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 11:10:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9029 values 142420 bits 17802 bytes 
Fri 17 Jan 2014 11:10:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:10:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:10:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:10:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:10:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:10:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:10:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:10:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:10:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:10:22 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:10:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:10:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:10:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:10:23 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:10:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:10:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:10:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:10:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:10:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:10:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:10:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:10:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43876412
Fri 17 Jan 2014 11:10:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:10:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43876412
Fri 17 Jan 2014 11:10:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:10:26 - job_xml_thread(): Done retrieving: data size 43876412
Fri 17 Jan 2014 11:10:26 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:10:26 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 11:10:27 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 11:10:27 - Housekeeping: done.
Fri 17 Jan 2014 11:10:27 - XML: Start document: iteration 0
Fri 17 Jan 2014 11:10:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:10:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:10:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:10:36 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:10:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:10:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:10:37 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:10:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:10:37 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:10:37 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:10:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:10:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:10:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:10:46 - XML: Processed 655484 elements - found 643 jobs
Fri 17 Jan 2014 11:10:46 - job 7347917 report time 1389953213 does not match current heartbeat 1389953334 : ignoring job
Fri 17 Jan 2014 11:10:46 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 11:10:46 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 11:10:46 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:10:46 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:10:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:10:48 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:10:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:10:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:10:48 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:10:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 11:10:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:10:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:10:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:10:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:10:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:10:50 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:10:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43843718
Fri 17 Jan 2014 11:10:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:10:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43843718
Fri 17 Jan 2014 11:10:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:10:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:10:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:11:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:11:01 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:11:01 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:11:01 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:11:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:11:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:11:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:11:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:11:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:11:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:11:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:11:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:11:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:11:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:11:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:11:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:11:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:11:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:11:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:11:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:11:06 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:11:06 - job_xml_thread(): Done retrieving: data size 43882125
Fri 17 Jan 2014 11:11:06 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:11:06 - XML: Start document: iteration 1
Fri 17 Jan 2014 11:11:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43882125
Fri 17 Jan 2014 11:11:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:11:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43882125
Fri 17 Jan 2014 11:11:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:11:13 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 11:11:13 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:11:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:11:14 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:11:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:11:15 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:11:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 11:11:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 11:11:16 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:11:16 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:11:16 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 11:11:16 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:11:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8792 values 138618 bits 17327 bytes 
Fri 17 Jan 2014 11:11:16 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 11:11:16 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 11:11:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:11:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:11:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:11:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Fri 17 Jan 2014 11:11:25 - XML: Processed 655484 elements - found 643 jobs
Fri 17 Jan 2014 11:11:25 - job 7347917 report time 1389953213 does not match current heartbeat 1389953334 : ignoring job
Fri 17 Jan 2014 11:11:25 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 11:11:25 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 11:11:26 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:11:26 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:11:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:11:29 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:11:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:11:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:11:30 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:11:30 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:11:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:11:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:11:30 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:11:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:11:31 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:11:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:11:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:11:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:11:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:11:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:11:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:11:33 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:11:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43323406
Fri 17 Jan 2014 11:11:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:11:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43323406
Fri 17 Jan 2014 11:11:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:11:42 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:11:42 - job_xml_thread(): Done retrieving: data size 43323406
Fri 17 Jan 2014 11:11:42 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:11:42 - XML: Start document: iteration 2
Fri 17 Jan 2014 11:11:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:11:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:11:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:11:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:11:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:11:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:11:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:11:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:11:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:11:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:11:48 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:11:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:11:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:11:54 - XML: Processed 648688 elements - found 647 jobs
Fri 17 Jan 2014 11:11:54 - job 7347920 report time 1389953334 does not match current heartbeat 1389953454 : ignoring job
Fri 17 Jan 2014 11:11:54 - job 7347726 appears to have finished
Fri 17 Jan 2014 11:11:54 - job_xml_thread(): Found 7 updated jobs.
Fri 17 Jan 2014 11:11:54 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 11:11:54 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:11:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 11:11:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:11:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:11:55 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:11:55 - job_xml_thread(): Done storing. succesfully stored: 7 jobs
Fri 17 Jan 2014 11:11:55 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:11:55 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:11:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:11:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:11:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:11:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:11:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:11:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:11:57 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:11:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43203063
Fri 17 Jan 2014 11:11:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:11:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43203063
Fri 17 Jan 2014 11:11:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:12:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:12:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:12:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:12:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:12:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:12:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:12:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:12:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:12:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:12:09 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:12:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:12:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:12:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:12:11 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:12:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:12:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:12:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:12:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43240792
Fri 17 Jan 2014 11:12:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:12:12 - job_xml_thread(): Done retrieving: data size 43240792
Fri 17 Jan 2014 11:12:12 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:12:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:12:12 - XML: Start document: iteration 3
Fri 17 Jan 2014 11:12:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:12:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43240792
Fri 17 Jan 2014 11:12:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:12:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:12:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:12:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:12:15 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:12:16 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:12:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 11:12:16 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:12:16 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:12:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:12:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 11:12:16 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:12:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9298 values 146625 bits 18328 bytes 
Fri 17 Jan 2014 11:12:17 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:12:17 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 11:12:17 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:12:17 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 11:12:17 - Entering storeMetrics(): cluster LISA Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Fri 17 Jan 2014 11:12:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:12:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:12:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:12:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:12:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:12:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:12:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:12:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:12:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:12:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:12:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:12:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:12:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:12:30 - XML: Processed 647612 elements - found 647 jobs
Fri 17 Jan 2014 11:12:30 - job 7347920 report time 1389953334 does not match current heartbeat 1389953454 : ignoring job
Fri 17 Jan 2014 11:12:30 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 11:12:30 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 11:12:30 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:12:30 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:12:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:12:34 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:12:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:12:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:12:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:12:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:12:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:12:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:12:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:12:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43509265
Fri 17 Jan 2014 11:12:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:12:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43509265
Fri 17 Jan 2014 11:12:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:12:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:12:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:12:45 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:12:45 - job_xml_thread(): Done retrieving: data size 43509265
Fri 17 Jan 2014 11:12:45 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:12:45 - XML: Start document: iteration 4
Fri 17 Jan 2014 11:12:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:12:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:12:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:12:56 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:12:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:12:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:12:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:12:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:12:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:12:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:12:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:12:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:12:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:12:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:12:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:12:59 - XML: Processed 651064 elements - found 647 jobs
Fri 17 Jan 2014 11:12:59 - job 7347920 report time 1389953334 does not match current heartbeat 1389953454 : ignoring job
Fri 17 Jan 2014 11:12:59 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 11:12:59 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 11:12:59 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:12:59 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:12:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:12:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:12:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:12:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:12:59 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:12:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 11:12:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:13:01 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:13:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862033
Fri 17 Jan 2014 11:13:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:13:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862033
Fri 17 Jan 2014 11:13:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:13:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:13:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:13:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:13:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:13:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:13:14 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:13:14 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:13:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:13:14 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:13:14 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:13:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:13:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:13:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:13:15 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:13:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:13:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:13:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:13:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:13:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:13:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:13:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:13:16 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:13:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:13:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 11:13:16 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:13:16 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:13:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 11:13:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5661 values 89248 bits 11156 bytes 
Fri 17 Jan 2014 11:13:17 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:13:17 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:13:17 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:13:17 - job_xml_thread(): Done retrieving: data size 43867449
Fri 17 Jan 2014 11:13:17 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:13:17 - XML: Start document: iteration 5
Fri 17 Jan 2014 11:13:17 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:13:17 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:13:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43867449
Fri 17 Jan 2014 11:13:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:13:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867449
Fri 17 Jan 2014 11:13:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:13:17 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 11:13:17 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 11:13:17 - Entering storeMetrics(): cluster LISA Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Fri 17 Jan 2014 11:13:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:13:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:13:30 - XML: Processed 655492 elements - found 647 jobs
Fri 17 Jan 2014 11:13:30 - job 7347920 report time 1389953334 does not match current heartbeat 1389953454 : ignoring job
Fri 17 Jan 2014 11:13:30 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 11:13:30 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 11:13:30 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:13:30 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:13:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:13:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:13:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:13:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:13:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:13:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:13:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:13:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:13:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:13:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:13:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:13:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:13:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:13:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:13:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:13:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:13:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:13:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:13:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:13:41 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:13:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 11:13:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:13:41 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:13:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862669
Fri 17 Jan 2014 11:13:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:13:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862669
Fri 17 Jan 2014 11:13:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:13:45 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:13:45 - job_xml_thread(): Done retrieving: data size 43862669
Fri 17 Jan 2014 11:13:45 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:13:45 - XML: Start document: iteration 6
Fri 17 Jan 2014 11:13:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:13:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:13:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:13:54 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:13:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:13:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:13:54 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:13:54 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:13:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:13:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:13:55 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:13:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:13:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:13:59 - XML: Processed 655494 elements - found 649 jobs
Fri 17 Jan 2014 11:13:59 - job 7347788 appears to have finished
Fri 17 Jan 2014 11:13:59 - job 7347931 report time 1389953454 does not match current heartbeat 1389953575 : ignoring job
Fri 17 Jan 2014 11:13:59 - job 7347903 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 11:13:59 - job 7347817 appears to have finished
Fri 17 Jan 2014 11:13:59 - job_xml_thread(): Found 8 updated jobs.
Fri 17 Jan 2014 11:13:59 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 11:14:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:14:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:14:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:14:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:14:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:14:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:14:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:14:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:14:03 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 11:14:03 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 11:14:03 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:14:04 - job_xml_thread(): Done storing. succesfully stored: 8 jobs
Fri 17 Jan 2014 11:14:04 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:14:04 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:14:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:14:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43854240
Fri 17 Jan 2014 11:14:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:14:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43854240
Fri 17 Jan 2014 11:14:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:14:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:14:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:14:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:14:16 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:14:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:14:16 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:14:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:14:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:14:17 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:14:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:14:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:14:18 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:14:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 11:14:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:14:18 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:14:18 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:14:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 11:14:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6825 values 107576 bits 13447 bytes 
Fri 17 Jan 2014 11:14:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:14:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:14:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:14:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:14:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:14:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:14:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:14:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:14:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:14:19 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:14:19 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:14:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:14:19 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 11:14:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:14:19 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 11:14:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:14:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:14:19 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 11:14:19 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:14:20 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 1056180 values 16659675 bits 2082459 bytes 
Fri 17 Jan 2014 11:14:20 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:14:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 11:14:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:14:23 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:14:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43896766
Fri 17 Jan 2014 11:14:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:14:23 - job_xml_thread(): Done retrieving: data size 43896766
Fri 17 Jan 2014 11:14:23 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:14:23 - XML: Start document: iteration 7
Fri 17 Jan 2014 11:14:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43896766
Fri 17 Jan 2014 11:14:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:14:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:14:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:14:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:14:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:14:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:14:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:14:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:14:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:14:42 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:14:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:14:42 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:14:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:14:42 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:14:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:14:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:14:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:14:47 - XML: Processed 655496 elements - found 649 jobs
Fri 17 Jan 2014 11:14:47 - job 7347931 report time 1389953454 does not match current heartbeat 1389953575 : ignoring job
Fri 17 Jan 2014 11:14:47 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 11:14:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:14:47 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 11:14:47 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:14:47 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:14:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:14:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:14:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:14:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:14:50 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:14:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43869926
Fri 17 Jan 2014 11:14:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:14:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43869926
Fri 17 Jan 2014 11:14:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:14:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:14:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:14:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:14:58 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:14:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:14:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:15:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:15:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:15:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43869926
Fri 17 Jan 2014 11:15:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:15:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:15:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:15:02 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:15:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:15:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:15:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:15:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:15:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:15:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:15:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:15:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:15:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:15:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:15:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:15:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:15:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:15:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:15:12 - job_xml_thread(): Done retrieving: data size 43862377
Fri 17 Jan 2014 11:15:12 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:15:12 - XML: Start document: iteration 8
Fri 17 Jan 2014 11:15:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862377
Fri 17 Jan 2014 11:15:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:15:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:15:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:15:16 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:15:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:15:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862377
Fri 17 Jan 2014 11:15:16 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:15:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:15:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:15:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:15:18 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:15:19 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:15:20 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 11:15:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:15:20 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:15:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 11:15:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 11:15:20 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:15:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148552 bits 18569 bytes 
Fri 17 Jan 2014 11:15:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:15:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:15:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:15:29 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:15:31 - XML: Processed 655493 elements - found 649 jobs
Fri 17 Jan 2014 11:15:31 - job 7347931 report time 1389953454 does not match current heartbeat 1389953575 : ignoring job
Fri 17 Jan 2014 11:15:31 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 11:15:31 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 11:15:31 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:15:31 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:15:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:15:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:15:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:15:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:15:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:15:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:15:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:15:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:15:35 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:15:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:15:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:15:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:15:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:15:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:15:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:15:37 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:15:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43892140
Fri 17 Jan 2014 11:15:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:15:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43892140
Fri 17 Jan 2014 11:15:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:15:46 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:15:46 - job_xml_thread(): Done retrieving: data size 43892140
Fri 17 Jan 2014 11:15:46 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:15:46 - XML: Start document: iteration 9
Fri 17 Jan 2014 11:15:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:15:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:15:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:15:49 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:15:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:15:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:15:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:15:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:15:49 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:15:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:15:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:15:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:15:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:15:51 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:15:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 11:15:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:15:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:15:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:15:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:15:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:15:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:15:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:15:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:15:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:15:57 - XML: Processed 655490 elements - found 646 jobs
Fri 17 Jan 2014 11:15:57 - job 7347924 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 11:15:57 - job 7347935 report time 1389953575 does not match current heartbeat 1389953695 : ignoring job
Fri 17 Jan 2014 11:15:57 - job 7347936 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 11:15:57 - job 7347937 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 11:15:57 - job 7347903 field 'start_timestamp' changed since saved from: 1389953599 to: 1389953543
Fri 17 Jan 2014 11:15:57 - job 7347822 appears to have finished
Fri 17 Jan 2014 11:15:57 - job 7347827 appears to have finished
Fri 17 Jan 2014 11:15:57 - job 7347699 appears to have finished
Fri 17 Jan 2014 11:15:57 - job_xml_thread(): Found 8 updated jobs.
Fri 17 Jan 2014 11:15:57 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 11:15:57 - job_xml_thread(): Done storing. succesfully stored: 8 jobs
Fri 17 Jan 2014 11:15:57 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:15:57 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:15:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:15:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43845628
Fri 17 Jan 2014 11:15:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:15:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43845628
Fri 17 Jan 2014 11:15:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:16:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:16:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:16:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:16:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:16:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:16:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:16:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:16:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:16:12 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:16:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:16:12 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:16:12 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:16:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:16:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:16:13 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:16:13 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:16:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:16:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:16:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:16:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:16:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:16:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:16:14 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:16:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873300
Fri 17 Jan 2014 11:16:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:16:15 - job_xml_thread(): Done retrieving: data size 43873300
Fri 17 Jan 2014 11:16:15 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:16:15 - XML: Start document: iteration 10
Fri 17 Jan 2014 11:16:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873300
Fri 17 Jan 2014 11:16:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:16:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:16:20 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:16:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:16:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 11:16:22 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:16:22 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:16:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 11:16:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9188 values 145022 bits 18127 bytes 
Fri 17 Jan 2014 11:16:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:16:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:16:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:16:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:16:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:16:29 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:16:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:16:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:16:29 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:16:29 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:16:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:16:29 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:16:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:16:35 - XML: Processed 655490 elements - found 646 jobs
Fri 17 Jan 2014 11:16:35 - job 7347935 report time 1389953575 does not match current heartbeat 1389953695 : ignoring job
Fri 17 Jan 2014 11:16:35 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 11:16:35 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 11:16:35 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:16:35 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:16:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:16:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:16:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:16:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:16:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:16:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:16:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:16:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:16:41 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:16:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862680
Fri 17 Jan 2014 11:16:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:16:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862680
Fri 17 Jan 2014 11:16:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:16:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:16:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:16:50 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:16:50 - job_xml_thread(): Done retrieving: data size 43862680
Fri 17 Jan 2014 11:16:50 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:16:50 - XML: Start document: iteration 11
Fri 17 Jan 2014 11:16:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:16:53 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:16:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:16:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:16:54 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:16:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:16:54 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:16:54 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:16:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:16:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:16:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:17:00 - XML: Processed 655490 elements - found 646 jobs
Fri 17 Jan 2014 11:17:00 - job 7347935 report time 1389953575 does not match current heartbeat 1389953695 : ignoring job
Fri 17 Jan 2014 11:17:00 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 11:17:00 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 11:17:01 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:17:01 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:17:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:17:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:17:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:17:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:17:05 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:17:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 11:17:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:17:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:17:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:17:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:17:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:17:07 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:17:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43863156
Fri 17 Jan 2014 11:17:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:17:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43863156
Fri 17 Jan 2014 11:17:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:17:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:17:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:17:16 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:17:16 - job_xml_thread(): Done retrieving: data size 43863156
Fri 17 Jan 2014 11:17:16 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:17:16 - XML: Start document: iteration 12
Fri 17 Jan 2014 11:17:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:17:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:17:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:17:21 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:17:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:17:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:17:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:17:22 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:17:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:17:23 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:17:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:17:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:17:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:17:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:17:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:17:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:17:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:17:24 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:17:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 11:17:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 11:17:24 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:17:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:17:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5690 values 89954 bits 11244 bytes 
Fri 17 Jan 2014 11:17:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:17:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:17:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:17:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:17:27 - XML: Processed 655490 elements - found 646 jobs
Fri 17 Jan 2014 11:17:27 - job 7347935 report time 1389953575 does not match current heartbeat 1389953695 : ignoring job
Fri 17 Jan 2014 11:17:27 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 11:17:27 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 11:17:27 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:17:27 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:17:30 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:17:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43743465
Fri 17 Jan 2014 11:17:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:17:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43743465
Fri 17 Jan 2014 11:17:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:17:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:17:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:17:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:17:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:17:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:17:41 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:17:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:17:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:17:42 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:17:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:17:42 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:17:42 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:17:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:17:42 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:17:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:17:45 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:17:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:17:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:17:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:17:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:17:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:17:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:17:45 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:17:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 11:17:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:17:47 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:17:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43268698
Fri 17 Jan 2014 11:17:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:17:48 - job_xml_thread(): Done retrieving: data size 43268698
Fri 17 Jan 2014 11:17:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43268698
Fri 17 Jan 2014 11:17:48 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:17:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:17:49 - XML: Start document: iteration 13
Fri 17 Jan 2014 11:17:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:17:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:17:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:17:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:18:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:18:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:18:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:18:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:18:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:18:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:18:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:18:06 - XML: Processed 648018 elements - found 645 jobs
Fri 17 Jan 2014 11:18:06 - job 7347927 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 11:18:06 - job 7347897 appears to have finished
Fri 17 Jan 2014 11:18:06 - job 7347939 report time 1389953695 does not match current heartbeat 1389953816 : ignoring job
Fri 17 Jan 2014 11:18:06 - job 7347899 appears to have finished
Fri 17 Jan 2014 11:18:07 - job_xml_thread(): Found 5 updated jobs.
Fri 17 Jan 2014 11:18:07 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 11:18:09 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Fri 17 Jan 2014 11:18:09 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:18:09 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:18:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:18:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:18:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:18:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:18:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:18:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:18:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:18:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:18:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:18:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43229803
Fri 17 Jan 2014 11:18:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:18:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43229803
Fri 17 Jan 2014 11:18:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:18:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:18:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:18:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:18:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:18:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:18:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:18:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:18:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:18:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:18:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43229803
Fri 17 Jan 2014 11:18:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:18:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:18:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:18:24 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:18:24 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:18:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:18:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:18:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:18:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:18:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 11:18:26 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:18:26 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:18:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 11:18:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8959 values 141607 bits 17700 bytes 
Fri 17 Jan 2014 11:18:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:18:32 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:18:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:18:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:18:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:18:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:18:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:18:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:18:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:18:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:18:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:18:36 - job_xml_thread(): Done retrieving: data size 43303877
Fri 17 Jan 2014 11:18:36 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:18:36 - XML: Start document: iteration 14
Fri 17 Jan 2014 11:18:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:18:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:18:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43303877
Fri 17 Jan 2014 11:18:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:18:37 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:18:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:18:37 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:18:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:18:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43303877
Fri 17 Jan 2014 11:18:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:18:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:18:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:18:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:18:50 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:18:51 - XML: Processed 648566 elements - found 645 jobs
Fri 17 Jan 2014 11:18:51 - job 7347939 report time 1389953695 does not match current heartbeat 1389953816 : ignoring job
Fri 17 Jan 2014 11:18:51 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 11:18:51 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 11:18:51 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:18:51 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:18:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:18:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:18:53 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:18:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:18:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:18:53 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:18:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:18:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:18:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:18:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:18:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:18:54 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:18:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 11:18:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:18:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:18:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:18:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:18:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:18:56 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:18:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43854493
Fri 17 Jan 2014 11:18:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:18:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43854493
Fri 17 Jan 2014 11:18:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:19:06 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:19:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:19:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:19:07 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:19:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:19:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:19:08 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:19:08 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:19:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:19:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:19:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:19:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:19:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:19:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:19:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:19:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:19:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:19:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:19:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:19:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:19:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:19:12 - job_xml_thread(): Done retrieving: data size 43869818
Fri 17 Jan 2014 11:19:12 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:19:12 - XML: Start document: iteration 15
Fri 17 Jan 2014 11:19:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43869818
Fri 17 Jan 2014 11:19:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:19:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43869818
Fri 17 Jan 2014 11:19:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:19:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:19:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:19:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:19:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:19:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:19:27 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:19:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:19:28 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:19:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 11:19:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 11:19:28 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:19:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8847 values 139624 bits 17453 bytes 
Fri 17 Jan 2014 11:19:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:19:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:19:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:19:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:19:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:19:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:19:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:19:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:19:31 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:19:33 - XML: Processed 655488 elements - found 645 jobs
Fri 17 Jan 2014 11:19:33 - job 7347939 report time 1389953695 does not match current heartbeat 1389953816 : ignoring job
Fri 17 Jan 2014 11:19:33 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 11:19:33 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 11:19:33 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:19:33 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:19:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:19:35 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:19:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:19:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:19:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:19:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:19:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:19:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:19:38 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:19:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 11:19:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:19:38 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:19:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870510
Fri 17 Jan 2014 11:19:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:19:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870510
Fri 17 Jan 2014 11:19:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:19:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:19:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:19:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:19:48 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:19:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:19:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:19:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:19:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:19:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:19:48 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:19:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:19:48 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:19:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:19:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:19:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:19:52 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:19:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:19:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:19:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:19:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:19:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:19:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:19:54 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:19:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43880812
Fri 17 Jan 2014 11:19:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:19:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43880812
Fri 17 Jan 2014 11:19:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:19:55 - job_xml_thread(): Done retrieving: data size 43880812
Fri 17 Jan 2014 11:19:55 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:19:55 - XML: Start document: iteration 16
Fri 17 Jan 2014 11:20:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:20:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:20:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:20:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:20:12 - XML: Processed 655488 elements - found 645 jobs
Fri 17 Jan 2014 11:20:12 - job 7347940 report time 1389953816 does not match current heartbeat 1389953937 : ignoring job
Fri 17 Jan 2014 11:20:12 - job 7347929 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 11:20:12 - job 7347930 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 11:20:12 - job 7347831 appears to have finished
Fri 17 Jan 2014 11:20:12 - job 7347855 appears to have finished
Fri 17 Jan 2014 11:20:12 - job_xml_thread(): Found 7 updated jobs.
Fri 17 Jan 2014 11:20:12 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 11:20:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:20:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:20:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:20:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:20:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:20:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:20:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:20:14 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:20:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:20:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:20:15 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:20:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:20:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:20:15 - job_xml_thread(): Done storing. succesfully stored: 7 jobs
Fri 17 Jan 2014 11:20:15 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:20:15 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:20:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:20:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:20:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:20:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:20:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:20:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865439
Fri 17 Jan 2014 11:20:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:20:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43865439
Fri 17 Jan 2014 11:20:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:20:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:20:28 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:20:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:20:28 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:20:29 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:20:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:20:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 11:20:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 11:20:29 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:20:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148679 bits 18584 bytes 
Fri 17 Jan 2014 11:20:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:20:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:20:30 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:20:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:20:30 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:20:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:20:30 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:20:31 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:20:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:20:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:20:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:20:31 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:20:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:20:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:20:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:20:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:20:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:20:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:20:34 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:20:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870588
Fri 17 Jan 2014 11:20:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:20:35 - job_xml_thread(): Done retrieving: data size 43870588
Fri 17 Jan 2014 11:20:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870588
Fri 17 Jan 2014 11:20:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:20:35 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:20:35 - XML: Start document: iteration 17
Fri 17 Jan 2014 11:20:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:20:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:20:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:20:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:20:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:20:49 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:20:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:20:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:20:50 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:20:50 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:20:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:20:50 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:20:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:20:52 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:20:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 11:20:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:20:56 - XML: Processed 655488 elements - found 645 jobs
Fri 17 Jan 2014 11:20:56 - job 7347940 report time 1389953816 does not match current heartbeat 1389953937 : ignoring job
Fri 17 Jan 2014 11:20:56 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 11:20:56 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 11:20:56 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:20:56 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:20:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:20:57 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:20:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:20:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:20:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:20:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:20:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:20:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:20:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:20:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43847874
Fri 17 Jan 2014 11:20:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:21:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43847874
Fri 17 Jan 2014 11:21:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:21:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:21:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:21:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:21:09 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:21:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:21:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:21:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:21:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:21:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:21:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:21:10 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:21:11 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:21:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:21:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:21:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:21:13 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:21:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:21:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:21:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:21:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:21:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:21:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:21:15 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:21:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43854860
Fri 17 Jan 2014 11:21:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:21:16 - job_xml_thread(): Done retrieving: data size 43854860
Fri 17 Jan 2014 11:21:16 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:21:16 - XML: Start document: iteration 18
Fri 17 Jan 2014 11:21:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43854860
Fri 17 Jan 2014 11:21:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:21:21 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 11:21:22 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:21:23 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:21:23 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 11:21:23 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:21:23 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 11:21:24 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 11:21:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:21:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Fri 17 Jan 2014 11:21:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:21:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:21:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:21:29 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:21:30 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:21:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:21:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 11:21:30 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:21:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 11:21:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9017 values 142236 bits 17779 bytes 
Fri 17 Jan 2014 11:21:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:21:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:21:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:21:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:21:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:21:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:21:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:21:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:21:34 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:21:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:21:37 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:21:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:21:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:21:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:21:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:21:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:21:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:21:39 - XML: Processed 655488 elements - found 645 jobs
Fri 17 Jan 2014 11:21:39 - job 7347940 report time 1389953816 does not match current heartbeat 1389953937 : ignoring job
Fri 17 Jan 2014 11:21:39 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 11:21:39 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 11:21:39 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:21:39 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:21:41 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:21:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43876378
Fri 17 Jan 2014 11:21:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:21:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43876378
Fri 17 Jan 2014 11:21:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:21:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:21:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:21:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:21:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:21:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:21:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:21:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:21:54 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:21:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:21:54 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:21:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:21:54 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:21:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:21:54 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:21:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:21:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:21:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:21:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:21:56 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:21:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 11:21:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:21:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:21:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:21:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:21:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:21:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:21:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43861820
Fri 17 Jan 2014 11:21:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:21:59 - job_xml_thread(): Done retrieving: data size 43861820
Fri 17 Jan 2014 11:21:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43861820
Fri 17 Jan 2014 11:21:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:21:59 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:21:59 - XML: Start document: iteration 19
Fri 17 Jan 2014 11:22:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:22:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:22:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:22:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:22:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:22:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:22:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:22:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:22:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:22:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:22:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:22:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:22:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:22:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:22:20 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:22:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:22:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:22:20 - XML: Processed 655494 elements - found 648 jobs
Fri 17 Jan 2014 11:22:20 - job 7347948 report time 1389953937 does not match current heartbeat 1389954057 : ignoring job
Fri 17 Jan 2014 11:22:20 - job 7347927 appears to have finished
Fri 17 Jan 2014 11:22:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:22:20 - job 7347924 appears to have finished
Fri 17 Jan 2014 11:22:20 - job 7347816 appears to have finished
Fri 17 Jan 2014 11:22:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:22:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:22:21 - job_xml_thread(): Found 10 updated jobs.
Fri 17 Jan 2014 11:22:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:22:21 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 11:22:21 - job_xml_thread(): Done storing. succesfully stored: 10 jobs
Fri 17 Jan 2014 11:22:21 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:22:21 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:22:22 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:22:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43868427
Fri 17 Jan 2014 11:22:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:22:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43868427
Fri 17 Jan 2014 11:22:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:22:24 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:22:24 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:22:27 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:22:27 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 11:22:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:22:28 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:22:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:22:28 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 11:22:28 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 11:22:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:22:31 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:22:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:22:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 11:22:33 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:22:33 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:22:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:22:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:22:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 11:22:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:22:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:22:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8925 values 140753 bits 17594 bytes 
Fri 17 Jan 2014 11:22:33 - size of cluster 'LISA Cluster': 624 hosts 79477 metrics 1019075 values 16091760 bits 2011470 bytes 
Fri 17 Jan 2014 11:22:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:22:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:22:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:22:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:22:34 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:22:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:22:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:22:36 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:22:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:22:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:22:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:22:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:22:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:22:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:22:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:22:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:22:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:22:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43857243
Fri 17 Jan 2014 11:22:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:22:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43857243
Fri 17 Jan 2014 11:22:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:22:44 - job_xml_thread(): Done retrieving: data size 43857243
Fri 17 Jan 2014 11:22:44 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:22:44 - XML: Start document: iteration 20
Fri 17 Jan 2014 11:22:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:22:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:22:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:22:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:23:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:23:03 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:23:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:23:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:23:06 - XML: Processed 655482 elements - found 648 jobs
Fri 17 Jan 2014 11:23:06 - job 7347948 report time 1389953937 does not match current heartbeat 1389954057 : ignoring job
Fri 17 Jan 2014 11:23:06 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 11:23:06 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 11:23:06 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:23:06 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:23:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:23:07 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:23:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:23:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:23:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:23:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:23:07 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:23:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:23:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:23:07 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:23:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:23:07 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:23:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:23:07 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:23:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 11:23:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:23:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:23:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43815851
Fri 17 Jan 2014 11:23:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:23:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43815851
Fri 17 Jan 2014 11:23:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:23:22 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:23:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:23:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:23:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:23:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:23:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:23:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:23:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:23:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:23:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:23:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:23:28 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:23:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:23:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:23:29 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:23:29 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 11:23:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:23:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:23:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:23:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:23:29 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:23:29 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:23:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:23:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:23:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:23:32 - job_xml_thread(): Done retrieving: data size 43783929
Fri 17 Jan 2014 11:23:32 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:23:32 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 11:23:32 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 11:23:32 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 11:23:32 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:23:32 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 11:23:32 - Housekeeping: done.
Fri 17 Jan 2014 11:23:32 - XML: Start document: iteration 0
Fri 17 Jan 2014 11:23:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43783929
Fri 17 Jan 2014 11:23:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:23:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:23:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43783929
Fri 17 Jan 2014 11:23:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:23:34 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:23:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:23:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 11:23:34 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:23:34 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:23:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 11:23:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5831 values 91954 bits 11494 bytes 
Fri 17 Jan 2014 11:23:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:23:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:23:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:23:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:23:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:23:48 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:23:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:23:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:23:50 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:23:50 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:23:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:23:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:23:50 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:23:54 - XML: Processed 654742 elements - found 646 jobs
Fri 17 Jan 2014 11:23:54 - job 7347951 field 'start_timestamp' changed since saved from: 1389954100 to: 1389954030
Fri 17 Jan 2014 11:23:54 - job 7347954 field 'start_timestamp' changed since saved from: 1389954106 to: 1389954030
Fri 17 Jan 2014 11:23:54 - job 7347955 report time 1389954057 does not match current heartbeat 1389954178 : ignoring job
Fri 17 Jan 2014 11:23:54 - job 7347929 appears to have finished
Fri 17 Jan 2014 11:23:54 - job 7347824 appears to have finished
Fri 17 Jan 2014 11:23:54 - job 7347843 appears to have finished
Fri 17 Jan 2014 11:23:54 - job_xml_thread(): Found 7 updated jobs.
Fri 17 Jan 2014 11:23:54 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 11:23:56 - job_xml_thread(): Done storing. succesfully stored: 7 jobs
Fri 17 Jan 2014 11:23:56 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:23:56 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:23:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:23:57 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:23:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:23:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:23:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:23:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:23:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:23:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:24:00 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:24:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43188652
Fri 17 Jan 2014 11:24:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:24:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43188652
Fri 17 Jan 2014 11:24:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:24:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:24:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:24:11 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:24:11 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:24:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:24:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:24:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:24:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:24:12 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:24:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 11:24:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:24:12 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:24:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:24:12 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:24:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:24:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:24:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:24:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:24:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:24:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:24:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:24:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:24:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:24:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:24:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:24:16 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:24:16 - job_xml_thread(): Done retrieving: data size 43262322
Fri 17 Jan 2014 11:24:16 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:24:16 - XML: Start document: iteration 1
Fri 17 Jan 2014 11:24:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43262322
Fri 17 Jan 2014 11:24:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:24:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43262322
Fri 17 Jan 2014 11:24:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:24:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:24:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:24:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:24:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:24:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:24:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:24:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:24:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:24:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:24:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:24:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:24:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:24:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:24:34 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:24:34 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:24:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:24:35 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:24:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 11:24:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 11:24:35 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:24:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6205 values 97852 bits 12231 bytes 
Fri 17 Jan 2014 11:24:40 - XML: Processed 648038 elements - found 646 jobs
Fri 17 Jan 2014 11:24:40 - job 7347955 report time 1389954057 does not match current heartbeat 1389954178 : ignoring job
Fri 17 Jan 2014 11:24:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:24:40 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 11:24:40 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 11:24:40 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:24:40 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:24:40 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:24:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:24:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:24:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:24:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:24:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:24:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:24:42 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:24:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43647979
Fri 17 Jan 2014 11:24:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:24:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43647979
Fri 17 Jan 2014 11:24:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:24:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:24:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:24:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:24:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:24:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:24:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:24:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:24:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:24:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43647979
Fri 17 Jan 2014 11:24:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:24:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:24:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:24:55 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:24:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:24:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:24:55 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:25:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:25:01 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:25:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:25:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:25:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:25:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:25:05 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:25:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 11:25:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:25:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:25:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:25:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:25:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:25:06 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:25:06 - job_xml_thread(): Done retrieving: data size 43850729
Fri 17 Jan 2014 11:25:06 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:25:06 - XML: Start document: iteration 2
Fri 17 Jan 2014 11:25:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43850729
Fri 17 Jan 2014 11:25:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:25:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:25:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:25:08 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:25:08 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:25:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:25:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:25:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43850729
Fri 17 Jan 2014 11:25:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:25:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:25:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:25:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:25:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:25:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:25:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:25:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:25:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:25:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:25:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:25:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:25:25 - XML: Processed 655484 elements - found 646 jobs
Fri 17 Jan 2014 11:25:25 - job 7347955 report time 1389954057 does not match current heartbeat 1389954178 : ignoring job
Fri 17 Jan 2014 11:25:25 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 11:25:25 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 11:25:25 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:25:25 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:25:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:25:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:25:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:25:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:25:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:25:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:25:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:25:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:25:30 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:25:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43852187
Fri 17 Jan 2014 11:25:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:25:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43852187
Fri 17 Jan 2014 11:25:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:25:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:25:36 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:25:37 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:25:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 11:25:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:25:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 11:25:38 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:25:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9042 values 142652 bits 17831 bytes 
Fri 17 Jan 2014 11:25:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:25:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:25:40 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:25:40 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:25:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:25:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:25:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:25:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:25:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:25:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:25:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:25:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:25:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:25:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:25:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:25:46 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:25:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:25:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:25:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:25:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:25:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:25:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:25:48 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:25:48 - job_xml_thread(): Done retrieving: data size 43857888
Fri 17 Jan 2014 11:25:48 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:25:48 - XML: Start document: iteration 3
Fri 17 Jan 2014 11:25:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43857888
Fri 17 Jan 2014 11:25:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:25:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43857888
Fri 17 Jan 2014 11:25:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:25:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:25:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:25:59 - XML: Processed 655488 elements - found 645 jobs
Fri 17 Jan 2014 11:26:00 - job 7347952 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 11:26:00 - job 7347956 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 11:26:00 - job 7347797 appears to have finished
Fri 17 Jan 2014 11:26:00 - job 7347930 appears to have finished
Fri 17 Jan 2014 11:26:00 - job 7343936 report time 1389954178 does not match current heartbeat 1389954298 : ignoring job
Fri 17 Jan 2014 11:26:00 - job 7347962 report time 1389954178 does not match current heartbeat 1389954298 : ignoring job
Fri 17 Jan 2014 11:26:00 - job 7335198 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 11:26:00 - job_xml_thread(): Found 7 updated jobs.
Fri 17 Jan 2014 11:26:00 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 11:26:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:26:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:26:07 - job_xml_thread(): Done storing. succesfully stored: 7 jobs
Fri 17 Jan 2014 11:26:07 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:26:07 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:26:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:26:07 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:26:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:26:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:26:07 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:26:07 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:26:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:26:07 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:26:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:26:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:26:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:26:10 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:26:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 11:26:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:26:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:26:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:26:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:26:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:26:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:26:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:26:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:26:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858427
Fri 17 Jan 2014 11:26:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:26:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43858427
Fri 17 Jan 2014 11:26:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:26:22 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:26:22 - job_xml_thread(): Done retrieving: data size 43858427
Fri 17 Jan 2014 11:26:22 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:26:22 - XML: Start document: iteration 4
Fri 17 Jan 2014 11:26:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:26:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:26:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:26:25 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:26:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:26:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:26:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:26:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:26:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:26:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:26:27 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:26:27 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:26:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:26:33 - XML: Processed 655488 elements - found 645 jobs
Fri 17 Jan 2014 11:26:33 - job 7343936 report time 1389954178 does not match current heartbeat 1389954298 : ignoring job
Fri 17 Jan 2014 11:26:33 - job 7347962 report time 1389954178 does not match current heartbeat 1389954298 : ignoring job
Fri 17 Jan 2014 11:26:33 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 11:26:33 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 11:26:33 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:26:33 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:26:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:26:35 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:26:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:26:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:26:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:26:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:26:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:26:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:26:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:26:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43869102
Fri 17 Jan 2014 11:26:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:26:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43869102
Fri 17 Jan 2014 11:26:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:26:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:26:38 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:26:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:26:38 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:26:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 11:26:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 11:26:39 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:26:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9085 values 143288 bits 17911 bytes 
Fri 17 Jan 2014 11:26:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:26:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:26:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:26:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:26:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:26:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:26:47 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:26:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:26:47 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:26:47 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:26:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:26:48 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:26:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:26:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:26:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:26:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:26:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:26:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:26:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:26:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:26:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:26:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:26:53 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:26:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 11:26:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:26:54 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:26:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867895
Fri 17 Jan 2014 11:26:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:26:54 - job_xml_thread(): Done retrieving: data size 43867895
Fri 17 Jan 2014 11:26:54 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:26:55 - XML: Start document: iteration 5
Fri 17 Jan 2014 11:26:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43867895
Fri 17 Jan 2014 11:26:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:27:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:27:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:27:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:27:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:27:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:27:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:27:06 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:27:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:27:06 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:27:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:27:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:27:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:27:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:27:10 - XML: Processed 655487 elements - found 645 jobs
Fri 17 Jan 2014 11:27:10 - job 7343936 report time 1389954178 does not match current heartbeat 1389954298 : ignoring job
Fri 17 Jan 2014 11:27:10 - job 7347962 report time 1389954178 does not match current heartbeat 1389954298 : ignoring job
Fri 17 Jan 2014 11:27:10 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 11:27:10 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 11:27:10 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:27:10 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:27:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:27:15 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:27:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:27:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:27:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:27:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:27:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:27:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:27:17 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:27:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43852847
Fri 17 Jan 2014 11:27:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:27:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43852847
Fri 17 Jan 2014 11:27:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:27:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:27:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:27:25 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:27:25 - job_xml_thread(): Done retrieving: data size 43852847
Fri 17 Jan 2014 11:27:25 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:27:25 - XML: Start document: iteration 6
Fri 17 Jan 2014 11:27:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:27:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:27:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:27:31 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:27:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:27:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:27:32 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:27:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:27:32 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:27:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:27:32 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:27:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:27:39 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:27:39 - XML: Processed 655488 elements - found 645 jobs
Fri 17 Jan 2014 11:27:40 - job 7343936 report time 1389954178 does not match current heartbeat 1389954298 : ignoring job
Fri 17 Jan 2014 11:27:40 - job 7347962 report time 1389954178 does not match current heartbeat 1389954298 : ignoring job
Fri 17 Jan 2014 11:27:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:27:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 11:27:40 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 11:27:40 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:27:40 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:27:40 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 11:27:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 11:27:40 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:27:40 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:27:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99066 bits 12383 bytes 
Fri 17 Jan 2014 11:27:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:27:40 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:27:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:27:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:27:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:27:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:27:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:27:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:27:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:27:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43839462
Fri 17 Jan 2014 11:27:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:27:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43839462
Fri 17 Jan 2014 11:27:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:27:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:27:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:27:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:27:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:27:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:27:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:27:53 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:27:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:27:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:27:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:27:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43839462
Fri 17 Jan 2014 11:27:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:27:55 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:27:55 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:27:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:27:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:28:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:28:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:28:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:28:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:28:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:28:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:28:05 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:28:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 11:28:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:28:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:28:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:28:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:28:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:28:07 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:28:07 - job_xml_thread(): Done retrieving: data size 43860234
Fri 17 Jan 2014 11:28:07 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:28:07 - XML: Start document: iteration 7
Fri 17 Jan 2014 11:28:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:28:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:28:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43860234
Fri 17 Jan 2014 11:28:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:28:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:28:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:28:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43860234
Fri 17 Jan 2014 11:28:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:28:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:28:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:28:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:28:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:28:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:28:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:28:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:28:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:28:27 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:28:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:28:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:28:27 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:28:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:28:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:28:31 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:28:31 - XML: Processed 655482 elements - found 642 jobs
Fri 17 Jan 2014 11:28:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:28:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:28:31 - job 7346742 appears to have finished
Fri 17 Jan 2014 11:28:31 - job 7347901 appears to have finished
Fri 17 Jan 2014 11:28:31 - job 7347903 appears to have finished
Fri 17 Jan 2014 11:28:31 - job 7347965 report time 1389954298 does not match current heartbeat 1389954419 : ignoring job
Fri 17 Jan 2014 11:28:31 - job_xml_thread(): Found 5 updated jobs.
Fri 17 Jan 2014 11:28:31 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 11:28:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:28:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:28:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:28:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:28:31 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Fri 17 Jan 2014 11:28:31 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:28:31 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:28:33 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:28:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43869885
Fri 17 Jan 2014 11:28:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43869885
Fri 17 Jan 2014 11:28:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:28:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:28:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:28:40 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:28:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:28:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 11:28:41 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:28:41 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:28:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 11:28:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8995 values 141887 bits 17735 bytes 
Fri 17 Jan 2014 11:28:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:28:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:28:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:28:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:28:46 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:28:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:28:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:28:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:28:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:28:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:28:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:28:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:28:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:28:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:28:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:28:48 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:28:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:28:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:28:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:28:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:28:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:28:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:28:50 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:28:50 - job_xml_thread(): Done retrieving: data size 43886390
Fri 17 Jan 2014 11:28:50 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:28:50 - XML: Start document: iteration 8
Fri 17 Jan 2014 11:28:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43886390
Fri 17 Jan 2014 11:28:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:28:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43886390
Fri 17 Jan 2014 11:28:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:29:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:29:01 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:29:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:29:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:29:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:29:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:29:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:29:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:29:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:29:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:29:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:29:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:29:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:29:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:29:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:29:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:29:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:29:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:29:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:29:11 - XML: Processed 655482 elements - found 642 jobs
Fri 17 Jan 2014 11:29:11 - job 7347965 report time 1389954298 does not match current heartbeat 1389954419 : ignoring job
Fri 17 Jan 2014 11:29:11 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 11:29:11 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 11:29:11 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:29:11 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:29:11 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:29:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 11:29:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:29:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:29:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43796401
Fri 17 Jan 2014 11:29:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:29:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43796401
Fri 17 Jan 2014 11:29:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:29:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:29:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:29:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:29:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:29:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:29:25 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:29:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:29:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:29:26 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:29:26 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:29:26 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:29:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:29:27 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:29:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:29:29 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 11:29:29 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:29:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:29:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:29:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:29:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:29:30 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:29:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:29:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:29:30 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:29:30 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 11:29:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:29:30 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 11:29:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:29:30 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 11:29:31 - size of cluster 'LISA Cluster': 624 hosts 79478 metrics 1035771 values 16340530 bits 2042566 bytes 
Fri 17 Jan 2014 11:29:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:29:32 - job_xml_thread(): Done retrieving: data size 43428629
Fri 17 Jan 2014 11:29:32 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:29:32 - XML: Start document: iteration 9
Fri 17 Jan 2014 11:29:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43428629
Fri 17 Jan 2014 11:29:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43428629
Fri 17 Jan 2014 11:29:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:29:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:29:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:29:42 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:29:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:29:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:29:43 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:29:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 11:29:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:29:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 11:29:43 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:29:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8903 values 140384 bits 17548 bytes 
Fri 17 Jan 2014 11:29:44 - XML: Processed 650056 elements - found 640 jobs
Fri 17 Jan 2014 11:29:44 - job 7347951 appears to have finished
Fri 17 Jan 2014 11:29:44 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 11:29:44 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 11:29:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:29:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:29:45 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 11:29:45 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:29:45 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:29:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:29:49 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:29:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:29:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:29:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:29:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:29:49 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:29:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:29:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:29:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:29:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:29:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:29:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:29:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:29:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:29:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:29:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:29:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:29:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43211356
Fri 17 Jan 2014 11:29:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:29:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43211356
Fri 17 Jan 2014 11:29:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:30:00 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:30:00 - job_xml_thread(): Done retrieving: data size 43211356
Fri 17 Jan 2014 11:30:00 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:30:00 - XML: Start document: iteration 10
Fri 17 Jan 2014 11:30:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:30:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:30:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:30:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:30:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:30:14 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:30:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:30:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:30:14 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:30:14 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:30:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:30:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:30:14 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:30:16 - XML: Processed 647558 elements - found 642 jobs
Fri 17 Jan 2014 11:30:16 - job 7347969 report time 1389954419 does not match current heartbeat 1389954540 : ignoring job
Fri 17 Jan 2014 11:30:16 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 11:30:16 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 11:30:16 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 11:30:16 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:30:16 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:30:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:30:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:30:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:30:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:30:18 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:30:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 11:30:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:30:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:30:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:30:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:30:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:30:21 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:30:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43273409
Fri 17 Jan 2014 11:30:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:30:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43273409
Fri 17 Jan 2014 11:30:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:30:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:30:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:30:30 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:30:30 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 11:30:31 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:30:31 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:30:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:30:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:30:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:30:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:30:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:30:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:30:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:30:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:30:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:30:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:30:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:30:35 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:30:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:30:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:30:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:30:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:30:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:30:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:30:39 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:30:39 - job_xml_thread(): Done retrieving: data size 43541330
Fri 17 Jan 2014 11:30:39 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:30:39 - XML: Start document: iteration 11
Fri 17 Jan 2014 11:30:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43541330
Fri 17 Jan 2014 11:30:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:30:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43541330
Fri 17 Jan 2014 11:30:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:30:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:30:43 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:30:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:30:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 11:30:43 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:30:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 11:30:44 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:30:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8814 values 139028 bits 17378 bytes 
Fri 17 Jan 2014 11:30:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:30:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:30:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:30:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:30:55 - XML: Processed 651529 elements - found 642 jobs
Fri 17 Jan 2014 11:30:55 - job 7347969 report time 1389954419 does not match current heartbeat 1389954540 : ignoring job
Fri 17 Jan 2014 11:30:55 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 11:30:55 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 11:30:55 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:30:55 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:30:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:30:58 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:30:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:30:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:30:59 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:30:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:30:59 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:30:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:30:59 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:31:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:31:01 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:31:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:31:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:31:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:31:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:31:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:31:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:31:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:31:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870263
Fri 17 Jan 2014 11:31:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:31:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870263
Fri 17 Jan 2014 11:31:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:31:10 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:31:10 - job_xml_thread(): Done retrieving: data size 43870263
Fri 17 Jan 2014 11:31:11 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:31:11 - XML: Start document: iteration 12
Fri 17 Jan 2014 11:31:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:31:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:31:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:31:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:31:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:31:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:31:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:31:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:31:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:31:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:31:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:31:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:31:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:31:26 - XML: Processed 655406 elements - found 642 jobs
Fri 17 Jan 2014 11:31:26 - job 7347969 report time 1389954419 does not match current heartbeat 1389954540 : ignoring job
Fri 17 Jan 2014 11:31:26 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 11:31:26 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 11:31:26 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:31:26 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:31:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:31:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:31:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:31:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:31:29 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:31:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 11:31:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:31:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:31:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:31:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:31:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:31:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:31:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43863263
Fri 17 Jan 2014 11:31:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:31:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43863263
Fri 17 Jan 2014 11:31:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:31:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:31:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:31:41 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:31:41 - job_xml_thread(): Done retrieving: data size 43863263
Fri 17 Jan 2014 11:31:41 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:31:41 - XML: Start document: iteration 13
Fri 17 Jan 2014 11:31:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:31:45 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:31:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:31:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:31:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:31:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 11:31:45 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:31:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 11:31:45 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:31:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5818 values 91945 bits 11493 bytes 
Fri 17 Jan 2014 11:31:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:31:50 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:31:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:31:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:31:51 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:31:51 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:31:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:31:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:31:51 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:31:57 - XML: Processed 655474 elements - found 638 jobs
Fri 17 Jan 2014 11:31:57 - job 7347952 appears to have finished
Fri 17 Jan 2014 11:31:57 - job 7347792 appears to have finished
Fri 17 Jan 2014 11:31:57 - job 7347919 appears to have finished
Fri 17 Jan 2014 11:31:57 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 11:31:57 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 11:31:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:31:57 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:31:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:31:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:31:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:31:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:31:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:31:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:31:58 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 11:31:58 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:31:58 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:32:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:32:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862396
Fri 17 Jan 2014 11:32:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:32:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862396
Fri 17 Jan 2014 11:32:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:32:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:32:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:32:06 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:32:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 11:32:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:32:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:32:13 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:32:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:32:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:32:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:32:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:32:13 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:32:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:32:14 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:32:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:32:14 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:32:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:32:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:32:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:32:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:32:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:32:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:32:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:32:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:32:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:32:21 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:32:21 - job_xml_thread(): Done retrieving: data size 43873758
Fri 17 Jan 2014 11:32:21 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:32:21 - XML: Start document: iteration 14
Fri 17 Jan 2014 11:32:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873758
Fri 17 Jan 2014 11:32:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873758
Fri 17 Jan 2014 11:32:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:32:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:32:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:32:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:32:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:32:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:32:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:32:36 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:32:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:32:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:32:37 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:32:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:32:37 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:32:37 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:32:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:32:39 - XML: Processed 655480 elements - found 641 jobs
Fri 17 Jan 2014 11:32:39 - job 7347879 report time 1389954540 does not match current heartbeat 1389954660 : ignoring job
Fri 17 Jan 2014 11:32:39 - job 7347974 field 'start_timestamp' changed since saved from: 1389954596 to: 1389954518
Fri 17 Jan 2014 11:32:39 - job 7347975 report time 1389954540 does not match current heartbeat 1389954660 : ignoring job
Fri 17 Jan 2014 11:32:39 - job 7347946 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 11:32:39 - job_xml_thread(): Found 5 updated jobs.
Fri 17 Jan 2014 11:32:39 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 11:32:41 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Fri 17 Jan 2014 11:32:41 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:32:41 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:32:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:32:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:32:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:32:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:32:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:32:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:32:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:32:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:32:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:32:45 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:32:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:32:46 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:32:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 11:32:46 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:32:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 11:32:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6252 values 98968 bits 12371 bytes 
Fri 17 Jan 2014 11:32:47 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:32:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870311
Fri 17 Jan 2014 11:32:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:32:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870311
Fri 17 Jan 2014 11:32:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:32:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:32:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:32:56 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:32:56 - job_xml_thread(): Done retrieving: data size 43870311
Fri 17 Jan 2014 11:32:56 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:32:56 - XML: Start document: iteration 15
Fri 17 Jan 2014 11:32:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:32:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:32:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:32:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:32:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:32:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:33:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:33:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:33:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:33:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:33:01 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:33:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:33:08 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:33:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:33:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:33:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:33:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:33:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:33:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:33:10 - XML: Processed 655480 elements - found 641 jobs
Fri 17 Jan 2014 11:33:10 - job 7347879 report time 1389954540 does not match current heartbeat 1389954660 : ignoring job
Fri 17 Jan 2014 11:33:10 - job 7347975 report time 1389954540 does not match current heartbeat 1389954660 : ignoring job
Fri 17 Jan 2014 11:33:10 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 11:33:10 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 11:33:10 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:33:10 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:33:14 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:33:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 11:33:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:33:14 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:33:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43841732
Fri 17 Jan 2014 11:33:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:33:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43841732
Fri 17 Jan 2014 11:33:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:33:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:33:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:33:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:33:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:33:25 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:33:25 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:33:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:33:27 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:33:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:33:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:33:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:33:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:33:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:33:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:33:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:33:30 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:33:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:33:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:33:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:33:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:33:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:33:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:33:32 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 11:33:32 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 11:33:32 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:33:33 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:33:33 - job_xml_thread(): Done retrieving: data size 43868116
Fri 17 Jan 2014 11:33:33 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:33:33 - XML: Start document: iteration 16
Fri 17 Jan 2014 11:33:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43868116
Fri 17 Jan 2014 11:33:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:33:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43868116
Fri 17 Jan 2014 11:33:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:33:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:33:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:33:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:33:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:33:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:33:47 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:33:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:33:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:33:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:33:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:33:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:33:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 11:33:48 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:33:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 11:33:48 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:33:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6665 values 105237 bits 13154 bytes 
Fri 17 Jan 2014 11:33:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:33:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:33:49 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:33:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:33:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:33:50 - XML: Processed 655468 elements - found 635 jobs
Fri 17 Jan 2014 11:33:50 - job 7347956 appears to have finished
Fri 17 Jan 2014 11:33:50 - job 7347796 appears to have finished
Fri 17 Jan 2014 11:33:50 - job 7347856 appears to have finished
Fri 17 Jan 2014 11:33:50 - job 7347913 appears to have finished
Fri 17 Jan 2014 11:33:50 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 11:33:50 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 11:33:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:33:55 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:33:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:33:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:33:55 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 11:33:55 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:33:55 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:33:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:33:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:33:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:33:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:33:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:33:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43857708
Fri 17 Jan 2014 11:33:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:33:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43857708
Fri 17 Jan 2014 11:33:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:34:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:34:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:34:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:34:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:34:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:34:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:34:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:34:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:34:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:34:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:34:09 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:34:09 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:34:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 11:34:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:34:10 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:34:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:34:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:34:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:34:12 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:34:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:34:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:34:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:34:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:34:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:34:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:34:14 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:34:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867997
Fri 17 Jan 2014 11:34:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:34:15 - job_xml_thread(): Done retrieving: data size 43867997
Fri 17 Jan 2014 11:34:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43867997
Fri 17 Jan 2014 11:34:15 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:34:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:34:15 - XML: Start document: iteration 17
Fri 17 Jan 2014 11:34:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:34:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:34:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:34:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:34:28 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:34:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:34:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:34:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:34:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:34:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:34:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:34:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:34:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:34:33 - XML: Processed 655470 elements - found 636 jobs
Fri 17 Jan 2014 11:34:33 - job 7347979 report time 1389954660 does not match current heartbeat 1389954781 : ignoring job
Fri 17 Jan 2014 11:34:33 - job 7347946 field 'start_timestamp' changed since saved from: 1389954675 to: 1389954640
Fri 17 Jan 2014 11:34:33 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 11:34:33 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 11:34:34 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 11:34:34 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:34:34 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:34:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:34:36 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:34:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:34:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:34:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:34:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:34:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:34:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:34:38 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:34:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43846882
Fri 17 Jan 2014 11:34:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:34:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43846882
Fri 17 Jan 2014 11:34:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:34:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:34:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:34:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:34:48 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:34:49 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:34:49 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:34:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:34:49 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:34:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 11:34:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 11:34:49 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:34:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:34:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9283 values 146493 bits 18311 bytes 
Fri 17 Jan 2014 11:34:50 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:34:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:34:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:34:51 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:34:51 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:34:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:34:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:34:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:34:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:34:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:34:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:34:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:34:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:34:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:34:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:34:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:34:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:34:56 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:34:56 - job_xml_thread(): Done retrieving: data size 43860201
Fri 17 Jan 2014 11:34:56 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:34:56 - XML: Start document: iteration 18
Fri 17 Jan 2014 11:34:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43860201
Fri 17 Jan 2014 11:34:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:34:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43860201
Fri 17 Jan 2014 11:34:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:35:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:35:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:35:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:35:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:35:15 - XML: Processed 655469 elements - found 636 jobs
Fri 17 Jan 2014 11:35:15 - job 7347979 report time 1389954660 does not match current heartbeat 1389954781 : ignoring job
Fri 17 Jan 2014 11:35:15 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 11:35:15 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 11:35:15 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:35:15 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:35:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:35:16 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:35:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:35:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:35:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:35:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:35:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:35:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:35:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:35:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:35:19 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:35:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:35:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:35:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:35:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:35:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:35:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:35:20 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:35:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 11:35:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:35:21 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:35:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43813774
Fri 17 Jan 2014 11:35:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:35:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43813774
Fri 17 Jan 2014 11:35:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:35:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:35:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:35:31 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:35:31 - job_xml_thread(): Done retrieving: data size 43813774
Fri 17 Jan 2014 11:35:31 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:35:31 - XML: Start document: iteration 19
Fri 17 Jan 2014 11:35:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:35:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:35:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:35:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:35:35 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:35:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:35:35 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:35:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:35:35 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:35:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:35:37 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:35:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:35:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:35:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:35:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:35:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:35:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:35:40 - XML: Processed 654722 elements - found 636 jobs
Fri 17 Jan 2014 11:35:40 - job 7347979 report time 1389954660 does not match current heartbeat 1389954781 : ignoring job
Fri 17 Jan 2014 11:35:40 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 11:35:40 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 11:35:40 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:35:40 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:35:42 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:35:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43258745
Fri 17 Jan 2014 11:35:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:35:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43258745
Fri 17 Jan 2014 11:35:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:35:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:35:50 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:35:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:35:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:35:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:35:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 11:35:50 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:35:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8534 values 134522 bits 16815 bytes 
Fri 17 Jan 2014 11:35:50 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:35:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 11:35:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:35:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:35:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:35:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:35:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:35:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:35:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:35:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:35:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:35:52 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:35:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:35:56 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:35:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:35:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:35:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:35:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:35:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:35:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:35:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:35:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:35:59 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:35:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 11:35:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:35:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:35:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43202240
Fri 17 Jan 2014 11:35:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:35:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43202240
Fri 17 Jan 2014 11:36:00 - job_xml_thread(): Done retrieving: data size 43202240
Fri 17 Jan 2014 11:36:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:36:00 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:36:00 - XML: Start document: iteration 20
Fri 17 Jan 2014 11:36:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:36:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:36:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:36:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:36:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:36:13 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:36:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:36:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:36:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:36:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:36:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:36:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:36:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:36:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:36:19 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:36:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:36:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:36:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:36:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:36:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:36:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:36:21 - XML: Processed 647318 elements - found 637 jobs
Fri 17 Jan 2014 11:36:21 - job 7343941 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 11:36:21 - job 7347981 report time 1389954781 does not match current heartbeat 1389954901 : ignoring job
Fri 17 Jan 2014 11:36:21 - job 7347852 appears to have finished
Fri 17 Jan 2014 11:36:21 - job_xml_thread(): Found 5 updated jobs.
Fri 17 Jan 2014 11:36:21 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 11:36:21 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Fri 17 Jan 2014 11:36:21 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:36:21 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:36:22 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:36:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43240656
Fri 17 Jan 2014 11:36:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:36:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43240656
Fri 17 Jan 2014 11:36:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:36:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:36:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:36:30 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 11:36:30 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:36:31 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:36:31 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:36:31 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 11:36:31 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 11:36:31 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 11:36:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:36:34 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:36:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:36:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:36:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:36:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:36:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:36:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:36:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:36:36 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:36:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:36:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:36:37 - size of cluster 'LISA Cluster': 624 hosts 79471 metrics 760721 values 12015128 bits 1501891 bytes 
Fri 17 Jan 2014 11:36:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:36:40 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:36:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:36:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:36:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:36:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:36:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:36:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:36:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:36:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43758062
Fri 17 Jan 2014 11:36:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:36:46 - job_xml_thread(): Done retrieving: data size 43758062
Fri 17 Jan 2014 11:36:46 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:36:46 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 11:36:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43758062
Fri 17 Jan 2014 11:36:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:36:46 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 11:36:47 - Housekeeping: done.
Fri 17 Jan 2014 11:36:47 - XML: Start document: iteration 0
Fri 17 Jan 2014 11:36:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:36:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:36:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:36:51 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:36:53 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:36:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 11:36:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:36:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 11:36:53 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:36:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9279 values 146377 bits 18297 bytes 
Fri 17 Jan 2014 11:36:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:36:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:37:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:37:00 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:37:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:37:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:37:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:37:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:37:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:37:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:37:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:37:03 - XML: Processed 654294 elements - found 637 jobs
Fri 17 Jan 2014 11:37:03 - job 7347981 report time 1389954781 does not match current heartbeat 1389954901 : ignoring job
Fri 17 Jan 2014 11:37:03 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 11:37:03 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 11:37:03 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:37:03 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:37:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:37:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:37:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:37:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:37:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:37:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:37:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:37:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:37:10 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:37:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 11:37:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:37:10 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:37:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851938
Fri 17 Jan 2014 11:37:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:37:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851938
Fri 17 Jan 2014 11:37:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:37:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:37:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:37:18 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:37:18 - job_xml_thread(): Done retrieving: data size 43851938
Fri 17 Jan 2014 11:37:18 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:37:18 - XML: Start document: iteration 1
Fri 17 Jan 2014 11:37:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:37:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:37:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:37:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:37:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:37:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:37:25 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:37:25 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:37:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:37:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:37:25 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:37:31 - XML: Processed 655472 elements - found 637 jobs
Fri 17 Jan 2014 11:37:31 - job 7347981 report time 1389954781 does not match current heartbeat 1389954901 : ignoring job
Fri 17 Jan 2014 11:37:31 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:37:31 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 11:37:31 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 11:37:31 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 11:37:31 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:37:31 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:37:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:37:34 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:37:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:37:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:37:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:37:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:37:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:37:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:37:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:37:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43849504
Fri 17 Jan 2014 11:37:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:37:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43849504
Fri 17 Jan 2014 11:37:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:37:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:37:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:37:46 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:37:47 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:37:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:37:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:37:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:37:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:37:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:37:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:37:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:37:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:37:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:37:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:37:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:37:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:37:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:37:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:37:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:37:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:37:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:37:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:37:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:37:53 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:37:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:37:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 11:37:53 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:37:53 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:37:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 11:37:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99100 bits 12387 bytes 
Fri 17 Jan 2014 11:37:54 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:37:54 - job_xml_thread(): Done retrieving: data size 43852238
Fri 17 Jan 2014 11:37:54 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:37:54 - XML: Start document: iteration 2
Fri 17 Jan 2014 11:37:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43852238
Fri 17 Jan 2014 11:37:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:37:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43852238
Fri 17 Jan 2014 11:37:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:38:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:38:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:38:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:38:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:38:10 - XML: Processed 655466 elements - found 634 jobs
Fri 17 Jan 2014 11:38:10 - job 7347988 report time 1389954901 does not match current heartbeat 1389955022 : ignoring job
Fri 17 Jan 2014 11:38:10 - job 7347718 appears to have finished
Fri 17 Jan 2014 11:38:10 - job 7347825 appears to have finished
Fri 17 Jan 2014 11:38:10 - job 7347983 field 'start_timestamp' changed since saved from: 1389954929 to: 1389954884
Fri 17 Jan 2014 11:38:10 - job 7347984 field 'start_timestamp' changed since saved from: 1389954931 to: 1389954884
Fri 17 Jan 2014 11:38:10 - job 7346457 appears to have finished
Fri 17 Jan 2014 11:38:10 - job_xml_thread(): Found 6 updated jobs.
Fri 17 Jan 2014 11:38:10 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 11:38:12 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Fri 17 Jan 2014 11:38:12 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:38:12 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:38:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:38:16 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:38:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:38:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:38:16 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:38:16 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:38:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:38:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:38:16 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:38:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:38:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:38:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:38:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:38:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:38:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:38:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:38:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:38:21 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:38:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 11:38:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:38:21 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:38:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873813
Fri 17 Jan 2014 11:38:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:38:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873813
Fri 17 Jan 2014 11:38:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:38:28 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:38:28 - job_xml_thread(): Done retrieving: data size 43873813
Fri 17 Jan 2014 11:38:28 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:38:28 - XML: Start document: iteration 3
Fri 17 Jan 2014 11:38:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:38:31 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:38:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:38:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:38:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:38:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:38:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:38:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:38:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:38:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:38:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:38:43 - XML: Processed 655466 elements - found 634 jobs
Fri 17 Jan 2014 11:38:43 - job 7347988 report time 1389954901 does not match current heartbeat 1389955022 : ignoring job
Fri 17 Jan 2014 11:38:43 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 11:38:43 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 11:38:43 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:38:43 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:38:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:38:45 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:38:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:38:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:38:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:38:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:38:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:38:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:38:48 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:38:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43847994
Fri 17 Jan 2014 11:38:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:38:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:38:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:38:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43847994
Fri 17 Jan 2014 11:38:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:38:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:38:53 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:38:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:38:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 11:38:55 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:38:55 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:38:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 11:38:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7203 values 113594 bits 14199 bytes 
Fri 17 Jan 2014 11:38:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:38:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:38:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:38:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:38:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:38:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:38:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43847994
Fri 17 Jan 2014 11:38:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:38:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:38:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:38:58 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:38:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:39:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:39:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:39:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:39:07 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:39:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:39:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:39:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:39:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:39:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:39:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:39:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:39:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:39:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:39:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:39:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:39:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:39:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:39:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:39:15 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:39:15 - job_xml_thread(): Done retrieving: data size 43828873
Fri 17 Jan 2014 11:39:15 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:39:15 - XML: Start document: iteration 4
Fri 17 Jan 2014 11:39:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43828873
Fri 17 Jan 2014 11:39:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:39:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43828873
Fri 17 Jan 2014 11:39:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:39:23 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:39:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 11:39:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:39:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:39:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:39:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:39:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:39:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:39:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:39:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:39:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:39:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:39:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:39:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:39:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:39:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:39:35 - XML: Processed 655466 elements - found 634 jobs
Fri 17 Jan 2014 11:39:35 - job 7347988 report time 1389954901 does not match current heartbeat 1389955022 : ignoring job
Fri 17 Jan 2014 11:39:35 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 11:39:35 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 11:39:35 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:39:36 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:39:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:39:37 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:39:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:39:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:39:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:39:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:39:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:39:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:39:40 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 11:39:40 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 11:39:40 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:39:41 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:39:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43849998
Fri 17 Jan 2014 11:39:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:39:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43849998
Fri 17 Jan 2014 11:39:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:39:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:39:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:39:51 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:39:51 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:39:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:39:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:39:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:39:54 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:39:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:39:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:39:55 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:39:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:39:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:39:56 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:39:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 11:39:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 11:39:56 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:39:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6210 values 97926 bits 12240 bytes 
Fri 17 Jan 2014 11:39:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:39:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:39:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:39:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:39:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:39:57 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:39:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:39:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:39:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:39:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:39:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:39:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:39:59 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:39:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 11:39:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:40:00 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:40:00 - job_xml_thread(): Done retrieving: data size 43853518
Fri 17 Jan 2014 11:40:00 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:40:00 - XML: Start document: iteration 5
Fri 17 Jan 2014 11:40:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853518
Fri 17 Jan 2014 11:40:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:40:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853518
Fri 17 Jan 2014 11:40:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:40:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:40:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:40:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:40:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:40:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:40:16 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:40:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:40:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:40:17 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:40:17 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:40:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:40:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:40:17 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:40:18 - XML: Processed 655468 elements - found 635 jobs
Fri 17 Jan 2014 11:40:18 - job 7347990 report time 1389955022 does not match current heartbeat 1389955143 : ignoring job
Fri 17 Jan 2014 11:40:18 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 11:40:18 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 11:40:19 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 11:40:19 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:40:19 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:40:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:40:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:40:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:40:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:40:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:40:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:40:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:40:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:40:24 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:40:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43846532
Fri 17 Jan 2014 11:40:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:40:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43846532
Fri 17 Jan 2014 11:40:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:40:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:40:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:40:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:40:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:40:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:40:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:40:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:40:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:40:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:40:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:40:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43846532
Fri 17 Jan 2014 11:40:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:40:34 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:40:34 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:40:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:40:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:40:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:40:41 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:40:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:40:44 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:40:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:40:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:40:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:40:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:40:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:40:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:40:46 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:40:46 - job_xml_thread(): Done retrieving: data size 43843461
Fri 17 Jan 2014 11:40:46 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:40:46 - XML: Start document: iteration 6
Fri 17 Jan 2014 11:40:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43843461
Fri 17 Jan 2014 11:40:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:40:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:40:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:40:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:40:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:40:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:40:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43843461
Fri 17 Jan 2014 11:40:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:40:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:40:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:40:56 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:40:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:40:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 11:40:57 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:40:57 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:40:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 11:40:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:40:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:40:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9127 values 143920 bits 17990 bytes 
Fri 17 Jan 2014 11:41:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:41:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:41:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:41:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:41:04 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:41:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:41:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:41:04 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:41:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:41:08 - XML: Processed 655468 elements - found 635 jobs
Fri 17 Jan 2014 11:41:08 - job 7347990 report time 1389955022 does not match current heartbeat 1389955143 : ignoring job
Fri 17 Jan 2014 11:41:08 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 11:41:08 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 11:41:08 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:41:09 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:41:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:41:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:41:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:41:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:41:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:41:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:41:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:41:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:41:12 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:41:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 11:41:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:41:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:41:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43790873
Fri 17 Jan 2014 11:41:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:41:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43790873
Fri 17 Jan 2014 11:41:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:41:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:41:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:41:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:41:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:41:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:41:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:41:24 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:41:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:41:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:41:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:41:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:41:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:41:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:41:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:41:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:41:27 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:41:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:41:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:41:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:41:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:41:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:41:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:41:29 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:41:29 - job_xml_thread(): Done retrieving: data size 43804017
Fri 17 Jan 2014 11:41:29 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:41:29 - XML: Start document: iteration 7
Fri 17 Jan 2014 11:41:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43804017
Fri 17 Jan 2014 11:41:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:41:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43804017
Fri 17 Jan 2014 11:41:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:41:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:41:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:41:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:41:41 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:41:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:41:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:41:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:41:42 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:41:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:41:42 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:41:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:41:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:41:42 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:41:48 - XML: Processed 654718 elements - found 635 jobs
Fri 17 Jan 2014 11:41:48 - job 7347990 report time 1389955022 does not match current heartbeat 1389955143 : ignoring job
Fri 17 Jan 2014 11:41:48 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 11:41:48 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 11:41:48 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:41:48 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:41:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:41:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:41:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:41:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:41:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:41:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:41:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:41:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:41:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:41:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43232727
Fri 17 Jan 2014 11:41:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:41:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43232727
Fri 17 Jan 2014 11:41:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:41:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:41:57 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:41:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:41:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:41:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:41:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 11:41:58 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:41:58 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:41:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 11:41:59 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148571 bits 18571 bytes 
Fri 17 Jan 2014 11:42:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:42:01 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:42:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:42:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:42:01 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:42:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:42:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43232727
Fri 17 Jan 2014 11:42:01 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:42:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:42:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:42:03 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:42:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:42:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:42:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:42:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:42:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:42:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:42:13 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:42:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:42:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:42:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:42:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:42:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:42:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:42:15 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:42:15 - job_xml_thread(): Done retrieving: data size 43239512
Fri 17 Jan 2014 11:42:15 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:42:15 - XML: Start document: iteration 8
Fri 17 Jan 2014 11:42:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43239512
Fri 17 Jan 2014 11:42:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:42:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:42:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:42:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:42:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:42:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43239512
Fri 17 Jan 2014 11:42:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:42:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:42:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:42:28 - XML: Processed 647940 elements - found 634 jobs
Fri 17 Jan 2014 11:42:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:42:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:42:29 - job 7347993 report time 1389955143 does not match current heartbeat 1389955263 : ignoring job
Fri 17 Jan 2014 11:42:29 - job 7347907 appears to have finished
Fri 17 Jan 2014 11:42:29 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 11:42:29 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 11:42:30 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 11:42:30 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:42:30 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:42:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:42:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:42:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:42:34 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:42:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:42:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:42:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:42:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:42:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:42:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:42:34 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:42:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:42:38 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:42:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:42:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:42:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:42:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:42:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:42:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:42:38 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:42:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 11:42:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:42:40 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:42:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43779815
Fri 17 Jan 2014 11:42:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:42:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43779815
Fri 17 Jan 2014 11:42:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:42:45 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:42:45 - job_xml_thread(): Done retrieving: data size 43779815
Fri 17 Jan 2014 11:42:45 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:42:45 - XML: Start document: iteration 9
Fri 17 Jan 2014 11:42:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:42:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:42:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:42:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:42:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:42:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:42:53 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:42:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:42:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:42:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:42:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:42:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:42:53 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:42:58 - XML: Processed 654466 elements - found 634 jobs
Fri 17 Jan 2014 11:42:58 - job 7347993 report time 1389955143 does not match current heartbeat 1389955263 : ignoring job
Fri 17 Jan 2014 11:42:58 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 11:42:58 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 11:42:58 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:42:58 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:42:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:42:58 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:42:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:42:59 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:42:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 11:42:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 11:42:59 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:42:59 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5757 values 90774 bits 11346 bytes 
Fri 17 Jan 2014 11:43:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:43:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:43:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:43:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:43:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:43:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:43:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:43:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:43:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:43:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43845733
Fri 17 Jan 2014 11:43:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:43:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43845733
Fri 17 Jan 2014 11:43:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:43:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:43:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:43:13 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:43:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:43:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:43:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:43:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:43:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:43:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:43:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:43:17 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:43:17 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:43:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:43:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:43:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:43:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:43:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:43:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:43:17 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:43:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 11:43:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:43:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:43:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:43:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:43:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:43:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:43:20 - job_xml_thread(): Done retrieving: data size 43867787
Fri 17 Jan 2014 11:43:20 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:43:20 - XML: Start document: iteration 10
Fri 17 Jan 2014 11:43:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43867787
Fri 17 Jan 2014 11:43:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:43:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867787
Fri 17 Jan 2014 11:43:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:43:31 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 11:43:31 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:43:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:43:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:43:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:43:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:43:33 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:43:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:43:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:43:33 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 11:43:33 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:43:34 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 11:43:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:43:34 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 11:43:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:43:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:43:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:43:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:43:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:43:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:43:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:43:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:43:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:43:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:43:42 - XML: Processed 655466 elements - found 634 jobs
Fri 17 Jan 2014 11:43:42 - job 7347993 report time 1389955143 does not match current heartbeat 1389955263 : ignoring job
Fri 17 Jan 2014 11:43:42 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 11:43:42 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 11:43:42 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:43:42 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:43:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:43:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:43:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:43:42 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 847085 values 13369805 bits 1671225 bytes 
Fri 17 Jan 2014 11:43:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:43:46 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:43:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43848697
Fri 17 Jan 2014 11:43:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:43:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43848697
Fri 17 Jan 2014 11:43:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:43:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:43:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:43:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:43:53 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:43:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:43:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:43:54 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:43:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:43:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43848697
Fri 17 Jan 2014 11:43:54 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:43:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:43:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:43:57 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:43:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:43:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:43:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:43:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:43:59 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:44:00 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:44:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:44:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 11:44:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 11:44:00 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:44:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8799 values 138719 bits 17339 bytes 
Fri 17 Jan 2014 11:44:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:44:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:44:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:44:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:44:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:44:07 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:44:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:44:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:44:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:44:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:44:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:44:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:44:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:44:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:44:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:44:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:44:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:44:11 - job_xml_thread(): Done retrieving: data size 43836768
Fri 17 Jan 2014 11:44:11 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:44:11 - XML: Start document: iteration 11
Fri 17 Jan 2014 11:44:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43836768
Fri 17 Jan 2014 11:44:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:44:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43836768
Fri 17 Jan 2014 11:44:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:44:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:44:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:44:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:44:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:44:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:44:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:44:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:44:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:44:26 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:44:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:44:26 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:44:26 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:44:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:44:30 - XML: Processed 655468 elements - found 635 jobs
Fri 17 Jan 2014 11:44:30 - job 7347995 report time 1389955263 does not match current heartbeat 1389955384 : ignoring job
Fri 17 Jan 2014 11:44:30 - job 7347618 appears to have finished
Fri 17 Jan 2014 11:44:30 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 11:44:30 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 11:44:31 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 11:44:31 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:44:31 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:44:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:44:34 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:44:34 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:44:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:44:34 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 11:44:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:44:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:44:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:44:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:44:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:44:34 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:44:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 11:44:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:44:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:44:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43860405
Fri 17 Jan 2014 11:44:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:44:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43860405
Fri 17 Jan 2014 11:44:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:44:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:44:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:44:46 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:44:46 - job_xml_thread(): Done retrieving: data size 43860405
Fri 17 Jan 2014 11:44:46 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:44:46 - XML: Start document: iteration 12
Fri 17 Jan 2014 11:44:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:44:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:44:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:44:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:44:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:44:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:44:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:44:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:44:49 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:44:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:44:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:44:54 - XML: Processed 655468 elements - found 635 jobs
Fri 17 Jan 2014 11:44:54 - job 7347995 report time 1389955263 does not match current heartbeat 1389955384 : ignoring job
Fri 17 Jan 2014 11:44:54 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 11:44:54 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 11:44:54 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:44:54 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:44:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:44:57 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:44:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:44:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:44:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:44:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:44:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:44:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:44:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:44:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43845992
Fri 17 Jan 2014 11:44:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:45:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:45:00 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:45:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43845992
Fri 17 Jan 2014 11:45:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:45:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:45:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 11:45:02 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:45:02 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:45:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 11:45:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8809 values 138847 bits 17355 bytes 
Fri 17 Jan 2014 11:45:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:45:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:45:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:45:09 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:45:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:45:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:45:09 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:45:09 - job_xml_thread(): Done retrieving: data size 43845992
Fri 17 Jan 2014 11:45:09 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:45:09 - XML: Start document: iteration 13
Fri 17 Jan 2014 11:45:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:45:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:45:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:45:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:45:10 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:45:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:45:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:45:21 - XML: Processed 655468 elements - found 635 jobs
Fri 17 Jan 2014 11:45:21 - job 7347995 report time 1389955263 does not match current heartbeat 1389955384 : ignoring job
Fri 17 Jan 2014 11:45:21 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 11:45:21 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 11:45:21 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:45:21 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:45:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:45:21 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:45:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:45:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:45:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:45:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:45:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:45:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:45:24 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:45:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 11:45:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:45:24 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:45:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43841767
Fri 17 Jan 2014 11:45:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:45:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43841767
Fri 17 Jan 2014 11:45:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:45:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:45:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:45:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:45:34 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:45:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:45:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:45:35 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:45:35 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:45:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:45:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:45:35 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:45:36 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:45:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:45:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:45:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:45:37 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:45:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:45:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:45:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:45:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:45:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:45:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:45:41 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:45:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43859858
Fri 17 Jan 2014 11:45:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:45:41 - job_xml_thread(): Done retrieving: data size 43859858
Fri 17 Jan 2014 11:45:41 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:45:41 - XML: Start document: iteration 14
Fri 17 Jan 2014 11:45:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43859858
Fri 17 Jan 2014 11:45:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:45:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:45:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:45:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:45:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:45:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:45:56 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:45:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:45:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:45:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:45:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:45:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:45:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:45:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:45:59 - XML: Processed 655466 elements - found 634 jobs
Fri 17 Jan 2014 11:45:59 - job 7348002 report time 1389955384 does not match current heartbeat 1389955504 : ignoring job
Fri 17 Jan 2014 11:45:59 - job 7347936 appears to have finished
Fri 17 Jan 2014 11:45:59 - job 7347918 appears to have finished
Fri 17 Jan 2014 11:45:59 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 11:45:59 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 11:46:00 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 11:46:00 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:46:00 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:46:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:46:02 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:46:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:46:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 11:46:03 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:46:03 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:46:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 11:46:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99017 bits 12377 bytes 
Fri 17 Jan 2014 11:46:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:46:03 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:46:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:46:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:46:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:46:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:46:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:46:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:46:07 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:46:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43872327
Fri 17 Jan 2014 11:46:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:46:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43872327
Fri 17 Jan 2014 11:46:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:46:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:46:14 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:46:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:46:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:46:14 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:46:14 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:46:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:46:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:46:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43872327
Fri 17 Jan 2014 11:46:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:46:15 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:46:15 - job_xml_thread(): Done retrieving: data size 43872327
Fri 17 Jan 2014 11:46:15 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:46:15 - XML: Start document: iteration 15
Fri 17 Jan 2014 11:46:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:46:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:46:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:46:28 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:46:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:46:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:46:30 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:46:30 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:46:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:46:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:46:31 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:46:33 - XML: Processed 655466 elements - found 634 jobs
Fri 17 Jan 2014 11:46:33 - job 7348002 report time 1389955384 does not match current heartbeat 1389955504 : ignoring job
Fri 17 Jan 2014 11:46:33 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 11:46:33 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 11:46:33 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:46:33 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:46:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:46:34 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:46:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:46:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:46:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:46:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:46:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:46:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:46:35 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:46:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 11:46:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:46:38 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:46:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43888238
Fri 17 Jan 2014 11:46:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:46:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43888238
Fri 17 Jan 2014 11:46:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:46:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:46:46 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:46:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:46:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:46:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:46:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:46:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43888238
Fri 17 Jan 2014 11:46:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:46:47 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:46:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:46:48 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:46:48 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:46:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:46:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:46:54 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 11:46:54 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 11:46:55 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:46:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:46:56 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:46:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:46:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:46:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:46:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:46:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:46:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:46:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:46:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:47:00 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:47:00 - job_xml_thread(): Done retrieving: data size 43844962
Fri 17 Jan 2014 11:47:00 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:47:00 - XML: Start document: iteration 16
Fri 17 Jan 2014 11:47:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43844962
Fri 17 Jan 2014 11:47:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:47:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:47:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:47:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:47:03 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:47:04 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:47:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:47:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:47:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:47:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 11:47:05 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:47:05 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:47:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5602 values 88471 bits 11058 bytes 
Fri 17 Jan 2014 11:47:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43844962
Fri 17 Jan 2014 11:47:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:47:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 11:47:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:47:10 - XML: Processed 655466 elements - found 634 jobs
Fri 17 Jan 2014 11:47:11 - job 7348002 report time 1389955384 does not match current heartbeat 1389955504 : ignoring job
Fri 17 Jan 2014 11:47:11 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 11:47:11 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 11:47:11 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:47:11 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:47:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:47:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:47:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:47:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:47:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:47:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:47:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:47:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:47:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:47:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:47:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:47:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:47:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:47:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:47:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:47:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:47:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:47:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:47:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:47:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:47:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43805474
Fri 17 Jan 2014 11:47:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:47:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43805474
Fri 17 Jan 2014 11:47:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:47:26 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:47:26 - job_xml_thread(): Done retrieving: data size 43805474
Fri 17 Jan 2014 11:47:26 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:47:26 - XML: Start document: iteration 17
Fri 17 Jan 2014 11:47:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:47:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:47:38 - XML: Processed 654714 elements - found 634 jobs
Fri 17 Jan 2014 11:47:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:47:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:47:38 - job 7348002 report time 1389955384 does not match current heartbeat 1389955504 : ignoring job
Fri 17 Jan 2014 11:47:38 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 11:47:38 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 11:47:38 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:47:38 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:47:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:47:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:47:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:47:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:47:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:47:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:47:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:47:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:47:44 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:47:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:47:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:47:47 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:47:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 11:47:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:47:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:47:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:47:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:47:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:47:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:47:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:47:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:47:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43243395
Fri 17 Jan 2014 11:47:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:47:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43243395
Fri 17 Jan 2014 11:47:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:47:54 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:47:54 - job_xml_thread(): Done retrieving: data size 43243395
Fri 17 Jan 2014 11:47:54 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:47:54 - XML: Start document: iteration 18
Fri 17 Jan 2014 11:47:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:48:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:48:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:48:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:48:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:48:05 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:48:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:48:05 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:48:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 11:48:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 11:48:06 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:48:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5970 values 94428 bits 11803 bytes 
Fri 17 Jan 2014 11:48:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:48:06 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:48:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:48:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:48:07 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:48:07 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:48:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:48:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:48:07 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:48:10 - XML: Processed 647634 elements - found 634 jobs
Fri 17 Jan 2014 11:48:10 - job 7348005 report time 1389955504 does not match current heartbeat 1389955625 : ignoring job
Fri 17 Jan 2014 11:48:10 - job 7347804 appears to have finished
Fri 17 Jan 2014 11:48:10 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 11:48:10 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 11:48:10 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 11:48:11 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:48:11 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:48:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:48:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:48:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:48:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:48:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:48:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:48:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:48:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:48:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:48:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43246580
Fri 17 Jan 2014 11:48:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:48:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43246580
Fri 17 Jan 2014 11:48:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:48:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:48:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:48:26 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:48:26 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:48:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:48:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:48:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:48:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:48:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:48:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:48:27 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:48:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:48:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:48:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:48:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:48:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:48:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:48:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:48:29 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:48:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 11:48:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:48:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:48:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:48:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:48:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:48:31 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:48:31 - job_xml_thread(): Done retrieving: data size 43266285
Fri 17 Jan 2014 11:48:31 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:48:31 - XML: Start document: iteration 19
Fri 17 Jan 2014 11:48:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43266285
Fri 17 Jan 2014 11:48:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43266285
Fri 17 Jan 2014 11:48:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:48:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:48:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:48:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:48:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:48:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:48:50 - XML: Processed 648014 elements - found 634 jobs
Fri 17 Jan 2014 11:48:50 - job 7348005 report time 1389955504 does not match current heartbeat 1389955625 : ignoring job
Fri 17 Jan 2014 11:48:50 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 11:48:50 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 11:48:50 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:48:50 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:48:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:48:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:48:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:48:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:48:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:48:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:48:52 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:48:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:48:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:48:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:48:53 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:48:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:48:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:48:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:48:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:48:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:48:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:48:54 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:48:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851581
Fri 17 Jan 2014 11:48:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:48:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851581
Fri 17 Jan 2014 11:48:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:49:05 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:49:05 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:49:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:49:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:49:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:49:06 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:49:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:49:06 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:49:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 11:49:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 11:49:06 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:49:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9097 values 143738 bits 17967 bytes 
Fri 17 Jan 2014 11:49:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:49:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:49:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:49:08 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:49:08 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:49:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:49:08 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:49:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:49:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:49:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:49:10 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:49:10 - job_xml_thread(): Done retrieving: data size 43854996
Fri 17 Jan 2014 11:49:10 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:49:10 - XML: Start document: iteration 20
Fri 17 Jan 2014 11:49:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:49:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:49:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43854996
Fri 17 Jan 2014 11:49:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43854996
Fri 17 Jan 2014 11:49:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:49:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:49:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:49:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:49:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:49:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:49:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:49:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:49:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:49:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:49:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:49:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:49:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:49:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:49:27 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:49:27 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:49:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:49:31 - XML: Processed 655468 elements - found 635 jobs
Fri 17 Jan 2014 11:49:31 - job 7348005 report time 1389955504 does not match current heartbeat 1389955625 : ignoring job
Fri 17 Jan 2014 11:49:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:49:31 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:49:31 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 11:49:31 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 11:49:31 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:49:31 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:49:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:49:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:49:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:49:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:49:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:49:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:49:32 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:49:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 11:49:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:49:33 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:49:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43859648
Fri 17 Jan 2014 11:49:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:49:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43859648
Fri 17 Jan 2014 11:49:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:49:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:49:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:49:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:49:45 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:49:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:49:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:49:45 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:49:45 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:49:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:49:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:49:45 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:49:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:49:46 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:49:46 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:49:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:49:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:49:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:49:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:49:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:49:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:49:48 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:49:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43881015
Fri 17 Jan 2014 11:49:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:49:48 - job_xml_thread(): Done retrieving: data size 43881015
Fri 17 Jan 2014 11:49:48 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:49:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43881015
Fri 17 Jan 2014 11:49:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:49:48 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 11:49:48 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 11:49:49 - Housekeeping: done.
Fri 17 Jan 2014 11:49:49 - XML: Start document: iteration 0
Fri 17 Jan 2014 11:50:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:50:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:50:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:50:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:50:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:50:07 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:50:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:50:07 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:50:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:50:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:50:07 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:50:07 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:50:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:50:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:50:07 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:50:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:50:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 11:50:07 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:50:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 11:50:07 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:50:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8497 values 134217 bits 16777 bytes 
Fri 17 Jan 2014 11:50:09 - XML: Processed 655480 elements - found 641 jobs
Fri 17 Jan 2014 11:50:09 - job 7345327 appears to have finished
Fri 17 Jan 2014 11:50:09 - job 7348007 report time 1389955625 does not match current heartbeat 1389955745 : ignoring job
Fri 17 Jan 2014 11:50:09 - job_xml_thread(): Found 9 updated jobs.
Fri 17 Jan 2014 11:50:09 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 11:50:10 - job_xml_thread(): Done storing. succesfully stored: 9 jobs
Fri 17 Jan 2014 11:50:10 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:50:10 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:50:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:50:12 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:50:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:50:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:50:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:50:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:50:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:50:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:50:14 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:50:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43844006
Fri 17 Jan 2014 11:50:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:50:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43844006
Fri 17 Jan 2014 11:50:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:50:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:50:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:50:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:50:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:50:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:50:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:50:25 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:50:25 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:50:25 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:50:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:50:25 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:50:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:50:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:50:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:50:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:50:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:50:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:50:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:50:28 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:50:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 11:50:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:50:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:50:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:50:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:50:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:50:30 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:50:30 - job_xml_thread(): Done retrieving: data size 43860767
Fri 17 Jan 2014 11:50:30 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:50:30 - XML: Start document: iteration 1
Fri 17 Jan 2014 11:50:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43860767
Fri 17 Jan 2014 11:50:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:50:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43860767
Fri 17 Jan 2014 11:50:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:50:34 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 11:50:34 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:50:36 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:50:36 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 11:50:36 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 11:50:36 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:50:36 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 11:50:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:50:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:50:43 - XML: Processed 655480 elements - found 641 jobs
Fri 17 Jan 2014 11:50:43 - job 7348007 report time 1389955625 does not match current heartbeat 1389955745 : ignoring job
Fri 17 Jan 2014 11:50:43 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 11:50:43 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 11:50:43 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:50:43 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:50:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:50:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:50:46 - size of cluster 'LISA Cluster': 624 hosts 79467 metrics 835346 values 13198931 bits 1649866 bytes 
Fri 17 Jan 2014 11:50:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:50:48 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:50:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:50:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:50:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:50:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:50:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:50:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:50:48 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:50:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:50:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:50:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:50:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:50:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:50:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:50:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:50:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:50:57 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:50:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851675
Fri 17 Jan 2014 11:50:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:50:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851675
Fri 17 Jan 2014 11:50:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:50:59 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:50:59 - job_xml_thread(): Done retrieving: data size 43851675
Fri 17 Jan 2014 11:50:59 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:51:00 - XML: Start document: iteration 2
Fri 17 Jan 2014 11:51:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:51:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:51:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:51:08 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:51:08 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:51:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:51:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 11:51:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 11:51:08 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:51:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8913 values 140771 bits 17596 bytes 
Fri 17 Jan 2014 11:51:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:51:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:51:14 - XML: Processed 655480 elements - found 641 jobs
Fri 17 Jan 2014 11:51:14 - job 7348007 report time 1389955625 does not match current heartbeat 1389955745 : ignoring job
Fri 17 Jan 2014 11:51:14 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 11:51:15 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 11:51:15 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:51:15 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:51:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:51:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:51:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:51:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:51:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:51:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:51:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:51:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:51:15 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:51:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:51:20 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:51:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:51:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:51:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:51:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:51:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:51:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:51:23 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:51:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875557
Fri 17 Jan 2014 11:51:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:51:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875557
Fri 17 Jan 2014 11:51:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:51:30 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:51:30 - job_xml_thread(): Done retrieving: data size 43875557
Fri 17 Jan 2014 11:51:30 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:51:30 - XML: Start document: iteration 3
Fri 17 Jan 2014 11:51:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:51:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:51:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:51:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:51:38 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:51:38 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 11:51:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:51:42 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:51:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:51:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:51:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:51:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:51:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:51:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:51:43 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:51:43 - XML: Processed 655480 elements - found 641 jobs
Fri 17 Jan 2014 11:51:43 - job 7348007 report time 1389955625 does not match current heartbeat 1389955745 : ignoring job
Fri 17 Jan 2014 11:51:43 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 11:51:43 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 11:51:43 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:51:43 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:51:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:51:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:51:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:51:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:51:47 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:51:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 11:51:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:51:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:51:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:51:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:51:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:51:50 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:51:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43869800
Fri 17 Jan 2014 11:51:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:51:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43869800
Fri 17 Jan 2014 11:51:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:51:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:51:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:51:58 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:51:58 - job_xml_thread(): Done retrieving: data size 43869800
Fri 17 Jan 2014 11:51:58 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:51:58 - XML: Start document: iteration 4
Fri 17 Jan 2014 11:52:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:52:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:52:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:52:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:52:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:52:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:52:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:52:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:52:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:52:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:52:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:52:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:52:08 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:52:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:52:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 11:52:09 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:52:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 11:52:09 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:52:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5776 values 91150 bits 11393 bytes 
Fri 17 Jan 2014 11:52:10 - XML: Processed 655476 elements - found 639 jobs
Fri 17 Jan 2014 11:52:10 - job 7347941 appears to have finished
Fri 17 Jan 2014 11:52:10 - job 36799 appears to have finished
Fri 17 Jan 2014 11:52:10 - job 7348006 appears to have finished
Fri 17 Jan 2014 11:52:10 - job 7348014 field 'start_timestamp' changed since saved from: 1389955801 to: 1389955738
Fri 17 Jan 2014 11:52:10 - job 7348013 report time 1389955745 does not match current heartbeat 1389955866 : ignoring job
Fri 17 Jan 2014 11:52:10 - job 7348018 report time 1389955745 does not match current heartbeat 1389955866 : ignoring job
Fri 17 Jan 2014 11:52:10 - job 7347908 appears to have finished
Fri 17 Jan 2014 11:52:10 - job_xml_thread(): Found 8 updated jobs.
Fri 17 Jan 2014 11:52:10 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 11:52:12 - job_xml_thread(): Done storing. succesfully stored: 8 jobs
Fri 17 Jan 2014 11:52:12 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:52:12 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:52:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:52:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:52:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:52:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:52:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:52:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:52:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:52:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:52:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:52:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:52:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:52:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43828441
Fri 17 Jan 2014 11:52:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:52:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43828441
Fri 17 Jan 2014 11:52:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:52:27 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:52:27 - job_xml_thread(): Done retrieving: data size 43828441
Fri 17 Jan 2014 11:52:27 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:52:27 - XML: Start document: iteration 5
Fri 17 Jan 2014 11:52:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:52:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:52:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:52:36 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:52:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:52:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:52:37 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:52:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:52:37 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:52:37 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:52:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:52:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:52:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:52:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:52:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:52:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:52:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:52:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:52:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:52:41 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:52:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 11:52:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:52:42 - XML: Processed 655476 elements - found 639 jobs
Fri 17 Jan 2014 11:52:42 - job 7348013 report time 1389955745 does not match current heartbeat 1389955866 : ignoring job
Fri 17 Jan 2014 11:52:42 - job 7348018 report time 1389955745 does not match current heartbeat 1389955866 : ignoring job
Fri 17 Jan 2014 11:52:42 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 11:52:42 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 11:52:42 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:52:42 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:52:44 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:52:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43847628
Fri 17 Jan 2014 11:52:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:52:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43847628
Fri 17 Jan 2014 11:52:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:52:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:52:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:52:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:52:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:52:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:52:56 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:52:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:52:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:52:57 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:52:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:52:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:52:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:52:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:52:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:52:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:52:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:52:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:52:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:52:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:52:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:52:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:52:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:53:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:53:02 - job_xml_thread(): Done retrieving: data size 43867036
Fri 17 Jan 2014 11:53:02 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:53:02 - XML: Start document: iteration 6
Fri 17 Jan 2014 11:53:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43867036
Fri 17 Jan 2014 11:53:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:53:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867036
Fri 17 Jan 2014 11:53:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:53:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:53:09 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:53:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:53:09 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:53:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 11:53:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 11:53:09 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:53:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8911 values 140612 bits 17576 bytes 
Fri 17 Jan 2014 11:53:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:53:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:53:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:53:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:53:15 - XML: Processed 655476 elements - found 639 jobs
Fri 17 Jan 2014 11:53:15 - job 7348013 report time 1389955745 does not match current heartbeat 1389955866 : ignoring job
Fri 17 Jan 2014 11:53:15 - job 7348018 report time 1389955745 does not match current heartbeat 1389955866 : ignoring job
Fri 17 Jan 2014 11:53:16 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 11:53:16 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 11:53:16 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:53:16 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:53:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:53:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:53:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:53:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:53:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:53:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:53:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:53:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:53:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:53:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:53:26 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:53:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:53:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:53:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:53:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:53:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:53:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:53:29 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:53:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43706019
Fri 17 Jan 2014 11:53:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:53:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43706019
Fri 17 Jan 2014 11:53:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:53:31 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:53:31 - job_xml_thread(): Done retrieving: data size 43706019
Fri 17 Jan 2014 11:53:31 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:53:31 - XML: Start document: iteration 7
Fri 17 Jan 2014 11:53:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:53:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:53:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:53:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:53:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:53:50 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:53:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:53:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:53:50 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:53:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:53:50 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:53:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:53:50 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:53:52 - XML: Processed 653688 elements - found 639 jobs
Fri 17 Jan 2014 11:53:52 - job 7348013 report time 1389955745 does not match current heartbeat 1389955866 : ignoring job
Fri 17 Jan 2014 11:53:52 - job 7348018 report time 1389955745 does not match current heartbeat 1389955866 : ignoring job
Fri 17 Jan 2014 11:53:52 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 11:53:52 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 11:53:52 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:53:52 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:53:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:53:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:53:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:53:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:53:55 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:53:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 11:53:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:53:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:53:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:53:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:53:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:53:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:53:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43202331
Fri 17 Jan 2014 11:53:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:53:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43202331
Fri 17 Jan 2014 11:53:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:54:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:54:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:54:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:54:06 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:54:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:54:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:54:07 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:54:07 - job_xml_thread(): Done retrieving: data size 43202331
Fri 17 Jan 2014 11:54:07 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:54:07 - XML: Start document: iteration 8
Fri 17 Jan 2014 11:54:08 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:54:08 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:54:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:54:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:54:08 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:54:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:54:09 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:54:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:54:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 11:54:10 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:54:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5737 values 90479 bits 11309 bytes 
Fri 17 Jan 2014 11:54:10 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:54:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 11:54:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:54:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:54:17 - XML: Processed 647370 elements - found 639 jobs
Fri 17 Jan 2014 11:54:17 - job 7348022 field 'start_timestamp' changed since saved from: 1389955907 to: 1389955860
Fri 17 Jan 2014 11:54:17 - job 7347705 appears to have finished
Fri 17 Jan 2014 11:54:17 - job 7348016 appears to have finished
Fri 17 Jan 2014 11:54:17 - job 7348017 appears to have finished
Fri 17 Jan 2014 11:54:17 - job 7348015 appears to have finished
Fri 17 Jan 2014 11:54:17 - job_xml_thread(): Found 11 updated jobs.
Fri 17 Jan 2014 11:54:17 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 11:54:18 - job_xml_thread(): Done storing. succesfully stored: 11 jobs
Fri 17 Jan 2014 11:54:18 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:54:18 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:54:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:54:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:54:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:54:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:54:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:54:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:54:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:54:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:54:21 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:54:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43242155
Fri 17 Jan 2014 11:54:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:54:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43242155
Fri 17 Jan 2014 11:54:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:54:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:54:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:54:24 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 11:54:24 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 11:54:24 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:54:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:54:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:54:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:54:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:54:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:54:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:54:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:54:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:54:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43242155
Fri 17 Jan 2014 11:54:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:54:33 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:54:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:54:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:54:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:54:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:54:42 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:54:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:54:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:54:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:54:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:54:44 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:54:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 11:54:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:54:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:54:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:54:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:54:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:54:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:54:45 - job_xml_thread(): Done retrieving: data size 43763595
Fri 17 Jan 2014 11:54:45 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:54:45 - XML: Start document: iteration 9
Fri 17 Jan 2014 11:54:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:54:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:54:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43763595
Fri 17 Jan 2014 11:54:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:54:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:54:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:54:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:54:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:54:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43763595
Fri 17 Jan 2014 11:54:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:54:59 - XML: Processed 654722 elements - found 639 jobs
Fri 17 Jan 2014 11:54:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:54:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:55:00 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 11:55:00 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 11:55:00 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:55:01 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:55:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:55:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:55:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:55:06 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:55:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:55:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:55:07 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:55:07 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:55:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:55:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:55:07 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:55:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:55:08 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:55:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:55:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:55:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:55:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:55:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:55:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:55:09 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:55:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43876993
Fri 17 Jan 2014 11:55:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:55:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43876993
Fri 17 Jan 2014 11:55:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:55:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:55:10 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:55:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:55:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 11:55:12 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:55:12 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:55:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 11:55:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8678 values 136874 bits 17109 bytes 
Fri 17 Jan 2014 11:55:16 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:55:16 - job_xml_thread(): Done retrieving: data size 43876993
Fri 17 Jan 2014 11:55:16 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:55:16 - XML: Start document: iteration 10
Fri 17 Jan 2014 11:55:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:55:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:55:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:55:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:55:23 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:55:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:55:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:55:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:55:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:55:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:55:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:55:31 - XML: Processed 655476 elements - found 639 jobs
Fri 17 Jan 2014 11:55:31 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 11:55:31 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 11:55:31 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:55:31 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:55:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:55:33 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:55:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:55:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:55:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:55:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:55:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:55:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:55:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:55:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43840826
Fri 17 Jan 2014 11:55:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:55:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43840826
Fri 17 Jan 2014 11:55:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:55:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:55:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:55:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:55:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:55:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:55:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:55:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:55:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:55:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43840826
Fri 17 Jan 2014 11:55:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:55:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:55:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:55:46 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:55:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:55:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:55:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:55:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:55:56 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:55:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:55:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:55:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:55:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:55:58 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:55:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 11:55:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:55:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:55:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:55:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:55:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:55:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:55:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:56:00 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:56:00 - job_xml_thread(): Done retrieving: data size 43828086
Fri 17 Jan 2014 11:56:00 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:56:00 - XML: Start document: iteration 11
Fri 17 Jan 2014 11:56:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43828086
Fri 17 Jan 2014 11:56:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:56:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:56:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:56:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:56:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:56:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43828086
Fri 17 Jan 2014 11:56:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:56:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:56:12 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:56:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:56:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 11:56:13 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:56:13 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:56:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 11:56:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5835 values 92041 bits 11505 bytes 
Fri 17 Jan 2014 11:56:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:56:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:56:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:56:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:56:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:56:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:56:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:56:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:56:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:56:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:56:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:56:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:56:20 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:56:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:56:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:56:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:56:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:56:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:56:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:56:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:56:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:56:22 - XML: Processed 655478 elements - found 640 jobs
Fri 17 Jan 2014 11:56:22 - job 7347974 appears to have finished
Fri 17 Jan 2014 11:56:22 - job 7348029 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 11:56:22 - job 7348021 appears to have finished
Fri 17 Jan 2014 11:56:22 - job 7348030 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 11:56:22 - job 7347934 appears to have finished
Fri 17 Jan 2014 11:56:22 - job 7347964 appears to have finished
Fri 17 Jan 2014 11:56:22 - job_xml_thread(): Found 11 updated jobs.
Fri 17 Jan 2014 11:56:22 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 11:56:22 - job_xml_thread(): Done storing. succesfully stored: 11 jobs
Fri 17 Jan 2014 11:56:22 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:56:22 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:56:25 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:56:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 11:56:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:56:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:56:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43880670
Fri 17 Jan 2014 11:56:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:56:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43880670
Fri 17 Jan 2014 11:56:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:56:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:56:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:56:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:56:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:56:38 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:56:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:56:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:56:38 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:56:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:56:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:56:39 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:56:39 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:56:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:56:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:56:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:56:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:56:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:56:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:56:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:56:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:56:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:56:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:56:41 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:56:41 - job_xml_thread(): Done retrieving: data size 43869942
Fri 17 Jan 2014 11:56:41 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:56:41 - XML: Start document: iteration 12
Fri 17 Jan 2014 11:56:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43869942
Fri 17 Jan 2014 11:56:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:56:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43869942
Fri 17 Jan 2014 11:56:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:56:54 - XML: Processed 655478 elements - found 640 jobs
Fri 17 Jan 2014 11:56:54 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 11:56:54 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 11:56:54 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:56:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:56:54 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:56:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:56:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:56:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:56:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:56:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:56:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:56:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:57:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:57:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:57:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:57:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:57:01 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:57:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:57:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:57:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:57:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:57:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:57:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:57:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:57:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:57:04 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:57:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43892492
Fri 17 Jan 2014 11:57:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:57:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43892492
Fri 17 Jan 2014 11:57:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:57:09 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:57:09 - job_xml_thread(): Done retrieving: data size 43892492
Fri 17 Jan 2014 11:57:09 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:57:09 - XML: Start document: iteration 13
Fri 17 Jan 2014 11:57:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:57:13 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:57:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:57:14 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:57:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 11:57:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 11:57:14 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:57:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9268 values 146205 bits 18275 bytes 
Fri 17 Jan 2014 11:57:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:57:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:57:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:57:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:57:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:57:21 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:57:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:57:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:57:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:57:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:57:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:57:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:57:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:57:25 - XML: Processed 655478 elements - found 640 jobs
Fri 17 Jan 2014 11:57:25 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 11:57:25 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 11:57:25 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:57:25 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:57:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:57:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:57:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:57:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:57:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:57:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:57:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:57:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:57:30 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:57:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 11:57:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:57:30 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:57:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853504
Fri 17 Jan 2014 11:57:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:57:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853504
Fri 17 Jan 2014 11:57:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:57:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:57:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:57:39 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 11:57:39 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:57:40 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:57:40 - job_xml_thread(): Done retrieving: data size 43853504
Fri 17 Jan 2014 11:57:40 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:57:40 - XML: Start document: iteration 14
Fri 17 Jan 2014 11:57:42 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:57:42 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:57:42 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 11:57:42 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 11:57:42 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 11:57:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:57:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:57:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:57:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:57:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:57:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:57:53 - XML: Processed 655478 elements - found 640 jobs
Fri 17 Jan 2014 11:57:53 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 11:57:53 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 11:57:53 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:57:53 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:57:53 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:57:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:57:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:57:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:57:53 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:57:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:57:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:57:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:57:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:57:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:57:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:57:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:57:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:57:55 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 877655 values 13851235 bits 1731404 bytes 
Fri 17 Jan 2014 11:57:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:57:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43857358
Fri 17 Jan 2014 11:57:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:57:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43857358
Fri 17 Jan 2014 11:57:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:58:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:58:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:58:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:58:08 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:58:08 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:58:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:58:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:58:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:58:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:58:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:58:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:58:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:58:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:58:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:58:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:58:13 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:58:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:58:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:58:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:58:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:58:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:58:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:58:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:58:14 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:58:15 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:58:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 11:58:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:58:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 11:58:15 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:58:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99081 bits 12385 bytes 
Fri 17 Jan 2014 11:58:17 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:58:17 - job_xml_thread(): Done retrieving: data size 43850729
Fri 17 Jan 2014 11:58:17 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:58:17 - XML: Start document: iteration 15
Fri 17 Jan 2014 11:58:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43850729
Fri 17 Jan 2014 11:58:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:58:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43850729
Fri 17 Jan 2014 11:58:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:58:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:58:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:58:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:58:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:58:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:58:36 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:58:37 - XML: Processed 655470 elements - found 636 jobs
Fri 17 Jan 2014 11:58:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:58:37 - job 7348026 appears to have finished
Fri 17 Jan 2014 11:58:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:58:37 - job 7348025 appears to have finished
Fri 17 Jan 2014 11:58:37 - job 7347932 appears to have finished
Fri 17 Jan 2014 11:58:37 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:58:37 - job 7347832 appears to have finished
Fri 17 Jan 2014 11:58:37 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:58:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:58:37 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:58:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:58:37 - job 7347900 appears to have finished
Fri 17 Jan 2014 11:58:37 - job 7347844 appears to have finished
Fri 17 Jan 2014 11:58:38 - job_xml_thread(): Found 8 updated jobs.
Fri 17 Jan 2014 11:58:38 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 11:58:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:58:40 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:58:41 - job_xml_thread(): Done storing. succesfully stored: 8 jobs
Fri 17 Jan 2014 11:58:41 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:58:41 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:58:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:58:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:58:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:58:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:58:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:58:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:58:42 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:58:42 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 11:58:42 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:58:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 11:58:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:58:44 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:58:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858376
Fri 17 Jan 2014 11:58:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:58:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43858376
Fri 17 Jan 2014 11:58:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:58:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:58:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:58:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:58:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:58:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:58:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:58:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:58:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:58:55 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:58:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:58:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:58:56 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:58:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:58:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:58:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:58:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:58:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:58:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:58:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:58:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:58:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:58:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:59:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:59:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43857143
Fri 17 Jan 2014 11:59:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:59:03 - job_xml_thread(): Done retrieving: data size 43857143
Fri 17 Jan 2014 11:59:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43857143
Fri 17 Jan 2014 11:59:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:59:03 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:59:04 - XML: Start document: iteration 16
Fri 17 Jan 2014 11:59:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:59:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:59:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:59:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:59:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:59:15 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:59:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:59:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:59:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:59:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:59:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:59:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 11:59:16 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:59:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 11:59:16 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:59:16 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:59:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:59:16 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:59:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:59:16 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:59:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7857 values 123931 bits 15491 bytes 
Fri 17 Jan 2014 11:59:21 - XML: Processed 655470 elements - found 636 jobs
Fri 17 Jan 2014 11:59:21 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 11:59:21 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 11:59:21 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:59:21 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:59:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:59:23 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:59:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:59:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:59:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:59:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:59:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:59:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:59:26 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 11:59:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 11:59:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:59:27 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:59:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43791042
Fri 17 Jan 2014 11:59:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:59:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43791042
Fri 17 Jan 2014 11:59:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:59:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:59:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:59:36 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 11:59:36 - job_xml_thread(): Done retrieving: data size 43791042
Fri 17 Jan 2014 11:59:36 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 11:59:36 - XML: Start document: iteration 17
Fri 17 Jan 2014 11:59:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 11:59:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 11:59:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 11:59:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 11:59:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 11:59:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 11:59:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:59:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 11:59:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 11:59:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 11:59:40 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 11:59:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 11:59:48 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 11:59:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 11:59:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 11:59:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:59:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 11:59:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 11:59:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 11:59:50 - XML: Processed 654720 elements - found 636 jobs
Fri 17 Jan 2014 11:59:50 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 11:59:50 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 11:59:50 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 11:59:50 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 11:59:53 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 11:59:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43235222
Fri 17 Jan 2014 11:59:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 11:59:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43235222
Fri 17 Jan 2014 11:59:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 11:59:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 11:59:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:00:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:00:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:00:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:00:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:00:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:00:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:00:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:00:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:00:05 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:00:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:00:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:00:06 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:00:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:00:08 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:00:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:00:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:00:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:00:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:00:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:00:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:00:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:00:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43222411
Fri 17 Jan 2014 12:00:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:00:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43222411
Fri 17 Jan 2014 12:00:12 - job_xml_thread(): Done retrieving: data size 43222411
Fri 17 Jan 2014 12:00:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:00:12 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:00:12 - XML: Start document: iteration 18
Fri 17 Jan 2014 12:00:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:00:16 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:00:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:00:18 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:00:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 12:00:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 12:00:18 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:00:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148609 bits 18576 bytes 
Fri 17 Jan 2014 12:00:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:00:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:00:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:00:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:00:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:00:30 - XML: Processed 647524 elements - found 635 jobs
Fri 17 Jan 2014 12:00:30 - job 7344533 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:00:30 - job 7347945 appears to have finished
Fri 17 Jan 2014 12:00:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:00:30 - job 7348034 appears to have finished
Fri 17 Jan 2014 12:00:30 - job 7348035 appears to have finished
Fri 17 Jan 2014 12:00:30 - job_xml_thread(): Found 6 updated jobs.
Fri 17 Jan 2014 12:00:30 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 12:00:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:00:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:00:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:00:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:00:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:00:31 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:00:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:00:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:00:34 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:00:34 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Fri 17 Jan 2014 12:00:34 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:00:34 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:00:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:00:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:00:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:00:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:00:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:00:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:00:37 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:00:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43477047
Fri 17 Jan 2014 12:00:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:00:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43477047
Fri 17 Jan 2014 12:00:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:00:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:00:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:00:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:00:49 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:00:49 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:00:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:00:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:00:49 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:00:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:00:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:00:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:00:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:00:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:00:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:00:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:00:53 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:00:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:00:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:00:53 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:00:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 12:00:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:00:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:00:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:00:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:00:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:00:56 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:00:56 - job_xml_thread(): Done retrieving: data size 43814347
Fri 17 Jan 2014 12:00:56 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:00:56 - XML: Start document: iteration 19
Fri 17 Jan 2014 12:00:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43814347
Fri 17 Jan 2014 12:00:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:00:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43814347
Fri 17 Jan 2014 12:00:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:01:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:01:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:01:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:01:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:01:14 - XML: Processed 654798 elements - found 635 jobs
Fri 17 Jan 2014 12:01:14 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 12:01:14 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 12:01:14 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:01:14 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:01:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:01:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:01:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:01:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:01:18 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:01:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:01:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:01:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 12:01:19 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:01:19 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:01:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 12:01:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5875 values 92708 bits 11588 bytes 
Fri 17 Jan 2014 12:01:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:01:20 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:01:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:01:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:01:20 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:01:20 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:01:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:01:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:01:20 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:01:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:01:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:01:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:01:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:01:24 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:01:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43883039
Fri 17 Jan 2014 12:01:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:01:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43883039
Fri 17 Jan 2014 12:01:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:01:29 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:01:29 - job_xml_thread(): Done retrieving: data size 43883039
Fri 17 Jan 2014 12:01:29 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:01:29 - XML: Start document: iteration 20
Fri 17 Jan 2014 12:01:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:01:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:01:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:01:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:01:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:01:36 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:01:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:01:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:01:37 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:01:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:01:37 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:01:37 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:01:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:01:38 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:01:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 12:01:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:01:45 - XML: Processed 655468 elements - found 635 jobs
Fri 17 Jan 2014 12:01:45 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 12:01:45 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 12:01:45 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:01:45 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:01:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:01:48 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:01:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:01:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:01:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:01:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:01:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:01:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:01:51 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:01:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43838757
Fri 17 Jan 2014 12:01:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:01:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43838757
Fri 17 Jan 2014 12:01:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:01:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:01:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:02:00 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:02:00 - job_xml_thread(): Done retrieving: data size 43838757
Fri 17 Jan 2014 12:02:00 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:02:00 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 12:02:00 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 12:02:00 - Housekeeping: done.
Fri 17 Jan 2014 12:02:01 - XML: Start document: iteration 0
Fri 17 Jan 2014 12:02:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:02:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:02:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:02:06 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:02:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:02:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:02:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:02:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:02:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:02:09 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:02:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:02:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:02:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:02:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:02:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:02:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:02:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:02:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:02:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:02:14 - XML: Processed 655468 elements - found 635 jobs
Fri 17 Jan 2014 12:02:14 - job 7347976 appears to have finished
Fri 17 Jan 2014 12:02:14 - job 7344533 field 'start_timestamp' changed since saved from: 1389956349 to: 1389956347
Fri 17 Jan 2014 12:02:14 - job 7346749 appears to have finished
Fri 17 Jan 2014 12:02:14 - job 7348040 appears to have finished
Fri 17 Jan 2014 12:02:14 - job_xml_thread(): Found 7 updated jobs.
Fri 17 Jan 2014 12:02:14 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 12:02:14 - job_xml_thread(): Done storing. succesfully stored: 7 jobs
Fri 17 Jan 2014 12:02:14 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:02:14 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:02:15 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 12:02:15 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 12:02:15 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:02:16 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:02:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858573
Fri 17 Jan 2014 12:02:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:02:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43858573
Fri 17 Jan 2014 12:02:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:02:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:02:19 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:02:20 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:02:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 12:02:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:02:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 12:02:20 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:02:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9149 values 144860 bits 18107 bytes 
Fri 17 Jan 2014 12:02:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:02:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:02:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:02:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:02:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:02:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:02:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:02:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:02:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:02:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:02:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:02:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:02:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:02:29 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:02:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:02:30 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:02:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:02:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:02:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:02:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:02:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:02:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:02:31 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:02:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873877
Fri 17 Jan 2014 12:02:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:02:32 - job_xml_thread(): Done retrieving: data size 43873877
Fri 17 Jan 2014 12:02:32 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:02:32 - XML: Start document: iteration 1
Fri 17 Jan 2014 12:02:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873877
Fri 17 Jan 2014 12:02:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:02:35 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:02:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 12:02:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:02:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:02:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:02:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:02:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:02:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:02:46 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:02:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:02:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:02:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:02:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:02:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:02:47 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:02:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:02:48 - XML: Processed 655468 elements - found 635 jobs
Fri 17 Jan 2014 12:02:48 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 12:02:48 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 12:02:48 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:02:48 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:02:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:02:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:02:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:02:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:02:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:02:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:02:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:02:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:02:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:02:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43878653
Fri 17 Jan 2014 12:02:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:02:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43878653
Fri 17 Jan 2014 12:02:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:03:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:03:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:03:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:03:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:03:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:03:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:03:03 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:03:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:03:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:03:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:03:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:03:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:03:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:03:06 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:03:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:03:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:03:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:03:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:03:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:03:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:03:08 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:03:08 - job_xml_thread(): Done retrieving: data size 43881090
Fri 17 Jan 2014 12:03:08 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:03:08 - XML: Start document: iteration 2
Fri 17 Jan 2014 12:03:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43881090
Fri 17 Jan 2014 12:03:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:03:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43881090
Fri 17 Jan 2014 12:03:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:03:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:03:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:03:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:03:20 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:03:21 - XML: Processed 655468 elements - found 635 jobs
Fri 17 Jan 2014 12:03:21 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 12:03:21 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 12:03:22 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:03:22 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:03:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:03:22 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:03:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 12:03:22 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:03:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 12:03:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9413 values 148892 bits 18611 bytes 
Fri 17 Jan 2014 12:03:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:03:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:03:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:03:28 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:03:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:03:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:03:29 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:03:29 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:03:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:03:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:03:29 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:03:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:03:31 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:03:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:03:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:03:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:03:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:03:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:03:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:03:34 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:03:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43864906
Fri 17 Jan 2014 12:03:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:03:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43864906
Fri 17 Jan 2014 12:03:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:03:37 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:03:37 - job_xml_thread(): Done retrieving: data size 43864906
Fri 17 Jan 2014 12:03:37 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:03:37 - XML: Start document: iteration 3
Fri 17 Jan 2014 12:03:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:03:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:03:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:03:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:03:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:03:49 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:03:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:03:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:03:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:03:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:03:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:03:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:03:49 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:03:53 - XML: Processed 655468 elements - found 635 jobs
Fri 17 Jan 2014 12:03:53 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 12:03:53 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 12:03:53 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:03:54 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:03:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:03:57 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:03:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:03:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:03:57 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:03:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 12:03:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:03:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:03:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:03:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:03:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:03:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:03:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43850155
Fri 17 Jan 2014 12:03:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:03:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43850155
Fri 17 Jan 2014 12:03:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:04:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:04:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:04:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:04:06 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:04:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:04:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:04:08 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:04:08 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:04:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:04:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43850155
Fri 17 Jan 2014 12:04:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:04:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:04:09 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:04:09 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:04:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:04:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:04:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:04:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:04:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:04:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:04:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:04:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:04:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:04:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:04:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:04:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:04:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:04:18 - job_xml_thread(): Done retrieving: data size 43839457
Fri 17 Jan 2014 12:04:18 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:04:18 - XML: Start document: iteration 4
Fri 17 Jan 2014 12:04:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43839457
Fri 17 Jan 2014 12:04:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:04:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:04:22 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:04:22 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:04:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:04:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 12:04:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 12:04:23 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:04:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5872 values 92716 bits 11589 bytes 
Fri 17 Jan 2014 12:04:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:04:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:04:25 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:04:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:04:25 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:04:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43839457
Fri 17 Jan 2014 12:04:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:04:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:04:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:04:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:04:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:04:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:04:37 - XML: Processed 655470 elements - found 636 jobs
Fri 17 Jan 2014 12:04:37 - job 7347833 appears to have finished
Fri 17 Jan 2014 12:04:37 - job 7348043 appears to have finished
Fri 17 Jan 2014 12:04:37 - job 7348047 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:04:37 - job 7348046 report time 1389956469 does not match current heartbeat 1389956590 : ignoring job
Fri 17 Jan 2014 12:04:37 - job_xml_thread(): Found 6 updated jobs.
Fri 17 Jan 2014 12:04:37 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 12:04:38 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Fri 17 Jan 2014 12:04:38 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:04:38 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:04:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:04:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:04:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:04:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:04:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:04:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:04:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:04:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:04:39 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:04:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:04:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:04:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:04:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:04:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:04:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:04:41 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:04:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 12:04:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:04:41 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:04:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43881677
Fri 17 Jan 2014 12:04:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:04:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43881677
Fri 17 Jan 2014 12:04:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:04:42 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 12:04:42 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:04:44 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:04:44 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:04:44 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 12:04:44 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 12:04:44 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 12:04:52 - size of cluster 'LISA Cluster': 624 hosts 79468 metrics 777710 values 12292326 bits 1536540 bytes 
Fri 17 Jan 2014 12:04:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:04:53 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:04:53 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:04:53 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:04:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:04:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:04:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:04:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:04:56 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:04:56 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:04:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:04:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:04:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:04:57 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:04:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:04:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:04:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:04:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:04:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:04:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:05:01 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:05:01 - job_xml_thread(): Done retrieving: data size 43855911
Fri 17 Jan 2014 12:05:01 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:05:01 - XML: Start document: iteration 5
Fri 17 Jan 2014 12:05:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855911
Fri 17 Jan 2014 12:05:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:05:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855911
Fri 17 Jan 2014 12:05:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:05:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:05:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:05:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:05:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:05:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:05:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:05:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:05:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:05:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:05:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:05:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:05:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:05:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:05:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:05:23 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:05:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:05:23 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:05:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 12:05:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 12:05:23 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:05:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6374 values 100580 bits 12572 bytes 
Fri 17 Jan 2014 12:05:24 - XML: Processed 655470 elements - found 636 jobs
Fri 17 Jan 2014 12:05:24 - job 7348046 report time 1389956469 does not match current heartbeat 1389956590 : ignoring job
Fri 17 Jan 2014 12:05:24 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 12:05:24 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 12:05:24 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:05:24 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:05:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:05:24 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:05:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:05:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:05:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:05:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:05:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:05:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:05:28 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:05:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43788209
Fri 17 Jan 2014 12:05:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:05:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43788209
Fri 17 Jan 2014 12:05:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:05:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:05:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:05:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:05:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:05:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:05:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:05:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:05:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:05:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:05:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:05:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:05:39 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:05:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:05:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:05:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:05:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:05:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:05:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:05:42 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:05:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 12:05:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:05:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:05:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:05:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:05:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:05:44 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:05:44 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 12:05:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:05:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43259638
Fri 17 Jan 2014 12:05:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:05:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43259638
Fri 17 Jan 2014 12:05:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:05:46 - job_xml_thread(): Done retrieving: data size 43259638
Fri 17 Jan 2014 12:05:46 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:05:46 - XML: Start document: iteration 6
Fri 17 Jan 2014 12:05:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:05:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:05:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:05:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:06:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:06:03 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:06:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:06:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:06:04 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:06:04 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:06:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:06:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:06:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:06:07 - XML: Processed 648094 elements - found 632 jobs
Fri 17 Jan 2014 12:06:07 - job 7347967 appears to have finished
Fri 17 Jan 2014 12:06:07 - job 7347954 appears to have finished
Fri 17 Jan 2014 12:06:07 - job 7347926 appears to have finished
Fri 17 Jan 2014 12:06:08 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 12:06:08 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 12:06:08 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 12:06:08 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:06:08 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:06:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:06:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:06:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:06:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:06:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:06:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:06:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:06:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:06:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:06:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43200830
Fri 17 Jan 2014 12:06:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:06:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43200830
Fri 17 Jan 2014 12:06:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:06:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:06:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:06:23 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:06:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:06:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:06:23 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:06:24 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:06:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 12:06:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:06:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 12:06:24 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:06:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8692 values 137103 bits 17137 bytes 
Fri 17 Jan 2014 12:06:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:06:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:06:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:06:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:06:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:06:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:06:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:06:28 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:06:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:06:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:06:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:06:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:06:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:06:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:06:29 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:06:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:06:29 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:06:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:06:31 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:06:31 - job_xml_thread(): Done retrieving: data size 43445221
Fri 17 Jan 2014 12:06:31 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:06:31 - XML: Start document: iteration 7
Fri 17 Jan 2014 12:06:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43445221
Fri 17 Jan 2014 12:06:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:06:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43445221
Fri 17 Jan 2014 12:06:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:06:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:06:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:06:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:06:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:06:55 - XML: Processed 650374 elements - found 633 jobs
Fri 17 Jan 2014 12:06:55 - job 7348050 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:06:55 - job 7348051 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:06:55 - job 7348049 report time 1389956590 does not match current heartbeat 1389956710 : ignoring job
Fri 17 Jan 2014 12:06:55 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 12:06:55 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 12:06:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:06:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:06:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:06:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:06:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:06:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:06:56 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:06:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:06:56 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:06:56 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:06:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:06:56 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 12:06:56 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:06:56 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:06:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:06:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:06:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:06:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:06:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:06:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:06:56 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:06:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 12:06:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:06:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:06:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43846481
Fri 17 Jan 2014 12:06:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:07:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43846481
Fri 17 Jan 2014 12:07:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:07:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:07:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:07:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:07:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:07:11 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:07:11 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:07:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:07:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:07:12 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:07:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:07:12 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:07:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:07:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:07:12 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:07:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:07:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:07:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:07:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:07:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:07:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:07:16 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:07:16 - job_xml_thread(): Done retrieving: data size 43863136
Fri 17 Jan 2014 12:07:16 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:07:16 - XML: Start document: iteration 8
Fri 17 Jan 2014 12:07:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43863136
Fri 17 Jan 2014 12:07:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:07:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43863136
Fri 17 Jan 2014 12:07:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:07:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:07:24 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:07:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:07:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 12:07:25 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:07:25 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:07:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 12:07:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8800 values 138782 bits 17347 bytes 
Fri 17 Jan 2014 12:07:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:07:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:07:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:07:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:07:31 - XML: Processed 655464 elements - found 633 jobs
Fri 17 Jan 2014 12:07:31 - job 7348049 report time 1389956590 does not match current heartbeat 1389956710 : ignoring job
Fri 17 Jan 2014 12:07:31 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 12:07:31 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 12:07:31 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:07:31 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:07:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:07:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:07:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:07:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:07:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:07:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:07:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:07:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:07:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:07:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:07:37 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:07:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:07:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:07:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:07:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:07:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:07:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:07:41 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:07:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43852889
Fri 17 Jan 2014 12:07:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:07:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43852889
Fri 17 Jan 2014 12:07:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:07:46 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:07:46 - job_xml_thread(): Done retrieving: data size 43852889
Fri 17 Jan 2014 12:07:46 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:07:46 - XML: Start document: iteration 9
Fri 17 Jan 2014 12:07:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:07:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:07:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:07:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:07:57 - XML: Processed 655462 elements - found 632 jobs
Fri 17 Jan 2014 12:07:57 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 12:07:57 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 12:07:57 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:07:58 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:08:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:08:01 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:08:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:08:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:08:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:08:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:08:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:08:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:08:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:08:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:08:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:08:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:08:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:08:05 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:08:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 12:08:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:08:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:08:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:08:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:08:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:08:07 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 12:08:07 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 12:08:07 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:08:08 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:08:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43860081
Fri 17 Jan 2014 12:08:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:08:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43860081
Fri 17 Jan 2014 12:08:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:08:13 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:08:13 - job_xml_thread(): Done retrieving: data size 43860081
Fri 17 Jan 2014 12:08:13 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:08:13 - XML: Start document: iteration 10
Fri 17 Jan 2014 12:08:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:08:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:08:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:08:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:08:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:08:21 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:08:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:08:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:08:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:08:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:08:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:08:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:08:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:08:25 - XML: Processed 655464 elements - found 633 jobs
Fri 17 Jan 2014 12:08:25 - job 7348053 report time 1389956710 does not match current heartbeat 1389956831 : ignoring job
Fri 17 Jan 2014 12:08:25 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 12:08:25 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 12:08:25 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 12:08:25 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:08:25 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:08:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:08:26 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:08:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:08:26 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:08:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 12:08:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 12:08:27 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:08:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5677 values 89469 bits 11183 bytes 
Fri 17 Jan 2014 12:08:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:08:31 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:08:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:08:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:08:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:08:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:08:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:08:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:08:33 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:08:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43836163
Fri 17 Jan 2014 12:08:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:08:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43836163
Fri 17 Jan 2014 12:08:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:08:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:08:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:08:40 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:08:40 - job_xml_thread(): Done retrieving: data size 43836163
Fri 17 Jan 2014 12:08:40 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:08:40 - XML: Start document: iteration 11
Fri 17 Jan 2014 12:08:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:08:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:08:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:08:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:08:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:08:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:08:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:08:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:08:48 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:08:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:08:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:08:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:08:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:08:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:08:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:08:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:08:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:08:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:08:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:08:55 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:08:55 - XML: Processed 655464 elements - found 633 jobs
Fri 17 Jan 2014 12:08:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 12:08:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:08:55 - job 7348053 report time 1389956710 does not match current heartbeat 1389956831 : ignoring job
Fri 17 Jan 2014 12:08:55 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 12:08:55 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 12:08:55 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:08:55 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:08:57 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:08:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43852490
Fri 17 Jan 2014 12:08:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:08:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43852490
Fri 17 Jan 2014 12:08:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:09:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:09:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:09:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:09:07 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:09:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:09:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:09:08 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:09:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:09:08 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:09:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:09:08 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:09:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:09:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:09:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:09:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:09:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:09:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:09:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:09:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:09:10 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:09:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:09:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43868853
Fri 17 Jan 2014 12:09:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:09:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43868853
Fri 17 Jan 2014 12:09:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:09:11 - job_xml_thread(): Done retrieving: data size 43868853
Fri 17 Jan 2014 12:09:13 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:09:13 - XML: Start document: iteration 12
Fri 17 Jan 2014 12:09:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:09:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:09:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:09:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:09:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:09:25 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:09:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:09:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:09:26 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:09:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:09:26 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:09:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:09:26 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:09:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:09:28 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:09:28 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:09:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 12:09:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:09:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 12:09:28 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:09:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9082 values 143232 bits 17904 bytes 
Fri 17 Jan 2014 12:09:30 - XML: Processed 655464 elements - found 633 jobs
Fri 17 Jan 2014 12:09:30 - job 7348053 report time 1389956710 does not match current heartbeat 1389956831 : ignoring job
Fri 17 Jan 2014 12:09:30 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 12:09:30 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 12:09:30 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:09:30 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:09:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:09:30 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:09:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:09:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:09:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:09:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:09:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:09:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:09:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:09:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43857938
Fri 17 Jan 2014 12:09:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:09:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43857938
Fri 17 Jan 2014 12:09:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:09:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:09:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:09:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:09:45 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:09:45 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:09:45 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:09:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:09:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:09:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:09:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:09:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:09:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:09:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:09:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:09:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:09:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:09:47 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:09:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 12:09:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:09:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:09:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:09:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:09:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:09:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:09:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:09:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:09:49 - job_xml_thread(): Done retrieving: data size 43866279
Fri 17 Jan 2014 12:09:49 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:09:49 - XML: Start document: iteration 13
Fri 17 Jan 2014 12:09:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43866279
Fri 17 Jan 2014 12:09:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:09:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43866279
Fri 17 Jan 2014 12:09:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:10:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:10:01 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:10:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:10:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:10:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:10:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:10:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:10:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:10:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:10:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:10:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:10:09 - XML: Processed 655462 elements - found 632 jobs
Fri 17 Jan 2014 12:10:09 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 12:10:09 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 12:10:09 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:10:09 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:10:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:10:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:10:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:10:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:10:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:10:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:10:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:10:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:10:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:10:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43849619
Fri 17 Jan 2014 12:10:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:10:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43849619
Fri 17 Jan 2014 12:10:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:10:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:10:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:10:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:10:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:10:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:10:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:10:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:10:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:10:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:10:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:10:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:10:24 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:10:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:10:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:10:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:10:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:10:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:10:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:10:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:10:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:10:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:10:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:10:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:10:29 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:10:29 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:10:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:10:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 12:10:29 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:10:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 12:10:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9294 values 146579 bits 18322 bytes 
Fri 17 Jan 2014 12:10:29 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:10:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870478
Fri 17 Jan 2014 12:10:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:10:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870478
Fri 17 Jan 2014 12:10:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:10:30 - job_xml_thread(): Done retrieving: data size 43870478
Fri 17 Jan 2014 12:10:30 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:10:30 - XML: Start document: iteration 14
Fri 17 Jan 2014 12:10:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:10:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:10:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:10:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:10:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:10:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:10:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:10:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:10:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:10:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:10:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:10:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:10:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:10:48 - XML: Processed 655472 elements - found 636 jobs
Fri 17 Jan 2014 12:10:48 - job 7348055 report time 1389956831 does not match current heartbeat 1389956951 : ignoring job
Fri 17 Jan 2014 12:10:48 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 12:10:48 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 12:10:50 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 12:10:50 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:10:50 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:10:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:10:52 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:10:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:10:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:10:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:10:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:10:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:10:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:10:55 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:10:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43830303
Fri 17 Jan 2014 12:10:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:10:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43830303
Fri 17 Jan 2014 12:10:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:10:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:10:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:11:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:11:03 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:11:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:11:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:11:06 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:11:06 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:11:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:11:06 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:11:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:11:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:11:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:11:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:11:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:11:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:11:10 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:11:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 12:11:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:11:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:11:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:11:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:11:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:11:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:11:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:11:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:11:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43790232
Fri 17 Jan 2014 12:11:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:11:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43790232
Fri 17 Jan 2014 12:11:12 - job_xml_thread(): Done retrieving: data size 43790232
Fri 17 Jan 2014 12:11:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:11:12 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:11:13 - XML: Start document: iteration 15
Fri 17 Jan 2014 12:11:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:11:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:11:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:11:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:11:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:11:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:11:25 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:11:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:11:25 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:11:25 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:11:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:11:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:11:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:11:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:11:29 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:11:29 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:11:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 12:11:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:11:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 12:11:30 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:11:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6187 values 97584 bits 12198 bytes 
Fri 17 Jan 2014 12:11:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:11:31 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:11:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:11:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:11:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:11:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:11:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:11:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:11:35 - XML: Processed 654724 elements - found 636 jobs
Fri 17 Jan 2014 12:11:35 - job 7348055 report time 1389956831 does not match current heartbeat 1389956951 : ignoring job
Fri 17 Jan 2014 12:11:35 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 12:11:35 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 12:11:35 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:11:35 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:11:37 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:11:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43629489
Fri 17 Jan 2014 12:11:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:11:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43629489
Fri 17 Jan 2014 12:11:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:11:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:11:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:11:44 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 12:11:44 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:11:45 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:11:45 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:11:45 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 12:11:45 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 12:11:45 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 12:11:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:11:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:11:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:11:49 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:11:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:11:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:11:50 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:11:50 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:11:50 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:11:50 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:11:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:11:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:11:51 - size of cluster 'LISA Cluster': 624 hosts 79487 metrics 857192 values 13523503 bits 1690437 bytes 
Fri 17 Jan 2014 12:11:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:11:53 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:11:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:11:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:11:54 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:11:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 12:11:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:11:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:11:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:11:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:11:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:11:57 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:11:57 - job_xml_thread(): Done retrieving: data size 43203710
Fri 17 Jan 2014 12:11:57 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:11:57 - XML: Start document: iteration 16
Fri 17 Jan 2014 12:11:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43203710
Fri 17 Jan 2014 12:11:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43203710
Fri 17 Jan 2014 12:11:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:11:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:12:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:12:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:12:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:12:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:12:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:12:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:12:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:12:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:12:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:12:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:12:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:12:10 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:12:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:12:17 - XML: Processed 647374 elements - found 636 jobs
Fri 17 Jan 2014 12:12:17 - job 7348057 report time 1389956951 does not match current heartbeat 1389957072 : ignoring job
Fri 17 Jan 2014 12:12:17 - job 7348011 appears to have finished
Fri 17 Jan 2014 12:12:17 - job 7348060 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:12:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:12:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:12:18 - job 7347983 appears to have finished
Fri 17 Jan 2014 12:12:18 - job 7347999 appears to have finished
Fri 17 Jan 2014 12:12:18 - job 7348045 appears to have finished
Fri 17 Jan 2014 12:12:18 - job_xml_thread(): Found 10 updated jobs.
Fri 17 Jan 2014 12:12:18 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 12:12:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:12:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:12:18 - job_xml_thread(): Done storing. succesfully stored: 10 jobs
Fri 17 Jan 2014 12:12:18 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:12:18 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:12:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:12:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:12:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:12:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:12:21 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:12:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43232940
Fri 17 Jan 2014 12:12:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:12:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43232940
Fri 17 Jan 2014 12:12:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:12:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:12:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:12:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:12:30 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:12:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:12:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:12:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:12:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:12:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:12:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:12:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:12:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:12:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43232940
Fri 17 Jan 2014 12:12:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:12:31 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:12:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 12:12:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 12:12:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:12:31 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:12:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9025 values 142351 bits 17793 bytes 
Fri 17 Jan 2014 12:12:33 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:12:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:12:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:12:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:12:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:12:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:12:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:12:44 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:12:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:12:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:12:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:12:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:12:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:12:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:12:45 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:12:45 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 12:12:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:12:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:12:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:12:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:12:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:12:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:12:47 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:12:47 - job_xml_thread(): Done retrieving: data size 43713934
Fri 17 Jan 2014 12:12:47 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:12:47 - XML: Start document: iteration 17
Fri 17 Jan 2014 12:12:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43713934
Fri 17 Jan 2014 12:12:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:12:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43713934
Fri 17 Jan 2014 12:12:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:12:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:12:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:13:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:13:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:13:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:13:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:13:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:13:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:13:07 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:13:07 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:13:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:13:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:13:07 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:13:08 - XML: Processed 653890 elements - found 636 jobs
Fri 17 Jan 2014 12:13:08 - job 7348057 report time 1389956951 does not match current heartbeat 1389957072 : ignoring job
Fri 17 Jan 2014 12:13:08 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 12:13:08 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 12:13:08 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:13:08 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:13:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:13:12 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:13:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:13:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:13:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:13:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:13:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:13:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:13:12 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:13:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 12:13:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:13:15 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:13:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862052
Fri 17 Jan 2014 12:13:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:13:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862052
Fri 17 Jan 2014 12:13:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:13:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:13:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:13:23 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:13:23 - job_xml_thread(): Done retrieving: data size 43862052
Fri 17 Jan 2014 12:13:23 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:13:23 - XML: Start document: iteration 18
Fri 17 Jan 2014 12:13:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:13:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:13:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:13:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:13:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:13:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:13:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:13:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:13:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:13:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:13:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:13:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:13:31 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:13:32 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:13:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 12:13:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:13:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 12:13:33 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:13:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5613 values 88473 bits 11059 bytes 
Fri 17 Jan 2014 12:13:36 - XML: Processed 655472 elements - found 636 jobs
Fri 17 Jan 2014 12:13:36 - job 7348057 report time 1389956951 does not match current heartbeat 1389957072 : ignoring job
Fri 17 Jan 2014 12:13:36 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 12:13:36 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 12:13:36 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:13:36 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:13:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:13:36 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:13:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:13:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:13:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:13:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:13:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:13:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:13:39 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:13:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43829123
Fri 17 Jan 2014 12:13:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:13:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43829123
Fri 17 Jan 2014 12:13:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:13:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:13:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:13:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:13:49 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:13:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:13:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:13:50 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:13:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:13:50 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:13:50 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:13:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:13:51 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:13:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:13:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:13:53 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:13:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 12:13:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:13:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:13:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:13:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:13:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:13:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:13:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:13:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:13:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:13:56 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:13:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43900227
Fri 17 Jan 2014 12:13:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:13:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43900227
Fri 17 Jan 2014 12:13:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:13:57 - job_xml_thread(): Done retrieving: data size 43900227
Fri 17 Jan 2014 12:13:57 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:13:57 - XML: Start document: iteration 19
Fri 17 Jan 2014 12:14:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:14:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:14:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:14:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:14:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:14:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:14:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:14:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:14:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:14:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:14:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:14:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:14:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:14:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:14:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:14:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:14:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:14:20 - XML: Processed 655734 elements - found 767 jobs
Fri 17 Jan 2014 12:14:20 - job 7348066 report time 1389957072 does not match current heartbeat 1389957193 : ignoring job
Fri 17 Jan 2014 12:14:20 - job_xml_thread(): Found 132 updated jobs.
Fri 17 Jan 2014 12:14:20 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 12:14:21 - job_xml_thread(): Done storing. succesfully stored: 132 jobs
Fri 17 Jan 2014 12:14:21 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:14:21 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:14:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:14:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:14:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:14:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:14:24 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:14:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43897470
Fri 17 Jan 2014 12:14:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:14:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43897470
Fri 17 Jan 2014 12:14:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:14:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:14:33 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:14:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:14:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:14:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:14:34 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:14:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:14:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 12:14:34 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:14:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 12:14:34 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:14:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8825 values 139110 bits 17388 bytes 
Fri 17 Jan 2014 12:14:36 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:14:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:14:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:14:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:14:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:14:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:14:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:14:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:14:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:14:36 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:14:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:14:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:14:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:14:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:14:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:14:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:14:40 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:14:40 - job_xml_thread(): Done retrieving: data size 43910516
Fri 17 Jan 2014 12:14:40 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:14:40 - XML: Start document: iteration 20
Fri 17 Jan 2014 12:14:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43910516
Fri 17 Jan 2014 12:14:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:14:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43910516
Fri 17 Jan 2014 12:14:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:14:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:14:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:14:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:14:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:14:53 - XML: Processed 655734 elements - found 767 jobs
Fri 17 Jan 2014 12:14:54 - job 7348066 report time 1389957072 does not match current heartbeat 1389957193 : ignoring job
Fri 17 Jan 2014 12:14:54 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 12:14:54 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 12:14:54 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:14:54 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:15:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:15:00 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:15:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:15:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:15:01 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 12:15:01 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 12:15:01 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:15:01 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:15:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:15:01 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:15:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:15:01 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:15:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:15:03 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:15:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:15:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:15:04 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:15:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 12:15:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:15:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:15:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:15:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:15:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:15:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:15:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43904282
Fri 17 Jan 2014 12:15:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:15:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43904282
Fri 17 Jan 2014 12:15:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:15:09 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:15:09 - job_xml_thread(): Done retrieving: data size 43904282
Fri 17 Jan 2014 12:15:09 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:15:09 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 12:15:09 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 12:15:10 - Housekeeping: done.
Fri 17 Jan 2014 12:15:10 - XML: Start document: iteration 0
Fri 17 Jan 2014 12:15:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:15:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:15:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:15:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:15:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:15:21 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:15:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:15:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:15:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:15:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:15:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:15:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:15:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:15:24 - XML: Processed 655734 elements - found 767 jobs
Fri 17 Jan 2014 12:15:24 - job 7348066 report time 1389957072 does not match current heartbeat 1389957193 : ignoring job
Fri 17 Jan 2014 12:15:24 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 12:15:24 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 12:15:24 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:15:24 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:15:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:15:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:15:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:15:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:15:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:15:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:15:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:15:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:15:30 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:15:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43911742
Fri 17 Jan 2014 12:15:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:15:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43911742
Fri 17 Jan 2014 12:15:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:15:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:15:34 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:15:35 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:15:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 12:15:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:15:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 12:15:35 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:15:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8598 values 135543 bits 16942 bytes 
Fri 17 Jan 2014 12:15:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:15:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:15:39 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:15:39 - job_xml_thread(): Done retrieving: data size 43911742
Fri 17 Jan 2014 12:15:39 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:15:39 - XML: Start document: iteration 1
Fri 17 Jan 2014 12:15:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:15:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:15:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:15:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:15:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:15:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:15:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:15:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:15:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:15:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:15:44 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:15:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:15:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:15:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:15:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:15:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:15:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:15:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:15:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:15:53 - XML: Processed 655734 elements - found 767 jobs
Fri 17 Jan 2014 12:15:53 - job 7348066 report time 1389957072 does not match current heartbeat 1389957193 : ignoring job
Fri 17 Jan 2014 12:15:53 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 12:15:53 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 12:15:53 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:15:53 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:15:55 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:15:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43885841
Fri 17 Jan 2014 12:15:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:15:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43885841
Fri 17 Jan 2014 12:15:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:15:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:15:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:16:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:16:06 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:16:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:16:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:16:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:16:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:16:07 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:16:07 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:16:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:16:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:16:07 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:16:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:16:08 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:16:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:16:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:16:08 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:16:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 12:16:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:16:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:16:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:16:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:16:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:16:08 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:16:09 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:16:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43923367
Fri 17 Jan 2014 12:16:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:16:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43923367
Fri 17 Jan 2014 12:16:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:16:10 - job_xml_thread(): Done retrieving: data size 43923367
Fri 17 Jan 2014 12:16:10 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:16:10 - XML: Start document: iteration 2
Fri 17 Jan 2014 12:16:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:16:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:16:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:16:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:16:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:16:27 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:16:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:16:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:16:28 - XML: Processed 655736 elements - found 768 jobs
Fri 17 Jan 2014 12:16:28 - job 7348030 appears to have finished
Fri 17 Jan 2014 12:16:28 - job 7348080 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:16:28 - job 7348070 field 'start_timestamp' changed since saved from: 1389957218 to: 1389957140
Fri 17 Jan 2014 12:16:28 - job 7348079 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:16:28 - job_xml_thread(): Found 7 updated jobs.
Fri 17 Jan 2014 12:16:28 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 12:16:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:16:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:16:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:16:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:16:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:16:29 - job_xml_thread(): Done storing. succesfully stored: 7 jobs
Fri 17 Jan 2014 12:16:29 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:16:29 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:16:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:16:30 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:16:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:16:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:16:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:16:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:16:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:16:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:16:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:16:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43937494
Fri 17 Jan 2014 12:16:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:16:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43937494
Fri 17 Jan 2014 12:16:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:16:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:16:35 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:16:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:16:36 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:16:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 12:16:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 12:16:36 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:16:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8921 values 140951 bits 17618 bytes 
Fri 17 Jan 2014 12:16:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:16:41 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:16:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:16:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:16:44 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:16:44 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:16:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:16:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:16:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:16:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:16:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:16:45 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:16:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:16:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:16:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:16:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:16:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:16:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:16:47 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:16:47 - job_xml_thread(): Done retrieving: data size 43942394
Fri 17 Jan 2014 12:16:47 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:16:47 - XML: Start document: iteration 3
Fri 17 Jan 2014 12:16:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43942394
Fri 17 Jan 2014 12:16:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:16:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43942394
Fri 17 Jan 2014 12:16:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:16:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:16:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:17:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:17:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:17:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:17:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:17:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:17:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:17:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:17:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:17:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:17:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:17:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:17:03 - XML: Processed 655736 elements - found 768 jobs
Fri 17 Jan 2014 12:17:03 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 12:17:03 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 12:17:03 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:17:03 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:17:08 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:17:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:17:08 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:17:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 12:17:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:17:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:17:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:17:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:17:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:17:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:17:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:17:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:17:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43897570
Fri 17 Jan 2014 12:17:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:17:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43897570
Fri 17 Jan 2014 12:17:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:17:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:17:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:17:19 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:17:19 - job_xml_thread(): Done retrieving: data size 43897570
Fri 17 Jan 2014 12:17:19 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:17:19 - XML: Start document: iteration 4
Fri 17 Jan 2014 12:17:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:17:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:17:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:17:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:17:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:17:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:17:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:17:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:17:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:17:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:17:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:17:30 - XML: Processed 655736 elements - found 768 jobs
Fri 17 Jan 2014 12:17:30 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 12:17:30 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 12:17:30 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:17:30 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:17:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:17:32 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:17:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:17:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:17:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:17:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:17:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:17:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:17:33 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:17:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43751105
Fri 17 Jan 2014 12:17:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:17:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43751105
Fri 17 Jan 2014 12:17:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:17:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:17:36 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:17:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:17:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 12:17:37 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:17:37 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:17:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 12:17:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9022 values 142745 bits 17843 bytes 
Fri 17 Jan 2014 12:17:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:17:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:17:45 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:17:45 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:17:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:17:46 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:17:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:17:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:17:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:17:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:17:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:17:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:17:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:17:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:17:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:17:49 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:17:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:17:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:17:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:17:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:17:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:17:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:17:51 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:17:51 - job_xml_thread(): Done retrieving: data size 43274054
Fri 17 Jan 2014 12:17:51 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:17:51 - XML: Start document: iteration 5
Fri 17 Jan 2014 12:17:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43274054
Fri 17 Jan 2014 12:17:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:17:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43274054
Fri 17 Jan 2014 12:17:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:17:55 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:17:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 12:17:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:18:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:18:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:18:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:18:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:18:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:18:09 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:18:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:18:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:18:11 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:18:11 - XML: Processed 648082 elements - found 769 jobs
Fri 17 Jan 2014 12:18:11 - job 7348081 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:18:11 - job 7348201 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:18:11 - job 7347961 appears to have finished
Fri 17 Jan 2014 12:18:11 - job_xml_thread(): Found 5 updated jobs.
Fri 17 Jan 2014 12:18:11 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 12:18:11 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:18:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:18:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:18:11 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:18:13 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Fri 17 Jan 2014 12:18:13 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:18:13 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:18:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:18:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:18:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:18:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:18:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:18:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:18:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:18:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:18:16 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:18:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43271979
Fri 17 Jan 2014 12:18:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:18:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43271979
Fri 17 Jan 2014 12:18:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:18:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:18:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:18:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:18:27 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:18:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:18:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:18:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:18:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:18:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:18:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:18:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:18:28 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:18:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:18:30 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:18:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:18:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:18:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:18:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:18:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:18:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:18:31 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:18:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43457550
Fri 17 Jan 2014 12:18:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:18:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43457550
Fri 17 Jan 2014 12:18:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:18:32 - job_xml_thread(): Done retrieving: data size 43457550
Fri 17 Jan 2014 12:18:32 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:18:32 - XML: Start document: iteration 6
Fri 17 Jan 2014 12:18:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:18:37 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:18:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:18:38 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:18:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 12:18:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 12:18:38 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:18:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9412 values 148745 bits 18593 bytes 
Fri 17 Jan 2014 12:18:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:18:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:18:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:18:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:18:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:18:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:18:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:18:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:18:44 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:18:45 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 12:18:45 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:18:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:18:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:18:46 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:18:46 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 12:18:46 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 12:18:46 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:18:46 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 12:18:51 - XML: Processed 649887 elements - found 769 jobs
Fri 17 Jan 2014 12:18:51 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 12:18:51 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 12:18:51 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:18:51 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:18:52 - size of cluster 'LISA Cluster': 624 hosts 79476 metrics 842460 values 13318842 bits 1664855 bytes 
Fri 17 Jan 2014 12:18:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:18:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:18:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:18:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:18:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:18:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:18:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:18:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:18:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:18:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873294
Fri 17 Jan 2014 12:18:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:18:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:19:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:19:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873294
Fri 17 Jan 2014 12:19:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:19:06 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:19:07 - job_xml_thread(): Done retrieving: data size 43873294
Fri 17 Jan 2014 12:19:07 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:19:07 - XML: Start document: iteration 7
Fri 17 Jan 2014 12:19:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:19:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:19:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:19:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:19:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:19:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:19:12 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:19:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:19:12 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:19:12 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:19:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:19:16 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:19:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 12:19:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:19:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:19:23 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:19:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:19:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:19:24 - XML: Processed 655584 elements - found 769 jobs
Fri 17 Jan 2014 12:19:24 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 12:19:24 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 12:19:24 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:19:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:19:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:19:24 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:19:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:19:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:19:27 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:19:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875765
Fri 17 Jan 2014 12:19:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:19:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:19:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875765
Fri 17 Jan 2014 12:19:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:19:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:19:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:19:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:19:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:19:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:19:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:19:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:19:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:19:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:19:37 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:19:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:19:38 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:19:38 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:19:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 12:19:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:19:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 12:19:38 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:19:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5793 values 91403 bits 11425 bytes 
Fri 17 Jan 2014 12:19:39 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:19:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:19:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:19:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:19:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:19:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:19:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:19:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:19:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:19:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:19:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:19:46 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:19:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 12:19:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:19:46 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:19:46 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:19:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43904488
Fri 17 Jan 2014 12:19:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:19:46 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 12:19:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43904488
Fri 17 Jan 2014 12:19:46 - job_xml_thread(): Done retrieving: data size 43904488
Fri 17 Jan 2014 12:19:46 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:19:46 - XML: Start document: iteration 8
Fri 17 Jan 2014 12:19:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:19:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:19:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:19:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:19:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:20:05 - XML: Processed 655736 elements - found 768 jobs
Fri 17 Jan 2014 12:20:05 - job 7348027 appears to have finished
Fri 17 Jan 2014 12:20:05 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 12:20:05 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 12:20:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:20:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:20:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:20:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:20:06 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 12:20:06 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:20:06 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:20:06 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:20:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:20:06 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:20:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:20:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:20:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:20:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:20:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:20:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:20:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:20:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:20:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:20:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:20:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:20:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43912585
Fri 17 Jan 2014 12:20:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:20:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43912585
Fri 17 Jan 2014 12:20:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:20:21 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:20:21 - job_xml_thread(): Done retrieving: data size 43912585
Fri 17 Jan 2014 12:20:21 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:20:21 - XML: Start document: iteration 9
Fri 17 Jan 2014 12:20:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:20:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:20:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:20:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:20:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:20:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:20:23 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:20:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:20:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:20:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:20:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43912585
Fri 17 Jan 2014 12:20:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:20:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:20:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:20:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:20:35 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:20:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:20:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:20:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:20:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:20:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:20:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:20:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:20:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:20:39 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:20:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:20:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:20:40 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:20:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:20:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 12:20:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 12:20:41 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:20:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99101 bits 12387 bytes 
Fri 17 Jan 2014 12:20:42 - XML: Processed 655746 elements - found 773 jobs
Fri 17 Jan 2014 12:20:42 - job 7348083 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:20:43 - job 7348082 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:20:43 - job_xml_thread(): Found 7 updated jobs.
Fri 17 Jan 2014 12:20:43 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 12:20:43 - job_xml_thread(): Done storing. succesfully stored: 7 jobs
Fri 17 Jan 2014 12:20:43 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:20:43 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:20:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:20:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:20:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:20:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:20:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:20:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:20:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:20:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:20:47 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:20:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 12:20:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:20:48 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:20:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43902070
Fri 17 Jan 2014 12:20:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:20:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43902070
Fri 17 Jan 2014 12:20:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:20:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:20:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:20:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:20:56 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:20:58 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:20:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:20:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:21:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:21:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:21:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:21:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:21:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:21:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:21:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:21:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:21:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:21:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:21:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:21:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:21:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:21:04 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:21:04 - job_xml_thread(): Done retrieving: data size 43913610
Fri 17 Jan 2014 12:21:04 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:21:04 - XML: Start document: iteration 10
Fri 17 Jan 2014 12:21:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43913610
Fri 17 Jan 2014 12:21:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43913610
Fri 17 Jan 2014 12:21:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:21:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:21:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:21:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:21:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:21:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:21:27 - XML: Processed 655746 elements - found 773 jobs
Fri 17 Jan 2014 12:21:27 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 12:21:27 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 12:21:27 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:21:27 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:21:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:21:27 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:21:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:21:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:21:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:21:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:21:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:21:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:21:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:21:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:21:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:21:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:21:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:21:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:21:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:21:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:21:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:21:31 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:21:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43929888
Fri 17 Jan 2014 12:21:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:21:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43929888
Fri 17 Jan 2014 12:21:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:21:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:21:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:21:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:21:40 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:21:42 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:21:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:21:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 12:21:42 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:21:42 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:21:42 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:21:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 12:21:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9279 values 146397 bits 18299 bytes 
Fri 17 Jan 2014 12:21:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:21:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:21:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:21:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:21:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:21:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:21:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:21:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:21:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:21:45 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:21:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:21:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:21:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:21:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:21:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:21:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:21:48 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:21:48 - job_xml_thread(): Done retrieving: data size 43903714
Fri 17 Jan 2014 12:21:48 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:21:48 - XML: Start document: iteration 11
Fri 17 Jan 2014 12:21:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43903714
Fri 17 Jan 2014 12:21:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43903714
Fri 17 Jan 2014 12:21:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:21:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:21:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:21:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:21:59 - XML: Processed 655745 elements - found 773 jobs
Fri 17 Jan 2014 12:21:59 - job 7348083 field 'start_timestamp' changed since saved from: 1389957559 to: 1389957505
Fri 17 Jan 2014 12:21:59 - job 7348084 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:21:59 - job 7348014 appears to have finished
Fri 17 Jan 2014 12:21:59 - job 7347848 appears to have finished
Fri 17 Jan 2014 12:21:59 - job_xml_thread(): Found 6 updated jobs.
Fri 17 Jan 2014 12:21:59 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 12:22:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:22:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:22:01 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Fri 17 Jan 2014 12:22:01 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:22:01 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:22:04 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 12:22:04 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 12:22:04 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:22:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:22:07 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:22:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:22:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:22:08 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:22:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:22:08 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:22:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:22:08 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:22:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:22:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:22:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:22:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:22:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:22:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:22:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:22:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:22:11 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:22:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 12:22:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:22:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:22:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43922997
Fri 17 Jan 2014 12:22:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:22:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43922997
Fri 17 Jan 2014 12:22:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:22:16 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:22:16 - job_xml_thread(): Done retrieving: data size 43922997
Fri 17 Jan 2014 12:22:16 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:22:16 - XML: Start document: iteration 12
Fri 17 Jan 2014 12:22:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:22:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:22:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:22:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:22:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:22:29 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:22:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:22:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:22:30 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:22:30 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:22:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:22:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:22:30 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:22:33 - XML: Processed 655746 elements - found 773 jobs
Fri 17 Jan 2014 12:22:33 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 12:22:33 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 12:22:33 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:22:33 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:22:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:22:35 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:22:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:22:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:22:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:22:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:22:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:22:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:22:38 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:22:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43898118
Fri 17 Jan 2014 12:22:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:22:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43898118
Fri 17 Jan 2014 12:22:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:22:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:22:42 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:22:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:22:44 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:22:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 12:22:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 12:22:44 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:22:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:22:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:22:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8632 values 136111 bits 17013 bytes 
Fri 17 Jan 2014 12:22:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:22:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:22:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:22:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:22:48 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:22:48 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:22:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:22:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:22:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:22:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:22:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:22:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:22:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:22:52 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:22:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:22:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:22:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:22:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:22:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:22:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:22:54 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:22:54 - job_xml_thread(): Done retrieving: data size 43910134
Fri 17 Jan 2014 12:22:54 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:22:54 - XML: Start document: iteration 13
Fri 17 Jan 2014 12:22:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43910134
Fri 17 Jan 2014 12:22:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:22:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43910134
Fri 17 Jan 2014 12:22:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:23:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:23:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:23:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:23:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:23:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:23:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:23:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:23:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:23:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:23:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:23:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:23:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:23:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:23:14 - XML: Processed 655746 elements - found 773 jobs
Fri 17 Jan 2014 12:23:14 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 12:23:14 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 12:23:14 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:23:14 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:23:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:23:19 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:23:19 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:23:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 12:23:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:23:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:23:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:23:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:23:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:23:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:23:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:23:21 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:23:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43835353
Fri 17 Jan 2014 12:23:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:23:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43835353
Fri 17 Jan 2014 12:23:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:23:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:23:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:23:29 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:23:29 - job_xml_thread(): Done retrieving: data size 43835353
Fri 17 Jan 2014 12:23:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:23:30 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:23:30 - XML: Start document: iteration 14
Fri 17 Jan 2014 12:23:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:23:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:23:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:23:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:23:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:23:31 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:23:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:23:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:23:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:23:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:23:39 - XML: Processed 654998 elements - found 773 jobs
Fri 17 Jan 2014 12:23:39 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 12:23:39 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 12:23:39 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:23:39 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:23:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:23:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:23:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:23:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:23:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:23:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:23:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:23:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:23:44 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:23:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43320808
Fri 17 Jan 2014 12:23:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:23:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:23:44 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:23:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43320808
Fri 17 Jan 2014 12:23:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:23:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:23:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:23:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 12:23:47 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:23:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 12:23:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:23:47 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:23:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8759 values 138101 bits 17262 bytes 
Fri 17 Jan 2014 12:23:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:23:54 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:23:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:23:55 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:23:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:23:55 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:23:56 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:23:56 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:23:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:23:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:23:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:23:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:23:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:23:59 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:23:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:23:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:23:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:23:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:23:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:23:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:24:01 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:24:01 - job_xml_thread(): Done retrieving: data size 43248102
Fri 17 Jan 2014 12:24:01 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:24:01 - XML: Start document: iteration 15
Fri 17 Jan 2014 12:24:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43248102
Fri 17 Jan 2014 12:24:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43248102
Fri 17 Jan 2014 12:24:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:24:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:24:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:24:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:24:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:24:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:24:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:24:16 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:24:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:24:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:24:17 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:24:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:24:17 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:24:17 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:24:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:24:19 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:24:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 12:24:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:24:21 - XML: Processed 647552 elements - found 776 jobs
Fri 17 Jan 2014 12:24:21 - job 7348110 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:24:21 - job 7348100 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:24:21 - job 7348101 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:24:21 - job 7348102 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:24:21 - job 7348103 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:24:21 - job 7348104 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:24:21 - job 7348105 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:24:21 - job 7348106 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:24:21 - job 7348107 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:24:21 - job 7348108 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:24:21 - job 7348109 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:24:21 - job 7348085 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:24:21 - job 7348087 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:24:21 - job 7348086 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:24:21 - job 7348089 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:24:21 - job 7348088 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:24:21 - job 7348203 report time 1389957675 does not match current heartbeat 1389957796 : ignoring job
Fri 17 Jan 2014 12:24:21 - job 7348001 appears to have finished
Fri 17 Jan 2014 12:24:21 - job 7348098 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:24:21 - job 7348099 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:24:21 - job 7348096 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:24:21 - job 7348097 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:24:21 - job 7348094 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:24:21 - job 7348095 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:24:21 - job 7348092 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:24:21 - job 7348093 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:24:21 - job 7348090 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:24:21 - job 7348091 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:24:21 - job 7348208 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:24:21 - job 7348200 report time 1389957675 does not match current heartbeat 1389957796 : ignoring job
Fri 17 Jan 2014 12:24:21 - job 7348207 report time 1389957675 does not match current heartbeat 1389957796 : ignoring job
Fri 17 Jan 2014 12:24:21 - job 7348206 report time 1389957675 does not match current heartbeat 1389957796 : ignoring job
Fri 17 Jan 2014 12:24:21 - job 7348205 report time 1389957675 does not match current heartbeat 1389957796 : ignoring job
Fri 17 Jan 2014 12:24:21 - job 7348204 report time 1389957675 does not match current heartbeat 1389957796 : ignoring job
Fri 17 Jan 2014 12:24:21 - job 7348210 report time 1389957675 does not match current heartbeat 1389957796 : ignoring job
Fri 17 Jan 2014 12:24:21 - job 7348198 report time 1389957675 does not match current heartbeat 1389957796 : ignoring job
Fri 17 Jan 2014 12:24:21 - job_xml_thread(): Found 32 updated jobs.
Fri 17 Jan 2014 12:24:21 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 12:24:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:24:24 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:24:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:24:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:24:24 - job_xml_thread(): Done storing. succesfully stored: 32 jobs
Fri 17 Jan 2014 12:24:24 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:24:24 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:24:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:24:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:24:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:24:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:24:26 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:24:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43312837
Fri 17 Jan 2014 12:24:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:24:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43312837
Fri 17 Jan 2014 12:24:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:24:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:24:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:24:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:24:38 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:24:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:24:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:24:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:24:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:24:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:24:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:24:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:24:40 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:24:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:24:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:24:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:24:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:24:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:24:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:24:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:24:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:24:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:24:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:24:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:24:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43791580
Fri 17 Jan 2014 12:24:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:24:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43791580
Fri 17 Jan 2014 12:24:43 - job_xml_thread(): Done retrieving: data size 43791580
Fri 17 Jan 2014 12:24:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:24:43 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:24:44 - XML: Start document: iteration 16
Fri 17 Jan 2014 12:24:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:24:47 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:24:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:24:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 12:24:48 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:24:48 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:24:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 12:24:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9136 values 144110 bits 18013 bytes 
Fri 17 Jan 2014 12:24:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:24:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:24:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:24:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:24:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:24:58 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:24:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:24:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:24:59 - XML: Processed 654022 elements - found 776 jobs
Fri 17 Jan 2014 12:24:59 - job 7348203 report time 1389957675 does not match current heartbeat 1389957796 : ignoring job
Fri 17 Jan 2014 12:25:00 - job 7348200 report time 1389957675 does not match current heartbeat 1389957796 : ignoring job
Fri 17 Jan 2014 12:25:00 - job 7348207 report time 1389957675 does not match current heartbeat 1389957796 : ignoring job
Fri 17 Jan 2014 12:25:00 - job 7348206 report time 1389957675 does not match current heartbeat 1389957796 : ignoring job
Fri 17 Jan 2014 12:25:00 - job 7348205 report time 1389957675 does not match current heartbeat 1389957796 : ignoring job
Fri 17 Jan 2014 12:25:00 - job 7348204 report time 1389957675 does not match current heartbeat 1389957796 : ignoring job
Fri 17 Jan 2014 12:25:00 - job 7348210 report time 1389957675 does not match current heartbeat 1389957796 : ignoring job
Fri 17 Jan 2014 12:25:00 - job 7348198 report time 1389957675 does not match current heartbeat 1389957796 : ignoring job
Fri 17 Jan 2014 12:25:00 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 12:25:00 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 12:25:00 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:25:00 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:25:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:25:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:25:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:25:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:25:01 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:25:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:25:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:25:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:25:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:25:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:25:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:25:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:25:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:25:04 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:25:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 12:25:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:25:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:25:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43907773
Fri 17 Jan 2014 12:25:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:25:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43907773
Fri 17 Jan 2014 12:25:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:25:15 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:25:15 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:25:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:25:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:25:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:25:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:25:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:25:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:25:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:25:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:25:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:25:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:25:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:25:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:25:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:25:20 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:25:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:25:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:25:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:25:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:25:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:25:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:25:22 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:25:22 - job_xml_thread(): Done retrieving: data size 43894318
Fri 17 Jan 2014 12:25:22 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:25:22 - XML: Start document: iteration 17
Fri 17 Jan 2014 12:25:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43894318
Fri 17 Jan 2014 12:25:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:25:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43894318
Fri 17 Jan 2014 12:25:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:25:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:25:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:25:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:25:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:25:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:25:36 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:25:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:25:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:25:37 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:25:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:25:37 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:25:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:25:37 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:25:44 - XML: Processed 655752 elements - found 776 jobs
Fri 17 Jan 2014 12:25:44 - job 7348203 report time 1389957675 does not match current heartbeat 1389957796 : ignoring job
Fri 17 Jan 2014 12:25:44 - job 7348200 report time 1389957675 does not match current heartbeat 1389957796 : ignoring job
Fri 17 Jan 2014 12:25:44 - job 7348207 report time 1389957675 does not match current heartbeat 1389957796 : ignoring job
Fri 17 Jan 2014 12:25:44 - job 7348206 report time 1389957675 does not match current heartbeat 1389957796 : ignoring job
Fri 17 Jan 2014 12:25:44 - job 7348205 report time 1389957675 does not match current heartbeat 1389957796 : ignoring job
Fri 17 Jan 2014 12:25:44 - job 7348204 report time 1389957675 does not match current heartbeat 1389957796 : ignoring job
Fri 17 Jan 2014 12:25:44 - job 7348210 report time 1389957675 does not match current heartbeat 1389957796 : ignoring job
Fri 17 Jan 2014 12:25:44 - job 7348198 report time 1389957675 does not match current heartbeat 1389957796 : ignoring job
Fri 17 Jan 2014 12:25:44 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 12:25:44 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 12:25:44 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:25:44 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:25:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:25:46 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:25:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:25:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:25:46 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 12:25:46 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:25:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:25:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:25:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:25:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:25:46 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:25:46 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 12:25:46 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:25:46 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 12:25:46 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 12:25:47 - size of cluster 'LISA Cluster': 624 hosts 79474 metrics 825849 values 13034996 bits 1629374 bytes 
Fri 17 Jan 2014 12:25:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:25:48 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:25:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:25:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43879756
Fri 17 Jan 2014 12:25:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:25:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:25:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 12:25:49 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:25:49 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:25:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6139 values 96838 bits 12104 bytes 
Fri 17 Jan 2014 12:25:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 12:25:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43879756
Fri 17 Jan 2014 12:25:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:25:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:25:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:25:59 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:25:59 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:25:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:25:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:25:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:25:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:26:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:26:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:26:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:26:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:26:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:26:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:26:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:26:03 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:26:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:26:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:26:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:26:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:26:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:26:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:26:07 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:26:07 - job_xml_thread(): Done retrieving: data size 43886249
Fri 17 Jan 2014 12:26:07 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:26:07 - XML: Start document: iteration 18
Fri 17 Jan 2014 12:26:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43886249
Fri 17 Jan 2014 12:26:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:26:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43886249
Fri 17 Jan 2014 12:26:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:26:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:26:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:26:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:26:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:26:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:26:21 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:26:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:26:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:26:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:26:23 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:26:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:26:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:26:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:26:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:26:30 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:26:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:26:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:26:30 - XML: Processed 655692 elements - found 746 jobs
Fri 17 Jan 2014 12:26:30 - job 7347978 appears to have finished
Fri 17 Jan 2014 12:26:30 - job 7348058 appears to have finished
Fri 17 Jan 2014 12:26:30 - job 7348110 field 'start_timestamp' changed since saved from: 1389957838 to: 1389957779
Fri 17 Jan 2014 12:26:30 - job 7348050 appears to have finished
Fri 17 Jan 2014 12:26:30 - job 7348051 appears to have finished
Fri 17 Jan 2014 12:26:30 - job 7348029 appears to have finished
Fri 17 Jan 2014 12:26:30 - job 7348024 appears to have finished
Fri 17 Jan 2014 12:26:30 - job 7348022 appears to have finished
Fri 17 Jan 2014 12:26:30 - job 7348039 appears to have finished
Fri 17 Jan 2014 12:26:30 - job 7348037 appears to have finished
Fri 17 Jan 2014 12:26:30 - job 7348031 appears to have finished
Fri 17 Jan 2014 12:26:30 - job 7347953 appears to have finished
Fri 17 Jan 2014 12:26:30 - job 7347925 appears to have finished
Fri 17 Jan 2014 12:26:30 - job 7347992 appears to have finished
Fri 17 Jan 2014 12:26:30 - job 7348004 appears to have finished
Fri 17 Jan 2014 12:26:30 - job 7348091 field 'start_timestamp' changed since saved from: 1389957800 to: 1389957718
Fri 17 Jan 2014 12:26:30 - job 7347898 appears to have finished
Fri 17 Jan 2014 12:26:30 - job 7348010 appears to have finished
Fri 17 Jan 2014 12:26:30 - job 7348036 appears to have finished
Fri 17 Jan 2014 12:26:30 - job 7347729 appears to have finished
Fri 17 Jan 2014 12:26:30 - job 7347902 appears to have finished
Fri 17 Jan 2014 12:26:30 - job 7348060 appears to have finished
Fri 17 Jan 2014 12:26:30 - job 7348208 field 'start_timestamp' changed since saved from: 1389957809 to: 1389957779
Fri 17 Jan 2014 12:26:30 - job 7347984 appears to have finished
Fri 17 Jan 2014 12:26:30 - job 7348042 appears to have finished
Fri 17 Jan 2014 12:26:30 - job 7346771 appears to have finished
Fri 17 Jan 2014 12:26:30 - job 7346508 appears to have finished
Fri 17 Jan 2014 12:26:30 - job 7348047 appears to have finished
Fri 17 Jan 2014 12:26:30 - job_xml_thread(): Found 31 updated jobs.
Fri 17 Jan 2014 12:26:30 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 12:26:30 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:26:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 12:26:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:26:30 - job_xml_thread(): Done storing. succesfully stored: 31 jobs
Fri 17 Jan 2014 12:26:30 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:26:30 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:26:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:26:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:26:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:26:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:26:33 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:26:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43884374
Fri 17 Jan 2014 12:26:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:26:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43884374
Fri 17 Jan 2014 12:26:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:26:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:26:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:26:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:26:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:26:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:26:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:26:45 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:26:45 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:26:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:26:45 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:26:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:26:45 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:26:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:26:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:26:46 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:26:46 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 12:26:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:26:48 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:26:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:26:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:26:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:26:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:26:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:26:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:26:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:26:49 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:26:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:26:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 12:26:49 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:26:49 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:26:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 12:26:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5827 values 91867 bits 11483 bytes 
Fri 17 Jan 2014 12:26:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:26:52 - job_xml_thread(): Done retrieving: data size 43892172
Fri 17 Jan 2014 12:26:52 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:26:52 - XML: Start document: iteration 19
Fri 17 Jan 2014 12:26:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43892172
Fri 17 Jan 2014 12:26:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:26:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43892172
Fri 17 Jan 2014 12:26:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:27:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:27:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:27:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:27:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:27:07 - XML: Processed 655692 elements - found 746 jobs
Fri 17 Jan 2014 12:27:07 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 12:27:07 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 12:27:08 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:27:08 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:27:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:27:13 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:27:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:27:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:27:14 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:27:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:27:14 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:27:14 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:27:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:27:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:27:15 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:27:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:27:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:27:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:27:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:27:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:27:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:27:17 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:27:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 12:27:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:27:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:27:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43903805
Fri 17 Jan 2014 12:27:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:27:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43903805
Fri 17 Jan 2014 12:27:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:27:23 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:27:23 - job_xml_thread(): Done retrieving: data size 43903805
Fri 17 Jan 2014 12:27:23 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:27:23 - XML: Start document: iteration 20
Fri 17 Jan 2014 12:27:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:27:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:27:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:27:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:27:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:27:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:27:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:27:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:27:35 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:27:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:27:35 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:27:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:27:35 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:27:39 - XML: Processed 655692 elements - found 746 jobs
Fri 17 Jan 2014 12:27:39 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 12:27:39 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 12:27:39 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:27:39 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:27:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:27:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:27:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:27:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:27:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:27:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:27:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:27:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:27:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:27:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43898177
Fri 17 Jan 2014 12:27:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:27:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43898177
Fri 17 Jan 2014 12:27:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:27:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:27:50 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:27:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:27:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 12:27:51 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:27:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8020 values 126481 bits 15810 bytes 
Fri 17 Jan 2014 12:27:51 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:27:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 12:27:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:27:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:27:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:27:53 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:27:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:27:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:27:53 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:27:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:27:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:27:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:27:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43898177
Fri 17 Jan 2014 12:27:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:27:54 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:27:54 - job_xml_thread(): Done retrieving: data size 43898177
Fri 17 Jan 2014 12:27:54 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:27:54 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 12:27:55 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 12:27:55 - Housekeeping: done.
Fri 17 Jan 2014 12:27:55 - XML: Start document: iteration 0
Fri 17 Jan 2014 12:27:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:27:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:28:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:28:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:28:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:28:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:28:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:28:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:28:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:28:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:28:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:28:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:28:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:28:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:28:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:28:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:28:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:28:13 - XML: Processed 655691 elements - found 746 jobs
Fri 17 Jan 2014 12:28:13 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 12:28:13 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 12:28:13 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:28:13 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:28:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:28:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:28:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:28:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:28:16 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:28:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 12:28:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:28:17 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:28:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43878722
Fri 17 Jan 2014 12:28:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:28:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43878722
Fri 17 Jan 2014 12:28:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:28:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:28:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:28:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:28:28 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:28:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:28:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:28:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:28:29 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:28:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:28:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:28:30 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:28:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:28:30 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:28:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:28:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:28:32 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:28:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:28:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:28:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:28:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:28:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:28:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:28:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:28:36 - job_xml_thread(): Done retrieving: data size 43891132
Fri 17 Jan 2014 12:28:36 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:28:36 - XML: Start document: iteration 1
Fri 17 Jan 2014 12:28:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43891132
Fri 17 Jan 2014 12:28:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:28:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43891132
Fri 17 Jan 2014 12:28:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:28:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:28:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:28:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:28:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:28:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:28:51 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:28:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:28:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 12:28:52 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:28:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:28:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:28:52 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:28:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 12:28:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6355 values 100227 bits 12528 bytes 
Fri 17 Jan 2014 12:28:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:28:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:28:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:28:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:28:53 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:28:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:28:53 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:28:57 - XML: Processed 655694 elements - found 747 jobs
Fri 17 Jan 2014 12:28:57 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 12:28:57 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 12:28:57 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 12:28:57 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:28:57 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:28:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:28:59 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:28:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:28:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:28:59 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 12:28:59 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 12:28:59 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:29:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:29:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:29:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:29:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:29:01 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:29:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43888352
Fri 17 Jan 2014 12:29:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:29:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43888352
Fri 17 Jan 2014 12:29:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:29:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:29:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:29:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:29:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:29:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:29:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:29:12 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:29:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:29:12 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:29:12 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:29:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:29:13 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:29:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:29:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:29:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:29:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:29:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:29:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:29:16 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:29:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 12:29:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:29:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:29:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:29:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:29:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:29:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:29:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43821197
Fri 17 Jan 2014 12:29:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:29:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43821197
Fri 17 Jan 2014 12:29:19 - job_xml_thread(): Done retrieving: data size 43821197
Fri 17 Jan 2014 12:29:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:29:19 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:29:19 - XML: Start document: iteration 2
Fri 17 Jan 2014 12:29:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:29:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:29:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:29:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:29:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:29:34 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:29:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:29:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:29:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:29:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:29:37 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:29:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:29:37 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:29:40 - XML: Processed 654946 elements - found 747 jobs
Fri 17 Jan 2014 12:29:40 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 12:29:40 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 12:29:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:29:40 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:29:40 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:29:40 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:29:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:29:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:29:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:29:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:29:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:29:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:29:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:29:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43346055
Fri 17 Jan 2014 12:29:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:29:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43346055
Fri 17 Jan 2014 12:29:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:29:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:29:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:29:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:29:52 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:29:54 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:29:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:29:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 12:29:54 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:29:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 12:29:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8961 values 141313 bits 17664 bytes 
Fri 17 Jan 2014 12:29:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:29:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:29:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:29:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:29:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:29:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:29:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:29:55 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:29:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:29:55 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:29:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:29:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:29:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:29:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:29:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:29:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:29:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:29:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:29:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:29:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:30:01 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:30:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43238660
Fri 17 Jan 2014 12:30:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:30:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43238660
Fri 17 Jan 2014 12:30:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:30:02 - job_xml_thread(): Done retrieving: data size 43238660
Fri 17 Jan 2014 12:30:02 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:30:02 - XML: Start document: iteration 3
Fri 17 Jan 2014 12:30:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:30:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:30:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:30:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:30:16 - XML: Processed 647496 elements - found 748 jobs
Fri 17 Jan 2014 12:30:16 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 12:30:16 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 12:30:16 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 12:30:16 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:30:16 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:30:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:30:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:30:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:30:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:30:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:30:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:30:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:30:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:30:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:30:22 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:30:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 12:30:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:30:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:30:23 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:30:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:30:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:30:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:30:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:30:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:30:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:30:24 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:30:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43307204
Fri 17 Jan 2014 12:30:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:30:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43307204
Fri 17 Jan 2014 12:30:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:30:32 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:30:32 - job_xml_thread(): Done retrieving: data size 43307204
Fri 17 Jan 2014 12:30:32 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:30:32 - XML: Start document: iteration 4
Fri 17 Jan 2014 12:30:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:30:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:30:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:30:38 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:30:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:30:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:30:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:30:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:30:39 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:30:39 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:30:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:30:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:30:39 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:30:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:30:44 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:30:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:30:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:30:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:30:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:30:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:30:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:30:47 - XML: Processed 648244 elements - found 748 jobs
Fri 17 Jan 2014 12:30:47 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 12:30:47 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 12:30:47 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:30:47 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:30:50 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:30:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43841953
Fri 17 Jan 2014 12:30:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:30:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43841953
Fri 17 Jan 2014 12:30:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:30:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:30:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:30:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:30:54 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:30:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:30:55 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:30:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 12:30:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 12:30:55 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:30:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8986 values 141708 bits 17713 bytes 
Fri 17 Jan 2014 12:31:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:31:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:31:01 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:31:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:31:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:31:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:31:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:31:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:31:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:31:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:31:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:31:02 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:31:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:31:06 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:31:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:31:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:31:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:31:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:31:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:31:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:31:08 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:31:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43901166
Fri 17 Jan 2014 12:31:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:31:08 - job_xml_thread(): Done retrieving: data size 43901166
Fri 17 Jan 2014 12:31:08 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:31:08 - XML: Start document: iteration 5
Fri 17 Jan 2014 12:31:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43901166
Fri 17 Jan 2014 12:31:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:31:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:31:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:31:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:31:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:31:22 - XML: Processed 655696 elements - found 748 jobs
Fri 17 Jan 2014 12:31:22 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 12:31:22 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 12:31:22 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:31:22 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:31:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:31:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:31:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:31:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:31:26 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:31:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:31:26 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:31:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:31:26 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:31:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:31:27 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:31:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:31:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:31:28 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:31:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 12:31:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:31:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:31:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:31:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:31:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:31:29 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:31:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43906102
Fri 17 Jan 2014 12:31:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:31:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43906102
Fri 17 Jan 2014 12:31:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:31:37 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:31:37 - job_xml_thread(): Done retrieving: data size 43906102
Fri 17 Jan 2014 12:31:37 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:31:37 - XML: Start document: iteration 6
Fri 17 Jan 2014 12:31:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:31:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:31:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:31:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:31:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:31:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:31:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:31:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:31:45 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:31:45 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:31:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:31:45 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:31:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:31:48 - XML: Processed 655696 elements - found 748 jobs
Fri 17 Jan 2014 12:31:48 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 12:31:48 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 12:31:48 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:31:48 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:31:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:31:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:31:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:31:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:31:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:31:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:31:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:31:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:31:53 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:31:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43893102
Fri 17 Jan 2014 12:31:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:31:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43893102
Fri 17 Jan 2014 12:31:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:31:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:31:55 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:31:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:31:56 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:31:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 12:31:56 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:31:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 12:31:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8832 values 139550 bits 17443 bytes 
Fri 17 Jan 2014 12:32:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:32:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:32:03 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:32:03 - job_xml_thread(): Done retrieving: data size 43893102
Fri 17 Jan 2014 12:32:03 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:32:03 - XML: Start document: iteration 7
Fri 17 Jan 2014 12:32:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:32:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:32:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:32:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:32:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:32:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:32:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:32:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:32:09 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:32:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:32:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:32:14 - XML: Processed 655694 elements - found 747 jobs
Fri 17 Jan 2014 12:32:14 - job 7348208 appears to have finished
Fri 17 Jan 2014 12:32:14 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 12:32:14 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 12:32:14 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 12:32:14 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:32:14 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:32:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:32:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:32:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:32:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:32:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:32:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:32:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:32:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:32:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:32:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43877231
Fri 17 Jan 2014 12:32:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:32:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43877231
Fri 17 Jan 2014 12:32:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:32:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:32:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:32:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:32:28 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:32:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:32:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:32:29 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:32:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:32:29 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:32:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:32:29 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:32:29 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:32:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:32:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:32:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:32:32 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:32:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:32:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:32:33 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:32:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 12:32:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:32:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:32:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:32:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:32:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:32:34 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:32:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43901108
Fri 17 Jan 2014 12:32:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:32:35 - job_xml_thread(): Done retrieving: data size 43901108
Fri 17 Jan 2014 12:32:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43901108
Fri 17 Jan 2014 12:32:35 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:32:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:32:35 - XML: Start document: iteration 8
Fri 17 Jan 2014 12:32:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:32:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:32:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:32:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:32:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:32:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:32:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:32:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:32:44 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:32:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:32:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:32:46 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 12:32:47 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:32:48 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:32:48 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 12:32:48 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:32:48 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 12:32:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:32:49 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 12:32:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:32:52 - size of cluster 'LISA Cluster': 624 hosts 79485 metrics 859324 values 13578738 bits 1697342 bytes 
Fri 17 Jan 2014 12:32:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:32:57 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:32:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:32:57 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:32:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:32:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:32:58 - XML: Processed 655694 elements - found 747 jobs
Fri 17 Jan 2014 12:32:58 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 12:32:58 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 12:32:58 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:32:58 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:32:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:32:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 12:32:58 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:32:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 12:32:58 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:32:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5771 values 91284 bits 11410 bytes 
Fri 17 Jan 2014 12:32:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:32:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:32:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:32:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:32:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:32:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:33:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:33:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43874457
Fri 17 Jan 2014 12:33:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:33:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43874457
Fri 17 Jan 2014 12:33:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:33:03 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:33:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 12:33:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:33:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:33:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:33:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:33:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:33:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:33:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:33:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:33:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:33:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:33:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:33:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:33:13 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:33:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:33:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:33:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:33:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:33:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:33:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:33:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:33:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:33:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:33:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43892230
Fri 17 Jan 2014 12:33:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:33:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43892230
Fri 17 Jan 2014 12:33:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:33:20 - job_xml_thread(): Done retrieving: data size 43892230
Fri 17 Jan 2014 12:33:20 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:33:20 - XML: Start document: iteration 9
Fri 17 Jan 2014 12:33:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:33:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:33:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:33:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:33:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:33:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:33:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:33:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:33:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:33:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:33:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:33:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:33:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:33:39 - XML: Processed 655694 elements - found 747 jobs
Fri 17 Jan 2014 12:33:39 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 12:33:39 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 12:33:39 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:33:39 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:33:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:33:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:33:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:33:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:33:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:33:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:33:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:33:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:33:46 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:33:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43885977
Fri 17 Jan 2014 12:33:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:33:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43885977
Fri 17 Jan 2014 12:33:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:33:49 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:33:49 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 12:33:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:33:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:33:54 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:33:54 - job_xml_thread(): Done retrieving: data size 43885977
Fri 17 Jan 2014 12:33:54 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:33:54 - XML: Start document: iteration 10
Fri 17 Jan 2014 12:33:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:33:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:33:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:33:59 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:34:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:34:00 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:34:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 12:34:00 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:34:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 12:34:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9402 values 148476 bits 18559 bytes 
Fri 17 Jan 2014 12:34:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:34:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:34:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:34:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:34:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:34:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:34:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:34:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:34:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:34:08 - XML: Processed 655690 elements - found 747 jobs
Fri 17 Jan 2014 12:34:08 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 12:34:08 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 12:34:08 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:34:08 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:34:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:34:08 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:34:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:34:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:34:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:34:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:34:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:34:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:34:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:34:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43900429
Fri 17 Jan 2014 12:34:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:34:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43900429
Fri 17 Jan 2014 12:34:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:34:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:34:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:34:23 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:34:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:34:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:34:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:34:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:34:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:34:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:34:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:34:25 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:34:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:34:25 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:34:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:34:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:34:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:34:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:34:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:34:28 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:34:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 12:34:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:34:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:34:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:34:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:34:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:34:31 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:34:31 - job_xml_thread(): Done retrieving: data size 43880399
Fri 17 Jan 2014 12:34:31 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:34:31 - XML: Start document: iteration 11
Fri 17 Jan 2014 12:34:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43880399
Fri 17 Jan 2014 12:34:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:34:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43880399
Fri 17 Jan 2014 12:34:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:34:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:34:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:34:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:34:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:34:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:34:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:34:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:34:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:34:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:34:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:34:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:34:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:34:48 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:34:53 - XML: Processed 655694 elements - found 747 jobs
Fri 17 Jan 2014 12:34:53 - job 7348112 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:34:53 - job 7348111 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:34:53 - job 7348163 appears to have finished
Fri 17 Jan 2014 12:34:53 - job 7348199 appears to have finished
Fri 17 Jan 2014 12:34:53 - job_xml_thread(): Found 6 updated jobs.
Fri 17 Jan 2014 12:34:53 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 12:34:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:34:55 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:34:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:34:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:34:55 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Fri 17 Jan 2014 12:34:55 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:34:55 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:34:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:34:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:34:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:34:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:34:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:34:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43903254
Fri 17 Jan 2014 12:34:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:34:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43903254
Fri 17 Jan 2014 12:34:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:35:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:35:00 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:35:01 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:35:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 12:35:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:35:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 12:35:01 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:35:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8678 values 136847 bits 17105 bytes 
Fri 17 Jan 2014 12:35:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:35:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:35:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:35:09 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:35:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:35:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:35:10 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:35:10 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:35:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:35:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:35:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:35:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:35:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:35:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:35:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:35:15 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:35:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:35:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:35:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:35:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:35:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:35:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:35:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:35:18 - job_xml_thread(): Done retrieving: data size 43815653
Fri 17 Jan 2014 12:35:18 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:35:18 - XML: Start document: iteration 12
Fri 17 Jan 2014 12:35:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43815653
Fri 17 Jan 2014 12:35:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:35:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43815653
Fri 17 Jan 2014 12:35:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:35:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:35:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:35:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:35:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:35:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:35:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:35:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:35:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:35:37 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:35:37 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:35:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:35:37 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:35:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:35:38 - XML: Processed 654946 elements - found 747 jobs
Fri 17 Jan 2014 12:35:38 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 12:35:38 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 12:35:38 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:35:38 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:35:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:35:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:35:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:35:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:35:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:35:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:35:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:35:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:35:42 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:35:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 12:35:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:35:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:35:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43302498
Fri 17 Jan 2014 12:35:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:35:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43302498
Fri 17 Jan 2014 12:35:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:35:53 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:35:53 - job_xml_thread(): Done retrieving: data size 43302498
Fri 17 Jan 2014 12:35:53 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:35:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:35:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:35:53 - XML: Start document: iteration 13
Fri 17 Jan 2014 12:35:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:35:54 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:35:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:35:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:35:56 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:35:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:35:56 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:35:56 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:35:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:35:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:35:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:36:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:36:01 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:36:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:36:02 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:36:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 12:36:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 12:36:02 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:36:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5486 values 86459 bits 10807 bytes 
Fri 17 Jan 2014 12:36:04 - XML: Processed 648313 elements - found 747 jobs
Fri 17 Jan 2014 12:36:04 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 12:36:04 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 12:36:04 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:36:04 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:36:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:36:08 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:36:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:36:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:36:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:36:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:36:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:36:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:36:11 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 12:36:11 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 12:36:11 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:36:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:36:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:36:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:36:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43218753
Fri 17 Jan 2014 12:36:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:36:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43218753
Fri 17 Jan 2014 12:36:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:36:19 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:36:19 - job_xml_thread(): Done retrieving: data size 43218753
Fri 17 Jan 2014 12:36:19 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:36:19 - XML: Start document: iteration 14
Fri 17 Jan 2014 12:36:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:36:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:36:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:36:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:36:23 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:36:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:36:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:36:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:36:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:36:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:36:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:36:31 - XML: Processed 647490 elements - found 745 jobs
Fri 17 Jan 2014 12:36:31 - job 7345983 appears to have finished
Fri 17 Jan 2014 12:36:31 - job 7348113 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:36:31 - job 7348115 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:36:31 - job 7348114 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:36:31 - job 7343941 appears to have finished
Fri 17 Jan 2014 12:36:32 - job_xml_thread(): Found 5 updated jobs.
Fri 17 Jan 2014 12:36:32 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 12:36:33 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Fri 17 Jan 2014 12:36:33 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:36:33 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:36:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:36:35 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:36:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:36:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:36:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:36:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:36:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:36:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:36:35 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:36:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 12:36:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:36:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:36:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43645626
Fri 17 Jan 2014 12:36:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:36:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43645626
Fri 17 Jan 2014 12:36:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:36:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:36:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:36:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:36:45 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:36:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:36:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:36:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:36:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:36:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:36:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:36:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43645626
Fri 17 Jan 2014 12:36:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:36:48 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:36:49 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:36:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:36:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:36:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:36:53 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:36:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:36:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:36:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:36:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:36:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:36:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:36:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:36:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:36:57 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:36:57 - job_xml_thread(): Done retrieving: data size 43864299
Fri 17 Jan 2014 12:36:57 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:36:57 - XML: Start document: iteration 15
Fri 17 Jan 2014 12:36:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43864299
Fri 17 Jan 2014 12:36:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:37:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:37:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:37:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:37:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:37:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:37:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43864299
Fri 17 Jan 2014 12:37:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:37:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:37:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:37:02 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:37:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:37:03 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:37:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 12:37:03 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:37:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 12:37:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8727 values 137572 bits 17196 bytes 
Fri 17 Jan 2014 12:37:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:37:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:37:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:37:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:37:15 - XML: Processed 655182 elements - found 745 jobs
Fri 17 Jan 2014 12:37:15 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 12:37:15 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 12:37:15 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:37:15 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:37:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:37:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:37:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:37:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:37:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:37:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:37:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:37:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:37:19 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:37:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:37:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:37:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:37:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:37:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:37:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:37:22 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:37:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43918290
Fri 17 Jan 2014 12:37:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:37:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43918290
Fri 17 Jan 2014 12:37:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:37:30 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:37:30 - job_xml_thread(): Done retrieving: data size 43918290
Fri 17 Jan 2014 12:37:31 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:37:31 - XML: Start document: iteration 16
Fri 17 Jan 2014 12:37:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:37:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:37:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:37:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:37:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:37:38 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:37:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:37:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:37:39 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:37:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:37:39 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:37:39 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:37:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:37:42 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:37:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 12:37:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:37:43 - XML: Processed 655688 elements - found 745 jobs
Fri 17 Jan 2014 12:37:43 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 12:37:43 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 12:37:43 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:37:44 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:37:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:37:44 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:37:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:37:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:37:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:37:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:37:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:37:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:37:46 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:37:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43885274
Fri 17 Jan 2014 12:37:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:37:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43885274
Fri 17 Jan 2014 12:37:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:37:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:37:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:37:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:37:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:37:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:37:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:37:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:37:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:37:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:37:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:37:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:37:59 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:38:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:38:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:38:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:38:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:38:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:38:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:38:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:38:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:38:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:38:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:38:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:38:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43904283
Fri 17 Jan 2014 12:38:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:38:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43904283
Fri 17 Jan 2014 12:38:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:38:02 - job_xml_thread(): Done retrieving: data size 43904283
Fri 17 Jan 2014 12:38:02 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:38:02 - XML: Start document: iteration 17
Fri 17 Jan 2014 12:38:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:38:04 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:38:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:38:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 12:38:07 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:38:07 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:38:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 12:38:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9025 values 142468 bits 17808 bytes 
Fri 17 Jan 2014 12:38:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:38:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:38:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:38:16 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:38:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:38:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:38:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:38:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:38:17 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:38:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:38:17 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:38:17 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:38:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:38:18 - XML: Processed 655688 elements - found 744 jobs
Fri 17 Jan 2014 12:38:18 - job 7348117 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:38:18 - job 7348116 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:38:18 - job 7348115 field 'start_timestamp' changed since saved from: 1389958523 to: 1389958470
Fri 17 Jan 2014 12:38:18 - job 7348114 field 'start_timestamp' changed since saved from: 1389958521 to: 1389958470
Fri 17 Jan 2014 12:38:18 - job 7344175 appears to have finished
Fri 17 Jan 2014 12:38:18 - job_xml_thread(): Found 5 updated jobs.
Fri 17 Jan 2014 12:38:18 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 12:38:19 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Fri 17 Jan 2014 12:38:19 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:38:19 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:38:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:38:24 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:38:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:38:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:38:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:38:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:38:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:38:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:38:26 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:38:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43907868
Fri 17 Jan 2014 12:38:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:38:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43907868
Fri 17 Jan 2014 12:38:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:38:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:38:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:38:34 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:38:34 - job_xml_thread(): Done retrieving: data size 43907868
Fri 17 Jan 2014 12:38:34 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:38:34 - XML: Start document: iteration 18
Fri 17 Jan 2014 12:38:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:38:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:38:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:38:42 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:38:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:38:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:38:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:38:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:38:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:38:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:38:43 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:38:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:38:45 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:38:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:38:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:38:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:38:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:38:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:38:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:38:47 - XML: Processed 655688 elements - found 744 jobs
Fri 17 Jan 2014 12:38:47 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 12:38:47 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 12:38:47 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:38:47 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:38:48 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:38:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 12:38:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:38:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:38:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43908545
Fri 17 Jan 2014 12:38:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:38:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43908545
Fri 17 Jan 2014 12:38:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:38:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:38:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:38:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:38:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:38:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:38:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:39:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:39:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:39:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:39:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:39:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:39:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:39:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:39:02 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:39:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:39:03 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:39:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:39:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:39:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:39:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:39:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:39:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:39:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:39:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43910387
Fri 17 Jan 2014 12:39:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:39:06 - job_xml_thread(): Done retrieving: data size 43910387
Fri 17 Jan 2014 12:39:06 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:39:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43910387
Fri 17 Jan 2014 12:39:06 - XML: Start document: iteration 19
Fri 17 Jan 2014 12:39:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:39:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:39:08 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:39:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:39:08 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:39:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 12:39:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 12:39:08 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:39:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9228 values 145530 bits 18191 bytes 
Fri 17 Jan 2014 12:39:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:39:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:39:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:39:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:39:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:39:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:39:17 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:39:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:39:17 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:39:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:39:17 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:39:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:39:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:39:25 - XML: Processed 655688 elements - found 744 jobs
Fri 17 Jan 2014 12:39:25 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 12:39:25 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 12:39:25 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:39:25 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:39:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:39:27 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:39:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:39:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:39:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:39:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:39:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:39:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:39:29 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:39:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875115
Fri 17 Jan 2014 12:39:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:39:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875115
Fri 17 Jan 2014 12:39:30 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:39:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:39:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 12:39:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:39:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:39:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:39:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:39:38 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:39:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:39:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:39:39 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:39:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:39:39 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:39:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:39:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875115
Fri 17 Jan 2014 12:39:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:39:40 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:39:40 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:39:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:39:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:39:50 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 12:39:50 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:39:51 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:39:51 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 12:39:51 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 12:39:51 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:39:51 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 12:39:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:39:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:39:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:39:52 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:39:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:39:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:39:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:39:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:39:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:39:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:39:53 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 905382 values 14292591 bits 1786573 bytes 
Fri 17 Jan 2014 12:39:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:39:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:39:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:39:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:39:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:39:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:39:56 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:39:56 - job_xml_thread(): Done retrieving: data size 43875386
Fri 17 Jan 2014 12:39:56 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:39:56 - XML: Start document: iteration 20
Fri 17 Jan 2014 12:39:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875386
Fri 17 Jan 2014 12:39:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:39:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875386
Fri 17 Jan 2014 12:39:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:40:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:40:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:40:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:40:08 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:40:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:40:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 12:40:10 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:40:10 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:40:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 12:40:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99056 bits 12382 bytes 
Fri 17 Jan 2014 12:40:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:40:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:40:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:40:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:40:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:40:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:40:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:40:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:40:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:40:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:40:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:40:17 - XML: Processed 655688 elements - found 744 jobs
Fri 17 Jan 2014 12:40:17 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 12:40:17 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 12:40:17 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:40:17 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:40:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:40:19 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:40:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:40:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:40:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:40:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:40:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:40:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:40:23 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:40:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43887075
Fri 17 Jan 2014 12:40:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:40:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43887075
Fri 17 Jan 2014 12:40:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:40:26 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:40:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 12:40:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:40:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:40:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:40:32 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:40:32 - job_xml_thread(): Done retrieving: data size 43887075
Fri 17 Jan 2014 12:40:32 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:40:32 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 12:40:32 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 12:40:32 - Housekeeping: done.
Fri 17 Jan 2014 12:40:32 - XML: Start document: iteration 0
Fri 17 Jan 2014 12:40:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:40:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:40:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:40:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:40:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:40:35 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:40:35 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:40:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:40:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:40:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:40:35 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:40:41 - XML: Processed 655684 elements - found 742 jobs
Fri 17 Jan 2014 12:40:41 - job 7348119 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:40:41 - job 7348118 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:40:41 - job 7348075 appears to have finished
Fri 17 Jan 2014 12:40:41 - job 7348074 appears to have finished
Fri 17 Jan 2014 12:40:41 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 12:40:41 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 12:40:42 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 12:40:42 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:40:42 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:40:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:40:45 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:40:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:40:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:40:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:40:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:40:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:40:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:40:48 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:40:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43866471
Fri 17 Jan 2014 12:40:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:40:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43866471
Fri 17 Jan 2014 12:40:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:40:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:40:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:40:51 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:40:51 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 12:40:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:40:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:40:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:40:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:40:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:40:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:40:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:40:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:40:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43866471
Fri 17 Jan 2014 12:40:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:40:57 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:40:57 - job_xml_thread(): Done retrieving: data size 43866471
Fri 17 Jan 2014 12:40:57 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:40:57 - XML: Start document: iteration 1
Fri 17 Jan 2014 12:41:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:41:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:41:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:41:10 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:41:11 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:41:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 12:41:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:41:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 12:41:11 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:41:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6229 values 98247 bits 12280 bytes 
Fri 17 Jan 2014 12:41:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:41:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:41:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:41:13 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:41:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:41:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:41:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:41:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:41:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:41:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:41:14 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:41:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:41:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:41:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:41:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:41:16 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:41:16 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:41:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:41:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:41:18 - XML: Processed 655684 elements - found 742 jobs
Fri 17 Jan 2014 12:41:18 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 12:41:18 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 12:41:18 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:41:18 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:41:22 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:41:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43831031
Fri 17 Jan 2014 12:41:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:41:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43831031
Fri 17 Jan 2014 12:41:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:41:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:41:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:41:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:41:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:41:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:41:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:41:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:41:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:41:33 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:41:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:41:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:41:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:41:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:41:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:41:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:41:38 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:41:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:41:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:41:38 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:41:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 12:41:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:41:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:41:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:41:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:41:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:41:41 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:41:41 - job_xml_thread(): Done retrieving: data size 43344833
Fri 17 Jan 2014 12:41:41 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:41:41 - XML: Start document: iteration 2
Fri 17 Jan 2014 12:41:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43344833
Fri 17 Jan 2014 12:41:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:41:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43344833
Fri 17 Jan 2014 12:41:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:41:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:41:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:41:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:41:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:42:01 - XML: Processed 648806 elements - found 742 jobs
Fri 17 Jan 2014 12:42:01 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 12:42:01 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 12:42:01 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:42:01 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:42:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:42:01 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:42:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:42:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:42:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:42:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:42:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:42:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:42:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:42:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:42:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:42:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:42:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:42:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:42:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:42:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:42:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:42:06 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:42:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43248560
Fri 17 Jan 2014 12:42:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:42:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43248560
Fri 17 Jan 2014 12:42:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:42:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:42:11 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:42:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:42:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 12:42:12 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:42:12 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:42:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 12:42:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8819 values 139065 bits 17383 bytes 
Fri 17 Jan 2014 12:42:16 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:42:16 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:42:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:42:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:42:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:42:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:42:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:42:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:42:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:42:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:42:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:42:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:42:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:42:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:42:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:42:21 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:42:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:42:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:42:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:42:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:42:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:42:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:42:25 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:42:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 12:42:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:42:26 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:42:26 - job_xml_thread(): Done retrieving: data size 43304963
Fri 17 Jan 2014 12:42:26 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:42:26 - XML: Start document: iteration 3
Fri 17 Jan 2014 12:42:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43304963
Fri 17 Jan 2014 12:42:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:42:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43304963
Fri 17 Jan 2014 12:42:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:42:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:42:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:42:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:42:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:42:43 - XML: Processed 648228 elements - found 740 jobs
Fri 17 Jan 2014 12:42:43 - job 7345997 appears to have finished
Fri 17 Jan 2014 12:42:43 - job 7348120 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:42:44 - job 7348068 appears to have finished
Fri 17 Jan 2014 12:42:44 - job 7348209 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:42:44 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 12:42:44 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 12:42:46 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 12:42:47 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:42:47 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:42:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:42:48 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:42:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:42:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:42:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:42:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:42:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:42:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:42:49 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:42:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:42:49 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:42:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:42:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:42:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:42:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:42:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:42:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:42:53 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:42:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875290
Fri 17 Jan 2014 12:42:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:42:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875290
Fri 17 Jan 2014 12:42:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:43:02 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:43:02 - job_xml_thread(): Done retrieving: data size 43875290
Fri 17 Jan 2014 12:43:02 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:43:02 - XML: Start document: iteration 4
Fri 17 Jan 2014 12:43:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:43:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:43:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:43:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:43:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:43:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:43:04 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:43:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:43:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:43:04 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:43:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:43:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:43:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:43:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:43:12 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:43:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:43:13 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:43:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 12:43:13 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:43:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 12:43:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99060 bits 12382 bytes 
Fri 17 Jan 2014 12:43:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:43:15 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:43:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:43:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:43:16 - XML: Processed 655246 elements - found 740 jobs
Fri 17 Jan 2014 12:43:16 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 12:43:16 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 12:43:16 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:43:16 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:43:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:43:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:43:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:43:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:43:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:43:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43854155
Fri 17 Jan 2014 12:43:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:43:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:43:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:43:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43854155
Fri 17 Jan 2014 12:43:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:43:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:43:28 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:43:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:43:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:43:29 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:43:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:43:29 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:43:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:43:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43854155
Fri 17 Jan 2014 12:43:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:43:31 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:43:31 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:43:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:43:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:43:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:43:36 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:43:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:43:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:43:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:43:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:43:41 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:43:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 12:43:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:43:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:43:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:43:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:43:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:43:44 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 12:43:44 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 12:43:44 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:43:44 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:43:44 - job_xml_thread(): Done retrieving: data size 43876551
Fri 17 Jan 2014 12:43:44 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:43:44 - XML: Start document: iteration 5
Fri 17 Jan 2014 12:43:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:43:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:43:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43876551
Fri 17 Jan 2014 12:43:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:43:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:43:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:43:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:43:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:43:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43876551
Fri 17 Jan 2014 12:43:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:43:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:43:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:43:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:43:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:44:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:44:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:44:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:44:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:44:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:44:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:44:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:44:04 - XML: Processed 655680 elements - found 740 jobs
Fri 17 Jan 2014 12:44:04 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 12:44:04 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 12:44:04 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:44:04 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:44:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:44:06 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:44:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:44:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:44:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:44:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:44:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:44:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:44:08 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:44:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43910998
Fri 17 Jan 2014 12:44:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:44:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43910998
Fri 17 Jan 2014 12:44:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:44:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:44:14 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:44:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:44:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 12:44:16 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:44:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 12:44:16 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:44:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8987 values 141682 bits 17710 bytes 
Fri 17 Jan 2014 12:44:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:44:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:44:19 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:44:20 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:44:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:44:21 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:44:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:44:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:44:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:44:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:44:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:44:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:44:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:44:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:44:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:44:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:44:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:44:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:44:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:44:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:44:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:44:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:44:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:44:25 - job_xml_thread(): Done retrieving: data size 43915713
Fri 17 Jan 2014 12:44:25 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:44:25 - XML: Start document: iteration 6
Fri 17 Jan 2014 12:44:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43915713
Fri 17 Jan 2014 12:44:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:44:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43915713
Fri 17 Jan 2014 12:44:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:44:35 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:44:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 12:44:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:44:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:44:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:44:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:44:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:44:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:44:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:44:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:44:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:44:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:44:45 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:44:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:44:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:44:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:44:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:44:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:44:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:44:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:44:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:44:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:44:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:44:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:44:48 - XML: Processed 655676 elements - found 738 jobs
Fri 17 Jan 2014 12:44:48 - job 7348080 appears to have finished
Fri 17 Jan 2014 12:44:48 - job 7348121 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:44:48 - job 7348201 appears to have finished
Fri 17 Jan 2014 12:44:48 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 12:44:48 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 12:44:48 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 12:44:48 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:44:48 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:44:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:44:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43901614
Fri 17 Jan 2014 12:44:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:44:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43901614
Fri 17 Jan 2014 12:44:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:45:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:45:00 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:45:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:45:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:45:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:45:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:45:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:45:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:45:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:45:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:45:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:45:03 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:45:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:45:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:45:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:45:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:45:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:45:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:45:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:45:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:45:06 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:45:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43904703
Fri 17 Jan 2014 12:45:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:45:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43904703
Fri 17 Jan 2014 12:45:06 - job_xml_thread(): Done retrieving: data size 43904703
Fri 17 Jan 2014 12:45:06 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:45:06 - XML: Start document: iteration 7
Fri 17 Jan 2014 12:45:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:45:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:45:16 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:45:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:45:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 12:45:17 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:45:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9351 values 147479 bits 18434 bytes 
Fri 17 Jan 2014 12:45:17 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:45:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 12:45:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:45:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:45:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:45:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:45:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:45:21 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:45:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:45:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:45:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:45:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:45:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:45:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:45:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:45:27 - XML: Processed 655676 elements - found 738 jobs
Fri 17 Jan 2014 12:45:27 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 12:45:27 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 12:45:27 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:45:27 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:45:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:45:30 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:45:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:45:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:45:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:45:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:45:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:45:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:45:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:45:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873672
Fri 17 Jan 2014 12:45:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:45:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873672
Fri 17 Jan 2014 12:45:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:45:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:45:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:45:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:45:42 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:45:42 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:45:42 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:45:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:45:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:45:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:45:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:45:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:45:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:45:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:45:45 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:45:45 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:45:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 12:45:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:45:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:45:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:45:46 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:45:46 - job_xml_thread(): Done retrieving: data size 43891427
Fri 17 Jan 2014 12:45:46 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:45:46 - XML: Start document: iteration 8
Fri 17 Jan 2014 12:45:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:45:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:45:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:45:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43891427
Fri 17 Jan 2014 12:45:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:45:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:45:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43891427
Fri 17 Jan 2014 12:45:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:45:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:45:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:45:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:45:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:46:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:46:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:46:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:46:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:46:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:46:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:46:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:46:06 - XML: Processed 655676 elements - found 738 jobs
Fri 17 Jan 2014 12:46:06 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 12:46:06 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 12:46:06 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:46:06 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:46:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:46:08 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:46:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:46:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:46:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:46:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:46:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:46:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:46:10 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:46:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43897447
Fri 17 Jan 2014 12:46:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:46:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43897447
Fri 17 Jan 2014 12:46:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:46:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:46:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:46:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:46:17 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:46:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:46:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 12:46:19 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:46:19 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:46:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 12:46:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9115 values 143907 bits 17988 bytes 
Fri 17 Jan 2014 12:46:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:46:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:46:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:46:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:46:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:46:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:46:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:46:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:46:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:46:21 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:46:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:46:24 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:46:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:46:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:46:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:46:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:46:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:46:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:46:26 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:46:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43907484
Fri 17 Jan 2014 12:46:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:46:27 - job_xml_thread(): Done retrieving: data size 43907484
Fri 17 Jan 2014 12:46:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43907484
Fri 17 Jan 2014 12:46:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:46:27 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:46:27 - XML: Start document: iteration 9
Fri 17 Jan 2014 12:46:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:46:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:46:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:46:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:46:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:46:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:46:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:46:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:46:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:46:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:46:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:46:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:46:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:46:46 - XML: Processed 655674 elements - found 737 jobs
Fri 17 Jan 2014 12:46:47 - job 7348122 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:46:47 - job 7348123 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:46:47 - job 7348124 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:46:47 - job 7348081 appears to have finished
Fri 17 Jan 2014 12:46:47 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 12:46:47 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 12:46:48 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 12:46:48 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:46:48 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:46:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:46:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:46:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:46:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:46:50 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:46:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 12:46:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:46:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:46:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:46:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:46:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:46:51 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 12:46:51 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:46:51 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:46:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867096
Fri 17 Jan 2014 12:46:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:46:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43867096
Fri 17 Jan 2014 12:46:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:46:52 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:46:52 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:46:52 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 12:46:52 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 12:46:52 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 12:46:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:46:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:47:03 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:47:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:47:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:47:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:47:05 - size of cluster 'LISA Cluster': 624 hosts 79476 metrics 828386 values 13076229 bits 1634528 bytes 
Fri 17 Jan 2014 12:47:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:47:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:47:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:47:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:47:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:47:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:47:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:47:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:47:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:47:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:47:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:47:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:47:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:47:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:47:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:47:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:47:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:47:13 - job_xml_thread(): Done retrieving: data size 43853024
Fri 17 Jan 2014 12:47:13 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:47:13 - XML: Start document: iteration 10
Fri 17 Jan 2014 12:47:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853024
Fri 17 Jan 2014 12:47:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853024
Fri 17 Jan 2014 12:47:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:47:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:47:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:47:19 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:47:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:47:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 12:47:20 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:47:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:47:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:47:20 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:47:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 12:47:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8837 values 139612 bits 17451 bytes 
Fri 17 Jan 2014 12:47:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:47:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:47:31 - XML: Processed 655176 elements - found 737 jobs
Fri 17 Jan 2014 12:47:31 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 12:47:31 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 12:47:31 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:47:31 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:47:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:47:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:47:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:47:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:47:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:47:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:47:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:47:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:47:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:47:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:47:36 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:47:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:47:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:47:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:47:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:47:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:47:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:47:40 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:47:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43323167
Fri 17 Jan 2014 12:47:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:47:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43323167
Fri 17 Jan 2014 12:47:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:47:46 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:47:46 - job_xml_thread(): Done retrieving: data size 43323167
Fri 17 Jan 2014 12:47:46 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:47:46 - XML: Start document: iteration 11
Fri 17 Jan 2014 12:47:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:47:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:47:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:47:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:47:52 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:47:52 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 12:47:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:47:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:47:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:47:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:47:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:47:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:47:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:47:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:47:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:48:02 - XML: Processed 648548 elements - found 737 jobs
Fri 17 Jan 2014 12:48:02 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 12:48:02 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 12:48:02 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:48:02 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:48:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:48:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:48:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:48:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:48:04 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:48:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 12:48:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:48:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:48:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:48:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:48:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:48:07 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:48:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43208796
Fri 17 Jan 2014 12:48:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:48:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43208796
Fri 17 Jan 2014 12:48:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:48:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:48:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:48:17 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:48:17 - job_xml_thread(): Done retrieving: data size 43208796
Fri 17 Jan 2014 12:48:17 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:48:17 - XML: Start document: iteration 12
Fri 17 Jan 2014 12:48:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:48:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:48:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:48:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:48:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:48:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:48:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:48:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:48:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:48:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:48:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:48:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:48:21 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:48:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:48:21 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:48:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 12:48:21 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:48:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 12:48:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5679 values 89681 bits 11210 bytes 
Fri 17 Jan 2014 12:48:28 - XML: Processed 647466 elements - found 733 jobs
Fri 17 Jan 2014 12:48:28 - job 7348129 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:48:28 - job 7348126 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:48:28 - job 7348127 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:48:28 - job 7348124 field 'start_timestamp' changed since saved from: 1389959171 to: 1389959112
Fri 17 Jan 2014 12:48:28 - job 7348125 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:48:28 - job 7348107 appears to have finished
Fri 17 Jan 2014 12:48:28 - job 7348082 appears to have finished
Fri 17 Jan 2014 12:48:28 - job 7344469 appears to have finished
Fri 17 Jan 2014 12:48:28 - job 7348130 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:48:28 - job 7348128 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:48:29 - job 7347826 appears to have finished
Fri 17 Jan 2014 12:48:29 - job_xml_thread(): Found 11 updated jobs.
Fri 17 Jan 2014 12:48:29 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 12:48:30 - job_xml_thread(): Done storing. succesfully stored: 11 jobs
Fri 17 Jan 2014 12:48:30 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:48:30 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:48:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:48:31 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:48:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:48:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:48:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:48:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:48:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:48:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:48:34 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:48:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43650290
Fri 17 Jan 2014 12:48:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:48:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43650290
Fri 17 Jan 2014 12:48:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:48:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:48:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:48:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:48:42 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:48:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:48:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:48:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:48:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:48:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:48:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:48:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43650290
Fri 17 Jan 2014 12:48:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:48:45 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:48:45 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:48:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:48:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:48:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:48:53 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:48:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:48:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:48:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:48:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:48:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:48:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:48:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:48:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:48:56 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:48:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 12:48:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:48:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:48:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:48:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:48:59 - job_xml_thread(): Done retrieving: data size 43841287
Fri 17 Jan 2014 12:48:59 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:48:59 - XML: Start document: iteration 13
Fri 17 Jan 2014 12:48:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43841287
Fri 17 Jan 2014 12:48:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:48:59 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:48:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:49:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:49:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43841287
Fri 17 Jan 2014 12:49:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:49:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:49:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:49:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:49:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:49:13 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:49:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:49:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:49:16 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:49:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:49:16 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:49:16 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:49:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:49:19 - XML: Processed 655160 elements - found 733 jobs
Fri 17 Jan 2014 12:49:19 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 12:49:19 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 12:49:19 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:49:19 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:49:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:49:22 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:49:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:49:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:49:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:49:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:49:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:49:22 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:49:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 12:49:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 12:49:22 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:49:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:49:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:49:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:49:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5727 values 90374 bits 11296 bytes 
Fri 17 Jan 2014 12:49:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:49:26 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:49:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43885542
Fri 17 Jan 2014 12:49:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:49:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43885542
Fri 17 Jan 2014 12:49:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:49:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:49:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:49:34 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:49:34 - job_xml_thread(): Done retrieving: data size 43885542
Fri 17 Jan 2014 12:49:34 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:49:34 - XML: Start document: iteration 14
Fri 17 Jan 2014 12:49:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:49:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:49:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:49:46 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:49:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:49:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:49:47 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:49:47 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:49:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:49:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:49:47 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:49:48 - XML: Processed 655666 elements - found 733 jobs
Fri 17 Jan 2014 12:49:48 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 12:49:48 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 12:49:48 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:49:48 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:49:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:49:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:49:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:49:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:49:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:49:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:49:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:49:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:49:51 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:49:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 12:49:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:49:53 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:49:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43890665
Fri 17 Jan 2014 12:49:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:49:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43890665
Fri 17 Jan 2014 12:49:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:50:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:50:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:50:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:50:03 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:50:03 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:50:03 - job_xml_thread(): Done retrieving: data size 43890665
Fri 17 Jan 2014 12:50:03 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:50:03 - XML: Start document: iteration 15
Fri 17 Jan 2014 12:50:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:50:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:50:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:50:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:50:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:50:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:50:05 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:50:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:50:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:50:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:50:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:50:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:50:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:50:17 - XML: Processed 655650 elements - found 725 jobs
Fri 17 Jan 2014 12:50:17 - job 7348110 appears to have finished
Fri 17 Jan 2014 12:50:17 - job 7348109 appears to have finished
Fri 17 Jan 2014 12:50:17 - job 7348083 appears to have finished
Fri 17 Jan 2014 12:50:17 - job 7348089 appears to have finished
Fri 17 Jan 2014 12:50:17 - job 7348099 appears to have finished
Fri 17 Jan 2014 12:50:17 - job 7348093 appears to have finished
Fri 17 Jan 2014 12:50:17 - job 7348202 appears to have finished
Fri 17 Jan 2014 12:50:17 - job 7348073 appears to have finished
Fri 17 Jan 2014 12:50:17 - job_xml_thread(): Found 8 updated jobs.
Fri 17 Jan 2014 12:50:17 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 12:50:17 - job_xml_thread(): Done storing. succesfully stored: 8 jobs
Fri 17 Jan 2014 12:50:17 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:50:17 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:50:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:50:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:50:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:50:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:50:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:50:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43863388
Fri 17 Jan 2014 12:50:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:50:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43863388
Fri 17 Jan 2014 12:50:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:50:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:50:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:50:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:50:23 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:50:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:50:24 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:50:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 12:50:24 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:50:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 12:50:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8613 values 135824 bits 16978 bytes 
Fri 17 Jan 2014 12:50:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:50:29 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:50:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:50:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:50:29 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:50:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:50:29 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:50:29 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:50:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:50:32 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:50:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:50:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:50:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:50:34 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:50:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:50:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:50:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:50:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:50:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:50:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:50:37 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 12:50:37 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 12:50:37 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:50:38 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:50:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43877780
Fri 17 Jan 2014 12:50:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:50:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43877780
Fri 17 Jan 2014 12:50:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:50:39 - job_xml_thread(): Done retrieving: data size 43877780
Fri 17 Jan 2014 12:50:39 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:50:39 - XML: Start document: iteration 16
Fri 17 Jan 2014 12:50:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:50:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:50:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:50:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:50:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:50:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:50:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:50:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:50:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:50:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:50:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:50:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:50:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:51:02 - XML: Processed 655650 elements - found 725 jobs
Fri 17 Jan 2014 12:51:02 - job 7348131 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:51:02 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 12:51:02 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 12:51:02 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 12:51:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:51:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:51:02 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:51:02 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:51:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:51:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:51:03 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:51:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 12:51:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:51:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:51:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:51:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:51:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:51:04 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:51:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43880195
Fri 17 Jan 2014 12:51:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:51:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43880195
Fri 17 Jan 2014 12:51:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:51:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:51:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:51:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:51:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:51:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:51:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:51:16 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:51:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:51:16 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:51:16 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:51:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:51:17 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:51:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:51:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:51:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:51:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:51:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:51:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:51:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:51:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:51:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:51:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43887321
Fri 17 Jan 2014 12:51:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:51:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43887321
Fri 17 Jan 2014 12:51:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:51:21 - job_xml_thread(): Done retrieving: data size 43887321
Fri 17 Jan 2014 12:51:21 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:51:22 - XML: Start document: iteration 17
Fri 17 Jan 2014 12:51:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:51:24 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:51:25 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:51:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 12:51:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:51:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 12:51:25 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:51:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8934 values 140932 bits 17616 bytes 
Fri 17 Jan 2014 12:51:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:51:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:51:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:51:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:51:37 - XML: Processed 655650 elements - found 725 jobs
Fri 17 Jan 2014 12:51:37 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 12:51:37 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 12:51:37 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:51:37 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:51:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:51:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:51:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:51:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:51:39 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:51:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:51:39 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:51:39 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:51:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:51:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:51:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:51:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:51:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:51:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:51:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:51:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:51:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:51:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:51:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43901181
Fri 17 Jan 2014 12:51:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:51:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43901181
Fri 17 Jan 2014 12:51:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:51:52 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:51:52 - job_xml_thread(): Done retrieving: data size 43901181
Fri 17 Jan 2014 12:51:52 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:51:52 - XML: Start document: iteration 18
Fri 17 Jan 2014 12:51:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:51:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:51:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:51:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:52:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:52:00 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:52:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:52:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:52:01 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:52:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:52:01 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:52:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:52:01 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:52:06 - XML: Processed 655650 elements - found 725 jobs
Fri 17 Jan 2014 12:52:06 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 12:52:06 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 12:52:06 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:52:06 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:52:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:52:08 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:52:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:52:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:52:09 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:52:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 12:52:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:52:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:52:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:52:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:52:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:52:10 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:52:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43878374
Fri 17 Jan 2014 12:52:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:52:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43878374
Fri 17 Jan 2014 12:52:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:52:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:52:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:52:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:52:21 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:52:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:52:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:52:21 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:52:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:52:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:52:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:52:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:52:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:52:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:52:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:52:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:52:25 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:52:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:52:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:52:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:52:25 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:52:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:52:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:52:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:52:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:52:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:52:26 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:52:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 12:52:26 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:52:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 12:52:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5966 values 94132 bits 11766 bytes 
Fri 17 Jan 2014 12:52:27 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:52:27 - job_xml_thread(): Done retrieving: data size 43893001
Fri 17 Jan 2014 12:52:27 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:52:27 - XML: Start document: iteration 19
Fri 17 Jan 2014 12:52:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43893001
Fri 17 Jan 2014 12:52:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43893001
Fri 17 Jan 2014 12:52:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:52:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:52:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:52:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:52:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:52:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:52:44 - XML: Processed 655650 elements - found 725 jobs
Fri 17 Jan 2014 12:52:44 - job 7348132 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:52:44 - job 7348071 appears to have finished
Fri 17 Jan 2014 12:52:44 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 12:52:44 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 12:52:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:52:46 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:52:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:52:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:52:47 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 12:52:47 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:52:47 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:52:47 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:52:47 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:52:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:52:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:52:47 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:52:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:52:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:52:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:52:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:52:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:52:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:52:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:52:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:52:51 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:52:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 12:52:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:52:53 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:52:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43893699
Fri 17 Jan 2014 12:52:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:52:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43893699
Fri 17 Jan 2014 12:52:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:53:02 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:53:02 - job_xml_thread(): Done retrieving: data size 43893699
Fri 17 Jan 2014 12:53:02 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:53:02 - XML: Start document: iteration 20
Fri 17 Jan 2014 12:53:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:53:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:53:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:53:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:53:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:53:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:53:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:53:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:53:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:53:05 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:53:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:53:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:53:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:53:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:53:15 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:53:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:53:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:53:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:53:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:53:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:53:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:53:16 - XML: Processed 655650 elements - found 725 jobs
Fri 17 Jan 2014 12:53:16 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 12:53:16 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 12:53:16 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:53:16 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:53:17 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:53:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43803677
Fri 17 Jan 2014 12:53:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:53:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43803677
Fri 17 Jan 2014 12:53:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:53:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:53:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:53:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:53:25 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:53:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:53:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:53:25 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:53:25 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:53:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:53:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43803677
Fri 17 Jan 2014 12:53:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:53:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:53:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:53:26 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:53:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:53:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 12:53:28 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:53:28 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:53:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 12:53:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8149 values 128466 bits 16058 bytes 
Fri 17 Jan 2014 12:53:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:53:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:53:31 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:53:31 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:53:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:53:38 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:53:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:53:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:53:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:53:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:53:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:53:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:53:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:53:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:53:41 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:53:41 - job_xml_thread(): Done retrieving: data size 43339708
Fri 17 Jan 2014 12:53:41 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:53:41 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 12:53:41 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 12:53:41 - Housekeeping: done.
Fri 17 Jan 2014 12:53:41 - XML: Start document: iteration 0
Fri 17 Jan 2014 12:53:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43339708
Fri 17 Jan 2014 12:53:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:53:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:53:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:53:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:53:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:53:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43339708
Fri 17 Jan 2014 12:53:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:53:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:53:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:53:49 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:53:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 12:53:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:53:53 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 12:53:53 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:53:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:53:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:53:54 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:53:54 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 12:53:54 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:53:54 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 12:53:55 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 12:53:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:53:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:53:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:53:58 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:53:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:53:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:53:59 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:53:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:53:59 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:53:59 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:54:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:54:00 - size of cluster 'LISA Cluster': 624 hosts 79475 metrics 831154 values 13124904 bits 1640613 bytes 
Fri 17 Jan 2014 12:54:00 - XML: Processed 649004 elements - found 725 jobs
Fri 17 Jan 2014 12:54:00 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 12:54:00 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 12:54:00 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:54:00 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:54:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:54:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:54:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:54:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:54:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:54:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:54:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:54:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:54:07 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:54:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43224744
Fri 17 Jan 2014 12:54:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:54:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43224744
Fri 17 Jan 2014 12:54:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:54:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:54:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:54:15 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:54:15 - job_xml_thread(): Done retrieving: data size 43224744
Fri 17 Jan 2014 12:54:15 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:54:15 - XML: Start document: iteration 1
Fri 17 Jan 2014 12:54:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:54:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:54:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:54:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:54:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:54:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:54:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:54:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:54:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:54:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:54:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:54:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:54:26 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:54:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:54:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:54:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:54:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:54:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:54:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:54:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:54:28 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:54:28 - XML: Processed 647454 elements - found 727 jobs
Fri 17 Jan 2014 12:54:28 - job 7348139 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:54:28 - job 7348138 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:54:28 - job 7348135 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:54:28 - job 7348134 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:54:28 - job 7348137 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:54:28 - job 7348136 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:54:28 - job 7348133 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:54:28 - job 7348091 appears to have finished
Fri 17 Jan 2014 12:54:28 - job 7348140 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:54:28 - job 7348222 field 'start_timestamp' changed since saved from: 1389959502 to: 1389959449
Fri 17 Jan 2014 12:54:28 - job_xml_thread(): Found 13 updated jobs.
Fri 17 Jan 2014 12:54:28 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 12:54:28 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:54:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:54:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 12:54:28 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:54:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 12:54:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6208 values 97905 bits 12238 bytes 
Fri 17 Jan 2014 12:54:28 - job_xml_thread(): Done storing. succesfully stored: 13 jobs
Fri 17 Jan 2014 12:54:28 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:54:28 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:54:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:54:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43365790
Fri 17 Jan 2014 12:54:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:54:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43365790
Fri 17 Jan 2014 12:54:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:54:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:54:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:54:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:54:41 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:54:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:54:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:54:42 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:54:42 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:54:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:54:42 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:54:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:54:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:54:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:54:44 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:54:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:54:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:54:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:54:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:54:47 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:54:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 12:54:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:54:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:54:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:54:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:54:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:54:50 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:54:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43850484
Fri 17 Jan 2014 12:54:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:54:51 - job_xml_thread(): Done retrieving: data size 43850484
Fri 17 Jan 2014 12:54:51 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:54:51 - XML: Start document: iteration 2
Fri 17 Jan 2014 12:54:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43850484
Fri 17 Jan 2014 12:54:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:54:54 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:54:54 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 12:54:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:54:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:55:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:55:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:55:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:55:06 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:55:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:55:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:55:07 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:55:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:55:07 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:55:07 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:55:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:55:08 - XML: Processed 655364 elements - found 727 jobs
Fri 17 Jan 2014 12:55:09 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 12:55:09 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 12:55:09 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:55:09 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:55:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:55:13 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:55:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:55:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:55:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:55:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:55:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:55:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:55:16 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:55:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43884065
Fri 17 Jan 2014 12:55:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:55:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43884065
Fri 17 Jan 2014 12:55:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:55:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:55:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:55:24 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:55:24 - job_xml_thread(): Done retrieving: data size 43884065
Fri 17 Jan 2014 12:55:24 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:55:24 - XML: Start document: iteration 3
Fri 17 Jan 2014 12:55:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:55:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:55:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:55:29 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:55:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:55:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 12:55:30 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:55:30 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:55:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 12:55:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8727 values 137602 bits 17200 bytes 
Fri 17 Jan 2014 12:55:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:55:31 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:55:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:55:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:55:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:55:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:55:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:55:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:55:32 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:55:36 - XML: Processed 655654 elements - found 727 jobs
Fri 17 Jan 2014 12:55:36 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 12:55:36 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 12:55:36 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:55:36 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:55:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:55:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:55:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:55:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:55:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:55:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:55:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:55:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:55:42 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:55:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875950
Fri 17 Jan 2014 12:55:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:55:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875950
Fri 17 Jan 2014 12:55:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:55:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:55:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:55:51 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:55:51 - job_xml_thread(): Done retrieving: data size 43875950
Fri 17 Jan 2014 12:55:51 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:55:51 - XML: Start document: iteration 4
Fri 17 Jan 2014 12:55:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:55:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:55:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:55:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:55:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:55:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:55:59 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:55:59 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:55:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:55:59 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:55:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:56:05 - XML: Processed 655654 elements - found 727 jobs
Fri 17 Jan 2014 12:56:05 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 12:56:05 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 12:56:05 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:56:05 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:56:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:56:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:56:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:56:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:56:08 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:56:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 12:56:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:56:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:56:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:56:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:56:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:56:10 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:56:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43879367
Fri 17 Jan 2014 12:56:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:56:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43879367
Fri 17 Jan 2014 12:56:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:56:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:56:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:56:20 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:56:20 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:56:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:56:21 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:56:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:56:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:56:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:56:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:56:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:56:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:56:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:56:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:56:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:56:25 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:56:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:56:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:56:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:56:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:56:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:56:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:56:28 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:56:28 - job_xml_thread(): Done retrieving: data size 43900186
Fri 17 Jan 2014 12:56:28 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:56:28 - XML: Start document: iteration 5
Fri 17 Jan 2014 12:56:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43900186
Fri 17 Jan 2014 12:56:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:56:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43900186
Fri 17 Jan 2014 12:56:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:56:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:56:30 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:56:31 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:56:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 12:56:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:56:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 12:56:31 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:56:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5607 values 88385 bits 11048 bytes 
Fri 17 Jan 2014 12:56:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:56:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:56:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:56:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:56:44 - XML: Processed 655668 elements - found 734 jobs
Fri 17 Jan 2014 12:56:44 - job 7347769 appears to have finished
Fri 17 Jan 2014 12:56:44 - job 7347786 appears to have finished
Fri 17 Jan 2014 12:56:44 - job 7347784 appears to have finished
Fri 17 Jan 2014 12:56:44 - job 7347783 appears to have finished
Fri 17 Jan 2014 12:56:44 - job 7347780 appears to have finished
Fri 17 Jan 2014 12:56:44 - job 7347774 appears to have finished
Fri 17 Jan 2014 12:56:44 - job 7347775 appears to have finished
Fri 17 Jan 2014 12:56:44 - job 7348139 field 'start_timestamp' changed since saved from: 1389959606 to: 1389959592
Fri 17 Jan 2014 12:56:44 - job 7348135 field 'start_timestamp' changed since saved from: 1389959643 to: 1389959592
Fri 17 Jan 2014 12:56:44 - job 7348137 field 'start_timestamp' changed since saved from: 1389959647 to: 1389959592
Fri 17 Jan 2014 12:56:44 - job 7348136 field 'start_timestamp' changed since saved from: 1389959645 to: 1389959592
Fri 17 Jan 2014 12:56:44 - job 7348144 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:56:44 - job 7348145 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:56:45 - job 7348140 field 'start_timestamp' changed since saved from: 1389959608 to: 1389959592
Fri 17 Jan 2014 12:56:45 - job 7348141 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:56:45 - job 7348142 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:56:45 - job 7348143 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:56:45 - job 7347771 appears to have finished
Fri 17 Jan 2014 12:56:45 - job_xml_thread(): Found 33 updated jobs.
Fri 17 Jan 2014 12:56:45 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 12:56:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:56:49 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:56:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:56:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:56:50 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:56:50 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:56:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:56:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:56:50 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:56:51 - job_xml_thread(): Done storing. succesfully stored: 33 jobs
Fri 17 Jan 2014 12:56:51 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:56:51 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:56:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:56:53 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:56:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:56:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:56:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:56:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:56:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:56:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:56:56 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:56:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43900088
Fri 17 Jan 2014 12:56:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:56:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43900088
Fri 17 Jan 2014 12:56:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:57:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:57:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:57:06 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:57:06 - job_xml_thread(): Done retrieving: data size 43900088
Fri 17 Jan 2014 12:57:07 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:57:07 - XML: Start document: iteration 6
Fri 17 Jan 2014 12:57:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:57:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:57:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:57:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:57:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:57:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:57:11 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:57:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:57:11 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:57:11 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:57:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:57:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:57:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:57:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:57:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:57:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:57:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:57:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:57:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:57:19 - XML: Processed 655668 elements - found 734 jobs
Fri 17 Jan 2014 12:57:19 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 12:57:19 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 12:57:19 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:57:19 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:57:19 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:57:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 12:57:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:57:22 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:57:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875769
Fri 17 Jan 2014 12:57:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:57:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875769
Fri 17 Jan 2014 12:57:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:57:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:57:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:57:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:57:31 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:57:32 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:57:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:57:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 12:57:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 12:57:32 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:57:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5846 values 92177 bits 11522 bytes 
Fri 17 Jan 2014 12:57:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:57:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:57:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:57:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:57:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:57:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:57:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:57:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:57:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:57:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:57:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:57:34 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:57:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:57:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:57:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:57:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:57:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:57:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:57:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:57:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:57:42 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:57:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43891135
Fri 17 Jan 2014 12:57:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:57:43 - job_xml_thread(): Done retrieving: data size 43891135
Fri 17 Jan 2014 12:57:43 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:57:43 - XML: Start document: iteration 7
Fri 17 Jan 2014 12:57:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43891135
Fri 17 Jan 2014 12:57:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:57:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:57:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:57:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:57:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:57:58 - XML: Processed 655668 elements - found 734 jobs
Fri 17 Jan 2014 12:57:58 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 12:57:58 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 12:57:58 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:57:58 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:58:03 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:58:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 12:58:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:58:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:58:03 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:58:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:58:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:58:04 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:58:04 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:58:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:58:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:58:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:58:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:58:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:58:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:58:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:58:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:58:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:58:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:58:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:58:09 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:58:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43907301
Fri 17 Jan 2014 12:58:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:58:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43907301
Fri 17 Jan 2014 12:58:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:58:13 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:58:13 - job_xml_thread(): Done retrieving: data size 43907301
Fri 17 Jan 2014 12:58:13 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:58:13 - XML: Start document: iteration 8
Fri 17 Jan 2014 12:58:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:58:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:58:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:58:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:58:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:58:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:58:20 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:58:20 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:58:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:58:20 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:58:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:58:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:58:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:58:27 - XML: Processed 655658 elements - found 729 jobs
Fri 17 Jan 2014 12:58:27 - job 7347787 appears to have finished
Fri 17 Jan 2014 12:58:27 - job 7347782 appears to have finished
Fri 17 Jan 2014 12:58:27 - job 7347772 appears to have finished
Fri 17 Jan 2014 12:58:27 - job 7347776 appears to have finished
Fri 17 Jan 2014 12:58:27 - job 7347777 appears to have finished
Fri 17 Jan 2014 12:58:27 - job 7348150 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:58:27 - job 7348148 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:58:27 - job 7348149 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:58:27 - job 7348146 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:58:27 - job 7348147 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 12:58:27 - job 7347778 appears to have finished
Fri 17 Jan 2014 12:58:27 - job 7347770 appears to have finished
Fri 17 Jan 2014 12:58:27 - job_xml_thread(): Found 14 updated jobs.
Fri 17 Jan 2014 12:58:27 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 12:58:29 - job_xml_thread(): Done storing. succesfully stored: 14 jobs
Fri 17 Jan 2014 12:58:29 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:58:29 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:58:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:58:31 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:58:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:58:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:58:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:58:33 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:58:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:58:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:58:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:58:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:58:33 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 12:58:33 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 12:58:33 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:58:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:58:35 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:58:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 12:58:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 12:58:35 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:58:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5841 values 92107 bits 11513 bytes 
Fri 17 Jan 2014 12:58:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:58:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:58:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:58:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862663
Fri 17 Jan 2014 12:58:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:58:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862663
Fri 17 Jan 2014 12:58:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:58:44 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:58:44 - job_xml_thread(): Done retrieving: data size 43862663
Fri 17 Jan 2014 12:58:44 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:58:44 - XML: Start document: iteration 9
Fri 17 Jan 2014 12:58:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:58:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:58:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:58:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:58:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:58:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:58:53 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:58:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:58:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:58:53 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:58:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:58:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:58:59 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:58:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:58:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:59:00 - XML: Processed 655658 elements - found 729 jobs
Fri 17 Jan 2014 12:59:00 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 12:59:00 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 12:59:00 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:59:00 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:59:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:59:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:59:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:59:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:59:00 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:59:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 12:59:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:59:01 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:59:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43895701
Fri 17 Jan 2014 12:59:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:59:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43895701
Fri 17 Jan 2014 12:59:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:59:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:59:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:59:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:59:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:59:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:59:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:59:11 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:59:11 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:59:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:59:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43895701
Fri 17 Jan 2014 12:59:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:59:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:59:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:59:15 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 12:59:15 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:59:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:59:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:59:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:59:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:59:23 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:59:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:59:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:59:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:59:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:59:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:59:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:59:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:59:25 - job_xml_thread(): Done retrieving: data size 43810816
Fri 17 Jan 2014 12:59:25 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 12:59:25 - XML: Start document: iteration 10
Fri 17 Jan 2014 12:59:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43810816
Fri 17 Jan 2014 12:59:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:59:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:59:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:59:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:59:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:59:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43810816
Fri 17 Jan 2014 12:59:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:59:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:59:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:59:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:59:35 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:59:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:59:36 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:59:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 12:59:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 12:59:36 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 12:59:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8486 values 133802 bits 16725 bytes 
Fri 17 Jan 2014 12:59:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 12:59:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:59:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:59:41 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:59:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:59:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:59:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:59:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:59:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:59:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:59:43 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 12:59:45 - XML: Processed 654907 elements - found 729 jobs
Fri 17 Jan 2014 12:59:45 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 12:59:45 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 12:59:45 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 12:59:45 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 12:59:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 12:59:48 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 12:59:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 12:59:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 12:59:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:59:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 12:59:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 12:59:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 12:59:50 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 12:59:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43251586
Fri 17 Jan 2014 12:59:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 12:59:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43251586
Fri 17 Jan 2014 12:59:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 12:59:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 12:59:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 12:59:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 12:59:58 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 12:59:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 12:59:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 12:59:59 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:59:59 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 12:59:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 12:59:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 12:59:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43251586
Fri 17 Jan 2014 12:59:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:00:00 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:00:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:00:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:00:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:00:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:00:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:00:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:00:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:00:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:00:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:00:11 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:00:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 13:00:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:00:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:00:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:00:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:00:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:00:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:00:12 - job_xml_thread(): Done retrieving: data size 43205699
Fri 17 Jan 2014 13:00:12 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:00:12 - XML: Start document: iteration 11
Fri 17 Jan 2014 13:00:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43205699
Fri 17 Jan 2014 13:00:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:00:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:00:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:00:16 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:00:16 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:00:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:00:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:00:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43205699
Fri 17 Jan 2014 13:00:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:00:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:00:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:00:27 - XML: Processed 647444 elements - found 722 jobs
Fri 17 Jan 2014 13:00:27 - job 7348115 appears to have finished
Fri 17 Jan 2014 13:00:27 - job 7347781 appears to have finished
Fri 17 Jan 2014 13:00:28 - job 7348101 appears to have finished
Fri 17 Jan 2014 13:00:28 - job 7348087 appears to have finished
Fri 17 Jan 2014 13:00:28 - job 7348090 appears to have finished
Fri 17 Jan 2014 13:00:28 - job 7348154 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:00:28 - job 7348153 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:00:28 - job 7348152 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:00:28 - job 7348151 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:00:28 - job 7348148 field 'start_timestamp' changed since saved from: 1389959849 to: 1389959801
Fri 17 Jan 2014 13:00:28 - job 7348149 field 'start_timestamp' changed since saved from: 1389959851 to: 1389959801
Fri 17 Jan 2014 13:00:28 - job 7348209 appears to have finished
Fri 17 Jan 2014 13:00:28 - job 7348222 appears to have finished
Fri 17 Jan 2014 13:00:28 - job_xml_thread(): Found 13 updated jobs.
Fri 17 Jan 2014 13:00:28 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 13:00:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:00:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:00:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:00:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:00:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:00:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:00:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:00:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:00:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:00:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:00:34 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:00:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:00:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:00:34 - job_xml_thread(): Done storing. succesfully stored: 13 jobs
Fri 17 Jan 2014 13:00:34 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:00:34 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:00:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:00:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:00:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:00:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:00:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:00:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43749764
Fri 17 Jan 2014 13:00:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:00:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43749764
Fri 17 Jan 2014 13:00:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:00:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:00:36 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:00:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:00:37 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:00:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 13:00:37 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:00:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 13:00:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8887 values 140176 bits 17522 bytes 
Fri 17 Jan 2014 13:00:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:00:45 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:00:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:00:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:00:49 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:00:49 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:00:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:00:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:00:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:00:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:00:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:00:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:00:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:00:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:00:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:00:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:00:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:00:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:00:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:00:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:00:53 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:00:53 - job_xml_thread(): Done retrieving: data size 43863464
Fri 17 Jan 2014 13:00:53 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:00:53 - XML: Start document: iteration 12
Fri 17 Jan 2014 13:00:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43863464
Fri 17 Jan 2014 13:00:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:00:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43863464
Fri 17 Jan 2014 13:00:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:00:55 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 13:00:55 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:00:56 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:00:56 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:00:56 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 13:00:56 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 13:00:56 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Fri 17 Jan 2014 13:01:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:01:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:01:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:01:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:01:10 - XML: Processed 655170 elements - found 722 jobs
Fri 17 Jan 2014 13:01:11 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:01:11 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:01:11 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:01:11 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:01:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:01:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:01:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:01:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:01:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:01:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:01:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:01:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:01:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:01:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:01:14 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:01:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:01:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:01:14 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:01:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 13:01:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:01:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:01:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:01:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:01:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:01:16 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:01:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43891434
Fri 17 Jan 2014 13:01:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:01:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43891434
Fri 17 Jan 2014 13:01:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:01:26 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:01:26 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:01:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:01:27 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:01:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:01:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:01:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:01:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:01:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:01:30 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:01:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:01:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:01:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:01:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:01:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:01:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:01:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:01:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:01:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:01:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:01:31 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:01:31 - job_xml_thread(): Done retrieving: data size 43872764
Fri 17 Jan 2014 13:01:31 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:01:31 - XML: Start document: iteration 13
Fri 17 Jan 2014 13:01:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43872764
Fri 17 Jan 2014 13:01:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:01:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43872764
Fri 17 Jan 2014 13:01:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:01:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:01:38 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:01:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:01:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 13:01:40 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:01:40 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:01:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9024 values 142565 bits 17820 bytes 
Fri 17 Jan 2014 13:01:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 13:01:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:01:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:01:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:01:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:01:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:01:48 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:01:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:01:48 - XML: Processed 655644 elements - found 722 jobs
Fri 17 Jan 2014 13:01:48 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:01:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:01:48 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:01:48 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:01:48 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:01:50 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:01:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:01:50 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:01:50 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:01:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:01:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:01:52 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:01:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:01:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:01:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:01:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:01:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:01:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:01:54 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:01:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43895951
Fri 17 Jan 2014 13:01:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:01:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43895951
Fri 17 Jan 2014 13:01:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:01:57 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:01:57 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:01:57 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:01:57 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 13:01:57 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 13:01:58 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:01:58 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 13:02:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:02:03 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:02:04 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:02:04 - job_xml_thread(): Done retrieving: data size 43895951
Fri 17 Jan 2014 13:02:04 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:02:04 - XML: Start document: iteration 14
Fri 17 Jan 2014 13:02:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:02:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:02:06 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:02:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:02:06 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:02:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:02:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:02:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:02:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:02:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:02:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:02:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:02:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:02:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:02:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:02:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:02:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:02:15 - size of cluster 'LISA Cluster': 624 hosts 79487 metrics 931026 values 14701388 bits 1837673 bytes 
Fri 17 Jan 2014 13:02:17 - XML: Processed 655639 elements - found 720 jobs
Fri 17 Jan 2014 13:02:17 - job 7348100 appears to have finished
Fri 17 Jan 2014 13:02:17 - job 7348095 appears to have finished
Fri 17 Jan 2014 13:02:17 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 13:02:17 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 13:02:18 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 13:02:18 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:02:18 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:02:18 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:02:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 13:02:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:02:21 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:02:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858645
Fri 17 Jan 2014 13:02:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:02:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43858645
Fri 17 Jan 2014 13:02:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:02:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:02:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:02:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:02:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:02:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:02:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:02:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:02:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:02:30 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:02:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:02:30 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:02:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858645
Fri 17 Jan 2014 13:02:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:02:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:02:33 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:02:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:02:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:02:40 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:02:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:02:41 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:02:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:02:41 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:02:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 13:02:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 13:02:42 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:02:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5652 values 89379 bits 11172 bytes 
Fri 17 Jan 2014 13:02:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:02:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:02:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:02:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:02:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:02:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:02:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:02:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:02:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:02:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:02:45 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:02:45 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:02:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:02:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:02:47 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:02:47 - job_xml_thread(): Done retrieving: data size 43868849
Fri 17 Jan 2014 13:02:47 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:02:47 - XML: Start document: iteration 15
Fri 17 Jan 2014 13:02:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43868849
Fri 17 Jan 2014 13:02:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43868849
Fri 17 Jan 2014 13:02:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:02:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:02:58 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:02:58 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 13:02:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:02:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:03:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:03:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:03:04 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:03:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 13:03:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:03:05 - XML: Processed 655648 elements - found 724 jobs
Fri 17 Jan 2014 13:03:05 - job 7348156 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:03:06 - job 7348155 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:03:06 - job_xml_thread(): Found 6 updated jobs.
Fri 17 Jan 2014 13:03:06 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 13:03:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:03:07 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:03:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:03:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:03:07 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:03:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:03:07 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:03:07 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Fri 17 Jan 2014 13:03:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:03:07 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:03:07 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:03:07 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:03:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:03:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:03:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:03:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:03:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:03:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:03:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:03:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:03:14 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:03:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43902098
Fri 17 Jan 2014 13:03:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:03:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43902098
Fri 17 Jan 2014 13:03:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:03:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:03:22 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:03:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:03:22 - job_xml_thread(): Done retrieving: data size 43902098
Fri 17 Jan 2014 13:03:22 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:03:22 - XML: Start document: iteration 16
Fri 17 Jan 2014 13:03:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:03:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:03:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:03:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:03:23 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:03:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:03:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43902098
Fri 17 Jan 2014 13:03:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:03:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:03:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:03:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:03:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:03:34 - XML: Processed 655648 elements - found 724 jobs
Fri 17 Jan 2014 13:03:35 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:03:35 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:03:35 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:03:35 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:03:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:03:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:03:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:03:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:03:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:03:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:03:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:03:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:03:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:03:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:03:40 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:03:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:03:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:03:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:03:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:03:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:03:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:03:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:03:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:03:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:03:41 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:03:42 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:03:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 13:03:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:03:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 13:03:42 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:03:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5796 values 91611 bits 11451 bytes 
Fri 17 Jan 2014 13:03:44 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:03:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43906160
Fri 17 Jan 2014 13:03:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:03:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43906160
Fri 17 Jan 2014 13:03:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:03:50 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:03:50 - job_xml_thread(): Done retrieving: data size 43906160
Fri 17 Jan 2014 13:03:50 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:03:50 - XML: Start document: iteration 17
Fri 17 Jan 2014 13:03:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:03:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:03:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:03:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:04:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:04:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:04:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:04:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:04:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:04:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:04:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:04:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:04:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:04:05 - XML: Processed 655646 elements - found 724 jobs
Fri 17 Jan 2014 13:04:05 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:04:05 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:04:05 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:04:05 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:04:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:04:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:04:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:04:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:04:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:04:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:04:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:04:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:04:11 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:04:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 13:04:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:04:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:04:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43894941
Fri 17 Jan 2014 13:04:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:04:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43894941
Fri 17 Jan 2014 13:04:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:04:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:04:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:04:21 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:04:21 - job_xml_thread(): Done retrieving: data size 43894941
Fri 17 Jan 2014 13:04:21 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:04:21 - XML: Start document: iteration 18
Fri 17 Jan 2014 13:04:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:04:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:04:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:04:27 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:04:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:04:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:04:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:04:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:04:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:04:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:04:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:04:36 - XML: Processed 655648 elements - found 724 jobs
Fri 17 Jan 2014 13:04:36 - job 7346016 appears to have finished
Fri 17 Jan 2014 13:04:36 - job 7348084 appears to have finished
Fri 17 Jan 2014 13:04:36 - job 7348157 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:04:36 - job_xml_thread(): Found 5 updated jobs.
Fri 17 Jan 2014 13:04:36 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 13:04:37 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Fri 17 Jan 2014 13:04:37 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:04:37 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:04:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:04:37 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:04:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:04:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:04:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:04:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:04:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:04:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:04:40 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:04:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43883483
Fri 17 Jan 2014 13:04:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:04:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43883483
Fri 17 Jan 2014 13:04:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:04:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:04:42 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:04:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:04:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:04:43 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:04:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 13:04:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:04:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 13:04:43 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:04:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7542 values 118988 bits 14873 bytes 
Fri 17 Jan 2014 13:04:52 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:04:52 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:04:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:04:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:04:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:04:53 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:04:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:04:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:04:54 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:04:54 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:04:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:04:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:04:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:04:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:04:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:04:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:04:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:04:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:04:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:04:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:04:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:04:58 - job_xml_thread(): Done retrieving: data size 43903361
Fri 17 Jan 2014 13:04:58 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:04:58 - XML: Start document: iteration 19
Fri 17 Jan 2014 13:04:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43903361
Fri 17 Jan 2014 13:04:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:04:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43903361
Fri 17 Jan 2014 13:04:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:05:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:05:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:05:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:05:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:05:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:05:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:05:16 - XML: Processed 655648 elements - found 724 jobs
Fri 17 Jan 2014 13:05:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:05:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:05:16 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:05:16 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:05:16 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:05:16 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:05:16 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:05:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:05:17 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:05:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:05:17 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:05:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:05:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:05:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:05:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:05:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:05:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:05:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:05:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:05:22 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:05:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 13:05:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:05:23 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 13:05:23 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 13:05:23 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:05:24 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:05:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43830671
Fri 17 Jan 2014 13:05:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:05:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43830671
Fri 17 Jan 2014 13:05:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:05:31 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:05:31 - job_xml_thread(): Done retrieving: data size 43830671
Fri 17 Jan 2014 13:05:31 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:05:31 - XML: Start document: iteration 20
Fri 17 Jan 2014 13:05:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:05:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:05:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:05:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:05:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:05:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:05:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:05:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:05:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:05:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:05:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:05:40 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:05:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:05:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:05:44 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:05:44 - XML: Processed 654900 elements - found 724 jobs
Fri 17 Jan 2014 13:05:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:05:44 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:05:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 13:05:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 13:05:44 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:05:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5729 values 90386 bits 11298 bytes 
Fri 17 Jan 2014 13:05:44 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:05:44 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:05:45 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:05:45 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:05:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:05:46 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:05:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:05:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:05:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:05:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:05:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:05:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:05:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:05:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43267167
Fri 17 Jan 2014 13:05:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:05:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43267167
Fri 17 Jan 2014 13:05:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:05:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:05:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:06:00 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:06:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:06:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:06:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:06:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:06:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:06:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:06:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:06:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:06:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:06:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:06:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:06:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:06:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:06:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:06:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:06:06 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:06:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 13:06:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:06:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:06:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:06:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:06:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:06:07 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:06:07 - job_xml_thread(): Done retrieving: data size 43230054
Fri 17 Jan 2014 13:06:07 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:06:07 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 13:06:07 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 13:06:07 - Housekeeping: done.
Fri 17 Jan 2014 13:06:07 - XML: Start document: iteration 0
Fri 17 Jan 2014 13:06:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43230054
Fri 17 Jan 2014 13:06:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43230054
Fri 17 Jan 2014 13:06:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:06:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:06:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:06:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:06:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:06:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:06:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:06:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:06:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:06:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:06:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:06:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:06:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:06:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:06:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:06:27 - XML: Processed 647448 elements - found 724 jobs
Fri 17 Jan 2014 13:06:27 - job 7347392 appears to have finished
Fri 17 Jan 2014 13:06:27 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 13:06:27 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 13:06:28 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 13:06:28 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:06:28 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:06:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:06:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:06:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:06:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:06:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:06:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:06:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:06:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:06:30 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:06:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43604490
Fri 17 Jan 2014 13:06:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:06:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43604490
Fri 17 Jan 2014 13:06:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:06:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:06:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:06:43 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:06:43 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:06:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:06:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:06:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:06:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:06:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:06:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:06:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:06:45 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:06:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:06:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 13:06:45 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:06:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8905 values 140477 bits 17559 bytes 
Fri 17 Jan 2014 13:06:45 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:06:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 13:06:45 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:06:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:06:45 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:06:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:06:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:06:45 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:06:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:06:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:06:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:06:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:06:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:06:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:06:48 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:06:48 - job_xml_thread(): Done retrieving: data size 43848165
Fri 17 Jan 2014 13:06:48 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:06:48 - XML: Start document: iteration 1
Fri 17 Jan 2014 13:06:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43848165
Fri 17 Jan 2014 13:06:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:06:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43848165
Fri 17 Jan 2014 13:06:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:07:00 - XML: Processed 655168 elements - found 724 jobs
Fri 17 Jan 2014 13:07:00 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:07:00 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:07:00 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:07:00 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:07:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:07:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:07:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:07:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:07:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:07:06 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:07:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:07:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:07:06 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:07:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:07:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:07:06 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:07:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:07:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:07:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:07:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:07:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:07:10 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:07:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 13:07:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:07:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:07:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:07:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:07:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:07:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:07:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43899482
Fri 17 Jan 2014 13:07:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:07:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43899482
Fri 17 Jan 2014 13:07:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:07:15 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:07:15 - job_xml_thread(): Done retrieving: data size 43899482
Fri 17 Jan 2014 13:07:15 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:07:15 - XML: Start document: iteration 2
Fri 17 Jan 2014 13:07:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:07:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:07:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:07:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:07:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:07:28 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:07:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:07:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:07:29 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:07:29 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:07:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:07:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:07:30 - XML: Processed 655648 elements - found 724 jobs
Fri 17 Jan 2014 13:07:30 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:07:30 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:07:30 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:07:30 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:07:30 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:07:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:07:33 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:07:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:07:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:07:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:07:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:07:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:07:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:07:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:07:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43891881
Fri 17 Jan 2014 13:07:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:07:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43891881
Fri 17 Jan 2014 13:07:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:07:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:07:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:07:45 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:07:45 - job_xml_thread(): Done retrieving: data size 43891881
Fri 17 Jan 2014 13:07:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:07:45 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:07:45 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:07:45 - XML: Start document: iteration 3
Fri 17 Jan 2014 13:07:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:07:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 13:07:46 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:07:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 13:07:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:07:47 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:07:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:07:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:07:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:07:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9231 values 145692 bits 18211 bytes 
Fri 17 Jan 2014 13:07:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:07:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:07:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:07:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:07:48 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:07:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:07:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:07:56 - XML: Processed 655648 elements - found 724 jobs
Fri 17 Jan 2014 13:07:56 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:07:56 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:07:56 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:07:56 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:07:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:07:57 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:07:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:07:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:07:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:07:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:07:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:07:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:07:59 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:07:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 13:07:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:07:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:07:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865710
Fri 17 Jan 2014 13:07:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:08:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43865710
Fri 17 Jan 2014 13:08:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:08:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:08:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:08:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:08:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:08:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:08:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:08:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:08:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:08:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:08:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:08:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865710
Fri 17 Jan 2014 13:08:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:08:11 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:08:11 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:08:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:08:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:08:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:08:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:08:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:08:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:08:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:08:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:08:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:08:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:08:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:08:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:08:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:08:20 - job_xml_thread(): Done retrieving: data size 43881842
Fri 17 Jan 2014 13:08:20 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:08:20 - XML: Start document: iteration 4
Fri 17 Jan 2014 13:08:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43881842
Fri 17 Jan 2014 13:08:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:08:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:08:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:08:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:08:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:08:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:08:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:08:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43881842
Fri 17 Jan 2014 13:08:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:08:32 - XML: Processed 655652 elements - found 726 jobs
Fri 17 Jan 2014 13:08:32 - job 7348159 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:08:32 - job 7348158 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:08:32 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 13:08:32 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 13:08:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:08:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:08:37 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 13:08:37 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:08:37 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:08:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:08:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:08:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:08:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:08:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:08:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:08:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:08:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:08:40 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:08:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:08:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:08:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:08:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:08:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:08:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:08:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:08:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:08:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:08:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43903352
Fri 17 Jan 2014 13:08:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:08:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43903352
Fri 17 Jan 2014 13:08:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:08:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:08:47 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:08:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:08:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 13:08:48 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:08:48 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:08:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148613 bits 18576 bytes 
Fri 17 Jan 2014 13:08:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 13:08:52 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:08:52 - job_xml_thread(): Done retrieving: data size 43903352
Fri 17 Jan 2014 13:08:52 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:08:52 - XML: Start document: iteration 5
Fri 17 Jan 2014 13:08:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:08:54 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:08:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:08:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:08:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:08:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:08:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:08:55 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:08:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:08:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:08:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:08:58 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 13:08:58 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:08:59 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:08:59 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:08:59 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 13:08:59 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 13:08:59 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 13:09:04 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 894340 values 14118098 bits 1764762 bytes 
Fri 17 Jan 2014 13:09:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:09:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:09:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:09:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:09:05 - XML: Processed 655652 elements - found 726 jobs
Fri 17 Jan 2014 13:09:05 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:09:05 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:09:05 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:09:05 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:09:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:09:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:09:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:09:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:09:09 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:09:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43874514
Fri 17 Jan 2014 13:09:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:09:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43874514
Fri 17 Jan 2014 13:09:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:09:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:09:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:09:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:09:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:09:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:09:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:09:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:09:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:09:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:09:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:09:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:09:20 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:09:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:09:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:09:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:09:23 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:09:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:09:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:09:24 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:09:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 13:09:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:09:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:09:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:09:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:09:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:09:26 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:09:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43897986
Fri 17 Jan 2014 13:09:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:09:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43897986
Fri 17 Jan 2014 13:09:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:09:27 - job_xml_thread(): Done retrieving: data size 43897986
Fri 17 Jan 2014 13:09:27 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:09:27 - XML: Start document: iteration 6
Fri 17 Jan 2014 13:09:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:09:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:09:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:09:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:09:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:09:42 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:09:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:09:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:09:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:09:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:09:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:09:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:09:43 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:09:45 - XML: Processed 655652 elements - found 726 jobs
Fri 17 Jan 2014 13:09:45 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:09:45 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:09:45 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:09:45 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:09:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:09:49 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:09:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:09:49 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:09:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:09:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:09:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:09:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:09:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:09:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:09:49 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:09:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:09:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 13:09:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 13:09:49 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:09:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5660 values 89233 bits 11154 bytes 
Fri 17 Jan 2014 13:09:53 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:09:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43888615
Fri 17 Jan 2014 13:09:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:09:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43888615
Fri 17 Jan 2014 13:09:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:09:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:09:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:10:00 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:10:00 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 13:10:00 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:10:00 - job_xml_thread(): Done retrieving: data size 43888615
Fri 17 Jan 2014 13:10:00 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:10:00 - XML: Start document: iteration 7
Fri 17 Jan 2014 13:10:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:10:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:10:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:10:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:10:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:10:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:10:06 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:10:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:10:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:10:06 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:10:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:10:13 - XML: Processed 655651 elements - found 726 jobs
Fri 17 Jan 2014 13:10:13 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:10:13 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:10:13 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:10:13 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:10:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:10:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:10:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:10:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:10:17 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:10:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 13:10:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:10:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:10:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:10:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:10:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:10:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:10:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856128
Fri 17 Jan 2014 13:10:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:10:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43856128
Fri 17 Jan 2014 13:10:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:10:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:10:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:10:28 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:10:28 - job_xml_thread(): Done retrieving: data size 43856128
Fri 17 Jan 2014 13:10:28 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:10:28 - XML: Start document: iteration 8
Fri 17 Jan 2014 13:10:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:10:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:10:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:10:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:10:32 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:10:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:10:32 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:10:32 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:10:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:10:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:10:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:10:38 - XML: Processed 655652 elements - found 726 jobs
Fri 17 Jan 2014 13:10:38 - job 7348114 appears to have finished
Fri 17 Jan 2014 13:10:38 - job 7348122 appears to have finished
Fri 17 Jan 2014 13:10:38 - job 7348127 appears to have finished
Fri 17 Jan 2014 13:10:38 - job 7348158 field 'start_timestamp' changed since saved from: 1389960454 to: 1389960390
Fri 17 Jan 2014 13:10:38 - job 7348160 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:10:38 - job 7348161 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:10:38 - job_xml_thread(): Found 9 updated jobs.
Fri 17 Jan 2014 13:10:38 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 13:10:40 - job_xml_thread(): Done storing. succesfully stored: 9 jobs
Fri 17 Jan 2014 13:10:40 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:10:40 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:10:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:10:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:10:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:10:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:10:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:10:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:10:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:10:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:10:46 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:10:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873490
Fri 17 Jan 2014 13:10:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:10:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873490
Fri 17 Jan 2014 13:10:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:10:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:10:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:10:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:10:49 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:10:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:10:50 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:10:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 13:10:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 13:10:51 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:10:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8516 values 134269 bits 16783 bytes 
Fri 17 Jan 2014 13:10:55 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:10:55 - job_xml_thread(): Done retrieving: data size 43873490
Fri 17 Jan 2014 13:10:55 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:10:55 - XML: Start document: iteration 9
Fri 17 Jan 2014 13:10:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:10:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:11:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:11:03 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:11:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:11:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:11:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:11:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:11:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:11:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:11:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:11:07 - XML: Processed 655652 elements - found 726 jobs
Fri 17 Jan 2014 13:11:07 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:11:07 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:11:07 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:11:07 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:11:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:11:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:11:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:11:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:11:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:11:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:11:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:11:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:11:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:11:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43845823
Fri 17 Jan 2014 13:11:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:11:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43845823
Fri 17 Jan 2014 13:11:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:11:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:11:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:11:22 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:11:22 - job_xml_thread(): Done retrieving: data size 43845823
Fri 17 Jan 2014 13:11:22 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:11:22 - XML: Start document: iteration 10
Fri 17 Jan 2014 13:11:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:11:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:11:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:11:28 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:11:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:11:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:11:29 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:11:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:11:29 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:11:29 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:11:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:11:31 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:11:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 13:11:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:11:34 - XML: Processed 655152 elements - found 726 jobs
Fri 17 Jan 2014 13:11:34 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:11:34 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:11:34 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:11:34 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:11:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:11:36 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:11:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:11:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:11:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:11:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:11:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:11:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:11:39 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:11:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43342915
Fri 17 Jan 2014 13:11:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:11:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43342915
Fri 17 Jan 2014 13:11:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:11:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:11:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:11:49 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:11:49 - job_xml_thread(): Done retrieving: data size 43342915
Fri 17 Jan 2014 13:11:49 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:11:49 - XML: Start document: iteration 11
Fri 17 Jan 2014 13:11:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:11:51 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:11:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:11:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 13:11:51 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:11:51 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:11:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 13:11:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5846 values 92184 bits 11523 bytes 
Fri 17 Jan 2014 13:11:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:11:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:11:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:11:54 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:11:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:11:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:11:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:11:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:11:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:11:55 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:11:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:11:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:11:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:11:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:11:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:11:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:11:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:11:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:11:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:11:59 - XML: Processed 649076 elements - found 726 jobs
Fri 17 Jan 2014 13:11:59 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:11:59 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:11:59 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:11:59 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:12:03 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:12:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 13:12:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:12:03 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:12:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43214656
Fri 17 Jan 2014 13:12:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:12:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43214656
Fri 17 Jan 2014 13:12:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:12:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:12:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:12:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:12:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:12:14 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:12:14 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:12:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:12:16 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:12:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:12:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:12:17 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:12:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:12:17 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:12:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:12:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:12:19 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:12:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:12:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:12:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:12:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:12:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:12:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:12:22 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:12:22 - job_xml_thread(): Done retrieving: data size 43286579
Fri 17 Jan 2014 13:12:22 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:12:22 - XML: Start document: iteration 12
Fri 17 Jan 2014 13:12:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43286579
Fri 17 Jan 2014 13:12:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:12:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43286579
Fri 17 Jan 2014 13:12:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:12:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:12:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:12:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:12:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:12:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:12:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:12:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:12:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:12:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:12:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:12:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:12:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:12:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:12:44 - XML: Processed 648128 elements - found 727 jobs
Fri 17 Jan 2014 13:12:44 - job 7347768 appears to have finished
Fri 17 Jan 2014 13:12:44 - job 7348169 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:12:44 - job 7348166 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:12:44 - job 7348167 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:12:44 - job 7348168 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:12:44 - job 7348076 appears to have finished
Fri 17 Jan 2014 13:12:44 - job 7348171 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:12:44 - job 7348170 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:12:44 - job 7348164 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:12:44 - job 7348165 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:12:44 - job 7348162 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:12:44 - job_xml_thread(): Found 14 updated jobs.
Fri 17 Jan 2014 13:12:44 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 13:12:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:12:44 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:12:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:12:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:12:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:12:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:12:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:12:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:12:47 - job_xml_thread(): Done storing. succesfully stored: 14 jobs
Fri 17 Jan 2014 13:12:47 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:12:47 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:12:50 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:12:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43805712
Fri 17 Jan 2014 13:12:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:12:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43805712
Fri 17 Jan 2014 13:12:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:12:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:12:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:12:52 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:12:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:12:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:12:52 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:12:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 13:12:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 13:12:52 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:12:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148624 bits 18578 bytes 
Fri 17 Jan 2014 13:12:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:12:58 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:12:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:12:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:12:59 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:12:59 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:12:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:12:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43805712
Fri 17 Jan 2014 13:12:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:12:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:13:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:13:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:13:02 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:13:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:13:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:13:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:13:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:13:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:13:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:13:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:13:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:13:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:13:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:13:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:13:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:13:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:13:15 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 13:13:15 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 13:13:15 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:13:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:13:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:13:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:13:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:13:15 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:13:15 - job_xml_thread(): Done retrieving: data size 43877357
Fri 17 Jan 2014 13:13:15 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:13:15 - XML: Start document: iteration 13
Fri 17 Jan 2014 13:13:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43877357
Fri 17 Jan 2014 13:13:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:13:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43877357
Fri 17 Jan 2014 13:13:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:13:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:13:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:13:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:13:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:13:31 - XML: Processed 655654 elements - found 727 jobs
Fri 17 Jan 2014 13:13:32 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:13:32 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:13:32 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:13:32 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:13:32 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:13:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 13:13:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:13:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:13:34 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:13:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:13:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:13:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:13:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:13:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:13:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:13:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:13:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:13:38 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:13:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:13:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:13:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:13:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:13:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:13:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:13:39 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:13:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43900874
Fri 17 Jan 2014 13:13:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:13:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43900874
Fri 17 Jan 2014 13:13:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:13:47 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:13:47 - job_xml_thread(): Done retrieving: data size 43900874
Fri 17 Jan 2014 13:13:47 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:13:47 - XML: Start document: iteration 14
Fri 17 Jan 2014 13:13:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:13:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:13:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:13:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:13:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:13:53 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:13:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:13:53 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:13:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:13:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:13:54 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:13:54 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:13:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:13:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:13:54 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:13:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:13:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 13:13:54 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:13:54 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:13:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 13:13:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6253 values 98631 bits 12328 bytes 
Fri 17 Jan 2014 13:14:01 - XML: Processed 655654 elements - found 727 jobs
Fri 17 Jan 2014 13:14:01 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:14:01 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:14:01 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:14:01 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:14:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:14:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:14:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:14:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:14:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:14:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:14:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:14:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:14:04 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:14:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 13:14:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:14:04 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:14:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858028
Fri 17 Jan 2014 13:14:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:14:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43858028
Fri 17 Jan 2014 13:14:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:14:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:14:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:14:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:14:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:14:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:14:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:14:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:14:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:14:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:14:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:14:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858028
Fri 17 Jan 2014 13:14:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:14:16 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:14:16 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:14:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:14:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:14:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:14:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:14:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:14:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:14:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:14:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:14:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:14:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:14:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:14:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:14:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:14:25 - job_xml_thread(): Done retrieving: data size 43884419
Fri 17 Jan 2014 13:14:25 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:14:25 - XML: Start document: iteration 15
Fri 17 Jan 2014 13:14:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43884419
Fri 17 Jan 2014 13:14:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:14:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:14:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:14:29 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:14:29 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:14:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:14:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43884419
Fri 17 Jan 2014 13:14:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:14:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:14:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:14:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:14:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:14:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:14:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:14:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:14:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:14:45 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:14:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:14:45 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:14:45 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:14:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:14:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:14:45 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:14:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:14:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:14:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:14:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:14:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:14:47 - XML: Processed 655619 elements - found 710 jobs
Fri 17 Jan 2014 13:14:47 - job 7347750 appears to have finished
Fri 17 Jan 2014 13:14:47 - job 7347751 appears to have finished
Fri 17 Jan 2014 13:14:47 - job 7347754 appears to have finished
Fri 17 Jan 2014 13:14:47 - job 7347756 appears to have finished
Fri 17 Jan 2014 13:14:47 - job 7347757 appears to have finished
Fri 17 Jan 2014 13:14:47 - job 7347758 appears to have finished
Fri 17 Jan 2014 13:14:47 - job 7348180 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:14:47 - job 7348181 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:14:47 - job 7348182 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:14:47 - job 7348183 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:14:47 - job 7348184 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:14:47 - job 7348185 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:14:47 - job 7348186 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:14:47 - job 7348187 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:14:47 - job 7347765 appears to have finished
Fri 17 Jan 2014 13:14:47 - job 7347764 appears to have finished
Fri 17 Jan 2014 13:14:47 - job 7347760 appears to have finished
Fri 17 Jan 2014 13:14:47 - job 7347763 appears to have finished
Fri 17 Jan 2014 13:14:47 - job 7347762 appears to have finished
Fri 17 Jan 2014 13:14:47 - job 7348169 field 'start_timestamp' changed since saved from: 1389960701 to: 1389960657
Fri 17 Jan 2014 13:14:47 - job 7347739 appears to have finished
Fri 17 Jan 2014 13:14:47 - job 7348166 field 'start_timestamp' changed since saved from: 1389960695 to: 1389960657
Fri 17 Jan 2014 13:14:47 - job 7348167 field 'start_timestamp' changed since saved from: 1389960697 to: 1389960657
Fri 17 Jan 2014 13:14:47 - job 7348179 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:14:47 - job 7348178 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:14:47 - job 7348170 field 'start_timestamp' changed since saved from: 1389960703 to: 1389960657
Fri 17 Jan 2014 13:14:47 - job 7348173 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:14:47 - job 7348172 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:14:47 - job 7348175 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:14:47 - job 7348174 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:14:47 - job 7348177 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:14:47 - job 7348176 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:14:47 - job 7347742 appears to have finished
Fri 17 Jan 2014 13:14:47 - job 7347741 appears to have finished
Fri 17 Jan 2014 13:14:47 - job 7347745 appears to have finished
Fri 17 Jan 2014 13:14:47 - job 7347748 appears to have finished
Fri 17 Jan 2014 13:14:47 - job 7347860 appears to have finished
Fri 17 Jan 2014 13:14:47 - job_xml_thread(): Found 37 updated jobs.
Fri 17 Jan 2014 13:14:47 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 13:14:47 - job_xml_thread(): Done storing. succesfully stored: 37 jobs
Fri 17 Jan 2014 13:14:47 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:14:47 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:14:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:14:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43884453
Fri 17 Jan 2014 13:14:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:14:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43884453
Fri 17 Jan 2014 13:14:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:14:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:14:55 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:14:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:14:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 13:14:55 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:14:55 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:14:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 13:14:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9127 values 143944 bits 17993 bytes 
Fri 17 Jan 2014 13:14:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:14:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:15:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:15:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:15:01 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:15:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:15:01 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:15:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:15:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:15:01 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:15:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:15:02 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:15:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:15:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:15:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:15:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:15:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:15:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:15:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:15:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:15:04 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:15:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 13:15:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:15:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:15:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43886154
Fri 17 Jan 2014 13:15:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:15:05 - job_xml_thread(): Done retrieving: data size 43886154
Fri 17 Jan 2014 13:15:05 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:15:05 - XML: Start document: iteration 16
Fri 17 Jan 2014 13:15:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43886154
Fri 17 Jan 2014 13:15:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:15:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:15:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:15:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:15:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:15:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:15:21 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:15:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:15:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:15:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:15:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:15:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:15:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:15:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:15:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:15:24 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:15:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:15:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:15:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:15:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:15:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:15:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:15:26 - XML: Processed 655620 elements - found 710 jobs
Fri 17 Jan 2014 13:15:26 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:15:26 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:15:26 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:15:26 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:15:28 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:15:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43887246
Fri 17 Jan 2014 13:15:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:15:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43887246
Fri 17 Jan 2014 13:15:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:15:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:15:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:15:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:15:38 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:15:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:15:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:15:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:15:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:15:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:15:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:15:40 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:15:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:15:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:15:41 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:15:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:15:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:15:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:15:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:15:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:15:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:15:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:15:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:15:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:15:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43898750
Fri 17 Jan 2014 13:15:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:15:44 - job_xml_thread(): Done retrieving: data size 43898750
Fri 17 Jan 2014 13:15:44 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:15:44 - XML: Start document: iteration 17
Fri 17 Jan 2014 13:15:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43898750
Fri 17 Jan 2014 13:15:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:15:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:15:53 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:15:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:15:55 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:15:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:15:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:15:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:15:56 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:15:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:15:56 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:15:56 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:15:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 13:15:56 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:15:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 13:15:56 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:15:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:15:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9279 values 146409 bits 18301 bytes 
Fri 17 Jan 2014 13:15:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:15:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:16:00 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 13:16:00 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:16:01 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:16:01 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:16:01 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 13:16:01 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 13:16:01 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 13:16:03 - XML: Processed 655620 elements - found 710 jobs
Fri 17 Jan 2014 13:16:03 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:16:03 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:16:03 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:16:03 - job_xml_thread(): Sleeping.. (15s)
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Fri 17 Jan 2014 13:16:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:16:06 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:16:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:16:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:16:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:16:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:16:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:16:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:16:08 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:16:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43868983
Fri 17 Jan 2014 13:16:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:16:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43868983
Fri 17 Jan 2014 13:16:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:16:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:16:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:16:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:16:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:16:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:16:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:16:16 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:16:16 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:16:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:16:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:16:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43868983
Fri 17 Jan 2014 13:16:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:16:18 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:16:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:16:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:16:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:16:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:16:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:16:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:16:27 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:16:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:16:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:16:27 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:16:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 13:16:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:16:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:16:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:16:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:16:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:16:29 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:16:29 - job_xml_thread(): Done retrieving: data size 43888341
Fri 17 Jan 2014 13:16:29 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:16:29 - XML: Start document: iteration 18
Fri 17 Jan 2014 13:16:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43888341
Fri 17 Jan 2014 13:16:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:16:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:16:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:16:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:16:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:16:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:16:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:16:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43888341
Fri 17 Jan 2014 13:16:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:16:39 - XML: Processed 655658 elements - found 729 jobs
Fri 17 Jan 2014 13:16:39 - job 7347752 appears to have finished
Fri 17 Jan 2014 13:16:39 - job 7347759 appears to have finished
Fri 17 Jan 2014 13:16:39 - job 7348188 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:16:39 - job 7348189 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:16:39 - job 7347766 appears to have finished
Fri 17 Jan 2014 13:16:39 - job 7347740 appears to have finished
Fri 17 Jan 2014 13:16:39 - job 7347747 appears to have finished
Fri 17 Jan 2014 13:16:39 - job 7347746 appears to have finished
Fri 17 Jan 2014 13:16:39 - job 7347744 appears to have finished
Fri 17 Jan 2014 13:16:40 - job 7348190 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:16:40 - job 7348191 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:16:40 - job_xml_thread(): Found 37 updated jobs.
Fri 17 Jan 2014 13:16:40 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 13:16:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:16:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:16:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:16:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:16:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:16:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:16:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:16:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:16:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:16:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:16:49 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:16:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:16:49 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:16:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:16:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:16:50 - job_xml_thread(): Done storing. succesfully stored: 37 jobs
Fri 17 Jan 2014 13:16:50 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:16:50 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:16:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:16:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:16:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:16:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:16:51 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:16:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43914572
Fri 17 Jan 2014 13:16:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:16:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43914572
Fri 17 Jan 2014 13:16:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:16:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:16:57 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:16:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:16:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 13:16:58 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:16:58 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:16:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8908 values 140915 bits 17614 bytes 
Fri 17 Jan 2014 13:16:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 13:17:01 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:17:01 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:17:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:17:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:17:02 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:17:02 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 13:17:02 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:17:02 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 13:17:02 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 13:17:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:17:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:17:05 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:17:05 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:17:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:17:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:17:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:17:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:17:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:17:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:17:05 - size of cluster 'LISA Cluster': 624 hosts 79482 metrics 883184 values 13945609 bits 1743201 bytes 
Fri 17 Jan 2014 13:17:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:17:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:17:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:17:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:17:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:17:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:17:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:17:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:17:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:17:11 - job_xml_thread(): Done retrieving: data size 43830858
Fri 17 Jan 2014 13:17:11 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:17:11 - XML: Start document: iteration 19
Fri 17 Jan 2014 13:17:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43830858
Fri 17 Jan 2014 13:17:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:17:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43830858
Fri 17 Jan 2014 13:17:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:17:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:17:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:17:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:17:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:17:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:17:27 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:17:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:17:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:17:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:17:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:17:27 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:17:27 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:17:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:17:31 - XML: Processed 654909 elements - found 729 jobs
Fri 17 Jan 2014 13:17:31 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:17:31 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:17:31 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:17:31 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:17:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:17:34 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:17:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:17:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:17:34 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:17:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 13:17:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:17:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:17:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:17:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:17:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:17:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:17:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43440491
Fri 17 Jan 2014 13:17:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:17:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43440491
Fri 17 Jan 2014 13:17:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:17:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:17:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:17:46 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:17:46 - job_xml_thread(): Done retrieving: data size 43440491
Fri 17 Jan 2014 13:17:46 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:17:46 - XML: Start document: iteration 20
Fri 17 Jan 2014 13:17:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:17:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:17:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:17:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:17:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:17:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:17:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:17:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:17:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:17:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:17:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:17:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:17:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:17:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:17:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:17:58 - XML: Processed 650284 elements - found 729 jobs
Fri 17 Jan 2014 13:17:58 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:17:58 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:17:58 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:17:58 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:17:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:17:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:17:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:17:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:17:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:17:59 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:17:59 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:17:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:17:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 13:17:59 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:17:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 13:17:59 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5897 values 93260 bits 11657 bytes 
Fri 17 Jan 2014 13:18:01 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:18:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43253779
Fri 17 Jan 2014 13:18:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:18:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43253779
Fri 17 Jan 2014 13:18:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:18:02 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:18:02 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 13:18:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:18:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:18:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:18:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:18:13 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:18:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:18:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:18:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:18:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:18:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:18:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:18:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:18:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:18:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:18:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:18:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:18:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:18:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:18:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:18:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:18:17 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:18:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 13:18:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:18:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:18:18 - job_xml_thread(): Done retrieving: data size 43285493
Fri 17 Jan 2014 13:18:18 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:18:18 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 13:18:18 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 13:18:18 - Housekeeping: done.
Fri 17 Jan 2014 13:18:18 - XML: Start document: iteration 0
Fri 17 Jan 2014 13:18:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43285493
Fri 17 Jan 2014 13:18:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:18:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43285493
Fri 17 Jan 2014 13:18:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:18:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:18:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:18:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:18:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:18:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:18:37 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:18:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:18:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:18:38 - XML: Processed 647847 elements - found 728 jobs
Fri 17 Jan 2014 13:18:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:18:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:18:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:18:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:18:38 - job 7348139 appears to have finished
Fri 17 Jan 2014 13:18:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:18:38 - job 7348092 appears to have finished
Fri 17 Jan 2014 13:18:39 - job 7348142 appears to have finished
Fri 17 Jan 2014 13:18:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:18:39 - job 7347743 appears to have finished
Fri 17 Jan 2014 13:18:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:18:39 - job 7348193 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:18:39 - job 7348192 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:18:39 - job_xml_thread(): Found 9 updated jobs.
Fri 17 Jan 2014 13:18:39 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 13:18:39 - job_xml_thread(): Done storing. succesfully stored: 9 jobs
Fri 17 Jan 2014 13:18:39 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:18:39 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:18:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:18:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:18:39 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:18:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:18:39 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:18:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:18:41 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:18:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43797137
Fri 17 Jan 2014 13:18:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:18:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43797137
Fri 17 Jan 2014 13:18:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:18:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:18:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:18:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:18:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:18:54 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:18:54 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:18:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:18:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:18:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:18:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:18:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:18:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:18:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:18:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:18:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:18:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:18:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:18:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:18:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:18:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:18:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:18:59 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:19:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:19:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 13:19:00 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:19:00 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:19:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 13:19:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7778 values 122853 bits 15356 bytes 
Fri 17 Jan 2014 13:19:00 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:19:00 - job_xml_thread(): Done retrieving: data size 43887170
Fri 17 Jan 2014 13:19:00 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:19:00 - XML: Start document: iteration 1
Fri 17 Jan 2014 13:19:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43887170
Fri 17 Jan 2014 13:19:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:19:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43887170
Fri 17 Jan 2014 13:19:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:19:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:19:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:19:11 - XML: Processed 655418 elements - found 728 jobs
Fri 17 Jan 2014 13:19:11 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:19:11 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:19:11 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:19:11 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:19:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:19:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:19:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:19:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:19:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:19:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:19:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:19:23 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:19:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:19:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:19:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:19:23 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:19:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:19:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:19:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:19:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:19:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:19:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:19:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:19:26 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:19:26 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 13:19:26 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 13:19:26 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:19:27 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:19:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 13:19:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:19:27 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:19:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43891376
Fri 17 Jan 2014 13:19:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:19:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43891376
Fri 17 Jan 2014 13:19:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:19:28 - job_xml_thread(): Done retrieving: data size 43891376
Fri 17 Jan 2014 13:19:28 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:19:28 - XML: Start document: iteration 2
Fri 17 Jan 2014 13:19:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:19:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:19:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:19:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:19:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:19:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:19:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:19:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:19:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:19:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:19:43 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:19:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:19:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:19:46 - XML: Processed 655656 elements - found 728 jobs
Fri 17 Jan 2014 13:19:46 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:19:46 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:19:46 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:19:46 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:19:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:19:49 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:19:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:19:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:19:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:19:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:19:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:19:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:19:51 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:19:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875137
Fri 17 Jan 2014 13:19:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:19:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875137
Fri 17 Jan 2014 13:19:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:19:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:19:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:20:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:20:00 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:20:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:20:00 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:20:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:20:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:20:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:20:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 13:20:00 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:20:00 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:20:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 13:20:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6346 values 100092 bits 12511 bytes 
Fri 17 Jan 2014 13:20:01 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:20:01 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:20:01 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:20:01 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:20:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:20:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:20:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:20:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:20:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:20:06 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:20:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:20:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:20:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:20:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:20:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:20:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:20:08 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:20:08 - job_xml_thread(): Done retrieving: data size 43870088
Fri 17 Jan 2014 13:20:08 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:20:08 - XML: Start document: iteration 3
Fri 17 Jan 2014 13:20:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870088
Fri 17 Jan 2014 13:20:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870088
Fri 17 Jan 2014 13:20:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:20:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:20:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:20:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:20:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:20:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:20:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:20:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:20:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:20:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:20:23 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:20:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:20:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:20:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:20:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:20:27 - XML: Processed 655653 elements - found 728 jobs
Fri 17 Jan 2014 13:20:27 - job 7348121 appears to have finished
Fri 17 Jan 2014 13:20:27 - job 7348146 appears to have finished
Fri 17 Jan 2014 13:20:27 - job 7348193 field 'start_timestamp' changed since saved from: 1389961064 to: 1389961025
Fri 17 Jan 2014 13:20:27 - job_xml_thread(): Found 5 updated jobs.
Fri 17 Jan 2014 13:20:27 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 13:20:28 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Fri 17 Jan 2014 13:20:28 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:20:28 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:20:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:20:31 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:20:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:20:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:20:31 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:20:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 13:20:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:20:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:20:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:20:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:20:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:20:33 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:20:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43887785
Fri 17 Jan 2014 13:20:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:20:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43887785
Fri 17 Jan 2014 13:20:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:20:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:20:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:20:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:20:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:20:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:20:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:20:43 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:20:43 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:20:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:20:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:20:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:20:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:20:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:20:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:20:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:20:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:20:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:20:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:20:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:20:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:20:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:20:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:20:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:20:49 - job_xml_thread(): Done retrieving: data size 43890197
Fri 17 Jan 2014 13:20:49 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:20:49 - XML: Start document: iteration 4
Fri 17 Jan 2014 13:20:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43890197
Fri 17 Jan 2014 13:20:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:20:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43890197
Fri 17 Jan 2014 13:20:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:20:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:20:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:21:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:21:00 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:21:02 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:21:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:21:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 13:21:02 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:21:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 13:21:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8624 values 136043 bits 17005 bytes 
Fri 17 Jan 2014 13:21:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:21:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:21:08 - XML: Processed 655652 elements - found 728 jobs
Fri 17 Jan 2014 13:21:08 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:21:08 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:21:08 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:21:08 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:21:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:21:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:21:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:21:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:21:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:21:12 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:21:12 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:21:12 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:21:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:21:12 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:21:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:21:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:21:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:21:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:21:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:21:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:21:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:21:15 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:21:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43914371
Fri 17 Jan 2014 13:21:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:21:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43914371
Fri 17 Jan 2014 13:21:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:21:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:21:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:21:23 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:21:23 - job_xml_thread(): Done retrieving: data size 43914371
Fri 17 Jan 2014 13:21:23 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:21:23 - XML: Start document: iteration 5
Fri 17 Jan 2014 13:21:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:21:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:21:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:21:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:21:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:21:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:21:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:21:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:21:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:21:34 - XML: Processed 655656 elements - found 728 jobs
Fri 17 Jan 2014 13:21:34 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:21:34 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:21:34 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:21:34 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:21:36 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:21:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 13:21:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:21:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:21:37 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:21:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:21:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:21:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:21:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:21:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:21:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:21:39 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:21:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43874690
Fri 17 Jan 2014 13:21:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:21:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43874690
Fri 17 Jan 2014 13:21:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:21:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:21:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:21:49 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:21:49 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:21:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:21:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:21:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:21:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:21:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:21:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:21:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:21:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:21:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:21:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:21:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:21:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:21:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:21:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:21:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:21:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:21:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:21:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:21:56 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:21:56 - job_xml_thread(): Done retrieving: data size 43890012
Fri 17 Jan 2014 13:21:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43890012
Fri 17 Jan 2014 13:21:56 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:21:56 - XML: Start document: iteration 6
Fri 17 Jan 2014 13:21:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:21:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43890012
Fri 17 Jan 2014 13:21:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:22:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:22:03 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:22:05 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:22:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:22:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 13:22:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 13:22:05 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:22:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9146 values 144334 bits 18041 bytes 
Fri 17 Jan 2014 13:22:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:22:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:22:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:22:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:22:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:22:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:22:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:22:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:22:11 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:22:12 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:22:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:22:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:22:12 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:22:17 - XML: Processed 655656 elements - found 728 jobs
Fri 17 Jan 2014 13:22:17 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:22:17 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:22:17 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:22:17 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:22:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:22:19 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:22:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:22:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:22:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:22:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:22:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:22:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:22:22 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:22:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43882703
Fri 17 Jan 2014 13:22:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:22:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43882703
Fri 17 Jan 2014 13:22:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:22:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:22:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:22:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:22:31 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:22:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:22:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:22:32 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:22:32 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:22:32 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:22:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:22:32 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:22:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:22:34 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:22:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 13:22:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:22:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:22:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:22:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:22:35 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:22:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:22:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:22:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:22:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:22:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:22:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:22:38 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:22:38 - job_xml_thread(): Done retrieving: data size 43889486
Fri 17 Jan 2014 13:22:38 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:22:38 - XML: Start document: iteration 7
Fri 17 Jan 2014 13:22:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43889486
Fri 17 Jan 2014 13:22:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:22:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43889486
Fri 17 Jan 2014 13:22:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:22:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:22:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:22:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:22:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:22:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:22:54 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:22:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:22:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:22:56 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:22:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:22:56 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:22:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:22:56 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:22:58 - XML: Processed 655660 elements - found 730 jobs
Fri 17 Jan 2014 13:22:58 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 13:22:58 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 13:22:59 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 13:22:59 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:22:59 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:23:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:23:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:23:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:23:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:23:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:23:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:23:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:23:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:23:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:23:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43890912
Fri 17 Jan 2014 13:23:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:23:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43890912
Fri 17 Jan 2014 13:23:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:23:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:23:06 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:23:10 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:23:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:23:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 13:23:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 13:23:10 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:23:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9305 values 146828 bits 18353 bytes 
Fri 17 Jan 2014 13:23:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:23:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:23:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:23:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:23:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:23:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:23:14 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:23:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:23:14 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:23:14 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:23:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:23:14 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:23:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:23:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:23:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:23:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:23:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:23:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:23:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:23:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:23:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:23:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:23:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:23:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43823494
Fri 17 Jan 2014 13:23:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:23:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43823494
Fri 17 Jan 2014 13:23:19 - job_xml_thread(): Done retrieving: data size 43823494
Fri 17 Jan 2014 13:23:19 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:23:19 - XML: Start document: iteration 8
Fri 17 Jan 2014 13:23:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:23:24 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:23:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 13:23:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:23:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:23:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:23:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:23:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:23:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:23:36 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:23:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:23:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:23:37 - XML: Processed 654912 elements - found 730 jobs
Fri 17 Jan 2014 13:23:37 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:23:37 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:23:37 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:23:37 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:23:37 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:23:37 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:23:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:23:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:23:37 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:23:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:23:40 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:23:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:23:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:23:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:23:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:23:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:23:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:23:42 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:23:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43303312
Fri 17 Jan 2014 13:23:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:23:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43303312
Fri 17 Jan 2014 13:23:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:23:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:23:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:23:52 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:23:52 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:23:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:23:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:23:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:23:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:23:53 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:23:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:23:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:23:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:23:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:23:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:23:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:23:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:23:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:23:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:23:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:23:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:23:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:23:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:23:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:23:58 - job_xml_thread(): Done retrieving: data size 43238440
Fri 17 Jan 2014 13:23:58 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:23:58 - XML: Start document: iteration 9
Fri 17 Jan 2014 13:23:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43238440
Fri 17 Jan 2014 13:23:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43238440
Fri 17 Jan 2014 13:23:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:23:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:24:03 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 13:24:03 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:24:03 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:24:04 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:24:04 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 13:24:04 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 13:24:04 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 13:24:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:24:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:24:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:24:10 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:24:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:24:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 13:24:11 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:24:11 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:24:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 13:24:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9411 values 148448 bits 18556 bytes 
Fri 17 Jan 2014 13:24:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:24:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:24:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:24:13 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:24:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:24:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:24:14 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:24:14 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:24:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:24:14 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:24:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:24:18 - size of cluster 'LISA Cluster': 624 hosts 79484 metrics 893655 values 14105256 bits 1763157 bytes 
Fri 17 Jan 2014 13:24:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:24:20 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:24:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:24:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:24:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:24:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:24:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:24:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:24:23 - XML: Processed 647496 elements - found 730 jobs
Fri 17 Jan 2014 13:24:23 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:24:23 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:24:23 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:24:23 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:24:28 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:24:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43271561
Fri 17 Jan 2014 13:24:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:24:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43271561
Fri 17 Jan 2014 13:24:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:24:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:24:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:24:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:24:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:24:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:24:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:24:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:24:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:24:38 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:24:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:24:39 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:24:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:24:39 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:24:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:24:41 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:24:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 13:24:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:24:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:24:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:24:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:24:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:24:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:24:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:24:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:24:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:24:46 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:24:46 - job_xml_thread(): Done retrieving: data size 43779489
Fri 17 Jan 2014 13:24:46 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:24:46 - XML: Start document: iteration 10
Fri 17 Jan 2014 13:24:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43779489
Fri 17 Jan 2014 13:24:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43779489
Fri 17 Jan 2014 13:24:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:24:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:24:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:24:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:24:59 - XML: Processed 654122 elements - found 731 jobs
Fri 17 Jan 2014 13:24:59 - job 7347753 appears to have finished
Fri 17 Jan 2014 13:24:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:24:59 - job 7348291 report time 1389961294 does not match current heartbeat 1389961415 : ignoring job
Fri 17 Jan 2014 13:24:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:24:59 - job 7348194 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:24:59 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 13:24:59 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 13:25:03 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 13:25:03 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:25:03 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:25:05 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:25:05 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 13:25:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:25:07 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:25:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:25:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:25:08 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:25:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:25:08 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:25:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:25:08 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:25:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:25:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:25:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:25:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:25:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:25:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:25:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:25:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:25:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:25:11 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:25:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:25:11 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:25:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 13:25:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 13:25:11 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:25:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5859 values 92427 bits 11553 bytes 
Fri 17 Jan 2014 13:25:14 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:25:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43894324
Fri 17 Jan 2014 13:25:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:25:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43894324
Fri 17 Jan 2014 13:25:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:25:18 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:25:18 - job_xml_thread(): Done retrieving: data size 43894324
Fri 17 Jan 2014 13:25:18 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:25:18 - XML: Start document: iteration 11
Fri 17 Jan 2014 13:25:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:25:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:25:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:25:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:25:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:25:27 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:25:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:25:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:25:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:25:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:25:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:25:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:25:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:25:31 - XML: Processed 655662 elements - found 731 jobs
Fri 17 Jan 2014 13:25:31 - job 7348291 report time 1389961294 does not match current heartbeat 1389961415 : ignoring job
Fri 17 Jan 2014 13:25:31 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:25:31 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:25:31 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:25:31 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:25:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:25:37 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:25:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:25:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:25:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:25:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:25:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:25:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:25:38 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:25:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 13:25:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:25:40 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:25:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867328
Fri 17 Jan 2014 13:25:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:25:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43867328
Fri 17 Jan 2014 13:25:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:25:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:25:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:25:46 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:25:46 - job_xml_thread(): Done retrieving: data size 43867328
Fri 17 Jan 2014 13:25:46 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:25:46 - XML: Start document: iteration 12
Fri 17 Jan 2014 13:25:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:25:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:25:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:25:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:25:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:25:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:25:53 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:25:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:25:53 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:25:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:25:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:26:02 - XML: Processed 655660 elements - found 731 jobs
Fri 17 Jan 2014 13:26:02 - job 7348291 report time 1389961294 does not match current heartbeat 1389961415 : ignoring job
Fri 17 Jan 2014 13:26:02 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:26:02 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:26:02 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:26:02 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:26:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:26:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:26:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:26:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:26:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:26:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:26:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:26:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:26:07 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:26:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43857523
Fri 17 Jan 2014 13:26:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:26:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43857523
Fri 17 Jan 2014 13:26:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:26:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:26:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:26:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:26:13 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:26:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:26:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 13:26:13 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:26:13 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:26:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 13:26:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7902 values 124632 bits 15579 bytes 
Fri 17 Jan 2014 13:26:17 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:26:17 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:26:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:26:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:26:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:26:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:26:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:26:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:26:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:26:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:26:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:26:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:26:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:26:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:26:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:26:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:26:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:26:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:26:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:26:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:26:26 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:26:26 - job_xml_thread(): Done retrieving: data size 43885472
Fri 17 Jan 2014 13:26:26 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:26:26 - XML: Start document: iteration 13
Fri 17 Jan 2014 13:26:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43885472
Fri 17 Jan 2014 13:26:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:26:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43885472
Fri 17 Jan 2014 13:26:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:26:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:26:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:26:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:26:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:26:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:26:41 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:26:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:26:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:26:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:26:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:26:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:26:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:26:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:26:43 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:26:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 13:26:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:26:48 - XML: Processed 655658 elements - found 729 jobs
Fri 17 Jan 2014 13:26:48 - job 7348155 appears to have finished
Fri 17 Jan 2014 13:26:48 - job 7348218 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:26:48 - job 7348219 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:26:48 - job 7348225 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:26:48 - job 7348224 report time 1389961415 does not match current heartbeat 1389961536 : ignoring job
Fri 17 Jan 2014 13:26:48 - job 7348223 report time 1389961415 does not match current heartbeat 1389961536 : ignoring job
Fri 17 Jan 2014 13:26:48 - job 7348197 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:26:48 - job 7348196 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:26:48 - job 7348195 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:26:48 - job_xml_thread(): Found 7 updated jobs.
Fri 17 Jan 2014 13:26:48 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 13:26:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:26:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:26:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:26:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:26:50 - job_xml_thread(): Done storing. succesfully stored: 7 jobs
Fri 17 Jan 2014 13:26:50 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:26:50 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:26:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:26:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:26:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:26:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:26:51 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 13:26:51 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 13:26:51 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:26:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:26:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43869962
Fri 17 Jan 2014 13:26:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:26:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43869962
Fri 17 Jan 2014 13:26:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:26:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:26:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:27:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:27:03 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:27:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:27:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:27:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:27:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:27:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:27:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:27:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:27:05 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:27:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:27:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:27:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:27:06 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:27:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:27:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:27:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:27:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:27:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:27:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:27:07 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:27:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43882771
Fri 17 Jan 2014 13:27:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:27:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43882771
Fri 17 Jan 2014 13:27:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:27:08 - job_xml_thread(): Done retrieving: data size 43882771
Fri 17 Jan 2014 13:27:08 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:27:08 - XML: Start document: iteration 14
Fri 17 Jan 2014 13:27:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:27:14 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:27:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:27:14 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:27:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 13:27:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 13:27:14 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:27:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7834 values 123588 bits 15448 bytes 
Fri 17 Jan 2014 13:27:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:27:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:27:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:27:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:27:26 - XML: Processed 655658 elements - found 729 jobs
Fri 17 Jan 2014 13:27:26 - job 7348224 report time 1389961415 does not match current heartbeat 1389961536 : ignoring job
Fri 17 Jan 2014 13:27:26 - job 7348223 report time 1389961415 does not match current heartbeat 1389961536 : ignoring job
Fri 17 Jan 2014 13:27:27 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:27:27 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:27:27 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:27:27 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:27:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:27:27 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:27:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:27:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:27:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:27:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:27:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:27:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:27:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:27:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:27:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:27:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:27:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:27:30 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:27:30 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:27:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:27:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:27:32 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:27:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 13:27:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:27:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:27:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43912950
Fri 17 Jan 2014 13:27:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:27:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43912950
Fri 17 Jan 2014 13:27:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:27:42 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:27:42 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:27:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:27:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:27:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:27:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:27:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:27:45 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:27:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:27:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:27:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:27:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:27:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:27:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:27:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:27:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:27:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:27:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:27:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:27:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:27:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:27:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:27:48 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:27:48 - job_xml_thread(): Done retrieving: data size 43904258
Fri 17 Jan 2014 13:27:48 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:27:48 - XML: Start document: iteration 15
Fri 17 Jan 2014 13:27:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43904258
Fri 17 Jan 2014 13:27:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43904258
Fri 17 Jan 2014 13:27:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:27:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:28:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:28:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:28:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:28:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:28:08 - XML: Processed 655658 elements - found 729 jobs
Fri 17 Jan 2014 13:28:08 - job 7348224 report time 1389961415 does not match current heartbeat 1389961536 : ignoring job
Fri 17 Jan 2014 13:28:08 - job 7348223 report time 1389961415 does not match current heartbeat 1389961536 : ignoring job
Fri 17 Jan 2014 13:28:08 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:28:08 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:28:08 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:28:08 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:28:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:28:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:28:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:28:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:28:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:28:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:28:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:28:09 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:28:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:28:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:28:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:28:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:28:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:28:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:28:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:28:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:28:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:28:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:28:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43902896
Fri 17 Jan 2014 13:28:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:28:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43902896
Fri 17 Jan 2014 13:28:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:28:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:28:14 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:28:15 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:28:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:28:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 13:28:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 13:28:16 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:28:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148616 bits 18577 bytes 
Fri 17 Jan 2014 13:28:23 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:28:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:28:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:28:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:28:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:28:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:28:25 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:28:25 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:28:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:28:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:28:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:28:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:28:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:28:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:28:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:28:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:28:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:28:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:28:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:28:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:28:31 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:28:31 - job_xml_thread(): Done retrieving: data size 43903778
Fri 17 Jan 2014 13:28:31 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:28:31 - XML: Start document: iteration 16
Fri 17 Jan 2014 13:28:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43903778
Fri 17 Jan 2014 13:28:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:28:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43903778
Fri 17 Jan 2014 13:28:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:28:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:28:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:28:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:28:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:28:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:28:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:28:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:28:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:28:45 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:28:45 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:28:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:28:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:28:45 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:28:51 - XML: Processed 655644 elements - found 722 jobs
Fri 17 Jan 2014 13:28:51 - job 7348241 report time 1389961536 does not match current heartbeat 1389961656 : ignoring job
Fri 17 Jan 2014 13:28:51 - job 7341554 appears to have finished
Fri 17 Jan 2014 13:28:51 - job 7348254 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:28:51 - job 7348256 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:28:51 - job 7348250 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:28:51 - job 7348252 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:28:51 - job 7347812 appears to have finished
Fri 17 Jan 2014 13:28:51 - job 7347810 appears to have finished
Fri 17 Jan 2014 13:28:51 - job 7347814 appears to have finished
Fri 17 Jan 2014 13:28:51 - job 7347807 appears to have finished
Fri 17 Jan 2014 13:28:51 - job 7348219 field 'start_timestamp' changed since saved from: 1389961566 to: 1389961502
Fri 17 Jan 2014 13:28:51 - job 7348242 report time 1389961536 does not match current heartbeat 1389961656 : ignoring job
Fri 17 Jan 2014 13:28:51 - job_xml_thread(): Found 10 updated jobs.
Fri 17 Jan 2014 13:28:51 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 13:28:52 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:28:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 13:28:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:28:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:28:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:28:54 - job_xml_thread(): Done storing. succesfully stored: 10 jobs
Fri 17 Jan 2014 13:28:54 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:28:54 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:28:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:28:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:28:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:28:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:28:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:28:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:28:56 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:28:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43872025
Fri 17 Jan 2014 13:28:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:28:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43872025
Fri 17 Jan 2014 13:28:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:29:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:29:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:29:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:29:06 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:29:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:29:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:29:07 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:29:07 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:29:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:29:07 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:29:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:29:09 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:29:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:29:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:29:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:29:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:29:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:29:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:29:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:29:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:29:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:29:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:29:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:29:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43824844
Fri 17 Jan 2014 13:29:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:29:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43824844
Fri 17 Jan 2014 13:29:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:29:14 - job_xml_thread(): Done retrieving: data size 43824844
Fri 17 Jan 2014 13:29:14 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:29:15 - XML: Start document: iteration 17
Fri 17 Jan 2014 13:29:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:29:16 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:29:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:29:17 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:29:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 13:29:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 13:29:17 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:29:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8821 values 139066 bits 17383 bytes 
Fri 17 Jan 2014 13:29:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:29:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:29:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:29:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:29:31 - XML: Processed 654896 elements - found 722 jobs
Fri 17 Jan 2014 13:29:32 - job 7348242 report time 1389961536 does not match current heartbeat 1389961656 : ignoring job
Fri 17 Jan 2014 13:29:32 - job 7348241 report time 1389961536 does not match current heartbeat 1389961656 : ignoring job
Fri 17 Jan 2014 13:29:32 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:29:32 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:29:32 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:29:32 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:29:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:29:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:29:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:29:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:29:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:29:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:29:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:29:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:29:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:29:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:29:38 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:29:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:29:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:29:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:29:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:29:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:29:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:29:40 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:29:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43324338
Fri 17 Jan 2014 13:29:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:29:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43324338
Fri 17 Jan 2014 13:29:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:29:47 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:29:47 - job_xml_thread(): Done retrieving: data size 43324338
Fri 17 Jan 2014 13:29:47 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:29:47 - XML: Start document: iteration 18
Fri 17 Jan 2014 13:29:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:29:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:29:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:29:49 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:29:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:29:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:29:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:29:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:29:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43324338
Fri 17 Jan 2014 13:29:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:29:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:29:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:29:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:29:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:30:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:30:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:30:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:30:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:30:06 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:30:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:30:06 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:30:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:30:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:30:08 - XML: Processed 648818 elements - found 722 jobs
Fri 17 Jan 2014 13:30:08 - job 7348242 report time 1389961536 does not match current heartbeat 1389961656 : ignoring job
Fri 17 Jan 2014 13:30:08 - job 7348241 report time 1389961536 does not match current heartbeat 1389961656 : ignoring job
Fri 17 Jan 2014 13:30:08 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:30:08 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:30:08 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:30:08 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:30:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:30:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:30:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:30:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:30:10 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:30:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 13:30:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:30:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:30:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:30:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:30:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:30:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:30:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43238795
Fri 17 Jan 2014 13:30:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:30:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43238795
Fri 17 Jan 2014 13:30:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:30:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:30:17 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:30:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:30:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 13:30:17 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:30:17 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:30:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 13:30:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5800 values 91475 bits 11434 bytes 
Fri 17 Jan 2014 13:30:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:30:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:30:23 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:30:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:30:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:30:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:30:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:30:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:30:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:30:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:30:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:30:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:30:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:30:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:30:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:30:26 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:30:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:30:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:30:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:30:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:30:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:30:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:30:28 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:30:28 - job_xml_thread(): Done retrieving: data size 43303146
Fri 17 Jan 2014 13:30:28 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:30:28 - XML: Start document: iteration 19
Fri 17 Jan 2014 13:30:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43303146
Fri 17 Jan 2014 13:30:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:30:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43303146
Fri 17 Jan 2014 13:30:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:30:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:30:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:30:42 - XML: Processed 648196 elements - found 724 jobs
Fri 17 Jan 2014 13:30:43 - job 7347813 appears to have finished
Fri 17 Jan 2014 13:30:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:30:43 - job 7347811 appears to have finished
Fri 17 Jan 2014 13:30:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:30:43 - job 7347808 appears to have finished
Fri 17 Jan 2014 13:30:43 - job 7348226 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:30:43 - job 7348225 appears to have finished
Fri 17 Jan 2014 13:30:43 - job 7348227 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:30:43 - job_xml_thread(): Found 14 updated jobs.
Fri 17 Jan 2014 13:30:43 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 13:30:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:30:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:30:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:30:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:30:48 - job_xml_thread(): Done storing. succesfully stored: 14 jobs
Fri 17 Jan 2014 13:30:48 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:30:48 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:30:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:30:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:30:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:30:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:30:48 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:30:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:30:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:30:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:30:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:30:51 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:30:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 13:30:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:30:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:30:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:30:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:30:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:30:53 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:30:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870930
Fri 17 Jan 2014 13:30:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:30:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870930
Fri 17 Jan 2014 13:30:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:31:03 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:31:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:31:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:31:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:31:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:31:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:31:05 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 13:31:05 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:31:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:31:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:31:06 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:31:06 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:31:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:31:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:31:07 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:31:07 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:31:07 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 13:31:07 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 13:31:07 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 13:31:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:31:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Fri 17 Jan 2014 13:31:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:31:08 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:31:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:31:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:31:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:31:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:31:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:31:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:31:10 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:31:10 - job_xml_thread(): Done retrieving: data size 43877095
Fri 17 Jan 2014 13:31:10 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:31:10 - XML: Start document: iteration 20
Fri 17 Jan 2014 13:31:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43877095
Fri 17 Jan 2014 13:31:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43877095
Fri 17 Jan 2014 13:31:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:31:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:31:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:31:18 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:31:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:31:20 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:31:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 13:31:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 13:31:20 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:31:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9030 values 142509 bits 17813 bytes 
Fri 17 Jan 2014 13:31:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:31:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:31:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:31:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:31:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:31:25 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:31:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:31:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:31:25 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:31:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:31:25 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:31:25 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:31:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:31:30 - XML: Processed 655648 elements - found 724 jobs
Fri 17 Jan 2014 13:31:30 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:31:30 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:31:30 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:31:30 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:31:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:31:34 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:31:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:31:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:31:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:31:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:31:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:31:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:31:36 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:31:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 13:31:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:31:37 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:31:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43861096
Fri 17 Jan 2014 13:31:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:31:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43861096
Fri 17 Jan 2014 13:31:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:31:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:31:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:31:45 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:31:45 - job_xml_thread(): Done retrieving: data size 43861096
Fri 17 Jan 2014 13:31:45 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:31:45 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 13:31:46 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 13:31:46 - Housekeeping: done.
Fri 17 Jan 2014 13:31:46 - XML: Start document: iteration 0
Fri 17 Jan 2014 13:31:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:31:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:31:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:31:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:31:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:31:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:31:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:31:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:31:50 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:31:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:31:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:31:56 - XML: Processed 655648 elements - found 724 jobs
Fri 17 Jan 2014 13:31:56 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:31:56 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:31:56 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:31:56 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:31:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:31:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:31:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:31:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:31:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:31:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:31:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:31:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:32:00 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:32:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43888876
Fri 17 Jan 2014 13:32:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:32:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43888876
Fri 17 Jan 2014 13:32:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:32:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:32:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:32:07 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:32:07 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:32:08 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:32:09 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 13:32:09 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:32:09 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 13:32:09 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 13:32:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:32:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:32:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:32:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Fri 17 Jan 2014 13:32:11 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:32:11 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:32:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:32:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:32:11 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:32:11 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:32:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:32:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:32:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:32:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:32:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:32:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:32:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:32:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:32:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:32:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:32:16 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:32:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43912096
Fri 17 Jan 2014 13:32:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:32:16 - job_xml_thread(): Done retrieving: data size 43912096
Fri 17 Jan 2014 13:32:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43912096
Fri 17 Jan 2014 13:32:17 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:32:17 - XML: Start document: iteration 1
Fri 17 Jan 2014 13:32:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:32:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:32:21 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:32:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:32:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 13:32:22 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:32:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 149061 bits 18632 bytes 
Fri 17 Jan 2014 13:32:22 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:32:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 13:32:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:32:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:32:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:32:29 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:32:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:32:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:32:29 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:32:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:32:29 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:32:29 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:32:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:32:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:32:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:32:39 - XML: Processed 655636 elements - found 718 jobs
Fri 17 Jan 2014 13:32:39 - job 7348105 appears to have finished
Fri 17 Jan 2014 13:32:39 - job 7348301 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:32:39 - job 7348135 appears to have finished
Fri 17 Jan 2014 13:32:39 - job 7348141 appears to have finished
Fri 17 Jan 2014 13:32:39 - job 7348230 report time 1389961777 does not match current heartbeat 1389961897 : ignoring job
Fri 17 Jan 2014 13:32:39 - job 7347854 appears to have finished
Fri 17 Jan 2014 13:32:39 - job 7348231 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:32:39 - job 7348160 appears to have finished
Fri 17 Jan 2014 13:32:39 - job 7348161 appears to have finished
Fri 17 Jan 2014 13:32:39 - job 7348290 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:32:39 - job 7348229 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:32:39 - job 7348228 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:32:39 - job_xml_thread(): Found 11 updated jobs.
Fri 17 Jan 2014 13:32:39 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 13:32:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:32:40 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:32:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:32:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:32:40 - job_xml_thread(): Done storing. succesfully stored: 11 jobs
Fri 17 Jan 2014 13:32:40 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:32:40 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:32:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:32:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:32:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:32:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:32:42 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:32:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862391
Fri 17 Jan 2014 13:32:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:32:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862391
Fri 17 Jan 2014 13:32:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:32:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:32:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:32:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:32:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:32:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:32:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:32:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:32:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:32:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:32:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:32:53 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:32:55 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:32:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:32:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:32:56 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:32:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 13:32:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:32:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:32:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:32:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:32:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:32:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:32:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:32:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:32:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:32:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:32:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43899289
Fri 17 Jan 2014 13:32:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:33:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43899289
Fri 17 Jan 2014 13:33:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:33:00 - job_xml_thread(): Done retrieving: data size 43899289
Fri 17 Jan 2014 13:33:00 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:33:00 - XML: Start document: iteration 2
Fri 17 Jan 2014 13:33:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:33:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:33:09 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:33:09 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:33:11 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:33:11 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 13:33:11 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 13:33:11 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:33:11 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 13:33:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:33:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:33:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:33:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:33:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:33:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:33:14 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:33:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:33:14 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:33:14 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:33:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:33:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:33:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:33:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:33:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:33:23 - size of cluster 'LISA Cluster': 624 hosts 79485 metrics 1003413 values 15847382 bits 1980922 bytes 
Fri 17 Jan 2014 13:33:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:33:23 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:33:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:33:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:33:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:33:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:33:24 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:33:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 13:33:24 - XML: Processed 655636 elements - found 718 jobs
Fri 17 Jan 2014 13:33:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:33:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 13:33:24 - job 7348230 report time 1389961777 does not match current heartbeat 1389961897 : ignoring job
Fri 17 Jan 2014 13:33:24 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:33:24 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:33:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5887 values 93094 bits 11636 bytes 
Fri 17 Jan 2014 13:33:24 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:33:24 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:33:24 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:33:28 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:33:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862208
Fri 17 Jan 2014 13:33:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:33:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862208
Fri 17 Jan 2014 13:33:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:33:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:33:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:33:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:33:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:33:39 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:33:39 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:33:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:33:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:33:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:33:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:33:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:33:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:33:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:33:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:33:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:33:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:33:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:33:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:33:44 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:33:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 13:33:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:33:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:33:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:33:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:33:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:33:47 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:33:47 - job_xml_thread(): Done retrieving: data size 43893774
Fri 17 Jan 2014 13:33:47 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:33:47 - XML: Start document: iteration 3
Fri 17 Jan 2014 13:33:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43893774
Fri 17 Jan 2014 13:33:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:33:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43893774
Fri 17 Jan 2014 13:33:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:33:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:33:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:33:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:33:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:34:03 - XML: Processed 655636 elements - found 718 jobs
Fri 17 Jan 2014 13:34:03 - job 7348230 report time 1389961777 does not match current heartbeat 1389961897 : ignoring job
Fri 17 Jan 2014 13:34:03 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:34:03 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:34:03 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:34:03 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:34:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:34:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:34:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:34:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:34:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:34:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:34:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:34:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:34:09 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:34:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:34:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:34:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:34:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:34:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:34:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:34:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:34:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:34:11 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:34:11 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 13:34:12 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 13:34:12 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 13:34:12 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:34:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:34:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43890045
Fri 17 Jan 2014 13:34:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:34:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43890045
Fri 17 Jan 2014 13:34:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:34:18 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:34:18 - job_xml_thread(): Done retrieving: data size 43890045
Fri 17 Jan 2014 13:34:18 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:34:18 - XML: Start document: iteration 4
Fri 17 Jan 2014 13:34:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:34:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:34:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:34:24 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:34:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:34:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 13:34:26 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:34:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:34:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:34:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 13:34:27 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:34:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8830 values 139299 bits 17412 bytes 
Fri 17 Jan 2014 13:34:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:34:28 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:34:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:34:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:34:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:34:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:34:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:34:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:34:31 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:34:32 - XML: Processed 655632 elements - found 716 jobs
Fri 17 Jan 2014 13:34:32 - job 7347789 appears to have finished
Fri 17 Jan 2014 13:34:32 - job 7348301 field 'start_timestamp' changed since saved from: 1389961910 to: 1389961858
Fri 17 Jan 2014 13:34:32 - job 7348143 appears to have finished
Fri 17 Jan 2014 13:34:32 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 13:34:32 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 13:34:34 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 13:34:34 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:34:34 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:34:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:34:37 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:34:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:34:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:34:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:34:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:34:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:34:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:34:39 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:34:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43887668
Fri 17 Jan 2014 13:34:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:34:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43887668
Fri 17 Jan 2014 13:34:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:34:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:34:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:34:49 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:34:49 - job_xml_thread(): Done retrieving: data size 43887668
Fri 17 Jan 2014 13:34:49 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:34:49 - XML: Start document: iteration 5
Fri 17 Jan 2014 13:34:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:34:49 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:34:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:34:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:34:51 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:34:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:34:51 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:34:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:34:51 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:34:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:34:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:34:58 - XML: Processed 655632 elements - found 716 jobs
Fri 17 Jan 2014 13:34:58 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:34:58 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:34:58 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:34:58 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:35:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:35:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:35:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:35:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:35:02 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:35:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 13:35:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:35:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:35:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:35:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:35:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:35:04 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:35:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43880341
Fri 17 Jan 2014 13:35:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:35:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43880341
Fri 17 Jan 2014 13:35:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:35:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:35:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:35:13 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:35:13 - job_xml_thread(): Done retrieving: data size 43880341
Fri 17 Jan 2014 13:35:13 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:35:13 - XML: Start document: iteration 6
Fri 17 Jan 2014 13:35:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:35:16 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:35:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:35:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:35:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:35:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:35:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:35:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:35:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:35:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:35:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:35:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:35:21 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:35:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:35:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:35:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:35:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:35:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:35:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:35:25 - XML: Processed 655632 elements - found 716 jobs
Fri 17 Jan 2014 13:35:25 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:35:25 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:35:25 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:35:25 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:35:27 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:35:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43800291
Fri 17 Jan 2014 13:35:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:35:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43800291
Fri 17 Jan 2014 13:35:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:35:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:35:27 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:35:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:35:28 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:35:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 13:35:28 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:35:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 13:35:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8090 values 127613 bits 15951 bytes 
Fri 17 Jan 2014 13:35:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:35:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:35:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:35:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:35:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:35:38 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:35:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:35:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:35:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:35:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:35:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:35:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:35:40 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:35:40 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:35:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:35:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:35:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:35:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:35:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:35:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:35:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:35:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:35:44 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:35:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43273446
Fri 17 Jan 2014 13:35:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:35:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43273446
Fri 17 Jan 2014 13:35:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:35:45 - job_xml_thread(): Done retrieving: data size 43273446
Fri 17 Jan 2014 13:35:45 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:35:45 - XML: Start document: iteration 7
Fri 17 Jan 2014 13:35:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:35:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:35:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:35:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:35:59 - XML: Processed 647998 elements - found 716 jobs
Fri 17 Jan 2014 13:35:59 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:35:59 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:35:59 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:35:59 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:36:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:36:03 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:36:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:36:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:36:04 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:36:04 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:36:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:36:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:36:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:36:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:36:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:36:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:36:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:36:07 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:36:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 13:36:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:36:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:36:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:36:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:36:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:36:09 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:36:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43254598
Fri 17 Jan 2014 13:36:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:36:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43254598
Fri 17 Jan 2014 13:36:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:36:15 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:36:15 - job_xml_thread(): Done retrieving: data size 43254598
Fri 17 Jan 2014 13:36:15 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:36:15 - XML: Start document: iteration 8
Fri 17 Jan 2014 13:36:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:36:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:36:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:36:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:36:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:36:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:36:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:36:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:36:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:36:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:36:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:36:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:36:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:36:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:36:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:36:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:36:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:36:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:36:28 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:36:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:36:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 13:36:28 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:36:28 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:36:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:36:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 13:36:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:36:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:36:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:36:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5736 values 90461 bits 11307 bytes 
Fri 17 Jan 2014 13:36:30 - XML: Processed 647688 elements - found 715 jobs
Fri 17 Jan 2014 13:36:30 - job 7348169 appears to have finished
Fri 17 Jan 2014 13:36:30 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 13:36:30 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 13:36:30 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 13:36:30 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:36:30 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:36:33 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:36:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43279676
Fri 17 Jan 2014 13:36:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:36:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43279676
Fri 17 Jan 2014 13:36:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:36:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:36:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:36:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:36:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:36:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:36:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:36:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:36:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:36:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:36:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:36:43 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:36:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:36:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:36:45 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:36:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:36:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:36:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:36:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:36:48 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:36:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 13:36:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:36:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:36:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:36:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:36:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:36:50 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:36:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43834069
Fri 17 Jan 2014 13:36:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:36:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43834069
Fri 17 Jan 2014 13:36:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:36:51 - job_xml_thread(): Done retrieving: data size 43834069
Fri 17 Jan 2014 13:36:51 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:36:51 - XML: Start document: iteration 9
Fri 17 Jan 2014 13:36:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:36:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:37:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:37:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:37:05 - XML: Processed 654720 elements - found 720 jobs
Fri 17 Jan 2014 13:37:05 - job 7348233 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:37:05 - job 7348257 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:37:05 - job 7348302 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:37:05 - job 7348232 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:37:05 - job 7348236 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:37:05 - job 7348237 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:37:05 - job 7348234 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:37:05 - job 7348235 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:37:05 - job_xml_thread(): Found 13 updated jobs.
Fri 17 Jan 2014 13:37:05 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 13:37:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:37:06 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:37:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:37:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:37:07 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:37:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:37:07 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:37:07 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:37:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:37:10 - job_xml_thread(): Done storing. succesfully stored: 13 jobs
Fri 17 Jan 2014 13:37:10 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:37:10 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:37:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:37:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:37:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:37:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:37:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:37:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:37:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:37:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:37:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:37:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875938
Fri 17 Jan 2014 13:37:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:37:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875938
Fri 17 Jan 2014 13:37:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:37:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:37:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:37:25 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:37:25 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:37:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:37:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:37:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:37:27 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:37:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:37:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:37:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:37:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:37:27 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:37:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:37:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:37:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:37:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:37:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:37:29 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:37:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:37:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:37:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:37:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:37:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:37:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:37:29 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:37:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 13:37:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 13:37:29 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:37:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8863 values 139846 bits 17480 bytes 
Fri 17 Jan 2014 13:37:31 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:37:31 - job_xml_thread(): Done retrieving: data size 43888280
Fri 17 Jan 2014 13:37:31 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:37:31 - XML: Start document: iteration 10
Fri 17 Jan 2014 13:37:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43888280
Fri 17 Jan 2014 13:37:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:37:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43888280
Fri 17 Jan 2014 13:37:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:37:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:37:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:37:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:37:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:37:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:37:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:37:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:37:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:37:45 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:37:45 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:37:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:37:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:37:45 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:37:52 - XML: Processed 655640 elements - found 720 jobs
Fri 17 Jan 2014 13:37:52 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:37:52 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:37:52 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:37:52 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:37:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:37:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:37:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:37:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:37:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:37:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:37:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:37:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:37:55 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:37:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 13:37:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:37:56 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:37:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870110
Fri 17 Jan 2014 13:37:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:37:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870110
Fri 17 Jan 2014 13:37:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:38:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:38:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:38:07 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:38:08 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:38:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:38:09 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:38:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:38:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:38:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:38:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:38:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:38:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:38:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:38:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:38:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:38:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:38:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:38:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:38:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:38:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:38:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:38:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:38:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:38:13 - job_xml_thread(): Done retrieving: data size 43877097
Fri 17 Jan 2014 13:38:13 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:38:13 - XML: Start document: iteration 11
Fri 17 Jan 2014 13:38:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43877097
Fri 17 Jan 2014 13:38:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:38:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43877097
Fri 17 Jan 2014 13:38:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:38:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:38:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:38:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:38:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:38:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:38:29 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:38:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:38:29 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:38:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:38:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:38:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:38:30 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:38:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 13:38:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 13:38:30 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:38:30 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:38:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:38:30 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:38:30 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:38:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:38:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8077 values 127395 bits 15924 bytes 
Fri 17 Jan 2014 13:38:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:38:36 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:38:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:38:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:38:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:38:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:38:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:38:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:38:37 - XML: Processed 655624 elements - found 712 jobs
Fri 17 Jan 2014 13:38:37 - job 7348181 appears to have finished
Fri 17 Jan 2014 13:38:37 - job 7348186 appears to have finished
Fri 17 Jan 2014 13:38:37 - job 7348238 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:38:37 - job 7348239 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:38:37 - job 7347806 appears to have finished
Fri 17 Jan 2014 13:38:37 - job 7348307 report time 1389962139 does not match current heartbeat 1389962259 : ignoring job
Fri 17 Jan 2014 13:38:37 - job 7348236 field 'start_timestamp' changed since saved from: 1389962140 to: 1389962105
Fri 17 Jan 2014 13:38:37 - job 7348179 appears to have finished
Fri 17 Jan 2014 13:38:37 - job 7348172 appears to have finished
Fri 17 Jan 2014 13:38:37 - job 7348177 appears to have finished
Fri 17 Jan 2014 13:38:37 - job 7348176 appears to have finished
Fri 17 Jan 2014 13:38:37 - job 7348190 appears to have finished
Fri 17 Jan 2014 13:38:37 - job 7348191 appears to have finished
Fri 17 Jan 2014 13:38:37 - job_xml_thread(): Found 13 updated jobs.
Fri 17 Jan 2014 13:38:37 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 13:38:37 - job_xml_thread(): Done storing. succesfully stored: 13 jobs
Fri 17 Jan 2014 13:38:37 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:38:37 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:38:39 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:38:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 13:38:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:38:39 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:38:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43896917
Fri 17 Jan 2014 13:38:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:38:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43896917
Fri 17 Jan 2014 13:38:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:38:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:38:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:38:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:38:49 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:38:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:38:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:38:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:38:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:38:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:38:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:38:50 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:38:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:38:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:38:52 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:38:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:38:52 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:38:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:38:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:38:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:38:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:38:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:38:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:38:54 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:38:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43906098
Fri 17 Jan 2014 13:38:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:38:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43906098
Fri 17 Jan 2014 13:38:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:38:56 - job_xml_thread(): Done retrieving: data size 43906098
Fri 17 Jan 2014 13:38:56 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:38:56 - XML: Start document: iteration 12
Fri 17 Jan 2014 13:39:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:39:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:39:08 - XML: Processed 655624 elements - found 712 jobs
Fri 17 Jan 2014 13:39:08 - job 7348307 report time 1389962139 does not match current heartbeat 1389962259 : ignoring job
Fri 17 Jan 2014 13:39:08 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:39:08 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:39:08 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:39:08 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:39:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:39:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:39:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:39:13 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:39:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:39:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:39:14 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:39:14 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:39:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:39:14 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:39:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:39:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:39:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:39:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:39:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:39:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:39:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:39:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:39:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:39:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:39:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43899710
Fri 17 Jan 2014 13:39:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:39:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43899710
Fri 17 Jan 2014 13:39:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:39:23 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:39:23 - job_xml_thread(): Done retrieving: data size 43899710
Fri 17 Jan 2014 13:39:23 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:39:24 - XML: Start document: iteration 13
Fri 17 Jan 2014 13:39:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:39:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:39:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:39:30 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:39:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:39:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 13:39:31 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:39:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 13:39:31 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:39:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:39:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:39:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148671 bits 18583 bytes 
Fri 17 Jan 2014 13:39:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:39:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:39:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:39:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:39:37 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:39:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:39:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:39:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:39:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:39:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:39:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:39:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:39:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:39:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:39:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:39:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:39:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:39:41 - XML: Processed 655624 elements - found 712 jobs
Fri 17 Jan 2014 13:39:41 - job 7348307 report time 1389962139 does not match current heartbeat 1389962259 : ignoring job
Fri 17 Jan 2014 13:39:41 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:39:41 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:39:41 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:39:41 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:39:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:39:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43871951
Fri 17 Jan 2014 13:39:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:39:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43871951
Fri 17 Jan 2014 13:39:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:39:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:39:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:39:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:39:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:39:56 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:39:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:39:56 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:39:56 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:39:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:39:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:39:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:39:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:39:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:39:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:40:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:40:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:40:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:40:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:40:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:40:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:40:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:40:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:40:01 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:40:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 13:40:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:40:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:40:02 - job_xml_thread(): Done retrieving: data size 43889604
Fri 17 Jan 2014 13:40:02 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:40:02 - XML: Start document: iteration 14
Fri 17 Jan 2014 13:40:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43889604
Fri 17 Jan 2014 13:40:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:40:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43889604
Fri 17 Jan 2014 13:40:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:40:12 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 13:40:12 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:40:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:40:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:40:13 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:40:13 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 13:40:13 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:40:13 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 13:40:13 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 13:40:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:40:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:40:16 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:40:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:40:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:40:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:40:17 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:40:17 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:40:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:40:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:40:17 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:40:20 - size of cluster 'LISA Cluster': 624 hosts 79477 metrics 972738 values 15354487 bits 1919310 bytes 
Fri 17 Jan 2014 13:40:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:40:26 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:40:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:40:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:40:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:40:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:40:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:40:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:40:27 - XML: Processed 655624 elements - found 712 jobs
Fri 17 Jan 2014 13:40:27 - job 7348307 report time 1389962139 does not match current heartbeat 1389962259 : ignoring job
Fri 17 Jan 2014 13:40:27 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:40:27 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:40:27 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:40:27 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:40:30 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:40:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853865
Fri 17 Jan 2014 13:40:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:40:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853865
Fri 17 Jan 2014 13:40:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:40:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:40:31 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:40:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:40:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:40:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:40:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 13:40:32 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:40:32 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:40:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 13:40:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5888 values 92895 bits 11611 bytes 
Fri 17 Jan 2014 13:40:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:40:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:40:43 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:40:43 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:40:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:40:45 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:40:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:40:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:40:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:40:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:40:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:40:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:40:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:40:46 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:40:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:40:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:40:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:40:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:40:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:40:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:40:50 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:40:50 - job_xml_thread(): Done retrieving: data size 43900369
Fri 17 Jan 2014 13:40:50 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:40:50 - XML: Start document: iteration 15
Fri 17 Jan 2014 13:40:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43900369
Fri 17 Jan 2014 13:40:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:40:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43900369
Fri 17 Jan 2014 13:40:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:41:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:41:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:41:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:41:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:41:08 - XML: Processed 655642 elements - found 721 jobs
Fri 17 Jan 2014 13:41:08 - job 7348189 appears to have finished
Fri 17 Jan 2014 13:41:08 - job 7348239 field 'start_timestamp' changed since saved from: 1389962281 to: 1389962250
Fri 17 Jan 2014 13:41:08 - job 7348193 appears to have finished
Fri 17 Jan 2014 13:41:08 - job_xml_thread(): Found 15 updated jobs.
Fri 17 Jan 2014 13:41:08 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 13:41:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:41:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:41:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:41:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:41:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:41:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:41:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:41:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:41:09 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:41:09 - job_xml_thread(): Done storing. succesfully stored: 15 jobs
Fri 17 Jan 2014 13:41:09 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:41:09 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:41:11 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:41:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 13:41:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:41:13 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:41:13 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 13:41:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:41:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:41:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:41:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:41:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:41:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:41:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:41:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:41:16 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:41:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43806758
Fri 17 Jan 2014 13:41:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:41:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43806758
Fri 17 Jan 2014 13:41:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:41:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:41:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:41:24 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:41:24 - job_xml_thread(): Done retrieving: data size 43806758
Fri 17 Jan 2014 13:41:24 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:41:24 - XML: Start document: iteration 16
Fri 17 Jan 2014 13:41:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:41:27 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:41:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:41:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:41:29 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:41:29 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:41:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:41:29 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:41:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:41:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:41:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:41:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:41:33 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:41:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:41:34 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:41:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 13:41:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 13:41:34 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:41:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5798 values 91438 bits 11429 bytes 
Fri 17 Jan 2014 13:41:38 - XML: Processed 654894 elements - found 721 jobs
Fri 17 Jan 2014 13:41:38 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:41:38 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:41:38 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:41:38 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:41:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:41:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:41:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:41:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:41:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:41:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:41:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:41:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:41:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:41:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43387200
Fri 17 Jan 2014 13:41:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:41:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43387200
Fri 17 Jan 2014 13:41:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:41:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:41:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:41:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:41:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:41:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:41:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:41:51 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:41:51 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:41:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:41:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:41:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43387200
Fri 17 Jan 2014 13:41:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:41:53 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:41:53 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:41:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:41:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:42:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:42:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:42:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:42:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:42:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:42:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:42:06 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:42:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 13:42:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:42:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:42:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:42:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:42:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:42:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:42:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:42:07 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:42:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:42:07 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:42:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:42:09 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:42:09 - job_xml_thread(): Done retrieving: data size 43212342
Fri 17 Jan 2014 13:42:09 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:42:09 - XML: Start document: iteration 17
Fri 17 Jan 2014 13:42:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43212342
Fri 17 Jan 2014 13:42:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:42:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43212342
Fri 17 Jan 2014 13:42:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:42:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:42:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:42:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:42:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:42:26 - XML: Processed 647441 elements - found 721 jobs
Fri 17 Jan 2014 13:42:27 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:42:27 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:42:27 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:42:27 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:42:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:42:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:42:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:42:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:42:32 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:42:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:42:32 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:42:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:42:32 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:42:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:42:32 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:42:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:42:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:42:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:42:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:42:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:42:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:42:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:42:34 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:42:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:42:35 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:42:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 13:42:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 13:42:35 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:42:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5735 values 90443 bits 11305 bytes 
Fri 17 Jan 2014 13:42:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:42:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565360
Fri 17 Jan 2014 13:42:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:42:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565360
Fri 17 Jan 2014 13:42:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:42:43 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:42:43 - job_xml_thread(): Done retrieving: data size 43565360
Fri 17 Jan 2014 13:42:43 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:42:43 - XML: Start document: iteration 18
Fri 17 Jan 2014 13:42:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:42:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:42:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:42:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:42:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:42:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:42:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:42:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:42:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:42:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:42:52 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:42:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:42:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:42:57 - XML: Processed 651376 elements - found 721 jobs
Fri 17 Jan 2014 13:42:57 - job 7348321 report time 1389962380 does not match current heartbeat 1389962500 : ignoring job
Fri 17 Jan 2014 13:42:57 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:42:57 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:42:57 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:42:58 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:43:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:43:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:43:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:43:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:43:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:43:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:43:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:43:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:43:03 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:43:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 13:43:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:43:03 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:43:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43866475
Fri 17 Jan 2014 13:43:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:43:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43866475
Fri 17 Jan 2014 13:43:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:43:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:43:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:43:13 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:43:13 - job_xml_thread(): Done retrieving: data size 43866475
Fri 17 Jan 2014 13:43:13 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:43:13 - XML: Start document: iteration 19
Fri 17 Jan 2014 13:43:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:43:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:43:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:43:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:43:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:43:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:43:16 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:43:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:43:17 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:43:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:43:17 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:43:24 - XML: Processed 655642 elements - found 721 jobs
Fri 17 Jan 2014 13:43:24 - job 7348321 report time 1389962380 does not match current heartbeat 1389962500 : ignoring job
Fri 17 Jan 2014 13:43:24 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:43:24 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:43:24 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:43:24 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:43:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:43:27 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:43:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:43:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:43:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:43:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:43:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:43:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:43:31 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:43:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853332
Fri 17 Jan 2014 13:43:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:43:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:43:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:43:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853332
Fri 17 Jan 2014 13:43:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:43:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:43:35 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:43:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:43:36 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:43:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 13:43:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 13:43:36 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:43:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6987 values 110184 bits 13773 bytes 
Fri 17 Jan 2014 13:43:40 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:43:40 - job_xml_thread(): Done retrieving: data size 43853332
Fri 17 Jan 2014 13:43:40 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:43:40 - XML: Start document: iteration 20
Fri 17 Jan 2014 13:43:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:43:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:43:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:43:49 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:43:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:43:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:43:50 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:43:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:43:50 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:43:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:43:50 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:43:53 - XML: Processed 655642 elements - found 721 jobs
Fri 17 Jan 2014 13:43:53 - job 7348321 report time 1389962380 does not match current heartbeat 1389962500 : ignoring job
Fri 17 Jan 2014 13:43:53 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:43:53 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:43:53 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:43:53 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:43:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:43:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:43:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:43:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:43:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:43:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:43:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:43:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:43:57 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 13:43:57 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 13:43:57 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:43:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:43:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43868918
Fri 17 Jan 2014 13:43:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:43:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43868918
Fri 17 Jan 2014 13:43:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:44:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:44:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:44:08 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:44:08 - job_xml_thread(): Done retrieving: data size 43868918
Fri 17 Jan 2014 13:44:08 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:44:08 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 13:44:08 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:44:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 13:44:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:44:09 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 13:44:09 - Housekeeping: done.
Fri 17 Jan 2014 13:44:09 - XML: Start document: iteration 0
Fri 17 Jan 2014 13:44:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:44:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:44:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:44:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:44:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:44:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:44:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:44:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:44:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:44:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:44:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:44:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:44:20 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:44:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:44:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:44:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:44:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:44:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:44:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:44:22 - XML: Processed 655642 elements - found 721 jobs
Fri 17 Jan 2014 13:44:22 - job 7348321 report time 1389962380 does not match current heartbeat 1389962500 : ignoring job
Fri 17 Jan 2014 13:44:22 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:44:22 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:44:22 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:44:22 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:44:24 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:44:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43892535
Fri 17 Jan 2014 13:44:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:44:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43892535
Fri 17 Jan 2014 13:44:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:44:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:44:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:44:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:44:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:44:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:44:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:44:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:44:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:44:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:44:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:44:34 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:44:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:44:36 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:44:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:44:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:44:37 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:44:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:44:37 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:44:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 13:44:37 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:44:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6221 values 98100 bits 12262 bytes 
Fri 17 Jan 2014 13:44:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 13:44:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:44:37 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:44:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:44:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:44:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:44:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:44:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:44:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:44:39 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:44:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43919646
Fri 17 Jan 2014 13:44:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:44:40 - job_xml_thread(): Done retrieving: data size 43919646
Fri 17 Jan 2014 13:44:40 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:44:40 - XML: Start document: iteration 1
Fri 17 Jan 2014 13:44:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43919646
Fri 17 Jan 2014 13:44:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:44:43 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:44:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 13:44:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:44:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:44:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:44:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:44:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:44:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:44:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:44:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:44:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:44:54 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:44:54 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:44:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:44:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:44:55 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:45:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:45:01 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:45:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:45:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:45:03 - XML: Processed 655642 elements - found 721 jobs
Fri 17 Jan 2014 13:45:03 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 13:45:03 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 13:45:03 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 13:45:03 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:45:03 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:45:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:45:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:45:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:45:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:45:04 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:45:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43883449
Fri 17 Jan 2014 13:45:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:45:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43883449
Fri 17 Jan 2014 13:45:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:45:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:45:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:45:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:45:14 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:45:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:45:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:45:16 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:45:16 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:45:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:45:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:45:16 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:45:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:45:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:45:18 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:45:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:45:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:45:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:45:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43904210
Fri 17 Jan 2014 13:45:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:45:19 - job_xml_thread(): Done retrieving: data size 43904210
Fri 17 Jan 2014 13:45:19 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:45:20 - XML: Start document: iteration 2
Fri 17 Jan 2014 13:45:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:45:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:45:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43904210
Fri 17 Jan 2014 13:45:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:45:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:45:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:45:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:45:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:45:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:45:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:45:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:45:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:45:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:45:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:45:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:45:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:45:37 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:45:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:45:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:45:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:45:38 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:45:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 13:45:38 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:45:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 13:45:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9346 values 147399 bits 18424 bytes 
Fri 17 Jan 2014 13:45:40 - XML: Processed 655642 elements - found 721 jobs
Fri 17 Jan 2014 13:45:40 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:45:40 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:45:40 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:45:40 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:45:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:45:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:45:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:45:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:45:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:45:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:45:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:45:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:45:44 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:45:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 13:45:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:45:44 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:45:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862081
Fri 17 Jan 2014 13:45:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:45:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862081
Fri 17 Jan 2014 13:45:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:45:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:45:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:45:55 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:45:55 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:45:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:45:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:45:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:45:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:45:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:45:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:45:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:45:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:45:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:45:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:45:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:45:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:45:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:45:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:45:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:45:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:45:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:45:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:45:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:45:59 - job_xml_thread(): Done retrieving: data size 43884890
Fri 17 Jan 2014 13:45:59 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:45:59 - XML: Start document: iteration 3
Fri 17 Jan 2014 13:46:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43884890
Fri 17 Jan 2014 13:46:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:46:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43884890
Fri 17 Jan 2014 13:46:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:46:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:46:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:46:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:46:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:46:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:46:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:46:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:46:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:46:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:46:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:46:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:46:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:46:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:46:20 - XML: Processed 655642 elements - found 721 jobs
Fri 17 Jan 2014 13:46:20 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:46:20 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:46:20 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:46:20 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:46:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:46:23 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:46:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:46:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:46:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:46:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:46:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:46:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:46:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:46:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43906637
Fri 17 Jan 2014 13:46:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:46:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43906637
Fri 17 Jan 2014 13:46:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:46:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:46:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:46:35 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:46:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:46:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:46:38 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:46:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:46:38 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:46:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:46:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 13:46:38 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:46:38 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:46:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148803 bits 18600 bytes 
Fri 17 Jan 2014 13:46:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 13:46:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:46:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:46:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:46:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:46:39 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:46:39 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:46:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:46:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:46:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:46:40 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:46:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:46:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:46:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:46:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:46:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:46:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:46:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:46:43 - job_xml_thread(): Done retrieving: data size 43881415
Fri 17 Jan 2014 13:46:43 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:46:43 - XML: Start document: iteration 4
Fri 17 Jan 2014 13:46:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43881415
Fri 17 Jan 2014 13:46:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:46:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43881415
Fri 17 Jan 2014 13:46:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:46:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:46:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:46:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:46:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:47:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:47:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:47:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:47:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:47:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:47:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:47:05 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:47:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:47:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:47:05 - XML: Processed 655644 elements - found 722 jobs
Fri 17 Jan 2014 13:47:05 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 13:47:06 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 13:47:06 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 13:47:06 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:47:06 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:47:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:47:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:47:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:47:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:47:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:47:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:47:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:47:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:47:07 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:47:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 13:47:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:47:08 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:47:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855747
Fri 17 Jan 2014 13:47:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:47:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855747
Fri 17 Jan 2014 13:47:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:47:13 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 13:47:13 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:47:15 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:47:15 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:47:15 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 13:47:15 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 13:47:15 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 13:47:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:47:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:47:21 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:47:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:47:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:47:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:47:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:47:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:47:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:47:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:47:23 - size of cluster 'LISA Cluster': 624 hosts 79475 metrics 874131 values 13798548 bits 1724818 bytes 
Fri 17 Jan 2014 13:47:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:47:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:47:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:47:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:47:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:47:25 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:47:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:47:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:47:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:47:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:47:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:47:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:47:29 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:47:29 - job_xml_thread(): Done retrieving: data size 43814475
Fri 17 Jan 2014 13:47:29 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:47:29 - XML: Start document: iteration 5
Fri 17 Jan 2014 13:47:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43814475
Fri 17 Jan 2014 13:47:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43814475
Fri 17 Jan 2014 13:47:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:47:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:47:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:47:39 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:47:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:47:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:47:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:47:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:47:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:47:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 13:47:40 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:47:40 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:47:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 13:47:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8919 values 141126 bits 17640 bytes 
Fri 17 Jan 2014 13:47:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:47:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:47:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:47:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:47:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:47:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:47:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:47:45 - XML: Processed 654896 elements - found 722 jobs
Fri 17 Jan 2014 13:47:46 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:47:46 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:47:46 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:47:46 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:47:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:47:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:47:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:47:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:47:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:47:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:47:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:47:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:47:54 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:47:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43264087
Fri 17 Jan 2014 13:47:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:47:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43264087
Fri 17 Jan 2014 13:47:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:47:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:47:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:48:01 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:48:01 - job_xml_thread(): Done retrieving: data size 43264087
Fri 17 Jan 2014 13:48:01 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:48:01 - XML: Start document: iteration 6
Fri 17 Jan 2014 13:48:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:48:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:48:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:48:07 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:48:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:48:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:48:07 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:48:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:48:07 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:48:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:48:07 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:48:14 - XML: Processed 647998 elements - found 722 jobs
Fri 17 Jan 2014 13:48:14 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:48:14 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:48:14 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:48:14 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:48:15 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:48:15 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 13:48:17 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:48:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 13:48:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:48:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:48:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:48:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:48:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:48:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:48:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:48:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:48:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:48:21 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:48:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43266344
Fri 17 Jan 2014 13:48:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:48:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:48:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:48:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43266344
Fri 17 Jan 2014 13:48:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:48:29 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:48:29 - job_xml_thread(): Done retrieving: data size 43266344
Fri 17 Jan 2014 13:48:29 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:48:29 - XML: Start document: iteration 7
Fri 17 Jan 2014 13:48:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:48:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:48:39 - XML: Processed 648120 elements - found 723 jobs
Fri 17 Jan 2014 13:48:39 - job 7348310 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:48:39 - job 7348319 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:48:39 - job 7348309 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:48:40 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 13:48:40 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 13:48:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:48:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:48:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:48:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:48:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:48:41 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:48:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:48:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:48:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:48:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:48:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:48:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:48:42 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:48:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 13:48:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 13:48:42 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:48:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5713 values 90322 bits 11290 bytes 
Fri 17 Jan 2014 13:48:42 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 13:48:42 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:48:42 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:48:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:48:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:48:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:48:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:48:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:48:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:48:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:48:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:48:47 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:48:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43819900
Fri 17 Jan 2014 13:48:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:48:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43819900
Fri 17 Jan 2014 13:48:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:48:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:48:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:48:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:48:57 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:48:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:48:57 - job_xml_thread(): Done retrieving: data size 43819900
Fri 17 Jan 2014 13:48:57 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:48:57 - XML: Start document: iteration 8
Fri 17 Jan 2014 13:48:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:48:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:48:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:48:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:48:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:48:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:48:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:48:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:48:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:49:07 - XML: Processed 654840 elements - found 723 jobs
Fri 17 Jan 2014 13:49:07 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:49:07 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:49:07 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:49:07 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:49:07 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:49:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 13:49:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:49:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:49:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:49:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:49:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:49:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:49:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:49:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:49:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:49:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:49:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:49:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:49:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43849148
Fri 17 Jan 2014 13:49:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:49:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43849148
Fri 17 Jan 2014 13:49:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:49:23 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:49:23 - job_xml_thread(): Done retrieving: data size 43849148
Fri 17 Jan 2014 13:49:23 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:49:23 - XML: Start document: iteration 9
Fri 17 Jan 2014 13:49:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:49:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:49:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:49:28 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:49:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:49:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:49:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:49:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:49:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:49:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:49:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:49:34 - XML: Processed 655646 elements - found 723 jobs
Fri 17 Jan 2014 13:49:34 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:49:34 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:49:34 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:49:34 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:49:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:49:36 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:49:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:49:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:49:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:49:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:49:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:49:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:49:39 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:49:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43886369
Fri 17 Jan 2014 13:49:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:49:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43886369
Fri 17 Jan 2014 13:49:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:49:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:49:42 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:49:42 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:49:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 13:49:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:49:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 13:49:42 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:49:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9122 values 143970 bits 17996 bytes 
Fri 17 Jan 2014 13:49:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:49:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:49:49 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:49:49 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:49:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:49:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:49:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:49:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:49:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:49:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:49:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:49:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:49:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:49:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:49:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:49:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:49:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:49:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:49:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:49:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:49:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:49:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:49:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:49:59 - job_xml_thread(): Done retrieving: data size 43871338
Fri 17 Jan 2014 13:49:59 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:49:59 - XML: Start document: iteration 10
Fri 17 Jan 2014 13:50:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43871338
Fri 17 Jan 2014 13:50:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:50:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43871338
Fri 17 Jan 2014 13:50:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:50:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:50:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:50:11 - XML: Processed 655646 elements - found 723 jobs
Fri 17 Jan 2014 13:50:11 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:50:11 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:50:12 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:50:12 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:50:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:50:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:50:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:50:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:50:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:50:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:50:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:50:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:50:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:50:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:50:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:50:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:50:24 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:50:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:50:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:50:24 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:50:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 13:50:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:50:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:50:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:50:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:50:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:50:27 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:50:27 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:50:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43899975
Fri 17 Jan 2014 13:50:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:50:28 - job_xml_thread(): Done retrieving: data size 43899975
Fri 17 Jan 2014 13:50:28 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:50:28 - XML: Start document: iteration 11
Fri 17 Jan 2014 13:50:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43899975
Fri 17 Jan 2014 13:50:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:50:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:50:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:50:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:50:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:50:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:50:42 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:50:44 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:50:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 13:50:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:50:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 13:50:45 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:50:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5802 values 91544 bits 11443 bytes 
Fri 17 Jan 2014 13:50:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:50:48 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:50:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:50:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:50:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:50:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:50:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:50:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:50:49 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:50:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:50:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:50:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:50:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:50:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:50:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:50:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:50:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:50:51 - XML: Processed 655637 elements - found 720 jobs
Fri 17 Jan 2014 13:50:51 - job 7348104 appears to have finished
Fri 17 Jan 2014 13:50:51 - job 7348314 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:50:51 - job 7348311 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:50:51 - job 7348313 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:50:51 - job 7348312 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:50:51 - job 7347642 appears to have finished
Fri 17 Jan 2014 13:50:51 - job 7348166 appears to have finished
Fri 17 Jan 2014 13:50:52 - job 7348236 appears to have finished
Fri 17 Jan 2014 13:50:52 - job 7348072 appears to have finished
Fri 17 Jan 2014 13:50:52 - job 7348197 appears to have finished
Fri 17 Jan 2014 13:50:52 - job 7348194 appears to have finished
Fri 17 Jan 2014 13:50:52 - job_xml_thread(): Found 15 updated jobs.
Fri 17 Jan 2014 13:50:52 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 13:50:52 - job_xml_thread(): Done storing. succesfully stored: 15 jobs
Fri 17 Jan 2014 13:50:52 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:50:52 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:50:56 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:50:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43910717
Fri 17 Jan 2014 13:50:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:50:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43910717
Fri 17 Jan 2014 13:50:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:51:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:51:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:51:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:51:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:51:07 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:51:07 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:51:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:51:09 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:51:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:51:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:51:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:51:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:51:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:51:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:51:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:51:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:51:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:51:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:51:11 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:51:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 13:51:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:51:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:51:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:51:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:51:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:51:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:51:13 - job_xml_thread(): Done retrieving: data size 43887236
Fri 17 Jan 2014 13:51:13 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:51:13 - XML: Start document: iteration 12
Fri 17 Jan 2014 13:51:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43887236
Fri 17 Jan 2014 13:51:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:51:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43887236
Fri 17 Jan 2014 13:51:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:51:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:51:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:51:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:51:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:51:34 - XML: Processed 655640 elements - found 720 jobs
Fri 17 Jan 2014 13:51:34 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:51:34 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:51:34 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:51:34 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:51:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:51:37 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:51:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:51:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:51:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:51:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:51:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:51:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:51:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:51:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:51:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:51:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:51:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:51:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:51:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:51:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:51:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:51:40 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 13:51:40 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 13:51:40 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:51:40 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:51:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43917027
Fri 17 Jan 2014 13:51:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:51:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43917027
Fri 17 Jan 2014 13:51:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:51:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:51:46 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:51:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:51:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 13:51:47 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:51:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 13:51:48 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:51:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9127 values 144019 bits 18002 bytes 
Fri 17 Jan 2014 13:51:49 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:51:49 - job_xml_thread(): Done retrieving: data size 43917027
Fri 17 Jan 2014 13:51:49 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:51:49 - XML: Start document: iteration 13
Fri 17 Jan 2014 13:51:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:51:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:51:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:51:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:51:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:51:58 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:51:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:51:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:51:59 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:51:59 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:51:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:51:59 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:51:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:52:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:52:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:52:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:52:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:52:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:52:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:52:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:52:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:52:04 - XML: Processed 655640 elements - found 720 jobs
Fri 17 Jan 2014 13:52:04 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:52:04 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:52:04 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:52:04 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:52:06 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:52:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43898088
Fri 17 Jan 2014 13:52:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:52:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43898088
Fri 17 Jan 2014 13:52:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:52:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:52:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:52:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:52:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:52:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:52:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:52:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:52:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:52:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:52:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:52:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:52:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:52:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:52:20 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:52:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:52:21 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:52:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:52:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:52:21 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:52:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 13:52:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:52:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:52:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:52:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:52:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:52:24 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:52:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43902830
Fri 17 Jan 2014 13:52:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:52:24 - job_xml_thread(): Done retrieving: data size 43902830
Fri 17 Jan 2014 13:52:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43902830
Fri 17 Jan 2014 13:52:24 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:52:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:52:24 - XML: Start document: iteration 14
Fri 17 Jan 2014 13:52:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:52:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:52:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:52:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:52:43 - XML: Processed 655632 elements - found 716 jobs
Fri 17 Jan 2014 13:52:43 - job 7348185 appears to have finished
Fri 17 Jan 2014 13:52:43 - job 7348324 appears to have finished
Fri 17 Jan 2014 13:52:44 - job 7348315 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:52:44 - job 7348316 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:52:44 - job 7348153 appears to have finished
Fri 17 Jan 2014 13:52:44 - job 7346762 appears to have finished
Fri 17 Jan 2014 13:52:44 - job_xml_thread(): Found 6 updated jobs.
Fri 17 Jan 2014 13:52:44 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 13:52:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:52:45 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:52:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:52:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:52:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:52:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:52:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:52:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:52:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:52:46 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Fri 17 Jan 2014 13:52:46 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:52:46 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:52:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:52:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:52:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:52:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:52:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:52:47 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:52:48 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:52:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:52:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 13:52:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 13:52:48 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:52:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5764 values 90913 bits 11364 bytes 
Fri 17 Jan 2014 13:52:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:52:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:52:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:52:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:52:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:52:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43898496
Fri 17 Jan 2014 13:52:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:52:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43898496
Fri 17 Jan 2014 13:52:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:53:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:53:00 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:53:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:53:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:53:01 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:53:01 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:53:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:53:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:53:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:53:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:53:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:53:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:53:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:53:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:53:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:53:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:53:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:53:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:53:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:53:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:53:05 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:53:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 13:53:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:53:06 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:53:06 - job_xml_thread(): Done retrieving: data size 43902776
Fri 17 Jan 2014 13:53:06 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:53:06 - XML: Start document: iteration 15
Fri 17 Jan 2014 13:53:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43902776
Fri 17 Jan 2014 13:53:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:53:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43902776
Fri 17 Jan 2014 13:53:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:53:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:53:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:53:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:53:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:53:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:53:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:53:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:53:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:53:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:53:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:53:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:53:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:53:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:53:24 - XML: Processed 655630 elements - found 716 jobs
Fri 17 Jan 2014 13:53:24 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:53:24 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:53:24 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:53:24 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:53:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:53:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:53:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:53:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:53:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:53:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:53:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:53:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:53:29 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:53:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43792073
Fri 17 Jan 2014 13:53:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:53:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43792073
Fri 17 Jan 2014 13:53:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:53:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:53:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:53:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:53:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:53:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:53:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:53:39 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:53:40 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:53:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:53:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:53:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:53:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:53:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:53:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:53:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:53:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:53:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:53:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:53:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:53:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:53:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:53:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:53:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:53:45 - job_xml_thread(): Done retrieving: data size 43264690
Fri 17 Jan 2014 13:53:45 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:53:45 - XML: Start document: iteration 16
Fri 17 Jan 2014 13:53:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43264690
Fri 17 Jan 2014 13:53:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:53:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43264690
Fri 17 Jan 2014 13:53:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:53:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:53:48 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:53:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:53:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 13:53:49 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:53:49 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:53:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 13:53:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 10628 values 167645 bits 20955 bytes 
Fri 17 Jan 2014 13:53:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:53:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:53:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:53:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:54:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:54:01 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:54:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:54:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:54:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:54:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:54:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:54:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:54:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:54:06 - XML: Processed 648118 elements - found 716 jobs
Fri 17 Jan 2014 13:54:06 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:54:06 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:54:06 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:54:06 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:54:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:54:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:54:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:54:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:54:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:54:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:54:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:54:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:54:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:54:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43246730
Fri 17 Jan 2014 13:54:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:54:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43246730
Fri 17 Jan 2014 13:54:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:54:15 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 13:54:15 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:54:16 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:54:16 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:54:16 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 13:54:16 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 13:54:16 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 13:54:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:54:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:54:21 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:54:21 - job_xml_thread(): Done retrieving: data size 43246730
Fri 17 Jan 2014 13:54:21 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:54:21 - XML: Start document: iteration 17
Fri 17 Jan 2014 13:54:23 - size of cluster 'LISA Cluster': 624 hosts 79476 metrics 744220 values 11743601 bits 1467950 bytes 
Fri 17 Jan 2014 13:54:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:54:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:54:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:54:27 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:54:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:54:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:54:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:54:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:54:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:54:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:54:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:54:29 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:54:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 13:54:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:54:32 - XML: Processed 647522 elements - found 716 jobs
Fri 17 Jan 2014 13:54:32 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:54:32 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:54:32 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:54:32 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:54:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:54:34 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:54:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:54:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:54:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:54:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:54:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:54:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:54:38 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:54:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43603116
Fri 17 Jan 2014 13:54:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:54:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43603116
Fri 17 Jan 2014 13:54:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:54:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:54:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:54:47 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:54:47 - job_xml_thread(): Done retrieving: data size 43603116
Fri 17 Jan 2014 13:54:47 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:54:47 - XML: Start document: iteration 18
Fri 17 Jan 2014 13:54:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:54:49 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:54:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:54:50 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:54:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 13:54:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 13:54:50 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:54:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:54:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:54:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6142 values 96890 bits 12111 bytes 
Fri 17 Jan 2014 13:54:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:54:53 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:54:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:54:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:54:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:54:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:54:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:54:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:54:55 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:54:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:54:59 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:54:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:54:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:54:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:54:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:54:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:54:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:55:02 - XML: Processed 652092 elements - found 715 jobs
Fri 17 Jan 2014 13:55:02 - job 7348129 appears to have finished
Fri 17 Jan 2014 13:55:02 - job 7348317 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:55:02 - job 7348318 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:55:02 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 13:55:02 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 13:55:02 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 13:55:02 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:55:02 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:55:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:55:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43871952
Fri 17 Jan 2014 13:55:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:55:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43871952
Fri 17 Jan 2014 13:55:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:55:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:55:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:55:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:55:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:55:16 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:55:16 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 13:55:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:55:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:55:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:55:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:55:17 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:55:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:55:17 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:55:17 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:55:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:55:17 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:55:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:55:21 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:55:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:55:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:55:22 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:55:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 13:55:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:55:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:55:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:55:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:55:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:55:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:55:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43894746
Fri 17 Jan 2014 13:55:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:55:25 - job_xml_thread(): Done retrieving: data size 43894746
Fri 17 Jan 2014 13:55:25 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:55:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43894746
Fri 17 Jan 2014 13:55:25 - XML: Start document: iteration 19
Fri 17 Jan 2014 13:55:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:55:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:55:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:55:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:55:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:55:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:55:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:55:35 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:55:35 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:55:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:55:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:55:35 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:55:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:55:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:55:47 - XML: Processed 655630 elements - found 715 jobs
Fri 17 Jan 2014 13:55:47 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:55:47 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:55:47 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:55:47 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:55:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:55:48 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:55:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:55:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:55:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:55:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:55:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:55:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:55:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:55:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:55:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:55:50 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:55:50 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:55:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:55:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 13:55:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 13:55:50 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:55:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5785 values 91227 bits 11403 bytes 
Fri 17 Jan 2014 13:55:51 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:55:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853801
Fri 17 Jan 2014 13:55:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:55:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853801
Fri 17 Jan 2014 13:55:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:56:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:56:00 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:56:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:56:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:56:01 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:56:01 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:56:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:56:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:56:01 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:56:02 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:56:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:56:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:56:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:56:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:56:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:56:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:56:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:56:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:56:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:56:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:56:08 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:56:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 13:56:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:56:09 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:56:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43901510
Fri 17 Jan 2014 13:56:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:56:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43901510
Fri 17 Jan 2014 13:56:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:56:10 - job_xml_thread(): Done retrieving: data size 43901510
Fri 17 Jan 2014 13:56:10 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:56:10 - XML: Start document: iteration 20
Fri 17 Jan 2014 13:56:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:56:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:56:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:56:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:56:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:56:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:56:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:56:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:56:23 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:56:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:56:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:56:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:56:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:56:33 - XML: Processed 655630 elements - found 715 jobs
Fri 17 Jan 2014 13:56:33 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:56:33 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:56:33 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:56:33 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:56:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:56:33 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:56:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:56:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:56:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:56:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:56:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:56:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:56:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:56:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43876455
Fri 17 Jan 2014 13:56:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:56:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43876455
Fri 17 Jan 2014 13:56:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:56:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:56:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:56:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:56:46 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:56:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:56:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:56:47 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:56:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:56:47 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:56:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:56:47 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:56:48 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:56:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:56:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:56:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:56:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:56:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:56:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:56:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:56:51 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:56:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:56:51 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:56:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 13:56:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 13:56:51 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:56:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6248 values 98496 bits 12312 bytes 
Fri 17 Jan 2014 13:56:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:56:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:56:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:56:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:56:54 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:56:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43908488
Fri 17 Jan 2014 13:56:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:56:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43908488
Fri 17 Jan 2014 13:56:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:56:55 - job_xml_thread(): Done retrieving: data size 43908488
Fri 17 Jan 2014 13:56:55 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:56:55 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 13:56:56 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 13:56:56 - Housekeeping: done.
Fri 17 Jan 2014 13:56:56 - XML: Start document: iteration 0
Fri 17 Jan 2014 13:57:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:57:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:57:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:57:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:57:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:57:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:57:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:57:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:57:08 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:57:08 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:57:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:57:08 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:57:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:57:16 - XML: Processed 655628 elements - found 714 jobs
Fri 17 Jan 2014 13:57:16 - job 7348247 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:57:16 - job 7346515 appears to have finished
Fri 17 Jan 2014 13:57:16 - job 7348079 appears to have finished
Fri 17 Jan 2014 13:57:16 - job 7348248 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:57:16 - job_xml_thread(): Found 5 updated jobs.
Fri 17 Jan 2014 13:57:16 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 13:57:17 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Fri 17 Jan 2014 13:57:17 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:57:17 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:57:19 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:57:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 13:57:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:57:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:57:20 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:57:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:57:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:57:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:57:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:57:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:57:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:57:22 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:57:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873932
Fri 17 Jan 2014 13:57:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:57:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873932
Fri 17 Jan 2014 13:57:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:57:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:57:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:57:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:57:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:57:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:57:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:57:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:57:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:57:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873932
Fri 17 Jan 2014 13:57:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:57:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:57:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:57:32 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:57:32 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:57:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:57:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:57:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:57:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:57:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:57:44 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:57:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:57:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:57:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:57:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:57:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:57:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:57:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:57:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:57:46 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 13:57:46 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 13:57:46 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:57:47 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:57:47 - job_xml_thread(): Done retrieving: data size 43857146
Fri 17 Jan 2014 13:57:47 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:57:47 - XML: Start document: iteration 1
Fri 17 Jan 2014 13:57:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43857146
Fri 17 Jan 2014 13:57:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:57:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:57:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:57:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:57:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:57:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43857146
Fri 17 Jan 2014 13:57:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:57:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:57:51 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:57:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:57:52 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:57:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 13:57:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 13:57:52 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:57:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8819 values 139082 bits 17385 bytes 
Fri 17 Jan 2014 13:57:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:57:58 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:58:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:58:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:58:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:58:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:58:04 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:58:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:58:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:58:04 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:58:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:58:05 - XML: Processed 655628 elements - found 714 jobs
Fri 17 Jan 2014 13:58:05 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:58:05 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:58:05 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:58:05 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:58:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:58:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:58:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:58:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:58:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:58:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:58:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:58:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:58:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:58:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43883109
Fri 17 Jan 2014 13:58:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:58:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43883109
Fri 17 Jan 2014 13:58:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:58:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:58:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:58:20 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:58:20 - job_xml_thread(): Done retrieving: data size 43883109
Fri 17 Jan 2014 13:58:20 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:58:20 - XML: Start document: iteration 2
Fri 17 Jan 2014 13:58:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:58:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:58:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:58:27 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:58:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:58:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:58:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:58:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:58:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:58:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:58:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:58:33 - XML: Processed 655628 elements - found 714 jobs
Fri 17 Jan 2014 13:58:33 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:58:33 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:58:33 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:58:33 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:58:33 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:58:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 13:58:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:58:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:58:34 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:58:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:58:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:58:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:58:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:58:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:58:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:58:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:58:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43891192
Fri 17 Jan 2014 13:58:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:58:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43891192
Fri 17 Jan 2014 13:58:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:58:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:58:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:58:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:58:48 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:58:48 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:58:48 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:58:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:58:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:58:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:58:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:58:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:58:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:58:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:58:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:58:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:58:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:58:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:58:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:58:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:58:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:58:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:58:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:58:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:58:52 - job_xml_thread(): Done retrieving: data size 43913887
Fri 17 Jan 2014 13:58:52 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:58:52 - XML: Start document: iteration 3
Fri 17 Jan 2014 13:58:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43913887
Fri 17 Jan 2014 13:58:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:58:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:58:52 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:58:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43913887
Fri 17 Jan 2014 13:58:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:58:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:58:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 13:58:54 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:58:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 13:58:55 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:58:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9240 values 145792 bits 18224 bytes 
Fri 17 Jan 2014 13:59:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:59:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:59:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:59:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:59:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:59:14 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:59:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:59:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:59:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:59:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:59:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:59:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:59:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:59:15 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:59:15 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:59:15 - XML: Processed 655626 elements - found 713 jobs
Fri 17 Jan 2014 13:59:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:59:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:59:15 - job 7348331 field 'start_timestamp' changed since saved from: 1389963365 to: 1389963331
Fri 17 Jan 2014 13:59:15 - job 7348085 appears to have finished
Fri 17 Jan 2014 13:59:15 - job 7348325 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:59:15 - job 7348259 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:59:15 - job 7348261 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:59:15 - job 7348260 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 13:59:15 - job 7348248 field 'start_timestamp' changed since saved from: 1389963379 to: 1389963331
Fri 17 Jan 2014 13:59:15 - job 7348196 appears to have finished
Fri 17 Jan 2014 13:59:15 - job_xml_thread(): Found 9 updated jobs.
Fri 17 Jan 2014 13:59:15 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 13:59:16 - job_xml_thread(): Done storing. succesfully stored: 9 jobs
Fri 17 Jan 2014 13:59:16 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:59:16 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:59:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:59:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:59:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:59:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:59:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:59:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43825445
Fri 17 Jan 2014 13:59:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:59:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43825445
Fri 17 Jan 2014 13:59:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:59:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:59:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:59:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:59:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:59:31 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 13:59:31 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:59:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:59:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:59:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:59:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:59:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:59:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:59:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:59:33 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:59:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:59:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:59:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:59:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:59:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:59:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 13:59:33 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:59:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 13:59:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:59:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 13:59:35 - job_xml_thread(): Done retrieving: data size 43339364
Fri 17 Jan 2014 13:59:35 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 13:59:35 - XML: Start document: iteration 4
Fri 17 Jan 2014 13:59:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43339364
Fri 17 Jan 2014 13:59:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 13:59:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43339364
Fri 17 Jan 2014 13:59:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 13:59:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:59:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:59:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 13:59:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 13:59:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 13:59:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:59:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 13:59:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 13:59:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:59:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:59:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 13:59:48 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 13:59:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 13:59:53 - XML: Processed 648794 elements - found 713 jobs
Fri 17 Jan 2014 13:59:53 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 13:59:53 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 13:59:53 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 13:59:54 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 13:59:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 13:59:55 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 13:59:57 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:59:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 13:59:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 13:59:57 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 13:59:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 13:59:57 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 13:59:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 13:59:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5797 values 91440 bits 11430 bytes 
Fri 17 Jan 2014 13:59:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 13:59:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 13:59:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:59:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 13:59:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 13:59:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:00:00 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:00:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43198637
Fri 17 Jan 2014 14:00:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:00:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43198637
Fri 17 Jan 2014 14:00:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:00:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:00:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:00:09 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:00:09 - job_xml_thread(): Done retrieving: data size 43198637
Fri 17 Jan 2014 14:00:09 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:00:09 - XML: Start document: iteration 5
Fri 17 Jan 2014 14:00:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:00:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:00:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:00:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:00:12 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:00:12 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:00:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:00:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:00:12 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:00:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:00:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:00:19 - XML: Processed 647538 elements - found 713 jobs
Fri 17 Jan 2014 14:00:19 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 14:00:19 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 14:00:19 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:00:19 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:00:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:00:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:00:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:00:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:00:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:00:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:00:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:00:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:00:22 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:00:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 14:00:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:00:23 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:00:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43273509
Fri 17 Jan 2014 14:00:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:00:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43273509
Fri 17 Jan 2014 14:00:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:00:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:00:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:00:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:00:34 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:00:34 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:00:34 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:00:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:00:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:00:35 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:00:35 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:00:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:00:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:00:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:00:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:00:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:00:38 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:00:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:00:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:00:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:00:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:00:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:00:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:00:39 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:00:39 - job_xml_thread(): Done retrieving: data size 43479799
Fri 17 Jan 2014 14:00:39 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:00:39 - XML: Start document: iteration 6
Fri 17 Jan 2014 14:00:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43479799
Fri 17 Jan 2014 14:00:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:00:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43479799
Fri 17 Jan 2014 14:00:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:00:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:00:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:00:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:00:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:00:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:00:58 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:00:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:00:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:00:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:00:59 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:00:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 14:00:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 14:00:59 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:00:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:00:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:00:59 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8580 values 135295 bits 16911 bytes 
Fri 17 Jan 2014 14:01:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:01:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:01:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:01:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:01:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:01:01 - XML: Processed 650432 elements - found 710 jobs
Fri 17 Jan 2014 14:01:01 - job 7348332 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 14:01:01 - job 7348102 appears to have finished
Fri 17 Jan 2014 14:01:01 - job 7348094 appears to have finished
Fri 17 Jan 2014 14:01:01 - job 7348261 field 'start_timestamp' changed since saved from: 1389963495 to: 1389963442
Fri 17 Jan 2014 14:01:01 - job 7347904 appears to have finished
Fri 17 Jan 2014 14:01:01 - job 7348069 appears to have finished
Fri 17 Jan 2014 14:01:02 - job_xml_thread(): Found 7 updated jobs.
Fri 17 Jan 2014 14:01:02 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 14:01:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:01:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:01:02 - job_xml_thread(): Done storing. succesfully stored: 7 jobs
Fri 17 Jan 2014 14:01:02 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:01:02 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:01:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:01:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:01:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:01:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:01:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:01:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:01:03 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:01:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43892395
Fri 17 Jan 2014 14:01:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:01:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43892395
Fri 17 Jan 2014 14:01:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:01:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:01:13 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:01:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:01:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:01:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:01:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:01:16 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:01:16 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:01:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:01:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:01:16 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:01:16 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:01:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 14:01:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:01:16 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 14:01:16 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:01:17 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:01:17 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:01:17 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 14:01:17 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 14:01:17 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 14:01:17 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:01:17 - size of cluster 'LISA Cluster': 624 hosts 79478 metrics 859144 values 13558555 bits 1694819 bytes 
Fri 17 Jan 2014 14:01:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:01:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:01:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:01:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:01:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:01:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:01:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:01:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43894553
Fri 17 Jan 2014 14:01:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:01:19 - job_xml_thread(): Done retrieving: data size 43894553
Fri 17 Jan 2014 14:01:19 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:01:19 - XML: Start document: iteration 7
Fri 17 Jan 2014 14:01:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43894553
Fri 17 Jan 2014 14:01:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:01:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:01:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:01:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:01:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:01:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:01:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:01:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:01:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:01:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:01:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:01:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:01:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:01:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:01:38 - XML: Processed 655620 elements - found 710 jobs
Fri 17 Jan 2014 14:01:39 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 14:01:39 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 14:01:39 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:01:39 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:01:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:01:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:01:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:01:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:01:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:01:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:01:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:01:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:01:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:01:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43860339
Fri 17 Jan 2014 14:01:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:01:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43860339
Fri 17 Jan 2014 14:01:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:01:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:01:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:01:54 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:01:54 - job_xml_thread(): Done retrieving: data size 43860339
Fri 17 Jan 2014 14:01:55 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:01:55 - XML: Start document: iteration 8
Fri 17 Jan 2014 14:01:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:01:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:01:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:01:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:01:56 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:01:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:01:56 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:01:56 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:01:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:01:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:01:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:01:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:01:59 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:01:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:01:59 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:01:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 14:01:59 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:01:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 14:02:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8925 values 141071 bits 17633 bytes 
Fri 17 Jan 2014 14:02:06 - XML: Processed 655620 elements - found 710 jobs
Fri 17 Jan 2014 14:02:07 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 14:02:07 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 14:02:07 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:02:07 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:02:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:02:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:02:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:02:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:02:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:02:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:02:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:02:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:02:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:02:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43866019
Fri 17 Jan 2014 14:02:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:02:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:02:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:02:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43866019
Fri 17 Jan 2014 14:02:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:02:17 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:02:17 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 14:02:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:02:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:02:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:02:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:02:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:02:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:02:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:02:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:02:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:02:23 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:02:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:02:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:02:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:02:24 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:02:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:02:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:02:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:02:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:02:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:02:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:02:25 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:02:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 14:02:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:02:28 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:02:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43880704
Fri 17 Jan 2014 14:02:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:02:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43880704
Fri 17 Jan 2014 14:02:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:02:29 - job_xml_thread(): Done retrieving: data size 43880704
Fri 17 Jan 2014 14:02:29 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:02:29 - XML: Start document: iteration 9
Fri 17 Jan 2014 14:02:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:02:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:02:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:02:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:02:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:02:45 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:02:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:02:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:02:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:02:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:02:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:02:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:02:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:02:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:02:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:02:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:02:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:02:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:02:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:02:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:02:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:02:51 - XML: Processed 655613 elements - found 709 jobs
Fri 17 Jan 2014 14:02:51 - job 7348333 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 14:02:51 - job 7348077 appears to have finished
Fri 17 Jan 2014 14:02:51 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 14:02:51 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 14:02:51 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 14:02:51 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:02:51 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:02:54 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:02:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43905030
Fri 17 Jan 2014 14:02:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:02:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43905030
Fri 17 Jan 2014 14:02:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:03:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:03:00 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:03:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:03:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:03:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:03:02 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:03:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 14:03:02 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:03:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8729 values 138098 bits 17262 bytes 
Fri 17 Jan 2014 14:03:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 14:03:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:03:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:03:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:03:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:03:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:03:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:03:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:03:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:03:05 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:03:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:03:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:03:06 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:03:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:03:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:03:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:03:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:03:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:03:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:03:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:03:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:03:12 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:03:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 14:03:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:03:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:03:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43886417
Fri 17 Jan 2014 14:03:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:03:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43886417
Fri 17 Jan 2014 14:03:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:03:14 - job_xml_thread(): Done retrieving: data size 43886417
Fri 17 Jan 2014 14:03:14 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:03:14 - XML: Start document: iteration 10
Fri 17 Jan 2014 14:03:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:03:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:03:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:03:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:03:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:03:31 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:03:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:03:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:03:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:03:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:03:31 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:03:32 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:03:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:03:34 - XML: Processed 655618 elements - found 709 jobs
Fri 17 Jan 2014 14:03:34 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 14:03:34 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 14:03:34 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:03:34 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:03:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:03:36 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:03:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:03:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:03:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:03:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:03:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:03:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:03:39 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:03:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43900685
Fri 17 Jan 2014 14:03:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:03:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43900685
Fri 17 Jan 2014 14:03:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:03:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:03:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:03:49 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:03:49 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:03:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:03:50 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:03:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:03:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:03:51 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:03:51 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:03:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:03:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:03:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:03:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:03:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:03:53 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:03:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:03:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:03:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:03:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:03:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:03:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:03:57 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:03:57 - job_xml_thread(): Done retrieving: data size 43904273
Fri 17 Jan 2014 14:03:57 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:03:57 - XML: Start document: iteration 11
Fri 17 Jan 2014 14:03:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43904273
Fri 17 Jan 2014 14:03:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:03:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43904273
Fri 17 Jan 2014 14:03:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:04:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:04:02 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:04:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:04:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 14:04:03 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:04:03 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:04:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148799 bits 18599 bytes 
Fri 17 Jan 2014 14:04:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 14:04:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:04:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:04:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:04:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:04:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:04:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:04:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:04:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:04:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:04:14 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:04:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:04:14 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:04:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:04:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:04:19 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:04:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:04:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:04:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:04:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:04:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:04:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:04:20 - XML: Processed 655613 elements - found 709 jobs
Fri 17 Jan 2014 14:04:20 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 14:04:20 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 14:04:20 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:04:20 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:04:24 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:04:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43891172
Fri 17 Jan 2014 14:04:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:04:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43891172
Fri 17 Jan 2014 14:04:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:04:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:04:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:04:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:04:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:04:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:04:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:04:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:04:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:04:35 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:04:35 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:04:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:04:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:04:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:04:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:04:39 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:04:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 14:04:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:04:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:04:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:04:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:04:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:04:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:04:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:04:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:04:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:04:43 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 14:04:43 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 14:04:43 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:04:44 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:04:44 - job_xml_thread(): Done retrieving: data size 43876138
Fri 17 Jan 2014 14:04:44 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:04:44 - XML: Start document: iteration 12
Fri 17 Jan 2014 14:04:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43876138
Fri 17 Jan 2014 14:04:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:04:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43876138
Fri 17 Jan 2014 14:04:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:04:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:04:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:04:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:04:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:05:00 - XML: Processed 655618 elements - found 709 jobs
Fri 17 Jan 2014 14:05:00 - job 7348333 field 'start_timestamp' changed since saved from: 1389963729 to: 1389963654
Fri 17 Jan 2014 14:05:00 - job 7348250 appears to have finished
Fri 17 Jan 2014 14:05:00 - job 7348262 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 14:05:00 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 14:05:00 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 14:05:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:05:04 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:05:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:05:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:05:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:05:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:05:04 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 14:05:04 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:05:04 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:05:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:05:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:05:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:05:05 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:05:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:05:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:05:05 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:05:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 14:05:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 14:05:05 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:05:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5775 values 91108 bits 11388 bytes 
Fri 17 Jan 2014 14:05:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:05:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:05:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:05:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:05:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:05:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:05:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:05:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:05:09 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:05:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43845522
Fri 17 Jan 2014 14:05:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:05:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43845522
Fri 17 Jan 2014 14:05:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:05:19 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:05:19 - job_xml_thread(): Done retrieving: data size 43845522
Fri 17 Jan 2014 14:05:19 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:05:19 - XML: Start document: iteration 13
Fri 17 Jan 2014 14:05:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:05:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:05:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:05:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:05:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:05:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:05:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:05:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:05:23 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:05:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:05:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:05:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:05:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:05:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:05:32 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:05:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:05:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:05:33 - XML: Processed 654870 elements - found 709 jobs
Fri 17 Jan 2014 14:05:33 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 14:05:33 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 14:05:33 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:05:33 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:05:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:05:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:05:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:05:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:05:33 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:05:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 14:05:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:05:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:05:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43782583
Fri 17 Jan 2014 14:05:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:05:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43782583
Fri 17 Jan 2014 14:05:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:05:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:05:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:05:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:05:46 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:05:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:05:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:05:48 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:05:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:05:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:05:48 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:05:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:05:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:05:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:05:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:05:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:05:49 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:05:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:05:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:05:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:05:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:05:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:05:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:05:51 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:05:51 - job_xml_thread(): Done retrieving: data size 43252118
Fri 17 Jan 2014 14:05:51 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:05:51 - XML: Start document: iteration 14
Fri 17 Jan 2014 14:05:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43252118
Fri 17 Jan 2014 14:05:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:05:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43252118
Fri 17 Jan 2014 14:05:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:06:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:06:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:06:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:06:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:06:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:06:06 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:06:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:06:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 14:06:06 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:06:06 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:06:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8930 values 140908 bits 17613 bytes 
Fri 17 Jan 2014 14:06:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 14:06:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:06:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:06:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:06:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:06:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:06:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:06:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:06:10 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:06:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:06:11 - XML: Processed 647590 elements - found 709 jobs
Fri 17 Jan 2014 14:06:11 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 14:06:11 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 14:06:11 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:06:11 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:06:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:06:13 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:06:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:06:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:06:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:06:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:06:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:06:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:06:16 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:06:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 14:06:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:06:16 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:06:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43272184
Fri 17 Jan 2014 14:06:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:06:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43272184
Fri 17 Jan 2014 14:06:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:06:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:06:25 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:06:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:06:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:06:26 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:06:26 - job_xml_thread(): Done retrieving: data size 43272184
Fri 17 Jan 2014 14:06:26 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:06:26 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:06:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:06:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:06:27 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:06:27 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:06:27 - XML: Start document: iteration 15
Fri 17 Jan 2014 14:06:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:06:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:06:36 - XML: Processed 648164 elements - found 708 jobs
Fri 17 Jan 2014 14:06:36 - job 7348334 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 14:06:36 - job 7348145 appears to have finished
Fri 17 Jan 2014 14:06:37 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 14:06:37 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 14:06:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:06:37 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:06:37 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 14:06:37 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:06:37 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:06:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:06:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:06:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:06:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:06:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:06:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:06:39 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:06:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43619129
Fri 17 Jan 2014 14:06:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:06:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43619129
Fri 17 Jan 2014 14:06:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:06:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:06:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:06:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:06:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:06:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:06:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:06:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:06:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:06:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:06:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:06:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43619129
Fri 17 Jan 2014 14:06:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:06:52 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:06:52 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:06:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:06:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:06:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:06:56 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:06:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:06:59 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:06:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:06:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:06:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:06:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:06:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:06:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:07:01 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:07:01 - job_xml_thread(): Done retrieving: data size 43858055
Fri 17 Jan 2014 14:07:01 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:07:01 - XML: Start document: iteration 16
Fri 17 Jan 2014 14:07:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43858055
Fri 17 Jan 2014 14:07:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:07:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:07:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:07:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:07:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:07:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:07:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:07:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858055
Fri 17 Jan 2014 14:07:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:07:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:07:07 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:07:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:07:08 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:07:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 14:07:08 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:07:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 14:07:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148647 bits 18580 bytes 
Fri 17 Jan 2014 14:07:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:07:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:07:19 - XML: Processed 655616 elements - found 708 jobs
Fri 17 Jan 2014 14:07:19 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 14:07:19 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 14:07:19 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:07:19 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:07:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:07:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:07:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:07:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:07:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:07:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:07:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:07:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:07:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:07:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:07:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:07:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:07:25 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:07:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:07:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:07:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:07:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:07:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:07:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:07:28 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:07:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43888373
Fri 17 Jan 2014 14:07:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:07:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43888373
Fri 17 Jan 2014 14:07:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:07:34 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:07:34 - job_xml_thread(): Done retrieving: data size 43888373
Fri 17 Jan 2014 14:07:35 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:07:35 - XML: Start document: iteration 17
Fri 17 Jan 2014 14:07:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:07:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:07:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:07:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:07:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:07:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:07:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:07:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:07:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:07:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:07:44 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:07:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 14:07:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:07:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:07:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:07:44 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:07:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:07:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:07:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:07:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:07:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:07:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:07:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:07:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:07:50 - XML: Processed 655615 elements - found 708 jobs
Fri 17 Jan 2014 14:07:50 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 14:07:50 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 14:07:50 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:07:50 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:07:51 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:07:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43882176
Fri 17 Jan 2014 14:07:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:07:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43882176
Fri 17 Jan 2014 14:07:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:08:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:08:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:08:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:08:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:08:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:08:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:08:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:08:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:08:05 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:08:05 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:08:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:08:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:08:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:08:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:08:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:08:06 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:08:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:08:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:08:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:08:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:08:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:08:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:08:08 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:08:08 - job_xml_thread(): Done retrieving: data size 43911348
Fri 17 Jan 2014 14:08:08 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:08:08 - XML: Start document: iteration 18
Fri 17 Jan 2014 14:08:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43911348
Fri 17 Jan 2014 14:08:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:08:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43911348
Fri 17 Jan 2014 14:08:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:08:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:08:09 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:08:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:08:10 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:08:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 14:08:10 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:08:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 14:08:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6488 values 102449 bits 12806 bytes 
Fri 17 Jan 2014 14:08:17 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 14:08:17 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:08:19 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:08:19 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:08:19 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 14:08:19 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 14:08:19 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 14:08:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:08:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:08:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:08:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:08:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:08:27 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:08:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:08:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Fri 17 Jan 2014 14:08:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:08:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:08:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:08:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:08:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:08:29 - XML: Processed 655616 elements - found 708 jobs
Fri 17 Jan 2014 14:08:29 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 14:08:29 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 14:08:29 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:08:29 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:08:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:08:31 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:08:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:08:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:08:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:08:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:08:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:08:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:08:33 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:08:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43883549
Fri 17 Jan 2014 14:08:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:08:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43883549
Fri 17 Jan 2014 14:08:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:08:36 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:08:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 14:08:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:08:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:08:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:08:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:08:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:08:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:08:44 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:08:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:08:44 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:08:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:08:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:08:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:08:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:08:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:08:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:08:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:08:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:08:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:08:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:08:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:08:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:08:48 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:08:48 - job_xml_thread(): Done retrieving: data size 43886057
Fri 17 Jan 2014 14:08:48 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:08:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43886057
Fri 17 Jan 2014 14:08:48 - XML: Start document: iteration 19
Fri 17 Jan 2014 14:08:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:08:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43886057
Fri 17 Jan 2014 14:08:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:08:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:09:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:09:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:09:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:09:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:09:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:09:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:09:10 - XML: Processed 655616 elements - found 708 jobs
Fri 17 Jan 2014 14:09:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:09:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:09:10 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:09:10 - job 7348334 field 'start_timestamp' changed since saved from: 1389963956 to: 1389963911
Fri 17 Jan 2014 14:09:10 - job 7348106 appears to have finished
Fri 17 Jan 2014 14:09:10 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 14:09:10 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 14:09:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:09:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 14:09:10 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:09:10 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:09:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6263 values 98781 bits 12347 bytes 
Fri 17 Jan 2014 14:09:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 14:09:11 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:09:11 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:09:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:09:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:09:11 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:09:11 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 14:09:11 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:09:11 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:09:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:09:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:09:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:09:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:09:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:09:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:09:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:09:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:09:14 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:09:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43884241
Fri 17 Jan 2014 14:09:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:09:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43884241
Fri 17 Jan 2014 14:09:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:09:19 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:09:19 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:09:21 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:09:21 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 14:09:21 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:09:21 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 14:09:21 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 14:09:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:09:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:09:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:09:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:09:27 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:09:27 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:09:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:09:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:09:27 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:09:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:09:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:09:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:09:27 - size of cluster 'LISA Cluster': 624 hosts 79477 metrics 937592 values 14798421 bits 1849802 bytes 
Fri 17 Jan 2014 14:09:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:09:30 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:09:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:09:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:09:31 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:09:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 14:09:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:09:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:09:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:09:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:09:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:09:34 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:09:34 - job_xml_thread(): Done retrieving: data size 43878980
Fri 17 Jan 2014 14:09:34 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:09:34 - XML: Start document: iteration 20
Fri 17 Jan 2014 14:09:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43878980
Fri 17 Jan 2014 14:09:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43878980
Fri 17 Jan 2014 14:09:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:09:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:09:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:09:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:09:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:09:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:09:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:09:49 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:09:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:09:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:09:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:09:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:09:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:09:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:09:52 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:09:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:09:54 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:09:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:09:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:09:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:09:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:09:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:09:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:09:56 - XML: Processed 655616 elements - found 708 jobs
Fri 17 Jan 2014 14:09:56 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 14:09:56 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 14:09:56 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:09:56 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:10:00 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:10:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43882280
Fri 17 Jan 2014 14:10:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:10:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43882280
Fri 17 Jan 2014 14:10:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:10:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:10:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:10:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:10:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:10:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:10:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:10:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:10:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:10:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:10:11 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:10:11 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:10:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:10:11 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:10:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:10:11 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:10:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:10:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 14:10:11 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:10:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 14:10:11 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:10:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8899 values 140338 bits 17542 bytes 
Fri 17 Jan 2014 14:10:12 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:10:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:10:15 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:10:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:10:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:10:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:10:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:10:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:10:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:10:18 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:10:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 14:10:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:10:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:10:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43874244
Fri 17 Jan 2014 14:10:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:10:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43874244
Fri 17 Jan 2014 14:10:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:10:20 - job_xml_thread(): Done retrieving: data size 43874244
Fri 17 Jan 2014 14:10:20 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:10:20 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 14:10:21 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:10:21 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 14:10:21 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 14:10:21 - Housekeeping: done.
Fri 17 Jan 2014 14:10:21 - XML: Start document: iteration 0
Fri 17 Jan 2014 14:10:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:10:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:10:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:10:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:10:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:10:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:10:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:10:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:10:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:10:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:10:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:10:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:10:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:10:36 - XML: Processed 655616 elements - found 708 jobs
Fri 17 Jan 2014 14:10:36 - job 7339776 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:36 - job 7340333 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:36 - job 7344405 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:36 - job 7344408 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:36 - job 7344356 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:36 - job 7344351 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:36 - job 7348335 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:36 - job 7335239 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:36 - job 7335232 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:36 - job 7335230 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:36 - job 7335231 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:36 - job 7348246 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:36 - job 7348245 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:36 - job 7348244 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:36 - job 7348243 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:36 - job 7348240 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:36 - job 7347949 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:36 - job 7346097 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:36 - job 7344382 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:36 - job 7339993 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:36 - job 7337217 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:36 - job 7344418 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:36 - job 7340781 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:36 - job 7344416 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:36 - job 7344414 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:36 - job 7344415 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:36 - job 7344412 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:36 - job 7344413 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:36 - job 7344410 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:36 - job 7344411 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:36 - job 7338953 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:36 - job 7344354 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:36 - job 7338775 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:36 - job 7343787 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:36 - job 7337863 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:36 - job 7335401 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:36 - job 7335400 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:36 - job 7335403 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7335402 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7335405 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7335404 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7335406 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7348328 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7348322 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7348323 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7348326 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7348327 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7335249 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7335248 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7335246 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7348255 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7348251 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7348253 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7337345 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7337341 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7336194 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7344419 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7339232 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7344417 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7337500 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7340310 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7336999 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7344427 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7337261 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7344645 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7341893 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7344399 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7344398 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7344016 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7344391 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7344390 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7344393 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7344392 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7344395 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7344394 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7344397 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7344396 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7338806 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7338411 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7335485 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7338343 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7342415 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7335259 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7335250 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7335254 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7335255 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7348263 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7348267 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7348266 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7337272 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7340972 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7345705 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7337799 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7344657 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7337400 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7341100 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7344384 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7339484 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7337641 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7344435 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7344436 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7344341 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7344430 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7344344 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7344433 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7345969 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7344368 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7344369 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7344360 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7344361 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7344362 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7344363 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7344364 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7344365 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7344366 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7344367 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7344440 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7348063 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7348062 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7348065 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7335389 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7335576 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7335273 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7335271 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7335276 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7335376 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7335375 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7335207 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7335206 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7335205 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7335204 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7335203 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7335202 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7335201 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7335200 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7339391 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7335209 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7335208 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7339156 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7347912 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7347910 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7347911 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7343472 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7345099 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7344425 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7338208 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7344422 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7344421 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7344420 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7344426 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7344357 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7344424 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7344423 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7344353 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7344352 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7335866 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7344359 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7344358 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7344429 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7344428 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7348282 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7338514 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7348283 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7348281 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7348280 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7348287 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7348286 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7348285 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7348284 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7348289 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7335361 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7335364 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7335365 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7348211 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7348212 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7348213 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7348214 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7348215 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7348216 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7348217 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7347695 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7348220 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7335214 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7335215 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7335216 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7335217 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7335210 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7335211 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7335212 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7335213 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7335218 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7335219 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7339966 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7341063 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7345647 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7348249 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7344342 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7344347 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7344432 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7344345 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7344348 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7344349 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7344438 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7344439 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7343751 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7338784 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7335903 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7348292 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7348293 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7348294 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7348295 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7348296 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7348297 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7348298 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7348299 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7342714 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7335424 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7335423 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7335422 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7335421 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7348221 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7338025 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job 7335199 report time 1389964069 does not match current heartbeat 1389964189 : ignoring job
Fri 17 Jan 2014 14:10:37 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 14:10:37 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 14:10:37 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:10:37 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:10:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:10:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:10:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:10:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:10:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:10:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:10:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:10:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:10:44 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:10:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43864937
Fri 17 Jan 2014 14:10:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:10:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43864937
Fri 17 Jan 2014 14:10:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:10:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:10:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:10:52 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:10:52 - job_xml_thread(): Done retrieving: data size 43864937
Fri 17 Jan 2014 14:10:52 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:10:52 - XML: Start document: iteration 1
Fri 17 Jan 2014 14:10:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:10:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:11:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:11:03 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:11:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:11:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:11:04 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:11:04 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:11:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:11:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:11:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:11:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:11:09 - XML: Processed 655613 elements - found 708 jobs
Fri 17 Jan 2014 14:11:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:11:09 - job 7348263 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 14:11:09 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 14:11:09 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 14:11:09 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 14:11:09 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:11:09 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:11:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:11:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:11:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:11:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:11:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:11:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:11:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:11:11 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:11:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:11:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 14:11:12 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:11:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 14:11:12 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:11:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99079 bits 12384 bytes 
Fri 17 Jan 2014 14:11:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:11:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43820700
Fri 17 Jan 2014 14:11:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:11:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43820700
Fri 17 Jan 2014 14:11:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:11:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:11:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:11:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:11:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:11:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:11:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:11:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:11:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:11:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:11:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:11:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43820700
Fri 17 Jan 2014 14:11:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:11:24 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:11:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:11:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:11:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:11:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:11:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:11:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:11:36 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:11:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:11:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:11:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:11:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:11:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:11:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:11:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:11:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:11:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:11:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:11:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:11:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:11:39 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:11:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 14:11:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:11:40 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:11:40 - job_xml_thread(): Done retrieving: data size 43692283
Fri 17 Jan 2014 14:11:40 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:11:40 - XML: Start document: iteration 2
Fri 17 Jan 2014 14:11:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43692283
Fri 17 Jan 2014 14:11:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:11:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43692283
Fri 17 Jan 2014 14:11:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:11:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:11:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:11:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:11:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:11:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:11:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:11:53 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:11:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:11:53 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:11:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:11:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:11:58 - XML: Processed 653494 elements - found 708 jobs
Fri 17 Jan 2014 14:11:58 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 14:11:58 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 14:11:58 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:11:58 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:12:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:12:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:12:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:12:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:12:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:12:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:12:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:12:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:12:05 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 14:12:05 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 14:12:05 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:12:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:12:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43201764
Fri 17 Jan 2014 14:12:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:12:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43201764
Fri 17 Jan 2014 14:12:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:12:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:12:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:12:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:12:12 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:12:13 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:12:13 - job_xml_thread(): Done retrieving: data size 43201764
Fri 17 Jan 2014 14:12:13 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:12:13 - XML: Start document: iteration 3
Fri 17 Jan 2014 14:12:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:12:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 14:12:13 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:12:13 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:12:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 14:12:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6884 values 108567 bits 13570 bytes 
Fri 17 Jan 2014 14:12:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:12:16 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:12:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:12:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:12:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:12:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:12:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:12:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:12:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:12:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:12:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:12:25 - XML: Processed 647422 elements - found 708 jobs
Fri 17 Jan 2014 14:12:25 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 14:12:25 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 14:12:25 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:12:25 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:12:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:12:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:12:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:12:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:12:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:12:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:12:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:12:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:12:30 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:12:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43510418
Fri 17 Jan 2014 14:12:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:12:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43510418
Fri 17 Jan 2014 14:12:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:12:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:12:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:12:40 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:12:40 - job_xml_thread(): Done retrieving: data size 43510418
Fri 17 Jan 2014 14:12:40 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:12:40 - XML: Start document: iteration 4
Fri 17 Jan 2014 14:12:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:12:41 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:12:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:12:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:12:42 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:12:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:12:42 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:12:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:12:42 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:12:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:12:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:12:51 - XML: Processed 651209 elements - found 707 jobs
Fri 17 Jan 2014 14:12:51 - job 7335221 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7335220 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7335223 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7335222 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7335225 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7335224 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7335227 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7335226 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7335229 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7335228 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7339776 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7341721 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7340333 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7340330 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7337749 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7337590 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7343918 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7344401 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7344400 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7344403 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7344402 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7344405 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7344404 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7344407 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7344406 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7344409 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7344408 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7343768 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7341823 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7348056 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7338797 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7338790 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7344356 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7335699 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7344351 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7335439 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7348335 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7335239 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7335232 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7335230 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7335231 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7348246 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7348245 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7348244 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7348243 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7348240 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7348249 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7347949 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7346097 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7344382 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7339993 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7337217 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7344418 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7340781 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7344416 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7344414 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7344415 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7344412 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7344413 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7344410 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7344411 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7338953 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7344354 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7338775 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7343787 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7337863 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7335401 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7335400 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7335403 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7335402 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7335405 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7335404 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7335406 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7348328 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7348322 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:51 - job 7348323 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7348326 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7348327 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7340337 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7335249 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7335248 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7335246 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7348255 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7348251 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7348253 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7337345 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7337341 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7336194 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7344419 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7339232 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7344417 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7337500 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7340310 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7336999 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7344427 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7337261 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7344645 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7341893 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7344399 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7344398 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7344016 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7344391 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7344390 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7344393 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7344392 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7344395 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7344394 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7344397 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7344396 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7338806 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7338411 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7335485 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7338343 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7342415 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7335259 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7335250 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7335254 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7335255 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7348260 appears to have finished
Fri 17 Jan 2014 14:12:52 - job 7348265 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7348264 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7348267 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7348266 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7348269 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7348268 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7337272 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7340972 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7345705 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7337799 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7344657 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7337400 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7344571 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7338475 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7338870 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7343952 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7344379 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7344378 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7344373 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7344372 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7344371 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7341100 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7344377 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7344376 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7344375 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7344374 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7344386 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7344387 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7344384 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7344385 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7338572 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7344383 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7344380 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7344381 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7344388 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7344389 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7335544 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7335395 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7335397 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7348300 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7348306 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7348304 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7348305 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7337899 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7342698 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7335260 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7348278 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7348279 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7348276 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7348277 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7348274 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7348275 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7348272 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7348273 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7348270 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7348271 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7339484 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7346830 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7344370 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7347335 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7347909 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7336565 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7337641 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7337640 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7337643 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7337645 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7337646 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7345031 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7344434 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7344435 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7344436 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7344341 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7344430 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7344431 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:52 - job 7344344 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:53 - job 7344433 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:53 - job 7345969 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:53 - job 7344368 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:53 - job 7344369 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:53 - job 7344360 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:53 - job 7344361 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:53 - job 7344362 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:53 - job 7344363 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:53 - job 7344364 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:53 - job 7344365 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:53 - job 7344366 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:53 - job 7344367 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:53 - job 7344440 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:53 - job 7348063 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:53 - job 7348062 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:53 - job 7348067 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:53 - job 7348065 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:53 - job 7348064 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:53 - job 7335389 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7335576 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7335273 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:12:54 - job 7335271 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7335276 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:12:54 - job 7335376 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7335375 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7335207 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7335206 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7335205 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7335204 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7335203 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7335202 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7335201 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7335200 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7339391 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7335209 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7335208 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7339156 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7347912 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7347910 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7347911 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7343472 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7345099 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7343632 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7343634 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7344425 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:12:54 - job 7338208 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:12:54 - job 7344422 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7344421 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7344420 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7344355 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7344426 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7344357 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7344424 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7344423 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7344350 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7344353 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7344352 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7335866 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7344359 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7344358 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7344429 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7344428 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7338514 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7348283 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7348281 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7348280 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7348287 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7348286 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7348285 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7348284 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7348289 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7335361 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7335364 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7335365 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7348211 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7348212 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7348213 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7348214 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7348215 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7348216 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7348217 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7347695 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7348220 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7335214 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7335215 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7335216 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7335217 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7335210 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7335211 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7335212 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7335213 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7335218 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7335219 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7339966 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7338025 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7341063 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7345647 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7344342 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7344343 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7344437 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7344346 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7344347 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7344432 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7344345 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7344348 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7344349 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7344438 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7344439 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7343751 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7338784 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7335903 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7348292 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7348293 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7348294 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7348295 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7348296 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7348297 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7348298 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7348299 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7342714 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7335424 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7335423 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7335422 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7335421 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7348221 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7348282 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job 7335199 report time 1389964189 does not match current heartbeat 1389964310 : ignoring job
Fri 17 Jan 2014 14:12:54 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 14:12:54 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 14:12:54 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 14:12:54 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:12:54 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:12:54 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:12:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 14:12:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:12:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:12:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:12:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:12:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:12:55 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:12:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43814034
Fri 17 Jan 2014 14:12:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:12:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43814034
Fri 17 Jan 2014 14:12:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:12:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:12:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:13:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:13:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:13:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:13:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:13:08 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:13:08 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:13:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:13:08 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:13:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:13:09 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:13:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:13:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:13:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:13:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:13:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:13:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:13:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:13:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:13:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:13:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:13:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:13:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43902753
Fri 17 Jan 2014 14:13:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:13:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43902753
Fri 17 Jan 2014 14:13:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:13:12 - job_xml_thread(): Done retrieving: data size 43902753
Fri 17 Jan 2014 14:13:12 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:13:12 - XML: Start document: iteration 5
Fri 17 Jan 2014 14:13:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:13:13 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:13:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:13:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 14:13:15 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:13:15 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:13:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Fri 17 Jan 2014 14:13:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:13:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:13:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:13:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:13:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:13:28 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:13:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:13:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:13:29 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:13:29 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:13:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:13:29 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:13:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:13:33 - XML: Processed 655611 elements - found 707 jobs
Fri 17 Jan 2014 14:13:33 - job 7348265 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 14:13:33 - job 7348264 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 14:13:33 - job 7348267 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 14:13:33 - job 7348266 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 14:13:33 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 14:13:33 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 14:13:33 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 14:13:33 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:13:33 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:13:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:13:35 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:13:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:13:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:13:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:13:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:13:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:13:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:13:37 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:13:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43878951
Fri 17 Jan 2014 14:13:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:13:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43878951
Fri 17 Jan 2014 14:13:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:13:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:13:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:13:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:13:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:13:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:13:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:13:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:13:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:13:48 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:13:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:13:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:13:49 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:13:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:13:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:13:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:13:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:13:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:13:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:13:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:13:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:13:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:13:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:13:53 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:13:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43905433
Fri 17 Jan 2014 14:13:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:13:53 - job_xml_thread(): Done retrieving: data size 43905433
Fri 17 Jan 2014 14:13:53 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:13:53 - XML: Start document: iteration 6
Fri 17 Jan 2014 14:13:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43905433
Fri 17 Jan 2014 14:13:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:14:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:14:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:14:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:14:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:14:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:14:07 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:14:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:14:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:14:08 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:14:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:14:08 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:14:08 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:14:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:14:14 - XML: Processed 655614 elements - found 707 jobs
Fri 17 Jan 2014 14:14:14 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 14:14:14 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 14:14:14 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:14:14 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:14:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:14:15 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:14:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:14:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 14:14:16 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:14:16 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:14:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 14:14:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 15286 values 241119 bits 30139 bytes 
Fri 17 Jan 2014 14:14:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:14:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:14:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:14:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:14:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:14:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:14:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:14:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:14:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:14:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43866594
Fri 17 Jan 2014 14:14:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:14:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43866594
Fri 17 Jan 2014 14:14:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:14:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:14:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:14:29 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:14:29 - job_xml_thread(): Done retrieving: data size 43866594
Fri 17 Jan 2014 14:14:29 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:14:29 - XML: Start document: iteration 7
Fri 17 Jan 2014 14:14:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:14:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:14:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:14:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:14:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:14:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:14:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:14:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:14:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:14:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:14:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:14:42 - XML: Processed 655614 elements - found 707 jobs
Fri 17 Jan 2014 14:14:42 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 14:14:42 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 14:14:42 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:14:42 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:14:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:14:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:14:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:14:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:14:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:14:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:14:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:14:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:14:42 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:14:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 14:14:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:14:44 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:14:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43877809
Fri 17 Jan 2014 14:14:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:14:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43877809
Fri 17 Jan 2014 14:14:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:14:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:14:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:14:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:14:53 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:14:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:14:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:14:54 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:14:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:14:54 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:14:54 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:14:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:14:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:14:57 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:14:57 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:14:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:14:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:14:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:14:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43882893
Fri 17 Jan 2014 14:14:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:14:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:14:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:14:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:14:59 - job_xml_thread(): Done retrieving: data size 43882893
Fri 17 Jan 2014 14:14:59 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:14:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:14:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43882893
Fri 17 Jan 2014 14:14:59 - XML: Start document: iteration 8
Fri 17 Jan 2014 14:14:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:15:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:15:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:15:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:15:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:15:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:15:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:15:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:15:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:15:14 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:15:14 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:15:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:15:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:15:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:15:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:15:17 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:15:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:15:17 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:15:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 14:15:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 14:15:17 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:15:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9000 values 141956 bits 17744 bytes 
Fri 17 Jan 2014 14:15:18 - XML: Processed 655606 elements - found 703 jobs
Fri 17 Jan 2014 14:15:18 - job 7348332 appears to have finished
Fri 17 Jan 2014 14:15:18 - job 7348098 appears to have finished
Fri 17 Jan 2014 14:15:18 - job 7348265 field 'start_timestamp' changed since saved from: 1389964313 to: 1389964252
Fri 17 Jan 2014 14:15:18 - job 7348267 field 'start_timestamp' changed since saved from: 1389964362 to: 1389964299
Fri 17 Jan 2014 14:15:18 - job 7348268 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 14:15:18 - job 7347905 appears to have finished
Fri 17 Jan 2014 14:15:18 - job 7348147 appears to have finished
Fri 17 Jan 2014 14:15:18 - job_xml_thread(): Found 7 updated jobs.
Fri 17 Jan 2014 14:15:18 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 14:15:21 - job_xml_thread(): Done storing. succesfully stored: 7 jobs
Fri 17 Jan 2014 14:15:21 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:15:21 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:15:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:15:21 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:15:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:15:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:15:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:15:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:15:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:15:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:15:23 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:15:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 14:15:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:15:23 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:15:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43880665
Fri 17 Jan 2014 14:15:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:15:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43880665
Fri 17 Jan 2014 14:15:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:15:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:15:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:15:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:15:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:15:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:15:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:15:35 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:15:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:15:35 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:15:35 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:15:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:15:36 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:15:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:15:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:15:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:15:37 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:15:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:15:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:15:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:15:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:15:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:15:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:15:40 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:15:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43909163
Fri 17 Jan 2014 14:15:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:15:40 - job_xml_thread(): Done retrieving: data size 43909163
Fri 17 Jan 2014 14:15:40 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:15:40 - XML: Start document: iteration 9
Fri 17 Jan 2014 14:15:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43909163
Fri 17 Jan 2014 14:15:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:15:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:15:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:15:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:15:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:15:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:15:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:15:53 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:15:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:15:53 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:15:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:15:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:15:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:15:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:15:58 - XML: Processed 655606 elements - found 703 jobs
Fri 17 Jan 2014 14:15:58 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 14:15:58 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 14:15:58 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:15:58 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:16:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:16:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:16:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:16:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:16:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:16:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:16:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:16:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:16:03 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:16:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43871606
Fri 17 Jan 2014 14:16:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:16:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43871606
Fri 17 Jan 2014 14:16:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:16:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:16:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:16:13 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:16:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:16:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:16:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:16:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:16:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:16:16 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:16:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:16:16 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:16:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:16:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:16:17 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:16:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:16:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:16:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:16:18 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:16:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 14:16:18 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:16:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 14:16:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148623 bits 18577 bytes 
Fri 17 Jan 2014 14:16:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:16:19 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:16:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:16:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:16:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:16:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:16:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:16:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:16:21 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 14:16:21 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:16:21 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:16:21 - job_xml_thread(): Done retrieving: data size 43888676
Fri 17 Jan 2014 14:16:21 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:16:21 - XML: Start document: iteration 10
Fri 17 Jan 2014 14:16:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43888676
Fri 17 Jan 2014 14:16:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:16:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43888676
Fri 17 Jan 2014 14:16:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:16:23 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:16:24 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:16:24 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 14:16:24 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 14:16:24 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 14:16:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:16:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:16:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:16:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:16:34 - XML: Processed 655604 elements - found 702 jobs
Fri 17 Jan 2014 14:16:34 - job 7348096 appears to have finished
Fri 17 Jan 2014 14:16:34 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 14:16:34 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 14:16:36 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 14:16:36 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:16:36 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:16:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:16:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:16:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:16:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:16:38 - size of cluster 'LISA Cluster': 624 hosts 79469 metrics 848662 values 13389441 bits 1673680 bytes 
Fri 17 Jan 2014 14:16:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:16:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:16:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:16:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:16:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:16:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:16:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:16:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:16:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:16:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:16:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:16:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:16:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:16:44 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:16:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 14:16:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:16:47 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:16:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43876616
Fri 17 Jan 2014 14:16:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:16:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43876616
Fri 17 Jan 2014 14:16:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:16:51 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:16:51 - job_xml_thread(): Done retrieving: data size 43876616
Fri 17 Jan 2014 14:16:51 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:16:51 - XML: Start document: iteration 11
Fri 17 Jan 2014 14:16:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:16:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:16:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:16:58 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:16:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:16:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:16:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:16:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:16:59 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:16:59 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:16:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:16:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:16:59 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:17:07 - XML: Processed 655604 elements - found 702 jobs
Fri 17 Jan 2014 14:17:07 - job 7348269 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 14:17:07 - job 7348268 field 'start_timestamp' changed since saved from: 1389964454 to: 1389964375
Fri 17 Jan 2014 14:17:07 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 14:17:07 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 14:17:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:17:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:17:09 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 14:17:09 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:17:09 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:17:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:17:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:17:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:17:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:17:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:17:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:17:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:17:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873392
Fri 17 Jan 2014 14:17:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:17:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873392
Fri 17 Jan 2014 14:17:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:17:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:17:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:17:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:17:18 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:17:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:17:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 14:17:18 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:17:18 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:17:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 14:17:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8731 values 138170 bits 17271 bytes 
Fri 17 Jan 2014 14:17:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:17:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:17:24 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:17:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:17:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:17:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:17:25 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:17:25 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 14:17:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:17:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:17:25 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:17:25 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:17:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:17:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:17:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:17:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:17:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:17:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:17:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:17:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:17:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:17:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:17:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:17:32 - job_xml_thread(): Done retrieving: data size 43804414
Fri 17 Jan 2014 14:17:32 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:17:32 - XML: Start document: iteration 12
Fri 17 Jan 2014 14:17:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43804414
Fri 17 Jan 2014 14:17:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:17:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43804414
Fri 17 Jan 2014 14:17:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:17:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:17:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:17:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:17:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:17:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:17:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:17:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:17:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:17:53 - XML: Processed 654758 elements - found 702 jobs
Fri 17 Jan 2014 14:17:53 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:17:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:17:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:17:53 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:17:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:17:53 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 14:17:53 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 14:17:53 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:17:53 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:17:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:17:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:17:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:17:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:17:56 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:17:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 14:17:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:17:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:17:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:17:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:17:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:17:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:17:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43218697
Fri 17 Jan 2014 14:17:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:18:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43218697
Fri 17 Jan 2014 14:18:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:18:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:18:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:18:09 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:18:09 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:18:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:18:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:18:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:18:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:18:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:18:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:18:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:18:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:18:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:18:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:18:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:18:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:18:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:18:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:18:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:18:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:18:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:18:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:18:17 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:18:17 - job_xml_thread(): Done retrieving: data size 43275385
Fri 17 Jan 2014 14:18:17 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:18:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43275385
Fri 17 Jan 2014 14:18:17 - XML: Start document: iteration 13
Fri 17 Jan 2014 14:18:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:18:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43275385
Fri 17 Jan 2014 14:18:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:18:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:18:18 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:18:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:18:21 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:18:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 14:18:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 14:18:21 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:18:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9147 values 144644 bits 18080 bytes 
Fri 17 Jan 2014 14:18:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:18:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:18:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:18:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:18:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:18:34 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:18:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:18:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:18:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:18:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:18:36 - XML: Processed 648078 elements - found 702 jobs
Fri 17 Jan 2014 14:18:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:18:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:18:36 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 14:18:36 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 14:18:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:18:36 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:18:37 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:18:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:18:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:18:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:18:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:18:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:18:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:18:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:18:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:18:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:18:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43820988
Fri 17 Jan 2014 14:18:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:18:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43820988
Fri 17 Jan 2014 14:18:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:18:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:18:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:18:52 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:18:52 - job_xml_thread(): Done retrieving: data size 43820988
Fri 17 Jan 2014 14:18:52 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:18:52 - XML: Start document: iteration 14
Fri 17 Jan 2014 14:18:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:18:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:18:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:18:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:19:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:19:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:19:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:19:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:19:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:19:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:19:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:19:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:19:03 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:19:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:19:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:19:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:19:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:19:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:19:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:19:05 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:19:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 14:19:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:19:06 - XML: Processed 654915 elements - found 703 jobs
Fri 17 Jan 2014 14:19:06 - job 7348113 appears to have finished
Fri 17 Jan 2014 14:19:06 - job 7348269 field 'start_timestamp' changed since saved from: 1389964591 to: 1389964536
Fri 17 Jan 2014 14:19:06 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 14:19:06 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 14:19:06 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 14:19:06 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:19:06 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:19:10 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:19:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43900615
Fri 17 Jan 2014 14:19:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:19:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43900615
Fri 17 Jan 2014 14:19:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:19:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:19:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:19:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:19:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:19:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:19:21 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:19:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:19:21 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:19:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 14:19:21 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:19:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:19:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 14:19:21 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:19:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5886 values 92888 bits 11611 bytes 
Fri 17 Jan 2014 14:19:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:19:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:19:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:19:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:19:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:19:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:19:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:19:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:19:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:19:26 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:19:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:19:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:19:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:19:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:19:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:19:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:19:29 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:19:29 - job_xml_thread(): Done retrieving: data size 43861740
Fri 17 Jan 2014 14:19:29 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:19:29 - XML: Start document: iteration 15
Fri 17 Jan 2014 14:19:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43861740
Fri 17 Jan 2014 14:19:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:19:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43861740
Fri 17 Jan 2014 14:19:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:19:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:19:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:19:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:19:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:19:42 - XML: Processed 655606 elements - found 703 jobs
Fri 17 Jan 2014 14:19:43 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 14:19:43 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 14:19:43 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:19:43 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:19:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:19:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:19:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:19:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:19:51 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:19:51 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:19:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:19:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:19:51 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:19:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:19:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:19:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:19:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:19:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:19:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:19:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:19:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:19:54 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:19:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 14:19:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:19:54 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 14:19:54 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 14:19:54 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:19:56 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:19:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43896363
Fri 17 Jan 2014 14:19:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:19:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43896363
Fri 17 Jan 2014 14:19:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:19:58 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:19:58 - job_xml_thread(): Done retrieving: data size 43896363
Fri 17 Jan 2014 14:19:58 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:19:58 - XML: Start document: iteration 16
Fri 17 Jan 2014 14:20:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:20:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:20:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:20:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:20:13 - XML: Processed 655606 elements - found 703 jobs
Fri 17 Jan 2014 14:20:13 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 14:20:13 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 14:20:13 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:20:14 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:20:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:20:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:20:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:20:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:20:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:20:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:20:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:20:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:20:15 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:20:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:20:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:20:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:20:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:20:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:20:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:20:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:20:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:20:21 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:20:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43888026
Fri 17 Jan 2014 14:20:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:20:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43888026
Fri 17 Jan 2014 14:20:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:20:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:20:22 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:20:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:20:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 14:20:22 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:20:22 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:20:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 14:20:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8801 values 138825 bits 17353 bytes 
Fri 17 Jan 2014 14:20:29 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:20:29 - job_xml_thread(): Done retrieving: data size 43888026
Fri 17 Jan 2014 14:20:29 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:20:29 - XML: Start document: iteration 17
Fri 17 Jan 2014 14:20:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:20:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:20:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:20:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:20:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:20:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:20:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:20:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:20:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:20:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:20:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:20:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:20:34 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:20:42 - XML: Processed 655606 elements - found 703 jobs
Fri 17 Jan 2014 14:20:42 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 14:20:42 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 14:20:42 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:20:42 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:20:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:20:44 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:20:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:20:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:20:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:20:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:20:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:20:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:20:46 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:20:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851156
Fri 17 Jan 2014 14:20:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:20:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851156
Fri 17 Jan 2014 14:20:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:20:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:20:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:20:57 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:20:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:20:58 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:20:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 14:20:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:20:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:20:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:20:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:20:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:20:59 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:20:59 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:20:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:20:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:21:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:21:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:21:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:21:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:21:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:21:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:21:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:21:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:21:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:21:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:21:03 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:21:03 - job_xml_thread(): Done retrieving: data size 43874432
Fri 17 Jan 2014 14:21:03 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:21:03 - XML: Start document: iteration 18
Fri 17 Jan 2014 14:21:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43874432
Fri 17 Jan 2014 14:21:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:21:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43874432
Fri 17 Jan 2014 14:21:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:21:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:21:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:21:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:21:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:21:21 - XML: Processed 655606 elements - found 703 jobs
Fri 17 Jan 2014 14:21:21 - job 7348240 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 14:21:21 - job 7348326 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 14:21:22 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 14:21:22 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 14:21:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:21:23 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:21:25 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:21:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:21:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:21:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 14:21:25 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:21:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6224 values 98191 bits 12273 bytes 
Fri 17 Jan 2014 14:21:25 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:21:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 14:21:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:21:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:21:25 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 14:21:25 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:21:25 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:21:26 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:21:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:21:26 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:21:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:21:26 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:21:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:21:27 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:21:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:21:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:21:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:21:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:21:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:21:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:21:29 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:21:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43891230
Fri 17 Jan 2014 14:21:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:21:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43891230
Fri 17 Jan 2014 14:21:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:21:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:21:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:21:41 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:21:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:21:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:21:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:21:42 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:21:42 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:21:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:21:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:21:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:21:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:21:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:21:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:21:43 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:21:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 14:21:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:21:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:21:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:21:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:21:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:21:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:21:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:21:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:21:45 - job_xml_thread(): Done retrieving: data size 43872999
Fri 17 Jan 2014 14:21:45 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:21:45 - XML: Start document: iteration 19
Fri 17 Jan 2014 14:21:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43872999
Fri 17 Jan 2014 14:21:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43872999
Fri 17 Jan 2014 14:21:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:21:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:21:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:21:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:21:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:22:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:22:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:22:01 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:22:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:22:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:22:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:22:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:22:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:22:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:22:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:22:05 - XML: Processed 655606 elements - found 703 jobs
Fri 17 Jan 2014 14:22:05 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 14:22:05 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 14:22:05 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:22:05 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:22:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:22:08 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:22:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:22:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:22:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:22:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:22:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:22:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:22:10 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:22:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43898899
Fri 17 Jan 2014 14:22:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:22:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43898899
Fri 17 Jan 2014 14:22:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:22:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:22:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:22:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:22:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:22:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:22:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:22:20 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:22:20 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:22:20 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:22:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:22:20 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:22:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:22:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:22:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:22:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:22:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:22:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:22:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:22:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:22:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:22:24 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:22:24 - job_xml_thread(): Done retrieving: data size 43909159
Fri 17 Jan 2014 14:22:24 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:22:24 - XML: Start document: iteration 20
Fri 17 Jan 2014 14:22:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43909159
Fri 17 Jan 2014 14:22:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:22:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:22:25 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:22:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43909159
Fri 17 Jan 2014 14:22:27 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:22:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:22:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 14:22:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:22:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 14:22:28 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:22:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9267 values 146209 bits 18276 bytes 
Fri 17 Jan 2014 14:22:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:22:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:22:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:22:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:22:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:22:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:22:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:22:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:22:45 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:22:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:22:45 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:22:45 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:22:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:22:46 - XML: Processed 655600 elements - found 700 jobs
Fri 17 Jan 2014 14:22:46 - job 7341398 appears to have finished
Fri 17 Jan 2014 14:22:46 - job 7347906 appears to have finished
Fri 17 Jan 2014 14:22:46 - job 7346162 appears to have finished
Fri 17 Jan 2014 14:22:46 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 14:22:46 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 14:22:47 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 14:22:47 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:22:47 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:22:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:22:49 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:22:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:22:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:22:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:22:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:22:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:22:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:22:51 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:22:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43891852
Fri 17 Jan 2014 14:22:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:22:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43891852
Fri 17 Jan 2014 14:22:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:22:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:22:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:23:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:23:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:23:01 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:23:01 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:23:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:23:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:23:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43891852
Fri 17 Jan 2014 14:23:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:23:02 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:23:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:23:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:23:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:23:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:23:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:23:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:23:13 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:23:13 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:23:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 14:23:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:23:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:23:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:23:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:23:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:23:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:23:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:23:15 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:23:15 - job_xml_thread(): Done retrieving: data size 43846973
Fri 17 Jan 2014 14:23:15 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:23:15 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 14:23:15 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 14:23:15 - Housekeeping: done.
Fri 17 Jan 2014 14:23:15 - XML: Start document: iteration 0
Fri 17 Jan 2014 14:23:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43846973
Fri 17 Jan 2014 14:23:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:23:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:23:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:23:17 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:23:17 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:23:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:23:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:23:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43846973
Fri 17 Jan 2014 14:23:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:23:25 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 14:23:25 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:23:27 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:23:27 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 14:23:27 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:23:27 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 14:23:27 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 14:23:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:23:28 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:23:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:23:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:23:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:23:29 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:23:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 14:23:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 14:23:29 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:23:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6184 values 97546 bits 12193 bytes 
Fri 17 Jan 2014 14:23:30 - size of cluster 'LISA Cluster': 624 hosts 79460 metrics 769139 values 12143515 bits 1517939 bytes 
Fri 17 Jan 2014 14:23:32 - XML: Processed 655524 elements - found 702 jobs
Fri 17 Jan 2014 14:23:32 - job 7348335 report time 1389964792 does not match current heartbeat 1389964913 : ignoring job
Fri 17 Jan 2014 14:23:32 - job 7347909 report time 1389964792 does not match current heartbeat 1389964913 : ignoring job
Fri 17 Jan 2014 14:23:32 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 14:23:32 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 14:23:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:23:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:23:33 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 14:23:33 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:23:33 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:23:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:23:36 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:23:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:23:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:23:37 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:23:37 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:23:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:23:37 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:23:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:23:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:23:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:23:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:23:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:23:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:23:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:23:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:23:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:23:43 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:23:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 14:23:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:23:44 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:23:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43274282
Fri 17 Jan 2014 14:23:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:23:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43274282
Fri 17 Jan 2014 14:23:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:23:49 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:23:49 - job_xml_thread(): Done retrieving: data size 43274282
Fri 17 Jan 2014 14:23:49 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:23:49 - XML: Start document: iteration 1
Fri 17 Jan 2014 14:23:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:23:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:23:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:23:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:23:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:23:58 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:23:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:23:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:23:59 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:23:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:23:59 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:23:59 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:23:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:24:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:24:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:24:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:24:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:24:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:24:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:24:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:24:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:24:08 - XML: Processed 648112 elements - found 702 jobs
Fri 17 Jan 2014 14:24:08 - job 7348335 report time 1389964792 does not match current heartbeat 1389964913 : ignoring job
Fri 17 Jan 2014 14:24:08 - job 7347909 report time 1389964792 does not match current heartbeat 1389964913 : ignoring job
Fri 17 Jan 2014 14:24:08 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 14:24:08 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 14:24:08 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:24:08 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:24:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:24:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43225152
Fri 17 Jan 2014 14:24:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:24:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43225152
Fri 17 Jan 2014 14:24:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:24:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:24:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:24:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:24:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:24:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:24:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:24:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:24:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:24:23 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:24:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:24:23 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:24:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:24:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:24:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:24:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:24:26 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:24:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:24:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:24:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:24:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:24:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:24:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:24:28 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:24:28 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 14:24:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:24:29 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:24:29 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:24:29 - job_xml_thread(): Done retrieving: data size 43463014
Fri 17 Jan 2014 14:24:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43463014
Fri 17 Jan 2014 14:24:29 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:24:29 - XML: Start document: iteration 2
Fri 17 Jan 2014 14:24:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:24:29 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:24:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 14:24:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:24:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 14:24:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43463014
Fri 17 Jan 2014 14:24:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:24:30 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:24:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99035 bits 12379 bytes 
Fri 17 Jan 2014 14:24:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:24:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:24:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:24:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:24:46 - XML: Processed 650537 elements - found 700 jobs
Fri 17 Jan 2014 14:24:46 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 14:24:46 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 14:24:46 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:24:46 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:24:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:24:53 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:24:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:24:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:24:53 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:24:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:24:53 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:24:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:24:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:24:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:24:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:24:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:24:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:24:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:24:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:24:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:24:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:24:57 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:24:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873792
Fri 17 Jan 2014 14:24:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:24:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873792
Fri 17 Jan 2014 14:24:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:25:01 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:25:01 - job_xml_thread(): Done retrieving: data size 43873792
Fri 17 Jan 2014 14:25:02 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:25:02 - XML: Start document: iteration 3
Fri 17 Jan 2014 14:25:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:25:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:25:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:25:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:25:10 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:25:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 14:25:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:25:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:25:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:25:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:25:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:25:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:25:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:25:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:25:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:25:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:25:21 - XML: Processed 655426 elements - found 700 jobs
Fri 17 Jan 2014 14:25:21 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 14:25:21 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 14:25:21 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:25:21 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:25:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:25:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:25:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:25:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:25:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:25:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:25:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:25:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:25:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:25:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43893524
Fri 17 Jan 2014 14:25:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:25:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43893524
Fri 17 Jan 2014 14:25:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:25:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:25:30 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:25:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:25:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 14:25:32 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:25:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6137 values 96788 bits 12098 bytes 
Fri 17 Jan 2014 14:25:32 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:25:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 14:25:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:25:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:25:36 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:25:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:25:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:25:36 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:25:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:25:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:25:37 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:25:37 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:25:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:25:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:25:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:25:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:25:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:25:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:25:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:25:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:25:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:25:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:25:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:25:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:25:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:25:45 - job_xml_thread(): Done retrieving: data size 43866191
Fri 17 Jan 2014 14:25:45 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:25:45 - XML: Start document: iteration 4
Fri 17 Jan 2014 14:25:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43866191
Fri 17 Jan 2014 14:25:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43866191
Fri 17 Jan 2014 14:25:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:25:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:25:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:25:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:25:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:25:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:26:03 - XML: Processed 655600 elements - found 700 jobs
Fri 17 Jan 2014 14:26:03 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 14:26:03 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 14:26:03 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:26:03 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:26:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:26:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:26:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:26:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:26:04 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:26:04 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:26:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:26:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:26:05 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:26:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:26:08 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:26:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:26:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:26:08 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:26:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 14:26:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:26:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:26:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:26:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:26:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:26:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:26:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43908195
Fri 17 Jan 2014 14:26:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:26:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43908195
Fri 17 Jan 2014 14:26:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:26:19 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:26:19 - job_xml_thread(): Done retrieving: data size 43908195
Fri 17 Jan 2014 14:26:19 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:26:19 - XML: Start document: iteration 5
Fri 17 Jan 2014 14:26:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:26:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:26:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:26:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:26:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:26:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:26:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:26:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:26:26 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:26:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:26:26 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:26:26 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:26:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:26:31 - XML: Processed 655600 elements - found 700 jobs
Fri 17 Jan 2014 14:26:31 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 14:26:31 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 14:26:31 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:26:31 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:26:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:26:32 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:26:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:26:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:26:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:26:32 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:26:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:26:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:26:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:26:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:26:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:26:32 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:26:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 14:26:32 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:26:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5855 values 92330 bits 11541 bytes 
Fri 17 Jan 2014 14:26:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 14:26:33 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 14:26:33 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 14:26:33 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:26:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:26:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870540
Fri 17 Jan 2014 14:26:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:26:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870540
Fri 17 Jan 2014 14:26:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:26:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:26:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:26:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:26:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:26:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:26:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:26:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:26:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:26:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:26:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:26:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:26:46 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:26:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:26:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:26:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:26:48 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:26:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:26:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:26:49 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:26:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 14:26:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:26:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:26:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:26:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:26:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:26:50 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:26:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43890464
Fri 17 Jan 2014 14:26:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:26:50 - job_xml_thread(): Done retrieving: data size 43890464
Fri 17 Jan 2014 14:26:50 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:26:51 - XML: Start document: iteration 6
Fri 17 Jan 2014 14:26:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43890464
Fri 17 Jan 2014 14:26:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:27:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:27:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:27:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:27:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:27:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:27:07 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:27:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:27:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:27:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:27:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:27:09 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:27:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:27:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:27:10 - XML: Processed 655600 elements - found 700 jobs
Fri 17 Jan 2014 14:27:11 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 14:27:11 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 14:27:11 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:27:11 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:27:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:27:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:27:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:27:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:27:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:27:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:27:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:27:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:27:16 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:27:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43885222
Fri 17 Jan 2014 14:27:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:27:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43885222
Fri 17 Jan 2014 14:27:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:27:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:27:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:27:26 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:27:26 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:27:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:27:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:27:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:27:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:27:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:27:27 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:27:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:27:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:27:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:27:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:27:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:27:30 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:27:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:27:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:27:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:27:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:27:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:27:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:27:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:27:32 - job_xml_thread(): Done retrieving: data size 43880076
Fri 17 Jan 2014 14:27:32 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:27:32 - XML: Start document: iteration 7
Fri 17 Jan 2014 14:27:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43880076
Fri 17 Jan 2014 14:27:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43880076
Fri 17 Jan 2014 14:27:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:27:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:27:33 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:27:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:27:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:27:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 14:27:34 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:27:34 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:27:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 14:27:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8745 values 137918 bits 17239 bytes 
Fri 17 Jan 2014 14:27:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:27:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:27:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:27:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:27:52 - XML: Processed 655600 elements - found 700 jobs
Fri 17 Jan 2014 14:27:52 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 14:27:52 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 14:27:52 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:27:52 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:27:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:27:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:27:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:27:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:27:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:27:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:27:52 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:27:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:27:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:27:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:27:55 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:27:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:27:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:27:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:27:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:27:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:27:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:27:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:27:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43900357
Fri 17 Jan 2014 14:27:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:27:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43900357
Fri 17 Jan 2014 14:27:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:28:07 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:28:07 - job_xml_thread(): Done retrieving: data size 43900357
Fri 17 Jan 2014 14:28:07 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:28:07 - XML: Start document: iteration 8
Fri 17 Jan 2014 14:28:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:28:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:28:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:28:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:28:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:28:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:28:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:28:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:28:12 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:28:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:28:12 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:28:12 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:28:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:28:15 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:28:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 14:28:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:28:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:28:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:28:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:28:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:28:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:28:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:28:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:28:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:28:19 - XML: Processed 655600 elements - found 700 jobs
Fri 17 Jan 2014 14:28:19 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 14:28:19 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 14:28:19 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:28:19 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:28:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:28:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43866368
Fri 17 Jan 2014 14:28:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:28:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43866368
Fri 17 Jan 2014 14:28:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:28:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:28:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:28:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:28:31 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:28:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:28:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:28:32 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:28:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:28:32 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:28:32 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:28:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:28:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:28:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:28:34 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:28:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:28:34 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:28:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:28:35 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:28:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:28:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:28:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:28:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 14:28:35 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:28:35 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:28:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6037 values 95231 bits 11903 bytes 
Fri 17 Jan 2014 14:28:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 14:28:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:28:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:28:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:28:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:28:37 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:28:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43894005
Fri 17 Jan 2014 14:28:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:28:37 - job_xml_thread(): Done retrieving: data size 43894005
Fri 17 Jan 2014 14:28:37 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:28:37 - XML: Start document: iteration 9
Fri 17 Jan 2014 14:28:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43894005
Fri 17 Jan 2014 14:28:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:28:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:28:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:28:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:28:50 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:28:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:28:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:28:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:28:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:28:51 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:28:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:28:51 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:28:51 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:28:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:29:00 - XML: Processed 655590 elements - found 695 jobs
Fri 17 Jan 2014 14:29:00 - job 7348123 appears to have finished
Fri 17 Jan 2014 14:29:00 - job 7347862 appears to have finished
Fri 17 Jan 2014 14:29:00 - job 7348130 appears to have finished
Fri 17 Jan 2014 14:29:00 - job 7348266 appears to have finished
Fri 17 Jan 2014 14:29:00 - job 7347869 appears to have finished
Fri 17 Jan 2014 14:29:00 - job_xml_thread(): Found 5 updated jobs.
Fri 17 Jan 2014 14:29:00 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 14:29:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:29:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:29:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:29:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:29:00 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Fri 17 Jan 2014 14:29:00 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:29:00 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:29:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:29:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:29:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:29:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:29:01 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:29:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 14:29:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:29:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:29:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858023
Fri 17 Jan 2014 14:29:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:29:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43858023
Fri 17 Jan 2014 14:29:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:29:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:29:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:29:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:29:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:29:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:29:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:29:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:29:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:29:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:29:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:29:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:29:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:29:15 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:29:15 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:29:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:29:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:29:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:29:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:29:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:29:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:29:17 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:29:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43808334
Fri 17 Jan 2014 14:29:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:29:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43808334
Fri 17 Jan 2014 14:29:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:29:18 - job_xml_thread(): Done retrieving: data size 43808334
Fri 17 Jan 2014 14:29:18 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:29:18 - XML: Start document: iteration 10
Fri 17 Jan 2014 14:29:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:29:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:29:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:29:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:29:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:29:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:29:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:29:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:29:32 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:29:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:29:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:29:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:29:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:29:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:29:35 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:29:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:29:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 14:29:36 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:29:36 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:29:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 14:29:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8009 values 126237 bits 15779 bytes 
Fri 17 Jan 2014 14:29:37 - XML: Processed 654842 elements - found 695 jobs
Fri 17 Jan 2014 14:29:37 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 14:29:37 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 14:29:37 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:29:37 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:29:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:29:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:29:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:29:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:29:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:29:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:29:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:29:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:29:43 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:29:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 14:29:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:29:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:29:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43323213
Fri 17 Jan 2014 14:29:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:29:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43323213
Fri 17 Jan 2014 14:29:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:29:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:29:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:29:52 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:29:52 - job_xml_thread(): Done retrieving: data size 43323213
Fri 17 Jan 2014 14:29:52 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:29:52 - XML: Start document: iteration 11
Fri 17 Jan 2014 14:29:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:29:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:29:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:29:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:29:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:29:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:29:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:29:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:29:56 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:29:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:29:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:30:02 - XML: Processed 648662 elements - found 695 jobs
Fri 17 Jan 2014 14:30:02 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 14:30:02 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 14:30:02 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:30:02 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:30:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:30:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:30:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:30:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:30:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:30:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:30:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:30:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:30:07 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:30:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43201338
Fri 17 Jan 2014 14:30:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:30:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43201338
Fri 17 Jan 2014 14:30:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:30:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:30:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:30:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:30:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:30:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:30:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:30:18 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:30:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:30:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:30:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:30:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:30:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:30:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:30:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:30:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:30:21 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:30:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:30:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:30:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:30:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:30:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:30:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:30:23 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:30:23 - job_xml_thread(): Done retrieving: data size 43288669
Fri 17 Jan 2014 14:30:23 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:30:23 - XML: Start document: iteration 12
Fri 17 Jan 2014 14:30:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43288669
Fri 17 Jan 2014 14:30:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43288669
Fri 17 Jan 2014 14:30:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:30:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:30:28 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 14:30:28 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:30:28 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:30:28 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:30:28 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 14:30:28 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 14:30:28 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 14:30:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:30:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:30:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:30:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:30:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:30:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:30:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:30:36 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:30:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:30:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:30:37 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:30:37 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:30:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:30:37 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:30:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:30:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:30:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 14:30:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 14:30:37 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:30:38 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:30:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9279 values 146392 bits 18299 bytes 
Fri 17 Jan 2014 14:30:42 - size of cluster 'LISA Cluster': 624 hosts 79482 metrics 910508 values 14359971 bits 1794996 bytes 
Fri 17 Jan 2014 14:30:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:30:44 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:30:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:30:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:30:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:30:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:30:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:30:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:30:45 - XML: Processed 648124 elements - found 688 jobs
Fri 17 Jan 2014 14:30:45 - job 7347870 appears to have finished
Fri 17 Jan 2014 14:30:45 - job 7348184 appears to have finished
Fri 17 Jan 2014 14:30:45 - job 7347864 appears to have finished
Fri 17 Jan 2014 14:30:45 - job 7348137 appears to have finished
Fri 17 Jan 2014 14:30:45 - job 7348140 appears to have finished
Fri 17 Jan 2014 14:30:45 - job 7348078 appears to have finished
Fri 17 Jan 2014 14:30:45 - job 7347861 appears to have finished
Fri 17 Jan 2014 14:30:45 - job_xml_thread(): Found 7 updated jobs.
Fri 17 Jan 2014 14:30:45 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 14:30:45 - job_xml_thread(): Done storing. succesfully stored: 7 jobs
Fri 17 Jan 2014 14:30:45 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:30:45 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:30:48 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:30:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 14:30:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:30:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:30:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43809499
Fri 17 Jan 2014 14:30:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:30:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43809499
Fri 17 Jan 2014 14:30:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:30:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:30:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:30:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:30:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:30:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:30:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:31:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:31:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:31:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:31:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:31:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:31:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:31:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:31:00 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:31:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:31:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:31:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:31:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:31:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:31:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:31:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:31:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:31:07 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:31:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43874139
Fri 17 Jan 2014 14:31:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:31:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43874139
Fri 17 Jan 2014 14:31:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:31:07 - job_xml_thread(): Done retrieving: data size 43874139
Fri 17 Jan 2014 14:31:07 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:31:07 - XML: Start document: iteration 13
Fri 17 Jan 2014 14:31:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:31:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:31:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:31:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:31:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:31:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:31:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:31:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:31:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:31:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:31:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:31:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:31:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:31:28 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:31:28 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 14:31:28 - XML: Processed 655578 elements - found 689 jobs
Fri 17 Jan 2014 14:31:28 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 14:31:28 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 14:31:29 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 14:31:29 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:31:29 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:31:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:31:31 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:31:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:31:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:31:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:31:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:31:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:31:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:31:34 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:31:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43842747
Fri 17 Jan 2014 14:31:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:31:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:31:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43842747
Fri 17 Jan 2014 14:31:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:31:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:31:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:31:38 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:31:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:31:38 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:31:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 14:31:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 14:31:38 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:31:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148775 bits 18596 bytes 
Fri 17 Jan 2014 14:31:44 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:31:44 - job_xml_thread(): Done retrieving: data size 43842747
Fri 17 Jan 2014 14:31:44 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:31:44 - XML: Start document: iteration 14
Fri 17 Jan 2014 14:31:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:31:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:31:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:31:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:31:45 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:31:45 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:31:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:31:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:31:45 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:31:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:31:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:31:58 - XML: Processed 655578 elements - found 689 jobs
Fri 17 Jan 2014 14:31:58 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 14:31:58 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 14:31:58 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:31:58 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:31:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:31:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:31:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:31:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:31:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:31:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:31:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:31:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:32:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:32:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:32:02 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:32:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 14:32:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:32:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:32:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43848613
Fri 17 Jan 2014 14:32:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:32:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43848613
Fri 17 Jan 2014 14:32:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:32:13 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:32:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:32:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:32:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:32:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:32:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:32:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:32:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:32:16 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:32:16 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:32:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:32:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:32:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:32:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:32:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:32:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:32:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:32:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:32:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:32:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:32:22 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:32:22 - job_xml_thread(): Done retrieving: data size 43873103
Fri 17 Jan 2014 14:32:22 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:32:22 - XML: Start document: iteration 15
Fri 17 Jan 2014 14:32:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873103
Fri 17 Jan 2014 14:32:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:32:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873103
Fri 17 Jan 2014 14:32:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:32:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:32:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:32:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:32:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:32:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:32:38 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:32:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:32:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 14:32:40 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:32:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 14:32:40 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:32:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99391 bits 12423 bytes 
Fri 17 Jan 2014 14:32:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:32:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:32:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:32:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:32:44 - XML: Processed 655578 elements - found 689 jobs
Fri 17 Jan 2014 14:32:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:32:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:32:44 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:32:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:32:44 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 14:32:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:32:44 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 14:32:44 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:32:44 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:32:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:32:46 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:32:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:32:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:32:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:32:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:32:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:32:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:32:51 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:32:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43876064
Fri 17 Jan 2014 14:32:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:32:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43876064
Fri 17 Jan 2014 14:32:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:32:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:32:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:32:59 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:32:59 - job_xml_thread(): Done retrieving: data size 43876064
Fri 17 Jan 2014 14:32:59 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:32:59 - XML: Start document: iteration 16
Fri 17 Jan 2014 14:33:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:33:00 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:33:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:33:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:33:01 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:33:01 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:33:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:33:01 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:33:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:33:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:33:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:33:07 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:33:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 14:33:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:33:13 - XML: Processed 655572 elements - found 686 jobs
Fri 17 Jan 2014 14:33:13 - job 7347866 appears to have finished
Fri 17 Jan 2014 14:33:13 - job 7347863 appears to have finished
Fri 17 Jan 2014 14:33:13 - job 7348086 appears to have finished
Fri 17 Jan 2014 14:33:13 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 14:33:13 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 14:33:14 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 14:33:14 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:33:14 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:33:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:33:15 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:33:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:33:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:33:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:33:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:33:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:33:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:33:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:33:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:33:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:33:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43845722
Fri 17 Jan 2014 14:33:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:33:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43845722
Fri 17 Jan 2014 14:33:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:33:29 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:33:29 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:33:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:33:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:33:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:33:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:33:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:33:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:33:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:33:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:33:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:33:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:33:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:33:34 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:33:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:33:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:33:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:33:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:33:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:33:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:33:38 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:33:38 - job_xml_thread(): Done retrieving: data size 43873367
Fri 17 Jan 2014 14:33:38 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:33:38 - XML: Start document: iteration 17
Fri 17 Jan 2014 14:33:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873367
Fri 17 Jan 2014 14:33:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:33:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873367
Fri 17 Jan 2014 14:33:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:33:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:33:41 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:33:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:33:45 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:33:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 14:33:45 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:33:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 14:33:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8987 values 142003 bits 17750 bytes 
Fri 17 Jan 2014 14:33:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:33:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:33:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:33:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:33:53 - XML: Processed 655572 elements - found 686 jobs
Fri 17 Jan 2014 14:33:53 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 14:33:54 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 14:33:54 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:33:54 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:33:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:33:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:33:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:33:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:33:56 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:33:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:33:56 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:33:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:33:56 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:34:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:34:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:34:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:34:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:34:00 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 14:34:00 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 14:34:00 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:34:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:34:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:34:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:34:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:34:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:34:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43871693
Fri 17 Jan 2014 14:34:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:34:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43871693
Fri 17 Jan 2014 14:34:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:34:09 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:34:09 - job_xml_thread(): Done retrieving: data size 43871693
Fri 17 Jan 2014 14:34:09 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:34:09 - XML: Start document: iteration 18
Fri 17 Jan 2014 14:34:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:34:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:34:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:34:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:34:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:34:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:34:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:34:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:34:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:34:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:34:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:34:19 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:34:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:34:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:34:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 14:34:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:34:23 - XML: Processed 655572 elements - found 686 jobs
Fri 17 Jan 2014 14:34:23 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 14:34:23 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 14:34:23 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:34:23 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:34:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:34:25 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:34:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:34:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:34:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:34:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:34:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:34:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:34:26 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:34:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43887566
Fri 17 Jan 2014 14:34:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:34:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43887566
Fri 17 Jan 2014 14:34:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:34:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:34:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:34:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:34:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:34:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:34:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:34:38 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:34:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:34:39 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:34:39 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:34:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:34:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:34:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:34:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:34:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:34:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:34:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:34:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:34:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:34:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:34:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:34:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:34:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:34:43 - job_xml_thread(): Done retrieving: data size 43904190
Fri 17 Jan 2014 14:34:43 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:34:43 - XML: Start document: iteration 19
Fri 17 Jan 2014 14:34:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43904190
Fri 17 Jan 2014 14:34:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43904190
Fri 17 Jan 2014 14:34:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:34:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:34:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:34:46 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:34:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:34:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 14:34:48 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:34:48 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:34:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 14:34:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9244 values 145852 bits 18231 bytes 
Fri 17 Jan 2014 14:34:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:34:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:34:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:34:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:34:58 - XML: Processed 655568 elements - found 684 jobs
Fri 17 Jan 2014 14:34:58 - job 7348188 appears to have finished
Fri 17 Jan 2014 14:34:58 - job 7348338 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 14:34:58 - job 7348243 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 14:34:58 - job 7347949 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 14:34:58 - job 7348150 appears to have finished
Fri 17 Jan 2014 14:34:58 - job 7348278 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 14:34:58 - job 7348279 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 14:34:58 - job 7348276 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 14:34:58 - job 7348277 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 14:34:58 - job 7348274 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 14:34:58 - job 7348275 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 14:34:58 - job 7348272 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 14:34:58 - job 7348273 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 14:34:58 - job 7348270 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 14:34:58 - job 7348271 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 14:34:58 - job 7348283 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 14:34:58 - job 7348281 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 14:34:58 - job 7348280 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 14:34:58 - job 7348282 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 14:34:58 - job 7348341 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 14:34:58 - job_xml_thread(): Found 20 updated jobs.
Fri 17 Jan 2014 14:34:58 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 14:35:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:35:03 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:35:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:35:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:35:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:35:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:35:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:35:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:35:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:35:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:35:06 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:35:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:35:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:35:06 - job_xml_thread(): Done storing. succesfully stored: 20 jobs
Fri 17 Jan 2014 14:35:06 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:35:06 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:35:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:35:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:35:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:35:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:35:08 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:35:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43881509
Fri 17 Jan 2014 14:35:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:35:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43881509
Fri 17 Jan 2014 14:35:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:35:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:35:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:35:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:35:21 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:35:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:35:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:35:21 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:35:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:35:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:35:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:35:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:35:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:35:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:35:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:35:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:35:23 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:35:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:35:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:35:23 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:35:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 14:35:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:35:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:35:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:35:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:35:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:35:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:35:25 - job_xml_thread(): Done retrieving: data size 43831177
Fri 17 Jan 2014 14:35:25 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:35:25 - XML: Start document: iteration 20
Fri 17 Jan 2014 14:35:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43831177
Fri 17 Jan 2014 14:35:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:35:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43831177
Fri 17 Jan 2014 14:35:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:35:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:35:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:35:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:35:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:35:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:35:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:35:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:35:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:35:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:35:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:35:44 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:35:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:35:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:35:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:35:48 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:35:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:35:48 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:35:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:35:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:35:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:35:49 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:35:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 14:35:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 14:35:49 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:35:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5976 values 94250 bits 11781 bytes 
Fri 17 Jan 2014 14:35:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:35:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:35:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:35:49 - XML: Processed 654820 elements - found 684 jobs
Fri 17 Jan 2014 14:35:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:35:49 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 14:35:49 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 14:35:49 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:35:49 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:35:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:35:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43238611
Fri 17 Jan 2014 14:35:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:35:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43238611
Fri 17 Jan 2014 14:35:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:36:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:36:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:36:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:36:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:36:04 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:36:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:36:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:36:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:36:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:36:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:36:06 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:36:06 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:36:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:36:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:36:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:36:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:36:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:36:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:36:08 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:36:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 14:36:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:36:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:36:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:36:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:36:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:36:09 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:36:09 - job_xml_thread(): Done retrieving: data size 43235328
Fri 17 Jan 2014 14:36:09 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:36:09 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 14:36:09 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 14:36:09 - Housekeeping: done.
Fri 17 Jan 2014 14:36:09 - XML: Start document: iteration 0
Fri 17 Jan 2014 14:36:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43235328
Fri 17 Jan 2014 14:36:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43235328
Fri 17 Jan 2014 14:36:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:36:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:36:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:36:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:36:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:36:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:36:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:36:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:36:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:36:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:36:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:36:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:36:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:36:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:36:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:36:28 - XML: Processed 647368 elements - found 684 jobs
Fri 17 Jan 2014 14:36:28 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 14:36:28 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 14:36:28 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:36:28 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:36:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:36:31 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:36:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:36:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:36:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:36:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:36:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:36:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:36:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:36:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43637129
Fri 17 Jan 2014 14:36:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:36:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43637129
Fri 17 Jan 2014 14:36:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:36:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:36:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:36:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:36:41 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:36:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:36:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:36:42 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:36:42 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:36:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:36:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:36:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43637129
Fri 17 Jan 2014 14:36:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:36:43 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:36:43 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:36:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:36:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:36:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:36:49 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:36:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:36:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 14:36:50 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:36:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8687 values 136962 bits 17120 bytes 
Fri 17 Jan 2014 14:36:50 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:36:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 14:36:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:36:50 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:36:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:36:52 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:36:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:36:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:36:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:36:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:36:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:36:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:36:54 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:36:54 - job_xml_thread(): Done retrieving: data size 43819878
Fri 17 Jan 2014 14:36:54 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:36:54 - XML: Start document: iteration 1
Fri 17 Jan 2014 14:36:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43819878
Fri 17 Jan 2014 14:36:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:36:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:36:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:36:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:36:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:36:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:36:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:36:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43819878
Fri 17 Jan 2014 14:36:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:37:03 - XML: Processed 654904 elements - found 683 jobs
Fri 17 Jan 2014 14:37:03 - job 7348124 appears to have finished
Fri 17 Jan 2014 14:37:03 - job 7348108 appears to have finished
Fri 17 Jan 2014 14:37:03 - job 7348292 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 14:37:04 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 14:37:04 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 14:37:06 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 14:37:06 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:37:06 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:37:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:37:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:37:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:37:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:37:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:37:13 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:37:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:37:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:37:14 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:37:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:37:14 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:37:14 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:37:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:37:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:37:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:37:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:37:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:37:16 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:37:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 14:37:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:37:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:37:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:37:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:37:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:37:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:37:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873998
Fri 17 Jan 2014 14:37:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:37:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873998
Fri 17 Jan 2014 14:37:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:37:21 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:37:22 - job_xml_thread(): Done retrieving: data size 43873998
Fri 17 Jan 2014 14:37:22 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:37:22 - XML: Start document: iteration 2
Fri 17 Jan 2014 14:37:28 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 14:37:29 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:37:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:37:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:37:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:37:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:37:30 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:37:30 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 14:37:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:37:30 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:37:30 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 14:37:30 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 14:37:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:37:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:37:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:37:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:37:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:37:32 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:37:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:37:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:37:33 - size of cluster 'LISA Cluster': 624 hosts 79469 metrics 859904 values 13584865 bits 1698108 bytes 
Fri 17 Jan 2014 14:37:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:37:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:37:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:37:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:37:43 - XML: Processed 655566 elements - found 683 jobs
Fri 17 Jan 2014 14:37:43 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 14:37:43 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 14:37:43 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:37:43 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:37:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:37:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:37:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:37:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:37:46 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:37:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43863048
Fri 17 Jan 2014 14:37:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:37:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43863048
Fri 17 Jan 2014 14:37:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:37:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:37:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:37:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:37:50 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:37:52 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:37:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 14:37:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:37:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 14:37:52 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:37:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8852 values 139704 bits 17463 bytes 
Fri 17 Jan 2014 14:37:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:37:56 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:37:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:37:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:37:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:37:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:37:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:37:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:37:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:37:58 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:37:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:37:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:38:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:38:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:38:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:38:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:38:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:38:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:38:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:38:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:38:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:38:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867691
Fri 17 Jan 2014 14:38:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:38:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43867691
Fri 17 Jan 2014 14:38:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:38:06 - job_xml_thread(): Done retrieving: data size 43867691
Fri 17 Jan 2014 14:38:06 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:38:06 - XML: Start document: iteration 3
Fri 17 Jan 2014 14:38:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:38:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:38:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:38:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:38:22 - XML: Processed 655566 elements - found 683 jobs
Fri 17 Jan 2014 14:38:22 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 14:38:22 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 14:38:22 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:38:22 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:38:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:38:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:38:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:38:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:38:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:38:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:38:27 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:38:27 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:38:27 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:38:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 14:38:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:38:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:38:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:38:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:38:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:38:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:38:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:38:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:38:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:38:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:38:31 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:38:31 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 14:38:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:38:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43884777
Fri 17 Jan 2014 14:38:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:38:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43884777
Fri 17 Jan 2014 14:38:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:38:37 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:38:37 - job_xml_thread(): Done retrieving: data size 43884777
Fri 17 Jan 2014 14:38:37 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:38:37 - XML: Start document: iteration 4
Fri 17 Jan 2014 14:38:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:38:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:38:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:38:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:38:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:38:48 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:38:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:38:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:38:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:38:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:38:49 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:38:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:38:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:38:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:38:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:38:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:38:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:38:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:38:52 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:38:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:38:53 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:38:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 14:38:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 14:38:53 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:38:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:38:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:38:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:38:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:38:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6026 values 95054 bits 11881 bytes 
Fri 17 Jan 2014 14:38:53 - XML: Processed 655566 elements - found 683 jobs
Fri 17 Jan 2014 14:38:53 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 14:38:53 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 14:38:53 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:38:53 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:38:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:38:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43891156
Fri 17 Jan 2014 14:38:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:38:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43891156
Fri 17 Jan 2014 14:38:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:39:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:39:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:39:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:39:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:39:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:39:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:39:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:39:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:39:09 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:39:09 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:39:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:39:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:39:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:39:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:39:12 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:39:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 14:39:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:39:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:39:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:39:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:39:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:39:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:39:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:39:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:39:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:39:17 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:39:17 - job_xml_thread(): Done retrieving: data size 43868312
Fri 17 Jan 2014 14:39:17 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:39:17 - XML: Start document: iteration 5
Fri 17 Jan 2014 14:39:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43868312
Fri 17 Jan 2014 14:39:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:39:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43868312
Fri 17 Jan 2014 14:39:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:39:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:39:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:39:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:39:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:39:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:39:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:39:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:39:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:39:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:39:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:39:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:39:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:39:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:39:39 - XML: Processed 655566 elements - found 683 jobs
Fri 17 Jan 2014 14:39:39 - job 7348062 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 14:39:39 - job 7347912 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 14:39:39 - job 7347910 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 14:39:39 - job 7347911 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 14:39:39 - job 7348294 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 14:39:39 - job 7348342 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 14:39:39 - job_xml_thread(): Found 6 updated jobs.
Fri 17 Jan 2014 14:39:39 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 14:39:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:39:40 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:39:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:39:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:39:41 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Fri 17 Jan 2014 14:39:41 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:39:41 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:39:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:39:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:39:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:39:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:39:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:39:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43881179
Fri 17 Jan 2014 14:39:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:39:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43881179
Fri 17 Jan 2014 14:39:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:39:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:39:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:39:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:39:53 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:39:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:39:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:39:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:39:53 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:39:53 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:39:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:39:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:39:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:39:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43881179
Fri 17 Jan 2014 14:39:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:39:53 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:39:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:39:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 14:39:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 14:39:53 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:39:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8933 values 140906 bits 17613 bytes 
Fri 17 Jan 2014 14:39:56 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:39:56 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:39:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:39:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:40:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:40:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:40:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:40:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:40:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:40:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:40:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:40:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:40:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:40:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:40:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:40:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:40:08 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:40:08 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:40:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:40:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:40:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:40:11 - job_xml_thread(): Done retrieving: data size 43856579
Fri 17 Jan 2014 14:40:11 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:40:11 - XML: Start document: iteration 6
Fri 17 Jan 2014 14:40:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43856579
Fri 17 Jan 2014 14:40:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856579
Fri 17 Jan 2014 14:40:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:40:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:40:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:40:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:40:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:40:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:40:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:40:27 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:40:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:40:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:40:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:40:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:40:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:40:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:40:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:40:29 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:40:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 14:40:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:40:31 - XML: Processed 655566 elements - found 683 jobs
Fri 17 Jan 2014 14:40:31 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 14:40:31 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 14:40:31 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:40:31 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:40:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:40:35 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:40:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:40:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:40:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:40:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:40:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:40:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:40:38 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:40:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43857912
Fri 17 Jan 2014 14:40:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:40:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43857912
Fri 17 Jan 2014 14:40:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:40:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:40:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:40:46 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:40:46 - job_xml_thread(): Done retrieving: data size 43857912
Fri 17 Jan 2014 14:40:46 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:40:46 - XML: Start document: iteration 7
Fri 17 Jan 2014 14:40:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:40:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:40:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:40:54 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:40:54 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:40:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 14:40:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:40:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 14:40:54 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:40:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:40:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5874 values 92675 bits 11584 bytes 
Fri 17 Jan 2014 14:40:54 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:40:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:40:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:40:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:40:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:40:55 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:40:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:40:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:41:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:41:01 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:41:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:41:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:41:01 - XML: Processed 655562 elements - found 681 jobs
Fri 17 Jan 2014 14:41:01 - job 7347949 appears to have finished
Fri 17 Jan 2014 14:41:01 - job 7348062 field 'start_timestamp' changed since saved from: 1389965887 to: 1389965841
Fri 17 Jan 2014 14:41:01 - job 7347912 field 'start_timestamp' changed since saved from: 1389965902 to: 1389965841
Fri 17 Jan 2014 14:41:01 - job 7347910 field 'start_timestamp' changed since saved from: 1389965898 to: 1389965841
Fri 17 Jan 2014 14:41:01 - job 7347911 field 'start_timestamp' changed since saved from: 1389965900 to: 1389965841
Fri 17 Jan 2014 14:41:01 - job 7348294 field 'start_timestamp' changed since saved from: 1389965901 to: 1389965841
Fri 17 Jan 2014 14:41:01 - job 7348295 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 14:41:01 - job 7348296 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 14:41:01 - job 7348344 appears to have finished
Fri 17 Jan 2014 14:41:01 - job_xml_thread(): Found 9 updated jobs.
Fri 17 Jan 2014 14:41:01 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 14:41:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:41:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:41:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:41:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:41:02 - job_xml_thread(): Done storing. succesfully stored: 9 jobs
Fri 17 Jan 2014 14:41:02 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:41:02 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:41:05 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:41:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 14:41:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:41:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:41:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43854130
Fri 17 Jan 2014 14:41:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:41:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43854130
Fri 17 Jan 2014 14:41:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:41:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:41:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:41:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:41:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:41:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:41:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:41:16 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:41:16 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:41:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:41:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:41:16 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:41:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:41:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:41:17 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:41:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:41:20 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:41:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:41:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:41:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:41:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:41:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:41:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:41:23 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:41:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43807613
Fri 17 Jan 2014 14:41:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:41:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43807613
Fri 17 Jan 2014 14:41:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:41:24 - job_xml_thread(): Done retrieving: data size 43807613
Fri 17 Jan 2014 14:41:24 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:41:24 - XML: Start document: iteration 8
Fri 17 Jan 2014 14:41:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:41:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:41:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:41:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:41:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:41:41 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:41:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:41:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:41:42 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:41:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:41:42 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:41:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:41:42 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:41:44 - XML: Processed 654814 elements - found 681 jobs
Fri 17 Jan 2014 14:41:44 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 14:41:44 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 14:41:44 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:41:44 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:41:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:41:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:41:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:41:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:41:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:41:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:41:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:41:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:41:47 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 14:41:47 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 14:41:47 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:41:48 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:41:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43255751
Fri 17 Jan 2014 14:41:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:41:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43255751
Fri 17 Jan 2014 14:41:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:41:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:41:55 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:41:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:41:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 14:41:55 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:41:55 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:41:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148570 bits 18571 bytes 
Fri 17 Jan 2014 14:41:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 14:41:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:41:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:41:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:41:58 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:41:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:41:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:41:59 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:41:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:41:59 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:41:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:41:59 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:41:59 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:42:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:42:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:42:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:42:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:42:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:42:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:42:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:42:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:42:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:42:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:42:04 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:42:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 14:42:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:42:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:42:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43205794
Fri 17 Jan 2014 14:42:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:42:05 - job_xml_thread(): Done retrieving: data size 43205794
Fri 17 Jan 2014 14:42:05 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:42:05 - XML: Start document: iteration 9
Fri 17 Jan 2014 14:42:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43205794
Fri 17 Jan 2014 14:42:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:42:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:42:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:42:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:42:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:42:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:42:21 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:42:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:42:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:42:23 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:42:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:42:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:42:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:42:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:42:26 - XML: Processed 647360 elements - found 681 jobs
Fri 17 Jan 2014 14:42:26 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 14:42:26 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 14:42:27 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:42:27 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:42:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:42:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:42:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:42:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:42:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:42:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:42:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:42:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:42:30 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:42:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43405123
Fri 17 Jan 2014 14:42:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:42:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43405123
Fri 17 Jan 2014 14:42:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:42:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:42:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:42:42 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:42:42 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:42:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:42:42 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:42:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:42:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:42:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:42:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:42:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:42:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:42:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:42:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:42:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:42:44 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:42:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:42:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:42:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:42:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:42:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:42:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:42:46 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:42:46 - job_xml_thread(): Done retrieving: data size 43796985
Fri 17 Jan 2014 14:42:46 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:42:46 - XML: Start document: iteration 10
Fri 17 Jan 2014 14:42:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43796985
Fri 17 Jan 2014 14:42:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:42:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43796985
Fri 17 Jan 2014 14:42:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:42:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:42:55 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:42:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:42:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 14:42:56 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:42:56 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:42:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 14:42:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148648 bits 18581 bytes 
Fri 17 Jan 2014 14:42:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:42:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:42:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:42:58 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:42:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:42:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:42:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:42:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:42:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:42:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:42:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:43:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:43:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:43:08 - XML: Processed 654504 elements - found 680 jobs
Fri 17 Jan 2014 14:43:08 - job 7347867 appears to have finished
Fri 17 Jan 2014 14:43:08 - job 7347868 appears to have finished
Fri 17 Jan 2014 14:43:08 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 14:43:08 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 14:43:08 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 14:43:08 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:43:08 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:43:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:43:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:43:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:43:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:43:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:43:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:43:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:43:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:43:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:43:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43854120
Fri 17 Jan 2014 14:43:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:43:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43854120
Fri 17 Jan 2014 14:43:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:43:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:43:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:43:23 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:43:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:43:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:43:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:43:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:43:27 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:43:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:43:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:43:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:43:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:43:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:43:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:43:28 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:43:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 14:43:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:43:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:43:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:43:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:43:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:43:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:43:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:43:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:43:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:43:29 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:43:29 - job_xml_thread(): Done retrieving: data size 43880541
Fri 17 Jan 2014 14:43:29 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:43:29 - XML: Start document: iteration 11
Fri 17 Jan 2014 14:43:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43880541
Fri 17 Jan 2014 14:43:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:43:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43880541
Fri 17 Jan 2014 14:43:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:43:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:43:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:43:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:43:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:43:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:43:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:43:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:43:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:43:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:43:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:43:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:43:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:43:49 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:43:49 - XML: Processed 655560 elements - found 680 jobs
Fri 17 Jan 2014 14:43:49 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 14:43:49 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 14:43:49 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:43:49 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:43:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:43:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:43:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:43:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:43:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:43:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:43:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:43:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:43:53 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:43:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873228
Fri 17 Jan 2014 14:43:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:43:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873228
Fri 17 Jan 2014 14:43:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:43:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:43:56 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:43:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:43:57 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:43:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 14:43:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 14:43:58 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:43:59 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9244 values 145796 bits 18224 bytes 
Fri 17 Jan 2014 14:44:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:44:00 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:44:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:44:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:44:04 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:44:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:44:04 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:44:04 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:44:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:44:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:44:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:44:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:44:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:44:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:44:07 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:44:07 - job_xml_thread(): Done retrieving: data size 43881306
Fri 17 Jan 2014 14:44:07 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:44:07 - XML: Start document: iteration 12
Fri 17 Jan 2014 14:44:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43881306
Fri 17 Jan 2014 14:44:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:44:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:44:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:44:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:44:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:44:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43881306
Fri 17 Jan 2014 14:44:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:44:19 - XML: Processed 655560 elements - found 680 jobs
Fri 17 Jan 2014 14:44:19 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 14:44:19 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 14:44:19 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:44:19 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:44:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:44:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:44:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:44:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:44:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:44:29 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:44:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:44:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:44:30 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:44:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:44:30 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:44:30 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:44:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:44:31 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 14:44:31 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:44:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:44:31 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:44:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:44:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:44:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:44:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:44:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:44:31 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:44:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:44:31 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 14:44:31 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:44:31 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 14:44:31 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 14:44:32 - size of cluster 'LISA Cluster': 624 hosts 79487 metrics 854858 values 13488507 bits 1686063 bytes 
Fri 17 Jan 2014 14:44:33 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:44:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 14:44:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:44:34 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:44:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:44:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873662
Fri 17 Jan 2014 14:44:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:44:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873662
Fri 17 Jan 2014 14:44:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:44:36 - job_xml_thread(): Done retrieving: data size 43873662
Fri 17 Jan 2014 14:44:36 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:44:36 - XML: Start document: iteration 13
Fri 17 Jan 2014 14:44:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:44:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:44:46 - XML: Processed 655560 elements - found 680 jobs
Fri 17 Jan 2014 14:44:46 - job 7347865 appears to have finished
Fri 17 Jan 2014 14:44:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:44:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:44:46 - job 7348297 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 14:44:46 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 14:44:46 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 14:44:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:44:49 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:44:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:44:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:44:50 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 14:44:50 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:44:50 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:44:50 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:44:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:44:50 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:44:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:44:51 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:44:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:44:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:44:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:44:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:44:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:44:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:44:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:44:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:44:57 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:44:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43883858
Fri 17 Jan 2014 14:44:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:44:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43883858
Fri 17 Jan 2014 14:44:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:44:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:44:58 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:45:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:45:00 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:45:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 14:45:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 14:45:00 - Entering storeMetrics(): cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Fri 17 Jan 2014 14:45:05 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:45:05 - job_xml_thread(): Done retrieving: data size 43883858
Fri 17 Jan 2014 14:45:05 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:45:05 - XML: Start document: iteration 14
Fri 17 Jan 2014 14:45:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:45:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:45:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:45:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:45:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:45:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:45:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:45:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:45:12 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:45:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:45:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:45:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:45:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:45:15 - XML: Processed 655560 elements - found 680 jobs
Fri 17 Jan 2014 14:45:15 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 14:45:15 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 14:45:15 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:45:15 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:45:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:45:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:45:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:45:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:45:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:45:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:45:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:45:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:45:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:45:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43859576
Fri 17 Jan 2014 14:45:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:45:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43859576
Fri 17 Jan 2014 14:45:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:45:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:45:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:45:30 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:45:30 - job_xml_thread(): Done retrieving: data size 43859576
Fri 17 Jan 2014 14:45:30 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:45:30 - XML: Start document: iteration 15
Fri 17 Jan 2014 14:45:31 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:45:31 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 14:45:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:45:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:45:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:45:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:45:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:45:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:45:35 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:45:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:45:35 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:45:35 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:45:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:45:40 - XML: Processed 655560 elements - found 680 jobs
Fri 17 Jan 2014 14:45:40 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 14:45:40 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 14:45:40 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:45:40 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:45:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:45:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:45:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:45:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:45:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:45:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:45:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:45:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:45:47 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:45:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873677
Fri 17 Jan 2014 14:45:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:45:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873677
Fri 17 Jan 2014 14:45:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:45:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:45:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:45:55 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:45:55 - job_xml_thread(): Done retrieving: data size 43873677
Fri 17 Jan 2014 14:45:55 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:45:55 - XML: Start document: iteration 16
Fri 17 Jan 2014 14:45:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:45:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:45:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:45:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:45:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:45:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:46:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:46:00 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:46:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:46:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:46:01 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:46:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:46:01 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:46:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:46:01 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:46:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 14:46:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 14:46:01 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:46:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 14943 values 235641 bits 29455 bytes 
Fri 17 Jan 2014 14:46:04 - XML: Processed 655556 elements - found 680 jobs
Fri 17 Jan 2014 14:46:04 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 14:46:04 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 14:46:04 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:46:04 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:46:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:46:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:46:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:46:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:46:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:46:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:46:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:46:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:46:10 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:46:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43872331
Fri 17 Jan 2014 14:46:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:46:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43872331
Fri 17 Jan 2014 14:46:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:46:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:46:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:46:19 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:46:19 - job_xml_thread(): Done retrieving: data size 43872331
Fri 17 Jan 2014 14:46:19 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:46:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:46:19 - XML: Start document: iteration 17
Fri 17 Jan 2014 14:46:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:46:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:46:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:46:20 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:46:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:46:20 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:46:20 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:46:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:46:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:46:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:46:27 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:46:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 14:46:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:46:30 - XML: Processed 655560 elements - found 680 jobs
Fri 17 Jan 2014 14:46:30 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 14:46:30 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 14:46:30 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:46:30 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:46:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:46:33 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:46:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:46:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:46:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:46:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:46:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:46:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:46:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:46:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:46:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:46:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43847479
Fri 17 Jan 2014 14:46:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:46:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43847479
Fri 17 Jan 2014 14:46:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:46:45 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:46:45 - job_xml_thread(): Done retrieving: data size 43847479
Fri 17 Jan 2014 14:46:45 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:46:45 - XML: Start document: iteration 18
Fri 17 Jan 2014 14:46:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:46:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:46:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:46:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:46:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:46:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:46:53 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:46:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:46:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:46:53 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:46:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:46:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:46:55 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:46:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:46:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:46:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:46:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:46:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:46:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:46:58 - XML: Processed 655562 elements - found 681 jobs
Fri 17 Jan 2014 14:46:58 - job 7348300 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 14:46:58 - job 7348304 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 14:46:58 - job 7348298 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 14:46:58 - job 7348299 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 14:46:58 - job_xml_thread(): Found 5 updated jobs.
Fri 17 Jan 2014 14:46:58 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 14:46:58 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Fri 17 Jan 2014 14:46:58 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:46:58 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:47:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:47:01 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:47:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:47:01 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:47:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 14:47:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 14:47:01 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:47:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5744 values 90781 bits 11347 bytes 
Fri 17 Jan 2014 14:47:01 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:47:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43886175
Fri 17 Jan 2014 14:47:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:47:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43886175
Fri 17 Jan 2014 14:47:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:47:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:47:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:47:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:47:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:47:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:47:13 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:47:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:47:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:47:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:47:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:47:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:47:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:47:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:47:13 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:47:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:47:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:47:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:47:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:47:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:47:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:47:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:47:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:47:21 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:47:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 14:47:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:47:22 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:47:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43798782
Fri 17 Jan 2014 14:47:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:47:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43798782
Fri 17 Jan 2014 14:47:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:47:23 - job_xml_thread(): Done retrieving: data size 43798782
Fri 17 Jan 2014 14:47:23 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:47:23 - XML: Start document: iteration 19
Fri 17 Jan 2014 14:47:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:47:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:47:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:47:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:47:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:47:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:47:40 - XML: Processed 654812 elements - found 680 jobs
Fri 17 Jan 2014 14:47:40 - job 7347708 appears to have finished
Fri 17 Jan 2014 14:47:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:47:40 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 14:47:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:47:40 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 14:47:41 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 14:47:41 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:47:41 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:47:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:47:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:47:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:47:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:47:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:47:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:47:45 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:47:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:47:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:47:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:47:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:47:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:47:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:47:47 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:47:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43261672
Fri 17 Jan 2014 14:47:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:47:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43261672
Fri 17 Jan 2014 14:47:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:47:56 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:47:56 - job_xml_thread(): Done retrieving: data size 43261672
Fri 17 Jan 2014 14:47:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:47:56 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:47:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:47:57 - XML: Start document: iteration 20
Fri 17 Jan 2014 14:47:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:47:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:47:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:47:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:48:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:48:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:48:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:48:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:48:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:48:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:48:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:48:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:48:02 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:48:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:48:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 14:48:02 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:48:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6344 values 100353 bits 12544 bytes 
Fri 17 Jan 2014 14:48:02 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:48:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 14:48:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:48:08 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:48:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:48:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:48:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:48:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:48:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:48:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:48:10 - XML: Processed 647850 elements - found 680 jobs
Fri 17 Jan 2014 14:48:10 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 14:48:10 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 14:48:10 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:48:10 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:48:12 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 14:48:12 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 14:48:12 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:48:13 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:48:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 14:48:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:48:14 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:48:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43201033
Fri 17 Jan 2014 14:48:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:48:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43201033
Fri 17 Jan 2014 14:48:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:48:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:48:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:48:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:48:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:48:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:48:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:48:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:48:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:48:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:48:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:48:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:48:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:48:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:48:25 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:48:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:48:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:48:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:48:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:48:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:48:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:48:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:48:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:48:29 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:48:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43296484
Fri 17 Jan 2014 14:48:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:48:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43296484
Fri 17 Jan 2014 14:48:30 - job_xml_thread(): Done retrieving: data size 43296484
Fri 17 Jan 2014 14:48:30 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:48:30 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 14:48:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:48:32 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 14:48:32 - Housekeeping: done.
Fri 17 Jan 2014 14:48:32 - XML: Start document: iteration 0
Fri 17 Jan 2014 14:48:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:48:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:48:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:48:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:48:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:48:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:48:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:48:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:48:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:48:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:48:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:48:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:48:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:48:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:48:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:48:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:48:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:48:52 - XML: Processed 648098 elements - found 675 jobs
Fri 17 Jan 2014 14:48:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:48:52 - job 7348187 appears to have finished
Fri 17 Jan 2014 14:48:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:48:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:48:52 - job 7348152 appears to have finished
Fri 17 Jan 2014 14:48:52 - job 7348279 appears to have finished
Fri 17 Jan 2014 14:48:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:48:52 - job 7348273 appears to have finished
Fri 17 Jan 2014 14:48:52 - job 7348346 appears to have finished
Fri 17 Jan 2014 14:48:52 - job_xml_thread(): Found 5 updated jobs.
Fri 17 Jan 2014 14:48:52 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 14:48:52 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Fri 17 Jan 2014 14:48:52 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:48:52 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:48:54 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:48:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43812668
Fri 17 Jan 2014 14:48:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:48:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43812668
Fri 17 Jan 2014 14:48:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:48:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:48:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:49:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:49:03 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:49:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:49:04 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:49:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 14:49:04 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:49:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 14:49:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9127 values 144199 bits 18024 bytes 
Fri 17 Jan 2014 14:49:07 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:49:07 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:49:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:49:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:49:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:49:09 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:49:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:49:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:49:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:49:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:49:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:49:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:49:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:49:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:49:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:49:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:49:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:49:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:49:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:49:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:49:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:49:13 - job_xml_thread(): Done retrieving: data size 43887453
Fri 17 Jan 2014 14:49:13 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:49:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43887453
Fri 17 Jan 2014 14:49:13 - XML: Start document: iteration 1
Fri 17 Jan 2014 14:49:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:49:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43887453
Fri 17 Jan 2014 14:49:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:49:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:49:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:49:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:49:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:49:26 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:49:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:49:26 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:49:26 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:49:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:49:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:49:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:49:35 - XML: Processed 655550 elements - found 675 jobs
Fri 17 Jan 2014 14:49:35 - job 7348244 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 14:49:35 - job 7348327 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 14:49:35 - job 7348306 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 14:49:35 - job 7348305 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 14:49:35 - job 7348299 field 'start_timestamp' changed since saved from: 1389966361 to: 1389966308
Fri 17 Jan 2014 14:49:35 - job 7348347 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 14:49:35 - job_xml_thread(): Found 6 updated jobs.
Fri 17 Jan 2014 14:49:35 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 14:49:35 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:49:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 14:49:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:49:36 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Fri 17 Jan 2014 14:49:36 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:49:36 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:49:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:49:37 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:49:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:49:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:49:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:49:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:49:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:49:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:49:38 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:49:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43849353
Fri 17 Jan 2014 14:49:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:49:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43849353
Fri 17 Jan 2014 14:49:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:49:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:49:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:49:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:49:48 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:49:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:49:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:49:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:49:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:49:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:49:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:49:50 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:49:51 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:49:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:49:52 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:49:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:49:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:49:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:49:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:49:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:49:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:49:54 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:49:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43886889
Fri 17 Jan 2014 14:49:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:49:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43886889
Fri 17 Jan 2014 14:49:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:49:54 - job_xml_thread(): Done retrieving: data size 43886889
Fri 17 Jan 2014 14:49:54 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:49:54 - XML: Start document: iteration 2
Fri 17 Jan 2014 14:50:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:50:05 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:50:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:50:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:50:05 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:50:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:50:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 14:50:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 14:50:05 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:50:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8955 values 141301 bits 17662 bytes 
Fri 17 Jan 2014 14:50:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:50:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:50:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:50:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:50:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:50:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:50:16 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:50:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:50:16 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:50:16 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:50:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:50:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:50:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:50:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:50:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:50:18 - XML: Processed 655550 elements - found 675 jobs
Fri 17 Jan 2014 14:50:18 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 14:50:18 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 14:50:18 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:50:18 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:50:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:50:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:50:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:50:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:50:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:50:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43874016
Fri 17 Jan 2014 14:50:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:50:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43874016
Fri 17 Jan 2014 14:50:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:50:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:50:29 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:50:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:50:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:50:32 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:50:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:50:32 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:50:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:50:32 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:50:33 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:50:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:50:33 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:50:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:50:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:50:33 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:50:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 14:50:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:50:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:50:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:50:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:50:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:50:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:50:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43878174
Fri 17 Jan 2014 14:50:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:50:35 - job_xml_thread(): Done retrieving: data size 43878174
Fri 17 Jan 2014 14:50:35 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:50:35 - XML: Start document: iteration 3
Fri 17 Jan 2014 14:50:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43878174
Fri 17 Jan 2014 14:50:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:50:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:50:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:50:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:50:48 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:50:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:50:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:50:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:50:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:50:50 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:50:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:50:50 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:50:50 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:50:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:50:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:50:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:50:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:50:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:50:59 - XML: Processed 655540 elements - found 670 jobs
Fri 17 Jan 2014 14:50:59 - job 7348328 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 14:50:59 - job 7348131 appears to have finished
Fri 17 Jan 2014 14:50:59 - job 7348133 appears to have finished
Fri 17 Jan 2014 14:50:59 - job 7348314 appears to have finished
Fri 17 Jan 2014 14:50:59 - job 7348310 appears to have finished
Fri 17 Jan 2014 14:50:59 - job 7348309 appears to have finished
Fri 17 Jan 2014 14:50:59 - job 7348343 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 14:50:59 - job_xml_thread(): Found 7 updated jobs.
Fri 17 Jan 2014 14:50:59 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 14:50:59 - job_xml_thread(): Done storing. succesfully stored: 7 jobs
Fri 17 Jan 2014 14:50:59 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:50:59 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:50:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:50:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:50:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:50:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:51:01 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:51:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43869609
Fri 17 Jan 2014 14:51:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:51:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43869609
Fri 17 Jan 2014 14:51:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:51:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:51:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:51:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:51:05 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:51:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:51:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 14:51:07 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:51:07 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:51:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 14:51:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8746 values 137976 bits 17247 bytes 
Fri 17 Jan 2014 14:51:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:51:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:51:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:51:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:51:11 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:51:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:51:11 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:51:11 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:51:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:51:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:51:14 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:51:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:51:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:51:15 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:51:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:51:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:51:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:51:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:51:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:51:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:51:17 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:51:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875846
Fri 17 Jan 2014 14:51:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:51:18 - job_xml_thread(): Done retrieving: data size 43875846
Fri 17 Jan 2014 14:51:18 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:51:18 - XML: Start document: iteration 4
Fri 17 Jan 2014 14:51:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875846
Fri 17 Jan 2014 14:51:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:51:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:51:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:51:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:51:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:51:31 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 14:51:31 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:51:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:51:31 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:51:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:51:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:51:32 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:51:32 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:51:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:51:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:51:32 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:51:32 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:51:32 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 14:51:32 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 14:51:32 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:51:33 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 14:51:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:51:40 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:51:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:51:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:51:41 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 860454 values 13593830 bits 1699228 bytes 
Fri 17 Jan 2014 14:51:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:51:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:51:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:51:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:51:42 - XML: Processed 655540 elements - found 670 jobs
Fri 17 Jan 2014 14:51:42 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 14:51:42 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 14:51:42 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:51:42 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:51:43 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:51:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 14:51:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:51:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:51:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862520
Fri 17 Jan 2014 14:51:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:51:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862520
Fri 17 Jan 2014 14:51:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:51:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:51:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:51:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:51:54 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:51:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:51:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:51:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:51:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:51:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:51:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:51:55 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:51:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:51:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:51:57 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:51:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:51:59 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:51:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:51:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:51:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:51:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:51:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:51:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:52:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:52:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43883285
Fri 17 Jan 2014 14:52:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:52:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43883285
Fri 17 Jan 2014 14:52:03 - job_xml_thread(): Done retrieving: data size 43883285
Fri 17 Jan 2014 14:52:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:52:03 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:52:03 - XML: Start document: iteration 5
Fri 17 Jan 2014 14:52:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:52:08 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:52:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:52:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 14:52:09 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:52:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8877 values 140002 bits 17500 bytes 
Fri 17 Jan 2014 14:52:09 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:52:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 14:52:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:52:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:52:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:52:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:52:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:52:16 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:52:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:52:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:52:16 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:52:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:52:16 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:52:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:52:17 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:52:24 - XML: Processed 655540 elements - found 670 jobs
Fri 17 Jan 2014 14:52:24 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 14:52:24 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 14:52:24 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:52:24 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:52:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:52:26 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:52:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:52:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:52:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:52:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:52:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:52:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:52:30 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:52:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43863134
Fri 17 Jan 2014 14:52:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:52:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43863134
Fri 17 Jan 2014 14:52:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:52:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:52:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:52:33 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:52:33 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 14:52:39 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:52:39 - job_xml_thread(): Done retrieving: data size 43863134
Fri 17 Jan 2014 14:52:39 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:52:39 - XML: Start document: iteration 6
Fri 17 Jan 2014 14:52:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:52:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:52:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:52:45 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:52:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:52:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:52:47 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:52:47 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:52:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:52:47 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:52:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:52:49 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:52:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 14:52:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:52:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:52:53 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:52:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:52:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:52:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:52:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:52:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:52:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:52:54 - XML: Processed 655540 elements - found 670 jobs
Fri 17 Jan 2014 14:52:54 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 14:52:54 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 14:52:54 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:52:54 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:52:57 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:52:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862831
Fri 17 Jan 2014 14:52:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:52:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862831
Fri 17 Jan 2014 14:52:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:53:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:53:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:53:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:53:07 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:53:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:53:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:53:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:53:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:53:08 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:53:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:53:08 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:53:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:53:08 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:53:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:53:10 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:53:10 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:53:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:53:11 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:53:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 14:53:11 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:53:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5975 values 94275 bits 11784 bytes 
Fri 17 Jan 2014 14:53:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 14:53:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:53:13 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:53:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:53:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:53:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:53:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:53:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:53:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:53:16 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:53:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43808721
Fri 17 Jan 2014 14:53:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:53:17 - job_xml_thread(): Done retrieving: data size 43808721
Fri 17 Jan 2014 14:53:17 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:53:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43808721
Fri 17 Jan 2014 14:53:17 - XML: Start document: iteration 7
Fri 17 Jan 2014 14:53:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:53:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:53:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:53:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:53:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:53:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:53:28 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:53:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:53:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:53:29 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:53:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:53:29 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:53:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:53:29 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:53:38 - XML: Processed 654788 elements - found 668 jobs
Fri 17 Jan 2014 14:53:39 - job 7348339 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 14:53:39 - job 7348088 appears to have finished
Fri 17 Jan 2014 14:53:39 - job 7348251 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 14:53:40 - job 7348211 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 14:53:40 - job 7348212 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 14:53:40 - job 7348192 appears to have finished
Fri 17 Jan 2014 14:53:40 - job 7348345 report time 1389966602 does not match current heartbeat 1389966722 : ignoring job
Fri 17 Jan 2014 14:53:40 - job_xml_thread(): Found 6 updated jobs.
Fri 17 Jan 2014 14:53:40 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 14:53:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:53:40 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:53:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:53:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:53:40 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Fri 17 Jan 2014 14:53:40 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:53:40 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:53:40 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:53:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 14:53:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:53:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:53:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:53:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:53:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:53:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:53:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43325069
Fri 17 Jan 2014 14:53:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:53:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:53:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:53:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43325069
Fri 17 Jan 2014 14:53:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:53:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:53:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:53:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:53:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:53:53 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:53:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:53:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:53:53 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:53:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:53:55 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:53:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:53:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:53:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:53:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:53:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:53:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:53:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:53:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:53:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:53:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:54:01 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:54:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43214583
Fri 17 Jan 2014 14:54:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:54:01 - job_xml_thread(): Done retrieving: data size 43214583
Fri 17 Jan 2014 14:54:01 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:54:01 - XML: Start document: iteration 8
Fri 17 Jan 2014 14:54:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43214583
Fri 17 Jan 2014 14:54:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:54:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:54:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:54:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:54:12 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:54:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:54:12 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:54:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 14:54:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 14:54:13 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:54:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8978 values 141555 bits 17694 bytes 
Fri 17 Jan 2014 14:54:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:54:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:54:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:54:15 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:54:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:54:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:54:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:54:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:54:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:54:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:54:17 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:54:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:54:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:54:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:54:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:54:23 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:54:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:54:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:54:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:54:23 - XML: Processed 647390 elements - found 668 jobs
Fri 17 Jan 2014 14:54:23 - job 7348345 report time 1389966602 does not match current heartbeat 1389966722 : ignoring job
Fri 17 Jan 2014 14:54:23 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 14:54:23 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 14:54:23 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:54:23 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:54:27 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:54:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43260317
Fri 17 Jan 2014 14:54:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:54:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43260317
Fri 17 Jan 2014 14:54:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:54:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:54:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:54:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:54:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:54:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:54:38 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:54:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:54:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:54:38 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:54:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:54:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:54:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:54:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:54:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:54:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:54:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:54:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:54:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:54:43 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:54:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 14:54:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:54:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:54:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:54:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:54:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:54:44 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 14:54:44 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 14:54:44 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:54:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:54:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43784344
Fri 17 Jan 2014 14:54:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:54:45 - job_xml_thread(): Done retrieving: data size 43784344
Fri 17 Jan 2014 14:54:46 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:54:46 - XML: Start document: iteration 9
Fri 17 Jan 2014 14:54:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43784344
Fri 17 Jan 2014 14:54:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:54:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:54:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:54:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:54:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:55:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:55:00 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:55:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:55:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:55:01 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:55:01 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:55:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:55:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:55:01 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:55:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:55:08 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:55:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:55:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:55:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:55:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:55:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:55:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:55:09 - XML: Processed 654456 elements - found 674 jobs
Fri 17 Jan 2014 14:55:09 - job 7345988 appears to have finished
Fri 17 Jan 2014 14:55:09 - job 7348136 appears to have finished
Fri 17 Jan 2014 14:55:09 - job 7348159 appears to have finished
Fri 17 Jan 2014 14:55:09 - job 7348156 appears to have finished
Fri 17 Jan 2014 14:55:09 - job 7348212 field 'start_timestamp' changed since saved from: 1389966727 to: 1389966685
Fri 17 Jan 2014 14:55:09 - job 7348294 appears to have finished
Fri 17 Jan 2014 14:55:09 - job_xml_thread(): Found 18 updated jobs.
Fri 17 Jan 2014 14:55:09 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 14:55:09 - job_xml_thread(): Done storing. succesfully stored: 18 jobs
Fri 17 Jan 2014 14:55:09 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:55:09 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:55:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:55:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43849651
Fri 17 Jan 2014 14:55:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:55:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43849651
Fri 17 Jan 2014 14:55:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:55:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:55:13 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:55:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:55:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 14:55:14 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:55:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 14:55:15 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:55:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9102 values 143573 bits 17946 bytes 
Fri 17 Jan 2014 14:55:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:55:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:55:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:55:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:55:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:55:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:55:23 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:55:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:55:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:55:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:55:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:55:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:55:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:55:24 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:55:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:55:27 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:55:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:55:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:55:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:55:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:55:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:55:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:55:29 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:55:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865592
Fri 17 Jan 2014 14:55:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:55:30 - job_xml_thread(): Done retrieving: data size 43865592
Fri 17 Jan 2014 14:55:30 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:55:30 - XML: Start document: iteration 10
Fri 17 Jan 2014 14:55:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43865592
Fri 17 Jan 2014 14:55:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:55:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:55:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:55:42 - XML: Processed 655548 elements - found 674 jobs
Fri 17 Jan 2014 14:55:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:55:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:55:43 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 14:55:43 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 14:55:43 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:55:43 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:55:45 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:55:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 14:55:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:55:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:55:49 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:55:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:55:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:55:50 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:55:50 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:55:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:55:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:55:51 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:55:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:55:53 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:55:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:55:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:55:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:55:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:55:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:55:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:55:54 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:55:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43880791
Fri 17 Jan 2014 14:55:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:55:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43880791
Fri 17 Jan 2014 14:55:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:55:58 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:55:58 - job_xml_thread(): Done retrieving: data size 43880791
Fri 17 Jan 2014 14:55:58 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:55:58 - XML: Start document: iteration 11
Fri 17 Jan 2014 14:56:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:56:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:56:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:56:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:56:07 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:56:07 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:56:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:56:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:56:07 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:56:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:56:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:56:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:56:14 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:56:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:56:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 14:56:15 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:56:15 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:56:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 14:56:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6177 values 97390 bits 12173 bytes 
Fri 17 Jan 2014 14:56:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:56:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:56:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:56:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:56:17 - XML: Processed 655548 elements - found 674 jobs
Fri 17 Jan 2014 14:56:17 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 14:56:17 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 14:56:17 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:56:17 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:56:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:56:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:56:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:56:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:56:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:56:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43874066
Fri 17 Jan 2014 14:56:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:56:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43874066
Fri 17 Jan 2014 14:56:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:56:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:56:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:56:32 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:56:32 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:56:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:56:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:56:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:56:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:56:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:56:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:56:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:56:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:56:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:56:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:56:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:56:36 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:56:36 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:56:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 14:56:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:56:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:56:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:56:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:56:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:56:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:56:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:56:37 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:56:37 - job_xml_thread(): Done retrieving: data size 43884305
Fri 17 Jan 2014 14:56:37 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:56:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43884305
Fri 17 Jan 2014 14:56:37 - XML: Start document: iteration 12
Fri 17 Jan 2014 14:56:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:56:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43884305
Fri 17 Jan 2014 14:56:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:56:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:56:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:56:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:56:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:56:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:56:53 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:56:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:56:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:56:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:56:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:56:53 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:56:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:56:53 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:56:58 - XML: Processed 655546 elements - found 673 jobs
Fri 17 Jan 2014 14:56:58 - job 7348167 appears to have finished
Fri 17 Jan 2014 14:56:58 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 14:56:58 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 14:56:58 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 14:56:58 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:56:58 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:57:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:57:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:57:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:57:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:57:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:57:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:57:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:57:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:57:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:57:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43878779
Fri 17 Jan 2014 14:57:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:57:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43878779
Fri 17 Jan 2014 14:57:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:57:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:57:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:57:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:57:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:57:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:57:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:57:12 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:57:12 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:57:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:57:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:57:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:57:13 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:57:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:57:15 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:57:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:57:15 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:57:16 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:57:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:57:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 14:57:16 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:57:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 14:57:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8949 values 141128 bits 17641 bytes 
Fri 17 Jan 2014 14:57:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:57:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:57:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:57:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:57:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:57:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:57:17 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:57:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43900200
Fri 17 Jan 2014 14:57:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:57:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43900200
Fri 17 Jan 2014 14:57:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:57:18 - job_xml_thread(): Done retrieving: data size 43900200
Fri 17 Jan 2014 14:57:18 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:57:18 - XML: Start document: iteration 13
Fri 17 Jan 2014 14:57:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:57:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:57:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:57:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:57:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:57:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:57:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:57:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:57:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:57:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:57:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:57:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:57:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:57:38 - XML: Processed 655546 elements - found 673 jobs
Fri 17 Jan 2014 14:57:38 - job 7348360 report time 1389966843 does not match current heartbeat 1389966964 : ignoring job
Fri 17 Jan 2014 14:57:38 - job 7348349 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 14:57:38 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 14:57:38 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 14:57:39 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 14:57:39 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:57:39 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:57:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:57:40 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:57:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:57:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:57:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:57:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:57:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:57:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:57:41 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:57:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 14:57:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:57:42 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:57:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43859683
Fri 17 Jan 2014 14:57:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:57:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43859683
Fri 17 Jan 2014 14:57:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:57:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:57:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:57:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:57:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:57:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:57:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:57:53 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:57:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:57:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:57:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:57:53 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:57:54 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:57:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:57:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:57:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:57:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:57:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:57:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:57:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:57:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:57:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:57:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:57:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:57:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43879393
Fri 17 Jan 2014 14:57:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:57:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43879393
Fri 17 Jan 2014 14:57:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:57:59 - job_xml_thread(): Done retrieving: data size 43879393
Fri 17 Jan 2014 14:57:59 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:57:59 - XML: Start document: iteration 14
Fri 17 Jan 2014 14:58:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:58:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:58:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:58:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:58:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:58:16 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:58:16 - XML: Processed 655546 elements - found 673 jobs
Fri 17 Jan 2014 14:58:16 - job 7348360 report time 1389966843 does not match current heartbeat 1389966964 : ignoring job
Fri 17 Jan 2014 14:58:16 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 14:58:16 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 14:58:16 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:58:16 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:58:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:58:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 14:58:17 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:58:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 14:58:17 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:58:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8021 values 126491 bits 15811 bytes 
Fri 17 Jan 2014 14:58:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:58:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:58:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:58:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:58:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:58:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:58:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:58:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:58:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:58:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:58:21 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:58:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:58:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:58:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:58:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:58:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:58:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:58:24 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:58:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43890393
Fri 17 Jan 2014 14:58:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:58:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43890393
Fri 17 Jan 2014 14:58:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:58:32 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:58:32 - job_xml_thread(): Done retrieving: data size 43890393
Fri 17 Jan 2014 14:58:32 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:58:32 - XML: Start document: iteration 15
Fri 17 Jan 2014 14:58:33 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 14:58:34 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:58:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:58:34 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:58:34 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:58:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:58:34 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 14:58:34 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 14:58:34 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 14:58:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:58:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:58:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:58:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:58:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:58:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:58:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:58:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:58:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:58:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:58:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:58:42 - size of cluster 'LISA Cluster': 624 hosts 79487 metrics 898546 values 14180580 bits 1772572 bytes 
Fri 17 Jan 2014 14:58:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:58:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:58:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:58:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:58:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:58:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:58:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:58:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:58:47 - XML: Processed 655544 elements - found 673 jobs
Fri 17 Jan 2014 14:58:47 - job 7348360 report time 1389966843 does not match current heartbeat 1389966964 : ignoring job
Fri 17 Jan 2014 14:58:47 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 14:58:47 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 14:58:47 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:58:47 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:58:47 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:58:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 14:58:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:58:50 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:58:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43879070
Fri 17 Jan 2014 14:58:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:58:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43879070
Fri 17 Jan 2014 14:58:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:58:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:58:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:58:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:59:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:59:02 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:59:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:59:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:59:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:59:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:59:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:59:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:59:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:59:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:59:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:59:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:59:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:59:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:59:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:59:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:59:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:59:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:59:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:59:08 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:59:08 - job_xml_thread(): Done retrieving: data size 43886731
Fri 17 Jan 2014 14:59:08 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:59:08 - XML: Start document: iteration 16
Fri 17 Jan 2014 14:59:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43886731
Fri 17 Jan 2014 14:59:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43886731
Fri 17 Jan 2014 14:59:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:59:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:59:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:59:17 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:59:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:59:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 14:59:17 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 14:59:17 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:59:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 14:59:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9230 values 145587 bits 18198 bytes 
Fri 17 Jan 2014 14:59:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:59:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:59:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:59:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:59:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:59:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:59:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:59:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:59:25 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:59:25 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:59:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:59:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:59:25 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:59:29 - XML: Processed 655520 elements - found 673 jobs
Fri 17 Jan 2014 14:59:29 - job 7348351 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 14:59:29 - job 7348350 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 14:59:29 - job 7348353 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 14:59:29 - job 7348352 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 14:59:29 - job_xml_thread(): Found 5 updated jobs.
Fri 17 Jan 2014 14:59:29 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 14:59:30 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Fri 17 Jan 2014 14:59:30 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 14:59:30 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 14:59:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:59:32 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:59:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:59:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 14:59:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:59:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 14:59:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 14:59:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 14:59:34 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:59:34 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 14:59:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 14:59:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43673589
Fri 17 Jan 2014 14:59:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 14:59:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43673589
Fri 17 Jan 2014 14:59:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 14:59:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 14:59:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:59:45 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 14:59:45 - job_xml_thread(): Done retrieving: data size 43673589
Fri 17 Jan 2014 14:59:45 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 14:59:45 - XML: Start document: iteration 17
Fri 17 Jan 2014 14:59:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 14:59:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 14:59:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 14:59:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 14:59:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 14:59:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 14:59:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:59:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 14:59:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 14:59:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 14:59:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 14:59:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 14:59:59 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 14:59:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 14:59:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:00:00 - XML: Processed 653232 elements - found 673 jobs
Fri 17 Jan 2014 15:00:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:00:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:00:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:00:00 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:00:00 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:00:00 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:00:00 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:00:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:00:00 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:00:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 15:00:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:00:03 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:00:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43212751
Fri 17 Jan 2014 15:00:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:00:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43212751
Fri 17 Jan 2014 15:00:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:00:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:00:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:00:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:00:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:00:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:00:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:00:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43212751
Fri 17 Jan 2014 15:00:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:00:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:00:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:00:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:00:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:00:15 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:00:15 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:00:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:00:18 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:00:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:00:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 15:00:19 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:00:19 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:00:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6106 values 96334 bits 12041 bytes 
Fri 17 Jan 2014 15:00:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 15:00:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:00:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:00:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:00:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:00:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:00:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:00:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:00:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:00:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:00:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:00:27 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:00:27 - job_xml_thread(): Done retrieving: data size 43246567
Fri 17 Jan 2014 15:00:27 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:00:27 - XML: Start document: iteration 18
Fri 17 Jan 2014 15:00:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43246567
Fri 17 Jan 2014 15:00:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:00:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:00:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:00:29 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:00:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:00:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43246567
Fri 17 Jan 2014 15:00:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:00:29 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:00:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:00:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:00:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:00:40 - XML: Processed 648098 elements - found 673 jobs
Fri 17 Jan 2014 15:00:40 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:00:40 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:00:40 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:00:40 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:00:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:00:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:00:47 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:00:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 15:00:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:00:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:00:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:00:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:00:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:00:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:00:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:00:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:00:48 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:00:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:00:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:00:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:00:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:00:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:00:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:00:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:00:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:00:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:00:53 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:00:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43824180
Fri 17 Jan 2014 15:00:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:00:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43824180
Fri 17 Jan 2014 15:00:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:00:55 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:00:55 - job_xml_thread(): Done retrieving: data size 43824180
Fri 17 Jan 2014 15:00:55 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:00:55 - XML: Start document: iteration 19
Fri 17 Jan 2014 15:01:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:01:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:01:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:01:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:01:14 - XML: Processed 654856 elements - found 669 jobs
Fri 17 Jan 2014 15:01:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:01:14 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:01:14 - job 7348126 appears to have finished
Fri 17 Jan 2014 15:01:14 - job 7348358 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 15:01:14 - job 7348245 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 15:01:14 - job 7348317 appears to have finished
Fri 17 Jan 2014 15:01:14 - job 7348316 appears to have finished
Fri 17 Jan 2014 15:01:14 - job 7348313 appears to have finished
Fri 17 Jan 2014 15:01:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:01:14 - job 7348312 appears to have finished
Fri 17 Jan 2014 15:01:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:01:15 - job 7348318 appears to have finished
Fri 17 Jan 2014 15:01:15 - job 7348351 field 'start_timestamp' changed since saved from: 1389967095 to: 1389967042
Fri 17 Jan 2014 15:01:15 - job 7348361 field 'start_timestamp' changed since saved from: 1389967160 to: 1389967075
Fri 17 Jan 2014 15:01:15 - job 7348289 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 15:01:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:01:15 - job 7348353 field 'start_timestamp' changed since saved from: 1389967099 to: 1389967042
Fri 17 Jan 2014 15:01:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:01:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:01:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:01:15 - job 7348352 field 'start_timestamp' changed since saved from: 1389967097 to: 1389967042
Fri 17 Jan 2014 15:01:15 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:01:15 - job 7348355 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 15:01:15 - job 7348354 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 15:01:15 - job 7348357 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 15:01:15 - job 7348356 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 15:01:15 - job 7348213 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 15:01:15 - job 7348214 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 15:01:15 - job_xml_thread(): Found 21 updated jobs.
Fri 17 Jan 2014 15:01:15 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 15:01:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:01:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:01:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:01:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:01:16 - job_xml_thread(): Done storing. succesfully stored: 21 jobs
Fri 17 Jan 2014 15:01:16 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:01:16 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:01:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:01:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:01:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:01:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:01:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:01:19 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:01:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:01:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43887837
Fri 17 Jan 2014 15:01:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:01:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43887837
Fri 17 Jan 2014 15:01:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:01:20 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:01:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 15:01:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:01:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 15:01:20 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:01:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9200 values 145240 bits 18155 bytes 
Fri 17 Jan 2014 15:01:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:01:27 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:01:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:01:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:01:30 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:01:30 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:01:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:01:30 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:01:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:01:31 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:01:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:01:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:01:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:01:32 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:01:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:01:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:01:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:01:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:01:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:01:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:01:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:01:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43888782
Fri 17 Jan 2014 15:01:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:01:37 - job_xml_thread(): Done retrieving: data size 43888782
Fri 17 Jan 2014 15:01:37 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:01:37 - XML: Start document: iteration 20
Fri 17 Jan 2014 15:01:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43888782
Fri 17 Jan 2014 15:01:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:01:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:01:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:01:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:01:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:01:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:01:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:01:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:01:57 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:01:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:01:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:01:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:01:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:01:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:01:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:01:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:01:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:01:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:01:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:01:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:01:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:01:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:01:59 - XML: Processed 655538 elements - found 669 jobs
Fri 17 Jan 2014 15:01:59 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:01:59 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:01:59 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:01:59 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:01:59 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:01:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 15:01:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:02:01 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 15:02:01 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 15:02:01 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:02:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:02:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43884930
Fri 17 Jan 2014 15:02:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:02:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43884930
Fri 17 Jan 2014 15:02:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:02:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:02:13 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:02:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:02:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:02:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:02:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:02:14 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:02:14 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:02:14 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:02:14 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:02:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:02:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:02:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:02:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:02:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:02:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:02:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:02:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:02:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:02:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:02:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:02:18 - job_xml_thread(): Done retrieving: data size 43892058
Fri 17 Jan 2014 15:02:18 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:02:18 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 15:02:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43892058
Fri 17 Jan 2014 15:02:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:02:19 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 15:02:19 - Housekeeping: done.
Fri 17 Jan 2014 15:02:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43892058
Fri 17 Jan 2014 15:02:19 - XML: Start document: iteration 0
Fri 17 Jan 2014 15:02:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:02:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:02:21 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:02:22 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:02:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:02:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 15:02:22 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:02:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 15:02:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8905 values 140776 bits 17597 bytes 
Fri 17 Jan 2014 15:02:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:02:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:02:29 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:02:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:02:30 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:02:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:02:30 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:02:30 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:02:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:02:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:02:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:02:40 - XML: Processed 655538 elements - found 669 jobs
Fri 17 Jan 2014 15:02:40 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:02:40 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:02:40 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:02:40 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:02:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:02:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:02:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:02:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:02:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:02:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:02:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:02:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:02:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:02:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43841049
Fri 17 Jan 2014 15:02:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:02:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:02:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:02:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43841049
Fri 17 Jan 2014 15:02:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:02:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:02:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:02:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:02:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:02:55 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:02:55 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:02:56 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:02:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:02:56 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:02:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:02:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:02:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:03:00 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:03:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 15:03:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:03:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:03:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:03:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:03:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:03:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:03:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:03:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:03:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:03:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:03:02 - job_xml_thread(): Done retrieving: data size 43876965
Fri 17 Jan 2014 15:03:02 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:03:02 - XML: Start document: iteration 1
Fri 17 Jan 2014 15:03:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43876965
Fri 17 Jan 2014 15:03:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:03:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43876965
Fri 17 Jan 2014 15:03:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:03:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:03:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:03:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:03:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:03:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:03:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:03:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:03:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:03:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:03:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:03:15 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:03:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:03:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:03:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:03:23 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:03:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:03:23 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:03:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:03:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:03:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:03:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 15:03:24 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:03:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 15:03:24 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:03:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5817 values 92026 bits 11503 bytes 
Fri 17 Jan 2014 15:03:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:03:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:03:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:03:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:03:25 - XML: Processed 655524 elements - found 662 jobs
Fri 17 Jan 2014 15:03:25 - job 7348358 field 'start_timestamp' changed since saved from: 1389967244 to: 1389967167
Fri 17 Jan 2014 15:03:25 - job 7348103 appears to have finished
Fri 17 Jan 2014 15:03:25 - job 7348315 appears to have finished
Fri 17 Jan 2014 15:03:25 - job 7348311 appears to have finished
Fri 17 Jan 2014 15:03:25 - job 7348157 appears to have finished
Fri 17 Jan 2014 15:03:25 - job 7348300 appears to have finished
Fri 17 Jan 2014 15:03:25 - job 7348119 appears to have finished
Fri 17 Jan 2014 15:03:25 - job 7344179 appears to have finished
Fri 17 Jan 2014 15:03:25 - job 7348285 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 15:03:25 - job 7348284 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 15:03:25 - job 7348357 field 'start_timestamp' changed since saved from: 1389967242 to: 1389967167
Fri 17 Jan 2014 15:03:25 - job 7348356 field 'start_timestamp' changed since saved from: 1389967240 to: 1389967167
Fri 17 Jan 2014 15:03:25 - job 7348293 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 15:03:25 - job_xml_thread(): Found 13 updated jobs.
Fri 17 Jan 2014 15:03:25 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 15:03:25 - job_xml_thread(): Done storing. succesfully stored: 13 jobs
Fri 17 Jan 2014 15:03:25 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:03:25 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:03:27 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:03:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43844980
Fri 17 Jan 2014 15:03:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:03:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43844980
Fri 17 Jan 2014 15:03:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:03:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:03:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:03:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:03:34 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:03:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:03:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:03:35 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:03:35 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:03:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:03:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:03:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43844980
Fri 17 Jan 2014 15:03:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:03:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:03:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:03:40 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:03:40 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:03:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:03:46 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:03:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:03:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:03:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:03:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:03:48 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:03:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 15:03:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:03:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:03:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:03:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:03:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:03:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:03:49 - job_xml_thread(): Done retrieving: data size 43869973
Fri 17 Jan 2014 15:03:49 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:03:49 - XML: Start document: iteration 2
Fri 17 Jan 2014 15:03:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:03:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43869973
Fri 17 Jan 2014 15:03:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:03:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:03:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:03:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:03:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:03:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43869973
Fri 17 Jan 2014 15:03:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:03:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:04:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:04:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:04:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:04:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:04:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:04:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:04:08 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:04:08 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:04:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:04:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:04:09 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:04:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:04:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:04:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:04:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:04:11 - XML: Processed 655524 elements - found 662 jobs
Fri 17 Jan 2014 15:04:11 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:04:11 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:04:11 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:04:11 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:04:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:04:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:04:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:04:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:04:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:04:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43877425
Fri 17 Jan 2014 15:04:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:04:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43877425
Fri 17 Jan 2014 15:04:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:04:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:04:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:04:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:04:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:04:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:04:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:04:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:04:25 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:04:25 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:04:25 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:04:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:04:25 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:04:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:04:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:04:25 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:04:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 15:04:25 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:04:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 15:04:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9040 values 142753 bits 17844 bytes 
Fri 17 Jan 2014 15:04:26 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:04:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:04:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:04:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:04:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:04:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:04:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:04:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:04:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:04:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:04:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:04:30 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:04:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43879200
Fri 17 Jan 2014 15:04:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:04:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43879200
Fri 17 Jan 2014 15:04:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:04:31 - job_xml_thread(): Done retrieving: data size 43879200
Fri 17 Jan 2014 15:04:31 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:04:31 - XML: Start document: iteration 3
Fri 17 Jan 2014 15:04:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:04:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:04:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:04:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:04:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:04:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:04:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:04:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:04:47 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:04:47 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:04:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:04:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:04:48 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:04:48 - XML: Processed 655524 elements - found 662 jobs
Fri 17 Jan 2014 15:04:48 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:04:48 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:04:48 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:04:48 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:04:52 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:04:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 15:04:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:04:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:04:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:04:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:04:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:04:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:04:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:04:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:04:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:04:56 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:04:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43861810
Fri 17 Jan 2014 15:04:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:04:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43861810
Fri 17 Jan 2014 15:04:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:05:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:05:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:05:03 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:05:03 - job_xml_thread(): Done retrieving: data size 43861810
Fri 17 Jan 2014 15:05:04 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:05:04 - XML: Start document: iteration 4
Fri 17 Jan 2014 15:05:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:05:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:05:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:05:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:05:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:05:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:05:11 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:05:11 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:05:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:05:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:05:11 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:05:16 - XML: Processed 655516 elements - found 658 jobs
Fri 17 Jan 2014 15:05:16 - job 7348182 appears to have finished
Fri 17 Jan 2014 15:05:16 - job 7347916 appears to have finished
Fri 17 Jan 2014 15:05:16 - job 7348287 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 15:05:16 - job 7348286 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 15:05:16 - job 7348211 appears to have finished
Fri 17 Jan 2014 15:05:16 - job 7348165 appears to have finished
Fri 17 Jan 2014 15:05:16 - job_xml_thread(): Found 6 updated jobs.
Fri 17 Jan 2014 15:05:16 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 15:05:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:05:19 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:05:19 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Fri 17 Jan 2014 15:05:19 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:05:19 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:05:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:05:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:05:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:05:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:05:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:05:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:05:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:05:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43800713
Fri 17 Jan 2014 15:05:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:05:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43800713
Fri 17 Jan 2014 15:05:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:05:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:05:26 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:05:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:05:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:05:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:05:27 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:05:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 15:05:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 15:05:27 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:05:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8975 values 141600 bits 17700 bytes 
Fri 17 Jan 2014 15:05:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:05:27 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:05:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:05:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:05:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:05:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:05:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:05:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43800713
Fri 17 Jan 2014 15:05:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:05:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:05:34 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:05:34 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:05:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:05:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:05:34 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 15:05:35 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:05:35 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:05:35 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 15:05:35 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 15:05:35 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:05:35 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 15:05:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:05:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:05:40 - size of cluster 'LISA Cluster': 624 hosts 79477 metrics 858314 values 13567476 bits 1695934 bytes 
Fri 17 Jan 2014 15:05:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:05:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:05:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:05:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:05:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:05:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:05:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:05:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:05:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:05:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:05:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:05:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:05:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:05:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:05:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:05:45 - job_xml_thread(): Done retrieving: data size 43291900
Fri 17 Jan 2014 15:05:45 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:05:45 - XML: Start document: iteration 5
Fri 17 Jan 2014 15:05:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43291900
Fri 17 Jan 2014 15:05:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:05:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43291900
Fri 17 Jan 2014 15:05:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:05:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:05:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:05:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:05:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:06:00 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:06:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 15:06:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:06:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:06:06 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:06:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:06:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:06:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:06:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:06:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:06:07 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:06:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:06:08 - XML: Processed 648638 elements - found 658 jobs
Fri 17 Jan 2014 15:06:08 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:06:08 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:06:08 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:06:08 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:06:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:06:09 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:06:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:06:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:06:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:06:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:06:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:06:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:06:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:06:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43272116
Fri 17 Jan 2014 15:06:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:06:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43272116
Fri 17 Jan 2014 15:06:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:06:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:06:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:06:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:06:23 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:06:23 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:06:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:06:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:06:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:06:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:06:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:06:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:06:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:06:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:06:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:06:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:06:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:06:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:06:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:06:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:06:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:06:27 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:06:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:06:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:06:27 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:06:28 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:06:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 15:06:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:06:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 15:06:28 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:06:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6152 values 97033 bits 12129 bytes 
Fri 17 Jan 2014 15:06:29 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:06:29 - job_xml_thread(): Done retrieving: data size 43265054
Fri 17 Jan 2014 15:06:29 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:06:29 - XML: Start document: iteration 6
Fri 17 Jan 2014 15:06:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43265054
Fri 17 Jan 2014 15:06:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:06:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43265054
Fri 17 Jan 2014 15:06:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:06:36 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:06:36 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 15:06:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:06:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:06:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:06:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:06:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:06:42 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:06:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:06:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:06:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:06:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:06:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:06:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:06:43 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:06:48 - XML: Processed 648068 elements - found 658 jobs
Fri 17 Jan 2014 15:06:48 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:06:48 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:06:48 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:06:48 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:06:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:06:53 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:06:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:06:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:06:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:06:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:06:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:06:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:06:55 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:06:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 15:06:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:06:56 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:06:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43829116
Fri 17 Jan 2014 15:06:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:06:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43829116
Fri 17 Jan 2014 15:06:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:06:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:06:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:07:04 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:07:04 - job_xml_thread(): Done retrieving: data size 43829116
Fri 17 Jan 2014 15:07:04 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:07:04 - XML: Start document: iteration 7
Fri 17 Jan 2014 15:07:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:07:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:07:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:07:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:07:06 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:07:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:07:06 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:07:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:07:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:07:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:07:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:07:17 - XML: Processed 655477 elements - found 653 jobs
Fri 17 Jan 2014 15:07:17 - job 7348183 appears to have finished
Fri 17 Jan 2014 15:07:17 - job 7348328 appears to have finished
Fri 17 Jan 2014 15:07:17 - job 7348170 appears to have finished
Fri 17 Jan 2014 15:07:17 - job 7348175 appears to have finished
Fri 17 Jan 2014 15:07:17 - job 7348212 appears to have finished
Fri 17 Jan 2014 15:07:17 - job 7348343 appears to have finished
Fri 17 Jan 2014 15:07:17 - job_xml_thread(): Found 7 updated jobs.
Fri 17 Jan 2014 15:07:17 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 15:07:19 - job_xml_thread(): Done storing. succesfully stored: 7 jobs
Fri 17 Jan 2014 15:07:19 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:07:19 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:07:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:07:20 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:07:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:07:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:07:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:07:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:07:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:07:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:07:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:07:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:07:23 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:07:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43844141
Fri 17 Jan 2014 15:07:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:07:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43844141
Fri 17 Jan 2014 15:07:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:07:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:07:28 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:07:29 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:07:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:07:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 15:07:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 15:07:29 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:07:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7332 values 115670 bits 14458 bytes 
Fri 17 Jan 2014 15:07:34 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:07:34 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:07:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:07:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:07:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:07:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:07:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:07:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:07:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:07:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:07:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:07:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:07:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:07:38 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:07:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:07:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:07:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:07:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:07:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:07:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:07:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:07:43 - job_xml_thread(): Done retrieving: data size 43848314
Fri 17 Jan 2014 15:07:43 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:07:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43848314
Fri 17 Jan 2014 15:07:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:07:43 - XML: Start document: iteration 8
Fri 17 Jan 2014 15:07:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43848314
Fri 17 Jan 2014 15:07:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:07:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:07:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:07:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:07:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:08:02 - XML: Processed 655506 elements - found 653 jobs
Fri 17 Jan 2014 15:08:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:08:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:08:02 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:08:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:08:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:08:02 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:08:02 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:08:02 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:08:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:08:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:08:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:08:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:08:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:08:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:08:06 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:08:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:08:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:08:06 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:08:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 15:08:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:08:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:08:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:08:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:08:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:08:09 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:08:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867365
Fri 17 Jan 2014 15:08:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:08:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43867365
Fri 17 Jan 2014 15:08:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:08:17 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:08:17 - job_xml_thread(): Done retrieving: data size 43867365
Fri 17 Jan 2014 15:08:17 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:08:17 - XML: Start document: iteration 9
Fri 17 Jan 2014 15:08:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:08:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:08:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:08:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:08:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:08:25 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:08:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:08:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:08:25 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:08:25 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:08:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:08:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:08:25 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:08:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:08:29 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:08:30 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:08:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 15:08:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:08:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 15:08:30 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:08:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6147 values 96991 bits 12123 bytes 
Fri 17 Jan 2014 15:08:31 - XML: Processed 655500 elements - found 653 jobs
Fri 17 Jan 2014 15:08:31 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:08:31 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:08:31 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:08:31 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:08:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:08:32 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:08:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:08:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:08:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:08:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:08:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:08:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:08:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:08:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43868704
Fri 17 Jan 2014 15:08:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:08:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43868704
Fri 17 Jan 2014 15:08:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:08:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:08:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:08:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:08:45 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:08:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:08:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:08:46 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:08:47 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:08:47 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:08:47 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:08:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:08:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:08:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:08:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:08:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:08:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:08:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:08:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:08:51 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:08:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 15:08:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:08:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:08:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:08:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:08:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:08:53 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:08:53 - job_xml_thread(): Done retrieving: data size 43875761
Fri 17 Jan 2014 15:08:53 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:08:53 - XML: Start document: iteration 10
Fri 17 Jan 2014 15:08:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875761
Fri 17 Jan 2014 15:08:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:08:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875761
Fri 17 Jan 2014 15:08:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:09:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:09:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:09:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:09:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:09:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:09:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:09:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:09:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:09:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:09:14 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:09:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:09:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:09:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:09:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:09:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:09:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:09:15 - XML: Processed 655496 elements - found 648 jobs
Fri 17 Jan 2014 15:09:15 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:09:15 - job 7348148 appears to have finished
Fri 17 Jan 2014 15:09:15 - job 7348287 appears to have finished
Fri 17 Jan 2014 15:09:15 - job 7348286 appears to have finished
Fri 17 Jan 2014 15:09:15 - job 7348285 appears to have finished
Fri 17 Jan 2014 15:09:15 - job 7348284 appears to have finished
Fri 17 Jan 2014 15:09:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:09:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:09:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:09:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:09:15 - job_xml_thread(): Found 5 updated jobs.
Fri 17 Jan 2014 15:09:15 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 15:09:16 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Fri 17 Jan 2014 15:09:16 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:09:16 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:09:18 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 15:09:18 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 15:09:18 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:09:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:09:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43884574
Fri 17 Jan 2014 15:09:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:09:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43884574
Fri 17 Jan 2014 15:09:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:09:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:09:31 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:09:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:09:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:09:31 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:09:31 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:09:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:09:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:09:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:09:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 15:09:32 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:09:32 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:09:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8745 values 137888 bits 17236 bytes 
Fri 17 Jan 2014 15:09:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 15:09:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:09:34 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:09:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:09:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:09:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:09:35 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:09:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:09:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:09:35 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:09:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:09:35 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:09:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:09:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:09:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:09:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:09:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:09:37 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:09:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 15:09:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:09:37 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:09:37 - job_xml_thread(): Done retrieving: data size 43881595
Fri 17 Jan 2014 15:09:37 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:09:37 - XML: Start document: iteration 11
Fri 17 Jan 2014 15:09:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43881595
Fri 17 Jan 2014 15:09:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43881595
Fri 17 Jan 2014 15:09:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:09:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:09:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:09:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:09:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:09:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:09:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:09:53 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:09:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:09:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:09:54 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:09:54 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:09:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:09:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:09:54 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:09:59 - XML: Processed 655496 elements - found 648 jobs
Fri 17 Jan 2014 15:09:59 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:09:59 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:09:59 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:09:59 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:10:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:10:01 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:10:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:10:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:10:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:10:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:10:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:10:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:10:03 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:10:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43859976
Fri 17 Jan 2014 15:10:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:10:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43859976
Fri 17 Jan 2014 15:10:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:10:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:10:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:10:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:10:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:10:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:10:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:10:12 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:10:12 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:10:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:10:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:10:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43859976
Fri 17 Jan 2014 15:10:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:10:14 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:10:15 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:10:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:10:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:10:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:10:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:10:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:10:24 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:10:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:10:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:10:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:10:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:10:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:10:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:10:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:10:25 - job_xml_thread(): Done retrieving: data size 43842843
Fri 17 Jan 2014 15:10:25 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:10:25 - XML: Start document: iteration 12
Fri 17 Jan 2014 15:10:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43842843
Fri 17 Jan 2014 15:10:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:10:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:10:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:10:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:10:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:10:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43842843
Fri 17 Jan 2014 15:10:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:10:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:10:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:10:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:10:33 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:10:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:10:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 15:10:33 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:10:33 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:10:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 15:10:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7335 values 115774 bits 14471 bytes 
Fri 17 Jan 2014 15:10:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:10:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:10:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:10:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:10:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:10:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:10:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:10:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:10:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:10:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:10:44 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:10:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:10:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:10:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:10:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:10:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:10:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:10:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:10:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:10:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:10:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:10:48 - XML: Processed 655496 elements - found 648 jobs
Fri 17 Jan 2014 15:10:48 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:10:48 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:10:48 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:10:48 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:10:51 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:10:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43879480
Fri 17 Jan 2014 15:10:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:10:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43879480
Fri 17 Jan 2014 15:10:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:10:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:10:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:11:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:11:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:11:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:11:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:11:04 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:11:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:11:04 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:11:04 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:11:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:11:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:11:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:11:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:11:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:11:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:11:05 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:11:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 15:11:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:11:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:11:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:11:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:11:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:11:07 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:11:07 - job_xml_thread(): Done retrieving: data size 43820725
Fri 17 Jan 2014 15:11:07 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:11:07 - XML: Start document: iteration 13
Fri 17 Jan 2014 15:11:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43820725
Fri 17 Jan 2014 15:11:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43820725
Fri 17 Jan 2014 15:11:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:11:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:11:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:11:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:11:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:11:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:11:20 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:11:20 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:11:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:11:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:11:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:11:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:11:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:11:24 - XML: Processed 654746 elements - found 647 jobs
Fri 17 Jan 2014 15:11:24 - job 7348365 appears to have finished
Fri 17 Jan 2014 15:11:24 - job 7348362 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 15:11:24 - job 7348173 appears to have finished
Fri 17 Jan 2014 15:11:24 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 15:11:24 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 15:11:24 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 15:11:24 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:11:24 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:11:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:11:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:11:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:11:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:11:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:11:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:11:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:11:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:11:30 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:11:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43784599
Fri 17 Jan 2014 15:11:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:11:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43784599
Fri 17 Jan 2014 15:11:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:11:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:11:34 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:11:34 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:11:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:11:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 15:11:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 15:11:35 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:11:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9179 values 144802 bits 18100 bytes 
Fri 17 Jan 2014 15:11:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:11:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:11:40 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:11:40 - job_xml_thread(): Done retrieving: data size 43784599
Fri 17 Jan 2014 15:11:40 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:11:40 - XML: Start document: iteration 14
Fri 17 Jan 2014 15:11:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:11:42 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:11:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:11:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:11:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:11:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:11:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:11:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:11:43 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:11:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:11:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:11:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:11:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:11:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:11:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:11:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:11:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:11:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:11:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:11:53 - XML: Processed 654738 elements - found 647 jobs
Fri 17 Jan 2014 15:11:53 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:11:53 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:11:53 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:11:53 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:11:55 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:11:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43205987
Fri 17 Jan 2014 15:11:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:11:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43205987
Fri 17 Jan 2014 15:11:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:11:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:11:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:12:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:12:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:12:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:12:06 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:12:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:12:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:12:06 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:12:06 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:12:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:12:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:12:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:12:08 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:12:09 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:12:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 15:12:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:12:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:12:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:12:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:12:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:12:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:12:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:12:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:12:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:12:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:12:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43251113
Fri 17 Jan 2014 15:12:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:12:13 - job_xml_thread(): Done retrieving: data size 43251113
Fri 17 Jan 2014 15:12:13 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:12:13 - XML: Start document: iteration 15
Fri 17 Jan 2014 15:12:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43251113
Fri 17 Jan 2014 15:12:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:12:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:12:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:12:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:12:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:12:30 - XML: Processed 647968 elements - found 647 jobs
Fri 17 Jan 2014 15:12:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:12:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:12:30 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:12:30 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:12:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:12:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:12:30 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:12:30 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:12:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:12:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:12:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:12:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:12:31 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:12:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:12:33 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:12:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:12:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:12:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:12:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:12:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:12:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:12:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:12:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43290322
Fri 17 Jan 2014 15:12:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:12:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:12:35 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:12:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43290322
Fri 17 Jan 2014 15:12:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:12:36 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 15:12:36 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:12:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:12:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 15:12:37 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:12:37 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:12:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9111 values 143748 bits 17968 bytes 
Fri 17 Jan 2014 15:12:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 15:12:38 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:12:38 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:12:38 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 15:12:38 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 15:12:38 - Entering storeMetrics(): cluster LISA Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Fri 17 Jan 2014 15:12:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:12:45 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:12:45 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:12:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:12:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:12:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:12:47 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:12:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:12:47 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:12:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:12:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:12:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:12:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:12:49 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:12:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:12:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:12:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:12:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:12:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:12:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:12:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:12:52 - job_xml_thread(): Done retrieving: data size 43784182
Fri 17 Jan 2014 15:12:52 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:12:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43784182
Fri 17 Jan 2014 15:12:52 - XML: Start document: iteration 16
Fri 17 Jan 2014 15:12:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:12:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43784182
Fri 17 Jan 2014 15:12:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:13:01 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:13:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 15:13:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:13:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:13:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:13:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:13:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:13:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:13:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:13:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:13:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:13:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:13:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:13:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:13:09 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:13:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:13:12 - XML: Processed 654342 elements - found 644 jobs
Fri 17 Jan 2014 15:13:12 - job 7348118 appears to have finished
Fri 17 Jan 2014 15:13:12 - job 7348361 appears to have finished
Fri 17 Jan 2014 15:13:12 - job 7348362 field 'start_timestamp' changed since saved from: 1389967882 to: 1389967806
Fri 17 Jan 2014 15:13:12 - job 7348162 appears to have finished
Fri 17 Jan 2014 15:13:12 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 15:13:12 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 15:13:13 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 15:13:13 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:13:13 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:13:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:13:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:13:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:13:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:13:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:13:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:13:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:13:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:13:16 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:13:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855543
Fri 17 Jan 2014 15:13:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:13:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855543
Fri 17 Jan 2014 15:13:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:13:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:13:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:13:28 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:13:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:13:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:13:29 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:13:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:13:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:13:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:13:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:13:30 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:13:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:13:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:13:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:13:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:13:31 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:13:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:13:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:13:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:13:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:13:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:13:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:13:33 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:13:33 - job_xml_thread(): Done retrieving: data size 43875564
Fri 17 Jan 2014 15:13:33 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:13:33 - XML: Start document: iteration 17
Fri 17 Jan 2014 15:13:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875564
Fri 17 Jan 2014 15:13:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:13:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875564
Fri 17 Jan 2014 15:13:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:13:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:13:38 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:13:38 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:13:38 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:13:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:13:38 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:13:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 15:13:38 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:13:38 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 15:13:38 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 15:13:38 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:13:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 15:13:38 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 15:13:39 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:13:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9225 values 145553 bits 18194 bytes 
Fri 17 Jan 2014 15:13:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:13:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:13:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:13:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:13:50 - XML: Processed 655488 elements - found 644 jobs
Fri 17 Jan 2014 15:13:50 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:13:50 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:13:50 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:13:50 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:13:51 - size of cluster 'LISA Cluster': 624 hosts 79479 metrics 898265 values 14169882 bits 1771235 bytes 
Fri 17 Jan 2014 15:13:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:13:54 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:13:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:13:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:13:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:13:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:13:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:13:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:13:55 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:13:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:13:57 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:13:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:13:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:13:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:13:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:13:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:13:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:14:01 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:14:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862872
Fri 17 Jan 2014 15:14:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:14:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862872
Fri 17 Jan 2014 15:14:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:14:05 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:14:05 - job_xml_thread(): Done retrieving: data size 43862872
Fri 17 Jan 2014 15:14:05 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:14:05 - XML: Start document: iteration 18
Fri 17 Jan 2014 15:14:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:14:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:14:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:14:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:14:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:14:14 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:14:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:14:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:14:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:14:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:14:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:14:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:14:15 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:14:18 - XML: Processed 655488 elements - found 644 jobs
Fri 17 Jan 2014 15:14:18 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:14:18 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:14:18 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:14:18 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:14:20 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:14:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 15:14:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:14:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:14:23 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:14:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:14:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:14:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:14:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:14:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:14:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:14:27 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:14:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43842323
Fri 17 Jan 2014 15:14:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:14:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43842323
Fri 17 Jan 2014 15:14:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:14:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:14:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:14:33 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:14:34 - job_xml_thread(): Done retrieving: data size 43842323
Fri 17 Jan 2014 15:14:34 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:14:34 - XML: Start document: iteration 19
Fri 17 Jan 2014 15:14:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:14:38 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:14:39 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:14:39 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 15:14:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:14:39 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:14:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 15:14:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 15:14:39 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:14:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:14:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:14:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5805 values 91558 bits 11444 bytes 
Fri 17 Jan 2014 15:14:43 - XML: Processed 655488 elements - found 644 jobs
Fri 17 Jan 2014 15:14:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:14:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:14:44 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:14:44 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:14:44 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:14:44 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:14:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:14:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:14:45 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:14:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:14:45 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:14:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:14:45 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:14:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:14:48 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:14:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:14:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:14:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:14:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:14:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:14:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:14:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:14:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43876393
Fri 17 Jan 2014 15:14:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:14:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43876393
Fri 17 Jan 2014 15:14:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:14:59 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:14:59 - job_xml_thread(): Done retrieving: data size 43876393
Fri 17 Jan 2014 15:14:59 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:14:59 - XML: Start document: iteration 20
Fri 17 Jan 2014 15:15:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:15:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:15:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:15:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:15:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:15:07 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:15:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:15:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:15:07 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:15:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 15:15:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:15:08 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:15:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:15:08 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:15:08 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:15:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:15:12 - XML: Processed 655480 elements - found 641 jobs
Fri 17 Jan 2014 15:15:12 - job 7348213 appears to have finished
Fri 17 Jan 2014 15:15:12 - job 7348214 appears to have finished
Fri 17 Jan 2014 15:15:12 - job 7348195 appears to have finished
Fri 17 Jan 2014 15:15:12 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 15:15:12 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 15:15:13 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 15:15:13 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:15:13 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:15:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:15:15 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:15:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:15:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:15:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:15:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:15:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:15:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:15:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:15:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43850529
Fri 17 Jan 2014 15:15:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:15:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43850529
Fri 17 Jan 2014 15:15:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:15:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:15:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:15:28 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:15:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:15:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:15:29 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:15:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:15:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:15:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:15:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:15:30 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:15:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:15:30 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:15:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:15:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:15:33 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:15:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:15:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:15:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:15:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:15:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:15:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:15:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:15:35 - job_xml_thread(): Done retrieving: data size 43871675
Fri 17 Jan 2014 15:15:35 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:15:35 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 15:15:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43871675
Fri 17 Jan 2014 15:15:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:15:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43871675
Fri 17 Jan 2014 15:15:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:15:35 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 15:15:35 - Housekeeping: done.
Fri 17 Jan 2014 15:15:35 - XML: Start document: iteration 0
Fri 17 Jan 2014 15:15:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:15:39 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:15:40 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:15:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 15:15:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:15:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 15:15:40 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:15:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9012 values 142164 bits 17770 bytes 
Fri 17 Jan 2014 15:15:44 - XML: Processed 655482 elements - found 641 jobs
Fri 17 Jan 2014 15:15:44 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:15:44 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:15:44 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:15:44 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:15:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:15:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:15:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:15:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:15:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:15:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:15:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:15:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:15:52 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 15:15:52 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 15:15:52 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:15:53 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:15:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:15:53 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:15:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:15:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:15:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:15:55 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:15:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:15:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:15:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:15:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:15:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:15:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:15:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:15:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43872491
Fri 17 Jan 2014 15:15:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:15:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43872491
Fri 17 Jan 2014 15:15:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:15:59 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:15:59 - job_xml_thread(): Done retrieving: data size 43872491
Fri 17 Jan 2014 15:15:59 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:15:59 - XML: Start document: iteration 1
Fri 17 Jan 2014 15:16:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:16:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:16:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:16:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:16:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:16:13 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:16:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:16:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:16:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:16:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:16:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:16:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:16:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:16:15 - XML: Processed 655482 elements - found 641 jobs
Fri 17 Jan 2014 15:16:15 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:16:15 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:16:15 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:16:15 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:16:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:16:20 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:16:20 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:16:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 15:16:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:16:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:16:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:16:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:16:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:16:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:16:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:16:22 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:16:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858481
Fri 17 Jan 2014 15:16:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:16:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43858481
Fri 17 Jan 2014 15:16:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:16:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:16:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:16:30 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:16:30 - job_xml_thread(): Done retrieving: data size 43858481
Fri 17 Jan 2014 15:16:30 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:16:30 - XML: Start document: iteration 2
Fri 17 Jan 2014 15:16:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:16:31 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:16:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:16:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:16:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:16:32 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:16:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:16:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:16:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858481
Fri 17 Jan 2014 15:16:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:16:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:16:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:16:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:16:40 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:16:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:16:40 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:16:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 15:16:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 15:16:41 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:16:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5693 values 89892 bits 11236 bytes 
Fri 17 Jan 2014 15:16:46 - XML: Processed 655480 elements - found 641 jobs
Fri 17 Jan 2014 15:16:46 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:16:46 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:16:46 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:16:47 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:16:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:16:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:16:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:16:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:16:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:16:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:16:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:16:52 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:16:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:16:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:16:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:16:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:16:52 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:16:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:16:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:16:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:16:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:16:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:16:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:16:54 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:16:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 15:16:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:16:55 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:16:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43877669
Fri 17 Jan 2014 15:16:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:16:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43877669
Fri 17 Jan 2014 15:16:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:17:02 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:17:02 - job_xml_thread(): Done retrieving: data size 43877669
Fri 17 Jan 2014 15:17:02 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:17:03 - XML: Start document: iteration 3
Fri 17 Jan 2014 15:17:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:17:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:17:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:17:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:17:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:17:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:17:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:17:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:17:12 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:17:12 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:17:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:17:12 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:17:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:17:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:17:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:17:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:17:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:17:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:17:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:17:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:17:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:17:19 - XML: Processed 655482 elements - found 641 jobs
Fri 17 Jan 2014 15:17:19 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:17:19 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:17:19 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:17:19 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:17:21 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:17:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43805882
Fri 17 Jan 2014 15:17:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:17:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43805882
Fri 17 Jan 2014 15:17:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:17:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:17:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:17:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:17:28 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:17:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:17:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:17:30 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:17:30 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:17:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:17:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43805882
Fri 17 Jan 2014 15:17:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:17:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:17:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:17:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:17:34 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:17:34 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:17:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:17:41 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:17:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:17:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:17:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:17:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:17:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:17:41 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:17:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 15:17:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 15:17:41 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:17:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99393 bits 12424 bytes 
Fri 17 Jan 2014 15:17:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:17:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:17:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:17:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:17:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:17:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:17:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:17:45 - job_xml_thread(): Done retrieving: data size 43307290
Fri 17 Jan 2014 15:17:45 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:17:45 - XML: Start document: iteration 4
Fri 17 Jan 2014 15:17:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43307290
Fri 17 Jan 2014 15:17:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:17:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:17:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:17:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:17:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:17:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:17:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:17:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43307290
Fri 17 Jan 2014 15:17:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:17:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:17:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:18:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:18:01 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:18:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:18:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:18:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:18:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:18:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:18:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:18:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:18:06 - XML: Processed 648854 elements - found 641 jobs
Fri 17 Jan 2014 15:18:06 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:18:06 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:18:06 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:18:06 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:18:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:18:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:18:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:18:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:18:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:18:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:18:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:18:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:18:09 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:18:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 15:18:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:18:10 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:18:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43241920
Fri 17 Jan 2014 15:18:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:18:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43241920
Fri 17 Jan 2014 15:18:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:18:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:18:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:18:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:18:21 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:18:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:18:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:18:22 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:18:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:18:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:18:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:18:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:18:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:18:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:18:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:18:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:18:25 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:18:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:18:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:18:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:18:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:18:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:18:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:18:26 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:18:26 - job_xml_thread(): Done retrieving: data size 43271566
Fri 17 Jan 2014 15:18:26 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:18:26 - XML: Start document: iteration 5
Fri 17 Jan 2014 15:18:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43271566
Fri 17 Jan 2014 15:18:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:18:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43271566
Fri 17 Jan 2014 15:18:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:18:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:18:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:18:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:18:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:18:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:18:42 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:18:42 - XML: Processed 648042 elements - found 641 jobs
Fri 17 Jan 2014 15:18:42 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:18:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:18:42 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:18:42 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:18:42 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:18:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 15:18:42 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:18:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 15:18:42 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:18:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8904 values 140671 bits 17583 bytes 
Fri 17 Jan 2014 15:18:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:18:48 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:18:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:18:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:18:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:18:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:18:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:18:49 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:18:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:18:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:18:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:18:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:18:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:18:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:18:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:18:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:18:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:18:52 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:18:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 15:18:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:18:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:18:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43828334
Fri 17 Jan 2014 15:18:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:18:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43828334
Fri 17 Jan 2014 15:18:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:18:57 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:18:57 - job_xml_thread(): Done retrieving: data size 43828334
Fri 17 Jan 2014 15:18:57 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:18:57 - XML: Start document: iteration 6
Fri 17 Jan 2014 15:19:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:19:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:19:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:19:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:19:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:19:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:19:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:19:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:19:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:19:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:19:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:19:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:19:10 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:19:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:19:12 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:19:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:19:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:19:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:19:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:19:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:19:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:19:14 - XML: Processed 654788 elements - found 641 jobs
Fri 17 Jan 2014 15:19:14 - job 7348246 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 15:19:14 - job 7348367 appears to have finished
Fri 17 Jan 2014 15:19:14 - job 7348171 appears to have finished
Fri 17 Jan 2014 15:19:14 - job_xml_thread(): Found 5 updated jobs.
Fri 17 Jan 2014 15:19:14 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 15:19:14 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Fri 17 Jan 2014 15:19:14 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:19:14 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:19:16 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:19:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43849180
Fri 17 Jan 2014 15:19:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:19:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43849180
Fri 17 Jan 2014 15:19:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:19:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:19:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:19:25 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:19:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:19:26 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:19:26 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:19:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:19:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:19:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43849180
Fri 17 Jan 2014 15:19:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:19:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:19:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:19:29 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:19:29 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:19:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:19:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:19:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:19:38 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:19:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:19:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:19:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:19:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:19:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:19:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:19:40 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:19:40 - job_xml_thread(): Done retrieving: data size 43841906
Fri 17 Jan 2014 15:19:40 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:19:40 - XML: Start document: iteration 7
Fri 17 Jan 2014 15:19:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43841906
Fri 17 Jan 2014 15:19:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:19:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:19:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:19:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:19:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:19:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:19:43 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:19:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:19:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:19:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43841906
Fri 17 Jan 2014 15:19:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:19:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:19:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 15:19:44 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:19:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 15:19:45 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:19:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99158 bits 12394 bytes 
Fri 17 Jan 2014 15:19:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:19:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:19:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:19:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:20:00 - XML: Processed 655482 elements - found 641 jobs
Fri 17 Jan 2014 15:20:00 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:20:01 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:20:01 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:20:01 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:20:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:20:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:20:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:20:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:20:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:20:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:20:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:20:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:20:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:20:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:20:03 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:20:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:20:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:20:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:20:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:20:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:20:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:20:06 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:20:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 15:20:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:20:06 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:20:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875000
Fri 17 Jan 2014 15:20:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:20:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875000
Fri 17 Jan 2014 15:20:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:20:17 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:20:17 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:20:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:20:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:20:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:20:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:20:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:20:21 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:20:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:20:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:20:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:20:21 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:20:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:20:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:20:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:20:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:20:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:20:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:20:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:20:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:20:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:20:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:20:23 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:20:23 - job_xml_thread(): Done retrieving: data size 43876750
Fri 17 Jan 2014 15:20:23 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:20:23 - XML: Start document: iteration 8
Fri 17 Jan 2014 15:20:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43876750
Fri 17 Jan 2014 15:20:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:20:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43876750
Fri 17 Jan 2014 15:20:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:20:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:20:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:20:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:20:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:20:39 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 15:20:39 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:20:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:20:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:20:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:20:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:20:40 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:20:40 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:20:40 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 15:20:40 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 15:20:40 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 15:20:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:20:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:20:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:20:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:20:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:20:44 - XML: Processed 655482 elements - found 641 jobs
Fri 17 Jan 2014 15:20:44 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:20:44 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:20:44 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:20:44 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:20:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:20:44 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:20:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:20:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 15:20:45 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:20:45 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:20:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 15:20:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6306 values 99486 bits 12435 bytes 
Fri 17 Jan 2014 15:20:46 - size of cluster 'LISA Cluster': 624 hosts 79479 metrics 904811 values 14295180 bits 1786897 bytes 
Fri 17 Jan 2014 15:20:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:20:48 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:20:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:20:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:20:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:20:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:20:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:20:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:20:51 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:20:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856622
Fri 17 Jan 2014 15:20:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:20:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43856622
Fri 17 Jan 2014 15:20:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:20:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:20:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:20:59 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:20:59 - job_xml_thread(): Done retrieving: data size 43856622
Fri 17 Jan 2014 15:20:59 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:20:59 - XML: Start document: iteration 9
Fri 17 Jan 2014 15:21:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:21:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:21:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:21:06 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:21:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:21:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:21:08 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:21:08 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:21:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:21:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:21:08 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:21:13 - XML: Processed 655478 elements - found 639 jobs
Fri 17 Jan 2014 15:21:13 - job 7335112 appears to have finished
Fri 17 Jan 2014 15:21:13 - job 7348180 appears to have finished
Fri 17 Jan 2014 15:21:13 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 15:21:13 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 15:21:13 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 15:21:13 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:21:13 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:21:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:21:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:21:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:21:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:21:16 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:21:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 15:21:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:21:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:21:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:21:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:21:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:21:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:21:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43847283
Fri 17 Jan 2014 15:21:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:21:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43847283
Fri 17 Jan 2014 15:21:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:21:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:21:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:21:28 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:21:28 - job_xml_thread(): Done retrieving: data size 43847283
Fri 17 Jan 2014 15:21:28 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:21:28 - XML: Start document: iteration 10
Fri 17 Jan 2014 15:21:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:21:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:21:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:21:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:21:30 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:21:30 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:21:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:21:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:21:31 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:21:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:21:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:21:40 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:21:40 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 15:21:41 - XML: Processed 655478 elements - found 639 jobs
Fri 17 Jan 2014 15:21:41 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:21:41 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:21:41 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:21:41 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:21:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:21:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:21:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:21:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:21:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:21:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:21:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:21:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:21:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:21:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43831539
Fri 17 Jan 2014 15:21:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:21:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:21:45 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:21:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:21:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:21:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43831539
Fri 17 Jan 2014 15:21:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:21:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:21:45 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:21:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 15:21:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 15:21:45 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:21:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5760 values 90852 bits 11356 bytes 
Fri 17 Jan 2014 15:21:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:21:54 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:21:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:21:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:21:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:21:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:21:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:21:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:21:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43831539
Fri 17 Jan 2014 15:21:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:21:56 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:21:56 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:21:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:21:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:22:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:22:06 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:22:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:22:08 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:22:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:22:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:22:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:22:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:22:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:22:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:22:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:22:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:22:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:22:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:22:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:22:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:22:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:22:11 - job_xml_thread(): Done retrieving: data size 43837467
Fri 17 Jan 2014 15:22:11 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:22:11 - XML: Start document: iteration 11
Fri 17 Jan 2014 15:22:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43837467
Fri 17 Jan 2014 15:22:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:22:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43837467
Fri 17 Jan 2014 15:22:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:22:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:22:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:22:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:22:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:22:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:22:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:22:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:22:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:22:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:22:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:22:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:22:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:22:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:22:34 - XML: Processed 655478 elements - found 639 jobs
Fri 17 Jan 2014 15:22:34 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:22:34 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:22:34 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:22:34 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:22:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:22:37 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:22:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:22:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:22:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:22:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:22:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:22:37 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:22:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:22:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 15:22:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:22:40 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:22:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43860887
Fri 17 Jan 2014 15:22:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:22:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43860887
Fri 17 Jan 2014 15:22:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:22:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:22:46 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:22:46 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:22:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:22:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 15:22:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 15:22:46 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:22:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6053 values 95479 bits 11934 bytes 
Fri 17 Jan 2014 15:22:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:22:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:22:49 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:22:49 - job_xml_thread(): Done retrieving: data size 43860887
Fri 17 Jan 2014 15:22:49 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:22:49 - XML: Start document: iteration 12
Fri 17 Jan 2014 15:22:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:22:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:22:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:22:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:22:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:22:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:22:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:22:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:22:52 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:22:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:22:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:23:02 - XML: Processed 655472 elements - found 636 jobs
Fri 17 Jan 2014 15:23:02 - job 7334715 appears to have finished
Fri 17 Jan 2014 15:23:02 - job 7348288 appears to have finished
Fri 17 Jan 2014 15:23:02 - job 7348164 appears to have finished
Fri 17 Jan 2014 15:23:02 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 15:23:02 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 15:23:02 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 15:23:02 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:23:02 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:23:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:23:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:23:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:23:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:23:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:23:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:23:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:23:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:23:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:23:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:23:08 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:23:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43846769
Fri 17 Jan 2014 15:23:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:23:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43846769
Fri 17 Jan 2014 15:23:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:23:11 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:23:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 15:23:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:23:18 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:23:18 - job_xml_thread(): Done retrieving: data size 43846769
Fri 17 Jan 2014 15:23:18 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:23:18 - XML: Start document: iteration 13
Fri 17 Jan 2014 15:23:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:23:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:23:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:23:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:23:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:23:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:23:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:23:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:23:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:23:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:23:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:23:29 - XML: Processed 655474 elements - found 637 jobs
Fri 17 Jan 2014 15:23:29 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 15:23:29 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 15:23:30 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 15:23:30 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:23:30 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:23:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:23:32 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:23:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:23:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:23:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:23:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:23:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:23:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:23:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:23:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:23:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:23:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43772579
Fri 17 Jan 2014 15:23:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:23:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43772579
Fri 17 Jan 2014 15:23:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:23:45 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:23:45 - job_xml_thread(): Done retrieving: data size 43772579
Fri 17 Jan 2014 15:23:46 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:23:46 - XML: Start document: iteration 14
Fri 17 Jan 2014 15:23:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:23:46 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:23:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:23:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:23:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 15:23:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:23:48 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:23:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6256 values 98661 bits 12332 bytes 
Fri 17 Jan 2014 15:23:48 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:23:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 15:23:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:23:55 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:23:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:23:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:23:56 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:23:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:23:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:23:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:23:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:23:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:23:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:23:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:23:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:23:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:23:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:23:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:23:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:23:59 - XML: Processed 654726 elements - found 637 jobs
Fri 17 Jan 2014 15:23:59 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:23:59 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:23:59 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:23:59 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:24:03 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:24:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43203400
Fri 17 Jan 2014 15:24:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:24:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43203400
Fri 17 Jan 2014 15:24:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:24:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:24:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:24:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:24:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:24:14 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:24:14 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:24:18 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:24:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 15:24:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:24:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:24:19 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:24:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:24:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:24:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:24:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:24:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:24:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:24:20 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:24:20 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:24:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:24:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:24:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:24:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:24:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:24:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:24:23 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:24:23 - job_xml_thread(): Done retrieving: data size 43272402
Fri 17 Jan 2014 15:24:23 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:24:23 - XML: Start document: iteration 15
Fri 17 Jan 2014 15:24:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43272402
Fri 17 Jan 2014 15:24:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:24:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43272402
Fri 17 Jan 2014 15:24:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:24:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:24:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:24:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:24:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:24:39 - XML: Processed 648022 elements - found 637 jobs
Fri 17 Jan 2014 15:24:39 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:24:39 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:24:39 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:24:39 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:24:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:24:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:24:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:24:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:24:45 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:24:45 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:24:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:24:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:24:45 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:24:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:24:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:24:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:24:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:24:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:24:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:24:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:24:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:24:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:24:49 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:24:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:24:49 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:24:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 15:24:49 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:24:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 15:24:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5860 values 92379 bits 11547 bytes 
Fri 17 Jan 2014 15:24:51 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:24:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43789808
Fri 17 Jan 2014 15:24:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:24:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43789808
Fri 17 Jan 2014 15:24:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:24:54 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:24:54 - job_xml_thread(): Done retrieving: data size 43789808
Fri 17 Jan 2014 15:24:54 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:24:54 - XML: Start document: iteration 16
Fri 17 Jan 2014 15:25:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:25:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:25:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:25:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:25:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:25:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:25:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:25:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:25:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:25:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:25:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:25:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:25:10 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:25:12 - XML: Processed 654495 elements - found 636 jobs
Fri 17 Jan 2014 15:25:12 - job 7348149 appears to have finished
Fri 17 Jan 2014 15:25:12 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 15:25:12 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 15:25:12 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 15:25:12 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:25:12 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:25:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:25:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:25:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:25:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:25:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:25:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:25:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:25:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:25:17 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 15:25:17 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 15:25:17 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:25:17 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:25:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 15:25:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:25:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:25:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43842905
Fri 17 Jan 2014 15:25:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:25:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43842905
Fri 17 Jan 2014 15:25:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:25:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:25:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:25:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:25:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:25:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:25:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:25:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:25:27 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:25:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:25:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:25:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43842905
Fri 17 Jan 2014 15:25:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:25:27 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:25:27 - job_xml_thread(): Done retrieving: data size 43842905
Fri 17 Jan 2014 15:25:27 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:25:27 - XML: Start document: iteration 17
Fri 17 Jan 2014 15:25:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:25:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:25:41 - XML: Processed 655472 elements - found 636 jobs
Fri 17 Jan 2014 15:25:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:25:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:25:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:25:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:25:42 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:25:42 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:25:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:25:42 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:25:42 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:25:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:25:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:25:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:25:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:25:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:25:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:25:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:25:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:25:44 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:25:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:25:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:25:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:25:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:25:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:25:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:25:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43874533
Fri 17 Jan 2014 15:25:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:25:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43874533
Fri 17 Jan 2014 15:25:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:25:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:25:50 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:25:51 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:25:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 15:25:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:25:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 15:25:52 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:25:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7334 values 115643 bits 14455 bytes 
Fri 17 Jan 2014 15:25:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:25:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:25:57 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:25:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:25:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:25:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:25:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:25:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:25:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:25:59 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:25:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:25:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:25:59 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:25:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:25:59 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:25:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:26:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:26:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:26:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:26:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:26:01 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:26:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 15:26:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:26:01 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:26:01 - job_xml_thread(): Done retrieving: data size 43869055
Fri 17 Jan 2014 15:26:01 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:26:01 - XML: Start document: iteration 18
Fri 17 Jan 2014 15:26:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43869055
Fri 17 Jan 2014 15:26:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:26:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43869055
Fri 17 Jan 2014 15:26:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:26:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:26:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:26:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:26:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:26:19 - XML: Processed 655472 elements - found 636 jobs
Fri 17 Jan 2014 15:26:19 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:26:19 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:26:19 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:26:19 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:26:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:26:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:26:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:26:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:26:20 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:26:20 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:26:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:26:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:26:20 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:26:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:26:23 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:26:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:26:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:26:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:26:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:26:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:26:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:26:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:26:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43872561
Fri 17 Jan 2014 15:26:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:26:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43872561
Fri 17 Jan 2014 15:26:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:26:34 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:26:34 - job_xml_thread(): Done retrieving: data size 43872561
Fri 17 Jan 2014 15:26:34 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:26:34 - XML: Start document: iteration 19
Fri 17 Jan 2014 15:26:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:26:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:26:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:26:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:26:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:26:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:26:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:26:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:26:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:26:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:26:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:26:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:26:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:26:46 - XML: Processed 655464 elements - found 636 jobs
Fri 17 Jan 2014 15:26:46 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:26:46 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:26:46 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:26:46 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:26:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:26:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:26:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:26:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:26:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:26:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:26:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:26:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:26:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:26:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855032
Fri 17 Jan 2014 15:26:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:26:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855032
Fri 17 Jan 2014 15:26:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:26:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:26:52 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:26:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:26:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 15:26:53 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:26:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 15:26:53 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:26:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9279 values 146293 bits 18286 bytes 
Fri 17 Jan 2014 15:26:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:26:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:27:01 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:27:01 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:27:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:27:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:27:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:27:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:27:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:27:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:27:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:27:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:27:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:27:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:27:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:27:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:27:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:27:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:27:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:27:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:27:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:27:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:27:07 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:27:07 - job_xml_thread(): Done retrieving: data size 43871878
Fri 17 Jan 2014 15:27:07 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:27:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43871878
Fri 17 Jan 2014 15:27:07 - XML: Start document: iteration 20
Fri 17 Jan 2014 15:27:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:27:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43871878
Fri 17 Jan 2014 15:27:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:27:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:27:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:27:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:27:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:27:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:27:25 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:27:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:27:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:27:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:27:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:27:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:27:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:27:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:27:29 - XML: Processed 655472 elements - found 636 jobs
Fri 17 Jan 2014 15:27:29 - job 7348369 appears to have finished
Fri 17 Jan 2014 15:27:29 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 15:27:29 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 15:27:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:27:30 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:27:30 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 15:27:30 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:27:30 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:27:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:27:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:27:31 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:27:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 15:27:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:27:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:27:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:27:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:27:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:27:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:27:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43866380
Fri 17 Jan 2014 15:27:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:27:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43866380
Fri 17 Jan 2014 15:27:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:27:40 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 15:27:40 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:27:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:27:41 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:27:41 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:27:41 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:27:41 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 15:27:41 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 15:27:41 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 15:27:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:27:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:27:45 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:27:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:27:45 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:27:45 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:27:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:27:45 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:27:46 - size of cluster 'LISA Cluster': 624 hosts 79480 metrics 731383 values 11537261 bits 1442157 bytes 
Fri 17 Jan 2014 15:27:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:27:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:27:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:27:48 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:27:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:27:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:27:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:27:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:27:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:27:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:27:51 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:27:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43866564
Fri 17 Jan 2014 15:27:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:27:52 - job_xml_thread(): Done retrieving: data size 43866564
Fri 17 Jan 2014 15:27:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43866564
Fri 17 Jan 2014 15:27:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:27:52 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:27:52 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 15:27:52 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 15:27:52 - Housekeeping: done.
Fri 17 Jan 2014 15:27:53 - XML: Start document: iteration 0
Fri 17 Jan 2014 15:27:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:27:54 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:27:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:27:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 15:27:56 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:27:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 15:27:56 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:27:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8697 values 137154 bits 17144 bytes 
Fri 17 Jan 2014 15:28:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:28:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:28:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:28:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:28:10 - XML: Processed 655472 elements - found 636 jobs
Fri 17 Jan 2014 15:28:10 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:28:10 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:28:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:28:10 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:28:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:28:10 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:28:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:28:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:28:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:28:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:28:11 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:28:11 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:28:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:28:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:28:15 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:28:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:28:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:28:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:28:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:28:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:28:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:28:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:28:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43849377
Fri 17 Jan 2014 15:28:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:28:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43849377
Fri 17 Jan 2014 15:28:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:28:25 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:28:25 - job_xml_thread(): Done retrieving: data size 43849377
Fri 17 Jan 2014 15:28:25 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:28:25 - XML: Start document: iteration 1
Fri 17 Jan 2014 15:28:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:28:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:28:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:28:29 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:28:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:28:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:28:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:28:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:28:31 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:28:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:28:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:28:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:28:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:28:37 - XML: Processed 655472 elements - found 636 jobs
Fri 17 Jan 2014 15:28:37 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:28:37 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:28:37 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:28:37 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:28:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:28:40 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:28:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:28:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:28:41 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:28:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 15:28:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:28:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:28:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:28:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:28:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:28:42 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:28:42 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 15:28:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:28:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43832220
Fri 17 Jan 2014 15:28:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:28:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43832220
Fri 17 Jan 2014 15:28:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:28:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:28:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:28:52 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:28:52 - job_xml_thread(): Done retrieving: data size 43832220
Fri 17 Jan 2014 15:28:52 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:28:52 - XML: Start document: iteration 2
Fri 17 Jan 2014 15:28:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:28:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:28:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:28:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:28:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:28:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:28:56 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:28:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:28:57 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:28:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 15:28:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:28:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 15:28:57 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:28:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5846 values 92172 bits 11521 bytes 
Fri 17 Jan 2014 15:28:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:28:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:28:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:28:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:28:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:29:02 - XML: Processed 655472 elements - found 636 jobs
Fri 17 Jan 2014 15:29:02 - job 7348249 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 15:29:02 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 15:29:02 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 15:29:02 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 15:29:02 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:29:02 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:29:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:29:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:29:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:29:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:29:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:29:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:29:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:29:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:29:09 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:29:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43852328
Fri 17 Jan 2014 15:29:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:29:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43852328
Fri 17 Jan 2014 15:29:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:29:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:29:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:29:17 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:29:17 - job_xml_thread(): Done retrieving: data size 43852328
Fri 17 Jan 2014 15:29:17 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:29:17 - XML: Start document: iteration 3
Fri 17 Jan 2014 15:29:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:29:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:29:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:29:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:29:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:29:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:29:23 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:29:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:29:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:29:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:29:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:29:25 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:29:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 15:29:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:29:30 - XML: Processed 655468 elements - found 634 jobs
Fri 17 Jan 2014 15:29:30 - job 7348125 appears to have finished
Fri 17 Jan 2014 15:29:30 - job 7336926 appears to have finished
Fri 17 Jan 2014 15:29:30 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 15:29:30 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 15:29:31 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 15:29:31 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:29:31 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:29:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:29:32 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:29:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:29:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:29:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:29:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:29:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:29:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:29:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:29:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43771659
Fri 17 Jan 2014 15:29:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:29:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43771659
Fri 17 Jan 2014 15:29:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:29:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:29:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:29:46 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:29:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:29:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:29:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:29:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:29:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:29:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:29:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:29:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:29:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:29:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:29:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:29:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:29:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:29:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:29:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:29:53 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:29:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:29:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:29:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:29:54 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:29:54 - job_xml_thread(): Done retrieving: data size 43234445
Fri 17 Jan 2014 15:29:54 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:29:54 - XML: Start document: iteration 4
Fri 17 Jan 2014 15:29:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43234445
Fri 17 Jan 2014 15:29:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:29:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43234445
Fri 17 Jan 2014 15:29:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:29:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:29:57 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:29:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:29:59 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:29:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 15:29:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 15:29:59 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:30:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9057 values 142855 bits 17856 bytes 
Fri 17 Jan 2014 15:30:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:30:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:30:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:30:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:30:14 - XML: Processed 647726 elements - found 634 jobs
Fri 17 Jan 2014 15:30:14 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:30:14 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:30:14 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:30:15 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:30:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:30:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:30:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:30:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:30:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:30:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:30:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:30:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:30:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:30:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:30:17 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:30:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:30:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:30:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:30:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:30:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:30:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:30:21 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:30:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 15:30:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:30:21 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:30:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43270276
Fri 17 Jan 2014 15:30:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:30:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43270276
Fri 17 Jan 2014 15:30:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:30:30 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:30:30 - job_xml_thread(): Done retrieving: data size 43270276
Fri 17 Jan 2014 15:30:30 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:30:30 - XML: Start document: iteration 5
Fri 17 Jan 2014 15:30:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:30:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:30:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:30:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:30:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:30:37 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:30:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:30:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:30:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:30:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:30:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:30:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:30:39 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:30:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:30:41 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:30:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:30:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:30:42 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:30:42 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:30:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:30:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:30:44 - XML: Processed 648016 elements - found 634 jobs
Fri 17 Jan 2014 15:30:44 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:30:44 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:30:44 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:30:44 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:30:47 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:30:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43794885
Fri 17 Jan 2014 15:30:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:30:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43794885
Fri 17 Jan 2014 15:30:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:30:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:30:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:30:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:30:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:30:59 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:30:59 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:30:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:30:59 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:31:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:31:01 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:31:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:31:01 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:31:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 15:31:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 15:31:01 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:31:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99063 bits 12382 bytes 
Fri 17 Jan 2014 15:31:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:31:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:31:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:31:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:31:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:31:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:31:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:31:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:31:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:31:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:31:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:31:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:31:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:31:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:31:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:31:05 - job_xml_thread(): Done retrieving: data size 43855345
Fri 17 Jan 2014 15:31:05 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:31:05 - XML: Start document: iteration 6
Fri 17 Jan 2014 15:31:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855345
Fri 17 Jan 2014 15:31:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:31:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855345
Fri 17 Jan 2014 15:31:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:31:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:31:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:31:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:31:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:31:24 - XML: Processed 655466 elements - found 633 jobs
Fri 17 Jan 2014 15:31:24 - job 7348112 appears to have finished
Fri 17 Jan 2014 15:31:25 - job 7348370 appears to have finished
Fri 17 Jan 2014 15:31:25 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 15:31:25 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 15:31:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:31:27 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:31:27 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 15:31:27 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:31:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:31:27 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:31:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:31:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:31:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:31:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:31:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:31:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:31:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:31:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:31:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:31:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:31:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:31:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:31:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:31:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:31:29 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:31:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 15:31:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:31:32 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 15:31:32 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 15:31:32 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:31:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:31:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856879
Fri 17 Jan 2014 15:31:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:31:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43856879
Fri 17 Jan 2014 15:31:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:31:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:31:41 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:31:42 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:31:42 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:31:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:31:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:31:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:31:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:31:45 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:31:45 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:31:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:31:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:31:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:31:46 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:31:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:31:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:31:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:31:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:31:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:31:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:31:47 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:31:47 - job_xml_thread(): Done retrieving: data size 43860637
Fri 17 Jan 2014 15:31:47 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:31:47 - XML: Start document: iteration 7
Fri 17 Jan 2014 15:31:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43860637
Fri 17 Jan 2014 15:31:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43860637
Fri 17 Jan 2014 15:31:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:31:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:32:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:32:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:32:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:32:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:32:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:32:01 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:32:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:32:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 15:32:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:32:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:32:02 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:32:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 15:32:03 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:32:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:32:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8733 values 137992 bits 17249 bytes 
Fri 17 Jan 2014 15:32:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:32:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:32:04 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:32:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:32:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:32:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:32:10 - XML: Processed 655466 elements - found 633 jobs
Fri 17 Jan 2014 15:32:10 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:32:10 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:32:10 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:32:10 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:32:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:32:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:32:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:32:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:32:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:32:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:32:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:32:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:32:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:32:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43849103
Fri 17 Jan 2014 15:32:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:32:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43849103
Fri 17 Jan 2014 15:32:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:32:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:32:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:32:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:32:25 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:32:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:32:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:32:26 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:32:26 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:32:26 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:32:26 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:32:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:32:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:32:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:32:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:32:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:32:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:32:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:32:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:32:28 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:32:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 15:32:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:32:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:32:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:32:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:32:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:32:29 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:32:29 - job_xml_thread(): Done retrieving: data size 43869819
Fri 17 Jan 2014 15:32:29 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:32:29 - XML: Start document: iteration 8
Fri 17 Jan 2014 15:32:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43869819
Fri 17 Jan 2014 15:32:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:32:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43869819
Fri 17 Jan 2014 15:32:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:32:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:32:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:32:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:32:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:32:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:32:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:32:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:32:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:32:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:32:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:32:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:32:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:32:48 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:32:49 - XML: Processed 655466 elements - found 633 jobs
Fri 17 Jan 2014 15:32:49 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:32:49 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:32:49 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:32:49 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:32:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:32:52 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:32:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:32:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:32:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:32:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:32:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:32:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:32:54 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:32:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43884335
Fri 17 Jan 2014 15:32:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:32:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43884335
Fri 17 Jan 2014 15:32:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:33:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:33:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:33:04 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:33:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:33:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:33:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:33:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:33:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:33:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:33:04 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:33:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 15:33:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 15:33:04 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:33:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9150 values 144734 bits 18091 bytes 
Fri 17 Jan 2014 15:33:04 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:33:05 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:33:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:33:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:33:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:33:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:33:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:33:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:33:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:33:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:33:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:33:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:33:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:33:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:33:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:33:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:33:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:33:11 - job_xml_thread(): Done retrieving: data size 43873839
Fri 17 Jan 2014 15:33:11 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:33:11 - XML: Start document: iteration 9
Fri 17 Jan 2014 15:33:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873839
Fri 17 Jan 2014 15:33:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:33:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873839
Fri 17 Jan 2014 15:33:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:33:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:33:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:33:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:33:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:33:27 - XML: Processed 655466 elements - found 633 jobs
Fri 17 Jan 2014 15:33:27 - job 7348371 appears to have finished
Fri 17 Jan 2014 15:33:27 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 15:33:27 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 15:33:28 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 15:33:28 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:33:28 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:33:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:33:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:33:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:33:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:33:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:33:34 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:33:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:33:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:33:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:33:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:33:34 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:33:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:33:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:33:35 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:33:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 15:33:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:33:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:33:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:33:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:33:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:33:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:33:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43877681
Fri 17 Jan 2014 15:33:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:33:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43877681
Fri 17 Jan 2014 15:33:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:33:44 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:33:44 - job_xml_thread(): Done retrieving: data size 43877681
Fri 17 Jan 2014 15:33:44 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:33:44 - XML: Start document: iteration 10
Fri 17 Jan 2014 15:33:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:33:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:33:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:33:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:33:50 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:33:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:33:50 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:33:50 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:33:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:33:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:33:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:33:54 - XML: Processed 655466 elements - found 633 jobs
Fri 17 Jan 2014 15:33:54 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:33:54 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:33:54 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:33:55 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:33:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:33:57 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:33:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:33:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:33:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:33:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:33:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:33:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:33:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:33:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858273
Fri 17 Jan 2014 15:33:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:33:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43858273
Fri 17 Jan 2014 15:33:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:34:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:34:05 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:34:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:34:05 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:34:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:34:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:34:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 15:34:05 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:34:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 15:34:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8490 values 133992 bits 16749 bytes 
Fri 17 Jan 2014 15:34:10 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:34:10 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:34:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:34:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:34:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:34:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:34:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:34:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:34:12 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:34:12 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:34:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:34:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:34:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:34:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:34:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:34:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:34:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:34:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:34:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:34:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:34:17 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:34:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 15:34:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:34:17 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:34:17 - job_xml_thread(): Done retrieving: data size 43844422
Fri 17 Jan 2014 15:34:17 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:34:17 - XML: Start document: iteration 11
Fri 17 Jan 2014 15:34:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43844422
Fri 17 Jan 2014 15:34:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:34:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43844422
Fri 17 Jan 2014 15:34:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:34:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:34:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:34:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:34:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:34:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:34:31 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:34:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:34:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:34:32 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:34:32 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:34:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:34:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:34:32 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:34:36 - XML: Processed 655466 elements - found 633 jobs
Fri 17 Jan 2014 15:34:36 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:34:36 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:34:36 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:34:36 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:34:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:34:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:34:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:34:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:34:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:34:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:34:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:34:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:34:41 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:34:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43868808
Fri 17 Jan 2014 15:34:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:34:42 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 15:34:42 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:34:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43868808
Fri 17 Jan 2014 15:34:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:34:42 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:34:42 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 15:34:42 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 15:34:43 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:34:43 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 15:34:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:34:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Fri 17 Jan 2014 15:34:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:34:50 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:34:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:34:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:34:51 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:34:51 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:34:52 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:34:52 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:34:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:34:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:34:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:34:55 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:34:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:34:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:34:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:34:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:34:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:34:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:34:56 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:34:56 - job_xml_thread(): Done retrieving: data size 43888632
Fri 17 Jan 2014 15:34:56 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:34:56 - XML: Start document: iteration 12
Fri 17 Jan 2014 15:34:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43888632
Fri 17 Jan 2014 15:34:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43888632
Fri 17 Jan 2014 15:34:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:34:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:35:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:35:06 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:35:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:35:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:35:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:35:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 15:35:08 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:35:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 15:35:08 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:35:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148667 bits 18583 bytes 
Fri 17 Jan 2014 15:35:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:35:09 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:35:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:35:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:35:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:35:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:35:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:35:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:35:10 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:35:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:35:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:35:16 - XML: Processed 655466 elements - found 633 jobs
Fri 17 Jan 2014 15:35:16 - job 7348128 appears to have finished
Fri 17 Jan 2014 15:35:16 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 15:35:16 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 15:35:16 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 15:35:16 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:35:16 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:35:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:35:20 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:35:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:35:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:35:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:35:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:35:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:35:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:35:21 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:35:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43771404
Fri 17 Jan 2014 15:35:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:35:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43771404
Fri 17 Jan 2014 15:35:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:35:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:35:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:35:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:35:31 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:35:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:35:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:35:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:35:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:35:31 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:35:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43771404
Fri 17 Jan 2014 15:35:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:35:31 - job_xml_thread(): Done retrieving: data size 43771404
Fri 17 Jan 2014 15:35:31 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:35:31 - XML: Start document: iteration 13
Fri 17 Jan 2014 15:35:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:35:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:35:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:35:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:35:43 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:35:44 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:35:44 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:35:44 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:35:44 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 15:35:44 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 15:35:44 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 15:35:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:35:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:35:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:35:48 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:35:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:35:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:35:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:35:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:35:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:35:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:35:48 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:35:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:35:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:35:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:35:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:35:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:35:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:35:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:35:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:35:52 - XML: Processed 654718 elements - found 633 jobs
Fri 17 Jan 2014 15:35:52 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:35:52 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:35:52 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:35:52 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:35:53 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 927060 values 14645840 bits 1830730 bytes 
Fri 17 Jan 2014 15:35:53 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:35:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 15:35:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:35:56 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:35:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43226706
Fri 17 Jan 2014 15:35:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:35:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43226706
Fri 17 Jan 2014 15:35:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:36:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:36:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:36:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:36:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:36:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:36:07 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:36:07 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:36:07 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:36:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:36:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:36:08 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:36:08 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:36:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:36:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:36:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:36:09 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:36:09 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:36:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 15:36:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:36:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 15:36:09 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:36:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5971 values 94183 bits 11772 bytes 
Fri 17 Jan 2014 15:36:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:36:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:36:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:36:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:36:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:36:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:36:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:36:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:36:15 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:36:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 15:36:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:36:15 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:36:15 - job_xml_thread(): Done retrieving: data size 43229796
Fri 17 Jan 2014 15:36:15 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:36:15 - XML: Start document: iteration 14
Fri 17 Jan 2014 15:36:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43229796
Fri 17 Jan 2014 15:36:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:36:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43229796
Fri 17 Jan 2014 15:36:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:36:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:36:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:36:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:36:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:36:30 - XML: Processed 647694 elements - found 633 jobs
Fri 17 Jan 2014 15:36:30 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:36:30 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:36:31 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:36:31 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:36:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:36:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:36:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:36:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:36:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:36:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:36:34 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:36:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:36:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:36:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:36:36 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:36:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:36:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:36:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:36:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:36:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:36:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:36:40 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:36:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43608710
Fri 17 Jan 2014 15:36:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:36:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43608710
Fri 17 Jan 2014 15:36:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:36:44 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:36:44 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 15:36:46 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:36:46 - job_xml_thread(): Done retrieving: data size 43608710
Fri 17 Jan 2014 15:36:46 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:36:46 - XML: Start document: iteration 15
Fri 17 Jan 2014 15:36:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:36:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:36:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:36:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:36:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:36:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:36:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:36:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:36:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:36:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:36:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:36:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:36:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:37:02 - XML: Processed 652076 elements - found 633 jobs
Fri 17 Jan 2014 15:37:02 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:37:02 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:37:02 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:37:02 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:37:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:37:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:37:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:37:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:37:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:37:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:37:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:37:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:37:07 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:37:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43857643
Fri 17 Jan 2014 15:37:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:37:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43857643
Fri 17 Jan 2014 15:37:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:37:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:37:09 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:37:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:37:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 15:37:11 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:37:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 15:37:11 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:37:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148634 bits 18579 bytes 
Fri 17 Jan 2014 15:37:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:37:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:37:17 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:37:17 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:37:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:37:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:37:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:37:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:37:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:37:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:37:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:37:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:37:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:37:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:37:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:37:23 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:37:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:37:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:37:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:37:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:37:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:37:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:37:26 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:37:26 - job_xml_thread(): Done retrieving: data size 43865933
Fri 17 Jan 2014 15:37:26 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:37:26 - XML: Start document: iteration 16
Fri 17 Jan 2014 15:37:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43865933
Fri 17 Jan 2014 15:37:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865933
Fri 17 Jan 2014 15:37:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:37:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:37:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:37:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:37:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:37:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:37:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:37:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:37:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:37:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:37:45 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:37:45 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:37:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:37:45 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:37:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:37:46 - XML: Processed 655464 elements - found 632 jobs
Fri 17 Jan 2014 15:37:46 - job 7348373 appears to have finished
Fri 17 Jan 2014 15:37:46 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 15:37:46 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 15:37:47 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:37:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 15:37:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:37:48 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 15:37:48 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:37:48 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:37:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:37:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:37:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:37:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:37:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:37:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:37:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:37:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:37:53 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:37:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43864525
Fri 17 Jan 2014 15:37:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:37:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43864525
Fri 17 Jan 2014 15:37:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:38:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:38:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:38:03 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:38:03 - job_xml_thread(): Done retrieving: data size 43864525
Fri 17 Jan 2014 15:38:03 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:38:03 - XML: Start document: iteration 17
Fri 17 Jan 2014 15:38:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:38:03 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:38:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:38:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:38:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:38:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:38:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:38:05 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:38:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:38:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:38:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:38:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:38:11 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:38:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:38:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 15:38:12 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:38:12 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:38:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5925 values 93481 bits 11685 bytes 
Fri 17 Jan 2014 15:38:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 15:38:13 - XML: Processed 655464 elements - found 632 jobs
Fri 17 Jan 2014 15:38:13 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:38:13 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:38:13 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:38:13 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:38:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:38:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:38:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:38:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:38:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:38:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:38:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:38:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:38:19 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 15:38:19 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 15:38:19 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:38:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:38:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43830210
Fri 17 Jan 2014 15:38:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:38:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43830210
Fri 17 Jan 2014 15:38:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:38:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:38:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:38:28 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:38:29 - job_xml_thread(): Done retrieving: data size 43830210
Fri 17 Jan 2014 15:38:29 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:38:29 - XML: Start document: iteration 18
Fri 17 Jan 2014 15:38:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:38:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:38:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:38:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:38:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:38:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:38:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:38:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:38:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:38:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:38:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:38:39 - XML: Processed 655464 elements - found 632 jobs
Fri 17 Jan 2014 15:38:39 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:38:39 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:38:39 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:38:40 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:38:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:38:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:38:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:38:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:38:43 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:38:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 15:38:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:38:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:38:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:38:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:38:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:38:44 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:38:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43842941
Fri 17 Jan 2014 15:38:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:38:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43842941
Fri 17 Jan 2014 15:38:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:38:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:38:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:38:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:38:54 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:38:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:38:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:38:55 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:38:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:38:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:38:55 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:38:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:38:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:38:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:38:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:38:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:38:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:38:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:38:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:38:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:38:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:38:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:38:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862062
Fri 17 Jan 2014 15:38:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:39:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862062
Fri 17 Jan 2014 15:39:00 - job_xml_thread(): Done retrieving: data size 43862062
Fri 17 Jan 2014 15:39:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:39:00 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:39:00 - XML: Start document: iteration 19
Fri 17 Jan 2014 15:39:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:39:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:39:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:39:12 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:39:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:39:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 15:39:13 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:39:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8885 values 140067 bits 17508 bytes 
Fri 17 Jan 2014 15:39:13 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:39:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 15:39:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:39:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:39:19 - XML: Processed 655462 elements - found 631 jobs
Fri 17 Jan 2014 15:39:19 - job 7348154 appears to have finished
Fri 17 Jan 2014 15:39:19 - job 7346008 appears to have finished
Fri 17 Jan 2014 15:39:20 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 15:39:20 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 15:39:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:39:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:39:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:39:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:39:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:39:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:39:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:39:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:39:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:39:22 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 15:39:22 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:39:22 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:39:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:39:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:39:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:39:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:39:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:39:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:39:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:39:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:39:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:39:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43877699
Fri 17 Jan 2014 15:39:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:39:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43877699
Fri 17 Jan 2014 15:39:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:39:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:39:34 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:39:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:39:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:39:37 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:39:37 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:39:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:39:37 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:39:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:39:37 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:39:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:39:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:39:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:39:40 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:39:40 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:39:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 15:39:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:39:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:39:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:39:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:39:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:39:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:39:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:39:42 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:39:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856754
Fri 17 Jan 2014 15:39:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:39:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43856754
Fri 17 Jan 2014 15:39:42 - job_xml_thread(): Done retrieving: data size 43856754
Fri 17 Jan 2014 15:39:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:39:43 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:39:43 - XML: Start document: iteration 20
Fri 17 Jan 2014 15:39:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:39:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:39:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:39:54 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:39:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:39:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:39:56 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:39:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:39:56 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:39:56 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:39:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:39:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:39:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:40:02 - XML: Processed 655462 elements - found 631 jobs
Fri 17 Jan 2014 15:40:02 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:40:02 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:40:02 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:40:02 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:40:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:40:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:40:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:40:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:40:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:40:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:40:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:40:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:40:06 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:40:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43846152
Fri 17 Jan 2014 15:40:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:40:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43846152
Fri 17 Jan 2014 15:40:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:40:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:40:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:40:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:40:13 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:40:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:40:14 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:40:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:40:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:40:15 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:40:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 15:40:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:40:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 15:40:15 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:40:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9161 values 144490 bits 18061 bytes 
Fri 17 Jan 2014 15:40:16 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:40:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:40:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43846152
Fri 17 Jan 2014 15:40:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:40:16 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:40:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:40:17 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:40:17 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:40:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:40:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:40:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:40:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:40:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:40:27 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:40:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:40:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:40:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:40:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:40:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:40:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:40:29 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:40:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 15:40:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:40:29 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:40:29 - job_xml_thread(): Done retrieving: data size 43828342
Fri 17 Jan 2014 15:40:29 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:40:29 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 15:40:29 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 15:40:29 - Housekeeping: done.
Fri 17 Jan 2014 15:40:29 - XML: Start document: iteration 0
Fri 17 Jan 2014 15:40:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43828342
Fri 17 Jan 2014 15:40:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:40:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:40:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:40:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:40:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:40:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:40:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:40:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43828342
Fri 17 Jan 2014 15:40:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:40:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:40:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:40:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:40:46 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:40:46 - XML: Processed 655461 elements - found 631 jobs
Fri 17 Jan 2014 15:40:46 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:40:46 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:40:46 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:40:46 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:40:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:40:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:40:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:40:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:40:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:40:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:40:48 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:40:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:40:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:40:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:40:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:40:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:40:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:40:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:40:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:40:51 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:40:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873551
Fri 17 Jan 2014 15:40:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:40:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873551
Fri 17 Jan 2014 15:40:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:41:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:41:01 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:41:02 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:41:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:41:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:41:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:41:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:41:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:41:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:41:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:41:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:41:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:41:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:41:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:41:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:41:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:41:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:41:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:41:07 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:41:07 - job_xml_thread(): Done retrieving: data size 43866659
Fri 17 Jan 2014 15:41:07 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:41:07 - XML: Start document: iteration 1
Fri 17 Jan 2014 15:41:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43866659
Fri 17 Jan 2014 15:41:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:41:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43866659
Fri 17 Jan 2014 15:41:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:41:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:41:15 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:41:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:41:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 15:41:17 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:41:17 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:41:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 15:41:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9457 values 149131 bits 18641 bytes 
Fri 17 Jan 2014 15:41:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:41:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:41:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:41:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:41:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:41:27 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:41:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:41:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:41:29 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:41:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:41:29 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:41:29 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:41:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:41:29 - XML: Processed 655436 elements - found 630 jobs
Fri 17 Jan 2014 15:41:29 - job 7346761 appears to have finished
Fri 17 Jan 2014 15:41:29 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 15:41:29 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 15:41:29 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 15:41:29 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:41:29 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:41:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:41:31 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:41:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:41:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:41:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:41:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:41:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:41:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:41:33 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:41:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43355816
Fri 17 Jan 2014 15:41:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:41:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43355816
Fri 17 Jan 2014 15:41:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:41:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:41:42 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:41:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:41:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:41:45 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:41:45 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:41:45 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:41:45 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:41:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:41:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:41:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:41:46 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:41:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:41:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:41:47 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:41:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 15:41:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:41:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:41:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:41:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:41:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:41:48 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:41:48 - job_xml_thread(): Done retrieving: data size 43241859
Fri 17 Jan 2014 15:41:48 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:41:48 - XML: Start document: iteration 2
Fri 17 Jan 2014 15:41:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43241859
Fri 17 Jan 2014 15:41:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:41:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43241859
Fri 17 Jan 2014 15:41:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:41:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:41:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:42:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:42:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:42:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:42:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:42:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:42:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:42:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:42:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:42:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:42:08 - XML: Processed 647784 elements - found 630 jobs
Fri 17 Jan 2014 15:42:08 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:42:08 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:42:08 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:42:09 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:42:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:42:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:42:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:42:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:42:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:42:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:42:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:42:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:42:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:42:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43223736
Fri 17 Jan 2014 15:42:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:42:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43223736
Fri 17 Jan 2014 15:42:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:42:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:42:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:42:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:42:18 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:42:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:42:18 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:42:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 15:42:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 15:42:18 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:42:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8938 values 140978 bits 17622 bytes 
Fri 17 Jan 2014 15:42:24 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:42:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:42:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:42:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:42:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:42:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:42:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:42:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:42:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:42:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:42:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:42:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:42:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:42:27 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:42:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:42:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:42:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:42:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:42:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:42:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:42:30 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:42:30 - job_xml_thread(): Done retrieving: data size 43478060
Fri 17 Jan 2014 15:42:30 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:42:30 - XML: Start document: iteration 3
Fri 17 Jan 2014 15:42:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43478060
Fri 17 Jan 2014 15:42:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43478060
Fri 17 Jan 2014 15:42:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:42:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:42:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:42:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:42:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:42:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:42:44 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 15:42:45 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:42:45 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:42:45 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 15:42:45 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 15:42:45 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:42:45 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 15:42:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:42:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:42:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:42:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:42:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:42:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:42:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:42:49 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:42:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:42:50 - XML: Processed 650822 elements - found 630 jobs
Fri 17 Jan 2014 15:42:50 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:42:50 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:42:50 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:42:51 - job_xml_thread(): Sleeping.. (15s)
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Fri 17 Jan 2014 15:42:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:42:53 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:42:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:42:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:42:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:42:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:42:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:42:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:42:54 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:42:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 15:42:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:42:55 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:42:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43821069
Fri 17 Jan 2014 15:42:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:42:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43821069
Fri 17 Jan 2014 15:42:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:43:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:43:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:43:06 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:43:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:43:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:43:07 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:43:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:43:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:43:08 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:43:08 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:43:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:43:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:43:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:43:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:43:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:43:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:43:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:43:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:43:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:43:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:43:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:43:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:43:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:43:12 - job_xml_thread(): Done retrieving: data size 43857442
Fri 17 Jan 2014 15:43:12 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:43:12 - XML: Start document: iteration 4
Fri 17 Jan 2014 15:43:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43857442
Fri 17 Jan 2014 15:43:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43857442
Fri 17 Jan 2014 15:43:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:43:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:43:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:43:19 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:43:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:43:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 15:43:21 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:43:21 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:43:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 15:43:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:43:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:43:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:43:25 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:43:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8909 values 140515 bits 17564 bytes 
Fri 17 Jan 2014 15:43:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:43:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:43:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:43:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:43:26 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:43:26 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:43:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:43:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:43:26 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:43:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:43:33 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:43:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:43:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:43:34 - XML: Processed 655462 elements - found 631 jobs
Fri 17 Jan 2014 15:43:34 - job 7348144 appears to have finished
Fri 17 Jan 2014 15:43:34 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 15:43:34 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 15:43:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:43:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:43:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:43:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:43:34 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 15:43:34 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:43:34 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:43:37 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:43:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43846592
Fri 17 Jan 2014 15:43:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:43:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43846592
Fri 17 Jan 2014 15:43:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:43:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:43:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:43:45 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:43:45 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:43:46 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:43:46 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:43:46 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 15:43:46 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 15:43:46 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 15:43:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:43:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:43:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:43:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:43:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:43:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:43:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:43:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:43:48 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:43:50 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:43:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:43:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Fri 17 Jan 2014 15:43:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:43:53 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:43:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:43:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:43:53 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:43:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 15:43:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:43:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:43:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:43:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:43:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:43:55 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:43:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873442
Fri 17 Jan 2014 15:43:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:43:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873442
Fri 17 Jan 2014 15:43:55 - job_xml_thread(): Done retrieving: data size 43873442
Fri 17 Jan 2014 15:43:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:43:55 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:43:55 - XML: Start document: iteration 5
Fri 17 Jan 2014 15:44:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:44:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:44:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:44:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:44:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:44:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:44:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:44:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:44:11 - XML: Processed 655462 elements - found 631 jobs
Fri 17 Jan 2014 15:44:11 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:44:11 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:44:11 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:44:11 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:44:11 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:44:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:44:11 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:44:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:44:11 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:44:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:44:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:44:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:44:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:44:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:44:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:44:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:44:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:44:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:44:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43847804
Fri 17 Jan 2014 15:44:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:44:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43847804
Fri 17 Jan 2014 15:44:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:44:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:44:21 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:44:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:44:24 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:44:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 15:44:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 15:44:24 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:44:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8870 values 139881 bits 17485 bytes 
Fri 17 Jan 2014 15:44:26 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:44:26 - job_xml_thread(): Done retrieving: data size 43847804
Fri 17 Jan 2014 15:44:26 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:44:26 - XML: Start document: iteration 6
Fri 17 Jan 2014 15:44:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:44:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:44:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:44:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:44:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:44:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:44:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:44:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:44:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:44:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:44:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:44:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:44:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:44:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:44:37 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:44:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:44:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:44:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:44:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:44:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:44:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:44:40 - XML: Processed 655462 elements - found 631 jobs
Fri 17 Jan 2014 15:44:40 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:44:40 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:44:40 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:44:40 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:44:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:44:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862432
Fri 17 Jan 2014 15:44:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:44:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862432
Fri 17 Jan 2014 15:44:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:44:46 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:44:47 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:44:48 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:44:48 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 15:44:48 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 15:44:48 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:44:48 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 15:44:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:44:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:44:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:44:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:44:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:44:54 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:44:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:44:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:44:54 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:44:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:44:54 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:44:54 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:44:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:44:55 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:44:56 - size of cluster 'LISA Cluster': 624 hosts 79477 metrics 975587 values 15386728 bits 1923341 bytes 
Fri 17 Jan 2014 15:44:58 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:44:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 15:44:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:45:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:45:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:45:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:45:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:45:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:45:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:45:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:45:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:45:03 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:45:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43848773
Fri 17 Jan 2014 15:45:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:45:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43848773
Fri 17 Jan 2014 15:45:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:45:04 - job_xml_thread(): Done retrieving: data size 43848773
Fri 17 Jan 2014 15:45:04 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:45:04 - XML: Start document: iteration 7
Fri 17 Jan 2014 15:45:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:45:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:45:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:45:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:45:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:45:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:45:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:45:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:45:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:45:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:45:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:45:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:45:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:45:23 - XML: Processed 655466 elements - found 633 jobs
Fri 17 Jan 2014 15:45:23 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 15:45:23 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 15:45:23 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 15:45:23 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:45:23 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:45:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:45:24 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:45:24 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:45:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 15:45:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:45:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 15:45:24 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:45:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5948 values 93840 bits 11730 bytes 
Fri 17 Jan 2014 15:45:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:45:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:45:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:45:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:45:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:45:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:45:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:45:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:45:31 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 15:45:31 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 15:45:31 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:45:31 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:45:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43839573
Fri 17 Jan 2014 15:45:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:45:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43839573
Fri 17 Jan 2014 15:45:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:45:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:45:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:45:38 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:45:38 - job_xml_thread(): Done retrieving: data size 43839573
Fri 17 Jan 2014 15:45:38 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:45:38 - XML: Start document: iteration 8
Fri 17 Jan 2014 15:45:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:45:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:45:48 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:45:48 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 15:45:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:45:49 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:45:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:45:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:45:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:45:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:45:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:45:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:45:51 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:45:51 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:45:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:45:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:45:51 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:45:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:45:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:45:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:45:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:45:54 - XML: Processed 655466 elements - found 633 jobs
Fri 17 Jan 2014 15:45:54 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:45:54 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:45:54 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:45:54 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:45:55 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:45:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 15:45:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:45:56 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:45:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43879453
Fri 17 Jan 2014 15:45:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:45:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43879453
Fri 17 Jan 2014 15:45:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:46:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:46:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:46:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:46:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:46:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:46:08 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:46:08 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:46:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:46:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:46:08 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:46:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:46:09 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:46:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:46:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:46:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:46:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:46:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:46:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:46:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:46:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:46:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:46:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43872912
Fri 17 Jan 2014 15:46:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:46:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43872912
Fri 17 Jan 2014 15:46:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:46:13 - job_xml_thread(): Done retrieving: data size 43872912
Fri 17 Jan 2014 15:46:13 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:46:13 - XML: Start document: iteration 9
Fri 17 Jan 2014 15:46:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:46:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:46:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:46:25 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:46:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:46:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:46:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:46:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 15:46:26 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:46:26 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:46:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 15:46:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:46:27 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:46:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8857 values 139826 bits 17478 bytes 
Fri 17 Jan 2014 15:46:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:46:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:46:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:46:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:46:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:46:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:46:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:46:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:46:31 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:46:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:46:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:46:32 - XML: Processed 655466 elements - found 633 jobs
Fri 17 Jan 2014 15:46:32 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:46:32 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:46:32 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:46:32 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:46:32 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:46:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:46:32 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:46:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:46:34 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:46:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43869284
Fri 17 Jan 2014 15:46:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:46:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43869284
Fri 17 Jan 2014 15:46:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:46:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:46:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:46:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:46:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:46:47 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:46:47 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:46:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:46:48 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:46:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:46:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:46:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:46:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:46:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:46:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:46:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:46:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:46:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:46:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:46:50 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:46:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 15:46:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:46:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:46:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:46:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:46:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:46:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:46:52 - job_xml_thread(): Done retrieving: data size 43880772
Fri 17 Jan 2014 15:46:52 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:46:52 - XML: Start document: iteration 10
Fri 17 Jan 2014 15:46:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43880772
Fri 17 Jan 2014 15:46:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:46:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43880772
Fri 17 Jan 2014 15:46:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:47:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:47:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:47:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:47:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:47:13 - XML: Processed 655466 elements - found 633 jobs
Fri 17 Jan 2014 15:47:14 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:47:14 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:47:14 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:47:14 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:47:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:47:14 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:47:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:47:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:47:14 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:47:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:47:14 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:47:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:47:14 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:47:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:47:15 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:47:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:47:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:47:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:47:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:47:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:47:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:47:17 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:47:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43805069
Fri 17 Jan 2014 15:47:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:47:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43805069
Fri 17 Jan 2014 15:47:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:47:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:47:26 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:47:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:47:27 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:47:27 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:47:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:47:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 15:47:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 15:47:28 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:47:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8783 values 138835 bits 17354 bytes 
Fri 17 Jan 2014 15:47:29 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:47:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:47:29 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:47:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:47:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:47:31 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:47:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:47:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:47:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:47:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:47:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:47:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:47:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:47:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:47:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:47:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:47:33 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:47:33 - job_xml_thread(): Done retrieving: data size 43331011
Fri 17 Jan 2014 15:47:33 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:47:33 - XML: Start document: iteration 11
Fri 17 Jan 2014 15:47:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43331011
Fri 17 Jan 2014 15:47:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:47:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43331011
Fri 17 Jan 2014 15:47:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:47:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:47:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:47:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:47:46 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:47:46 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:47:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 15:47:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:47:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:47:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:47:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:47:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:47:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:47:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:47:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:47:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:47:48 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:47:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:47:53 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:47:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:47:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:47:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:47:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:47:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:47:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:47:55 - XML: Processed 648844 elements - found 636 jobs
Fri 17 Jan 2014 15:47:55 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 15:47:55 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 15:47:55 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 15:47:55 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:47:55 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:47:56 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:47:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43196448
Fri 17 Jan 2014 15:47:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:47:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43196448
Fri 17 Jan 2014 15:47:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:48:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:48:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:48:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:48:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:48:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:48:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:48:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:48:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:48:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:48:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:48:10 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:48:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:48:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:48:10 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:48:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:48:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:48:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:48:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:48:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:48:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:48:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:48:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:48:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:48:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43258478
Fri 17 Jan 2014 15:48:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:48:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43258478
Fri 17 Jan 2014 15:48:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:48:13 - job_xml_thread(): Done retrieving: data size 43258478
Fri 17 Jan 2014 15:48:13 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:48:13 - XML: Start document: iteration 12
Fri 17 Jan 2014 15:48:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:48:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:48:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:48:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:48:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:48:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:48:26 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:48:26 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:48:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:48:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:48:26 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:48:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:48:28 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:48:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:48:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 15:48:28 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:48:28 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:48:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 15:48:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9147 values 144603 bits 18075 bytes 
Fri 17 Jan 2014 15:48:30 - XML: Processed 647904 elements - found 636 jobs
Fri 17 Jan 2014 15:48:30 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:48:30 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:48:30 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:48:30 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:48:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:48:34 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:48:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:48:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:48:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:48:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:48:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:48:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:48:37 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:48:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43303212
Fri 17 Jan 2014 15:48:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:48:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43303212
Fri 17 Jan 2014 15:48:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:48:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:48:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:48:45 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:48:45 - job_xml_thread(): Done retrieving: data size 43303212
Fri 17 Jan 2014 15:48:45 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:48:45 - XML: Start document: iteration 13
Fri 17 Jan 2014 15:48:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:48:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:48:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:48:50 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:48:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:48:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:48:51 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:48:51 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:48:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:48:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:48:51 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:48:56 - XML: Processed 648560 elements - found 636 jobs
Fri 17 Jan 2014 15:48:56 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:48:56 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:48:56 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:48:56 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:48:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:48:59 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:48:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:48:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:48:59 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:48:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 15:48:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:48:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:48:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:48:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:48:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:49:01 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:49:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43836539
Fri 17 Jan 2014 15:49:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:49:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43836539
Fri 17 Jan 2014 15:49:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:49:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:49:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:49:11 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:49:11 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:49:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:49:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:49:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:49:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:49:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:49:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:49:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:49:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:49:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:49:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:49:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:49:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:49:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:49:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:49:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:49:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:49:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:49:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:49:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:49:18 - job_xml_thread(): Done retrieving: data size 43846247
Fri 17 Jan 2014 15:49:18 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:49:18 - XML: Start document: iteration 14
Fri 17 Jan 2014 15:49:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43846247
Fri 17 Jan 2014 15:49:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:49:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43846247
Fri 17 Jan 2014 15:49:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:49:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:49:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:49:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:49:29 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:49:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:49:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 15:49:30 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:49:30 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:49:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 15:49:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8707 values 137383 bits 17172 bytes 
Fri 17 Jan 2014 15:49:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:49:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:49:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:49:34 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:49:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:49:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:49:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:49:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:49:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:49:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:49:34 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:49:36 - XML: Processed 655472 elements - found 636 jobs
Fri 17 Jan 2014 15:49:36 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:49:36 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:49:36 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:49:36 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:49:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:49:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:49:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:49:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:49:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:49:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:49:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:49:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:49:41 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:49:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43859582
Fri 17 Jan 2014 15:49:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:49:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43859582
Fri 17 Jan 2014 15:49:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:49:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:49:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:49:51 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:49:52 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:49:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:49:53 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:49:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:49:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:49:53 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:49:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:49:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:49:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:49:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:49:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:49:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:49:57 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:49:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:49:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:49:57 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:49:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 15:49:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:49:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:49:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:49:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:49:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:49:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:49:58 - job_xml_thread(): Done retrieving: data size 43847671
Fri 17 Jan 2014 15:49:58 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:49:58 - XML: Start document: iteration 15
Fri 17 Jan 2014 15:49:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43847671
Fri 17 Jan 2014 15:49:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43847671
Fri 17 Jan 2014 15:49:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:49:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:50:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:50:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:50:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:50:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:50:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:50:16 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:50:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:50:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:50:17 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:50:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:50:17 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:50:17 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:50:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:50:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:50:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:50:22 - XML: Processed 655472 elements - found 636 jobs
Fri 17 Jan 2014 15:50:22 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:50:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:50:22 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:50:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:50:22 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:50:22 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:50:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:50:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:50:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:50:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:50:24 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:50:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43863548
Fri 17 Jan 2014 15:50:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:50:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43863548
Fri 17 Jan 2014 15:50:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:50:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:50:30 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:50:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:50:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 15:50:32 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:50:32 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:50:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 15:50:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8950 values 141180 bits 17647 bytes 
Fri 17 Jan 2014 15:50:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:50:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:50:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:50:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:50:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:50:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:50:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:50:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:50:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:50:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:50:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:50:38 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:50:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:50:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:50:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:50:40 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:50:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:50:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:50:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:50:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:50:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:50:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:50:42 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:50:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862673
Fri 17 Jan 2014 15:50:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:50:43 - job_xml_thread(): Done retrieving: data size 43862673
Fri 17 Jan 2014 15:50:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862673
Fri 17 Jan 2014 15:50:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:50:43 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:50:43 - XML: Start document: iteration 16
Fri 17 Jan 2014 15:50:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:50:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:50:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:50:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:51:03 - XML: Processed 655472 elements - found 636 jobs
Fri 17 Jan 2014 15:51:03 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:51:03 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:51:03 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:51:03 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:51:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:51:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:51:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:51:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:51:06 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:51:06 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:51:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:51:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:51:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:51:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:51:06 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:51:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:51:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:51:07 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:51:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 15:51:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:51:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:51:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:51:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:51:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:51:09 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:51:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43889296
Fri 17 Jan 2014 15:51:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:51:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43889296
Fri 17 Jan 2014 15:51:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:51:18 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:51:18 - job_xml_thread(): Done retrieving: data size 43889296
Fri 17 Jan 2014 15:51:18 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:51:18 - XML: Start document: iteration 17
Fri 17 Jan 2014 15:51:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:51:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:51:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:51:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:51:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:51:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:51:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:51:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:51:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:51:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:51:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:51:27 - XML: Processed 655472 elements - found 636 jobs
Fri 17 Jan 2014 15:51:27 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:51:27 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:51:27 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:51:27 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:51:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:51:31 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:51:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:51:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:51:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:51:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:51:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:51:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:51:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:51:32 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:51:33 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:51:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43842580
Fri 17 Jan 2014 15:51:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:51:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43842580
Fri 17 Jan 2014 15:51:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:51:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:51:34 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:51:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 15:51:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 15:51:34 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:51:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7304 values 115259 bits 14407 bytes 
Fri 17 Jan 2014 15:51:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:51:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:51:42 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:51:42 - job_xml_thread(): Done retrieving: data size 43842580
Fri 17 Jan 2014 15:51:42 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:51:42 - XML: Start document: iteration 18
Fri 17 Jan 2014 15:51:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:51:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:51:50 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 15:51:50 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:51:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:51:50 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:51:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:51:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:51:52 - XML: Processed 655472 elements - found 636 jobs
Fri 17 Jan 2014 15:51:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:51:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:51:52 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:51:52 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:51:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:51:52 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:51:52 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:51:52 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 15:51:52 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 15:51:52 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:51:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:51:52 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:51:52 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:51:52 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 15:51:56 - size of cluster 'LISA Cluster': 624 hosts 79480 metrics 1045762 values 16521846 bits 2065230 bytes 
Fri 17 Jan 2014 15:51:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:51:57 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:51:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:51:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:51:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:51:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:51:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:51:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:51:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:51:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43848555
Fri 17 Jan 2014 15:51:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:52:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43848555
Fri 17 Jan 2014 15:52:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:52:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:52:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:52:07 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:52:07 - job_xml_thread(): Done retrieving: data size 43848555
Fri 17 Jan 2014 15:52:07 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:52:07 - XML: Start document: iteration 19
Fri 17 Jan 2014 15:52:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:52:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:52:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:52:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:52:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:52:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:52:14 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:52:14 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:52:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:52:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:52:14 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:52:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:52:21 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:52:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:52:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:52:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:52:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:52:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:52:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:52:22 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:52:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 15:52:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:52:24 - XML: Processed 655472 elements - found 636 jobs
Fri 17 Jan 2014 15:52:24 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:52:24 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:52:24 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:52:24 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:52:26 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:52:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43838603
Fri 17 Jan 2014 15:52:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:52:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43838603
Fri 17 Jan 2014 15:52:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:52:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:52:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:52:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:52:34 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:52:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:52:35 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:52:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 15:52:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 15:52:35 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:52:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5885 values 92828 bits 11603 bytes 
Fri 17 Jan 2014 15:52:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:52:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:52:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:52:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:52:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:52:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:52:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:52:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:52:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:52:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:52:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:52:39 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:52:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:52:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:52:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:52:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:52:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:52:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:52:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:52:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:52:47 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:52:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853174
Fri 17 Jan 2014 15:52:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:52:48 - job_xml_thread(): Done retrieving: data size 43853174
Fri 17 Jan 2014 15:52:48 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:52:48 - XML: Start document: iteration 20
Fri 17 Jan 2014 15:52:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853174
Fri 17 Jan 2014 15:52:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:52:52 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:52:52 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 15:52:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:52:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:52:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:52:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:53:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:53:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:53:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:53:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:53:06 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:53:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:53:06 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:53:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:53:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:53:08 - XML: Processed 655472 elements - found 636 jobs
Fri 17 Jan 2014 15:53:08 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:53:08 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:53:08 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:53:08 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:53:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:53:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:53:11 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:53:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 15:53:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:53:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:53:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:53:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:53:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:53:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:53:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:53:14 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:53:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43778668
Fri 17 Jan 2014 15:53:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:53:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43778668
Fri 17 Jan 2014 15:53:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:53:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:53:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:53:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:53:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:53:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:53:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:53:23 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:53:23 - job_xml_thread(): Done retrieving: data size 43778668
Fri 17 Jan 2014 15:53:23 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:53:23 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 15:53:23 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 15:53:23 - Housekeeping: done.
Fri 17 Jan 2014 15:53:23 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:53:23 - XML: Start document: iteration 0
Fri 17 Jan 2014 15:53:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:53:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:53:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43778668
Fri 17 Jan 2014 15:53:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:53:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:53:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:53:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:53:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:53:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:53:35 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:53:35 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:53:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:53:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:53:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:53:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 15:53:36 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:53:36 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:53:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5778 values 91071 bits 11383 bytes 
Fri 17 Jan 2014 15:53:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 15:53:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:53:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:53:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:53:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:53:37 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:53:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:53:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:53:42 - XML: Processed 654728 elements - found 638 jobs
Fri 17 Jan 2014 15:53:42 - job 7348158 appears to have finished
Fri 17 Jan 2014 15:53:42 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 15:53:42 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 15:53:42 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 15:53:42 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:53:42 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:53:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:53:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:53:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:53:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:53:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:53:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:53:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:53:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:53:47 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:53:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43248063
Fri 17 Jan 2014 15:53:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:53:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43248063
Fri 17 Jan 2014 15:53:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:53:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:53:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:53:58 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:53:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:53:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:53:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:54:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:54:03 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:54:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:54:03 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:54:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:54:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:54:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:54:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:54:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:54:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:54:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:54:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:54:04 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:54:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 15:54:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:54:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:54:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:54:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:54:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:54:06 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:54:06 - job_xml_thread(): Done retrieving: data size 43203072
Fri 17 Jan 2014 15:54:06 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:54:06 - XML: Start document: iteration 1
Fri 17 Jan 2014 15:54:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43203072
Fri 17 Jan 2014 15:54:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:54:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43203072
Fri 17 Jan 2014 15:54:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:54:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:54:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:54:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:54:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:54:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:54:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:54:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:54:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:54:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:54:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:54:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:54:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:54:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:54:28 - XML: Processed 647276 elements - found 638 jobs
Fri 17 Jan 2014 15:54:28 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:54:28 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:54:28 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:54:28 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:54:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:54:30 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:54:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:54:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:54:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:54:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:54:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:54:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:54:34 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:54:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43240660
Fri 17 Jan 2014 15:54:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:54:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:54:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43240660
Fri 17 Jan 2014 15:54:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:54:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:54:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:54:37 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:54:38 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:54:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 15:54:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:54:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 15:54:38 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:54:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8737 values 137742 bits 17217 bytes 
Fri 17 Jan 2014 15:54:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:54:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:54:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:54:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:54:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:54:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:54:43 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:54:43 - job_xml_thread(): Done retrieving: data size 43240660
Fri 17 Jan 2014 15:54:43 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:54:43 - XML: Start document: iteration 2
Fri 17 Jan 2014 15:54:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:54:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:54:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43240660
Fri 17 Jan 2014 15:54:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:54:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:54:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:54:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:54:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:55:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:55:01 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:55:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:55:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:55:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:55:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:55:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:55:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:55:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:55:04 - XML: Processed 648024 elements - found 638 jobs
Fri 17 Jan 2014 15:55:05 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:55:05 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:55:05 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:55:05 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:55:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:55:06 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:55:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:55:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:55:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:55:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:55:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:55:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:55:09 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:55:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858041
Fri 17 Jan 2014 15:55:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:55:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43858041
Fri 17 Jan 2014 15:55:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:55:12 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:55:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 15:55:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:55:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:55:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:55:20 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:55:20 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:55:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:55:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:55:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:55:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:55:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:55:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:55:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:55:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:55:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:55:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:55:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:55:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:55:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:55:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:55:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:55:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:55:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:55:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:55:26 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:55:26 - job_xml_thread(): Done retrieving: data size 43851390
Fri 17 Jan 2014 15:55:26 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:55:26 - XML: Start document: iteration 3
Fri 17 Jan 2014 15:55:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851390
Fri 17 Jan 2014 15:55:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:55:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851390
Fri 17 Jan 2014 15:55:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:55:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:55:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:55:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:55:38 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:55:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:55:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:55:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:55:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 15:55:39 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:55:39 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:55:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6549 values 103321 bits 12915 bytes 
Fri 17 Jan 2014 15:55:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 15:55:43 - XML: Processed 655478 elements - found 639 jobs
Fri 17 Jan 2014 15:55:43 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 15:55:43 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 15:55:43 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 15:55:43 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:55:43 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:55:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:55:49 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:55:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:55:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:55:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:55:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:55:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:55:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:55:49 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:55:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:55:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:55:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:55:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:55:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:55:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:55:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:55:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:55:50 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 15:55:50 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 15:55:50 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:55:53 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:55:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43881962
Fri 17 Jan 2014 15:55:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:55:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43881962
Fri 17 Jan 2014 15:55:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:55:58 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:55:59 - job_xml_thread(): Done retrieving: data size 43881962
Fri 17 Jan 2014 15:55:59 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:55:59 - XML: Start document: iteration 4
Fri 17 Jan 2014 15:56:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:56:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:56:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:56:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:56:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:56:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:56:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:56:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:56:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:56:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:56:07 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:56:08 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:56:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 15:56:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:56:12 - XML: Processed 655478 elements - found 639 jobs
Fri 17 Jan 2014 15:56:12 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:56:12 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:56:12 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:56:12 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:56:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:56:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:56:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:56:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:56:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:56:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:56:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:56:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:56:16 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:56:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43848464
Fri 17 Jan 2014 15:56:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:56:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43848464
Fri 17 Jan 2014 15:56:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:56:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:56:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:56:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:56:25 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:56:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:56:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:56:27 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:56:27 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:56:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:56:27 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:56:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:56:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:56:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:56:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:56:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:56:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:56:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:56:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:56:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:56:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:56:31 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:56:31 - job_xml_thread(): Done retrieving: data size 43869117
Fri 17 Jan 2014 15:56:31 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:56:31 - XML: Start document: iteration 5
Fri 17 Jan 2014 15:56:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43869117
Fri 17 Jan 2014 15:56:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:56:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43869117
Fri 17 Jan 2014 15:56:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:56:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:56:40 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:56:41 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:56:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:56:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 15:56:41 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:56:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 15:56:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9310 values 146829 bits 18353 bytes 
Fri 17 Jan 2014 15:56:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:56:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:56:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:56:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:56:49 - XML: Processed 655478 elements - found 639 jobs
Fri 17 Jan 2014 15:56:49 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:56:49 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:56:49 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:56:49 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:56:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:56:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:56:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:56:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:56:53 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:56:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:56:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:56:53 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:56:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:56:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:56:53 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:56:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:56:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:56:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:56:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:56:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:56:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:56:56 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:56:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43877556
Fri 17 Jan 2014 15:56:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:56:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43877556
Fri 17 Jan 2014 15:56:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:57:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:57:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:57:04 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:57:04 - job_xml_thread(): Done retrieving: data size 43877556
Fri 17 Jan 2014 15:57:04 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:57:04 - XML: Start document: iteration 6
Fri 17 Jan 2014 15:57:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:57:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:57:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:57:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:57:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:57:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:57:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:57:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:57:09 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:57:14 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:57:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 15:57:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:57:16 - XML: Processed 655476 elements - found 638 jobs
Fri 17 Jan 2014 15:57:16 - job 7348374 appears to have finished
Fri 17 Jan 2014 15:57:16 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 15:57:16 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 15:57:17 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 15:57:17 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:57:17 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:57:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:57:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:57:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:57:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:57:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:57:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:57:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:57:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:57:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:57:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856263
Fri 17 Jan 2014 15:57:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:57:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43856263
Fri 17 Jan 2014 15:57:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:57:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:57:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:57:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:57:29 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:57:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:57:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:57:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:57:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:57:31 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:57:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:57:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:57:33 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:57:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:57:33 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:57:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:57:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:57:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:57:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:57:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:57:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:57:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:57:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43881542
Fri 17 Jan 2014 15:57:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:57:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43881542
Fri 17 Jan 2014 15:57:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:57:36 - job_xml_thread(): Done retrieving: data size 43881542
Fri 17 Jan 2014 15:57:36 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:57:36 - XML: Start document: iteration 7
Fri 17 Jan 2014 15:57:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:57:41 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:57:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:57:42 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:57:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 15:57:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 15:57:42 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:57:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9028 values 142411 bits 17801 bytes 
Fri 17 Jan 2014 15:57:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:57:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:57:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:57:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:57:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:57:56 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:57:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:57:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:57:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:57:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:57:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:57:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:57:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:57:58 - XML: Processed 655476 elements - found 638 jobs
Fri 17 Jan 2014 15:57:58 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:57:58 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:57:58 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:57:58 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:57:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:57:59 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:57:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:57:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:57:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:57:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:57:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:57:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:58:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:58:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867920
Fri 17 Jan 2014 15:58:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:58:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43867920
Fri 17 Jan 2014 15:58:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:58:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:58:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:58:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:58:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:58:13 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:58:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:58:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:58:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:58:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:58:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:58:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:58:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:58:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:58:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:58:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:58:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:58:17 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:58:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 15:58:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:58:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:58:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:58:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:58:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:58:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:58:19 - job_xml_thread(): Done retrieving: data size 43866694
Fri 17 Jan 2014 15:58:19 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:58:19 - XML: Start document: iteration 8
Fri 17 Jan 2014 15:58:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43866694
Fri 17 Jan 2014 15:58:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:58:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43866694
Fri 17 Jan 2014 15:58:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:58:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:58:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:58:29 - XML: Processed 655476 elements - found 638 jobs
Fri 17 Jan 2014 15:58:29 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:58:29 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:58:29 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:58:29 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:58:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:58:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:58:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:58:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:58:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:58:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:58:37 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:58:37 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:58:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:58:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:58:37 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:58:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:58:40 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:58:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:58:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:58:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:58:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:58:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:58:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:58:41 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:58:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43872509
Fri 17 Jan 2014 15:58:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:58:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43872509
Fri 17 Jan 2014 15:58:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:58:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:58:44 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:58:44 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:58:44 - job_xml_thread(): Done retrieving: data size 43872509
Fri 17 Jan 2014 15:58:44 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:58:44 - XML: Start document: iteration 9
Fri 17 Jan 2014 15:58:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:58:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 15:58:44 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:58:45 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:58:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 15:58:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8940 values 140995 bits 17624 bytes 
Fri 17 Jan 2014 15:58:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:58:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:58:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:58:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:58:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:58:52 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 15:58:53 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:58:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:58:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:58:54 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:58:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:58:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:58:54 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:58:54 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:58:54 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 15:58:54 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:58:54 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 15:58:54 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 15:58:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:58:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:59:00 - size of cluster 'LISA Cluster': 624 hosts 79479 metrics 856958 values 13520665 bits 1690083 bytes 
Fri 17 Jan 2014 15:59:01 - XML: Processed 655476 elements - found 638 jobs
Fri 17 Jan 2014 15:59:01 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:59:01 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:59:01 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:59:01 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:59:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:59:06 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:59:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:59:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:59:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:59:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:59:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:59:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:59:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:59:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:59:10 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:59:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851848
Fri 17 Jan 2014 15:59:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:59:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851848
Fri 17 Jan 2014 15:59:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:59:16 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:59:16 - job_xml_thread(): Done retrieving: data size 43851848
Fri 17 Jan 2014 15:59:16 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:59:17 - XML: Start document: iteration 10
Fri 17 Jan 2014 15:59:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:59:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:59:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:59:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:59:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:59:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:59:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:59:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:59:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:59:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:59:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:59:25 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:59:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 15:59:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:59:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:59:31 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:59:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:59:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:59:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:59:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:59:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:59:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:59:32 - XML: Processed 655476 elements - found 638 jobs
Fri 17 Jan 2014 15:59:32 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 15:59:32 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 15:59:32 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 15:59:32 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 15:59:34 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:59:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43684726
Fri 17 Jan 2014 15:59:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:59:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43684726
Fri 17 Jan 2014 15:59:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:59:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:59:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:59:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 15:59:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 15:59:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 15:59:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:59:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 15:59:45 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 15:59:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:59:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 15:59:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 15:59:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:59:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:59:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 15:59:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 15:59:46 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:59:46 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 15:59:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 15:59:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6123 values 96586 bits 12073 bytes 
Fri 17 Jan 2014 15:59:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:59:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 15:59:47 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 15:59:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 15:59:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 15:59:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 15:59:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 15:59:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:59:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 15:59:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 15:59:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 15:59:53 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 15:59:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43225289
Fri 17 Jan 2014 15:59:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 15:59:53 - job_xml_thread(): Done retrieving: data size 43225289
Fri 17 Jan 2014 15:59:53 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 15:59:53 - XML: Start document: iteration 11
Fri 17 Jan 2014 15:59:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43225289
Fri 17 Jan 2014 15:59:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 15:59:54 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 15:59:54 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 15:59:56 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 15:59:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 15:59:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:00:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:00:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:00:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:00:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:00:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:00:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:00:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:00:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:00:14 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:00:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:00:14 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:00:14 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:00:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:00:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:00:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:00:15 - XML: Processed 647522 elements - found 638 jobs
Fri 17 Jan 2014 16:00:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:00:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:00:15 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:00:15 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:00:15 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:00:15 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:00:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:00:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:00:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:00:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:00:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:00:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43264703
Fri 17 Jan 2014 16:00:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:00:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43264703
Fri 17 Jan 2014 16:00:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:00:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:00:27 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:00:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:00:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:00:30 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:00:30 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:00:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:00:30 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:00:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:00:30 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:00:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:00:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:00:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:00:31 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:00:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:00:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:00:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:00:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:00:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:00:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:00:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:00:35 - job_xml_thread(): Done retrieving: data size 43380021
Fri 17 Jan 2014 16:00:35 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:00:35 - XML: Start document: iteration 12
Fri 17 Jan 2014 16:00:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43380021
Fri 17 Jan 2014 16:00:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:00:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43380021
Fri 17 Jan 2014 16:00:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:00:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:00:46 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:00:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:00:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:00:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:00:46 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:00:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 16:00:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 16:00:46 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:00:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9384 values 148026 bits 18503 bytes 
Fri 17 Jan 2014 16:00:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:00:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:00:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:00:54 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:00:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:00:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:00:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:00:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:00:55 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:00:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:00:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:00:56 - XML: Processed 649404 elements - found 638 jobs
Fri 17 Jan 2014 16:00:56 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:00:56 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:00:56 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:00:56 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:01:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:01:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:01:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:01:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:01:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:01:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:01:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:01:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:01:04 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:01:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43848139
Fri 17 Jan 2014 16:01:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:01:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43848139
Fri 17 Jan 2014 16:01:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:01:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:01:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:01:11 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:01:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 16:01:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:01:12 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:01:12 - job_xml_thread(): Done retrieving: data size 43848139
Fri 17 Jan 2014 16:01:12 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:01:12 - XML: Start document: iteration 13
Fri 17 Jan 2014 16:01:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:01:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:01:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:01:16 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:01:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:01:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:01:17 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:01:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:01:17 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:01:17 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:01:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:01:23 - XML: Processed 655460 elements - found 640 jobs
Fri 17 Jan 2014 16:01:23 - job 7335199 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 16:01:23 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 16:01:23 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 16:01:24 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 16:01:24 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:01:24 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:01:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:01:27 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:01:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:01:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:01:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:01:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:01:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:01:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:01:31 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:01:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43832614
Fri 17 Jan 2014 16:01:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:01:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:01:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:01:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43832614
Fri 17 Jan 2014 16:01:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:01:39 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:01:39 - job_xml_thread(): Done retrieving: data size 43832614
Fri 17 Jan 2014 16:01:40 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:01:40 - XML: Start document: iteration 14
Fri 17 Jan 2014 16:01:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:01:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:01:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:01:45 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:01:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:01:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:01:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:01:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:01:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:01:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:01:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:01:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:01:46 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:01:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:01:47 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:01:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 16:01:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 16:01:47 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:01:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6212 values 98102 bits 12262 bytes 
Fri 17 Jan 2014 16:01:50 - XML: Processed 655475 elements - found 640 jobs
Fri 17 Jan 2014 16:01:50 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:01:50 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:01:50 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:01:50 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:01:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:01:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:01:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:01:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:01:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:01:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:01:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:01:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:01:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:01:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43852072
Fri 17 Jan 2014 16:01:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:02:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43852072
Fri 17 Jan 2014 16:02:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:02:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:02:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:02:05 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:02:05 - job_xml_thread(): Done retrieving: data size 43852072
Fri 17 Jan 2014 16:02:05 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:02:05 - XML: Start document: iteration 15
Fri 17 Jan 2014 16:02:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:02:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:02:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:02:13 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:02:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:02:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:02:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:02:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:02:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:02:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:02:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:02:20 - XML: Processed 655480 elements - found 640 jobs
Fri 17 Jan 2014 16:02:20 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:02:20 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:02:20 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:02:20 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:02:22 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:02:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 16:02:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:02:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:02:23 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:02:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:02:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:02:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:02:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:02:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:02:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:02:27 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:02:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43850809
Fri 17 Jan 2014 16:02:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:02:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43850809
Fri 17 Jan 2014 16:02:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:02:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:02:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:02:35 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:02:35 - job_xml_thread(): Done retrieving: data size 43850809
Fri 17 Jan 2014 16:02:35 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:02:35 - XML: Start document: iteration 16
Fri 17 Jan 2014 16:02:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:02:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:02:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:02:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:02:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:02:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:02:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:02:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:02:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:02:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:02:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:02:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:02:47 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:02:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:02:47 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:02:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 16:02:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 16:02:47 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:02:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5634 values 89087 bits 11135 bytes 
Fri 17 Jan 2014 16:02:51 - XML: Processed 655479 elements - found 640 jobs
Fri 17 Jan 2014 16:02:51 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:02:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:02:51 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:02:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:02:51 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:02:51 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:02:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:02:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:02:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:02:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:02:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:02:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:02:55 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:02:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855606
Fri 17 Jan 2014 16:02:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:02:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855606
Fri 17 Jan 2014 16:02:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:02:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:02:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:03:07 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:03:07 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:03:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:03:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:03:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:03:07 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:03:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:03:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:03:07 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:03:07 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:03:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:03:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:03:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:03:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:03:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:03:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:03:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:03:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:03:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:03:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:03:12 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:03:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 16:03:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:03:14 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:03:14 - job_xml_thread(): Done retrieving: data size 43850972
Fri 17 Jan 2014 16:03:14 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:03:14 - XML: Start document: iteration 17
Fri 17 Jan 2014 16:03:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43850972
Fri 17 Jan 2014 16:03:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:03:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43850972
Fri 17 Jan 2014 16:03:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:03:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:03:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:03:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:03:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:03:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:03:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:03:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:03:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:03:39 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:03:39 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:03:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:03:39 - XML: Processed 655478 elements - found 639 jobs
Fri 17 Jan 2014 16:03:39 - job 7348243 appears to have finished
Fri 17 Jan 2014 16:03:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:03:39 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 16:03:39 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 16:03:39 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:03:39 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 16:03:39 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:03:39 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:03:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:03:40 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:03:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:03:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:03:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:03:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:03:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:03:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:03:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:03:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862459
Fri 17 Jan 2014 16:03:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:03:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862459
Fri 17 Jan 2014 16:03:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:03:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:03:47 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:03:48 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:03:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:03:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 16:03:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 16:03:48 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:03:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8678 values 137118 bits 17139 bytes 
Fri 17 Jan 2014 16:03:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:03:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:03:54 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:03:54 - job_xml_thread(): Done retrieving: data size 43862459
Fri 17 Jan 2014 16:03:54 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:03:54 - XML: Start document: iteration 18
Fri 17 Jan 2014 16:03:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:03:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:03:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:03:58 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:03:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:03:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:03:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:03:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:03:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:03:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:03:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:04:09 - XML: Processed 655478 elements - found 639 jobs
Fri 17 Jan 2014 16:04:09 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:04:09 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:04:09 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:04:09 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:04:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:04:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:04:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:04:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:04:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:04:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:04:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:04:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:04:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:04:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851410
Fri 17 Jan 2014 16:04:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:04:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:04:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:04:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851410
Fri 17 Jan 2014 16:04:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:04:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:04:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:04:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:04:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:04:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:04:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:04:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:04:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:04:24 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:04:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:04:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:04:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:04:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:04:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:04:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:04:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:04:28 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:04:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 16:04:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:04:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:04:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:04:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:04:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:04:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:04:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43850749
Fri 17 Jan 2014 16:04:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:04:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43850749
Fri 17 Jan 2014 16:04:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:04:32 - job_xml_thread(): Done retrieving: data size 43850749
Fri 17 Jan 2014 16:04:32 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:04:32 - XML: Start document: iteration 19
Fri 17 Jan 2014 16:04:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:04:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:04:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:04:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:04:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:04:49 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:04:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:04:49 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:04:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:04:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:04:50 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:04:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:04:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 16:04:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 16:04:50 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:04:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5876 values 92727 bits 11590 bytes 
Fri 17 Jan 2014 16:04:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:04:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:04:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:04:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:04:52 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:04:53 - XML: Processed 655478 elements - found 639 jobs
Fri 17 Jan 2014 16:04:53 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:04:53 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:04:53 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:04:53 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:04:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:04:54 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:04:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:04:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:04:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:04:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:04:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:04:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:04:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:04:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43877026
Fri 17 Jan 2014 16:04:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:04:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43877026
Fri 17 Jan 2014 16:04:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:05:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:05:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:05:08 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:05:08 - job_xml_thread(): Done retrieving: data size 43877026
Fri 17 Jan 2014 16:05:08 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:05:08 - XML: Start document: iteration 20
Fri 17 Jan 2014 16:05:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:05:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:05:16 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:05:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 16:05:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:05:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:05:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:05:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:05:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:05:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:05:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:05:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:05:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:05:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:05:24 - XML: Processed 655475 elements - found 638 jobs
Fri 17 Jan 2014 16:05:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:05:24 - job 7348372 appears to have finished
Fri 17 Jan 2014 16:05:24 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:05:24 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 16:05:24 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 16:05:24 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 16:05:24 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:05:24 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:05:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:05:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:05:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:05:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:05:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:05:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:05:34 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:05:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43801192
Fri 17 Jan 2014 16:05:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:05:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43801192
Fri 17 Jan 2014 16:05:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:05:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:05:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:05:39 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:05:39 - job_xml_thread(): Done retrieving: data size 43801192
Fri 17 Jan 2014 16:05:39 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:05:39 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 16:05:40 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 16:05:40 - Housekeeping: done.
Fri 17 Jan 2014 16:05:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:05:40 - XML: Start document: iteration 0
Fri 17 Jan 2014 16:05:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:05:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:05:50 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:05:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:05:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:05:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:05:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:05:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:05:51 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:05:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 16:05:51 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:05:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 16:05:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5793 values 91385 bits 11423 bytes 
Fri 17 Jan 2014 16:05:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:05:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:05:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:05:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:05:52 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:05:54 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 16:05:54 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:05:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:05:55 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:05:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:05:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:05:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:05:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:05:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:05:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:05:56 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:05:56 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 16:05:56 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 16:05:56 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:05:56 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 16:05:58 - XML: Processed 654730 elements - found 639 jobs
Fri 17 Jan 2014 16:05:58 - job 7335200 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 16:05:58 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 16:05:58 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 16:05:58 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 1112659 values 17575345 bits 2196918 bytes 
Fri 17 Jan 2014 16:05:58 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 16:05:58 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:05:58 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:06:05 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:06:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 16:06:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:06:06 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:06:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43174704
Fri 17 Jan 2014 16:06:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:06:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43174704
Fri 17 Jan 2014 16:06:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:06:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:06:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:06:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:06:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:06:13 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:06:13 - job_xml_thread(): Done retrieving: data size 43174704
Fri 17 Jan 2014 16:06:13 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:06:13 - XML: Start document: iteration 1
Fri 17 Jan 2014 16:06:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:06:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:06:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:06:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:06:16 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:06:16 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:06:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:06:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:06:16 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:06:26 - XML: Processed 647316 elements - found 639 jobs
Fri 17 Jan 2014 16:06:26 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:06:26 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:06:26 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:06:26 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:06:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:06:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:06:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:06:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:06:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:06:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:06:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:06:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:06:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:06:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:06:38 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:06:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43602766
Fri 17 Jan 2014 16:06:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:06:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43602766
Fri 17 Jan 2014 16:06:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:06:41 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:06:41 - job_xml_thread(): Done retrieving: data size 43602766
Fri 17 Jan 2014 16:06:41 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:06:41 - XML: Start document: iteration 2
Fri 17 Jan 2014 16:06:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:06:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:06:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:06:51 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:06:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:06:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 16:06:53 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:06:53 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:06:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 16:06:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99095 bits 12386 bytes 
Fri 17 Jan 2014 16:06:56 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:06:56 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 16:06:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:06:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:06:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:06:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:06:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:06:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:06:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:06:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:06:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:07:00 - XML: Processed 652772 elements - found 639 jobs
Fri 17 Jan 2014 16:07:00 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:07:00 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:07:00 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:07:00 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:07:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:07:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:07:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:07:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:07:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:07:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:07:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:07:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:07:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:07:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43847622
Fri 17 Jan 2014 16:07:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:07:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:07:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:07:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43847622
Fri 17 Jan 2014 16:07:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:07:14 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:07:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 16:07:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:07:15 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:07:15 - job_xml_thread(): Done retrieving: data size 43847622
Fri 17 Jan 2014 16:07:15 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:07:15 - XML: Start document: iteration 3
Fri 17 Jan 2014 16:07:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:07:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:07:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:07:31 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:07:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:07:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:07:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:07:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:07:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:07:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:07:31 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:07:31 - XML: Processed 655478 elements - found 639 jobs
Fri 17 Jan 2014 16:07:32 - job 7347591 appears to have finished
Fri 17 Jan 2014 16:07:32 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 16:07:32 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 16:07:32 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 16:07:32 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:07:32 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:07:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:07:36 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:07:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:07:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:07:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:07:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:07:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:07:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:07:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:07:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43854259
Fri 17 Jan 2014 16:07:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:07:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43854259
Fri 17 Jan 2014 16:07:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:07:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:07:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:07:47 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:07:47 - job_xml_thread(): Done retrieving: data size 43854259
Fri 17 Jan 2014 16:07:47 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:07:47 - XML: Start document: iteration 4
Fri 17 Jan 2014 16:07:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:07:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:07:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:07:53 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:07:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:07:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 16:07:55 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:07:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 16:07:55 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:07:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6211 values 98008 bits 12251 bytes 
Fri 17 Jan 2014 16:08:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:08:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:08:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:08:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:08:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:08:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:08:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:08:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:08:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:08:04 - XML: Processed 655478 elements - found 639 jobs
Fri 17 Jan 2014 16:08:04 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:08:04 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:08:04 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:08:04 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:08:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:08:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:08:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:08:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:08:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:08:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:08:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:08:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:08:13 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 16:08:13 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 16:08:13 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:08:15 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:08:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855033
Fri 17 Jan 2014 16:08:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:08:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855033
Fri 17 Jan 2014 16:08:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:08:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:08:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:08:19 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:08:19 - job_xml_thread(): Done retrieving: data size 43855033
Fri 17 Jan 2014 16:08:19 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:08:19 - XML: Start document: iteration 5
Fri 17 Jan 2014 16:08:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:08:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:08:25 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:08:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 16:08:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:08:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:08:28 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:08:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:08:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:08:30 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:08:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:08:30 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:08:30 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:08:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:08:35 - XML: Processed 655478 elements - found 639 jobs
Fri 17 Jan 2014 16:08:35 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:08:35 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:08:35 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:08:35 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:08:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:08:38 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:08:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:08:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:08:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:08:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:08:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:08:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:08:41 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:08:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43861084
Fri 17 Jan 2014 16:08:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:08:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43861084
Fri 17 Jan 2014 16:08:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:08:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:08:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:08:50 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:08:50 - job_xml_thread(): Done retrieving: data size 43861084
Fri 17 Jan 2014 16:08:50 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:08:50 - XML: Start document: iteration 6
Fri 17 Jan 2014 16:08:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:08:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:08:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:08:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:08:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:08:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:08:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:08:55 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:08:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:08:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:08:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:08:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:08:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:08:55 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:08:55 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:08:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 16:08:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 16:08:55 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:08:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6179 values 97463 bits 12182 bytes 
Fri 17 Jan 2014 16:09:03 - XML: Processed 655478 elements - found 639 jobs
Fri 17 Jan 2014 16:09:03 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:09:03 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:09:03 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:09:03 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:09:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:09:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:09:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:09:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:09:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:09:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:09:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:09:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:09:08 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:09:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43836737
Fri 17 Jan 2014 16:09:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:09:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43836737
Fri 17 Jan 2014 16:09:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:09:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:09:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:09:18 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:09:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:09:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:09:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:09:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:09:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:09:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:09:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:09:20 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:09:20 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:09:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:09:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:09:23 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:09:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 16:09:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:09:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:09:25 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:09:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:09:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:09:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:09:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:09:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:09:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:09:28 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:09:28 - job_xml_thread(): Done retrieving: data size 43858725
Fri 17 Jan 2014 16:09:28 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:09:28 - XML: Start document: iteration 7
Fri 17 Jan 2014 16:09:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43858725
Fri 17 Jan 2014 16:09:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:09:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858725
Fri 17 Jan 2014 16:09:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:09:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:09:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:09:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:09:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:09:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:09:46 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:09:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:09:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:09:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:09:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:09:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:09:49 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:09:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:09:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:09:49 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:09:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:09:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:09:50 - XML: Processed 655478 elements - found 639 jobs
Fri 17 Jan 2014 16:09:50 - job 7348391 appears to have finished
Fri 17 Jan 2014 16:09:50 - job 7348393 field 'start_timestamp' changed since saved from: 1389971229 to: 1389971180
Fri 17 Jan 2014 16:09:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:09:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:09:50 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 16:09:50 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 16:09:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:09:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:09:50 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 16:09:50 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:09:50 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:09:54 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:09:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870625
Fri 17 Jan 2014 16:09:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:09:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870625
Fri 17 Jan 2014 16:09:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:09:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:09:55 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:09:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:09:56 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:09:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 16:09:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 16:09:56 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:09:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8982 values 141668 bits 17708 bytes 
Fri 17 Jan 2014 16:10:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:10:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:10:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:10:05 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:10:05 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:10:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:10:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:10:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:10:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:10:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:10:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:10:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:10:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:10:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:10:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:10:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:10:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:10:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:10:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:10:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:10:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:10:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:10:14 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:10:14 - job_xml_thread(): Done retrieving: data size 43861320
Fri 17 Jan 2014 16:10:14 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:10:14 - XML: Start document: iteration 8
Fri 17 Jan 2014 16:10:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43861320
Fri 17 Jan 2014 16:10:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:10:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43861320
Fri 17 Jan 2014 16:10:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:10:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:10:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:10:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:10:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:10:29 - XML: Processed 655475 elements - found 639 jobs
Fri 17 Jan 2014 16:10:29 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:10:29 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:10:29 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:10:29 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:10:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:10:36 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:10:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:10:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:10:37 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:10:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:10:37 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:10:37 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:10:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:10:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:10:37 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:10:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:10:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:10:38 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:10:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 16:10:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:10:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:10:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:10:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:10:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:10:40 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:10:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43886987
Fri 17 Jan 2014 16:10:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:10:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43886987
Fri 17 Jan 2014 16:10:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:10:44 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:10:44 - job_xml_thread(): Done retrieving: data size 43886987
Fri 17 Jan 2014 16:10:44 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:10:44 - XML: Start document: iteration 9
Fri 17 Jan 2014 16:10:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:10:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:10:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:10:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:10:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:10:57 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:10:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:10:59 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:10:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 16:10:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 16:10:59 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:10:59 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5800 values 91489 bits 11436 bytes 
Fri 17 Jan 2014 16:10:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:10:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:10:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:10:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:11:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:11:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:11:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:11:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:11:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:11:03 - XML: Processed 655478 elements - found 639 jobs
Fri 17 Jan 2014 16:11:03 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:11:03 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:11:03 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:11:03 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:11:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:11:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:11:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:11:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:11:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:11:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:11:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:11:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:11:08 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:11:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 16:11:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:11:09 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:11:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858853
Fri 17 Jan 2014 16:11:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:11:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43858853
Fri 17 Jan 2014 16:11:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:11:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:11:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:11:18 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:11:18 - job_xml_thread(): Done retrieving: data size 43858853
Fri 17 Jan 2014 16:11:19 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:11:19 - XML: Start document: iteration 10
Fri 17 Jan 2014 16:11:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:11:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:11:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:11:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:11:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:11:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:11:23 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:11:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:11:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:11:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:11:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:11:31 - XML: Processed 655476 elements - found 638 jobs
Fri 17 Jan 2014 16:11:31 - job 7337111 appears to have finished
Fri 17 Jan 2014 16:11:31 - job 7348394 field 'start_timestamp' changed since saved from: 1389971321 to: 1389971287
Fri 17 Jan 2014 16:11:31 - job 7348377 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 16:11:31 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 16:11:31 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 16:11:32 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 16:11:32 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:11:32 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:11:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:11:34 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:11:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:11:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:11:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:11:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:11:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:11:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:11:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:11:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43765373
Fri 17 Jan 2014 16:11:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:11:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43765373
Fri 17 Jan 2014 16:11:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:11:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:11:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:11:47 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:11:47 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:11:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:11:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:11:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:11:53 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:11:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:11:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:11:54 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:11:54 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:11:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:11:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:11:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:11:55 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:11:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:11:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:11:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:11:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:11:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:11:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:11:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:11:58 - job_xml_thread(): Done retrieving: data size 43203597
Fri 17 Jan 2014 16:11:58 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:11:58 - XML: Start document: iteration 11
Fri 17 Jan 2014 16:11:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43203597
Fri 17 Jan 2014 16:11:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:11:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:11:59 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:11:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43203597
Fri 17 Jan 2014 16:12:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:12:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:12:00 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:12:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 16:12:00 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:12:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 16:12:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148604 bits 18575 bytes 
Fri 17 Jan 2014 16:12:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:12:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:12:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:12:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:12:14 - XML: Processed 647406 elements - found 638 jobs
Fri 17 Jan 2014 16:12:14 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:12:14 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:12:14 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:12:14 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:12:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:12:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:12:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:12:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:12:20 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:12:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:12:20 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:12:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:12:20 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:12:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:12:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:12:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:12:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:12:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:12:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:12:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:12:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 2019, in storeMetrics
    del self.myMetrics[ hostname ][ metricname ]
KeyError: u'boottime'

Fri 17 Jan 2014 16:12:26 - ganglia_store_thread(): Done waiting: storemetricthread() has finished: cluster LISA Cluster
Fri 17 Jan 2014 16:12:26 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:12:26 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:12:26 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:12:26 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 16:12:26 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 16:12:26 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 16:12:26 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:12:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43283956
Fri 17 Jan 2014 16:12:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:12:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43283956
Fri 17 Jan 2014 16:12:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:12:29 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:12:30 - job_xml_thread(): Done retrieving: data size 43283956
Fri 17 Jan 2014 16:12:30 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:12:30 - XML: Start document: iteration 12
Fri 17 Jan 2014 16:12:31 - size of cluster 'LISA Cluster': 624 hosts 79448 metrics 980974 values 15487176 bits 1935897 bytes 
Fri 17 Jan 2014 16:12:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:12:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:12:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:12:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:12:40 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:12:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 16:12:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:12:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:12:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:12:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:12:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:12:47 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:12:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:12:47 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:12:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:12:47 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:12:49 - XML: Processed 648024 elements - found 638 jobs
Fri 17 Jan 2014 16:12:49 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:12:49 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:12:49 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:12:49 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:12:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:12:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:12:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:12:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:12:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:12:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:12:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:12:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:12:55 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:12:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43815239
Fri 17 Jan 2014 16:12:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:12:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43815239
Fri 17 Jan 2014 16:12:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:13:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:13:01 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:13:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:13:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:13:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:13:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 16:13:02 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:13:02 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:13:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 16:13:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6155 values 97113 bits 12139 bytes 
Fri 17 Jan 2014 16:13:04 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:13:04 - job_xml_thread(): Done retrieving: data size 43815239
Fri 17 Jan 2014 16:13:04 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:13:04 - XML: Start document: iteration 13
Fri 17 Jan 2014 16:13:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:13:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:13:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:13:06 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:13:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:13:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:13:07 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:13:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:13:07 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:13:07 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:13:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:13:15 - XML: Processed 654892 elements - found 638 jobs
Fri 17 Jan 2014 16:13:15 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:13:15 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:13:15 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:13:15 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:13:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:13:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:13:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:13:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:13:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:13:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:13:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:13:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:13:22 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:13:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43823476
Fri 17 Jan 2014 16:13:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:13:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:13:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:13:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43823476
Fri 17 Jan 2014 16:13:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:13:26 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:13:26 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 16:13:30 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:13:30 - job_xml_thread(): Done retrieving: data size 43823476
Fri 17 Jan 2014 16:13:30 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:13:30 - XML: Start document: iteration 14
Fri 17 Jan 2014 16:13:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:13:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:13:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:13:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:13:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:13:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:13:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:13:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:13:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:13:34 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:13:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:13:45 - XML: Processed 655470 elements - found 635 jobs
Fri 17 Jan 2014 16:13:45 - job 7346682 appears to have finished
Fri 17 Jan 2014 16:13:45 - job 7348227 appears to have finished
Fri 17 Jan 2014 16:13:45 - job 7348229 appears to have finished
Fri 17 Jan 2014 16:13:45 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 16:13:45 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 16:13:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:13:45 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:13:45 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 16:13:45 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:13:45 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:13:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:13:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:13:45 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:13:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 16:13:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:13:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:13:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:13:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:13:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:13:48 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:13:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43823420
Fri 17 Jan 2014 16:13:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:13:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43823420
Fri 17 Jan 2014 16:13:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:13:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:13:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:14:00 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:14:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:14:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:14:01 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:14:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:14:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:14:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:14:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:14:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:14:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:14:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:14:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:14:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:14:02 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:14:03 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:14:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:14:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 16:14:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 16:14:03 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:14:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5769 values 91012 bits 11376 bytes 
Fri 17 Jan 2014 16:14:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:14:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:14:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:14:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:14:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:14:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:14:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:14:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:14:08 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:14:08 - job_xml_thread(): Done retrieving: data size 43861200
Fri 17 Jan 2014 16:14:08 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:14:08 - XML: Start document: iteration 15
Fri 17 Jan 2014 16:14:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43861200
Fri 17 Jan 2014 16:14:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:14:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43861200
Fri 17 Jan 2014 16:14:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:14:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:14:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:14:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:14:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:14:30 - XML: Processed 655470 elements - found 635 jobs
Fri 17 Jan 2014 16:14:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:14:30 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:14:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:14:30 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:14:30 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:14:30 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:14:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:14:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:14:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:14:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:14:31 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:14:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:14:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:14:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:14:33 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:14:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:14:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:14:34 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:14:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 16:14:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:14:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:14:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:14:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:14:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:14:37 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:14:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867631
Fri 17 Jan 2014 16:14:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:14:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43867631
Fri 17 Jan 2014 16:14:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:14:46 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:14:46 - job_xml_thread(): Done retrieving: data size 43867631
Fri 17 Jan 2014 16:14:46 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:14:46 - XML: Start document: iteration 16
Fri 17 Jan 2014 16:14:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:14:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:14:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:14:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:14:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:14:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:14:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:14:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:14:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:14:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:14:48 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:14:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:14:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:14:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:14:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:14:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:14:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:15:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:15:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:15:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:15:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:15:00 - XML: Processed 655470 elements - found 635 jobs
Fri 17 Jan 2014 16:15:00 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:15:00 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:15:00 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:15:00 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:15:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:15:03 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:15:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:15:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:15:03 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:15:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:15:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 16:15:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 16:15:03 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:15:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5604 values 88380 bits 11047 bytes 
Fri 17 Jan 2014 16:15:03 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:15:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43828397
Fri 17 Jan 2014 16:15:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:15:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43828397
Fri 17 Jan 2014 16:15:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:15:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:15:14 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:15:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:15:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:15:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:15:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:15:15 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:15:15 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:15:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:15:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:15:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:15:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:15:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:15:20 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:15:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:15:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:15:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:15:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:15:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:15:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:15:24 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:15:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 16:15:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:15:24 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:15:24 - job_xml_thread(): Done retrieving: data size 43855213
Fri 17 Jan 2014 16:15:24 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:15:24 - XML: Start document: iteration 17
Fri 17 Jan 2014 16:15:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855213
Fri 17 Jan 2014 16:15:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:15:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855213
Fri 17 Jan 2014 16:15:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:15:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:15:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:15:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:15:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:15:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:15:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:15:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:15:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:15:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:15:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:15:44 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:15:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:15:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:15:44 - XML: Processed 655464 elements - found 632 jobs
Fri 17 Jan 2014 16:15:44 - job 7348394 appears to have finished
Fri 17 Jan 2014 16:15:44 - job 7348168 appears to have finished
Fri 17 Jan 2014 16:15:44 - job 7348226 appears to have finished
Fri 17 Jan 2014 16:15:44 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 16:15:44 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 16:15:45 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 16:15:45 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:15:45 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:15:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:15:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:15:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:15:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:15:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:15:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:15:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:15:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:15:50 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:15:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855210
Fri 17 Jan 2014 16:15:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:15:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855210
Fri 17 Jan 2014 16:15:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:15:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:16:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:16:00 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:16:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:16:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:16:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:16:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:16:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:16:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:16:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:16:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:16:03 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:16:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:16:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:16:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:16:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:16:03 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:16:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 16:16:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:16:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 16:16:03 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:16:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6529 values 103035 bits 12879 bytes 
Fri 17 Jan 2014 16:16:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:16:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:16:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:16:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:16:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:16:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:16:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:16:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:16:09 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:16:09 - job_xml_thread(): Done retrieving: data size 43863518
Fri 17 Jan 2014 16:16:09 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:16:09 - XML: Start document: iteration 18
Fri 17 Jan 2014 16:16:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43863518
Fri 17 Jan 2014 16:16:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:16:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43863518
Fri 17 Jan 2014 16:16:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:16:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:16:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:16:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:16:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:16:25 - XML: Processed 655464 elements - found 632 jobs
Fri 17 Jan 2014 16:16:25 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:16:25 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:16:25 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:16:25 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:16:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:16:31 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:16:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:16:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:16:32 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:16:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:16:32 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:16:32 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:16:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:16:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:16:33 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:16:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:16:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:16:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:16:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:16:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:16:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:16:33 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:16:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 16:16:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:16:37 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:16:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870876
Fri 17 Jan 2014 16:16:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:16:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870876
Fri 17 Jan 2014 16:16:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:16:40 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:16:40 - job_xml_thread(): Done retrieving: data size 43870876
Fri 17 Jan 2014 16:16:40 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:16:40 - XML: Start document: iteration 19
Fri 17 Jan 2014 16:16:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:16:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:16:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:16:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:16:54 - XML: Processed 655464 elements - found 632 jobs
Fri 17 Jan 2014 16:16:54 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:16:54 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:16:54 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:16:54 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:16:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:16:56 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:16:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:16:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:16:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:16:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:16:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:16:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:16:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:17:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:17:01 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:17:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:17:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:17:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:17:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:17:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:17:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:17:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:17:03 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:17:04 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:17:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:17:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 16:17:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 16:17:04 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:17:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5881 values 92927 bits 11615 bytes 
Fri 17 Jan 2014 16:17:04 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:17:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43850206
Fri 17 Jan 2014 16:17:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:17:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43850206
Fri 17 Jan 2014 16:17:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:17:09 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:17:09 - job_xml_thread(): Done retrieving: data size 43850206
Fri 17 Jan 2014 16:17:09 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:17:09 - XML: Start document: iteration 20
Fri 17 Jan 2014 16:17:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:17:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:17:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:17:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:17:25 - XML: Processed 655458 elements - found 629 jobs
Fri 17 Jan 2014 16:17:25 - job 7348134 appears to have finished
Fri 17 Jan 2014 16:17:25 - job 7348231 appears to have finished
Fri 17 Jan 2014 16:17:26 - job 7348228 appears to have finished
Fri 17 Jan 2014 16:17:26 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 16:17:26 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 16:17:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:17:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:17:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:17:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:17:27 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 16:17:27 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:17:27 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:17:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:17:27 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:17:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:17:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:17:27 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:17:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:17:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:17:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:17:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:17:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:17:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:17:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:17:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:17:33 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:17:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43408191
Fri 17 Jan 2014 16:17:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:17:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43408191
Fri 17 Jan 2014 16:17:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:17:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:17:42 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:17:42 - job_xml_thread(): Done retrieving: data size 43408191
Fri 17 Jan 2014 16:17:42 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:17:42 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 16:17:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:17:42 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 16:17:42 - Housekeeping: done.
Fri 17 Jan 2014 16:17:42 - XML: Start document: iteration 0
Fri 17 Jan 2014 16:17:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:17:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:17:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:17:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:17:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:17:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:17:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:17:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:17:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:17:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:17:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:17:50 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:17:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 16:17:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:17:56 - XML: Processed 649852 elements - found 629 jobs
Fri 17 Jan 2014 16:17:56 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:17:56 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:17:56 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:17:56 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:17:56 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 16:17:56 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 16:17:56 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:17:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:17:57 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:17:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:17:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:17:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:17:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:17:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:17:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:17:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:17:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43223671
Fri 17 Jan 2014 16:17:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:17:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43223671
Fri 17 Jan 2014 16:17:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:18:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:18:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:18:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:18:04 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:18:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:18:07 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:18:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 16:18:07 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:18:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 16:18:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6388 values 101081 bits 12635 bytes 
Fri 17 Jan 2014 16:18:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:18:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:18:12 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:18:12 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:18:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:18:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:18:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:18:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:18:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:18:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:18:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:18:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:18:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:18:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:18:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:18:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:18:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:18:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:18:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:18:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:18:16 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:18:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 16:18:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:18:16 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:18:16 - job_xml_thread(): Done retrieving: data size 43236535
Fri 17 Jan 2014 16:18:16 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:18:16 - XML: Start document: iteration 1
Fri 17 Jan 2014 16:18:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43236535
Fri 17 Jan 2014 16:18:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:18:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43236535
Fri 17 Jan 2014 16:18:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:18:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:18:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:18:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:18:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:18:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:18:31 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:18:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:18:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:18:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:18:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:18:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:18:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:18:32 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:18:35 - XML: Processed 647622 elements - found 629 jobs
Fri 17 Jan 2014 16:18:35 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:18:35 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:18:35 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:18:35 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:18:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:18:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:18:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:18:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:18:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:18:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:18:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:18:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:18:40 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:18:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43726466
Fri 17 Jan 2014 16:18:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:18:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43726466
Fri 17 Jan 2014 16:18:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:18:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:18:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:18:50 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:18:50 - job_xml_thread(): Done retrieving: data size 43726466
Fri 17 Jan 2014 16:18:50 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:18:50 - XML: Start document: iteration 2
Fri 17 Jan 2014 16:18:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:18:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:18:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:18:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:18:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:18:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:18:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:18:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:18:52 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:18:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:18:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:19:00 - XML: Processed 653878 elements - found 629 jobs
Fri 17 Jan 2014 16:19:01 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:19:01 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:19:01 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:19:01 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:19:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:19:03 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:19:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:19:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:19:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:19:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:19:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:19:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:19:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:19:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43818673
Fri 17 Jan 2014 16:19:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:19:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43818673
Fri 17 Jan 2014 16:19:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:19:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:19:07 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:19:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:19:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:19:08 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:19:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 16:19:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:19:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 16:19:08 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:19:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148767 bits 18595 bytes 
Fri 17 Jan 2014 16:19:16 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:19:16 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:19:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:19:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:19:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:19:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:19:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:19:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:19:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:19:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:19:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:19:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:19:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:19:21 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:19:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:19:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:19:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:19:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:19:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:19:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:19:23 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:19:23 - job_xml_thread(): Done retrieving: data size 43833955
Fri 17 Jan 2014 16:19:23 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:19:23 - XML: Start document: iteration 3
Fri 17 Jan 2014 16:19:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43833955
Fri 17 Jan 2014 16:19:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43833955
Fri 17 Jan 2014 16:19:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:19:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:19:26 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 16:19:26 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:19:28 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:19:28 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:19:28 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 16:19:28 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 16:19:28 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 16:19:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:19:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:19:34 - size of cluster 'LISA Cluster': 624 hosts 79469 metrics 674231 values 10657747 bits 1332218 bytes 
Fri 17 Jan 2014 16:19:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:19:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:19:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:19:41 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:19:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:19:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:19:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:19:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:19:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:19:43 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:19:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:19:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:19:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:19:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:19:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:19:48 - XML: Processed 655456 elements - found 628 jobs
Fri 17 Jan 2014 16:19:48 - job 7348235 appears to have finished
Fri 17 Jan 2014 16:19:48 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 16:19:48 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 16:19:48 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 16:19:48 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:19:48 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:19:48 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:19:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 16:19:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:19:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:19:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:19:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:19:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:19:51 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:19:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43832367
Fri 17 Jan 2014 16:19:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:19:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43832367
Fri 17 Jan 2014 16:19:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:19:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:19:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:20:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:20:03 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:20:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:20:03 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:20:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:20:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:20:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:20:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:20:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:20:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:20:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:20:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:20:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:20:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:20:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:20:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:20:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:20:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:20:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:20:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:20:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:20:08 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:20:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:20:08 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:20:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 16:20:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 16:20:08 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:20:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5892 values 92983 bits 11622 bytes 
Fri 17 Jan 2014 16:20:10 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:20:10 - job_xml_thread(): Done retrieving: data size 43845645
Fri 17 Jan 2014 16:20:10 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:20:10 - XML: Start document: iteration 4
Fri 17 Jan 2014 16:20:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43845645
Fri 17 Jan 2014 16:20:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:20:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43845645
Fri 17 Jan 2014 16:20:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:20:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:20:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:20:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:20:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:20:25 - XML: Processed 655453 elements - found 628 jobs
Fri 17 Jan 2014 16:20:26 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:20:26 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:20:26 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:20:26 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:20:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:20:27 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:20:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:20:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:20:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:20:27 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:20:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:20:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:20:27 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:20:28 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:20:28 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 16:20:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:20:32 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:20:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:20:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:20:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:20:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:20:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:20:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:20:34 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:20:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 16:20:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:20:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:20:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43840101
Fri 17 Jan 2014 16:20:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:20:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43840101
Fri 17 Jan 2014 16:20:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:20:41 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:20:41 - job_xml_thread(): Done retrieving: data size 43840101
Fri 17 Jan 2014 16:20:41 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:20:41 - XML: Start document: iteration 5
Fri 17 Jan 2014 16:20:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:20:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:20:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:20:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:20:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:20:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:20:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:20:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:20:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:20:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:20:52 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:20:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:20:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:20:57 - XML: Processed 655456 elements - found 628 jobs
Fri 17 Jan 2014 16:20:57 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:20:57 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:20:57 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:20:57 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:20:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:20:59 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:21:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:21:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:21:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:21:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:21:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:21:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:21:03 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:21:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43847238
Fri 17 Jan 2014 16:21:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:21:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43847238
Fri 17 Jan 2014 16:21:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:21:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:21:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:21:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:21:08 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:21:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:21:09 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:21:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 16:21:09 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:21:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 16:21:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7282 values 114848 bits 14356 bytes 
Fri 17 Jan 2014 16:21:12 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:21:12 - job_xml_thread(): Done retrieving: data size 43847238
Fri 17 Jan 2014 16:21:12 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:21:12 - XML: Start document: iteration 6
Fri 17 Jan 2014 16:21:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:21:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:21:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:21:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:21:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:21:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:21:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:21:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:21:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:21:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:21:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:21:24 - XML: Processed 655456 elements - found 628 jobs
Fri 17 Jan 2014 16:21:24 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:21:24 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:21:24 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:21:24 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:21:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:21:26 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:21:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:21:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:21:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:21:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:21:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:21:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:21:29 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:21:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 16:21:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:21:30 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:21:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43859186
Fri 17 Jan 2014 16:21:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:21:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43859186
Fri 17 Jan 2014 16:21:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:21:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:21:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:21:39 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:21:39 - job_xml_thread(): Done retrieving: data size 43859186
Fri 17 Jan 2014 16:21:39 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:21:39 - XML: Start document: iteration 7
Fri 17 Jan 2014 16:21:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:21:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:21:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:21:46 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:21:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:21:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:21:47 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:21:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:21:47 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:21:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:21:47 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:21:49 - XML: Processed 655458 elements - found 629 jobs
Fri 17 Jan 2014 16:21:49 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 16:21:49 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 16:21:49 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 16:21:49 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:21:49 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:21:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:21:53 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:21:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:21:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:21:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:21:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:21:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:21:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:21:56 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:21:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43859550
Fri 17 Jan 2014 16:21:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:21:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43859550
Fri 17 Jan 2014 16:21:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:22:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:22:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:22:04 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:22:04 - job_xml_thread(): Done retrieving: data size 43859550
Fri 17 Jan 2014 16:22:04 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:22:04 - XML: Start document: iteration 8
Fri 17 Jan 2014 16:22:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:22:07 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:22:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:22:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:22:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:22:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:22:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:22:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:22:09 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:22:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:22:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:22:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:22:10 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:22:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:22:10 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:22:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 16:22:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 16:22:10 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:22:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99068 bits 12383 bytes 
Fri 17 Jan 2014 16:22:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:22:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:22:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:22:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:22:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:22:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:22:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:22:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:22:20 - XML: Processed 655458 elements - found 629 jobs
Fri 17 Jan 2014 16:22:20 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:22:20 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:22:20 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:22:20 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:22:23 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:22:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43827402
Fri 17 Jan 2014 16:22:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:22:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43827402
Fri 17 Jan 2014 16:22:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:22:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:22:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:22:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:22:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:22:35 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:22:35 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:22:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:22:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:22:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:22:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:22:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:22:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:22:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:22:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:22:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:22:40 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:22:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:22:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:22:40 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:22:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 16:22:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:22:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:22:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:22:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:22:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:22:42 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:22:42 - job_xml_thread(): Done retrieving: data size 43867874
Fri 17 Jan 2014 16:22:42 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:22:42 - XML: Start document: iteration 9
Fri 17 Jan 2014 16:22:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43867874
Fri 17 Jan 2014 16:22:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:22:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867874
Fri 17 Jan 2014 16:22:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:22:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:22:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:22:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:22:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:22:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:22:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:22:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:22:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:22:56 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:22:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:22:56 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:22:56 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:22:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:23:02 - XML: Processed 655458 elements - found 629 jobs
Fri 17 Jan 2014 16:23:02 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:23:02 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:23:02 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:23:02 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:23:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:23:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:23:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:23:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:23:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:23:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:23:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:23:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:23:08 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:23:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43833286
Fri 17 Jan 2014 16:23:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:23:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43833286
Fri 17 Jan 2014 16:23:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:23:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:23:10 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:23:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:23:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:23:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:23:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 16:23:11 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:23:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 16:23:11 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:23:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8847 values 139501 bits 17437 bytes 
Fri 17 Jan 2014 16:23:17 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:23:17 - job_xml_thread(): Done retrieving: data size 43833286
Fri 17 Jan 2014 16:23:17 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:23:17 - XML: Start document: iteration 10
Fri 17 Jan 2014 16:23:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:23:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:23:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:23:21 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:23:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:23:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:23:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:23:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:23:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:23:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:23:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:23:32 - XML: Processed 655458 elements - found 629 jobs
Fri 17 Jan 2014 16:23:32 - job 7348239 appears to have finished
Fri 17 Jan 2014 16:23:32 - job 7348067 report time 1389972028 does not match current heartbeat 1389972149 : ignoring job
Fri 17 Jan 2014 16:23:32 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 16:23:32 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 16:23:33 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 16:23:33 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:23:33 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:23:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:23:34 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:23:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:23:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:23:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:23:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:23:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:23:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:23:36 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:23:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 16:23:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:23:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:23:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43763845
Fri 17 Jan 2014 16:23:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:23:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43763845
Fri 17 Jan 2014 16:23:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:23:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:23:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:23:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:23:46 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:23:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:23:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:23:47 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:23:47 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:23:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:23:47 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:23:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:23:48 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:23:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:23:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:23:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:23:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:23:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:23:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:23:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:23:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:23:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:23:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:23:53 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 16:23:53 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 16:23:53 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:23:54 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:23:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43204242
Fri 17 Jan 2014 16:23:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:23:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43204242
Fri 17 Jan 2014 16:23:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:23:55 - job_xml_thread(): Done retrieving: data size 43204242
Fri 17 Jan 2014 16:23:55 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:23:55 - XML: Start document: iteration 11
Fri 17 Jan 2014 16:24:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:24:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:24:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:24:07 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:24:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:24:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:24:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:24:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:24:07 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:24:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:24:07 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:24:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:24:07 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:24:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:24:12 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:24:13 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:24:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:24:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 16:24:13 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:24:13 - XML: Processed 647450 elements - found 629 jobs
Fri 17 Jan 2014 16:24:13 - job 7348067 report time 1389972028 does not match current heartbeat 1389972149 : ignoring job
Fri 17 Jan 2014 16:24:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 16:24:13 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:24:13 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:24:13 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:24:13 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:24:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99003 bits 12375 bytes 
Fri 17 Jan 2014 16:24:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:24:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:24:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:24:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:24:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:24:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:24:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:24:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:24:18 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:24:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 16:24:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:24:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:24:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43221629
Fri 17 Jan 2014 16:24:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:24:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43221629
Fri 17 Jan 2014 16:24:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:24:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:24:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:24:28 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:24:28 - job_xml_thread(): Done retrieving: data size 43221629
Fri 17 Jan 2014 16:24:28 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:24:28 - XML: Start document: iteration 12
Fri 17 Jan 2014 16:24:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:24:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:24:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:24:36 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:24:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:24:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:24:37 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:24:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:24:37 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:24:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:24:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:24:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:24:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:24:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:24:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:24:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:24:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:24:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:24:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:24:41 - XML: Processed 647876 elements - found 629 jobs
Fri 17 Jan 2014 16:24:41 - job 7348067 report time 1389972028 does not match current heartbeat 1389972149 : ignoring job
Fri 17 Jan 2014 16:24:41 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:24:41 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:24:41 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:24:41 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:24:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:24:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43734247
Fri 17 Jan 2014 16:24:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:24:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43734247
Fri 17 Jan 2014 16:24:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:24:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:24:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:24:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:24:54 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:24:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:24:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:24:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:24:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:24:55 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:24:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:24:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:24:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:24:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:24:56 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:24:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:24:57 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:24:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:24:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:24:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:24:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:24:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:24:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:24:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:24:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43840415
Fri 17 Jan 2014 16:24:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:24:59 - job_xml_thread(): Done retrieving: data size 43840415
Fri 17 Jan 2014 16:24:59 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:24:59 - XML: Start document: iteration 13
Fri 17 Jan 2014 16:24:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43840415
Fri 17 Jan 2014 16:24:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:25:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:25:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:25:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:25:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:25:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:25:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:25:13 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:25:13 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:25:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:25:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:25:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:25:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:25:13 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:25:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 16:25:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 16:25:13 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:25:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:25:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:25:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:25:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148543 bits 18567 bytes 
Fri 17 Jan 2014 16:25:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:25:19 - XML: Processed 654966 elements - found 627 jobs
Fri 17 Jan 2014 16:25:20 - job 7347698 appears to have finished
Fri 17 Jan 2014 16:25:20 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 16:25:20 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 16:25:20 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 16:25:20 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:25:20 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:25:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:25:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:25:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:25:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:25:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:25:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:25:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:25:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:25:24 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:25:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43831775
Fri 17 Jan 2014 16:25:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:25:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43831775
Fri 17 Jan 2014 16:25:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:25:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:25:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:25:35 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:25:35 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:25:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:25:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:25:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:25:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:25:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:25:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:25:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:25:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:25:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:25:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:25:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:25:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:25:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:25:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:25:40 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:25:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 16:25:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:25:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:25:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:25:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:25:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:25:41 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:25:41 - job_xml_thread(): Done retrieving: data size 43859672
Fri 17 Jan 2014 16:25:41 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:25:41 - XML: Start document: iteration 14
Fri 17 Jan 2014 16:25:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43859672
Fri 17 Jan 2014 16:25:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:25:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43859672
Fri 17 Jan 2014 16:25:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:25:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:25:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:25:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:25:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:25:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:25:56 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:25:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:25:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:25:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:25:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:25:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:25:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:25:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:26:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:26:03 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:26:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:26:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:26:04 - XML: Processed 655456 elements - found 628 jobs
Fri 17 Jan 2014 16:26:04 - job 7348056 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 16:26:04 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 16:26:04 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 16:26:04 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 16:26:04 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:26:04 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:26:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:26:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:26:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:26:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:26:06 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:26:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43836549
Fri 17 Jan 2014 16:26:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:26:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43836549
Fri 17 Jan 2014 16:26:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:26:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:26:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:26:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:26:13 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:26:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:26:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 16:26:14 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:26:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 16:26:14 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:26:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9123 values 143863 bits 17982 bytes 
Fri 17 Jan 2014 16:26:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:26:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:26:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:26:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:26:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:26:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:26:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:26:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:26:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:26:19 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:26:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:26:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:26:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:26:21 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:26:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:26:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:26:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:26:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:26:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:26:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:26:23 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:26:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865652
Fri 17 Jan 2014 16:26:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:26:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43865652
Fri 17 Jan 2014 16:26:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:26:24 - job_xml_thread(): Done retrieving: data size 43865652
Fri 17 Jan 2014 16:26:24 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:26:24 - XML: Start document: iteration 15
Fri 17 Jan 2014 16:26:28 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 16:26:29 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:26:30 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:26:30 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:26:30 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 16:26:30 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 16:26:30 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 16:26:33 - size of cluster 'LISA Cluster': 624 hosts 79467 metrics 751935 values 11858689 bits 1482336 bytes 
Fri 17 Jan 2014 16:26:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:26:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:26:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:26:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:26:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:26:41 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:26:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:26:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:26:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:26:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:26:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:26:41 - XML: Processed 655456 elements - found 628 jobs
Fri 17 Jan 2014 16:26:41 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:26:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:26:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:26:41 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:26:41 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:26:41 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:26:44 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:26:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 16:26:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:26:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:26:46 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:26:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:26:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:26:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:26:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:26:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:26:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:26:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:26:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43849240
Fri 17 Jan 2014 16:26:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:26:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43849240
Fri 17 Jan 2014 16:26:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:26:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:26:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:26:56 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:26:56 - job_xml_thread(): Done retrieving: data size 43849240
Fri 17 Jan 2014 16:26:56 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:26:56 - XML: Start document: iteration 16
Fri 17 Jan 2014 16:26:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:26:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:26:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:26:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:27:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:27:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:27:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:27:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:27:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:27:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:27:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:27:09 - XML: Processed 655456 elements - found 628 jobs
Fri 17 Jan 2014 16:27:09 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:27:09 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:27:09 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:27:09 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:27:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:27:12 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:27:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:27:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:27:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:27:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:27:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:27:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:27:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:27:14 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:27:14 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:27:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:27:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 16:27:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 16:27:14 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:27:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5951 values 93829 bits 11728 bytes 
Fri 17 Jan 2014 16:27:15 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:27:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43844040
Fri 17 Jan 2014 16:27:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:27:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:27:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:27:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43844040
Fri 17 Jan 2014 16:27:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:27:24 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:27:24 - job_xml_thread(): Done retrieving: data size 43844040
Fri 17 Jan 2014 16:27:25 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:27:25 - XML: Start document: iteration 17
Fri 17 Jan 2014 16:27:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:27:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:27:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:27:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:27:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:27:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:27:30 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:27:30 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 16:27:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:27:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:27:31 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:27:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:27:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:27:36 - XML: Processed 655463 elements - found 632 jobs
Fri 17 Jan 2014 16:27:36 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 16:27:36 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 16:27:37 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 16:27:37 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:27:38 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:27:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:27:38 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:27:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:27:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:27:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:27:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:27:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:27:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:27:42 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:27:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855341
Fri 17 Jan 2014 16:27:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:27:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855341
Fri 17 Jan 2014 16:27:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:27:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:27:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:27:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:27:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:27:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:27:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:27:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:27:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:27:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:27:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:27:52 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:27:53 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:27:53 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:27:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 16:27:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:27:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:27:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:27:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:27:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:27:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:27:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:27:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:27:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:27:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:27:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:28:01 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:28:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43846301
Fri 17 Jan 2014 16:28:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:28:01 - job_xml_thread(): Done retrieving: data size 43846301
Fri 17 Jan 2014 16:28:01 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:28:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43846301
Fri 17 Jan 2014 16:28:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:28:02 - XML: Start document: iteration 18
Fri 17 Jan 2014 16:28:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:28:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:28:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:28:13 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:28:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:28:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:28:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:28:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:28:14 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:28:14 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:28:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:28:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:28:14 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:28:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:28:15 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:28:16 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:28:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 16:28:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:28:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 16:28:16 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:28:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5966 values 94092 bits 11761 bytes 
Fri 17 Jan 2014 16:28:19 - XML: Processed 655464 elements - found 632 jobs
Fri 17 Jan 2014 16:28:19 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:28:19 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:28:19 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:28:19 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:28:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:28:24 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:28:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:28:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:28:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:28:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:28:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:28:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:28:27 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:28:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43850567
Fri 17 Jan 2014 16:28:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:28:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43850567
Fri 17 Jan 2014 16:28:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:28:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:28:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:28:34 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:28:34 - job_xml_thread(): Done retrieving: data size 43850567
Fri 17 Jan 2014 16:28:34 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:28:34 - XML: Start document: iteration 19
Fri 17 Jan 2014 16:28:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:28:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:28:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:28:45 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:28:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:28:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:28:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:28:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:28:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:28:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:28:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:28:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:28:49 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:28:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:28:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:28:51 - XML: Processed 655464 elements - found 632 jobs
Fri 17 Jan 2014 16:28:51 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:28:51 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:28:51 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:28:51 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:28:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:28:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:28:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:28:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:28:51 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:28:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 16:28:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:28:54 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:28:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43861642
Fri 17 Jan 2014 16:28:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:28:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43861642
Fri 17 Jan 2014 16:28:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:29:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:29:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:29:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:29:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:29:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:29:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:29:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:29:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:29:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43861642
Fri 17 Jan 2014 16:29:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:29:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:29:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:29:06 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:29:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:29:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:29:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:29:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:29:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:29:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:29:16 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:29:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:29:16 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:29:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 16:29:16 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:29:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 16:29:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5699 values 89812 bits 11226 bytes 
Fri 17 Jan 2014 16:29:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:29:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:29:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:29:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:29:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:29:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:29:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:29:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:29:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:29:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:29:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:29:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:29:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:29:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:29:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:29:19 - job_xml_thread(): Done retrieving: data size 43762945
Fri 17 Jan 2014 16:29:19 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:29:19 - XML: Start document: iteration 20
Fri 17 Jan 2014 16:29:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43762945
Fri 17 Jan 2014 16:29:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:29:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43762945
Fri 17 Jan 2014 16:29:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:29:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:29:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:29:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:29:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:29:36 - XML: Processed 654720 elements - found 634 jobs
Fri 17 Jan 2014 16:29:36 - job 7348400 field 'start_timestamp' changed since saved from: 1389972413 to: 1389972371
Fri 17 Jan 2014 16:29:36 - job 7348402 field 'start_timestamp' changed since saved from: 1389972417 to: 1389972371
Fri 17 Jan 2014 16:29:36 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 16:29:36 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 16:29:39 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 16:29:39 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:29:39 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:29:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:29:42 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:29:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:29:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:29:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:29:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:29:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:29:43 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:29:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:29:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:29:44 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:29:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:29:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:29:45 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:29:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 16:29:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:29:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:29:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:29:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:29:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:29:46 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:29:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43249121
Fri 17 Jan 2014 16:29:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:29:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43249121
Fri 17 Jan 2014 16:29:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:29:54 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:29:54 - job_xml_thread(): Done retrieving: data size 43249121
Fri 17 Jan 2014 16:29:54 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:29:54 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 16:29:55 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 16:29:55 - Housekeeping: done.
Fri 17 Jan 2014 16:29:55 - XML: Start document: iteration 0
Fri 17 Jan 2014 16:29:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:29:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:30:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:30:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:30:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:30:03 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:30:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:30:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:30:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:30:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:30:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:30:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:30:05 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:30:08 - XML: Processed 647854 elements - found 634 jobs
Fri 17 Jan 2014 16:30:08 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:30:08 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:30:08 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:30:08 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:30:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:30:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:30:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:30:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:30:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:30:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:30:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:30:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:30:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:30:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43206697
Fri 17 Jan 2014 16:30:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:30:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43206697
Fri 17 Jan 2014 16:30:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:30:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:30:16 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:30:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:30:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 16:30:18 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:30:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8632 values 136073 bits 17009 bytes 
Fri 17 Jan 2014 16:30:18 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:30:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 16:30:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:30:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:30:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:30:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:30:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:30:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:30:23 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:30:23 - job_xml_thread(): Done retrieving: data size 43206697
Fri 17 Jan 2014 16:30:23 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:30:23 - XML: Start document: iteration 1
Fri 17 Jan 2014 16:30:23 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:30:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:30:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:30:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:30:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43206697
Fri 17 Jan 2014 16:30:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:30:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:30:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:30:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:30:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:30:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:30:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:30:39 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:30:39 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:30:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:30:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:30:40 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:30:43 - XML: Processed 647272 elements - found 634 jobs
Fri 17 Jan 2014 16:30:43 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:30:43 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:30:43 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:30:43 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:30:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:30:44 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:30:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:30:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:30:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:30:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:30:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:30:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:30:46 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 16:30:46 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 16:30:46 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:30:47 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:30:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43801512
Fri 17 Jan 2014 16:30:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:30:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43801512
Fri 17 Jan 2014 16:30:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:30:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:30:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:30:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:30:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:30:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:30:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:30:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:30:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:30:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:30:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:30:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:30:58 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:30:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 16:30:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:30:58 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:30:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:30:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:31:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:31:03 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:31:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:31:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:31:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:31:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:31:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:31:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:31:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:31:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43837878
Fri 17 Jan 2014 16:31:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:31:05 - job_xml_thread(): Done retrieving: data size 43837878
Fri 17 Jan 2014 16:31:05 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:31:05 - XML: Start document: iteration 2
Fri 17 Jan 2014 16:31:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43837878
Fri 17 Jan 2014 16:31:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:31:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:31:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:31:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:31:18 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:31:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:31:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:31:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:31:20 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:31:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 16:31:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 16:31:20 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:31:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6235 values 98407 bits 12300 bytes 
Fri 17 Jan 2014 16:31:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:31:21 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:31:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:31:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:31:21 - XML: Processed 655466 elements - found 633 jobs
Fri 17 Jan 2014 16:31:21 - job 7348240 appears to have finished
Fri 17 Jan 2014 16:31:21 - job 7348322 report time 1389972511 does not match current heartbeat 1389972631 : ignoring job
Fri 17 Jan 2014 16:31:21 - job 7348363 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 16:31:22 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 16:31:22 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 16:31:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:31:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:31:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:31:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:31:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:31:23 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 16:31:23 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:31:23 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:31:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:31:27 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:31:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:31:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:31:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:31:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:31:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:31:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:31:29 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:31:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 16:31:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:31:29 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:31:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43861174
Fri 17 Jan 2014 16:31:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:31:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43861174
Fri 17 Jan 2014 16:31:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:31:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:31:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:31:38 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:31:38 - job_xml_thread(): Done retrieving: data size 43861174
Fri 17 Jan 2014 16:31:38 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:31:39 - XML: Start document: iteration 3
Fri 17 Jan 2014 16:31:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:31:42 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:31:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:31:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:31:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:31:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:31:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:31:43 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:31:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:31:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:31:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:31:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:31:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:31:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:31:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:31:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:31:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:31:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:31:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:31:52 - XML: Processed 655463 elements - found 633 jobs
Fri 17 Jan 2014 16:31:52 - job 7348322 report time 1389972511 does not match current heartbeat 1389972631 : ignoring job
Fri 17 Jan 2014 16:31:52 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:31:52 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:31:52 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:31:52 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:31:54 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:31:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43844469
Fri 17 Jan 2014 16:31:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:31:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43844469
Fri 17 Jan 2014 16:31:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:31:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:31:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:32:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:32:06 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:32:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:32:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:32:06 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:32:06 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:32:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:32:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:32:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:32:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:32:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:32:07 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:32:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:32:08 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:32:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:32:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:32:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:32:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:32:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:32:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:32:10 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:32:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43879951
Fri 17 Jan 2014 16:32:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:32:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43879951
Fri 17 Jan 2014 16:32:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:32:10 - job_xml_thread(): Done retrieving: data size 43879951
Fri 17 Jan 2014 16:32:10 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:32:10 - XML: Start document: iteration 4
Fri 17 Jan 2014 16:32:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:32:20 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:32:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:32:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 16:32:20 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:32:20 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:32:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 149017 bits 18627 bytes 
Fri 17 Jan 2014 16:32:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 16:32:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:32:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:32:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:32:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:32:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:32:25 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:32:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:32:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:32:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:32:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:32:27 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:32:27 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:32:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:32:30 - XML: Processed 655466 elements - found 633 jobs
Fri 17 Jan 2014 16:32:30 - job 7348322 report time 1389972511 does not match current heartbeat 1389972631 : ignoring job
Fri 17 Jan 2014 16:32:30 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:32:30 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:32:30 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:32:30 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:32:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:32:32 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:32:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:32:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:32:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:32:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:32:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:32:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:32:34 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:32:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43847420
Fri 17 Jan 2014 16:32:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:32:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43847420
Fri 17 Jan 2014 16:32:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:32:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:32:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:32:46 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:32:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:32:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:32:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:32:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:32:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:32:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:32:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:32:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:32:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:32:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:32:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:32:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:32:49 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:32:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:32:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:32:49 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:32:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 16:32:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:32:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:32:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:32:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:32:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:32:51 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:32:51 - job_xml_thread(): Done retrieving: data size 43864314
Fri 17 Jan 2014 16:32:51 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:32:51 - XML: Start document: iteration 5
Fri 17 Jan 2014 16:32:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43864314
Fri 17 Jan 2014 16:32:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:32:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43864314
Fri 17 Jan 2014 16:32:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:33:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:33:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:33:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:33:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:33:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:33:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:33:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:33:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:33:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:33:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:33:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:33:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:33:05 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:33:11 - XML: Processed 655466 elements - found 633 jobs
Fri 17 Jan 2014 16:33:11 - job 7348322 report time 1389972511 does not match current heartbeat 1389972631 : ignoring job
Fri 17 Jan 2014 16:33:11 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:33:11 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:33:11 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:33:11 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:33:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:33:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:33:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:33:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:33:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:33:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:33:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:33:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:33:15 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:33:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43838437
Fri 17 Jan 2014 16:33:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:33:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43838437
Fri 17 Jan 2014 16:33:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:33:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:33:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:33:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:33:21 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:33:21 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:33:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:33:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 16:33:21 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:33:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 16:33:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9037 values 142916 bits 17864 bytes 
Fri 17 Jan 2014 16:33:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:33:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:33:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:33:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:33:25 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:33:25 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:33:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:33:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:33:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43838437
Fri 17 Jan 2014 16:33:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:33:26 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:33:26 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:33:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:33:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:33:31 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 16:33:31 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:33:31 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:33:31 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:33:31 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 16:33:31 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 16:33:31 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 16:33:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:33:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:33:36 - size of cluster 'LISA Cluster': 624 hosts 79479 metrics 796919 values 12597841 bits 1574730 bytes 
Fri 17 Jan 2014 16:33:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:33:38 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:33:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:33:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:33:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:33:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:33:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:33:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:33:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:33:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:33:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:33:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:33:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:33:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:33:41 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:33:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 16:33:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:33:41 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:33:41 - job_xml_thread(): Done retrieving: data size 43844024
Fri 17 Jan 2014 16:33:41 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:33:41 - XML: Start document: iteration 6
Fri 17 Jan 2014 16:33:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43844024
Fri 17 Jan 2014 16:33:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:33:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43844024
Fri 17 Jan 2014 16:33:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:33:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:33:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:33:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:33:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:33:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:33:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:33:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:33:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:33:56 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:33:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:33:56 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:33:56 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:33:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:34:03 - XML: Processed 655461 elements - found 632 jobs
Fri 17 Jan 2014 16:34:03 - job 7348383 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 16:34:03 - job 7348215 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 16:34:03 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 16:34:03 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 16:34:04 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 16:34:04 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:34:04 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:34:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:34:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:34:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:34:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:34:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:34:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:34:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:34:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:34:08 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:34:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43850603
Fri 17 Jan 2014 16:34:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:34:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43850603
Fri 17 Jan 2014 16:34:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:34:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:34:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:34:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:34:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:34:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:34:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:34:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:34:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:34:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:34:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:34:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:34:19 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:34:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:34:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:34:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:34:21 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:34:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:34:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:34:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:34:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:34:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:34:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:34:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:34:22 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:34:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:34:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 16:34:22 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:34:22 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:34:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 16:34:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6179 values 97499 bits 12187 bytes 
Fri 17 Jan 2014 16:34:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:34:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43880426
Fri 17 Jan 2014 16:34:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:34:25 - job_xml_thread(): Done retrieving: data size 43880426
Fri 17 Jan 2014 16:34:25 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:34:25 - XML: Start document: iteration 7
Fri 17 Jan 2014 16:34:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43880426
Fri 17 Jan 2014 16:34:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:34:31 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:34:31 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 16:34:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:34:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:34:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:34:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:34:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:34:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:34:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:34:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:34:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:34:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:34:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:34:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:34:44 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:34:46 - XML: Processed 655464 elements - found 632 jobs
Fri 17 Jan 2014 16:34:46 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:34:46 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:34:46 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:34:46 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:34:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:34:49 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:34:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:34:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:34:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:34:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:34:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:34:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:34:51 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:34:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 16:34:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:34:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:34:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43861129
Fri 17 Jan 2014 16:34:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:34:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43861129
Fri 17 Jan 2014 16:34:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:34:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:34:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:35:01 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:35:01 - job_xml_thread(): Done retrieving: data size 43861129
Fri 17 Jan 2014 16:35:01 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:35:02 - XML: Start document: iteration 8
Fri 17 Jan 2014 16:35:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:35:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:35:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:35:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:35:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:35:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:35:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:35:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:35:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:35:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:35:05 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:35:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:35:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:35:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:35:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:35:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:35:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:35:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:35:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:35:13 - XML: Processed 655464 elements - found 632 jobs
Fri 17 Jan 2014 16:35:13 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:35:13 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:35:13 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:35:13 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:35:16 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:35:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43763224
Fri 17 Jan 2014 16:35:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:35:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43763224
Fri 17 Jan 2014 16:35:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:35:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:35:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:35:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:35:22 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:35:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:35:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 16:35:23 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:35:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 16:35:23 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:35:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7880 values 124291 bits 15536 bytes 
Fri 17 Jan 2014 16:35:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:35:25 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:35:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:35:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:35:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:35:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:35:26 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:35:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:35:26 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:35:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:35:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43763224
Fri 17 Jan 2014 16:35:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:35:28 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:35:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:35:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:35:38 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:35:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:35:38 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:35:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:35:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:35:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:35:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:35:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:35:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:35:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:35:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:35:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:35:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:35:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:35:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:35:42 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:35:42 - job_xml_thread(): Done retrieving: data size 43354348
Fri 17 Jan 2014 16:35:42 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:35:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43354348
Fri 17 Jan 2014 16:35:42 - XML: Start document: iteration 9
Fri 17 Jan 2014 16:35:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:35:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43354348
Fri 17 Jan 2014 16:35:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:35:50 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:35:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 16:35:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:35:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:35:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:35:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:35:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:35:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:35:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:35:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:35:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:36:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:36:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:36:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:36:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:36:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:36:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:36:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:36:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:36:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:36:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:36:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:36:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:36:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:36:05 - XML: Processed 649378 elements - found 631 jobs
Fri 17 Jan 2014 16:36:05 - job 7348244 appears to have finished
Fri 17 Jan 2014 16:36:05 - job 7347946 appears to have finished
Fri 17 Jan 2014 16:36:05 - job 7348234 appears to have finished
Fri 17 Jan 2014 16:36:05 - job_xml_thread(): Found 5 updated jobs.
Fri 17 Jan 2014 16:36:05 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 16:36:05 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Fri 17 Jan 2014 16:36:05 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:36:06 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:36:09 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:36:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43200980
Fri 17 Jan 2014 16:36:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:36:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43200980
Fri 17 Jan 2014 16:36:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:36:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:36:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:36:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:36:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:36:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:36:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:36:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:36:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:36:21 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:36:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:36:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:36:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:36:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:36:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:36:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:36:23 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:36:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:36:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:36:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:36:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:36:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:36:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:36:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:36:23 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:36:24 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:36:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 16:36:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:36:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 16:36:24 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:36:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6337 values 99919 bits 12489 bytes 
Fri 17 Jan 2014 16:36:27 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:36:27 - job_xml_thread(): Done retrieving: data size 43303553
Fri 17 Jan 2014 16:36:27 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:36:27 - XML: Start document: iteration 10
Fri 17 Jan 2014 16:36:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43303553
Fri 17 Jan 2014 16:36:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:36:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43303553
Fri 17 Jan 2014 16:36:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:36:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:36:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:36:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:36:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:36:46 - XML: Processed 648166 elements - found 631 jobs
Fri 17 Jan 2014 16:36:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:36:46 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:36:46 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:36:46 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:36:46 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:36:46 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:36:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:36:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:36:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:36:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:36:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:36:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:36:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:36:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:36:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:36:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:36:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:36:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:36:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:36:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:36:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:36:52 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:36:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 16:36:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:36:54 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:36:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43803658
Fri 17 Jan 2014 16:36:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:36:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43803658
Fri 17 Jan 2014 16:36:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:37:01 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:37:01 - job_xml_thread(): Done retrieving: data size 43803658
Fri 17 Jan 2014 16:37:01 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:37:01 - XML: Start document: iteration 11
Fri 17 Jan 2014 16:37:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:37:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:37:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:37:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:37:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:37:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:37:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:37:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:37:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:37:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:37:05 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:37:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:37:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:37:15 - XML: Processed 654720 elements - found 631 jobs
Fri 17 Jan 2014 16:37:15 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:37:15 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:37:15 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:37:15 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:37:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:37:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:37:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:37:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:37:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:37:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:37:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:37:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:37:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:37:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43829191
Fri 17 Jan 2014 16:37:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:37:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43829191
Fri 17 Jan 2014 16:37:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:37:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:37:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:37:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:37:24 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:37:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:37:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 16:37:26 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:37:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8067 values 127219 bits 15902 bytes 
Fri 17 Jan 2014 16:37:26 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:37:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 16:37:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:37:29 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:37:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:37:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:37:30 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:37:30 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:37:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:37:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:37:30 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:37:31 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:37:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:37:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:37:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:37:35 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:37:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:37:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:37:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:37:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:37:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:37:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:37:37 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 16:37:37 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 16:37:37 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:37:38 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:37:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 16:37:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:37:38 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:37:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855697
Fri 17 Jan 2014 16:37:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:37:39 - job_xml_thread(): Done retrieving: data size 43855697
Fri 17 Jan 2014 16:37:39 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:37:39 - XML: Start document: iteration 12
Fri 17 Jan 2014 16:37:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855697
Fri 17 Jan 2014 16:37:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:37:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:37:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:37:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:37:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:37:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:37:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:37:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:37:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:37:54 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:37:54 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:37:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:37:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:37:54 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:38:01 - XML: Processed 655462 elements - found 631 jobs
Fri 17 Jan 2014 16:38:01 - job 7348406 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 16:38:01 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 16:38:01 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 16:38:02 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 16:38:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:38:02 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:38:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:38:02 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:38:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:38:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:38:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:38:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:38:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:38:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:38:04 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:38:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43837861
Fri 17 Jan 2014 16:38:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:38:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43837861
Fri 17 Jan 2014 16:38:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:38:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:38:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:38:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:38:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:38:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:38:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:38:17 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:38:17 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:38:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:38:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:38:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:38:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:38:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:38:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:38:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:38:19 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:38:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:38:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:38:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:38:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:38:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:38:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:38:21 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:38:21 - job_xml_thread(): Done retrieving: data size 43869036
Fri 17 Jan 2014 16:38:21 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:38:21 - XML: Start document: iteration 13
Fri 17 Jan 2014 16:38:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43869036
Fri 17 Jan 2014 16:38:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:38:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43869036
Fri 17 Jan 2014 16:38:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:38:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:38:29 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:38:29 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:38:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:38:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 16:38:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 16:38:30 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:38:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148610 bits 18576 bytes 
Fri 17 Jan 2014 16:38:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:38:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:38:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:38:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:38:38 - XML: Processed 655462 elements - found 631 jobs
Fri 17 Jan 2014 16:38:38 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:38:38 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:38:38 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:38:38 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:38:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:38:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:38:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:38:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:38:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:38:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:38:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:38:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:38:40 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:38:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:38:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:38:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:38:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:38:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:38:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:38:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:38:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:38:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:38:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43863910
Fri 17 Jan 2014 16:38:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:38:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43863910
Fri 17 Jan 2014 16:38:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:38:53 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:38:53 - job_xml_thread(): Done retrieving: data size 43863910
Fri 17 Jan 2014 16:38:53 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:38:53 - XML: Start document: iteration 14
Fri 17 Jan 2014 16:38:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:38:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:38:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:38:58 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:38:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:38:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:38:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:38:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:38:59 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:39:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:39:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:39:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:39:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:39:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:39:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:39:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:39:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:39:08 - XML: Processed 655462 elements - found 631 jobs
Fri 17 Jan 2014 16:39:08 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:39:08 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:39:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:39:08 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:39:08 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:39:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:39:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:39:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:39:08 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:39:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 16:39:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:39:09 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:39:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855791
Fri 17 Jan 2014 16:39:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:39:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855791
Fri 17 Jan 2014 16:39:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:39:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:39:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:39:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:39:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:39:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:39:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:39:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:39:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:39:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:39:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:39:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:39:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:39:23 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:39:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:39:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:39:24 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:39:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:39:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:39:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:39:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:39:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:39:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:39:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:39:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43879661
Fri 17 Jan 2014 16:39:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:39:26 - job_xml_thread(): Done retrieving: data size 43879661
Fri 17 Jan 2014 16:39:26 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:39:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43879661
Fri 17 Jan 2014 16:39:27 - XML: Start document: iteration 15
Fri 17 Jan 2014 16:39:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:39:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:39:33 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:39:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:39:33 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:39:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 16:39:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 16:39:33 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:39:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9071 values 142994 bits 17874 bytes 
Fri 17 Jan 2014 16:39:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:39:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:39:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:39:38 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:39:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:39:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:39:39 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:39:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:39:39 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:39:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:39:39 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:39:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:39:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:39:44 - XML: Processed 655454 elements - found 627 jobs
Fri 17 Jan 2014 16:39:44 - job 7348233 appears to have finished
Fri 17 Jan 2014 16:39:44 - job 7348247 appears to have finished
Fri 17 Jan 2014 16:39:44 - job 7348399 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 16:39:44 - job 7348232 appears to have finished
Fri 17 Jan 2014 16:39:44 - job 7348237 appears to have finished
Fri 17 Jan 2014 16:39:44 - job_xml_thread(): Found 5 updated jobs.
Fri 17 Jan 2014 16:39:44 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 16:39:44 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Fri 17 Jan 2014 16:39:44 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:39:45 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:39:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:39:48 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:39:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:39:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:39:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:39:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:39:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:39:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:39:50 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:39:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 16:39:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:39:50 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:39:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43831114
Fri 17 Jan 2014 16:39:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:39:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43831114
Fri 17 Jan 2014 16:39:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:39:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:39:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:40:00 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:40:00 - job_xml_thread(): Done retrieving: data size 43831114
Fri 17 Jan 2014 16:40:00 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:40:00 - XML: Start document: iteration 16
Fri 17 Jan 2014 16:40:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:40:03 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:40:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:40:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:40:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:40:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:40:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:40:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:40:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:40:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:40:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:40:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:40:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:40:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:40:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:40:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:40:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:40:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:40:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:40:12 - XML: Processed 655454 elements - found 627 jobs
Fri 17 Jan 2014 16:40:12 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:40:12 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:40:12 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:40:12 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:40:15 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:40:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43835713
Fri 17 Jan 2014 16:40:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:40:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43835713
Fri 17 Jan 2014 16:40:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:40:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:40:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:40:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:40:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:40:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:40:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:40:25 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:40:25 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:40:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:40:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:40:25 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:40:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:40:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:40:27 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:40:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:40:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:40:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:40:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:40:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:40:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:40:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:40:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:40:30 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:40:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43850717
Fri 17 Jan 2014 16:40:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:40:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43850717
Fri 17 Jan 2014 16:40:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:40:31 - job_xml_thread(): Done retrieving: data size 43850717
Fri 17 Jan 2014 16:40:31 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:40:32 - XML: Start document: iteration 17
Fri 17 Jan 2014 16:40:33 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 16:40:33 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:40:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:40:34 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:40:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:40:35 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:40:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 16:40:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 16:40:35 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:40:36 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:40:36 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:40:36 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 16:40:36 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 16:40:36 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 16:40:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9279 values 146363 bits 18295 bytes 
Fri 17 Jan 2014 16:40:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:40:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:40:41 - size of cluster 'LISA Cluster': 624 hosts 79451 metrics 714246 values 11268299 bits 1408537 bytes 
Fri 17 Jan 2014 16:40:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:40:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:40:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:40:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:40:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:40:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:40:47 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:40:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:40:47 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:40:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:40:47 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:40:52 - XML: Processed 655454 elements - found 627 jobs
Fri 17 Jan 2014 16:40:53 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:40:53 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:40:53 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:40:53 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:40:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:40:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:40:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:40:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:40:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:40:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:40:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:40:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:40:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:40:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43835697
Fri 17 Jan 2014 16:40:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:40:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43835697
Fri 17 Jan 2014 16:40:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:41:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:41:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:41:08 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:41:08 - job_xml_thread(): Done retrieving: data size 43835697
Fri 17 Jan 2014 16:41:08 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:41:08 - XML: Start document: iteration 18
Fri 17 Jan 2014 16:41:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:41:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:41:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:41:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:41:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:41:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:41:16 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:41:16 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:41:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:41:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:41:17 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:41:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:41:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:41:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:41:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:41:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:41:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:41:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:41:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:41:21 - XML: Processed 655454 elements - found 627 jobs
Fri 17 Jan 2014 16:41:21 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:41:21 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:41:21 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:41:21 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:41:21 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:41:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 16:41:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:41:24 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:41:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43802466
Fri 17 Jan 2014 16:41:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:41:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43802466
Fri 17 Jan 2014 16:41:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:41:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:41:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:41:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:41:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:41:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:41:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:41:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:41:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:41:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:41:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:41:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:41:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:41:34 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:41:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:41:35 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:41:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:41:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 16:41:35 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:41:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6006 values 94702 bits 11837 bytes 
Fri 17 Jan 2014 16:41:36 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:41:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 16:41:36 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:41:36 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:41:36 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 16:41:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:41:40 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:41:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:41:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:41:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:41:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:41:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:41:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:41:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:41:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43294786
Fri 17 Jan 2014 16:41:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:41:43 - job_xml_thread(): Done retrieving: data size 43294786
Fri 17 Jan 2014 16:41:43 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:41:43 - XML: Start document: iteration 19
Fri 17 Jan 2014 16:41:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43294786
Fri 17 Jan 2014 16:41:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:41:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:41:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:41:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:41:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:41:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:41:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:41:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:41:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:42:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:42:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:42:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:42:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:42:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:42:04 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:42:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 16:42:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:42:04 - XML: Processed 648524 elements - found 631 jobs
Fri 17 Jan 2014 16:42:04 - job 7348238 appears to have finished
Fri 17 Jan 2014 16:42:04 - job 7348261 appears to have finished
Fri 17 Jan 2014 16:42:04 - job 7348399 field 'start_timestamp' changed since saved from: 1389973131 to: 1389973075
Fri 17 Jan 2014 16:42:04 - job 7348406 appears to have finished
Fri 17 Jan 2014 16:42:04 - job 7348216 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 16:42:04 - job 7348248 appears to have finished
Fri 17 Jan 2014 16:42:04 - job_xml_thread(): Found 14 updated jobs.
Fri 17 Jan 2014 16:42:04 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 16:42:05 - job_xml_thread(): Done storing. succesfully stored: 14 jobs
Fri 17 Jan 2014 16:42:05 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:42:05 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:42:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:42:06 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:42:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:42:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:42:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:42:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:42:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:42:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:42:09 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:42:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43199278
Fri 17 Jan 2014 16:42:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:42:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43199278
Fri 17 Jan 2014 16:42:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:42:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:42:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:42:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:42:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:42:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:42:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:42:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:42:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:42:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:42:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:42:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43199278
Fri 17 Jan 2014 16:42:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:42:20 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:42:20 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:42:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:42:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:42:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:42:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:42:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:42:32 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:42:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:42:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:42:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:42:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:42:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:42:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:42:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:42:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:42:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:42:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:42:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:42:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:42:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:42:35 - job_xml_thread(): Done retrieving: data size 43530035
Fri 17 Jan 2014 16:42:35 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:42:35 - XML: Start document: iteration 20
Fri 17 Jan 2014 16:42:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43530035
Fri 17 Jan 2014 16:42:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:42:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:42:36 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:42:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43530035
Fri 17 Jan 2014 16:42:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:42:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:42:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 16:42:36 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:42:36 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:42:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 16:42:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7558 values 119166 bits 14895 bytes 
Fri 17 Jan 2014 16:42:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:42:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:42:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:42:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:42:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:42:50 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:42:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:42:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:42:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:42:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:42:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:42:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:42:52 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:42:55 - XML: Processed 651772 elements - found 631 jobs
Fri 17 Jan 2014 16:42:55 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:42:55 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:42:55 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:42:55 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:42:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:42:59 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:42:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:42:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:43:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:43:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:43:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:43:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:43:03 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:43:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 16:43:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:43:03 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:43:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43833712
Fri 17 Jan 2014 16:43:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43833712
Fri 17 Jan 2014 16:43:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:43:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:43:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:43:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:43:10 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:43:10 - job_xml_thread(): Done retrieving: data size 43833712
Fri 17 Jan 2014 16:43:11 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:43:11 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 16:43:13 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 16:43:13 - Housekeeping: done.
Fri 17 Jan 2014 16:43:13 - XML: Start document: iteration 0
Fri 17 Jan 2014 16:43:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:43:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:43:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:43:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:43:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:43:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:43:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:43:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:43:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:43:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:43:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:43:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:43:21 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:43:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:43:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:43:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:43:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:43:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:43:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:43:25 - XML: Processed 655462 elements - found 631 jobs
Fri 17 Jan 2014 16:43:25 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:43:25 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:43:25 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:43:25 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:43:26 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 16:43:26 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 16:43:26 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:43:27 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:43:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43857082
Fri 17 Jan 2014 16:43:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:43:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43857082
Fri 17 Jan 2014 16:43:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:43:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:43:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:43:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:43:36 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:43:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:43:37 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:43:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 16:43:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 16:43:37 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:43:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99003 bits 12375 bytes 
Fri 17 Jan 2014 16:43:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:43:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:43:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:43:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:43:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:43:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:43:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:43:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:43:40 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:43:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:43:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:43:40 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:43:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:43:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:43:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:43:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:43:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:43:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:43:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:43:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:43:45 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:43:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 16:43:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:43:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:43:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43845630
Fri 17 Jan 2014 16:43:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:43:46 - job_xml_thread(): Done retrieving: data size 43845630
Fri 17 Jan 2014 16:43:46 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:43:46 - XML: Start document: iteration 1
Fri 17 Jan 2014 16:43:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43845630
Fri 17 Jan 2014 16:43:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:43:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:43:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:43:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:43:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:44:02 - XML: Processed 655462 elements - found 631 jobs
Fri 17 Jan 2014 16:44:02 - job 7348245 appears to have finished
Fri 17 Jan 2014 16:44:02 - job 7348414 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 16:44:02 - job 7348415 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 16:44:02 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 16:44:02 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 16:44:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:44:03 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:44:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:44:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:44:04 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:44:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:44:04 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:44:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:44:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:44:04 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 16:44:04 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:44:04 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:44:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:44:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:44:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:44:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:44:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:44:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:44:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:44:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:44:09 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:44:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875247
Fri 17 Jan 2014 16:44:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:44:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875247
Fri 17 Jan 2014 16:44:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:44:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:44:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:44:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:44:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:44:19 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:44:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:44:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:44:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:44:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:44:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:44:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:44:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:44:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:44:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:44:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:44:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:44:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:44:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:44:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:44:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:44:23 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:44:23 - job_xml_thread(): Done retrieving: data size 43879133
Fri 17 Jan 2014 16:44:23 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:44:23 - XML: Start document: iteration 2
Fri 17 Jan 2014 16:44:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43879133
Fri 17 Jan 2014 16:44:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:44:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43879133
Fri 17 Jan 2014 16:44:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:44:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:44:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:44:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:44:37 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:44:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:44:37 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:44:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 16:44:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 16:44:38 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:44:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148538 bits 18567 bytes 
Fri 17 Jan 2014 16:44:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:44:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:44:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:44:42 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:44:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:44:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:44:42 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:44:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:44:42 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:44:42 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:44:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:44:43 - XML: Processed 655462 elements - found 631 jobs
Fri 17 Jan 2014 16:44:43 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:44:43 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:44:43 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:44:43 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:44:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:44:46 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:44:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:44:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:44:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:44:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:44:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:44:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:44:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:44:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43850423
Fri 17 Jan 2014 16:44:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:44:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43850423
Fri 17 Jan 2014 16:44:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:44:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:44:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:44:58 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:44:58 - job_xml_thread(): Done retrieving: data size 43850423
Fri 17 Jan 2014 16:44:58 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:44:58 - XML: Start document: iteration 3
Fri 17 Jan 2014 16:45:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:45:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:45:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:45:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:45:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:45:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:45:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:45:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:45:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:45:05 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:45:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:45:11 - XML: Processed 655462 elements - found 631 jobs
Fri 17 Jan 2014 16:45:11 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:45:11 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:45:11 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:45:11 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:45:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:45:12 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:45:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:45:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:45:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:45:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:45:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:45:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:45:12 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:45:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 16:45:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:45:14 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:45:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43839859
Fri 17 Jan 2014 16:45:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:45:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43839859
Fri 17 Jan 2014 16:45:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:45:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:45:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:45:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:45:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:45:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:45:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:45:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:45:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:45:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:45:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:45:25 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:45:26 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:45:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:45:27 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:45:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:45:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:45:28 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:45:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43864813
Fri 17 Jan 2014 16:45:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:45:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:45:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:45:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:45:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43864813
Fri 17 Jan 2014 16:45:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:45:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:45:29 - job_xml_thread(): Done retrieving: data size 43864813
Fri 17 Jan 2014 16:45:30 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:45:30 - XML: Start document: iteration 4
Fri 17 Jan 2014 16:45:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:45:37 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:45:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:45:38 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:45:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:45:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 16:45:39 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:45:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:45:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 16:45:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:45:40 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:45:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8974 values 141524 bits 17690 bytes 
Fri 17 Jan 2014 16:45:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:45:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:45:40 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:45:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:45:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:45:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:45:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:45:48 - XML: Processed 655460 elements - found 630 jobs
Fri 17 Jan 2014 16:45:48 - job 7348259 appears to have finished
Fri 17 Jan 2014 16:45:48 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 16:45:48 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 16:45:49 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 16:45:49 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:45:49 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:45:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:45:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:45:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:45:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:45:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:45:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:45:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:45:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:45:52 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:45:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 16:45:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:45:53 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:45:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43846063
Fri 17 Jan 2014 16:45:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:45:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43846063
Fri 17 Jan 2014 16:45:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:45:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:45:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:46:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:46:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:46:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:46:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:46:04 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:46:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:46:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:46:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:46:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:46:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:46:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:46:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:46:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:46:06 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:46:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:46:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:46:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:46:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:46:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:46:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:46:08 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:46:08 - job_xml_thread(): Done retrieving: data size 43881717
Fri 17 Jan 2014 16:46:08 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:46:08 - XML: Start document: iteration 5
Fri 17 Jan 2014 16:46:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43881717
Fri 17 Jan 2014 16:46:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:46:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43881717
Fri 17 Jan 2014 16:46:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:46:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:46:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:46:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:46:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:46:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:46:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:46:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:46:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:46:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:46:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:46:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:46:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:46:25 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:46:26 - XML: Processed 655460 elements - found 630 jobs
Fri 17 Jan 2014 16:46:26 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:46:26 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:46:26 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:46:26 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:46:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:46:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:46:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:46:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:46:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:46:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:46:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:46:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:46:30 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:46:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43852314
Fri 17 Jan 2014 16:46:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:46:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43852314
Fri 17 Jan 2014 16:46:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:46:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:46:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:46:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:46:40 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:46:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:46:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:46:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:46:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:46:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:46:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:46:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:46:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:46:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:46:41 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:46:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:46:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 16:46:41 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:46:41 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:46:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 16:46:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148689 bits 18586 bytes 
Fri 17 Jan 2014 16:46:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:46:44 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:46:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:46:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:46:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:46:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:46:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:46:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:46:46 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:46:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851811
Fri 17 Jan 2014 16:46:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:46:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851811
Fri 17 Jan 2014 16:46:46 - job_xml_thread(): Done retrieving: data size 43851811
Fri 17 Jan 2014 16:46:46 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:46:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:46:46 - XML: Start document: iteration 6
Fri 17 Jan 2014 16:46:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:46:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:46:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:46:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:47:01 - XML: Processed 655460 elements - found 630 jobs
Fri 17 Jan 2014 16:47:01 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:47:01 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:47:01 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:47:01 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:47:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:47:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:47:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:47:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:47:06 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:47:06 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:47:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:47:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:47:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:47:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:47:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:47:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:47:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:47:07 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:47:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 16:47:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:47:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:47:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:47:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:47:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:47:09 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:47:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43821010
Fri 17 Jan 2014 16:47:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:47:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43821010
Fri 17 Jan 2014 16:47:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:47:16 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:47:17 - job_xml_thread(): Done retrieving: data size 43821010
Fri 17 Jan 2014 16:47:17 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:47:17 - XML: Start document: iteration 7
Fri 17 Jan 2014 16:47:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:47:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:47:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:47:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:47:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:47:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:47:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:47:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:47:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:47:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:47:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:47:26 - XML: Processed 654706 elements - found 627 jobs
Fri 17 Jan 2014 16:47:26 - job 7348262 appears to have finished
Fri 17 Jan 2014 16:47:27 - job 7348412 appears to have finished
Fri 17 Jan 2014 16:47:27 - job 7348290 appears to have finished
Fri 17 Jan 2014 16:47:27 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 16:47:27 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 16:47:27 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 16:47:27 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:47:27 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:47:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:47:30 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:47:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:47:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:47:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:47:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:47:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:47:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:47:31 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:47:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43767013
Fri 17 Jan 2014 16:47:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:47:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43767013
Fri 17 Jan 2014 16:47:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:47:36 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 16:47:36 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:47:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:47:38 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:47:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:47:38 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:47:38 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 16:47:38 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 16:47:38 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 16:47:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:47:41 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:47:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:47:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:47:42 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:47:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:47:42 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:47:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:47:42 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:47:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:47:42 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:47:42 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:47:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:47:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 16:47:43 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:47:43 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:47:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 16:47:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8734 values 138162 bits 17270 bytes 
Fri 17 Jan 2014 16:47:45 - size of cluster 'LISA Cluster': 624 hosts 79481 metrics 870031 values 13740921 bits 1717615 bytes 
Fri 17 Jan 2014 16:47:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:47:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:47:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:47:48 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:47:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:47:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:47:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:47:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:47:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:47:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:47:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:47:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43219767
Fri 17 Jan 2014 16:47:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:47:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43219767
Fri 17 Jan 2014 16:47:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:47:53 - job_xml_thread(): Done retrieving: data size 43219767
Fri 17 Jan 2014 16:47:53 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:47:53 - XML: Start document: iteration 8
Fri 17 Jan 2014 16:47:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:47:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:48:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:48:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:48:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:48:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:48:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:48:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:48:12 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:48:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:48:12 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:48:12 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:48:12 - XML: Processed 647732 elements - found 629 jobs
Fri 17 Jan 2014 16:48:12 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 16:48:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:48:12 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 16:48:13 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 16:48:13 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:48:13 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:48:16 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:48:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 16:48:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:48:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:48:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:48:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:48:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:48:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:48:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:48:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:48:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:48:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:48:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43245494
Fri 17 Jan 2014 16:48:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:48:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43245494
Fri 17 Jan 2014 16:48:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:48:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:48:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:48:28 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:48:28 - job_xml_thread(): Done retrieving: data size 43245494
Fri 17 Jan 2014 16:48:28 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:48:28 - XML: Start document: iteration 9
Fri 17 Jan 2014 16:48:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:48:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:48:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:48:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:48:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:48:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:48:31 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:48:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:48:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:48:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:48:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:48:38 - XML: Processed 648004 elements - found 629 jobs
Fri 17 Jan 2014 16:48:38 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:48:38 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:48:38 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:48:38 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:48:39 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:48:39 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 16:48:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:48:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:48:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:48:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:48:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:48:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:48:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:48:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:48:42 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:48:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43652055
Fri 17 Jan 2014 16:48:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:48:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:48:43 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:48:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43652055
Fri 17 Jan 2014 16:48:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:48:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:48:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 16:48:44 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:48:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 16:48:44 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:48:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9021 values 142479 bits 17809 bytes 
Fri 17 Jan 2014 16:48:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:48:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:48:53 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:48:53 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:48:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:48:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:48:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:48:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:48:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:48:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:48:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:48:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:48:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:48:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:48:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:48:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:48:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:48:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:48:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:48:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:48:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:48:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:49:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:49:02 - job_xml_thread(): Done retrieving: data size 43831561
Fri 17 Jan 2014 16:49:02 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:49:02 - XML: Start document: iteration 10
Fri 17 Jan 2014 16:49:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43831561
Fri 17 Jan 2014 16:49:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:49:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43831561
Fri 17 Jan 2014 16:49:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:49:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:49:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:49:11 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:49:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 16:49:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:49:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:49:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:49:22 - XML: Processed 655433 elements - found 629 jobs
Fri 17 Jan 2014 16:49:22 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:49:22 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:49:22 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:49:22 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:49:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:49:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:49:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:49:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:49:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:49:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:49:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:49:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:49:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:49:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:49:25 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:49:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:49:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:49:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:49:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:49:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:49:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:49:29 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:49:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43866570
Fri 17 Jan 2014 16:49:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:49:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43866570
Fri 17 Jan 2014 16:49:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:49:37 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:49:37 - job_xml_thread(): Done retrieving: data size 43866570
Fri 17 Jan 2014 16:49:37 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:49:37 - XML: Start document: iteration 11
Fri 17 Jan 2014 16:49:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:49:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:49:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:49:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:49:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:49:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:49:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:49:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:49:40 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:49:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:49:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:49:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:49:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:49:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:49:44 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:49:45 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:49:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:49:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 16:49:45 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:49:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6235 values 98380 bits 12297 bytes 
Fri 17 Jan 2014 16:49:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 16:49:48 - XML: Processed 655459 elements - found 630 jobs
Fri 17 Jan 2014 16:49:48 - job 7348421 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 16:49:49 - job 7348416 appears to have finished
Fri 17 Jan 2014 16:49:49 - job 7348414 appears to have finished
Fri 17 Jan 2014 16:49:49 - job 7348415 appears to have finished
Fri 17 Jan 2014 16:49:49 - job_xml_thread(): Found 8 updated jobs.
Fri 17 Jan 2014 16:49:49 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 16:49:50 - job_xml_thread(): Done storing. succesfully stored: 8 jobs
Fri 17 Jan 2014 16:49:50 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:49:50 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:49:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:49:53 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:49:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:49:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:49:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:49:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:49:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:49:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:49:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:49:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:49:57 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:49:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 16:49:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:49:57 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:49:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43834392
Fri 17 Jan 2014 16:49:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:49:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43834392
Fri 17 Jan 2014 16:49:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:50:05 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:50:05 - job_xml_thread(): Done retrieving: data size 43834392
Fri 17 Jan 2014 16:50:05 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:50:06 - XML: Start document: iteration 12
Fri 17 Jan 2014 16:50:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:50:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:50:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:50:13 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:50:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:50:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:50:14 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:50:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:50:14 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:50:14 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:50:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:50:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:50:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:50:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:50:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:50:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:50:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:50:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:50:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:50:20 - XML: Processed 655457 elements - found 630 jobs
Fri 17 Jan 2014 16:50:20 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:50:20 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:50:20 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:50:20 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:50:22 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:50:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853016
Fri 17 Jan 2014 16:50:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:50:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853016
Fri 17 Jan 2014 16:50:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:50:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:50:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:50:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:50:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:50:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:50:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:50:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:50:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:50:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:50:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:50:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:50:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:50:34 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:50:35 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:50:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:50:37 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:50:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:50:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:50:38 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 16:50:38 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 16:50:38 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:50:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:50:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:50:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:50:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:50:39 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:50:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43883098
Fri 17 Jan 2014 16:50:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:50:40 - job_xml_thread(): Done retrieving: data size 43883098
Fri 17 Jan 2014 16:50:40 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:50:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43883098
Fri 17 Jan 2014 16:50:40 - XML: Start document: iteration 13
Fri 17 Jan 2014 16:50:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:50:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:50:45 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:50:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:50:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 16:50:47 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:50:47 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:50:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 16:50:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148606 bits 18575 bytes 
Fri 17 Jan 2014 16:50:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:50:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:50:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:50:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:50:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:50:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:50:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:50:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:50:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:50:56 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:50:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:50:56 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:50:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:51:02 - XML: Processed 655460 elements - found 630 jobs
Fri 17 Jan 2014 16:51:02 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:51:02 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:51:02 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:51:02 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:51:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:51:03 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:51:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:51:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:51:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:51:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:51:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:51:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:51:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:51:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43844820
Fri 17 Jan 2014 16:51:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:51:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43844820
Fri 17 Jan 2014 16:51:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:51:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:51:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:51:12 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:51:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 16:51:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:51:17 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:51:17 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:51:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:51:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:51:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:51:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:51:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:51:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:51:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:51:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:51:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:51:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:51:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:51:21 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:51:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:51:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:51:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:51:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:51:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:51:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:51:23 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:51:23 - job_xml_thread(): Done retrieving: data size 43868960
Fri 17 Jan 2014 16:51:23 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:51:23 - XML: Start document: iteration 14
Fri 17 Jan 2014 16:51:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43868960
Fri 17 Jan 2014 16:51:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43868960
Fri 17 Jan 2014 16:51:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:51:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:51:32 - XML: Processed 655458 elements - found 629 jobs
Fri 17 Jan 2014 16:51:32 - job 7348420 appears to have finished
Fri 17 Jan 2014 16:51:32 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 16:51:32 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 16:51:33 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 16:51:33 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:51:34 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:51:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:51:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:51:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:51:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:51:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:51:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:51:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:51:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:51:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:51:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:51:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:51:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:51:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:51:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:51:44 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:51:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:51:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:51:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:51:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:51:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:51:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:51:46 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:51:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43849315
Fri 17 Jan 2014 16:51:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:51:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43849315
Fri 17 Jan 2014 16:51:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:51:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:51:49 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:51:49 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:51:49 - job_xml_thread(): Done retrieving: data size 43849315
Fri 17 Jan 2014 16:51:49 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:51:49 - XML: Start document: iteration 15
Fri 17 Jan 2014 16:51:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:51:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 16:51:50 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:51:50 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:51:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 16:51:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9339 values 147302 bits 18412 bytes 
Fri 17 Jan 2014 16:51:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:51:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:51:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:51:58 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:51:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:51:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:51:59 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:51:59 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:51:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:51:59 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:51:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:51:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:52:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:52:03 - XML: Processed 655458 elements - found 629 jobs
Fri 17 Jan 2014 16:52:03 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:52:03 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:52:03 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:52:03 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:52:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:52:06 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:52:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:52:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:52:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:52:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:52:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:52:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:52:08 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:52:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856547
Fri 17 Jan 2014 16:52:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:52:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43856547
Fri 17 Jan 2014 16:52:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:52:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:52:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:52:18 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:52:18 - job_xml_thread(): Done retrieving: data size 43856547
Fri 17 Jan 2014 16:52:18 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:52:18 - XML: Start document: iteration 16
Fri 17 Jan 2014 16:52:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:52:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:52:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:52:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:52:20 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:52:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:52:20 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:52:20 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:52:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:52:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:52:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:52:28 - XML: Processed 655458 elements - found 629 jobs
Fri 17 Jan 2014 16:52:28 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:52:28 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:52:28 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:52:28 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:52:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:52:30 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:52:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:52:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:52:30 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:52:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 16:52:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:52:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:52:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:52:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:52:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:52:31 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:52:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43831003
Fri 17 Jan 2014 16:52:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:52:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43831003
Fri 17 Jan 2014 16:52:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:52:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:52:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:52:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:52:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:52:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:52:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:52:42 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:52:42 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:52:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:52:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:52:42 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:52:43 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:52:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:52:45 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:52:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:52:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:52:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:52:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:52:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:52:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:52:47 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:52:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851638
Fri 17 Jan 2014 16:52:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:52:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851638
Fri 17 Jan 2014 16:52:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:52:48 - job_xml_thread(): Done retrieving: data size 43851638
Fri 17 Jan 2014 16:52:48 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:52:48 - XML: Start document: iteration 17
Fri 17 Jan 2014 16:52:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:52:51 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:52:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:52:52 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:52:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 16:52:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 16:52:52 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:52:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8606 values 135707 bits 16963 bytes 
Fri 17 Jan 2014 16:52:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:52:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:53:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:53:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:53:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:53:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:53:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:53:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:53:06 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:53:06 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:53:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:53:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:53:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:53:09 - XML: Processed 655458 elements - found 629 jobs
Fri 17 Jan 2014 16:53:09 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:53:09 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:53:09 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:53:10 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:53:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:53:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:53:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:53:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:53:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:53:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:53:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:53:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:53:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:53:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43785768
Fri 17 Jan 2014 16:53:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:53:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43785768
Fri 17 Jan 2014 16:53:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:53:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:53:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:53:25 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:53:25 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:53:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:53:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:53:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:53:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:53:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:53:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:53:27 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:53:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:53:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:53:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:53:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:53:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:53:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:53:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:53:28 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:53:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 16:53:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:53:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:53:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:53:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:53:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:53:30 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:53:30 - job_xml_thread(): Done retrieving: data size 43526600
Fri 17 Jan 2014 16:53:30 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:53:30 - XML: Start document: iteration 18
Fri 17 Jan 2014 16:53:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43526600
Fri 17 Jan 2014 16:53:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:53:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43526600
Fri 17 Jan 2014 16:53:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:53:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:53:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:53:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:53:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:53:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:53:50 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:53:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:53:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:53:51 - XML: Processed 651508 elements - found 626 jobs
Fri 17 Jan 2014 16:53:51 - job 7348422 appears to have finished
Fri 17 Jan 2014 16:53:51 - job 7348424 appears to have finished
Fri 17 Jan 2014 16:53:51 - job 7348401 appears to have finished
Fri 17 Jan 2014 16:53:51 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 16:53:51 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 16:53:51 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:53:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:53:51 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:53:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:53:51 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:53:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:53:52 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:53:52 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 16:53:52 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:53:52 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:53:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:53:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 16:53:53 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:53:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6076 values 95865 bits 11983 bytes 
Fri 17 Jan 2014 16:53:53 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:53:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 16:53:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:53:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:53:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:53:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:53:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:53:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:53:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:53:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:53:56 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:53:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43232103
Fri 17 Jan 2014 16:53:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:53:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43232103
Fri 17 Jan 2014 16:53:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:54:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:54:06 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:54:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:54:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:54:07 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:54:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:54:07 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:54:07 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:54:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:54:07 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:54:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:54:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:54:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:54:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:54:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:54:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:54:10 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:54:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 16:54:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:54:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:54:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:54:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:54:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:54:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:54:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43239418
Fri 17 Jan 2014 16:54:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:54:12 - job_xml_thread(): Done retrieving: data size 43239418
Fri 17 Jan 2014 16:54:12 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:54:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43239418
Fri 17 Jan 2014 16:54:12 - XML: Start document: iteration 19
Fri 17 Jan 2014 16:54:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:54:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:54:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:54:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:54:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:54:23 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:54:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:54:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:54:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:54:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:54:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:54:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:54:31 - XML: Processed 647614 elements - found 626 jobs
Fri 17 Jan 2014 16:54:31 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:54:31 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:54:31 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:54:31 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:54:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:54:33 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:54:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:54:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:54:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:54:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:54:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:54:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:54:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:54:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43540437
Fri 17 Jan 2014 16:54:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:54:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43540437
Fri 17 Jan 2014 16:54:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:54:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:54:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:54:39 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 16:54:39 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:54:42 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:54:42 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 16:54:42 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 16:54:42 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:54:42 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 16:54:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:54:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:54:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:54:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:54:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:54:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:54:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:54:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43540437
Fri 17 Jan 2014 16:54:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:54:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:54:46 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:54:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:54:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:54:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:54:52 - size of cluster 'LISA Cluster': 624 hosts 79474 metrics 926109 values 14618249 bits 1827281 bytes 
Fri 17 Jan 2014 16:54:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:54:53 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:54:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:54:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 16:54:54 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:54:54 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:54:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 16:54:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8941 values 141015 bits 17626 bytes 
Fri 17 Jan 2014 16:54:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:54:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:54:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:54:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:54:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:54:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:54:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:54:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:54:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:54:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:55:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:55:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:55:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:55:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:55:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:55:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:55:01 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:55:01 - job_xml_thread(): Done retrieving: data size 43819247
Fri 17 Jan 2014 16:55:01 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:55:01 - XML: Start document: iteration 20
Fri 17 Jan 2014 16:55:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43819247
Fri 17 Jan 2014 16:55:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:55:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43819247
Fri 17 Jan 2014 16:55:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:55:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:55:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:55:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:55:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:55:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:55:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:55:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:55:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:55:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:55:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:55:20 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:55:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:55:20 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:55:21 - XML: Processed 655452 elements - found 626 jobs
Fri 17 Jan 2014 16:55:21 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:55:21 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:55:21 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:55:21 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:55:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:55:26 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:55:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:55:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:55:26 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:55:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 16:55:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:55:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:55:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:55:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:55:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:55:29 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:55:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43849546
Fri 17 Jan 2014 16:55:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:55:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43849546
Fri 17 Jan 2014 16:55:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:55:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:55:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:55:36 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:55:36 - job_xml_thread(): Done retrieving: data size 43849546
Fri 17 Jan 2014 16:55:36 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:55:36 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 16:55:37 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 16:55:37 - Housekeeping: done.
Fri 17 Jan 2014 16:55:37 - XML: Start document: iteration 0
Fri 17 Jan 2014 16:55:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:55:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:55:42 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:55:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:55:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:55:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:55:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:55:43 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:55:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:55:43 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:55:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:55:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:55:43 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 16:55:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:55:52 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:55:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:55:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:55:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:55:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:55:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:55:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:55:53 - XML: Processed 655454 elements - found 627 jobs
Fri 17 Jan 2014 16:55:53 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 16:55:53 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 16:55:53 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 16:55:53 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:55:53 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:55:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:55:54 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:55:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:55:54 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:55:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 16:55:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 16:55:54 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:55:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5362 values 84496 bits 10562 bytes 
Fri 17 Jan 2014 16:55:56 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:55:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43844316
Fri 17 Jan 2014 16:55:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:55:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43844316
Fri 17 Jan 2014 16:55:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:55:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:55:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:56:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:56:06 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:56:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:56:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:56:06 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:56:06 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:56:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:56:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:56:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43844316
Fri 17 Jan 2014 16:56:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:56:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:56:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:56:08 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:56:08 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:56:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:56:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:56:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:56:20 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:56:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:56:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:56:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:56:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:56:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:56:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:56:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:56:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:56:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:56:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:56:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:56:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:56:22 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:56:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 16:56:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:56:23 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:56:23 - job_xml_thread(): Done retrieving: data size 43834941
Fri 17 Jan 2014 16:56:23 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:56:23 - XML: Start document: iteration 1
Fri 17 Jan 2014 16:56:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43834941
Fri 17 Jan 2014 16:56:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:56:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43834941
Fri 17 Jan 2014 16:56:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:56:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:56:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:56:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:56:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:56:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:56:38 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:56:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:56:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:56:39 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:56:39 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:56:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:56:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:56:39 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:56:43 - XML: Processed 655454 elements - found 627 jobs
Fri 17 Jan 2014 16:56:43 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:56:43 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:56:43 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:56:43 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:56:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:56:45 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:56:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:56:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:56:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:56:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:56:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:56:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:56:48 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:56:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43841309
Fri 17 Jan 2014 16:56:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:56:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43841309
Fri 17 Jan 2014 16:56:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:56:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:56:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:56:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:56:54 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:56:55 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:56:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:56:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 16:56:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 16:56:55 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:56:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7710 values 121531 bits 15191 bytes 
Fri 17 Jan 2014 16:56:58 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:56:58 - job_xml_thread(): Done retrieving: data size 43841309
Fri 17 Jan 2014 16:56:58 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:56:58 - XML: Start document: iteration 2
Fri 17 Jan 2014 16:56:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:56:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:56:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:56:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:57:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:57:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:57:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:57:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:57:01 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:57:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:57:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:57:09 - XML: Processed 655454 elements - found 627 jobs
Fri 17 Jan 2014 16:57:09 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:57:09 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:57:09 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:57:09 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:57:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:57:12 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:57:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:57:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:57:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:57:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:57:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:57:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:57:15 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:57:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43839985
Fri 17 Jan 2014 16:57:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:57:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:57:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43839985
Fri 17 Jan 2014 16:57:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:57:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:57:24 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:57:24 - job_xml_thread(): Done retrieving: data size 43839985
Fri 17 Jan 2014 16:57:24 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:57:24 - XML: Start document: iteration 3
Fri 17 Jan 2014 16:57:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:57:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:57:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:57:34 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:57:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:57:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:57:35 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:57:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:57:35 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:57:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:57:35 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:57:38 - XML: Processed 655450 elements - found 625 jobs
Fri 17 Jan 2014 16:57:38 - job 7348425 appears to have finished
Fri 17 Jan 2014 16:57:38 - job 7348267 appears to have finished
Fri 17 Jan 2014 16:57:38 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 16:57:38 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 16:57:39 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 16:57:39 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:57:39 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:57:39 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:57:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 16:57:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:57:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:57:40 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:57:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:57:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:57:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:57:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:57:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:57:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:57:44 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:57:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862413
Fri 17 Jan 2014 16:57:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:57:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862413
Fri 17 Jan 2014 16:57:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:57:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:57:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:57:54 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:57:54 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:57:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:57:55 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:57:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:57:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:57:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:57:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 16:57:56 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:57:56 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:57:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 16:57:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5897 values 93036 bits 11629 bytes 
Fri 17 Jan 2014 16:57:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:57:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:57:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:57:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:57:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:57:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:57:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:57:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:58:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:58:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:58:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:58:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:58:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:58:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:58:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:58:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:58:04 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:58:04 - job_xml_thread(): Done retrieving: data size 43844110
Fri 17 Jan 2014 16:58:04 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:58:04 - XML: Start document: iteration 4
Fri 17 Jan 2014 16:58:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43844110
Fri 17 Jan 2014 16:58:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:58:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43844110
Fri 17 Jan 2014 16:58:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:58:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:58:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:58:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:58:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:58:18 - XML: Processed 655452 elements - found 626 jobs
Fri 17 Jan 2014 16:58:18 - job 7348379 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 16:58:18 - job 7348378 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 16:58:18 - job 7348063 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 16:58:18 - job 7348380 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 16:58:18 - job 7348381 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 16:58:18 - job_xml_thread(): Found 6 updated jobs.
Fri 17 Jan 2014 16:58:18 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 16:58:24 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Fri 17 Jan 2014 16:58:24 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:58:24 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:58:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:58:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:58:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:58:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:58:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:58:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:58:27 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:58:27 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:58:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:58:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:58:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:58:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:58:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:58:29 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:58:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 16:58:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:58:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:58:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:58:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:58:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:58:31 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:58:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43863413
Fri 17 Jan 2014 16:58:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:58:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43863413
Fri 17 Jan 2014 16:58:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:58:39 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:58:39 - job_xml_thread(): Done retrieving: data size 43863413
Fri 17 Jan 2014 16:58:39 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:58:39 - XML: Start document: iteration 5
Fri 17 Jan 2014 16:58:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:58:41 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:58:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:58:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:58:42 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:58:42 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:58:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:58:42 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:58:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:58:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:58:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:58:53 - XML: Processed 655452 elements - found 626 jobs
Fri 17 Jan 2014 16:58:53 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 16:58:53 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 16:58:53 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:58:53 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:58:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:58:53 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:58:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:58:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:58:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:58:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:58:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:58:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:58:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:58:56 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:58:56 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 16:58:56 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 16:58:56 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:58:57 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:58:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853952
Fri 17 Jan 2014 16:58:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:58:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:58:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 16:58:57 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:58:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5779 values 91138 bits 11392 bytes 
Fri 17 Jan 2014 16:58:57 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:58:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 16:58:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853952
Fri 17 Jan 2014 16:58:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:58:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:58:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:59:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:59:07 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:59:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:59:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:59:08 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:59:08 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:59:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:59:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:59:08 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:59:08 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:59:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:59:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:59:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:59:12 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:59:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:59:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:59:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:59:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:59:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:59:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:59:14 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:59:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43783490
Fri 17 Jan 2014 16:59:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:59:15 - job_xml_thread(): Done retrieving: data size 43783490
Fri 17 Jan 2014 16:59:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43783490
Fri 17 Jan 2014 16:59:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:59:15 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 16:59:15 - XML: Start document: iteration 6
Fri 17 Jan 2014 16:59:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:59:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:59:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:59:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:59:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:59:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:59:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:59:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:59:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:59:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:59:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:59:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:59:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:59:35 - XML: Processed 654700 elements - found 624 jobs
Fri 17 Jan 2014 16:59:35 - job 7348265 appears to have finished
Fri 17 Jan 2014 16:59:35 - job 7348363 appears to have finished
Fri 17 Jan 2014 16:59:35 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 16:59:35 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 16:59:37 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 16:59:37 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 16:59:37 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 16:59:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 16:59:38 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 16:59:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 16:59:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 16:59:38 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:59:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 16:59:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:59:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:59:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 16:59:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 16:59:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 16:59:40 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 16:59:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43311742
Fri 17 Jan 2014 16:59:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:59:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43311742
Fri 17 Jan 2014 16:59:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 16:59:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:59:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:59:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 16:59:48 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 16:59:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 16:59:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:59:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:59:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 16:59:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43311742
Fri 17 Jan 2014 16:59:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 16:59:50 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:59:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 16:59:52 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 16:59:52 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 16:59:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 16:59:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 16:59:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 16:59:57 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 16:59:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:59:58 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 16:59:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 16:59:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 16:59:58 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 16:59:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5844 values 92146 bits 11518 bytes 
Fri 17 Jan 2014 17:00:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:00:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:00:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:00:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:00:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:00:00 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:00:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:00:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:00:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:00:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:00:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:00:02 - job_xml_thread(): Done retrieving: data size 43165743
Fri 17 Jan 2014 17:00:02 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:00:02 - XML: Start document: iteration 7
Fri 17 Jan 2014 17:00:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43165743
Fri 17 Jan 2014 17:00:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:00:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:00:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:00:06 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:00:06 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:00:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:00:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43165743
Fri 17 Jan 2014 17:00:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:00:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:00:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:00:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:00:20 - XML: Processed 647296 elements - found 625 jobs
Fri 17 Jan 2014 17:00:20 - job 7348323 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 17:00:20 - job 7348378 field 'start_timestamp' changed since saved from: 1389974214 to: 1389974182
Fri 17 Jan 2014 17:00:20 - job 7348063 field 'start_timestamp' changed since saved from: 1389974214 to: 1389974182
Fri 17 Jan 2014 17:00:20 - job 7348065 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 17:00:20 - job 7348064 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 17:00:20 - job_xml_thread(): Found 6 updated jobs.
Fri 17 Jan 2014 17:00:20 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 17:00:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:00:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:00:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:00:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:00:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:00:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:00:23 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:00:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:00:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:00:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:00:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:00:23 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Fri 17 Jan 2014 17:00:23 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:00:23 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:00:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:00:26 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:00:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:00:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:00:26 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:00:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 17:00:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:00:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:00:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:00:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:00:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:00:27 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:00:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43353610
Fri 17 Jan 2014 17:00:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:00:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43353610
Fri 17 Jan 2014 17:00:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:00:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:00:36 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:00:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:00:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:00:39 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:00:39 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:00:39 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:00:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:00:39 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:00:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:00:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:00:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:00:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:00:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:00:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:00:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:00:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:00:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:00:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:00:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:00:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:00:43 - job_xml_thread(): Done retrieving: data size 43644180
Fri 17 Jan 2014 17:00:43 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:00:43 - XML: Start document: iteration 8
Fri 17 Jan 2014 17:00:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43644180
Fri 17 Jan 2014 17:00:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:00:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43644180
Fri 17 Jan 2014 17:00:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:00:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:00:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:00:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:00:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:00:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:00:58 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:01:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:01:00 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:01:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:01:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 17:01:00 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:01:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:01:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:01:00 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:01:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 17:01:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8500 values 134052 bits 16756 bytes 
Fri 17 Jan 2014 17:01:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:01:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:01:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:01:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:01:01 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:01:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:01:01 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:01:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:01:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:01:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:01:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:01:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:01:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:01:02 - XML: Processed 652771 elements - found 625 jobs
Fri 17 Jan 2014 17:01:02 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:01:02 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:01:02 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:01:02 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:01:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:01:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855222
Fri 17 Jan 2014 17:01:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:01:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855222
Fri 17 Jan 2014 17:01:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:01:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:01:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:01:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:01:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:01:16 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:01:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:01:16 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:01:16 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:01:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:01:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:01:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:01:18 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:01:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:01:20 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:01:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:01:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:01:20 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:01:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 17:01:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:01:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:01:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:01:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:01:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:01:22 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:01:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853158
Fri 17 Jan 2014 17:01:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:01:23 - job_xml_thread(): Done retrieving: data size 43853158
Fri 17 Jan 2014 17:01:23 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:01:23 - XML: Start document: iteration 9
Fri 17 Jan 2014 17:01:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853158
Fri 17 Jan 2014 17:01:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:01:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:01:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:01:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:01:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:01:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:01:38 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:01:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:01:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:01:40 - XML: Processed 655440 elements - found 620 jobs
Fri 17 Jan 2014 17:01:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:01:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:01:40 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:01:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:01:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:01:40 - job 7348427 appears to have finished
Fri 17 Jan 2014 17:01:40 - job 7348428 field 'start_timestamp' changed since saved from: 1389974359 to: 1389974306
Fri 17 Jan 2014 17:01:40 - job 7348379 appears to have finished
Fri 17 Jan 2014 17:01:40 - job 7348396 appears to have finished
Fri 17 Jan 2014 17:01:40 - job 7348380 appears to have finished
Fri 17 Jan 2014 17:01:40 - job 7348381 appears to have finished
Fri 17 Jan 2014 17:01:40 - job_xml_thread(): Found 6 updated jobs.
Fri 17 Jan 2014 17:01:40 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 17:01:42 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Fri 17 Jan 2014 17:01:42 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:01:42 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:01:43 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 17:01:43 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:01:43 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:01:43 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:01:43 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 17:01:43 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 17:01:43 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 17:01:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:01:46 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:01:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:01:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:01:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:01:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:01:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:01:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:01:46 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 812693 values 12829704 bits 1603713 bytes 
Fri 17 Jan 2014 17:01:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:01:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43830117
Fri 17 Jan 2014 17:01:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:01:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43830117
Fri 17 Jan 2014 17:01:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:01:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:01:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:01:57 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:01:57 - job_xml_thread(): Done retrieving: data size 43830117
Fri 17 Jan 2014 17:01:57 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:01:57 - XML: Start document: iteration 10
Fri 17 Jan 2014 17:01:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:01:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:02:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:02:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:02:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:02:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:02:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:02:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:02:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:02:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:02:00 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:02:01 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:02:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 17:02:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:02:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 17:02:01 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:02:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9123 values 144223 bits 18027 bytes 
Fri 17 Jan 2014 17:02:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:02:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:02:09 - XML: Processed 655440 elements - found 620 jobs
Fri 17 Jan 2014 17:02:09 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:02:09 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:02:09 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:02:09 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:02:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:02:13 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:02:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:02:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:02:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:02:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:02:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:02:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:02:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:02:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:02:16 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:02:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43825156
Fri 17 Jan 2014 17:02:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:02:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43825156
Fri 17 Jan 2014 17:02:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:02:24 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:02:24 - job_xml_thread(): Done retrieving: data size 43825156
Fri 17 Jan 2014 17:02:24 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:02:24 - XML: Start document: iteration 11
Fri 17 Jan 2014 17:02:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:02:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:02:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:02:29 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:02:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:02:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:02:30 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:02:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:02:30 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:02:30 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:02:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:02:37 - XML: Processed 655440 elements - found 620 jobs
Fri 17 Jan 2014 17:02:37 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:02:37 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:02:37 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:02:37 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:02:39 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:02:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 17:02:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:02:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:02:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:02:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:02:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:02:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:02:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:02:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:02:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:02:43 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:02:43 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 17:02:44 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:02:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43842238
Fri 17 Jan 2014 17:02:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:02:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43842238
Fri 17 Jan 2014 17:02:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:02:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:02:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:02:52 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:02:52 - job_xml_thread(): Done retrieving: data size 43842238
Fri 17 Jan 2014 17:02:53 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:02:53 - XML: Start document: iteration 12
Fri 17 Jan 2014 17:02:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:02:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:02:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:02:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:02:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:02:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:03:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:03:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:03:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:03:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:03:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:03:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:03:01 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:03:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:03:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 17:03:01 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:03:01 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:03:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 17:03:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5885 values 93150 bits 11643 bytes 
Fri 17 Jan 2014 17:03:07 - XML: Processed 655440 elements - found 620 jobs
Fri 17 Jan 2014 17:03:07 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:03:07 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:03:07 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:03:07 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:03:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:03:08 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:03:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:03:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:03:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:03:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:03:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:03:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:03:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:03:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43861285
Fri 17 Jan 2014 17:03:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:03:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43861285
Fri 17 Jan 2014 17:03:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:03:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:03:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:03:22 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:03:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:03:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:03:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:03:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:03:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:03:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:03:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:03:27 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:03:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:03:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:03:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:03:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:03:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:03:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:03:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:03:28 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:03:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 17:03:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:03:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:03:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:03:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:03:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:03:31 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:03:31 - job_xml_thread(): Done retrieving: data size 43840861
Fri 17 Jan 2014 17:03:31 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:03:31 - XML: Start document: iteration 13
Fri 17 Jan 2014 17:03:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43840861
Fri 17 Jan 2014 17:03:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:03:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43840861
Fri 17 Jan 2014 17:03:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:03:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:03:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:03:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:03:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:03:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:03:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:03:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:03:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:03:45 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:03:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:03:45 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:03:45 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:03:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:03:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:03:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:03:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:03:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:03:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:03:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:03:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:03:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:03:53 - XML: Processed 655438 elements - found 619 jobs
Fri 17 Jan 2014 17:03:53 - job 7348289 appears to have finished
Fri 17 Jan 2014 17:03:53 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 17:03:53 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 17:03:53 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 17:03:53 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:03:53 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:03:56 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:03:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856077
Fri 17 Jan 2014 17:03:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:03:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43856077
Fri 17 Jan 2014 17:03:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:04:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:04:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:04:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:04:02 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:04:02 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:04:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:04:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 17:04:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 17:04:02 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:04:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8729 values 137762 bits 17220 bytes 
Fri 17 Jan 2014 17:04:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:04:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:04:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:04:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:04:06 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:04:06 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:04:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:04:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:04:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856077
Fri 17 Jan 2014 17:04:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:04:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:04:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:04:08 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:04:08 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:04:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:04:13 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:04:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:04:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:04:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:04:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:04:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:04:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:04:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:04:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:04:21 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:04:21 - job_xml_thread(): Done retrieving: data size 43826123
Fri 17 Jan 2014 17:04:21 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:04:21 - XML: Start document: iteration 14
Fri 17 Jan 2014 17:04:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:04:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:04:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43826123
Fri 17 Jan 2014 17:04:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:04:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:04:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:04:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:04:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:04:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43826123
Fri 17 Jan 2014 17:04:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:04:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:04:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:04:31 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:04:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 17:04:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:04:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:04:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:04:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:04:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:04:37 - XML: Processed 655438 elements - found 619 jobs
Fri 17 Jan 2014 17:04:37 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:04:37 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:04:37 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:04:37 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:04:37 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:04:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:04:37 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:04:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:04:37 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:04:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:04:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:04:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:04:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:04:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:04:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:04:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:04:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:04:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:04:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43861182
Fri 17 Jan 2014 17:04:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:04:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43861182
Fri 17 Jan 2014 17:04:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:04:52 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:04:52 - job_xml_thread(): Done retrieving: data size 43861182
Fri 17 Jan 2014 17:04:52 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:04:52 - XML: Start document: iteration 15
Fri 17 Jan 2014 17:04:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:04:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:04:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:04:53 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:04:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:04:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:04:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:04:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:04:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:04:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:04:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43861182
Fri 17 Jan 2014 17:04:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:04:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:04:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:05:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:05:03 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:05:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:05:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 17:05:04 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:05:04 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:05:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 17:05:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6344 values 100105 bits 12513 bytes 
Fri 17 Jan 2014 17:05:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:05:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:05:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:05:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:05:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:05:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:05:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:05:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:05:10 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:05:12 - XML: Processed 655438 elements - found 619 jobs
Fri 17 Jan 2014 17:05:12 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:05:12 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:05:12 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:05:12 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:05:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:05:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:05:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:05:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:05:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:05:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:05:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:05:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:05:17 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:05:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43775925
Fri 17 Jan 2014 17:05:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:05:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43775925
Fri 17 Jan 2014 17:05:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:05:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:05:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:05:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:05:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:05:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:05:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:05:27 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:05:27 - job_xml_thread(): Done retrieving: data size 43775925
Fri 17 Jan 2014 17:05:27 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:05:27 - XML: Start document: iteration 16
Fri 17 Jan 2014 17:05:27 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:05:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:05:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:05:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:05:27 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:05:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:05:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:05:37 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:05:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 17:05:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:05:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:05:38 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:05:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:05:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:05:38 - XML: Processed 654688 elements - found 618 jobs
Fri 17 Jan 2014 17:05:38 - job 7348269 appears to have finished
Fri 17 Jan 2014 17:05:38 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 17:05:38 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 17:05:38 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 17:05:38 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:05:38 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:05:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:05:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:05:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:05:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:05:41 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:05:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43389346
Fri 17 Jan 2014 17:05:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:05:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43389346
Fri 17 Jan 2014 17:05:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:05:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:05:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:05:53 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:05:53 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:05:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:05:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:05:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:05:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:05:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:05:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:05:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:05:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:05:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:05:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:05:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:05:57 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:05:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:05:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:05:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:05:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:05:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:05:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:06:00 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:06:00 - job_xml_thread(): Done retrieving: data size 43200724
Fri 17 Jan 2014 17:06:00 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:06:00 - XML: Start document: iteration 17
Fri 17 Jan 2014 17:06:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43200724
Fri 17 Jan 2014 17:06:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:06:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43200724
Fri 17 Jan 2014 17:06:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:06:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:06:04 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:06:05 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:06:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 17:06:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:06:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 17:06:05 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:06:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8835 values 139356 bits 17419 bytes 
Fri 17 Jan 2014 17:06:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:06:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:06:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:06:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:06:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:06:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:06:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:06:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:06:16 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:06:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:06:16 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:06:16 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:06:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:06:17 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 17:06:17 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 17:06:17 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:06:18 - XML: Processed 647238 elements - found 619 jobs
Fri 17 Jan 2014 17:06:19 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 17:06:19 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 17:06:20 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 17:06:20 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:06:20 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:06:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:06:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:06:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:06:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:06:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:06:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:06:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:06:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:06:24 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:06:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43251535
Fri 17 Jan 2014 17:06:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:06:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43251535
Fri 17 Jan 2014 17:06:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:06:25 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:06:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 17:06:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:06:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:06:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:06:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:06:34 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:06:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:06:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:06:35 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:06:35 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:06:35 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:06:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:06:35 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:06:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:06:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:06:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:06:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:06:38 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:06:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:06:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:06:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:06:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:06:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:06:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:06:40 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:06:40 - job_xml_thread(): Done retrieving: data size 43745171
Fri 17 Jan 2014 17:06:40 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:06:40 - XML: Start document: iteration 18
Fri 17 Jan 2014 17:06:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43745171
Fri 17 Jan 2014 17:06:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43745171
Fri 17 Jan 2014 17:06:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:06:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:06:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:06:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:06:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:06:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:06:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:06:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:06:53 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:06:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:06:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:06:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:06:53 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:06:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:06:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:06:58 - XML: Processed 653914 elements - found 619 jobs
Fri 17 Jan 2014 17:06:58 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:06:58 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:06:58 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:06:58 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:07:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:07:01 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:07:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:07:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:07:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:07:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:07:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:07:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:07:03 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:07:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43820158
Fri 17 Jan 2014 17:07:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:07:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43820158
Fri 17 Jan 2014 17:07:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:07:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:07:06 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:07:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:07:06 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:07:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 17:07:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 17:07:06 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:07:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148676 bits 18584 bytes 
Fri 17 Jan 2014 17:07:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:07:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:07:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:07:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:07:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:07:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:07:11 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:07:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:07:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43820158
Fri 17 Jan 2014 17:07:11 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:07:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:07:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:07:13 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:07:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:07:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:07:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:07:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:07:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:07:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:07:21 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:07:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:07:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:07:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:07:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:07:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:07:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:07:24 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:07:24 - job_xml_thread(): Done retrieving: data size 43831497
Fri 17 Jan 2014 17:07:24 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:07:24 - XML: Start document: iteration 19
Fri 17 Jan 2014 17:07:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43831497
Fri 17 Jan 2014 17:07:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:07:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:07:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:07:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:07:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:07:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43831497
Fri 17 Jan 2014 17:07:27 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:07:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:07:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:07:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:07:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:07:42 - XML: Processed 655438 elements - found 619 jobs
Fri 17 Jan 2014 17:07:42 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:07:42 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:07:42 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:07:42 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:07:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:07:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:07:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:07:48 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:07:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:07:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:07:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:07:48 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:07:48 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:07:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 17:07:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:07:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:07:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:07:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:07:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:07:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:07:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:07:49 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:07:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:07:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:07:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:07:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:07:50 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:07:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43858240
Fri 17 Jan 2014 17:07:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:07:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858240
Fri 17 Jan 2014 17:07:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:07:57 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:07:57 - job_xml_thread(): Done retrieving: data size 43858240
Fri 17 Jan 2014 17:07:58 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:07:58 - XML: Start document: iteration 20
Fri 17 Jan 2014 17:08:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:08:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:08:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:08:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:08:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:08:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:08:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:08:07 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:08:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:08:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:08:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:08:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:08:07 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:08:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:08:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 17:08:08 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:08:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 17:08:08 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:08:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6258 values 98719 bits 12339 bytes 
Fri 17 Jan 2014 17:08:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:08:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:08:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:08:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:08:11 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:08:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:08:11 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:08:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:08:13 - XML: Processed 655438 elements - found 619 jobs
Fri 17 Jan 2014 17:08:13 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:08:13 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:08:13 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:08:13 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:08:15 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:08:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43863793
Fri 17 Jan 2014 17:08:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:08:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43863793
Fri 17 Jan 2014 17:08:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:08:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:08:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:08:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:08:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:08:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:08:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:08:26 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:08:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:08:26 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:08:26 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:08:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:08:28 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:08:29 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:08:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 17:08:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:08:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:08:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:08:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:08:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:08:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:08:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:08:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:08:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:08:30 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:08:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43868271
Fri 17 Jan 2014 17:08:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:08:31 - job_xml_thread(): Done retrieving: data size 43868271
Fri 17 Jan 2014 17:08:31 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:08:31 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 17:08:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43868271
Fri 17 Jan 2014 17:08:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:08:32 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 17:08:32 - Housekeeping: done.
Fri 17 Jan 2014 17:08:32 - XML: Start document: iteration 0
Fri 17 Jan 2014 17:08:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:08:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:08:43 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 17:08:44 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:08:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:08:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:08:45 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:08:45 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:08:45 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 17:08:45 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 17:08:45 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 17:08:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:08:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:08:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:08:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:08:49 - XML: Processed 655438 elements - found 619 jobs
Fri 17 Jan 2014 17:08:49 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:08:49 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:08:49 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:08:49 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:08:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:08:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:08:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:08:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:08:49 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:08:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:08:52 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:08:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:08:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:08:52 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 809385 values 12776617 bits 1597077 bytes 
Fri 17 Jan 2014 17:08:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:08:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:08:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:08:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:08:55 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:08:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862477
Fri 17 Jan 2014 17:08:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:08:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862477
Fri 17 Jan 2014 17:08:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:09:04 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:09:04 - job_xml_thread(): Done retrieving: data size 43862477
Fri 17 Jan 2014 17:09:04 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:09:04 - XML: Start document: iteration 1
Fri 17 Jan 2014 17:09:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:09:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:09:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:09:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:09:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:09:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:09:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:09:08 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:09:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:09:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:09:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:09:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:09:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:09:09 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:09:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:09:09 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:09:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 17:09:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 17:09:09 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:09:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:09:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9056 values 142863 bits 17857 bytes 
Fri 17 Jan 2014 17:09:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:09:13 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:09:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:09:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:09:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:09:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:09:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:09:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:09:16 - XML: Processed 655438 elements - found 619 jobs
Fri 17 Jan 2014 17:09:16 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:09:16 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:09:16 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:09:16 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:09:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:09:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43831422
Fri 17 Jan 2014 17:09:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:09:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43831422
Fri 17 Jan 2014 17:09:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:09:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:09:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:09:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:09:29 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:09:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:09:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:09:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:09:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:09:29 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:09:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:09:29 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:09:30 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:09:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:09:31 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:09:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:09:33 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:09:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:09:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:09:33 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:09:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 17:09:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:09:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:09:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:09:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:09:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:09:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:09:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43850227
Fri 17 Jan 2014 17:09:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:09:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43850227
Fri 17 Jan 2014 17:09:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:09:37 - job_xml_thread(): Done retrieving: data size 43850227
Fri 17 Jan 2014 17:09:37 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:09:38 - XML: Start document: iteration 2
Fri 17 Jan 2014 17:09:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:09:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:09:45 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:09:45 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 17:09:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:09:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:09:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:09:50 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:09:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:09:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:09:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:09:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:09:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:09:52 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:09:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:09:58 - XML: Processed 655436 elements - found 618 jobs
Fri 17 Jan 2014 17:09:58 - job 7346239 appears to have finished
Fri 17 Jan 2014 17:09:58 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 17:09:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:09:58 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 17:09:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:09:58 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 17:09:58 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:09:58 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:09:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:09:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:09:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:09:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:09:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:09:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:10:01 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:10:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43842186
Fri 17 Jan 2014 17:10:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:10:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43842186
Fri 17 Jan 2014 17:10:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:10:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:10:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:10:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:10:09 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:10:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:10:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:10:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:10:11 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:10:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 17:10:11 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:10:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 17:10:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8755 values 138049 bits 17256 bytes 
Fri 17 Jan 2014 17:10:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:10:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:10:12 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:10:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:10:12 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:10:12 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:10:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:10:13 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:10:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:10:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:10:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:10:15 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:10:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:10:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:10:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:10:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:10:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:10:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:10:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:10:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43838659
Fri 17 Jan 2014 17:10:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:10:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43838659
Fri 17 Jan 2014 17:10:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:10:18 - job_xml_thread(): Done retrieving: data size 43838659
Fri 17 Jan 2014 17:10:18 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:10:18 - XML: Start document: iteration 3
Fri 17 Jan 2014 17:10:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:10:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:10:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:10:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:10:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:10:32 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:10:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:10:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:10:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:10:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:10:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:10:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:10:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:10:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:10:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:10:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:10:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:10:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:10:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:10:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:10:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:10:40 - XML: Processed 655436 elements - found 618 jobs
Fri 17 Jan 2014 17:10:40 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:10:40 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:10:40 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:10:40 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:10:40 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:10:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 17:10:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:10:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:10:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43850576
Fri 17 Jan 2014 17:10:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:10:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43850576
Fri 17 Jan 2014 17:10:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:10:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:10:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:10:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:10:53 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:10:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:10:55 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:10:55 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:10:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:10:56 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:10:56 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:10:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:10:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:10:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:10:57 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:10:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:10:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:10:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:10:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:10:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:10:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:11:00 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:11:00 - job_xml_thread(): Done retrieving: data size 43853289
Fri 17 Jan 2014 17:11:00 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:11:00 - XML: Start document: iteration 4
Fri 17 Jan 2014 17:11:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853289
Fri 17 Jan 2014 17:11:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:11:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853289
Fri 17 Jan 2014 17:11:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:11:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:11:11 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:11:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:11:11 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:11:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 17:11:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:11:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:11:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 17:11:12 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:11:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:11:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:11:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8873 values 139936 bits 17492 bytes 
Fri 17 Jan 2014 17:11:14 - XML: Processed 655436 elements - found 618 jobs
Fri 17 Jan 2014 17:11:14 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:11:14 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:11:14 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:11:14 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:11:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:11:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:11:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:11:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:11:20 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:11:20 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:11:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:11:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:11:20 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:11:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:11:24 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:11:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:11:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:11:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:11:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:11:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:11:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:11:27 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:11:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43792088
Fri 17 Jan 2014 17:11:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:11:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43792088
Fri 17 Jan 2014 17:11:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:11:29 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:11:29 - job_xml_thread(): Done retrieving: data size 43792088
Fri 17 Jan 2014 17:11:29 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:11:29 - XML: Start document: iteration 5
Fri 17 Jan 2014 17:11:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:11:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:11:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:11:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:11:44 - XML: Processed 654684 elements - found 618 jobs
Fri 17 Jan 2014 17:11:44 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:11:44 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:11:44 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:11:44 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:11:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:11:46 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:11:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:11:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:11:47 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:11:47 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:11:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:11:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:11:47 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:11:50 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:11:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 17:11:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:11:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:11:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:11:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:11:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:11:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:11:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:11:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:11:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:11:54 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:11:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43207799
Fri 17 Jan 2014 17:11:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:11:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43207799
Fri 17 Jan 2014 17:11:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:12:00 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:12:00 - job_xml_thread(): Done retrieving: data size 43207799
Fri 17 Jan 2014 17:12:00 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:12:00 - XML: Start document: iteration 6
Fri 17 Jan 2014 17:12:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:12:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:12:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:12:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:12:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:12:11 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:12:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:12:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:12:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:12:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:12:12 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:12:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:12:12 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:12:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:12:12 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:12:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:12:13 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:12:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 17:12:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 17:12:13 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:12:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6068 values 95733 bits 11966 bytes 
Fri 17 Jan 2014 17:12:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:12:15 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:12:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:12:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:12:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:12:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:12:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:12:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:12:17 - XML: Processed 647380 elements - found 618 jobs
Fri 17 Jan 2014 17:12:17 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:12:17 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:12:17 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:12:17 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:12:18 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 17:12:18 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 17:12:18 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:12:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:12:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43241982
Fri 17 Jan 2014 17:12:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:12:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43241982
Fri 17 Jan 2014 17:12:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:12:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:12:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:12:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:12:28 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:12:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:12:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:12:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:12:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:12:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43241982
Fri 17 Jan 2014 17:12:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:12:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:12:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:12:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:12:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:12:32 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:12:32 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:12:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:12:36 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:12:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:12:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:12:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:12:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:12:39 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:12:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 17:12:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:12:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:12:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:12:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:12:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:12:41 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:12:41 - job_xml_thread(): Done retrieving: data size 43694610
Fri 17 Jan 2014 17:12:41 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:12:41 - XML: Start document: iteration 7
Fri 17 Jan 2014 17:12:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43694610
Fri 17 Jan 2014 17:12:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:12:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:12:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:12:45 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:12:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:12:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43694610
Fri 17 Jan 2014 17:12:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:12:45 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:12:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:12:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:12:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:12:57 - XML: Processed 653586 elements - found 618 jobs
Fri 17 Jan 2014 17:12:57 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:12:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:12:58 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:12:58 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:12:58 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:12:58 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:13:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:13:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:13:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:13:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:13:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:13:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:13:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:13:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:13:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:13:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:13:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:13:01 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:13:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:13:01 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:13:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:13:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:13:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43846891
Fri 17 Jan 2014 17:13:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:13:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43846891
Fri 17 Jan 2014 17:13:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:13:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:13:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:13:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:13:13 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:13:13 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:13:14 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:13:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:13:14 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:13:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 17:13:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 17:13:14 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:13:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9154 values 144403 bits 18050 bytes 
Fri 17 Jan 2014 17:13:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:13:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:13:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:13:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:13:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:13:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:13:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:13:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:13:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:13:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:13:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:13:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:13:17 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:13:17 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:13:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:13:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:13:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:13:19 - job_xml_thread(): Done retrieving: data size 43840603
Fri 17 Jan 2014 17:13:19 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:13:19 - XML: Start document: iteration 8
Fri 17 Jan 2014 17:13:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43840603
Fri 17 Jan 2014 17:13:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43840603
Fri 17 Jan 2014 17:13:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:13:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:13:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:13:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:13:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:13:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:13:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:13:34 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:13:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:13:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:13:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:13:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:13:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:13:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:13:34 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:13:42 - XML: Processed 655436 elements - found 618 jobs
Fri 17 Jan 2014 17:13:42 - job 7348263 appears to have finished
Fri 17 Jan 2014 17:13:42 - job 7348217 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 17:13:42 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 17:13:42 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 17:13:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:13:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:13:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:13:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:13:42 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 17:13:42 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:13:42 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:13:42 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:13:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 17:13:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:13:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:13:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:13:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:13:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:13:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:13:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43836871
Fri 17 Jan 2014 17:13:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:13:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43836871
Fri 17 Jan 2014 17:13:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:13:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:13:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:13:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:13:56 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:13:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:13:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:13:57 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:13:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:13:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:13:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:13:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:13:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:13:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:13:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:13:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:13:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:13:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:13:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:13:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:13:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:13:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:13:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:14:00 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:14:00 - job_xml_thread(): Done retrieving: data size 43855034
Fri 17 Jan 2014 17:14:00 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:14:00 - XML: Start document: iteration 9
Fri 17 Jan 2014 17:14:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855034
Fri 17 Jan 2014 17:14:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:14:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855034
Fri 17 Jan 2014 17:14:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:14:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:14:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:14:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:14:14 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:14:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:14:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:14:15 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:14:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:14:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 17:14:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 17:14:15 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:14:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8860 values 139703 bits 17462 bytes 
Fri 17 Jan 2014 17:14:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:14:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:14:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:14:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:14:17 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:14:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:14:17 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:14:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:14:17 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:14:22 - XML: Processed 655433 elements - found 618 jobs
Fri 17 Jan 2014 17:14:22 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:14:22 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:14:22 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:14:22 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:14:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:14:24 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:14:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:14:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:14:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:14:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:14:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:14:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:14:26 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:14:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855192
Fri 17 Jan 2014 17:14:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:14:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855192
Fri 17 Jan 2014 17:14:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:14:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:14:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:14:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:14:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:14:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:14:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:14:37 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:14:37 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:14:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:14:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:14:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:14:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:14:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:14:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:14:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:14:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:14:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:14:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:14:42 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:14:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 17:14:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:14:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:14:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:14:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:14:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:14:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:14:43 - job_xml_thread(): Done retrieving: data size 43856961
Fri 17 Jan 2014 17:14:43 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:14:43 - XML: Start document: iteration 10
Fri 17 Jan 2014 17:14:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43856961
Fri 17 Jan 2014 17:14:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:14:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856961
Fri 17 Jan 2014 17:14:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:14:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:14:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:14:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:14:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:15:01 - XML: Processed 655436 elements - found 618 jobs
Fri 17 Jan 2014 17:15:01 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:15:01 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:15:01 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:15:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:15:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:15:02 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:15:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:15:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:15:04 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:15:04 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:15:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:15:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:15:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:15:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:15:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:15:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:15:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:15:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:15:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:15:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:15:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:15:07 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:15:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43868338
Fri 17 Jan 2014 17:15:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:15:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43868338
Fri 17 Jan 2014 17:15:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:15:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:15:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:15:16 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:15:16 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:15:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:15:17 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:15:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 17:15:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 17:15:17 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:15:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8698 values 137137 bits 17142 bytes 
Fri 17 Jan 2014 17:15:17 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:15:17 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:15:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:15:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:15:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:15:20 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:15:20 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:15:20 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:15:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:15:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:15:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:15:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:15:22 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:15:22 - job_xml_thread(): Done retrieving: data size 43868632
Fri 17 Jan 2014 17:15:22 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:15:22 - XML: Start document: iteration 11
Fri 17 Jan 2014 17:15:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43868632
Fri 17 Jan 2014 17:15:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:15:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:15:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:15:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:15:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:15:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43868632
Fri 17 Jan 2014 17:15:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:15:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:15:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:15:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:15:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:15:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:15:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:15:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:15:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:15:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:15:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:15:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:15:42 - XML: Processed 655434 elements - found 617 jobs
Fri 17 Jan 2014 17:15:42 - job 7348249 appears to have finished
Fri 17 Jan 2014 17:15:42 - job 7348433 field 'start_timestamp' changed since saved from: 1389975179 to: 1389975133
Fri 17 Jan 2014 17:15:42 - job 7348264 appears to have finished
Fri 17 Jan 2014 17:15:42 - job 7348283 appears to have finished
Fri 17 Jan 2014 17:15:42 - job_xml_thread(): Found 6 updated jobs.
Fri 17 Jan 2014 17:15:42 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 17:15:43 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Fri 17 Jan 2014 17:15:43 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:15:43 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:15:45 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 17:15:45 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:15:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:15:46 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:15:46 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:15:46 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 17:15:46 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:15:46 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 17:15:46 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 17:15:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:15:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:15:47 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 891059 values 14057423 bits 1757177 bytes 
Fri 17 Jan 2014 17:15:47 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:15:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 17:15:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:15:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:15:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:15:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:15:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:15:50 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:15:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43825187
Fri 17 Jan 2014 17:15:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:15:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43825187
Fri 17 Jan 2014 17:15:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:15:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:15:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:15:58 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:15:58 - job_xml_thread(): Done retrieving: data size 43825187
Fri 17 Jan 2014 17:15:58 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:15:58 - XML: Start document: iteration 12
Fri 17 Jan 2014 17:16:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:16:01 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:16:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:16:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:16:01 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:16:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:16:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:16:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:16:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:16:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:16:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:16:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:16:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:16:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:16:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:16:11 - XML: Processed 655434 elements - found 617 jobs
Fri 17 Jan 2014 17:16:11 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:16:11 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:16:11 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:16:11 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:16:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:16:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:16:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:16:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:16:14 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:16:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43828400
Fri 17 Jan 2014 17:16:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:16:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43828400
Fri 17 Jan 2014 17:16:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:16:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:16:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:16:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:16:17 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:16:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:16:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 17:16:18 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:16:18 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:16:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 17:16:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8755 values 138159 bits 17269 bytes 
Fri 17 Jan 2014 17:16:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:16:25 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:16:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:16:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:16:26 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:16:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:16:26 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:16:26 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:16:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:16:26 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:16:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:16:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:16:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:16:30 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:16:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:16:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:16:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:16:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:16:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:16:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:16:33 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:16:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 17:16:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:16:34 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:16:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856160
Fri 17 Jan 2014 17:16:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:16:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43856160
Fri 17 Jan 2014 17:16:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:16:35 - job_xml_thread(): Done retrieving: data size 43856160
Fri 17 Jan 2014 17:16:36 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:16:36 - XML: Start document: iteration 13
Fri 17 Jan 2014 17:16:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:16:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:16:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:16:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:16:46 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:16:46 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 17:16:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:16:50 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:16:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:16:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:16:50 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:16:50 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:16:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:16:50 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:16:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:16:57 - XML: Processed 655434 elements - found 617 jobs
Fri 17 Jan 2014 17:16:57 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:16:57 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:16:57 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:16:57 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:16:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:16:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:16:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:16:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:16:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:16:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:16:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:16:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:17:01 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:17:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43840626
Fri 17 Jan 2014 17:17:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:17:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43840626
Fri 17 Jan 2014 17:17:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:17:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:17:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:17:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:17:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:17:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:17:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:17:12 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:17:12 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:17:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:17:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:17:12 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:17:12 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:17:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:17:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:17:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:17:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:17:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:17:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:17:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:17:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:17:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:17:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:17:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:17:18 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:17:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:17:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 17:17:19 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:17:19 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:17:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99381 bits 12422 bytes 
Fri 17 Jan 2014 17:17:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 17:17:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:17:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43781285
Fri 17 Jan 2014 17:17:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:17:20 - job_xml_thread(): Done retrieving: data size 43781285
Fri 17 Jan 2014 17:17:20 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:17:20 - XML: Start document: iteration 14
Fri 17 Jan 2014 17:17:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43781285
Fri 17 Jan 2014 17:17:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:17:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:17:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:17:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:17:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:17:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:17:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:17:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:17:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:17:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:17:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:17:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:17:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:17:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:17:39 - XML: Processed 654686 elements - found 617 jobs
Fri 17 Jan 2014 17:17:39 - job 7348428 appears to have finished
Fri 17 Jan 2014 17:17:39 - job 7348268 appears to have finished
Fri 17 Jan 2014 17:17:39 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 17:17:39 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 17:17:39 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 17:17:39 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:17:39 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:17:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:17:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:17:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:17:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:17:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:17:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:17:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:17:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:17:44 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:17:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 17:17:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:17:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:17:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43275142
Fri 17 Jan 2014 17:17:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:17:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43275142
Fri 17 Jan 2014 17:17:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:17:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:17:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:17:54 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:17:54 - job_xml_thread(): Done retrieving: data size 43275142
Fri 17 Jan 2014 17:17:54 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:17:54 - XML: Start document: iteration 15
Fri 17 Jan 2014 17:17:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:17:56 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:17:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:17:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:17:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:17:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:17:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:17:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:17:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:17:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:17:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:18:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:18:08 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:18:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:18:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:18:08 - XML: Processed 648438 elements - found 617 jobs
Fri 17 Jan 2014 17:18:08 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:18:08 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:18:08 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:18:08 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:18:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:18:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:18:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:18:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:18:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:18:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43183855
Fri 17 Jan 2014 17:18:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:18:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:18:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:18:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43183855
Fri 17 Jan 2014 17:18:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:18:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:18:19 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:18:20 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:18:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 17:18:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:18:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 17:18:20 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:18:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6576 values 104031 bits 13003 bytes 
Fri 17 Jan 2014 17:18:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:18:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:18:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:18:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:18:23 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:18:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:18:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:18:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:18:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:18:24 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:18:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:18:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:18:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:18:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:18:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:18:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:18:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:18:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:18:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:18:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:18:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:18:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565387
Fri 17 Jan 2014 17:18:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:18:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565387
Fri 17 Jan 2014 17:18:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:18:33 - job_xml_thread(): Done retrieving: data size 43565387
Fri 17 Jan 2014 17:18:33 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:18:33 - XML: Start document: iteration 16
Fri 17 Jan 2014 17:18:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:18:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:18:42 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:18:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 17:18:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:18:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:18:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:18:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:18:46 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:18:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:18:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:18:47 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:18:47 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:18:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:18:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:18:48 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:18:52 - XML: Processed 652012 elements - found 617 jobs
Fri 17 Jan 2014 17:18:52 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:18:52 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:18:52 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:18:52 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:18:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:18:55 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:18:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:18:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:18:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:18:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:18:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:18:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:18:57 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 17:18:57 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 17:18:57 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:18:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:18:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43826567
Fri 17 Jan 2014 17:18:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:18:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43826567
Fri 17 Jan 2014 17:18:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:19:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:19:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:19:07 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:19:07 - job_xml_thread(): Done retrieving: data size 43826567
Fri 17 Jan 2014 17:19:07 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:19:07 - XML: Start document: iteration 17
Fri 17 Jan 2014 17:19:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:19:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:19:15 - XML: Processed 655374 elements - found 617 jobs
Fri 17 Jan 2014 17:19:15 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:19:15 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:19:15 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:19:15 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:19:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:19:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:19:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:19:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:19:16 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:19:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:19:16 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:19:16 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:19:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:19:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:19:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:19:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:19:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:19:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:19:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:19:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:19:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:19:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:19:20 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:19:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:19:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 17:19:20 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:19:20 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:19:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 17:19:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6105 values 96375 bits 12046 bytes 
Fri 17 Jan 2014 17:19:21 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:19:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43861453
Fri 17 Jan 2014 17:19:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:19:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43861453
Fri 17 Jan 2014 17:19:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:19:30 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:19:30 - job_xml_thread(): Done retrieving: data size 43861453
Fri 17 Jan 2014 17:19:30 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:19:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:19:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:19:30 - XML: Start document: iteration 18
Fri 17 Jan 2014 17:19:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:19:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:19:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:19:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:19:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:19:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:19:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:19:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:19:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:19:39 - XML: Processed 655436 elements - found 618 jobs
Fri 17 Jan 2014 17:19:39 - job 7348431 appears to have finished
Fri 17 Jan 2014 17:19:39 - job 7348437 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 17:19:39 - job 7348400 appears to have finished
Fri 17 Jan 2014 17:19:39 - job 7348281 appears to have finished
Fri 17 Jan 2014 17:19:39 - job 7348282 appears to have finished
Fri 17 Jan 2014 17:19:39 - job_xml_thread(): Found 10 updated jobs.
Fri 17 Jan 2014 17:19:39 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 17:19:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:19:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:19:41 - job_xml_thread(): Done storing. succesfully stored: 10 jobs
Fri 17 Jan 2014 17:19:41 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:19:41 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:19:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:19:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:19:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:19:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:19:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:19:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:19:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:19:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43822638
Fri 17 Jan 2014 17:19:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:19:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43822638
Fri 17 Jan 2014 17:19:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:19:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:19:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:19:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:19:54 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:19:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:19:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:19:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:19:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:19:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:19:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:19:55 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:19:56 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:19:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:19:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:19:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:19:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:19:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:19:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:19:58 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:19:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 17:19:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:19:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:19:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:19:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:19:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:20:00 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:20:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43842960
Fri 17 Jan 2014 17:20:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:20:00 - job_xml_thread(): Done retrieving: data size 43842960
Fri 17 Jan 2014 17:20:00 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:20:00 - XML: Start document: iteration 19
Fri 17 Jan 2014 17:20:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43842960
Fri 17 Jan 2014 17:20:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:20:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:20:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:20:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:20:13 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:20:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:20:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:20:14 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:20:14 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:20:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:20:14 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:20:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:20:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:20:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:20:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:20:20 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:20:21 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:20:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 17:20:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:20:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 17:20:21 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:20:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5907 values 93140 bits 11642 bytes 
Fri 17 Jan 2014 17:20:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:20:23 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:20:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:20:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:20:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:20:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:20:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:20:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:20:23 - XML: Processed 655436 elements - found 618 jobs
Fri 17 Jan 2014 17:20:23 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:20:23 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:20:23 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:20:23 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:20:26 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:20:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43844961
Fri 17 Jan 2014 17:20:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:20:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43844961
Fri 17 Jan 2014 17:20:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:20:28 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:20:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 17:20:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:20:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:20:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:20:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:20:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:20:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:20:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:20:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:20:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:20:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:20:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:20:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43844961
Fri 17 Jan 2014 17:20:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:20:38 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:20:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:20:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:20:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:20:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:20:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:20:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:20:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:20:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:20:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:20:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:20:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:20:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:20:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:20:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:20:49 - job_xml_thread(): Done retrieving: data size 43835437
Fri 17 Jan 2014 17:20:49 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:20:49 - XML: Start document: iteration 20
Fri 17 Jan 2014 17:20:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43835437
Fri 17 Jan 2014 17:20:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:20:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:20:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:20:50 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:20:50 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:20:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:20:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:20:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43835437
Fri 17 Jan 2014 17:20:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:21:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:21:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:21:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:21:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:21:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:21:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:21:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:21:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:21:06 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:21:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:21:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:21:06 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:21:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:21:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:21:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:21:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:21:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:21:12 - XML: Processed 655436 elements - found 618 jobs
Fri 17 Jan 2014 17:21:12 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:21:12 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:21:12 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:21:12 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:21:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:21:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:21:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:21:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:21:14 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:21:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43842244
Fri 17 Jan 2014 17:21:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:21:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43842244
Fri 17 Jan 2014 17:21:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:21:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:21:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:21:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:21:22 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:21:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:21:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 17:21:23 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:21:23 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:21:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 17:21:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148622 bits 18577 bytes 
Fri 17 Jan 2014 17:21:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:21:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:21:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:21:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:21:27 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:21:27 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:21:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:21:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:21:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:21:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:21:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:21:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:21:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:21:30 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:21:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:21:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:21:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:21:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:21:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:21:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:21:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:21:32 - job_xml_thread(): Done retrieving: data size 43855577
Fri 17 Jan 2014 17:21:32 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:21:32 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 17:21:32 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 17:21:32 - Housekeeping: done.
Fri 17 Jan 2014 17:21:32 - XML: Start document: iteration 0
Fri 17 Jan 2014 17:21:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855577
Fri 17 Jan 2014 17:21:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:21:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855577
Fri 17 Jan 2014 17:21:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:21:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:21:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:21:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:21:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:21:51 - XML: Processed 655438 elements - found 619 jobs
Fri 17 Jan 2014 17:21:51 - job 7348441 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 17:21:51 - job 7348442 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 17:21:51 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 17:21:51 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 17:21:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:21:54 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:21:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:21:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:21:54 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 17:21:54 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:21:54 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:21:54 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:21:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:21:54 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:21:54 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:21:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:21:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:21:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:21:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:21:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:21:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:21:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:21:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:21:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:21:57 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:21:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 17:21:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:21:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:21:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43860983
Fri 17 Jan 2014 17:21:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:21:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43860983
Fri 17 Jan 2014 17:21:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:22:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:22:07 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:22:09 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:22:09 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:22:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:22:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:22:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:22:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:22:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:22:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:22:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:22:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:22:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:22:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:22:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:22:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:22:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:22:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:22:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:22:13 - job_xml_thread(): Done retrieving: data size 43870305
Fri 17 Jan 2014 17:22:13 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:22:13 - XML: Start document: iteration 1
Fri 17 Jan 2014 17:22:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870305
Fri 17 Jan 2014 17:22:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:22:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870305
Fri 17 Jan 2014 17:22:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:22:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:22:23 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:22:25 - XML: Processed 655435 elements - found 619 jobs
Fri 17 Jan 2014 17:22:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:22:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:22:26 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:22:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:22:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 17:22:26 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:22:26 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:22:26 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:22:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 17:22:26 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:22:26 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:22:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8990 values 141814 bits 17726 bytes 
Fri 17 Jan 2014 17:22:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:22:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:22:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:22:31 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:22:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:22:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:22:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:22:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:22:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:22:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:22:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:22:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:22:34 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:22:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:22:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:22:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:22:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:22:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:22:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:22:37 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:22:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43877745
Fri 17 Jan 2014 17:22:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:22:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43877745
Fri 17 Jan 2014 17:22:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:22:41 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:22:41 - job_xml_thread(): Done retrieving: data size 43877745
Fri 17 Jan 2014 17:22:41 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:22:41 - XML: Start document: iteration 2
Fri 17 Jan 2014 17:22:47 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 17:22:47 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:22:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:22:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:22:48 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:22:48 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 17:22:48 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 17:22:48 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:22:48 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 17:22:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:22:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:22:55 - XML: Processed 655438 elements - found 619 jobs
Fri 17 Jan 2014 17:22:55 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:22:55 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:22:55 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:22:55 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:22:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:22:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:22:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:22:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:22:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:22:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:22:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:22:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:22:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:22:59 - size of cluster 'LISA Cluster': 624 hosts 79474 metrics 845048 values 13346131 bits 1668266 bytes 
Fri 17 Jan 2014 17:23:00 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:23:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 17:23:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:23:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:23:01 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:23:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:23:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:23:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:23:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:23:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:23:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:23:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:23:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853770
Fri 17 Jan 2014 17:23:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:23:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853770
Fri 17 Jan 2014 17:23:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:23:11 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:23:11 - job_xml_thread(): Done retrieving: data size 43853770
Fri 17 Jan 2014 17:23:11 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:23:11 - XML: Start document: iteration 3
Fri 17 Jan 2014 17:23:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:23:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:23:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:23:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:23:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:23:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:23:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:23:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:23:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:23:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:23:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:23:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:23:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:23:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:23:26 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:23:26 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:23:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 17:23:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:23:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 17:23:26 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:23:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6140 values 96868 bits 12108 bytes 
Fri 17 Jan 2014 17:23:27 - XML: Processed 655438 elements - found 619 jobs
Fri 17 Jan 2014 17:23:27 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:23:27 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:23:27 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:23:27 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:23:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:23:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:23:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:23:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:23:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:23:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:23:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:23:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:23:33 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:23:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43755567
Fri 17 Jan 2014 17:23:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:23:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43755567
Fri 17 Jan 2014 17:23:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:23:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:23:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:23:42 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:23:42 - job_xml_thread(): Done retrieving: data size 43755567
Fri 17 Jan 2014 17:23:42 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:23:42 - XML: Start document: iteration 4
Fri 17 Jan 2014 17:23:43 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:23:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 17:23:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:23:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:23:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:23:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:23:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:23:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:23:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:23:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:23:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:23:44 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:23:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:23:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:23:49 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:23:49 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 17:23:54 - XML: Processed 654692 elements - found 620 jobs
Fri 17 Jan 2014 17:23:54 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 17:23:54 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 17:23:55 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 17:23:55 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:23:55 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:23:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:23:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:23:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:23:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:23:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:23:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:23:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:23:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:24:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:24:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:24:00 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:24:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43196514
Fri 17 Jan 2014 17:24:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:24:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43196514
Fri 17 Jan 2014 17:24:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:24:10 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:24:10 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:24:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:24:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:24:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:24:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:24:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:24:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:24:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:24:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:24:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:24:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:24:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:24:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:24:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:24:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:24:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:24:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:24:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:24:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:24:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:24:19 - job_xml_thread(): Done retrieving: data size 43232664
Fri 17 Jan 2014 17:24:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43232664
Fri 17 Jan 2014 17:24:19 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:24:19 - XML: Start document: iteration 5
Fri 17 Jan 2014 17:24:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:24:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43232664
Fri 17 Jan 2014 17:24:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:24:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:24:27 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:24:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:24:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 17:24:27 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:24:27 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:24:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 17:24:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:24:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:24:28 - XML: Processed 647914 elements - found 620 jobs
Fri 17 Jan 2014 17:24:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9167 values 144567 bits 18070 bytes 
Fri 17 Jan 2014 17:24:28 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:24:28 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:24:28 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:24:28 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:24:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:24:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:24:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:24:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:24:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:24:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:24:35 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:24:35 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:24:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:24:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:24:35 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:24:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:24:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:24:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:24:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:24:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:24:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:24:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:24:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:24:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:24:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43674483
Fri 17 Jan 2014 17:24:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:24:44 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:24:44 - job_xml_thread(): Done retrieving: data size 43674483
Fri 17 Jan 2014 17:24:44 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:24:44 - XML: Start document: iteration 6
Fri 17 Jan 2014 17:24:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43674483
Fri 17 Jan 2014 17:24:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:24:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:24:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:24:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:24:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:25:02 - XML: Processed 653158 elements - found 620 jobs
Fri 17 Jan 2014 17:25:02 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:25:02 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:25:02 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:25:02 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:25:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:25:03 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:25:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:25:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:25:04 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:25:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:25:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:25:04 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:25:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:25:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:25:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:25:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:25:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:25:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:25:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:25:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:25:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:25:06 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:25:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 17:25:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:25:09 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:25:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856610
Fri 17 Jan 2014 17:25:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:25:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43856610
Fri 17 Jan 2014 17:25:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:25:17 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:25:17 - job_xml_thread(): Done retrieving: data size 43856610
Fri 17 Jan 2014 17:25:17 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:25:17 - XML: Start document: iteration 7
Fri 17 Jan 2014 17:25:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:25:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:25:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:25:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:25:20 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:25:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:25:20 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:25:20 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:25:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:25:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:25:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:25:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:25:27 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:25:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:25:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 17:25:28 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:25:28 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:25:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 17:25:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5773 values 91051 bits 11381 bytes 
Fri 17 Jan 2014 17:25:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:25:31 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:25:31 - XML: Processed 655446 elements - found 620 jobs
Fri 17 Jan 2014 17:25:31 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:25:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:25:31 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:25:31 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:25:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:25:31 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:25:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:25:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:25:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:25:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:25:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:25:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43816803
Fri 17 Jan 2014 17:25:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:25:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:25:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:25:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43816803
Fri 17 Jan 2014 17:25:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:25:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:25:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:25:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:25:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:25:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:25:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:25:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:25:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:25:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43816803
Fri 17 Jan 2014 17:25:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:25:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:25:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:25:46 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:25:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:25:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:25:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:25:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:25:57 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:25:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:25:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:25:57 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:25:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 17:25:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:25:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:25:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:25:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:25:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:25:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:25:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:26:00 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:26:00 - job_xml_thread(): Done retrieving: data size 43826276
Fri 17 Jan 2014 17:26:00 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:26:00 - XML: Start document: iteration 8
Fri 17 Jan 2014 17:26:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:26:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:26:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:26:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:26:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43826276
Fri 17 Jan 2014 17:26:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:26:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43826276
Fri 17 Jan 2014 17:26:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:26:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:26:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:26:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:26:14 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:26:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:26:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:26:16 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:26:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:26:16 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:26:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:26:16 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:26:23 - XML: Processed 655446 elements - found 620 jobs
Fri 17 Jan 2014 17:26:23 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:26:23 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:26:23 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:26:23 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:26:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:26:24 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:26:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:26:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:26:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:26:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:26:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:26:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:26:26 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 17:26:26 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 17:26:26 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:26:27 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:26:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43848303
Fri 17 Jan 2014 17:26:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:26:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43848303
Fri 17 Jan 2014 17:26:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:26:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:26:29 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:26:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:26:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 17:26:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:26:31 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:26:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:26:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8678 values 136832 bits 17104 bytes 
Fri 17 Jan 2014 17:26:31 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:26:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 17:26:39 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:26:39 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:26:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:26:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:26:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:26:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:26:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:26:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:26:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:26:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:26:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:26:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:26:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:26:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:26:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:26:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:26:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:26:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:26:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:26:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:26:44 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:26:44 - job_xml_thread(): Done retrieving: data size 43858753
Fri 17 Jan 2014 17:26:44 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:26:44 - XML: Start document: iteration 9
Fri 17 Jan 2014 17:26:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43858753
Fri 17 Jan 2014 17:26:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858753
Fri 17 Jan 2014 17:26:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:26:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:26:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:26:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:26:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:26:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:27:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:27:01 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:27:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:27:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:27:01 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:27:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:27:01 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:27:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:27:01 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:27:05 - XML: Processed 655446 elements - found 620 jobs
Fri 17 Jan 2014 17:27:05 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:27:05 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:27:05 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:27:05 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:27:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:27:08 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:27:08 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:27:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 17:27:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:27:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:27:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:27:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:27:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:27:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:27:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:27:09 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:27:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867400
Fri 17 Jan 2014 17:27:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:27:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43867400
Fri 17 Jan 2014 17:27:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:27:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:27:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:27:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:27:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:27:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:27:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:27:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:27:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:27:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:27:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:27:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867400
Fri 17 Jan 2014 17:27:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:27:20 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:27:20 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:27:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:27:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:27:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:27:29 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:27:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:27:30 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:27:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:27:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:27:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:27:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:27:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:27:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:27:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:27:31 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:27:31 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:27:31 - job_xml_thread(): Done retrieving: data size 43828870
Fri 17 Jan 2014 17:27:31 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:27:31 - XML: Start document: iteration 10
Fri 17 Jan 2014 17:27:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43828870
Fri 17 Jan 2014 17:27:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:27:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:27:32 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:27:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 17:27:32 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:27:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 17:27:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5826 values 91931 bits 11491 bytes 
Fri 17 Jan 2014 17:27:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:27:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:27:35 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:27:35 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:27:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:27:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:27:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43828870
Fri 17 Jan 2014 17:27:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:27:43 - XML: Processed 655440 elements - found 617 jobs
Fri 17 Jan 2014 17:27:43 - job 7348433 appears to have finished
Fri 17 Jan 2014 17:27:44 - job 7348434 appears to have finished
Fri 17 Jan 2014 17:27:44 - job 7348385 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 17:27:44 - job 7348174 appears to have finished
Fri 17 Jan 2014 17:27:44 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 17:27:44 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 17:27:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:27:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:27:47 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 17:27:47 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:27:48 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:27:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:27:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:27:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:27:53 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:27:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:27:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:27:53 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:27:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:27:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:27:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:27:53 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:27:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:27:55 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:27:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:27:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:27:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:27:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:27:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:27:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:27:56 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:27:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 17:27:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:27:57 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:27:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862959
Fri 17 Jan 2014 17:27:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:27:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862959
Fri 17 Jan 2014 17:27:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:28:03 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:28:03 - job_xml_thread(): Done retrieving: data size 43862959
Fri 17 Jan 2014 17:28:03 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:28:03 - XML: Start document: iteration 11
Fri 17 Jan 2014 17:28:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:28:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:28:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:28:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:28:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:28:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:28:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:28:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:28:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:28:10 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:28:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:28:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:28:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:28:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:28:19 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:28:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:28:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:28:19 - XML: Processed 655440 elements - found 617 jobs
Fri 17 Jan 2014 17:28:19 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:28:19 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:28:19 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:28:19 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:28:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:28:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:28:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:28:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:28:21 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:28:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43839821
Fri 17 Jan 2014 17:28:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:28:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43839821
Fri 17 Jan 2014 17:28:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:28:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:28:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:28:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:28:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:28:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:28:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:28:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:28:32 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:28:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:28:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:28:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:28:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:28:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:28:34 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:28:34 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:28:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 17:28:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 17:28:34 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:28:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6316 values 99657 bits 12457 bytes 
Fri 17 Jan 2014 17:28:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:28:34 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:28:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:28:34 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:28:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:28:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:28:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:28:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:28:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:28:37 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:28:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 17:28:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:28:37 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:28:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43878012
Fri 17 Jan 2014 17:28:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:28:37 - job_xml_thread(): Done retrieving: data size 43878012
Fri 17 Jan 2014 17:28:37 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:28:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43878012
Fri 17 Jan 2014 17:28:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:28:38 - XML: Start document: iteration 12
Fri 17 Jan 2014 17:28:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:28:48 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:28:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:28:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:28:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:28:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:28:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:28:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:28:49 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:28:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:28:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:28:56 - XML: Processed 655440 elements - found 617 jobs
Fri 17 Jan 2014 17:28:56 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:28:56 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:28:56 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:28:56 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:28:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:28:59 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:28:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:28:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:28:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:28:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:28:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:28:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:29:01 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:29:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43821832
Fri 17 Jan 2014 17:29:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:29:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43821832
Fri 17 Jan 2014 17:29:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:29:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:29:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:29:11 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:29:11 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:29:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:29:13 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:29:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:29:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:29:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:29:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:29:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:29:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:29:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:29:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:29:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:29:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:29:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:29:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:29:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:29:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:29:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:29:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:29:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:29:18 - job_xml_thread(): Done retrieving: data size 43772928
Fri 17 Jan 2014 17:29:18 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:29:18 - XML: Start document: iteration 13
Fri 17 Jan 2014 17:29:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43772928
Fri 17 Jan 2014 17:29:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:29:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43772928
Fri 17 Jan 2014 17:29:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:29:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:29:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:29:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:29:31 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:29:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:29:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:29:32 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:29:32 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:29:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:29:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:29:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:29:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:29:32 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:29:33 - XML: Processed 654690 elements - found 616 jobs
Fri 17 Jan 2014 17:29:33 - job 7348385 field 'start_timestamp' changed since saved from: 1389976028 to: 1389975965
Fri 17 Jan 2014 17:29:33 - job 7348341 appears to have finished
Fri 17 Jan 2014 17:29:33 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 17:29:33 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 17:29:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:29:34 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:29:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:29:35 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 17:29:35 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:29:35 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:29:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 17:29:35 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:29:35 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:29:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 17:29:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9268 values 146180 bits 18272 bytes 
Fri 17 Jan 2014 17:29:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:29:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:29:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:29:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:29:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:29:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:29:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:29:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:29:41 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:29:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43314018
Fri 17 Jan 2014 17:29:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:29:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43314018
Fri 17 Jan 2014 17:29:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:29:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:29:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:29:49 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 17:29:49 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:29:50 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:29:51 - job_xml_thread(): Done retrieving: data size 43314018
Fri 17 Jan 2014 17:29:51 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:29:51 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 17:29:51 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 17:29:51 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:29:51 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:29:51 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 17:29:51 - XML: Start document: iteration 14
Fri 17 Jan 2014 17:29:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:29:53 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:29:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:29:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:29:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:29:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Fri 17 Jan 2014 17:29:56 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:29:56 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:29:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:29:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:29:56 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:29:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:29:59 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:29:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:29:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:29:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:29:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:29:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:29:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:30:02 - XML: Processed 648758 elements - found 616 jobs
Fri 17 Jan 2014 17:30:02 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:30:02 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:30:02 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:30:02 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:30:03 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:30:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 17:30:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:30:04 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:30:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43178028
Fri 17 Jan 2014 17:30:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:30:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43178028
Fri 17 Jan 2014 17:30:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:30:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:30:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:30:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:30:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:30:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:30:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:30:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:30:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:30:17 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:30:17 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:30:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:30:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:30:17 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:30:17 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:30:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:30:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:30:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:30:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:30:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:30:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:30:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:30:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:30:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:30:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43271176
Fri 17 Jan 2014 17:30:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:30:20 - job_xml_thread(): Done retrieving: data size 43271176
Fri 17 Jan 2014 17:30:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43271176
Fri 17 Jan 2014 17:30:20 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:30:20 - XML: Start document: iteration 15
Fri 17 Jan 2014 17:30:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:30:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:30:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:30:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:30:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:30:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:30:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:30:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:30:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:30:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:30:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:30:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:30:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:30:34 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:30:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:30:36 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:30:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:30:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 17:30:36 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:30:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8813 values 139018 bits 17377 bytes 
Fri 17 Jan 2014 17:30:36 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:30:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 17:30:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:30:40 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:30:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:30:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:30:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:30:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:30:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:30:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:30:41 - XML: Processed 647986 elements - found 616 jobs
Fri 17 Jan 2014 17:30:41 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:30:41 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:30:41 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:30:41 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:30:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:30:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43726931
Fri 17 Jan 2014 17:30:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:30:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43726931
Fri 17 Jan 2014 17:30:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:30:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:30:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:30:51 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:30:51 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:30:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:30:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:30:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:30:51 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:30:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:30:51 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 17:30:51 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:30:51 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 17:30:51 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 17:30:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:30:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:30:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43726931
Fri 17 Jan 2014 17:30:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:30:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:30:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:30:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:30:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:30:56 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:30:56 - XMLGatherer.retrieveData(): actually retrieving data..
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Fri 17 Jan 2014 17:31:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:31:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:31:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:31:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:31:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:31:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:31:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:31:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:31:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:31:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:31:07 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:31:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 17:31:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:31:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:31:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:31:07 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:31:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:31:07 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:31:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:31:08 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:31:08 - job_xml_thread(): Done retrieving: data size 43837401
Fri 17 Jan 2014 17:31:08 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:31:08 - XML: Start document: iteration 16
Fri 17 Jan 2014 17:31:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43837401
Fri 17 Jan 2014 17:31:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:31:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43837401
Fri 17 Jan 2014 17:31:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:31:22 - XML: Processed 655438 elements - found 616 jobs
Fri 17 Jan 2014 17:31:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:31:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:31:22 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:31:22 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:31:22 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:31:22 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:31:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:31:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:31:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:31:27 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:31:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:31:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:31:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:31:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:31:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:31:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:31:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:31:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:31:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:31:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:31:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:31:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:31:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:31:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:31:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:31:30 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:31:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855344
Fri 17 Jan 2014 17:31:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:31:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855344
Fri 17 Jan 2014 17:31:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:31:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:31:37 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:31:37 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:31:37 - job_xml_thread(): Done retrieving: data size 43855344
Fri 17 Jan 2014 17:31:37 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:31:37 - XML: Start document: iteration 17
Fri 17 Jan 2014 17:31:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:31:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 17:31:38 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:31:38 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:31:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 17:31:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9104 values 143819 bits 17977 bytes 
Fri 17 Jan 2014 17:31:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:31:42 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:31:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:31:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:31:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:31:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:31:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:31:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:31:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:31:45 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:31:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:31:52 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:31:52 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:31:52 - XML: Processed 655434 elements - found 614 jobs
Fri 17 Jan 2014 17:31:52 - job 7348306 appears to have finished
Fri 17 Jan 2014 17:31:52 - job 7348440 appears to have finished
Fri 17 Jan 2014 17:31:52 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 17:31:52 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 17:31:52 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:31:52 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 17:31:52 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:31:52 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 17:31:52 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 17:31:53 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 17:31:53 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:31:53 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:31:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:31:55 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:31:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:31:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:31:55 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 1012295 values 15974070 bits 1996758 bytes 
Fri 17 Jan 2014 17:31:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:31:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:31:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:31:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:31:59 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:31:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 17:31:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:31:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:31:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43843198
Fri 17 Jan 2014 17:31:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:32:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43843198
Fri 17 Jan 2014 17:32:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:32:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:32:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:32:08 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:32:08 - job_xml_thread(): Done retrieving: data size 43843198
Fri 17 Jan 2014 17:32:08 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:32:08 - XML: Start document: iteration 18
Fri 17 Jan 2014 17:32:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:32:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:32:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:32:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:32:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:32:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:32:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:32:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:32:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43843198
Fri 17 Jan 2014 17:32:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:32:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:32:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:32:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:32:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:32:25 - XML: Processed 655431 elements - found 614 jobs
Fri 17 Jan 2014 17:32:25 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:32:25 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:32:25 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:32:25 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:32:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:32:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:32:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:32:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:32:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:32:27 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:32:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:32:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:32:27 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:32:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:32:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:32:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:32:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:32:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:32:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:32:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:32:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:32:33 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:32:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851819
Fri 17 Jan 2014 17:32:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:32:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851819
Fri 17 Jan 2014 17:32:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:32:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:32:38 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:32:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:32:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 17:32:39 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:32:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 17:32:39 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:32:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99465 bits 12433 bytes 
Fri 17 Jan 2014 17:32:40 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:32:40 - job_xml_thread(): Done retrieving: data size 43851819
Fri 17 Jan 2014 17:32:40 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:32:40 - XML: Start document: iteration 19
Fri 17 Jan 2014 17:32:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:32:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:32:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:32:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:32:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:32:48 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:32:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:32:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:32:50 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:32:51 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:32:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:32:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:32:51 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:32:52 - XML: Processed 655434 elements - found 614 jobs
Fri 17 Jan 2014 17:32:52 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:32:52 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:32:52 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:32:52 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:32:53 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:32:53 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 17:32:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:32:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:32:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:32:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:32:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:32:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:32:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:32:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:32:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:32:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43866865
Fri 17 Jan 2014 17:32:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:32:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43866865
Fri 17 Jan 2014 17:33:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:33:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:33:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:33:07 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:33:07 - job_xml_thread(): Done retrieving: data size 43866865
Fri 17 Jan 2014 17:33:07 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:33:07 - XML: Start document: iteration 20
Fri 17 Jan 2014 17:33:07 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:33:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 17:33:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:33:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:33:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:33:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:33:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:33:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:33:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:33:16 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:33:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:33:16 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:33:16 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:33:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:33:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:33:20 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:33:20 - XML: Processed 655432 elements - found 614 jobs
Fri 17 Jan 2014 17:33:20 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:33:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:33:20 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:33:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:33:20 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:33:20 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:33:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:33:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:33:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:33:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:33:23 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:33:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43849605
Fri 17 Jan 2014 17:33:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:33:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43849605
Fri 17 Jan 2014 17:33:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:33:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:33:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:33:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:33:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:33:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:33:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:33:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:33:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:33:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:33:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:33:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:33:35 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:33:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:33:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:33:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:33:39 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:33:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:33:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:33:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:33:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:33:39 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:33:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:33:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 17:33:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 17:33:39 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:33:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6175 values 97588 bits 12198 bytes 
Fri 17 Jan 2014 17:33:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:33:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:33:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:33:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:33:43 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 17:33:43 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 17:33:43 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:33:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:33:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43857172
Fri 17 Jan 2014 17:33:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:33:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43857172
Fri 17 Jan 2014 17:33:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:33:43 - job_xml_thread(): Done retrieving: data size 43857172
Fri 17 Jan 2014 17:33:44 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:33:44 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 17:33:44 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 17:33:44 - Housekeeping: done.
Fri 17 Jan 2014 17:33:44 - XML: Start document: iteration 0
Fri 17 Jan 2014 17:33:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:33:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:33:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:33:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:33:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:33:56 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:33:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:33:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:33:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:33:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:33:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:33:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:33:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:34:02 - XML: Processed 655434 elements - found 614 jobs
Fri 17 Jan 2014 17:34:02 - job 7348327 appears to have finished
Fri 17 Jan 2014 17:34:02 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 17:34:02 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 17:34:03 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 17:34:03 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:34:03 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:34:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:34:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:34:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:34:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:34:07 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:34:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 17:34:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:34:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:34:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:34:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:34:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:34:09 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:34:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43836918
Fri 17 Jan 2014 17:34:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:34:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43836918
Fri 17 Jan 2014 17:34:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:34:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:34:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:34:18 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:34:18 - job_xml_thread(): Done retrieving: data size 43836918
Fri 17 Jan 2014 17:34:18 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:34:18 - XML: Start document: iteration 1
Fri 17 Jan 2014 17:34:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:34:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:34:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:34:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:34:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:34:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:34:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:34:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:34:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:34:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:34:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:34:29 - XML: Processed 655434 elements - found 614 jobs
Fri 17 Jan 2014 17:34:29 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:34:29 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:34:29 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:34:29 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:34:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:34:31 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:34:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:34:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:34:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:34:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:34:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:34:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:34:33 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:34:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43829210
Fri 17 Jan 2014 17:34:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:34:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43829210
Fri 17 Jan 2014 17:34:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:34:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:34:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:34:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:34:39 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:34:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:34:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 17:34:41 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:34:41 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:34:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 17:34:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:34:41 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:34:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8487 values 133835 bits 16729 bytes 
Fri 17 Jan 2014 17:34:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:34:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:34:42 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:34:42 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:34:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:34:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:34:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43829210
Fri 17 Jan 2014 17:34:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:34:45 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:34:45 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:34:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:34:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:34:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:34:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:34:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:34:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:34:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:34:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:34:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:34:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:34:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:34:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:34:56 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:34:56 - job_xml_thread(): Done retrieving: data size 43841280
Fri 17 Jan 2014 17:34:56 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:34:56 - XML: Start document: iteration 2
Fri 17 Jan 2014 17:34:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43841280
Fri 17 Jan 2014 17:34:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:34:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:34:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:34:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:34:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:34:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:34:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:34:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43841280
Fri 17 Jan 2014 17:34:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:35:07 - XML: Processed 655434 elements - found 614 jobs
Fri 17 Jan 2014 17:35:07 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:35:07 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:35:07 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:35:07 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:35:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:35:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:35:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:35:13 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:35:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:35:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:35:14 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:35:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:35:14 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:35:14 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:35:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:35:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:35:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:35:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:35:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:35:18 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:35:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 17:35:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:35:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:35:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:35:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:35:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:35:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:35:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43769320
Fri 17 Jan 2014 17:35:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:35:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43769320
Fri 17 Jan 2014 17:35:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:35:22 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:35:22 - job_xml_thread(): Done retrieving: data size 43769320
Fri 17 Jan 2014 17:35:22 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:35:22 - XML: Start document: iteration 3
Fri 17 Jan 2014 17:35:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:35:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:35:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:35:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:35:36 - XML: Processed 654682 elements - found 612 jobs
Fri 17 Jan 2014 17:35:36 - job 7348278 appears to have finished
Fri 17 Jan 2014 17:35:36 - job 7348270 appears to have finished
Fri 17 Jan 2014 17:35:36 - job 7348271 appears to have finished
Fri 17 Jan 2014 17:35:36 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 17:35:36 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 17:35:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:35:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:35:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:35:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:35:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:35:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:35:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:35:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:35:40 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:35:41 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 17:35:41 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:35:41 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:35:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:35:41 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:35:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:35:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:35:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:35:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:35:42 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:35:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 17:35:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:35:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 17:35:42 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:35:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:35:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:35:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:35:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:35:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5487 values 86507 bits 10813 bytes 
Fri 17 Jan 2014 17:35:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:35:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43256166
Fri 17 Jan 2014 17:35:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:35:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43256166
Fri 17 Jan 2014 17:35:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:35:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:35:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:35:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:35:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:35:56 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:35:56 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:35:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:35:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:35:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:35:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:35:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:35:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:35:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:35:59 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:35:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:35:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:35:59 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:35:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 17:35:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:35:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:35:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:35:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:35:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:36:00 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:36:00 - job_xml_thread(): Done retrieving: data size 43207731
Fri 17 Jan 2014 17:36:00 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:36:00 - XML: Start document: iteration 4
Fri 17 Jan 2014 17:36:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43207731
Fri 17 Jan 2014 17:36:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:36:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43207731
Fri 17 Jan 2014 17:36:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:36:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:36:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:36:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:36:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:36:19 - XML: Processed 647230 elements - found 612 jobs
Fri 17 Jan 2014 17:36:19 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:36:19 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:36:19 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:36:19 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:36:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:36:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:36:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:36:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:36:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:36:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:36:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:36:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:36:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:36:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:36:23 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:36:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:36:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:36:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:36:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:36:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:36:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:36:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:36:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43277580
Fri 17 Jan 2014 17:36:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:36:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43277580
Fri 17 Jan 2014 17:36:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:36:34 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:36:34 - job_xml_thread(): Done retrieving: data size 43277580
Fri 17 Jan 2014 17:36:34 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:36:34 - XML: Start document: iteration 5
Fri 17 Jan 2014 17:36:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:36:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:36:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:36:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:36:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:36:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:36:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:36:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:36:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:36:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:36:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:36:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:36:43 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:36:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:36:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 17:36:43 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:36:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 17:36:43 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:36:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8937 values 140969 bits 17621 bytes 
Fri 17 Jan 2014 17:36:43 - XML: Processed 647978 elements - found 612 jobs
Fri 17 Jan 2014 17:36:43 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:36:43 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:36:43 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:36:43 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:36:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:36:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:36:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:36:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:36:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:36:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:36:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:36:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:36:49 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:36:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 17:36:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:36:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:36:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43783791
Fri 17 Jan 2014 17:36:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:36:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43783791
Fri 17 Jan 2014 17:36:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:36:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:36:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:36:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:36:58 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:36:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:36:58 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:36:58 - job_xml_thread(): Done retrieving: data size 43783791
Fri 17 Jan 2014 17:36:58 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:36:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:36:58 - XML: Start document: iteration 6
Fri 17 Jan 2014 17:36:59 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:36:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:36:59 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:36:59 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:36:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:37:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:37:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:37:08 - XML: Processed 654924 elements - found 612 jobs
Fri 17 Jan 2014 17:37:08 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:37:08 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:37:08 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:37:08 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:37:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:37:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:37:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:37:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:37:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:37:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:37:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:37:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:37:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:37:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43840239
Fri 17 Jan 2014 17:37:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:37:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43840239
Fri 17 Jan 2014 17:37:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:37:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:37:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:37:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:37:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:37:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:37:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:37:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:37:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:37:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43840239
Fri 17 Jan 2014 17:37:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:37:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:37:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:37:23 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:37:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:37:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:37:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:37:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:37:31 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:37:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:37:32 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:37:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:37:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:37:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:37:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:37:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:37:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:37:34 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:37:34 - job_xml_thread(): Done retrieving: data size 43820829
Fri 17 Jan 2014 17:37:34 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:37:34 - XML: Start document: iteration 7
Fri 17 Jan 2014 17:37:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43820829
Fri 17 Jan 2014 17:37:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:37:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:37:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:37:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:37:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:37:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:37:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:37:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43820829
Fri 17 Jan 2014 17:37:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:37:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:37:44 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:37:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:37:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 17:37:47 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:37:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148673 bits 18584 bytes 
Fri 17 Jan 2014 17:37:47 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:37:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 17:37:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:37:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:37:51 - XML: Processed 655422 elements - found 608 jobs
Fri 17 Jan 2014 17:37:51 - job 7348276 appears to have finished
Fri 17 Jan 2014 17:37:51 - job 7348277 appears to have finished
Fri 17 Jan 2014 17:37:51 - job 7348274 appears to have finished
Fri 17 Jan 2014 17:37:51 - job 7348382 appears to have finished
Fri 17 Jan 2014 17:37:51 - job 7348280 appears to have finished
Fri 17 Jan 2014 17:37:51 - job_xml_thread(): Found 6 updated jobs.
Fri 17 Jan 2014 17:37:51 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 17:37:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:37:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:37:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:37:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:37:53 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:37:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:37:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:37:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:37:53 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:37:53 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Fri 17 Jan 2014 17:37:53 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:37:53 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:37:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:37:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:37:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:37:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:37:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:37:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:37:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:37:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:37:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:37:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865042
Fri 17 Jan 2014 17:37:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:37:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43865042
Fri 17 Jan 2014 17:37:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:38:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:38:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:38:08 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:38:08 - job_xml_thread(): Done retrieving: data size 43865042
Fri 17 Jan 2014 17:38:08 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:38:08 - XML: Start document: iteration 8
Fri 17 Jan 2014 17:38:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:38:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:38:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:38:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:38:11 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:38:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:38:11 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:38:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:38:11 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:38:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:38:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:38:20 - XML: Processed 655422 elements - found 608 jobs
Fri 17 Jan 2014 17:38:20 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:38:20 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:38:20 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:38:20 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:38:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:38:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:38:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:38:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:38:22 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:38:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 17:38:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:38:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:38:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:38:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:38:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:38:24 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:38:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43831425
Fri 17 Jan 2014 17:38:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:38:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43831425
Fri 17 Jan 2014 17:38:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:38:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:38:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:38:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:38:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:38:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:38:35 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:38:35 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:38:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:38:37 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:38:37 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:38:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:38:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:38:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:38:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:38:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:38:38 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:38:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:38:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:38:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:38:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:38:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:38:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:38:40 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:38:40 - job_xml_thread(): Done retrieving: data size 43872032
Fri 17 Jan 2014 17:38:40 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:38:40 - XML: Start document: iteration 9
Fri 17 Jan 2014 17:38:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43872032
Fri 17 Jan 2014 17:38:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:38:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43872032
Fri 17 Jan 2014 17:38:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:38:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:38:48 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:38:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:38:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 17:38:49 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:38:49 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:38:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 17:38:53 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 17:38:53 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:38:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:38:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:38:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8929 values 140812 bits 17601 bytes 
Fri 17 Jan 2014 17:38:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:38:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:38:54 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:38:54 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 17:38:54 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 17:38:55 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:38:55 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 17:38:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:38:56 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:38:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:38:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:38:59 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:38:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:38:59 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:39:00 - XML: Processed 655422 elements - found 608 jobs
Fri 17 Jan 2014 17:39:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:39:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:39:00 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:39:00 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:39:00 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:39:00 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:39:02 - size of cluster 'LISA Cluster': 624 hosts 79484 metrics 965406 values 15244324 bits 1905540 bytes 
Fri 17 Jan 2014 17:39:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:39:03 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:39:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:39:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:39:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:39:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:39:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:39:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:39:07 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:39:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43845706
Fri 17 Jan 2014 17:39:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:39:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43845706
Fri 17 Jan 2014 17:39:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:39:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:39:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:39:15 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:39:15 - job_xml_thread(): Done retrieving: data size 43845706
Fri 17 Jan 2014 17:39:15 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:39:15 - XML: Start document: iteration 10
Fri 17 Jan 2014 17:39:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:39:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:39:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:39:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:39:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:39:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:39:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:39:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:39:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:39:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:39:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:39:30 - XML: Processed 655422 elements - found 608 jobs
Fri 17 Jan 2014 17:39:30 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:39:30 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:39:30 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:39:30 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:39:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:39:30 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:39:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:39:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:39:30 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:39:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 17:39:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:39:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:39:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:39:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:39:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:39:33 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:39:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43821592
Fri 17 Jan 2014 17:39:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:39:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43821592
Fri 17 Jan 2014 17:39:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:39:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:39:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:39:45 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:39:45 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:39:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:39:46 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:39:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:39:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:39:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:39:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:39:47 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:39:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:39:47 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:39:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:39:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:39:49 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:39:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:39:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:39:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:39:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:39:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:39:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:39:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:39:50 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:39:50 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:39:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:39:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 17:39:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 17:39:50 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:39:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5839 values 92057 bits 11507 bytes 
Fri 17 Jan 2014 17:39:53 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:39:53 - job_xml_thread(): Done retrieving: data size 43841149
Fri 17 Jan 2014 17:39:53 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:39:53 - XML: Start document: iteration 11
Fri 17 Jan 2014 17:39:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43841149
Fri 17 Jan 2014 17:39:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43841149
Fri 17 Jan 2014 17:39:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:39:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:39:55 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:39:55 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 17:40:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:40:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:40:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:40:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:40:08 - XML: Processed 655426 elements - found 610 jobs
Fri 17 Jan 2014 17:40:09 - job 7348272 appears to have finished
Fri 17 Jan 2014 17:40:09 - job 7348292 appears to have finished
Fri 17 Jan 2014 17:40:09 - job 7348443 appears to have finished
Fri 17 Jan 2014 17:40:09 - job_xml_thread(): Found 8 updated jobs.
Fri 17 Jan 2014 17:40:09 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 17:40:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:40:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:40:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:40:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:40:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:40:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:40:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:40:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:40:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:40:14 - job_xml_thread(): Done storing. succesfully stored: 8 jobs
Fri 17 Jan 2014 17:40:14 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:40:14 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:40:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:40:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:40:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:40:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:40:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:40:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:40:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:40:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:40:18 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:40:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 17:40:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:40:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:40:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43828776
Fri 17 Jan 2014 17:40:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:40:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43828776
Fri 17 Jan 2014 17:40:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:40:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:40:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:40:29 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:40:29 - job_xml_thread(): Done retrieving: data size 43828776
Fri 17 Jan 2014 17:40:29 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:40:29 - XML: Start document: iteration 12
Fri 17 Jan 2014 17:40:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:40:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:40:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:40:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:40:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:40:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:40:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:40:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:40:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:40:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:40:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:40:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:40:38 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:40:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:40:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:40:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:40:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:40:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:40:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:40:40 - XML: Processed 655426 elements - found 610 jobs
Fri 17 Jan 2014 17:40:40 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:40:40 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:40:40 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:40:40 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:40:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:40:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43845877
Fri 17 Jan 2014 17:40:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:40:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43845877
Fri 17 Jan 2014 17:40:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:40:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:40:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:40:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:40:51 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:40:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:40:52 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:40:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 17:40:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 17:40:52 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:40:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7828 values 123423 bits 15427 bytes 
Fri 17 Jan 2014 17:40:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:40:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:40:55 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:40:55 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:40:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:40:58 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:40:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:40:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:40:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:40:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:40:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:40:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:40:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:40:59 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:40:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:40:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:41:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:41:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:41:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:41:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:41:04 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:41:04 - job_xml_thread(): Done retrieving: data size 43836548
Fri 17 Jan 2014 17:41:04 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:41:04 - XML: Start document: iteration 13
Fri 17 Jan 2014 17:41:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43836548
Fri 17 Jan 2014 17:41:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43836548
Fri 17 Jan 2014 17:41:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:41:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:41:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:41:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:41:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:41:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:41:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:41:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:41:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:41:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:41:20 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:41:20 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:41:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:41:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:41:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:41:21 - XML: Processed 655426 elements - found 610 jobs
Fri 17 Jan 2014 17:41:21 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:41:21 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:41:21 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:41:21 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:41:24 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:41:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 17:41:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:41:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:41:27 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:41:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:41:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:41:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:41:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:41:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:41:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:41:30 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:41:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43778309
Fri 17 Jan 2014 17:41:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:41:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43778309
Fri 17 Jan 2014 17:41:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:41:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:41:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:41:36 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:41:36 - job_xml_thread(): Done retrieving: data size 43778309
Fri 17 Jan 2014 17:41:36 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:41:36 - XML: Start document: iteration 14
Fri 17 Jan 2014 17:41:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:41:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:41:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:41:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:41:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:41:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:41:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:41:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:41:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:41:44 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:41:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:41:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:41:52 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:41:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:41:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 17:41:53 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:41:53 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:41:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 17:41:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:41:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5894 values 92922 bits 11615 bytes 
Fri 17 Jan 2014 17:41:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:41:54 - XML: Processed 654668 elements - found 605 jobs
Fri 17 Jan 2014 17:41:54 - job 7348275 appears to have finished
Fri 17 Jan 2014 17:41:54 - job 7335201 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 17:41:54 - job 7348215 appears to have finished
Fri 17 Jan 2014 17:41:54 - job 7348216 appears to have finished
Fri 17 Jan 2014 17:41:54 - job 7348217 appears to have finished
Fri 17 Jan 2014 17:41:54 - job 7348220 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 17:41:54 - job 7348441 appears to have finished
Fri 17 Jan 2014 17:41:54 - job 7348221 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 17:41:54 - job_xml_thread(): Found 8 updated jobs.
Fri 17 Jan 2014 17:41:54 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 17:41:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:41:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:41:54 - job_xml_thread(): Done storing. succesfully stored: 8 jobs
Fri 17 Jan 2014 17:41:54 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:41:54 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:41:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:41:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:41:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:41:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:41:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:41:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43218405
Fri 17 Jan 2014 17:41:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:41:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43218405
Fri 17 Jan 2014 17:41:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:41:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:41:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:42:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:42:09 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:42:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:42:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:42:09 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:42:09 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:42:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:42:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:42:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:42:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:42:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:42:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:42:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:42:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:42:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:42:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:42:15 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:42:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 17:42:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:42:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:42:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:42:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:42:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:42:16 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:42:16 - job_xml_thread(): Done retrieving: data size 43215484
Fri 17 Jan 2014 17:42:16 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:42:16 - XML: Start document: iteration 15
Fri 17 Jan 2014 17:42:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43215484
Fri 17 Jan 2014 17:42:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:42:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43215484
Fri 17 Jan 2014 17:42:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:42:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:42:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:42:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:42:28 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:42:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:42:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:42:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:42:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:42:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:42:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:42:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:42:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:42:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:42:35 - XML: Processed 647680 elements - found 605 jobs
Fri 17 Jan 2014 17:42:35 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:42:35 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:42:35 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:42:35 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:42:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:42:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:42:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:42:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:42:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:42:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:42:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:42:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:42:42 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:42:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43655091
Fri 17 Jan 2014 17:42:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:42:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43655091
Fri 17 Jan 2014 17:42:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:42:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:42:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:42:50 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:42:50 - job_xml_thread(): Done retrieving: data size 43655091
Fri 17 Jan 2014 17:42:50 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:42:50 - XML: Start document: iteration 16
Fri 17 Jan 2014 17:42:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:42:54 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:42:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:42:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:42:54 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:42:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 17:42:54 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:42:54 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:42:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8634 values 136125 bits 17015 bytes 
Fri 17 Jan 2014 17:42:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 17:42:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:42:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:42:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:42:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:42:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:42:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:42:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:42:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:42:55 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:43:04 - XML: Processed 653168 elements - found 605 jobs
Fri 17 Jan 2014 17:43:04 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:43:04 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:43:04 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:43:04 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:43:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:43:06 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:43:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:43:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:43:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:43:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:43:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:43:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:43:07 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 17:43:07 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 17:43:07 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:43:09 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:43:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43823223
Fri 17 Jan 2014 17:43:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:43:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43823223
Fri 17 Jan 2014 17:43:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:43:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:43:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:43:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:43:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:43:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:43:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:43:19 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:43:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:43:20 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:43:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:43:20 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:43:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:43:21 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:43:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 17:43:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:43:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:43:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:43:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:43:24 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:43:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:43:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:43:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:43:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:43:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:43:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:43:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:43:25 - job_xml_thread(): Done retrieving: data size 43852213
Fri 17 Jan 2014 17:43:25 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:43:25 - XML: Start document: iteration 17
Fri 17 Jan 2014 17:43:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43852213
Fri 17 Jan 2014 17:43:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:43:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43852213
Fri 17 Jan 2014 17:43:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:43:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:43:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:43:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:43:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:43:44 - XML: Processed 655414 elements - found 604 jobs
Fri 17 Jan 2014 17:43:44 - job 7348453 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 17:43:44 - job 7348253 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 17:43:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:43:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:43:44 - job 7348383 appears to have finished
Fri 17 Jan 2014 17:43:44 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 17:43:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:43:44 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 17:43:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:43:45 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:43:45 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:43:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:43:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:43:45 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:43:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:43:46 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:43:46 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 17:43:46 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:43:46 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:43:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:43:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:43:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:43:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:43:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:43:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:43:48 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:43:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43842342
Fri 17 Jan 2014 17:43:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:43:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43842342
Fri 17 Jan 2014 17:43:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:43:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:43:55 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:43:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:43:56 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:43:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 17:43:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 17:43:56 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:43:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9072 values 143033 bits 17879 bytes 
Fri 17 Jan 2014 17:43:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:43:58 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:44:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:44:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:44:01 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:44:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:44:01 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:44:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:44:01 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:44:01 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:44:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:44:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:44:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:44:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:44:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:44:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:44:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:44:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:44:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:44:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:44:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:44:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43846148
Fri 17 Jan 2014 17:44:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:44:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43846148
Fri 17 Jan 2014 17:44:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:44:05 - job_xml_thread(): Done retrieving: data size 43846148
Fri 17 Jan 2014 17:44:06 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:44:06 - XML: Start document: iteration 18
Fri 17 Jan 2014 17:44:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:44:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:44:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:44:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:44:24 - XML: Processed 655414 elements - found 604 jobs
Fri 17 Jan 2014 17:44:24 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:44:24 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:44:24 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:44:24 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:44:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:44:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:44:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:44:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:44:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:44:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:44:27 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:44:27 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:44:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:44:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:44:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:44:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:44:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:44:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:44:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:44:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:44:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:44:28 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:44:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 17:44:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:44:29 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:44:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43868139
Fri 17 Jan 2014 17:44:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:44:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43868139
Fri 17 Jan 2014 17:44:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:44:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:44:38 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:44:39 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:44:40 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:44:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:44:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:44:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:44:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:44:42 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:44:42 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:44:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:44:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:44:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:44:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:44:44 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:44:44 - job_xml_thread(): Done retrieving: data size 43881321
Fri 17 Jan 2014 17:44:44 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:44:44 - XML: Start document: iteration 19
Fri 17 Jan 2014 17:44:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43881321
Fri 17 Jan 2014 17:44:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:44:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:44:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:44:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:44:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:44:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43881321
Fri 17 Jan 2014 17:44:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:44:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:44:57 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:44:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:44:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:44:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:44:57 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:44:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 17:44:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 17:44:58 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:44:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:44:58 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:44:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:44:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:44:59 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9071 values 143064 bits 17883 bytes 
Fri 17 Jan 2014 17:44:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:44:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:44:59 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:44:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:44:59 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:44:59 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:44:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:45:03 - XML: Processed 655414 elements - found 604 jobs
Fri 17 Jan 2014 17:45:03 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:45:03 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:45:03 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:45:03 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:45:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:45:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:45:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:45:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:45:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:45:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:45:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:45:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:45:09 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:45:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43838553
Fri 17 Jan 2014 17:45:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:45:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43838553
Fri 17 Jan 2014 17:45:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:45:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:45:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:45:18 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:45:18 - job_xml_thread(): Done retrieving: data size 43838553
Fri 17 Jan 2014 17:45:18 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:45:18 - XML: Start document: iteration 20
Fri 17 Jan 2014 17:45:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:45:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:45:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:45:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:45:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:45:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:45:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:45:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:45:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:45:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:45:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:45:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:45:25 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:45:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:45:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:45:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:45:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:45:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:45:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:45:29 - XML: Processed 655414 elements - found 604 jobs
Fri 17 Jan 2014 17:45:29 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:45:29 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:45:29 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:45:29 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:45:29 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:45:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 17:45:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:45:30 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:45:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43849043
Fri 17 Jan 2014 17:45:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:45:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43849043
Fri 17 Jan 2014 17:45:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:45:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:45:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:45:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:45:38 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:45:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:45:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:45:39 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:45:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:45:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43849043
Fri 17 Jan 2014 17:45:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:45:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:45:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:45:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:45:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:45:44 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:45:44 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:45:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:45:44 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:45:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:45:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:45:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:45:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:45:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:45:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:45:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:45:48 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:45:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:45:49 - job_xml_thread(): Done retrieving: data size 43838630
Fri 17 Jan 2014 17:45:49 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:45:49 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 17:45:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43838630
Fri 17 Jan 2014 17:45:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:45:50 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 17:45:50 - Housekeeping: done.
Fri 17 Jan 2014 17:45:50 - XML: Start document: iteration 0
Fri 17 Jan 2014 17:45:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:45:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:45:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:45:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:45:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:45:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43838630
Fri 17 Jan 2014 17:45:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:45:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:45:56 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 17:45:56 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:45:57 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:45:57 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 17:45:57 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 17:45:57 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:45:57 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 17:45:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:45:59 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:46:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:46:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 17:46:00 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:46:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 17:46:00 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:46:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8905 values 140423 bits 17552 bytes 
Fri 17 Jan 2014 17:46:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:46:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:46:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:46:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:46:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:46:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:46:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:46:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:46:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:46:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:46:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:46:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:46:09 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:46:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:46:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:46:10 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 902487 values 14238163 bits 1779770 bytes 
Fri 17 Jan 2014 17:46:11 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:46:11 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:46:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:46:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:46:13 - XML: Processed 655407 elements - found 602 jobs
Fri 17 Jan 2014 17:46:13 - job 7348246 appears to have finished
Fri 17 Jan 2014 17:46:13 - job 7348065 appears to have finished
Fri 17 Jan 2014 17:46:13 - job 7348297 appears to have finished
Fri 17 Jan 2014 17:46:13 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 17:46:13 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 17:46:13 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 17:46:13 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:46:13 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:46:17 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:46:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 17:46:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:46:17 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:46:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43846557
Fri 17 Jan 2014 17:46:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:46:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43846557
Fri 17 Jan 2014 17:46:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:46:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:46:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:46:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:46:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:46:28 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:46:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:46:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:46:31 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:46:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:46:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:46:32 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:46:32 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:46:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:46:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:46:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:46:33 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:46:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:46:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:46:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:46:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:46:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:46:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:46:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:46:36 - job_xml_thread(): Done retrieving: data size 43838460
Fri 17 Jan 2014 17:46:36 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:46:36 - XML: Start document: iteration 1
Fri 17 Jan 2014 17:46:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43838460
Fri 17 Jan 2014 17:46:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:46:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43838460
Fri 17 Jan 2014 17:46:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:46:46 - XML: Processed 655410 elements - found 602 jobs
Fri 17 Jan 2014 17:46:46 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:46:46 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:46:46 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:46:46 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:46:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:46:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:46:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:46:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:46:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:46:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:46:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:46:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:46:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:46:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:46:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:46:55 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:46:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:46:57 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:46:57 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 17:46:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:46:59 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:46:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:46:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:46:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:46:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:46:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:46:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:47:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:47:00 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:47:00 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:47:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:47:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 17:47:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 17:47:00 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:47:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99244 bits 12405 bytes 
Fri 17 Jan 2014 17:47:01 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:47:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:47:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865627
Fri 17 Jan 2014 17:47:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:47:03 - job_xml_thread(): Done retrieving: data size 43865627
Fri 17 Jan 2014 17:47:03 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:47:03 - XML: Start document: iteration 2
Fri 17 Jan 2014 17:47:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43865627
Fri 17 Jan 2014 17:47:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:47:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:47:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:47:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:47:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:47:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:47:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:47:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:47:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:47:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:47:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:47:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:47:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:47:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:47:27 - XML: Processed 655407 elements - found 602 jobs
Fri 17 Jan 2014 17:47:27 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:47:27 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:47:27 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:47:27 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:47:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:47:27 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:47:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:47:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:47:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:47:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:47:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:47:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:47:28 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:47:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 17:47:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:47:30 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:47:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43775617
Fri 17 Jan 2014 17:47:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:47:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43775617
Fri 17 Jan 2014 17:47:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:47:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:47:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:47:42 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:47:42 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:47:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:47:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:47:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:47:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:47:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:47:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:47:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:47:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:47:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:47:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:47:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:47:46 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:47:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:47:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:47:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:47:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:47:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:47:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:47:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:47:49 - job_xml_thread(): Done retrieving: data size 43226477
Fri 17 Jan 2014 17:47:49 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:47:49 - XML: Start document: iteration 3
Fri 17 Jan 2014 17:47:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43226477
Fri 17 Jan 2014 17:47:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:47:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43226477
Fri 17 Jan 2014 17:47:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:47:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:47:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:48:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:48:01 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:48:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:48:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:48:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:48:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 17:48:01 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:48:01 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:48:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 17:48:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7530 values 119098 bits 14887 bytes 
Fri 17 Jan 2014 17:48:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:48:07 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:48:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:48:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:48:08 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:48:08 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:48:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:48:08 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:48:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:48:09 - XML: Processed 647790 elements - found 601 jobs
Fri 17 Jan 2014 17:48:09 - job 7348298 appears to have finished
Fri 17 Jan 2014 17:48:09 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 17:48:09 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 17:48:09 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 17:48:09 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:48:09 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:48:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:48:13 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:48:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:48:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:48:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:48:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:48:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:48:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:48:16 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:48:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43189573
Fri 17 Jan 2014 17:48:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:48:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43189573
Fri 17 Jan 2014 17:48:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:48:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:48:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:48:24 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:48:24 - job_xml_thread(): Done retrieving: data size 43189573
Fri 17 Jan 2014 17:48:24 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:48:24 - XML: Start document: iteration 4
Fri 17 Jan 2014 17:48:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:48:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:48:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:48:31 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:48:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:48:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:48:32 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:48:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:48:32 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:48:32 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:48:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:48:36 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:48:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 17:48:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:48:38 - XML: Processed 647212 elements - found 601 jobs
Fri 17 Jan 2014 17:48:39 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:48:39 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:48:39 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:48:39 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:48:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:48:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:48:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:48:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:48:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:48:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:48:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:48:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:48:42 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:48:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43731780
Fri 17 Jan 2014 17:48:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:48:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43731780
Fri 17 Jan 2014 17:48:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:48:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:48:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:48:54 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:48:54 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:48:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:48:54 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:48:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:48:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:48:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:48:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:48:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:48:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:48:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:48:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:48:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:48:59 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:48:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:48:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:48:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:48:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:48:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:48:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:49:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:49:02 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:49:02 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:49:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 17:49:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:49:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 17:49:02 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:49:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5794 values 91451 bits 11431 bytes 
Fri 17 Jan 2014 17:49:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:49:02 - job_xml_thread(): Done retrieving: data size 43834822
Fri 17 Jan 2014 17:49:02 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:49:02 - XML: Start document: iteration 5
Fri 17 Jan 2014 17:49:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43834822
Fri 17 Jan 2014 17:49:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:49:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43834822
Fri 17 Jan 2014 17:49:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:49:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:49:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:49:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:49:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:49:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:49:16 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:49:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:49:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:49:16 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:49:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:49:16 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:49:16 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:49:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:49:21 - XML: Processed 655206 elements - found 601 jobs
Fri 17 Jan 2014 17:49:21 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:49:21 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:49:21 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:49:21 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:49:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:49:25 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:49:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:49:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:49:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:49:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:49:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:49:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:49:28 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:49:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 17:49:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:49:28 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:49:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43832955
Fri 17 Jan 2014 17:49:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:49:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43832955
Fri 17 Jan 2014 17:49:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:49:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:49:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:49:36 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:49:36 - job_xml_thread(): Done retrieving: data size 43832955
Fri 17 Jan 2014 17:49:36 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:49:36 - XML: Start document: iteration 6
Fri 17 Jan 2014 17:49:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:49:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:49:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:49:42 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:49:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:49:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:49:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:49:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:49:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:49:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:49:44 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:49:49 - XML: Processed 655404 elements - found 599 jobs
Fri 17 Jan 2014 17:49:49 - job 7348455 appears to have finished
Fri 17 Jan 2014 17:49:49 - job 7348299 appears to have finished
Fri 17 Jan 2014 17:49:49 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 17:49:50 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 17:49:50 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 17:49:50 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:49:50 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:49:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:49:52 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:49:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:49:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:49:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:49:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:49:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:49:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:49:56 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 17:49:56 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 17:49:56 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:49:56 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:49:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43827792
Fri 17 Jan 2014 17:49:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:49:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43827792
Fri 17 Jan 2014 17:49:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:49:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:49:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:50:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:50:02 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:50:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:50:04 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:50:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 17:50:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 17:50:04 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:50:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6402 values 101010 bits 12626 bytes 
Fri 17 Jan 2014 17:50:05 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:50:05 - job_xml_thread(): Done retrieving: data size 43827792
Fri 17 Jan 2014 17:50:05 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:50:05 - XML: Start document: iteration 7
Fri 17 Jan 2014 17:50:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:50:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:50:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:50:09 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:50:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:50:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:50:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:50:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:50:11 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:50:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:50:11 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:50:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:50:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:50:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:50:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:50:19 - XML: Processed 655404 elements - found 599 jobs
Fri 17 Jan 2014 17:50:19 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:50:19 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:50:19 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:50:19 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:50:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:50:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:50:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:50:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:50:21 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:50:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43819416
Fri 17 Jan 2014 17:50:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:50:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43819416
Fri 17 Jan 2014 17:50:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:50:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:50:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:50:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:50:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:50:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:50:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:50:34 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:50:34 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:50:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:50:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:50:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:50:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:50:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:50:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:50:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:50:36 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:50:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:50:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:50:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:50:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:50:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:50:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:50:37 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:50:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 17:50:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:50:38 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:50:38 - job_xml_thread(): Done retrieving: data size 43849758
Fri 17 Jan 2014 17:50:38 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:50:38 - XML: Start document: iteration 8
Fri 17 Jan 2014 17:50:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43849758
Fri 17 Jan 2014 17:50:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43849758
Fri 17 Jan 2014 17:50:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:50:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:50:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:50:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:50:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:50:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:50:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:50:56 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:50:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:50:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:50:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:50:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:50:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:50:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:50:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:51:00 - XML: Processed 655404 elements - found 599 jobs
Fri 17 Jan 2014 17:51:00 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:51:00 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:51:00 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:51:00 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:51:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:51:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:51:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:51:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:51:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:51:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:51:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:51:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:51:03 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:51:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43852639
Fri 17 Jan 2014 17:51:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:51:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43852639
Fri 17 Jan 2014 17:51:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:51:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:51:04 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:51:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:51:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 17:51:05 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:51:05 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:51:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 17:51:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6417 values 101215 bits 12651 bytes 
Fri 17 Jan 2014 17:51:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:51:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:51:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:51:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:51:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:51:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:51:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:51:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:51:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:51:15 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:51:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:51:15 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:51:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:51:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:51:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:51:19 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:51:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:51:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:51:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:51:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:51:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:51:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:51:21 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:51:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43835161
Fri 17 Jan 2014 17:51:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:51:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43835161
Fri 17 Jan 2014 17:51:21 - job_xml_thread(): Done retrieving: data size 43835161
Fri 17 Jan 2014 17:51:21 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:51:21 - XML: Start document: iteration 9
Fri 17 Jan 2014 17:51:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:51:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:51:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:51:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:51:34 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:51:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:51:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:51:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:51:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:51:35 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:51:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:51:35 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:51:35 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:51:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:51:43 - XML: Processed 655404 elements - found 599 jobs
Fri 17 Jan 2014 17:51:43 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:51:43 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:51:43 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:51:43 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:51:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:51:44 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:51:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:51:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:51:44 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:51:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 17:51:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:51:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:51:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:51:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:51:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:51:46 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:51:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43842191
Fri 17 Jan 2014 17:51:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:51:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43842191
Fri 17 Jan 2014 17:51:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:51:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:51:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:51:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:51:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:51:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:51:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:51:59 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:51:59 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:51:59 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:51:59 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:51:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:51:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:52:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:52:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:52:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:52:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:52:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:52:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:52:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:52:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:52:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:52:02 - job_xml_thread(): Done retrieving: data size 43869267
Fri 17 Jan 2014 17:52:02 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:52:02 - XML: Start document: iteration 10
Fri 17 Jan 2014 17:52:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43869267
Fri 17 Jan 2014 17:52:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:52:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43869267
Fri 17 Jan 2014 17:52:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:52:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:52:05 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:52:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:52:07 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:52:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 17:52:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 17:52:07 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:52:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8899 values 140350 bits 17543 bytes 
Fri 17 Jan 2014 17:52:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:52:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:52:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:52:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:52:25 - XML: Processed 655397 elements - found 596 jobs
Fri 17 Jan 2014 17:52:25 - job 7348305 appears to have finished
Fri 17 Jan 2014 17:52:25 - job 7348295 appears to have finished
Fri 17 Jan 2014 17:52:25 - job 7348296 appears to have finished
Fri 17 Jan 2014 17:52:25 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 17:52:25 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 17:52:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:52:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:52:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:52:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:52:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:52:26 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:52:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:52:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:52:26 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 17:52:26 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:52:26 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:52:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:52:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:52:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:52:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:52:27 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:52:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:52:27 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:52:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:52:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:52:29 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:52:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 17:52:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:52:29 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:52:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43879122
Fri 17 Jan 2014 17:52:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:52:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43879122
Fri 17 Jan 2014 17:52:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:52:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:52:41 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:52:41 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:52:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:52:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:52:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:52:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:52:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:52:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:52:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:52:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:52:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:52:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:52:44 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:52:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:52:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:52:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:52:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:52:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:52:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:52:46 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:52:46 - job_xml_thread(): Done retrieving: data size 43873172
Fri 17 Jan 2014 17:52:46 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:52:46 - XML: Start document: iteration 11
Fri 17 Jan 2014 17:52:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873172
Fri 17 Jan 2014 17:52:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:52:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873172
Fri 17 Jan 2014 17:52:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:52:57 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 17:52:57 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:52:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:52:58 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:52:58 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 17:52:58 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:52:58 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 17:52:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:52:59 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 17:53:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:53:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:53:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:53:03 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:53:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:53:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:53:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:53:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:53:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:53:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:53:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:53:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:53:07 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:53:08 - size of cluster 'LISA Cluster': 624 hosts 79482 metrics 829063 values 13090185 bits 1636273 bytes 
Fri 17 Jan 2014 17:53:08 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:53:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 17:53:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:53:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 17:53:08 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:53:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99101 bits 12387 bytes 
Fri 17 Jan 2014 17:53:10 - XML: Processed 655395 elements - found 596 jobs
Fri 17 Jan 2014 17:53:10 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:53:10 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:53:10 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:53:10 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:53:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:53:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:53:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:53:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:53:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:53:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:53:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:53:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:53:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:53:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43779060
Fri 17 Jan 2014 17:53:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:53:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43779060
Fri 17 Jan 2014 17:53:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:53:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:53:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:53:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:53:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:53:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:53:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:53:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:53:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:53:23 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:53:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:53:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43779060
Fri 17 Jan 2014 17:53:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:53:25 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:53:25 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:53:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:53:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:53:29 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:53:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 17:53:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:53:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:53:34 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:53:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:53:36 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:53:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:53:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:53:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:53:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:53:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:53:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:53:38 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:53:38 - job_xml_thread(): Done retrieving: data size 43583981
Fri 17 Jan 2014 17:53:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:53:38 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:53:38 - XML: Start document: iteration 12
Fri 17 Jan 2014 17:53:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:53:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583981
Fri 17 Jan 2014 17:53:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:53:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:53:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:53:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583981
Fri 17 Jan 2014 17:53:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:53:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:53:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:53:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:53:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:53:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:53:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:53:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:53:56 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:53:57 - XML: Processed 652632 elements - found 595 jobs
Fri 17 Jan 2014 17:53:57 - job 7348339 appears to have finished
Fri 17 Jan 2014 17:53:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:53:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:53:57 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 17:53:57 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 17:53:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:53:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:53:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:53:57 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 17:53:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:53:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:53:57 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:53:57 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:53:58 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:53:58 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 17:54:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:54:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:54:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:54:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:54:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:54:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:54:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:54:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:54:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:54:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43197433
Fri 17 Jan 2014 17:54:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:54:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43197433
Fri 17 Jan 2014 17:54:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:54:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:54:08 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:54:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:54:08 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:54:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 17:54:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 17:54:09 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:54:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9376 values 147827 bits 18478 bytes 
Fri 17 Jan 2014 17:54:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:54:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:54:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:54:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:54:12 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:54:12 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:54:12 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:54:12 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:54:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:54:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:54:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:54:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:54:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:54:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:54:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:54:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:54:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:54:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:54:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:54:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:54:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:54:20 - job_xml_thread(): Done retrieving: data size 43222416
Fri 17 Jan 2014 17:54:20 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:54:20 - XML: Start document: iteration 13
Fri 17 Jan 2014 17:54:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43222416
Fri 17 Jan 2014 17:54:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:54:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43222416
Fri 17 Jan 2014 17:54:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:54:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:54:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:54:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:54:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:54:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:54:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:54:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:54:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:54:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:54:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:54:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:54:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:54:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:54:42 - XML: Processed 647808 elements - found 595 jobs
Fri 17 Jan 2014 17:54:42 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:54:42 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:54:42 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:54:42 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:54:44 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:54:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 17:54:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:54:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:54:46 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:54:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:54:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:54:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:54:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:54:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:54:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:54:48 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:54:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43786287
Fri 17 Jan 2014 17:54:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:54:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43786287
Fri 17 Jan 2014 17:54:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:54:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:54:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:54:57 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:54:57 - job_xml_thread(): Done retrieving: data size 43786287
Fri 17 Jan 2014 17:54:57 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:54:57 - XML: Start document: iteration 14
Fri 17 Jan 2014 17:54:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:54:58 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:54:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:54:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:54:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:54:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:54:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:54:59 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:54:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:55:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:55:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:55:07 - XML: Processed 654756 elements - found 595 jobs
Fri 17 Jan 2014 17:55:07 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:55:07 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:55:07 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:55:07 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:55:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:55:09 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:55:09 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:55:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 17:55:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:55:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 17:55:09 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:55:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5798 values 91405 bits 11425 bytes 
Fri 17 Jan 2014 17:55:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:55:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:55:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:55:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:55:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:55:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:55:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:55:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:55:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:55:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43823075
Fri 17 Jan 2014 17:55:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:55:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:55:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:55:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43823075
Fri 17 Jan 2014 17:55:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:55:22 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:55:22 - job_xml_thread(): Done retrieving: data size 43823075
Fri 17 Jan 2014 17:55:22 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:55:22 - XML: Start document: iteration 15
Fri 17 Jan 2014 17:55:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:55:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:55:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:55:28 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:55:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:55:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:55:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:55:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:55:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:55:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:55:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:55:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:55:32 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:55:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:55:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:55:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:55:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:55:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:55:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:55:35 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:55:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 17:55:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:55:36 - XML: Processed 655396 elements - found 595 jobs
Fri 17 Jan 2014 17:55:36 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:55:36 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:55:36 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:55:36 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:55:39 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:55:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43820878
Fri 17 Jan 2014 17:55:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:55:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43820878
Fri 17 Jan 2014 17:55:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:55:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:55:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:55:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:55:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:55:51 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:55:51 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:55:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:55:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:55:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:55:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:55:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:55:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:55:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:55:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:55:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:55:55 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:55:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:55:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:55:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:55:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:55:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:55:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:55:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:55:59 - job_xml_thread(): Done retrieving: data size 43858853
Fri 17 Jan 2014 17:55:59 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:55:59 - XML: Start document: iteration 16
Fri 17 Jan 2014 17:55:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43858853
Fri 17 Jan 2014 17:55:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858853
Fri 17 Jan 2014 17:56:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:56:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:56:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:56:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:56:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:56:09 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:56:09 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:56:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 17:56:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:56:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 17:56:09 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:56:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8597 values 135506 bits 16938 bytes 
Fri 17 Jan 2014 17:56:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:56:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:56:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:56:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:56:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:56:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:56:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:56:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:56:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:56:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:56:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:56:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:56:21 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:56:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:56:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:56:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:56:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:56:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:56:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:56:22 - XML: Processed 655396 elements - found 595 jobs
Fri 17 Jan 2014 17:56:22 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:56:22 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:56:22 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:56:22 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:56:26 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:56:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853075
Fri 17 Jan 2014 17:56:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:56:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853075
Fri 17 Jan 2014 17:56:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:56:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:56:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:56:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:56:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:56:38 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:56:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:56:39 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:56:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 17:56:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:56:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:56:41 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:56:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:56:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:56:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:56:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:56:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:56:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:56:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:56:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:56:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:56:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:56:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:56:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:56:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:56:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:56:44 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 17:56:44 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 17:56:44 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:56:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:56:45 - job_xml_thread(): Done retrieving: data size 43864680
Fri 17 Jan 2014 17:56:45 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:56:45 - XML: Start document: iteration 17
Fri 17 Jan 2014 17:56:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43864680
Fri 17 Jan 2014 17:56:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43864680
Fri 17 Jan 2014 17:56:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:56:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:56:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:56:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:56:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:56:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:57:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:57:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:57:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:57:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:57:06 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:57:06 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:57:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:57:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:57:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:57:07 - XML: Processed 655396 elements - found 595 jobs
Fri 17 Jan 2014 17:57:07 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:57:07 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:57:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:57:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:57:07 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:57:07 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:57:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:57:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:57:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:57:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:57:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:57:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:57:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:57:09 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:57:09 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:57:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43859759
Fri 17 Jan 2014 17:57:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:57:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43859759
Fri 17 Jan 2014 17:57:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:57:10 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:57:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:57:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 17:57:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 17:57:10 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:57:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6121 values 96542 bits 12067 bytes 
Fri 17 Jan 2014 17:57:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:57:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:57:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:57:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:57:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:57:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:57:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:57:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:57:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:57:23 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:57:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:57:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:57:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:57:25 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:57:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:57:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:57:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:57:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:57:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:57:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:57:27 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:57:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43864887
Fri 17 Jan 2014 17:57:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:57:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43864887
Fri 17 Jan 2014 17:57:27 - job_xml_thread(): Done retrieving: data size 43864887
Fri 17 Jan 2014 17:57:27 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:57:27 - XML: Start document: iteration 18
Fri 17 Jan 2014 17:57:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:57:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:57:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:57:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:57:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:57:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:57:45 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:57:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:57:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:57:45 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:57:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:57:45 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:57:45 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:57:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:57:47 - XML: Processed 655396 elements - found 595 jobs
Fri 17 Jan 2014 17:57:47 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:57:47 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:57:47 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:57:47 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:57:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:57:49 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:57:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:57:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:57:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:57:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:57:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:57:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:57:49 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:57:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 17:57:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:57:50 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:57:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43841459
Fri 17 Jan 2014 17:57:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:57:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43841459
Fri 17 Jan 2014 17:57:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:58:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:58:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:58:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:58:01 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:58:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:58:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:58:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:58:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:58:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:58:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:58:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:58:02 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:58:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:58:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:58:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:58:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:58:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:58:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:58:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:58:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:58:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:58:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:58:06 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:58:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43847131
Fri 17 Jan 2014 17:58:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:58:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43847131
Fri 17 Jan 2014 17:58:06 - job_xml_thread(): Done retrieving: data size 43847131
Fri 17 Jan 2014 17:58:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:58:07 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:58:07 - XML: Start document: iteration 19
Fri 17 Jan 2014 17:58:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:58:11 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:58:12 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:58:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:58:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 17:58:12 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:58:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 17:58:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9068 values 143023 bits 17877 bytes 
Fri 17 Jan 2014 17:58:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:58:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:58:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:58:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:58:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:58:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:58:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:58:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:58:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:58:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:58:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:58:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:58:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:58:30 - XML: Processed 655396 elements - found 595 jobs
Fri 17 Jan 2014 17:58:30 - job 7344341 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 17:58:30 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 17:58:30 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 17:58:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:58:30 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:58:30 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 17:58:30 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:58:30 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:58:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:58:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:58:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:58:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:58:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:58:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:58:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:58:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43824639
Fri 17 Jan 2014 17:58:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:58:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43824639
Fri 17 Jan 2014 17:58:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:58:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:58:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:58:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:58:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:58:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:58:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:58:45 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:58:45 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:58:45 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:58:45 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:58:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:58:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:58:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:58:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:58:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:58:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:58:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:58:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:58:47 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:58:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 17:58:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:58:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:58:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:58:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:58:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:58:48 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:58:48 - job_xml_thread(): Done retrieving: data size 43846808
Fri 17 Jan 2014 17:58:48 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:58:48 - XML: Start document: iteration 20
Fri 17 Jan 2014 17:58:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43846808
Fri 17 Jan 2014 17:58:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:58:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43846808
Fri 17 Jan 2014 17:58:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:59:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:59:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:59:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:59:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:59:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:59:07 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:59:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:59:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:59:08 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:59:08 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:59:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:59:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:59:08 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:59:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:59:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:59:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:59:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:59:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:59:12 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:59:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:59:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:59:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:59:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:59:12 - XML: Processed 655396 elements - found 595 jobs
Fri 17 Jan 2014 17:59:12 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 17:59:12 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 17:59:12 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:59:12 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:59:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:59:13 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:59:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 17:59:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 17:59:13 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:59:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5753 values 90690 bits 11336 bytes 
Fri 17 Jan 2014 17:59:15 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:59:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43791006
Fri 17 Jan 2014 17:59:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:59:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43791006
Fri 17 Jan 2014 17:59:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:59:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:59:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:59:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:59:25 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:59:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:59:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:59:26 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:59:26 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:59:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:59:26 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:59:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:59:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:59:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:59:27 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 17:59:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:59:30 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:59:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:59:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:59:30 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 17:59:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 17:59:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:59:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:59:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:59:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:59:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:59:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:59:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43413154
Fri 17 Jan 2014 17:59:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:59:32 - job_xml_thread(): Done retrieving: data size 43413154
Fri 17 Jan 2014 17:59:32 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 17:59:32 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 17:59:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43413154
Fri 17 Jan 2014 17:59:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 17:59:35 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 17:59:35 - Housekeeping: done.
Fri 17 Jan 2014 17:59:35 - XML: Start document: iteration 0
Fri 17 Jan 2014 17:59:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 17:59:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:59:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 17:59:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 17:59:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 17:59:49 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 17:59:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 17:59:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 17:59:50 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:59:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 17:59:50 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 17:59:50 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 17:59:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 17:59:54 - XML: Processed 650192 elements - found 595 jobs
Fri 17 Jan 2014 17:59:54 - job 7348301 appears to have finished
Fri 17 Jan 2014 17:59:54 - job 7348304 appears to have finished
Fri 17 Jan 2014 17:59:54 - job 7344336 appears to have finished
Fri 17 Jan 2014 17:59:54 - job_xml_thread(): Found 6 updated jobs.
Fri 17 Jan 2014 17:59:54 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 17:59:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 17:59:55 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 17:59:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 17:59:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:59:55 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Fri 17 Jan 2014 17:59:55 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 17:59:55 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 17:59:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:59:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 17:59:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 17:59:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 17:59:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 17:59:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43193296
Fri 17 Jan 2014 17:59:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 17:59:59 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 17:59:59 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 17:59:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43193296
Fri 17 Jan 2014 17:59:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:00:00 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:00:00 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 18:00:01 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:00:01 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 18:00:01 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 18:00:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:00:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:00:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:00:07 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:00:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:00:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:00:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:00:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:00:09 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:00:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:00:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:00:09 - size of cluster 'LISA Cluster': 624 hosts 79459 metrics 796715 values 12572367 bits 1571545 bytes 
Fri 17 Jan 2014 18:00:10 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:00:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:00:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:00:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:00:13 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:00:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:00:13 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:00:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:00:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:00:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:00:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:00:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:00:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:00:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:00:14 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:00:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 18:00:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 18:00:14 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:00:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9050 values 142706 bits 17838 bytes 
Fri 17 Jan 2014 18:00:16 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:00:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43220882
Fri 17 Jan 2014 18:00:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:00:16 - job_xml_thread(): Done retrieving: data size 43220882
Fri 17 Jan 2014 18:00:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43220882
Fri 17 Jan 2014 18:00:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:00:16 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:00:16 - XML: Start document: iteration 1
Fri 17 Jan 2014 18:00:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:00:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:00:27 - XML: Processed 647734 elements - found 595 jobs
Fri 17 Jan 2014 18:00:27 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:00:27 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:00:27 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:00:27 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:00:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:00:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:00:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:00:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:00:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:00:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:00:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:00:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:00:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:00:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:00:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:00:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:00:40 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:00:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:00:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:00:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:00:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:00:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:00:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:00:42 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:00:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 18:00:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:00:42 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:00:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:00:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43651342
Fri 17 Jan 2014 18:00:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:00:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43651342
Fri 17 Jan 2014 18:00:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:00:44 - job_xml_thread(): Done retrieving: data size 43651342
Fri 17 Jan 2014 18:00:44 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:00:44 - XML: Start document: iteration 2
Fri 17 Jan 2014 18:00:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:00:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:00:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:00:53 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:00:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:00:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:00:54 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:00:54 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:00:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:00:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:00:54 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:00:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:00:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:01:00 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:01:00 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 18:01:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:01:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:01:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:01:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:01:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:01:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:01:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:01:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:01:03 - XML: Processed 652852 elements - found 595 jobs
Fri 17 Jan 2014 18:01:03 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:01:03 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:01:03 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:01:03 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:01:06 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:01:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43817998
Fri 17 Jan 2014 18:01:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:01:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43817998
Fri 17 Jan 2014 18:01:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:01:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:01:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:01:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:01:14 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:01:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:01:15 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:01:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 18:01:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 18:01:15 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:01:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7932 values 124984 bits 15623 bytes 
Fri 17 Jan 2014 18:01:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:01:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:01:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:01:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:01:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:01:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:01:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:01:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:01:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:01:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:01:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:01:18 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:01:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:01:21 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:01:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:01:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:01:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:01:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:01:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:01:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:01:24 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:01:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 18:01:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:01:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:01:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43843498
Fri 17 Jan 2014 18:01:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:01:26 - job_xml_thread(): Done retrieving: data size 43843498
Fri 17 Jan 2014 18:01:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43843498
Fri 17 Jan 2014 18:01:26 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:01:26 - XML: Start document: iteration 3
Fri 17 Jan 2014 18:01:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:01:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:01:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:01:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:01:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:01:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:01:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:01:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:01:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:01:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:01:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:01:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:01:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:01:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:01:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:01:48 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:01:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:01:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:01:49 - XML: Processed 655396 elements - found 595 jobs
Fri 17 Jan 2014 18:01:49 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:01:49 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:01:49 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:01:49 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:01:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:01:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:01:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:01:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:01:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:01:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43814263
Fri 17 Jan 2014 18:01:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:01:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43814263
Fri 17 Jan 2014 18:01:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:01:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:01:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:02:04 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:02:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:02:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:02:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:02:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:02:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:02:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:02:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:02:04 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:02:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:02:04 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:02:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:02:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:02:08 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:02:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:02:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:02:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:02:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:02:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:02:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:02:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:02:11 - job_xml_thread(): Done retrieving: data size 43853429
Fri 17 Jan 2014 18:02:11 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:02:11 - XML: Start document: iteration 4
Fri 17 Jan 2014 18:02:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853429
Fri 17 Jan 2014 18:02:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:02:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853429
Fri 17 Jan 2014 18:02:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:02:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:02:15 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:02:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:02:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 18:02:18 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:02:18 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:02:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 18:02:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 149073 bits 18634 bytes 
Fri 17 Jan 2014 18:02:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:02:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:02:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:02:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:02:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:02:27 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:02:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:02:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:02:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:02:27 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:02:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:02:27 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:02:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:02:29 - XML: Processed 655396 elements - found 595 jobs
Fri 17 Jan 2014 18:02:29 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:02:29 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:02:29 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:02:29 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:02:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:02:33 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:02:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:02:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:02:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:02:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:02:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:02:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:02:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:02:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43840033
Fri 17 Jan 2014 18:02:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:02:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43840033
Fri 17 Jan 2014 18:02:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:02:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:02:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:02:44 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:02:44 - job_xml_thread(): Done retrieving: data size 43840033
Fri 17 Jan 2014 18:02:44 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:02:44 - XML: Start document: iteration 5
Fri 17 Jan 2014 18:02:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:02:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:02:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:02:52 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:02:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:02:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:02:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:02:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:02:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:02:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:02:53 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:02:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:02:56 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:02:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:02:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:02:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:02:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:02:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:02:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:03:00 - XML: Processed 655396 elements - found 595 jobs
Fri 17 Jan 2014 18:03:00 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:03:00 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:03:00 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:03:00 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:03:00 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:03:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 18:03:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:03:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:03:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43829361
Fri 17 Jan 2014 18:03:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:03:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43829361
Fri 17 Jan 2014 18:03:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:03:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:03:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:03:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:03:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:03:15 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:03:15 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:03:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:03:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:03:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:03:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:03:16 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:03:16 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:03:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:03:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:03:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:03:18 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:03:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:03:18 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:03:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 18:03:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 18:03:18 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:03:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:03:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5888 values 93085 bits 11635 bytes 
Fri 17 Jan 2014 18:03:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:03:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:03:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:03:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:03:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:03:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:03:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:03:20 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 18:03:20 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 18:03:20 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:03:21 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:03:21 - job_xml_thread(): Done retrieving: data size 43838177
Fri 17 Jan 2014 18:03:21 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:03:21 - XML: Start document: iteration 6
Fri 17 Jan 2014 18:03:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43838177
Fri 17 Jan 2014 18:03:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:03:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43838177
Fri 17 Jan 2014 18:03:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:03:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:03:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:03:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:03:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:03:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:03:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:03:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:03:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:03:39 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:03:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:03:39 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:03:39 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:03:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:03:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:03:44 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:03:44 - XML: Processed 655396 elements - found 595 jobs
Fri 17 Jan 2014 18:03:44 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:03:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:03:44 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:03:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:03:44 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:03:44 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:03:44 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:03:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 18:03:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:03:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:03:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:03:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:03:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:03:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:03:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43830893
Fri 17 Jan 2014 18:03:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:03:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43830893
Fri 17 Jan 2014 18:03:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:03:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:03:54 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:03:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:03:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:03:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:03:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:03:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:03:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:03:56 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:03:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:03:59 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:03:59 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:04:00 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:04:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:04:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43842701
Fri 17 Jan 2014 18:04:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:04:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:04:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:04:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:04:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43842701
Fri 17 Jan 2014 18:04:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:04:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:04:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:04:01 - job_xml_thread(): Done retrieving: data size 43842701
Fri 17 Jan 2014 18:04:01 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:04:01 - XML: Start document: iteration 7
Fri 17 Jan 2014 18:04:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:04:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:04:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:04:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:04:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:04:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:04:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:04:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:04:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:04:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:04:14 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:04:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:04:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:04:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:04:19 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:04:19 - XML: Processed 655396 elements - found 595 jobs
Fri 17 Jan 2014 18:04:19 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:04:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:04:19 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:04:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 18:04:19 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:04:19 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:04:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 18:04:19 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:04:19 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:04:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8793 values 138744 bits 17343 bytes 
Fri 17 Jan 2014 18:04:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:04:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:04:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:04:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:04:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:04:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:04:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:04:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:04:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:04:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43834668
Fri 17 Jan 2014 18:04:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:04:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43834668
Fri 17 Jan 2014 18:04:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:04:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:04:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:04:34 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:04:34 - job_xml_thread(): Done retrieving: data size 43834668
Fri 17 Jan 2014 18:04:34 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:04:34 - XML: Start document: iteration 8
Fri 17 Jan 2014 18:04:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:04:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:04:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:04:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:04:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:04:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:04:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:04:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:04:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:04:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:04:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:04:45 - XML: Processed 655396 elements - found 595 jobs
Fri 17 Jan 2014 18:04:45 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:04:45 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:04:45 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:04:45 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:04:47 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:04:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 18:04:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:04:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:04:48 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:04:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:04:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:04:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:04:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:04:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:04:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:04:50 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:04:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43825202
Fri 17 Jan 2014 18:04:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:04:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43825202
Fri 17 Jan 2014 18:04:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:04:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:04:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:04:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:04:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:05:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:05:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:05:01 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:05:01 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:05:01 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:05:01 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:05:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:05:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:05:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:05:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:05:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:05:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:05:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:05:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:05:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:05:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:05:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:05:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:05:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:05:05 - job_xml_thread(): Done retrieving: data size 43860676
Fri 17 Jan 2014 18:05:05 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:05:05 - XML: Start document: iteration 9
Fri 17 Jan 2014 18:05:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43860676
Fri 17 Jan 2014 18:05:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43860676
Fri 17 Jan 2014 18:05:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:05:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:05:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:05:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:05:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:05:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:05:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:05:19 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:05:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:05:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 18:05:20 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:05:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 18:05:20 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:05:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8869 values 139924 bits 17490 bytes 
Fri 17 Jan 2014 18:05:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:05:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:05:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:05:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:05:23 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:05:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:05:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:05:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:05:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:05:27 - XML: Processed 655396 elements - found 595 jobs
Fri 17 Jan 2014 18:05:27 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:05:28 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:05:28 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:05:28 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:05:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:05:30 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:05:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:05:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:05:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:05:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:05:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:05:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:05:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:05:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43756726
Fri 17 Jan 2014 18:05:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:05:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43756726
Fri 17 Jan 2014 18:05:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:05:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:05:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:05:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:05:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:05:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:05:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:05:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:05:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:05:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:05:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:05:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43756726
Fri 17 Jan 2014 18:05:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:05:43 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:05:43 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:05:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:05:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:05:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:05:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:05:51 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:05:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 18:05:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:05:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:05:53 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:05:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:05:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:05:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:05:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:05:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:05:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:05:55 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:05:55 - job_xml_thread(): Done retrieving: data size 43226566
Fri 17 Jan 2014 18:05:55 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:05:55 - XML: Start document: iteration 10
Fri 17 Jan 2014 18:05:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43226566
Fri 17 Jan 2014 18:05:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:05:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:05:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:05:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:05:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:05:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43226566
Fri 17 Jan 2014 18:05:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:05:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:05:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:06:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:06:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:06:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:06:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:06:13 - XML: Processed 647884 elements - found 595 jobs
Fri 17 Jan 2014 18:06:13 - job 7348390 appears to have finished
Fri 17 Jan 2014 18:06:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:06:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:06:13 - job 7348293 appears to have finished
Fri 17 Jan 2014 18:06:13 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 18:06:13 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 18:06:14 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:06:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:06:14 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:06:14 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:06:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:06:14 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 18:06:14 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:06:14 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:06:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:06:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:06:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:06:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:06:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:06:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:06:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:06:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:06:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:06:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43254973
Fri 17 Jan 2014 18:06:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:06:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43254973
Fri 17 Jan 2014 18:06:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:06:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:06:21 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:06:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:06:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 18:06:23 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:06:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9233 values 145654 bits 18206 bytes 
Fri 17 Jan 2014 18:06:23 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:06:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 18:06:29 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:06:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:06:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:06:29 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:06:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:06:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:06:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:06:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:06:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:06:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:06:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:06:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:06:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:06:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:06:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:06:35 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:06:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:06:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:06:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:06:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:06:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:06:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:06:37 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:06:37 - job_xml_thread(): Done retrieving: data size 43466496
Fri 17 Jan 2014 18:06:37 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:06:37 - XML: Start document: iteration 11
Fri 17 Jan 2014 18:06:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43466496
Fri 17 Jan 2014 18:06:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:06:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43466496
Fri 17 Jan 2014 18:06:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:06:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:06:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:06:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:06:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:06:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:06:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:06:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:06:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:06:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:06:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:06:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:06:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:06:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:07:00 - XML: Processed 650644 elements - found 595 jobs
Fri 17 Jan 2014 18:07:00 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:07:00 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:07:00 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:07:00 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:07:01 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 18:07:01 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:07:01 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:07:01 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 18:07:01 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 18:07:01 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:07:01 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 18:07:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:07:01 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:07:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:07:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:07:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:07:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:07:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:07:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:07:02 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 878075 values 13873089 bits 1734136 bytes 
Fri 17 Jan 2014 18:07:03 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:07:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 18:07:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:07:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:07:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43842033
Fri 17 Jan 2014 18:07:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43842033
Fri 17 Jan 2014 18:07:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:07:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:07:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:07:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:07:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:07:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:07:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:07:15 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:07:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:07:15 - job_xml_thread(): Done retrieving: data size 43842033
Fri 17 Jan 2014 18:07:15 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:07:15 - XML: Start document: iteration 12
Fri 17 Jan 2014 18:07:17 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:07:17 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:07:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:07:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:07:17 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:07:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:07:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:07:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:07:23 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:07:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:07:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 18:07:25 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:07:25 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:07:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5726 values 90323 bits 11290 bytes 
Fri 17 Jan 2014 18:07:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 18:07:27 - XML: Processed 655396 elements - found 595 jobs
Fri 17 Jan 2014 18:07:27 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:07:27 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:07:27 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:07:27 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:07:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:07:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:07:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:07:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:07:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:07:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:07:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:07:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:07:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:07:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:07:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:07:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43807970
Fri 17 Jan 2014 18:07:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:07:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43807970
Fri 17 Jan 2014 18:07:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:07:42 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:07:42 - job_xml_thread(): Done retrieving: data size 43807970
Fri 17 Jan 2014 18:07:42 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:07:42 - XML: Start document: iteration 13
Fri 17 Jan 2014 18:07:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:07:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:07:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:07:48 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:07:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:07:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:07:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:07:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:07:49 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:07:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:07:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:07:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:07:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:07:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:07:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:07:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:07:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:07:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:07:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:07:57 - XML: Processed 655396 elements - found 595 jobs
Fri 17 Jan 2014 18:07:57 - job 7348465 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 18:07:57 - job 7344342 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 18:07:57 - job 7344343 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 18:07:57 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 18:07:57 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 18:07:57 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 18:07:57 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:07:57 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:07:58 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:07:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 18:07:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:08:01 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:08:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43818322
Fri 17 Jan 2014 18:08:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:08:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43818322
Fri 17 Jan 2014 18:08:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:08:01 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:08:01 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 18:08:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:08:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:08:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:08:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:08:12 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:08:12 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:08:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:08:13 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:08:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:08:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:08:14 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:08:14 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:08:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:08:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:08:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:08:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:08:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:08:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:08:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:08:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:08:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:08:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:08:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:08:20 - job_xml_thread(): Done retrieving: data size 43849934
Fri 17 Jan 2014 18:08:20 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:08:20 - XML: Start document: iteration 14
Fri 17 Jan 2014 18:08:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43849934
Fri 17 Jan 2014 18:08:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:08:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43849934
Fri 17 Jan 2014 18:08:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:08:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:08:25 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:08:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:08:26 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:08:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 18:08:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 18:08:26 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:08:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8770 values 138265 bits 17283 bytes 
Fri 17 Jan 2014 18:08:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:08:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:08:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:08:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:08:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:08:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:08:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:08:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:08:39 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:08:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:08:39 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:08:39 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:08:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:08:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:08:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:08:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:08:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:08:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:08:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:08:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:08:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:08:42 - XML: Processed 655394 elements - found 595 jobs
Fri 17 Jan 2014 18:08:42 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:08:42 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:08:42 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:08:42 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:08:46 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:08:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43841888
Fri 17 Jan 2014 18:08:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:08:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43841888
Fri 17 Jan 2014 18:08:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:08:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:08:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:08:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:08:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:08:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:08:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:08:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:08:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:08:58 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:08:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:08:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:08:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:08:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:08:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:09:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:09:03 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:09:03 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:09:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 18:09:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:09:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:09:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:09:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:09:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:09:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:09:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:09:06 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:09:06 - job_xml_thread(): Done retrieving: data size 43852011
Fri 17 Jan 2014 18:09:06 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:09:06 - XML: Start document: iteration 15
Fri 17 Jan 2014 18:09:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43852011
Fri 17 Jan 2014 18:09:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43852011
Fri 17 Jan 2014 18:09:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:09:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:09:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:09:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:09:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:09:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:09:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:09:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:09:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:09:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:09:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:09:26 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:09:27 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:09:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:09:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:09:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:09:27 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:09:27 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:09:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 18:09:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:09:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 18:09:27 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:09:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5793 values 91322 bits 11415 bytes 
Fri 17 Jan 2014 18:09:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:09:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:09:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:09:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:09:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:09:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:09:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:09:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:09:30 - XML: Processed 655396 elements - found 595 jobs
Fri 17 Jan 2014 18:09:30 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:09:30 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:09:30 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:09:30 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:09:34 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:09:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43843129
Fri 17 Jan 2014 18:09:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:09:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43843129
Fri 17 Jan 2014 18:09:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:09:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:09:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:09:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:09:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:09:45 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:09:45 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:09:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:09:46 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:09:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:09:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:09:47 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:09:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:09:47 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:09:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:09:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:09:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:09:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:09:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:09:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:09:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:09:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:09:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:09:51 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:09:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 18:09:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:09:54 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:09:54 - job_xml_thread(): Done retrieving: data size 43848370
Fri 17 Jan 2014 18:09:54 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:09:54 - XML: Start document: iteration 16
Fri 17 Jan 2014 18:09:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43848370
Fri 17 Jan 2014 18:09:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:09:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43848370
Fri 17 Jan 2014 18:09:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:10:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:10:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:10:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:10:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:10:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:10:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:10:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:10:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:10:11 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:10:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:10:11 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:10:11 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:10:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:10:15 - XML: Processed 655392 elements - found 593 jobs
Fri 17 Jan 2014 18:10:15 - job 7344337 appears to have finished
Fri 17 Jan 2014 18:10:15 - job 7344338 appears to have finished
Fri 17 Jan 2014 18:10:15 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 18:10:15 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 18:10:16 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 18:10:16 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:10:16 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:10:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:10:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:10:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:10:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:10:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:10:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:10:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:10:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:10:21 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:10:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43833275
Fri 17 Jan 2014 18:10:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:10:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43833275
Fri 17 Jan 2014 18:10:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:10:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:10:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:10:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:10:27 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:10:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:10:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 18:10:27 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:10:27 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:10:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 18:10:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8780 values 138422 bits 17302 bytes 
Fri 17 Jan 2014 18:10:31 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:10:31 - job_xml_thread(): Done retrieving: data size 43833275
Fri 17 Jan 2014 18:10:31 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:10:31 - XML: Start document: iteration 17
Fri 17 Jan 2014 18:10:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:10:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:10:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:10:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:10:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:10:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:10:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:10:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:10:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:10:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:10:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:10:44 - XML: Processed 655392 elements - found 593 jobs
Fri 17 Jan 2014 18:10:44 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:10:44 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:10:44 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:10:44 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:10:45 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 18:10:45 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 18:10:45 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:10:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:10:46 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:10:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:10:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:10:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:10:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:10:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:10:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:10:47 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:10:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43821970
Fri 17 Jan 2014 18:10:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:10:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43821970
Fri 17 Jan 2014 18:10:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:10:50 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:10:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 18:10:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:10:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:10:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:10:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:10:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:10:59 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:11:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:11:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:11:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:11:01 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:11:01 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:11:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:11:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:11:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:11:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:11:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:11:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:11:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:11:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:11:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:11:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:11:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:11:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:11:04 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:11:04 - job_xml_thread(): Done retrieving: data size 43855746
Fri 17 Jan 2014 18:11:04 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:11:04 - XML: Start document: iteration 18
Fri 17 Jan 2014 18:11:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855746
Fri 17 Jan 2014 18:11:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:11:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855746
Fri 17 Jan 2014 18:11:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:11:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:11:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:11:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:11:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:11:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:11:21 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:11:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:11:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:11:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:11:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:11:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:11:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:11:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:11:22 - XML: Processed 655392 elements - found 593 jobs
Fri 17 Jan 2014 18:11:23 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:11:23 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:11:23 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:11:23 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:11:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:11:26 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:11:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:11:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:11:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:11:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:11:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:11:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:11:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:11:28 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:11:28 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:11:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:11:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 18:11:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 18:11:28 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:11:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6128 values 96596 bits 12074 bytes 
Fri 17 Jan 2014 18:11:28 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:11:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43765004
Fri 17 Jan 2014 18:11:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:11:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43765004
Fri 17 Jan 2014 18:11:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:11:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:11:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:11:38 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:11:38 - job_xml_thread(): Done retrieving: data size 43765004
Fri 17 Jan 2014 18:11:38 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:11:38 - XML: Start document: iteration 19
Fri 17 Jan 2014 18:11:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:11:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:11:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:11:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:11:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:11:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:11:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:11:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:11:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:11:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:11:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:11:48 - XML: Processed 654629 elements - found 593 jobs
Fri 17 Jan 2014 18:11:48 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:11:48 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:11:48 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:11:48 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:11:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:11:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:11:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:11:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:11:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:11:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:11:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:11:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:11:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:11:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43219920
Fri 17 Jan 2014 18:11:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:11:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43219920
Fri 17 Jan 2014 18:11:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:11:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:11:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:12:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:12:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:12:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:12:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:12:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:12:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:12:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43219920
Fri 17 Jan 2014 18:12:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:12:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:12:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:12:03 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:12:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:12:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:12:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:12:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:12:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:12:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:12:13 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:12:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:12:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:12:14 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:12:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 18:12:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:12:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:12:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:12:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:12:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:12:15 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:12:15 - job_xml_thread(): Done retrieving: data size 43203763
Fri 17 Jan 2014 18:12:15 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:12:15 - XML: Start document: iteration 20
Fri 17 Jan 2014 18:12:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43203763
Fri 17 Jan 2014 18:12:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:12:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:12:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:12:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:12:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:12:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:12:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:12:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43203763
Fri 17 Jan 2014 18:12:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:12:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:12:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:12:28 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:12:28 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:12:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:12:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 18:12:29 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:12:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 18:12:29 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:12:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5791 values 91328 bits 11416 bytes 
Fri 17 Jan 2014 18:12:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:12:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:12:32 - XML: Processed 647836 elements - found 593 jobs
Fri 17 Jan 2014 18:12:32 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:12:32 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:12:32 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:12:32 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:12:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:12:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:12:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:12:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:12:34 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:12:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:12:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:12:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:12:36 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:12:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:12:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:12:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:12:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:12:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:12:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:12:39 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:12:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43602708
Fri 17 Jan 2014 18:12:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:12:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43602708
Fri 17 Jan 2014 18:12:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:12:47 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:12:47 - job_xml_thread(): Done retrieving: data size 43602708
Fri 17 Jan 2014 18:12:47 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:12:47 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 18:12:48 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 18:12:48 - Housekeeping: done.
Fri 17 Jan 2014 18:12:48 - XML: Start document: iteration 0
Fri 17 Jan 2014 18:12:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:12:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:12:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:12:50 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:12:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:12:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:12:51 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:12:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:12:51 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:12:51 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:12:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:12:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:12:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:12:59 - XML: Processed 652032 elements - found 593 jobs
Fri 17 Jan 2014 18:12:59 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:12:59 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:12:59 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:12:59 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:13:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:13:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:13:02 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:13:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 18:13:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:13:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:13:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:13:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:13:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:13:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:13:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:13:04 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:13:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43818852
Fri 17 Jan 2014 18:13:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:13:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43818852
Fri 17 Jan 2014 18:13:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:13:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:13:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:13:14 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:13:14 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:13:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:13:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:13:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:13:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:13:16 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:13:16 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:13:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:13:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:13:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:13:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:13:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:13:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:13:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:13:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:13:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:13:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:13:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:13:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:13:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:13:20 - job_xml_thread(): Done retrieving: data size 43841334
Fri 17 Jan 2014 18:13:20 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:13:20 - XML: Start document: iteration 1
Fri 17 Jan 2014 18:13:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43841334
Fri 17 Jan 2014 18:13:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:13:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43841334
Fri 17 Jan 2014 18:13:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:13:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:13:29 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:13:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:13:30 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:13:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 18:13:30 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:13:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 18:13:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8972 values 141507 bits 17688 bytes 
Fri 17 Jan 2014 18:13:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:13:31 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:13:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:13:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:13:32 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:13:32 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:13:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:13:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:13:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:13:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:13:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:13:39 - XML: Processed 655392 elements - found 593 jobs
Fri 17 Jan 2014 18:13:39 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:13:39 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:13:39 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:13:39 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:13:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:13:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:13:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:13:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:13:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:13:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:13:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:13:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:13:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:13:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43840216
Fri 17 Jan 2014 18:13:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:13:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43840216
Fri 17 Jan 2014 18:13:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:13:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:13:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:13:54 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:13:54 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:13:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:13:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:13:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:13:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:13:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:13:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:13:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:13:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:13:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:13:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:13:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:13:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:13:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:13:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:13:59 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:13:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 18:13:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:13:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:13:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:13:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:13:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:14:00 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:14:00 - job_xml_thread(): Done retrieving: data size 43838175
Fri 17 Jan 2014 18:14:00 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:14:00 - XML: Start document: iteration 2
Fri 17 Jan 2014 18:14:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43838175
Fri 17 Jan 2014 18:14:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43838175
Fri 17 Jan 2014 18:14:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:14:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:14:02 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 18:14:02 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:14:04 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:14:04 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:14:04 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 18:14:05 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 18:14:05 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 18:14:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:14:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:14:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:14:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:14:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:14:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:14:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:14:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:14:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:14:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:14:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:14:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:14:21 - size of cluster 'LISA Cluster': 624 hosts 79486 metrics 859301 values 13560597 bits 1695074 bytes 
Fri 17 Jan 2014 18:14:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:14:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:14:21 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:14:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:14:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:14:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:14:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:14:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:14:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:14:23 - XML: Processed 655392 elements - found 593 jobs
Fri 17 Jan 2014 18:14:23 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:14:23 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:14:23 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:14:23 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:14:26 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:14:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862285
Fri 17 Jan 2014 18:14:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:14:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862285
Fri 17 Jan 2014 18:14:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:14:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:14:31 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:14:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:14:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 18:14:32 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:14:32 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:14:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 18:14:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8869 values 139853 bits 17481 bytes 
Fri 17 Jan 2014 18:14:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:14:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:14:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:14:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:14:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:14:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:14:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:14:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:14:38 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:14:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:14:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:14:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:14:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:14:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:14:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:14:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:14:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:14:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:14:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:14:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:14:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:14:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43861761
Fri 17 Jan 2014 18:14:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:14:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43861761
Fri 17 Jan 2014 18:14:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:14:44 - job_xml_thread(): Done retrieving: data size 43861761
Fri 17 Jan 2014 18:14:44 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:14:44 - XML: Start document: iteration 3
Fri 17 Jan 2014 18:14:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:14:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:14:53 - XML: Processed 655392 elements - found 593 jobs
Fri 17 Jan 2014 18:14:53 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:14:53 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:14:54 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:14:54 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:14:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:14:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:15:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:15:00 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:15:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:15:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:15:01 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:15:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:15:01 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:15:01 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:15:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:15:02 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:15:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 18:15:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:15:04 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:15:04 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 18:15:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:15:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:15:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:15:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:15:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:15:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:15:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:15:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:15:08 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:15:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43848675
Fri 17 Jan 2014 18:15:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:15:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43848675
Fri 17 Jan 2014 18:15:09 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:15:09 - job_xml_thread(): Done retrieving: data size 43848675
Fri 17 Jan 2014 18:15:09 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:15:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:15:09 - XML: Start document: iteration 4
Fri 17 Jan 2014 18:15:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:15:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:15:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:15:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:15:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:15:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:15:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:15:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:15:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:15:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:15:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:15:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:15:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:15:30 - XML: Processed 655392 elements - found 593 jobs
Fri 17 Jan 2014 18:15:31 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:15:31 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:15:31 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:15:31 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:15:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:15:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:15:32 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:15:32 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:15:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:15:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:15:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:15:33 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:15:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 18:15:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 18:15:33 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:15:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6055 values 95518 bits 11939 bytes 
Fri 17 Jan 2014 18:15:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:15:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:15:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:15:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:15:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:15:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43833923
Fri 17 Jan 2014 18:15:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:15:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43833923
Fri 17 Jan 2014 18:15:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:15:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:15:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:15:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:15:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:15:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:15:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:15:45 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:15:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:15:45 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:15:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43833923
Fri 17 Jan 2014 18:15:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:15:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:15:46 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:15:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:15:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:15:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:15:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:15:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:15:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:15:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:15:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:15:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:15:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:15:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:15:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:15:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:15:58 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:15:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 18:15:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:16:00 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:16:00 - job_xml_thread(): Done retrieving: data size 43822486
Fri 17 Jan 2014 18:16:00 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:16:00 - XML: Start document: iteration 5
Fri 17 Jan 2014 18:16:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:16:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:16:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43822486
Fri 17 Jan 2014 18:16:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:16:01 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:16:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:16:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:16:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:16:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43822486
Fri 17 Jan 2014 18:16:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:16:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:16:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:16:16 - XML: Processed 655386 elements - found 590 jobs
Fri 17 Jan 2014 18:16:16 - job 7348333 appears to have finished
Fri 17 Jan 2014 18:16:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:16:16 - job 7348325 appears to have finished
Fri 17 Jan 2014 18:16:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:16:17 - job 7348465 appears to have finished
Fri 17 Jan 2014 18:16:17 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 18:16:17 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 18:16:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:16:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:16:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:16:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:16:17 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:16:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:16:17 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:16:17 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:16:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:16:17 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 18:16:17 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:16:17 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:16:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:16:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:16:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:16:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:16:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:16:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:16:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:16:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:16:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:16:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856460
Fri 17 Jan 2014 18:16:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:16:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43856460
Fri 17 Jan 2014 18:16:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:16:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:16:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:16:32 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:16:32 - job_xml_thread(): Done retrieving: data size 43856460
Fri 17 Jan 2014 18:16:32 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:16:32 - XML: Start document: iteration 6
Fri 17 Jan 2014 18:16:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:16:33 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:16:34 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:16:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:16:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 18:16:34 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:16:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 18:16:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8291 values 130884 bits 16360 bytes 
Fri 17 Jan 2014 18:16:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:16:36 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:16:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:16:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:16:37 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:16:37 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:16:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:16:37 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:16:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:16:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:16:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:16:46 - XML: Processed 655386 elements - found 590 jobs
Fri 17 Jan 2014 18:16:46 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:16:46 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:16:46 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:16:46 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:16:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:16:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:16:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:16:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:16:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:16:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:16:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:16:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:16:50 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:16:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43827268
Fri 17 Jan 2014 18:16:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:16:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43827268
Fri 17 Jan 2014 18:16:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:16:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:16:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:17:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:17:00 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:17:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:17:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:17:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:17:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:17:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:17:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:17:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:17:01 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:17:02 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:17:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 18:17:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:17:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:17:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:17:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:17:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:17:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:17:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:17:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:17:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:17:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:17:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:17:07 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:17:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43859557
Fri 17 Jan 2014 18:17:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:17:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43859557
Fri 17 Jan 2014 18:17:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:17:08 - job_xml_thread(): Done retrieving: data size 43859557
Fri 17 Jan 2014 18:17:08 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:17:08 - XML: Start document: iteration 7
Fri 17 Jan 2014 18:17:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:17:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:17:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:17:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:17:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:17:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:17:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:17:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:17:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:17:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:17:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:17:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:17:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:17:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:17:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:17:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:17:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:17:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:17:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:17:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:17:31 - XML: Processed 655386 elements - found 590 jobs
Fri 17 Jan 2014 18:17:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:17:31 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:17:31 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:17:31 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:17:31 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:17:32 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 18:17:32 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 18:17:32 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:17:33 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:17:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43780487
Fri 17 Jan 2014 18:17:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:17:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43780487
Fri 17 Jan 2014 18:17:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:17:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:17:34 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:17:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:17:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:17:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:17:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 18:17:37 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:17:37 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:17:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 18:17:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8778 values 138827 bits 17353 bytes 
Fri 17 Jan 2014 18:17:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:17:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:17:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:17:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:17:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:17:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:17:44 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:17:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:17:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:17:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:17:46 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:17:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:17:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:17:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:17:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:17:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:17:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:17:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:17:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:17:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:17:50 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:17:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43251055
Fri 17 Jan 2014 18:17:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:17:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43251055
Fri 17 Jan 2014 18:17:51 - job_xml_thread(): Done retrieving: data size 43251055
Fri 17 Jan 2014 18:17:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:17:51 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:17:51 - XML: Start document: iteration 8
Fri 17 Jan 2014 18:17:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:17:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:18:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:18:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:18:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:18:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:18:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:18:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:18:06 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:18:06 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:18:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:18:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:18:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:18:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:18:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:18:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:18:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:18:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:18:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:18:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:18:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:18:11 - XML: Processed 647798 elements - found 646 jobs
Fri 17 Jan 2014 18:18:11 - job 7344344 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 18:18:11 - job_xml_thread(): Found 57 updated jobs.
Fri 17 Jan 2014 18:18:11 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 18:18:12 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:18:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 18:18:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:18:12 - job_xml_thread(): Done storing. succesfully stored: 57 jobs
Fri 17 Jan 2014 18:18:12 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:18:12 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:18:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:18:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43229469
Fri 17 Jan 2014 18:18:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:18:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43229469
Fri 17 Jan 2014 18:18:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:18:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:18:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:18:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:18:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:18:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:18:25 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:18:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:18:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:18:26 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:18:26 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:18:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:18:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:18:26 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:18:27 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:18:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:18:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:18:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:18:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:18:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:18:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:18:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:18:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:18:30 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:18:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43494392
Fri 17 Jan 2014 18:18:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:18:30 - job_xml_thread(): Done retrieving: data size 43494392
Fri 17 Jan 2014 18:18:30 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:18:30 - XML: Start document: iteration 9
Fri 17 Jan 2014 18:18:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43494392
Fri 17 Jan 2014 18:18:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:18:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:18:38 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:18:39 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:18:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 18:18:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:18:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 18:18:39 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:18:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8798 values 138966 bits 17370 bytes 
Fri 17 Jan 2014 18:18:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:18:41 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:18:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:18:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:18:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:18:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:18:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:18:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:18:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:18:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:18:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:18:49 - XML: Processed 650806 elements - found 646 jobs
Fri 17 Jan 2014 18:18:49 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:18:49 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:18:49 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:18:49 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:18:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:18:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:18:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:18:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:18:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:18:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:18:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:18:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:18:53 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:18:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43810377
Fri 17 Jan 2014 18:18:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:18:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43810377
Fri 17 Jan 2014 18:18:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:18:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:18:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:19:04 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:19:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:19:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:19:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:19:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:19:08 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:19:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:19:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:19:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:19:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:19:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:19:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:19:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:19:09 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:19:09 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:19:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 18:19:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:19:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:19:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:19:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:19:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:19:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:19:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:19:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:19:11 - job_xml_thread(): Done retrieving: data size 43869541
Fri 17 Jan 2014 18:19:11 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:19:11 - XML: Start document: iteration 10
Fri 17 Jan 2014 18:19:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43869541
Fri 17 Jan 2014 18:19:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:19:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43869541
Fri 17 Jan 2014 18:19:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:19:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:19:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:19:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:19:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:19:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:19:28 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:19:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:19:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:19:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:19:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:19:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:19:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:19:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:19:31 - XML: Processed 655498 elements - found 646 jobs
Fri 17 Jan 2014 18:19:31 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:19:31 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:19:31 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:19:31 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:19:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:19:33 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:19:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:19:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:19:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:19:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:19:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:19:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:19:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:19:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43850245
Fri 17 Jan 2014 18:19:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:19:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43850245
Fri 17 Jan 2014 18:19:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:19:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:19:39 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:19:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:19:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 18:19:41 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:19:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 18:19:41 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:19:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8933 values 140924 bits 17615 bytes 
Fri 17 Jan 2014 18:19:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:19:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:19:46 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:19:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:19:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:19:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:19:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:19:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:19:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:19:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:19:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:19:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:19:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:19:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:19:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:19:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:19:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:19:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:19:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:19:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:19:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:19:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:19:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:19:52 - job_xml_thread(): Done retrieving: data size 43869397
Fri 17 Jan 2014 18:19:52 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:19:52 - XML: Start document: iteration 11
Fri 17 Jan 2014 18:19:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43869397
Fri 17 Jan 2014 18:19:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43869397
Fri 17 Jan 2014 18:19:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:19:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:20:02 - XML: Processed 655497 elements - found 646 jobs
Fri 17 Jan 2014 18:20:03 - job 7348482 field 'start_timestamp' changed since saved from: 1389979057 to: 1389979005
Fri 17 Jan 2014 18:20:03 - job 7348490 field 'start_timestamp' changed since saved from: 1389979073 to: 1389979005
Fri 17 Jan 2014 18:20:03 - job 7348496 field 'start_timestamp' changed since saved from: 1389979085 to: 1389979005
Fri 17 Jan 2014 18:20:03 - job 7348497 field 'start_timestamp' changed since saved from: 1389979087 to: 1389979005
Fri 17 Jan 2014 18:20:03 - job 7348495 field 'start_timestamp' changed since saved from: 1389979083 to: 1389979005
Fri 17 Jan 2014 18:20:03 - job 7348498 field 'start_timestamp' changed since saved from: 1389979044 to: 1389979005
Fri 17 Jan 2014 18:20:03 - job 7348499 field 'start_timestamp' changed since saved from: 1389979046 to: 1389979005
Fri 17 Jan 2014 18:20:03 - job 7348511 field 'start_timestamp' changed since saved from: 1389979070 to: 1389979005
Fri 17 Jan 2014 18:20:03 - job 7348475 field 'start_timestamp' changed since saved from: 1389979088 to: 1389979004
Fri 17 Jan 2014 18:20:03 - job 7348505 field 'start_timestamp' changed since saved from: 1389979058 to: 1389979005
Fri 17 Jan 2014 18:20:03 - job 7348506 field 'start_timestamp' changed since saved from: 1389979060 to: 1389979005
Fri 17 Jan 2014 18:20:03 - job 7348507 field 'start_timestamp' changed since saved from: 1389979062 to: 1389979005
Fri 17 Jan 2014 18:20:03 - job 7348500 field 'start_timestamp' changed since saved from: 1389979048 to: 1389979005
Fri 17 Jan 2014 18:20:03 - job 7348501 field 'start_timestamp' changed since saved from: 1389979050 to: 1389979005
Fri 17 Jan 2014 18:20:03 - job 7348502 field 'start_timestamp' changed since saved from: 1389979052 to: 1389979005
Fri 17 Jan 2014 18:20:03 - job 7348503 field 'start_timestamp' changed since saved from: 1389979054 to: 1389979005
Fri 17 Jan 2014 18:20:03 - job 7348509 field 'start_timestamp' changed since saved from: 1389979066 to: 1389979005
Fri 17 Jan 2014 18:20:03 - job 7344339 appears to have finished
Fri 17 Jan 2014 18:20:03 - job_xml_thread(): Found 19 updated jobs.
Fri 17 Jan 2014 18:20:03 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 18:20:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:20:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:20:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:20:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:20:11 - job_xml_thread(): Done storing. succesfully stored: 19 jobs
Fri 17 Jan 2014 18:20:11 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:20:11 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:20:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:20:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:20:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:20:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:20:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:20:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:20:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:20:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:20:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:20:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:20:15 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:20:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:20:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:20:15 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:20:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 18:20:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:20:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:20:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:20:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:20:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:20:17 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:20:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43860258
Fri 17 Jan 2014 18:20:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:20:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43860258
Fri 17 Jan 2014 18:20:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:20:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:20:25 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:20:26 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:20:26 - job_xml_thread(): Done retrieving: data size 43860258
Fri 17 Jan 2014 18:20:26 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:20:27 - XML: Start document: iteration 12
Fri 17 Jan 2014 18:20:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:20:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:20:29 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:20:29 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:20:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:20:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:20:29 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:20:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:20:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:20:38 - XML: Processed 655498 elements - found 646 jobs
Fri 17 Jan 2014 18:20:38 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:20:38 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:20:38 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:20:39 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:20:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:20:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:20:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:20:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:20:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:20:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:20:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:20:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:20:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:20:41 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:20:41 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:20:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43857942
Fri 17 Jan 2014 18:20:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:20:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43857942
Fri 17 Jan 2014 18:20:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:20:42 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:20:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:20:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 18:20:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 18:20:42 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:20:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6419 values 101243 bits 12655 bytes 
Fri 17 Jan 2014 18:20:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:20:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:20:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:20:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:20:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:20:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:20:53 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:20:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:20:53 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:20:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:20:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:20:54 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:20:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:20:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:20:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:20:55 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:20:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:20:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:20:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:20:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:20:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:20:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:20:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:20:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43884169
Fri 17 Jan 2014 18:20:58 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:20:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:20:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 18:20:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:20:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43884169
Fri 17 Jan 2014 18:20:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:20:59 - job_xml_thread(): Done retrieving: data size 43884169
Fri 17 Jan 2014 18:21:00 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:21:00 - XML: Start document: iteration 13
Fri 17 Jan 2014 18:21:04 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 18:21:04 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:21:06 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:21:06 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 18:21:06 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 18:21:06 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:21:06 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 18:21:07 - size of cluster 'LISA Cluster': 624 hosts 79473 metrics 869359 values 13747774 bits 1718471 bytes 
Fri 17 Jan 2014 18:21:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:21:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:21:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:21:09 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:21:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:21:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:21:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:21:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:21:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:21:10 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:21:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:21:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:21:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:21:17 - XML: Processed 655498 elements - found 646 jobs
Fri 17 Jan 2014 18:21:17 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:21:17 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:21:17 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:21:17 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:21:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:21:20 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:21:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:21:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:21:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:21:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:21:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:21:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:21:23 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:21:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851636
Fri 17 Jan 2014 18:21:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:21:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851636
Fri 17 Jan 2014 18:21:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:21:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:21:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:21:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:21:31 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:21:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:21:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:21:33 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:21:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:21:33 - job_xml_thread(): Done retrieving: data size 43851636
Fri 17 Jan 2014 18:21:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:21:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:21:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:21:33 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:21:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851636
Fri 17 Jan 2014 18:21:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:21:33 - XML: Start document: iteration 14
Fri 17 Jan 2014 18:21:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:21:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:21:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:21:42 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:21:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:21:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 18:21:42 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:21:42 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:21:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 18:21:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99057 bits 12382 bytes 
Fri 17 Jan 2014 18:21:46 - XML: Processed 655498 elements - found 646 jobs
Fri 17 Jan 2014 18:21:47 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:21:47 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:21:47 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:21:47 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:21:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:21:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:21:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:21:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:21:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:21:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:21:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:21:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:21:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:21:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:21:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:21:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:21:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:21:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:21:51 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:21:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:21:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:21:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:21:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:21:55 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:21:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43883969
Fri 17 Jan 2014 18:21:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:21:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43883969
Fri 17 Jan 2014 18:21:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:21:59 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:21:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 18:21:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:22:03 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:22:03 - job_xml_thread(): Done retrieving: data size 43883969
Fri 17 Jan 2014 18:22:03 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:22:03 - XML: Start document: iteration 15
Fri 17 Jan 2014 18:22:06 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:22:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:22:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:22:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:22:07 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 18:22:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:22:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:22:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:22:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:22:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:22:11 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:22:11 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:22:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:22:11 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:22:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:22:16 - XML: Processed 655498 elements - found 646 jobs
Fri 17 Jan 2014 18:22:16 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:22:16 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:22:16 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:22:16 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:22:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:22:19 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:22:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:22:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:22:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:22:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:22:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:22:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:22:22 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:22:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855565
Fri 17 Jan 2014 18:22:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:22:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855565
Fri 17 Jan 2014 18:22:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:22:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:22:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:22:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:22:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:22:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:22:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:22:30 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:22:30 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:22:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:22:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:22:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855565
Fri 17 Jan 2014 18:22:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:22:31 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:22:31 - job_xml_thread(): Done retrieving: data size 43855565
Fri 17 Jan 2014 18:22:31 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:22:32 - XML: Start document: iteration 16
Fri 17 Jan 2014 18:22:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:22:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:22:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:22:43 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:22:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:22:43 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:22:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 18:22:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 18:22:44 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:22:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6271 values 98951 bits 12368 bytes 
Fri 17 Jan 2014 18:22:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:22:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:22:45 - XML: Processed 655498 elements - found 646 jobs
Fri 17 Jan 2014 18:22:45 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:22:45 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:22:46 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:22:46 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:22:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:22:46 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:22:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:22:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:22:47 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:22:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:22:47 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:22:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:22:47 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:22:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:22:52 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:22:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:22:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:22:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:22:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:22:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:22:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:22:56 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:22:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43872002
Fri 17 Jan 2014 18:22:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:22:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43872002
Fri 17 Jan 2014 18:22:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:23:01 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:23:01 - job_xml_thread(): Done retrieving: data size 43872002
Fri 17 Jan 2014 18:23:01 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:23:01 - XML: Start document: iteration 17
Fri 17 Jan 2014 18:23:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:23:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:23:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:23:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:23:14 - XML: Processed 655498 elements - found 646 jobs
Fri 17 Jan 2014 18:23:14 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:23:14 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:23:14 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:23:14 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:23:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:23:16 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:23:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:23:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:23:17 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:23:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:23:17 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:23:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:23:17 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:23:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:23:20 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:23:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:23:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:23:20 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:23:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 18:23:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:23:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:23:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:23:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:23:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:23:23 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:23:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43810543
Fri 17 Jan 2014 18:23:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:23:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43810543
Fri 17 Jan 2014 18:23:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:23:29 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:23:29 - job_xml_thread(): Done retrieving: data size 43810543
Fri 17 Jan 2014 18:23:29 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:23:29 - XML: Start document: iteration 18
Fri 17 Jan 2014 18:23:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:23:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:23:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:23:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:23:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:23:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:23:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:23:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:23:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:23:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:23:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:23:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:23:39 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:23:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:23:44 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:23:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:23:44 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:23:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 18:23:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 18:23:44 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:23:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5855 values 92361 bits 11545 bytes 
Fri 17 Jan 2014 18:23:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:23:44 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:23:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:23:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:23:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:23:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:23:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:23:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:23:45 - XML: Processed 654750 elements - found 646 jobs
Fri 17 Jan 2014 18:23:45 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:23:45 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:23:45 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:23:45 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:23:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:23:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43234401
Fri 17 Jan 2014 18:23:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:23:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43234401
Fri 17 Jan 2014 18:23:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:23:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:23:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:24:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:24:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:24:00 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:24:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:24:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:24:03 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:24:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:24:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:24:04 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:24:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:24:04 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:24:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:24:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:24:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:24:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:24:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:24:06 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:24:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 18:24:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:24:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:24:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:24:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:24:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:24:09 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:24:09 - job_xml_thread(): Done retrieving: data size 43199549
Fri 17 Jan 2014 18:24:09 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:24:09 - XML: Start document: iteration 19
Fri 17 Jan 2014 18:24:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43199549
Fri 17 Jan 2014 18:24:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43199549
Fri 17 Jan 2014 18:24:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:24:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:24:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:24:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:24:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:24:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:24:22 - XML: Processed 647298 elements - found 646 jobs
Fri 17 Jan 2014 18:24:22 - job 7348459 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 18:24:22 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 18:24:22 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 18:24:24 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 18:24:24 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:24:24 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:24:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:24:27 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:24:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:24:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:24:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:24:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:24:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:24:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:24:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:24:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:24:31 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:24:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:24:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:24:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:24:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:24:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:24:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:24:34 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:24:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43657432
Fri 17 Jan 2014 18:24:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:24:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43657432
Fri 17 Jan 2014 18:24:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:24:39 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:24:39 - job_xml_thread(): Done retrieving: data size 43657432
Fri 17 Jan 2014 18:24:39 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:24:39 - XML: Start document: iteration 20
Fri 17 Jan 2014 18:24:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:24:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:24:44 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:24:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:24:45 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:24:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:24:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 18:24:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 18:24:45 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:24:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:24:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8608 values 135733 bits 16966 bytes 
Fri 17 Jan 2014 18:24:45 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:24:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:24:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:24:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:24:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:24:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:24:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:24:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:24:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:24:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:24:57 - XML: Processed 652920 elements - found 646 jobs
Fri 17 Jan 2014 18:24:57 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:24:57 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:24:57 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:24:57 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:24:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:24:59 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:24:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:24:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:24:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:24:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:24:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:24:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:25:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:25:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:25:01 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:25:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 18:25:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:25:01 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:25:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43821884
Fri 17 Jan 2014 18:25:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:25:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43821884
Fri 17 Jan 2014 18:25:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:25:12 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:25:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:25:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:25:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:25:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:25:16 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:25:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:25:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:25:16 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:25:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:25:16 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:25:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:25:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:25:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:25:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:25:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:25:18 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 18:25:18 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 18:25:18 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:25:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:25:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:25:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:25:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:25:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:25:20 - job_xml_thread(): Done retrieving: data size 43857417
Fri 17 Jan 2014 18:25:20 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:25:20 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 18:25:20 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 18:25:20 - Housekeeping: done.
Fri 17 Jan 2014 18:25:20 - XML: Start document: iteration 0
Fri 17 Jan 2014 18:25:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43857417
Fri 17 Jan 2014 18:25:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:25:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43857417
Fri 17 Jan 2014 18:25:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:25:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:25:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:25:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:25:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:25:35 - XML: Processed 655498 elements - found 646 jobs
Fri 17 Jan 2014 18:25:35 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:25:35 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:25:35 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:25:35 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:25:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:25:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:25:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:25:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:25:39 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:25:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:25:39 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:25:39 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:25:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:25:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:25:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:25:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:25:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:25:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:25:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:25:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:25:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:25:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:25:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43854182
Fri 17 Jan 2014 18:25:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:25:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43854182
Fri 17 Jan 2014 18:25:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:25:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:25:45 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:25:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:25:46 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:25:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 18:25:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 18:25:46 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:25:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148596 bits 18574 bytes 
Fri 17 Jan 2014 18:25:50 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:25:50 - job_xml_thread(): Done retrieving: data size 43854182
Fri 17 Jan 2014 18:25:50 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:25:51 - XML: Start document: iteration 1
Fri 17 Jan 2014 18:25:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:25:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:25:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:25:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:25:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:25:58 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:25:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:25:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:25:59 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:25:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:25:59 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:25:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:25:59 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:26:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:26:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:26:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:26:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:26:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:26:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:26:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:26:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:26:07 - XML: Processed 655492 elements - found 644 jobs
Fri 17 Jan 2014 18:26:07 - job 7348453 appears to have finished
Fri 17 Jan 2014 18:26:07 - job 7348522 appears to have finished
Fri 17 Jan 2014 18:26:07 - job 7348459 field 'start_timestamp' changed since saved from: 1389979416 to: 1389979370
Fri 17 Jan 2014 18:26:07 - job 7344345 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 18:26:07 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 18:26:07 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 18:26:07 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 18:26:07 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:26:07 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:26:09 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:26:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43861973
Fri 17 Jan 2014 18:26:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:26:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43861973
Fri 17 Jan 2014 18:26:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:26:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:26:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:26:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:26:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:26:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:26:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:26:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:26:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:26:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:26:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:26:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:26:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:26:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:26:22 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:26:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:26:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:26:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:26:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:26:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:26:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:26:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:26:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:26:23 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:26:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 18:26:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:26:24 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:26:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43883510
Fri 17 Jan 2014 18:26:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:26:24 - job_xml_thread(): Done retrieving: data size 43883510
Fri 17 Jan 2014 18:26:24 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:26:24 - XML: Start document: iteration 2
Fri 17 Jan 2014 18:26:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43883510
Fri 17 Jan 2014 18:26:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:26:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:26:34 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:26:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:26:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:26:35 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:26:35 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:26:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:26:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:26:35 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:26:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:26:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:26:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:26:46 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:26:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:26:46 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:26:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:26:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:26:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 18:26:46 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:26:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:26:46 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:26:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 18:26:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5851 values 92266 bits 11533 bytes 
Fri 17 Jan 2014 18:26:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:26:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:26:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:26:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:26:47 - XML: Processed 655494 elements - found 644 jobs
Fri 17 Jan 2014 18:26:47 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:26:47 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:26:47 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:26:47 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:26:50 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:26:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43834565
Fri 17 Jan 2014 18:26:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:26:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:26:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:26:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43834565
Fri 17 Jan 2014 18:26:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:27:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:27:00 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:27:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:27:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:27:01 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:27:01 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:27:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:27:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:27:01 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:27:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:27:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:27:03 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:27:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:27:03 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:27:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:27:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:27:03 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:27:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 18:27:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:27:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:27:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:27:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:27:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:27:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:27:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43876048
Fri 17 Jan 2014 18:27:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:27:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43876048
Fri 17 Jan 2014 18:27:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:27:06 - job_xml_thread(): Done retrieving: data size 43876048
Fri 17 Jan 2014 18:27:06 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:27:06 - XML: Start document: iteration 3
Fri 17 Jan 2014 18:27:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:27:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:27:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:27:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:27:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:27:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:27:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:27:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:27:23 - XML: Processed 655494 elements - found 644 jobs
Fri 17 Jan 2014 18:27:24 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:27:24 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:27:24 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:27:24 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:27:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:27:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:27:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:27:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:27:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:27:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:27:27 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:27:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:27:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:27:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:27:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:27:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:27:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:27:29 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:27:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870033
Fri 17 Jan 2014 18:27:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:27:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870033
Fri 17 Jan 2014 18:27:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:27:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:27:38 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:27:39 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:27:39 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:27:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:27:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:27:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:27:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:27:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:27:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:27:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:27:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:27:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:27:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:27:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:27:43 - job_xml_thread(): Done retrieving: data size 43870160
Fri 17 Jan 2014 18:27:43 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:27:43 - XML: Start document: iteration 4
Fri 17 Jan 2014 18:27:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870160
Fri 17 Jan 2014 18:27:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:27:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:27:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:27:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:27:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:27:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870160
Fri 17 Jan 2014 18:27:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:27:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:27:46 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:27:47 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:27:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:27:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 18:27:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 18:27:50 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:27:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 12070 values 190353 bits 23794 bytes 
Fri 17 Jan 2014 18:27:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:27:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:27:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:27:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:27:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:27:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:27:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:27:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:28:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:28:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:28:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:28:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:28:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:28:05 - XML: Processed 655492 elements - found 643 jobs
Fri 17 Jan 2014 18:28:05 - job 7344340 appears to have finished
Fri 17 Jan 2014 18:28:05 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 18:28:06 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 18:28:06 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 18:28:06 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:28:06 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:28:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:28:06 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:28:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:28:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:28:07 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 18:28:07 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:28:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:28:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:28:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:28:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:28:07 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:28:07 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:28:07 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 18:28:07 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 18:28:07 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 18:28:08 - size of cluster 'LISA Cluster': 624 hosts 79481 metrics 832838 values 13143991 bits 1642998 bytes 
Fri 17 Jan 2014 18:28:10 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:28:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43864643
Fri 17 Jan 2014 18:28:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:28:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43864643
Fri 17 Jan 2014 18:28:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:28:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:28:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:28:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:28:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:28:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:28:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:28:20 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:28:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:28:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43864643
Fri 17 Jan 2014 18:28:20 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:28:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:28:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:28:22 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:28:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:28:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:28:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:28:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:28:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:28:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:28:33 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:28:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:28:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:28:33 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:28:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 18:28:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:28:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:28:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:28:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:28:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:28:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:28:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:28:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:28:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:28:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:28:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:28:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:28:36 - job_xml_thread(): Done retrieving: data size 43836870
Fri 17 Jan 2014 18:28:36 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:28:36 - XML: Start document: iteration 5
Fri 17 Jan 2014 18:28:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43836870
Fri 17 Jan 2014 18:28:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:28:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43836870
Fri 17 Jan 2014 18:28:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:28:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:28:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:28:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:28:49 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:28:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:28:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 18:28:50 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:28:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 18:28:50 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:28:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5759 values 90808 bits 11351 bytes 
Fri 17 Jan 2014 18:28:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:28:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:28:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:28:57 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:28:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:28:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:28:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:28:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:28:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:28:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:28:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:28:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:28:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:28:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:28:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:29:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:29:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:29:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:29:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:29:00 - XML: Processed 655487 elements - found 643 jobs
Fri 17 Jan 2014 18:29:00 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:29:00 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:29:00 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:29:00 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:29:04 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:29:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 18:29:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:29:04 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:29:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43858340
Fri 17 Jan 2014 18:29:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:29:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858340
Fri 17 Jan 2014 18:29:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:29:07 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:29:07 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 18:29:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:29:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:29:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:29:14 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:29:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:29:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:29:15 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:29:15 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:29:16 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:29:16 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:29:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:29:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:29:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:29:19 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:29:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:29:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:29:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:29:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:29:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:29:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:29:22 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:29:22 - job_xml_thread(): Done retrieving: data size 43794874
Fri 17 Jan 2014 18:29:22 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:29:22 - XML: Start document: iteration 6
Fri 17 Jan 2014 18:29:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43794874
Fri 17 Jan 2014 18:29:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:29:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43794874
Fri 17 Jan 2014 18:29:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:29:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:29:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:29:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:29:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:29:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:29:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:29:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:29:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:29:39 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:29:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:29:40 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:29:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:29:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:29:42 - XML: Processed 654744 elements - found 643 jobs
Fri 17 Jan 2014 18:29:42 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:29:42 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:29:42 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:29:42 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:29:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:29:46 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:29:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:29:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:29:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:29:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:29:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:29:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:29:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:29:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43266494
Fri 17 Jan 2014 18:29:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:29:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43266494
Fri 17 Jan 2014 18:29:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:29:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:29:50 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:29:51 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:29:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:29:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 18:29:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 18:29:51 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:29:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148570 bits 18571 bytes 
Fri 17 Jan 2014 18:29:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:29:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:29:57 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:29:57 - job_xml_thread(): Done retrieving: data size 43266494
Fri 17 Jan 2014 18:29:57 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:29:57 - XML: Start document: iteration 7
Fri 17 Jan 2014 18:30:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:30:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:30:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:30:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:30:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:30:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:30:06 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:30:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:30:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:30:06 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:30:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:30:11 - XML: Processed 648320 elements - found 643 jobs
Fri 17 Jan 2014 18:30:11 - job 7348512 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 18:30:11 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 18:30:11 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 18:30:11 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 18:30:11 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:30:11 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:30:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:30:13 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:30:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:30:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:30:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:30:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:30:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:30:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:30:17 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:30:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43223575
Fri 17 Jan 2014 18:30:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:30:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43223575
Fri 17 Jan 2014 18:30:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:30:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:30:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:30:26 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:30:26 - job_xml_thread(): Done retrieving: data size 43223575
Fri 17 Jan 2014 18:30:26 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:30:26 - XML: Start document: iteration 8
Fri 17 Jan 2014 18:30:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:30:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:30:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:30:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:30:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:30:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:30:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:30:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:30:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:30:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:30:34 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:30:38 - XML: Processed 647854 elements - found 643 jobs
Fri 17 Jan 2014 18:30:38 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:30:38 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:30:38 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:30:38 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:30:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:30:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:30:39 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:30:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 18:30:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:30:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:30:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:30:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:30:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:30:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:30:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:30:41 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:30:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43687048
Fri 17 Jan 2014 18:30:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:30:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43687048
Fri 17 Jan 2014 18:30:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:30:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:30:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:30:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:30:51 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:30:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:30:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:30:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:30:51 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:30:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 18:30:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 18:30:51 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:30:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5934 values 93628 bits 11703 bytes 
Fri 17 Jan 2014 18:30:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:30:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:30:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:30:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:30:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:30:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:30:53 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:30:53 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:30:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:30:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:30:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:30:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:30:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:30:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:30:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:30:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:30:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:30:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:31:01 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:31:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43840028
Fri 17 Jan 2014 18:31:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:31:01 - job_xml_thread(): Done retrieving: data size 43840028
Fri 17 Jan 2014 18:31:01 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:31:01 - XML: Start document: iteration 9
Fri 17 Jan 2014 18:31:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43840028
Fri 17 Jan 2014 18:31:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:31:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:31:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:31:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:31:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:31:14 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:31:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 18:31:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:31:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:31:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:31:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:31:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:31:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:31:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:31:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:31:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:31:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:31:21 - XML: Processed 655354 elements - found 643 jobs
Fri 17 Jan 2014 18:31:21 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:31:21 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:31:21 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:31:21 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:31:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:31:24 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:31:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:31:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:31:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:31:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:31:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:31:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:31:28 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:31:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43880095
Fri 17 Jan 2014 18:31:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:31:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43880095
Fri 17 Jan 2014 18:31:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:31:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:31:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:31:36 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:31:37 - job_xml_thread(): Done retrieving: data size 43880095
Fri 17 Jan 2014 18:31:37 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:31:37 - XML: Start document: iteration 10
Fri 17 Jan 2014 18:31:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:31:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:31:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:31:41 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:31:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:31:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:31:42 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:31:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:31:43 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:31:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:31:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:31:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:31:49 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:31:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:31:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:31:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:31:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:31:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:31:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:31:50 - XML: Processed 655492 elements - found 643 jobs
Fri 17 Jan 2014 18:31:50 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:31:50 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:31:50 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:31:50 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:31:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:31:51 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:31:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:31:52 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:31:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 18:31:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 18:31:52 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:31:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6008 values 94906 bits 11863 bytes 
Fri 17 Jan 2014 18:31:54 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:31:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851732
Fri 17 Jan 2014 18:31:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:31:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851732
Fri 17 Jan 2014 18:31:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:31:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:31:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:32:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:32:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:32:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:32:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:32:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:32:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:32:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:32:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:32:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851732
Fri 17 Jan 2014 18:32:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:32:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:32:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:32:05 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:32:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:32:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:32:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:32:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:32:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:32:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:32:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:32:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:32:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:32:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:32:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:32:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:32:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:32:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:32:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:32:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:32:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:32:18 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 18:32:18 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 18:32:18 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:32:19 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:32:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 18:32:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:32:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:32:19 - job_xml_thread(): Done retrieving: data size 43835841
Fri 17 Jan 2014 18:32:19 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:32:19 - XML: Start document: iteration 11
Fri 17 Jan 2014 18:32:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43835841
Fri 17 Jan 2014 18:32:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43835841
Fri 17 Jan 2014 18:32:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:32:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:32:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:32:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:32:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:32:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:32:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:32:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:32:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:32:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:32:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:32:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:32:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:32:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:32:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:32:38 - XML: Processed 655490 elements - found 642 jobs
Fri 17 Jan 2014 18:32:38 - job 7348138 appears to have finished
Fri 17 Jan 2014 18:32:38 - job 7348512 field 'start_timestamp' changed since saved from: 1389979747 to: 1389979680
Fri 17 Jan 2014 18:32:38 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 18:32:38 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 18:32:39 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 18:32:39 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:32:39 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:32:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:32:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:32:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:32:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:32:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:32:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:32:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:32:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:32:44 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:32:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43864019
Fri 17 Jan 2014 18:32:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:32:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43864019
Fri 17 Jan 2014 18:32:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:32:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:32:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:32:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:32:53 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:32:54 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:32:54 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:32:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:32:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 18:32:54 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:32:54 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:32:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 18:32:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7473 values 118191 bits 14773 bytes 
Fri 17 Jan 2014 18:32:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:32:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:32:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:32:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:32:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:32:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:32:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:32:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:32:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:32:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:32:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:32:59 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:32:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:32:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:32:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:32:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:32:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:32:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:33:01 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:33:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 18:33:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:33:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:33:02 - job_xml_thread(): Done retrieving: data size 43847821
Fri 17 Jan 2014 18:33:02 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:33:02 - XML: Start document: iteration 12
Fri 17 Jan 2014 18:33:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43847821
Fri 17 Jan 2014 18:33:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43847821
Fri 17 Jan 2014 18:33:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:33:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:33:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:33:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:33:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:33:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:33:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:33:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:33:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:33:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:33:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:33:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:33:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:33:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:33:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:33:21 - XML: Processed 655490 elements - found 642 jobs
Fri 17 Jan 2014 18:33:21 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:33:21 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:33:21 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:33:21 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:33:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:33:24 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:33:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:33:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:33:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:33:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:33:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:33:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:33:26 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:33:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43878709
Fri 17 Jan 2014 18:33:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:33:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43878709
Fri 17 Jan 2014 18:33:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:33:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:33:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:33:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:33:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:33:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:33:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:33:36 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:33:37 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:33:37 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:33:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:33:37 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:33:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:33:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:33:40 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:33:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:33:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:33:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:33:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:33:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:33:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:33:41 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:33:41 - job_xml_thread(): Done retrieving: data size 43892862
Fri 17 Jan 2014 18:33:41 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:33:41 - XML: Start document: iteration 13
Fri 17 Jan 2014 18:33:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43892862
Fri 17 Jan 2014 18:33:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:33:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43892862
Fri 17 Jan 2014 18:33:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:33:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:33:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:33:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:33:54 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:33:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:33:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 18:33:55 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:33:55 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:33:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 18:33:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148765 bits 18595 bytes 
Fri 17 Jan 2014 18:33:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:33:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:34:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:34:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:34:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:34:02 - XML: Processed 655492 elements - found 643 jobs
Fri 17 Jan 2014 18:34:02 - job 7348515 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 18:34:02 - job 7348460 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 18:34:02 - job 7348516 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 18:34:02 - job 7348514 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 18:34:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:34:02 - job 7348513 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 18:34:02 - job_xml_thread(): Found 6 updated jobs.
Fri 17 Jan 2014 18:34:03 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 18:34:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:34:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:34:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:34:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:34:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:34:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:34:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:34:05 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Fri 17 Jan 2014 18:34:05 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:34:05 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:34:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:34:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:34:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:34:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:34:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:34:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:34:07 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:34:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875564
Fri 17 Jan 2014 18:34:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:34:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875564
Fri 17 Jan 2014 18:34:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:34:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:34:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:34:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:34:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:34:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:34:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:34:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:34:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:34:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:34:20 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:34:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:34:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:34:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:34:21 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:34:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:34:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:34:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:34:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:34:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:34:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:34:22 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:34:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 18:34:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:34:23 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:34:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43881497
Fri 17 Jan 2014 18:34:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:34:23 - job_xml_thread(): Done retrieving: data size 43881497
Fri 17 Jan 2014 18:34:23 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:34:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43881497
Fri 17 Jan 2014 18:34:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:34:24 - XML: Start document: iteration 14
Fri 17 Jan 2014 18:34:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:34:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:34:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:34:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:34:35 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:34:35 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:34:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:34:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:34:35 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:34:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:34:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:34:45 - XML: Processed 655492 elements - found 643 jobs
Fri 17 Jan 2014 18:34:45 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:34:45 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:34:45 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:34:45 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:34:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:34:46 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:34:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:34:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:34:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:34:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:34:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:34:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:34:48 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:34:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43836951
Fri 17 Jan 2014 18:34:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:34:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43836951
Fri 17 Jan 2014 18:34:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:34:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:34:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:34:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:34:55 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:34:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:34:55 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:34:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 18:34:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 18:34:55 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:34:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8861 values 139795 bits 17474 bytes 
Fri 17 Jan 2014 18:34:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:34:56 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:34:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:34:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:34:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:34:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:34:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:34:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:34:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43836951
Fri 17 Jan 2014 18:34:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:35:00 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:35:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:35:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:35:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:35:07 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 18:35:07 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:35:08 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:35:08 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:35:08 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 18:35:08 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 18:35:08 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 18:35:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:35:09 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:35:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:35:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:35:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:35:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:35:11 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 798162 values 12617595 bits 1577199 bytes 
Fri 17 Jan 2014 18:35:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:35:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:35:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:35:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:35:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:35:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:35:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:35:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:35:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:35:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:35:14 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:35:14 - job_xml_thread(): Done retrieving: data size 43851686
Fri 17 Jan 2014 18:35:14 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:35:14 - XML: Start document: iteration 15
Fri 17 Jan 2014 18:35:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851686
Fri 17 Jan 2014 18:35:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:35:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851686
Fri 17 Jan 2014 18:35:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:35:18 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:35:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 18:35:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:35:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:35:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:35:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:35:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:35:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:35:29 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:35:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:35:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:35:30 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:35:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:35:30 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:35:30 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:35:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:35:33 - XML: Processed 655492 elements - found 643 jobs
Fri 17 Jan 2014 18:35:34 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:35:34 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:35:34 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:35:34 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:35:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:35:37 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:35:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:35:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:35:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:35:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:35:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:35:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:35:39 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:35:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43295860
Fri 17 Jan 2014 18:35:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:35:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43295860
Fri 17 Jan 2014 18:35:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:35:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:35:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:35:49 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:35:49 - job_xml_thread(): Done retrieving: data size 43295860
Fri 17 Jan 2014 18:35:49 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:35:49 - XML: Start document: iteration 16
Fri 17 Jan 2014 18:35:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:35:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:35:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:35:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:35:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:35:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:35:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:35:52 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:35:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:35:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:35:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:35:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:35:56 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:35:56 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:35:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 18:35:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:35:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 18:35:56 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:35:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6301 values 99395 bits 12424 bytes 
Fri 17 Jan 2014 18:35:59 - XML: Processed 648582 elements - found 641 jobs
Fri 17 Jan 2014 18:35:59 - job 7348458 appears to have finished
Fri 17 Jan 2014 18:35:59 - job 7348515 field 'start_timestamp' changed since saved from: 1389980023 to: 1389979983
Fri 17 Jan 2014 18:35:59 - job 7348460 field 'start_timestamp' changed since saved from: 1389980003 to: 1389979983
Fri 17 Jan 2014 18:35:59 - job 7348517 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 18:35:59 - job 7348518 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 18:35:59 - job 7348357 appears to have finished
Fri 17 Jan 2014 18:35:59 - job 7348349 appears to have finished
Fri 17 Jan 2014 18:35:59 - job_xml_thread(): Found 8 updated jobs.
Fri 17 Jan 2014 18:35:59 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 18:36:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:36:01 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:36:01 - job_xml_thread(): Done storing. succesfully stored: 8 jobs
Fri 17 Jan 2014 18:36:01 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:36:01 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:36:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:36:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:36:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:36:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:36:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:36:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:36:03 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:36:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43185551
Fri 17 Jan 2014 18:36:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:36:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43185551
Fri 17 Jan 2014 18:36:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:36:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:36:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:36:08 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:36:08 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 18:36:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:36:14 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:36:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:36:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:36:14 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:36:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:36:14 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:36:14 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:36:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:36:16 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:36:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:36:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:36:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:36:20 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:36:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:36:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:36:20 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:36:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 18:36:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:36:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:36:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:36:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:36:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:36:23 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:36:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43258769
Fri 17 Jan 2014 18:36:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:36:23 - job_xml_thread(): Done retrieving: data size 43258769
Fri 17 Jan 2014 18:36:23 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:36:23 - XML: Start document: iteration 17
Fri 17 Jan 2014 18:36:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43258769
Fri 17 Jan 2014 18:36:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:36:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:36:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:36:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:36:34 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:36:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:36:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:36:35 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:36:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:36:35 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:36:35 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:36:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:36:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:36:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:36:40 - XML: Processed 648036 elements - found 641 jobs
Fri 17 Jan 2014 18:36:40 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:36:40 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:36:40 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:36:40 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:36:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:36:46 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:36:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:36:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:36:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:36:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:36:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:36:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:36:48 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:36:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43770622
Fri 17 Jan 2014 18:36:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:36:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43770622
Fri 17 Jan 2014 18:36:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:36:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:36:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:36:55 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:36:55 - job_xml_thread(): Done retrieving: data size 43770622
Fri 17 Jan 2014 18:36:55 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:36:55 - XML: Start document: iteration 18
Fri 17 Jan 2014 18:36:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:36:56 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:36:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:36:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 18:36:57 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:36:57 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:36:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 18:36:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8497 values 134021 bits 16752 bytes 
Fri 17 Jan 2014 18:37:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:37:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:37:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:37:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:37:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:37:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:37:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:37:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:37:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:37:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:37:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:37:10 - XML: Processed 654606 elements - found 641 jobs
Fri 17 Jan 2014 18:37:10 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:37:10 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:37:10 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:37:10 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:37:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:37:12 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:37:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:37:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:37:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:37:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:37:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:37:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:37:15 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:37:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43852722
Fri 17 Jan 2014 18:37:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:37:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43852722
Fri 17 Jan 2014 18:37:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:37:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:37:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:37:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:37:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:37:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:37:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:37:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:37:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:37:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:37:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:37:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43852722
Fri 17 Jan 2014 18:37:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:37:25 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:37:25 - job_xml_thread(): Done retrieving: data size 43852722
Fri 17 Jan 2014 18:37:25 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:37:25 - XML: Start document: iteration 19
Fri 17 Jan 2014 18:37:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:37:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:37:29 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:37:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 18:37:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:37:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:37:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:37:42 - XML: Processed 655488 elements - found 641 jobs
Fri 17 Jan 2014 18:37:42 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:37:42 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:37:42 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:37:42 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:37:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:37:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:37:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:37:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:37:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:37:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:37:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:37:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:37:44 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:37:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:37:46 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:37:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:37:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:37:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:37:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:37:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:37:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:37:48 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:37:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43861110
Fri 17 Jan 2014 18:37:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:37:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43861110
Fri 17 Jan 2014 18:37:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:37:57 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:37:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:37:57 - job_xml_thread(): Done retrieving: data size 43861110
Fri 17 Jan 2014 18:37:57 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:37:57 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:37:57 - XML: Start document: iteration 20
Fri 17 Jan 2014 18:37:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:37:59 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:37:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 18:37:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 18:37:59 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:37:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:37:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:38:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6241 values 98493 bits 12311 bytes 
Fri 17 Jan 2014 18:38:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:38:00 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:38:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:38:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:38:01 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:38:01 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:38:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:38:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:38:01 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:38:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:38:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:38:12 - XML: Processed 655482 elements - found 638 jobs
Fri 17 Jan 2014 18:38:12 - job 7335221 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7335220 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7335223 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7335222 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7335225 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7335224 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7335227 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7335226 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7335229 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7335228 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7339776 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7341721 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7340333 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7340330 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7337749 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7337590 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7343918 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7344401 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7344400 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7344403 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7344402 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7344405 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7344404 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7344407 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7344406 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7344409 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7344408 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7343768 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7341823 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7338797 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7338790 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7344356 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7335699 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7344351 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7348450 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7348451 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7335439 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7335239 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7335232 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7335230 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7335231 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7348524 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7348523 appears to have finished
Fri 17 Jan 2014 18:38:12 - job 7348520 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7348521 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7346097 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7344382 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7339993 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7337217 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7344418 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:38:12 - job 7340781 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7344416 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:38:12 - job 7344414 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7344415 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7344412 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7344413 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7344410 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7344411 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7338953 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7344354 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7338775 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7343787 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7337863 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7335401 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7335400 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7335403 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7335402 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7335405 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7335404 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7335406 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7340337 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7335249 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7335248 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7335246 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7348255 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7337345 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7337341 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7336194 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7344419 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7339232 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7344417 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7337500 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7340310 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7336999 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7344427 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7337261 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7344645 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7341893 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7344399 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7344398 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7344016 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7344391 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7344390 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7344393 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7344392 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7344395 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7344394 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7344397 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:38:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:38:12 - job 7344396 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7338806 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7338411 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7335485 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7338343 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7348435 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7342415 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7335259 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7335250 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7335254 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7335255 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7337272 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7340972 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7345705 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7337799 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7344657 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7337400 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7344571 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7338475 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7338870 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7343952 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7344379 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7344378 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7344373 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7344372 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7344371 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7341100 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7344377 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7344376 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7344375 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7344374 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7344386 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7344387 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7344384 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7344385 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7338572 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7344383 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7344380 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7344381 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7344388 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7344389 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7348397 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7348409 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7348408 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7348407 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7335544 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7335395 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7335397 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:12 - job 7337899 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7342698 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7335260 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7339484 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7346830 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7344370 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7347335 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7336565 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7337641 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7337640 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7337643 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7337645 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7337646 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7345031 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7344434 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7344435 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7344436 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7344430 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7344431 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7344433 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7348350 appears to have finished
Fri 17 Jan 2014 18:38:13 - job 7345969 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7344368 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7344369 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7344360 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7344361 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7344362 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7344363 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7344364 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7344365 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7344366 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7344367 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7344440 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7348386 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7348387 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7348410 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7348411 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7335389 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7335576 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7335273 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7335271 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7335276 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7348452 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7335376 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7335375 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7335207 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7335206 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7335205 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7335204 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7335203 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7335202 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7339391 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7335209 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7335208 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7339156 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7348519 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7343472 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7345099 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7343632 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7343634 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7344425 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7338208 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7344422 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7344421 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7344420 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7344355 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7344426 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7344357 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7344424 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7344423 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7344350 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7344353 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7344352 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7335866 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7344359 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7344358 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7344429 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7344428 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7338514 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7340309 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7335361 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7335364 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7335365 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7348353 appears to have finished
Fri 17 Jan 2014 18:38:13 - job 7348359 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7347695 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7335214 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7335215 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7335216 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7335217 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7335210 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7335211 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7335212 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7335213 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7335218 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7335219 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7339966 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7338025 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7341063 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7345647 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7344437 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7344346 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7344347 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7344432 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7344348 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7344349 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7344438 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7344439 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7343751 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7338784 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7335903 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7342714 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7335424 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7335423 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7335422 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job 7335421 report time 1389980107 does not match current heartbeat 1389980228 : ignoring job
Fri 17 Jan 2014 18:38:13 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 18:38:13 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 18:38:13 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 18:38:13 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:38:13 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:38:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:38:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:38:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:38:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:38:16 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:38:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856261
Fri 17 Jan 2014 18:38:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:38:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:38:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:38:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43856261
Fri 17 Jan 2014 18:38:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:38:28 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:38:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:38:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:38:28 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:38:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:38:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:38:28 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:38:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 18:38:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:38:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:38:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:38:29 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:38:29 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:38:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:38:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:38:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:38:32 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:38:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:38:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:38:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:38:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:38:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:38:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:38:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:38:35 - job_xml_thread(): Done retrieving: data size 43853962
Fri 17 Jan 2014 18:38:35 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:38:35 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 18:38:35 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 18:38:35 - Housekeeping: done.
Fri 17 Jan 2014 18:38:35 - XML: Start document: iteration 0
Fri 17 Jan 2014 18:38:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853962
Fri 17 Jan 2014 18:38:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:38:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853962
Fri 17 Jan 2014 18:38:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:38:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:38:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:38:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:38:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:38:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:38:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:38:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:38:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:38:53 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:38:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:38:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:38:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:38:53 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:38:57 - XML: Processed 655482 elements - found 638 jobs
Fri 17 Jan 2014 18:38:57 - job 7348524 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 18:38:57 - job 7348520 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 18:38:57 - job 7348521 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 18:38:57 - job 7348519 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 18:38:57 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 18:38:57 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 18:38:58 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 18:38:58 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:38:58 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:38:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:38:59 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:38:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:38:59 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:38:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:38:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:38:59 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 18:38:59 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 18:38:59 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:39:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:39:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:39:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:39:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:39:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:39:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 18:39:00 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:39:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 18:39:00 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:39:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5962 values 94040 bits 11755 bytes 
Fri 17 Jan 2014 18:39:01 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:39:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43864369
Fri 17 Jan 2014 18:39:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:39:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43864369
Fri 17 Jan 2014 18:39:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:39:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:39:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:39:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:39:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:39:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:39:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:39:11 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:39:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:39:11 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:39:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:39:11 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:39:13 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:39:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:39:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:39:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:39:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:39:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:39:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:39:16 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:39:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 18:39:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:39:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:39:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:39:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:39:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:39:17 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:39:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43857466
Fri 17 Jan 2014 18:39:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:39:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43857466
Fri 17 Jan 2014 18:39:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:39:18 - job_xml_thread(): Done retrieving: data size 43857466
Fri 17 Jan 2014 18:39:18 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:39:18 - XML: Start document: iteration 1
Fri 17 Jan 2014 18:39:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:39:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:39:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:39:31 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:39:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:39:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:39:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:39:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:39:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:39:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:39:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:39:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:39:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:39:40 - XML: Processed 655482 elements - found 638 jobs
Fri 17 Jan 2014 18:39:40 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:39:40 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:39:40 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:39:40 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:39:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:39:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:39:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:39:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:39:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:39:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:39:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:39:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:39:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:39:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43859237
Fri 17 Jan 2014 18:39:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:39:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43859237
Fri 17 Jan 2014 18:39:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:39:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:39:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:39:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:39:54 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:39:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:39:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:39:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:39:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:39:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:39:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:39:55 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:39:55 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:39:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:39:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:39:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:39:57 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:39:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:39:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:39:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:39:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:39:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:39:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:39:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:39:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43880040
Fri 17 Jan 2014 18:39:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:39:59 - job_xml_thread(): Done retrieving: data size 43880040
Fri 17 Jan 2014 18:39:59 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:39:59 - XML: Start document: iteration 2
Fri 17 Jan 2014 18:39:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43880040
Fri 17 Jan 2014 18:39:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:40:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:40:00 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:40:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:40:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 18:40:03 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:40:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 11924 values 188029 bits 23503 bytes 
Fri 17 Jan 2014 18:40:03 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:40:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 18:40:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:40:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:40:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:40:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:40:17 - XML: Processed 655474 elements - found 634 jobs
Fri 17 Jan 2014 18:40:17 - job 7348405 appears to have finished
Fri 17 Jan 2014 18:40:17 - job 7348351 appears to have finished
Fri 17 Jan 2014 18:40:17 - job 7348352 appears to have finished
Fri 17 Jan 2014 18:40:17 - job 7348355 appears to have finished
Fri 17 Jan 2014 18:40:17 - job 7348354 appears to have finished
Fri 17 Jan 2014 18:40:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:40:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:40:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:40:18 - job_xml_thread(): Found 6 updated jobs.
Fri 17 Jan 2014 18:40:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:40:18 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 18:40:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:40:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:40:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:40:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:40:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:40:19 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Fri 17 Jan 2014 18:40:19 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:40:19 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:40:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:40:21 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:40:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:40:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:40:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:40:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:40:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:40:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:40:24 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:40:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43864970
Fri 17 Jan 2014 18:40:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:40:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43864970
Fri 17 Jan 2014 18:40:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:40:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:40:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:40:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:40:34 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:40:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:40:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:40:34 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:40:34 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:40:34 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:40:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 18:40:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:40:35 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:40:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:40:35 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:40:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:40:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:40:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:40:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:40:37 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:40:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:40:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:40:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:40:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:40:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:40:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:40:39 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:40:39 - job_xml_thread(): Done retrieving: data size 43869052
Fri 17 Jan 2014 18:40:39 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:40:39 - XML: Start document: iteration 3
Fri 17 Jan 2014 18:40:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43869052
Fri 17 Jan 2014 18:40:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:40:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43869052
Fri 17 Jan 2014 18:40:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:40:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:40:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:40:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:40:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:40:57 - XML: Processed 655474 elements - found 634 jobs
Fri 17 Jan 2014 18:40:57 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:40:57 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:40:57 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:40:57 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:41:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:41:01 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:41:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:41:01 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:41:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:41:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:41:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:41:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:41:01 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:41:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:41:01 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:41:01 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:41:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:41:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:41:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:41:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:41:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:41:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:41:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43877673
Fri 17 Jan 2014 18:41:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:41:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43877673
Fri 17 Jan 2014 18:41:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:41:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:41:03 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:41:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:41:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 18:41:04 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:41:04 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:41:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 18:41:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9151 values 144352 bits 18044 bytes 
Fri 17 Jan 2014 18:41:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:41:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:41:12 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:41:12 - job_xml_thread(): Done retrieving: data size 43877673
Fri 17 Jan 2014 18:41:12 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:41:12 - XML: Start document: iteration 4
Fri 17 Jan 2014 18:41:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:41:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:41:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:41:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:41:17 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:41:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:41:17 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:41:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:41:17 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:41:23 - XML: Processed 655474 elements - found 634 jobs
Fri 17 Jan 2014 18:41:23 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:41:23 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:41:23 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:41:23 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:41:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:41:24 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:41:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:41:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:41:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:41:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:41:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:41:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:41:26 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:41:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43788327
Fri 17 Jan 2014 18:41:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:41:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43788327
Fri 17 Jan 2014 18:41:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:41:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:41:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:41:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:41:38 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:41:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:41:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:41:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:41:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:41:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:41:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:41:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:41:38 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:41:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:41:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:41:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:41:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:41:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:41:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:41:41 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:41:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 18:41:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:41:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:41:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:41:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:41:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:41:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:41:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43289912
Fri 17 Jan 2014 18:41:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:41:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43289912
Fri 17 Jan 2014 18:41:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:41:44 - job_xml_thread(): Done retrieving: data size 43289912
Fri 17 Jan 2014 18:41:44 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:41:44 - XML: Start document: iteration 5
Fri 17 Jan 2014 18:41:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:41:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:41:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:41:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:41:58 - XML: Processed 648262 elements - found 629 jobs
Fri 17 Jan 2014 18:41:58 - job 7348358 appears to have finished
Fri 17 Jan 2014 18:41:58 - job 7348494 appears to have finished
Fri 17 Jan 2014 18:41:58 - job 7348466 appears to have finished
Fri 17 Jan 2014 18:41:58 - job 7348501 appears to have finished
Fri 17 Jan 2014 18:41:58 - job 7348508 appears to have finished
Fri 17 Jan 2014 18:41:58 - job_xml_thread(): Found 5 updated jobs.
Fri 17 Jan 2014 18:41:58 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 18:42:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:42:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:42:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:42:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:42:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:42:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:42:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:42:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:42:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:42:04 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Fri 17 Jan 2014 18:42:04 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:42:04 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:42:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:42:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:42:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:42:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:42:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:42:04 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:42:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:42:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:42:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:42:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:42:05 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:42:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:42:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 18:42:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 18:42:05 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:42:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5803 values 91502 bits 11437 bytes 
Fri 17 Jan 2014 18:42:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:42:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43200119
Fri 17 Jan 2014 18:42:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:42:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43200119
Fri 17 Jan 2014 18:42:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:42:08 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 18:42:08 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:42:10 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:42:10 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:42:10 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 18:42:10 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 18:42:10 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 18:42:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:42:14 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:42:15 - size of cluster 'LISA Cluster': 624 hosts 79471 metrics 805154 values 12710260 bits 1588782 bytes 
Fri 17 Jan 2014 18:42:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:42:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:42:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:42:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:42:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:42:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:42:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:42:19 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:42:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:42:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:42:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:42:20 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:42:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:42:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:42:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:42:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:42:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:42:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:42:24 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:42:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43261709
Fri 17 Jan 2014 18:42:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:42:24 - job_xml_thread(): Done retrieving: data size 43261709
Fri 17 Jan 2014 18:42:24 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:42:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43261709
Fri 17 Jan 2014 18:42:24 - XML: Start document: iteration 6
Fri 17 Jan 2014 18:42:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:42:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:42:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:42:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:42:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:42:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:42:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:42:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:42:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:42:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:42:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:42:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:42:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:42:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:42:43 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:42:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 18:42:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:42:44 - XML: Processed 648012 elements - found 629 jobs
Fri 17 Jan 2014 18:42:44 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:42:44 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:42:44 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:42:44 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:42:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:42:48 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:42:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:42:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:42:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:42:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:42:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:42:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:42:51 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:42:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43806320
Fri 17 Jan 2014 18:42:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:42:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43806320
Fri 17 Jan 2014 18:42:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:42:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:42:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:42:59 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:42:59 - job_xml_thread(): Done retrieving: data size 43806320
Fri 17 Jan 2014 18:42:59 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:42:59 - XML: Start document: iteration 7
Fri 17 Jan 2014 18:43:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:43:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:43:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:43:06 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:43:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:43:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 18:43:06 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:43:06 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:43:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 18:43:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6073 values 95800 bits 11975 bytes 
Fri 17 Jan 2014 18:43:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:43:07 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:43:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:43:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:43:08 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:43:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:43:08 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:43:08 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:43:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:43:10 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:43:10 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 18:43:11 - XML: Processed 655168 elements - found 629 jobs
Fri 17 Jan 2014 18:43:11 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:43:11 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:43:11 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:43:11 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:43:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:43:15 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:43:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:43:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:43:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:43:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:43:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:43:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:43:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:43:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43847545
Fri 17 Jan 2014 18:43:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:43:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43847545
Fri 17 Jan 2014 18:43:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:43:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:43:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:43:26 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:43:26 - job_xml_thread(): Done retrieving: data size 43847545
Fri 17 Jan 2014 18:43:26 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:43:26 - XML: Start document: iteration 8
Fri 17 Jan 2014 18:43:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:43:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:43:36 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:43:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 18:43:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:43:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:43:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:43:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:43:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:43:38 - XML: Processed 655464 elements - found 629 jobs
Fri 17 Jan 2014 18:43:38 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:43:38 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:43:38 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:43:38 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:43:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:43:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:43:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:43:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:43:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:43:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:43:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:43:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:43:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:43:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:43:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:43:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:43:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:43:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:43:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43871662
Fri 17 Jan 2014 18:43:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:43:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43871662
Fri 17 Jan 2014 18:43:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:43:53 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:43:53 - job_xml_thread(): Done retrieving: data size 43871662
Fri 17 Jan 2014 18:43:54 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:43:54 - XML: Start document: iteration 9
Fri 17 Jan 2014 18:43:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:43:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:43:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:43:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:43:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:43:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:43:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:43:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:43:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:43:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:43:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:43:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:43:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:44:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:44:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:44:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:44:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:44:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:44:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:44:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:44:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:44:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:44:06 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:44:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:44:07 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:44:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 18:44:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 18:44:07 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:44:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5956 values 93915 bits 11739 bytes 
Fri 17 Jan 2014 18:44:07 - XML: Processed 655458 elements - found 626 jobs
Fri 17 Jan 2014 18:44:07 - job 7335221 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:07 - job 7335220 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:07 - job 7335223 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:07 - job 7335222 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7335225 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7335224 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7335227 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7335226 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7335229 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7335228 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7339776 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7341721 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7340333 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7340330 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7340337 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7337749 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7337590 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7343918 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344401 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344400 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344403 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344402 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344405 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344404 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344407 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344406 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344409 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344408 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7343768 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7341823 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7338797 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7338790 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344356 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7335699 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7348452 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7348450 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7348451 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7335439 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7335239 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7335232 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7335230 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7335231 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7346097 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344382 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7339993 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7337217 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344418 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7340781 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344416 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344414 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344415 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344412 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344413 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344410 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344411 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7338953 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344354 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7338775 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7343787 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7337863 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7335401 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7335400 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7335403 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7335402 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7335405 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7335404 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7335406 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7335249 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7335248 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7335246 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7348255 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7337345 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7337341 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7336194 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344419 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7339232 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344417 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7337500 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7340310 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7336999 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344427 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7337261 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344645 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344351 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7341893 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344399 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344398 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344016 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344391 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344390 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344393 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344392 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344395 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344394 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344397 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344396 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7338806 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7338411 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7335485 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7338343 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7348435 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7342415 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7348487 appears to have finished
Fri 17 Jan 2014 18:44:08 - job 7348480 appears to have finished
Fri 17 Jan 2014 18:44:08 - job 7335259 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7335250 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7335254 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7335255 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7337272 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7340972 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7345705 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7337799 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344657 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7337400 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344571 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7338475 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7338870 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7343952 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344379 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344378 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344373 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344372 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344371 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7341100 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344377 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344376 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344375 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344374 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344386 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344387 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344384 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344385 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7338572 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344383 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344380 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344381 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344388 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344389 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7348397 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7348409 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7348408 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7348407 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7335544 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7335395 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7335397 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7337899 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7342698 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7335260 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7339484 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7346830 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344370 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7347335 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7336565 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7337641 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7337640 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7337643 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7337645 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7337646 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7345031 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344434 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344435 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344430 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344431 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344433 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7345969 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344368 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344369 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344360 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344361 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344362 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344363 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344364 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344365 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344366 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344367 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344440 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7348386 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7348387 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7348410 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7348411 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7335389 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7335576 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7335273 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7335271 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7335276 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7335376 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7335375 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7335207 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7335206 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7335205 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7335204 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7335203 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7335202 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7339391 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7335209 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7335208 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7339156 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7345099 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7343632 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7343634 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344425 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7338208 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344422 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344421 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344420 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344355 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344426 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344357 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344424 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344423 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344350 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344353 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344352 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7335866 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344359 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344358 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344429 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344428 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7338514 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7340309 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7348473 appears to have finished
Fri 17 Jan 2014 18:44:08 - job 7335361 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7335364 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7335365 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7348359 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7347695 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7335214 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7335215 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7335216 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7335217 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7335210 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7335211 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7335212 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7335213 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7335218 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7335219 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7339966 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7341063 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7345647 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344436 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344437 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344346 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344347 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344432 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344348 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344349 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344438 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7344439 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7343751 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7343472 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7338784 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7335903 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7342714 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7335424 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7335423 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7335422 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7335421 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job 7338025 report time 1389980469 does not match current heartbeat 1389980589 : ignoring job
Fri 17 Jan 2014 18:44:08 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 18:44:08 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 18:44:08 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 18:44:08 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:44:08 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:44:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:44:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43834726
Fri 17 Jan 2014 18:44:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:44:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43834726
Fri 17 Jan 2014 18:44:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:44:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:44:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:44:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:44:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:44:23 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:44:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:44:23 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:44:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 18:44:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:44:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:44:25 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:44:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:44:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:44:26 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:44:26 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:44:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:44:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:44:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:44:27 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:44:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:44:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:44:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:44:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:44:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:44:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:44:30 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:44:30 - job_xml_thread(): Done retrieving: data size 43875113
Fri 17 Jan 2014 18:44:30 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:44:30 - XML: Start document: iteration 10
Fri 17 Jan 2014 18:44:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875113
Fri 17 Jan 2014 18:44:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875113
Fri 17 Jan 2014 18:44:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:44:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:44:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:44:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:44:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:44:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:44:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:44:48 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:44:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:44:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:44:48 - XML: Processed 655460 elements - found 627 jobs
Fri 17 Jan 2014 18:44:48 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 18:44:48 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 18:44:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:44:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:44:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:44:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:44:48 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:44:49 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 18:44:49 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:44:49 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:44:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:44:53 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:44:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:44:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:44:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:44:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:44:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:44:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:44:56 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:44:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43854449
Fri 17 Jan 2014 18:44:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:44:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43854449
Fri 17 Jan 2014 18:44:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:45:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:45:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:45:04 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:45:04 - job_xml_thread(): Done retrieving: data size 43854449
Fri 17 Jan 2014 18:45:04 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:45:04 - XML: Start document: iteration 11
Fri 17 Jan 2014 18:45:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:45:07 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:45:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:45:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 18:45:08 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:45:08 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:45:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 18:45:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9163 values 144518 bits 18064 bytes 
Fri 17 Jan 2014 18:45:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:45:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:45:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:45:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:45:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:45:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:45:11 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:45:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:45:11 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:45:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:45:11 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:45:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:45:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:45:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:45:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:45:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:45:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:45:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:45:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:45:19 - XML: Processed 655460 elements - found 627 jobs
Fri 17 Jan 2014 18:45:19 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:45:19 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:45:19 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:45:19 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:45:21 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 18:45:21 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 18:45:21 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:45:22 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:45:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43831803
Fri 17 Jan 2014 18:45:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:45:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43831803
Fri 17 Jan 2014 18:45:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:45:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:45:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:45:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:45:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:45:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:45:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:45:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:45:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:45:34 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:45:34 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:45:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:45:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:45:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:45:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:45:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:45:37 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:45:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:45:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:45:37 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:45:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 18:45:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:45:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:45:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:45:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:45:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:45:38 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:45:38 - job_xml_thread(): Done retrieving: data size 43858783
Fri 17 Jan 2014 18:45:38 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:45:38 - XML: Start document: iteration 12
Fri 17 Jan 2014 18:45:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858783
Fri 17 Jan 2014 18:45:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:45:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43858783
Fri 17 Jan 2014 18:45:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:45:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:45:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:45:51 - XML: Processed 655456 elements - found 625 jobs
Fri 17 Jan 2014 18:45:51 - job 7348524 appears to have finished
Fri 17 Jan 2014 18:45:51 - job 7348356 appears to have finished
Fri 17 Jan 2014 18:45:51 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 18:45:51 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 18:45:52 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 18:45:52 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:45:52 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:45:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:45:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:45:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:45:56 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:45:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:45:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:45:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:45:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:45:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:45:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:45:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:46:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:46:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:46:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:46:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:46:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:46:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:46:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:46:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:46:01 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:46:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43903082
Fri 17 Jan 2014 18:46:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:46:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43903082
Fri 17 Jan 2014 18:46:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:46:07 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:46:07 - job_xml_thread(): Done retrieving: data size 43903082
Fri 17 Jan 2014 18:46:07 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:46:07 - XML: Start document: iteration 13
Fri 17 Jan 2014 18:46:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:46:09 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:46:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:46:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 18:46:10 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:46:10 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:46:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 18:46:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8788 values 138612 bits 17326 bytes 
Fri 17 Jan 2014 18:46:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:46:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:46:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:46:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:46:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:46:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:46:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:46:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:46:17 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:46:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:46:17 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:46:17 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:46:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:46:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:46:20 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:46:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:46:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:46:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:46:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:46:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:46:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:46:23 - XML: Processed 655551 elements - found 675 jobs
Fri 17 Jan 2014 18:46:23 - job_xml_thread(): Found 50 updated jobs.
Fri 17 Jan 2014 18:46:23 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 18:46:23 - job_xml_thread(): Done storing. succesfully stored: 50 jobs
Fri 17 Jan 2014 18:46:23 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:46:23 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:46:26 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:46:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873332
Fri 17 Jan 2014 18:46:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:46:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873332
Fri 17 Jan 2014 18:46:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:46:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:46:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:46:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:46:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:46:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:46:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:46:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:46:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:46:37 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:46:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:46:37 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:46:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:46:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:46:38 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:46:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:46:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:46:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:46:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:46:39 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:46:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 18:46:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:46:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:46:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:46:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:46:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:46:40 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:46:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43900698
Fri 17 Jan 2014 18:46:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:46:40 - job_xml_thread(): Done retrieving: data size 43900698
Fri 17 Jan 2014 18:46:40 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:46:40 - XML: Start document: iteration 14
Fri 17 Jan 2014 18:46:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43900698
Fri 17 Jan 2014 18:46:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:46:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:46:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:46:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:46:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:46:56 - XML: Processed 655556 elements - found 675 jobs
Fri 17 Jan 2014 18:46:56 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:46:56 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:46:56 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:46:56 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:47:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:47:00 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:47:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:47:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:47:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:47:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:47:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:47:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:47:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:47:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:47:01 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:47:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:47:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:47:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:47:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:47:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:47:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:47:03 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:47:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43878843
Fri 17 Jan 2014 18:47:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:47:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43878843
Fri 17 Jan 2014 18:47:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:47:11 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:47:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:47:11 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:47:11 - job_xml_thread(): Done retrieving: data size 43878843
Fri 17 Jan 2014 18:47:11 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:47:11 - XML: Start document: iteration 15
Fri 17 Jan 2014 18:47:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:47:12 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:47:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 18:47:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 18:47:12 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:47:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8943 values 141487 bits 17685 bytes 
Fri 17 Jan 2014 18:47:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:47:14 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:47:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:47:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:47:16 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:47:16 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:47:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:47:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:47:16 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:47:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:47:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:47:23 - XML: Processed 655553 elements - found 675 jobs
Fri 17 Jan 2014 18:47:23 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:47:23 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:47:23 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:47:23 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:47:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:47:26 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:47:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:47:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:47:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:47:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:47:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:47:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:47:28 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:47:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43801581
Fri 17 Jan 2014 18:47:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:47:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43801581
Fri 17 Jan 2014 18:47:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:47:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:47:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:47:39 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:47:39 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:47:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:47:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:47:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:47:42 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:47:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:47:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:47:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:47:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:47:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:47:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:47:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:47:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:47:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:47:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:47:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:47:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:47:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:47:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:47:43 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:47:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 18:47:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:47:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:47:45 - job_xml_thread(): Done retrieving: data size 43295192
Fri 17 Jan 2014 18:47:45 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:47:45 - XML: Start document: iteration 16
Fri 17 Jan 2014 18:47:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43295192
Fri 17 Jan 2014 18:47:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:47:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43295192
Fri 17 Jan 2014 18:47:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:47:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:47:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:47:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:47:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:48:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:48:01 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:48:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:48:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:48:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:48:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:48:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:48:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:48:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:48:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:48:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:48:07 - XML: Processed 648084 elements - found 675 jobs
Fri 17 Jan 2014 18:48:07 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:48:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:48:07 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:48:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:48:07 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:48:07 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:48:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:48:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:48:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:48:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:48:09 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:48:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43208470
Fri 17 Jan 2014 18:48:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:48:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43208470
Fri 17 Jan 2014 18:48:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:48:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:48:13 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:48:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:48:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 18:48:13 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:48:13 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:48:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 18:48:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8911 values 140877 bits 17609 bytes 
Fri 17 Jan 2014 18:48:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:48:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:48:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:48:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:48:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:48:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:48:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:48:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:48:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:48:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43208470
Fri 17 Jan 2014 18:48:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:48:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:48:23 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:48:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:48:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:48:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:48:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:48:28 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:48:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:48:31 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:48:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:48:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:48:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:48:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:48:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:48:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:48:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:48:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:48:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:48:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:48:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:48:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:48:34 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:48:34 - job_xml_thread(): Done retrieving: data size 43571843
Fri 17 Jan 2014 18:48:34 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:48:34 - XML: Start document: iteration 17
Fri 17 Jan 2014 18:48:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571843
Fri 17 Jan 2014 18:48:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:48:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571843
Fri 17 Jan 2014 18:48:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:48:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:48:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:48:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:48:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:48:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:48:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:48:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:48:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:48:53 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:48:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:48:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:48:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:48:53 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:48:57 - XML: Processed 652046 elements - found 676 jobs
Fri 17 Jan 2014 18:48:57 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 18:48:57 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 18:48:57 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 18:48:57 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:48:57 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:48:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:48:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:48:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:48:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:48:59 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:48:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 18:48:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:48:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:48:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:48:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:48:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:49:00 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:49:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43861311
Fri 17 Jan 2014 18:49:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:49:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43861311
Fri 17 Jan 2014 18:49:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:49:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:49:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:49:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:49:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:49:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:49:11 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 18:49:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:49:11 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:49:12 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:49:12 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:49:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:49:12 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:49:12 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:49:12 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 18:49:12 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:49:12 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 18:49:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:49:12 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 18:49:13 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:49:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:49:13 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:49:14 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:49:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 18:49:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:49:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 18:49:14 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:49:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5787 values 91330 bits 11416 bytes 
Fri 17 Jan 2014 18:49:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:49:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:49:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:49:15 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:49:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:49:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:49:16 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 920144 values 14551917 bits 1818989 bytes 
Fri 17 Jan 2014 18:49:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:49:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:49:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:49:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:49:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:49:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43864649
Fri 17 Jan 2014 18:49:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:49:20 - job_xml_thread(): Done retrieving: data size 43864649
Fri 17 Jan 2014 18:49:20 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:49:20 - XML: Start document: iteration 18
Fri 17 Jan 2014 18:49:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43864649
Fri 17 Jan 2014 18:49:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:49:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:49:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:49:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:49:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:49:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:49:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:49:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:49:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:49:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:49:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:49:34 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:49:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:49:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:49:42 - XML: Processed 655558 elements - found 676 jobs
Fri 17 Jan 2014 18:49:42 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:49:42 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:49:42 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:49:42 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:49:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:49:44 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:49:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:49:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:49:45 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:49:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 18:49:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:49:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:49:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:49:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:49:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:49:48 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:49:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43848967
Fri 17 Jan 2014 18:49:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:49:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43848967
Fri 17 Jan 2014 18:49:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:49:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:49:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:49:57 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:49:57 - job_xml_thread(): Done retrieving: data size 43848967
Fri 17 Jan 2014 18:49:57 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:49:58 - XML: Start document: iteration 19
Fri 17 Jan 2014 18:50:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:50:00 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:50:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:50:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:50:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:50:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:50:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:50:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:50:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:50:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:50:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:50:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:50:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:50:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:50:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:50:11 - XML: Processed 655555 elements - found 676 jobs
Fri 17 Jan 2014 18:50:11 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:50:11 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:50:11 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:50:11 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:50:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:50:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:50:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:50:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:50:12 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:50:12 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 18:50:14 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:50:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43869569
Fri 17 Jan 2014 18:50:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:50:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:50:14 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:50:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43869569
Fri 17 Jan 2014 18:50:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:50:16 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:50:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 18:50:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:50:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 18:50:16 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:50:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8789 values 138602 bits 17325 bytes 
Fri 17 Jan 2014 18:50:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:50:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:50:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:50:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:50:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:50:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:50:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:50:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:50:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:50:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:50:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:50:26 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:50:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:50:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:50:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:50:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:50:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:50:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:50:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:50:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:50:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:50:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:50:31 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:50:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 18:50:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:50:33 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:50:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875202
Fri 17 Jan 2014 18:50:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:50:33 - job_xml_thread(): Done retrieving: data size 43875202
Fri 17 Jan 2014 18:50:33 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:50:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875202
Fri 17 Jan 2014 18:50:33 - XML: Start document: iteration 20
Fri 17 Jan 2014 18:50:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:50:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:50:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:50:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:50:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:50:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:50:55 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:50:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:50:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:50:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:50:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:50:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:50:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:50:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:50:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:50:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:50:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:50:55 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:50:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:50:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:50:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:50:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:50:57 - XML: Processed 655558 elements - found 676 jobs
Fri 17 Jan 2014 18:50:57 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:50:57 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:50:57 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:50:57 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:51:01 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:51:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43902480
Fri 17 Jan 2014 18:51:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:51:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43902480
Fri 17 Jan 2014 18:51:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:51:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:51:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:51:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:51:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:51:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:51:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:51:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43902480
Fri 17 Jan 2014 18:51:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:51:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:51:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:51:11 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:51:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:51:12 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:51:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:51:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:51:16 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:51:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:51:17 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:51:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 18:51:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 18:51:17 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:51:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99051 bits 12381 bytes 
Fri 17 Jan 2014 18:51:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:51:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:51:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:51:24 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:51:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:51:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:51:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:51:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:51:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:51:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:51:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:51:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:51:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:51:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:51:27 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:51:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:51:28 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:51:28 - job_xml_thread(): Done retrieving: data size 43855634
Fri 17 Jan 2014 18:51:28 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:51:28 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 18:51:28 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 18:51:28 - Housekeeping: done.
Fri 17 Jan 2014 18:51:28 - XML: Start document: iteration 0
Fri 17 Jan 2014 18:51:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855634
Fri 17 Jan 2014 18:51:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:51:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855634
Fri 17 Jan 2014 18:51:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:51:31 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:51:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 18:51:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:51:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:51:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:51:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:51:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:51:46 - XML: Processed 655558 elements - found 676 jobs
Fri 17 Jan 2014 18:51:46 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:51:46 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:51:46 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:51:47 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:51:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:51:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:51:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:51:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:51:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:51:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:51:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:51:48 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:51:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:51:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:51:52 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:51:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:51:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:51:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:51:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:51:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:51:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:51:55 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:51:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43874316
Fri 17 Jan 2014 18:51:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:51:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43874316
Fri 17 Jan 2014 18:51:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:52:02 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:52:03 - job_xml_thread(): Done retrieving: data size 43874316
Fri 17 Jan 2014 18:52:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:52:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:52:03 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:52:03 - XML: Start document: iteration 1
Fri 17 Jan 2014 18:52:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:52:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:52:14 - XML: Processed 655560 elements - found 677 jobs
Fri 17 Jan 2014 18:52:14 - job 7348577 report time 1389980951 does not match current heartbeat 1389981072 : ignoring job
Fri 17 Jan 2014 18:52:14 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 18:52:14 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 18:52:14 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 18:52:14 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:52:15 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:52:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:52:17 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:52:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:52:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:52:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:52:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:52:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:52:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:52:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:52:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:52:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:52:18 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:52:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 18:52:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:52:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 18:52:18 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:52:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99058 bits 12382 bytes 
Fri 17 Jan 2014 18:52:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:52:20 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:52:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:52:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:52:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:52:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:52:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:52:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:52:24 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:52:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873793
Fri 17 Jan 2014 18:52:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:52:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873793
Fri 17 Jan 2014 18:52:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:52:31 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:52:31 - job_xml_thread(): Done retrieving: data size 43873793
Fri 17 Jan 2014 18:52:31 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:52:31 - XML: Start document: iteration 2
Fri 17 Jan 2014 18:52:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:52:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:52:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:52:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:52:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:52:36 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:52:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:52:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:52:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:52:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:52:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:52:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:52:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:52:47 - XML: Processed 655560 elements - found 677 jobs
Fri 17 Jan 2014 18:52:47 - job 7348577 report time 1389980951 does not match current heartbeat 1389981072 : ignoring job
Fri 17 Jan 2014 18:52:47 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:52:47 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:52:47 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:52:47 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:52:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:52:49 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:52:49 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:52:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 18:52:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:52:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:52:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:52:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:52:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:52:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:52:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:52:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:52:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:52:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:52:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43847011
Fri 17 Jan 2014 18:52:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:52:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43847011
Fri 17 Jan 2014 18:52:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:53:02 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:53:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:53:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:53:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:53:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:53:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:53:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:53:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:53:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:53:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:53:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:53:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:53:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:53:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:53:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:53:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:53:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:53:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:53:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:53:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:53:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:53:12 - job_xml_thread(): Done retrieving: data size 43864537
Fri 17 Jan 2014 18:53:12 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:53:12 - XML: Start document: iteration 3
Fri 17 Jan 2014 18:53:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43864537
Fri 17 Jan 2014 18:53:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:53:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43864537
Fri 17 Jan 2014 18:53:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:53:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:53:18 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:53:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:53:19 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:53:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 18:53:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 18:53:19 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:53:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8753 values 138003 bits 17250 bytes 
Fri 17 Jan 2014 18:53:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:53:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:53:23 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 18:53:23 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 18:53:23 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:53:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:53:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:53:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:53:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:53:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:53:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:53:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:53:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:53:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:53:34 - XML: Processed 655560 elements - found 677 jobs
Fri 17 Jan 2014 18:53:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:53:34 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:53:34 - job 7348577 report time 1389980951 does not match current heartbeat 1389981072 : ignoring job
Fri 17 Jan 2014 18:53:34 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:53:34 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:53:34 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:53:34 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:53:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:53:37 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:53:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:53:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:53:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:53:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:53:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:53:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:53:39 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:53:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43305215
Fri 17 Jan 2014 18:53:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:53:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43305215
Fri 17 Jan 2014 18:53:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:53:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:53:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:53:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:53:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:53:49 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:53:49 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:53:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:53:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:53:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:53:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:53:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:53:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:53:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:53:53 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:53:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:53:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:53:54 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:53:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 18:53:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:53:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:53:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:53:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:53:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:53:55 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:53:55 - job_xml_thread(): Done retrieving: data size 43227507
Fri 17 Jan 2014 18:53:55 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:53:55 - XML: Start document: iteration 4
Fri 17 Jan 2014 18:53:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43227507
Fri 17 Jan 2014 18:53:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43227507
Fri 17 Jan 2014 18:53:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:53:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:54:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:54:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:54:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:54:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:54:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:54:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:54:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:54:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:54:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:54:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:54:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:54:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:54:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:54:13 - XML: Processed 647550 elements - found 676 jobs
Fri 17 Jan 2014 18:54:14 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:54:14 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:54:14 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:54:14 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:54:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:54:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:54:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:54:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:54:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:54:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:54:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:54:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:54:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:54:19 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:54:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:54:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43270749
Fri 17 Jan 2014 18:54:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:54:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:54:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 18:54:19 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:54:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5302 values 83566 bits 10445 bytes 
Fri 17 Jan 2014 18:54:19 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:54:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 18:54:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43270749
Fri 17 Jan 2014 18:54:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:54:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:54:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:54:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:54:28 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:54:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:54:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:54:29 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:54:29 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:54:29 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:54:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:54:29 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:54:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:54:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:54:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:54:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:54:34 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:54:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:54:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:54:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:54:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:54:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:54:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:54:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:54:36 - job_xml_thread(): Done retrieving: data size 43507121
Fri 17 Jan 2014 18:54:36 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:54:36 - XML: Start document: iteration 5
Fri 17 Jan 2014 18:54:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43507121
Fri 17 Jan 2014 18:54:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:54:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43507121
Fri 17 Jan 2014 18:54:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:54:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:54:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:54:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:54:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:54:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:54:53 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:54:54 - XML: Processed 651036 elements - found 676 jobs
Fri 17 Jan 2014 18:54:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:54:54 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:54:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:54:54 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:54:54 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:54:54 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:54:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:54:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:54:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:54:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:54:55 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:54:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:54:59 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:54:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:54:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:54:59 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:54:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 18:54:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:54:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:54:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:54:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:54:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:55:01 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:55:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43880634
Fri 17 Jan 2014 18:55:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:55:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43880634
Fri 17 Jan 2014 18:55:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:55:10 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:55:10 - job_xml_thread(): Done retrieving: data size 43880634
Fri 17 Jan 2014 18:55:10 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:55:10 - XML: Start document: iteration 6
Fri 17 Jan 2014 18:55:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:55:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:55:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:55:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:55:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:55:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:55:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:55:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:55:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:55:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:55:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:55:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:55:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:55:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:55:20 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:55:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:55:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 18:55:21 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:55:21 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:55:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 18:55:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5558 values 87606 bits 10950 bytes 
Fri 17 Jan 2014 18:55:21 - XML: Processed 655462 elements - found 676 jobs
Fri 17 Jan 2014 18:55:21 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:55:21 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:55:21 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:55:21 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:55:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:55:23 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:55:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:55:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:55:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:55:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:55:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:55:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:55:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:55:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43860860
Fri 17 Jan 2014 18:55:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:55:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43860860
Fri 17 Jan 2014 18:55:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:55:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:55:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:55:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:55:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:55:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:55:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:55:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:55:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:55:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43860860
Fri 17 Jan 2014 18:55:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:55:36 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:55:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 18:55:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:55:36 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:55:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:55:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:55:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:55:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:55:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:55:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:55:46 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:55:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:55:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:55:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:55:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:55:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:55:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:55:48 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:55:48 - job_xml_thread(): Done retrieving: data size 43864755
Fri 17 Jan 2014 18:55:48 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:55:48 - XML: Start document: iteration 7
Fri 17 Jan 2014 18:55:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43864755
Fri 17 Jan 2014 18:55:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:55:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:55:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:55:50 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:55:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:55:50 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:55:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:55:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43864755
Fri 17 Jan 2014 18:55:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:56:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:56:01 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:56:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:56:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:56:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:56:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:56:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:56:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:56:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:56:05 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:56:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:56:09 - XML: Processed 655558 elements - found 676 jobs
Fri 17 Jan 2014 18:56:10 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:56:10 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:56:10 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:56:10 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:56:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:56:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:56:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:56:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:56:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:56:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:56:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:56:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:56:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:56:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43868038
Fri 17 Jan 2014 18:56:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:56:12 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 18:56:12 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:56:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43868038
Fri 17 Jan 2014 18:56:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:56:13 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:56:13 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 18:56:13 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 18:56:13 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:56:14 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Fri 17 Jan 2014 18:56:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:56:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:56:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:56:21 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:56:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:56:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 18:56:22 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:56:22 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:56:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 18:56:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9414 values 148469 bits 18558 bytes 
Fri 17 Jan 2014 18:56:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:56:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:56:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:56:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:56:23 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:56:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:56:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:56:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:56:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:56:25 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:56:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:56:26 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:56:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:56:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:56:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:56:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:56:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:56:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:56:29 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:56:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43892235
Fri 17 Jan 2014 18:56:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:56:29 - job_xml_thread(): Done retrieving: data size 43892235
Fri 17 Jan 2014 18:56:29 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:56:29 - XML: Start document: iteration 8
Fri 17 Jan 2014 18:56:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43892235
Fri 17 Jan 2014 18:56:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:56:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:56:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:56:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:56:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:56:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:56:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:56:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:56:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:56:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:56:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:56:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:56:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:56:43 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:56:51 - XML: Processed 655558 elements - found 676 jobs
Fri 17 Jan 2014 18:56:51 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:56:51 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:56:52 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:56:52 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:56:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:56:52 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:56:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:56:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:56:52 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:56:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 18:56:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:56:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:56:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:56:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:56:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:56:53 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:56:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43864688
Fri 17 Jan 2014 18:56:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:56:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43864688
Fri 17 Jan 2014 18:56:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:57:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:57:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:57:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:57:03 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:57:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:57:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:57:04 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:57:04 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:57:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:57:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:57:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:57:07 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:57:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:57:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:57:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:57:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:57:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:57:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:57:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:57:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:57:08 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:57:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43876081
Fri 17 Jan 2014 18:57:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:57:09 - job_xml_thread(): Done retrieving: data size 43876081
Fri 17 Jan 2014 18:57:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43876081
Fri 17 Jan 2014 18:57:09 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:57:09 - XML: Start document: iteration 9
Fri 17 Jan 2014 18:57:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:57:14 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:57:14 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:57:15 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:57:15 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 18:57:15 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 18:57:15 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:57:15 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 18:57:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:57:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:57:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:57:23 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:57:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:57:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:57:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:57:24 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:57:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 18:57:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 18:57:24 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:57:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8730 values 137664 bits 17208 bytes 
Fri 17 Jan 2014 18:57:24 - size of cluster 'LISA Cluster': 624 hosts 79470 metrics 844145 values 13325066 bits 1665633 bytes 
Fri 17 Jan 2014 18:57:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:57:28 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:57:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:57:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:57:29 - XML: Processed 655558 elements - found 676 jobs
Fri 17 Jan 2014 18:57:29 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:57:30 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:57:30 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:57:30 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:57:30 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:57:30 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:57:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:57:30 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:57:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:57:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:57:34 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:57:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:57:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:57:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:57:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:57:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:57:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:57:37 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:57:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43877604
Fri 17 Jan 2014 18:57:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:57:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43877604
Fri 17 Jan 2014 18:57:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:57:45 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:57:45 - job_xml_thread(): Done retrieving: data size 43877604
Fri 17 Jan 2014 18:57:45 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:57:45 - XML: Start document: iteration 10
Fri 17 Jan 2014 18:57:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:57:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:57:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:57:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:57:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:57:49 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:57:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:57:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:57:50 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:57:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:57:50 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:57:50 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:57:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:57:58 - XML: Processed 655558 elements - found 676 jobs
Fri 17 Jan 2014 18:57:58 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:57:58 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:57:58 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:57:58 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:58:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:58:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:58:02 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:58:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 18:58:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:58:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:58:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:58:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:58:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:58:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:58:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:58:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:58:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43868592
Fri 17 Jan 2014 18:58:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:58:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:58:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:58:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43868592
Fri 17 Jan 2014 18:58:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:58:14 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:58:14 - job_xml_thread(): Done retrieving: data size 43868592
Fri 17 Jan 2014 18:58:14 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:58:14 - XML: Start document: iteration 11
Fri 17 Jan 2014 18:58:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:58:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:58:15 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:58:15 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 18:58:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:58:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:58:17 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:58:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:58:17 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:58:17 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:58:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:58:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:58:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:58:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:58:24 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:58:25 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:58:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:58:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 18:58:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 18:58:25 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:58:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5729 values 90324 bits 11290 bytes 
Fri 17 Jan 2014 18:58:27 - XML: Processed 655558 elements - found 676 jobs
Fri 17 Jan 2014 18:58:27 - job 7348537 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 18:58:27 - job 7348578 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 18:58:27 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 18:58:27 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 18:58:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:58:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:58:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:58:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:58:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:58:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:58:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:58:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:58:29 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 18:58:29 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:58:29 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:58:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:58:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:58:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:58:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856205
Fri 17 Jan 2014 18:58:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:58:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43856205
Fri 17 Jan 2014 18:58:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:58:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:58:42 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:58:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:58:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:58:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:58:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:58:43 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:58:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:58:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:58:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:58:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:58:44 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:58:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:58:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:58:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:58:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:58:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:58:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:58:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:58:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:58:47 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:58:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 18:58:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:58:50 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:58:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43891119
Fri 17 Jan 2014 18:58:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:58:51 - job_xml_thread(): Done retrieving: data size 43891119
Fri 17 Jan 2014 18:58:51 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:58:51 - XML: Start document: iteration 12
Fri 17 Jan 2014 18:58:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43891119
Fri 17 Jan 2014 18:58:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:58:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:58:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:59:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:59:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:59:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:59:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:59:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:59:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:59:06 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:59:07 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:59:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:59:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:59:07 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:59:10 - XML: Processed 655558 elements - found 676 jobs
Fri 17 Jan 2014 18:59:11 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:59:11 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:59:11 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:59:11 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:59:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:59:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:59:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:59:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:59:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:59:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:59:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:59:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:59:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:59:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43796438
Fri 17 Jan 2014 18:59:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:59:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43796438
Fri 17 Jan 2014 18:59:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:59:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:59:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:59:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:59:25 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:59:26 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:59:26 - job_xml_thread(): Done retrieving: data size 43796438
Fri 17 Jan 2014 18:59:26 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:59:26 - XML: Start document: iteration 13
Fri 17 Jan 2014 18:59:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:59:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 18:59:26 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 18:59:26 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:59:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 18:59:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8579 values 135220 bits 16902 bytes 
Fri 17 Jan 2014 18:59:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:59:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:59:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 18:59:34 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 18:59:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 18:59:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 18:59:35 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:59:35 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 18:59:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 18:59:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 18:59:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 18:59:40 - XML: Processed 654810 elements - found 676 jobs
Fri 17 Jan 2014 18:59:40 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 18:59:40 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 18:59:40 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 18:59:40 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 18:59:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 18:59:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 18:59:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 18:59:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:59:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:59:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 18:59:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 18:59:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 18:59:46 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 18:59:46 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 18:59:46 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 18:59:46 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 18:59:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43269757
Fri 17 Jan 2014 18:59:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 18:59:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43269757
Fri 17 Jan 2014 18:59:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 18:59:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 18:59:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 18:59:56 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 18:59:56 - job_xml_thread(): Done retrieving: data size 43269757
Fri 17 Jan 2014 18:59:56 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 18:59:56 - XML: Start document: iteration 14
Fri 17 Jan 2014 18:59:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 18:59:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:00:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:00:01 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:00:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:00:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:00:01 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:00:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:00:01 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:00:01 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:00:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:00:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:00:08 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:00:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:00:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:00:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:00:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:00:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:00:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:00:10 - XML: Processed 648288 elements - found 676 jobs
Fri 17 Jan 2014 19:00:10 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:00:10 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:00:10 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:00:10 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:00:10 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:00:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 19:00:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:00:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:00:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43244869
Fri 17 Jan 2014 19:00:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:00:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43244869
Fri 17 Jan 2014 19:00:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:00:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:00:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:00:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:00:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:00:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:00:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:00:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:00:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:00:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:00:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:00:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:00:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:00:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:00:25 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:00:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:00:26 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:00:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:00:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:00:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:00:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:00:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:00:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:00:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:00:27 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:00:27 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:00:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:00:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 19:00:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 19:00:27 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:00:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5810 values 91613 bits 11451 bytes 
Fri 17 Jan 2014 19:00:28 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:00:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43287806
Fri 17 Jan 2014 19:00:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:00:28 - job_xml_thread(): Done retrieving: data size 43287806
Fri 17 Jan 2014 19:00:28 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:00:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43287806
Fri 17 Jan 2014 19:00:28 - XML: Start document: iteration 15
Fri 17 Jan 2014 19:00:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:00:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:00:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:00:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:00:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:00:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:00:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:00:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:00:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:00:40 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:00:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:00:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:00:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:00:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:00:49 - XML: Processed 648108 elements - found 677 jobs
Fri 17 Jan 2014 19:00:49 - job 7348539 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 19:00:49 - job 7348538 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 19:00:49 - job 7348526 appears to have finished
Fri 17 Jan 2014 19:00:49 - job 7348527 appears to have finished
Fri 17 Jan 2014 19:00:49 - job_xml_thread(): Found 7 updated jobs.
Fri 17 Jan 2014 19:00:49 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 19:00:50 - job_xml_thread(): Done storing. succesfully stored: 7 jobs
Fri 17 Jan 2014 19:00:50 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:00:50 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:00:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:00:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:00:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:00:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:00:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:00:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:00:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:00:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:00:53 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:00:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43808454
Fri 17 Jan 2014 19:00:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:00:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43808454
Fri 17 Jan 2014 19:00:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:00:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:00:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:01:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:01:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:01:05 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:01:05 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:01:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:01:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:01:06 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:01:06 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:01:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:01:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:01:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:01:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:01:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:01:08 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:01:09 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:01:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 19:01:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:01:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:01:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:01:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:01:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:01:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:01:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:01:10 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:01:10 - job_xml_thread(): Done retrieving: data size 43866485
Fri 17 Jan 2014 19:01:10 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:01:10 - XML: Start document: iteration 16
Fri 17 Jan 2014 19:01:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43866485
Fri 17 Jan 2014 19:01:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:01:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43866485
Fri 17 Jan 2014 19:01:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:01:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:01:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:01:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:01:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:01:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:01:25 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:01:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:01:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:01:26 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:01:26 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:01:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:01:26 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:01:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:01:27 - XML: Processed 655560 elements - found 677 jobs
Fri 17 Jan 2014 19:01:27 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:01:27 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:01:27 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:01:27 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:01:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:01:27 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:01:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:01:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 19:01:28 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:01:28 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:01:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 19:01:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6369 values 100509 bits 12563 bytes 
Fri 17 Jan 2014 19:01:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:01:32 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:01:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:01:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:01:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:01:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:01:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:01:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:01:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:01:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43876356
Fri 17 Jan 2014 19:01:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:01:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43876356
Fri 17 Jan 2014 19:01:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:01:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:01:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:01:42 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:01:43 - job_xml_thread(): Done retrieving: data size 43876356
Fri 17 Jan 2014 19:01:43 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:01:43 - XML: Start document: iteration 17
Fri 17 Jan 2014 19:01:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:01:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:01:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:01:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:01:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:01:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:01:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:01:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:01:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43876356
Fri 17 Jan 2014 19:01:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:01:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:01:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:01:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:01:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:02:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:02:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:02:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:02:01 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:02:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:02:01 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:02:01 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:02:01 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:02:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:02:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:02:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:02:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:02:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:02:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:02:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:02:03 - XML: Processed 655560 elements - found 677 jobs
Fri 17 Jan 2014 19:02:03 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:02:03 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:02:03 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:02:03 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:02:03 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:02:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 19:02:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:02:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:02:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43896009
Fri 17 Jan 2014 19:02:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:02:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43896009
Fri 17 Jan 2014 19:02:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:02:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:02:14 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:02:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:02:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:02:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:02:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:02:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:02:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:02:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:02:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:02:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:02:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:02:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:02:18 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:02:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:02:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:02:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:02:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:02:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:02:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:02:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:02:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43899415
Fri 17 Jan 2014 19:02:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:02:21 - job_xml_thread(): Done retrieving: data size 43899415
Fri 17 Jan 2014 19:02:21 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:02:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43899415
Fri 17 Jan 2014 19:02:21 - XML: Start document: iteration 18
Fri 17 Jan 2014 19:02:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:02:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:02:29 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:02:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:02:29 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:02:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:02:29 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:02:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 19:02:29 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:02:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8955 values 141569 bits 17696 bytes 
Fri 17 Jan 2014 19:02:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 19:02:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:02:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:02:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:02:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:02:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:02:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:02:34 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:02:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:02:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:02:39 - XML: Processed 655548 elements - found 675 jobs
Fri 17 Jan 2014 19:02:39 - job 7348533 appears to have finished
Fri 17 Jan 2014 19:02:39 - job 7348515 appears to have finished
Fri 17 Jan 2014 19:02:39 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 19:02:39 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 19:02:39 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 19:02:39 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:02:39 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:02:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:02:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:02:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:02:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:02:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:02:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:02:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:02:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:02:43 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:02:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 19:02:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:02:44 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:02:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43863491
Fri 17 Jan 2014 19:02:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:02:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43863491
Fri 17 Jan 2014 19:02:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:02:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:02:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:02:54 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:02:55 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:02:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:02:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:02:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:02:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:02:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:02:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:02:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:02:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:02:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:02:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:02:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:02:59 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:02:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:02:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:03:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:03:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:03:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:03:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:03:01 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:03:01 - job_xml_thread(): Done retrieving: data size 43884407
Fri 17 Jan 2014 19:03:01 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:03:01 - XML: Start document: iteration 19
Fri 17 Jan 2014 19:03:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43884407
Fri 17 Jan 2014 19:03:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:03:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43884407
Fri 17 Jan 2014 19:03:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:03:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:03:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:03:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:03:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:03:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:03:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:03:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:03:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:03:16 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:03:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:03:16 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:03:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:03:17 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:03:18 - XML: Processed 655556 elements - found 675 jobs
Fri 17 Jan 2014 19:03:19 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:03:19 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:03:19 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:03:19 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:03:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:03:23 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:03:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:03:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:03:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:03:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:03:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:03:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:03:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:03:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43863270
Fri 17 Jan 2014 19:03:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:03:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43863270
Fri 17 Jan 2014 19:03:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:03:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:03:30 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:03:31 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:03:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 19:03:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:03:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:03:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 19:03:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:03:32 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:03:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148955 bits 18619 bytes 
Fri 17 Jan 2014 19:03:35 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:03:35 - job_xml_thread(): Done retrieving: data size 43863270
Fri 17 Jan 2014 19:03:35 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:03:35 - XML: Start document: iteration 20
Fri 17 Jan 2014 19:03:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:03:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:03:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:03:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:03:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:03:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:03:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:03:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:03:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:03:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:03:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:03:45 - XML: Processed 655556 elements - found 675 jobs
Fri 17 Jan 2014 19:03:45 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:03:45 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:03:45 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:03:45 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:03:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:03:46 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:03:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:03:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:03:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:03:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:03:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:03:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:03:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:03:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43871266
Fri 17 Jan 2014 19:03:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:03:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43871266
Fri 17 Jan 2014 19:03:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:03:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:03:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:03:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:03:56 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:03:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:03:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:03:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:03:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:03:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:03:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:03:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43871266
Fri 17 Jan 2014 19:03:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:04:00 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:04:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:04:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:04:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:04:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:04:06 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:04:10 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:04:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 19:04:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:04:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:04:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:04:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:04:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:04:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:04:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:04:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:04:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:04:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:04:12 - job_xml_thread(): Done retrieving: data size 43861327
Fri 17 Jan 2014 19:04:12 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:04:12 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 19:04:12 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 19:04:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43861327
Fri 17 Jan 2014 19:04:12 - Housekeeping: done.
Fri 17 Jan 2014 19:04:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:04:12 - XML: Start document: iteration 0
Fri 17 Jan 2014 19:04:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:04:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:04:14 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:04:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:04:14 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:04:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:04:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43861327
Fri 17 Jan 2014 19:04:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:04:16 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 19:04:16 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:04:18 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:04:18 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 19:04:18 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 19:04:18 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:04:18 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 19:04:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:04:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:04:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:04:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:04:30 - XML: Processed 655556 elements - found 675 jobs
Fri 17 Jan 2014 19:04:30 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:04:30 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:04:30 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:04:30 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:04:31 - size of cluster 'LISA Cluster': 624 hosts 79477 metrics 906257 values 14329860 bits 1791232 bytes 
Fri 17 Jan 2014 19:04:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:04:31 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:04:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:04:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 19:04:32 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:04:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 19:04:33 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:04:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5893 values 93018 bits 11627 bytes 
Fri 17 Jan 2014 19:04:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:04:35 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:04:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:04:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:04:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:04:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:04:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:04:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:04:36 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:04:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:04:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:04:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:04:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:04:37 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:04:37 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:04:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:04:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:04:40 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:04:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43888592
Fri 17 Jan 2014 19:04:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:04:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43888592
Fri 17 Jan 2014 19:04:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:04:46 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:04:46 - job_xml_thread(): Done retrieving: data size 43888592
Fri 17 Jan 2014 19:04:46 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:04:46 - XML: Start document: iteration 1
Fri 17 Jan 2014 19:04:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:04:50 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:04:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:04:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:04:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:04:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:04:54 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:04:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:04:54 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:04:54 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:04:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:05:01 - XML: Processed 655556 elements - found 675 jobs
Fri 17 Jan 2014 19:05:01 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:05:01 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:05:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:05:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:05:02 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:05:02 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:05:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:05:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:05:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:05:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:05:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:05:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:05:02 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:05:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 19:05:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:05:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:05:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43869155
Fri 17 Jan 2014 19:05:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:05:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43869155
Fri 17 Jan 2014 19:05:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:05:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:05:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:05:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:05:14 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:05:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:05:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:05:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:05:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:05:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:05:15 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:05:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:05:17 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:05:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:05:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:05:18 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:05:18 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 19:05:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:05:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:05:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:05:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:05:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:05:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:05:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:05:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:05:21 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:05:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43805178
Fri 17 Jan 2014 19:05:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:05:22 - job_xml_thread(): Done retrieving: data size 43805178
Fri 17 Jan 2014 19:05:22 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:05:22 - XML: Start document: iteration 2
Fri 17 Jan 2014 19:05:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43805178
Fri 17 Jan 2014 19:05:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:05:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:05:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:05:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:05:33 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:05:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:05:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 19:05:34 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:05:34 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:05:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 19:05:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:05:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:05:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9068 values 143127 bits 17890 bytes 
Fri 17 Jan 2014 19:05:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:05:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:05:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:05:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:05:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:05:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:05:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:05:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:05:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:05:38 - XML: Processed 654800 elements - found 675 jobs
Fri 17 Jan 2014 19:05:38 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:05:38 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:05:38 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:05:38 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:05:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:05:44 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:05:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:05:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:05:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:05:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:05:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:05:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:05:47 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:05:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43290556
Fri 17 Jan 2014 19:05:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:05:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43290556
Fri 17 Jan 2014 19:05:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:05:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:05:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:05:53 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:05:53 - job_xml_thread(): Done retrieving: data size 43290556
Fri 17 Jan 2014 19:05:53 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:05:53 - XML: Start document: iteration 3
Fri 17 Jan 2014 19:06:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:06:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:06:06 - XML: Processed 648356 elements - found 675 jobs
Fri 17 Jan 2014 19:06:06 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:06:06 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:06:06 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:06:06 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:06:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:06:08 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:06:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:06:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:06:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:06:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:06:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:06:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:06:09 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:06:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:06:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:06:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:06:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:06:11 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:06:11 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:06:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:06:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:06:11 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:06:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 19:06:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:06:14 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:06:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43274776
Fri 17 Jan 2014 19:06:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:06:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43274776
Fri 17 Jan 2014 19:06:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:06:22 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:06:23 - job_xml_thread(): Done retrieving: data size 43274776
Fri 17 Jan 2014 19:06:23 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:06:23 - XML: Start document: iteration 4
Fri 17 Jan 2014 19:06:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:06:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:06:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:06:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:06:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:06:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:06:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:06:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:06:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:06:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:06:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:06:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:06:34 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:06:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:06:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 19:06:35 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:06:35 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:06:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 19:06:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5449 values 85907 bits 10738 bytes 
Fri 17 Jan 2014 19:06:37 - XML: Processed 648014 elements - found 675 jobs
Fri 17 Jan 2014 19:06:37 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:06:37 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:06:37 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:06:37 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:06:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:06:38 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:06:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:06:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:06:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:06:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:06:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:06:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:06:42 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:06:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43754345
Fri 17 Jan 2014 19:06:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:06:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43754345
Fri 17 Jan 2014 19:06:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:06:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:06:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:06:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:06:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:06:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:06:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:06:52 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:06:52 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:06:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:06:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:06:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:06:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:06:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:06:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:06:56 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:06:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 19:06:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:06:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:06:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:06:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:06:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:06:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:06:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:06:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:06:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:07:01 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:07:01 - job_xml_thread(): Done retrieving: data size 43855045
Fri 17 Jan 2014 19:07:01 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:07:01 - XML: Start document: iteration 5
Fri 17 Jan 2014 19:07:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855045
Fri 17 Jan 2014 19:07:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:07:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855045
Fri 17 Jan 2014 19:07:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:07:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:07:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:07:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:07:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:07:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:07:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:07:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:07:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:07:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:07:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:07:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:07:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:07:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:07:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:07:24 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:07:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:07:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:07:25 - XML: Processed 655376 elements - found 675 jobs
Fri 17 Jan 2014 19:07:25 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:07:25 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:07:25 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:07:25 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:07:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:07:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:07:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:07:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:07:28 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:07:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43857555
Fri 17 Jan 2014 19:07:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:07:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43857555
Fri 17 Jan 2014 19:07:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:07:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:07:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:07:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:07:35 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:07:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:07:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 19:07:36 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:07:36 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:07:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 19:07:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9183 values 144891 bits 18111 bytes 
Fri 17 Jan 2014 19:07:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:07:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:07:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:07:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:07:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:07:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:07:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:07:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:07:40 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:07:40 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:07:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:07:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:07:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:07:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:07:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:07:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:07:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:07:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:07:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:07:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:07:47 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:07:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43879806
Fri 17 Jan 2014 19:07:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:07:47 - job_xml_thread(): Done retrieving: data size 43879806
Fri 17 Jan 2014 19:07:47 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:07:47 - XML: Start document: iteration 6
Fri 17 Jan 2014 19:07:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43879806
Fri 17 Jan 2014 19:07:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:07:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:07:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:07:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:07:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:08:04 - XML: Processed 655556 elements - found 675 jobs
Fri 17 Jan 2014 19:08:04 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:08:05 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:08:05 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:08:05 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:08:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:08:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:08:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:08:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:08:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:08:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:08:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:08:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:08:09 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:08:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:08:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:08:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:08:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:08:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:08:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:08:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:08:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:08:11 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:08:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 19:08:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:08:14 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 19:08:14 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 19:08:14 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:08:14 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:08:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43880273
Fri 17 Jan 2014 19:08:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:08:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43880273
Fri 17 Jan 2014 19:08:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:08:20 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:08:20 - job_xml_thread(): Done retrieving: data size 43880273
Fri 17 Jan 2014 19:08:20 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:08:20 - XML: Start document: iteration 7
Fri 17 Jan 2014 19:08:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:08:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:08:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:08:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:08:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:08:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:08:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:08:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:08:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:08:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:08:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:08:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:08:34 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:08:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:08:36 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:08:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:08:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:08:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:08:36 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:08:38 - XML: Processed 655556 elements - found 675 jobs
Fri 17 Jan 2014 19:08:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:08:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:08:38 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:08:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:08:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:08:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 19:08:38 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:08:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5594 values 88184 bits 11023 bytes 
Fri 17 Jan 2014 19:08:38 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:08:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:08:38 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:08:38 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:08:38 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:08:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 19:08:40 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:08:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43882276
Fri 17 Jan 2014 19:08:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:08:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43882276
Fri 17 Jan 2014 19:08:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:08:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:08:49 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:08:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:08:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:08:51 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:08:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:08:51 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:08:51 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:08:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:08:53 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:08:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:08:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:08:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:08:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:08:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:08:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:08:54 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:08:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 19:08:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:08:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:08:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:08:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:08:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:08:55 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:08:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43884193
Fri 17 Jan 2014 19:08:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:08:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43884193
Fri 17 Jan 2014 19:08:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:08:57 - job_xml_thread(): Done retrieving: data size 43884193
Fri 17 Jan 2014 19:08:57 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:08:57 - XML: Start document: iteration 8
Fri 17 Jan 2014 19:09:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:09:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:09:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:09:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:09:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:09:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:09:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:09:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:09:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:09:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:09:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:09:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:09:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:09:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:09:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:09:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:09:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:09:19 - XML: Processed 655556 elements - found 675 jobs
Fri 17 Jan 2014 19:09:19 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:09:19 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:09:19 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:09:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:09:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:09:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:09:19 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:09:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:09:21 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:09:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858333
Fri 17 Jan 2014 19:09:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:09:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43858333
Fri 17 Jan 2014 19:09:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:09:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:09:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:09:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:09:33 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:09:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:09:34 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:09:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:09:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:09:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:09:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:09:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:09:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:09:34 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:09:34 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:09:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:09:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:09:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:09:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:09:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:09:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:09:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:09:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43883277
Fri 17 Jan 2014 19:09:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:09:36 - job_xml_thread(): Done retrieving: data size 43883277
Fri 17 Jan 2014 19:09:36 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:09:36 - XML: Start document: iteration 9
Fri 17 Jan 2014 19:09:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43883277
Fri 17 Jan 2014 19:09:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:09:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:09:38 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:09:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:09:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 19:09:38 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:09:38 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:09:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 19:09:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 11971 values 188829 bits 23603 bytes 
Fri 17 Jan 2014 19:09:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:09:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:09:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:09:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:09:53 - XML: Processed 655556 elements - found 675 jobs
Fri 17 Jan 2014 19:09:53 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:09:53 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:09:53 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:09:54 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:09:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:09:54 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:09:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:09:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:09:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:09:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:09:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:09:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:09:55 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:09:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:09:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:09:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:09:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:09:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:09:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:09:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:09:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:10:00 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:10:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43904680
Fri 17 Jan 2014 19:10:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:10:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43904680
Fri 17 Jan 2014 19:10:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:10:09 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:10:09 - job_xml_thread(): Done retrieving: data size 43904680
Fri 17 Jan 2014 19:10:09 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:10:09 - XML: Start document: iteration 10
Fri 17 Jan 2014 19:10:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:10:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:10:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:10:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:10:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:10:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:10:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:10:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:10:17 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:10:17 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:10:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:10:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:10:17 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:10:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:10:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:10:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:10:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:10:23 - XML: Processed 655622 elements - found 708 jobs
Fri 17 Jan 2014 19:10:23 - job_xml_thread(): Found 33 updated jobs.
Fri 17 Jan 2014 19:10:23 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 19:10:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:10:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:10:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:10:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:10:23 - job_xml_thread(): Done storing. succesfully stored: 33 jobs
Fri 17 Jan 2014 19:10:23 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:10:23 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:10:24 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:10:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 19:10:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:10:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:10:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43880884
Fri 17 Jan 2014 19:10:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:10:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43880884
Fri 17 Jan 2014 19:10:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:10:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:10:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:10:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:10:34 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:10:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:10:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:10:37 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:10:37 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:10:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:10:37 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:10:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:10:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:10:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:10:38 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:10:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:10:38 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:10:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:10:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:10:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:10:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:10:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:10:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:10:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:10:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:10:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:10:39 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:10:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 19:10:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 19:10:39 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:10:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5888 values 92843 bits 11605 bytes 
Fri 17 Jan 2014 19:10:41 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:10:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43895067
Fri 17 Jan 2014 19:10:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:10:42 - job_xml_thread(): Done retrieving: data size 43895067
Fri 17 Jan 2014 19:10:42 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:10:42 - XML: Start document: iteration 11
Fri 17 Jan 2014 19:10:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43895067
Fri 17 Jan 2014 19:10:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:10:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:10:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:10:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:10:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:10:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:10:56 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:10:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:10:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:10:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:10:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:10:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:10:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:10:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:11:03 - XML: Processed 655622 elements - found 708 jobs
Fri 17 Jan 2014 19:11:03 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:11:03 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:11:03 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:11:03 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:11:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:11:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:11:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:11:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:11:05 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:11:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 19:11:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:11:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:11:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:11:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:11:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:11:06 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:11:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43885395
Fri 17 Jan 2014 19:11:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:11:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43885395
Fri 17 Jan 2014 19:11:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:11:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:11:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:11:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:11:16 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:11:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:11:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:11:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:11:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:11:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:11:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:11:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:11:18 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 19:11:18 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:11:18 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:11:19 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:11:19 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 19:11:19 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 19:11:20 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:11:20 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 19:11:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:11:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:11:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:11:21 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:11:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:11:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:11:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:11:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:11:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:11:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:11:21 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 865975 values 13669982 bits 1708747 bytes 
Fri 17 Jan 2014 19:11:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:11:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43812731
Fri 17 Jan 2014 19:11:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:11:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43812731
Fri 17 Jan 2014 19:11:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:11:26 - job_xml_thread(): Done retrieving: data size 43812731
Fri 17 Jan 2014 19:11:26 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:11:26 - XML: Start document: iteration 12
Fri 17 Jan 2014 19:11:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:11:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:11:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:11:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:11:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:11:39 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:11:40 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:11:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 19:11:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:11:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 19:11:40 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:11:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8534 values 134515 bits 16814 bytes 
Fri 17 Jan 2014 19:11:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:11:42 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:11:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:11:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:11:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:11:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:11:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:11:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:11:43 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:11:45 - XML: Processed 654874 elements - found 708 jobs
Fri 17 Jan 2014 19:11:45 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:11:45 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:11:45 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:11:45 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:11:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:11:49 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:11:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:11:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:11:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:11:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:11:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:11:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:11:52 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:11:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 19:11:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:11:53 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:11:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43255547
Fri 17 Jan 2014 19:11:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:11:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43255547
Fri 17 Jan 2014 19:11:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:11:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:11:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:12:00 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:12:00 - job_xml_thread(): Done retrieving: data size 43255547
Fri 17 Jan 2014 19:12:00 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:12:00 - XML: Start document: iteration 13
Fri 17 Jan 2014 19:12:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:12:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:12:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:12:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:12:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:12:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:12:06 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:12:06 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:12:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:12:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:12:07 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:12:10 - XML: Processed 648018 elements - found 708 jobs
Fri 17 Jan 2014 19:12:10 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:12:10 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:12:10 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:12:10 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:12:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:12:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:12:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:12:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:12:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:12:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:12:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:12:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:12:17 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:12:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43285017
Fri 17 Jan 2014 19:12:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:12:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43285017
Fri 17 Jan 2014 19:12:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:12:20 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:12:20 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 19:12:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:12:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:12:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:12:25 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:12:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:12:26 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:12:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:12:26 - job_xml_thread(): Done retrieving: data size 43285017
Fri 17 Jan 2014 19:12:26 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:12:26 - XML: Start document: iteration 14
Fri 17 Jan 2014 19:12:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:12:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:12:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:12:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:12:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:12:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:12:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:12:37 - XML: Processed 648170 elements - found 708 jobs
Fri 17 Jan 2014 19:12:37 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:12:37 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:12:37 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:12:37 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:12:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:12:38 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:12:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:12:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:12:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:12:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:12:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:12:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:12:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:12:40 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:12:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:12:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 19:12:40 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:12:40 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:12:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 19:12:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99081 bits 12385 bytes 
Fri 17 Jan 2014 19:12:42 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:12:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43736816
Fri 17 Jan 2014 19:12:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:12:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:12:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:12:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43736816
Fri 17 Jan 2014 19:12:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:12:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:12:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:12:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:12:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:12:52 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:12:52 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:12:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:12:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:12:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:12:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:12:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:12:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:12:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:12:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:12:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:12:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:12:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:12:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:12:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:12:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:13:00 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:13:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 19:13:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:13:01 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:13:01 - job_xml_thread(): Done retrieving: data size 43866845
Fri 17 Jan 2014 19:13:01 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:13:01 - XML: Start document: iteration 15
Fri 17 Jan 2014 19:13:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43866845
Fri 17 Jan 2014 19:13:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:13:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43866845
Fri 17 Jan 2014 19:13:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:13:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:13:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:13:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:13:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:13:20 - XML: Processed 655458 elements - found 708 jobs
Fri 17 Jan 2014 19:13:20 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:13:20 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:13:20 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:13:20 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:13:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:13:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:13:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:13:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:13:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:13:24 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:13:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:13:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:13:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:13:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:13:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:13:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:13:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:13:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:13:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:13:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:13:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:13:27 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:13:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43886414
Fri 17 Jan 2014 19:13:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:13:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43886414
Fri 17 Jan 2014 19:13:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:13:36 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:13:36 - job_xml_thread(): Done retrieving: data size 43886414
Fri 17 Jan 2014 19:13:36 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:13:36 - XML: Start document: iteration 16
Fri 17 Jan 2014 19:13:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:13:36 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:13:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:13:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:13:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:13:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:13:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:13:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:13:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:13:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:13:40 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:13:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:13:40 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:13:41 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:13:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 19:13:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:13:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 19:13:41 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:13:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7760 values 122290 bits 15286 bytes 
Fri 17 Jan 2014 19:13:49 - XML: Processed 655622 elements - found 708 jobs
Fri 17 Jan 2014 19:13:49 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:13:49 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:13:49 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:13:49 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:13:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:13:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:13:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:13:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:13:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:13:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:13:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:13:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:13:53 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:13:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 19:13:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:13:53 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:13:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43866672
Fri 17 Jan 2014 19:13:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:13:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43866672
Fri 17 Jan 2014 19:13:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:13:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:13:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:14:04 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:14:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:14:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:14:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:14:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:14:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:14:04 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:14:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:14:04 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:14:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:14:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:14:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:14:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:14:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:14:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:14:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:14:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:14:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:14:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:14:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:14:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:14:12 - job_xml_thread(): Done retrieving: data size 43875701
Fri 17 Jan 2014 19:14:12 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:14:12 - XML: Start document: iteration 17
Fri 17 Jan 2014 19:14:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875701
Fri 17 Jan 2014 19:14:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:14:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875701
Fri 17 Jan 2014 19:14:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:14:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:14:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:14:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:14:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:14:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:14:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:14:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:14:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:14:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:14:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:14:31 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:14:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:14:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:14:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:14:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:14:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:14:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:14:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:14:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:14:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:14:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:14:36 - XML: Processed 655622 elements - found 708 jobs
Fri 17 Jan 2014 19:14:36 - job 7348540 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 19:14:36 - job 7348541 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 19:14:36 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 19:14:36 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 19:14:36 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 19:14:36 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:14:36 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:14:38 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:14:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43880488
Fri 17 Jan 2014 19:14:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:14:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43880488
Fri 17 Jan 2014 19:14:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:14:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:14:41 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:14:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:14:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 19:14:41 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:14:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 19:14:41 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:14:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7898 values 124585 bits 15573 bytes 
Fri 17 Jan 2014 19:14:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:14:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:14:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:14:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:14:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:14:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:14:51 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:14:51 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:14:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:14:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:14:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:14:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:14:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:14:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:14:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:14:55 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:14:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:14:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:14:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:14:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:14:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:14:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:14:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:14:58 - job_xml_thread(): Done retrieving: data size 43885929
Fri 17 Jan 2014 19:14:58 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:14:58 - XML: Start document: iteration 18
Fri 17 Jan 2014 19:14:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43885929
Fri 17 Jan 2014 19:14:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:14:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43885929
Fri 17 Jan 2014 19:14:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:15:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:15:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:15:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:15:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:15:13 - XML: Processed 655622 elements - found 708 jobs
Fri 17 Jan 2014 19:15:13 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:15:13 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:15:13 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:15:13 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:15:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:15:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:15:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:15:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:15:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:15:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:15:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:15:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:15:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:15:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:15:21 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:15:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:15:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:15:21 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:15:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 19:15:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:15:21 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 19:15:21 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 19:15:21 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:15:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:15:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:15:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:15:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:15:23 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:15:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43888240
Fri 17 Jan 2014 19:15:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:15:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43888240
Fri 17 Jan 2014 19:15:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:15:28 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:15:29 - job_xml_thread(): Done retrieving: data size 43888240
Fri 17 Jan 2014 19:15:29 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:15:29 - XML: Start document: iteration 19
Fri 17 Jan 2014 19:15:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:15:34 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:15:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:15:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:15:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:15:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:15:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:15:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:15:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:15:37 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:15:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:15:39 - XML: Processed 655622 elements - found 708 jobs
Fri 17 Jan 2014 19:15:39 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:15:39 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:15:39 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:15:39 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:15:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:15:41 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:15:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:15:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:15:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:15:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 19:15:42 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:15:42 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:15:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5895 values 92994 bits 11624 bytes 
Fri 17 Jan 2014 19:15:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 19:15:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:15:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:15:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:15:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:15:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:15:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:15:44 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:15:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43886499
Fri 17 Jan 2014 19:15:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:15:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43886499
Fri 17 Jan 2014 19:15:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:15:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:15:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:15:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:15:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:15:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:15:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:15:53 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:15:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:15:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:15:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43886499
Fri 17 Jan 2014 19:15:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:15:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:15:54 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:15:54 - job_xml_thread(): Done retrieving: data size 43886499
Fri 17 Jan 2014 19:15:54 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:15:54 - XML: Start document: iteration 20
Fri 17 Jan 2014 19:15:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:15:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:16:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:16:07 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:16:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:16:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:16:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:16:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:16:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:16:09 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:16:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:16:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:16:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:16:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:16:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:16:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:16:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:16:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:16:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:16:13 - XML: Processed 655622 elements - found 708 jobs
Fri 17 Jan 2014 19:16:13 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:16:13 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:16:13 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:16:13 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:16:13 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:16:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 19:16:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:16:15 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:16:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43893722
Fri 17 Jan 2014 19:16:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:16:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43893722
Fri 17 Jan 2014 19:16:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:16:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:16:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:16:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:16:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:16:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:16:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:16:26 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:16:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:16:26 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:16:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:16:27 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:16:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:16:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:16:28 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:16:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:16:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:16:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:16:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:16:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:16:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:16:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:16:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:16:31 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:16:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43908536
Fri 17 Jan 2014 19:16:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:16:31 - job_xml_thread(): Done retrieving: data size 43908536
Fri 17 Jan 2014 19:16:31 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:16:31 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 19:16:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43908536
Fri 17 Jan 2014 19:16:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:16:33 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 19:16:33 - Housekeeping: done.
Fri 17 Jan 2014 19:16:33 - XML: Start document: iteration 0
Fri 17 Jan 2014 19:16:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:16:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:16:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:16:42 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:16:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:16:43 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:16:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 19:16:43 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:16:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 19:16:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9187 values 145023 bits 18127 bytes 
Fri 17 Jan 2014 19:16:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:16:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:16:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:16:45 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:16:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:16:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:16:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:16:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:16:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:16:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:16:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:16:52 - XML: Processed 655618 elements - found 706 jobs
Fri 17 Jan 2014 19:16:52 - job 7348539 appears to have finished
Fri 17 Jan 2014 19:16:52 - job 7341710 appears to have finished
Fri 17 Jan 2014 19:16:52 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 19:16:52 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 19:16:53 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 19:16:53 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:16:53 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:16:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:16:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:16:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:16:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:16:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:16:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:16:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:16:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:16:56 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:16:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43874168
Fri 17 Jan 2014 19:16:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:16:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43874168
Fri 17 Jan 2014 19:16:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:17:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:17:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:17:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:17:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:17:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:17:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:17:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:17:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:17:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:17:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:17:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43874168
Fri 17 Jan 2014 19:17:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:17:08 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:17:08 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:17:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:17:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:17:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:17:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:17:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:17:19 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:17:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:17:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:17:19 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:17:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 19:17:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:17:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:17:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:17:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:17:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:17:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:17:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:17:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:17:20 - job_xml_thread(): Done retrieving: data size 43812041
Fri 17 Jan 2014 19:17:20 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:17:20 - XML: Start document: iteration 1
Fri 17 Jan 2014 19:17:20 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:17:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:17:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43812041
Fri 17 Jan 2014 19:17:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:17:20 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:17:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:17:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43812041
Fri 17 Jan 2014 19:17:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:17:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:17:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:17:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:17:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:17:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:17:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:17:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:17:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:17:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:17:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:17:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:17:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:17:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:17:38 - XML: Processed 654870 elements - found 706 jobs
Fri 17 Jan 2014 19:17:39 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:17:39 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:17:39 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:17:39 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:17:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:17:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:17:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:17:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:17:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:17:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:17:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:17:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:17:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:17:43 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:17:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:17:43 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:17:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 19:17:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 19:17:43 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:17:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5934 values 93986 bits 11748 bytes 
Fri 17 Jan 2014 19:17:44 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:17:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43322060
Fri 17 Jan 2014 19:17:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:17:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43322060
Fri 17 Jan 2014 19:17:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:17:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:17:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:17:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:17:53 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:17:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:17:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:17:54 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:17:54 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:17:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:17:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:17:54 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:17:54 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:17:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:17:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:17:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:17:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:17:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:17:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:17:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:17:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:17:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:17:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:18:00 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:18:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 19:18:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:18:01 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:18:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43233397
Fri 17 Jan 2014 19:18:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:18:01 - job_xml_thread(): Done retrieving: data size 43233397
Fri 17 Jan 2014 19:18:01 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:18:01 - XML: Start document: iteration 2
Fri 17 Jan 2014 19:18:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43233397
Fri 17 Jan 2014 19:18:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:18:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:18:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:18:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:18:13 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:18:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:18:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:18:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:18:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:18:14 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:18:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:18:14 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:18:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:18:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:18:19 - XML: Processed 647424 elements - found 706 jobs
Fri 17 Jan 2014 19:18:19 - job 7348542 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 19:18:19 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 19:18:19 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 19:18:19 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 19:18:19 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:18:19 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:18:20 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 19:18:20 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:18:20 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:18:20 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 19:18:20 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 19:18:20 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:18:20 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 19:18:21 - size of cluster 'LISA Cluster': 624 hosts 79479 metrics 823102 values 13013016 bits 1626627 bytes 
Fri 17 Jan 2014 19:18:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:18:24 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:18:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:18:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:18:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:18:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:18:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:18:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:18:28 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:18:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43267763
Fri 17 Jan 2014 19:18:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:18:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43267763
Fri 17 Jan 2014 19:18:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:18:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:18:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:18:34 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:18:35 - job_xml_thread(): Done retrieving: data size 43267763
Fri 17 Jan 2014 19:18:35 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:18:35 - XML: Start document: iteration 3
Fri 17 Jan 2014 19:18:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:18:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:18:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:18:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:18:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:18:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:18:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:18:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:18:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:18:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:18:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:18:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:18:43 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:18:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:18:44 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:18:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 19:18:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 19:18:44 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:18:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7151 values 112942 bits 14117 bytes 
Fri 17 Jan 2014 19:18:50 - XML: Processed 648144 elements - found 706 jobs
Fri 17 Jan 2014 19:18:50 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:18:50 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:18:50 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:18:50 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:18:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:18:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:18:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:18:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:18:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:18:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:18:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:18:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:18:54 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:18:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43852592
Fri 17 Jan 2014 19:18:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:18:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43852592
Fri 17 Jan 2014 19:18:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:18:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:18:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:19:05 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:19:05 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:19:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:19:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:19:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:19:07 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:19:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:19:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:19:08 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:19:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:19:08 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:19:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:19:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:19:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:19:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:19:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:19:10 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:19:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 19:19:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:19:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:19:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:19:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:19:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:19:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:19:12 - job_xml_thread(): Done retrieving: data size 43878629
Fri 17 Jan 2014 19:19:12 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:19:12 - XML: Start document: iteration 4
Fri 17 Jan 2014 19:19:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43878629
Fri 17 Jan 2014 19:19:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:19:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43878629
Fri 17 Jan 2014 19:19:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:19:20 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:19:20 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 19:19:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:19:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:19:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:19:25 - XML: Processed 655618 elements - found 706 jobs
Fri 17 Jan 2014 19:19:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:19:25 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:19:25 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:19:25 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:19:25 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:19:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:19:34 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:19:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:19:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:19:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:19:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:19:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:19:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:19:34 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:19:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:19:36 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:19:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:19:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:19:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:19:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:19:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:19:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:19:39 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:19:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43883346
Fri 17 Jan 2014 19:19:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:19:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43883346
Fri 17 Jan 2014 19:19:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:19:40 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:19:40 - job_xml_thread(): Done retrieving: data size 43883346
Fri 17 Jan 2014 19:19:40 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:19:40 - XML: Start document: iteration 5
Fri 17 Jan 2014 19:19:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:19:44 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:19:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:19:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 19:19:44 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:19:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8307 values 131079 bits 16384 bytes 
Fri 17 Jan 2014 19:19:44 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:19:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 19:19:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:19:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:19:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:19:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:20:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:20:00 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:20:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:20:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:20:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:20:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:20:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:20:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:20:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:20:03 - XML: Processed 655618 elements - found 706 jobs
Fri 17 Jan 2014 19:20:03 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:20:03 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:20:03 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:20:03 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:20:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:20:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:20:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:20:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:20:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:20:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:20:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:20:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:20:07 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:20:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 19:20:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:20:07 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:20:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43896423
Fri 17 Jan 2014 19:20:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:20:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43896423
Fri 17 Jan 2014 19:20:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:20:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:20:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:20:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:20:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:20:18 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:20:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:20:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:20:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:20:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:20:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:20:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:20:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:20:20 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:20:20 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:20:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:20:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:20:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:20:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:20:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:20:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:20:22 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:20:22 - job_xml_thread(): Done retrieving: data size 43897825
Fri 17 Jan 2014 19:20:22 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:20:22 - XML: Start document: iteration 6
Fri 17 Jan 2014 19:20:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43897825
Fri 17 Jan 2014 19:20:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:20:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43897825
Fri 17 Jan 2014 19:20:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:20:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:20:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:20:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:20:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:20:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:20:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:20:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:20:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:20:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:20:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:20:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:20:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:20:40 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:20:43 - XML: Processed 655616 elements - found 705 jobs
Fri 17 Jan 2014 19:20:43 - job 7348426 appears to have finished
Fri 17 Jan 2014 19:20:43 - job 7343947 appears to have finished
Fri 17 Jan 2014 19:20:43 - job 7348542 field 'start_timestamp' changed since saved from: 1389982687 to: 1389982610
Fri 17 Jan 2014 19:20:43 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 19:20:43 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 19:20:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:20:44 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:20:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:20:44 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:20:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 19:20:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 19:20:44 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:20:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99108 bits 12388 bytes 
Fri 17 Jan 2014 19:20:45 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 19:20:45 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:20:45 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:20:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:20:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:20:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:20:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:20:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:20:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:20:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:20:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:20:51 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:20:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43886455
Fri 17 Jan 2014 19:20:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:20:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43886455
Fri 17 Jan 2014 19:20:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:20:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:20:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:21:00 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:21:00 - job_xml_thread(): Done retrieving: data size 43886455
Fri 17 Jan 2014 19:21:00 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:21:00 - XML: Start document: iteration 7
Fri 17 Jan 2014 19:21:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:21:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:21:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:21:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:21:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:21:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:21:04 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:21:04 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:21:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:21:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:21:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:21:04 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:21:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 19:21:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:21:09 - XML: Processed 655616 elements - found 705 jobs
Fri 17 Jan 2014 19:21:09 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:21:09 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:21:09 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:21:09 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:21:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:21:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:21:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:21:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:21:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:21:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:21:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:21:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:21:14 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:21:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870698
Fri 17 Jan 2014 19:21:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:21:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870698
Fri 17 Jan 2014 19:21:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:21:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:21:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:21:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:21:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:21:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:21:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:21:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:21:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:21:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:21:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870698
Fri 17 Jan 2014 19:21:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:21:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:21:24 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:21:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:21:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:21:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:21:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:21:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:21:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:21:35 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:21:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:21:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:21:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:21:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:21:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:21:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:21:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:21:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:21:37 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:21:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:21:37 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:21:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:21:38 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:21:38 - job_xml_thread(): Done retrieving: data size 43873888
Fri 17 Jan 2014 19:21:38 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:21:38 - XML: Start document: iteration 8
Fri 17 Jan 2014 19:21:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873888
Fri 17 Jan 2014 19:21:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:21:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873888
Fri 17 Jan 2014 19:21:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:21:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:21:45 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:21:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:21:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 19:21:46 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:21:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9262 values 146137 bits 18267 bytes 
Fri 17 Jan 2014 19:21:46 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:21:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 19:21:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:21:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:21:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:21:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:21:55 - XML: Processed 655616 elements - found 705 jobs
Fri 17 Jan 2014 19:21:55 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:21:55 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:21:55 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:21:55 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:21:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:21:56 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:21:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:21:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:21:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:21:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:21:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:21:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:21:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:22:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:22:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:22:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:22:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:22:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:22:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:22:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:22:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:22:04 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:22:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43894592
Fri 17 Jan 2014 19:22:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:22:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43894592
Fri 17 Jan 2014 19:22:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:22:10 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:22:10 - job_xml_thread(): Done retrieving: data size 43894592
Fri 17 Jan 2014 19:22:10 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:22:10 - XML: Start document: iteration 9
Fri 17 Jan 2014 19:22:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:22:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:22:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:22:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:22:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:22:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:22:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:22:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:22:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43894592
Fri 17 Jan 2014 19:22:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:22:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:22:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:22:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:22:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:22:23 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:22:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 19:22:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:22:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:22:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:22:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:22:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:22:29 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:22:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:22:29 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:22:29 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:22:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:22:31 - XML: Processed 655616 elements - found 705 jobs
Fri 17 Jan 2014 19:22:31 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:22:31 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:22:31 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:22:32 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:22:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:22:33 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:22:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:22:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:22:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:22:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:22:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:22:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:22:33 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 19:22:33 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 19:22:33 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:22:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:22:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43905819
Fri 17 Jan 2014 19:22:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:22:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43905819
Fri 17 Jan 2014 19:22:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:22:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:22:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:22:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:22:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:22:45 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:22:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:22:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:22:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:22:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:22:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:22:46 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:22:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:22:46 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:22:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 19:22:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 19:22:46 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:22:47 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:22:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6029 values 95146 bits 11893 bytes 
Fri 17 Jan 2014 19:22:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:22:48 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:22:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:22:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:22:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:22:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:22:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:22:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:22:50 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:22:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 19:22:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:22:51 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:22:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43901499
Fri 17 Jan 2014 19:22:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:22:52 - job_xml_thread(): Done retrieving: data size 43901499
Fri 17 Jan 2014 19:22:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43901499
Fri 17 Jan 2014 19:22:52 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:22:52 - XML: Start document: iteration 10
Fri 17 Jan 2014 19:22:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:23:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:23:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:23:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:23:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:23:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:23:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:23:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:23:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:23:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:23:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:23:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:23:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:23:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:23:09 - XML: Processed 655616 elements - found 705 jobs
Fri 17 Jan 2014 19:23:09 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:23:09 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:23:09 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:23:09 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:23:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:23:12 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:23:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:23:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:23:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:23:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:23:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:23:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:23:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:23:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43861815
Fri 17 Jan 2014 19:23:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:23:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43861815
Fri 17 Jan 2014 19:23:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:23:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:23:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:23:24 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:23:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:23:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:23:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:23:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:23:28 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:23:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:23:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:23:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:23:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:23:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:23:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:23:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:23:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:23:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:23:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:23:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:23:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:23:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:23:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:23:30 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:23:30 - job_xml_thread(): Done retrieving: data size 43811588
Fri 17 Jan 2014 19:23:30 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:23:30 - XML: Start document: iteration 11
Fri 17 Jan 2014 19:23:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43811588
Fri 17 Jan 2014 19:23:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:23:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43811588
Fri 17 Jan 2014 19:23:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:23:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:23:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:23:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:23:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:23:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:23:47 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:23:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:23:48 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:23:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 19:23:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 19:23:48 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:23:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148637 bits 18579 bytes 
Fri 17 Jan 2014 19:23:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:23:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:23:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:23:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:23:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:23:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:23:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:23:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:23:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:23:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:23:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:23:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:23:52 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:23:53 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:23:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:23:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:23:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:23:54 - XML: Processed 654778 elements - found 705 jobs
Fri 17 Jan 2014 19:23:54 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:23:54 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:23:54 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:23:54 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:23:55 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:23:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43231507
Fri 17 Jan 2014 19:23:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:23:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43231507
Fri 17 Jan 2014 19:23:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:24:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:24:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:24:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:24:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:24:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:24:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:24:08 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:24:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:24:08 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:24:08 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:24:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:24:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:24:08 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:24:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:24:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:24:09 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:24:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:24:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:24:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:24:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:24:09 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:24:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 19:24:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:24:10 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:24:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43299750
Fri 17 Jan 2014 19:24:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:24:11 - job_xml_thread(): Done retrieving: data size 43299750
Fri 17 Jan 2014 19:24:11 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:24:11 - XML: Start document: iteration 12
Fri 17 Jan 2014 19:24:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43299750
Fri 17 Jan 2014 19:24:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:24:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:24:21 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:24:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:24:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:24:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:24:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:24:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:24:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:24:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:24:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:24:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:24:31 - XML: Processed 648164 elements - found 705 jobs
Fri 17 Jan 2014 19:24:31 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:24:31 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:24:31 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:24:31 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:24:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:24:33 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:24:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:24:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:24:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:24:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:24:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:24:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:24:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:24:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43296988
Fri 17 Jan 2014 19:24:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:24:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43296988
Fri 17 Jan 2014 19:24:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:24:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:24:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:24:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:24:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:24:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:24:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:24:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:24:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:24:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:24:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:24:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43296988
Fri 17 Jan 2014 19:24:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:24:47 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:24:48 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:24:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:24:48 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:24:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:24:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 19:24:49 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:24:49 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:24:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 19:24:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:24:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:24:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8750 values 137961 bits 17245 bytes 
Fri 17 Jan 2014 19:24:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:24:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:24:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:24:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:24:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:24:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:24:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:24:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:24:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:24:56 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:24:58 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:24:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 19:24:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:24:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:24:58 - job_xml_thread(): Done retrieving: data size 43853725
Fri 17 Jan 2014 19:24:58 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:24:58 - XML: Start document: iteration 13
Fri 17 Jan 2014 19:24:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853725
Fri 17 Jan 2014 19:24:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:24:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:24:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:25:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:25:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:25:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:25:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:25:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853725
Fri 17 Jan 2014 19:25:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:25:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:25:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:25:14 - XML: Processed 655528 elements - found 705 jobs
Fri 17 Jan 2014 19:25:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:25:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:25:15 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:25:16 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:25:16 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:25:16 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:25:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:25:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:25:19 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:25:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:25:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:25:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:25:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:25:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:25:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:25:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:25:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:25:20 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:25:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:25:20 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:25:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:25:20 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 19:25:20 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:25:21 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:25:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43906035
Fri 17 Jan 2014 19:25:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:25:22 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:25:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43906035
Fri 17 Jan 2014 19:25:22 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:25:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:25:22 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 19:25:22 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 19:25:22 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 19:25:32 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:25:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:25:32 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:25:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:25:33 - size of cluster 'LISA Cluster': 624 hosts 79465 metrics 796244 values 12571443 bits 1571430 bytes 
Fri 17 Jan 2014 19:25:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:25:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:25:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:25:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:25:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:25:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:25:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:25:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:25:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:25:37 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:25:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:25:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:25:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:25:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:25:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:25:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:25:41 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:25:41 - job_xml_thread(): Done retrieving: data size 43881162
Fri 17 Jan 2014 19:25:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43881162
Fri 17 Jan 2014 19:25:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:25:41 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:25:41 - XML: Start document: iteration 14
Fri 17 Jan 2014 19:25:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43881162
Fri 17 Jan 2014 19:25:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:25:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:25:49 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:25:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:25:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 19:25:50 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:25:50 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:25:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 19:25:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9279 values 146379 bits 18297 bytes 
Fri 17 Jan 2014 19:25:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:25:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:25:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:25:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:25:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:25:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:25:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:25:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:25:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:25:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:25:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:25:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:25:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:26:03 - XML: Processed 655616 elements - found 705 jobs
Fri 17 Jan 2014 19:26:03 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:26:03 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:26:03 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:26:03 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:26:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:26:06 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:26:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:26:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:26:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:26:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:26:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:26:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:26:09 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:26:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43879556
Fri 17 Jan 2014 19:26:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:26:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43879556
Fri 17 Jan 2014 19:26:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:26:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:26:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:26:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:26:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:26:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:26:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:26:18 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:26:18 - job_xml_thread(): Done retrieving: data size 43879556
Fri 17 Jan 2014 19:26:18 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:26:18 - XML: Start document: iteration 15
Fri 17 Jan 2014 19:26:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:26:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:26:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43879556
Fri 17 Jan 2014 19:26:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:26:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:26:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:26:20 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:26:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 19:26:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:26:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:26:22 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:26:22 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 19:26:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:26:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:26:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:26:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:26:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:26:38 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:26:38 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:26:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:26:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:26:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:26:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:26:39 - XML: Processed 655613 elements - found 705 jobs
Fri 17 Jan 2014 19:26:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:26:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:26:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:26:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:26:39 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:26:39 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:26:39 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:26:39 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:26:39 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:26:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:26:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:26:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:26:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:26:42 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:26:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43894423
Fri 17 Jan 2014 19:26:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:26:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43894423
Fri 17 Jan 2014 19:26:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:26:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:26:50 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:26:51 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:26:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 19:26:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:26:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 19:26:52 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:26:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6269 values 98884 bits 12360 bytes 
Fri 17 Jan 2014 19:26:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:26:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:26:54 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:26:54 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:26:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:26:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:26:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:26:56 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:26:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:26:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:26:56 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:26:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:26:56 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:26:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:26:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:26:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:26:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:26:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:26:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:26:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:26:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:26:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:27:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:27:02 - job_xml_thread(): Done retrieving: data size 43883058
Fri 17 Jan 2014 19:27:02 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:27:02 - XML: Start document: iteration 16
Fri 17 Jan 2014 19:27:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43883058
Fri 17 Jan 2014 19:27:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:27:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43883058
Fri 17 Jan 2014 19:27:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:27:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:27:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:27:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:27:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:27:20 - XML: Processed 655616 elements - found 705 jobs
Fri 17 Jan 2014 19:27:20 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:27:20 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:27:20 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:27:20 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:27:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:27:21 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:27:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:27:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:27:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:27:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:27:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:27:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:27:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:27:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:27:24 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:27:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:27:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:27:24 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:27:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 19:27:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:27:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:27:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:27:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:27:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:27:27 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:27:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43876909
Fri 17 Jan 2014 19:27:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:27:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43876909
Fri 17 Jan 2014 19:27:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:27:35 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:27:36 - job_xml_thread(): Done retrieving: data size 43876909
Fri 17 Jan 2014 19:27:36 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:27:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:27:36 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:27:36 - XML: Start document: iteration 17
Fri 17 Jan 2014 19:27:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:27:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:27:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:27:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:27:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:27:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:27:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:27:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:27:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:27:47 - XML: Processed 655616 elements - found 705 jobs
Fri 17 Jan 2014 19:27:47 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:27:47 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:27:47 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:27:47 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:27:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:27:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:27:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:27:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:27:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:27:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:27:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:27:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:27:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:27:51 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:27:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:27:51 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:27:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 19:27:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 19:27:51 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:27:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5877 values 92713 bits 11589 bytes 
Fri 17 Jan 2014 19:27:53 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:27:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865589
Fri 17 Jan 2014 19:27:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:27:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43865589
Fri 17 Jan 2014 19:27:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:27:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:27:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:28:02 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:28:02 - job_xml_thread(): Done retrieving: data size 43865589
Fri 17 Jan 2014 19:28:02 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:28:02 - XML: Start document: iteration 18
Fri 17 Jan 2014 19:28:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:28:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:28:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:28:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:28:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:28:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:28:06 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:28:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:28:06 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:28:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:28:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:28:13 - XML: Processed 655609 elements - found 705 jobs
Fri 17 Jan 2014 19:28:13 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:28:13 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:28:13 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:28:13 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:28:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:28:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:28:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:28:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:28:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:28:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:28:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:28:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:28:19 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:28:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 19:28:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:28:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:28:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43876509
Fri 17 Jan 2014 19:28:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:28:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43876509
Fri 17 Jan 2014 19:28:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:28:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:28:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:28:28 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:28:28 - job_xml_thread(): Done retrieving: data size 43876509
Fri 17 Jan 2014 19:28:28 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:28:28 - XML: Start document: iteration 19
Fri 17 Jan 2014 19:28:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:28:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:28:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:28:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:28:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:28:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:28:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:28:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:28:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:28:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:28:34 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:28:40 - XML: Processed 655622 elements - found 708 jobs
Fri 17 Jan 2014 19:28:41 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 19:28:41 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 19:28:42 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 19:28:42 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:28:42 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:28:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:28:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:28:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:28:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:28:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:28:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:28:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:28:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:28:46 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:28:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873864
Fri 17 Jan 2014 19:28:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:28:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873864
Fri 17 Jan 2014 19:28:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:28:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:28:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:28:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:28:52 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:28:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:28:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 19:28:53 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:28:53 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:28:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 19:28:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7319 values 115425 bits 14428 bytes 
Fri 17 Jan 2014 19:28:57 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:28:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:28:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:28:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:28:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:28:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:28:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:28:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:28:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:28:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:28:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:28:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:29:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:29:01 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:29:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:29:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:29:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:29:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:29:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:29:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:29:04 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 19:29:04 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 19:29:04 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:29:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:29:05 - job_xml_thread(): Done retrieving: data size 43897554
Fri 17 Jan 2014 19:29:05 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:29:05 - XML: Start document: iteration 20
Fri 17 Jan 2014 19:29:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43897554
Fri 17 Jan 2014 19:29:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:29:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43897554
Fri 17 Jan 2014 19:29:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:29:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:29:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:29:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:29:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:29:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:29:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:29:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:29:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:29:26 - XML: Processed 655622 elements - found 708 jobs
Fri 17 Jan 2014 19:29:26 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:29:26 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:29:26 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:29:26 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:29:26 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:29:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:29:26 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:29:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:29:26 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:29:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:29:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:29:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:29:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:29:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:29:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:29:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:29:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:29:29 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:29:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 19:29:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:29:30 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:29:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43520006
Fri 17 Jan 2014 19:29:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:29:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43520006
Fri 17 Jan 2014 19:29:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:29:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:29:41 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:29:41 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:29:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:29:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:29:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:29:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:29:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:29:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:29:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:29:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:29:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:29:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:29:45 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:29:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:29:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:29:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:29:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:29:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:29:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:29:46 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:29:46 - job_xml_thread(): Done retrieving: data size 43300224
Fri 17 Jan 2014 19:29:46 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:29:46 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 19:29:46 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 19:29:46 - Housekeeping: done.
Fri 17 Jan 2014 19:29:46 - XML: Start document: iteration 0
Fri 17 Jan 2014 19:29:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43300224
Fri 17 Jan 2014 19:29:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:29:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43300224
Fri 17 Jan 2014 19:29:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:29:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:29:53 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:29:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:29:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 19:29:55 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:29:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8686 values 136898 bits 17112 bytes 
Fri 17 Jan 2014 19:29:55 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:29:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 19:29:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:29:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:30:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:30:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:30:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:30:03 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:30:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:30:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:30:04 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:30:04 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:30:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:30:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:30:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:30:06 - XML: Processed 648304 elements - found 708 jobs
Fri 17 Jan 2014 19:30:06 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:30:06 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:30:06 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:30:06 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:30:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:30:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:30:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:30:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:30:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:30:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:30:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:30:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:30:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:30:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43266363
Fri 17 Jan 2014 19:30:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:30:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43266363
Fri 17 Jan 2014 19:30:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:30:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:30:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:30:22 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:30:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:30:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:30:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:30:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:30:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:30:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:30:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:30:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:30:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:30:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:30:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:30:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:30:26 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:30:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:30:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:30:26 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:30:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 19:30:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:30:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:30:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:30:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:30:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:30:28 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:30:28 - job_xml_thread(): Done retrieving: data size 43280891
Fri 17 Jan 2014 19:30:28 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:30:28 - XML: Start document: iteration 1
Fri 17 Jan 2014 19:30:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43280891
Fri 17 Jan 2014 19:30:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43280891
Fri 17 Jan 2014 19:30:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:30:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:30:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:30:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:30:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:30:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:30:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:30:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:30:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:30:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:30:45 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:30:45 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:30:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:30:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:30:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:30:45 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:30:45 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:30:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:30:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:30:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:30:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:30:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:30:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:30:47 - XML: Processed 648168 elements - found 707 jobs
Fri 17 Jan 2014 19:30:47 - job 7341732 appears to have finished
Fri 17 Jan 2014 19:30:47 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 19:30:47 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 19:30:47 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 19:30:47 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:30:47 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:30:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:30:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43840644
Fri 17 Jan 2014 19:30:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:30:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43840644
Fri 17 Jan 2014 19:30:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:30:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:30:56 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:30:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:30:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 19:30:58 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:30:58 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:30:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 19:30:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9051 values 142777 bits 17847 bytes 
Fri 17 Jan 2014 19:31:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:31:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:31:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:31:01 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:31:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:31:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:31:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:31:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:31:01 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:31:01 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:31:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:31:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:31:01 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:31:03 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:31:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:31:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:31:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:31:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:31:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:31:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:31:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:31:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:31:06 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:31:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43902856
Fri 17 Jan 2014 19:31:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:31:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43902856
Fri 17 Jan 2014 19:31:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:31:07 - job_xml_thread(): Done retrieving: data size 43902856
Fri 17 Jan 2014 19:31:07 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:31:08 - XML: Start document: iteration 2
Fri 17 Jan 2014 19:31:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:31:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:31:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:31:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:31:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:31:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:31:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:31:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:31:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:31:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:31:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:31:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:31:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:31:26 - XML: Processed 655560 elements - found 707 jobs
Fri 17 Jan 2014 19:31:26 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:31:26 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:31:26 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:31:27 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:31:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:31:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:31:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:31:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:31:28 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:31:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 19:31:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:31:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:31:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:31:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:31:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:31:29 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:31:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875684
Fri 17 Jan 2014 19:31:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:31:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875684
Fri 17 Jan 2014 19:31:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:31:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:31:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:31:42 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:31:42 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:31:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:31:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:31:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:31:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:31:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:31:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:31:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:31:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:31:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:31:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:31:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:31:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:31:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:31:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:31:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:31:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:31:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:31:45 - job_xml_thread(): Done retrieving: data size 43893219
Fri 17 Jan 2014 19:31:45 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:31:45 - XML: Start document: iteration 3
Fri 17 Jan 2014 19:31:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43893219
Fri 17 Jan 2014 19:31:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:31:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43893219
Fri 17 Jan 2014 19:31:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:31:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:31:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:31:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:31:59 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:31:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:31:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:32:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:32:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 19:32:01 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:32:01 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:32:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8783 values 138814 bits 17351 bytes 
Fri 17 Jan 2014 19:32:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 19:32:02 - XML: Processed 655620 elements - found 707 jobs
Fri 17 Jan 2014 19:32:03 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:32:03 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:32:03 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:32:03 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:32:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:32:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:32:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:32:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:32:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:32:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:32:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:32:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:32:05 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:32:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:32:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:32:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:32:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:32:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:32:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:32:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:32:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:32:09 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:32:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43909580
Fri 17 Jan 2014 19:32:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:32:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43909580
Fri 17 Jan 2014 19:32:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:32:18 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:32:18 - job_xml_thread(): Done retrieving: data size 43909580
Fri 17 Jan 2014 19:32:18 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:32:18 - XML: Start document: iteration 4
Fri 17 Jan 2014 19:32:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:32:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:32:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:32:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:32:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:32:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:32:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:32:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:32:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:32:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:32:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:32:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:32:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:32:22 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 19:32:23 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:32:24 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:32:24 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 19:32:24 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:32:24 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 19:32:24 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Fri 17 Jan 2014 19:32:31 - XML: Processed 655620 elements - found 707 jobs
Fri 17 Jan 2014 19:32:31 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:32:31 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:32:31 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:32:31 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:32:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:32:34 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:32:34 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:32:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 19:32:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:32:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:32:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:32:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:32:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:32:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:32:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:32:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:32:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43878819
Fri 17 Jan 2014 19:32:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:32:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43878819
Fri 17 Jan 2014 19:32:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:32:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:32:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:32:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:32:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:32:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:32:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:32:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:32:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:32:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:32:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:32:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:32:46 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:32:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:32:49 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:32:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:32:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:32:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:32:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:32:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:32:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:32:50 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:32:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43918076
Fri 17 Jan 2014 19:32:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:32:51 - job_xml_thread(): Done retrieving: data size 43918076
Fri 17 Jan 2014 19:32:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43918076
Fri 17 Jan 2014 19:32:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:32:51 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:32:51 - XML: Start document: iteration 5
Fri 17 Jan 2014 19:33:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:33:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:33:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:33:02 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:33:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:33:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 19:33:02 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:33:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 19:33:02 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:33:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8777 values 138785 bits 17348 bytes 
Fri 17 Jan 2014 19:33:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:33:03 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:33:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:33:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:33:04 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:33:04 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:33:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:33:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:33:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:33:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:33:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:33:09 - XML: Processed 655620 elements - found 707 jobs
Fri 17 Jan 2014 19:33:09 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:33:09 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:33:09 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:33:09 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:33:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:33:12 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:33:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:33:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:33:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:33:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:33:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:33:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:33:14 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:33:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865067
Fri 17 Jan 2014 19:33:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:33:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43865067
Fri 17 Jan 2014 19:33:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:33:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:33:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:33:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:33:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:33:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:33:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:33:24 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:33:24 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:33:24 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:33:24 - job_xml_thread(): Done retrieving: data size 43865067
Fri 17 Jan 2014 19:33:24 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:33:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:33:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:33:24 - XML: Start document: iteration 6
Fri 17 Jan 2014 19:33:24 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:33:24 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 19:33:24 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 19:33:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:33:24 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:33:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:33:25 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:33:25 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 19:33:27 - size of cluster 'LISA Cluster': 624 hosts 79475 metrics 888832 values 14048840 bits 1756105 bytes 
Fri 17 Jan 2014 19:33:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:33:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:33:34 - XML: Processed 655620 elements - found 707 jobs
Fri 17 Jan 2014 19:33:34 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:33:34 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:33:34 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:33:34 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:33:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:33:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:33:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:33:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:33:39 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:33:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 19:33:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:33:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:33:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:33:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:33:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:33:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:33:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:33:41 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:33:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862081
Fri 17 Jan 2014 19:33:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:33:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862081
Fri 17 Jan 2014 19:33:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:33:49 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:33:49 - job_xml_thread(): Done retrieving: data size 43862081
Fri 17 Jan 2014 19:33:49 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:33:49 - XML: Start document: iteration 7
Fri 17 Jan 2014 19:33:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:33:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:33:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:33:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:33:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:33:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:33:59 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:33:59 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:33:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:33:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:33:59 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:34:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:34:01 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:34:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:34:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:34:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:34:02 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:34:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:34:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:34:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:34:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:34:03 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:34:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:34:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 19:34:03 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:34:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5672 values 89528 bits 11191 bytes 
Fri 17 Jan 2014 19:34:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 19:34:03 - XML: Processed 655620 elements - found 707 jobs
Fri 17 Jan 2014 19:34:03 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:34:03 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:34:03 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:34:03 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:34:07 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:34:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43906453
Fri 17 Jan 2014 19:34:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:34:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43906453
Fri 17 Jan 2014 19:34:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:34:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:34:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:34:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:34:16 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:34:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:34:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:34:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:34:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:34:18 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:34:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:34:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:34:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:34:20 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:34:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:34:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:34:21 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:34:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:34:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:34:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:34:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:34:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:34:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:34:22 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:34:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 19:34:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:34:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:34:25 - job_xml_thread(): Done retrieving: data size 43904181
Fri 17 Jan 2014 19:34:25 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:34:25 - XML: Start document: iteration 8
Fri 17 Jan 2014 19:34:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43904181
Fri 17 Jan 2014 19:34:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43904181
Fri 17 Jan 2014 19:34:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:34:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:34:25 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:34:25 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 19:34:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:34:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:34:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:34:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:34:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:34:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:34:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:34:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:34:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:34:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:34:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:34:44 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:34:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:34:47 - XML: Processed 655620 elements - found 707 jobs
Fri 17 Jan 2014 19:34:47 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:34:47 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:34:47 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:34:47 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:34:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:34:49 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:34:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:34:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:34:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:34:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:34:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:34:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:34:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:34:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43903345
Fri 17 Jan 2014 19:34:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:34:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43903345
Fri 17 Jan 2014 19:34:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:35:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:35:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:35:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:35:03 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:35:03 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:35:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:35:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:35:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:35:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:35:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:35:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:35:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:35:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:35:04 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:35:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:35:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:35:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:35:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 19:35:05 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:35:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8862 values 139834 bits 17479 bytes 
Fri 17 Jan 2014 19:35:05 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:35:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 19:35:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:35:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:35:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:35:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:35:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:35:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:35:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:35:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:35:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:35:11 - job_xml_thread(): Done retrieving: data size 43865112
Fri 17 Jan 2014 19:35:11 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:35:11 - XML: Start document: iteration 9
Fri 17 Jan 2014 19:35:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43865112
Fri 17 Jan 2014 19:35:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865112
Fri 17 Jan 2014 19:35:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:35:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:35:17 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:35:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 19:35:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:35:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:35:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:35:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:35:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:35:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:35:28 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:35:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:35:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:35:30 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:35:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:35:30 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:35:30 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:35:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:35:31 - XML: Processed 655341 elements - found 707 jobs
Fri 17 Jan 2014 19:35:31 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:35:31 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:35:31 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:35:31 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:35:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:35:34 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:35:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:35:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:35:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:35:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:35:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:35:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:35:37 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:35:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43366157
Fri 17 Jan 2014 19:35:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:35:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43366157
Fri 17 Jan 2014 19:35:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:35:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:35:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:35:46 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:35:46 - job_xml_thread(): Done retrieving: data size 43366157
Fri 17 Jan 2014 19:35:46 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:35:46 - XML: Start document: iteration 10
Fri 17 Jan 2014 19:35:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:35:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:35:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:35:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:35:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:35:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:35:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:35:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:35:52 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:35:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:35:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:35:56 - XML: Processed 649002 elements - found 707 jobs
Fri 17 Jan 2014 19:35:56 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:35:56 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:35:56 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:35:56 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:35:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:35:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:35:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:35:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:35:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:35:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:35:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:35:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:36:00 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 19:36:00 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 19:36:00 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:36:01 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:36:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43222928
Fri 17 Jan 2014 19:36:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:36:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43222928
Fri 17 Jan 2014 19:36:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:36:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:36:05 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:36:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:36:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:36:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:36:08 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:36:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 19:36:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 19:36:08 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:36:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9412 values 148507 bits 18563 bytes 
Fri 17 Jan 2014 19:36:11 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:36:11 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:36:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:36:13 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:36:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:36:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:36:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:36:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:36:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:36:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:36:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:36:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:36:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:36:15 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:36:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:36:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:36:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:36:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:36:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:36:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:36:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:36:18 - job_xml_thread(): Done retrieving: data size 43294975
Fri 17 Jan 2014 19:36:18 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:36:18 - XML: Start document: iteration 11
Fri 17 Jan 2014 19:36:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43294975
Fri 17 Jan 2014 19:36:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:36:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43294975
Fri 17 Jan 2014 19:36:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:36:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:36:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:36:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:36:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:36:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:36:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:36:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:36:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:36:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:36:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:36:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:36:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:36:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:36:37 - XML: Processed 648168 elements - found 707 jobs
Fri 17 Jan 2014 19:36:37 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:36:37 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:36:37 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:36:37 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:36:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:36:40 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:36:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:36:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:36:40 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:36:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 19:36:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:36:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:36:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:36:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:36:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:36:42 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:36:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43792037
Fri 17 Jan 2014 19:36:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:36:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43792037
Fri 17 Jan 2014 19:36:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:36:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:36:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:36:52 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:36:52 - job_xml_thread(): Done retrieving: data size 43792037
Fri 17 Jan 2014 19:36:52 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:36:52 - XML: Start document: iteration 12
Fri 17 Jan 2014 19:36:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:36:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:36:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:36:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:36:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:36:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:36:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:36:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:36:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:36:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:36:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:37:01 - XML: Processed 654534 elements - found 707 jobs
Fri 17 Jan 2014 19:37:01 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:37:01 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:37:01 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:37:01 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:37:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:37:03 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:37:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:37:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:37:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:37:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:37:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:37:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:37:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:37:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43884472
Fri 17 Jan 2014 19:37:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:37:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43884472
Fri 17 Jan 2014 19:37:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:37:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:37:08 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:37:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:37:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 19:37:09 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:37:09 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:37:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 19:37:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8699 values 137238 bits 17154 bytes 
Fri 17 Jan 2014 19:37:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:37:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:37:13 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:37:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:37:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:37:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:37:14 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:37:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:37:14 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:37:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:37:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43884472
Fri 17 Jan 2014 19:37:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:37:16 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:37:16 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:37:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:37:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:37:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:37:25 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:37:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:37:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:37:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:37:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:37:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:37:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:37:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:37:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:37:29 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:37:29 - job_xml_thread(): Done retrieving: data size 43863357
Fri 17 Jan 2014 19:37:29 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:37:29 - XML: Start document: iteration 13
Fri 17 Jan 2014 19:37:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43863357
Fri 17 Jan 2014 19:37:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:37:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:37:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:37:32 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:37:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:37:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:37:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:37:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43863357
Fri 17 Jan 2014 19:37:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:37:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:37:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:37:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:37:46 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:37:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:37:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:37:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:37:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:37:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:37:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:37:50 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:37:51 - XML: Processed 655620 elements - found 707 jobs
Fri 17 Jan 2014 19:37:51 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:37:51 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:37:52 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:37:52 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:37:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:37:52 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:37:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:37:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:37:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:37:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:37:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:37:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:37:52 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:37:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 19:37:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:37:55 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:37:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43888919
Fri 17 Jan 2014 19:37:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:37:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43888919
Fri 17 Jan 2014 19:37:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:38:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:38:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:38:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:38:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:38:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:38:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:38:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:38:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:38:05 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:38:07 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:38:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:38:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:38:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:38:08 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:38:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:38:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:38:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:38:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:38:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:38:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:38:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:38:09 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:38:09 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:38:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:38:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 19:38:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 19:38:09 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:38:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5860 values 92421 bits 11552 bytes 
Fri 17 Jan 2014 19:38:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:38:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43885465
Fri 17 Jan 2014 19:38:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:38:11 - job_xml_thread(): Done retrieving: data size 43885465
Fri 17 Jan 2014 19:38:11 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:38:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43885465
Fri 17 Jan 2014 19:38:11 - XML: Start document: iteration 14
Fri 17 Jan 2014 19:38:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:38:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:38:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:38:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:38:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:38:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:38:28 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:38:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:38:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:38:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:38:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:38:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:38:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:38:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:38:33 - XML: Processed 655620 elements - found 707 jobs
Fri 17 Jan 2014 19:38:33 - job 7348543 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 19:38:33 - job 7348544 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 19:38:33 - job 7348545 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 19:38:33 - job 7348546 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 19:38:33 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 19:38:33 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 19:38:34 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 19:38:34 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:38:34 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:38:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:38:35 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:38:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:38:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:38:36 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:38:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 19:38:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:38:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:38:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:38:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:38:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:38:37 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:38:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43893632
Fri 17 Jan 2014 19:38:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:38:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43893632
Fri 17 Jan 2014 19:38:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:38:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:38:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:38:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:38:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:38:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:38:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:38:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:38:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:38:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:38:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:38:48 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:38:49 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:38:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:38:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:38:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:38:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:38:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:38:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:38:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:38:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:38:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:38:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:38:53 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:38:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43893586
Fri 17 Jan 2014 19:38:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:38:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43893586
Fri 17 Jan 2014 19:38:54 - job_xml_thread(): Done retrieving: data size 43893586
Fri 17 Jan 2014 19:38:54 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:38:54 - XML: Start document: iteration 15
Fri 17 Jan 2014 19:38:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:39:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:39:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:39:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:39:03 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:39:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:39:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:39:04 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:39:04 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:39:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:39:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:39:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:39:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:39:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:39:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:39:09 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:39:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:39:10 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:39:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 19:39:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 19:39:10 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:39:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8116 values 127950 bits 15993 bytes 
Fri 17 Jan 2014 19:39:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:39:15 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:39:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:39:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:39:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:39:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:39:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:39:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:39:16 - XML: Processed 655620 elements - found 707 jobs
Fri 17 Jan 2014 19:39:16 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:39:16 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:39:16 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:39:16 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:39:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:39:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43864481
Fri 17 Jan 2014 19:39:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:39:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43864481
Fri 17 Jan 2014 19:39:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:39:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:39:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:39:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:39:29 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:39:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:39:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:39:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:39:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:39:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:39:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:39:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:39:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:39:31 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:39:31 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:39:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:39:32 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:39:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:39:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:39:33 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:39:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 19:39:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:39:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:39:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:39:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:39:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:39:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:39:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43909820
Fri 17 Jan 2014 19:39:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:39:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43909820
Fri 17 Jan 2014 19:39:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:39:35 - job_xml_thread(): Done retrieving: data size 43909820
Fri 17 Jan 2014 19:39:35 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:39:35 - XML: Start document: iteration 16
Fri 17 Jan 2014 19:39:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:39:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:39:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:39:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:39:52 - XML: Processed 655620 elements - found 707 jobs
Fri 17 Jan 2014 19:39:52 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:39:52 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:39:52 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:39:52 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:39:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:39:54 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:39:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:39:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:39:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:39:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:39:55 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:39:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:39:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:39:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:39:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:39:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:39:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:39:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:39:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:39:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:39:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:39:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:39:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43886191
Fri 17 Jan 2014 19:39:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:39:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43886191
Fri 17 Jan 2014 19:39:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:40:07 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:40:07 - job_xml_thread(): Done retrieving: data size 43886191
Fri 17 Jan 2014 19:40:07 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:40:07 - XML: Start document: iteration 17
Fri 17 Jan 2014 19:40:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:40:10 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:40:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:40:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:40:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:40:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 19:40:11 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:40:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 19:40:11 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:40:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8633 values 136109 bits 17013 bytes 
Fri 17 Jan 2014 19:40:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:40:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:40:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:40:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:40:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:40:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:40:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:40:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:40:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:40:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:40:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:40:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:40:19 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:40:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:40:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:40:20 - XML: Processed 655616 elements - found 705 jobs
Fri 17 Jan 2014 19:40:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:40:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:40:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:40:21 - job 7348117 appears to have finished
Fri 17 Jan 2014 19:40:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:40:21 - job 7348447 appears to have finished
Fri 17 Jan 2014 19:40:21 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 19:40:21 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 19:40:21 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 19:40:21 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:40:21 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:40:23 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:40:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 19:40:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:40:23 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:40:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43876343
Fri 17 Jan 2014 19:40:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:40:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43876343
Fri 17 Jan 2014 19:40:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:40:26 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 19:40:26 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:40:27 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:40:27 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:40:27 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 19:40:27 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 19:40:27 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 19:40:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:40:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:40:33 - size of cluster 'LISA Cluster': 624 hosts 79473 metrics 852060 values 13451489 bits 1681436 bytes 
Fri 17 Jan 2014 19:40:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:40:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:40:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:40:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:40:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:40:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:40:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:40:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:40:35 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:40:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:40:36 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:40:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:40:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:40:36 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:40:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:40:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:40:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:40:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:40:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:40:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:40:40 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:40:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43894037
Fri 17 Jan 2014 19:40:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:40:40 - job_xml_thread(): Done retrieving: data size 43894037
Fri 17 Jan 2014 19:40:40 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:40:40 - XML: Start document: iteration 18
Fri 17 Jan 2014 19:40:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43894037
Fri 17 Jan 2014 19:40:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:40:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:40:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:40:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:40:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:40:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:40:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:40:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:40:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:40:57 - XML: Processed 655616 elements - found 705 jobs
Fri 17 Jan 2014 19:40:57 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:40:57 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:40:57 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:40:58 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:40:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:40:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:40:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:40:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:40:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:41:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:41:03 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:41:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:41:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:41:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:41:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:41:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:41:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:41:06 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:41:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43895391
Fri 17 Jan 2014 19:41:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:41:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43895391
Fri 17 Jan 2014 19:41:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:41:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:41:11 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:41:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:41:12 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:41:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 19:41:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 19:41:12 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:41:13 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:41:13 - job_xml_thread(): Done retrieving: data size 43895391
Fri 17 Jan 2014 19:41:13 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:41:13 - XML: Start document: iteration 19
Fri 17 Jan 2014 19:41:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:41:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:41:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9279 values 146356 bits 18294 bytes 
Fri 17 Jan 2014 19:41:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:41:16 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:41:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:41:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:41:17 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:41:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:41:17 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:41:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:41:17 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:41:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:41:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:41:23 - XML: Processed 655616 elements - found 705 jobs
Fri 17 Jan 2014 19:41:23 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:41:23 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:41:23 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:41:23 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:41:27 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:41:27 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 19:41:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:41:30 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:41:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:41:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:41:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:41:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:41:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:41:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:41:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:41:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:41:33 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:41:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43794030
Fri 17 Jan 2014 19:41:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:41:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43794030
Fri 17 Jan 2014 19:41:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:41:38 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:41:38 - job_xml_thread(): Done retrieving: data size 43794030
Fri 17 Jan 2014 19:41:38 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:41:38 - XML: Start document: iteration 20
Fri 17 Jan 2014 19:41:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:41:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:41:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:41:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:41:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:41:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:41:51 - XML: Processed 654868 elements - found 705 jobs
Fri 17 Jan 2014 19:41:51 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:41:51 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:41:51 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:41:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:41:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:41:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:41:51 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:41:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:41:51 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:41:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:41:54 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:41:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:41:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:41:54 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:41:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 19:41:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:41:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:41:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:41:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:41:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:41:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:41:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43235243
Fri 17 Jan 2014 19:41:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:41:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43235243
Fri 17 Jan 2014 19:41:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:42:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:42:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:42:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:42:06 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:42:06 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:42:06 - job_xml_thread(): Done retrieving: data size 43235243
Fri 17 Jan 2014 19:42:06 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:42:06 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 19:42:06 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 19:42:06 - Housekeeping: done.
Fri 17 Jan 2014 19:42:06 - XML: Start document: iteration 0
Fri 17 Jan 2014 19:42:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:42:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:42:11 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:42:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:42:11 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:42:11 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:42:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:42:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:42:12 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:42:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:42:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 19:42:12 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:42:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6127 values 96632 bits 12079 bytes 
Fri 17 Jan 2014 19:42:12 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:42:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 19:42:18 - XML: Processed 647612 elements - found 705 jobs
Fri 17 Jan 2014 19:42:18 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:42:18 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:42:18 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:42:18 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:42:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:42:20 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:42:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:42:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:42:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:42:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:42:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:42:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:42:23 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:42:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43284764
Fri 17 Jan 2014 19:42:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:42:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43284764
Fri 17 Jan 2014 19:42:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:42:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:42:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:42:33 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:42:33 - job_xml_thread(): Done retrieving: data size 43284764
Fri 17 Jan 2014 19:42:33 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:42:33 - XML: Start document: iteration 1
Fri 17 Jan 2014 19:42:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:42:34 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:42:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:42:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:42:35 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:42:35 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:42:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:42:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:42:35 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:42:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:42:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:42:47 - XML: Processed 648164 elements - found 705 jobs
Fri 17 Jan 2014 19:42:47 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:42:48 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:42:48 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:42:48 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:42:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:42:48 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:42:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:42:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:42:48 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:42:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 19:42:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:42:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:42:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:42:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:42:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:42:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:42:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:42:51 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:42:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43791055
Fri 17 Jan 2014 19:42:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:42:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43791055
Fri 17 Jan 2014 19:42:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:43:03 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:43:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:43:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:43:03 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:43:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:43:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:43:04 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:43:04 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:43:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:43:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:43:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:43:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:43:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:43:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:43:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:43:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:43:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:43:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:43:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:43:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:43:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:43:11 - job_xml_thread(): Done retrieving: data size 43892998
Fri 17 Jan 2014 19:43:11 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:43:11 - XML: Start document: iteration 2
Fri 17 Jan 2014 19:43:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43892998
Fri 17 Jan 2014 19:43:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43892998
Fri 17 Jan 2014 19:43:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:43:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:43:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:43:12 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:43:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:43:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 19:43:13 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:43:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7557 values 119186 bits 14898 bytes 
Fri 17 Jan 2014 19:43:13 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:43:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 19:43:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:43:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:43:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:43:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:43:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:43:27 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:43:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:43:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:43:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:43:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:43:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:43:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:43:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:43:30 - XML: Processed 655610 elements - found 705 jobs
Fri 17 Jan 2014 19:43:30 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:43:30 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:43:30 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:43:30 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:43:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:43:35 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:43:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:43:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:43:35 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 19:43:35 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 19:43:35 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:43:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:43:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:43:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:43:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:43:37 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:43:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43887943
Fri 17 Jan 2014 19:43:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:43:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43887943
Fri 17 Jan 2014 19:43:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:43:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:43:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:43:45 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:43:45 - job_xml_thread(): Done retrieving: data size 43887943
Fri 17 Jan 2014 19:43:45 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:43:45 - XML: Start document: iteration 3
Fri 17 Jan 2014 19:43:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:43:45 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:43:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:43:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:43:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:43:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:43:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:43:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43887943
Fri 17 Jan 2014 19:43:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:43:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:43:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:43:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:43:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:43:58 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:43:59 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:43:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 19:43:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:44:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:44:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:44:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:44:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:44:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:44:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:44:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:44:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:44:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:44:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:44:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:44:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:44:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:44:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:44:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:44:05 - XML: Processed 655616 elements - found 705 jobs
Fri 17 Jan 2014 19:44:05 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:44:05 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:44:05 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:44:05 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:44:07 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:44:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43913791
Fri 17 Jan 2014 19:44:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:44:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43913791
Fri 17 Jan 2014 19:44:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:44:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:44:14 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:44:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:44:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:44:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:44:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:44:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:44:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:44:18 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:44:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:44:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 19:44:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 19:44:18 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:44:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:44:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:44:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6186 values 97530 bits 12191 bytes 
Fri 17 Jan 2014 19:44:20 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:44:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:44:20 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:44:20 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:44:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:44:20 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:44:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:44:21 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:44:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:44:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:44:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:44:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:44:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:44:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:44:24 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:44:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43902351
Fri 17 Jan 2014 19:44:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:44:24 - job_xml_thread(): Done retrieving: data size 43902351
Fri 17 Jan 2014 19:44:24 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:44:24 - XML: Start document: iteration 4
Fri 17 Jan 2014 19:44:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43902351
Fri 17 Jan 2014 19:44:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:44:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:44:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:44:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:44:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:44:40 - XML: Processed 655616 elements - found 705 jobs
Fri 17 Jan 2014 19:44:40 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:44:41 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:44:41 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:44:41 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:44:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:44:42 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:44:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:44:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:44:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:44:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:44:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:44:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:44:43 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:44:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:44:46 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:44:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:44:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:44:46 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:44:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 19:44:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:44:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:44:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:44:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:44:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:44:48 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:44:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43900192
Fri 17 Jan 2014 19:44:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:44:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43900192
Fri 17 Jan 2014 19:44:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:44:56 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:44:56 - job_xml_thread(): Done retrieving: data size 43900192
Fri 17 Jan 2014 19:44:56 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:44:56 - XML: Start document: iteration 5
Fri 17 Jan 2014 19:44:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:44:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:45:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:45:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:45:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:45:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:45:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:45:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:45:04 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:45:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:45:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:45:04 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:45:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:45:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:45:08 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:45:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:45:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:45:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:45:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:45:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:45:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:45:09 - XML: Processed 655616 elements - found 705 jobs
Fri 17 Jan 2014 19:45:09 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:45:09 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:45:09 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:45:09 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:45:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:45:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43889032
Fri 17 Jan 2014 19:45:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:45:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43889032
Fri 17 Jan 2014 19:45:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:45:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:45:19 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:45:19 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:45:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 19:45:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:45:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 19:45:19 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:45:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8818 values 138996 bits 17374 bytes 
Fri 17 Jan 2014 19:45:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:45:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:45:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:45:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:45:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:45:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:45:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:45:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:45:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:45:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:45:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:45:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:45:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:45:24 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:45:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:45:25 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:45:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:45:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:45:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:45:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:45:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:45:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:45:27 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:45:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43883359
Fri 17 Jan 2014 19:45:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:45:28 - job_xml_thread(): Done retrieving: data size 43883359
Fri 17 Jan 2014 19:45:28 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:45:28 - XML: Start document: iteration 6
Fri 17 Jan 2014 19:45:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43883359
Fri 17 Jan 2014 19:45:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:45:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:45:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:45:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:45:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:45:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:45:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:45:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:45:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:45:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:45:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:45:44 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:45:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:45:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:45:46 - XML: Processed 655616 elements - found 705 jobs
Fri 17 Jan 2014 19:45:46 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:45:46 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:45:46 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:45:46 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:45:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:45:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:45:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:45:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:45:50 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:45:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 19:45:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:45:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:45:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:45:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:45:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:45:51 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:45:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43899388
Fri 17 Jan 2014 19:45:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:45:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43899388
Fri 17 Jan 2014 19:45:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:45:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:45:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:46:01 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:46:01 - job_xml_thread(): Done retrieving: data size 43899388
Fri 17 Jan 2014 19:46:01 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:46:01 - XML: Start document: iteration 7
Fri 17 Jan 2014 19:46:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:46:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:46:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:46:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:46:04 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:46:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:46:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:46:04 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:46:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:46:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:46:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:46:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:46:08 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:46:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:46:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:46:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:46:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:46:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:46:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:46:11 - XML: Processed 655616 elements - found 705 jobs
Fri 17 Jan 2014 19:46:11 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:46:11 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:46:11 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:46:11 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:46:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:46:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43871871
Fri 17 Jan 2014 19:46:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:46:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43871871
Fri 17 Jan 2014 19:46:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:46:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:46:19 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:46:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:46:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:46:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:46:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 19:46:19 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:46:19 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:46:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 19:46:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8938 values 141033 bits 17629 bytes 
Fri 17 Jan 2014 19:46:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:46:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:46:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:46:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:46:23 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:46:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:46:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:46:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:46:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:46:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:46:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:46:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:46:25 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:46:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:46:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:46:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:46:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:46:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:46:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:46:26 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:46:27 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:46:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43895969
Fri 17 Jan 2014 19:46:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:46:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43895969
Fri 17 Jan 2014 19:46:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:46:28 - job_xml_thread(): Done retrieving: data size 43895969
Fri 17 Jan 2014 19:46:28 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:46:28 - XML: Start document: iteration 8
Fri 17 Jan 2014 19:46:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:46:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:46:39 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:46:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 19:46:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:46:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:46:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:46:46 - XML: Processed 655616 elements - found 705 jobs
Fri 17 Jan 2014 19:46:46 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:46:46 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:46:46 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:46:47 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:46:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:46:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:46:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:46:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:46:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:46:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:46:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:46:48 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:46:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:46:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:46:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:46:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:46:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:46:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:46:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:46:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:46:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:46:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:46:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43920309
Fri 17 Jan 2014 19:46:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:46:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43920309
Fri 17 Jan 2014 19:46:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:47:02 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:47:02 - job_xml_thread(): Done retrieving: data size 43920309
Fri 17 Jan 2014 19:47:02 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:47:02 - XML: Start document: iteration 9
Fri 17 Jan 2014 19:47:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:47:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:47:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:47:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:47:04 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:47:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:47:04 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:47:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:47:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:47:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:47:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:47:11 - XML: Processed 655616 elements - found 705 jobs
Fri 17 Jan 2014 19:47:11 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:47:11 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:47:11 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:47:11 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:47:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:47:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:47:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:47:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:47:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:47:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:47:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:47:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:47:16 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:47:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43802070
Fri 17 Jan 2014 19:47:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:47:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43802070
Fri 17 Jan 2014 19:47:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:47:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:47:20 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:47:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:47:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:47:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:47:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 19:47:20 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:47:20 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:47:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 19:47:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9354 values 147931 bits 18491 bytes 
Fri 17 Jan 2014 19:47:26 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:47:26 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:47:27 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 19:47:27 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:47:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:47:27 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:47:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:47:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:47:28 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:47:28 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 19:47:28 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:47:28 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 19:47:28 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 19:47:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:47:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:47:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:47:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:47:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:47:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:47:31 - size of cluster 'LISA Cluster': 624 hosts 79478 metrics 846783 values 13374863 bits 1671857 bytes 
Fri 17 Jan 2014 19:47:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:47:34 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:47:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:47:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:47:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:47:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:47:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:47:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:47:38 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:47:38 - job_xml_thread(): Done retrieving: data size 43458227
Fri 17 Jan 2014 19:47:38 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:47:38 - XML: Start document: iteration 10
Fri 17 Jan 2014 19:47:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43458227
Fri 17 Jan 2014 19:47:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:47:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43458227
Fri 17 Jan 2014 19:47:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:47:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:47:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:47:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:47:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:47:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:47:56 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:47:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:47:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:47:57 - XML: Processed 650316 elements - found 705 jobs
Fri 17 Jan 2014 19:47:57 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:47:57 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:47:57 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:47:57 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:47:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:47:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:47:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:47:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:47:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:48:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:48:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:48:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:48:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:48:00 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:48:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 19:48:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:48:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:48:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:48:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:48:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:48:03 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:48:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43228288
Fri 17 Jan 2014 19:48:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:48:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43228288
Fri 17 Jan 2014 19:48:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:48:12 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:48:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:48:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:48:12 - job_xml_thread(): Done retrieving: data size 43228288
Fri 17 Jan 2014 19:48:12 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:48:12 - XML: Start document: iteration 11
Fri 17 Jan 2014 19:48:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:48:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:48:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:48:21 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:48:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:48:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 19:48:21 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:48:21 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:48:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 19:48:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:48:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:48:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5576 values 88149 bits 11018 bytes 
Fri 17 Jan 2014 19:48:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:48:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:48:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:48:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:48:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:48:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:48:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:48:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:48:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:48:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:48:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:48:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:48:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:48:25 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:48:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:48:25 - XML: Processed 647416 elements - found 705 jobs
Fri 17 Jan 2014 19:48:25 - job 7348547 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 19:48:25 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 19:48:25 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 19:48:25 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 19:48:25 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:48:25 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:48:28 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:48:28 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 19:48:28 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:48:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 19:48:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:48:29 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:48:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43328510
Fri 17 Jan 2014 19:48:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:48:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43328510
Fri 17 Jan 2014 19:48:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:48:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:48:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:48:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:48:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:48:40 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:48:40 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:48:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:48:42 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:48:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:48:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:48:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:48:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:48:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:48:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:48:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:48:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:48:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:48:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:48:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:48:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:48:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:48:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:48:47 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:48:47 - job_xml_thread(): Done retrieving: data size 43809582
Fri 17 Jan 2014 19:48:47 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:48:47 - XML: Start document: iteration 12
Fri 17 Jan 2014 19:48:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43809582
Fri 17 Jan 2014 19:48:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43809582
Fri 17 Jan 2014 19:48:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:48:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:48:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:48:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:48:58 - XML: Processed 654752 elements - found 705 jobs
Fri 17 Jan 2014 19:48:58 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:48:58 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:48:58 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:48:58 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:48:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:48:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:49:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:49:03 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:49:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:49:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:49:04 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:49:04 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:49:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:49:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:49:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:49:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:49:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:49:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:49:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:49:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:49:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:49:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:49:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:49:10 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:49:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43899760
Fri 17 Jan 2014 19:49:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:49:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43899760
Fri 17 Jan 2014 19:49:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:49:13 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:49:13 - job_xml_thread(): Done retrieving: data size 43899760
Fri 17 Jan 2014 19:49:13 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:49:13 - XML: Start document: iteration 13
Fri 17 Jan 2014 19:49:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:49:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:49:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:49:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:49:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:49:22 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:49:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:49:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 19:49:23 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:49:23 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:49:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 19:49:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148750 bits 18593 bytes 
Fri 17 Jan 2014 19:49:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:49:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:49:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:49:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:49:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:49:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:49:30 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:49:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:49:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:49:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:49:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:49:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:49:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:49:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:49:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:49:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:49:34 - XML: Processed 655616 elements - found 705 jobs
Fri 17 Jan 2014 19:49:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:49:34 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:49:34 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:49:34 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:49:34 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:49:38 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:49:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43885517
Fri 17 Jan 2014 19:49:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:49:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43885517
Fri 17 Jan 2014 19:49:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:49:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:49:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:49:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:49:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:49:49 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:49:49 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:49:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:49:50 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:49:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:49:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:49:51 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:49:51 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:49:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:49:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:49:53 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:49:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 19:49:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:49:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:49:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:49:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:49:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:49:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:49:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:49:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:49:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:49:57 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:49:57 - job_xml_thread(): Done retrieving: data size 43888739
Fri 17 Jan 2014 19:49:57 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:49:57 - XML: Start document: iteration 14
Fri 17 Jan 2014 19:49:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43888739
Fri 17 Jan 2014 19:49:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:49:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43888739
Fri 17 Jan 2014 19:49:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:50:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:50:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:50:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:50:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:50:14 - XML: Processed 655616 elements - found 705 jobs
Fri 17 Jan 2014 19:50:14 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:50:14 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:50:14 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:50:14 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:50:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:50:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:50:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:50:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:50:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:50:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:50:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:50:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:50:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:50:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:50:20 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:50:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:50:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:50:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:50:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:50:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:50:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:50:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:50:23 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:50:24 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:50:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43895920
Fri 17 Jan 2014 19:50:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:50:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43895920
Fri 17 Jan 2014 19:50:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:50:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:50:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 19:50:24 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:50:24 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:50:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5974 values 94220 bits 11777 bytes 
Fri 17 Jan 2014 19:50:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 19:50:29 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:50:29 - job_xml_thread(): Done retrieving: data size 43895920
Fri 17 Jan 2014 19:50:29 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:50:29 - XML: Start document: iteration 15
Fri 17 Jan 2014 19:50:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:50:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:50:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:50:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:50:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:50:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:50:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:50:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:50:39 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:50:39 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:50:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:50:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:50:40 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:50:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:50:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:50:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:50:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:50:48 - XML: Processed 655612 elements - found 704 jobs
Fri 17 Jan 2014 19:50:48 - job 7348548 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 19:50:48 - job 7348547 field 'start_timestamp' changed since saved from: 1389984452 to: 1389984437
Fri 17 Jan 2014 19:50:48 - job 7348347 appears to have finished
Fri 17 Jan 2014 19:50:48 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 19:50:48 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 19:50:48 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 19:50:48 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:50:48 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:50:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:50:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:50:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:50:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:50:50 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 19:50:50 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 19:50:50 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:50:50 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:50:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43880125
Fri 17 Jan 2014 19:50:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:50:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43880125
Fri 17 Jan 2014 19:50:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:50:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:50:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:50:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:50:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:50:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:50:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:50:59 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:50:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:50:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43880125
Fri 17 Jan 2014 19:50:59 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:50:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:50:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:51:03 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:51:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:51:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:51:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:51:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:51:06 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:51:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:51:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:51:11 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:51:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 19:51:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:51:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:51:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:51:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:51:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:51:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:51:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:51:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:51:12 - job_xml_thread(): Done retrieving: data size 43879117
Fri 17 Jan 2014 19:51:12 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:51:12 - XML: Start document: iteration 16
Fri 17 Jan 2014 19:51:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43879117
Fri 17 Jan 2014 19:51:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:51:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:51:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:51:16 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:51:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:51:17 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:51:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:51:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43879117
Fri 17 Jan 2014 19:51:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:51:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:51:24 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:51:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:51:25 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:51:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 19:51:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 19:51:26 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:51:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6185 values 97565 bits 12195 bytes 
Fri 17 Jan 2014 19:51:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:51:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:51:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:51:31 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:51:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:51:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:51:32 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:51:32 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:51:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:51:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:51:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:51:34 - XML: Processed 655614 elements - found 704 jobs
Fri 17 Jan 2014 19:51:34 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:51:34 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:51:34 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:51:34 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:51:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:51:36 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:51:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:51:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:51:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:51:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:51:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:51:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:51:38 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:51:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43895502
Fri 17 Jan 2014 19:51:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:51:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43895502
Fri 17 Jan 2014 19:51:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:51:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:51:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:51:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:51:48 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:51:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:51:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:51:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:51:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:51:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:51:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43895502
Fri 17 Jan 2014 19:51:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:51:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:51:49 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:51:49 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:51:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:51:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:51:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:51:56 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:52:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:52:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:52:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:52:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:52:00 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:52:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 19:52:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:52:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:52:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:52:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:52:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:52:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:52:02 - job_xml_thread(): Done retrieving: data size 43862551
Fri 17 Jan 2014 19:52:02 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:52:02 - XML: Start document: iteration 17
Fri 17 Jan 2014 19:52:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862551
Fri 17 Jan 2014 19:52:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:52:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:52:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:52:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:52:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:52:06 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:52:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862551
Fri 17 Jan 2014 19:52:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:52:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:52:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:52:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:52:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:52:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:52:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:52:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:52:23 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:52:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:52:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:52:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:52:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:52:24 - XML: Processed 655614 elements - found 704 jobs
Fri 17 Jan 2014 19:52:24 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:52:24 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:52:24 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:52:24 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:52:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:52:25 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:52:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:52:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:52:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:52:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:52:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:52:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:52:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:52:25 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:52:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:52:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 19:52:25 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:52:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 19:52:25 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:52:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5796 values 91407 bits 11425 bytes 
Fri 17 Jan 2014 19:52:27 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:52:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43905444
Fri 17 Jan 2014 19:52:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:52:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43905444
Fri 17 Jan 2014 19:52:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:52:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:52:38 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:52:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:52:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:52:39 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:52:39 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:52:39 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:52:39 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:52:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:52:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:52:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:52:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:52:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:52:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:52:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:52:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:52:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:52:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:52:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:52:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:52:43 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:52:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 19:52:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:52:44 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:52:44 - job_xml_thread(): Done retrieving: data size 43890699
Fri 17 Jan 2014 19:52:44 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:52:44 - XML: Start document: iteration 18
Fri 17 Jan 2014 19:52:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43890699
Fri 17 Jan 2014 19:52:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:52:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43890699
Fri 17 Jan 2014 19:52:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:52:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:52:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:52:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:52:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:53:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:53:03 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:53:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:53:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:53:04 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:53:04 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:53:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:53:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:53:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:53:04 - XML: Processed 655612 elements - found 703 jobs
Fri 17 Jan 2014 19:53:04 - job 7348545 appears to have finished
Fri 17 Jan 2014 19:53:04 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 19:53:04 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 19:53:05 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 19:53:05 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:53:05 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:53:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:53:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:53:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:53:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:53:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:53:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:53:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:53:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:53:09 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:53:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43833217
Fri 17 Jan 2014 19:53:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:53:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43833217
Fri 17 Jan 2014 19:53:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:53:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:53:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:53:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:53:20 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:53:20 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:53:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:53:20 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:53:20 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:53:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:53:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:53:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:53:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:53:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:53:25 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:53:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:53:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:53:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:53:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:53:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:53:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:53:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:53:25 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:53:26 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:53:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 19:53:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:53:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 19:53:26 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:53:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7744 values 122140 bits 15267 bytes 
Fri 17 Jan 2014 19:53:27 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:53:27 - job_xml_thread(): Done retrieving: data size 43829640
Fri 17 Jan 2014 19:53:27 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:53:27 - XML: Start document: iteration 19
Fri 17 Jan 2014 19:53:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43829640
Fri 17 Jan 2014 19:53:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:53:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43829640
Fri 17 Jan 2014 19:53:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:53:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:53:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:53:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:53:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:53:48 - XML: Processed 654864 elements - found 703 jobs
Fri 17 Jan 2014 19:53:48 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:53:48 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:53:48 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:53:48 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:53:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:53:48 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:53:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:53:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:53:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:53:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:53:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:53:49 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:53:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:53:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:53:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:53:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:53:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:53:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:53:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:53:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:53:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:53:52 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:53:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 19:53:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:53:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:53:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43248095
Fri 17 Jan 2014 19:53:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:53:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43248095
Fri 17 Jan 2014 19:53:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:54:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:54:01 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:54:03 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:54:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:54:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:54:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:54:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:54:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:54:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:54:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:54:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:54:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:54:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:54:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:54:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:54:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:54:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:54:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:54:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:54:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:54:07 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:54:07 - job_xml_thread(): Done retrieving: data size 43230709
Fri 17 Jan 2014 19:54:07 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:54:07 - XML: Start document: iteration 20
Fri 17 Jan 2014 19:54:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43230709
Fri 17 Jan 2014 19:54:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:54:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43230709
Fri 17 Jan 2014 19:54:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:54:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:54:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:54:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:54:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:54:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:54:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:54:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:54:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:54:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:54:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:54:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:54:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:54:26 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:54:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:54:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 19:54:27 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:54:27 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:54:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 19:54:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6781 values 106927 bits 13365 bytes 
Fri 17 Jan 2014 19:54:28 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 19:54:28 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:54:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:54:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:54:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:54:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:54:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:54:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:54:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:54:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:54:30 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:54:30 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:54:30 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 19:54:30 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 19:54:30 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 19:54:30 - XML: Processed 647414 elements - found 704 jobs
Fri 17 Jan 2014 19:54:30 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 19:54:30 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 19:54:30 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 19:54:30 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:54:30 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:54:31 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 870247 values 13741370 bits 1717671 bytes 
Fri 17 Jan 2014 19:54:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:54:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43625266
Fri 17 Jan 2014 19:54:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:54:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43625266
Fri 17 Jan 2014 19:54:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:54:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:54:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:54:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:54:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:54:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:54:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:54:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:54:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:54:45 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:54:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:54:45 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:54:45 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:54:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:54:45 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:54:49 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:54:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 19:54:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:54:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:54:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:54:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:54:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:54:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:54:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:54:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:54:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:54:53 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:54:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43834282
Fri 17 Jan 2014 19:54:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:54:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43834282
Fri 17 Jan 2014 19:54:54 - job_xml_thread(): Done retrieving: data size 43834282
Fri 17 Jan 2014 19:54:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:54:54 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:54:54 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 19:54:55 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 19:54:55 - Housekeeping: done.
Fri 17 Jan 2014 19:54:55 - XML: Start document: iteration 0
Fri 17 Jan 2014 19:55:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:55:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:55:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:55:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:55:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:55:09 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:55:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:55:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:55:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:55:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:55:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:55:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:55:09 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:55:14 - XML: Processed 655012 elements - found 704 jobs
Fri 17 Jan 2014 19:55:14 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:55:14 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:55:14 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:55:14 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:55:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:55:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:55:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:55:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:55:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:55:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:55:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:55:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:55:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:55:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43857485
Fri 17 Jan 2014 19:55:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:55:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43857485
Fri 17 Jan 2014 19:55:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:55:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:55:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:55:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:55:28 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:55:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:55:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 19:55:29 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:55:29 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:55:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8861 values 139716 bits 17464 bytes 
Fri 17 Jan 2014 19:55:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 19:55:29 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:55:29 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:55:30 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:55:30 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 19:55:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:55:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:55:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:55:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:55:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:55:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:55:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:55:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:55:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:55:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:55:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:55:35 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:55:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:55:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:55:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:55:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:55:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:55:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:55:39 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:55:39 - job_xml_thread(): Done retrieving: data size 43872917
Fri 17 Jan 2014 19:55:39 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:55:39 - XML: Start document: iteration 1
Fri 17 Jan 2014 19:55:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43872917
Fri 17 Jan 2014 19:55:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:55:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43872917
Fri 17 Jan 2014 19:55:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:55:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:55:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:55:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:55:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:55:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:55:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:55:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:55:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:55:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:55:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:55:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:55:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:55:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:55:59 - XML: Processed 655614 elements - found 704 jobs
Fri 17 Jan 2014 19:56:00 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:56:00 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:56:00 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:56:00 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:56:00 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:56:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 19:56:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:56:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:56:03 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:56:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:56:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:56:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:56:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:56:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:56:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:56:06 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:56:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43878814
Fri 17 Jan 2014 19:56:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:56:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43878814
Fri 17 Jan 2014 19:56:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:56:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:56:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:56:15 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:56:15 - job_xml_thread(): Done retrieving: data size 43878814
Fri 17 Jan 2014 19:56:15 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:56:15 - XML: Start document: iteration 2
Fri 17 Jan 2014 19:56:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:56:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:56:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:56:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:56:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:56:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:56:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:56:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:56:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:56:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:56:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:56:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:56:27 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:56:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:56:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:56:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:56:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:56:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:56:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:56:29 - XML: Processed 655614 elements - found 704 jobs
Fri 17 Jan 2014 19:56:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:56:29 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:56:29 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:56:29 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:56:29 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:56:29 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:56:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:56:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 19:56:29 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:56:29 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:56:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 19:56:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5951 values 93847 bits 11730 bytes 
Fri 17 Jan 2014 19:56:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:56:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43871918
Fri 17 Jan 2014 19:56:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:56:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43871918
Fri 17 Jan 2014 19:56:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:56:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:56:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:56:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:56:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:56:44 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:56:44 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:56:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:56:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:56:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:56:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:56:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:56:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:56:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:56:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:56:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:56:49 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:56:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:56:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:56:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:56:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:56:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:56:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:56:50 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:56:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 19:56:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:56:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:56:52 - job_xml_thread(): Done retrieving: data size 43885841
Fri 17 Jan 2014 19:56:52 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:56:52 - XML: Start document: iteration 3
Fri 17 Jan 2014 19:56:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43885841
Fri 17 Jan 2014 19:56:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:56:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43885841
Fri 17 Jan 2014 19:56:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:57:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:57:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:57:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:57:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:57:08 - XML: Processed 655614 elements - found 704 jobs
Fri 17 Jan 2014 19:57:08 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:57:08 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:57:08 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:57:08 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:57:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:57:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:57:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:57:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:57:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:57:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:57:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:57:09 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:57:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:57:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:57:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:57:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:57:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:57:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:57:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:57:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:57:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:57:17 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:57:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43879949
Fri 17 Jan 2014 19:57:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:57:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43879949
Fri 17 Jan 2014 19:57:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:57:23 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:57:23 - job_xml_thread(): Done retrieving: data size 43879949
Fri 17 Jan 2014 19:57:23 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:57:23 - XML: Start document: iteration 4
Fri 17 Jan 2014 19:57:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:57:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:57:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:57:29 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:57:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:57:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:57:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:57:30 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:57:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 19:57:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 19:57:30 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:57:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8208 values 129410 bits 16176 bytes 
Fri 17 Jan 2014 19:57:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:57:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:57:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:57:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:57:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:57:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:57:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:57:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:57:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:57:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:57:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:57:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:57:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:57:42 - XML: Processed 655614 elements - found 704 jobs
Fri 17 Jan 2014 19:57:42 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:57:42 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:57:42 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:57:42 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:57:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:57:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:57:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:57:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:57:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:57:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43878739
Fri 17 Jan 2014 19:57:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:57:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43878739
Fri 17 Jan 2014 19:57:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:57:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:57:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:57:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:57:56 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:57:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:57:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:57:56 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:57:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 19:57:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:57:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:57:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:57:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:57:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:57:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:57:57 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:57:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:57:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:58:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:58:01 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:58:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:58:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:58:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:58:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:58:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:58:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:58:03 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 19:58:03 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 19:58:03 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:58:04 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:58:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43878598
Fri 17 Jan 2014 19:58:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:58:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43878598
Fri 17 Jan 2014 19:58:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:58:05 - job_xml_thread(): Done retrieving: data size 43878598
Fri 17 Jan 2014 19:58:05 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:58:05 - XML: Start document: iteration 5
Fri 17 Jan 2014 19:58:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:58:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:58:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:58:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:58:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:58:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:58:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:58:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:58:15 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:58:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:58:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:58:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:58:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:58:22 - XML: Processed 655614 elements - found 704 jobs
Fri 17 Jan 2014 19:58:22 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:58:22 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:58:22 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:58:22 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:58:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:58:25 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:58:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:58:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:58:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:58:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:58:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:58:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:58:27 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:58:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43881237
Fri 17 Jan 2014 19:58:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:58:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43881237
Fri 17 Jan 2014 19:58:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:58:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:58:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:58:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:58:30 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:58:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:58:31 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:58:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 19:58:31 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:58:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9192 values 145026 bits 18128 bytes 
Fri 17 Jan 2014 19:58:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 19:58:37 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:58:37 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:58:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:58:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:58:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:58:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:58:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:58:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:58:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:58:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:58:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:58:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:58:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:58:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:58:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:58:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:58:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:58:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:58:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:58:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:58:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:58:43 - job_xml_thread(): Done retrieving: data size 43914605
Fri 17 Jan 2014 19:58:43 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:58:43 - XML: Start document: iteration 6
Fri 17 Jan 2014 19:58:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43914605
Fri 17 Jan 2014 19:58:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:58:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43914605
Fri 17 Jan 2014 19:58:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:58:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:58:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:58:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:58:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:58:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:58:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:58:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:58:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:58:59 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:58:59 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:58:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:58:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:58:59 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:59:03 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:59:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 19:59:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:59:05 - XML: Processed 655608 elements - found 704 jobs
Fri 17 Jan 2014 19:59:05 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:59:05 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:59:05 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:59:05 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:59:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:59:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:59:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:59:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:59:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:59:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:59:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:59:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:59:09 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:59:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875694
Fri 17 Jan 2014 19:59:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:59:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875694
Fri 17 Jan 2014 19:59:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:59:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:59:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:59:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:59:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:59:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:59:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:59:20 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:59:20 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:59:20 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:59:20 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:59:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:59:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:59:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:59:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:59:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:59:24 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:59:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:59:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:59:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:59:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:59:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:59:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:59:26 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:59:26 - job_xml_thread(): Done retrieving: data size 43826216
Fri 17 Jan 2014 19:59:26 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:59:26 - XML: Start document: iteration 7
Fri 17 Jan 2014 19:59:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43826216
Fri 17 Jan 2014 19:59:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43826216
Fri 17 Jan 2014 19:59:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:59:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:59:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:59:32 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:59:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:59:33 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:59:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 19:59:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 19:59:34 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:59:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9077 values 143151 bits 17893 bytes 
Fri 17 Jan 2014 19:59:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:59:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:59:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 19:59:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 19:59:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 19:59:43 - XML: Processed 654866 elements - found 704 jobs
Fri 17 Jan 2014 19:59:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 19:59:43 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 19:59:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 19:59:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:59:43 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 19:59:43 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 19:59:43 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 19:59:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:59:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 19:59:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 19:59:43 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 19:59:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 19:59:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 19:59:48 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 19:59:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 19:59:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 19:59:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:59:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 19:59:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 19:59:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 19:59:50 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 19:59:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 19:59:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 19:59:50 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 19:59:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43242155
Fri 17 Jan 2014 19:59:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 19:59:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43242155
Fri 17 Jan 2014 19:59:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 19:59:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 19:59:58 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 19:59:58 - job_xml_thread(): Done retrieving: data size 43242155
Fri 17 Jan 2014 19:59:58 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 19:59:58 - XML: Start document: iteration 8
Fri 17 Jan 2014 19:59:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:00:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:00:00 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:00:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:00:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:00:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:00:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:00:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:00:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:00:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:00:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:00:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:00:13 - XML: Processed 647896 elements - found 704 jobs
Fri 17 Jan 2014 20:00:14 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:00:14 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:00:14 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:00:14 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:00:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:00:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:00:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:00:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:00:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:00:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:00:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:00:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:00:16 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:00:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43222921
Fri 17 Jan 2014 20:00:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:00:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43222921
Fri 17 Jan 2014 20:00:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:00:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:00:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:00:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:00:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:00:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:00:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:00:25 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:00:25 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:00:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:00:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:00:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43222921
Fri 17 Jan 2014 20:00:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:00:29 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:00:29 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:00:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:00:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:00:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:00:34 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:00:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:00:34 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:00:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 20:00:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 20:00:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:00:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:00:35 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:00:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99039 bits 12379 bytes 
Fri 17 Jan 2014 20:00:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:00:37 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:00:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:00:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:00:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:00:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:00:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:00:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:00:39 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:00:39 - job_xml_thread(): Done retrieving: data size 43701204
Fri 17 Jan 2014 20:00:39 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:00:39 - XML: Start document: iteration 9
Fri 17 Jan 2014 20:00:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:00:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:00:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43701204
Fri 17 Jan 2014 20:00:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:00:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:00:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:00:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:00:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:00:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43701204
Fri 17 Jan 2014 20:00:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:00:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:00:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:00:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:00:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:00:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:00:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:00:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:00:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:00:59 - XML: Processed 653508 elements - found 704 jobs
Fri 17 Jan 2014 20:00:59 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:00:59 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:00:59 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:00:59 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:01:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:01:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:01:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:01:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:01:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:01:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:01:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:01:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:01:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:01:02 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:01:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 20:01:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:01:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:01:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:01:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:01:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:01:03 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:01:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43880659
Fri 17 Jan 2014 20:01:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:01:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43880659
Fri 17 Jan 2014 20:01:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:01:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:01:13 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:01:14 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:01:14 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:01:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:01:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:01:16 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:01:16 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:01:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:01:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:01:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:01:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:01:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:01:18 - job_xml_thread(): Done retrieving: data size 43877096
Fri 17 Jan 2014 20:01:18 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:01:18 - XML: Start document: iteration 10
Fri 17 Jan 2014 20:01:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43877096
Fri 17 Jan 2014 20:01:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:01:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:01:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:01:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:01:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:01:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:01:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:01:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43877096
Fri 17 Jan 2014 20:01:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:01:30 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 20:01:30 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:01:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:01:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:01:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:01:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:01:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:01:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:01:32 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:01:32 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:01:32 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 20:01:32 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 20:01:32 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 20:01:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:01:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:01:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:01:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:01:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:01:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:01:35 - XML: Processed 655614 elements - found 704 jobs
Fri 17 Jan 2014 20:01:35 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:01:35 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:01:35 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:01:35 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:01:35 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:01:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:01:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:01:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:01:36 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:01:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 20:01:36 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:01:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 20:01:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8855 values 139685 bits 17460 bytes 
Fri 17 Jan 2014 20:01:36 - size of cluster 'LISA Cluster': 624 hosts 79475 metrics 850163 values 13422380 bits 1677797 bytes 
Fri 17 Jan 2014 20:01:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:01:38 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:01:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:01:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:01:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:01:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:01:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:01:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:01:41 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:01:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 20:01:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:01:42 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:01:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43891337
Fri 17 Jan 2014 20:01:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:01:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43891337
Fri 17 Jan 2014 20:01:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:01:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:01:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:01:50 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:01:51 - job_xml_thread(): Done retrieving: data size 43891337
Fri 17 Jan 2014 20:01:51 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:01:51 - XML: Start document: iteration 11
Fri 17 Jan 2014 20:01:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:01:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:01:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:01:54 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:01:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:01:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:01:56 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:01:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:01:56 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:01:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:01:56 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:02:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:02:03 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:02:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:02:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:02:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:02:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:02:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:02:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:02:05 - XML: Processed 655614 elements - found 704 jobs
Fri 17 Jan 2014 20:02:05 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:02:05 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:02:05 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:02:05 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:02:08 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:02:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43869517
Fri 17 Jan 2014 20:02:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:02:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43869517
Fri 17 Jan 2014 20:02:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:02:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:02:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:02:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:02:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:02:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:02:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:02:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:02:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:02:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:02:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:02:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:02:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:02:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:02:20 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:02:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:02:23 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:02:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:02:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:02:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:02:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:02:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:02:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:02:26 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:02:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43904472
Fri 17 Jan 2014 20:02:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:02:27 - job_xml_thread(): Done retrieving: data size 43904472
Fri 17 Jan 2014 20:02:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43904472
Fri 17 Jan 2014 20:02:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:02:28 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:02:28 - XML: Start document: iteration 12
Fri 17 Jan 2014 20:02:32 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:02:32 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 20:02:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:02:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:02:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:02:37 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:02:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:02:38 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:02:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 20:02:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 20:02:38 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:02:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 149042 bits 18630 bytes 
Fri 17 Jan 2014 20:02:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:02:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:02:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:02:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:02:39 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:02:39 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:02:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:02:39 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:02:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:02:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:02:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:02:47 - XML: Processed 655614 elements - found 704 jobs
Fri 17 Jan 2014 20:02:47 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:02:48 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:02:48 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:02:48 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:02:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:02:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:02:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:02:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:02:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:02:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:02:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:02:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:02:54 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:02:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43859678
Fri 17 Jan 2014 20:02:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:02:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43859678
Fri 17 Jan 2014 20:02:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:02:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:02:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:03:03 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:03:03 - job_xml_thread(): Done retrieving: data size 43859678
Fri 17 Jan 2014 20:03:03 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:03:03 - XML: Start document: iteration 13
Fri 17 Jan 2014 20:03:04 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:03:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 20:03:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:03:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:03:06 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:03:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:03:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:03:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:03:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:03:07 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:03:07 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:03:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:03:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:03:07 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:03:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:03:15 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:03:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:03:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:03:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:03:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:03:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:03:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:03:17 - XML: Processed 655614 elements - found 704 jobs
Fri 17 Jan 2014 20:03:17 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:03:17 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:03:17 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:03:17 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:03:21 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:03:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856965
Fri 17 Jan 2014 20:03:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:03:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43856965
Fri 17 Jan 2014 20:03:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:03:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:03:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:03:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:03:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:03:32 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:03:32 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:03:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:03:34 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:03:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:03:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:03:35 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:03:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:03:35 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:03:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:03:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:03:37 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:03:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:03:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:03:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:03:38 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:03:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:03:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:03:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:03:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:03:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:03:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 20:03:39 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:03:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 20:03:39 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:03:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6009 values 95006 bits 11875 bytes 
Fri 17 Jan 2014 20:03:40 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:03:40 - job_xml_thread(): Done retrieving: data size 43891248
Fri 17 Jan 2014 20:03:40 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:03:40 - XML: Start document: iteration 14
Fri 17 Jan 2014 20:03:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43891248
Fri 17 Jan 2014 20:03:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:03:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43891248
Fri 17 Jan 2014 20:03:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:03:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:03:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:03:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:03:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:03:54 - XML: Processed 655614 elements - found 704 jobs
Fri 17 Jan 2014 20:03:54 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:03:54 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:03:54 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:03:54 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:04:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:04:01 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:04:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:04:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:04:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:04:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:04:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:04:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:04:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:04:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:04:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:04:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:04:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:04:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:04:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:04:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:04:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:04:07 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:04:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 20:04:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:04:08 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:04:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43900458
Fri 17 Jan 2014 20:04:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:04:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43900458
Fri 17 Jan 2014 20:04:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:04:10 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:04:10 - job_xml_thread(): Done retrieving: data size 43900458
Fri 17 Jan 2014 20:04:10 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:04:10 - XML: Start document: iteration 15
Fri 17 Jan 2014 20:04:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:04:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:04:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:04:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:04:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:04:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:04:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:04:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:04:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:04:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:04:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:04:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:04:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:04:26 - XML: Processed 655618 elements - found 706 jobs
Fri 17 Jan 2014 20:04:26 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 20:04:26 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 20:04:26 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 20:04:26 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:04:26 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:04:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:04:31 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:04:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:04:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:04:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:04:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:04:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:04:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:04:33 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:04:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856674
Fri 17 Jan 2014 20:04:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:04:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43856674
Fri 17 Jan 2014 20:04:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:04:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:04:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:04:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:04:39 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:04:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:04:40 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:04:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 20:04:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 20:04:40 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:04:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7602 values 119858 bits 14982 bytes 
Fri 17 Jan 2014 20:04:42 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:04:42 - job_xml_thread(): Done retrieving: data size 43856674
Fri 17 Jan 2014 20:04:42 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:04:42 - XML: Start document: iteration 16
Fri 17 Jan 2014 20:04:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:04:45 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:04:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:04:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:04:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:04:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:04:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:04:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:04:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:04:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:04:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:04:54 - XML: Processed 655618 elements - found 706 jobs
Fri 17 Jan 2014 20:04:54 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:04:54 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:04:54 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:04:54 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:04:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:04:57 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:04:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:04:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:04:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:04:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:04:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:04:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:04:58 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 20:04:58 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 20:04:58 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:05:00 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:05:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43879056
Fri 17 Jan 2014 20:05:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:05:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43879056
Fri 17 Jan 2014 20:05:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:05:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:05:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:05:09 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:05:09 - job_xml_thread(): Done retrieving: data size 43879056
Fri 17 Jan 2014 20:05:09 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:05:09 - XML: Start document: iteration 17
Fri 17 Jan 2014 20:05:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:05:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:05:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:05:13 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:05:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:05:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:05:14 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:05:14 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:05:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:05:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:05:14 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:05:20 - XML: Processed 655618 elements - found 706 jobs
Fri 17 Jan 2014 20:05:20 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:05:20 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:05:20 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:05:20 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:05:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:05:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:05:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:05:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:05:22 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:05:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 20:05:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:05:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:05:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:05:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:05:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:05:24 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:05:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43812442
Fri 17 Jan 2014 20:05:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:05:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43812442
Fri 17 Jan 2014 20:05:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:05:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:05:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:05:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:05:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:05:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:05:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:05:35 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:05:35 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:05:35 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:05:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:05:35 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:05:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:05:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:05:38 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:05:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:05:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:05:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:05:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:05:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:05:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:05:39 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:05:39 - job_xml_thread(): Done retrieving: data size 43354658
Fri 17 Jan 2014 20:05:39 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:05:39 - XML: Start document: iteration 18
Fri 17 Jan 2014 20:05:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43354658
Fri 17 Jan 2014 20:05:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:05:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43354658
Fri 17 Jan 2014 20:05:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:05:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:05:40 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:05:41 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:05:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:05:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 20:05:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 20:05:41 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:05:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5860 values 92408 bits 11551 bytes 
Fri 17 Jan 2014 20:05:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:05:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:05:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:05:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:05:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:05:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:05:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:05:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:05:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:05:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:05:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:05:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:05:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:05:59 - XML: Processed 648720 elements - found 706 jobs
Fri 17 Jan 2014 20:05:59 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:05:59 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:05:59 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:05:59 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:06:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:06:01 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:06:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:06:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:06:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:06:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:06:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:06:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:06:04 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:06:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 20:06:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:06:04 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:06:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43216962
Fri 17 Jan 2014 20:06:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:06:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43216962
Fri 17 Jan 2014 20:06:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:06:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:06:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:06:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:06:14 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:06:14 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:06:14 - job_xml_thread(): Done retrieving: data size 43216962
Fri 17 Jan 2014 20:06:14 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:06:14 - XML: Start document: iteration 19
Fri 17 Jan 2014 20:06:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:06:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:06:16 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:06:16 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:06:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:06:16 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:06:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:06:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:06:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:06:22 - XML: Processed 647420 elements - found 707 jobs
Fri 17 Jan 2014 20:06:22 - job 7335202 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 20:06:22 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 20:06:22 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 20:06:23 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 20:06:23 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:06:23 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:06:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:06:24 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:06:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:06:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:06:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:06:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:06:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:06:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:06:26 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:06:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43291743
Fri 17 Jan 2014 20:06:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:06:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43291743
Fri 17 Jan 2014 20:06:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:06:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:06:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:06:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:06:38 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:06:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:06:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:06:38 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:06:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:06:39 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:06:39 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:06:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:06:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:06:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:06:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:06:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:06:41 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:06:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:06:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:06:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:06:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:06:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:06:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 20:06:42 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:06:42 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:06:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 20:06:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6281 values 99059 bits 12382 bytes 
Fri 17 Jan 2014 20:06:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:06:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:06:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:06:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:06:44 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:06:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 20:06:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:06:44 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:06:44 - job_xml_thread(): Done retrieving: data size 43715361
Fri 17 Jan 2014 20:06:44 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:06:44 - XML: Start document: iteration 20
Fri 17 Jan 2014 20:06:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43715361
Fri 17 Jan 2014 20:06:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:06:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43715361
Fri 17 Jan 2014 20:06:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:06:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:06:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:06:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:06:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:07:02 - XML: Processed 653376 elements - found 707 jobs
Fri 17 Jan 2014 20:07:02 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:07:02 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:07:02 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:07:02 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:07:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:07:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:07:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:07:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:07:06 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:07:06 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:07:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:07:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:07:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:07:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:07:08 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:07:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:07:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:07:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:07:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:07:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:07:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:07:10 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:07:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43911609
Fri 17 Jan 2014 20:07:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:07:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43911609
Fri 17 Jan 2014 20:07:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:07:18 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:07:18 - job_xml_thread(): Done retrieving: data size 43911609
Fri 17 Jan 2014 20:07:18 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:07:18 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 20:07:21 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 20:07:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:07:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:07:21 - Housekeeping: done.
Fri 17 Jan 2014 20:07:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:07:21 - XML: Start document: iteration 0
Fri 17 Jan 2014 20:07:21 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:07:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:07:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:07:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:07:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:07:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:07:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:07:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:07:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:07:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:07:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:07:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:07:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:07:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:07:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:07:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:07:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:07:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:07:31 - XML: Processed 655620 elements - found 707 jobs
Fri 17 Jan 2014 20:07:31 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:07:31 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:07:31 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:07:31 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:07:33 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:07:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858273
Fri 17 Jan 2014 20:07:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:07:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43858273
Fri 17 Jan 2014 20:07:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:07:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:07:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:07:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:07:42 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:07:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:07:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:07:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:07:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 20:07:44 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:07:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148624 bits 18578 bytes 
Fri 17 Jan 2014 20:07:44 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:07:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:07:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 20:07:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:07:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:07:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:07:45 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:07:45 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:07:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:07:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:07:45 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:07:46 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:07:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:07:49 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:07:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:07:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:07:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:07:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:07:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:07:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:07:51 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:07:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43883659
Fri 17 Jan 2014 20:07:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:07:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43883659
Fri 17 Jan 2014 20:07:51 - job_xml_thread(): Done retrieving: data size 43883659
Fri 17 Jan 2014 20:07:51 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:07:51 - XML: Start document: iteration 1
Fri 17 Jan 2014 20:07:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:08:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:08:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:08:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:08:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:08:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:08:07 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:08:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:08:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:08:07 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:08:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:08:07 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:08:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:08:07 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:08:14 - XML: Processed 655620 elements - found 707 jobs
Fri 17 Jan 2014 20:08:14 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:08:14 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:08:14 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:08:14 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:08:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:08:15 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:08:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:08:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:08:15 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:08:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 20:08:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:08:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:08:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:08:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:08:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:08:17 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:08:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870080
Fri 17 Jan 2014 20:08:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:08:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870080
Fri 17 Jan 2014 20:08:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:08:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:08:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:08:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:08:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:08:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:08:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:08:29 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:08:29 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:08:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:08:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:08:29 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:08:29 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:08:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:08:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:08:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:08:31 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:08:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:08:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:08:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:08:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:08:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:08:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:08:32 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 20:08:32 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:08:33 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:08:33 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:08:33 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 20:08:33 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 20:08:33 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 20:08:34 - size of cluster 'LISA Cluster': 624 hosts 79464 metrics 792549 values 12516830 bits 1564603 bytes 
Fri 17 Jan 2014 20:08:34 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:08:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43882338
Fri 17 Jan 2014 20:08:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:08:34 - job_xml_thread(): Done retrieving: data size 43882338
Fri 17 Jan 2014 20:08:34 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:08:34 - XML: Start document: iteration 2
Fri 17 Jan 2014 20:08:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43882338
Fri 17 Jan 2014 20:08:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:08:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:08:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:08:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:08:44 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:08:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:08:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 20:08:44 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:08:44 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:08:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 20:08:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8558 values 134847 bits 16855 bytes 
Fri 17 Jan 2014 20:08:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:08:46 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:08:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:08:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:08:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:08:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:08:47 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:08:47 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:08:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:08:47 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:08:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:08:52 - XML: Processed 655618 elements - found 706 jobs
Fri 17 Jan 2014 20:08:52 - job 7335117 appears to have finished
Fri 17 Jan 2014 20:08:52 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 20:08:52 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 20:08:52 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 20:08:52 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:08:52 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:08:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:08:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:08:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:08:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:08:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:08:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:08:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:08:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:09:01 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:09:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875319
Fri 17 Jan 2014 20:09:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:09:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875319
Fri 17 Jan 2014 20:09:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:09:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:09:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:09:07 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:09:07 - job_xml_thread(): Done retrieving: data size 43875319
Fri 17 Jan 2014 20:09:07 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:09:07 - XML: Start document: iteration 3
Fri 17 Jan 2014 20:09:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:09:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:09:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:09:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:09:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:09:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:09:15 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:09:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:09:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:09:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:09:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 20:09:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:09:15 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:09:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:09:20 - XML: Processed 655615 elements - found 706 jobs
Fri 17 Jan 2014 20:09:20 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:09:20 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:09:20 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:09:20 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:09:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:09:24 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:09:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:09:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:09:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:09:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:09:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:09:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:09:27 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:09:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43876816
Fri 17 Jan 2014 20:09:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:09:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43876816
Fri 17 Jan 2014 20:09:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:09:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:09:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:09:33 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:09:33 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 20:09:36 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:09:36 - job_xml_thread(): Done retrieving: data size 43876816
Fri 17 Jan 2014 20:09:36 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:09:36 - XML: Start document: iteration 4
Fri 17 Jan 2014 20:09:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:09:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:09:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:09:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:09:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:09:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:09:39 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:09:39 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:09:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:09:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:09:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:09:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:09:44 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:09:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:09:45 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:09:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 20:09:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 20:09:45 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:09:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6032 values 95132 bits 11891 bytes 
Fri 17 Jan 2014 20:09:46 - XML: Processed 655618 elements - found 706 jobs
Fri 17 Jan 2014 20:09:46 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:09:46 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:09:46 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:09:46 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:09:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:09:49 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:09:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:09:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:09:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:09:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:09:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:09:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:09:53 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:09:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43861654
Fri 17 Jan 2014 20:09:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:09:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:09:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:09:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43861654
Fri 17 Jan 2014 20:09:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:10:02 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:10:02 - job_xml_thread(): Done retrieving: data size 43861654
Fri 17 Jan 2014 20:10:02 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:10:03 - XML: Start document: iteration 5
Fri 17 Jan 2014 20:10:05 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:10:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 20:10:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:10:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:10:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:10:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:10:06 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:10:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:10:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:10:07 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:10:07 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:10:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:10:07 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:10:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:10:15 - XML: Processed 655618 elements - found 706 jobs
Fri 17 Jan 2014 20:10:15 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:10:15 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:10:15 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:10:15 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:10:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:10:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:10:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:10:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:10:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:10:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:10:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:10:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:10:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:10:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43852927
Fri 17 Jan 2014 20:10:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:10:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43852927
Fri 17 Jan 2014 20:10:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:10:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:10:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:10:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:10:29 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:10:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:10:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:10:30 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:10:30 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:10:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:10:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:10:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:10:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:10:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:10:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:10:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:10:35 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:10:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:10:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:10:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:10:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:10:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:10:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:10:38 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:10:38 - job_xml_thread(): Done retrieving: data size 43884076
Fri 17 Jan 2014 20:10:38 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:10:38 - XML: Start document: iteration 6
Fri 17 Jan 2014 20:10:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43884076
Fri 17 Jan 2014 20:10:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43884076
Fri 17 Jan 2014 20:10:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:10:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:10:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:10:45 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:10:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:10:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:10:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:10:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 20:10:46 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:10:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 20:10:46 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:10:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9262 values 146073 bits 18259 bytes 
Fri 17 Jan 2014 20:10:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:10:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:10:52 - XML: Processed 655618 elements - found 706 jobs
Fri 17 Jan 2014 20:10:52 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:10:52 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:10:52 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:10:52 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:10:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:10:58 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:10:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:10:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:10:59 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:10:59 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:10:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:10:59 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:10:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:11:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:11:03 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:11:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:11:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:11:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:11:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:11:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:11:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:11:06 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:11:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43885374
Fri 17 Jan 2014 20:11:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:11:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43885374
Fri 17 Jan 2014 20:11:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:11:07 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:11:07 - job_xml_thread(): Done retrieving: data size 43885374
Fri 17 Jan 2014 20:11:07 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:11:07 - XML: Start document: iteration 7
Fri 17 Jan 2014 20:11:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:11:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:11:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:11:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:11:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:11:27 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:11:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:11:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:11:28 - XML: Processed 655618 elements - found 706 jobs
Fri 17 Jan 2014 20:11:28 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:11:28 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:11:28 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:11:28 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:11:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:11:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:11:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:11:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:11:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:11:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:11:31 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:11:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:11:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:11:31 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:11:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 20:11:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:11:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:11:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:11:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:11:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:11:34 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:11:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43407558
Fri 17 Jan 2014 20:11:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:11:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43407558
Fri 17 Jan 2014 20:11:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:11:43 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:11:43 - job_xml_thread(): Done retrieving: data size 43407558
Fri 17 Jan 2014 20:11:43 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:11:43 - XML: Start document: iteration 8
Fri 17 Jan 2014 20:11:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:11:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:11:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:11:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:11:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:11:46 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:11:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:11:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 20:11:47 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:11:47 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:11:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 20:11:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5800 values 91460 bits 11432 bytes 
Fri 17 Jan 2014 20:11:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:11:49 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:11:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:11:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:11:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:11:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:11:49 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:11:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:11:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:11:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:11:56 - XML: Processed 649718 elements - found 706 jobs
Fri 17 Jan 2014 20:11:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:11:56 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:11:56 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:11:56 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:11:56 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:11:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:11:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:11:57 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 20:11:57 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 20:11:57 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:11:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:11:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:11:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:11:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:11:58 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:11:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 20:11:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:11:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:11:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43232632
Fri 17 Jan 2014 20:11:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:11:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43232632
Fri 17 Jan 2014 20:11:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:12:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:12:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:12:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:12:09 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:12:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:12:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:12:12 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:12:12 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:12:12 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:12:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:12:12 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:12:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:12:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:12:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:12:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:12:13 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:12:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:12:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:12:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:12:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:12:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:12:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:12:14 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:12:14 - job_xml_thread(): Done retrieving: data size 43253221
Fri 17 Jan 2014 20:12:14 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:12:14 - XML: Start document: iteration 9
Fri 17 Jan 2014 20:12:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43253221
Fri 17 Jan 2014 20:12:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:12:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43253221
Fri 17 Jan 2014 20:12:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:12:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:12:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:12:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:12:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:12:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:12:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:12:27 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:12:27 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:12:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:12:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:12:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:12:31 - XML: Processed 647526 elements - found 706 jobs
Fri 17 Jan 2014 20:12:31 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:12:31 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:12:31 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:12:31 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:12:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:12:35 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:12:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:12:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:12:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:12:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:12:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:12:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:12:37 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:12:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43727378
Fri 17 Jan 2014 20:12:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:12:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43727378
Fri 17 Jan 2014 20:12:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:12:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:12:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:12:46 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:12:46 - job_xml_thread(): Done retrieving: data size 43727378
Fri 17 Jan 2014 20:12:46 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:12:46 - XML: Start document: iteration 10
Fri 17 Jan 2014 20:12:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:12:48 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:12:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:12:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:12:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:12:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:12:48 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:12:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:12:48 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:12:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:12:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:12:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:12:50 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:12:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 20:12:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 20:12:50 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:12:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9268 values 146195 bits 18274 bytes 
Fri 17 Jan 2014 20:12:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:12:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:12:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:12:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:12:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:12:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:12:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:12:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:12:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:12:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:13:00 - XML: Processed 653926 elements - found 706 jobs
Fri 17 Jan 2014 20:13:00 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:13:00 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:13:00 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:13:00 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:13:02 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:13:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 20:13:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:13:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:13:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43836027
Fri 17 Jan 2014 20:13:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:13:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43836027
Fri 17 Jan 2014 20:13:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:13:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:13:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:13:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:13:14 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:13:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:13:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:13:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:13:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:13:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:13:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:13:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:13:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:13:15 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:13:15 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:13:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:13:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:13:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:13:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:13:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:13:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:13:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:13:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:13:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:13:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43884822
Fri 17 Jan 2014 20:13:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:13:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43884822
Fri 17 Jan 2014 20:13:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:13:19 - job_xml_thread(): Done retrieving: data size 43884822
Fri 17 Jan 2014 20:13:19 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:13:20 - XML: Start document: iteration 11
Fri 17 Jan 2014 20:13:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:13:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:13:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:13:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:13:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:13:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:13:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:13:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:13:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:13:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:13:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:13:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:13:34 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:13:39 - XML: Processed 655618 elements - found 706 jobs
Fri 17 Jan 2014 20:13:39 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:13:39 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:13:39 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:13:39 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:13:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:13:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:13:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:13:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:13:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:13:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:13:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:13:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:13:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:13:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43882797
Fri 17 Jan 2014 20:13:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:13:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43882797
Fri 17 Jan 2014 20:13:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:13:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:13:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:13:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:13:50 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:13:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:13:50 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:13:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 20:13:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 20:13:51 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:13:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9279 values 146333 bits 18291 bytes 
Fri 17 Jan 2014 20:13:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:13:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:13:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:13:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:13:53 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:13:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:13:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:13:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:13:53 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:13:54 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:13:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:13:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:13:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:13:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:13:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:13:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:13:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:13:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:13:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:13:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43904840
Fri 17 Jan 2014 20:13:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:13:58 - job_xml_thread(): Done retrieving: data size 43904840
Fri 17 Jan 2014 20:13:58 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:13:59 - XML: Start document: iteration 12
Fri 17 Jan 2014 20:13:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43904840
Fri 17 Jan 2014 20:13:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:14:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:14:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:14:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:14:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:14:17 - XML: Processed 655618 elements - found 706 jobs
Fri 17 Jan 2014 20:14:18 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:14:18 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:14:18 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:14:18 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:14:19 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:14:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 20:14:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:14:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:14:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:14:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:14:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:14:20 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:14:20 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:14:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:14:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:14:20 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:14:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:14:21 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:14:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:14:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:14:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:14:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:14:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:14:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:14:22 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:14:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43893338
Fri 17 Jan 2014 20:14:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:14:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43893338
Fri 17 Jan 2014 20:14:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:14:33 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:14:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:14:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:14:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:14:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:14:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:14:35 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:14:35 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:14:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:14:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:14:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:14:36 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:14:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:14:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:14:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:14:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:14:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:14:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:14:38 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:14:38 - job_xml_thread(): Done retrieving: data size 43890949
Fri 17 Jan 2014 20:14:38 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:14:38 - XML: Start document: iteration 13
Fri 17 Jan 2014 20:14:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43890949
Fri 17 Jan 2014 20:14:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:14:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43890949
Fri 17 Jan 2014 20:14:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:14:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:14:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:14:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:14:51 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:14:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:14:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 20:14:51 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:14:51 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:14:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 20:14:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:14:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:14:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9357 values 147632 bits 18454 bytes 
Fri 17 Jan 2014 20:14:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:14:53 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:14:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:14:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:14:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:14:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:14:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:14:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:14:55 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:14:59 - XML: Processed 655618 elements - found 706 jobs
Fri 17 Jan 2014 20:14:59 - job 7348616 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 20:14:59 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 20:14:59 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 20:15:00 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 20:15:00 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:15:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:15:01 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:15:01 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:15:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:15:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:15:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:15:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:15:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:15:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:15:03 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:15:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870728
Fri 17 Jan 2014 20:15:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:15:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870728
Fri 17 Jan 2014 20:15:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:15:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:15:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:15:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:15:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:15:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:15:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:15:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:15:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:15:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:15:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:15:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870728
Fri 17 Jan 2014 20:15:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:15:16 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:15:16 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:15:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:15:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:15:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:15:24 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:15:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:15:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:15:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:15:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:15:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:15:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:15:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:15:25 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:15:25 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:15:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 20:15:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:15:27 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:15:27 - job_xml_thread(): Done retrieving: data size 43881967
Fri 17 Jan 2014 20:15:27 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:15:27 - XML: Start document: iteration 14
Fri 17 Jan 2014 20:15:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43881967
Fri 17 Jan 2014 20:15:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:15:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:15:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:15:29 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:15:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:15:29 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:15:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43881967
Fri 17 Jan 2014 20:15:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:15:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:15:34 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 20:15:34 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:15:36 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:15:36 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:15:37 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 20:15:37 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 20:15:37 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Fri 17 Jan 2014 20:15:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:15:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:15:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:15:42 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:15:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:15:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:15:45 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:15:45 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:15:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:15:45 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:15:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:15:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:15:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:15:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:15:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:15:49 - XML: Processed 655618 elements - found 706 jobs
Fri 17 Jan 2014 20:15:49 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:15:49 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:15:49 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:15:49 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:15:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:15:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:15:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:15:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:15:51 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:15:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43896272
Fri 17 Jan 2014 20:15:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:15:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43896272
Fri 17 Jan 2014 20:15:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:15:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:15:52 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:15:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:15:53 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:15:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 20:15:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 20:15:53 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:15:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8999 values 141948 bits 17743 bytes 
Fri 17 Jan 2014 20:16:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:16:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:16:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:16:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:16:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:16:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:16:04 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:16:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:16:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:16:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:16:04 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:16:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:16:04 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:16:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:16:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:16:06 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:16:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:16:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:16:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:16:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:16:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:16:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:16:08 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:16:08 - job_xml_thread(): Done retrieving: data size 43901287
Fri 17 Jan 2014 20:16:08 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:16:08 - XML: Start document: iteration 15
Fri 17 Jan 2014 20:16:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43901287
Fri 17 Jan 2014 20:16:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:16:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43901287
Fri 17 Jan 2014 20:16:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:16:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:16:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:16:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:16:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:16:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:16:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:16:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:16:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:16:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:16:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:16:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:16:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:16:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:16:26 - XML: Processed 655616 elements - found 705 jobs
Fri 17 Jan 2014 20:16:26 - job 7348342 appears to have finished
Fri 17 Jan 2014 20:16:26 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 20:16:26 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 20:16:26 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 20:16:26 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:16:26 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:16:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:16:30 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:16:30 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:16:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 20:16:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:16:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:16:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:16:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:16:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:16:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:16:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:16:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:16:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865656
Fri 17 Jan 2014 20:16:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:16:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43865656
Fri 17 Jan 2014 20:16:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:16:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:16:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:16:37 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:16:38 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:16:39 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:16:39 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 20:16:39 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 20:16:39 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:16:39 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Fri 17 Jan 2014 20:16:41 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:16:41 - job_xml_thread(): Done retrieving: data size 43865656
Fri 17 Jan 2014 20:16:41 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:16:41 - XML: Start document: iteration 16
Fri 17 Jan 2014 20:16:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:16:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:16:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:16:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:16:45 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:16:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:16:45 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:16:45 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:16:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:16:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:16:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:16:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:16:53 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:16:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:16:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 20:16:54 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:16:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5741 values 90672 bits 11334 bytes 
Fri 17 Jan 2014 20:16:54 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:16:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 20:16:55 - XML: Processed 655616 elements - found 705 jobs
Fri 17 Jan 2014 20:16:55 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:16:55 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:16:55 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:16:55 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:16:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:16:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:16:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:16:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:16:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:16:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:16:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:16:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:16:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:16:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43884511
Fri 17 Jan 2014 20:16:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:16:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43884511
Fri 17 Jan 2014 20:16:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:17:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:17:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:17:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:17:09 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:17:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:17:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:17:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:17:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:17:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:17:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:17:10 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:17:10 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:17:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:17:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:17:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:17:12 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:17:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:17:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:17:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:17:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:17:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:17:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:17:13 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:17:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 20:17:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:17:14 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:17:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43842042
Fri 17 Jan 2014 20:17:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:17:15 - job_xml_thread(): Done retrieving: data size 43842042
Fri 17 Jan 2014 20:17:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43842042
Fri 17 Jan 2014 20:17:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:17:15 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:17:15 - XML: Start document: iteration 17
Fri 17 Jan 2014 20:17:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:17:25 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:17:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:17:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:17:25 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:17:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:17:25 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:17:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:17:25 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:17:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:17:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:17:30 - XML: Processed 654868 elements - found 705 jobs
Fri 17 Jan 2014 20:17:30 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:17:30 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:17:30 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:17:30 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:17:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:17:35 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:17:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:17:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:17:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:17:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:17:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:17:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:17:37 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:17:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43684686
Fri 17 Jan 2014 20:17:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:17:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43684686
Fri 17 Jan 2014 20:17:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:17:40 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:17:40 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:17:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:17:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:17:41 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:17:41 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 20:17:41 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 20:17:41 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:17:41 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 20:17:46 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:17:46 - job_xml_thread(): Done retrieving: data size 43684686
Fri 17 Jan 2014 20:17:46 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:17:46 - XML: Start document: iteration 18
Fri 17 Jan 2014 20:17:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:17:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:17:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:17:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:17:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:17:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:17:51 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:17:51 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:17:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:17:51 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:17:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:17:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:17:55 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:17:55 - size of cluster 'LISA Cluster': 624 hosts 79485 metrics 989411 values 15631223 bits 1953902 bytes 
Fri 17 Jan 2014 20:17:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:17:55 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:17:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 20:17:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 20:17:55 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:17:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8790 values 139213 bits 17401 bytes 
Fri 17 Jan 2014 20:17:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:17:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:17:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:17:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:17:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:17:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:17:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:17:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:18:00 - XML: Processed 653359 elements - found 705 jobs
Fri 17 Jan 2014 20:18:00 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:18:00 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:18:00 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:18:00 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:18:04 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:18:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43214026
Fri 17 Jan 2014 20:18:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:18:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:18:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43214026
Fri 17 Jan 2014 20:18:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:18:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:18:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:18:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:18:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:18:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:18:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:18:14 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:18:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:18:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:18:14 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:18:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:18:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43214026
Fri 17 Jan 2014 20:18:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:18:16 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:18:16 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:18:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:18:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:18:26 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:18:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 20:18:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:18:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:18:26 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:18:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:18:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:18:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:18:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:18:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:18:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:18:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:18:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:18:29 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:18:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:18:29 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:18:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:18:30 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:18:30 - job_xml_thread(): Done retrieving: data size 43314167
Fri 17 Jan 2014 20:18:30 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:18:30 - XML: Start document: iteration 19
Fri 17 Jan 2014 20:18:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43314167
Fri 17 Jan 2014 20:18:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:18:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43314167
Fri 17 Jan 2014 20:18:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:18:41 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:18:41 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 20:18:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:18:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:18:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:18:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:18:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:18:45 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:18:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:18:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:18:45 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:18:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:18:45 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:18:45 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:18:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:18:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:18:52 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:18:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:18:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:18:53 - XML: Processed 648529 elements - found 705 jobs
Fri 17 Jan 2014 20:18:53 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:18:53 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:18:53 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:18:53 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:18:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:18:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:18:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:18:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:18:55 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 20:18:55 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 20:18:55 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:18:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:18:56 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:18:56 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:18:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43843661
Fri 17 Jan 2014 20:18:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:18:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43843661
Fri 17 Jan 2014 20:18:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:18:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:18:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 20:18:57 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:18:57 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:18:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 20:18:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6005 values 94894 bits 11861 bytes 
Fri 17 Jan 2014 20:19:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:19:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:19:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:19:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:19:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:19:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:19:06 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:19:06 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:19:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:19:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:19:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:19:08 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:19:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:19:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:19:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:19:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:19:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:19:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:19:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:19:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:19:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:19:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:19:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:19:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43891910
Fri 17 Jan 2014 20:19:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:19:13 - job_xml_thread(): Done retrieving: data size 43891910
Fri 17 Jan 2014 20:19:13 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:19:13 - XML: Start document: iteration 20
Fri 17 Jan 2014 20:19:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43891910
Fri 17 Jan 2014 20:19:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:19:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:19:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:19:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:19:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:19:28 - XML: Processed 655616 elements - found 705 jobs
Fri 17 Jan 2014 20:19:28 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:19:28 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:19:28 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:19:28 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:19:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:19:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:19:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:19:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:19:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:19:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:19:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:19:34 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:19:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:19:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:19:35 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:19:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:19:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:19:36 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:19:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 20:19:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:19:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:19:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:19:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:19:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:19:37 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:19:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43890608
Fri 17 Jan 2014 20:19:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:19:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43890608
Fri 17 Jan 2014 20:19:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:19:43 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:19:43 - job_xml_thread(): Done retrieving: data size 43890608
Fri 17 Jan 2014 20:19:43 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:19:44 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 20:19:45 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 20:19:45 - Housekeeping: done.
Fri 17 Jan 2014 20:19:45 - XML: Start document: iteration 0
Fri 17 Jan 2014 20:19:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:19:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:19:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:19:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:19:50 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:19:50 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:19:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:19:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:19:50 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:19:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:19:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:19:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:19:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:19:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:19:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:19:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:19:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:19:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:19:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:19:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:19:57 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:19:58 - XML: Processed 655616 elements - found 705 jobs
Fri 17 Jan 2014 20:19:58 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:19:58 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:19:58 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:19:58 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:19:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:19:58 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:19:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 20:19:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 20:19:58 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:19:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5895 values 92983 bits 11622 bytes 
Fri 17 Jan 2014 20:20:00 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:20:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43882593
Fri 17 Jan 2014 20:20:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:20:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43882593
Fri 17 Jan 2014 20:20:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:20:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:20:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:20:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:20:09 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:20:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:20:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:20:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:20:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:20:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:20:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:20:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43882593
Fri 17 Jan 2014 20:20:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:20:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:20:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:20:13 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:20:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:20:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:20:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:20:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:20:21 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:20:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:20:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:20:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:20:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:20:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:20:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:20:22 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:20:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 20:20:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:20:23 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:20:23 - job_xml_thread(): Done retrieving: data size 43872485
Fri 17 Jan 2014 20:20:23 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:20:23 - XML: Start document: iteration 1
Fri 17 Jan 2014 20:20:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43872485
Fri 17 Jan 2014 20:20:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:20:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:20:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:20:26 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:20:26 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:20:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:20:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:20:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43872485
Fri 17 Jan 2014 20:20:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:20:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:20:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:20:36 - XML: Processed 655616 elements - found 705 jobs
Fri 17 Jan 2014 20:20:37 - job 7348621 appears to have finished
Fri 17 Jan 2014 20:20:37 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 20:20:37 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 20:20:39 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 20:20:39 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:20:39 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:20:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:20:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:20:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:20:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:20:42 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:20:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:20:42 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:20:42 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:20:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:20:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:20:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:20:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:20:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:20:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:20:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:20:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:20:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:20:44 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:20:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43903627
Fri 17 Jan 2014 20:20:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:20:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43903627
Fri 17 Jan 2014 20:20:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:20:54 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:20:54 - job_xml_thread(): Done retrieving: data size 43903627
Fri 17 Jan 2014 20:20:54 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:20:54 - XML: Start document: iteration 2
Fri 17 Jan 2014 20:20:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:20:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:20:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:20:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:20:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:20:58 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:20:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:20:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:20:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:20:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:21:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:21:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:21:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:21:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:21:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:21:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:21:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 20:21:01 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:21:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 20:21:01 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:21:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8196 values 129261 bits 16157 bytes 
Fri 17 Jan 2014 20:21:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:21:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:21:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:21:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:21:08 - XML: Processed 655616 elements - found 705 jobs
Fri 17 Jan 2014 20:21:08 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:21:08 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:21:08 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:21:08 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:21:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:21:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:21:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:21:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:21:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:21:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43881018
Fri 17 Jan 2014 20:21:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:21:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43881018
Fri 17 Jan 2014 20:21:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:21:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:21:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:21:22 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:21:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 20:21:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:21:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:21:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:21:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:21:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:21:23 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:21:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:21:23 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:21:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:21:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:21:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:21:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:21:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:21:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:21:25 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:21:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:21:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:21:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:21:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:21:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:21:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:21:27 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:21:27 - job_xml_thread(): Done retrieving: data size 43903797
Fri 17 Jan 2014 20:21:27 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:21:27 - XML: Start document: iteration 3
Fri 17 Jan 2014 20:21:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43903797
Fri 17 Jan 2014 20:21:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:21:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43903797
Fri 17 Jan 2014 20:21:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:21:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:21:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:21:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:21:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:21:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:21:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:21:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:21:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:21:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:21:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:21:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:21:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:21:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:21:47 - XML: Processed 655616 elements - found 705 jobs
Fri 17 Jan 2014 20:21:47 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:21:47 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:21:47 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:21:47 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:21:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:21:48 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:21:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:21:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:21:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:21:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:21:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:21:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:21:50 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:21:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43872071
Fri 17 Jan 2014 20:21:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:21:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43872071
Fri 17 Jan 2014 20:21:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:21:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:21:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:21:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:21:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:21:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:21:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:22:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:22:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:22:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:22:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:22:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:22:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:22:01 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:22:02 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:22:02 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:22:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:22:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 20:22:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 20:22:03 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:22:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9102 values 143501 bits 17937 bytes 
Fri 17 Jan 2014 20:22:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:22:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:22:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:22:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:22:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:22:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:22:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:22:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:22:06 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:22:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43889122
Fri 17 Jan 2014 20:22:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:22:07 - job_xml_thread(): Done retrieving: data size 43889122
Fri 17 Jan 2014 20:22:07 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:22:07 - XML: Start document: iteration 4
Fri 17 Jan 2014 20:22:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43889122
Fri 17 Jan 2014 20:22:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:22:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:22:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:22:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:22:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:22:23 - XML: Processed 655616 elements - found 705 jobs
Fri 17 Jan 2014 20:22:23 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:22:23 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:22:24 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:22:24 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:22:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:22:25 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:22:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:22:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:22:25 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:22:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:22:26 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:22:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:22:27 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:22:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:22:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:22:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:22:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:22:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:22:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:22:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:22:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:22:28 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:22:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 20:22:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:22:30 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:22:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43909836
Fri 17 Jan 2014 20:22:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:22:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43909836
Fri 17 Jan 2014 20:22:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:22:39 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:22:39 - job_xml_thread(): Done retrieving: data size 43909836
Fri 17 Jan 2014 20:22:39 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:22:39 - XML: Start document: iteration 5
Fri 17 Jan 2014 20:22:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:22:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:22:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:22:41 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:22:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:22:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:22:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:22:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:22:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:22:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:22:44 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:22:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:22:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:22:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:22:53 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:22:53 - XML: Processed 655616 elements - found 705 jobs
Fri 17 Jan 2014 20:22:53 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:22:53 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:22:53 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:22:53 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:22:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:22:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:22:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:22:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:22:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:22:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:22:56 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:22:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43878027
Fri 17 Jan 2014 20:22:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:22:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43878027
Fri 17 Jan 2014 20:22:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:23:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:23:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:23:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:23:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:23:03 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:23:03 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:23:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:23:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:23:04 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:23:04 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:23:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:23:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43878027
Fri 17 Jan 2014 20:23:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:23:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:23:04 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:23:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 20:23:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:23:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 20:23:05 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:23:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8863 values 139824 bits 17478 bytes 
Fri 17 Jan 2014 20:23:08 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:23:09 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:23:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:23:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:23:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:23:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:23:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:23:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:23:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:23:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:23:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:23:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:23:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:23:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:23:18 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:23:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 20:23:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:23:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:23:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:23:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:23:19 - job_xml_thread(): Done retrieving: data size 43798715
Fri 17 Jan 2014 20:23:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43798715
Fri 17 Jan 2014 20:23:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:23:19 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:23:19 - XML: Start document: iteration 6
Fri 17 Jan 2014 20:23:20 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:23:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:23:20 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:23:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:23:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43798715
Fri 17 Jan 2014 20:23:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:23:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:23:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:23:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:23:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:23:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:23:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:23:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:23:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:23:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:23:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:23:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:23:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:23:42 - XML: Processed 654868 elements - found 705 jobs
Fri 17 Jan 2014 20:23:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:23:42 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:23:42 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:23:42 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:23:42 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:23:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:23:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:23:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:23:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:23:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:23:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:23:44 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:23:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43309286
Fri 17 Jan 2014 20:23:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:23:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43309286
Fri 17 Jan 2014 20:23:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:23:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:23:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:23:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:23:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:23:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:23:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:23:57 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:23:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:23:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:23:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:23:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:23:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:23:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:23:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:23:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:23:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:23:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:23:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:23:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:23:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:23:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:23:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:24:01 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:24:01 - job_xml_thread(): Done retrieving: data size 43238093
Fri 17 Jan 2014 20:24:01 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:24:01 - XML: Start document: iteration 7
Fri 17 Jan 2014 20:24:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43238093
Fri 17 Jan 2014 20:24:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:24:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43238093
Fri 17 Jan 2014 20:24:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:24:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:24:05 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:24:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:24:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 20:24:06 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:24:06 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:24:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9279 values 146306 bits 18288 bytes 
Fri 17 Jan 2014 20:24:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 20:24:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:24:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:24:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:24:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:24:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:24:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:24:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:24:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:24:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:24:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:24:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:24:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:24:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:24:21 - XML: Processed 647416 elements - found 705 jobs
Fri 17 Jan 2014 20:24:21 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:24:21 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:24:21 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:24:22 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:24:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:24:23 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:24:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:24:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:24:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:24:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:24:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:24:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:24:26 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:24:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 20:24:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:24:26 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:24:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43291586
Fri 17 Jan 2014 20:24:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:24:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43291586
Fri 17 Jan 2014 20:24:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:24:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:24:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:24:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:24:36 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:24:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:24:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:24:37 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:24:37 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:24:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:24:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:24:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:24:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:24:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:24:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:24:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:24:40 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:24:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:24:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:24:41 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 20:24:41 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:24:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:24:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:24:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:24:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:24:41 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:24:41 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:24:41 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 20:24:41 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 20:24:41 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 20:24:42 - size of cluster 'LISA Cluster': 624 hosts 79483 metrics 960840 values 15175337 bits 1896917 bytes 
Fri 17 Jan 2014 20:24:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:24:45 - job_xml_thread(): Done retrieving: data size 43753539
Fri 17 Jan 2014 20:24:45 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:24:45 - XML: Start document: iteration 8
Fri 17 Jan 2014 20:24:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43753539
Fri 17 Jan 2014 20:24:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:24:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43753539
Fri 17 Jan 2014 20:24:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:24:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:24:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:24:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:24:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:25:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:25:01 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:25:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:25:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:25:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:25:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:25:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:25:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:25:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:25:03 - XML: Processed 653790 elements - found 705 jobs
Fri 17 Jan 2014 20:25:04 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:25:04 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:25:04 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:25:04 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:25:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:25:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:25:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:25:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:25:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:25:07 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:25:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:25:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:25:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:25:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:25:08 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:25:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 20:25:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:25:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 20:25:08 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:25:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99044 bits 12380 bytes 
Fri 17 Jan 2014 20:25:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:25:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43884241
Fri 17 Jan 2014 20:25:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:25:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43884241
Fri 17 Jan 2014 20:25:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:25:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:25:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:25:20 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:25:20 - job_xml_thread(): Done retrieving: data size 43884241
Fri 17 Jan 2014 20:25:20 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:25:20 - XML: Start document: iteration 9
Fri 17 Jan 2014 20:25:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:25:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:25:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:25:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:25:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:25:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:25:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:25:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:25:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:25:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:25:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:25:31 - XML: Processed 655616 elements - found 705 jobs
Fri 17 Jan 2014 20:25:31 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:25:31 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:25:31 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:25:31 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:25:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:25:35 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:25:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:25:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:25:35 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:25:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 20:25:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:25:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:25:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:25:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:25:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:25:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:25:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:25:38 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:25:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853018
Fri 17 Jan 2014 20:25:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:25:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853018
Fri 17 Jan 2014 20:25:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:25:41 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:25:41 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 20:25:46 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:25:46 - job_xml_thread(): Done retrieving: data size 43853018
Fri 17 Jan 2014 20:25:46 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:25:46 - XML: Start document: iteration 10
Fri 17 Jan 2014 20:25:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:25:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:25:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:25:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:25:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:25:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:25:53 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:25:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:25:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:25:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:25:53 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:25:59 - XML: Processed 655616 elements - found 705 jobs
Fri 17 Jan 2014 20:25:59 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:25:59 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:25:59 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:25:59 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:26:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:26:01 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:26:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:26:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:26:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:26:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:26:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:26:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:26:04 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:26:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43860992
Fri 17 Jan 2014 20:26:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:26:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43860992
Fri 17 Jan 2014 20:26:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:26:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:26:08 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:26:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:26:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:26:10 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:26:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:26:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 20:26:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 20:26:10 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:26:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8655 values 136441 bits 17055 bytes 
Fri 17 Jan 2014 20:26:14 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:26:14 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:26:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:26:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:26:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:26:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:26:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:26:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:26:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:26:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:26:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:26:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:26:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:26:20 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:26:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:26:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:26:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:26:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:26:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:26:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:26:24 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:26:24 - job_xml_thread(): Done retrieving: data size 43874115
Fri 17 Jan 2014 20:26:24 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:26:24 - XML: Start document: iteration 11
Fri 17 Jan 2014 20:26:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43874115
Fri 17 Jan 2014 20:26:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:26:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43874115
Fri 17 Jan 2014 20:26:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:26:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:26:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:26:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:26:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:26:43 - XML: Processed 655618 elements - found 706 jobs
Fri 17 Jan 2014 20:26:44 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 20:26:44 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 20:26:45 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 20:26:45 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:26:45 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:26:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:26:46 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:26:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:26:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:26:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:26:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:26:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:26:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:26:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:26:47 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:26:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 20:26:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:26:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:26:49 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:26:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:26:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:26:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:26:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:26:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:26:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:26:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:26:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43882559
Fri 17 Jan 2014 20:26:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:26:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43882559
Fri 17 Jan 2014 20:26:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:27:00 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:27:00 - job_xml_thread(): Done retrieving: data size 43882559
Fri 17 Jan 2014 20:27:00 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:27:00 - XML: Start document: iteration 12
Fri 17 Jan 2014 20:27:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:27:01 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:27:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:27:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:27:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:27:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:27:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:27:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:27:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43882559
Fri 17 Jan 2014 20:27:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:27:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:27:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:27:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:27:10 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:27:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:27:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 20:27:12 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:27:12 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:27:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 20:27:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6030 values 95107 bits 11888 bytes 
Fri 17 Jan 2014 20:27:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:27:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:27:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:27:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:27:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:27:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:27:15 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:27:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:27:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:27:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:27:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:27:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:27:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:27:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:27:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:27:20 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:27:20 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:27:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:27:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:27:21 - XML: Processed 655618 elements - found 706 jobs
Fri 17 Jan 2014 20:27:21 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:27:21 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:27:21 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:27:21 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:27:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:27:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43877207
Fri 17 Jan 2014 20:27:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:27:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43877207
Fri 17 Jan 2014 20:27:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:27:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:27:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:27:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:27:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:27:36 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:27:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:27:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:27:36 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:27:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:27:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:27:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:27:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:27:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:27:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:27:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:27:42 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:27:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:27:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 20:27:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:27:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:27:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:27:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:27:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:27:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:27:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:27:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:27:45 - job_xml_thread(): Done retrieving: data size 43889376
Fri 17 Jan 2014 20:27:45 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:27:45 - XML: Start document: iteration 13
Fri 17 Jan 2014 20:27:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43889376
Fri 17 Jan 2014 20:27:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:27:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43889376
Fri 17 Jan 2014 20:27:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:27:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:27:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:27:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:27:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:28:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:28:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:28:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:28:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:28:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:28:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:28:05 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:28:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:28:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:28:06 - XML: Processed 655616 elements - found 706 jobs
Fri 17 Jan 2014 20:28:07 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:28:07 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:28:07 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:28:07 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:28:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:28:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:28:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:28:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:28:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:28:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:28:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:28:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:28:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:28:12 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:28:12 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 20:28:12 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 20:28:12 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:28:12 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:28:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:28:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 20:28:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 20:28:12 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:28:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5665 values 89333 bits 11166 bytes 
Fri 17 Jan 2014 20:28:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:28:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43896069
Fri 17 Jan 2014 20:28:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:28:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43896069
Fri 17 Jan 2014 20:28:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:28:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:28:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:28:22 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:28:22 - job_xml_thread(): Done retrieving: data size 43896069
Fri 17 Jan 2014 20:28:22 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:28:22 - XML: Start document: iteration 14
Fri 17 Jan 2014 20:28:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:28:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:28:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:28:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:28:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:28:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:28:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:28:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:28:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:28:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:28:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:28:34 - XML: Processed 655618 elements - found 706 jobs
Fri 17 Jan 2014 20:28:34 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:28:34 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:28:34 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:28:34 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:28:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:28:35 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:28:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:28:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:28:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:28:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:28:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:28:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:28:37 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:28:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 20:28:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:28:38 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:28:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862406
Fri 17 Jan 2014 20:28:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:28:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862406
Fri 17 Jan 2014 20:28:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:28:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:28:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:28:49 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:28:49 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:28:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:28:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:28:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:28:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:28:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:28:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:28:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:28:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:28:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:28:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:28:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:28:53 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:28:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:28:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:28:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:28:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:28:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:28:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:28:54 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:28:54 - job_xml_thread(): Done retrieving: data size 43894081
Fri 17 Jan 2014 20:28:54 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:28:54 - XML: Start document: iteration 15
Fri 17 Jan 2014 20:28:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43894081
Fri 17 Jan 2014 20:28:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43894081
Fri 17 Jan 2014 20:28:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:28:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:29:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:29:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:29:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:29:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:29:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:29:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:29:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:29:09 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:29:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:29:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:29:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:29:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:29:13 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:29:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:29:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 20:29:13 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:29:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6387 values 100711 bits 12588 bytes 
Fri 17 Jan 2014 20:29:13 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:29:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 20:29:15 - XML: Processed 655618 elements - found 706 jobs
Fri 17 Jan 2014 20:29:15 - job 7348549 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 20:29:15 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 20:29:15 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 20:29:16 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 20:29:16 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:29:16 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:29:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:29:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:29:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:29:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:29:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:29:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:29:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:29:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:29:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:29:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43795087
Fri 17 Jan 2014 20:29:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:29:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43795087
Fri 17 Jan 2014 20:29:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:29:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:29:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:29:31 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:29:31 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:29:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:29:31 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:29:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:29:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:29:32 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:29:32 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:29:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:29:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:29:33 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:29:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 20:29:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:29:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:29:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:29:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:29:36 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:29:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:29:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:29:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:29:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:29:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:29:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:29:37 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:29:37 - job_xml_thread(): Done retrieving: data size 43357347
Fri 17 Jan 2014 20:29:37 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:29:37 - XML: Start document: iteration 16
Fri 17 Jan 2014 20:29:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43357347
Fri 17 Jan 2014 20:29:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:29:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43357347
Fri 17 Jan 2014 20:29:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:29:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:29:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:29:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:29:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:29:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:29:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:29:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:29:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:29:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:29:48 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:29:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:29:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:29:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:29:57 - XML: Processed 649180 elements - found 706 jobs
Fri 17 Jan 2014 20:29:57 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:29:58 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:29:58 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:29:58 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:30:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:30:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:30:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:30:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:30:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:30:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:30:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:30:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:30:01 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:30:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43231604
Fri 17 Jan 2014 20:30:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:30:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43231604
Fri 17 Jan 2014 20:30:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:30:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:30:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:30:13 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:30:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:30:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:30:13 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:30:14 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:30:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 20:30:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:30:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:30:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 20:30:14 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:30:14 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:30:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9179 values 144722 bits 18090 bytes 
Fri 17 Jan 2014 20:30:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:30:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:30:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:30:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:30:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:30:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:30:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:30:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:30:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:30:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:30:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:30:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:30:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:30:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:30:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:30:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:30:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:30:19 - job_xml_thread(): Done retrieving: data size 43273256
Fri 17 Jan 2014 20:30:19 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:30:19 - XML: Start document: iteration 17
Fri 17 Jan 2014 20:30:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43273256
Fri 17 Jan 2014 20:30:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:30:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43273256
Fri 17 Jan 2014 20:30:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:30:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:30:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:30:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:30:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:30:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:30:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:30:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:30:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:30:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:30:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:30:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:30:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:30:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:30:34 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:30:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 20:30:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:30:41 - XML: Processed 648060 elements - found 705 jobs
Fri 17 Jan 2014 20:30:41 - job 7347565 appears to have finished
Fri 17 Jan 2014 20:30:41 - job 7348549 field 'start_timestamp' changed since saved from: 1389986862 to: 1389986861
Fri 17 Jan 2014 20:30:42 - job 7348617 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 20:30:42 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 20:30:42 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 20:30:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:30:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:30:42 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 20:30:42 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:30:42 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:30:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:30:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:30:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:30:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:30:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:30:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:30:44 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:30:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43759466
Fri 17 Jan 2014 20:30:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:30:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43759466
Fri 17 Jan 2014 20:30:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:30:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:30:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:30:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:30:53 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:30:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:30:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:30:56 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:30:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:30:56 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:30:56 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:30:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:30:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:30:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:30:57 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:30:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:30:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:30:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:30:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:30:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:30:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:30:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:30:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:30:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:30:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43876673
Fri 17 Jan 2014 20:30:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:30:59 - job_xml_thread(): Done retrieving: data size 43876673
Fri 17 Jan 2014 20:30:59 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:31:00 - XML: Start document: iteration 18
Fri 17 Jan 2014 20:31:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43876673
Fri 17 Jan 2014 20:31:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:31:09 - XML: Processed 655300 elements - found 705 jobs
Fri 17 Jan 2014 20:31:10 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:31:10 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:31:10 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:31:10 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:31:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:31:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:31:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:31:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:31:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:31:14 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:31:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:31:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 20:31:15 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:31:15 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:31:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 20:31:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9250 values 145958 bits 18244 bytes 
Fri 17 Jan 2014 20:31:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:31:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:31:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:31:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:31:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:31:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:31:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:31:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:31:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:31:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:31:20 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:31:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:31:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:31:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:31:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:31:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:31:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:31:22 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:31:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43884794
Fri 17 Jan 2014 20:31:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:31:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43884794
Fri 17 Jan 2014 20:31:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:31:25 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:31:25 - job_xml_thread(): Done retrieving: data size 43884794
Fri 17 Jan 2014 20:31:25 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:31:25 - XML: Start document: iteration 19
Fri 17 Jan 2014 20:31:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:31:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:31:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:31:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:31:36 - XML: Processed 655616 elements - found 705 jobs
Fri 17 Jan 2014 20:31:36 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:31:36 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:31:36 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:31:37 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:31:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:31:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:31:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:31:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:31:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:31:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:31:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:31:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:31:40 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:31:41 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 20:31:41 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:31:42 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:31:42 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 20:31:42 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:31:42 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 20:31:42 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Fri 17 Jan 2014 20:31:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:31:45 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:31:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:31:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:31:45 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:31:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 20:31:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:31:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:31:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:31:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:31:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:31:47 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:31:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43881079
Fri 17 Jan 2014 20:31:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:31:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43881079
Fri 17 Jan 2014 20:31:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:31:52 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:31:52 - job_xml_thread(): Done retrieving: data size 43881079
Fri 17 Jan 2014 20:31:52 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:31:52 - XML: Start document: iteration 20
Fri 17 Jan 2014 20:31:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:31:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:31:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:31:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:31:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:31:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:32:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:32:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:32:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:32:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:32:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:32:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:32:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:32:09 - XML: Processed 655616 elements - found 705 jobs
Fri 17 Jan 2014 20:32:10 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:32:10 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:32:10 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:32:10 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:32:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:32:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:32:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:32:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:32:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:32:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:32:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:32:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:32:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:32:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43879791
Fri 17 Jan 2014 20:32:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:32:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43879791
Fri 17 Jan 2014 20:32:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:32:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:32:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:32:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:32:16 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:32:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:32:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 20:32:18 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:32:18 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:32:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 20:32:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8961 values 141656 bits 17707 bytes 
Fri 17 Jan 2014 20:32:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:32:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:32:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:32:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:32:25 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:32:25 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:32:25 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:32:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:32:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:32:25 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:32:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:32:26 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:32:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:32:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:32:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:32:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:32:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:32:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:32:28 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:32:28 - job_xml_thread(): Done retrieving: data size 43914753
Fri 17 Jan 2014 20:32:28 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:32:28 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 20:32:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43914753
Fri 17 Jan 2014 20:32:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:32:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43914753
Fri 17 Jan 2014 20:32:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:32:30 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 20:32:30 - Housekeeping: done.
Fri 17 Jan 2014 20:32:32 - XML: Start document: iteration 0
Fri 17 Jan 2014 20:32:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:32:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:32:42 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:32:42 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:32:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:32:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:32:42 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:32:42 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:32:42 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 20:32:42 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 20:32:42 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 20:32:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:32:48 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:32:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:32:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:32:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:32:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:32:48 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:32:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:32:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:32:50 - size of cluster 'LISA Cluster': 624 hosts 79483 metrics 897579 values 14182962 bits 1772870 bytes 
Fri 17 Jan 2014 20:32:51 - XML: Processed 655614 elements - found 704 jobs
Fri 17 Jan 2014 20:32:51 - job 7347911 appears to have finished
Fri 17 Jan 2014 20:32:51 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 20:32:51 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 20:32:51 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 20:32:51 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:32:51 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:32:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:32:53 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:32:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:32:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:32:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:32:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:32:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:32:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:32:54 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:32:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 20:32:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:32:57 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:32:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43887705
Fri 17 Jan 2014 20:32:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:32:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43887705
Fri 17 Jan 2014 20:32:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:33:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:33:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:33:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:33:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:33:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:33:06 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:33:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:33:06 - job_xml_thread(): Done retrieving: data size 43887705
Fri 17 Jan 2014 20:33:06 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:33:06 - XML: Start document: iteration 1
Fri 17 Jan 2014 20:33:07 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:33:07 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:33:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:33:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:33:07 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:33:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:33:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:33:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:33:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:33:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:33:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:33:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:33:18 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:33:18 - XML: Processed 655614 elements - found 704 jobs
Fri 17 Jan 2014 20:33:18 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:33:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:33:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:33:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:33:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:33:18 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:33:18 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:33:18 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:33:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:33:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 20:33:19 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:33:19 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:33:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5861 values 92675 bits 11584 bytes 
Fri 17 Jan 2014 20:33:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 20:33:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:33:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:33:22 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:33:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43852469
Fri 17 Jan 2014 20:33:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:33:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43852469
Fri 17 Jan 2014 20:33:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:33:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:33:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:33:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:33:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:33:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:33:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:33:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:33:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:33:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:33:33 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:33:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:33:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:33:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:33:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:33:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:33:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:33:39 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:33:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 20:33:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:33:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:33:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:33:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:33:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:33:42 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:33:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43888503
Fri 17 Jan 2014 20:33:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:33:42 - job_xml_thread(): Done retrieving: data size 43888503
Fri 17 Jan 2014 20:33:43 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:33:43 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:33:43 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 20:33:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43888503
Fri 17 Jan 2014 20:33:43 - XML: Start document: iteration 2
Fri 17 Jan 2014 20:33:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:33:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:33:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:33:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:33:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:33:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:33:56 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:33:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:33:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:33:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:33:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:33:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:33:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:33:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:34:04 - XML: Processed 655614 elements - found 704 jobs
Fri 17 Jan 2014 20:34:04 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:34:05 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:34:05 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:34:05 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:34:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:34:06 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:34:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:34:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:34:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:34:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:34:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:34:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:34:09 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:34:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43869588
Fri 17 Jan 2014 20:34:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:34:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43869588
Fri 17 Jan 2014 20:34:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:34:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:34:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:34:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:34:19 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:34:20 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:34:20 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:34:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:34:20 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:34:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 20:34:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 20:34:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:34:20 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:34:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:34:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8808 values 138939 bits 17367 bytes 
Fri 17 Jan 2014 20:34:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:34:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:34:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:34:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:34:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:34:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:34:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:34:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:34:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:34:25 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:34:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:34:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:34:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:34:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:34:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:34:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:34:29 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:34:29 - job_xml_thread(): Done retrieving: data size 43893779
Fri 17 Jan 2014 20:34:29 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:34:29 - XML: Start document: iteration 3
Fri 17 Jan 2014 20:34:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43893779
Fri 17 Jan 2014 20:34:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:34:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43893779
Fri 17 Jan 2014 20:34:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:34:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:34:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:34:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:34:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:34:42 - XML: Processed 655614 elements - found 704 jobs
Fri 17 Jan 2014 20:34:42 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:34:42 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:34:42 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:34:42 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:34:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:34:50 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:34:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:34:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:34:50 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:34:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:34:50 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:34:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:34:50 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:34:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:34:53 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:34:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:34:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:34:54 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:34:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 20:34:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:34:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:34:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:34:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:34:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:34:56 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 20:34:56 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 20:34:56 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:34:57 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:34:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43893218
Fri 17 Jan 2014 20:34:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:34:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43893218
Fri 17 Jan 2014 20:34:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:34:57 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:34:57 - job_xml_thread(): Done retrieving: data size 43893218
Fri 17 Jan 2014 20:34:58 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:34:58 - XML: Start document: iteration 4
Fri 17 Jan 2014 20:35:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:35:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:35:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:35:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:35:11 - XML: Processed 655614 elements - found 704 jobs
Fri 17 Jan 2014 20:35:11 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:35:11 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:35:11 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:35:11 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:35:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:35:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:35:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:35:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:35:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:35:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:35:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:35:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:35:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:35:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:35:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:35:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:35:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:35:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:35:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:35:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:35:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:35:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:35:20 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:35:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:35:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43830233
Fri 17 Jan 2014 20:35:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:35:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43830233
Fri 17 Jan 2014 20:35:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:35:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:35:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 20:35:22 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:35:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 20:35:22 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:35:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5762 values 90885 bits 11360 bytes 
Fri 17 Jan 2014 20:35:27 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:35:27 - job_xml_thread(): Done retrieving: data size 43830233
Fri 17 Jan 2014 20:35:27 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:35:27 - XML: Start document: iteration 5
Fri 17 Jan 2014 20:35:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:35:33 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:35:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:35:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:35:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:35:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:35:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:35:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:35:35 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:35:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:35:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:35:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:35:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:35:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:35:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:35:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:35:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:35:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:35:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:35:42 - XML: Processed 654866 elements - found 704 jobs
Fri 17 Jan 2014 20:35:42 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:35:42 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:35:42 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:35:42 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:35:44 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:35:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43297717
Fri 17 Jan 2014 20:35:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:35:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43297717
Fri 17 Jan 2014 20:35:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:35:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:35:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:35:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:35:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:35:57 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:35:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:35:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:35:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:35:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:35:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:35:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:35:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:35:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:35:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:36:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:36:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:36:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:36:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:36:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:36:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:36:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:36:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:36:00 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:36:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 20:36:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:36:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:36:02 - job_xml_thread(): Done retrieving: data size 43246431
Fri 17 Jan 2014 20:36:02 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:36:02 - XML: Start document: iteration 6
Fri 17 Jan 2014 20:36:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43246431
Fri 17 Jan 2014 20:36:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43246431
Fri 17 Jan 2014 20:36:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:36:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:36:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:36:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:36:16 - XML: Processed 647413 elements - found 704 jobs
Fri 17 Jan 2014 20:36:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:36:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:36:16 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:36:16 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:36:16 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:36:16 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:36:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:36:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:36:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:36:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:36:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:36:22 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:36:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:36:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:36:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:36:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:36:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:36:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:36:23 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:36:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:36:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:36:23 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:36:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:36:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 20:36:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 20:36:23 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:36:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5666 values 89309 bits 11163 bytes 
Fri 17 Jan 2014 20:36:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:36:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:36:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:36:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:36:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:36:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43308676
Fri 17 Jan 2014 20:36:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:36:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43308676
Fri 17 Jan 2014 20:36:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:36:31 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:36:31 - job_xml_thread(): Done retrieving: data size 43308676
Fri 17 Jan 2014 20:36:31 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:36:31 - XML: Start document: iteration 7
Fri 17 Jan 2014 20:36:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:36:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:36:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:36:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:36:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:36:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:36:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:36:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:36:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:36:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:36:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:36:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:36:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:36:43 - XML: Processed 648162 elements - found 704 jobs
Fri 17 Jan 2014 20:36:43 - job 7348550 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 20:36:43 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 20:36:43 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 20:36:43 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 20:36:43 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:36:43 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:36:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:36:48 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:36:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:36:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:36:48 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:36:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 20:36:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:36:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:36:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:36:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:36:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:36:50 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:36:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43832393
Fri 17 Jan 2014 20:36:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:36:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43832393
Fri 17 Jan 2014 20:36:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:36:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:36:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:36:59 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:36:59 - job_xml_thread(): Done retrieving: data size 43832393
Fri 17 Jan 2014 20:36:59 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:36:59 - XML: Start document: iteration 8
Fri 17 Jan 2014 20:37:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:37:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:37:10 - XML: Processed 655192 elements - found 704 jobs
Fri 17 Jan 2014 20:37:10 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:37:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:37:10 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:37:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:37:10 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:37:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:37:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:37:10 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:37:12 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:37:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:37:12 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:37:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:37:12 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:37:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:37:12 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:37:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:37:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:37:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:37:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:37:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:37:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:37:14 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:37:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43912490
Fri 17 Jan 2014 20:37:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:37:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43912490
Fri 17 Jan 2014 20:37:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:37:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:37:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:37:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:37:24 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:37:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:37:24 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:37:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 20:37:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 20:37:24 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:37:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8884 values 140086 bits 17510 bytes 
Fri 17 Jan 2014 20:37:26 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:37:26 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:37:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:37:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:37:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:37:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:37:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:37:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:37:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:37:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:37:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:37:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:37:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:37:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:37:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:37:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:37:30 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:37:30 - job_xml_thread(): Done retrieving: data size 43906523
Fri 17 Jan 2014 20:37:30 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:37:30 - XML: Start document: iteration 9
Fri 17 Jan 2014 20:37:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43906523
Fri 17 Jan 2014 20:37:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:37:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43906523
Fri 17 Jan 2014 20:37:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:37:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:37:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:37:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:37:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:37:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:37:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:37:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:37:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:37:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:37:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:37:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:37:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:37:49 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:37:49 - XML: Processed 655614 elements - found 704 jobs
Fri 17 Jan 2014 20:37:50 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:37:50 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:37:50 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:37:50 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:37:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:37:53 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:37:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:37:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:37:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:37:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:37:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:37:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:37:53 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:37:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 20:37:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:37:55 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:37:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43887412
Fri 17 Jan 2014 20:37:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:37:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43887412
Fri 17 Jan 2014 20:37:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:38:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:38:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:38:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:38:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:38:05 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:38:05 - job_xml_thread(): Done retrieving: data size 43887412
Fri 17 Jan 2014 20:38:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:38:05 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:38:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:38:05 - XML: Start document: iteration 10
Fri 17 Jan 2014 20:38:06 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:38:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:38:06 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:38:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:38:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:38:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:38:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:38:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:38:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:38:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:38:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:38:18 - XML: Processed 655614 elements - found 704 jobs
Fri 17 Jan 2014 20:38:18 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:38:18 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:38:18 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:38:18 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:38:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:38:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:38:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:38:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:38:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:38:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43854998
Fri 17 Jan 2014 20:38:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:38:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43854998
Fri 17 Jan 2014 20:38:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:38:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:38:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:38:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:38:25 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:38:26 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:38:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:38:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 20:38:26 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:38:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8842 values 139408 bits 17426 bytes 
Fri 17 Jan 2014 20:38:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 20:38:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:38:28 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:38:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:38:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:38:29 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:38:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:38:29 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:38:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:38:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43854998
Fri 17 Jan 2014 20:38:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:38:33 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:38:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:38:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:38:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:38:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:38:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:38:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:38:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:38:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:38:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:38:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:38:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:38:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:38:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:38:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:38:43 - job_xml_thread(): Done retrieving: data size 43889100
Fri 17 Jan 2014 20:38:43 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:38:43 - XML: Start document: iteration 11
Fri 17 Jan 2014 20:38:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43889100
Fri 17 Jan 2014 20:38:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:38:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:38:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:38:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:38:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:38:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:38:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:38:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43889100
Fri 17 Jan 2014 20:38:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:38:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:38:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:39:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:39:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:39:01 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:39:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:39:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:39:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:39:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:39:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:39:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:39:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:39:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:39:04 - XML: Processed 655612 elements - found 703 jobs
Fri 17 Jan 2014 20:39:04 - job 7348442 appears to have finished
Fri 17 Jan 2014 20:39:04 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 20:39:04 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 20:39:04 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 20:39:04 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:39:04 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:39:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:39:08 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:39:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:39:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:39:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:39:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:39:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:39:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:39:08 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:39:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 20:39:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:39:10 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:39:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43883503
Fri 17 Jan 2014 20:39:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:39:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43883503
Fri 17 Jan 2014 20:39:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:39:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:39:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:39:19 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:39:20 - job_xml_thread(): Done retrieving: data size 43883503
Fri 17 Jan 2014 20:39:20 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:39:20 - XML: Start document: iteration 12
Fri 17 Jan 2014 20:39:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:39:21 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:39:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:39:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:39:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:39:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:39:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:39:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:39:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:39:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:39:26 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:39:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:39:27 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:39:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 20:39:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 20:39:27 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:39:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:39:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5829 values 91880 bits 11485 bytes 
Fri 17 Jan 2014 20:39:27 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:39:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:39:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:39:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:39:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:39:29 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:39:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:39:31 - XML: Processed 655612 elements - found 703 jobs
Fri 17 Jan 2014 20:39:31 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:39:31 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:39:31 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:39:31 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:39:33 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:39:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875701
Fri 17 Jan 2014 20:39:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:39:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875701
Fri 17 Jan 2014 20:39:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:39:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:39:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:39:40 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:39:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 20:39:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:39:43 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 20:39:43 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:39:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:39:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:39:44 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:39:44 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:39:45 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 20:39:45 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 20:39:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:39:45 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:39:45 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 20:39:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:39:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:39:46 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:39:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:39:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:39:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:39:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:39:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:39:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:39:48 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:39:49 - size of cluster 'LISA Cluster': 624 hosts 79481 metrics 923558 values 14581461 bits 1822682 bytes 
Fri 17 Jan 2014 20:39:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:39:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:39:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:39:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:39:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:39:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:39:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:39:52 - job_xml_thread(): Done retrieving: data size 43879946
Fri 17 Jan 2014 20:39:52 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:39:52 - XML: Start document: iteration 13
Fri 17 Jan 2014 20:39:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43879946
Fri 17 Jan 2014 20:39:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:39:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43879946
Fri 17 Jan 2014 20:39:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:40:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:40:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:40:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:40:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:40:11 - XML: Processed 655612 elements - found 703 jobs
Fri 17 Jan 2014 20:40:11 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:40:11 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:40:11 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:40:11 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:40:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:40:14 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:40:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:40:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:40:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:40:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:40:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:40:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:40:15 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:40:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:40:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:40:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:40:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:40:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:40:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:40:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:40:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:40:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:40:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43889817
Fri 17 Jan 2014 20:40:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:40:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43889817
Fri 17 Jan 2014 20:40:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:40:26 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:40:27 - job_xml_thread(): Done retrieving: data size 43889817
Fri 17 Jan 2014 20:40:27 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:40:27 - XML: Start document: iteration 14
Fri 17 Jan 2014 20:40:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:40:28 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:40:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:40:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 20:40:29 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:40:29 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:40:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 20:40:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:40:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:40:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9356 values 147520 bits 18440 bytes 
Fri 17 Jan 2014 20:40:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:40:31 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:40:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:40:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:40:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:40:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:40:32 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:40:32 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:40:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:40:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:40:32 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:40:40 - XML: Processed 655612 elements - found 703 jobs
Fri 17 Jan 2014 20:40:40 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:40:40 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:40:40 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:40:41 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:40:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:40:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:40:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:40:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:40:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:40:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:40:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:40:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:40:45 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:40:45 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 20:40:46 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:40:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875905
Fri 17 Jan 2014 20:40:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:40:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875905
Fri 17 Jan 2014 20:40:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:40:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:40:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:40:56 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:40:56 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:40:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:40:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:40:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:40:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:40:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:40:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:40:59 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:40:59 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:40:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:40:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:41:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:41:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:41:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:41:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:41:02 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:41:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 20:41:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:41:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:41:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:41:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:41:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:41:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:41:05 - job_xml_thread(): Done retrieving: data size 43869793
Fri 17 Jan 2014 20:41:05 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:41:05 - XML: Start document: iteration 15
Fri 17 Jan 2014 20:41:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43869793
Fri 17 Jan 2014 20:41:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:41:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43869793
Fri 17 Jan 2014 20:41:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:41:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:41:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:41:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:41:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:41:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:41:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:41:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:41:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:41:23 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:41:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:41:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:41:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:41:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:41:24 - XML: Processed 655612 elements - found 703 jobs
Fri 17 Jan 2014 20:41:24 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:41:24 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:41:24 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:41:24 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:41:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:41:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:41:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:41:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:41:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:41:29 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:41:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:41:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:41:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:41:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:41:29 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:41:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:41:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 20:41:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 20:41:29 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:41:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5760 values 90809 bits 11351 bytes 
Fri 17 Jan 2014 20:41:33 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:41:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43737761
Fri 17 Jan 2014 20:41:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:41:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43737761
Fri 17 Jan 2014 20:41:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:41:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:41:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:41:39 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:41:39 - job_xml_thread(): Done retrieving: data size 43737761
Fri 17 Jan 2014 20:41:39 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:41:39 - XML: Start document: iteration 16
Fri 17 Jan 2014 20:41:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:41:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:41:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:41:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:41:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:41:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:41:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:41:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:41:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:41:52 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:41:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:41:54 - XML: Processed 653840 elements - found 703 jobs
Fri 17 Jan 2014 20:41:55 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:41:55 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:41:55 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:41:55 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:41:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:41:57 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:41:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:41:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:41:57 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:41:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 20:41:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:41:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:41:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:41:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:41:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:41:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:41:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43239181
Fri 17 Jan 2014 20:41:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:42:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43239181
Fri 17 Jan 2014 20:42:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:42:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:42:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:42:10 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:42:10 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:42:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:42:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:42:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:42:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:42:11 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:42:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:42:11 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:42:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:42:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:42:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:42:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:42:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:42:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:42:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:42:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:42:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:42:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:42:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:42:17 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:42:17 - job_xml_thread(): Done retrieving: data size 43245145
Fri 17 Jan 2014 20:42:17 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:42:17 - XML: Start document: iteration 17
Fri 17 Jan 2014 20:42:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43245145
Fri 17 Jan 2014 20:42:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43245145
Fri 17 Jan 2014 20:42:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:42:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:42:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:42:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:42:30 - XML: Processed 647490 elements - found 703 jobs
Fri 17 Jan 2014 20:42:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:42:30 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:42:30 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:42:30 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:42:30 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:42:30 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:42:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:42:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:42:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:42:31 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:42:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 20:42:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 20:42:31 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:42:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8499 values 133967 bits 16745 bytes 
Fri 17 Jan 2014 20:42:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:42:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:42:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:42:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:42:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:42:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:42:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:42:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:42:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:42:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:42:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:42:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:42:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:42:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:42:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:42:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:42:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:42:45 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:42:45 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:42:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 20:42:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:42:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:42:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43804793
Fri 17 Jan 2014 20:42:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:42:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43804793
Fri 17 Jan 2014 20:42:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:42:46 - job_xml_thread(): Done retrieving: data size 43804793
Fri 17 Jan 2014 20:42:46 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:42:46 - XML: Start document: iteration 18
Fri 17 Jan 2014 20:42:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:42:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:42:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:42:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:43:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:43:00 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:43:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:43:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:43:01 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:43:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:43:01 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:43:01 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:43:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:43:04 - XML: Processed 654524 elements - found 703 jobs
Fri 17 Jan 2014 20:43:04 - job 7348551 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 20:43:04 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 20:43:04 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 20:43:04 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 20:43:04 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:43:04 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:43:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:43:08 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:43:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:43:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:43:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:43:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:43:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:43:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:43:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:43:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870323
Fri 17 Jan 2014 20:43:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:43:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870323
Fri 17 Jan 2014 20:43:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:43:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:43:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:43:19 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:43:19 - job_xml_thread(): Done retrieving: data size 43870323
Fri 17 Jan 2014 20:43:19 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:43:19 - XML: Start document: iteration 19
Fri 17 Jan 2014 20:43:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:43:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:43:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:43:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:43:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:43:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:43:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:43:29 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:43:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:43:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:43:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:43:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:43:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:43:30 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:43:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:43:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:43:31 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:43:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:43:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:43:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:43:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:43:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:43:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 20:43:31 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:43:31 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:43:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 20:43:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99104 bits 12388 bytes 
Fri 17 Jan 2014 20:43:33 - XML: Processed 655612 elements - found 703 jobs
Fri 17 Jan 2014 20:43:33 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:43:33 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:43:33 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:43:33 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:43:33 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 20:43:33 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 20:43:33 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:43:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:43:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43881841
Fri 17 Jan 2014 20:43:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:43:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43881841
Fri 17 Jan 2014 20:43:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:43:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:43:45 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:43:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:43:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:43:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:43:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:43:47 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:43:47 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:43:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:43:47 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:43:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:43:48 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:43:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:43:49 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:43:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:43:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:43:49 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:43:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 20:43:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:43:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:43:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:43:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:43:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:43:51 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:43:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43886627
Fri 17 Jan 2014 20:43:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:43:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43886627
Fri 17 Jan 2014 20:43:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:43:51 - job_xml_thread(): Done retrieving: data size 43886627
Fri 17 Jan 2014 20:43:51 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:43:51 - XML: Start document: iteration 20
Fri 17 Jan 2014 20:44:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:44:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:44:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:44:03 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:44:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:44:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:44:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:44:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:44:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:44:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:44:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:44:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:44:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:44:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:44:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:44:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:44:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:44:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:44:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:44:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:44:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:44:12 - XML: Processed 655610 elements - found 703 jobs
Fri 17 Jan 2014 20:44:12 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:44:12 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:44:12 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:44:12 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:44:15 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:44:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43878415
Fri 17 Jan 2014 20:44:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:44:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43878415
Fri 17 Jan 2014 20:44:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:44:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:44:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:44:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:44:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:44:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:44:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:44:26 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:44:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:44:26 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:44:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:44:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:44:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:44:27 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:44:27 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:44:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:44:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:44:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:44:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:44:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:44:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:44:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:44:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:44:30 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:44:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43912750
Fri 17 Jan 2014 20:44:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:44:31 - job_xml_thread(): Done retrieving: data size 43912750
Fri 17 Jan 2014 20:44:31 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:44:31 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 20:44:31 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 20:44:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43912750
Fri 17 Jan 2014 20:44:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:44:31 - Housekeeping: done.
Fri 17 Jan 2014 20:44:31 - XML: Start document: iteration 0
Fri 17 Jan 2014 20:44:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:44:31 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:44:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:44:33 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:44:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 20:44:34 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:44:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 20:44:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 10787 values 170055 bits 21256 bytes 
Fri 17 Jan 2014 20:44:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:44:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:44:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:44:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:44:45 - XML: Processed 655610 elements - found 702 jobs
Fri 17 Jan 2014 20:44:45 - job 7348620 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 20:44:45 - job 7348525 appears to have finished
Fri 17 Jan 2014 20:44:45 - job 7348552 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 20:44:45 - job 7348618 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 20:44:45 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 20:44:45 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 20:44:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:44:50 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:44:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:44:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:44:51 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 20:44:51 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:44:51 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:44:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:44:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:44:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:44:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:44:52 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:44:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:44:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:44:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:44:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:44:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:44:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:44:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:44:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:44:56 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:44:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43894800
Fri 17 Jan 2014 20:44:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:44:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43894800
Fri 17 Jan 2014 20:44:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:45:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:45:06 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:45:06 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:45:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:45:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:45:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:45:08 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:45:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:45:08 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:45:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:45:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:45:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:45:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:45:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:45:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:45:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:45:11 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:45:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 20:45:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:45:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:45:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:45:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:45:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:45:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:45:13 - job_xml_thread(): Done retrieving: data size 43886598
Fri 17 Jan 2014 20:45:13 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:45:13 - XML: Start document: iteration 1
Fri 17 Jan 2014 20:45:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43886598
Fri 17 Jan 2014 20:45:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43886598
Fri 17 Jan 2014 20:45:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:45:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:45:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:45:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:45:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:45:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:45:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:45:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:45:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:45:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:45:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:45:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:45:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:45:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:45:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:45:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:45:33 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:45:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:45:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:45:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:45:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:45:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:45:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:45:34 - XML: Processed 655610 elements - found 702 jobs
Fri 17 Jan 2014 20:45:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:45:34 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:45:34 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:45:34 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:45:34 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:45:34 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:45:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:45:35 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:45:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 20:45:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 20:45:35 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:45:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5841 values 92069 bits 11508 bytes 
Fri 17 Jan 2014 20:45:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:45:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43872990
Fri 17 Jan 2014 20:45:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:45:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43872990
Fri 17 Jan 2014 20:45:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:45:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:45:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:45:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:45:45 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:45:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:45:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:45:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:45:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:45:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:45:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:45:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:45:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:45:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:45:49 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:45:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:45:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:45:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:45:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:45:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:45:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:45:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:45:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:45:51 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:45:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 20:45:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:45:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:45:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43892425
Fri 17 Jan 2014 20:45:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:45:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43892425
Fri 17 Jan 2014 20:45:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:45:53 - job_xml_thread(): Done retrieving: data size 43892425
Fri 17 Jan 2014 20:45:53 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:45:53 - XML: Start document: iteration 2
Fri 17 Jan 2014 20:46:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:46:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:46:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:46:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:46:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:46:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:46:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:46:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:46:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:46:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:46:05 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:46:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:46:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:46:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:46:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:46:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:46:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:46:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:46:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:46:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:46:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:46:14 - XML: Processed 655610 elements - found 702 jobs
Fri 17 Jan 2014 20:46:14 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:46:14 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:46:14 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:46:14 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:46:16 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:46:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43886675
Fri 17 Jan 2014 20:46:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:46:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43886675
Fri 17 Jan 2014 20:46:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:46:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:46:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:46:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:46:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:46:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:46:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:46:25 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:46:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:46:25 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:46:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:46:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43886675
Fri 17 Jan 2014 20:46:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:46:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:46:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:46:29 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:46:29 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:46:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:46:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:46:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:46:35 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:46:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:46:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:46:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 20:46:36 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:46:36 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:46:36 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:46:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 20:46:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7110 values 112173 bits 14021 bytes 
Fri 17 Jan 2014 20:46:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:46:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:46:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:46:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:46:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:46:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:46:38 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:46:38 - job_xml_thread(): Done retrieving: data size 43878772
Fri 17 Jan 2014 20:46:38 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:46:38 - XML: Start document: iteration 3
Fri 17 Jan 2014 20:46:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43878772
Fri 17 Jan 2014 20:46:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:46:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:46:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:46:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:46:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:46:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43878772
Fri 17 Jan 2014 20:46:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:46:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:46:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:46:45 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 20:46:45 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:46:46 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:46:46 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 20:46:46 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 20:46:46 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:46:46 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Fri 17 Jan 2014 20:46:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:46:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:46:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:46:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:47:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:47:01 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:47:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:47:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:47:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:47:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:47:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:47:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:47:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:47:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:47:03 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:47:03 - XML: Processed 655605 elements - found 700 jobs
Fri 17 Jan 2014 20:47:03 - job 7348620 field 'start_timestamp' changed since saved from: 1389987883 to: 1389987820
Fri 17 Jan 2014 20:47:03 - job 7348553 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 20:47:03 - job 7348552 field 'start_timestamp' changed since saved from: 1389987882 to: 1389987820
Fri 17 Jan 2014 20:47:03 - job 7348376 appears to have finished
Fri 17 Jan 2014 20:47:03 - job 7347910 appears to have finished
Fri 17 Jan 2014 20:47:03 - job_xml_thread(): Found 5 updated jobs.
Fri 17 Jan 2014 20:47:03 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 20:47:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:47:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:47:03 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Fri 17 Jan 2014 20:47:03 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:47:03 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:47:03 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:47:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 20:47:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:47:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:47:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:47:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:47:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:47:04 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:47:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43883346
Fri 17 Jan 2014 20:47:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:47:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43883346
Fri 17 Jan 2014 20:47:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:47:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:47:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:47:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:47:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:47:18 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:47:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:47:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:47:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:47:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:47:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:47:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:47:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:47:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:47:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:47:19 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:47:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:47:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:47:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:47:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:47:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:47:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:47:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:47:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:47:20 - job_xml_thread(): Done retrieving: data size 43829116
Fri 17 Jan 2014 20:47:20 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:47:20 - XML: Start document: iteration 4
Fri 17 Jan 2014 20:47:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43829116
Fri 17 Jan 2014 20:47:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:47:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43829116
Fri 17 Jan 2014 20:47:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:47:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:47:34 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:47:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:47:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:47:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:47:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:47:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:47:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:47:35 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:47:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:47:35 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:47:35 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:47:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:47:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:47:36 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:47:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:47:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 20:47:37 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:47:37 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:47:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 20:47:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8761 values 138718 bits 17339 bytes 
Fri 17 Jan 2014 20:47:40 - XML: Processed 654858 elements - found 700 jobs
Fri 17 Jan 2014 20:47:40 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:47:40 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:47:40 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:47:40 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:47:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:47:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:47:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:47:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:47:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:47:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:47:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:47:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:47:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:47:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43302547
Fri 17 Jan 2014 20:47:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:47:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43302547
Fri 17 Jan 2014 20:47:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:47:46 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:47:46 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:47:47 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:47:48 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:47:48 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 20:47:48 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 20:47:48 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 20:47:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:47:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:47:54 - size of cluster 'LISA Cluster': 624 hosts 79470 metrics 915946 values 14469335 bits 1808666 bytes 
Fri 17 Jan 2014 20:47:55 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:47:55 - job_xml_thread(): Done retrieving: data size 43302547
Fri 17 Jan 2014 20:47:55 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:47:55 - XML: Start document: iteration 5
Fri 17 Jan 2014 20:47:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:47:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:48:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:48:03 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:48:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:48:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:48:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:48:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:48:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:48:05 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:48:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:48:07 - XML: Processed 648432 elements - found 700 jobs
Fri 17 Jan 2014 20:48:07 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:48:07 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:48:07 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:48:07 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:48:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:48:08 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:48:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:48:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:48:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:48:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:48:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:48:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:48:09 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:48:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 20:48:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:48:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:48:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43226415
Fri 17 Jan 2014 20:48:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:48:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43226415
Fri 17 Jan 2014 20:48:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:48:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:48:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:48:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:48:21 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:48:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:48:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:48:22 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:48:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:48:23 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:48:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:48:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:48:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:48:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:48:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:48:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:48:26 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:48:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:48:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:48:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:48:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:48:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:48:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:48:30 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:48:30 - job_xml_thread(): Done retrieving: data size 43299811
Fri 17 Jan 2014 20:48:30 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:48:30 - XML: Start document: iteration 6
Fri 17 Jan 2014 20:48:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43299811
Fri 17 Jan 2014 20:48:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:48:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43299811
Fri 17 Jan 2014 20:48:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:48:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:48:38 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:48:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:48:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:48:40 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:48:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:48:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 20:48:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 20:48:40 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:48:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8949 values 141390 bits 17673 bytes 
Fri 17 Jan 2014 20:48:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:48:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:48:48 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:48:49 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 20:48:49 - XML: Processed 648152 elements - found 699 jobs
Fri 17 Jan 2014 20:48:49 - job 7348624 appears to have finished
Fri 17 Jan 2014 20:48:49 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 20:48:49 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 20:48:49 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 20:48:49 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:48:49 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:48:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:48:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:48:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:48:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:48:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:48:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:48:52 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:48:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:48:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:48:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:48:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:48:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:48:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:48:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:48:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:48:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:48:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:48:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:48:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43871634
Fri 17 Jan 2014 20:48:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:49:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43871634
Fri 17 Jan 2014 20:49:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:49:04 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:49:04 - job_xml_thread(): Done retrieving: data size 43871634
Fri 17 Jan 2014 20:49:04 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:49:04 - XML: Start document: iteration 7
Fri 17 Jan 2014 20:49:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:49:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:49:09 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:49:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 20:49:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:49:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:49:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:49:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:49:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:49:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:49:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:49:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:49:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:49:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:49:20 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:49:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:49:21 - XML: Processed 655396 elements - found 699 jobs
Fri 17 Jan 2014 20:49:21 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:49:21 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:49:21 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:49:21 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:49:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:49:23 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:49:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:49:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:49:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:49:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:49:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:49:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:49:26 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:49:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43877176
Fri 17 Jan 2014 20:49:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:49:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43877176
Fri 17 Jan 2014 20:49:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:49:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:49:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:49:37 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:49:37 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:49:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:49:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:49:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:49:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:49:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:49:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:49:39 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:49:39 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:49:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:49:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:49:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:49:40 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:49:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:49:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 20:49:41 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:49:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 20:49:41 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:49:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6123 values 96569 bits 12071 bytes 
Fri 17 Jan 2014 20:49:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:49:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:49:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:49:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:49:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:49:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:49:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:49:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:49:46 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:49:46 - job_xml_thread(): Done retrieving: data size 43885687
Fri 17 Jan 2014 20:49:46 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:49:46 - XML: Start document: iteration 8
Fri 17 Jan 2014 20:49:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43885687
Fri 17 Jan 2014 20:49:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43885687
Fri 17 Jan 2014 20:49:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:49:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:49:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:49:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:49:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:49:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:50:02 - XML: Processed 655604 elements - found 699 jobs
Fri 17 Jan 2014 20:50:02 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:50:02 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:50:02 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:50:02 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:50:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:50:09 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:50:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:50:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:50:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:50:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:50:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:50:10 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:50:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:50:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:50:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:50:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:50:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:50:10 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:50:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 20:50:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:50:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:50:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:50:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:50:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:50:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:50:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43909003
Fri 17 Jan 2014 20:50:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:50:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43909003
Fri 17 Jan 2014 20:50:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:50:17 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:50:17 - job_xml_thread(): Done retrieving: data size 43909003
Fri 17 Jan 2014 20:50:17 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:50:17 - XML: Start document: iteration 9
Fri 17 Jan 2014 20:50:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:50:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:50:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:50:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:50:26 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:50:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:50:26 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:50:26 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:50:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:50:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:50:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:50:33 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 20:50:33 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 20:50:33 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:50:33 - XML: Processed 655604 elements - found 699 jobs
Fri 17 Jan 2014 20:50:33 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:50:33 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:50:33 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:50:33 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:50:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:50:34 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:50:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:50:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:50:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:50:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:50:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:50:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:50:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:50:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43869499
Fri 17 Jan 2014 20:50:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:50:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43869499
Fri 17 Jan 2014 20:50:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:50:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:50:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:50:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:50:41 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:50:42 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:50:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 20:50:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:50:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 20:50:42 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:50:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8810 values 138830 bits 17353 bytes 
Fri 17 Jan 2014 20:50:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:50:46 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:50:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:50:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:50:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:50:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:50:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:50:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:50:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:50:48 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:50:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:50:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:50:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:50:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:50:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:50:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:50:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:50:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:50:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:50:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:50:53 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:50:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43885358
Fri 17 Jan 2014 20:50:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:50:53 - job_xml_thread(): Done retrieving: data size 43885358
Fri 17 Jan 2014 20:50:53 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:50:53 - XML: Start document: iteration 10
Fri 17 Jan 2014 20:50:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43885358
Fri 17 Jan 2014 20:50:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:51:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:51:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:51:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:51:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:51:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:51:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:51:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:51:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:51:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:51:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:51:05 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:51:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:51:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:51:13 - XML: Processed 655606 elements - found 700 jobs
Fri 17 Jan 2014 20:51:13 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 20:51:13 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 20:51:13 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 20:51:13 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:51:13 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:51:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:51:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:51:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:51:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:51:17 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:51:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 20:51:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:51:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:51:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:51:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:51:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:51:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:51:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865120
Fri 17 Jan 2014 20:51:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:51:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43865120
Fri 17 Jan 2014 20:51:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:51:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:51:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:51:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:51:28 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:51:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:51:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:51:28 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:51:28 - job_xml_thread(): Done retrieving: data size 43865120
Fri 17 Jan 2014 20:51:28 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:51:28 - XML: Start document: iteration 11
Fri 17 Jan 2014 20:51:30 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:51:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:51:30 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:51:30 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:51:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:51:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:51:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:51:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:51:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:51:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:51:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:51:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:51:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:51:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:51:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:51:40 - XML: Processed 655604 elements - found 700 jobs
Fri 17 Jan 2014 20:51:40 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:51:40 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:51:40 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:51:40 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:51:42 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:51:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43874923
Fri 17 Jan 2014 20:51:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:51:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43874923
Fri 17 Jan 2014 20:51:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:51:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:51:44 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:51:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:51:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:51:46 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:51:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:51:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 20:51:47 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:51:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 20:51:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8799 values 138670 bits 17333 bytes 
Fri 17 Jan 2014 20:51:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:51:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:51:55 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:51:55 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:51:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:51:56 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:51:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:51:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:51:56 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:51:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:51:56 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:51:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:51:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:51:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:51:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:51:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:51:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:51:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:51:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:51:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:52:00 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:52:00 - job_xml_thread(): Done retrieving: data size 43910774
Fri 17 Jan 2014 20:52:00 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:52:00 - XML: Start document: iteration 12
Fri 17 Jan 2014 20:52:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43910774
Fri 17 Jan 2014 20:52:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:52:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43910774
Fri 17 Jan 2014 20:52:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:52:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:52:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:52:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:52:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:52:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:52:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:52:19 - XML: Processed 655606 elements - found 700 jobs
Fri 17 Jan 2014 20:52:20 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:52:20 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:52:20 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:52:20 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:52:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:52:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:52:20 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:52:20 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:52:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:52:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:52:20 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:52:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:52:23 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:52:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:52:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:52:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:52:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:52:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:52:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:52:23 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:52:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 20:52:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:52:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:52:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43890766
Fri 17 Jan 2014 20:52:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:52:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43890766
Fri 17 Jan 2014 20:52:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:52:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:52:35 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:52:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:52:35 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:52:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:52:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:52:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:52:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:52:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:52:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:52:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:52:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:52:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:52:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:52:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:52:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:52:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:52:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:52:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:52:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:52:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:52:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:52:41 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:52:41 - job_xml_thread(): Done retrieving: data size 43896734
Fri 17 Jan 2014 20:52:41 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:52:41 - XML: Start document: iteration 13
Fri 17 Jan 2014 20:52:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43896734
Fri 17 Jan 2014 20:52:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:52:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43896734
Fri 17 Jan 2014 20:52:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:52:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:52:47 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:52:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:52:47 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:52:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 20:52:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 20:52:47 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:52:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8629 values 136042 bits 17005 bytes 
Fri 17 Jan 2014 20:52:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:52:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:52:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:52:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:52:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:52:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:52:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:52:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:52:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:52:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:52:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:52:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:52:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:53:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:53:00 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:53:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:53:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:53:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:53:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:53:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:53:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:53:03 - XML: Processed 655608 elements - found 701 jobs
Fri 17 Jan 2014 20:53:03 - job 7348554 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 20:53:03 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 20:53:03 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 20:53:03 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 20:53:03 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:53:03 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:53:05 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:53:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 20:53:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:53:06 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:53:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43872533
Fri 17 Jan 2014 20:53:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:53:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43872533
Fri 17 Jan 2014 20:53:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:53:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:53:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:53:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:53:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:53:18 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:53:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:53:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:53:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:53:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:53:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:53:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:53:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:53:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:53:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:53:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:53:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:53:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:53:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:53:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:53:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:53:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:53:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:53:23 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:53:23 - job_xml_thread(): Done retrieving: data size 43816830
Fri 17 Jan 2014 20:53:23 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:53:23 - XML: Start document: iteration 14
Fri 17 Jan 2014 20:53:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43816830
Fri 17 Jan 2014 20:53:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:53:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43816830
Fri 17 Jan 2014 20:53:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:53:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:53:34 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:53:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:53:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:53:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:53:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:53:39 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:53:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:53:39 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:53:39 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:53:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:53:40 - XML: Processed 654860 elements - found 701 jobs
Fri 17 Jan 2014 20:53:40 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:53:40 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:53:40 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:53:40 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:53:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:53:45 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:53:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:53:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:53:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:53:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:53:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:53:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:53:47 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:53:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43293229
Fri 17 Jan 2014 20:53:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:53:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:53:47 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:53:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43293229
Fri 17 Jan 2014 20:53:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:53:48 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:53:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 20:53:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:53:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 20:53:48 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:53:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148522 bits 18565 bytes 
Fri 17 Jan 2014 20:53:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:53:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:53:55 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:53:56 - job_xml_thread(): Done retrieving: data size 43293229
Fri 17 Jan 2014 20:53:56 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:53:56 - XML: Start document: iteration 15
Fri 17 Jan 2014 20:54:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:54:00 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:54:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:54:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:54:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:54:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:54:01 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:54:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:54:01 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:54:01 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:54:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:54:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:54:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:54:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:54:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:54:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:54:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:54:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:54:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:54:10 - XML: Processed 648246 elements - found 701 jobs
Fri 17 Jan 2014 20:54:10 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:54:10 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:54:10 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:54:10 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:54:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:54:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43214769
Fri 17 Jan 2014 20:54:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:54:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43214769
Fri 17 Jan 2014 20:54:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:54:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:54:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:54:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:54:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:54:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:54:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:54:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:54:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:54:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:54:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:54:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43214769
Fri 17 Jan 2014 20:54:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:54:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:54:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:54:25 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:54:25 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:54:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:54:36 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:54:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:54:36 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:54:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:54:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:54:36 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:54:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 20:54:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:54:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:54:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:54:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:54:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:54:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:54:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:54:37 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:54:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:54:37 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:54:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:54:38 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:54:38 - job_xml_thread(): Done retrieving: data size 43752591
Fri 17 Jan 2014 20:54:38 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:54:38 - XML: Start document: iteration 16
Fri 17 Jan 2014 20:54:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43752591
Fri 17 Jan 2014 20:54:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:54:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43752591
Fri 17 Jan 2014 20:54:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:54:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:54:48 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:54:49 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 20:54:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:54:49 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:54:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 20:54:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 20:54:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:54:52 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:54:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:54:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6072 values 95748 bits 11968 bytes 
Fri 17 Jan 2014 20:54:52 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:54:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:54:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:54:53 - XML: Processed 654382 elements - found 700 jobs
Fri 17 Jan 2014 20:54:53 - job 7348438 appears to have finished
Fri 17 Jan 2014 20:54:53 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 20:54:53 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 20:54:54 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 20:54:54 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:54:54 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:54:54 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:54:54 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:54:54 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 20:54:54 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 20:54:54 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 20:54:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:54:57 - ganglia_parse_thread(): finished: Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Fri 17 Jan 2014 20:54:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:54:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:54:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:54:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:54:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:54:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:54:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:55:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:55:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:55:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:55:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:55:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:55:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:55:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:55:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:55:03 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:55:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43885342
Fri 17 Jan 2014 20:55:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:55:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43885342
Fri 17 Jan 2014 20:55:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:55:09 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:55:09 - job_xml_thread(): Done retrieving: data size 43885342
Fri 17 Jan 2014 20:55:10 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:55:10 - XML: Start document: iteration 17
Fri 17 Jan 2014 20:55:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:55:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:55:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:55:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:55:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:55:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:55:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:55:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:55:15 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:55:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:55:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:55:16 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:55:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 20:55:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:55:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:55:24 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:55:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:55:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:55:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:55:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:55:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:55:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:55:25 - XML: Processed 655366 elements - found 700 jobs
Fri 17 Jan 2014 20:55:25 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:55:25 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:55:25 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:55:25 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:55:27 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:55:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43863411
Fri 17 Jan 2014 20:55:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:55:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43863411
Fri 17 Jan 2014 20:55:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:55:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:55:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:55:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:55:38 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:55:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:55:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:55:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:55:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:55:40 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:55:40 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:55:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:55:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:55:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:55:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:55:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:55:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:55:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:55:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:55:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:55:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:55:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:55:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:55:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:55:43 - job_xml_thread(): Done retrieving: data size 43900018
Fri 17 Jan 2014 20:55:43 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:55:43 - XML: Start document: iteration 18
Fri 17 Jan 2014 20:55:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43900018
Fri 17 Jan 2014 20:55:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:55:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43900018
Fri 17 Jan 2014 20:55:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:55:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:55:52 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:55:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:55:54 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:55:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 20:55:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 20:55:54 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:55:54 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:55:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:55:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:55:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9343 values 147307 bits 18413 bytes 
Fri 17 Jan 2014 20:55:56 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:55:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:55:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:55:58 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:55:58 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 20:55:58 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:55:58 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 20:55:58 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 20:56:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:56:01 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:56:02 - XML: Processed 655606 elements - found 700 jobs
Fri 17 Jan 2014 20:56:02 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:56:02 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:56:02 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:56:02 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:56:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:56:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Fri 17 Jan 2014 20:56:04 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:56:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:56:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:56:04 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:56:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:56:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:56:08 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:56:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:56:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:56:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:56:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:56:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:56:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:56:10 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:56:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43888036
Fri 17 Jan 2014 20:56:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:56:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43888036
Fri 17 Jan 2014 20:56:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:56:17 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:56:18 - job_xml_thread(): Done retrieving: data size 43888036
Fri 17 Jan 2014 20:56:19 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:56:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:56:19 - XML: Start document: iteration 19
Fri 17 Jan 2014 20:56:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:56:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:56:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:56:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:56:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:56:23 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:56:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:56:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:56:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:56:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:56:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:56:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:56:32 - XML: Processed 655606 elements - found 700 jobs
Fri 17 Jan 2014 20:56:32 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:56:33 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:56:33 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:56:33 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:56:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:56:34 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:56:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:56:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:56:35 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:56:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 20:56:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:56:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:56:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:56:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:56:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:56:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:56:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862963
Fri 17 Jan 2014 20:56:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:56:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862963
Fri 17 Jan 2014 20:56:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:56:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:56:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:56:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:56:46 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:56:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:56:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:56:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:56:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:56:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:56:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:56:48 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:56:48 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:56:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:56:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:56:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:56:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:56:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:56:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:56:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:56:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:56:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:56:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:56:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:56:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43895912
Fri 17 Jan 2014 20:56:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:56:53 - job_xml_thread(): Done retrieving: data size 43895912
Fri 17 Jan 2014 20:56:53 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:56:53 - XML: Start document: iteration 20
Fri 17 Jan 2014 20:56:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43895912
Fri 17 Jan 2014 20:56:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:56:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:56:56 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:56:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:56:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 20:56:57 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:56:58 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:56:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8781 values 138386 bits 17298 bytes 
Fri 17 Jan 2014 20:56:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 20:56:58 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:56:58 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:57:01 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:57:01 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 20:57:01 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 20:57:01 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:57:01 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 20:57:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:57:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:57:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:57:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:57:14 - size of cluster 'LISA Cluster': 624 hosts 79474 metrics 989648 values 15620605 bits 1952575 bytes 
Fri 17 Jan 2014 20:57:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:57:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:57:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:57:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:57:16 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:57:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:57:16 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:57:16 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:57:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:57:17 - XML: Processed 655606 elements - found 700 jobs
Fri 17 Jan 2014 20:57:17 - job 7348555 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 20:57:17 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 20:57:17 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 20:57:17 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 20:57:17 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:57:17 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:57:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:57:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:57:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:57:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:57:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:57:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:57:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:57:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:57:21 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:57:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43901040
Fri 17 Jan 2014 20:57:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:57:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43901040
Fri 17 Jan 2014 20:57:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:57:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:57:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:57:32 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:57:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:57:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:57:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:57:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:57:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:57:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:57:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:57:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:57:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:57:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:57:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:57:34 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:57:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 20:57:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:57:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:57:37 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:57:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:57:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:57:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:57:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:57:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:57:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:57:41 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:57:41 - job_xml_thread(): Done retrieving: data size 43882368
Fri 17 Jan 2014 20:57:41 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:57:41 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 20:57:41 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 20:57:41 - Housekeeping: done.
Fri 17 Jan 2014 20:57:41 - XML: Start document: iteration 0
Fri 17 Jan 2014 20:57:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43882368
Fri 17 Jan 2014 20:57:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:57:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43882368
Fri 17 Jan 2014 20:57:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:57:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:57:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:57:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:57:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:57:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:57:58 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:57:59 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:57:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:57:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 20:58:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 20:58:00 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:58:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6097 values 96180 bits 12022 bytes 
Fri 17 Jan 2014 20:58:01 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:58:01 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 20:58:01 - XML: Processed 655606 elements - found 700 jobs
Fri 17 Jan 2014 20:58:01 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:58:01 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:58:01 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:58:01 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:58:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:58:03 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:58:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:58:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:58:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:58:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:58:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:58:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:58:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:58:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:58:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:58:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:58:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:58:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:58:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:58:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:58:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:58:09 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:58:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43884964
Fri 17 Jan 2014 20:58:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:58:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43884964
Fri 17 Jan 2014 20:58:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:58:17 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:58:17 - job_xml_thread(): Done retrieving: data size 43884964
Fri 17 Jan 2014 20:58:17 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:58:17 - XML: Start document: iteration 1
Fri 17 Jan 2014 20:58:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:58:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:58:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:58:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:58:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:58:28 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:58:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:58:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:58:29 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:58:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:58:29 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:58:29 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:58:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:58:31 - XML: Processed 655606 elements - found 700 jobs
Fri 17 Jan 2014 20:58:31 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:58:31 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:58:31 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:58:31 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:58:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:58:33 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:58:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:58:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:58:33 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:58:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 20:58:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:58:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:58:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:58:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:58:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:58:34 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 20:58:34 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 20:58:34 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:58:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:58:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43894760
Fri 17 Jan 2014 20:58:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:58:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43894760
Fri 17 Jan 2014 20:58:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:58:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:58:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:58:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:58:45 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:58:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:58:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:58:46 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:58:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:58:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:58:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:58:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:58:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:58:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:58:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:58:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:58:49 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:58:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:58:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:58:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:58:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:58:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:58:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:58:51 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:58:51 - job_xml_thread(): Done retrieving: data size 43892514
Fri 17 Jan 2014 20:58:51 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:58:51 - XML: Start document: iteration 2
Fri 17 Jan 2014 20:58:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43892514
Fri 17 Jan 2014 20:58:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:58:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43892514
Fri 17 Jan 2014 20:58:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:58:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:58:59 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:59:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:59:00 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:59:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 20:59:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 20:59:00 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:59:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:59:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:59:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9033 values 142398 bits 17799 bytes 
Fri 17 Jan 2014 20:59:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:59:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:59:06 - XML: Processed 655606 elements - found 700 jobs
Fri 17 Jan 2014 20:59:06 - job 7348551 appears to have finished
Fri 17 Jan 2014 20:59:06 - job 7348556 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 20:59:06 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 20:59:06 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 20:59:08 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 20:59:08 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:59:09 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:59:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:59:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:59:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:59:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:59:11 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:59:11 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:59:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:59:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:59:12 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:59:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:59:13 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:59:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:59:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:59:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:59:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:59:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:59:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:59:16 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:59:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43841939
Fri 17 Jan 2014 20:59:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:59:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43841939
Fri 17 Jan 2014 20:59:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:59:24 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:59:24 - job_xml_thread(): Done retrieving: data size 43841939
Fri 17 Jan 2014 20:59:24 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 20:59:24 - XML: Start document: iteration 3
Fri 17 Jan 2014 20:59:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:59:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:59:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:59:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:59:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:59:34 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:59:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:59:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:59:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:59:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:59:35 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:59:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:59:35 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:59:36 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 20:59:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 20:59:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:59:36 - XML: Processed 654855 elements - found 700 jobs
Fri 17 Jan 2014 20:59:36 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 20:59:36 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 20:59:36 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 20:59:36 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 20:59:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 20:59:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 20:59:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 20:59:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 20:59:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:59:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 20:59:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 20:59:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 20:59:41 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 20:59:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43287718
Fri 17 Jan 2014 20:59:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:59:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43287718
Fri 17 Jan 2014 20:59:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 20:59:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 20:59:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:59:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:59:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 20:59:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 20:59:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 20:59:51 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:59:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 20:59:51 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 20:59:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 20:59:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43287718
Fri 17 Jan 2014 20:59:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 20:59:51 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 20:59:51 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 20:59:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 20:59:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 20:59:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 20:59:58 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:00:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:00:01 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:00:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:00:01 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:00:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:00:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:00:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:00:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:00:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:00:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:00:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:00:01 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:00:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 21:00:01 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:00:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6188 values 97567 bits 12195 bytes 
Fri 17 Jan 2014 21:00:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 21:00:03 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:00:03 - job_xml_thread(): Done retrieving: data size 43221816
Fri 17 Jan 2014 21:00:03 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:00:03 - XML: Start document: iteration 4
Fri 17 Jan 2014 21:00:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43221816
Fri 17 Jan 2014 21:00:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:00:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:00:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:00:07 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:00:07 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:00:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:00:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:00:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43221816
Fri 17 Jan 2014 21:00:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:00:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:00:14 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:00:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:00:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:00:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:00:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:00:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:00:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:00:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:00:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:00:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:00:24 - XML: Processed 647453 elements - found 700 jobs
Fri 17 Jan 2014 21:00:24 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:00:24 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:00:24 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:00:24 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:00:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:00:24 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:00:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:00:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:00:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:00:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:00:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:00:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:00:25 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:00:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 21:00:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:00:26 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:00:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43286762
Fri 17 Jan 2014 21:00:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:00:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43286762
Fri 17 Jan 2014 21:00:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:00:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:00:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:00:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:00:38 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:00:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:00:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:00:39 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:00:39 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:00:39 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:00:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:00:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:00:39 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:00:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:00:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:00:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:00:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:00:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:00:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:00:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:00:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:00:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:00:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:00:42 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:00:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43781360
Fri 17 Jan 2014 21:00:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:00:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43781360
Fri 17 Jan 2014 21:00:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:00:43 - job_xml_thread(): Done retrieving: data size 43781360
Fri 17 Jan 2014 21:00:44 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:00:44 - XML: Start document: iteration 5
Fri 17 Jan 2014 21:00:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:00:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:00:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:00:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:00:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:00:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:00:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:00:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:00:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:00:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:00:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:00:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:00:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:01:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:01:02 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:01:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:01:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 21:01:03 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:01:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 21:01:03 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:01:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8138 values 128262 bits 16032 bytes 
Fri 17 Jan 2014 21:01:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:01:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:01:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:01:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:01:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:01:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:01:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:01:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:01:05 - XML: Processed 654178 elements - found 701 jobs
Fri 17 Jan 2014 21:01:05 - job 7348578 appears to have finished
Fri 17 Jan 2014 21:01:05 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 21:01:05 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 21:01:05 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 21:01:05 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:01:05 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:01:07 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:01:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43866316
Fri 17 Jan 2014 21:01:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:01:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43866316
Fri 17 Jan 2014 21:01:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:01:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:01:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:01:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:01:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:01:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:01:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:01:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:01:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:01:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:01:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:01:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:01:20 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:01:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:01:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:01:21 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:01:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 21:01:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:01:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:01:23 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:01:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:01:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:01:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:01:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:01:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:01:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:01:24 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:01:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43869675
Fri 17 Jan 2014 21:01:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:01:24 - job_xml_thread(): Done retrieving: data size 43869675
Fri 17 Jan 2014 21:01:24 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:01:24 - XML: Start document: iteration 6
Fri 17 Jan 2014 21:01:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43869675
Fri 17 Jan 2014 21:01:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:01:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:01:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:01:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:01:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:01:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:01:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:01:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:01:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:01:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:01:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:01:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:01:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:01:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:01:44 - XML: Processed 655608 elements - found 701 jobs
Fri 17 Jan 2014 21:01:44 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:01:44 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:01:44 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:01:44 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:01:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:01:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:01:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:01:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:01:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:01:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:01:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:01:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:01:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:01:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43886459
Fri 17 Jan 2014 21:01:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:01:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43886459
Fri 17 Jan 2014 21:01:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:01:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:01:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:01:59 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:01:59 - job_xml_thread(): Done retrieving: data size 43886459
Fri 17 Jan 2014 21:01:59 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:01:59 - XML: Start document: iteration 7
Fri 17 Jan 2014 21:02:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:02:00 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:02:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:02:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:02:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:02:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:02:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:02:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:02:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:02:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:02:03 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:02:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:02:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:02:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:02:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 21:02:04 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:02:04 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:02:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 21:02:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9040 values 142875 bits 17859 bytes 
Fri 17 Jan 2014 21:02:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:02:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:02:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:02:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:02:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:02:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:02:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:02:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:02:12 - XML: Processed 655608 elements - found 701 jobs
Fri 17 Jan 2014 21:02:12 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:02:12 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:02:12 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:02:12 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:02:15 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:02:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43874286
Fri 17 Jan 2014 21:02:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:02:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43874286
Fri 17 Jan 2014 21:02:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:02:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:02:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:02:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:02:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:02:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:02:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:02:25 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:02:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:02:25 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:02:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:02:26 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:02:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:02:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:02:26 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:02:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 21:02:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:02:27 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:02:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:02:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:02:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:02:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:02:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:02:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:02:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:02:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:02:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:02:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43913912
Fri 17 Jan 2014 21:02:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:02:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43913912
Fri 17 Jan 2014 21:02:32 - job_xml_thread(): Done retrieving: data size 43913912
Fri 17 Jan 2014 21:02:32 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:02:32 - XML: Start document: iteration 8
Fri 17 Jan 2014 21:02:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:02:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:02:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:02:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:02:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:02:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:02:45 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:02:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:02:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:02:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:02:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:02:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:02:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:02:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:02:49 - XML: Processed 655608 elements - found 701 jobs
Fri 17 Jan 2014 21:02:49 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:02:49 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:02:49 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:02:49 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:02:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:02:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:02:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:02:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:02:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:02:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:02:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:02:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:02:53 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:02:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873950
Fri 17 Jan 2014 21:02:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:02:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873950
Fri 17 Jan 2014 21:02:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:03:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:03:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:03:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:03:04 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:03:04 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:03:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:03:05 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:03:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:03:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 21:03:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 21:03:05 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:03:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9041 values 143038 bits 17879 bytes 
Fri 17 Jan 2014 21:03:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:03:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:03:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:03:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:03:06 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:03:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:03:06 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:03:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:03:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:03:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:03:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:03:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:03:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:03:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:03:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:03:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:03:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:03:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:03:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:03:11 - job_xml_thread(): Done retrieving: data size 43884029
Fri 17 Jan 2014 21:03:11 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:03:11 - XML: Start document: iteration 9
Fri 17 Jan 2014 21:03:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43884029
Fri 17 Jan 2014 21:03:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43884029
Fri 17 Jan 2014 21:03:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:03:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:03:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:03:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:03:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:03:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:03:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:03:28 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:03:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:03:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:03:29 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:03:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:03:29 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:03:29 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:03:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:03:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:03:34 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:03:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:03:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:03:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:03:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:03:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:03:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:03:36 - XML: Processed 655608 elements - found 701 jobs
Fri 17 Jan 2014 21:03:36 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:03:36 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:03:36 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:03:36 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:03:36 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:03:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 21:03:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:03:37 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:03:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43872210
Fri 17 Jan 2014 21:03:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:03:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43872210
Fri 17 Jan 2014 21:03:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:03:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:03:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:03:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:03:45 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:03:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:03:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:03:47 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:03:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:03:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43872210
Fri 17 Jan 2014 21:03:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:03:47 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:03:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:03:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:03:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:03:51 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:03:51 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:03:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:03:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:03:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:03:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:03:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:03:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:03:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:03:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:03:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:03:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:04:00 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:04:00 - job_xml_thread(): Done retrieving: data size 43887889
Fri 17 Jan 2014 21:04:00 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:04:00 - XML: Start document: iteration 10
Fri 17 Jan 2014 21:04:01 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 21:04:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43887889
Fri 17 Jan 2014 21:04:01 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:04:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:04:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:04:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:04:03 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:04:03 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:04:03 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 21:04:03 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 21:04:03 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 21:04:04 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:04:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:04:04 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:04:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:04:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43887889
Fri 17 Jan 2014 21:04:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Fri 17 Jan 2014 21:04:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:04:05 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:04:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:04:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 21:04:07 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:04:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9000 values 142073 bits 17759 bytes 
Fri 17 Jan 2014 21:04:07 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:04:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 21:04:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:04:13 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:04:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:04:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:04:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:04:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:04:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:04:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:04:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:04:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:04:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:04:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:04:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:04:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:04:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:04:20 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:04:20 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:04:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:04:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:04:21 - XML: Processed 655608 elements - found 701 jobs
Fri 17 Jan 2014 21:04:21 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:04:21 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:04:21 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:04:21 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:04:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:04:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43885180
Fri 17 Jan 2014 21:04:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:04:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43885180
Fri 17 Jan 2014 21:04:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:04:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:04:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:04:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:04:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:04:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:04:36 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:04:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:04:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:04:36 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:04:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:04:37 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:04:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 21:04:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:04:37 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:04:37 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:04:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:04:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:04:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:04:38 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:04:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:04:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:04:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:04:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:04:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:04:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:04:40 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:04:40 - job_xml_thread(): Done retrieving: data size 43891795
Fri 17 Jan 2014 21:04:40 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:04:40 - XML: Start document: iteration 11
Fri 17 Jan 2014 21:04:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43891795
Fri 17 Jan 2014 21:04:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:04:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43891795
Fri 17 Jan 2014 21:04:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:04:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:04:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:04:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:04:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:04:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:04:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:04:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:04:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:04:59 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:04:59 - XML: Processed 655608 elements - found 701 jobs
Fri 17 Jan 2014 21:04:59 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:04:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:04:59 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:04:59 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:04:59 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:04:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:04:59 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:04:59 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:05:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:05:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:05:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:05:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:05:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:05:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:05:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:05:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:05:03 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:05:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43901522
Fri 17 Jan 2014 21:05:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:05:03 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:05:03 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:05:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43901522
Fri 17 Jan 2014 21:05:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:05:06 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:05:06 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:05:06 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 21:05:06 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 21:05:06 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 21:05:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:05:08 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:05:11 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:05:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:05:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 21:05:11 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:05:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 21:05:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9354 values 147509 bits 18438 bytes 
Fri 17 Jan 2014 21:05:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:05:13 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:05:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:05:14 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:05:14 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:05:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:05:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:05:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:05:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:05:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:05:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:05:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:05:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:05:19 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:05:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:05:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:05:19 - size of cluster 'LISA Cluster': 624 hosts 79487 metrics 1051021 values 16611537 bits 2076442 bytes 
Fri 17 Jan 2014 21:05:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:05:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:05:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:05:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:05:23 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:05:23 - job_xml_thread(): Done retrieving: data size 43802116
Fri 17 Jan 2014 21:05:23 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:05:23 - XML: Start document: iteration 12
Fri 17 Jan 2014 21:05:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43802116
Fri 17 Jan 2014 21:05:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:05:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43802116
Fri 17 Jan 2014 21:05:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:05:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:05:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:05:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:05:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:05:38 - XML: Processed 654860 elements - found 701 jobs
Fri 17 Jan 2014 21:05:38 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:05:38 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:05:38 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:05:38 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:05:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:05:45 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:05:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:05:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:05:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:05:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:05:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:05:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:05:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:05:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:05:48 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:05:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:05:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:05:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:05:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:05:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:05:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:05:48 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:05:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 21:05:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:05:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:05:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43257729
Fri 17 Jan 2014 21:05:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:05:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43257729
Fri 17 Jan 2014 21:05:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:05:53 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:05:53 - job_xml_thread(): Done retrieving: data size 43257729
Fri 17 Jan 2014 21:05:54 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:05:54 - XML: Start document: iteration 13
Fri 17 Jan 2014 21:06:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:06:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:06:01 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:06:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:06:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:06:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:06:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:06:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:06:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43257729
Fri 17 Jan 2014 21:06:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:06:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:06:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:06:06 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:06:06 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 21:06:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:06:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:06:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:06:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:06:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:06:12 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:06:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:06:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:06:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:06:12 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:06:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:06:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:06:12 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:06:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 21:06:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 21:06:12 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:06:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5712 values 90052 bits 11256 bytes 
Fri 17 Jan 2014 21:06:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:06:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:06:19 - XML: Processed 647818 elements - found 701 jobs
Fri 17 Jan 2014 21:06:19 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:06:19 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:06:19 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:06:19 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:06:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:06:21 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:06:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:06:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:06:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:06:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:06:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:06:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:06:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:06:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43257446
Fri 17 Jan 2014 21:06:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:06:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43257446
Fri 17 Jan 2014 21:06:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:06:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:06:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:06:34 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:06:34 - job_xml_thread(): Done retrieving: data size 43257446
Fri 17 Jan 2014 21:06:34 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:06:34 - XML: Start document: iteration 14
Fri 17 Jan 2014 21:06:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:06:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:06:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:06:41 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:06:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:06:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:06:42 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:06:42 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:06:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:06:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:06:42 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:06:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:06:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:06:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:06:50 - XML: Processed 648156 elements - found 701 jobs
Fri 17 Jan 2014 21:06:50 - job 7348626 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 21:06:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:06:50 - job 7348359 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 21:06:50 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 21:06:50 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 21:06:50 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 21:06:50 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:06:50 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:06:50 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:06:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 21:06:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:06:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:06:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:06:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:06:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:06:54 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:06:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43840716
Fri 17 Jan 2014 21:06:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:06:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43840716
Fri 17 Jan 2014 21:06:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:06:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:06:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:07:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:07:03 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:07:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:07:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:07:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:07:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:07:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:07:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43840716
Fri 17 Jan 2014 21:07:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:07:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:07:05 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:07:05 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:07:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:07:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:07:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:07:12 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:07:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:07:13 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:07:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 21:07:13 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:07:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 21:07:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5815 values 91678 bits 11459 bytes 
Fri 17 Jan 2014 21:07:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:07:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:07:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:07:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:07:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:07:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:07:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:07:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:07:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:07:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:07:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:07:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:07:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:07:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:07:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:07:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:07:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:07:20 - job_xml_thread(): Done retrieving: data size 43848475
Fri 17 Jan 2014 21:07:20 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:07:20 - XML: Start document: iteration 15
Fri 17 Jan 2014 21:07:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43848475
Fri 17 Jan 2014 21:07:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:07:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43848475
Fri 17 Jan 2014 21:07:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:07:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:07:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:07:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:07:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:07:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:07:36 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:07:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:07:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:07:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:07:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:07:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:07:37 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:07:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:07:42 - XML: Processed 655608 elements - found 701 jobs
Fri 17 Jan 2014 21:07:42 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:07:42 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:07:42 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:07:42 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:07:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:07:45 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:07:45 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:07:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 21:07:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:07:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:07:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:07:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:07:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:07:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:07:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:07:47 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 21:07:47 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 21:07:47 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:07:48 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:07:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862826
Fri 17 Jan 2014 21:07:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:07:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862826
Fri 17 Jan 2014 21:07:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:07:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:07:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:07:57 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:07:57 - job_xml_thread(): Done retrieving: data size 43862826
Fri 17 Jan 2014 21:07:57 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:07:57 - XML: Start document: iteration 16
Fri 17 Jan 2014 21:08:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:08:00 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:08:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:08:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:08:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:08:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:08:04 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:08:04 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:08:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:08:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:08:05 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:08:10 - XML: Processed 655608 elements - found 701 jobs
Fri 17 Jan 2014 21:08:10 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:08:10 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:08:10 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:08:10 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:08:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:08:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:08:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:08:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:08:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:08:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:08:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:08:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:08:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:08:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43891594
Fri 17 Jan 2014 21:08:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:08:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:08:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43891594
Fri 17 Jan 2014 21:08:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:08:13 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:08:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:08:15 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:08:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 21:08:15 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:08:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 21:08:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8980 values 141630 bits 17703 bytes 
Fri 17 Jan 2014 21:08:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:08:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:08:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:08:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:08:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:08:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:08:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:08:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:08:23 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:08:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:08:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:08:25 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:08:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:08:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:08:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:08:27 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:08:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:08:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:08:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:08:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:08:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:08:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:08:30 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:08:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43905792
Fri 17 Jan 2014 21:08:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:08:31 - job_xml_thread(): Done retrieving: data size 43905792
Fri 17 Jan 2014 21:08:31 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:08:31 - XML: Start document: iteration 17
Fri 17 Jan 2014 21:08:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43905792
Fri 17 Jan 2014 21:08:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:08:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:08:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:08:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:08:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:08:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:08:45 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:08:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:08:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:08:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:08:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:08:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:08:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:08:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:08:49 - XML: Processed 655604 elements - found 699 jobs
Fri 17 Jan 2014 21:08:49 - job 7348020 appears to have finished
Fri 17 Jan 2014 21:08:49 - job 7341517 appears to have finished
Fri 17 Jan 2014 21:08:49 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 21:08:49 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 21:08:50 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 21:08:50 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:08:50 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:08:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:08:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:08:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:08:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:08:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:08:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:08:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:08:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:08:55 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:08:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 21:08:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:08:56 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:08:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43878372
Fri 17 Jan 2014 21:08:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:08:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43878372
Fri 17 Jan 2014 21:08:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:09:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:09:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:09:05 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:09:05 - job_xml_thread(): Done retrieving: data size 43878372
Fri 17 Jan 2014 21:09:05 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:09:05 - XML: Start document: iteration 18
Fri 17 Jan 2014 21:09:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:09:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:09:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:09:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:09:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:09:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:09:12 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:09:12 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:09:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:09:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:09:12 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:09:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:09:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:09:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:09:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:09:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:09:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:09:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:09:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:09:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:09:15 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:09:15 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:09:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 21:09:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:09:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 21:09:16 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:09:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5530 values 87169 bits 10896 bytes 
Fri 17 Jan 2014 21:09:17 - XML: Processed 655604 elements - found 699 jobs
Fri 17 Jan 2014 21:09:17 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:09:17 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:09:17 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:09:17 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:09:20 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:09:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 21:09:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:09:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:09:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43874945
Fri 17 Jan 2014 21:09:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:09:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43874945
Fri 17 Jan 2014 21:09:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:09:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:09:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:09:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:09:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:09:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:09:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:09:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:09:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:09:32 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:09:32 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:09:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:09:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:09:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:09:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:09:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:09:35 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:09:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:09:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:09:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:09:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:09:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:09:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:09:37 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:09:37 - job_xml_thread(): Done retrieving: data size 43898570
Fri 17 Jan 2014 21:09:37 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:09:37 - XML: Start document: iteration 19
Fri 17 Jan 2014 21:09:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43898570
Fri 17 Jan 2014 21:09:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:09:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43898570
Fri 17 Jan 2014 21:09:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:09:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:09:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:09:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:09:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:09:55 - XML: Processed 655604 elements - found 699 jobs
Fri 17 Jan 2014 21:09:56 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:09:56 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:09:56 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:09:56 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:09:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:09:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:09:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:09:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:10:01 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:10:01 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:10:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:10:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:10:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:10:01 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:10:01 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:10:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:10:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:10:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:10:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:10:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:10:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:10:03 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:10:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43904404
Fri 17 Jan 2014 21:10:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:10:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43904404
Fri 17 Jan 2014 21:10:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:10:12 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:10:12 - job_xml_thread(): Done retrieving: data size 43904404
Fri 17 Jan 2014 21:10:12 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:10:12 - XML: Start document: iteration 20
Fri 17 Jan 2014 21:10:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:10:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:10:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:10:15 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:10:16 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:10:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:10:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 21:10:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 21:10:16 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:10:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148636 bits 18579 bytes 
Fri 17 Jan 2014 21:10:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:10:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:10:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:10:17 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:10:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:10:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:10:17 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:10:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:10:17 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:10:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:10:21 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:10:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:10:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:10:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:10:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:10:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:10:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:10:24 - XML: Processed 655604 elements - found 699 jobs
Fri 17 Jan 2014 21:10:24 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:10:24 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:10:24 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:10:24 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:10:26 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:10:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875251
Fri 17 Jan 2014 21:10:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:10:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875251
Fri 17 Jan 2014 21:10:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:10:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:10:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:10:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:10:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:10:39 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:10:39 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:10:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:10:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:10:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:10:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:10:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:10:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:10:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:10:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:10:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:10:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:10:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:10:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:10:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:10:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:10:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:10:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:10:42 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:10:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 21:10:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:10:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:10:43 - job_xml_thread(): Done retrieving: data size 43906907
Fri 17 Jan 2014 21:10:43 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:10:43 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 21:10:43 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 21:10:43 - Housekeeping: done.
Fri 17 Jan 2014 21:10:43 - XML: Start document: iteration 0
Fri 17 Jan 2014 21:10:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43906907
Fri 17 Jan 2014 21:10:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43906907
Fri 17 Jan 2014 21:10:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:10:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:10:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:10:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:10:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:10:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:10:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:10:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:10:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:10:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:10:59 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:10:59 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:10:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:10:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:10:59 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:11:02 - XML: Processed 655604 elements - found 699 jobs
Fri 17 Jan 2014 21:11:02 - job 7348557 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 21:11:02 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 21:11:02 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 21:11:02 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 21:11:03 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:11:03 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:11:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:11:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:11:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:11:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:11:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:11:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:11:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:11:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:11:07 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:11:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43877956
Fri 17 Jan 2014 21:11:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:11:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43877956
Fri 17 Jan 2014 21:11:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:11:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:11:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:11:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:11:17 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:11:18 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:11:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:11:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:11:18 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:11:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 21:11:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 21:11:18 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:11:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:11:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8782 values 138490 bits 17311 bytes 
Fri 17 Jan 2014 21:11:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:11:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:11:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:11:20 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:11:20 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:11:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:11:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:11:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:11:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:11:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:11:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:11:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:11:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:11:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:11:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:11:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:11:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:11:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:11:25 - job_xml_thread(): Done retrieving: data size 43828946
Fri 17 Jan 2014 21:11:25 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:11:25 - XML: Start document: iteration 1
Fri 17 Jan 2014 21:11:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43828946
Fri 17 Jan 2014 21:11:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:11:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43828946
Fri 17 Jan 2014 21:11:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:11:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:11:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:11:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:11:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:11:43 - XML: Processed 654856 elements - found 699 jobs
Fri 17 Jan 2014 21:11:43 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:11:43 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:11:43 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:11:43 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:11:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:11:45 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:11:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:11:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:11:47 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:11:47 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:11:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:11:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:11:47 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:11:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:11:48 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:11:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:11:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:11:49 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:11:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 21:11:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:11:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:11:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:11:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:11:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:11:50 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:11:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43243595
Fri 17 Jan 2014 21:11:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:11:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43243595
Fri 17 Jan 2014 21:11:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:11:58 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:11:58 - job_xml_thread(): Done retrieving: data size 43243595
Fri 17 Jan 2014 21:11:59 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:11:59 - XML: Start document: iteration 2
Fri 17 Jan 2014 21:12:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:12:01 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:12:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:12:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:12:04 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:12:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:12:04 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:12:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:12:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:12:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:12:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:12:07 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 21:12:07 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:12:08 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:12:08 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:12:08 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 21:12:08 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 21:12:08 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 21:12:12 - XML: Processed 647610 elements - found 699 jobs
Fri 17 Jan 2014 21:12:12 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:12:12 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:12:12 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:12:12 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:12:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:12:13 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:12:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:12:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:12:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:12:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:12:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:12:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:12:13 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 928867 values 14666322 bits 1833290 bytes 
Fri 17 Jan 2014 21:12:17 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:12:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43230963
Fri 17 Jan 2014 21:12:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:12:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43230963
Fri 17 Jan 2014 21:12:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:12:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:12:18 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:12:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:12:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:12:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:12:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 21:12:19 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:12:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 21:12:20 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:12:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8822 values 139221 bits 17402 bytes 
Fri 17 Jan 2014 21:12:27 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:12:27 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:12:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:12:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:12:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:12:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:12:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:12:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:12:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:12:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:12:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:12:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:12:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:12:33 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:12:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:12:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:12:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:12:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:12:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:12:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:12:37 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:12:37 - job_xml_thread(): Done retrieving: data size 43736551
Fri 17 Jan 2014 21:12:37 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:12:37 - XML: Start document: iteration 3
Fri 17 Jan 2014 21:12:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43736551
Fri 17 Jan 2014 21:12:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:12:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43736551
Fri 17 Jan 2014 21:12:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:12:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:12:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:12:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:12:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:12:50 - XML: Processed 653958 elements - found 698 jobs
Fri 17 Jan 2014 21:12:50 - job 7343763 appears to have finished
Fri 17 Jan 2014 21:12:50 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 21:12:50 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 21:12:52 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 21:12:52 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:12:52 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:12:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:12:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:12:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:12:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:12:56 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:12:56 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:12:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:12:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:12:56 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:12:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:12:59 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:12:59 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:12:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 21:12:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:12:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:12:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:13:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:13:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:13:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:13:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:13:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:13:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43869132
Fri 17 Jan 2014 21:13:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:13:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43869132
Fri 17 Jan 2014 21:13:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:13:07 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:13:07 - job_xml_thread(): Done retrieving: data size 43869132
Fri 17 Jan 2014 21:13:07 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:13:07 - XML: Start document: iteration 4
Fri 17 Jan 2014 21:13:08 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:13:08 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 21:13:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:13:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:13:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:13:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:13:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:13:20 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:13:21 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:13:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 21:13:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:13:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 21:13:21 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:13:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6135 values 96910 bits 12113 bytes 
Fri 17 Jan 2014 21:13:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:13:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:13:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:13:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:13:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:13:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:13:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:13:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:13:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:13:25 - XML: Processed 655286 elements - found 698 jobs
Fri 17 Jan 2014 21:13:25 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:13:25 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:13:25 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:13:25 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:13:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:13:26 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:13:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:13:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:13:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:13:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:13:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:13:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:13:31 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:13:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43898638
Fri 17 Jan 2014 21:13:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:13:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43898638
Fri 17 Jan 2014 21:13:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:13:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:13:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:13:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:13:40 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:13:40 - job_xml_thread(): Done retrieving: data size 43898638
Fri 17 Jan 2014 21:13:40 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:13:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:13:40 - XML: Start document: iteration 5
Fri 17 Jan 2014 21:13:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:13:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:13:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:13:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:13:42 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:13:42 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:13:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:13:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:13:42 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:13:47 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:13:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 21:13:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:13:51 - XML: Processed 655602 elements - found 698 jobs
Fri 17 Jan 2014 21:13:52 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:13:52 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:13:52 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:13:52 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:13:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:13:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:13:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:13:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:13:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:13:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:13:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:13:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:13:57 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:13:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43857838
Fri 17 Jan 2014 21:13:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:13:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:13:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:13:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43857838
Fri 17 Jan 2014 21:13:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:14:07 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:14:07 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:14:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:14:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:14:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:14:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:14:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:14:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:14:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:14:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:14:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:14:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:14:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:14:13 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:14:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:14:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:14:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:14:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:14:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:14:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:14:17 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:14:17 - job_xml_thread(): Done retrieving: data size 43894340
Fri 17 Jan 2014 21:14:17 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:14:17 - XML: Start document: iteration 6
Fri 17 Jan 2014 21:14:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43894340
Fri 17 Jan 2014 21:14:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43894340
Fri 17 Jan 2014 21:14:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:14:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:14:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:14:21 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:14:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:14:22 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:14:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 21:14:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 21:14:22 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:14:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9128 values 144212 bits 18026 bytes 
Fri 17 Jan 2014 21:14:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:14:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:14:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:14:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:14:40 - XML: Processed 655602 elements - found 698 jobs
Fri 17 Jan 2014 21:14:40 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:14:40 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:14:40 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:14:40 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:14:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:14:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:14:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:14:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:14:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:14:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:14:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:14:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:14:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:14:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:14:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:14:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:14:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:14:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:14:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:14:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:14:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:14:45 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:14:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 21:14:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:14:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:14:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43912809
Fri 17 Jan 2014 21:14:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:14:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43912809
Fri 17 Jan 2014 21:14:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:14:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:14:55 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:14:55 - job_xml_thread(): Done retrieving: data size 43912809
Fri 17 Jan 2014 21:14:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:14:55 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:14:55 - XML: Start document: iteration 7
Fri 17 Jan 2014 21:14:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:14:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:14:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:14:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:14:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:14:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:14:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:14:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:14:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:15:06 - XML: Processed 655604 elements - found 699 jobs
Fri 17 Jan 2014 21:15:06 - job 7348450 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 21:15:06 - job 7348451 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 21:15:06 - job 7348397 report time 1389989515 does not match current heartbeat 1389989636 : ignoring job
Fri 17 Jan 2014 21:15:06 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 21:15:06 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 21:15:07 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 21:15:07 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:15:07 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:15:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:15:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:15:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:15:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:15:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:15:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:15:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:15:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:15:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:15:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43859830
Fri 17 Jan 2014 21:15:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:15:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:15:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:15:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43859830
Fri 17 Jan 2014 21:15:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:15:22 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:15:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:15:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:15:22 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:15:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:15:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:15:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:15:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:15:23 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:15:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:15:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:15:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:15:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:15:23 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:15:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 21:15:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 21:15:23 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:15:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6139 values 97002 bits 12125 bytes 
Fri 17 Jan 2014 21:15:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:15:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:15:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:15:26 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:15:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:15:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:15:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:15:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:15:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:15:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:15:29 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:15:29 - job_xml_thread(): Done retrieving: data size 43887657
Fri 17 Jan 2014 21:15:29 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:15:29 - XML: Start document: iteration 8
Fri 17 Jan 2014 21:15:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43887657
Fri 17 Jan 2014 21:15:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:15:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43887657
Fri 17 Jan 2014 21:15:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:15:36 - XML: Processed 655604 elements - found 699 jobs
Fri 17 Jan 2014 21:15:36 - job 7348397 report time 1389989515 does not match current heartbeat 1389989636 : ignoring job
Fri 17 Jan 2014 21:15:37 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:15:37 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:15:37 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:15:37 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:15:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:15:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:15:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:15:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:15:43 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:15:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 21:15:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:15:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:15:45 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:15:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:15:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:15:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:15:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:15:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:15:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:15:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:15:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:15:49 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:15:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:15:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:15:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:15:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:15:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:15:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:15:52 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:15:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:15:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43883701
Fri 17 Jan 2014 21:15:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:15:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43883701
Fri 17 Jan 2014 21:15:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:15:53 - job_xml_thread(): Done retrieving: data size 43883701
Fri 17 Jan 2014 21:15:53 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:15:53 - XML: Start document: iteration 9
Fri 17 Jan 2014 21:16:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:16:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:16:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:16:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:16:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:16:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:16:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:16:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:16:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:16:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:16:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:16:11 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:16:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:16:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:16:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:16:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:16:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:16:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:16:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:16:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:16:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:16:15 - XML: Processed 655604 elements - found 699 jobs
Fri 17 Jan 2014 21:16:15 - job 7348397 report time 1389989515 does not match current heartbeat 1389989636 : ignoring job
Fri 17 Jan 2014 21:16:15 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:16:15 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:16:15 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:16:15 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:16:16 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 21:16:16 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 21:16:16 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:16:17 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:16:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43909028
Fri 17 Jan 2014 21:16:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:16:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43909028
Fri 17 Jan 2014 21:16:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:16:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:16:23 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:16:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:16:24 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:16:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 21:16:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 21:16:24 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:16:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:16:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:16:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9201 values 145463 bits 18182 bytes 
Fri 17 Jan 2014 21:16:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:16:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:16:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:16:28 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:16:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:16:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:16:29 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:16:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:16:29 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:16:29 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:16:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:16:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:16:30 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:16:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:16:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:16:30 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:16:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:16:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:16:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:16:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:16:33 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:16:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43910426
Fri 17 Jan 2014 21:16:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:16:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43910426
Fri 17 Jan 2014 21:16:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:16:33 - job_xml_thread(): Done retrieving: data size 43910426
Fri 17 Jan 2014 21:16:33 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:16:33 - XML: Start document: iteration 10
Fri 17 Jan 2014 21:16:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:16:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:16:44 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:16:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 21:16:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:16:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:16:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:16:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:16:49 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:16:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:16:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:16:50 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:16:50 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:16:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:16:50 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:16:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:16:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:16:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:16:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:16:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:16:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:16:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:16:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:16:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:16:57 - XML: Processed 655598 elements - found 696 jobs
Fri 17 Jan 2014 21:16:57 - job 7337745 appears to have finished
Fri 17 Jan 2014 21:16:57 - job 7344533 appears to have finished
Fri 17 Jan 2014 21:16:57 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 21:16:57 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 21:16:57 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 21:16:57 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:16:57 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:16:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:16:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43890187
Fri 17 Jan 2014 21:16:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:16:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43890187
Fri 17 Jan 2014 21:16:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:17:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:17:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:17:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:17:12 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:17:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:17:12 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:17:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:17:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:17:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:17:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:17:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:17:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:17:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:17:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:17:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:17:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:17:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:17:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:17:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:17:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:17:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:17:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:17:16 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:17:16 - job_xml_thread(): Done retrieving: data size 43847119
Fri 17 Jan 2014 21:17:16 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:17:16 - XML: Start document: iteration 11
Fri 17 Jan 2014 21:17:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43847119
Fri 17 Jan 2014 21:17:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:17:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43847119
Fri 17 Jan 2014 21:17:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:17:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:17:24 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:17:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:17:26 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:17:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 21:17:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 21:17:26 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:17:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9369 values 148400 bits 18550 bytes 
Fri 17 Jan 2014 21:17:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:17:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:17:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:17:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:17:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:17:31 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:17:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:17:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:17:32 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:17:32 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:17:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:17:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:17:32 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:17:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:17:38 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:17:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:17:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:17:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:17:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:17:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:17:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:17:40 - XML: Processed 654854 elements - found 698 jobs
Fri 17 Jan 2014 21:17:40 - job 7348452 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 21:17:40 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 21:17:40 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 21:17:40 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 21:17:40 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:17:40 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:17:42 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:17:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43328398
Fri 17 Jan 2014 21:17:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:17:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43328398
Fri 17 Jan 2014 21:17:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:17:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:17:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:17:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:17:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:17:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:17:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:17:53 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:17:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:17:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:17:53 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:17:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:17:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:17:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:17:55 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:17:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:17:57 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:17:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:17:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:17:57 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:17:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 21:17:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:17:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:17:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:17:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:17:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:17:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:17:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43237482
Fri 17 Jan 2014 21:17:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:17:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43237482
Fri 17 Jan 2014 21:17:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:17:59 - job_xml_thread(): Done retrieving: data size 43237482
Fri 17 Jan 2014 21:17:59 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:17:59 - XML: Start document: iteration 12
Fri 17 Jan 2014 21:18:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:18:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:18:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:18:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:18:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:18:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:18:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:18:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:18:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:18:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:18:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:18:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:18:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:18:21 - XML: Processed 647408 elements - found 698 jobs
Fri 17 Jan 2014 21:18:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:18:21 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:18:21 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:18:21 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:18:21 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:18:21 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:18:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:18:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:18:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:18:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:18:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:18:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:18:23 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:18:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43267837
Fri 17 Jan 2014 21:18:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:18:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43267837
Fri 17 Jan 2014 21:18:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:18:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:18:26 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:18:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:18:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:18:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:18:29 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:18:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 21:18:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 21:18:29 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:18:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8969 values 141926 bits 17740 bytes 
Fri 17 Jan 2014 21:18:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:18:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:18:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:18:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:18:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:18:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:18:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:18:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:18:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:18:36 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:18:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:18:36 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:18:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:18:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:18:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:18:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:18:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:18:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:18:39 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:18:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43792070
Fri 17 Jan 2014 21:18:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:18:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43792070
Fri 17 Jan 2014 21:18:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:18:39 - job_xml_thread(): Done retrieving: data size 43792070
Fri 17 Jan 2014 21:18:39 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:18:39 - XML: Start document: iteration 13
Fri 17 Jan 2014 21:18:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:18:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:18:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:18:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:18:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:18:58 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:18:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:18:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:18:59 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:18:59 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:18:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:18:59 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:18:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:19:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:19:01 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:19:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:19:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:19:02 - XML: Processed 654414 elements - found 697 jobs
Fri 17 Jan 2014 21:19:02 - job 7343075 appears to have finished
Fri 17 Jan 2014 21:19:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:19:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:19:02 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 21:19:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:19:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:19:02 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 21:19:02 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 21:19:02 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:19:02 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:19:02 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:19:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 21:19:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:19:03 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:19:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43894292
Fri 17 Jan 2014 21:19:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:19:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43894292
Fri 17 Jan 2014 21:19:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:19:09 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 21:19:09 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:19:10 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:19:10 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:19:10 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 21:19:10 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 21:19:10 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 21:19:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:19:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:19:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:19:14 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:19:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:19:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Fri 17 Jan 2014 21:19:16 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:19:16 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:19:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:19:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:19:16 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:19:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:19:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:19:17 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:19:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:19:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:19:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:19:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:19:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:19:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:19:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:19:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:19:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:19:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43888216
Fri 17 Jan 2014 21:19:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:19:20 - job_xml_thread(): Done retrieving: data size 43888216
Fri 17 Jan 2014 21:19:20 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:19:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43888216
Fri 17 Jan 2014 21:19:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:19:21 - XML: Start document: iteration 14
Fri 17 Jan 2014 21:19:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:19:29 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:19:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:19:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:19:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:19:31 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:19:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:19:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:19:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:19:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 21:19:31 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:19:32 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:19:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 21:19:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9133 values 144340 bits 18042 bytes 
Fri 17 Jan 2014 21:19:32 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:19:32 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:19:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:19:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:19:32 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:19:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:19:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:19:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:19:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:19:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:19:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:19:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:19:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:19:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:19:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:19:44 - XML: Processed 655600 elements - found 697 jobs
Fri 17 Jan 2014 21:19:44 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:19:44 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:19:44 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:19:44 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:19:46 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:19:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43861610
Fri 17 Jan 2014 21:19:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:19:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43861610
Fri 17 Jan 2014 21:19:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:19:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:19:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:19:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:19:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:19:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:19:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:19:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:19:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:19:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:19:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:19:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:19:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:19:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:19:59 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:20:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:20:01 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:20:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:20:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:20:01 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:20:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 21:20:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:20:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:20:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:20:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:20:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:20:03 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:20:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43887079
Fri 17 Jan 2014 21:20:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:20:04 - job_xml_thread(): Done retrieving: data size 43887079
Fri 17 Jan 2014 21:20:04 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:20:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43887079
Fri 17 Jan 2014 21:20:04 - XML: Start document: iteration 15
Fri 17 Jan 2014 21:20:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:20:10 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:20:10 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:20:13 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:20:13 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 21:20:13 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:20:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:20:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:20:13 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 21:20:13 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 21:20:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:20:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:20:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:20:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:20:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:20:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:20:20 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:20:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:20:20 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:20:20 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:20:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:20:21 - size of cluster 'LISA Cluster': 624 hosts 79451 metrics 843101 values 13326592 bits 1665824 bytes 
Fri 17 Jan 2014 21:20:24 - XML: Processed 655600 elements - found 697 jobs
Fri 17 Jan 2014 21:20:24 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:20:24 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:20:24 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:20:24 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:20:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:20:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:20:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:20:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:20:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:20:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:20:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:20:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:20:31 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:20:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43882463
Fri 17 Jan 2014 21:20:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:20:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43882463
Fri 17 Jan 2014 21:20:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:20:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:20:32 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:20:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:20:33 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:20:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 21:20:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 21:20:33 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:20:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9034 values 142696 bits 17837 bytes 
Fri 17 Jan 2014 21:20:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:20:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:20:39 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:20:39 - job_xml_thread(): Done retrieving: data size 43882463
Fri 17 Jan 2014 21:20:39 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:20:39 - XML: Start document: iteration 16
Fri 17 Jan 2014 21:20:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:20:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:20:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:20:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:20:42 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:20:42 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:20:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:20:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:20:42 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:20:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:20:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:20:51 - XML: Processed 655600 elements - found 697 jobs
Fri 17 Jan 2014 21:20:51 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:20:51 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:20:51 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:20:51 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:20:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:20:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:20:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:20:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:20:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:20:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:20:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:20:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:20:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:20:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:20:57 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:20:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856794
Fri 17 Jan 2014 21:20:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:20:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43856794
Fri 17 Jan 2014 21:20:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:21:06 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:21:06 - job_xml_thread(): Done retrieving: data size 43856794
Fri 17 Jan 2014 21:21:06 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:21:06 - XML: Start document: iteration 17
Fri 17 Jan 2014 21:21:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:21:07 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:21:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:21:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:21:07 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:21:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:21:07 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:21:07 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:21:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:21:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:21:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:21:13 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:21:13 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 21:21:17 - XML: Processed 655600 elements - found 697 jobs
Fri 17 Jan 2014 21:21:17 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:21:17 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:21:17 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:21:17 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:21:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:21:20 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:21:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:21:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:21:20 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:21:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 21:21:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:21:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:21:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:21:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:21:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:21:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:21:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:21:23 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:21:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851874
Fri 17 Jan 2014 21:21:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:21:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851874
Fri 17 Jan 2014 21:21:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:21:32 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:21:32 - job_xml_thread(): Done retrieving: data size 43851874
Fri 17 Jan 2014 21:21:32 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:21:32 - XML: Start document: iteration 18
Fri 17 Jan 2014 21:21:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:21:33 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:21:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:21:34 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:21:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 21:21:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 21:21:34 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:21:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5836 values 92125 bits 11515 bytes 
Fri 17 Jan 2014 21:21:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:21:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:21:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:21:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:21:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:21:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:21:37 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:21:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:21:37 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:21:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:21:37 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:21:47 - XML: Processed 655600 elements - found 697 jobs
Fri 17 Jan 2014 21:21:47 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:21:47 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:21:47 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:21:47 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:21:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:21:48 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:21:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:21:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:21:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:21:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:21:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:21:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:21:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:21:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43861690
Fri 17 Jan 2014 21:21:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:21:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:21:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:21:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43861690
Fri 17 Jan 2014 21:21:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:22:03 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:22:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:22:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:22:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:22:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:22:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:22:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:22:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:22:06 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:22:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:22:06 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:22:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:22:06 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:22:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 21:22:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:22:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:22:08 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:22:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:22:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:22:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:22:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:22:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:22:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:22:09 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 21:22:09 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 21:22:09 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:22:10 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:22:10 - job_xml_thread(): Done retrieving: data size 43889813
Fri 17 Jan 2014 21:22:10 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:22:10 - XML: Start document: iteration 19
Fri 17 Jan 2014 21:22:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43889813
Fri 17 Jan 2014 21:22:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43889813
Fri 17 Jan 2014 21:22:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:22:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:22:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:22:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:22:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:22:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:22:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:22:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:22:23 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:22:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:22:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:22:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:22:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:22:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:22:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:22:28 - XML: Processed 655600 elements - found 697 jobs
Fri 17 Jan 2014 21:22:28 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:22:28 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:22:28 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:22:28 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:22:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:22:32 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:22:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:22:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:22:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:22:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:22:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:22:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:22:34 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:22:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43876142
Fri 17 Jan 2014 21:22:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:22:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43876142
Fri 17 Jan 2014 21:22:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:22:35 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:22:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:22:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:22:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:22:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 21:22:39 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:22:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 21:22:39 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:22:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:22:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9094 values 143682 bits 17960 bytes 
Fri 17 Jan 2014 21:22:43 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:22:43 - job_xml_thread(): Done retrieving: data size 43876142
Fri 17 Jan 2014 21:22:43 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:22:43 - XML: Start document: iteration 20
Fri 17 Jan 2014 21:22:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:22:46 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:22:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:22:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:22:47 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:22:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:22:47 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:22:47 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:22:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:22:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:22:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:22:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:22:55 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:22:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:22:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:22:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:22:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:22:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:22:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:22:57 - XML: Processed 655600 elements - found 697 jobs
Fri 17 Jan 2014 21:22:57 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:22:57 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:22:57 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:22:57 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:22:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:22:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43871412
Fri 17 Jan 2014 21:22:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:23:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43871412
Fri 17 Jan 2014 21:23:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:23:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:23:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:23:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:23:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:23:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:23:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:23:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:23:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:23:12 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:23:12 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:23:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:23:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:23:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:23:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:23:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:23:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:23:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:23:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:23:14 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:23:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 21:23:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:23:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:23:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:23:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:23:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:23:15 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:23:15 - job_xml_thread(): Done retrieving: data size 43839313
Fri 17 Jan 2014 21:23:15 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:23:15 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 21:23:15 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 21:23:15 - Housekeeping: done.
Fri 17 Jan 2014 21:23:15 - XML: Start document: iteration 0
Fri 17 Jan 2014 21:23:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43839313
Fri 17 Jan 2014 21:23:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:23:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43839313
Fri 17 Jan 2014 21:23:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:23:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:23:28 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:23:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:23:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:23:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:23:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:23:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:23:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:23:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:23:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:23:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:23:34 - XML: Processed 654852 elements - found 697 jobs
Fri 17 Jan 2014 21:23:34 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:23:34 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:23:34 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:23:34 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:23:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:23:35 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:23:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:23:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:23:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:23:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:23:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:23:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:23:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:23:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43408267
Fri 17 Jan 2014 21:23:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:23:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43408267
Fri 17 Jan 2014 21:23:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:23:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:23:39 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:23:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:23:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 21:23:41 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:23:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 21:23:41 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:23:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8877 values 140080 bits 17510 bytes 
Fri 17 Jan 2014 21:23:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:23:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:23:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:23:46 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:23:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:23:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:23:47 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:23:47 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:23:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:23:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:23:47 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:23:49 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:23:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:23:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:23:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:23:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:23:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:23:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:23:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:23:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:23:53 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:23:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43232240
Fri 17 Jan 2014 21:23:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:23:53 - job_xml_thread(): Done retrieving: data size 43232240
Fri 17 Jan 2014 21:23:53 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:23:53 - XML: Start document: iteration 1
Fri 17 Jan 2014 21:23:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43232240
Fri 17 Jan 2014 21:23:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:24:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:24:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:24:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:24:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:24:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:24:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:24:06 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:24:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:24:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:24:06 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:24:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:24:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:24:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:24:11 - XML: Processed 647566 elements - found 697 jobs
Fri 17 Jan 2014 21:24:11 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:24:11 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:24:12 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:24:12 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:24:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:24:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:24:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:24:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:24:16 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:24:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 21:24:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:24:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:24:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:24:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:24:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:24:17 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:24:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43238988
Fri 17 Jan 2014 21:24:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:24:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43238988
Fri 17 Jan 2014 21:24:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:24:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:24:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:24:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:24:25 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:24:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:24:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:24:26 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:24:26 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:24:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:24:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:24:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43238988
Fri 17 Jan 2014 21:24:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:24:27 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:24:27 - job_xml_thread(): Done retrieving: data size 43238988
Fri 17 Jan 2014 21:24:27 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:24:27 - XML: Start document: iteration 2
Fri 17 Jan 2014 21:24:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:24:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:24:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:24:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:24:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:24:41 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:24:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:24:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:24:42 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:24:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:24:42 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:24:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:24:42 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:24:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:24:42 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:24:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 21:24:42 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:24:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 21:24:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5695 values 89802 bits 11225 bytes 
Fri 17 Jan 2014 21:24:45 - XML: Processed 647628 elements - found 697 jobs
Fri 17 Jan 2014 21:24:45 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:24:45 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:24:46 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:24:46 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:24:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:24:46 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:24:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:24:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:24:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:24:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:24:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:24:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:24:48 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:24:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 21:24:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:24:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:24:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43813436
Fri 17 Jan 2014 21:24:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:24:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43813436
Fri 17 Jan 2014 21:24:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:24:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:24:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:25:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:25:00 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:25:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:25:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:25:01 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:25:01 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:25:01 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:25:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:25:01 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:25:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:25:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:25:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:25:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:25:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:25:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:25:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:25:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:25:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:25:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:25:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:25:06 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:25:06 - job_xml_thread(): Done retrieving: data size 43882056
Fri 17 Jan 2014 21:25:06 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:25:06 - XML: Start document: iteration 3
Fri 17 Jan 2014 21:25:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43882056
Fri 17 Jan 2014 21:25:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:25:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43882056
Fri 17 Jan 2014 21:25:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:25:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:25:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:25:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:25:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:25:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:25:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:25:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:25:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:25:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:25:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:25:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:25:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:25:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:25:27 - XML: Processed 655600 elements - found 697 jobs
Fri 17 Jan 2014 21:25:27 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:25:27 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:25:27 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:25:27 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:25:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:25:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:25:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:25:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:25:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:25:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:25:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:25:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:25:30 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:25:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43884877
Fri 17 Jan 2014 21:25:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:25:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43884877
Fri 17 Jan 2014 21:25:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:25:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:25:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:25:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:25:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:25:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:25:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:25:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:25:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:25:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:25:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:25:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:25:42 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:25:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:25:42 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:25:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:25:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:25:43 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:25:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 21:25:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:25:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 21:25:43 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:25:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148759 bits 18594 bytes 
Fri 17 Jan 2014 21:25:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:25:44 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:25:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:25:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:25:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:25:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:25:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:25:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:25:47 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:25:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 21:25:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:25:47 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:25:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43894592
Fri 17 Jan 2014 21:25:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:25:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43894592
Fri 17 Jan 2014 21:25:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:25:48 - job_xml_thread(): Done retrieving: data size 43894592
Fri 17 Jan 2014 21:25:48 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:25:48 - XML: Start document: iteration 4
Fri 17 Jan 2014 21:25:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:25:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:26:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:26:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:26:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:26:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:26:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:26:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:26:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:26:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:26:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:26:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:26:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:26:04 - XML: Processed 655600 elements - found 697 jobs
Fri 17 Jan 2014 21:26:04 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:26:04 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:26:04 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:26:04 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:26:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:26:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:26:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:26:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:26:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:26:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:26:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:26:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:26:09 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:26:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43888630
Fri 17 Jan 2014 21:26:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:26:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43888630
Fri 17 Jan 2014 21:26:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:26:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:26:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:26:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:26:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:26:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:26:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:26:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:26:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:26:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43888630
Fri 17 Jan 2014 21:26:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:26:19 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:26:19 - job_xml_thread(): Done retrieving: data size 43888630
Fri 17 Jan 2014 21:26:19 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:26:19 - XML: Start document: iteration 5
Fri 17 Jan 2014 21:26:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:26:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:26:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:26:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:26:36 - XML: Processed 655600 elements - found 697 jobs
Fri 17 Jan 2014 21:26:36 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:26:36 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:26:36 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:26:36 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:26:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:26:36 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:26:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:26:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:26:37 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:26:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:26:37 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:26:37 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:26:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:26:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:26:38 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:26:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:26:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:26:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:26:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:26:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:26:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:26:40 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:26:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43906941
Fri 17 Jan 2014 21:26:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:26:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43906941
Fri 17 Jan 2014 21:26:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:26:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:26:44 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:26:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:26:45 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:26:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 21:26:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 21:26:45 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:26:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148761 bits 18595 bytes 
Fri 17 Jan 2014 21:26:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:26:50 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:26:51 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:26:51 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:26:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:26:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:26:53 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:26:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:26:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:26:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:26:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:26:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:26:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:26:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:26:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:26:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:26:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:26:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:26:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:26:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:26:56 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:26:56 - job_xml_thread(): Done retrieving: data size 43899132
Fri 17 Jan 2014 21:26:56 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:26:56 - XML: Start document: iteration 6
Fri 17 Jan 2014 21:26:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43899132
Fri 17 Jan 2014 21:26:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:26:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43899132
Fri 17 Jan 2014 21:26:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:27:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:27:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:27:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:27:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:27:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:27:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:27:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:27:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:27:09 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:27:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:27:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:27:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:27:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:27:14 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 21:27:14 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:27:14 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:27:14 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 21:27:14 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 21:27:14 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:27:14 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 21:27:14 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:27:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 21:27:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:27:18 - XML: Processed 655602 elements - found 698 jobs
Fri 17 Jan 2014 21:27:18 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 21:27:18 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 21:27:20 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 21:27:20 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:27:20 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:27:20 - size of cluster 'LISA Cluster': 624 hosts 79481 metrics 984174 values 15534934 bits 1941866 bytes 
Fri 17 Jan 2014 21:27:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:27:21 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:27:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:27:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:27:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:27:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:27:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:27:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:27:24 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:27:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853328
Fri 17 Jan 2014 21:27:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:27:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:27:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:27:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853328
Fri 17 Jan 2014 21:27:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:27:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:27:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:27:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:27:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:27:35 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:27:35 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:27:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:27:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:27:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:27:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:27:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:27:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:27:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:27:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:27:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:27:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:27:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:27:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:27:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:27:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:27:42 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:27:42 - job_xml_thread(): Done retrieving: data size 43885551
Fri 17 Jan 2014 21:27:42 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:27:42 - XML: Start document: iteration 7
Fri 17 Jan 2014 21:27:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43885551
Fri 17 Jan 2014 21:27:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:27:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43885551
Fri 17 Jan 2014 21:27:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:27:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:27:45 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:27:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:27:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 21:27:46 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:27:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 21:27:46 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:27:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9048 values 142910 bits 17863 bytes 
Fri 17 Jan 2014 21:27:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:27:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:27:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:27:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:28:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:28:00 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:28:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:28:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:28:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:28:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:28:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:28:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:28:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:28:02 - XML: Processed 655602 elements - found 698 jobs
Fri 17 Jan 2014 21:28:02 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:28:02 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:28:02 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:28:02 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:28:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:28:06 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:28:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:28:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:28:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:28:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:28:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:28:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:28:09 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:28:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43879329
Fri 17 Jan 2014 21:28:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:28:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43879329
Fri 17 Jan 2014 21:28:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:28:14 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:28:14 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 21:28:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:28:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:28:17 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:28:17 - job_xml_thread(): Done retrieving: data size 43879329
Fri 17 Jan 2014 21:28:17 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:28:17 - XML: Start document: iteration 8
Fri 17 Jan 2014 21:28:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:28:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:28:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:28:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:28:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:28:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:28:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:28:27 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:28:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:28:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:28:27 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:28:32 - XML: Processed 655602 elements - found 698 jobs
Fri 17 Jan 2014 21:28:32 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:28:32 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:28:32 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:28:32 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:28:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:28:34 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:28:34 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:28:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 21:28:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:28:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:28:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:28:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:28:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:28:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:28:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:28:37 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:28:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43871415
Fri 17 Jan 2014 21:28:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:28:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43871415
Fri 17 Jan 2014 21:28:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:28:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:28:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:28:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:28:46 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:28:47 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:28:47 - job_xml_thread(): Done retrieving: data size 43871415
Fri 17 Jan 2014 21:28:47 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:28:47 - XML: Start document: iteration 9
Fri 17 Jan 2014 21:28:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:28:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:28:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:28:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:28:48 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:28:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 21:28:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:28:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 21:28:48 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:28:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5791 values 91411 bits 11426 bytes 
Fri 17 Jan 2014 21:28:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:28:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:28:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:28:49 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:28:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:28:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:28:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:28:57 - XML: Processed 655622 elements - found 708 jobs
Fri 17 Jan 2014 21:28:57 - job_xml_thread(): Found 10 updated jobs.
Fri 17 Jan 2014 21:28:57 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 21:28:57 - job_xml_thread(): Done storing. succesfully stored: 10 jobs
Fri 17 Jan 2014 21:28:57 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:28:57 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:29:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:29:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:29:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:29:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:29:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:29:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:29:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:29:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:29:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:29:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:29:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:29:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43869067
Fri 17 Jan 2014 21:29:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:29:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43869067
Fri 17 Jan 2014 21:29:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:29:12 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:29:12 - job_xml_thread(): Done retrieving: data size 43869067
Fri 17 Jan 2014 21:29:12 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:29:13 - XML: Start document: iteration 10
Fri 17 Jan 2014 21:29:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:29:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:29:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:29:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:29:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:29:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:29:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:29:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:29:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:29:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:29:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:29:22 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:29:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 21:29:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:29:25 - XML: Processed 655622 elements - found 708 jobs
Fri 17 Jan 2014 21:29:25 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:29:25 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:29:25 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:29:25 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:29:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:29:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:29:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:29:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:29:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:29:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:29:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:29:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:29:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:29:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43824303
Fri 17 Jan 2014 21:29:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:29:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43824303
Fri 17 Jan 2014 21:29:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:29:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:29:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:29:40 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:29:40 - job_xml_thread(): Done retrieving: data size 43824303
Fri 17 Jan 2014 21:29:40 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:29:40 - XML: Start document: iteration 11
Fri 17 Jan 2014 21:29:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:29:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:29:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:29:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:29:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:29:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:29:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:29:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:29:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:29:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:29:48 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:29:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:29:48 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:29:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:29:49 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:29:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 21:29:49 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:29:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 21:29:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5997 values 94701 bits 11837 bytes 
Fri 17 Jan 2014 21:29:51 - XML: Processed 654866 elements - found 708 jobs
Fri 17 Jan 2014 21:29:51 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:29:51 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:29:51 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:29:51 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:29:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:29:55 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:29:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:29:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:29:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:29:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:29:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:29:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:29:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:29:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43235900
Fri 17 Jan 2014 21:29:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:30:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43235900
Fri 17 Jan 2014 21:30:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:30:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:30:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:30:06 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:30:06 - job_xml_thread(): Done retrieving: data size 43235900
Fri 17 Jan 2014 21:30:06 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:30:06 - XML: Start document: iteration 12
Fri 17 Jan 2014 21:30:08 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:30:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 21:30:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:30:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:30:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:30:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:30:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:30:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:30:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:30:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:30:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:30:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:30:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:30:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:30:20 - XML: Processed 647656 elements - found 708 jobs
Fri 17 Jan 2014 21:30:20 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:30:20 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:30:20 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:30:20 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:30:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:30:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:30:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:30:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:30:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:30:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:30:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:30:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:30:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:30:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43265183
Fri 17 Jan 2014 21:30:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:30:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43265183
Fri 17 Jan 2014 21:30:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:30:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:30:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:30:35 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:30:35 - job_xml_thread(): Done retrieving: data size 43265183
Fri 17 Jan 2014 21:30:35 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:30:35 - XML: Start document: iteration 13
Fri 17 Jan 2014 21:30:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:30:38 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:30:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:30:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:30:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:30:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:30:39 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:30:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:30:39 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:30:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:30:39 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:30:48 - XML: Processed 648170 elements - found 708 jobs
Fri 17 Jan 2014 21:30:48 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:30:48 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:30:48 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:30:48 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:30:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:30:49 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:30:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:30:49 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:30:49 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:30:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 21:30:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:30:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 21:30:49 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:30:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6193 values 97783 bits 12222 bytes 
Fri 17 Jan 2014 21:30:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:30:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:30:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:30:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:30:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:30:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:30:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:30:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43841581
Fri 17 Jan 2014 21:30:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:30:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43841581
Fri 17 Jan 2014 21:30:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:30:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:30:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:31:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:31:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:31:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:31:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:31:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:31:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:31:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:31:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:31:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43841581
Fri 17 Jan 2014 21:31:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:31:03 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:31:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:31:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:31:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:31:08 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:31:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 21:31:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:31:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:31:14 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:31:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:31:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:31:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:31:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:31:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:31:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:31:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:31:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:31:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:31:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:31:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:31:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:31:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:31:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:31:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:31:18 - job_xml_thread(): Done retrieving: data size 43872189
Fri 17 Jan 2014 21:31:18 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:31:18 - XML: Start document: iteration 14
Fri 17 Jan 2014 21:31:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43872189
Fri 17 Jan 2014 21:31:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:31:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43872189
Fri 17 Jan 2014 21:31:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:31:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:31:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:31:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:31:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:31:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:31:38 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:31:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:31:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:31:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:31:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:31:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:31:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:31:40 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:31:42 - XML: Processed 655616 elements - found 708 jobs
Fri 17 Jan 2014 21:31:42 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:31:42 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:31:42 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:31:42 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:31:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:31:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:31:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:31:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:31:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:31:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:31:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:31:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:31:45 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 21:31:45 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 21:31:45 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:31:46 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:31:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43900042
Fri 17 Jan 2014 21:31:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:31:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43900042
Fri 17 Jan 2014 21:31:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:31:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:31:49 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:31:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:31:52 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:31:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 21:31:52 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:31:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 21:31:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9264 values 146503 bits 18312 bytes 
Fri 17 Jan 2014 21:31:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:31:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:31:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:31:56 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:31:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:31:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:31:57 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:31:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:31:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:31:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:31:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:31:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:31:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:31:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:32:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:32:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:32:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:32:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:32:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:32:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:32:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:32:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:32:03 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:32:03 - job_xml_thread(): Done retrieving: data size 43904681
Fri 17 Jan 2014 21:32:03 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:32:03 - XML: Start document: iteration 15
Fri 17 Jan 2014 21:32:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43904681
Fri 17 Jan 2014 21:32:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43904681
Fri 17 Jan 2014 21:32:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:32:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:32:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:32:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:32:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:32:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:32:18 - XML: Processed 655622 elements - found 708 jobs
Fri 17 Jan 2014 21:32:18 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:32:19 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:32:19 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:32:19 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:32:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:32:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:32:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:32:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:32:26 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:32:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:32:26 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:32:26 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:32:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:32:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:32:26 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:32:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:32:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:32:27 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:32:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 21:32:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:32:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:32:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:32:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:32:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:32:28 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:32:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43913785
Fri 17 Jan 2014 21:32:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:32:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43913785
Fri 17 Jan 2014 21:32:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:32:34 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:32:34 - job_xml_thread(): Done retrieving: data size 43913785
Fri 17 Jan 2014 21:32:34 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:32:34 - XML: Start document: iteration 16
Fri 17 Jan 2014 21:32:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:32:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:32:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:32:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:32:42 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:32:42 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:32:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:32:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:32:42 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:32:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:32:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:32:47 - XML: Processed 655622 elements - found 708 jobs
Fri 17 Jan 2014 21:32:47 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:32:47 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:32:47 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:32:47 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:32:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:32:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:32:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:32:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:32:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:32:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:32:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:32:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:32:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:32:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43868274
Fri 17 Jan 2014 21:32:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:32:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43868274
Fri 17 Jan 2014 21:32:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:32:52 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:32:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:32:54 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:32:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 21:32:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:32:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 21:32:54 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:32:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8811 values 139518 bits 17439 bytes 
Fri 17 Jan 2014 21:32:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:32:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:33:02 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:33:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:33:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:33:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:33:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:33:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:33:06 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:33:06 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:33:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:33:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:33:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:33:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:33:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:33:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:33:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:33:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:33:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:33:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:33:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:33:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:33:10 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:33:10 - job_xml_thread(): Done retrieving: data size 43894107
Fri 17 Jan 2014 21:33:10 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:33:10 - XML: Start document: iteration 17
Fri 17 Jan 2014 21:33:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43894107
Fri 17 Jan 2014 21:33:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:33:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43894107
Fri 17 Jan 2014 21:33:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:33:11 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:33:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 21:33:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:33:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:33:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:33:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:33:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:33:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:33:27 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:33:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:33:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:33:30 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:33:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:33:30 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:33:30 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:33:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:33:30 - XML: Processed 655622 elements - found 708 jobs
Fri 17 Jan 2014 21:33:30 - job 7348558 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 21:33:30 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 21:33:30 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 21:33:31 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 21:33:31 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:33:31 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:33:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:33:33 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:33:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:33:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:33:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:33:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:33:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:33:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:33:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:33:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43890436
Fri 17 Jan 2014 21:33:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:33:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43890436
Fri 17 Jan 2014 21:33:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:33:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:33:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:33:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:33:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:33:46 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:33:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:33:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:33:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:33:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:33:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:33:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:33:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:33:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:33:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:33:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:33:49 - job_xml_thread(): Done retrieving: data size 43902068
Fri 17 Jan 2014 21:33:49 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:33:49 - XML: Start document: iteration 18
Fri 17 Jan 2014 21:33:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:33:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:33:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43902068
Fri 17 Jan 2014 21:33:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:33:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:33:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:33:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43902068
Fri 17 Jan 2014 21:33:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:33:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:33:54 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:33:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:33:55 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:33:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 21:33:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 21:33:55 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:33:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148956 bits 18619 bytes 
Fri 17 Jan 2014 21:34:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:34:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:34:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:34:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:34:08 - XML: Processed 655616 elements - found 708 jobs
Fri 17 Jan 2014 21:34:08 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:34:08 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:34:08 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:34:08 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:34:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:34:12 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:34:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:34:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:34:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:34:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:34:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:34:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:34:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:34:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:34:12 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:34:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:34:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:34:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:34:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:34:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:34:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:34:14 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 21:34:14 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:34:14 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:34:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43910359
Fri 17 Jan 2014 21:34:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:34:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43910359
Fri 17 Jan 2014 21:34:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:34:15 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:34:15 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:34:15 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 21:34:15 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 21:34:15 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 21:34:22 - size of cluster 'LISA Cluster': 624 hosts 79467 metrics 751330 values 11880612 bits 1485076 bytes 
Fri 17 Jan 2014 21:34:22 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:34:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 21:34:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:34:23 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:34:23 - job_xml_thread(): Done retrieving: data size 43910359
Fri 17 Jan 2014 21:34:23 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:34:23 - XML: Start document: iteration 19
Fri 17 Jan 2014 21:34:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:34:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:34:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:34:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:34:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:34:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:34:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:34:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:34:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:34:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:34:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:34:36 - XML: Processed 655622 elements - found 708 jobs
Fri 17 Jan 2014 21:34:36 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:34:36 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:34:36 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:34:36 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:34:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:34:38 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:34:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:34:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:34:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:34:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:34:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:34:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:34:41 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:34:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43874899
Fri 17 Jan 2014 21:34:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:34:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43874899
Fri 17 Jan 2014 21:34:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:34:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:34:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:34:51 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:34:51 - job_xml_thread(): Done retrieving: data size 43874899
Fri 17 Jan 2014 21:34:51 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:34:51 - XML: Start document: iteration 20
Fri 17 Jan 2014 21:34:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:34:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:34:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:34:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:34:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:34:55 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:34:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:34:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:34:56 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:34:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:34:56 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:34:56 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:34:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:34:56 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:34:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:34:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 21:34:56 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:34:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 21:34:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6254 values 98791 bits 12348 bytes 
Fri 17 Jan 2014 21:34:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:34:59 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:34:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:34:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:35:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:35:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:35:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:35:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:35:04 - XML: Processed 655620 elements - found 707 jobs
Fri 17 Jan 2014 21:35:04 - job 7341324 appears to have finished
Fri 17 Jan 2014 21:35:04 - job 7348559 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 21:35:04 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 21:35:04 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 21:35:04 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 21:35:04 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:35:04 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:35:07 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:35:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 21:35:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:35:08 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:35:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867351
Fri 17 Jan 2014 21:35:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:35:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43867351
Fri 17 Jan 2014 21:35:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:35:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:35:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:35:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:35:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:35:16 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:35:16 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 21:35:19 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:35:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:35:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:35:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:35:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:35:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:35:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:35:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:35:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:35:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:35:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:35:24 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:35:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:35:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:35:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:35:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:35:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:35:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:35:27 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:35:27 - job_xml_thread(): Done retrieving: data size 43827392
Fri 17 Jan 2014 21:35:27 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:35:27 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 21:35:27 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 21:35:27 - Housekeeping: done.
Fri 17 Jan 2014 21:35:27 - XML: Start document: iteration 0
Fri 17 Jan 2014 21:35:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43827392
Fri 17 Jan 2014 21:35:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43827392
Fri 17 Jan 2014 21:35:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:35:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:35:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:35:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:35:39 - XML: Processed 654872 elements - found 707 jobs
Fri 17 Jan 2014 21:35:39 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:35:39 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:35:39 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:35:39 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:35:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:35:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:35:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:35:48 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:35:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:35:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:35:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:35:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:35:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:35:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:35:50 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:35:50 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:35:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:35:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:35:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:35:51 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:35:51 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:35:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:35:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:35:53 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:35:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43248243
Fri 17 Jan 2014 21:35:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:35:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43248243
Fri 17 Jan 2014 21:35:54 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:35:54 - job_xml_thread(): Done retrieving: data size 43248243
Fri 17 Jan 2014 21:35:54 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:35:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:35:54 - XML: Start document: iteration 1
Fri 17 Jan 2014 21:35:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:35:57 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:35:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:35:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 21:35:57 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:35:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 21:35:57 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:35:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99222 bits 12402 bytes 
Fri 17 Jan 2014 21:36:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:36:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:36:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:36:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:36:10 - XML: Processed 647520 elements - found 707 jobs
Fri 17 Jan 2014 21:36:10 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:36:10 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:36:10 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:36:10 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:36:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:36:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:36:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:36:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:36:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:36:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:36:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:36:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:36:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:36:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:36:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:36:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:36:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:36:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:36:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:36:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:36:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:36:21 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:36:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43272166
Fri 17 Jan 2014 21:36:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:36:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43272166
Fri 17 Jan 2014 21:36:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:36:26 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:36:26 - job_xml_thread(): Done retrieving: data size 43272166
Fri 17 Jan 2014 21:36:26 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:36:26 - XML: Start document: iteration 2
Fri 17 Jan 2014 21:36:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:36:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:36:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:36:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:36:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:36:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:36:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:36:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:36:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:36:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:36:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:36:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:36:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:36:42 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:36:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 21:36:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:36:43 - XML: Processed 648032 elements - found 707 jobs
Fri 17 Jan 2014 21:36:43 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:36:43 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:36:43 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:36:43 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:36:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:36:45 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:36:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:36:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:36:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:36:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:36:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:36:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:36:47 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:36:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43790909
Fri 17 Jan 2014 21:36:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:36:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43790909
Fri 17 Jan 2014 21:36:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:36:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:36:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:36:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:36:58 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:36:58 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:36:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:36:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:36:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:36:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:36:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:36:59 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:36:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:36:59 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:36:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:36:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:36:59 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:36:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 21:36:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 21:36:59 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:36:59 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5989 values 94606 bits 11825 bytes 
Fri 17 Jan 2014 21:37:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:37:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:37:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:37:03 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:37:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:37:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:37:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:37:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:37:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:37:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:37:06 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:37:06 - job_xml_thread(): Done retrieving: data size 43880099
Fri 17 Jan 2014 21:37:06 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:37:06 - XML: Start document: iteration 3
Fri 17 Jan 2014 21:37:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43880099
Fri 17 Jan 2014 21:37:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:37:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43880099
Fri 17 Jan 2014 21:37:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:37:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:37:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:37:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:37:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:37:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:37:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:37:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:37:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:37:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:37:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:37:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:37:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:37:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:37:25 - XML: Processed 655622 elements - found 708 jobs
Fri 17 Jan 2014 21:37:25 - job 7348557 appears to have finished
Fri 17 Jan 2014 21:37:26 - job 7348560 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 21:37:26 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 21:37:26 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 21:37:26 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 21:37:26 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:37:26 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:37:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:37:30 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:37:30 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:37:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 21:37:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:37:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:37:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:37:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:37:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:37:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:37:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:37:34 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:37:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873080
Fri 17 Jan 2014 21:37:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:37:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873080
Fri 17 Jan 2014 21:37:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:37:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:37:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:37:41 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:37:41 - job_xml_thread(): Done retrieving: data size 43873080
Fri 17 Jan 2014 21:37:42 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:37:42 - XML: Start document: iteration 4
Fri 17 Jan 2014 21:37:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:37:42 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:37:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:37:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:37:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:37:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:37:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:37:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:37:44 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:37:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:37:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:37:53 - XML: Processed 655622 elements - found 708 jobs
Fri 17 Jan 2014 21:37:53 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:37:53 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:37:53 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:37:53 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:37:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:37:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:37:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:37:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:37:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:37:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:37:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:37:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:37:57 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:37:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875933
Fri 17 Jan 2014 21:37:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:37:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875933
Fri 17 Jan 2014 21:37:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:37:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:37:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:37:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:37:59 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:38:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:38:01 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:38:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 21:38:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 21:38:01 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:38:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8823 values 139244 bits 17405 bytes 
Fri 17 Jan 2014 21:38:09 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:38:09 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:38:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:38:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:38:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:38:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:38:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:38:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:38:11 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:38:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:38:11 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:38:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:38:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:38:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:38:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:38:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:38:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:38:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:38:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:38:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:38:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:38:18 - job_xml_thread(): Done retrieving: data size 43886377
Fri 17 Jan 2014 21:38:18 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:38:18 - XML: Start document: iteration 5
Fri 17 Jan 2014 21:38:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43886377
Fri 17 Jan 2014 21:38:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:38:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43886377
Fri 17 Jan 2014 21:38:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:38:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:38:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:38:28 - XML: Processed 655622 elements - found 708 jobs
Fri 17 Jan 2014 21:38:28 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:38:28 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:38:28 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:38:28 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:38:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:38:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:38:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:38:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:38:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:38:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:38:37 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:38:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:38:37 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:38:37 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:38:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:38:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:38:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:38:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:38:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:38:41 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:38:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 21:38:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:38:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:38:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:38:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:38:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:38:42 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 21:38:42 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 21:38:42 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:38:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:38:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43905655
Fri 17 Jan 2014 21:38:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:38:43 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:38:43 - job_xml_thread(): Done retrieving: data size 43905655
Fri 17 Jan 2014 21:38:43 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:38:43 - XML: Start document: iteration 6
Fri 17 Jan 2014 21:38:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43905655
Fri 17 Jan 2014 21:38:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:38:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:38:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:38:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:38:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:39:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:39:01 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:39:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:39:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:39:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:39:02 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:39:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:39:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:39:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:39:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:39:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:39:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:39:02 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:39:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 21:39:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 21:39:02 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:39:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5803 values 91590 bits 11448 bytes 
Fri 17 Jan 2014 21:39:04 - XML: Processed 655620 elements - found 707 jobs
Fri 17 Jan 2014 21:39:04 - job 7346230 appears to have finished
Fri 17 Jan 2014 21:39:04 - job 7348562 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 21:39:04 - job 7348563 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 21:39:04 - job 7348561 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 21:39:04 - job 7348564 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 21:39:04 - job_xml_thread(): Found 5 updated jobs.
Fri 17 Jan 2014 21:39:04 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 21:39:05 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Fri 17 Jan 2014 21:39:05 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:39:05 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:39:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:39:08 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:39:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:39:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:39:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:39:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:39:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:39:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:39:10 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:39:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43888913
Fri 17 Jan 2014 21:39:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:39:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43888913
Fri 17 Jan 2014 21:39:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:39:12 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:39:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 21:39:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:39:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:39:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:39:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:39:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:39:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:39:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:39:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:39:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:39:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:39:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43888913
Fri 17 Jan 2014 21:39:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:39:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:39:21 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:39:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:39:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:39:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:39:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:39:27 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:39:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:39:30 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:39:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:39:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:39:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:39:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:39:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:39:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:39:31 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:39:31 - job_xml_thread(): Done retrieving: data size 43887775
Fri 17 Jan 2014 21:39:31 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:39:31 - XML: Start document: iteration 7
Fri 17 Jan 2014 21:39:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43887775
Fri 17 Jan 2014 21:39:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:39:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:39:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:39:39 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:39:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:39:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43887775
Fri 17 Jan 2014 21:39:39 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:39:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:39:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:39:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:39:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:39:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:39:48 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:39:49 - XML: Processed 655620 elements - found 707 jobs
Fri 17 Jan 2014 21:39:49 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:39:49 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:39:49 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:39:49 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:39:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:39:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:39:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:39:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:39:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:39:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:39:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:39:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:39:52 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:39:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:39:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:39:54 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:39:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:39:54 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:39:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:39:54 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:39:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43909255
Fri 17 Jan 2014 21:39:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:39:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43909255
Fri 17 Jan 2014 21:39:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:40:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:40:03 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:40:04 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:40:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:40:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:40:05 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:40:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 21:40:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 21:40:05 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:40:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148733 bits 18591 bytes 
Fri 17 Jan 2014 21:40:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:40:07 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:40:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:40:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:40:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:40:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:40:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:40:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:40:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:40:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:40:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:40:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:40:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:40:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:40:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:40:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:40:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:40:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:40:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:40:12 - job_xml_thread(): Done retrieving: data size 43886060
Fri 17 Jan 2014 21:40:12 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:40:12 - XML: Start document: iteration 8
Fri 17 Jan 2014 21:40:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43886060
Fri 17 Jan 2014 21:40:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:40:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43886060
Fri 17 Jan 2014 21:40:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:40:15 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:40:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 21:40:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:40:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:40:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:40:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:40:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:40:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:40:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:40:26 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:40:26 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:40:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:40:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:40:26 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:40:32 - XML: Processed 655620 elements - found 707 jobs
Fri 17 Jan 2014 21:40:32 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:40:32 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:40:32 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:40:32 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:40:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:40:34 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:40:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:40:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:40:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:40:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:40:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:40:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:40:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:40:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43863686
Fri 17 Jan 2014 21:40:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:40:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43863686
Fri 17 Jan 2014 21:40:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:40:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:40:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:40:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:40:45 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:40:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:40:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:40:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:40:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:40:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:40:47 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:40:47 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:40:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:40:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:40:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:40:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:40:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:40:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:40:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:40:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:40:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:40:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:40:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:40:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:40:52 - job_xml_thread(): Done retrieving: data size 43889838
Fri 17 Jan 2014 21:40:52 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:40:52 - XML: Start document: iteration 9
Fri 17 Jan 2014 21:40:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43889838
Fri 17 Jan 2014 21:40:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:40:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43889838
Fri 17 Jan 2014 21:40:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:41:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:41:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:41:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:41:05 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:41:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:41:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:41:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:41:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 21:41:06 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:41:06 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:41:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 21:41:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148731 bits 18591 bytes 
Fri 17 Jan 2014 21:41:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:41:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:41:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:41:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:41:11 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:41:11 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:41:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:41:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:41:11 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:41:12 - XML: Processed 655620 elements - found 707 jobs
Fri 17 Jan 2014 21:41:12 - job 7348562 field 'start_timestamp' changed since saved from: 1389991142 to: 1389991064
Fri 17 Jan 2014 21:41:12 - job 7348563 field 'start_timestamp' changed since saved from: 1389991144 to: 1389991064
Fri 17 Jan 2014 21:41:12 - job 7348561 field 'start_timestamp' changed since saved from: 1389991140 to: 1389991064
Fri 17 Jan 2014 21:41:12 - job 7348459 appears to have finished
Fri 17 Jan 2014 21:41:12 - job_xml_thread(): Found 5 updated jobs.
Fri 17 Jan 2014 21:41:12 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 21:41:14 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Fri 17 Jan 2014 21:41:14 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:41:14 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:41:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:41:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:41:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:41:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:41:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:41:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:41:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:41:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:41:16 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 21:41:16 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:41:17 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:41:17 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 21:41:17 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:41:17 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 21:41:17 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 21:41:18 - size of cluster 'LISA Cluster': 624 hosts 79472 metrics 720780 values 11376694 bits 1422086 bytes 
Fri 17 Jan 2014 21:41:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:41:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43816564
Fri 17 Jan 2014 21:41:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43816564
Fri 17 Jan 2014 21:41:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:41:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:41:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:41:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:41:29 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:41:29 - job_xml_thread(): Done retrieving: data size 43816564
Fri 17 Jan 2014 21:41:29 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:41:29 - XML: Start document: iteration 10
Fri 17 Jan 2014 21:41:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:41:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:41:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:41:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:41:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:41:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:41:31 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:41:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:41:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:41:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:41:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:41:38 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:41:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 21:41:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:41:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:41:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:41:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:41:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:41:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:41:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:41:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:41:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:41:43 - XML: Processed 654872 elements - found 707 jobs
Fri 17 Jan 2014 21:41:43 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:41:43 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:41:43 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:41:43 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:41:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:41:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:41:46 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:41:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43333294
Fri 17 Jan 2014 21:41:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:41:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43333294
Fri 17 Jan 2014 21:41:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:41:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:41:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:41:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:41:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:41:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:41:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:41:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:41:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:41:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:41:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:41:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:41:58 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:42:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:42:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:42:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:42:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:42:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:42:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:42:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:42:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:42:03 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:42:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43216259
Fri 17 Jan 2014 21:42:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:42:04 - job_xml_thread(): Done retrieving: data size 43216259
Fri 17 Jan 2014 21:42:04 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:42:04 - XML: Start document: iteration 11
Fri 17 Jan 2014 21:42:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43216259
Fri 17 Jan 2014 21:42:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:42:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:42:07 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:42:07 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:42:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 21:42:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:42:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 21:42:07 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:42:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8885 values 140217 bits 17527 bytes 
Fri 17 Jan 2014 21:42:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:42:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:42:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:42:17 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:42:17 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 21:42:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:42:24 - XML: Processed 647420 elements - found 707 jobs
Fri 17 Jan 2014 21:42:24 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:42:24 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:42:24 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:42:24 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:42:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:42:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:42:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:42:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:42:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:42:26 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:42:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:42:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:42:26 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:42:26 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:42:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:42:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:42:26 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:42:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:42:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:42:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:42:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:42:30 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:42:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43315321
Fri 17 Jan 2014 21:42:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:42:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43315321
Fri 17 Jan 2014 21:42:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:42:34 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:42:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 21:42:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:42:39 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:42:39 - job_xml_thread(): Done retrieving: data size 43315321
Fri 17 Jan 2014 21:42:39 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:42:39 - XML: Start document: iteration 12
Fri 17 Jan 2014 21:42:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:42:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:42:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:42:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:42:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:42:48 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:42:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:42:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:42:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:42:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:42:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:42:49 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:42:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:42:54 - XML: Processed 648192 elements - found 707 jobs
Fri 17 Jan 2014 21:42:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:42:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:42:54 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:42:54 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:42:54 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:42:54 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:42:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:42:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:42:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:42:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:42:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:42:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:42:57 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:42:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856503
Fri 17 Jan 2014 21:42:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:42:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43856503
Fri 17 Jan 2014 21:42:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:43:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:43:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:43:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:43:07 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:43:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:43:08 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:43:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 21:43:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 21:43:08 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:43:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6271 values 99070 bits 12383 bytes 
Fri 17 Jan 2014 21:43:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:43:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:43:10 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:43:10 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:43:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:43:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:43:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:43:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:43:12 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:43:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:43:12 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:43:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:43:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:43:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:43:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:43:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:43:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:43:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:43:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:43:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:43:17 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:43:17 - job_xml_thread(): Done retrieving: data size 43885786
Fri 17 Jan 2014 21:43:17 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:43:17 - XML: Start document: iteration 13
Fri 17 Jan 2014 21:43:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43885786
Fri 17 Jan 2014 21:43:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43885786
Fri 17 Jan 2014 21:43:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:43:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:43:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:43:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:43:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:43:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:43:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:43:40 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:43:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:43:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:43:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:43:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:43:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:43:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:43:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:43:41 - XML: Processed 655622 elements - found 708 jobs
Fri 17 Jan 2014 21:43:41 - job 7344524 appears to have finished
Fri 17 Jan 2014 21:43:41 - job 7335203 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 21:43:41 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 21:43:41 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 21:43:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:43:42 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:43:42 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 21:43:42 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:43:42 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:43:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:43:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:43:42 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:43:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 21:43:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:43:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:43:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:43:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:43:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:43:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:43:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43902032
Fri 17 Jan 2014 21:43:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:43:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43902032
Fri 17 Jan 2014 21:43:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:43:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:43:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:43:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:43:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:43:58 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:43:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:43:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:43:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:43:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:43:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:43:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:43:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:43:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:43:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:43:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:43:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:43:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:43:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:43:59 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:43:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:43:59 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:43:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:44:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:44:02 - job_xml_thread(): Done retrieving: data size 43899599
Fri 17 Jan 2014 21:44:02 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:44:02 - XML: Start document: iteration 14
Fri 17 Jan 2014 21:44:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43899599
Fri 17 Jan 2014 21:44:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:44:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43899599
Fri 17 Jan 2014 21:44:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:44:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:44:08 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:44:08 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:44:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 21:44:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:44:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 21:44:08 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:44:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9205 values 145366 bits 18170 bytes 
Fri 17 Jan 2014 21:44:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:44:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:44:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:44:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:44:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:44:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:44:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:44:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:44:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:44:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:44:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:44:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:44:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:44:22 - XML: Processed 655622 elements - found 708 jobs
Fri 17 Jan 2014 21:44:22 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:44:22 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:44:22 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:44:22 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:44:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:44:26 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:44:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:44:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:44:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:44:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:44:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:44:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:44:30 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:44:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43888149
Fri 17 Jan 2014 21:44:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:44:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43888149
Fri 17 Jan 2014 21:44:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:44:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:44:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:44:37 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:44:37 - job_xml_thread(): Done retrieving: data size 43888149
Fri 17 Jan 2014 21:44:37 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:44:37 - XML: Start document: iteration 15
Fri 17 Jan 2014 21:44:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:44:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:44:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:44:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:44:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:44:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:44:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:44:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:44:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:44:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:44:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:44:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:44:52 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:44:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:44:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:44:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:44:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:44:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:44:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:44:54 - XML: Processed 655622 elements - found 708 jobs
Fri 17 Jan 2014 21:44:54 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:44:54 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:44:54 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:44:54 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:44:54 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:44:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 21:44:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:44:55 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 21:44:55 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 21:44:55 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:44:56 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:44:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43878926
Fri 17 Jan 2014 21:44:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:44:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43878926
Fri 17 Jan 2014 21:44:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:45:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:45:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:45:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:45:07 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:45:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:45:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:45:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:45:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:45:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:45:08 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:45:08 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:45:08 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:45:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:45:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:45:08 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:45:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:45:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 21:45:08 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:45:08 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:45:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5630 values 88790 bits 11098 bytes 
Fri 17 Jan 2014 21:45:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 21:45:09 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:45:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:45:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:45:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:45:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:45:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:45:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:45:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:45:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:45:14 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:45:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43896571
Fri 17 Jan 2014 21:45:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:45:14 - job_xml_thread(): Done retrieving: data size 43896571
Fri 17 Jan 2014 21:45:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43896571
Fri 17 Jan 2014 21:45:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:45:14 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:45:14 - XML: Start document: iteration 16
Fri 17 Jan 2014 21:45:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:45:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:45:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:45:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:45:28 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:45:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 21:45:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:45:29 - XML: Processed 655622 elements - found 708 jobs
Fri 17 Jan 2014 21:45:29 - job 7330451 appears to have finished
Fri 17 Jan 2014 21:45:29 - job 7348648 field 'start_timestamp' changed since saved from: 1389991359 to: 1389991299
Fri 17 Jan 2014 21:45:29 - job 7348407 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 21:45:29 - job 7348565 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 21:45:29 - job_xml_thread(): Found 5 updated jobs.
Fri 17 Jan 2014 21:45:29 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 21:45:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:45:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:45:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:45:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:45:30 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:45:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:45:30 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:45:30 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:45:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:45:31 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Fri 17 Jan 2014 21:45:31 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:45:31 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:45:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:45:35 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:45:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:45:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:45:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:45:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:45:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:45:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:45:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:45:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43885559
Fri 17 Jan 2014 21:45:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:45:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43885559
Fri 17 Jan 2014 21:45:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:45:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:45:45 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:45:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:45:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:45:46 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:45:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:45:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:45:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:45:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:45:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:45:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:45:49 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:45:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:45:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:45:51 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:45:51 - job_xml_thread(): Done retrieving: data size 43889789
Fri 17 Jan 2014 21:45:51 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:45:51 - XML: Start document: iteration 17
Fri 17 Jan 2014 21:45:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:45:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:45:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:45:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43889789
Fri 17 Jan 2014 21:45:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43889789
Fri 17 Jan 2014 21:45:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:45:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:45:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:46:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:46:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:46:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:46:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:46:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:46:09 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:46:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:46:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:46:10 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:46:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:46:11 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:46:11 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:46:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:46:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:46:11 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:46:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:46:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 21:46:11 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:46:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 21:46:11 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:46:11 - XML: Processed 655619 elements - found 708 jobs
Fri 17 Jan 2014 21:46:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9231 values 145812 bits 18226 bytes 
Fri 17 Jan 2014 21:46:11 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:46:11 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:46:11 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:46:11 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:46:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:46:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:46:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:46:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:46:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:46:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:46:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:46:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:46:16 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:46:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43911483
Fri 17 Jan 2014 21:46:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:46:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43911483
Fri 17 Jan 2014 21:46:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:46:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:46:25 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:46:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:46:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:46:26 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:46:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:46:26 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:46:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:46:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43911483
Fri 17 Jan 2014 21:46:26 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:46:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:46:26 - job_xml_thread(): Done retrieving: data size 43911483
Fri 17 Jan 2014 21:46:26 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:46:26 - XML: Start document: iteration 18
Fri 17 Jan 2014 21:46:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:46:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:46:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:46:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:46:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:46:42 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:46:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:46:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:46:42 - XML: Processed 655622 elements - found 708 jobs
Fri 17 Jan 2014 21:46:42 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:46:42 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:46:42 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:46:42 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:46:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:46:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:46:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:46:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:46:43 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:46:45 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:46:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 21:46:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:46:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:46:46 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:46:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:46:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:46:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:46:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:46:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:46:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:46:48 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:46:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43903104
Fri 17 Jan 2014 21:46:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:46:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43903104
Fri 17 Jan 2014 21:46:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:46:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:46:58 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:46:58 - job_xml_thread(): Done retrieving: data size 43903104
Fri 17 Jan 2014 21:46:58 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:46:58 - XML: Start document: iteration 19
Fri 17 Jan 2014 21:46:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:46:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:46:58 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:46:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:46:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:46:59 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:46:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:46:59 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:46:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:46:59 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:47:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:47:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:47:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:47:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:47:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:47:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:47:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:47:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:47:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:47:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:47:08 - XML: Processed 655618 elements - found 706 jobs
Fri 17 Jan 2014 21:47:08 - job 7348534 appears to have finished
Fri 17 Jan 2014 21:47:08 - job 7335118 appears to have finished
Fri 17 Jan 2014 21:47:08 - job 7348566 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 21:47:08 - job 7348567 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 21:47:08 - job 7348565 field 'start_timestamp' changed since saved from: 1389991463 to: 1389991398
Fri 17 Jan 2014 21:47:08 - job_xml_thread(): Found 5 updated jobs.
Fri 17 Jan 2014 21:47:08 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 21:47:08 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Fri 17 Jan 2014 21:47:08 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:47:08 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:47:09 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:47:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875996
Fri 17 Jan 2014 21:47:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:47:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875996
Fri 17 Jan 2014 21:47:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:47:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:47:11 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:47:11 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:47:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 21:47:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:47:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 21:47:11 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:47:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8928 values 141246 bits 17655 bytes 
Fri 17 Jan 2014 21:47:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:47:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:47:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:47:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:47:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:47:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:47:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:47:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:47:23 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:47:23 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:47:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:47:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:47:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:47:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:47:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:47:25 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:47:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:47:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:47:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:47:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:47:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:47:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:47:27 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:47:27 - job_xml_thread(): Done retrieving: data size 43833123
Fri 17 Jan 2014 21:47:27 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:47:27 - XML: Start document: iteration 20
Fri 17 Jan 2014 21:47:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43833123
Fri 17 Jan 2014 21:47:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:47:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43833123
Fri 17 Jan 2014 21:47:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:47:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:47:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:47:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:47:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:47:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:47:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:47:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:47:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:47:45 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:47:45 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:47:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:47:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:47:45 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:47:48 - XML: Processed 654858 elements - found 706 jobs
Fri 17 Jan 2014 21:47:48 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:47:48 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:47:48 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:47:48 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:47:48 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:47:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 21:47:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:47:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:47:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:47:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:47:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:47:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:47:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:47:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:47:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:47:51 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:47:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43252668
Fri 17 Jan 2014 21:47:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:47:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43252668
Fri 17 Jan 2014 21:47:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:48:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:48:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:48:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:48:00 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:48:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:48:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:48:03 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:48:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:48:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:48:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:48:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:48:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:48:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:48:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:48:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:48:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:48:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:48:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:48:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:48:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:48:06 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:48:06 - job_xml_thread(): Done retrieving: data size 43236599
Fri 17 Jan 2014 21:48:06 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:48:06 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 21:48:06 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 21:48:06 - Housekeeping: done.
Fri 17 Jan 2014 21:48:06 - XML: Start document: iteration 0
Fri 17 Jan 2014 21:48:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43236599
Fri 17 Jan 2014 21:48:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:48:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43236599
Fri 17 Jan 2014 21:48:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:48:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:48:12 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:48:12 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:48:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 21:48:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:48:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 21:48:13 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:48:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8814 values 139514 bits 17439 bytes 
Fri 17 Jan 2014 21:48:18 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 21:48:18 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:48:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:48:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:48:19 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:48:19 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:48:19 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 21:48:19 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 21:48:19 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 21:48:20 - XML: Processed 647418 elements - found 706 jobs
Fri 17 Jan 2014 21:48:20 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:48:20 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:48:20 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:48:20 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:48:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:48:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:48:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:48:27 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:48:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:48:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:48:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:48:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:48:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:48:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:48:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:48:29 - size of cluster 'LISA Cluster': 624 hosts 79477 metrics 873124 values 13801601 bits 1725200 bytes 
Fri 17 Jan 2014 21:48:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:48:31 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:48:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:48:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:48:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:48:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:48:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:48:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:48:34 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:48:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43674105
Fri 17 Jan 2014 21:48:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:48:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43674105
Fri 17 Jan 2014 21:48:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:48:35 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:48:35 - job_xml_thread(): Done retrieving: data size 43674105
Fri 17 Jan 2014 21:48:35 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:48:35 - XML: Start document: iteration 1
Fri 17 Jan 2014 21:48:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:48:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:48:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:48:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:48:47 - XML: Processed 653072 elements - found 707 jobs
Fri 17 Jan 2014 21:48:48 - job 7348535 appears to have finished
Fri 17 Jan 2014 21:48:48 - job 7348536 appears to have finished
Fri 17 Jan 2014 21:48:48 - job_xml_thread(): Found 5 updated jobs.
Fri 17 Jan 2014 21:48:48 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 21:48:51 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Fri 17 Jan 2014 21:48:51 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:48:51 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:48:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:48:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:48:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:48:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:48:54 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:48:54 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:48:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:48:54 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:48:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:48:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:48:57 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:48:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:48:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:48:57 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:48:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 21:48:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:48:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:48:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:48:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:48:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:48:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:48:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43871422
Fri 17 Jan 2014 21:48:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:49:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43871422
Fri 17 Jan 2014 21:49:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:49:06 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:49:06 - job_xml_thread(): Done retrieving: data size 43871422
Fri 17 Jan 2014 21:49:06 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:49:06 - XML: Start document: iteration 2
Fri 17 Jan 2014 21:49:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:49:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:49:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:49:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:49:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:49:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:49:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:49:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:49:10 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:49:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:49:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:49:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:49:12 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:49:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:49:13 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:49:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 21:49:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 21:49:13 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:49:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5795 values 91575 bits 11446 bytes 
Fri 17 Jan 2014 21:49:18 - XML: Processed 655286 elements - found 707 jobs
Fri 17 Jan 2014 21:49:18 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:49:18 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:49:18 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:49:18 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:49:19 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:49:19 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 21:49:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:49:21 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:49:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:49:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:49:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:49:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:49:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:49:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:49:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:49:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855114
Fri 17 Jan 2014 21:49:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:49:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:49:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:49:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855114
Fri 17 Jan 2014 21:49:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:49:33 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:49:33 - job_xml_thread(): Done retrieving: data size 43855114
Fri 17 Jan 2014 21:49:33 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:49:33 - XML: Start document: iteration 3
Fri 17 Jan 2014 21:49:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:49:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:49:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:49:45 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:49:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:49:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:49:47 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:49:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:49:47 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:49:47 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:49:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:49:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:49:48 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:49:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:49:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:49:49 - XML: Processed 655620 elements - found 707 jobs
Fri 17 Jan 2014 21:49:49 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:49:49 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:49:49 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:49:49 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:49:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:49:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:49:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:49:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:49:49 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:49:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 21:49:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:49:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:49:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43888638
Fri 17 Jan 2014 21:49:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:49:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43888638
Fri 17 Jan 2014 21:49:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:50:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:50:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:50:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:50:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:50:04 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:50:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:50:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:50:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:50:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:50:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:50:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:50:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:50:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:50:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:50:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:50:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:50:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:50:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:50:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:50:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:50:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:50:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:50:10 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:50:10 - job_xml_thread(): Done retrieving: data size 43893975
Fri 17 Jan 2014 21:50:10 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:50:10 - XML: Start document: iteration 4
Fri 17 Jan 2014 21:50:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43893975
Fri 17 Jan 2014 21:50:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43893975
Fri 17 Jan 2014 21:50:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:50:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:50:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:50:13 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:50:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:50:15 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:50:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 21:50:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 21:50:15 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:50:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8939 values 141187 bits 17648 bytes 
Fri 17 Jan 2014 21:50:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:50:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:50:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:50:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:50:24 - XML: Processed 655620 elements - found 707 jobs
Fri 17 Jan 2014 21:50:24 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:50:24 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:50:24 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:50:24 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:50:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:50:28 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:50:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:50:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:50:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:50:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:50:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:50:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:50:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:50:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:50:32 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:50:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:50:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:50:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:50:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:50:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:50:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:50:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:50:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43880247
Fri 17 Jan 2014 21:50:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:50:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43880247
Fri 17 Jan 2014 21:50:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:50:39 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:50:42 - job_xml_thread(): Done retrieving: data size 43880247
Fri 17 Jan 2014 21:50:42 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:50:42 - XML: Start document: iteration 5
Fri 17 Jan 2014 21:50:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:50:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:50:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:50:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:50:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:50:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:50:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:50:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:50:51 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:50:51 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:50:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:50:51 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:50:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:50:52 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:50:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 21:50:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:50:59 - XML: Processed 655620 elements - found 707 jobs
Fri 17 Jan 2014 21:50:59 - job 7348568 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 21:50:59 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 21:50:59 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 21:51:00 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 21:51:00 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:51:00 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:51:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:51:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:51:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:51:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:51:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:51:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:51:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:51:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:51:03 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:51:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43874821
Fri 17 Jan 2014 21:51:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:51:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43874821
Fri 17 Jan 2014 21:51:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:51:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:51:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:51:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:51:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:51:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:51:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:51:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:51:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:51:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:51:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:51:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:51:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:51:15 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:51:15 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:51:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:51:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:51:15 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:51:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:51:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 21:51:15 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:51:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6070 values 95909 bits 11988 bytes 
Fri 17 Jan 2014 21:51:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 21:51:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:51:19 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:51:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:51:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:51:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:51:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:51:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:51:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:51:22 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:51:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43879730
Fri 17 Jan 2014 21:51:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:51:23 - job_xml_thread(): Done retrieving: data size 43879730
Fri 17 Jan 2014 21:51:23 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:51:23 - XML: Start document: iteration 6
Fri 17 Jan 2014 21:51:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43879730
Fri 17 Jan 2014 21:51:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:51:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:51:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:51:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:51:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:51:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:51:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:51:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:51:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:51:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:51:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:51:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:51:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:51:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:51:41 - XML: Processed 655620 elements - found 707 jobs
Fri 17 Jan 2014 21:51:41 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:51:41 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:51:41 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:51:41 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:51:45 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:51:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 21:51:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:51:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:51:46 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:51:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:51:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:51:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:51:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:51:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:51:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:51:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:51:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43866040
Fri 17 Jan 2014 21:51:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:51:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43866040
Fri 17 Jan 2014 21:51:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:51:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:51:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:51:56 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:51:56 - job_xml_thread(): Done retrieving: data size 43866040
Fri 17 Jan 2014 21:51:56 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:51:56 - XML: Start document: iteration 7
Fri 17 Jan 2014 21:52:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:52:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:52:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:52:03 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:52:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:52:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:52:04 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:52:04 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:52:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:52:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:52:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:52:07 - XML: Processed 655620 elements - found 707 jobs
Fri 17 Jan 2014 21:52:07 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:52:07 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:52:07 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:52:07 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:52:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:52:12 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:52:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:52:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:52:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:52:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:52:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:52:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:52:15 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:52:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43883655
Fri 17 Jan 2014 21:52:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:52:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43883655
Fri 17 Jan 2014 21:52:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:52:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:52:16 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:52:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:52:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 21:52:17 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:52:17 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:52:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 21:52:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8937 values 141102 bits 17637 bytes 
Fri 17 Jan 2014 21:52:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:52:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:52:22 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:52:22 - job_xml_thread(): Done retrieving: data size 43883655
Fri 17 Jan 2014 21:52:22 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:52:22 - XML: Start document: iteration 8
Fri 17 Jan 2014 21:52:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:52:25 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:52:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:52:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:52:26 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:52:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:52:26 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:52:26 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:52:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:52:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:52:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:52:30 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 21:52:30 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 21:52:30 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:52:34 - XML: Processed 655620 elements - found 707 jobs
Fri 17 Jan 2014 21:52:35 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:52:35 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:52:35 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:52:35 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:52:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:52:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:52:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:52:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:52:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:52:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:52:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:52:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:52:41 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:52:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873216
Fri 17 Jan 2014 21:52:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:52:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:52:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873216
Fri 17 Jan 2014 21:52:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:52:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:52:50 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:52:50 - job_xml_thread(): Done retrieving: data size 43873216
Fri 17 Jan 2014 21:52:50 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:52:50 - XML: Start document: iteration 9
Fri 17 Jan 2014 21:52:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:52:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:52:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:52:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:52:53 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:52:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:52:53 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:52:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:52:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:52:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:52:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:53:00 - XML: Processed 655620 elements - found 707 jobs
Fri 17 Jan 2014 21:53:00 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:53:00 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:53:00 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:53:00 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:53:02 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:53:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 21:53:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:53:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:53:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:53:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:53:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:53:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:53:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:53:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:53:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:53:04 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:53:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43864550
Fri 17 Jan 2014 21:53:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:53:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43864550
Fri 17 Jan 2014 21:53:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:53:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:53:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:53:16 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:53:16 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:53:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:53:16 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:53:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:53:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:53:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:53:17 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:53:17 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:53:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:53:17 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:53:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:53:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:53:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 21:53:17 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:53:17 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:53:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 21:53:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5983 values 94495 bits 11811 bytes 
Fri 17 Jan 2014 21:53:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:53:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:53:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:53:19 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:53:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:53:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:53:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:53:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:53:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:53:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:53:21 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:53:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 21:53:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:53:21 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:53:21 - job_xml_thread(): Done retrieving: data size 43815824
Fri 17 Jan 2014 21:53:21 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:53:21 - XML: Start document: iteration 10
Fri 17 Jan 2014 21:53:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43815824
Fri 17 Jan 2014 21:53:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:53:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43815824
Fri 17 Jan 2014 21:53:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:53:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:53:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:53:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:53:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:53:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:53:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:53:35 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:53:35 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:53:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:53:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:53:35 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:53:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:53:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:53:39 - XML: Processed 654872 elements - found 707 jobs
Fri 17 Jan 2014 21:53:39 - job 7348626 appears to have finished
Fri 17 Jan 2014 21:53:39 - job 7348151 appears to have finished
Fri 17 Jan 2014 21:53:39 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 21:53:39 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 21:53:41 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 21:53:41 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:53:41 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:53:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:53:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:53:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:53:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:53:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:53:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:53:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:53:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:53:44 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:53:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43321233
Fri 17 Jan 2014 21:53:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:53:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43321233
Fri 17 Jan 2014 21:53:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:53:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:53:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:53:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:53:54 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:53:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:53:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:53:56 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:53:56 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:53:56 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:53:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:53:56 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:53:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:53:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:53:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:53:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:53:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:53:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:53:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:53:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:53:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:54:00 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:54:00 - job_xml_thread(): Done retrieving: data size 43244204
Fri 17 Jan 2014 21:54:00 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:54:00 - XML: Start document: iteration 11
Fri 17 Jan 2014 21:54:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43244204
Fri 17 Jan 2014 21:54:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:54:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43244204
Fri 17 Jan 2014 21:54:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:54:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:54:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:54:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:54:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:54:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:54:16 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:54:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:54:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:54:17 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:54:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:54:17 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:54:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:54:17 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:54:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:54:17 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:54:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:54:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 21:54:18 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:54:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 21:54:18 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:54:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148702 bits 18587 bytes 
Fri 17 Jan 2014 21:54:19 - XML: Processed 647420 elements - found 707 jobs
Fri 17 Jan 2014 21:54:19 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:54:19 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:54:19 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:54:19 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:54:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:54:23 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:54:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:54:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:54:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:54:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:54:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:54:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:54:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:54:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43288288
Fri 17 Jan 2014 21:54:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:54:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43288288
Fri 17 Jan 2014 21:54:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:54:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:54:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:54:34 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:54:34 - job_xml_thread(): Done retrieving: data size 43288288
Fri 17 Jan 2014 21:54:34 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:54:34 - XML: Start document: iteration 12
Fri 17 Jan 2014 21:54:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:54:36 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:54:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:54:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:54:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:54:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:54:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:54:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:54:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:54:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:54:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:54:42 - XML: Processed 648168 elements - found 707 jobs
Fri 17 Jan 2014 21:54:42 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:54:42 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:54:42 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:54:42 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:54:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:54:45 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:54:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:54:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:54:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:54:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:54:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:54:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:54:46 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:54:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 21:54:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:54:47 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:54:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43825227
Fri 17 Jan 2014 21:54:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:54:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43825227
Fri 17 Jan 2014 21:54:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:54:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:54:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:54:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:54:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:54:57 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:54:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:54:57 - job_xml_thread(): Done retrieving: data size 43825227
Fri 17 Jan 2014 21:54:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:54:57 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:54:57 - XML: Start document: iteration 13
Fri 17 Jan 2014 21:54:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:54:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:54:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:54:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:54:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:55:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:55:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:55:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:55:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:55:10 - XML: Processed 654948 elements - found 707 jobs
Fri 17 Jan 2014 21:55:10 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:55:10 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:55:10 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:55:10 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:55:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:55:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:55:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:55:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:55:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:55:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:55:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:55:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43860501
Fri 17 Jan 2014 21:55:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:55:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43860501
Fri 17 Jan 2014 21:55:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:55:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:55:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:55:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:55:18 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:55:19 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 21:55:19 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:55:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:55:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 21:55:20 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:55:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8895 values 140375 bits 17546 bytes 
Fri 17 Jan 2014 21:55:20 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:55:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 21:55:20 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:55:20 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 21:55:20 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 21:55:20 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:55:20 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 21:55:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:55:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:55:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:55:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:55:24 - size of cluster 'LISA Cluster': 624 hosts 79478 metrics 780799 values 12325272 bits 1540659 bytes 
Fri 17 Jan 2014 21:55:25 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:55:25 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:55:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:55:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:55:25 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:55:25 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:55:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:55:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:55:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:55:27 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:55:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:55:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:55:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:55:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:55:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:55:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:55:31 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:55:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43900975
Fri 17 Jan 2014 21:55:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:55:32 - job_xml_thread(): Done retrieving: data size 43900975
Fri 17 Jan 2014 21:55:32 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:55:32 - XML: Start document: iteration 14
Fri 17 Jan 2014 21:55:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43900975
Fri 17 Jan 2014 21:55:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:55:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:55:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:55:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:55:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:55:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:55:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:55:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:55:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:55:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:55:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:55:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:55:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:55:48 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:55:50 - XML: Processed 655620 elements - found 707 jobs
Fri 17 Jan 2014 21:55:50 - job 7348654 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 21:55:50 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 21:55:50 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 21:55:51 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 21:55:51 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:55:51 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:55:51 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:55:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 21:55:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:55:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:55:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:55:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:55:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:55:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:55:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:55:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:55:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:55:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:55:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43888932
Fri 17 Jan 2014 21:55:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:55:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43888932
Fri 17 Jan 2014 21:55:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:56:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:56:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:56:06 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:56:06 - job_xml_thread(): Done retrieving: data size 43888932
Fri 17 Jan 2014 21:56:06 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:56:06 - XML: Start document: iteration 15
Fri 17 Jan 2014 21:56:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:56:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:56:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:56:14 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:56:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:56:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:56:14 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:56:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:56:14 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:56:14 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:56:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:56:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:56:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:56:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:56:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:56:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:56:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:56:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:56:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:56:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:56:20 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:56:20 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:56:20 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 21:56:21 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:56:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 21:56:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:56:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 21:56:21 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:56:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5859 values 92494 bits 11561 bytes 
Fri 17 Jan 2014 21:56:21 - XML: Processed 655620 elements - found 707 jobs
Fri 17 Jan 2014 21:56:21 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:56:21 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:56:21 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:56:21 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:56:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:56:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43879848
Fri 17 Jan 2014 21:56:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:56:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43879848
Fri 17 Jan 2014 21:56:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:56:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:56:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:56:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:56:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:56:36 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:56:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:56:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:56:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:56:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:56:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:56:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:56:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:56:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:56:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:56:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:56:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:56:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:56:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:56:42 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:56:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 21:56:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:56:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:56:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:56:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:56:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:56:44 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:56:44 - job_xml_thread(): Done retrieving: data size 43904168
Fri 17 Jan 2014 21:56:44 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:56:44 - XML: Start document: iteration 16
Fri 17 Jan 2014 21:56:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43904168
Fri 17 Jan 2014 21:56:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43904168
Fri 17 Jan 2014 21:56:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:56:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:56:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:56:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:56:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:56:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:57:00 - XML: Processed 655618 elements - found 706 jobs
Fri 17 Jan 2014 21:57:00 - job 7348377 appears to have finished
Fri 17 Jan 2014 21:57:01 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 21:57:01 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 21:57:02 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 21:57:02 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:57:02 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:57:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:57:03 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:57:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:57:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:57:04 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:57:04 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:57:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:57:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:57:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:57:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:57:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:57:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:57:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:57:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:57:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:57:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:57:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:57:10 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:57:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43899788
Fri 17 Jan 2014 21:57:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:57:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43899788
Fri 17 Jan 2014 21:57:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:57:17 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:57:17 - job_xml_thread(): Done retrieving: data size 43899788
Fri 17 Jan 2014 21:57:17 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:57:18 - XML: Start document: iteration 17
Fri 17 Jan 2014 21:57:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:57:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:57:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:57:21 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:57:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:57:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:57:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:57:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 21:57:23 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:57:23 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:57:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 21:57:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8883 values 140194 bits 17524 bytes 
Fri 17 Jan 2014 21:57:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:57:27 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:57:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:57:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:57:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:57:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:57:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:57:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:57:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:57:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:57:32 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:57:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:57:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:57:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:57:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:57:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:57:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:57:34 - XML: Processed 655618 elements - found 706 jobs
Fri 17 Jan 2014 21:57:34 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:57:34 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:57:34 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:57:34 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:57:38 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:57:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43881069
Fri 17 Jan 2014 21:57:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:57:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43881069
Fri 17 Jan 2014 21:57:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:57:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:57:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:57:47 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:57:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 21:57:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:57:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:57:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:57:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:57:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:57:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:57:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:57:48 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:57:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:57:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:57:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:57:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:57:49 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:57:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:57:52 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:57:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:57:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:57:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:57:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:57:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:57:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:57:55 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:57:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43897002
Fri 17 Jan 2014 21:57:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:57:56 - job_xml_thread(): Done retrieving: data size 43897002
Fri 17 Jan 2014 21:57:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43897002
Fri 17 Jan 2014 21:57:56 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:57:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:57:57 - XML: Start document: iteration 18
Fri 17 Jan 2014 21:58:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:58:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:58:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:58:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:58:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:58:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:58:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:58:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:58:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:58:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:58:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:58:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:58:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:58:15 - XML: Processed 655618 elements - found 706 jobs
Fri 17 Jan 2014 21:58:15 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:58:15 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:58:15 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:58:15 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:58:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:58:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:58:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:58:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:58:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:58:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:58:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:58:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:58:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:58:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43882239
Fri 17 Jan 2014 21:58:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:58:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43882239
Fri 17 Jan 2014 21:58:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:58:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:58:23 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:58:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:58:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 21:58:25 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:58:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 21:58:25 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:58:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9287 values 146635 bits 18329 bytes 
Fri 17 Jan 2014 21:58:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:58:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:58:30 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:58:30 - job_xml_thread(): Done retrieving: data size 43882239
Fri 17 Jan 2014 21:58:30 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:58:30 - XML: Start document: iteration 19
Fri 17 Jan 2014 21:58:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:58:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:58:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:58:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:58:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:58:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:58:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:58:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:58:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:58:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:58:37 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:58:42 - XML: Processed 655618 elements - found 706 jobs
Fri 17 Jan 2014 21:58:42 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 21:58:42 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 21:58:42 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:58:42 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:58:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:58:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:58:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:58:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:58:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:58:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:58:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:58:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:58:46 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:58:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 21:58:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:58:46 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 21:58:46 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 21:58:46 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:58:46 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:58:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43886457
Fri 17 Jan 2014 21:58:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:58:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43886457
Fri 17 Jan 2014 21:58:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:58:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:58:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:58:57 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:58:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:58:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:58:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:58:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:58:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:58:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:58:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:59:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:59:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:59:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:59:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:59:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:59:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:59:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:59:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:59:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:59:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:59:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:59:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:59:03 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:59:03 - job_xml_thread(): Done retrieving: data size 43880958
Fri 17 Jan 2014 21:59:03 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:59:03 - XML: Start document: iteration 20
Fri 17 Jan 2014 21:59:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43880958
Fri 17 Jan 2014 21:59:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:59:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43880958
Fri 17 Jan 2014 21:59:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:59:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:59:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:59:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:59:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:59:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:59:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:59:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:59:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:59:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:59:23 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:59:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:59:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:59:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:59:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:59:25 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:59:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:59:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 21:59:26 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:59:26 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:59:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 21:59:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99125 bits 12390 bytes 
Fri 17 Jan 2014 21:59:27 - XML: Processed 655618 elements - found 706 jobs
Fri 17 Jan 2014 21:59:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:59:27 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:59:27 - job 7348571 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 21:59:27 - job 7348570 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 21:59:27 - job 7348569 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 21:59:27 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 21:59:27 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 21:59:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:59:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:59:27 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 21:59:27 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 21:59:27 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 21:59:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:59:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:59:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:59:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:59:29 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:59:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43763561
Fri 17 Jan 2014 21:59:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:59:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43763561
Fri 17 Jan 2014 21:59:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:59:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:59:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:59:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 21:59:41 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 21:59:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 21:59:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:59:42 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 21:59:42 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 21:59:42 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:59:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 21:59:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 21:59:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 21:59:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 21:59:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 21:59:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 21:59:45 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 21:59:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 21:59:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 21:59:45 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 21:59:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 21:59:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 21:59:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:59:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 21:59:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 21:59:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 21:59:47 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 21:59:47 - job_xml_thread(): Done retrieving: data size 43258429
Fri 17 Jan 2014 21:59:47 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 21:59:47 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 21:59:47 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 21:59:47 - Housekeeping: done.
Fri 17 Jan 2014 21:59:47 - XML: Start document: iteration 0
Fri 17 Jan 2014 21:59:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43258429
Fri 17 Jan 2014 21:59:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 21:59:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43258429
Fri 17 Jan 2014 21:59:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 21:59:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 21:59:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:00:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:00:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:00:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:00:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:00:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:00:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:00:06 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:00:06 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:00:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:00:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:00:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:00:08 - XML: Processed 647846 elements - found 706 jobs
Fri 17 Jan 2014 22:00:08 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:00:08 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:00:08 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:00:09 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:00:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:00:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:00:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:00:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:00:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:00:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:00:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:00:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:00:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:00:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43238847
Fri 17 Jan 2014 22:00:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:00:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43238847
Fri 17 Jan 2014 22:00:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:00:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:00:21 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:00:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:00:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:00:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:00:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:00:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:00:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:00:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:00:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:00:23 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:00:24 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:00:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:00:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43312941
Fri 17 Jan 2014 22:00:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:00:26 - job_xml_thread(): Done retrieving: data size 43312941
Fri 17 Jan 2014 22:00:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:00:26 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:00:26 - XML: Start document: iteration 1
Fri 17 Jan 2014 22:00:26 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:00:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:00:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:00:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:00:27 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:00:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 22:00:27 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:00:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 22:00:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 11943 values 188520 bits 23565 bytes 
Fri 17 Jan 2014 22:00:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:00:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:00:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:00:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43312941
Fri 17 Jan 2014 22:00:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:00:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:00:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:00:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:00:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:00:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:00:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:00:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:00:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:00:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:00:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:00:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:00:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:00:46 - XML: Processed 648166 elements - found 706 jobs
Fri 17 Jan 2014 22:00:46 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:00:46 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:00:46 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:00:46 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:00:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:00:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:00:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:00:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:00:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:00:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:00:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:00:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:00:48 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:00:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 22:00:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:00:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:00:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43807571
Fri 17 Jan 2014 22:00:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:00:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43807571
Fri 17 Jan 2014 22:00:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:00:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:00:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:01:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:01:00 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:01:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:01:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:01:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:01:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:01:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:01:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:01:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:01:01 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:01:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:01:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:01:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:01:03 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:01:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:01:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:01:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:01:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:01:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:01:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:01:04 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:01:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43882244
Fri 17 Jan 2014 22:01:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:01:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43882244
Fri 17 Jan 2014 22:01:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:01:05 - job_xml_thread(): Done retrieving: data size 43882244
Fri 17 Jan 2014 22:01:05 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:01:06 - XML: Start document: iteration 2
Fri 17 Jan 2014 22:01:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:01:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:01:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:01:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:01:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:01:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:01:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:01:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:01:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:01:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:01:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:01:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:01:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:01:26 - XML: Processed 655616 elements - found 705 jobs
Fri 17 Jan 2014 22:01:26 - job 7348323 appears to have finished
Fri 17 Jan 2014 22:01:26 - job 7348572 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 22:01:26 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 22:01:26 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 22:01:27 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 22:01:27 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:01:27 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:01:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:01:27 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:01:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:01:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:01:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:01:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:01:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:01:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:01:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:01:28 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:01:28 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:01:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 22:01:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:01:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 22:01:28 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:01:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99235 bits 12404 bytes 
Fri 17 Jan 2014 22:01:29 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:01:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43878689
Fri 17 Jan 2014 22:01:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:01:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43878689
Fri 17 Jan 2014 22:01:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:01:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:01:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:01:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:01:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:01:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:01:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:01:39 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:01:39 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:01:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:01:39 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:01:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:01:42 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:01:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:01:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:01:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:01:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:01:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:01:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:01:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:01:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:01:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:01:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:01:45 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:01:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 22:01:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:01:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:01:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43878709
Fri 17 Jan 2014 22:01:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:01:46 - job_xml_thread(): Done retrieving: data size 43878709
Fri 17 Jan 2014 22:01:46 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:01:46 - XML: Start document: iteration 3
Fri 17 Jan 2014 22:01:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43878709
Fri 17 Jan 2014 22:01:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:01:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:01:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:01:59 - XML: Processed 655616 elements - found 705 jobs
Fri 17 Jan 2014 22:01:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:01:59 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:01:59 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:01:59 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:01:59 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:01:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:02:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:02:03 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:02:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:02:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:02:04 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:02:04 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:02:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:02:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:02:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:02:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:02:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:02:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:02:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:02:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:02:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:02:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:02:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:02:09 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:02:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43900828
Fri 17 Jan 2014 22:02:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:02:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43900828
Fri 17 Jan 2014 22:02:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:02:14 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:02:14 - job_xml_thread(): Done retrieving: data size 43900828
Fri 17 Jan 2014 22:02:14 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:02:14 - XML: Start document: iteration 4
Fri 17 Jan 2014 22:02:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:02:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:02:21 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 22:02:21 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:02:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:02:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:02:23 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:02:23 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:02:23 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 22:02:24 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 22:02:24 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 22:02:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:02:27 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:02:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:02:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:02:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:02:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:02:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:02:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:02:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:02:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:02:28 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:02:28 - XML: Processed 655616 elements - found 705 jobs
Fri 17 Jan 2014 22:02:28 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:02:28 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:02:28 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:02:28 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:02:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:02:29 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:02:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 22:02:29 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:02:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 22:02:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7210 values 114176 bits 14272 bytes 
Fri 17 Jan 2014 22:02:31 - size of cluster 'LISA Cluster': 624 hosts 79480 metrics 862260 values 13622791 bits 1702848 bytes 
Fri 17 Jan 2014 22:02:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:02:33 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:02:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:02:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:02:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:02:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:02:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:02:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:02:37 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:02:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43880645
Fri 17 Jan 2014 22:02:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:02:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43880645
Fri 17 Jan 2014 22:02:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:02:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:02:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:02:43 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:02:43 - job_xml_thread(): Done retrieving: data size 43880645
Fri 17 Jan 2014 22:02:43 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:02:43 - XML: Start document: iteration 5
Fri 17 Jan 2014 22:02:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:02:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:02:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:02:53 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:02:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:02:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:02:54 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:02:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:02:54 - XML: Processed 655616 elements - found 705 jobs
Fri 17 Jan 2014 22:02:54 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:02:54 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:02:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:02:54 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:02:54 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:02:54 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:02:54 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:02:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:02:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:02:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:02:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:02:59 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:02:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 22:02:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:02:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:02:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:02:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:02:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:03:01 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:03:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43911032
Fri 17 Jan 2014 22:03:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:03:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43911032
Fri 17 Jan 2014 22:03:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:03:09 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:03:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:03:10 - job_xml_thread(): Done retrieving: data size 43911032
Fri 17 Jan 2014 22:03:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:03:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:03:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:03:10 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:03:10 - XML: Start document: iteration 6
Fri 17 Jan 2014 22:03:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:03:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:03:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:03:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:03:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:03:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:03:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:03:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:03:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:03:23 - XML: Processed 655620 elements - found 707 jobs
Fri 17 Jan 2014 22:03:23 - job 7348573 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 22:03:23 - job 7348574 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 22:03:23 - job 7348563 appears to have finished
Fri 17 Jan 2014 22:03:23 - job_xml_thread(): Found 6 updated jobs.
Fri 17 Jan 2014 22:03:23 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 22:03:23 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:03:23 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 22:03:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:03:24 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:03:24 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Fri 17 Jan 2014 22:03:24 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:03:24 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:03:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:03:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:03:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:03:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:03:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:03:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:03:27 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:03:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43874161
Fri 17 Jan 2014 22:03:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:03:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43874161
Fri 17 Jan 2014 22:03:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:03:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:03:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:03:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:03:29 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:03:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:03:30 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:03:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 22:03:30 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:03:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 22:03:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8701 values 137574 bits 17196 bytes 
Fri 17 Jan 2014 22:03:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:03:36 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:03:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:03:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:03:37 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:03:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:03:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43874161
Fri 17 Jan 2014 22:03:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:03:37 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:03:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:03:39 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:03:39 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:03:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:03:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:03:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:03:46 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:03:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:03:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:03:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:03:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:03:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:03:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:03:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:03:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:03:51 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:03:51 - job_xml_thread(): Done retrieving: data size 43864315
Fri 17 Jan 2014 22:03:51 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:03:51 - XML: Start document: iteration 7
Fri 17 Jan 2014 22:03:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43864315
Fri 17 Jan 2014 22:03:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:03:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:03:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:03:53 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:03:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:03:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43864315
Fri 17 Jan 2014 22:03:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:03:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:03:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:04:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:04:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:04:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:04:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:04:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:04:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:04:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:04:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:04:09 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:04:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:04:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:04:11 - XML: Processed 655620 elements - found 707 jobs
Fri 17 Jan 2014 22:04:11 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:04:11 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:04:11 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:04:11 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:04:15 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:04:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 22:04:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:04:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:04:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:04:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:04:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:04:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:04:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:04:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:04:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:04:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:04:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43872550
Fri 17 Jan 2014 22:04:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:04:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43872550
Fri 17 Jan 2014 22:04:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:04:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:04:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:04:26 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:04:27 - job_xml_thread(): Done retrieving: data size 43872550
Fri 17 Jan 2014 22:04:27 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:04:27 - XML: Start document: iteration 8
Fri 17 Jan 2014 22:04:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:04:32 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:04:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:04:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:04:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:04:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:04:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:04:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:04:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:04:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 22:04:33 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:04:33 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:04:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 22:04:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5806 values 91642 bits 11455 bytes 
Fri 17 Jan 2014 22:04:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:04:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:04:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:04:34 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:04:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:04:41 - XML: Processed 655620 elements - found 707 jobs
Fri 17 Jan 2014 22:04:41 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:04:42 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:04:42 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:04:42 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:04:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:04:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:04:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:04:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:04:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:04:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:04:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:04:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:04:46 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:04:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43890097
Fri 17 Jan 2014 22:04:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:04:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43890097
Fri 17 Jan 2014 22:04:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:04:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:04:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:04:57 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:04:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:04:57 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:04:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 22:04:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:04:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:04:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:04:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:04:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:04:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:04:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:05:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:05:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:05:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:05:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:05:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:05:01 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:05:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:05:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:05:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:05:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:05:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:05:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:05:04 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:05:04 - job_xml_thread(): Done retrieving: data size 43887276
Fri 17 Jan 2014 22:05:04 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:05:04 - XML: Start document: iteration 9
Fri 17 Jan 2014 22:05:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43887276
Fri 17 Jan 2014 22:05:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:05:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43887276
Fri 17 Jan 2014 22:05:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:05:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:05:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:05:15 - XML: Processed 655616 elements - found 705 jobs
Fri 17 Jan 2014 22:05:16 - job 7348532 appears to have finished
Fri 17 Jan 2014 22:05:16 - job 7348529 appears to have finished
Fri 17 Jan 2014 22:05:16 - job 7348575 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 22:05:16 - job 7348576 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 22:05:16 - job 7348579 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 22:05:17 - job_xml_thread(): Found 5 updated jobs.
Fri 17 Jan 2014 22:05:17 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 22:05:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:05:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:05:23 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Fri 17 Jan 2014 22:05:23 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:05:23 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:05:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:05:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:05:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:05:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:05:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:05:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:05:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:05:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:05:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:05:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:05:27 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:05:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:05:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:05:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:05:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:05:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:05:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:05:30 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:05:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43806046
Fri 17 Jan 2014 22:05:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:05:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43806046
Fri 17 Jan 2014 22:05:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:05:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:05:33 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:05:34 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:05:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:05:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 22:05:34 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:05:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 22:05:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9253 values 146097 bits 18262 bytes 
Fri 17 Jan 2014 22:05:39 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:05:39 - job_xml_thread(): Done retrieving: data size 43806046
Fri 17 Jan 2014 22:05:39 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:05:39 - XML: Start document: iteration 10
Fri 17 Jan 2014 22:05:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:05:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:05:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:05:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:05:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:05:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:05:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:05:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:05:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:05:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:05:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:05:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:05:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:05:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:05:49 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:05:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:05:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:05:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:05:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:05:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:05:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:05:53 - XML: Processed 654412 elements - found 705 jobs
Fri 17 Jan 2014 22:05:53 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:05:53 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:05:53 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:05:53 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:05:56 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 22:05:56 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 22:05:56 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:05:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:05:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:05:56 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:05:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43260505
Fri 17 Jan 2014 22:05:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:05:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43260505
Fri 17 Jan 2014 22:05:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:06:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:06:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:06:08 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:06:08 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:06:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:06:09 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:06:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:06:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:06:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:06:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:06:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:06:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:06:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:06:12 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:06:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:06:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:06:12 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:06:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 22:06:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:06:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:06:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:06:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:06:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:06:14 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:06:14 - job_xml_thread(): Done retrieving: data size 43245012
Fri 17 Jan 2014 22:06:14 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:06:14 - XML: Start document: iteration 11
Fri 17 Jan 2014 22:06:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43245012
Fri 17 Jan 2014 22:06:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:06:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43245012
Fri 17 Jan 2014 22:06:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:06:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:06:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:06:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:06:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:06:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:06:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:06:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:06:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:06:30 - XML: Processed 647416 elements - found 705 jobs
Fri 17 Jan 2014 22:06:30 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:06:30 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:06:30 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:06:31 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:06:32 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:06:32 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:06:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:06:32 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:06:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:06:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:06:34 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:06:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:06:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 22:06:35 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:06:35 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:06:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5760 values 90865 bits 11358 bytes 
Fri 17 Jan 2014 22:06:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 22:06:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:06:35 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:06:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:06:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:06:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:06:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:06:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:06:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:06:37 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:06:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 22:06:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:06:38 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:06:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43762576
Fri 17 Jan 2014 22:06:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:06:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43762576
Fri 17 Jan 2014 22:06:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:06:46 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:06:46 - job_xml_thread(): Done retrieving: data size 43762576
Fri 17 Jan 2014 22:06:46 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:06:46 - XML: Start document: iteration 12
Fri 17 Jan 2014 22:06:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:06:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:06:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:06:48 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:06:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:06:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:06:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:06:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:06:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:06:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:06:49 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:06:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:06:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:07:00 - XML: Processed 654144 elements - found 702 jobs
Fri 17 Jan 2014 22:07:00 - job 7348531 appears to have finished
Fri 17 Jan 2014 22:07:00 - job 7348530 appears to have finished
Fri 17 Jan 2014 22:07:00 - job 7348528 appears to have finished
Fri 17 Jan 2014 22:07:00 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 22:07:00 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 22:07:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:07:01 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:07:01 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 22:07:01 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:07:01 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:07:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:07:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:07:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:07:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:07:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:07:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:07:03 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:07:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853462
Fri 17 Jan 2014 22:07:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:07:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:07:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853462
Fri 17 Jan 2014 22:07:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:07:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:07:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:07:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:07:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:07:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:07:16 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:07:16 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:07:17 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:07:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:07:17 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:07:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:07:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:07:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:07:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:07:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:07:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:07:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:07:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:07:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:07:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:07:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:07:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:07:19 - job_xml_thread(): Done retrieving: data size 43885428
Fri 17 Jan 2014 22:07:19 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:07:19 - XML: Start document: iteration 13
Fri 17 Jan 2014 22:07:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43885428
Fri 17 Jan 2014 22:07:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:07:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43885428
Fri 17 Jan 2014 22:07:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:07:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:07:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:07:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:07:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:07:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:07:36 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:07:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:07:37 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:07:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 22:07:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 22:07:37 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:07:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148667 bits 18583 bytes 
Fri 17 Jan 2014 22:07:39 - XML: Processed 655610 elements - found 702 jobs
Fri 17 Jan 2014 22:07:39 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:07:40 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:07:40 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:07:40 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:07:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:07:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:07:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:07:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:07:42 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:07:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:07:42 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:07:42 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:07:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:07:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:07:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:07:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:07:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:07:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:07:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:07:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:07:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:07:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:07:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43909087
Fri 17 Jan 2014 22:07:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:07:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43909087
Fri 17 Jan 2014 22:07:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:07:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:07:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:07:55 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:07:55 - job_xml_thread(): Done retrieving: data size 43909087
Fri 17 Jan 2014 22:07:55 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:07:56 - XML: Start document: iteration 14
Fri 17 Jan 2014 22:07:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:07:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:07:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:07:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:07:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:07:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:07:59 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:07:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:07:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:08:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:08:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:08:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:08:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:08:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:08:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:08:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:08:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:08:06 - XML: Processed 655610 elements - found 702 jobs
Fri 17 Jan 2014 22:08:06 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:08:06 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:08:06 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:08:06 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:08:07 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:08:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 22:08:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:08:09 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:08:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870317
Fri 17 Jan 2014 22:08:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:08:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870317
Fri 17 Jan 2014 22:08:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:08:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:08:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:08:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:08:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:08:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:08:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:08:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:08:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:08:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:08:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:08:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870317
Fri 17 Jan 2014 22:08:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:08:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:08:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:08:21 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:08:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:08:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:08:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:08:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:08:31 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:08:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:08:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:08:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:08:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:08:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:08:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:08:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:08:32 - job_xml_thread(): Done retrieving: data size 43886896
Fri 17 Jan 2014 22:08:32 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:08:32 - XML: Start document: iteration 15
Fri 17 Jan 2014 22:08:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43886896
Fri 17 Jan 2014 22:08:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:08:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:08:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:08:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:08:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:08:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:08:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43886896
Fri 17 Jan 2014 22:08:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:08:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:08:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:08:37 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:08:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:08:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 22:08:37 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:08:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8733 values 137723 bits 17215 bytes 
Fri 17 Jan 2014 22:08:37 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:08:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 22:08:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:08:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:08:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:08:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:08:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:08:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:08:50 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:08:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:08:50 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:08:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:08:50 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:08:53 - XML: Processed 655610 elements - found 702 jobs
Fri 17 Jan 2014 22:08:53 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:08:53 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:08:53 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:08:53 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:08:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:08:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:08:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:08:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:08:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:08:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:08:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:08:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:08:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:08:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43900023
Fri 17 Jan 2014 22:08:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:08:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43900023
Fri 17 Jan 2014 22:08:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:09:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:09:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:09:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:09:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:09:08 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:09:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:09:08 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:09:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:09:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:09:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:09:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:09:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:09:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:09:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:09:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:09:13 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:09:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:09:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:09:13 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:09:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 22:09:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:09:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:09:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:09:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:09:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:09:15 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:09:15 - job_xml_thread(): Done retrieving: data size 43906560
Fri 17 Jan 2014 22:09:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43906560
Fri 17 Jan 2014 22:09:15 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:09:15 - XML: Start document: iteration 16
Fri 17 Jan 2014 22:09:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:09:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43906560
Fri 17 Jan 2014 22:09:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:09:23 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 22:09:24 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:09:24 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:09:24 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:09:24 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 22:09:24 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 22:09:25 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 22:09:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:09:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:09:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:09:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:09:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:09:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:09:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:09:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:09:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:09:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:09:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:09:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:09:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:09:34 - XML: Processed 655608 elements - found 702 jobs
Fri 17 Jan 2014 22:09:34 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:09:34 - size of cluster 'LISA Cluster': 624 hosts 79467 metrics 823249 values 12996507 bits 1624563 bytes 
Fri 17 Jan 2014 22:09:34 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:09:34 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:09:34 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:09:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:09:38 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:09:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:09:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:09:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:09:39 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:09:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 22:09:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 22:09:39 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:09:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5773 values 91012 bits 11376 bytes 
Fri 17 Jan 2014 22:09:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:09:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:09:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:09:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:09:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:09:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:09:42 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:09:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43889247
Fri 17 Jan 2014 22:09:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:09:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43889247
Fri 17 Jan 2014 22:09:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:09:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:09:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:09:50 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:09:50 - job_xml_thread(): Done retrieving: data size 43889247
Fri 17 Jan 2014 22:09:50 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:09:50 - XML: Start document: iteration 17
Fri 17 Jan 2014 22:09:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:09:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:09:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:09:56 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:09:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:09:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:09:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:09:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:09:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:09:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:09:57 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:10:02 - XML: Processed 655610 elements - found 702 jobs
Fri 17 Jan 2014 22:10:02 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:10:02 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:10:02 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:10:02 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:10:03 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:10:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 22:10:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:10:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:10:06 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:10:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:10:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:10:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:10:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:10:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:10:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:10:09 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:10:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867186
Fri 17 Jan 2014 22:10:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:10:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43867186
Fri 17 Jan 2014 22:10:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:10:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:10:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:10:17 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:10:17 - job_xml_thread(): Done retrieving: data size 43867186
Fri 17 Jan 2014 22:10:18 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:10:18 - XML: Start document: iteration 18
Fri 17 Jan 2014 22:10:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:10:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:10:25 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:10:25 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 22:10:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:10:25 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:10:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:10:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:10:26 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:10:26 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:10:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:10:26 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:10:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:10:31 - XML: Processed 655610 elements - found 702 jobs
Fri 17 Jan 2014 22:10:31 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:10:31 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:10:31 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:10:32 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:10:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:10:32 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:10:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:10:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:10:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:10:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:10:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:10:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:10:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:10:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43877608
Fri 17 Jan 2014 22:10:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:10:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43877608
Fri 17 Jan 2014 22:10:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:10:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:10:39 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:10:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:10:40 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:10:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 22:10:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 22:10:40 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:10:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8868 values 139912 bits 17489 bytes 
Fri 17 Jan 2014 22:10:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:10:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:10:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:10:46 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:10:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:10:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:10:47 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:10:47 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:10:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:10:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:10:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:10:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:10:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:10:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:10:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:10:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:10:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:10:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:10:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:10:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:10:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:10:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:10:55 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:10:55 - job_xml_thread(): Done retrieving: data size 43882516
Fri 17 Jan 2014 22:10:55 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:10:55 - XML: Start document: iteration 19
Fri 17 Jan 2014 22:10:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43882516
Fri 17 Jan 2014 22:10:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:10:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43882516
Fri 17 Jan 2014 22:10:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:11:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:11:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:11:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:11:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:11:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:11:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:11:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:11:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:11:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:11:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:11:10 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:11:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:11:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:11:15 - XML: Processed 655616 elements - found 705 jobs
Fri 17 Jan 2014 22:11:15 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 22:11:16 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 22:11:16 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 22:11:16 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:11:16 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:11:19 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:11:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 22:11:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:11:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:11:20 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:11:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:11:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:11:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:11:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:11:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:11:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:11:23 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:11:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43791919
Fri 17 Jan 2014 22:11:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:11:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43791919
Fri 17 Jan 2014 22:11:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:11:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:11:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:11:31 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:11:31 - job_xml_thread(): Done retrieving: data size 43791919
Fri 17 Jan 2014 22:11:31 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:11:31 - XML: Start document: iteration 20
Fri 17 Jan 2014 22:11:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:11:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:11:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:11:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:11:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:11:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:11:37 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:11:37 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:11:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:11:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:11:37 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:11:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:11:40 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:11:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:11:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 22:11:41 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:11:41 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:11:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 22:11:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5773 values 91027 bits 11378 bytes 
Fri 17 Jan 2014 22:11:45 - XML: Processed 654868 elements - found 705 jobs
Fri 17 Jan 2014 22:11:45 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:11:45 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:11:45 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:11:45 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:11:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:11:48 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:11:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:11:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:11:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:11:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:11:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:11:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:11:51 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:11:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43274524
Fri 17 Jan 2014 22:11:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:11:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43274524
Fri 17 Jan 2014 22:11:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:11:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:11:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:12:00 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:12:00 - job_xml_thread(): Done retrieving: data size 43274524
Fri 17 Jan 2014 22:12:00 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:12:00 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 22:12:00 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 22:12:00 - Housekeeping: done.
Fri 17 Jan 2014 22:12:00 - XML: Start document: iteration 0
Fri 17 Jan 2014 22:12:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:12:01 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:12:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:12:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:12:01 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:12:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:12:01 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:12:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:12:01 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:12:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:12:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:12:07 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:12:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 22:12:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:12:13 - XML: Processed 648370 elements - found 705 jobs
Fri 17 Jan 2014 22:12:14 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:12:14 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:12:14 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:12:14 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:12:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:12:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:12:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:12:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:12:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:12:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:12:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:12:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:12:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:12:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:12:17 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:12:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43232419
Fri 17 Jan 2014 22:12:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:12:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43232419
Fri 17 Jan 2014 22:12:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:12:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:12:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:12:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:12:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:12:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:12:27 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:12:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:12:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:12:27 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:12:29 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:12:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:12:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:12:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:12:32 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:12:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:12:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:12:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:12:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:12:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:12:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:12:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:12:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43727597
Fri 17 Jan 2014 22:12:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:12:36 - job_xml_thread(): Done retrieving: data size 43727597
Fri 17 Jan 2014 22:12:36 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:12:36 - XML: Start document: iteration 1
Fri 17 Jan 2014 22:12:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43727597
Fri 17 Jan 2014 22:12:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:12:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:12:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:12:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:12:42 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:12:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:12:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 22:12:42 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:12:42 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:12:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 22:12:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8800 values 138877 bits 17359 bytes 
Fri 17 Jan 2014 22:12:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:12:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:12:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:12:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:12:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:12:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:12:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:12:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:12:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:12:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:12:52 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:12:57 - XML: Processed 653836 elements - found 705 jobs
Fri 17 Jan 2014 22:12:57 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:12:57 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:12:57 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:12:57 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:12:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:12:59 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:12:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:12:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:12:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:12:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:12:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:12:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:13:03 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:13:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43854759
Fri 17 Jan 2014 22:13:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:13:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43854759
Fri 17 Jan 2014 22:13:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:13:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:13:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:13:12 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:13:12 - job_xml_thread(): Done retrieving: data size 43854759
Fri 17 Jan 2014 22:13:12 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:13:12 - XML: Start document: iteration 2
Fri 17 Jan 2014 22:13:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:13:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:13:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:13:14 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:13:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:13:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:13:16 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:13:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:13:16 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:13:16 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:13:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:13:24 - XML: Processed 655258 elements - found 705 jobs
Fri 17 Jan 2014 22:13:24 - job 7348580 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 22:13:24 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 22:13:24 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 22:13:26 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 22:13:26 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:13:26 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:13:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:13:26 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:13:26 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:13:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 22:13:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:13:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:13:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:13:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:13:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:13:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:13:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:13:29 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:13:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43877353
Fri 17 Jan 2014 22:13:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:13:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43877353
Fri 17 Jan 2014 22:13:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:13:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:13:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:13:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:13:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:13:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:13:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:13:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:13:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:13:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:13:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:13:40 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:13:41 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:13:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:13:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:13:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:13:43 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:13:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:13:43 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:13:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 22:13:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 22:13:43 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:13:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5796 values 91426 bits 11428 bytes 
Fri 17 Jan 2014 22:13:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:13:45 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:13:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:13:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:13:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:13:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:13:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:13:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:13:47 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 22:13:47 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 22:13:47 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:13:48 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:13:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43871369
Fri 17 Jan 2014 22:13:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:13:49 - job_xml_thread(): Done retrieving: data size 43871369
Fri 17 Jan 2014 22:13:49 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:13:49 - XML: Start document: iteration 3
Fri 17 Jan 2014 22:13:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43871369
Fri 17 Jan 2014 22:13:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:13:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:13:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:14:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:14:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:14:07 - XML: Processed 655616 elements - found 705 jobs
Fri 17 Jan 2014 22:14:07 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:14:07 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:14:07 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:14:07 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:14:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:14:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:14:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:14:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:14:08 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:14:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:14:08 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:14:08 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:14:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:14:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:14:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:14:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:14:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:14:11 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:14:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 22:14:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:14:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:14:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:14:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:14:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:14:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:14:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43911283
Fri 17 Jan 2014 22:14:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:14:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43911283
Fri 17 Jan 2014 22:14:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:14:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:14:21 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:14:22 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:14:22 - job_xml_thread(): Done retrieving: data size 43911283
Fri 17 Jan 2014 22:14:22 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:14:22 - XML: Start document: iteration 4
Fri 17 Jan 2014 22:14:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:14:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:14:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:14:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:14:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:14:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:14:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:14:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:14:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:14:34 - XML: Processed 655616 elements - found 705 jobs
Fri 17 Jan 2014 22:14:34 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:14:34 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:14:34 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:14:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:14:34 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:14:34 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:14:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:14:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:14:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:14:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:14:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:14:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:14:37 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:14:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867395
Fri 17 Jan 2014 22:14:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:14:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43867395
Fri 17 Jan 2014 22:14:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:14:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:14:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:14:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:14:43 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:14:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:14:46 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:14:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:14:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:14:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:14:47 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:14:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 22:14:47 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:14:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 22:14:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8819 values 139045 bits 17380 bytes 
Fri 17 Jan 2014 22:14:47 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:14:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:14:47 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:14:47 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:14:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:14:49 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:14:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:14:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:14:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:14:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:14:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:14:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:14:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:14:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:14:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:14:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:14:53 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:14:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43891517
Fri 17 Jan 2014 22:14:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:14:53 - job_xml_thread(): Done retrieving: data size 43891517
Fri 17 Jan 2014 22:14:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43891517
Fri 17 Jan 2014 22:14:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:14:54 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:14:54 - XML: Start document: iteration 5
Fri 17 Jan 2014 22:15:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:15:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:15:06 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:15:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 22:15:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:15:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:15:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:15:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:15:09 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:15:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:15:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:15:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:15:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:15:10 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:15:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:15:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:15:16 - XML: Processed 655614 elements - found 704 jobs
Fri 17 Jan 2014 22:15:16 - job 7348569 appears to have finished
Fri 17 Jan 2014 22:15:16 - job 7348581 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 22:15:16 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 22:15:16 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 22:15:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:15:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:15:17 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 22:15:17 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:15:17 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:15:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:15:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:15:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:15:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:15:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:15:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:15:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:15:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43866518
Fri 17 Jan 2014 22:15:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:15:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43866518
Fri 17 Jan 2014 22:15:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:15:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:15:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:15:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:15:27 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:15:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:15:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:15:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:15:27 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:15:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:15:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:15:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43866518
Fri 17 Jan 2014 22:15:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:15:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:15:32 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:15:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:15:32 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:15:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:15:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:15:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:15:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:15:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:15:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:15:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:15:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:15:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:15:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:15:41 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:15:41 - job_xml_thread(): Done retrieving: data size 43887283
Fri 17 Jan 2014 22:15:41 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:15:41 - XML: Start document: iteration 6
Fri 17 Jan 2014 22:15:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43887283
Fri 17 Jan 2014 22:15:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:15:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:15:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:15:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:15:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:15:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43887283
Fri 17 Jan 2014 22:15:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:15:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:15:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:15:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:15:47 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:15:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:15:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 22:15:48 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:15:48 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:15:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8284 values 130791 bits 16348 bytes 
Fri 17 Jan 2014 22:15:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 22:15:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:15:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:15:58 - XML: Processed 655614 elements - found 704 jobs
Fri 17 Jan 2014 22:15:59 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:15:59 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:15:59 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:15:59 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:16:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:16:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:16:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:16:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:16:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:16:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:16:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:16:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:16:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:16:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:16:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:16:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:16:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:16:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:16:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:16:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:16:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:16:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:16:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:16:06 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:16:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 22:16:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:16:06 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:16:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43899389
Fri 17 Jan 2014 22:16:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:16:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43899389
Fri 17 Jan 2014 22:16:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:16:14 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:16:15 - job_xml_thread(): Done retrieving: data size 43899389
Fri 17 Jan 2014 22:16:15 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:16:15 - XML: Start document: iteration 7
Fri 17 Jan 2014 22:16:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:16:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:16:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:16:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:16:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:16:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:16:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:16:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:16:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:16:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:16:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:16:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:16:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:16:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:16:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:16:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:16:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:16:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:16:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:16:25 - XML: Processed 655614 elements - found 704 jobs
Fri 17 Jan 2014 22:16:25 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 22:16:25 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:16:25 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:16:25 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:16:25 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:16:25 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:16:26 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:16:26 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:16:26 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 22:16:26 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 22:16:26 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 22:16:27 - size of cluster 'LISA Cluster': 624 hosts 79478 metrics 800256 values 12634514 bits 1579314 bytes 
Fri 17 Jan 2014 22:16:28 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:16:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43913397
Fri 17 Jan 2014 22:16:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:16:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43913397
Fri 17 Jan 2014 22:16:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:16:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:16:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:16:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:16:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:16:40 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:16:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:16:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:16:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:16:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:16:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:16:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:16:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:16:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:16:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:16:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:16:45 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:16:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:16:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:16:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:16:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:16:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:16:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:16:48 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:16:48 - job_xml_thread(): Done retrieving: data size 43897554
Fri 17 Jan 2014 22:16:48 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:16:48 - XML: Start document: iteration 8
Fri 17 Jan 2014 22:16:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:16:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43897554
Fri 17 Jan 2014 22:16:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43897554
Fri 17 Jan 2014 22:16:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:16:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:16:49 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:16:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:16:50 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:16:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 22:16:50 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:16:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 22:16:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6781 values 107294 bits 13411 bytes 
Fri 17 Jan 2014 22:16:57 - XML: Processed 655612 elements - found 703 jobs
Fri 17 Jan 2014 22:16:57 - job 7348537 appears to have finished
Fri 17 Jan 2014 22:16:57 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 22:16:57 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 22:16:58 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 22:16:58 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:16:58 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:16:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:16:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:17:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:17:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:17:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:17:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:17:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:17:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:17:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:17:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:17:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:17:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:17:09 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:17:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:17:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:17:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:17:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:17:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:17:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:17:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:17:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:17:13 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:17:14 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:17:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 22:17:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:17:14 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:17:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43847297
Fri 17 Jan 2014 22:17:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:17:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43847297
Fri 17 Jan 2014 22:17:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:17:14 - job_xml_thread(): Done retrieving: data size 43847297
Fri 17 Jan 2014 22:17:14 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:17:15 - XML: Start document: iteration 9
Fri 17 Jan 2014 22:17:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:17:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:17:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:17:26 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:17:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:17:27 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 22:17:29 - XML: Processed 654868 elements - found 705 jobs
Fri 17 Jan 2014 22:17:30 - job 7348615 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 22:17:30 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 22:17:31 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 22:17:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:17:33 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:17:33 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 22:17:33 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:17:33 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:17:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:17:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:17:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:17:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:17:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:17:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:17:34 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:17:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:17:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:17:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:17:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:17:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:17:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:17:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:17:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:17:38 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:17:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43342672
Fri 17 Jan 2014 22:17:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:17:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43342672
Fri 17 Jan 2014 22:17:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:17:48 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:17:48 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:17:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:17:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:17:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:17:51 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:17:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:17:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:17:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:17:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 22:17:52 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:17:52 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:17:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 22:17:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6282 values 99443 bits 12430 bytes 
Fri 17 Jan 2014 22:17:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:17:52 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:17:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:17:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:17:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:17:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:17:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:17:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:17:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:17:54 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:17:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:17:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:17:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:17:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:17:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:17:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:17:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:17:58 - job_xml_thread(): Done retrieving: data size 43250258
Fri 17 Jan 2014 22:17:58 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:17:58 - XML: Start document: iteration 10
Fri 17 Jan 2014 22:17:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43250258
Fri 17 Jan 2014 22:17:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43250258
Fri 17 Jan 2014 22:17:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:17:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:18:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:18:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:18:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:18:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:18:11 - XML: Processed 647686 elements - found 705 jobs
Fri 17 Jan 2014 22:18:11 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:18:11 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:18:11 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:18:11 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:18:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:18:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:18:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:18:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:18:18 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:18:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 22:18:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:18:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:18:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:18:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:18:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:18:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:18:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:18:21 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:18:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:18:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:18:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:18:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:18:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:18:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:18:24 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:18:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43305465
Fri 17 Jan 2014 22:18:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:18:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43305465
Fri 17 Jan 2014 22:18:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:18:26 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:18:26 - job_xml_thread(): Done retrieving: data size 43305465
Fri 17 Jan 2014 22:18:26 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:18:26 - XML: Start document: iteration 11
Fri 17 Jan 2014 22:18:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:18:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:18:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:18:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:18:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:18:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:18:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:18:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:18:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:18:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:18:40 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:18:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:18:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:18:45 - XML: Processed 648164 elements - found 705 jobs
Fri 17 Jan 2014 22:18:46 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:18:46 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:18:46 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:18:46 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:18:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:18:46 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:18:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:18:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:18:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:18:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:18:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:18:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:18:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:18:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43834564
Fri 17 Jan 2014 22:18:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:18:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43834564
Fri 17 Jan 2014 22:18:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:18:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:18:53 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:18:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:18:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 22:18:55 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:18:55 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:18:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 22:18:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9194 values 145339 bits 18167 bytes 
Fri 17 Jan 2014 22:18:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:18:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:19:01 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:19:01 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:19:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:19:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:19:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:19:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:19:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:19:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:19:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:19:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:19:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:19:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:19:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:19:06 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:19:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:19:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:19:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:19:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:19:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:19:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:19:09 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:19:09 - job_xml_thread(): Done retrieving: data size 43886553
Fri 17 Jan 2014 22:19:09 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:19:09 - XML: Start document: iteration 12
Fri 17 Jan 2014 22:19:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43886553
Fri 17 Jan 2014 22:19:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43886553
Fri 17 Jan 2014 22:19:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:19:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:19:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:19:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:19:21 - XML: Processed 655614 elements - found 704 jobs
Fri 17 Jan 2014 22:19:21 - job 7348647 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 22:19:21 - job 7348575 appears to have finished
Fri 17 Jan 2014 22:19:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:19:21 - job 7348619 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 22:19:21 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 22:19:21 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 22:19:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:19:22 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 22:19:22 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:19:22 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:19:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:19:28 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:19:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:19:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:19:29 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:19:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:19:29 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:19:29 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:19:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:19:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:19:33 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:19:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:19:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:19:33 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:19:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 22:19:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:19:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:19:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:19:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:19:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:19:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:19:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873895
Fri 17 Jan 2014 22:19:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:19:37 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:19:37 - job_xml_thread(): Done retrieving: data size 43873895
Fri 17 Jan 2014 22:19:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873895
Fri 17 Jan 2014 22:19:37 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:19:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:19:37 - XML: Start document: iteration 13
Fri 17 Jan 2014 22:19:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:19:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:19:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:19:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:19:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:19:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:19:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:19:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:19:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:19:55 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:19:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:19:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:19:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:19:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:19:55 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:19:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:19:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 22:19:56 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:19:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5768 values 90986 bits 11373 bytes 
Fri 17 Jan 2014 22:19:56 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:19:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 22:20:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:20:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:20:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:20:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:20:01 - XML: Processed 655614 elements - found 704 jobs
Fri 17 Jan 2014 22:20:01 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:20:01 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:20:01 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:20:01 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:20:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:20:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:20:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:20:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:20:04 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:20:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43863161
Fri 17 Jan 2014 22:20:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:20:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43863161
Fri 17 Jan 2014 22:20:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:20:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:20:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:20:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:20:13 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:20:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:20:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:20:14 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:20:14 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:20:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:20:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:20:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43863161
Fri 17 Jan 2014 22:20:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:20:16 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:20:16 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:20:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:20:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:20:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:20:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:20:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:20:27 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:20:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:20:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:20:27 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:20:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 22:20:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:20:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:20:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:20:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:20:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:20:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:20:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:20:30 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:20:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:20:30 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:20:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:20:30 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:20:30 - job_xml_thread(): Done retrieving: data size 43872286
Fri 17 Jan 2014 22:20:30 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:20:30 - XML: Start document: iteration 14
Fri 17 Jan 2014 22:20:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43872286
Fri 17 Jan 2014 22:20:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:20:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43872286
Fri 17 Jan 2014 22:20:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:20:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:20:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:20:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:20:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:20:48 - XML: Processed 655612 elements - found 704 jobs
Fri 17 Jan 2014 22:20:48 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:20:48 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:20:48 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:20:48 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:20:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:20:50 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:20:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:20:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:20:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:20:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:20:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:20:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:20:52 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:20:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:20:53 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:20:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:20:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:20:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:20:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:20:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:20:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:20:55 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 22:20:55 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 22:20:55 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:20:56 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:20:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43918711
Fri 17 Jan 2014 22:20:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:20:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43918711
Fri 17 Jan 2014 22:20:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:20:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:20:56 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:21:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:21:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 22:21:00 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:21:00 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:21:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 22:21:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9046 values 142753 bits 17844 bytes 
Fri 17 Jan 2014 22:21:04 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:21:04 - job_xml_thread(): Done retrieving: data size 43918711
Fri 17 Jan 2014 22:21:04 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:21:04 - XML: Start document: iteration 15
Fri 17 Jan 2014 22:21:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:21:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:21:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:21:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:21:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:21:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:21:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:21:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:21:09 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:21:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:21:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:21:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:21:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:21:16 - XML: Processed 655610 elements - found 702 jobs
Fri 17 Jan 2014 22:21:16 - job 7348538 appears to have finished
Fri 17 Jan 2014 22:21:16 - job 7348542 appears to have finished
Fri 17 Jan 2014 22:21:16 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 22:21:16 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 22:21:18 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 22:21:18 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:21:18 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:21:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:21:19 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:21:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:21:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:21:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:21:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:21:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:21:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:21:21 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:21:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 22:21:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:21:21 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:21:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862252
Fri 17 Jan 2014 22:21:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:21:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862252
Fri 17 Jan 2014 22:21:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:21:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:21:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:21:33 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:21:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:21:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:21:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:21:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:21:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:21:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:21:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:21:35 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:21:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:21:35 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:21:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:21:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:21:36 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:21:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:21:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:21:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:21:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:21:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:21:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:21:37 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:21:37 - job_xml_thread(): Done retrieving: data size 43901260
Fri 17 Jan 2014 22:21:37 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:21:37 - XML: Start document: iteration 16
Fri 17 Jan 2014 22:21:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43901260
Fri 17 Jan 2014 22:21:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:21:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43901260
Fri 17 Jan 2014 22:21:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:21:51 - XML: Processed 655610 elements - found 702 jobs
Fri 17 Jan 2014 22:21:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:21:51 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:21:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:21:51 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:21:51 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:21:51 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:21:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:21:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:21:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:21:58 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:21:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:21:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:21:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:21:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:21:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:21:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:21:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:21:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:21:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:21:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:21:59 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:21:59 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:21:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:21:59 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:21:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:22:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:22:00 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:22:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:22:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 22:22:00 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:22:00 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:22:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 22:22:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99121 bits 12390 bytes 
Fri 17 Jan 2014 22:22:01 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:22:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43896942
Fri 17 Jan 2014 22:22:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:22:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43896942
Fri 17 Jan 2014 22:22:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:22:06 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:22:06 - job_xml_thread(): Done retrieving: data size 43896942
Fri 17 Jan 2014 22:22:06 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:22:06 - XML: Start document: iteration 17
Fri 17 Jan 2014 22:22:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:22:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:22:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:22:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:22:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:22:14 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:22:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:22:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:22:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:22:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:22:15 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:22:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:22:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:22:21 - XML: Processed 655610 elements - found 702 jobs
Fri 17 Jan 2014 22:22:21 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:22:21 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:22:21 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:22:21 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:22:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:22:23 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:22:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:22:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:22:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:22:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:22:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:22:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:22:25 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:22:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 22:22:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:22:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:22:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43887067
Fri 17 Jan 2014 22:22:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:22:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43887067
Fri 17 Jan 2014 22:22:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:22:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:22:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:22:36 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:22:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:22:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:22:36 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:22:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:22:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:22:37 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:22:37 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:22:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:22:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:22:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:22:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:22:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:22:40 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:22:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:22:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:22:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:22:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:22:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:22:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:22:41 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:22:41 - job_xml_thread(): Done retrieving: data size 43911943
Fri 17 Jan 2014 22:22:41 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:22:41 - XML: Start document: iteration 18
Fri 17 Jan 2014 22:22:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43911943
Fri 17 Jan 2014 22:22:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:22:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43911943
Fri 17 Jan 2014 22:22:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:22:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:22:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:22:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:22:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:22:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:22:56 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:22:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:22:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:22:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:22:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:22:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:22:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:22:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:23:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:23:02 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:23:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:23:03 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:23:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:23:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:23:04 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:23:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 22:23:04 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:23:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:23:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 22:23:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7039 values 111092 bits 13886 bytes 
Fri 17 Jan 2014 22:23:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:23:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:23:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:23:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:23:05 - XML: Processed 655609 elements - found 702 jobs
Fri 17 Jan 2014 22:23:05 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:23:05 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:23:05 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:23:05 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:23:08 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:23:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43881937
Fri 17 Jan 2014 22:23:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:23:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43881937
Fri 17 Jan 2014 22:23:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:23:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:23:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:23:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:23:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:23:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:23:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:23:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:23:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:23:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:23:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:23:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:23:19 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:23:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 22:23:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:23:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:23:20 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:23:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:23:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:23:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:23:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:23:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:23:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:23:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:23:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:23:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:23:24 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:23:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43833330
Fri 17 Jan 2014 22:23:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:23:24 - job_xml_thread(): Done retrieving: data size 43833330
Fri 17 Jan 2014 22:23:24 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:23:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43833330
Fri 17 Jan 2014 22:23:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:23:24 - XML: Start document: iteration 19
Fri 17 Jan 2014 22:23:29 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 22:23:29 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:23:31 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:23:31 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 22:23:31 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:23:31 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 22:23:31 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 22:23:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:23:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:23:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:23:36 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:23:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:23:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:23:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:23:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:23:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:23:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:23:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:23:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:23:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:23:43 - size of cluster 'LISA Cluster': 624 hosts 79480 metrics 783857 values 12375001 bits 1546875 bytes 
Fri 17 Jan 2014 22:23:43 - XML: Processed 654868 elements - found 705 jobs
Fri 17 Jan 2014 22:23:43 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 22:23:43 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 22:23:45 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 22:23:45 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:23:45 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:23:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:23:45 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:23:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:23:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:23:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:23:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:23:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:23:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:23:48 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:23:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43264189
Fri 17 Jan 2014 22:23:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:23:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43264189
Fri 17 Jan 2014 22:23:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:23:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:23:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:23:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:23:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:23:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:23:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:23:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:23:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:23:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:23:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:23:59 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:24:00 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:24:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:24:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:24:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:24:03 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:24:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:24:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:24:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:24:04 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:24:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:24:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 22:24:04 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:24:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:24:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9295 values 146609 bits 18326 bytes 
Fri 17 Jan 2014 22:24:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:24:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:24:04 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:24:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:24:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 22:24:07 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:24:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43224952
Fri 17 Jan 2014 22:24:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:24:07 - job_xml_thread(): Done retrieving: data size 43224952
Fri 17 Jan 2014 22:24:07 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:24:07 - XML: Start document: iteration 20
Fri 17 Jan 2014 22:24:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43224952
Fri 17 Jan 2014 22:24:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:24:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:24:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:24:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:24:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:24:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:24:21 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:24:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:24:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:24:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:24:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:24:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:24:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:24:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:24:29 - XML: Processed 647416 elements - found 705 jobs
Fri 17 Jan 2014 22:24:29 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:24:29 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:24:29 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:24:29 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:24:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:24:31 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:24:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:24:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:24:31 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:24:31 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 22:24:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:24:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:24:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:24:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:24:32 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:24:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 22:24:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:24:34 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:24:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43669325
Fri 17 Jan 2014 22:24:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:24:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43669325
Fri 17 Jan 2014 22:24:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:24:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:24:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:24:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:24:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:24:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:24:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:24:44 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:24:45 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:24:45 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:24:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:24:45 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:24:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:24:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:24:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:24:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:24:49 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:24:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:24:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:24:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:24:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:24:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:24:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:24:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:24:52 - job_xml_thread(): Done retrieving: data size 43820128
Fri 17 Jan 2014 22:24:52 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:24:52 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 22:24:52 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 22:24:52 - Housekeeping: done.
Fri 17 Jan 2014 22:24:52 - XML: Start document: iteration 0
Fri 17 Jan 2014 22:24:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43820128
Fri 17 Jan 2014 22:24:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43820128
Fri 17 Jan 2014 22:24:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:24:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:25:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:25:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:25:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:25:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:25:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:25:05 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:25:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:25:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 22:25:06 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:25:06 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:25:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 22:25:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7617 values 120130 bits 15016 bytes 
Fri 17 Jan 2014 22:25:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:25:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:25:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:25:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:25:11 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:25:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:25:11 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:25:11 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:25:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:25:13 - XML: Processed 654798 elements - found 705 jobs
Fri 17 Jan 2014 22:25:13 - job 7348630 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 22:25:13 - job 7348650 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 22:25:13 - job 7348646 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 22:25:13 - job 7348645 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 22:25:13 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 22:25:13 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 22:25:14 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 22:25:14 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:25:14 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:25:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:25:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:25:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:25:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:25:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:25:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:25:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:25:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:25:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:25:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865735
Fri 17 Jan 2014 22:25:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:25:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43865735
Fri 17 Jan 2014 22:25:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:25:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:25:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:25:29 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:25:29 - job_xml_thread(): Done retrieving: data size 43865735
Fri 17 Jan 2014 22:25:29 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:25:29 - XML: Start document: iteration 1
Fri 17 Jan 2014 22:25:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:25:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:25:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:25:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:25:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:25:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:25:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:25:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:25:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:25:34 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:25:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:25:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:25:37 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:25:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:25:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:25:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:25:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:25:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:25:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:25:41 - XML: Processed 655616 elements - found 705 jobs
Fri 17 Jan 2014 22:25:41 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:25:41 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:25:41 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:25:41 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:25:41 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:25:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 22:25:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:25:44 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:25:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43882722
Fri 17 Jan 2014 22:25:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:25:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43882722
Fri 17 Jan 2014 22:25:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:25:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:25:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:25:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:25:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:25:56 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:25:56 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:25:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:25:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:25:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:25:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:25:59 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:25:59 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:25:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:25:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:26:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:26:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:26:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:26:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:26:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:26:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:26:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:26:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:26:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:26:02 - job_xml_thread(): Done retrieving: data size 43882392
Fri 17 Jan 2014 22:26:02 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:26:02 - XML: Start document: iteration 2
Fri 17 Jan 2014 22:26:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43882392
Fri 17 Jan 2014 22:26:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43882392
Fri 17 Jan 2014 22:26:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:26:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:26:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:26:06 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:26:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:26:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 22:26:08 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:26:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 22:26:09 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:26:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8829 values 139203 bits 17400 bytes 
Fri 17 Jan 2014 22:26:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:26:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:26:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:26:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:26:16 - XML: Processed 655613 elements - found 705 jobs
Fri 17 Jan 2014 22:26:16 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:26:16 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:26:16 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:26:16 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:26:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:26:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:26:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:26:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:26:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:26:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:26:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:26:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:26:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:26:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:26:26 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:26:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:26:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:26:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:26:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:26:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:26:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:26:30 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:26:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43893691
Fri 17 Jan 2014 22:26:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:26:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43893691
Fri 17 Jan 2014 22:26:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:26:31 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:26:31 - job_xml_thread(): Done retrieving: data size 43893691
Fri 17 Jan 2014 22:26:31 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:26:31 - XML: Start document: iteration 3
Fri 17 Jan 2014 22:26:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:26:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:26:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:26:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:26:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:26:45 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:26:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:26:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:26:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:26:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:26:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:26:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:26:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:26:47 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:26:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 22:26:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:26:51 - XML: Processed 655616 elements - found 705 jobs
Fri 17 Jan 2014 22:26:52 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:26:52 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:26:52 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:26:52 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:26:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:26:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:26:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:26:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:26:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:26:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:26:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:26:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:26:57 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:26:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43889192
Fri 17 Jan 2014 22:26:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:26:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43889192
Fri 17 Jan 2014 22:26:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:27:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:27:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:27:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:27:06 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:27:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:27:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:27:07 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:27:07 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:27:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:27:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:27:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43889192
Fri 17 Jan 2014 22:27:07 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:27:07 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:27:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:27:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:27:09 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:27:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:27:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:27:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:27:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 22:27:10 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:27:10 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:27:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5946 values 93801 bits 11725 bytes 
Fri 17 Jan 2014 22:27:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 22:27:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:27:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:27:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:27:19 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:27:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:27:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:27:20 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 22:27:20 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 22:27:20 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:27:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:27:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:27:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:27:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:27:21 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:27:21 - job_xml_thread(): Done retrieving: data size 43861643
Fri 17 Jan 2014 22:27:21 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:27:21 - XML: Start document: iteration 4
Fri 17 Jan 2014 22:27:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:27:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:27:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43861643
Fri 17 Jan 2014 22:27:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:27:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:27:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:27:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43861643
Fri 17 Jan 2014 22:27:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:27:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:27:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:27:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:27:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:27:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:27:35 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:27:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:27:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:27:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:27:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:27:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:27:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:27:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:27:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:27:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:27:44 - XML: Processed 655616 elements - found 705 jobs
Fri 17 Jan 2014 22:27:44 - job 7348645 field 'start_timestamp' changed since saved from: 1389993873 to: 1389993840
Fri 17 Jan 2014 22:27:44 - job 7335204 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 22:27:44 - job 7347912 appears to have finished
Fri 17 Jan 2014 22:27:44 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 22:27:44 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 22:27:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:27:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:27:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:27:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:27:44 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 22:27:44 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:27:44 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:27:44 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:27:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 22:27:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:27:45 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:27:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:27:45 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:27:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:27:46 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:27:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43876915
Fri 17 Jan 2014 22:27:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:27:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43876915
Fri 17 Jan 2014 22:27:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:27:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:27:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:27:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:27:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:27:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:27:59 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:27:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:27:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:27:59 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:27:59 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:28:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:28:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:28:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:28:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:28:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:28:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:28:01 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:28:01 - job_xml_thread(): Done retrieving: data size 43896453
Fri 17 Jan 2014 22:28:01 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:28:01 - XML: Start document: iteration 5
Fri 17 Jan 2014 22:28:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43896453
Fri 17 Jan 2014 22:28:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:28:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:28:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:28:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:28:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:28:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43896453
Fri 17 Jan 2014 22:28:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:28:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:28:10 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:28:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:28:11 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:28:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 22:28:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 22:28:11 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:28:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9164 values 144629 bits 18078 bytes 
Fri 17 Jan 2014 22:28:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:28:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:28:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:28:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:28:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:28:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:28:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:28:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:28:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:28:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:28:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:28:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:28:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:28:24 - XML: Processed 655616 elements - found 705 jobs
Fri 17 Jan 2014 22:28:24 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:28:24 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:28:24 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:28:24 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:28:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:28:25 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:28:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:28:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:28:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:28:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:28:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:28:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:28:27 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:28:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43900716
Fri 17 Jan 2014 22:28:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:28:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43900716
Fri 17 Jan 2014 22:28:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:28:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:28:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:28:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:28:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:28:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:28:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:28:37 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:28:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:28:37 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:28:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43900716
Fri 17 Jan 2014 22:28:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:28:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:28:39 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:28:39 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:28:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:28:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:28:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:28:46 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:28:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:28:49 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:28:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:28:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:28:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:28:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:28:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:28:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:28:49 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:28:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 22:28:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:28:51 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:28:51 - job_xml_thread(): Done retrieving: data size 43871582
Fri 17 Jan 2014 22:28:51 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:28:51 - XML: Start document: iteration 6
Fri 17 Jan 2014 22:28:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43871582
Fri 17 Jan 2014 22:28:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:28:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:28:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:28:54 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:28:54 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:28:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:28:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43871582
Fri 17 Jan 2014 22:28:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:28:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:29:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:29:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:29:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:29:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:29:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:29:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:29:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:29:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:29:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:29:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:29:09 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:29:10 - XML: Processed 655618 elements - found 706 jobs
Fri 17 Jan 2014 22:29:10 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 22:29:10 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 22:29:10 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 22:29:10 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:29:10 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:29:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:29:11 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:29:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:29:12 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:29:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 22:29:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 22:29:12 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:29:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5508 values 86794 bits 10849 bytes 
Fri 17 Jan 2014 22:29:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:29:12 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:29:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:29:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:29:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:29:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:29:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:29:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:29:14 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:29:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43824250
Fri 17 Jan 2014 22:29:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:29:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43824250
Fri 17 Jan 2014 22:29:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:29:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:29:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:29:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:29:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:29:25 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:29:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:29:25 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:29:25 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:29:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:29:25 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:29:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:29:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:29:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:29:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:29:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:29:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:29:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:29:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:29:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:29:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:29:30 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:29:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 22:29:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:29:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:29:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43634516
Fri 17 Jan 2014 22:29:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:29:33 - job_xml_thread(): Done retrieving: data size 43634516
Fri 17 Jan 2014 22:29:33 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:29:33 - XML: Start document: iteration 7
Fri 17 Jan 2014 22:29:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43634516
Fri 17 Jan 2014 22:29:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:29:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:29:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:29:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:29:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:29:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:29:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:29:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:29:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:29:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:29:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:29:44 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:29:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:29:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:29:52 - XML: Processed 652678 elements - found 705 jobs
Fri 17 Jan 2014 22:29:52 - job 7335201 appears to have finished
Fri 17 Jan 2014 22:29:52 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 22:29:52 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 22:29:52 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 22:29:52 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:29:52 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:29:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:29:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:29:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:29:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:29:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:29:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:29:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:29:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:29:55 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:29:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43285452
Fri 17 Jan 2014 22:29:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:29:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43285452
Fri 17 Jan 2014 22:29:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:29:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:29:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:30:07 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:30:07 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:30:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:30:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:30:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:30:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:30:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:30:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:30:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:30:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:30:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:30:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:30:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:30:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:30:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:30:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:30:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:30:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:30:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:30:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:30:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:30:12 - job_xml_thread(): Done retrieving: data size 43265123
Fri 17 Jan 2014 22:30:12 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:30:12 - XML: Start document: iteration 8
Fri 17 Jan 2014 22:30:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43265123
Fri 17 Jan 2014 22:30:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:30:12 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:30:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:30:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43265123
Fri 17 Jan 2014 22:30:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:30:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:30:14 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:30:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 22:30:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 22:30:14 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:30:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8822 values 139077 bits 17384 bytes 
Fri 17 Jan 2014 22:30:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:30:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:30:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:30:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:30:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:30:27 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:30:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:30:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:30:29 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:30:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:30:29 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:30:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:30:29 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:30:31 - XML: Processed 647604 elements - found 705 jobs
Fri 17 Jan 2014 22:30:31 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 22:30:31 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:30:31 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:30:31 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:30:31 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:30:31 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:30:32 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:30:32 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 22:30:32 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 22:30:32 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:30:32 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 22:30:34 - size of cluster 'LISA Cluster': 624 hosts 79481 metrics 800508 values 12631081 bits 1578885 bytes 
Fri 17 Jan 2014 22:30:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:30:35 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:30:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:30:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:30:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:30:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:30:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:30:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:30:40 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:30:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43599645
Fri 17 Jan 2014 22:30:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:30:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43599645
Fri 17 Jan 2014 22:30:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:30:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:30:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:30:46 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:30:46 - job_xml_thread(): Done retrieving: data size 43599645
Fri 17 Jan 2014 22:30:46 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:30:47 - XML: Start document: iteration 9
Fri 17 Jan 2014 22:30:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:30:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:31:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:31:01 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:31:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:31:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:31:01 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:31:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 22:31:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:31:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:31:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:31:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:31:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:31:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:31:03 - XML: Processed 652022 elements - found 705 jobs
Fri 17 Jan 2014 22:31:04 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:31:04 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:31:04 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:31:04 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:31:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:31:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:31:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:31:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:31:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:31:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:31:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:31:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:31:08 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:31:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43900566
Fri 17 Jan 2014 22:31:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:31:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43900566
Fri 17 Jan 2014 22:31:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:31:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:31:14 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:31:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:31:16 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:31:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 22:31:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 22:31:16 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:31:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6156 values 97173 bits 12146 bytes 
Fri 17 Jan 2014 22:31:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:31:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:31:19 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:31:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:31:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:31:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:31:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:31:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:31:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:31:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:31:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:31:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:31:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:31:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:31:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:31:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:31:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:31:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:31:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:31:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:31:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:31:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:31:26 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:31:26 - job_xml_thread(): Done retrieving: data size 43907036
Fri 17 Jan 2014 22:31:26 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:31:26 - XML: Start document: iteration 10
Fri 17 Jan 2014 22:31:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43907036
Fri 17 Jan 2014 22:31:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43907036
Fri 17 Jan 2014 22:31:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:31:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:31:32 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:31:32 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 22:31:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:31:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:31:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:31:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:31:39 - XML: Processed 655614 elements - found 704 jobs
Fri 17 Jan 2014 22:31:40 - job 7348651 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 22:31:40 - job 7348667 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 22:31:40 - job 7346760 appears to have finished
Fri 17 Jan 2014 22:31:40 - job 7348619 appears to have finished
Fri 17 Jan 2014 22:31:40 - job_xml_thread(): Found 5 updated jobs.
Fri 17 Jan 2014 22:31:40 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 22:31:40 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Fri 17 Jan 2014 22:31:40 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:31:40 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:31:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:31:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:31:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:31:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:31:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:31:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:31:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:31:43 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:31:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:31:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:31:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:31:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:31:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:31:47 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:31:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 22:31:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:31:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:31:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:31:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:31:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:31:50 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:31:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43884096
Fri 17 Jan 2014 22:31:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:31:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43884096
Fri 17 Jan 2014 22:31:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:31:56 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:31:56 - job_xml_thread(): Done retrieving: data size 43884096
Fri 17 Jan 2014 22:31:56 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:31:56 - XML: Start document: iteration 11
Fri 17 Jan 2014 22:31:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:31:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:32:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:32:01 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:32:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:32:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:32:01 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:32:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:32:01 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:32:01 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:32:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:32:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:32:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:32:10 - XML: Processed 655614 elements - found 704 jobs
Fri 17 Jan 2014 22:32:10 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:32:10 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:32:10 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:32:10 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:32:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:32:13 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:32:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:32:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:32:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:32:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:32:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:32:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:32:16 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:32:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43863011
Fri 17 Jan 2014 22:32:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:32:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:32:16 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:32:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:32:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:32:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43863011
Fri 17 Jan 2014 22:32:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:32:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:32:17 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:32:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 22:32:17 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:32:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 22:32:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8889 values 140552 bits 17569 bytes 
Fri 17 Jan 2014 22:32:26 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:32:26 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:32:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:32:28 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:32:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:32:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:32:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:32:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:32:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:32:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:32:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:32:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:32:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:32:33 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:32:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:32:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:32:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:32:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:32:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:32:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:32:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:32:37 - job_xml_thread(): Done retrieving: data size 43883396
Fri 17 Jan 2014 22:32:37 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:32:37 - XML: Start document: iteration 12
Fri 17 Jan 2014 22:32:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43883396
Fri 17 Jan 2014 22:32:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:32:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43883396
Fri 17 Jan 2014 22:32:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:32:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:32:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:32:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:32:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:32:57 - XML: Processed 655614 elements - found 704 jobs
Fri 17 Jan 2014 22:32:57 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:32:57 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:32:57 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:32:57 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:33:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:33:00 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:33:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:33:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:33:01 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:33:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:33:01 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:33:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:33:01 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:33:01 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:33:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 22:33:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:33:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:33:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:33:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:33:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:33:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:33:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:33:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:33:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:33:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:33:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43904749
Fri 17 Jan 2014 22:33:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:33:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43904749
Fri 17 Jan 2014 22:33:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:33:12 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:33:12 - job_xml_thread(): Done retrieving: data size 43904749
Fri 17 Jan 2014 22:33:12 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:33:12 - XML: Start document: iteration 13
Fri 17 Jan 2014 22:33:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:33:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:33:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:33:16 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:33:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:33:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:33:17 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:33:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:33:17 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:33:17 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:33:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:33:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:33:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:33:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:33:17 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:33:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:33:18 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:33:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 22:33:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 22:33:18 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:33:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5921 values 93698 bits 11712 bytes 
Fri 17 Jan 2014 22:33:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:33:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:33:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:33:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:33:29 - XML: Processed 655614 elements - found 704 jobs
Fri 17 Jan 2014 22:33:29 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:33:29 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:33:29 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:33:29 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:33:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:33:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:33:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:33:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:33:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:33:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:33:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:33:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858899
Fri 17 Jan 2014 22:33:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:33:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43858899
Fri 17 Jan 2014 22:33:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:33:44 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:33:44 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:33:44 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:33:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 22:33:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:33:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:33:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:33:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:33:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:33:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:33:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:33:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:33:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:33:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:33:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:33:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:33:49 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:33:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:33:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:33:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:33:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:33:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:33:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:33:51 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 22:33:51 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 22:33:51 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:33:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:33:52 - job_xml_thread(): Done retrieving: data size 43890731
Fri 17 Jan 2014 22:33:52 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:33:52 - XML: Start document: iteration 14
Fri 17 Jan 2014 22:33:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43890731
Fri 17 Jan 2014 22:33:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:33:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43890731
Fri 17 Jan 2014 22:33:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:34:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:34:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:34:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:34:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:34:07 - XML: Processed 655613 elements - found 704 jobs
Fri 17 Jan 2014 22:34:07 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:34:07 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:34:08 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:34:08 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:34:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:34:09 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:34:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:34:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:34:11 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:34:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:34:11 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:34:11 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:34:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:34:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:34:12 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:34:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:34:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:34:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:34:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:34:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:34:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:34:14 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:34:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43884594
Fri 17 Jan 2014 22:34:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:34:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43884594
Fri 17 Jan 2014 22:34:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:34:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:34:18 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:34:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:34:19 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:34:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 22:34:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 22:34:19 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:34:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9112 values 143856 bits 17982 bytes 
Fri 17 Jan 2014 22:34:23 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:34:23 - job_xml_thread(): Done retrieving: data size 43884594
Fri 17 Jan 2014 22:34:23 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:34:23 - XML: Start document: iteration 15
Fri 17 Jan 2014 22:34:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:34:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:34:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:34:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:34:26 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:34:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:34:26 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:34:26 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:34:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:34:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:34:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:34:34 - XML: Processed 655614 elements - found 704 jobs
Fri 17 Jan 2014 22:34:34 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:34:34 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:34:34 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:34:34 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:34:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:34:37 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:34:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:34:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:34:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:34:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:34:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:34:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:34:39 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:34:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43885487
Fri 17 Jan 2014 22:34:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:34:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43885487
Fri 17 Jan 2014 22:34:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:34:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:34:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:34:49 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:34:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:34:49 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:34:49 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:34:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:34:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:34:50 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:34:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:34:50 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:34:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:34:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:34:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:34:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:34:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:34:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:34:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:34:54 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:34:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 22:34:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:34:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:34:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:34:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:34:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:34:55 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:34:55 - job_xml_thread(): Done retrieving: data size 43905312
Fri 17 Jan 2014 22:34:55 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:34:55 - XML: Start document: iteration 16
Fri 17 Jan 2014 22:34:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43905312
Fri 17 Jan 2014 22:34:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43905312
Fri 17 Jan 2014 22:34:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:34:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:35:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:35:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:35:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:35:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:35:15 - XML: Processed 655609 elements - found 703 jobs
Fri 17 Jan 2014 22:35:15 - job 7348546 appears to have finished
Fri 17 Jan 2014 22:35:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:35:15 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 22:35:15 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 22:35:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:35:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:35:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:35:16 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:35:17 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:35:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:35:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:35:17 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:35:17 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 22:35:17 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:35:17 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:35:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:35:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:35:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:35:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:35:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:35:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:35:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:35:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:35:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:35:19 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:35:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:35:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43837163
Fri 17 Jan 2014 22:35:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:35:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43837163
Fri 17 Jan 2014 22:35:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:35:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:35:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 22:35:20 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:35:20 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:35:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5875 values 92699 bits 11587 bytes 
Fri 17 Jan 2014 22:35:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 22:35:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:35:28 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:35:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:35:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:35:32 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:35:32 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:35:32 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:35:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:35:32 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:35:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:35:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:35:33 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:35:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:35:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:35:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:35:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:35:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:35:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:35:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:35:35 - job_xml_thread(): Done retrieving: data size 43330156
Fri 17 Jan 2014 22:35:35 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:35:35 - XML: Start document: iteration 17
Fri 17 Jan 2014 22:35:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43330156
Fri 17 Jan 2014 22:35:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:35:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43330156
Fri 17 Jan 2014 22:35:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:35:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:35:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:35:49 - XML: Processed 648524 elements - found 703 jobs
Fri 17 Jan 2014 22:35:49 - job 7348386 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 22:35:49 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 22:35:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:35:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:35:49 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 22:35:51 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 22:35:51 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:35:51 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:35:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:35:54 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:35:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:35:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:35:55 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:35:55 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:35:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:35:55 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:35:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:35:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:35:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:35:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:35:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:35:59 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:35:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 22:35:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:35:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:35:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:35:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:35:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:36:00 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:36:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43222375
Fri 17 Jan 2014 22:36:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:36:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43222375
Fri 17 Jan 2014 22:36:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:36:06 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:36:06 - job_xml_thread(): Done retrieving: data size 43222375
Fri 17 Jan 2014 22:36:06 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:36:07 - XML: Start document: iteration 18
Fri 17 Jan 2014 22:36:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:36:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:36:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:36:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:36:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:36:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:36:14 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:36:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:36:14 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:36:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:36:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:36:14 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:36:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:36:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:36:20 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:36:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:36:21 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:36:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:36:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:36:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:36:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:36:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:36:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:36:21 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:36:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:36:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 22:36:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 22:36:22 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:36:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5683 values 89612 bits 11201 bytes 
Fri 17 Jan 2014 22:36:22 - XML: Processed 647412 elements - found 703 jobs
Fri 17 Jan 2014 22:36:22 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:36:22 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:36:22 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:36:22 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:36:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:36:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43303214
Fri 17 Jan 2014 22:36:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:36:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43303214
Fri 17 Jan 2014 22:36:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:36:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:36:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:36:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:36:34 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:36:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:36:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:36:35 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:36:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:36:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43303214
Fri 17 Jan 2014 22:36:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:36:35 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:36:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:36:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:36:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:36:37 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:36:37 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:36:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:36:45 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:36:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:36:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:36:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:36:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:36:47 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:36:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 22:36:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:36:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:36:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:36:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:36:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:36:48 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:36:49 - job_xml_thread(): Done retrieving: data size 43796170
Fri 17 Jan 2014 22:36:49 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:36:49 - XML: Start document: iteration 19
Fri 17 Jan 2014 22:36:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43796170
Fri 17 Jan 2014 22:36:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:36:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:36:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:36:50 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:36:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:36:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43796170
Fri 17 Jan 2014 22:36:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:36:50 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:36:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:37:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:37:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:37:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:37:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:37:05 - XML: Processed 654712 elements - found 703 jobs
Fri 17 Jan 2014 22:37:05 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:37:05 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:37:05 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:37:05 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:37:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:37:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:37:07 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:37:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:37:07 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:37:07 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:37:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:37:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:37:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:37:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:37:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:37:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:37:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:37:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:37:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:37:10 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:37:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43910921
Fri 17 Jan 2014 22:37:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:37:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43910921
Fri 17 Jan 2014 22:37:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:37:20 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:37:20 - job_xml_thread(): Done retrieving: data size 43910921
Fri 17 Jan 2014 22:37:20 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:37:21 - XML: Start document: iteration 20
Fri 17 Jan 2014 22:37:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:37:21 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:37:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:37:22 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:37:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:37:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:37:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:37:22 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:37:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 22:37:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 22:37:22 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:37:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8977 values 141610 bits 17701 bytes 
Fri 17 Jan 2014 22:37:23 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:37:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:37:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:37:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:37:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:37:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:37:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:37:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:37:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:37:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:37:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:37:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:37:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:37:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:37:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:37:32 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 22:37:32 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:37:32 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:37:32 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 22:37:32 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 22:37:32 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:37:32 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 22:37:33 - XML: Processed 655612 elements - found 703 jobs
Fri 17 Jan 2014 22:37:33 - job 7346725 appears to have finished
Fri 17 Jan 2014 22:37:33 - job 7348544 appears to have finished
Fri 17 Jan 2014 22:37:33 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 22:37:33 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 22:37:33 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 22:37:33 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:37:33 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:37:34 - size of cluster 'LISA Cluster': 624 hosts 79485 metrics 879657 values 13899173 bits 1737396 bytes 
Fri 17 Jan 2014 22:37:37 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:37:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43872423
Fri 17 Jan 2014 22:37:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:37:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43872423
Fri 17 Jan 2014 22:37:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:37:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:37:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:37:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:37:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:37:48 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:37:48 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:37:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:37:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:37:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:37:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:37:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:37:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:37:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:37:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:37:52 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:37:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 22:37:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:37:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:37:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:37:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:37:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:37:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:37:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:37:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:37:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:37:57 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:37:57 - job_xml_thread(): Done retrieving: data size 43896382
Fri 17 Jan 2014 22:37:57 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:37:57 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 22:37:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43896382
Fri 17 Jan 2014 22:37:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:37:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43896382
Fri 17 Jan 2014 22:37:57 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 22:37:57 - Housekeeping: done.
Fri 17 Jan 2014 22:37:57 - XML: Start document: iteration 0
Fri 17 Jan 2014 22:37:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:38:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:38:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:38:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:38:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:38:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:38:16 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:38:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:38:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:38:16 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:38:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:38:16 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:38:16 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:38:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:38:17 - XML: Processed 655612 elements - found 703 jobs
Fri 17 Jan 2014 22:38:17 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:38:17 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:38:17 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:38:17 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:38:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:38:21 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:38:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:38:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:38:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:38:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:38:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:38:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:38:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:38:22 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:38:23 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:38:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 22:38:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:38:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 22:38:23 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:38:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5997 values 94639 bits 11829 bytes 
Fri 17 Jan 2014 22:38:24 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:38:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43904550
Fri 17 Jan 2014 22:38:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:38:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43904550
Fri 17 Jan 2014 22:38:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:38:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:38:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:38:32 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:38:32 - job_xml_thread(): Done retrieving: data size 43904550
Fri 17 Jan 2014 22:38:32 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:38:32 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:38:32 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 22:38:32 - XML: Start document: iteration 1
Fri 17 Jan 2014 22:38:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:38:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:38:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:38:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:38:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:38:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:38:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43904550
Fri 17 Jan 2014 22:38:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:38:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:38:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:38:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:38:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:38:48 - XML: Processed 655612 elements - found 703 jobs
Fri 17 Jan 2014 22:38:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:38:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:38:49 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:38:49 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:38:49 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:38:49 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:38:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:38:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:38:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:38:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:38:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:38:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:38:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:38:52 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:38:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:38:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:38:55 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:38:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:38:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:38:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:38:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:38:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:38:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:38:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:38:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43898129
Fri 17 Jan 2014 22:38:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:38:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43898129
Fri 17 Jan 2014 22:38:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:39:04 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:39:04 - job_xml_thread(): Done retrieving: data size 43898129
Fri 17 Jan 2014 22:39:04 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:39:04 - XML: Start document: iteration 2
Fri 17 Jan 2014 22:39:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:39:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:39:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:39:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:39:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:39:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:39:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:39:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:39:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:39:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:39:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:39:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:39:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:39:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:39:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:39:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:39:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:39:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:39:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:39:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:39:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:39:21 - XML: Processed 655612 elements - found 703 jobs
Fri 17 Jan 2014 22:39:21 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:39:21 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:39:21 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:39:21 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:39:21 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:39:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 22:39:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:39:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:39:23 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:39:24 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:39:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43886272
Fri 17 Jan 2014 22:39:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:39:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43886272
Fri 17 Jan 2014 22:39:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:39:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:39:24 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:39:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 22:39:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 22:39:25 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:39:25 - size of cluster 'Render Cluster': 20 hosts 3138 metrics 3304 values 52086 bits 6510 bytes 
Fri 17 Jan 2014 22:39:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:39:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:39:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:39:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:39:36 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:39:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:39:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:39:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:39:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:39:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:39:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:39:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:39:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:39:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:39:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:39:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:39:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:39:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:39:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:39:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:39:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:39:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:39:46 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:39:46 - job_xml_thread(): Done retrieving: data size 43870673
Fri 17 Jan 2014 22:39:46 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:39:46 - XML: Start document: iteration 3
Fri 17 Jan 2014 22:39:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870673
Fri 17 Jan 2014 22:39:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:39:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870673
Fri 17 Jan 2014 22:39:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:39:49 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:39:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 22:39:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:39:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:39:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:39:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:39:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:39:57 - XML: Processed 655612 elements - found 703 jobs
Fri 17 Jan 2014 22:39:57 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:39:57 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:39:57 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:39:57 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:40:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:40:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:40:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:40:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:40:06 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:40:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:40:06 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:40:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:40:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:40:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:40:08 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:40:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:40:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:40:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:40:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:40:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:40:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:40:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:40:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43890024
Fri 17 Jan 2014 22:40:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:40:12 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:40:12 - job_xml_thread(): Done retrieving: data size 43890024
Fri 17 Jan 2014 22:40:12 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:40:12 - XML: Start document: iteration 4
Fri 17 Jan 2014 22:40:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43890024
Fri 17 Jan 2014 22:40:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:40:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:40:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:40:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:40:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:40:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:40:25 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:40:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:40:25 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:40:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 22:40:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 22:40:25 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:40:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99080 bits 12385 bytes 
Fri 17 Jan 2014 22:40:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:40:28 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:40:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:40:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:40:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:40:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:40:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:40:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:40:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:40:30 - XML: Processed 655612 elements - found 703 jobs
Fri 17 Jan 2014 22:40:31 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:40:31 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:40:31 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:40:31 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:40:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:40:37 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:40:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:40:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:40:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:40:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:40:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:40:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:40:40 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:40:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43888309
Fri 17 Jan 2014 22:40:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43888309
Fri 17 Jan 2014 22:40:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:40:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:40:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:40:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:40:46 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:40:46 - job_xml_thread(): Done retrieving: data size 43888309
Fri 17 Jan 2014 22:40:46 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:40:46 - XML: Start document: iteration 5
Fri 17 Jan 2014 22:40:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:40:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:40:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:41:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:41:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:41:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:41:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:41:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:41:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:41:01 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:41:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:41:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:41:03 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:41:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:41:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:41:04 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:41:04 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:41:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:41:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:41:05 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:41:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 22:41:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:41:05 - XML: Processed 655612 elements - found 703 jobs
Fri 17 Jan 2014 22:41:05 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:41:05 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:41:05 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:41:05 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:41:08 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:41:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43898796
Fri 17 Jan 2014 22:41:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:41:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43898796
Fri 17 Jan 2014 22:41:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:41:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:41:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:41:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:41:19 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:41:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:41:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:41:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:41:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:41:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:41:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:41:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:41:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:41:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:41:20 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:41:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:41:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:41:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:41:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:41:23 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:41:23 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:41:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:41:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:41:24 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 22:41:24 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 22:41:24 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:41:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:41:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43844668
Fri 17 Jan 2014 22:41:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:41:25 - job_xml_thread(): Done retrieving: data size 43844668
Fri 17 Jan 2014 22:41:25 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:41:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:41:25 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:41:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43844668
Fri 17 Jan 2014 22:41:25 - XML: Start document: iteration 6
Fri 17 Jan 2014 22:41:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:41:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:41:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 22:41:27 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:41:27 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:41:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Fri 17 Jan 2014 22:41:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:41:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:41:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:41:38 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:41:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:41:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:41:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:41:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:41:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:41:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:41:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:41:44 - XML: Processed 654864 elements - found 703 jobs
Fri 17 Jan 2014 22:41:44 - job 7348652 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 22:41:44 - job 7348655 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 22:41:44 - job 7348656 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 22:41:44 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 22:41:44 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 22:41:45 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 22:41:45 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:41:45 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:41:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:41:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:41:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:41:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:41:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:41:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:41:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:41:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:41:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:41:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43280845
Fri 17 Jan 2014 22:41:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:41:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43280845
Fri 17 Jan 2014 22:41:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:41:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:41:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:42:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:42:00 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:42:00 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:42:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:42:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:42:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:42:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:42:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:42:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:42:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:42:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:42:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:42:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:42:03 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:42:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:42:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:42:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:42:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:42:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:42:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:42:04 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:42:04 - job_xml_thread(): Done retrieving: data size 43241855
Fri 17 Jan 2014 22:42:04 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:42:04 - XML: Start document: iteration 7
Fri 17 Jan 2014 22:42:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43241855
Fri 17 Jan 2014 22:42:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:42:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43241855
Fri 17 Jan 2014 22:42:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:42:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:42:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:42:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:42:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:42:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:42:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:42:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:42:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:42:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:42:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:42:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:42:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:42:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:42:24 - XML: Processed 647412 elements - found 703 jobs
Fri 17 Jan 2014 22:42:24 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:42:24 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:42:24 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:42:24 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:42:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:42:25 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:42:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:42:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:42:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:42:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:42:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:42:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:42:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:42:27 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:42:27 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:42:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43374108
Fri 17 Jan 2014 22:42:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:42:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43374108
Fri 17 Jan 2014 22:42:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:42:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:42:29 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:42:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 22:42:29 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:42:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 22:42:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 15473 values 244071 bits 30508 bytes 
Fri 17 Jan 2014 22:42:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:42:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:42:39 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:42:39 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:42:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:42:40 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:42:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:42:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:42:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:42:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:42:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:42:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:42:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:42:42 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:42:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:42:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:42:42 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:42:42 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:42:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:42:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:42:44 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:42:44 - job_xml_thread(): Done retrieving: data size 43807039
Fri 17 Jan 2014 22:42:44 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:42:44 - XML: Start document: iteration 8
Fri 17 Jan 2014 22:42:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43807039
Fri 17 Jan 2014 22:42:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43807039
Fri 17 Jan 2014 22:42:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:42:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:42:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:42:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:42:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:42:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:43:02 - XML: Processed 654702 elements - found 703 jobs
Fri 17 Jan 2014 22:43:02 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:43:02 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:43:02 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:43:02 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:43:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:43:03 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:43:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:43:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:43:04 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:43:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:43:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:43:05 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:43:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:43:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:43:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:43:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:43:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:43:09 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:43:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 22:43:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:43:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:43:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:43:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:43:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:43:10 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:43:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43910307
Fri 17 Jan 2014 22:43:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:43:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43910307
Fri 17 Jan 2014 22:43:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:43:17 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:43:17 - job_xml_thread(): Done retrieving: data size 43910307
Fri 17 Jan 2014 22:43:17 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:43:18 - XML: Start document: iteration 9
Fri 17 Jan 2014 22:43:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:43:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:43:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:43:21 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:43:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:43:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:43:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:43:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:43:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:43:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:43:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:43:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:43:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:43:28 - XML: Processed 655611 elements - found 703 jobs
Fri 17 Jan 2014 22:43:28 - job 7348540 appears to have finished
Fri 17 Jan 2014 22:43:28 - job 7348657 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 22:43:28 - job 7346000 appears to have finished
Fri 17 Jan 2014 22:43:28 - job_xml_thread(): Found 5 updated jobs.
Fri 17 Jan 2014 22:43:28 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 22:43:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:43:29 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:43:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:43:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 22:43:29 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:43:29 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:43:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 22:43:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6055 values 95535 bits 11941 bytes 
Fri 17 Jan 2014 22:43:29 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Fri 17 Jan 2014 22:43:29 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:43:29 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:43:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:43:31 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:43:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:43:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:43:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:43:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:43:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:43:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:43:34 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:43:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43866237
Fri 17 Jan 2014 22:43:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:43:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43866237
Fri 17 Jan 2014 22:43:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:43:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:43:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:43:44 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:43:44 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:43:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:43:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:43:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:43:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:43:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:43:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:43:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:43:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:43:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:43:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:43:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:43:48 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:43:48 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:43:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 22:43:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:43:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:43:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:43:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:43:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:43:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:43:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:43:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:43:49 - job_xml_thread(): Done retrieving: data size 43884256
Fri 17 Jan 2014 22:43:49 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:43:49 - XML: Start document: iteration 10
Fri 17 Jan 2014 22:43:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43884256
Fri 17 Jan 2014 22:43:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43884256
Fri 17 Jan 2014 22:43:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:43:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:44:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:44:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:44:04 - XML: Processed 655612 elements - found 703 jobs
Fri 17 Jan 2014 22:44:04 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:44:04 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:44:04 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:44:04 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:44:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:44:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:44:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:44:07 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:44:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:44:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:44:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:44:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:44:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:44:09 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:44:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:44:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:44:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:44:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:44:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:44:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:44:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:44:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:44:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:44:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:44:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43892086
Fri 17 Jan 2014 22:44:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43892086
Fri 17 Jan 2014 22:44:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:44:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:44:19 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:44:19 - job_xml_thread(): Done retrieving: data size 43892086
Fri 17 Jan 2014 22:44:19 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:44:19 - XML: Start document: iteration 11
Fri 17 Jan 2014 22:44:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:44:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:44:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:44:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:44:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:44:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:44:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:44:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:44:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:44:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:44:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:44:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:44:29 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:44:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:44:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 22:44:30 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:44:30 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:44:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 22:44:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9139 values 144189 bits 18023 bytes 
Fri 17 Jan 2014 22:44:32 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 22:44:32 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:44:33 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:44:33 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 22:44:33 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 22:44:33 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:44:33 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 22:44:34 - XML: Processed 655612 elements - found 703 jobs
Fri 17 Jan 2014 22:44:34 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:44:34 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:44:35 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:44:35 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:44:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:44:36 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:44:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:44:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:44:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:44:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:44:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:44:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:44:36 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 853025 values 13463994 bits 1682999 bytes 
Fri 17 Jan 2014 22:44:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:44:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:44:40 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:44:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875188
Fri 17 Jan 2014 22:44:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:44:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875188
Fri 17 Jan 2014 22:44:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:44:50 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:44:50 - job_xml_thread(): Done retrieving: data size 43875188
Fri 17 Jan 2014 22:44:50 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:44:50 - XML: Start document: iteration 12
Fri 17 Jan 2014 22:44:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:44:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:44:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:44:58 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:44:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:44:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:44:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:44:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:44:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:44:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:44:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:45:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:45:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:45:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:45:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:45:05 - XML: Processed 655612 elements - found 703 jobs
Fri 17 Jan 2014 22:45:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:45:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:45:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:45:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:45:05 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:45:05 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:45:05 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:45:05 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:45:05 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:45:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 22:45:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:45:07 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:45:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43887362
Fri 17 Jan 2014 22:45:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:45:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43887362
Fri 17 Jan 2014 22:45:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:45:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:45:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:45:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:45:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:45:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:45:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:45:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:45:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:45:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:45:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:45:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:45:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:45:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:45:20 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:45:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:45:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:45:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:45:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:45:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:45:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:45:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:45:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:45:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:45:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43907433
Fri 17 Jan 2014 22:45:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:45:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43907433
Fri 17 Jan 2014 22:45:25 - job_xml_thread(): Done retrieving: data size 43907433
Fri 17 Jan 2014 22:45:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:45:25 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:45:25 - XML: Start document: iteration 13
Fri 17 Jan 2014 22:45:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:45:31 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:45:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:45:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 22:45:33 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:45:33 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:45:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8505 values 134072 bits 16759 bytes 
Fri 17 Jan 2014 22:45:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 22:45:33 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:45:33 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 22:45:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:45:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:45:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:45:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:45:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:45:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:45:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:45:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:45:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:45:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:45:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:45:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:45:44 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:45:45 - XML: Processed 655610 elements - found 702 jobs
Fri 17 Jan 2014 22:45:45 - job 7348541 appears to have finished
Fri 17 Jan 2014 22:45:45 - job 7348658 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 22:45:45 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 22:45:45 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 22:45:46 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 22:45:46 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:45:46 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:45:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:45:49 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:45:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:45:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:45:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:45:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:45:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:45:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:45:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:45:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43889447
Fri 17 Jan 2014 22:45:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:45:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43889447
Fri 17 Jan 2014 22:45:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:45:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:45:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:46:01 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:46:01 - job_xml_thread(): Done retrieving: data size 43889447
Fri 17 Jan 2014 22:46:01 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:46:01 - XML: Start document: iteration 14
Fri 17 Jan 2014 22:46:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:46:01 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:46:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:46:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:46:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:46:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:46:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:46:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:46:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43889447
Fri 17 Jan 2014 22:46:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:46:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:46:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:46:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:46:15 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:46:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:46:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:46:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:46:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:46:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:46:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:46:16 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:46:16 - XML: Processed 655610 elements - found 702 jobs
Fri 17 Jan 2014 22:46:17 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:46:17 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:46:17 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:46:17 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:46:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:46:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:46:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:46:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:46:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:46:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:46:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:46:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:46:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:46:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:46:19 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:46:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 22:46:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:46:22 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:46:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43897950
Fri 17 Jan 2014 22:46:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:46:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43897950
Fri 17 Jan 2014 22:46:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:46:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:46:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:46:32 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:46:32 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:46:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:46:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:46:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:46:33 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:46:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:46:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:46:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:46:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 22:46:34 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:46:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 22:46:34 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:46:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:46:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:46:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:46:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6058 values 95679 bits 11959 bytes 
Fri 17 Jan 2014 22:46:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:46:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:46:36 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:46:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:46:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:46:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:46:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:46:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:46:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:46:39 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:46:39 - job_xml_thread(): Done retrieving: data size 43910729
Fri 17 Jan 2014 22:46:39 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:46:39 - XML: Start document: iteration 15
Fri 17 Jan 2014 22:46:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43910729
Fri 17 Jan 2014 22:46:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:46:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43910729
Fri 17 Jan 2014 22:46:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:46:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:46:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:46:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:46:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:46:57 - XML: Processed 655610 elements - found 702 jobs
Fri 17 Jan 2014 22:46:58 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:46:58 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:46:58 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:46:58 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:47:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:47:00 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:47:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:47:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:47:01 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:47:01 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:47:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:47:01 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:47:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:47:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:47:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:47:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:47:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:47:04 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:47:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 22:47:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:47:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:47:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:47:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:47:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:47:06 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:47:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43904985
Fri 17 Jan 2014 22:47:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:47:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43904985
Fri 17 Jan 2014 22:47:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:47:13 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:47:13 - job_xml_thread(): Done retrieving: data size 43904985
Fri 17 Jan 2014 22:47:13 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:47:13 - XML: Start document: iteration 16
Fri 17 Jan 2014 22:47:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:47:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:47:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:47:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:47:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:47:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:47:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:47:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:47:25 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:47:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:47:25 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:47:25 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:47:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:47:28 - XML: Processed 655610 elements - found 702 jobs
Fri 17 Jan 2014 22:47:28 - job 7348547 appears to have finished
Fri 17 Jan 2014 22:47:28 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 22:47:28 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 22:47:28 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 22:47:28 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:47:28 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:47:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:47:30 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:47:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:47:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:47:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:47:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:47:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:47:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:47:34 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:47:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43645851
Fri 17 Jan 2014 22:47:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:47:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:47:34 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:47:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43645851
Fri 17 Jan 2014 22:47:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:47:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:47:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 22:47:35 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:47:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9021 values 142681 bits 17835 bytes 
Fri 17 Jan 2014 22:47:35 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:47:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 22:47:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:47:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:47:43 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:47:43 - job_xml_thread(): Done retrieving: data size 43645851
Fri 17 Jan 2014 22:47:43 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:47:43 - XML: Start document: iteration 17
Fri 17 Jan 2014 22:47:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:47:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:47:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:47:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:47:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:47:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:47:49 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:47:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:47:49 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:47:49 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:47:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:47:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:47:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:47:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:47:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:47:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:47:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:47:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:47:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:47:57 - XML: Processed 652808 elements - found 702 jobs
Fri 17 Jan 2014 22:47:57 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:47:57 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:47:57 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:47:57 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:48:00 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:48:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43214753
Fri 17 Jan 2014 22:48:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:48:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43214753
Fri 17 Jan 2014 22:48:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:48:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:48:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:48:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:48:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:48:12 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:48:12 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:48:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:48:13 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:48:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:48:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:48:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:48:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:48:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:48:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:48:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:48:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:48:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:48:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:48:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:48:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:48:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:48:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:48:16 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:48:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 22:48:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:48:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:48:19 - job_xml_thread(): Done retrieving: data size 43285055
Fri 17 Jan 2014 22:48:19 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:48:19 - XML: Start document: iteration 18
Fri 17 Jan 2014 22:48:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43285055
Fri 17 Jan 2014 22:48:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43285055
Fri 17 Jan 2014 22:48:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:48:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:48:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:48:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:48:31 - XML: Processed 648158 elements - found 702 jobs
Fri 17 Jan 2014 22:48:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:48:31 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:48:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:48:31 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:48:31 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:48:31 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:48:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:48:36 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:48:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:48:38 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:48:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 22:48:38 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:48:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 22:48:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5588 values 88272 bits 11034 bytes 
Fri 17 Jan 2014 22:48:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:48:38 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:48:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:48:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:48:39 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:48:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:48:39 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:48:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:48:39 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:48:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:48:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:48:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:48:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:48:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:48:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:48:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:48:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:48:43 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 22:48:43 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 22:48:43 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:48:44 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:48:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43782358
Fri 17 Jan 2014 22:48:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:48:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43782358
Fri 17 Jan 2014 22:48:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:48:46 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:48:46 - job_xml_thread(): Done retrieving: data size 43782358
Fri 17 Jan 2014 22:48:46 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:48:46 - XML: Start document: iteration 19
Fri 17 Jan 2014 22:48:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:48:54 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:48:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:48:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:48:56 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:48:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:48:56 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:48:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:48:56 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:48:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:48:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:48:59 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:48:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 22:48:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:49:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:49:01 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:49:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:49:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:49:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:49:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:49:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:49:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:49:04 - XML: Processed 654352 elements - found 702 jobs
Fri 17 Jan 2014 22:49:04 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:49:04 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:49:04 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:49:04 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:49:06 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:49:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43878204
Fri 17 Jan 2014 22:49:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:49:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43878204
Fri 17 Jan 2014 22:49:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:49:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:49:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:49:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:49:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:49:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:49:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:49:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:49:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:49:19 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:49:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:49:20 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:49:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:49:20 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:49:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:49:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:49:21 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:49:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:49:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:49:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:49:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:49:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:49:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:49:23 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:49:23 - job_xml_thread(): Done retrieving: data size 43906175
Fri 17 Jan 2014 22:49:23 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:49:23 - XML: Start document: iteration 20
Fri 17 Jan 2014 22:49:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43906175
Fri 17 Jan 2014 22:49:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43906175
Fri 17 Jan 2014 22:49:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:49:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:49:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:49:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:49:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:49:36 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:49:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:49:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:49:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:49:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:49:37 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:49:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:49:37 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:49:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:49:37 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:49:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:49:38 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:49:39 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:49:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 22:49:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:49:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 22:49:39 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:49:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9034 values 142532 bits 17816 bytes 
Fri 17 Jan 2014 22:49:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:49:46 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:49:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:49:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:49:47 - XML: Processed 655610 elements - found 702 jobs
Fri 17 Jan 2014 22:49:47 - job 7348548 appears to have finished
Fri 17 Jan 2014 22:49:47 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 22:49:47 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 22:49:47 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 22:49:47 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:49:47 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:49:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:49:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:49:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:49:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:49:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:49:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43863566
Fri 17 Jan 2014 22:49:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:49:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43863566
Fri 17 Jan 2014 22:49:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:49:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:49:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:49:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:49:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:49:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:49:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:50:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:50:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:50:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:50:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:50:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:50:02 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:50:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:50:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:50:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:50:03 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:50:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:50:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:50:03 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:50:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 22:50:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:50:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:50:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:50:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:50:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:50:04 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:50:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43896483
Fri 17 Jan 2014 22:50:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:50:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43896483
Fri 17 Jan 2014 22:50:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:50:05 - job_xml_thread(): Done retrieving: data size 43896483
Fri 17 Jan 2014 22:50:05 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:50:05 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 22:50:06 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 22:50:06 - Housekeeping: done.
Fri 17 Jan 2014 22:50:06 - XML: Start document: iteration 0
Fri 17 Jan 2014 22:50:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:50:14 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:50:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:50:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:50:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:50:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:50:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:50:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:50:15 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:50:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:50:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:50:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:50:24 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:50:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:50:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:50:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:50:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:50:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:50:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:50:26 - XML: Processed 655610 elements - found 702 jobs
Fri 17 Jan 2014 22:50:26 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:50:26 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:50:26 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:50:26 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:50:28 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:50:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43869983
Fri 17 Jan 2014 22:50:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:50:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43869983
Fri 17 Jan 2014 22:50:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:50:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:50:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:50:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:50:39 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:50:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:50:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 22:50:39 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:50:39 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:50:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 22:50:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8642 values 136315 bits 17039 bytes 
Fri 17 Jan 2014 22:50:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:50:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:50:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:50:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:50:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:50:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:50:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:50:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:50:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:50:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:50:40 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:50:41 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:50:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:50:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:50:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:50:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:50:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:50:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:50:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:50:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:50:46 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:50:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43886820
Fri 17 Jan 2014 22:50:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:50:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43886820
Fri 17 Jan 2014 22:50:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:50:47 - job_xml_thread(): Done retrieving: data size 43886820
Fri 17 Jan 2014 22:50:47 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:50:47 - XML: Start document: iteration 1
Fri 17 Jan 2014 22:50:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:50:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:50:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:50:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:50:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:50:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:50:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:50:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:51:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:51:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:51:01 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:51:01 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:51:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:51:04 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:51:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 22:51:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:51:06 - XML: Processed 655610 elements - found 702 jobs
Fri 17 Jan 2014 22:51:06 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:51:06 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:51:06 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:51:06 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:51:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:51:08 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:51:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:51:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:51:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:51:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:51:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:51:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:51:10 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:51:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43897488
Fri 17 Jan 2014 22:51:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:51:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43897488
Fri 17 Jan 2014 22:51:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:51:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:51:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:51:22 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:51:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:51:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:51:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:51:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:51:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:51:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:51:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:51:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:51:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:51:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:51:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:51:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:51:25 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:51:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:51:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:51:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:51:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:51:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:51:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:51:27 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:51:27 - job_xml_thread(): Done retrieving: data size 43894603
Fri 17 Jan 2014 22:51:27 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:51:27 - XML: Start document: iteration 2
Fri 17 Jan 2014 22:51:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43894603
Fri 17 Jan 2014 22:51:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:51:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43894603
Fri 17 Jan 2014 22:51:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:51:34 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 22:51:36 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:51:38 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:51:38 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:51:38 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 22:51:38 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 22:51:38 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 22:51:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:51:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:51:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:51:39 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:51:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:51:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:51:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:51:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:51:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:51:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:51:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:51:40 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:51:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:51:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:51:40 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:51:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 22:51:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 22:51:40 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:51:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9165 values 144634 bits 18079 bytes 
Fri 17 Jan 2014 22:51:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:51:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:51:47 - size of cluster 'LISA Cluster': 624 hosts 79475 metrics 824311 values 13024054 bits 1628006 bytes 
Fri 17 Jan 2014 22:51:48 - XML: Processed 655618 elements - found 706 jobs
Fri 17 Jan 2014 22:51:48 - job 7348659 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 22:51:48 - job 7348660 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 22:51:48 - job_xml_thread(): Found 6 updated jobs.
Fri 17 Jan 2014 22:51:48 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 22:51:48 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Fri 17 Jan 2014 22:51:48 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:51:48 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:51:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:51:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:51:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:51:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:51:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:51:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:51:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:51:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:51:54 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:51:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43878846
Fri 17 Jan 2014 22:51:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:51:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43878846
Fri 17 Jan 2014 22:51:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:51:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:51:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:52:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:52:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:52:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:52:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:52:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:52:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:52:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:52:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:52:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43878846
Fri 17 Jan 2014 22:52:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:52:03 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:52:03 - job_xml_thread(): Done retrieving: data size 43878846
Fri 17 Jan 2014 22:52:03 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:52:03 - XML: Start document: iteration 3
Fri 17 Jan 2014 22:52:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:52:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:52:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:52:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:52:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:52:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:52:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:52:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:52:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:52:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:52:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:52:21 - XML: Processed 655618 elements - found 706 jobs
Fri 17 Jan 2014 22:52:21 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:52:21 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:52:21 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:52:21 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:52:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:52:24 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:52:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:52:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:52:25 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:52:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 22:52:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:52:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:52:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:52:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:52:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:52:27 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:52:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43893888
Fri 17 Jan 2014 22:52:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:52:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43893888
Fri 17 Jan 2014 22:52:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:52:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:52:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:52:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:52:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:52:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:52:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:52:36 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:52:36 - job_xml_thread(): Done retrieving: data size 43893888
Fri 17 Jan 2014 22:52:36 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:52:36 - XML: Start document: iteration 4
Fri 17 Jan 2014 22:52:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:52:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:52:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:52:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:52:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:52:38 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:52:39 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 22:52:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:52:40 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:52:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:52:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:52:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:52:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 22:52:41 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:52:41 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:52:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 22:52:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5764 values 90912 bits 11364 bytes 
Fri 17 Jan 2014 22:52:47 - XML: Processed 655618 elements - found 706 jobs
Fri 17 Jan 2014 22:52:47 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:52:47 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:52:47 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:52:47 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:52:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:52:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:52:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:52:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:52:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:52:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:52:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:52:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:52:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:52:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:52:55 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:52:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873521
Fri 17 Jan 2014 22:52:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:52:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873521
Fri 17 Jan 2014 22:52:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:53:02 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:53:02 - job_xml_thread(): Done retrieving: data size 43873521
Fri 17 Jan 2014 22:53:02 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:53:03 - XML: Start document: iteration 5
Fri 17 Jan 2014 22:53:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:53:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:53:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:53:07 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:53:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:53:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:53:08 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:53:08 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:53:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:53:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:53:08 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:53:17 - XML: Processed 655618 elements - found 706 jobs
Fri 17 Jan 2014 22:53:17 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:53:17 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:53:17 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:53:17 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:53:18 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:53:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 22:53:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:53:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:53:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:53:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:53:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:53:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:53:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:53:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:53:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:53:21 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:53:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43803215
Fri 17 Jan 2014 22:53:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:53:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43803215
Fri 17 Jan 2014 22:53:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:53:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:53:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:53:32 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:53:32 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:53:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:53:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:53:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:53:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:53:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:53:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:53:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:53:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:53:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:53:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:53:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:53:37 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:53:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:53:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:53:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:53:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:53:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:53:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:53:40 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:53:40 - job_xml_thread(): Done retrieving: data size 43373818
Fri 17 Jan 2014 22:53:40 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:53:40 - XML: Start document: iteration 6
Fri 17 Jan 2014 22:53:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43373818
Fri 17 Jan 2014 22:53:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43373818
Fri 17 Jan 2014 22:53:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:53:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:53:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:53:41 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:53:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:53:42 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:53:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 22:53:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 22:53:43 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:53:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9138 values 144171 bits 18021 bytes 
Fri 17 Jan 2014 22:53:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:53:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:53:52 - XML: Processed 649081 elements - found 703 jobs
Fri 17 Jan 2014 22:53:53 - job 7348497 appears to have finished
Fri 17 Jan 2014 22:53:53 - job 7348387 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 22:53:53 - job 7348665 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 22:53:53 - job 7348664 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 22:53:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:53:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:53:53 - job 7348661 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 22:53:53 - job 7348663 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 22:53:53 - job 7348662 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 22:53:53 - job 7348674 appears to have finished
Fri 17 Jan 2014 22:53:53 - job 7348502 appears to have finished
Fri 17 Jan 2014 22:53:53 - job_xml_thread(): Found 9 updated jobs.
Fri 17 Jan 2014 22:53:53 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 22:53:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:53:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:53:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:54:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:54:00 - job_xml_thread(): Done storing. succesfully stored: 9 jobs
Fri 17 Jan 2014 22:54:00 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:54:00 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:54:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:54:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:54:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:54:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:54:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:54:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:54:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:54:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:54:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:54:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:54:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:54:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:54:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:54:06 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:54:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43234663
Fri 17 Jan 2014 22:54:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:54:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43234663
Fri 17 Jan 2014 22:54:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:54:15 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:54:15 - job_xml_thread(): Done retrieving: data size 43234663
Fri 17 Jan 2014 22:54:15 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:54:15 - XML: Start document: iteration 7
Fri 17 Jan 2014 22:54:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:54:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:54:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:54:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:54:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:54:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:54:16 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:54:16 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:54:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:54:16 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:54:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:54:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:54:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:54:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:54:26 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:54:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:54:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:54:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:54:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:54:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:54:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:54:28 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:54:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 22:54:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:54:29 - XML: Processed 647412 elements - found 703 jobs
Fri 17 Jan 2014 22:54:29 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:54:29 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:54:29 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:54:29 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:54:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:54:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:54:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:54:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43352022
Fri 17 Jan 2014 22:54:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:54:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43352022
Fri 17 Jan 2014 22:54:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:54:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:54:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:54:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:54:42 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:54:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:54:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 22:54:43 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:54:43 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:54:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6001 values 94664 bits 11833 bytes 
Fri 17 Jan 2014 22:54:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 22:54:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:54:44 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:54:44 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:54:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:54:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:54:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:54:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:54:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:54:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:54:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:54:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:54:49 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:54:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:54:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:54:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:54:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:54:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:54:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:54:51 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:54:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 22:54:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:54:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:54:52 - job_xml_thread(): Done retrieving: data size 43847153
Fri 17 Jan 2014 22:54:52 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:54:52 - XML: Start document: iteration 8
Fri 17 Jan 2014 22:54:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43847153
Fri 17 Jan 2014 22:54:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:54:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43847153
Fri 17 Jan 2014 22:54:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:55:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:55:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:55:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:55:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:55:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:55:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:55:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:55:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:55:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:55:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:55:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:55:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:55:05 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:55:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:55:15 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:55:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:55:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:55:15 - XML: Processed 655016 elements - found 703 jobs
Fri 17 Jan 2014 22:55:15 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:55:15 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:55:15 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:55:15 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:55:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:55:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:55:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:55:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:55:17 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:55:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851989
Fri 17 Jan 2014 22:55:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:55:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851989
Fri 17 Jan 2014 22:55:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:55:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:55:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:55:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:55:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:55:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:55:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:55:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:55:27 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:55:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:55:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851989
Fri 17 Jan 2014 22:55:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:55:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:55:30 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:55:30 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:55:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:55:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:55:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:55:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:55:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:55:40 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:55:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:55:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:55:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:55:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:55:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:55:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:55:41 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 22:55:41 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 22:55:41 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:55:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:55:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:55:42 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:55:42 - job_xml_thread(): Done retrieving: data size 43868955
Fri 17 Jan 2014 22:55:42 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:55:42 - XML: Start document: iteration 9
Fri 17 Jan 2014 22:55:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43868955
Fri 17 Jan 2014 22:55:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:55:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:55:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:55:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:55:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:55:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43868955
Fri 17 Jan 2014 22:55:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:55:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:55:44 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:55:44 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:55:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 22:55:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:55:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 22:55:45 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:55:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9209 values 145396 bits 18174 bytes 
Fri 17 Jan 2014 22:55:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:55:54 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:55:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:55:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:55:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:55:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:55:58 - XML: Processed 655600 elements - found 697 jobs
Fri 17 Jan 2014 22:55:58 - job 7348543 appears to have finished
Fri 17 Jan 2014 22:55:58 - job 7348655 appears to have finished
Fri 17 Jan 2014 22:55:58 - job 7348385 appears to have finished
Fri 17 Jan 2014 22:55:58 - job 7348669 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 22:55:58 - job 7348668 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 22:55:58 - job 7348507 appears to have finished
Fri 17 Jan 2014 22:55:58 - job 7348500 appears to have finished
Fri 17 Jan 2014 22:55:58 - job 7348509 appears to have finished
Fri 17 Jan 2014 22:55:58 - job_xml_thread(): Found 8 updated jobs.
Fri 17 Jan 2014 22:55:58 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 22:55:59 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:55:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:55:59 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:55:59 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:55:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:56:00 - job_xml_thread(): Done storing. succesfully stored: 8 jobs
Fri 17 Jan 2014 22:56:00 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:56:00 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:56:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:56:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:56:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:56:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:56:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:56:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:56:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:56:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:56:06 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:56:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43891312
Fri 17 Jan 2014 22:56:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:56:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43891312
Fri 17 Jan 2014 22:56:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:56:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:56:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:56:15 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:56:15 - job_xml_thread(): Done retrieving: data size 43891312
Fri 17 Jan 2014 22:56:15 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:56:15 - XML: Start document: iteration 10
Fri 17 Jan 2014 22:56:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:56:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:56:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:56:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:56:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:56:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:56:21 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:56:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:56:21 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:56:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:56:21 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:56:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:56:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:56:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:56:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:56:30 - XML: Processed 655600 elements - found 697 jobs
Fri 17 Jan 2014 22:56:30 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:56:30 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:56:30 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:56:30 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:56:30 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:56:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 22:56:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:56:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:56:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:56:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:56:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:56:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:56:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43868137
Fri 17 Jan 2014 22:56:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:56:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43868137
Fri 17 Jan 2014 22:56:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:56:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:56:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:56:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:56:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:56:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:56:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:56:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:56:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:56:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:56:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:56:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43868137
Fri 17 Jan 2014 22:56:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:56:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:56:45 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:56:45 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:56:45 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:56:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:56:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:56:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:56:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 22:56:45 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:56:45 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:56:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 22:56:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5910 values 93206 bits 11650 bytes 
Fri 17 Jan 2014 22:56:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:56:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:56:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:56:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:56:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:56:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:56:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:56:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:56:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:56:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:56:56 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:56:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 22:56:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:56:56 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:56:56 - job_xml_thread(): Done retrieving: data size 43881867
Fri 17 Jan 2014 22:56:56 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:56:56 - XML: Start document: iteration 11
Fri 17 Jan 2014 22:56:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43881867
Fri 17 Jan 2014 22:56:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:56:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:56:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:56:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:56:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:56:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:56:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:56:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43881867
Fri 17 Jan 2014 22:56:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:57:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:57:06 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:57:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:57:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:57:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:57:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:57:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:57:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:57:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:57:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:57:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:57:15 - XML: Processed 655600 elements - found 697 jobs
Fri 17 Jan 2014 22:57:15 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:57:15 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:57:15 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:57:15 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:57:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:57:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:57:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:57:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:57:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:57:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:57:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:57:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:57:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:57:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43896938
Fri 17 Jan 2014 22:57:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:57:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43896938
Fri 17 Jan 2014 22:57:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:57:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:57:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:57:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:57:29 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:57:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:57:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:57:30 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:57:30 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:57:30 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:57:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:57:30 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:57:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:57:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:57:32 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:57:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:57:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:57:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:57:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:57:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:57:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:57:34 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:57:34 - job_xml_thread(): Done retrieving: data size 43908791
Fri 17 Jan 2014 22:57:34 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:57:34 - XML: Start document: iteration 12
Fri 17 Jan 2014 22:57:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43908791
Fri 17 Jan 2014 22:57:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:57:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43908791
Fri 17 Jan 2014 22:57:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:57:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:57:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:57:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:57:45 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:57:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:57:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 22:57:47 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:57:47 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:57:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 22:57:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148672 bits 18584 bytes 
Fri 17 Jan 2014 22:57:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:57:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:57:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:57:50 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:57:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:57:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:57:51 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:57:51 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:57:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:57:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:57:51 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:57:52 - XML: Processed 655606 elements - found 700 jobs
Fri 17 Jan 2014 22:57:52 - job 7348493 appears to have finished
Fri 17 Jan 2014 22:57:52 - job 7348669 field 'start_timestamp' changed since saved from: 1389995676 to: 1389995640
Fri 17 Jan 2014 22:57:52 - job 7348672 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 22:57:52 - job 7348670 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 22:57:52 - job 7348671 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 22:57:52 - job_xml_thread(): Found 9 updated jobs.
Fri 17 Jan 2014 22:57:52 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 22:57:53 - job_xml_thread(): Done storing. succesfully stored: 9 jobs
Fri 17 Jan 2014 22:57:53 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:57:53 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:57:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:57:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:57:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:57:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:57:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:57:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:57:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:57:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:57:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:57:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43877446
Fri 17 Jan 2014 22:57:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:57:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43877446
Fri 17 Jan 2014 22:57:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:58:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:58:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:58:08 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:58:08 - job_xml_thread(): Done retrieving: data size 43877446
Fri 17 Jan 2014 22:58:08 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:58:08 - XML: Start document: iteration 13
Fri 17 Jan 2014 22:58:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:58:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:58:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:58:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:58:11 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:58:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:58:11 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:58:11 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:58:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:58:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:58:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:58:21 - XML: Processed 655606 elements - found 700 jobs
Fri 17 Jan 2014 22:58:21 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:58:21 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:58:21 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:58:21 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:58:21 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:58:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 22:58:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:58:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:58:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:58:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:58:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:58:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:58:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:58:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:58:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:58:24 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:58:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43890759
Fri 17 Jan 2014 22:58:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:58:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43890759
Fri 17 Jan 2014 22:58:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:58:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:58:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:58:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:58:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:58:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:58:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:58:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:58:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:58:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:58:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:58:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:58:36 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:58:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:58:38 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:58:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:58:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:58:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:58:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:58:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:58:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:58:39 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:58:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43918284
Fri 17 Jan 2014 22:58:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:58:39 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 22:58:39 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:58:40 - job_xml_thread(): Done retrieving: data size 43918284
Fri 17 Jan 2014 22:58:40 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:58:40 - XML: Start document: iteration 14
Fri 17 Jan 2014 22:58:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43918284
Fri 17 Jan 2014 22:58:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:58:40 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:58:40 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:58:40 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 22:58:40 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 22:58:41 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 22:58:45 - size of cluster 'LISA Cluster': 624 hosts 79468 metrics 777198 values 12268264 bits 1533533 bytes 
Fri 17 Jan 2014 22:58:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:58:47 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:58:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:58:48 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:58:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:58:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 22:58:48 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:58:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 22:58:48 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:58:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8953 values 141250 bits 17656 bytes 
Fri 17 Jan 2014 22:58:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:58:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:58:51 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:58:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:58:51 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:58:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:58:51 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:58:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:58:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:58:59 - XML: Processed 655601 elements - found 700 jobs
Fri 17 Jan 2014 22:58:59 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 22:58:59 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 22:58:59 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:58:59 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:59:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:59:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:59:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:59:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:59:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:59:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:59:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:59:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:59:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:59:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870035
Fri 17 Jan 2014 22:59:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:59:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:59:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870035
Fri 17 Jan 2014 22:59:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:59:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:59:14 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:59:14 - job_xml_thread(): Done retrieving: data size 43870035
Fri 17 Jan 2014 22:59:14 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:59:14 - XML: Start document: iteration 15
Fri 17 Jan 2014 22:59:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:59:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:59:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:59:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:59:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:59:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:59:20 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:59:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:59:20 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:59:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:59:20 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:59:21 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:59:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 22:59:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:59:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:59:27 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:59:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:59:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:59:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:59:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:59:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:59:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:59:29 - XML: Processed 655598 elements - found 696 jobs
Fri 17 Jan 2014 22:59:29 - job 7348498 appears to have finished
Fri 17 Jan 2014 22:59:29 - job 7348680 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 22:59:29 - job 7348672 field 'start_timestamp' changed since saved from: 1389995862 to: 1389995787
Fri 17 Jan 2014 22:59:29 - job 7348676 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 22:59:29 - job 7348675 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 22:59:29 - job 7348504 appears to have finished
Fri 17 Jan 2014 22:59:29 - job 7348505 appears to have finished
Fri 17 Jan 2014 22:59:29 - job 7348503 appears to have finished
Fri 17 Jan 2014 22:59:29 - job_xml_thread(): Found 8 updated jobs.
Fri 17 Jan 2014 22:59:29 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 22:59:29 - job_xml_thread(): Done storing. succesfully stored: 8 jobs
Fri 17 Jan 2014 22:59:29 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 22:59:29 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 22:59:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:59:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43793038
Fri 17 Jan 2014 22:59:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:59:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43793038
Fri 17 Jan 2014 22:59:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:59:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:59:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:59:40 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:59:41 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 22:59:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 22:59:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 22:59:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 22:59:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 22:59:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 22:59:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:59:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:59:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:59:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 22:59:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 22:59:43 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 22:59:44 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 22:59:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:59:48 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 22:59:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 22:59:48 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 22:59:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 22:59:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 22:59:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:59:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 22:59:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 22:59:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 22:59:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:59:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 22:59:49 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 22:59:49 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 22:59:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 22:59:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6055 values 95521 bits 11940 bytes 
Fri 17 Jan 2014 22:59:52 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 22:59:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43252811
Fri 17 Jan 2014 22:59:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 22:59:52 - job_xml_thread(): Done retrieving: data size 43252811
Fri 17 Jan 2014 22:59:52 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 22:59:52 - XML: Start document: iteration 16
Fri 17 Jan 2014 22:59:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43252811
Fri 17 Jan 2014 22:59:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 22:59:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 22:59:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:00:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:00:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:00:11 - XML: Processed 647736 elements - found 696 jobs
Fri 17 Jan 2014 23:00:11 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:00:11 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:00:11 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:00:11 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:00:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:00:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:00:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:00:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:00:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:00:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:00:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:00:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:00:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:00:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:00:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:00:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:00:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:00:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:00:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:00:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:00:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:00:17 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:00:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 23:00:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:00:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:00:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43286092
Fri 17 Jan 2014 23:00:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:00:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43286092
Fri 17 Jan 2014 23:00:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:00:26 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:00:27 - job_xml_thread(): Done retrieving: data size 43286092
Fri 17 Jan 2014 23:00:27 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:00:27 - XML: Start document: iteration 17
Fri 17 Jan 2014 23:00:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:00:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:00:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:00:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:00:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:00:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:00:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:00:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:00:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:00:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:00:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:00:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:00:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:00:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:00:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:00:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:00:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:00:43 - XML: Processed 648146 elements - found 696 jobs
Fri 17 Jan 2014 23:00:43 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:00:43 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:00:43 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:00:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:00:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:00:43 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:00:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:00:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:00:47 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:00:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43772538
Fri 17 Jan 2014 23:00:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:00:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43772538
Fri 17 Jan 2014 23:00:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:00:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:00:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:00:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:00:49 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:00:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:00:51 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:00:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 23:00:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 23:00:51 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:00:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8394 values 132377 bits 16547 bytes 
Fri 17 Jan 2014 23:00:58 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:00:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:00:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:00:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:01:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:01:00 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:01:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:01:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:01:01 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:01:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:01:01 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:01:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:01:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:01:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:01:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:01:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:01:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:01:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:01:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:01:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:01:06 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:01:06 - job_xml_thread(): Done retrieving: data size 43884084
Fri 17 Jan 2014 23:01:06 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:01:06 - XML: Start document: iteration 18
Fri 17 Jan 2014 23:01:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43884084
Fri 17 Jan 2014 23:01:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:01:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43884084
Fri 17 Jan 2014 23:01:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:01:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:01:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:01:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:01:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:01:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:01:21 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:01:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:01:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:01:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:01:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:01:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:01:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:01:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:01:24 - XML: Processed 655594 elements - found 694 jobs
Fri 17 Jan 2014 23:01:24 - job 7348634 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 23:01:24 - job 7348499 appears to have finished
Fri 17 Jan 2014 23:01:24 - job 7348681 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 23:01:24 - job 7348680 field 'start_timestamp' changed since saved from: 1389995923 to: 1389995873
Fri 17 Jan 2014 23:01:24 - job 7348510 appears to have finished
Fri 17 Jan 2014 23:01:24 - job 7348676 field 'start_timestamp' changed since saved from: 1389995915 to: 1389995848
Fri 17 Jan 2014 23:01:24 - job 7348675 field 'start_timestamp' changed since saved from: 1389995913 to: 1389995848
Fri 17 Jan 2014 23:01:24 - job_xml_thread(): Found 7 updated jobs.
Fri 17 Jan 2014 23:01:24 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 23:01:26 - job_xml_thread(): Done storing. succesfully stored: 7 jobs
Fri 17 Jan 2014 23:01:26 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:01:26 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:01:26 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:01:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 23:01:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:01:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:01:28 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:01:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:01:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:01:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:01:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:01:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:01:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:01:31 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:01:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867653
Fri 17 Jan 2014 23:01:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:01:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43867653
Fri 17 Jan 2014 23:01:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:01:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:01:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:01:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:01:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:01:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:01:41 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:01:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:01:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:01:42 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:01:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:01:42 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:01:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:01:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:01:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:01:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:01:45 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:01:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:01:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:01:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:01:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:01:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:01:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:01:48 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:01:48 - job_xml_thread(): Done retrieving: data size 43874675
Fri 17 Jan 2014 23:01:48 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:01:48 - XML: Start document: iteration 19
Fri 17 Jan 2014 23:01:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43874675
Fri 17 Jan 2014 23:01:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:01:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43874675
Fri 17 Jan 2014 23:01:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:01:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:01:51 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:01:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:01:53 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:01:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 23:01:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 23:01:53 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:01:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9166 values 144907 bits 18113 bytes 
Fri 17 Jan 2014 23:01:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:01:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:02:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:02:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:02:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:02:03 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:02:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:02:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:02:04 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:02:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:02:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:02:04 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:02:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:02:07 - XML: Processed 655594 elements - found 694 jobs
Fri 17 Jan 2014 23:02:07 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:02:07 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:02:07 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:02:07 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:02:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:02:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:02:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:02:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:02:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:02:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:02:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:02:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:02:13 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:02:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43893002
Fri 17 Jan 2014 23:02:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:02:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43893002
Fri 17 Jan 2014 23:02:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:02:18 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 23:02:18 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 23:02:18 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:02:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:02:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:02:21 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:02:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 23:02:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:02:22 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:02:22 - job_xml_thread(): Done retrieving: data size 43893002
Fri 17 Jan 2014 23:02:22 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:02:22 - XML: Start document: iteration 20
Fri 17 Jan 2014 23:02:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:02:25 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:02:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:02:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:02:25 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:02:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:02:25 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:02:25 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:02:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:02:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:02:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:02:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:02:30 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:02:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:02:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:02:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:02:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:02:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:02:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:02:33 - XML: Processed 655594 elements - found 694 jobs
Fri 17 Jan 2014 23:02:33 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:02:33 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:02:33 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:02:33 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:02:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:02:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43871148
Fri 17 Jan 2014 23:02:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:02:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43871148
Fri 17 Jan 2014 23:02:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:02:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:02:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:02:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:02:45 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:02:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:02:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:02:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:02:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:02:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:02:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:02:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:02:47 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:02:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:02:48 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:02:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:02:49 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:02:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:02:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:02:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:02:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:02:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:02:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:02:51 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:02:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43899097
Fri 17 Jan 2014 23:02:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:02:52 - job_xml_thread(): Done retrieving: data size 43899097
Fri 17 Jan 2014 23:02:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43899097
Fri 17 Jan 2014 23:02:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:02:52 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:02:52 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 23:02:52 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 23:02:52 - Housekeeping: done.
Fri 17 Jan 2014 23:02:52 - XML: Start document: iteration 0
Fri 17 Jan 2014 23:02:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:02:53 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:02:54 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:02:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 23:02:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:02:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 23:02:54 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:02:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9366 values 148252 bits 18531 bytes 
Fri 17 Jan 2014 23:03:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:03:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:03:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:03:03 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:03:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:03:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:03:04 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:03:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:03:04 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:03:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:03:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:03:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:03:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:03:11 - XML: Processed 655594 elements - found 694 jobs
Fri 17 Jan 2014 23:03:11 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:03:11 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:03:11 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:03:11 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:03:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:03:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:03:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:03:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:03:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:03:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:03:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:03:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:03:17 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:03:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858956
Fri 17 Jan 2014 23:03:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:03:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43858956
Fri 17 Jan 2014 23:03:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:03:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:03:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:03:26 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:03:26 - job_xml_thread(): Done retrieving: data size 43858956
Fri 17 Jan 2014 23:03:26 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:03:26 - XML: Start document: iteration 1
Fri 17 Jan 2014 23:03:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:03:27 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:03:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:03:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:03:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:03:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:03:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:03:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:03:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:03:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:03:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:03:34 - XML: Processed 655590 elements - found 692 jobs
Fri 17 Jan 2014 23:03:34 - job 7348511 appears to have finished
Fri 17 Jan 2014 23:03:34 - job 7348506 appears to have finished
Fri 17 Jan 2014 23:03:34 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 23:03:34 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 23:03:34 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 23:03:34 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:03:34 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:03:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:03:36 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:03:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:03:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:03:36 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:03:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 23:03:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:03:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:03:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:03:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:03:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:03:37 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:03:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43879561
Fri 17 Jan 2014 23:03:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:03:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43879561
Fri 17 Jan 2014 23:03:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:03:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:03:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:03:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:03:46 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:03:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:03:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:03:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:03:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:03:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:03:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:03:48 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:03:49 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:03:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:03:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:03:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:03:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:03:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:03:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:03:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:03:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:03:53 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:03:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43907842
Fri 17 Jan 2014 23:03:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:03:53 - job_xml_thread(): Done retrieving: data size 43907842
Fri 17 Jan 2014 23:03:53 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:03:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43907842
Fri 17 Jan 2014 23:03:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:03:54 - XML: Start document: iteration 2
Fri 17 Jan 2014 23:03:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:03:55 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:03:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:03:55 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:03:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 23:03:55 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:03:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 23:03:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8611 values 135976 bits 16997 bytes 
Fri 17 Jan 2014 23:04:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:04:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:04:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:04:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:04:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:04:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:04:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:04:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:04:10 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:04:10 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:04:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:04:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:04:10 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:04:10 - XML: Processed 655590 elements - found 692 jobs
Fri 17 Jan 2014 23:04:10 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:04:10 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:04:10 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:04:10 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:04:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:04:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:04:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:04:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:04:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:04:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:04:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:04:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:04:16 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:04:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43883368
Fri 17 Jan 2014 23:04:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:04:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43883368
Fri 17 Jan 2014 23:04:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:04:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:04:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:04:25 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:04:25 - job_xml_thread(): Done retrieving: data size 43883368
Fri 17 Jan 2014 23:04:25 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:04:25 - XML: Start document: iteration 3
Fri 17 Jan 2014 23:04:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:04:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:04:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:04:38 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:04:38 - XML: Processed 655590 elements - found 692 jobs
Fri 17 Jan 2014 23:04:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:04:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:04:39 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:04:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:04:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:04:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:04:39 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:04:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:04:39 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:04:39 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:04:39 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:04:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:04:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:04:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:04:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:04:40 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:04:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 23:04:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:04:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:04:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:04:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:04:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:04:41 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:04:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43909771
Fri 17 Jan 2014 23:04:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:04:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43909771
Fri 17 Jan 2014 23:04:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:04:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:04:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:04:54 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:04:54 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:04:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:04:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:04:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:04:56 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:04:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:04:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:04:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:04:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:04:56 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:04:56 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:04:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:04:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:04:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 23:04:56 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:04:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:04:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 23:04:56 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:04:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5835 values 92064 bits 11508 bytes 
Fri 17 Jan 2014 23:04:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:04:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:04:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:04:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:04:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:04:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:04:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:04:58 - job_xml_thread(): Done retrieving: data size 43905506
Fri 17 Jan 2014 23:04:58 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:04:58 - XML: Start document: iteration 4
Fri 17 Jan 2014 23:04:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43905506
Fri 17 Jan 2014 23:04:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:04:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43905506
Fri 17 Jan 2014 23:04:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:05:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:05:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:05:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:05:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:05:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:05:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:05:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:05:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:05:12 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:05:12 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:05:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:05:12 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:05:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:05:15 - XML: Processed 655586 elements - found 690 jobs
Fri 17 Jan 2014 23:05:15 - job 7348496 appears to have finished
Fri 17 Jan 2014 23:05:15 - job 7348495 appears to have finished
Fri 17 Jan 2014 23:05:15 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 23:05:15 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 23:05:15 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 23:05:15 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:05:15 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:05:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:05:19 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:05:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:05:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:05:19 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:05:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 23:05:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:05:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:05:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:05:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:05:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:05:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:05:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43802721
Fri 17 Jan 2014 23:05:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:05:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43802721
Fri 17 Jan 2014 23:05:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:05:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:05:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:05:30 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:05:30 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:05:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:05:32 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:05:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:05:34 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:05:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:05:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:05:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:05:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:05:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:05:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:05:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:05:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:05:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:05:35 - job_xml_thread(): Done retrieving: data size 43368295
Fri 17 Jan 2014 23:05:35 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:05:35 - XML: Start document: iteration 5
Fri 17 Jan 2014 23:05:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43368295
Fri 17 Jan 2014 23:05:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:05:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:05:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:05:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:05:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43368295
Fri 17 Jan 2014 23:05:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:05:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:05:41 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 23:05:41 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:05:42 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:05:42 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 23:05:42 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 23:05:42 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:05:42 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 23:05:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:05:46 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:05:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:05:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:05:50 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:05:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:05:50 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:05:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:05:50 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:05:50 - size of cluster 'LISA Cluster': 624 hosts 79472 metrics 863698 values 13653680 bits 1706710 bytes 
Fri 17 Jan 2014 23:05:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:05:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:05:56 - XML: Processed 649226 elements - found 692 jobs
Fri 17 Jan 2014 23:05:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:05:56 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:05:56 - job 7348408 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 23:05:56 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 23:05:56 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 23:05:56 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 23:05:56 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:05:56 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:05:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:05:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 23:05:57 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:05:57 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:05:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 23:05:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8819 values 139175 bits 17396 bytes 
Fri 17 Jan 2014 23:05:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:05:59 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:05:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:05:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:06:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:06:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:06:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:06:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:06:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:06:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43231101
Fri 17 Jan 2014 23:06:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:06:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43231101
Fri 17 Jan 2014 23:06:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:06:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:06:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:06:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:06:09 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:06:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:06:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:06:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:06:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:06:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:06:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:06:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43231101
Fri 17 Jan 2014 23:06:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:06:12 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:06:12 - job_xml_thread(): Done retrieving: data size 43231101
Fri 17 Jan 2014 23:06:12 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:06:12 - XML: Start document: iteration 6
Fri 17 Jan 2014 23:06:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:06:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:06:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:06:20 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:06:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:06:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:06:25 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:06:25 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:06:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:06:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:06:25 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:06:28 - XML: Processed 647690 elements - found 692 jobs
Fri 17 Jan 2014 23:06:28 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:06:28 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:06:28 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:06:28 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:06:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:06:30 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:06:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:06:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:06:30 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:06:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 23:06:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:06:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:06:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:06:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:06:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:06:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:06:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568483
Fri 17 Jan 2014 23:06:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:06:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568483
Fri 17 Jan 2014 23:06:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:06:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:06:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:06:42 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:06:42 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 23:06:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:06:42 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:06:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:06:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:06:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:06:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:06:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:06:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:06:43 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:06:43 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:06:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:06:45 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:06:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:06:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:06:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:06:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:06:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:06:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:06:48 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:06:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43834724
Fri 17 Jan 2014 23:06:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:06:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43834724
Fri 17 Jan 2014 23:06:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:06:49 - job_xml_thread(): Done retrieving: data size 43834724
Fri 17 Jan 2014 23:06:49 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:06:49 - XML: Start document: iteration 7
Fri 17 Jan 2014 23:06:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:06:57 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:06:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:06:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 23:06:57 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:06:57 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:06:57 - XML: Processed 655088 elements - found 692 jobs
Fri 17 Jan 2014 23:06:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 23:06:57 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:06:57 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:06:57 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:06:57 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:06:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8958 values 141371 bits 17671 bytes 
Fri 17 Jan 2014 23:06:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:06:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:07:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:07:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:07:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:07:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:07:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:07:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:07:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:07:07 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:07:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:07:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:07:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:07:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:07:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:07:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:07:08 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:07:08 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:07:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:07:08 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:07:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:07:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:07:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43898257
Fri 17 Jan 2014 23:07:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:07:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43898257
Fri 17 Jan 2014 23:07:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:07:13 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:07:13 - job_xml_thread(): Done retrieving: data size 43898257
Fri 17 Jan 2014 23:07:13 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:07:13 - XML: Start document: iteration 8
Fri 17 Jan 2014 23:07:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:07:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:07:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:07:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:07:24 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:07:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 23:07:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:07:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:07:29 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:07:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:07:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:07:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:07:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:07:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:07:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:07:31 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:07:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:07:34 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:07:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:07:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:07:35 - XML: Processed 655584 elements - found 689 jobs
Fri 17 Jan 2014 23:07:35 - job 7335119 appears to have finished
Fri 17 Jan 2014 23:07:35 - job 7348636 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 23:07:35 - job 7348635 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 23:07:35 - job 7346297 appears to have finished
Fri 17 Jan 2014 23:07:35 - job 7348661 appears to have finished
Fri 17 Jan 2014 23:07:35 - job_xml_thread(): Found 5 updated jobs.
Fri 17 Jan 2014 23:07:35 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 23:07:35 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Fri 17 Jan 2014 23:07:35 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:07:35 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:07:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:07:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:07:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:07:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:07:38 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:07:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43889675
Fri 17 Jan 2014 23:07:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:07:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43889675
Fri 17 Jan 2014 23:07:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:07:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:07:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:07:50 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:07:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:07:50 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:07:50 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:07:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:07:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:07:51 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:07:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:07:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:07:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:07:51 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:07:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:07:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:07:53 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:07:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:07:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:07:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:07:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:07:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:07:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:07:56 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:07:56 - job_xml_thread(): Done retrieving: data size 43892941
Fri 17 Jan 2014 23:07:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43892941
Fri 17 Jan 2014 23:07:56 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:07:56 - XML: Start document: iteration 9
Fri 17 Jan 2014 23:07:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:07:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43892941
Fri 17 Jan 2014 23:07:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:07:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:07:58 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:07:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:08:00 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:08:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 23:08:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 23:08:00 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:08:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6123 values 96649 bits 12081 bytes 
Fri 17 Jan 2014 23:08:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:08:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:08:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:08:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:08:12 - XML: Processed 655584 elements - found 689 jobs
Fri 17 Jan 2014 23:08:12 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:08:12 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:08:12 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:08:12 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:08:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:08:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:08:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:08:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:08:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:08:19 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:08:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:08:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:08:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:08:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:08:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:08:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:08:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:08:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:08:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:08:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:08:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:08:23 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:08:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43904144
Fri 17 Jan 2014 23:08:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:08:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43904144
Fri 17 Jan 2014 23:08:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:08:28 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:08:28 - job_xml_thread(): Done retrieving: data size 43904144
Fri 17 Jan 2014 23:08:29 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:08:29 - XML: Start document: iteration 10
Fri 17 Jan 2014 23:08:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:08:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:08:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:08:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:08:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:08:38 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:08:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:08:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:08:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:08:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:08:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:08:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:08:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:08:45 - XML: Processed 655584 elements - found 689 jobs
Fri 17 Jan 2014 23:08:45 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:08:45 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:08:45 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:08:45 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:08:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:08:46 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:08:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:08:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:08:46 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:08:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 23:08:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:08:47 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:08:47 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:08:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:08:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:08:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:08:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43871373
Fri 17 Jan 2014 23:08:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:08:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43871373
Fri 17 Jan 2014 23:08:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:08:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:08:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:08:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:08:58 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:09:00 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:09:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:09:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:09:00 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:09:01 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:09:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:09:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 23:09:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 23:09:01 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:09:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5709 values 90042 bits 11255 bytes 
Fri 17 Jan 2014 23:09:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:09:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:09:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:09:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:09:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:09:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:09:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:09:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:09:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:09:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:09:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:09:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:09:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:09:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:09:08 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:09:08 - job_xml_thread(): Done retrieving: data size 43883588
Fri 17 Jan 2014 23:09:08 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:09:08 - XML: Start document: iteration 11
Fri 17 Jan 2014 23:09:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43883588
Fri 17 Jan 2014 23:09:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:09:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43883588
Fri 17 Jan 2014 23:09:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:09:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:09:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:09:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:09:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:09:24 - XML: Processed 655582 elements - found 688 jobs
Fri 17 Jan 2014 23:09:24 - job 7348669 appears to have finished
Fri 17 Jan 2014 23:09:24 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 23:09:24 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 23:09:24 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 23:09:24 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:09:24 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:09:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:09:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:09:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:09:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:09:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:09:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:09:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:09:31 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:09:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:09:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:09:32 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:09:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:09:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:09:33 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:09:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 23:09:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:09:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:09:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:09:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:09:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:09:35 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 23:09:35 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 23:09:35 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:09:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:09:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43888828
Fri 17 Jan 2014 23:09:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:09:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43888828
Fri 17 Jan 2014 23:09:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:09:39 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:09:39 - job_xml_thread(): Done retrieving: data size 43888828
Fri 17 Jan 2014 23:09:39 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:09:39 - XML: Start document: iteration 12
Fri 17 Jan 2014 23:09:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:09:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:09:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:09:48 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:09:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:09:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:09:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:09:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:09:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:09:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:09:48 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:09:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:09:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:09:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:09:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:09:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:09:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:09:56 - XML: Processed 655582 elements - found 688 jobs
Fri 17 Jan 2014 23:09:56 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:09:56 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:09:56 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:09:56 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:09:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:09:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:09:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:09:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:09:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:09:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43881535
Fri 17 Jan 2014 23:09:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:09:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43881535
Fri 17 Jan 2014 23:09:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:10:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:10:02 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:10:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:10:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 23:10:03 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:10:03 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:10:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 23:10:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8900 values 140384 bits 17548 bytes 
Fri 17 Jan 2014 23:10:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:10:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:10:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:10:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:10:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:10:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:10:11 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:10:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:10:12 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:10:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:10:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:10:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:10:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:10:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:10:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:10:13 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:10:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:10:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:10:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:10:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:10:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:10:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:10:15 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:10:15 - job_xml_thread(): Done retrieving: data size 43885968
Fri 17 Jan 2014 23:10:15 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:10:15 - XML: Start document: iteration 13
Fri 17 Jan 2014 23:10:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43885968
Fri 17 Jan 2014 23:10:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43885968
Fri 17 Jan 2014 23:10:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:10:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:10:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:10:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:10:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:10:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:10:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:10:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:10:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:10:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:10:34 - XML: Processed 655573 elements - found 688 jobs
Fri 17 Jan 2014 23:10:34 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:10:34 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:10:34 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:10:34 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:10:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:10:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:10:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:10:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:10:34 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:10:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:10:38 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:10:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:10:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:10:38 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:10:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 23:10:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:10:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:10:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:10:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:10:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:10:40 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:10:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43896924
Fri 17 Jan 2014 23:10:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:10:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43896924
Fri 17 Jan 2014 23:10:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:10:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:10:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:10:49 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:10:49 - job_xml_thread(): Done retrieving: data size 43896924
Fri 17 Jan 2014 23:10:49 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:10:50 - XML: Start document: iteration 14
Fri 17 Jan 2014 23:10:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:10:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:10:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:10:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:10:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:10:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:10:53 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:10:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:10:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:10:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:10:53 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:11:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:11:01 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:11:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:11:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:11:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:11:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:11:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:11:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:11:03 - XML: Processed 655582 elements - found 688 jobs
Fri 17 Jan 2014 23:11:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:11:03 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:11:03 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:11:03 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:11:03 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:11:03 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:11:04 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:11:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:11:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 23:11:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 23:11:04 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:11:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5776 values 91104 bits 11388 bytes 
Fri 17 Jan 2014 23:11:06 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:11:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865490
Fri 17 Jan 2014 23:11:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:11:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43865490
Fri 17 Jan 2014 23:11:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:11:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:11:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:11:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:11:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:11:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:11:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:11:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:11:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:11:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:11:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:11:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:11:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:11:18 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:11:18 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:11:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:11:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:11:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:11:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:11:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:11:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:11:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:11:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:11:23 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:11:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 23:11:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:11:23 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:11:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43822797
Fri 17 Jan 2014 23:11:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:11:24 - job_xml_thread(): Done retrieving: data size 43822797
Fri 17 Jan 2014 23:11:24 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:11:24 - XML: Start document: iteration 15
Fri 17 Jan 2014 23:11:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43822797
Fri 17 Jan 2014 23:11:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:11:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:11:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:11:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:11:36 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:11:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:11:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:11:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:11:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:11:37 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:11:37 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:11:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:11:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:11:37 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:11:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:11:46 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:11:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:11:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:11:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:11:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:11:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:11:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:11:47 - XML: Processed 654838 elements - found 690 jobs
Fri 17 Jan 2014 23:11:47 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 23:11:47 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 23:11:47 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 23:11:47 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:11:47 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:11:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:11:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43265584
Fri 17 Jan 2014 23:11:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:11:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43265584
Fri 17 Jan 2014 23:11:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:11:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:11:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:12:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:12:01 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:12:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:12:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:12:01 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:12:01 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:12:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:12:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:12:01 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:12:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:12:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:12:02 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:12:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:12:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:12:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:12:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:12:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:12:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:12:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:12:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:12:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:12:04 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:12:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:12:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 23:12:04 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:12:04 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:12:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 23:12:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7762 values 122464 bits 15308 bytes 
Fri 17 Jan 2014 23:12:06 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:12:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43234016
Fri 17 Jan 2014 23:12:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:12:07 - job_xml_thread(): Done retrieving: data size 43234016
Fri 17 Jan 2014 23:12:07 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:12:07 - XML: Start document: iteration 16
Fri 17 Jan 2014 23:12:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43234016
Fri 17 Jan 2014 23:12:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:12:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:12:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:12:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:12:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:12:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:12:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:12:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:12:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:12:20 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:12:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:12:20 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:12:20 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:12:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:12:26 - XML: Processed 647386 elements - found 690 jobs
Fri 17 Jan 2014 23:12:26 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:12:26 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:12:26 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:12:26 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:12:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:12:30 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:12:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:12:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:12:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:12:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:12:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:12:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:12:31 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:12:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 23:12:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:12:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:12:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43623194
Fri 17 Jan 2014 23:12:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:12:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43623194
Fri 17 Jan 2014 23:12:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:12:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:12:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:12:41 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:12:41 - job_xml_thread(): Done retrieving: data size 43623194
Fri 17 Jan 2014 23:12:41 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:12:41 - XML: Start document: iteration 17
Fri 17 Jan 2014 23:12:42 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 23:12:42 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:12:43 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:12:43 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:12:43 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 23:12:43 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 23:12:43 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 23:12:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:12:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:12:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:12:48 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:12:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:12:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:12:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:12:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:12:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:12:49 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:12:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:12:49 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:12:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:12:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:12:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:12:51 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:12:51 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:12:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:12:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:12:52 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 811223 values 12803606 bits 1600450 bytes 
Fri 17 Jan 2014 23:12:55 - XML: Processed 652722 elements - found 690 jobs
Fri 17 Jan 2014 23:12:55 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:12:55 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:12:55 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:12:55 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:12:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:12:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43834904
Fri 17 Jan 2014 23:12:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:12:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43834904
Fri 17 Jan 2014 23:12:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:13:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:13:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:13:05 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:13:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:13:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:13:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 23:13:05 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:13:05 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:13:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8179 values 129105 bits 16138 bytes 
Fri 17 Jan 2014 23:13:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 23:13:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:13:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:13:10 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:13:10 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:13:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:13:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:13:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:13:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:13:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:13:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:13:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:13:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:13:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:13:14 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:13:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:13:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:13:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:13:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:13:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:13:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:13:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:13:18 - job_xml_thread(): Done retrieving: data size 43870702
Fri 17 Jan 2014 23:13:18 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:13:18 - XML: Start document: iteration 18
Fri 17 Jan 2014 23:13:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870702
Fri 17 Jan 2014 23:13:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:13:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870702
Fri 17 Jan 2014 23:13:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:13:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:13:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:13:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:13:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:13:32 - XML: Processed 655580 elements - found 688 jobs
Fri 17 Jan 2014 23:13:32 - job 7348512 appears to have finished
Fri 17 Jan 2014 23:13:32 - job 7348676 appears to have finished
Fri 17 Jan 2014 23:13:32 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 23:13:32 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 23:13:33 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 23:13:33 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:13:33 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:13:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:13:36 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:13:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:13:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:13:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:13:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:13:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:13:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:13:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:13:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:13:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:13:42 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:13:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 23:13:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:13:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:13:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:13:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:13:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:13:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:13:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:13:43 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:13:43 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 23:13:44 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:13:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43876544
Fri 17 Jan 2014 23:13:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:13:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43876544
Fri 17 Jan 2014 23:13:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:13:48 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:13:48 - job_xml_thread(): Done retrieving: data size 43876544
Fri 17 Jan 2014 23:13:48 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:13:48 - XML: Start document: iteration 19
Fri 17 Jan 2014 23:13:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:13:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:13:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:13:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:13:53 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:13:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:13:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43876544
Fri 17 Jan 2014 23:13:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:13:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:13:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:13:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:13:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:14:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:14:03 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:14:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:14:06 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:14:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:14:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 23:14:07 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:14:07 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:14:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 23:14:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5972 values 94227 bits 11778 bytes 
Fri 17 Jan 2014 23:14:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:14:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:14:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:14:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:14:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:14:09 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:14:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:14:12 - XML: Processed 655578 elements - found 688 jobs
Fri 17 Jan 2014 23:14:12 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:14:12 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:14:12 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:14:12 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:14:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:14:13 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:14:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:14:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:14:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:14:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:14:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:14:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:14:17 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:14:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43868882
Fri 17 Jan 2014 23:14:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:14:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43868882
Fri 17 Jan 2014 23:14:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:14:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:14:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:14:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:14:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:14:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:14:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:14:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:14:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:14:27 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:14:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43868882
Fri 17 Jan 2014 23:14:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:14:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:14:27 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:14:27 - job_xml_thread(): Done retrieving: data size 43868882
Fri 17 Jan 2014 23:14:27 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:14:27 - XML: Start document: iteration 20
Fri 17 Jan 2014 23:14:29 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:14:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 23:14:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:14:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:14:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:14:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:14:38 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:14:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:14:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:14:42 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:14:42 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:14:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:14:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:14:42 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:14:46 - XML: Processed 655580 elements - found 688 jobs
Fri 17 Jan 2014 23:14:46 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:14:46 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:14:46 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:14:46 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:14:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:14:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:14:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:14:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:14:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:14:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:14:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:14:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:14:50 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:14:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43886595
Fri 17 Jan 2014 23:14:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:14:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43886595
Fri 17 Jan 2014 23:14:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:14:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:14:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:14:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:14:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:15:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:15:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:15:01 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:15:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:15:01 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:15:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:15:01 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:15:01 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:15:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:15:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:15:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:15:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:15:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:15:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:15:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:15:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:15:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:15:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:15:07 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:15:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43897870
Fri 17 Jan 2014 23:15:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:15:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:15:07 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:15:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43897870
Fri 17 Jan 2014 23:15:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:15:08 - job_xml_thread(): Done retrieving: data size 43897870
Fri 17 Jan 2014 23:15:08 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:15:08 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 23:15:08 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:15:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:15:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 23:15:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 23:15:08 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:15:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6814 values 107582 bits 13447 bytes 
Fri 17 Jan 2014 23:15:08 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 23:15:08 - Housekeeping: done.
Fri 17 Jan 2014 23:15:08 - XML: Start document: iteration 0
Fri 17 Jan 2014 23:15:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:15:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:15:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:15:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:15:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:15:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:15:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:15:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:15:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:15:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:15:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:15:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:15:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:15:27 - XML: Processed 655580 elements - found 688 jobs
Fri 17 Jan 2014 23:15:27 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:15:27 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:15:27 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:15:27 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:15:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:15:30 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:15:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:15:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:15:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:15:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:15:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:15:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:15:33 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:15:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867474
Fri 17 Jan 2014 23:15:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:15:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43867474
Fri 17 Jan 2014 23:15:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:15:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:15:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:15:42 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:15:42 - job_xml_thread(): Done retrieving: data size 43867474
Fri 17 Jan 2014 23:15:42 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:15:42 - XML: Start document: iteration 1
Fri 17 Jan 2014 23:15:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:15:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:15:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:15:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:15:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:15:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:15:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:15:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:15:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:15:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:15:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:15:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:15:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:15:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:15:53 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:15:54 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:15:54 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:15:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:15:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:15:56 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:15:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 23:15:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:15:57 - XML: Processed 655580 elements - found 688 jobs
Fri 17 Jan 2014 23:15:57 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:15:57 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:15:57 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:15:57 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:15:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:15:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43893247
Fri 17 Jan 2014 23:15:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:16:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43893247
Fri 17 Jan 2014 23:16:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:16:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:16:08 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:16:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:16:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:16:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:16:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 23:16:08 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:16:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 23:16:08 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:16:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6030 values 95185 bits 11898 bytes 
Fri 17 Jan 2014 23:16:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:16:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:16:12 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:16:12 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:16:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:16:14 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:16:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:16:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:16:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:16:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:16:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:16:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:16:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:16:15 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:16:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:16:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:16:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:16:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:16:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:16:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:16:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:16:18 - job_xml_thread(): Done retrieving: data size 43886525
Fri 17 Jan 2014 23:16:18 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:16:18 - XML: Start document: iteration 2
Fri 17 Jan 2014 23:16:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43886525
Fri 17 Jan 2014 23:16:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:16:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43886525
Fri 17 Jan 2014 23:16:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:16:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:16:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:16:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:16:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:16:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:16:37 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:16:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:16:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:16:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:16:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:16:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:16:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:16:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:16:40 - XML: Processed 655580 elements - found 688 jobs
Fri 17 Jan 2014 23:16:40 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:16:40 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:16:40 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:16:40 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:16:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:16:41 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:16:41 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:16:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 23:16:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:16:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:16:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:16:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:16:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:16:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:16:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:16:41 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 23:16:41 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 23:16:41 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:16:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:16:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43903537
Fri 17 Jan 2014 23:16:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:16:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43903537
Fri 17 Jan 2014 23:16:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:16:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:16:53 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:16:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:16:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:16:54 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:16:54 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:16:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:16:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:16:54 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:16:55 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:16:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:16:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:16:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:16:57 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:16:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:16:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:16:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:16:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:16:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:16:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:16:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:16:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43912397
Fri 17 Jan 2014 23:16:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:16:58 - job_xml_thread(): Done retrieving: data size 43912397
Fri 17 Jan 2014 23:16:58 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:16:58 - XML: Start document: iteration 3
Fri 17 Jan 2014 23:16:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43912397
Fri 17 Jan 2014 23:16:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:17:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:17:08 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:17:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:17:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:17:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:17:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 23:17:09 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:17:09 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:17:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 23:17:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9172 values 145117 bits 18139 bytes 
Fri 17 Jan 2014 23:17:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:17:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:17:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:17:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:17:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:17:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:17:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:17:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:17:16 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:17:16 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:17:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:17:17 - XML: Processed 655579 elements - found 688 jobs
Fri 17 Jan 2014 23:17:17 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:17:17 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:17:17 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:17:17 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:17:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:17:20 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:17:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:17:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:17:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:17:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:17:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:17:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:17:22 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:17:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 23:17:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:17:22 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:17:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43821461
Fri 17 Jan 2014 23:17:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:17:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43821461
Fri 17 Jan 2014 23:17:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:17:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:17:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:17:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:17:31 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:17:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:17:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:17:32 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:17:32 - job_xml_thread(): Done retrieving: data size 43821461
Fri 17 Jan 2014 23:17:32 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:17:32 - XML: Start document: iteration 4
Fri 17 Jan 2014 23:17:33 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:17:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:17:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:17:33 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:17:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:17:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:17:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:17:41 - XML: Processed 654834 elements - found 689 jobs
Fri 17 Jan 2014 23:17:41 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 23:17:41 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 23:17:41 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 23:17:41 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:17:41 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:17:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:17:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:17:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:17:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:17:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:17:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:17:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:17:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:17:44 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:17:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43330522
Fri 17 Jan 2014 23:17:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:17:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43330522
Fri 17 Jan 2014 23:17:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:17:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:17:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:17:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:17:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:17:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:17:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:17:56 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:17:56 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:17:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:17:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:17:56 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:17:57 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:17:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:17:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:17:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:17:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:17:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:17:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43245165
Fri 17 Jan 2014 23:17:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:18:00 - job_xml_thread(): Done retrieving: data size 43245165
Fri 17 Jan 2014 23:18:00 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:18:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:18:00 - XML: Start document: iteration 5
Fri 17 Jan 2014 23:18:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:18:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43245165
Fri 17 Jan 2014 23:18:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:18:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:18:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:18:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:18:09 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:18:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:18:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 23:18:11 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:18:11 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:18:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9268 values 146726 bits 18340 bytes 
Fri 17 Jan 2014 23:18:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 23:18:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:18:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:18:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:18:13 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:18:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:18:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:18:14 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:18:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:18:14 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:18:14 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:18:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:18:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:18:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:18:19 - XML: Processed 647384 elements - found 689 jobs
Fri 17 Jan 2014 23:18:19 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:18:19 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:18:19 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:18:19 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:18:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:18:21 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:18:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:18:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:18:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:18:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:18:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:18:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:18:23 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:18:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43281617
Fri 17 Jan 2014 23:18:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:18:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43281617
Fri 17 Jan 2014 23:18:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:18:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:18:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:18:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:18:34 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:18:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:18:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:18:34 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:18:34 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:18:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:18:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:18:35 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:18:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:18:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:18:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:18:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:18:37 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:18:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:18:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:18:37 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:18:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 23:18:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:18:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:18:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:18:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:18:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:18:39 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:18:39 - job_xml_thread(): Done retrieving: data size 43732427
Fri 17 Jan 2014 23:18:39 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:18:39 - XML: Start document: iteration 6
Fri 17 Jan 2014 23:18:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43732427
Fri 17 Jan 2014 23:18:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43732427
Fri 17 Jan 2014 23:18:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:18:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:18:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:18:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:18:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:18:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:18:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:18:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:18:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:18:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:18:56 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:18:56 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:18:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:18:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:18:56 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:18:58 - XML: Processed 653568 elements - found 689 jobs
Fri 17 Jan 2014 23:18:58 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:18:58 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:18:58 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:18:58 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:19:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:19:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:19:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:19:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:19:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:19:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:19:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:19:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:19:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:19:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873306
Fri 17 Jan 2014 23:19:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:19:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873306
Fri 17 Jan 2014 23:19:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:19:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:19:11 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:19:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:19:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:19:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:19:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 23:19:11 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:19:11 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:19:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 23:19:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9026 values 142491 bits 17811 bytes 
Fri 17 Jan 2014 23:19:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:19:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:19:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:19:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:19:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:19:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:19:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:19:13 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:19:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:19:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:19:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:19:15 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:19:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:19:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:19:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:19:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:19:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:19:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:19:17 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:19:17 - job_xml_thread(): Done retrieving: data size 43879441
Fri 17 Jan 2014 23:19:17 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:19:17 - XML: Start document: iteration 7
Fri 17 Jan 2014 23:19:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43879441
Fri 17 Jan 2014 23:19:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43879441
Fri 17 Jan 2014 23:19:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:19:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:19:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:19:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:19:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:19:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:19:38 - XML: Processed 655584 elements - found 689 jobs
Fri 17 Jan 2014 23:19:38 - job 7348637 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 23:19:38 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 23:19:38 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 23:19:38 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 23:19:38 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:19:39 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:19:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:19:40 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:19:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:19:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:19:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:19:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:19:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:19:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:19:40 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:19:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 23:19:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:19:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:19:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:19:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:19:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:19:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:19:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:19:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:19:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:19:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:19:42 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:19:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43894348
Fri 17 Jan 2014 23:19:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:19:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43894348
Fri 17 Jan 2014 23:19:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:19:44 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 23:19:44 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:19:48 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:19:48 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 23:19:48 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:19:49 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 23:19:49 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 23:19:54 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:19:54 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:19:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:19:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:19:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:19:56 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:19:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:19:56 - size of cluster 'LISA Cluster': 624 hosts 79478 metrics 790669 values 12505196 bits 1563149 bytes 
Fri 17 Jan 2014 23:19:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:19:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:19:57 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:19:57 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:19:57 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:19:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:19:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:19:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:19:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:19:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:19:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:19:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:19:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:20:00 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:20:00 - job_xml_thread(): Done retrieving: data size 43875833
Fri 17 Jan 2014 23:20:00 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:20:00 - XML: Start document: iteration 8
Fri 17 Jan 2014 23:20:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875833
Fri 17 Jan 2014 23:20:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:20:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875833
Fri 17 Jan 2014 23:20:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:20:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:20:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:20:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:20:11 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:20:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:20:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 23:20:12 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:20:12 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:20:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8988 values 141783 bits 17722 bytes 
Fri 17 Jan 2014 23:20:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 23:20:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:20:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:20:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:20:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:20:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:20:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:20:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:20:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:20:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:20:21 - XML: Processed 655584 elements - found 689 jobs
Fri 17 Jan 2014 23:20:21 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:20:21 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:20:21 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:20:21 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:20:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:20:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:20:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:20:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:20:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:20:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:20:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:20:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:20:26 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:20:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873439
Fri 17 Jan 2014 23:20:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:20:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873439
Fri 17 Jan 2014 23:20:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:20:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:20:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:20:36 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:20:36 - job_xml_thread(): Done retrieving: data size 43873439
Fri 17 Jan 2014 23:20:36 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:20:37 - XML: Start document: iteration 9
Fri 17 Jan 2014 23:20:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:20:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:20:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:20:41 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:20:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:20:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:20:42 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:20:42 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:20:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:20:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:20:42 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:20:44 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:20:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 23:20:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:20:48 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:20:48 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 23:20:51 - XML: Processed 655584 elements - found 689 jobs
Fri 17 Jan 2014 23:20:51 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:20:51 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:20:51 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:20:51 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:20:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:20:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:20:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:20:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:20:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:20:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:20:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:20:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:20:55 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:20:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43868567
Fri 17 Jan 2014 23:20:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:20:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43868567
Fri 17 Jan 2014 23:20:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:20:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:20:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:21:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:21:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:21:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:21:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:21:06 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:21:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:21:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:21:06 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:21:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:21:06 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:21:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:21:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:21:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:21:09 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:21:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:21:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:21:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:21:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:21:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:21:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:21:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:21:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43898747
Fri 17 Jan 2014 23:21:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:21:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43898747
Fri 17 Jan 2014 23:21:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:21:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:21:12 - job_xml_thread(): Done retrieving: data size 43898747
Fri 17 Jan 2014 23:21:12 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:21:12 - XML: Start document: iteration 10
Fri 17 Jan 2014 23:21:13 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:21:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:21:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 23:21:14 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:21:14 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:21:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 23:21:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6098 values 96224 bits 12028 bytes 
Fri 17 Jan 2014 23:21:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:21:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:21:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:21:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:21:28 - XML: Processed 655582 elements - found 688 jobs
Fri 17 Jan 2014 23:21:28 - job 7348638 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 23:21:28 - job 7348486 appears to have finished
Fri 17 Jan 2014 23:21:28 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 23:21:28 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 23:21:29 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 23:21:29 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:21:29 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:21:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:21:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:21:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:21:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:21:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:21:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:21:34 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:21:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:21:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:21:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:21:35 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:21:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:21:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:21:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:21:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:21:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:21:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:21:38 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:21:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43892157
Fri 17 Jan 2014 23:21:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:21:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43892157
Fri 17 Jan 2014 23:21:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:21:45 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:21:45 - job_xml_thread(): Done retrieving: data size 43892157
Fri 17 Jan 2014 23:21:45 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:21:45 - XML: Start document: iteration 11
Fri 17 Jan 2014 23:21:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:21:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:21:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:21:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:21:50 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:21:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:21:50 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:21:50 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:21:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:21:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:21:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:21:57 - XML: Processed 655582 elements - found 688 jobs
Fri 17 Jan 2014 23:21:57 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:21:57 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:21:57 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:21:57 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:21:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:21:59 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:21:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:21:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:21:59 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:21:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 23:21:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:22:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:22:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:22:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:22:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:22:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:22:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862215
Fri 17 Jan 2014 23:22:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:22:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862215
Fri 17 Jan 2014 23:22:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:22:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:22:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:22:13 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:22:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:22:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:22:15 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:22:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:22:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:22:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:22:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:22:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:22:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:22:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:22:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 23:22:15 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:22:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:22:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:22:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:22:15 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:22:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 23:22:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:22:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5769 values 91048 bits 11381 bytes 
Fri 17 Jan 2014 23:22:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:22:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:22:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:22:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:22:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:22:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:22:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:22:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:22:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:22:20 - job_xml_thread(): Done retrieving: data size 43882553
Fri 17 Jan 2014 23:22:20 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:22:20 - XML: Start document: iteration 12
Fri 17 Jan 2014 23:22:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43882553
Fri 17 Jan 2014 23:22:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:22:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43882553
Fri 17 Jan 2014 23:22:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:22:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:22:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:22:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:22:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:22:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:22:39 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:22:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:22:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:22:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:22:40 - XML: Processed 655582 elements - found 688 jobs
Fri 17 Jan 2014 23:22:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:22:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:22:40 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:22:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:22:40 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:22:40 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:22:40 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:22:40 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:22:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:22:45 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:22:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:22:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:22:45 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:22:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 23:22:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:22:45 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 23:22:45 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 23:22:45 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:22:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:22:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:22:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:22:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:22:47 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:22:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43879034
Fri 17 Jan 2014 23:22:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:22:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43879034
Fri 17 Jan 2014 23:22:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:22:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:22:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:22:55 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:22:55 - job_xml_thread(): Done retrieving: data size 43879034
Fri 17 Jan 2014 23:22:55 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:22:55 - XML: Start document: iteration 13
Fri 17 Jan 2014 23:22:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:22:58 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:22:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:22:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:23:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:23:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:23:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:23:01 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:23:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:23:01 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:23:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:23:09 - XML: Processed 655582 elements - found 688 jobs
Fri 17 Jan 2014 23:23:09 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:23:09 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:23:09 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:23:09 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:23:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:23:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:23:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:23:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:23:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:23:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:23:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:23:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:23:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:23:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43874837
Fri 17 Jan 2014 23:23:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:23:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43874837
Fri 17 Jan 2014 23:23:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:23:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:23:16 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:23:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:23:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:23:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:23:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 23:23:16 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:23:16 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:23:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8799 values 138810 bits 17351 bytes 
Fri 17 Jan 2014 23:23:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 23:23:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:23:21 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:23:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:23:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:23:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:23:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:23:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:23:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:23:22 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:23:24 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:23:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:23:24 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:23:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:23:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:23:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:23:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:23:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:23:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:23:26 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:23:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 23:23:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:23:26 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:23:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43820654
Fri 17 Jan 2014 23:23:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:23:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43820654
Fri 17 Jan 2014 23:23:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:23:27 - job_xml_thread(): Done retrieving: data size 43820654
Fri 17 Jan 2014 23:23:27 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:23:28 - XML: Start document: iteration 14
Fri 17 Jan 2014 23:23:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:23:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:23:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:23:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:23:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:23:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:23:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:23:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:23:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:23:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:23:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:23:44 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:23:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:23:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:23:48 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:23:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:23:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:23:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:23:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:23:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:23:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:23:49 - XML: Processed 654832 elements - found 687 jobs
Fri 17 Jan 2014 23:23:49 - job 7348639 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 23:23:49 - job 7348479 appears to have finished
Fri 17 Jan 2014 23:23:49 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 23:23:49 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 23:23:49 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 23:23:49 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:23:49 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:23:51 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:23:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43253476
Fri 17 Jan 2014 23:23:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:23:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43253476
Fri 17 Jan 2014 23:23:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:24:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:24:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:24:01 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:24:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:24:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:24:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:24:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:24:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:24:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:24:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:24:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:24:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:24:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:24:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:24:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:24:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:24:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:24:04 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:24:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:24:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:24:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:24:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:24:06 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:24:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43246097
Fri 17 Jan 2014 23:24:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:24:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43246097
Fri 17 Jan 2014 23:24:06 - job_xml_thread(): Done retrieving: data size 43246097
Fri 17 Jan 2014 23:24:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:24:07 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:24:07 - XML: Start document: iteration 15
Fri 17 Jan 2014 23:24:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:24:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:24:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:24:17 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:24:18 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:24:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:24:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:24:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 23:24:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:24:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 23:24:18 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:24:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148672 bits 18584 bytes 
Fri 17 Jan 2014 23:24:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:24:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:24:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:24:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:24:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:24:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:24:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:24:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:24:24 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:24:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:24:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:24:24 - XML: Processed 647380 elements - found 687 jobs
Fri 17 Jan 2014 23:24:24 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:24:24 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:24:24 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:24:24 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:24:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:24:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:24:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:24:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:24:26 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:24:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 23:24:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:24:26 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:24:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43333313
Fri 17 Jan 2014 23:24:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:24:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43333313
Fri 17 Jan 2014 23:24:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:24:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:24:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:24:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:24:36 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:24:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:24:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:24:38 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:24:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:24:38 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:24:38 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:24:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:24:39 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:24:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:24:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:24:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:24:40 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:24:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:24:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:24:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:24:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:24:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:24:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:24:42 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:24:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43677134
Fri 17 Jan 2014 23:24:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:24:42 - job_xml_thread(): Done retrieving: data size 43677134
Fri 17 Jan 2014 23:24:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43677134
Fri 17 Jan 2014 23:24:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:24:42 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:24:42 - XML: Start document: iteration 16
Fri 17 Jan 2014 23:24:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:24:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:24:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:24:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:24:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:24:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:24:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:24:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:25:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:25:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:25:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:25:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:25:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:25:05 - XML: Processed 652788 elements - found 687 jobs
Fri 17 Jan 2014 23:25:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:25:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:25:05 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:25:05 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:25:05 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:25:05 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:25:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:25:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:25:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:25:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:25:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:25:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:25:07 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:25:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43881688
Fri 17 Jan 2014 23:25:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:25:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43881688
Fri 17 Jan 2014 23:25:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:25:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:25:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:25:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:25:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:25:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:25:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:25:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:25:18 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:25:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:25:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:25:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:25:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:25:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:25:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:25:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 23:25:19 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:25:19 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:25:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 23:25:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148676 bits 18584 bytes 
Fri 17 Jan 2014 23:25:20 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:25:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:25:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:25:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:25:21 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:25:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:25:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:25:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:25:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:25:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:25:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:25:23 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:25:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43895284
Fri 17 Jan 2014 23:25:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:25:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43895284
Fri 17 Jan 2014 23:25:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:25:24 - job_xml_thread(): Done retrieving: data size 43895284
Fri 17 Jan 2014 23:25:24 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:25:24 - XML: Start document: iteration 17
Fri 17 Jan 2014 23:25:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:25:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:25:36 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:25:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 23:25:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:25:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:25:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:25:46 - XML: Processed 655578 elements - found 686 jobs
Fri 17 Jan 2014 23:25:46 - job 7348643 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 23:25:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:25:46 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:25:46 - job 7348642 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 23:25:46 - job 7348641 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 23:25:46 - job 7348640 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 23:25:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:25:46 - job 7348476 appears to have finished
Fri 17 Jan 2014 23:25:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:25:46 - job_xml_thread(): Found 5 updated jobs.
Fri 17 Jan 2014 23:25:46 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 23:25:47 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:25:47 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:25:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:25:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:25:47 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:25:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:25:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:25:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:25:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:25:47 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Fri 17 Jan 2014 23:25:47 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:25:47 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:25:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:25:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:25:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:25:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:25:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:25:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43901352
Fri 17 Jan 2014 23:25:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:25:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43901352
Fri 17 Jan 2014 23:25:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:26:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:26:01 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:26:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:26:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:26:03 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:26:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:26:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:26:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:26:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:26:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:26:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:26:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:26:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:26:04 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:26:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:26:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:26:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:26:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:26:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:26:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:26:05 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:26:05 - job_xml_thread(): Done retrieving: data size 43911818
Fri 17 Jan 2014 23:26:05 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:26:05 - XML: Start document: iteration 18
Fri 17 Jan 2014 23:26:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43911818
Fri 17 Jan 2014 23:26:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:26:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43911818
Fri 17 Jan 2014 23:26:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:26:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:26:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:26:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:26:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:26:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:26:20 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:26:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:26:20 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:26:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 23:26:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 23:26:20 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:26:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9350 values 147637 bits 18454 bytes 
Fri 17 Jan 2014 23:26:28 - XML: Processed 655578 elements - found 686 jobs
Fri 17 Jan 2014 23:26:28 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:26:28 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:26:28 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:26:28 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:26:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:26:29 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:26:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:26:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:26:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:26:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:26:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:26:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:26:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:26:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:26:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:26:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:26:29 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:26:29 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:26:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:26:29 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:26:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:26:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:26:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43901372
Fri 17 Jan 2014 23:26:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:26:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43901372
Fri 17 Jan 2014 23:26:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:26:43 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:26:43 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:26:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:26:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:26:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:26:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:26:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:26:45 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:26:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:26:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:26:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:26:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:26:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:26:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:26:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:26:48 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:26:48 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:26:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 23:26:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:26:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:26:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:26:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:26:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:26:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:26:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:26:48 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 23:26:48 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:26:49 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:26:49 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:26:49 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 23:26:49 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 23:26:49 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 23:26:50 - size of cluster 'LISA Cluster': 624 hosts 79469 metrics 852366 values 13449225 bits 1681153 bytes 
Fri 17 Jan 2014 23:26:51 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:26:51 - job_xml_thread(): Done retrieving: data size 43899668
Fri 17 Jan 2014 23:26:51 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:26:51 - XML: Start document: iteration 19
Fri 17 Jan 2014 23:26:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43899668
Fri 17 Jan 2014 23:26:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43899668
Fri 17 Jan 2014 23:26:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:26:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:27:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:27:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:27:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:27:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:27:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:27:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:27:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:27:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:27:05 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:27:05 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:27:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:27:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:27:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:27:08 - XML: Processed 655578 elements - found 686 jobs
Fri 17 Jan 2014 23:27:08 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:27:08 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:27:08 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:27:08 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:27:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:27:13 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:27:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:27:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:27:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:27:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:27:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:27:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:27:15 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:27:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867642
Fri 17 Jan 2014 23:27:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:27:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43867642
Fri 17 Jan 2014 23:27:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:27:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:27:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:27:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:27:20 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:27:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:27:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 23:27:21 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:27:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 23:27:22 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:27:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9179 values 144888 bits 18111 bytes 
Fri 17 Jan 2014 23:27:23 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:27:23 - job_xml_thread(): Done retrieving: data size 43867642
Fri 17 Jan 2014 23:27:23 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:27:23 - XML: Start document: iteration 20
Fri 17 Jan 2014 23:27:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:27:27 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:27:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:27:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:27:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:27:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:27:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:27:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:27:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:27:29 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:27:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:27:35 - XML: Processed 655572 elements - found 684 jobs
Fri 17 Jan 2014 23:27:35 - job 7348644 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 23:27:35 - job 7348485 appears to have finished
Fri 17 Jan 2014 23:27:35 - job 7348409 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 23:27:35 - job 7348490 appears to have finished
Fri 17 Jan 2014 23:27:35 - job 7348467 appears to have finished
Fri 17 Jan 2014 23:27:35 - job 7348474 appears to have finished
Fri 17 Jan 2014 23:27:35 - job_xml_thread(): Found 8 updated jobs.
Fri 17 Jan 2014 23:27:35 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 23:27:38 - job_xml_thread(): Done storing. succesfully stored: 8 jobs
Fri 17 Jan 2014 23:27:38 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:27:38 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:27:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:27:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:27:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:27:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:27:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:27:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:27:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:27:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:27:43 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:27:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856176
Fri 17 Jan 2014 23:27:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:27:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:27:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:27:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43856176
Fri 17 Jan 2014 23:27:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:27:49 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:27:49 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 23:27:53 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:27:53 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:27:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:27:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:27:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:27:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:27:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:27:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:27:56 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:27:56 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:27:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:27:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:28:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:28:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:28:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:28:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:28:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:28:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:28:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:28:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:28:00 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:28:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 23:28:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:28:03 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:28:03 - job_xml_thread(): Done retrieving: data size 43876602
Fri 17 Jan 2014 23:28:03 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:28:03 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 23:28:03 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 23:28:03 - Housekeeping: done.
Fri 17 Jan 2014 23:28:03 - XML: Start document: iteration 0
Fri 17 Jan 2014 23:28:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43876602
Fri 17 Jan 2014 23:28:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:28:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43876602
Fri 17 Jan 2014 23:28:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:28:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:28:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:28:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:28:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:28:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:28:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:28:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:28:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:28:18 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:28:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:28:18 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:28:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:28:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:28:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:28:21 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:28:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:28:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 23:28:22 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:28:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5766 values 90932 bits 11366 bytes 
Fri 17 Jan 2014 23:28:23 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:28:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 23:28:23 - XML: Processed 655574 elements - found 684 jobs
Fri 17 Jan 2014 23:28:23 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:28:23 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:28:23 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:28:23 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:28:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:28:26 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:28:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:28:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:28:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:28:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:28:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:28:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:28:30 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:28:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856920
Fri 17 Jan 2014 23:28:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:28:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43856920
Fri 17 Jan 2014 23:28:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:28:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:28:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:28:39 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:28:39 - job_xml_thread(): Done retrieving: data size 43856920
Fri 17 Jan 2014 23:28:39 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:28:39 - XML: Start document: iteration 1
Fri 17 Jan 2014 23:28:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:28:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:28:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:28:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:28:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:28:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:28:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:28:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:28:47 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:28:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:28:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:28:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:28:48 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:28:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:28:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:28:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:28:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:28:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:28:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:28:51 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:28:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 23:28:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:28:53 - XML: Processed 655574 elements - found 684 jobs
Fri 17 Jan 2014 23:28:53 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:28:53 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:28:53 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:28:53 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:28:56 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:28:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43882179
Fri 17 Jan 2014 23:28:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:28:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43882179
Fri 17 Jan 2014 23:28:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:29:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:29:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:29:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:29:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:29:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:29:06 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:29:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:29:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:29:07 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:29:07 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:29:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:29:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:29:07 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:29:09 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:29:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:29:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:29:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:29:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:29:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:29:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:29:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:29:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:29:14 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:29:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43797874
Fri 17 Jan 2014 23:29:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:29:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43797874
Fri 17 Jan 2014 23:29:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:29:15 - job_xml_thread(): Done retrieving: data size 43797874
Fri 17 Jan 2014 23:29:15 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:29:15 - XML: Start document: iteration 2
Fri 17 Jan 2014 23:29:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:29:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:29:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:29:23 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:29:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:29:24 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:29:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 23:29:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 23:29:24 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:29:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8946 values 141162 bits 17645 bytes 
Fri 17 Jan 2014 23:29:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:29:25 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:29:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:29:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:29:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:29:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:29:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:29:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:29:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:29:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:29:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:29:36 - XML: Processed 654814 elements - found 678 jobs
Fri 17 Jan 2014 23:29:36 - job 7348483 appears to have finished
Fri 17 Jan 2014 23:29:36 - job 7348482 appears to have finished
Fri 17 Jan 2014 23:29:36 - job 7347734 appears to have finished
Fri 17 Jan 2014 23:29:36 - job 7348477 appears to have finished
Fri 17 Jan 2014 23:29:36 - job 7348472 appears to have finished
Fri 17 Jan 2014 23:29:36 - job 7346461 appears to have finished
Fri 17 Jan 2014 23:29:36 - job_xml_thread(): Found 6 updated jobs.
Fri 17 Jan 2014 23:29:36 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 23:29:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:29:38 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:29:38 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Fri 17 Jan 2014 23:29:38 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:29:38 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:29:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:29:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:29:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:29:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:29:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:29:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:29:39 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 23:29:39 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 23:29:39 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:29:40 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:29:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43378256
Fri 17 Jan 2014 23:29:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:29:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43378256
Fri 17 Jan 2014 23:29:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:29:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:29:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:29:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:29:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:29:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:29:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:29:53 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:29:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:29:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:29:53 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:29:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:29:53 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:29:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:29:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:29:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:29:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:29:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:29:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:29:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:29:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:29:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:29:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:29:56 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:29:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 23:29:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:29:57 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:29:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43222564
Fri 17 Jan 2014 23:29:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:29:58 - job_xml_thread(): Done retrieving: data size 43222564
Fri 17 Jan 2014 23:29:58 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:29:58 - XML: Start document: iteration 3
Fri 17 Jan 2014 23:29:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43222564
Fri 17 Jan 2014 23:29:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:30:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:30:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:30:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:30:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:30:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:30:13 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:30:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:30:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:30:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:30:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:30:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:30:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:30:15 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:30:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:30:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:30:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:30:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:30:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:30:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:30:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:30:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:30:16 - XML: Processed 647406 elements - found 678 jobs
Fri 17 Jan 2014 23:30:16 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:30:16 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:30:16 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:30:16 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:30:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:30:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43299960
Fri 17 Jan 2014 23:30:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:30:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43299960
Fri 17 Jan 2014 23:30:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:30:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:30:24 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:30:25 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:30:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:30:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 23:30:26 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:30:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8950 values 141144 bits 17643 bytes 
Fri 17 Jan 2014 23:30:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 23:30:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:30:29 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:30:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:30:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:30:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:30:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:30:31 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:30:31 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:30:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:30:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:30:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:30:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:30:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:30:32 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:30:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:30:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:30:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:30:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:30:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:30:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:30:34 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:30:34 - job_xml_thread(): Done retrieving: data size 43403508
Fri 17 Jan 2014 23:30:34 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:30:34 - XML: Start document: iteration 4
Fri 17 Jan 2014 23:30:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43403508
Fri 17 Jan 2014 23:30:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:30:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43403508
Fri 17 Jan 2014 23:30:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:30:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:30:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:30:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:30:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:30:48 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:30:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 23:30:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:30:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:30:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:30:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:30:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:30:51 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:30:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:30:51 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:30:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:30:51 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:30:54 - XML: Processed 649320 elements - found 678 jobs
Fri 17 Jan 2014 23:30:54 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:30:54 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:30:54 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:30:54 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:30:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:30:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:30:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:30:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:30:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:30:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:30:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:30:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:30:57 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:30:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856780
Fri 17 Jan 2014 23:30:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:30:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43856780
Fri 17 Jan 2014 23:30:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:31:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:31:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:31:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:31:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:31:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:31:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:31:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:31:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:31:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:31:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:31:09 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:31:09 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:31:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:31:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:31:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:31:12 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:31:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:31:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:31:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:31:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:31:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:31:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:31:14 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:31:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43871827
Fri 17 Jan 2014 23:31:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:31:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43871827
Fri 17 Jan 2014 23:31:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:31:15 - job_xml_thread(): Done retrieving: data size 43871827
Fri 17 Jan 2014 23:31:15 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:31:15 - XML: Start document: iteration 5
Fri 17 Jan 2014 23:31:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:31:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:31:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:31:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:31:25 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:31:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:31:25 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:31:25 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:31:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:31:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:31:26 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:31:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:31:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 23:31:26 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:31:26 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:31:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9363 values 147848 bits 18481 bytes 
Fri 17 Jan 2014 23:31:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 23:31:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:31:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:31:33 - XML: Processed 655554 elements - found 674 jobs
Fri 17 Jan 2014 23:31:33 - job 7348484 appears to have finished
Fri 17 Jan 2014 23:31:33 - job 7348491 appears to have finished
Fri 17 Jan 2014 23:31:33 - job 7348468 appears to have finished
Fri 17 Jan 2014 23:31:33 - job 7348478 appears to have finished
Fri 17 Jan 2014 23:31:33 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 23:31:33 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 23:31:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:31:34 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:31:34 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 23:31:34 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:31:34 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:31:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:31:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:31:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:31:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:31:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:31:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:31:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:31:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43866428
Fri 17 Jan 2014 23:31:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:31:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43866428
Fri 17 Jan 2014 23:31:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:31:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:31:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:31:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:31:45 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:31:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:31:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:31:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:31:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:31:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:31:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:31:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:31:49 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:31:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:31:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:31:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:31:50 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:31:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:31:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:31:50 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:31:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 23:31:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:31:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:31:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:31:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:31:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:31:51 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:31:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43897740
Fri 17 Jan 2014 23:31:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:31:52 - job_xml_thread(): Done retrieving: data size 43897740
Fri 17 Jan 2014 23:31:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43897740
Fri 17 Jan 2014 23:31:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:31:52 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:31:53 - XML: Start document: iteration 6
Fri 17 Jan 2014 23:32:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:32:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:32:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:32:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:32:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:32:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:32:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:32:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:32:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:32:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:32:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:32:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:32:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:32:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:32:13 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:32:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:32:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:32:13 - XML: Processed 655554 elements - found 674 jobs
Fri 17 Jan 2014 23:32:13 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:32:13 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:32:13 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:32:13 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:32:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:32:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:32:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:32:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:32:15 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:32:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853491
Fri 17 Jan 2014 23:32:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:32:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853491
Fri 17 Jan 2014 23:32:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:32:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:32:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:32:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:32:26 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:32:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:32:27 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:32:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:32:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:32:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:32:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:32:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:32:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:32:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:32:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:32:28 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:32:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 23:32:28 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:32:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 23:32:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8815 values 139321 bits 17415 bytes 
Fri 17 Jan 2014 23:32:29 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:32:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:32:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:32:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:32:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:32:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:32:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:32:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:32:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:32:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:32:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43897244
Fri 17 Jan 2014 23:32:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:32:32 - job_xml_thread(): Done retrieving: data size 43897244
Fri 17 Jan 2014 23:32:32 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:32:32 - XML: Start document: iteration 7
Fri 17 Jan 2014 23:32:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43897244
Fri 17 Jan 2014 23:32:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:32:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:32:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:32:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:32:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:32:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:32:49 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:32:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:32:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:32:50 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:32:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:32:50 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:32:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:32:50 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:32:50 - XML: Processed 655554 elements - found 674 jobs
Fri 17 Jan 2014 23:32:50 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:32:50 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:32:50 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:32:50 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:32:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:32:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:32:54 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:32:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 23:32:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:32:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:32:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:32:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:32:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:32:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:32:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:32:56 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:32:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43880850
Fri 17 Jan 2014 23:32:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:32:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43880850
Fri 17 Jan 2014 23:32:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:33:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:33:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:33:06 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:33:06 - job_xml_thread(): Done retrieving: data size 43880850
Fri 17 Jan 2014 23:33:06 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:33:06 - XML: Start document: iteration 8
Fri 17 Jan 2014 23:33:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:33:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:33:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:33:14 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:33:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:33:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:33:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:33:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:33:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:33:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:33:15 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:33:15 - XML: Processed 655550 elements - found 674 jobs
Fri 17 Jan 2014 23:33:15 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:33:15 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:33:15 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:33:15 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:33:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:33:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:33:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:33:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:33:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:33:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:33:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:33:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:33:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:33:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43898352
Fri 17 Jan 2014 23:33:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:33:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43898352
Fri 17 Jan 2014 23:33:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:33:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:33:28 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:33:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:33:29 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:33:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:33:30 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:33:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 23:33:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 23:33:30 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:33:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8996 values 142306 bits 17788 bytes 
Fri 17 Jan 2014 23:33:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:33:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:33:30 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:33:31 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:33:31 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:33:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:33:31 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:33:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:33:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:33:32 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:33:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:33:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:33:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:33:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:33:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:33:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:33:34 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:33:34 - job_xml_thread(): Done retrieving: data size 43901541
Fri 17 Jan 2014 23:33:34 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:33:34 - XML: Start document: iteration 9
Fri 17 Jan 2014 23:33:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43901541
Fri 17 Jan 2014 23:33:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:33:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43901541
Fri 17 Jan 2014 23:33:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:33:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:33:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:33:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:33:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:33:49 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 23:33:49 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:33:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:33:50 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:33:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:33:50 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:33:50 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 23:33:50 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:33:50 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 23:33:50 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 23:33:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:33:51 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:33:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:33:51 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:33:51 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:33:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:33:52 - size of cluster 'LISA Cluster': 624 hosts 79484 metrics 920500 values 14555048 bits 1819381 bytes 
Fri 17 Jan 2014 23:33:56 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:33:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 23:33:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:33:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:33:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:33:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:33:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:33:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:33:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:33:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:33:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:33:58 - XML: Processed 655548 elements - found 671 jobs
Fri 17 Jan 2014 23:33:58 - job 7348492 appears to have finished
Fri 17 Jan 2014 23:33:58 - job 7348470 appears to have finished
Fri 17 Jan 2014 23:33:58 - job 7348471 appears to have finished
Fri 17 Jan 2014 23:33:58 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 23:33:58 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 23:33:58 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 23:33:58 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:33:58 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:34:01 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:34:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43864894
Fri 17 Jan 2014 23:34:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:34:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43864894
Fri 17 Jan 2014 23:34:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:34:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:34:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:34:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:34:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:34:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:34:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:34:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:34:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:34:13 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:34:13 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:34:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:34:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:34:13 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:34:13 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:34:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:34:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:34:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:34:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:34:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:34:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:34:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:34:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:34:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:34:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43888996
Fri 17 Jan 2014 23:34:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:34:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43888996
Fri 17 Jan 2014 23:34:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:34:20 - job_xml_thread(): Done retrieving: data size 43888996
Fri 17 Jan 2014 23:34:21 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:34:21 - XML: Start document: iteration 10
Fri 17 Jan 2014 23:34:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:34:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:34:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:34:30 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:34:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:34:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 23:34:30 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:34:30 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:34:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 23:34:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8928 values 140927 bits 17615 bytes 
Fri 17 Jan 2014 23:34:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:34:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:34:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:34:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:34:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:34:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:34:35 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:34:35 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:34:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:34:35 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:34:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:34:37 - XML: Processed 655548 elements - found 671 jobs
Fri 17 Jan 2014 23:34:37 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:34:37 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:34:37 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:34:37 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:34:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:34:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:34:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:34:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:34:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:34:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:34:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:34:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:34:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:34:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43864642
Fri 17 Jan 2014 23:34:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:34:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43864642
Fri 17 Jan 2014 23:34:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:34:50 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:34:50 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 23:34:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:34:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:34:52 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:34:52 - job_xml_thread(): Done retrieving: data size 43864642
Fri 17 Jan 2014 23:34:52 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:34:52 - XML: Start document: iteration 11
Fri 17 Jan 2014 23:34:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:34:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:35:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:35:01 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:35:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:35:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:35:02 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:35:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:35:02 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:35:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:35:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:35:09 - XML: Processed 655548 elements - found 671 jobs
Fri 17 Jan 2014 23:35:09 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:35:09 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:35:09 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:35:09 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:35:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:35:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:35:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:35:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:35:11 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:35:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 23:35:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:35:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:35:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:35:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:35:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:35:14 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:35:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43848940
Fri 17 Jan 2014 23:35:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:35:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43848940
Fri 17 Jan 2014 23:35:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:35:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:35:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:35:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:35:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:35:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:35:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:35:24 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:35:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:35:25 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:35:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:35:25 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:35:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:35:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:35:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:35:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:35:29 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:35:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:35:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:35:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:35:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:35:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:35:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:35:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:35:31 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:35:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:35:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 23:35:31 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:35:31 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:35:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5545 values 87436 bits 10929 bytes 
Fri 17 Jan 2014 23:35:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 23:35:32 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:35:32 - job_xml_thread(): Done retrieving: data size 43776267
Fri 17 Jan 2014 23:35:32 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:35:32 - XML: Start document: iteration 12
Fri 17 Jan 2014 23:35:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43776267
Fri 17 Jan 2014 23:35:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:35:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43776267
Fri 17 Jan 2014 23:35:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:35:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:35:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:35:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:35:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:35:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:35:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:35:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:35:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:35:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:35:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:35:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:35:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:35:52 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:35:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:35:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:35:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:35:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:35:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:35:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:35:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:35:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:35:57 - XML: Processed 654448 elements - found 669 jobs
Fri 17 Jan 2014 23:35:57 - job 7348488 appears to have finished
Fri 17 Jan 2014 23:35:57 - job 7348469 appears to have finished
Fri 17 Jan 2014 23:35:57 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 23:35:57 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 23:35:57 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 23:35:57 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:35:57 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:36:00 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:36:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 23:36:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:36:01 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:36:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43208826
Fri 17 Jan 2014 23:36:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:36:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43208826
Fri 17 Jan 2014 23:36:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:36:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:36:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:36:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:36:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:36:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:36:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:36:11 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:36:11 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:36:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:36:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:36:11 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:36:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:36:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:36:12 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:36:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:36:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:36:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:36:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:36:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:36:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:36:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:36:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:36:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:36:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43287345
Fri 17 Jan 2014 23:36:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:36:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43287345
Fri 17 Jan 2014 23:36:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:36:19 - job_xml_thread(): Done retrieving: data size 43287345
Fri 17 Jan 2014 23:36:19 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:36:19 - XML: Start document: iteration 13
Fri 17 Jan 2014 23:36:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:36:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:36:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:36:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:36:31 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:36:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:36:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:36:32 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:36:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 23:36:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 23:36:33 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:36:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7185 values 113341 bits 14167 bytes 
Fri 17 Jan 2014 23:36:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:36:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:36:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:36:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:36:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:36:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:36:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:36:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:36:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:36:39 - XML: Processed 648092 elements - found 669 jobs
Fri 17 Jan 2014 23:36:39 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:36:39 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:36:39 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:36:39 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:36:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:36:42 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:36:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:36:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:36:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:36:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:36:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:36:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:36:46 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:36:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43781041
Fri 17 Jan 2014 23:36:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:36:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43781041
Fri 17 Jan 2014 23:36:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:36:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:36:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:36:54 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:36:54 - job_xml_thread(): Done retrieving: data size 43781041
Fri 17 Jan 2014 23:36:54 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:36:54 - XML: Start document: iteration 14
Fri 17 Jan 2014 23:36:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:36:57 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:36:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:36:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:36:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:36:58 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:36:58 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:36:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:36:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:36:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:36:58 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:37:03 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:37:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 23:37:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:37:07 - XML: Processed 654510 elements - found 669 jobs
Fri 17 Jan 2014 23:37:08 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:37:08 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:37:08 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:37:08 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:37:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:37:10 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:37:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:37:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:37:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:37:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:37:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:37:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:37:11 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 23:37:11 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 23:37:11 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:37:12 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:37:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43843462
Fri 17 Jan 2014 23:37:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:37:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:37:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43843462
Fri 17 Jan 2014 23:37:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:37:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:37:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:37:19 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:37:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:37:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:37:22 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:37:22 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:37:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:37:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43843462
Fri 17 Jan 2014 23:37:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:37:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:37:23 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:37:23 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:37:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:37:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:37:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:37:33 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:37:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:37:33 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:37:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:37:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:37:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:37:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:37:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:37:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:37:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:37:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 23:37:34 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:37:34 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:37:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:37:34 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:37:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6010 values 94866 bits 11858 bytes 
Fri 17 Jan 2014 23:37:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 23:37:37 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:37:37 - job_xml_thread(): Done retrieving: data size 43869299
Fri 17 Jan 2014 23:37:37 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:37:37 - XML: Start document: iteration 15
Fri 17 Jan 2014 23:37:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43869299
Fri 17 Jan 2014 23:37:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:37:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:37:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:37:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:37:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:37:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:37:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43869299
Fri 17 Jan 2014 23:37:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:37:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:37:47 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:37:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 23:37:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:37:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:37:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:37:50 - XML: Processed 655542 elements - found 668 jobs
Fri 17 Jan 2014 23:37:50 - job 7348481 appears to have finished
Fri 17 Jan 2014 23:37:50 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 23:37:50 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 23:37:51 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 23:37:51 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:37:51 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:37:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:37:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:37:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:37:58 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:37:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:37:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:37:59 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:37:59 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:37:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:37:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:37:59 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:37:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:37:59 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:37:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:37:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:38:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:38:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:38:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:38:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:38:01 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:38:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43892796
Fri 17 Jan 2014 23:38:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:38:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43892796
Fri 17 Jan 2014 23:38:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:38:07 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:38:07 - job_xml_thread(): Done retrieving: data size 43892796
Fri 17 Jan 2014 23:38:07 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:38:07 - XML: Start document: iteration 16
Fri 17 Jan 2014 23:38:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:38:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:38:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:38:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:38:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:38:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:38:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:38:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:38:15 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:38:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:38:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:38:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:38:23 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:38:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:38:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:38:24 - XML: Processed 655542 elements - found 668 jobs
Fri 17 Jan 2014 23:38:24 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:38:24 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:38:24 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:38:24 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:38:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:38:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:38:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:38:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:38:25 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:38:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870128
Fri 17 Jan 2014 23:38:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:38:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870128
Fri 17 Jan 2014 23:38:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:38:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:38:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:38:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:38:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:38:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:38:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:38:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:38:34 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:38:34 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:38:34 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:38:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:38:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:38:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870128
Fri 17 Jan 2014 23:38:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:38:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:38:35 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:38:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 23:38:35 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:38:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9379 values 147975 bits 18496 bytes 
Fri 17 Jan 2014 23:38:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 23:38:39 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:38:39 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:38:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:38:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:38:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:38:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:38:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:38:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:38:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:38:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:38:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:38:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:38:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:38:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:38:45 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:38:45 - job_xml_thread(): Done retrieving: data size 43873606
Fri 17 Jan 2014 23:38:45 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:38:45 - XML: Start document: iteration 17
Fri 17 Jan 2014 23:38:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873606
Fri 17 Jan 2014 23:38:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:38:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:38:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:38:51 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:38:51 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:38:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:38:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:38:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873606
Fri 17 Jan 2014 23:38:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:38:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:38:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:39:00 - XML: Processed 655542 elements - found 668 jobs
Fri 17 Jan 2014 23:39:00 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:39:00 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:39:00 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:39:00 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:39:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:39:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:39:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:39:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:39:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:39:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:39:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:39:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:39:06 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:39:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:39:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:39:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:39:08 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:39:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:39:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:39:08 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:39:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 23:39:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:39:09 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:39:09 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:39:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:39:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:39:10 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:39:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43896214
Fri 17 Jan 2014 23:39:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:39:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43896214
Fri 17 Jan 2014 23:39:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:39:16 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:39:16 - job_xml_thread(): Done retrieving: data size 43896214
Fri 17 Jan 2014 23:39:16 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:39:16 - XML: Start document: iteration 18
Fri 17 Jan 2014 23:39:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:39:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:39:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:39:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:39:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:39:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:39:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:39:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:39:27 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:39:27 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:39:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:39:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:39:27 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:39:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:39:31 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:39:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:39:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:39:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:39:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:39:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:39:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:39:33 - XML: Processed 655540 elements - found 667 jobs
Fri 17 Jan 2014 23:39:33 - job 7348475 appears to have finished
Fri 17 Jan 2014 23:39:33 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 23:39:33 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 23:39:33 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 23:39:33 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:39:33 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:39:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:39:35 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:39:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:39:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873639
Fri 17 Jan 2014 23:39:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:39:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873639
Fri 17 Jan 2014 23:39:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:39:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:39:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 23:39:36 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:39:36 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:39:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 23:39:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9199 values 145143 bits 18142 bytes 
Fri 17 Jan 2014 23:39:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:39:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:39:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:39:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:39:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:39:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:39:43 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:39:43 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:39:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:39:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:39:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873639
Fri 17 Jan 2014 23:39:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:39:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:39:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:39:48 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:39:48 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:39:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:39:53 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:39:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:39:57 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:39:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:39:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:39:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:39:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:39:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:39:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:39:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:39:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:39:59 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:39:59 - job_xml_thread(): Done retrieving: data size 43849139
Fri 17 Jan 2014 23:39:59 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:39:59 - XML: Start document: iteration 19
Fri 17 Jan 2014 23:39:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43849139
Fri 17 Jan 2014 23:39:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:39:59 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:39:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:39:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43849139
Fri 17 Jan 2014 23:39:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:40:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:40:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:40:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:40:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:40:14 - XML: Processed 655540 elements - found 667 jobs
Fri 17 Jan 2014 23:40:14 - job 7348410 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 23:40:15 - job 7348411 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 23:40:15 - job 7348688 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 23:40:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:40:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:40:15 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 23:40:15 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 23:40:17 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 23:40:17 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:40:17 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:40:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:40:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:40:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:40:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:40:17 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:40:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:40:17 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:40:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:40:17 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:40:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:40:21 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:40:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:40:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:40:21 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:40:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 23:40:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:40:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:40:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:40:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:40:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:40:23 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:40:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43895406
Fri 17 Jan 2014 23:40:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:40:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43895406
Fri 17 Jan 2014 23:40:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:40:32 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:40:32 - job_xml_thread(): Done retrieving: data size 43895406
Fri 17 Jan 2014 23:40:32 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:40:32 - XML: Start document: iteration 20
Fri 17 Jan 2014 23:40:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:40:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:40:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:40:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:40:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:40:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:40:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:40:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:40:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:40:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:40:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:40:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:40:37 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:40:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:40:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:40:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:40:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 23:40:37 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:40:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 23:40:38 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:40:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6015 values 94895 bits 11861 bytes 
Fri 17 Jan 2014 23:40:47 - XML: Processed 655540 elements - found 667 jobs
Fri 17 Jan 2014 23:40:47 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:40:47 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:40:47 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:40:47 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:40:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:40:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:40:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:40:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:40:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:40:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:40:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:40:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:40:50 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:40:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43859110
Fri 17 Jan 2014 23:40:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:40:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43859110
Fri 17 Jan 2014 23:40:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:40:51 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 23:40:51 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:40:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:40:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:40:52 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:40:52 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 23:40:52 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 23:40:52 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:40:52 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 23:41:01 - size of cluster 'LISA Cluster': 624 hosts 79468 metrics 831014 values 13114859 bits 1639357 bytes 
Fri 17 Jan 2014 23:41:02 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:41:02 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:41:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:41:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:41:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:41:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:41:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:41:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:41:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:41:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:41:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:41:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:41:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:41:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:41:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:41:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:41:07 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:41:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 23:41:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:41:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:41:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:41:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:41:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:41:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:41:11 - job_xml_thread(): Done retrieving: data size 43883343
Fri 17 Jan 2014 23:41:11 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:41:11 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 23:41:11 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 23:41:11 - Housekeeping: done.
Fri 17 Jan 2014 23:41:11 - XML: Start document: iteration 0
Fri 17 Jan 2014 23:41:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43883343
Fri 17 Jan 2014 23:41:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43883343
Fri 17 Jan 2014 23:41:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:41:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:41:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:41:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:41:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:41:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:41:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:41:27 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:41:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:41:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:41:27 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:41:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:41:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:41:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:41:28 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:41:33 - XML: Processed 655537 elements - found 667 jobs
Fri 17 Jan 2014 23:41:34 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:41:34 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:41:34 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:41:34 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:41:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:41:35 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:41:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:41:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:41:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:41:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:41:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:41:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:41:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:41:38 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:41:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:41:38 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:41:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 23:41:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 23:41:38 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:41:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5873 values 92645 bits 11580 bytes 
Fri 17 Jan 2014 23:41:39 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:41:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43393069
Fri 17 Jan 2014 23:41:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:41:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43393069
Fri 17 Jan 2014 23:41:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:41:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:41:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:41:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:41:48 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:41:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:41:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:41:49 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:41:49 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:41:50 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:41:50 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:41:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:41:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:41:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:41:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:41:52 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:41:52 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 23:41:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:41:53 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:41:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:41:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:41:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:41:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:41:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:41:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:41:56 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:41:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 23:41:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:41:57 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:41:57 - job_xml_thread(): Done retrieving: data size 43232191
Fri 17 Jan 2014 23:41:57 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:41:57 - XML: Start document: iteration 1
Fri 17 Jan 2014 23:41:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43232191
Fri 17 Jan 2014 23:41:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43232191
Fri 17 Jan 2014 23:41:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:41:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:42:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:42:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:42:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:42:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:42:13 - XML: Processed 647534 elements - found 662 jobs
Fri 17 Jan 2014 23:42:13 - job 7348452 appears to have finished
Fri 17 Jan 2014 23:42:13 - job 7348450 appears to have finished
Fri 17 Jan 2014 23:42:13 - job 7348489 appears to have finished
Fri 17 Jan 2014 23:42:13 - job 7348654 appears to have finished
Fri 17 Jan 2014 23:42:13 - job 7348667 appears to have finished
Fri 17 Jan 2014 23:42:13 - job_xml_thread(): Found 5 updated jobs.
Fri 17 Jan 2014 23:42:13 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 23:42:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:42:13 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:42:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:42:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:42:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:42:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:42:15 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:42:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:42:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:42:15 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Fri 17 Jan 2014 23:42:15 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:42:15 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:42:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:42:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:42:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:42:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:42:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:42:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:42:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:42:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:42:22 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:42:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43289050
Fri 17 Jan 2014 23:42:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:42:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43289050
Fri 17 Jan 2014 23:42:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:42:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:42:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:42:30 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:42:30 - job_xml_thread(): Done retrieving: data size 43289050
Fri 17 Jan 2014 23:42:30 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:42:30 - XML: Start document: iteration 2
Fri 17 Jan 2014 23:42:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:42:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:42:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:42:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:42:38 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:42:38 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:42:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:42:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:42:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:42:40 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:42:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 23:42:40 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:42:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 23:42:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7114 values 112235 bits 14029 bytes 
Fri 17 Jan 2014 23:42:41 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:42:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:42:41 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:42:41 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:42:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:42:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:42:44 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:42:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:42:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:42:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:42:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:42:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:42:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:42:45 - XML: Processed 648078 elements - found 662 jobs
Fri 17 Jan 2014 23:42:45 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:42:45 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:42:45 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:42:45 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:42:49 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:42:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43813000
Fri 17 Jan 2014 23:42:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:42:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43813000
Fri 17 Jan 2014 23:42:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:42:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:42:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:42:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:42:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:43:01 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:43:01 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:43:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:43:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:43:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:43:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:43:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:43:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:43:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:43:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:43:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:43:05 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:43:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:43:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:43:05 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:43:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 23:43:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:43:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:43:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:43:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:43:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:43:08 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:43:08 - job_xml_thread(): Done retrieving: data size 43890980
Fri 17 Jan 2014 23:43:08 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:43:08 - XML: Start document: iteration 3
Fri 17 Jan 2014 23:43:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43890980
Fri 17 Jan 2014 23:43:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:43:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43890980
Fri 17 Jan 2014 23:43:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:43:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:43:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:43:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:43:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:43:25 - XML: Processed 655512 elements - found 662 jobs
Fri 17 Jan 2014 23:43:25 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:43:25 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:43:25 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:43:25 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:43:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:43:29 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:43:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:43:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:43:30 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:43:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:43:30 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:43:30 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:43:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:43:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:43:32 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:43:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:43:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:43:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:43:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:43:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:43:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:43:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:43:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43887504
Fri 17 Jan 2014 23:43:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:43:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43887504
Fri 17 Jan 2014 23:43:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:43:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:43:40 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:43:40 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:43:40 - job_xml_thread(): Done retrieving: data size 43887504
Fri 17 Jan 2014 23:43:40 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:43:40 - XML: Start document: iteration 4
Fri 17 Jan 2014 23:43:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:43:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 23:43:42 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:43:42 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:43:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 23:43:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8678 values 136882 bits 17110 bytes 
Fri 17 Jan 2014 23:43:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:43:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:43:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:43:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:43:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:43:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:43:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:43:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:43:54 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:43:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:43:54 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:43:54 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:43:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:44:00 - XML: Processed 655532 elements - found 663 jobs
Fri 17 Jan 2014 23:44:00 - job_xml_thread(): Found 1 updated jobs.
Fri 17 Jan 2014 23:44:00 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 23:44:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:44:00 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:44:00 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Fri 17 Jan 2014 23:44:00 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:44:00 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:44:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:44:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:44:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:44:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:44:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:44:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:44:04 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:44:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43868454
Fri 17 Jan 2014 23:44:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:44:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43868454
Fri 17 Jan 2014 23:44:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:44:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:44:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:44:15 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:44:15 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:44:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:44:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:44:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:44:17 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:44:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:44:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:44:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:44:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:44:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:44:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:44:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:44:21 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:44:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:44:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:44:21 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:44:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 23:44:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:44:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:44:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:44:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:44:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:44:24 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:44:24 - job_xml_thread(): Done retrieving: data size 43880567
Fri 17 Jan 2014 23:44:24 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:44:24 - XML: Start document: iteration 5
Fri 17 Jan 2014 23:44:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43880567
Fri 17 Jan 2014 23:44:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43880567
Fri 17 Jan 2014 23:44:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:44:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:44:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:44:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:44:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:44:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:44:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:44:41 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:44:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:44:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:44:42 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:44:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:44:42 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:44:42 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:44:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:44:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:44:42 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:44:43 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:44:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:44:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 23:44:43 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:44:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 23:44:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5974 values 94253 bits 11781 bytes 
Fri 17 Jan 2014 23:44:45 - XML: Processed 655532 elements - found 663 jobs
Fri 17 Jan 2014 23:44:45 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:44:45 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:44:45 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:44:45 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:44:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:44:49 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:44:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:44:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:44:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:44:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:44:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:44:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:44:53 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:44:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43879907
Fri 17 Jan 2014 23:44:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:44:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43879907
Fri 17 Jan 2014 23:44:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:44:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:44:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:45:00 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:45:00 - job_xml_thread(): Done retrieving: data size 43879907
Fri 17 Jan 2014 23:45:00 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:45:00 - XML: Start document: iteration 6
Fri 17 Jan 2014 23:45:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:45:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:45:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:45:05 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:45:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:45:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:45:07 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:45:07 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:45:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:45:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:45:07 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:45:14 - XML: Processed 655532 elements - found 663 jobs
Fri 17 Jan 2014 23:45:14 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:45:14 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:45:14 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:45:14 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:45:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:45:16 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:45:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:45:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:45:16 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:45:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 23:45:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:45:17 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 23:45:17 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 23:45:17 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:45:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:45:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:45:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:45:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:45:18 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:45:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862962
Fri 17 Jan 2014 23:45:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:45:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862962
Fri 17 Jan 2014 23:45:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:45:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:45:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:45:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:45:27 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:45:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:45:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:45:29 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:45:29 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:45:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:45:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:45:29 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:45:30 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:45:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:45:32 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:45:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:45:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:45:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:45:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:45:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:45:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:45:34 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:45:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43893026
Fri 17 Jan 2014 23:45:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:45:35 - job_xml_thread(): Done retrieving: data size 43893026
Fri 17 Jan 2014 23:45:35 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:45:35 - XML: Start document: iteration 7
Fri 17 Jan 2014 23:45:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43893026
Fri 17 Jan 2014 23:45:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:45:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:45:43 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:45:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:45:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:45:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:45:45 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:45:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 23:45:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 23:45:45 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:45:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8906 values 140437 bits 17554 bytes 
Fri 17 Jan 2014 23:45:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:45:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:45:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:45:49 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:45:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:45:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:45:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:45:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:45:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:45:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:45:52 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:45:52 - XML: Processed 655528 elements - found 661 jobs
Fri 17 Jan 2014 23:45:52 - job 7348520 appears to have finished
Fri 17 Jan 2014 23:45:52 - job 7348549 appears to have finished
Fri 17 Jan 2014 23:45:52 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 23:45:52 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 23:45:53 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 23:45:53 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:45:53 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:45:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:45:56 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:45:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:45:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:45:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:45:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:45:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:45:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:45:58 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:45:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43880259
Fri 17 Jan 2014 23:45:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:45:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43880259
Fri 17 Jan 2014 23:45:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:46:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:46:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:46:08 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:46:08 - job_xml_thread(): Done retrieving: data size 43880259
Fri 17 Jan 2014 23:46:08 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:46:08 - XML: Start document: iteration 8
Fri 17 Jan 2014 23:46:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:46:09 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:46:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:46:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:46:11 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:46:11 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:46:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:46:11 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:46:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:46:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:46:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:46:18 - XML: Processed 655528 elements - found 661 jobs
Fri 17 Jan 2014 23:46:18 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:46:18 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:46:18 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:46:18 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:46:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:46:19 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:46:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:46:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:46:19 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:46:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 23:46:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:46:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:46:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:46:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:46:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:46:20 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:46:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43880553
Fri 17 Jan 2014 23:46:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:46:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43880553
Fri 17 Jan 2014 23:46:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:46:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:46:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:46:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:46:31 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:46:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:46:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:46:32 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:46:32 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:46:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:46:32 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:46:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:46:33 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:46:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:46:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:46:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:46:35 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:46:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:46:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:46:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:46:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:46:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:46:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:46:37 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:46:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43884332
Fri 17 Jan 2014 23:46:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:46:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43884332
Fri 17 Jan 2014 23:46:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:46:37 - job_xml_thread(): Done retrieving: data size 43884332
Fri 17 Jan 2014 23:46:37 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:46:37 - XML: Start document: iteration 9
Fri 17 Jan 2014 23:46:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:46:45 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:46:47 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:46:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:46:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 23:46:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 23:46:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:46:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:46:47 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:46:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9040 values 142956 bits 17869 bytes 
Fri 17 Jan 2014 23:46:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:46:50 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:46:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:46:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:46:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:46:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:46:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:46:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:46:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:46:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:46:52 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:46:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:46:59 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:46:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:46:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:47:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:47:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:47:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:47:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:47:01 - XML: Processed 655525 elements - found 661 jobs
Fri 17 Jan 2014 23:47:01 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:47:01 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:47:01 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:47:01 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:47:04 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:47:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43880880
Fri 17 Jan 2014 23:47:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:47:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43880880
Fri 17 Jan 2014 23:47:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:47:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:47:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:47:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:47:14 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:47:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:47:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:47:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:47:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:47:15 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:47:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:47:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:47:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:47:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:47:16 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:47:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:47:17 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:47:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:47:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:47:18 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:47:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 23:47:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:47:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:47:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:47:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:47:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:47:19 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:47:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43828518
Fri 17 Jan 2014 23:47:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:47:19 - job_xml_thread(): Done retrieving: data size 43828518
Fri 17 Jan 2014 23:47:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43828518
Fri 17 Jan 2014 23:47:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:47:20 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:47:20 - XML: Start document: iteration 10
Fri 17 Jan 2014 23:47:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:47:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:47:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:47:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:47:40 - XML: Processed 654780 elements - found 661 jobs
Fri 17 Jan 2014 23:47:40 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:47:40 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:47:41 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:47:41 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:47:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:47:44 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:47:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:47:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:47:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:47:44 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:47:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:47:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:47:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:47:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:47:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:47:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:47:44 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:47:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:47:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:47:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:47:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:47:47 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:47:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43260499
Fri 17 Jan 2014 23:47:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:47:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:47:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43260499
Fri 17 Jan 2014 23:47:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:47:47 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:47:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:47:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 23:47:48 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:47:48 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:47:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 23:47:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5841 values 92408 bits 11551 bytes 
Fri 17 Jan 2014 23:47:52 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 23:47:52 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:47:53 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:47:53 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:47:53 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 23:47:53 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 23:47:54 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 23:47:56 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:47:56 - job_xml_thread(): Done retrieving: data size 43260499
Fri 17 Jan 2014 23:47:56 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:47:56 - XML: Start document: iteration 11
Fri 17 Jan 2014 23:47:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:47:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:47:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:48:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:48:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:48:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:48:01 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:48:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:48:01 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:48:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:48:01 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:48:03 - size of cluster 'LISA Cluster': 624 hosts 79467 metrics 741758 values 11719255 bits 1464906 bytes 
Fri 17 Jan 2014 23:48:11 - XML: Processed 647682 elements - found 661 jobs
Fri 17 Jan 2014 23:48:11 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:48:11 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:48:11 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:48:11 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:48:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:48:11 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:48:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:48:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:48:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:48:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:48:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:48:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:48:14 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:48:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43250036
Fri 17 Jan 2014 23:48:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:48:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43250036
Fri 17 Jan 2014 23:48:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:48:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:48:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:48:21 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:48:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 23:48:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:48:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:48:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:48:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:48:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:48:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:48:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:48:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43250036
Fri 17 Jan 2014 23:48:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:48:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:48:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:48:26 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:48:26 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:48:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:48:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:48:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:48:33 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:48:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:48:34 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:48:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:48:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:48:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:48:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:48:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:48:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:48:36 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:48:36 - job_xml_thread(): Done retrieving: data size 43489704
Fri 17 Jan 2014 23:48:36 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:48:36 - XML: Start document: iteration 12
Fri 17 Jan 2014 23:48:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43489704
Fri 17 Jan 2014 23:48:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:48:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:48:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:48:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:48:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:48:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43489704
Fri 17 Jan 2014 23:48:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:48:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:48:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:48:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:48:49 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:48:49 - XML: Processed 650864 elements - found 661 jobs
Fri 17 Jan 2014 23:48:49 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:48:49 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:48:49 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:48:49 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:48:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:48:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 23:48:49 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:48:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6282 values 99289 bits 12411 bytes 
Fri 17 Jan 2014 23:48:49 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:48:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 23:48:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:48:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:48:54 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:48:54 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 23:48:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:48:54 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:48:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:48:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:48:56 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:48:56 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:48:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:48:56 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:48:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:48:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:48:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:48:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:48:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:48:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:48:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:48:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:48:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:49:01 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:49:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 23:49:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:49:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:49:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43864534
Fri 17 Jan 2014 23:49:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:49:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43864534
Fri 17 Jan 2014 23:49:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:49:04 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:49:04 - job_xml_thread(): Done retrieving: data size 43864534
Fri 17 Jan 2014 23:49:04 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:49:04 - XML: Start document: iteration 13
Fri 17 Jan 2014 23:49:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:49:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:49:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:49:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:49:21 - XML: Processed 655350 elements - found 661 jobs
Fri 17 Jan 2014 23:49:21 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:49:21 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:49:21 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:49:21 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:49:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:49:22 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:49:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:49:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:49:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:49:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:49:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:49:24 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:49:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:49:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:49:25 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:49:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:49:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:49:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:49:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:49:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:49:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:49:29 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:49:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43878892
Fri 17 Jan 2014 23:49:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:49:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43878892
Fri 17 Jan 2014 23:49:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:49:37 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:49:37 - job_xml_thread(): Done retrieving: data size 43878892
Fri 17 Jan 2014 23:49:37 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:49:37 - XML: Start document: iteration 14
Fri 17 Jan 2014 23:49:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:49:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:49:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:49:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:49:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:49:45 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:49:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:49:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:49:46 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:49:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:49:46 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:49:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:49:46 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:49:48 - XML: Processed 655520 elements - found 657 jobs
Fri 17 Jan 2014 23:49:48 - job 7348521 appears to have finished
Fri 17 Jan 2014 23:49:48 - job 7348517 appears to have finished
Fri 17 Jan 2014 23:49:48 - job 7348516 appears to have finished
Fri 17 Jan 2014 23:49:48 - job 7348513 appears to have finished
Fri 17 Jan 2014 23:49:48 - job 7348673 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 23:49:48 - job 7348677 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 23:49:48 - job_xml_thread(): Found 6 updated jobs.
Fri 17 Jan 2014 23:49:48 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 23:49:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:49:49 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:49:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:49:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:49:49 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Fri 17 Jan 2014 23:49:49 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:49:49 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:49:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:49:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:49:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:49:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:49:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:49:49 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:49:50 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:49:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:49:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 23:49:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 23:49:50 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:49:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99105 bits 12388 bytes 
Fri 17 Jan 2014 23:49:51 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:49:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43882067
Fri 17 Jan 2014 23:49:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:49:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43882067
Fri 17 Jan 2014 23:49:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:50:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:50:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:50:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:50:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:50:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:50:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:50:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:50:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:50:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:50:03 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:50:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:50:04 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:50:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:50:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:50:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:50:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:50:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:50:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:50:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:50:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:50:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:50:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:50:10 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:50:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 23:50:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:50:11 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:50:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43863004
Fri 17 Jan 2014 23:50:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:50:12 - job_xml_thread(): Done retrieving: data size 43863004
Fri 17 Jan 2014 23:50:12 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:50:12 - XML: Start document: iteration 15
Fri 17 Jan 2014 23:50:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43863004
Fri 17 Jan 2014 23:50:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:50:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:50:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:50:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:50:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:50:26 - XML: Processed 655520 elements - found 657 jobs
Fri 17 Jan 2014 23:50:26 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:50:26 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:50:26 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:50:26 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:50:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:50:29 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:50:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:50:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:50:30 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:50:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:50:30 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:50:30 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:50:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:50:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:50:33 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:50:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:50:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:50:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:50:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:50:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:50:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:50:35 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:50:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43884017
Fri 17 Jan 2014 23:50:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:50:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43884017
Fri 17 Jan 2014 23:50:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:50:41 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:50:42 - job_xml_thread(): Done retrieving: data size 43884017
Fri 17 Jan 2014 23:50:42 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:50:42 - XML: Start document: iteration 16
Fri 17 Jan 2014 23:50:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:50:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:50:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:50:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:50:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:50:50 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:50:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:50:51 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:50:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 23:50:51 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:50:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 23:50:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7059 values 111393 bits 13924 bytes 
Fri 17 Jan 2014 23:50:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:50:51 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:50:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:50:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:50:52 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:50:52 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:50:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:50:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:50:52 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:50:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:50:57 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:50:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:50:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:50:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:50:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:50:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:50:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:50:58 - XML: Processed 655520 elements - found 657 jobs
Fri 17 Jan 2014 23:50:58 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:50:58 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:50:58 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:50:58 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:51:02 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:51:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873633
Fri 17 Jan 2014 23:51:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:51:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873633
Fri 17 Jan 2014 23:51:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:51:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:51:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:51:09 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:51:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 23:51:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:51:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:51:12 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:51:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:51:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:51:12 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:51:12 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:51:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:51:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:51:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873633
Fri 17 Jan 2014 23:51:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:51:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:51:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:51:14 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:51:14 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:51:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:51:23 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:51:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:51:26 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:51:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:51:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:51:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:51:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:51:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:51:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:51:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:51:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:51:28 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 23:51:28 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 23:51:28 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:51:28 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:51:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:51:28 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:51:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:51:29 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:51:29 - job_xml_thread(): Done retrieving: data size 43847113
Fri 17 Jan 2014 23:51:29 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:51:29 - XML: Start document: iteration 17
Fri 17 Jan 2014 23:51:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43847113
Fri 17 Jan 2014 23:51:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43847113
Fri 17 Jan 2014 23:51:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:51:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:51:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:51:40 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:51:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:51:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:51:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:51:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:51:44 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:51:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:51:44 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:51:44 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:51:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:51:48 - XML: Processed 655516 elements - found 655 jobs
Fri 17 Jan 2014 23:51:48 - job 7348653 appears to have finished
Fri 17 Jan 2014 23:51:48 - job 7348688 appears to have finished
Fri 17 Jan 2014 23:51:48 - job_xml_thread(): Found 2 updated jobs.
Fri 17 Jan 2014 23:51:48 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 23:51:49 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Fri 17 Jan 2014 23:51:49 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:51:49 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:51:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:51:51 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:51:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:51:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:51:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:51:51 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:51:51 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:51:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:51:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 23:51:51 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:51:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99111 bits 12388 bytes 
Fri 17 Jan 2014 23:51:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 23:51:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:51:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:51:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:51:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:51:53 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:51:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856749
Fri 17 Jan 2014 23:51:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:51:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43856749
Fri 17 Jan 2014 23:51:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:52:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:52:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:52:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:52:02 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:52:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:52:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:52:03 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:52:03 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:52:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:52:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:52:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856749
Fri 17 Jan 2014 23:52:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:52:04 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:52:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:52:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:52:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:52:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:52:11 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:52:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:52:15 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:52:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:52:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:52:16 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:52:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 23:52:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:52:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:52:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:52:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:52:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:52:17 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:52:17 - job_xml_thread(): Done retrieving: data size 43864260
Fri 17 Jan 2014 23:52:17 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:52:17 - XML: Start document: iteration 18
Fri 17 Jan 2014 23:52:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43864260
Fri 17 Jan 2014 23:52:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:52:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:52:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:52:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:52:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:52:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:52:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:52:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43864260
Fri 17 Jan 2014 23:52:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:52:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:52:30 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:52:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:52:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:52:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:52:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:52:35 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:52:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:52:35 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:52:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:52:35 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:52:37 - XML: Processed 655516 elements - found 655 jobs
Fri 17 Jan 2014 23:52:37 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:52:37 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:52:37 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:52:37 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:52:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:52:39 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:52:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:52:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:52:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:52:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:52:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:52:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:52:40 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:52:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43879873
Fri 17 Jan 2014 23:52:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:52:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43879873
Fri 17 Jan 2014 23:52:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:52:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:52:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:52:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:52:52 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:52:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:52:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:52:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:52:52 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:52:52 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:52:52 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:52:53 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:52:53 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:52:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:52:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:52:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:52:53 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:52:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 23:52:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 23:52:53 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:52:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8676 values 136870 bits 17108 bytes 
Fri 17 Jan 2014 23:52:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:52:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:52:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:52:55 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:52:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:52:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:52:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:52:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:52:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:52:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:52:57 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:52:57 - job_xml_thread(): Done retrieving: data size 43888504
Fri 17 Jan 2014 23:52:57 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:52:57 - XML: Start document: iteration 19
Fri 17 Jan 2014 23:52:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43888504
Fri 17 Jan 2014 23:52:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43888504
Fri 17 Jan 2014 23:52:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:52:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:53:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:53:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:53:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:53:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:53:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:53:15 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:53:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:53:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:53:16 - XML: Processed 655516 elements - found 655 jobs
Fri 17 Jan 2014 23:53:16 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:53:16 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:53:16 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:53:16 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:53:17 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:53:17 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:53:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:53:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:53:17 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:53:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:53:19 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:53:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:53:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:53:19 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:53:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 23:53:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:53:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:53:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:53:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:53:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:53:21 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:53:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43794534
Fri 17 Jan 2014 23:53:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:53:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43794534
Fri 17 Jan 2014 23:53:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:53:31 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:53:31 - job_xml_thread(): Done retrieving: data size 43794534
Fri 17 Jan 2014 23:53:31 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:53:31 - XML: Start document: iteration 20
Fri 17 Jan 2014 23:53:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:53:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:53:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:53:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:53:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:53:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:53:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:53:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:53:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:53:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:53:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:53:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:53:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:53:40 - XML: Processed 654760 elements - found 651 jobs
Fri 17 Jan 2014 23:53:40 - job 7348550 appears to have finished
Fri 17 Jan 2014 23:53:40 - job 7348514 appears to have finished
Fri 17 Jan 2014 23:53:40 - job 7348519 appears to have finished
Fri 17 Jan 2014 23:53:40 - job 7348518 appears to have finished
Fri 17 Jan 2014 23:53:40 - job_xml_thread(): Found 4 updated jobs.
Fri 17 Jan 2014 23:53:40 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 23:53:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:53:43 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:53:43 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Fri 17 Jan 2014 23:53:43 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:53:43 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:53:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:53:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:53:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:53:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:53:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:53:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:53:44 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:53:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43300683
Fri 17 Jan 2014 23:53:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:53:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43300683
Fri 17 Jan 2014 23:53:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:53:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:53:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:53:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:53:53 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:53:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:53:55 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:53:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:53:55 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:53:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:53:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 23:53:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 23:53:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:53:56 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:53:56 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:53:56 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:53:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:53:56 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:53:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:53:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9138 values 144157 bits 18019 bytes 
Fri 17 Jan 2014 23:53:58 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:53:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:53:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:53:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:53:58 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:53:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:53:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:53:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:53:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:53:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:53:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:54:00 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:54:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43229722
Fri 17 Jan 2014 23:54:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:54:01 - job_xml_thread(): Done retrieving: data size 43229722
Fri 17 Jan 2014 23:54:01 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:54:01 - Housekeeping: checking database for timed out jobs..
Fri 17 Jan 2014 23:54:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43229722
Fri 17 Jan 2014 23:54:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:54:01 - Housekeeping: Found 0 timed out jobs in database: closing entries
Fri 17 Jan 2014 23:54:01 - Housekeeping: done.
Fri 17 Jan 2014 23:54:01 - XML: Start document: iteration 0
Fri 17 Jan 2014 23:54:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:54:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:54:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:54:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:54:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:54:16 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:54:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:54:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:54:16 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:54:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:54:16 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:54:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:54:16 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:54:18 - XML: Processed 647308 elements - found 651 jobs
Fri 17 Jan 2014 23:54:18 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:54:18 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:54:18 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:54:18 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:54:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:54:22 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:54:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:54:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:54:23 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:54:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 23:54:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:54:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:54:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:54:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:54:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:54:24 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:54:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43256330
Fri 17 Jan 2014 23:54:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:54:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43256330
Fri 17 Jan 2014 23:54:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:54:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:54:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:54:33 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:54:33 - job_xml_thread(): Done retrieving: data size 43256330
Fri 17 Jan 2014 23:54:33 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:54:33 - XML: Start document: iteration 1
Fri 17 Jan 2014 23:54:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:54:36 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:54:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:54:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:54:37 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:54:37 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:54:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:54:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:54:37 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:54:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:54:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:54:43 - XML: Processed 648056 elements - found 651 jobs
Fri 17 Jan 2014 23:54:43 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:54:43 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:54:43 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:54:43 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:54:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:54:47 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:54:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:54:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:54:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:54:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:54:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:54:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:54:48 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:54:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43785594
Fri 17 Jan 2014 23:54:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:54:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43785594
Fri 17 Jan 2014 23:54:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:54:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:54:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:54:54 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Fri 17 Jan 2014 23:54:54 - ganglia_store_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:54:55 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:54:55 - ganglia_store_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:54:55 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Fri 17 Jan 2014 23:54:55 - Entering storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 23:54:56 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Fri 17 Jan 2014 23:54:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:54:56 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:54:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:54:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 23:54:57 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:54:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 23:54:57 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:54:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8739 values 137790 bits 17223 bytes 
Fri 17 Jan 2014 23:54:58 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:54:58 - job_xml_thread(): Done retrieving: data size 43785594
Fri 17 Jan 2014 23:54:58 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:54:58 - XML: Start document: iteration 2
Fri 17 Jan 2014 23:54:59 - size of cluster 'LISA Cluster': 624 hosts 79478 metrics 858892 values 13557584 bits 1694698 bytes 
Fri 17 Jan 2014 23:55:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:55:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:55:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:55:06 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:55:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:55:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:55:07 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:55:07 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:55:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:55:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:55:07 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:55:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:55:07 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:55:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:55:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:55:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:55:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:55:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:55:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:55:12 - XML: Processed 654564 elements - found 651 jobs
Fri 17 Jan 2014 23:55:12 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:55:12 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:55:12 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:55:12 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:55:15 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:55:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875732
Fri 17 Jan 2014 23:55:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:55:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875732
Fri 17 Jan 2014 23:55:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:55:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:55:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:55:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:55:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:55:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:55:24 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:55:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:55:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:55:24 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:55:24 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:55:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:55:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875732
Fri 17 Jan 2014 23:55:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:55:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:55:27 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:55:27 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:55:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:55:34 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:55:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:55:37 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:55:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:55:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:55:38 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:55:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 23:55:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:55:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:55:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:55:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:55:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:55:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:55:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:55:40 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:55:40 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:55:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:55:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:55:40 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:55:41 - job_xml_thread(): Done retrieving: data size 43842095
Fri 17 Jan 2014 23:55:41 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:55:41 - XML: Start document: iteration 3
Fri 17 Jan 2014 23:55:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43842095
Fri 17 Jan 2014 23:55:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:55:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43842095
Fri 17 Jan 2014 23:55:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:55:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:55:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:55:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:55:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:55:56 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:55:56 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Fri 17 Jan 2014 23:55:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:55:57 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:55:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:55:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 23:55:58 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:55:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 23:55:58 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:55:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5788 values 91288 bits 11411 bytes 
Fri 17 Jan 2014 23:55:59 - XML: Processed 655512 elements - found 653 jobs
Fri 17 Jan 2014 23:56:00 - job 7335205 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 23:56:00 - job_xml_thread(): Found 3 updated jobs.
Fri 17 Jan 2014 23:56:00 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 23:56:00 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Fri 17 Jan 2014 23:56:00 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:56:00 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:56:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:56:02 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:56:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:56:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:56:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:56:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:56:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:56:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:56:04 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:56:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:56:04 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:56:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:56:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:56:04 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:56:04 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:56:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:56:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:56:08 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:56:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43879432
Fri 17 Jan 2014 23:56:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:56:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43879432
Fri 17 Jan 2014 23:56:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:56:15 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:56:15 - job_xml_thread(): Done retrieving: data size 43879432
Fri 17 Jan 2014 23:56:15 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:56:15 - XML: Start document: iteration 4
Fri 17 Jan 2014 23:56:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:56:18 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:56:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:56:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:56:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:56:19 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:56:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:56:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 23:56:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:56:19 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:56:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:56:19 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:56:19 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:56:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:56:28 - XML: Processed 655512 elements - found 653 jobs
Fri 17 Jan 2014 23:56:28 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:56:28 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:56:28 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:56:28 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:56:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:56:32 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:56:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:56:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:56:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:56:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:56:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:56:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:56:34 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:56:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:56:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:56:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851483
Fri 17 Jan 2014 23:56:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:56:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851483
Fri 17 Jan 2014 23:56:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:56:43 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:56:43 - job_xml_thread(): Done retrieving: data size 43851483
Fri 17 Jan 2014 23:56:43 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:56:43 - XML: Start document: iteration 5
Fri 17 Jan 2014 23:56:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:56:47 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:56:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:56:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:56:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:56:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:56:48 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:56:48 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:56:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:56:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:56:48 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:56:57 - XML: Processed 655512 elements - found 653 jobs
Fri 17 Jan 2014 23:56:57 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:56:57 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:56:57 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:56:57 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:56:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:56:57 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:56:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:56:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:56:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:56:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:56:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:56:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:56:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:56:58 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:56:58 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:56:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:56:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 23:56:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 23:56:58 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:56:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6060 values 95602 bits 11950 bytes 
Fri 17 Jan 2014 23:57:01 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:57:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43869011
Fri 17 Jan 2014 23:57:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:57:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43869011
Fri 17 Jan 2014 23:57:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:57:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:57:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:57:12 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:57:12 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:57:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:57:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:57:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:57:14 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:57:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:57:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:57:15 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:57:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:57:15 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:57:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:57:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:57:18 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:57:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:57:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:57:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:57:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:57:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:57:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:57:20 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:57:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 23:57:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:57:21 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:57:21 - job_xml_thread(): Done retrieving: data size 43859293
Fri 17 Jan 2014 23:57:21 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:57:21 - XML: Start document: iteration 6
Fri 17 Jan 2014 23:57:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43859293
Fri 17 Jan 2014 23:57:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:57:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43859293
Fri 17 Jan 2014 23:57:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:57:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:57:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:57:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:57:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:57:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:57:35 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:57:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:57:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:57:36 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:57:36 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:57:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:57:36 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:57:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:57:41 - XML: Processed 655508 elements - found 655 jobs
Fri 17 Jan 2014 23:57:41 - job 7348451 appears to have finished
Fri 17 Jan 2014 23:57:42 - job 7348678 field 'status' changed since saved from: R to: Q
Fri 17 Jan 2014 23:57:42 - job_xml_thread(): Found 5 updated jobs.
Fri 17 Jan 2014 23:57:42 - job_xml_thread(): Storing jobs to database..
Fri 17 Jan 2014 23:57:43 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Fri 17 Jan 2014 23:57:43 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:57:43 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:57:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:57:45 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:57:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:57:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:57:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:57:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:57:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:57:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:57:48 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:57:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870053
Fri 17 Jan 2014 23:57:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:57:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870053
Fri 17 Jan 2014 23:57:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:57:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:57:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:57:58 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:57:58 - job_xml_thread(): Done retrieving: data size 43870053
Fri 17 Jan 2014 23:57:58 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:57:58 - XML: Start document: iteration 7
Fri 17 Jan 2014 23:57:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:57:59 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:57:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:57:59 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:58:00 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:58:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 23:58:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:58:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 23:58:00 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:58:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:58:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7724 values 121832 bits 15229 bytes 
Fri 17 Jan 2014 23:58:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:58:00 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:58:00 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:58:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:58:00 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:58:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:58:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:58:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:58:11 - XML: Processed 655516 elements - found 655 jobs
Fri 17 Jan 2014 23:58:11 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:58:11 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:58:11 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:58:11 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:58:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:58:12 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:58:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:58:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:58:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:58:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:58:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:58:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:58:15 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:58:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 23:58:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:58:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:58:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:58:16 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:58:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43860439
Fri 17 Jan 2014 23:58:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:58:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43860439
Fri 17 Jan 2014 23:58:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:58:27 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:58:27 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:58:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:58:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:58:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:58:28 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:58:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:58:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:58:29 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:58:29 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:58:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:58:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:58:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:58:31 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:58:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:58:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:58:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:58:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:58:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:58:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:58:34 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:58:34 - job_xml_thread(): Done retrieving: data size 43882084
Fri 17 Jan 2014 23:58:34 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:58:34 - XML: Start document: iteration 8
Fri 17 Jan 2014 23:58:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43882084
Fri 17 Jan 2014 23:58:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:58:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43882084
Fri 17 Jan 2014 23:58:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:58:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:58:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:58:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:58:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:58:47 - XML: Processed 655509 elements - found 655 jobs
Fri 17 Jan 2014 23:58:47 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:58:47 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:58:47 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:58:47 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:58:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:58:50 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:58:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:58:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:58:51 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:58:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:58:51 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:58:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:58:51 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:58:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:58:54 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:58:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:58:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:58:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:58:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:58:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:58:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:58:57 - Leaving storeMetrics(): cluster LISA Cluster
Fri 17 Jan 2014 23:58:57 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Fri 17 Jan 2014 23:58:57 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:58:57 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:58:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43887831
Fri 17 Jan 2014 23:58:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:58:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43887831
Fri 17 Jan 2014 23:58:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:59:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:59:00 - ganglia_store_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:59:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:59:01 - ganglia_store_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:59:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Fri 17 Jan 2014 23:59:01 - Entering storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:59:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Fri 17 Jan 2014 23:59:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9279 values 146379 bits 18297 bytes 
Fri 17 Jan 2014 23:59:02 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:59:02 - job_xml_thread(): Done retrieving: data size 43887831
Fri 17 Jan 2014 23:59:02 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:59:02 - XML: Start document: iteration 9
Fri 17 Jan 2014 23:59:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:59:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:59:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:59:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:59:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:59:10 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:59:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:59:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:59:11 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:59:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:59:11 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:59:11 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:59:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:59:18 - XML: Processed 655516 elements - found 655 jobs
Fri 17 Jan 2014 23:59:18 - job_xml_thread(): Found 0 updated jobs.
Fri 17 Jan 2014 23:59:18 - job_xml_thread(): No jobs to store.
Fri 17 Jan 2014 23:59:18 - job_xml_thread(): Done parsing.
Fri 17 Jan 2014 23:59:18 - job_xml_thread(): Sleeping.. (15s)
Fri 17 Jan 2014 23:59:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:59:20 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:59:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:59:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:59:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:59:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:59:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:59:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:59:23 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:59:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43767332
Fri 17 Jan 2014 23:59:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:59:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43767332
Fri 17 Jan 2014 23:59:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:59:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:59:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:59:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:59:32 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:59:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Fri 17 Jan 2014 23:59:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:59:32 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:59:32 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:59:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:59:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:59:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43767332
Fri 17 Jan 2014 23:59:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Fri 17 Jan 2014 23:59:33 - job_xml_thread(): Retrieving XML data..
Fri 17 Jan 2014 23:59:33 - XMLGatherer.retrieveData(): actually retrieving data..
Fri 17 Jan 2014 23:59:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Fri 17 Jan 2014 23:59:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Fri 17 Jan 2014 23:59:38 - Leaving storeMetrics(): cluster Render Cluster
Fri 17 Jan 2014 23:59:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Fri 17 Jan 2014 23:59:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:59:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Fri 17 Jan 2014 23:59:43 - ganglia_parse_thread(): finished: Render Cluster
Fri 17 Jan 2014 23:59:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Fri 17 Jan 2014 23:59:45 - ganglia_parse_thread(): finished: LISA Cluster
Fri 17 Jan 2014 23:59:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Fri 17 Jan 2014 23:59:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Fri 17 Jan 2014 23:59:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:59:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Fri 17 Jan 2014 23:59:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Fri 17 Jan 2014 23:59:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Fri 17 Jan 2014 23:59:46 - XMLGatherer.retrieveData(): Done retrieving data.
Fri 17 Jan 2014 23:59:46 - job_xml_thread(): Done retrieving: data size 43277044
Fri 17 Jan 2014 23:59:46 - job_xml_thread(): Parsing XML..
Fri 17 Jan 2014 23:59:46 - XML: Start document: iteration 10
Fri 17 Jan 2014 23:59:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43277044
Fri 17 Jan 2014 23:59:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Fri 17 Jan 2014 23:59:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Fri 17 Jan 2014 23:59:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Fri 17 Jan 2014 23:59:50 - ganglia_parse_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:59:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Fri 17 Jan 2014 23:59:50 - ganglia_xml_thread(): started: cluster Render Cluster
Fri 17 Jan 2014 23:59:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Fri 17 Jan 2014 23:59:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43277044
Fri 17 Jan 2014 23:59:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:00:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:00:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:00:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:00:01 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:00:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:00:03 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:00:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 00:00:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 00:00:03 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:00:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6250 values 98617 bits 12327 bytes 
Sat 18 Jan 2014 00:00:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:00:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:00:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:00:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:00:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:00:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:00:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:00:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:00:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:00:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:00:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:00:08 - XML: Processed 648390 elements - found 652 jobs
Sat 18 Jan 2014 00:00:08 - job 7348553 appears to have finished
Sat 18 Jan 2014 00:00:08 - job 7348552 appears to have finished
Sat 18 Jan 2014 00:00:08 - job 7348691 appears to have finished
Sat 18 Jan 2014 00:00:08 - job_xml_thread(): Found 3 updated jobs.
Sat 18 Jan 2014 00:00:08 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 00:00:09 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Sat 18 Jan 2014 00:00:09 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:00:10 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:00:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:00:10 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:00:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:00:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:00:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:00:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:00:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:00:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:00:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:00:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43259259
Sat 18 Jan 2014 00:00:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:00:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43259259
Sat 18 Jan 2014 00:00:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:00:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:00:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:00:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:00:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:00:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:00:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:00:25 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:00:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:00:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:00:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:00:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:00:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:00:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:00:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:00:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:00:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:00:26 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:00:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 00:00:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:00:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:00:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:00:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:00:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:00:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:00:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:00:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:00:28 - job_xml_thread(): Done retrieving: data size 43293212
Sat 18 Jan 2014 00:00:28 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:00:28 - XML: Start document: iteration 11
Sat 18 Jan 2014 00:00:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43293212
Sat 18 Jan 2014 00:00:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43293212
Sat 18 Jan 2014 00:00:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:00:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:00:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:00:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:00:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:00:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:00:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:00:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:00:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:00:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:00:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:00:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:00:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:00:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:00:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:00:47 - XML: Processed 648058 elements - found 652 jobs
Sat 18 Jan 2014 00:00:47 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:00:47 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:00:47 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:00:47 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:00:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:00:50 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:00:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:00:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:00:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:00:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:00:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:00:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:00:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:00:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43801923
Sat 18 Jan 2014 00:00:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:00:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43801923
Sat 18 Jan 2014 00:00:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:00:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:00:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:01:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:01:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:01:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:01:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:01:02 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:01:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:01:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:01:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:01:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:01:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:01:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:01:03 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:01:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:01:04 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:01:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 00:01:04 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:01:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9359 values 147663 bits 18457 bytes 
Sat 18 Jan 2014 00:01:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 00:01:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:01:05 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:01:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:01:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:01:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:01:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:01:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:01:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:01:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:01:06 - job_xml_thread(): Done retrieving: data size 43863596
Sat 18 Jan 2014 00:01:06 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:01:06 - XML: Start document: iteration 12
Sat 18 Jan 2014 00:01:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43863596
Sat 18 Jan 2014 00:01:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:01:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43863596
Sat 18 Jan 2014 00:01:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:01:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:01:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:01:19 - XML: Processed 655470 elements - found 652 jobs
Sat 18 Jan 2014 00:01:19 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:01:19 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:01:19 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:01:19 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:01:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:01:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:01:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:01:24 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:01:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:01:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:01:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:01:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:01:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:01:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:01:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:01:24 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:01:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 00:01:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:01:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:01:27 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:01:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:01:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:01:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:01:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:01:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:01:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:01:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:01:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43885892
Sat 18 Jan 2014 00:01:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:01:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43885892
Sat 18 Jan 2014 00:01:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:01:34 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:01:34 - job_xml_thread(): Done retrieving: data size 43885892
Sat 18 Jan 2014 00:01:34 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:01:34 - XML: Start document: iteration 13
Sat 18 Jan 2014 00:01:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:01:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:01:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:01:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:01:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:01:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:01:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:01:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:01:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:01:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:01:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:01:48 - XML: Processed 655510 elements - found 652 jobs
Sat 18 Jan 2014 00:01:48 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:01:49 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:01:49 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:01:49 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:01:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:01:50 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:01:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:01:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:01:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:01:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:01:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:01:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:01:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:01:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43849362
Sat 18 Jan 2014 00:01:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:01:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43849362
Sat 18 Jan 2014 00:01:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:01:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:01:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:01:56 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 00:01:56 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:01:58 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:01:58 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:01:58 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 00:01:58 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 00:01:58 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 00:02:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:02:03 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:02:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:02:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:02:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:02:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:02:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:02:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:02:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:02:04 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:02:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:02:04 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:02:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:02:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 00:02:05 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:02:05 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:02:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 00:02:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8901 values 140841 bits 17605 bytes 
Sat 18 Jan 2014 00:02:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:02:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:02:07 - size of cluster 'LISA Cluster': 624 hosts 79475 metrics 828850 values 13092201 bits 1636525 bytes 
Sat 18 Jan 2014 00:02:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:02:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:02:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:02:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:02:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:02:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:02:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:02:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:02:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:02:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870140
Sat 18 Jan 2014 00:02:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:02:13 - job_xml_thread(): Done retrieving: data size 43870140
Sat 18 Jan 2014 00:02:13 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:02:13 - XML: Start document: iteration 14
Sat 18 Jan 2014 00:02:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870140
Sat 18 Jan 2014 00:02:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:02:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:02:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:02:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:02:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:02:30 - XML: Processed 655510 elements - found 652 jobs
Sat 18 Jan 2014 00:02:30 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:02:30 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:02:30 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:02:30 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:02:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:02:32 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:02:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:02:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:02:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:02:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:02:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:02:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:02:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:02:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:02:34 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:02:34 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:02:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 00:02:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:02:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:02:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:02:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:02:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:02:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:02:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:02:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:02:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43889176
Sat 18 Jan 2014 00:02:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:02:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43889176
Sat 18 Jan 2014 00:02:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:02:45 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:02:45 - job_xml_thread(): Done retrieving: data size 43889176
Sat 18 Jan 2014 00:02:45 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:02:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:02:45 - XML: Start document: iteration 15
Sat 18 Jan 2014 00:02:45 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:02:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:02:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:02:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:02:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:02:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:02:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:02:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:02:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:02:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:02:58 - XML: Processed 655510 elements - found 652 jobs
Sat 18 Jan 2014 00:02:58 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:02:58 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:02:58 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:02:58 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:02:58 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:02:58 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 00:02:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:02:59 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:02:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:02:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:03:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:03:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:03:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:03:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:03:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:03:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867870
Sat 18 Jan 2014 00:03:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:03:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43867870
Sat 18 Jan 2014 00:03:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:03:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:03:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:03:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:03:06 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:03:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:03:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 00:03:06 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:03:06 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:03:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9151 values 145027 bits 18128 bytes 
Sat 18 Jan 2014 00:03:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 00:03:13 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:03:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:03:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:03:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:03:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:03:15 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:03:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:03:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:03:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:03:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:03:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:03:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:03:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:03:18 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:03:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:03:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:03:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:03:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:03:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:03:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:03:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:03:21 - job_xml_thread(): Done retrieving: data size 43861493
Sat 18 Jan 2014 00:03:21 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:03:21 - XML: Start document: iteration 16
Sat 18 Jan 2014 00:03:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43861493
Sat 18 Jan 2014 00:03:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:03:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43861493
Sat 18 Jan 2014 00:03:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:03:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:03:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:03:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:03:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:03:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:03:39 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:03:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:03:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:03:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:03:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:03:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:03:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:03:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:03:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:03:41 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:03:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:03:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:03:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:03:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:03:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:03:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:03:42 - XML: Processed 655512 elements - found 654 jobs
Sat 18 Jan 2014 00:03:42 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 00:03:42 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 00:03:42 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:03:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 00:03:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:03:42 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 00:03:42 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:03:42 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:03:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:03:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43885446
Sat 18 Jan 2014 00:03:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:03:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43885446
Sat 18 Jan 2014 00:03:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:03:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:03:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:03:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:03:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:03:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:03:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:03:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:03:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:03:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:03:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:03:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:03:57 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:03:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:03:59 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:03:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:03:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:03:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:03:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:03:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:03:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:04:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:04:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43884688
Sat 18 Jan 2014 00:04:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:04:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43884688
Sat 18 Jan 2014 00:04:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:04:03 - job_xml_thread(): Done retrieving: data size 43884688
Sat 18 Jan 2014 00:04:03 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:04:04 - XML: Start document: iteration 17
Sat 18 Jan 2014 00:04:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:04:06 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:04:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:04:08 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:04:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 00:04:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 00:04:08 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:04:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9135 values 144377 bits 18047 bytes 
Sat 18 Jan 2014 00:04:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:04:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:04:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:04:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:04:25 - XML: Processed 655514 elements - found 654 jobs
Sat 18 Jan 2014 00:04:25 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:04:25 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:04:25 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:04:25 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:04:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:04:27 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:04:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:04:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:04:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:04:28 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:04:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:04:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:04:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:04:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:04:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:04:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:04:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:04:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:04:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:04:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:04:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:04:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:04:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43892040
Sat 18 Jan 2014 00:04:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:04:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43892040
Sat 18 Jan 2014 00:04:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:04:40 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:04:41 - job_xml_thread(): Done retrieving: data size 43892040
Sat 18 Jan 2014 00:04:41 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:04:41 - XML: Start document: iteration 18
Sat 18 Jan 2014 00:04:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:04:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:04:43 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:04:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 00:04:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:04:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:04:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:04:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:04:44 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:04:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:04:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:04:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:04:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:04:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:04:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:04:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:04:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:04:54 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:04:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:04:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:04:55 - XML: Processed 655514 elements - found 654 jobs
Sat 18 Jan 2014 00:04:55 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:04:55 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:04:55 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:04:55 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:04:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:04:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:04:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:04:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:04:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:04:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43854154
Sat 18 Jan 2014 00:04:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:04:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:04:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:04:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43854154
Sat 18 Jan 2014 00:04:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:05:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:05:08 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:05:09 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:05:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 00:05:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:05:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:05:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:05:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 00:05:09 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:05:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6233 values 98370 bits 12296 bytes 
Sat 18 Jan 2014 00:05:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:05:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:05:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:05:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:05:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:05:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:05:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:05:10 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:05:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:05:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:05:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:05:13 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:05:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:05:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:05:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:05:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:05:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:05:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:05:16 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:05:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 00:05:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:05:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:05:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43804091
Sat 18 Jan 2014 00:05:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:05:17 - job_xml_thread(): Done retrieving: data size 43804091
Sat 18 Jan 2014 00:05:17 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:05:17 - XML: Start document: iteration 19
Sat 18 Jan 2014 00:05:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43804091
Sat 18 Jan 2014 00:05:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:05:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:05:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:05:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:05:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:05:32 - XML: Processed 654766 elements - found 654 jobs
Sat 18 Jan 2014 00:05:32 - job 7348698 field 'start_timestamp' changed since saved from: 1389999830 to: 1389999759
Sat 18 Jan 2014 00:05:32 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 00:05:32 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 00:05:32 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 00:05:32 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:05:32 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:05:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:05:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:05:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:05:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:05:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:05:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:05:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:05:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:05:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:05:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:05:40 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:05:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:05:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:05:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:05:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:05:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:05:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:05:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:05:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43291036
Sat 18 Jan 2014 00:05:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:05:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43291036
Sat 18 Jan 2014 00:05:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:05:47 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:05:47 - job_xml_thread(): Done retrieving: data size 43291036
Sat 18 Jan 2014 00:05:47 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:05:47 - XML: Start document: iteration 20
Sat 18 Jan 2014 00:05:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:05:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:05:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:05:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:05:56 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 00:05:56 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 00:05:56 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:05:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:05:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:05:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:05:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:06:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:06:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:06:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:06:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:06:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:06:02 - XML: Processed 648208 elements - found 653 jobs
Sat 18 Jan 2014 00:06:02 - job 7348554 appears to have finished
Sat 18 Jan 2014 00:06:02 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 00:06:02 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 00:06:02 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 00:06:02 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:06:02 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:06:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:06:04 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:06:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:06:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:06:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:06:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:06:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:06:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:06:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:06:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43200893
Sat 18 Jan 2014 00:06:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:06:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43200893
Sat 18 Jan 2014 00:06:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:06:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:06:09 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:06:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:06:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 00:06:09 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:06:09 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:06:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148707 bits 18588 bytes 
Sat 18 Jan 2014 00:06:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 00:06:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:06:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:06:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:06:15 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:06:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:06:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:06:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:06:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:06:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:06:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:06:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:06:17 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:06:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:06:19 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:06:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:06:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:06:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:06:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:06:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:06:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:06:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:06:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43275460
Sat 18 Jan 2014 00:06:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:06:22 - job_xml_thread(): Done retrieving: data size 43275460
Sat 18 Jan 2014 00:06:22 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:06:22 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 00:06:22 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 00:06:22 - Housekeeping: done.
Sat 18 Jan 2014 00:06:22 - XML: Start document: iteration 0
Sat 18 Jan 2014 00:06:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43275460
Sat 18 Jan 2014 00:06:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:06:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:06:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:06:32 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:06:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:06:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:06:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:06:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:06:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:06:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:06:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:06:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:06:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:06:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:06:40 - XML: Processed 648060 elements - found 653 jobs
Sat 18 Jan 2014 00:06:40 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:06:40 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:06:40 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:06:40 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:06:43 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:06:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 00:06:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:06:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:06:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:06:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:06:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:06:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:06:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:06:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:06:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:06:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:06:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43761982
Sat 18 Jan 2014 00:06:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:06:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43761982
Sat 18 Jan 2014 00:06:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:06:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:06:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:06:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:06:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:06:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:06:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:06:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:06:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:06:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43761982
Sat 18 Jan 2014 00:06:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:06:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:06:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:06:55 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:06:55 - job_xml_thread(): Done retrieving: data size 43761982
Sat 18 Jan 2014 00:06:55 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:06:55 - XML: Start document: iteration 1
Sat 18 Jan 2014 00:07:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:07:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:07:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:07:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:07:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:07:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:07:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:07:10 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:07:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:07:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:07:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:07:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:07:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:07:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:07:11 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:07:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 00:07:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:07:11 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:07:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 00:07:11 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:07:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5906 values 93222 bits 11652 bytes 
Sat 18 Jan 2014 00:07:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:07:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:07:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:07:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:07:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:07:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:07:13 - XML: Processed 654286 elements - found 653 jobs
Sat 18 Jan 2014 00:07:13 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:07:13 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:07:13 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:07:13 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:07:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:07:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43878379
Sat 18 Jan 2014 00:07:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:07:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43878379
Sat 18 Jan 2014 00:07:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:07:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:07:26 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:07:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:07:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:07:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:07:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:07:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:07:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:07:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:07:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:07:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:07:28 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:07:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:07:30 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:07:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:07:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:07:30 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:07:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 00:07:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:07:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:07:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:07:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:07:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:07:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:07:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43869174
Sat 18 Jan 2014 00:07:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:07:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43869174
Sat 18 Jan 2014 00:07:32 - job_xml_thread(): Done retrieving: data size 43869174
Sat 18 Jan 2014 00:07:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:07:33 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:07:33 - XML: Start document: iteration 2
Sat 18 Jan 2014 00:07:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:07:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:07:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:07:44 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:07:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:07:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:07:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:07:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:07:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:07:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:07:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:07:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:07:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:07:50 - XML: Processed 655510 elements - found 653 jobs
Sat 18 Jan 2014 00:07:50 - job 7348582 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 00:07:50 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 00:07:50 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 00:07:50 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 00:07:50 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:07:50 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:07:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:07:53 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:07:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:07:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:07:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:07:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:07:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:07:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:07:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:07:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43852867
Sat 18 Jan 2014 00:07:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:07:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43852867
Sat 18 Jan 2014 00:07:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:08:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:08:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:08:05 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:08:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:08:05 - job_xml_thread(): Done retrieving: data size 43852867
Sat 18 Jan 2014 00:08:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:08:05 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:08:05 - XML: Start document: iteration 3
Sat 18 Jan 2014 00:08:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:08:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:08:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:08:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:08:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:08:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:08:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:08:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:08:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:08:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:08:11 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:08:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:08:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 00:08:12 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:08:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 00:08:12 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:08:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9037 values 142650 bits 17831 bytes 
Sat 18 Jan 2014 00:08:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:08:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:08:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:08:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:08:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:08:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:08:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:08:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:08:19 - XML: Processed 655511 elements - found 653 jobs
Sat 18 Jan 2014 00:08:19 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:08:19 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:08:19 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:08:19 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:08:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:08:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43838813
Sat 18 Jan 2014 00:08:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:08:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43838813
Sat 18 Jan 2014 00:08:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:08:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:08:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:08:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:08:31 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:08:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:08:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:08:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:08:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:08:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:08:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:08:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:08:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:08:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:08:34 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:08:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:08:35 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:08:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:08:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:08:35 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:08:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 00:08:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:08:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:08:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:08:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:08:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:08:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:08:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43877841
Sat 18 Jan 2014 00:08:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:08:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43877841
Sat 18 Jan 2014 00:08:37 - job_xml_thread(): Done retrieving: data size 43877841
Sat 18 Jan 2014 00:08:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:08:38 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:08:38 - XML: Start document: iteration 4
Sat 18 Jan 2014 00:08:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:08:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:08:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:08:48 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:08:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:08:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:08:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:08:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:08:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:08:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:08:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:08:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:08:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:08:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:08:56 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:08:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:08:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:08:57 - XML: Processed 655512 elements - found 653 jobs
Sat 18 Jan 2014 00:08:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:08:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:08:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:08:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:08:57 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:08:57 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:08:57 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:08:57 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:08:58 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 00:08:58 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:08:58 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:08:58 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:08:58 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 00:08:58 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 00:08:58 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 00:08:59 - size of cluster 'LISA Cluster': 624 hosts 79469 metrics 808963 values 12774234 bits 1596779 bytes 
Sat 18 Jan 2014 00:09:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:09:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43871451
Sat 18 Jan 2014 00:09:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:09:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43871451
Sat 18 Jan 2014 00:09:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:09:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:09:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:09:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:09:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:09:12 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:09:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:09:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:09:13 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:09:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:09:13 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:09:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:09:13 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:09:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 00:09:13 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:09:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:09:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 00:09:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8846 values 139467 bits 17433 bytes 
Sat 18 Jan 2014 00:09:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:09:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:09:14 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:09:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:09:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:09:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:09:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:09:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:09:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:09:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:09:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:09:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:09:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:09:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:09:18 - job_xml_thread(): Done retrieving: data size 43886145
Sat 18 Jan 2014 00:09:18 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:09:18 - XML: Start document: iteration 5
Sat 18 Jan 2014 00:09:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43886145
Sat 18 Jan 2014 00:09:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:09:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43886145
Sat 18 Jan 2014 00:09:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:09:22 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:09:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 00:09:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:09:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:09:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:09:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:09:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:09:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:09:32 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:09:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:09:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:09:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:09:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:09:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:09:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:09:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:09:37 - XML: Processed 655510 elements - found 652 jobs
Sat 18 Jan 2014 00:09:37 - job 7348555 appears to have finished
Sat 18 Jan 2014 00:09:37 - job 7348407 appears to have finished
Sat 18 Jan 2014 00:09:37 - job 7348682 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 00:09:37 - job 7335206 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 00:09:37 - job_xml_thread(): Found 5 updated jobs.
Sat 18 Jan 2014 00:09:37 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 00:09:38 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Sat 18 Jan 2014 00:09:38 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:09:38 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:09:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:09:40 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:09:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:09:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:09:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:09:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:09:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:09:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:09:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:09:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867491
Sat 18 Jan 2014 00:09:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:09:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43867491
Sat 18 Jan 2014 00:09:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:09:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:09:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:09:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:09:53 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:09:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:09:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:09:53 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:09:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:09:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:09:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:09:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:09:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:09:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:09:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:09:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:09:57 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:09:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:09:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:09:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:09:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:09:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:09:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:09:58 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:09:58 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 00:10:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:10:00 - job_xml_thread(): Done retrieving: data size 43879627
Sat 18 Jan 2014 00:10:00 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:10:00 - XML: Start document: iteration 6
Sat 18 Jan 2014 00:10:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43879627
Sat 18 Jan 2014 00:10:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:10:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43879627
Sat 18 Jan 2014 00:10:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:10:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:10:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:10:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:10:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:10:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:10:13 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:10:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:10:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 00:10:13 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:10:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 00:10:13 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:10:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9387 values 148098 bits 18512 bytes 
Sat 18 Jan 2014 00:10:19 - XML: Processed 655510 elements - found 652 jobs
Sat 18 Jan 2014 00:10:19 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:10:19 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:10:20 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:10:20 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:10:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:10:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:10:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:10:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:10:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:10:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:10:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:10:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:10:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:10:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:10:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:10:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:10:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:10:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:10:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:10:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:10:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:10:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:10:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43888001
Sat 18 Jan 2014 00:10:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:10:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43888001
Sat 18 Jan 2014 00:10:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:10:35 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:10:35 - job_xml_thread(): Done retrieving: data size 43888001
Sat 18 Jan 2014 00:10:35 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:10:35 - XML: Start document: iteration 7
Sat 18 Jan 2014 00:10:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:10:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:10:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:10:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:10:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:10:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:10:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:10:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:10:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:10:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:10:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:10:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:10:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:10:44 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:10:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 00:10:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:10:49 - XML: Processed 655510 elements - found 652 jobs
Sat 18 Jan 2014 00:10:50 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:10:50 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:10:50 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:10:50 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:10:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:10:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:10:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:10:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:10:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:10:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:10:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:10:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:10:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:10:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43842659
Sat 18 Jan 2014 00:10:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:10:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43842659
Sat 18 Jan 2014 00:10:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:10:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:10:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:11:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:11:02 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:11:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:11:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:11:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:11:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:11:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:11:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:11:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43842659
Sat 18 Jan 2014 00:11:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:11:05 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:11:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:11:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:11:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:11:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:11:13 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:11:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:11:13 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:11:14 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:11:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:11:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 00:11:14 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:11:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 00:11:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6080 values 95942 bits 11992 bytes 
Sat 18 Jan 2014 00:11:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:11:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:11:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:11:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:11:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:11:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:11:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:11:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:11:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:11:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:11:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:11:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:11:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:11:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:11:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:11:20 - job_xml_thread(): Done retrieving: data size 43791833
Sat 18 Jan 2014 00:11:20 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:11:20 - XML: Start document: iteration 8
Sat 18 Jan 2014 00:11:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43791833
Sat 18 Jan 2014 00:11:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:11:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43791833
Sat 18 Jan 2014 00:11:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:11:28 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:11:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 00:11:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:11:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:11:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:11:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:11:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:11:37 - XML: Processed 654766 elements - found 654 jobs
Sat 18 Jan 2014 00:11:37 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 00:11:37 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 00:11:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:11:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:11:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:11:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:11:39 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 00:11:39 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:11:39 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:11:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:11:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:11:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:11:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:11:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:11:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:11:43 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:11:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:11:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:11:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:11:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:11:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:11:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:11:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:11:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43263960
Sat 18 Jan 2014 00:11:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:11:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43263960
Sat 18 Jan 2014 00:11:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:11:54 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:11:54 - job_xml_thread(): Done retrieving: data size 43263960
Sat 18 Jan 2014 00:11:54 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:11:54 - XML: Start document: iteration 9
Sat 18 Jan 2014 00:11:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:11:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:11:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:11:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:12:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:12:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:12:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:12:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:12:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:12:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:12:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:12:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:12:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:12:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:12:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:12:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:12:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:12:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:12:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:12:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:12:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:12:10 - XML: Processed 647966 elements - found 652 jobs
Sat 18 Jan 2014 00:12:10 - job 7335186 appears to have finished
Sat 18 Jan 2014 00:12:10 - job 7345970 appears to have finished
Sat 18 Jan 2014 00:12:10 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 00:12:10 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 00:12:10 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 00:12:10 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:12:10 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:12:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:12:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43257672
Sat 18 Jan 2014 00:12:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:12:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43257672
Sat 18 Jan 2014 00:12:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:12:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:12:15 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:12:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:12:16 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:12:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 00:12:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 00:12:16 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:12:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9310 values 146887 bits 18360 bytes 
Sat 18 Jan 2014 00:12:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:12:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:12:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:12:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:12:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:12:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:12:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:12:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:12:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:12:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:12:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43257672
Sat 18 Jan 2014 00:12:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:12:25 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:12:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:12:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:12:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:12:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:12:32 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:12:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:12:35 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:12:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:12:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:12:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:12:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:12:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:12:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:12:35 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 00:12:35 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 00:12:35 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:12:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:12:37 - job_xml_thread(): Done retrieving: data size 43555499
Sat 18 Jan 2014 00:12:37 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:12:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555499
Sat 18 Jan 2014 00:12:37 - XML: Start document: iteration 10
Sat 18 Jan 2014 00:12:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:12:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:12:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:12:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:12:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:12:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555499
Sat 18 Jan 2014 00:12:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:12:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:12:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:12:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:12:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:12:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:12:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:12:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:12:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:12:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:12:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:12:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:12:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:12:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:12:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:12:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:13:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:13:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:13:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:13:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:13:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:13:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:13:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:13:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:13:01 - XML: Processed 651832 elements - found 652 jobs
Sat 18 Jan 2014 00:13:01 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:13:01 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:13:01 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:13:01 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:13:02 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:13:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 00:13:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:13:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:13:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43872959
Sat 18 Jan 2014 00:13:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:13:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43872959
Sat 18 Jan 2014 00:13:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:13:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:13:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:13:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:13:15 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:13:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:13:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:13:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:13:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:13:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:13:16 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:13:16 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:13:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:13:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:13:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:13:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:13:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:13:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:13:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 00:13:17 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:13:17 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:13:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 00:13:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5669 values 89340 bits 11167 bytes 
Sat 18 Jan 2014 00:13:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:13:18 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:13:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:13:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:13:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:13:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:13:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:13:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:13:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:13:21 - job_xml_thread(): Done retrieving: data size 43885155
Sat 18 Jan 2014 00:13:21 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:13:21 - XML: Start document: iteration 11
Sat 18 Jan 2014 00:13:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43885155
Sat 18 Jan 2014 00:13:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43885155
Sat 18 Jan 2014 00:13:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:13:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:13:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:13:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:13:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:13:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:13:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:13:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:13:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:13:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:13:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:13:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:13:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:13:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:13:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:13:40 - XML: Processed 655508 elements - found 651 jobs
Sat 18 Jan 2014 00:13:40 - job 7348556 appears to have finished
Sat 18 Jan 2014 00:13:40 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 00:13:40 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 00:13:40 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 00:13:40 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:13:40 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:13:40 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:13:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 00:13:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:13:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:13:43 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:13:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:13:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:13:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:13:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:13:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:13:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:13:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:13:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856979
Sat 18 Jan 2014 00:13:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:13:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43856979
Sat 18 Jan 2014 00:13:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:13:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:13:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:13:55 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:13:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:13:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:13:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:13:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:13:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:13:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:13:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:13:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:13:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:13:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:13:59 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:13:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:13:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:13:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:13:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:13:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:13:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:14:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:14:00 - job_xml_thread(): Done retrieving: data size 43871065
Sat 18 Jan 2014 00:14:00 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:14:00 - XML: Start document: iteration 12
Sat 18 Jan 2014 00:14:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43871065
Sat 18 Jan 2014 00:14:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43871065
Sat 18 Jan 2014 00:14:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:14:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:14:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:14:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:14:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:14:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:14:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:14:18 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:14:18 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:14:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:14:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 00:14:18 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:14:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 00:14:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8975 values 141551 bits 17693 bytes 
Sat 18 Jan 2014 00:14:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:14:20 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:14:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:14:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:14:20 - XML: Processed 655508 elements - found 651 jobs
Sat 18 Jan 2014 00:14:20 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:14:20 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:14:20 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:14:20 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:14:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:14:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:14:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:14:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:14:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:14:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:14:23 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:14:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:14:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:14:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:14:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:14:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:14:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:14:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:14:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43874680
Sat 18 Jan 2014 00:14:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:14:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43874680
Sat 18 Jan 2014 00:14:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:14:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:14:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:14:35 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:14:35 - job_xml_thread(): Done retrieving: data size 43874680
Sat 18 Jan 2014 00:14:35 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:14:35 - XML: Start document: iteration 13
Sat 18 Jan 2014 00:14:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:14:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:14:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:14:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:14:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:14:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:14:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:14:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:14:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:14:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:14:48 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:14:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:14:48 - XML: Processed 655508 elements - found 651 jobs
Sat 18 Jan 2014 00:14:48 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:14:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:14:48 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:14:48 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:14:48 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:14:48 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:14:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 00:14:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:14:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:14:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:14:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:14:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:14:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:14:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43864597
Sat 18 Jan 2014 00:14:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:14:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43864597
Sat 18 Jan 2014 00:14:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:14:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:14:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:15:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:15:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:15:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:15:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:15:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:15:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:15:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:15:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:15:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:15:03 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:15:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:15:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:15:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:15:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:15:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:15:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:15:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:15:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:15:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:15:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43894308
Sat 18 Jan 2014 00:15:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:15:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43894308
Sat 18 Jan 2014 00:15:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:15:07 - job_xml_thread(): Done retrieving: data size 43894308
Sat 18 Jan 2014 00:15:07 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:15:08 - XML: Start document: iteration 14
Sat 18 Jan 2014 00:15:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:15:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:15:18 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:15:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:15:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:15:19 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:15:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:15:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:15:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:15:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:15:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:15:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:15:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:15:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:15:20 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:15:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 00:15:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 00:15:20 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:15:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9102 values 143638 bits 17954 bytes 
Sat 18 Jan 2014 00:15:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:15:27 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:15:27 - XML: Processed 655508 elements - found 651 jobs
Sat 18 Jan 2014 00:15:27 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:15:27 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:15:27 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:15:27 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:15:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:15:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:15:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:15:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:15:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:15:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:15:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:15:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43854740
Sat 18 Jan 2014 00:15:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:15:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43854740
Sat 18 Jan 2014 00:15:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:15:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:15:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:15:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:15:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:15:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:15:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:15:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:15:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:15:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:15:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:15:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:15:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:15:42 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:15:42 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:15:42 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:15:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 00:15:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:15:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:15:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:15:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:15:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:15:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:15:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:15:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:15:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43881201
Sat 18 Jan 2014 00:15:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:15:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43881201
Sat 18 Jan 2014 00:15:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:15:44 - job_xml_thread(): Done retrieving: data size 43881201
Sat 18 Jan 2014 00:15:44 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:15:44 - XML: Start document: iteration 15
Sat 18 Jan 2014 00:15:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:15:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:15:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:15:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:15:58 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 00:15:58 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:15:59 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:15:59 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 00:15:59 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 00:15:59 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:15:59 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 00:15:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:15:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:16:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:16:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:16:00 - XML: Processed 655508 elements - found 651 jobs
Sat 18 Jan 2014 00:16:00 - job 7348583 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 00:16:01 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 00:16:01 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 00:16:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:16:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:16:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:16:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:16:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:16:01 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 00:16:01 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:16:01 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:16:04 - size of cluster 'LISA Cluster': 624 hosts 79475 metrics 847037 values 13363474 bits 1670434 bytes 
Sat 18 Jan 2014 00:16:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:16:06 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:16:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:16:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:16:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:16:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:16:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:16:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:16:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:16:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43866752
Sat 18 Jan 2014 00:16:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:16:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43866752
Sat 18 Jan 2014 00:16:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:16:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:16:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:16:16 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:16:16 - job_xml_thread(): Done retrieving: data size 43866752
Sat 18 Jan 2014 00:16:17 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:16:17 - XML: Start document: iteration 16
Sat 18 Jan 2014 00:16:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:16:21 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:16:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:16:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:16:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:16:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 00:16:23 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:16:23 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:16:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 00:16:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8692 values 137187 bits 17148 bytes 
Sat 18 Jan 2014 00:16:29 - XML: Processed 655508 elements - found 651 jobs
Sat 18 Jan 2014 00:16:29 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:16:29 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:16:29 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:16:29 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:16:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:16:29 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:16:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:16:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:16:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:16:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:16:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:16:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:16:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:16:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:16:34 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:16:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:16:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:16:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:16:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:16:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:16:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:16:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:16:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43878420
Sat 18 Jan 2014 00:16:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:16:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43878420
Sat 18 Jan 2014 00:16:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:16:44 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:16:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:16:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:16:46 - job_xml_thread(): Done retrieving: data size 43878420
Sat 18 Jan 2014 00:16:46 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:16:46 - XML: Start document: iteration 17
Sat 18 Jan 2014 00:16:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:16:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:16:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:16:53 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:16:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:16:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:16:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:16:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:16:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:16:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:16:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:16:58 - XML: Processed 655508 elements - found 651 jobs
Sat 18 Jan 2014 00:16:58 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:16:58 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:16:58 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:16:58 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:16:59 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:16:59 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 00:17:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:17:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:17:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:17:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:17:01 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:17:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 00:17:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:17:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:17:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:17:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:17:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:17:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:17:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43883801
Sat 18 Jan 2014 00:17:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:17:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43883801
Sat 18 Jan 2014 00:17:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:17:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:17:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:17:13 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:17:13 - job_xml_thread(): Done retrieving: data size 43883801
Sat 18 Jan 2014 00:17:13 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:17:13 - XML: Start document: iteration 18
Sat 18 Jan 2014 00:17:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:17:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:17:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:17:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:17:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:17:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:17:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:17:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:17:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:17:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:17:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:17:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:17:24 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:17:24 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:17:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 00:17:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:17:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 00:17:24 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:17:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5687 values 89873 bits 11234 bytes 
Sat 18 Jan 2014 00:17:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:17:27 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:17:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:17:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:17:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:17:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:17:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:17:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:17:28 - XML: Processed 655508 elements - found 651 jobs
Sat 18 Jan 2014 00:17:28 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:17:28 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:17:28 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:17:28 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:17:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:17:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43790581
Sat 18 Jan 2014 00:17:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:17:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43790581
Sat 18 Jan 2014 00:17:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:17:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:17:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:17:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:17:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:17:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:17:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:17:40 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:17:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 00:17:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:17:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:17:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:17:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43790581
Sat 18 Jan 2014 00:17:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:17:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:17:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:17:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:17:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:17:43 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:17:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:17:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:17:49 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:17:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:17:54 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:17:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:17:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:17:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:17:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:17:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:17:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:17:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:17:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:17:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:17:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:17:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:17:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:17:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:17:56 - job_xml_thread(): Done retrieving: data size 43233788
Sat 18 Jan 2014 00:17:56 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:17:56 - XML: Start document: iteration 19
Sat 18 Jan 2014 00:17:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43233788
Sat 18 Jan 2014 00:17:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43233788
Sat 18 Jan 2014 00:17:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:17:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:18:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:18:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:18:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:18:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:18:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:18:12 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:18:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:18:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:18:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:18:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:18:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:18:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:18:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:18:18 - XML: Processed 647976 elements - found 650 jobs
Sat 18 Jan 2014 00:18:18 - job 7348221 appears to have finished
Sat 18 Jan 2014 00:18:18 - job 7348584 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 00:18:18 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 00:18:18 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 00:18:19 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 00:18:19 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:18:19 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:18:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:18:19 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:18:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:18:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:18:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:18:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:18:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:18:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:18:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:18:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43288239
Sat 18 Jan 2014 00:18:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:18:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43288239
Sat 18 Jan 2014 00:18:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:18:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:18:24 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:18:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:18:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 00:18:25 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:18:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 149082 bits 18635 bytes 
Sat 18 Jan 2014 00:18:25 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:18:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 00:18:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:18:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:18:34 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:18:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:18:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:18:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:18:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:18:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:18:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:18:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:18:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:18:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:18:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:18:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:18:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:18:39 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:18:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:18:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:18:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:18:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:18:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:18:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:18:41 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:18:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 00:18:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:18:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:18:42 - job_xml_thread(): Done retrieving: data size 43784820
Sat 18 Jan 2014 00:18:42 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:18:42 - XML: Start document: iteration 20
Sat 18 Jan 2014 00:18:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43784820
Sat 18 Jan 2014 00:18:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:18:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43784820
Sat 18 Jan 2014 00:18:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:18:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:18:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:18:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:18:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:18:56 - XML: Processed 654601 elements - found 650 jobs
Sat 18 Jan 2014 00:18:56 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:18:57 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:18:57 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:18:57 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:18:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:18:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:18:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:18:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:19:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:19:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:19:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:19:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:19:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:19:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:19:04 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:19:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:19:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:19:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:19:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:19:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:19:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:19:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:19:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870812
Sat 18 Jan 2014 00:19:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:19:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870812
Sat 18 Jan 2014 00:19:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:19:12 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:19:12 - job_xml_thread(): Done retrieving: data size 43870812
Sat 18 Jan 2014 00:19:12 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:19:12 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 00:19:12 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 00:19:12 - Housekeeping: done.
Sat 18 Jan 2014 00:19:12 - XML: Start document: iteration 0
Sat 18 Jan 2014 00:19:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:19:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:19:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:19:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:19:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:19:24 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:19:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:19:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:19:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:19:25 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:19:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:19:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:19:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:19:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:19:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:19:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:19:27 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:19:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 00:19:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 00:19:27 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:19:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99152 bits 12394 bytes 
Sat 18 Jan 2014 00:19:29 - XML: Processed 655404 elements - found 650 jobs
Sat 18 Jan 2014 00:19:29 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:19:30 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:19:30 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:19:30 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:19:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:19:30 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:19:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:19:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:19:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:19:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:19:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:19:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:19:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:19:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43871669
Sat 18 Jan 2014 00:19:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:19:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43871669
Sat 18 Jan 2014 00:19:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:19:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:19:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:19:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:19:44 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:19:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:19:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:19:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:19:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:19:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:19:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:19:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:19:45 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:19:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:19:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:19:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:19:48 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:19:48 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 00:19:48 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 00:19:48 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:19:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:19:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:19:48 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:19:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 00:19:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:19:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:19:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:19:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:19:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:19:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:19:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43876688
Sat 18 Jan 2014 00:19:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:19:51 - job_xml_thread(): Done retrieving: data size 43876688
Sat 18 Jan 2014 00:19:51 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:19:51 - XML: Start document: iteration 1
Sat 18 Jan 2014 00:19:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43876688
Sat 18 Jan 2014 00:19:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:20:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:20:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:20:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:20:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:20:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:20:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:20:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:20:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:20:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:20:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:20:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:20:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:20:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:20:09 - XML: Processed 655506 elements - found 650 jobs
Sat 18 Jan 2014 00:20:10 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:20:10 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:20:10 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:20:10 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:20:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:20:13 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:20:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:20:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:20:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:20:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:20:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:20:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:20:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:20:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856382
Sat 18 Jan 2014 00:20:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:20:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43856382
Sat 18 Jan 2014 00:20:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:20:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:20:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:20:25 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:20:26 - job_xml_thread(): Done retrieving: data size 43856382
Sat 18 Jan 2014 00:20:26 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:20:26 - XML: Start document: iteration 2
Sat 18 Jan 2014 00:20:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:20:26 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:20:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:20:27 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:20:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:20:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:20:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:20:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:20:30 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:20:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:20:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 00:20:30 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:20:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 00:20:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:20:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:20:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:20:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:20:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9108 values 143730 bits 17966 bytes 
Sat 18 Jan 2014 00:20:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:20:36 - XML: Processed 655506 elements - found 650 jobs
Sat 18 Jan 2014 00:20:36 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:20:36 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:20:36 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:20:36 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:20:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:20:38 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:20:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:20:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:20:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:20:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:20:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:20:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:20:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:20:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43852840
Sat 18 Jan 2014 00:20:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:20:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43852840
Sat 18 Jan 2014 00:20:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:20:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:20:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:20:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:20:50 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:20:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:20:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:20:51 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:20:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:20:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:20:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:20:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:20:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:20:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:20:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:20:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:20:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:20:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:20:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:20:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:20:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:20:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:20:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:20:55 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:20:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 00:20:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:20:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:20:57 - job_xml_thread(): Done retrieving: data size 43873508
Sat 18 Jan 2014 00:20:57 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:20:57 - XML: Start document: iteration 3
Sat 18 Jan 2014 00:20:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873508
Sat 18 Jan 2014 00:20:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:20:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873508
Sat 18 Jan 2014 00:20:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:21:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:21:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:21:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:21:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:21:14 - XML: Processed 655506 elements - found 650 jobs
Sat 18 Jan 2014 00:21:14 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:21:14 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:21:14 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:21:14 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:21:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:21:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:21:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:21:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:21:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:21:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:21:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:21:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:21:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:21:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:21:19 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:21:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:21:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:21:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:21:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:21:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:21:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:21:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:21:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43888207
Sat 18 Jan 2014 00:21:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:21:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43888207
Sat 18 Jan 2014 00:21:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:21:29 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:21:29 - job_xml_thread(): Done retrieving: data size 43888207
Sat 18 Jan 2014 00:21:29 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:21:29 - XML: Start document: iteration 4
Sat 18 Jan 2014 00:21:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:21:30 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:21:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:21:31 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:21:31 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:21:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 00:21:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:21:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 00:21:31 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:21:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8845 values 139512 bits 17439 bytes 
Sat 18 Jan 2014 00:21:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:21:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:21:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:21:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:21:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:21:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:21:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:21:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:21:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:21:41 - XML: Processed 655504 elements - found 649 jobs
Sat 18 Jan 2014 00:21:41 - job 7348056 appears to have finished
Sat 18 Jan 2014 00:21:41 - job 7348585 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 00:21:41 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 00:21:41 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 00:21:41 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 00:21:41 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:21:41 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:21:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:21:43 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:21:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:21:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:21:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:21:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:21:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:21:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:21:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:21:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853052
Sat 18 Jan 2014 00:21:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:21:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853052
Sat 18 Jan 2014 00:21:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:21:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:21:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:21:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:21:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:21:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:21:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:21:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:21:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:21:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:21:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:21:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:21:56 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:21:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:21:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:21:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:21:59 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:21:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:21:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:21:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:21:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:21:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:21:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:22:00 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:22:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 00:22:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:22:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:22:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43879977
Sat 18 Jan 2014 00:22:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:22:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43879977
Sat 18 Jan 2014 00:22:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:22:02 - job_xml_thread(): Done retrieving: data size 43879977
Sat 18 Jan 2014 00:22:03 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:22:03 - XML: Start document: iteration 5
Sat 18 Jan 2014 00:22:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:22:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:22:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:22:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:22:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:22:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:22:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:22:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:22:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:22:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:22:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:22:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:22:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:22:21 - XML: Processed 655504 elements - found 649 jobs
Sat 18 Jan 2014 00:22:21 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:22:21 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:22:21 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:22:21 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:22:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:22:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:22:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:22:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:22:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:22:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:22:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:22:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:22:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:22:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43836698
Sat 18 Jan 2014 00:22:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:22:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43836698
Sat 18 Jan 2014 00:22:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:22:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:22:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:22:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:22:32 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:22:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:22:33 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:22:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 00:22:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 00:22:33 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:22:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8750 values 138005 bits 17250 bytes 
Sat 18 Jan 2014 00:22:36 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:22:36 - job_xml_thread(): Done retrieving: data size 43836698
Sat 18 Jan 2014 00:22:36 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:22:36 - XML: Start document: iteration 6
Sat 18 Jan 2014 00:22:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:22:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:22:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:22:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:22:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:22:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:22:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:22:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:22:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:22:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:22:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:22:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:22:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:22:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:22:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:22:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:22:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:22:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:22:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:22:49 - XML: Processed 655504 elements - found 649 jobs
Sat 18 Jan 2014 00:22:49 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:22:49 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:22:49 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:22:49 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:22:50 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:22:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 00:22:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:22:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:22:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43860824
Sat 18 Jan 2014 00:22:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:22:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43860824
Sat 18 Jan 2014 00:22:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:22:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:22:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:22:59 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 00:22:59 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:23:00 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:23:00 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 00:23:00 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:23:00 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 00:23:00 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 00:23:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:23:02 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:23:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:23:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:23:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:23:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:23:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:23:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:23:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:23:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:23:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:23:04 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:23:05 - size of cluster 'LISA Cluster': 624 hosts 79482 metrics 793605 values 12529944 bits 1566243 bytes 
Sat 18 Jan 2014 00:23:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:23:07 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:23:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:23:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:23:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:23:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:23:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:23:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:23:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:23:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43821599
Sat 18 Jan 2014 00:23:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:23:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43821599
Sat 18 Jan 2014 00:23:11 - job_xml_thread(): Done retrieving: data size 43821599
Sat 18 Jan 2014 00:23:11 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:23:11 - XML: Start document: iteration 7
Sat 18 Jan 2014 00:23:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:23:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:23:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:23:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:23:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:23:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:23:29 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:23:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:23:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:23:31 - XML: Processed 655020 elements - found 649 jobs
Sat 18 Jan 2014 00:23:31 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:23:31 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:23:31 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:23:31 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:23:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:23:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:23:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:23:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:23:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:23:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:23:33 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:23:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:23:34 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:23:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:23:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 00:23:34 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:23:34 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:23:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 00:23:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99117 bits 12389 bytes 
Sat 18 Jan 2014 00:23:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:23:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:23:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:23:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:23:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:23:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:23:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:23:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43301211
Sat 18 Jan 2014 00:23:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:23:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43301211
Sat 18 Jan 2014 00:23:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:23:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:23:45 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:23:46 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:23:46 - job_xml_thread(): Done retrieving: data size 43301211
Sat 18 Jan 2014 00:23:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:23:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:23:46 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:23:46 - XML: Start document: iteration 8
Sat 18 Jan 2014 00:23:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:23:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:23:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:23:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:23:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43301211
Sat 18 Jan 2014 00:23:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:23:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:23:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:24:00 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:24:00 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 00:24:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:24:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:24:02 - XML: Processed 648562 elements - found 649 jobs
Sat 18 Jan 2014 00:24:02 - job 7348253 appears to have finished
Sat 18 Jan 2014 00:24:02 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 00:24:02 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 00:24:04 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 00:24:04 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:24:04 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:24:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:24:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:24:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:24:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:24:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:24:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:24:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:24:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:24:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:24:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:24:07 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:24:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:24:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:24:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:24:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:24:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:24:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:24:07 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:24:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 00:24:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:24:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:24:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43263468
Sat 18 Jan 2014 00:24:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:24:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43263468
Sat 18 Jan 2014 00:24:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:24:19 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:24:19 - job_xml_thread(): Done retrieving: data size 43263468
Sat 18 Jan 2014 00:24:19 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:24:19 - XML: Start document: iteration 9
Sat 18 Jan 2014 00:24:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:24:20 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:24:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:24:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:24:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:24:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:24:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:24:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:24:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:24:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:24:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:24:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:24:30 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:24:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:24:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:24:32 - XML: Processed 647866 elements - found 649 jobs
Sat 18 Jan 2014 00:24:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:24:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:24:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:24:32 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:24:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:24:32 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:24:32 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:24:32 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:24:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:24:34 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:24:34 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:24:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:24:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 00:24:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 00:24:34 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:24:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5921 values 93396 bits 11674 bytes 
Sat 18 Jan 2014 00:24:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:24:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43414851
Sat 18 Jan 2014 00:24:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:24:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43414851
Sat 18 Jan 2014 00:24:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:24:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:24:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:24:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:24:46 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:24:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:24:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:24:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:24:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:24:47 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:24:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:24:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:24:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:24:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:24:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:24:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:24:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:24:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:24:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:24:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:24:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:24:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:24:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:24:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:24:55 - job_xml_thread(): Done retrieving: data size 43835506
Sat 18 Jan 2014 00:24:55 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:24:55 - XML: Start document: iteration 10
Sat 18 Jan 2014 00:24:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43835506
Sat 18 Jan 2014 00:24:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:24:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43835506
Sat 18 Jan 2014 00:24:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:25:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:25:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:25:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:25:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:25:11 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:25:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 00:25:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:25:14 - XML: Processed 655218 elements - found 649 jobs
Sat 18 Jan 2014 00:25:14 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:25:14 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:25:14 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:25:14 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:25:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:25:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:25:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:25:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:25:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:25:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:25:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:25:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:25:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:25:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:25:19 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:25:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:25:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:25:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:25:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:25:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:25:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:25:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:25:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858993
Sat 18 Jan 2014 00:25:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:25:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43858993
Sat 18 Jan 2014 00:25:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:25:29 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:25:29 - job_xml_thread(): Done retrieving: data size 43858993
Sat 18 Jan 2014 00:25:29 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:25:29 - XML: Start document: iteration 11
Sat 18 Jan 2014 00:25:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:25:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:25:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:25:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:25:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:25:34 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:25:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:25:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:25:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:25:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:25:35 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:25:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 00:25:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:25:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 00:25:35 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:25:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6209 values 97958 bits 12244 bytes 
Sat 18 Jan 2014 00:25:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:25:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:25:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:25:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:25:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:25:43 - XML: Processed 655502 elements - found 648 jobs
Sat 18 Jan 2014 00:25:43 - job 7344405 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7344408 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7337345 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7344419 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7344399 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7344398 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7344016 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7344391 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7344390 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7344393 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7344392 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7344395 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7344394 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7344397 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7344396 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7338411 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7335485 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7338343 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7348435 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7335259 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7335250 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7335254 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7335255 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7340349 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7337272 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7340972 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7345705 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7337799 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7344657 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7337400 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7339484 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7344435 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7344430 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7344433 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7344369 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7344363 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7344364 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7344367 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7348701 appears to have finished
Sat 18 Jan 2014 00:25:43 - job 7348599 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7348597 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7335361 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7348595 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7335364 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7335365 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7348591 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7348590 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7348609 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7348608 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7348606 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7348605 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7348604 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7348603 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7348602 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7348600 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7347695 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7335214 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7335215 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7335216 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7335217 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7335210 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7335211 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7335212 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7335213 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7335218 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7335219 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7339966 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7341063 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7345647 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7344436 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7344347 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7344432 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7344348 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7344349 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7344438 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7344439 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7343751 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7343472 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7348588 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7348589 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7338784 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7335903 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7342714 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7335424 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7335423 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7335422 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7335421 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7338025 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7348586 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7348587 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7348614 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7348611 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7348612 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job 7348613 report time 1390001071 does not match current heartbeat 1390001095 : ignoring job
Sat 18 Jan 2014 00:25:43 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 00:25:43 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 00:25:43 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 00:25:43 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:25:43 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:25:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:25:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:25:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:25:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:25:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:25:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:25:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:25:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:25:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:25:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858954
Sat 18 Jan 2014 00:25:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:25:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43858954
Sat 18 Jan 2014 00:25:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:25:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:25:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:25:58 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:25:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:25:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:25:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:25:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:25:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:25:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:25:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:25:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:25:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:26:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:26:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:26:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:26:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:26:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:26:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:26:03 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:26:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 00:26:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:26:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:26:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:26:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:26:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:26:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:26:05 - job_xml_thread(): Done retrieving: data size 43855310
Sat 18 Jan 2014 00:26:05 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:26:05 - XML: Start document: iteration 12
Sat 18 Jan 2014 00:26:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855310
Sat 18 Jan 2014 00:26:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855310
Sat 18 Jan 2014 00:26:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:26:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:26:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:26:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:26:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:26:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:26:19 - XML: Processed 655502 elements - found 648 jobs
Sat 18 Jan 2014 00:26:19 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:26:19 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:26:19 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:26:19 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:26:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:26:24 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:26:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:26:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:26:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:26:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:26:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:26:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:26:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:26:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:26:27 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:26:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:26:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:26:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:26:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:26:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:26:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:26:30 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 00:26:30 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 00:26:30 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:26:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:26:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43886427
Sat 18 Jan 2014 00:26:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:26:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43886427
Sat 18 Jan 2014 00:26:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:26:35 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:26:35 - job_xml_thread(): Done retrieving: data size 43886427
Sat 18 Jan 2014 00:26:35 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:26:35 - XML: Start document: iteration 13
Sat 18 Jan 2014 00:26:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:26:36 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:26:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:26:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 00:26:37 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:26:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8730 values 137651 bits 17206 bytes 
Sat 18 Jan 2014 00:26:37 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:26:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 00:26:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:26:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:26:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:26:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:26:42 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:26:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:26:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:26:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:26:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:26:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:26:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:26:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:26:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:26:51 - XML: Processed 655501 elements - found 648 jobs
Sat 18 Jan 2014 00:26:51 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:26:51 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:26:52 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:26:52 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:26:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:26:53 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:26:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:26:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:26:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:26:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:26:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:26:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:26:55 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:26:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 00:26:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:26:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:26:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43850782
Sat 18 Jan 2014 00:26:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:26:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43850782
Sat 18 Jan 2014 00:26:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:26:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:27:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:27:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:27:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:27:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:27:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:27:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:27:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:27:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:27:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:27:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:27:07 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:27:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:27:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:27:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:27:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:27:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:27:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:27:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:27:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:27:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:27:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:27:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:27:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43887546
Sat 18 Jan 2014 00:27:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:27:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43887546
Sat 18 Jan 2014 00:27:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:27:12 - job_xml_thread(): Done retrieving: data size 43887546
Sat 18 Jan 2014 00:27:12 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:27:12 - XML: Start document: iteration 14
Sat 18 Jan 2014 00:27:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:27:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:27:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:27:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:27:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:27:25 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:27:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:27:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:27:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:27:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:27:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:27:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:27:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:27:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:27:33 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:27:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:27:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:27:35 - XML: Processed 655502 elements - found 648 jobs
Sat 18 Jan 2014 00:27:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:27:35 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:27:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:27:35 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:27:35 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:27:35 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:27:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:27:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:27:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:27:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43847062
Sat 18 Jan 2014 00:27:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:27:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:27:38 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:27:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43847062
Sat 18 Jan 2014 00:27:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:27:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:27:39 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:27:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 00:27:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 00:27:40 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:27:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:27:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:27:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9279 values 146439 bits 18304 bytes 
Sat 18 Jan 2014 00:27:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:27:48 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:27:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:27:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:27:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:27:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:27:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:27:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:27:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:27:50 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:27:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:27:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:27:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:27:52 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:27:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:27:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:27:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:27:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:27:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:27:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:27:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:27:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875884
Sat 18 Jan 2014 00:27:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:27:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875884
Sat 18 Jan 2014 00:27:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:27:55 - job_xml_thread(): Done retrieving: data size 43875884
Sat 18 Jan 2014 00:27:55 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:27:55 - XML: Start document: iteration 15
Sat 18 Jan 2014 00:28:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:28:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:28:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:28:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:28:12 - XML: Processed 655502 elements - found 648 jobs
Sat 18 Jan 2014 00:28:12 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:28:12 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:28:12 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:28:12 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:28:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:28:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:28:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:28:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:28:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:28:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:28:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:28:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:28:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:28:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:28:19 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:28:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:28:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:28:19 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:28:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 00:28:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:28:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:28:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:28:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:28:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:28:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:28:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43864459
Sat 18 Jan 2014 00:28:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:28:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43864459
Sat 18 Jan 2014 00:28:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:28:27 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:28:27 - job_xml_thread(): Done retrieving: data size 43864459
Sat 18 Jan 2014 00:28:27 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:28:27 - XML: Start document: iteration 16
Sat 18 Jan 2014 00:28:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:28:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:28:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:28:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:28:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:28:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:28:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:28:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:28:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:28:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:28:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:28:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:28:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:28:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:28:39 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:28:41 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:28:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:28:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 00:28:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 00:28:41 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:28:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5926 values 93493 bits 11686 bytes 
Sat 18 Jan 2014 00:28:44 - XML: Processed 655502 elements - found 648 jobs
Sat 18 Jan 2014 00:28:44 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:28:44 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:28:44 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:28:44 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:28:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:28:46 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:28:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:28:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:28:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:28:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:28:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:28:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:28:47 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:28:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 00:28:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:28:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:28:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870413
Sat 18 Jan 2014 00:28:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:28:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870413
Sat 18 Jan 2014 00:28:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:28:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:28:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:28:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:28:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:28:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:28:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:28:59 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:28:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:28:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:28:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:28:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:28:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:29:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:29:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:29:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:29:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:29:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:29:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:29:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:29:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:29:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:29:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:29:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:29:05 - job_xml_thread(): Done retrieving: data size 43886028
Sat 18 Jan 2014 00:29:05 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:29:05 - XML: Start document: iteration 17
Sat 18 Jan 2014 00:29:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43886028
Sat 18 Jan 2014 00:29:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:29:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43886028
Sat 18 Jan 2014 00:29:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:29:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:29:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:29:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:29:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:29:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:29:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:29:22 - XML: Processed 655502 elements - found 648 jobs
Sat 18 Jan 2014 00:29:22 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:29:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:29:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:29:22 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:29:22 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:29:22 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:29:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:29:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:29:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:29:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:29:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:29:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:29:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:29:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:29:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:29:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:29:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:29:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:29:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:29:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:29:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43817604
Sat 18 Jan 2014 00:29:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:29:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43817604
Sat 18 Jan 2014 00:29:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:29:37 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:29:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:29:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:29:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:29:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:29:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:29:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:29:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:29:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:29:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:29:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:29:41 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:29:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:29:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:29:41 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:29:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:29:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:29:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:29:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:29:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:29:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:29:41 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:29:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 00:29:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 00:29:41 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:29:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148621 bits 18577 bytes 
Sat 18 Jan 2014 00:29:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:29:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:29:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:29:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:29:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:29:43 - job_xml_thread(): Done retrieving: data size 43289812
Sat 18 Jan 2014 00:29:43 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:29:43 - XML: Start document: iteration 18
Sat 18 Jan 2014 00:29:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43289812
Sat 18 Jan 2014 00:29:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:29:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43289812
Sat 18 Jan 2014 00:29:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:29:54 - XML: Processed 648322 elements - found 648 jobs
Sat 18 Jan 2014 00:29:54 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:29:54 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:29:54 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:29:54 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:29:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:29:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:29:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:29:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:30:00 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 00:30:00 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:30:01 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:30:01 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:30:01 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 00:30:01 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 00:30:01 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 00:30:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:30:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:30:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:30:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:30:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:30:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:30:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:30:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:30:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:30:05 - size of cluster 'LISA Cluster': 624 hosts 79485 metrics 776391 values 12250075 bits 1531259 bytes 
Sat 18 Jan 2014 00:30:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:30:07 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:30:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:30:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:30:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:30:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:30:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:30:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:30:07 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:30:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 00:30:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:30:09 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:30:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:30:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43253225
Sat 18 Jan 2014 00:30:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:30:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43253225
Sat 18 Jan 2014 00:30:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:30:11 - job_xml_thread(): Done retrieving: data size 43253225
Sat 18 Jan 2014 00:30:11 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:30:11 - XML: Start document: iteration 19
Sat 18 Jan 2014 00:30:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:30:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:30:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:30:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:30:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:30:29 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:30:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:30:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:30:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:30:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:30:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:30:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:30:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:30:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:30:30 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:30:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:30:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:30:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:30:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:30:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:30:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:30:33 - XML: Processed 647872 elements - found 648 jobs
Sat 18 Jan 2014 00:30:33 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:30:33 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:30:33 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:30:33 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:30:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:30:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43486531
Sat 18 Jan 2014 00:30:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:30:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43486531
Sat 18 Jan 2014 00:30:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:30:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:30:41 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:30:42 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:30:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 00:30:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:30:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 00:30:42 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:30:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8649 values 136414 bits 17051 bytes 
Sat 18 Jan 2014 00:30:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:30:45 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:30:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:30:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:30:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:30:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:30:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:30:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:30:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:30:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:30:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:30:48 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:30:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:30:49 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:30:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:30:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:30:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:30:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:30:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:30:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:30:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:30:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43846709
Sat 18 Jan 2014 00:30:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:30:53 - job_xml_thread(): Done retrieving: data size 43846709
Sat 18 Jan 2014 00:30:53 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:30:53 - XML: Start document: iteration 20
Sat 18 Jan 2014 00:30:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43846709
Sat 18 Jan 2014 00:30:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:31:01 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:31:01 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 00:31:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:31:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:31:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:31:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:31:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:31:10 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:31:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:31:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:31:11 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:31:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 00:31:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:31:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:31:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:31:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:31:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:31:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:31:12 - XML: Processed 655340 elements - found 648 jobs
Sat 18 Jan 2014 00:31:12 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:31:12 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:31:12 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:31:12 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:31:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:31:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:31:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:31:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:31:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:31:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:31:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:31:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:31:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:31:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43884971
Sat 18 Jan 2014 00:31:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:31:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43884971
Sat 18 Jan 2014 00:31:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:31:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:31:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:31:27 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:31:27 - job_xml_thread(): Done retrieving: data size 43884971
Sat 18 Jan 2014 00:31:27 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:31:27 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 00:31:27 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 00:31:27 - Housekeeping: done.
Sat 18 Jan 2014 00:31:27 - XML: Start document: iteration 0
Sat 18 Jan 2014 00:31:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:31:27 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:31:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:31:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:31:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:31:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:31:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:31:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:31:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:31:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:31:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:31:39 - XML: Processed 655508 elements - found 651 jobs
Sat 18 Jan 2014 00:31:39 - job 7348586 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 00:31:39 - job_xml_thread(): Found 4 updated jobs.
Sat 18 Jan 2014 00:31:39 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 00:31:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:31:40 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:31:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:31:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:31:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:31:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:31:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:31:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:31:41 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Sat 18 Jan 2014 00:31:41 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:31:41 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:31:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:31:42 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:31:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:31:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43844808
Sat 18 Jan 2014 00:31:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:31:43 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:31:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 00:31:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:31:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 00:31:43 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:31:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7684 values 121428 bits 15178 bytes 
Sat 18 Jan 2014 00:31:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43844808
Sat 18 Jan 2014 00:31:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:31:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:31:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:31:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:31:52 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:31:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:31:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:31:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:31:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:31:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:31:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:31:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:31:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:31:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:31:56 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:31:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:31:58 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:31:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:31:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:31:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:31:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:31:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:31:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:32:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:32:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875345
Sat 18 Jan 2014 00:32:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:32:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875345
Sat 18 Jan 2014 00:32:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:32:02 - job_xml_thread(): Done retrieving: data size 43875345
Sat 18 Jan 2014 00:32:02 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:32:02 - XML: Start document: iteration 1
Sat 18 Jan 2014 00:32:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:32:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:32:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:32:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:32:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:32:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:32:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:32:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:32:23 - XML: Processed 655504 elements - found 649 jobs
Sat 18 Jan 2014 00:32:23 - job 7348566 appears to have finished
Sat 18 Jan 2014 00:32:23 - job 7348565 appears to have finished
Sat 18 Jan 2014 00:32:23 - job 7348586 field 'start_timestamp' changed since saved from: 1390001434 to: 1390001432
Sat 18 Jan 2014 00:32:23 - job_xml_thread(): Found 3 updated jobs.
Sat 18 Jan 2014 00:32:23 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 00:32:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:32:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:32:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:32:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:32:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:32:23 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Sat 18 Jan 2014 00:32:23 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:32:23 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:32:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:32:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:32:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:32:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:32:26 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:32:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 00:32:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:32:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:32:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:32:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:32:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:32:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:32:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43880120
Sat 18 Jan 2014 00:32:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:32:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43880120
Sat 18 Jan 2014 00:32:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:32:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:32:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:32:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:32:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:32:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:32:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:32:38 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:32:38 - job_xml_thread(): Done retrieving: data size 43880120
Sat 18 Jan 2014 00:32:39 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:32:39 - XML: Start document: iteration 2
Sat 18 Jan 2014 00:32:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:32:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:32:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:32:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:32:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:32:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:32:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:32:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:32:43 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:32:45 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:32:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 00:32:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:32:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 00:32:45 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:32:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5926 values 93805 bits 11725 bytes 
Sat 18 Jan 2014 00:32:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:32:49 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:32:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:32:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:32:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:32:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:32:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:32:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:32:52 - XML: Processed 655504 elements - found 649 jobs
Sat 18 Jan 2014 00:32:52 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:32:52 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:32:52 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:32:52 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:32:54 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 00:32:54 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 00:32:54 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:32:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:32:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:32:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:32:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43840512
Sat 18 Jan 2014 00:32:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:32:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43840512
Sat 18 Jan 2014 00:32:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:33:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:33:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:33:07 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:33:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:33:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:33:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:33:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:33:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:33:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:33:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:33:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:33:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:33:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:33:12 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:33:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:33:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:33:12 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:33:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 00:33:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:33:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:33:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:33:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:33:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:33:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:33:13 - job_xml_thread(): Done retrieving: data size 43875344
Sat 18 Jan 2014 00:33:13 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:33:13 - XML: Start document: iteration 3
Sat 18 Jan 2014 00:33:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875344
Sat 18 Jan 2014 00:33:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:33:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875344
Sat 18 Jan 2014 00:33:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:33:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:33:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:33:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:33:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:33:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:33:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:33:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:33:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:33:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:33:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:33:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:33:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:33:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:33:34 - XML: Processed 655502 elements - found 648 jobs
Sat 18 Jan 2014 00:33:34 - job 7348567 appears to have finished
Sat 18 Jan 2014 00:33:34 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 00:33:34 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 00:33:34 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 00:33:34 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:33:34 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:33:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:33:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:33:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:33:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:33:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:33:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:33:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:33:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:33:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:33:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43849863
Sat 18 Jan 2014 00:33:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:33:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43849863
Sat 18 Jan 2014 00:33:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:33:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:33:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:33:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:33:45 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:33:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:33:46 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:33:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 00:33:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 00:33:46 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:33:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8813 values 139212 bits 17401 bytes 
Sat 18 Jan 2014 00:33:49 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:33:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:33:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:33:49 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:33:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:33:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:33:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:33:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:33:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:33:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:33:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:33:52 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:33:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:33:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:33:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:33:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:33:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:33:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:33:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:33:54 - job_xml_thread(): Done retrieving: data size 43871608
Sat 18 Jan 2014 00:33:54 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:33:54 - XML: Start document: iteration 4
Sat 18 Jan 2014 00:33:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43871608
Sat 18 Jan 2014 00:33:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43871608
Sat 18 Jan 2014 00:33:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:33:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:34:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:34:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:34:07 - XML: Processed 655500 elements - found 647 jobs
Sat 18 Jan 2014 00:34:07 - job 7348220 appears to have finished
Sat 18 Jan 2014 00:34:07 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 00:34:07 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 00:34:07 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 00:34:07 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:34:07 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:34:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:34:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:34:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:34:13 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:34:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:34:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:34:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:34:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:34:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:34:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:34:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:34:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:34:16 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:34:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:34:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:34:17 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:34:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 00:34:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:34:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:34:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:34:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:34:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:34:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:34:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43887055
Sat 18 Jan 2014 00:34:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:34:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43887055
Sat 18 Jan 2014 00:34:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:34:22 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:34:23 - job_xml_thread(): Done retrieving: data size 43887055
Sat 18 Jan 2014 00:34:23 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:34:23 - XML: Start document: iteration 5
Sat 18 Jan 2014 00:34:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:34:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:34:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:34:31 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:34:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:34:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:34:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:34:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:34:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:34:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:34:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:34:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:34:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:34:39 - XML: Processed 655500 elements - found 647 jobs
Sat 18 Jan 2014 00:34:39 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:34:39 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:34:39 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:34:39 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:34:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:34:41 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:34:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:34:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:34:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:34:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:34:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:34:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:34:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:34:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43869978
Sat 18 Jan 2014 00:34:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:34:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43869978
Sat 18 Jan 2014 00:34:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:34:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:34:46 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:34:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:34:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 00:34:47 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:34:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9032 values 142562 bits 17820 bytes 
Sat 18 Jan 2014 00:34:47 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:34:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 00:34:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:34:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:34:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:34:52 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:34:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:34:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:34:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:34:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:34:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:34:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:34:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:34:54 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:34:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:34:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:34:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:34:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:34:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:34:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:34:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:34:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:34:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:34:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43888593
Sat 18 Jan 2014 00:34:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:34:58 - job_xml_thread(): Done retrieving: data size 43888593
Sat 18 Jan 2014 00:34:58 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:34:58 - XML: Start document: iteration 6
Sat 18 Jan 2014 00:34:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43888593
Sat 18 Jan 2014 00:34:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:35:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:35:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:35:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:35:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:35:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:35:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:35:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:35:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:35:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:35:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:35:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:35:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:35:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:35:18 - XML: Processed 655500 elements - found 647 jobs
Sat 18 Jan 2014 00:35:18 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:35:18 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:35:18 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:35:18 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:35:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:35:19 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:35:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:35:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:35:19 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:35:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 00:35:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:35:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:35:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:35:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:35:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:35:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:35:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43791811
Sat 18 Jan 2014 00:35:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:35:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43791811
Sat 18 Jan 2014 00:35:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:35:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:35:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:35:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:35:30 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:35:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:35:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:35:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:35:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:35:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:35:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:35:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:35:33 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:35:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:35:34 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:35:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:35:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:35:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:35:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:35:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:35:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:35:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:35:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43306926
Sat 18 Jan 2014 00:35:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:35:36 - job_xml_thread(): Done retrieving: data size 43306926
Sat 18 Jan 2014 00:35:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43306926
Sat 18 Jan 2014 00:35:37 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:35:37 - XML: Start document: iteration 7
Sat 18 Jan 2014 00:35:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:35:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:35:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:35:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:35:47 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:35:48 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:35:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 00:35:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:35:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 00:35:49 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:35:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8913 values 140657 bits 17582 bytes 
Sat 18 Jan 2014 00:35:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:35:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:35:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:35:51 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:35:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:35:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:35:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:35:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:35:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:35:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:35:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:35:55 - XML: Processed 648624 elements - found 647 jobs
Sat 18 Jan 2014 00:35:55 - job 7335221 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7335220 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7335223 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7335222 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7335225 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7335224 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7335227 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7335226 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7335229 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7335228 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7339776 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7341721 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7340484 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7344401 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7344400 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7344403 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7344402 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7344405 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7344404 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7344407 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7344406 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7344409 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7344408 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7341823 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7338797 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7338790 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7344356 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7335699 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7348596 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7348593 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7348592 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7335439 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7335239 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7335232 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7335230 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7335231 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7346097 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7344382 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7339993 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7337217 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7344418 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7340781 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7344416 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7344414 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7344415 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7344412 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7344413 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7344410 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7344411 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7338953 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7344354 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7338775 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7337863 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7335401 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7335400 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7335403 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7335402 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7335405 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7335404 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7335406 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7335249 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7335248 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7335246 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7348255 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7337345 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7337341 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7336194 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7344419 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7339232 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7344417 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7336999 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7344427 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7337261 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7344645 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7344351 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7341893 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7344399 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7344398 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7344016 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7344391 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7344390 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7344393 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7344392 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7344395 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7344394 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7344397 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7344396 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7335485 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7338343 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7342415 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7335259 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7335250 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7335254 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7335255 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7337272 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7340972 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7344657 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7337400 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7344571 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7343952 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7344379 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7344378 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7344373 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7344372 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7344371 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7341100 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7344377 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7344376 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7344375 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7344374 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7344386 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7344387 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7344384 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7344385 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7338572 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7344383 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7344380 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7344381 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7344388 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7344389 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:55 - job 7335544 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7335395 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7335397 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7337899 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7342698 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7335260 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7339484 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7346830 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7344370 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7336565 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7337641 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7337640 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7337643 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7337645 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7337646 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7345031 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7344434 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7344435 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7344430 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7344431 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7344433 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7344368 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7344369 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7344360 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7344361 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7344362 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7344363 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7344364 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7344365 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7344366 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7344367 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7344440 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7335389 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7348683 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7335273 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7335271 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7335276 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7335376 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7335375 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7335207 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7335209 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7335208 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7345099 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7343632 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7343634 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7344425 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7338208 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7344422 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7344421 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7344420 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7344355 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7344426 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7344357 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7344424 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7344423 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7344350 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7344353 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7344352 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7335866 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7344359 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7344358 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7344429 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7344428 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7338514 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7348690 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7348693 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7348599 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7348598 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7348597 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7335361 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7348595 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7348594 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7335365 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7348591 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7348590 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7348606 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7348601 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7347695 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7335214 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7335215 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7335216 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7335217 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7335210 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7335211 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7335212 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7335213 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7335218 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7335219 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7339966 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7345647 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7344436 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7344437 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7344346 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7344347 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7344432 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7344348 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7344349 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7344438 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7344439 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7343751 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7343472 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7348589 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7338784 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7342714 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7335424 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7335423 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7335422 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7335421 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7348588 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7338025 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job 7348587 report time 1390001698 does not match current heartbeat 1390001674 : ignoring job
Sat 18 Jan 2014 00:35:56 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:35:56 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:35:56 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:35:56 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:35:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:35:59 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:35:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:35:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:36:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:36:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:36:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:36:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:36:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:36:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43216338
Sat 18 Jan 2014 00:36:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:36:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43216338
Sat 18 Jan 2014 00:36:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:36:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:36:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:36:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:36:10 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:36:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:36:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:36:11 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:36:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:36:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:36:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:36:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:36:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:36:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:36:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:36:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:36:16 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:36:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:36:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:36:16 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:36:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 00:36:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:36:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:36:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:36:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:36:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:36:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:36:18 - job_xml_thread(): Done retrieving: data size 43246418
Sat 18 Jan 2014 00:36:18 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:36:18 - XML: Start document: iteration 8
Sat 18 Jan 2014 00:36:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43246418
Sat 18 Jan 2014 00:36:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:36:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43246418
Sat 18 Jan 2014 00:36:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:36:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:36:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:36:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:36:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:36:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:36:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:36:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:36:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:36:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:36:40 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:36:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:36:41 - XML: Processed 647574 elements - found 647 jobs
Sat 18 Jan 2014 00:36:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:36:41 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:36:41 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:36:41 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:36:41 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:36:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:36:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:36:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:36:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:36:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:36:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:36:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:36:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:36:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:36:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:36:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43791583
Sat 18 Jan 2014 00:36:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:36:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43791583
Sat 18 Jan 2014 00:36:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:36:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:36:49 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:36:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:36:50 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:36:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 00:36:50 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:36:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 00:36:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8914 values 140655 bits 17581 bytes 
Sat 18 Jan 2014 00:36:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:36:52 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:36:56 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:36:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:36:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:36:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:36:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:36:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:36:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:36:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:36:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:36:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:36:57 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:36:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:36:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:36:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:36:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:36:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:36:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:36:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:36:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:36:59 - job_xml_thread(): Done retrieving: data size 43870150
Sat 18 Jan 2014 00:36:59 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:36:59 - XML: Start document: iteration 9
Sat 18 Jan 2014 00:37:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870150
Sat 18 Jan 2014 00:37:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:37:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870150
Sat 18 Jan 2014 00:37:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:37:03 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 00:37:03 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:37:04 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:37:04 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:37:04 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 00:37:04 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 00:37:04 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 00:37:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:37:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:37:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:37:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sat 18 Jan 2014 00:37:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:37:19 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:37:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:37:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:37:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:37:22 - XML: Processed 655316 elements - found 647 jobs
Sat 18 Jan 2014 00:37:22 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:37:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:37:22 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:37:22 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:37:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:37:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:37:22 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:37:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:37:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:37:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:37:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:37:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:37:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:37:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:37:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:37:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:37:24 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:37:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 00:37:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:37:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:37:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43881504
Sat 18 Jan 2014 00:37:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:37:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43881504
Sat 18 Jan 2014 00:37:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:37:37 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:37:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:37:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:37:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:37:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:37:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:37:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:37:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:37:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:37:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:37:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:37:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:37:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:37:40 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:37:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:37:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:37:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:37:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:37:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:37:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:37:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:37:42 - job_xml_thread(): Done retrieving: data size 43873468
Sat 18 Jan 2014 00:37:42 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:37:42 - XML: Start document: iteration 10
Sat 18 Jan 2014 00:37:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873468
Sat 18 Jan 2014 00:37:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:37:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873468
Sat 18 Jan 2014 00:37:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:37:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:37:50 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:37:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:37:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 00:37:52 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:37:52 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:37:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 00:37:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8836 values 139442 bits 17430 bytes 
Sat 18 Jan 2014 00:37:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:37:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:37:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:37:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:38:03 - XML: Processed 655500 elements - found 647 jobs
Sat 18 Jan 2014 00:38:03 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:38:03 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:38:03 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:38:03 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:38:04 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:38:04 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:38:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:38:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:38:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:38:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:38:05 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:38:05 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 00:38:05 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:38:05 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 00:38:05 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 00:38:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:38:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:38:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:38:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:38:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:38:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:38:07 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:38:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:38:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:38:08 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 979799 values 15472610 bits 1934076 bytes 
Sat 18 Jan 2014 00:38:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:38:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:38:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:38:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:38:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:38:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43879011
Sat 18 Jan 2014 00:38:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:38:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43879011
Sat 18 Jan 2014 00:38:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:38:19 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:38:19 - job_xml_thread(): Done retrieving: data size 43879011
Sat 18 Jan 2014 00:38:19 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:38:19 - XML: Start document: iteration 11
Sat 18 Jan 2014 00:38:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:38:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:38:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:38:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:38:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:38:30 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:38:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:38:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:38:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:38:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:38:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:38:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:38:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:38:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:38:31 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:38:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:38:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:38:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:38:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:38:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:38:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:38:35 - XML: Processed 655500 elements - found 647 jobs
Sat 18 Jan 2014 00:38:35 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:38:35 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:38:35 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:38:35 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:38:36 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:38:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 00:38:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:38:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:38:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870178
Sat 18 Jan 2014 00:38:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:38:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870178
Sat 18 Jan 2014 00:38:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:38:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:38:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:38:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:38:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:38:50 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:38:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:38:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:38:52 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:38:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:38:53 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:38:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 00:38:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 00:38:53 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:38:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5458 values 86047 bits 10755 bytes 
Sat 18 Jan 2014 00:38:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:38:53 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:38:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:38:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:38:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:38:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:38:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:38:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:38:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:38:56 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:38:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:38:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:38:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:38:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:38:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:38:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:39:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:39:00 - job_xml_thread(): Done retrieving: data size 43864307
Sat 18 Jan 2014 00:39:00 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:39:00 - XML: Start document: iteration 12
Sat 18 Jan 2014 00:39:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43864307
Sat 18 Jan 2014 00:39:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43864307
Sat 18 Jan 2014 00:39:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:39:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:39:05 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:39:05 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 00:39:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:39:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:39:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:39:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:39:19 - XML: Processed 655500 elements - found 647 jobs
Sat 18 Jan 2014 00:39:19 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:39:19 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:39:19 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:39:19 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:39:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:39:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:39:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:39:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:39:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:39:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:39:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:39:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:39:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:39:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:39:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:39:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:39:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:39:24 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:39:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 00:39:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:39:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:39:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:39:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:39:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:39:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:39:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865257
Sat 18 Jan 2014 00:39:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:39:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43865257
Sat 18 Jan 2014 00:39:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:39:34 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:39:34 - job_xml_thread(): Done retrieving: data size 43865257
Sat 18 Jan 2014 00:39:34 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:39:34 - XML: Start document: iteration 13
Sat 18 Jan 2014 00:39:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:39:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:39:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:39:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:39:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:39:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:39:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:39:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:39:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:39:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:39:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:39:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:39:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:39:48 - XML: Processed 655500 elements - found 647 jobs
Sat 18 Jan 2014 00:39:48 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:39:48 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:39:48 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:39:48 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:39:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:39:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:39:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:39:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:39:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:39:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:39:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:39:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:39:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:39:53 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:39:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:39:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43841721
Sat 18 Jan 2014 00:39:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:39:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43841721
Sat 18 Jan 2014 00:39:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:39:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:39:54 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:39:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 00:39:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 00:39:54 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:39:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5682 values 89540 bits 11192 bytes 
Sat 18 Jan 2014 00:39:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:39:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:40:04 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:40:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:40:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:40:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:40:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:40:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:40:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:40:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:40:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:40:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:40:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:40:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:40:08 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 00:40:08 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 00:40:08 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:40:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:40:10 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:40:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:40:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:40:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:40:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:40:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:40:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:40:13 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:40:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 00:40:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:40:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:40:13 - job_xml_thread(): Done retrieving: data size 43857012
Sat 18 Jan 2014 00:40:13 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:40:13 - XML: Start document: iteration 14
Sat 18 Jan 2014 00:40:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43857012
Sat 18 Jan 2014 00:40:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43857012
Sat 18 Jan 2014 00:40:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:40:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:40:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:40:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:40:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:40:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:40:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:40:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:40:34 - XML: Processed 655500 elements - found 647 jobs
Sat 18 Jan 2014 00:40:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:40:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:40:34 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:40:34 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:40:34 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:40:34 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:40:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:40:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:40:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:40:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:40:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:40:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:40:35 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:40:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:40:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:40:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:40:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:40:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:40:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:40:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:40:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43880196
Sat 18 Jan 2014 00:40:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:40:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43880196
Sat 18 Jan 2014 00:40:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:40:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:40:47 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:40:49 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:40:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:40:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:40:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:40:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:40:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:40:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:40:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:40:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:40:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:40:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:40:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:40:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:40:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:40:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:40:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:40:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:40:53 - job_xml_thread(): Done retrieving: data size 43870332
Sat 18 Jan 2014 00:40:53 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:40:53 - XML: Start document: iteration 15
Sat 18 Jan 2014 00:40:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870332
Sat 18 Jan 2014 00:40:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:40:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870332
Sat 18 Jan 2014 00:40:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:40:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:40:54 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:40:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:40:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 00:40:57 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:40:57 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:40:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 00:40:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9289 values 146598 bits 18324 bytes 
Sat 18 Jan 2014 00:41:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:41:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:41:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:41:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:41:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:41:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:41:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:41:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:41:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:41:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:41:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:41:12 - XML: Processed 655500 elements - found 647 jobs
Sat 18 Jan 2014 00:41:12 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:41:12 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:41:12 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:41:12 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:41:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:41:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:41:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:41:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:41:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:41:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:41:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:41:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:41:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:41:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43796545
Sat 18 Jan 2014 00:41:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:41:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43796545
Sat 18 Jan 2014 00:41:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:41:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:41:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:41:27 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:41:27 - job_xml_thread(): Done retrieving: data size 43796545
Sat 18 Jan 2014 00:41:27 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:41:27 - XML: Start document: iteration 16
Sat 18 Jan 2014 00:41:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:41:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:41:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:41:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:41:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:41:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:41:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:41:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:41:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:41:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:41:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:41:37 - XML: Processed 654752 elements - found 647 jobs
Sat 18 Jan 2014 00:41:37 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:41:37 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:41:37 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:41:37 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:41:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:41:41 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:41:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:41:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:41:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:41:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:41:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:41:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:41:41 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:41:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 00:41:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:41:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:41:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43300780
Sat 18 Jan 2014 00:41:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:41:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43300780
Sat 18 Jan 2014 00:41:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:41:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:41:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:41:52 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:41:52 - job_xml_thread(): Done retrieving: data size 43300780
Sat 18 Jan 2014 00:41:52 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:41:52 - XML: Start document: iteration 17
Sat 18 Jan 2014 00:41:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:41:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:41:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:41:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:41:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:41:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:41:58 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:41:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:42:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:42:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:42:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:42:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:42:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 00:42:00 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:42:00 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:42:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:42:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 00:42:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:42:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5583 values 87995 bits 10999 bytes 
Sat 18 Jan 2014 00:42:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:42:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:42:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:42:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:42:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:42:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:42:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:42:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:42:06 - XML: Processed 648768 elements - found 647 jobs
Sat 18 Jan 2014 00:42:06 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:42:06 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:42:06 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:42:06 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:42:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:42:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43249861
Sat 18 Jan 2014 00:42:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:42:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43249861
Sat 18 Jan 2014 00:42:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:42:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:42:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:42:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:42:18 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:42:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:42:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:42:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:42:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:42:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:42:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:42:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:42:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:42:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:42:21 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:42:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:42:22 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:42:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:42:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:42:22 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:42:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 00:42:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:42:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:42:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:42:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:42:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:42:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:42:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43270710
Sat 18 Jan 2014 00:42:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:42:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43270710
Sat 18 Jan 2014 00:42:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:42:24 - job_xml_thread(): Done retrieving: data size 43270710
Sat 18 Jan 2014 00:42:24 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:42:24 - XML: Start document: iteration 18
Sat 18 Jan 2014 00:42:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:42:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:42:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:42:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:42:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:42:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:42:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:42:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:42:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:42:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:42:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:42:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:42:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:42:45 - XML: Processed 648048 elements - found 647 jobs
Sat 18 Jan 2014 00:42:45 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:42:45 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:42:45 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:42:45 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:42:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:42:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:42:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:42:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:42:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:42:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:42:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:42:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:42:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:42:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43791396
Sat 18 Jan 2014 00:42:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:42:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43791396
Sat 18 Jan 2014 00:42:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:42:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:42:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:42:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:42:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:42:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:42:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:43:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:43:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:43:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:43:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:43:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:43:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:43:00 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:43:00 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:43:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:43:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 00:43:01 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:43:01 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:43:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 00:43:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8878 values 140040 bits 17505 bytes 
Sat 18 Jan 2014 00:43:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:43:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:43:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:43:04 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:43:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:43:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:43:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:43:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:43:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:43:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:43:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:43:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43876853
Sat 18 Jan 2014 00:43:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:43:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43876853
Sat 18 Jan 2014 00:43:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:43:07 - job_xml_thread(): Done retrieving: data size 43876853
Sat 18 Jan 2014 00:43:07 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:43:08 - XML: Start document: iteration 19
Sat 18 Jan 2014 00:43:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:43:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:43:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:43:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:43:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:43:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:43:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:43:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:43:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:43:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:43:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:43:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:43:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:43:27 - XML: Processed 655454 elements - found 647 jobs
Sat 18 Jan 2014 00:43:27 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:43:27 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:43:27 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:43:27 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:43:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:43:30 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:43:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:43:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:43:30 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:43:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 00:43:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:43:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:43:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:43:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:43:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:43:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:43:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43863660
Sat 18 Jan 2014 00:43:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:43:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43863660
Sat 18 Jan 2014 00:43:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:43:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:43:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:43:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:43:42 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:43:43 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:43:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:43:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:43:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:43:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:43:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:43:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:43:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:43:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:43:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:43:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:43:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:43:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:43:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:43:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:43:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:43:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:43:48 - job_xml_thread(): Done retrieving: data size 43876174
Sat 18 Jan 2014 00:43:48 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:43:48 - XML: Start document: iteration 20
Sat 18 Jan 2014 00:43:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43876174
Sat 18 Jan 2014 00:43:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:43:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43876174
Sat 18 Jan 2014 00:43:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:43:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:43:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:44:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:44:00 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:44:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:44:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:44:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:44:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:44:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:44:01 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:44:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:44:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:44:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 00:44:02 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:44:02 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:44:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:44:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 00:44:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:44:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:44:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8379 values 132134 bits 16516 bytes 
Sat 18 Jan 2014 00:44:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:44:04 - XML: Processed 655504 elements - found 649 jobs
Sat 18 Jan 2014 00:44:04 - job 7348558 appears to have finished
Sat 18 Jan 2014 00:44:05 - job_xml_thread(): Found 4 updated jobs.
Sat 18 Jan 2014 00:44:05 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 00:44:05 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Sat 18 Jan 2014 00:44:05 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:44:05 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:44:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:44:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:44:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:44:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:44:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:44:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:44:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:44:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:44:11 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:44:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 00:44:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:44:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:44:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851027
Sat 18 Jan 2014 00:44:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:44:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851027
Sat 18 Jan 2014 00:44:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:44:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:44:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:44:21 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:44:21 - job_xml_thread(): Done retrieving: data size 43851027
Sat 18 Jan 2014 00:44:21 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:44:21 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 00:44:22 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 00:44:22 - Housekeeping: done.
Sat 18 Jan 2014 00:44:22 - XML: Start document: iteration 0
Sat 18 Jan 2014 00:44:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:44:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:44:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:44:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:44:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:44:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:44:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:44:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:44:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:44:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:44:25 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:44:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:44:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:44:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:44:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:44:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:44:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:44:29 - XML: Processed 655504 elements - found 649 jobs
Sat 18 Jan 2014 00:44:29 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:44:29 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:44:29 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:44:29 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:44:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:44:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873894
Sat 18 Jan 2014 00:44:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:44:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873894
Sat 18 Jan 2014 00:44:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:44:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:44:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:44:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:44:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:44:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:44:43 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:44:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:44:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:44:44 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:44:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:44:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:44:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:44:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:44:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:44:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:44:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:44:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:44:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:44:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:44:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:44:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:44:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:44:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:44:47 - job_xml_thread(): Done retrieving: data size 43892267
Sat 18 Jan 2014 00:44:47 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:44:47 - XML: Start document: iteration 1
Sat 18 Jan 2014 00:44:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43892267
Sat 18 Jan 2014 00:44:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:44:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43892267
Sat 18 Jan 2014 00:44:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:45:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:45:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:45:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:45:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:45:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:45:02 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:45:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:45:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 00:45:03 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:45:03 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:45:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 00:45:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9279 values 146392 bits 18299 bytes 
Sat 18 Jan 2014 00:45:04 - XML: Processed 655504 elements - found 649 jobs
Sat 18 Jan 2014 00:45:04 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:45:05 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:45:05 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:45:05 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:45:06 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 00:45:06 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:45:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:45:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:45:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:45:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:45:07 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:45:07 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 00:45:07 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:45:07 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 00:45:07 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 00:45:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:45:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:45:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:45:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:45:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:45:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:45:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:45:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:45:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:45:09 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 869322 values 13717590 bits 1714698 bytes 
Sat 18 Jan 2014 00:45:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:45:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:45:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:45:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:45:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:45:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865040
Sat 18 Jan 2014 00:45:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:45:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43865040
Sat 18 Jan 2014 00:45:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:45:20 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:45:20 - job_xml_thread(): Done retrieving: data size 43865040
Sat 18 Jan 2014 00:45:20 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:45:20 - XML: Start document: iteration 2
Sat 18 Jan 2014 00:45:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:45:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:45:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:45:24 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:45:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:45:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:45:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:45:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:45:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:45:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:45:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:45:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:45:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:45:32 - XML: Processed 655501 elements - found 648 jobs
Sat 18 Jan 2014 00:45:32 - job 7348683 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 00:45:32 - job 7348560 appears to have finished
Sat 18 Jan 2014 00:45:32 - job 7348693 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 00:45:32 - job_xml_thread(): Found 3 updated jobs.
Sat 18 Jan 2014 00:45:32 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 00:45:33 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Sat 18 Jan 2014 00:45:33 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:45:33 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:45:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:45:35 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:45:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:45:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:45:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:45:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:45:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:45:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:45:35 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:45:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 00:45:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:45:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:45:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43857287
Sat 18 Jan 2014 00:45:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:45:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43857287
Sat 18 Jan 2014 00:45:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:45:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:45:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:45:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:45:47 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:45:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:45:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:45:48 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:45:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:45:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:45:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:45:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:45:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:45:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:45:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:45:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:45:52 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:45:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:45:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:45:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:45:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:45:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:45:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:45:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:45:55 - job_xml_thread(): Done retrieving: data size 43861918
Sat 18 Jan 2014 00:45:55 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:45:55 - XML: Start document: iteration 3
Sat 18 Jan 2014 00:45:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43861918
Sat 18 Jan 2014 00:45:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:45:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43861918
Sat 18 Jan 2014 00:45:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:46:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:46:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:46:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:46:04 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:46:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:46:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 00:46:05 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:46:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 00:46:05 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:46:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8888 values 140206 bits 17525 bytes 
Sat 18 Jan 2014 00:46:07 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:46:07 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 00:46:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:46:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:46:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:46:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:46:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:46:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:46:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:46:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:46:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:46:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:46:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:46:11 - XML: Processed 655500 elements - found 647 jobs
Sat 18 Jan 2014 00:46:11 - job 7348559 appears to have finished
Sat 18 Jan 2014 00:46:11 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 00:46:11 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 00:46:11 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 00:46:11 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:46:11 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:46:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:46:14 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:46:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:46:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:46:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:46:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:46:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:46:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:46:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:46:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875616
Sat 18 Jan 2014 00:46:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:46:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875616
Sat 18 Jan 2014 00:46:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:46:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:46:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:46:26 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:46:26 - job_xml_thread(): Done retrieving: data size 43875616
Sat 18 Jan 2014 00:46:26 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:46:26 - XML: Start document: iteration 4
Sat 18 Jan 2014 00:46:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:46:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:46:33 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:46:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 00:46:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:46:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:46:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:46:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:46:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:46:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:46:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:46:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:46:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:46:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:46:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:46:38 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:46:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:46:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:46:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:46:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:46:39 - XML: Processed 655500 elements - found 647 jobs
Sat 18 Jan 2014 00:46:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:46:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:46:39 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:46:39 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:46:39 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:46:39 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:46:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:46:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43863532
Sat 18 Jan 2014 00:46:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:46:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43863532
Sat 18 Jan 2014 00:46:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:46:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:46:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:46:54 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:46:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:46:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:46:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:46:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:46:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:46:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:46:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:46:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:46:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:46:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:46:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:47:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:47:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:47:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:47:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:47:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:47:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:47:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:47:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:47:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:47:03 - job_xml_thread(): Done retrieving: data size 43875408
Sat 18 Jan 2014 00:47:03 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:47:03 - XML: Start document: iteration 5
Sat 18 Jan 2014 00:47:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875408
Sat 18 Jan 2014 00:47:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:47:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875408
Sat 18 Jan 2014 00:47:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:47:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:47:05 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:47:06 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:47:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 00:47:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:47:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 00:47:06 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:47:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7052 values 111520 bits 13940 bytes 
Sat 18 Jan 2014 00:47:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:47:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:47:11 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 00:47:11 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 00:47:11 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:47:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:47:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:47:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:47:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:47:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:47:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:47:23 - XML: Processed 655500 elements - found 647 jobs
Sat 18 Jan 2014 00:47:23 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:47:23 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:47:23 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:47:23 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:47:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:47:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:47:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:47:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:47:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:47:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:47:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:47:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:47:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:47:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:47:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:47:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:47:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:47:27 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:47:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 00:47:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:47:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:47:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43721314
Sat 18 Jan 2014 00:47:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:47:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43721314
Sat 18 Jan 2014 00:47:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:47:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:47:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:47:38 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:47:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:47:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:47:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:47:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:47:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:47:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:47:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:47:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:47:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:47:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:47:41 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:47:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:47:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:47:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:47:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:47:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:47:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:47:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:47:43 - job_xml_thread(): Done retrieving: data size 43256891
Sat 18 Jan 2014 00:47:43 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:47:43 - XML: Start document: iteration 6
Sat 18 Jan 2014 00:47:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43256891
Sat 18 Jan 2014 00:47:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:47:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43256891
Sat 18 Jan 2014 00:47:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:47:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:47:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:47:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:47:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:47:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:47:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:47:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:47:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:47:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:47:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:47:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:47:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:47:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:48:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:48:05 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:48:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:48:06 - XML: Processed 647880 elements - found 646 jobs
Sat 18 Jan 2014 00:48:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:48:06 - job 7348460 appears to have finished
Sat 18 Jan 2014 00:48:06 - job 7348683 field 'start_timestamp' changed since saved from: 1390002319 to: 1390002266
Sat 18 Jan 2014 00:48:06 - job 7348693 field 'start_timestamp' changed since saved from: 1390002340 to: 1390002266
Sat 18 Jan 2014 00:48:06 - job_xml_thread(): Found 3 updated jobs.
Sat 18 Jan 2014 00:48:06 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 00:48:06 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Sat 18 Jan 2014 00:48:06 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:48:06 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:48:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:48:06 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:48:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:48:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 00:48:07 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:48:07 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:48:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 00:48:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99387 bits 12423 bytes 
Sat 18 Jan 2014 00:48:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:48:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:48:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:48:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:48:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:48:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43231086
Sat 18 Jan 2014 00:48:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:48:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43231086
Sat 18 Jan 2014 00:48:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:48:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:48:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:48:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:48:19 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:48:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:48:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:48:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:48:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:48:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:48:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:48:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:48:21 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:48:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:48:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:48:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:48:23 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:48:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:48:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:48:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:48:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:48:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:48:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:48:25 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:48:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 00:48:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:48:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:48:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43266782
Sat 18 Jan 2014 00:48:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:48:26 - job_xml_thread(): Done retrieving: data size 43266782
Sat 18 Jan 2014 00:48:26 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:48:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43266782
Sat 18 Jan 2014 00:48:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:48:27 - XML: Start document: iteration 7
Sat 18 Jan 2014 00:48:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:48:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:48:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:48:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:48:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:48:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:48:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:48:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:48:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:48:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:48:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:48:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:48:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:48:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:48:46 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:48:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:48:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:48:48 - XML: Processed 648046 elements - found 646 jobs
Sat 18 Jan 2014 00:48:48 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:48:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:48:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:48:48 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:48:48 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:48:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:48:48 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:48:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:48:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:48:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43778838
Sat 18 Jan 2014 00:48:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:48:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43778838
Sat 18 Jan 2014 00:48:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:48:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:48:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:49:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:49:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:49:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:49:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:49:03 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:49:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:49:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:49:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:49:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:49:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:49:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:49:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:49:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:49:05 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:49:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:49:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:49:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:49:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:49:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:49:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:49:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:49:06 - job_xml_thread(): Done retrieving: data size 43885138
Sat 18 Jan 2014 00:49:06 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:49:07 - XML: Start document: iteration 8
Sat 18 Jan 2014 00:49:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:49:07 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:49:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43885138
Sat 18 Jan 2014 00:49:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:49:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43885138
Sat 18 Jan 2014 00:49:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:49:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:49:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 00:49:09 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:49:09 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:49:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 00:49:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7432 values 117383 bits 14672 bytes 
Sat 18 Jan 2014 00:49:16 - XML: Processed 655400 elements - found 646 jobs
Sat 18 Jan 2014 00:49:16 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:49:16 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:49:16 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:49:17 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:49:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:49:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:49:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:49:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:49:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:49:25 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:49:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:49:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:49:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:49:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:49:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:49:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:49:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:49:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:49:30 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:49:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:49:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:49:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:49:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:49:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:49:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:49:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:49:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865953
Sat 18 Jan 2014 00:49:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:49:32 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:49:32 - job_xml_thread(): Done retrieving: data size 43865953
Sat 18 Jan 2014 00:49:32 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:49:33 - XML: Start document: iteration 9
Sat 18 Jan 2014 00:49:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43865953
Sat 18 Jan 2014 00:49:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:49:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:49:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:49:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:49:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:49:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:49:47 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:49:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:49:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:49:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:49:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:49:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:49:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:49:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:49:54 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:49:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 00:49:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:49:55 - XML: Processed 655496 elements - found 645 jobs
Sat 18 Jan 2014 00:49:55 - job 7345935 appears to have finished
Sat 18 Jan 2014 00:49:55 - job 7348587 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 00:49:55 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 00:49:55 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 00:49:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:49:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:49:55 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 00:49:55 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:49:55 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:49:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:49:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:49:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:49:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:49:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:49:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:49:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:49:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855045
Sat 18 Jan 2014 00:49:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:49:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855045
Sat 18 Jan 2014 00:49:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:50:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:50:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:50:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:50:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:50:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:50:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:50:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:50:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:50:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:50:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:50:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855045
Sat 18 Jan 2014 00:50:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:50:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:50:10 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:50:10 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:50:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:50:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:50:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:50:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:50:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 00:50:12 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:50:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6092 values 96173 bits 12021 bytes 
Sat 18 Jan 2014 00:50:12 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:50:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 00:50:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:50:14 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:50:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:50:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:50:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:50:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:50:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:50:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:50:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:50:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:50:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:50:18 - job_xml_thread(): Done retrieving: data size 43868225
Sat 18 Jan 2014 00:50:18 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:50:18 - XML: Start document: iteration 10
Sat 18 Jan 2014 00:50:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43868225
Sat 18 Jan 2014 00:50:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:50:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:50:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:50:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:50:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:50:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:50:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:50:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43868225
Sat 18 Jan 2014 00:50:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:50:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:50:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:50:35 - XML: Processed 655496 elements - found 645 jobs
Sat 18 Jan 2014 00:50:35 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:50:35 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:50:35 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:50:35 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:50:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:50:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:50:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:50:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:50:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:50:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:50:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:50:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:50:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:50:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:50:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:50:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:50:41 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:50:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:50:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:50:42 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:50:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 00:50:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:50:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:50:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:50:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:50:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:50:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:50:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43871362
Sat 18 Jan 2014 00:50:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:50:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43871362
Sat 18 Jan 2014 00:50:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:50:50 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:50:50 - job_xml_thread(): Done retrieving: data size 43871362
Sat 18 Jan 2014 00:50:50 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:50:50 - XML: Start document: iteration 11
Sat 18 Jan 2014 00:50:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:50:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:50:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:50:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:51:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:51:00 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:51:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:51:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:51:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:51:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:51:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:51:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:51:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:51:05 - XML: Processed 655496 elements - found 645 jobs
Sat 18 Jan 2014 00:51:06 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:51:06 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:51:06 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:51:06 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:51:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:51:07 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:51:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:51:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:51:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:51:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:51:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:51:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:51:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:51:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43887958
Sat 18 Jan 2014 00:51:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:51:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43887958
Sat 18 Jan 2014 00:51:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:51:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:51:12 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:51:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:51:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 00:51:13 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:51:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 00:51:13 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:51:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8979 values 141606 bits 17700 bytes 
Sat 18 Jan 2014 00:51:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:51:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:51:21 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:51:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:51:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:51:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:51:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:51:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:51:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:51:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:51:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:51:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:51:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:51:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:51:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:51:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:51:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:51:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:51:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:51:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:51:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:51:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:51:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:51:26 - job_xml_thread(): Done retrieving: data size 43865316
Sat 18 Jan 2014 00:51:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43865316
Sat 18 Jan 2014 00:51:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:51:26 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:51:26 - XML: Start document: iteration 12
Sat 18 Jan 2014 00:51:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865316
Sat 18 Jan 2014 00:51:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:51:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:51:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:51:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:51:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:51:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:51:45 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:51:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:51:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:51:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:51:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:51:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:51:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:51:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:51:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:51:49 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:51:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:51:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:51:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:51:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:51:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:51:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:51:51 - XML: Processed 655496 elements - found 645 jobs
Sat 18 Jan 2014 00:51:51 - job 7348334 appears to have finished
Sat 18 Jan 2014 00:51:51 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 00:51:51 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 00:51:51 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 00:51:51 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:51:51 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:51:51 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:51:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 00:51:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:51:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:51:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43885420
Sat 18 Jan 2014 00:51:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:51:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43885420
Sat 18 Jan 2014 00:51:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:52:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:52:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:52:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:52:03 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:52:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:52:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:52:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:52:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:52:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:52:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:52:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:52:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:52:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:52:06 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:52:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:52:07 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:52:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:52:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:52:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:52:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:52:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:52:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:52:08 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 00:52:08 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:52:08 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:52:08 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 00:52:08 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:52:08 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 00:52:08 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 00:52:09 - size of cluster 'LISA Cluster': 624 hosts 79474 metrics 933089 values 14743487 bits 1842935 bytes 
Sat 18 Jan 2014 00:52:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:52:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43889508
Sat 18 Jan 2014 00:52:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:52:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43889508
Sat 18 Jan 2014 00:52:11 - job_xml_thread(): Done retrieving: data size 43889508
Sat 18 Jan 2014 00:52:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:52:11 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:52:12 - XML: Start document: iteration 13
Sat 18 Jan 2014 00:52:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:52:14 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:52:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:52:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 00:52:15 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:52:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 00:52:15 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:52:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8747 values 137904 bits 17238 bytes 
Sat 18 Jan 2014 00:52:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:52:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:52:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:52:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:52:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:52:24 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:52:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:52:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:52:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:52:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:52:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:52:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:52:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:52:29 - XML: Processed 655492 elements - found 643 jobs
Sat 18 Jan 2014 00:52:29 - job 7348711 field 'start_timestamp' changed since saved from: 1390002646 to: 1390002580
Sat 18 Jan 2014 00:52:29 - job 7343921 appears to have finished
Sat 18 Jan 2014 00:52:29 - job 7348568 appears to have finished
Sat 18 Jan 2014 00:52:29 - job_xml_thread(): Found 3 updated jobs.
Sat 18 Jan 2014 00:52:29 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 00:52:29 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Sat 18 Jan 2014 00:52:29 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:52:29 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:52:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:52:35 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:52:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:52:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:52:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:52:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:52:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:52:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:52:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:52:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865226
Sat 18 Jan 2014 00:52:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:52:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43865226
Sat 18 Jan 2014 00:52:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:52:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:52:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:52:45 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:52:45 - job_xml_thread(): Done retrieving: data size 43865226
Sat 18 Jan 2014 00:52:45 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:52:45 - XML: Start document: iteration 14
Sat 18 Jan 2014 00:52:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:52:48 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:52:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:52:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:52:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:52:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:52:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:52:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:52:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:52:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:52:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:52:57 - XML: Processed 655492 elements - found 643 jobs
Sat 18 Jan 2014 00:52:57 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:52:57 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:52:57 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:52:57 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:53:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:53:01 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:53:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:53:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:53:01 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:53:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 00:53:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:53:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:53:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:53:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:53:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:53:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:53:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:53:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:53:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43850059
Sat 18 Jan 2014 00:53:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:53:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43850059
Sat 18 Jan 2014 00:53:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:53:09 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:53:09 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 00:53:12 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:53:12 - job_xml_thread(): Done retrieving: data size 43850059
Sat 18 Jan 2014 00:53:13 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:53:13 - XML: Start document: iteration 15
Sat 18 Jan 2014 00:53:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:53:15 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:53:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:53:15 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:53:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 00:53:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 00:53:15 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:53:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5840 values 92092 bits 11511 bytes 
Sat 18 Jan 2014 00:53:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:53:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:53:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:53:19 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:53:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:53:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:53:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:53:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:53:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:53:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:53:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:53:27 - XML: Processed 655492 elements - found 643 jobs
Sat 18 Jan 2014 00:53:27 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:53:27 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:53:27 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:53:27 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:53:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:53:29 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:53:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:53:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:53:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:53:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:53:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:53:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:53:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:53:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43783671
Sat 18 Jan 2014 00:53:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:53:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43783671
Sat 18 Jan 2014 00:53:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:53:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:53:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:53:42 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:53:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:53:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:53:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:53:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:53:46 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:53:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:53:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:53:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:53:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:53:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:53:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:53:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:53:48 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:53:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:53:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:53:48 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:53:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 00:53:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:53:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:53:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:53:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:53:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:53:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:53:52 - job_xml_thread(): Done retrieving: data size 43263149
Sat 18 Jan 2014 00:53:52 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:53:52 - XML: Start document: iteration 16
Sat 18 Jan 2014 00:53:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43263149
Sat 18 Jan 2014 00:53:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:53:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43263149
Sat 18 Jan 2014 00:53:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:54:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:54:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:54:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:54:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:54:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:54:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:54:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:54:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:54:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:54:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:54:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:54:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:54:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:54:12 - XML: Processed 647954 elements - found 643 jobs
Sat 18 Jan 2014 00:54:12 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:54:12 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:54:12 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:54:12 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:54:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:54:15 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:54:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:54:16 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:54:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:54:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:54:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:54:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:54:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:54:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:54:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:54:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 00:54:16 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:54:16 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:54:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 00:54:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5893 values 92892 bits 11611 bytes 
Sat 18 Jan 2014 00:54:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:54:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43265705
Sat 18 Jan 2014 00:54:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:54:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43265705
Sat 18 Jan 2014 00:54:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:54:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:54:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:54:28 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:54:28 - job_xml_thread(): Done retrieving: data size 43265705
Sat 18 Jan 2014 00:54:28 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:54:28 - XML: Start document: iteration 17
Sat 18 Jan 2014 00:54:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:54:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:54:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:54:32 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:54:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:54:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:54:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:54:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:54:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:54:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:54:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:54:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:54:38 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:54:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:54:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:54:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:54:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:54:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:54:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:54:41 - XML: Processed 647966 elements - found 643 jobs
Sat 18 Jan 2014 00:54:41 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:54:41 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:54:41 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:54:41 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:54:43 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:54:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 00:54:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:54:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:54:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43777514
Sat 18 Jan 2014 00:54:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:54:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43777514
Sat 18 Jan 2014 00:54:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:54:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:54:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:54:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:54:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:54:56 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:54:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:54:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:54:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:54:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:54:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:54:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:54:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:54:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:54:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:55:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:55:01 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:55:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:55:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:55:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:55:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:55:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:55:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:55:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:55:04 - job_xml_thread(): Done retrieving: data size 43863034
Sat 18 Jan 2014 00:55:04 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:55:04 - XML: Start document: iteration 18
Sat 18 Jan 2014 00:55:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43863034
Sat 18 Jan 2014 00:55:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:55:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43863034
Sat 18 Jan 2014 00:55:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:55:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:55:15 - XML: Processed 655462 elements - found 643 jobs
Sat 18 Jan 2014 00:55:15 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:55:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:55:15 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:55:15 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:55:15 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:55:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:55:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:55:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:55:17 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:55:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:55:18 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:55:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 00:55:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 00:55:18 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:55:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8064 values 127215 bits 15901 bytes 
Sat 18 Jan 2014 00:55:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:55:24 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:55:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:55:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:55:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:55:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:55:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:55:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:55:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:55:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:55:28 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:55:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:55:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:55:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:55:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:55:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:55:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:55:30 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:55:31 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 00:55:31 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 00:55:31 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:55:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:55:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862327
Sat 18 Jan 2014 00:55:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:55:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862327
Sat 18 Jan 2014 00:55:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:55:32 - job_xml_thread(): Done retrieving: data size 43862327
Sat 18 Jan 2014 00:55:33 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:55:33 - XML: Start document: iteration 19
Sat 18 Jan 2014 00:55:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:55:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:55:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:55:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:55:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:55:51 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:55:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:55:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:55:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:55:52 - XML: Processed 655492 elements - found 643 jobs
Sat 18 Jan 2014 00:55:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:55:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:55:52 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:55:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:55:52 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:55:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:55:52 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:55:52 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:55:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:55:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:55:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:55:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:55:55 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:55:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 00:55:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:55:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:55:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:55:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:55:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:55:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:55:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43866279
Sat 18 Jan 2014 00:55:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:55:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43866279
Sat 18 Jan 2014 00:55:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:56:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:56:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:56:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:56:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:56:07 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:56:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:56:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:56:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:56:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:56:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:56:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:56:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:56:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:56:10 - job_xml_thread(): Done retrieving: data size 43881291
Sat 18 Jan 2014 00:56:10 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:56:10 - XML: Start document: iteration 20
Sat 18 Jan 2014 00:56:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43881291
Sat 18 Jan 2014 00:56:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:56:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:56:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:56:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:56:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:56:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43881291
Sat 18 Jan 2014 00:56:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:56:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:56:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:56:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:56:18 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:56:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:56:20 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:56:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 00:56:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 00:56:20 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:56:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8526 values 134331 bits 16791 bytes 
Sat 18 Jan 2014 00:56:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:56:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:56:26 - XML: Processed 655492 elements - found 643 jobs
Sat 18 Jan 2014 00:56:27 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:56:27 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:56:27 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:56:27 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:56:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:56:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:56:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:56:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:56:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:56:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:56:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:56:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:56:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:56:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:56:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:56:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:56:33 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:56:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:56:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:56:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:56:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:56:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:56:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:56:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:56:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43889074
Sat 18 Jan 2014 00:56:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:56:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43889074
Sat 18 Jan 2014 00:56:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:56:42 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:56:42 - job_xml_thread(): Done retrieving: data size 43889074
Sat 18 Jan 2014 00:56:42 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:56:42 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 00:56:43 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 00:56:43 - Housekeeping: done.
Sat 18 Jan 2014 00:56:43 - XML: Start document: iteration 0
Sat 18 Jan 2014 00:56:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:56:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:56:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:56:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:56:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:56:50 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:56:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:56:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:56:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:56:52 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:56:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:56:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:56:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:56:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:56:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:56:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:56:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:56:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:56:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:56:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:56:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:56:57 - XML: Processed 655492 elements - found 643 jobs
Sat 18 Jan 2014 00:56:57 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:56:57 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:56:57 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:56:57 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:56:57 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:56:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 00:56:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:56:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:56:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43860914
Sat 18 Jan 2014 00:56:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:56:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43860914
Sat 18 Jan 2014 00:56:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:57:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:57:07 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:57:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:57:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:57:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:57:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:57:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:57:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:57:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:57:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:57:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:57:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:57:11 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:57:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:57:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:57:12 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:57:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:57:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:57:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:57:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:57:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:57:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865966
Sat 18 Jan 2014 00:57:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:57:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43865966
Sat 18 Jan 2014 00:57:14 - job_xml_thread(): Done retrieving: data size 43865966
Sat 18 Jan 2014 00:57:14 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:57:14 - XML: Start document: iteration 1
Sat 18 Jan 2014 00:57:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:57:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:57:21 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:57:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:57:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 00:57:22 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:57:22 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:57:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 00:57:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9035 values 142564 bits 17820 bytes 
Sat 18 Jan 2014 00:57:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:57:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:57:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:57:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:57:36 - XML: Processed 655498 elements - found 646 jobs
Sat 18 Jan 2014 00:57:36 - job_xml_thread(): Found 3 updated jobs.
Sat 18 Jan 2014 00:57:36 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 00:57:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:57:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:57:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:57:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:57:37 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Sat 18 Jan 2014 00:57:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:57:37 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:57:37 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:57:37 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:57:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:57:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:57:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:57:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:57:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:57:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:57:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:57:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:57:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:57:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:57:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:57:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:57:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43898419
Sat 18 Jan 2014 00:57:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:57:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43898419
Sat 18 Jan 2014 00:57:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:57:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:57:50 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:57:52 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:57:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:57:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:57:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:57:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:57:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:57:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:57:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:57:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:57:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:57:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:57:53 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:57:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:57:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:57:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:57:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:57:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:57:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:57:54 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:57:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 00:57:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:57:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:57:55 - job_xml_thread(): Done retrieving: data size 43881701
Sat 18 Jan 2014 00:57:55 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:57:55 - XML: Start document: iteration 2
Sat 18 Jan 2014 00:57:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43881701
Sat 18 Jan 2014 00:57:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:57:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43881701
Sat 18 Jan 2014 00:57:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:58:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:58:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:58:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:58:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:58:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:58:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:58:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:58:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:58:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:58:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:58:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:58:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:58:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:58:15 - XML: Processed 655498 elements - found 646 jobs
Sat 18 Jan 2014 00:58:15 - job 7348712 field 'start_timestamp' changed since saved from: 1390003008 to: 1390002982
Sat 18 Jan 2014 00:58:15 - job 7348564 appears to have finished
Sat 18 Jan 2014 00:58:16 - job_xml_thread(): Found 3 updated jobs.
Sat 18 Jan 2014 00:58:16 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 00:58:17 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Sat 18 Jan 2014 00:58:17 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:58:17 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:58:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:58:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:58:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:58:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:58:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:58:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:58:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:58:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:58:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:58:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867399
Sat 18 Jan 2014 00:58:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:58:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43867399
Sat 18 Jan 2014 00:58:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:58:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:58:23 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:58:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:58:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:58:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:58:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 00:58:25 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:58:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8511 values 134188 bits 16773 bytes 
Sat 18 Jan 2014 00:58:25 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:58:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 00:58:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:58:26 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:58:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 00:58:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:58:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:58:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:58:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:58:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:58:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867399
Sat 18 Jan 2014 00:58:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:58:33 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:58:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:58:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:58:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:58:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:58:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:58:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:58:39 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:58:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:58:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:58:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:58:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:58:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:58:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:58:42 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:58:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 00:58:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:58:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:58:42 - job_xml_thread(): Done retrieving: data size 43865783
Sat 18 Jan 2014 00:58:42 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:58:42 - XML: Start document: iteration 3
Sat 18 Jan 2014 00:58:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43865783
Sat 18 Jan 2014 00:58:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:58:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:58:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:58:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:58:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:58:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:58:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:58:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865783
Sat 18 Jan 2014 00:58:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:58:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:58:53 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:58:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:58:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:58:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:58:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:59:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:59:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:59:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:59:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:59:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:59:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:59:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:59:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:59:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:59:04 - XML: Processed 655495 elements - found 646 jobs
Sat 18 Jan 2014 00:59:04 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 00:59:04 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 00:59:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:59:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:59:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:59:04 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:59:04 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:59:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:59:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:59:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43885184
Sat 18 Jan 2014 00:59:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:59:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43885184
Sat 18 Jan 2014 00:59:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:59:10 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 00:59:11 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:59:12 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:59:12 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:59:12 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 00:59:12 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 00:59:12 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 00:59:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:59:15 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:59:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:59:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:59:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:59:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:59:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:59:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:59:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43885184
Sat 18 Jan 2014 00:59:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sat 18 Jan 2014 00:59:19 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 00:59:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:59:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:59:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:59:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:59:25 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:59:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:59:27 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:59:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:59:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:59:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:59:28 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:59:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 00:59:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 00:59:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:59:28 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:59:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:59:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:59:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:59:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:59:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:59:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6312 values 99551 bits 12443 bytes 
Sat 18 Jan 2014 00:59:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:59:31 - job_xml_thread(): Done retrieving: data size 43775767
Sat 18 Jan 2014 00:59:31 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 00:59:31 - XML: Start document: iteration 4
Sat 18 Jan 2014 00:59:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:59:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:59:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43775767
Sat 18 Jan 2014 00:59:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 00:59:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:59:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:59:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:59:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43775767
Sat 18 Jan 2014 00:59:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:59:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:59:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 00:59:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 00:59:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 00:59:47 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 00:59:48 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 00:59:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 00:59:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:59:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 00:59:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 00:59:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:59:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 00:59:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 00:59:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 00:59:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 00:59:52 - XML: Processed 654750 elements - found 646 jobs
Sat 18 Jan 2014 00:59:52 - job 7348713 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 00:59:52 - job 7348715 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 00:59:52 - job 7348714 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 00:59:52 - job_xml_thread(): Found 3 updated jobs.
Sat 18 Jan 2014 00:59:52 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 00:59:53 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Sat 18 Jan 2014 00:59:53 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 00:59:53 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 00:59:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 00:59:54 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 00:59:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 00:59:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 00:59:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:59:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 00:59:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 00:59:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 00:59:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 00:59:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43209126
Sat 18 Jan 2014 00:59:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 00:59:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43209126
Sat 18 Jan 2014 00:59:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:00:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:00:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:00:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:00:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:00:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:00:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:00:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:00:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:00:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:00:08 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:00:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:00:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:00:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:00:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:00:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:00:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:00:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:00:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:00:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:00:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:00:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:00:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:00:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:00:11 - job_xml_thread(): Done retrieving: data size 43250785
Sat 18 Jan 2014 01:00:11 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:00:11 - XML: Start document: iteration 5
Sat 18 Jan 2014 01:00:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43250785
Sat 18 Jan 2014 01:00:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43250785
Sat 18 Jan 2014 01:00:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:00:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:00:12 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:00:12 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:00:13 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:00:13 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 01:00:13 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:00:14 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 01:00:14 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 01:00:17 - size of cluster 'LISA Cluster': 624 hosts 79468 metrics 901301 values 14219189 bits 1777398 bytes 
Sat 18 Jan 2014 01:00:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:00:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:00:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:00:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:00:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:00:29 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:00:29 - XML: Processed 647662 elements - found 642 jobs
Sat 18 Jan 2014 01:00:29 - job 7348708 appears to have finished
Sat 18 Jan 2014 01:00:29 - job 7345101 appears to have finished
Sat 18 Jan 2014 01:00:29 - job 7348562 appears to have finished
Sat 18 Jan 2014 01:00:29 - job 7348561 appears to have finished
Sat 18 Jan 2014 01:00:29 - job_xml_thread(): Found 4 updated jobs.
Sat 18 Jan 2014 01:00:29 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 01:00:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:00:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 01:00:29 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:00:29 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:00:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 01:00:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9083 values 143258 bits 17907 bytes 
Sat 18 Jan 2014 01:00:30 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Sat 18 Jan 2014 01:00:30 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:00:30 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:00:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:00:30 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:00:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:00:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:00:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:00:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:00:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:00:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:00:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:00:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:00:33 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:00:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:00:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:00:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:00:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:00:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:00:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:00:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:00:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43347952
Sat 18 Jan 2014 01:00:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:00:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43347952
Sat 18 Jan 2014 01:00:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:00:45 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:00:45 - job_xml_thread(): Done retrieving: data size 43347952
Sat 18 Jan 2014 01:00:45 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:00:45 - XML: Start document: iteration 6
Sat 18 Jan 2014 01:00:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:00:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:00:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:00:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:00:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:00:53 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:00:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:00:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:00:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:00:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:00:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:00:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:00:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:00:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:00:57 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:00:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:00:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:00:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:00:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:00:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:00:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:01:01 - XML: Processed 648824 elements - found 642 jobs
Sat 18 Jan 2014 01:01:01 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 01:01:01 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 01:01:01 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:01:01 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:01:01 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:01:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 01:01:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:01:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:01:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43852213
Sat 18 Jan 2014 01:01:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:01:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43852213
Sat 18 Jan 2014 01:01:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:01:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:01:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:01:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:01:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:01:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:01:13 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:01:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:01:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:01:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:01:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:01:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43852213
Sat 18 Jan 2014 01:01:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:01:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:01:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:01:14 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:01:14 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 01:01:16 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:01:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:01:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:01:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:01:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:01:27 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:01:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:01:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:01:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:01:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:01:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:01:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:01:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:01:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:01:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:01:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:01:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:01:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:01:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:01:30 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:01:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:01:30 - job_xml_thread(): Done retrieving: data size 43830091
Sat 18 Jan 2014 01:01:30 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:01:30 - XML: Start document: iteration 7
Sat 18 Jan 2014 01:01:30 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:01:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43830091
Sat 18 Jan 2014 01:01:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:01:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 01:01:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:01:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43830091
Sat 18 Jan 2014 01:01:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:01:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 01:01:30 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:01:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5699 values 89898 bits 11237 bytes 
Sat 18 Jan 2014 01:01:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:01:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:01:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:01:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:01:48 - XML: Processed 655488 elements - found 641 jobs
Sat 18 Jan 2014 01:01:48 - job 7348571 appears to have finished
Sat 18 Jan 2014 01:01:48 - job 7348588 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 01:01:48 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 01:01:48 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 01:01:49 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 01:01:49 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:01:49 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:01:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:01:49 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:01:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:01:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:01:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:01:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:01:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:01:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:01:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:01:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:01:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:01:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:01:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:01:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:01:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:01:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:01:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:01:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:01:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43859770
Sat 18 Jan 2014 01:01:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:01:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43859770
Sat 18 Jan 2014 01:01:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:01:59 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:01:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 01:01:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:02:04 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:02:04 - job_xml_thread(): Done retrieving: data size 43859770
Sat 18 Jan 2014 01:02:04 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:02:04 - XML: Start document: iteration 8
Sat 18 Jan 2014 01:02:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:02:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:02:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:02:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:02:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:02:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:02:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:02:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:02:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:02:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:02:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:02:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:02:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:02:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:02:19 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:02:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:02:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:02:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:02:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:02:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:02:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:02:21 - XML: Processed 655486 elements - found 640 jobs
Sat 18 Jan 2014 01:02:21 - job 7348570 appears to have finished
Sat 18 Jan 2014 01:02:21 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 01:02:21 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 01:02:22 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 01:02:22 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:02:22 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:02:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:02:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43869739
Sat 18 Jan 2014 01:02:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:02:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43869739
Sat 18 Jan 2014 01:02:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:02:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:02:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:02:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:02:30 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:02:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:02:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 01:02:31 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:02:31 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:02:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6292 values 99579 bits 12447 bytes 
Sat 18 Jan 2014 01:02:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 01:02:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:02:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:02:37 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:02:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:02:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:02:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:02:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:02:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:02:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:02:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:02:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:02:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:02:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:02:42 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:02:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:02:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:02:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:02:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:02:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:02:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:02:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:02:46 - job_xml_thread(): Done retrieving: data size 43858204
Sat 18 Jan 2014 01:02:46 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:02:46 - XML: Start document: iteration 9
Sat 18 Jan 2014 01:02:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43858204
Sat 18 Jan 2014 01:02:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858204
Sat 18 Jan 2014 01:02:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:02:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:02:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:02:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:02:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:02:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:02:58 - XML: Processed 655486 elements - found 640 jobs
Sat 18 Jan 2014 01:02:58 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 01:02:58 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 01:02:58 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:02:58 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:03:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:03:03 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:03:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:03:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:03:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:03:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:03:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:03:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:03:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:03:05 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:03:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 01:03:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:03:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:03:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:03:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:03:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:03:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:03:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:03:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:03:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:03:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:03:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43878703
Sat 18 Jan 2014 01:03:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:03:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43878703
Sat 18 Jan 2014 01:03:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:03:13 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:03:13 - job_xml_thread(): Done retrieving: data size 43878703
Sat 18 Jan 2014 01:03:13 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:03:13 - XML: Start document: iteration 10
Sat 18 Jan 2014 01:03:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:03:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:03:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:03:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:03:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:03:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:03:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:03:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:03:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:03:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:03:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:03:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:03:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:03:30 - XML: Processed 655486 elements - found 640 jobs
Sat 18 Jan 2014 01:03:30 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 01:03:30 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 01:03:30 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:03:30 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:03:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:03:31 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:03:32 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 01:03:32 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 01:03:32 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:03:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:03:32 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:03:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 01:03:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 01:03:32 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:03:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5916 values 93581 bits 11697 bytes 
Sat 18 Jan 2014 01:03:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:03:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:03:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:03:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:03:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:03:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:03:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:03:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:03:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:03:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43852605
Sat 18 Jan 2014 01:03:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:03:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43852605
Sat 18 Jan 2014 01:03:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:03:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:03:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:03:45 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:03:45 - job_xml_thread(): Done retrieving: data size 43852605
Sat 18 Jan 2014 01:03:45 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:03:45 - XML: Start document: iteration 11
Sat 18 Jan 2014 01:03:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:03:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:03:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:03:53 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:03:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:03:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:03:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:03:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:03:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:03:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:03:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:03:59 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:03:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 01:03:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:03:59 - XML: Processed 655486 elements - found 640 jobs
Sat 18 Jan 2014 01:03:59 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 01:03:59 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 01:03:59 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:03:59 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:04:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:04:01 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:04:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:04:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:04:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:04:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:04:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:04:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:04:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:04:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43854503
Sat 18 Jan 2014 01:04:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:04:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43854503
Sat 18 Jan 2014 01:04:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:04:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:04:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:04:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:04:14 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:04:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:04:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:04:14 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:04:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:04:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:04:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:04:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:04:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:04:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:04:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:04:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:04:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:04:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:04:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:04:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:04:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:04:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:04:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:04:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:04:19 - job_xml_thread(): Done retrieving: data size 43877635
Sat 18 Jan 2014 01:04:19 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:04:19 - XML: Start document: iteration 12
Sat 18 Jan 2014 01:04:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43877635
Sat 18 Jan 2014 01:04:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:04:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43877635
Sat 18 Jan 2014 01:04:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:04:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:04:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:04:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:04:32 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:04:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:04:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:04:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:04:33 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:04:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 01:04:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 01:04:34 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:04:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9167 values 144737 bits 18092 bytes 
Sat 18 Jan 2014 01:04:37 - XML: Processed 655484 elements - found 639 jobs
Sat 18 Jan 2014 01:04:37 - job 7346547 appears to have finished
Sat 18 Jan 2014 01:04:37 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 01:04:37 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 01:04:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:04:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:04:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:04:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:04:38 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 01:04:38 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:04:38 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:04:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:04:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:04:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:04:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:04:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:04:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:04:43 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:04:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:04:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:04:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:04:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:04:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:04:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:04:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:04:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43861606
Sat 18 Jan 2014 01:04:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:04:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43861606
Sat 18 Jan 2014 01:04:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:04:53 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:04:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:04:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:04:53 - job_xml_thread(): Done retrieving: data size 43861606
Sat 18 Jan 2014 01:04:53 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:04:53 - XML: Start document: iteration 13
Sat 18 Jan 2014 01:04:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:04:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:04:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:04:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:04:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:04:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:04:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:04:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:04:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:04:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:04:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:05:04 - XML: Processed 655484 elements - found 639 jobs
Sat 18 Jan 2014 01:05:04 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 01:05:04 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 01:05:04 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:05:04 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:05:05 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:05:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 01:05:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:05:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:05:07 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:05:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:05:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:05:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:05:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:05:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:05:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:05:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:05:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855217
Sat 18 Jan 2014 01:05:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:05:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855217
Sat 18 Jan 2014 01:05:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:05:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:05:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:05:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:05:19 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:05:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:05:19 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:05:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:05:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:05:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:05:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:05:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:05:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:05:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:05:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:05:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:05:23 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:05:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:05:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:05:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:05:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:05:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:05:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:05:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:05:25 - job_xml_thread(): Done retrieving: data size 43820489
Sat 18 Jan 2014 01:05:25 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:05:25 - XML: Start document: iteration 14
Sat 18 Jan 2014 01:05:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43820489
Sat 18 Jan 2014 01:05:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43820489
Sat 18 Jan 2014 01:05:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:05:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:05:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:05:34 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:05:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:05:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 01:05:34 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:05:35 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:05:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:05:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:05:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8972 values 141598 bits 17699 bytes 
Sat 18 Jan 2014 01:05:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 01:05:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:05:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:05:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:05:43 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:05:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:05:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:05:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:05:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:05:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:05:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:05:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:05:47 - XML: Processed 654740 elements - found 641 jobs
Sat 18 Jan 2014 01:05:47 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 01:05:47 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 01:05:48 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 01:05:48 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:05:48 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:05:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:05:48 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:05:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:05:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:05:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:05:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:05:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:05:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:05:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:05:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43248864
Sat 18 Jan 2014 01:05:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:05:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43248864
Sat 18 Jan 2014 01:05:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:06:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:06:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:06:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:06:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:06:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:06:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:06:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:06:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:06:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:06:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:06:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:06:03 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:06:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:06:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:06:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:06:05 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:06:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:06:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:06:05 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:06:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 01:06:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:06:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:06:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:06:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:06:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:06:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:06:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43231024
Sat 18 Jan 2014 01:06:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:06:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43231024
Sat 18 Jan 2014 01:06:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:06:07 - job_xml_thread(): Done retrieving: data size 43231024
Sat 18 Jan 2014 01:06:07 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:06:07 - XML: Start document: iteration 15
Sat 18 Jan 2014 01:06:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:06:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:06:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:06:19 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:06:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:06:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:06:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:06:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:06:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:06:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:06:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:06:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:06:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:06:23 - XML: Processed 647288 elements - found 641 jobs
Sat 18 Jan 2014 01:06:23 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 01:06:23 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 01:06:23 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:06:23 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:06:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:06:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:06:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:06:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:06:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:06:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:06:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:06:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:06:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:06:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43371841
Sat 18 Jan 2014 01:06:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:06:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43371841
Sat 18 Jan 2014 01:06:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:06:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:06:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:06:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:06:36 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:06:36 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:06:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:06:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 01:06:36 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:06:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 01:06:38 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:06:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:06:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:06:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:06:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8819 values 139094 bits 17386 bytes 
Sat 18 Jan 2014 01:06:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:06:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:06:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:06:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:06:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:06:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:06:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:06:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:06:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:06:43 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:06:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:06:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:06:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:06:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:06:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:06:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:06:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:06:45 - job_xml_thread(): Done retrieving: data size 43788023
Sat 18 Jan 2014 01:06:45 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:06:45 - XML: Start document: iteration 16
Sat 18 Jan 2014 01:06:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43788023
Sat 18 Jan 2014 01:06:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:06:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43788023
Sat 18 Jan 2014 01:06:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:06:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:06:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:06:57 - XML: Processed 654722 elements - found 641 jobs
Sat 18 Jan 2014 01:06:57 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 01:06:57 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 01:06:57 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:06:57 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:06:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:06:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:07:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:07:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:07:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:07:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:07:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:07:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:07:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:07:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:07:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:07:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:07:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:07:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:07:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:07:09 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:07:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 01:07:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:07:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:07:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:07:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:07:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:07:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:07:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43886333
Sat 18 Jan 2014 01:07:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:07:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43886333
Sat 18 Jan 2014 01:07:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:07:13 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:07:13 - job_xml_thread(): Done retrieving: data size 43886333
Sat 18 Jan 2014 01:07:13 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:07:13 - XML: Start document: iteration 17
Sat 18 Jan 2014 01:07:14 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 01:07:15 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:07:18 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:07:18 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:07:18 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 01:07:18 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 01:07:18 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 01:07:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:07:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:07:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:07:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:07:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:07:26 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:07:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:07:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:07:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:07:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:07:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:07:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:07:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:07:31 - XML: Processed 655488 elements - found 641 jobs
Sat 18 Jan 2014 01:07:31 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 01:07:31 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 01:07:31 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:07:31 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:07:32 - size of cluster 'LISA Cluster': 624 hosts 79472 metrics 825425 values 13045157 bits 1630644 bytes 
Sat 18 Jan 2014 01:07:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:07:35 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:07:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:07:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:07:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:07:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:07:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:07:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:07:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:07:36 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:07:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:07:36 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:07:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 01:07:36 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:07:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 01:07:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6006 values 94817 bits 11852 bytes 
Sat 18 Jan 2014 01:07:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:07:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855421
Sat 18 Jan 2014 01:07:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:07:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855421
Sat 18 Jan 2014 01:07:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:07:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:07:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:07:46 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:07:46 - job_xml_thread(): Done retrieving: data size 43855421
Sat 18 Jan 2014 01:07:46 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:07:46 - XML: Start document: iteration 18
Sat 18 Jan 2014 01:07:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:07:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:07:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:07:53 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:07:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:07:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:07:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:07:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:07:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:07:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:07:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:08:03 - XML: Processed 655488 elements - found 641 jobs
Sat 18 Jan 2014 01:08:03 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 01:08:03 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 01:08:03 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:08:03 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:08:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:08:04 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:08:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:08:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:08:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:08:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:08:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:08:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:08:06 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:08:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 01:08:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:08:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:08:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855008
Sat 18 Jan 2014 01:08:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:08:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855008
Sat 18 Jan 2014 01:08:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:08:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:08:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:08:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:08:18 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:08:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:08:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:08:18 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:08:18 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 01:08:18 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:08:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:08:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:08:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:08:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:08:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:08:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:08:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:08:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:08:22 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:08:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:08:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:08:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:08:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:08:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:08:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:08:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:08:25 - job_xml_thread(): Done retrieving: data size 43893002
Sat 18 Jan 2014 01:08:25 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:08:25 - XML: Start document: iteration 19
Sat 18 Jan 2014 01:08:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43893002
Sat 18 Jan 2014 01:08:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:08:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43893002
Sat 18 Jan 2014 01:08:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:08:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:08:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:08:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:08:37 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:08:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:08:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:08:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:08:40 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:08:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 01:08:40 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:08:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 01:08:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7956 values 125542 bits 15692 bytes 
Sat 18 Jan 2014 01:08:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:08:42 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:08:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:08:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:08:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:08:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:08:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:08:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:08:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:08:47 - XML: Processed 655486 elements - found 640 jobs
Sat 18 Jan 2014 01:08:47 - job 7348573 appears to have finished
Sat 18 Jan 2014 01:08:47 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 01:08:47 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 01:08:48 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 01:08:48 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:08:48 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:08:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:08:50 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:08:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:08:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:08:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:08:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:08:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:08:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:08:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:08:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867313
Sat 18 Jan 2014 01:08:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:08:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43867313
Sat 18 Jan 2014 01:08:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:08:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:08:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:09:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:09:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:09:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:09:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:09:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:09:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:09:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867313
Sat 18 Jan 2014 01:09:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:09:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:09:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:09:03 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:09:03 - job_xml_thread(): Done retrieving: data size 43867313
Sat 18 Jan 2014 01:09:03 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:09:03 - XML: Start document: iteration 20
Sat 18 Jan 2014 01:09:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:09:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:09:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:09:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:09:18 - XML: Processed 655486 elements - found 640 jobs
Sat 18 Jan 2014 01:09:18 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 01:09:18 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 01:09:18 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:09:18 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:09:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:09:19 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:09:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:09:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:09:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:09:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:09:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:09:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:09:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:09:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:09:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:09:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:09:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:09:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:09:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:09:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:09:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:09:23 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:09:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 01:09:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:09:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:09:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43892298
Sat 18 Jan 2014 01:09:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:09:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43892298
Sat 18 Jan 2014 01:09:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:09:33 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:09:33 - job_xml_thread(): Done retrieving: data size 43892298
Sat 18 Jan 2014 01:09:33 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:09:33 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 01:09:35 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 01:09:35 - Housekeeping: done.
Sat 18 Jan 2014 01:09:35 - XML: Start document: iteration 0
Sat 18 Jan 2014 01:09:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:09:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:09:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:09:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:09:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:09:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:09:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:09:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:09:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:09:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:09:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:09:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:09:41 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:09:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:09:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 01:09:41 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:09:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5582 values 87997 bits 10999 bytes 
Sat 18 Jan 2014 01:09:41 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:09:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 01:09:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:09:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:09:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:09:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:09:47 - XML: Processed 655486 elements - found 640 jobs
Sat 18 Jan 2014 01:09:47 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 01:09:47 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 01:09:47 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:09:47 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:09:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:09:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:09:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:09:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:09:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:09:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43847115
Sat 18 Jan 2014 01:09:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:09:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43847115
Sat 18 Jan 2014 01:09:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:09:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:09:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:10:02 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:10:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:10:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:10:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:10:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:10:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:10:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:10:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:10:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:10:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:10:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:10:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:10:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:10:07 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:10:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:10:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:10:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:10:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:10:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:10:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:10:08 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:10:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 01:10:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:10:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:10:10 - job_xml_thread(): Done retrieving: data size 43885096
Sat 18 Jan 2014 01:10:10 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:10:10 - XML: Start document: iteration 1
Sat 18 Jan 2014 01:10:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43885096
Sat 18 Jan 2014 01:10:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:10:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43885096
Sat 18 Jan 2014 01:10:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:10:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:10:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:10:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:10:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:10:24 - XML: Processed 655482 elements - found 638 jobs
Sat 18 Jan 2014 01:10:24 - job 7348574 appears to have finished
Sat 18 Jan 2014 01:10:24 - job 7348579 appears to have finished
Sat 18 Jan 2014 01:10:24 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 01:10:25 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 01:10:27 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 01:10:27 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:10:27 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:10:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:10:27 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:10:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:10:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:10:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:10:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:10:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:10:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:10:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:10:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:10:31 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:10:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:10:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:10:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:10:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:10:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:10:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:10:33 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 01:10:33 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 01:10:33 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:10:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:10:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43864626
Sat 18 Jan 2014 01:10:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:10:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43864626
Sat 18 Jan 2014 01:10:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:10:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:10:41 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:10:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:10:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 01:10:42 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:10:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8805 values 138878 bits 17359 bytes 
Sat 18 Jan 2014 01:10:42 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:10:42 - job_xml_thread(): Done retrieving: data size 43864626
Sat 18 Jan 2014 01:10:42 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:10:42 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:10:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 01:10:42 - XML: Start document: iteration 2
Sat 18 Jan 2014 01:10:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:10:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:10:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:10:46 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:10:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:10:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:10:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:10:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:10:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:10:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:10:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:10:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:10:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:10:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:10:56 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:10:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:10:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:10:58 - XML: Processed 655482 elements - found 638 jobs
Sat 18 Jan 2014 01:10:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:10:58 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 01:10:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:10:58 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 01:10:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:10:58 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:10:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:10:58 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:11:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:11:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43846789
Sat 18 Jan 2014 01:11:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:11:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43846789
Sat 18 Jan 2014 01:11:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:11:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:11:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:11:13 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:11:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:11:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:11:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:11:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:11:15 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:11:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:11:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:11:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:11:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:11:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:11:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:11:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:11:16 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:11:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:11:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:11:16 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:11:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 01:11:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:11:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:11:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:11:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:11:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:11:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:11:18 - job_xml_thread(): Done retrieving: data size 43798110
Sat 18 Jan 2014 01:11:18 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:11:18 - XML: Start document: iteration 3
Sat 18 Jan 2014 01:11:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43798110
Sat 18 Jan 2014 01:11:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:11:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43798110
Sat 18 Jan 2014 01:11:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:11:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:11:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:11:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:11:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:11:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:11:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:11:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:11:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:11:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:11:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:11:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:11:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:11:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:11:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:11:38 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:11:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:11:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:11:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:11:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:11:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:11:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:11:39 - XML: Processed 654742 elements - found 642 jobs
Sat 18 Jan 2014 01:11:39 - job_xml_thread(): Found 4 updated jobs.
Sat 18 Jan 2014 01:11:39 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 01:11:39 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Sat 18 Jan 2014 01:11:39 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:11:39 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:11:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:11:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43287220
Sat 18 Jan 2014 01:11:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:11:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43287220
Sat 18 Jan 2014 01:11:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:11:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:11:43 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:11:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:11:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 01:11:45 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:11:45 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:11:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 01:11:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8757 values 138088 bits 17261 bytes 
Sat 18 Jan 2014 01:11:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:11:49 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:11:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:11:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:11:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:11:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:11:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:11:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:11:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:11:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:11:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:11:55 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:11:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:11:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:11:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:11:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:11:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:11:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:11:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:11:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43229747
Sat 18 Jan 2014 01:11:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:11:58 - job_xml_thread(): Done retrieving: data size 43229747
Sat 18 Jan 2014 01:11:58 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:11:58 - XML: Start document: iteration 4
Sat 18 Jan 2014 01:11:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43229747
Sat 18 Jan 2014 01:11:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:12:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:12:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:12:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:12:10 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:12:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:12:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:12:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:12:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:12:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:12:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:12:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:12:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:12:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:12:12 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:12:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 01:12:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:12:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:12:19 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:12:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:12:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:12:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:12:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:12:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:12:20 - XML: Processed 647306 elements - found 641 jobs
Sat 18 Jan 2014 01:12:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:12:20 - job 7348720 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 01:12:20 - job 7348721 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 01:12:20 - job 7348719 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 01:12:20 - job 7348576 appears to have finished
Sat 18 Jan 2014 01:12:20 - job_xml_thread(): Found 4 updated jobs.
Sat 18 Jan 2014 01:12:20 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 01:12:20 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Sat 18 Jan 2014 01:12:20 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:12:20 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:12:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:12:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43248997
Sat 18 Jan 2014 01:12:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:12:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43248997
Sat 18 Jan 2014 01:12:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:12:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:12:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:12:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:12:32 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:12:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:12:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:12:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:12:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:12:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:12:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:12:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:12:35 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:12:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:12:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:12:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:12:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:12:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:12:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:12:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:12:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:12:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:12:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:12:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:12:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43651277
Sat 18 Jan 2014 01:12:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:12:39 - job_xml_thread(): Done retrieving: data size 43651277
Sat 18 Jan 2014 01:12:39 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:12:39 - XML: Start document: iteration 5
Sat 18 Jan 2014 01:12:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43651277
Sat 18 Jan 2014 01:12:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:12:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:12:46 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:12:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:12:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 01:12:47 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:12:48 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:12:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 01:12:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:12:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:12:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9181 values 144942 bits 18117 bytes 
Sat 18 Jan 2014 01:12:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:12:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:12:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:12:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:12:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:12:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:12:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:12:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:12:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:12:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:12:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:12:58 - XML: Processed 652606 elements - found 641 jobs
Sat 18 Jan 2014 01:12:58 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 01:12:58 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 01:12:58 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:12:58 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:13:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:13:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:13:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:13:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:13:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:13:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:13:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:13:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:13:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:13:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858706
Sat 18 Jan 2014 01:13:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:13:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43858706
Sat 18 Jan 2014 01:13:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:13:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:13:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:13:13 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:13:13 - job_xml_thread(): Done retrieving: data size 43858706
Sat 18 Jan 2014 01:13:13 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:13:13 - XML: Start document: iteration 6
Sat 18 Jan 2014 01:13:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:13:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:13:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:13:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:13:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:13:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:13:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:13:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:13:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:13:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:13:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:13:25 - XML: Processed 655488 elements - found 641 jobs
Sat 18 Jan 2014 01:13:25 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 01:13:25 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 01:13:25 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:13:25 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:13:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:13:28 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:13:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:13:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:13:28 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:13:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 01:13:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:13:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:13:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:13:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:13:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:13:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:13:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43835156
Sat 18 Jan 2014 01:13:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:13:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43835156
Sat 18 Jan 2014 01:13:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:13:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:13:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:13:41 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:13:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:13:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:13:42 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:13:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:13:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:13:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:13:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:13:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:13:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:13:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:13:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:13:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:13:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:13:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:13:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:13:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:13:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:13:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:13:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:13:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:13:46 - job_xml_thread(): Done retrieving: data size 43857508
Sat 18 Jan 2014 01:13:46 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:13:46 - XML: Start document: iteration 7
Sat 18 Jan 2014 01:13:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43857508
Sat 18 Jan 2014 01:13:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43857508
Sat 18 Jan 2014 01:13:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:13:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:13:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:13:48 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:13:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:13:49 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:13:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 01:13:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 01:13:50 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:13:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8837 values 139387 bits 17423 bytes 
Sat 18 Jan 2014 01:13:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:13:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:14:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:14:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:14:05 - XML: Processed 655490 elements - found 642 jobs
Sat 18 Jan 2014 01:14:05 - job 7348589 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 01:14:05 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 01:14:05 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 01:14:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:14:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:14:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:14:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:14:06 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 01:14:06 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:14:06 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:14:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:14:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:14:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:14:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:14:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:14:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:14:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:14:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:14:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:14:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:14:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:14:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:14:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:14:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:14:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43894848
Sat 18 Jan 2014 01:14:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:14:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43894848
Sat 18 Jan 2014 01:14:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:14:19 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 01:14:19 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:14:19 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:14:19 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:14:19 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 01:14:20 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 01:14:20 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 01:14:21 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:14:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:14:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:14:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:14:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:14:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:14:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:14:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:14:23 - size of cluster 'LISA Cluster': 624 hosts 79480 metrics 867202 values 13690480 bits 1711310 bytes 
Sat 18 Jan 2014 01:14:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:14:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:14:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:14:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:14:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:14:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:14:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:14:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:14:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:14:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:14:25 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:14:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 01:14:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:14:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:14:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:14:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:14:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:14:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:14:28 - job_xml_thread(): Done retrieving: data size 43878329
Sat 18 Jan 2014 01:14:28 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:14:28 - XML: Start document: iteration 8
Sat 18 Jan 2014 01:14:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43878329
Sat 18 Jan 2014 01:14:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43878329
Sat 18 Jan 2014 01:14:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:14:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:14:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:14:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:14:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:14:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:14:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:14:43 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:14:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:14:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:14:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:14:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:14:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:14:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:14:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:14:46 - XML: Processed 655490 elements - found 642 jobs
Sat 18 Jan 2014 01:14:46 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 01:14:47 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 01:14:47 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:14:47 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:14:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:14:49 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:14:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:14:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 01:14:50 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:14:50 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:14:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 01:14:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6103 values 96304 bits 12038 bytes 
Sat 18 Jan 2014 01:14:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:14:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:14:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:14:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:14:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:14:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:14:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:14:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:14:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:14:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43869226
Sat 18 Jan 2014 01:14:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:14:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43869226
Sat 18 Jan 2014 01:14:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:15:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:15:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:15:02 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:15:02 - job_xml_thread(): Done retrieving: data size 43869226
Sat 18 Jan 2014 01:15:02 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:15:02 - XML: Start document: iteration 9
Sat 18 Jan 2014 01:15:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:15:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:15:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:15:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:15:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:15:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:15:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:15:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:15:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:15:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:15:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:15:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:15:16 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:15:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:15:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:15:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:15:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:15:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:15:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:15:18 - XML: Processed 655490 elements - found 642 jobs
Sat 18 Jan 2014 01:15:18 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 01:15:18 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 01:15:18 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:15:18 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:15:18 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:15:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 01:15:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:15:20 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:15:20 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 01:15:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:15:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43841558
Sat 18 Jan 2014 01:15:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:15:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43841558
Sat 18 Jan 2014 01:15:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:15:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:15:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:15:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:15:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:15:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:15:32 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:15:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:15:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:15:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:15:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:15:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:15:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:15:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:15:33 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:15:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:15:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:15:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:15:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:15:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:15:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:15:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:15:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:15:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:15:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43881246
Sat 18 Jan 2014 01:15:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:15:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43881246
Sat 18 Jan 2014 01:15:40 - job_xml_thread(): Done retrieving: data size 43881246
Sat 18 Jan 2014 01:15:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:15:40 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:15:40 - XML: Start document: iteration 10
Sat 18 Jan 2014 01:15:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:15:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:15:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:15:50 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:15:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:15:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 01:15:50 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:15:50 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:15:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 01:15:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8705 values 137288 bits 17161 bytes 
Sat 18 Jan 2014 01:15:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:15:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:15:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:15:56 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:15:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:15:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:15:57 - XML: Processed 655486 elements - found 640 jobs
Sat 18 Jan 2014 01:15:57 - job 7335120 appears to have finished
Sat 18 Jan 2014 01:15:57 - job 7348387 appears to have finished
Sat 18 Jan 2014 01:15:57 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 01:15:57 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 01:15:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:15:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:15:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:15:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:15:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:15:58 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 01:15:58 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:15:58 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:16:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:16:01 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:16:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:16:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:16:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:16:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:16:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:16:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:16:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:16:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43863625
Sat 18 Jan 2014 01:16:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:16:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43863625
Sat 18 Jan 2014 01:16:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:16:13 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:16:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:16:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:16:13 - job_xml_thread(): Done retrieving: data size 43863625
Sat 18 Jan 2014 01:16:13 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:16:13 - XML: Start document: iteration 11
Sat 18 Jan 2014 01:16:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:16:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:16:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:16:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:16:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:16:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:16:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:16:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:16:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:16:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:16:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:16:27 - XML: Processed 655486 elements - found 640 jobs
Sat 18 Jan 2014 01:16:27 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 01:16:27 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 01:16:27 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:16:27 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:16:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:16:29 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:16:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:16:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:16:29 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:16:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 01:16:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:16:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:16:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:16:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:16:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:16:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:16:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855081
Sat 18 Jan 2014 01:16:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:16:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855081
Sat 18 Jan 2014 01:16:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:16:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:16:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:16:42 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:16:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:16:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:16:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:16:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:16:46 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:16:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:16:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:16:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:16:48 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:16:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:16:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:16:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:16:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:16:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:16:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:16:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:16:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:16:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:16:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:16:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:16:50 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:16:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:16:51 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:16:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 01:16:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 01:16:51 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:16:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5808 values 91755 bits 11469 bytes 
Sat 18 Jan 2014 01:16:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:16:51 - job_xml_thread(): Done retrieving: data size 43869309
Sat 18 Jan 2014 01:16:51 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:16:51 - XML: Start document: iteration 12
Sat 18 Jan 2014 01:16:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43869309
Sat 18 Jan 2014 01:16:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:16:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43869309
Sat 18 Jan 2014 01:16:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:17:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:17:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:17:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:17:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:17:11 - XML: Processed 655486 elements - found 640 jobs
Sat 18 Jan 2014 01:17:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:17:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:17:12 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 01:17:12 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 01:17:12 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:17:12 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:17:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:17:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:17:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:17:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:17:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:17:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:17:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:17:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:17:16 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:17:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:17:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:17:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:17:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:17:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:17:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:17:20 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:17:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 01:17:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:17:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:17:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43799335
Sat 18 Jan 2014 01:17:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:17:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43799335
Sat 18 Jan 2014 01:17:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:17:27 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:17:27 - job_xml_thread(): Done retrieving: data size 43799335
Sat 18 Jan 2014 01:17:28 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:17:28 - XML: Start document: iteration 13
Sat 18 Jan 2014 01:17:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:17:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:17:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:17:31 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:17:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:17:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:17:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:17:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:17:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:17:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:17:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:17:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:17:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:17:39 - XML: Processed 654738 elements - found 640 jobs
Sat 18 Jan 2014 01:17:39 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 01:17:39 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 01:17:39 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:17:39 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:17:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:17:43 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:17:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:17:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:17:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:17:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:17:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:17:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:17:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:17:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43304536
Sat 18 Jan 2014 01:17:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:17:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43304536
Sat 18 Jan 2014 01:17:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:17:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:17:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:17:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:17:51 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:17:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:17:52 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:17:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 01:17:52 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:17:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 01:17:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6783 values 107373 bits 13421 bytes 
Sat 18 Jan 2014 01:17:54 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:17:54 - job_xml_thread(): Done retrieving: data size 43304536
Sat 18 Jan 2014 01:17:54 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:17:54 - XML: Start document: iteration 14
Sat 18 Jan 2014 01:17:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:17:56 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:17:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:17:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:17:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:17:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:17:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:17:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:17:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:17:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:17:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:18:06 - XML: Processed 648752 elements - found 640 jobs
Sat 18 Jan 2014 01:18:06 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 01:18:06 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 01:18:06 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:18:06 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:18:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:18:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:18:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:18:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:18:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:18:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:18:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:18:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:18:11 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 01:18:11 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 01:18:11 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:18:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:18:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43203738
Sat 18 Jan 2014 01:18:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:18:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:18:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43203738
Sat 18 Jan 2014 01:18:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:18:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:18:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:18:20 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:18:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:18:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:18:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:18:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:18:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:18:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43203738
Sat 18 Jan 2014 01:18:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:18:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:18:21 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:18:21 - job_xml_thread(): Done retrieving: data size 43203738
Sat 18 Jan 2014 01:18:21 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:18:21 - XML: Start document: iteration 15
Sat 18 Jan 2014 01:18:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:18:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:18:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:18:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:18:36 - XML: Processed 647306 elements - found 643 jobs
Sat 18 Jan 2014 01:18:36 - job_xml_thread(): Found 3 updated jobs.
Sat 18 Jan 2014 01:18:36 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 01:18:38 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Sat 18 Jan 2014 01:18:38 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:18:38 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:18:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:18:39 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:18:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:18:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:18:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:18:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:18:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:18:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:18:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:18:39 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:18:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 01:18:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:18:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:18:41 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:18:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:18:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:18:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:18:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:18:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:18:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:18:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:18:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43775951
Sat 18 Jan 2014 01:18:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:18:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43775951
Sat 18 Jan 2014 01:18:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:18:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:18:52 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:18:53 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:18:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:18:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:18:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 01:18:53 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:18:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5852 values 92469 bits 11558 bytes 
Sat 18 Jan 2014 01:18:53 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:18:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 01:18:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:18:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:18:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:18:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:18:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:18:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:18:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:18:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:18:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:18:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:18:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:18:57 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:18:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:18:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:18:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:18:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:18:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:18:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:19:00 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:19:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 01:19:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:19:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:19:00 - job_xml_thread(): Done retrieving: data size 43855248
Sat 18 Jan 2014 01:19:00 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:19:00 - XML: Start document: iteration 16
Sat 18 Jan 2014 01:19:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855248
Sat 18 Jan 2014 01:19:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:19:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855248
Sat 18 Jan 2014 01:19:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:19:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:19:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:19:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:19:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:19:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:19:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:19:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:19:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:19:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:19:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:19:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:19:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:19:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:19:21 - XML: Processed 655472 elements - found 643 jobs
Sat 18 Jan 2014 01:19:21 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 01:19:21 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 01:19:21 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:19:21 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:19:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:19:23 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:19:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:19:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:19:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:19:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:19:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:19:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:19:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:19:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43864950
Sat 18 Jan 2014 01:19:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:19:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43864950
Sat 18 Jan 2014 01:19:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:19:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:19:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:19:36 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:19:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:19:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:19:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:19:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:19:39 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:19:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:19:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:19:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:19:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:19:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:19:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:19:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:19:41 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:19:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:19:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:19:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:19:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:19:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:19:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:19:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:19:42 - job_xml_thread(): Done retrieving: data size 43883752
Sat 18 Jan 2014 01:19:42 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:19:42 - XML: Start document: iteration 17
Sat 18 Jan 2014 01:19:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43883752
Sat 18 Jan 2014 01:19:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:19:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43883752
Sat 18 Jan 2014 01:19:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:19:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:19:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:19:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:19:54 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:19:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:19:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 01:19:54 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:19:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148689 bits 18586 bytes 
Sat 18 Jan 2014 01:19:54 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:19:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 01:19:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:19:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:19:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:19:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:19:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:19:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:19:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:19:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:19:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:20:00 - XML: Processed 655486 elements - found 640 jobs
Sat 18 Jan 2014 01:20:00 - job 7348724 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 01:20:00 - job 7348722 field 'start_timestamp' changed since saved from: 1390004288 to: 1390004219
Sat 18 Jan 2014 01:20:00 - job 7348723 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 01:20:00 - job 7348651 appears to have finished
Sat 18 Jan 2014 01:20:00 - job 7348572 appears to have finished
Sat 18 Jan 2014 01:20:00 - job 7348580 appears to have finished
Sat 18 Jan 2014 01:20:00 - job_xml_thread(): Found 6 updated jobs.
Sat 18 Jan 2014 01:20:00 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 01:20:01 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Sat 18 Jan 2014 01:20:01 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:20:01 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:20:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:20:04 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:20:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:20:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:20:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:20:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:20:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:20:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:20:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:20:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851401
Sat 18 Jan 2014 01:20:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:20:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851401
Sat 18 Jan 2014 01:20:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:20:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:20:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:20:17 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:20:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:20:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:20:18 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:20:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:20:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:20:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:20:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:20:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:20:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:20:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:20:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:20:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:20:20 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:20:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:20:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:20:20 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:20:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 01:20:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:20:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:20:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:20:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:20:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:20:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:20:22 - job_xml_thread(): Done retrieving: data size 43870256
Sat 18 Jan 2014 01:20:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870256
Sat 18 Jan 2014 01:20:22 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:20:22 - XML: Start document: iteration 18
Sat 18 Jan 2014 01:20:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:20:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870256
Sat 18 Jan 2014 01:20:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:20:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:20:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:20:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:20:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:20:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:20:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:20:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:20:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:20:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:20:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:20:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:20:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:20:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:20:42 - XML: Processed 655486 elements - found 640 jobs
Sat 18 Jan 2014 01:20:42 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 01:20:42 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 01:20:42 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:20:42 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:20:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:20:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:20:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:20:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:20:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:20:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:20:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:20:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:20:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:20:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865357
Sat 18 Jan 2014 01:20:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:20:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43865357
Sat 18 Jan 2014 01:20:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:20:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:20:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:20:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:20:55 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:20:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:20:56 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:20:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 01:20:56 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:20:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 01:20:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9094 values 143539 bits 17942 bytes 
Sat 18 Jan 2014 01:20:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:20:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:20:58 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:20:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:20:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:20:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:20:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:20:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:20:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:20:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:21:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:21:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:21:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:21:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:21:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:21:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:21:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:21:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:21:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:21:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:21:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:21:05 - job_xml_thread(): Done retrieving: data size 43858722
Sat 18 Jan 2014 01:21:05 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:21:05 - XML: Start document: iteration 19
Sat 18 Jan 2014 01:21:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43858722
Sat 18 Jan 2014 01:21:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858722
Sat 18 Jan 2014 01:21:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:21:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:21:13 - XML: Processed 655486 elements - found 640 jobs
Sat 18 Jan 2014 01:21:13 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 01:21:13 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 01:21:13 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:21:13 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:21:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:21:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:21:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:21:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:21:20 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 01:21:20 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:21:21 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:21:21 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:21:21 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 01:21:21 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 01:21:21 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 01:21:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:21:24 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:21:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:21:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:21:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:21:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:21:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:21:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:21:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:21:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:21:27 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:21:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:21:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:21:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:21:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:21:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:21:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:21:27 - size of cluster 'LISA Cluster': 624 hosts 79480 metrics 849140 values 13415566 bits 1676945 bytes 
Sat 18 Jan 2014 01:21:28 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:21:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 01:21:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:21:28 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:21:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:21:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43872942
Sat 18 Jan 2014 01:21:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:21:31 - job_xml_thread(): Done retrieving: data size 43872942
Sat 18 Jan 2014 01:21:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43872942
Sat 18 Jan 2014 01:21:31 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:21:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:21:32 - XML: Start document: iteration 20
Sat 18 Jan 2014 01:21:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:21:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:21:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:21:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:21:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:21:42 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:21:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:21:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:21:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:21:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:21:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:21:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:21:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:21:48 - XML: Processed 655481 elements - found 639 jobs
Sat 18 Jan 2014 01:21:48 - job 7348714 appears to have finished
Sat 18 Jan 2014 01:21:48 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 01:21:48 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 01:21:48 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 01:21:48 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:21:48 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:21:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:21:53 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:21:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:21:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:21:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:21:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:21:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:21:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:21:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:21:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855429
Sat 18 Jan 2014 01:21:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:21:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:21:57 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:21:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855429
Sat 18 Jan 2014 01:21:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:21:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:21:58 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:21:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 01:21:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 01:21:59 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:22:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:22:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:22:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8929 values 140865 bits 17608 bytes 
Sat 18 Jan 2014 01:22:04 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:22:04 - job_xml_thread(): Done retrieving: data size 43855429
Sat 18 Jan 2014 01:22:04 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:22:04 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 01:22:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:22:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:22:05 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 01:22:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:22:05 - Housekeeping: done.
Sat 18 Jan 2014 01:22:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:22:05 - XML: Start document: iteration 0
Sat 18 Jan 2014 01:22:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:22:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:22:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:22:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:22:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:22:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:22:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:22:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:22:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:22:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:22:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:22:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:22:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:22:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:22:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:22:19 - XML: Processed 655482 elements - found 638 jobs
Sat 18 Jan 2014 01:22:19 - job 7348581 appears to have finished
Sat 18 Jan 2014 01:22:19 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 01:22:19 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 01:22:19 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 01:22:19 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:22:19 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:22:21 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:22:21 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 01:22:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:22:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:22:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:22:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43835406
Sat 18 Jan 2014 01:22:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:22:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43835406
Sat 18 Jan 2014 01:22:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:22:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:22:33 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:22:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:22:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:22:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:22:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:22:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:22:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:22:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:22:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:22:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:22:34 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:22:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:22:38 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:22:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:22:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:22:39 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:22:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 01:22:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:22:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:22:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:22:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:22:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:22:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:22:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43878313
Sat 18 Jan 2014 01:22:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:22:41 - job_xml_thread(): Done retrieving: data size 43878313
Sat 18 Jan 2014 01:22:41 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:22:41 - XML: Start document: iteration 1
Sat 18 Jan 2014 01:22:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43878313
Sat 18 Jan 2014 01:22:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:22:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:22:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:22:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:22:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:22:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:22:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:22:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:22:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:22:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:22:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:22:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:22:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:22:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:22:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:22:59 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:23:00 - XML: Processed 655482 elements - found 638 jobs
Sat 18 Jan 2014 01:23:00 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 01:23:00 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 01:23:00 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:23:00 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:23:00 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:23:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:23:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 01:23:00 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:23:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 01:23:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5530 values 87215 bits 10901 bytes 
Sat 18 Jan 2014 01:23:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:23:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:23:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:23:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:23:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:23:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:23:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:23:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:23:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:23:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858790
Sat 18 Jan 2014 01:23:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:23:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43858790
Sat 18 Jan 2014 01:23:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:23:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:23:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:23:16 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:23:16 - job_xml_thread(): Done retrieving: data size 43858790
Sat 18 Jan 2014 01:23:16 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:23:16 - XML: Start document: iteration 2
Sat 18 Jan 2014 01:23:17 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:23:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 01:23:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:23:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:23:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:23:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:23:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:23:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:23:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:23:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:23:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:23:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:23:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:23:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:23:31 - XML: Processed 655482 elements - found 638 jobs
Sat 18 Jan 2014 01:23:31 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 01:23:31 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 01:23:31 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:23:31 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:23:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:23:32 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:23:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:23:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:23:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:23:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:23:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:23:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:23:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:23:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43771695
Sat 18 Jan 2014 01:23:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:23:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43771695
Sat 18 Jan 2014 01:23:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:23:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:23:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:23:46 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:23:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:23:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:23:46 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:23:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:23:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:23:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:23:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:23:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:23:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:23:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:23:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:23:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:23:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:23:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:23:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:23:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:23:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:23:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:23:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:23:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:23:54 - job_xml_thread(): Done retrieving: data size 43213291
Sat 18 Jan 2014 01:23:54 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:23:54 - XML: Start document: iteration 3
Sat 18 Jan 2014 01:23:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43213291
Sat 18 Jan 2014 01:23:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43213291
Sat 18 Jan 2014 01:23:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:23:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:24:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:24:00 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:24:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:24:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 01:24:01 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:24:01 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:24:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 01:24:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9356 values 147582 bits 18447 bytes 
Sat 18 Jan 2014 01:24:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:24:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:24:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:24:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:24:07 - XML: Processed 647514 elements - found 638 jobs
Sat 18 Jan 2014 01:24:07 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 01:24:07 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 01:24:07 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:24:07 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:24:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:24:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:24:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:24:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:24:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:24:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:24:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:24:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:24:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:24:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:24:18 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:24:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:24:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:24:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:24:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:24:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:24:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:24:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:24:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43251313
Sat 18 Jan 2014 01:24:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:24:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43251313
Sat 18 Jan 2014 01:24:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:24:22 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:24:22 - job_xml_thread(): Done retrieving: data size 43251313
Sat 18 Jan 2014 01:24:22 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:24:22 - XML: Start document: iteration 4
Sat 18 Jan 2014 01:24:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:24:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:24:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:24:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:24:36 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:24:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 01:24:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:24:36 - XML: Processed 647938 elements - found 638 jobs
Sat 18 Jan 2014 01:24:36 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 01:24:36 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 01:24:36 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:24:36 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:24:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:24:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:24:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:24:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:24:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:24:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:24:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:24:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:24:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:24:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:24:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:24:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:24:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:24:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:24:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:24:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:24:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:24:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:24:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43792277
Sat 18 Jan 2014 01:24:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:24:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43792277
Sat 18 Jan 2014 01:24:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:24:51 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:24:51 - job_xml_thread(): Done retrieving: data size 43792277
Sat 18 Jan 2014 01:24:51 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:24:52 - XML: Start document: iteration 5
Sat 18 Jan 2014 01:24:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:24:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:25:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:25:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:25:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:25:02 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:25:02 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:25:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 01:25:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:25:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 01:25:02 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:25:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6110 values 96434 bits 12054 bytes 
Sat 18 Jan 2014 01:25:05 - XML: Processed 654586 elements - found 638 jobs
Sat 18 Jan 2014 01:25:05 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 01:25:05 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 01:25:05 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:25:05 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:25:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:25:07 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:25:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:25:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:25:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:25:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:25:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:25:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:25:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:25:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:25:11 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:25:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:25:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:25:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:25:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:25:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:25:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:25:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:25:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43878106
Sat 18 Jan 2014 01:25:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:25:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43878106
Sat 18 Jan 2014 01:25:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:25:20 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:25:20 - job_xml_thread(): Done retrieving: data size 43878106
Sat 18 Jan 2014 01:25:20 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:25:20 - XML: Start document: iteration 6
Sat 18 Jan 2014 01:25:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:25:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:25:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:25:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:25:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:25:32 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:25:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:25:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:25:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:25:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:25:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:25:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:25:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:25:34 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:25:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 01:25:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:25:36 - XML: Processed 655482 elements - found 638 jobs
Sat 18 Jan 2014 01:25:36 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 01:25:36 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 01:25:36 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:25:36 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:25:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:25:38 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:25:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:25:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:25:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:25:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:25:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:25:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:25:38 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 01:25:38 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 01:25:38 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:25:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:25:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865436
Sat 18 Jan 2014 01:25:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:25:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43865436
Sat 18 Jan 2014 01:25:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:25:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:25:48 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:25:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:25:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:25:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:25:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:25:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:25:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865436
Sat 18 Jan 2014 01:25:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:25:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:25:51 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:25:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:25:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:25:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:25:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:25:59 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:25:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:25:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:26:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:26:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:26:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:26:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:26:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:26:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:26:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:26:02 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:26:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:26:02 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:26:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 01:26:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 01:26:02 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:26:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5668 values 89362 bits 11170 bytes 
Sat 18 Jan 2014 01:26:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:26:02 - job_xml_thread(): Done retrieving: data size 43844242
Sat 18 Jan 2014 01:26:02 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:26:02 - XML: Start document: iteration 7
Sat 18 Jan 2014 01:26:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43844242
Sat 18 Jan 2014 01:26:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:26:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:26:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:26:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:26:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:26:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:26:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:26:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43844242
Sat 18 Jan 2014 01:26:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:26:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:26:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:26:20 - XML: Processed 655488 elements - found 641 jobs
Sat 18 Jan 2014 01:26:20 - job 7348590 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 01:26:20 - job_xml_thread(): Found 4 updated jobs.
Sat 18 Jan 2014 01:26:20 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 01:26:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:26:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:26:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:26:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:26:22 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Sat 18 Jan 2014 01:26:22 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:26:22 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:26:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:26:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:26:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:26:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:26:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:26:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:26:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:26:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:26:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:26:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:26:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:26:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:26:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:26:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:26:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43896562
Sat 18 Jan 2014 01:26:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:26:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43896562
Sat 18 Jan 2014 01:26:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:26:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:26:38 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:26:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:26:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:26:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:26:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:26:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:26:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:26:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:26:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:26:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:26:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:26:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:26:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:26:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:26:43 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:26:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:26:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:26:44 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:26:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 01:26:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:26:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:26:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:26:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:26:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:26:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:26:45 - job_xml_thread(): Done retrieving: data size 43882976
Sat 18 Jan 2014 01:26:45 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:26:45 - XML: Start document: iteration 8
Sat 18 Jan 2014 01:26:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43882976
Sat 18 Jan 2014 01:26:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43882976
Sat 18 Jan 2014 01:26:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:26:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:26:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:26:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:26:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:26:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:27:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:27:03 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:27:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:27:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 01:27:03 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:27:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5990 values 94475 bits 11809 bytes 
Sat 18 Jan 2014 01:27:03 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:27:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 01:27:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:27:04 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:27:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:27:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:27:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:27:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:27:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:27:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:27:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:27:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:27:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:27:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:27:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:27:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:27:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:27:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:27:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:27:07 - XML: Processed 655480 elements - found 641 jobs
Sat 18 Jan 2014 01:27:07 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 01:27:07 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 01:27:07 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:27:07 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:27:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:27:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43888580
Sat 18 Jan 2014 01:27:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:27:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43888580
Sat 18 Jan 2014 01:27:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:27:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:27:20 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:27:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:27:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:27:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:27:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:27:22 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:27:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:27:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:27:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:27:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:27:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:27:24 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:27:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 01:27:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:27:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:27:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:27:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:27:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:27:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:27:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:27:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:27:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:27:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:27:26 - job_xml_thread(): Done retrieving: data size 43888851
Sat 18 Jan 2014 01:27:26 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:27:26 - XML: Start document: iteration 9
Sat 18 Jan 2014 01:27:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43888851
Sat 18 Jan 2014 01:27:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:27:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43888851
Sat 18 Jan 2014 01:27:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:27:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:27:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:27:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:27:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:27:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:27:43 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:27:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:27:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:27:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:27:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:27:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:27:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:27:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:27:47 - XML: Processed 655486 elements - found 640 jobs
Sat 18 Jan 2014 01:27:47 - job 7348591 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 01:27:47 - job 7348615 appears to have finished
Sat 18 Jan 2014 01:27:47 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 01:27:47 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 01:27:48 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 01:27:48 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:27:48 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:27:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:27:50 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:27:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:27:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:27:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:27:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:27:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:27:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:27:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:27:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43861507
Sat 18 Jan 2014 01:27:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:27:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43861507
Sat 18 Jan 2014 01:27:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:27:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:27:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:27:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:28:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:28:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:28:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:28:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:28:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43861507
Sat 18 Jan 2014 01:28:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:28:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:28:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:28:03 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:28:03 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:28:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:28:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:28:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 01:28:04 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:28:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 01:28:04 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:28:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:28:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:28:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9260 values 146158 bits 18269 bytes 
Sat 18 Jan 2014 01:28:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:28:11 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:28:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:28:12 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:28:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:28:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:28:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:28:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:28:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:28:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:28:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:28:15 - job_xml_thread(): Done retrieving: data size 43862547
Sat 18 Jan 2014 01:28:15 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:28:15 - XML: Start document: iteration 10
Sat 18 Jan 2014 01:28:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862547
Sat 18 Jan 2014 01:28:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:28:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:28:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:28:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:28:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:28:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:28:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862547
Sat 18 Jan 2014 01:28:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:28:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:28:21 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 01:28:21 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:28:22 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:28:22 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 01:28:22 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 01:28:22 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:28:22 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 01:28:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:28:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:28:30 - XML: Processed 655484 elements - found 639 jobs
Sat 18 Jan 2014 01:28:30 - job 7343930 appears to have finished
Sat 18 Jan 2014 01:28:30 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 01:28:30 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 01:28:30 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 01:28:30 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:28:30 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:28:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:28:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sat 18 Jan 2014 01:28:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:28:38 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:28:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:28:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:28:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:28:39 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:28:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:28:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:28:39 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:28:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 01:28:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:28:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:28:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:28:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:28:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:28:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:28:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:28:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:28:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:28:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:28:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:28:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43897526
Sat 18 Jan 2014 01:28:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43897526
Sat 18 Jan 2014 01:28:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:28:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:28:45 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:28:46 - job_xml_thread(): Done retrieving: data size 43897526
Sat 18 Jan 2014 01:28:46 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:28:46 - XML: Start document: iteration 11
Sat 18 Jan 2014 01:28:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:28:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:28:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:28:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:29:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:29:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:29:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:29:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:29:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:29:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:29:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:29:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:29:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:29:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:29:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:29:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:29:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:29:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:29:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:29:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:29:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:29:03 - XML: Processed 655484 elements - found 639 jobs
Sat 18 Jan 2014 01:29:03 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 01:29:03 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 01:29:03 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:29:03 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:29:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:29:04 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:29:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:29:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 01:29:04 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:29:04 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:29:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5983 values 94410 bits 11801 bytes 
Sat 18 Jan 2014 01:29:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 01:29:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:29:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43869009
Sat 18 Jan 2014 01:29:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:29:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43869009
Sat 18 Jan 2014 01:29:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:29:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:29:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:29:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:29:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:29:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:29:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:29:18 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:29:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:29:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:29:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:29:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:29:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:29:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:29:20 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:29:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:29:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:29:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:29:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:29:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:29:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:29:21 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:29:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 01:29:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:29:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:29:22 - job_xml_thread(): Done retrieving: data size 43806547
Sat 18 Jan 2014 01:29:22 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:29:22 - XML: Start document: iteration 12
Sat 18 Jan 2014 01:29:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43806547
Sat 18 Jan 2014 01:29:23 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:29:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:29:23 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:29:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43806547
Sat 18 Jan 2014 01:29:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:29:25 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:29:25 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 01:29:25 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:29:26 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 01:29:26 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 01:29:32 - size of cluster 'LISA Cluster': 624 hosts 79466 metrics 843086 values 13297148 bits 1662143 bytes 
Sat 18 Jan 2014 01:29:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:29:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:29:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:29:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:29:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:29:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:29:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:29:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:29:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:29:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:29:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:29:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:29:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:29:44 - XML: Processed 654736 elements - found 639 jobs
Sat 18 Jan 2014 01:29:44 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 01:29:44 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 01:29:44 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:29:44 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:29:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:29:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:29:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:29:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:29:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:29:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:29:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:29:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:29:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:29:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43269142
Sat 18 Jan 2014 01:29:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:29:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43269142
Sat 18 Jan 2014 01:29:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:29:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:29:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:29:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:29:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:29:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:29:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:29:59 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:29:59 - job_xml_thread(): Done retrieving: data size 43269142
Sat 18 Jan 2014 01:29:59 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:29:59 - XML: Start document: iteration 13
Sat 18 Jan 2014 01:29:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:29:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:29:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:29:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:29:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43269142
Sat 18 Jan 2014 01:29:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:30:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:30:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:30:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:30:05 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:30:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:30:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 01:30:05 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:30:05 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:30:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 01:30:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7628 values 120330 bits 15041 bytes 
Sat 18 Jan 2014 01:30:13 - XML: Processed 648500 elements - found 638 jobs
Sat 18 Jan 2014 01:30:13 - job 7348408 appears to have finished
Sat 18 Jan 2014 01:30:13 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 01:30:13 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 01:30:13 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 01:30:13 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:30:13 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:30:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:30:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:30:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:30:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:30:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:30:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:30:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:30:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:30:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:30:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:30:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:30:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:30:19 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:30:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:30:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:30:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:30:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:30:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:30:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:30:23 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:30:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 01:30:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:30:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:30:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43269081
Sat 18 Jan 2014 01:30:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:30:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43269081
Sat 18 Jan 2014 01:30:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:30:26 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:30:26 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 01:30:29 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:30:29 - job_xml_thread(): Done retrieving: data size 43269081
Sat 18 Jan 2014 01:30:31 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:30:31 - XML: Start document: iteration 14
Sat 18 Jan 2014 01:30:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:30:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:30:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:30:33 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:30:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:30:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:30:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:30:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:30:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:30:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:30:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:30:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:30:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:30:44 - XML: Processed 648030 elements - found 638 jobs
Sat 18 Jan 2014 01:30:44 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 01:30:44 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 01:30:44 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:30:44 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:30:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:30:46 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:30:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:30:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:30:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:30:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:30:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:30:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:30:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:30:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43786517
Sat 18 Jan 2014 01:30:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:30:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43786517
Sat 18 Jan 2014 01:30:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:30:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:30:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:30:59 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:30:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:31:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:31:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:31:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:31:03 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:31:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:31:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:31:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:31:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:31:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:31:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:31:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:31:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:31:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:31:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:31:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:31:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:31:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:31:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:31:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:31:06 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:31:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:31:06 - job_xml_thread(): Done retrieving: data size 43857690
Sat 18 Jan 2014 01:31:06 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:31:06 - XML: Start document: iteration 15
Sat 18 Jan 2014 01:31:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43857690
Sat 18 Jan 2014 01:31:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43857690
Sat 18 Jan 2014 01:31:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:31:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:31:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:31:07 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:31:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 01:31:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 01:31:07 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:31:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99120 bits 12390 bytes 
Sat 18 Jan 2014 01:31:17 - XML: Processed 655482 elements - found 638 jobs
Sat 18 Jan 2014 01:31:17 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 01:31:17 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 01:31:17 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:31:17 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:31:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:31:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:31:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:31:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:31:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:31:28 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:31:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:31:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:31:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:31:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:31:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:31:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:31:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:31:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:31:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:31:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:31:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:31:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:31:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:31:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:31:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:31:32 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:31:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:31:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875081
Sat 18 Jan 2014 01:31:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:31:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875081
Sat 18 Jan 2014 01:31:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:31:33 - job_xml_thread(): Done retrieving: data size 43875081
Sat 18 Jan 2014 01:31:33 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:31:33 - XML: Start document: iteration 16
Sat 18 Jan 2014 01:31:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:31:42 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:31:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:31:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:31:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:31:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:31:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:31:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:31:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:31:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:31:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:31:50 - XML: Processed 655479 elements - found 639 jobs
Sat 18 Jan 2014 01:31:50 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 01:31:50 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:31:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 01:31:50 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 01:31:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:31:50 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 01:31:50 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:31:50 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:31:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:31:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:31:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:31:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:31:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:31:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:31:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:31:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:31:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:31:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43874694
Sat 18 Jan 2014 01:31:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:31:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43874694
Sat 18 Jan 2014 01:31:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:32:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:32:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:32:05 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:32:05 - job_xml_thread(): Done retrieving: data size 43874694
Sat 18 Jan 2014 01:32:05 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:32:05 - XML: Start document: iteration 17
Sat 18 Jan 2014 01:32:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:32:07 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:32:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:32:08 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:32:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:32:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:32:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:32:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:32:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:32:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:32:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:32:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:32:09 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:32:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 01:32:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 01:32:09 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:32:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6283 values 99339 bits 12417 bytes 
Sat 18 Jan 2014 01:32:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:32:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:32:20 - XML: Processed 655482 elements - found 638 jobs
Sat 18 Jan 2014 01:32:20 - job 7348720 appears to have finished
Sat 18 Jan 2014 01:32:20 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 01:32:20 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 01:32:20 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 01:32:20 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:32:20 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:32:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:32:21 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:32:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:32:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:32:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:32:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:32:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:32:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:32:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:32:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:32:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:32:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43846569
Sat 18 Jan 2014 01:32:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:32:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43846569
Sat 18 Jan 2014 01:32:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:32:35 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:32:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:32:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:32:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:32:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:32:38 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:32:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:32:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:32:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:32:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:32:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:32:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:32:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:32:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:32:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:32:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:32:40 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:32:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 01:32:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:32:41 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 01:32:41 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 01:32:41 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:32:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:32:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:32:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:32:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:32:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:32:42 - job_xml_thread(): Done retrieving: data size 43881815
Sat 18 Jan 2014 01:32:42 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:32:42 - XML: Start document: iteration 18
Sat 18 Jan 2014 01:32:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43881815
Sat 18 Jan 2014 01:32:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43881815
Sat 18 Jan 2014 01:32:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:32:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:32:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:32:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:32:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:32:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:32:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:32:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:32:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:32:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:32:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:32:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:32:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:32:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:32:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:33:02 - XML: Processed 655479 elements - found 638 jobs
Sat 18 Jan 2014 01:33:02 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 01:33:02 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 01:33:02 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:33:02 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:33:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:33:05 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:33:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:33:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:33:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:33:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:33:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:33:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:33:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:33:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43859248
Sat 18 Jan 2014 01:33:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:33:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43859248
Sat 18 Jan 2014 01:33:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:33:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:33:10 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:33:11 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:33:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 01:33:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:33:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 01:33:11 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:33:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9252 values 146405 bits 18300 bytes 
Sat 18 Jan 2014 01:33:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:33:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:33:17 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:33:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:33:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:33:19 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:33:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:33:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:33:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:33:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:33:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:33:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:33:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:33:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:33:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:33:22 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:33:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:33:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:33:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:33:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:33:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:33:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:33:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:33:25 - job_xml_thread(): Done retrieving: data size 43867817
Sat 18 Jan 2014 01:33:25 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:33:25 - XML: Start document: iteration 19
Sat 18 Jan 2014 01:33:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43867817
Sat 18 Jan 2014 01:33:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:33:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867817
Sat 18 Jan 2014 01:33:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:33:35 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:33:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 01:33:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:33:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:33:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:33:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:33:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:33:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:33:39 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:33:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:33:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:33:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:33:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:33:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:33:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:33:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:33:44 - XML: Processed 655482 elements - found 638 jobs
Sat 18 Jan 2014 01:33:44 - job 7335221 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:44 - job 7335220 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:44 - job 7335223 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:44 - job 7335222 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:44 - job 7335225 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:44 - job 7335224 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:44 - job 7335227 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:44 - job 7335226 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:44 - job 7335229 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:44 - job 7335228 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:44 - job 7339776 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:44 - job 7341721 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:44 - job 7340333 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:44 - job 7340330 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:44 - job 7340337 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:44 - job 7340484 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:44 - job 7337749 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:44 - job 7337590 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:44 - job 7343918 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:44 - job 7344401 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:44 - job 7344400 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:44 - job 7344403 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:44 - job 7344402 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:44 - job 7344405 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:44 - job 7344404 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:44 - job 7344407 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:44 - job 7344406 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:44 - job 7344409 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:44 - job 7344408 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:44 - job 7343768 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:44 - job 7341823 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:44 - job 7338797 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7338790 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7344356 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7335699 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7348454 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7344351 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7348596 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7348593 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7335365 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7335439 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7348629 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7348628 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7348627 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7348607 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7335239 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7335232 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7335230 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7335231 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7346097 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7344382 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7339993 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7337217 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7344418 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7340781 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7344416 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7344414 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7344415 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7344412 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7344413 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7344410 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7344411 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7338953 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7344354 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7338775 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7343787 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7337863 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7335401 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7335400 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7335403 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7335402 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7335405 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7335404 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7335406 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7348632 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7348633 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7348631 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7335249 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7335248 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7335246 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7348255 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7337345 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7337341 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7336194 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7344419 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7339232 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7344417 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7337500 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7340310 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7336999 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7344427 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7337261 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7344645 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7341893 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7344399 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7344398 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7344016 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7344391 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7344390 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7344393 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7344392 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7344395 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7344394 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7344397 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7344396 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7338806 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7338411 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7340339 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7335485 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7338343 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7348435 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7342415 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7335259 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7335250 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7335254 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7335255 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7340349 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7337272 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7340972 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7345705 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7337799 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7344657 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7337400 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7344571 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7338475 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7338870 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7343952 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7344379 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7344378 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7344373 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7344372 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7344371 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:45 - job 7344370 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7344377 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7344376 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7344375 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7344374 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7344386 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7344387 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7344384 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7344385 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7338572 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7344383 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7344380 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7344381 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7344388 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7344389 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7335544 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7335395 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7335397 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7337899 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7342698 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7335260 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7339484 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7346830 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7347335 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7336565 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7346841 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7337641 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7337640 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7337643 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7337645 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7337646 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7345031 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7344434 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7344435 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:33:46 - job 7344430 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7344431 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7344433 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7345969 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7344368 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7344369 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7344360 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7344361 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7344362 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:33:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:33:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:33:46 - job 7344363 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7344364 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7344365 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7344366 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7344367 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7344440 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7335389 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7335576 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7335273 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7335271 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7335276 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7335376 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7335375 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7335207 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7339391 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7335209 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7335208 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7339156 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7345099 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7341100 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7340351 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7343632 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7343634 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7344425 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7338208 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7344422 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7344421 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7344420 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7344355 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7344426 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7344357 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7344424 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7344423 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7344350 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7344353 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7344352 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7335866 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7344359 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7344358 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7344429 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7344428 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7338514 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7340309 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7348623 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7348690 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7348599 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7348598 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7348597 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7335361 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7348595 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7348594 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7335364 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7348592 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7348609 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7348608 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7348606 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7348605 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7348604 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7348603 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7348602 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7348601 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7348600 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7347695 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7335214 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7335215 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7335216 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7335217 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7335210 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7335211 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7335212 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7335213 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7335218 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7335219 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7339966 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7341063 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7345647 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7344436 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7344437 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7344346 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7344347 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7344432 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7344348 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7344349 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7344438 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7344439 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7343751 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7343472 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7340659 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7338784 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7335903 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7342714 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7335424 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7335423 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7335422 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7335421 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7338025 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7348610 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7348614 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7348611 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7348612 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job 7348613 report time 1390005074 does not match current heartbeat 1390005171 : ignoring job
Sat 18 Jan 2014 01:33:46 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 01:33:46 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 01:33:46 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:33:46 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:33:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:33:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:33:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:33:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:33:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:33:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43860366
Sat 18 Jan 2014 01:33:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:33:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43860366
Sat 18 Jan 2014 01:33:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:33:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:33:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:34:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:34:00 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:34:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:34:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:34:01 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:34:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:34:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:34:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:34:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:34:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:34:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:34:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:34:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:34:02 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:34:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:34:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:34:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:34:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:34:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:34:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:34:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:34:04 - job_xml_thread(): Done retrieving: data size 43870848
Sat 18 Jan 2014 01:34:04 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:34:04 - XML: Start document: iteration 20
Sat 18 Jan 2014 01:34:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870848
Sat 18 Jan 2014 01:34:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870848
Sat 18 Jan 2014 01:34:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:34:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:34:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:34:12 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:34:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:34:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 01:34:13 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:34:14 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:34:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 01:34:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9366 values 147935 bits 18491 bytes 
Sat 18 Jan 2014 01:34:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:34:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:34:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:34:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:34:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:34:25 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:34:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:34:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:34:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:34:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:34:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:34:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:34:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:34:27 - XML: Processed 655482 elements - found 638 jobs
Sat 18 Jan 2014 01:34:27 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 01:34:27 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 01:34:27 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:34:27 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:34:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:34:28 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:34:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:34:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:34:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:34:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:34:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:34:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:34:30 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:34:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 01:34:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:34:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:34:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43874187
Sat 18 Jan 2014 01:34:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:34:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43874187
Sat 18 Jan 2014 01:34:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:34:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:34:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:34:42 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:34:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:34:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:34:43 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:34:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:34:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:34:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:34:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:34:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:34:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:34:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:34:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:34:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:34:46 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:34:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:34:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:34:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:34:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:34:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:34:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:34:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:34:48 - job_xml_thread(): Done retrieving: data size 43869849
Sat 18 Jan 2014 01:34:48 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:34:48 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 01:34:48 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 01:34:48 - Housekeeping: done.
Sat 18 Jan 2014 01:34:48 - XML: Start document: iteration 0
Sat 18 Jan 2014 01:34:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43869849
Sat 18 Jan 2014 01:34:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:34:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43869849
Sat 18 Jan 2014 01:34:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:34:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:35:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:35:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:35:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:35:05 - XML: Processed 655482 elements - found 638 jobs
Sat 18 Jan 2014 01:35:05 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 01:35:05 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 01:35:05 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:35:05 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:35:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:35:07 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:35:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:35:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:35:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:35:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:35:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:35:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:35:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:35:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:35:10 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:35:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:35:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:35:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:35:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:35:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:35:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:35:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:35:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43818866
Sat 18 Jan 2014 01:35:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:35:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43818866
Sat 18 Jan 2014 01:35:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:35:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:35:14 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:35:16 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:35:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:35:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 01:35:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 01:35:16 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:35:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9268 values 146249 bits 18281 bytes 
Sat 18 Jan 2014 01:35:21 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:35:21 - job_xml_thread(): Done retrieving: data size 43818866
Sat 18 Jan 2014 01:35:21 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:35:21 - XML: Start document: iteration 1
Sat 18 Jan 2014 01:35:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:35:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:35:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:35:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:35:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:35:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:35:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:35:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:35:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:35:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:35:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:35:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:35:29 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:35:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:35:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:35:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:35:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:35:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:35:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:35:32 - XML: Processed 654731 elements - found 638 jobs
Sat 18 Jan 2014 01:35:32 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 01:35:32 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 01:35:32 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:35:32 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:35:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:35:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43528021
Sat 18 Jan 2014 01:35:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:35:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43528021
Sat 18 Jan 2014 01:35:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:35:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:35:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:35:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:35:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:35:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:35:46 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:35:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:35:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:35:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:35:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:35:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:35:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:35:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:35:48 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:35:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:35:49 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:35:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:35:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:35:50 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:35:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 01:35:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:35:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:35:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:35:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:35:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:35:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:35:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43221667
Sat 18 Jan 2014 01:35:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:35:52 - job_xml_thread(): Done retrieving: data size 43221667
Sat 18 Jan 2014 01:35:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43221667
Sat 18 Jan 2014 01:35:52 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:35:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:35:52 - XML: Start document: iteration 2
Sat 18 Jan 2014 01:36:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:36:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:36:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:36:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:36:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:36:10 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:36:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:36:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:36:11 - XML: Processed 647460 elements - found 637 jobs
Sat 18 Jan 2014 01:36:11 - job 7348658 appears to have finished
Sat 18 Jan 2014 01:36:11 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 01:36:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:36:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:36:11 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 01:36:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:36:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:36:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:36:11 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 01:36:11 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:36:11 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:36:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:36:13 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:36:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:36:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:36:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:36:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:36:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:36:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:36:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:36:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43262831
Sat 18 Jan 2014 01:36:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:36:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:36:16 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:36:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43262831
Sat 18 Jan 2014 01:36:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:36:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:36:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 01:36:17 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:36:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 01:36:17 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:36:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8840 values 139451 bits 17431 bytes 
Sat 18 Jan 2014 01:36:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:36:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:36:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:36:26 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:36:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:36:27 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:36:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:36:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:36:27 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 01:36:27 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:36:27 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:36:27 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 01:36:27 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:36:27 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 01:36:27 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 01:36:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:36:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:36:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:36:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:36:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:36:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:36:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:36:31 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:36:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:36:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:36:31 - size of cluster 'LISA Cluster': 624 hosts 79482 metrics 816782 values 12903459 bits 1612932 bytes 
Sat 18 Jan 2014 01:36:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:36:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:36:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:36:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:36:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:36:34 - job_xml_thread(): Done retrieving: data size 43665150
Sat 18 Jan 2014 01:36:34 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:36:34 - XML: Start document: iteration 3
Sat 18 Jan 2014 01:36:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43665150
Sat 18 Jan 2014 01:36:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:36:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43665150
Sat 18 Jan 2014 01:36:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:36:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:36:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:36:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:36:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:36:47 - XML: Processed 653054 elements - found 637 jobs
Sat 18 Jan 2014 01:36:47 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 01:36:47 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 01:36:47 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:36:47 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:36:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:36:53 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:36:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:36:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:36:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:36:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:36:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:36:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:36:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:36:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:36:58 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:36:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:36:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:36:58 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:36:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 01:36:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:36:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:36:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:36:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:36:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:37:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:37:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856616
Sat 18 Jan 2014 01:37:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:37:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43856616
Sat 18 Jan 2014 01:37:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:37:03 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:37:03 - job_xml_thread(): Done retrieving: data size 43856616
Sat 18 Jan 2014 01:37:03 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:37:03 - XML: Start document: iteration 4
Sat 18 Jan 2014 01:37:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:37:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:37:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:37:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:37:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:37:18 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:37:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:37:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 01:37:18 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:37:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 01:37:18 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:37:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5679 values 89550 bits 11193 bytes 
Sat 18 Jan 2014 01:37:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:37:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:37:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:37:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:37:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:37:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:37:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:37:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:37:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:37:24 - XML: Processed 655480 elements - found 637 jobs
Sat 18 Jan 2014 01:37:24 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 01:37:24 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 01:37:25 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:37:25 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:37:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:37:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:37:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:37:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:37:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:37:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:37:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:37:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:37:27 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:37:27 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 01:37:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:37:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43877762
Sat 18 Jan 2014 01:37:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:37:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43877762
Sat 18 Jan 2014 01:37:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:37:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:37:39 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:37:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:37:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:37:40 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:37:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:37:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:37:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:37:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:37:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:37:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:37:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:37:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:37:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:37:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:37:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:37:45 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:37:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 01:37:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:37:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:37:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:37:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:37:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:37:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:37:49 - job_xml_thread(): Done retrieving: data size 43858378
Sat 18 Jan 2014 01:37:49 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:37:49 - XML: Start document: iteration 5
Sat 18 Jan 2014 01:37:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858378
Sat 18 Jan 2014 01:37:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:37:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43858378
Sat 18 Jan 2014 01:37:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:37:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:37:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:38:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:38:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:38:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:38:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:38:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:38:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:38:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:38:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:38:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:38:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:38:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:38:08 - XML: Processed 655480 elements - found 637 jobs
Sat 18 Jan 2014 01:38:08 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 01:38:08 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 01:38:08 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:38:08 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:38:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:38:11 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:38:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:38:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:38:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:38:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:38:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:38:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:38:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:38:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873276
Sat 18 Jan 2014 01:38:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:38:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873276
Sat 18 Jan 2014 01:38:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:38:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:38:19 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:38:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:38:20 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:38:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 01:38:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 01:38:20 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:38:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8927 values 140832 bits 17604 bytes 
Sat 18 Jan 2014 01:38:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:38:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:38:23 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:38:23 - job_xml_thread(): Done retrieving: data size 43873276
Sat 18 Jan 2014 01:38:23 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:38:23 - XML: Start document: iteration 6
Sat 18 Jan 2014 01:38:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:38:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:38:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:38:29 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:38:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:38:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:38:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:38:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:38:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:38:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:38:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:38:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:38:35 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:38:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:38:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:38:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:38:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:38:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:38:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:38:37 - XML: Processed 655479 elements - found 637 jobs
Sat 18 Jan 2014 01:38:37 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 01:38:37 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 01:38:37 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:38:37 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:38:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:38:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867442
Sat 18 Jan 2014 01:38:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:38:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43867442
Sat 18 Jan 2014 01:38:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:38:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:38:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:38:48 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:38:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 01:38:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:38:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:38:50 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:38:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:38:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:38:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:38:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:38:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:38:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:38:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:38:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:38:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:38:52 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:38:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:38:57 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:38:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:38:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:38:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:38:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:38:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:38:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:39:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:39:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43872128
Sat 18 Jan 2014 01:39:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:39:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43872128
Sat 18 Jan 2014 01:39:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:39:00 - job_xml_thread(): Done retrieving: data size 43872128
Sat 18 Jan 2014 01:39:00 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:39:00 - XML: Start document: iteration 7
Sat 18 Jan 2014 01:39:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:39:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:39:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:39:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:39:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:39:18 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:39:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:39:18 - XML: Processed 655480 elements - found 637 jobs
Sat 18 Jan 2014 01:39:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:39:18 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 01:39:18 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 01:39:18 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:39:18 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:39:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:39:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:39:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:39:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:39:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:39:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:39:20 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:39:21 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:39:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:39:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 01:39:21 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:39:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 01:39:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6184 values 97555 bits 12194 bytes 
Sat 18 Jan 2014 01:39:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:39:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:39:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:39:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:39:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:39:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:39:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:39:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:39:25 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 01:39:25 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 01:39:25 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:39:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:39:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43868313
Sat 18 Jan 2014 01:39:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:39:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43868313
Sat 18 Jan 2014 01:39:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:39:33 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:39:33 - job_xml_thread(): Done retrieving: data size 43868313
Sat 18 Jan 2014 01:39:33 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:39:33 - XML: Start document: iteration 8
Sat 18 Jan 2014 01:39:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:39:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:39:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:39:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:39:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:39:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:39:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:39:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:39:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:39:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:39:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:39:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:39:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:39:48 - XML: Processed 655480 elements - found 637 jobs
Sat 18 Jan 2014 01:39:48 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 01:39:48 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 01:39:48 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:39:48 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:39:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:39:49 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:39:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:39:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:39:49 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:39:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 01:39:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:39:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:39:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:39:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:39:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:39:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:39:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43841522
Sat 18 Jan 2014 01:39:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:39:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43841522
Sat 18 Jan 2014 01:39:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:39:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:39:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:40:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:40:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:40:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:40:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:40:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:40:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:40:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:40:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:40:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:40:03 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:40:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:40:04 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:40:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:40:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:40:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:40:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:40:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:40:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:40:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:40:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865050
Sat 18 Jan 2014 01:40:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:40:06 - job_xml_thread(): Done retrieving: data size 43865050
Sat 18 Jan 2014 01:40:06 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:40:06 - XML: Start document: iteration 9
Sat 18 Jan 2014 01:40:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43865050
Sat 18 Jan 2014 01:40:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:40:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:40:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:40:18 - XML: Processed 655482 elements - found 638 jobs
Sat 18 Jan 2014 01:40:18 - job 7348659 appears to have finished
Sat 18 Jan 2014 01:40:18 - job_xml_thread(): Found 3 updated jobs.
Sat 18 Jan 2014 01:40:18 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 01:40:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:40:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:40:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:40:21 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Sat 18 Jan 2014 01:40:21 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:40:21 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:40:21 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:40:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:40:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 01:40:21 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:40:21 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:40:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8886 values 140143 bits 17517 bytes 
Sat 18 Jan 2014 01:40:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 01:40:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:40:27 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:40:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:40:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:40:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:40:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:40:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:40:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:40:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:40:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:40:28 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:40:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:40:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:40:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:40:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:40:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:40:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:40:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:40:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867521
Sat 18 Jan 2014 01:40:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:40:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43867521
Sat 18 Jan 2014 01:40:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:40:36 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:40:36 - job_xml_thread(): Done retrieving: data size 43867521
Sat 18 Jan 2014 01:40:36 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:40:36 - XML: Start document: iteration 10
Sat 18 Jan 2014 01:40:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:40:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:40:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:40:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:40:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:40:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:40:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:40:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:40:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:40:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:40:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:40:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:40:49 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:40:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:40:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:40:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:40:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:40:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:40:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:40:52 - XML: Processed 655480 elements - found 638 jobs
Sat 18 Jan 2014 01:40:52 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 01:40:52 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 01:40:52 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:40:52 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:40:53 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:40:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 01:40:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:40:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:40:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858299
Sat 18 Jan 2014 01:40:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:40:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43858299
Sat 18 Jan 2014 01:40:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:40:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:40:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:41:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:41:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:41:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:41:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:41:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:41:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:41:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:41:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:41:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:41:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:41:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:41:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:41:07 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:41:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:41:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:41:07 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:41:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:41:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:41:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:41:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:41:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:41:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43808670
Sat 18 Jan 2014 01:41:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:41:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43808670
Sat 18 Jan 2014 01:41:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:41:09 - job_xml_thread(): Done retrieving: data size 43808670
Sat 18 Jan 2014 01:41:09 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:41:09 - XML: Start document: iteration 11
Sat 18 Jan 2014 01:41:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:41:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:41:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:41:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:41:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:41:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:41:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:41:22 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:41:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:41:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:41:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:41:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:41:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:41:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:41:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 01:41:23 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:41:23 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:41:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:41:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:41:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8621 values 135912 bits 16989 bytes 
Sat 18 Jan 2014 01:41:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 01:41:30 - XML: Processed 654734 elements - found 638 jobs
Sat 18 Jan 2014 01:41:30 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 01:41:30 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 01:41:30 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:41:30 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:41:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:41:33 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:41:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:41:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:41:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:41:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:41:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:41:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:41:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:41:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43768366
Sat 18 Jan 2014 01:41:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:41:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43768366
Sat 18 Jan 2014 01:41:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:41:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:41:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:41:45 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:41:45 - job_xml_thread(): Done retrieving: data size 43768366
Sat 18 Jan 2014 01:41:45 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:41:45 - XML: Start document: iteration 12
Sat 18 Jan 2014 01:41:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:41:46 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:41:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:41:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:41:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:41:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:41:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:41:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:41:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:41:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:41:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:41:53 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:41:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 01:41:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:41:54 - XML: Processed 654722 elements - found 638 jobs
Sat 18 Jan 2014 01:41:54 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 01:41:54 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 01:41:54 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:41:54 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:41:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:41:58 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:41:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:41:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:41:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:41:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:41:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:41:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:42:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:42:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43210565
Sat 18 Jan 2014 01:42:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:42:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43210565
Sat 18 Jan 2014 01:42:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:42:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:42:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:42:09 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:42:09 - job_xml_thread(): Done retrieving: data size 43210565
Sat 18 Jan 2014 01:42:09 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:42:09 - XML: Start document: iteration 13
Sat 18 Jan 2014 01:42:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:42:11 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:42:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:42:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:42:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:42:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:42:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:42:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:42:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:42:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:42:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:42:21 - XML: Processed 647554 elements - found 636 jobs
Sat 18 Jan 2014 01:42:21 - job 7348726 appears to have finished
Sat 18 Jan 2014 01:42:21 - job 7348386 appears to have finished
Sat 18 Jan 2014 01:42:21 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 01:42:21 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 01:42:22 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 01:42:22 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:42:22 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:42:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:42:22 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:42:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:42:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:42:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:42:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:42:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:42:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:42:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:42:23 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:42:23 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:42:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 01:42:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:42:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 01:42:23 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:42:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5702 values 89898 bits 11237 bytes 
Sat 18 Jan 2014 01:42:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:42:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43247246
Sat 18 Jan 2014 01:42:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:42:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43247246
Sat 18 Jan 2014 01:42:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:42:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:42:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:42:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:42:33 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:42:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:42:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:42:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:42:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:42:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:42:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:42:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43247246
Sat 18 Jan 2014 01:42:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:42:37 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:42:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:42:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:42:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:42:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:42:43 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:42:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:42:46 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:42:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:42:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:42:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:42:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:42:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:42:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:42:47 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:42:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 01:42:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:42:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:42:48 - job_xml_thread(): Done retrieving: data size 43809490
Sat 18 Jan 2014 01:42:48 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:42:48 - XML: Start document: iteration 14
Sat 18 Jan 2014 01:42:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43809490
Sat 18 Jan 2014 01:42:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:42:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:42:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:42:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:42:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:42:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43809490
Sat 18 Jan 2014 01:42:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:42:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:42:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:43:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:43:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:43:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:43:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:43:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:43:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:43:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:43:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:43:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:43:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:43:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:43:07 - XML: Processed 655077 elements - found 636 jobs
Sat 18 Jan 2014 01:43:07 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 01:43:08 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 01:43:08 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:43:08 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:43:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:43:10 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:43:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:43:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:43:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:43:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:43:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:43:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:43:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:43:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43872599
Sat 18 Jan 2014 01:43:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:43:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43872599
Sat 18 Jan 2014 01:43:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:43:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:43:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:43:23 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:43:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:43:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:43:24 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:43:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:43:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 01:43:24 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:43:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6985 values 110227 bits 13778 bytes 
Sat 18 Jan 2014 01:43:24 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:43:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 01:43:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:43:24 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:43:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:43:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:43:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:43:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:43:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:43:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:43:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:43:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:43:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:43:27 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:43:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:43:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:43:27 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 01:43:27 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:43:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:43:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:43:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:43:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:43:28 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:43:28 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 01:43:28 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:43:28 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 01:43:28 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 01:43:29 - size of cluster 'LISA Cluster': 624 hosts 79479 metrics 850640 values 13419831 bits 1677478 bytes 
Sat 18 Jan 2014 01:43:31 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:43:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 01:43:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:43:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:43:31 - job_xml_thread(): Done retrieving: data size 43870952
Sat 18 Jan 2014 01:43:31 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:43:31 - XML: Start document: iteration 15
Sat 18 Jan 2014 01:43:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870952
Sat 18 Jan 2014 01:43:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:43:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870952
Sat 18 Jan 2014 01:43:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:43:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:43:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:43:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:43:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:43:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:43:45 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:43:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:43:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:43:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:43:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:43:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:43:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:43:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:43:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:43:54 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:43:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:43:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:43:54 - XML: Processed 655478 elements - found 636 jobs
Sat 18 Jan 2014 01:43:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:43:54 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 01:43:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:43:54 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 01:43:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:43:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:43:54 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:43:54 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:43:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:43:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851712
Sat 18 Jan 2014 01:43:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:43:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851712
Sat 18 Jan 2014 01:43:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:44:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:44:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:44:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:44:07 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:44:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:44:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:44:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:44:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:44:10 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:44:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:44:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:44:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:44:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:44:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:44:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:44:12 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:44:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:44:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:44:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:44:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:44:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:44:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:44:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:44:16 - job_xml_thread(): Done retrieving: data size 43883928
Sat 18 Jan 2014 01:44:16 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:44:16 - XML: Start document: iteration 16
Sat 18 Jan 2014 01:44:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43883928
Sat 18 Jan 2014 01:44:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43883928
Sat 18 Jan 2014 01:44:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:44:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:44:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:44:24 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:44:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:44:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:44:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:44:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 01:44:25 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:44:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148661 bits 18582 bytes 
Sat 18 Jan 2014 01:44:26 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:44:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 01:44:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:44:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:44:28 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:44:28 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 01:44:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:44:38 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:44:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:44:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:44:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:44:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:44:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:44:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:44:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:44:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:44:39 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:44:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:44:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:44:40 - XML: Processed 655476 elements - found 635 jobs
Sat 18 Jan 2014 01:44:40 - job 7348650 appears to have finished
Sat 18 Jan 2014 01:44:40 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 01:44:40 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 01:44:40 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 01:44:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:44:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:44:40 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:44:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:44:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:44:40 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:44:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:44:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43891371
Sat 18 Jan 2014 01:44:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:44:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43891371
Sat 18 Jan 2014 01:44:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:44:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:44:53 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:44:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:44:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:44:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:44:55 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:44:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:44:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:44:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:44:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:44:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:44:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:44:58 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:44:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 01:44:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:44:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:44:59 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:44:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:44:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:44:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:44:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:44:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:44:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:45:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:45:02 - job_xml_thread(): Done retrieving: data size 43860290
Sat 18 Jan 2014 01:45:02 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:45:02 - XML: Start document: iteration 17
Sat 18 Jan 2014 01:45:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43860290
Sat 18 Jan 2014 01:45:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:45:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43860290
Sat 18 Jan 2014 01:45:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:45:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:45:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:45:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:45:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:45:14 - XML: Processed 655468 elements - found 635 jobs
Sat 18 Jan 2014 01:45:14 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 01:45:14 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 01:45:14 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:45:14 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:45:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:45:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:45:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:45:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:45:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:45:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:45:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:45:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:45:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:45:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:45:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:45:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:45:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:45:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:45:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:45:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:45:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:45:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:45:26 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:45:26 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:45:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:45:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 01:45:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 01:45:26 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:45:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5956 values 94042 bits 11755 bytes 
Sat 18 Jan 2014 01:45:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:45:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43879572
Sat 18 Jan 2014 01:45:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:45:29 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:45:29 - job_xml_thread(): Done retrieving: data size 43879572
Sat 18 Jan 2014 01:45:29 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:45:29 - XML: Start document: iteration 18
Sat 18 Jan 2014 01:45:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43879572
Sat 18 Jan 2014 01:45:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:45:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:45:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:45:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:45:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:45:51 - XML: Processed 655470 elements - found 632 jobs
Sat 18 Jan 2014 01:45:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:45:51 - job 7348668 appears to have finished
Sat 18 Jan 2014 01:45:51 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:45:51 - job 7348664 appears to have finished
Sat 18 Jan 2014 01:45:51 - job 7348660 appears to have finished
Sat 18 Jan 2014 01:45:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:45:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:45:51 - job_xml_thread(): Found 3 updated jobs.
Sat 18 Jan 2014 01:45:51 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 01:45:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:45:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:45:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:45:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:45:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:45:52 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Sat 18 Jan 2014 01:45:52 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:45:52 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:45:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:45:53 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:45:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:45:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:45:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:45:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:45:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:45:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:45:55 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:45:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 01:45:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:45:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:45:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43885313
Sat 18 Jan 2014 01:45:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:45:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43885313
Sat 18 Jan 2014 01:45:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:46:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:46:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:46:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:46:07 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:46:07 - job_xml_thread(): Done retrieving: data size 43885313
Sat 18 Jan 2014 01:46:07 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:46:07 - XML: Start document: iteration 19
Sat 18 Jan 2014 01:46:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:46:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:46:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:46:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:46:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:46:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:46:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:46:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:46:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:46:16 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:46:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:46:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:46:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:46:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:46:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:46:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:46:17 - XML: Processed 655482 elements - found 638 jobs
Sat 18 Jan 2014 01:46:17 - job 7348630 appears to have finished
Sat 18 Jan 2014 01:46:17 - job 7348665 appears to have finished
Sat 18 Jan 2014 01:46:17 - job 7348663 appears to have finished
Sat 18 Jan 2014 01:46:17 - job_xml_thread(): Found 12 updated jobs.
Sat 18 Jan 2014 01:46:17 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 01:46:17 - job_xml_thread(): Done storing. succesfully stored: 12 jobs
Sat 18 Jan 2014 01:46:17 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:46:17 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:46:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:46:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43842294
Sat 18 Jan 2014 01:46:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:46:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43842294
Sat 18 Jan 2014 01:46:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:46:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:46:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:46:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:46:26 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:46:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:46:28 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:46:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 01:46:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 01:46:28 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:46:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8001 values 126275 bits 15784 bytes 
Sat 18 Jan 2014 01:46:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:46:30 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:46:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:46:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:46:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:46:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:46:32 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:46:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:46:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:46:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:46:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:46:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:46:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:46:33 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:46:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:46:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:46:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:46:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:46:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:46:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:46:35 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 01:46:35 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 01:46:35 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:46:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:46:35 - job_xml_thread(): Done retrieving: data size 43875685
Sat 18 Jan 2014 01:46:35 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:46:35 - XML: Start document: iteration 20
Sat 18 Jan 2014 01:46:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875685
Sat 18 Jan 2014 01:46:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:46:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875685
Sat 18 Jan 2014 01:46:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:46:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:46:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:46:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:46:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:46:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:46:51 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:46:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:46:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:46:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:46:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:46:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:46:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:46:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:46:54 - XML: Processed 655482 elements - found 638 jobs
Sat 18 Jan 2014 01:46:54 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 01:46:54 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 01:46:54 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:46:54 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:46:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:46:58 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:46:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:46:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:46:58 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:46:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 01:46:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:46:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:46:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:46:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:46:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:47:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:47:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853836
Sat 18 Jan 2014 01:47:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:47:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853836
Sat 18 Jan 2014 01:47:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:47:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:47:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:47:09 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:47:09 - job_xml_thread(): Done retrieving: data size 43853836
Sat 18 Jan 2014 01:47:09 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:47:09 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 01:47:10 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 01:47:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:47:11 - Housekeeping: done.
Sat 18 Jan 2014 01:47:11 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:47:11 - XML: Start document: iteration 0
Sat 18 Jan 2014 01:47:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:47:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:47:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:47:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:47:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:47:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:47:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:47:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:47:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:47:20 - XML: Processed 655482 elements - found 638 jobs
Sat 18 Jan 2014 01:47:20 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 01:47:20 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 01:47:20 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:47:20 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:47:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:47:22 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:47:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:47:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:47:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:47:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:47:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:47:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:47:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:47:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43787635
Sat 18 Jan 2014 01:47:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:47:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43787635
Sat 18 Jan 2014 01:47:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:47:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:47:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:47:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:47:28 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:47:29 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:47:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:47:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 01:47:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 01:47:29 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:47:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9132 values 144484 bits 18060 bytes 
Sat 18 Jan 2014 01:47:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:47:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:47:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:47:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:47:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:47:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:47:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:47:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:47:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:47:35 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:47:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:47:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:47:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:47:40 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:47:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:47:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:47:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:47:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:47:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:47:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:47:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:47:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43285451
Sat 18 Jan 2014 01:47:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:47:43 - job_xml_thread(): Done retrieving: data size 43285451
Sat 18 Jan 2014 01:47:43 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:47:43 - XML: Start document: iteration 1
Sat 18 Jan 2014 01:47:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43285451
Sat 18 Jan 2014 01:47:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:47:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:47:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:47:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:47:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:47:59 - XML: Processed 648134 elements - found 638 jobs
Sat 18 Jan 2014 01:47:59 - job 7348739 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 01:47:59 - job 7348738 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 01:47:59 - job 7348737 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 01:47:59 - job 7348736 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 01:47:59 - job 7348735 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 01:47:59 - job 7348734 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 01:47:59 - job 7348732 field 'start_timestamp' changed since saved from: 1390005928 to: 1390005888
Sat 18 Jan 2014 01:47:59 - job_xml_thread(): Found 7 updated jobs.
Sat 18 Jan 2014 01:47:59 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 01:48:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:48:03 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:48:03 - job_xml_thread(): Done storing. succesfully stored: 7 jobs
Sat 18 Jan 2014 01:48:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:48:03 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:48:03 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:48:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:48:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:48:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:48:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:48:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:48:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:48:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:48:05 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:48:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:48:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:48:05 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:48:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 01:48:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:48:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:48:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:48:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:48:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:48:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:48:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43211139
Sat 18 Jan 2014 01:48:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:48:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43211139
Sat 18 Jan 2014 01:48:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:48:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:48:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:48:18 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:48:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:48:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:48:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:48:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:48:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:48:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:48:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:48:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:48:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:48:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:48:21 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:48:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:48:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:48:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:48:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:48:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:48:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:48:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:48:23 - job_xml_thread(): Done retrieving: data size 43278128
Sat 18 Jan 2014 01:48:23 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:48:23 - XML: Start document: iteration 2
Sat 18 Jan 2014 01:48:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43278128
Sat 18 Jan 2014 01:48:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:48:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43278128
Sat 18 Jan 2014 01:48:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:48:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:48:30 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:48:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:48:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 01:48:31 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:48:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8916 values 140987 bits 17623 bytes 
Sat 18 Jan 2014 01:48:31 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:48:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 01:48:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:48:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:48:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:48:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:48:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:48:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:48:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:48:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:48:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:48:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:48:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:48:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:48:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:48:45 - XML: Processed 648022 elements - found 634 jobs
Sat 18 Jan 2014 01:48:45 - job 7348645 appears to have finished
Sat 18 Jan 2014 01:48:45 - job 7348662 appears to have finished
Sat 18 Jan 2014 01:48:45 - job 7348070 appears to have finished
Sat 18 Jan 2014 01:48:45 - job 7348671 appears to have finished
Sat 18 Jan 2014 01:48:45 - job_xml_thread(): Found 4 updated jobs.
Sat 18 Jan 2014 01:48:45 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 01:48:45 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Sat 18 Jan 2014 01:48:45 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:48:45 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:48:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:48:46 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:48:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:48:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:48:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:48:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:48:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:48:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:48:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:48:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43794723
Sat 18 Jan 2014 01:48:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:48:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43794723
Sat 18 Jan 2014 01:48:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:48:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:48:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:48:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:48:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:48:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:48:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:48:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:48:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:48:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:48:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:48:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:49:00 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:49:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:49:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:49:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:49:02 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:49:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:49:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:49:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:49:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:49:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:49:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:49:03 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:49:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 01:49:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:49:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:49:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43871328
Sat 18 Jan 2014 01:49:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:49:05 - job_xml_thread(): Done retrieving: data size 43871328
Sat 18 Jan 2014 01:49:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43871328
Sat 18 Jan 2014 01:49:05 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:49:05 - XML: Start document: iteration 3
Sat 18 Jan 2014 01:49:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:49:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:49:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:49:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:49:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:49:23 - XML: Processed 655474 elements - found 634 jobs
Sat 18 Jan 2014 01:49:23 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 01:49:23 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 01:49:23 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:49:23 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:49:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:49:26 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:49:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:49:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:49:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:49:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:49:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:49:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:49:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:49:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:49:28 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:49:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:49:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:49:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:49:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:49:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:49:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:49:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:49:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865170
Sat 18 Jan 2014 01:49:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:49:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43865170
Sat 18 Jan 2014 01:49:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:49:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:49:32 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:49:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:49:33 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:49:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 01:49:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 01:49:33 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:49:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8677 values 136879 bits 17109 bytes 
Sat 18 Jan 2014 01:49:39 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:49:39 - job_xml_thread(): Done retrieving: data size 43865170
Sat 18 Jan 2014 01:49:39 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:49:39 - XML: Start document: iteration 4
Sat 18 Jan 2014 01:49:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:49:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:49:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:49:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:49:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:49:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:49:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:49:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:49:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:49:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:49:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:49:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:49:50 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:49:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:49:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:49:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:49:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:49:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:49:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:49:52 - XML: Processed 655474 elements - found 634 jobs
Sat 18 Jan 2014 01:49:52 - job 7348592 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 01:49:52 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 01:49:52 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 01:49:52 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 01:49:52 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:49:52 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:49:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:49:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851105
Sat 18 Jan 2014 01:49:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:49:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851105
Sat 18 Jan 2014 01:49:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:49:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:49:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:50:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:50:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:50:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:50:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:50:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:50:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:50:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:50:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:50:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:50:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:50:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:50:07 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:50:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:50:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:50:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:50:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:50:08 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:50:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 01:50:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:50:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:50:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:50:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:50:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:50:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:50:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43882945
Sat 18 Jan 2014 01:50:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:50:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43882945
Sat 18 Jan 2014 01:50:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:50:11 - job_xml_thread(): Done retrieving: data size 43882945
Sat 18 Jan 2014 01:50:11 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:50:11 - XML: Start document: iteration 5
Sat 18 Jan 2014 01:50:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:50:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:50:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:50:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:50:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:50:27 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:50:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:50:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:50:28 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 01:50:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:50:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:50:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:50:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:50:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:50:28 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:50:29 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:50:29 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:50:29 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 01:50:29 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 01:50:29 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 01:50:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:50:29 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:50:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:50:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:50:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:50:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:50:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:50:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:50:32 - XML: Processed 655474 elements - found 634 jobs
Sat 18 Jan 2014 01:50:32 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 01:50:32 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 01:50:32 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:50:32 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:50:33 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 850295 values 13434705 bits 1679338 bytes 
Sat 18 Jan 2014 01:50:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:50:33 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:50:34 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:50:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:50:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 01:50:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 01:50:34 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:50:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6100 values 96251 bits 12031 bytes 
Sat 18 Jan 2014 01:50:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:50:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43860165
Sat 18 Jan 2014 01:50:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:50:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43860165
Sat 18 Jan 2014 01:50:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:50:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:50:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:50:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:50:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:50:47 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:50:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:50:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:50:48 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:50:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:50:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:50:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:50:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:50:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:50:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:50:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:50:53 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:50:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:50:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:50:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:50:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:50:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:50:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:50:54 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:50:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 01:50:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:50:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:50:56 - job_xml_thread(): Done retrieving: data size 43874564
Sat 18 Jan 2014 01:50:56 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:50:56 - XML: Start document: iteration 6
Sat 18 Jan 2014 01:50:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43874564
Sat 18 Jan 2014 01:50:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:50:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43874564
Sat 18 Jan 2014 01:50:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:51:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:51:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:51:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:51:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:51:10 - XML: Processed 655474 elements - found 634 jobs
Sat 18 Jan 2014 01:51:11 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 01:51:11 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 01:51:11 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:51:11 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:51:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:51:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:51:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:51:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:51:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:51:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:51:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:51:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:51:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:51:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:51:16 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:51:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:51:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:51:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:51:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:51:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:51:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:51:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:51:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865686
Sat 18 Jan 2014 01:51:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:51:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43865686
Sat 18 Jan 2014 01:51:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:51:26 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:51:26 - job_xml_thread(): Done retrieving: data size 43865686
Sat 18 Jan 2014 01:51:26 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:51:27 - XML: Start document: iteration 7
Sat 18 Jan 2014 01:51:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:51:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:51:29 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:51:29 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 01:51:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:51:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:51:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:51:34 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:51:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:51:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:51:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:51:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:51:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:51:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:51:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:51:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:51:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:51:34 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:51:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 01:51:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:51:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 01:51:34 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:51:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8063 values 127166 bits 15895 bytes 
Sat 18 Jan 2014 01:51:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:51:38 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:51:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:51:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:51:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:51:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:51:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:51:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:51:39 - XML: Processed 655472 elements - found 634 jobs
Sat 18 Jan 2014 01:51:39 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 01:51:39 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 01:51:39 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:51:39 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:51:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:51:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875805
Sat 18 Jan 2014 01:51:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:51:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875805
Sat 18 Jan 2014 01:51:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:51:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:51:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:51:54 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:51:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:51:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:51:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:51:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:51:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:51:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:51:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:51:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:51:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:51:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:51:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:51:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:51:58 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:51:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:51:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:51:59 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:51:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 01:51:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:51:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:51:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:51:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:51:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:52:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:52:01 - job_xml_thread(): Done retrieving: data size 43860159
Sat 18 Jan 2014 01:52:01 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:52:01 - XML: Start document: iteration 8
Sat 18 Jan 2014 01:52:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43860159
Sat 18 Jan 2014 01:52:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:52:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43860159
Sat 18 Jan 2014 01:52:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:52:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:52:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:52:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:52:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:52:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:52:20 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:52:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:52:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:52:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:52:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:52:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:52:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:52:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:52:22 - XML: Processed 655470 elements - found 632 jobs
Sat 18 Jan 2014 01:52:22 - job 7337217 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 01:52:22 - job 7348409 appears to have finished
Sat 18 Jan 2014 01:52:22 - job 7348670 appears to have finished
Sat 18 Jan 2014 01:52:22 - job 7344346 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 01:52:22 - job_xml_thread(): Found 4 updated jobs.
Sat 18 Jan 2014 01:52:22 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 01:52:24 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Sat 18 Jan 2014 01:52:24 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:52:24 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:52:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:52:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:52:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:52:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:52:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:52:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:52:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:52:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:52:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:52:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43881106
Sat 18 Jan 2014 01:52:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:52:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43881106
Sat 18 Jan 2014 01:52:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:52:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:52:34 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:52:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:52:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:52:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:52:37 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:52:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 01:52:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 01:52:37 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:52:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8800 values 138785 bits 17348 bytes 
Sat 18 Jan 2014 01:52:39 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:52:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:52:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:52:39 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:52:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:52:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:52:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:52:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:52:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:52:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:52:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:52:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:52:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:52:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:52:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:52:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:52:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:52:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:52:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:52:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:52:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:52:49 - job_xml_thread(): Done retrieving: data size 43847885
Sat 18 Jan 2014 01:52:49 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:52:49 - XML: Start document: iteration 9
Sat 18 Jan 2014 01:52:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43847885
Sat 18 Jan 2014 01:52:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:52:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43847885
Sat 18 Jan 2014 01:52:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:52:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:52:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:53:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:53:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:53:07 - XML: Processed 655470 elements - found 632 jobs
Sat 18 Jan 2014 01:53:07 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 01:53:07 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 01:53:07 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:53:07 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:53:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:53:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:53:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:53:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:53:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:53:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:53:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:53:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:53:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:53:11 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:53:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 01:53:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:53:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:53:13 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:53:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:53:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:53:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:53:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:53:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:53:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:53:15 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 01:53:15 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 01:53:15 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:53:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:53:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43807617
Sat 18 Jan 2014 01:53:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:53:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43807617
Sat 18 Jan 2014 01:53:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:53:23 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:53:23 - job_xml_thread(): Done retrieving: data size 43807617
Sat 18 Jan 2014 01:53:23 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:53:23 - XML: Start document: iteration 10
Sat 18 Jan 2014 01:53:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:53:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:53:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:53:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:53:33 - XML: Processed 654722 elements - found 632 jobs
Sat 18 Jan 2014 01:53:33 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 01:53:33 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 01:53:33 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:53:33 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:53:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:53:33 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:53:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:53:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:53:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:53:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:53:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:53:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:53:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:53:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:53:37 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:53:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:53:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:53:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:53:37 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:53:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:53:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:53:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:53:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:53:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:53:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 01:53:37 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:53:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 01:53:37 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:53:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5986 values 94444 bits 11805 bytes 
Sat 18 Jan 2014 01:53:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:53:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43298509
Sat 18 Jan 2014 01:53:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:53:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43298509
Sat 18 Jan 2014 01:53:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:53:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:53:48 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:53:48 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:53:48 - job_xml_thread(): Done retrieving: data size 43298509
Sat 18 Jan 2014 01:53:48 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:53:48 - XML: Start document: iteration 11
Sat 18 Jan 2014 01:53:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:53:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:53:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:53:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:53:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:53:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:53:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:53:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:53:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:53:58 - XML: Processed 648380 elements - found 637 jobs
Sat 18 Jan 2014 01:53:58 - job_xml_thread(): Found 5 updated jobs.
Sat 18 Jan 2014 01:53:58 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 01:53:59 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Sat 18 Jan 2014 01:53:59 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:53:59 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:54:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:54:01 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:54:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:54:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:54:01 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:54:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 01:54:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:54:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:54:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:54:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:54:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:54:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:54:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43180023
Sat 18 Jan 2014 01:54:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:54:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43180023
Sat 18 Jan 2014 01:54:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:54:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:54:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:54:14 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:54:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:54:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:54:15 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:54:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:54:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:54:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:54:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:54:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:54:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:54:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:54:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:54:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:54:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:54:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:54:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:54:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:54:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:54:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:54:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:54:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:54:18 - job_xml_thread(): Done retrieving: data size 43271454
Sat 18 Jan 2014 01:54:18 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:54:18 - XML: Start document: iteration 12
Sat 18 Jan 2014 01:54:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43271454
Sat 18 Jan 2014 01:54:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:54:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43271454
Sat 18 Jan 2014 01:54:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:54:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:54:31 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:54:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:54:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:54:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:54:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:54:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:54:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:54:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:54:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:54:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:54:37 - XML: Processed 648024 elements - found 635 jobs
Sat 18 Jan 2014 01:54:37 - job 7348742 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 01:54:37 - job 7348743 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 01:54:37 - job 7348741 field 'start_timestamp' changed since saved from: 1390006396 to: 1390006336
Sat 18 Jan 2014 01:54:37 - job 7348744 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 01:54:37 - job 7348740 field 'start_timestamp' changed since saved from: 1390006394 to: 1390006336
Sat 18 Jan 2014 01:54:37 - job 7348672 appears to have finished
Sat 18 Jan 2014 01:54:37 - job 7344343 appears to have finished
Sat 18 Jan 2014 01:54:37 - job_xml_thread(): Found 7 updated jobs.
Sat 18 Jan 2014 01:54:37 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 01:54:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:54:37 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:54:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:54:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 01:54:38 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:54:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 01:54:38 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:54:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8505 values 134090 bits 16761 bytes 
Sat 18 Jan 2014 01:54:38 - job_xml_thread(): Done storing. succesfully stored: 7 jobs
Sat 18 Jan 2014 01:54:38 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:54:38 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:54:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:54:40 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:54:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:54:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:54:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:54:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:54:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:54:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:54:42 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:54:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 01:54:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:54:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:54:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43709700
Sat 18 Jan 2014 01:54:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:54:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43709700
Sat 18 Jan 2014 01:54:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:54:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:54:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:54:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:54:53 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:54:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:54:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:54:53 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:54:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:54:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:54:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:54:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:54:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:54:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:54:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:54:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:54:57 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:54:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:54:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:54:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:54:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:54:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:54:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:54:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:54:59 - job_xml_thread(): Done retrieving: data size 43848234
Sat 18 Jan 2014 01:54:59 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:54:59 - XML: Start document: iteration 13
Sat 18 Jan 2014 01:54:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43848234
Sat 18 Jan 2014 01:54:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:54:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43848234
Sat 18 Jan 2014 01:54:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:55:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:55:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:55:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:55:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:55:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:55:14 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:55:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:55:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:55:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:55:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:55:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:55:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:55:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:55:21 - XML: Processed 655190 elements - found 635 jobs
Sat 18 Jan 2014 01:55:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:55:21 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:55:21 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 01:55:21 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 01:55:21 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:55:21 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:55:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:55:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:55:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:55:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:55:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:55:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:55:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:55:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855809
Sat 18 Jan 2014 01:55:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:55:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855809
Sat 18 Jan 2014 01:55:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:55:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:55:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:55:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:55:32 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:55:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:55:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:55:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:55:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:55:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:55:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:55:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:55:36 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:55:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:55:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:55:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:55:37 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:55:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:55:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:55:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:55:38 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:55:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:55:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:55:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:55:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:55:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:55:38 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:55:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 01:55:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 01:55:38 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:55:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148641 bits 18580 bytes 
Sat 18 Jan 2014 01:55:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:55:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43866255
Sat 18 Jan 2014 01:55:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:55:39 - job_xml_thread(): Done retrieving: data size 43866255
Sat 18 Jan 2014 01:55:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43866255
Sat 18 Jan 2014 01:55:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:55:39 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:55:39 - XML: Start document: iteration 14
Sat 18 Jan 2014 01:55:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:55:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:55:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:55:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:55:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:55:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:55:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:55:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:55:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:55:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:55:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:55:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:55:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:55:58 - XML: Processed 655474 elements - found 634 jobs
Sat 18 Jan 2014 01:55:59 - job 7348742 field 'status' changed since saved from: Q to: R
Sat 18 Jan 2014 01:55:59 - job 7348743 field 'status' changed since saved from: Q to: R
Sat 18 Jan 2014 01:55:59 - job 7348744 field 'status' changed since saved from: Q to: R
Sat 18 Jan 2014 01:55:59 - job 7348656 appears to have finished
Sat 18 Jan 2014 01:55:59 - job_xml_thread(): Found 4 updated jobs.
Sat 18 Jan 2014 01:55:59 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 01:55:59 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Sat 18 Jan 2014 01:55:59 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:55:59 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:56:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:56:02 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:56:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:56:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:56:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:56:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:56:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:56:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:56:03 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:56:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 01:56:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:56:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:56:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43849672
Sat 18 Jan 2014 01:56:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:56:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43849672
Sat 18 Jan 2014 01:56:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:56:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:56:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:56:14 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:56:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:56:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:56:15 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:56:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:56:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:56:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:56:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:56:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:56:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:56:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:56:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:56:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:56:18 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:56:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:56:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:56:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:56:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:56:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:56:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:56:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:56:20 - job_xml_thread(): Done retrieving: data size 43874375
Sat 18 Jan 2014 01:56:20 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:56:20 - XML: Start document: iteration 15
Sat 18 Jan 2014 01:56:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43874375
Sat 18 Jan 2014 01:56:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:56:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43874375
Sat 18 Jan 2014 01:56:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:56:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:56:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:56:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:56:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:56:36 - XML: Processed 655474 elements - found 634 jobs
Sat 18 Jan 2014 01:56:36 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 01:56:36 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 01:56:36 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:56:36 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:56:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:56:38 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:56:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:56:38 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:56:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 01:56:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 01:56:38 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:56:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6790 values 107106 bits 13388 bytes 
Sat 18 Jan 2014 01:56:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:56:39 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:56:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:56:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:56:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:56:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:56:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:56:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:56:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:56:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:56:41 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:56:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:56:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:56:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:56:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:56:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:56:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:56:43 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:56:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 01:56:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:56:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:56:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43884448
Sat 18 Jan 2014 01:56:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:56:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43884448
Sat 18 Jan 2014 01:56:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:56:51 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:56:51 - job_xml_thread(): Done retrieving: data size 43884448
Sat 18 Jan 2014 01:56:51 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:56:51 - XML: Start document: iteration 16
Sat 18 Jan 2014 01:56:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:56:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:56:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:56:56 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:56:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:56:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:56:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:56:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:56:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:56:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:56:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:56:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:56:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:57:02 - XML: Processed 655474 elements - found 634 jobs
Sat 18 Jan 2014 01:57:02 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 01:57:02 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 01:57:02 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:57:02 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:57:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:57:04 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:57:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:57:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:57:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:57:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:57:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:57:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:57:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:57:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43864839
Sat 18 Jan 2014 01:57:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:57:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43864839
Sat 18 Jan 2014 01:57:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:57:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:57:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:57:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:57:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:57:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:57:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:57:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:57:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:57:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:57:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:57:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:57:18 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:57:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:57:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:57:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:57:20 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:57:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:57:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:57:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:57:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:57:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:57:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:57:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:57:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43878565
Sat 18 Jan 2014 01:57:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:57:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43878565
Sat 18 Jan 2014 01:57:23 - job_xml_thread(): Done retrieving: data size 43878565
Sat 18 Jan 2014 01:57:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:57:23 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:57:23 - XML: Start document: iteration 17
Sat 18 Jan 2014 01:57:30 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 01:57:30 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:57:31 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:57:31 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:57:31 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 01:57:31 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 01:57:32 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 01:57:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:57:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:57:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:57:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:57:38 - XML: Processed 655474 elements - found 634 jobs
Sat 18 Jan 2014 01:57:38 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 01:57:38 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 01:57:38 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:57:38 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:57:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:57:39 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:57:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:57:39 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:57:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 01:57:39 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:57:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 01:57:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148666 bits 18583 bytes 
Sat 18 Jan 2014 01:57:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:57:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:57:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:57:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:57:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:57:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:57:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sat 18 Jan 2014 01:57:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:57:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:57:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:57:46 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:57:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:57:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:57:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:57:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:57:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:57:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:57:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:57:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873701
Sat 18 Jan 2014 01:57:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:57:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873701
Sat 18 Jan 2014 01:57:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:57:54 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:57:54 - job_xml_thread(): Done retrieving: data size 43873701
Sat 18 Jan 2014 01:57:54 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:57:55 - XML: Start document: iteration 18
Sat 18 Jan 2014 01:57:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:57:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:58:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:58:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:58:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:58:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:58:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:58:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:58:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:58:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:58:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:58:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:58:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:58:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:58:07 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:58:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:58:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:58:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:58:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:58:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:58:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:58:10 - XML: Processed 655472 elements - found 633 jobs
Sat 18 Jan 2014 01:58:10 - job 7348680 appears to have finished
Sat 18 Jan 2014 01:58:10 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 01:58:10 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 01:58:10 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 01:58:10 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:58:10 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:58:11 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:58:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 01:58:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:58:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:58:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43877216
Sat 18 Jan 2014 01:58:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:58:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43877216
Sat 18 Jan 2014 01:58:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:58:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:58:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:58:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:58:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:58:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:58:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:58:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:58:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:58:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:58:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:58:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:58:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:58:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:58:25 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:58:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:58:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:58:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:58:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:58:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:58:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:58:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:58:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:58:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:58:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873775
Sat 18 Jan 2014 01:58:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:58:28 - job_xml_thread(): Done retrieving: data size 43873775
Sat 18 Jan 2014 01:58:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873775
Sat 18 Jan 2014 01:58:29 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:58:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:58:29 - XML: Start document: iteration 19
Sat 18 Jan 2014 01:58:32 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:58:32 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:58:33 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:58:33 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 01:58:33 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 01:58:34 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:58:34 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 01:58:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:58:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:58:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:58:39 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:58:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:58:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:58:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:58:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:58:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:58:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:58:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:58:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:58:40 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:58:41 - size of cluster 'LISA Cluster': 624 hosts 79469 metrics 908275 values 14329546 bits 1791193 bytes 
Sat 18 Jan 2014 01:58:41 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:58:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 01:58:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:58:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 01:58:41 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:58:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8595 values 135519 bits 16939 bytes 
Sat 18 Jan 2014 01:58:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:58:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:58:48 - XML: Processed 655472 elements - found 633 jobs
Sat 18 Jan 2014 01:58:48 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 01:58:48 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 01:58:48 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:58:48 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:58:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:58:50 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:58:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:58:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:58:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:58:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:58:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:58:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:58:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:58:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856898
Sat 18 Jan 2014 01:58:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:58:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:58:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43856898
Sat 18 Jan 2014 01:58:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:58:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:59:03 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:59:03 - job_xml_thread(): Done retrieving: data size 43856898
Sat 18 Jan 2014 01:59:03 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:59:03 - XML: Start document: iteration 20
Sat 18 Jan 2014 01:59:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:59:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:59:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:59:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:59:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:59:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:59:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:59:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:59:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:59:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:59:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:59:18 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:59:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 01:59:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:59:19 - XML: Processed 655472 elements - found 633 jobs
Sat 18 Jan 2014 01:59:19 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 01:59:20 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 01:59:20 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 01:59:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:59:20 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 01:59:20 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:59:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:59:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:59:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:59:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:59:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:59:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:59:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:59:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:59:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:59:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43768767
Sat 18 Jan 2014 01:59:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:59:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43768767
Sat 18 Jan 2014 01:59:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:59:34 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:59:34 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 01:59:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:59:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:59:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 01:59:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:59:35 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 01:59:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 01:59:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:59:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:59:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 01:59:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 01:59:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:59:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:59:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 01:59:39 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 01:59:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 01:59:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 01:59:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:59:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 01:59:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 01:59:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 01:59:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:59:41 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 01:59:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:59:41 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 01:59:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 01:59:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 01:59:41 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 01:59:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5723 values 90231 bits 11278 bytes 
Sat 18 Jan 2014 01:59:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 01:59:42 - job_xml_thread(): Done retrieving: data size 43284056
Sat 18 Jan 2014 01:59:42 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 01:59:42 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 01:59:42 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 01:59:42 - Housekeeping: done.
Sat 18 Jan 2014 01:59:42 - XML: Start document: iteration 0
Sat 18 Jan 2014 01:59:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43284056
Sat 18 Jan 2014 01:59:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 01:59:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43284056
Sat 18 Jan 2014 01:59:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 01:59:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 01:59:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:59:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 01:59:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 01:59:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 01:59:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 01:59:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:00:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:00:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:00:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:00:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:00:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:00:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:00:02 - XML: Processed 648194 elements - found 633 jobs
Sat 18 Jan 2014 02:00:02 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:00:02 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:00:02 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:00:02 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:00:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:00:05 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:00:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:00:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:00:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:00:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:00:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:00:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:00:08 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 02:00:08 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 02:00:08 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:00:08 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:00:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 02:00:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:00:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:00:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43201226
Sat 18 Jan 2014 02:00:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:00:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43201226
Sat 18 Jan 2014 02:00:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:00:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:00:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:00:17 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:00:17 - job_xml_thread(): Done retrieving: data size 43201226
Sat 18 Jan 2014 02:00:17 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:00:17 - XML: Start document: iteration 1
Sat 18 Jan 2014 02:00:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:00:19 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:00:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:00:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:00:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:00:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:00:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:00:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:00:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:00:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:00:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:00:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:00:30 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:00:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:00:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:00:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:00:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:00:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:00:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:00:31 - XML: Processed 647276 elements - found 635 jobs
Sat 18 Jan 2014 02:00:31 - job 7344344 appears to have finished
Sat 18 Jan 2014 02:00:31 - job_xml_thread(): Found 4 updated jobs.
Sat 18 Jan 2014 02:00:31 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 02:00:31 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Sat 18 Jan 2014 02:00:31 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:00:31 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:00:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:00:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43590745
Sat 18 Jan 2014 02:00:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:00:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43590745
Sat 18 Jan 2014 02:00:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:00:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:00:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:00:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:00:41 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:00:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:00:42 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:00:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 02:00:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 02:00:42 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:00:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7109 values 112133 bits 14016 bytes 
Sat 18 Jan 2014 02:00:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:00:44 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:00:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:00:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:00:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:00:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:00:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:00:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:00:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:00:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:00:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:00:46 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:00:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:00:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:00:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:00:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:00:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:00:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:00:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:00:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:00:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:00:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43805626
Sat 18 Jan 2014 02:00:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:00:50 - job_xml_thread(): Done retrieving: data size 43805626
Sat 18 Jan 2014 02:00:50 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:00:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43805626
Sat 18 Jan 2014 02:00:50 - XML: Start document: iteration 2
Sat 18 Jan 2014 02:00:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:01:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:01:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:01:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:01:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:01:08 - XML: Processed 654782 elements - found 635 jobs
Sat 18 Jan 2014 02:01:08 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:01:09 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:01:09 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:01:09 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:01:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:01:10 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:01:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:01:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:01:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:01:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:01:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:01:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:01:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:01:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:01:13 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:01:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:01:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:01:13 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:01:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 02:01:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:01:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:01:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:01:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:01:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:01:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:01:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43869683
Sat 18 Jan 2014 02:01:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:01:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43869683
Sat 18 Jan 2014 02:01:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:01:24 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:01:24 - job_xml_thread(): Done retrieving: data size 43869683
Sat 18 Jan 2014 02:01:24 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:01:24 - XML: Start document: iteration 3
Sat 18 Jan 2014 02:01:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:01:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:01:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:01:27 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:01:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:01:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:01:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:01:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:01:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:01:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:01:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:01:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:01:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:01:36 - XML: Processed 655476 elements - found 635 jobs
Sat 18 Jan 2014 02:01:36 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:01:36 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:01:36 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:01:36 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:01:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:01:37 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:01:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:01:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:01:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:01:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:01:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:01:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:01:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:01:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855245
Sat 18 Jan 2014 02:01:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:01:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855245
Sat 18 Jan 2014 02:01:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:01:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:01:43 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:01:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:01:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 02:01:44 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:01:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:01:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 02:01:44 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:01:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:01:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8787 values 138695 bits 17336 bytes 
Sat 18 Jan 2014 02:01:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:01:50 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:01:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:01:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:01:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:01:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:01:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:01:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:01:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:01:51 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:01:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:01:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:01:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:01:54 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:01:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:01:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:01:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:01:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:01:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:01:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:01:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:01:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43878286
Sat 18 Jan 2014 02:01:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:01:57 - job_xml_thread(): Done retrieving: data size 43878286
Sat 18 Jan 2014 02:01:57 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:01:57 - XML: Start document: iteration 4
Sat 18 Jan 2014 02:01:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43878286
Sat 18 Jan 2014 02:01:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:02:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:02:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:02:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:02:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:02:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:02:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:02:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:02:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:02:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:02:18 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:02:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:02:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:02:19 - XML: Processed 655468 elements - found 633 jobs
Sat 18 Jan 2014 02:02:19 - job 7348681 appears to have finished
Sat 18 Jan 2014 02:02:19 - job 7348675 appears to have finished
Sat 18 Jan 2014 02:02:19 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 02:02:19 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 02:02:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:02:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:02:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:02:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:02:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:02:19 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 02:02:19 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:02:19 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:02:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:02:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:02:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:02:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:02:20 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:02:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 02:02:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:02:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:02:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43882230
Sat 18 Jan 2014 02:02:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:02:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43882230
Sat 18 Jan 2014 02:02:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:02:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:02:31 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:02:34 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:02:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:02:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:02:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:02:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:02:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:02:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:02:35 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:02:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:02:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:02:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:02:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:02:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:02:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:02:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:02:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:02:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:02:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:02:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:02:36 - job_xml_thread(): Done retrieving: data size 43885059
Sat 18 Jan 2014 02:02:36 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:02:36 - XML: Start document: iteration 5
Sat 18 Jan 2014 02:02:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43885059
Sat 18 Jan 2014 02:02:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43885059
Sat 18 Jan 2014 02:02:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:02:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:02:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:02:45 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:02:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:02:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 02:02:46 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:02:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8244 values 130499 bits 16312 bytes 
Sat 18 Jan 2014 02:02:46 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:02:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 02:02:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:02:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:02:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:02:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:02:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:02:52 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:02:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:02:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:02:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:02:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:02:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:02:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:02:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:02:55 - XML: Processed 655471 elements - found 633 jobs
Sat 18 Jan 2014 02:02:55 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:02:55 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:02:55 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:02:55 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:02:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:02:58 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:02:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:02:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:03:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:03:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:03:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:03:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:03:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:03:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43864509
Sat 18 Jan 2014 02:03:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:03:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43864509
Sat 18 Jan 2014 02:03:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:03:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:03:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:03:10 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:03:10 - job_xml_thread(): Done retrieving: data size 43864509
Sat 18 Jan 2014 02:03:10 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:03:10 - XML: Start document: iteration 6
Sat 18 Jan 2014 02:03:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:03:11 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:03:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:03:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:03:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:03:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:03:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:03:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:03:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:03:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:03:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:03:20 - XML: Processed 655465 elements - found 633 jobs
Sat 18 Jan 2014 02:03:20 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:03:20 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:03:20 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:03:20 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:03:23 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:03:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 02:03:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:03:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:03:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:03:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:03:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:03:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:03:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:03:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:03:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:03:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:03:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43852083
Sat 18 Jan 2014 02:03:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:03:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43852083
Sat 18 Jan 2014 02:03:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:03:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:03:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:03:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:03:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:03:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:03:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:03:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:03:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:03:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:03:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:03:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43852083
Sat 18 Jan 2014 02:03:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:03:35 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:03:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:03:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:03:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:03:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:03:46 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:03:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:03:47 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:03:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:03:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:03:47 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:03:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 02:03:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:03:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 02:03:47 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:03:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5698 values 90062 bits 11257 bytes 
Sat 18 Jan 2014 02:03:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:03:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:03:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:03:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:03:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:03:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:03:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:03:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:03:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:03:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:03:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:03:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:03:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:03:50 - job_xml_thread(): Done retrieving: data size 43835486
Sat 18 Jan 2014 02:03:50 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:03:50 - XML: Start document: iteration 7
Sat 18 Jan 2014 02:03:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43835486
Sat 18 Jan 2014 02:03:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43835486
Sat 18 Jan 2014 02:03:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:03:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:04:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:04:03 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:04:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:04:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:04:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:04:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:04:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:04:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:04:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:04:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:04:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:04:10 - XML: Processed 655470 elements - found 632 jobs
Sat 18 Jan 2014 02:04:10 - job 7348593 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 02:04:10 - job 7348742 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 02:04:10 - job 7348743 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 02:04:10 - job 7348746 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 02:04:10 - job 7348747 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 02:04:10 - job 7348744 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 02:04:10 - job 7348745 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 02:04:10 - job 7348410 appears to have finished
Sat 18 Jan 2014 02:04:10 - job 7348594 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 02:04:10 - job 7344347 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 02:04:10 - job_xml_thread(): Found 10 updated jobs.
Sat 18 Jan 2014 02:04:10 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 02:04:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:04:13 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:04:13 - job_xml_thread(): Done storing. succesfully stored: 10 jobs
Sat 18 Jan 2014 02:04:13 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:04:13 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:04:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:04:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:04:13 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:04:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 02:04:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:04:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:04:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:04:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:04:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:04:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:04:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43857364
Sat 18 Jan 2014 02:04:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:04:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43857364
Sat 18 Jan 2014 02:04:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:04:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:04:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:04:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:04:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:04:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:04:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:04:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:04:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:04:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:04:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:04:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43857364
Sat 18 Jan 2014 02:04:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:04:28 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:04:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:04:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:04:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:04:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:04:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:04:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:04:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:04:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:04:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:04:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:04:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:04:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:04:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:04:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:04:38 - job_xml_thread(): Done retrieving: data size 43858579
Sat 18 Jan 2014 02:04:38 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:04:38 - XML: Start document: iteration 8
Sat 18 Jan 2014 02:04:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43858579
Sat 18 Jan 2014 02:04:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:04:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:04:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:04:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:04:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:04:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858579
Sat 18 Jan 2014 02:04:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:04:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:04:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:04:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:04:47 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:04:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:04:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 02:04:49 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:04:51 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:04:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8492 values 134010 bits 16751 bytes 
Sat 18 Jan 2014 02:04:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 02:04:52 - XML: Processed 655470 elements - found 632 jobs
Sat 18 Jan 2014 02:04:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:04:52 - job 7348742 field 'start_timestamp' changed since saved from: 1390006983 to: 1390006911
Sat 18 Jan 2014 02:04:52 - job 7348743 field 'start_timestamp' changed since saved from: 1390006985 to: 1390006911
Sat 18 Jan 2014 02:04:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:04:52 - job 7348744 field 'start_timestamp' changed since saved from: 1390006987 to: 1390006911
Sat 18 Jan 2014 02:04:52 - job 7348594 field 'start_timestamp' changed since saved from: 1390007001 to: 1390006964
Sat 18 Jan 2014 02:04:53 - job_xml_thread(): Found 4 updated jobs.
Sat 18 Jan 2014 02:04:53 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 02:04:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:04:56 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:04:56 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Sat 18 Jan 2014 02:04:56 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:04:56 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:04:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:04:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:04:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:04:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:04:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:04:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:04:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:05:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:05:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:05:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:05:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:05:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:05:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:05:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:05:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:05:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:05:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43876273
Sat 18 Jan 2014 02:05:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:05:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43876273
Sat 18 Jan 2014 02:05:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:05:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:05:11 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:05:11 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:05:11 - job_xml_thread(): Done retrieving: data size 43876273
Sat 18 Jan 2014 02:05:11 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:05:12 - XML: Start document: iteration 9
Sat 18 Jan 2014 02:05:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:05:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:05:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:05:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:05:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:05:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:05:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:05:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:05:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:05:23 - XML: Processed 655470 elements - found 632 jobs
Sat 18 Jan 2014 02:05:23 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:05:23 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:05:23 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:05:23 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:05:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:05:23 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:05:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:05:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:05:24 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:05:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 02:05:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:05:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:05:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:05:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:05:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:05:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:05:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43793691
Sat 18 Jan 2014 02:05:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:05:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43793691
Sat 18 Jan 2014 02:05:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:05:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:05:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:05:34 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 02:05:34 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:05:35 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:05:35 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 02:05:35 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 02:05:36 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:05:36 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 02:05:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:05:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:05:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:05:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:05:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:05:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:05:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:05:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:05:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:05:38 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:05:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:05:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:05:39 - size of cluster 'LISA Cluster': 624 hosts 79479 metrics 996420 values 15746388 bits 1968298 bytes 
Sat 18 Jan 2014 02:05:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:05:42 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:05:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:05:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:05:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:05:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:05:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:05:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:05:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:05:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43291827
Sat 18 Jan 2014 02:05:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:05:45 - job_xml_thread(): Done retrieving: data size 43291827
Sat 18 Jan 2014 02:05:46 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:05:46 - XML: Start document: iteration 10
Sat 18 Jan 2014 02:05:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43291827
Sat 18 Jan 2014 02:05:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:05:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:05:52 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:05:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:05:52 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:05:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 02:05:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 02:05:52 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:05:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:05:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:05:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8721 values 137570 bits 17196 bytes 
Sat 18 Jan 2014 02:05:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:05:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:06:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:06:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:06:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:06:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:06:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:06:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:06:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:06:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:06:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:06:07 - XML: Processed 648320 elements - found 632 jobs
Sat 18 Jan 2014 02:06:07 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:06:07 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:06:07 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:06:07 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:06:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:06:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:06:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:06:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:06:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:06:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:06:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:06:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:06:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:06:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43200955
Sat 18 Jan 2014 02:06:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:06:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43200955
Sat 18 Jan 2014 02:06:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:06:17 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:06:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 02:06:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:06:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:06:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:06:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:06:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:06:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:06:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:06:22 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:06:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:06:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:06:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:06:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:06:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:06:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:06:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:06:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:06:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:06:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:06:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:06:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:06:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:06:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:06:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:06:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:06:30 - job_xml_thread(): Done retrieving: data size 43345753
Sat 18 Jan 2014 02:06:30 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:06:30 - XML: Start document: iteration 11
Sat 18 Jan 2014 02:06:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43345753
Sat 18 Jan 2014 02:06:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:06:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43345753
Sat 18 Jan 2014 02:06:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:06:36 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:06:36 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 02:06:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:06:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:06:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:06:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:06:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:06:45 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:06:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:06:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:06:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:06:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:06:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:06:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:06:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:06:50 - XML: Processed 648888 elements - found 631 jobs
Sat 18 Jan 2014 02:06:50 - job 7348411 appears to have finished
Sat 18 Jan 2014 02:06:50 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 02:06:50 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 02:06:51 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 02:06:51 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:06:51 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:06:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:06:53 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:06:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:06:53 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:06:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 02:06:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 02:06:53 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:06:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6168 values 97350 bits 12168 bytes 
Sat 18 Jan 2014 02:06:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:06:54 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:06:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:06:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:06:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:06:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:06:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:06:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:06:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:06:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43816840
Sat 18 Jan 2014 02:06:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:06:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43816840
Sat 18 Jan 2014 02:06:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:07:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:07:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:07:06 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:07:06 - job_xml_thread(): Done retrieving: data size 43816840
Sat 18 Jan 2014 02:07:06 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:07:06 - XML: Start document: iteration 12
Sat 18 Jan 2014 02:07:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:07:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:07:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:07:15 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:07:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:07:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:07:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:07:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:07:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:07:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:07:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:07:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:07:19 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:07:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:07:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:07:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:07:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:07:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:07:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:07:21 - XML: Processed 654980 elements - found 631 jobs
Sat 18 Jan 2014 02:07:21 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:07:21 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:07:21 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:07:21 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:07:21 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:07:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 02:07:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:07:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:07:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853355
Sat 18 Jan 2014 02:07:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:07:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853355
Sat 18 Jan 2014 02:07:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:07:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:07:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:07:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:07:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:07:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:07:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:07:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:07:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:07:36 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:07:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:07:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:07:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:07:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:07:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:07:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:07:39 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:07:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:07:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:07:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:07:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:07:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:07:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:07:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:07:43 - job_xml_thread(): Done retrieving: data size 43869949
Sat 18 Jan 2014 02:07:43 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:07:43 - XML: Start document: iteration 13
Sat 18 Jan 2014 02:07:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43869949
Sat 18 Jan 2014 02:07:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:07:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43869949
Sat 18 Jan 2014 02:07:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:07:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:07:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:07:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:07:53 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:07:55 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:07:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:07:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 02:07:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:07:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 02:07:55 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:07:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:07:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8654 values 136494 bits 17061 bytes 
Sat 18 Jan 2014 02:07:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:07:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:07:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:07:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:07:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:07:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:07:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:07:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:07:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:08:03 - XML: Processed 655466 elements - found 630 jobs
Sat 18 Jan 2014 02:08:03 - job 7348097 appears to have finished
Sat 18 Jan 2014 02:08:03 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 02:08:03 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 02:08:04 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 02:08:04 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:08:04 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:08:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:08:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:08:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:08:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:08:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:08:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:08:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:08:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:08:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:08:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855663
Sat 18 Jan 2014 02:08:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:08:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855663
Sat 18 Jan 2014 02:08:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:08:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:08:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:08:19 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:08:19 - job_xml_thread(): Done retrieving: data size 43855663
Sat 18 Jan 2014 02:08:19 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:08:19 - XML: Start document: iteration 14
Sat 18 Jan 2014 02:08:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:08:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:08:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:08:27 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:08:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:08:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:08:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:08:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:08:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:08:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:08:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:08:32 - XML: Processed 655466 elements - found 630 jobs
Sat 18 Jan 2014 02:08:32 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:08:32 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:08:32 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:08:32 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:08:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:08:35 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:08:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:08:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:08:35 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:08:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 02:08:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:08:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:08:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:08:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:08:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:08:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:08:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43859570
Sat 18 Jan 2014 02:08:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:08:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43859570
Sat 18 Jan 2014 02:08:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:08:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:08:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:08:48 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:08:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:08:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:08:50 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:08:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:08:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:08:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:08:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:08:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:08:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:08:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:08:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:08:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:08:53 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:08:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:08:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:08:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:08:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:08:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:08:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:08:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:08:55 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:08:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:08:56 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:08:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 02:08:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 02:08:56 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:08:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5965 values 94130 bits 11766 bytes 
Sat 18 Jan 2014 02:08:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:08:57 - job_xml_thread(): Done retrieving: data size 43871025
Sat 18 Jan 2014 02:08:57 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:08:57 - XML: Start document: iteration 15
Sat 18 Jan 2014 02:08:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43871025
Sat 18 Jan 2014 02:08:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:08:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43871025
Sat 18 Jan 2014 02:08:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:09:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:09:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:09:09 - XML: Processed 655463 elements - found 630 jobs
Sat 18 Jan 2014 02:09:09 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:09:09 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:09:09 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:09:09 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:09:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:09:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:09:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:09:18 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:09:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:09:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:09:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:09:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:09:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:09:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:09:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:09:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:09:21 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:09:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:09:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:09:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:09:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:09:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:09:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:09:24 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 02:09:24 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 02:09:24 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:09:24 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:09:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 02:09:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:09:24 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:09:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:09:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873564
Sat 18 Jan 2014 02:09:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:09:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873564
Sat 18 Jan 2014 02:09:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:09:25 - job_xml_thread(): Done retrieving: data size 43873564
Sat 18 Jan 2014 02:09:26 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:09:26 - XML: Start document: iteration 16
Sat 18 Jan 2014 02:09:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:09:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:09:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:09:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:09:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:09:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:09:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:09:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:09:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:09:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:09:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:09:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:09:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:09:43 - XML: Processed 655466 elements - found 630 jobs
Sat 18 Jan 2014 02:09:43 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:09:43 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:09:43 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:09:43 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:09:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:09:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:09:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:09:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:09:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:09:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:09:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:09:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:09:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:09:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851168
Sat 18 Jan 2014 02:09:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:09:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851168
Sat 18 Jan 2014 02:09:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:09:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:09:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:09:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:09:56 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:09:58 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:09:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:09:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 02:09:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 02:09:58 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:09:58 - job_xml_thread(): Done retrieving: data size 43851168
Sat 18 Jan 2014 02:09:58 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:09:58 - XML: Start document: iteration 17
Sat 18 Jan 2014 02:09:58 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:09:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6978 values 110058 bits 13757 bytes 
Sat 18 Jan 2014 02:10:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:10:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:10:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:10:03 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:10:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:10:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:10:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:10:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:10:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:10:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:10:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:10:09 - XML: Processed 655466 elements - found 630 jobs
Sat 18 Jan 2014 02:10:09 - job 7344348 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 02:10:10 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 02:10:10 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 02:10:10 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 02:10:10 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:10:10 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:10:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:10:11 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:10:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:10:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:10:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:10:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:10:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:10:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:10:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:10:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851018
Sat 18 Jan 2014 02:10:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:10:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851018
Sat 18 Jan 2014 02:10:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:10:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:10:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:10:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:10:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:10:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:10:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:10:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:10:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:10:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:10:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851018
Sat 18 Jan 2014 02:10:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:10:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:10:25 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:10:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:10:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:10:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:10:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:10:33 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:10:35 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:10:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 02:10:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:10:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:10:35 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:10:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:10:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:10:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:10:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:10:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:10:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:10:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:10:37 - job_xml_thread(): Done retrieving: data size 43848001
Sat 18 Jan 2014 02:10:37 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:10:37 - XML: Start document: iteration 18
Sat 18 Jan 2014 02:10:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43848001
Sat 18 Jan 2014 02:10:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:10:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:10:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:10:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:10:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:10:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:10:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43848001
Sat 18 Jan 2014 02:10:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:10:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:10:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:10:50 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:10:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:10:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:10:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:10:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:10:57 - XML: Processed 655466 elements - found 630 jobs
Sat 18 Jan 2014 02:10:57 - job 7344349 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 02:10:57 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 02:10:57 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 02:10:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:10:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:10:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:10:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:10:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:10:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:10:58 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 02:10:58 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:10:58 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:10:58 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:10:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:10:59 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:10:59 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:10:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 02:10:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:10:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 02:10:59 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:10:59 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5834 values 92036 bits 11504 bytes 
Sat 18 Jan 2014 02:10:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:10:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:11:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:11:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:11:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:11:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:11:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:11:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43864983
Sat 18 Jan 2014 02:11:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:11:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43864983
Sat 18 Jan 2014 02:11:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:11:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:11:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:11:13 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:11:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:11:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:11:14 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:11:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:11:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:11:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:11:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:11:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:11:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:11:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:11:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:11:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:11:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:11:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:11:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:11:18 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:11:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 02:11:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:11:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:11:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:11:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:11:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:11:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:11:19 - job_xml_thread(): Done retrieving: data size 43804944
Sat 18 Jan 2014 02:11:19 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:11:19 - XML: Start document: iteration 19
Sat 18 Jan 2014 02:11:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43804944
Sat 18 Jan 2014 02:11:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43804944
Sat 18 Jan 2014 02:11:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:11:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:11:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:11:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:11:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:11:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:11:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:11:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:11:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:11:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:11:37 - XML: Processed 654718 elements - found 630 jobs
Sat 18 Jan 2014 02:11:37 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:11:37 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:11:37 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:11:37 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:11:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:11:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:11:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:11:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:11:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:11:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:11:41 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:11:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:11:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:11:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:11:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:11:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:11:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:11:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:11:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43256076
Sat 18 Jan 2014 02:11:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:11:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43256076
Sat 18 Jan 2014 02:11:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:11:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:11:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:11:52 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:11:52 - job_xml_thread(): Done retrieving: data size 43256076
Sat 18 Jan 2014 02:11:52 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:11:52 - XML: Start document: iteration 20
Sat 18 Jan 2014 02:11:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:11:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:11:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:11:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:11:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:11:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:11:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:11:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:11:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:11:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:11:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:11:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:11:59 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:12:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:12:00 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:12:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 02:12:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 02:12:00 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:12:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8758 values 138109 bits 17263 bytes 
Sat 18 Jan 2014 02:12:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:12:02 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:12:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:12:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:12:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:12:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:12:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:12:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:12:03 - XML: Processed 648106 elements - found 630 jobs
Sat 18 Jan 2014 02:12:03 - job 7344349 field 'start_timestamp' changed since saved from: 1390007420 to: 1390007354
Sat 18 Jan 2014 02:12:03 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 02:12:03 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 02:12:03 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 02:12:03 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:12:03 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:12:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:12:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43197462
Sat 18 Jan 2014 02:12:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:12:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43197462
Sat 18 Jan 2014 02:12:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:12:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:12:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:12:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:12:15 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:12:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:12:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:12:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:12:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:12:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:12:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:12:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:12:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:12:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:12:18 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:12:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:12:20 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:12:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:12:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:12:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:12:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:12:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:12:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:12:21 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:12:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 02:12:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:12:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:12:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43265372
Sat 18 Jan 2014 02:12:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:12:23 - job_xml_thread(): Done retrieving: data size 43265372
Sat 18 Jan 2014 02:12:23 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:12:23 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 02:12:23 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 02:12:23 - Housekeeping: done.
Sat 18 Jan 2014 02:12:23 - XML: Start document: iteration 0
Sat 18 Jan 2014 02:12:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43265372
Sat 18 Jan 2014 02:12:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:12:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:12:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:12:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:12:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:12:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:12:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:12:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:12:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:12:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:12:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:12:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:12:36 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 02:12:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:12:36 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:12:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:12:37 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:12:37 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 02:12:37 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:12:37 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 02:12:37 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 02:12:43 - XML: Processed 648010 elements - found 628 jobs
Sat 18 Jan 2014 02:12:43 - job 7344341 appears to have finished
Sat 18 Jan 2014 02:12:43 - job 7344345 appears to have finished
Sat 18 Jan 2014 02:12:43 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 02:12:43 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 02:12:43 - size of cluster 'LISA Cluster': 624 hosts 79472 metrics 788590 values 12442100 bits 1555262 bytes 
Sat 18 Jan 2014 02:12:44 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 02:12:44 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:12:44 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:12:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:12:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:12:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:12:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:12:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:12:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:12:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:12:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:12:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:12:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43786737
Sat 18 Jan 2014 02:12:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:12:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43786737
Sat 18 Jan 2014 02:12:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:12:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:12:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:12:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:12:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:12:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:12:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:12:59 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:12:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:13:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:13:00 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:13:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:13:00 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:13:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 02:13:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:13:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:13:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:13:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 02:13:00 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:13:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:13:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8953 values 141237 bits 17654 bytes 
Sat 18 Jan 2014 02:13:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:13:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:13:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:13:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:13:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:13:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:13:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:13:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:13:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:13:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:13:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:13:07 - job_xml_thread(): Done retrieving: data size 43852629
Sat 18 Jan 2014 02:13:07 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:13:07 - XML: Start document: iteration 1
Sat 18 Jan 2014 02:13:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43852629
Sat 18 Jan 2014 02:13:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43852629
Sat 18 Jan 2014 02:13:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:13:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:13:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:13:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:13:18 - XML: Processed 655462 elements - found 628 jobs
Sat 18 Jan 2014 02:13:18 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:13:18 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:13:18 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:13:18 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:13:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:13:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:13:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:13:26 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:13:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:13:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:13:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:13:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:13:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:13:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:13:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:13:28 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:13:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 02:13:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:13:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:13:31 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:13:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:13:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:13:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:13:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:13:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:13:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:13:33 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:13:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:13:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43850206
Sat 18 Jan 2014 02:13:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:13:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43850206
Sat 18 Jan 2014 02:13:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:13:34 - job_xml_thread(): Done retrieving: data size 43850206
Sat 18 Jan 2014 02:13:34 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:13:34 - XML: Start document: iteration 2
Sat 18 Jan 2014 02:13:37 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:13:38 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 02:13:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:13:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:13:46 - XML: Processed 655462 elements - found 628 jobs
Sat 18 Jan 2014 02:13:46 - job 7348120 appears to have finished
Sat 18 Jan 2014 02:13:46 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 02:13:46 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 02:13:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:13:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:13:48 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 02:13:48 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:13:48 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:13:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:13:49 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:13:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:13:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:13:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:13:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:13:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:13:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:13:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:13:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:13:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:13:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:13:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:13:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:13:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:13:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:13:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:13:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:13:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43864661
Sat 18 Jan 2014 02:13:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:13:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43864661
Sat 18 Jan 2014 02:13:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:14:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:14:01 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:14:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:14:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 02:14:02 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:14:02 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:14:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 02:14:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9114 values 143806 bits 17975 bytes 
Sat 18 Jan 2014 02:14:03 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:14:03 - job_xml_thread(): Done retrieving: data size 43864661
Sat 18 Jan 2014 02:14:03 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:14:03 - XML: Start document: iteration 3
Sat 18 Jan 2014 02:14:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:14:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:14:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:14:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:14:19 - XML: Processed 655462 elements - found 628 jobs
Sat 18 Jan 2014 02:14:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:14:19 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:14:19 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:14:19 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:14:19 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:14:19 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:14:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:14:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:14:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:14:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:14:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:14:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:14:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:14:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:14:23 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:14:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:14:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:14:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:14:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:14:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:14:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:14:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:14:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43872040
Sat 18 Jan 2014 02:14:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:14:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43872040
Sat 18 Jan 2014 02:14:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:14:34 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:14:34 - job_xml_thread(): Done retrieving: data size 43872040
Sat 18 Jan 2014 02:14:34 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:14:34 - XML: Start document: iteration 4
Sat 18 Jan 2014 02:14:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:14:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:14:39 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:14:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 02:14:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:14:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:14:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:14:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:14:44 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:14:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:14:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:14:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:14:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:14:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:14:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:14:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:14:49 - XML: Processed 655462 elements - found 628 jobs
Sat 18 Jan 2014 02:14:49 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:14:49 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:14:49 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:14:49 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:14:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:14:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:14:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:14:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:14:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:14:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:14:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:14:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:14:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:14:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43861944
Sat 18 Jan 2014 02:14:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:14:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43861944
Sat 18 Jan 2014 02:14:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:14:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:14:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:15:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:15:02 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:15:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:15:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 02:15:03 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:15:03 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:15:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5980 values 94258 bits 11782 bytes 
Sat 18 Jan 2014 02:15:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 02:15:04 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:15:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:15:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:15:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:15:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:15:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:15:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:15:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:15:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:15:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:15:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:15:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:15:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:15:10 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:15:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:15:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:15:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:15:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:15:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:15:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:15:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:15:13 - job_xml_thread(): Done retrieving: data size 43870573
Sat 18 Jan 2014 02:15:13 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:15:13 - XML: Start document: iteration 5
Sat 18 Jan 2014 02:15:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870573
Sat 18 Jan 2014 02:15:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:15:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870573
Sat 18 Jan 2014 02:15:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:15:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:15:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:15:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:15:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:15:34 - XML: Processed 655462 elements - found 628 jobs
Sat 18 Jan 2014 02:15:34 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:15:34 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:15:34 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:15:34 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:15:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:15:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:15:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:15:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:15:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:15:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:15:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:15:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:15:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:15:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:15:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:15:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:15:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:15:37 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:15:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 02:15:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:15:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:15:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:15:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:15:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:15:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:15:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43881681
Sat 18 Jan 2014 02:15:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:15:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43881681
Sat 18 Jan 2014 02:15:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:15:49 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:15:49 - job_xml_thread(): Done retrieving: data size 43881681
Sat 18 Jan 2014 02:15:49 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:15:49 - XML: Start document: iteration 6
Sat 18 Jan 2014 02:15:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:15:51 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:15:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:15:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:15:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:15:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:15:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:15:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:15:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:15:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:15:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:16:01 - XML: Processed 655462 elements - found 628 jobs
Sat 18 Jan 2014 02:16:01 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:16:01 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:16:01 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:16:01 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:16:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:16:02 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:16:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:16:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:16:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:16:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:16:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:16:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:16:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:16:03 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:16:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:16:03 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:16:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 02:16:03 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:16:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5637 values 88884 bits 11110 bytes 
Sat 18 Jan 2014 02:16:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 02:16:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:16:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43846274
Sat 18 Jan 2014 02:16:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:16:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43846274
Sat 18 Jan 2014 02:16:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:16:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:16:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:16:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:16:14 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:16:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:16:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:16:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:16:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:16:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:16:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:16:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43846274
Sat 18 Jan 2014 02:16:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:16:16 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:16:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:16:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:16:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:16:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:16:25 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:16:27 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 02:16:27 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 02:16:27 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:16:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:16:28 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:16:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:16:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:16:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:16:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:16:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:16:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:16:29 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:16:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 02:16:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:16:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:16:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:16:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:16:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:16:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:16:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:16:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:16:30 - job_xml_thread(): Done retrieving: data size 43843408
Sat 18 Jan 2014 02:16:30 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:16:30 - XML: Start document: iteration 7
Sat 18 Jan 2014 02:16:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43843408
Sat 18 Jan 2014 02:16:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:16:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43843408
Sat 18 Jan 2014 02:16:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:16:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:16:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:16:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:16:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:16:46 - XML: Processed 655458 elements - found 626 jobs
Sat 18 Jan 2014 02:16:47 - job 7347937 appears to have finished
Sat 18 Jan 2014 02:16:47 - job 7348111 appears to have finished
Sat 18 Jan 2014 02:16:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:16:48 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:16:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:16:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:16:48 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 02:16:48 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 02:16:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:16:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:16:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:16:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:16:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:16:49 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 02:16:49 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:16:49 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:16:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:16:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:16:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:16:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:16:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:16:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:16:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:16:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:16:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:16:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43886059
Sat 18 Jan 2014 02:16:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:16:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43886059
Sat 18 Jan 2014 02:16:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:17:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:17:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:17:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:17:03 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:17:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:17:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 02:17:04 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:17:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:17:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:17:04 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:17:04 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:17:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:17:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 02:17:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:17:05 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:17:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7334 values 115915 bits 14489 bytes 
Sat 18 Jan 2014 02:17:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:17:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:17:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:17:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:17:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:17:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:17:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:17:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:17:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:17:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:17:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:17:08 - job_xml_thread(): Done retrieving: data size 43818673
Sat 18 Jan 2014 02:17:08 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:17:08 - XML: Start document: iteration 8
Sat 18 Jan 2014 02:17:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43818673
Sat 18 Jan 2014 02:17:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43818673
Sat 18 Jan 2014 02:17:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:17:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:17:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:17:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:17:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:17:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:17:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:17:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:17:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:17:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:17:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:17:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:17:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:17:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:17:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:17:28 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:17:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 02:17:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:17:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:17:30 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:17:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:17:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:17:31 - XML: Processed 654710 elements - found 626 jobs
Sat 18 Jan 2014 02:17:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:17:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:17:31 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:17:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:17:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:17:31 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:17:31 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:17:31 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:17:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:17:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43433102
Sat 18 Jan 2014 02:17:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:17:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43433102
Sat 18 Jan 2014 02:17:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:17:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:17:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:17:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:17:43 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:17:46 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:17:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:17:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:17:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:17:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:17:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:17:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:17:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:17:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:17:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:17:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:17:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:17:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:17:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:17:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:17:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:17:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:17:49 - job_xml_thread(): Done retrieving: data size 43235804
Sat 18 Jan 2014 02:17:49 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:17:49 - XML: Start document: iteration 9
Sat 18 Jan 2014 02:17:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43235804
Sat 18 Jan 2014 02:17:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:17:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43235804
Sat 18 Jan 2014 02:17:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:18:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:18:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:18:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:18:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:18:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:18:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:18:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:18:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:18:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:18:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:18:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:18:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:18:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:18:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:18:05 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:18:06 - XML: Processed 647544 elements - found 626 jobs
Sat 18 Jan 2014 02:18:06 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:18:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:18:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 02:18:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 02:18:07 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:18:07 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:18:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9294 values 147156 bits 18394 bytes 
Sat 18 Jan 2014 02:18:07 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:18:07 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:18:07 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:18:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:18:11 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:18:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:18:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:18:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:18:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:18:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:18:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:18:13 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:18:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 02:18:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:18:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:18:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43218060
Sat 18 Jan 2014 02:18:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:18:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43218060
Sat 18 Jan 2014 02:18:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:18:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:18:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:18:22 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:18:22 - job_xml_thread(): Done retrieving: data size 43218060
Sat 18 Jan 2014 02:18:22 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:18:22 - XML: Start document: iteration 10
Sat 18 Jan 2014 02:18:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:18:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:18:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:18:30 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:18:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:18:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:18:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:18:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:18:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:18:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:18:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:18:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:18:32 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:18:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:18:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:18:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:18:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:18:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:18:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:18:34 - XML: Processed 647290 elements - found 624 jobs
Sat 18 Jan 2014 02:18:35 - job 7348738 appears to have finished
Sat 18 Jan 2014 02:18:35 - job 7348652 appears to have finished
Sat 18 Jan 2014 02:18:35 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 02:18:35 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 02:18:35 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 02:18:35 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:18:35 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:18:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:18:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43691221
Sat 18 Jan 2014 02:18:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:18:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43691221
Sat 18 Jan 2014 02:18:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:18:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:18:45 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:18:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:18:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:18:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:18:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:18:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:18:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:18:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:18:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:18:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:18:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:18:49 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:18:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:18:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:18:50 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:18:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:18:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:18:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:18:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:18:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:18:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43827476
Sat 18 Jan 2014 02:18:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:18:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43827476
Sat 18 Jan 2014 02:18:52 - job_xml_thread(): Done retrieving: data size 43827476
Sat 18 Jan 2014 02:18:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:18:52 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:18:52 - XML: Start document: iteration 11
Sat 18 Jan 2014 02:19:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:19:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:19:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:19:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:19:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:19:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:19:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:19:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:19:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:19:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:19:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:19:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:19:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:19:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:19:06 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:19:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:19:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 02:19:08 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:19:08 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:19:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 02:19:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148844 bits 18605 bytes 
Sat 18 Jan 2014 02:19:09 - XML: Processed 655008 elements - found 624 jobs
Sat 18 Jan 2014 02:19:09 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:19:09 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:19:09 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:19:09 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:19:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:19:13 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:19:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:19:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:19:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:19:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:19:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:19:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:19:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:19:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43840590
Sat 18 Jan 2014 02:19:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:19:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43840590
Sat 18 Jan 2014 02:19:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:19:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:19:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:19:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:19:24 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:19:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:19:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:19:24 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:19:24 - job_xml_thread(): Done retrieving: data size 43840590
Sat 18 Jan 2014 02:19:25 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:19:25 - XML: Start document: iteration 12
Sat 18 Jan 2014 02:19:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:19:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:19:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:19:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:19:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:19:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:19:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:19:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:19:37 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:19:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:19:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:19:38 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 02:19:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:19:38 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:19:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:19:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:19:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:19:38 - XML: Processed 655454 elements - found 624 jobs
Sat 18 Jan 2014 02:19:38 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:19:38 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:19:38 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:19:38 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:19:38 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:19:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 02:19:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:19:39 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:19:39 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:19:39 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 02:19:39 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 02:19:39 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 02:19:40 - size of cluster 'LISA Cluster': 624 hosts 79478 metrics 832262 values 13157479 bits 1644684 bytes 
Sat 18 Jan 2014 02:19:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:19:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:19:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:19:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43837154
Sat 18 Jan 2014 02:19:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:19:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43837154
Sat 18 Jan 2014 02:19:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:19:53 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:19:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:19:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:19:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:19:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:19:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:19:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:19:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:19:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:19:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:19:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:19:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:19:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:19:57 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:19:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:19:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:19:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:19:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:19:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:19:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:20:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:20:00 - job_xml_thread(): Done retrieving: data size 43856286
Sat 18 Jan 2014 02:20:00 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:20:00 - XML: Start document: iteration 13
Sat 18 Jan 2014 02:20:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856286
Sat 18 Jan 2014 02:20:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43856286
Sat 18 Jan 2014 02:20:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:20:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:20:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:20:08 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:20:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:20:09 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:20:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 02:20:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:20:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 02:20:09 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:20:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:20:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8425 values 132882 bits 16610 bytes 
Sat 18 Jan 2014 02:20:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:20:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:20:15 - XML: Processed 655454 elements - found 624 jobs
Sat 18 Jan 2014 02:20:15 - job 7348685 appears to have finished
Sat 18 Jan 2014 02:20:15 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 02:20:15 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 02:20:18 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 02:20:18 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:20:18 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:20:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:20:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:20:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:20:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:20:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:20:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:20:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:20:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:20:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:20:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:20:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:20:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:20:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:20:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:20:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:20:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:20:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:20:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:20:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43876932
Sat 18 Jan 2014 02:20:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:20:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43876932
Sat 18 Jan 2014 02:20:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:20:33 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:20:33 - job_xml_thread(): Done retrieving: data size 43876932
Sat 18 Jan 2014 02:20:33 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:20:33 - XML: Start document: iteration 14
Sat 18 Jan 2014 02:20:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:20:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:20:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:20:39 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:20:39 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:20:39 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 02:20:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:20:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:20:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:20:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:20:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:20:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:20:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:20:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:20:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:20:50 - XML: Processed 655454 elements - found 624 jobs
Sat 18 Jan 2014 02:20:50 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:20:50 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:20:50 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:20:50 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:20:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:20:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:20:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:20:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:20:52 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:20:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 02:20:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:20:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:20:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:20:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:20:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:20:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:20:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43845633
Sat 18 Jan 2014 02:20:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:20:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43845633
Sat 18 Jan 2014 02:20:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:20:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:20:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:21:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:21:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:21:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:21:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:21:05 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:21:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:21:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:21:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:21:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:21:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:21:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:21:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:21:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:21:09 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:21:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:21:10 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:21:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 02:21:10 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:21:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 02:21:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5835 values 92051 bits 11506 bytes 
Sat 18 Jan 2014 02:21:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:21:11 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:21:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:21:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:21:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:21:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:21:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:21:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:21:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:21:15 - job_xml_thread(): Done retrieving: data size 43861983
Sat 18 Jan 2014 02:21:15 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:21:15 - XML: Start document: iteration 15
Sat 18 Jan 2014 02:21:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43861983
Sat 18 Jan 2014 02:21:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:21:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43861983
Sat 18 Jan 2014 02:21:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:21:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:21:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:21:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:21:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:21:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:21:31 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:21:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:21:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:21:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:21:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:21:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:21:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:21:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:21:32 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:21:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 02:21:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:21:35 - XML: Processed 655451 elements - found 624 jobs
Sat 18 Jan 2014 02:21:35 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:21:35 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:21:35 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:21:35 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:21:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:21:39 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:21:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:21:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:21:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:21:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:21:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:21:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:21:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:21:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43863002
Sat 18 Jan 2014 02:21:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:21:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43863002
Sat 18 Jan 2014 02:21:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:21:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:21:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:21:50 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:21:50 - job_xml_thread(): Done retrieving: data size 43863002
Sat 18 Jan 2014 02:21:50 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:21:50 - XML: Start document: iteration 16
Sat 18 Jan 2014 02:21:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:21:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:21:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:21:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:21:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:21:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:21:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:21:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:21:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:21:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:21:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:22:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:22:05 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:22:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:22:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:22:06 - XML: Processed 655452 elements - found 623 jobs
Sat 18 Jan 2014 02:22:06 - job 7348732 appears to have finished
Sat 18 Jan 2014 02:22:06 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 02:22:06 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 02:22:06 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 02:22:06 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:22:06 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:22:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:22:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:22:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:22:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:22:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:22:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43860941
Sat 18 Jan 2014 02:22:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43860941
Sat 18 Jan 2014 02:22:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:22:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:22:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:22:10 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:22:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:22:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 02:22:11 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:22:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 02:22:11 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:22:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6554 values 103407 bits 12925 bytes 
Sat 18 Jan 2014 02:22:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:22:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:22:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:22:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:22:21 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:22:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:22:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:22:25 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:22:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:22:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:22:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:22:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:22:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:22:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:22:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:22:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:22:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:22:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:22:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:22:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:22:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:22:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:22:30 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:22:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 02:22:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:22:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:22:30 - job_xml_thread(): Done retrieving: data size 43865513
Sat 18 Jan 2014 02:22:30 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:22:30 - XML: Start document: iteration 17
Sat 18 Jan 2014 02:22:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865513
Sat 18 Jan 2014 02:22:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:22:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43865513
Sat 18 Jan 2014 02:22:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:22:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:22:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:22:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:22:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:22:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:22:43 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:22:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:22:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:22:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:22:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:22:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:22:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:22:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:22:50 - XML: Processed 655456 elements - found 625 jobs
Sat 18 Jan 2014 02:22:51 - job 7348116 appears to have finished
Sat 18 Jan 2014 02:22:51 - job 7348657 appears to have finished
Sat 18 Jan 2014 02:22:51 - job 7348686 appears to have finished
Sat 18 Jan 2014 02:22:51 - job 7344350 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 02:22:51 - job_xml_thread(): Found 9 updated jobs.
Sat 18 Jan 2014 02:22:51 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 02:22:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:22:53 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:22:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:22:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:22:53 - job_xml_thread(): Done storing. succesfully stored: 9 jobs
Sat 18 Jan 2014 02:22:53 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:22:53 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:22:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:22:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:22:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:22:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:22:56 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 02:22:56 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 02:22:56 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:22:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:22:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43857147
Sat 18 Jan 2014 02:22:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:22:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43857147
Sat 18 Jan 2014 02:22:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:23:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:23:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:23:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:23:07 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:23:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:23:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:23:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:23:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:23:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:23:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:23:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:23:08 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:23:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:23:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:23:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:23:11 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:23:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:23:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:23:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:23:11 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:23:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:23:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:23:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:23:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:23:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:23:11 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:23:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 02:23:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 02:23:11 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:23:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99100 bits 12387 bytes 
Sat 18 Jan 2014 02:23:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:23:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43810596
Sat 18 Jan 2014 02:23:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:23:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43810596
Sat 18 Jan 2014 02:23:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:23:14 - job_xml_thread(): Done retrieving: data size 43810596
Sat 18 Jan 2014 02:23:14 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:23:14 - XML: Start document: iteration 18
Sat 18 Jan 2014 02:23:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:23:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:23:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:23:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:23:33 - XML: Processed 654708 elements - found 625 jobs
Sat 18 Jan 2014 02:23:33 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:23:33 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:23:33 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:23:33 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:23:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:23:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:23:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:23:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:23:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:23:37 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:23:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:23:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:23:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:23:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:23:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:23:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:23:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:23:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:23:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:23:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:23:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:23:37 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:23:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 02:23:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:23:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:23:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43274155
Sat 18 Jan 2014 02:23:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:23:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43274155
Sat 18 Jan 2014 02:23:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:23:48 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:23:48 - job_xml_thread(): Done retrieving: data size 43274155
Sat 18 Jan 2014 02:23:48 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:23:48 - XML: Start document: iteration 19
Sat 18 Jan 2014 02:23:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:23:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:23:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:23:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:23:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:23:52 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:23:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:23:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:23:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:23:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:23:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:23:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:23:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:23:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:23:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:23:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:23:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:23:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:23:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:23:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:23:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:23:59 - XML: Processed 647972 elements - found 625 jobs
Sat 18 Jan 2014 02:23:59 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:23:59 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:23:59 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:23:59 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:24:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:24:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43186236
Sat 18 Jan 2014 02:24:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:24:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43186236
Sat 18 Jan 2014 02:24:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:24:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:24:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:24:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:24:11 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:24:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:24:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:24:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:24:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:24:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:24:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:24:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:24:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 02:24:13 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:24:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8016 values 126360 bits 15795 bytes 
Sat 18 Jan 2014 02:24:13 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:24:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 02:24:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:24:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:24:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:24:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:24:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:24:14 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:24:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:24:16 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:24:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:24:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:24:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:24:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:24:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:24:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:24:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:24:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43264793
Sat 18 Jan 2014 02:24:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:24:18 - job_xml_thread(): Done retrieving: data size 43264793
Sat 18 Jan 2014 02:24:18 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:24:19 - XML: Start document: iteration 20
Sat 18 Jan 2014 02:24:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43264793
Sat 18 Jan 2014 02:24:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:24:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:24:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:24:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:24:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:24:39 - XML: Processed 648002 elements - found 624 jobs
Sat 18 Jan 2014 02:24:39 - job 7348755 field 'start_timestamp' changed since saved from: 1390008134 to: 1390008085
Sat 18 Jan 2014 02:24:39 - job 7348754 field 'start_timestamp' changed since saved from: 1390008132 to: 1390008085
Sat 18 Jan 2014 02:24:39 - job 7344342 appears to have finished
Sat 18 Jan 2014 02:24:39 - job_xml_thread(): Found 3 updated jobs.
Sat 18 Jan 2014 02:24:39 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 02:24:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:24:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:24:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:24:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:24:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:24:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:24:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:24:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:24:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:24:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:24:41 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:24:41 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Sat 18 Jan 2014 02:24:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:24:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:24:41 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:24:41 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:24:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:24:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:24:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:24:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:24:41 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:24:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 02:24:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:24:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:24:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43740551
Sat 18 Jan 2014 02:24:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:24:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43740551
Sat 18 Jan 2014 02:24:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:24:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:24:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:24:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:24:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:24:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:24:56 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:24:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:24:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:24:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:24:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:24:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:24:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:24:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:24:58 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:24:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:24:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:24:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:24:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:24:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:24:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:25:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:25:00 - job_xml_thread(): Done retrieving: data size 43844055
Sat 18 Jan 2014 02:25:00 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:25:00 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 02:25:00 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 02:25:00 - Housekeeping: done.
Sat 18 Jan 2014 02:25:00 - XML: Start document: iteration 0
Sat 18 Jan 2014 02:25:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43844055
Sat 18 Jan 2014 02:25:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:25:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43844055
Sat 18 Jan 2014 02:25:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:25:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:25:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:25:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:25:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:25:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:25:15 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:25:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:25:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:25:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:25:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:25:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:25:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 02:25:17 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:25:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 02:25:17 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:25:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8740 values 137846 bits 17230 bytes 
Sat 18 Jan 2014 02:25:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:25:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:25:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:25:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:25:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:25:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:25:22 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:25:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:25:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:25:23 - XML: Processed 655181 elements - found 624 jobs
Sat 18 Jan 2014 02:25:23 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:25:23 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:25:23 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:25:23 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:25:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:25:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:25:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:25:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:25:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:25:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43864733
Sat 18 Jan 2014 02:25:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:25:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43864733
Sat 18 Jan 2014 02:25:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:25:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:25:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:25:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:25:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:25:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:25:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:25:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:25:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:25:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:25:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:25:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:25:38 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:25:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:25:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:25:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:25:39 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:25:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:25:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:25:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:25:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:25:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:25:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:25:40 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:25:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 02:25:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:25:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:25:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43872971
Sat 18 Jan 2014 02:25:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:25:43 - job_xml_thread(): Done retrieving: data size 43872971
Sat 18 Jan 2014 02:25:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43872971
Sat 18 Jan 2014 02:25:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:25:44 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:25:44 - XML: Start document: iteration 1
Sat 18 Jan 2014 02:25:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:25:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:25:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:25:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:25:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:25:56 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:25:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:25:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:25:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:25:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:25:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:25:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:25:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:26:01 - XML: Processed 655454 elements - found 624 jobs
Sat 18 Jan 2014 02:26:01 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:26:01 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:26:01 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:26:01 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:26:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:26:05 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:26:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:26:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:26:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:26:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:26:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:26:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:26:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:26:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43843392
Sat 18 Jan 2014 02:26:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:26:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43843392
Sat 18 Jan 2014 02:26:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:26:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:26:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:26:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:26:15 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:26:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:26:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:26:17 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:26:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:26:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:26:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:26:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:26:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:26:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:26:18 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:26:18 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:26:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 02:26:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:26:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 02:26:18 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:26:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8766 values 138218 bits 17277 bytes 
Sat 18 Jan 2014 02:26:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:26:19 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:26:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:26:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:26:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:26:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:26:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:26:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:26:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:26:21 - job_xml_thread(): Done retrieving: data size 43858364
Sat 18 Jan 2014 02:26:21 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:26:21 - XML: Start document: iteration 2
Sat 18 Jan 2014 02:26:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43858364
Sat 18 Jan 2014 02:26:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858364
Sat 18 Jan 2014 02:26:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:26:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:26:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:26:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:26:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:26:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:26:39 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 02:26:40 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:26:41 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:26:41 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:26:41 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 02:26:41 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 02:26:42 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 02:26:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:26:42 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:26:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:26:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:26:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:26:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:26:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:26:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:26:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:26:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:26:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:26:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:26:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:26:46 - XML: Processed 655454 elements - found 624 jobs
Sat 18 Jan 2014 02:26:46 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:26:46 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:26:46 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:26:46 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:26:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:26:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:26:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:26:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:26:46 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 857077 values 13517525 bits 1689690 bytes 
Sat 18 Jan 2014 02:26:46 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:26:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 02:26:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:26:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:26:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862678
Sat 18 Jan 2014 02:26:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:26:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862678
Sat 18 Jan 2014 02:26:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:26:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:26:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:27:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:27:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:27:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:27:01 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:27:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:27:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:27:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:27:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:27:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:27:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:27:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:27:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:27:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:27:04 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:27:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:27:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:27:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:27:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:27:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:27:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:27:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:27:07 - job_xml_thread(): Done retrieving: data size 43857388
Sat 18 Jan 2014 02:27:07 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:27:07 - XML: Start document: iteration 3
Sat 18 Jan 2014 02:27:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43857388
Sat 18 Jan 2014 02:27:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:27:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43857388
Sat 18 Jan 2014 02:27:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:27:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:27:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:27:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:27:19 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:27:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:27:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:27:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:27:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 02:27:22 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:27:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9018 values 142298 bits 17787 bytes 
Sat 18 Jan 2014 02:27:22 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:27:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 02:27:24 - XML: Processed 655454 elements - found 624 jobs
Sat 18 Jan 2014 02:27:25 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:27:25 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:27:25 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:27:25 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:27:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:27:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:27:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:27:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:27:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:27:29 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:27:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:27:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:27:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:27:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:27:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:27:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:27:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:27:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:27:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:27:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:27:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:27:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:27:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43871479
Sat 18 Jan 2014 02:27:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:27:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43871479
Sat 18 Jan 2014 02:27:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:27:40 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:27:40 - job_xml_thread(): Done retrieving: data size 43871479
Sat 18 Jan 2014 02:27:40 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:27:40 - XML: Start document: iteration 4
Sat 18 Jan 2014 02:27:43 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:27:43 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 02:27:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:27:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:27:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:27:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:27:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:27:46 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:27:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:27:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:27:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:27:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:27:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:27:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:27:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:27:47 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:27:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 02:27:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:27:52 - XML: Processed 655456 elements - found 625 jobs
Sat 18 Jan 2014 02:27:52 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 02:27:52 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 02:27:53 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 02:27:53 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:27:53 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:27:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:27:56 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:27:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:27:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:27:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:27:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:27:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:27:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:28:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:28:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853610
Sat 18 Jan 2014 02:28:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:28:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853610
Sat 18 Jan 2014 02:28:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:28:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:28:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:28:08 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:28:08 - job_xml_thread(): Done retrieving: data size 43853610
Sat 18 Jan 2014 02:28:08 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:28:08 - XML: Start document: iteration 5
Sat 18 Jan 2014 02:28:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:28:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:28:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:28:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:28:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:28:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:28:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:28:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:28:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:28:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:28:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:28:19 - XML: Processed 655452 elements - found 625 jobs
Sat 18 Jan 2014 02:28:19 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:28:19 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:28:19 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:28:19 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:28:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:28:22 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:28:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:28:23 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:28:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:28:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:28:23 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:28:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 02:28:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:28:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 02:28:23 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:28:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5790 values 91385 bits 11423 bytes 
Sat 18 Jan 2014 02:28:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:28:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:28:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:28:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:28:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:28:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:28:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:28:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43833654
Sat 18 Jan 2014 02:28:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:28:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43833654
Sat 18 Jan 2014 02:28:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:28:34 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:28:34 - job_xml_thread(): Done retrieving: data size 43833654
Sat 18 Jan 2014 02:28:34 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:28:34 - XML: Start document: iteration 6
Sat 18 Jan 2014 02:28:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:28:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:28:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:28:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:28:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:28:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:28:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:28:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:28:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:28:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:28:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:28:51 - XML: Processed 655454 elements - found 624 jobs
Sat 18 Jan 2014 02:28:51 - job 7348749 appears to have finished
Sat 18 Jan 2014 02:28:51 - job 7348744 appears to have finished
Sat 18 Jan 2014 02:28:51 - job_xml_thread(): Found 3 updated jobs.
Sat 18 Jan 2014 02:28:51 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 02:28:52 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Sat 18 Jan 2014 02:28:52 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:28:52 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:28:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:28:52 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:28:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:28:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:28:52 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:28:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 02:28:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:28:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:28:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:28:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:28:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:28:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:28:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43838753
Sat 18 Jan 2014 02:28:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:28:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43838753
Sat 18 Jan 2014 02:28:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:28:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:28:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:29:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:29:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:29:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:29:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:29:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:29:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:29:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:29:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:29:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:29:07 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:29:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:29:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:29:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:29:10 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:29:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:29:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:29:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:29:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:29:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:29:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:29:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:29:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43799583
Sat 18 Jan 2014 02:29:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:29:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43799583
Sat 18 Jan 2014 02:29:14 - job_xml_thread(): Done retrieving: data size 43799583
Sat 18 Jan 2014 02:29:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:29:14 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:29:14 - XML: Start document: iteration 7
Sat 18 Jan 2014 02:29:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:29:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:29:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:29:23 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:29:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:29:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 02:29:24 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:29:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8818 values 139003 bits 17375 bytes 
Sat 18 Jan 2014 02:29:24 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:29:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 02:29:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:29:25 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:29:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:29:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:29:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:29:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:29:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:29:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:29:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:29:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:29:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:29:32 - XML: Processed 654706 elements - found 624 jobs
Sat 18 Jan 2014 02:29:32 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:29:32 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:29:32 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:29:32 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:29:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:29:37 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:29:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:29:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:29:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:29:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:29:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:29:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:29:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:29:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43389632
Sat 18 Jan 2014 02:29:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:29:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43389632
Sat 18 Jan 2014 02:29:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:29:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:29:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:29:47 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:29:47 - job_xml_thread(): Done retrieving: data size 43389632
Sat 18 Jan 2014 02:29:47 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:29:47 - XML: Start document: iteration 8
Sat 18 Jan 2014 02:29:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:29:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:29:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:29:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:29:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:29:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:29:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:29:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:29:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:29:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:29:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:30:01 - XML: Processed 649956 elements - found 624 jobs
Sat 18 Jan 2014 02:30:01 - job 7348757 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 02:30:02 - job 7348756 field 'start_timestamp' changed since saved from: 1390008496 to: 1390008426
Sat 18 Jan 2014 02:30:02 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 02:30:02 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 02:30:02 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 02:30:02 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:30:02 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:30:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:30:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:30:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:30:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:30:03 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:30:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 02:30:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:30:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:30:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:30:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:30:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:30:04 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 02:30:04 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 02:30:04 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:30:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:30:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43181449
Sat 18 Jan 2014 02:30:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:30:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43181449
Sat 18 Jan 2014 02:30:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:30:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:30:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:30:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:30:14 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:30:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:30:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:30:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:30:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:30:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:30:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:30:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:30:17 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:30:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:30:18 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:30:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:30:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:30:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:30:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:30:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:30:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:30:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:30:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43242000
Sat 18 Jan 2014 02:30:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:30:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43242000
Sat 18 Jan 2014 02:30:20 - job_xml_thread(): Done retrieving: data size 43242000
Sat 18 Jan 2014 02:30:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:30:20 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:30:20 - XML: Start document: iteration 9
Sat 18 Jan 2014 02:30:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:30:25 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:30:25 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:30:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 02:30:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:30:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 02:30:26 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:30:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8733 values 137716 bits 17214 bytes 
Sat 18 Jan 2014 02:30:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:30:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:30:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:30:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:30:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:30:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:30:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:30:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:30:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:30:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:30:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:30:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:30:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:30:39 - XML: Processed 647892 elements - found 624 jobs
Sat 18 Jan 2014 02:30:39 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:30:39 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:30:39 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:30:39 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:30:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:30:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:30:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:30:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:30:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:30:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:30:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:30:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:30:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:30:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43779465
Sat 18 Jan 2014 02:30:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:30:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43779465
Sat 18 Jan 2014 02:30:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:30:48 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:30:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 02:30:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:30:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:30:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:30:54 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:30:54 - job_xml_thread(): Done retrieving: data size 43779465
Sat 18 Jan 2014 02:30:54 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:30:54 - XML: Start document: iteration 10
Sat 18 Jan 2014 02:30:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:30:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:30:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:30:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:30:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:30:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:31:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:31:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:31:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:31:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:31:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:31:05 - XML: Processed 654286 elements - found 624 jobs
Sat 18 Jan 2014 02:31:05 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:31:05 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:31:05 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:31:05 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:31:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:31:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:31:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:31:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:31:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:31:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:31:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:31:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:31:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:31:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43841837
Sat 18 Jan 2014 02:31:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:31:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43841837
Sat 18 Jan 2014 02:31:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:31:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:31:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:31:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:31:18 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:31:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:31:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:31:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:31:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:31:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:31:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:31:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:31:20 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:31:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:31:22 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:31:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:31:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43861663
Sat 18 Jan 2014 02:31:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:31:24 - job_xml_thread(): Done retrieving: data size 43861663
Sat 18 Jan 2014 02:31:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:31:24 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:31:24 - XML: Start document: iteration 11
Sat 18 Jan 2014 02:31:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:31:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:31:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:31:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:31:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43861663
Sat 18 Jan 2014 02:31:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:31:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:31:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:31:26 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:31:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:31:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 02:31:26 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:31:26 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:31:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 02:31:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9413 values 148778 bits 18597 bytes 
Sat 18 Jan 2014 02:31:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:31:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:31:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:31:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:31:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:31:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:31:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:31:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:31:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:31:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:31:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:31:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:31:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:31:44 - XML: Processed 655454 elements - found 624 jobs
Sat 18 Jan 2014 02:31:44 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:31:44 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:31:44 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:31:44 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:31:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:31:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:31:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:31:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:31:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:31:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:31:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:31:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:31:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:31:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43859691
Sat 18 Jan 2014 02:31:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:31:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43859691
Sat 18 Jan 2014 02:31:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:31:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:31:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:31:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:31:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:31:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:31:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:31:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:31:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:31:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:31:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:31:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43859691
Sat 18 Jan 2014 02:31:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:31:59 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:31:59 - job_xml_thread(): Done retrieving: data size 43859691
Sat 18 Jan 2014 02:32:00 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:32:00 - XML: Start document: iteration 12
Sat 18 Jan 2014 02:32:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:32:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:32:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:32:11 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:32:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:32:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:32:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:32:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:32:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:32:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:32:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:32:17 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:32:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 02:32:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:32:17 - XML: Processed 655454 elements - found 624 jobs
Sat 18 Jan 2014 02:32:17 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:32:17 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:32:17 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:32:17 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:32:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:32:18 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:32:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:32:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:32:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:32:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:32:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:32:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:32:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:32:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867587
Sat 18 Jan 2014 02:32:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:32:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43867587
Sat 18 Jan 2014 02:32:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:32:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:32:26 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:32:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:32:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 02:32:27 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:32:27 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:32:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 02:32:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6145 values 97187 bits 12148 bytes 
Sat 18 Jan 2014 02:32:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:32:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:32:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:32:32 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:32:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:32:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:32:32 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:32:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:32:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:32:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:32:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:32:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:32:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:32:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:32:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:32:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:32:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:32:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:32:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:32:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:32:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:32:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:32:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:32:38 - job_xml_thread(): Done retrieving: data size 43853565
Sat 18 Jan 2014 02:32:38 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:32:38 - XML: Start document: iteration 13
Sat 18 Jan 2014 02:32:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853565
Sat 18 Jan 2014 02:32:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853565
Sat 18 Jan 2014 02:32:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:32:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:32:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:32:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:32:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:32:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:32:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:32:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:32:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:32:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:32:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:32:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:32:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:32:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:32:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:33:00 - XML: Processed 655450 elements - found 623 jobs
Sat 18 Jan 2014 02:33:00 - job 7348687 appears to have finished
Sat 18 Jan 2014 02:33:00 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 02:33:00 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 02:33:01 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 02:33:01 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:33:01 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:33:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:33:01 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:33:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:33:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:33:01 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:33:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 02:33:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:33:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:33:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:33:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:33:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:33:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:33:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873337
Sat 18 Jan 2014 02:33:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:33:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873337
Sat 18 Jan 2014 02:33:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:33:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:33:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:33:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:33:13 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:33:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:33:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:33:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:33:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:33:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:33:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:33:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:33:16 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:33:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:33:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:33:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:33:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:33:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:33:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:33:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:33:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:33:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:33:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:33:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:33:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875769
Sat 18 Jan 2014 02:33:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:33:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875769
Sat 18 Jan 2014 02:33:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:33:20 - job_xml_thread(): Done retrieving: data size 43875769
Sat 18 Jan 2014 02:33:20 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:33:20 - XML: Start document: iteration 14
Sat 18 Jan 2014 02:33:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:33:28 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:33:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:33:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 02:33:29 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:33:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8996 values 142214 bits 17776 bytes 
Sat 18 Jan 2014 02:33:29 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:33:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 02:33:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:33:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:33:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:33:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:33:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:33:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:33:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:33:37 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:33:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:33:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:33:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:33:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:33:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:33:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:33:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:33:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:33:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:33:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:33:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:33:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:33:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:33:41 - XML: Processed 655450 elements - found 623 jobs
Sat 18 Jan 2014 02:33:41 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:33:41 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:33:41 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:33:41 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:33:43 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 02:33:43 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:33:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:33:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43867535
Sat 18 Jan 2014 02:33:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:33:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867535
Sat 18 Jan 2014 02:33:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:33:44 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:33:44 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 02:33:44 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 02:33:44 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:33:44 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 02:33:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:33:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:33:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:33:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:33:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sat 18 Jan 2014 02:33:56 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:33:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:33:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:33:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:33:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:33:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:33:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:33:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:33:56 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:34:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:34:01 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:34:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:34:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:34:01 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:34:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 02:34:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:34:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:34:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:34:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:34:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:34:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:34:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43871682
Sat 18 Jan 2014 02:34:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:34:03 - job_xml_thread(): Done retrieving: data size 43871682
Sat 18 Jan 2014 02:34:03 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:34:03 - XML: Start document: iteration 15
Sat 18 Jan 2014 02:34:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43871682
Sat 18 Jan 2014 02:34:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:34:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:34:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:34:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:34:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:34:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:34:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:34:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:34:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:34:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:34:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:34:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:34:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:34:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:34:21 - XML: Processed 655452 elements - found 623 jobs
Sat 18 Jan 2014 02:34:21 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:34:21 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:34:21 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:34:21 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:34:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:34:23 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:34:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:34:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:34:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:34:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:34:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:34:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:34:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:34:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43850791
Sat 18 Jan 2014 02:34:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:34:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43850791
Sat 18 Jan 2014 02:34:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:34:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:34:30 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:34:31 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:34:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:34:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 02:34:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 02:34:31 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:34:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8819 values 139082 bits 17385 bytes 
Sat 18 Jan 2014 02:34:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:34:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:34:36 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:34:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:34:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:34:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:34:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:34:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:34:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:34:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:34:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:34:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:34:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:34:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:34:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:34:41 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:34:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:34:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:34:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:34:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:34:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:34:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:34:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:34:43 - job_xml_thread(): Done retrieving: data size 43854524
Sat 18 Jan 2014 02:34:43 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:34:43 - XML: Start document: iteration 16
Sat 18 Jan 2014 02:34:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43854524
Sat 18 Jan 2014 02:34:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:34:44 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:34:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43854524
Sat 18 Jan 2014 02:34:44 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:34:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:34:45 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:34:45 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 02:34:45 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:34:45 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 02:34:45 - Entering storeMetrics(): cluster LISA Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sat 18 Jan 2014 02:34:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:34:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:34:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:34:56 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:34:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:34:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:34:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:34:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:34:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:34:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:34:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:34:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:34:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:35:03 - XML: Processed 655452 elements - found 623 jobs
Sat 18 Jan 2014 02:35:03 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:35:03 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:35:03 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:35:03 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:35:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:35:05 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:35:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:35:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:35:05 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:35:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 02:35:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:35:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:35:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:35:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:35:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:35:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:35:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43863535
Sat 18 Jan 2014 02:35:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:35:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43863535
Sat 18 Jan 2014 02:35:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:35:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:35:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:35:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:35:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:35:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:35:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:35:18 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:35:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:35:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:35:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:35:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:35:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:35:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:35:20 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:35:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:35:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:35:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:35:21 - job_xml_thread(): Done retrieving: data size 43812597
Sat 18 Jan 2014 02:35:21 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:35:21 - XML: Start document: iteration 17
Sat 18 Jan 2014 02:35:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43812597
Sat 18 Jan 2014 02:35:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:35:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:35:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:35:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:35:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:35:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43812597
Sat 18 Jan 2014 02:35:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:35:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:35:33 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:35:34 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:35:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:35:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 02:35:34 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:35:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8950 values 141190 bits 17648 bytes 
Sat 18 Jan 2014 02:35:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 02:35:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:35:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:35:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:35:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:35:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:35:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:35:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:35:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:35:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:35:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:35:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:35:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:35:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:35:42 - XML: Processed 654704 elements - found 623 jobs
Sat 18 Jan 2014 02:35:42 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:35:42 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:35:42 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:35:42 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:35:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:35:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:35:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:35:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:35:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:35:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:35:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:35:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:35:45 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:35:45 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:35:46 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:35:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 02:35:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:35:46 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:35:46 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 02:35:46 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:35:46 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 02:35:46 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 02:35:47 - size of cluster 'LISA Cluster': 624 hosts 79461 metrics 960151 values 15162687 bits 1895335 bytes 
Sat 18 Jan 2014 02:35:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:35:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43252603
Sat 18 Jan 2014 02:35:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:35:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43252603
Sat 18 Jan 2014 02:35:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:35:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:35:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:35:57 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:35:57 - job_xml_thread(): Done retrieving: data size 43252603
Sat 18 Jan 2014 02:35:57 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:35:57 - XML: Start document: iteration 18
Sat 18 Jan 2014 02:36:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:36:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:36:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:36:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:36:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:36:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:36:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:36:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:36:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:36:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:36:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:36:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:36:05 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:36:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:36:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:36:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:36:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:36:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:36:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:36:09 - XML: Processed 648036 elements - found 624 jobs
Sat 18 Jan 2014 02:36:09 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 02:36:09 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 02:36:09 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 02:36:09 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:36:09 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:36:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:36:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43242695
Sat 18 Jan 2014 02:36:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:36:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43242695
Sat 18 Jan 2014 02:36:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:36:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:36:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:36:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:36:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:36:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:36:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:36:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:36:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:36:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:36:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:36:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:36:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43242695
Sat 18 Jan 2014 02:36:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:36:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:36:24 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:36:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:36:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:36:31 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:36:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:36:34 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:36:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:36:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:36:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:36:34 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:36:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:36:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:36:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:36:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:36:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:36:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 02:36:35 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:36:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 02:36:35 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:36:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99109 bits 12388 bytes 
Sat 18 Jan 2014 02:36:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:36:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:36:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:36:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:36:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:36:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:36:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:36:38 - job_xml_thread(): Done retrieving: data size 43427331
Sat 18 Jan 2014 02:36:38 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:36:38 - XML: Start document: iteration 19
Sat 18 Jan 2014 02:36:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43427331
Sat 18 Jan 2014 02:36:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:36:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43427331
Sat 18 Jan 2014 02:36:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:36:46 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:36:46 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 02:36:48 - XML: Processed 650173 elements - found 624 jobs
Sat 18 Jan 2014 02:36:48 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:36:49 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:36:49 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:36:49 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:36:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:36:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:36:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:36:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:36:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:36:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:36:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:36:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:36:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:36:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:36:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:36:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:36:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:37:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:37:02 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:37:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:37:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:37:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:37:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:37:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:37:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:37:03 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:37:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 02:37:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:37:03 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 02:37:03 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 02:37:03 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:37:04 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:37:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:37:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851929
Sat 18 Jan 2014 02:37:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:37:06 - job_xml_thread(): Done retrieving: data size 43851929
Sat 18 Jan 2014 02:37:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851929
Sat 18 Jan 2014 02:37:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:37:06 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:37:06 - XML: Start document: iteration 20
Sat 18 Jan 2014 02:37:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:37:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:37:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:37:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:37:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:37:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:37:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:37:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:37:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:37:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:37:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:37:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:37:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:37:27 - XML: Processed 655178 elements - found 624 jobs
Sat 18 Jan 2014 02:37:27 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:37:27 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:37:27 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:37:27 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:37:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:37:29 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:37:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:37:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:37:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:37:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:37:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:37:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:37:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:37:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858019
Sat 18 Jan 2014 02:37:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:37:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43858019
Sat 18 Jan 2014 02:37:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:37:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:37:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:37:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:37:35 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:37:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:37:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 02:37:39 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:37:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 02:37:39 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:37:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8178 values 128974 bits 16121 bytes 
Sat 18 Jan 2014 02:37:42 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:37:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:37:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:37:45 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:37:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:37:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:37:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:37:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:37:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:37:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:37:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:37:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:37:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:37:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:37:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:37:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:37:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:37:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:37:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:37:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:37:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:37:50 - job_xml_thread(): Done retrieving: data size 43868916
Sat 18 Jan 2014 02:37:50 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:37:50 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 02:37:50 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 02:37:50 - Housekeeping: done.
Sat 18 Jan 2014 02:37:50 - XML: Start document: iteration 0
Sat 18 Jan 2014 02:37:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43868916
Sat 18 Jan 2014 02:37:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43868916
Sat 18 Jan 2014 02:37:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:37:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:38:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:38:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:38:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:38:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:38:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:38:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:38:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:38:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:38:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:38:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:38:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:38:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:38:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:38:09 - XML: Processed 655454 elements - found 624 jobs
Sat 18 Jan 2014 02:38:09 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:38:09 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:38:09 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:38:09 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:38:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:38:13 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:38:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:38:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:38:13 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:38:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 02:38:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:38:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:38:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:38:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:38:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:38:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:38:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858153
Sat 18 Jan 2014 02:38:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:38:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43858153
Sat 18 Jan 2014 02:38:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:38:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:38:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:38:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:38:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:38:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:38:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:38:24 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:38:24 - job_xml_thread(): Done retrieving: data size 43858153
Sat 18 Jan 2014 02:38:24 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:38:24 - XML: Start document: iteration 1
Sat 18 Jan 2014 02:38:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:38:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:38:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858153
Sat 18 Jan 2014 02:38:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:38:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:38:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:38:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:38:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:38:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:38:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:38:39 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:38:40 - XML: Processed 655454 elements - found 624 jobs
Sat 18 Jan 2014 02:38:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:38:40 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:38:40 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:38:40 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:38:40 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:38:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:38:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:38:40 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:38:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 02:38:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:38:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:38:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 02:38:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:38:41 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:38:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5723 values 90244 bits 11280 bytes 
Sat 18 Jan 2014 02:38:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:38:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:38:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:38:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:38:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:38:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:38:42 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:38:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:38:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:38:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:38:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:38:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:38:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:38:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:38:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43886002
Sat 18 Jan 2014 02:38:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:38:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43886002
Sat 18 Jan 2014 02:38:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:38:53 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:38:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 02:38:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:38:55 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:38:55 - job_xml_thread(): Done retrieving: data size 43886002
Sat 18 Jan 2014 02:38:55 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:38:55 - XML: Start document: iteration 2
Sat 18 Jan 2014 02:38:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:38:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:38:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:38:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:38:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:38:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:38:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:38:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:38:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:38:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:38:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:38:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:38:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:39:06 - XML: Processed 655454 elements - found 624 jobs
Sat 18 Jan 2014 02:39:06 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:39:06 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:39:06 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:39:06 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:39:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:39:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:39:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:39:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:39:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:39:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:39:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:39:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:39:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:39:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43834773
Sat 18 Jan 2014 02:39:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:39:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43834773
Sat 18 Jan 2014 02:39:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:39:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:39:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:39:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:39:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:39:22 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:39:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:39:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:39:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:39:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:39:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:39:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:39:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:39:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:39:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:39:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:39:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:39:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:39:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:39:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:39:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:39:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:39:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:39:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:39:26 - job_xml_thread(): Done retrieving: data size 43862164
Sat 18 Jan 2014 02:39:26 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:39:26 - XML: Start document: iteration 3
Sat 18 Jan 2014 02:39:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862164
Sat 18 Jan 2014 02:39:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:39:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862164
Sat 18 Jan 2014 02:39:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:39:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:39:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:39:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:39:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:39:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:39:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:39:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:39:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:39:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:39:41 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:39:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:39:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:39:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:39:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:39:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:39:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 02:39:41 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:39:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:39:41 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:39:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 02:39:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9404 values 148338 bits 18542 bytes 
Sat 18 Jan 2014 02:39:45 - XML: Processed 655454 elements - found 624 jobs
Sat 18 Jan 2014 02:39:45 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:39:45 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:39:45 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:39:45 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:39:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:39:49 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:39:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:39:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:39:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:39:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:39:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:39:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:39:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:39:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43836949
Sat 18 Jan 2014 02:39:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:39:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43836949
Sat 18 Jan 2014 02:39:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:39:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:39:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:40:00 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:40:00 - job_xml_thread(): Done retrieving: data size 43836949
Sat 18 Jan 2014 02:40:00 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:40:00 - XML: Start document: iteration 4
Sat 18 Jan 2014 02:40:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:40:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:40:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:40:10 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:40:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:40:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:40:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:40:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:40:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:40:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:40:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:40:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:40:16 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:40:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:40:16 - XML: Processed 655447 elements - found 623 jobs
Sat 18 Jan 2014 02:40:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:40:16 - job 7348132 appears to have finished
Sat 18 Jan 2014 02:40:16 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 02:40:16 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 02:40:16 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 02:40:16 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:40:16 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:40:17 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:40:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 02:40:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:40:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:40:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:40:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:40:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:40:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:40:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43874058
Sat 18 Jan 2014 02:40:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:40:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43874058
Sat 18 Jan 2014 02:40:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:40:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:40:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:40:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:40:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:40:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:40:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:40:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:40:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:40:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:40:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:40:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:40:31 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:40:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:40:32 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:40:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:40:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:40:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:40:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:40:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:40:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:40:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:40:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43877717
Sat 18 Jan 2014 02:40:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:40:34 - job_xml_thread(): Done retrieving: data size 43877717
Sat 18 Jan 2014 02:40:34 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:40:34 - XML: Start document: iteration 5
Sat 18 Jan 2014 02:40:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43877717
Sat 18 Jan 2014 02:40:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:40:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:40:41 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:40:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:40:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 02:40:42 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:40:42 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:40:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8726 values 137616 bits 17202 bytes 
Sat 18 Jan 2014 02:40:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 02:40:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:40:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:40:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:40:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:40:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:40:49 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:40:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:40:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:40:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:40:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:40:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:40:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:40:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:40:53 - XML: Processed 655451 elements - found 623 jobs
Sat 18 Jan 2014 02:40:53 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:40:53 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:40:53 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:40:53 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:40:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:40:57 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:40:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:40:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:40:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:40:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:40:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:40:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:41:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:41:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851006
Sat 18 Jan 2014 02:41:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:41:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851006
Sat 18 Jan 2014 02:41:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:41:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:41:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:41:08 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:41:08 - job_xml_thread(): Done retrieving: data size 43851006
Sat 18 Jan 2014 02:41:08 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:41:08 - XML: Start document: iteration 6
Sat 18 Jan 2014 02:41:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:41:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:41:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:41:13 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:41:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:41:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:41:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:41:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:41:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:41:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:41:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:41:19 - XML: Processed 655452 elements - found 623 jobs
Sat 18 Jan 2014 02:41:19 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:41:19 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:41:19 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:41:19 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:41:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:41:22 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:41:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:41:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:41:23 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:41:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 02:41:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:41:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:41:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:41:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:41:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:41:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:41:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43765283
Sat 18 Jan 2014 02:41:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:41:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43765283
Sat 18 Jan 2014 02:41:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:41:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:41:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:41:34 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:41:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:41:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:41:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:41:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:41:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:41:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:41:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:41:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:41:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:41:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:41:38 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:41:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:41:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:41:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:41:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:41:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:41:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:41:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:41:40 - job_xml_thread(): Done retrieving: data size 43296655
Sat 18 Jan 2014 02:41:40 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:41:40 - XML: Start document: iteration 7
Sat 18 Jan 2014 02:41:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43296655
Sat 18 Jan 2014 02:41:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43296655
Sat 18 Jan 2014 02:41:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:41:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:41:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:41:42 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:41:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:41:44 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:41:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 02:41:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 02:41:45 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:41:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8828 values 139170 bits 17396 bytes 
Sat 18 Jan 2014 02:41:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:41:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:41:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:41:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:41:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:41:56 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:41:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:41:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:41:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:41:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:41:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:41:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:41:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:42:00 - XML: Processed 648620 elements - found 623 jobs
Sat 18 Jan 2014 02:42:00 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:42:00 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:42:00 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:42:00 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:42:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:42:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:42:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:42:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:42:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:42:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:42:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:42:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:42:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:42:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43209377
Sat 18 Jan 2014 02:42:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:42:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43209377
Sat 18 Jan 2014 02:42:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:42:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:42:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:42:15 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:42:15 - job_xml_thread(): Done retrieving: data size 43209377
Sat 18 Jan 2014 02:42:15 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:42:15 - XML: Start document: iteration 8
Sat 18 Jan 2014 02:42:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:42:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:42:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:42:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:42:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:42:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:42:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:42:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:42:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:42:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:42:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:42:24 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:42:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 02:42:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:42:26 - XML: Processed 647254 elements - found 622 jobs
Sat 18 Jan 2014 02:42:26 - job 7348399 appears to have finished
Sat 18 Jan 2014 02:42:26 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 02:42:26 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 02:42:27 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 02:42:27 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:42:27 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:42:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:42:29 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:42:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:42:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:42:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:42:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:42:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:42:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:42:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:42:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43242776
Sat 18 Jan 2014 02:42:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:42:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43242776
Sat 18 Jan 2014 02:42:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:42:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:42:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:42:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:42:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:42:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:42:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:42:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:42:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:42:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:42:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:42:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:42:42 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:42:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:42:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:42:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:42:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:42:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:42:45 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:42:45 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:42:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:42:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 02:42:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 02:42:45 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:42:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5791 values 91353 bits 11419 bytes 
Sat 18 Jan 2014 02:42:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:42:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:42:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:42:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:42:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:42:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43796461
Sat 18 Jan 2014 02:42:46 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 02:42:46 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:42:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:42:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43796461
Sat 18 Jan 2014 02:42:47 - job_xml_thread(): Done retrieving: data size 43796461
Sat 18 Jan 2014 02:42:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:42:47 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:42:47 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 02:42:47 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 02:42:47 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:42:47 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:42:47 - XML: Start document: iteration 9
Sat 18 Jan 2014 02:42:47 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 02:42:55 - size of cluster 'LISA Cluster': 624 hosts 79468 metrics 927508 values 14635176 bits 1829397 bytes 
Sat 18 Jan 2014 02:42:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:42:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:43:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:43:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:43:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:43:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:43:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:43:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:43:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:43:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:43:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:43:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:43:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:43:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:43:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:43:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:43:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:43:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:43:10 - XML: Processed 654478 elements - found 622 jobs
Sat 18 Jan 2014 02:43:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:43:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:43:10 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:43:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:43:10 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:43:10 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:43:10 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:43:13 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:43:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 02:43:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:43:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:43:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851760
Sat 18 Jan 2014 02:43:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:43:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851760
Sat 18 Jan 2014 02:43:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:43:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:43:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:43:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:43:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:43:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:43:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:43:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:43:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:43:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851760
Sat 18 Jan 2014 02:43:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:43:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:43:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:43:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:43:25 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:43:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:43:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:43:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:43:34 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:43:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:43:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:43:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:43:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:43:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:43:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:43:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:43:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:43:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:43:39 - job_xml_thread(): Done retrieving: data size 43828829
Sat 18 Jan 2014 02:43:39 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:43:39 - XML: Start document: iteration 10
Sat 18 Jan 2014 02:43:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43828829
Sat 18 Jan 2014 02:43:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:43:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:43:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:43:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:43:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:43:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43828829
Sat 18 Jan 2014 02:43:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:43:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:43:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:43:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:43:45 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:43:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:43:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 02:43:46 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:43:46 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:43:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 02:43:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7363 values 116122 bits 14515 bytes 
Sat 18 Jan 2014 02:43:47 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:43:47 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 02:43:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:43:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:43:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:43:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:43:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:43:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:43:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:43:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:43:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:43:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:43:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:43:59 - XML: Processed 655450 elements - found 622 jobs
Sat 18 Jan 2014 02:43:59 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:43:59 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:44:00 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:44:00 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:44:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:44:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:44:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:44:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:44:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:44:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:44:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:44:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:44:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:44:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853031
Sat 18 Jan 2014 02:44:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:44:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853031
Sat 18 Jan 2014 02:44:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:44:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:44:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:44:15 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:44:15 - job_xml_thread(): Done retrieving: data size 43853031
Sat 18 Jan 2014 02:44:15 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:44:15 - XML: Start document: iteration 11
Sat 18 Jan 2014 02:44:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:44:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:44:20 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:44:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 02:44:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:44:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:44:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:44:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:44:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:44:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:44:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:44:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:44:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:44:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:44:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:44:31 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:44:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:44:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:44:31 - XML: Processed 655448 elements - found 622 jobs
Sat 18 Jan 2014 02:44:31 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:44:31 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:44:31 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:44:31 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:44:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:44:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:44:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:44:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:44:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:44:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855325
Sat 18 Jan 2014 02:44:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:44:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855325
Sat 18 Jan 2014 02:44:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:44:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:44:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:44:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:44:44 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:44:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:44:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:44:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:44:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:44:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:44:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:44:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:44:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:44:46 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:44:46 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:44:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:44:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:44:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:44:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 02:44:48 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:44:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5962 values 94073 bits 11759 bytes 
Sat 18 Jan 2014 02:44:48 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:44:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 02:44:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:44:49 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:44:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:44:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:44:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:44:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:44:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:44:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:44:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:44:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855067
Sat 18 Jan 2014 02:44:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:44:54 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:44:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 02:44:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:44:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855067
Sat 18 Jan 2014 02:44:54 - job_xml_thread(): Done retrieving: data size 43855067
Sat 18 Jan 2014 02:44:54 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:44:54 - XML: Start document: iteration 12
Sat 18 Jan 2014 02:44:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:45:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:45:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:45:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:45:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:45:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:45:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:45:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:45:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:45:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:45:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:45:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:45:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:45:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:45:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:45:16 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:45:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:45:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:45:16 - XML: Processed 655450 elements - found 622 jobs
Sat 18 Jan 2014 02:45:16 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:45:16 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:45:16 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:45:16 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:45:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:45:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:45:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:45:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:45:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:45:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851313
Sat 18 Jan 2014 02:45:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:45:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851313
Sat 18 Jan 2014 02:45:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:45:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:45:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:45:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:45:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:45:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:45:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:45:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:45:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:45:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:45:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:45:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:45:31 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:45:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:45:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:45:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:45:34 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:45:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:45:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:45:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:45:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:45:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:45:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:45:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:45:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43846420
Sat 18 Jan 2014 02:45:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:45:37 - job_xml_thread(): Done retrieving: data size 43846420
Sat 18 Jan 2014 02:45:37 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:45:37 - XML: Start document: iteration 13
Sat 18 Jan 2014 02:45:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43846420
Sat 18 Jan 2014 02:45:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:45:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:45:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:45:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:45:48 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:45:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:45:49 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:45:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 02:45:49 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:45:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9279 values 146439 bits 18304 bytes 
Sat 18 Jan 2014 02:45:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 02:45:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:45:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:45:52 - XML: Processed 655450 elements - found 622 jobs
Sat 18 Jan 2014 02:45:52 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:45:52 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:45:52 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:45:52 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:45:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:45:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:45:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:45:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:45:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:45:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:45:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:45:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:45:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:46:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:46:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:46:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:46:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:46:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:46:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:46:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:46:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:46:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:46:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43874840
Sat 18 Jan 2014 02:46:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:46:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43874840
Sat 18 Jan 2014 02:46:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:46:08 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:46:08 - job_xml_thread(): Done retrieving: data size 43874840
Sat 18 Jan 2014 02:46:08 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:46:08 - XML: Start document: iteration 14
Sat 18 Jan 2014 02:46:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:46:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:46:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:46:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:46:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:46:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:46:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:46:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:46:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:46:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:46:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:46:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:46:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:46:24 - XML: Processed 655444 elements - found 621 jobs
Sat 18 Jan 2014 02:46:24 - job 7348636 appears to have finished
Sat 18 Jan 2014 02:46:25 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 02:46:25 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 02:46:25 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 02:46:25 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:46:25 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:46:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:46:28 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:46:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:46:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:46:28 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:46:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 02:46:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:46:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:46:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:46:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:46:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:46:30 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 02:46:30 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 02:46:30 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:46:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:46:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43845578
Sat 18 Jan 2014 02:46:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:46:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43845578
Sat 18 Jan 2014 02:46:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:46:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:46:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:46:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:46:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:46:40 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:46:40 - job_xml_thread(): Done retrieving: data size 43845578
Sat 18 Jan 2014 02:46:40 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:46:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:46:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:46:40 - XML: Start document: iteration 15
Sat 18 Jan 2014 02:46:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:46:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:46:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43845578
Sat 18 Jan 2014 02:46:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:46:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:46:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:46:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:46:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:46:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:46:50 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:46:50 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:46:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 02:46:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:46:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 02:46:52 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:46:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6021 values 95218 bits 11902 bytes 
Sat 18 Jan 2014 02:46:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:46:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:46:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:46:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:46:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:46:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:46:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:46:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:46:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:46:56 - XML: Processed 655444 elements - found 619 jobs
Sat 18 Jan 2014 02:46:56 - job 7348635 appears to have finished
Sat 18 Jan 2014 02:46:56 - job 7348648 appears to have finished
Sat 18 Jan 2014 02:46:56 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 02:46:56 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 02:46:57 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 02:46:57 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:46:57 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:47:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:47:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:47:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:47:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:47:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:47:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:47:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:47:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:47:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:47:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43892817
Sat 18 Jan 2014 02:47:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:47:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43892817
Sat 18 Jan 2014 02:47:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:47:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:47:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:47:12 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:47:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:47:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:47:15 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:47:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:47:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:47:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:47:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:47:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:47:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:47:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:47:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:47:17 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:47:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 02:47:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:47:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:47:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:47:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:47:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:47:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:47:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:47:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:47:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:47:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:47:18 - job_xml_thread(): Done retrieving: data size 43804071
Sat 18 Jan 2014 02:47:18 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:47:18 - XML: Start document: iteration 16
Sat 18 Jan 2014 02:47:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43804071
Sat 18 Jan 2014 02:47:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:47:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43804071
Sat 18 Jan 2014 02:47:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:47:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:47:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:47:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:47:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:47:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:47:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:47:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:47:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:47:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:47:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:47:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:47:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:47:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:47:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:47:43 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:47:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:47:43 - XML: Processed 654693 elements - found 619 jobs
Sat 18 Jan 2014 02:47:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:47:43 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:47:43 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:47:43 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:47:43 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:47:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:47:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:47:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:47:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:47:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:47:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43267170
Sat 18 Jan 2014 02:47:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:47:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43267170
Sat 18 Jan 2014 02:47:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:47:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:47:52 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:47:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:47:53 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:47:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:47:54 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:47:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 02:47:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 02:47:54 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:47:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:47:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9080 values 143732 bits 17966 bytes 
Sat 18 Jan 2014 02:47:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:47:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:47:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:47:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:47:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:47:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:47:58 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:47:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:47:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:48:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:48:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:48:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:48:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:48:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:48:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:48:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:48:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:48:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:48:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43218566
Sat 18 Jan 2014 02:48:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:48:03 - job_xml_thread(): Done retrieving: data size 43218566
Sat 18 Jan 2014 02:48:03 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:48:03 - XML: Start document: iteration 17
Sat 18 Jan 2014 02:48:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43218566
Sat 18 Jan 2014 02:48:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:48:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:48:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:48:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:48:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:48:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:48:15 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:48:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:48:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:48:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:48:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:48:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:48:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:48:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:48:23 - XML: Processed 647246 elements - found 620 jobs
Sat 18 Jan 2014 02:48:23 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 02:48:23 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 02:48:24 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 02:48:24 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:48:24 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:48:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:48:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:48:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:48:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:48:26 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:48:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 02:48:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:48:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:48:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:48:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:48:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:48:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:48:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43246973
Sat 18 Jan 2014 02:48:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:48:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43246973
Sat 18 Jan 2014 02:48:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:48:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:48:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:48:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:48:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:48:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:48:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:48:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:48:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:48:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:48:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:48:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43246973
Sat 18 Jan 2014 02:48:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:48:39 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:48:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:48:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:48:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:48:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:48:45 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:48:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:48:48 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:48:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:48:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:48:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:48:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:48:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:48:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:48:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:48:49 - job_xml_thread(): Done retrieving: data size 43803823
Sat 18 Jan 2014 02:48:49 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:48:49 - XML: Start document: iteration 18
Sat 18 Jan 2014 02:48:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43803823
Sat 18 Jan 2014 02:48:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:48:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:48:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:48:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:48:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:48:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:48:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:48:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43803823
Sat 18 Jan 2014 02:48:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:48:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:48:54 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:48:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:48:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 02:48:55 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:48:56 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:48:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 02:49:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8836 values 139600 bits 17450 bytes 
Sat 18 Jan 2014 02:49:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:49:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:49:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:49:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:49:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:49:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:49:08 - XML: Processed 654806 elements - found 620 jobs
Sat 18 Jan 2014 02:49:08 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:49:08 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:49:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:49:08 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:49:08 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:49:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:49:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:49:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:49:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:49:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:49:11 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:49:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:49:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:49:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:49:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:49:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:49:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:49:13 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:49:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 02:49:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:49:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:49:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43868632
Sat 18 Jan 2014 02:49:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:49:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43868632
Sat 18 Jan 2014 02:49:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:49:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:49:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:49:23 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:49:23 - job_xml_thread(): Done retrieving: data size 43868632
Sat 18 Jan 2014 02:49:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:49:23 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:49:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:49:23 - XML: Start document: iteration 19
Sat 18 Jan 2014 02:49:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:49:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:49:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:49:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:49:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:49:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:49:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:49:31 - XML: Processed 655446 elements - found 620 jobs
Sat 18 Jan 2014 02:49:31 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:49:31 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:49:31 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:49:31 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:49:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:49:32 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:49:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:49:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:49:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:49:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:49:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:49:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:49:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:49:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43841158
Sat 18 Jan 2014 02:49:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:49:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43841158
Sat 18 Jan 2014 02:49:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:49:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:49:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:49:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:49:42 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:49:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:49:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:49:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:49:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:49:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:49:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:49:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43841158
Sat 18 Jan 2014 02:49:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:49:46 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:49:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:49:47 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 02:49:47 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:49:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:49:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:49:48 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:49:48 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 02:49:48 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:49:48 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 02:49:48 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 02:49:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:49:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:49:56 - size of cluster 'LISA Cluster': 624 hosts 79481 metrics 816735 values 12906074 bits 1613259 bytes 
Sat 18 Jan 2014 02:49:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:49:57 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:49:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:49:57 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:49:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:49:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:49:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:49:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:49:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:49:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:49:58 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:49:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:49:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 02:49:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 02:49:58 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:49:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99128 bits 12391 bytes 
Sat 18 Jan 2014 02:49:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:49:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:49:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:49:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:49:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:49:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:50:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:50:00 - job_xml_thread(): Done retrieving: data size 43846531
Sat 18 Jan 2014 02:50:00 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:50:00 - XML: Start document: iteration 20
Sat 18 Jan 2014 02:50:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43846531
Sat 18 Jan 2014 02:50:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:50:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43846531
Sat 18 Jan 2014 02:50:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:50:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:50:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:50:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:50:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:50:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:50:15 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:50:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:50:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:50:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:50:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:50:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:50:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:50:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:50:20 - XML: Processed 655446 elements - found 620 jobs
Sat 18 Jan 2014 02:50:20 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:50:20 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:50:20 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:50:20 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:50:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:50:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:50:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:50:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:50:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:50:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:50:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:50:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:50:25 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:50:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 02:50:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:50:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:50:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43841522
Sat 18 Jan 2014 02:50:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:50:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43841522
Sat 18 Jan 2014 02:50:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:50:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:50:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:50:35 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:50:35 - job_xml_thread(): Done retrieving: data size 43841522
Sat 18 Jan 2014 02:50:35 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:50:35 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 02:50:35 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 02:50:35 - Housekeeping: done.
Sat 18 Jan 2014 02:50:35 - XML: Start document: iteration 0
Sat 18 Jan 2014 02:50:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:50:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:50:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:50:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:50:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:50:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:50:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:50:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:50:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:50:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:50:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:50:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:50:48 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:50:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:50:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:50:48 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:50:48 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 02:50:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:50:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:50:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:50:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:50:51 - XML: Processed 655446 elements - found 620 jobs
Sat 18 Jan 2014 02:50:51 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:50:51 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:50:51 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:50:51 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:50:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:50:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43834344
Sat 18 Jan 2014 02:50:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:50:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43834344
Sat 18 Jan 2014 02:50:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:50:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:50:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:50:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:50:58 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:50:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:50:59 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:50:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 02:50:59 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:50:59 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7796 values 122976 bits 15372 bytes 
Sat 18 Jan 2014 02:50:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 02:51:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:51:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:51:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:51:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:51:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:51:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:51:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:51:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:51:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:51:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:51:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:51:06 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:51:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:51:10 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:51:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:51:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:51:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:51:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:51:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:51:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:51:13 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:51:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 02:51:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:51:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:51:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43864359
Sat 18 Jan 2014 02:51:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:51:14 - job_xml_thread(): Done retrieving: data size 43864359
Sat 18 Jan 2014 02:51:14 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:51:14 - XML: Start document: iteration 1
Sat 18 Jan 2014 02:51:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43864359
Sat 18 Jan 2014 02:51:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:51:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:51:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:51:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:51:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:51:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:51:32 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:51:33 - XML: Processed 655446 elements - found 620 jobs
Sat 18 Jan 2014 02:51:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:51:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:51:33 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:51:33 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:51:33 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:51:33 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:51:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:51:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:51:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:51:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:51:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:51:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:51:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:51:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:51:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:51:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:51:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:51:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:51:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:51:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:51:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43859334
Sat 18 Jan 2014 02:51:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:51:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43859334
Sat 18 Jan 2014 02:51:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:51:49 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:51:49 - job_xml_thread(): Done retrieving: data size 43859334
Sat 18 Jan 2014 02:51:49 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:51:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:51:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:51:49 - XML: Start document: iteration 2
Sat 18 Jan 2014 02:51:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:51:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:51:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:51:51 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:51:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:51:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:51:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:51:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:51:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:51:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:51:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:51:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:51:59 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:51:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:52:00 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:52:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 02:52:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:52:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:52:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 02:52:00 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:52:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:52:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:52:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99095 bits 12386 bytes 
Sat 18 Jan 2014 02:52:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:52:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:52:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:52:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:52:01 - XML: Processed 655446 elements - found 620 jobs
Sat 18 Jan 2014 02:52:01 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:52:01 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:52:01 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:52:01 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:52:05 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:52:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 02:52:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:52:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:52:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43840047
Sat 18 Jan 2014 02:52:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:52:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43840047
Sat 18 Jan 2014 02:52:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:52:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:52:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:52:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:52:14 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:52:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:52:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:52:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:52:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:52:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:52:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:52:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43840047
Sat 18 Jan 2014 02:52:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:52:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:52:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:52:17 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:52:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:52:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:52:27 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:52:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:52:29 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:52:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:52:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:52:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:52:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:52:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:52:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:52:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:52:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:52:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:52:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:52:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:52:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:52:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:52:32 - job_xml_thread(): Done retrieving: data size 43844263
Sat 18 Jan 2014 02:52:32 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:52:32 - XML: Start document: iteration 3
Sat 18 Jan 2014 02:52:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43844263
Sat 18 Jan 2014 02:52:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:52:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43844263
Sat 18 Jan 2014 02:52:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:52:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:52:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:52:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:52:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:52:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:52:47 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:52:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:52:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:52:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:52:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:52:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:52:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:52:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:52:50 - XML: Processed 655445 elements - found 620 jobs
Sat 18 Jan 2014 02:52:50 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:52:50 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:52:50 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:52:50 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:52:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:52:56 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:52:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:52:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:52:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:52:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:52:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:52:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:52:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:52:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855139
Sat 18 Jan 2014 02:52:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:53:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855139
Sat 18 Jan 2014 02:53:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:53:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:53:00 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:53:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:53:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 02:53:01 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:53:01 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:53:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 02:53:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9279 values 146465 bits 18308 bytes 
Sat 18 Jan 2014 02:53:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:53:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:53:06 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:53:06 - job_xml_thread(): Done retrieving: data size 43855139
Sat 18 Jan 2014 02:53:07 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:53:07 - XML: Start document: iteration 4
Sat 18 Jan 2014 02:53:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:53:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:53:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:53:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:53:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:53:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:53:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:53:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:53:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:53:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:53:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:53:15 - XML: Processed 655446 elements - found 620 jobs
Sat 18 Jan 2014 02:53:15 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:53:15 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:53:15 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:53:15 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:53:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:53:18 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:53:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:53:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:53:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:53:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:53:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:53:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:53:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:53:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43763214
Sat 18 Jan 2014 02:53:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:53:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43763214
Sat 18 Jan 2014 02:53:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:53:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:53:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:53:30 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:53:30 - job_xml_thread(): Done retrieving: data size 43763214
Sat 18 Jan 2014 02:53:30 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:53:30 - XML: Start document: iteration 5
Sat 18 Jan 2014 02:53:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:53:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:53:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:53:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:53:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:53:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:53:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:53:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:53:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:53:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:53:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:53:39 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:53:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 02:53:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:53:41 - XML: Processed 654698 elements - found 620 jobs
Sat 18 Jan 2014 02:53:41 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:53:41 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:53:41 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:53:41 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:53:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:53:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:53:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:53:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:53:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:53:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:53:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:53:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:53:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:53:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43262617
Sat 18 Jan 2014 02:53:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43262617
Sat 18 Jan 2014 02:53:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:53:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:53:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:53:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:53:57 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:53:57 - job_xml_thread(): Done retrieving: data size 43262617
Sat 18 Jan 2014 02:53:57 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:53:57 - XML: Start document: iteration 6
Sat 18 Jan 2014 02:54:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:54:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:54:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:54:01 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:54:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:54:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 02:54:02 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:54:02 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:54:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 02:54:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5974 values 94311 bits 11788 bytes 
Sat 18 Jan 2014 02:54:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:54:03 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:54:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:54:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:54:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:54:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:54:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:54:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:54:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:54:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:54:11 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:54:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:54:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:54:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:54:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:54:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:54:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:54:12 - XML: Processed 648246 elements - found 620 jobs
Sat 18 Jan 2014 02:54:12 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:54:12 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:54:12 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:54:12 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:54:12 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 02:54:12 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 02:54:12 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:54:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:54:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43204393
Sat 18 Jan 2014 02:54:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:54:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43204393
Sat 18 Jan 2014 02:54:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:54:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:54:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:54:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:54:24 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:54:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:54:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:54:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:54:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:54:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:54:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:54:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:54:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:54:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:54:27 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:54:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:54:28 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:54:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:54:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:54:29 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:54:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 02:54:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:54:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:54:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:54:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:54:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:54:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:54:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43389452
Sat 18 Jan 2014 02:54:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:54:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43389452
Sat 18 Jan 2014 02:54:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:54:31 - job_xml_thread(): Done retrieving: data size 43389452
Sat 18 Jan 2014 02:54:31 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:54:31 - XML: Start document: iteration 7
Sat 18 Jan 2014 02:54:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:54:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:54:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:54:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:54:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:54:48 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:54:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:54:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:54:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:54:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:54:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:54:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:54:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:54:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:54:52 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:54:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:54:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:54:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:54:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:54:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:54:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:54:54 - XML: Processed 649376 elements - found 620 jobs
Sat 18 Jan 2014 02:54:54 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:54:54 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:54:54 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:54:54 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:54:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:54:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43835540
Sat 18 Jan 2014 02:54:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:54:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43835540
Sat 18 Jan 2014 02:54:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:55:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:55:03 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:55:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:55:03 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:55:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 02:55:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 02:55:03 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:55:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9011 values 142305 bits 17788 bytes 
Sat 18 Jan 2014 02:55:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:55:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:55:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:55:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:55:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:55:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:55:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:55:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:55:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:55:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:55:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:55:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:55:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:55:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:55:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:55:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:55:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:55:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:55:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:55:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:55:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:55:09 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:55:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:55:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856064
Sat 18 Jan 2014 02:55:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:55:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43856064
Sat 18 Jan 2014 02:55:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:55:12 - job_xml_thread(): Done retrieving: data size 43856064
Sat 18 Jan 2014 02:55:12 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:55:12 - XML: Start document: iteration 8
Sat 18 Jan 2014 02:55:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:55:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:55:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:55:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:55:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:55:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:55:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:55:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:55:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:55:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:55:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:55:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:55:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:55:29 - XML: Processed 655446 elements - found 620 jobs
Sat 18 Jan 2014 02:55:29 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:55:29 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:55:29 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:55:29 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:55:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:55:33 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:55:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:55:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:55:33 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:55:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 02:55:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:55:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:55:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:55:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:55:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:55:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:55:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851209
Sat 18 Jan 2014 02:55:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:55:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851209
Sat 18 Jan 2014 02:55:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:55:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:55:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:55:44 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:55:44 - job_xml_thread(): Done retrieving: data size 43851209
Sat 18 Jan 2014 02:55:44 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:55:44 - XML: Start document: iteration 9
Sat 18 Jan 2014 02:55:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:55:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:55:51 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:55:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:55:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:55:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:55:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:55:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:55:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:55:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:55:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:55:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:55:53 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:55:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:55:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:55:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:55:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:55:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:55:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:55:56 - XML: Processed 655446 elements - found 620 jobs
Sat 18 Jan 2014 02:55:56 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:55:56 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:55:56 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:55:56 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:55:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:55:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43872233
Sat 18 Jan 2014 02:55:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:55:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43872233
Sat 18 Jan 2014 02:55:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:56:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:56:04 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:56:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:56:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 02:56:05 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:56:05 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:56:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 02:56:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8816 values 139073 bits 17384 bytes 
Sat 18 Jan 2014 02:56:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:56:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:56:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:56:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:56:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:56:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:56:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:56:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:56:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:56:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:56:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:56:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:56:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:56:11 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:56:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:56:13 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:56:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:56:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:56:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:56:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:56:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:56:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:56:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:56:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43884278
Sat 18 Jan 2014 02:56:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:56:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43884278
Sat 18 Jan 2014 02:56:16 - job_xml_thread(): Done retrieving: data size 43884278
Sat 18 Jan 2014 02:56:16 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:56:16 - XML: Start document: iteration 10
Sat 18 Jan 2014 02:56:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:56:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:56:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:56:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:56:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:56:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:56:32 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:56:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:56:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:56:33 - XML: Processed 655443 elements - found 619 jobs
Sat 18 Jan 2014 02:56:33 - job 7348759 appears to have finished
Sat 18 Jan 2014 02:56:33 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 02:56:33 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 02:56:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:56:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:56:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:56:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:56:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:56:35 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 02:56:35 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:56:35 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:56:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:56:38 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:56:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:56:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:56:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:56:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:56:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:56:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:56:38 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:56:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 02:56:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:56:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:56:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43866868
Sat 18 Jan 2014 02:56:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:56:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43866868
Sat 18 Jan 2014 02:56:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:56:48 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 02:56:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:56:49 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:56:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:56:49 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:56:49 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:56:49 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 02:56:49 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 02:56:50 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 02:56:50 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:56:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:56:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:56:51 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:56:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:56:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:56:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:56:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:56:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:56:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:56:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:56:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:56:55 - size of cluster 'LISA Cluster': 624 hosts 79485 metrics 827922 values 13062854 bits 1632856 bytes 
Sat 18 Jan 2014 02:56:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:56:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:56:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:56:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:56:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:56:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:56:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:56:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:56:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:56:58 - job_xml_thread(): Done retrieving: data size 43871873
Sat 18 Jan 2014 02:56:58 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:56:58 - XML: Start document: iteration 11
Sat 18 Jan 2014 02:56:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43871873
Sat 18 Jan 2014 02:56:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:56:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43871873
Sat 18 Jan 2014 02:56:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:57:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:57:06 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:57:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:57:06 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:57:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 02:57:06 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:57:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 02:57:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8852 values 139660 bits 17457 bytes 
Sat 18 Jan 2014 02:57:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:57:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:57:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:57:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:57:12 - XML: Processed 655444 elements - found 619 jobs
Sat 18 Jan 2014 02:57:12 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:57:13 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:57:13 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:57:13 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:57:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:57:18 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:57:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:57:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:57:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:57:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:57:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:57:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:57:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:57:19 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:57:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:57:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:57:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:57:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:57:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:57:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:57:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:57:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:57:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43866142
Sat 18 Jan 2014 02:57:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:57:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43866142
Sat 18 Jan 2014 02:57:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:57:29 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:57:29 - job_xml_thread(): Done retrieving: data size 43866142
Sat 18 Jan 2014 02:57:29 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:57:29 - XML: Start document: iteration 12
Sat 18 Jan 2014 02:57:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:57:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:57:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:57:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:57:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:57:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:57:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:57:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:57:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:57:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:57:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:57:42 - XML: Processed 655444 elements - found 619 jobs
Sat 18 Jan 2014 02:57:42 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:57:42 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:57:42 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:57:42 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:57:44 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:57:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 02:57:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:57:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:57:46 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:57:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:57:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:57:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:57:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:57:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:57:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:57:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:57:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43852167
Sat 18 Jan 2014 02:57:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:57:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43852167
Sat 18 Jan 2014 02:57:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:57:50 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:57:50 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 02:57:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:57:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:57:57 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:57:57 - job_xml_thread(): Done retrieving: data size 43852167
Sat 18 Jan 2014 02:57:57 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:57:57 - XML: Start document: iteration 13
Sat 18 Jan 2014 02:57:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:57:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:57:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:57:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:58:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:58:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:58:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:58:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:58:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:58:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:58:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:58:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:58:06 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:58:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:58:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 02:58:07 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:58:07 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:58:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 02:58:07 - XML: Processed 655441 elements - found 619 jobs
Sat 18 Jan 2014 02:58:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5946 values 93878 bits 11734 bytes 
Sat 18 Jan 2014 02:58:08 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:58:08 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:58:08 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:58:08 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:58:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:58:10 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:58:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:58:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:58:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:58:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:58:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:58:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:58:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:58:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855217
Sat 18 Jan 2014 02:58:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:58:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855217
Sat 18 Jan 2014 02:58:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:58:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:58:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:58:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:58:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:58:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:58:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:58:23 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:58:23 - job_xml_thread(): Done retrieving: data size 43855217
Sat 18 Jan 2014 02:58:23 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:58:23 - XML: Start document: iteration 14
Sat 18 Jan 2014 02:58:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:58:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:58:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:58:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855217
Sat 18 Jan 2014 02:58:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:58:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:58:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:58:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:58:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:58:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:58:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:58:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:58:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:58:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:58:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:58:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:58:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:58:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:58:43 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:58:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:58:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:58:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:58:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:58:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:58:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:58:45 - XML: Processed 655444 elements - found 619 jobs
Sat 18 Jan 2014 02:58:45 - job 7335207 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 02:58:45 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 02:58:45 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 02:58:45 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 02:58:45 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:58:45 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:58:45 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:58:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 02:58:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:58:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:58:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855192
Sat 18 Jan 2014 02:58:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:58:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855192
Sat 18 Jan 2014 02:58:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:58:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:58:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:58:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:58:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:58:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:58:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:58:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:58:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:58:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:58:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:58:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:58:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:58:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:59:00 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:59:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:59:04 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:59:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:59:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:59:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:59:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:59:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:59:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:59:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:59:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43847693
Sat 18 Jan 2014 02:59:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:59:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43847693
Sat 18 Jan 2014 02:59:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:59:07 - job_xml_thread(): Done retrieving: data size 43847693
Sat 18 Jan 2014 02:59:07 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:59:07 - XML: Start document: iteration 15
Sat 18 Jan 2014 02:59:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:59:07 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:59:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:59:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 02:59:08 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 02:59:08 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:59:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sat 18 Jan 2014 02:59:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:59:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:59:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:59:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:59:24 - XML: Processed 655442 elements - found 618 jobs
Sat 18 Jan 2014 02:59:24 - job 7335207 field 'start_timestamp' changed since saved from: 1390010247 to: 1390010202
Sat 18 Jan 2014 02:59:24 - job 7348178 appears to have finished
Sat 18 Jan 2014 02:59:25 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 02:59:25 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 02:59:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:59:26 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:59:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:59:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:59:26 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 02:59:26 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:59:26 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:59:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:59:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:59:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:59:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:59:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:59:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:59:30 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:59:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:59:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:59:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:59:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:59:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:59:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:59:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:59:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43413530
Sat 18 Jan 2014 02:59:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:59:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43413530
Sat 18 Jan 2014 02:59:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 02:59:41 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 02:59:41 - job_xml_thread(): Done retrieving: data size 43413530
Sat 18 Jan 2014 02:59:41 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 02:59:41 - XML: Start document: iteration 16
Sat 18 Jan 2014 02:59:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 02:59:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:59:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 02:59:44 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 02:59:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 02:59:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 02:59:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:59:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 02:59:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 02:59:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 02:59:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 02:59:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 02:59:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 02:59:55 - XML: Processed 650054 elements - found 618 jobs
Sat 18 Jan 2014 02:59:55 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 02:59:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 02:59:56 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 02:59:56 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 02:59:56 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 02:59:56 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 02:59:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 02:59:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 02:59:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:59:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 02:59:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 02:59:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 02:59:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 02:59:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43208589
Sat 18 Jan 2014 02:59:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 02:59:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43208589
Sat 18 Jan 2014 02:59:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:00:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:00:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:00:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:00:08 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:00:09 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:00:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 03:00:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:00:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 03:00:10 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:00:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 15014 values 236822 bits 29602 bytes 
Sat 18 Jan 2014 03:00:11 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:00:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:00:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:00:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:00:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:00:14 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:00:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:00:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:00:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:00:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:00:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:00:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:00:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:00:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:00:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:00:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:00:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:00:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:00:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:00:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:00:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:00:19 - job_xml_thread(): Done retrieving: data size 43221195
Sat 18 Jan 2014 03:00:19 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:00:19 - XML: Start document: iteration 17
Sat 18 Jan 2014 03:00:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43221195
Sat 18 Jan 2014 03:00:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:00:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43221195
Sat 18 Jan 2014 03:00:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:00:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:00:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:00:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:00:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:00:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:00:39 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:00:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:00:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:00:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:00:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:00:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:00:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:00:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:00:41 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:00:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 03:00:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:00:42 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 03:00:42 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 03:00:42 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:00:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:00:42 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:00:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:00:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:00:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:00:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:00:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:00:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:00:43 - XML: Processed 647737 elements - found 615 jobs
Sat 18 Jan 2014 03:00:43 - job 7348758 appears to have finished
Sat 18 Jan 2014 03:00:43 - job 7343074 appears to have finished
Sat 18 Jan 2014 03:00:43 - job 7348637 appears to have finished
Sat 18 Jan 2014 03:00:43 - job_xml_thread(): Found 3 updated jobs.
Sat 18 Jan 2014 03:00:43 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 03:00:44 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Sat 18 Jan 2014 03:00:44 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:00:44 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:00:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:00:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43746722
Sat 18 Jan 2014 03:00:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:00:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43746722
Sat 18 Jan 2014 03:00:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:00:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:00:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:00:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:00:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:00:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:00:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:00:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:00:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:00:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:00:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:00:57 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:00:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:00:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:00:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:00:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:00:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:00:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:00:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:00:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43844597
Sat 18 Jan 2014 03:00:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:00:59 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:00:59 - job_xml_thread(): Done retrieving: data size 43844597
Sat 18 Jan 2014 03:00:59 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:00:59 - XML: Start document: iteration 18
Sat 18 Jan 2014 03:00:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43844597
Sat 18 Jan 2014 03:00:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:01:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:01:09 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:01:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:01:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 03:01:10 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:01:10 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:01:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8897 values 140382 bits 17547 bytes 
Sat 18 Jan 2014 03:01:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 03:01:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:01:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:01:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:01:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:01:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:01:19 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:01:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:01:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:01:20 - XML: Processed 654956 elements - found 615 jobs
Sat 18 Jan 2014 03:01:20 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:01:20 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:01:20 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:01:20 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:01:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:01:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:01:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:01:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:01:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:01:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:01:22 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:01:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:01:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:01:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:01:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:01:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:01:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:01:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:01:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43868508
Sat 18 Jan 2014 03:01:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:01:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43868508
Sat 18 Jan 2014 03:01:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:01:35 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:01:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:01:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:01:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:01:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:01:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:01:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:01:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:01:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:01:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:01:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:01:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:01:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:01:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:01:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:01:39 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:01:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:01:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:01:39 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:01:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 03:01:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:01:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:01:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:01:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:01:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:01:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:01:41 - job_xml_thread(): Done retrieving: data size 43864314
Sat 18 Jan 2014 03:01:41 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:01:41 - XML: Start document: iteration 19
Sat 18 Jan 2014 03:01:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43864314
Sat 18 Jan 2014 03:01:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:01:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43864314
Sat 18 Jan 2014 03:01:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:01:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:01:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:01:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:01:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:01:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:01:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:01:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:01:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:02:00 - XML: Processed 655436 elements - found 615 jobs
Sat 18 Jan 2014 03:02:00 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:02:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:02:00 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:02:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:02:00 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:02:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:02:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:02:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:02:00 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:02:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:02:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:02:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:02:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:02:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:02:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:02:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:02:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:02:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:02:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853847
Sat 18 Jan 2014 03:02:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:02:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853847
Sat 18 Jan 2014 03:02:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:02:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:02:12 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:02:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:02:12 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:02:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 03:02:12 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:02:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8948 values 141490 bits 17686 bytes 
Sat 18 Jan 2014 03:02:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 03:02:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:02:15 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:02:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:02:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:02:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:02:18 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:02:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:02:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:02:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:02:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:02:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:02:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:02:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:02:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:02:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:02:20 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:02:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:02:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:02:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:02:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:02:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:02:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:02:22 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:02:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 03:02:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:02:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:02:22 - job_xml_thread(): Done retrieving: data size 43850720
Sat 18 Jan 2014 03:02:22 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:02:22 - XML: Start document: iteration 20
Sat 18 Jan 2014 03:02:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43850720
Sat 18 Jan 2014 03:02:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:02:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43850720
Sat 18 Jan 2014 03:02:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:02:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:02:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:02:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:02:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:02:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:02:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:02:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:02:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:02:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:02:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:02:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:02:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:02:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:02:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:02:46 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:02:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:02:46 - XML: Processed 655432 elements - found 613 jobs
Sat 18 Jan 2014 03:02:46 - job 7348638 appears to have finished
Sat 18 Jan 2014 03:02:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:02:46 - job 7348639 appears to have finished
Sat 18 Jan 2014 03:02:46 - job 7348643 appears to have finished
Sat 18 Jan 2014 03:02:46 - job_xml_thread(): Found 4 updated jobs.
Sat 18 Jan 2014 03:02:46 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 03:02:46 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Sat 18 Jan 2014 03:02:46 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:02:46 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:02:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:02:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:02:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:02:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:02:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:02:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43846592
Sat 18 Jan 2014 03:02:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:02:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43846592
Sat 18 Jan 2014 03:02:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:02:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:02:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:02:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:02:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:02:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:02:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:02:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:02:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:02:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:02:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43846592
Sat 18 Jan 2014 03:02:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:02:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:03:01 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:03:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:03:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:03:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:03:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:03:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:03:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:03:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:03:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:03:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:03:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:03:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:03:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:03:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:03:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:03:11 - job_xml_thread(): Done retrieving: data size 43855733
Sat 18 Jan 2014 03:03:11 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:03:11 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 03:03:11 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 03:03:11 - Housekeeping: done.
Sat 18 Jan 2014 03:03:11 - XML: Start document: iteration 0
Sat 18 Jan 2014 03:03:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855733
Sat 18 Jan 2014 03:03:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:03:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:03:13 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:03:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:03:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:03:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:03:13 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:03:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 03:03:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 03:03:13 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:03:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:03:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:03:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855733
Sat 18 Jan 2014 03:03:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:03:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:03:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:03:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99411 bits 12426 bytes 
Sat 18 Jan 2014 03:03:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:03:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:03:26 - XML: Processed 655432 elements - found 613 jobs
Sat 18 Jan 2014 03:03:27 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:03:27 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:03:27 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:03:27 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:03:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:03:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:03:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:03:35 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:03:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:03:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:03:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:03:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:03:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:03:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:03:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:03:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:03:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:03:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:03:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:03:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:03:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:03:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:03:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:03:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:03:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43871338
Sat 18 Jan 2014 03:03:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:03:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43871338
Sat 18 Jan 2014 03:03:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:03:42 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:03:42 - job_xml_thread(): Done retrieving: data size 43871338
Sat 18 Jan 2014 03:03:42 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:03:42 - XML: Start document: iteration 1
Sat 18 Jan 2014 03:03:50 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 03:03:50 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:03:51 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:03:51 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:03:51 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 03:03:51 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 03:03:51 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 03:03:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:03:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:03:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:03:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:03:59 - XML: Processed 655432 elements - found 613 jobs
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sat 18 Jan 2014 03:03:59 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:03:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:03:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:03:59 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:03:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:03:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:03:59 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:03:59 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:04:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:04:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:04:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:04:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:04:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:04:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:04:02 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:04:02 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:04:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 03:04:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:04:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:04:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:04:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:04:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:04:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:04:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:04:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:04:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858743
Sat 18 Jan 2014 03:04:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:04:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43858743
Sat 18 Jan 2014 03:04:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:04:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:04:14 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:04:15 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:04:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:04:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:04:15 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:04:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 03:04:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:04:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 03:04:15 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:04:15 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:04:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6189 values 97698 bits 12212 bytes 
Sat 18 Jan 2014 03:04:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:04:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:04:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:04:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:04:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:04:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:04:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:04:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:04:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:04:19 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:04:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:04:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:04:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:04:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:04:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:04:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:04:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:04:21 - job_xml_thread(): Done retrieving: data size 43850854
Sat 18 Jan 2014 03:04:21 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:04:21 - XML: Start document: iteration 2
Sat 18 Jan 2014 03:04:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43850854
Sat 18 Jan 2014 03:04:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43850854
Sat 18 Jan 2014 03:04:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:04:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:04:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:04:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:04:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:04:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:04:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:04:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:04:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:04:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:04:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:04:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:04:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:04:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:04:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:04:43 - XML: Processed 655430 elements - found 612 jobs
Sat 18 Jan 2014 03:04:43 - job 7348640 appears to have finished
Sat 18 Jan 2014 03:04:44 - job 7348761 field 'start_timestamp' changed since saved from: 1390010502 to: 1390010500
Sat 18 Jan 2014 03:04:44 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 03:04:44 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 03:04:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:04:44 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 03:04:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:04:44 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:04:44 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:04:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:04:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:04:44 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:04:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 03:04:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:04:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:04:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:04:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:04:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:04:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:04:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43863719
Sat 18 Jan 2014 03:04:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:04:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43863719
Sat 18 Jan 2014 03:04:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:04:51 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:04:51 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:04:52 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:04:52 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:04:52 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 03:04:52 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 03:04:52 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 03:04:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:04:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:04:59 - size of cluster 'LISA Cluster': 624 hosts 79468 metrics 834437 values 13185581 bits 1648197 bytes 
Sat 18 Jan 2014 03:04:59 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:04:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:04:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:04:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:04:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:04:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:05:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:05:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:05:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:05:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:05:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:05:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:05:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:05:02 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:05:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:05:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:05:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:05:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:05:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:05:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:05:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:05:05 - job_xml_thread(): Done retrieving: data size 43849717
Sat 18 Jan 2014 03:05:05 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:05:05 - XML: Start document: iteration 3
Sat 18 Jan 2014 03:05:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43849717
Sat 18 Jan 2014 03:05:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43849717
Sat 18 Jan 2014 03:05:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:05:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:05:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:05:15 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:05:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:05:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:05:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:05:16 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:05:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 03:05:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 03:05:16 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:05:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8924 values 140795 bits 17599 bytes 
Sat 18 Jan 2014 03:05:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:05:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:05:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:05:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:05:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:05:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:05:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:05:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:05:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:05:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:05:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:05:26 - XML: Processed 655430 elements - found 612 jobs
Sat 18 Jan 2014 03:05:26 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:05:26 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:05:26 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:05:26 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:05:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:05:29 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:05:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:05:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:05:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:05:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:05:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:05:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:05:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:05:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43772733
Sat 18 Jan 2014 03:05:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:05:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43772733
Sat 18 Jan 2014 03:05:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:05:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:05:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:05:41 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:05:41 - job_xml_thread(): Done retrieving: data size 43772733
Sat 18 Jan 2014 03:05:41 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:05:41 - XML: Start document: iteration 4
Sat 18 Jan 2014 03:05:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:05:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:05:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:05:46 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:05:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:05:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:05:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:05:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:05:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:05:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:05:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:05:52 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:05:52 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 03:05:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:05:54 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:05:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:05:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:05:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:05:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:05:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:05:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:05:56 - XML: Processed 654682 elements - found 612 jobs
Sat 18 Jan 2014 03:05:56 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:05:56 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:05:56 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:05:56 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:05:56 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:05:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 03:05:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:05:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:05:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43211361
Sat 18 Jan 2014 03:05:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:05:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43211361
Sat 18 Jan 2014 03:05:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:06:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:06:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:06:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:06:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:06:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:06:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:06:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:06:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:06:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:06:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:06:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:06:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:06:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:06:11 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:06:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:06:14 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:06:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:06:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:06:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:06:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:06:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:06:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:06:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:06:16 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:06:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:06:16 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:06:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 03:06:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 03:06:16 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:06:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5892 values 92948 bits 11618 bytes 
Sat 18 Jan 2014 03:06:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:06:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43227323
Sat 18 Jan 2014 03:06:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:06:17 - job_xml_thread(): Done retrieving: data size 43227323
Sat 18 Jan 2014 03:06:17 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:06:17 - XML: Start document: iteration 5
Sat 18 Jan 2014 03:06:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43227323
Sat 18 Jan 2014 03:06:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:06:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:06:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:06:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:06:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:06:32 - XML: Processed 647576 elements - found 611 jobs
Sat 18 Jan 2014 03:06:32 - job 7348641 appears to have finished
Sat 18 Jan 2014 03:06:32 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 03:06:32 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 03:06:32 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 03:06:32 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:06:32 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:06:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:06:33 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:06:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:06:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:06:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:06:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:06:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:06:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:06:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:06:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:06:39 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:06:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:06:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:06:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:06:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:06:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:06:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:06:40 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 03:06:40 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 03:06:40 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:06:41 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:06:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 03:06:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:06:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:06:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43739448
Sat 18 Jan 2014 03:06:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:06:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43739448
Sat 18 Jan 2014 03:06:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:06:47 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:06:48 - job_xml_thread(): Done retrieving: data size 43739448
Sat 18 Jan 2014 03:06:48 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:06:48 - XML: Start document: iteration 6
Sat 18 Jan 2014 03:06:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:06:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:06:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:06:50 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:06:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:06:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:06:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:06:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:06:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:06:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:06:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:06:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:06:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:06:59 - XML: Processed 653974 elements - found 611 jobs
Sat 18 Jan 2014 03:06:59 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:06:59 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:06:59 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:06:59 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:07:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:07:02 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:07:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:07:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:07:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:07:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:07:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:07:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:07:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:07:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43825390
Sat 18 Jan 2014 03:07:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:07:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43825390
Sat 18 Jan 2014 03:07:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:07:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:07:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:07:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:07:13 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:07:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:07:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:07:15 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:07:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:07:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:07:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:07:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:07:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:07:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:07:17 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:07:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:07:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:07:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:07:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:07:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:07:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:07:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:07:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:07:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:07:18 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:07:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 03:07:18 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:07:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 03:07:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6636 values 104746 bits 13093 bytes 
Sat 18 Jan 2014 03:07:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:07:20 - job_xml_thread(): Done retrieving: data size 43839272
Sat 18 Jan 2014 03:07:20 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:07:20 - XML: Start document: iteration 7
Sat 18 Jan 2014 03:07:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43839272
Sat 18 Jan 2014 03:07:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:07:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43839272
Sat 18 Jan 2014 03:07:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:07:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:07:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:07:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:07:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:07:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:07:33 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:07:33 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:07:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 03:07:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:07:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:07:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:07:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:07:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:07:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:07:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:07:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:07:42 - XML: Processed 655428 elements - found 611 jobs
Sat 18 Jan 2014 03:07:43 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:07:43 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:07:43 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:07:43 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:07:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:07:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:07:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:07:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:07:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:07:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:07:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:07:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:07:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:07:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855221
Sat 18 Jan 2014 03:07:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:07:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855221
Sat 18 Jan 2014 03:07:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:07:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:07:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:07:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:07:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:07:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:07:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:07:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:07:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:07:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:07:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855221
Sat 18 Jan 2014 03:07:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:07:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:07:58 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:07:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:08:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:08:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:08:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:08:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:08:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:08:06 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:08:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:08:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:08:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:08:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:08:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:08:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:08:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:08:08 - job_xml_thread(): Done retrieving: data size 43838747
Sat 18 Jan 2014 03:08:08 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:08:08 - XML: Start document: iteration 8
Sat 18 Jan 2014 03:08:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43838747
Sat 18 Jan 2014 03:08:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:08:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:08:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:08:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:08:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:08:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:08:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:08:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43838747
Sat 18 Jan 2014 03:08:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:08:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:08:18 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:08:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:08:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 03:08:19 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:08:19 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:08:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 03:08:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9271 values 146325 bits 18290 bytes 
Sat 18 Jan 2014 03:08:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:08:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:08:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:08:24 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:08:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:08:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:08:27 - XML: Processed 655426 elements - found 610 jobs
Sat 18 Jan 2014 03:08:27 - job 7348644 appears to have finished
Sat 18 Jan 2014 03:08:27 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 03:08:27 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 03:08:27 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 03:08:27 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:08:27 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:08:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:08:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:08:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:08:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:08:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:08:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:08:32 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:08:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:08:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:08:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:08:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:08:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:08:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:08:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:08:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865112
Sat 18 Jan 2014 03:08:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:08:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43865112
Sat 18 Jan 2014 03:08:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:08:43 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:08:43 - job_xml_thread(): Done retrieving: data size 43865112
Sat 18 Jan 2014 03:08:43 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:08:43 - XML: Start document: iteration 9
Sat 18 Jan 2014 03:08:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:08:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:08:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:08:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:08:48 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:08:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 03:08:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:08:54 - XML: Processed 655424 elements - found 609 jobs
Sat 18 Jan 2014 03:08:54 - job 7348642 appears to have finished
Sat 18 Jan 2014 03:08:54 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 03:08:54 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 03:08:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:08:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:08:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:08:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:08:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:08:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:08:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:08:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:08:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:08:56 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 03:08:56 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:08:56 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:08:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:08:56 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:08:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:08:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:08:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:08:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:08:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:08:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:08:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:08:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43883094
Sat 18 Jan 2014 03:08:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:08:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43883094
Sat 18 Jan 2014 03:08:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:09:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:09:10 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:09:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:09:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:09:11 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:09:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:09:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:09:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:09:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:09:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:09:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:09:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:09:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:09:13 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:09:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:09:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:09:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:09:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:09:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:09:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:09:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:09:14 - job_xml_thread(): Done retrieving: data size 43879539
Sat 18 Jan 2014 03:09:14 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:09:14 - XML: Start document: iteration 10
Sat 18 Jan 2014 03:09:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43879539
Sat 18 Jan 2014 03:09:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:09:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43879539
Sat 18 Jan 2014 03:09:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:09:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:09:20 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:09:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:09:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 03:09:21 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:09:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9186 values 144930 bits 18116 bytes 
Sat 18 Jan 2014 03:09:21 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:09:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 03:09:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:09:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:09:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:09:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:09:33 - XML: Processed 655421 elements - found 609 jobs
Sat 18 Jan 2014 03:09:33 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:09:33 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:09:33 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:09:33 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:09:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:09:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:09:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:09:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:09:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:09:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:09:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:09:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:09:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:09:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:09:37 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:09:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:09:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:09:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:09:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:09:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:09:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:09:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:09:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865536
Sat 18 Jan 2014 03:09:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:09:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43865536
Sat 18 Jan 2014 03:09:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:09:48 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:09:48 - job_xml_thread(): Done retrieving: data size 43865536
Sat 18 Jan 2014 03:09:48 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:09:48 - XML: Start document: iteration 11
Sat 18 Jan 2014 03:09:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:09:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:09:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:09:52 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:09:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:09:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:09:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:09:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:09:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:09:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:09:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:09:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:09:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:09:58 - XML: Processed 655424 elements - found 609 jobs
Sat 18 Jan 2014 03:09:58 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:09:58 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:09:58 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:09:58 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:09:58 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:09:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 03:09:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:10:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:10:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:10:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:10:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:10:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:10:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:10:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:10:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:10:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:10:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43829501
Sat 18 Jan 2014 03:10:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:10:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43829501
Sat 18 Jan 2014 03:10:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:10:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:10:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:10:13 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:10:13 - job_xml_thread(): Done retrieving: data size 43829501
Sat 18 Jan 2014 03:10:13 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:10:13 - XML: Start document: iteration 12
Sat 18 Jan 2014 03:10:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:10:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:10:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:10:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:10:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:10:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:10:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:10:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:10:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:10:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:10:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:10:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:10:21 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:10:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:10:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 03:10:21 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:10:21 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:10:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 03:10:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6049 values 95450 bits 11931 bytes 
Sat 18 Jan 2014 03:10:23 - XML: Processed 655424 elements - found 609 jobs
Sat 18 Jan 2014 03:10:23 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:10:23 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:10:23 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:10:23 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:10:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:10:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:10:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:10:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:10:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:10:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:10:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:10:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:10:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:10:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43849606
Sat 18 Jan 2014 03:10:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:10:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43849606
Sat 18 Jan 2014 03:10:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:10:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:10:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:10:38 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:10:38 - job_xml_thread(): Done retrieving: data size 43849606
Sat 18 Jan 2014 03:10:39 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:10:39 - XML: Start document: iteration 13
Sat 18 Jan 2014 03:10:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:10:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:10:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:10:45 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:10:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:10:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:10:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:10:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:10:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:10:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:10:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:10:50 - XML: Processed 655424 elements - found 609 jobs
Sat 18 Jan 2014 03:10:50 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:10:50 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:10:50 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:10:50 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:10:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:10:53 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:10:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:10:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:10:53 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:10:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 03:10:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:10:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:10:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:10:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:10:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:10:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:10:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43845348
Sat 18 Jan 2014 03:10:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:10:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43845348
Sat 18 Jan 2014 03:10:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:11:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:11:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:11:05 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:11:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:11:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:11:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:11:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:11:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:11:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:11:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:11:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:11:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:11:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:11:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:11:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:11:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:11:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:11:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:11:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:11:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:11:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:11:10 - job_xml_thread(): Done retrieving: data size 43792215
Sat 18 Jan 2014 03:11:10 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:11:10 - XML: Start document: iteration 14
Sat 18 Jan 2014 03:11:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43792215
Sat 18 Jan 2014 03:11:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:11:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43792215
Sat 18 Jan 2014 03:11:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:11:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:11:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:11:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:11:22 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:11:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:11:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 03:11:22 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:11:22 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:11:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 03:11:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8838 values 139375 bits 17421 bytes 
Sat 18 Jan 2014 03:11:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:11:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:11:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:11:27 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:11:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:11:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:11:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:11:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:11:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:11:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:11:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:11:29 - XML: Processed 654676 elements - found 609 jobs
Sat 18 Jan 2014 03:11:29 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:11:29 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:11:29 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:11:29 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:11:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:11:33 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:11:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:11:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:11:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:11:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:11:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:11:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:11:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:11:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43339207
Sat 18 Jan 2014 03:11:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:11:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43339207
Sat 18 Jan 2014 03:11:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:11:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:11:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:11:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:11:44 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:11:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:11:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:11:44 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:11:44 - job_xml_thread(): Done retrieving: data size 43339207
Sat 18 Jan 2014 03:11:44 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:11:44 - XML: Start document: iteration 15
Sat 18 Jan 2014 03:11:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:11:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:11:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:11:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:11:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:11:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:11:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:11:52 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 03:11:53 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:11:53 - XML: Processed 649126 elements - found 609 jobs
Sat 18 Jan 2014 03:11:53 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:11:53 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:11:53 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:11:53 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:11:53 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:11:53 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:11:53 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 03:11:53 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 03:11:53 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 03:11:56 - size of cluster 'LISA Cluster': 624 hosts 79476 metrics 974648 values 15377880 bits 1922235 bytes 
Sat 18 Jan 2014 03:11:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:11:59 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:11:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:11:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:11:59 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:11:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 03:11:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:11:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:11:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:11:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:11:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:12:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:12:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:12:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:12:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43185470
Sat 18 Jan 2014 03:12:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:12:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43185470
Sat 18 Jan 2014 03:12:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:12:08 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:12:08 - job_xml_thread(): Done retrieving: data size 43185470
Sat 18 Jan 2014 03:12:08 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:12:08 - XML: Start document: iteration 16
Sat 18 Jan 2014 03:12:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:12:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:12:20 - XML: Processed 647462 elements - found 609 jobs
Sat 18 Jan 2014 03:12:20 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:12:20 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:12:20 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:12:20 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:12:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:12:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:12:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:12:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:12:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:12:22 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:12:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:12:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:12:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:12:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:12:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:12:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:12:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 03:12:23 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:12:23 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:12:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5565 values 87772 bits 10971 bytes 
Sat 18 Jan 2014 03:12:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 03:12:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:12:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:12:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:12:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:12:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:12:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:12:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:12:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:12:28 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:12:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 03:12:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:12:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:12:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43340290
Sat 18 Jan 2014 03:12:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:12:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43340290
Sat 18 Jan 2014 03:12:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:12:35 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:12:35 - job_xml_thread(): Done retrieving: data size 43340290
Sat 18 Jan 2014 03:12:35 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:12:35 - XML: Start document: iteration 17
Sat 18 Jan 2014 03:12:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:12:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:12:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:12:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:12:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:12:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:12:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:12:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:12:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:12:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:12:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:12:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:12:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:12:48 - XML: Processed 648858 elements - found 609 jobs
Sat 18 Jan 2014 03:12:48 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:12:48 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:12:48 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:12:48 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:12:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:12:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:12:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:12:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:12:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:12:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:12:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:12:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:12:53 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:12:53 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 03:12:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:12:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43784425
Sat 18 Jan 2014 03:12:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:12:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43784425
Sat 18 Jan 2014 03:12:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:12:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:12:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:13:03 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:13:03 - job_xml_thread(): Done retrieving: data size 43784425
Sat 18 Jan 2014 03:13:03 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:13:03 - XML: Start document: iteration 18
Sat 18 Jan 2014 03:13:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:13:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:13:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:13:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:13:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:13:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:13:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:13:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:13:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:13:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:13:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:13:14 - XML: Processed 654692 elements - found 609 jobs
Sat 18 Jan 2014 03:13:14 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:13:14 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:13:14 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:13:14 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:13:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:13:16 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:13:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:13:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:13:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:13:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:13:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:13:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:13:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:13:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43830350
Sat 18 Jan 2014 03:13:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:13:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43830350
Sat 18 Jan 2014 03:13:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:13:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:13:24 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:13:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:13:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:13:24 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:13:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 03:13:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:13:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 03:13:24 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:13:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148697 bits 18587 bytes 
Sat 18 Jan 2014 03:13:29 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:13:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:13:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:13:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:13:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:13:31 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:13:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:13:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:13:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:13:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:13:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:13:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:13:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:13:33 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:13:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:13:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:13:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:13:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:13:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:13:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:13:35 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:13:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 03:13:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:13:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:13:36 - job_xml_thread(): Done retrieving: data size 43838290
Sat 18 Jan 2014 03:13:36 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:13:36 - XML: Start document: iteration 19
Sat 18 Jan 2014 03:13:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43838290
Sat 18 Jan 2014 03:13:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:13:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43838290
Sat 18 Jan 2014 03:13:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:13:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:13:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:13:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:13:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:13:55 - XML: Processed 655424 elements - found 609 jobs
Sat 18 Jan 2014 03:13:55 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:13:55 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:13:55 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:13:55 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:13:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:13:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:13:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:13:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:13:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:13:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:13:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:13:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:13:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:13:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:13:59 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:13:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:13:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:14:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:14:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:14:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:14:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:14:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:14:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858495
Sat 18 Jan 2014 03:14:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:14:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43858495
Sat 18 Jan 2014 03:14:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:14:10 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:14:10 - job_xml_thread(): Done retrieving: data size 43858495
Sat 18 Jan 2014 03:14:10 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:14:10 - XML: Start document: iteration 20
Sat 18 Jan 2014 03:14:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:14:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:14:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:14:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:14:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:14:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:14:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:14:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:14:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:14:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:14:24 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:14:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:14:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:14:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:14:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:14:25 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:14:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 03:14:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:14:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 03:14:25 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:14:26 - XML: Processed 655424 elements - found 609 jobs
Sat 18 Jan 2014 03:14:26 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:14:26 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:14:26 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:14:26 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:14:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6139 values 96874 bits 12109 bytes 
Sat 18 Jan 2014 03:14:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:14:26 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:14:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:14:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:14:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:14:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:14:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:14:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:14:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:14:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43870936
Sat 18 Jan 2014 03:14:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:14:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43870936
Sat 18 Jan 2014 03:14:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:14:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:14:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:14:41 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:14:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:14:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:14:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:14:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:14:43 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:14:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:14:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:14:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:14:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:14:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:14:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:14:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:14:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:14:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:14:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:14:47 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:14:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 03:14:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:14:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:14:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:14:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:14:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:14:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:14:50 - job_xml_thread(): Done retrieving: data size 43839017
Sat 18 Jan 2014 03:14:50 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:14:50 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 03:14:50 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 03:14:50 - Housekeeping: done.
Sat 18 Jan 2014 03:14:50 - XML: Start document: iteration 0
Sat 18 Jan 2014 03:14:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43839017
Sat 18 Jan 2014 03:14:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:14:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43839017
Sat 18 Jan 2014 03:14:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:14:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:14:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:15:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:15:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:15:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:15:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:15:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:15:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:15:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:15:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:15:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:15:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:15:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:15:10 - XML: Processed 655424 elements - found 609 jobs
Sat 18 Jan 2014 03:15:10 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:15:10 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:15:10 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:15:10 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:15:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:15:13 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:15:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:15:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:15:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:15:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:15:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:15:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:15:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:15:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43852481
Sat 18 Jan 2014 03:15:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:15:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43852481
Sat 18 Jan 2014 03:15:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:15:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:15:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:15:25 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:15:25 - job_xml_thread(): Done retrieving: data size 43852481
Sat 18 Jan 2014 03:15:25 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:15:25 - XML: Start document: iteration 1
Sat 18 Jan 2014 03:15:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:15:26 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:15:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:15:26 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:15:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:15:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 03:15:27 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:15:27 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:15:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 03:15:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8926 values 140818 bits 17602 bytes 
Sat 18 Jan 2014 03:15:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:15:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:15:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:15:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:15:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:15:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:15:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:15:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:15:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:15:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:15:37 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:15:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:15:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:15:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:15:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:15:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:15:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:15:39 - XML: Processed 655424 elements - found 609 jobs
Sat 18 Jan 2014 03:15:39 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:15:39 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:15:39 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:15:39 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:15:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:15:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:15:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:15:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43842842
Sat 18 Jan 2014 03:15:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:15:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43842842
Sat 18 Jan 2014 03:15:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:15:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:15:53 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:15:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:15:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:15:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:15:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:15:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:15:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:15:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:15:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:15:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:15:54 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:15:56 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:15:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 03:15:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:15:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:15:59 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:15:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:15:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:16:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:16:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:16:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:16:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:16:00 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 03:16:00 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 03:16:00 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:16:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:16:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43859708
Sat 18 Jan 2014 03:16:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:16:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43859708
Sat 18 Jan 2014 03:16:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:16:02 - job_xml_thread(): Done retrieving: data size 43859708
Sat 18 Jan 2014 03:16:02 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:16:02 - XML: Start document: iteration 2
Sat 18 Jan 2014 03:16:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:16:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:16:15 - XML: Processed 655426 elements - found 610 jobs
Sat 18 Jan 2014 03:16:15 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 03:16:15 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 03:16:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:16:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:16:16 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 03:16:16 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:16:16 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:16:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:16:18 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:16:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:16:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:16:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:16:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:16:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:16:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:16:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:16:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:16:21 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:16:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:16:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:16:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:16:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:16:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:16:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:16:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:16:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43877388
Sat 18 Jan 2014 03:16:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:16:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43877388
Sat 18 Jan 2014 03:16:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:16:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:16:27 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:16:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:16:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 03:16:27 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:16:27 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:16:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9127 values 144194 bits 18024 bytes 
Sat 18 Jan 2014 03:16:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 03:16:32 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:16:32 - job_xml_thread(): Done retrieving: data size 43877388
Sat 18 Jan 2014 03:16:32 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:16:32 - XML: Start document: iteration 3
Sat 18 Jan 2014 03:16:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:16:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:16:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:16:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:16:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:16:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:16:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:16:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:16:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:16:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:16:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:16:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:16:40 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:16:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:16:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:16:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:16:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:16:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:16:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:16:44 - XML: Processed 655426 elements - found 610 jobs
Sat 18 Jan 2014 03:16:44 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:16:44 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:16:44 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:16:44 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:16:46 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:16:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 03:16:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:16:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:16:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43848094
Sat 18 Jan 2014 03:16:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:16:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43848094
Sat 18 Jan 2014 03:16:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:16:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:16:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:16:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:16:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:16:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:16:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:16:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:16:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:16:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:16:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:16:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:16:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:16:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:16:59 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:17:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:17:01 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:17:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:17:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:17:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:17:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:17:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:17:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:17:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:17:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43859520
Sat 18 Jan 2014 03:17:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:17:03 - job_xml_thread(): Done retrieving: data size 43859520
Sat 18 Jan 2014 03:17:04 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:17:04 - XML: Start document: iteration 4
Sat 18 Jan 2014 03:17:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43859520
Sat 18 Jan 2014 03:17:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:17:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:17:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:17:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:17:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:17:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:17:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:17:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:17:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:17:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:17:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:17:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:17:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:17:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:17:20 - XML: Processed 655426 elements - found 610 jobs
Sat 18 Jan 2014 03:17:20 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:17:20 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:17:20 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:17:20 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:17:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:17:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:17:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:17:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:17:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:17:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:17:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:17:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:17:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:17:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43809291
Sat 18 Jan 2014 03:17:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:17:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43809291
Sat 18 Jan 2014 03:17:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:17:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:17:28 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:17:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:17:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 03:17:30 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:17:30 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:17:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 03:17:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 149041 bits 18630 bytes 
Sat 18 Jan 2014 03:17:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:17:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:17:35 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:17:35 - job_xml_thread(): Done retrieving: data size 43809291
Sat 18 Jan 2014 03:17:35 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:17:35 - XML: Start document: iteration 5
Sat 18 Jan 2014 03:17:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:17:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:17:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:17:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:17:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:17:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:17:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:17:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:17:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:17:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:17:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:17:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:17:49 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:17:49 - XML: Processed 654678 elements - found 610 jobs
Sat 18 Jan 2014 03:17:49 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:17:49 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:17:49 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:17:49 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:17:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:17:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:17:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:17:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:17:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:17:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:17:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:17:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43262825
Sat 18 Jan 2014 03:17:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:17:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43262825
Sat 18 Jan 2014 03:17:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:17:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:17:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:18:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:18:02 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:18:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:18:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:18:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:18:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:18:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:18:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:18:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:18:04 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:18:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:18:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:18:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:18:06 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:18:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:18:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:18:06 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:18:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 03:18:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:18:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:18:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:18:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:18:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:18:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:18:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43201233
Sat 18 Jan 2014 03:18:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:18:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43201233
Sat 18 Jan 2014 03:18:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:18:08 - job_xml_thread(): Done retrieving: data size 43201233
Sat 18 Jan 2014 03:18:08 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:18:08 - XML: Start document: iteration 6
Sat 18 Jan 2014 03:18:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:18:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:18:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:18:20 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:18:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:18:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:18:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:18:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:18:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:18:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:18:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:18:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:18:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:18:26 - XML: Processed 647228 elements - found 611 jobs
Sat 18 Jan 2014 03:18:26 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 03:18:26 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 03:18:29 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 03:18:29 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:18:29 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:18:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:18:30 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:18:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:18:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:18:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:18:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:18:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:18:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:18:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:18:30 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:18:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:18:31 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:18:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 03:18:31 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:18:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 03:18:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5786 values 91554 bits 11444 bytes 
Sat 18 Jan 2014 03:18:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:18:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43625524
Sat 18 Jan 2014 03:18:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:18:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43625524
Sat 18 Jan 2014 03:18:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:18:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:18:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:18:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:18:42 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:18:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:18:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:18:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:18:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:18:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:18:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:18:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:18:45 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:18:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:18:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:18:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:18:46 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:18:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:18:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:18:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:18:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:18:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:18:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:18:48 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:18:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 03:18:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:18:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:18:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43812787
Sat 18 Jan 2014 03:18:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:18:49 - job_xml_thread(): Done retrieving: data size 43812787
Sat 18 Jan 2014 03:18:49 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:18:49 - XML: Start document: iteration 7
Sat 18 Jan 2014 03:18:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43812787
Sat 18 Jan 2014 03:18:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:18:53 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 03:18:53 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:18:55 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:18:55 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:18:55 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 03:18:55 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 03:18:55 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 03:18:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:18:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:19:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:19:00 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:19:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:19:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:19:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:19:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:19:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:19:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:19:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:19:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:19:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:19:09 - size of cluster 'LISA Cluster': 624 hosts 79481 metrics 814807 values 12880351 bits 1610043 bytes 
Sat 18 Jan 2014 03:19:10 - XML: Processed 655022 elements - found 611 jobs
Sat 18 Jan 2014 03:19:10 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:19:10 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:19:10 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:19:10 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:19:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:19:12 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:19:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:19:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:19:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:19:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:19:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:19:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:19:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:19:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43831997
Sat 18 Jan 2014 03:19:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:19:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43831997
Sat 18 Jan 2014 03:19:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:19:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:19:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:19:25 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:19:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:19:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:19:27 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:19:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:19:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:19:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:19:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:19:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:19:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:19:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:19:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:19:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:19:30 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:19:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:19:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:19:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:19:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:19:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:19:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:19:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:19:31 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:19:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:19:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 03:19:31 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:19:31 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:19:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 03:19:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6798 values 107257 bits 13407 bytes 
Sat 18 Jan 2014 03:19:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:19:33 - job_xml_thread(): Done retrieving: data size 43845345
Sat 18 Jan 2014 03:19:33 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:19:33 - XML: Start document: iteration 8
Sat 18 Jan 2014 03:19:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43845345
Sat 18 Jan 2014 03:19:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43845345
Sat 18 Jan 2014 03:19:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:19:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:19:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:19:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:19:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:19:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:19:54 - XML: Processed 655428 elements - found 611 jobs
Sat 18 Jan 2014 03:19:54 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:19:55 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:19:55 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:19:55 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:19:55 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:19:55 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 03:19:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:19:57 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:19:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:19:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:19:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:19:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:19:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:19:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:19:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:19:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:19:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:19:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:19:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:19:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:19:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:19:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:19:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:19:59 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:19:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 03:19:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:20:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:20:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862475
Sat 18 Jan 2014 03:20:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:20:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862475
Sat 18 Jan 2014 03:20:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:20:10 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:20:11 - job_xml_thread(): Done retrieving: data size 43862475
Sat 18 Jan 2014 03:20:11 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:20:11 - XML: Start document: iteration 9
Sat 18 Jan 2014 03:20:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:20:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:20:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:20:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:20:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:20:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:20:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:20:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:20:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:20:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:20:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:20:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:20:21 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:20:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:20:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:20:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:20:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:20:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:20:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:20:24 - XML: Processed 655425 elements - found 611 jobs
Sat 18 Jan 2014 03:20:24 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:20:24 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:20:24 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:20:24 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:20:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:20:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43846818
Sat 18 Jan 2014 03:20:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:20:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43846818
Sat 18 Jan 2014 03:20:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:20:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:20:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:20:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:20:31 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:20:32 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:20:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 03:20:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:20:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 03:20:32 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:20:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7521 values 118622 bits 14827 bytes 
Sat 18 Jan 2014 03:20:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:20:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:20:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:20:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:20:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:20:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:20:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:20:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:20:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:20:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:20:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:20:39 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:20:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:20:43 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:20:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:20:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:20:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:20:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:20:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:20:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:20:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:20:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853085
Sat 18 Jan 2014 03:20:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:20:47 - job_xml_thread(): Done retrieving: data size 43853085
Sat 18 Jan 2014 03:20:47 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:20:47 - XML: Start document: iteration 10
Sat 18 Jan 2014 03:20:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853085
Sat 18 Jan 2014 03:20:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:20:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:20:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:20:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:20:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:21:03 - XML: Processed 655426 elements - found 610 jobs
Sat 18 Jan 2014 03:21:03 - job 7348762 appears to have finished
Sat 18 Jan 2014 03:21:03 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 03:21:03 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 03:21:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:21:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:21:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:21:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:21:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:21:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:21:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:21:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:21:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:21:06 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 03:21:06 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:21:06 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:21:08 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:21:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 03:21:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:21:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:21:10 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:21:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:21:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:21:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:21:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:21:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:21:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:21:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:21:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867459
Sat 18 Jan 2014 03:21:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:21:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43867459
Sat 18 Jan 2014 03:21:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:21:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:21:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:21:21 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:21:21 - job_xml_thread(): Done retrieving: data size 43867459
Sat 18 Jan 2014 03:21:21 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:21:21 - XML: Start document: iteration 11
Sat 18 Jan 2014 03:21:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:21:25 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:21:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:21:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:21:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:21:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:21:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:21:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:21:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:21:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:21:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:21:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:21:33 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:21:33 - XML: Processed 655426 elements - found 610 jobs
Sat 18 Jan 2014 03:21:33 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:21:33 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:21:33 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:21:33 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:21:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:21:34 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:21:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 03:21:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 03:21:34 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:21:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5908 values 93225 bits 11653 bytes 
Sat 18 Jan 2014 03:21:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:21:37 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:21:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:21:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:21:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:21:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:21:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:21:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:21:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:21:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43843475
Sat 18 Jan 2014 03:21:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:21:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43843475
Sat 18 Jan 2014 03:21:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:21:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:21:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:21:48 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:21:48 - job_xml_thread(): Done retrieving: data size 43843475
Sat 18 Jan 2014 03:21:48 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:21:48 - XML: Start document: iteration 12
Sat 18 Jan 2014 03:21:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:21:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:21:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:21:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:21:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:21:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:21:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:21:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:21:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:21:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:21:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:22:01 - XML: Processed 655426 elements - found 610 jobs
Sat 18 Jan 2014 03:22:01 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:22:01 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:22:01 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:22:01 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:22:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:22:04 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:22:04 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:22:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 03:22:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:22:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:22:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:22:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:22:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:22:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:22:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:22:06 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 03:22:06 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 03:22:06 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:22:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:22:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43847791
Sat 18 Jan 2014 03:22:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:22:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43847791
Sat 18 Jan 2014 03:22:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:22:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:22:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:22:17 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:22:17 - job_xml_thread(): Done retrieving: data size 43847791
Sat 18 Jan 2014 03:22:17 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:22:17 - XML: Start document: iteration 13
Sat 18 Jan 2014 03:22:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:22:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:22:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:22:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:22:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:22:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:22:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:22:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:22:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:22:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:22:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:22:29 - XML: Processed 655426 elements - found 610 jobs
Sat 18 Jan 2014 03:22:29 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:22:29 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:22:29 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:22:29 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:22:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:22:30 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:22:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:22:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:22:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:22:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:22:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:22:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:22:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:22:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43823116
Sat 18 Jan 2014 03:22:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:22:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43823116
Sat 18 Jan 2014 03:22:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:22:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:22:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:22:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:22:34 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:22:36 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:22:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:22:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 03:22:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 03:22:36 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:22:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8890 values 140262 bits 17532 bytes 
Sat 18 Jan 2014 03:22:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:22:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:22:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:22:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:22:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:22:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:22:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:22:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:22:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43823116
Sat 18 Jan 2014 03:22:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:22:44 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:22:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:22:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:22:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:22:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:22:51 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:22:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:22:54 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:22:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:22:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:22:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:22:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:22:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:22:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:22:56 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:22:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 03:22:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:22:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:22:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:22:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:22:56 - job_xml_thread(): Done retrieving: data size 43846899
Sat 18 Jan 2014 03:22:56 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:22:56 - XML: Start document: iteration 14
Sat 18 Jan 2014 03:22:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43846899
Sat 18 Jan 2014 03:22:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:22:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:22:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:22:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:22:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43846899
Sat 18 Jan 2014 03:22:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:22:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:23:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:23:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:23:12 - XML: Processed 655424 elements - found 609 jobs
Sat 18 Jan 2014 03:23:12 - job 7348763 appears to have finished
Sat 18 Jan 2014 03:23:12 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 03:23:12 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 03:23:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:23:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:23:15 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 03:23:15 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:23:15 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:23:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:23:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:23:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:23:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:23:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:23:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:23:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:23:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:23:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:23:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:23:20 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:23:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:23:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:23:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:23:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:23:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:23:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:23:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:23:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43807883
Sat 18 Jan 2014 03:23:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:23:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43807883
Sat 18 Jan 2014 03:23:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:23:30 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:23:30 - job_xml_thread(): Done retrieving: data size 43807883
Sat 18 Jan 2014 03:23:31 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:23:31 - XML: Start document: iteration 15
Sat 18 Jan 2014 03:23:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:23:31 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:23:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:23:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:23:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:23:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:23:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:23:36 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:23:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:23:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:23:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:23:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:23:36 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:23:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:23:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 03:23:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 03:23:36 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:23:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:23:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6342 values 100046 bits 12505 bytes 
Sat 18 Jan 2014 03:23:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:23:39 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:23:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:23:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:23:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:23:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:23:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:23:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:23:42 - XML: Processed 654676 elements - found 609 jobs
Sat 18 Jan 2014 03:23:42 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:23:42 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:23:42 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:23:42 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:23:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:23:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43242430
Sat 18 Jan 2014 03:23:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:23:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43242430
Sat 18 Jan 2014 03:23:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:23:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:23:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:23:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:23:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:23:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:23:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:23:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:23:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:23:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:23:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:23:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:23:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:23:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:23:57 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:24:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:24:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:24:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:24:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:24:00 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:24:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 03:24:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:24:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:24:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:24:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:24:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:24:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:24:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43195831
Sat 18 Jan 2014 03:24:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:24:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43195831
Sat 18 Jan 2014 03:24:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:24:02 - job_xml_thread(): Done retrieving: data size 43195831
Sat 18 Jan 2014 03:24:02 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:24:02 - XML: Start document: iteration 16
Sat 18 Jan 2014 03:24:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:24:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:24:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:24:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:24:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:24:18 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:24:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:24:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:24:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:24:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:24:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:24:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:24:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:24:22 - XML: Processed 647224 elements - found 609 jobs
Sat 18 Jan 2014 03:24:22 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:24:22 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:24:22 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:24:22 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:24:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:24:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:24:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:24:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:24:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:24:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:24:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:24:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:24:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:24:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43305086
Sat 18 Jan 2014 03:24:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:24:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43305086
Sat 18 Jan 2014 03:24:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:24:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:24:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:24:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:24:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:24:36 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:24:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:24:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:24:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:24:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:24:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:24:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:24:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:24:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:24:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:24:37 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:24:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 03:24:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 03:24:37 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:24:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9147 values 144311 bits 18038 bytes 
Sat 18 Jan 2014 03:24:38 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:24:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:24:40 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:24:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:24:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:24:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:24:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:24:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:24:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:24:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:24:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43590580
Sat 18 Jan 2014 03:24:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:24:43 - job_xml_thread(): Done retrieving: data size 43590580
Sat 18 Jan 2014 03:24:43 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:24:43 - XML: Start document: iteration 17
Sat 18 Jan 2014 03:24:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43590580
Sat 18 Jan 2014 03:24:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:24:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:24:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:24:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:24:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:24:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:24:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:24:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:24:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:24:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:24:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:24:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:24:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:24:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:25:00 - XML: Processed 652090 elements - found 609 jobs
Sat 18 Jan 2014 03:25:00 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:25:00 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:25:00 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:25:00 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:25:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:25:06 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:25:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:25:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:25:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:25:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:25:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:25:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:25:06 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:25:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 03:25:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:25:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:25:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43850915
Sat 18 Jan 2014 03:25:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:25:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43850915
Sat 18 Jan 2014 03:25:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:25:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:25:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:25:15 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:25:15 - job_xml_thread(): Done retrieving: data size 43850915
Sat 18 Jan 2014 03:25:15 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:25:15 - XML: Start document: iteration 18
Sat 18 Jan 2014 03:25:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:25:18 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:25:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:25:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:25:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:25:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:25:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:25:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:25:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:25:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:25:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:25:24 - XML: Processed 655424 elements - found 609 jobs
Sat 18 Jan 2014 03:25:24 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:25:24 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:25:24 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:25:24 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:25:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:25:28 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:25:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:25:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:25:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:25:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:25:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:25:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:25:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:25:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43822425
Sat 18 Jan 2014 03:25:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:25:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43822425
Sat 18 Jan 2014 03:25:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:25:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:25:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:25:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:25:37 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:25:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:25:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 03:25:38 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:25:38 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:25:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 03:25:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8777 values 138379 bits 17297 bytes 
Sat 18 Jan 2014 03:25:40 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:25:40 - job_xml_thread(): Done retrieving: data size 43822425
Sat 18 Jan 2014 03:25:40 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:25:40 - XML: Start document: iteration 19
Sat 18 Jan 2014 03:25:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:25:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:25:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:25:46 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:25:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:25:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:25:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:25:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:25:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:25:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:25:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:25:52 - XML: Processed 655424 elements - found 609 jobs
Sat 18 Jan 2014 03:25:52 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:25:52 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:25:52 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:25:52 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:25:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:25:54 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:25:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:25:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:25:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:25:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:25:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:25:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:25:55 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 03:25:55 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:25:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:25:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855515
Sat 18 Jan 2014 03:25:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:25:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855515
Sat 18 Jan 2014 03:25:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:25:56 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:25:56 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:25:56 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 03:25:56 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 03:25:56 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 03:25:59 - size of cluster 'LISA Cluster': 624 hosts 79469 metrics 815960 values 12871623 bits 1608952 bytes 
Sat 18 Jan 2014 03:26:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:26:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:26:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:26:07 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:26:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:26:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:26:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:26:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:26:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:26:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:26:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:26:07 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:26:08 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:26:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 03:26:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:26:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:26:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:26:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:26:12 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:26:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:26:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:26:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:26:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:26:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:26:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:26:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:26:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43842954
Sat 18 Jan 2014 03:26:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:26:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43842954
Sat 18 Jan 2014 03:26:15 - job_xml_thread(): Done retrieving: data size 43842954
Sat 18 Jan 2014 03:26:15 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:26:15 - XML: Start document: iteration 20
Sat 18 Jan 2014 03:26:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:26:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:26:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:26:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:26:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:26:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:26:32 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:26:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:26:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:26:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:26:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:26:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:26:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:26:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:26:33 - XML: Processed 655424 elements - found 609 jobs
Sat 18 Jan 2014 03:26:33 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:26:33 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:26:33 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:26:33 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:26:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:26:38 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:26:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:26:38 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:26:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:26:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:26:39 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:26:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:26:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:26:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 03:26:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 03:26:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:26:39 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:26:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:26:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:26:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6046 values 95391 bits 11923 bytes 
Sat 18 Jan 2014 03:26:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:26:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858908
Sat 18 Jan 2014 03:26:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:26:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43858908
Sat 18 Jan 2014 03:26:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:26:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:26:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:26:48 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:26:48 - job_xml_thread(): Done retrieving: data size 43858908
Sat 18 Jan 2014 03:26:48 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:26:48 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 03:26:49 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 03:26:49 - Housekeeping: done.
Sat 18 Jan 2014 03:26:49 - XML: Start document: iteration 0
Sat 18 Jan 2014 03:26:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:26:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:26:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:26:56 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:26:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:26:56 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:26:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:26:56 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 03:26:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:26:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:26:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:26:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:26:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:27:01 - XML: Processed 655422 elements - found 608 jobs
Sat 18 Jan 2014 03:27:01 - job 7346773 appears to have finished
Sat 18 Jan 2014 03:27:01 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 03:27:01 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 03:27:02 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 03:27:02 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:27:02 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:27:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:27:04 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:27:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:27:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:27:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:27:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:27:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:27:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:27:05 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:27:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 03:27:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:27:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:27:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43854080
Sat 18 Jan 2014 03:27:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:27:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43854080
Sat 18 Jan 2014 03:27:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:27:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:27:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:27:18 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:27:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:27:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:27:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:27:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:27:23 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:27:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:27:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:27:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:27:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:27:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:27:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:27:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:27:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:27:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:27:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:27:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:27:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:27:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:27:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:27:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:27:26 - job_xml_thread(): Done retrieving: data size 43864018
Sat 18 Jan 2014 03:27:26 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:27:26 - XML: Start document: iteration 1
Sat 18 Jan 2014 03:27:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43864018
Sat 18 Jan 2014 03:27:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:27:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43864018
Sat 18 Jan 2014 03:27:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:27:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:27:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:27:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:27:39 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:27:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:27:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:27:41 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:27:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:27:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 03:27:41 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:27:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 03:27:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8362 values 131904 bits 16488 bytes 
Sat 18 Jan 2014 03:27:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:27:46 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:27:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:27:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:27:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:27:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:27:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:27:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:27:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:27:48 - XML: Processed 655422 elements - found 608 jobs
Sat 18 Jan 2014 03:27:48 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:27:48 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:27:48 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:27:48 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:27:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:27:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:27:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:27:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:27:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:27:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:27:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:27:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:27:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:27:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43861262
Sat 18 Jan 2014 03:27:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:27:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43861262
Sat 18 Jan 2014 03:27:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:28:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:28:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:28:03 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:28:03 - job_xml_thread(): Done retrieving: data size 43861262
Sat 18 Jan 2014 03:28:03 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:28:03 - XML: Start document: iteration 2
Sat 18 Jan 2014 03:28:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:28:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:28:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:28:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:28:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:28:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:28:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:28:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:28:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:28:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:28:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:28:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:28:16 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:28:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:28:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:28:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:28:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:28:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:28:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:28:17 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:28:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 03:28:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:28:18 - XML: Processed 655422 elements - found 608 jobs
Sat 18 Jan 2014 03:28:18 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:28:18 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:28:18 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:28:18 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:28:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:28:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43835106
Sat 18 Jan 2014 03:28:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:28:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43835106
Sat 18 Jan 2014 03:28:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:28:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:28:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:28:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:28:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:28:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:28:32 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:28:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:28:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:28:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:28:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:28:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:28:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:28:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:28:33 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:28:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:28:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:28:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:28:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:28:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:28:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:28:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:28:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:28:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:28:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875262
Sat 18 Jan 2014 03:28:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:28:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875262
Sat 18 Jan 2014 03:28:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:28:39 - job_xml_thread(): Done retrieving: data size 43875262
Sat 18 Jan 2014 03:28:39 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:28:39 - XML: Start document: iteration 3
Sat 18 Jan 2014 03:28:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:28:41 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:28:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:28:43 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:28:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 03:28:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 03:28:43 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:28:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8912 values 140528 bits 17566 bytes 
Sat 18 Jan 2014 03:28:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:28:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:28:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:28:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:28:56 - XML: Processed 655422 elements - found 608 jobs
Sat 18 Jan 2014 03:28:56 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:28:56 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:28:56 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:28:56 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:28:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:28:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:28:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:28:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:28:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:28:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:28:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:28:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:28:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:29:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:29:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:29:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:29:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:29:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:29:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:29:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:29:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:29:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:29:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43864038
Sat 18 Jan 2014 03:29:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:29:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43864038
Sat 18 Jan 2014 03:29:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:29:11 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:29:11 - job_xml_thread(): Done retrieving: data size 43864038
Sat 18 Jan 2014 03:29:11 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:29:11 - XML: Start document: iteration 4
Sat 18 Jan 2014 03:29:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:29:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:29:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:29:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:29:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:29:20 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:29:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:29:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:29:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:29:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:29:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:29:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:29:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:29:23 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:29:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 03:29:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:29:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:29:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:29:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:29:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:29:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:29:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:29:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:29:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:29:28 - XML: Processed 655422 elements - found 608 jobs
Sat 18 Jan 2014 03:29:28 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:29:28 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:29:28 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:29:28 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:29:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:29:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43767732
Sat 18 Jan 2014 03:29:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:29:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43767732
Sat 18 Jan 2014 03:29:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:29:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:29:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:29:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:29:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:29:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:29:43 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:29:44 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:29:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:29:44 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:29:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 03:29:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:29:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 03:29:44 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:29:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6032 values 95184 bits 11898 bytes 
Sat 18 Jan 2014 03:29:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:29:45 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:29:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:29:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:29:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:29:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:29:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:29:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:29:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:29:48 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:29:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:29:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:29:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:29:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:29:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:29:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:29:50 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 03:29:50 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 03:29:50 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:29:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:29:51 - job_xml_thread(): Done retrieving: data size 43236101
Sat 18 Jan 2014 03:29:51 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:29:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43236101
Sat 18 Jan 2014 03:29:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:29:51 - XML: Start document: iteration 5
Sat 18 Jan 2014 03:29:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43236101
Sat 18 Jan 2014 03:29:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:30:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:30:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:30:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:30:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:30:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:30:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:30:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:30:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:30:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:30:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:30:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:30:11 - XML: Processed 647770 elements - found 608 jobs
Sat 18 Jan 2014 03:30:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:30:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:30:11 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:30:11 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:30:11 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:30:11 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:30:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:30:14 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:30:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:30:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:30:14 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:30:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 03:30:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:30:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:30:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:30:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:30:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:30:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:30:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43261930
Sat 18 Jan 2014 03:30:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:30:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43261930
Sat 18 Jan 2014 03:30:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:30:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:30:26 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:30:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:30:26 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:30:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:30:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:30:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:30:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:30:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:30:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:30:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:30:28 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:30:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:30:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:30:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:30:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:30:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:30:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:30:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:30:29 - job_xml_thread(): Done retrieving: data size 43381107
Sat 18 Jan 2014 03:30:29 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:30:29 - XML: Start document: iteration 6
Sat 18 Jan 2014 03:30:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43381107
Sat 18 Jan 2014 03:30:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:30:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43381107
Sat 18 Jan 2014 03:30:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:30:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:30:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:30:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:30:44 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:30:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:30:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:30:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:30:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 03:30:45 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:30:45 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:30:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 03:30:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9125 values 144042 bits 18005 bytes 
Sat 18 Jan 2014 03:30:46 - XML: Processed 649430 elements - found 609 jobs
Sat 18 Jan 2014 03:30:46 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 03:30:46 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 03:30:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:30:46 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:30:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:30:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:30:47 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 03:30:47 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:30:47 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:30:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:30:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:30:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:30:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:30:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:30:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:30:50 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:30:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:30:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:30:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:30:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:30:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:30:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:30:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:30:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43806322
Sat 18 Jan 2014 03:30:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:30:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43806322
Sat 18 Jan 2014 03:30:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:31:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:31:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:31:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:31:02 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:31:02 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:31:02 - job_xml_thread(): Done retrieving: data size 43806322
Sat 18 Jan 2014 03:31:02 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:31:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:31:02 - XML: Start document: iteration 7
Sat 18 Jan 2014 03:31:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:31:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:31:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:31:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:31:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:31:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:31:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:31:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:31:11 - XML: Processed 654684 elements - found 609 jobs
Sat 18 Jan 2014 03:31:11 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:31:11 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:31:11 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:31:11 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:31:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:31:14 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:31:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:31:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:31:14 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:31:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 03:31:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:31:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:31:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:31:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:31:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:31:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:31:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43822842
Sat 18 Jan 2014 03:31:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:31:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43822842
Sat 18 Jan 2014 03:31:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:31:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:31:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:31:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:31:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:31:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:31:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:31:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:31:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:31:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:31:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:31:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43822842
Sat 18 Jan 2014 03:31:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:31:26 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:31:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:31:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:31:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:31:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:31:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:31:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:31:35 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:31:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:31:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:31:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:31:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:31:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:31:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:31:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:31:37 - job_xml_thread(): Done retrieving: data size 43847249
Sat 18 Jan 2014 03:31:37 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:31:37 - XML: Start document: iteration 8
Sat 18 Jan 2014 03:31:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43847249
Sat 18 Jan 2014 03:31:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:31:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:31:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:31:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:31:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:31:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43847249
Sat 18 Jan 2014 03:31:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:31:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:31:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:31:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:31:45 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:31:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:31:46 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:31:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 03:31:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 03:31:47 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:31:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8783 values 138710 bits 17338 bytes 
Sat 18 Jan 2014 03:31:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:31:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:31:54 - XML: Processed 655424 elements - found 609 jobs
Sat 18 Jan 2014 03:31:54 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:31:54 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:31:54 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:31:54 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:31:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:31:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:31:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:31:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:31:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:31:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:31:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:31:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:31:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:31:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:31:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:32:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:32:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:32:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:32:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:32:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:32:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:32:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:32:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:32:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:32:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43860813
Sat 18 Jan 2014 03:32:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:32:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43860813
Sat 18 Jan 2014 03:32:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:32:09 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:32:09 - job_xml_thread(): Done retrieving: data size 43860813
Sat 18 Jan 2014 03:32:09 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:32:09 - XML: Start document: iteration 9
Sat 18 Jan 2014 03:32:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:32:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:32:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:32:15 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:32:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:32:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:32:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:32:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:32:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:32:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:32:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:32:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:32:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:32:20 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:32:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 03:32:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:32:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:32:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:32:25 - XML: Processed 655424 elements - found 609 jobs
Sat 18 Jan 2014 03:32:25 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:32:25 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:32:25 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:32:25 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:32:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:32:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:32:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:32:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:32:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:32:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:32:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:32:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43844645
Sat 18 Jan 2014 03:32:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:32:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43844645
Sat 18 Jan 2014 03:32:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:32:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:32:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:32:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:32:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:32:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:32:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:32:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:32:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:32:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:32:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:32:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:32:40 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:32:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:32:41 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:32:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:32:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:32:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:32:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:32:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:32:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:32:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:32:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873780
Sat 18 Jan 2014 03:32:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:32:43 - job_xml_thread(): Done retrieving: data size 43873780
Sat 18 Jan 2014 03:32:43 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:32:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873780
Sat 18 Jan 2014 03:32:43 - XML: Start document: iteration 10
Sat 18 Jan 2014 03:32:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:32:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:32:47 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:32:47 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:32:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:32:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 03:32:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 03:32:47 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:32:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9112 values 144294 bits 18036 bytes 
Sat 18 Jan 2014 03:32:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:32:56 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:32:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:32:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:32:57 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 03:32:57 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:32:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:32:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:32:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:32:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:32:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:32:57 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:32:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:32:57 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:32:57 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 03:32:57 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 03:32:57 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 03:32:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sat 18 Jan 2014 03:33:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:33:05 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:33:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:33:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:33:06 - XML: Processed 655424 elements - found 609 jobs
Sat 18 Jan 2014 03:33:06 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:33:06 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:33:06 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:33:06 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:33:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:33:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:33:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:33:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:33:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:33:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43847342
Sat 18 Jan 2014 03:33:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:33:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43847342
Sat 18 Jan 2014 03:33:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:33:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:33:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:33:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:33:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:33:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:33:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:33:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:33:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:33:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:33:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:33:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43847342
Sat 18 Jan 2014 03:33:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:33:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:33:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:33:21 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:33:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:33:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:33:24 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:33:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:33:28 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:33:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:33:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:33:29 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:33:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 03:33:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:33:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:33:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:33:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:33:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:33:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:33:30 - job_xml_thread(): Done retrieving: data size 43835608
Sat 18 Jan 2014 03:33:30 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:33:30 - XML: Start document: iteration 11
Sat 18 Jan 2014 03:33:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43835608
Sat 18 Jan 2014 03:33:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:33:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:33:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:33:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:33:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:33:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:33:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43835608
Sat 18 Jan 2014 03:33:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:33:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:33:42 - XML: Processed 655424 elements - found 609 jobs
Sat 18 Jan 2014 03:33:42 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:33:42 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:33:42 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:33:42 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:33:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:33:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:33:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:33:48 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:33:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:33:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:33:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:33:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 03:33:50 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:33:50 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:33:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5793 values 91485 bits 11435 bytes 
Sat 18 Jan 2014 03:33:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 03:33:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:33:50 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:33:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:33:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:33:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:33:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:33:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:33:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:33:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:33:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:33:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:33:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:33:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:33:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:33:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:33:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:33:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:33:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:33:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875891
Sat 18 Jan 2014 03:33:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:33:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875891
Sat 18 Jan 2014 03:33:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:33:57 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:33:57 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:33:57 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:33:57 - job_xml_thread(): Done retrieving: data size 43875891
Sat 18 Jan 2014 03:33:57 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:33:57 - XML: Start document: iteration 12
Sat 18 Jan 2014 03:33:58 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:33:58 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:33:58 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 03:33:58 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 03:33:58 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 03:34:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:34:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:34:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:34:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:34:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:34:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:34:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:34:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sat 18 Jan 2014 03:34:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:34:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:34:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:34:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:34:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:34:12 - XML: Processed 655424 elements - found 609 jobs
Sat 18 Jan 2014 03:34:12 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:34:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 03:34:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:34:12 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:34:12 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:34:12 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:34:12 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:34:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:34:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:34:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:34:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:34:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:34:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:34:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:34:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:34:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:34:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43850922
Sat 18 Jan 2014 03:34:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:34:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43850922
Sat 18 Jan 2014 03:34:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:34:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:34:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:34:27 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:34:27 - job_xml_thread(): Done retrieving: data size 43850922
Sat 18 Jan 2014 03:34:27 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:34:27 - XML: Start document: iteration 13
Sat 18 Jan 2014 03:34:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:34:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:34:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:34:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:34:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:34:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:34:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:34:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:34:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:34:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:34:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:34:38 - XML: Processed 655424 elements - found 609 jobs
Sat 18 Jan 2014 03:34:38 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:34:38 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:34:38 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:34:38 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:34:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:34:40 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:34:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:34:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:34:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:34:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:34:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:34:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:34:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:34:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43848524
Sat 18 Jan 2014 03:34:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:34:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43848524
Sat 18 Jan 2014 03:34:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:34:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:34:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:34:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:34:50 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:34:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:34:51 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:34:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 03:34:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 03:34:52 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:34:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9050 values 142828 bits 17853 bytes 
Sat 18 Jan 2014 03:34:53 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:34:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:34:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:34:53 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:34:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:34:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:34:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:34:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:34:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:34:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:34:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:34:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:34:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:34:58 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:34:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:34:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:34:58 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:34:58 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:34:58 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:34:58 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 03:34:58 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:34:58 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 03:34:58 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 03:34:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:34:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:34:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:34:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:34:59 - size of cluster 'LISA Cluster': 624 hosts 79482 metrics 938799 values 14827903 bits 1853487 bytes 
Sat 18 Jan 2014 03:35:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:35:02 - job_xml_thread(): Done retrieving: data size 43847272
Sat 18 Jan 2014 03:35:02 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:35:02 - XML: Start document: iteration 14
Sat 18 Jan 2014 03:35:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43847272
Sat 18 Jan 2014 03:35:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:35:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43847272
Sat 18 Jan 2014 03:35:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:35:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:35:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:35:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:35:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:35:17 - XML: Processed 655424 elements - found 609 jobs
Sat 18 Jan 2014 03:35:18 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:35:18 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:35:18 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:35:18 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:35:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:35:20 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:35:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:35:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:35:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:35:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:35:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:35:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:35:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:35:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:35:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:35:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:35:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:35:26 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:35:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 03:35:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:35:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:35:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:35:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:35:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:35:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:35:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43787469
Sat 18 Jan 2014 03:35:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:35:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43787469
Sat 18 Jan 2014 03:35:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:35:33 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:35:33 - job_xml_thread(): Done retrieving: data size 43787469
Sat 18 Jan 2014 03:35:33 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:35:33 - XML: Start document: iteration 15
Sat 18 Jan 2014 03:35:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:35:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:35:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:35:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:35:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:35:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:35:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:35:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:35:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:35:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:35:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:35:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:35:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:35:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:35:48 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:35:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:35:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:35:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:35:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:35:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:35:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:35:51 - XML: Processed 654675 elements - found 609 jobs
Sat 18 Jan 2014 03:35:51 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:35:51 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:35:51 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:35:51 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:35:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:35:51 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:35:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:35:52 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:35:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 03:35:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 03:35:52 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:35:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5673 values 89446 bits 11180 bytes 
Sat 18 Jan 2014 03:35:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:35:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43219395
Sat 18 Jan 2014 03:35:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:35:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43219395
Sat 18 Jan 2014 03:35:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:35:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:35:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:35:59 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:35:59 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 03:36:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:36:03 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:36:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:36:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:36:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:36:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:36:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:36:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:36:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:36:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:36:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43219395
Sat 18 Jan 2014 03:36:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:36:06 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:36:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:36:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:36:14 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:36:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:36:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:36:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:36:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:36:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:36:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:36:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:36:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:36:19 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:36:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 03:36:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:36:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:36:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:36:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:36:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:36:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:36:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:36:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:36:21 - job_xml_thread(): Done retrieving: data size 43229007
Sat 18 Jan 2014 03:36:21 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:36:21 - XML: Start document: iteration 16
Sat 18 Jan 2014 03:36:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43229007
Sat 18 Jan 2014 03:36:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:36:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43229007
Sat 18 Jan 2014 03:36:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:36:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:36:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:36:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:36:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:36:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:36:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:36:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:36:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:36:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:36:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:36:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:36:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:36:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:36:41 - XML: Processed 647898 elements - found 609 jobs
Sat 18 Jan 2014 03:36:42 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:36:42 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:36:42 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:36:42 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:36:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:36:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:36:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:36:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:36:44 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 03:36:44 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 03:36:44 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:36:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:36:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:36:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:36:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:36:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:36:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43780016
Sat 18 Jan 2014 03:36:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:36:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43780016
Sat 18 Jan 2014 03:36:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:36:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:36:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:36:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:36:52 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:36:53 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:36:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 03:36:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:36:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 03:36:53 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:36:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8127 values 128214 bits 16026 bytes 
Sat 18 Jan 2014 03:36:57 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:36:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:36:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:36:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:36:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:36:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:36:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:36:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:36:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:36:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:37:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:37:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:37:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:37:01 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:37:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:37:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:37:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:37:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:37:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:37:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:37:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:37:03 - job_xml_thread(): Done retrieving: data size 43850310
Sat 18 Jan 2014 03:37:03 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:37:03 - XML: Start document: iteration 17
Sat 18 Jan 2014 03:37:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43850310
Sat 18 Jan 2014 03:37:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43850310
Sat 18 Jan 2014 03:37:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:37:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:37:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:37:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:37:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:37:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:37:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:37:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:37:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:37:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:37:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:37:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:37:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:37:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:37:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:37:21 - XML: Processed 655422 elements - found 608 jobs
Sat 18 Jan 2014 03:37:21 - job 7348764 appears to have finished
Sat 18 Jan 2014 03:37:21 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 03:37:21 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 03:37:22 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 03:37:22 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:37:22 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:37:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:37:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:37:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:37:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:37:26 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:37:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 03:37:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:37:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:37:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:37:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:37:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:37:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:37:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43854757
Sat 18 Jan 2014 03:37:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:37:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43854757
Sat 18 Jan 2014 03:37:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:37:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:37:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:37:37 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:37:37 - job_xml_thread(): Done retrieving: data size 43854757
Sat 18 Jan 2014 03:37:37 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:37:37 - XML: Start document: iteration 18
Sat 18 Jan 2014 03:37:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:37:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:37:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:37:45 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:37:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:37:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:37:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:37:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:37:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:37:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:37:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:37:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:37:48 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:37:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:37:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:37:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:37:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:37:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:37:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:37:50 - XML: Processed 655418 elements - found 608 jobs
Sat 18 Jan 2014 03:37:50 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:37:50 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:37:50 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:37:50 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:37:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:37:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855341
Sat 18 Jan 2014 03:37:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:37:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855341
Sat 18 Jan 2014 03:37:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:37:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:37:54 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:37:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:37:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 03:37:55 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:37:55 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:37:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8858 values 139733 bits 17466 bytes 
Sat 18 Jan 2014 03:37:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 03:38:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:38:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:38:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:38:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:38:05 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:38:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:38:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:38:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:38:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:38:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:38:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:38:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:38:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:38:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:38:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:38:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:38:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:38:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:38:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:38:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:38:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:38:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:38:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:38:11 - job_xml_thread(): Done retrieving: data size 43879409
Sat 18 Jan 2014 03:38:11 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:38:11 - XML: Start document: iteration 19
Sat 18 Jan 2014 03:38:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43879409
Sat 18 Jan 2014 03:38:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43879409
Sat 18 Jan 2014 03:38:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:38:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:38:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:38:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:38:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:38:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:38:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:38:25 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:38:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:38:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:38:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:38:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:38:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:38:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:38:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:38:30 - XML: Processed 655422 elements - found 608 jobs
Sat 18 Jan 2014 03:38:30 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:38:30 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:38:30 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:38:30 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:38:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:38:33 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:38:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:38:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:38:33 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:38:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 03:38:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:38:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:38:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:38:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:38:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:38:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:38:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43843016
Sat 18 Jan 2014 03:38:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:38:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43843016
Sat 18 Jan 2014 03:38:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:38:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:38:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:38:45 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:38:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:38:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:38:46 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:38:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:38:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:38:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:38:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:38:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:38:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:38:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:38:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:38:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:38:49 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:38:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:38:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:38:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:38:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:38:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:38:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:38:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:38:51 - job_xml_thread(): Done retrieving: data size 43861817
Sat 18 Jan 2014 03:38:51 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:38:51 - XML: Start document: iteration 20
Sat 18 Jan 2014 03:38:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43861817
Sat 18 Jan 2014 03:38:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:38:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43861817
Sat 18 Jan 2014 03:38:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:38:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:38:56 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:38:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:38:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 03:38:56 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:38:56 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:38:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 03:38:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8857 values 139650 bits 17456 bytes 
Sat 18 Jan 2014 03:39:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:39:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:39:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:39:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:39:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:39:07 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:39:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:39:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:39:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:39:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:39:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:39:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:39:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:39:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:39:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:39:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:39:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:39:15 - XML: Processed 655422 elements - found 608 jobs
Sat 18 Jan 2014 03:39:15 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:39:15 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:39:15 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:39:15 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:39:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:39:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:39:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:39:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:39:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:39:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43838020
Sat 18 Jan 2014 03:39:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:39:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43838020
Sat 18 Jan 2014 03:39:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:39:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:39:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:39:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:39:26 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:39:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:39:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:39:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:39:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:39:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:39:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:39:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43838020
Sat 18 Jan 2014 03:39:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:39:30 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:39:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:39:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:39:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:39:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:39:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:39:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:39:39 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:39:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:39:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:39:39 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:39:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 03:39:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:39:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:39:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:39:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:39:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:39:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:39:41 - job_xml_thread(): Done retrieving: data size 43849275
Sat 18 Jan 2014 03:39:41 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:39:41 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 03:39:41 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 03:39:41 - Housekeeping: done.
Sat 18 Jan 2014 03:39:41 - XML: Start document: iteration 0
Sat 18 Jan 2014 03:39:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43849275
Sat 18 Jan 2014 03:39:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:39:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:39:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:39:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:39:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:39:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:39:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:39:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43849275
Sat 18 Jan 2014 03:39:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:39:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:39:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:39:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:39:56 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:39:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:39:57 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:39:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 03:39:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 03:39:57 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:39:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5833 values 91952 bits 11494 bytes 
Sat 18 Jan 2014 03:39:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:39:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:39:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:39:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:39:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:39:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:39:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:39:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:39:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:40:01 - XML: Processed 655422 elements - found 608 jobs
Sat 18 Jan 2014 03:40:01 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:40:01 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:40:01 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:40:01 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:40:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:40:05 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:40:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:40:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:40:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:40:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:40:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:40:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:40:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:40:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43847192
Sat 18 Jan 2014 03:40:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:40:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43847192
Sat 18 Jan 2014 03:40:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:40:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:40:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:40:16 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:40:16 - job_xml_thread(): Done retrieving: data size 43847192
Sat 18 Jan 2014 03:40:16 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:40:16 - XML: Start document: iteration 1
Sat 18 Jan 2014 03:40:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:40:20 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:40:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:40:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:40:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:40:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:40:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:40:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:40:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:40:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:40:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:40:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:40:31 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:40:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:40:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:40:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:40:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:40:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:40:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:40:32 - XML: Processed 655422 elements - found 608 jobs
Sat 18 Jan 2014 03:40:32 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:40:32 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:40:32 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:40:32 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:40:32 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:40:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 03:40:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:40:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:40:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43821509
Sat 18 Jan 2014 03:40:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:40:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43821509
Sat 18 Jan 2014 03:40:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:40:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:40:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:40:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:40:44 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:40:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:40:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:40:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:40:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:40:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:40:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:40:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:40:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:40:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:40:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:40:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:40:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:40:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:40:47 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:40:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:40:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:40:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:40:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:40:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:40:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855813
Sat 18 Jan 2014 03:40:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:40:49 - job_xml_thread(): Done retrieving: data size 43855813
Sat 18 Jan 2014 03:40:49 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:40:49 - XML: Start document: iteration 2
Sat 18 Jan 2014 03:40:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855813
Sat 18 Jan 2014 03:40:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:40:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:40:58 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:40:58 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:40:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 03:40:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:40:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 03:40:59 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:40:59 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8749 values 137921 bits 17240 bytes 
Sat 18 Jan 2014 03:41:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:41:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:41:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:41:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:41:06 - XML: Processed 655422 elements - found 608 jobs
Sat 18 Jan 2014 03:41:06 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:41:06 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:41:06 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:41:06 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:41:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:41:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:41:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:41:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:41:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:41:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:41:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:41:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:41:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:41:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:41:13 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:41:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:41:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:41:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:41:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:41:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:41:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:41:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:41:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43800893
Sat 18 Jan 2014 03:41:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:41:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43800893
Sat 18 Jan 2014 03:41:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:41:21 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:41:21 - job_xml_thread(): Done retrieving: data size 43800893
Sat 18 Jan 2014 03:41:21 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:41:21 - XML: Start document: iteration 3
Sat 18 Jan 2014 03:41:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:41:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:41:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:41:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:41:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:41:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:41:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:41:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:41:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:41:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:41:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:41:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:41:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:41:34 - XML: Processed 654674 elements - found 608 jobs
Sat 18 Jan 2014 03:41:34 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:41:34 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:41:34 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:41:34 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:41:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:41:37 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:41:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:41:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:41:38 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:41:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 03:41:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:41:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:41:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:41:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:41:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:41:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:41:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43376950
Sat 18 Jan 2014 03:41:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:41:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43376950
Sat 18 Jan 2014 03:41:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:41:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:41:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:41:49 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:41:50 - job_xml_thread(): Done retrieving: data size 43376950
Sat 18 Jan 2014 03:41:50 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:41:50 - XML: Start document: iteration 4
Sat 18 Jan 2014 03:41:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:41:51 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:41:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:41:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:41:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:41:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:41:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:41:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:41:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:41:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:41:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:41:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:41:59 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:41:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:41:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 03:41:59 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:41:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 03:41:59 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:41:59 - XML: Processed 649734 elements - found 608 jobs
Sat 18 Jan 2014 03:41:59 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5910 values 93197 bits 11649 bytes 
Sat 18 Jan 2014 03:41:59 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:41:59 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:41:59 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:41:59 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:42:00 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 03:42:00 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:42:00 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:42:00 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:42:00 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 03:42:00 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 03:42:00 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 03:42:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:42:01 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:42:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:42:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:42:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:42:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:42:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:42:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:42:02 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 979237 values 15451071 bits 1931383 bytes 
Sat 18 Jan 2014 03:42:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:42:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43168737
Sat 18 Jan 2014 03:42:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:42:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43168737
Sat 18 Jan 2014 03:42:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:42:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:42:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:42:14 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:42:14 - job_xml_thread(): Done retrieving: data size 43168737
Sat 18 Jan 2014 03:42:15 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:42:15 - XML: Start document: iteration 5
Sat 18 Jan 2014 03:42:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:42:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:42:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:42:20 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:42:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:42:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:42:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:42:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:42:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:42:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:42:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:42:24 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:42:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 03:42:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:42:28 - XML: Processed 647296 elements - found 608 jobs
Sat 18 Jan 2014 03:42:28 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:42:28 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:42:28 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:42:28 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:42:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:42:30 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:42:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:42:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:42:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:42:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:42:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:42:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:42:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:42:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572037
Sat 18 Jan 2014 03:42:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:42:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572037
Sat 18 Jan 2014 03:42:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:42:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:42:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:42:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:42:43 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:42:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:42:43 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:42:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:42:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:42:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:42:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:42:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:42:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:42:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:42:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:42:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:42:48 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:42:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:42:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:42:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:42:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:42:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:42:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:42:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:42:51 - job_xml_thread(): Done retrieving: data size 43813732
Sat 18 Jan 2014 03:42:51 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:42:51 - XML: Start document: iteration 6
Sat 18 Jan 2014 03:42:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43813732
Sat 18 Jan 2014 03:42:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43813732
Sat 18 Jan 2014 03:42:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:42:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:42:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:42:59 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:42:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:42:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:43:00 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:43:01 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 03:43:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:43:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 03:43:01 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:43:01 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:43:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 03:43:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9112 values 143724 bits 17965 bytes 
Sat 18 Jan 2014 03:43:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:43:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:43:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:43:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:43:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:43:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:43:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:43:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:43:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:43:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:43:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:43:13 - XML: Processed 655106 elements - found 607 jobs
Sat 18 Jan 2014 03:43:13 - job 7348252 appears to have finished
Sat 18 Jan 2014 03:43:13 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 03:43:13 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 03:43:14 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 03:43:14 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:43:14 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:43:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:43:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:43:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:43:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:43:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:43:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:43:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:43:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:43:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:43:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43839432
Sat 18 Jan 2014 03:43:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:43:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43839432
Sat 18 Jan 2014 03:43:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:43:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:43:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:43:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:43:27 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:43:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:43:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:43:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:43:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:43:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:43:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:43:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43839432
Sat 18 Jan 2014 03:43:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:43:29 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:43:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:43:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:43:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:43:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:43:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:43:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:43:41 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:43:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:43:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:43:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:43:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:43:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:43:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:43:42 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:43:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 03:43:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:43:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:43:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:43:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:43:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:43:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:43:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:43:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:43:44 - job_xml_thread(): Done retrieving: data size 43834184
Sat 18 Jan 2014 03:43:44 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:43:44 - XML: Start document: iteration 7
Sat 18 Jan 2014 03:43:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43834184
Sat 18 Jan 2014 03:43:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43834184
Sat 18 Jan 2014 03:43:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:43:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:43:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:43:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:43:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:43:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:43:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:43:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:43:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:43:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:44:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:44:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:44:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:44:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:44:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:44:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:44:01 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:44:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:44:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 03:44:02 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:44:02 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:44:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5819 values 91739 bits 11467 bytes 
Sat 18 Jan 2014 03:44:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 03:44:07 - XML: Processed 655420 elements - found 607 jobs
Sat 18 Jan 2014 03:44:07 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:44:07 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:44:07 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:44:07 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:44:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:44:10 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:44:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:44:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:44:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:44:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:44:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:44:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:44:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:44:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43842455
Sat 18 Jan 2014 03:44:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:44:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43842455
Sat 18 Jan 2014 03:44:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:44:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:44:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:44:22 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:44:22 - job_xml_thread(): Done retrieving: data size 43842455
Sat 18 Jan 2014 03:44:22 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:44:22 - XML: Start document: iteration 8
Sat 18 Jan 2014 03:44:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:44:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:44:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:44:27 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:44:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:44:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:44:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:44:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:44:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:44:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:44:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:44:37 - XML: Processed 655420 elements - found 607 jobs
Sat 18 Jan 2014 03:44:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:44:37 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:44:37 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:44:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:44:37 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:44:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:44:37 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:44:37 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:44:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:44:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:44:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:44:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:44:38 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:44:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 03:44:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:44:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:44:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43840179
Sat 18 Jan 2014 03:44:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:44:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43840179
Sat 18 Jan 2014 03:44:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:44:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:44:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:44:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:44:51 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:44:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:44:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:44:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:44:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:44:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:44:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:44:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:44:52 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:44:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:44:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:44:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:44:57 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:44:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:44:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:44:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:44:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:44:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:44:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:45:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:45:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43868324
Sat 18 Jan 2014 03:45:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:45:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43868324
Sat 18 Jan 2014 03:45:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:45:00 - job_xml_thread(): Done retrieving: data size 43868324
Sat 18 Jan 2014 03:45:00 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:45:00 - XML: Start document: iteration 9
Sat 18 Jan 2014 03:45:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:45:02 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:45:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:45:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 03:45:03 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:45:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5739 values 90478 bits 11309 bytes 
Sat 18 Jan 2014 03:45:04 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:45:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 03:45:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:45:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:45:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:45:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:45:19 - XML: Processed 655420 elements - found 607 jobs
Sat 18 Jan 2014 03:45:20 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:45:20 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:45:20 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:45:20 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:45:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:45:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:45:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:45:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:45:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:45:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:45:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:45:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:45:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:45:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:45:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:45:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:45:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:45:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:45:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:45:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:45:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:45:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:45:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43874898
Sat 18 Jan 2014 03:45:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:45:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43874898
Sat 18 Jan 2014 03:45:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:45:35 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:45:35 - job_xml_thread(): Done retrieving: data size 43874898
Sat 18 Jan 2014 03:45:35 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:45:35 - XML: Start document: iteration 10
Sat 18 Jan 2014 03:45:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:45:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:45:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:45:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:45:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:45:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:45:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:45:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:45:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:45:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:45:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:45:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:45:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:45:48 - XML: Processed 655420 elements - found 607 jobs
Sat 18 Jan 2014 03:45:48 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:45:48 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:45:48 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:45:48 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:45:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:45:50 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:45:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:45:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:45:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:45:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:45:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:45:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:45:50 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:45:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 03:45:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:45:52 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 03:45:52 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 03:45:52 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:45:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:45:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43835879
Sat 18 Jan 2014 03:45:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:45:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43835879
Sat 18 Jan 2014 03:45:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:45:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:45:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:46:04 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:46:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:46:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:46:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:46:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:46:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:46:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:46:04 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:46:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:46:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:46:04 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:46:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:46:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 03:46:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:46:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:46:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 03:46:04 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:46:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5955 values 93935 bits 11741 bytes 
Sat 18 Jan 2014 03:46:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:46:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:46:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:46:07 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:46:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:46:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:46:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:46:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:46:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:46:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:46:09 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:46:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 03:46:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:46:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:46:10 - job_xml_thread(): Done retrieving: data size 43861330
Sat 18 Jan 2014 03:46:10 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:46:10 - XML: Start document: iteration 11
Sat 18 Jan 2014 03:46:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43861330
Sat 18 Jan 2014 03:46:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:46:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43861330
Sat 18 Jan 2014 03:46:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:46:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:46:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:46:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:46:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:46:24 - XML: Processed 655420 elements - found 607 jobs
Sat 18 Jan 2014 03:46:24 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:46:25 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:46:25 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:46:25 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:46:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:46:29 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:46:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:46:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:46:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:46:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:46:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:46:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:46:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:46:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:46:32 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:46:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:46:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:46:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:46:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:46:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:46:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:46:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:46:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43857970
Sat 18 Jan 2014 03:46:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:46:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43857970
Sat 18 Jan 2014 03:46:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:46:40 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:46:40 - job_xml_thread(): Done retrieving: data size 43857970
Sat 18 Jan 2014 03:46:40 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:46:40 - XML: Start document: iteration 12
Sat 18 Jan 2014 03:46:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:46:43 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:46:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:46:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:46:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:46:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:46:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:46:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:46:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:46:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:46:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:46:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:46:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:46:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:46:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:46:56 - XML: Processed 655420 elements - found 607 jobs
Sat 18 Jan 2014 03:46:56 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:46:56 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:46:56 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:46:56 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:46:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:46:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:46:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:46:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:46:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:46:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43860568
Sat 18 Jan 2014 03:46:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:46:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43860568
Sat 18 Jan 2014 03:46:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:47:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:47:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:47:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:47:04 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:47:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:47:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 03:47:06 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:47:06 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:47:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 03:47:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148847 bits 18605 bytes 
Sat 18 Jan 2014 03:47:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:47:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:47:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:47:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:47:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:47:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:47:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:47:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:47:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:47:11 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:47:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:47:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:47:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:47:13 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:47:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:47:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:47:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:47:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:47:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:47:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:47:15 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:47:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 03:47:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:47:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:47:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43797209
Sat 18 Jan 2014 03:47:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:47:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43797209
Sat 18 Jan 2014 03:47:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:47:16 - job_xml_thread(): Done retrieving: data size 43797209
Sat 18 Jan 2014 03:47:16 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:47:16 - XML: Start document: iteration 13
Sat 18 Jan 2014 03:47:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:47:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:47:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:47:27 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:47:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:47:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:47:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:47:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:47:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:47:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:47:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:47:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:47:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:47:37 - XML: Processed 654672 elements - found 607 jobs
Sat 18 Jan 2014 03:47:37 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:47:37 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:47:37 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:47:37 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:47:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:47:38 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:47:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:47:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:47:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:47:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:47:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:47:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:47:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:47:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43311422
Sat 18 Jan 2014 03:47:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:47:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43311422
Sat 18 Jan 2014 03:47:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:47:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:47:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:47:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:47:51 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:47:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:47:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:47:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:47:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:47:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:47:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:47:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:47:52 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:47:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:47:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:47:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:47:54 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:47:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:47:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:47:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:47:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:47:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:47:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:47:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:47:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43217676
Sat 18 Jan 2014 03:47:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:47:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43217676
Sat 18 Jan 2014 03:47:57 - job_xml_thread(): Done retrieving: data size 43217676
Sat 18 Jan 2014 03:47:57 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:47:57 - XML: Start document: iteration 14
Sat 18 Jan 2014 03:47:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:48:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:48:06 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:48:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:48:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:48:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:48:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 03:48:07 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:48:07 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:48:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 03:48:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9279 values 146796 bits 18349 bytes 
Sat 18 Jan 2014 03:48:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:48:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:48:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:48:15 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:48:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:48:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:48:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:48:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:48:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:48:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:48:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:48:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:48:18 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:48:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:48:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:48:19 - XML: Processed 647250 elements - found 607 jobs
Sat 18 Jan 2014 03:48:19 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:48:19 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:48:19 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:48:19 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:48:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:48:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:48:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:48:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:48:22 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:48:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 03:48:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:48:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:48:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43250614
Sat 18 Jan 2014 03:48:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:48:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43250614
Sat 18 Jan 2014 03:48:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:48:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:48:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:48:34 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:48:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:48:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:48:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:48:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:48:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:48:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:48:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:48:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:48:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:48:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:48:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:48:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:48:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:48:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:48:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:48:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:48:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:48:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:48:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:48:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:48:38 - job_xml_thread(): Done retrieving: data size 43711321
Sat 18 Jan 2014 03:48:38 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:48:38 - XML: Start document: iteration 15
Sat 18 Jan 2014 03:48:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43711321
Sat 18 Jan 2014 03:48:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:48:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43711321
Sat 18 Jan 2014 03:48:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:48:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:48:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:48:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:48:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:48:57 - XML: Processed 653612 elements - found 607 jobs
Sat 18 Jan 2014 03:48:57 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:48:57 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:48:57 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:48:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:48:58 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:48:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:48:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:48:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:48:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:48:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:48:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:48:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:48:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:49:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:49:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:49:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:49:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:49:01 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 03:49:01 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:49:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:49:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:49:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:49:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:49:01 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:49:01 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:49:01 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 03:49:01 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 03:49:01 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 03:49:02 - size of cluster 'LISA Cluster': 624 hosts 79474 metrics 811527 values 12826897 bits 1603362 bytes 
Sat 18 Jan 2014 03:49:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:49:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43843858
Sat 18 Jan 2014 03:49:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:49:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43843858
Sat 18 Jan 2014 03:49:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:49:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:49:08 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:49:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:49:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 03:49:10 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:49:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148749 bits 18593 bytes 
Sat 18 Jan 2014 03:49:10 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:49:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 03:49:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:49:11 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:49:13 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:49:13 - job_xml_thread(): Done retrieving: data size 43843858
Sat 18 Jan 2014 03:49:13 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:49:13 - XML: Start document: iteration 16
Sat 18 Jan 2014 03:49:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:49:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:49:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:49:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:49:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:49:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:49:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:49:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:49:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:49:24 - XML: Processed 655284 elements - found 607 jobs
Sat 18 Jan 2014 03:49:24 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:49:24 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:49:24 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:49:24 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:49:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:49:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:49:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:49:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:49:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:49:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:49:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:49:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:49:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:49:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43834285
Sat 18 Jan 2014 03:49:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:49:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:49:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43834285
Sat 18 Jan 2014 03:49:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:49:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:49:40 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:49:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:49:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:49:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:49:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:49:44 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:49:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:49:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:49:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:49:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:49:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:49:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:49:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:49:46 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:49:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:49:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:49:46 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:49:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 03:49:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:49:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:49:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:49:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:49:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:49:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:49:49 - job_xml_thread(): Done retrieving: data size 43836639
Sat 18 Jan 2014 03:49:49 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:49:49 - XML: Start document: iteration 17
Sat 18 Jan 2014 03:49:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43836639
Sat 18 Jan 2014 03:49:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43836639
Sat 18 Jan 2014 03:49:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:49:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:50:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:50:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:50:01 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:50:01 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 03:50:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:50:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:50:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:50:03 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:50:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:50:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:50:04 - XML: Processed 655420 elements - found 607 jobs
Sat 18 Jan 2014 03:50:04 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:50:04 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:50:04 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:50:04 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:50:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:50:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:50:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:50:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:50:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:50:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:50:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:50:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:50:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:50:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:50:10 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:50:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:50:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:50:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:50:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:50:10 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:50:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 03:50:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:50:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 03:50:10 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:50:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5810 values 91654 bits 11456 bytes 
Sat 18 Jan 2014 03:50:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:50:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43869258
Sat 18 Jan 2014 03:50:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:50:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43869258
Sat 18 Jan 2014 03:50:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:50:19 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:50:19 - job_xml_thread(): Done retrieving: data size 43869258
Sat 18 Jan 2014 03:50:19 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:50:19 - XML: Start document: iteration 18
Sat 18 Jan 2014 03:50:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:50:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:50:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:50:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:50:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:50:30 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:50:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:50:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:50:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:50:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:50:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:50:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:50:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:50:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:50:33 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:50:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:50:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:50:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:50:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:50:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:50:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:50:35 - XML: Processed 655420 elements - found 607 jobs
Sat 18 Jan 2014 03:50:35 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:50:35 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:50:35 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:50:35 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:50:36 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:50:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 03:50:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:50:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:50:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43859403
Sat 18 Jan 2014 03:50:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:50:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43859403
Sat 18 Jan 2014 03:50:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:50:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:50:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:50:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:50:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:50:49 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:50:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:50:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:50:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:50:50 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:50:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:50:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:50:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:50:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:50:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:50:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:50:52 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:50:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:50:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:50:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:50:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:50:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:50:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:50:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:50:56 - job_xml_thread(): Done retrieving: data size 43873135
Sat 18 Jan 2014 03:50:56 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:50:56 - XML: Start document: iteration 19
Sat 18 Jan 2014 03:50:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43873135
Sat 18 Jan 2014 03:50:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:50:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43873135
Sat 18 Jan 2014 03:50:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:51:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:51:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:51:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:51:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:51:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:51:10 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:51:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:51:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:51:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:51:11 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:51:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:51:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 03:51:12 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:51:12 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:51:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 03:51:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:51:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:51:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:51:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:51:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8012 values 126362 bits 15795 bytes 
Sat 18 Jan 2014 03:51:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:51:16 - XML: Processed 655420 elements - found 607 jobs
Sat 18 Jan 2014 03:51:16 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:51:16 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:51:16 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:51:16 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:51:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:51:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:51:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:51:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:51:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:51:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:51:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:51:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:51:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:51:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43852991
Sat 18 Jan 2014 03:51:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:51:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43852991
Sat 18 Jan 2014 03:51:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:51:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:51:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:51:31 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:51:31 - job_xml_thread(): Done retrieving: data size 43852991
Sat 18 Jan 2014 03:51:31 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:51:31 - XML: Start document: iteration 20
Sat 18 Jan 2014 03:51:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:51:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:51:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:51:40 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:51:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:51:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:51:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:51:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:51:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:51:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:51:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:51:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:51:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:51:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:51:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:51:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:51:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:51:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:51:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:51:46 - XML: Processed 655420 elements - found 607 jobs
Sat 18 Jan 2014 03:51:46 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:51:46 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:51:46 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:51:46 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:51:46 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:51:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 03:51:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:51:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:51:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43845903
Sat 18 Jan 2014 03:51:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:51:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43845903
Sat 18 Jan 2014 03:51:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:51:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:51:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:51:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:51:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:51:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:51:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:51:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:51:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:52:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:52:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:52:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:52:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:52:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:52:01 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:52:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:52:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:52:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:52:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:52:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:52:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:52:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:52:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:52:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:52:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43860032
Sat 18 Jan 2014 03:52:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:52:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43860032
Sat 18 Jan 2014 03:52:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:52:07 - job_xml_thread(): Done retrieving: data size 43860032
Sat 18 Jan 2014 03:52:08 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:52:08 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 03:52:09 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 03:52:09 - Housekeeping: done.
Sat 18 Jan 2014 03:52:09 - XML: Start document: iteration 0
Sat 18 Jan 2014 03:52:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:52:12 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:52:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:52:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 03:52:14 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:52:14 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:52:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 03:52:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8819 values 139068 bits 17383 bytes 
Sat 18 Jan 2014 03:52:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:52:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:52:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:52:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:52:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:52:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:52:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:52:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:52:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:52:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:52:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:52:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:52:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:52:29 - XML: Processed 655422 elements - found 608 jobs
Sat 18 Jan 2014 03:52:29 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 03:52:29 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 03:52:29 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 03:52:29 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:52:29 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:52:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:52:31 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:52:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:52:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:52:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:52:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:52:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:52:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:52:35 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 03:52:35 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 03:52:35 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:52:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:52:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43836036
Sat 18 Jan 2014 03:52:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:52:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43836036
Sat 18 Jan 2014 03:52:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:52:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:52:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:52:44 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:52:44 - job_xml_thread(): Done retrieving: data size 43836036
Sat 18 Jan 2014 03:52:44 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:52:44 - XML: Start document: iteration 1
Sat 18 Jan 2014 03:52:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:52:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:52:47 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:52:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:52:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:52:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:52:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:52:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:52:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:52:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:52:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:52:57 - XML: Processed 655422 elements - found 608 jobs
Sat 18 Jan 2014 03:52:57 - job 7348765 field 'start_timestamp' changed since saved from: 1390013509 to: 1390013460
Sat 18 Jan 2014 03:52:57 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 03:52:57 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 03:52:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:52:57 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:52:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:52:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:52:57 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 03:52:57 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:52:57 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:52:57 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:52:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 03:52:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:52:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:52:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:52:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:52:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:52:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:52:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43841780
Sat 18 Jan 2014 03:52:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:53:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43841780
Sat 18 Jan 2014 03:53:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:53:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:53:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:53:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:53:07 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:53:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:53:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:53:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:53:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:53:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:53:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:53:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43841780
Sat 18 Jan 2014 03:53:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:53:12 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:53:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:53:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:53:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:53:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:53:15 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:53:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:53:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 03:53:16 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:53:16 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:53:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 03:53:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6117 values 96555 bits 12069 bytes 
Sat 18 Jan 2014 03:53:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:53:19 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:53:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:53:19 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:53:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:53:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:53:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:53:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:53:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:53:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:53:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:53:22 - job_xml_thread(): Done retrieving: data size 43777820
Sat 18 Jan 2014 03:53:22 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:53:22 - XML: Start document: iteration 2
Sat 18 Jan 2014 03:53:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43777820
Sat 18 Jan 2014 03:53:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:53:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:53:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:53:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:53:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:53:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43777820
Sat 18 Jan 2014 03:53:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:53:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:53:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:53:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:53:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:53:38 - XML: Processed 654674 elements - found 608 jobs
Sat 18 Jan 2014 03:53:38 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:53:38 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:53:38 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:53:38 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:53:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:53:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:53:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:53:39 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:53:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:53:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:53:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:53:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:53:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:53:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:53:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:53:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:53:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:53:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:53:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:53:44 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:53:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 03:53:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:53:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:53:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:53:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:53:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:53:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:53:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43254916
Sat 18 Jan 2014 03:53:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:53:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43254916
Sat 18 Jan 2014 03:53:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:53:53 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:53:53 - job_xml_thread(): Done retrieving: data size 43254916
Sat 18 Jan 2014 03:53:53 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:53:53 - XML: Start document: iteration 3
Sat 18 Jan 2014 03:53:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:53:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:53:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:53:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:53:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:53:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:54:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:54:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:54:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:54:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:54:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:54:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:54:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:54:04 - XML: Processed 647994 elements - found 608 jobs
Sat 18 Jan 2014 03:54:04 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:54:04 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:54:04 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:54:04 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:54:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:54:07 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:54:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:54:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:54:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:54:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:54:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:54:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:54:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:54:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43199927
Sat 18 Jan 2014 03:54:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:54:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43199927
Sat 18 Jan 2014 03:54:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:54:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:54:16 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:54:17 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:54:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 03:54:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:54:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 03:54:17 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:54:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9231 values 145621 bits 18202 bytes 
Sat 18 Jan 2014 03:54:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:54:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:54:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:54:19 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:54:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:54:19 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:54:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:54:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:54:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:54:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:54:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:54:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:54:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:54:22 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:54:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:54:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:54:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:54:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:54:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:54:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:54:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:54:23 - job_xml_thread(): Done retrieving: data size 43278442
Sat 18 Jan 2014 03:54:23 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:54:23 - XML: Start document: iteration 4
Sat 18 Jan 2014 03:54:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43278442
Sat 18 Jan 2014 03:54:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43278442
Sat 18 Jan 2014 03:54:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:54:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:54:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:54:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:54:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:54:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:54:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:54:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:54:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:54:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:54:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:54:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:54:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:54:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:54:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:54:39 - XML: Processed 647968 elements - found 607 jobs
Sat 18 Jan 2014 03:54:39 - job 7348062 appears to have finished
Sat 18 Jan 2014 03:54:39 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 03:54:39 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 03:54:40 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 03:54:40 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:54:40 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:54:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:54:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:54:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:54:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:54:44 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:54:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 03:54:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:54:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:54:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:54:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:54:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:54:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:54:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43786087
Sat 18 Jan 2014 03:54:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:54:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43786087
Sat 18 Jan 2014 03:54:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:54:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:54:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:54:55 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:54:55 - job_xml_thread(): Done retrieving: data size 43786087
Sat 18 Jan 2014 03:54:55 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:54:55 - XML: Start document: iteration 5
Sat 18 Jan 2014 03:54:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:54:56 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:54:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:54:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:54:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:54:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:54:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:54:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:54:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:54:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:54:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:55:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:55:07 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:55:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:55:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:55:08 - XML: Processed 654708 elements - found 607 jobs
Sat 18 Jan 2014 03:55:08 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:55:08 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:55:08 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:55:08 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:55:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:55:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:55:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:55:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:55:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:55:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43845628
Sat 18 Jan 2014 03:55:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:55:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43845628
Sat 18 Jan 2014 03:55:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:55:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:55:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:55:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:55:18 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:55:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:55:18 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:55:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 03:55:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 03:55:18 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:55:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8980 values 141634 bits 17704 bytes 
Sat 18 Jan 2014 03:55:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:55:19 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:55:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:55:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:55:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:55:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:55:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:55:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:55:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43845628
Sat 18 Jan 2014 03:55:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:55:23 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:55:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:55:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:55:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:55:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:55:28 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:55:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:55:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:55:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:55:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:55:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:55:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:55:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:55:31 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:55:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:55:33 - job_xml_thread(): Done retrieving: data size 43845501
Sat 18 Jan 2014 03:55:33 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:55:33 - XML: Start document: iteration 6
Sat 18 Jan 2014 03:55:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43845501
Sat 18 Jan 2014 03:55:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:55:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:55:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:55:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:55:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:55:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43845501
Sat 18 Jan 2014 03:55:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:55:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:55:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:55:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:55:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:55:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:55:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:55:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:55:51 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:55:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:55:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:55:51 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:55:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 03:55:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:55:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:55:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:55:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:55:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:55:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:55:54 - XML: Processed 655420 elements - found 607 jobs
Sat 18 Jan 2014 03:55:54 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:55:54 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:55:54 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:55:54 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:55:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:55:56 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:55:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:55:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:55:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:55:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:55:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:55:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:55:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:55:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43845399
Sat 18 Jan 2014 03:55:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:55:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43845399
Sat 18 Jan 2014 03:55:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:56:02 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 03:56:02 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:56:04 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:56:04 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:56:04 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 03:56:04 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 03:56:04 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 03:56:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:56:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:56:09 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:56:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:56:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:56:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:56:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:56:12 - size of cluster 'LISA Cluster': 624 hosts 79481 metrics 856891 values 13518330 bits 1689791 bytes 
Sat 18 Jan 2014 03:56:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:56:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:56:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:56:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:56:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:56:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:56:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:56:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:56:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:56:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:56:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:56:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:56:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:56:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:56:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:56:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:56:17 - job_xml_thread(): Done retrieving: data size 43852079
Sat 18 Jan 2014 03:56:17 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:56:17 - XML: Start document: iteration 7
Sat 18 Jan 2014 03:56:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:56:18 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:56:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43852079
Sat 18 Jan 2014 03:56:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43852079
Sat 18 Jan 2014 03:56:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:56:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:56:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:56:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 03:56:20 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:56:20 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:56:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 03:56:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6176 values 97385 bits 12173 bytes 
Sat 18 Jan 2014 03:56:26 - XML: Processed 655420 elements - found 607 jobs
Sat 18 Jan 2014 03:56:26 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:56:26 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:56:26 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:56:26 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:56:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:56:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:56:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:56:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:56:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:56:39 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:56:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:56:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:56:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:56:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:56:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:56:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:56:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:56:41 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:56:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:56:41 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:56:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:56:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:56:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:56:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:56:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:56:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:56:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:56:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43859084
Sat 18 Jan 2014 03:56:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:56:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43859084
Sat 18 Jan 2014 03:56:45 - job_xml_thread(): Done retrieving: data size 43859084
Sat 18 Jan 2014 03:56:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:56:45 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:56:45 - XML: Start document: iteration 8
Sat 18 Jan 2014 03:56:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:56:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:56:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:56:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:56:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:56:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:56:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:56:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:56:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:56:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:56:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:56:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:56:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:57:01 - XML: Processed 655416 elements - found 605 jobs
Sat 18 Jan 2014 03:57:01 - job 7348696 appears to have finished
Sat 18 Jan 2014 03:57:01 - job 7348765 appears to have finished
Sat 18 Jan 2014 03:57:01 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 03:57:01 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 03:57:02 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 03:57:02 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:57:02 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:57:02 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:57:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 03:57:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:57:04 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:57:04 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 03:57:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:57:06 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:57:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:57:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:57:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:57:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:57:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:57:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:57:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:57:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43859133
Sat 18 Jan 2014 03:57:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:57:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43859133
Sat 18 Jan 2014 03:57:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:57:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:57:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:57:17 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:57:17 - job_xml_thread(): Done retrieving: data size 43859133
Sat 18 Jan 2014 03:57:17 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:57:17 - XML: Start document: iteration 9
Sat 18 Jan 2014 03:57:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:57:20 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:57:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:57:20 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:57:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 03:57:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 03:57:20 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:57:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6265 values 98803 bits 12350 bytes 
Sat 18 Jan 2014 03:57:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:57:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:57:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:57:27 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:57:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:57:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:57:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:57:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:57:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:57:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:57:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:57:31 - XML: Processed 655416 elements - found 605 jobs
Sat 18 Jan 2014 03:57:31 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:57:31 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:57:31 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:57:31 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:57:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:57:33 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:57:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:57:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:57:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:57:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:57:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:57:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:57:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:57:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43854855
Sat 18 Jan 2014 03:57:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:57:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43854855
Sat 18 Jan 2014 03:57:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:57:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:57:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:57:46 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:57:46 - job_xml_thread(): Done retrieving: data size 43854855
Sat 18 Jan 2014 03:57:46 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:57:46 - XML: Start document: iteration 10
Sat 18 Jan 2014 03:57:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:57:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:57:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:57:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:57:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:57:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:57:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:57:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:57:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:57:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:57:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:57:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:57:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:57:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:57:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:57:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:57:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:57:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:57:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:57:59 - XML: Processed 655416 elements - found 605 jobs
Sat 18 Jan 2014 03:57:59 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:57:59 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:57:59 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:57:59 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:58:01 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:58:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 03:58:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:58:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:58:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865334
Sat 18 Jan 2014 03:58:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:58:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43865334
Sat 18 Jan 2014 03:58:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:58:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:58:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:58:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:58:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:58:14 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:58:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:58:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:58:18 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:58:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:58:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:58:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:58:19 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:58:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:58:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:58:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:58:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:58:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:58:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:58:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:58:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:58:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:58:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:58:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:58:20 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:58:21 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:58:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:58:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 03:58:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 03:58:21 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:58:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5934 values 93588 bits 11698 bytes 
Sat 18 Jan 2014 03:58:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:58:23 - job_xml_thread(): Done retrieving: data size 43859872
Sat 18 Jan 2014 03:58:23 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:58:23 - XML: Start document: iteration 11
Sat 18 Jan 2014 03:58:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43859872
Sat 18 Jan 2014 03:58:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:58:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43859872
Sat 18 Jan 2014 03:58:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:58:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:58:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:58:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:58:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:58:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:58:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:58:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:58:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:58:41 - XML: Processed 655416 elements - found 605 jobs
Sat 18 Jan 2014 03:58:41 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:58:41 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:58:41 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:58:41 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:58:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:58:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:58:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:58:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:58:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:58:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:58:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:58:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:58:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:58:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:58:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:58:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:58:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:58:52 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:58:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 03:58:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:58:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:58:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43857978
Sat 18 Jan 2014 03:58:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:58:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43857978
Sat 18 Jan 2014 03:58:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:58:56 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:58:56 - job_xml_thread(): Done retrieving: data size 43857978
Sat 18 Jan 2014 03:58:56 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:58:56 - XML: Start document: iteration 12
Sat 18 Jan 2014 03:58:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:58:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:59:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:59:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:59:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:59:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:59:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:59:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:59:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:59:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:59:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:59:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:59:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:59:16 - XML: Processed 655416 elements - found 605 jobs
Sat 18 Jan 2014 03:59:17 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 03:59:17 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 03:59:17 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 03:59:17 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 03:59:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:59:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:59:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:59:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:59:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:59:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:59:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:59:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:59:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:59:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43787472
Sat 18 Jan 2014 03:59:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:59:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:59:21 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:59:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43787472
Sat 18 Jan 2014 03:59:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:59:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:59:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 03:59:22 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:59:22 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:59:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 03:59:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7442 values 117298 bits 14662 bytes 
Sat 18 Jan 2014 03:59:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:59:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:59:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:59:31 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 03:59:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 03:59:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:59:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:59:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 03:59:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 03:59:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 03:59:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 03:59:32 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 03:59:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:59:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:59:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 03:59:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 03:59:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 03:59:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 03:59:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:59:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 03:59:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 03:59:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 03:59:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 03:59:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43288913
Sat 18 Jan 2014 03:59:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 03:59:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43288913
Sat 18 Jan 2014 03:59:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 03:59:40 - job_xml_thread(): Done retrieving: data size 43288913
Sat 18 Jan 2014 03:59:40 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 03:59:40 - XML: Start document: iteration 13
Sat 18 Jan 2014 03:59:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 03:59:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:59:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 03:59:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 03:59:54 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 03:59:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 03:59:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 03:59:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 03:59:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:00:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:00:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:00:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:00:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:00:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:00:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:00:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:00:03 - XML: Processed 648402 elements - found 605 jobs
Sat 18 Jan 2014 04:00:03 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:00:03 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:00:03 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:00:03 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:00:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:00:06 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:00:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:00:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:00:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:00:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:00:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:00:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:00:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:00:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43197679
Sat 18 Jan 2014 04:00:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:00:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43197679
Sat 18 Jan 2014 04:00:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:00:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:00:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:00:18 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:00:18 - job_xml_thread(): Done retrieving: data size 43197679
Sat 18 Jan 2014 04:00:18 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:00:18 - XML: Start document: iteration 14
Sat 18 Jan 2014 04:00:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:00:22 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:00:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:00:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:00:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:00:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 04:00:22 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:00:22 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:00:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 04:00:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6217 values 98060 bits 12257 bytes 
Sat 18 Jan 2014 04:00:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:00:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:00:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:00:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:00:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:00:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:00:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:00:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:00:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:00:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:00:29 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:00:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:00:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:00:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:00:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:00:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:00:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:00:32 - XML: Processed 647230 elements - found 605 jobs
Sat 18 Jan 2014 04:00:32 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:00:32 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:00:32 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:00:32 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:00:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:00:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43356498
Sat 18 Jan 2014 04:00:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:00:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43356498
Sat 18 Jan 2014 04:00:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:00:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:00:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:00:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:00:45 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:00:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:00:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:00:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:00:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:00:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:00:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:00:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:00:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:00:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:00:46 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:00:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 04:00:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:00:47 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:00:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:00:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:00:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:00:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:00:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:00:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:00:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:00:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:00:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:00:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43806109
Sat 18 Jan 2014 04:00:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:00:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43806109
Sat 18 Jan 2014 04:00:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:00:55 - job_xml_thread(): Done retrieving: data size 43806109
Sat 18 Jan 2014 04:00:55 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:00:55 - XML: Start document: iteration 15
Sat 18 Jan 2014 04:01:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:01:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:01:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:01:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:01:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:01:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:01:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:01:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:01:13 - XML: Processed 654868 elements - found 606 jobs
Sat 18 Jan 2014 04:01:13 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 04:01:13 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 04:01:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:01:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:01:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:01:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:01:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:01:14 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 04:01:14 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:01:14 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:01:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:01:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:01:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:01:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:01:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:01:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:01:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:01:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:01:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:01:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855056
Sat 18 Jan 2014 04:01:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:01:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855056
Sat 18 Jan 2014 04:01:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:01:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:01:23 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:01:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:01:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 04:01:23 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:01:23 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:01:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 04:01:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6113 values 96469 bits 12058 bytes 
Sat 18 Jan 2014 04:01:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:01:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:01:30 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:01:30 - job_xml_thread(): Done retrieving: data size 43855056
Sat 18 Jan 2014 04:01:30 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:01:30 - XML: Start document: iteration 16
Sat 18 Jan 2014 04:01:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:01:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:01:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:01:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:01:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:01:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:01:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:01:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:01:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:01:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:01:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:01:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:01:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:01:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:01:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:01:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:01:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:01:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:01:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:01:47 - XML: Processed 655418 elements - found 606 jobs
Sat 18 Jan 2014 04:01:47 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:01:47 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:01:47 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:01:47 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:01:49 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 04:01:49 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 04:01:49 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:01:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:01:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43840894
Sat 18 Jan 2014 04:01:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:01:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43840894
Sat 18 Jan 2014 04:01:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:01:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:01:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:02:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:02:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:02:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:02:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:02:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:02:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:02:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:02:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:02:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:02:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:02:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:02:02 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:02:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:02:04 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:02:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:02:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:02:04 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:02:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 04:02:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:02:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:02:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:02:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:02:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:02:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:02:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867972
Sat 18 Jan 2014 04:02:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:02:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43867972
Sat 18 Jan 2014 04:02:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:02:07 - job_xml_thread(): Done retrieving: data size 43867972
Sat 18 Jan 2014 04:02:08 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:02:08 - XML: Start document: iteration 17
Sat 18 Jan 2014 04:02:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:02:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:02:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:02:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:02:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:02:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:02:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:02:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:02:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:02:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:02:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:02:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:02:24 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:02:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:02:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 04:02:24 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:02:24 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:02:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6060 values 95895 bits 11986 bytes 
Sat 18 Jan 2014 04:02:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 04:02:28 - XML: Processed 655414 elements - found 604 jobs
Sat 18 Jan 2014 04:02:28 - job 7343041 appears to have finished
Sat 18 Jan 2014 04:02:28 - job 7348697 appears to have finished
Sat 18 Jan 2014 04:02:28 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 04:02:28 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 04:02:28 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 04:02:28 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:02:28 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:02:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:02:29 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:02:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:02:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:02:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:02:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:02:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:02:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:02:32 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:02:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 04:02:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:02:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:02:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43830541
Sat 18 Jan 2014 04:02:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:02:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43830541
Sat 18 Jan 2014 04:02:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:02:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:02:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:02:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:02:43 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:02:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:02:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:02:44 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:02:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:02:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:02:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:02:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:02:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:02:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:02:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:02:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:02:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:02:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:02:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:02:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:02:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:02:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:02:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:02:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:02:49 - job_xml_thread(): Done retrieving: data size 43878032
Sat 18 Jan 2014 04:02:49 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:02:49 - XML: Start document: iteration 18
Sat 18 Jan 2014 04:02:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43878032
Sat 18 Jan 2014 04:02:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:02:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43878032
Sat 18 Jan 2014 04:02:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:03:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:03:00 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:03:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:03:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:03:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:03:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:03:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:03:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:03:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:03:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:03:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:03:04 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 04:03:04 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:03:05 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:03:05 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 04:03:05 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:03:05 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 04:03:05 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 04:03:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:03:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:03:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:03:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:03:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:03:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:03:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:03:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:03:13 - XML: Processed 655414 elements - found 604 jobs
Sat 18 Jan 2014 04:03:13 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:03:13 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:03:13 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:03:13 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:03:13 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 1069752 values 16901113 bits 2112639 bytes 
Sat 18 Jan 2014 04:03:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:03:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:03:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:03:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43821545
Sat 18 Jan 2014 04:03:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:03:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43821545
Sat 18 Jan 2014 04:03:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:03:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:03:24 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:03:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:03:25 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:03:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 04:03:25 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:03:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 04:03:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 149025 bits 18628 bytes 
Sat 18 Jan 2014 04:03:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:03:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:03:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:03:26 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:03:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:03:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:03:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:03:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:03:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:03:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:03:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:03:28 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:03:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:03:32 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:03:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:03:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:03:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:03:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:03:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:03:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:03:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:03:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43848667
Sat 18 Jan 2014 04:03:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:03:36 - job_xml_thread(): Done retrieving: data size 43848667
Sat 18 Jan 2014 04:03:36 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:03:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43848667
Sat 18 Jan 2014 04:03:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:03:36 - XML: Start document: iteration 19
Sat 18 Jan 2014 04:03:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:03:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:03:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:03:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:03:47 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:03:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 04:03:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:03:54 - XML: Processed 655413 elements - found 604 jobs
Sat 18 Jan 2014 04:03:54 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:03:54 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:03:54 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:03:54 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:03:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:03:56 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:03:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:03:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:03:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:03:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:03:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:03:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:03:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:03:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:03:59 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:03:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:03:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:04:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:04:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:04:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:04:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:04:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:04:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43861391
Sat 18 Jan 2014 04:04:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:04:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43861391
Sat 18 Jan 2014 04:04:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:04:05 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:04:06 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 04:04:09 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:04:09 - job_xml_thread(): Done retrieving: data size 43861391
Sat 18 Jan 2014 04:04:09 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:04:09 - XML: Start document: iteration 20
Sat 18 Jan 2014 04:04:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:04:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:04:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:04:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:04:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:04:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:04:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:04:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:04:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:04:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:04:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:04:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:04:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:04:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:04:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:04:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:04:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:04:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:04:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:04:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:04:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:04:25 - XML: Processed 655414 elements - found 604 jobs
Sat 18 Jan 2014 04:04:25 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:04:25 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:04:25 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:04:25 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:04:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:04:25 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:04:25 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:04:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:04:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 04:04:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 04:04:25 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:04:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6162 values 97274 bits 12159 bytes 
Sat 18 Jan 2014 04:04:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:04:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43829836
Sat 18 Jan 2014 04:04:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:04:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43829836
Sat 18 Jan 2014 04:04:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:04:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:04:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:04:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:04:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:04:40 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:04:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:04:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:04:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:04:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:04:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:04:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:04:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:04:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:04:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:04:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:04:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:04:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:04:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:04:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:04:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:04:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:04:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:04:47 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:04:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 04:04:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:04:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:04:49 - job_xml_thread(): Done retrieving: data size 43865246
Sat 18 Jan 2014 04:04:49 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:04:49 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 04:04:49 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 04:04:49 - Housekeeping: done.
Sat 18 Jan 2014 04:04:49 - XML: Start document: iteration 0
Sat 18 Jan 2014 04:04:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43865246
Sat 18 Jan 2014 04:04:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865246
Sat 18 Jan 2014 04:04:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:04:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:04:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:04:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:05:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:05:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:05:06 - XML: Processed 655412 elements - found 603 jobs
Sat 18 Jan 2014 04:05:06 - job 7348695 appears to have finished
Sat 18 Jan 2014 04:05:06 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 04:05:06 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 04:05:06 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 04:05:06 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:05:06 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:05:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:05:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:05:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:05:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:05:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:05:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:05:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:05:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:05:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:05:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:05:13 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:05:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:05:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:05:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:05:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:05:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:05:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:05:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:05:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43794417
Sat 18 Jan 2014 04:05:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:05:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43794417
Sat 18 Jan 2014 04:05:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:05:21 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:05:21 - job_xml_thread(): Done retrieving: data size 43794417
Sat 18 Jan 2014 04:05:21 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:05:21 - XML: Start document: iteration 1
Sat 18 Jan 2014 04:05:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:05:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:05:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:05:26 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:05:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:05:26 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:05:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:05:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:05:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:05:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:05:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:05:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:05:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:05:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:05:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 04:05:28 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:05:28 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:05:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 04:05:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8271 values 130434 bits 16304 bytes 
Sat 18 Jan 2014 04:05:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:05:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:05:35 - XML: Processed 654664 elements - found 603 jobs
Sat 18 Jan 2014 04:05:35 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:05:35 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:05:35 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:05:35 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:05:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:05:38 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:05:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:05:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:05:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:05:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:05:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:05:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:05:41 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:05:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 04:05:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:05:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:05:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43364672
Sat 18 Jan 2014 04:05:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:05:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43364672
Sat 18 Jan 2014 04:05:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:05:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:05:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:05:51 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:05:51 - job_xml_thread(): Done retrieving: data size 43364672
Sat 18 Jan 2014 04:05:51 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:05:52 - XML: Start document: iteration 2
Sat 18 Jan 2014 04:05:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:05:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:05:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:05:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:05:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:05:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:05:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:05:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:05:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:05:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:05:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:06:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:06:02 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:06:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:06:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:06:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:06:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:06:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:06:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:06:05 - XML: Processed 649694 elements - found 603 jobs
Sat 18 Jan 2014 04:06:05 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:06:05 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:06:05 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:06:05 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:06:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:06:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43196779
Sat 18 Jan 2014 04:06:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:06:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43196779
Sat 18 Jan 2014 04:06:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:06:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:06:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:06:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:06:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:06:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:06:20 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:06:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:06:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:06:20 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:06:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:06:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:06:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:06:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:06:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:06:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:06:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:06:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:06:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:06:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:06:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:06:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:06:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:06:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:06:27 - job_xml_thread(): Done retrieving: data size 43237767
Sat 18 Jan 2014 04:06:27 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:06:27 - XML: Start document: iteration 3
Sat 18 Jan 2014 04:06:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43237767
Sat 18 Jan 2014 04:06:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:06:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43237767
Sat 18 Jan 2014 04:06:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:06:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:06:29 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:06:30 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:06:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 04:06:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:06:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 04:06:30 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:06:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148595 bits 18574 bytes 
Sat 18 Jan 2014 04:06:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:06:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:06:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:06:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:06:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:06:46 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:06:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:06:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:06:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:06:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:06:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:06:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:06:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:06:47 - XML: Processed 647972 elements - found 605 jobs
Sat 18 Jan 2014 04:06:47 - job 7348698 appears to have finished
Sat 18 Jan 2014 04:06:47 - job_xml_thread(): Found 4 updated jobs.
Sat 18 Jan 2014 04:06:47 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 04:06:48 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Sat 18 Jan 2014 04:06:48 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:06:48 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:06:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:06:53 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:06:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:06:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:06:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:06:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:06:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:06:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:06:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:06:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43824501
Sat 18 Jan 2014 04:06:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:06:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43824501
Sat 18 Jan 2014 04:06:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:07:00 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:07:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 04:07:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:07:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:07:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:07:03 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:07:04 - job_xml_thread(): Done retrieving: data size 43824501
Sat 18 Jan 2014 04:07:04 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:07:04 - XML: Start document: iteration 4
Sat 18 Jan 2014 04:07:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:07:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:07:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:07:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:07:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:07:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:07:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:07:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:07:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:07:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:07:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:07:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:07:19 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:07:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:07:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:07:20 - XML: Processed 655346 elements - found 605 jobs
Sat 18 Jan 2014 04:07:20 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:07:20 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:07:20 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:07:20 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:07:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:07:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:07:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:07:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:07:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:07:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43828390
Sat 18 Jan 2014 04:07:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:07:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43828390
Sat 18 Jan 2014 04:07:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:07:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:07:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:07:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:07:30 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:07:31 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:07:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 04:07:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:07:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 04:07:31 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:07:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5905 values 93144 bits 11643 bytes 
Sat 18 Jan 2014 04:07:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:07:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:07:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:07:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:07:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:07:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:07:35 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:07:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:07:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:07:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:07:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:07:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:07:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:07:40 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:07:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:07:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:07:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:07:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:07:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:07:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:07:44 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:07:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 04:07:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:07:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:07:44 - job_xml_thread(): Done retrieving: data size 43836242
Sat 18 Jan 2014 04:07:44 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:07:44 - XML: Start document: iteration 5
Sat 18 Jan 2014 04:07:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43836242
Sat 18 Jan 2014 04:07:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43836242
Sat 18 Jan 2014 04:07:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:07:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:07:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:07:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:07:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:07:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:08:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:08:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:08:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:08:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:08:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:08:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:08:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:08:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:08:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:08:06 - XML: Processed 655416 elements - found 605 jobs
Sat 18 Jan 2014 04:08:06 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:08:06 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:08:06 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:08:07 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:08:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:08:10 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:08:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:08:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:08:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:08:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:08:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:08:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:08:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:08:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43835891
Sat 18 Jan 2014 04:08:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:08:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43835891
Sat 18 Jan 2014 04:08:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:08:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:08:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:08:22 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:08:22 - job_xml_thread(): Done retrieving: data size 43835891
Sat 18 Jan 2014 04:08:22 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:08:22 - XML: Start document: iteration 6
Sat 18 Jan 2014 04:08:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:08:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:08:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:08:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:08:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:08:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:08:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:08:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:08:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:08:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:08:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:08:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:08:32 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:08:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:08:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 04:08:33 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:08:33 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:08:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99064 bits 12383 bytes 
Sat 18 Jan 2014 04:08:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 04:08:35 - XML: Processed 655414 elements - found 604 jobs
Sat 18 Jan 2014 04:08:35 - job 7348699 appears to have finished
Sat 18 Jan 2014 04:08:35 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 04:08:35 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 04:08:35 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 04:08:35 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:08:35 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:08:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:08:38 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:08:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:08:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:08:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:08:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:08:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:08:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:08:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:08:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43825013
Sat 18 Jan 2014 04:08:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:08:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43825013
Sat 18 Jan 2014 04:08:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:08:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:08:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:08:50 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:08:50 - job_xml_thread(): Done retrieving: data size 43825013
Sat 18 Jan 2014 04:08:50 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:08:50 - XML: Start document: iteration 7
Sat 18 Jan 2014 04:08:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:08:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:09:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:09:02 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:09:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:09:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:09:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:09:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:09:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:09:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:09:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:09:05 - XML: Processed 655414 elements - found 604 jobs
Sat 18 Jan 2014 04:09:05 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:09:05 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:09:05 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:09:05 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:09:06 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:09:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 04:09:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:09:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:09:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:09:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:09:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:09:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:09:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:09:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:09:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:09:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:09:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43835727
Sat 18 Jan 2014 04:09:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:09:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43835727
Sat 18 Jan 2014 04:09:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:09:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:09:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:09:21 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:09:21 - job_xml_thread(): Done retrieving: data size 43835727
Sat 18 Jan 2014 04:09:21 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:09:21 - XML: Start document: iteration 8
Sat 18 Jan 2014 04:09:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:09:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:09:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:09:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:09:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:09:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:09:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:09:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:09:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:09:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:09:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:09:33 - XML: Processed 655414 elements - found 604 jobs
Sat 18 Jan 2014 04:09:33 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:09:33 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:09:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:09:33 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:09:33 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:09:33 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:09:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:09:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 04:09:34 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:09:34 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:09:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 04:09:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5891 values 92906 bits 11613 bytes 
Sat 18 Jan 2014 04:09:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:09:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:09:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:09:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:09:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:09:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:09:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:09:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:09:40 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:09:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 04:09:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:09:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:09:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43839229
Sat 18 Jan 2014 04:09:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:09:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43839229
Sat 18 Jan 2014 04:09:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:09:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:09:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:09:48 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:09:48 - job_xml_thread(): Done retrieving: data size 43839229
Sat 18 Jan 2014 04:09:48 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:09:48 - XML: Start document: iteration 9
Sat 18 Jan 2014 04:09:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:09:51 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:09:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:09:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:09:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:09:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:09:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:09:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:09:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:09:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:09:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:10:01 - XML: Processed 655414 elements - found 604 jobs
Sat 18 Jan 2014 04:10:01 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:10:01 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:10:01 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:10:01 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:10:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:10:04 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:10:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:10:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:10:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:10:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:10:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:10:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:10:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:10:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:10:07 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 04:10:07 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:10:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:10:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43842103
Sat 18 Jan 2014 04:10:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:10:09 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:10:09 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:10:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43842103
Sat 18 Jan 2014 04:10:09 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 04:10:09 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 04:10:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:10:09 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 04:10:16 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:10:16 - job_xml_thread(): Done retrieving: data size 43842103
Sat 18 Jan 2014 04:10:16 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:10:16 - XML: Start document: iteration 10
Sat 18 Jan 2014 04:10:17 - size of cluster 'LISA Cluster': 624 hosts 79456 metrics 1019023 values 16085878 bits 2010734 bytes 
Sat 18 Jan 2014 04:10:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:10:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:10:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:10:25 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:10:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:10:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:10:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:10:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:10:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:10:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:10:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:10:27 - XML: Processed 655414 elements - found 604 jobs
Sat 18 Jan 2014 04:10:27 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:10:27 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:10:27 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:10:27 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:10:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:10:32 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:10:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:10:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:10:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:10:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:10:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:10:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:10:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:10:34 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:10:35 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:10:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 04:10:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:10:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 04:10:35 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:10:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99054 bits 12381 bytes 
Sat 18 Jan 2014 04:10:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:10:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851971
Sat 18 Jan 2014 04:10:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:10:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851971
Sat 18 Jan 2014 04:10:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:10:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:10:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:10:42 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:10:42 - job_xml_thread(): Done retrieving: data size 43851971
Sat 18 Jan 2014 04:10:42 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:10:42 - XML: Start document: iteration 11
Sat 18 Jan 2014 04:10:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:10:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:10:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:10:51 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:10:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:10:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:10:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:10:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:10:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:10:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:10:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:10:58 - XML: Processed 655410 elements - found 602 jobs
Sat 18 Jan 2014 04:10:58 - job 7343924 appears to have finished
Sat 18 Jan 2014 04:10:58 - job 7348702 appears to have finished
Sat 18 Jan 2014 04:10:58 - job 7348595 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 04:10:58 - job_xml_thread(): Found 3 updated jobs.
Sat 18 Jan 2014 04:10:58 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 04:10:58 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Sat 18 Jan 2014 04:10:58 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:10:58 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:11:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:11:02 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:11:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:11:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:11:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:11:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:11:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:11:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:11:07 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:11:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 04:11:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:11:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:11:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:11:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:11:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43840493
Sat 18 Jan 2014 04:11:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:11:09 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:11:09 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 04:11:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43840493
Sat 18 Jan 2014 04:11:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:11:13 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:11:13 - job_xml_thread(): Done retrieving: data size 43840493
Sat 18 Jan 2014 04:11:13 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:11:13 - XML: Start document: iteration 12
Sat 18 Jan 2014 04:11:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:11:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:11:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:11:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:11:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:11:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:11:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:11:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:11:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:11:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:11:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:11:28 - XML: Processed 655410 elements - found 602 jobs
Sat 18 Jan 2014 04:11:28 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:11:28 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:11:28 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:11:28 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:11:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:11:32 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:11:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:11:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:11:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:11:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:11:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:11:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:11:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:11:35 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:11:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:11:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 04:11:35 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:11:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 3479 values 54873 bits 6859 bytes 
Sat 18 Jan 2014 04:11:35 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:11:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 04:11:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:11:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:11:43 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:11:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:11:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43633642
Sat 18 Jan 2014 04:11:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:11:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:11:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:11:47 - job_xml_thread(): Done retrieving: data size 43633642
Sat 18 Jan 2014 04:11:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43633642
Sat 18 Jan 2014 04:11:47 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:11:47 - XML: Start document: iteration 13
Sat 18 Jan 2014 04:11:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:12:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:12:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:12:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:12:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:12:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:12:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:12:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:12:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:12:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:12:05 - XML: Processed 653006 elements - found 602 jobs
Sat 18 Jan 2014 04:12:05 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:12:05 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:12:05 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:12:05 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:12:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:12:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:12:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:12:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:12:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:12:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:12:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:12:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:12:11 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:12:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 04:12:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:12:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:12:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43226389
Sat 18 Jan 2014 04:12:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:12:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43226389
Sat 18 Jan 2014 04:12:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:12:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:12:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:12:20 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:12:20 - job_xml_thread(): Done retrieving: data size 43226389
Sat 18 Jan 2014 04:12:20 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:12:21 - XML: Start document: iteration 14
Sat 18 Jan 2014 04:12:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:12:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:12:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:12:36 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:12:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:12:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:12:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:12:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:12:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:12:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:12:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:12:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:12:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:12:37 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:12:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 04:12:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:12:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 04:12:37 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:12:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5057 values 79723 bits 9965 bytes 
Sat 18 Jan 2014 04:12:38 - XML: Processed 647864 elements - found 601 jobs
Sat 18 Jan 2014 04:12:38 - job 7348592 appears to have finished
Sat 18 Jan 2014 04:12:38 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 04:12:38 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 04:12:38 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 04:12:38 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:12:38 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:12:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:12:41 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:12:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:12:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:12:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:12:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:12:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:12:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:12:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:12:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43745373
Sat 18 Jan 2014 04:12:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:12:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43745373
Sat 18 Jan 2014 04:12:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:12:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:12:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:12:53 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:12:53 - job_xml_thread(): Done retrieving: data size 43745373
Sat 18 Jan 2014 04:12:53 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:12:53 - XML: Start document: iteration 15
Sat 18 Jan 2014 04:12:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:12:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:13:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:13:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:13:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:13:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:13:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:13:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:13:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:13:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:13:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:13:13 - XML: Processed 654266 elements - found 601 jobs
Sat 18 Jan 2014 04:13:13 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:13:13 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:13:13 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:13:13 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:13:13 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:13:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 04:13:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:13:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:13:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:13:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:13:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:13:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:13:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:13:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:13:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:13:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:13:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:13:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:13:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43826136
Sat 18 Jan 2014 04:13:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:13:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43826136
Sat 18 Jan 2014 04:13:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:13:28 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:13:28 - job_xml_thread(): Done retrieving: data size 43826136
Sat 18 Jan 2014 04:13:28 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:13:28 - XML: Start document: iteration 16
Sat 18 Jan 2014 04:13:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:13:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:13:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:13:39 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:13:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:13:40 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:13:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:13:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:13:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:13:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:13:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:13:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:13:41 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:13:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 04:13:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:13:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 04:13:41 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:13:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:13:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:13:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:13:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:13:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:13:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5891 values 92910 bits 11613 bytes 
Sat 18 Jan 2014 04:13:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:13:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:13:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:13:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:13:46 - XML: Processed 655408 elements - found 601 jobs
Sat 18 Jan 2014 04:13:46 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:13:46 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:13:46 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:13:46 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:13:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:13:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:13:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:13:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:13:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:13:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43848215
Sat 18 Jan 2014 04:13:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:13:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43848215
Sat 18 Jan 2014 04:13:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:14:01 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:14:01 - job_xml_thread(): Done retrieving: data size 43848215
Sat 18 Jan 2014 04:14:01 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:14:01 - XML: Start document: iteration 17
Sat 18 Jan 2014 04:14:10 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:14:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 04:14:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:14:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:14:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:14:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:14:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:14:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:14:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:14:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:14:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:14:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:14:20 - XML: Processed 655408 elements - found 601 jobs
Sat 18 Jan 2014 04:14:20 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:14:20 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:14:20 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:14:20 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:14:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:14:21 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:14:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:14:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:14:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:14:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:14:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:14:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:14:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:14:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851401
Sat 18 Jan 2014 04:14:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:14:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:14:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:14:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851401
Sat 18 Jan 2014 04:14:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:14:36 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:14:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:14:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:14:36 - job_xml_thread(): Done retrieving: data size 43851401
Sat 18 Jan 2014 04:14:36 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:14:37 - XML: Start document: iteration 18
Sat 18 Jan 2014 04:14:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:14:41 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:14:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:14:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 04:14:43 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:14:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 04:14:43 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:14:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5958 values 93997 bits 11749 bytes 
Sat 18 Jan 2014 04:14:49 - XML: Processed 655408 elements - found 601 jobs
Sat 18 Jan 2014 04:14:49 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:14:49 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:14:49 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:14:50 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:14:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:14:50 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:14:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:14:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:14:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:14:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:14:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:14:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:14:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:14:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:14:56 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:14:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:14:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:14:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:14:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:14:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:14:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:15:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:15:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43835995
Sat 18 Jan 2014 04:15:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:15:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43835995
Sat 18 Jan 2014 04:15:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:15:05 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:15:05 - job_xml_thread(): Done retrieving: data size 43835995
Sat 18 Jan 2014 04:15:05 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:15:05 - XML: Start document: iteration 19
Sat 18 Jan 2014 04:15:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:15:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:15:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:15:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:15:14 - XML: Processed 655408 elements - found 601 jobs
Sat 18 Jan 2014 04:15:14 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:15:14 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:15:14 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:15:14 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:15:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:15:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:15:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:15:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:15:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:15:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:15:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:15:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:15:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:15:18 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:15:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 04:15:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:15:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:15:21 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:15:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:15:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:15:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:15:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:15:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:15:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:15:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:15:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43861515
Sat 18 Jan 2014 04:15:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:15:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43861515
Sat 18 Jan 2014 04:15:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:15:29 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:15:29 - job_xml_thread(): Done retrieving: data size 43861515
Sat 18 Jan 2014 04:15:29 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:15:29 - XML: Start document: iteration 20
Sat 18 Jan 2014 04:15:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:15:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:15:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:15:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:15:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:15:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:15:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:15:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:15:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:15:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:15:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:15:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:15:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:15:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:15:43 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:15:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:15:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 04:15:44 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:15:44 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:15:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 04:15:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5938 values 93668 bits 11708 bytes 
Sat 18 Jan 2014 04:15:47 - XML: Processed 655408 elements - found 601 jobs
Sat 18 Jan 2014 04:15:47 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:15:47 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:15:47 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:15:47 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:15:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:15:50 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:15:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:15:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:15:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:15:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:15:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:15:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:15:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:15:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43852167
Sat 18 Jan 2014 04:15:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:15:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43852167
Sat 18 Jan 2014 04:15:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:15:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:15:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:16:02 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:16:02 - job_xml_thread(): Done retrieving: data size 43852167
Sat 18 Jan 2014 04:16:02 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:16:02 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 04:16:02 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 04:16:02 - Housekeeping: done.
Sat 18 Jan 2014 04:16:02 - XML: Start document: iteration 0
Sat 18 Jan 2014 04:16:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:16:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:16:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:16:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:16:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:16:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:16:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:16:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:16:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:16:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:16:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:16:10 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:16:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 04:16:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:16:15 - XML: Processed 655408 elements - found 601 jobs
Sat 18 Jan 2014 04:16:15 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:16:15 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:16:15 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:16:15 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:16:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:16:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:16:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:16:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:16:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:16:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:16:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:16:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:16:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:16:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43846969
Sat 18 Jan 2014 04:16:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:16:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43846969
Sat 18 Jan 2014 04:16:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:16:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:16:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:16:30 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:16:30 - job_xml_thread(): Done retrieving: data size 43846969
Sat 18 Jan 2014 04:16:30 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:16:30 - XML: Start document: iteration 1
Sat 18 Jan 2014 04:16:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:16:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:16:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:16:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:16:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:16:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:16:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:16:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:16:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:16:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:16:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:16:42 - XML: Processed 655408 elements - found 601 jobs
Sat 18 Jan 2014 04:16:42 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:16:42 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:16:42 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:16:42 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:16:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:16:42 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:16:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:16:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:16:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:16:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:16:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:16:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:16:43 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 04:16:43 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 04:16:43 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:16:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:16:44 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:16:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:16:44 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:16:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 04:16:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 04:16:44 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:16:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5793 values 91499 bits 11437 bytes 
Sat 18 Jan 2014 04:16:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:16:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43866090
Sat 18 Jan 2014 04:16:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:16:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43866090
Sat 18 Jan 2014 04:16:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:16:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:16:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:16:57 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:16:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:16:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:16:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:16:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:16:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:16:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:16:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:16:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:16:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:16:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:16:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:17:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:17:01 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:17:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:17:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:17:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:17:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:17:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:17:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:17:02 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:17:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 04:17:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:17:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:17:03 - job_xml_thread(): Done retrieving: data size 43863987
Sat 18 Jan 2014 04:17:03 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:17:03 - XML: Start document: iteration 2
Sat 18 Jan 2014 04:17:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43863987
Sat 18 Jan 2014 04:17:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:17:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43863987
Sat 18 Jan 2014 04:17:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:17:09 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 04:17:09 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:17:10 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:17:10 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 04:17:10 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:17:10 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 04:17:10 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 04:17:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:17:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:17:16 - XML: Processed 655408 elements - found 601 jobs
Sat 18 Jan 2014 04:17:16 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:17:16 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:17:16 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:17:16 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:17:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:17:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:17:16 - size of cluster 'LISA Cluster': 624 hosts 79457 metrics 495507 values 7823654 bits 977956 bytes 
Sat 18 Jan 2014 04:17:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:17:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:17:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:17:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:17:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:17:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:17:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:17:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:17:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:17:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:17:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:17:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:17:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:17:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:17:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:17:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:17:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:17:28 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 04:17:28 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 04:17:28 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:17:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:17:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43684016
Sat 18 Jan 2014 04:17:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:17:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43684016
Sat 18 Jan 2014 04:17:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:17:31 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:17:31 - job_xml_thread(): Done retrieving: data size 43684016
Sat 18 Jan 2014 04:17:31 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:17:31 - XML: Start document: iteration 3
Sat 18 Jan 2014 04:17:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:17:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:17:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:17:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:17:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:17:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:17:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:17:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:17:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:17:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:17:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:17:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:17:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:17:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:17:45 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:17:45 - XML: Processed 653382 elements - found 601 jobs
Sat 18 Jan 2014 04:17:45 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:17:45 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:17:45 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:17:45 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:17:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:17:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 04:17:46 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:17:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7343 values 116182 bits 14522 bytes 
Sat 18 Jan 2014 04:17:46 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:17:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 04:17:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:17:50 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:17:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:17:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:17:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:17:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:17:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:17:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:17:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:17:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43264258
Sat 18 Jan 2014 04:17:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:17:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43264258
Sat 18 Jan 2014 04:17:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:17:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:17:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:18:00 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:18:00 - job_xml_thread(): Done retrieving: data size 43264258
Sat 18 Jan 2014 04:18:00 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:18:00 - XML: Start document: iteration 4
Sat 18 Jan 2014 04:18:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:18:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:18:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:18:07 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:18:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:18:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:18:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:18:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:18:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:18:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:18:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:18:10 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:18:10 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 04:18:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:18:12 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:18:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:18:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:18:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:18:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:18:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:18:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:18:13 - XML: Processed 648204 elements - found 601 jobs
Sat 18 Jan 2014 04:18:13 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:18:13 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:18:13 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:18:13 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:18:13 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:18:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 04:18:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:18:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:18:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43252914
Sat 18 Jan 2014 04:18:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:18:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43252914
Sat 18 Jan 2014 04:18:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:18:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:18:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:18:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:18:26 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:18:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:18:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:18:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:18:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:18:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:18:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:18:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:18:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:18:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:18:28 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:18:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:18:30 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:18:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:18:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:18:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:18:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:18:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:18:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:18:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:18:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43410027
Sat 18 Jan 2014 04:18:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:18:33 - job_xml_thread(): Done retrieving: data size 43410027
Sat 18 Jan 2014 04:18:33 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:18:33 - XML: Start document: iteration 5
Sat 18 Jan 2014 04:18:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43410027
Sat 18 Jan 2014 04:18:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:18:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:18:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:18:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:18:46 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:18:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:18:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:18:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:18:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 04:18:47 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:18:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 04:18:47 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:18:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9144 values 144540 bits 18067 bytes 
Sat 18 Jan 2014 04:18:50 - XML: Processed 649774 elements - found 601 jobs
Sat 18 Jan 2014 04:18:50 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:18:50 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:18:50 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:18:50 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:18:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:18:53 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:18:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:18:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:18:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:18:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:18:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:18:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:18:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:18:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:18:57 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:18:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:18:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:18:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:18:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:18:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:18:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:19:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:19:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43847307
Sat 18 Jan 2014 04:19:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:19:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43847307
Sat 18 Jan 2014 04:19:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:19:05 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:19:05 - job_xml_thread(): Done retrieving: data size 43847307
Sat 18 Jan 2014 04:19:05 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:19:05 - XML: Start document: iteration 6
Sat 18 Jan 2014 04:19:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:19:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:19:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:19:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:19:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:19:14 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:19:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:19:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:19:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:19:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:19:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:19:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:19:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:19:20 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:19:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 04:19:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:19:24 - XML: Processed 655408 elements - found 601 jobs
Sat 18 Jan 2014 04:19:24 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:19:24 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:19:24 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:19:24 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:19:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:19:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:19:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:19:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:19:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:19:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:19:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:19:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:19:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:19:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43831518
Sat 18 Jan 2014 04:19:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:19:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43831518
Sat 18 Jan 2014 04:19:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:19:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:19:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:19:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:19:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:19:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:19:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:19:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:19:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:19:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:19:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:19:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:19:39 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:19:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:19:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:19:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:19:41 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:19:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:19:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:19:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:19:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:19:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:19:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:19:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:19:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43839905
Sat 18 Jan 2014 04:19:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:19:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43839905
Sat 18 Jan 2014 04:19:45 - job_xml_thread(): Done retrieving: data size 43839905
Sat 18 Jan 2014 04:19:45 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:19:45 - XML: Start document: iteration 7
Sat 18 Jan 2014 04:19:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:19:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:19:47 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:19:48 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:19:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 04:19:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:19:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 04:19:49 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:19:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8909 values 140549 bits 17568 bytes 
Sat 18 Jan 2014 04:19:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:19:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:19:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:19:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:19:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:19:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:19:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:19:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:19:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:19:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:19:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:19:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:19:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:20:03 - XML: Processed 655408 elements - found 601 jobs
Sat 18 Jan 2014 04:20:03 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:20:03 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:20:03 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:20:03 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:20:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:20:06 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:20:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:20:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:20:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:20:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:20:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:20:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:20:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:20:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43844427
Sat 18 Jan 2014 04:20:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:20:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43844427
Sat 18 Jan 2014 04:20:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:20:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:20:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:20:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:20:18 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:20:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:20:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:20:18 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:20:18 - job_xml_thread(): Done retrieving: data size 43844427
Sat 18 Jan 2014 04:20:18 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:20:18 - XML: Start document: iteration 8
Sat 18 Jan 2014 04:20:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:20:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:20:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:20:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43844427
Sat 18 Jan 2014 04:20:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:20:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:20:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:20:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:20:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:20:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:20:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:20:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:20:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:20:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:20:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:20:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:20:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:20:36 - XML: Processed 655408 elements - found 601 jobs
Sat 18 Jan 2014 04:20:36 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:20:36 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:20:36 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:20:36 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:20:38 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:20:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 04:20:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:20:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:20:39 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:20:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:20:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:20:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:20:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:20:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:20:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:20:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:20:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43854394
Sat 18 Jan 2014 04:20:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:20:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43854394
Sat 18 Jan 2014 04:20:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:20:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:20:49 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:20:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:20:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:20:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:20:50 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:20:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 04:20:50 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:20:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5974 values 94265 bits 11783 bytes 
Sat 18 Jan 2014 04:20:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 04:20:51 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:20:51 - job_xml_thread(): Done retrieving: data size 43854394
Sat 18 Jan 2014 04:20:51 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:20:51 - XML: Start document: iteration 9
Sat 18 Jan 2014 04:20:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:20:53 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:20:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:20:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:20:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:20:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:20:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:20:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:20:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:20:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:20:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:21:04 - XML: Processed 655408 elements - found 601 jobs
Sat 18 Jan 2014 04:21:04 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:21:04 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:21:04 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:21:04 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:21:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:21:06 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:21:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:21:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:21:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:21:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:21:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:21:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:21:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:21:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:21:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:21:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43833401
Sat 18 Jan 2014 04:21:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:21:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43833401
Sat 18 Jan 2014 04:21:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:21:19 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:21:19 - job_xml_thread(): Done retrieving: data size 43833401
Sat 18 Jan 2014 04:21:19 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:21:19 - XML: Start document: iteration 10
Sat 18 Jan 2014 04:21:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:21:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:21:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:21:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:21:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:21:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:21:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:21:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:21:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:21:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:21:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:21:24 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:21:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 04:21:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:21:30 - XML: Processed 655408 elements - found 601 jobs
Sat 18 Jan 2014 04:21:30 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:21:30 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:21:30 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:21:30 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:21:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:21:34 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:21:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:21:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:21:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:21:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:21:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:21:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:21:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:21:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43829982
Sat 18 Jan 2014 04:21:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:21:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43829982
Sat 18 Jan 2014 04:21:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:21:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:21:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:21:45 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:21:45 - job_xml_thread(): Done retrieving: data size 43829982
Sat 18 Jan 2014 04:21:45 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:21:45 - XML: Start document: iteration 11
Sat 18 Jan 2014 04:21:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:21:46 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:21:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:21:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:21:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:21:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:21:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:21:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:21:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:21:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:21:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:21:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:21:51 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:21:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:21:52 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:21:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 04:21:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 04:21:52 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:21:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6002 values 94693 bits 11836 bytes 
Sat 18 Jan 2014 04:21:53 - XML: Processed 655408 elements - found 601 jobs
Sat 18 Jan 2014 04:21:53 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:21:53 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:21:53 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:21:53 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:21:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:21:57 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:21:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:21:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:21:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:21:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:21:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:21:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:22:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:22:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43825786
Sat 18 Jan 2014 04:22:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:22:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43825786
Sat 18 Jan 2014 04:22:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:22:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:22:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:22:08 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:22:08 - job_xml_thread(): Done retrieving: data size 43825786
Sat 18 Jan 2014 04:22:08 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:22:08 - XML: Start document: iteration 12
Sat 18 Jan 2014 04:22:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:22:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:22:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:22:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:22:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:22:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:22:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:22:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:22:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:22:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:22:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:22:18 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:22:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 04:22:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:22:22 - XML: Processed 655408 elements - found 601 jobs
Sat 18 Jan 2014 04:22:22 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:22:22 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:22:22 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:22:22 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:22:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:22:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:22:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:22:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:22:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:22:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:22:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:22:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:22:28 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 04:22:28 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 04:22:28 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:22:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:22:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43828955
Sat 18 Jan 2014 04:22:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:22:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43828955
Sat 18 Jan 2014 04:22:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:22:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:22:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:22:37 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:22:37 - job_xml_thread(): Done retrieving: data size 43828955
Sat 18 Jan 2014 04:22:37 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:22:37 - XML: Start document: iteration 13
Sat 18 Jan 2014 04:22:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:22:39 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:22:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:22:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:22:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:22:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:22:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:22:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:22:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:22:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:22:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:22:48 - XML: Processed 655408 elements - found 601 jobs
Sat 18 Jan 2014 04:22:48 - job 7335208 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 04:22:48 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 04:22:48 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 04:22:49 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 04:22:49 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:22:49 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:22:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:22:50 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:22:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:22:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:22:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:22:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:22:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:22:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:22:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:22:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43849772
Sat 18 Jan 2014 04:22:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:22:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43849772
Sat 18 Jan 2014 04:22:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:22:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:22:52 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:22:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:22:53 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:22:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 04:22:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 04:22:53 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:22:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9051 values 142838 bits 17854 bytes 
Sat 18 Jan 2014 04:22:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:22:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:23:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:23:00 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:23:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:23:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:23:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:23:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:23:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:23:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:23:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:23:04 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:23:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:23:05 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:23:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:23:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:23:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:23:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:23:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:23:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:23:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:23:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43867597
Sat 18 Jan 2014 04:23:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:23:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43867597
Sat 18 Jan 2014 04:23:08 - job_xml_thread(): Done retrieving: data size 43867597
Sat 18 Jan 2014 04:23:08 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:23:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:23:08 - XML: Start document: iteration 14
Sat 18 Jan 2014 04:23:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:23:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:23:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:23:18 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:23:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:23:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:23:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:23:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:23:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:23:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:23:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:23:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:23:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:23:26 - XML: Processed 655408 elements - found 601 jobs
Sat 18 Jan 2014 04:23:26 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:23:26 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:23:26 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:23:26 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:23:29 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:23:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 04:23:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:23:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:23:30 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:23:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:23:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:23:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:23:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:23:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:23:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:23:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:23:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43763016
Sat 18 Jan 2014 04:23:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:23:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43763016
Sat 18 Jan 2014 04:23:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:23:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:23:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:23:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:23:39 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:23:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:23:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:23:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:23:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:23:41 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:23:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43763016
Sat 18 Jan 2014 04:23:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:23:41 - job_xml_thread(): Done retrieving: data size 43763016
Sat 18 Jan 2014 04:23:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:23:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:23:41 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:23:41 - XML: Start document: iteration 15
Sat 18 Jan 2014 04:23:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:23:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:23:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:23:49 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:23:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:23:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:23:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:23:53 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:23:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:23:54 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:23:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 04:23:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 04:23:54 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:23:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5813 values 91674 bits 11459 bytes 
Sat 18 Jan 2014 04:23:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:23:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:23:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:23:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:23:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:23:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:23:56 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:23:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:23:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:23:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:23:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:23:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:23:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:24:00 - XML: Processed 654660 elements - found 601 jobs
Sat 18 Jan 2014 04:24:00 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:24:00 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:24:00 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:24:00 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:24:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:24:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43194327
Sat 18 Jan 2014 04:24:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:24:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43194327
Sat 18 Jan 2014 04:24:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:24:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:24:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:24:10 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 04:24:10 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:24:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:24:10 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:24:11 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:24:11 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:24:11 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 04:24:11 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 04:24:11 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 04:24:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:24:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:24:13 - size of cluster 'LISA Cluster': 624 hosts 79473 metrics 654223 values 10320023 bits 1290002 bytes 
Sat 18 Jan 2014 04:24:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:24:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:24:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:24:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:24:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:24:15 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:24:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:24:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:24:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:24:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:24:17 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:24:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 04:24:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:24:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:24:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:24:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:24:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:24:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:24:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43260962
Sat 18 Jan 2014 04:24:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:24:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43260962
Sat 18 Jan 2014 04:24:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:24:20 - job_xml_thread(): Done retrieving: data size 43260962
Sat 18 Jan 2014 04:24:20 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:24:20 - XML: Start document: iteration 16
Sat 18 Jan 2014 04:24:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:24:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:24:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:24:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:24:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:24:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:24:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:24:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:24:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:24:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:24:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:24:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:24:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:24:40 - XML: Processed 647954 elements - found 600 jobs
Sat 18 Jan 2014 04:24:40 - job 7348596 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 04:24:40 - job 7348593 appears to have finished
Sat 18 Jan 2014 04:24:40 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 04:24:40 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 04:24:40 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 04:24:40 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:24:40 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:24:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:24:42 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:24:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:24:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:24:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:24:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:24:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:24:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:24:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:24:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43748054
Sat 18 Jan 2014 04:24:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:24:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43748054
Sat 18 Jan 2014 04:24:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:24:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:24:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:24:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:24:54 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:24:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:24:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:24:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:24:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 04:24:55 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:24:55 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:24:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 04:24:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8919 values 140687 bits 17585 bytes 
Sat 18 Jan 2014 04:24:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:24:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:24:55 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:24:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:24:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:24:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:24:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:24:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:24:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:24:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:25:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:25:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:25:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:25:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:25:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:25:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:25:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:25:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:25:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:25:04 - job_xml_thread(): Done retrieving: data size 43833174
Sat 18 Jan 2014 04:25:04 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:25:04 - XML: Start document: iteration 17
Sat 18 Jan 2014 04:25:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43833174
Sat 18 Jan 2014 04:25:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:25:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43833174
Sat 18 Jan 2014 04:25:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:25:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:25:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:25:12 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:25:12 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 04:25:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:25:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:25:23 - XML: Processed 655156 elements - found 600 jobs
Sat 18 Jan 2014 04:25:23 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:25:23 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:25:23 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:25:23 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:25:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:25:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:25:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:25:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:25:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:25:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:25:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:25:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:25:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:25:24 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:25:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 04:25:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:25:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:25:27 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:25:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:25:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:25:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:25:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:25:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:25:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:25:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:25:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43854044
Sat 18 Jan 2014 04:25:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:25:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43854044
Sat 18 Jan 2014 04:25:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:25:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:25:38 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:25:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:25:38 - job_xml_thread(): Done retrieving: data size 43854044
Sat 18 Jan 2014 04:25:38 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:25:38 - XML: Start document: iteration 18
Sat 18 Jan 2014 04:25:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:25:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:25:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:25:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:25:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:25:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:25:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:25:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:25:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:25:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:25:52 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:25:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:25:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:25:52 - XML: Processed 655406 elements - found 600 jobs
Sat 18 Jan 2014 04:25:52 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:25:52 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:25:52 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:25:52 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:25:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:25:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:25:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:25:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:25:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:25:55 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:25:55 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:25:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 04:25:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:25:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 04:25:55 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:25:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6070 values 95781 bits 11972 bytes 
Sat 18 Jan 2014 04:25:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:25:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43818867
Sat 18 Jan 2014 04:25:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:25:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43818867
Sat 18 Jan 2014 04:25:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:25:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:25:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:26:07 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:26:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:26:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:26:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:26:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:26:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:26:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:26:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:26:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:26:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:26:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:26:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:26:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:26:12 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:26:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:26:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:26:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:26:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:26:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:26:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:26:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:26:15 - job_xml_thread(): Done retrieving: data size 43851310
Sat 18 Jan 2014 04:26:15 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:26:15 - XML: Start document: iteration 19
Sat 18 Jan 2014 04:26:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851310
Sat 18 Jan 2014 04:26:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:26:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851310
Sat 18 Jan 2014 04:26:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:26:18 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:26:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 04:26:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:26:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:26:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:26:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:26:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:26:33 - XML: Processed 655404 elements - found 599 jobs
Sat 18 Jan 2014 04:26:33 - job 7348594 appears to have finished
Sat 18 Jan 2014 04:26:33 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 04:26:33 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 04:26:35 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 04:26:35 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:26:35 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:26:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:26:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:26:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:26:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:26:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:26:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:26:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:26:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:26:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:26:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:26:39 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:26:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:26:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:26:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:26:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:26:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:26:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:26:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:26:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43852821
Sat 18 Jan 2014 04:26:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:26:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43852821
Sat 18 Jan 2014 04:26:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:26:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:26:49 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:26:50 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:26:50 - job_xml_thread(): Done retrieving: data size 43852821
Sat 18 Jan 2014 04:26:50 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:26:50 - XML: Start document: iteration 20
Sat 18 Jan 2014 04:26:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:26:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:26:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:26:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:26:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:26:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:26:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:26:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:26:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:26:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:26:55 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:26:56 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:26:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 04:26:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:26:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 04:26:56 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:26:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6379 values 100620 bits 12577 bytes 
Sat 18 Jan 2014 04:27:01 - XML: Processed 655404 elements - found 599 jobs
Sat 18 Jan 2014 04:27:01 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:27:01 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:27:01 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:27:01 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:27:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:27:01 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:27:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:27:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:27:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:27:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:27:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:27:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:27:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:27:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43852435
Sat 18 Jan 2014 04:27:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:27:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43852435
Sat 18 Jan 2014 04:27:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:27:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:27:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:27:16 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:27:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:27:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:27:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:27:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:27:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:27:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:27:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:27:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:27:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:27:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:27:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:27:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:27:21 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:27:21 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:27:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 04:27:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:27:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:27:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:27:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:27:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:27:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:27:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:27:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:27:24 - job_xml_thread(): Done retrieving: data size 43850145
Sat 18 Jan 2014 04:27:24 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:27:24 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 04:27:24 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 04:27:24 - Housekeeping: done.
Sat 18 Jan 2014 04:27:24 - XML: Start document: iteration 0
Sat 18 Jan 2014 04:27:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43850145
Sat 18 Jan 2014 04:27:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43850145
Sat 18 Jan 2014 04:27:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:27:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:27:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:27:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:27:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:27:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:27:39 - XML: Processed 655404 elements - found 599 jobs
Sat 18 Jan 2014 04:27:39 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:27:39 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:27:39 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:27:39 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:27:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:27:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:27:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:27:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:27:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:27:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:27:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:27:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:27:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:27:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:27:46 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:27:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:27:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:27:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:27:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:27:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:27:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:27:48 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 04:27:48 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 04:27:48 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:27:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:27:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43860907
Sat 18 Jan 2014 04:27:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:27:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43860907
Sat 18 Jan 2014 04:27:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:27:54 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:27:54 - job_xml_thread(): Done retrieving: data size 43860907
Sat 18 Jan 2014 04:27:54 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:27:54 - XML: Start document: iteration 1
Sat 18 Jan 2014 04:27:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:27:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:27:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:27:57 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:27:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:27:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 04:27:58 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:27:58 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:27:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 04:27:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:27:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:28:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:28:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:28:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8813 values 139009 bits 17376 bytes 
Sat 18 Jan 2014 04:28:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:28:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:28:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:28:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:28:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:28:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:28:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:28:09 - XML: Processed 655404 elements - found 599 jobs
Sat 18 Jan 2014 04:28:09 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:28:09 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:28:09 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:28:09 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:28:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:28:12 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:28:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:28:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:28:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:28:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:28:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:28:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:28:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:28:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43825502
Sat 18 Jan 2014 04:28:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:28:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43825502
Sat 18 Jan 2014 04:28:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:28:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:28:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:28:24 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:28:24 - job_xml_thread(): Done retrieving: data size 43825502
Sat 18 Jan 2014 04:28:24 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:28:24 - XML: Start document: iteration 2
Sat 18 Jan 2014 04:28:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:28:27 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:28:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:28:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:28:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:28:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:28:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:28:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:28:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:28:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:28:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:28:35 - XML: Processed 655403 elements - found 599 jobs
Sat 18 Jan 2014 04:28:35 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:28:35 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:28:35 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:28:35 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:28:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:28:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:28:36 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:28:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 04:28:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:28:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:28:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:28:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:28:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:28:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:28:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:28:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:28:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43839440
Sat 18 Jan 2014 04:28:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:28:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43839440
Sat 18 Jan 2014 04:28:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:28:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:28:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:28:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:28:47 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:28:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:28:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:28:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:28:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:28:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:28:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:28:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:28:50 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:28:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:28:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:28:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:28:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:28:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:28:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:28:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:28:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:28:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:28:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43846362
Sat 18 Jan 2014 04:28:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:28:54 - job_xml_thread(): Done retrieving: data size 43846362
Sat 18 Jan 2014 04:28:54 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:28:54 - XML: Start document: iteration 3
Sat 18 Jan 2014 04:28:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43846362
Sat 18 Jan 2014 04:28:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:28:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:28:58 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:28:59 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:28:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 04:28:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:28:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 04:28:59 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:29:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8926 values 140727 bits 17590 bytes 
Sat 18 Jan 2014 04:29:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:29:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:29:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:29:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:29:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:29:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:29:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:29:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:29:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:29:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:29:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:29:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:29:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:29:15 - XML: Processed 655402 elements - found 598 jobs
Sat 18 Jan 2014 04:29:16 - job 7348703 appears to have finished
Sat 18 Jan 2014 04:29:16 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 04:29:16 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 04:29:16 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 04:29:16 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:29:16 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:29:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:29:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:29:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:29:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:29:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:29:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:29:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:29:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:29:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:29:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43792415
Sat 18 Jan 2014 04:29:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:29:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43792415
Sat 18 Jan 2014 04:29:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:29:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:29:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:29:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:29:29 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:29:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:29:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:29:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:29:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:29:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:29:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:29:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:29:31 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:29:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:29:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:29:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:29:34 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:29:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:29:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:29:34 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:29:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 04:29:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:29:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:29:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:29:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:29:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:29:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:29:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43329477
Sat 18 Jan 2014 04:29:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:29:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43329477
Sat 18 Jan 2014 04:29:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:29:37 - job_xml_thread(): Done retrieving: data size 43329477
Sat 18 Jan 2014 04:29:37 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:29:37 - XML: Start document: iteration 4
Sat 18 Jan 2014 04:29:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:29:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:29:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:29:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:29:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:29:51 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:29:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:29:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:29:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:29:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:29:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:29:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:29:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:29:56 - XML: Processed 648852 elements - found 598 jobs
Sat 18 Jan 2014 04:29:56 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:29:56 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:29:56 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:29:56 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:29:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:29:58 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:29:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:29:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:29:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:29:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:29:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:29:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:29:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:29:59 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:29:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:29:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43196491
Sat 18 Jan 2014 04:29:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:30:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43196491
Sat 18 Jan 2014 04:30:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:30:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:30:00 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:30:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 04:30:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 04:30:00 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:30:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8937 values 140865 bits 17608 bytes 
Sat 18 Jan 2014 04:30:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:30:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:30:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:30:11 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:30:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:30:12 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:30:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:30:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:30:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:30:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:30:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:30:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:30:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:30:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:30:13 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:30:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:30:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:30:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:30:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:30:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:30:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:30:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:30:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:30:16 - job_xml_thread(): Done retrieving: data size 43273587
Sat 18 Jan 2014 04:30:16 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:30:16 - XML: Start document: iteration 5
Sat 18 Jan 2014 04:30:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43273587
Sat 18 Jan 2014 04:30:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:30:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43273587
Sat 18 Jan 2014 04:30:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:30:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:30:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:30:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:30:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:30:33 - XML: Processed 647950 elements - found 598 jobs
Sat 18 Jan 2014 04:30:33 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:30:33 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:30:33 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:30:33 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:30:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:30:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:30:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:30:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:30:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:30:37 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:30:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:30:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:30:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:30:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:30:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:30:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:30:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:30:37 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:30:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 04:30:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:30:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:30:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:30:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:30:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:30:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:30:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43623187
Sat 18 Jan 2014 04:30:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:30:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43623187
Sat 18 Jan 2014 04:30:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:30:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:30:47 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:30:48 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:30:48 - job_xml_thread(): Done retrieving: data size 43623187
Sat 18 Jan 2014 04:30:48 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:30:48 - XML: Start document: iteration 6
Sat 18 Jan 2014 04:30:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:30:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:30:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:30:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:30:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:30:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:30:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:30:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:30:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:30:57 - XML: Processed 652570 elements - found 598 jobs
Sat 18 Jan 2014 04:30:57 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:30:57 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:30:57 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:30:57 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:30:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:30:58 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:30:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:30:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:30:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:30:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:30:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:30:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:30:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:30:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43841245
Sat 18 Jan 2014 04:30:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:30:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43841245
Sat 18 Jan 2014 04:30:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:31:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:31:00 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:31:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:31:01 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:31:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 04:31:01 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:31:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 04:31:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8966 values 141437 bits 17679 bytes 
Sat 18 Jan 2014 04:31:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:31:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:31:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:31:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:31:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:31:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:31:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43841245
Sat 18 Jan 2014 04:31:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:31:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:31:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:31:12 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:31:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:31:12 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 04:31:12 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:31:13 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:31:13 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:31:13 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 04:31:13 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 04:31:13 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 04:31:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:31:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:31:17 - size of cluster 'LISA Cluster': 624 hosts 79477 metrics 864464 values 13633736 bits 1704217 bytes 
Sat 18 Jan 2014 04:31:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:31:22 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:31:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:31:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:31:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:31:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:31:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:31:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:31:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:31:24 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:31:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:31:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:31:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:31:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:31:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:31:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:31:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:31:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:31:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:31:27 - job_xml_thread(): Done retrieving: data size 43812380
Sat 18 Jan 2014 04:31:27 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:31:27 - XML: Start document: iteration 7
Sat 18 Jan 2014 04:31:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43812380
Sat 18 Jan 2014 04:31:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:31:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43812380
Sat 18 Jan 2014 04:31:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:31:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:31:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:31:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:31:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:31:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:31:43 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:31:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:31:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:31:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:31:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:31:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:31:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:31:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:31:45 - XML: Processed 655399 elements - found 598 jobs
Sat 18 Jan 2014 04:31:45 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:31:45 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:31:45 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:31:45 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:31:51 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:31:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 04:31:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:31:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:31:52 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:31:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:31:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:31:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:31:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:31:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:31:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:31:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:31:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43832635
Sat 18 Jan 2014 04:31:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:31:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43832635
Sat 18 Jan 2014 04:31:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:31:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:31:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:32:00 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:32:00 - job_xml_thread(): Done retrieving: data size 43832635
Sat 18 Jan 2014 04:32:00 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:32:00 - XML: Start document: iteration 8
Sat 18 Jan 2014 04:32:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:32:01 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:32:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:32:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 04:32:01 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:32:01 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:32:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 04:32:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5950 values 94016 bits 11752 bytes 
Sat 18 Jan 2014 04:32:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:32:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:32:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:32:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:32:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:32:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:32:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:32:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:32:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:32:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:32:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:32:13 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:32:13 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 04:32:13 - XML: Processed 655400 elements - found 598 jobs
Sat 18 Jan 2014 04:32:13 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:32:13 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:32:13 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:32:13 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:32:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:32:19 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:32:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:32:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:32:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:32:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:32:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:32:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:32:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:32:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43850264
Sat 18 Jan 2014 04:32:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:32:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43850264
Sat 18 Jan 2014 04:32:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:32:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:32:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:32:28 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:32:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 04:32:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:32:28 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:32:28 - job_xml_thread(): Done retrieving: data size 43850264
Sat 18 Jan 2014 04:32:28 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:32:28 - XML: Start document: iteration 9
Sat 18 Jan 2014 04:32:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:32:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:32:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:32:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:32:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:32:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:32:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:32:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:32:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:32:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:32:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:32:42 - XML: Processed 655402 elements - found 598 jobs
Sat 18 Jan 2014 04:32:42 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:32:42 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:32:42 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:32:42 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:32:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:32:46 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:32:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:32:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:32:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:32:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:32:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:32:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:32:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:32:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43843850
Sat 18 Jan 2014 04:32:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:32:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43843850
Sat 18 Jan 2014 04:32:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:32:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:32:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:32:58 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:32:58 - job_xml_thread(): Done retrieving: data size 43843850
Sat 18 Jan 2014 04:32:58 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:32:58 - XML: Start document: iteration 10
Sat 18 Jan 2014 04:33:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:33:02 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:33:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:33:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 04:33:02 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:33:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 04:33:02 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:33:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:33:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:33:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6250 values 98861 bits 12357 bytes 
Sat 18 Jan 2014 04:33:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:33:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:33:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:33:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:33:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:33:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:33:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:33:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:33:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:33:11 - XML: Processed 655402 elements - found 598 jobs
Sat 18 Jan 2014 04:33:11 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:33:11 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:33:11 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:33:11 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:33:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:33:13 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:33:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:33:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:33:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:33:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:33:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:33:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:33:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:33:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862848
Sat 18 Jan 2014 04:33:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:33:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862848
Sat 18 Jan 2014 04:33:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:33:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:33:25 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:33:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:33:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:33:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:33:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:33:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:33:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862848
Sat 18 Jan 2014 04:33:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:33:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:33:27 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:33:27 - job_xml_thread(): Done retrieving: data size 43862848
Sat 18 Jan 2014 04:33:27 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:33:27 - XML: Start document: iteration 11
Sat 18 Jan 2014 04:33:28 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:33:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 04:33:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:33:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:33:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:33:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:33:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:33:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:33:42 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:33:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:33:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:33:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:33:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:33:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:33:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:33:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:33:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:33:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:33:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:33:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:33:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:33:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:33:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:33:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:33:47 - XML: Processed 655400 elements - found 598 jobs
Sat 18 Jan 2014 04:33:47 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:33:47 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:33:47 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:33:47 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:33:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:33:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43869925
Sat 18 Jan 2014 04:33:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:33:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43869925
Sat 18 Jan 2014 04:33:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:33:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:33:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:34:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:34:00 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:34:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:34:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:34:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:34:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:34:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:34:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:34:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:34:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:34:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:34:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:34:02 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:34:02 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:34:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:34:03 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:34:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 04:34:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 04:34:03 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:34:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6256 values 98695 bits 12336 bytes 
Sat 18 Jan 2014 04:34:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:34:05 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:34:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:34:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:34:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:34:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:34:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:34:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:34:09 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:34:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 04:34:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:34:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:34:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43852830
Sat 18 Jan 2014 04:34:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:34:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43852830
Sat 18 Jan 2014 04:34:10 - job_xml_thread(): Done retrieving: data size 43852830
Sat 18 Jan 2014 04:34:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:34:10 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:34:11 - XML: Start document: iteration 12
Sat 18 Jan 2014 04:34:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:34:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:34:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:34:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:34:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:34:29 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:34:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:34:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:34:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:34:30 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:34:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:34:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:34:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:34:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:34:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:34:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:34:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:34:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:34:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:34:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:34:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:34:31 - XML: Processed 655402 elements - found 598 jobs
Sat 18 Jan 2014 04:34:31 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:34:31 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:34:31 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:34:31 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:34:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:34:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43884648
Sat 18 Jan 2014 04:34:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:34:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43884648
Sat 18 Jan 2014 04:34:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:34:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:34:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:34:46 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:34:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:34:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:34:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:34:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:34:47 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:34:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:34:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:34:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:34:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:34:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:34:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:34:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:34:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:34:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:34:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:34:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:34:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:34:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:34:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:34:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:34:54 - job_xml_thread(): Done retrieving: data size 43855304
Sat 18 Jan 2014 04:34:54 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:34:54 - XML: Start document: iteration 13
Sat 18 Jan 2014 04:34:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43855304
Sat 18 Jan 2014 04:34:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:34:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43855304
Sat 18 Jan 2014 04:34:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:35:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:35:05 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:35:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:35:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:35:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:35:07 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:35:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 04:35:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:35:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 04:35:07 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:35:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:35:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148549 bits 18568 bytes 
Sat 18 Jan 2014 04:35:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:35:13 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:35:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:35:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:35:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:35:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:35:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:35:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:35:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:35:16 - XML: Processed 655402 elements - found 598 jobs
Sat 18 Jan 2014 04:35:16 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:35:16 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:35:16 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:35:16 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:35:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:35:18 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:35:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:35:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:35:18 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 04:35:18 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 04:35:18 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:35:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:35:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:35:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:35:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:35:20 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:35:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 04:35:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:35:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:35:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43801029
Sat 18 Jan 2014 04:35:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:35:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43801029
Sat 18 Jan 2014 04:35:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:35:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:35:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:35:32 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:35:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:35:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:35:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:35:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:35:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:35:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:35:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:35:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:35:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:35:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:35:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:35:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:35:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:35:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:35:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:35:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:35:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:35:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:35:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:35:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:35:37 - job_xml_thread(): Done retrieving: data size 43303534
Sat 18 Jan 2014 04:35:37 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:35:37 - XML: Start document: iteration 14
Sat 18 Jan 2014 04:35:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43303534
Sat 18 Jan 2014 04:35:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:35:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43303534
Sat 18 Jan 2014 04:35:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:35:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:35:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:35:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:35:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:35:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:35:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:35:58 - XML: Processed 648474 elements - found 598 jobs
Sat 18 Jan 2014 04:35:58 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:35:58 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:35:58 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:35:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:35:59 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:35:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:35:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:35:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:35:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:35:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:36:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:36:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:36:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:36:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:36:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:36:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:36:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:36:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:36:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:36:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:36:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43218770
Sat 18 Jan 2014 04:36:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:36:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43218770
Sat 18 Jan 2014 04:36:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:36:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:36:07 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:36:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:36:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 04:36:08 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:36:08 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:36:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 04:36:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148582 bits 18572 bytes 
Sat 18 Jan 2014 04:36:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:36:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:36:14 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:36:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:36:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:36:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:36:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:36:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:36:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:36:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:36:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:36:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:36:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:36:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:36:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:36:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:36:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:36:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:36:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:36:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:36:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:36:19 - job_xml_thread(): Done retrieving: data size 43284874
Sat 18 Jan 2014 04:36:19 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:36:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43284874
Sat 18 Jan 2014 04:36:19 - XML: Start document: iteration 15
Sat 18 Jan 2014 04:36:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:36:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43284874
Sat 18 Jan 2014 04:36:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:36:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:36:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:36:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:36:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:36:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:36:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:36:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:36:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:36:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:36:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:36:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:36:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:36:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:36:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:36:42 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:36:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:36:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:36:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:36:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:36:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:36:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:36:43 - XML: Processed 647948 elements - found 597 jobs
Sat 18 Jan 2014 04:36:43 - job 7340333 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7338797 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7338790 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7344356 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7335699 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7348454 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7344351 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7335365 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7335439 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7348629 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7348628 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7347041 appears to have finished
Sat 18 Jan 2014 04:36:43 - job 7348627 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7348607 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7335239 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7335232 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7335230 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7335231 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7346097 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7339993 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7344418 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7340781 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7344416 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7344414 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7344415 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7344412 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7344413 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7344410 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7344411 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7338953 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7344354 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7338775 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7343787 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7337863 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7335401 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7335400 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7335403 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7335402 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7335405 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7335404 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7335406 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7348632 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7348633 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7348631 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7335249 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7335248 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7335246 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7348255 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7340339 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7337345 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7337341 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7336194 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7344419 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7339232 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7344417 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7337500 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7340310 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7336999 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7344427 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7337261 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7344645 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7341893 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7344399 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7344398 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7344016 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7344391 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7344390 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7344393 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7344392 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7344395 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7344394 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7344397 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7344396 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7338806 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7338411 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7335485 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7338343 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7348435 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7342415 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7335259 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7335250 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7335254 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7335255 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7340349 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7337272 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7340972 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7345705 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7337799 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7344657 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7337400 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7344371 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7344384 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7338572 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7344383 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7339484 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7336565 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7346841 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7337641 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7337640 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7337643 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7337645 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7337646 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7345031 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7344434 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7344435 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7344430 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7344431 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7344433 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7345969 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7344368 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7344369 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7344360 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7344361 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7344362 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7344363 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7344364 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7344365 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7344366 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7344367 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7344440 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7335389 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7335576 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7335273 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7335271 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7335276 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7335376 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7335375 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7339391 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7335209 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7339156 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7345099 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7341100 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7340351 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7343634 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7344425 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7338208 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7344422 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7344421 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7344420 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7344426 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7344357 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7344424 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7344423 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7344353 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7344352 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7335866 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7344359 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7344358 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7344429 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7344428 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7338514 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7340309 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7348623 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7348690 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7348599 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7348598 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7348597 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7335361 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7335364 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7348609 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7348608 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7348606 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7348605 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7348604 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7348603 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7348602 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7348601 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7348600 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7347695 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7335214 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7335215 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7335216 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7335217 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7335210 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7335211 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7335212 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7335213 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7335218 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7335219 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7339966 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7341063 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7345647 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7344436 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7344437 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7344432 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7344438 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7344439 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7343751 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7343472 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7340659 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7338784 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7335903 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7342714 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7335424 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7335423 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7335422 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7335421 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7338025 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7348614 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7348610 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7348611 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7348612 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job 7348613 report time 1390016023 does not match current heartbeat 1390016143 : ignoring job
Sat 18 Jan 2014 04:36:43 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 04:36:43 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 04:36:43 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 04:36:43 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:36:43 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:36:44 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:36:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 04:36:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:36:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:36:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43756792
Sat 18 Jan 2014 04:36:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:36:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43756792
Sat 18 Jan 2014 04:36:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:36:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:36:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:36:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:36:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:36:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:36:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:36:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:36:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:36:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:36:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:36:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:36:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:36:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:36:58 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:36:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:36:59 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:36:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:36:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:36:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:36:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:36:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:36:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:37:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:37:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43845800
Sat 18 Jan 2014 04:37:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:37:01 - job_xml_thread(): Done retrieving: data size 43845800
Sat 18 Jan 2014 04:37:01 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:37:01 - XML: Start document: iteration 16
Sat 18 Jan 2014 04:37:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43845800
Sat 18 Jan 2014 04:37:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:37:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:37:08 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:37:09 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:37:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:37:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 04:37:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 04:37:09 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:37:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8983 values 141621 bits 17702 bytes 
Sat 18 Jan 2014 04:37:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:37:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:37:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:37:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:37:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:37:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:37:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:37:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:37:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:37:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:37:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:37:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:37:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:37:19 - XML: Processed 655170 elements - found 597 jobs
Sat 18 Jan 2014 04:37:19 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:37:19 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:37:19 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:37:19 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:37:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:37:22 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:37:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:37:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:37:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:37:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:37:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:37:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:37:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:37:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43829716
Sat 18 Jan 2014 04:37:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:37:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43829716
Sat 18 Jan 2014 04:37:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:37:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:37:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:37:34 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:37:34 - job_xml_thread(): Done retrieving: data size 43829716
Sat 18 Jan 2014 04:37:34 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:37:34 - XML: Start document: iteration 17
Sat 18 Jan 2014 04:37:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:37:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:37:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:37:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:37:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:37:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:37:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:37:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:37:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:37:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:37:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:37:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:37:43 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:37:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:37:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:37:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:37:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:37:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:37:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:37:48 - XML: Processed 655400 elements - found 597 jobs
Sat 18 Jan 2014 04:37:48 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:37:48 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:37:48 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:37:48 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:37:48 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:37:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 04:37:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:37:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:37:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43845991
Sat 18 Jan 2014 04:37:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:37:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43845991
Sat 18 Jan 2014 04:37:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:37:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:37:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:37:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:37:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:37:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:37:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:37:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:37:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:38:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:38:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:38:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:38:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:38:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:38:03 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:38:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:38:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:38:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:38:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:38:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:38:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:38:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:38:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:38:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:38:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43872917
Sat 18 Jan 2014 04:38:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:38:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43872917
Sat 18 Jan 2014 04:38:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:38:06 - job_xml_thread(): Done retrieving: data size 43872917
Sat 18 Jan 2014 04:38:07 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:38:07 - XML: Start document: iteration 18
Sat 18 Jan 2014 04:38:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:38:10 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:38:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:38:11 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:38:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 04:38:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 04:38:11 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:38:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8998 values 141842 bits 17730 bytes 
Sat 18 Jan 2014 04:38:13 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 04:38:13 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:38:15 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:38:15 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 04:38:15 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:38:15 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 04:38:15 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 04:38:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:38:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:38:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:38:19 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:38:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:38:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:38:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:38:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:38:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:38:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:38:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:38:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:38:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:38:22 - size of cluster 'LISA Cluster': 624 hosts 79468 metrics 832375 values 13138387 bits 1642298 bytes 
Sat 18 Jan 2014 04:38:27 - XML: Processed 655399 elements - found 597 jobs
Sat 18 Jan 2014 04:38:27 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:38:27 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:38:27 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:38:27 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:38:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:38:30 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:38:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:38:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:38:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:38:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:38:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:38:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:38:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:38:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43845231
Sat 18 Jan 2014 04:38:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:38:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43845231
Sat 18 Jan 2014 04:38:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:38:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:38:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:38:42 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:38:43 - job_xml_thread(): Done retrieving: data size 43845231
Sat 18 Jan 2014 04:38:43 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:38:43 - XML: Start document: iteration 19
Sat 18 Jan 2014 04:38:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:38:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:38:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:38:50 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:38:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:38:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:38:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:38:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:38:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:38:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:38:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:38:57 - XML: Processed 655396 elements - found 595 jobs
Sat 18 Jan 2014 04:38:57 - job 7348706 appears to have finished
Sat 18 Jan 2014 04:38:57 - job 7348707 appears to have finished
Sat 18 Jan 2014 04:38:57 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 04:38:57 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 04:38:58 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 04:38:58 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:38:58 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:38:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:38:58 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:38:58 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:38:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 04:38:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:38:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:38:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:38:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:38:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:38:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:38:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:39:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:39:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43846830
Sat 18 Jan 2014 04:39:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:39:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43846830
Sat 18 Jan 2014 04:39:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:39:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:39:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:39:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:39:11 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:39:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:39:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 04:39:11 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:39:11 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:39:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5823 values 91786 bits 11473 bytes 
Sat 18 Jan 2014 04:39:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 04:39:13 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:39:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:39:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:39:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:39:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:39:14 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:39:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:39:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:39:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:39:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:39:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:39:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:39:15 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:39:15 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 04:39:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:39:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:39:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:39:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:39:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:39:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:39:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:39:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:39:19 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:39:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 04:39:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:39:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:39:19 - job_xml_thread(): Done retrieving: data size 43875066
Sat 18 Jan 2014 04:39:19 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:39:19 - XML: Start document: iteration 20
Sat 18 Jan 2014 04:39:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43875066
Sat 18 Jan 2014 04:39:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43875066
Sat 18 Jan 2014 04:39:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:39:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:39:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:39:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:39:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:39:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:39:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:39:32 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:39:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:39:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:39:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:39:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:39:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:39:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:39:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:39:39 - XML: Processed 655396 elements - found 595 jobs
Sat 18 Jan 2014 04:39:39 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:39:39 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:39:39 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:39:39 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:39:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:39:41 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:39:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:39:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:39:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:39:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:39:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:39:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:39:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:39:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43831116
Sat 18 Jan 2014 04:39:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:39:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43831116
Sat 18 Jan 2014 04:39:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:39:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:39:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:39:54 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:39:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:39:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:39:56 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:39:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:39:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:39:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:39:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:39:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:39:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:39:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:39:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:40:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:40:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:40:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:40:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:40:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:40:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:40:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:40:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:40:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:40:03 - job_xml_thread(): Done retrieving: data size 43859756
Sat 18 Jan 2014 04:40:03 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:40:03 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 04:40:03 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 04:40:03 - Housekeeping: done.
Sat 18 Jan 2014 04:40:03 - XML: Start document: iteration 0
Sat 18 Jan 2014 04:40:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43859756
Sat 18 Jan 2014 04:40:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:40:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43859756
Sat 18 Jan 2014 04:40:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:40:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:40:12 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:40:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:40:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:40:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:40:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 04:40:13 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:40:13 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:40:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 04:40:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148614 bits 18576 bytes 
Sat 18 Jan 2014 04:40:16 - XML: Processed 655396 elements - found 595 jobs
Sat 18 Jan 2014 04:40:16 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:40:16 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:40:16 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:40:16 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:40:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:40:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:40:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:40:24 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:40:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:40:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:40:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:40:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:40:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:40:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:40:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:40:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:40:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:40:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:40:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:40:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:40:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:40:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:40:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:40:29 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:40:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 04:40:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:40:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:40:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43858480
Sat 18 Jan 2014 04:40:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:40:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43858480
Sat 18 Jan 2014 04:40:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:40:31 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:40:31 - job_xml_thread(): Done retrieving: data size 43858480
Sat 18 Jan 2014 04:40:31 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:40:31 - XML: Start document: iteration 1
Sat 18 Jan 2014 04:40:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:40:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:40:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:40:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:40:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:40:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:40:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:40:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:40:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:40:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:40:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:40:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:40:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:40:48 - XML: Processed 655396 elements - found 595 jobs
Sat 18 Jan 2014 04:40:48 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:40:48 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:40:48 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:40:48 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:40:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:40:52 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:40:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:40:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:40:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:40:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:40:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:40:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:40:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:40:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43819739
Sat 18 Jan 2014 04:40:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:40:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43819739
Sat 18 Jan 2014 04:40:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:40:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:40:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:41:03 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:41:03 - job_xml_thread(): Done retrieving: data size 43819739
Sat 18 Jan 2014 04:41:03 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:41:03 - XML: Start document: iteration 2
Sat 18 Jan 2014 04:41:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:41:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:41:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:41:10 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:41:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:41:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:41:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:41:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:41:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:41:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:41:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:41:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:41:13 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:41:13 - XML: Processed 655396 elements - found 595 jobs
Sat 18 Jan 2014 04:41:13 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:41:13 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:41:13 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:41:13 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:41:14 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:41:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:41:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 04:41:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 04:41:14 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:41:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99052 bits 12381 bytes 
Sat 18 Jan 2014 04:41:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:41:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:41:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:41:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:41:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:41:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:41:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:41:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:41:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:41:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43784499
Sat 18 Jan 2014 04:41:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:41:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43784499
Sat 18 Jan 2014 04:41:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:41:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:41:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:41:28 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:41:28 - job_xml_thread(): Done retrieving: data size 43784499
Sat 18 Jan 2014 04:41:28 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:41:28 - XML: Start document: iteration 3
Sat 18 Jan 2014 04:41:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:41:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:41:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:41:33 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:41:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:41:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:41:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:41:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:41:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:41:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:41:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:41:39 - XML: Processed 654648 elements - found 595 jobs
Sat 18 Jan 2014 04:41:39 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:41:39 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:41:39 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:41:39 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:41:40 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:41:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 04:41:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:41:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:41:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:41:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:41:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:41:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:41:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:41:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:41:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:41:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:41:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43276449
Sat 18 Jan 2014 04:41:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:41:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43276449
Sat 18 Jan 2014 04:41:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:41:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:41:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:41:54 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:41:54 - job_xml_thread(): Done retrieving: data size 43276449
Sat 18 Jan 2014 04:41:54 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:41:54 - XML: Start document: iteration 4
Sat 18 Jan 2014 04:42:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:42:00 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:42:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:42:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:42:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:42:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:42:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:42:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:42:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:42:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:42:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:42:04 - XML: Processed 648454 elements - found 595 jobs
Sat 18 Jan 2014 04:42:04 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:42:04 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:42:04 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:42:04 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:42:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:42:07 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:42:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:42:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:42:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:42:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:42:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:42:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:42:09 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 04:42:09 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 04:42:09 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:42:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:42:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43218798
Sat 18 Jan 2014 04:42:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:42:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43218798
Sat 18 Jan 2014 04:42:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:42:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:42:14 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:42:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:42:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 04:42:15 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:42:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9113 values 143680 bits 17960 bytes 
Sat 18 Jan 2014 04:42:15 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:42:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 04:42:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:42:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:42:19 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:42:19 - job_xml_thread(): Done retrieving: data size 43218798
Sat 18 Jan 2014 04:42:19 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:42:19 - XML: Start document: iteration 5
Sat 18 Jan 2014 04:42:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:42:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:42:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:42:26 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:42:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:42:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:42:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:42:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:42:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:42:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:42:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:42:31 - XML: Processed 647692 elements - found 595 jobs
Sat 18 Jan 2014 04:42:31 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:42:31 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:42:31 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:42:31 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:42:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:42:33 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:42:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:42:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:42:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:42:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:42:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:42:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:42:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:42:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43453090
Sat 18 Jan 2014 04:42:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:42:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43453090
Sat 18 Jan 2014 04:42:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:42:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:42:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:42:44 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:42:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 04:42:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:42:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:42:45 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:42:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:42:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:42:46 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:42:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:42:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:42:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:42:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:42:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:42:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:42:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:42:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:42:49 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:42:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:42:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:42:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:42:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:42:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:42:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:42:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:42:51 - job_xml_thread(): Done retrieving: data size 43832969
Sat 18 Jan 2014 04:42:51 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:42:51 - XML: Start document: iteration 6
Sat 18 Jan 2014 04:42:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43832969
Sat 18 Jan 2014 04:42:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:42:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43832969
Sat 18 Jan 2014 04:42:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:43:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:43:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:43:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:43:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:43:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:43:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:43:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:43:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:43:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:43:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:43:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:43:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:43:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:43:10 - XML: Processed 655230 elements - found 593 jobs
Sat 18 Jan 2014 04:43:10 - job 7348705 appears to have finished
Sat 18 Jan 2014 04:43:10 - job 7347853 appears to have finished
Sat 18 Jan 2014 04:43:10 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 04:43:10 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 04:43:11 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 04:43:11 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:43:11 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:43:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:43:12 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:43:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:43:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:43:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:43:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:43:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:43:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:43:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:43:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43846507
Sat 18 Jan 2014 04:43:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:43:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43846507
Sat 18 Jan 2014 04:43:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:43:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:43:16 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:43:17 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:43:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 04:43:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:43:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 04:43:17 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:43:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9396 values 148161 bits 18520 bytes 
Sat 18 Jan 2014 04:43:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:43:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:43:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:43:26 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:43:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:43:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:43:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:43:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:43:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:43:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:43:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:43:26 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:43:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:43:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:43:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:43:29 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:43:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:43:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:43:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:43:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:43:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:43:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:43:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:43:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43861547
Sat 18 Jan 2014 04:43:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:43:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43861547
Sat 18 Jan 2014 04:43:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:43:32 - job_xml_thread(): Done retrieving: data size 43861547
Sat 18 Jan 2014 04:43:33 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:43:33 - XML: Start document: iteration 7
Sat 18 Jan 2014 04:43:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:43:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:43:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:43:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:43:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:43:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:43:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:43:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:43:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:43:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:43:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:43:47 - XML: Processed 655392 elements - found 593 jobs
Sat 18 Jan 2014 04:43:47 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:43:47 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:43:47 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:43:47 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:43:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:43:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:43:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:43:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:43:51 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:43:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 04:43:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:43:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:43:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:43:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:43:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:43:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:43:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43820432
Sat 18 Jan 2014 04:43:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:43:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43820432
Sat 18 Jan 2014 04:43:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:43:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:43:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:44:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:44:02 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:44:02 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:44:02 - job_xml_thread(): Done retrieving: data size 43820432
Sat 18 Jan 2014 04:44:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:44:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:44:03 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:44:03 - XML: Start document: iteration 8
Sat 18 Jan 2014 04:44:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:44:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:44:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:44:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:44:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:44:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:44:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:44:14 - XML: Processed 655392 elements - found 593 jobs
Sat 18 Jan 2014 04:44:14 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:44:14 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:44:14 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:44:14 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:44:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:44:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:44:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:44:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:44:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:44:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:44:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:44:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:44:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:44:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43839303
Sat 18 Jan 2014 04:44:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:44:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:44:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43839303
Sat 18 Jan 2014 04:44:17 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:44:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:44:19 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:44:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:44:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:44:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:44:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 04:44:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 04:44:20 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:44:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9062 values 142862 bits 17857 bytes 
Sat 18 Jan 2014 04:44:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:44:29 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:44:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:44:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:44:29 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:44:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:44:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:44:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:44:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:44:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:44:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:44:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:44:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:44:32 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:44:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:44:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:44:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:44:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:44:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:44:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:44:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:44:35 - job_xml_thread(): Done retrieving: data size 43854927
Sat 18 Jan 2014 04:44:35 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:44:35 - XML: Start document: iteration 9
Sat 18 Jan 2014 04:44:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43854927
Sat 18 Jan 2014 04:44:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:44:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43854927
Sat 18 Jan 2014 04:44:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:44:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:44:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:44:45 - XML: Processed 655392 elements - found 593 jobs
Sat 18 Jan 2014 04:44:45 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:44:45 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:44:46 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:44:46 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:44:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:44:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:44:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:44:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:44:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:44:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:44:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:44:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:44:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:44:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:44:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:44:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:44:57 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:44:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:44:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:44:58 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:44:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 04:44:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:44:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:44:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:44:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:44:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:44:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:44:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43869557
Sat 18 Jan 2014 04:44:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:45:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43869557
Sat 18 Jan 2014 04:45:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:45:01 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:45:01 - job_xml_thread(): Done retrieving: data size 43869557
Sat 18 Jan 2014 04:45:01 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:45:01 - XML: Start document: iteration 10
Sat 18 Jan 2014 04:45:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:45:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:45:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:45:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:45:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:45:15 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:45:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:45:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:45:15 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 04:45:15 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:45:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:45:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:45:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:45:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:45:16 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:45:16 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 04:45:16 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 04:45:16 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:45:16 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 04:45:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:45:17 - XML: Processed 655392 elements - found 593 jobs
Sat 18 Jan 2014 04:45:17 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:45:17 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:45:17 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:45:17 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:45:19 - size of cluster 'LISA Cluster': 624 hosts 79478 metrics 827835 values 13054744 bits 1631843 bytes 
Sat 18 Jan 2014 04:45:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:45:20 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:45:21 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:45:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:45:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 04:45:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 04:45:21 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:45:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5712 values 90037 bits 11254 bytes 
Sat 18 Jan 2014 04:45:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:45:22 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:45:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:45:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:45:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:45:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:45:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:45:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:45:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:45:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43832659
Sat 18 Jan 2014 04:45:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:45:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43832659
Sat 18 Jan 2014 04:45:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:45:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:45:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:45:32 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:45:33 - job_xml_thread(): Done retrieving: data size 43832659
Sat 18 Jan 2014 04:45:33 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:45:33 - XML: Start document: iteration 11
Sat 18 Jan 2014 04:45:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:45:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:45:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:45:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:45:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:45:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:45:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:45:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:45:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:45:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:45:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:45:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:45:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:45:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:45:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:45:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:45:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:45:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:45:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:45:49 - XML: Processed 655392 elements - found 593 jobs
Sat 18 Jan 2014 04:45:49 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:45:49 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:45:49 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:45:49 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:45:49 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:45:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 04:45:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:45:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:45:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43822521
Sat 18 Jan 2014 04:45:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:45:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43822521
Sat 18 Jan 2014 04:45:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:45:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:45:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:46:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:46:02 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:46:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:46:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:46:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:46:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:46:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:46:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:46:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:46:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:46:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:46:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:46:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:46:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:46:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:46:04 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:46:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:46:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:46:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:46:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:46:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:46:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43863897
Sat 18 Jan 2014 04:46:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:46:06 - job_xml_thread(): Done retrieving: data size 43863897
Sat 18 Jan 2014 04:46:06 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:46:06 - XML: Start document: iteration 12
Sat 18 Jan 2014 04:46:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43863897
Sat 18 Jan 2014 04:46:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:46:17 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:46:17 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 04:46:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:46:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:46:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:46:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:46:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:46:19 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:46:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:46:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:46:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:46:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:46:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:46:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:46:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:46:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:46:21 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:46:22 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:46:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:46:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 04:46:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 04:46:22 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:46:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8956 values 141311 bits 17663 bytes 
Sat 18 Jan 2014 04:46:26 - XML: Processed 655392 elements - found 593 jobs
Sat 18 Jan 2014 04:46:26 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:46:26 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:46:26 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:46:26 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:46:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:46:30 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:46:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:46:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:46:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:46:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:46:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:46:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:46:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:46:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43838319
Sat 18 Jan 2014 04:46:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:46:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43838319
Sat 18 Jan 2014 04:46:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:46:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:46:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:46:41 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:46:41 - job_xml_thread(): Done retrieving: data size 43838319
Sat 18 Jan 2014 04:46:41 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:46:41 - XML: Start document: iteration 13
Sat 18 Jan 2014 04:46:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:46:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:46:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:46:46 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:46:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:46:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:46:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:46:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:46:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:46:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:46:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:46:55 - XML: Processed 655392 elements - found 593 jobs
Sat 18 Jan 2014 04:46:55 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:46:55 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:46:55 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:46:55 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:46:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:46:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:46:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:46:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:46:56 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:46:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 04:46:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:46:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:46:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:46:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:46:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:46:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:46:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43837617
Sat 18 Jan 2014 04:46:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:46:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43837617
Sat 18 Jan 2014 04:46:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:47:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:47:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:47:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:47:07 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:47:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:47:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:47:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:47:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:47:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:47:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:47:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:47:10 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:47:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:47:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:47:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:47:11 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:47:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:47:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:47:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:47:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:47:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:47:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:47:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:47:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43792029
Sat 18 Jan 2014 04:47:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:47:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43792029
Sat 18 Jan 2014 04:47:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:47:15 - job_xml_thread(): Done retrieving: data size 43792029
Sat 18 Jan 2014 04:47:16 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:47:16 - XML: Start document: iteration 14
Sat 18 Jan 2014 04:47:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:47:22 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:47:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:47:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:47:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:47:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 04:47:24 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:47:24 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:47:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 04:47:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8819 values 139452 bits 17431 bytes 
Sat 18 Jan 2014 04:47:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:47:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:47:29 - XML: Processed 654644 elements - found 593 jobs
Sat 18 Jan 2014 04:47:29 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:47:29 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:47:29 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:47:29 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:47:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:47:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:47:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:47:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:47:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:47:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:47:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:47:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:47:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:47:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:47:38 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:47:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:47:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:47:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:47:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:47:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:47:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:47:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:47:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43263026
Sat 18 Jan 2014 04:47:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:47:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43263026
Sat 18 Jan 2014 04:47:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:47:44 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:47:44 - job_xml_thread(): Done retrieving: data size 43263026
Sat 18 Jan 2014 04:47:44 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:47:44 - XML: Start document: iteration 15
Sat 18 Jan 2014 04:47:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:47:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:47:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:47:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:47:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:47:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:47:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:47:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:47:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:47:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:47:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:47:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:47:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:48:01 - XML: Processed 648142 elements - found 593 jobs
Sat 18 Jan 2014 04:48:01 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:48:01 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:48:01 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:48:01 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:48:04 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:48:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 04:48:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:48:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:48:05 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:48:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:48:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:48:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:48:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:48:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:48:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:48:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:48:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43200964
Sat 18 Jan 2014 04:48:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:48:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43200964
Sat 18 Jan 2014 04:48:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:48:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:48:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:48:16 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:48:16 - job_xml_thread(): Done retrieving: data size 43200964
Sat 18 Jan 2014 04:48:16 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:48:16 - XML: Start document: iteration 16
Sat 18 Jan 2014 04:48:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:48:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:48:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:48:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:48:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:48:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:48:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:48:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:48:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:48:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:48:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:48:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:48:25 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:48:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:48:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:48:26 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:48:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:48:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 04:48:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:48:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:48:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 04:48:26 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:48:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5817 values 91913 bits 11489 bytes 
Sat 18 Jan 2014 04:48:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:48:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:48:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:48:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:48:28 - XML: Processed 647546 elements - found 593 jobs
Sat 18 Jan 2014 04:48:28 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:48:28 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:48:28 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:48:28 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:48:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:48:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43241420
Sat 18 Jan 2014 04:48:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:48:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43241420
Sat 18 Jan 2014 04:48:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:48:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:48:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:48:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:48:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:48:43 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:48:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:48:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:48:44 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:48:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:48:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:48:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:48:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:48:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:48:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:48:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:48:48 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:48:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:48:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:48:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:48:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:48:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:48:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:48:48 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:48:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 04:48:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:48:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:48:51 - job_xml_thread(): Done retrieving: data size 43801341
Sat 18 Jan 2014 04:48:51 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:48:51 - XML: Start document: iteration 17
Sat 18 Jan 2014 04:48:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43801341
Sat 18 Jan 2014 04:48:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:48:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43801341
Sat 18 Jan 2014 04:48:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:49:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:49:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:49:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:49:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:49:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:49:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:49:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:49:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:49:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:49:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:49:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:49:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:49:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:49:14 - XML: Processed 655016 elements - found 592 jobs
Sat 18 Jan 2014 04:49:14 - job 7348710 appears to have finished
Sat 18 Jan 2014 04:49:14 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 04:49:14 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 04:49:14 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 04:49:14 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:49:14 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:49:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:49:16 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:49:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:49:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:49:17 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 04:49:17 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 04:49:17 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:49:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:49:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:49:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:49:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:49:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:49:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43829354
Sat 18 Jan 2014 04:49:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:49:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43829354
Sat 18 Jan 2014 04:49:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:49:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:49:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:49:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:49:26 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:49:27 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:49:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:49:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 04:49:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 04:49:27 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:49:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8760 values 138203 bits 17275 bytes 
Sat 18 Jan 2014 04:49:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:49:27 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:49:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:49:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:49:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:49:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:49:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:49:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:49:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43829354
Sat 18 Jan 2014 04:49:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:49:29 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:49:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:49:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:49:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:49:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:49:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:49:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:49:38 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:49:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:49:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:49:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:49:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:49:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:49:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:49:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:49:41 - job_xml_thread(): Done retrieving: data size 43834075
Sat 18 Jan 2014 04:49:41 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:49:41 - XML: Start document: iteration 18
Sat 18 Jan 2014 04:49:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43834075
Sat 18 Jan 2014 04:49:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:49:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:49:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:49:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:49:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:49:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:49:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:49:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43834075
Sat 18 Jan 2014 04:49:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:49:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:49:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:49:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:49:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:49:59 - XML: Processed 655390 elements - found 592 jobs
Sat 18 Jan 2014 04:49:59 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:49:59 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:49:59 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:49:59 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:50:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:50:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:50:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:50:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:50:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:50:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:50:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:50:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:50:04 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:50:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:50:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:50:04 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:50:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 04:50:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:50:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:50:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:50:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:50:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:50:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:50:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43838097
Sat 18 Jan 2014 04:50:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:50:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43838097
Sat 18 Jan 2014 04:50:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:50:14 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:50:14 - job_xml_thread(): Done retrieving: data size 43838097
Sat 18 Jan 2014 04:50:14 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:50:14 - XML: Start document: iteration 19
Sat 18 Jan 2014 04:50:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:50:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:50:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:50:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:50:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:50:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:50:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:50:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:50:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:50:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:50:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:50:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:50:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:50:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:50:27 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:50:27 - XML: Processed 655390 elements - found 592 jobs
Sat 18 Jan 2014 04:50:27 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:50:27 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:50:27 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:50:27 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:50:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:50:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 04:50:27 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:50:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 04:50:28 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:50:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5832 values 91964 bits 11495 bytes 
Sat 18 Jan 2014 04:50:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:50:30 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:50:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:50:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:50:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:50:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:50:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:50:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:50:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:50:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43850994
Sat 18 Jan 2014 04:50:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:50:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43850994
Sat 18 Jan 2014 04:50:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:50:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:50:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:50:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:50:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:50:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:50:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:50:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:50:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:50:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:50:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43850994
Sat 18 Jan 2014 04:50:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:50:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:50:42 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:50:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:50:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:50:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:50:51 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:50:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 04:50:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:50:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:50:52 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:50:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:50:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:50:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:50:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:50:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:50:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:50:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:50:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:50:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:50:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:50:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:50:56 - job_xml_thread(): Done retrieving: data size 43823445
Sat 18 Jan 2014 04:50:56 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:50:56 - XML: Start document: iteration 20
Sat 18 Jan 2014 04:50:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43823445
Sat 18 Jan 2014 04:50:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:50:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:50:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:50:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:50:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:50:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43823445
Sat 18 Jan 2014 04:50:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:51:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:51:11 - XML: Processed 655390 elements - found 592 jobs
Sat 18 Jan 2014 04:51:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:51:12 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:51:12 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:51:12 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:51:12 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:51:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:51:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:51:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:51:14 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:51:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:51:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:51:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:51:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:51:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:51:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:51:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:51:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:51:19 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:51:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:51:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:51:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:51:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:51:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:51:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:51:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:51:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43843197
Sat 18 Jan 2014 04:51:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:51:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43843197
Sat 18 Jan 2014 04:51:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:51:27 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:51:27 - job_xml_thread(): Done retrieving: data size 43843197
Sat 18 Jan 2014 04:51:27 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:51:27 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 04:51:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:51:28 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:51:29 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 04:51:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:51:29 - Housekeeping: done.
Sat 18 Jan 2014 04:51:29 - XML: Start document: iteration 0
Sat 18 Jan 2014 04:51:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 04:51:29 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:51:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9229 values 145595 bits 18199 bytes 
Sat 18 Jan 2014 04:51:29 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:51:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 04:51:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:51:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:51:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:51:33 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:51:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:51:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:51:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:51:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:51:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:51:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:51:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:51:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:51:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:51:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:51:43 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:51:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:51:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:51:44 - XML: Processed 655390 elements - found 592 jobs
Sat 18 Jan 2014 04:51:44 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:51:44 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:51:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:51:44 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:51:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:51:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:51:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:51:44 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:51:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:51:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43843623
Sat 18 Jan 2014 04:51:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:51:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43843623
Sat 18 Jan 2014 04:51:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:51:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:51:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:51:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:51:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:51:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:51:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:51:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:51:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:51:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:51:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:51:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:51:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:51:59 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:51:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:52:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:52:01 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:52:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:52:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:52:01 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:52:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 04:52:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:52:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:52:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:52:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:52:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:52:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:52:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43864827
Sat 18 Jan 2014 04:52:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:52:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43864827
Sat 18 Jan 2014 04:52:03 - job_xml_thread(): Done retrieving: data size 43864827
Sat 18 Jan 2014 04:52:03 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:52:03 - XML: Start document: iteration 1
Sat 18 Jan 2014 04:52:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:52:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:52:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:52:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:52:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:52:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:52:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:52:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:52:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:52:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:52:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:52:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:52:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:52:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:52:17 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 04:52:17 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:52:17 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:52:17 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 04:52:17 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 04:52:18 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:52:18 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 04:52:23 - size of cluster 'LISA Cluster': 624 hosts 79485 metrics 837199 values 13221618 bits 1652702 bytes 
Sat 18 Jan 2014 04:52:26 - XML: Processed 655390 elements - found 592 jobs
Sat 18 Jan 2014 04:52:26 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:52:26 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:52:26 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:52:26 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:52:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:52:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:52:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:52:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:52:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:52:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:52:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:52:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:52:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:52:29 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:52:30 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:52:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 04:52:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:52:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 04:52:30 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:52:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5957 values 93989 bits 11748 bytes 
Sat 18 Jan 2014 04:52:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:52:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43830554
Sat 18 Jan 2014 04:52:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:52:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43830554
Sat 18 Jan 2014 04:52:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:52:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:52:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:52:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:52:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:52:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:52:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:52:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:52:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:52:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:52:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:52:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:52:41 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:52:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:52:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:52:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:52:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:52:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:52:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:52:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:52:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:52:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:52:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:52:48 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:52:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 04:52:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:52:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:52:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43857006
Sat 18 Jan 2014 04:52:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:52:50 - job_xml_thread(): Done retrieving: data size 43857006
Sat 18 Jan 2014 04:52:50 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:52:50 - XML: Start document: iteration 2
Sat 18 Jan 2014 04:52:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43857006
Sat 18 Jan 2014 04:52:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:52:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:52:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:53:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:53:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:53:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:53:03 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:53:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:53:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:53:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:53:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:53:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:53:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:53:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:53:10 - XML: Processed 655386 elements - found 590 jobs
Sat 18 Jan 2014 04:53:10 - job 7348709 appears to have finished
Sat 18 Jan 2014 04:53:10 - job 7348389 appears to have finished
Sat 18 Jan 2014 04:53:10 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 04:53:10 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 04:53:11 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 04:53:11 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:53:11 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:53:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:53:12 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:53:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:53:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:53:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:53:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:53:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:53:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:53:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:53:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43773023
Sat 18 Jan 2014 04:53:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:53:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43773023
Sat 18 Jan 2014 04:53:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:53:18 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:53:18 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 04:53:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:53:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:53:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:53:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:53:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:53:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:53:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:53:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:53:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:53:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:53:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43773023
Sat 18 Jan 2014 04:53:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:53:27 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:53:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:53:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:53:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:53:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:53:30 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:53:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:53:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 04:53:30 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:53:30 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:53:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 04:53:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6517 values 102762 bits 12845 bytes 
Sat 18 Jan 2014 04:53:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:53:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:53:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:53:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:53:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:53:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:53:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:53:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:53:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:53:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:53:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:53:39 - job_xml_thread(): Done retrieving: data size 43383452
Sat 18 Jan 2014 04:53:39 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:53:39 - XML: Start document: iteration 3
Sat 18 Jan 2014 04:53:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43383452
Sat 18 Jan 2014 04:53:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:53:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:53:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:53:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:53:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:53:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:53:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:53:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43383452
Sat 18 Jan 2014 04:53:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:53:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:53:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:53:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:53:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:53:55 - XML: Processed 650006 elements - found 590 jobs
Sat 18 Jan 2014 04:53:56 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:53:56 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:53:56 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:53:56 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:53:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:53:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:53:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:53:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:53:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:53:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:53:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:54:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:54:01 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:54:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:54:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:54:02 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:54:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 04:54:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:54:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:54:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:54:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:54:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:54:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:54:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43199337
Sat 18 Jan 2014 04:54:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:54:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43199337
Sat 18 Jan 2014 04:54:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:54:11 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:54:11 - job_xml_thread(): Done retrieving: data size 43199337
Sat 18 Jan 2014 04:54:11 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:54:11 - XML: Start document: iteration 4
Sat 18 Jan 2014 04:54:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:54:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:54:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:54:15 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:54:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:54:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:54:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:54:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:54:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:54:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:54:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:54:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:54:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:54:21 - XML: Processed 647240 elements - found 590 jobs
Sat 18 Jan 2014 04:54:21 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:54:21 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:54:21 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:54:21 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:54:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:54:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:54:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:54:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:54:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:54:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:54:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:54:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:54:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:54:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43228799
Sat 18 Jan 2014 04:54:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:54:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43228799
Sat 18 Jan 2014 04:54:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:54:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:54:31 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:54:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:54:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:54:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:54:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 04:54:32 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:54:32 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:54:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 04:54:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8867 values 139811 bits 17476 bytes 
Sat 18 Jan 2014 04:54:36 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:54:36 - job_xml_thread(): Done retrieving: data size 43228799
Sat 18 Jan 2014 04:54:36 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:54:36 - XML: Start document: iteration 5
Sat 18 Jan 2014 04:54:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:54:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:54:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:54:42 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:54:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:54:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:54:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:54:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:54:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:54:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:54:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:54:48 - XML: Processed 647934 elements - found 590 jobs
Sat 18 Jan 2014 04:54:48 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:54:48 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:54:49 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:54:49 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:54:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:54:49 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:54:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:54:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:54:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:54:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:54:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:54:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:54:52 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:54:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 04:54:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:54:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:54:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43813197
Sat 18 Jan 2014 04:54:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:54:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43813197
Sat 18 Jan 2014 04:54:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:54:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:54:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:55:04 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:55:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:55:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:55:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:55:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:55:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:55:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:55:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:55:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:55:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:55:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:55:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:55:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:55:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:55:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:55:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:55:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:55:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:55:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:55:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:55:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:55:12 - job_xml_thread(): Done retrieving: data size 43836923
Sat 18 Jan 2014 04:55:12 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:55:12 - XML: Start document: iteration 6
Sat 18 Jan 2014 04:55:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43836923
Sat 18 Jan 2014 04:55:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43836923
Sat 18 Jan 2014 04:55:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:55:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:55:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:55:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:55:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:55:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:55:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:55:26 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:55:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:55:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:55:28 - XML: Processed 655386 elements - found 590 jobs
Sat 18 Jan 2014 04:55:28 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:55:28 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:55:28 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:55:28 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:55:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:55:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:55:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:55:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:55:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:55:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:55:32 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:55:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:55:33 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:55:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:55:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:55:33 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:55:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:55:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 04:55:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 04:55:33 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:55:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99054 bits 12381 bytes 
Sat 18 Jan 2014 04:55:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:55:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:55:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:55:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:55:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:55:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43828454
Sat 18 Jan 2014 04:55:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:55:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43828454
Sat 18 Jan 2014 04:55:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:55:43 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:55:43 - job_xml_thread(): Done retrieving: data size 43828454
Sat 18 Jan 2014 04:55:43 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:55:43 - XML: Start document: iteration 7
Sat 18 Jan 2014 04:55:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:55:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:55:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:55:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:55:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:55:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:55:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:55:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:55:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:55:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:55:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:55:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:55:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:55:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:55:59 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:56:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:56:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:56:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:56:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:56:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:56:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:56:00 - XML: Processed 655384 elements - found 590 jobs
Sat 18 Jan 2014 04:56:00 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:56:00 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:56:00 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:56:00 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:56:01 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:56:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 04:56:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:56:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:56:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43857173
Sat 18 Jan 2014 04:56:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:56:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43857173
Sat 18 Jan 2014 04:56:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:56:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:56:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:56:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:56:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:56:16 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:56:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:56:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:56:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:56:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:56:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:56:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:56:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:56:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:56:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:56:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:56:19 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:56:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:56:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:56:19 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 04:56:19 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 04:56:19 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:56:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:56:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:56:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:56:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:56:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:56:20 - job_xml_thread(): Done retrieving: data size 43853846
Sat 18 Jan 2014 04:56:20 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:56:20 - XML: Start document: iteration 8
Sat 18 Jan 2014 04:56:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853846
Sat 18 Jan 2014 04:56:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853846
Sat 18 Jan 2014 04:56:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:56:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:56:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:56:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:56:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:56:33 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:56:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:56:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:56:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:56:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:56:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:56:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:56:36 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:56:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:56:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 04:56:36 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:56:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8864 values 139771 bits 17471 bytes 
Sat 18 Jan 2014 04:56:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 04:56:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:56:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:56:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:56:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:56:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:56:38 - XML: Processed 655386 elements - found 590 jobs
Sat 18 Jan 2014 04:56:38 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:56:38 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:56:38 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:56:38 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:56:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:56:40 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:56:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:56:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:56:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:56:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:56:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:56:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:56:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:56:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856883
Sat 18 Jan 2014 04:56:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:56:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43856883
Sat 18 Jan 2014 04:56:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:56:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:56:53 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:56:53 - job_xml_thread(): Done retrieving: data size 43856883
Sat 18 Jan 2014 04:56:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:56:53 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:56:53 - XML: Start document: iteration 9
Sat 18 Jan 2014 04:56:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:56:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:57:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:57:00 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:57:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:57:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:57:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:57:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:57:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:57:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:57:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:57:02 - XML: Processed 655386 elements - found 590 jobs
Sat 18 Jan 2014 04:57:02 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:57:02 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:57:02 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:57:02 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:57:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:57:04 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:57:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:57:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:57:04 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:57:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 04:57:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:57:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:57:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:57:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:57:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:57:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:57:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853878
Sat 18 Jan 2014 04:57:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:57:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853878
Sat 18 Jan 2014 04:57:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:57:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:57:15 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:57:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:57:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:57:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:57:17 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:57:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:57:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:57:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:57:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:57:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:57:19 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:57:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:57:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:57:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:57:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:57:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:57:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:57:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:57:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43854783
Sat 18 Jan 2014 04:57:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:57:21 - job_xml_thread(): Done retrieving: data size 43854783
Sat 18 Jan 2014 04:57:21 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:57:21 - XML: Start document: iteration 10
Sat 18 Jan 2014 04:57:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43854783
Sat 18 Jan 2014 04:57:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:57:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:57:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:57:33 - XML: Processed 655386 elements - found 590 jobs
Sat 18 Jan 2014 04:57:34 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:57:34 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:57:34 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:57:34 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:57:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:57:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:57:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:57:37 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:57:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:57:37 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:57:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 04:57:37 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:57:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 04:57:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8905 values 140441 bits 17555 bytes 
Sat 18 Jan 2014 04:57:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:57:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:57:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:57:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:57:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:57:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:57:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:57:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:57:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:57:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:57:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:57:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:57:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:57:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:57:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:57:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:57:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:57:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:57:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43866417
Sat 18 Jan 2014 04:57:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:57:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43866417
Sat 18 Jan 2014 04:57:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:57:49 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:57:49 - job_xml_thread(): Done retrieving: data size 43866417
Sat 18 Jan 2014 04:57:49 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:57:49 - XML: Start document: iteration 11
Sat 18 Jan 2014 04:57:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:57:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:58:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:58:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:58:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:58:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:58:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:58:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:58:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:58:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:58:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:58:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:58:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:58:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:58:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:58:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:58:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:58:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:58:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:58:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:58:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:58:10 - XML: Processed 655386 elements - found 590 jobs
Sat 18 Jan 2014 04:58:10 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:58:10 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:58:10 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:58:10 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:58:10 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:58:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 04:58:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:58:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:58:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43857014
Sat 18 Jan 2014 04:58:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:58:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43857014
Sat 18 Jan 2014 04:58:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:58:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:58:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:58:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:58:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:58:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:58:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:58:25 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:58:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:58:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:58:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:58:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:58:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:58:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:58:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:58:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:58:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:58:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:58:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:58:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:58:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:58:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:58:28 - job_xml_thread(): Done retrieving: data size 43866956
Sat 18 Jan 2014 04:58:28 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:58:28 - XML: Start document: iteration 12
Sat 18 Jan 2014 04:58:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43866956
Sat 18 Jan 2014 04:58:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:58:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43866956
Sat 18 Jan 2014 04:58:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:58:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:58:37 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:58:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:58:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 04:58:38 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:58:38 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:58:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 04:58:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8962 values 141310 bits 17663 bytes 
Sat 18 Jan 2014 04:58:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:58:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:58:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:58:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:58:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:58:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:58:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:58:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:58:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:58:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:58:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:58:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:58:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:58:46 - XML: Processed 655384 elements - found 589 jobs
Sat 18 Jan 2014 04:58:46 - job 7348711 appears to have finished
Sat 18 Jan 2014 04:58:46 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 04:58:46 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 04:58:46 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 04:58:46 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:58:46 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:58:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:58:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:58:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:58:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:58:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:58:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:58:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:58:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:58:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:58:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43827523
Sat 18 Jan 2014 04:58:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:58:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43827523
Sat 18 Jan 2014 04:58:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:58:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:58:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:59:01 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:59:01 - job_xml_thread(): Done retrieving: data size 43827523
Sat 18 Jan 2014 04:59:01 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:59:01 - XML: Start document: iteration 13
Sat 18 Jan 2014 04:59:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:59:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:59:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:59:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:59:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:59:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:59:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:59:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:59:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:59:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:59:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:59:13 - XML: Processed 655384 elements - found 589 jobs
Sat 18 Jan 2014 04:59:13 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 04:59:13 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 04:59:13 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 04:59:13 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 04:59:14 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:59:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 04:59:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:59:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:59:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:59:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:59:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:59:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:59:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:59:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:59:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:59:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:59:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43781074
Sat 18 Jan 2014 04:59:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:59:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43781074
Sat 18 Jan 2014 04:59:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:59:18 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 04:59:18 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:59:20 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:59:20 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:59:20 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 04:59:20 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 04:59:21 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 04:59:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:59:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:59:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:59:24 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:59:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 04:59:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:59:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:59:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:59:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:59:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43781074
Sat 18 Jan 2014 04:59:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:59:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:59:28 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 04:59:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:59:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:59:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:59:32 - size of cluster 'LISA Cluster': 624 hosts 79482 metrics 812268 values 12809421 bits 1601177 bytes 
Sat 18 Jan 2014 04:59:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:59:39 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:59:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:59:39 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:59:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 04:59:39 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 04:59:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 04:59:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 04:59:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:59:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 04:59:39 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:59:39 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 04:59:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 04:59:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5975 values 94226 bits 11778 bytes 
Sat 18 Jan 2014 04:59:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:59:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 04:59:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 04:59:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 04:59:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:59:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:59:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:59:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 04:59:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:59:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:59:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 04:59:42 - job_xml_thread(): Done retrieving: data size 43345323
Sat 18 Jan 2014 04:59:42 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 04:59:42 - XML: Start document: iteration 14
Sat 18 Jan 2014 04:59:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43345323
Sat 18 Jan 2014 04:59:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 04:59:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43345323
Sat 18 Jan 2014 04:59:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 04:59:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 04:59:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 04:59:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 04:59:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 04:59:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 04:59:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 04:59:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:59:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 04:59:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 04:59:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 04:59:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:00:03 - XML: Processed 649574 elements - found 589 jobs
Sat 18 Jan 2014 05:00:03 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:00:03 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:00:03 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:00:03 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:00:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:00:05 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:00:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:00:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:00:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:00:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:00:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:00:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:00:06 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:00:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 05:00:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:00:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:00:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43201031
Sat 18 Jan 2014 05:00:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:00:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43201031
Sat 18 Jan 2014 05:00:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:00:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:00:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:00:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:00:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:00:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:00:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:00:18 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:00:18 - job_xml_thread(): Done retrieving: data size 43201031
Sat 18 Jan 2014 05:00:19 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:00:19 - XML: Start document: iteration 15
Sat 18 Jan 2014 05:00:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:00:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:00:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:00:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:00:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:00:20 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:00:20 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 05:00:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:00:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:00:29 - XML: Processed 647626 elements - found 589 jobs
Sat 18 Jan 2014 05:00:29 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:00:29 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:00:29 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:00:29 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:00:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:00:30 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:00:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:00:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:00:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:00:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:00:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:00:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:00:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:00:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43246255
Sat 18 Jan 2014 05:00:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:00:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43246255
Sat 18 Jan 2014 05:00:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:00:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:00:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:00:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:00:39 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:00:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:00:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 05:00:40 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:00:40 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:00:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 05:00:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8621 values 135892 bits 16986 bytes 
Sat 18 Jan 2014 05:00:44 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:00:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:00:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:00:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:00:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:00:48 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:00:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:00:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:00:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:00:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:00:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:00:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:00:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:00:49 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:00:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:00:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:00:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:00:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:00:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:00:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:00:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:00:53 - job_xml_thread(): Done retrieving: data size 43814469
Sat 18 Jan 2014 05:00:53 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:00:53 - XML: Start document: iteration 16
Sat 18 Jan 2014 05:00:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43814469
Sat 18 Jan 2014 05:00:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:00:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43814469
Sat 18 Jan 2014 05:00:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:01:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:01:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:01:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:01:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:01:11 - XML: Processed 655151 elements - found 589 jobs
Sat 18 Jan 2014 05:01:11 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:01:11 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:01:11 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:01:11 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:01:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:01:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:01:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:01:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:01:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:01:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:01:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:01:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:01:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:01:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:01:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:01:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:01:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:01:16 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:01:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 05:01:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:01:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:01:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:01:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:01:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:01:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:01:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862430
Sat 18 Jan 2014 05:01:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:01:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862430
Sat 18 Jan 2014 05:01:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:01:26 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:01:26 - job_xml_thread(): Done retrieving: data size 43862430
Sat 18 Jan 2014 05:01:26 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:01:26 - XML: Start document: iteration 17
Sat 18 Jan 2014 05:01:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:01:27 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:01:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:01:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:01:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:01:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:01:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:01:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:01:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:01:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:01:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:01:38 - XML: Processed 655384 elements - found 589 jobs
Sat 18 Jan 2014 05:01:38 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:01:38 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:01:38 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:01:38 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:01:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:01:39 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:01:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:01:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:01:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:01:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:01:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:01:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:01:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:01:40 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:01:40 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:01:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 05:01:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:01:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 05:01:40 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:01:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5711 values 90135 bits 11266 bytes 
Sat 18 Jan 2014 05:01:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:01:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43827832
Sat 18 Jan 2014 05:01:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:01:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43827832
Sat 18 Jan 2014 05:01:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:01:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:01:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:01:53 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:01:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:01:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:01:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:01:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:01:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:01:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:01:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:01:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:01:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:01:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:01:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:01:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:01:58 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:01:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:01:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:01:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:01:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:01:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:01:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:02:00 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:02:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 05:02:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:02:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:02:01 - job_xml_thread(): Done retrieving: data size 43853025
Sat 18 Jan 2014 05:02:01 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:02:01 - XML: Start document: iteration 18
Sat 18 Jan 2014 05:02:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853025
Sat 18 Jan 2014 05:02:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:02:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853025
Sat 18 Jan 2014 05:02:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:02:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:02:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:02:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:02:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:02:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:02:20 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:02:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:02:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:02:21 - XML: Processed 655384 elements - found 589 jobs
Sat 18 Jan 2014 05:02:21 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:02:21 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:02:21 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:02:21 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:02:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:02:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:02:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:02:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:02:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:02:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:02:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:02:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:02:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:02:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:02:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:02:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:02:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:02:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:02:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43848901
Sat 18 Jan 2014 05:02:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:02:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43848901
Sat 18 Jan 2014 05:02:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:02:36 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:02:36 - job_xml_thread(): Done retrieving: data size 43848901
Sat 18 Jan 2014 05:02:36 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:02:36 - XML: Start document: iteration 19
Sat 18 Jan 2014 05:02:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:02:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:02:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:02:40 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:02:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:02:41 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:02:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 05:02:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 05:02:41 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:02:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7723 values 122145 bits 15268 bytes 
Sat 18 Jan 2014 05:02:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:02:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:02:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:02:47 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:02:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:02:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:02:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:02:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:02:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:02:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:02:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:02:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:02:49 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:02:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:02:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:02:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:02:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:02:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:02:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:02:52 - XML: Processed 655382 elements - found 588 jobs
Sat 18 Jan 2014 05:02:52 - job 7348713 appears to have finished
Sat 18 Jan 2014 05:02:52 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 05:02:52 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 05:02:52 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 05:02:52 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:02:52 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:02:54 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 05:02:54 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 05:02:54 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:02:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:02:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43854870
Sat 18 Jan 2014 05:02:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:02:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43854870
Sat 18 Jan 2014 05:02:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:03:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:03:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:03:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:03:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:03:07 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:03:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:03:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:03:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:03:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:03:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:03:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:03:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:03:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:03:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:03:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:03:11 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:03:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:03:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:03:12 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:03:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 05:03:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:03:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:03:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:03:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:03:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:03:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:03:13 - job_xml_thread(): Done retrieving: data size 43852868
Sat 18 Jan 2014 05:03:13 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:03:13 - XML: Start document: iteration 20
Sat 18 Jan 2014 05:03:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43852868
Sat 18 Jan 2014 05:03:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:03:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43852868
Sat 18 Jan 2014 05:03:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:03:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:03:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:03:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:03:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:03:28 - XML: Processed 655382 elements - found 588 jobs
Sat 18 Jan 2014 05:03:28 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:03:28 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:03:28 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:03:28 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:03:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:03:30 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:03:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:03:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:03:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:03:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:03:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:03:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:03:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:03:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:03:35 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:03:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:03:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:03:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:03:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:03:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:03:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:03:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:03:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43845550
Sat 18 Jan 2014 05:03:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:03:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43845550
Sat 18 Jan 2014 05:03:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:03:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:03:42 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:03:44 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:03:44 - job_xml_thread(): Done retrieving: data size 43845550
Sat 18 Jan 2014 05:03:44 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:03:44 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 05:03:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:03:44 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:03:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 05:03:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 05:03:44 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:03:45 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 05:03:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9062 values 143132 bits 17891 bytes 
Sat 18 Jan 2014 05:03:45 - Housekeeping: done.
Sat 18 Jan 2014 05:03:45 - XML: Start document: iteration 0
Sat 18 Jan 2014 05:03:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:03:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:03:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:03:50 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:03:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:03:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:03:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:03:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:03:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:03:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:03:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:03:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:03:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:03:57 - XML: Processed 655382 elements - found 588 jobs
Sat 18 Jan 2014 05:03:57 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:03:57 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:03:57 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:03:57 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:03:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:03:59 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:03:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:03:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:03:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:03:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:03:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:03:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:04:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:04:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851250
Sat 18 Jan 2014 05:04:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:04:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851250
Sat 18 Jan 2014 05:04:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:04:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:04:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:04:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:04:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:04:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:04:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:04:12 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:04:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:04:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:04:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:04:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:04:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:04:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:04:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:04:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:04:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:04:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:04:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:04:17 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:04:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 05:04:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:04:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:04:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:04:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:04:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:04:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:04:19 - job_xml_thread(): Done retrieving: data size 43839954
Sat 18 Jan 2014 05:04:19 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:04:19 - XML: Start document: iteration 1
Sat 18 Jan 2014 05:04:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43839954
Sat 18 Jan 2014 05:04:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43839954
Sat 18 Jan 2014 05:04:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:04:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:04:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:04:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:04:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:04:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:04:33 - XML: Processed 655379 elements - found 588 jobs
Sat 18 Jan 2014 05:04:33 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:04:33 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:04:33 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:04:33 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:04:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:04:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:04:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:04:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:04:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:04:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:04:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:04:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:04:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:04:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:04:39 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:04:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:04:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:04:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:04:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:04:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:04:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:04:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:04:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43866385
Sat 18 Jan 2014 05:04:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:04:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43866385
Sat 18 Jan 2014 05:04:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:04:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:04:44 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:04:46 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:04:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:04:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 05:04:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 05:04:47 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:04:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8904 values 140515 bits 17564 bytes 
Sat 18 Jan 2014 05:04:48 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:04:48 - job_xml_thread(): Done retrieving: data size 43866385
Sat 18 Jan 2014 05:04:48 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:04:49 - XML: Start document: iteration 2
Sat 18 Jan 2014 05:04:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:04:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:04:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:04:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:04:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:04:56 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:04:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:04:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:04:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:04:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:04:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:04:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:04:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:05:03 - XML: Processed 655382 elements - found 588 jobs
Sat 18 Jan 2014 05:05:03 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:05:03 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:05:03 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:05:03 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:05:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:05:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:05:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:05:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:05:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:05:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:05:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:05:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:05:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:05:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43837311
Sat 18 Jan 2014 05:05:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:05:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43837311
Sat 18 Jan 2014 05:05:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:05:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:05:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:05:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:05:14 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:05:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:05:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:05:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:05:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:05:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:05:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:05:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43837311
Sat 18 Jan 2014 05:05:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:05:18 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:05:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:05:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:05:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:05:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:05:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:05:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:05:28 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:05:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:05:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:05:28 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:05:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 05:05:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:05:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:05:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:05:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:05:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:05:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:05:29 - job_xml_thread(): Done retrieving: data size 43771513
Sat 18 Jan 2014 05:05:29 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:05:29 - XML: Start document: iteration 3
Sat 18 Jan 2014 05:05:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43771513
Sat 18 Jan 2014 05:05:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:05:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:05:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:05:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:05:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:05:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:05:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:05:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43771513
Sat 18 Jan 2014 05:05:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:05:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:05:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:05:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:05:45 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:05:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:05:47 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:05:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:05:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:05:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:05:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:05:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:05:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:05:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:05:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:05:48 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:05:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 05:05:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 05:05:48 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:05:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5972 values 94188 bits 11773 bytes 
Sat 18 Jan 2014 05:05:51 - XML: Processed 654634 elements - found 588 jobs
Sat 18 Jan 2014 05:05:51 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:05:51 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:05:51 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:05:51 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:05:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:05:52 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:05:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:05:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:05:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:05:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:05:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:05:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:05:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:05:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43198596
Sat 18 Jan 2014 05:05:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:05:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43198596
Sat 18 Jan 2014 05:05:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:06:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:06:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:06:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:06:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:06:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:06:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:06:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:06:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:06:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:06:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:06:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:06:06 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:06:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:06:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:06:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:06:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:06:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:06:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:06:08 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:06:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 05:06:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:06:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:06:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:06:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:06:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:06:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:06:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43196211
Sat 18 Jan 2014 05:06:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:06:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43196211
Sat 18 Jan 2014 05:06:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:06:11 - job_xml_thread(): Done retrieving: data size 43196211
Sat 18 Jan 2014 05:06:11 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:06:11 - XML: Start document: iteration 4
Sat 18 Jan 2014 05:06:20 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 05:06:20 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:06:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:06:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:06:21 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:06:21 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 05:06:21 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 05:06:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:06:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:06:21 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:06:21 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 05:06:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:06:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:06:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:06:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:06:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:06:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:06:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:06:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:06:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:06:29 - size of cluster 'LISA Cluster': 624 hosts 79477 metrics 876412 values 13841831 bits 1730228 bytes 
Sat 18 Jan 2014 05:06:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:06:31 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:06:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:06:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:06:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:06:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:06:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:06:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:06:33 - XML: Processed 647182 elements - found 588 jobs
Sat 18 Jan 2014 05:06:33 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:06:33 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:06:33 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:06:33 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:06:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:06:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43695262
Sat 18 Jan 2014 05:06:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:06:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43695262
Sat 18 Jan 2014 05:06:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:06:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:06:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:06:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:06:45 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:06:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:06:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:06:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:06:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:06:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:06:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:06:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:06:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:06:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:06:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:06:48 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:06:49 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:06:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:06:49 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:06:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 05:06:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 05:06:49 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:06:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9211 values 145315 bits 18164 bytes 
Sat 18 Jan 2014 05:06:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:06:52 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:06:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:06:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:06:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:06:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:06:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:06:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:06:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:06:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43818750
Sat 18 Jan 2014 05:06:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:06:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43818750
Sat 18 Jan 2014 05:06:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:06:56 - job_xml_thread(): Done retrieving: data size 43818750
Sat 18 Jan 2014 05:06:56 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:06:56 - XML: Start document: iteration 5
Sat 18 Jan 2014 05:07:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:07:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:07:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:07:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:07:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:07:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:07:07 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:07:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 05:07:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:07:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:07:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:07:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:07:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:07:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:07:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:07:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:07:12 - XML: Processed 655092 elements - found 587 jobs
Sat 18 Jan 2014 05:07:12 - job 7348715 appears to have finished
Sat 18 Jan 2014 05:07:12 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 05:07:12 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 05:07:12 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 05:07:12 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:07:12 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:07:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:07:16 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:07:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:07:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:07:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:07:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:07:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:07:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:07:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:07:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43820548
Sat 18 Jan 2014 05:07:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:07:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43820548
Sat 18 Jan 2014 05:07:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:07:22 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:07:22 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 05:07:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:07:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:07:27 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:07:27 - job_xml_thread(): Done retrieving: data size 43820548
Sat 18 Jan 2014 05:07:27 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:07:27 - XML: Start document: iteration 6
Sat 18 Jan 2014 05:07:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:07:31 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:07:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:07:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:07:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:07:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:07:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:07:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:07:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:07:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:07:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:07:43 - XML: Processed 655380 elements - found 587 jobs
Sat 18 Jan 2014 05:07:43 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:07:43 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:07:43 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:07:43 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:07:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:07:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:07:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:07:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:07:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:07:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:07:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:07:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:07:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:07:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43831038
Sat 18 Jan 2014 05:07:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:07:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43831038
Sat 18 Jan 2014 05:07:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:07:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:07:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:07:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:07:49 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:07:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:07:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 05:07:50 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:07:50 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:07:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 05:07:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9336 values 147321 bits 18415 bytes 
Sat 18 Jan 2014 05:07:58 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:07:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:07:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:07:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:08:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:08:02 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:08:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:08:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:08:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:08:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:08:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:08:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:08:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:08:03 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:08:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:08:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:08:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:08:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:08:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:08:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:08:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:08:06 - job_xml_thread(): Done retrieving: data size 43830201
Sat 18 Jan 2014 05:08:06 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:08:06 - XML: Start document: iteration 7
Sat 18 Jan 2014 05:08:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43830201
Sat 18 Jan 2014 05:08:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:08:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43830201
Sat 18 Jan 2014 05:08:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:08:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:08:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:08:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:08:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:08:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:08:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:08:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:08:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:08:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:08:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:08:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:08:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:08:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:08:26 - XML: Processed 655377 elements - found 587 jobs
Sat 18 Jan 2014 05:08:26 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:08:26 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:08:26 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:08:26 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:08:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:08:31 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:08:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:08:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:08:32 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:08:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 05:08:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:08:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:08:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:08:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:08:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:08:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:08:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43835231
Sat 18 Jan 2014 05:08:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:08:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43835231
Sat 18 Jan 2014 05:08:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:08:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:08:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:08:41 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:08:41 - job_xml_thread(): Done retrieving: data size 43835231
Sat 18 Jan 2014 05:08:41 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:08:41 - XML: Start document: iteration 8
Sat 18 Jan 2014 05:08:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:08:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:08:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:08:51 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:08:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:08:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 05:08:51 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:08:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 05:08:51 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:08:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5802 values 91512 bits 11439 bytes 
Sat 18 Jan 2014 05:08:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:08:53 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:08:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:08:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:08:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:08:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:08:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:08:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:08:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:08:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:08:58 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:08:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:08:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:08:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:08:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:08:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:08:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:08:59 - XML: Processed 655378 elements - found 586 jobs
Sat 18 Jan 2014 05:08:59 - job 7348712 appears to have finished
Sat 18 Jan 2014 05:08:59 - job 7348716 appears to have finished
Sat 18 Jan 2014 05:08:59 - job_xml_thread(): Found 3 updated jobs.
Sat 18 Jan 2014 05:08:59 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 05:08:59 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Sat 18 Jan 2014 05:08:59 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:08:59 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:09:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:09:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43852679
Sat 18 Jan 2014 05:09:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:09:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43852679
Sat 18 Jan 2014 05:09:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:09:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:09:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:09:09 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:09:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 05:09:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:09:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:09:14 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:09:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:09:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:09:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:09:19 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:09:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:09:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:09:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:09:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:09:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:09:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:09:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:09:20 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:09:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:09:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:09:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:09:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:09:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:09:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:09:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:09:23 - job_xml_thread(): Done retrieving: data size 43828946
Sat 18 Jan 2014 05:09:23 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:09:23 - XML: Start document: iteration 9
Sat 18 Jan 2014 05:09:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43828946
Sat 18 Jan 2014 05:09:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:09:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43828946
Sat 18 Jan 2014 05:09:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:09:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:09:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:09:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:09:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:09:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:09:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:09:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:09:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:09:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:09:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:09:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:09:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:09:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:09:42 - XML: Processed 655378 elements - found 586 jobs
Sat 18 Jan 2014 05:09:42 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:09:42 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:09:42 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:09:42 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:09:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:09:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:09:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:09:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:09:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:09:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:09:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:09:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:09:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:09:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43831462
Sat 18 Jan 2014 05:09:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:09:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43831462
Sat 18 Jan 2014 05:09:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:09:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:09:51 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:09:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:09:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:09:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:09:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 05:09:52 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:09:52 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:09:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 05:09:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9369 values 147791 bits 18473 bytes 
Sat 18 Jan 2014 05:09:57 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:09:57 - job_xml_thread(): Done retrieving: data size 43831462
Sat 18 Jan 2014 05:09:57 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:09:57 - XML: Start document: iteration 10
Sat 18 Jan 2014 05:10:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:10:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:10:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:10:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:10:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:10:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:10:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:10:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:10:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:10:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:10:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:10:12 - XML: Processed 655378 elements - found 586 jobs
Sat 18 Jan 2014 05:10:12 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:10:13 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:10:13 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:10:13 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:10:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:10:13 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:10:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:10:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:10:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:10:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:10:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:10:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:10:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:10:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43842993
Sat 18 Jan 2014 05:10:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:10:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43842993
Sat 18 Jan 2014 05:10:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:10:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:10:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:10:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:10:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:10:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:10:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:10:28 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:10:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:10:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:10:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:10:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:10:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:10:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:10:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:10:31 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:10:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 05:10:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:10:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:10:34 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:10:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:10:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:10:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:10:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:10:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:10:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:10:36 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 05:10:36 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 05:10:36 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:10:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:10:36 - job_xml_thread(): Done retrieving: data size 43831493
Sat 18 Jan 2014 05:10:36 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:10:36 - XML: Start document: iteration 11
Sat 18 Jan 2014 05:10:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43831493
Sat 18 Jan 2014 05:10:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:10:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43831493
Sat 18 Jan 2014 05:10:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:10:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:10:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:10:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:10:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:10:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:10:52 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:10:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:10:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:10:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:10:54 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:10:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 05:10:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 05:10:54 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:10:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:10:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:10:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5882 values 92780 bits 11597 bytes 
Sat 18 Jan 2014 05:10:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:10:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:10:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:10:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:10:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:10:56 - XML: Processed 655376 elements - found 585 jobs
Sat 18 Jan 2014 05:10:56 - job 7343881 appears to have finished
Sat 18 Jan 2014 05:10:56 - job 7348719 appears to have finished
Sat 18 Jan 2014 05:10:57 - job 7348597 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 05:10:57 - job_xml_thread(): Found 4 updated jobs.
Sat 18 Jan 2014 05:10:57 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 05:10:58 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Sat 18 Jan 2014 05:10:58 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:10:58 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:11:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:11:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:11:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:11:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:11:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:11:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:11:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:11:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:11:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:11:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43849996
Sat 18 Jan 2014 05:11:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:11:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43849996
Sat 18 Jan 2014 05:11:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:11:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:11:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:11:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:11:11 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:11:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:11:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:11:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:11:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:11:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:11:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:11:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43849996
Sat 18 Jan 2014 05:11:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:11:13 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:11:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:11:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:11:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:11:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:11:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:11:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:11:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:11:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:11:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:11:25 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:11:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 05:11:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:11:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:11:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:11:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:11:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:11:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:11:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:11:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:11:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:11:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:11:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:11:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:11:29 - job_xml_thread(): Done retrieving: data size 43757055
Sat 18 Jan 2014 05:11:29 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:11:29 - XML: Start document: iteration 12
Sat 18 Jan 2014 05:11:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43757055
Sat 18 Jan 2014 05:11:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43757055
Sat 18 Jan 2014 05:11:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:11:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:11:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:11:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:11:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:11:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:11:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:11:44 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:11:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:11:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:11:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:11:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:11:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:11:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:11:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:11:46 - XML: Processed 654628 elements - found 585 jobs
Sat 18 Jan 2014 05:11:47 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:11:47 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:11:47 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:11:47 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:11:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:11:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:11:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:11:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:11:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:11:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:11:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:11:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:11:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:11:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43195265
Sat 18 Jan 2014 05:11:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:11:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43195265
Sat 18 Jan 2014 05:11:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:11:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:11:54 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:11:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:11:55 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:11:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 05:11:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 05:11:56 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:11:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9097 values 143480 bits 17935 bytes 
Sat 18 Jan 2014 05:12:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:12:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:12:02 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:12:02 - job_xml_thread(): Done retrieving: data size 43195265
Sat 18 Jan 2014 05:12:02 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:12:02 - XML: Start document: iteration 13
Sat 18 Jan 2014 05:12:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:12:02 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:12:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:12:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:12:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:12:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:12:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:12:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:12:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43195265
Sat 18 Jan 2014 05:12:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:12:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:12:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:12:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:12:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:12:20 - XML: Processed 647424 elements - found 585 jobs
Sat 18 Jan 2014 05:12:20 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:12:20 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:12:20 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:12:20 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:12:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:12:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:12:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:12:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:12:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:12:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:12:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:12:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:12:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:12:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:12:22 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:12:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:12:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:12:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:12:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:12:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:12:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:12:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:12:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43271343
Sat 18 Jan 2014 05:12:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:12:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43271343
Sat 18 Jan 2014 05:12:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:12:36 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:12:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:12:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:12:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:12:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:12:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:12:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:12:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:12:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:12:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:12:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:12:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:12:39 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:12:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 05:12:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:12:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:12:40 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:12:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:12:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:12:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:12:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:12:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:12:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:12:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:12:41 - job_xml_thread(): Done retrieving: data size 43710324
Sat 18 Jan 2014 05:12:41 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:12:41 - XML: Start document: iteration 14
Sat 18 Jan 2014 05:12:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43710324
Sat 18 Jan 2014 05:12:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:12:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43710324
Sat 18 Jan 2014 05:12:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:12:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:12:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:12:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:12:56 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:12:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:12:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:12:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:12:56 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:12:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:12:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:12:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:12:57 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:12:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 05:12:57 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:12:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 05:12:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5966 values 94092 bits 11761 bytes 
Sat 18 Jan 2014 05:12:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:12:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:12:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:12:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:12:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:12:59 - XML: Processed 653512 elements - found 583 jobs
Sat 18 Jan 2014 05:12:59 - job 7348717 appears to have finished
Sat 18 Jan 2014 05:12:59 - job 7348721 appears to have finished
Sat 18 Jan 2014 05:12:59 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 05:12:59 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 05:13:00 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 05:13:00 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:13:00 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:13:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:13:04 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:13:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:13:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:13:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:13:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:13:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:13:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:13:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:13:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43829297
Sat 18 Jan 2014 05:13:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:13:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43829297
Sat 18 Jan 2014 05:13:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:13:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:13:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:13:15 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:13:15 - job_xml_thread(): Done retrieving: data size 43829297
Sat 18 Jan 2014 05:13:15 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:13:15 - XML: Start document: iteration 15
Sat 18 Jan 2014 05:13:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:13:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:13:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:13:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:13:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:13:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:13:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:13:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:13:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:13:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:13:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:13:23 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 05:13:23 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:13:23 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:13:23 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:13:23 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 05:13:23 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 05:13:23 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 05:13:24 - XML: Processed 655372 elements - found 583 jobs
Sat 18 Jan 2014 05:13:25 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:13:25 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:13:25 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:13:25 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:13:29 - size of cluster 'LISA Cluster': 624 hosts 79482 metrics 803175 values 12669480 bits 1583685 bytes 
Sat 18 Jan 2014 05:13:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:13:29 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:13:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:13:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:13:30 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:13:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 05:13:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:13:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:13:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:13:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:13:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:13:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:13:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43807899
Sat 18 Jan 2014 05:13:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:13:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:13:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:13:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43807899
Sat 18 Jan 2014 05:13:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:13:40 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:13:40 - job_xml_thread(): Done retrieving: data size 43807899
Sat 18 Jan 2014 05:13:40 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:13:40 - XML: Start document: iteration 16
Sat 18 Jan 2014 05:13:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:13:44 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:13:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:13:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:13:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:13:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:13:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:13:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:13:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:13:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:13:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:13:53 - XML: Processed 655371 elements - found 583 jobs
Sat 18 Jan 2014 05:13:53 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:13:53 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:13:53 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:13:53 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:13:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:13:57 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:13:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:13:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:13:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:13:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:13:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:13:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:13:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:13:57 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:13:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:13:58 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:13:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 05:13:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 05:13:58 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:13:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5579 values 87931 bits 10991 bytes 
Sat 18 Jan 2014 05:14:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:14:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:14:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:14:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43824063
Sat 18 Jan 2014 05:14:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:14:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43824063
Sat 18 Jan 2014 05:14:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:14:08 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:14:08 - job_xml_thread(): Done retrieving: data size 43824063
Sat 18 Jan 2014 05:14:08 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:14:08 - XML: Start document: iteration 17
Sat 18 Jan 2014 05:14:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:14:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:14:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:14:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:14:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:14:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:14:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:14:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:14:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:14:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:14:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:14:23 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:14:23 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 05:14:25 - XML: Processed 655366 elements - found 583 jobs
Sat 18 Jan 2014 05:14:25 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:14:25 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:14:25 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:14:25 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:14:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:14:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:14:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:14:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:14:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:14:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:14:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:14:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:14:27 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:14:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 05:14:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:14:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:14:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43849717
Sat 18 Jan 2014 05:14:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:14:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43849717
Sat 18 Jan 2014 05:14:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:14:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:14:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:14:40 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:14:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:14:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:14:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:14:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:14:44 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:14:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:14:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:14:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:14:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:14:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:14:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:14:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:14:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:14:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:14:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:14:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:14:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:14:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:14:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:14:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:14:48 - job_xml_thread(): Done retrieving: data size 43838260
Sat 18 Jan 2014 05:14:48 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:14:48 - XML: Start document: iteration 18
Sat 18 Jan 2014 05:14:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43838260
Sat 18 Jan 2014 05:14:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:14:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43838260
Sat 18 Jan 2014 05:14:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:15:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:15:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:15:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:15:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:15:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:15:01 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:15:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:15:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 05:15:02 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:15:02 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:15:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 05:15:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8044 values 126834 bits 15854 bytes 
Sat 18 Jan 2014 05:15:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:15:07 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:15:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:15:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:15:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:15:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:15:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:15:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:15:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:15:10 - XML: Processed 655372 elements - found 583 jobs
Sat 18 Jan 2014 05:15:10 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:15:10 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:15:10 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:15:10 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:15:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:15:12 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:15:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:15:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:15:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:15:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:15:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:15:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:15:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:15:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43836278
Sat 18 Jan 2014 05:15:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:15:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43836278
Sat 18 Jan 2014 05:15:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:15:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:15:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:15:25 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:15:25 - job_xml_thread(): Done retrieving: data size 43836278
Sat 18 Jan 2014 05:15:25 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:15:25 - XML: Start document: iteration 19
Sat 18 Jan 2014 05:15:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:15:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:15:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:15:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:15:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:15:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:15:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:15:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:15:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:15:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:15:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:15:36 - XML: Processed 655369 elements - found 583 jobs
Sat 18 Jan 2014 05:15:36 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:15:36 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:15:36 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:15:36 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:15:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:15:38 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:15:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:15:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:15:38 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:15:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 05:15:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:15:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:15:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:15:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:15:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:15:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:15:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43842038
Sat 18 Jan 2014 05:15:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:15:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43842038
Sat 18 Jan 2014 05:15:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:15:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:15:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:15:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:15:50 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:15:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:15:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:15:51 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:15:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:15:51 - job_xml_thread(): Done retrieving: data size 43842038
Sat 18 Jan 2014 05:15:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:15:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:15:51 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:15:51 - XML: Start document: iteration 20
Sat 18 Jan 2014 05:15:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:15:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:15:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:15:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:16:02 - XML: Processed 655372 elements - found 583 jobs
Sat 18 Jan 2014 05:16:02 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:16:02 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:16:02 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:16:02 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:16:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:16:03 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:16:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:16:03 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:16:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 05:16:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 05:16:03 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:16:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5672 values 89419 bits 11177 bytes 
Sat 18 Jan 2014 05:16:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:16:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:16:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:16:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:16:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:16:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:16:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:16:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:16:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:16:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:16:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:16:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43819949
Sat 18 Jan 2014 05:16:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:16:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43819949
Sat 18 Jan 2014 05:16:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:16:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:16:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:16:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:16:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:16:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:16:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:16:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:16:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43819949
Sat 18 Jan 2014 05:16:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:16:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:16:17 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:16:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:16:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:16:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:16:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:16:29 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:16:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:16:30 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:16:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:16:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:16:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:16:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:16:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:16:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:16:30 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:16:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 05:16:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:16:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:16:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:16:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:16:32 - job_xml_thread(): Done retrieving: data size 43813769
Sat 18 Jan 2014 05:16:32 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:16:32 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 05:16:32 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 05:16:32 - Housekeeping: done.
Sat 18 Jan 2014 05:16:32 - XML: Start document: iteration 0
Sat 18 Jan 2014 05:16:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:16:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:16:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:16:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43813769
Sat 18 Jan 2014 05:16:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:16:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:16:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43813769
Sat 18 Jan 2014 05:16:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:16:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:16:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:16:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:16:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:16:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:16:50 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:16:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:16:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:16:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:16:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:16:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:16:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:16:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:16:52 - XML: Processed 655372 elements - found 583 jobs
Sat 18 Jan 2014 05:16:52 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:16:52 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:16:52 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:16:52 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:16:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:16:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:16:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:16:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:16:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:16:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:16:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:16:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:16:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:16:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43880573
Sat 18 Jan 2014 05:16:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:16:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43880573
Sat 18 Jan 2014 05:16:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:17:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:17:03 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:17:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:17:04 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:17:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 05:17:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 05:17:04 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:17:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8852 values 139891 bits 17486 bytes 
Sat 18 Jan 2014 05:17:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:17:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:17:07 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:17:07 - job_xml_thread(): Done retrieving: data size 43880573
Sat 18 Jan 2014 05:17:07 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:17:07 - XML: Start document: iteration 1
Sat 18 Jan 2014 05:17:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:17:10 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:17:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:17:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:17:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:17:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:17:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:17:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:17:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:17:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:17:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:17:17 - XML: Processed 655372 elements - found 583 jobs
Sat 18 Jan 2014 05:17:17 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:17:17 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:17:17 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:17:17 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:17:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:17:18 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:17:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:17:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:17:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:17:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:17:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:17:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:17:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:17:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43774263
Sat 18 Jan 2014 05:17:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:17:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43774263
Sat 18 Jan 2014 05:17:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:17:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:17:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:17:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:17:30 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:17:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:17:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:17:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:17:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:17:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:17:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:17:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43774263
Sat 18 Jan 2014 05:17:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:17:32 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:17:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:17:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:17:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:17:40 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:17:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 05:17:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:17:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:17:43 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:17:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:17:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:17:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:17:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:17:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:17:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:17:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:17:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:17:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:17:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:17:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:17:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:17:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:17:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:17:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:17:47 - job_xml_thread(): Done retrieving: data size 43275030
Sat 18 Jan 2014 05:17:47 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:17:47 - XML: Start document: iteration 2
Sat 18 Jan 2014 05:17:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43275030
Sat 18 Jan 2014 05:17:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:17:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43275030
Sat 18 Jan 2014 05:17:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:18:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:18:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:18:00 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:18:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:18:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:18:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:18:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:18:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:18:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:18:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:18:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:18:04 - XML: Processed 648652 elements - found 583 jobs
Sat 18 Jan 2014 05:18:04 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:18:04 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:18:04 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:18:04 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:18:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:18:04 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:18:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:18:05 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:18:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 05:18:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 05:18:05 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:18:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6157 values 97424 bits 12178 bytes 
Sat 18 Jan 2014 05:18:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:18:10 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:18:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:18:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:18:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:18:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:18:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:18:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:18:12 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 05:18:12 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 05:18:12 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:18:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:18:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43191412
Sat 18 Jan 2014 05:18:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:18:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43191412
Sat 18 Jan 2014 05:18:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:18:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:18:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:18:19 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:18:19 - job_xml_thread(): Done retrieving: data size 43191412
Sat 18 Jan 2014 05:18:19 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:18:19 - XML: Start document: iteration 3
Sat 18 Jan 2014 05:18:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:18:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:18:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:18:29 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:18:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:18:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:18:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:18:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:18:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:18:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:18:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:18:32 - XML: Processed 647230 elements - found 583 jobs
Sat 18 Jan 2014 05:18:32 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:18:32 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:18:32 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:18:32 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:18:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:18:35 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:18:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:18:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:18:35 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:18:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 05:18:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:18:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:18:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:18:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:18:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:18:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:18:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43616990
Sat 18 Jan 2014 05:18:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:18:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43616990
Sat 18 Jan 2014 05:18:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:18:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:18:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:18:47 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:18:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:18:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:18:49 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:18:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:18:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:18:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:18:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:18:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:18:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:18:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:18:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:18:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:18:52 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:18:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:18:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:18:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:18:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:18:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:18:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:18:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:18:54 - job_xml_thread(): Done retrieving: data size 43807306
Sat 18 Jan 2014 05:18:54 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:18:54 - XML: Start document: iteration 4
Sat 18 Jan 2014 05:18:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43807306
Sat 18 Jan 2014 05:18:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:18:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43807306
Sat 18 Jan 2014 05:18:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:19:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:19:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:19:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:19:05 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:19:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:19:06 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:19:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 05:19:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 05:19:06 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:19:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9129 values 144096 bits 18012 bytes 
Sat 18 Jan 2014 05:19:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:19:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:19:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:19:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:19:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:19:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:19:12 - XML: Processed 654744 elements - found 581 jobs
Sat 18 Jan 2014 05:19:12 - job 7348718 appears to have finished
Sat 18 Jan 2014 05:19:12 - job 7348722 appears to have finished
Sat 18 Jan 2014 05:19:12 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 05:19:12 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 05:19:13 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 05:19:13 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:19:13 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:19:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:19:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:19:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:19:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:19:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:19:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:19:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:19:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:19:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:19:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:19:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:19:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:19:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:19:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:19:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43832068
Sat 18 Jan 2014 05:19:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:19:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43832068
Sat 18 Jan 2014 05:19:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:19:28 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:19:28 - job_xml_thread(): Done retrieving: data size 43832068
Sat 18 Jan 2014 05:19:28 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:19:28 - XML: Start document: iteration 5
Sat 18 Jan 2014 05:19:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:19:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:19:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:19:33 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:19:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:19:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:19:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:19:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:19:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:19:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:19:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:19:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:19:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:19:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:19:42 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:19:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:19:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:19:43 - XML: Processed 655368 elements - found 581 jobs
Sat 18 Jan 2014 05:19:43 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:19:43 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:19:43 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:19:43 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:19:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:19:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:19:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:19:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:19:43 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:19:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 05:19:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:19:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:19:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43810834
Sat 18 Jan 2014 05:19:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:19:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43810834
Sat 18 Jan 2014 05:19:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:19:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:19:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:19:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:19:56 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:19:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:19:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:19:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:19:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:19:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:19:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:19:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:19:58 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:19:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:19:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:19:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:19:59 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:19:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:19:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:20:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:20:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:20:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:20:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:20:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:20:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43842274
Sat 18 Jan 2014 05:20:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:20:01 - job_xml_thread(): Done retrieving: data size 43842274
Sat 18 Jan 2014 05:20:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43842274
Sat 18 Jan 2014 05:20:01 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:20:01 - XML: Start document: iteration 6
Sat 18 Jan 2014 05:20:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:20:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:20:06 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:20:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:20:08 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:20:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 05:20:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 05:20:08 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:20:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8945 values 141106 bits 17638 bytes 
Sat 18 Jan 2014 05:20:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:20:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:20:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:20:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:20:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:20:18 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:20:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:20:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:20:19 - XML: Processed 655368 elements - found 581 jobs
Sat 18 Jan 2014 05:20:19 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:20:19 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:20:19 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:20:19 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:20:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:20:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:20:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:20:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:20:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:20:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:20:22 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:20:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:20:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:20:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:20:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:20:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:20:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:20:23 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 05:20:23 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:20:24 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:20:24 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 05:20:24 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:20:24 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 05:20:24 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 05:20:25 - size of cluster 'LISA Cluster': 624 hosts 79472 metrics 754059 values 11913353 bits 1489169 bytes 
Sat 18 Jan 2014 05:20:25 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:20:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 05:20:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:20:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:20:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43857071
Sat 18 Jan 2014 05:20:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:20:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43857071
Sat 18 Jan 2014 05:20:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:20:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:20:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:20:34 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:20:35 - job_xml_thread(): Done retrieving: data size 43857071
Sat 18 Jan 2014 05:20:35 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:20:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:20:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:20:35 - XML: Start document: iteration 7
Sat 18 Jan 2014 05:20:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:20:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:20:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:20:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:20:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:20:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:20:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:20:46 - XML: Processed 655366 elements - found 580 jobs
Sat 18 Jan 2014 05:20:46 - job 7348723 appears to have finished
Sat 18 Jan 2014 05:20:46 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 05:20:46 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 05:20:46 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 05:20:46 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:20:46 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:20:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:20:49 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:20:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:20:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:20:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:20:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:20:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:20:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:20:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:20:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43823200
Sat 18 Jan 2014 05:20:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:20:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:20:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:20:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43823200
Sat 18 Jan 2014 05:20:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:21:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:21:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:21:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:21:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:21:01 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:21:01 - job_xml_thread(): Done retrieving: data size 43823200
Sat 18 Jan 2014 05:21:01 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:21:01 - XML: Start document: iteration 8
Sat 18 Jan 2014 05:21:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:21:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:21:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:21:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43823200
Sat 18 Jan 2014 05:21:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:21:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:21:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:21:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:21:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:21:08 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:21:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:21:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 05:21:09 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:21:09 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:21:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 05:21:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6128 values 96709 bits 12088 bytes 
Sat 18 Jan 2014 05:21:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:21:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:21:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:21:19 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:21:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:21:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:21:21 - XML: Processed 655366 elements - found 580 jobs
Sat 18 Jan 2014 05:21:21 - job 7348598 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 05:21:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:21:21 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 05:21:21 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 05:21:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:21:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:21:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:21:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:21:21 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 05:21:21 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:21:21 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:21:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:21:23 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:21:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:21:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:21:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:21:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:21:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:21:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:21:24 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:21:24 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 05:21:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:21:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43865079
Sat 18 Jan 2014 05:21:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:21:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43865079
Sat 18 Jan 2014 05:21:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:21:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:21:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:21:36 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:21:37 - job_xml_thread(): Done retrieving: data size 43865079
Sat 18 Jan 2014 05:21:37 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:21:37 - XML: Start document: iteration 9
Sat 18 Jan 2014 05:21:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:21:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:21:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:21:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:21:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:21:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:21:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:21:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:21:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:21:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:21:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:21:49 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:21:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 05:21:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:21:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:21:50 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:21:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:21:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:21:51 - XML: Processed 655366 elements - found 580 jobs
Sat 18 Jan 2014 05:21:51 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:21:51 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:21:51 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:21:51 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:21:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:21:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:21:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:21:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:21:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:21:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43834593
Sat 18 Jan 2014 05:21:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:21:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43834593
Sat 18 Jan 2014 05:21:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:21:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:21:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:22:06 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:22:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:22:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:22:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:22:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:22:07 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:22:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:22:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:22:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:22:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:22:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:22:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:22:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:22:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:22:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:22:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:22:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:22:09 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:22:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:22:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:22:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:22:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:22:10 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:22:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:22:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 05:22:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 05:22:10 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:22:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5894 values 92952 bits 11619 bytes 
Sat 18 Jan 2014 05:22:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:22:12 - job_xml_thread(): Done retrieving: data size 43861544
Sat 18 Jan 2014 05:22:12 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:22:12 - XML: Start document: iteration 10
Sat 18 Jan 2014 05:22:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43861544
Sat 18 Jan 2014 05:22:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:22:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43861544
Sat 18 Jan 2014 05:22:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:22:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:22:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:22:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:22:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:22:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:22:30 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:22:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:22:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:22:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:22:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:22:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:22:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:22:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:22:34 - XML: Processed 655366 elements - found 580 jobs
Sat 18 Jan 2014 05:22:34 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:22:34 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:22:34 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:22:34 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:22:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:22:37 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:22:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:22:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:22:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:22:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:22:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:22:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:22:38 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:22:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 05:22:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:22:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:22:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43845932
Sat 18 Jan 2014 05:22:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:22:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43845932
Sat 18 Jan 2014 05:22:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:22:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:22:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:22:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:22:49 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:22:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:22:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:22:49 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:22:50 - job_xml_thread(): Done retrieving: data size 43845932
Sat 18 Jan 2014 05:22:50 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:22:50 - XML: Start document: iteration 11
Sat 18 Jan 2014 05:22:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:22:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:22:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:22:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:22:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:22:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:22:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:23:01 - XML: Processed 655364 elements - found 579 jobs
Sat 18 Jan 2014 05:23:01 - job 7343923 appears to have finished
Sat 18 Jan 2014 05:23:01 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 05:23:01 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 05:23:02 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 05:23:02 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:23:02 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:23:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:23:04 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:23:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:23:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:23:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:23:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:23:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:23:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:23:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:23:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:23:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:23:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43815180
Sat 18 Jan 2014 05:23:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:23:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43815180
Sat 18 Jan 2014 05:23:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:23:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:23:10 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:23:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:23:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 05:23:11 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:23:11 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:23:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 05:23:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8162 values 128734 bits 16091 bytes 
Sat 18 Jan 2014 05:23:17 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:23:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:23:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:23:18 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:23:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:23:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:23:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:23:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:23:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:23:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:23:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:23:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:23:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:23:22 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:23:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:23:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:23:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:23:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:23:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:23:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:23:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:23:25 - job_xml_thread(): Done retrieving: data size 43780558
Sat 18 Jan 2014 05:23:25 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:23:25 - XML: Start document: iteration 12
Sat 18 Jan 2014 05:23:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43780558
Sat 18 Jan 2014 05:23:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:23:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43780558
Sat 18 Jan 2014 05:23:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:23:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:23:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:23:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:23:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:23:44 - XML: Processed 654616 elements - found 579 jobs
Sat 18 Jan 2014 05:23:45 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:23:45 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:23:45 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:23:45 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:23:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:23:47 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:23:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:23:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:23:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:23:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:23:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:23:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:23:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:23:49 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:23:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 05:23:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:23:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:23:49 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:23:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:23:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:23:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:23:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:23:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:23:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:23:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:23:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43196838
Sat 18 Jan 2014 05:23:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:23:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43196838
Sat 18 Jan 2014 05:23:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:24:00 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:24:00 - job_xml_thread(): Done retrieving: data size 43196838
Sat 18 Jan 2014 05:24:01 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:24:01 - XML: Start document: iteration 13
Sat 18 Jan 2014 05:24:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:24:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:24:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:24:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:24:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:24:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:24:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:24:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:24:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:24:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:24:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:24:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:24:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:24:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:24:11 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:24:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:24:12 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:24:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 05:24:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 05:24:12 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:24:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6114 values 96423 bits 12052 bytes 
Sat 18 Jan 2014 05:24:16 - XML: Processed 647330 elements - found 579 jobs
Sat 18 Jan 2014 05:24:16 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:24:16 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:24:16 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:24:16 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:24:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:24:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:24:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:24:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:24:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:24:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:24:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:24:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:24:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:24:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:24:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:24:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43212124
Sat 18 Jan 2014 05:24:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:24:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43212124
Sat 18 Jan 2014 05:24:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:24:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:24:29 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:24:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:24:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:24:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:24:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:24:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43212124
Sat 18 Jan 2014 05:24:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:24:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:24:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:24:31 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:24:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:24:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:24:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:24:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:24:42 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:24:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:24:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:24:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:24:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:24:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:24:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:24:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:24:44 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:24:44 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:24:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 05:24:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:24:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:24:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:24:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:24:46 - job_xml_thread(): Done retrieving: data size 43732141
Sat 18 Jan 2014 05:24:46 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:24:46 - XML: Start document: iteration 14
Sat 18 Jan 2014 05:24:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43732141
Sat 18 Jan 2014 05:24:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:24:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:24:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:24:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43732141
Sat 18 Jan 2014 05:24:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:24:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:24:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:24:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:24:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:25:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:25:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:25:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:25:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:25:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:25:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:25:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:25:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:25:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:25:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:25:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:25:09 - XML: Processed 654216 elements - found 578 jobs
Sat 18 Jan 2014 05:25:09 - job 7348739 appears to have finished
Sat 18 Jan 2014 05:25:09 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 05:25:09 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 05:25:10 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 05:25:10 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:25:10 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:25:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:25:11 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:25:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:25:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:25:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:25:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:25:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:25:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:25:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:25:12 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:25:13 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:25:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 05:25:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:25:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 05:25:13 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:25:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5793 values 91339 bits 11417 bytes 
Sat 18 Jan 2014 05:25:13 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 05:25:13 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 05:25:13 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:25:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:25:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43846148
Sat 18 Jan 2014 05:25:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:25:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43846148
Sat 18 Jan 2014 05:25:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:25:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:25:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:25:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:25:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:25:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:25:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:25:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:25:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:25:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:25:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:25:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:25:25 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:25:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:25:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:25:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:25:28 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:25:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:25:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:25:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:25:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:25:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:25:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:25:30 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:25:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 05:25:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:25:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:25:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43852775
Sat 18 Jan 2014 05:25:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:25:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43852775
Sat 18 Jan 2014 05:25:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:25:31 - job_xml_thread(): Done retrieving: data size 43852775
Sat 18 Jan 2014 05:25:31 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:25:31 - XML: Start document: iteration 15
Sat 18 Jan 2014 05:25:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:25:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:25:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:25:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:25:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:25:45 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:25:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:25:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:25:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:25:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:25:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:25:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:25:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:25:49 - XML: Processed 655359 elements - found 578 jobs
Sat 18 Jan 2014 05:25:49 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:25:49 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:25:49 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:25:49 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:25:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:25:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:25:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:25:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:25:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:25:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:25:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:25:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:25:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:25:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43833438
Sat 18 Jan 2014 05:25:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:25:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43833438
Sat 18 Jan 2014 05:25:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:26:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:26:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:26:04 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:26:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:26:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:26:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:26:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:26:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:26:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:26:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:26:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:26:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:26:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:26:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:26:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:26:07 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:26:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:26:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:26:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:26:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:26:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:26:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:26:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:26:09 - job_xml_thread(): Done retrieving: data size 43845965
Sat 18 Jan 2014 05:26:09 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:26:09 - XML: Start document: iteration 16
Sat 18 Jan 2014 05:26:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43845965
Sat 18 Jan 2014 05:26:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:26:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43845965
Sat 18 Jan 2014 05:26:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:26:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:26:13 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:26:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:26:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 05:26:15 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:26:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 10498 values 165551 bits 20693 bytes 
Sat 18 Jan 2014 05:26:15 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:26:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 05:26:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:26:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:26:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:26:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:26:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:26:25 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:26:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:26:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:26:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:26:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:26:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:26:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:26:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:26:28 - XML: Processed 655362 elements - found 578 jobs
Sat 18 Jan 2014 05:26:29 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:26:29 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:26:29 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:26:29 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:26:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:26:31 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:26:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:26:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:26:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:26:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:26:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:26:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:26:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:26:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43828687
Sat 18 Jan 2014 05:26:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:26:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43828687
Sat 18 Jan 2014 05:26:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:26:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:26:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:26:44 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:26:44 - job_xml_thread(): Done retrieving: data size 43828687
Sat 18 Jan 2014 05:26:44 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:26:44 - XML: Start document: iteration 17
Sat 18 Jan 2014 05:26:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:26:47 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:26:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:26:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:26:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:26:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:26:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:26:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:26:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:26:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:26:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:26:56 - XML: Processed 655356 elements - found 575 jobs
Sat 18 Jan 2014 05:26:56 - job 7348724 appears to have finished
Sat 18 Jan 2014 05:26:56 - job 7348727 appears to have finished
Sat 18 Jan 2014 05:26:56 - job 7348725 appears to have finished
Sat 18 Jan 2014 05:26:56 - job_xml_thread(): Found 3 updated jobs.
Sat 18 Jan 2014 05:26:56 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 05:26:57 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Sat 18 Jan 2014 05:26:57 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:26:57 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:26:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:26:57 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:26:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:26:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:26:57 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:26:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 05:26:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:26:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:26:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:26:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:26:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:26:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:26:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43844232
Sat 18 Jan 2014 05:26:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:26:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43844232
Sat 18 Jan 2014 05:27:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:27:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:27:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:27:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:27:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:27:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:27:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:27:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:27:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:27:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:27:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43844232
Sat 18 Jan 2014 05:27:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:27:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:27:12 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:27:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:27:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:27:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:27:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:27:16 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:27:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:27:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 05:27:17 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:27:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 05:27:17 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:27:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5775 values 91035 bits 11379 bytes 
Sat 18 Jan 2014 05:27:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:27:20 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:27:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:27:21 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:27:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:27:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:27:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:27:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:27:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:27:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:27:23 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:27:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 05:27:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:27:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:27:23 - job_xml_thread(): Done retrieving: data size 43826895
Sat 18 Jan 2014 05:27:23 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:27:23 - XML: Start document: iteration 18
Sat 18 Jan 2014 05:27:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:27:24 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 05:27:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43826895
Sat 18 Jan 2014 05:27:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:27:24 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:27:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:27:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:27:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:27:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:27:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:27:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43826895
Sat 18 Jan 2014 05:27:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:27:26 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:27:26 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:27:26 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 05:27:26 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 05:27:26 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 05:27:29 - size of cluster 'LISA Cluster': 624 hosts 79467 metrics 758929 values 11969646 bits 1496205 bytes 
Sat 18 Jan 2014 05:27:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:27:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:27:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:27:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:27:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:27:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:27:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:27:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:27:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:27:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:27:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:27:43 - XML: Processed 655356 elements - found 575 jobs
Sat 18 Jan 2014 05:27:43 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:27:43 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:27:43 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:27:43 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:27:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:27:46 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:27:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:27:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:27:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:27:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:27:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:27:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:27:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:27:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43831150
Sat 18 Jan 2014 05:27:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:27:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43831150
Sat 18 Jan 2014 05:27:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:27:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:27:58 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:27:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:27:58 - job_xml_thread(): Done retrieving: data size 43831150
Sat 18 Jan 2014 05:27:58 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:27:58 - XML: Start document: iteration 19
Sat 18 Jan 2014 05:28:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:28:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:28:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:28:02 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:28:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:28:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:28:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:28:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:28:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:28:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:28:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:28:11 - XML: Processed 655354 elements - found 575 jobs
Sat 18 Jan 2014 05:28:11 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:28:11 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:28:11 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:28:11 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:28:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:28:13 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:28:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:28:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:28:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:28:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:28:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:28:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:28:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:28:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43823128
Sat 18 Jan 2014 05:28:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:28:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43823128
Sat 18 Jan 2014 05:28:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:28:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:28:18 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:28:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:28:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:28:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:28:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 05:28:19 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:28:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 05:28:19 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:28:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9268 values 146210 bits 18276 bytes 
Sat 18 Jan 2014 05:28:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:28:25 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:28:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:28:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:28:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:28:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:28:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:28:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:28:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:28:26 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:28:26 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 05:28:27 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:28:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:28:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:28:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:28:30 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:28:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:28:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:28:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:28:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:28:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:28:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:28:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:28:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43829953
Sat 18 Jan 2014 05:28:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:28:35 - job_xml_thread(): Done retrieving: data size 43829953
Sat 18 Jan 2014 05:28:35 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:28:35 - XML: Start document: iteration 20
Sat 18 Jan 2014 05:28:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43829953
Sat 18 Jan 2014 05:28:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:28:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:28:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:28:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:28:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:28:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:28:53 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:28:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:28:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:28:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:28:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:28:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:28:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:28:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:28:55 - XML: Processed 655352 elements - found 573 jobs
Sat 18 Jan 2014 05:28:55 - job 7348741 appears to have finished
Sat 18 Jan 2014 05:28:55 - job 7348740 appears to have finished
Sat 18 Jan 2014 05:28:55 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 05:28:55 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 05:28:56 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 05:28:56 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:28:56 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:28:57 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:28:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 05:28:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:28:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:28:59 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:28:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:28:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:29:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:29:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:29:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:29:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:29:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:29:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43834203
Sat 18 Jan 2014 05:29:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:29:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43834203
Sat 18 Jan 2014 05:29:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:29:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:29:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:29:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:29:10 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:29:11 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:29:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:29:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:29:11 - job_xml_thread(): Done retrieving: data size 43834203
Sat 18 Jan 2014 05:29:11 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:29:11 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 05:29:11 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 05:29:11 - Housekeeping: done.
Sat 18 Jan 2014 05:29:11 - XML: Start document: iteration 0
Sat 18 Jan 2014 05:29:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:29:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:29:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:29:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:29:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:29:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:29:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:29:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:29:19 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:29:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:29:20 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:29:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 05:29:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 05:29:20 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:29:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5748 values 90601 bits 11325 bytes 
Sat 18 Jan 2014 05:29:22 - XML: Processed 655352 elements - found 573 jobs
Sat 18 Jan 2014 05:29:22 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:29:22 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:29:22 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:29:22 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:29:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:29:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:29:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:29:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:29:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:29:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:29:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:29:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:29:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:29:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:29:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:29:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43754722
Sat 18 Jan 2014 05:29:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:29:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43754722
Sat 18 Jan 2014 05:29:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:29:37 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:29:37 - job_xml_thread(): Done retrieving: data size 43754722
Sat 18 Jan 2014 05:29:37 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:29:37 - XML: Start document: iteration 1
Sat 18 Jan 2014 05:29:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:29:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:29:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:29:43 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:29:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:29:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:29:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:29:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:29:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:29:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:29:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:29:48 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:29:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 05:29:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:29:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:29:49 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:29:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:29:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:29:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:29:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:29:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:29:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:29:53 - XML: Processed 654604 elements - found 573 jobs
Sat 18 Jan 2014 05:29:53 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:29:53 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:29:53 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:29:53 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:29:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:29:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43222914
Sat 18 Jan 2014 05:29:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:29:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43222914
Sat 18 Jan 2014 05:29:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:29:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:29:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:30:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:30:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:30:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:30:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:30:08 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:30:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:30:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:30:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:30:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:30:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:30:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:30:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:30:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:30:12 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:30:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:30:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:30:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:30:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:30:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:30:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:30:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:30:15 - job_xml_thread(): Done retrieving: data size 43214290
Sat 18 Jan 2014 05:30:15 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:30:15 - XML: Start document: iteration 2
Sat 18 Jan 2014 05:30:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43214290
Sat 18 Jan 2014 05:30:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:30:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43214290
Sat 18 Jan 2014 05:30:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:30:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:30:21 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:30:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:30:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 05:30:22 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:30:22 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:30:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 05:30:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8834 values 139319 bits 17414 bytes 
Sat 18 Jan 2014 05:30:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:30:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:30:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:30:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:30:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:30:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:30:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:30:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:30:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:30:38 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:30:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:30:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:30:39 - XML: Processed 647606 elements - found 573 jobs
Sat 18 Jan 2014 05:30:39 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:30:39 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:30:39 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:30:39 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:30:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:30:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:30:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:30:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:30:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:30:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:30:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:30:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:30:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:30:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:30:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43663686
Sat 18 Jan 2014 05:30:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:30:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43663686
Sat 18 Jan 2014 05:30:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:30:46 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:30:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 05:30:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:30:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:30:53 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:30:54 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:30:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:30:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:30:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:30:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:30:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:30:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:30:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:30:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:30:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:30:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:30:57 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:30:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:30:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:30:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:30:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:30:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:30:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:31:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:31:00 - job_xml_thread(): Done retrieving: data size 43835032
Sat 18 Jan 2014 05:31:00 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:31:00 - XML: Start document: iteration 3
Sat 18 Jan 2014 05:31:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43835032
Sat 18 Jan 2014 05:31:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:31:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43835032
Sat 18 Jan 2014 05:31:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:31:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:31:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:31:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:31:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:31:18 - XML: Processed 655340 elements - found 573 jobs
Sat 18 Jan 2014 05:31:18 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:31:18 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:31:18 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:31:18 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:31:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:31:20 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:31:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:31:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:31:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:31:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:31:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:31:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:31:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:31:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:31:22 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:31:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:31:22 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:31:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 05:31:22 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:31:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 05:31:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6248 values 98615 bits 12326 bytes 
Sat 18 Jan 2014 05:31:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:31:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:31:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:31:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:31:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:31:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:31:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:31:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:31:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:31:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43849486
Sat 18 Jan 2014 05:31:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:31:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43849486
Sat 18 Jan 2014 05:31:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:31:33 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:31:33 - job_xml_thread(): Done retrieving: data size 43849486
Sat 18 Jan 2014 05:31:33 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:31:33 - XML: Start document: iteration 4
Sat 18 Jan 2014 05:31:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:31:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:31:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:31:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:31:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:31:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:31:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:31:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:31:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:31:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:31:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:31:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:31:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:31:50 - XML: Processed 655352 elements - found 573 jobs
Sat 18 Jan 2014 05:31:50 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:31:50 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:31:50 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:31:50 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:31:50 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:31:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 05:31:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:31:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:31:52 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:31:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:31:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:31:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:31:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:31:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:31:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:31:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:31:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43824124
Sat 18 Jan 2014 05:31:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:31:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43824124
Sat 18 Jan 2014 05:31:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:31:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:31:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:32:05 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:32:05 - job_xml_thread(): Done retrieving: data size 43824124
Sat 18 Jan 2014 05:32:05 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:32:05 - XML: Start document: iteration 5
Sat 18 Jan 2014 05:32:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:32:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:32:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:32:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:32:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:32:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:32:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:32:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:32:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:32:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:32:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:32:17 - XML: Processed 655352 elements - found 573 jobs
Sat 18 Jan 2014 05:32:17 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:32:17 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:32:17 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:32:17 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:32:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:32:19 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:32:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:32:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:32:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:32:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:32:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:32:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:32:22 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 05:32:22 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 05:32:22 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:32:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:32:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43832712
Sat 18 Jan 2014 05:32:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:32:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:32:23 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:32:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43832712
Sat 18 Jan 2014 05:32:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:32:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:32:24 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:32:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 05:32:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 05:32:24 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:32:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8831 values 139635 bits 17454 bytes 
Sat 18 Jan 2014 05:32:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:32:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:32:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:32:31 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:32:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:32:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:32:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:32:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:32:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:32:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:32:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43832712
Sat 18 Jan 2014 05:32:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:32:32 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:32:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:32:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:32:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:32:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:32:44 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:32:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:32:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:32:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:32:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:32:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:32:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:32:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:32:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:32:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:32:46 - job_xml_thread(): Done retrieving: data size 43810622
Sat 18 Jan 2014 05:32:46 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:32:46 - XML: Start document: iteration 6
Sat 18 Jan 2014 05:32:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:32:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:32:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43810622
Sat 18 Jan 2014 05:32:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:32:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:32:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:32:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:32:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:32:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43810622
Sat 18 Jan 2014 05:32:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:33:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:33:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:33:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:33:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:33:03 - XML: Processed 655338 elements - found 566 jobs
Sat 18 Jan 2014 05:33:03 - job 7348771 appears to have finished
Sat 18 Jan 2014 05:33:03 - job 7348742 appears to have finished
Sat 18 Jan 2014 05:33:03 - job 7348743 appears to have finished
Sat 18 Jan 2014 05:33:03 - job 7348747 appears to have finished
Sat 18 Jan 2014 05:33:04 - job 7348728 appears to have finished
Sat 18 Jan 2014 05:33:04 - job 7348729 appears to have finished
Sat 18 Jan 2014 05:33:04 - job 7348772 appears to have finished
Sat 18 Jan 2014 05:33:04 - job_xml_thread(): Found 7 updated jobs.
Sat 18 Jan 2014 05:33:04 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 05:33:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:33:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:33:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:33:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:33:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:33:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:33:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:33:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:33:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:33:07 - job_xml_thread(): Done storing. succesfully stored: 7 jobs
Sat 18 Jan 2014 05:33:07 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:33:07 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:33:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:33:10 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:33:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:33:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:33:10 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:33:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 05:33:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:33:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:33:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:33:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:33:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:33:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:33:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43857188
Sat 18 Jan 2014 05:33:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:33:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43857188
Sat 18 Jan 2014 05:33:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:33:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:33:20 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:33:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:33:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:33:23 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:33:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:33:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:33:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:33:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:33:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:33:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:33:25 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:33:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:33:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:33:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:33:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:33:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:33:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:33:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:33:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:33:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:33:26 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:33:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 05:33:26 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:33:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 05:33:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6018 values 95118 bits 11889 bytes 
Sat 18 Jan 2014 05:33:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:33:26 - job_xml_thread(): Done retrieving: data size 43857464
Sat 18 Jan 2014 05:33:26 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:33:26 - XML: Start document: iteration 7
Sat 18 Jan 2014 05:33:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43857464
Sat 18 Jan 2014 05:33:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:33:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43857464
Sat 18 Jan 2014 05:33:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:33:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:33:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:33:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:33:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:33:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:33:44 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:33:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:33:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:33:45 - XML: Processed 655335 elements - found 566 jobs
Sat 18 Jan 2014 05:33:45 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:33:45 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:33:45 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:33:45 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:33:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:33:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:33:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:33:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:33:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:33:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:33:48 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:33:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:33:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:33:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:33:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:33:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:33:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:33:50 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:33:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 05:33:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:33:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:33:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43844067
Sat 18 Jan 2014 05:33:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:33:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43844067
Sat 18 Jan 2014 05:33:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:34:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:34:00 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:34:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:34:00 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:34:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:34:00 - job_xml_thread(): Done retrieving: data size 43844067
Sat 18 Jan 2014 05:34:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:34:00 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:34:00 - XML: Start document: iteration 8
Sat 18 Jan 2014 05:34:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:34:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:34:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:34:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:34:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:34:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:34:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:34:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:34:12 - XML: Processed 655338 elements - found 566 jobs
Sat 18 Jan 2014 05:34:12 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:34:12 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:34:12 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:34:13 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:34:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:34:13 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:34:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:34:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:34:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:34:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:34:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:34:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:34:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:34:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43814217
Sat 18 Jan 2014 05:34:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:34:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43814217
Sat 18 Jan 2014 05:34:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:34:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:34:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:34:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:34:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:34:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:34:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:34:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:34:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:34:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:34:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:34:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:34:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:34:26 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:34:27 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 05:34:27 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:34:27 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:34:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:34:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:34:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 05:34:27 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:34:27 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:34:27 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:34:27 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 05:34:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 05:34:27 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:34:27 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 05:34:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7000 values 110405 bits 13800 bytes 
Sat 18 Jan 2014 05:34:27 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 05:34:28 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:34:28 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 780408 values 12329402 bits 1541175 bytes 
Sat 18 Jan 2014 05:34:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:34:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:34:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:34:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:34:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:34:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:34:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:34:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43830206
Sat 18 Jan 2014 05:34:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:34:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43830206
Sat 18 Jan 2014 05:34:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:34:33 - job_xml_thread(): Done retrieving: data size 43830206
Sat 18 Jan 2014 05:34:33 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:34:33 - XML: Start document: iteration 9
Sat 18 Jan 2014 05:34:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:34:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:34:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:34:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:34:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:34:52 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:34:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:34:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:34:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:34:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:34:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:34:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:34:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:34:53 - XML: Processed 655338 elements - found 566 jobs
Sat 18 Jan 2014 05:34:53 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:34:53 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:34:53 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:34:53 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:34:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:34:57 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:34:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:34:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:34:57 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:34:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 05:34:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:34:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:34:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:34:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:34:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:35:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:35:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43846437
Sat 18 Jan 2014 05:35:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:35:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43846437
Sat 18 Jan 2014 05:35:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:35:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:35:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:35:08 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:35:08 - job_xml_thread(): Done retrieving: data size 43846437
Sat 18 Jan 2014 05:35:08 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:35:08 - XML: Start document: iteration 10
Sat 18 Jan 2014 05:35:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:35:13 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:35:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:35:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:35:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:35:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:35:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:35:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:35:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:35:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:35:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:35:22 - XML: Processed 655338 elements - found 566 jobs
Sat 18 Jan 2014 05:35:22 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:35:22 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:35:22 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:35:22 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:35:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:35:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:35:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:35:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:35:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:35:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:35:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:35:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:35:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:35:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43766310
Sat 18 Jan 2014 05:35:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:35:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43766310
Sat 18 Jan 2014 05:35:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:35:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:35:27 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:35:27 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 05:35:27 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:35:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:35:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:35:29 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:35:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 05:35:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:35:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 05:35:30 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:35:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8819 values 139035 bits 17379 bytes 
Sat 18 Jan 2014 05:35:37 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:35:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:35:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:35:39 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:35:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:35:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:35:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:35:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:35:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:35:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:35:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:35:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:35:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:35:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:35:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:35:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:35:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:35:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:35:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:35:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:35:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:35:47 - job_xml_thread(): Done retrieving: data size 43218624
Sat 18 Jan 2014 05:35:47 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:35:47 - XML: Start document: iteration 11
Sat 18 Jan 2014 05:35:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43218624
Sat 18 Jan 2014 05:35:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43218624
Sat 18 Jan 2014 05:35:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:35:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:35:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:35:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:35:58 - XML: Processed 647956 elements - found 566 jobs
Sat 18 Jan 2014 05:35:58 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:35:58 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:35:58 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:35:58 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:36:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:36:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:36:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:36:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:36:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:36:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:36:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:36:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:36:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:36:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:36:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:36:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:36:11 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:36:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:36:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:36:11 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:36:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 05:36:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:36:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:36:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:36:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:36:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:36:13 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:36:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:36:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43225907
Sat 18 Jan 2014 05:36:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:36:15 - job_xml_thread(): Done retrieving: data size 43225907
Sat 18 Jan 2014 05:36:15 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:36:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43225907
Sat 18 Jan 2014 05:36:15 - XML: Start document: iteration 12
Sat 18 Jan 2014 05:36:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:36:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:36:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:36:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:36:26 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:36:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:36:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:36:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:36:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:36:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:36:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:36:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:36:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:36:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:36:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:36:30 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:36:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:36:30 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:36:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 05:36:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 05:36:30 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:36:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5613 values 88471 bits 11058 bytes 
Sat 18 Jan 2014 05:36:33 - XML: Processed 647550 elements - found 566 jobs
Sat 18 Jan 2014 05:36:34 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:36:34 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:36:34 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:36:34 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:36:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:36:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:36:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:36:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:36:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:36:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:36:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:36:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:36:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:36:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43610007
Sat 18 Jan 2014 05:36:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:36:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43610007
Sat 18 Jan 2014 05:36:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:36:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:36:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:36:49 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:36:49 - job_xml_thread(): Done retrieving: data size 43610007
Sat 18 Jan 2014 05:36:49 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:36:49 - XML: Start document: iteration 13
Sat 18 Jan 2014 05:36:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:36:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:36:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:36:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:36:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:36:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:36:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:36:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:36:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:36:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:36:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:37:01 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:37:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 05:37:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:37:03 - XML: Processed 652598 elements - found 564 jobs
Sat 18 Jan 2014 05:37:03 - job 7348745 appears to have finished
Sat 18 Jan 2014 05:37:03 - job 7348730 appears to have finished
Sat 18 Jan 2014 05:37:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:37:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:37:03 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 05:37:03 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 05:37:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:37:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:37:04 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 05:37:04 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:37:04 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:37:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:37:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:37:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:37:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:37:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:37:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43826216
Sat 18 Jan 2014 05:37:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:37:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43826216
Sat 18 Jan 2014 05:37:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:37:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:37:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:37:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:37:18 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:37:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:37:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:37:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:37:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:37:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:37:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:37:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:37:19 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:37:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:37:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:37:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:37:21 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:37:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:37:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:37:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:37:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:37:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:37:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:37:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:37:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43845958
Sat 18 Jan 2014 05:37:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:37:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43845958
Sat 18 Jan 2014 05:37:28 - job_xml_thread(): Done retrieving: data size 43845958
Sat 18 Jan 2014 05:37:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:37:28 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:37:28 - XML: Start document: iteration 14
Sat 18 Jan 2014 05:37:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:37:31 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:37:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:37:32 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:37:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 05:37:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 05:37:32 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:37:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9103 values 143632 bits 17954 bytes 
Sat 18 Jan 2014 05:37:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:37:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:37:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:37:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:37:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:37:43 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:37:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:37:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:37:45 - XML: Processed 655334 elements - found 564 jobs
Sat 18 Jan 2014 05:37:45 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:37:45 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:37:45 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:37:45 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:37:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:37:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:37:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:37:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:37:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:37:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:37:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:37:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:37:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:37:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:37:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:37:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:37:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:37:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:37:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43845972
Sat 18 Jan 2014 05:37:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:37:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43845972
Sat 18 Jan 2014 05:37:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:38:00 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:38:00 - job_xml_thread(): Done retrieving: data size 43845972
Sat 18 Jan 2014 05:38:00 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:38:00 - XML: Start document: iteration 15
Sat 18 Jan 2014 05:38:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:38:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:38:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:38:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:38:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:38:07 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:38:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:38:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:38:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:38:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:38:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:38:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:38:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:38:09 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:38:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 05:38:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:38:14 - XML: Processed 655334 elements - found 564 jobs
Sat 18 Jan 2014 05:38:14 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:38:14 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:38:14 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:38:14 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:38:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:38:16 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:38:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:38:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:38:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:38:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:38:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:38:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:38:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:38:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43825484
Sat 18 Jan 2014 05:38:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:38:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43825484
Sat 18 Jan 2014 05:38:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:38:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:38:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:38:29 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:38:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:38:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:38:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:38:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:38:31 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:38:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:38:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:38:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:38:32 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:38:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:38:33 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:38:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:38:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 05:38:33 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:38:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:38:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 05:38:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:38:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:38:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5819 values 91727 bits 11465 bytes 
Sat 18 Jan 2014 05:38:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:38:35 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:38:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:38:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:38:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:38:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:38:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:38:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:38:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:38:39 - job_xml_thread(): Done retrieving: data size 43845083
Sat 18 Jan 2014 05:38:39 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:38:39 - XML: Start document: iteration 16
Sat 18 Jan 2014 05:38:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43845083
Sat 18 Jan 2014 05:38:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43845083
Sat 18 Jan 2014 05:38:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:38:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:38:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:38:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:38:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:38:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:38:55 - XML: Processed 655332 elements - found 563 jobs
Sat 18 Jan 2014 05:38:55 - job 7348746 appears to have finished
Sat 18 Jan 2014 05:38:55 - job 7348599 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 05:38:55 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 05:38:55 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 05:38:56 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 05:38:56 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:38:56 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:39:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:39:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:39:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:39:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:39:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:39:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:39:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:39:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:39:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:39:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:39:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:39:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:39:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:39:03 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 05:39:03 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 05:39:03 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:39:03 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:39:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 05:39:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:39:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:39:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:39:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:39:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:39:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:39:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43864555
Sat 18 Jan 2014 05:39:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:39:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43864555
Sat 18 Jan 2014 05:39:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:39:11 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:39:11 - job_xml_thread(): Done retrieving: data size 43864555
Sat 18 Jan 2014 05:39:11 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:39:11 - XML: Start document: iteration 17
Sat 18 Jan 2014 05:39:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:39:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:39:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:39:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:39:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:39:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:39:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:39:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:39:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:39:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:39:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:39:26 - XML: Processed 655332 elements - found 563 jobs
Sat 18 Jan 2014 05:39:26 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:39:26 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:39:26 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:39:26 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:39:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:39:28 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:39:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:39:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:39:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:39:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:39:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:39:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:39:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:39:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43813713
Sat 18 Jan 2014 05:39:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:39:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43813713
Sat 18 Jan 2014 05:39:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:39:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:39:33 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:39:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:39:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:39:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:39:35 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:39:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 05:39:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 05:39:35 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:39:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8735 values 137666 bits 17208 bytes 
Sat 18 Jan 2014 05:39:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:39:39 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:39:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:39:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:39:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:39:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:39:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:39:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:39:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:39:41 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:39:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:39:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:39:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:39:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:39:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:39:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:39:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:39:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:39:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:39:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:39:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:39:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43833869
Sat 18 Jan 2014 05:39:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:39:47 - job_xml_thread(): Done retrieving: data size 43833869
Sat 18 Jan 2014 05:39:47 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:39:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43833869
Sat 18 Jan 2014 05:39:47 - XML: Start document: iteration 18
Sat 18 Jan 2014 05:39:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:39:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:39:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:40:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:40:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:40:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:40:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:40:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:40:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:40:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:40:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:40:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:40:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:40:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:40:10 - XML: Processed 655332 elements - found 563 jobs
Sat 18 Jan 2014 05:40:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:40:10 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:40:10 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:40:10 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:40:10 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:40:10 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:40:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:40:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:40:11 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:40:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 05:40:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:40:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:40:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:40:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:40:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:40:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:40:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43842387
Sat 18 Jan 2014 05:40:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:40:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43842387
Sat 18 Jan 2014 05:40:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:40:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:40:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:40:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:40:25 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:40:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:40:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:40:26 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:40:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:40:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:40:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:40:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:40:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:40:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:40:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:40:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:40:27 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:40:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:40:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:40:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:40:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:40:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:40:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:40:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:40:28 - job_xml_thread(): Done retrieving: data size 43841980
Sat 18 Jan 2014 05:40:28 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:40:28 - XML: Start document: iteration 19
Sat 18 Jan 2014 05:40:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43841980
Sat 18 Jan 2014 05:40:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43841980
Sat 18 Jan 2014 05:40:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:40:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:40:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:40:35 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:40:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:40:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 05:40:35 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:40:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 05:40:35 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:40:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8870 values 139835 bits 17479 bytes 
Sat 18 Jan 2014 05:40:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:40:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:40:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:40:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:40:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:40:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:40:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:40:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:40:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:40:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:40:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:40:46 - XML: Processed 655326 elements - found 560 jobs
Sat 18 Jan 2014 05:40:46 - job 7348734 appears to have finished
Sat 18 Jan 2014 05:40:46 - job 7348733 appears to have finished
Sat 18 Jan 2014 05:40:46 - job 7343926 appears to have finished
Sat 18 Jan 2014 05:40:46 - job_xml_thread(): Found 3 updated jobs.
Sat 18 Jan 2014 05:40:46 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 05:40:48 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Sat 18 Jan 2014 05:40:48 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:40:48 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:40:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:40:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:40:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:40:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:40:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:40:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:40:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:40:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:40:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:40:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43833181
Sat 18 Jan 2014 05:40:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:40:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43833181
Sat 18 Jan 2014 05:40:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:40:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:40:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:41:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:41:02 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:41:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:41:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:41:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:41:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:41:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:41:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43833181
Sat 18 Jan 2014 05:41:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:41:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:41:03 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:41:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:41:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:41:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:41:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:41:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:41:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:41:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:41:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:41:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:41:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:41:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:41:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:41:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:41:17 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:41:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 05:41:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:41:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:41:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:41:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:41:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:41:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:41:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:41:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:41:18 - job_xml_thread(): Done retrieving: data size 43772614
Sat 18 Jan 2014 05:41:18 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:41:18 - XML: Start document: iteration 20
Sat 18 Jan 2014 05:41:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43772614
Sat 18 Jan 2014 05:41:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43772614
Sat 18 Jan 2014 05:41:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:41:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:41:28 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 05:41:28 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:41:28 - XML: Processed 654944 elements - found 560 jobs
Sat 18 Jan 2014 05:41:28 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:41:28 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:41:28 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:41:28 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:41:29 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:41:29 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 05:41:29 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:41:29 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 05:41:29 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 05:41:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:41:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:41:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:41:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:41:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:41:35 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:41:36 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:41:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 05:41:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:41:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 05:41:36 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:41:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5862 values 92427 bits 11553 bytes 
Sat 18 Jan 2014 05:41:39 - size of cluster 'LISA Cluster': 624 hosts 79481 metrics 809391 values 12765777 bits 1595722 bytes 
Sat 18 Jan 2014 05:41:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:41:39 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:41:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:41:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:41:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:41:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:41:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:41:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:41:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:41:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:41:41 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:41:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:41:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:41:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:41:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:41:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:41:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:41:43 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:41:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:41:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43252766
Sat 18 Jan 2014 05:41:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:41:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43252766
Sat 18 Jan 2014 05:41:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:41:45 - job_xml_thread(): Done retrieving: data size 43252766
Sat 18 Jan 2014 05:41:45 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:41:45 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 05:41:45 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 05:41:45 - Housekeeping: done.
Sat 18 Jan 2014 05:41:45 - XML: Start document: iteration 0
Sat 18 Jan 2014 05:41:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:41:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:41:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:41:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:41:58 - XML: Processed 648155 elements - found 560 jobs
Sat 18 Jan 2014 05:41:58 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:41:58 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:41:58 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:41:58 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:42:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:42:02 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:42:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:42:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:42:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:42:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:42:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:42:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:42:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:42:03 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:42:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 05:42:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:42:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:42:06 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:42:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:42:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:42:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:42:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:42:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:42:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:42:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:42:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43193202
Sat 18 Jan 2014 05:42:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:42:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43193202
Sat 18 Jan 2014 05:42:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:42:13 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:42:13 - job_xml_thread(): Done retrieving: data size 43193202
Sat 18 Jan 2014 05:42:13 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:42:14 - XML: Start document: iteration 1
Sat 18 Jan 2014 05:42:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:42:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:42:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:42:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:42:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:42:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:42:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:42:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:42:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:42:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:42:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:42:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:42:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:42:29 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:42:29 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 05:42:30 - XML: Processed 647128 elements - found 560 jobs
Sat 18 Jan 2014 05:42:30 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:42:30 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:42:30 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:42:30 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:42:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:42:33 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:42:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:42:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:42:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:42:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:42:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:42:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:42:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:42:36 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:42:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:42:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43509729
Sat 18 Jan 2014 05:42:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:42:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:42:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:42:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43509729
Sat 18 Jan 2014 05:42:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:42:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:42:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 05:42:37 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:42:37 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:42:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 05:42:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6036 values 95208 bits 11901 bytes 
Sat 18 Jan 2014 05:42:45 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:42:45 - job_xml_thread(): Done retrieving: data size 43509729
Sat 18 Jan 2014 05:42:45 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:42:45 - XML: Start document: iteration 2
Sat 18 Jan 2014 05:42:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:42:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:42:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:42:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:42:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:42:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:42:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:42:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:42:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:42:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:42:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:42:57 - XML: Processed 651608 elements - found 560 jobs
Sat 18 Jan 2014 05:42:57 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:42:57 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:42:57 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:42:57 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:43:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:43:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:43:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:43:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:43:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:43:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:43:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:43:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:43:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:43:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43821667
Sat 18 Jan 2014 05:43:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:43:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43821667
Sat 18 Jan 2014 05:43:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:43:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:43:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:43:12 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:43:12 - job_xml_thread(): Done retrieving: data size 43821667
Sat 18 Jan 2014 05:43:12 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:43:12 - XML: Start document: iteration 3
Sat 18 Jan 2014 05:43:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:43:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:43:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:43:18 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:43:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:43:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:43:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:43:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:43:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:43:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:43:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:43:20 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:43:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 05:43:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:43:25 - XML: Processed 655322 elements - found 558 jobs
Sat 18 Jan 2014 05:43:25 - job 7348736 appears to have finished
Sat 18 Jan 2014 05:43:25 - job 7348735 appears to have finished
Sat 18 Jan 2014 05:43:25 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 05:43:25 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 05:43:25 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 05:43:25 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:43:25 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:43:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:43:28 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:43:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:43:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:43:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:43:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:43:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:43:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:43:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:43:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43806372
Sat 18 Jan 2014 05:43:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:43:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43806372
Sat 18 Jan 2014 05:43:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:43:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:43:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:43:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:43:37 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:43:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:43:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 05:43:38 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:43:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 05:43:38 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:43:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6084 values 95963 bits 11995 bytes 
Sat 18 Jan 2014 05:43:40 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:43:40 - job_xml_thread(): Done retrieving: data size 43806372
Sat 18 Jan 2014 05:43:41 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:43:41 - XML: Start document: iteration 4
Sat 18 Jan 2014 05:43:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:43:43 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:43:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:43:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:43:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:43:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:43:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:43:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:43:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:43:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:43:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:43:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:43:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:43:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:43:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:43:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:43:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:43:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:43:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:43:54 - XML: Processed 655322 elements - found 558 jobs
Sat 18 Jan 2014 05:43:54 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:43:54 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:43:54 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:43:54 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:43:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:43:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43817512
Sat 18 Jan 2014 05:43:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:43:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43817512
Sat 18 Jan 2014 05:43:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:44:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:44:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:44:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:44:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:44:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:44:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:44:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:44:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:44:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:44:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:44:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43817512
Sat 18 Jan 2014 05:44:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:44:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:44:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:44:09 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:44:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:44:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:44:20 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:44:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:44:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:44:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:44:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:44:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:44:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:44:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:44:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:44:22 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:44:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 05:44:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:44:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:44:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:44:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:44:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:44:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:44:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:44:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:44:25 - job_xml_thread(): Done retrieving: data size 43825619
Sat 18 Jan 2014 05:44:25 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:44:25 - XML: Start document: iteration 5
Sat 18 Jan 2014 05:44:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43825619
Sat 18 Jan 2014 05:44:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43825619
Sat 18 Jan 2014 05:44:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:44:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:44:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:44:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:44:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:44:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:44:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:44:38 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:44:39 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:44:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:44:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 05:44:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 05:44:39 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:44:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5903 values 93081 bits 11635 bytes 
Sat 18 Jan 2014 05:44:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:44:43 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:44:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:44:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:44:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:44:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:44:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:44:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:44:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:44:45 - XML: Processed 655322 elements - found 558 jobs
Sat 18 Jan 2014 05:44:45 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:44:45 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:44:45 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:44:45 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:44:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:44:49 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:44:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:44:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:44:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:44:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:44:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:44:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:44:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:44:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43839841
Sat 18 Jan 2014 05:44:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:44:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43839841
Sat 18 Jan 2014 05:44:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:44:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:44:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:45:00 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:45:00 - job_xml_thread(): Done retrieving: data size 43839841
Sat 18 Jan 2014 05:45:00 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:45:00 - XML: Start document: iteration 6
Sat 18 Jan 2014 05:45:01 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:45:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 05:45:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:45:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:45:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:45:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:45:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:45:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:45:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:45:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:45:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:45:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:45:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:45:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:45:14 - XML: Processed 655318 elements - found 556 jobs
Sat 18 Jan 2014 05:45:14 - job 7348737 appears to have finished
Sat 18 Jan 2014 05:45:14 - job 7348731 appears to have finished
Sat 18 Jan 2014 05:45:14 - job 7348600 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 05:45:14 - job_xml_thread(): Found 3 updated jobs.
Sat 18 Jan 2014 05:45:14 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 05:45:15 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Sat 18 Jan 2014 05:45:15 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:45:15 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:45:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:45:16 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:45:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:45:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:45:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:45:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:45:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:45:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:45:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:45:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43816381
Sat 18 Jan 2014 05:45:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:45:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43816381
Sat 18 Jan 2014 05:45:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:45:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:45:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:45:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:45:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:45:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:45:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:45:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:45:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:45:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43816381
Sat 18 Jan 2014 05:45:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:45:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:45:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:45:31 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:45:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:45:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:45:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:45:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:45:39 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:45:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:45:40 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:45:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:45:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:45:40 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:45:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:45:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 05:45:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 05:45:41 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:45:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6165 values 97232 bits 12154 bytes 
Sat 18 Jan 2014 05:45:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:45:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:45:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:45:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:45:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:45:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:45:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:45:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:45:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:45:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:45:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:45:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:45:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:45:45 - job_xml_thread(): Done retrieving: data size 43813089
Sat 18 Jan 2014 05:45:45 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:45:45 - XML: Start document: iteration 7
Sat 18 Jan 2014 05:45:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43813089
Sat 18 Jan 2014 05:45:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:45:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43813089
Sat 18 Jan 2014 05:45:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:45:46 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:45:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 05:45:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:45:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:45:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:45:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:45:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:45:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:45:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:45:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:45:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:45:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:45:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:45:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:46:05 - XML: Processed 655318 elements - found 556 jobs
Sat 18 Jan 2014 05:46:05 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:46:05 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:46:05 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:46:05 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:46:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:46:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:46:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:46:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:46:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:46:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:46:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:46:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:46:09 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 05:46:09 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 05:46:09 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:46:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:46:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43833898
Sat 18 Jan 2014 05:46:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:46:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43833898
Sat 18 Jan 2014 05:46:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:46:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:46:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:46:20 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:46:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:46:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:46:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:46:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:46:24 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:46:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:46:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:46:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:46:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:46:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:46:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:46:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:46:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:46:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:46:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:46:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:46:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:46:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:46:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:46:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:46:27 - job_xml_thread(): Done retrieving: data size 43847160
Sat 18 Jan 2014 05:46:27 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:46:27 - XML: Start document: iteration 8
Sat 18 Jan 2014 05:46:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43847160
Sat 18 Jan 2014 05:46:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:46:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43847160
Sat 18 Jan 2014 05:46:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:46:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:46:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:46:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:46:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:46:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:46:41 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:46:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:46:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 05:46:42 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:46:42 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:46:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9409 values 148595 bits 18574 bytes 
Sat 18 Jan 2014 05:46:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 05:46:44 - XML: Processed 655318 elements - found 556 jobs
Sat 18 Jan 2014 05:46:44 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:46:44 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:46:44 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:46:44 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:46:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:46:49 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:46:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:46:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:46:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:46:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:46:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:46:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:46:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:46:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:46:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:46:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:46:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:46:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:46:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:46:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:46:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:46:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:46:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43863239
Sat 18 Jan 2014 05:46:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:46:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43863239
Sat 18 Jan 2014 05:46:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:46:59 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:46:59 - job_xml_thread(): Done retrieving: data size 43863239
Sat 18 Jan 2014 05:46:59 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:46:59 - XML: Start document: iteration 9
Sat 18 Jan 2014 05:47:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:47:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:47:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:47:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:47:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:47:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:47:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:47:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:47:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:47:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:47:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:47:14 - XML: Processed 655316 elements - found 555 jobs
Sat 18 Jan 2014 05:47:14 - job 7343927 appears to have finished
Sat 18 Jan 2014 05:47:14 - job 7348601 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 05:47:14 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 05:47:14 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 05:47:15 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 05:47:15 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:47:15 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:47:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:47:16 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:47:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:47:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:47:16 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:47:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 05:47:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:47:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:47:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:47:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:47:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:47:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:47:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43746798
Sat 18 Jan 2014 05:47:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:47:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43746798
Sat 18 Jan 2014 05:47:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:47:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:47:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:47:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:47:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:47:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:47:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:47:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:47:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:47:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:47:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:47:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:47:30 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:47:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:47:32 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:47:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:47:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:47:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:47:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:47:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:47:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:47:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:47:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43305823
Sat 18 Jan 2014 05:47:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43305823
Sat 18 Jan 2014 05:47:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:47:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:47:34 - job_xml_thread(): Done retrieving: data size 43305823
Sat 18 Jan 2014 05:47:34 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:47:34 - XML: Start document: iteration 10
Sat 18 Jan 2014 05:47:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:47:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:47:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:47:43 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:47:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:47:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 05:47:44 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:47:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 05:47:44 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:47:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:47:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8997 values 142257 bits 17782 bytes 
Sat 18 Jan 2014 05:47:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:47:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:47:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:47:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:47:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:47:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:47:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:47:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:47:52 - XML: Processed 648742 elements - found 555 jobs
Sat 18 Jan 2014 05:47:52 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:47:52 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:47:52 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:47:52 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:47:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:47:54 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:47:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:47:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:47:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:47:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:47:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:47:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:47:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:47:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43182624
Sat 18 Jan 2014 05:47:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:47:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43182624
Sat 18 Jan 2014 05:47:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:48:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:48:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:48:07 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:48:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:48:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:48:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:48:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:48:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:48:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:48:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:48:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:48:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:48:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:48:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:48:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:48:12 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:48:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:48:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:48:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:48:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:48:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:48:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:48:12 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:48:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 05:48:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:48:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:48:13 - job_xml_thread(): Done retrieving: data size 43207377
Sat 18 Jan 2014 05:48:13 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:48:13 - XML: Start document: iteration 11
Sat 18 Jan 2014 05:48:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43207377
Sat 18 Jan 2014 05:48:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:48:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43207377
Sat 18 Jan 2014 05:48:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:48:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:48:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:48:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:48:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:48:30 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 05:48:31 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:48:32 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:48:32 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 05:48:33 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 05:48:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:48:33 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:48:33 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 05:48:33 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:48:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:48:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:48:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:48:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:48:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:48:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:48:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:48:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:48:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:48:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:48:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:48:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:48:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:48:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:48:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:48:36 - XML: Processed 647462 elements - found 555 jobs
Sat 18 Jan 2014 05:48:36 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:48:36 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:48:36 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:48:36 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:48:37 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 769539 values 12159560 bits 1519945 bytes 
Sat 18 Jan 2014 05:48:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:48:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43601441
Sat 18 Jan 2014 05:48:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:48:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43601441
Sat 18 Jan 2014 05:48:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:48:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:48:45 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:48:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:48:46 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:48:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 05:48:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 05:48:46 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:48:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8911 values 140848 bits 17606 bytes 
Sat 18 Jan 2014 05:48:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:48:49 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:48:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:48:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:48:51 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:48:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:48:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:48:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:48:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:48:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:48:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:48:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:48:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:48:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:48:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:48:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:48:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:48:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:48:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:48:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:48:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:48:58 - job_xml_thread(): Done retrieving: data size 43814934
Sat 18 Jan 2014 05:48:58 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:48:58 - XML: Start document: iteration 12
Sat 18 Jan 2014 05:48:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43814934
Sat 18 Jan 2014 05:48:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:48:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43814934
Sat 18 Jan 2014 05:48:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:49:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:49:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:49:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:49:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:49:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:49:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:49:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:49:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:49:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:49:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:49:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:49:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:49:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:49:16 - XML: Processed 655010 elements - found 554 jobs
Sat 18 Jan 2014 05:49:16 - job 7343928 appears to have finished
Sat 18 Jan 2014 05:49:16 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 05:49:16 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 05:49:16 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 05:49:16 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:49:16 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:49:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:49:21 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:49:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:49:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:49:22 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:49:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 05:49:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:49:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:49:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:49:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:49:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:49:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:49:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:49:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:49:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43817129
Sat 18 Jan 2014 05:49:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:49:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43817129
Sat 18 Jan 2014 05:49:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:49:32 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:49:32 - job_xml_thread(): Done retrieving: data size 43817129
Sat 18 Jan 2014 05:49:32 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:49:32 - XML: Start document: iteration 13
Sat 18 Jan 2014 05:49:33 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:49:33 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 05:49:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:49:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:49:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:49:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:49:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:49:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:49:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:49:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:49:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:49:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:49:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:49:46 - XML: Processed 655314 elements - found 554 jobs
Sat 18 Jan 2014 05:49:46 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:49:46 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:49:46 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:49:46 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:49:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:49:46 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:49:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:49:46 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:49:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:49:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:49:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:49:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:49:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:49:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:49:47 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:49:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 05:49:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:49:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 05:49:47 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:49:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5675 values 89485 bits 11185 bytes 
Sat 18 Jan 2014 05:49:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:49:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43815761
Sat 18 Jan 2014 05:49:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:49:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43815761
Sat 18 Jan 2014 05:49:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:49:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:49:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:50:01 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:50:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:50:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:50:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:50:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:50:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:50:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:50:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:50:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:50:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:50:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:50:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:50:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:50:07 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:50:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:50:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:50:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:50:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:50:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:50:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:50:09 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:50:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 05:50:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:50:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:50:11 - job_xml_thread(): Done retrieving: data size 43832774
Sat 18 Jan 2014 05:50:11 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:50:11 - XML: Start document: iteration 14
Sat 18 Jan 2014 05:50:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43832774
Sat 18 Jan 2014 05:50:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:50:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43832774
Sat 18 Jan 2014 05:50:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:50:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:50:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:50:23 - XML: Processed 655314 elements - found 554 jobs
Sat 18 Jan 2014 05:50:23 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:50:23 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:50:23 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:50:23 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:50:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:50:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:50:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:50:29 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:50:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:50:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:50:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:50:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:50:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:50:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:50:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:50:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:50:32 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:50:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:50:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:50:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:50:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:50:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:50:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:50:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:50:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43834066
Sat 18 Jan 2014 05:50:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:50:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43834066
Sat 18 Jan 2014 05:50:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:50:38 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:50:38 - job_xml_thread(): Done retrieving: data size 43834066
Sat 18 Jan 2014 05:50:38 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:50:38 - XML: Start document: iteration 15
Sat 18 Jan 2014 05:50:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:50:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:50:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:50:47 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:50:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:50:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:50:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:50:48 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:50:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 05:50:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 05:50:49 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:50:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:50:49 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:50:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8319 values 131262 bits 16407 bytes 
Sat 18 Jan 2014 05:50:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:50:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:50:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:50:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:50:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:50:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:50:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:50:55 - XML: Processed 655310 elements - found 552 jobs
Sat 18 Jan 2014 05:50:55 - job 7348755 appears to have finished
Sat 18 Jan 2014 05:50:55 - job 7348756 appears to have finished
Sat 18 Jan 2014 05:50:55 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 05:50:55 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 05:50:56 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 05:50:56 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:50:56 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:50:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:50:59 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:50:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:50:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:50:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:50:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:50:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:50:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:51:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:51:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43806060
Sat 18 Jan 2014 05:51:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:51:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43806060
Sat 18 Jan 2014 05:51:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:51:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:51:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:51:11 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:51:11 - job_xml_thread(): Done retrieving: data size 43806060
Sat 18 Jan 2014 05:51:11 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:51:11 - XML: Start document: iteration 16
Sat 18 Jan 2014 05:51:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:51:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:51:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:51:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:51:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:51:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:51:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:51:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:51:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:51:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:51:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:51:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:51:27 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:51:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:51:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:51:28 - XML: Processed 655310 elements - found 552 jobs
Sat 18 Jan 2014 05:51:28 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:51:28 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:51:28 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:51:28 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:51:28 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:51:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 05:51:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:51:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:51:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:51:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:51:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:51:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:51:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43817317
Sat 18 Jan 2014 05:51:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:51:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43817317
Sat 18 Jan 2014 05:51:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:51:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:51:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:51:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:51:42 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:51:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:51:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:51:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:51:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:51:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:51:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:51:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:51:43 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:51:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:51:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:51:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:51:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:51:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:51:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:51:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:51:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:51:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:51:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:51:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:51:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43827479
Sat 18 Jan 2014 05:51:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:51:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43827479
Sat 18 Jan 2014 05:51:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:51:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:51:49 - job_xml_thread(): Done retrieving: data size 43827479
Sat 18 Jan 2014 05:51:49 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:51:49 - XML: Start document: iteration 17
Sat 18 Jan 2014 05:51:49 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:51:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:51:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 05:51:50 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:51:50 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:51:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sat 18 Jan 2014 05:51:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:51:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:52:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:52:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:52:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:52:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:52:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:52:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:52:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:52:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:52:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:52:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:52:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:52:09 - XML: Processed 655309 elements - found 552 jobs
Sat 18 Jan 2014 05:52:09 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:52:09 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:52:09 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:52:09 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:52:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:52:12 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:52:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:52:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:52:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:52:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:52:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:52:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:52:15 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 05:52:15 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 05:52:15 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:52:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:52:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43833521
Sat 18 Jan 2014 05:52:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:52:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43833521
Sat 18 Jan 2014 05:52:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:52:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:52:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:52:24 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:52:24 - job_xml_thread(): Done retrieving: data size 43833521
Sat 18 Jan 2014 05:52:24 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:52:24 - XML: Start document: iteration 18
Sat 18 Jan 2014 05:52:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:52:27 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:52:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:52:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:52:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:52:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:52:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:52:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:52:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:52:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:52:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:52:37 - XML: Processed 655308 elements - found 552 jobs
Sat 18 Jan 2014 05:52:37 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:52:37 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:52:37 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:52:37 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:52:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:52:39 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:52:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:52:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:52:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:52:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:52:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:52:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:52:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:52:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43822236
Sat 18 Jan 2014 05:52:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:52:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43822236
Sat 18 Jan 2014 05:52:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:52:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:52:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:52:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:52:50 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:52:50 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:52:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:52:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 05:52:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 05:52:51 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:52:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:52:51 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:52:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 15065 values 237724 bits 29715 bytes 
Sat 18 Jan 2014 05:52:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:52:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:52:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:52:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:52:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:52:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:52:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:52:52 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:52:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:52:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:52:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:52:56 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:52:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:52:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:52:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:52:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:52:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:52:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:52:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:52:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853680
Sat 18 Jan 2014 05:52:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:52:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853680
Sat 18 Jan 2014 05:52:58 - job_xml_thread(): Done retrieving: data size 43853680
Sat 18 Jan 2014 05:52:58 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:52:58 - XML: Start document: iteration 19
Sat 18 Jan 2014 05:52:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:53:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:53:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:53:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:53:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:53:18 - XML: Processed 655310 elements - found 552 jobs
Sat 18 Jan 2014 05:53:20 - job 7348602 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 05:53:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:53:20 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:53:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:53:20 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 05:53:20 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 05:53:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:53:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:53:21 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:53:21 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 05:53:21 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:53:21 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:53:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:53:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:53:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:53:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:53:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:53:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:53:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:53:21 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:53:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 05:53:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:53:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:53:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:53:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:53:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:53:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:53:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43784856
Sat 18 Jan 2014 05:53:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:53:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43784856
Sat 18 Jan 2014 05:53:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:53:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:53:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:53:36 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:53:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:53:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:53:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:53:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:53:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:53:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:53:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:53:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:53:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:53:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:53:38 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:53:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:53:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:53:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:53:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:53:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:53:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:53:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:53:39 - job_xml_thread(): Done retrieving: data size 43273008
Sat 18 Jan 2014 05:53:39 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:53:39 - XML: Start document: iteration 20
Sat 18 Jan 2014 05:53:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43273008
Sat 18 Jan 2014 05:53:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43273008
Sat 18 Jan 2014 05:53:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:53:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:53:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:53:51 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:53:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:53:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 05:53:52 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:53:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8818 values 139021 bits 17377 bytes 
Sat 18 Jan 2014 05:53:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:53:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:53:52 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:53:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 05:53:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:53:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:53:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:53:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:53:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:53:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:54:00 - XML: Processed 648186 elements - found 552 jobs
Sat 18 Jan 2014 05:54:00 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:54:00 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:54:00 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:54:00 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:54:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:54:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:54:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:54:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:54:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:54:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:54:01 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:54:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:54:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:54:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:54:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:54:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:54:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:54:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:54:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43168929
Sat 18 Jan 2014 05:54:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:54:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43168929
Sat 18 Jan 2014 05:54:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:54:15 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:54:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:54:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:54:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:54:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:54:15 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:54:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:54:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:54:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:54:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:54:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:54:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:54:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:54:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:54:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:54:18 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:54:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:54:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:54:18 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:54:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 05:54:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:54:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:54:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:54:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:54:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:54:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:54:20 - job_xml_thread(): Done retrieving: data size 43231270
Sat 18 Jan 2014 05:54:20 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:54:20 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 05:54:20 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 05:54:20 - Housekeeping: done.
Sat 18 Jan 2014 05:54:20 - XML: Start document: iteration 0
Sat 18 Jan 2014 05:54:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43231270
Sat 18 Jan 2014 05:54:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:54:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43231270
Sat 18 Jan 2014 05:54:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:54:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:54:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:54:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:54:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:54:35 - XML: Processed 647858 elements - found 552 jobs
Sat 18 Jan 2014 05:54:35 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:54:35 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:54:35 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:54:35 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:54:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:54:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:54:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:54:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:54:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:54:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:54:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:54:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:54:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:54:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:54:42 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:54:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:54:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:54:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:54:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:54:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:54:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:54:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:54:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43730808
Sat 18 Jan 2014 05:54:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:54:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43730808
Sat 18 Jan 2014 05:54:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:54:50 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:54:50 - job_xml_thread(): Done retrieving: data size 43730808
Sat 18 Jan 2014 05:54:51 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:54:51 - XML: Start document: iteration 1
Sat 18 Jan 2014 05:54:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:54:52 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:54:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:54:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 05:54:53 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:54:53 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:54:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 05:54:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8813 values 138949 bits 17368 bytes 
Sat 18 Jan 2014 05:54:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:54:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:54:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:54:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:55:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:55:00 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:55:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:55:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:55:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:55:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:55:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:55:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:55:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:55:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:55:06 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:55:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:55:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:55:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:55:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:55:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:55:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:55:07 - XML: Processed 653802 elements - found 550 jobs
Sat 18 Jan 2014 05:55:07 - job 7348757 appears to have finished
Sat 18 Jan 2014 05:55:07 - job 7343929 appears to have finished
Sat 18 Jan 2014 05:55:07 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 05:55:07 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 05:55:07 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 05:55:07 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:55:07 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:55:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:55:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43825657
Sat 18 Jan 2014 05:55:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:55:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43825657
Sat 18 Jan 2014 05:55:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:55:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:55:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:55:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:55:20 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:55:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:55:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:55:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:55:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:55:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:55:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:55:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:55:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:55:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:55:22 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:55:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:55:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:55:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:55:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:55:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:55:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:55:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:55:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:55:25 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:55:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 05:55:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:55:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:55:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43847420
Sat 18 Jan 2014 05:55:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:55:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43847420
Sat 18 Jan 2014 05:55:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:55:27 - job_xml_thread(): Done retrieving: data size 43847420
Sat 18 Jan 2014 05:55:27 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:55:27 - XML: Start document: iteration 2
Sat 18 Jan 2014 05:55:33 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 05:55:33 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:55:34 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:55:34 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:55:34 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 05:55:34 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 05:55:34 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 05:55:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:55:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:55:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:55:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:55:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:55:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:55:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:55:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:55:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:55:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:55:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:55:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:55:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:55:45 - size of cluster 'LISA Cluster': 624 hosts 79486 metrics 825792 values 13025088 bits 1628136 bytes 
Sat 18 Jan 2014 05:55:50 - XML: Processed 655304 elements - found 550 jobs
Sat 18 Jan 2014 05:55:50 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:55:50 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:55:50 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:55:50 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:55:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:55:50 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:55:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:55:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:55:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:55:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:55:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:55:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:55:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:55:53 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:55:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:55:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43812549
Sat 18 Jan 2014 05:55:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:55:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43812549
Sat 18 Jan 2014 05:55:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:55:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:55:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 05:55:54 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:55:54 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:55:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 05:55:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5710 values 89993 bits 11249 bytes 
Sat 18 Jan 2014 05:55:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:55:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:56:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:56:03 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:56:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:56:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:56:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:56:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:56:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:56:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:56:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:56:05 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:56:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:56:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:56:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:56:10 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:56:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:56:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:56:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:56:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:56:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:56:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:56:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:56:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43829211
Sat 18 Jan 2014 05:56:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:56:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43829211
Sat 18 Jan 2014 05:56:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:56:14 - job_xml_thread(): Done retrieving: data size 43829211
Sat 18 Jan 2014 05:56:14 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:56:14 - XML: Start document: iteration 3
Sat 18 Jan 2014 05:56:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:56:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:56:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:56:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:56:26 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:56:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 05:56:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:56:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:56:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:56:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:56:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:56:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:56:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:56:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:56:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:56:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:56:34 - XML: Processed 655302 elements - found 550 jobs
Sat 18 Jan 2014 05:56:34 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:56:34 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:56:34 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:56:34 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:56:34 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:56:35 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 05:56:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:56:37 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:56:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:56:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:56:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:56:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:56:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:56:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:56:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:56:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43829280
Sat 18 Jan 2014 05:56:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:56:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43829280
Sat 18 Jan 2014 05:56:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:56:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:56:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:56:49 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:56:49 - job_xml_thread(): Done retrieving: data size 43829280
Sat 18 Jan 2014 05:56:50 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:56:50 - XML: Start document: iteration 4
Sat 18 Jan 2014 05:56:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:56:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:56:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:56:54 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:56:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:56:55 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:56:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 05:56:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 05:56:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:56:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:56:55 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:56:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:56:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:56:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6112 values 96413 bits 12051 bytes 
Sat 18 Jan 2014 05:56:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:56:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:56:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:56:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:56:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:57:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:57:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:57:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:57:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:57:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:57:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:57:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:57:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:57:05 - XML: Processed 655304 elements - found 550 jobs
Sat 18 Jan 2014 05:57:05 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:57:05 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:57:05 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:57:05 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:57:09 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:57:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 05:57:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:57:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:57:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43823098
Sat 18 Jan 2014 05:57:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:57:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43823098
Sat 18 Jan 2014 05:57:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:57:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:57:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:57:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:57:18 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:57:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:57:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:57:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:57:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:57:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:57:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:57:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43823098
Sat 18 Jan 2014 05:57:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:57:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:57:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:57:20 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:57:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:57:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:57:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:57:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:57:29 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:57:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:57:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:57:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:57:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:57:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:57:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:57:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:57:33 - job_xml_thread(): Done retrieving: data size 43812727
Sat 18 Jan 2014 05:57:33 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:57:33 - XML: Start document: iteration 5
Sat 18 Jan 2014 05:57:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:57:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:57:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43812727
Sat 18 Jan 2014 05:57:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:57:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:57:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:57:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43812727
Sat 18 Jan 2014 05:57:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:57:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:57:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:57:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:57:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:57:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:57:46 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:57:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:57:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:57:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:57:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:57:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:57:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:57:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:57:52 - XML: Processed 655304 elements - found 550 jobs
Sat 18 Jan 2014 05:57:52 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:57:52 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:57:52 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:57:53 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:57:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:57:55 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:57:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:57:56 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:57:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:57:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:57:56 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:57:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 05:57:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:57:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 05:57:56 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:57:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99083 bits 12385 bytes 
Sat 18 Jan 2014 05:57:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:57:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:57:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:57:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:58:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:58:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43823471
Sat 18 Jan 2014 05:58:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:58:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43823471
Sat 18 Jan 2014 05:58:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:58:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:58:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:58:08 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:58:08 - job_xml_thread(): Done retrieving: data size 43823471
Sat 18 Jan 2014 05:58:08 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:58:08 - XML: Start document: iteration 6
Sat 18 Jan 2014 05:58:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:58:12 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:58:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:58:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:58:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:58:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:58:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:58:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:58:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:58:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:58:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:58:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:58:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:58:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:58:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:58:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:58:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:58:18 - XML: Processed 655304 elements - found 550 jobs
Sat 18 Jan 2014 05:58:18 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:58:18 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:58:18 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:58:18 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:58:19 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:58:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 05:58:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:58:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:58:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43828392
Sat 18 Jan 2014 05:58:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:58:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43828392
Sat 18 Jan 2014 05:58:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:58:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:58:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:58:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:58:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:58:33 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:58:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:58:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:58:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:58:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:58:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:58:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:58:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:58:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:58:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:58:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:58:37 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:58:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:58:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:58:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:58:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:58:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:58:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:58:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:58:41 - job_xml_thread(): Done retrieving: data size 43844491
Sat 18 Jan 2014 05:58:41 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:58:41 - XML: Start document: iteration 7
Sat 18 Jan 2014 05:58:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43844491
Sat 18 Jan 2014 05:58:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:58:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43844491
Sat 18 Jan 2014 05:58:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:58:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:58:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:58:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:58:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:58:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:58:57 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:58:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:58:58 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:58:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 05:58:58 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:58:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 05:58:59 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8469 values 133467 bits 16683 bytes 
Sat 18 Jan 2014 05:59:02 - XML: Processed 655304 elements - found 550 jobs
Sat 18 Jan 2014 05:59:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:59:03 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:59:03 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:59:03 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:59:03 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:59:03 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:59:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:59:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:59:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:59:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:59:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:59:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:59:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:59:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:59:05 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:59:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:59:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:59:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:59:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:59:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:59:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:59:05 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 05:59:05 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 05:59:05 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:59:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:59:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43814814
Sat 18 Jan 2014 05:59:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:59:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43814814
Sat 18 Jan 2014 05:59:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:59:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:59:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:59:18 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:59:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:59:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:59:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:59:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:59:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:59:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:59:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:59:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:59:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:59:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:59:21 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:59:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:59:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:59:21 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 05:59:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 05:59:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:59:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:59:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:59:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:59:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:59:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:59:23 - job_xml_thread(): Done retrieving: data size 43765127
Sat 18 Jan 2014 05:59:23 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 05:59:23 - XML: Start document: iteration 8
Sat 18 Jan 2014 05:59:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43765127
Sat 18 Jan 2014 05:59:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:59:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43765127
Sat 18 Jan 2014 05:59:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:59:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:59:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:59:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:59:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:59:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:59:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:59:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 05:59:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:59:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:59:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:59:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:59:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:59:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:59:42 - XML: Processed 654556 elements - found 550 jobs
Sat 18 Jan 2014 05:59:42 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 05:59:42 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 05:59:42 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 05:59:42 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 05:59:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 05:59:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 05:59:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 05:59:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 05:59:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:59:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 05:59:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 05:59:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 05:59:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 05:59:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43208421
Sat 18 Jan 2014 05:59:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 05:59:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43208421
Sat 18 Jan 2014 05:59:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 05:59:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:59:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 05:59:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 05:59:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 05:59:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 05:59:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:59:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:59:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 05:59:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 05:59:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:59:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 05:59:57 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 05:59:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 05:59:59 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 05:59:59 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:59:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 05:59:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 05:59:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 05:59:59 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:00:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8934 values 140842 bits 17605 bytes 
Sat 18 Jan 2014 06:00:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:00:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:00:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:00:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:00:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:00:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:00:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:00:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:00:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:00:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43166470
Sat 18 Jan 2014 06:00:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:00:03 - job_xml_thread(): Done retrieving: data size 43166470
Sat 18 Jan 2014 06:00:03 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:00:03 - XML: Start document: iteration 9
Sat 18 Jan 2014 06:00:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43166470
Sat 18 Jan 2014 06:00:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:00:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:00:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:00:15 - XML: Processed 647106 elements - found 550 jobs
Sat 18 Jan 2014 06:00:16 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:00:16 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:00:16 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:00:16 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:00:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:00:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:00:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:00:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:00:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:00:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:00:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:00:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:00:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:00:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:00:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:00:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:00:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:00:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:00:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:00:25 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:00:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 06:00:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:00:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:00:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:00:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:00:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:00:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:00:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43263126
Sat 18 Jan 2014 06:00:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:00:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43263126
Sat 18 Jan 2014 06:00:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:00:31 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:00:31 - job_xml_thread(): Done retrieving: data size 43263126
Sat 18 Jan 2014 06:00:31 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:00:31 - XML: Start document: iteration 10
Sat 18 Jan 2014 06:00:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:00:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:00:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:00:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:00:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:00:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:00:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:00:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:00:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:00:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:00:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:00:43 - XML: Processed 647970 elements - found 550 jobs
Sat 18 Jan 2014 06:00:43 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:00:43 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:00:43 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:00:43 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:00:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:00:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:00:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:00:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:00:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:00:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:00:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:00:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:00:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:00:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43760198
Sat 18 Jan 2014 06:00:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:00:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43760198
Sat 18 Jan 2014 06:00:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:00:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:00:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:00:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:00:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:00:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:00:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:00:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:00:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:00:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:00:58 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:01:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:01:00 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:01:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:01:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:01:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:01:00 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:01:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 06:01:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 06:01:00 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:01:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8727 values 137568 bits 17196 bytes 
Sat 18 Jan 2014 06:01:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:01:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:01:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:01:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:01:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:01:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:01:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:01:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43829689
Sat 18 Jan 2014 06:01:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:01:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43829689
Sat 18 Jan 2014 06:01:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:01:03 - job_xml_thread(): Done retrieving: data size 43829689
Sat 18 Jan 2014 06:01:03 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:01:03 - XML: Start document: iteration 11
Sat 18 Jan 2014 06:01:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:01:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:01:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:01:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:01:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:01:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:01:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:01:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:01:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:01:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:01:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:01:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:01:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:01:23 - XML: Processed 655306 elements - found 550 jobs
Sat 18 Jan 2014 06:01:23 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:01:23 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:01:23 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:01:23 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:01:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:01:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:01:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:01:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:01:26 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:01:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 06:01:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:01:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:01:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:01:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:01:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:01:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:01:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43815412
Sat 18 Jan 2014 06:01:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:01:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43815412
Sat 18 Jan 2014 06:01:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:01:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:01:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:01:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:01:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:01:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:01:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:01:38 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:01:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:01:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:01:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:01:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:01:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:01:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:01:41 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:01:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:01:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:01:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:01:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:01:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:01:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:01:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:01:43 - job_xml_thread(): Done retrieving: data size 43842155
Sat 18 Jan 2014 06:01:43 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:01:43 - XML: Start document: iteration 12
Sat 18 Jan 2014 06:01:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43842155
Sat 18 Jan 2014 06:01:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43842155
Sat 18 Jan 2014 06:01:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:01:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:01:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:01:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:01:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:01:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:01:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:01:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:01:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:01:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:01:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:01:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:01:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:01:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:01:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:02:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:02:01 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:02:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:02:01 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:02:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 06:02:01 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:02:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 06:02:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8292 values 130895 bits 16361 bytes 
Sat 18 Jan 2014 06:02:02 - XML: Processed 655306 elements - found 550 jobs
Sat 18 Jan 2014 06:02:03 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:02:03 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:02:03 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:02:03 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:02:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:02:05 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:02:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:02:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:02:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:02:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:02:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:02:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:02:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:02:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43827311
Sat 18 Jan 2014 06:02:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:02:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43827311
Sat 18 Jan 2014 06:02:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:02:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:02:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:02:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:02:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:02:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:02:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:02:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:02:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:02:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43827311
Sat 18 Jan 2014 06:02:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:02:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:02:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:02:18 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:02:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:02:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:02:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:02:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:02:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:02:30 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:02:30 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:02:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:02:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:02:31 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:02:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 06:02:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:02:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:02:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:02:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:02:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:02:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:02:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:02:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:02:32 - job_xml_thread(): Done retrieving: data size 43804583
Sat 18 Jan 2014 06:02:32 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:02:32 - XML: Start document: iteration 13
Sat 18 Jan 2014 06:02:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:02:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:02:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:02:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:02:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43804583
Sat 18 Jan 2014 06:02:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:02:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43804583
Sat 18 Jan 2014 06:02:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:02:35 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 06:02:35 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:02:36 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:02:36 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:02:36 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 06:02:36 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 06:02:36 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 06:02:46 - XML: Processed 655306 elements - found 550 jobs
Sat 18 Jan 2014 06:02:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:02:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:02:46 - size of cluster 'LISA Cluster': 624 hosts 79466 metrics 853277 values 13468395 bits 1683549 bytes 
Sat 18 Jan 2014 06:02:47 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:02:47 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:02:47 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:02:47 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:02:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:02:49 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:02:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:02:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:02:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:02:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:02:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:02:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:02:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:02:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:02:52 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:02:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:02:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:02:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:02:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:02:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:02:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:02:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:02:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856460
Sat 18 Jan 2014 06:02:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:02:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43856460
Sat 18 Jan 2014 06:02:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:03:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:03:01 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:03:02 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:03:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 06:03:02 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:03:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:03:02 - job_xml_thread(): Done retrieving: data size 43856460
Sat 18 Jan 2014 06:03:02 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:03:02 - XML: Start document: iteration 14
Sat 18 Jan 2014 06:03:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 06:03:02 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:03:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8899 values 140769 bits 17596 bytes 
Sat 18 Jan 2014 06:03:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:03:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:03:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:03:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:03:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:03:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:03:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:03:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:03:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:03:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:03:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:03:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:03:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:03:15 - XML: Processed 655304 elements - found 549 jobs
Sat 18 Jan 2014 06:03:15 - job 7348750 appears to have finished
Sat 18 Jan 2014 06:03:15 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 06:03:15 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 06:03:16 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 06:03:16 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:03:16 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:03:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:03:19 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:03:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:03:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:03:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:03:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:03:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:03:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:03:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:03:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43829862
Sat 18 Jan 2014 06:03:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:03:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43829862
Sat 18 Jan 2014 06:03:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:03:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:03:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:03:31 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:03:31 - job_xml_thread(): Done retrieving: data size 43829862
Sat 18 Jan 2014 06:03:31 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:03:31 - XML: Start document: iteration 15
Sat 18 Jan 2014 06:03:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:03:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:03:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:03:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:03:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:03:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:03:36 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:03:36 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 06:03:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:03:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:03:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:03:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:03:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:03:42 - XML: Processed 655304 elements - found 549 jobs
Sat 18 Jan 2014 06:03:42 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:03:42 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:03:42 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:03:42 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:03:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:03:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:03:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:03:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:03:44 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:03:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 06:03:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:03:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:03:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:03:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:03:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:03:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:03:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43814826
Sat 18 Jan 2014 06:03:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:03:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43814826
Sat 18 Jan 2014 06:03:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:03:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:03:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:03:57 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:03:57 - job_xml_thread(): Done retrieving: data size 43814826
Sat 18 Jan 2014 06:03:57 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:03:57 - XML: Start document: iteration 16
Sat 18 Jan 2014 06:03:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:03:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:04:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:04:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:04:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:04:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:04:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:04:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:04:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:04:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:04:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:04:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:04:02 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:04:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:04:03 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:04:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 06:04:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 06:04:04 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:04:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5821 values 91944 bits 11493 bytes 
Sat 18 Jan 2014 06:04:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:04:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:04:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:04:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:04:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:04:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:04:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:04:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:04:11 - XML: Processed 655304 elements - found 549 jobs
Sat 18 Jan 2014 06:04:11 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:04:11 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:04:11 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:04:11 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:04:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:04:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43809201
Sat 18 Jan 2014 06:04:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43809201
Sat 18 Jan 2014 06:04:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:04:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:04:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:04:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:04:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:04:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:04:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:04:26 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:04:26 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:04:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:04:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:04:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:04:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:04:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:04:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:04:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:04:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:04:31 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:04:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:04:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:04:32 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:04:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 06:04:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:04:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:04:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:04:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:04:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:04:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:04:35 - job_xml_thread(): Done retrieving: data size 43832600
Sat 18 Jan 2014 06:04:35 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:04:35 - XML: Start document: iteration 17
Sat 18 Jan 2014 06:04:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43832600
Sat 18 Jan 2014 06:04:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:04:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43832600
Sat 18 Jan 2014 06:04:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:04:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:04:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:04:47 - XML: Processed 655304 elements - found 549 jobs
Sat 18 Jan 2014 06:04:47 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:04:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:04:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:04:47 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:04:47 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:04:47 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:04:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:04:53 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:04:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:04:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:04:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:04:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:04:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:04:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:04:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:04:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:04:56 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:04:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:04:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:04:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:04:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:04:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:04:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:05:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:05:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43827798
Sat 18 Jan 2014 06:05:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:05:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43827798
Sat 18 Jan 2014 06:05:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:05:02 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:05:02 - job_xml_thread(): Done retrieving: data size 43827798
Sat 18 Jan 2014 06:05:02 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:05:02 - XML: Start document: iteration 18
Sat 18 Jan 2014 06:05:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:05:03 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:05:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:05:05 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:05:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 06:05:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 06:05:05 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:05:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9075 values 143164 bits 17895 bytes 
Sat 18 Jan 2014 06:05:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:05:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:05:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:05:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:05:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:05:14 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:05:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:05:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:05:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:05:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:05:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:05:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:05:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:05:20 - XML: Processed 655300 elements - found 547 jobs
Sat 18 Jan 2014 06:05:20 - job 7348754 appears to have finished
Sat 18 Jan 2014 06:05:20 - job 7337029 appears to have finished
Sat 18 Jan 2014 06:05:20 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 06:05:20 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 06:05:21 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 06:05:21 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:05:21 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:05:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:05:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:05:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:05:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:05:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:05:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:05:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:05:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:05:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:05:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43757857
Sat 18 Jan 2014 06:05:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:05:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43757857
Sat 18 Jan 2014 06:05:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:05:29 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:05:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 06:05:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:05:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:05:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:05:36 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:05:36 - job_xml_thread(): Done retrieving: data size 43757857
Sat 18 Jan 2014 06:05:36 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:05:36 - XML: Start document: iteration 19
Sat 18 Jan 2014 06:05:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:05:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:05:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:05:43 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:05:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:05:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:05:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:05:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:05:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:05:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:05:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:05:50 - XML: Processed 654552 elements - found 547 jobs
Sat 18 Jan 2014 06:05:50 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:05:50 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:05:50 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:05:50 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:05:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:05:53 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:05:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:05:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:05:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:05:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:05:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:05:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:05:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:05:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43210479
Sat 18 Jan 2014 06:05:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:05:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43210479
Sat 18 Jan 2014 06:05:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:05:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:05:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:06:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:06:05 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:06:05 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:06:05 - job_xml_thread(): Done retrieving: data size 43210479
Sat 18 Jan 2014 06:06:05 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:06:05 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:06:05 - XML: Start document: iteration 20
Sat 18 Jan 2014 06:06:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 06:06:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:06:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 06:06:06 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:06:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99067 bits 12383 bytes 
Sat 18 Jan 2014 06:06:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:06:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:06:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:06:10 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:06:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:06:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:06:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:06:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:06:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:06:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:06:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:06:16 - XML: Processed 647686 elements - found 547 jobs
Sat 18 Jan 2014 06:06:16 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:06:16 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:06:16 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:06:16 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:06:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:06:20 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:06:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:06:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:06:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:06:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:06:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:06:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:06:23 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 06:06:23 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 06:06:23 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:06:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:06:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43226107
Sat 18 Jan 2014 06:06:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:06:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43226107
Sat 18 Jan 2014 06:06:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:06:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:06:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:06:31 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:06:31 - job_xml_thread(): Done retrieving: data size 43226107
Sat 18 Jan 2014 06:06:31 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:06:31 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 06:06:32 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 06:06:32 - Housekeeping: done.
Sat 18 Jan 2014 06:06:32 - XML: Start document: iteration 0
Sat 18 Jan 2014 06:06:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:06:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:06:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:06:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:06:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:06:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:06:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:06:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:06:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:06:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:06:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:06:41 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:06:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 06:06:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:06:46 - XML: Processed 647848 elements - found 547 jobs
Sat 18 Jan 2014 06:06:46 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:06:46 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:06:47 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:06:47 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:06:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:06:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:06:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:06:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:06:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:06:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:06:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:06:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:06:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:06:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43774102
Sat 18 Jan 2014 06:06:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:06:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43774102
Sat 18 Jan 2014 06:06:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:06:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:06:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:06:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:06:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:06:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:06:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:07:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:07:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:07:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:07:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:07:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:07:02 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:07:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:07:02 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:07:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:07:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:07:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:07:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:07:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:07:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:07:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:07:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43834394
Sat 18 Jan 2014 06:07:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:07:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43834394
Sat 18 Jan 2014 06:07:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:07:05 - job_xml_thread(): Done retrieving: data size 43834394
Sat 18 Jan 2014 06:07:05 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:07:05 - XML: Start document: iteration 1
Sat 18 Jan 2014 06:07:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:07:05 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:07:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:07:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 06:07:06 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:07:06 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:07:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 06:07:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9213 values 145346 bits 18168 bytes 
Sat 18 Jan 2014 06:07:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:07:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:07:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:07:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:07:21 - XML: Processed 655298 elements - found 546 jobs
Sat 18 Jan 2014 06:07:21 - job 7348753 appears to have finished
Sat 18 Jan 2014 06:07:21 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 06:07:21 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 06:07:21 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 06:07:21 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:07:22 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:07:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:07:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:07:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:07:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:07:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:07:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:07:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:07:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:07:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:07:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:07:27 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:07:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:07:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:07:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:07:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:07:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:07:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:07:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:07:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43822073
Sat 18 Jan 2014 06:07:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:07:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43822073
Sat 18 Jan 2014 06:07:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:07:37 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:07:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:07:37 - job_xml_thread(): Done retrieving: data size 43822073
Sat 18 Jan 2014 06:07:37 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:07:37 - XML: Start document: iteration 2
Sat 18 Jan 2014 06:07:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:07:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:07:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:07:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:07:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:07:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:07:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43822073
Sat 18 Jan 2014 06:07:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:07:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:07:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:07:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:07:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:07:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:07:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:07:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:07:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:07:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:07:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:07:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:07:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:07:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:07:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:07:56 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:07:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 06:07:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:07:57 - XML: Processed 655298 elements - found 546 jobs
Sat 18 Jan 2014 06:07:57 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:07:57 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:07:57 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:07:57 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:07:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:07:59 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:07:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:07:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:08:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:08:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:08:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:08:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:08:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:08:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43817400
Sat 18 Jan 2014 06:08:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:08:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43817400
Sat 18 Jan 2014 06:08:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:08:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:08:07 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:08:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:08:09 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:08:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 06:08:09 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:08:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 06:08:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6189 values 97619 bits 12202 bytes 
Sat 18 Jan 2014 06:08:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:08:10 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:08:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:08:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:08:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:08:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:08:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:08:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:08:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:08:12 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:08:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:08:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:08:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:08:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:08:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:08:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:08:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:08:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:08:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:08:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43826792
Sat 18 Jan 2014 06:08:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:08:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43826792
Sat 18 Jan 2014 06:08:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:08:18 - job_xml_thread(): Done retrieving: data size 43826792
Sat 18 Jan 2014 06:08:18 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:08:18 - XML: Start document: iteration 3
Sat 18 Jan 2014 06:08:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:08:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:08:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:08:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:08:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:08:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:08:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:08:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:08:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:08:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:08:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:08:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:08:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:08:39 - XML: Processed 655298 elements - found 546 jobs
Sat 18 Jan 2014 06:08:39 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:08:39 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:08:39 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:08:39 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:08:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:08:40 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:08:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:08:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:08:40 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:08:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 06:08:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:08:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:08:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:08:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:08:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:08:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:08:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43841239
Sat 18 Jan 2014 06:08:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:08:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43841239
Sat 18 Jan 2014 06:08:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:08:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:08:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:08:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:08:52 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:08:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:08:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:08:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:08:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:08:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:08:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:08:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:08:54 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:08:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:08:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:08:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:08:56 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:08:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:08:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:08:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:08:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:08:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:08:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:08:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:08:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43836074
Sat 18 Jan 2014 06:08:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:08:58 - job_xml_thread(): Done retrieving: data size 43836074
Sat 18 Jan 2014 06:08:58 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:08:58 - XML: Start document: iteration 4
Sat 18 Jan 2014 06:08:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43836074
Sat 18 Jan 2014 06:08:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:09:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:09:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:09:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:09:09 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:09:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:09:10 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:09:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 06:09:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 06:09:11 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:09:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9030 values 142389 bits 17798 bytes 
Sat 18 Jan 2014 06:09:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:09:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:09:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:09:13 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:09:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:09:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:09:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:09:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:09:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:09:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:09:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:09:15 - XML: Processed 655298 elements - found 546 jobs
Sat 18 Jan 2014 06:09:15 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:09:15 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:09:15 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:09:15 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:09:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:09:20 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:09:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:09:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:09:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:09:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:09:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:09:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:09:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:09:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43835263
Sat 18 Jan 2014 06:09:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:09:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43835263
Sat 18 Jan 2014 06:09:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:09:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:09:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:09:30 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:09:30 - job_xml_thread(): Done retrieving: data size 43835263
Sat 18 Jan 2014 06:09:30 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:09:30 - XML: Start document: iteration 5
Sat 18 Jan 2014 06:09:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:09:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:09:37 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 06:09:37 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:09:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:09:38 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:09:38 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 06:09:38 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 06:09:38 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:09:38 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 06:09:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:09:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:09:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sat 18 Jan 2014 06:09:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:09:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:09:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:09:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:09:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:09:41 - XML: Processed 655298 elements - found 546 jobs
Sat 18 Jan 2014 06:09:41 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:09:41 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:09:41 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:09:41 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:09:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:09:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:09:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:09:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:09:44 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:09:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 06:09:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:09:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:09:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:09:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:09:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:09:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:09:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43825814
Sat 18 Jan 2014 06:09:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:09:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43825814
Sat 18 Jan 2014 06:09:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:09:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:09:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:09:56 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:09:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:09:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:09:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:09:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:09:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:09:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:09:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:09:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:09:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:09:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:09:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:10:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:10:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:10:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:10:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:10:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:10:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:10:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:10:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:10:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:10:02 - job_xml_thread(): Done retrieving: data size 43820111
Sat 18 Jan 2014 06:10:02 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:10:02 - XML: Start document: iteration 6
Sat 18 Jan 2014 06:10:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43820111
Sat 18 Jan 2014 06:10:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43820111
Sat 18 Jan 2014 06:10:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:10:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:10:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:10:11 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:10:12 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:10:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:10:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 06:10:12 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:10:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 06:10:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:10:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:10:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:10:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:10:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:10:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:10:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:10:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:10:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8813 values 138892 bits 17361 bytes 
Sat 18 Jan 2014 06:10:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:10:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:10:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:10:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:10:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:10:18 - XML: Processed 655298 elements - found 546 jobs
Sat 18 Jan 2014 06:10:18 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:10:18 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:10:18 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:10:18 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:10:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:10:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:10:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:10:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:10:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:10:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:10:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:10:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:10:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:10:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43832213
Sat 18 Jan 2014 06:10:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:10:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43832213
Sat 18 Jan 2014 06:10:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:10:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:10:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:10:33 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:10:33 - job_xml_thread(): Done retrieving: data size 43832213
Sat 18 Jan 2014 06:10:33 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:10:33 - XML: Start document: iteration 7
Sat 18 Jan 2014 06:10:38 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:10:38 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:10:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:10:39 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:10:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:10:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:10:39 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:10:40 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 06:10:40 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:10:40 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 06:10:40 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 06:10:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:10:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:10:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:10:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:10:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:10:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:10:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:10:44 - size of cluster 'LISA Cluster': 624 hosts 79481 metrics 915777 values 14441974 bits 1805246 bytes 
Sat 18 Jan 2014 06:10:45 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:10:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 06:10:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:10:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:10:46 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:10:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:10:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:10:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:10:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:10:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:10:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:10:50 - XML: Processed 655298 elements - found 546 jobs
Sat 18 Jan 2014 06:10:50 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:10:50 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:10:50 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:10:50 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:10:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:10:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43819223
Sat 18 Jan 2014 06:10:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:10:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43819223
Sat 18 Jan 2014 06:10:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:10:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:10:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:11:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:11:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:11:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:11:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:11:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:11:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:11:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:11:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:11:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:11:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:11:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:11:05 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:11:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:11:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:11:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:11:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:11:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:11:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:11:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:11:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:11:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:11:12 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:11:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:11:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43773214
Sat 18 Jan 2014 06:11:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:11:13 - job_xml_thread(): Done retrieving: data size 43773214
Sat 18 Jan 2014 06:11:13 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:11:13 - XML: Start document: iteration 8
Sat 18 Jan 2014 06:11:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43773214
Sat 18 Jan 2014 06:11:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:11:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:11:13 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:11:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 06:11:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 06:11:13 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:11:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5886 values 92817 bits 11602 bytes 
Sat 18 Jan 2014 06:11:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:11:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:11:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:11:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:11:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:11:33 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:11:33 - XML: Processed 654550 elements - found 546 jobs
Sat 18 Jan 2014 06:11:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:11:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:11:33 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:11:33 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:11:33 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:11:33 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:11:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:11:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:11:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:11:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:11:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:11:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:11:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:11:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:11:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:11:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:11:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:11:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:11:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:11:40 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:11:40 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 06:11:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:11:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43266729
Sat 18 Jan 2014 06:11:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:11:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43266729
Sat 18 Jan 2014 06:11:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:11:48 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:11:48 - job_xml_thread(): Done retrieving: data size 43266729
Sat 18 Jan 2014 06:11:48 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:11:48 - XML: Start document: iteration 9
Sat 18 Jan 2014 06:11:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:11:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:11:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:11:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:11:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:11:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:11:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:11:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:11:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:11:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:11:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:11:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:11:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:11:59 - XML: Processed 648114 elements - found 546 jobs
Sat 18 Jan 2014 06:11:59 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:11:59 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:11:59 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:11:59 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:12:01 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:12:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 06:12:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:12:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:12:02 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:12:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:12:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:12:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:12:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:12:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:12:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:12:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:12:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43161578
Sat 18 Jan 2014 06:12:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:12:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43161578
Sat 18 Jan 2014 06:12:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:12:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:12:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:12:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:12:13 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:12:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:12:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 06:12:13 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:12:13 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:12:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 06:12:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5788 values 91222 bits 11402 bytes 
Sat 18 Jan 2014 06:12:14 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:12:14 - job_xml_thread(): Done retrieving: data size 43161578
Sat 18 Jan 2014 06:12:14 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:12:14 - XML: Start document: iteration 10
Sat 18 Jan 2014 06:12:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:12:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:12:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:12:18 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:12:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:12:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:12:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:12:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:12:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:12:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:12:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:12:26 - XML: Processed 647098 elements - found 546 jobs
Sat 18 Jan 2014 06:12:26 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:12:26 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:12:26 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:12:26 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:12:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:12:29 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:12:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:12:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:12:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:12:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:12:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:12:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:12:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:12:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43534027
Sat 18 Jan 2014 06:12:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:12:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43534027
Sat 18 Jan 2014 06:12:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:12:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:12:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:12:41 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:12:41 - job_xml_thread(): Done retrieving: data size 43534027
Sat 18 Jan 2014 06:12:41 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:12:41 - XML: Start document: iteration 11
Sat 18 Jan 2014 06:12:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:12:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:12:49 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:12:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 06:12:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:12:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:12:54 - XML: Processed 652048 elements - found 546 jobs
Sat 18 Jan 2014 06:12:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:12:54 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:12:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:12:54 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:12:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:12:54 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:12:54 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:12:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:12:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:12:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:12:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:12:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:12:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:12:57 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:12:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:12:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:12:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:12:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:12:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:12:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:13:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:13:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43812900
Sat 18 Jan 2014 06:13:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:13:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43812900
Sat 18 Jan 2014 06:13:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:13:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:13:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:13:10 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:13:10 - job_xml_thread(): Done retrieving: data size 43812900
Sat 18 Jan 2014 06:13:10 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:13:10 - XML: Start document: iteration 12
Sat 18 Jan 2014 06:13:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:13:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:13:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:13:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:13:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:13:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:13:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:13:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:13:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:13:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:13:14 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:13:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:13:14 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:13:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 06:13:14 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:13:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 06:13:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6135 values 96734 bits 12091 bytes 
Sat 18 Jan 2014 06:13:19 - XML: Processed 655128 elements - found 546 jobs
Sat 18 Jan 2014 06:13:19 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:13:19 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:13:19 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:13:19 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:13:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:13:23 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:13:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:13:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:13:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:13:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:13:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:13:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:13:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:13:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:13:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:13:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43807117
Sat 18 Jan 2014 06:13:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:13:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43807117
Sat 18 Jan 2014 06:13:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:13:34 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:13:34 - job_xml_thread(): Done retrieving: data size 43807117
Sat 18 Jan 2014 06:13:34 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:13:34 - XML: Start document: iteration 13
Sat 18 Jan 2014 06:13:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:13:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:13:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:13:42 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:13:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:13:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:13:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:13:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:13:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:13:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:13:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:13:44 - XML: Processed 655298 elements - found 546 jobs
Sat 18 Jan 2014 06:13:44 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:13:44 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:13:44 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:13:44 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:13:48 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:13:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 06:13:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:13:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:13:49 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:13:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:13:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:13:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:13:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:13:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:13:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:13:49 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 06:13:49 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 06:13:49 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:13:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:13:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43822042
Sat 18 Jan 2014 06:13:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:13:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43822042
Sat 18 Jan 2014 06:13:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:13:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:13:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:13:59 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:13:59 - job_xml_thread(): Done retrieving: data size 43822042
Sat 18 Jan 2014 06:13:59 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:14:00 - XML: Start document: iteration 14
Sat 18 Jan 2014 06:14:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:14:00 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:14:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:14:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:14:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:14:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:14:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:14:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:14:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:14:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:14:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:14:12 - XML: Processed 655298 elements - found 546 jobs
Sat 18 Jan 2014 06:14:12 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:14:12 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:14:12 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:14:12 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:14:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:14:13 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:14:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:14:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:14:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:14:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:14:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:14:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:14:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:14:14 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:14:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:14:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43809915
Sat 18 Jan 2014 06:14:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:14:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43809915
Sat 18 Jan 2014 06:14:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:14:16 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:14:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 06:14:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:14:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:14:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 06:14:17 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:14:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:14:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8926 values 140715 bits 17589 bytes 
Sat 18 Jan 2014 06:14:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:14:25 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:14:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:14:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:14:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:14:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:14:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:14:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:14:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:14:27 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:14:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:14:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:14:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:14:29 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:14:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:14:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:14:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:14:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:14:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:14:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:14:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:14:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43828061
Sat 18 Jan 2014 06:14:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:14:32 - job_xml_thread(): Done retrieving: data size 43828061
Sat 18 Jan 2014 06:14:32 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:14:32 - XML: Start document: iteration 15
Sat 18 Jan 2014 06:14:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43828061
Sat 18 Jan 2014 06:14:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:14:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:14:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:14:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:14:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:14:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:14:47 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:14:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:14:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:14:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:14:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:14:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:14:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:14:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:14:51 - XML: Processed 655298 elements - found 546 jobs
Sat 18 Jan 2014 06:14:51 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:14:51 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:14:52 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:14:52 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:14:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:14:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:14:55 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:14:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 06:14:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:14:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:14:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:14:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:14:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:14:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:14:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:14:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:14:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43838733
Sat 18 Jan 2014 06:14:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:14:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43838733
Sat 18 Jan 2014 06:14:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:15:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:15:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:15:07 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:15:07 - job_xml_thread(): Done retrieving: data size 43838733
Sat 18 Jan 2014 06:15:07 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:15:07 - XML: Start document: iteration 16
Sat 18 Jan 2014 06:15:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:15:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:15:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:15:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:15:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:15:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:15:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:15:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:15:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:15:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:15:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:15:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:15:17 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:15:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:15:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:15:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:15:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:15:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:15:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 06:15:18 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:15:18 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:15:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 06:15:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5889 values 92874 bits 11609 bytes 
Sat 18 Jan 2014 06:15:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:15:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:15:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:15:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:15:19 - XML: Processed 655294 elements - found 544 jobs
Sat 18 Jan 2014 06:15:19 - job 7348751 appears to have finished
Sat 18 Jan 2014 06:15:19 - job 7348393 appears to have finished
Sat 18 Jan 2014 06:15:19 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 06:15:19 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 06:15:19 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 06:15:19 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:15:19 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:15:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:15:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43813548
Sat 18 Jan 2014 06:15:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:15:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43813548
Sat 18 Jan 2014 06:15:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:15:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:15:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:15:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:15:33 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:15:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:15:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:15:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:15:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:15:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:15:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:15:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:15:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:15:34 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:15:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:15:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:15:37 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:15:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:15:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:15:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:15:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:15:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:15:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:15:38 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:15:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 06:15:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:15:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:15:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43838828
Sat 18 Jan 2014 06:15:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:15:39 - job_xml_thread(): Done retrieving: data size 43838828
Sat 18 Jan 2014 06:15:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43838828
Sat 18 Jan 2014 06:15:39 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:15:39 - XML: Start document: iteration 17
Sat 18 Jan 2014 06:15:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:15:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:15:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:15:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:15:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:15:55 - XML: Processed 655294 elements - found 544 jobs
Sat 18 Jan 2014 06:15:55 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:15:55 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:15:55 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:15:56 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:15:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:15:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:15:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:15:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:15:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:15:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:15:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:15:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:15:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:16:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:16:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:16:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:16:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:16:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:16:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:16:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:16:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:16:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:16:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43837314
Sat 18 Jan 2014 06:16:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:16:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43837314
Sat 18 Jan 2014 06:16:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:16:11 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:16:11 - job_xml_thread(): Done retrieving: data size 43837314
Sat 18 Jan 2014 06:16:11 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:16:11 - XML: Start document: iteration 18
Sat 18 Jan 2014 06:16:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:16:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:16:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:16:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:16:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:16:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:16:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:16:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:16:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:16:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:16:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:16:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:16:18 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:16:19 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:16:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 06:16:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:16:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 06:16:19 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:16:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8011 values 126423 bits 15802 bytes 
Sat 18 Jan 2014 06:16:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:16:22 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:16:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:16:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:16:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:16:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:16:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:16:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:16:24 - XML: Processed 655294 elements - found 544 jobs
Sat 18 Jan 2014 06:16:24 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:16:24 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:16:24 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:16:24 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:16:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:16:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43828864
Sat 18 Jan 2014 06:16:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:16:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43828864
Sat 18 Jan 2014 06:16:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:16:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:16:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:16:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:16:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:16:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:16:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:16:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:16:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:16:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:16:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:16:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:16:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:16:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:16:39 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:16:41 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:16:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 06:16:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:16:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:16:42 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:16:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:16:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:16:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:16:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:16:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:16:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:16:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:16:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43845664
Sat 18 Jan 2014 06:16:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:16:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43845664
Sat 18 Jan 2014 06:16:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:16:44 - job_xml_thread(): Done retrieving: data size 43845664
Sat 18 Jan 2014 06:16:44 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:16:44 - XML: Start document: iteration 19
Sat 18 Jan 2014 06:16:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:16:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:16:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:16:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:16:59 - XML: Processed 655294 elements - found 544 jobs
Sat 18 Jan 2014 06:16:59 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:16:59 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:16:59 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:17:00 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:17:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:17:00 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:17:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:17:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:17:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:17:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:17:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:17:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:17:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:17:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:17:05 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:17:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:17:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:17:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:17:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:17:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:17:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:17:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:17:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43847966
Sat 18 Jan 2014 06:17:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:17:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43847966
Sat 18 Jan 2014 06:17:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:17:15 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:17:15 - job_xml_thread(): Done retrieving: data size 43847966
Sat 18 Jan 2014 06:17:15 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:17:15 - XML: Start document: iteration 20
Sat 18 Jan 2014 06:17:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:17:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:17:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:17:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:17:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:17:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:17:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:17:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:17:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:17:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:17:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:17:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:17:19 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:17:20 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:17:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:17:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:17:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:17:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 06:17:20 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:17:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 06:17:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9204 values 145496 bits 18187 bytes 
Sat 18 Jan 2014 06:17:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:17:29 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:17:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:17:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:17:30 - XML: Processed 655294 elements - found 544 jobs
Sat 18 Jan 2014 06:17:30 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:17:30 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:17:30 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:17:30 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:17:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:17:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:17:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:17:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:17:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:17:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43737098
Sat 18 Jan 2014 06:17:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:17:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43737098
Sat 18 Jan 2014 06:17:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:17:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:17:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:17:40 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 06:17:40 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:17:41 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:17:41 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 06:17:42 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 06:17:42 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:17:42 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 06:17:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:17:43 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:17:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:17:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:17:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:17:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:17:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:17:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:17:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:17:45 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:17:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:17:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:17:47 - size of cluster 'LISA Cluster': 624 hosts 79482 metrics 874309 values 13803400 bits 1725425 bytes 
Sat 18 Jan 2014 06:17:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:17:49 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:17:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:17:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:17:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:17:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:17:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:17:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:17:50 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:17:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 06:17:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:17:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:17:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43226824
Sat 18 Jan 2014 06:17:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:17:53 - job_xml_thread(): Done retrieving: data size 43226824
Sat 18 Jan 2014 06:17:53 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:17:53 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 06:17:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43226824
Sat 18 Jan 2014 06:17:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:17:55 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 06:17:55 - Housekeeping: done.
Sat 18 Jan 2014 06:17:55 - XML: Start document: iteration 0
Sat 18 Jan 2014 06:17:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:17:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:18:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:18:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:18:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:18:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:18:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:18:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:18:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:18:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:18:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:18:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:18:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:18:12 - XML: Processed 647738 elements - found 544 jobs
Sat 18 Jan 2014 06:18:12 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:18:12 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:18:12 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:18:12 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:18:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:18:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:18:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:18:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:18:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:18:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:18:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:18:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:18:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:18:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43212391
Sat 18 Jan 2014 06:18:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:18:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43212391
Sat 18 Jan 2014 06:18:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:18:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:18:21 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:18:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:18:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:18:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:18:22 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:18:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 06:18:22 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:18:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 06:18:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8692 values 137407 bits 17175 bytes 
Sat 18 Jan 2014 06:18:27 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:18:27 - job_xml_thread(): Done retrieving: data size 43212391
Sat 18 Jan 2014 06:18:27 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:18:27 - XML: Start document: iteration 1
Sat 18 Jan 2014 06:18:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:18:29 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:18:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:18:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:18:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:18:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:18:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:18:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:18:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:18:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:18:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:18:37 - XML: Processed 647842 elements - found 544 jobs
Sat 18 Jan 2014 06:18:37 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:18:37 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:18:37 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:18:37 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:18:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:18:40 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:18:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:18:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:18:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:18:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:18:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:18:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:18:43 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:18:43 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 06:18:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:18:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43705328
Sat 18 Jan 2014 06:18:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:18:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43705328
Sat 18 Jan 2014 06:18:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:18:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:18:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:18:52 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:18:52 - job_xml_thread(): Done retrieving: data size 43705328
Sat 18 Jan 2014 06:18:52 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:18:52 - XML: Start document: iteration 2
Sat 18 Jan 2014 06:18:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:18:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:18:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:18:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:18:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:18:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:18:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:18:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:18:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:18:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:18:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:19:01 - XML: Processed 653999 elements - found 544 jobs
Sat 18 Jan 2014 06:19:01 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:19:01 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:19:01 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:19:01 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:19:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:19:04 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:19:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:19:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:19:04 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:19:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 06:19:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:19:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:19:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:19:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:19:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:19:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:19:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43832857
Sat 18 Jan 2014 06:19:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:19:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43832857
Sat 18 Jan 2014 06:19:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:19:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:19:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:19:16 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:19:16 - job_xml_thread(): Done retrieving: data size 43832857
Sat 18 Jan 2014 06:19:16 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:19:16 - XML: Start document: iteration 3
Sat 18 Jan 2014 06:19:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:19:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:19:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:19:20 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:19:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:19:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:19:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:19:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:19:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:19:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:19:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:19:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:19:24 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:19:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:19:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 06:19:25 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:19:25 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:19:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 06:19:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6030 values 95200 bits 11900 bytes 
Sat 18 Jan 2014 06:19:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:19:30 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:19:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:19:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:19:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:19:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:19:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:19:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:19:31 - XML: Processed 655294 elements - found 544 jobs
Sat 18 Jan 2014 06:19:31 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:19:31 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:19:31 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:19:31 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:19:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:19:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43798848
Sat 18 Jan 2014 06:19:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:19:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43798848
Sat 18 Jan 2014 06:19:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:19:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:19:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:19:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:19:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:19:46 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:19:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:19:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:19:47 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:19:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:19:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:19:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:19:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:19:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:19:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:19:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:19:52 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:19:52 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:19:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 06:19:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:19:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:19:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:19:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:19:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:19:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:19:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:19:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:19:55 - job_xml_thread(): Done retrieving: data size 43830058
Sat 18 Jan 2014 06:19:55 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:19:55 - XML: Start document: iteration 4
Sat 18 Jan 2014 06:19:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43830058
Sat 18 Jan 2014 06:19:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43830058
Sat 18 Jan 2014 06:19:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:19:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:20:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:20:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:20:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:20:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:20:09 - XML: Processed 655294 elements - found 544 jobs
Sat 18 Jan 2014 06:20:09 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:20:09 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:20:09 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:20:09 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:20:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:20:14 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:20:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:20:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:20:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:20:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:20:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:20:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:20:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:20:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:20:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:20:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:20:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:20:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:20:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:20:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:20:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:20:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:20:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43835313
Sat 18 Jan 2014 06:20:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:20:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43835313
Sat 18 Jan 2014 06:20:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:20:24 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:20:24 - job_xml_thread(): Done retrieving: data size 43835313
Sat 18 Jan 2014 06:20:24 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:20:24 - XML: Start document: iteration 5
Sat 18 Jan 2014 06:20:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:20:25 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:20:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:20:25 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:20:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 06:20:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 06:20:26 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:20:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8941 values 141046 bits 17630 bytes 
Sat 18 Jan 2014 06:20:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:20:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:20:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:20:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:20:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:20:39 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:20:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:20:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:20:39 - XML: Processed 655294 elements - found 544 jobs
Sat 18 Jan 2014 06:20:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:20:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:20:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:20:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:20:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:20:39 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:20:39 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:20:39 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:20:39 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:20:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:20:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:20:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:20:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:20:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:20:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:20:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:20:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:20:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:20:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43821362
Sat 18 Jan 2014 06:20:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:20:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43821362
Sat 18 Jan 2014 06:20:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:20:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:20:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:20:54 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:20:54 - job_xml_thread(): Done retrieving: data size 43821362
Sat 18 Jan 2014 06:20:54 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:20:54 - XML: Start document: iteration 6
Sat 18 Jan 2014 06:20:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:20:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:21:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:21:02 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:21:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:21:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:21:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:21:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:21:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:21:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:21:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:21:09 - XML: Processed 655294 elements - found 544 jobs
Sat 18 Jan 2014 06:21:09 - job 7335209 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 06:21:09 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 06:21:09 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 06:21:10 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 06:21:10 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:21:10 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:21:11 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:21:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 06:21:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:21:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:21:13 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:21:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:21:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:21:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:21:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:21:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:21:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:21:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:21:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43805722
Sat 18 Jan 2014 06:21:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:21:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43805722
Sat 18 Jan 2014 06:21:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:21:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:21:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:21:25 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:21:25 - job_xml_thread(): Done retrieving: data size 43805722
Sat 18 Jan 2014 06:21:25 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:21:25 - XML: Start document: iteration 7
Sat 18 Jan 2014 06:21:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:21:26 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:21:27 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:21:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:21:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 06:21:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 06:21:27 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:21:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5807 values 91546 bits 11443 bytes 
Sat 18 Jan 2014 06:21:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:21:27 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:21:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:21:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:21:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:21:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:21:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:21:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:21:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:21:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:21:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:21:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:21:35 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:21:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:21:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:21:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:21:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:21:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:21:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:21:40 - XML: Processed 655294 elements - found 544 jobs
Sat 18 Jan 2014 06:21:40 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:21:40 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:21:40 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:21:40 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:21:42 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 06:21:42 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 06:21:42 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:21:43 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:21:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 06:21:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:21:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:21:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:21:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:21:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43814961
Sat 18 Jan 2014 06:21:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:21:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43814961
Sat 18 Jan 2014 06:21:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:21:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:21:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:21:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:21:53 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:21:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:21:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:21:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:21:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:21:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:21:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:21:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:21:55 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:21:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:21:57 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:21:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:21:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:21:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:21:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:21:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:21:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:21:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:21:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43826056
Sat 18 Jan 2014 06:21:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:21:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43826056
Sat 18 Jan 2014 06:21:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:21:59 - job_xml_thread(): Done retrieving: data size 43826056
Sat 18 Jan 2014 06:21:59 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:21:59 - XML: Start document: iteration 8
Sat 18 Jan 2014 06:22:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:22:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:22:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:22:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:22:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:22:20 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:22:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:22:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:22:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:22:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:22:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:22:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:22:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:22:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:22:21 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:22:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:22:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:22:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:22:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:22:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:22:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:22:22 - XML: Processed 655294 elements - found 544 jobs
Sat 18 Jan 2014 06:22:22 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:22:22 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:22:22 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:22:22 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:22:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:22:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43852823
Sat 18 Jan 2014 06:22:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:22:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43852823
Sat 18 Jan 2014 06:22:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:22:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:22:27 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:22:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:22:29 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:22:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 06:22:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 06:22:29 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:22:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148585 bits 18573 bytes 
Sat 18 Jan 2014 06:22:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:22:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:22:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:22:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:22:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:22:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:22:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:22:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:22:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:22:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:22:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:22:37 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:22:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:22:39 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:22:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:22:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:22:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:22:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:22:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:22:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:22:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:22:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43838009
Sat 18 Jan 2014 06:22:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:22:42 - job_xml_thread(): Done retrieving: data size 43838009
Sat 18 Jan 2014 06:22:42 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:22:42 - XML: Start document: iteration 9
Sat 18 Jan 2014 06:22:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43838009
Sat 18 Jan 2014 06:22:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:22:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:22:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:22:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:22:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:23:00 - XML: Processed 655291 elements - found 543 jobs
Sat 18 Jan 2014 06:23:00 - job 7348359 appears to have finished
Sat 18 Jan 2014 06:23:00 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 06:23:00 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 06:23:01 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 06:23:01 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:23:01 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:23:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:23:02 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:23:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:23:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:23:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:23:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:23:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:23:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:23:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:23:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:23:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:23:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:23:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:23:04 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:23:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 06:23:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:23:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:23:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:23:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:23:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:23:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:23:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43821811
Sat 18 Jan 2014 06:23:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:23:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43821811
Sat 18 Jan 2014 06:23:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:23:16 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:23:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:23:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:23:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:23:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:23:18 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:23:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:23:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:23:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:23:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:23:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:23:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:23:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:23:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:23:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:23:20 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:23:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:23:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:23:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:23:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:23:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:23:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:23:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:23:22 - job_xml_thread(): Done retrieving: data size 43775590
Sat 18 Jan 2014 06:23:22 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:23:22 - XML: Start document: iteration 10
Sat 18 Jan 2014 06:23:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43775590
Sat 18 Jan 2014 06:23:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:23:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43775590
Sat 18 Jan 2014 06:23:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:23:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:23:29 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:23:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:23:29 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:23:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 06:23:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 06:23:29 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:23:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8847 values 139531 bits 17441 bytes 
Sat 18 Jan 2014 06:23:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:23:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:23:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:23:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:23:39 - XML: Processed 654544 elements - found 543 jobs
Sat 18 Jan 2014 06:23:40 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:23:40 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:23:40 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:23:40 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:23:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:23:43 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:23:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:23:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:23:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:23:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:23:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:23:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:23:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:23:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:23:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:23:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:23:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:23:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:23:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:23:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:23:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:23:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:23:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43214225
Sat 18 Jan 2014 06:23:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:23:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43214225
Sat 18 Jan 2014 06:23:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:23:55 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:23:55 - job_xml_thread(): Done retrieving: data size 43214225
Sat 18 Jan 2014 06:23:55 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:23:55 - XML: Start document: iteration 11
Sat 18 Jan 2014 06:23:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:23:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:23:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:23:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:23:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:23:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:23:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:23:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:23:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:24:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:24:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:24:02 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:24:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 06:24:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:24:08 - XML: Processed 647568 elements - found 543 jobs
Sat 18 Jan 2014 06:24:08 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:24:08 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:24:08 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:24:08 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:24:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:24:10 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:24:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:24:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:24:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:24:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:24:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:24:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:24:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:24:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43177529
Sat 18 Jan 2014 06:24:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:24:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43177529
Sat 18 Jan 2014 06:24:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:24:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:24:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:24:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:24:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:24:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:24:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:24:23 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:24:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:24:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:24:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:24:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:24:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:24:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:24:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:24:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:24:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:24:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:24:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:24:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:24:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:24:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:24:26 - job_xml_thread(): Done retrieving: data size 43307609
Sat 18 Jan 2014 06:24:26 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:24:26 - XML: Start document: iteration 12
Sat 18 Jan 2014 06:24:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43307609
Sat 18 Jan 2014 06:24:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:24:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43307609
Sat 18 Jan 2014 06:24:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:24:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:24:30 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:24:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:24:31 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:24:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 06:24:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 06:24:32 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:24:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9224 values 145455 bits 18181 bytes 
Sat 18 Jan 2014 06:24:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:24:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:24:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:24:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:24:43 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 06:24:43 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:24:43 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:24:43 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:24:43 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 06:24:43 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 06:24:43 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 06:24:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:24:45 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:24:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:24:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:24:45 - XML: Processed 648614 elements - found 543 jobs
Sat 18 Jan 2014 06:24:45 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:24:45 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:24:45 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:24:45 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:24:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:24:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:24:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:24:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:24:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:24:48 - size of cluster 'LISA Cluster': 624 hosts 79477 metrics 817520 values 12892581 bits 1611572 bytes 
Sat 18 Jan 2014 06:24:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:24:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:24:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:24:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:24:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:24:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:24:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:24:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:24:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:24:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43770060
Sat 18 Jan 2014 06:24:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:24:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43770060
Sat 18 Jan 2014 06:24:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:25:01 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:25:01 - job_xml_thread(): Done retrieving: data size 43770060
Sat 18 Jan 2014 06:25:01 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:25:01 - XML: Start document: iteration 13
Sat 18 Jan 2014 06:25:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:25:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:25:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:25:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:25:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:25:13 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:25:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:25:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:25:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:25:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:25:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:25:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:25:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:25:15 - XML: Processed 654436 elements - found 543 jobs
Sat 18 Jan 2014 06:25:15 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:25:15 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:25:15 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:25:15 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:25:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:25:18 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:25:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:25:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:25:18 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:25:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 06:25:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:25:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:25:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:25:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:25:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:25:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:25:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43827005
Sat 18 Jan 2014 06:25:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:25:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43827005
Sat 18 Jan 2014 06:25:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:25:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:25:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:25:30 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:25:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:25:30 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:25:30 - job_xml_thread(): Done retrieving: data size 43827005
Sat 18 Jan 2014 06:25:30 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:25:30 - XML: Start document: iteration 14
Sat 18 Jan 2014 06:25:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:25:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:25:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:25:32 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:25:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:25:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:25:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:25:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:25:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:25:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:25:32 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:25:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 06:25:32 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:25:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 06:25:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5792 values 91330 bits 11416 bytes 
Sat 18 Jan 2014 06:25:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:25:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:25:43 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:25:43 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 06:25:43 - XML: Processed 655292 elements - found 543 jobs
Sat 18 Jan 2014 06:25:43 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:25:43 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:25:43 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:25:43 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:25:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:25:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:25:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:25:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:25:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:25:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:25:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:25:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:25:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:25:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:25:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:25:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43796451
Sat 18 Jan 2014 06:25:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:25:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43796451
Sat 18 Jan 2014 06:25:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:25:57 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:25:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 06:25:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:25:58 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:25:58 - job_xml_thread(): Done retrieving: data size 43796451
Sat 18 Jan 2014 06:25:58 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:25:58 - XML: Start document: iteration 15
Sat 18 Jan 2014 06:26:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:26:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:26:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:26:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:26:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:26:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:26:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:26:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:26:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:26:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:26:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:26:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:26:13 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:26:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:26:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:26:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:26:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:26:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:26:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:26:14 - XML: Processed 655292 elements - found 543 jobs
Sat 18 Jan 2014 06:26:14 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:26:14 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:26:14 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:26:14 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:26:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:26:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43805197
Sat 18 Jan 2014 06:26:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:26:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43805197
Sat 18 Jan 2014 06:26:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:26:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:26:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:26:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:26:26 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:26:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:26:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:26:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:26:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:26:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:26:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:26:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:26:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:26:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:26:29 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:26:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:26:31 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:26:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:26:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:26:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:26:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:26:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:26:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:26:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:26:32 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:26:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:26:32 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:26:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 06:26:32 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:26:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 06:26:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6168 values 97292 bits 12161 bytes 
Sat 18 Jan 2014 06:26:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:26:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43826100
Sat 18 Jan 2014 06:26:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:26:35 - job_xml_thread(): Done retrieving: data size 43826100
Sat 18 Jan 2014 06:26:35 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:26:35 - XML: Start document: iteration 16
Sat 18 Jan 2014 06:26:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43826100
Sat 18 Jan 2014 06:26:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:26:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:26:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:26:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:26:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:26:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:26:52 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:26:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:26:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:26:53 - XML: Processed 655292 elements - found 543 jobs
Sat 18 Jan 2014 06:26:53 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:26:53 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:26:53 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:26:53 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:26:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:26:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:26:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:26:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:26:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:26:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:26:58 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:26:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:26:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:26:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:26:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:26:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:26:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:26:59 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:26:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 06:26:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:27:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:27:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43817764
Sat 18 Jan 2014 06:27:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:27:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43817764
Sat 18 Jan 2014 06:27:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:27:08 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:27:08 - job_xml_thread(): Done retrieving: data size 43817764
Sat 18 Jan 2014 06:27:08 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:27:08 - XML: Start document: iteration 17
Sat 18 Jan 2014 06:27:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:27:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:27:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:27:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:27:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:27:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:27:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:27:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:27:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:27:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:27:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:27:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:27:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:27:21 - XML: Processed 655292 elements - found 543 jobs
Sat 18 Jan 2014 06:27:21 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:27:21 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:27:21 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:27:21 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:27:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:27:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:27:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:27:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:27:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:27:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:27:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:27:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:27:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:27:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43813332
Sat 18 Jan 2014 06:27:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:27:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43813332
Sat 18 Jan 2014 06:27:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:27:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:27:33 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:27:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:27:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:27:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:27:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 06:27:34 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:27:34 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:27:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8451 values 133222 bits 16652 bytes 
Sat 18 Jan 2014 06:27:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 06:27:36 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:27:36 - job_xml_thread(): Done retrieving: data size 43813332
Sat 18 Jan 2014 06:27:36 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:27:36 - XML: Start document: iteration 18
Sat 18 Jan 2014 06:27:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:27:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:27:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:27:43 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:27:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:27:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:27:43 - XML: Processed 655291 elements - found 543 jobs
Sat 18 Jan 2014 06:27:43 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:27:43 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:27:43 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:27:43 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:27:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:27:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:27:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:27:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:27:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:27:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:27:49 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:27:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:27:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:27:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:27:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:27:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:27:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:27:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:27:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43832601
Sat 18 Jan 2014 06:27:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:27:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43832601
Sat 18 Jan 2014 06:27:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:27:58 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:27:58 - job_xml_thread(): Done retrieving: data size 43832601
Sat 18 Jan 2014 06:27:58 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:27:58 - XML: Start document: iteration 19
Sat 18 Jan 2014 06:27:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:28:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:28:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:28:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:28:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:28:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:28:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:28:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:28:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:28:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:28:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:28:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:28:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:28:11 - XML: Processed 655292 elements - found 543 jobs
Sat 18 Jan 2014 06:28:11 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:28:11 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:28:11 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:28:11 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:28:11 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:28:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 06:28:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:28:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:28:16 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:28:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:28:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:28:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:28:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:28:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:28:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:28:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:28:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43820538
Sat 18 Jan 2014 06:28:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:28:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43820538
Sat 18 Jan 2014 06:28:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:28:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:28:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:28:26 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:28:26 - job_xml_thread(): Done retrieving: data size 43820538
Sat 18 Jan 2014 06:28:26 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:28:26 - XML: Start document: iteration 20
Sat 18 Jan 2014 06:28:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:28:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:28:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:28:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:28:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:28:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:28:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:28:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:28:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:28:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:28:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:28:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:28:34 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:28:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:28:35 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:28:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 06:28:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 06:28:36 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:28:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6064 values 95677 bits 11959 bytes 
Sat 18 Jan 2014 06:28:39 - XML: Processed 655292 elements - found 543 jobs
Sat 18 Jan 2014 06:28:39 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:28:39 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:28:39 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:28:39 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:28:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:28:40 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:28:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:28:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:28:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:28:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:28:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:28:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:28:43 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 06:28:43 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 06:28:43 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:28:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:28:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43809863
Sat 18 Jan 2014 06:28:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:28:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:28:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:28:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43809863
Sat 18 Jan 2014 06:28:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:28:54 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:28:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:28:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:28:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:28:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:28:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:28:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:28:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:28:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:28:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:28:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:28:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:29:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:29:01 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:29:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:29:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:29:01 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:29:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 06:29:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:29:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:29:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:29:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:29:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:29:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:29:03 - job_xml_thread(): Done retrieving: data size 43819487
Sat 18 Jan 2014 06:29:03 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:29:03 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 06:29:03 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 06:29:03 - Housekeeping: done.
Sat 18 Jan 2014 06:29:03 - XML: Start document: iteration 0
Sat 18 Jan 2014 06:29:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43819487
Sat 18 Jan 2014 06:29:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43819487
Sat 18 Jan 2014 06:29:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:29:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:29:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:29:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:29:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:29:14 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:29:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:29:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:29:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:29:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:29:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:29:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:29:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:29:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:29:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:29:22 - XML: Processed 655292 elements - found 543 jobs
Sat 18 Jan 2014 06:29:22 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:29:22 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:29:22 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:29:22 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:29:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:29:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:29:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:29:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:29:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:29:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:29:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:29:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:29:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:29:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43771956
Sat 18 Jan 2014 06:29:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:29:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43771956
Sat 18 Jan 2014 06:29:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:29:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:29:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:29:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:29:36 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:29:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:29:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:29:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:29:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:29:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:29:36 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:29:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 06:29:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 06:29:37 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:29:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9090 values 143376 bits 17922 bytes 
Sat 18 Jan 2014 06:29:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:29:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:29:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:29:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:29:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:29:38 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:29:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:29:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:29:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:29:41 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:29:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:29:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:29:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:29:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:29:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:29:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:29:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:29:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43260733
Sat 18 Jan 2014 06:29:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:29:44 - job_xml_thread(): Done retrieving: data size 43260733
Sat 18 Jan 2014 06:29:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43260733
Sat 18 Jan 2014 06:29:44 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:29:44 - XML: Start document: iteration 1
Sat 18 Jan 2014 06:29:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:29:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:29:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:29:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:29:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:30:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:30:00 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:30:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:30:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:30:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:30:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:30:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:30:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:30:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:30:04 - XML: Processed 648196 elements - found 543 jobs
Sat 18 Jan 2014 06:30:04 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:30:04 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:30:04 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:30:04 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:30:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:30:06 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:30:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:30:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:30:06 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:30:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 06:30:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:30:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:30:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:30:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:30:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:30:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:30:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43194164
Sat 18 Jan 2014 06:30:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:30:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43194164
Sat 18 Jan 2014 06:30:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:30:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:30:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:30:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:30:19 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:30:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:30:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:30:19 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:30:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:30:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:30:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:30:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:30:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:30:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:30:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:30:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:30:22 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:30:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:30:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:30:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:30:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:30:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:30:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:30:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:30:23 - job_xml_thread(): Done retrieving: data size 43256218
Sat 18 Jan 2014 06:30:23 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:30:23 - XML: Start document: iteration 2
Sat 18 Jan 2014 06:30:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43256218
Sat 18 Jan 2014 06:30:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43256218
Sat 18 Jan 2014 06:30:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:30:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:30:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:30:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:30:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:30:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:30:37 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:30:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:30:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:30:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 06:30:38 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:30:38 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:30:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 06:30:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9170 values 144643 bits 18080 bytes 
Sat 18 Jan 2014 06:30:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:30:39 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:30:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:30:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:30:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:30:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:30:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:30:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:30:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:30:42 - XML: Processed 647840 elements - found 543 jobs
Sat 18 Jan 2014 06:30:43 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:30:43 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:30:43 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:30:43 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:30:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:30:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:30:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:30:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:30:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:30:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:30:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:30:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:30:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:30:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43777059
Sat 18 Jan 2014 06:30:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:30:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43777059
Sat 18 Jan 2014 06:30:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:30:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:30:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:30:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:30:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:30:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:30:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:30:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:30:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:30:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:30:58 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:31:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:31:01 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:31:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:31:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:31:01 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:31:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 06:31:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:31:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:31:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:31:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:31:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:31:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:31:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43820938
Sat 18 Jan 2014 06:31:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:31:02 - job_xml_thread(): Done retrieving: data size 43820938
Sat 18 Jan 2014 06:31:02 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:31:02 - XML: Start document: iteration 3
Sat 18 Jan 2014 06:31:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43820938
Sat 18 Jan 2014 06:31:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:31:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:31:11 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:31:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:31:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:31:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:31:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:31:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:31:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:31:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:31:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:31:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:31:18 - XML: Processed 655290 elements - found 542 jobs
Sat 18 Jan 2014 06:31:18 - job 7348595 appears to have finished
Sat 18 Jan 2014 06:31:18 - job 7348603 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 06:31:18 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 06:31:19 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 06:31:20 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 06:31:20 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:31:20 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:31:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:31:22 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:31:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:31:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:31:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:31:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:31:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:31:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:31:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:31:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43827843
Sat 18 Jan 2014 06:31:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:31:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43827843
Sat 18 Jan 2014 06:31:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:31:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:31:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:31:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:31:32 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:31:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:31:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:31:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:31:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:31:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:31:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:31:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:31:35 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:31:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:31:37 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:31:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:31:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:31:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:31:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:31:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:31:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:31:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:31:38 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:31:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:31:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43840465
Sat 18 Jan 2014 06:31:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:31:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43840465
Sat 18 Jan 2014 06:31:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:31:39 - job_xml_thread(): Done retrieving: data size 43840465
Sat 18 Jan 2014 06:31:39 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:31:39 - XML: Start document: iteration 4
Sat 18 Jan 2014 06:31:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:31:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 06:31:40 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:31:40 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:31:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 11684 values 184504 bits 23063 bytes 
Sat 18 Jan 2014 06:31:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 06:31:43 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 06:31:43 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:31:44 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:31:44 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 06:31:44 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 06:31:44 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:31:44 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 06:31:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:31:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:31:52 - size of cluster 'LISA Cluster': 624 hosts 79465 metrics 781210 values 12322903 bits 1540362 bytes 
Sat 18 Jan 2014 06:31:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:31:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:31:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:31:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:31:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:31:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:31:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:31:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:31:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:31:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:31:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:32:00 - XML: Processed 655290 elements - found 542 jobs
Sat 18 Jan 2014 06:32:00 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:32:00 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:32:00 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:32:00 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:32:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:32:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:32:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:32:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:32:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:32:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:32:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:32:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:32:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:32:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43817285
Sat 18 Jan 2014 06:32:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:32:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43817285
Sat 18 Jan 2014 06:32:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:32:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:32:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:32:15 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:32:15 - job_xml_thread(): Done retrieving: data size 43817285
Sat 18 Jan 2014 06:32:15 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:32:15 - XML: Start document: iteration 5
Sat 18 Jan 2014 06:32:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:32:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:32:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:32:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:32:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:32:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:32:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:32:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:32:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:32:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:32:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:32:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:32:27 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:32:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:32:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:32:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:32:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:32:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:32:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:32:30 - XML: Processed 655290 elements - found 542 jobs
Sat 18 Jan 2014 06:32:30 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:32:30 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:32:30 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:32:30 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:32:30 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:32:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 06:32:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:32:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:32:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43829062
Sat 18 Jan 2014 06:32:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:32:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43829062
Sat 18 Jan 2014 06:32:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:32:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:32:41 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:32:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:32:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:32:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:32:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:32:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:32:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 06:32:44 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:32:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5923 values 93722 bits 11715 bytes 
Sat 18 Jan 2014 06:32:44 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:32:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 06:32:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:32:44 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:32:44 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:32:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:32:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:32:44 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 06:32:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:32:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:32:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:32:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:32:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:32:45 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:32:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:32:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:32:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:32:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:32:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:32:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:32:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:32:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:32:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:32:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43840262
Sat 18 Jan 2014 06:32:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:32:51 - job_xml_thread(): Done retrieving: data size 43840262
Sat 18 Jan 2014 06:32:52 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:32:52 - XML: Start document: iteration 6
Sat 18 Jan 2014 06:32:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43840262
Sat 18 Jan 2014 06:32:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:32:56 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:32:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 06:32:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:33:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:33:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:33:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:33:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:33:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:33:10 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:33:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:33:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:33:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:33:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:33:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:33:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:33:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:33:13 - XML: Processed 655290 elements - found 542 jobs
Sat 18 Jan 2014 06:33:13 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:33:13 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:33:13 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:33:13 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:33:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:33:16 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:33:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:33:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:33:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:33:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:33:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:33:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:33:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:33:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43817713
Sat 18 Jan 2014 06:33:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:33:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43817713
Sat 18 Jan 2014 06:33:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:33:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:33:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:33:29 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:33:29 - job_xml_thread(): Done retrieving: data size 43817713
Sat 18 Jan 2014 06:33:29 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:33:29 - XML: Start document: iteration 7
Sat 18 Jan 2014 06:33:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:33:29 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:33:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:33:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:33:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:33:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:33:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:33:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:33:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:33:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:33:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:33:40 - XML: Processed 655290 elements - found 542 jobs
Sat 18 Jan 2014 06:33:40 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:33:40 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:33:40 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:33:40 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:33:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:33:41 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:33:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:33:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:33:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:33:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:33:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:33:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:33:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:33:44 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:33:44 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:33:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:33:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 06:33:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 06:33:44 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:33:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6251 values 98857 bits 12357 bytes 
Sat 18 Jan 2014 06:33:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:33:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43812520
Sat 18 Jan 2014 06:33:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:33:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43812520
Sat 18 Jan 2014 06:33:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:33:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:33:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:33:55 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:33:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:33:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:33:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:33:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:33:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:33:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:33:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:33:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:33:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:33:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:33:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:34:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:34:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:34:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:34:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:34:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:34:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:34:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:34:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:34:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:34:04 - job_xml_thread(): Done retrieving: data size 43819862
Sat 18 Jan 2014 06:34:04 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:34:04 - XML: Start document: iteration 8
Sat 18 Jan 2014 06:34:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43819862
Sat 18 Jan 2014 06:34:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:34:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43819862
Sat 18 Jan 2014 06:34:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:34:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:34:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:34:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:34:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:34:17 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:34:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 06:34:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:34:20 - XML: Processed 655290 elements - found 542 jobs
Sat 18 Jan 2014 06:34:20 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:34:20 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:34:20 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:34:20 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:34:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:34:28 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:34:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:34:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:34:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:34:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:34:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:34:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:34:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:34:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:34:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:34:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:34:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:34:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:34:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:34:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:34:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:34:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:34:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43834538
Sat 18 Jan 2014 06:34:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:34:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43834538
Sat 18 Jan 2014 06:34:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:34:35 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:34:35 - job_xml_thread(): Done retrieving: data size 43834538
Sat 18 Jan 2014 06:34:35 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:34:35 - XML: Start document: iteration 9
Sat 18 Jan 2014 06:34:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:34:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:34:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:34:44 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:34:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:34:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:34:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:34:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 06:34:45 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:34:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5946 values 93767 bits 11720 bytes 
Sat 18 Jan 2014 06:34:45 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:34:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 06:34:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:34:49 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:34:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:34:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:34:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:34:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:34:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:34:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:34:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:34:51 - XML: Processed 655290 elements - found 542 jobs
Sat 18 Jan 2014 06:34:51 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:34:51 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:34:51 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:34:51 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:34:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:34:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:34:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:34:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:34:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:34:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:34:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:34:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:34:57 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 06:34:57 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 06:34:57 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:34:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:34:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43833353
Sat 18 Jan 2014 06:34:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:34:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43833353
Sat 18 Jan 2014 06:34:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:35:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:35:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:35:06 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:35:06 - job_xml_thread(): Done retrieving: data size 43833353
Sat 18 Jan 2014 06:35:06 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:35:06 - XML: Start document: iteration 10
Sat 18 Jan 2014 06:35:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:35:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:35:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:35:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:35:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:35:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:35:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:35:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:35:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:35:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:35:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:35:20 - XML: Processed 655283 elements - found 541 jobs
Sat 18 Jan 2014 06:35:20 - job 7337038 appears to have finished
Sat 18 Jan 2014 06:35:20 - job 7348604 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 06:35:20 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 06:35:20 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 06:35:20 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 06:35:20 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:35:20 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:35:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:35:22 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:35:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:35:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:35:23 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:35:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 06:35:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:35:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:35:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:35:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:35:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:35:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:35:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43754774
Sat 18 Jan 2014 06:35:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:35:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43754774
Sat 18 Jan 2014 06:35:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:35:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:35:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:35:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:35:33 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:35:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:35:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:35:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:35:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:35:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:35:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:35:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43754774
Sat 18 Jan 2014 06:35:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:35:35 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:35:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:35:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:35:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:35:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:35:43 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:35:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:35:45 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:35:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:35:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:35:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:35:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:35:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:35:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 06:35:46 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:35:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 06:35:46 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:35:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5391 values 84977 bits 10622 bytes 
Sat 18 Jan 2014 06:35:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:35:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:35:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:35:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:35:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:35:48 - job_xml_thread(): Done retrieving: data size 43220165
Sat 18 Jan 2014 06:35:48 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:35:48 - XML: Start document: iteration 11
Sat 18 Jan 2014 06:35:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43220165
Sat 18 Jan 2014 06:35:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:35:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:35:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:35:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:35:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:35:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:35:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43220165
Sat 18 Jan 2014 06:35:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:35:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:36:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:36:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:36:03 - XML: Processed 648044 elements - found 541 jobs
Sat 18 Jan 2014 06:36:03 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:36:03 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:36:03 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:36:03 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:36:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:36:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:36:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:36:11 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:36:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:36:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:36:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:36:11 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:36:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:36:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:36:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:36:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:36:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:36:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:36:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:36:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:36:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:36:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:36:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:36:12 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:36:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 06:36:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:36:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:36:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43223028
Sat 18 Jan 2014 06:36:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:36:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43223028
Sat 18 Jan 2014 06:36:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:36:18 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:36:18 - job_xml_thread(): Done retrieving: data size 43223028
Sat 18 Jan 2014 06:36:18 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:36:19 - XML: Start document: iteration 12
Sat 18 Jan 2014 06:36:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:36:24 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:36:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:36:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:36:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:36:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:36:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:36:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:36:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:36:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:36:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:36:31 - XML: Processed 647525 elements - found 541 jobs
Sat 18 Jan 2014 06:36:31 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:36:31 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:36:31 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:36:31 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:36:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:36:32 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:36:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:36:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:36:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:36:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:36:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:36:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:36:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:36:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43451510
Sat 18 Jan 2014 06:36:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:36:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43451510
Sat 18 Jan 2014 06:36:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:36:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:36:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:36:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:36:46 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:36:46 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:36:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:36:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:36:47 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:36:47 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:36:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 06:36:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:36:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:36:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:36:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 06:36:48 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:36:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7843 values 123639 bits 15454 bytes 
Sat 18 Jan 2014 06:36:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:36:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:36:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:36:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:36:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:36:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:36:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:36:50 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:36:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:36:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:36:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:36:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:36:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:36:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:36:53 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:36:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 06:36:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:36:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:36:53 - job_xml_thread(): Done retrieving: data size 43780830
Sat 18 Jan 2014 06:36:53 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:36:53 - XML: Start document: iteration 13
Sat 18 Jan 2014 06:36:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43780830
Sat 18 Jan 2014 06:36:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:36:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43780830
Sat 18 Jan 2014 06:36:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:37:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:37:02 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:37:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:37:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:37:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:37:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:37:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:37:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:37:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:37:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:37:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:37:13 - XML: Processed 654502 elements - found 537 jobs
Sat 18 Jan 2014 06:37:13 - job 7348464 appears to have finished
Sat 18 Jan 2014 06:37:13 - job 7337040 appears to have finished
Sat 18 Jan 2014 06:37:13 - job 7341447 appears to have finished
Sat 18 Jan 2014 06:37:13 - job 7348761 appears to have finished
Sat 18 Jan 2014 06:37:13 - job_xml_thread(): Found 4 updated jobs.
Sat 18 Jan 2014 06:37:13 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 06:37:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:37:14 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:37:14 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Sat 18 Jan 2014 06:37:14 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:37:14 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:37:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:37:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:37:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:37:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:37:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:37:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:37:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:37:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43802839
Sat 18 Jan 2014 06:37:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:37:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43802839
Sat 18 Jan 2014 06:37:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:37:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:37:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:37:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:37:26 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:37:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:37:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:37:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:37:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:37:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:37:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:37:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:37:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:37:29 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:37:29 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:37:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:37:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:37:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:37:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:37:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:37:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:37:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:37:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43824984
Sat 18 Jan 2014 06:37:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:37:32 - job_xml_thread(): Done retrieving: data size 43824984
Sat 18 Jan 2014 06:37:32 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:37:32 - XML: Start document: iteration 14
Sat 18 Jan 2014 06:37:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43824984
Sat 18 Jan 2014 06:37:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:37:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:37:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:37:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:37:45 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:37:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:37:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:37:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:37:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:37:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:37:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:37:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:37:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:37:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:37:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:37:48 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:37:49 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:37:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:37:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 06:37:49 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:37:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148594 bits 18574 bytes 
Sat 18 Jan 2014 06:37:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 06:37:49 - XML: Processed 655280 elements - found 537 jobs
Sat 18 Jan 2014 06:37:49 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:37:49 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:37:49 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:37:49 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:37:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:37:54 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:37:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:37:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:37:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:37:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:37:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:37:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:37:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:37:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43828122
Sat 18 Jan 2014 06:37:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:37:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43828122
Sat 18 Jan 2014 06:37:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:38:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:38:02 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:38:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:38:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:38:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:38:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:38:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:38:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43828122
Sat 18 Jan 2014 06:38:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:38:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:38:04 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:38:04 - job_xml_thread(): Done retrieving: data size 43828122
Sat 18 Jan 2014 06:38:04 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:38:04 - XML: Start document: iteration 15
Sat 18 Jan 2014 06:38:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:38:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:38:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:38:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:38:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:38:20 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:38:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:38:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:38:21 - XML: Processed 655280 elements - found 537 jobs
Sat 18 Jan 2014 06:38:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:38:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:38:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:38:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:38:21 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:38:21 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:38:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:38:21 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:38:21 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:38:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:38:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:38:24 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:38:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 06:38:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:38:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:38:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:38:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:38:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:38:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:38:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:38:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:38:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43846650
Sat 18 Jan 2014 06:38:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:38:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43846650
Sat 18 Jan 2014 06:38:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:38:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:38:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:38:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:38:36 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:38:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:38:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:38:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:38:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:38:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:38:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:38:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:38:39 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:38:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:38:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:38:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:38:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:38:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:38:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:38:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:38:41 - job_xml_thread(): Done retrieving: data size 43837275
Sat 18 Jan 2014 06:38:41 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:38:41 - XML: Start document: iteration 16
Sat 18 Jan 2014 06:38:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43837275
Sat 18 Jan 2014 06:38:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:38:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43837275
Sat 18 Jan 2014 06:38:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:38:44 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 06:38:44 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:38:46 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:38:46 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 06:38:46 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 06:38:48 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:38:48 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 06:38:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:38:50 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:38:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:38:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 06:38:51 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:38:51 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:38:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 06:38:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9010 values 142072 bits 17759 bytes 
Sat 18 Jan 2014 06:38:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:38:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:38:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:38:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:38:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:38:56 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:38:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:38:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:38:56 - size of cluster 'LISA Cluster': 624 hosts 79470 metrics 831823 values 13124426 bits 1640553 bytes 
Sat 18 Jan 2014 06:38:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:38:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:38:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:38:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:38:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:39:04 - XML: Processed 655280 elements - found 537 jobs
Sat 18 Jan 2014 06:39:04 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:39:04 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:39:04 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:39:04 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:39:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:39:07 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:39:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:39:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:39:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:39:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:39:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:39:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:39:10 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:39:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 06:39:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:39:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:39:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43812091
Sat 18 Jan 2014 06:39:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:39:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43812091
Sat 18 Jan 2014 06:39:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:39:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:39:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:39:19 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:39:19 - job_xml_thread(): Done retrieving: data size 43812091
Sat 18 Jan 2014 06:39:19 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:39:19 - XML: Start document: iteration 17
Sat 18 Jan 2014 06:39:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:39:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:39:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:39:26 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:39:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:39:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:39:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:39:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:39:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:39:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:39:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:39:33 - XML: Processed 655278 elements - found 536 jobs
Sat 18 Jan 2014 06:39:33 - job 7337042 appears to have finished
Sat 18 Jan 2014 06:39:33 - job 7348605 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 06:39:33 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 06:39:33 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 06:39:33 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 06:39:33 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:39:33 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:39:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:39:34 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:39:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:39:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:39:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:39:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:39:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:39:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:39:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:39:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43820726
Sat 18 Jan 2014 06:39:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:39:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43820726
Sat 18 Jan 2014 06:39:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:39:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:39:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:39:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:39:43 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:39:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:39:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:39:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:39:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:39:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:39:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43820726
Sat 18 Jan 2014 06:39:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:39:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:39:48 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:39:48 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 06:39:49 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:39:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:39:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:39:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:39:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:39:51 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:39:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:39:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 06:39:52 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:39:52 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:39:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 06:39:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99048 bits 12381 bytes 
Sat 18 Jan 2014 06:39:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:39:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:39:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:39:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:39:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:39:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:39:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:39:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:39:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:39:56 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:39:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:39:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:40:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:40:00 - job_xml_thread(): Done retrieving: data size 43805913
Sat 18 Jan 2014 06:40:00 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:40:00 - XML: Start document: iteration 18
Sat 18 Jan 2014 06:40:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43805913
Sat 18 Jan 2014 06:40:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:40:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:40:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:40:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:40:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43805913
Sat 18 Jan 2014 06:40:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:40:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:40:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:40:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:40:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:40:15 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:40:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:40:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:40:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:40:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:40:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:40:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:40:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:40:18 - XML: Processed 655278 elements - found 536 jobs
Sat 18 Jan 2014 06:40:19 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:40:19 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:40:19 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:40:19 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:40:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:40:23 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:40:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:40:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:40:23 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:40:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 06:40:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:40:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:40:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:40:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:40:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:40:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:40:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43822770
Sat 18 Jan 2014 06:40:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:40:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43822770
Sat 18 Jan 2014 06:40:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:40:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:40:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:40:34 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:40:34 - job_xml_thread(): Done retrieving: data size 43822770
Sat 18 Jan 2014 06:40:34 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:40:34 - XML: Start document: iteration 19
Sat 18 Jan 2014 06:40:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:40:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:40:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:40:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:40:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:40:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:40:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:40:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:40:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:40:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:40:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:40:48 - XML: Processed 655275 elements - found 536 jobs
Sat 18 Jan 2014 06:40:48 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:40:48 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:40:48 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:40:48 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:40:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:40:50 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:40:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:40:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:40:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:40:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:40:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:40:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:40:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:40:52 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:40:52 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:40:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 06:40:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:40:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 06:40:52 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:40:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5869 values 92582 bits 11572 bytes 
Sat 18 Jan 2014 06:40:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:40:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43821890
Sat 18 Jan 2014 06:40:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:40:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43821890
Sat 18 Jan 2014 06:40:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:40:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:40:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:41:03 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:41:03 - job_xml_thread(): Done retrieving: data size 43821890
Sat 18 Jan 2014 06:41:03 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:41:03 - XML: Start document: iteration 20
Sat 18 Jan 2014 06:41:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:41:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:41:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:41:10 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:41:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:41:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:41:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:41:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:41:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:41:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:41:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:41:14 - XML: Processed 655276 elements - found 535 jobs
Sat 18 Jan 2014 06:41:14 - job 7343931 appears to have finished
Sat 18 Jan 2014 06:41:14 - job 7348605 field 'start_timestamp' changed since saved from: 1390023497 to: 1390023495
Sat 18 Jan 2014 06:41:14 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 06:41:14 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 06:41:14 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 06:41:14 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:41:14 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:41:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:41:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:41:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:41:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:41:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:41:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:41:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:41:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:41:21 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:41:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 06:41:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:41:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:41:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43746021
Sat 18 Jan 2014 06:41:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:41:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43746021
Sat 18 Jan 2014 06:41:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:41:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:41:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:41:29 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:41:29 - job_xml_thread(): Done retrieving: data size 43746021
Sat 18 Jan 2014 06:41:30 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:41:30 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 06:41:30 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 06:41:30 - Housekeeping: done.
Sat 18 Jan 2014 06:41:30 - XML: Start document: iteration 0
Sat 18 Jan 2014 06:41:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:41:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:41:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:41:43 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:41:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:41:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:41:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:41:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:41:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:41:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:41:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:41:45 - XML: Processed 654528 elements - found 535 jobs
Sat 18 Jan 2014 06:41:45 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:41:45 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:41:45 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:41:45 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:41:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:41:46 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:41:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:41:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:41:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:41:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:41:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:41:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:41:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:41:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43205917
Sat 18 Jan 2014 06:41:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:41:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43205917
Sat 18 Jan 2014 06:41:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:41:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:41:52 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:41:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:41:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 06:41:53 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:41:54 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:41:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 06:41:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7596 values 119750 bits 14968 bytes 
Sat 18 Jan 2014 06:41:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:41:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:42:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:42:00 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:42:00 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:42:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:42:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:42:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:42:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:42:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:42:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:42:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:42:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:42:04 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:42:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:42:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:42:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:42:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:42:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:42:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:42:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:42:08 - job_xml_thread(): Done retrieving: data size 43174010
Sat 18 Jan 2014 06:42:08 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:42:08 - XML: Start document: iteration 1
Sat 18 Jan 2014 06:42:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43174010
Sat 18 Jan 2014 06:42:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43174010
Sat 18 Jan 2014 06:42:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:42:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:42:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:42:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:42:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:42:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:42:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:42:29 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:42:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:42:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:42:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:42:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:42:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:42:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:42:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:42:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:42:31 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:42:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:42:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:42:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:42:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:42:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:42:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:42:32 - XML: Processed 647076 elements - found 535 jobs
Sat 18 Jan 2014 06:42:32 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:42:32 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:42:32 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:42:32 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:42:32 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:42:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 06:42:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:42:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:42:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43469615
Sat 18 Jan 2014 06:42:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:42:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43469615
Sat 18 Jan 2014 06:42:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:42:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:42:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:42:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:42:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:42:47 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:42:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:42:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:42:47 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:42:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:42:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:42:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:42:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:42:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:42:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:42:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:42:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:42:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:42:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:42:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:42:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:42:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:42:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:42:51 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 06:42:51 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 06:42:51 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:42:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:42:53 - job_xml_thread(): Done retrieving: data size 43783063
Sat 18 Jan 2014 06:42:53 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:42:53 - XML: Start document: iteration 2
Sat 18 Jan 2014 06:42:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43783063
Sat 18 Jan 2014 06:42:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43783063
Sat 18 Jan 2014 06:42:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:42:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:42:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:42:54 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:42:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:42:54 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:42:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 06:42:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 06:42:55 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:42:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6560 values 103566 bits 12945 bytes 
Sat 18 Jan 2014 06:43:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:43:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:43:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:43:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:43:07 - XML: Processed 654654 elements - found 533 jobs
Sat 18 Jan 2014 06:43:07 - job 7348620 appears to have finished
Sat 18 Jan 2014 06:43:07 - job 7337044 appears to have finished
Sat 18 Jan 2014 06:43:07 - job 7348606 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 06:43:07 - job_xml_thread(): Found 3 updated jobs.
Sat 18 Jan 2014 06:43:07 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 06:43:09 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Sat 18 Jan 2014 06:43:09 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:43:09 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:43:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:43:13 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:43:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:43:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:43:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:43:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:43:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:43:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:43:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:43:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:43:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:43:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:43:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:43:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:43:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:43:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:43:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:43:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:43:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43820445
Sat 18 Jan 2014 06:43:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:43:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43820445
Sat 18 Jan 2014 06:43:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:43:24 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:43:24 - job_xml_thread(): Done retrieving: data size 43820445
Sat 18 Jan 2014 06:43:24 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:43:24 - XML: Start document: iteration 3
Sat 18 Jan 2014 06:43:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:43:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:43:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:43:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:43:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:43:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:43:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:43:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:43:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:43:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:43:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:43:39 - XML: Processed 655272 elements - found 533 jobs
Sat 18 Jan 2014 06:43:39 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:43:39 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:43:39 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:43:39 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:43:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:43:42 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:43:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:43:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:43:42 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:43:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 06:43:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:43:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:43:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:43:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:43:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:43:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:43:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43793581
Sat 18 Jan 2014 06:43:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:43:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43793581
Sat 18 Jan 2014 06:43:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:43:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:43:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:43:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:43:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:43:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:43:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:43:54 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:43:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:43:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:43:54 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:43:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:43:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:43:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:43:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:43:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:43:56 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:43:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 06:43:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 06:43:56 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:43:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5821 values 91742 bits 11467 bytes 
Sat 18 Jan 2014 06:43:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:43:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:43:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:43:59 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:43:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:43:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:44:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:44:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:44:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:44:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:44:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:44:01 - job_xml_thread(): Done retrieving: data size 43821469
Sat 18 Jan 2014 06:44:01 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:44:01 - XML: Start document: iteration 4
Sat 18 Jan 2014 06:44:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43821469
Sat 18 Jan 2014 06:44:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43821469
Sat 18 Jan 2014 06:44:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:44:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:44:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:44:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:44:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:44:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:44:20 - XML: Processed 655272 elements - found 533 jobs
Sat 18 Jan 2014 06:44:20 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:44:20 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:44:20 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:44:20 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:44:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:44:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:44:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:44:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:44:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:44:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:44:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:44:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:44:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:44:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:44:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:44:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:44:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:44:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:44:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:44:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:44:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:44:25 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:44:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 06:44:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:44:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:44:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43840548
Sat 18 Jan 2014 06:44:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:44:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43840548
Sat 18 Jan 2014 06:44:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:44:35 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:44:35 - job_xml_thread(): Done retrieving: data size 43840548
Sat 18 Jan 2014 06:44:36 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:44:36 - XML: Start document: iteration 5
Sat 18 Jan 2014 06:44:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:44:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:44:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:44:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:44:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:44:43 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:44:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:44:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:44:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:44:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:44:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:44:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:44:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:44:48 - XML: Processed 655272 elements - found 533 jobs
Sat 18 Jan 2014 06:44:48 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:44:48 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:44:48 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:44:48 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:44:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:44:49 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:44:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:44:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:44:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:44:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:44:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:44:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:44:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:44:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43843961
Sat 18 Jan 2014 06:44:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:44:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43843961
Sat 18 Jan 2014 06:44:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:44:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:44:56 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:44:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:44:57 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:44:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 06:44:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 06:44:57 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:44:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9072 values 143020 bits 17877 bytes 
Sat 18 Jan 2014 06:45:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:45:00 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:45:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:45:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:45:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:45:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:45:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:45:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:45:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:45:03 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:45:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:45:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:45:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:45:06 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:45:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:45:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:45:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:45:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:45:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:45:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:45:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:45:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43846314
Sat 18 Jan 2014 06:45:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:45:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43846314
Sat 18 Jan 2014 06:45:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:45:10 - job_xml_thread(): Done retrieving: data size 43846314
Sat 18 Jan 2014 06:45:10 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:45:10 - XML: Start document: iteration 6
Sat 18 Jan 2014 06:45:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:45:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:45:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:45:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:45:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:45:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:45:28 - XML: Processed 655270 elements - found 532 jobs
Sat 18 Jan 2014 06:45:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:45:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:45:28 - job 7348596 appears to have finished
Sat 18 Jan 2014 06:45:28 - job 7348607 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 06:45:28 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 06:45:28 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 06:45:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:45:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:45:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:45:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:45:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:45:28 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 06:45:28 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:45:28 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:45:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:45:32 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:45:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:45:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:45:32 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:45:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 06:45:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:45:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:45:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:45:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:45:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:45:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:45:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43825888
Sat 18 Jan 2014 06:45:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:45:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43825888
Sat 18 Jan 2014 06:45:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:45:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:45:42 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:45:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:45:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:45:44 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:45:44 - job_xml_thread(): Done retrieving: data size 43825888
Sat 18 Jan 2014 06:45:44 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:45:44 - XML: Start document: iteration 7
Sat 18 Jan 2014 06:45:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:45:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:45:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:45:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:45:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:45:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:45:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:45:48 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 06:45:48 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:45:50 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:45:50 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:45:50 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 06:45:50 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 06:45:50 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 06:45:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:45:50 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:45:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:45:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:45:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:45:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:45:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:45:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:45:55 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 873779 values 13777879 bits 1722234 bytes 
Sat 18 Jan 2014 06:45:55 - XML: Processed 655267 elements - found 532 jobs
Sat 18 Jan 2014 06:45:55 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:45:55 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:45:55 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:45:55 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:45:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:45:58 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:45:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:45:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 06:45:58 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:45:58 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:45:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 06:45:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6091 values 96084 bits 12010 bytes 
Sat 18 Jan 2014 06:45:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:45:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43805897
Sat 18 Jan 2014 06:45:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:46:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:46:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43805897
Sat 18 Jan 2014 06:46:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:46:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:46:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:46:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:46:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:46:10 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:46:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:46:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:46:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:46:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:46:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:46:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:46:10 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:46:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:46:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:46:13 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:46:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:46:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:46:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:46:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:46:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:46:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:46:17 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:46:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 06:46:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:46:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:46:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43836508
Sat 18 Jan 2014 06:46:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:46:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43836508
Sat 18 Jan 2014 06:46:18 - job_xml_thread(): Done retrieving: data size 43836508
Sat 18 Jan 2014 06:46:18 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:46:18 - XML: Start document: iteration 8
Sat 18 Jan 2014 06:46:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:46:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:46:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:46:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:46:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:46:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:46:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:46:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:46:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:46:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:46:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:46:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:46:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:46:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:46:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:46:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:46:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:46:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:46:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:46:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:46:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:46:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:46:38 - XML: Processed 655270 elements - found 532 jobs
Sat 18 Jan 2014 06:46:38 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:46:38 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:46:38 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:46:38 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:46:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:46:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43826513
Sat 18 Jan 2014 06:46:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:46:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43826513
Sat 18 Jan 2014 06:46:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:46:50 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:46:50 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 06:46:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:46:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:46:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:46:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:46:53 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:46:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:46:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:46:53 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:46:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:46:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:46:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:46:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:46:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:46:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:46:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:46:57 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:46:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:46:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:46:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:46:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:46:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:46:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:46:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:46:58 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:46:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:46:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 06:46:59 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:46:59 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:46:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 06:46:59 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6703 values 105913 bits 13239 bytes 
Sat 18 Jan 2014 06:47:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:47:00 - job_xml_thread(): Done retrieving: data size 43825572
Sat 18 Jan 2014 06:47:00 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:47:00 - XML: Start document: iteration 9
Sat 18 Jan 2014 06:47:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43825572
Sat 18 Jan 2014 06:47:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:47:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43825572
Sat 18 Jan 2014 06:47:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:47:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:47:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:47:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:47:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:47:16 - XML: Processed 655268 elements - found 531 jobs
Sat 18 Jan 2014 06:47:16 - job 7343932 appears to have finished
Sat 18 Jan 2014 06:47:16 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 06:47:16 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 06:47:17 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 06:47:17 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:47:17 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:47:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:47:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:47:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:47:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:47:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:47:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:47:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:47:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:47:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:47:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:47:23 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:47:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:47:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:47:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:47:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:47:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:47:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:47:27 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:47:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 06:47:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:47:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:47:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43760218
Sat 18 Jan 2014 06:47:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:47:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43760218
Sat 18 Jan 2014 06:47:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:47:32 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:47:32 - job_xml_thread(): Done retrieving: data size 43760218
Sat 18 Jan 2014 06:47:32 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:47:33 - XML: Start document: iteration 10
Sat 18 Jan 2014 06:47:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:47:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:47:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:47:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:47:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:47:43 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:47:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:47:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:47:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:47:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:47:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:47:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:47:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:47:49 - XML: Processed 654520 elements - found 531 jobs
Sat 18 Jan 2014 06:47:49 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:47:49 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:47:49 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:47:49 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:47:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:47:50 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:47:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:47:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:47:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:47:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:47:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:47:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:47:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:47:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43187022
Sat 18 Jan 2014 06:47:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:47:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43187022
Sat 18 Jan 2014 06:47:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:47:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:47:59 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:47:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:47:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 06:48:00 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:48:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 06:48:00 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:48:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6973 values 110285 bits 13785 bytes 
Sat 18 Jan 2014 06:48:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:48:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:48:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:48:03 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:48:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:48:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:48:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:48:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:48:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:48:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:48:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:48:04 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:48:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:48:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:48:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:48:10 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:48:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:48:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:48:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:48:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:48:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:48:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:48:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:48:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43208880
Sat 18 Jan 2014 06:48:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:48:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43208880
Sat 18 Jan 2014 06:48:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:48:14 - job_xml_thread(): Done retrieving: data size 43208880
Sat 18 Jan 2014 06:48:14 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:48:14 - XML: Start document: iteration 11
Sat 18 Jan 2014 06:48:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:48:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:48:24 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:48:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 06:48:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:48:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:48:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:48:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:48:33 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:48:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:48:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:48:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:48:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:48:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:48:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:48:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:48:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:48:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:48:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:48:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:48:36 - XML: Processed 647732 elements - found 531 jobs
Sat 18 Jan 2014 06:48:36 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:48:36 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:48:36 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:48:36 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:48:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:48:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:48:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:48:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:48:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:48:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43523002
Sat 18 Jan 2014 06:48:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:48:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43523002
Sat 18 Jan 2014 06:48:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:48:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:48:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:48:51 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:48:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:48:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:48:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:48:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:48:52 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:48:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:48:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:48:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:48:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:48:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:48:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:48:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:48:56 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:48:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:48:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:48:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:48:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:48:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:48:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:48:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:48:59 - job_xml_thread(): Done retrieving: data size 43802427
Sat 18 Jan 2014 06:48:59 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:48:59 - XML: Start document: iteration 12
Sat 18 Jan 2014 06:49:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:49:00 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:49:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43802427
Sat 18 Jan 2014 06:49:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43802427
Sat 18 Jan 2014 06:49:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:49:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:49:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:49:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 06:49:02 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:49:02 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:49:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6155 values 97284 bits 12160 bytes 
Sat 18 Jan 2014 06:49:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 06:49:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:49:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:49:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:49:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:49:13 - XML: Processed 655144 elements - found 531 jobs
Sat 18 Jan 2014 06:49:14 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:49:14 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:49:14 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:49:14 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:49:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:49:22 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:49:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:49:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:49:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:49:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:49:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:49:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:49:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:49:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:49:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:49:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:49:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:49:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:49:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:49:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:49:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:49:28 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:49:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 06:49:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:49:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:49:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43820903
Sat 18 Jan 2014 06:49:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:49:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43820903
Sat 18 Jan 2014 06:49:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:49:30 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:49:30 - job_xml_thread(): Done retrieving: data size 43820903
Sat 18 Jan 2014 06:49:30 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:49:30 - XML: Start document: iteration 13
Sat 18 Jan 2014 06:49:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:49:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:49:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:49:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:49:50 - XML: Processed 655268 elements - found 531 jobs
Sat 18 Jan 2014 06:49:50 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:49:50 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:49:51 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:49:51 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:49:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:49:51 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:49:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:49:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:49:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:49:52 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:49:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:49:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:49:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:49:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:49:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:49:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:49:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:49:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:49:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:49:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:49:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:49:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:49:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43830442
Sat 18 Jan 2014 06:49:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:49:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43830442
Sat 18 Jan 2014 06:49:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:50:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:50:03 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:50:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:50:04 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:50:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 06:50:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 06:50:04 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:50:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6300 values 99378 bits 12422 bytes 
Sat 18 Jan 2014 06:50:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:50:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:50:06 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:50:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:50:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:50:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:50:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:50:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:50:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:50:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:50:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:50:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:50:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:50:10 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:50:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:50:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:50:11 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 06:50:11 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 06:50:11 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:50:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:50:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:50:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:50:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:50:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:50:12 - job_xml_thread(): Done retrieving: data size 43819065
Sat 18 Jan 2014 06:50:12 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:50:12 - XML: Start document: iteration 14
Sat 18 Jan 2014 06:50:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43819065
Sat 18 Jan 2014 06:50:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:50:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43819065
Sat 18 Jan 2014 06:50:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:50:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:50:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:50:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:50:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:50:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:50:31 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:50:31 - XML: Processed 655268 elements - found 531 jobs
Sat 18 Jan 2014 06:50:31 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:50:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:50:31 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:50:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:50:31 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:50:31 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:50:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:50:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:50:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:50:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:50:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:50:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:50:35 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:50:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:50:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:50:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:50:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:50:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:50:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:50:35 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:50:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 06:50:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:50:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:50:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43846661
Sat 18 Jan 2014 06:50:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:50:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43846661
Sat 18 Jan 2014 06:50:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:50:47 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:50:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:50:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:50:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:50:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:50:49 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:50:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:50:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:50:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:50:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:50:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:50:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:50:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:50:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:50:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:50:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:50:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:50:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:50:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:50:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:50:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:50:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:50:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:50:52 - job_xml_thread(): Done retrieving: data size 43840881
Sat 18 Jan 2014 06:50:52 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:50:52 - XML: Start document: iteration 15
Sat 18 Jan 2014 06:50:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43840881
Sat 18 Jan 2014 06:50:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:50:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43840881
Sat 18 Jan 2014 06:50:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:51:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:51:04 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:51:05 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:51:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 06:51:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:51:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 06:51:05 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:51:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:51:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:51:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:51:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:51:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8793 values 138644 bits 17330 bytes 
Sat 18 Jan 2014 06:51:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:51:07 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:51:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:51:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:51:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:51:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:51:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:51:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:51:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:51:10 - XML: Processed 655266 elements - found 530 jobs
Sat 18 Jan 2014 06:51:11 - job 7346726 appears to have finished
Sat 18 Jan 2014 06:51:11 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 06:51:11 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 06:51:11 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 06:51:11 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:51:11 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:51:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:51:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:51:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:51:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:51:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:51:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:51:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:51:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:51:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:51:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43823357
Sat 18 Jan 2014 06:51:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:51:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43823357
Sat 18 Jan 2014 06:51:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:51:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:51:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:51:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:51:26 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:51:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:51:27 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:51:27 - job_xml_thread(): Done retrieving: data size 43823357
Sat 18 Jan 2014 06:51:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:51:27 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:51:27 - XML: Start document: iteration 16
Sat 18 Jan 2014 06:51:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:51:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:51:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:51:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:51:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:51:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:51:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:51:35 - XML: Processed 655266 elements - found 530 jobs
Sat 18 Jan 2014 06:51:35 - job 7348608 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 06:51:35 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 06:51:35 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 06:51:35 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 06:51:35 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:51:35 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:51:36 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:51:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 06:51:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:51:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:51:38 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:51:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:51:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:51:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:51:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:51:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:51:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:51:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:51:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43809303
Sat 18 Jan 2014 06:51:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:51:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43809303
Sat 18 Jan 2014 06:51:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:51:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:51:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:51:50 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:51:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:51:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:51:51 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:51:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:51:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:51:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:51:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:51:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:51:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:51:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:51:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:51:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:51:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:51:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:51:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:51:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:51:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:51:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:51:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:51:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:51:57 - job_xml_thread(): Done retrieving: data size 43813216
Sat 18 Jan 2014 06:51:57 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:51:57 - XML: Start document: iteration 17
Sat 18 Jan 2014 06:51:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43813216
Sat 18 Jan 2014 06:51:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43813216
Sat 18 Jan 2014 06:51:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:51:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:52:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:52:05 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:52:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:52:06 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:52:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 06:52:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 06:52:06 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:52:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9241 values 145811 bits 18226 bytes 
Sat 18 Jan 2014 06:52:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:52:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:52:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:52:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:52:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:52:18 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:52:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:52:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:52:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:52:19 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:52:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:52:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:52:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:52:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:52:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:52:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:52:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:52:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:52:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:52:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:52:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:52:21 - XML: Processed 655263 elements - found 530 jobs
Sat 18 Jan 2014 06:52:21 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:52:21 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:52:21 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:52:21 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:52:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:52:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43840525
Sat 18 Jan 2014 06:52:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:52:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43840525
Sat 18 Jan 2014 06:52:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:52:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:52:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:52:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:52:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:52:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:52:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:52:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:52:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:52:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:52:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:52:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:52:36 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:52:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:52:38 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:52:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:52:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:52:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:52:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:52:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:52:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:52:39 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:52:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 06:52:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:52:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:52:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43824472
Sat 18 Jan 2014 06:52:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:52:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43824472
Sat 18 Jan 2014 06:52:41 - job_xml_thread(): Done retrieving: data size 43824472
Sat 18 Jan 2014 06:52:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:52:41 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:52:41 - XML: Start document: iteration 18
Sat 18 Jan 2014 06:52:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:52:51 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 06:52:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:52:51 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:52:51 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:52:51 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 06:52:51 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 06:52:52 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:52:52 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 06:52:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:52:52 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:52:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:52:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:52:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:52:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:52:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:52:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:52:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:52:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:52:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:52:59 - size of cluster 'LISA Cluster': 624 hosts 79469 metrics 776554 values 12255704 bits 1531963 bytes 
Sat 18 Jan 2014 06:53:03 - XML: Processed 655266 elements - found 530 jobs
Sat 18 Jan 2014 06:53:03 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:53:03 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:53:03 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:53:03 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:53:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:53:05 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:53:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:53:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:53:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:53:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:53:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:53:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:53:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:53:06 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:53:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:53:06 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:53:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 06:53:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 06:53:06 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:53:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5336 values 84140 bits 10517 bytes 
Sat 18 Jan 2014 06:53:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:53:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43820802
Sat 18 Jan 2014 06:53:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:53:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43820802
Sat 18 Jan 2014 06:53:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:53:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:53:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:53:18 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:53:18 - job_xml_thread(): Done retrieving: data size 43820802
Sat 18 Jan 2014 06:53:18 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:53:18 - XML: Start document: iteration 19
Sat 18 Jan 2014 06:53:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:53:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:53:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:53:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:53:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:53:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:53:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:53:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:53:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:53:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:53:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:53:29 - XML: Processed 655264 elements - found 529 jobs
Sat 18 Jan 2014 06:53:29 - job 7343933 appears to have finished
Sat 18 Jan 2014 06:53:30 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 06:53:30 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 06:53:30 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 06:53:30 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:53:30 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:53:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:53:32 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:53:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:53:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:53:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:53:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:53:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:53:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:53:34 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:53:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 06:53:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:53:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:53:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43739687
Sat 18 Jan 2014 06:53:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:53:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43739687
Sat 18 Jan 2014 06:53:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:53:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:53:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:53:45 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:53:45 - job_xml_thread(): Done retrieving: data size 43739687
Sat 18 Jan 2014 06:53:45 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:53:45 - XML: Start document: iteration 20
Sat 18 Jan 2014 06:53:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:53:45 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:53:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:53:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:53:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:53:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:53:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:53:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:53:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:53:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:53:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:53:52 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:53:52 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 06:53:55 - XML: Processed 654430 elements - found 529 jobs
Sat 18 Jan 2014 06:53:55 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:53:55 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:53:55 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:53:55 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:53:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:53:57 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:53:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:53:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:53:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:53:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:53:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:53:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:54:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:54:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43164940
Sat 18 Jan 2014 06:54:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:54:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43164940
Sat 18 Jan 2014 06:54:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:54:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:54:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:54:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:54:06 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:54:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:54:08 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:54:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 06:54:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 06:54:08 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:54:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8114 values 127935 bits 15991 bytes 
Sat 18 Jan 2014 06:54:10 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:54:10 - job_xml_thread(): Done retrieving: data size 43164940
Sat 18 Jan 2014 06:54:10 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:54:10 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 06:54:10 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 06:54:11 - Housekeeping: done.
Sat 18 Jan 2014 06:54:11 - XML: Start document: iteration 0
Sat 18 Jan 2014 06:54:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:54:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:54:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:54:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:54:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:54:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:54:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:54:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:54:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:54:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:54:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:54:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:54:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:54:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:54:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:54:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:54:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:54:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:54:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:54:25 - XML: Processed 647496 elements - found 529 jobs
Sat 18 Jan 2014 06:54:25 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:54:25 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:54:25 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:54:25 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:54:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:54:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:54:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:54:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43194654
Sat 18 Jan 2014 06:54:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:54:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43194654
Sat 18 Jan 2014 06:54:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:54:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:54:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:54:40 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:54:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:54:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:54:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:54:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:54:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:54:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:54:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:54:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:54:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:54:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:54:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:54:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:54:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:54:44 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:54:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 06:54:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:54:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:54:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:54:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:54:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:54:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:54:47 - job_xml_thread(): Done retrieving: data size 43764785
Sat 18 Jan 2014 06:54:47 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:54:47 - XML: Start document: iteration 1
Sat 18 Jan 2014 06:54:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43764785
Sat 18 Jan 2014 06:54:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43764785
Sat 18 Jan 2014 06:54:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:54:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:54:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:54:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:55:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:55:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:55:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:55:08 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:55:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:55:09 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:55:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 06:55:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 06:55:09 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:55:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5679 values 89484 bits 11185 bytes 
Sat 18 Jan 2014 06:55:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:55:10 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:55:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:55:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:55:10 - XML: Processed 654504 elements - found 529 jobs
Sat 18 Jan 2014 06:55:10 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:55:10 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:55:10 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:55:10 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:55:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:55:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:55:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:55:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:55:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:55:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:55:12 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:55:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:55:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:55:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:55:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:55:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:55:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:55:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:55:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43827104
Sat 18 Jan 2014 06:55:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:55:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43827104
Sat 18 Jan 2014 06:55:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:55:25 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:55:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:55:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:55:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:55:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:55:26 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:55:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:55:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:55:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:55:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:55:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:55:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:55:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:55:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:55:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:55:32 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:55:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:55:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:55:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:55:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:55:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:55:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:55:32 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:55:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 06:55:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:55:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:55:35 - job_xml_thread(): Done retrieving: data size 43813647
Sat 18 Jan 2014 06:55:35 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:55:35 - XML: Start document: iteration 2
Sat 18 Jan 2014 06:55:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43813647
Sat 18 Jan 2014 06:55:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:55:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43813647
Sat 18 Jan 2014 06:55:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:55:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:55:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:55:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:55:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:55:56 - XML: Processed 655264 elements - found 529 jobs
Sat 18 Jan 2014 06:55:56 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:55:56 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:55:56 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:55:56 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:55:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:55:56 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:55:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:55:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:55:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:55:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:55:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:55:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:55:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:55:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:55:58 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:55:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:55:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:55:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:55:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:55:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:55:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:56:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:56:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43842554
Sat 18 Jan 2014 06:56:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:56:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43842554
Sat 18 Jan 2014 06:56:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:56:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:56:10 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:56:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:56:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 06:56:10 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:56:10 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:56:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 06:56:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8711 values 137285 bits 17160 bytes 
Sat 18 Jan 2014 06:56:11 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:56:11 - job_xml_thread(): Done retrieving: data size 43842554
Sat 18 Jan 2014 06:56:11 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:56:11 - XML: Start document: iteration 3
Sat 18 Jan 2014 06:56:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:56:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:56:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:56:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:56:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:56:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:56:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:56:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:56:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:56:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:56:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:56:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:56:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:56:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:56:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:56:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:56:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:56:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:56:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:56:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:56:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:56:25 - XML: Processed 655264 elements - found 529 jobs
Sat 18 Jan 2014 06:56:25 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:56:25 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:56:25 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:56:25 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:56:27 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 06:56:27 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 06:56:27 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:56:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:56:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43802581
Sat 18 Jan 2014 06:56:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:56:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43802581
Sat 18 Jan 2014 06:56:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:56:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:56:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:56:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:56:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:56:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:56:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:56:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:56:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:56:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:56:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:56:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:56:40 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:56:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:56:43 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:56:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:56:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:56:43 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:56:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 06:56:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:56:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:56:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:56:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:56:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:56:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:56:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43830431
Sat 18 Jan 2014 06:56:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:56:45 - job_xml_thread(): Done retrieving: data size 43830431
Sat 18 Jan 2014 06:56:45 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:56:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43830431
Sat 18 Jan 2014 06:56:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:56:46 - XML: Start document: iteration 4
Sat 18 Jan 2014 06:56:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:56:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:56:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:56:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:57:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:57:02 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:57:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:57:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:57:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:57:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:57:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:57:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:57:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:57:06 - XML: Processed 655264 elements - found 529 jobs
Sat 18 Jan 2014 06:57:06 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:57:06 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:57:06 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:57:06 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:57:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:57:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:57:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:57:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:57:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:57:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:57:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:57:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:57:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:57:10 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:57:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:57:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43820275
Sat 18 Jan 2014 06:57:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:57:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43820275
Sat 18 Jan 2014 06:57:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:57:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:57:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 06:57:11 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:57:11 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:57:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 06:57:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5660 values 89215 bits 11151 bytes 
Sat 18 Jan 2014 06:57:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:57:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:57:21 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:57:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:57:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:57:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:57:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:57:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:57:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:57:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:57:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:57:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:57:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:57:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:57:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:57:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:57:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:57:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:57:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:57:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:57:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:57:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:57:27 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:57:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 06:57:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:57:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:57:27 - job_xml_thread(): Done retrieving: data size 43823889
Sat 18 Jan 2014 06:57:27 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:57:27 - XML: Start document: iteration 5
Sat 18 Jan 2014 06:57:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43823889
Sat 18 Jan 2014 06:57:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:57:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43823889
Sat 18 Jan 2014 06:57:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:57:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:57:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:57:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:57:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:57:44 - XML: Processed 655264 elements - found 529 jobs
Sat 18 Jan 2014 06:57:44 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:57:44 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:57:44 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:57:44 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:57:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:57:47 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:57:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:57:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:57:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:57:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:57:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:57:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:57:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:57:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:57:50 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:57:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:57:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:57:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:57:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:57:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:57:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:57:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:57:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43850693
Sat 18 Jan 2014 06:57:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:57:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43850693
Sat 18 Jan 2014 06:57:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:57:59 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:57:59 - job_xml_thread(): Done retrieving: data size 43850693
Sat 18 Jan 2014 06:57:59 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:57:59 - XML: Start document: iteration 6
Sat 18 Jan 2014 06:58:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:58:00 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:58:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:58:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:58:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:58:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:58:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:58:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:58:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:58:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:58:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:58:09 - XML: Processed 655264 elements - found 529 jobs
Sat 18 Jan 2014 06:58:09 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:58:09 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:58:09 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:58:09 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:58:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:58:11 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:58:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:58:13 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:58:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 06:58:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 06:58:13 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:58:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6284 values 99141 bits 12392 bytes 
Sat 18 Jan 2014 06:58:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:58:13 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:58:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:58:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:58:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:58:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:58:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:58:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:58:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:58:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43811802
Sat 18 Jan 2014 06:58:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:58:16 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:58:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 06:58:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:58:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43811802
Sat 18 Jan 2014 06:58:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:58:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:58:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:58:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:58:24 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:58:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:58:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:58:24 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:58:25 - job_xml_thread(): Done retrieving: data size 43811802
Sat 18 Jan 2014 06:58:25 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:58:25 - XML: Start document: iteration 7
Sat 18 Jan 2014 06:58:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:58:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:58:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:58:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:58:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:58:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:58:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:58:32 - XML: Processed 655264 elements - found 529 jobs
Sat 18 Jan 2014 06:58:32 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:58:32 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:58:32 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:58:32 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:58:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:58:35 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:58:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:58:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:58:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:58:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:58:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:58:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:58:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:58:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43824138
Sat 18 Jan 2014 06:58:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:58:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43824138
Sat 18 Jan 2014 06:58:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:58:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:58:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:58:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:58:46 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:58:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:58:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:58:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:58:47 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:58:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:58:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:58:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:58:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:58:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:58:50 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:58:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:58:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:58:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:58:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:58:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:58:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:58:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:58:52 - job_xml_thread(): Done retrieving: data size 43851299
Sat 18 Jan 2014 06:58:52 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:58:52 - XML: Start document: iteration 8
Sat 18 Jan 2014 06:58:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43851299
Sat 18 Jan 2014 06:58:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43851299
Sat 18 Jan 2014 06:58:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:58:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:59:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:59:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:59:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:59:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:59:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:59:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:59:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:59:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:59:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:59:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:59:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:59:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:59:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:59:11 - XML: Processed 655264 elements - found 529 jobs
Sat 18 Jan 2014 06:59:11 - job 7335221 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:11 - job 7335220 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:11 - job 7335223 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:11 - job 7335222 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:11 - job 7335225 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:11 - job 7335224 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:11 - job 7335227 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:11 - job 7335226 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:11 - job 7335229 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:11 - job 7335228 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:11 - job 7339776 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:11 - job 7341721 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:11 - job 7340333 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:11 - job 7340330 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:11 - job 7340337 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:11 - job 7340484 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:11 - job 7337749 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:11 - job 7337590 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:11 - job 7343918 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:11 - job 7344401 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:11 - job 7344400 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:11 - job 7344403 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:11 - job 7344402 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:11 - job 7344405 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:11 - job 7344404 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:11 - job 7344407 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:11 - job 7344406 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:11 - job 7344409 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:11 - job 7344408 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:11 - job 7343768 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:11 - job 7341823 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:11 - job 7338797 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:11 - job 7338790 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:11 - job 7344356 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:11 - job 7335699 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:11 - job 7348454 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:11 - job 7344351 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:11 - job 7335439 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:11 - job 7348629 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:11 - job 7348628 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7348627 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7335239 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7335232 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7335230 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7335231 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7346097 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344382 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7339993 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344418 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7340781 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344416 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344417 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344414 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344415 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344412 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344413 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344410 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344411 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7338953 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344354 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7338775 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7343787 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7337863 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7335401 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7335400 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7335403 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7335402 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7335405 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7335404 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7335406 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7348632 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7348633 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7348631 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7335249 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7335248 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7335246 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7348255 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7340339 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7337345 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7337341 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7336194 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344419 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7339232 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7337500 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7340310 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7336999 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344427 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7337261 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344645 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7341893 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344399 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344398 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344016 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344391 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344390 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344393 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344392 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344395 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344394 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344397 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344396 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7338806 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7338411 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7335485 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7338343 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7348435 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7342415 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7335259 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7335250 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7335254 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7335255 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7340349 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7337272 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7340972 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7345705 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7337799 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344657 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7337400 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344571 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7338475 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7338870 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7343952 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344379 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344378 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344373 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344372 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344371 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344370 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344377 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344376 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344375 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344374 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344386 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344387 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344384 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344385 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7338572 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344383 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344380 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344381 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344388 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344389 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7335544 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7335395 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7335397 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7337899 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7342698 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7335260 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7339484 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7346830 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7347335 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7336565 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7346841 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7337641 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7337640 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7337643 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7337645 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7337646 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7345031 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344430 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344431 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7345969 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344368 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344369 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344360 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344361 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344362 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344363 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344364 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344365 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344366 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344367 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344440 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7335389 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7335576 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7335273 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7335271 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7335276 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7335376 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7335375 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7339391 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7339156 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7345099 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7341100 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7340351 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7343632 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7343634 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344425 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7338208 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344422 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344421 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344420 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344355 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344426 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344357 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344424 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344423 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344353 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344352 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7335866 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344359 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344358 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344429 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344428 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7338514 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7340309 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7348623 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7348690 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7335361 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7335364 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7335365 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7348609 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7347695 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7335214 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7335215 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7335216 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7335217 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7335210 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7335211 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7335212 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7335213 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7335218 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7335219 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7339966 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7341063 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7345647 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344434 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344435 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344436 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344437 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344432 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344433 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344438 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7344439 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7343751 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7343472 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7340659 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7338784 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7335903 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7342714 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7335424 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7335423 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7335422 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7335421 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7338025 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7348614 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7348610 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7348611 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7348612 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job 7348613 report time 1390024581 does not match current heartbeat 1390024677 : ignoring job
Sat 18 Jan 2014 06:59:12 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:59:12 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:59:12 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:59:12 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:59:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:59:13 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:59:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:59:13 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:59:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 06:59:13 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:59:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148579 bits 18572 bytes 
Sat 18 Jan 2014 06:59:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 06:59:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:59:14 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:59:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:59:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:59:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:59:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:59:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:59:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:59:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:59:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43732413
Sat 18 Jan 2014 06:59:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:59:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43732413
Sat 18 Jan 2014 06:59:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:59:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:59:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:59:27 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 06:59:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:59:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:59:27 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:59:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:59:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:59:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:59:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:59:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:59:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:59:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:59:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:59:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:59:31 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:59:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:59:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:59:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:59:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:59:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:59:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:59:31 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 06:59:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 06:59:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:59:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:59:33 - job_xml_thread(): Done retrieving: data size 43381251
Sat 18 Jan 2014 06:59:33 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 06:59:33 - XML: Start document: iteration 9
Sat 18 Jan 2014 06:59:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43381251
Sat 18 Jan 2014 06:59:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 06:59:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43381251
Sat 18 Jan 2014 06:59:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:59:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 06:59:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:59:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 06:59:46 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 06:59:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 06:59:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 06:59:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:59:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 06:59:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 06:59:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 06:59:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 06:59:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 06:59:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 06:59:50 - XML: Processed 649812 elements - found 529 jobs
Sat 18 Jan 2014 06:59:50 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 06:59:50 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 06:59:50 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 06:59:50 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 06:59:52 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 06:59:52 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:59:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 06:59:53 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 06:59:53 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:59:53 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:59:53 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 06:59:53 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 06:59:53 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 06:59:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 06:59:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 06:59:54 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 904651 values 14264669 bits 1783083 bytes 
Sat 18 Jan 2014 06:59:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:59:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 06:59:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 06:59:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 06:59:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 06:59:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43156430
Sat 18 Jan 2014 06:59:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 06:59:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43156430
Sat 18 Jan 2014 06:59:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:00:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:00:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:00:05 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:00:05 - job_xml_thread(): Done retrieving: data size 43156430
Sat 18 Jan 2014 07:00:05 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:00:05 - XML: Start document: iteration 10
Sat 18 Jan 2014 07:00:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:00:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:00:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:00:11 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:00:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:00:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:00:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:00:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:00:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:00:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:00:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:00:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:00:13 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:00:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:00:14 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:00:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 07:00:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 07:00:14 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:00:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8672 values 136706 bits 17088 bytes 
Sat 18 Jan 2014 07:00:16 - XML: Processed 647320 elements - found 529 jobs
Sat 18 Jan 2014 07:00:17 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:00:17 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:00:17 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:00:17 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:00:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:00:22 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:00:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:00:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:00:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:00:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:00:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:00:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:00:25 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:00:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 07:00:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:00:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:00:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43208838
Sat 18 Jan 2014 07:00:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:00:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43208838
Sat 18 Jan 2014 07:00:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:00:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:00:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:00:32 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:00:32 - job_xml_thread(): Done retrieving: data size 43208838
Sat 18 Jan 2014 07:00:32 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:00:32 - XML: Start document: iteration 11
Sat 18 Jan 2014 07:00:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:00:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:00:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:00:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:00:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:00:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:00:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:00:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:00:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:00:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:00:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:00:45 - XML: Processed 647786 elements - found 529 jobs
Sat 18 Jan 2014 07:00:45 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:00:45 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:00:45 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:00:45 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:00:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:00:46 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:00:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:00:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:00:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:00:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:00:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:00:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:00:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:00:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43735623
Sat 18 Jan 2014 07:00:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:00:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43735623
Sat 18 Jan 2014 07:00:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:00:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:00:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:00:53 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:00:53 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 07:01:00 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:01:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:01:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:01:00 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:01:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:01:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:01:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:01:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:01:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:01:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:01:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:01:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:01:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:01:04 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:01:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:01:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:01:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:01:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:01:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:01:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:01:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:01:07 - job_xml_thread(): Done retrieving: data size 43826543
Sat 18 Jan 2014 07:01:07 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:01:07 - XML: Start document: iteration 12
Sat 18 Jan 2014 07:01:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43826543
Sat 18 Jan 2014 07:01:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43826543
Sat 18 Jan 2014 07:01:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:01:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:01:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:01:14 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:01:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:01:15 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:01:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 07:01:15 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:01:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 07:01:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148709 bits 18588 bytes 
Sat 18 Jan 2014 07:01:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:01:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:01:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:01:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:01:22 - XML: Processed 655264 elements - found 529 jobs
Sat 18 Jan 2014 07:01:22 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:01:22 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:01:22 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:01:22 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:01:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:01:26 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:01:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:01:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:01:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:01:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:01:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:01:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:01:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:01:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:01:29 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:01:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:01:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:01:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:01:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:01:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:01:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:01:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:01:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43823753
Sat 18 Jan 2014 07:01:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:01:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43823753
Sat 18 Jan 2014 07:01:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:01:38 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:01:38 - job_xml_thread(): Done retrieving: data size 43823753
Sat 18 Jan 2014 07:01:38 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:01:38 - XML: Start document: iteration 13
Sat 18 Jan 2014 07:01:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:01:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:01:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:01:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:01:52 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:01:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 07:01:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:01:53 - XML: Processed 655264 elements - found 529 jobs
Sat 18 Jan 2014 07:01:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:01:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:01:54 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:01:54 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:01:54 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:01:54 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:01:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:01:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:01:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:01:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:01:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:01:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:01:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:01:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:01:57 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:01:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:01:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:01:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:01:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:01:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:01:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:02:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:02:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43819896
Sat 18 Jan 2014 07:02:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:02:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43819896
Sat 18 Jan 2014 07:02:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:02:09 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:02:09 - job_xml_thread(): Done retrieving: data size 43819896
Sat 18 Jan 2014 07:02:09 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:02:09 - XML: Start document: iteration 14
Sat 18 Jan 2014 07:02:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:02:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:02:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:02:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:02:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:02:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:02:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:02:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:02:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:02:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:02:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:02:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:02:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:02:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:02:15 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:02:16 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:02:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 07:02:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:02:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 07:02:16 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:02:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6061 values 95872 bits 11984 bytes 
Sat 18 Jan 2014 07:02:22 - XML: Processed 655264 elements - found 529 jobs
Sat 18 Jan 2014 07:02:22 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:02:22 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:02:22 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:02:22 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:02:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:02:23 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:02:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:02:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:02:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:02:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:02:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:02:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:02:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:02:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43820486
Sat 18 Jan 2014 07:02:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:02:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43820486
Sat 18 Jan 2014 07:02:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:02:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:02:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:02:37 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:02:37 - job_xml_thread(): Done retrieving: data size 43820486
Sat 18 Jan 2014 07:02:37 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:02:37 - XML: Start document: iteration 15
Sat 18 Jan 2014 07:02:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:02:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:02:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:02:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:02:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:02:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:02:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:02:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:02:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:02:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:02:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:02:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:02:48 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:02:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:02:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:02:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:02:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:02:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:02:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:02:49 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:02:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 07:02:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:02:51 - XML: Processed 655263 elements - found 529 jobs
Sat 18 Jan 2014 07:02:51 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:02:51 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:02:51 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:02:51 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:02:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:02:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43818307
Sat 18 Jan 2014 07:02:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:02:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43818307
Sat 18 Jan 2014 07:02:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:02:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:02:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:03:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:03:03 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:03:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:03:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:03:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:03:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:03:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:03:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:03:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:03:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:03:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:03:06 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:03:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:03:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:03:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:03:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:03:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:03:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:03:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:03:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:03:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:03:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43841334
Sat 18 Jan 2014 07:03:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:03:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43841334
Sat 18 Jan 2014 07:03:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:03:12 - job_xml_thread(): Done retrieving: data size 43841334
Sat 18 Jan 2014 07:03:12 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:03:12 - XML: Start document: iteration 16
Sat 18 Jan 2014 07:03:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:03:16 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:03:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:03:18 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:03:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 07:03:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 07:03:18 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:03:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8864 values 140175 bits 17521 bytes 
Sat 18 Jan 2014 07:03:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:03:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:03:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:03:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:03:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:03:29 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:03:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:03:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:03:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:03:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:03:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:03:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:03:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:03:31 - XML: Processed 655266 elements - found 530 jobs
Sat 18 Jan 2014 07:03:31 - job 7348609 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 07:03:31 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 07:03:31 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 07:03:32 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 07:03:32 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:03:32 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:03:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:03:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:03:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:03:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:03:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:03:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:03:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:03:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:03:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:03:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43825520
Sat 18 Jan 2014 07:03:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:03:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43825520
Sat 18 Jan 2014 07:03:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:03:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:03:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:03:47 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:03:47 - job_xml_thread(): Done retrieving: data size 43825520
Sat 18 Jan 2014 07:03:47 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:03:47 - XML: Start document: iteration 17
Sat 18 Jan 2014 07:03:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:03:51 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:03:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:03:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:03:51 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 07:03:51 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 07:03:51 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:03:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:03:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:03:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:03:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:03:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:03:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:03:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:03:52 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:03:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 07:03:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:04:00 - XML: Processed 655266 elements - found 530 jobs
Sat 18 Jan 2014 07:04:00 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:04:00 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:04:00 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:04:00 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:04:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:04:02 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:04:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:04:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:04:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:04:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:04:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:04:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:04:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:04:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43801584
Sat 18 Jan 2014 07:04:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:04:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43801584
Sat 18 Jan 2014 07:04:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:04:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:04:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:04:16 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:04:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:04:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:04:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:04:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:04:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:04:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:04:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:04:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:04:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:04:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:04:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:04:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:04:18 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:04:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:04:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 07:04:18 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:04:18 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:04:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 07:04:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6010 values 94824 bits 11853 bytes 
Sat 18 Jan 2014 07:04:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:04:20 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:04:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:04:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:04:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:04:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:04:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:04:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:04:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:04:22 - job_xml_thread(): Done retrieving: data size 43830145
Sat 18 Jan 2014 07:04:22 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:04:22 - XML: Start document: iteration 18
Sat 18 Jan 2014 07:04:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43830145
Sat 18 Jan 2014 07:04:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:04:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43830145
Sat 18 Jan 2014 07:04:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:04:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:04:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:04:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:04:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:04:36 - XML: Processed 655266 elements - found 530 jobs
Sat 18 Jan 2014 07:04:36 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:04:36 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:04:36 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:04:36 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:04:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:04:42 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:04:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:04:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:04:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:04:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:04:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:04:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:04:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:04:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:04:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:04:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:04:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:04:45 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:04:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 07:04:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:04:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:04:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:04:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:04:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:04:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:04:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43834027
Sat 18 Jan 2014 07:04:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:04:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43834027
Sat 18 Jan 2014 07:04:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:04:51 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:04:51 - job_xml_thread(): Done retrieving: data size 43834027
Sat 18 Jan 2014 07:04:51 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:04:51 - XML: Start document: iteration 19
Sat 18 Jan 2014 07:04:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:04:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:05:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:05:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:05:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:05:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:05:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:05:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:05:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:05:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:05:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:05:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:05:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:05:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:05:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:05:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:05:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:05:09 - XML: Processed 655264 elements - found 530 jobs
Sat 18 Jan 2014 07:05:09 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:05:09 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:05:09 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:05:09 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:05:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:05:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:05:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:05:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:05:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:05:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43766147
Sat 18 Jan 2014 07:05:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:05:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43766147
Sat 18 Jan 2014 07:05:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:05:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:05:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:05:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:05:19 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:05:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:05:19 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:05:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 07:05:19 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:05:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 07:05:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8774 values 138345 bits 17293 bytes 
Sat 18 Jan 2014 07:05:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:05:20 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:05:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:05:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:05:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:05:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:05:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:05:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:05:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43766147
Sat 18 Jan 2014 07:05:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:05:24 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:05:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:05:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:05:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:05:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:05:33 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:05:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:05:33 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:05:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:05:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:05:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:05:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:05:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:05:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:05:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:05:36 - job_xml_thread(): Done retrieving: data size 43628401
Sat 18 Jan 2014 07:05:36 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:05:36 - XML: Start document: iteration 20
Sat 18 Jan 2014 07:05:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:05:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:05:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43628401
Sat 18 Jan 2014 07:05:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:05:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:05:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:05:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:05:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:05:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43628401
Sat 18 Jan 2014 07:05:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:05:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:05:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:05:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:05:52 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:05:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:05:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:05:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:05:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:05:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:05:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:05:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:05:55 - XML: Processed 653098 elements - found 528 jobs
Sat 18 Jan 2014 07:05:55 - job 7335125 appears to have finished
Sat 18 Jan 2014 07:05:55 - job 7337046 appears to have finished
Sat 18 Jan 2014 07:05:55 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 07:05:55 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 07:05:56 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 07:05:56 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:05:56 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:05:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:05:57 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:05:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:05:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:05:57 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:05:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 07:05:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:05:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:05:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:05:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:05:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:05:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:05:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43163883
Sat 18 Jan 2014 07:05:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:05:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43163883
Sat 18 Jan 2014 07:05:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:06:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:06:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:06:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:06:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:06:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:06:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:06:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:06:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:06:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:06:11 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:06:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:06:11 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:06:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:06:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43205059
Sat 18 Jan 2014 07:06:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:06:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:06:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:06:14 - job_xml_thread(): Done retrieving: data size 43205059
Sat 18 Jan 2014 07:06:14 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:06:14 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 07:06:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:06:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:06:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:06:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:06:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43205059
Sat 18 Jan 2014 07:06:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:06:14 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 07:06:14 - Housekeeping: done.
Sat 18 Jan 2014 07:06:14 - XML: Start document: iteration 0
Sat 18 Jan 2014 07:06:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:06:19 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:06:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:06:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 07:06:20 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:06:20 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:06:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 07:06:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:06:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:06:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8938 values 140915 bits 17614 bytes 
Sat 18 Jan 2014 07:06:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:06:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:06:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:06:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:06:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:06:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:06:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:06:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:06:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:06:33 - XML: Processed 647474 elements - found 528 jobs
Sat 18 Jan 2014 07:06:33 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:06:33 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:06:33 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:06:33 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:06:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:06:35 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:06:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:06:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:06:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:06:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:06:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:06:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:06:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:06:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43540864
Sat 18 Jan 2014 07:06:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:06:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43540864
Sat 18 Jan 2014 07:06:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:06:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:06:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:06:49 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:06:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:06:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:06:49 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:06:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:06:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:06:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:06:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:06:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:06:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:06:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:06:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:06:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:06:53 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:06:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:06:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:06:53 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:06:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 07:06:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:06:53 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 07:06:53 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:06:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:06:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:06:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:06:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:06:54 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:06:54 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:06:54 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 07:06:54 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 07:06:54 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 07:06:55 - size of cluster 'LISA Cluster': 624 hosts 79474 metrics 784678 values 12390687 bits 1548835 bytes 
Sat 18 Jan 2014 07:06:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:06:56 - job_xml_thread(): Done retrieving: data size 43797146
Sat 18 Jan 2014 07:06:56 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:06:56 - XML: Start document: iteration 1
Sat 18 Jan 2014 07:06:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43797146
Sat 18 Jan 2014 07:06:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:06:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43797146
Sat 18 Jan 2014 07:06:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:07:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:07:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:07:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:07:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:07:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:07:11 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:07:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:07:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:07:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:07:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:07:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:07:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:07:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:07:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:07:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:07:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:07:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:07:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:07:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:07:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:07:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:07:18 - XML: Processed 654772 elements - found 528 jobs
Sat 18 Jan 2014 07:07:18 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:07:18 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:07:18 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:07:18 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:07:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:07:20 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:07:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:07:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43808158
Sat 18 Jan 2014 07:07:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:07:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43808158
Sat 18 Jan 2014 07:07:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:07:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:07:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 07:07:22 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:07:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6052 values 95484 bits 11935 bytes 
Sat 18 Jan 2014 07:07:22 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:07:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 07:07:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:07:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:07:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:07:33 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:07:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:07:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:07:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:07:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:07:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:07:33 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:07:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:07:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:07:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:07:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:07:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:07:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:07:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:07:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:07:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:07:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:07:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:07:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:07:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:07:40 - job_xml_thread(): Done retrieving: data size 43823724
Sat 18 Jan 2014 07:07:40 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:07:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43823724
Sat 18 Jan 2014 07:07:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:07:40 - XML: Start document: iteration 2
Sat 18 Jan 2014 07:07:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43823724
Sat 18 Jan 2014 07:07:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:07:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:07:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:07:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:07:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:07:54 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:07:54 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 07:07:56 - XML: Processed 655262 elements - found 528 jobs
Sat 18 Jan 2014 07:07:56 - job 7348610 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 07:07:56 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 07:07:56 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 07:07:56 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 07:07:56 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:07:56 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:08:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:08:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:08:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:08:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:08:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:08:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:08:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:08:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:08:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:08:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:08:04 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:08:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:08:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:08:04 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:08:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 07:08:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:08:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:08:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:08:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:08:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:08:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:08:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43822890
Sat 18 Jan 2014 07:08:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:08:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43822890
Sat 18 Jan 2014 07:08:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:08:11 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:08:11 - job_xml_thread(): Done retrieving: data size 43822890
Sat 18 Jan 2014 07:08:11 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:08:11 - XML: Start document: iteration 3
Sat 18 Jan 2014 07:08:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:08:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:08:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:08:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:08:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:08:22 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:08:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:08:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:08:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:08:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 07:08:22 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:08:23 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:08:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 07:08:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5865 values 92524 bits 11565 bytes 
Sat 18 Jan 2014 07:08:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:08:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:08:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:08:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:08:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:08:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:08:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:08:28 - XML: Processed 655262 elements - found 528 jobs
Sat 18 Jan 2014 07:08:29 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:08:29 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:08:29 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:08:29 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:08:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:08:32 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:08:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:08:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:08:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:08:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:08:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:08:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:08:35 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:08:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 07:08:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:08:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:08:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43803306
Sat 18 Jan 2014 07:08:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:08:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43803306
Sat 18 Jan 2014 07:08:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:08:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:08:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:08:44 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:08:44 - job_xml_thread(): Done retrieving: data size 43803306
Sat 18 Jan 2014 07:08:44 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:08:44 - XML: Start document: iteration 4
Sat 18 Jan 2014 07:08:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:08:47 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:08:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:08:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:08:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:08:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:08:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:08:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:08:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:08:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:08:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:08:55 - XML: Processed 655262 elements - found 528 jobs
Sat 18 Jan 2014 07:08:55 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:08:55 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:08:55 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:08:55 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:08:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:08:58 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:08:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:08:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:08:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:08:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:08:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:08:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:09:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:09:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43807819
Sat 18 Jan 2014 07:09:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:09:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43807819
Sat 18 Jan 2014 07:09:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:09:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:09:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:09:10 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:09:10 - job_xml_thread(): Done retrieving: data size 43807819
Sat 18 Jan 2014 07:09:10 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:09:10 - XML: Start document: iteration 5
Sat 18 Jan 2014 07:09:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:09:11 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:09:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:09:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:09:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:09:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:09:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:09:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:09:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:09:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:09:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:09:21 - XML: Processed 655254 elements - found 524 jobs
Sat 18 Jan 2014 07:09:21 - job 7341474 appears to have finished
Sat 18 Jan 2014 07:09:21 - job 7329989 appears to have finished
Sat 18 Jan 2014 07:09:21 - job 7337048 appears to have finished
Sat 18 Jan 2014 07:09:21 - job 7348766 appears to have finished
Sat 18 Jan 2014 07:09:21 - job_xml_thread(): Found 4 updated jobs.
Sat 18 Jan 2014 07:09:21 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 07:09:22 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Sat 18 Jan 2014 07:09:22 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:09:22 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:09:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:09:23 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:09:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:09:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 07:09:23 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:09:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 07:09:24 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:09:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99013 bits 12376 bytes 
Sat 18 Jan 2014 07:09:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:09:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:09:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:09:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:09:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:09:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:09:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:09:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:09:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:09:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:09:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:09:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43804687
Sat 18 Jan 2014 07:09:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:09:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43804687
Sat 18 Jan 2014 07:09:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:09:37 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:09:38 - job_xml_thread(): Done retrieving: data size 43804687
Sat 18 Jan 2014 07:09:38 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:09:38 - XML: Start document: iteration 6
Sat 18 Jan 2014 07:09:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:09:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:09:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:09:44 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:09:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:09:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:09:45 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:09:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 07:09:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:09:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:09:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:09:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:09:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:09:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:09:50 - XML: Processed 655254 elements - found 524 jobs
Sat 18 Jan 2014 07:09:50 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:09:50 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:09:50 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:09:50 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:09:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:09:52 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:09:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:09:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:09:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:09:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:09:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:09:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:09:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:09:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43817609
Sat 18 Jan 2014 07:09:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:09:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43817609
Sat 18 Jan 2014 07:09:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:10:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:10:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:10:05 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:10:05 - job_xml_thread(): Done retrieving: data size 43817609
Sat 18 Jan 2014 07:10:05 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:10:05 - XML: Start document: iteration 7
Sat 18 Jan 2014 07:10:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:10:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:10:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:10:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:10:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:10:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:10:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:10:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:10:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:10:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:10:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:10:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:10:18 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:10:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:10:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:10:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:10:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:10:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:10:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:10:19 - XML: Processed 655254 elements - found 524 jobs
Sat 18 Jan 2014 07:10:19 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:10:19 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:10:19 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:10:19 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:10:21 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 07:10:21 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 07:10:21 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:10:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:10:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43803405
Sat 18 Jan 2014 07:10:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:10:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43803405
Sat 18 Jan 2014 07:10:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:10:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:10:24 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:10:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:10:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:10:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:10:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 07:10:26 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:10:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8924 values 140728 bits 17591 bytes 
Sat 18 Jan 2014 07:10:26 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:10:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 07:10:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:10:32 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:10:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:10:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:10:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:10:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:10:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:10:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:10:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:10:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:10:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:10:34 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:10:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:10:37 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:10:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:10:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:10:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:10:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:10:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:10:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:10:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:10:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43828017
Sat 18 Jan 2014 07:10:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:10:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43828017
Sat 18 Jan 2014 07:10:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:10:40 - job_xml_thread(): Done retrieving: data size 43828017
Sat 18 Jan 2014 07:10:40 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:10:40 - XML: Start document: iteration 8
Sat 18 Jan 2014 07:10:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:10:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:10:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:10:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:10:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:10:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:10:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:10:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:10:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:10:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:10:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:10:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:10:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:11:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:11:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:11:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:11:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:11:01 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:11:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 07:11:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:11:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:11:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:11:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:11:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:11:03 - XML: Processed 655254 elements - found 524 jobs
Sat 18 Jan 2014 07:11:03 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:11:03 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:11:03 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:11:03 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:11:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:11:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43821662
Sat 18 Jan 2014 07:11:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:11:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43821662
Sat 18 Jan 2014 07:11:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:11:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:11:14 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:11:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:11:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:11:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:11:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:11:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:11:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:11:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:11:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:11:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:11:18 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:11:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:11:18 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:11:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:11:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:11:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:11:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:11:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:11:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:11:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:11:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43759582
Sat 18 Jan 2014 07:11:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:11:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43759582
Sat 18 Jan 2014 07:11:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:11:23 - job_xml_thread(): Done retrieving: data size 43759582
Sat 18 Jan 2014 07:11:23 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:11:23 - XML: Start document: iteration 9
Sat 18 Jan 2014 07:11:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:11:27 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:11:29 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:11:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 07:11:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:11:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 07:11:29 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:11:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9231 values 145582 bits 18197 bytes 
Sat 18 Jan 2014 07:11:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:11:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:11:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:11:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:11:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:11:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:11:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:11:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:11:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:11:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:11:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:11:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:11:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:11:40 - XML: Processed 654502 elements - found 522 jobs
Sat 18 Jan 2014 07:11:40 - job 7348767 appears to have finished
Sat 18 Jan 2014 07:11:40 - job 7348768 appears to have finished
Sat 18 Jan 2014 07:11:40 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 07:11:40 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 07:11:40 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 07:11:40 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:11:40 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:11:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:11:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:11:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:11:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:11:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:11:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:11:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:11:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:11:46 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:11:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 07:11:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:11:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:11:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43212892
Sat 18 Jan 2014 07:11:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:11:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43212892
Sat 18 Jan 2014 07:11:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:11:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:11:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:11:56 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:11:56 - job_xml_thread(): Done retrieving: data size 43212892
Sat 18 Jan 2014 07:11:56 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:11:56 - XML: Start document: iteration 10
Sat 18 Jan 2014 07:11:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:11:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:11:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:11:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:11:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:11:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:12:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:12:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:12:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:12:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:12:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:12:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:12:07 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:12:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:12:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:12:08 - XML: Processed 647858 elements - found 522 jobs
Sat 18 Jan 2014 07:12:08 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:12:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:12:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:12:08 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:12:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:12:08 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:12:08 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:12:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:12:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:12:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43152121
Sat 18 Jan 2014 07:12:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:12:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43152121
Sat 18 Jan 2014 07:12:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:12:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:12:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:12:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:12:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:12:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:12:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:12:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:12:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:12:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:12:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:12:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:12:23 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:12:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:12:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:12:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:12:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:12:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:12:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:12:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:12:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:12:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:12:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:12:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:12:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43243645
Sat 18 Jan 2014 07:12:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:12:27 - job_xml_thread(): Done retrieving: data size 43243645
Sat 18 Jan 2014 07:12:27 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:12:27 - XML: Start document: iteration 11
Sat 18 Jan 2014 07:12:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43243645
Sat 18 Jan 2014 07:12:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:12:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:12:29 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:12:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:12:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 07:12:30 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:12:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 07:12:30 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:12:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148576 bits 18572 bytes 
Sat 18 Jan 2014 07:12:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:12:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:12:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:12:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:12:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:12:43 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:12:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:12:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:12:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:12:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:12:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:12:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:12:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:12:48 - XML: Processed 647798 elements - found 522 jobs
Sat 18 Jan 2014 07:12:48 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:12:48 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:12:48 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:12:48 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:12:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:12:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:12:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:12:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:12:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:12:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:12:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:12:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:12:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:12:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43776741
Sat 18 Jan 2014 07:12:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:12:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43776741
Sat 18 Jan 2014 07:12:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:13:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:13:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:13:03 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:13:03 - job_xml_thread(): Done retrieving: data size 43776741
Sat 18 Jan 2014 07:13:03 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:13:03 - XML: Start document: iteration 12
Sat 18 Jan 2014 07:13:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:13:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:13:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:13:07 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:13:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:13:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:13:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:13:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:13:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:13:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:13:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:13:16 - XML: Processed 654772 elements - found 522 jobs
Sat 18 Jan 2014 07:13:16 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:13:16 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:13:16 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:13:16 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:13:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:13:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:13:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:13:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:13:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:13:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:13:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:13:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:13:17 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:13:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 07:13:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:13:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:13:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43786926
Sat 18 Jan 2014 07:13:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:13:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43786926
Sat 18 Jan 2014 07:13:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:13:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:13:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:13:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:13:27 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:13:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:13:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:13:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:13:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:13:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:13:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:13:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:13:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:13:30 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:13:31 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:13:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:13:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 07:13:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 07:13:31 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:13:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5651 values 89038 bits 11129 bytes 
Sat 18 Jan 2014 07:13:32 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:13:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:13:32 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:13:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:13:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:13:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:13:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:13:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:13:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:13:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:13:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43818017
Sat 18 Jan 2014 07:13:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:13:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43818017
Sat 18 Jan 2014 07:13:35 - job_xml_thread(): Done retrieving: data size 43818017
Sat 18 Jan 2014 07:13:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:13:35 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:13:35 - XML: Start document: iteration 13
Sat 18 Jan 2014 07:13:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:13:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:13:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:13:47 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:13:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:13:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:13:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:13:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:13:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:13:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:13:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:13:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:13:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:13:53 - XML: Processed 655243 elements - found 520 jobs
Sat 18 Jan 2014 07:13:53 - job 7337050 appears to have finished
Sat 18 Jan 2014 07:13:53 - job 7348769 appears to have finished
Sat 18 Jan 2014 07:13:53 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 07:13:53 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 07:13:54 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 07:13:54 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:13:54 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:13:54 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 07:13:54 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:13:54 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:13:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 07:13:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:13:55 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:13:55 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:13:55 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 07:13:55 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 07:13:55 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 07:13:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:13:58 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:13:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:13:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:13:58 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 862549 values 13601189 bits 1700148 bytes 
Sat 18 Jan 2014 07:13:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:13:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:13:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:13:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:14:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:14:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43801770
Sat 18 Jan 2014 07:14:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:14:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43801770
Sat 18 Jan 2014 07:14:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:14:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:14:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:14:09 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:14:09 - job_xml_thread(): Done retrieving: data size 43801770
Sat 18 Jan 2014 07:14:09 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:14:09 - XML: Start document: iteration 14
Sat 18 Jan 2014 07:14:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:14:11 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:14:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:14:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:14:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:14:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:14:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:14:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:14:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:14:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:14:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:14:22 - XML: Processed 655246 elements - found 520 jobs
Sat 18 Jan 2014 07:14:22 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:14:22 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:14:22 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:14:22 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:14:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:14:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:14:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:14:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:14:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:14:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:14:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:14:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:14:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:14:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:14:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:14:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43801548
Sat 18 Jan 2014 07:14:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:14:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43801548
Sat 18 Jan 2014 07:14:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:14:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:14:31 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:14:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:14:32 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:14:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 07:14:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 07:14:32 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:14:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9005 values 141960 bits 17745 bytes 
Sat 18 Jan 2014 07:14:37 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:14:37 - job_xml_thread(): Done retrieving: data size 43801548
Sat 18 Jan 2014 07:14:37 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:14:37 - XML: Start document: iteration 15
Sat 18 Jan 2014 07:14:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:14:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:14:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:14:46 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:14:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:14:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:14:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:14:48 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:14:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:14:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:14:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:14:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:14:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:14:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:14:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:14:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:14:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:14:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:14:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:14:51 - XML: Processed 655246 elements - found 520 jobs
Sat 18 Jan 2014 07:14:51 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:14:51 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:14:51 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:14:51 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:14:55 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:14:55 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 07:14:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:14:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43824955
Sat 18 Jan 2014 07:14:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:14:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43824955
Sat 18 Jan 2014 07:14:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:15:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:15:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:15:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:15:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:15:06 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:15:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:15:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:15:10 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:15:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:15:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:15:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:15:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:15:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:15:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:15:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:15:11 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:15:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:15:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:15:11 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:15:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 07:15:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:15:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:15:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:15:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:15:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:15:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:15:14 - job_xml_thread(): Done retrieving: data size 43824401
Sat 18 Jan 2014 07:15:14 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:15:14 - XML: Start document: iteration 16
Sat 18 Jan 2014 07:15:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43824401
Sat 18 Jan 2014 07:15:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43824401
Sat 18 Jan 2014 07:15:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:15:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:15:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:15:26 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:15:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:15:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:15:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:15:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:15:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:15:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:15:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:15:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:15:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:15:30 - XML: Processed 655246 elements - found 520 jobs
Sat 18 Jan 2014 07:15:30 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:15:30 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:15:30 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:15:30 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:15:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:15:32 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:15:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:15:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 07:15:33 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:15:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5820 values 91763 bits 11470 bytes 
Sat 18 Jan 2014 07:15:33 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:15:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 07:15:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:15:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:15:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:15:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:15:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:15:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:15:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:15:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:15:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:15:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43803334
Sat 18 Jan 2014 07:15:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:15:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43803334
Sat 18 Jan 2014 07:15:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:15:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:15:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:15:45 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:15:45 - job_xml_thread(): Done retrieving: data size 43803334
Sat 18 Jan 2014 07:15:45 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:15:45 - XML: Start document: iteration 17
Sat 18 Jan 2014 07:15:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:15:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:15:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:15:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:15:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:15:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:15:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:15:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:15:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:15:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:15:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:16:01 - XML: Processed 655246 elements - found 520 jobs
Sat 18 Jan 2014 07:16:01 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:16:01 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:16:01 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:16:01 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:16:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:16:01 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:16:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:16:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:16:02 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:16:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 07:16:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:16:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:16:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:16:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:16:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:16:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:16:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43822816
Sat 18 Jan 2014 07:16:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:16:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43822816
Sat 18 Jan 2014 07:16:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:16:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:16:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:16:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:16:13 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:16:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:16:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:16:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:16:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:16:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:16:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:16:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43822816
Sat 18 Jan 2014 07:16:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:16:16 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:16:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:16:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:16:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:16:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:16:24 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:16:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:16:27 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:16:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:16:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:16:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:16:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:16:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:16:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:16:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:16:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:16:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:16:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:16:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:16:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:16:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:16:31 - job_xml_thread(): Done retrieving: data size 43810093
Sat 18 Jan 2014 07:16:31 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:16:31 - XML: Start document: iteration 18
Sat 18 Jan 2014 07:16:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43810093
Sat 18 Jan 2014 07:16:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43810093
Sat 18 Jan 2014 07:16:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:16:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:16:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:16:33 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:16:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:16:34 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:16:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 07:16:34 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:16:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 07:16:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5569 values 87856 bits 10982 bytes 
Sat 18 Jan 2014 07:16:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:16:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:16:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:16:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:16:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:16:46 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:16:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:16:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:16:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:16:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:16:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:16:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:16:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:16:49 - XML: Processed 655246 elements - found 520 jobs
Sat 18 Jan 2014 07:16:49 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:16:49 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:16:49 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:16:49 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:16:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:16:54 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:16:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:16:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:16:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:16:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:16:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:16:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:16:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:16:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43831444
Sat 18 Jan 2014 07:16:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:16:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43831444
Sat 18 Jan 2014 07:16:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:17:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:17:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:17:04 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:17:04 - job_xml_thread(): Done retrieving: data size 43831444
Sat 18 Jan 2014 07:17:04 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:17:04 - XML: Start document: iteration 19
Sat 18 Jan 2014 07:17:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:17:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:17:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:17:14 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:17:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:17:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:17:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:17:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:17:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:17:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:17:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:17:16 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:17:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 07:17:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:17:20 - XML: Processed 655246 elements - found 520 jobs
Sat 18 Jan 2014 07:17:20 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:17:20 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:17:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:17:20 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:17:20 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:17:20 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:17:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:17:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:17:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:17:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:17:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:17:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:17:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:17:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43752204
Sat 18 Jan 2014 07:17:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:17:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43752204
Sat 18 Jan 2014 07:17:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:17:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:17:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:17:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:17:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:17:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:17:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:17:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:17:34 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:17:35 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:17:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:17:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:17:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:17:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:17:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:17:35 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:17:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 07:17:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:17:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 07:17:36 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:17:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6149 values 97240 bits 12155 bytes 
Sat 18 Jan 2014 07:17:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:17:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:17:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:17:40 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:17:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:17:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:17:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:17:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:17:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:17:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:17:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:17:44 - job_xml_thread(): Done retrieving: data size 43277878
Sat 18 Jan 2014 07:17:44 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:17:44 - XML: Start document: iteration 20
Sat 18 Jan 2014 07:17:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43277878
Sat 18 Jan 2014 07:17:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43277878
Sat 18 Jan 2014 07:17:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:17:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:17:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:17:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:17:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:17:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:17:58 - XML: Processed 648392 elements - found 520 jobs
Sat 18 Jan 2014 07:17:58 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:17:58 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:17:58 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:17:58 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:18:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:18:03 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:18:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:18:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:18:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:18:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:18:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:18:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:18:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:18:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:18:06 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:18:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:18:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:18:06 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:18:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 07:18:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:18:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:18:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:18:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:18:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:18:07 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 07:18:07 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 07:18:07 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:18:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:18:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43166708
Sat 18 Jan 2014 07:18:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:18:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43166708
Sat 18 Jan 2014 07:18:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:18:14 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:18:14 - job_xml_thread(): Done retrieving: data size 43166708
Sat 18 Jan 2014 07:18:15 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:18:15 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 07:18:16 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 07:18:16 - Housekeeping: done.
Sat 18 Jan 2014 07:18:16 - XML: Start document: iteration 0
Sat 18 Jan 2014 07:18:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:18:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:18:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:18:20 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:18:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:18:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:18:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:18:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:18:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:18:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:18:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:18:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:18:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:18:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:18:29 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:18:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:18:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:18:30 - XML: Processed 647046 elements - found 520 jobs
Sat 18 Jan 2014 07:18:30 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:18:30 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:18:30 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:18:30 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:18:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:18:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:18:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:18:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:18:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:18:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43425018
Sat 18 Jan 2014 07:18:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:18:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43425018
Sat 18 Jan 2014 07:18:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:18:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:18:36 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:18:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:18:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:18:37 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:18:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:18:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 07:18:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 07:18:37 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:18:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8916 values 140851 bits 17606 bytes 
Sat 18 Jan 2014 07:18:45 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:18:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:18:45 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:18:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:18:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:18:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:18:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:18:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:18:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:18:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:18:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:18:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:18:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:18:48 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:18:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:18:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:18:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:18:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:18:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:18:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:18:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:18:50 - job_xml_thread(): Done retrieving: data size 43790284
Sat 18 Jan 2014 07:18:50 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:18:50 - XML: Start document: iteration 1
Sat 18 Jan 2014 07:18:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43790284
Sat 18 Jan 2014 07:18:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:18:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43790284
Sat 18 Jan 2014 07:18:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:19:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:19:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:19:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:19:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:19:10 - XML: Processed 654816 elements - found 520 jobs
Sat 18 Jan 2014 07:19:10 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:19:10 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:19:10 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:19:10 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:19:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:19:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:19:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:19:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:19:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:19:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:19:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:19:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:19:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:19:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:19:13 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:19:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:19:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:19:14 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:19:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 07:19:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:19:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:19:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:19:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:19:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:19:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:19:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43845343
Sat 18 Jan 2014 07:19:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:19:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43845343
Sat 18 Jan 2014 07:19:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:19:26 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:19:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:19:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:19:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:19:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:19:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:19:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:19:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:19:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:19:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:19:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:19:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:19:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:19:30 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:19:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:19:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:19:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:19:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:19:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:19:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:19:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:19:32 - job_xml_thread(): Done retrieving: data size 43824457
Sat 18 Jan 2014 07:19:32 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:19:32 - XML: Start document: iteration 2
Sat 18 Jan 2014 07:19:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43824457
Sat 18 Jan 2014 07:19:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:19:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43824457
Sat 18 Jan 2014 07:19:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:19:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:19:37 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:19:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:19:38 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:19:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 07:19:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 07:19:38 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:19:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8771 values 138314 bits 17289 bytes 
Sat 18 Jan 2014 07:19:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:19:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:19:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:19:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:19:46 - XML: Processed 655246 elements - found 520 jobs
Sat 18 Jan 2014 07:19:46 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:19:46 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:19:46 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:19:47 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:19:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:19:49 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:19:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:19:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:19:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:19:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:19:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:19:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:19:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:19:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:19:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:19:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:19:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:19:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:19:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:19:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:19:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:19:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:19:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43825338
Sat 18 Jan 2014 07:19:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:19:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43825338
Sat 18 Jan 2014 07:19:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:20:02 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:20:02 - job_xml_thread(): Done retrieving: data size 43825338
Sat 18 Jan 2014 07:20:02 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:20:02 - XML: Start document: iteration 3
Sat 18 Jan 2014 07:20:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:20:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:20:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:20:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:20:15 - XML: Processed 655246 elements - found 520 jobs
Sat 18 Jan 2014 07:20:15 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:20:15 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:20:15 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:20:15 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:20:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:20:19 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:20:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:20:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:20:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:20:19 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:20:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:20:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:20:19 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:20:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 07:20:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:20:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:20:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:20:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:20:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:20:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:20:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:20:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:20:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:20:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:20:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:20:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43826468
Sat 18 Jan 2014 07:20:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:20:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43826468
Sat 18 Jan 2014 07:20:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:20:30 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:20:30 - job_xml_thread(): Done retrieving: data size 43826468
Sat 18 Jan 2014 07:20:30 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:20:30 - XML: Start document: iteration 4
Sat 18 Jan 2014 07:20:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:20:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:20:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:20:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:20:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:20:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:20:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:20:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:20:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:20:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:20:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:20:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:20:38 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:20:39 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:20:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 07:20:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:20:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 07:20:39 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:20:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5962 values 94064 bits 11758 bytes 
Sat 18 Jan 2014 07:20:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:20:43 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:20:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:20:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:20:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:20:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:20:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:20:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:20:44 - XML: Processed 655246 elements - found 520 jobs
Sat 18 Jan 2014 07:20:44 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:20:44 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:20:44 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:20:44 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:20:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:20:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43811938
Sat 18 Jan 2014 07:20:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:20:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43811938
Sat 18 Jan 2014 07:20:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:20:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:20:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:20:55 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 07:20:55 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:20:57 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:20:57 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 07:20:57 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 07:20:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:20:57 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:20:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:20:57 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 07:20:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:20:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:20:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:20:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:20:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:20:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:20:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:20:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:20:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:20:59 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:20:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 07:20:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:20:59 - size of cluster 'LISA Cluster': 624 hosts 79471 metrics 778989 values 12302504 bits 1537813 bytes 
Sat 18 Jan 2014 07:20:59 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:21:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:21:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:21:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:21:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:21:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:21:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:21:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:21:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:21:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:21:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43809393
Sat 18 Jan 2014 07:21:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:21:06 - job_xml_thread(): Done retrieving: data size 43809393
Sat 18 Jan 2014 07:21:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43809393
Sat 18 Jan 2014 07:21:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:21:06 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:21:06 - XML: Start document: iteration 5
Sat 18 Jan 2014 07:21:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:21:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:21:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:21:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:21:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:21:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:21:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:21:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:21:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:21:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:21:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:21:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:21:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:21:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:21:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:21:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:21:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:21:26 - XML: Processed 655246 elements - found 520 jobs
Sat 18 Jan 2014 07:21:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:21:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:21:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:21:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:21:26 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:21:26 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:21:26 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:21:26 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:21:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:21:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43844290
Sat 18 Jan 2014 07:21:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:21:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43844290
Sat 18 Jan 2014 07:21:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:21:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:21:39 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:21:40 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:21:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:21:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:21:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 07:21:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 07:21:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:21:40 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:21:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9191 values 145042 bits 18130 bytes 
Sat 18 Jan 2014 07:21:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:21:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:21:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:21:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:21:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:21:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:21:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:21:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:21:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:21:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:21:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:21:41 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:21:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:21:46 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:21:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:21:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:21:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:21:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:21:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:21:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:21:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:21:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43808444
Sat 18 Jan 2014 07:21:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:21:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43808444
Sat 18 Jan 2014 07:21:50 - job_xml_thread(): Done retrieving: data size 43808444
Sat 18 Jan 2014 07:21:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:21:51 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:21:51 - XML: Start document: iteration 6
Sat 18 Jan 2014 07:21:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:21:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:21:57 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:21:57 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 07:22:02 - XML: Processed 655243 elements - found 520 jobs
Sat 18 Jan 2014 07:22:02 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:22:02 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:22:02 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:22:02 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:22:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:22:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:22:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:22:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:22:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:22:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:22:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:22:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:22:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:22:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:22:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:22:11 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:22:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 07:22:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:22:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:22:13 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:22:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:22:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:22:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:22:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:22:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:22:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:22:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:22:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43820042
Sat 18 Jan 2014 07:22:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:22:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43820042
Sat 18 Jan 2014 07:22:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:22:18 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:22:18 - job_xml_thread(): Done retrieving: data size 43820042
Sat 18 Jan 2014 07:22:18 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:22:18 - XML: Start document: iteration 7
Sat 18 Jan 2014 07:22:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:22:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:22:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:22:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:22:33 - XML: Processed 655246 elements - found 520 jobs
Sat 18 Jan 2014 07:22:33 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:22:33 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:22:33 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:22:33 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:22:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:22:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:22:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:22:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:22:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:22:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:22:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:22:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:22:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:22:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:22:39 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:22:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:22:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:22:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:22:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:22:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:22:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:22:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:22:40 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:22:41 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:22:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:22:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 07:22:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 07:22:41 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:22:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5937 values 93674 bits 11709 bytes 
Sat 18 Jan 2014 07:22:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:22:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43836438
Sat 18 Jan 2014 07:22:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:22:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43836438
Sat 18 Jan 2014 07:22:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:22:48 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:22:48 - job_xml_thread(): Done retrieving: data size 43836438
Sat 18 Jan 2014 07:22:48 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:22:48 - XML: Start document: iteration 8
Sat 18 Jan 2014 07:22:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:22:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:22:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:22:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:22:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:22:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:22:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:22:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:23:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:23:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:23:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:23:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:23:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:23:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:23:04 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:23:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:23:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:23:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:23:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:23:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:23:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:23:07 - XML: Processed 655246 elements - found 520 jobs
Sat 18 Jan 2014 07:23:07 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:23:07 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:23:07 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:23:07 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:23:10 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:23:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 07:23:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:23:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:23:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43814437
Sat 18 Jan 2014 07:23:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:23:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43814437
Sat 18 Jan 2014 07:23:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:23:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:23:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:23:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:23:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:23:22 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:23:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:23:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:23:24 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:23:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:23:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:23:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:23:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:23:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:23:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:23:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:23:27 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:23:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:23:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:23:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:23:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:23:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:23:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:23:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:23:30 - job_xml_thread(): Done retrieving: data size 43762714
Sat 18 Jan 2014 07:23:30 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:23:30 - XML: Start document: iteration 9
Sat 18 Jan 2014 07:23:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43762714
Sat 18 Jan 2014 07:23:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:23:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43762714
Sat 18 Jan 2014 07:23:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:23:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:23:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:23:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:23:41 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:23:42 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:23:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 07:23:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:23:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 07:23:43 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:23:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:23:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:23:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7306 values 115172 bits 14396 bytes 
Sat 18 Jan 2014 07:23:47 - XML: Processed 654496 elements - found 520 jobs
Sat 18 Jan 2014 07:23:48 - job 7348611 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 07:23:48 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 07:23:48 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 07:23:49 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 07:23:49 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:23:49 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:23:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:23:50 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:23:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:23:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:23:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:23:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:23:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:23:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:23:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:23:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:23:53 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:23:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:23:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:23:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:23:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:23:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:23:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:23:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:23:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43175646
Sat 18 Jan 2014 07:23:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:23:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43175646
Sat 18 Jan 2014 07:23:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:24:04 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:24:04 - job_xml_thread(): Done retrieving: data size 43175646
Sat 18 Jan 2014 07:24:04 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:24:04 - XML: Start document: iteration 10
Sat 18 Jan 2014 07:24:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:24:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:24:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:24:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:24:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:24:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:24:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:24:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:24:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:24:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:24:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:24:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:24:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:24:15 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:24:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 07:24:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:24:17 - XML: Processed 647132 elements - found 520 jobs
Sat 18 Jan 2014 07:24:17 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:24:17 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:24:17 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:24:17 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:24:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:24:20 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:24:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:24:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:24:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:24:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:24:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:24:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:24:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:24:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43194640
Sat 18 Jan 2014 07:24:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:24:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43194640
Sat 18 Jan 2014 07:24:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:24:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:24:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:24:33 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:24:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:24:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:24:33 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:24:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:24:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:24:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:24:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:24:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:24:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:24:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:24:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:24:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:24:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:24:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:24:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:24:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:24:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:24:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:24:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:24:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:24:40 - job_xml_thread(): Done retrieving: data size 43650141
Sat 18 Jan 2014 07:24:40 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:24:40 - XML: Start document: iteration 11
Sat 18 Jan 2014 07:24:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43650141
Sat 18 Jan 2014 07:24:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:24:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43650141
Sat 18 Jan 2014 07:24:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:24:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:24:43 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:24:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:24:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 07:24:44 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:24:44 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:24:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 07:24:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7315 values 115423 bits 14427 bytes 
Sat 18 Jan 2014 07:24:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:24:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:24:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:24:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:24:55 - XML: Processed 653104 elements - found 520 jobs
Sat 18 Jan 2014 07:24:55 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:24:55 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:24:55 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:24:55 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:25:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:25:02 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:25:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:25:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:25:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:25:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:25:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:25:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:25:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:25:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:25:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:25:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:25:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:25:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:25:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:25:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:25:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:25:04 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 07:25:04 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 07:25:04 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:25:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:25:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43834583
Sat 18 Jan 2014 07:25:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:25:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43834583
Sat 18 Jan 2014 07:25:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:25:10 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:25:10 - job_xml_thread(): Done retrieving: data size 43834583
Sat 18 Jan 2014 07:25:10 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:25:10 - XML: Start document: iteration 12
Sat 18 Jan 2014 07:25:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:25:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:25:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:25:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:25:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:25:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:25:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:25:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:25:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:25:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:25:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:25:26 - XML: Processed 655244 elements - found 519 jobs
Sat 18 Jan 2014 07:25:26 - job 7341499 appears to have finished
Sat 18 Jan 2014 07:25:26 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 07:25:26 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 07:25:27 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 07:25:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:25:27 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:25:27 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:25:27 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:25:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:25:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:25:27 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:25:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 07:25:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:25:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:25:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:25:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:25:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:25:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:25:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43810280
Sat 18 Jan 2014 07:25:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:25:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43810280
Sat 18 Jan 2014 07:25:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:25:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:25:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:25:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:25:39 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:25:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:25:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:25:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:25:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:25:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:25:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:25:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:25:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:25:42 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:25:42 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:25:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:25:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:25:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:25:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:25:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:25:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:25:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:25:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43829198
Sat 18 Jan 2014 07:25:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:25:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:25:44 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:25:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:25:44 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:25:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 07:25:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 07:25:44 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:25:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9022 values 142266 bits 17783 bytes 
Sat 18 Jan 2014 07:25:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43829198
Sat 18 Jan 2014 07:25:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:25:45 - job_xml_thread(): Done retrieving: data size 43829198
Sat 18 Jan 2014 07:25:45 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:25:45 - XML: Start document: iteration 13
Sat 18 Jan 2014 07:25:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:25:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:25:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:25:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:25:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:25:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:25:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:25:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:25:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:25:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:25:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:25:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:25:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:26:04 - XML: Processed 655244 elements - found 519 jobs
Sat 18 Jan 2014 07:26:04 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:26:04 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:26:04 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:26:04 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:26:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:26:07 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:26:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:26:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:26:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:26:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:26:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:26:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:26:09 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:26:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 07:26:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:26:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:26:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43807779
Sat 18 Jan 2014 07:26:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:26:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43807779
Sat 18 Jan 2014 07:26:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:26:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:26:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:26:19 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:26:19 - job_xml_thread(): Done retrieving: data size 43807779
Sat 18 Jan 2014 07:26:20 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:26:20 - XML: Start document: iteration 14
Sat 18 Jan 2014 07:26:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:26:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:26:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:26:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:26:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:26:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:26:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:26:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:26:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:26:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:26:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:26:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:26:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:26:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:26:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:26:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:26:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:26:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:26:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:26:31 - XML: Processed 655244 elements - found 519 jobs
Sat 18 Jan 2014 07:26:31 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:26:31 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:26:31 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:26:31 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:26:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:26:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43825059
Sat 18 Jan 2014 07:26:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:26:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43825059
Sat 18 Jan 2014 07:26:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:26:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:26:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:26:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:26:45 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:26:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:26:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:26:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:26:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 07:26:45 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:26:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 07:26:45 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:26:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99043 bits 12380 bytes 
Sat 18 Jan 2014 07:26:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:26:45 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:26:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:26:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:26:46 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:26:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:26:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:26:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:26:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:26:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:26:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:26:48 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:26:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:26:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:26:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:26:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:26:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:26:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:26:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:26:51 - job_xml_thread(): Done retrieving: data size 43828042
Sat 18 Jan 2014 07:26:51 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:26:51 - XML: Start document: iteration 15
Sat 18 Jan 2014 07:26:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43828042
Sat 18 Jan 2014 07:26:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43828042
Sat 18 Jan 2014 07:26:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:26:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:27:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:27:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:27:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:27:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:27:08 - XML: Processed 655244 elements - found 519 jobs
Sat 18 Jan 2014 07:27:08 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:27:08 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:27:08 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:27:08 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:27:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:27:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:27:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:27:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:27:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:27:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:27:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:27:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:27:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:27:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:27:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:27:15 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:27:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 07:27:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:27:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:27:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:27:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:27:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:27:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:27:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:27:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:27:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43810432
Sat 18 Jan 2014 07:27:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:27:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43810432
Sat 18 Jan 2014 07:27:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:27:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:27:25 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:27:25 - job_xml_thread(): Done retrieving: data size 43810432
Sat 18 Jan 2014 07:27:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:27:25 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:27:25 - XML: Start document: iteration 16
Sat 18 Jan 2014 07:27:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:27:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:27:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:27:31 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:27:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:27:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:27:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:27:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:27:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:27:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:27:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:27:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:27:39 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:27:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:27:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:27:40 - XML: Processed 655244 elements - found 519 jobs
Sat 18 Jan 2014 07:27:40 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:27:40 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:27:40 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:27:40 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:27:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:27:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:27:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:27:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:27:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:27:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43821453
Sat 18 Jan 2014 07:27:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:27:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43821453
Sat 18 Jan 2014 07:27:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:27:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:27:45 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:27:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:27:46 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:27:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 07:27:46 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:27:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 07:27:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8933 values 140900 bits 17612 bytes 
Sat 18 Jan 2014 07:27:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:27:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:27:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:27:53 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:27:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:27:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:27:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:27:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:27:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:27:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:27:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:27:55 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:27:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:27:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:27:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:27:56 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:27:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:27:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:27:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:27:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:27:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:27:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:27:57 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 07:27:57 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:27:57 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:27:57 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 07:27:57 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:27:57 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 07:27:57 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 07:27:58 - size of cluster 'LISA Cluster': 624 hosts 79477 metrics 857728 values 13519837 bits 1689979 bytes 
Sat 18 Jan 2014 07:27:59 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:27:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 07:27:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:28:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:28:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43832098
Sat 18 Jan 2014 07:28:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:28:00 - job_xml_thread(): Done retrieving: data size 43832098
Sat 18 Jan 2014 07:28:00 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:28:00 - XML: Start document: iteration 17
Sat 18 Jan 2014 07:28:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43832098
Sat 18 Jan 2014 07:28:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:28:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:28:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:28:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:28:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:28:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:28:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:28:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:28:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:28:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:28:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:28:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43832098
Sat 18 Jan 2014 07:28:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:28:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:28:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:28:23 - XML: Processed 655244 elements - found 519 jobs
Sat 18 Jan 2014 07:28:23 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:28:23 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:28:23 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:28:23 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:28:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:28:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:28:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:28:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:28:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:28:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:28:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:28:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:28:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:28:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:28:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:28:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:28:30 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:28:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:28:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:28:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:28:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:28:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:28:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:28:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:28:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43823083
Sat 18 Jan 2014 07:28:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:28:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43823083
Sat 18 Jan 2014 07:28:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:28:38 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:28:38 - job_xml_thread(): Done retrieving: data size 43823083
Sat 18 Jan 2014 07:28:38 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:28:38 - XML: Start document: iteration 18
Sat 18 Jan 2014 07:28:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:28:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:28:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:28:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:28:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:28:47 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:28:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:28:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 07:28:48 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:28:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99008 bits 12376 bytes 
Sat 18 Jan 2014 07:28:48 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:28:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 07:28:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:28:49 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:28:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:28:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:28:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:28:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:28:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:28:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:28:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:28:56 - XML: Processed 655244 elements - found 519 jobs
Sat 18 Jan 2014 07:28:56 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:28:56 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:28:56 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:28:56 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:28:57 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:28:57 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 07:28:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:28:57 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:28:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:28:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:28:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:28:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:28:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:28:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:29:00 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:29:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 07:29:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:29:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:29:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43807804
Sat 18 Jan 2014 07:29:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:29:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43807804
Sat 18 Jan 2014 07:29:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:29:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:29:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:29:11 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:29:11 - job_xml_thread(): Done retrieving: data size 43807804
Sat 18 Jan 2014 07:29:11 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:29:11 - XML: Start document: iteration 19
Sat 18 Jan 2014 07:29:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:29:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:29:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:29:14 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:29:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:29:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:29:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:29:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:29:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:29:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:29:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:29:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:29:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:29:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:29:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:29:26 - XML: Processed 655244 elements - found 519 jobs
Sat 18 Jan 2014 07:29:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:29:26 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:29:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:29:26 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:29:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:29:26 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:29:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:29:26 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:29:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:29:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43742791
Sat 18 Jan 2014 07:29:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:29:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43742791
Sat 18 Jan 2014 07:29:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:29:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:29:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:29:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:29:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:29:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:29:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:29:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:29:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:29:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:29:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:29:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43742791
Sat 18 Jan 2014 07:29:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:29:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:29:41 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:29:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:29:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:29:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:29:49 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:29:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:29:49 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:29:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:29:49 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:29:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 07:29:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 07:29:49 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:29:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99023 bits 12377 bytes 
Sat 18 Jan 2014 07:29:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:29:50 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:29:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:29:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:29:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:29:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:29:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:29:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:29:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:29:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:29:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:29:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:29:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:29:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:29:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:29:54 - job_xml_thread(): Done retrieving: data size 43204093
Sat 18 Jan 2014 07:29:54 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:29:54 - XML: Start document: iteration 20
Sat 18 Jan 2014 07:29:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43204093
Sat 18 Jan 2014 07:29:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:29:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43204093
Sat 18 Jan 2014 07:29:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:30:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:30:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:30:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:30:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:30:12 - XML: Processed 647856 elements - found 519 jobs
Sat 18 Jan 2014 07:30:12 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:30:13 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:30:13 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:30:13 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:30:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:30:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:30:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:30:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:30:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:30:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:30:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:30:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:30:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:30:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:30:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:30:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:30:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:30:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:30:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:30:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:30:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:30:17 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:30:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 07:30:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:30:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:30:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43226708
Sat 18 Jan 2014 07:30:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:30:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43226708
Sat 18 Jan 2014 07:30:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:30:28 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:30:28 - job_xml_thread(): Done retrieving: data size 43226708
Sat 18 Jan 2014 07:30:28 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:30:28 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 07:30:28 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 07:30:28 - Housekeeping: done.
Sat 18 Jan 2014 07:30:28 - XML: Start document: iteration 0
Sat 18 Jan 2014 07:30:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:30:30 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:30:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:30:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:30:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:30:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:30:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:30:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:30:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:30:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:30:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:30:41 - XML: Processed 647792 elements - found 519 jobs
Sat 18 Jan 2014 07:30:41 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:30:41 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:30:41 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:30:41 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:30:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:30:43 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:30:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:30:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:30:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:30:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:30:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:30:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:30:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:30:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43730153
Sat 18 Jan 2014 07:30:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:30:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43730153
Sat 18 Jan 2014 07:30:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:30:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:30:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:30:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:30:49 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:30:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:30:50 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:30:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 07:30:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 07:30:50 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:30:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8944 values 141056 bits 17632 bytes 
Sat 18 Jan 2014 07:30:56 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:30:56 - job_xml_thread(): Done retrieving: data size 43730153
Sat 18 Jan 2014 07:30:56 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:30:56 - XML: Start document: iteration 1
Sat 18 Jan 2014 07:30:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:30:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:31:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:31:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:31:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:31:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:31:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:31:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:31:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:31:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:31:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:31:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:31:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:31:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:31:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:31:09 - XML: Processed 654458 elements - found 519 jobs
Sat 18 Jan 2014 07:31:09 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:31:09 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:31:09 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:31:09 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:31:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:31:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:31:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:31:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:31:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:31:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43813185
Sat 18 Jan 2014 07:31:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:31:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43813185
Sat 18 Jan 2014 07:31:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:31:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:31:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:31:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:31:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:31:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:31:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:31:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:31:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:31:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:31:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:31:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43813185
Sat 18 Jan 2014 07:31:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:31:24 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:31:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:31:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:31:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:31:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:31:29 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:31:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:31:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:31:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:31:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:31:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:31:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:31:30 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:31:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 07:31:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:31:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:31:33 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:31:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:31:36 - job_xml_thread(): Done retrieving: data size 43803141
Sat 18 Jan 2014 07:31:36 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:31:36 - XML: Start document: iteration 2
Sat 18 Jan 2014 07:31:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43803141
Sat 18 Jan 2014 07:31:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:31:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:31:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:31:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:31:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:31:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:31:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43803141
Sat 18 Jan 2014 07:31:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:31:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:31:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:31:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:31:47 - XML: Processed 655244 elements - found 519 jobs
Sat 18 Jan 2014 07:31:47 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:31:47 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:31:47 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:31:47 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:31:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:31:51 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:31:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:31:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 07:31:51 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:31:51 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:31:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 07:31:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5965 values 94312 bits 11789 bytes 
Sat 18 Jan 2014 07:31:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:31:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:31:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:31:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:31:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:31:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:31:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:31:59 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:31:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:31:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:32:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:32:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:32:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:32:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:32:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:32:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:32:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:32:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:32:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:32:02 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:32:04 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:32:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 07:32:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:32:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:32:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43831611
Sat 18 Jan 2014 07:32:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:32:04 - job_xml_thread(): Done retrieving: data size 43831611
Sat 18 Jan 2014 07:32:04 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:32:04 - XML: Start document: iteration 3
Sat 18 Jan 2014 07:32:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43831611
Sat 18 Jan 2014 07:32:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:32:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:32:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:32:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:32:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:32:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:32:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:32:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:32:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:32:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:32:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:32:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:32:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:32:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:32:25 - XML: Processed 655244 elements - found 519 jobs
Sat 18 Jan 2014 07:32:25 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:32:25 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:32:25 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:32:25 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:32:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:32:27 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:32:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:32:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:32:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:32:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:32:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:32:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:32:30 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 07:32:30 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 07:32:30 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:32:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:32:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43813974
Sat 18 Jan 2014 07:32:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:32:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43813974
Sat 18 Jan 2014 07:32:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:32:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:32:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:32:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:32:39 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:32:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:32:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:32:40 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:32:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:32:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:32:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:32:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:32:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:32:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:32:43 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:32:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:32:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:32:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:32:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:32:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:32:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:32:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:32:45 - job_xml_thread(): Done retrieving: data size 43827777
Sat 18 Jan 2014 07:32:45 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:32:45 - XML: Start document: iteration 4
Sat 18 Jan 2014 07:32:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43827777
Sat 18 Jan 2014 07:32:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:32:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43827777
Sat 18 Jan 2014 07:32:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:32:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:32:52 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:32:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:32:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 07:32:53 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:32:53 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:32:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 07:32:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9268 values 146671 bits 18333 bytes 
Sat 18 Jan 2014 07:32:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:32:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:32:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:32:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:33:02 - XML: Processed 655244 elements - found 519 jobs
Sat 18 Jan 2014 07:33:02 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:33:03 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:33:03 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:33:03 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:33:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:33:07 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:33:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:33:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:33:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:33:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:33:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:33:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:33:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:33:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:33:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:33:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:33:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:33:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:33:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:33:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:33:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:33:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:33:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43841577
Sat 18 Jan 2014 07:33:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:33:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43841577
Sat 18 Jan 2014 07:33:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:33:18 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:33:18 - job_xml_thread(): Done retrieving: data size 43841577
Sat 18 Jan 2014 07:33:18 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:33:18 - XML: Start document: iteration 5
Sat 18 Jan 2014 07:33:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:33:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:33:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:33:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:33:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:33:32 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:33:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:33:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:33:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:33:33 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:33:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:33:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:33:34 - XML: Processed 655244 elements - found 519 jobs
Sat 18 Jan 2014 07:33:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:33:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:33:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:33:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:33:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:33:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:33:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:33:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:33:34 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:33:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:33:34 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:33:34 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:33:34 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:33:34 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:33:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 07:33:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:33:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:33:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43841066
Sat 18 Jan 2014 07:33:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:33:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43841066
Sat 18 Jan 2014 07:33:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:33:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:33:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:33:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:33:49 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:33:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:33:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:33:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:33:49 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:33:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:33:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:33:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:33:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:33:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:33:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:33:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:33:52 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:33:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:33:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:33:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:33:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:33:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:33:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:33:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:33:53 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:33:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:33:53 - job_xml_thread(): Done retrieving: data size 43838251
Sat 18 Jan 2014 07:33:53 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:33:53 - XML: Start document: iteration 6
Sat 18 Jan 2014 07:33:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43838251
Sat 18 Jan 2014 07:33:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43838251
Sat 18 Jan 2014 07:33:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:33:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:33:54 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:33:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 07:33:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:33:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 07:33:56 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:33:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5671 values 89466 bits 11183 bytes 
Sat 18 Jan 2014 07:34:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:34:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:34:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:34:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:34:08 - XML: Processed 655244 elements - found 519 jobs
Sat 18 Jan 2014 07:34:08 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:34:08 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:34:08 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:34:08 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:34:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:34:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:34:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:34:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:34:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:34:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:34:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:34:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:34:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:34:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:34:16 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:34:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:34:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:34:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:34:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:34:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:34:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:34:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:34:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43823207
Sat 18 Jan 2014 07:34:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:34:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43823207
Sat 18 Jan 2014 07:34:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:34:24 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:34:24 - job_xml_thread(): Done retrieving: data size 43823207
Sat 18 Jan 2014 07:34:24 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:34:24 - XML: Start document: iteration 7
Sat 18 Jan 2014 07:34:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:34:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:34:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:34:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:34:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:34:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:34:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:34:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:34:38 - XML: Processed 655244 elements - found 519 jobs
Sat 18 Jan 2014 07:34:38 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:34:38 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:34:38 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:34:38 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:34:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:34:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:34:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:34:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:34:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:34:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:34:42 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:34:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:34:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:34:42 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:34:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 07:34:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:34:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:34:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:34:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:34:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:34:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:34:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43824302
Sat 18 Jan 2014 07:34:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:34:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43824302
Sat 18 Jan 2014 07:34:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:34:53 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:34:53 - job_xml_thread(): Done retrieving: data size 43824302
Sat 18 Jan 2014 07:34:53 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:34:53 - XML: Start document: iteration 8
Sat 18 Jan 2014 07:34:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:34:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:34:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:34:56 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:34:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:34:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:34:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:34:57 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:34:57 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 07:34:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:34:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:34:57 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:34:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:34:57 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:34:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 07:34:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:34:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:34:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:34:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 07:34:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:34:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:34:59 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:35:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5787 values 91284 bits 11410 bytes 
Sat 18 Jan 2014 07:35:01 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:35:01 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 07:35:01 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 07:35:01 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:35:01 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 07:35:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:35:04 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:35:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:35:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:35:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:35:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:35:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:35:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:35:08 - XML: Processed 655244 elements - found 519 jobs
Sat 18 Jan 2014 07:35:08 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:35:08 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:35:09 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:35:09 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:35:09 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 747188 values 11803102 bits 1475387 bytes 
Sat 18 Jan 2014 07:35:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:35:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43817915
Sat 18 Jan 2014 07:35:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:35:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43817915
Sat 18 Jan 2014 07:35:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:35:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:35:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:35:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:35:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:35:24 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:35:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:35:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:35:26 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:35:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:35:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:35:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:35:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:35:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:35:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:35:28 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:35:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 07:35:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:35:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:35:29 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:35:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:35:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:35:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:35:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:35:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:35:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:35:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:35:32 - job_xml_thread(): Done retrieving: data size 43719465
Sat 18 Jan 2014 07:35:32 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:35:32 - XML: Start document: iteration 9
Sat 18 Jan 2014 07:35:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43719465
Sat 18 Jan 2014 07:35:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:35:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43719465
Sat 18 Jan 2014 07:35:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:35:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:35:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:35:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:35:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:35:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:35:48 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:35:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:35:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:35:50 - XML: Processed 654270 elements - found 518 jobs
Sat 18 Jan 2014 07:35:50 - job 7348582 appears to have finished
Sat 18 Jan 2014 07:35:50 - job 7348612 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 07:35:50 - job 7348613 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 07:35:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:35:50 - job_xml_thread(): Found 3 updated jobs.
Sat 18 Jan 2014 07:35:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:35:50 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 07:35:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:35:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:35:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:35:52 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Sat 18 Jan 2014 07:35:52 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:35:52 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:35:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:35:54 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:35:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:35:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:35:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:35:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:35:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:35:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:35:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:35:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43179175
Sat 18 Jan 2014 07:35:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:35:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43179175
Sat 18 Jan 2014 07:35:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:35:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:35:59 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:36:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:36:00 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:36:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 07:36:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 07:36:00 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:36:01 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:36:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9152 values 144353 bits 18044 bytes 
Sat 18 Jan 2014 07:36:01 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 07:36:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:36:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:36:07 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:36:07 - job_xml_thread(): Done retrieving: data size 43179175
Sat 18 Jan 2014 07:36:07 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:36:07 - XML: Start document: iteration 10
Sat 18 Jan 2014 07:36:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:36:10 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:36:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:36:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:36:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:36:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:36:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:36:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:36:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:36:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:36:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:36:19 - XML: Processed 647208 elements - found 518 jobs
Sat 18 Jan 2014 07:36:19 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:36:19 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:36:19 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:36:19 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:36:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:36:22 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:36:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:36:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:36:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:36:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:36:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:36:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:36:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:36:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:36:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:36:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43219832
Sat 18 Jan 2014 07:36:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:36:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43219832
Sat 18 Jan 2014 07:36:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:36:34 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:36:34 - job_xml_thread(): Done retrieving: data size 43219832
Sat 18 Jan 2014 07:36:34 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:36:34 - XML: Start document: iteration 11
Sat 18 Jan 2014 07:36:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:36:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:36:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:36:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:36:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:36:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:36:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:36:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:36:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:36:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:36:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:36:42 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:36:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 07:36:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:36:44 - XML: Processed 647871 elements - found 518 jobs
Sat 18 Jan 2014 07:36:44 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:36:44 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:36:44 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:36:44 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:36:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:36:48 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:36:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:36:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:36:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:36:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:36:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:36:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:36:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:36:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43729747
Sat 18 Jan 2014 07:36:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:36:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43729747
Sat 18 Jan 2014 07:36:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:36:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:36:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:36:59 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:36:59 - job_xml_thread(): Done retrieving: data size 43729747
Sat 18 Jan 2014 07:36:59 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:36:59 - XML: Start document: iteration 12
Sat 18 Jan 2014 07:37:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:37:00 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:37:01 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:37:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 07:37:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:37:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:37:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:37:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 07:37:01 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:37:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6054 values 95515 bits 11939 bytes 
Sat 18 Jan 2014 07:37:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:37:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:37:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:37:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:37:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:37:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:37:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:37:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:37:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:37:14 - XML: Processed 654364 elements - found 518 jobs
Sat 18 Jan 2014 07:37:14 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:37:15 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:37:15 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:37:15 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:37:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:37:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:37:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:37:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:37:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:37:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:37:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:37:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:37:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:37:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:37:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:37:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43791231
Sat 18 Jan 2014 07:37:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:37:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43791231
Sat 18 Jan 2014 07:37:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:37:30 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:37:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:37:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:37:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:37:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:37:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:37:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:37:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:37:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:37:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:37:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:37:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:37:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:37:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:37:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:37:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:37:36 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:37:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 07:37:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:37:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:37:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:37:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:37:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:37:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:37:39 - job_xml_thread(): Done retrieving: data size 43830457
Sat 18 Jan 2014 07:37:39 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:37:39 - XML: Start document: iteration 13
Sat 18 Jan 2014 07:37:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43830457
Sat 18 Jan 2014 07:37:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:37:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43830457
Sat 18 Jan 2014 07:37:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:37:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:37:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:37:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:37:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:37:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:37:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:37:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:37:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:38:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:38:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:38:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:38:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:38:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:38:01 - XML: Processed 655240 elements - found 517 jobs
Sat 18 Jan 2014 07:38:01 - job 7341505 appears to have finished
Sat 18 Jan 2014 07:38:01 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 07:38:01 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 07:38:01 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 07:38:01 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:38:01 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:38:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:38:01 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:38:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:38:02 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:38:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 07:38:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 07:38:02 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:38:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5922 values 93441 bits 11680 bytes 
Sat 18 Jan 2014 07:38:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:38:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:38:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:38:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:38:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:38:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:38:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:38:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:38:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:38:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43831680
Sat 18 Jan 2014 07:38:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:38:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43831680
Sat 18 Jan 2014 07:38:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:38:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:38:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:38:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:38:16 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:38:16 - job_xml_thread(): Done retrieving: data size 43831680
Sat 18 Jan 2014 07:38:16 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:38:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:38:16 - XML: Start document: iteration 14
Sat 18 Jan 2014 07:38:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:38:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:38:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:38:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:38:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:38:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:38:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:38:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:38:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:38:26 - XML: Processed 655240 elements - found 517 jobs
Sat 18 Jan 2014 07:38:26 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:38:26 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:38:26 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:38:26 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:38:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:38:28 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:38:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:38:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:38:29 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:38:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 07:38:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:38:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:38:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:38:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:38:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:38:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:38:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43791625
Sat 18 Jan 2014 07:38:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:38:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43791625
Sat 18 Jan 2014 07:38:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:38:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:38:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:38:41 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:38:41 - job_xml_thread(): Done retrieving: data size 43791625
Sat 18 Jan 2014 07:38:41 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:38:41 - XML: Start document: iteration 15
Sat 18 Jan 2014 07:38:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:38:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:38:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:38:48 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:38:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:38:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:38:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:38:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:38:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:38:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:38:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:38:53 - XML: Processed 655240 elements - found 517 jobs
Sat 18 Jan 2014 07:38:53 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:38:53 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:38:53 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:38:53 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:38:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:38:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:38:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:38:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:38:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:38:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:38:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:38:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:38:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:38:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43823879
Sat 18 Jan 2014 07:38:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:38:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43823879
Sat 18 Jan 2014 07:38:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:39:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:39:02 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:39:04 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:39:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 07:39:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:39:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 07:39:05 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:39:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:39:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:39:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8495 values 133953 bits 16744 bytes 
Sat 18 Jan 2014 07:39:08 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:39:08 - job_xml_thread(): Done retrieving: data size 43823879
Sat 18 Jan 2014 07:39:08 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:39:08 - XML: Start document: iteration 16
Sat 18 Jan 2014 07:39:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:39:10 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:39:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:39:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:39:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:39:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:39:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:39:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:39:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:39:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:39:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:39:19 - XML: Processed 655237 elements - found 517 jobs
Sat 18 Jan 2014 07:39:19 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:39:19 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:39:19 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:39:19 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:39:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:39:21 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:39:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:39:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:39:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:39:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:39:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:39:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:39:24 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 07:39:24 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 07:39:24 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:39:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:39:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43808287
Sat 18 Jan 2014 07:39:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:39:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43808287
Sat 18 Jan 2014 07:39:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:39:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:39:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:39:35 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:39:35 - job_xml_thread(): Done retrieving: data size 43808287
Sat 18 Jan 2014 07:39:35 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:39:35 - XML: Start document: iteration 17
Sat 18 Jan 2014 07:39:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:39:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:39:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:39:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:39:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:39:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:39:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:39:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:39:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:39:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:39:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:39:46 - XML: Processed 655240 elements - found 517 jobs
Sat 18 Jan 2014 07:39:46 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:39:47 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:39:47 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:39:47 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:39:47 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:39:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 07:39:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:39:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:39:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:39:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:39:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:39:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:39:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:39:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:39:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:39:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:39:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43797986
Sat 18 Jan 2014 07:39:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:39:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43797986
Sat 18 Jan 2014 07:39:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:39:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:39:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:40:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:40:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:40:02 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:40:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:40:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:40:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:40:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:40:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:40:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:40:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:40:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:40:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:40:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:40:04 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:40:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:40:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:40:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:40:04 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:40:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:40:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:40:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:40:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:40:05 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:40:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 07:40:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:40:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 07:40:05 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:40:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5978 values 94282 bits 11785 bytes 
Sat 18 Jan 2014 07:40:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:40:06 - job_xml_thread(): Done retrieving: data size 43843007
Sat 18 Jan 2014 07:40:06 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:40:06 - XML: Start document: iteration 18
Sat 18 Jan 2014 07:40:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43843007
Sat 18 Jan 2014 07:40:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:40:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43843007
Sat 18 Jan 2014 07:40:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:40:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:40:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:40:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:40:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:40:23 - XML: Processed 655240 elements - found 517 jobs
Sat 18 Jan 2014 07:40:23 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:40:23 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:40:23 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:40:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:40:24 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:40:24 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:40:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:40:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:40:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:40:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:40:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:40:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:40:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:40:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:40:27 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:40:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:40:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:40:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:40:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:40:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:40:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:40:28 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:40:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 07:40:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:40:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:40:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43812336
Sat 18 Jan 2014 07:40:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:40:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43812336
Sat 18 Jan 2014 07:40:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:40:39 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:40:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:40:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:40:39 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:40:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:40:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:40:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:40:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:40:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:40:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:40:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:40:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:40:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:40:43 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:40:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:40:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:40:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:40:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:40:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:40:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:40:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:40:45 - job_xml_thread(): Done retrieving: data size 43814627
Sat 18 Jan 2014 07:40:45 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:40:45 - XML: Start document: iteration 19
Sat 18 Jan 2014 07:40:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43814627
Sat 18 Jan 2014 07:40:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:40:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43814627
Sat 18 Jan 2014 07:40:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:40:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:40:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:40:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:40:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:41:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:41:00 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:41:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:41:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:41:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:41:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:41:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:41:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:41:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:41:04 - XML: Processed 655240 elements - found 517 jobs
Sat 18 Jan 2014 07:41:04 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:41:04 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:41:04 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:41:04 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:41:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:41:05 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:41:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:41:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 07:41:06 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:41:06 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:41:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 07:41:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:41:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7509 values 118425 bits 14803 bytes 
Sat 18 Jan 2014 07:41:07 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:41:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:41:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:41:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:41:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:41:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:41:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:41:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:41:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43831985
Sat 18 Jan 2014 07:41:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:41:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43831985
Sat 18 Jan 2014 07:41:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:41:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:41:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:41:19 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:41:19 - job_xml_thread(): Done retrieving: data size 43831985
Sat 18 Jan 2014 07:41:19 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:41:19 - XML: Start document: iteration 20
Sat 18 Jan 2014 07:41:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:41:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:41:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:41:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:41:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:41:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:41:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:41:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:41:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:41:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:41:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:41:28 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:41:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 07:41:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:41:29 - XML: Processed 655240 elements - found 517 jobs
Sat 18 Jan 2014 07:41:29 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:41:29 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:41:29 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:41:29 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:41:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:41:32 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:41:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:41:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:41:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:41:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:41:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:41:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:41:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:41:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43735644
Sat 18 Jan 2014 07:41:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:41:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43735644
Sat 18 Jan 2014 07:41:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:41:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:41:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:41:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:41:42 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:41:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:41:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:41:44 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:41:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:41:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:41:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:41:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:41:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:41:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:41:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:41:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:41:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:41:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:41:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:41:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:41:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:41:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:41:49 - job_xml_thread(): Done retrieving: data size 43210819
Sat 18 Jan 2014 07:41:49 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:41:49 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 07:41:49 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 07:41:49 - Housekeeping: done.
Sat 18 Jan 2014 07:41:49 - XML: Start document: iteration 0
Sat 18 Jan 2014 07:41:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43210819
Sat 18 Jan 2014 07:41:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43210819
Sat 18 Jan 2014 07:41:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:41:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:41:56 - XML: Processed 647616 elements - found 517 jobs
Sat 18 Jan 2014 07:41:56 - job 7348614 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 07:41:56 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 07:41:56 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 07:41:58 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 07:41:58 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:41:58 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:42:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:42:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:42:01 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 07:42:01 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:42:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:42:02 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:42:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:42:03 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 07:42:03 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 07:42:03 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:42:03 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 07:42:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:42:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:42:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:42:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:42:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:42:07 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:42:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:42:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:42:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:42:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 07:42:08 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:42:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9162 values 144522 bits 18065 bytes 
Sat 18 Jan 2014 07:42:08 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:42:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 07:42:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:42:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:42:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:42:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:42:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:42:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:42:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:42:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:42:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:42:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:42:09 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 808260 values 12744819 bits 1593102 bytes 
Sat 18 Jan 2014 07:42:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:42:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:42:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43189541
Sat 18 Jan 2014 07:42:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:42:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43189541
Sat 18 Jan 2014 07:42:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:42:13 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:42:13 - job_xml_thread(): Done retrieving: data size 43189541
Sat 18 Jan 2014 07:42:13 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:42:13 - XML: Start document: iteration 1
Sat 18 Jan 2014 07:42:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:42:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:42:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:42:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:42:26 - XML: Processed 647364 elements - found 517 jobs
Sat 18 Jan 2014 07:42:26 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:42:26 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:42:26 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:42:26 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:42:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:42:30 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:42:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:42:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:42:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:42:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:42:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:42:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:42:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:42:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:42:35 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:42:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:42:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:42:35 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:42:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 07:42:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:42:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:42:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:42:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:42:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:42:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:42:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43440212
Sat 18 Jan 2014 07:42:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:42:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43440212
Sat 18 Jan 2014 07:42:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:42:41 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:42:41 - job_xml_thread(): Done retrieving: data size 43440212
Sat 18 Jan 2014 07:42:42 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:42:43 - XML: Start document: iteration 2
Sat 18 Jan 2014 07:42:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:42:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:42:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:42:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:42:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:42:53 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:42:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:42:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:42:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:42:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:42:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:42:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:42:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:43:02 - XML: Processed 650484 elements - found 517 jobs
Sat 18 Jan 2014 07:43:02 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:43:02 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:43:02 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:43:02 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:43:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:43:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:43:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:43:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:43:03 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:43:03 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 07:43:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:43:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:43:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:43:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:43:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:43:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43808288
Sat 18 Jan 2014 07:43:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:43:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43808288
Sat 18 Jan 2014 07:43:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:43:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:43:09 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:43:09 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:43:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:43:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 07:43:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 07:43:09 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:43:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8749 values 137937 bits 17242 bytes 
Sat 18 Jan 2014 07:43:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:43:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:43:17 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:43:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:43:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:43:18 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:43:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:43:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:43:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:43:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:43:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:43:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:43:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:43:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:43:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:43:23 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:43:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:43:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:43:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:43:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:43:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:43:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:43:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:43:27 - job_xml_thread(): Done retrieving: data size 43814296
Sat 18 Jan 2014 07:43:27 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:43:27 - XML: Start document: iteration 3
Sat 18 Jan 2014 07:43:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43814296
Sat 18 Jan 2014 07:43:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:43:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43814296
Sat 18 Jan 2014 07:43:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:43:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:43:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:43:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:43:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:43:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:43:46 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:43:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:43:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:43:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:43:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:43:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:43:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:43:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:43:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:43:49 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:43:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:43:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:43:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:43:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:43:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:43:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:43:51 - XML: Processed 655238 elements - found 516 jobs
Sat 18 Jan 2014 07:43:51 - job 7348583 appears to have finished
Sat 18 Jan 2014 07:43:51 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 07:43:51 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 07:43:51 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 07:43:51 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:43:51 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:43:51 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:43:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 07:43:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:43:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:43:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43823181
Sat 18 Jan 2014 07:43:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:43:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43823181
Sat 18 Jan 2014 07:43:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:44:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:44:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:44:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:44:02 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:44:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:44:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:44:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:44:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:44:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:44:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:44:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43823181
Sat 18 Jan 2014 07:44:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:44:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:44:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:44:06 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:44:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:44:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:44:09 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:44:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:44:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 07:44:10 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:44:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6090 values 96078 bits 12009 bytes 
Sat 18 Jan 2014 07:44:10 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:44:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 07:44:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:44:11 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:44:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:44:14 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:44:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:44:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:44:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:44:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:44:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:44:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:44:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:44:18 - job_xml_thread(): Done retrieving: data size 43793862
Sat 18 Jan 2014 07:44:18 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:44:18 - XML: Start document: iteration 4
Sat 18 Jan 2014 07:44:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:44:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:44:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43793862
Sat 18 Jan 2014 07:44:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:44:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:44:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:44:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:44:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:44:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43793862
Sat 18 Jan 2014 07:44:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:44:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:44:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:44:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:44:33 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:44:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:44:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:44:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:44:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:44:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:44:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:44:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:44:40 - XML: Processed 655238 elements - found 516 jobs
Sat 18 Jan 2014 07:44:40 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:44:40 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:44:40 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:44:40 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:44:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:44:42 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:44:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:44:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:44:42 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:44:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 07:44:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:44:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:44:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:44:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:44:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:44:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:44:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43802608
Sat 18 Jan 2014 07:44:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:44:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43802608
Sat 18 Jan 2014 07:44:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:44:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:44:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:44:55 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:44:55 - job_xml_thread(): Done retrieving: data size 43802608
Sat 18 Jan 2014 07:44:55 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:44:55 - XML: Start document: iteration 5
Sat 18 Jan 2014 07:44:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:44:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:44:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:44:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:44:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:44:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:44:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:44:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:44:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:44:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:44:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:45:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:45:05 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:45:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:45:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:45:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:45:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:45:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:45:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:45:07 - XML: Processed 655238 elements - found 516 jobs
Sat 18 Jan 2014 07:45:07 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:45:07 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:45:07 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:45:07 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:45:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:45:10 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:45:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:45:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43821025
Sat 18 Jan 2014 07:45:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:45:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43821025
Sat 18 Jan 2014 07:45:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:45:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:45:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 07:45:12 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:45:12 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:45:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 07:45:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7022 values 110776 bits 13847 bytes 
Sat 18 Jan 2014 07:45:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:45:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:45:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:45:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:45:22 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:45:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:45:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:45:24 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:45:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:45:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:45:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:45:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:45:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:45:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:45:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:45:27 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:45:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:45:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:45:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:45:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:45:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:45:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:45:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:45:30 - job_xml_thread(): Done retrieving: data size 43804794
Sat 18 Jan 2014 07:45:30 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:45:30 - XML: Start document: iteration 6
Sat 18 Jan 2014 07:45:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43804794
Sat 18 Jan 2014 07:45:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43804794
Sat 18 Jan 2014 07:45:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:45:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:45:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:45:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:45:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:45:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:45:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:45:48 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:45:48 - XML: Processed 655240 elements - found 517 jobs
Sat 18 Jan 2014 07:45:48 - job 7348623 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 07:45:48 - job 7335210 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 07:45:48 - job_xml_thread(): Found 3 updated jobs.
Sat 18 Jan 2014 07:45:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:45:48 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 07:45:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:45:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:45:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:45:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:45:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:45:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:45:49 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Sat 18 Jan 2014 07:45:49 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:45:49 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:45:50 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:45:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 07:45:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:45:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:45:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:45:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:45:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:45:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:45:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:45:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:45:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:45:52 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 07:45:52 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 07:45:52 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:45:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:45:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43832092
Sat 18 Jan 2014 07:45:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:45:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43832092
Sat 18 Jan 2014 07:45:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:46:04 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:46:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:46:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:46:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:46:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:46:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:46:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:46:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:46:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:46:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:46:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:46:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:46:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:46:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:46:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:46:07 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:46:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:46:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:46:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:46:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:46:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:46:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:46:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:46:09 - job_xml_thread(): Done retrieving: data size 43837468
Sat 18 Jan 2014 07:46:09 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:46:09 - XML: Start document: iteration 7
Sat 18 Jan 2014 07:46:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43837468
Sat 18 Jan 2014 07:46:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:46:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43837468
Sat 18 Jan 2014 07:46:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:46:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:46:13 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:46:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:46:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 07:46:16 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:46:16 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:46:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8876 values 139982 bits 17497 bytes 
Sat 18 Jan 2014 07:46:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 07:46:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:46:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:46:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:46:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:46:28 - XML: Processed 655240 elements - found 517 jobs
Sat 18 Jan 2014 07:46:29 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:46:29 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:46:29 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:46:29 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:46:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:46:30 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:46:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:46:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:46:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:46:30 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:46:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:46:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:46:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:46:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:46:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:46:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:46:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:46:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:46:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:46:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:46:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:46:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:46:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43842052
Sat 18 Jan 2014 07:46:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:46:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43842052
Sat 18 Jan 2014 07:46:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:46:44 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:46:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:46:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:46:45 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:46:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:46:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:46:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:46:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:46:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:46:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:46:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:46:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:46:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:46:48 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:46:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:46:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:46:48 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:46:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 07:46:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:46:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:46:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:46:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:46:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:46:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:46:50 - job_xml_thread(): Done retrieving: data size 43836569
Sat 18 Jan 2014 07:46:50 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:46:50 - XML: Start document: iteration 8
Sat 18 Jan 2014 07:46:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43836569
Sat 18 Jan 2014 07:46:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:46:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43836569
Sat 18 Jan 2014 07:46:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:47:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:47:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:47:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:47:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:47:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:47:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:47:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:47:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:47:07 - XML: Processed 655240 elements - found 517 jobs
Sat 18 Jan 2014 07:47:08 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:47:08 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:47:08 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:47:08 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:47:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:47:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:47:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:47:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:47:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:47:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:47:12 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:47:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:47:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:47:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:47:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:47:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:47:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:47:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:47:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43748928
Sat 18 Jan 2014 07:47:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:47:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43748928
Sat 18 Jan 2014 07:47:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:47:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:47:17 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:47:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:47:17 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:47:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 07:47:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 07:47:18 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:47:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9191 values 145549 bits 18193 bytes 
Sat 18 Jan 2014 07:47:23 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:47:23 - job_xml_thread(): Done retrieving: data size 43748928
Sat 18 Jan 2014 07:47:23 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:47:23 - XML: Start document: iteration 9
Sat 18 Jan 2014 07:47:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:47:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:47:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:47:24 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:47:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:47:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:47:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:47:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:47:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:47:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:47:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:47:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:47:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:47:31 - XML: Processed 654483 elements - found 514 jobs
Sat 18 Jan 2014 07:47:31 - job 7348627 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 07:47:31 - job 7345994 appears to have finished
Sat 18 Jan 2014 07:47:31 - job 7335194 appears to have finished
Sat 18 Jan 2014 07:47:31 - job 7348584 appears to have finished
Sat 18 Jan 2014 07:47:31 - job_xml_thread(): Found 4 updated jobs.
Sat 18 Jan 2014 07:47:31 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 07:47:32 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Sat 18 Jan 2014 07:47:32 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:47:32 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:47:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:47:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:47:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:47:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:47:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:47:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:47:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:47:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:47:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:47:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43412350
Sat 18 Jan 2014 07:47:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:47:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43412350
Sat 18 Jan 2014 07:47:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:47:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:47:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:47:47 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:47:47 - job_xml_thread(): Done retrieving: data size 43412350
Sat 18 Jan 2014 07:47:48 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:47:48 - XML: Start document: iteration 10
Sat 18 Jan 2014 07:47:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:47:48 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:47:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:47:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:47:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:47:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:47:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:47:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:47:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:47:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:47:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:47:59 - XML: Processed 650392 elements - found 514 jobs
Sat 18 Jan 2014 07:47:59 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:47:59 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:47:59 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:47:59 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:48:00 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:48:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 07:48:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:48:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:48:02 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:48:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:48:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:48:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:48:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:48:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:48:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:48:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:48:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43139531
Sat 18 Jan 2014 07:48:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:48:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43139531
Sat 18 Jan 2014 07:48:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:48:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:48:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:48:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:48:13 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:48:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:48:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:48:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:48:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:48:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:48:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:48:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:48:15 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:48:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:48:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:48:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:48:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:48:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:48:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:48:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:48:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:48:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:48:17 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:48:17 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:48:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:48:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 07:48:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 07:48:17 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:48:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5860 values 92676 bits 11584 bytes 
Sat 18 Jan 2014 07:48:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:48:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43235441
Sat 18 Jan 2014 07:48:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:48:20 - job_xml_thread(): Done retrieving: data size 43235441
Sat 18 Jan 2014 07:48:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43235441
Sat 18 Jan 2014 07:48:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:48:20 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:48:20 - XML: Start document: iteration 11
Sat 18 Jan 2014 07:48:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:48:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:48:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:48:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:48:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:48:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:48:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:48:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:48:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:48:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:48:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:48:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:48:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:48:37 - XML: Processed 647782 elements - found 514 jobs
Sat 18 Jan 2014 07:48:37 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:48:37 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:48:37 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:48:38 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:48:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:48:42 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:48:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:48:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:48:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:48:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:48:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:48:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:48:42 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:48:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 07:48:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:48:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:48:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43717059
Sat 18 Jan 2014 07:48:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:48:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43717059
Sat 18 Jan 2014 07:48:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:48:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:48:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:48:53 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:48:53 - job_xml_thread(): Done retrieving: data size 43717059
Sat 18 Jan 2014 07:48:53 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:48:53 - XML: Start document: iteration 12
Sat 18 Jan 2014 07:48:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:48:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:48:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:48:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:48:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:48:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:48:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:48:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:48:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:48:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:48:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:49:02 - XML: Processed 654126 elements - found 514 jobs
Sat 18 Jan 2014 07:49:02 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:49:02 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:49:02 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:49:02 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:49:03 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 07:49:03 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:49:04 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:49:04 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:49:04 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 07:49:04 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 07:49:04 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 07:49:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:49:05 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:49:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:49:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:49:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:49:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:49:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:49:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:49:06 - size of cluster 'LISA Cluster': 624 hosts 79487 metrics 873978 values 13804105 bits 1725513 bytes 
Sat 18 Jan 2014 07:49:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:49:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43805171
Sat 18 Jan 2014 07:49:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:49:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43805171
Sat 18 Jan 2014 07:49:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:49:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:49:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:49:17 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:49:17 - job_xml_thread(): Done retrieving: data size 43805171
Sat 18 Jan 2014 07:49:17 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:49:17 - XML: Start document: iteration 13
Sat 18 Jan 2014 07:49:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:49:18 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:49:20 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:49:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:49:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 07:49:20 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:49:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 07:49:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:49:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:49:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8457 values 133375 bits 16671 bytes 
Sat 18 Jan 2014 07:49:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:49:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:49:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:49:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:49:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:49:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:49:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:49:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:49:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:49:29 - XML: Processed 655230 elements - found 512 jobs
Sat 18 Jan 2014 07:49:30 - job 7348064 appears to have finished
Sat 18 Jan 2014 07:49:30 - job 7348585 appears to have finished
Sat 18 Jan 2014 07:49:30 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 07:49:30 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 07:49:30 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 07:49:30 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:49:30 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:49:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:49:33 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:49:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:49:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:49:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:49:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:49:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:49:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:49:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:49:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43790803
Sat 18 Jan 2014 07:49:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:49:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43790803
Sat 18 Jan 2014 07:49:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:49:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:49:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:49:45 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:49:45 - job_xml_thread(): Done retrieving: data size 43790803
Sat 18 Jan 2014 07:49:45 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:49:45 - XML: Start document: iteration 14
Sat 18 Jan 2014 07:49:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:49:48 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:49:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:49:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:49:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:49:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:49:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:49:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:49:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:49:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:49:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:49:53 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:49:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 07:49:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:49:57 - XML: Processed 655230 elements - found 512 jobs
Sat 18 Jan 2014 07:49:57 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:49:57 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:49:57 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:49:57 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:50:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:50:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:50:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:50:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:50:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:50:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:50:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:50:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:50:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:50:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43786307
Sat 18 Jan 2014 07:50:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:50:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43786307
Sat 18 Jan 2014 07:50:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:50:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:50:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:50:05 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:50:05 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 07:50:13 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:50:13 - job_xml_thread(): Done retrieving: data size 43786307
Sat 18 Jan 2014 07:50:13 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:50:13 - XML: Start document: iteration 15
Sat 18 Jan 2014 07:50:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:50:13 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:50:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:50:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:50:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:50:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:50:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:50:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:50:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:50:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:50:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:50:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:50:20 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:50:20 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:50:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 07:50:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:50:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 07:50:20 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:50:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5974 values 94212 bits 11776 bytes 
Sat 18 Jan 2014 07:50:25 - XML: Processed 655230 elements - found 512 jobs
Sat 18 Jan 2014 07:50:25 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:50:25 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:50:25 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:50:25 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:50:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:50:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:50:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:50:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:50:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:50:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:50:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:50:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:50:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:50:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43803584
Sat 18 Jan 2014 07:50:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:50:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43803584
Sat 18 Jan 2014 07:50:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:50:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:50:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:50:40 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:50:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:50:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:50:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:50:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:50:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:50:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:50:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:50:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:50:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:50:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:50:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:50:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:50:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:50:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:50:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:50:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:50:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:50:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:50:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:50:46 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:50:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 07:50:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:50:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:50:49 - job_xml_thread(): Done retrieving: data size 43814613
Sat 18 Jan 2014 07:50:49 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:50:49 - XML: Start document: iteration 16
Sat 18 Jan 2014 07:50:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43814613
Sat 18 Jan 2014 07:50:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:50:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43814613
Sat 18 Jan 2014 07:50:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:50:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:50:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:51:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:51:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:51:08 - XML: Processed 655230 elements - found 512 jobs
Sat 18 Jan 2014 07:51:08 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:51:08 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:51:08 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:51:08 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:51:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:51:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:51:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:51:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:51:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:51:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:51:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:51:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:51:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:51:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:51:11 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:51:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:51:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:51:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:51:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:51:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:51:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:51:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:51:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43822710
Sat 18 Jan 2014 07:51:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:51:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43822710
Sat 18 Jan 2014 07:51:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:51:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:51:21 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:51:21 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:51:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 07:51:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:51:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 07:51:21 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:51:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8731 values 137684 bits 17210 bytes 
Sat 18 Jan 2014 07:51:24 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:51:24 - job_xml_thread(): Done retrieving: data size 43822710
Sat 18 Jan 2014 07:51:24 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:51:24 - XML: Start document: iteration 17
Sat 18 Jan 2014 07:51:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:51:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:51:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:51:27 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:51:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:51:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:51:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:51:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:51:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:51:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:51:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:51:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:51:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:51:36 - XML: Processed 655228 elements - found 511 jobs
Sat 18 Jan 2014 07:51:36 - job 7348673 appears to have finished
Sat 18 Jan 2014 07:51:36 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 07:51:36 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 07:51:36 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 07:51:36 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:51:36 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:51:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:51:38 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:51:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:51:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:51:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:51:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:51:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:51:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:51:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:51:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43805377
Sat 18 Jan 2014 07:51:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:51:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:51:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43805377
Sat 18 Jan 2014 07:51:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:51:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:51:51 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:51:51 - job_xml_thread(): Done retrieving: data size 43805377
Sat 18 Jan 2014 07:51:51 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:51:51 - XML: Start document: iteration 18
Sat 18 Jan 2014 07:51:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:51:52 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:51:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:51:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:51:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:51:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:51:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:51:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:51:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:51:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:51:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:52:02 - XML: Processed 655228 elements - found 511 jobs
Sat 18 Jan 2014 07:52:02 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:52:02 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:52:02 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:52:02 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:52:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:52:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:52:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:52:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:52:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:52:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:52:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:52:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:52:04 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:52:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 07:52:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:52:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:52:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43798454
Sat 18 Jan 2014 07:52:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:52:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:52:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:52:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43798454
Sat 18 Jan 2014 07:52:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:52:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:52:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:52:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:52:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:52:18 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:52:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:52:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:52:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:52:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:52:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:52:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:52:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:52:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:52:21 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:52:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:52:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:52:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:52:22 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:52:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:52:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:52:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:52:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:52:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:52:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 07:52:22 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:52:22 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:52:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 07:52:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5697 values 89825 bits 11228 bytes 
Sat 18 Jan 2014 07:52:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:52:26 - job_xml_thread(): Done retrieving: data size 43829619
Sat 18 Jan 2014 07:52:26 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:52:26 - XML: Start document: iteration 19
Sat 18 Jan 2014 07:52:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43829619
Sat 18 Jan 2014 07:52:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:52:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43829619
Sat 18 Jan 2014 07:52:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:52:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:52:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:52:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:52:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:52:40 - XML: Processed 655228 elements - found 511 jobs
Sat 18 Jan 2014 07:52:40 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:52:40 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:52:40 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:52:40 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:52:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:52:46 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:52:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:52:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:52:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:52:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:52:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:52:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:52:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:52:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:52:50 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:52:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:52:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:52:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:52:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:52:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:52:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:52:51 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:52:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 07:52:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:52:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:52:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43833835
Sat 18 Jan 2014 07:52:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:52:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43833835
Sat 18 Jan 2014 07:52:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:52:55 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:52:55 - job_xml_thread(): Done retrieving: data size 43833835
Sat 18 Jan 2014 07:52:55 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:52:55 - XML: Start document: iteration 20
Sat 18 Jan 2014 07:53:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:53:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:53:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:53:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:53:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:53:07 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:53:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:53:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:53:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:53:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:53:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:53:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:53:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:53:13 - XML: Processed 655228 elements - found 511 jobs
Sat 18 Jan 2014 07:53:13 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:53:13 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:53:13 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:53:13 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:53:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:53:16 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:53:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:53:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:53:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:53:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:53:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:53:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:53:17 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 07:53:17 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 07:53:17 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:53:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:53:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43739659
Sat 18 Jan 2014 07:53:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:53:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43739659
Sat 18 Jan 2014 07:53:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:53:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:53:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:53:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:53:23 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:53:25 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:53:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 07:53:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:53:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 07:53:26 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:53:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7991 values 126017 bits 15752 bytes 
Sat 18 Jan 2014 07:53:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:53:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:53:29 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:53:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:53:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:53:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:53:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:53:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:53:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:53:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:53:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:53:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:53:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:53:33 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:53:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:53:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:53:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:53:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:53:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:53:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:53:35 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:53:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 07:53:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:53:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:53:36 - job_xml_thread(): Done retrieving: data size 43332892
Sat 18 Jan 2014 07:53:36 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:53:36 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 07:53:36 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 07:53:36 - Housekeeping: done.
Sat 18 Jan 2014 07:53:36 - XML: Start document: iteration 0
Sat 18 Jan 2014 07:53:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43332892
Sat 18 Jan 2014 07:53:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:53:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43332892
Sat 18 Jan 2014 07:53:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:53:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:53:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:53:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:53:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:53:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:53:51 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:53:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:53:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:53:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:53:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:53:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:53:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:53:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:53:55 - XML: Processed 649104 elements - found 510 jobs
Sat 18 Jan 2014 07:53:55 - job 7348628 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 07:53:55 - job 7341506 appears to have finished
Sat 18 Jan 2014 07:53:55 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 07:53:55 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 07:53:55 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 07:53:55 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:53:55 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:53:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:53:58 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:53:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:53:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:53:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:53:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:53:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:53:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:54:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:54:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43150788
Sat 18 Jan 2014 07:54:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:54:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43150788
Sat 18 Jan 2014 07:54:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:54:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:54:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:54:07 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:54:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:54:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:54:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:54:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:54:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:54:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43150788
Sat 18 Jan 2014 07:54:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:54:10 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:54:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:54:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:54:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:54:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:54:19 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:54:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:54:20 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:54:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:54:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:54:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:54:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:54:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:54:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:54:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:54:21 - job_xml_thread(): Done retrieving: data size 43222488
Sat 18 Jan 2014 07:54:21 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:54:21 - XML: Start document: iteration 1
Sat 18 Jan 2014 07:54:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43222488
Sat 18 Jan 2014 07:54:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:54:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:54:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:54:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:54:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:54:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:54:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43222488
Sat 18 Jan 2014 07:54:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:54:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:54:25 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:54:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:54:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:54:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 07:54:26 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:54:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99064 bits 12383 bytes 
Sat 18 Jan 2014 07:54:26 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:54:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 07:54:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:54:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:54:41 - XML: Processed 647778 elements - found 510 jobs
Sat 18 Jan 2014 07:54:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:54:41 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:54:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:54:41 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:54:41 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:54:41 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:54:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:54:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:54:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:54:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:54:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:54:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:54:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:54:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:54:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:54:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:54:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:54:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:54:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:54:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:54:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:54:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:54:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:54:47 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:54:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 07:54:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:54:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:54:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43744405
Sat 18 Jan 2014 07:54:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:54:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43744405
Sat 18 Jan 2014 07:54:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:54:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:54:56 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:54:56 - job_xml_thread(): Done retrieving: data size 43744405
Sat 18 Jan 2014 07:54:56 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:54:56 - XML: Start document: iteration 2
Sat 18 Jan 2014 07:54:56 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:54:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:54:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:54:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:54:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:54:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:54:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:54:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:55:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:55:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:55:09 - XML: Processed 654178 elements - found 510 jobs
Sat 18 Jan 2014 07:55:10 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:55:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:55:10 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:55:10 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:55:10 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:55:10 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:55:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:55:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:55:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:55:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:55:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:55:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:55:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:55:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43777898
Sat 18 Jan 2014 07:55:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:55:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43777898
Sat 18 Jan 2014 07:55:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:55:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:55:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:55:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:55:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:55:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:55:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:55:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:55:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:55:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:55:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:55:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:55:25 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:55:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:55:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:55:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:55:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:55:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:55:26 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:55:26 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:55:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 07:55:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:55:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 07:55:26 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:55:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6287 values 99172 bits 12396 bytes 
Sat 18 Jan 2014 07:55:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:55:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:55:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:55:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:55:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:55:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43800587
Sat 18 Jan 2014 07:55:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:55:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43800587
Sat 18 Jan 2014 07:55:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:55:29 - job_xml_thread(): Done retrieving: data size 43800587
Sat 18 Jan 2014 07:55:29 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:55:29 - XML: Start document: iteration 3
Sat 18 Jan 2014 07:55:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:55:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:55:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:55:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:55:46 - XML: Processed 655220 elements - found 507 jobs
Sat 18 Jan 2014 07:55:46 - job 7336913 appears to have finished
Sat 18 Jan 2014 07:55:46 - job 7336910 appears to have finished
Sat 18 Jan 2014 07:55:46 - job 7336911 appears to have finished
Sat 18 Jan 2014 07:55:46 - job_xml_thread(): Found 3 updated jobs.
Sat 18 Jan 2014 07:55:46 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 07:55:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:55:47 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:55:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:55:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:55:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:55:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:55:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:55:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:55:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:55:48 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Sat 18 Jan 2014 07:55:48 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:55:48 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:55:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:55:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:55:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:55:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:55:51 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:55:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 07:55:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:55:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:55:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:55:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:55:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:55:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:55:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43827022
Sat 18 Jan 2014 07:55:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:55:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43827022
Sat 18 Jan 2014 07:55:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:56:03 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:56:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:56:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:56:03 - job_xml_thread(): Done retrieving: data size 43827022
Sat 18 Jan 2014 07:56:03 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:56:03 - XML: Start document: iteration 4
Sat 18 Jan 2014 07:56:05 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 07:56:05 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:56:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:56:06 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:56:06 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 07:56:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:56:06 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 07:56:06 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:56:06 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 07:56:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:56:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:56:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:56:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:56:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:56:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:56:08 - XMLGatherer.retrieveData(): actually retrieving data..
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sat 18 Jan 2014 07:56:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:56:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:56:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:56:13 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:56:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:56:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:56:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:56:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:56:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:56:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:56:15 - XML: Processed 655220 elements - found 507 jobs
Sat 18 Jan 2014 07:56:16 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:56:16 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:56:16 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:56:16 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:56:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:56:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43811811
Sat 18 Jan 2014 07:56:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:56:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43811811
Sat 18 Jan 2014 07:56:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:56:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:56:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:56:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:56:26 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:56:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:56:26 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:56:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:56:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:56:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:56:27 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:56:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 07:56:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 07:56:27 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:56:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8800 values 138692 bits 17336 bytes 
Sat 18 Jan 2014 07:56:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:56:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:56:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:56:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:56:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:56:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:56:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:56:31 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:56:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:56:32 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:56:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:56:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:56:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:56:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:56:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:56:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:56:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:56:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43826188
Sat 18 Jan 2014 07:56:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:56:35 - job_xml_thread(): Done retrieving: data size 43826188
Sat 18 Jan 2014 07:56:35 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:56:35 - XML: Start document: iteration 5
Sat 18 Jan 2014 07:56:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43826188
Sat 18 Jan 2014 07:56:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:56:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:56:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:56:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:56:47 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:56:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:56:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:56:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:56:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:56:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:56:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:56:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:56:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:56:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:56:56 - XML: Processed 655220 elements - found 507 jobs
Sat 18 Jan 2014 07:56:56 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:56:56 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:56:56 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:56:56 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:56:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:56:57 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:56:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:56:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:56:57 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:56:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 07:56:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:56:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:56:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:56:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:56:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:56:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:56:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43794917
Sat 18 Jan 2014 07:56:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:57:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43794917
Sat 18 Jan 2014 07:57:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:57:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:57:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:57:06 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:57:06 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:57:08 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:57:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:57:08 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:57:08 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 07:57:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:57:08 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 07:57:08 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 07:57:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:57:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:57:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:57:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:57:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:57:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:57:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:57:11 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:57:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:57:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:57:13 - size of cluster 'LISA Cluster': 624 hosts 79482 metrics 883779 values 13937121 bits 1742140 bytes 
Sat 18 Jan 2014 07:57:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:57:14 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:57:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:57:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:57:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:57:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:57:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:57:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:57:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:57:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43816477
Sat 18 Jan 2014 07:57:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:57:18 - job_xml_thread(): Done retrieving: data size 43816477
Sat 18 Jan 2014 07:57:18 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:57:18 - XML: Start document: iteration 6
Sat 18 Jan 2014 07:57:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43816477
Sat 18 Jan 2014 07:57:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:57:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:57:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:57:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:57:28 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:57:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:57:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 07:57:28 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:57:28 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:57:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 07:57:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8877 values 139969 bits 17496 bytes 
Sat 18 Jan 2014 07:57:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:57:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:57:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:57:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:57:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:57:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:57:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:57:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:57:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:57:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:57:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:57:36 - XML: Processed 655218 elements - found 506 jobs
Sat 18 Jan 2014 07:57:36 - job 7348629 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 07:57:36 - job 7348254 appears to have finished
Sat 18 Jan 2014 07:57:36 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 07:57:36 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 07:57:37 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 07:57:37 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:57:37 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:57:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:57:41 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:57:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:57:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:57:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:57:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:57:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:57:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:57:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:57:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43808859
Sat 18 Jan 2014 07:57:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:57:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43808859
Sat 18 Jan 2014 07:57:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:57:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:57:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:57:52 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:57:52 - job_xml_thread(): Done retrieving: data size 43808859
Sat 18 Jan 2014 07:57:52 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:57:52 - XML: Start document: iteration 7
Sat 18 Jan 2014 07:57:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:57:56 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:57:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:57:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:57:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:57:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:57:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:57:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:57:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:57:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:57:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:58:04 - XML: Processed 655218 elements - found 506 jobs
Sat 18 Jan 2014 07:58:04 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:58:04 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:58:04 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:58:04 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:58:06 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:58:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 07:58:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:58:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:58:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:58:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:58:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:58:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:58:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:58:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:58:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:58:08 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:58:08 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 07:58:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:58:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43791463
Sat 18 Jan 2014 07:58:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:58:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43791463
Sat 18 Jan 2014 07:58:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:58:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:58:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:58:19 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:58:19 - job_xml_thread(): Done retrieving: data size 43791463
Sat 18 Jan 2014 07:58:19 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:58:19 - XML: Start document: iteration 8
Sat 18 Jan 2014 07:58:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:58:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:58:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:58:24 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:58:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:58:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:58:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:58:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:58:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:58:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:58:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:58:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:58:29 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:58:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:58:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 07:58:30 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:58:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 07:58:30 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:58:30 - XML: Processed 655218 elements - found 506 jobs
Sat 18 Jan 2014 07:58:30 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:58:30 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:58:30 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:58:30 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:58:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5699 values 89823 bits 11227 bytes 
Sat 18 Jan 2014 07:58:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:58:34 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:58:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:58:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:58:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:58:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:58:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:58:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:58:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:58:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43813849
Sat 18 Jan 2014 07:58:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:58:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43813849
Sat 18 Jan 2014 07:58:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:58:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:58:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:58:45 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:58:45 - job_xml_thread(): Done retrieving: data size 43813849
Sat 18 Jan 2014 07:58:45 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:58:45 - XML: Start document: iteration 9
Sat 18 Jan 2014 07:58:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:58:49 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:58:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:58:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:58:49 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:58:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 07:58:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:58:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:58:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:58:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:58:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:58:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:58:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:58:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:59:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:59:01 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:59:01 - XML: Processed 655215 elements - found 506 jobs
Sat 18 Jan 2014 07:59:01 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 07:59:01 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 07:59:01 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:59:01 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:59:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:59:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:59:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:59:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:59:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:59:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:59:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:59:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43807229
Sat 18 Jan 2014 07:59:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:59:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43807229
Sat 18 Jan 2014 07:59:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:59:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:59:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:59:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:59:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:59:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:59:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:59:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:59:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:59:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:59:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:59:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:59:16 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:59:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:59:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:59:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:59:21 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:59:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:59:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:59:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:59:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:59:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:59:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:59:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:59:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43724563
Sat 18 Jan 2014 07:59:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:59:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43724563
Sat 18 Jan 2014 07:59:25 - job_xml_thread(): Done retrieving: data size 43724563
Sat 18 Jan 2014 07:59:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:59:25 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:59:25 - XML: Start document: iteration 10
Sat 18 Jan 2014 07:59:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:59:30 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:59:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:59:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:59:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:59:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 07:59:33 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 07:59:33 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:59:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 07:59:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9277 values 146286 bits 18285 bytes 
Sat 18 Jan 2014 07:59:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 07:59:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 07:59:40 - XML: Processed 654470 elements - found 506 jobs
Sat 18 Jan 2014 07:59:40 - job 7348631 report time 1390028197 does not match current heartbeat 1390028317 : ignoring job
Sat 18 Jan 2014 07:59:40 - job 7343935 appears to have finished
Sat 18 Jan 2014 07:59:40 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 07:59:40 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 07:59:41 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 07:59:41 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 07:59:41 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 07:59:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 07:59:42 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 07:59:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 07:59:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 07:59:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:59:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 07:59:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 07:59:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 07:59:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 07:59:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 07:59:49 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 07:59:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 07:59:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:59:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:59:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 07:59:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 07:59:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 07:59:51 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 07:59:51 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 07:59:51 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 07:59:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 07:59:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43189395
Sat 18 Jan 2014 07:59:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 07:59:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43189395
Sat 18 Jan 2014 07:59:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 07:59:56 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 07:59:56 - job_xml_thread(): Done retrieving: data size 43189395
Sat 18 Jan 2014 07:59:56 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 07:59:56 - XML: Start document: iteration 11
Sat 18 Jan 2014 07:59:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 07:59:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:00:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:00:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:00:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:00:07 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:00:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:00:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:00:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:00:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:00:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:00:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:00:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:00:13 - XML: Processed 647570 elements - found 506 jobs
Sat 18 Jan 2014 08:00:13 - job 7348631 report time 1390028197 does not match current heartbeat 1390028317 : ignoring job
Sat 18 Jan 2014 08:00:13 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:00:13 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:00:13 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:00:13 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:00:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:00:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:00:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:00:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:00:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:00:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:00:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:00:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:00:15 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:00:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 08:00:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:00:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:00:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43216643
Sat 18 Jan 2014 08:00:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:00:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43216643
Sat 18 Jan 2014 08:00:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:00:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:00:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:00:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:00:26 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:00:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:00:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:00:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:00:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:00:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:00:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:00:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:00:28 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:00:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:00:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:00:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:00:30 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:00:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:00:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:00:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:00:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:00:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:00:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:00:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:00:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43232177
Sat 18 Jan 2014 08:00:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:00:33 - job_xml_thread(): Done retrieving: data size 43232177
Sat 18 Jan 2014 08:00:33 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:00:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:00:33 - XML: Start document: iteration 12
Sat 18 Jan 2014 08:00:33 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:00:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43232177
Sat 18 Jan 2014 08:00:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:00:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:00:37 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:00:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 08:00:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 08:00:37 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:00:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8712 values 137478 bits 17184 bytes 
Sat 18 Jan 2014 08:00:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:00:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:00:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:00:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:00:48 - XML: Processed 647766 elements - found 506 jobs
Sat 18 Jan 2014 08:00:48 - job 7348631 report time 1390028197 does not match current heartbeat 1390028317 : ignoring job
Sat 18 Jan 2014 08:00:48 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:00:48 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:00:48 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:00:48 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:00:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:00:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:00:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:00:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:00:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:00:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:00:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:00:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:00:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:00:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:00:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:00:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:00:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:00:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:00:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:00:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:00:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:00:57 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:00:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 08:00:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:00:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:00:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43806555
Sat 18 Jan 2014 08:00:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:00:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43806555
Sat 18 Jan 2014 08:00:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:01:03 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:01:03 - job_xml_thread(): Done retrieving: data size 43806555
Sat 18 Jan 2014 08:01:03 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:01:04 - XML: Start document: iteration 13
Sat 18 Jan 2014 08:01:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:01:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:01:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:01:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:01:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:01:14 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:01:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:01:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:01:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:01:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:01:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:01:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:01:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:01:19 - XML: Processed 655044 elements - found 506 jobs
Sat 18 Jan 2014 08:01:19 - job 7348631 report time 1390028197 does not match current heartbeat 1390028317 : ignoring job
Sat 18 Jan 2014 08:01:19 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:01:19 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:01:19 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:01:19 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:01:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:01:20 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:01:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:01:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:01:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:01:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:01:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:01:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:01:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:01:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43822816
Sat 18 Jan 2014 08:01:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:01:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43822816
Sat 18 Jan 2014 08:01:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:01:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:01:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:01:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:01:32 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:01:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:01:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:01:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:01:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:01:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:01:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:01:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:01:34 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:01:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:01:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:01:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:01:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:01:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:01:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:01:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:01:37 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:01:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:01:37 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:01:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:01:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:01:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 08:01:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:01:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:01:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 08:01:37 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:01:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99259 bits 12407 bytes 
Sat 18 Jan 2014 08:01:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:01:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43818271
Sat 18 Jan 2014 08:01:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:01:39 - job_xml_thread(): Done retrieving: data size 43818271
Sat 18 Jan 2014 08:01:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43818271
Sat 18 Jan 2014 08:01:39 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:01:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:01:39 - XML: Start document: iteration 14
Sat 18 Jan 2014 08:01:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:01:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:01:48 - XML: Processed 655212 elements - found 504 jobs
Sat 18 Jan 2014 08:01:48 - job 7340349 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 08:01:48 - job 7348586 appears to have finished
Sat 18 Jan 2014 08:01:48 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 08:01:48 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 08:01:50 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 08:01:50 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:01:50 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:01:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:01:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:01:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:01:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:02:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:02:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:02:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:02:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:02:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:02:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:02:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:02:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:02:02 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:02:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:02:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:02:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:02:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:02:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:02:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:02:03 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:02:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 08:02:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:02:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:02:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43839702
Sat 18 Jan 2014 08:02:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:02:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43839702
Sat 18 Jan 2014 08:02:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:02:06 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:02:06 - job_xml_thread(): Done retrieving: data size 43839702
Sat 18 Jan 2014 08:02:07 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:02:07 - XML: Start document: iteration 15
Sat 18 Jan 2014 08:02:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:02:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:02:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:02:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:02:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:02:20 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:02:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:02:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:02:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:02:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:02:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:02:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:02:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:02:24 - XML: Processed 655214 elements - found 504 jobs
Sat 18 Jan 2014 08:02:24 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:02:24 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:02:24 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:02:24 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:02:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:02:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:02:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:02:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:02:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:02:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:02:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:02:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:02:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:02:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43807108
Sat 18 Jan 2014 08:02:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:02:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43807108
Sat 18 Jan 2014 08:02:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:02:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:02:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:02:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:02:37 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:02:38 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:02:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 08:02:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:02:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 08:02:39 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:02:39 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:02:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:02:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7877 values 124557 bits 15569 bytes 
Sat 18 Jan 2014 08:02:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:02:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:02:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:02:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:02:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:02:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:02:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:02:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:02:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:02:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:02:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:02:42 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:02:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:02:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:02:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:02:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:02:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:02:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:02:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:02:45 - job_xml_thread(): Done retrieving: data size 43822684
Sat 18 Jan 2014 08:02:45 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:02:45 - XML: Start document: iteration 16
Sat 18 Jan 2014 08:02:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43822684
Sat 18 Jan 2014 08:02:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:02:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43822684
Sat 18 Jan 2014 08:02:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:02:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:02:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:02:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:02:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:03:07 - XML: Processed 655214 elements - found 504 jobs
Sat 18 Jan 2014 08:03:07 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:03:07 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:03:08 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:03:08 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:03:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:03:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:03:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:03:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:03:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:03:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:03:09 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:03:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 08:03:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:03:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:03:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:03:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:03:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:03:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:03:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:03:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:03:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:03:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:03:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:03:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:03:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:03:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43824862
Sat 18 Jan 2014 08:03:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:03:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43824862
Sat 18 Jan 2014 08:03:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:03:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:03:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:03:23 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:03:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:03:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:03:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:03:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:03:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:03:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:03:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:03:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:03:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:03:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:03:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:03:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:03:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:03:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:03:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:03:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:03:27 - job_xml_thread(): Done retrieving: data size 43814100
Sat 18 Jan 2014 08:03:27 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:03:27 - XML: Start document: iteration 17
Sat 18 Jan 2014 08:03:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43814100
Sat 18 Jan 2014 08:03:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:03:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43814100
Sat 18 Jan 2014 08:03:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:03:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:03:38 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:03:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:03:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 08:03:39 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:03:39 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:03:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 08:03:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9215 values 145744 bits 18218 bytes 
Sat 18 Jan 2014 08:03:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:03:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:03:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:03:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:03:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:03:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:03:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:03:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:03:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:03:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:03:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:03:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:03:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:03:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:03:48 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:03:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:03:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:03:49 - XML: Processed 655214 elements - found 504 jobs
Sat 18 Jan 2014 08:03:49 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:03:49 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:03:49 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:03:49 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:03:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:03:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:03:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:03:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:03:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:03:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43818956
Sat 18 Jan 2014 08:03:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:03:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43818956
Sat 18 Jan 2014 08:03:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:04:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:04:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:04:05 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:04:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:04:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:04:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:04:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:04:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:04:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:04:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:04:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:04:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:04:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:04:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:04:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:04:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:04:08 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:04:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 08:04:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:04:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:04:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:04:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:04:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:04:09 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 08:04:09 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:04:09 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:04:09 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 08:04:09 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:04:09 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 08:04:09 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 08:04:10 - size of cluster 'LISA Cluster': 624 hosts 79474 metrics 855665 values 13514971 bits 1689371 bytes 
Sat 18 Jan 2014 08:04:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:04:11 - job_xml_thread(): Done retrieving: data size 43810733
Sat 18 Jan 2014 08:04:11 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:04:11 - XML: Start document: iteration 18
Sat 18 Jan 2014 08:04:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43810733
Sat 18 Jan 2014 08:04:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:04:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43810733
Sat 18 Jan 2014 08:04:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:04:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:04:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:04:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:04:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:04:27 - XML: Processed 655214 elements - found 504 jobs
Sat 18 Jan 2014 08:04:27 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:04:27 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:04:27 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:04:27 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:04:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:04:29 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:04:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:04:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:04:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:04:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:04:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:04:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:04:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:04:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:04:32 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:04:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:04:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:04:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:04:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:04:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:04:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:04:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:04:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43840208
Sat 18 Jan 2014 08:04:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:04:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43840208
Sat 18 Jan 2014 08:04:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:04:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:04:40 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:04:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:04:42 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:04:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 08:04:42 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:04:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 08:04:42 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:04:42 - job_xml_thread(): Done retrieving: data size 43840208
Sat 18 Jan 2014 08:04:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8933 values 140917 bits 17614 bytes 
Sat 18 Jan 2014 08:04:42 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:04:43 - XML: Start document: iteration 19
Sat 18 Jan 2014 08:04:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:04:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:04:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:04:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:04:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:04:52 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:04:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:04:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:04:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:04:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:04:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:04:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:04:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:04:55 - XML: Processed 655214 elements - found 504 jobs
Sat 18 Jan 2014 08:04:56 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:04:56 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:04:56 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:04:56 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:04:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:04:58 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:04:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:04:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:04:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:04:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:04:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:04:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:05:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:05:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43815658
Sat 18 Jan 2014 08:05:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:05:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43815658
Sat 18 Jan 2014 08:05:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:05:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:05:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:05:09 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:05:09 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 08:05:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:05:10 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:05:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:05:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:05:11 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:05:11 - job_xml_thread(): Done retrieving: data size 43815658
Sat 18 Jan 2014 08:05:11 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:05:11 - XML: Start document: iteration 20
Sat 18 Jan 2014 08:05:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:05:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:05:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:05:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:05:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43815658
Sat 18 Jan 2014 08:05:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:05:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:05:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:05:24 - XML: Processed 655214 elements - found 504 jobs
Sat 18 Jan 2014 08:05:25 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:05:25 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:05:26 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:05:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:05:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:05:26 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:05:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:05:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:05:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:05:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:05:28 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:05:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 08:05:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:05:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:05:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:05:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:05:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:05:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:05:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:05:31 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:05:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:05:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:05:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:05:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:05:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:05:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:05:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:05:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43352906
Sat 18 Jan 2014 08:05:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:05:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43352906
Sat 18 Jan 2014 08:05:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:05:41 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:05:41 - job_xml_thread(): Done retrieving: data size 43352906
Sat 18 Jan 2014 08:05:41 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:05:41 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 08:05:41 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 08:05:41 - Housekeeping: done.
Sat 18 Jan 2014 08:05:42 - XML: Start document: iteration 0
Sat 18 Jan 2014 08:05:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:05:42 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:05:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:05:43 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:05:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 08:05:43 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:05:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 08:05:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6059 values 95613 bits 11951 bytes 
Sat 18 Jan 2014 08:05:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:05:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:05:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:05:44 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:05:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:05:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:05:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:05:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:05:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:05:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:05:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:05:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:05:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:05:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:05:52 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:05:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:05:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:05:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:05:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:05:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:05:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:05:56 - XML: Processed 649262 elements - found 504 jobs
Sat 18 Jan 2014 08:05:56 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:05:56 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:05:56 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:05:56 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:06:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:06:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43151606
Sat 18 Jan 2014 08:06:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:06:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43151606
Sat 18 Jan 2014 08:06:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:06:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:06:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:06:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:06:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:06:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:06:11 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:06:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:06:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:06:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:06:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:06:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:06:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:06:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:06:11 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:06:13 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:06:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 08:06:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:06:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:06:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:06:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:06:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:06:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:06:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:06:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:06:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:06:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:06:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43223501
Sat 18 Jan 2014 08:06:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:06:18 - job_xml_thread(): Done retrieving: data size 43223501
Sat 18 Jan 2014 08:06:18 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:06:18 - XML: Start document: iteration 1
Sat 18 Jan 2014 08:06:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43223501
Sat 18 Jan 2014 08:06:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:06:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:06:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:06:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:06:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:06:35 - XML: Processed 647688 elements - found 504 jobs
Sat 18 Jan 2014 08:06:35 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:06:35 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:06:35 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:06:35 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:06:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:06:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:06:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:06:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:06:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:06:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:06:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:06:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:06:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:06:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:06:42 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:06:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:06:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:06:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:06:43 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:06:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:06:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:06:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:06:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:06:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:06:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 08:06:43 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:06:43 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:06:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 08:06:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5941 values 93699 bits 11712 bytes 
Sat 18 Jan 2014 08:06:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:06:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43731178
Sat 18 Jan 2014 08:06:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:06:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43731178
Sat 18 Jan 2014 08:06:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:06:51 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:06:51 - job_xml_thread(): Done retrieving: data size 43731178
Sat 18 Jan 2014 08:06:51 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:06:51 - XML: Start document: iteration 2
Sat 18 Jan 2014 08:06:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:06:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:06:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:06:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:06:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:06:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:06:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:06:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:07:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:07:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:07:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:07:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:07:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:07:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:07:10 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:07:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:07:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:07:10 - XML: Processed 654276 elements - found 504 jobs
Sat 18 Jan 2014 08:07:10 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:07:10 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:07:10 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:07:10 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:07:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:07:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:07:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:07:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:07:12 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:07:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 08:07:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:07:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:07:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43786390
Sat 18 Jan 2014 08:07:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:07:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43786390
Sat 18 Jan 2014 08:07:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:07:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:07:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:07:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:07:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:07:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:07:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:07:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:07:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:07:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:07:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43786390
Sat 18 Jan 2014 08:07:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:07:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:07:25 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:07:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:07:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:07:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:07:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:07:30 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:07:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:07:35 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:07:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:07:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:07:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:07:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:07:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:07:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:07:38 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 08:07:38 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 08:07:38 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:07:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:07:38 - job_xml_thread(): Done retrieving: data size 43778808
Sat 18 Jan 2014 08:07:38 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:07:38 - XML: Start document: iteration 3
Sat 18 Jan 2014 08:07:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:07:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:07:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43778808
Sat 18 Jan 2014 08:07:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:07:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:07:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:07:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:07:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43778808
Sat 18 Jan 2014 08:07:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:07:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:07:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:07:44 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:07:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:07:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 08:07:46 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:07:46 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:07:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 08:07:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7722 values 121802 bits 15225 bytes 
Sat 18 Jan 2014 08:07:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:07:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:07:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:07:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:07:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:07:56 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:07:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:07:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:07:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:07:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:07:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:07:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:07:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:07:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:07:58 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:07:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:07:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:07:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:07:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:07:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:07:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:08:01 - XML: Processed 655212 elements - found 503 jobs
Sat 18 Jan 2014 08:08:01 - job 7348439 appears to have finished
Sat 18 Jan 2014 08:08:01 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 08:08:01 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 08:08:01 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 08:08:01 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:08:01 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:08:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:08:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43834239
Sat 18 Jan 2014 08:08:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:08:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43834239
Sat 18 Jan 2014 08:08:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:08:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:08:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:08:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:08:13 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:08:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:08:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:08:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:08:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:08:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:08:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:08:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:08:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:08:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:08:16 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:08:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:08:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:08:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:08:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:08:17 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:08:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 08:08:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:08:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:08:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:08:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:08:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:08:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:08:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43838342
Sat 18 Jan 2014 08:08:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:08:20 - job_xml_thread(): Done retrieving: data size 43838342
Sat 18 Jan 2014 08:08:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43838342
Sat 18 Jan 2014 08:08:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:08:20 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:08:20 - XML: Start document: iteration 4
Sat 18 Jan 2014 08:08:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:08:29 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:08:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:08:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:08:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:08:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:08:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:08:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:08:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:08:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:08:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:08:36 - XML: Processed 655212 elements - found 503 jobs
Sat 18 Jan 2014 08:08:36 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:08:36 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:08:36 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:08:36 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:08:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:08:40 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:08:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:08:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:08:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:08:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:08:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:08:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:08:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:08:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43792875
Sat 18 Jan 2014 08:08:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:08:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43792875
Sat 18 Jan 2014 08:08:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:08:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:08:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:08:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:08:46 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:08:47 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:08:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:08:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 08:08:47 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:08:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9266 values 146103 bits 18262 bytes 
Sat 18 Jan 2014 08:08:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 08:08:52 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:08:52 - job_xml_thread(): Done retrieving: data size 43792875
Sat 18 Jan 2014 08:08:52 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:08:52 - XML: Start document: iteration 5
Sat 18 Jan 2014 08:08:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:08:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:08:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:08:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:08:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:08:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:08:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:08:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:08:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:08:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:08:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:09:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:09:05 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:09:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:09:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:09:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:09:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:09:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:09:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:09:06 - XML: Processed 655212 elements - found 503 jobs
Sat 18 Jan 2014 08:09:06 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:09:06 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:09:06 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:09:06 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:09:08 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:09:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 08:09:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:09:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:09:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43798439
Sat 18 Jan 2014 08:09:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:09:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43798439
Sat 18 Jan 2014 08:09:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:09:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:09:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:09:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:09:18 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:09:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:09:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:09:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:09:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:09:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:09:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:09:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:09:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:09:21 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:09:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:09:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:09:22 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:09:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:09:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:09:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:09:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:09:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:09:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:09:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:09:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43808175
Sat 18 Jan 2014 08:09:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:09:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43808175
Sat 18 Jan 2014 08:09:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:09:24 - job_xml_thread(): Done retrieving: data size 43808175
Sat 18 Jan 2014 08:09:24 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:09:25 - XML: Start document: iteration 6
Sat 18 Jan 2014 08:09:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:09:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:09:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:09:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:09:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:09:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:09:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:09:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:09:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:09:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:09:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:09:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:09:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:09:44 - XML: Processed 655210 elements - found 502 jobs
Sat 18 Jan 2014 08:09:44 - job 7336915 appears to have finished
Sat 18 Jan 2014 08:09:44 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 08:09:44 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 08:09:44 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 08:09:44 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:09:44 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:09:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:09:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:09:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:09:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:09:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:09:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:09:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:09:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:09:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:09:47 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:09:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:09:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 08:09:48 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:09:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 08:09:48 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:09:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99039 bits 12379 bytes 
Sat 18 Jan 2014 08:09:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:09:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43820163
Sat 18 Jan 2014 08:09:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:09:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43820163
Sat 18 Jan 2014 08:09:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:09:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:09:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:09:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:09:56 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:09:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:09:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:09:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:09:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:09:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:09:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:09:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43820163
Sat 18 Jan 2014 08:09:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:09:59 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:09:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:10:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:10:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:10:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:10:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:10:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:10:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:10:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:10:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:10:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:10:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:10:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:10:10 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:10:12 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:10:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 08:10:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:10:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:10:12 - job_xml_thread(): Done retrieving: data size 43792328
Sat 18 Jan 2014 08:10:12 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:10:12 - XML: Start document: iteration 7
Sat 18 Jan 2014 08:10:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:10:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:10:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:10:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:10:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43792328
Sat 18 Jan 2014 08:10:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:10:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:10:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43792328
Sat 18 Jan 2014 08:10:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:10:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:10:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:10:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:10:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:10:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:10:29 - XML: Processed 655210 elements - found 502 jobs
Sat 18 Jan 2014 08:10:29 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:10:29 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:10:29 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:10:29 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:10:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:10:30 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:10:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:10:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:10:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:10:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:10:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:10:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:10:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:10:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:10:34 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:10:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:10:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:10:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:10:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:10:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:10:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:10:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:10:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43814612
Sat 18 Jan 2014 08:10:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:10:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43814612
Sat 18 Jan 2014 08:10:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:10:45 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:10:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:10:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:10:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:10:46 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:10:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:10:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:10:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:10:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:10:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:10:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:10:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:10:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:10:49 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:10:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:10:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 08:10:49 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:10:49 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:10:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6598 values 104063 bits 13007 bytes 
Sat 18 Jan 2014 08:10:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 08:10:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:10:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:10:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:10:50 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:10:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:10:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:10:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:10:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:10:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:10:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:10:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:10:52 - job_xml_thread(): Done retrieving: data size 43808791
Sat 18 Jan 2014 08:10:52 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:10:52 - XML: Start document: iteration 8
Sat 18 Jan 2014 08:10:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43808791
Sat 18 Jan 2014 08:10:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:10:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43808791
Sat 18 Jan 2014 08:10:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:11:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:11:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:11:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:11:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:11:07 - XML: Processed 655210 elements - found 502 jobs
Sat 18 Jan 2014 08:11:07 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:11:07 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:11:07 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:11:07 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:11:10 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 08:11:10 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:11:11 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:11:11 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:11:11 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 08:11:11 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 08:11:11 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 08:11:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:11:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:11:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:11:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:11:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:11:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:11:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:11:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:11:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:11:18 - size of cluster 'LISA Cluster': 624 hosts 79480 metrics 899338 values 14182707 bits 1772838 bytes 
Sat 18 Jan 2014 08:11:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:11:18 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:11:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:11:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:11:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:11:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:11:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:11:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:11:19 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:11:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 08:11:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:11:22 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:11:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:11:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43750319
Sat 18 Jan 2014 08:11:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:11:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43750319
Sat 18 Jan 2014 08:11:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:11:23 - job_xml_thread(): Done retrieving: data size 43750319
Sat 18 Jan 2014 08:11:23 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:11:23 - XML: Start document: iteration 9
Sat 18 Jan 2014 08:11:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:11:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:11:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:11:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:11:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:11:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:11:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:11:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:11:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:11:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:11:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:11:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:11:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:11:40 - XML: Processed 654461 elements - found 502 jobs
Sat 18 Jan 2014 08:11:40 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:11:40 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:11:40 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:11:40 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:11:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:11:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:11:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:11:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:11:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:11:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:11:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:11:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:11:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:11:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43212090
Sat 18 Jan 2014 08:11:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:11:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43212090
Sat 18 Jan 2014 08:11:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:11:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:11:49 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:11:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:11:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 08:11:50 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:11:50 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:11:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 08:11:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:11:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:11:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8799 values 138737 bits 17342 bytes 
Sat 18 Jan 2014 08:11:55 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:11:55 - job_xml_thread(): Done retrieving: data size 43212090
Sat 18 Jan 2014 08:11:56 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:11:56 - XML: Start document: iteration 10
Sat 18 Jan 2014 08:11:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:11:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:11:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:11:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:12:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:12:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:12:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:12:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:12:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:12:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:12:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:12:04 - XML: Processed 647876 elements - found 502 jobs
Sat 18 Jan 2014 08:12:04 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:12:04 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:12:04 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:12:04 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:12:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:12:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:12:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:12:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:12:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:12:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:12:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:12:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:12:11 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:12:11 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 08:12:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:12:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43193525
Sat 18 Jan 2014 08:12:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:12:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43193525
Sat 18 Jan 2014 08:12:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:12:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:12:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:12:19 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:12:19 - job_xml_thread(): Done retrieving: data size 43193525
Sat 18 Jan 2014 08:12:19 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:12:19 - XML: Start document: iteration 11
Sat 18 Jan 2014 08:12:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:12:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:12:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:12:29 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:12:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:12:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:12:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:12:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:12:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:12:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:12:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:12:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:12:34 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:12:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:12:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:12:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:12:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:12:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:12:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:12:36 - XML: Processed 647684 elements - found 502 jobs
Sat 18 Jan 2014 08:12:36 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:12:36 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:12:36 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:12:36 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:12:37 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:12:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 08:12:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:12:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:12:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43619132
Sat 18 Jan 2014 08:12:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:12:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43619132
Sat 18 Jan 2014 08:12:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:12:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:12:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:12:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:12:49 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:12:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:12:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:12:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:12:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:12:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:12:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:12:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:12:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:12:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:12:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:12:50 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:12:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:12:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 08:12:51 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:12:51 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:12:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5626 values 88675 bits 11084 bytes 
Sat 18 Jan 2014 08:12:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 08:12:51 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:12:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:12:54 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:12:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:12:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:12:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:12:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:12:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:12:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:12:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:12:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43783546
Sat 18 Jan 2014 08:12:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:12:58 - job_xml_thread(): Done retrieving: data size 43783546
Sat 18 Jan 2014 08:12:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43783546
Sat 18 Jan 2014 08:12:58 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:12:58 - XML: Start document: iteration 12
Sat 18 Jan 2014 08:12:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:13:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:13:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:13:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:13:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:13:16 - XML: Processed 655020 elements - found 502 jobs
Sat 18 Jan 2014 08:13:17 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:13:17 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:13:17 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:13:17 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:13:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:13:19 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:13:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:13:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:13:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:13:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:13:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:13:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:13:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:13:22 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:13:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 08:13:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:13:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:13:23 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:13:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:13:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:13:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:13:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:13:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:13:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:13:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:13:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43796819
Sat 18 Jan 2014 08:13:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:13:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43796819
Sat 18 Jan 2014 08:13:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:13:32 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:13:32 - job_xml_thread(): Done retrieving: data size 43796819
Sat 18 Jan 2014 08:13:32 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:13:32 - XML: Start document: iteration 13
Sat 18 Jan 2014 08:13:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:13:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:13:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:13:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:13:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:13:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:13:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:13:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:13:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:13:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:13:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:13:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:13:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:13:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:13:48 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:13:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:13:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:13:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:13:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:13:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:13:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:13:50 - XML: Processed 655208 elements - found 501 jobs
Sat 18 Jan 2014 08:13:50 - job 7336917 appears to have finished
Sat 18 Jan 2014 08:13:50 - job 7348690 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 08:13:50 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 08:13:50 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 08:13:50 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 08:13:50 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:13:50 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:13:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:13:51 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:13:52 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:13:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:13:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 08:13:52 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:13:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 08:13:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5702 values 89898 bits 11237 bytes 
Sat 18 Jan 2014 08:13:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:13:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43788485
Sat 18 Jan 2014 08:13:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:13:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:13:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:13:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43788485
Sat 18 Jan 2014 08:13:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:14:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:14:03 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:14:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:14:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:14:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:14:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:14:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:14:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:14:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:14:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:14:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:14:05 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:14:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:14:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:14:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:14:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:14:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:14:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:14:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:14:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:14:12 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:14:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 08:14:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:14:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:14:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43799952
Sat 18 Jan 2014 08:14:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:14:13 - job_xml_thread(): Done retrieving: data size 43799952
Sat 18 Jan 2014 08:14:13 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:14:13 - XML: Start document: iteration 14
Sat 18 Jan 2014 08:14:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43799952
Sat 18 Jan 2014 08:14:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:14:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:14:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:14:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:14:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:14:31 - XML: Processed 655208 elements - found 501 jobs
Sat 18 Jan 2014 08:14:31 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:14:31 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:14:31 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:14:31 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:14:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:14:32 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:14:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:14:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:14:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:14:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:14:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:14:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:14:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:14:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:14:35 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:14:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:14:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:14:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:14:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:14:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:14:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:14:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:14:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43811327
Sat 18 Jan 2014 08:14:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:14:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43811327
Sat 18 Jan 2014 08:14:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:14:46 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:14:46 - job_xml_thread(): Done retrieving: data size 43811327
Sat 18 Jan 2014 08:14:46 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:14:46 - XML: Start document: iteration 15
Sat 18 Jan 2014 08:14:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:14:48 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:14:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:14:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:14:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:14:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:14:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:14:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:14:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:14:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:14:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:14:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:14:52 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:14:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:14:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 08:14:53 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:14:53 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:14:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6779 values 106883 bits 13360 bytes 
Sat 18 Jan 2014 08:14:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 08:14:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:14:58 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:14:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:14:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:14:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:14:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:14:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:14:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:14:59 - XML: Processed 655208 elements - found 501 jobs
Sat 18 Jan 2014 08:14:59 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:14:59 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:14:59 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:14:59 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:15:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:15:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43799137
Sat 18 Jan 2014 08:15:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:15:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43799137
Sat 18 Jan 2014 08:15:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:15:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:15:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:15:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:15:10 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:15:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:15:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:15:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:15:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:15:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:15:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43799137
Sat 18 Jan 2014 08:15:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:15:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:15:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:15:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:15:14 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:15:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:15:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:15:21 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:15:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:15:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:15:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:15:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:15:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:15:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:15:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:15:24 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:15:24 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:15:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 08:15:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:15:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:15:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:15:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:15:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:15:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:15:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:15:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:15:28 - job_xml_thread(): Done retrieving: data size 43786098
Sat 18 Jan 2014 08:15:28 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:15:28 - XML: Start document: iteration 16
Sat 18 Jan 2014 08:15:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43786098
Sat 18 Jan 2014 08:15:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:15:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43786098
Sat 18 Jan 2014 08:15:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:15:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:15:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:15:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:15:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:15:45 - XML: Processed 655206 elements - found 500 jobs
Sat 18 Jan 2014 08:15:45 - job 7341518 appears to have finished
Sat 18 Jan 2014 08:15:45 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 08:15:45 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 08:15:45 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 08:15:45 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:15:45 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:15:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:15:46 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:15:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:15:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:15:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:15:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:15:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:15:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:15:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:15:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:15:50 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:15:50 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 08:15:50 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 08:15:50 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:15:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:15:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:15:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:15:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:15:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:15:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:15:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:15:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43822930
Sat 18 Jan 2014 08:15:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:15:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43822930
Sat 18 Jan 2014 08:15:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:15:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:15:53 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:15:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:15:54 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:15:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 08:15:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 08:15:54 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:15:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8916 values 140639 bits 17579 bytes 
Sat 18 Jan 2014 08:16:00 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:16:00 - job_xml_thread(): Done retrieving: data size 43822930
Sat 18 Jan 2014 08:16:00 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:16:01 - XML: Start document: iteration 17
Sat 18 Jan 2014 08:16:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:16:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:16:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:16:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:16:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:16:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:16:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:16:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:16:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:16:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:16:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:16:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:16:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:16:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:16:10 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:16:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:16:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:16:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:16:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:16:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:16:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:16:13 - XML: Processed 655206 elements - found 500 jobs
Sat 18 Jan 2014 08:16:13 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:16:13 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:16:13 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:16:13 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:16:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:16:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43812907
Sat 18 Jan 2014 08:16:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:16:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43812907
Sat 18 Jan 2014 08:16:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:16:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:16:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:16:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:16:25 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:16:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:16:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:16:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:16:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:16:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:16:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:16:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:16:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:16:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:16:28 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:16:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:16:28 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:16:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:16:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:16:29 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:16:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 08:16:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:16:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:16:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:16:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:16:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:16:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:16:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43832615
Sat 18 Jan 2014 08:16:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:16:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43832615
Sat 18 Jan 2014 08:16:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:16:30 - job_xml_thread(): Done retrieving: data size 43832615
Sat 18 Jan 2014 08:16:31 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:16:31 - XML: Start document: iteration 18
Sat 18 Jan 2014 08:16:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:16:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:16:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:16:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:16:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:16:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:16:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:16:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:16:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:16:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:16:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:16:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:16:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:16:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:16:49 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:16:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:16:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:16:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:16:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:16:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:16:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:16:51 - XML: Processed 655205 elements - found 500 jobs
Sat 18 Jan 2014 08:16:51 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:16:51 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:16:51 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:16:51 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:16:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:16:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43797277
Sat 18 Jan 2014 08:16:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:16:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43797277
Sat 18 Jan 2014 08:16:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:16:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:16:55 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:16:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:16:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 08:16:56 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:16:56 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:16:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 08:16:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8738 values 138117 bits 17264 bytes 
Sat 18 Jan 2014 08:16:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:16:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:17:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:17:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:17:07 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:17:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:17:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:17:07 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:17:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:17:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:17:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:17:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:17:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:17:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:17:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:17:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:17:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:17:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:17:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:17:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:17:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:17:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:17:12 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:17:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 08:17:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:17:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:17:12 - job_xml_thread(): Done retrieving: data size 43756598
Sat 18 Jan 2014 08:17:12 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:17:12 - XML: Start document: iteration 19
Sat 18 Jan 2014 08:17:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43756598
Sat 18 Jan 2014 08:17:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:17:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43756598
Sat 18 Jan 2014 08:17:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:17:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:17:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:17:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:17:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:17:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:17:27 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:17:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:17:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:17:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:17:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:17:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:17:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:17:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:17:30 - XML: Processed 654458 elements - found 500 jobs
Sat 18 Jan 2014 08:17:30 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:17:30 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:17:30 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:17:30 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:17:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:17:35 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:17:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:17:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:17:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:17:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:17:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:17:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:17:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:17:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43329770
Sat 18 Jan 2014 08:17:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:17:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43329770
Sat 18 Jan 2014 08:17:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:17:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:17:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:17:45 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:17:45 - job_xml_thread(): Done retrieving: data size 43329770
Sat 18 Jan 2014 08:17:45 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:17:45 - XML: Start document: iteration 20
Sat 18 Jan 2014 08:17:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:17:50 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:17:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:17:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:17:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:17:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:17:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:17:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:17:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:17:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:17:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:17:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:17:56 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:17:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:17:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 08:17:57 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:17:57 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:17:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 08:17:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99366 bits 12420 bytes 
Sat 18 Jan 2014 08:17:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:17:59 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:17:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:17:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:17:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:17:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:17:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:17:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:18:00 - XML: Processed 649266 elements - found 500 jobs
Sat 18 Jan 2014 08:18:00 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:18:00 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:18:00 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:18:00 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:18:02 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:18:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 08:18:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:18:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:18:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43156849
Sat 18 Jan 2014 08:18:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:18:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43156849
Sat 18 Jan 2014 08:18:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:18:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:18:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:18:11 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 08:18:11 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:18:13 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:18:13 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:18:13 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 08:18:13 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 08:18:13 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 08:18:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:18:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:18:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:18:15 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:18:15 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:18:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:18:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:18:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:18:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:18:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:18:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:18:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:18:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:18:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:18:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:18:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:18:18 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 797603 values 12599860 bits 1574982 bytes 
Sat 18 Jan 2014 08:18:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:18:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:18:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:18:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:18:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:18:21 - job_xml_thread(): Done retrieving: data size 43241464
Sat 18 Jan 2014 08:18:21 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:18:21 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 08:18:21 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 08:18:21 - Housekeeping: done.
Sat 18 Jan 2014 08:18:21 - XML: Start document: iteration 0
Sat 18 Jan 2014 08:18:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43241464
Sat 18 Jan 2014 08:18:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43241464
Sat 18 Jan 2014 08:18:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:18:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:18:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:18:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:18:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:18:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:18:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:18:42 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:18:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:18:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:18:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:18:43 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:18:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:18:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:18:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:18:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:18:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:18:44 - XML: Processed 647754 elements - found 500 jobs
Sat 18 Jan 2014 08:18:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:18:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:18:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:18:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:18:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:18:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:18:44 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:18:44 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:18:44 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:18:44 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:18:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:18:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43754455
Sat 18 Jan 2014 08:18:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:18:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43754455
Sat 18 Jan 2014 08:18:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:18:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:18:56 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:18:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:18:58 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:18:58 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:18:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:18:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 08:18:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 08:18:58 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:18:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148772 bits 18596 bytes 
Sat 18 Jan 2014 08:18:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:18:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:18:59 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:18:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:18:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:18:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:19:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:19:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:19:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:19:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:19:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:19:01 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:19:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:19:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:19:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:19:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:19:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:19:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:19:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:19:05 - job_xml_thread(): Done retrieving: data size 43827739
Sat 18 Jan 2014 08:19:05 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:19:05 - XML: Start document: iteration 1
Sat 18 Jan 2014 08:19:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43827739
Sat 18 Jan 2014 08:19:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:19:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43827739
Sat 18 Jan 2014 08:19:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:19:13 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:19:13 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 08:19:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:19:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:19:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:19:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:19:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:19:19 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:19:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:19:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:19:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:19:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:19:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:19:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:19:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:19:22 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:19:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 08:19:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:19:24 - XML: Processed 655092 elements - found 500 jobs
Sat 18 Jan 2014 08:19:24 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:19:24 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:19:24 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:19:24 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:19:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:19:27 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:19:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:19:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:19:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:19:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:19:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:19:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:19:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:19:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43794490
Sat 18 Jan 2014 08:19:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:19:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43794490
Sat 18 Jan 2014 08:19:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:19:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:19:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:19:39 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:19:39 - job_xml_thread(): Done retrieving: data size 43794490
Sat 18 Jan 2014 08:19:39 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:19:39 - XML: Start document: iteration 2
Sat 18 Jan 2014 08:19:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:19:39 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:19:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:19:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:19:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:19:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:19:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:19:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:19:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:19:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:19:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:19:52 - XML: Processed 655206 elements - found 500 jobs
Sat 18 Jan 2014 08:19:52 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:19:52 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:19:52 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:19:52 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:19:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:19:53 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:19:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:19:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:19:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:19:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:19:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:19:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:19:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:19:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43776838
Sat 18 Jan 2014 08:19:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:19:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43776838
Sat 18 Jan 2014 08:19:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:19:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:19:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:19:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:19:58 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:19:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:19:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 08:19:59 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:19:59 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:19:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 08:19:59 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9157 values 144431 bits 18053 bytes 
Sat 18 Jan 2014 08:20:07 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:20:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:20:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:20:07 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:20:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:20:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:20:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:20:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:20:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:20:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:20:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:20:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:20:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:20:12 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:20:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:20:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:20:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:20:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:20:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:20:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:20:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:20:16 - job_xml_thread(): Done retrieving: data size 43812190
Sat 18 Jan 2014 08:20:16 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:20:16 - XML: Start document: iteration 3
Sat 18 Jan 2014 08:20:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43812190
Sat 18 Jan 2014 08:20:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43812190
Sat 18 Jan 2014 08:20:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:20:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:20:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:20:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:20:25 - XML: Processed 655206 elements - found 500 jobs
Sat 18 Jan 2014 08:20:25 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:20:25 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:20:25 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:20:25 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:20:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:20:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:20:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:20:32 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:20:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:20:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:20:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:20:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:20:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:20:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:20:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:20:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:20:38 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:20:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:20:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:20:38 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:20:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 08:20:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:20:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:20:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:20:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:20:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:20:40 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:20:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:20:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43802670
Sat 18 Jan 2014 08:20:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:20:42 - job_xml_thread(): Done retrieving: data size 43802670
Sat 18 Jan 2014 08:20:42 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:20:42 - XML: Start document: iteration 4
Sat 18 Jan 2014 08:20:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43802670
Sat 18 Jan 2014 08:20:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:20:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:20:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:20:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:20:53 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:20:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:20:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:20:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:20:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:20:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:20:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:20:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:20:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:20:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:20:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:20:59 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:21:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:21:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 08:21:01 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:21:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5953 values 93901 bits 11737 bytes 
Sat 18 Jan 2014 08:21:01 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:21:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 08:21:03 - XML: Processed 655206 elements - found 500 jobs
Sat 18 Jan 2014 08:21:03 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:21:03 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:21:03 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:21:03 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:21:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:21:04 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:21:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:21:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:21:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:21:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:21:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:21:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:21:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:21:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43788351
Sat 18 Jan 2014 08:21:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:21:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43788351
Sat 18 Jan 2014 08:21:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:21:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:21:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:21:18 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:21:18 - job_xml_thread(): Done retrieving: data size 43788351
Sat 18 Jan 2014 08:21:18 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:21:19 - XML: Start document: iteration 5
Sat 18 Jan 2014 08:21:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:21:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:21:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:21:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:21:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:21:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:21:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:21:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:21:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:21:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:21:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:21:25 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:21:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 08:21:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:21:30 - XML: Processed 655206 elements - found 500 jobs
Sat 18 Jan 2014 08:21:30 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:21:30 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:21:30 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:21:30 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:21:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:21:32 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:21:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:21:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:21:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:21:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:21:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:21:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:21:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:21:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43801403
Sat 18 Jan 2014 08:21:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:21:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43801403
Sat 18 Jan 2014 08:21:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:21:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:21:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:21:45 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:21:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:21:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:21:46 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:21:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:21:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:21:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:21:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:21:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:21:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:21:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:21:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:21:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:21:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:21:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:21:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:21:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:21:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:21:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:21:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:21:54 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 08:21:54 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 08:21:54 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:21:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:21:54 - job_xml_thread(): Done retrieving: data size 43802635
Sat 18 Jan 2014 08:21:54 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:21:54 - XML: Start document: iteration 6
Sat 18 Jan 2014 08:21:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43802635
Sat 18 Jan 2014 08:21:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43802635
Sat 18 Jan 2014 08:21:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:21:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:22:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:22:02 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:22:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:22:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:22:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:22:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 08:22:04 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:22:04 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:22:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 08:22:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9179 values 144744 bits 18093 bytes 
Sat 18 Jan 2014 08:22:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:22:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:22:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:22:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:22:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:22:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:22:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:22:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:22:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:22:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:22:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:22:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:22:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:22:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:22:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:22:16 - XML: Processed 655206 elements - found 500 jobs
Sat 18 Jan 2014 08:22:16 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:22:16 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:22:16 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:22:16 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:22:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:22:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:22:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:22:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:22:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:22:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43803906
Sat 18 Jan 2014 08:22:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:22:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43803906
Sat 18 Jan 2014 08:22:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:22:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:22:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:22:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:22:27 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:22:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:22:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:22:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:22:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:22:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:22:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:22:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:22:31 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:22:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:22:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:22:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:22:32 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:22:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:22:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:22:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:22:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:22:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:22:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:22:32 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:22:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 08:22:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:22:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:22:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43826495
Sat 18 Jan 2014 08:22:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:22:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43826495
Sat 18 Jan 2014 08:22:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:22:35 - job_xml_thread(): Done retrieving: data size 43826495
Sat 18 Jan 2014 08:22:35 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:22:35 - XML: Start document: iteration 7
Sat 18 Jan 2014 08:22:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:22:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:22:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:22:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:22:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:22:48 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:22:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:22:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:22:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:22:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:22:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:22:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:22:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:22:53 - XML: Processed 655206 elements - found 500 jobs
Sat 18 Jan 2014 08:22:53 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:22:53 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:22:53 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:22:53 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:22:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:22:56 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:22:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:22:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:22:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:22:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:22:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:22:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:22:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:22:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43809195
Sat 18 Jan 2014 08:22:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:22:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43809195
Sat 18 Jan 2014 08:22:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:23:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:23:04 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:23:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:23:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:23:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:23:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 08:23:05 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:23:05 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:23:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 08:23:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8693 values 137064 bits 17133 bytes 
Sat 18 Jan 2014 08:23:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:23:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:23:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:23:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:23:09 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:23:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:23:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:23:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:23:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:23:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:23:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:23:12 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:23:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:23:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:23:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:23:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:23:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:23:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:23:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:23:14 - job_xml_thread(): Done retrieving: data size 43764306
Sat 18 Jan 2014 08:23:14 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:23:14 - XML: Start document: iteration 8
Sat 18 Jan 2014 08:23:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43764306
Sat 18 Jan 2014 08:23:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43764306
Sat 18 Jan 2014 08:23:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:23:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:23:21 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:23:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 08:23:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:23:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:23:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:23:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:23:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:23:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:23:30 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:23:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:23:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:23:31 - XML: Processed 654456 elements - found 499 jobs
Sat 18 Jan 2014 08:23:31 - job 7336919 appears to have finished
Sat 18 Jan 2014 08:23:31 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 08:23:31 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 08:23:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:23:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:23:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:23:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:23:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:23:32 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 08:23:32 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:23:32 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:23:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:23:34 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:23:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:23:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:23:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:23:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:23:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:23:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:23:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:23:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43258679
Sat 18 Jan 2014 08:23:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:23:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43258679
Sat 18 Jan 2014 08:23:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:23:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:23:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:23:47 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:23:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:23:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:23:48 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:23:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:23:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:23:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:23:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:23:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:23:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:23:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:23:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:23:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:23:50 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:23:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:23:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:23:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:23:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:23:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:23:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:23:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:23:52 - job_xml_thread(): Done retrieving: data size 43159643
Sat 18 Jan 2014 08:23:52 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:23:52 - XML: Start document: iteration 9
Sat 18 Jan 2014 08:23:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43159643
Sat 18 Jan 2014 08:23:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:23:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43159643
Sat 18 Jan 2014 08:23:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:24:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:24:05 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:24:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:24:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:24:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:24:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:24:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:24:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 08:24:06 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:24:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 08:24:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:24:06 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:24:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:24:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:24:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:24:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9199 values 145056 bits 18132 bytes 
Sat 18 Jan 2014 08:24:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:24:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:24:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:24:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:24:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:24:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:24:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:24:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:24:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:24:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:24:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:24:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:24:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:24:16 - XML: Processed 647217 elements - found 499 jobs
Sat 18 Jan 2014 08:24:16 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:24:16 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:24:16 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:24:16 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:24:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:24:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43177081
Sat 18 Jan 2014 08:24:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:24:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43177081
Sat 18 Jan 2014 08:24:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:24:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:24:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:24:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:24:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:24:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:24:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:24:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:24:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:24:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:24:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:24:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:24:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:24:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:24:31 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:24:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:24:33 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:24:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:24:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:24:33 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:24:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 08:24:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:24:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:24:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:24:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:24:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:24:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:24:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43640293
Sat 18 Jan 2014 08:24:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:24:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43640293
Sat 18 Jan 2014 08:24:36 - job_xml_thread(): Done retrieving: data size 43640293
Sat 18 Jan 2014 08:24:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:24:36 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:24:36 - XML: Start document: iteration 10
Sat 18 Jan 2014 08:24:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:24:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:24:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:24:47 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:24:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:24:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:24:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:24:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:24:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:24:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:24:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:24:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:24:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:24:53 - XML: Processed 653092 elements - found 499 jobs
Sat 18 Jan 2014 08:24:53 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:24:53 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:24:53 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:24:53 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:24:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:24:57 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:24:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:24:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:24:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:24:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:24:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:24:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:24:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:24:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43771177
Sat 18 Jan 2014 08:24:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:24:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43771177
Sat 18 Jan 2014 08:24:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:25:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:25:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:25:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:25:06 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:25:06 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:25:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 08:25:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:25:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 08:25:07 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:25:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9041 values 142497 bits 17812 bytes 
Sat 18 Jan 2014 08:25:08 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:25:08 - job_xml_thread(): Done retrieving: data size 43771177
Sat 18 Jan 2014 08:25:08 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:25:09 - XML: Start document: iteration 11
Sat 18 Jan 2014 08:25:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:25:10 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:25:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:25:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:25:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:25:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:25:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:25:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:25:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:25:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:25:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:25:13 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 08:25:13 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:25:14 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:25:14 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 08:25:14 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:25:14 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 08:25:14 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 08:25:20 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 885445 values 13961065 bits 1745133 bytes 
Sat 18 Jan 2014 08:25:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:25:21 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:25:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:25:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:25:22 - XML: Processed 654724 elements - found 499 jobs
Sat 18 Jan 2014 08:25:22 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:25:22 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:25:22 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:25:22 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:25:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:25:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:25:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:25:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:25:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:25:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43784848
Sat 18 Jan 2014 08:25:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:25:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43784848
Sat 18 Jan 2014 08:25:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:25:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:25:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:25:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:25:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:25:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:25:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:25:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:25:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:25:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:25:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:25:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:25:37 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:25:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:25:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:25:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:25:41 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:25:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:25:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:25:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:25:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:25:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:25:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:25:42 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:25:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 08:25:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:25:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:25:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43809667
Sat 18 Jan 2014 08:25:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:25:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43809667
Sat 18 Jan 2014 08:25:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:25:45 - job_xml_thread(): Done retrieving: data size 43809667
Sat 18 Jan 2014 08:25:45 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:25:46 - XML: Start document: iteration 12
Sat 18 Jan 2014 08:25:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:25:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:25:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:25:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:25:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:25:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:25:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:25:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:25:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:25:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:25:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:25:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:25:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:26:06 - XML: Processed 655204 elements - found 499 jobs
Sat 18 Jan 2014 08:26:06 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:26:06 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:26:06 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:26:06 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:26:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:26:06 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:26:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:26:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 08:26:07 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:26:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 08:26:07 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:26:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5527 values 87070 bits 10883 bytes 
Sat 18 Jan 2014 08:26:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:26:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:26:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:26:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:26:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:26:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:26:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:26:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:26:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:26:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43785716
Sat 18 Jan 2014 08:26:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:26:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43785716
Sat 18 Jan 2014 08:26:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:26:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:26:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:26:14 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:26:14 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 08:26:21 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:26:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:26:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:26:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:26:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:26:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:26:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:26:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:26:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:26:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:26:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:26:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:26:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:26:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:26:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:26:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:26:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:26:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:26:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:26:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:26:27 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:26:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 08:26:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:26:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:26:30 - job_xml_thread(): Done retrieving: data size 43814872
Sat 18 Jan 2014 08:26:30 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:26:30 - XML: Start document: iteration 13
Sat 18 Jan 2014 08:26:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43814872
Sat 18 Jan 2014 08:26:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:26:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43814872
Sat 18 Jan 2014 08:26:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:26:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:26:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:26:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:26:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:26:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:26:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:26:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:26:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:26:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:26:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:26:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:26:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:26:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:26:48 - XML: Processed 655204 elements - found 499 jobs
Sat 18 Jan 2014 08:26:48 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:26:48 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:26:48 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:26:48 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:26:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:26:53 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:26:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:26:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:26:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:26:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:26:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:26:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:26:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:26:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43786479
Sat 18 Jan 2014 08:26:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:26:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43786479
Sat 18 Jan 2014 08:26:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:26:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:26:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:27:03 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:27:03 - job_xml_thread(): Done retrieving: data size 43786479
Sat 18 Jan 2014 08:27:04 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:27:04 - XML: Start document: iteration 14
Sat 18 Jan 2014 08:27:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:27:08 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:27:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:27:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:27:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:27:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 08:27:09 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:27:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 08:27:09 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:27:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8524 values 134312 bits 16789 bytes 
Sat 18 Jan 2014 08:27:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:27:18 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:27:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:27:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:27:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:27:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:27:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:27:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:27:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:27:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:27:20 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:27:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:27:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:27:21 - XML: Processed 655204 elements - found 499 jobs
Sat 18 Jan 2014 08:27:21 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:27:21 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:27:21 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:27:21 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:27:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:27:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:27:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:27:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:27:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:27:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43810328
Sat 18 Jan 2014 08:27:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:27:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43810328
Sat 18 Jan 2014 08:27:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:27:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:27:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:27:36 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:27:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:27:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:27:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:27:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:27:39 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:27:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:27:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:27:40 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:27:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 08:27:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:27:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:27:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:27:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:27:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:27:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:27:41 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:27:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:27:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:27:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:27:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:27:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:27:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:27:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:27:45 - job_xml_thread(): Done retrieving: data size 43814621
Sat 18 Jan 2014 08:27:45 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:27:45 - XML: Start document: iteration 15
Sat 18 Jan 2014 08:27:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43814621
Sat 18 Jan 2014 08:27:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43814621
Sat 18 Jan 2014 08:27:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:27:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:27:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:27:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:27:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:27:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:28:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:28:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:28:07 - XML: Processed 655204 elements - found 499 jobs
Sat 18 Jan 2014 08:28:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:28:07 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:28:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:28:07 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:28:07 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:28:07 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:28:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:28:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:28:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:28:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:28:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:28:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:28:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:28:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:28:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:28:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:28:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:28:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:28:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:28:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:28:09 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:28:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:28:10 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:28:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 08:28:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 08:28:10 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:28:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5796 values 91421 bits 11427 bytes 
Sat 18 Jan 2014 08:28:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:28:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43822979
Sat 18 Jan 2014 08:28:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:28:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43822979
Sat 18 Jan 2014 08:28:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:28:23 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:28:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:28:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:28:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:28:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:28:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:28:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:28:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:28:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:28:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:28:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:28:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:28:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:28:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:28:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:28:29 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:28:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:28:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:28:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:28:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:28:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:28:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:28:31 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:28:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 08:28:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:28:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:28:33 - job_xml_thread(): Done retrieving: data size 43818407
Sat 18 Jan 2014 08:28:33 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:28:33 - XML: Start document: iteration 16
Sat 18 Jan 2014 08:28:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43818407
Sat 18 Jan 2014 08:28:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:28:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43818407
Sat 18 Jan 2014 08:28:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:28:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:28:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:28:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:28:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:28:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:28:48 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:28:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:28:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:28:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:28:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:28:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:28:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:28:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:28:54 - XML: Processed 655204 elements - found 499 jobs
Sat 18 Jan 2014 08:28:54 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:28:54 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:28:54 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:28:54 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:28:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:28:56 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:28:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:28:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:28:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:28:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:28:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:28:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:28:59 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 08:28:59 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 08:28:59 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:28:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:28:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43817406
Sat 18 Jan 2014 08:28:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:29:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43817406
Sat 18 Jan 2014 08:29:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:29:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:29:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:29:09 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:29:09 - job_xml_thread(): Done retrieving: data size 43817406
Sat 18 Jan 2014 08:29:09 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:29:09 - XML: Start document: iteration 17
Sat 18 Jan 2014 08:29:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:29:10 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:29:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:29:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 08:29:11 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:29:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 08:29:11 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:29:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:29:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:29:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:29:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:29:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7393 values 116547 bits 14568 bytes 
Sat 18 Jan 2014 08:29:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:29:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:29:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:29:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:29:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:29:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:29:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:29:19 - XML: Processed 655204 elements - found 499 jobs
Sat 18 Jan 2014 08:29:19 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:29:19 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:29:19 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:29:19 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:29:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:29:23 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:29:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:29:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:29:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:29:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:29:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:29:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:29:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:29:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43724406
Sat 18 Jan 2014 08:29:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:29:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43724406
Sat 18 Jan 2014 08:29:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:29:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:29:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:29:34 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:29:34 - job_xml_thread(): Done retrieving: data size 43724406
Sat 18 Jan 2014 08:29:34 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:29:34 - XML: Start document: iteration 18
Sat 18 Jan 2014 08:29:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:29:39 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:29:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:29:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:29:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:29:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:29:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:29:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:29:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:29:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:29:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:29:42 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:29:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 08:29:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:29:49 - XML: Processed 654456 elements - found 499 jobs
Sat 18 Jan 2014 08:29:49 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:29:49 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:29:49 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:29:49 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:29:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:29:50 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:29:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:29:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:29:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:29:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:29:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:29:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:29:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:29:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43203801
Sat 18 Jan 2014 08:29:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:29:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43203801
Sat 18 Jan 2014 08:29:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:29:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:29:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:30:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:30:03 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:30:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:30:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:30:04 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:30:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:30:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:30:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:30:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:30:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:30:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:30:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:30:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:30:06 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:30:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:30:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:30:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:30:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:30:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:30:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:30:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:30:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43153040
Sat 18 Jan 2014 08:30:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:30:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43153040
Sat 18 Jan 2014 08:30:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:30:09 - job_xml_thread(): Done retrieving: data size 43153040
Sat 18 Jan 2014 08:30:10 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:30:10 - XML: Start document: iteration 19
Sat 18 Jan 2014 08:30:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:30:12 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:30:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:30:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 08:30:12 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:30:12 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:30:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 08:30:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9071 values 143081 bits 17885 bytes 
Sat 18 Jan 2014 08:30:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:30:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:30:20 - XML: Processed 647078 elements - found 499 jobs
Sat 18 Jan 2014 08:30:20 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:30:20 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:30:20 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:30:20 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:30:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:30:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:30:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:30:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:30:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:30:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:30:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:30:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:30:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:30:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:30:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:30:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:30:31 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:30:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:30:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:30:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:30:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:30:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:30:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:30:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:30:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43362315
Sat 18 Jan 2014 08:30:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:30:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43362315
Sat 18 Jan 2014 08:30:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:30:35 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:30:35 - job_xml_thread(): Done retrieving: data size 43362315
Sat 18 Jan 2014 08:30:35 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:30:35 - XML: Start document: iteration 20
Sat 18 Jan 2014 08:30:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:30:43 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:30:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:30:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:30:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:30:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:30:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:30:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:30:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:30:46 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:30:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 08:30:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:30:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:30:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:30:51 - XML: Processed 649376 elements - found 499 jobs
Sat 18 Jan 2014 08:30:52 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:30:52 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:30:52 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:30:52 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:30:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:30:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:30:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:30:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:30:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:30:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:30:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:30:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:30:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:30:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43777687
Sat 18 Jan 2014 08:30:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:30:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43777687
Sat 18 Jan 2014 08:30:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:30:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:30:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:31:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:31:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:31:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:31:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:31:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:31:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:31:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:31:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:31:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:31:07 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:31:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:31:10 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:31:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:31:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:31:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:31:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:31:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:31:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:31:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:31:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43816142
Sat 18 Jan 2014 08:31:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:31:12 - job_xml_thread(): Done retrieving: data size 43816142
Sat 18 Jan 2014 08:31:12 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:31:12 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 08:31:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43816142
Sat 18 Jan 2014 08:31:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:31:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:31:13 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:31:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:31:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 08:31:13 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:31:13 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:31:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 08:31:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6754 values 106636 bits 13329 bytes 
Sat 18 Jan 2014 08:31:13 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 08:31:14 - Housekeeping: done.
Sat 18 Jan 2014 08:31:14 - XML: Start document: iteration 0
Sat 18 Jan 2014 08:31:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:31:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:31:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:31:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:31:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:31:27 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:31:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:31:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:31:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:31:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:31:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:31:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:31:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:31:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:31:34 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:31:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:31:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:31:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:31:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:31:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:31:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:31:35 - XML: Processed 655204 elements - found 499 jobs
Sat 18 Jan 2014 08:31:35 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:31:35 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:31:35 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:31:35 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:31:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:31:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43793094
Sat 18 Jan 2014 08:31:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:31:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43793094
Sat 18 Jan 2014 08:31:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:31:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:31:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:31:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:31:47 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:31:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:31:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:31:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:31:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:31:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:31:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:31:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:31:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:31:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:31:50 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:31:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:31:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:31:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:31:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:31:51 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:31:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 08:31:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:31:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:31:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:31:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:31:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:31:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:31:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43808751
Sat 18 Jan 2014 08:31:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:31:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43808751
Sat 18 Jan 2014 08:31:53 - job_xml_thread(): Done retrieving: data size 43808751
Sat 18 Jan 2014 08:31:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:31:53 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:31:54 - XML: Start document: iteration 1
Sat 18 Jan 2014 08:32:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:32:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:32:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:32:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:32:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:32:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:32:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:32:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:32:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:32:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:32:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:32:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:32:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:32:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:32:13 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:32:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:32:13 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:32:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 08:32:13 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:32:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 08:32:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6094 values 96286 bits 12035 bytes 
Sat 18 Jan 2014 08:32:14 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 08:32:14 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:32:15 - XML: Processed 655203 elements - found 499 jobs
Sat 18 Jan 2014 08:32:15 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:32:15 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:32:15 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:32:15 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:32:15 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:32:15 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:32:15 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 08:32:15 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 08:32:15 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 08:32:17 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 869775 values 13724694 bits 1715586 bytes 
Sat 18 Jan 2014 08:32:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:32:18 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:32:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:32:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:32:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:32:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:32:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:32:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:32:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:32:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43812544
Sat 18 Jan 2014 08:32:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:32:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43812544
Sat 18 Jan 2014 08:32:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:32:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:32:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:32:30 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:32:30 - job_xml_thread(): Done retrieving: data size 43812544
Sat 18 Jan 2014 08:32:30 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:32:30 - XML: Start document: iteration 2
Sat 18 Jan 2014 08:32:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:32:33 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:32:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:32:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:32:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:32:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:32:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:32:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:32:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:32:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:32:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:32:42 - XML: Processed 655204 elements - found 499 jobs
Sat 18 Jan 2014 08:32:42 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:32:42 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:32:42 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:32:42 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:32:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:32:46 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:32:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:32:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:32:46 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:32:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 08:32:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:32:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:32:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:32:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:32:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:32:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:32:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:32:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:32:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43807562
Sat 18 Jan 2014 08:32:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:32:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43807562
Sat 18 Jan 2014 08:32:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:32:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:32:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:32:57 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:32:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:32:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:32:57 - job_xml_thread(): Done retrieving: data size 43807562
Sat 18 Jan 2014 08:32:57 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:32:57 - XML: Start document: iteration 3
Sat 18 Jan 2014 08:32:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:32:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:32:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:32:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:32:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43807562
Sat 18 Jan 2014 08:32:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:33:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:33:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:33:12 - XML: Processed 655204 elements - found 499 jobs
Sat 18 Jan 2014 08:33:12 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:33:12 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:33:12 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:33:12 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:33:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:33:13 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:33:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:33:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:33:13 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:33:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:33:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:33:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:33:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:33:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:33:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:33:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:33:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:33:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:33:14 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:33:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 08:33:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 08:33:15 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:33:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5563 values 87980 bits 10997 bytes 
Sat 18 Jan 2014 08:33:15 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:33:15 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 08:33:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:33:18 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:33:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:33:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:33:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:33:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:33:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:33:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:33:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:33:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43813732
Sat 18 Jan 2014 08:33:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:33:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43813732
Sat 18 Jan 2014 08:33:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:33:27 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:33:27 - job_xml_thread(): Done retrieving: data size 43813732
Sat 18 Jan 2014 08:33:27 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:33:27 - XML: Start document: iteration 4
Sat 18 Jan 2014 08:33:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:33:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:33:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:33:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:33:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:33:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:33:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:33:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:33:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:33:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:33:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:33:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:33:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:33:43 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:33:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 08:33:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:33:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:33:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:33:44 - XML: Processed 655204 elements - found 499 jobs
Sat 18 Jan 2014 08:33:44 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:33:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:33:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:33:44 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:33:44 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:33:44 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:33:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:33:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:33:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:33:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:33:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:33:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43809649
Sat 18 Jan 2014 08:33:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:33:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43809649
Sat 18 Jan 2014 08:33:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:33:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:33:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:33:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:33:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:33:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:33:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:33:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:33:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:33:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:33:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:33:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:33:59 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:33:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:34:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:34:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:34:02 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:34:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:34:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:34:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:34:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:34:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:34:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:34:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:34:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43823503
Sat 18 Jan 2014 08:34:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:34:05 - job_xml_thread(): Done retrieving: data size 43823503
Sat 18 Jan 2014 08:34:05 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:34:05 - XML: Start document: iteration 5
Sat 18 Jan 2014 08:34:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43823503
Sat 18 Jan 2014 08:34:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:34:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:34:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:34:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:34:16 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:34:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:34:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:34:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:34:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:34:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:34:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:34:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:34:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 08:34:18 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:34:18 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:34:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8954 values 141323 bits 17665 bytes 
Sat 18 Jan 2014 08:34:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 08:34:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:34:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:34:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:34:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:34:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:34:24 - XML: Processed 655200 elements - found 499 jobs
Sat 18 Jan 2014 08:34:25 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:34:25 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:34:25 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:34:25 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:34:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:34:27 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:34:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:34:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:34:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:34:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:34:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:34:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:34:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:34:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43813026
Sat 18 Jan 2014 08:34:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:34:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43813026
Sat 18 Jan 2014 08:34:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:34:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:34:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:34:40 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:34:40 - job_xml_thread(): Done retrieving: data size 43813026
Sat 18 Jan 2014 08:34:40 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:34:40 - XML: Start document: iteration 6
Sat 18 Jan 2014 08:34:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:34:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:34:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:34:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:34:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:34:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:34:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43813026
Sat 18 Jan 2014 08:34:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:34:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:34:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:34:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:34:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:34:54 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:34:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 08:34:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:34:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:34:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:34:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:34:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:34:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:34:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:34:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:34:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:34:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:34:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:34:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:34:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:34:59 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:34:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:34:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:34:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:34:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:34:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:34:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:35:01 - XML: Processed 655204 elements - found 499 jobs
Sat 18 Jan 2014 08:35:01 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:35:01 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:35:01 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:35:01 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:35:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:35:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43821971
Sat 18 Jan 2014 08:35:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:35:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43821971
Sat 18 Jan 2014 08:35:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:35:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:35:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:35:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:35:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:35:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:35:15 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:35:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:35:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:35:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:35:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:35:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:35:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:35:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:35:17 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:35:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:35:19 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:35:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:35:19 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:35:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 08:35:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 08:35:19 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:35:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6064 values 95662 bits 11957 bytes 
Sat 18 Jan 2014 08:35:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:35:20 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:35:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:35:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:35:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:35:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:35:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:35:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:35:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:35:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43732973
Sat 18 Jan 2014 08:35:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:35:24 - job_xml_thread(): Done retrieving: data size 43732973
Sat 18 Jan 2014 08:35:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43732973
Sat 18 Jan 2014 08:35:24 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:35:24 - XML: Start document: iteration 7
Sat 18 Jan 2014 08:35:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:35:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:35:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:35:32 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:35:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 08:35:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:35:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:35:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:35:38 - XML: Processed 654454 elements - found 498 jobs
Sat 18 Jan 2014 08:35:39 - job 7346473 appears to have finished
Sat 18 Jan 2014 08:35:39 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 08:35:39 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 08:35:39 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 08:35:40 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:35:40 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:35:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:35:44 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:35:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:35:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:35:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:35:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:35:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:35:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:35:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:35:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:35:46 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:35:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:35:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:35:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:35:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:35:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:35:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:35:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:35:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43187749
Sat 18 Jan 2014 08:35:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:35:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43187749
Sat 18 Jan 2014 08:35:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:35:55 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:35:55 - job_xml_thread(): Done retrieving: data size 43187749
Sat 18 Jan 2014 08:35:55 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:35:55 - XML: Start document: iteration 8
Sat 18 Jan 2014 08:36:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:36:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:36:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:36:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:36:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:36:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:36:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:36:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:36:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:36:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:36:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:36:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:36:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:36:12 - XML: Processed 647254 elements - found 498 jobs
Sat 18 Jan 2014 08:36:12 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:36:12 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:36:13 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:36:13 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:36:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:36:14 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:36:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:36:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:36:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:36:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:36:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:36:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:36:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:36:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43181049
Sat 18 Jan 2014 08:36:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:36:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43181049
Sat 18 Jan 2014 08:36:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:36:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:36:20 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:36:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:36:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:36:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:36:21 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:36:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 08:36:21 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:36:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 08:36:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9359 values 147659 bits 18457 bytes 
Sat 18 Jan 2014 08:36:28 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:36:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:36:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:36:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:36:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:36:30 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:36:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:36:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:36:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:36:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:36:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:36:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:36:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:36:33 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:36:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:36:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:36:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:36:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:36:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:36:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:36:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:36:37 - job_xml_thread(): Done retrieving: data size 43581471
Sat 18 Jan 2014 08:36:37 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:36:37 - XML: Start document: iteration 9
Sat 18 Jan 2014 08:36:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581471
Sat 18 Jan 2014 08:36:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581471
Sat 18 Jan 2014 08:36:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:36:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:36:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:36:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:36:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:36:48 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:36:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:36:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:36:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:36:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:36:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:36:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:36:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:36:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:36:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:36:56 - XML: Processed 652464 elements - found 498 jobs
Sat 18 Jan 2014 08:36:56 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:36:56 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:36:56 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:36:56 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:36:59 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 08:36:59 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 08:36:59 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:37:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:37:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:37:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:37:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:37:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:37:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:37:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:37:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:37:00 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:37:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 08:37:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:37:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:37:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43787045
Sat 18 Jan 2014 08:37:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:37:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43787045
Sat 18 Jan 2014 08:37:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:37:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:37:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:37:12 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:37:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:37:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:37:12 - job_xml_thread(): Done retrieving: data size 43787045
Sat 18 Jan 2014 08:37:12 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:37:12 - XML: Start document: iteration 10
Sat 18 Jan 2014 08:37:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:37:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:37:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:37:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:37:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:37:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:37:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:37:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:37:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:37:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:37:22 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:37:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:37:22 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:37:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 08:37:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 08:37:22 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:37:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5610 values 88482 bits 11060 bytes 
Sat 18 Jan 2014 08:37:24 - XML: Processed 654986 elements - found 498 jobs
Sat 18 Jan 2014 08:37:24 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:37:24 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:37:24 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:37:24 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:37:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:37:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:37:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:37:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:37:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:37:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:37:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:37:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:37:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:37:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43785183
Sat 18 Jan 2014 08:37:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:37:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:37:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43785183
Sat 18 Jan 2014 08:37:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:37:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:37:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:37:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:37:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:37:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:37:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:37:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:37:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:37:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:37:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:37:39 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:37:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:37:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:37:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:37:41 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:37:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:37:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:37:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:37:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:37:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:37:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:37:42 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:37:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 08:37:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:37:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:37:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43821729
Sat 18 Jan 2014 08:37:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:37:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43821729
Sat 18 Jan 2014 08:37:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:37:44 - job_xml_thread(): Done retrieving: data size 43821729
Sat 18 Jan 2014 08:37:44 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:37:44 - XML: Start document: iteration 11
Sat 18 Jan 2014 08:37:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:37:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:37:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:37:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:37:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:37:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:37:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:37:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:37:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:37:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:37:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:37:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:37:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:38:05 - XML: Processed 655202 elements - found 498 jobs
Sat 18 Jan 2014 08:38:05 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:38:05 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:38:05 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:38:05 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:38:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:38:07 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:38:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:38:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:38:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:38:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:38:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:38:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:38:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:38:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43786552
Sat 18 Jan 2014 08:38:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:38:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43786552
Sat 18 Jan 2014 08:38:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:38:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:38:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:38:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:38:20 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:38:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:38:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:38:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:38:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:38:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:38:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:38:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:38:21 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:38:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:38:23 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:38:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:38:23 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:38:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:38:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:38:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:38:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 08:38:24 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:38:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 08:38:24 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:38:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8741 values 137867 bits 17233 bytes 
Sat 18 Jan 2014 08:38:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:38:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:38:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:38:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:38:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:38:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43820633
Sat 18 Jan 2014 08:38:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:38:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43820633
Sat 18 Jan 2014 08:38:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:38:26 - job_xml_thread(): Done retrieving: data size 43820633
Sat 18 Jan 2014 08:38:26 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:38:26 - XML: Start document: iteration 12
Sat 18 Jan 2014 08:38:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:38:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:38:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:38:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:38:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:38:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:38:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:38:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:38:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:38:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:38:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:38:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:38:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:38:43 - XML: Processed 655202 elements - found 498 jobs
Sat 18 Jan 2014 08:38:44 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:38:44 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:38:44 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:38:44 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:38:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:38:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:38:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:38:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:38:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:38:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:38:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:38:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:38:48 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:38:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 08:38:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:38:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:38:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43791012
Sat 18 Jan 2014 08:38:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:38:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43791012
Sat 18 Jan 2014 08:38:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:38:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:38:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:38:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:38:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:38:59 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:38:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:39:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:39:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:39:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:39:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:39:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:39:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:39:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:39:02 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:39:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:39:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:39:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:39:03 - job_xml_thread(): Done retrieving: data size 43820422
Sat 18 Jan 2014 08:39:03 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:39:03 - XML: Start document: iteration 13
Sat 18 Jan 2014 08:39:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:39:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43820422
Sat 18 Jan 2014 08:39:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:39:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:39:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:39:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:39:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43820422
Sat 18 Jan 2014 08:39:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:39:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:39:15 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:39:16 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 08:39:16 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:39:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:39:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:39:17 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:39:17 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:39:17 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 08:39:17 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 08:39:17 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 08:39:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:39:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:39:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:39:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:39:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:39:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:39:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:39:23 - XML: Processed 655202 elements - found 498 jobs
Sat 18 Jan 2014 08:39:23 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:39:23 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:39:23 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:39:23 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:39:23 - size of cluster 'LISA Cluster': 624 hosts 79480 metrics 815925 values 12866753 bits 1608344 bytes 
Sat 18 Jan 2014 08:39:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:39:24 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:39:24 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:39:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:39:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 08:39:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 08:39:24 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:39:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7565 values 119286 bits 14910 bytes 
Sat 18 Jan 2014 08:39:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:39:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:39:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:39:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:39:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:39:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:39:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:39:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:39:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:39:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43807148
Sat 18 Jan 2014 08:39:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:39:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43807148
Sat 18 Jan 2014 08:39:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:39:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:39:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:39:38 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:39:38 - job_xml_thread(): Done retrieving: data size 43807148
Sat 18 Jan 2014 08:39:38 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:39:38 - XML: Start document: iteration 14
Sat 18 Jan 2014 08:39:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:39:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:39:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:39:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:39:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:39:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:39:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:39:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:39:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:39:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:39:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:39:47 - XML: Processed 655201 elements - found 498 jobs
Sat 18 Jan 2014 08:39:47 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:39:47 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:39:47 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:39:47 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:39:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:39:53 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:39:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:39:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:39:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:39:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:39:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:39:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:39:53 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:39:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 08:39:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:39:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:39:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:39:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:39:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43790035
Sat 18 Jan 2014 08:39:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:39:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43790035
Sat 18 Jan 2014 08:39:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:40:02 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:40:02 - job_xml_thread(): Done retrieving: data size 43790035
Sat 18 Jan 2014 08:40:03 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:40:03 - XML: Start document: iteration 15
Sat 18 Jan 2014 08:40:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:40:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:40:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:40:10 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:40:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:40:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:40:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:40:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:40:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:40:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:40:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:40:16 - XML: Processed 655202 elements - found 498 jobs
Sat 18 Jan 2014 08:40:16 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:40:16 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:40:16 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:40:17 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:40:17 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:40:17 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 08:40:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:40:19 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:40:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:40:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:40:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:40:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:40:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:40:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:40:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:40:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43789705
Sat 18 Jan 2014 08:40:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:40:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43789705
Sat 18 Jan 2014 08:40:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:40:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:40:25 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:40:25 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:40:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:40:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 08:40:25 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:40:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 08:40:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8809 values 138921 bits 17365 bytes 
Sat 18 Jan 2014 08:40:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:40:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:40:32 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:40:32 - job_xml_thread(): Done retrieving: data size 43789705
Sat 18 Jan 2014 08:40:32 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:40:32 - XML: Start document: iteration 16
Sat 18 Jan 2014 08:40:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:40:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:40:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:40:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:40:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:40:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:40:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:40:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:40:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:40:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:40:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:40:42 - XML: Processed 655202 elements - found 498 jobs
Sat 18 Jan 2014 08:40:42 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:40:42 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:40:42 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:40:42 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:40:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:40:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:40:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:40:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:40:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:40:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:40:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:40:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:40:48 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:40:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 08:40:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:40:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:40:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43789186
Sat 18 Jan 2014 08:40:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:40:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43789186
Sat 18 Jan 2014 08:40:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:40:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:40:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:40:57 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:40:57 - job_xml_thread(): Done retrieving: data size 43789186
Sat 18 Jan 2014 08:40:57 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:40:57 - XML: Start document: iteration 17
Sat 18 Jan 2014 08:41:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:41:00 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:41:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:41:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:41:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:41:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:41:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:41:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:41:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:41:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:41:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:41:09 - XML: Processed 655202 elements - found 498 jobs
Sat 18 Jan 2014 08:41:09 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:41:09 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:41:09 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:41:09 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:41:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:41:11 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:41:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:41:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:41:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:41:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:41:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:41:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:41:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:41:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43807216
Sat 18 Jan 2014 08:41:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:41:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43807216
Sat 18 Jan 2014 08:41:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:41:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:41:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:41:24 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:41:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:41:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:41:26 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:41:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:41:26 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:41:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:41:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:41:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:41:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:41:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:41:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:41:26 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:41:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 08:41:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:41:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 08:41:26 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:41:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99010 bits 12376 bytes 
Sat 18 Jan 2014 08:41:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:41:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:41:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:41:30 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:41:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:41:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:41:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:41:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:41:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:41:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:41:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:41:33 - job_xml_thread(): Done retrieving: data size 43665493
Sat 18 Jan 2014 08:41:33 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:41:33 - XML: Start document: iteration 18
Sat 18 Jan 2014 08:41:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43665493
Sat 18 Jan 2014 08:41:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:41:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43665493
Sat 18 Jan 2014 08:41:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:41:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:41:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:41:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:41:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:41:47 - XML: Processed 653636 elements - found 497 jobs
Sat 18 Jan 2014 08:41:47 - job 7346479 appears to have finished
Sat 18 Jan 2014 08:41:47 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 08:41:47 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 08:41:48 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 08:41:48 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:41:48 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:41:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:41:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:41:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:41:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:41:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:41:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:41:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:41:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:41:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:41:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:41:56 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:41:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:41:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:41:56 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:41:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 08:41:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:41:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:41:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:41:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:41:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:41:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:41:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43169033
Sat 18 Jan 2014 08:41:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:42:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43169033
Sat 18 Jan 2014 08:42:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:42:03 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:42:03 - job_xml_thread(): Done retrieving: data size 43169033
Sat 18 Jan 2014 08:42:03 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:42:03 - XML: Start document: iteration 19
Sat 18 Jan 2014 08:42:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:42:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:42:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:42:10 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:42:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:42:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:42:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:42:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:42:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:42:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:42:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:42:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:42:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:42:21 - XML: Processed 647006 elements - found 497 jobs
Sat 18 Jan 2014 08:42:21 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:42:21 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:42:21 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:42:21 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:42:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:42:21 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:42:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:42:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:42:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:42:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:42:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:42:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:42:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:42:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43188628
Sat 18 Jan 2014 08:42:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:42:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43188628
Sat 18 Jan 2014 08:42:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:42:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:42:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:42:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:42:26 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:42:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:42:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 08:42:27 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:42:27 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:42:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 08:42:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8120 values 128058 bits 16007 bytes 
Sat 18 Jan 2014 08:42:36 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:42:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:42:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:42:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:42:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:42:41 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:42:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:42:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:42:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:42:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:42:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:42:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:42:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:42:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:42:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:42:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:42:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:42:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:42:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:42:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:42:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:42:44 - job_xml_thread(): Done retrieving: data size 43699815
Sat 18 Jan 2014 08:42:44 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:42:44 - XML: Start document: iteration 20
Sat 18 Jan 2014 08:42:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43699815
Sat 18 Jan 2014 08:42:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:42:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43699815
Sat 18 Jan 2014 08:42:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:42:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:42:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:42:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:42:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:43:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:43:03 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:43:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:43:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:43:04 - XML: Processed 653698 elements - found 497 jobs
Sat 18 Jan 2014 08:43:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:43:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:43:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:43:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:43:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:43:04 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:43:04 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:43:04 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:43:04 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:43:05 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:43:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 08:43:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:43:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:43:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:43:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:43:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:43:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:43:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:43:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:43:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:43:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:43:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43808788
Sat 18 Jan 2014 08:43:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:43:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43808788
Sat 18 Jan 2014 08:43:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:43:19 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:43:19 - job_xml_thread(): Done retrieving: data size 43808788
Sat 18 Jan 2014 08:43:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:43:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:43:19 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:43:19 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 08:43:20 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 08:43:20 - Housekeeping: done.
Sat 18 Jan 2014 08:43:20 - XML: Start document: iteration 0
Sat 18 Jan 2014 08:43:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:43:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:43:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:43:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:43:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:43:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:43:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:43:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:43:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:43:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:43:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:43:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:43:27 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:43:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:43:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 08:43:28 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:43:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5660 values 89209 bits 11151 bytes 
Sat 18 Jan 2014 08:43:28 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:43:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 08:43:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:43:34 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:43:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:43:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:43:35 - XML: Processed 655200 elements - found 497 jobs
Sat 18 Jan 2014 08:43:35 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:43:35 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:43:35 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:43:35 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:43:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:43:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:43:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:43:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:43:37 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 08:43:37 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 08:43:37 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:43:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:43:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43777991
Sat 18 Jan 2014 08:43:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:43:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43777991
Sat 18 Jan 2014 08:43:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:43:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:43:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:43:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:43:47 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:43:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:43:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:43:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:43:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:43:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:43:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:43:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:43:50 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:43:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:43:50 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:43:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:43:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:43:50 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:43:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 08:43:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:43:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:43:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:43:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:43:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:43:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:43:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43823807
Sat 18 Jan 2014 08:43:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:43:52 - job_xml_thread(): Done retrieving: data size 43823807
Sat 18 Jan 2014 08:43:52 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:43:52 - XML: Start document: iteration 1
Sat 18 Jan 2014 08:43:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43823807
Sat 18 Jan 2014 08:43:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:44:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:44:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:44:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:44:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:44:08 - XML: Processed 655198 elements - found 496 jobs
Sat 18 Jan 2014 08:44:08 - job 7346480 appears to have finished
Sat 18 Jan 2014 08:44:08 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 08:44:08 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 08:44:09 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 08:44:09 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:44:09 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:44:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:44:14 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:44:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:44:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:44:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:44:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:44:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:44:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:44:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:44:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:44:16 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:44:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:44:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:44:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:44:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:44:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:44:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:44:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:44:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43818171
Sat 18 Jan 2014 08:44:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:44:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43818171
Sat 18 Jan 2014 08:44:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:44:24 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:44:24 - job_xml_thread(): Done retrieving: data size 43818171
Sat 18 Jan 2014 08:44:24 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:44:24 - XML: Start document: iteration 2
Sat 18 Jan 2014 08:44:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:44:28 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:44:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:44:29 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:44:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:44:29 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:44:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 08:44:29 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:44:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:44:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:44:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 08:44:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8898 values 140263 bits 17532 bytes 
Sat 18 Jan 2014 08:44:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:44:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:44:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:44:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:44:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:44:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:44:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:44:39 - XML: Processed 655195 elements - found 496 jobs
Sat 18 Jan 2014 08:44:39 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:44:39 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:44:39 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:44:39 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:44:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:44:40 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:44:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:44:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:44:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:44:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:44:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:44:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:44:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:44:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43803448
Sat 18 Jan 2014 08:44:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:44:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43803448
Sat 18 Jan 2014 08:44:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:44:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:44:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:44:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:44:53 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:44:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:44:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:44:55 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:44:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:44:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:44:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:44:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:44:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:44:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:44:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:44:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:44:57 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:44:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:44:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:44:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:44:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:44:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:44:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:44:57 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:44:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 08:44:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:44:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:44:59 - job_xml_thread(): Done retrieving: data size 43836518
Sat 18 Jan 2014 08:44:59 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:44:59 - XML: Start document: iteration 3
Sat 18 Jan 2014 08:44:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43836518
Sat 18 Jan 2014 08:44:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43836518
Sat 18 Jan 2014 08:45:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:45:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:45:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:45:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:45:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:45:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:45:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:45:18 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:45:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:45:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:45:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:45:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:45:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:45:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:45:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:45:20 - XML: Processed 655196 elements - found 496 jobs
Sat 18 Jan 2014 08:45:20 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:45:20 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:45:20 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:45:20 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:45:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:45:22 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:45:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:45:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:45:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:45:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:45:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:45:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:45:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:45:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43816748
Sat 18 Jan 2014 08:45:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:45:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43816748
Sat 18 Jan 2014 08:45:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:45:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:45:30 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:45:32 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:45:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:45:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 08:45:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 08:45:32 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:45:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8902 values 140390 bits 17548 bytes 
Sat 18 Jan 2014 08:45:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:45:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:45:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:45:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:45:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:45:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:45:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:45:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:45:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:45:35 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:45:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:45:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:45:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:45:39 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:45:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:45:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:45:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:45:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:45:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:45:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:45:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:45:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43812051
Sat 18 Jan 2014 08:45:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:45:42 - job_xml_thread(): Done retrieving: data size 43812051
Sat 18 Jan 2014 08:45:42 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:45:42 - XML: Start document: iteration 4
Sat 18 Jan 2014 08:45:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43812051
Sat 18 Jan 2014 08:45:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:45:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:45:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:45:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:45:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:45:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:45:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:45:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:45:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:45:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:45:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:45:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:45:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:45:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:45:57 - XML: Processed 655198 elements - found 496 jobs
Sat 18 Jan 2014 08:45:57 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:45:57 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:45:57 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:45:57 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:45:59 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:45:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 08:45:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:46:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:46:01 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:46:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:46:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:46:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:46:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:46:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:46:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:46:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:46:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43812917
Sat 18 Jan 2014 08:46:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:46:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43812917
Sat 18 Jan 2014 08:46:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:46:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:46:11 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:46:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:46:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:46:12 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:46:12 - job_xml_thread(): Done retrieving: data size 43812917
Sat 18 Jan 2014 08:46:12 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:46:12 - XML: Start document: iteration 5
Sat 18 Jan 2014 08:46:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:46:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:46:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:46:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:46:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:46:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:46:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:46:17 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 08:46:17 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:46:18 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:46:18 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 08:46:18 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 08:46:18 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:46:18 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 08:46:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:46:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:46:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:46:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:46:26 - XML: Processed 655198 elements - found 496 jobs
Sat 18 Jan 2014 08:46:26 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:46:26 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:46:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:46:26 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:46:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:46:26 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:46:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:46:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:46:26 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 843904 values 13305718 bits 1663214 bytes 
Sat 18 Jan 2014 08:46:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:46:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:46:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:46:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43793216
Sat 18 Jan 2014 08:46:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:46:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43793216
Sat 18 Jan 2014 08:46:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:46:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:46:32 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:46:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:46:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 08:46:33 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:46:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 08:46:33 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:46:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8911 values 140745 bits 17593 bytes 
Sat 18 Jan 2014 08:46:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:46:39 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:46:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:46:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:46:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:46:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:46:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:46:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:46:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43793216
Sat 18 Jan 2014 08:46:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:46:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:46:41 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:46:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:46:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:46:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:46:48 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:46:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:46:53 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:46:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:46:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:46:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:46:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:46:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:46:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:46:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:46:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:46:55 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:46:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 08:46:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:46:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:46:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:46:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:46:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:46:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:46:56 - job_xml_thread(): Done retrieving: data size 43796679
Sat 18 Jan 2014 08:46:56 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:46:56 - XML: Start document: iteration 6
Sat 18 Jan 2014 08:46:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43796679
Sat 18 Jan 2014 08:46:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43796679
Sat 18 Jan 2014 08:46:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:46:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:47:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:47:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:47:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:47:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:47:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:47:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:47:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:47:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:47:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:47:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:47:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:47:16 - XML: Processed 655198 elements - found 496 jobs
Sat 18 Jan 2014 08:47:16 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:47:16 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:47:16 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:47:16 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:47:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:47:18 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:47:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:47:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:47:19 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:47:19 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 08:47:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:47:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:47:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:47:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:47:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:47:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43731865
Sat 18 Jan 2014 08:47:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:47:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43731865
Sat 18 Jan 2014 08:47:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:47:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:47:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:47:31 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:47:31 - job_xml_thread(): Done retrieving: data size 43731865
Sat 18 Jan 2014 08:47:31 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:47:31 - XML: Start document: iteration 7
Sat 18 Jan 2014 08:47:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:47:32 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:47:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:47:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:47:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:47:33 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:47:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:47:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:47:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:47:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:47:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:47:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:47:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 08:47:33 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:47:33 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:47:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 08:47:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6396 values 101211 bits 12651 bytes 
Sat 18 Jan 2014 08:47:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:47:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:47:43 - XML: Processed 654450 elements - found 496 jobs
Sat 18 Jan 2014 08:47:43 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:47:43 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:47:43 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:47:43 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:47:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:47:46 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:47:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:47:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:47:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:47:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:47:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:47:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:47:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:47:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:47:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:47:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43231626
Sat 18 Jan 2014 08:47:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:47:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43231626
Sat 18 Jan 2014 08:47:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:47:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:47:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:47:58 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:47:58 - job_xml_thread(): Done retrieving: data size 43231626
Sat 18 Jan 2014 08:47:58 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:47:58 - XML: Start document: iteration 8
Sat 18 Jan 2014 08:47:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:47:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:47:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:48:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:48:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:48:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:48:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:48:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:48:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:48:11 - XML: Processed 648270 elements - found 496 jobs
Sat 18 Jan 2014 08:48:11 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:48:11 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:48:11 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:48:11 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:48:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:48:12 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:48:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:48:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:48:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:48:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:48:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:48:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:48:13 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:48:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 08:48:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:48:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:48:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:48:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:48:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43132400
Sat 18 Jan 2014 08:48:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:48:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43132400
Sat 18 Jan 2014 08:48:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:48:26 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:48:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:48:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:48:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:48:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:48:31 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:48:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:48:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:48:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:48:32 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:48:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:48:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:48:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:48:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:48:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:48:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:48:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:48:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:48:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:48:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:48:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:48:33 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:48:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:48:34 - job_xml_thread(): Done retrieving: data size 43478124
Sat 18 Jan 2014 08:48:34 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:48:34 - XML: Start document: iteration 9
Sat 18 Jan 2014 08:48:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43478124
Sat 18 Jan 2014 08:48:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43478124
Sat 18 Jan 2014 08:48:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:48:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:48:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:48:35 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:48:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 08:48:35 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:48:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 08:48:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5708 values 90190 bits 11273 bytes 
Sat 18 Jan 2014 08:48:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:48:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:48:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:48:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:48:55 - XML: Processed 651106 elements - found 496 jobs
Sat 18 Jan 2014 08:48:55 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:48:55 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:48:55 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:48:55 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:48:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:48:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:48:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:48:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:48:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:48:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:48:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:48:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:48:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:48:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:48:59 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:48:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:48:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:48:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:48:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:48:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:48:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:49:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:49:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43798948
Sat 18 Jan 2014 08:49:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:49:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43798948
Sat 18 Jan 2014 08:49:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:49:10 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:49:10 - job_xml_thread(): Done retrieving: data size 43798948
Sat 18 Jan 2014 08:49:10 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:49:10 - XML: Start document: iteration 10
Sat 18 Jan 2014 08:49:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:49:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:49:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:49:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:49:20 - XML: Processed 654797 elements - found 496 jobs
Sat 18 Jan 2014 08:49:20 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:49:20 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:49:20 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:49:20 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:49:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:49:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:49:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:49:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:49:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:49:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:49:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:49:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:49:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:49:24 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:49:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 08:49:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:49:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:49:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:49:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:49:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:49:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:49:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:49:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:49:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:49:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:49:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43812491
Sat 18 Jan 2014 08:49:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:49:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43812491
Sat 18 Jan 2014 08:49:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:49:35 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:49:35 - job_xml_thread(): Done retrieving: data size 43812491
Sat 18 Jan 2014 08:49:35 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:49:35 - XML: Start document: iteration 11
Sat 18 Jan 2014 08:49:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:49:35 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:49:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:49:35 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:49:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 08:49:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 08:49:35 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:49:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:49:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:49:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5908 values 93246 bits 11655 bytes 
Sat 18 Jan 2014 08:49:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:49:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:49:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:49:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:49:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:49:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:49:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:49:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:49:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:49:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:49:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:49:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:49:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:49:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:49:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:49:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:49:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:49:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:49:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:49:51 - XML: Processed 655194 elements - found 494 jobs
Sat 18 Jan 2014 08:49:51 - job 7346476 appears to have finished
Sat 18 Jan 2014 08:49:51 - job 7346477 appears to have finished
Sat 18 Jan 2014 08:49:51 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 08:49:51 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 08:49:51 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 08:49:51 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:49:51 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:49:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:49:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43789784
Sat 18 Jan 2014 08:49:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:49:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43789784
Sat 18 Jan 2014 08:49:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:49:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:49:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:50:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:50:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:50:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:50:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:50:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:50:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:50:05 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:50:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 08:50:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:50:06 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:50:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:50:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:50:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:50:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:50:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:50:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:50:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:50:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:50:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:50:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:50:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:50:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:50:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:50:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:50:12 - job_xml_thread(): Done retrieving: data size 43811262
Sat 18 Jan 2014 08:50:12 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:50:12 - XML: Start document: iteration 12
Sat 18 Jan 2014 08:50:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43811262
Sat 18 Jan 2014 08:50:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:50:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43811262
Sat 18 Jan 2014 08:50:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:50:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:50:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:50:25 - XML: Processed 655194 elements - found 494 jobs
Sat 18 Jan 2014 08:50:25 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:50:25 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:50:25 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:50:25 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:50:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:50:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:50:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:50:33 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:50:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:50:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:50:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:50:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:50:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:50:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:50:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:50:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:50:35 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:50:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:50:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:50:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:50:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:50:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:50:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:50:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:50:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:50:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:50:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 08:50:36 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:50:36 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:50:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 08:50:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5819 values 91790 bits 11473 bytes 
Sat 18 Jan 2014 08:50:38 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 08:50:38 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 08:50:38 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:50:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:50:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43812936
Sat 18 Jan 2014 08:50:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:50:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43812936
Sat 18 Jan 2014 08:50:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:50:40 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:50:40 - job_xml_thread(): Done retrieving: data size 43812936
Sat 18 Jan 2014 08:50:40 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:50:40 - XML: Start document: iteration 13
Sat 18 Jan 2014 08:50:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:50:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:50:50 - XML: Processed 655194 elements - found 494 jobs
Sat 18 Jan 2014 08:50:50 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:50:50 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:50:50 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:50:50 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:50:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:50:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:50:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:50:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:50:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:50:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:50:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:50:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:50:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:50:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:50:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:51:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:51:01 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:51:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:51:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:51:01 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:51:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 08:51:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:51:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:51:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:51:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:51:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:51:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:51:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43830464
Sat 18 Jan 2014 08:51:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:51:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43830464
Sat 18 Jan 2014 08:51:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:51:05 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:51:05 - job_xml_thread(): Done retrieving: data size 43830464
Sat 18 Jan 2014 08:51:05 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:51:05 - XML: Start document: iteration 14
Sat 18 Jan 2014 08:51:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:51:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:51:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:51:17 - XML: Processed 655194 elements - found 494 jobs
Sat 18 Jan 2014 08:51:17 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:51:17 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:51:17 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:51:17 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:51:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:51:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:51:20 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:51:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:51:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:51:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:51:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:51:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:51:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:51:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:51:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:51:23 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:51:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:51:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:51:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:51:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:51:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:51:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:51:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:51:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43810086
Sat 18 Jan 2014 08:51:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:51:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43810086
Sat 18 Jan 2014 08:51:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:51:33 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:51:33 - job_xml_thread(): Done retrieving: data size 43810086
Sat 18 Jan 2014 08:51:33 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:51:34 - XML: Start document: iteration 15
Sat 18 Jan 2014 08:51:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:51:37 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:51:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:51:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:51:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:51:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 08:51:38 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:51:38 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:51:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 08:51:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8715 values 137456 bits 17182 bytes 
Sat 18 Jan 2014 08:51:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:51:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:51:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:51:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:51:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:51:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:51:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:51:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:51:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:51:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:51:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:51:44 - XML: Processed 655192 elements - found 493 jobs
Sat 18 Jan 2014 08:51:44 - job 7346474 appears to have finished
Sat 18 Jan 2014 08:51:44 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 08:51:44 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 08:51:44 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 08:51:44 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:51:44 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:51:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:51:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:51:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:51:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:51:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:51:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:51:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:51:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:51:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:51:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43819341
Sat 18 Jan 2014 08:51:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:51:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43819341
Sat 18 Jan 2014 08:51:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:51:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:51:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:51:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:51:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:51:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:51:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:51:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:51:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43819341
Sat 18 Jan 2014 08:51:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:51:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:51:59 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:51:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:52:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:52:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:52:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:52:05 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:52:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:52:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:52:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:52:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:52:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:52:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:52:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:52:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:52:09 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:52:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 08:52:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:52:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:52:10 - job_xml_thread(): Done retrieving: data size 43790496
Sat 18 Jan 2014 08:52:10 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:52:10 - XML: Start document: iteration 16
Sat 18 Jan 2014 08:52:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43790496
Sat 18 Jan 2014 08:52:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:52:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:52:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:52:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:52:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:52:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:52:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:52:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43790496
Sat 18 Jan 2014 08:52:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:52:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:52:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:52:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:52:27 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:52:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:52:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:52:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:52:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:52:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:52:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:52:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:52:31 - XML: Processed 655192 elements - found 493 jobs
Sat 18 Jan 2014 08:52:31 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:52:31 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:52:31 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:52:32 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:52:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:52:33 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:52:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:52:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:52:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:52:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:52:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:52:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:52:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:52:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43818385
Sat 18 Jan 2014 08:52:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:52:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43818385
Sat 18 Jan 2014 08:52:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:52:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:52:39 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:52:40 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:52:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 08:52:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:52:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 08:52:40 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:52:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8976 values 141554 bits 17694 bytes 
Sat 18 Jan 2014 08:52:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:52:44 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:52:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:52:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:52:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:52:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:52:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:52:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:52:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:52:47 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:52:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:52:48 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:52:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:52:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:52:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:52:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:52:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:52:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:52:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:52:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43816968
Sat 18 Jan 2014 08:52:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:52:51 - job_xml_thread(): Done retrieving: data size 43816968
Sat 18 Jan 2014 08:52:51 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:52:51 - XML: Start document: iteration 17
Sat 18 Jan 2014 08:52:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43816968
Sat 18 Jan 2014 08:52:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:53:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:53:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:53:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:53:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:53:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:53:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:53:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:53:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:53:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:53:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:53:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:53:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:53:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:53:12 - XML: Processed 655192 elements - found 493 jobs
Sat 18 Jan 2014 08:53:12 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:53:12 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:53:13 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:53:13 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:53:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:53:14 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:53:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:53:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:53:14 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:53:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 08:53:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:53:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:53:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:53:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:53:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:53:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:53:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43742106
Sat 18 Jan 2014 08:53:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:53:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43742106
Sat 18 Jan 2014 08:53:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:53:19 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 08:53:19 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:53:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:53:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:53:20 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:53:20 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:53:20 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 08:53:21 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 08:53:21 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 08:53:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:53:27 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:53:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:53:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:53:28 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:53:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:53:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:53:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:53:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:53:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:53:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:53:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:53:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:53:31 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:53:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:53:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:53:32 - size of cluster 'LISA Cluster': 624 hosts 79485 metrics 827060 values 13051313 bits 1631414 bytes 
Sat 18 Jan 2014 08:53:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:53:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:53:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:53:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:53:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:53:35 - job_xml_thread(): Done retrieving: data size 43328766
Sat 18 Jan 2014 08:53:35 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:53:35 - XML: Start document: iteration 18
Sat 18 Jan 2014 08:53:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43328766
Sat 18 Jan 2014 08:53:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:53:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43328766
Sat 18 Jan 2014 08:53:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:53:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:53:40 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:53:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:53:41 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:53:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 08:53:41 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:53:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 08:53:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8904 values 140409 bits 17551 bytes 
Sat 18 Jan 2014 08:53:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:53:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:53:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:53:44 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:53:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:53:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:53:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:53:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:53:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:53:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:53:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:53:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:53:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:53:57 - XML: Processed 649344 elements - found 493 jobs
Sat 18 Jan 2014 08:53:57 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:53:57 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:53:57 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:53:57 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:53:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:53:57 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:53:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:53:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:53:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:53:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:53:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:53:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:54:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:54:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:54:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:54:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43176396
Sat 18 Jan 2014 08:54:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:54:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43176396
Sat 18 Jan 2014 08:54:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:54:12 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:54:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:54:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:54:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:54:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:54:14 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:54:14 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:54:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 08:54:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:54:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:54:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:54:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:54:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:54:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:54:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:54:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:54:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:54:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:54:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:54:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:54:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:54:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:54:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:54:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:54:20 - job_xml_thread(): Done retrieving: data size 43181186
Sat 18 Jan 2014 08:54:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43181186
Sat 18 Jan 2014 08:54:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:54:20 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:54:20 - XML: Start document: iteration 19
Sat 18 Jan 2014 08:54:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43181186
Sat 18 Jan 2014 08:54:21 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:54:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:54:21 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 08:54:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:54:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:54:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:54:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:54:36 - XML: Processed 647464 elements - found 493 jobs
Sat 18 Jan 2014 08:54:36 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:54:36 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:54:36 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:54:36 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:54:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:54:39 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:54:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:54:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:54:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:54:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:54:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:54:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:54:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:54:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:54:41 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:54:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:54:41 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:54:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 08:54:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 08:54:41 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:54:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6156 values 97122 bits 12140 bytes 
Sat 18 Jan 2014 08:54:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:54:43 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:54:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:54:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:54:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:54:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:54:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:54:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:54:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:54:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43753512
Sat 18 Jan 2014 08:54:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:54:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43753512
Sat 18 Jan 2014 08:54:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:54:51 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:54:51 - job_xml_thread(): Done retrieving: data size 43753512
Sat 18 Jan 2014 08:54:51 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:54:51 - XML: Start document: iteration 20
Sat 18 Jan 2014 08:54:54 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:54:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 08:54:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:54:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:54:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:54:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:54:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:55:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:55:03 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:55:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:55:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:55:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:55:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:55:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:55:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:55:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:55:06 - XML: Processed 654396 elements - found 493 jobs
Sat 18 Jan 2014 08:55:06 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:55:06 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:55:06 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:55:06 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:55:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:55:10 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:55:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:55:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:55:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:55:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:55:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:55:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:55:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:55:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43805460
Sat 18 Jan 2014 08:55:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:55:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43805460
Sat 18 Jan 2014 08:55:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:55:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:55:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:55:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:55:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:55:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:55:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:55:21 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:55:21 - job_xml_thread(): Done retrieving: data size 43805460
Sat 18 Jan 2014 08:55:21 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:55:22 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 08:55:22 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 08:55:22 - Housekeeping: done.
Sat 18 Jan 2014 08:55:22 - XML: Start document: iteration 0
Sat 18 Jan 2014 08:55:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:55:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:55:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:55:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:55:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43805460
Sat 18 Jan 2014 08:55:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:55:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:55:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:55:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:55:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:55:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:55:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:55:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:55:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:55:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:55:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:55:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:55:39 - XML: Processed 655192 elements - found 493 jobs
Sat 18 Jan 2014 08:55:39 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:55:39 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:55:39 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:55:39 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:55:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:55:41 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:55:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:55:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:55:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:55:41 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:55:42 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:55:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:55:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 08:55:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 08:55:42 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:55:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6187 values 97613 bits 12201 bytes 
Sat 18 Jan 2014 08:55:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:55:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:55:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:55:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:55:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:55:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43817203
Sat 18 Jan 2014 08:55:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:55:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43817203
Sat 18 Jan 2014 08:55:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:55:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:55:54 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:55:54 - job_xml_thread(): Done retrieving: data size 43817203
Sat 18 Jan 2014 08:55:54 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:55:54 - XML: Start document: iteration 1
Sat 18 Jan 2014 08:55:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:55:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:55:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:55:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:55:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:55:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:55:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:55:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:55:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:55:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:55:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:55:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:56:02 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:56:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 08:56:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:56:05 - XML: Processed 655190 elements - found 492 jobs
Sat 18 Jan 2014 08:56:05 - job 7346471 appears to have finished
Sat 18 Jan 2014 08:56:05 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 08:56:05 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 08:56:06 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 08:56:06 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:56:06 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:56:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:56:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:56:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:56:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:56:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:56:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:56:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:56:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:56:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:56:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43796558
Sat 18 Jan 2014 08:56:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:56:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43796558
Sat 18 Jan 2014 08:56:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:56:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:56:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:56:21 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:56:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:56:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:56:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:56:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:56:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:56:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:56:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:56:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:56:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:56:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:56:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:56:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:56:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:56:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:56:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:56:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:56:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:56:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:56:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:56:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:56:29 - job_xml_thread(): Done retrieving: data size 43822551
Sat 18 Jan 2014 08:56:29 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:56:29 - XML: Start document: iteration 2
Sat 18 Jan 2014 08:56:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43822551
Sat 18 Jan 2014 08:56:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:56:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43822551
Sat 18 Jan 2014 08:56:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:56:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:56:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:56:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:56:42 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:56:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:56:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:56:43 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:56:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:56:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 08:56:43 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:56:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 08:56:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9207 values 145254 bits 18156 bytes 
Sat 18 Jan 2014 08:56:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:56:48 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:56:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:56:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:56:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:56:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:56:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:56:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:56:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:56:49 - XML: Processed 655190 elements - found 492 jobs
Sat 18 Jan 2014 08:56:49 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:56:49 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:56:49 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:56:50 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:56:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:56:54 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:56:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:56:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:56:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:56:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:56:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:56:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:56:57 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:56:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 08:56:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:56:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:56:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43813591
Sat 18 Jan 2014 08:56:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:56:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43813591
Sat 18 Jan 2014 08:56:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:57:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:57:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:57:05 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:57:05 - job_xml_thread(): Done retrieving: data size 43813591
Sat 18 Jan 2014 08:57:05 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:57:05 - XML: Start document: iteration 3
Sat 18 Jan 2014 08:57:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:57:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:57:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:57:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:57:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:57:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:57:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:57:18 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:57:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:57:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:57:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:57:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:57:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:57:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:57:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:57:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:57:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:57:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:57:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:57:21 - XML: Processed 655190 elements - found 492 jobs
Sat 18 Jan 2014 08:57:21 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:57:21 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:57:21 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:57:21 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:57:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:57:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43817182
Sat 18 Jan 2014 08:57:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:57:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43817182
Sat 18 Jan 2014 08:57:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:57:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:57:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:57:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:57:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:57:36 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:57:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:57:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:57:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:57:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:57:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:57:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:57:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:57:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:57:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:57:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:57:38 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:57:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:57:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:57:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:57:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:57:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:57:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:57:40 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 08:57:40 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 08:57:40 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:57:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:57:41 - job_xml_thread(): Done retrieving: data size 43822186
Sat 18 Jan 2014 08:57:41 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:57:41 - XML: Start document: iteration 4
Sat 18 Jan 2014 08:57:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43822186
Sat 18 Jan 2014 08:57:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:57:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43822186
Sat 18 Jan 2014 08:57:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:57:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:57:43 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:57:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:57:43 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:57:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 08:57:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 08:57:43 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:57:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8656 values 136620 bits 17077 bytes 
Sat 18 Jan 2014 08:57:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:57:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:57:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:57:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:57:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:57:56 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:57:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:57:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:57:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:57:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:57:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:57:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:57:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:58:02 - XML: Processed 655190 elements - found 492 jobs
Sat 18 Jan 2014 08:58:02 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:58:02 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:58:02 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:58:02 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:58:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:58:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:58:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:58:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:58:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:58:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:58:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:58:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:58:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:58:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43795570
Sat 18 Jan 2014 08:58:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:58:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43795570
Sat 18 Jan 2014 08:58:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:58:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:58:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:58:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:58:15 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:58:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:58:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:58:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:58:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:58:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:58:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:58:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:58:17 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:58:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:58:19 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:58:19 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:58:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 08:58:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:58:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:58:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:58:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:58:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:58:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:58:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:58:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:58:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43811836
Sat 18 Jan 2014 08:58:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:58:24 - job_xml_thread(): Done retrieving: data size 43811836
Sat 18 Jan 2014 08:58:24 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:58:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43811836
Sat 18 Jan 2014 08:58:25 - XML: Start document: iteration 5
Sat 18 Jan 2014 08:58:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:58:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:58:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:58:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:58:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:58:39 - XML: Processed 655190 elements - found 492 jobs
Sat 18 Jan 2014 08:58:39 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:58:39 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:58:39 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:58:39 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:58:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:58:43 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:58:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:58:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 08:58:43 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:58:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5970 values 94164 bits 11770 bytes 
Sat 18 Jan 2014 08:58:43 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:58:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 08:58:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:58:44 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:58:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:58:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:58:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:58:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:58:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:58:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:58:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:58:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:58:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:58:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:58:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:58:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:58:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:58:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:58:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:58:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:58:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43823111
Sat 18 Jan 2014 08:58:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:58:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43823111
Sat 18 Jan 2014 08:58:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:58:54 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:58:54 - job_xml_thread(): Done retrieving: data size 43823111
Sat 18 Jan 2014 08:58:54 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:58:54 - XML: Start document: iteration 6
Sat 18 Jan 2014 08:58:56 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:58:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 08:58:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:59:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:59:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:59:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:59:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:59:04 - XML: Processed 655190 elements - found 492 jobs
Sat 18 Jan 2014 08:59:05 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:59:05 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:59:05 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:59:05 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:59:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:59:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:59:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:59:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:59:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:59:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:59:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:59:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:59:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:59:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:59:10 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:59:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:59:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:59:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:59:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:59:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:59:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:59:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:59:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43759340
Sat 18 Jan 2014 08:59:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:59:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43759340
Sat 18 Jan 2014 08:59:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:59:20 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:59:20 - job_xml_thread(): Done retrieving: data size 43759340
Sat 18 Jan 2014 08:59:20 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:59:20 - XML: Start document: iteration 7
Sat 18 Jan 2014 08:59:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:59:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:59:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:59:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:59:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:59:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:59:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:59:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:59:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:59:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:59:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:59:33 - XML: Processed 654442 elements - found 492 jobs
Sat 18 Jan 2014 08:59:33 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 08:59:33 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 08:59:33 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 08:59:33 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 08:59:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:59:34 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:59:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:59:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:59:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:59:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:59:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:59:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:59:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:59:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43345200
Sat 18 Jan 2014 08:59:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 08:59:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43345200
Sat 18 Jan 2014 08:59:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:59:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:59:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:59:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 08:59:43 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:59:45 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:59:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 08:59:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:59:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 08:59:45 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 08:59:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9375 values 147970 bits 18496 bytes 
Sat 18 Jan 2014 08:59:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 08:59:48 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 08:59:48 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 08:59:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 08:59:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 08:59:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 08:59:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:59:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 08:59:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 08:59:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 08:59:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 08:59:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 08:59:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 08:59:52 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 08:59:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 08:59:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 08:59:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:59:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 08:59:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 08:59:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 08:59:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 08:59:54 - job_xml_thread(): Done retrieving: data size 43157264
Sat 18 Jan 2014 08:59:54 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 08:59:54 - XML: Start document: iteration 8
Sat 18 Jan 2014 08:59:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43157264
Sat 18 Jan 2014 08:59:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43157264
Sat 18 Jan 2014 08:59:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 08:59:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:00:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:00:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:00:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:00:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:00:11 - XML: Processed 647124 elements - found 491 jobs
Sat 18 Jan 2014 09:00:11 - job 7348693 appears to have finished
Sat 18 Jan 2014 09:00:11 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 09:00:11 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 09:00:13 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 09:00:13 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:00:13 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:00:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:00:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:00:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:00:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:00:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:00:18 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:00:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:00:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:00:18 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:00:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 09:00:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:00:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:00:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:00:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:00:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:00:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:00:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:00:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:00:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:00:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:00:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:00:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43213005
Sat 18 Jan 2014 09:00:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:00:21 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 09:00:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43213005
Sat 18 Jan 2014 09:00:21 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:00:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:00:23 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:00:23 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:00:23 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 09:00:23 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 09:00:23 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 09:00:28 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:00:28 - job_xml_thread(): Done retrieving: data size 43213005
Sat 18 Jan 2014 09:00:28 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:00:28 - XML: Start document: iteration 9
Sat 18 Jan 2014 09:00:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:00:29 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:00:32 - size of cluster 'LISA Cluster': 624 hosts 79461 metrics 743593 values 11720369 bits 1465046 bytes 
Sat 18 Jan 2014 09:00:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:00:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:00:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:00:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:00:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:00:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:00:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:00:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:00:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:00:40 - XML: Processed 647736 elements - found 491 jobs
Sat 18 Jan 2014 09:00:40 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:00:40 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:00:40 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:00:40 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:00:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:00:43 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:00:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:00:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:00:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:00:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:00:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:00:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:00:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:00:45 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:00:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:00:45 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:00:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 09:00:45 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:00:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 09:00:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5760 values 90819 bits 11352 bytes 
Sat 18 Jan 2014 09:00:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:00:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43679259
Sat 18 Jan 2014 09:00:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:00:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43679259
Sat 18 Jan 2014 09:00:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:00:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:00:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:00:55 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:00:55 - job_xml_thread(): Done retrieving: data size 43679259
Sat 18 Jan 2014 09:00:55 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:00:56 - XML: Start document: iteration 10
Sat 18 Jan 2014 09:00:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:00:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:01:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:01:02 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:01:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:01:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:01:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:01:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:01:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:01:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:01:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:01:04 - XML: Processed 653743 elements - found 491 jobs
Sat 18 Jan 2014 09:01:04 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:01:04 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:01:04 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:01:04 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:01:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:01:05 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:01:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:01:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:01:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:01:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:01:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:01:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:01:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:01:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43811717
Sat 18 Jan 2014 09:01:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:01:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43811717
Sat 18 Jan 2014 09:01:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:01:11 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:01:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 09:01:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:01:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:01:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:01:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:01:20 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:01:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:01:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:01:20 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:01:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:01:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:01:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:01:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:01:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:01:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:01:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:01:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:01:23 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:01:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:01:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:01:23 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:01:23 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 09:01:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:01:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:01:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:01:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:01:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:01:26 - job_xml_thread(): Done retrieving: data size 43814515
Sat 18 Jan 2014 09:01:26 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:01:26 - XML: Start document: iteration 11
Sat 18 Jan 2014 09:01:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43814515
Sat 18 Jan 2014 09:01:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:01:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43814515
Sat 18 Jan 2014 09:01:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:01:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:01:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:01:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:01:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:01:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:01:45 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:01:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:01:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 09:01:45 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:01:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 09:01:45 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:01:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6497 values 102592 bits 12824 bytes 
Sat 18 Jan 2014 09:01:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:01:47 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:01:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:01:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:01:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:01:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:01:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:01:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:01:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:01:50 - XML: Processed 655188 elements - found 491 jobs
Sat 18 Jan 2014 09:01:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:01:50 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:01:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:01:50 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:01:50 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:01:50 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:01:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:01:50 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:01:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:01:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:01:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:01:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:01:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:01:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43812961
Sat 18 Jan 2014 09:01:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:01:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43812961
Sat 18 Jan 2014 09:01:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:01:59 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:01:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 09:01:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:02:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:02:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:02:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:02:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:02:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:02:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:02:05 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:02:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:02:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:02:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:02:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:02:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:02:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:02:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:02:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:02:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:02:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:02:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:02:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:02:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:02:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:02:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:02:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:02:11 - job_xml_thread(): Done retrieving: data size 43825580
Sat 18 Jan 2014 09:02:11 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:02:11 - XML: Start document: iteration 12
Sat 18 Jan 2014 09:02:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43825580
Sat 18 Jan 2014 09:02:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:02:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43825580
Sat 18 Jan 2014 09:02:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:02:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:02:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:02:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:02:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:02:29 - XML: Processed 655188 elements - found 491 jobs
Sat 18 Jan 2014 09:02:29 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:02:29 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:02:29 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:02:29 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:02:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:02:31 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:02:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:02:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:02:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:02:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:02:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:02:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:02:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:02:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:02:34 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:02:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:02:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:02:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:02:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:02:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:02:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:02:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:02:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43817179
Sat 18 Jan 2014 09:02:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:02:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43817179
Sat 18 Jan 2014 09:02:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:02:44 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:02:44 - job_xml_thread(): Done retrieving: data size 43817179
Sat 18 Jan 2014 09:02:44 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:02:44 - XML: Start document: iteration 13
Sat 18 Jan 2014 09:02:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:02:46 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:02:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:02:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:02:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:02:47 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:02:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 09:02:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 09:02:47 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:02:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9172 values 145143 bits 18142 bytes 
Sat 18 Jan 2014 09:02:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:02:49 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:02:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:02:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:02:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:02:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:02:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:02:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:02:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:02:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:02:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:02:56 - XML: Processed 655188 elements - found 491 jobs
Sat 18 Jan 2014 09:02:56 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:02:56 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:02:56 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:02:56 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:03:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:03:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:03:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:03:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:03:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:03:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:03:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:03:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:03:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:03:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43789724
Sat 18 Jan 2014 09:03:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:03:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43789724
Sat 18 Jan 2014 09:03:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:03:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:03:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:03:11 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:03:11 - job_xml_thread(): Done retrieving: data size 43789724
Sat 18 Jan 2014 09:03:11 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:03:11 - XML: Start document: iteration 14
Sat 18 Jan 2014 09:03:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:03:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:03:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:03:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:03:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:03:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:03:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:03:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:03:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:03:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:03:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:03:18 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:03:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 09:03:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:03:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:03:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:03:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:03:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:03:27 - XML: Processed 655188 elements - found 491 jobs
Sat 18 Jan 2014 09:03:27 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:03:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:03:27 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:03:27 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:03:27 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:03:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:03:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:03:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:03:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:03:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43801912
Sat 18 Jan 2014 09:03:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:03:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43801912
Sat 18 Jan 2014 09:03:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:03:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:03:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:03:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:03:42 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:03:43 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:03:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:03:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:03:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:03:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:03:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:03:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:03:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:03:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:03:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:03:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:03:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:03:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:03:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:03:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:03:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:03:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:03:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:03:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:03:48 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:03:48 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:03:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 09:03:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:03:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 09:03:48 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:03:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5905 values 93290 bits 11661 bytes 
Sat 18 Jan 2014 09:03:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:03:49 - job_xml_thread(): Done retrieving: data size 43803205
Sat 18 Jan 2014 09:03:49 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:03:49 - XML: Start document: iteration 15
Sat 18 Jan 2014 09:03:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43803205
Sat 18 Jan 2014 09:03:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:03:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43803205
Sat 18 Jan 2014 09:03:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:03:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:03:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:04:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:04:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:04:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:04:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:04:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:04:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:04:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:04:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:04:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:04:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:04:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:04:12 - XML: Processed 655186 elements - found 490 jobs
Sat 18 Jan 2014 09:04:12 - job 7346468 appears to have finished
Sat 18 Jan 2014 09:04:12 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 09:04:12 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 09:04:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:04:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:04:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:04:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:04:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:04:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:04:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:04:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:04:13 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 09:04:13 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 09:04:13 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:04:14 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 09:04:14 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:04:14 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:04:14 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:04:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 09:04:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:04:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:04:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43826217
Sat 18 Jan 2014 09:04:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:04:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43826217
Sat 18 Jan 2014 09:04:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:04:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:04:25 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:04:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:04:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:04:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:04:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:04:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:04:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:04:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:04:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:04:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:04:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:04:28 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:04:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:04:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:04:29 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:04:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:04:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:04:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:04:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:04:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:04:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43830121
Sat 18 Jan 2014 09:04:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:04:31 - job_xml_thread(): Done retrieving: data size 43830121
Sat 18 Jan 2014 09:04:31 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:04:31 - XML: Start document: iteration 16
Sat 18 Jan 2014 09:04:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43830121
Sat 18 Jan 2014 09:04:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:04:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:04:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:04:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:04:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:04:48 - XML: Processed 655186 elements - found 490 jobs
Sat 18 Jan 2014 09:04:48 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:04:48 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:04:48 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:04:48 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:04:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:04:48 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:04:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:04:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:04:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:04:48 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:04:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:04:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:04:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:04:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:04:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:04:49 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:04:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:04:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 09:04:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 09:04:49 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:04:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7007 values 110532 bits 13816 bytes 
Sat 18 Jan 2014 09:04:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:04:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:04:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:04:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:04:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:04:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:04:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:04:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:04:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:04:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43827216
Sat 18 Jan 2014 09:04:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:04:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43827216
Sat 18 Jan 2014 09:04:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:05:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:05:02 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:05:03 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:05:03 - job_xml_thread(): Done retrieving: data size 43827216
Sat 18 Jan 2014 09:05:03 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:05:03 - XML: Start document: iteration 17
Sat 18 Jan 2014 09:05:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:05:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:05:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:05:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:05:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:05:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:05:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:05:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:05:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:05:12 - XML: Processed 655186 elements - found 490 jobs
Sat 18 Jan 2014 09:05:12 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:05:12 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:05:12 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:05:12 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:05:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:05:14 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:05:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:05:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:05:14 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:05:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 09:05:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:05:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:05:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:05:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:05:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:05:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:05:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43722771
Sat 18 Jan 2014 09:05:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:05:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43722771
Sat 18 Jan 2014 09:05:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:05:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:05:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:05:27 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:05:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:05:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:05:27 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:05:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:05:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:05:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:05:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:05:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:05:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:05:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:05:30 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:05:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:05:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:05:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:05:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:05:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:05:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:05:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:05:31 - job_xml_thread(): Done retrieving: data size 43371952
Sat 18 Jan 2014 09:05:31 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:05:31 - XML: Start document: iteration 18
Sat 18 Jan 2014 09:05:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43371952
Sat 18 Jan 2014 09:05:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:05:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43371952
Sat 18 Jan 2014 09:05:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:05:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:05:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:05:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:05:46 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:05:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:05:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:05:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:05:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:05:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:05:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:05:49 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:05:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:05:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:05:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:05:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:05:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:05:51 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:05:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:05:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 09:05:51 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:05:51 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:05:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 09:05:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8751 values 138019 bits 17252 bytes 
Sat 18 Jan 2014 09:05:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:05:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:05:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:05:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:05:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:05:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:05:52 - XML: Processed 649862 elements - found 490 jobs
Sat 18 Jan 2014 09:05:52 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:05:52 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:05:52 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:05:52 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:05:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:05:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43174925
Sat 18 Jan 2014 09:05:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:05:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43174925
Sat 18 Jan 2014 09:05:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:06:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:06:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:06:08 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:06:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:06:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:06:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:06:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:06:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:06:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:06:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:06:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:06:10 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:06:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:06:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:06:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:06:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:06:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:06:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:06:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:06:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:06:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:06:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:06:11 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:06:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 09:06:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:06:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:06:12 - job_xml_thread(): Done retrieving: data size 43164403
Sat 18 Jan 2014 09:06:12 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:06:12 - XML: Start document: iteration 19
Sat 18 Jan 2014 09:06:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43164403
Sat 18 Jan 2014 09:06:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:06:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43164403
Sat 18 Jan 2014 09:06:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:06:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:06:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:06:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:06:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:06:28 - XML: Processed 647014 elements - found 492 jobs
Sat 18 Jan 2014 09:06:28 - job 7335211 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 09:06:28 - job_xml_thread(): Found 3 updated jobs.
Sat 18 Jan 2014 09:06:28 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 09:06:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:06:32 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:06:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:06:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:06:32 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Sat 18 Jan 2014 09:06:32 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:06:32 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:06:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:06:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:06:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:06:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:06:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:06:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:06:35 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:06:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:06:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:06:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:06:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:06:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:06:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:06:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:06:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43682881
Sat 18 Jan 2014 09:06:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:06:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43682881
Sat 18 Jan 2014 09:06:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:06:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:06:45 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:06:47 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:06:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:06:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:06:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:06:50 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:06:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:06:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:06:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:06:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:06:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:06:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:06:51 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:06:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:06:51 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:06:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 09:06:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 09:06:51 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:06:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8686 values 136936 bits 17117 bytes 
Sat 18 Jan 2014 09:06:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:06:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:06:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:06:52 - job_xml_thread(): Done retrieving: data size 43785972
Sat 18 Jan 2014 09:06:52 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:06:52 - XML: Start document: iteration 20
Sat 18 Jan 2014 09:06:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43785972
Sat 18 Jan 2014 09:06:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:06:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:06:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:06:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:06:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:06:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43785972
Sat 18 Jan 2014 09:06:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:07:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:07:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:07:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:07:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:07:09 - XML: Processed 654800 elements - found 492 jobs
Sat 18 Jan 2014 09:07:09 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:07:09 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:07:09 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:07:09 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:07:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:07:11 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:07:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:07:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:07:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:07:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:07:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:07:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:07:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:07:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:07:14 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:07:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:07:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:07:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:07:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:07:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:07:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:07:15 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:07:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 09:07:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:07:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:07:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43803069
Sat 18 Jan 2014 09:07:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:07:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43803069
Sat 18 Jan 2014 09:07:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:07:24 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 09:07:24 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:07:24 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:07:24 - job_xml_thread(): Done retrieving: data size 43803069
Sat 18 Jan 2014 09:07:24 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:07:24 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 09:07:25 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 09:07:25 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:07:25 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:07:25 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 09:07:25 - Housekeeping: done.
Sat 18 Jan 2014 09:07:25 - XML: Start document: iteration 0
Sat 18 Jan 2014 09:07:25 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 09:07:25 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 09:07:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:07:26 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:07:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:07:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:07:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:07:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:07:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:07:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:07:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:07:28 - size of cluster 'LISA Cluster': 624 hosts 79469 metrics 835180 values 13183896 bits 1647987 bytes 
Sat 18 Jan 2014 09:07:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:07:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:07:39 - XML: Processed 655188 elements - found 492 jobs
Sat 18 Jan 2014 09:07:39 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:07:39 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:07:39 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:07:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:07:39 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:07:39 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:07:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:07:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:07:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:07:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:07:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:07:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:07:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:07:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43786089
Sat 18 Jan 2014 09:07:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:07:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43786089
Sat 18 Jan 2014 09:07:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:07:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:07:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:07:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:07:51 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:07:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:07:52 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:07:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:07:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:07:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:07:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:07:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:07:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:07:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:07:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:07:54 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:07:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 09:07:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 09:07:54 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:07:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6837 values 107815 bits 13476 bytes 
Sat 18 Jan 2014 09:07:54 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:07:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:07:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:07:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:07:58 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:07:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:07:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:07:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:07:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:07:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:07:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:08:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:08:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43800339
Sat 18 Jan 2014 09:08:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:08:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43800339
Sat 18 Jan 2014 09:08:03 - job_xml_thread(): Done retrieving: data size 43800339
Sat 18 Jan 2014 09:08:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:08:04 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:08:04 - XML: Start document: iteration 1
Sat 18 Jan 2014 09:08:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:08:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:08:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:08:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:08:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:08:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:08:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:08:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:08:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:08:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:08:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:08:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:08:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:08:22 - XML: Processed 655182 elements - found 490 jobs
Sat 18 Jan 2014 09:08:22 - job 7335126 appears to have finished
Sat 18 Jan 2014 09:08:22 - job 7348063 appears to have finished
Sat 18 Jan 2014 09:08:22 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 09:08:22 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 09:08:23 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 09:08:23 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:08:23 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:08:24 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:08:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 09:08:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:08:25 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:08:25 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 09:08:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:08:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:08:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:08:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:08:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:08:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:08:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:08:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:08:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:08:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43805236
Sat 18 Jan 2014 09:08:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:08:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43805236
Sat 18 Jan 2014 09:08:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:08:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:08:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:08:38 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:08:38 - job_xml_thread(): Done retrieving: data size 43805236
Sat 18 Jan 2014 09:08:38 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:08:38 - XML: Start document: iteration 2
Sat 18 Jan 2014 09:08:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:08:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:08:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:08:43 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:08:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:08:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:08:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:08:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:08:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:08:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:08:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:08:50 - XML: Processed 655186 elements - found 490 jobs
Sat 18 Jan 2014 09:08:50 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:08:50 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:08:50 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:08:50 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:08:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:08:53 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:08:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:08:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:08:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:08:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:08:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:08:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:08:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:08:54 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:08:54 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:08:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 09:08:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:08:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 09:08:54 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:08:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5898 values 92999 bits 11624 bytes 
Sat 18 Jan 2014 09:08:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:08:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43790556
Sat 18 Jan 2014 09:08:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:08:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43790556
Sat 18 Jan 2014 09:08:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:08:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:09:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:09:05 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:09:05 - job_xml_thread(): Done retrieving: data size 43790556
Sat 18 Jan 2014 09:09:05 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:09:05 - XML: Start document: iteration 3
Sat 18 Jan 2014 09:09:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:09:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:09:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:09:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:09:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:09:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:09:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:09:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:09:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:09:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:09:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:09:18 - XML: Processed 655186 elements - found 490 jobs
Sat 18 Jan 2014 09:09:18 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:09:18 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:09:18 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:09:18 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:09:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:09:19 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:09:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:09:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:09:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:09:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:09:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:09:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:09:22 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:09:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 09:09:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:09:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:09:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43783932
Sat 18 Jan 2014 09:09:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:09:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43783932
Sat 18 Jan 2014 09:09:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:09:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:09:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:09:33 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:09:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:09:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:09:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:09:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:09:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:09:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:09:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:09:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:09:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:09:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:09:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:09:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:09:39 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:09:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:09:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:09:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:09:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:09:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:09:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:09:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:09:42 - job_xml_thread(): Done retrieving: data size 43803779
Sat 18 Jan 2014 09:09:42 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:09:42 - XML: Start document: iteration 4
Sat 18 Jan 2014 09:09:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43803779
Sat 18 Jan 2014 09:09:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:09:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43803779
Sat 18 Jan 2014 09:09:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:09:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:09:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:09:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:09:54 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:09:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:09:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:09:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:09:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 09:09:55 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:09:55 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:09:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 09:09:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7635 values 120357 bits 15044 bytes 
Sat 18 Jan 2014 09:10:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:10:02 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:10:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:10:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:10:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:10:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:10:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:10:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:10:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:10:04 - XML: Processed 655186 elements - found 490 jobs
Sat 18 Jan 2014 09:10:04 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:10:04 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:10:04 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:10:04 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:10:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:10:06 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:10:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:10:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:10:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:10:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:10:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:10:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:10:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:10:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43811789
Sat 18 Jan 2014 09:10:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:10:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43811789
Sat 18 Jan 2014 09:10:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:10:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:10:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:10:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:10:18 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:10:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:10:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:10:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:10:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:10:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:10:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:10:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43811789
Sat 18 Jan 2014 09:10:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:10:19 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:10:19 - job_xml_thread(): Done retrieving: data size 43811789
Sat 18 Jan 2014 09:10:19 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:10:19 - XML: Start document: iteration 5
Sat 18 Jan 2014 09:10:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:10:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:10:32 - XML: Processed 655186 elements - found 490 jobs
Sat 18 Jan 2014 09:10:32 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:10:32 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:10:32 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:10:32 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:10:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:10:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:10:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:10:37 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:10:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:10:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:10:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:10:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:10:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:10:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:10:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:10:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:10:39 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:10:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:10:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:10:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:10:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:10:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:10:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:10:40 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:10:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 09:10:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:10:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:10:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43820472
Sat 18 Jan 2014 09:10:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:10:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43820472
Sat 18 Jan 2014 09:10:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:10:47 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:10:47 - job_xml_thread(): Done retrieving: data size 43820472
Sat 18 Jan 2014 09:10:47 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:10:48 - XML: Start document: iteration 6
Sat 18 Jan 2014 09:10:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:10:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:10:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:10:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:10:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:10:55 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:10:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:10:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 09:10:56 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:10:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 09:10:56 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:10:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5771 values 90981 bits 11372 bytes 
Sat 18 Jan 2014 09:11:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:11:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:11:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:11:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:11:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:11:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:11:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:11:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:11:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:11:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:11:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:11:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:11:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:11:08 - XML: Processed 655186 elements - found 490 jobs
Sat 18 Jan 2014 09:11:08 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:11:08 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:11:08 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:11:08 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:11:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:11:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:11:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:11:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:11:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:11:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43738127
Sat 18 Jan 2014 09:11:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:11:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43738127
Sat 18 Jan 2014 09:11:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:11:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:11:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:11:23 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:11:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:11:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:11:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:11:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:11:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:11:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:11:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:11:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:11:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:11:24 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:11:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 09:11:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:11:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:11:28 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:11:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:11:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:11:28 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 09:11:28 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 09:11:28 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:11:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:11:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:11:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:11:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:11:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:11:30 - job_xml_thread(): Done retrieving: data size 43748995
Sat 18 Jan 2014 09:11:30 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:11:30 - XML: Start document: iteration 7
Sat 18 Jan 2014 09:11:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43748995
Sat 18 Jan 2014 09:11:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43748995
Sat 18 Jan 2014 09:11:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:11:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:11:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:11:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:11:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:11:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:11:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:11:46 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:11:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:11:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:11:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:11:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:11:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:11:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:11:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:11:51 - XML: Processed 654426 elements - found 490 jobs
Sat 18 Jan 2014 09:11:51 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:11:51 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:11:51 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:11:51 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:11:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:11:53 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:11:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:11:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:11:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:11:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:11:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:11:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:11:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:11:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43160362
Sat 18 Jan 2014 09:11:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:11:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43160362
Sat 18 Jan 2014 09:11:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:11:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:11:56 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:11:57 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:11:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:11:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 09:11:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 09:11:58 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:11:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9090 values 143335 bits 17916 bytes 
Sat 18 Jan 2014 09:12:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:12:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:12:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:12:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:12:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:12:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:12:06 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:12:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:12:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:12:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:12:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:12:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:12:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:12:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:12:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:12:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:12:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:12:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:12:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:12:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:12:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:12:10 - job_xml_thread(): Done retrieving: data size 43153231
Sat 18 Jan 2014 09:12:10 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:12:10 - XML: Start document: iteration 8
Sat 18 Jan 2014 09:12:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43153231
Sat 18 Jan 2014 09:12:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:12:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43153231
Sat 18 Jan 2014 09:12:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:12:19 - XML: Processed 647060 elements - found 490 jobs
Sat 18 Jan 2014 09:12:19 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:12:19 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:12:19 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:12:19 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:12:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:12:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:12:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:12:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:12:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:12:31 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:12:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:12:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:12:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:12:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:12:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:12:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:12:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:12:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:12:32 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:12:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:12:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:12:32 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:12:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 09:12:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:12:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:12:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:12:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:12:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:12:34 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:12:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:12:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43624449
Sat 18 Jan 2014 09:12:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:12:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43624449
Sat 18 Jan 2014 09:12:35 - job_xml_thread(): Done retrieving: data size 43624449
Sat 18 Jan 2014 09:12:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:12:35 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:12:35 - XML: Start document: iteration 9
Sat 18 Jan 2014 09:12:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:12:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:12:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:12:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:12:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:12:50 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:12:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:12:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:12:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:12:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:12:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:12:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:12:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:12:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:12:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:12:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:12:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:12:57 - XML: Processed 652840 elements - found 490 jobs
Sat 18 Jan 2014 09:12:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:12:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:12:57 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:12:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:12:57 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:12:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:12:57 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:12:57 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:12:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:12:58 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:12:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:12:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43780375
Sat 18 Jan 2014 09:12:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:12:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43780375
Sat 18 Jan 2014 09:12:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:12:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:12:59 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:12:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 09:12:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 09:13:00 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:13:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9015 values 142235 bits 17779 bytes 
Sat 18 Jan 2014 09:13:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:13:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:13:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:13:11 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:13:12 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:13:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:13:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:13:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:13:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:13:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:13:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:13:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:13:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:13:13 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:13:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:13:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:13:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:13:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:13:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:13:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:13:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:13:16 - job_xml_thread(): Done retrieving: data size 43822509
Sat 18 Jan 2014 09:13:16 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:13:16 - XML: Start document: iteration 10
Sat 18 Jan 2014 09:13:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43822509
Sat 18 Jan 2014 09:13:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:13:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43822509
Sat 18 Jan 2014 09:13:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:13:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:13:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:13:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:13:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:13:35 - XML: Processed 655186 elements - found 490 jobs
Sat 18 Jan 2014 09:13:36 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:13:36 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:13:36 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:13:36 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:13:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:13:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:13:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:13:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:13:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:13:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:13:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:13:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:13:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:13:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:13:41 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:13:41 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:13:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 09:13:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:13:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:13:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:13:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:13:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:13:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:13:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:13:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:13:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43819038
Sat 18 Jan 2014 09:13:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:13:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43819038
Sat 18 Jan 2014 09:13:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:13:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:13:51 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:13:51 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:13:52 - job_xml_thread(): Done retrieving: data size 43819038
Sat 18 Jan 2014 09:13:52 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:13:52 - XML: Start document: iteration 11
Sat 18 Jan 2014 09:13:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:13:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:13:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:13:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:13:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:13:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:13:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:13:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:13:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:14:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:14:00 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:14:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:14:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:14:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:14:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 09:14:00 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:14:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6125 values 96610 bits 12076 bytes 
Sat 18 Jan 2014 09:14:00 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:14:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:14:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:14:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 09:14:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:14:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:14:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:14:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:14:03 - XML: Processed 655186 elements - found 490 jobs
Sat 18 Jan 2014 09:14:03 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:14:03 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:14:03 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:14:03 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:14:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:14:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43780541
Sat 18 Jan 2014 09:14:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:14:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43780541
Sat 18 Jan 2014 09:14:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:14:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:14:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:14:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:14:15 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:14:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:14:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:14:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:14:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:14:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:14:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:14:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:14:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:14:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:14:18 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:14:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:14:19 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:14:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:14:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:14:19 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:14:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 09:14:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:14:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:14:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:14:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:14:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:14:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:14:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43806622
Sat 18 Jan 2014 09:14:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:14:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43806622
Sat 18 Jan 2014 09:14:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:14:21 - job_xml_thread(): Done retrieving: data size 43806622
Sat 18 Jan 2014 09:14:21 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:14:21 - XML: Start document: iteration 12
Sat 18 Jan 2014 09:14:26 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 09:14:26 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:14:28 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:14:28 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:14:28 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 09:14:28 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 09:14:28 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 09:14:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:14:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:14:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:14:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:14:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:14:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:14:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:14:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:14:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:14:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:14:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:14:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:14:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:14:42 - XML: Processed 655186 elements - found 490 jobs
Sat 18 Jan 2014 09:14:42 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:14:42 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:14:42 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:14:42 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:14:43 - size of cluster 'LISA Cluster': 624 hosts 79472 metrics 855560 values 13488053 bits 1686006 bytes 
Sat 18 Jan 2014 09:14:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:14:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:14:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:14:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:14:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:14:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:14:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:14:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:14:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:14:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43796471
Sat 18 Jan 2014 09:14:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:14:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43796471
Sat 18 Jan 2014 09:14:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:14:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:14:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:14:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:14:56 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:14:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:14:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:14:58 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:14:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:14:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:14:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:14:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:14:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:15:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:15:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:15:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:15:00 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:15:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:15:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 09:15:01 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:15:01 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:15:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 09:15:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8898 values 140256 bits 17532 bytes 
Sat 18 Jan 2014 09:15:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:15:02 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:15:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:15:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:15:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:15:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:15:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:15:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:15:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:15:06 - job_xml_thread(): Done retrieving: data size 43798183
Sat 18 Jan 2014 09:15:06 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:15:06 - XML: Start document: iteration 13
Sat 18 Jan 2014 09:15:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43798183
Sat 18 Jan 2014 09:15:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:15:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43798183
Sat 18 Jan 2014 09:15:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:15:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:15:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:15:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:15:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:15:22 - XML: Processed 655186 elements - found 490 jobs
Sat 18 Jan 2014 09:15:23 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:15:23 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:15:23 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:15:23 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:15:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:15:26 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:15:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:15:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:15:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:15:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:15:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:15:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:15:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:15:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:15:28 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:15:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:15:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:15:28 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:15:28 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 09:15:29 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:15:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 09:15:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:15:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:15:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:15:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:15:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:15:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:15:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43814582
Sat 18 Jan 2014 09:15:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:15:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43814582
Sat 18 Jan 2014 09:15:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:15:38 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:15:38 - job_xml_thread(): Done retrieving: data size 43814582
Sat 18 Jan 2014 09:15:38 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:15:38 - XML: Start document: iteration 14
Sat 18 Jan 2014 09:15:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:15:42 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:15:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:15:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:15:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:15:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:15:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:15:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:15:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:15:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:15:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:15:53 - XML: Processed 655186 elements - found 490 jobs
Sat 18 Jan 2014 09:15:53 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:15:53 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:15:54 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:15:54 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:15:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:15:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:15:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:15:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:15:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:15:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:15:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:15:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:15:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:15:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43807355
Sat 18 Jan 2014 09:15:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:15:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43807355
Sat 18 Jan 2014 09:15:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:16:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:16:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:16:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:16:02 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:16:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:16:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 09:16:02 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:16:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 09:16:03 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:16:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8715 values 137443 bits 17180 bytes 
Sat 18 Jan 2014 09:16:09 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:16:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:16:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:16:11 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:16:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:16:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:16:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:16:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:16:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:16:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:16:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:16:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:16:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:16:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:16:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:16:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:16:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:16:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:16:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:16:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:16:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:16:18 - job_xml_thread(): Done retrieving: data size 43792218
Sat 18 Jan 2014 09:16:18 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:16:18 - XML: Start document: iteration 15
Sat 18 Jan 2014 09:16:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43792218
Sat 18 Jan 2014 09:16:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43792218
Sat 18 Jan 2014 09:16:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:16:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:16:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:16:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:16:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:16:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:16:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:16:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:16:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:16:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:16:34 - XML: Processed 655186 elements - found 490 jobs
Sat 18 Jan 2014 09:16:34 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:16:35 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:16:35 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:16:35 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:16:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:16:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:16:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:16:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:16:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:16:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:16:39 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:16:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:16:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:16:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:16:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:16:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:16:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:16:40 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:16:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 09:16:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:16:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:16:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43823110
Sat 18 Jan 2014 09:16:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:16:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43823110
Sat 18 Jan 2014 09:16:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:16:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:16:50 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:16:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:16:50 - job_xml_thread(): Done retrieving: data size 43823110
Sat 18 Jan 2014 09:16:51 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:16:51 - XML: Start document: iteration 16
Sat 18 Jan 2014 09:16:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:16:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:16:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:16:56 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:16:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:16:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:16:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:16:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:16:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:16:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:16:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:17:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:17:03 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:17:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:17:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 09:17:04 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:17:04 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:17:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 09:17:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5786 values 91479 bits 11434 bytes 
Sat 18 Jan 2014 09:17:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:17:04 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:17:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:17:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:17:05 - XML: Processed 655186 elements - found 490 jobs
Sat 18 Jan 2014 09:17:05 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:17:05 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:17:05 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:17:05 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:17:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:17:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:17:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:17:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:17:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:17:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43804216
Sat 18 Jan 2014 09:17:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:17:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43804216
Sat 18 Jan 2014 09:17:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:17:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:17:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:17:20 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:17:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:17:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:17:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:17:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:17:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:17:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:17:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:17:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:17:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:17:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:17:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:17:26 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:17:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 09:17:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:17:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:17:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:17:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:17:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:17:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:17:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:17:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:17:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:17:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:17:29 - job_xml_thread(): Done retrieving: data size 43750030
Sat 18 Jan 2014 09:17:29 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:17:29 - XML: Start document: iteration 17
Sat 18 Jan 2014 09:17:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43750030
Sat 18 Jan 2014 09:17:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43750030
Sat 18 Jan 2014 09:17:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:17:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:17:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:17:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:17:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:17:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:17:52 - XML: Processed 654435 elements - found 489 jobs
Sat 18 Jan 2014 09:17:52 - job 7346486 appears to have finished
Sat 18 Jan 2014 09:17:53 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 09:17:53 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 09:17:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:17:53 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:17:53 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 09:17:53 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:17:53 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:17:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:17:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:17:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:17:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:17:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:17:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:17:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:17:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:17:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:17:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:17:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:17:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:17:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:17:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:17:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:17:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:17:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43166088
Sat 18 Jan 2014 09:17:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:17:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43166088
Sat 18 Jan 2014 09:17:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:18:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:18:04 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:18:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:18:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 09:18:05 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:18:05 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:18:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 09:18:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8954 values 141612 bits 17701 bytes 
Sat 18 Jan 2014 09:18:08 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:18:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:18:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:18:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:18:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:18:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:18:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:18:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:18:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:18:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:18:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:18:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:18:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:18:14 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:18:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:18:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:18:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:18:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:18:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:18:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:18:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:18:18 - job_xml_thread(): Done retrieving: data size 43188451
Sat 18 Jan 2014 09:18:18 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:18:18 - XML: Start document: iteration 18
Sat 18 Jan 2014 09:18:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43188451
Sat 18 Jan 2014 09:18:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:18:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43188451
Sat 18 Jan 2014 09:18:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:18:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:18:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:18:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:18:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:18:33 - XML: Processed 647602 elements - found 489 jobs
Sat 18 Jan 2014 09:18:33 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:18:34 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:18:34 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:18:34 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:18:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:18:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:18:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:18:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:18:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:18:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:18:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:18:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:18:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:18:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:18:40 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:18:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:18:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:18:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:18:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:18:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:18:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:18:41 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:18:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 09:18:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:18:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:18:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43653674
Sat 18 Jan 2014 09:18:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:18:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43653674
Sat 18 Jan 2014 09:18:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:18:49 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:18:49 - job_xml_thread(): Done retrieving: data size 43653674
Sat 18 Jan 2014 09:18:49 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:18:50 - XML: Start document: iteration 19
Sat 18 Jan 2014 09:18:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:18:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:18:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:18:56 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:18:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:18:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:18:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:18:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:18:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:18:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:18:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:18:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:18:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:19:04 - XML: Processed 653066 elements - found 489 jobs
Sat 18 Jan 2014 09:19:04 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:19:04 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:19:04 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:19:04 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:19:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:19:05 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:19:06 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:19:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:19:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 09:19:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 09:19:06 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:19:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:19:06 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:19:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5572 values 87937 bits 10992 bytes 
Sat 18 Jan 2014 09:19:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:19:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:19:07 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 09:19:07 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 09:19:07 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:19:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:19:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:19:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:19:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:19:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:19:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43790926
Sat 18 Jan 2014 09:19:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:19:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43790926
Sat 18 Jan 2014 09:19:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:19:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:19:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:19:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:19:18 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:19:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:19:19 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:19:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:19:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:19:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:19:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:19:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:19:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:19:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:19:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:19:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:19:23 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:19:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:19:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:19:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:19:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:19:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:19:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:19:24 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:19:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 09:19:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:19:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:19:26 - job_xml_thread(): Done retrieving: data size 43818827
Sat 18 Jan 2014 09:19:26 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:19:26 - XML: Start document: iteration 20
Sat 18 Jan 2014 09:19:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43818827
Sat 18 Jan 2014 09:19:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:19:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43818827
Sat 18 Jan 2014 09:19:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:19:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:19:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:19:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:19:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:19:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:19:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:19:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:19:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:19:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:19:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:19:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:19:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:19:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:19:47 - XML: Processed 655184 elements - found 489 jobs
Sat 18 Jan 2014 09:19:47 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:19:47 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:19:47 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:19:47 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:19:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:19:49 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:19:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:19:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:19:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:19:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:19:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:19:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:19:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:19:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43799785
Sat 18 Jan 2014 09:19:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:19:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43799785
Sat 18 Jan 2014 09:19:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:19:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:19:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:20:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:20:02 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:20:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:20:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:20:03 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:20:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:20:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:20:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:20:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:20:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:20:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:20:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:20:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:20:05 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:20:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:20:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:20:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:20:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:20:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:20:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:20:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:20:06 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:20:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:20:06 - job_xml_thread(): Done retrieving: data size 43817584
Sat 18 Jan 2014 09:20:06 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:20:06 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 09:20:06 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 09:20:06 - Housekeeping: done.
Sat 18 Jan 2014 09:20:06 - XML: Start document: iteration 0
Sat 18 Jan 2014 09:20:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43817584
Sat 18 Jan 2014 09:20:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:20:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43817584
Sat 18 Jan 2014 09:20:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:20:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:20:08 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:20:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 09:20:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 09:20:08 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:20:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9130 values 144053 bits 18006 bytes 
Sat 18 Jan 2014 09:20:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:20:19 - XML: Processed 655184 elements - found 489 jobs
Sat 18 Jan 2014 09:20:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:20:19 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:20:19 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:20:19 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:20:19 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:20:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:20:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:20:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:20:24 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:20:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:20:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:20:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:20:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:20:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:20:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:20:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:20:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:20:28 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:20:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:20:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:20:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:20:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:20:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:20:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:20:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:20:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43797689
Sat 18 Jan 2014 09:20:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:20:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43797689
Sat 18 Jan 2014 09:20:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:20:34 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:20:34 - job_xml_thread(): Done retrieving: data size 43797689
Sat 18 Jan 2014 09:20:34 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:20:34 - XML: Start document: iteration 1
Sat 18 Jan 2014 09:20:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:20:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:20:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:20:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:20:46 - XML: Processed 655184 elements - found 489 jobs
Sat 18 Jan 2014 09:20:46 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:20:46 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:20:46 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:20:46 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:20:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:20:49 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:20:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:20:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:20:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:20:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:20:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:20:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:20:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:20:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:20:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:20:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:20:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:20:55 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:20:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 09:20:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:20:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:20:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:20:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:20:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:20:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:20:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43819531
Sat 18 Jan 2014 09:20:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:20:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43819531
Sat 18 Jan 2014 09:20:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:21:01 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:21:01 - job_xml_thread(): Done retrieving: data size 43819531
Sat 18 Jan 2014 09:21:01 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:21:01 - XML: Start document: iteration 2
Sat 18 Jan 2014 09:21:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:21:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:21:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:21:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:21:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:21:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:21:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43819531
Sat 18 Jan 2014 09:21:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:21:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:21:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:21:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:21:08 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:21:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:21:10 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:21:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 09:21:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 09:21:10 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:21:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:21:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:21:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5945 values 93798 bits 11724 bytes 
Sat 18 Jan 2014 09:21:16 - XML: Processed 655183 elements - found 489 jobs
Sat 18 Jan 2014 09:21:16 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:21:16 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:21:16 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:21:16 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:21:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:21:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:21:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:21:23 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:21:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:21:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:21:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:21:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:21:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:21:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:21:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:21:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:21:25 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:21:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:21:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:21:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:21:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:21:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:21:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:21:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:21:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43816659
Sat 18 Jan 2014 09:21:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:21:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43816659
Sat 18 Jan 2014 09:21:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:21:28 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 09:21:29 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:21:31 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:21:31 - job_xml_thread(): Done retrieving: data size 43816659
Sat 18 Jan 2014 09:21:31 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:21:31 - XML: Start document: iteration 3
Sat 18 Jan 2014 09:21:32 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:21:32 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:21:32 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 09:21:33 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 09:21:33 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 09:21:39 - XML: Processed 655184 elements - found 489 jobs
Sat 18 Jan 2014 09:21:40 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:21:40 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:21:40 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:21:40 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:21:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:21:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:21:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:21:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:21:48 - size of cluster 'LISA Cluster': 624 hosts 79478 metrics 814179 values 12852789 bits 1606598 bytes 
Sat 18 Jan 2014 09:21:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:21:49 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:21:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:21:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:21:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:21:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:21:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:21:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:21:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:21:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:21:50 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:21:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:21:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:21:50 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:21:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 09:21:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:21:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:21:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:21:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:21:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:21:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:21:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43838986
Sat 18 Jan 2014 09:21:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:21:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43838986
Sat 18 Jan 2014 09:21:55 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:21:55 - job_xml_thread(): Done retrieving: data size 43838986
Sat 18 Jan 2014 09:21:55 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:21:55 - XML: Start document: iteration 4
Sat 18 Jan 2014 09:21:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:22:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:22:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:22:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:22:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:22:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:22:10 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:22:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:22:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 09:22:11 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:22:11 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:22:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 09:22:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6207 values 97901 bits 12237 bytes 
Sat 18 Jan 2014 09:22:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:22:13 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:22:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:22:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:22:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:22:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:22:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:22:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:22:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:22:15 - XML: Processed 655184 elements - found 489 jobs
Sat 18 Jan 2014 09:22:15 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:22:15 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:22:15 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:22:15 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:22:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:22:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:22:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:22:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:22:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:22:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:22:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:22:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:22:21 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:22:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 09:22:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:22:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:22:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43812008
Sat 18 Jan 2014 09:22:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:22:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43812008
Sat 18 Jan 2014 09:22:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:22:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:22:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:22:30 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:22:30 - job_xml_thread(): Done retrieving: data size 43812008
Sat 18 Jan 2014 09:22:30 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:22:30 - XML: Start document: iteration 5
Sat 18 Jan 2014 09:22:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:22:32 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:22:33 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:22:33 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 09:22:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:22:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:22:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:22:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:22:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:22:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:22:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:22:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:22:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:22:40 - XML: Processed 655184 elements - found 489 jobs
Sat 18 Jan 2014 09:22:40 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:22:40 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:22:40 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:22:40 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:22:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:22:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:22:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:22:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:22:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:22:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:22:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:22:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:22:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:22:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43780282
Sat 18 Jan 2014 09:22:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:22:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43780282
Sat 18 Jan 2014 09:22:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:22:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:22:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:22:56 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:22:56 - job_xml_thread(): Done retrieving: data size 43780282
Sat 18 Jan 2014 09:22:56 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:22:56 - XML: Start document: iteration 6
Sat 18 Jan 2014 09:22:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:22:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:22:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:22:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:22:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:22:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:22:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:22:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:22:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:22:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:22:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:23:05 - XML: Processed 655184 elements - found 489 jobs
Sat 18 Jan 2014 09:23:05 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:23:05 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:23:05 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:23:05 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:23:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:23:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:23:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:23:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:23:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:23:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:23:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:23:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:23:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:23:11 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:23:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:23:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43800932
Sat 18 Jan 2014 09:23:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:23:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:23:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 09:23:12 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:23:12 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:23:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 09:23:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99087 bits 12385 bytes 
Sat 18 Jan 2014 09:23:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43800932
Sat 18 Jan 2014 09:23:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:23:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:23:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:23:20 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:23:20 - job_xml_thread(): Done retrieving: data size 43800932
Sat 18 Jan 2014 09:23:20 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:23:20 - XML: Start document: iteration 7
Sat 18 Jan 2014 09:23:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:23:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:23:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:23:26 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:23:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:23:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:23:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:23:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:23:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:23:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:23:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:23:34 - XML: Processed 655184 elements - found 489 jobs
Sat 18 Jan 2014 09:23:34 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:23:34 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:23:34 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:23:34 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:23:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:23:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:23:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:23:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:23:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:23:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:23:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:23:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:23:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:23:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43372302
Sat 18 Jan 2014 09:23:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:23:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43372302
Sat 18 Jan 2014 09:23:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:23:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:23:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:23:49 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:23:49 - job_xml_thread(): Done retrieving: data size 43372302
Sat 18 Jan 2014 09:23:49 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:23:49 - XML: Start document: iteration 8
Sat 18 Jan 2014 09:23:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:23:50 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:23:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:23:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:23:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:23:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:23:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:23:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:23:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:23:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:23:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:23:51 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:23:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 09:23:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:24:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:24:01 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:24:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:24:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:24:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:24:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:24:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:24:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:24:02 - XML: Processed 649930 elements - found 489 jobs
Sat 18 Jan 2014 09:24:02 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:24:02 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:24:02 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:24:02 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:24:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:24:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43122186
Sat 18 Jan 2014 09:24:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:24:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43122186
Sat 18 Jan 2014 09:24:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:24:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:24:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:24:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:24:12 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:24:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:24:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 09:24:13 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:24:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6205 values 97840 bits 12230 bytes 
Sat 18 Jan 2014 09:24:13 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:24:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 09:24:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:24:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:24:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:24:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:24:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:24:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:24:17 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:24:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:24:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:24:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:24:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:24:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:24:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:24:21 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:24:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:24:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:24:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:24:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:24:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:24:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:24:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:24:24 - job_xml_thread(): Done retrieving: data size 43225179
Sat 18 Jan 2014 09:24:24 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:24:24 - XML: Start document: iteration 9
Sat 18 Jan 2014 09:24:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43225179
Sat 18 Jan 2014 09:24:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:24:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43225179
Sat 18 Jan 2014 09:24:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:24:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:24:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:24:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:24:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:24:39 - XML: Processed 647732 elements - found 489 jobs
Sat 18 Jan 2014 09:24:39 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:24:39 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:24:39 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:24:39 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:24:41 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:24:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 09:24:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:24:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:24:44 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:24:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:24:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:24:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:24:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:24:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:24:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:24:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:24:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:24:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:24:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:24:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:24:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:24:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:24:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:24:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:24:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:24:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43748312
Sat 18 Jan 2014 09:24:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:24:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43748312
Sat 18 Jan 2014 09:24:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:24:54 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:24:55 - job_xml_thread(): Done retrieving: data size 43748312
Sat 18 Jan 2014 09:24:56 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:24:57 - XML: Start document: iteration 10
Sat 18 Jan 2014 09:25:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:25:00 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:25:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:25:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:25:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:25:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:25:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:25:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:25:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:25:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:25:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:25:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:25:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:25:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:25:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:25:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:25:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:25:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:25:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:25:12 - XML: Processed 654320 elements - found 489 jobs
Sat 18 Jan 2014 09:25:12 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:25:12 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:25:12 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:25:12 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:25:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:25:14 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:25:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:25:14 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:25:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 09:25:14 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:25:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 09:25:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6051 values 95438 bits 11929 bytes 
Sat 18 Jan 2014 09:25:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:25:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43784033
Sat 18 Jan 2014 09:25:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:25:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43784033
Sat 18 Jan 2014 09:25:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:25:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:25:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:25:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:25:25 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:25:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:25:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:25:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:25:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:25:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:25:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:25:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:25:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:25:27 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:25:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:25:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:25:29 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:25:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:25:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:25:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:25:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:25:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:25:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:25:33 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:25:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 09:25:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:25:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:25:34 - job_xml_thread(): Done retrieving: data size 43795863
Sat 18 Jan 2014 09:25:34 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:25:34 - XML: Start document: iteration 11
Sat 18 Jan 2014 09:25:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43795863
Sat 18 Jan 2014 09:25:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43795863
Sat 18 Jan 2014 09:25:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:25:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:25:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:25:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:25:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:25:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:25:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:25:51 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:25:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:25:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:25:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:25:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:25:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:25:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:25:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:25:52 - XML: Processed 655182 elements - found 488 jobs
Sat 18 Jan 2014 09:25:52 - job 7346485 appears to have finished
Sat 18 Jan 2014 09:25:52 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 09:25:52 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 09:25:52 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 09:25:52 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:25:52 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:25:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:25:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:25:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:25:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:25:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:25:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:25:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:25:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:25:57 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 09:25:57 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 09:25:57 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:25:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:25:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43803478
Sat 18 Jan 2014 09:25:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:25:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43803478
Sat 18 Jan 2014 09:25:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:26:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:26:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:26:07 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:26:07 - job_xml_thread(): Done retrieving: data size 43803478
Sat 18 Jan 2014 09:26:07 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:26:08 - XML: Start document: iteration 12
Sat 18 Jan 2014 09:26:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:26:10 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:26:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:26:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:26:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:26:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:26:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:26:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:26:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:26:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:26:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:26:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:26:14 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:26:14 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:26:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:26:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 09:26:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 09:26:14 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:26:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6991 values 110203 bits 13775 bytes 
Sat 18 Jan 2014 09:26:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:26:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:26:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:26:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:26:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:26:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:26:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:26:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:26:20 - XML: Processed 655178 elements - found 488 jobs
Sat 18 Jan 2014 09:26:20 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:26:20 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:26:20 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:26:20 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:26:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:26:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43800250
Sat 18 Jan 2014 09:26:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:26:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43800250
Sat 18 Jan 2014 09:26:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:26:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:26:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:26:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:26:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:26:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:26:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:26:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:26:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:26:35 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:26:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:26:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:26:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:26:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:26:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:26:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:26:37 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:26:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:26:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:26:38 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:26:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 09:26:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:26:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:26:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:26:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:26:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:26:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:26:39 - job_xml_thread(): Done retrieving: data size 43829514
Sat 18 Jan 2014 09:26:39 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:26:39 - XML: Start document: iteration 13
Sat 18 Jan 2014 09:26:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43829514
Sat 18 Jan 2014 09:26:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43829514
Sat 18 Jan 2014 09:26:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:26:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:26:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:26:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:26:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:26:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:26:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:26:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:26:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:26:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:26:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:26:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:26:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:26:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:26:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:26:59 - XML: Processed 655182 elements - found 488 jobs
Sat 18 Jan 2014 09:26:59 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:26:59 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:26:59 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:26:59 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:27:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:27:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:27:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:27:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:27:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:27:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:27:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:27:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:27:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:27:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43799261
Sat 18 Jan 2014 09:27:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:27:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43799261
Sat 18 Jan 2014 09:27:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:27:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:27:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:27:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:27:13 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:27:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:27:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:27:14 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:27:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:27:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:27:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:27:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:27:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:27:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:27:15 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:27:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:27:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:27:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:27:15 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:27:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 09:27:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 09:27:15 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:27:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8813 values 138920 bits 17365 bytes 
Sat 18 Jan 2014 09:27:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:27:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:27:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:27:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:27:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:27:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:27:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:27:17 - job_xml_thread(): Done retrieving: data size 43814271
Sat 18 Jan 2014 09:27:17 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:27:17 - XML: Start document: iteration 14
Sat 18 Jan 2014 09:27:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43814271
Sat 18 Jan 2014 09:27:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:27:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43814271
Sat 18 Jan 2014 09:27:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:27:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:27:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:27:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:27:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:27:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:27:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:27:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:27:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:27:36 - XML: Processed 655182 elements - found 488 jobs
Sat 18 Jan 2014 09:27:36 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:27:36 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:27:36 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:27:36 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:27:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:27:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:27:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:27:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:27:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:27:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:27:40 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:27:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:27:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:27:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:27:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:27:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:27:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:27:41 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:27:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 09:27:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:27:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:27:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43800982
Sat 18 Jan 2014 09:27:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:27:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43800982
Sat 18 Jan 2014 09:27:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:27:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:27:50 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:27:51 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:27:51 - job_xml_thread(): Done retrieving: data size 43800982
Sat 18 Jan 2014 09:27:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:27:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:27:52 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:27:52 - XML: Start document: iteration 15
Sat 18 Jan 2014 09:27:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:27:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:27:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:27:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:27:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:27:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:27:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:28:00 - XML: Processed 655181 elements - found 488 jobs
Sat 18 Jan 2014 09:28:00 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:28:00 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:28:00 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:28:00 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:28:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:28:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:28:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:28:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:28:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:28:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:28:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:28:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:28:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:28:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43791070
Sat 18 Jan 2014 09:28:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:28:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43791070
Sat 18 Jan 2014 09:28:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:28:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:28:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:28:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:28:14 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:28:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:28:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:28:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:28:15 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:28:16 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:28:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:28:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:28:16 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:28:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 09:28:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:28:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:28:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:28:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:28:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 09:28:16 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:28:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8538 values 134611 bits 16826 bytes 
Sat 18 Jan 2014 09:28:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:28:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:28:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:28:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:28:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:28:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:28:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:28:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:28:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:28:20 - job_xml_thread(): Done retrieving: data size 43826269
Sat 18 Jan 2014 09:28:20 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:28:20 - XML: Start document: iteration 16
Sat 18 Jan 2014 09:28:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43826269
Sat 18 Jan 2014 09:28:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:28:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43826269
Sat 18 Jan 2014 09:28:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:28:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:28:32 - XML: Processed 655182 elements - found 488 jobs
Sat 18 Jan 2014 09:28:32 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:28:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:28:32 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:28:32 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:28:32 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:28:33 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 09:28:33 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:28:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:28:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:28:34 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:28:34 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:28:34 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 09:28:35 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 09:28:35 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 09:28:39 - size of cluster 'LISA Cluster': 624 hosts 79481 metrics 834213 values 13148555 bits 1643569 bytes 
Sat 18 Jan 2014 09:28:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:28:43 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:28:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:28:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:28:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:28:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:28:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:28:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:28:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:28:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:28:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:28:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:28:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:28:45 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:28:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 09:28:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:28:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:28:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:28:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:28:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:28:47 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:28:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:28:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43809332
Sat 18 Jan 2014 09:28:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:28:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43809332
Sat 18 Jan 2014 09:28:49 - job_xml_thread(): Done retrieving: data size 43809332
Sat 18 Jan 2014 09:28:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:28:50 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:28:51 - XML: Start document: iteration 17
Sat 18 Jan 2014 09:28:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:28:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:29:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:29:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:29:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:29:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:29:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:29:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:29:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:29:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:29:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:29:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:29:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:29:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:29:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:29:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:29:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:29:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:29:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:29:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:29:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:29:11 - XML: Processed 655182 elements - found 488 jobs
Sat 18 Jan 2014 09:29:11 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:29:11 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:29:11 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:29:11 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:29:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:29:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43726972
Sat 18 Jan 2014 09:29:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:29:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43726972
Sat 18 Jan 2014 09:29:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:29:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:29:16 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:29:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:29:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 09:29:18 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:29:18 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:29:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 09:29:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8881 values 139999 bits 17499 bytes 
Sat 18 Jan 2014 09:29:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:29:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:29:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:29:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:29:26 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:29:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:29:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:29:27 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:29:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:29:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:29:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:29:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:29:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:29:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:29:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:29:30 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:29:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:29:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:29:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:29:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:29:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:29:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:29:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:29:34 - job_xml_thread(): Done retrieving: data size 43369217
Sat 18 Jan 2014 09:29:34 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:29:34 - XML: Start document: iteration 18
Sat 18 Jan 2014 09:29:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43369217
Sat 18 Jan 2014 09:29:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:29:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43369217
Sat 18 Jan 2014 09:29:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:29:35 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:29:35 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 09:29:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:29:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:29:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:29:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:29:47 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:29:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 09:29:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:29:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:29:50 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:29:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:29:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:29:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:29:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:29:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:29:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:29:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:29:57 - XML: Processed 649890 elements - found 487 jobs
Sat 18 Jan 2014 09:29:57 - job 7346483 appears to have finished
Sat 18 Jan 2014 09:29:57 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 09:29:57 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 09:29:57 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 09:29:57 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:29:57 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:29:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:29:59 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:29:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:29:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:30:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:30:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:30:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:30:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:30:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:30:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43128982
Sat 18 Jan 2014 09:30:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:30:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43128982
Sat 18 Jan 2014 09:30:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:30:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:30:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:30:12 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:30:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:30:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:30:13 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:30:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:30:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:30:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:30:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:30:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:30:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:30:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:30:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:30:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:30:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:30:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:30:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:30:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:30:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:30:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:30:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:30:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:30:18 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:30:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:30:19 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:30:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 09:30:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 09:30:19 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:30:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5963 values 94052 bits 11756 bytes 
Sat 18 Jan 2014 09:30:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:30:21 - job_xml_thread(): Done retrieving: data size 43202409
Sat 18 Jan 2014 09:30:21 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:30:21 - XML: Start document: iteration 19
Sat 18 Jan 2014 09:30:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43202409
Sat 18 Jan 2014 09:30:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:30:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43202409
Sat 18 Jan 2014 09:30:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:30:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:30:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:30:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:30:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:30:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:30:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:30:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:30:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:30:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:30:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:30:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:30:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:30:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:30:40 - XML: Processed 647654 elements - found 487 jobs
Sat 18 Jan 2014 09:30:40 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:30:40 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:30:40 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:30:40 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:30:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:30:42 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:30:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:30:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:30:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:30:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:30:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:30:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:30:44 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:30:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 09:30:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:30:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:30:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43730095
Sat 18 Jan 2014 09:30:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:30:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43730095
Sat 18 Jan 2014 09:30:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:30:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:30:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:30:55 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:30:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:30:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:30:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:30:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:30:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:30:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:30:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:30:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:30:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:30:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:30:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:31:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:31:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:31:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:31:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:31:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:31:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:31:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:31:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:31:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:31:03 - job_xml_thread(): Done retrieving: data size 43791436
Sat 18 Jan 2014 09:31:03 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:31:03 - XML: Start document: iteration 20
Sat 18 Jan 2014 09:31:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43791436
Sat 18 Jan 2014 09:31:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43791436
Sat 18 Jan 2014 09:31:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:31:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:31:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:31:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:31:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:31:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:31:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:31:15 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:31:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:31:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:31:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:31:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:31:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:31:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:31:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:31:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:31:19 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:31:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:31:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 09:31:19 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:31:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7784 values 122733 bits 15341 bytes 
Sat 18 Jan 2014 09:31:20 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:31:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 09:31:23 - XML: Processed 655180 elements - found 487 jobs
Sat 18 Jan 2014 09:31:23 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:31:23 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:31:23 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:31:23 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:31:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:31:27 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:31:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:31:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:31:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:31:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:31:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:31:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:31:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:31:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43765472
Sat 18 Jan 2014 09:31:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:31:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43765472
Sat 18 Jan 2014 09:31:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:31:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:31:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:31:38 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:31:38 - job_xml_thread(): Done retrieving: data size 43765472
Sat 18 Jan 2014 09:31:38 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:31:38 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 09:31:39 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 09:31:39 - Housekeeping: done.
Sat 18 Jan 2014 09:31:39 - XML: Start document: iteration 0
Sat 18 Jan 2014 09:31:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:31:39 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:31:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:31:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:31:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:31:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:31:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:31:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:31:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43765472
Sat 18 Jan 2014 09:31:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:31:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:31:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:31:55 - XML: Processed 655180 elements - found 487 jobs
Sat 18 Jan 2014 09:31:55 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:31:55 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:31:55 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:31:55 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:31:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:31:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:31:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:31:58 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:31:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:31:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:31:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:31:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:31:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:31:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:31:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:31:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:31:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:31:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:31:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:32:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:32:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:32:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:32:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:32:00 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:32:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 09:32:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:32:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:32:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43807425
Sat 18 Jan 2014 09:32:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:32:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43807425
Sat 18 Jan 2014 09:32:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:32:10 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:32:10 - job_xml_thread(): Done retrieving: data size 43807425
Sat 18 Jan 2014 09:32:11 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:32:11 - XML: Start document: iteration 1
Sat 18 Jan 2014 09:32:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:32:11 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:32:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:32:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:32:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:32:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:32:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:32:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:32:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:32:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:32:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:32:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:32:20 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:32:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:32:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 09:32:20 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:32:20 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:32:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 09:32:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5655 values 89365 bits 11170 bytes 
Sat 18 Jan 2014 09:32:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:32:23 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:32:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:32:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:32:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:32:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:32:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:32:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:32:25 - XML: Processed 655180 elements - found 487 jobs
Sat 18 Jan 2014 09:32:25 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:32:25 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:32:25 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:32:25 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:32:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:32:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43781499
Sat 18 Jan 2014 09:32:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:32:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43781499
Sat 18 Jan 2014 09:32:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:32:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:32:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:32:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:32:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:32:40 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:32:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:32:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:32:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:32:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:32:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:32:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:32:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:32:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:32:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:32:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:32:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:32:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:32:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:32:44 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:32:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 09:32:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:32:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:32:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:32:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:32:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:32:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:32:47 - job_xml_thread(): Done retrieving: data size 43806367
Sat 18 Jan 2014 09:32:47 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:32:47 - XML: Start document: iteration 2
Sat 18 Jan 2014 09:32:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43806367
Sat 18 Jan 2014 09:32:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:32:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43806367
Sat 18 Jan 2014 09:32:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:32:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:32:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:33:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:33:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:33:06 - XML: Processed 655180 elements - found 487 jobs
Sat 18 Jan 2014 09:33:06 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:33:06 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:33:07 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:33:07 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:33:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:33:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:33:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:33:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:33:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:33:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:33:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:33:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:33:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:33:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:33:12 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:33:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:33:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:33:12 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 09:33:12 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 09:33:12 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:33:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:33:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:33:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:33:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:33:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:33:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43807054
Sat 18 Jan 2014 09:33:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43807054
Sat 18 Jan 2014 09:33:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:33:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:33:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:33:20 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:33:22 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:33:22 - job_xml_thread(): Done retrieving: data size 43807054
Sat 18 Jan 2014 09:33:22 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:33:22 - XML: Start document: iteration 3
Sat 18 Jan 2014 09:33:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:33:22 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:33:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 09:33:22 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:33:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 09:33:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8780 values 138810 bits 17351 bytes 
Sat 18 Jan 2014 09:33:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:33:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:33:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:33:27 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:33:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:33:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:33:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:33:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:33:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:33:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:33:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:33:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:33:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:33:32 - XML: Processed 655180 elements - found 487 jobs
Sat 18 Jan 2014 09:33:32 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:33:32 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:33:32 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:33:32 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:33:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:33:34 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:33:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:33:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:33:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:33:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:33:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:33:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:33:36 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:33:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 09:33:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:33:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:33:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43804581
Sat 18 Jan 2014 09:33:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:33:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43804581
Sat 18 Jan 2014 09:33:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:33:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:33:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:33:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:33:47 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:33:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:33:47 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:33:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:33:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:33:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:33:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:33:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:33:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:33:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:33:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:33:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:33:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:33:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:33:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:33:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:33:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:33:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:33:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:33:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:33:53 - job_xml_thread(): Done retrieving: data size 43825523
Sat 18 Jan 2014 09:33:53 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:33:53 - XML: Start document: iteration 4
Sat 18 Jan 2014 09:33:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43825523
Sat 18 Jan 2014 09:33:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:33:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43825523
Sat 18 Jan 2014 09:33:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:34:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:34:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:34:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:34:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:34:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:34:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:34:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:34:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:34:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:34:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:34:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:34:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:34:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:34:12 - XML: Processed 655178 elements - found 486 jobs
Sat 18 Jan 2014 09:34:12 - job 7346475 appears to have finished
Sat 18 Jan 2014 09:34:12 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 09:34:12 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 09:34:12 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 09:34:12 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:34:13 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:34:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:34:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:34:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:34:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:34:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:34:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:34:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:34:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:34:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:34:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43788696
Sat 18 Jan 2014 09:34:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:34:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43788696
Sat 18 Jan 2014 09:34:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:34:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:34:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:34:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:34:23 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:34:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:34:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 09:34:23 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:34:23 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:34:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148639 bits 18579 bytes 
Sat 18 Jan 2014 09:34:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 09:34:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:34:26 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:34:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:34:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:34:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:34:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:34:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:34:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:34:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43788696
Sat 18 Jan 2014 09:34:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:34:28 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:34:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:34:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:34:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:34:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:34:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:34:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:34:38 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:34:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:34:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:34:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:34:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:34:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:34:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:34:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:34:40 - job_xml_thread(): Done retrieving: data size 43793438
Sat 18 Jan 2014 09:34:40 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:34:40 - XML: Start document: iteration 5
Sat 18 Jan 2014 09:34:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43793438
Sat 18 Jan 2014 09:34:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:34:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:34:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:34:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:34:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:34:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:34:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:34:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43793438
Sat 18 Jan 2014 09:34:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:34:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:34:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:34:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:34:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:34:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:34:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:34:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:34:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:35:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:35:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:35:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:35:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:35:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:35:03 - XML: Processed 655178 elements - found 486 jobs
Sat 18 Jan 2014 09:35:03 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:35:03 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:35:03 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:35:03 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:35:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:35:04 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:35:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:35:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:35:04 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:35:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 09:35:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:35:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:35:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:35:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:35:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:35:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:35:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43811637
Sat 18 Jan 2014 09:35:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:35:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43811637
Sat 18 Jan 2014 09:35:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:35:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:35:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:35:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:35:15 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:35:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:35:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:35:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:35:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:35:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:35:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:35:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:35:18 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:35:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:35:19 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:35:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:35:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:35:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:35:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:35:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:35:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:35:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:35:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43746697
Sat 18 Jan 2014 09:35:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:35:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43746697
Sat 18 Jan 2014 09:35:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:35:21 - job_xml_thread(): Done retrieving: data size 43746697
Sat 18 Jan 2014 09:35:22 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:35:22 - XML: Start document: iteration 6
Sat 18 Jan 2014 09:35:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:35:23 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:35:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:35:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 09:35:24 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:35:24 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:35:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9073 values 143095 bits 17886 bytes 
Sat 18 Jan 2014 09:35:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 09:35:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:35:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:35:35 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 09:35:35 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:35:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:35:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:35:35 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:35:35 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 09:35:36 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:35:36 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 09:35:36 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 09:35:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:35:39 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:35:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:35:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:35:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:35:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:35:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:35:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:35:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:35:42 - size of cluster 'LISA Cluster': 624 hosts 79467 metrics 739248 values 11671870 bits 1458983 bytes 
Sat 18 Jan 2014 09:35:42 - XML: Processed 654430 elements - found 486 jobs
Sat 18 Jan 2014 09:35:42 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:35:42 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:35:42 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:35:42 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:35:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:35:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:35:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:35:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:35:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:35:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:35:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:35:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:35:48 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:35:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 09:35:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:35:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:35:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43177487
Sat 18 Jan 2014 09:35:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:35:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43177487
Sat 18 Jan 2014 09:35:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:35:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:35:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:35:57 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:35:57 - job_xml_thread(): Done retrieving: data size 43177487
Sat 18 Jan 2014 09:35:58 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:35:58 - XML: Start document: iteration 7
Sat 18 Jan 2014 09:36:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:36:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:36:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:36:02 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:36:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:36:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:36:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:36:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:36:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:36:04 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:36:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:36:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:36:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:36:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:36:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:36:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:36:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:36:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:36:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:36:09 - XML: Processed 647464 elements - found 486 jobs
Sat 18 Jan 2014 09:36:09 - job 7348775 report time 1390033980 does not match current heartbeat 1390034101 : ignoring job
Sat 18 Jan 2014 09:36:09 - job 7346482 appears to have finished
Sat 18 Jan 2014 09:36:09 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 09:36:09 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 09:36:09 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 09:36:09 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:36:09 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:36:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:36:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43176407
Sat 18 Jan 2014 09:36:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:36:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43176407
Sat 18 Jan 2014 09:36:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:36:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:36:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:36:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:36:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:36:24 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:36:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:36:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:36:25 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:36:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:36:25 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:36:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:36:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:36:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:36:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:36:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:36:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:36:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:36:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 09:36:25 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:36:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99055 bits 12381 bytes 
Sat 18 Jan 2014 09:36:25 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:36:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 09:36:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:36:27 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:36:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:36:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:36:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:36:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:36:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:36:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:36:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:36:31 - job_xml_thread(): Done retrieving: data size 43284436
Sat 18 Jan 2014 09:36:31 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:36:31 - XML: Start document: iteration 8
Sat 18 Jan 2014 09:36:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43284436
Sat 18 Jan 2014 09:36:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:36:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43284436
Sat 18 Jan 2014 09:36:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:36:36 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:36:36 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 09:36:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:36:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:36:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:36:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:36:50 - XML: Processed 648716 elements - found 486 jobs
Sat 18 Jan 2014 09:36:50 - job 7348775 report time 1390033980 does not match current heartbeat 1390034101 : ignoring job
Sat 18 Jan 2014 09:36:50 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:36:50 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:36:50 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:36:50 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:36:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:36:51 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:36:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:36:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:36:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:36:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:36:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:36:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:36:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:36:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:36:54 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:36:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:36:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:36:55 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:36:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 09:36:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:36:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:36:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:36:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:36:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:36:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:36:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43797395
Sat 18 Jan 2014 09:36:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:36:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43797395
Sat 18 Jan 2014 09:36:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:37:06 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:37:06 - job_xml_thread(): Done retrieving: data size 43797395
Sat 18 Jan 2014 09:37:06 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:37:06 - XML: Start document: iteration 9
Sat 18 Jan 2014 09:37:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:37:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:37:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:37:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:37:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:37:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:37:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:37:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:37:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:37:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:37:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:37:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:37:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:37:16 - XML: Processed 655124 elements - found 486 jobs
Sat 18 Jan 2014 09:37:16 - job 7348775 report time 1390033980 does not match current heartbeat 1390034101 : ignoring job
Sat 18 Jan 2014 09:37:16 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:37:16 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:37:16 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:37:16 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:37:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:37:18 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:37:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:37:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:37:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:37:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:37:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:37:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:37:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:37:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43790827
Sat 18 Jan 2014 09:37:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:37:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43790827
Sat 18 Jan 2014 09:37:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:37:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:37:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:37:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:37:26 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:37:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:37:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 09:37:26 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:37:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 09:37:26 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:37:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8678 values 136850 bits 17106 bytes 
Sat 18 Jan 2014 09:37:31 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:37:31 - job_xml_thread(): Done retrieving: data size 43790827
Sat 18 Jan 2014 09:37:31 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:37:31 - XML: Start document: iteration 10
Sat 18 Jan 2014 09:37:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:37:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:37:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:37:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:37:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:37:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:37:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:37:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:37:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:37:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:37:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:37:46 - XML: Processed 655178 elements - found 486 jobs
Sat 18 Jan 2014 09:37:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:37:46 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:37:46 - job 7348775 report time 1390033980 does not match current heartbeat 1390034101 : ignoring job
Sat 18 Jan 2014 09:37:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:37:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:37:46 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:37:46 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:37:46 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:37:46 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:37:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:37:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:37:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:37:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:37:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:37:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43797211
Sat 18 Jan 2014 09:37:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:37:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43797211
Sat 18 Jan 2014 09:37:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:37:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:37:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:37:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:37:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:37:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:37:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:38:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:38:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:38:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:38:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:38:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:38:01 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:38:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:38:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:38:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:38:05 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:38:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:38:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:38:06 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:38:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 09:38:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:38:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:38:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:38:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:38:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:38:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:38:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43809196
Sat 18 Jan 2014 09:38:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:38:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43809196
Sat 18 Jan 2014 09:38:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:38:09 - job_xml_thread(): Done retrieving: data size 43809196
Sat 18 Jan 2014 09:38:09 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:38:09 - XML: Start document: iteration 11
Sat 18 Jan 2014 09:38:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:38:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:38:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:38:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:38:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:38:26 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:38:27 - XML: Processed 655174 elements - found 484 jobs
Sat 18 Jan 2014 09:38:27 - job 7344744 appears to have finished
Sat 18 Jan 2014 09:38:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:38:27 - job 7348780 report time 1390034101 does not match current heartbeat 1390034221 : ignoring job
Sat 18 Jan 2014 09:38:27 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:38:27 - job 7346467 appears to have finished
Sat 18 Jan 2014 09:38:28 - job_xml_thread(): Found 3 updated jobs.
Sat 18 Jan 2014 09:38:28 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 09:38:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:38:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:38:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:38:28 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:38:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 09:38:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 09:38:28 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:38:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5670 values 89345 bits 11168 bytes 
Sat 18 Jan 2014 09:38:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:38:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:38:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:38:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:38:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:38:29 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Sat 18 Jan 2014 09:38:29 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:38:29 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:38:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:38:31 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:38:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:38:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:38:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:38:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:38:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:38:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:38:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:38:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43811652
Sat 18 Jan 2014 09:38:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:38:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43811652
Sat 18 Jan 2014 09:38:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:38:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:38:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:38:44 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:38:44 - job_xml_thread(): Done retrieving: data size 43811652
Sat 18 Jan 2014 09:38:44 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:38:44 - XML: Start document: iteration 12
Sat 18 Jan 2014 09:38:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:38:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:38:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:38:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:38:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:38:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:38:57 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:38:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:38:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:38:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:38:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:38:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:38:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:38:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:38:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:38:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:38:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:38:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:38:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:38:59 - XML: Processed 655174 elements - found 484 jobs
Sat 18 Jan 2014 09:38:59 - job 7348780 report time 1390034101 does not match current heartbeat 1390034221 : ignoring job
Sat 18 Jan 2014 09:38:59 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:38:59 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:38:59 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:38:59 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:38:59 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:38:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 09:38:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:39:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:39:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43814125
Sat 18 Jan 2014 09:39:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:39:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43814125
Sat 18 Jan 2014 09:39:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:39:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:39:13 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:39:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:39:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:39:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:39:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:39:14 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:39:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:39:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:39:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:39:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:39:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:39:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:39:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:39:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:39:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:39:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:39:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:39:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:39:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:39:21 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 09:39:21 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 09:39:21 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:39:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:39:22 - job_xml_thread(): Done retrieving: data size 43805251
Sat 18 Jan 2014 09:39:22 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:39:22 - XML: Start document: iteration 13
Sat 18 Jan 2014 09:39:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43805251
Sat 18 Jan 2014 09:39:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43805251
Sat 18 Jan 2014 09:39:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:39:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:39:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:39:28 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:39:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:39:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:39:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 09:39:29 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:39:29 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:39:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 09:39:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:39:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9029 values 142360 bits 17795 bytes 
Sat 18 Jan 2014 09:39:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:39:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:39:40 - XML: Processed 655174 elements - found 484 jobs
Sat 18 Jan 2014 09:39:40 - job 7348780 report time 1390034101 does not match current heartbeat 1390034221 : ignoring job
Sat 18 Jan 2014 09:39:41 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:39:41 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:39:41 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:39:41 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:39:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:39:42 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:39:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:39:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:39:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:39:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:39:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:39:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:39:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:39:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:39:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:39:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:39:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:39:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:39:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:39:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:39:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:39:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:39:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43799291
Sat 18 Jan 2014 09:39:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:39:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43799291
Sat 18 Jan 2014 09:39:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:39:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:39:57 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:39:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:39:57 - job_xml_thread(): Done retrieving: data size 43799291
Sat 18 Jan 2014 09:39:57 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:39:57 - XML: Start document: iteration 14
Sat 18 Jan 2014 09:39:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:39:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:40:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:40:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:40:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:40:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:40:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:40:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:40:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:40:09 - XML: Processed 655174 elements - found 484 jobs
Sat 18 Jan 2014 09:40:09 - job 7348782 report time 1390034221 does not match current heartbeat 1390034342 : ignoring job
Sat 18 Jan 2014 09:40:09 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 09:40:09 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 09:40:09 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 09:40:09 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:40:09 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:40:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:40:10 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:40:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:40:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:40:10 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:40:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 09:40:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:40:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:40:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:40:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:40:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:40:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:40:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43780834
Sat 18 Jan 2014 09:40:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:40:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43780834
Sat 18 Jan 2014 09:40:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:40:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:40:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:40:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:40:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:40:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:40:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:40:24 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:40:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:40:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:40:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:40:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:40:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:40:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:40:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:40:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:40:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:40:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:40:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:40:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:40:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:40:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:40:27 - job_xml_thread(): Done retrieving: data size 43810180
Sat 18 Jan 2014 09:40:27 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:40:27 - XML: Start document: iteration 15
Sat 18 Jan 2014 09:40:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43810180
Sat 18 Jan 2014 09:40:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:40:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43810180
Sat 18 Jan 2014 09:40:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:40:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:40:30 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:40:31 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:40:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 09:40:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:40:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 09:40:31 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:40:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8841 values 139358 bits 17419 bytes 
Sat 18 Jan 2014 09:40:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:40:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:40:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:40:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:40:46 - XML: Processed 655174 elements - found 484 jobs
Sat 18 Jan 2014 09:40:46 - job 7348782 report time 1390034221 does not match current heartbeat 1390034342 : ignoring job
Sat 18 Jan 2014 09:40:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:40:46 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:40:46 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:40:46 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:40:46 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:40:47 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:40:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:40:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:40:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:40:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:40:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:40:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:40:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:40:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:40:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:40:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:40:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:40:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:40:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:40:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:40:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:40:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:40:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43816385
Sat 18 Jan 2014 09:40:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:40:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43816385
Sat 18 Jan 2014 09:40:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:41:02 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:41:02 - job_xml_thread(): Done retrieving: data size 43816385
Sat 18 Jan 2014 09:41:02 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:41:02 - XML: Start document: iteration 16
Sat 18 Jan 2014 09:41:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:41:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:41:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:41:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:41:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:41:05 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:41:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:41:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 09:41:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:41:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:41:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:41:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:41:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:41:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:41:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:41:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:41:12 - XML: Processed 655174 elements - found 484 jobs
Sat 18 Jan 2014 09:41:12 - job 7348782 report time 1390034221 does not match current heartbeat 1390034342 : ignoring job
Sat 18 Jan 2014 09:41:12 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:41:12 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:41:13 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:41:13 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:41:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:41:14 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:41:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:41:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:41:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:41:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:41:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:41:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:41:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:41:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43709005
Sat 18 Jan 2014 09:41:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:41:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43709005
Sat 18 Jan 2014 09:41:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:41:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:41:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:41:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:41:27 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:41:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:41:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:41:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:41:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:41:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:41:28 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:41:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:41:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:41:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:41:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:41:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:41:31 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:41:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:41:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:41:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:41:31 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:41:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:41:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:41:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:41:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:41:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:41:32 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:41:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 09:41:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 09:41:32 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:41:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6206 values 97874 bits 12234 bytes 
Sat 18 Jan 2014 09:41:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:41:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43344556
Sat 18 Jan 2014 09:41:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:41:33 - job_xml_thread(): Done retrieving: data size 43344556
Sat 18 Jan 2014 09:41:33 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:41:33 - XML: Start document: iteration 17
Sat 18 Jan 2014 09:41:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43344556
Sat 18 Jan 2014 09:41:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:41:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:41:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:41:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:41:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:41:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:41:49 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:41:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:41:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:41:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:41:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:41:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:41:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:41:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:41:50 - XML: Processed 649634 elements - found 483 jobs
Sat 18 Jan 2014 09:41:50 - job 7346472 appears to have finished
Sat 18 Jan 2014 09:41:50 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 09:41:50 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 09:41:51 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 09:41:51 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:41:51 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:41:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:41:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:41:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:41:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:41:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:41:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:41:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:41:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:41:57 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:41:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 09:41:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:41:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:41:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43160963
Sat 18 Jan 2014 09:41:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:41:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43160963
Sat 18 Jan 2014 09:41:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:42:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:42:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:42:06 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:42:06 - job_xml_thread(): Done retrieving: data size 43160963
Sat 18 Jan 2014 09:42:06 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:42:06 - XML: Start document: iteration 18
Sat 18 Jan 2014 09:42:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:42:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:42:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:42:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:42:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:42:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:42:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:42:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:42:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:42:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:42:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:42:18 - XML: Processed 647216 elements - found 483 jobs
Sat 18 Jan 2014 09:42:18 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:42:18 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:42:18 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:42:18 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:42:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:42:20 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:42:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:42:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:42:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:42:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:42:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:42:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:42:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:42:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43194219
Sat 18 Jan 2014 09:42:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:42:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43194219
Sat 18 Jan 2014 09:42:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:42:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:42:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:42:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:42:32 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:42:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:42:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:42:32 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:42:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:42:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:42:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:42:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:42:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:42:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:42:33 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:42:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 09:42:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:42:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 09:42:33 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:42:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6777 values 106911 bits 13363 bytes 
Sat 18 Jan 2014 09:42:33 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:42:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:42:35 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:42:36 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 09:42:36 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:42:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:42:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:42:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:42:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:42:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:42:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:42:37 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:42:37 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 09:42:37 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:42:37 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 09:42:37 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 09:42:38 - size of cluster 'LISA Cluster': 624 hosts 79477 metrics 840104 values 13241946 bits 1655243 bytes 
Sat 18 Jan 2014 09:42:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:42:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43538865
Sat 18 Jan 2014 09:42:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:42:41 - job_xml_thread(): Done retrieving: data size 43538865
Sat 18 Jan 2014 09:42:41 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:42:41 - XML: Start document: iteration 19
Sat 18 Jan 2014 09:42:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43538865
Sat 18 Jan 2014 09:42:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:42:41 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:42:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 09:42:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:42:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:42:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:42:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:42:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:42:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:42:53 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:42:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:42:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:42:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:42:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:42:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:42:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:42:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:43:00 - XML: Processed 651658 elements - found 483 jobs
Sat 18 Jan 2014 09:43:00 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:43:00 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:43:00 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:43:00 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:43:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:43:05 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:43:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:43:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:43:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:43:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:43:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:43:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:43:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:43:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43777410
Sat 18 Jan 2014 09:43:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:43:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43777410
Sat 18 Jan 2014 09:43:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:43:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:43:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:43:15 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:43:15 - job_xml_thread(): Done retrieving: data size 43777410
Sat 18 Jan 2014 09:43:15 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:43:15 - XML: Start document: iteration 20
Sat 18 Jan 2014 09:43:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:43:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:43:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:43:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:43:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:43:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:43:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:43:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:43:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:43:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:43:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:43:27 - XML: Processed 655172 elements - found 483 jobs
Sat 18 Jan 2014 09:43:27 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:43:27 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:43:27 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:43:27 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:43:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:43:30 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:43:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:43:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:43:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:43:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:43:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:43:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:43:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:43:33 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:43:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:43:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43764703
Sat 18 Jan 2014 09:43:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:43:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43764703
Sat 18 Jan 2014 09:43:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:43:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:43:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:43:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:43:34 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:43:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 09:43:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 09:43:34 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:43:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99067 bits 12383 bytes 
Sat 18 Jan 2014 09:43:37 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:43:37 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 09:43:42 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:43:42 - job_xml_thread(): Done retrieving: data size 43764703
Sat 18 Jan 2014 09:43:42 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:43:42 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 09:43:43 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 09:43:43 - Housekeeping: done.
Sat 18 Jan 2014 09:43:43 - XML: Start document: iteration 0
Sat 18 Jan 2014 09:43:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:43:46 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:43:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:43:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:43:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:43:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:43:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:43:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:43:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:43:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:43:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:43:58 - XML: Processed 655174 elements - found 484 jobs
Sat 18 Jan 2014 09:43:59 - job 7344351 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 09:43:59 - job 7348785 report time 1390034462 does not match current heartbeat 1390034583 : ignoring job
Sat 18 Jan 2014 09:43:59 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 09:43:59 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 09:43:59 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 09:43:59 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:43:59 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:43:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:43:59 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:43:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:43:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:43:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:43:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:43:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:43:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:44:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:44:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43776687
Sat 18 Jan 2014 09:44:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:44:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:44:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:44:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43776687
Sat 18 Jan 2014 09:44:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:44:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:44:13 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:44:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:44:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:44:14 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:44:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:44:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:44:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:44:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:44:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:44:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:44:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:44:17 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:44:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 09:44:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:44:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:44:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:44:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:44:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:44:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:44:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:44:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:44:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:44:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:44:20 - job_xml_thread(): Done retrieving: data size 43807950
Sat 18 Jan 2014 09:44:20 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:44:20 - XML: Start document: iteration 1
Sat 18 Jan 2014 09:44:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43807950
Sat 18 Jan 2014 09:44:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:44:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43807950
Sat 18 Jan 2014 09:44:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:44:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:44:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:44:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:44:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:44:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:44:34 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:44:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:44:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 09:44:35 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:44:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6094 values 96140 bits 12017 bytes 
Sat 18 Jan 2014 09:44:35 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:44:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 09:44:37 - XML: Processed 655170 elements - found 482 jobs
Sat 18 Jan 2014 09:44:37 - job 7348783 appears to have finished
Sat 18 Jan 2014 09:44:37 - job 7348785 report time 1390034462 does not match current heartbeat 1390034583 : ignoring job
Sat 18 Jan 2014 09:44:37 - job 7346464 appears to have finished
Sat 18 Jan 2014 09:44:37 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 09:44:38 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 09:44:39 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 09:44:39 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:44:39 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:44:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:44:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:44:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:44:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:44:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:44:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:44:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:44:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:44:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:44:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:44:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:44:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:44:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:44:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:44:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:44:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:44:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:44:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:44:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43797672
Sat 18 Jan 2014 09:44:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:44:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43797672
Sat 18 Jan 2014 09:44:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:44:55 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:44:55 - job_xml_thread(): Done retrieving: data size 43797672
Sat 18 Jan 2014 09:44:55 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:44:55 - XML: Start document: iteration 2
Sat 18 Jan 2014 09:44:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:44:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:45:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:45:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:45:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:45:07 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:45:07 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:45:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 09:45:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:45:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:45:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:45:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:45:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:45:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:45:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:45:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:45:10 - XML: Processed 655170 elements - found 482 jobs
Sat 18 Jan 2014 09:45:10 - job 7348785 report time 1390034462 does not match current heartbeat 1390034583 : ignoring job
Sat 18 Jan 2014 09:45:10 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:45:10 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:45:10 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:45:10 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:45:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:45:12 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:45:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:45:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:45:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:45:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:45:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:45:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:45:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:45:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43792900
Sat 18 Jan 2014 09:45:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:45:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43792900
Sat 18 Jan 2014 09:45:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:45:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:45:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:45:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:45:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:45:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:45:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:45:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:45:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:45:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43792900
Sat 18 Jan 2014 09:45:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:45:25 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:45:25 - job_xml_thread(): Done retrieving: data size 43792900
Sat 18 Jan 2014 09:45:25 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:45:25 - XML: Start document: iteration 3
Sat 18 Jan 2014 09:45:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:45:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:45:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:45:35 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:45:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:45:37 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:45:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 09:45:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 09:45:37 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:45:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5979 values 94303 bits 11787 bytes 
Sat 18 Jan 2014 09:45:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:45:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:45:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:45:43 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:45:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:45:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:45:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:45:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:45:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:45:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:45:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:45:45 - XML: Processed 655170 elements - found 482 jobs
Sat 18 Jan 2014 09:45:45 - job 7348785 report time 1390034462 does not match current heartbeat 1390034583 : ignoring job
Sat 18 Jan 2014 09:45:45 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:45:45 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:45:45 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:45:45 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:45:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:45:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:45:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:45:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:45:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:45:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:45:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:45:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:45:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:45:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43805849
Sat 18 Jan 2014 09:45:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:45:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43805849
Sat 18 Jan 2014 09:45:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:45:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:45:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:46:00 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:46:00 - job_xml_thread(): Done retrieving: data size 43805849
Sat 18 Jan 2014 09:46:00 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:46:00 - XML: Start document: iteration 4
Sat 18 Jan 2014 09:46:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:46:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:46:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:46:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:46:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:46:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:46:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:46:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:46:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:46:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:46:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:46:05 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:46:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 09:46:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:46:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:46:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:46:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:46:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:46:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:46:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:46:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:46:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:46:10 - XML: Processed 655168 elements - found 481 jobs
Sat 18 Jan 2014 09:46:10 - job 7348787 report time 1390034583 does not match current heartbeat 1390034703 : ignoring job
Sat 18 Jan 2014 09:46:10 - job 7344352 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 09:46:10 - job 7344347 appears to have finished
Sat 18 Jan 2014 09:46:10 - job_xml_thread(): Found 3 updated jobs.
Sat 18 Jan 2014 09:46:10 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 09:46:10 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Sat 18 Jan 2014 09:46:10 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:46:10 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:46:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:46:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43785107
Sat 18 Jan 2014 09:46:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:46:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43785107
Sat 18 Jan 2014 09:46:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:46:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:46:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:46:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:46:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:46:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:46:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:46:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:46:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:46:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:46:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:46:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:46:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:46:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:46:25 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:46:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:46:28 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:46:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:46:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:46:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:46:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:46:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:46:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:46:32 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 09:46:32 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 09:46:32 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:46:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:46:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43792657
Sat 18 Jan 2014 09:46:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:46:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43792657
Sat 18 Jan 2014 09:46:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:46:33 - job_xml_thread(): Done retrieving: data size 43792657
Sat 18 Jan 2014 09:46:33 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:46:33 - XML: Start document: iteration 5
Sat 18 Jan 2014 09:46:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:46:37 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:46:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:46:39 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:46:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:46:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:46:40 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:46:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:46:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 09:46:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 09:46:40 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:46:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9062 values 143150 bits 17893 bytes 
Sat 18 Jan 2014 09:46:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:46:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:46:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:46:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:46:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43792657
Sat 18 Jan 2014 09:46:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:46:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:46:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:46:54 - XML: Processed 655168 elements - found 481 jobs
Sat 18 Jan 2014 09:46:54 - job 7348787 report time 1390034583 does not match current heartbeat 1390034703 : ignoring job
Sat 18 Jan 2014 09:46:54 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:46:54 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:46:54 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:46:54 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:46:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:46:57 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:46:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:46:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:46:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:46:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:46:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:46:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:46:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:46:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:46:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:46:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:46:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:46:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:46:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:46:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:46:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:46:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:46:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:47:00 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:47:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 09:47:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:47:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:47:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43809823
Sat 18 Jan 2014 09:47:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:47:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43809823
Sat 18 Jan 2014 09:47:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:47:09 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:47:09 - job_xml_thread(): Done retrieving: data size 43809823
Sat 18 Jan 2014 09:47:09 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:47:09 - XML: Start document: iteration 6
Sat 18 Jan 2014 09:47:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:47:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:47:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:47:13 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:47:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:47:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:47:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:47:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:47:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:47:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:47:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:47:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:47:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:47:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:47:22 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:47:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:47:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:47:23 - XML: Processed 655168 elements - found 481 jobs
Sat 18 Jan 2014 09:47:23 - job 7348787 report time 1390034583 does not match current heartbeat 1390034703 : ignoring job
Sat 18 Jan 2014 09:47:23 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:47:23 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:47:23 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:47:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:47:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:47:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:47:23 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:47:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:47:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:47:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43739430
Sat 18 Jan 2014 09:47:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:47:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43739430
Sat 18 Jan 2014 09:47:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:47:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:47:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:47:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:47:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:47:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:47:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:47:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:47:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:47:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:47:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:47:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:47:38 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:47:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:47:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:47:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:47:39 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:47:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:47:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:47:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:47:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:47:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:47:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:47:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:47:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43234404
Sat 18 Jan 2014 09:47:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:47:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43234404
Sat 18 Jan 2014 09:47:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:47:41 - job_xml_thread(): Done retrieving: data size 43234404
Sat 18 Jan 2014 09:47:41 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:47:41 - XML: Start document: iteration 7
Sat 18 Jan 2014 09:47:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:47:41 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:47:42 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:47:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 09:47:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:47:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 09:47:42 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:47:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9298 values 147069 bits 18383 bytes 
Sat 18 Jan 2014 09:47:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:47:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:47:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:47:53 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:47:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:47:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:47:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:47:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:47:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:47:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:47:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:47:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:47:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:47:59 - XML: Processed 647950 elements - found 479 jobs
Sat 18 Jan 2014 09:47:59 - job 7344346 appears to have finished
Sat 18 Jan 2014 09:47:59 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 09:47:59 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 09:47:59 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 09:47:59 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:47:59 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:48:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:48:02 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:48:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:48:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:48:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:48:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:48:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:48:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:48:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:48:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43125525
Sat 18 Jan 2014 09:48:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:48:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43125525
Sat 18 Jan 2014 09:48:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:48:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:48:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:48:14 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:48:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:48:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:48:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:48:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:48:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:48:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:48:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:48:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:48:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:48:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:48:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:48:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:48:21 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:48:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:48:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:48:21 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:48:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 09:48:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:48:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:48:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:48:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:48:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:48:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:48:22 - job_xml_thread(): Done retrieving: data size 43211006
Sat 18 Jan 2014 09:48:22 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:48:22 - XML: Start document: iteration 8
Sat 18 Jan 2014 09:48:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43211006
Sat 18 Jan 2014 09:48:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:48:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43211006
Sat 18 Jan 2014 09:48:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:48:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:48:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:48:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:48:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:48:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:48:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:48:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:48:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:48:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:48:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:48:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:48:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:48:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:48:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:48:42 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:48:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:48:43 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:48:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:48:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:48:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:48:44 - XML: Processed 647714 elements - found 480 jobs
Sat 18 Jan 2014 09:48:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 09:48:44 - job 7348789 report time 1390034703 does not match current heartbeat 1390034824 : ignoring job
Sat 18 Jan 2014 09:48:44 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:48:44 - job 7344352 field 'start_timestamp' changed since saved from: 1390034744 to: 1390034658
Sat 18 Jan 2014 09:48:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 09:48:44 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:48:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5636 values 88977 bits 11122 bytes 
Sat 18 Jan 2014 09:48:44 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 09:48:44 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 09:48:44 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 09:48:44 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:48:44 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:48:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:48:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:48:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:48:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:48:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:48:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43709631
Sat 18 Jan 2014 09:48:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:48:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43709631
Sat 18 Jan 2014 09:48:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:48:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:48:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:48:59 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:48:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:48:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:48:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:48:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:48:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:48:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:48:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:49:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:49:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:49:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:49:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:49:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:49:02 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:49:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:49:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:49:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:49:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:49:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:49:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:49:03 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:49:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 09:49:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:49:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:49:04 - job_xml_thread(): Done retrieving: data size 43795456
Sat 18 Jan 2014 09:49:04 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:49:04 - XML: Start document: iteration 9
Sat 18 Jan 2014 09:49:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43795456
Sat 18 Jan 2014 09:49:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43795456
Sat 18 Jan 2014 09:49:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:49:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:49:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:49:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:49:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:49:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:49:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:49:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:49:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:49:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:49:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:49:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:49:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:49:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:49:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:49:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:49:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:49:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:49:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:49:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:49:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:49:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:49:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:49:27 - XML: Processed 655166 elements - found 480 jobs
Sat 18 Jan 2014 09:49:27 - job 7348789 report time 1390034703 does not match current heartbeat 1390034824 : ignoring job
Sat 18 Jan 2014 09:49:27 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:49:27 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:49:27 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:49:27 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:49:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:49:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43769719
Sat 18 Jan 2014 09:49:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:49:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43769719
Sat 18 Jan 2014 09:49:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:49:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:49:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:49:37 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 09:49:37 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:49:40 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:49:40 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 09:49:40 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 09:49:40 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:49:40 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 09:49:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:49:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:49:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:49:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:49:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:49:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:49:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:49:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:49:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:49:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:49:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:49:42 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:49:43 - size of cluster 'LISA Cluster': 624 hosts 79478 metrics 826631 values 13057495 bits 1632186 bytes 
Sat 18 Jan 2014 09:49:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:49:44 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:49:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:49:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:49:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:49:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 09:49:45 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:49:45 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:49:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 09:49:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8657 values 136515 bits 17064 bytes 
Sat 18 Jan 2014 09:49:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:49:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:49:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:49:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:49:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:49:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:49:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:49:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43792769
Sat 18 Jan 2014 09:49:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:49:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43792769
Sat 18 Jan 2014 09:49:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:49:49 - job_xml_thread(): Done retrieving: data size 43792769
Sat 18 Jan 2014 09:49:49 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:49:49 - XML: Start document: iteration 10
Sat 18 Jan 2014 09:49:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:49:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:50:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:50:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:50:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:50:07 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:50:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:50:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:50:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:50:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:50:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:50:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:50:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:50:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:50:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:50:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:50:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:50:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:50:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:50:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:50:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:50:11 - XML: Processed 655166 elements - found 480 jobs
Sat 18 Jan 2014 09:50:11 - job 7348791 report time 1390034824 does not match current heartbeat 1390034944 : ignoring job
Sat 18 Jan 2014 09:50:11 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 09:50:11 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 09:50:11 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 09:50:11 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:50:11 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:50:11 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:50:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 09:50:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:50:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:50:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43801153
Sat 18 Jan 2014 09:50:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:50:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43801153
Sat 18 Jan 2014 09:50:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:50:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:50:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:50:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:50:26 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:50:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:50:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:50:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:50:26 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:50:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:50:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:50:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:50:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:50:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:50:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:50:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:50:29 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:50:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:50:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:50:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:50:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:50:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:50:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:50:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:50:32 - job_xml_thread(): Done retrieving: data size 43793166
Sat 18 Jan 2014 09:50:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43793166
Sat 18 Jan 2014 09:50:32 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:50:32 - XML: Start document: iteration 11
Sat 18 Jan 2014 09:50:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:50:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43793166
Sat 18 Jan 2014 09:50:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:50:40 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:50:40 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 09:50:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:50:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:50:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:50:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:50:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:50:45 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:50:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:50:46 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:50:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 09:50:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 09:50:46 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:50:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9000 values 141978 bits 17747 bytes 
Sat 18 Jan 2014 09:50:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:50:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:50:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:50:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:50:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:50:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:50:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:50:56 - XML: Processed 655166 elements - found 480 jobs
Sat 18 Jan 2014 09:50:56 - job 7348791 report time 1390034824 does not match current heartbeat 1390034944 : ignoring job
Sat 18 Jan 2014 09:50:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:50:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:50:56 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:50:56 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:50:56 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:50:56 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:50:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:50:56 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:50:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:50:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:50:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:50:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:50:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:50:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:50:59 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:50:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 09:50:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:51:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:51:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43804631
Sat 18 Jan 2014 09:51:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:51:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43804631
Sat 18 Jan 2014 09:51:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:51:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:51:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:51:11 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:51:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:51:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:51:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:51:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:51:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:51:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:51:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:51:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:51:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:51:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:51:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:51:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:51:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:51:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:51:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:51:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:51:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:51:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:51:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:51:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:51:19 - job_xml_thread(): Done retrieving: data size 43793220
Sat 18 Jan 2014 09:51:19 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:51:19 - XML: Start document: iteration 12
Sat 18 Jan 2014 09:51:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43793220
Sat 18 Jan 2014 09:51:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43793220
Sat 18 Jan 2014 09:51:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:51:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:51:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:51:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:51:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:51:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:51:39 - XML: Processed 655166 elements - found 480 jobs
Sat 18 Jan 2014 09:51:39 - job 7348791 report time 1390034824 does not match current heartbeat 1390034944 : ignoring job
Sat 18 Jan 2014 09:51:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:51:39 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:51:39 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:51:39 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:51:39 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:51:39 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:51:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:51:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:51:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:51:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:51:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:51:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:51:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:51:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:51:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:51:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:51:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:51:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:51:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:51:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:51:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:51:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:51:46 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:51:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:51:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 09:51:47 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:51:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99053 bits 12381 bytes 
Sat 18 Jan 2014 09:51:47 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:51:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 09:51:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:51:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43791895
Sat 18 Jan 2014 09:51:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:51:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43791895
Sat 18 Jan 2014 09:51:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:51:55 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:51:55 - job_xml_thread(): Done retrieving: data size 43791895
Sat 18 Jan 2014 09:51:55 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:51:55 - XML: Start document: iteration 13
Sat 18 Jan 2014 09:51:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:51:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:51:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:51:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:52:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:52:02 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:52:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:52:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:52:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:52:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:52:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:52:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:52:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:52:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:52:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:52:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:52:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:52:10 - XML: Processed 655166 elements - found 480 jobs
Sat 18 Jan 2014 09:52:10 - job 7348793 report time 1390034944 does not match current heartbeat 1390035065 : ignoring job
Sat 18 Jan 2014 09:52:10 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 09:52:10 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 09:52:10 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 09:52:10 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:52:10 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:52:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:52:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:52:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:52:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:52:14 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:52:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 09:52:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:52:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:52:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43787095
Sat 18 Jan 2014 09:52:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:52:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43787095
Sat 18 Jan 2014 09:52:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:52:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:52:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:52:25 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:52:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:52:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:52:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:52:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:52:26 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:52:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:52:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:52:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:52:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:52:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:52:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:52:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:52:30 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:52:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:52:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:52:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:52:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:52:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:52:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:52:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:52:34 - job_xml_thread(): Done retrieving: data size 43787852
Sat 18 Jan 2014 09:52:34 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:52:34 - XML: Start document: iteration 14
Sat 18 Jan 2014 09:52:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43787852
Sat 18 Jan 2014 09:52:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:52:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43787852
Sat 18 Jan 2014 09:52:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:52:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:52:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:52:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:52:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:52:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:52:47 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:52:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:52:48 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:52:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 09:52:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 09:52:48 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:52:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6753 values 106539 bits 13317 bytes 
Sat 18 Jan 2014 09:52:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:52:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:52:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:52:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:52:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:52:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:52:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:52:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:52:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:52:58 - XML: Processed 655166 elements - found 480 jobs
Sat 18 Jan 2014 09:52:58 - job 7348793 report time 1390034944 does not match current heartbeat 1390035065 : ignoring job
Sat 18 Jan 2014 09:52:58 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:52:58 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:52:58 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:52:58 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:52:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:52:59 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:52:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:52:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:53:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:53:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:53:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:53:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:53:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:53:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43798986
Sat 18 Jan 2014 09:53:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:53:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43798986
Sat 18 Jan 2014 09:53:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:53:13 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:53:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:53:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:53:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:53:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:53:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:53:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:53:18 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:53:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:53:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:53:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:53:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:53:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:53:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:53:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:53:19 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:53:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:53:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:53:20 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:53:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 09:53:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:53:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:53:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:53:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:53:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:53:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:53:23 - job_xml_thread(): Done retrieving: data size 43735792
Sat 18 Jan 2014 09:53:23 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:53:23 - XML: Start document: iteration 15
Sat 18 Jan 2014 09:53:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43735792
Sat 18 Jan 2014 09:53:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:53:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43735792
Sat 18 Jan 2014 09:53:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:53:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:53:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:53:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:53:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:53:36 - XML: Processed 654418 elements - found 480 jobs
Sat 18 Jan 2014 09:53:36 - job 7348793 report time 1390034944 does not match current heartbeat 1390035065 : ignoring job
Sat 18 Jan 2014 09:53:37 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:53:37 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:53:37 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:53:37 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:53:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:53:42 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:53:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:53:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:53:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:53:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:53:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:53:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:53:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:53:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:53:46 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:53:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:53:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:53:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:53:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:53:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:53:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:53:48 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 09:53:48 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 09:53:48 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:53:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:53:48 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:53:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:53:48 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:53:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 09:53:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 09:53:48 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:53:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5793 values 91363 bits 11420 bytes 
Sat 18 Jan 2014 09:53:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:53:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43178608
Sat 18 Jan 2014 09:53:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:53:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43178608
Sat 18 Jan 2014 09:53:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:53:52 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:53:52 - job_xml_thread(): Done retrieving: data size 43178608
Sat 18 Jan 2014 09:53:52 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:53:52 - XML: Start document: iteration 16
Sat 18 Jan 2014 09:53:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:53:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:54:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:54:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:54:06 - XML: Processed 647596 elements - found 479 jobs
Sat 18 Jan 2014 09:54:06 - job 7346478 appears to have finished
Sat 18 Jan 2014 09:54:06 - job 7348795 report time 1390035065 does not match current heartbeat 1390035185 : ignoring job
Sat 18 Jan 2014 09:54:06 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 09:54:06 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 09:54:07 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 09:54:07 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:54:07 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:54:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:54:10 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:54:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:54:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:54:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:54:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:54:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:54:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:54:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:54:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:54:12 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:54:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:54:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:54:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:54:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:54:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:54:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:54:13 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:54:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 09:54:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:54:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:54:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43164636
Sat 18 Jan 2014 09:54:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:54:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43164636
Sat 18 Jan 2014 09:54:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:54:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:54:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:54:23 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:54:23 - job_xml_thread(): Done retrieving: data size 43164636
Sat 18 Jan 2014 09:54:23 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:54:23 - XML: Start document: iteration 17
Sat 18 Jan 2014 09:54:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:54:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:54:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:54:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:54:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:54:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:54:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:54:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:54:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:54:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:54:31 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:54:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:54:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:54:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:54:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:54:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:54:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:54:33 - XML: Processed 647086 elements - found 479 jobs
Sat 18 Jan 2014 09:54:33 - job 7348795 report time 1390035065 does not match current heartbeat 1390035185 : ignoring job
Sat 18 Jan 2014 09:54:33 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:54:33 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:54:33 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:54:33 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:54:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:54:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43658779
Sat 18 Jan 2014 09:54:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:54:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43658779
Sat 18 Jan 2014 09:54:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:54:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:54:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:54:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:54:47 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:54:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:54:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:54:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:54:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:54:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:54:48 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:54:49 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:54:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:54:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:54:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:54:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:54:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:54:49 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:54:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 09:54:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:54:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 09:54:49 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:54:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7620 values 120109 bits 15013 bytes 
Sat 18 Jan 2014 09:54:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:54:52 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:54:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:54:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:54:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:54:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:54:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:54:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:54:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:54:55 - job_xml_thread(): Done retrieving: data size 43774401
Sat 18 Jan 2014 09:54:55 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:54:55 - XML: Start document: iteration 18
Sat 18 Jan 2014 09:54:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43774401
Sat 18 Jan 2014 09:54:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43774401
Sat 18 Jan 2014 09:54:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:54:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:55:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:55:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:55:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:55:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:55:13 - XML: Processed 654752 elements - found 479 jobs
Sat 18 Jan 2014 09:55:13 - job 7348795 report time 1390035065 does not match current heartbeat 1390035185 : ignoring job
Sat 18 Jan 2014 09:55:13 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:55:13 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:55:13 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:55:14 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:55:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:55:14 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:55:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:55:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:55:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:55:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:55:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:55:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:55:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:55:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:55:16 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:55:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:55:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:55:16 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:55:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 09:55:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:55:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:55:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:55:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:55:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:55:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:55:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43793273
Sat 18 Jan 2014 09:55:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:55:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43793273
Sat 18 Jan 2014 09:55:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:55:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:55:29 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:55:29 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:55:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:55:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:55:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:55:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:55:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:55:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:55:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:55:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:55:31 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:55:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:55:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:55:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:55:32 - job_xml_thread(): Done retrieving: data size 43797731
Sat 18 Jan 2014 09:55:32 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:55:32 - XML: Start document: iteration 19
Sat 18 Jan 2014 09:55:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43797731
Sat 18 Jan 2014 09:55:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:55:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:55:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:55:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:55:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:55:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43797731
Sat 18 Jan 2014 09:55:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:55:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:55:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:55:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:55:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:55:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:55:49 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:55:50 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:55:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 09:55:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:55:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 09:55:51 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:55:51 - XML: Processed 655164 elements - found 479 jobs
Sat 18 Jan 2014 09:55:51 - job 7348797 report time 1390035185 does not match current heartbeat 1390035306 : ignoring job
Sat 18 Jan 2014 09:55:51 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 09:55:51 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 09:55:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8807 values 138878 bits 17359 bytes 
Sat 18 Jan 2014 09:55:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:55:52 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 09:55:52 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:55:52 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:55:52 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:55:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:55:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:55:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:55:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:55:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:55:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:55:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:55:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:55:57 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:55:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:55:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:55:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:55:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:55:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:55:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:55:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:55:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43817222
Sat 18 Jan 2014 09:55:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:56:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43817222
Sat 18 Jan 2014 09:56:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:56:08 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:56:08 - job_xml_thread(): Done retrieving: data size 43817222
Sat 18 Jan 2014 09:56:08 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:56:08 - XML: Start document: iteration 20
Sat 18 Jan 2014 09:56:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:56:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:56:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:56:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:56:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:56:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:56:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:56:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:56:16 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:56:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 09:56:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:56:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:56:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:56:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:56:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:56:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:56:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:56:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:56:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:56:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:56:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:56:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:56:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:56:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:56:20 - XML: Processed 655164 elements - found 479 jobs
Sat 18 Jan 2014 09:56:20 - job 7348797 report time 1390035185 does not match current heartbeat 1390035306 : ignoring job
Sat 18 Jan 2014 09:56:20 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:56:20 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:56:20 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:56:20 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:56:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:56:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43811531
Sat 18 Jan 2014 09:56:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:56:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43811531
Sat 18 Jan 2014 09:56:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:56:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:56:31 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:56:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:56:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:56:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:56:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:56:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:56:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:56:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:56:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:56:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:56:35 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:56:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:56:35 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:56:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:56:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:56:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:56:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:56:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:56:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:56:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:56:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43821153
Sat 18 Jan 2014 09:56:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:56:37 - job_xml_thread(): Done retrieving: data size 43821153
Sat 18 Jan 2014 09:56:37 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:56:38 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 09:56:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43821153
Sat 18 Jan 2014 09:56:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:56:40 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 09:56:40 - Housekeeping: done.
Sat 18 Jan 2014 09:56:40 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 09:56:40 - XML: Start document: iteration 0
Sat 18 Jan 2014 09:56:41 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:56:42 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:56:42 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 09:56:42 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:56:43 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 09:56:43 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 09:56:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:56:47 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:56:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:56:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:56:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:56:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:56:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:56:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:56:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:56:50 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:56:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:56:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:56:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:56:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:56:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 09:56:52 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:56:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 09:56:52 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:56:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9199 values 145034 bits 18129 bytes 
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sat 18 Jan 2014 09:56:58 - XML: Processed 655164 elements - found 479 jobs
Sat 18 Jan 2014 09:56:58 - job 7348797 report time 1390035185 does not match current heartbeat 1390035306 : ignoring job
Sat 18 Jan 2014 09:56:58 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:56:58 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:56:58 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:56:58 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:57:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:57:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:57:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:57:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:57:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:57:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:57:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:57:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:57:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:57:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43790167
Sat 18 Jan 2014 09:57:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:57:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43790167
Sat 18 Jan 2014 09:57:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:57:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:57:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:57:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:57:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:57:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:57:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:57:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:57:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:57:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:57:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:57:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:57:13 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:57:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:57:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:57:15 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:57:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 09:57:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:57:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:57:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:57:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:57:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43806883
Sat 18 Jan 2014 09:57:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:57:17 - job_xml_thread(): Done retrieving: data size 43806883
Sat 18 Jan 2014 09:57:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:57:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:57:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:57:17 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:57:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:57:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43806883
Sat 18 Jan 2014 09:57:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:57:17 - XML: Start document: iteration 1
Sat 18 Jan 2014 09:57:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:57:27 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:57:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:57:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:57:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:57:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:57:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:57:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:57:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:57:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:57:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:57:38 - XML: Processed 655162 elements - found 479 jobs
Sat 18 Jan 2014 09:57:38 - job 7348797 report time 1390035185 does not match current heartbeat 1390035306 : ignoring job
Sat 18 Jan 2014 09:57:38 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:57:38 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:57:38 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:57:38 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:57:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:57:39 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:57:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:57:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:57:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:57:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:57:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:57:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:57:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:57:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43789599
Sat 18 Jan 2014 09:57:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:57:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43789599
Sat 18 Jan 2014 09:57:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:57:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:57:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:57:43 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:57:43 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:57:45 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:57:45 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:57:45 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 09:57:46 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 09:57:46 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 09:57:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:57:50 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:57:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:57:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:57:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:57:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:57:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:57:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43789599
Sat 18 Jan 2014 09:57:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:57:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:57:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:57:52 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:57:53 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:57:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:57:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:57:53 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:57:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 09:57:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 09:57:53 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:57:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8608 values 135720 bits 16965 bytes 
Sat 18 Jan 2014 09:57:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:57:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:58:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:58:00 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:58:00 - size of cluster 'LISA Cluster': 624 hosts 79473 metrics 867278 values 13671747 bits 1708968 bytes 
Sat 18 Jan 2014 09:58:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:58:05 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:58:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:58:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:58:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:58:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:58:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:58:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:58:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:58:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:58:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:58:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:58:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:58:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:58:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:58:08 - job_xml_thread(): Done retrieving: data size 43773985
Sat 18 Jan 2014 09:58:08 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:58:08 - XML: Start document: iteration 2
Sat 18 Jan 2014 09:58:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43773985
Sat 18 Jan 2014 09:58:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:58:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43773985
Sat 18 Jan 2014 09:58:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:58:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:58:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:58:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:58:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:58:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:58:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:58:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:58:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:58:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:58:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:58:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:58:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:58:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:58:30 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:58:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 09:58:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:58:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:58:34 - XML: Processed 655162 elements - found 478 jobs
Sat 18 Jan 2014 09:58:34 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:58:34 - job 7344353 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 09:58:34 - job 7346481 appears to have finished
Sat 18 Jan 2014 09:58:34 - job_xml_thread(): Found 3 updated jobs.
Sat 18 Jan 2014 09:58:34 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 09:58:34 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Sat 18 Jan 2014 09:58:34 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:58:34 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:58:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:58:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:58:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:58:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:58:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:58:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:58:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:58:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43792462
Sat 18 Jan 2014 09:58:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43792462
Sat 18 Jan 2014 09:58:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:58:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:58:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:58:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:58:45 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:58:45 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 09:58:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:58:46 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:58:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:58:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:58:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:58:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:58:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:58:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43792462
Sat 18 Jan 2014 09:58:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:58:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:58:49 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:58:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:58:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:58:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:58:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:58:53 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:58:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:58:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 09:58:54 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:58:54 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:58:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 09:58:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5903 values 93079 bits 11634 bytes 
Sat 18 Jan 2014 09:58:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:58:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:58:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:58:59 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:58:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:58:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:59:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:59:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:59:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:59:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:59:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:59:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:59:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:59:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:59:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:59:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:59:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:59:03 - job_xml_thread(): Done retrieving: data size 43788785
Sat 18 Jan 2014 09:59:03 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:59:03 - XML: Start document: iteration 3
Sat 18 Jan 2014 09:59:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43788785
Sat 18 Jan 2014 09:59:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:59:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43788785
Sat 18 Jan 2014 09:59:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:59:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:59:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:59:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:59:17 - XML: Processed 655162 elements - found 478 jobs
Sat 18 Jan 2014 09:59:17 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:59:17 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:59:18 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:59:18 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:59:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:59:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:59:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:59:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:59:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:59:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:59:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:59:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:59:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:59:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:59:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:59:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:59:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:59:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:59:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:59:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:59:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:59:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:59:26 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:59:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 09:59:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:59:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:59:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43737798
Sat 18 Jan 2014 09:59:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:59:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43737798
Sat 18 Jan 2014 09:59:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 09:59:33 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 09:59:33 - job_xml_thread(): Done retrieving: data size 43737798
Sat 18 Jan 2014 09:59:33 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 09:59:33 - XML: Start document: iteration 4
Sat 18 Jan 2014 09:59:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:59:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:59:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 09:59:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 09:59:45 - XML: Processed 654409 elements - found 478 jobs
Sat 18 Jan 2014 09:59:45 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 09:59:45 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 09:59:45 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 09:59:46 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 09:59:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 09:59:49 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 09:59:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 09:59:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:59:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:59:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:59:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 09:59:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 09:59:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 09:59:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 09:59:52 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 09:59:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 09:59:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:59:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:59:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 09:59:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 09:59:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 09:59:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 09:59:55 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 09:59:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:59:55 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 09:59:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 09:59:55 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 09:59:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 09:59:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5853 values 92262 bits 11532 bytes 
Sat 18 Jan 2014 09:59:55 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 09:59:55 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 09:59:55 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 09:59:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 09:59:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43155570
Sat 18 Jan 2014 09:59:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 09:59:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43155570
Sat 18 Jan 2014 09:59:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:00:01 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:00:01 - job_xml_thread(): Done retrieving: data size 43155570
Sat 18 Jan 2014 10:00:01 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:00:01 - XML: Start document: iteration 5
Sat 18 Jan 2014 10:00:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:00:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:00:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:00:07 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:00:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:00:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:00:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:00:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:00:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:00:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:00:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:00:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:00:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:00:14 - XML: Processed 647048 elements - found 476 jobs
Sat 18 Jan 2014 10:00:14 - job 7348256 appears to have finished
Sat 18 Jan 2014 10:00:14 - job 7348798 appears to have finished
Sat 18 Jan 2014 10:00:14 - job 7344353 field 'start_timestamp' changed since saved from: 1390035427 to: 1390035426
Sat 18 Jan 2014 10:00:14 - job 7344349 appears to have finished
Sat 18 Jan 2014 10:00:14 - job_xml_thread(): Found 5 updated jobs.
Sat 18 Jan 2014 10:00:14 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 10:00:17 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Sat 18 Jan 2014 10:00:17 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:00:17 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:00:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:00:18 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:00:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:00:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:00:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:00:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:00:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:00:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:00:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:00:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43168675
Sat 18 Jan 2014 10:00:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:00:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43168675
Sat 18 Jan 2014 10:00:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:00:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:00:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:00:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:00:31 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:00:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:00:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:00:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:00:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:00:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:00:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:00:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:00:32 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:00:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:00:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:00:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:00:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:00:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:00:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:00:36 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:00:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 10:00:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:00:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:00:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:00:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:00:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:00:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:00:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43633230
Sat 18 Jan 2014 10:00:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:00:38 - job_xml_thread(): Done retrieving: data size 43633230
Sat 18 Jan 2014 10:00:38 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:00:38 - XML: Start document: iteration 6
Sat 18 Jan 2014 10:00:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43633230
Sat 18 Jan 2014 10:00:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:00:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:00:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:00:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:00:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:00:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:00:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:00:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:00:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:00:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:00:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:00:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:00:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:00:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:00:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:00:55 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:00:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:00:55 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:00:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 10:00:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 10:00:55 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:00:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6100 values 96168 bits 12021 bytes 
Sat 18 Jan 2014 10:00:59 - XML: Processed 653249 elements - found 476 jobs
Sat 18 Jan 2014 10:00:59 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:00:59 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:00:59 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:00:59 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:01:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:01:02 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:01:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:01:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:01:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:01:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:01:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:01:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:01:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:01:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43785748
Sat 18 Jan 2014 10:01:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:01:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43785748
Sat 18 Jan 2014 10:01:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:01:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:01:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:01:14 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:01:14 - job_xml_thread(): Done retrieving: data size 43785748
Sat 18 Jan 2014 10:01:14 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:01:14 - XML: Start document: iteration 7
Sat 18 Jan 2014 10:01:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:01:15 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:01:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:01:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:01:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:01:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:01:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:01:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:01:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:01:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:01:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:01:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:01:22 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:01:22 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:01:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 10:01:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:01:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:01:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:01:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:01:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:01:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:01:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:01:24 - XML: Processed 655078 elements - found 476 jobs
Sat 18 Jan 2014 10:01:24 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:01:24 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:01:24 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:01:24 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:01:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:01:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43784570
Sat 18 Jan 2014 10:01:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:01:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43784570
Sat 18 Jan 2014 10:01:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:01:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:01:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:01:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:01:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:01:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:01:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:01:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:01:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:01:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:01:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:01:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:01:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:01:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:01:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:01:39 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:01:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:01:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:01:39 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:01:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:01:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:01:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:01:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:01:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:01:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43812125
Sat 18 Jan 2014 10:01:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:01:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43812125
Sat 18 Jan 2014 10:01:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:01:42 - job_xml_thread(): Done retrieving: data size 43812125
Sat 18 Jan 2014 10:01:42 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:01:42 - XML: Start document: iteration 8
Sat 18 Jan 2014 10:01:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:01:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:01:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:01:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:01:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:01:56 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:01:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:01:56 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:01:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:01:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:01:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:01:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:01:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:01:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:01:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:01:57 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:01:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 10:01:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 10:01:57 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:01:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9084 values 143542 bits 17942 bytes 
Sat 18 Jan 2014 10:01:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:02:01 - XML: Processed 655156 elements - found 475 jobs
Sat 18 Jan 2014 10:02:01 - job 7348800 appears to have finished
Sat 18 Jan 2014 10:02:01 - job 7348802 report time 1390035547 does not match current heartbeat 1390035667 : ignoring job
Sat 18 Jan 2014 10:02:01 - job 7346466 appears to have finished
Sat 18 Jan 2014 10:02:01 - job_xml_thread(): Found 3 updated jobs.
Sat 18 Jan 2014 10:02:01 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 10:02:02 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Sat 18 Jan 2014 10:02:02 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:02:02 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:02:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:02:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:02:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:02:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:02:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:02:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:02:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:02:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:02:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:02:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43786681
Sat 18 Jan 2014 10:02:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:02:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43786681
Sat 18 Jan 2014 10:02:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:02:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:02:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:02:17 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:02:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:02:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:02:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:02:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:02:19 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:02:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:02:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:02:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:02:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:02:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:02:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:02:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:02:20 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:02:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:02:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:02:20 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:02:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 10:02:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:02:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:02:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:02:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:02:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:02:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:02:22 - job_xml_thread(): Done retrieving: data size 43799279
Sat 18 Jan 2014 10:02:22 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:02:22 - XML: Start document: iteration 9
Sat 18 Jan 2014 10:02:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43799279
Sat 18 Jan 2014 10:02:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43799279
Sat 18 Jan 2014 10:02:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:02:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:02:35 - XML: Processed 655156 elements - found 475 jobs
Sat 18 Jan 2014 10:02:35 - job 7348802 report time 1390035547 does not match current heartbeat 1390035667 : ignoring job
Sat 18 Jan 2014 10:02:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:02:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:02:35 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:02:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:02:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:02:36 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:02:36 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:02:36 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:02:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:02:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:02:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:02:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:02:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:02:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:02:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:02:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:02:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:02:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:02:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:02:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:02:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:02:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:02:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:02:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:02:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:02:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:02:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43822480
Sat 18 Jan 2014 10:02:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:02:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43822480
Sat 18 Jan 2014 10:02:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:02:51 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:02:51 - job_xml_thread(): Done retrieving: data size 43822480
Sat 18 Jan 2014 10:02:51 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:02:51 - XML: Start document: iteration 10
Sat 18 Jan 2014 10:02:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:02:57 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:02:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:02:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:02:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:02:58 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:02:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 10:02:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 10:02:58 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:02:59 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9006 values 142498 bits 17812 bytes 
Sat 18 Jan 2014 10:03:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:03:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:03:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:03:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:03:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:03:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:03:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:03:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:03:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:03:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:03:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:03:07 - XML: Processed 655156 elements - found 475 jobs
Sat 18 Jan 2014 10:03:07 - job 7348802 report time 1390035547 does not match current heartbeat 1390035667 : ignoring job
Sat 18 Jan 2014 10:03:07 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:03:07 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:03:07 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:03:07 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:03:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:03:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:03:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:03:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:03:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:03:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:03:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:03:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:03:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:03:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43801472
Sat 18 Jan 2014 10:03:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:03:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43801472
Sat 18 Jan 2014 10:03:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:03:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:03:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:03:22 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:03:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:03:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:03:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:03:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:03:25 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:03:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:03:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:03:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:03:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:03:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:03:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:03:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:03:28 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:03:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:03:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:03:28 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:03:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 10:03:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:03:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:03:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:03:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:03:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:03:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:03:30 - job_xml_thread(): Done retrieving: data size 43807332
Sat 18 Jan 2014 10:03:30 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:03:30 - XML: Start document: iteration 11
Sat 18 Jan 2014 10:03:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43807332
Sat 18 Jan 2014 10:03:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:03:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43807332
Sat 18 Jan 2014 10:03:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:03:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:03:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:03:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:03:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:03:47 - XML: Processed 655156 elements - found 475 jobs
Sat 18 Jan 2014 10:03:47 - job 7348802 report time 1390035547 does not match current heartbeat 1390035667 : ignoring job
Sat 18 Jan 2014 10:03:48 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:03:48 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:03:48 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:03:48 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:03:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:03:48 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:03:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:03:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:03:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:03:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:03:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:03:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:03:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:03:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:03:52 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:03:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:03:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:03:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:03:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:03:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:03:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:03:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:03:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43805786
Sat 18 Jan 2014 10:03:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:03:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43805786
Sat 18 Jan 2014 10:03:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:03:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:03:59 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:04:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:04:01 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:04:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 10:04:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 10:04:01 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:04:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8984 values 141877 bits 17734 bytes 
Sat 18 Jan 2014 10:04:03 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:04:03 - job_xml_thread(): Done retrieving: data size 43805786
Sat 18 Jan 2014 10:04:03 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:04:03 - XML: Start document: iteration 12
Sat 18 Jan 2014 10:04:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:04:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:04:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:04:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:04:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:04:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:04:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:04:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:04:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:04:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:04:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:04:13 - XML: Processed 655156 elements - found 475 jobs
Sat 18 Jan 2014 10:04:13 - job 7348804 report time 1390035667 does not match current heartbeat 1390035788 : ignoring job
Sat 18 Jan 2014 10:04:13 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 10:04:13 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 10:04:13 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 10:04:13 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:04:13 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:04:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:04:16 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:04:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:04:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:04:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:04:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:04:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:04:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:04:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:04:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43798049
Sat 18 Jan 2014 10:04:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:04:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43798049
Sat 18 Jan 2014 10:04:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:04:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:04:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:04:28 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:04:28 - job_xml_thread(): Done retrieving: data size 43798049
Sat 18 Jan 2014 10:04:28 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:04:28 - XML: Start document: iteration 13
Sat 18 Jan 2014 10:04:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:04:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:04:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:04:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:04:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:04:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:04:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:04:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:04:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:04:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:04:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:04:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:04:38 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:04:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:04:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:04:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:04:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:04:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:04:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:04:41 - XML: Processed 655156 elements - found 475 jobs
Sat 18 Jan 2014 10:04:41 - job 7348804 report time 1390035667 does not match current heartbeat 1390035788 : ignoring job
Sat 18 Jan 2014 10:04:41 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:04:41 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:04:41 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:04:41 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:04:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 10:04:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:04:41 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:04:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:04:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43800342
Sat 18 Jan 2014 10:04:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:04:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43800342
Sat 18 Jan 2014 10:04:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:04:46 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 10:04:46 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:04:46 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:04:46 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:04:46 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 10:04:47 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 10:04:48 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 10:04:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:04:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sat 18 Jan 2014 10:04:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:04:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:04:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:04:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:04:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:04:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:04:56 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:04:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:04:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:04:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:04:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:04:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:04:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:04:56 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:04:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:04:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:04:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:04:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:04:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:04:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:04:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:04:58 - job_xml_thread(): Done retrieving: data size 43818001
Sat 18 Jan 2014 10:04:58 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:04:58 - XML: Start document: iteration 14
Sat 18 Jan 2014 10:04:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43818001
Sat 18 Jan 2014 10:04:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:04:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43818001
Sat 18 Jan 2014 10:04:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:05:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:05:01 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:05:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:05:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 10:05:05 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:05:05 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:05:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 10:05:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9155 values 144481 bits 18060 bytes 
Sat 18 Jan 2014 10:05:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:05:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:05:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:05:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:05:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:05:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:05:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:05:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:05:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:05:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:05:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:05:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:05:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:05:19 - XML: Processed 655156 elements - found 475 jobs
Sat 18 Jan 2014 10:05:19 - job 7348804 report time 1390035667 does not match current heartbeat 1390035788 : ignoring job
Sat 18 Jan 2014 10:05:19 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:05:19 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:05:19 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:05:19 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:05:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:05:20 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:05:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:05:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:05:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:05:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:05:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:05:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:05:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:05:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43711656
Sat 18 Jan 2014 10:05:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:05:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43711656
Sat 18 Jan 2014 10:05:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:05:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:05:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:05:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:05:32 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:05:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:05:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:05:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:05:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:05:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:05:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:05:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:05:34 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:05:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:05:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:05:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:05:37 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:05:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:05:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:05:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:05:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:05:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:05:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:05:38 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:05:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 10:05:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:05:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:05:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43260704
Sat 18 Jan 2014 10:05:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:05:40 - job_xml_thread(): Done retrieving: data size 43260704
Sat 18 Jan 2014 10:05:40 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:05:40 - XML: Start document: iteration 15
Sat 18 Jan 2014 10:05:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43260704
Sat 18 Jan 2014 10:05:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:05:47 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:05:47 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:05:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:05:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:05:50 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:05:50 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 10:05:50 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:05:50 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 10:05:50 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 10:05:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:05:51 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:05:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:05:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:05:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:05:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:05:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:05:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:05:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:05:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:05:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:05:58 - XML: Processed 648560 elements - found 473 jobs
Sat 18 Jan 2014 10:05:58 - job 7348806 report time 1390035788 does not match current heartbeat 1390035908 : ignoring job
Sat 18 Jan 2014 10:05:58 - job 7344354 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 10:05:58 - job 7344350 appears to have finished
Sat 18 Jan 2014 10:05:58 - job 7346469 appears to have finished
Sat 18 Jan 2014 10:05:58 - job_xml_thread(): Found 4 updated jobs.
Sat 18 Jan 2014 10:05:58 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 10:06:01 - size of cluster 'LISA Cluster': 624 hosts 79474 metrics 983123 values 15522117 bits 1940264 bytes 
Sat 18 Jan 2014 10:06:02 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Sat 18 Jan 2014 10:06:02 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:06:02 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:06:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:06:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:06:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:06:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:06:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:06:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:06:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:06:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:06:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:06:06 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:06:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:06:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 10:06:07 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:06:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5550 values 87514 bits 10939 bytes 
Sat 18 Jan 2014 10:06:07 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:06:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 10:06:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:06:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43126398
Sat 18 Jan 2014 10:06:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:06:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43126398
Sat 18 Jan 2014 10:06:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:06:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:06:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:06:17 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:06:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:06:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:06:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:06:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:06:20 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:06:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:06:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:06:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:06:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:06:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:06:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:06:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:06:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:06:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:06:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:06:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:06:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:06:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:06:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:06:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:06:28 - job_xml_thread(): Done retrieving: data size 43188538
Sat 18 Jan 2014 10:06:28 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:06:28 - XML: Start document: iteration 16
Sat 18 Jan 2014 10:06:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43188538
Sat 18 Jan 2014 10:06:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:06:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43188538
Sat 18 Jan 2014 10:06:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:06:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:06:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:06:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:06:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:06:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:06:42 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:06:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:06:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:06:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:06:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:06:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:06:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:06:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:06:49 - XML: Processed 647700 elements - found 473 jobs
Sat 18 Jan 2014 10:06:49 - job 7348806 report time 1390035788 does not match current heartbeat 1390035908 : ignoring job
Sat 18 Jan 2014 10:06:50 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:06:50 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:06:50 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:06:50 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:06:50 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:06:50 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 10:06:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:06:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:06:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:06:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:06:52 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:06:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 10:06:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:06:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:06:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:06:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:06:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:06:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:06:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43764019
Sat 18 Jan 2014 10:06:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:06:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43764019
Sat 18 Jan 2014 10:06:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:06:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:06:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:07:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:07:03 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:07:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:07:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:07:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:07:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:07:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:07:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:07:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43764019
Sat 18 Jan 2014 10:07:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:07:05 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:07:05 - job_xml_thread(): Done retrieving: data size 43764019
Sat 18 Jan 2014 10:07:05 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:07:05 - XML: Start document: iteration 17
Sat 18 Jan 2014 10:07:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:07:07 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:07:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:07:08 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:07:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 10:07:08 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:07:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 10:07:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5847 values 92185 bits 11523 bytes 
Sat 18 Jan 2014 10:07:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:07:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:07:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:07:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:07:19 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:07:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:07:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:07:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:07:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:07:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:07:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:07:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:07:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:07:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:07:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:07:25 - XML: Processed 654972 elements - found 473 jobs
Sat 18 Jan 2014 10:07:25 - job 7348806 report time 1390035788 does not match current heartbeat 1390035908 : ignoring job
Sat 18 Jan 2014 10:07:25 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:07:25 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:07:25 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:07:25 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:07:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:07:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:07:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:07:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:07:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:07:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43782960
Sat 18 Jan 2014 10:07:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:07:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43782960
Sat 18 Jan 2014 10:07:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:07:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:07:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:07:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:07:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:07:40 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:07:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:07:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:07:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:07:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:07:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:07:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:07:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:07:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:07:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:07:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:07:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:07:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:07:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:07:45 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:07:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 10:07:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:07:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:07:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:07:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:07:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:07:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:07:49 - job_xml_thread(): Done retrieving: data size 43796111
Sat 18 Jan 2014 10:07:49 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:07:49 - XML: Start document: iteration 18
Sat 18 Jan 2014 10:07:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43796111
Sat 18 Jan 2014 10:07:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:07:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43796111
Sat 18 Jan 2014 10:07:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:07:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:07:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:08:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:08:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:08:05 - XML: Processed 655152 elements - found 473 jobs
Sat 18 Jan 2014 10:08:05 - job 7348808 report time 1390035908 does not match current heartbeat 1390036029 : ignoring job
Sat 18 Jan 2014 10:08:05 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 10:08:05 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 10:08:05 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 10:08:05 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:08:05 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:08:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:08:08 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:08:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:08:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 10:08:08 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:08:08 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:08:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 10:08:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:08:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:08:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5867 values 92570 bits 11571 bytes 
Sat 18 Jan 2014 10:08:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:08:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:08:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:08:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:08:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:08:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:08:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:08:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:08:13 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:08:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:08:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:08:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:08:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:08:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:08:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:08:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:08:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43795026
Sat 18 Jan 2014 10:08:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:08:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43795026
Sat 18 Jan 2014 10:08:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:08:21 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:08:21 - job_xml_thread(): Done retrieving: data size 43795026
Sat 18 Jan 2014 10:08:21 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:08:22 - XML: Start document: iteration 19
Sat 18 Jan 2014 10:08:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:08:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:08:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:08:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:08:32 - XML: Processed 655152 elements - found 473 jobs
Sat 18 Jan 2014 10:08:32 - job 7348808 report time 1390035908 does not match current heartbeat 1390036029 : ignoring job
Sat 18 Jan 2014 10:08:32 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:08:32 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:08:32 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:08:32 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:08:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:08:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:08:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:08:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:08:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:08:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:08:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:08:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:08:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:08:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:08:40 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:08:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:08:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:08:40 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:08:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 10:08:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:08:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:08:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:08:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:08:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:08:43 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 10:08:43 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 10:08:43 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:08:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:08:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43794954
Sat 18 Jan 2014 10:08:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:08:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43794954
Sat 18 Jan 2014 10:08:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:08:48 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:08:48 - job_xml_thread(): Done retrieving: data size 43794954
Sat 18 Jan 2014 10:08:48 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:08:48 - XML: Start document: iteration 20
Sat 18 Jan 2014 10:08:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:08:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:08:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:08:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:09:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:09:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:09:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:09:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:09:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:09:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:09:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:09:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:09:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:09:06 - XML: Processed 655152 elements - found 473 jobs
Sat 18 Jan 2014 10:09:06 - job 7348808 report time 1390035908 does not match current heartbeat 1390036029 : ignoring job
Sat 18 Jan 2014 10:09:07 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:09:07 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:09:07 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:09:07 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:09:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:09:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:09:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:09:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:09:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:09:08 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:09:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:09:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:09:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:09:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:09:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:09:09 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:09:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 10:09:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 10:09:09 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:09:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6093 values 96065 bits 12008 bytes 
Sat 18 Jan 2014 10:09:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:09:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43789025
Sat 18 Jan 2014 10:09:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:09:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43789025
Sat 18 Jan 2014 10:09:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:09:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:09:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:09:22 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:09:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:09:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:09:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:09:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:09:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:09:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:09:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:09:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:09:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:09:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:09:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:09:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:09:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:09:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:09:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:09:27 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:09:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 10:09:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:09:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:09:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:09:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:09:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:09:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:09:29 - job_xml_thread(): Done retrieving: data size 43794714
Sat 18 Jan 2014 10:09:29 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:09:29 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 10:09:29 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 10:09:29 - Housekeeping: done.
Sat 18 Jan 2014 10:09:29 - XML: Start document: iteration 0
Sat 18 Jan 2014 10:09:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43794714
Sat 18 Jan 2014 10:09:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:09:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43794714
Sat 18 Jan 2014 10:09:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:09:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:09:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:09:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:09:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:09:47 - XML: Processed 655152 elements - found 473 jobs
Sat 18 Jan 2014 10:09:47 - job 7348808 report time 1390035908 does not match current heartbeat 1390036029 : ignoring job
Sat 18 Jan 2014 10:09:47 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:09:47 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:09:48 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:09:48 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:09:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:09:50 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:09:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:09:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:09:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:09:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:09:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:09:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:09:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:09:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:09:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:09:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:09:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:09:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:09:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:09:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:09:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:09:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:09:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43808698
Sat 18 Jan 2014 10:09:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:09:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43808698
Sat 18 Jan 2014 10:09:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:10:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:10:02 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:10:03 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:10:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:10:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:10:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:10:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:10:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:10:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:10:06 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:10:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:10:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:10:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:10:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:10:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:10:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:10:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:10:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:10:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:10:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:10:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:10:08 - job_xml_thread(): Done retrieving: data size 43801781
Sat 18 Jan 2014 10:10:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43801781
Sat 18 Jan 2014 10:10:08 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:10:08 - XML: Start document: iteration 1
Sat 18 Jan 2014 10:10:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:10:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43801781
Sat 18 Jan 2014 10:10:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:10:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:10:09 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:10:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:10:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 10:10:10 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:10:10 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:10:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 10:10:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8102 values 127704 bits 15963 bytes 
Sat 18 Jan 2014 10:10:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:10:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:10:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:10:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:10:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:10:26 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:10:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:10:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:10:27 - XML: Processed 655152 elements - found 473 jobs
Sat 18 Jan 2014 10:10:27 - job 7348810 report time 1390036029 does not match current heartbeat 1390036149 : ignoring job
Sat 18 Jan 2014 10:10:27 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 10:10:27 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 10:10:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:10:27 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 10:10:27 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:10:27 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:10:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:10:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:10:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:10:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:10:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:10:31 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:10:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:10:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:10:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:10:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:10:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:10:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:10:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:10:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43804860
Sat 18 Jan 2014 10:10:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:10:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43804860
Sat 18 Jan 2014 10:10:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:10:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:10:42 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:10:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:10:42 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:10:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:10:42 - job_xml_thread(): Done retrieving: data size 43804860
Sat 18 Jan 2014 10:10:42 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:10:42 - XML: Start document: iteration 2
Sat 18 Jan 2014 10:10:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:10:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:10:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:10:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:10:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:10:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:10:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:10:48 - XML: Processed 655152 elements - found 473 jobs
Sat 18 Jan 2014 10:10:48 - job 7348810 report time 1390036029 does not match current heartbeat 1390036149 : ignoring job
Sat 18 Jan 2014 10:10:48 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:10:48 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:10:48 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:10:48 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:10:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:10:53 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:10:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:10:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:10:53 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:10:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 10:10:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:10:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:10:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:10:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:10:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:10:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:10:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43783274
Sat 18 Jan 2014 10:10:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:10:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43783274
Sat 18 Jan 2014 10:10:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:10:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:10:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:11:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:11:03 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:11:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:11:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:11:04 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:11:04 - job_xml_thread(): Done retrieving: data size 43783274
Sat 18 Jan 2014 10:11:04 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:11:04 - XML: Start document: iteration 3
Sat 18 Jan 2014 10:11:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:11:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:11:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:11:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:11:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:11:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:11:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:11:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:11:11 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:11:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:11:11 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:11:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:11:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:11:12 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:11:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:11:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 10:11:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 10:11:12 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:11:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5957 values 93925 bits 11740 bytes 
Sat 18 Jan 2014 10:11:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:11:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:11:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:11:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:11:14 - XML: Processed 655152 elements - found 473 jobs
Sat 18 Jan 2014 10:11:15 - job 7348810 report time 1390036029 does not match current heartbeat 1390036149 : ignoring job
Sat 18 Jan 2014 10:11:15 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:11:15 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:11:15 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:11:15 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:11:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:11:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43724641
Sat 18 Jan 2014 10:11:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:11:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43724641
Sat 18 Jan 2014 10:11:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:11:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:11:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:11:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:11:27 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:11:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:11:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:11:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:11:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:11:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:11:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:11:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:11:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:11:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:11:30 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:11:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:11:32 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:11:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:11:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:11:32 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:11:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 10:11:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:11:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:11:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:11:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:11:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:11:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:11:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43323994
Sat 18 Jan 2014 10:11:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:11:34 - job_xml_thread(): Done retrieving: data size 43323994
Sat 18 Jan 2014 10:11:34 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:11:34 - XML: Start document: iteration 4
Sat 18 Jan 2014 10:11:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43323994
Sat 18 Jan 2014 10:11:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:11:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:11:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:11:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:11:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:11:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:11:49 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:11:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:11:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:11:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:11:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:11:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:11:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:11:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:11:56 - XML: Processed 649338 elements - found 473 jobs
Sat 18 Jan 2014 10:11:56 - job 7348810 report time 1390036029 does not match current heartbeat 1390036149 : ignoring job
Sat 18 Jan 2014 10:11:56 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:11:56 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:11:56 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:11:56 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:11:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:11:56 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:11:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:11:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:11:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:11:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:11:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:11:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:11:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:11:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43139658
Sat 18 Jan 2014 10:11:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:11:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43139658
Sat 18 Jan 2014 10:11:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:12:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:12:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:12:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:12:07 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:12:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:12:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:12:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:12:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:12:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43139658
Sat 18 Jan 2014 10:12:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:12:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:12:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:12:12 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:12:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:12:12 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:12:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:12:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:12:12 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:12:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 10:12:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 10:12:12 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:12:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:12:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:12:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9012 values 142138 bits 17767 bytes 
Sat 18 Jan 2014 10:12:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:12:19 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:12:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:12:20 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:12:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:12:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:12:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:12:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:12:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:12:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:12:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:12:23 - job_xml_thread(): Done retrieving: data size 43172067
Sat 18 Jan 2014 10:12:23 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:12:23 - XML: Start document: iteration 5
Sat 18 Jan 2014 10:12:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43172067
Sat 18 Jan 2014 10:12:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:12:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:12:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:12:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:12:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:12:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43172067
Sat 18 Jan 2014 10:12:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:12:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:12:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:12:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:12:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:12:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:12:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:12:42 - XML: Processed 647700 elements - found 473 jobs
Sat 18 Jan 2014 10:12:43 - job 7348812 report time 1390036149 does not match current heartbeat 1390036270 : ignoring job
Sat 18 Jan 2014 10:12:43 - job 7344355 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 10:12:43 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 10:12:43 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 10:12:44 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 10:12:44 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:12:44 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:12:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:12:44 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:12:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:12:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:12:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:12:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:12:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:12:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:12:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:12:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:12:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:12:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:12:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:12:47 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:12:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 10:12:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:12:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:12:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:12:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:12:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:12:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:12:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43714221
Sat 18 Jan 2014 10:12:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:12:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43714221
Sat 18 Jan 2014 10:12:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:12:51 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 10:12:51 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:12:52 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:12:52 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:12:52 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 10:12:52 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 10:12:52 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 10:12:56 - size of cluster 'LISA Cluster': 624 hosts 79468 metrics 886023 values 13969956 bits 1746244 bytes 
Sat 18 Jan 2014 10:12:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:12:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:12:59 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:12:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:13:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:13:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:13:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:13:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:13:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:13:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:13:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:13:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:13:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:13:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:13:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:13:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:13:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:13:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:13:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:13:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:13:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:13:06 - job_xml_thread(): Done retrieving: data size 43785314
Sat 18 Jan 2014 10:13:06 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:13:06 - XML: Start document: iteration 6
Sat 18 Jan 2014 10:13:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43785314
Sat 18 Jan 2014 10:13:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:13:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43785314
Sat 18 Jan 2014 10:13:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:13:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:13:12 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:13:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:13:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 10:13:14 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:13:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 10:13:14 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:13:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8877 values 139999 bits 17499 bytes 
Sat 18 Jan 2014 10:13:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:13:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:13:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:13:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:13:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:13:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:13:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:13:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:13:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:13:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:13:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:13:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:13:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:13:26 - XML: Processed 655140 elements - found 473 jobs
Sat 18 Jan 2014 10:13:27 - job 7348812 report time 1390036149 does not match current heartbeat 1390036270 : ignoring job
Sat 18 Jan 2014 10:13:27 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:13:27 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:13:27 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:13:27 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:13:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:13:29 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:13:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:13:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:13:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:13:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:13:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:13:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:13:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:13:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43791732
Sat 18 Jan 2014 10:13:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:13:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43791732
Sat 18 Jan 2014 10:13:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:13:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:13:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:13:42 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:13:42 - job_xml_thread(): Done retrieving: data size 43791732
Sat 18 Jan 2014 10:13:42 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:13:42 - XML: Start document: iteration 7
Sat 18 Jan 2014 10:13:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:13:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:13:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:13:47 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:13:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:13:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:13:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:13:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:13:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:13:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:13:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:13:49 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:13:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 10:13:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:13:52 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:13:52 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 10:13:55 - XML: Processed 655152 elements - found 473 jobs
Sat 18 Jan 2014 10:13:55 - job 7348812 report time 1390036149 does not match current heartbeat 1390036270 : ignoring job
Sat 18 Jan 2014 10:13:55 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:13:55 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:13:55 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:13:55 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:13:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:13:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:13:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:13:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:13:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:13:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:13:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:13:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:13:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:13:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43779710
Sat 18 Jan 2014 10:13:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:13:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43779710
Sat 18 Jan 2014 10:13:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:14:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:14:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:14:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:14:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:14:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:14:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:14:10 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:14:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:14:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:14:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:14:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:14:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:14:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:14:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:14:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:14:14 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:14:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:14:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:14:14 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:14:14 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:14:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 10:14:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 10:14:14 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:14:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5971 values 94169 bits 11771 bytes 
Sat 18 Jan 2014 10:14:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:14:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:14:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:14:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:14:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:14:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:14:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:14:17 - job_xml_thread(): Done retrieving: data size 43806269
Sat 18 Jan 2014 10:14:17 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:14:17 - XML: Start document: iteration 8
Sat 18 Jan 2014 10:14:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43806269
Sat 18 Jan 2014 10:14:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43806269
Sat 18 Jan 2014 10:14:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:14:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:14:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:14:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:14:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:14:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:14:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:14:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:14:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:14:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:14:37 - XML: Processed 655150 elements - found 472 jobs
Sat 18 Jan 2014 10:14:37 - job 7348814 report time 1390036270 does not match current heartbeat 1390036390 : ignoring job
Sat 18 Jan 2014 10:14:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:14:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:14:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:14:37 - job 7344348 appears to have finished
Sat 18 Jan 2014 10:14:37 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 10:14:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:14:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:14:38 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 10:14:39 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 10:14:39 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:14:39 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:14:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:14:41 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:14:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:14:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:14:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:14:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:14:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:14:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:14:42 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:14:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 10:14:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:14:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:14:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43804972
Sat 18 Jan 2014 10:14:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:14:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43804972
Sat 18 Jan 2014 10:14:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:14:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:14:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:14:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:14:53 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:14:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:14:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:14:54 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:14:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:14:54 - job_xml_thread(): Done retrieving: data size 43804972
Sat 18 Jan 2014 10:14:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:14:54 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:14:54 - XML: Start document: iteration 9
Sat 18 Jan 2014 10:14:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:14:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43804972
Sat 18 Jan 2014 10:14:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:14:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:14:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:14:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:15:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:15:07 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:15:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:15:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:15:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:15:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:15:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:15:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:15:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:15:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:15:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:15:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:15:14 - XML: Processed 655150 elements - found 472 jobs
Sat 18 Jan 2014 10:15:14 - job 7348814 report time 1390036270 does not match current heartbeat 1390036390 : ignoring job
Sat 18 Jan 2014 10:15:14 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:15:14 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:15:14 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:15:14 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:15:14 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:15:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:15:14 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:15:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:15:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:15:15 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:15:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:15:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 10:15:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:15:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:15:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:15:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:15:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 10:15:15 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:15:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5588 values 88076 bits 11009 bytes 
Sat 18 Jan 2014 10:15:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:15:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43809310
Sat 18 Jan 2014 10:15:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:15:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43809310
Sat 18 Jan 2014 10:15:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:15:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:15:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:15:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:15:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:15:29 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:15:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:15:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:15:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:15:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:15:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:15:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:15:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:15:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:15:35 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:15:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:15:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:15:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:15:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:15:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:15:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:15:35 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:15:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 10:15:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:15:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:15:38 - job_xml_thread(): Done retrieving: data size 43782095
Sat 18 Jan 2014 10:15:38 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:15:38 - XML: Start document: iteration 10
Sat 18 Jan 2014 10:15:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43782095
Sat 18 Jan 2014 10:15:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:15:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43782095
Sat 18 Jan 2014 10:15:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:15:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:15:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:15:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:15:49 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:15:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:15:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:15:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:15:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:15:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:15:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:15:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:15:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:15:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:15:56 - XML: Processed 655152 elements - found 473 jobs
Sat 18 Jan 2014 10:15:56 - job 7348814 report time 1390036270 does not match current heartbeat 1390036511 : ignoring job
Sat 18 Jan 2014 10:15:56 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 10:15:56 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 10:15:57 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 10:15:57 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:15:57 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:15:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:15:59 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:15:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:15:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:15:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:15:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:15:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:15:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:16:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:16:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43790650
Sat 18 Jan 2014 10:16:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:16:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43790650
Sat 18 Jan 2014 10:16:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:16:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:16:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:16:12 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:16:12 - job_xml_thread(): Done retrieving: data size 43790650
Sat 18 Jan 2014 10:16:12 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:16:12 - XML: Start document: iteration 11
Sat 18 Jan 2014 10:16:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:16:13 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:16:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:16:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:16:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:16:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:16:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:16:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:16:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:16:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:16:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:16:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:16:15 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:16:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:16:16 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:16:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 10:16:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 10:16:16 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:16:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8726 values 137687 bits 17210 bytes 
Sat 18 Jan 2014 10:16:25 - XML: Processed 655150 elements - found 472 jobs
Sat 18 Jan 2014 10:16:25 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:16:25 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:16:25 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:16:25 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:16:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:16:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:16:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:16:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:16:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:16:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:16:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:16:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:16:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:16:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:16:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:16:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43783134
Sat 18 Jan 2014 10:16:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:16:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43783134
Sat 18 Jan 2014 10:16:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:16:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:16:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:16:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:16:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:16:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:16:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:16:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:16:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43783134
Sat 18 Jan 2014 10:16:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:16:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:16:40 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:16:40 - job_xml_thread(): Done retrieving: data size 43783134
Sat 18 Jan 2014 10:16:40 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:16:40 - XML: Start document: iteration 12
Sat 18 Jan 2014 10:16:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:16:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:16:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:16:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:16:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:16:57 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:16:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:16:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:16:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:16:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:16:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:16:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:16:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:16:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:16:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:16:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:16:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:17:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:17:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:17:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:17:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:17:00 - XML: Processed 655150 elements - found 472 jobs
Sat 18 Jan 2014 10:17:00 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:17:00 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:17:00 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:17:00 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:17:01 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:17:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 10:17:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:17:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:17:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43813448
Sat 18 Jan 2014 10:17:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:17:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43813448
Sat 18 Jan 2014 10:17:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:17:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:17:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:17:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:17:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:17:15 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:17:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:17:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:17:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:17:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:17:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:17:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:17:16 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:17:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:17:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:17:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:17:17 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:17:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:17:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:17:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 10:17:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 10:17:17 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:17:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5882 values 92983 bits 11622 bytes 
Sat 18 Jan 2014 10:17:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:17:20 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:17:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:17:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:17:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:17:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:17:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:17:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:17:23 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 10:17:23 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 10:17:23 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:17:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:17:23 - job_xml_thread(): Done retrieving: data size 43726397
Sat 18 Jan 2014 10:17:23 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:17:23 - XML: Start document: iteration 13
Sat 18 Jan 2014 10:17:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43726397
Sat 18 Jan 2014 10:17:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43726397
Sat 18 Jan 2014 10:17:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:17:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:17:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:17:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:17:35 - XML: Processed 654402 elements - found 472 jobs
Sat 18 Jan 2014 10:17:35 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:17:35 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:17:35 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:17:35 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:17:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:17:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:17:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:17:43 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:17:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:17:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:17:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:17:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:17:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:17:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:17:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:17:46 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:17:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 10:17:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:17:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:17:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:17:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:17:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:17:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:17:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:17:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:17:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:17:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:17:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43191786
Sat 18 Jan 2014 10:17:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:17:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43191786
Sat 18 Jan 2014 10:17:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:17:50 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:17:50 - job_xml_thread(): Done retrieving: data size 43191786
Sat 18 Jan 2014 10:17:50 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:17:50 - XML: Start document: iteration 14
Sat 18 Jan 2014 10:17:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:17:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:18:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:18:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:18:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:18:03 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:18:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:18:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:18:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:18:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:18:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:18:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:18:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:18:11 - XML: Processed 647552 elements - found 470 jobs
Sat 18 Jan 2014 10:18:11 - job 7348815 appears to have finished
Sat 18 Jan 2014 10:18:12 - job 7346465 appears to have finished
Sat 18 Jan 2014 10:18:12 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 10:18:12 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 10:18:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:18:13 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:18:13 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 10:18:13 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:18:13 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:18:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:18:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:18:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:18:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:18:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:18:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:18:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:18:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43189624
Sat 18 Jan 2014 10:18:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:18:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43189624
Sat 18 Jan 2014 10:18:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:18:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:18:17 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:18:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:18:18 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:18:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 10:18:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 10:18:19 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:18:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8993 values 142219 bits 17777 bytes 
Sat 18 Jan 2014 10:18:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:18:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:18:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:18:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:18:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:18:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:18:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:18:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:18:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:18:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:18:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43189624
Sat 18 Jan 2014 10:18:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:18:28 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:18:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:18:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:18:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:18:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:18:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:18:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:18:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:18:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:18:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:18:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:18:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:18:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:18:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:18:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:18:38 - job_xml_thread(): Done retrieving: data size 43666177
Sat 18 Jan 2014 10:18:38 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:18:38 - XML: Start document: iteration 15
Sat 18 Jan 2014 10:18:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43666177
Sat 18 Jan 2014 10:18:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:18:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:18:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:18:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:18:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:18:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43666177
Sat 18 Jan 2014 10:18:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:18:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:18:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:18:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:18:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:18:57 - XML: Processed 653851 elements - found 471 jobs
Sat 18 Jan 2014 10:18:57 - job 7348817 report time 1390036511 does not match current heartbeat 1390036631 : ignoring job
Sat 18 Jan 2014 10:18:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:18:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:18:57 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 10:18:57 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 10:18:57 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 10:18:57 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:18:57 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:18:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:18:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:19:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:19:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:19:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:19:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:19:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:19:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:19:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:19:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:19:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:19:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:19:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:19:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:19:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:19:00 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:19:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 10:19:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:19:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:19:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43809207
Sat 18 Jan 2014 10:19:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:19:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43809207
Sat 18 Jan 2014 10:19:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:19:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:19:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:19:12 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:19:12 - job_xml_thread(): Done retrieving: data size 43809207
Sat 18 Jan 2014 10:19:12 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:19:12 - XML: Start document: iteration 16
Sat 18 Jan 2014 10:19:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:19:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:19:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:19:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:19:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:19:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:19:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:19:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:19:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:19:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:19:19 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:19:19 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:19:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 10:19:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:19:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 10:19:19 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:19:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5884 values 92817 bits 11602 bytes 
Sat 18 Jan 2014 10:19:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:19:23 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:19:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:19:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:19:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:19:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:19:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:19:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:19:25 - XML: Processed 655004 elements - found 471 jobs
Sat 18 Jan 2014 10:19:25 - job 7348817 report time 1390036511 does not match current heartbeat 1390036631 : ignoring job
Sat 18 Jan 2014 10:19:25 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:19:25 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:19:25 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:19:25 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:19:27 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:19:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 10:19:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:19:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:19:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43772921
Sat 18 Jan 2014 10:19:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:19:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43772921
Sat 18 Jan 2014 10:19:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:19:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:19:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:19:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:19:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:19:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:19:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:19:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:19:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:19:40 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:19:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:19:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:19:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:19:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:19:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:19:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:19:41 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:19:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:19:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:19:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:19:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:19:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:19:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:19:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:19:44 - job_xml_thread(): Done retrieving: data size 43799280
Sat 18 Jan 2014 10:19:44 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:19:44 - XML: Start document: iteration 17
Sat 18 Jan 2014 10:19:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43799280
Sat 18 Jan 2014 10:19:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:19:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43799280
Sat 18 Jan 2014 10:19:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:19:52 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 10:19:52 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:19:53 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:19:53 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 10:19:53 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 10:19:53 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:19:53 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 10:19:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:19:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:19:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:19:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:19:58 - XML: Processed 655146 elements - found 470 jobs
Sat 18 Jan 2014 10:19:58 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:19:58 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:19:58 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:19:58 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:19:59 - size of cluster 'LISA Cluster': 624 hosts 79457 metrics 717244 values 11325646 bits 1415705 bytes 
Sat 18 Jan 2014 10:20:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:20:03 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:20:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:20:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:20:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:20:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:20:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:20:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:20:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:20:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:20:07 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:20:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:20:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:20:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:20:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:20:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:20:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:20:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:20:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43784865
Sat 18 Jan 2014 10:20:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:20:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43784865
Sat 18 Jan 2014 10:20:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:20:13 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:20:13 - job_xml_thread(): Done retrieving: data size 43784865
Sat 18 Jan 2014 10:20:13 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:20:13 - XML: Start document: iteration 18
Sat 18 Jan 2014 10:20:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:20:19 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:20:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:20:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:20:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:20:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 10:20:20 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:20:20 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:20:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 10:20:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148624 bits 18578 bytes 
Sat 18 Jan 2014 10:20:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:20:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:20:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:20:26 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:20:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:20:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:20:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:20:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:20:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:20:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:20:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:20:29 - XML: Processed 655150 elements - found 472 jobs
Sat 18 Jan 2014 10:20:29 - job 7348819 report time 1390036631 does not match current heartbeat 1390036751 : ignoring job
Sat 18 Jan 2014 10:20:29 - job 7335212 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 10:20:29 - job_xml_thread(): Found 3 updated jobs.
Sat 18 Jan 2014 10:20:29 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 10:20:29 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Sat 18 Jan 2014 10:20:29 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:20:29 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:20:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:20:34 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:20:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:20:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:20:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:20:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:20:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:20:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:20:37 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:20:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 10:20:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:20:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:20:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43779775
Sat 18 Jan 2014 10:20:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:20:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43779775
Sat 18 Jan 2014 10:20:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:20:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:20:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:20:44 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:20:44 - job_xml_thread(): Done retrieving: data size 43779775
Sat 18 Jan 2014 10:20:44 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:20:44 - XML: Start document: iteration 19
Sat 18 Jan 2014 10:20:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:20:49 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:20:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:20:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:20:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:20:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:20:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:20:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:20:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:20:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:20:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:20:53 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:20:53 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 10:20:59 - XML: Processed 655150 elements - found 472 jobs
Sat 18 Jan 2014 10:21:00 - job 7348819 report time 1390036631 does not match current heartbeat 1390036751 : ignoring job
Sat 18 Jan 2014 10:21:00 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:21:00 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:21:00 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:21:00 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:21:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:21:02 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:21:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:21:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:21:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:21:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:21:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:21:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:21:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:21:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43774482
Sat 18 Jan 2014 10:21:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:21:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:21:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:21:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43774482
Sat 18 Jan 2014 10:21:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:21:15 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:21:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:21:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:21:15 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:21:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:21:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:21:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:21:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:21:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:21:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:21:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:21:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:21:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:21:20 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:21:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:21:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:21:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:21:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:21:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:21:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:21:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:21:20 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:21:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:21:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 10:21:21 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:21:21 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:21:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99048 bits 12381 bytes 
Sat 18 Jan 2014 10:21:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 10:21:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:21:23 - job_xml_thread(): Done retrieving: data size 43786856
Sat 18 Jan 2014 10:21:23 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:21:23 - XML: Start document: iteration 20
Sat 18 Jan 2014 10:21:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43786856
Sat 18 Jan 2014 10:21:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:21:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43786856
Sat 18 Jan 2014 10:21:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:21:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:21:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:21:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:21:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:21:41 - XML: Processed 655150 elements - found 472 jobs
Sat 18 Jan 2014 10:21:41 - job 7348819 report time 1390036631 does not match current heartbeat 1390036751 : ignoring job
Sat 18 Jan 2014 10:21:42 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:21:42 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:21:42 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:21:42 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:21:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:21:43 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:21:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:21:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:21:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:21:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:21:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:21:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:21:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:21:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:21:48 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:21:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:21:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:21:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:21:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:21:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:21:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:21:50 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:21:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 10:21:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:21:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:21:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43792482
Sat 18 Jan 2014 10:21:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:21:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43792482
Sat 18 Jan 2014 10:21:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:21:57 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:21:57 - job_xml_thread(): Done retrieving: data size 43792482
Sat 18 Jan 2014 10:21:57 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:21:57 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 10:21:58 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 10:21:58 - Housekeeping: done.
Sat 18 Jan 2014 10:21:59 - XML: Start document: iteration 0
Sat 18 Jan 2014 10:21:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:21:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:22:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:22:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:22:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:22:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:22:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:22:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:22:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:22:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:22:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:22:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:22:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:22:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:22:13 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:22:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:22:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:22:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:22:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:22:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:22:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:22:14 - XML: Processed 655145 elements - found 471 jobs
Sat 18 Jan 2014 10:22:14 - job 7335209 appears to have finished
Sat 18 Jan 2014 10:22:14 - job 7348821 report time 1390036751 does not match current heartbeat 1390036872 : ignoring job
Sat 18 Jan 2014 10:22:14 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 10:22:14 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 10:22:14 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 10:22:14 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:22:14 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:22:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:22:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43794020
Sat 18 Jan 2014 10:22:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:22:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43794020
Sat 18 Jan 2014 10:22:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:22:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:22:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:22:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:22:22 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:22:23 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:22:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:22:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 10:22:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 10:22:23 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:22:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7363 values 116147 bits 14518 bytes 
Sat 18 Jan 2014 10:22:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:22:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:22:30 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:22:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:22:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:22:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:22:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:22:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:22:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:22:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:22:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:22:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:22:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:22:34 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:22:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:22:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:22:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:22:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:22:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:22:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:22:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:22:38 - job_xml_thread(): Done retrieving: data size 43793481
Sat 18 Jan 2014 10:22:38 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:22:38 - XML: Start document: iteration 1
Sat 18 Jan 2014 10:22:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43793481
Sat 18 Jan 2014 10:22:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:22:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43793481
Sat 18 Jan 2014 10:22:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:22:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:22:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:22:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:22:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:22:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:22:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:22:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:22:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:23:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:23:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:23:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:23:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:23:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:23:01 - XML: Processed 655148 elements - found 471 jobs
Sat 18 Jan 2014 10:23:01 - job 7348821 report time 1390036751 does not match current heartbeat 1390036872 : ignoring job
Sat 18 Jan 2014 10:23:01 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:23:01 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:23:01 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:23:01 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:23:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:23:02 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:23:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:23:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:23:03 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:23:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 10:23:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:23:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:23:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:23:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:23:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:23:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:23:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43802342
Sat 18 Jan 2014 10:23:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:23:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43802342
Sat 18 Jan 2014 10:23:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:23:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:23:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:23:17 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:23:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:23:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:23:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:23:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:23:19 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:23:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:23:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:23:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:23:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:23:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:23:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:23:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:23:22 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:23:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:23:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:23:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:23:23 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:23:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:23:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 10:23:23 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:23:23 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:23:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 10:23:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5763 values 90876 bits 11359 bytes 
Sat 18 Jan 2014 10:23:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:23:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:23:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:23:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:23:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:23:26 - job_xml_thread(): Done retrieving: data size 43726062
Sat 18 Jan 2014 10:23:26 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:23:26 - XML: Start document: iteration 2
Sat 18 Jan 2014 10:23:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43726062
Sat 18 Jan 2014 10:23:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:23:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43726062
Sat 18 Jan 2014 10:23:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:23:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:23:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:23:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:23:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:23:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:23:46 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:23:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:23:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:23:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:23:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:23:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:23:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:23:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:23:50 - XML: Processed 654400 elements - found 471 jobs
Sat 18 Jan 2014 10:23:50 - job 7348821 report time 1390036751 does not match current heartbeat 1390036872 : ignoring job
Sat 18 Jan 2014 10:23:50 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:23:50 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:23:50 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:23:50 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:23:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:23:51 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:23:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:23:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:23:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:23:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:23:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:23:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:23:52 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:23:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 10:23:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:23:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:23:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43143084
Sat 18 Jan 2014 10:23:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:23:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43143084
Sat 18 Jan 2014 10:23:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:24:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:24:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:24:05 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:24:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:24:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:24:06 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:24:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:24:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:24:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:24:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:24:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:24:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:24:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:24:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:24:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:24:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:24:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:24:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:24:09 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 10:24:09 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 10:24:09 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:24:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:24:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:24:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:24:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:24:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:24:10 - job_xml_thread(): Done retrieving: data size 43172597
Sat 18 Jan 2014 10:24:10 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:24:10 - XML: Start document: iteration 3
Sat 18 Jan 2014 10:24:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43172597
Sat 18 Jan 2014 10:24:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43172597
Sat 18 Jan 2014 10:24:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:24:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:24:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:24:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:24:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:24:23 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:24:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:24:24 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:24:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:24:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:24:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 10:24:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 10:24:24 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:24:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8307 values 130958 bits 16369 bytes 
Sat 18 Jan 2014 10:24:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:24:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:24:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:24:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:24:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:24:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:24:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:24:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:24:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:24:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:24:33 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:24:33 - XML: Processed 647329 elements - found 471 jobs
Sat 18 Jan 2014 10:24:33 - job 7348824 report time 1390036872 does not match current heartbeat 1390036992 : ignoring job
Sat 18 Jan 2014 10:24:33 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 10:24:33 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 10:24:33 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 10:24:33 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:24:33 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:24:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:24:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:24:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:24:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:24:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:24:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:24:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:24:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43443999
Sat 18 Jan 2014 10:24:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:24:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43443999
Sat 18 Jan 2014 10:24:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:24:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:24:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:24:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:24:45 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:24:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:24:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:24:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:24:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:24:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:24:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:24:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:24:47 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:24:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 10:24:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:24:48 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:24:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:24:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:24:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:24:49 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:24:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:24:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:24:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:24:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:24:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:24:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:24:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:24:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43759891
Sat 18 Jan 2014 10:24:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:24:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43759891
Sat 18 Jan 2014 10:24:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:24:51 - job_xml_thread(): Done retrieving: data size 43759891
Sat 18 Jan 2014 10:24:51 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:24:51 - XML: Start document: iteration 4
Sat 18 Jan 2014 10:25:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:25:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:25:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:25:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:25:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:25:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:25:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:25:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:25:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:25:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:25:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:25:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:25:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:25:10 - XML: Processed 654622 elements - found 471 jobs
Sat 18 Jan 2014 10:25:10 - job 7348824 report time 1390036872 does not match current heartbeat 1390036992 : ignoring job
Sat 18 Jan 2014 10:25:10 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:25:10 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:25:10 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:25:10 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:25:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:25:12 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:25:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:25:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:25:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:25:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:25:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:25:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:25:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:25:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43783244
Sat 18 Jan 2014 10:25:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:25:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43783244
Sat 18 Jan 2014 10:25:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:25:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:25:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:25:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:25:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:25:25 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:25:25 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:25:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:25:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:25:25 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:25:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:25:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:25:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:25:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:25:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:25:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:25:26 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:25:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 10:25:26 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:25:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 10:25:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9246 values 145846 bits 18230 bytes 
Sat 18 Jan 2014 10:25:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:25:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:25:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:25:27 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:25:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:25:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:25:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:25:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:25:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:25:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:25:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:25:30 - job_xml_thread(): Done retrieving: data size 43796547
Sat 18 Jan 2014 10:25:30 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:25:30 - XML: Start document: iteration 5
Sat 18 Jan 2014 10:25:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43796547
Sat 18 Jan 2014 10:25:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:25:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43796547
Sat 18 Jan 2014 10:25:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:25:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:25:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:25:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:25:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:25:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:25:48 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:25:49 - XML: Processed 655148 elements - found 471 jobs
Sat 18 Jan 2014 10:25:49 - job 7348824 report time 1390036872 does not match current heartbeat 1390036992 : ignoring job
Sat 18 Jan 2014 10:25:49 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:25:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:25:49 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:25:49 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:25:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:25:49 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:25:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:25:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:25:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:25:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:25:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:25:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:25:53 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:25:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:25:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:25:53 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:25:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 10:25:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:25:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:25:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:25:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:25:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:25:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:25:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43795624
Sat 18 Jan 2014 10:25:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:25:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43795624
Sat 18 Jan 2014 10:25:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:26:04 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:26:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:26:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:26:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:26:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:26:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:26:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:26:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:26:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:26:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:26:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:26:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:26:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:26:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:26:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:26:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:26:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:26:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:26:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:26:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:26:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:26:11 - job_xml_thread(): Done retrieving: data size 43797001
Sat 18 Jan 2014 10:26:11 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:26:11 - XML: Start document: iteration 6
Sat 18 Jan 2014 10:26:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43797001
Sat 18 Jan 2014 10:26:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:26:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43797001
Sat 18 Jan 2014 10:26:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:26:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:26:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:26:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:26:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:26:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:26:26 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:26:27 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:26:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 10:26:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:26:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 10:26:27 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:26:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8813 values 138932 bits 17366 bytes 
Sat 18 Jan 2014 10:26:29 - XML: Processed 655148 elements - found 471 jobs
Sat 18 Jan 2014 10:26:30 - job 7348826 report time 1390036992 does not match current heartbeat 1390037113 : ignoring job
Sat 18 Jan 2014 10:26:30 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 10:26:30 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 10:26:30 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 10:26:30 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:26:30 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:26:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:26:31 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:26:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:26:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:26:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:26:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:26:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:26:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:26:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:26:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:26:34 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:26:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:26:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:26:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:26:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:26:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:26:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:26:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:26:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43816902
Sat 18 Jan 2014 10:26:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:26:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43816902
Sat 18 Jan 2014 10:26:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:26:45 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:26:45 - job_xml_thread(): Done retrieving: data size 43816902
Sat 18 Jan 2014 10:26:45 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:26:45 - XML: Start document: iteration 7
Sat 18 Jan 2014 10:26:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:26:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:26:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:26:48 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:26:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:26:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:26:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:26:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:26:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:26:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:26:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:26:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:26:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:26:53 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 10:26:53 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:26:54 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:26:54 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 10:26:54 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 10:26:54 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:26:54 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 10:26:58 - XML: Processed 655147 elements - found 471 jobs
Sat 18 Jan 2014 10:26:58 - job 7348826 report time 1390036992 does not match current heartbeat 1390037113 : ignoring job
Sat 18 Jan 2014 10:26:58 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:26:58 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:26:58 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:26:58 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:26:58 - size of cluster 'LISA Cluster': 624 hosts 79475 metrics 790786 values 12464684 bits 1558085 bytes 
Sat 18 Jan 2014 10:27:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:27:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:27:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:27:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:27:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:27:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:27:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:27:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:27:00 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:27:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 10:27:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:27:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:27:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43782761
Sat 18 Jan 2014 10:27:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:27:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43782761
Sat 18 Jan 2014 10:27:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:27:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:27:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:27:13 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:27:13 - job_xml_thread(): Done retrieving: data size 43782761
Sat 18 Jan 2014 10:27:13 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:27:13 - XML: Start document: iteration 8
Sat 18 Jan 2014 10:27:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:27:15 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:27:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:27:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:27:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:27:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:27:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:27:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:27:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:27:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:27:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:27:24 - XML: Processed 655148 elements - found 471 jobs
Sat 18 Jan 2014 10:27:24 - job 7348826 report time 1390036992 does not match current heartbeat 1390037113 : ignoring job
Sat 18 Jan 2014 10:27:24 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:27:24 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:27:24 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:27:24 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:27:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:27:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:27:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:27:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:27:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:27:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:27:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:27:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:27:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:27:27 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:27:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:27:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 10:27:28 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:27:28 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:27:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 10:27:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5490 values 86552 bits 10819 bytes 
Sat 18 Jan 2014 10:27:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:27:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43779576
Sat 18 Jan 2014 10:27:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:27:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43779576
Sat 18 Jan 2014 10:27:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:27:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:27:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:27:39 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:27:39 - job_xml_thread(): Done retrieving: data size 43779576
Sat 18 Jan 2014 10:27:39 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:27:39 - XML: Start document: iteration 9
Sat 18 Jan 2014 10:27:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:27:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:27:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:27:44 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:27:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:27:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:27:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:27:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:27:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:27:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:27:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:27:53 - XML: Processed 655148 elements - found 471 jobs
Sat 18 Jan 2014 10:27:53 - job 7348826 report time 1390036992 does not match current heartbeat 1390037113 : ignoring job
Sat 18 Jan 2014 10:27:53 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:27:53 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:27:53 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:27:53 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:27:54 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:27:54 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 10:27:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:27:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:27:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:27:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:27:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:27:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:27:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:27:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:27:57 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:27:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 10:27:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:27:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:27:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43765025
Sat 18 Jan 2014 10:27:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:27:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43765025
Sat 18 Jan 2014 10:27:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:28:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:28:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:28:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:28:07 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:28:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:28:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:28:09 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:28:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:28:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:28:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:28:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:28:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:28:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:28:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:28:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:28:12 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:28:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:28:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:28:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:28:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:28:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:28:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:28:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:28:15 - job_xml_thread(): Done retrieving: data size 43790569
Sat 18 Jan 2014 10:28:15 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:28:15 - XML: Start document: iteration 10
Sat 18 Jan 2014 10:28:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43790569
Sat 18 Jan 2014 10:28:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:28:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43790569
Sat 18 Jan 2014 10:28:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:28:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:28:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:28:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:28:28 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:28:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:28:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:28:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:28:29 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:28:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 10:28:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 10:28:29 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:28:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7475 values 117839 bits 14729 bytes 
Sat 18 Jan 2014 10:28:34 - XML: Processed 655148 elements - found 471 jobs
Sat 18 Jan 2014 10:28:34 - job 7348828 report time 1390037113 does not match current heartbeat 1390037233 : ignoring job
Sat 18 Jan 2014 10:28:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:28:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:28:34 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 10:28:34 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 10:28:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:28:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:28:34 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 10:28:34 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:28:34 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:28:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:28:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:28:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:28:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:28:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:28:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:28:38 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:28:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:28:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:28:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:28:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:28:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:28:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:28:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:28:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43788732
Sat 18 Jan 2014 10:28:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:28:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43788732
Sat 18 Jan 2014 10:28:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:28:49 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:28:49 - job_xml_thread(): Done retrieving: data size 43788732
Sat 18 Jan 2014 10:28:49 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:28:49 - XML: Start document: iteration 11
Sat 18 Jan 2014 10:28:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:28:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:28:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:28:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:28:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:28:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:28:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:28:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:28:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:28:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:28:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:28:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:28:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:29:01 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:29:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 10:29:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:29:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:29:02 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:29:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:29:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:29:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:29:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:29:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:29:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:29:03 - XML: Processed 655148 elements - found 471 jobs
Sat 18 Jan 2014 10:29:03 - job 7348828 report time 1390037113 does not match current heartbeat 1390037233 : ignoring job
Sat 18 Jan 2014 10:29:03 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:29:03 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:29:03 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:29:03 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:29:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:29:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43799089
Sat 18 Jan 2014 10:29:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:29:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43799089
Sat 18 Jan 2014 10:29:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:29:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:29:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:29:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:29:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:29:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:29:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:29:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:29:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:29:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:29:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:29:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:29:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:29:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:29:18 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:29:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:29:21 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:29:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:29:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:29:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:29:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:29:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:29:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:29:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:29:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43726402
Sat 18 Jan 2014 10:29:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:29:25 - job_xml_thread(): Done retrieving: data size 43726402
Sat 18 Jan 2014 10:29:25 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:29:25 - XML: Start document: iteration 12
Sat 18 Jan 2014 10:29:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43726402
Sat 18 Jan 2014 10:29:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:29:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:29:29 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:29:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:29:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 10:29:30 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:29:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 10:29:30 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:29:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8933 values 140839 bits 17604 bytes 
Sat 18 Jan 2014 10:29:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:29:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:29:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:29:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:29:41 - XML: Processed 654400 elements - found 471 jobs
Sat 18 Jan 2014 10:29:41 - job 7348828 report time 1390037113 does not match current heartbeat 1390037233 : ignoring job
Sat 18 Jan 2014 10:29:41 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:29:41 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:29:41 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:29:41 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:29:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:29:44 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:29:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:29:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:29:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:29:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:29:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:29:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:29:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:29:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:29:48 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:29:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:29:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:29:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:29:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:29:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:29:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:29:52 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:29:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 10:29:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:29:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:29:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43188425
Sat 18 Jan 2014 10:29:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:29:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43188425
Sat 18 Jan 2014 10:29:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:29:56 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:29:56 - job_xml_thread(): Done retrieving: data size 43188425
Sat 18 Jan 2014 10:29:56 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:29:56 - XML: Start document: iteration 13
Sat 18 Jan 2014 10:30:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:30:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:30:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:30:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:30:10 - XML: Processed 647577 elements - found 471 jobs
Sat 18 Jan 2014 10:30:10 - job 7348830 report time 1390037233 does not match current heartbeat 1390037354 : ignoring job
Sat 18 Jan 2014 10:30:10 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 10:30:10 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 10:30:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:30:10 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:30:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:30:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:30:10 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 10:30:10 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:30:10 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:30:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:30:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:30:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:30:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:30:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:30:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:30:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:30:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:30:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:30:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:30:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:30:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:30:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:30:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:30:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43208729
Sat 18 Jan 2014 10:30:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:30:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43208729
Sat 18 Jan 2014 10:30:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:30:26 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:30:26 - job_xml_thread(): Done retrieving: data size 43208729
Sat 18 Jan 2014 10:30:26 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:30:26 - XML: Start document: iteration 14
Sat 18 Jan 2014 10:30:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:30:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:30:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:30:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:30:30 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:30:30 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:30:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:30:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:30:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:30:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:30:31 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:30:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 10:30:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:30:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:30:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:30:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:30:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:30:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:30:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 10:30:32 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:30:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99054 bits 12381 bytes 
Sat 18 Jan 2014 10:30:39 - XML: Processed 647696 elements - found 471 jobs
Sat 18 Jan 2014 10:30:39 - job 7348830 report time 1390037233 does not match current heartbeat 1390037354 : ignoring job
Sat 18 Jan 2014 10:30:39 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:30:39 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:30:39 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:30:39 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:30:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:30:41 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:30:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:30:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:30:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:30:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:30:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:30:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:30:42 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 10:30:42 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 10:30:42 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:30:44 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:30:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 10:30:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:30:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:30:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43694873
Sat 18 Jan 2014 10:30:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:30:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43694873
Sat 18 Jan 2014 10:30:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:30:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:30:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:30:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:30:53 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:30:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:30:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:30:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:30:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:30:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:30:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:30:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43694873
Sat 18 Jan 2014 10:30:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:30:54 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:30:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:30:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:30:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:31:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:31:01 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:31:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:31:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:31:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:31:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:31:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:31:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:31:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:31:03 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:31:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:31:04 - job_xml_thread(): Done retrieving: data size 43779493
Sat 18 Jan 2014 10:31:04 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:31:04 - XML: Start document: iteration 15
Sat 18 Jan 2014 10:31:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43779493
Sat 18 Jan 2014 10:31:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:31:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:31:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:31:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:31:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:31:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:31:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:31:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43779493
Sat 18 Jan 2014 10:31:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:31:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:31:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:31:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:31:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:31:21 - XML: Processed 655074 elements - found 471 jobs
Sat 18 Jan 2014 10:31:21 - job 7348830 report time 1390037233 does not match current heartbeat 1390037354 : ignoring job
Sat 18 Jan 2014 10:31:21 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:31:21 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:31:21 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:31:21 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:31:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:31:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:31:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:31:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:31:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:31:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:31:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:31:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:31:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:31:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:31:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:31:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:31:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:31:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:31:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:31:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:31:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43790357
Sat 18 Jan 2014 10:31:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:31:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43790357
Sat 18 Jan 2014 10:31:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:31:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:31:32 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:31:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:31:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 10:31:33 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:31:33 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:31:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 10:31:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148708 bits 18588 bytes 
Sat 18 Jan 2014 10:31:36 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:31:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:31:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:31:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:31:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:31:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:31:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:31:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:31:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:31:40 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:31:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:31:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:31:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:31:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:31:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:31:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:31:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:31:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:31:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:31:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:31:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:31:42 - job_xml_thread(): Done retrieving: data size 43779688
Sat 18 Jan 2014 10:31:42 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:31:42 - XML: Start document: iteration 16
Sat 18 Jan 2014 10:31:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43779688
Sat 18 Jan 2014 10:31:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:31:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43779688
Sat 18 Jan 2014 10:31:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:31:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:31:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:31:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:31:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:32:02 - XML: Processed 655148 elements - found 471 jobs
Sat 18 Jan 2014 10:32:02 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 10:32:02 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 10:32:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:32:03 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:32:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:32:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:32:03 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 10:32:03 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:32:03 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:32:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:32:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:32:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:32:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:32:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:32:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:32:06 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:32:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:32:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:32:06 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:32:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 10:32:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:32:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:32:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:32:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:32:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:32:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:32:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43811736
Sat 18 Jan 2014 10:32:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:32:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43811736
Sat 18 Jan 2014 10:32:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:32:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:32:15 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:32:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:32:18 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:32:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:32:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:32:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:32:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:32:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:32:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:32:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:32:20 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:32:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:32:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:32:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:32:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:32:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:32:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:32:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:32:22 - job_xml_thread(): Done retrieving: data size 43816304
Sat 18 Jan 2014 10:32:22 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:32:22 - XML: Start document: iteration 17
Sat 18 Jan 2014 10:32:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43816304
Sat 18 Jan 2014 10:32:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:32:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43816304
Sat 18 Jan 2014 10:32:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:32:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:32:33 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:32:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:32:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:32:36 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:32:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:32:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:32:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:32:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 10:32:36 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:32:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 10:32:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9074 values 143672 bits 17959 bytes 
Sat 18 Jan 2014 10:32:39 - XML: Processed 655148 elements - found 471 jobs
Sat 18 Jan 2014 10:32:39 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:32:39 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:32:39 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:32:39 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:32:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:32:42 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:32:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:32:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:32:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:32:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:32:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:32:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:32:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:32:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:32:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:32:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:32:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:32:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:32:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:32:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:32:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:32:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:32:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43825354
Sat 18 Jan 2014 10:32:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:32:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43825354
Sat 18 Jan 2014 10:32:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:32:54 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:32:54 - job_xml_thread(): Done retrieving: data size 43825354
Sat 18 Jan 2014 10:32:54 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:32:54 - XML: Start document: iteration 18
Sat 18 Jan 2014 10:32:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:32:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:32:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:32:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:33:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:33:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:33:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:33:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:33:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:33:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:33:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:33:04 - XML: Processed 655148 elements - found 471 jobs
Sat 18 Jan 2014 10:33:04 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:33:04 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:33:04 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:33:04 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:33:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:33:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:33:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:33:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:33:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:33:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:33:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:33:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:33:08 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:33:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 10:33:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:33:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:33:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43769377
Sat 18 Jan 2014 10:33:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:33:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43769377
Sat 18 Jan 2014 10:33:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:33:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:33:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:33:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:33:18 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:33:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:33:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:33:19 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:33:19 - job_xml_thread(): Done retrieving: data size 43769377
Sat 18 Jan 2014 10:33:19 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:33:19 - XML: Start document: iteration 19
Sat 18 Jan 2014 10:33:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:33:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:33:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:33:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:33:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43769377
Sat 18 Jan 2014 10:33:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:33:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:33:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:33:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:33:31 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:33:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:33:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:33:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:33:35 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:33:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:33:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:33:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:33:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:33:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:33:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:33:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:33:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:33:37 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:33:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:33:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:33:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:33:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:33:38 - XML: Processed 655147 elements - found 471 jobs
Sat 18 Jan 2014 10:33:38 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:33:38 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:33:38 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:33:38 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:33:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:33:38 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:33:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 10:33:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 10:33:38 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:33:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5592 values 88344 bits 11043 bytes 
Sat 18 Jan 2014 10:33:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:33:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43789815
Sat 18 Jan 2014 10:33:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:33:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43789815
Sat 18 Jan 2014 10:33:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:33:46 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:33:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 10:33:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:33:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:33:48 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:33:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:33:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:33:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:33:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:33:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:33:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:33:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:33:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:33:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:33:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:33:53 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:33:53 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:33:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:33:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:33:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:33:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:33:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:33:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:33:54 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 10:33:54 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:33:54 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:33:54 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 10:33:54 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:33:54 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 10:33:54 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 10:33:55 - size of cluster 'LISA Cluster': 624 hosts 79464 metrics 772453 values 12202473 bits 1525309 bytes 
Sat 18 Jan 2014 10:33:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:33:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43793189
Sat 18 Jan 2014 10:33:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:33:56 - job_xml_thread(): Done retrieving: data size 43793189
Sat 18 Jan 2014 10:33:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43793189
Sat 18 Jan 2014 10:33:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:33:56 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:33:56 - XML: Start document: iteration 20
Sat 18 Jan 2014 10:34:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:34:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:34:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:34:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:34:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:34:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:34:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:34:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:34:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:34:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:34:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:34:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:34:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:34:13 - XML: Processed 655148 elements - found 471 jobs
Sat 18 Jan 2014 10:34:13 - job 7348831 appears to have finished
Sat 18 Jan 2014 10:34:13 - job 7335213 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 10:34:13 - job_xml_thread(): Found 3 updated jobs.
Sat 18 Jan 2014 10:34:13 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 10:34:14 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Sat 18 Jan 2014 10:34:14 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:34:14 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:34:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:34:18 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:34:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:34:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:34:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:34:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:34:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:34:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:34:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:34:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43794546
Sat 18 Jan 2014 10:34:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:34:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43794546
Sat 18 Jan 2014 10:34:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:34:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:34:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:34:29 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:34:29 - job_xml_thread(): Done retrieving: data size 43794546
Sat 18 Jan 2014 10:34:29 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:34:29 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 10:34:29 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 10:34:29 - Housekeeping: done.
Sat 18 Jan 2014 10:34:29 - XML: Start document: iteration 0
Sat 18 Jan 2014 10:34:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:34:30 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:34:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:34:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:34:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:34:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:34:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:34:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:34:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:34:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:34:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:34:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:34:38 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:34:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:34:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 10:34:39 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:34:39 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:34:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 10:34:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9314 values 146942 bits 18367 bytes 
Sat 18 Jan 2014 10:34:39 - XML: Processed 655148 elements - found 471 jobs
Sat 18 Jan 2014 10:34:39 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:34:39 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:34:39 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:34:39 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:34:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:34:41 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:34:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:34:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:34:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:34:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:34:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:34:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:34:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:34:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43773761
Sat 18 Jan 2014 10:34:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:34:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43773761
Sat 18 Jan 2014 10:34:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:34:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:34:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:34:54 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:34:54 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 10:34:54 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:34:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:34:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:34:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:35:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:35:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:35:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:35:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:35:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:35:00 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:35:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:35:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:35:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:35:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:35:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:35:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:35:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:35:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:35:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:35:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:35:01 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:35:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 10:35:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:35:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:35:04 - job_xml_thread(): Done retrieving: data size 43803631
Sat 18 Jan 2014 10:35:04 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:35:04 - XML: Start document: iteration 1
Sat 18 Jan 2014 10:35:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43803631
Sat 18 Jan 2014 10:35:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:35:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43803631
Sat 18 Jan 2014 10:35:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:35:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:35:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:35:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:35:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:35:21 - XML: Processed 655148 elements - found 471 jobs
Sat 18 Jan 2014 10:35:22 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:35:22 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:35:22 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:35:22 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:35:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:35:24 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:35:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:35:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:35:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:35:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:35:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:35:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:35:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:35:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:35:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:35:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:35:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:35:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:35:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:35:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:35:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:35:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:35:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43491439
Sat 18 Jan 2014 10:35:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:35:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43491439
Sat 18 Jan 2014 10:35:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:35:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:35:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:35:37 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:35:37 - job_xml_thread(): Done retrieving: data size 43491439
Sat 18 Jan 2014 10:35:37 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:35:37 - XML: Start document: iteration 2
Sat 18 Jan 2014 10:35:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:35:39 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:35:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:35:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 10:35:40 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:35:40 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:35:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 10:35:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8660 values 136573 bits 17071 bytes 
Sat 18 Jan 2014 10:35:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:35:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:35:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:35:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:35:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:35:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:35:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:35:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:35:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:35:49 - XML: Processed 651334 elements - found 471 jobs
Sat 18 Jan 2014 10:35:49 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:35:49 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:35:49 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:35:49 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:35:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:35:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:35:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:35:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:35:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:35:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:35:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:35:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:35:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:35:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43156063
Sat 18 Jan 2014 10:35:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:35:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43156063
Sat 18 Jan 2014 10:35:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:35:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:35:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:36:04 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:36:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:36:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:36:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:36:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:36:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:36:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:36:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:36:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:36:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:36:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:36:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:36:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:36:11 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:36:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:36:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:36:11 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:36:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 10:36:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:36:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:36:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:36:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:36:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:36:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:36:14 - job_xml_thread(): Done retrieving: data size 43184311
Sat 18 Jan 2014 10:36:14 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:36:14 - XML: Start document: iteration 3
Sat 18 Jan 2014 10:36:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43184311
Sat 18 Jan 2014 10:36:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43184311
Sat 18 Jan 2014 10:36:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:36:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:36:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:36:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:36:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:36:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:36:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:36:33 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:36:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:36:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:36:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:36:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:36:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:36:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:36:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:36:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:36:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:36:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:36:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:36:36 - XML: Processed 647620 elements - found 470 jobs
Sat 18 Jan 2014 10:36:36 - job 7348833 appears to have finished
Sat 18 Jan 2014 10:36:36 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 10:36:36 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 10:36:36 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 10:36:36 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:36:36 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:36:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:36:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:36:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:36:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:36:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:36:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43669098
Sat 18 Jan 2014 10:36:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:36:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:36:40 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:36:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43669098
Sat 18 Jan 2014 10:36:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:36:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:36:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 10:36:40 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:36:40 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:36:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 10:36:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8819 values 139027 bits 17378 bytes 
Sat 18 Jan 2014 10:36:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:36:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:36:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:36:49 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:36:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:36:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:36:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:36:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:36:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:36:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:36:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:36:51 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:36:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:36:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:36:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:36:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:36:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:36:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:36:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:36:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:36:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:36:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:36:58 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 10:36:58 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 10:36:58 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:36:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:36:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43772582
Sat 18 Jan 2014 10:36:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:36:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43772582
Sat 18 Jan 2014 10:36:59 - job_xml_thread(): Done retrieving: data size 43772582
Sat 18 Jan 2014 10:36:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:36:59 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:37:00 - XML: Start document: iteration 4
Sat 18 Jan 2014 10:37:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:37:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:37:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:37:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:37:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:37:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:37:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:37:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:37:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:37:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:37:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:37:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:37:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:37:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:37:19 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:37:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:37:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:37:20 - XML: Processed 654948 elements - found 470 jobs
Sat 18 Jan 2014 10:37:20 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:37:20 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:37:20 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:37:20 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:37:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:37:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:37:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:37:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:37:20 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:37:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 10:37:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:37:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:37:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43790963
Sat 18 Jan 2014 10:37:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:37:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43790963
Sat 18 Jan 2014 10:37:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:37:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:37:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:37:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:37:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:37:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:37:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:37:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:37:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:37:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:37:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:37:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:37:35 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:37:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:37:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:37:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:37:37 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:37:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:37:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:37:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:37:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:37:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:37:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:37:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:37:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43801481
Sat 18 Jan 2014 10:37:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:37:39 - job_xml_thread(): Done retrieving: data size 43801481
Sat 18 Jan 2014 10:37:39 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:37:39 - XML: Start document: iteration 5
Sat 18 Jan 2014 10:37:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43801481
Sat 18 Jan 2014 10:37:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:37:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:37:40 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:37:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:37:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 10:37:42 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:37:42 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:37:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 10:37:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8970 values 141508 bits 17688 bytes 
Sat 18 Jan 2014 10:37:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:37:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:37:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:37:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:37:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:37:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:37:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:37:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:37:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:37:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:37:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:37:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:37:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:37:59 - XML: Processed 655146 elements - found 470 jobs
Sat 18 Jan 2014 10:37:59 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:37:59 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:37:59 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:37:59 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:38:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:38:02 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:38:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:38:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:38:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:38:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:38:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:38:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:38:04 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:38:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 10:38:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:38:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:38:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43814550
Sat 18 Jan 2014 10:38:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:38:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43814550
Sat 18 Jan 2014 10:38:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:38:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:38:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:38:14 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:38:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:38:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:38:14 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:38:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:38:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:38:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:38:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:38:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:38:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:38:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:38:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:38:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:38:18 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:38:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:38:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:38:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:38:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:38:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:38:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:38:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:38:21 - job_xml_thread(): Done retrieving: data size 43817265
Sat 18 Jan 2014 10:38:21 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:38:21 - XML: Start document: iteration 6
Sat 18 Jan 2014 10:38:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43817265
Sat 18 Jan 2014 10:38:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43817265
Sat 18 Jan 2014 10:38:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:38:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:38:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:38:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:38:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:38:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:38:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:38:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:38:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:38:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:38:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:38:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:38:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:38:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:38:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:38:39 - XML: Processed 655146 elements - found 470 jobs
Sat 18 Jan 2014 10:38:39 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:38:39 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:38:39 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:38:39 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:38:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:38:42 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:38:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:38:42 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:38:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:38:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:38:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:38:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 10:38:42 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:38:42 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:38:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 10:38:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99061 bits 12382 bytes 
Sat 18 Jan 2014 10:38:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:38:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:38:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:38:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:38:44 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:38:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 10:38:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:38:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:38:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43803318
Sat 18 Jan 2014 10:38:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:38:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43803318
Sat 18 Jan 2014 10:38:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:38:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:38:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:38:54 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:38:54 - job_xml_thread(): Done retrieving: data size 43803318
Sat 18 Jan 2014 10:38:54 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:38:54 - XML: Start document: iteration 7
Sat 18 Jan 2014 10:38:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:38:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:38:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:38:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:38:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:38:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:38:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:38:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:38:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:39:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:39:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:39:06 - XML: Processed 655146 elements - found 470 jobs
Sat 18 Jan 2014 10:39:06 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:39:06 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:39:06 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:39:06 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:39:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:39:07 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:39:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:39:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:39:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:39:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:39:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:39:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:39:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:39:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43780575
Sat 18 Jan 2014 10:39:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:39:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43780575
Sat 18 Jan 2014 10:39:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:39:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:39:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:39:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:39:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:39:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:39:21 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:39:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:39:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:39:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:39:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:39:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:39:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:39:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:39:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:39:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:39:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:39:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:39:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:39:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:39:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:39:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:39:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:39:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:39:25 - job_xml_thread(): Done retrieving: data size 43801443
Sat 18 Jan 2014 10:39:25 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:39:25 - XML: Start document: iteration 8
Sat 18 Jan 2014 10:39:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43801443
Sat 18 Jan 2014 10:39:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:39:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43801443
Sat 18 Jan 2014 10:39:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:39:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:39:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:39:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:39:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:39:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:39:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:39:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:39:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:39:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:39:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:39:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:39:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:39:42 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:39:43 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:39:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:39:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 10:39:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 10:39:43 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:39:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148571 bits 18571 bytes 
Sat 18 Jan 2014 10:39:45 - XML: Processed 655146 elements - found 470 jobs
Sat 18 Jan 2014 10:39:45 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:39:45 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:39:45 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:39:45 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:39:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:39:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:39:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:39:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:39:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:39:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:39:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:39:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:39:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:39:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43791968
Sat 18 Jan 2014 10:39:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:39:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43791968
Sat 18 Jan 2014 10:39:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:39:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:39:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:40:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:40:00 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:40:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:40:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:40:00 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:40:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:40:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:40:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:40:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:40:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:40:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:40:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:40:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:40:04 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:40:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:40:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:40:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:40:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:40:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:40:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:40:04 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:40:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 10:40:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:40:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:40:05 - job_xml_thread(): Done retrieving: data size 43802076
Sat 18 Jan 2014 10:40:05 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:40:05 - XML: Start document: iteration 9
Sat 18 Jan 2014 10:40:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43802076
Sat 18 Jan 2014 10:40:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:40:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43802076
Sat 18 Jan 2014 10:40:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:40:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:40:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:40:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:40:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:40:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:40:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:40:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:40:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:40:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:40:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:40:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:40:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:40:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:40:28 - XML: Processed 655146 elements - found 470 jobs
Sat 18 Jan 2014 10:40:28 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:40:28 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:40:28 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:40:28 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:40:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:40:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:40:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:40:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:40:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:40:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:40:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:40:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:40:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:40:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43806490
Sat 18 Jan 2014 10:40:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:40:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43806490
Sat 18 Jan 2014 10:40:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:40:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:40:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:40:43 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:40:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:40:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:40:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:40:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:40:43 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:40:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:40:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:40:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:40:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:40:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:40:43 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:40:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:40:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:40:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:40:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:40:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:40:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:40:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:40:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:40:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:40:44 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:40:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 10:40:44 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:40:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8891 values 140177 bits 17522 bytes 
Sat 18 Jan 2014 10:40:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 10:40:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:40:46 - job_xml_thread(): Done retrieving: data size 43813684
Sat 18 Jan 2014 10:40:46 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:40:46 - XML: Start document: iteration 10
Sat 18 Jan 2014 10:40:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43813684
Sat 18 Jan 2014 10:40:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:40:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43813684
Sat 18 Jan 2014 10:40:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:40:54 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 10:40:55 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:40:56 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:40:56 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 10:40:56 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 10:40:56 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:40:56 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 10:40:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:40:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:40:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:40:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:41:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:41:03 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:41:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:41:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:41:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:41:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:41:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:41:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:41:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:41:07 - XML: Processed 655146 elements - found 470 jobs
Sat 18 Jan 2014 10:41:07 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:41:07 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:41:07 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:41:07 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:41:10 - size of cluster 'LISA Cluster': 624 hosts 79482 metrics 866762 values 13665453 bits 1708181 bytes 
Sat 18 Jan 2014 10:41:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:41:11 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:41:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:41:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:41:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:41:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:41:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:41:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:41:11 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:41:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 10:41:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:41:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:41:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43721188
Sat 18 Jan 2014 10:41:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:41:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43721188
Sat 18 Jan 2014 10:41:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:41:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:41:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:41:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:41:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:41:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:41:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:41:23 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:41:23 - job_xml_thread(): Done retrieving: data size 43721188
Sat 18 Jan 2014 10:41:23 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:41:23 - XML: Start document: iteration 11
Sat 18 Jan 2014 10:41:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:41:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:41:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:41:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:41:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43721188
Sat 18 Jan 2014 10:41:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:41:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:41:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:41:36 - XML: Processed 654398 elements - found 470 jobs
Sat 18 Jan 2014 10:41:36 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:41:36 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:41:36 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:41:36 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:41:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:41:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:41:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:41:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:41:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:41:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:41:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:41:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:41:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:41:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:41:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:41:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:41:43 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:41:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:41:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:41:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:41:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:41:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:41:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:41:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:41:44 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:41:44 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:41:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:41:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 10:41:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 10:41:44 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:41:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5765 values 90867 bits 11358 bytes 
Sat 18 Jan 2014 10:41:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:41:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43195641
Sat 18 Jan 2014 10:41:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:41:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43195641
Sat 18 Jan 2014 10:41:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:41:52 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:41:52 - job_xml_thread(): Done retrieving: data size 43195641
Sat 18 Jan 2014 10:41:52 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:41:52 - XML: Start document: iteration 12
Sat 18 Jan 2014 10:41:56 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:41:56 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 10:41:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:41:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:41:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:41:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:41:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:41:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:41:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:41:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:41:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:41:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:41:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:41:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:41:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:42:04 - XML: Processed 647518 elements - found 470 jobs
Sat 18 Jan 2014 10:42:04 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:42:04 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:42:04 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:42:04 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:42:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:42:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:42:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:42:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:42:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:42:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:42:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:42:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:42:10 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:42:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 10:42:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:42:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:42:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43170388
Sat 18 Jan 2014 10:42:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:42:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43170388
Sat 18 Jan 2014 10:42:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:42:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:42:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:42:19 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:42:19 - job_xml_thread(): Done retrieving: data size 43170388
Sat 18 Jan 2014 10:42:19 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:42:19 - XML: Start document: iteration 13
Sat 18 Jan 2014 10:42:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:42:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:42:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:42:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:42:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:42:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:42:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:42:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:42:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:42:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:42:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:42:30 - XML: Processed 647620 elements - found 470 jobs
Sat 18 Jan 2014 10:42:30 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:42:30 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:42:30 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:42:30 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:42:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:42:34 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:42:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:42:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:42:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:42:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:42:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:42:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:42:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:42:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43307272
Sat 18 Jan 2014 10:42:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:42:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43307272
Sat 18 Jan 2014 10:42:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:42:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:42:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:42:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:42:44 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:42:45 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:42:45 - job_xml_thread(): Done retrieving: data size 43307272
Sat 18 Jan 2014 10:42:45 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:42:45 - XML: Start document: iteration 14
Sat 18 Jan 2014 10:42:45 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:42:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:42:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 10:42:45 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:42:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 10:42:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7875 values 124184 bits 15523 bytes 
Sat 18 Jan 2014 10:42:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:42:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:42:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:42:52 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:42:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:42:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:42:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:42:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:42:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:42:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:42:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:42:58 - XML: Processed 649239 elements - found 470 jobs
Sat 18 Jan 2014 10:42:58 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:42:58 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:42:58 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:42:58 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:43:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:43:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:43:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:43:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:43:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:43:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:43:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:43:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:43:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:43:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43781525
Sat 18 Jan 2014 10:43:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:43:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43781525
Sat 18 Jan 2014 10:43:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:43:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:43:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:43:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:43:13 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:43:13 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:43:13 - job_xml_thread(): Done retrieving: data size 43781525
Sat 18 Jan 2014 10:43:13 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:43:14 - XML: Start document: iteration 15
Sat 18 Jan 2014 10:43:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:43:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:43:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:43:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:43:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:43:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:43:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:43:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:43:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:43:19 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:43:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 10:43:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:43:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:43:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:43:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:43:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:43:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:43:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:43:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:43:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:43:28 - XML: Processed 655074 elements - found 470 jobs
Sat 18 Jan 2014 10:43:28 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:43:28 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:43:28 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:43:28 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:43:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:43:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:43:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:43:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43763832
Sat 18 Jan 2014 10:43:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:43:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43763832
Sat 18 Jan 2014 10:43:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:43:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:43:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:43:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:43:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:43:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:43:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:43:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:43:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:43:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:43:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:43:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:43:43 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:43:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:43:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:43:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:43:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:43:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:43:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:43:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:43:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:43:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:43:45 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:43:46 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:43:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:43:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 10:43:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 10:43:46 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:43:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5737 values 90456 bits 11307 bytes 
Sat 18 Jan 2014 10:43:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:43:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43802674
Sat 18 Jan 2014 10:43:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:43:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43802674
Sat 18 Jan 2014 10:43:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:43:49 - job_xml_thread(): Done retrieving: data size 43802674
Sat 18 Jan 2014 10:43:49 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:43:49 - XML: Start document: iteration 16
Sat 18 Jan 2014 10:43:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:43:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:44:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:44:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:44:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:44:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:44:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:44:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:44:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:44:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:44:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:44:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:44:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:44:09 - XML: Processed 655146 elements - found 470 jobs
Sat 18 Jan 2014 10:44:09 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:44:09 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:44:09 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:44:09 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:44:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:44:12 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:44:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:44:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:44:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:44:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:44:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:44:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:44:13 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:44:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 10:44:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:44:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:44:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43778799
Sat 18 Jan 2014 10:44:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:44:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43778799
Sat 18 Jan 2014 10:44:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:44:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:44:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:44:24 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:44:24 - job_xml_thread(): Done retrieving: data size 43778799
Sat 18 Jan 2014 10:44:24 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:44:24 - XML: Start document: iteration 17
Sat 18 Jan 2014 10:44:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:44:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:44:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:44:29 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:44:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:44:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:44:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:44:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:44:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:44:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:44:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:44:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:44:33 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:44:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:44:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:44:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:44:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:44:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:44:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:44:36 - XML: Processed 655146 elements - found 470 jobs
Sat 18 Jan 2014 10:44:36 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:44:36 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:44:36 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:44:36 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:44:37 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 10:44:37 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 10:44:37 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:44:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:44:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43812229
Sat 18 Jan 2014 10:44:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:44:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43812229
Sat 18 Jan 2014 10:44:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:44:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:44:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:44:46 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:44:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:44:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:44:48 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:44:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 10:44:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 10:44:49 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:44:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:44:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:44:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7695 values 121335 bits 15166 bytes 
Sat 18 Jan 2014 10:44:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:44:50 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:44:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:44:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:44:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:44:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:44:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:44:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:44:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:44:51 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:44:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:44:53 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:44:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:44:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:44:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:44:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:44:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:44:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:44:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:44:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43815681
Sat 18 Jan 2014 10:44:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:44:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43815681
Sat 18 Jan 2014 10:44:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:44:55 - job_xml_thread(): Done retrieving: data size 43815681
Sat 18 Jan 2014 10:44:56 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:44:56 - XML: Start document: iteration 18
Sat 18 Jan 2014 10:45:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:45:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:45:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:45:07 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:45:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:45:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:45:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:45:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:45:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:45:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:45:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:45:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:45:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:45:14 - XML: Processed 655143 elements - found 470 jobs
Sat 18 Jan 2014 10:45:15 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:45:15 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:45:15 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:45:15 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:45:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:45:16 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:45:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:45:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:45:16 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:45:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 10:45:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:45:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:45:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:45:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:45:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:45:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:45:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43786376
Sat 18 Jan 2014 10:45:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:45:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43786376
Sat 18 Jan 2014 10:45:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:45:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:45:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:45:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:45:27 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:45:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:45:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:45:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:45:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:45:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:45:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:45:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:45:30 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:45:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:45:32 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:45:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:45:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:45:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:45:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:45:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:45:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:45:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:45:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43799356
Sat 18 Jan 2014 10:45:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:45:34 - job_xml_thread(): Done retrieving: data size 43799356
Sat 18 Jan 2014 10:45:34 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:45:34 - XML: Start document: iteration 19
Sat 18 Jan 2014 10:45:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43799356
Sat 18 Jan 2014 10:45:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:45:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:45:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:45:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:45:45 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:45:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:45:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:45:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:45:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:45:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:45:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:45:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:45:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:45:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:45:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:45:49 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:45:50 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:45:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 10:45:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:45:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 10:45:50 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:45:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8930 values 140783 bits 17597 bytes 
Sat 18 Jan 2014 10:45:56 - XML: Processed 655146 elements - found 470 jobs
Sat 18 Jan 2014 10:45:56 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:45:56 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:45:56 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:45:56 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:45:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:45:57 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:45:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:45:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:45:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:45:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:45:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:45:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:45:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:45:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43767677
Sat 18 Jan 2014 10:45:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:46:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43767677
Sat 18 Jan 2014 10:46:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:46:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:46:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:46:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:46:10 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:46:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:46:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:46:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:46:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:46:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:46:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:46:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:46:11 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:46:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:46:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:46:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:46:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:46:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:46:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:46:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:46:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:46:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:46:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:46:15 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:46:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 10:46:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:46:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:46:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43792213
Sat 18 Jan 2014 10:46:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:46:17 - job_xml_thread(): Done retrieving: data size 43792213
Sat 18 Jan 2014 10:46:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43792213
Sat 18 Jan 2014 10:46:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:46:17 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:46:17 - XML: Start document: iteration 20
Sat 18 Jan 2014 10:46:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:46:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:46:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:46:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:46:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:46:32 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:46:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:46:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:46:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:46:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:46:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:46:34 - XML: Processed 655146 elements - found 470 jobs
Sat 18 Jan 2014 10:46:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:46:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:46:34 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:46:34 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:46:34 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:46:34 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:46:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:46:37 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:46:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:46:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:46:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:46:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:46:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:46:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:46:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:46:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43822545
Sat 18 Jan 2014 10:46:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:46:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43822545
Sat 18 Jan 2014 10:46:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:46:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:46:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:46:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:46:49 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:46:49 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:46:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:46:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:46:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:46:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:46:50 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:46:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:46:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:46:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:46:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:46:50 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:46:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:46:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 10:46:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 10:46:50 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:46:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8919 values 141002 bits 17625 bytes 
Sat 18 Jan 2014 10:46:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:46:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:46:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:46:53 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:46:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:46:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:46:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:46:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:46:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:46:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:46:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:46:55 - job_xml_thread(): Done retrieving: data size 43820552
Sat 18 Jan 2014 10:46:55 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:46:55 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 10:46:55 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 10:46:55 - Housekeeping: done.
Sat 18 Jan 2014 10:46:55 - XML: Start document: iteration 0
Sat 18 Jan 2014 10:46:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43820552
Sat 18 Jan 2014 10:46:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:46:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43820552
Sat 18 Jan 2014 10:46:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:47:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:47:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:47:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:47:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:47:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:47:11 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:47:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:47:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:47:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:47:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:47:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:47:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:47:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:47:13 - XML: Processed 655146 elements - found 470 jobs
Sat 18 Jan 2014 10:47:13 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:47:13 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:47:13 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:47:13 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:47:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:47:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:47:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:47:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:47:17 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:47:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 10:47:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:47:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:47:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:47:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:47:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:47:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:47:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43730831
Sat 18 Jan 2014 10:47:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:47:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43730831
Sat 18 Jan 2014 10:47:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:47:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:47:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:47:28 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:47:28 - job_xml_thread(): Done retrieving: data size 43730831
Sat 18 Jan 2014 10:47:28 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:47:28 - XML: Start document: iteration 1
Sat 18 Jan 2014 10:47:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:47:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:47:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:47:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:47:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:47:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:47:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43730831
Sat 18 Jan 2014 10:47:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:47:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:47:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:47:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:47:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:47:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:47:38 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:47:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:47:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:47:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:47:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:47:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:47:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:47:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:47:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:47:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:47:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:47:46 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:47:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:47:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:47:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:47:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:47:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:47:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:47:47 - XML: Processed 654398 elements - found 470 jobs
Sat 18 Jan 2014 10:47:47 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:47:47 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:47:47 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:47:47 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:47:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:47:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43167564
Sat 18 Jan 2014 10:47:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:47:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43167564
Sat 18 Jan 2014 10:47:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:47:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:47:50 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:47:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:47:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 10:47:51 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:47:51 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:47:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 10:47:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5761 values 91094 bits 11386 bytes 
Sat 18 Jan 2014 10:47:56 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 10:47:56 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:47:57 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:47:57 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 10:47:57 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:47:57 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 10:47:57 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 10:47:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:47:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:47:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:47:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:48:00 - size of cluster 'LISA Cluster': 624 hosts 79472 metrics 880396 values 13896269 bits 1737033 bytes 
Sat 18 Jan 2014 10:48:02 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:48:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:48:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:48:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:48:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:48:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:48:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:48:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:48:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:48:05 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:48:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:48:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:48:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:48:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:48:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:48:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:48:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:48:09 - job_xml_thread(): Done retrieving: data size 43146620
Sat 18 Jan 2014 10:48:09 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:48:09 - XML: Start document: iteration 2
Sat 18 Jan 2014 10:48:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43146620
Sat 18 Jan 2014 10:48:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43146620
Sat 18 Jan 2014 10:48:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:48:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:48:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:48:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:48:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:48:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:48:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:48:26 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:48:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:48:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:48:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:48:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:48:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:48:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:48:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:48:31 - XML: Processed 646954 elements - found 470 jobs
Sat 18 Jan 2014 10:48:31 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:48:31 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:48:31 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:48:31 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:48:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:48:34 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:48:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:48:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:48:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:48:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:48:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:48:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:48:34 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:48:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 10:48:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:48:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:48:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43343968
Sat 18 Jan 2014 10:48:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:48:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43343968
Sat 18 Jan 2014 10:48:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:48:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:48:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:48:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:48:45 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:48:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:48:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:48:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:48:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:48:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:48:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:48:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43343968
Sat 18 Jan 2014 10:48:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:48:46 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:48:46 - job_xml_thread(): Done retrieving: data size 43343968
Sat 18 Jan 2014 10:48:46 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:48:46 - XML: Start document: iteration 3
Sat 18 Jan 2014 10:48:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:48:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:48:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:48:51 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:48:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:48:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 10:48:52 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:48:52 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:48:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 10:48:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5822 values 91974 bits 11496 bytes 
Sat 18 Jan 2014 10:48:57 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:48:57 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 10:49:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:49:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:49:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:49:03 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:49:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:49:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:49:04 - XML: Processed 649586 elements - found 470 jobs
Sat 18 Jan 2014 10:49:04 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:49:04 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:49:04 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:49:04 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:49:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:49:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:49:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:49:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:49:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:49:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:49:06 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:49:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:49:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:49:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:49:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:49:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:49:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:49:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:49:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43816024
Sat 18 Jan 2014 10:49:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:49:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43816024
Sat 18 Jan 2014 10:49:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:49:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:49:19 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:49:19 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:49:19 - job_xml_thread(): Done retrieving: data size 43816024
Sat 18 Jan 2014 10:49:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:49:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:49:19 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:49:19 - XML: Start document: iteration 4
Sat 18 Jan 2014 10:49:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:49:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:49:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:49:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:49:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:49:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:49:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:49:23 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:49:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 10:49:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:49:30 - XML: Processed 655146 elements - found 470 jobs
Sat 18 Jan 2014 10:49:30 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:49:30 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:49:30 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:49:30 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:49:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:49:33 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:49:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:49:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:49:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:49:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:49:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:49:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:49:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:49:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:49:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:49:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43764069
Sat 18 Jan 2014 10:49:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:49:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43764069
Sat 18 Jan 2014 10:49:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:49:45 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:49:45 - job_xml_thread(): Done retrieving: data size 43764069
Sat 18 Jan 2014 10:49:45 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:49:46 - XML: Start document: iteration 5
Sat 18 Jan 2014 10:49:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:49:48 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:49:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:49:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:49:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:49:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:49:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:49:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:49:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:49:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:49:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:49:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:49:53 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:49:53 - XML: Processed 655146 elements - found 470 jobs
Sat 18 Jan 2014 10:49:53 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:49:53 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:49:53 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:49:53 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:49:54 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:49:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:49:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 10:49:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 10:49:54 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:49:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5738 values 90517 bits 11314 bytes 
Sat 18 Jan 2014 10:49:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:49:59 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:49:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:49:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:50:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:50:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:50:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:50:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:50:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:50:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43766926
Sat 18 Jan 2014 10:50:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:50:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43766926
Sat 18 Jan 2014 10:50:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:50:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:50:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:50:08 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:50:08 - job_xml_thread(): Done retrieving: data size 43766926
Sat 18 Jan 2014 10:50:08 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:50:08 - XML: Start document: iteration 6
Sat 18 Jan 2014 10:50:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:50:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:50:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:50:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:50:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:50:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:50:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:50:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:50:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:50:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:50:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:50:23 - XML: Processed 655152 elements - found 473 jobs
Sat 18 Jan 2014 10:50:23 - job_xml_thread(): Found 3 updated jobs.
Sat 18 Jan 2014 10:50:23 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 10:50:24 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Sat 18 Jan 2014 10:50:24 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:50:24 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:50:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:50:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:50:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:50:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:50:26 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:50:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 10:50:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:50:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:50:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:50:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:50:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:50:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:50:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43792971
Sat 18 Jan 2014 10:50:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:50:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43792971
Sat 18 Jan 2014 10:50:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:50:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:50:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:50:39 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:50:39 - job_xml_thread(): Done retrieving: data size 43792971
Sat 18 Jan 2014 10:50:39 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:50:39 - XML: Start document: iteration 7
Sat 18 Jan 2014 10:50:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:50:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:50:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:50:43 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:50:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:50:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:50:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:50:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:50:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:50:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:50:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:50:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:50:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:50:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:50:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:50:52 - XML: Processed 655152 elements - found 473 jobs
Sat 18 Jan 2014 10:50:52 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:50:52 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:50:52 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:50:52 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:50:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:50:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:50:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:50:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:50:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:50:54 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:50:55 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:50:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 10:50:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:50:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 10:50:55 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:50:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5693 values 89749 bits 11218 bytes 
Sat 18 Jan 2014 10:50:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:50:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43797569
Sat 18 Jan 2014 10:50:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:50:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43797569
Sat 18 Jan 2014 10:50:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:50:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:50:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:51:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:51:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:51:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:51:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:51:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:51:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:51:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:51:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:51:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:51:07 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:51:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:51:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:51:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:51:10 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:51:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:51:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:51:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:51:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:51:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:51:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:51:14 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:51:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 10:51:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:51:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:51:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43802756
Sat 18 Jan 2014 10:51:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:51:15 - job_xml_thread(): Done retrieving: data size 43802756
Sat 18 Jan 2014 10:51:15 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:51:15 - XML: Start document: iteration 8
Sat 18 Jan 2014 10:51:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43802756
Sat 18 Jan 2014 10:51:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:51:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:51:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:51:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:51:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:51:36 - XML: Processed 655152 elements - found 473 jobs
Sat 18 Jan 2014 10:51:36 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:51:36 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:51:36 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:51:36 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:51:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:51:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:51:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:51:39 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:51:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:51:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:51:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:51:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:51:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:51:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:51:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:51:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:51:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:51:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:51:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:51:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:51:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:51:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:51:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43822776
Sat 18 Jan 2014 10:51:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:51:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43822776
Sat 18 Jan 2014 10:51:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:51:51 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:51:52 - job_xml_thread(): Done retrieving: data size 43822776
Sat 18 Jan 2014 10:51:52 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:51:52 - XML: Start document: iteration 9
Sat 18 Jan 2014 10:51:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:51:52 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:51:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:51:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:51:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:51:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:51:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:51:55 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:51:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:51:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:51:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:51:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:51:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:51:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:51:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 10:51:56 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:51:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 10:51:56 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:51:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6377 values 100573 bits 12571 bytes 
Sat 18 Jan 2014 10:52:02 - XML: Processed 655152 elements - found 473 jobs
Sat 18 Jan 2014 10:52:02 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:52:02 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:52:02 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:52:02 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:52:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:52:05 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:52:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:52:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:52:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:52:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:52:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:52:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:52:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:52:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43786326
Sat 18 Jan 2014 10:52:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:52:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43786326
Sat 18 Jan 2014 10:52:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:52:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:52:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:52:17 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:52:17 - job_xml_thread(): Done retrieving: data size 43786326
Sat 18 Jan 2014 10:52:17 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:52:17 - XML: Start document: iteration 10
Sat 18 Jan 2014 10:52:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:52:19 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:52:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:52:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:52:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:52:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:52:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:52:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:52:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:52:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:52:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:52:24 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:52:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 10:52:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:52:30 - XML: Processed 655152 elements - found 473 jobs
Sat 18 Jan 2014 10:52:30 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:52:30 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:52:30 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:52:30 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:52:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:52:32 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:52:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:52:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:52:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:52:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:52:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:52:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:52:33 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 10:52:33 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 10:52:33 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:52:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:52:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43765463
Sat 18 Jan 2014 10:52:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:52:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43765463
Sat 18 Jan 2014 10:52:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:52:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:52:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:52:45 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:52:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:52:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:52:46 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:52:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:52:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:52:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:52:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:52:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:52:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:52:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:52:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:52:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:52:49 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:52:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:52:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:52:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:52:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:52:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:52:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:52:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:52:51 - job_xml_thread(): Done retrieving: data size 43798742
Sat 18 Jan 2014 10:52:51 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:52:51 - XML: Start document: iteration 11
Sat 18 Jan 2014 10:52:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43798742
Sat 18 Jan 2014 10:52:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:52:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43798742
Sat 18 Jan 2014 10:52:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:52:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:52:56 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:52:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:52:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 10:52:58 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:52:58 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:52:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 10:52:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8978 values 141596 bits 17699 bytes 
Sat 18 Jan 2014 10:53:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:53:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:53:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:53:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:53:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:53:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:53:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:53:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:53:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:53:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:53:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:53:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:53:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:53:12 - XML: Processed 655152 elements - found 473 jobs
Sat 18 Jan 2014 10:53:12 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:53:12 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:53:12 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:53:12 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:53:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:53:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:53:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:53:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:53:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:53:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:53:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:53:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:53:16 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:53:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 10:53:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:53:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:53:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43725728
Sat 18 Jan 2014 10:53:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:53:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43725728
Sat 18 Jan 2014 10:53:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:53:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:53:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:53:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:53:26 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:53:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:53:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:53:27 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:53:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:53:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:53:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:53:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:53:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:53:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:53:30 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:53:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:53:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:53:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:53:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:53:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:53:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:53:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:53:32 - job_xml_thread(): Done retrieving: data size 43354317
Sat 18 Jan 2014 10:53:32 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:53:32 - XML: Start document: iteration 12
Sat 18 Jan 2014 10:53:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43354317
Sat 18 Jan 2014 10:53:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:53:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43354317
Sat 18 Jan 2014 10:53:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:53:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:53:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:53:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:53:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:53:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:53:48 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:53:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:53:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:53:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:53:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:53:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:53:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:53:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:53:53 - XML: Processed 649678 elements - found 473 jobs
Sat 18 Jan 2014 10:53:53 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:53:53 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:53:53 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:53:53 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:53:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:53:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:53:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:53:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:53:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:53:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:53:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:53:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:53:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:53:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43164415
Sat 18 Jan 2014 10:53:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:53:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43164415
Sat 18 Jan 2014 10:53:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:53:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:53:58 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:53:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:53:59 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:53:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 10:53:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 10:53:59 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:53:59 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9279 values 146333 bits 18291 bytes 
Sat 18 Jan 2014 10:54:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:54:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:54:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:54:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:54:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:54:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:54:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:54:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:54:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:54:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:54:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:54:08 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:54:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:54:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:54:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:54:11 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:54:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:54:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:54:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:54:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:54:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:54:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:54:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:54:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43155549
Sat 18 Jan 2014 10:54:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:54:14 - job_xml_thread(): Done retrieving: data size 43155549
Sat 18 Jan 2014 10:54:14 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:54:14 - XML: Start document: iteration 13
Sat 18 Jan 2014 10:54:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43155549
Sat 18 Jan 2014 10:54:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:54:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:54:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:54:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:54:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:54:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:54:29 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:54:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:54:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:54:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:54:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:54:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:54:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:54:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:54:32 - XML: Processed 646952 elements - found 473 jobs
Sat 18 Jan 2014 10:54:32 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:54:33 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:54:33 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:54:33 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:54:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:54:35 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:54:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:54:35 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:54:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:54:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 10:54:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:54:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:54:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:54:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:54:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:54:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:54:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43634804
Sat 18 Jan 2014 10:54:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:54:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43634804
Sat 18 Jan 2014 10:54:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:54:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:54:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:54:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:54:47 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:54:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:54:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:54:48 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:54:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:54:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:54:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:54:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:54:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:54:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:54:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:54:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:54:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:54:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:54:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:54:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:54:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:54:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:54:52 - job_xml_thread(): Done retrieving: data size 43763760
Sat 18 Jan 2014 10:54:52 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:54:52 - XML: Start document: iteration 14
Sat 18 Jan 2014 10:54:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43763760
Sat 18 Jan 2014 10:54:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:54:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43763760
Sat 18 Jan 2014 10:54:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:54:57 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 10:54:57 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:54:58 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:54:58 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:54:58 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 10:54:58 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 10:54:58 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 10:55:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:55:00 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:55:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:55:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 10:55:01 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:55:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9049 values 142734 bits 17841 bytes 
Sat 18 Jan 2014 10:55:01 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:55:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 10:55:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:55:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:55:05 - size of cluster 'LISA Cluster': 624 hosts 79470 metrics 769604 values 12134138 bits 1516767 bytes 
Sat 18 Jan 2014 10:55:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:55:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:55:14 - XML: Processed 654698 elements - found 473 jobs
Sat 18 Jan 2014 10:55:14 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:55:14 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:55:14 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:55:14 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:55:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:55:15 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:55:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:55:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:55:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:55:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:55:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:55:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:55:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:55:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:55:16 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:55:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:55:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:55:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:55:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:55:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:55:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:55:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:55:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43787694
Sat 18 Jan 2014 10:55:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:55:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43787694
Sat 18 Jan 2014 10:55:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:55:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:55:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:55:30 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:55:30 - job_xml_thread(): Done retrieving: data size 43787694
Sat 18 Jan 2014 10:55:30 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:55:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:55:30 - XML: Start document: iteration 15
Sat 18 Jan 2014 10:55:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:55:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:55:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:55:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:55:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:55:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:55:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:55:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:55:42 - XML: Processed 655152 elements - found 473 jobs
Sat 18 Jan 2014 10:55:42 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:55:42 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:55:42 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:55:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:55:42 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:55:42 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:55:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:55:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:55:42 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:55:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 10:55:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:55:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:55:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:55:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:55:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:55:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:55:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43778200
Sat 18 Jan 2014 10:55:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:55:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:55:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:55:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43778200
Sat 18 Jan 2014 10:55:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:55:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:55:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:55:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:55:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:55:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:55:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:55:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:55:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:55:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43778200
Sat 18 Jan 2014 10:55:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:55:57 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:55:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:55:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:55:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:55:58 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:55:58 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 10:56:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:56:01 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:56:02 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:56:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 10:56:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:56:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 10:56:02 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:56:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5739 values 90450 bits 11306 bytes 
Sat 18 Jan 2014 10:56:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:56:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:56:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:56:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:56:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:56:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:56:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:56:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:56:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:56:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:56:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:56:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:56:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:56:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:56:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:56:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:56:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:56:11 - job_xml_thread(): Done retrieving: data size 43785030
Sat 18 Jan 2014 10:56:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43785030
Sat 18 Jan 2014 10:56:11 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:56:11 - XML: Start document: iteration 16
Sat 18 Jan 2014 10:56:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:56:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43785030
Sat 18 Jan 2014 10:56:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:56:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:56:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:56:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:56:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:56:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:56:30 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:56:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:56:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:56:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:56:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:56:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:56:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:56:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:56:32 - XML: Processed 655152 elements - found 473 jobs
Sat 18 Jan 2014 10:56:32 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:56:32 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:56:32 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:56:32 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:56:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:56:35 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:56:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:56:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:56:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:56:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:56:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:56:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:56:36 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:56:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 10:56:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:56:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:56:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43793221
Sat 18 Jan 2014 10:56:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:56:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43793221
Sat 18 Jan 2014 10:56:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:56:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:56:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:56:47 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:56:47 - job_xml_thread(): Done retrieving: data size 43793221
Sat 18 Jan 2014 10:56:47 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:56:47 - XML: Start document: iteration 17
Sat 18 Jan 2014 10:56:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:56:48 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:56:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:56:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:56:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:56:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:56:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:56:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:56:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:56:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:56:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:56:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:56:59 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:56:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:56:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:57:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:57:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:57:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:57:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:57:00 - XML: Processed 655152 elements - found 473 jobs
Sat 18 Jan 2014 10:57:00 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:57:00 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:57:00 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:57:00 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:57:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:57:02 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:57:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:57:02 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:57:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 10:57:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 10:57:02 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:57:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5671 values 89362 bits 11170 bytes 
Sat 18 Jan 2014 10:57:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:57:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:57:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:57:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43776506
Sat 18 Jan 2014 10:57:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:57:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43776506
Sat 18 Jan 2014 10:57:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:57:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:57:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:57:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:57:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:57:16 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:57:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:57:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:57:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:57:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:57:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:57:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:57:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:57:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:57:20 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:57:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:57:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:57:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:57:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:57:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:57:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:57:22 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:57:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 10:57:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:57:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:57:24 - job_xml_thread(): Done retrieving: data size 43793965
Sat 18 Jan 2014 10:57:24 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:57:24 - XML: Start document: iteration 18
Sat 18 Jan 2014 10:57:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43793965
Sat 18 Jan 2014 10:57:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:57:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43793965
Sat 18 Jan 2014 10:57:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:57:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:57:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:57:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:57:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:57:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:57:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:57:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:57:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:57:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:57:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:57:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:57:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:57:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:57:45 - XML: Processed 655152 elements - found 473 jobs
Sat 18 Jan 2014 10:57:45 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:57:45 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:57:45 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:57:45 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:57:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:57:48 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:57:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:57:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:57:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:57:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:57:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:57:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:57:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:57:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43775242
Sat 18 Jan 2014 10:57:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:57:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43775242
Sat 18 Jan 2014 10:57:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:57:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:57:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:58:00 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:58:00 - job_xml_thread(): Done retrieving: data size 43775242
Sat 18 Jan 2014 10:58:00 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:58:00 - XML: Start document: iteration 19
Sat 18 Jan 2014 10:58:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:58:03 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:58:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:58:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:58:04 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:58:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 10:58:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:58:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 10:58:04 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:58:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7540 values 118906 bits 14863 bytes 
Sat 18 Jan 2014 10:58:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:58:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:58:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:58:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:58:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:58:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:58:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:58:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:58:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:58:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:58:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:58:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:58:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:58:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:58:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:58:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:58:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:58:16 - XML: Processed 655152 elements - found 473 jobs
Sat 18 Jan 2014 10:58:16 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:58:16 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:58:16 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:58:16 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:58:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:58:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43782516
Sat 18 Jan 2014 10:58:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:58:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43782516
Sat 18 Jan 2014 10:58:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:58:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:58:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:58:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:58:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:58:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:58:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:58:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:58:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:58:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43782516
Sat 18 Jan 2014 10:58:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:58:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:58:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:58:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:58:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:58:31 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:58:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:58:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:58:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:58:42 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:58:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 10:58:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:58:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:58:43 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:58:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:58:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:58:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:58:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:58:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:58:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:58:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:58:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:58:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:58:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:58:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:58:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:58:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:58:45 - job_xml_thread(): Done retrieving: data size 43789254
Sat 18 Jan 2014 10:58:45 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:58:45 - XML: Start document: iteration 20
Sat 18 Jan 2014 10:58:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43789254
Sat 18 Jan 2014 10:58:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:58:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43789254
Sat 18 Jan 2014 10:58:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:58:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:58:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:58:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:58:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:59:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:59:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:59:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:59:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:59:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:59:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:59:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:59:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:59:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:59:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:59:05 - XML: Processed 655152 elements - found 473 jobs
Sat 18 Jan 2014 10:59:05 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:59:05 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:59:05 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:59:05 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:59:05 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:59:05 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:59:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:59:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 10:59:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 10:59:05 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:59:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5734 values 90421 bits 11302 bytes 
Sat 18 Jan 2014 10:59:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:59:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:59:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:59:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:59:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:59:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:59:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:59:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:59:12 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 10:59:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 10:59:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:59:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:59:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43736713
Sat 18 Jan 2014 10:59:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:59:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43736713
Sat 18 Jan 2014 10:59:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:59:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:59:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:59:20 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:59:20 - job_xml_thread(): Done retrieving: data size 43736713
Sat 18 Jan 2014 10:59:21 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:59:21 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 10:59:23 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 10:59:23 - Housekeeping: done.
Sat 18 Jan 2014 10:59:23 - XML: Start document: iteration 0
Sat 18 Jan 2014 10:59:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:59:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:59:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:59:25 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:59:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:59:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:59:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:59:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:59:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:59:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:59:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:59:33 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 10:59:33 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 10:59:33 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:59:35 - XML: Processed 654404 elements - found 473 jobs
Sat 18 Jan 2014 10:59:35 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 10:59:35 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 10:59:35 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 10:59:35 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 10:59:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:59:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:59:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 10:59:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:59:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:59:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:59:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:59:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:59:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:59:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43409061
Sat 18 Jan 2014 10:59:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:59:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43409061
Sat 18 Jan 2014 10:59:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:59:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 10:59:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 10:59:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 10:59:48 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 10:59:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 10:59:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 10:59:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:59:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 10:59:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 10:59:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 10:59:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 10:59:50 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 10:59:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 10:59:52 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 10:59:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 10:59:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 10:59:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:59:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 10:59:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 10:59:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 10:59:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 10:59:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43140167
Sat 18 Jan 2014 10:59:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 10:59:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43140167
Sat 18 Jan 2014 10:59:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 10:59:55 - job_xml_thread(): Done retrieving: data size 43140167
Sat 18 Jan 2014 10:59:55 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 10:59:55 - XML: Start document: iteration 1
Sat 18 Jan 2014 11:00:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:00:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:00:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:00:06 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:00:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:00:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 11:00:08 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:00:08 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:00:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 11:00:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148592 bits 18574 bytes 
Sat 18 Jan 2014 11:00:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:00:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:00:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:00:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:00:16 - XML: Processed 647096 elements - found 473 jobs
Sat 18 Jan 2014 11:00:16 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:00:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:00:16 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:00:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:00:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:00:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:00:16 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:00:16 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:00:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:00:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:00:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:00:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:00:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:00:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:00:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:00:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:00:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:00:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:00:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:00:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:00:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43178573
Sat 18 Jan 2014 11:00:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:00:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43178573
Sat 18 Jan 2014 11:00:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:00:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:00:31 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:00:31 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:00:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:00:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:00:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:00:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:00:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:00:32 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:00:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:00:32 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:00:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 11:00:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:00:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:00:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:00:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:00:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:00:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:00:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:00:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:00:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:00:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:00:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:00:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:00:33 - job_xml_thread(): Done retrieving: data size 43402086
Sat 18 Jan 2014 11:00:33 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:00:33 - XML: Start document: iteration 2
Sat 18 Jan 2014 11:00:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43402086
Sat 18 Jan 2014 11:00:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43402086
Sat 18 Jan 2014 11:00:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:00:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:00:46 - XML: Processed 650051 elements - found 473 jobs
Sat 18 Jan 2014 11:00:46 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:00:46 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:00:46 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:00:46 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:00:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:00:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:00:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:00:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:00:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:00:49 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:00:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:00:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:00:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:00:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:00:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:00:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:00:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:00:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:00:52 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:00:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:00:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:00:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:00:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:00:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:00:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:00:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:00:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43777408
Sat 18 Jan 2014 11:00:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:00:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43777408
Sat 18 Jan 2014 11:00:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:01:02 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:01:02 - job_xml_thread(): Done retrieving: data size 43777408
Sat 18 Jan 2014 11:01:02 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:01:02 - XML: Start document: iteration 3
Sat 18 Jan 2014 11:01:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:01:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:01:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:01:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:01:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:01:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:01:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:01:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:01:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:01:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:01:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:01:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:01:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:01:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:01:08 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:01:09 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:01:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 11:01:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:01:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 11:01:09 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:01:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9337 values 147322 bits 18415 bytes 
Sat 18 Jan 2014 11:01:13 - XML: Processed 654928 elements - found 473 jobs
Sat 18 Jan 2014 11:01:13 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:01:13 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:01:13 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:01:13 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:01:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:01:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:01:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:01:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:01:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:01:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:01:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:01:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:01:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:01:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43790052
Sat 18 Jan 2014 11:01:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:01:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43790052
Sat 18 Jan 2014 11:01:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:01:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:01:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:01:28 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:01:28 - job_xml_thread(): Done retrieving: data size 43790052
Sat 18 Jan 2014 11:01:28 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:01:28 - XML: Start document: iteration 4
Sat 18 Jan 2014 11:01:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:01:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:01:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:01:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:01:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:01:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:01:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:01:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:01:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:01:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:01:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:01:41 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:01:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 11:01:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:01:42 - XML: Processed 655152 elements - found 473 jobs
Sat 18 Jan 2014 11:01:42 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:01:42 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:01:42 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:01:42 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:01:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:01:43 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:01:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:01:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:01:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:01:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:01:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:01:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:01:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:01:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43790716
Sat 18 Jan 2014 11:01:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:01:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43790716
Sat 18 Jan 2014 11:01:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:01:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:01:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:01:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:01:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:01:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:01:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:01:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:01:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:01:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:01:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:01:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:01:57 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:01:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:01:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:01:59 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 11:01:59 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:01:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:01:59 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:01:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:01:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:02:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:02:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:02:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:02:00 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:02:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:02:00 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:02:00 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 11:02:00 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 11:02:00 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 11:02:01 - size of cluster 'LISA Cluster': 624 hosts 79477 metrics 813776 values 12839921 bits 1604990 bytes 
Sat 18 Jan 2014 11:02:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:02:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43816517
Sat 18 Jan 2014 11:02:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:02:03 - job_xml_thread(): Done retrieving: data size 43816517
Sat 18 Jan 2014 11:02:04 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:02:04 - XML: Start document: iteration 5
Sat 18 Jan 2014 11:02:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43816517
Sat 18 Jan 2014 11:02:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:02:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:02:09 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:02:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:02:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 11:02:10 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:02:10 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:02:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 11:02:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9040 values 143071 bits 17883 bytes 
Sat 18 Jan 2014 11:02:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:02:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:02:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:02:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:02:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:02:19 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:02:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:02:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:02:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:02:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:02:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:02:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:02:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:02:25 - XML: Processed 655150 elements - found 472 jobs
Sat 18 Jan 2014 11:02:25 - job 7346489 appears to have finished
Sat 18 Jan 2014 11:02:25 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 11:02:25 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 11:02:25 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 11:02:25 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:02:25 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:02:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:02:28 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:02:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:02:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:02:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:02:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:02:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:02:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:02:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:02:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43793810
Sat 18 Jan 2014 11:02:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:02:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43793810
Sat 18 Jan 2014 11:02:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:02:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:02:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:02:40 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:02:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 11:02:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:02:40 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:02:40 - job_xml_thread(): Done retrieving: data size 43793810
Sat 18 Jan 2014 11:02:40 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:02:40 - XML: Start document: iteration 6
Sat 18 Jan 2014 11:02:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:02:43 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:02:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:02:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:02:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:02:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:02:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:02:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:02:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:02:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:02:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:02:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:02:50 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:02:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:02:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:02:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:02:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:02:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:02:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:02:53 - XML: Processed 655150 elements - found 472 jobs
Sat 18 Jan 2014 11:02:53 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:02:53 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:02:53 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:02:53 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:02:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:02:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43779100
Sat 18 Jan 2014 11:02:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:02:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43779100
Sat 18 Jan 2014 11:02:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:02:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:02:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:03:00 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:03:00 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 11:03:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:03:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:03:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:03:07 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:03:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:03:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:03:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:03:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:03:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:03:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:03:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:03:08 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:03:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:03:11 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:03:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:03:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 11:03:11 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:03:11 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:03:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 11:03:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6195 values 98004 bits 12250 bytes 
Sat 18 Jan 2014 11:03:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:03:11 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:03:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:03:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:03:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:03:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:03:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:03:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:03:15 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:03:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 11:03:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:03:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:03:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43807208
Sat 18 Jan 2014 11:03:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:03:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43807208
Sat 18 Jan 2014 11:03:16 - job_xml_thread(): Done retrieving: data size 43807208
Sat 18 Jan 2014 11:03:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:03:16 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:03:16 - XML: Start document: iteration 7
Sat 18 Jan 2014 11:03:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:03:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:03:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:03:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:03:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:03:33 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:03:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:03:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:03:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:03:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:03:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:03:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:03:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:03:37 - XML: Processed 655150 elements - found 472 jobs
Sat 18 Jan 2014 11:03:37 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:03:37 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:03:37 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:03:37 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:03:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:03:39 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:03:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:03:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:03:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:03:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:03:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:03:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:03:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:03:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43787305
Sat 18 Jan 2014 11:03:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:03:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43787305
Sat 18 Jan 2014 11:03:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:03:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:03:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:03:52 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:03:52 - job_xml_thread(): Done retrieving: data size 43787305
Sat 18 Jan 2014 11:03:52 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:03:52 - XML: Start document: iteration 8
Sat 18 Jan 2014 11:03:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:03:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:03:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:03:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:03:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:03:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:03:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:03:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:03:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:03:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:03:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:04:03 - XML: Processed 655150 elements - found 472 jobs
Sat 18 Jan 2014 11:04:03 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:04:03 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:04:03 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:04:03 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:04:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:04:06 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:04:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:04:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:04:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:04:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:04:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:04:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:04:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:04:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43771364
Sat 18 Jan 2014 11:04:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:04:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43771364
Sat 18 Jan 2014 11:04:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:04:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:04:11 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:04:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:04:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:04:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:04:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 11:04:13 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:04:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 11:04:13 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:04:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148622 bits 18577 bytes 
Sat 18 Jan 2014 11:04:18 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:04:18 - job_xml_thread(): Done retrieving: data size 43771364
Sat 18 Jan 2014 11:04:18 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:04:18 - XML: Start document: iteration 9
Sat 18 Jan 2014 11:04:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:04:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:04:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:04:24 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:04:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:04:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:04:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:04:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:04:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:04:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:04:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:04:28 - XML: Processed 655150 elements - found 472 jobs
Sat 18 Jan 2014 11:04:28 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:04:28 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:04:28 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:04:28 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:04:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:04:32 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:04:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:04:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:04:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:04:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:04:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:04:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:04:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:04:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43801659
Sat 18 Jan 2014 11:04:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:04:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43801659
Sat 18 Jan 2014 11:04:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:04:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:04:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:04:43 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:04:43 - job_xml_thread(): Done retrieving: data size 43801659
Sat 18 Jan 2014 11:04:43 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:04:43 - XML: Start document: iteration 10
Sat 18 Jan 2014 11:04:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:04:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:04:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:04:49 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:04:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:04:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:04:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:04:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:04:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:04:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:04:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:04:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:04:59 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:04:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:04:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:04:59 - XML: Processed 655150 elements - found 472 jobs
Sat 18 Jan 2014 11:04:59 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:04:59 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:04:59 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:04:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:04:59 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:04:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:04:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:04:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:04:59 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:04:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 11:04:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:05:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:05:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43798633
Sat 18 Jan 2014 11:05:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:05:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43798633
Sat 18 Jan 2014 11:05:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:05:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:05:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:05:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:05:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:05:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:05:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:05:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:05:13 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:05:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:05:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:05:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:05:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:05:14 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:05:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:05:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 11:05:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:05:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 11:05:14 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:05:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5736 values 90457 bits 11307 bytes 
Sat 18 Jan 2014 11:05:14 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:05:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:05:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:05:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:05:16 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:05:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:05:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:05:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:05:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:05:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:05:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:05:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:05:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43738043
Sat 18 Jan 2014 11:05:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:05:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43738043
Sat 18 Jan 2014 11:05:20 - job_xml_thread(): Done retrieving: data size 43738043
Sat 18 Jan 2014 11:05:20 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:05:20 - XML: Start document: iteration 11
Sat 18 Jan 2014 11:05:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:05:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:05:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:05:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:05:31 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:05:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:05:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:05:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:05:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:05:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:05:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:05:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:05:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:05:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:05:39 - XML: Processed 654402 elements - found 472 jobs
Sat 18 Jan 2014 11:05:39 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:05:39 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:05:39 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:05:39 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:05:42 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:05:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 11:05:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:05:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:05:43 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:05:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:05:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:05:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:05:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:05:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:05:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:05:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:05:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:05:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:05:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43245740
Sat 18 Jan 2014 11:05:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:05:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43245740
Sat 18 Jan 2014 11:05:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:05:54 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:05:54 - job_xml_thread(): Done retrieving: data size 43245740
Sat 18 Jan 2014 11:05:54 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:05:55 - XML: Start document: iteration 12
Sat 18 Jan 2014 11:05:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:05:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:06:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:06:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:06:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:06:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:06:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:06:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:06:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:06:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:06:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:06:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:06:05 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:06:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:06:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:06:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:06:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:06:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:06:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:06:08 - XML: Processed 648522 elements - found 472 jobs
Sat 18 Jan 2014 11:06:09 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:06:09 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:06:09 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:06:09 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:06:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:06:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43124818
Sat 18 Jan 2014 11:06:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:06:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43124818
Sat 18 Jan 2014 11:06:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:06:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:06:14 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:06:14 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:06:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:06:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 11:06:14 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:06:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 11:06:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8950 values 141115 bits 17639 bytes 
Sat 18 Jan 2014 11:06:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:06:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:06:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:06:20 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:06:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:06:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:06:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:06:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:06:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43124818
Sat 18 Jan 2014 11:06:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:06:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:06:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:06:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:06:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:06:24 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:06:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:06:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:06:30 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:06:32 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 11:06:32 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 11:06:32 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:06:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:06:34 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:06:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:06:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:06:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:06:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:06:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:06:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:06:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:06:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:06:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:06:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:06:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:06:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:06:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:06:36 - job_xml_thread(): Done retrieving: data size 43619829
Sat 18 Jan 2014 11:06:36 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:06:36 - XML: Start document: iteration 13
Sat 18 Jan 2014 11:06:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43619829
Sat 18 Jan 2014 11:06:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43619829
Sat 18 Jan 2014 11:06:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:06:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:06:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:06:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:06:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:06:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:06:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:06:52 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:06:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:06:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:06:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:06:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:06:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:06:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:06:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:06:53 - XML: Processed 653366 elements - found 475 jobs
Sat 18 Jan 2014 11:06:53 - job_xml_thread(): Found 3 updated jobs.
Sat 18 Jan 2014 11:06:53 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 11:06:53 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Sat 18 Jan 2014 11:06:53 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:06:53 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:06:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:06:57 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:06:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:06:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:06:57 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:06:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 11:06:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:06:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:06:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:06:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:06:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:06:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:06:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43781596
Sat 18 Jan 2014 11:06:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:07:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43781596
Sat 18 Jan 2014 11:07:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:07:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:07:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:07:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:07:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:07:09 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:07:09 - job_xml_thread(): Done retrieving: data size 43781596
Sat 18 Jan 2014 11:07:09 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:07:09 - XML: Start document: iteration 14
Sat 18 Jan 2014 11:07:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:07:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:07:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:07:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:07:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:07:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:07:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:07:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:07:15 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:07:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:07:15 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:07:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 11:07:15 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:07:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 11:07:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6134 values 96717 bits 12089 bytes 
Sat 18 Jan 2014 11:07:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:07:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:07:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:07:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:07:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:07:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:07:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:07:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:07:19 - XML: Processed 654840 elements - found 475 jobs
Sat 18 Jan 2014 11:07:19 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:07:19 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:07:19 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:07:19 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:07:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:07:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43770660
Sat 18 Jan 2014 11:07:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:07:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43770660
Sat 18 Jan 2014 11:07:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:07:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:07:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:07:29 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:07:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 11:07:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:07:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:07:32 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:07:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:07:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:07:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:07:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:07:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:07:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:07:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:07:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:07:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:07:34 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:07:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:07:34 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:07:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:07:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:07:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:07:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:07:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:07:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:07:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:07:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43794031
Sat 18 Jan 2014 11:07:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:07:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43794031
Sat 18 Jan 2014 11:07:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:07:37 - job_xml_thread(): Done retrieving: data size 43794031
Sat 18 Jan 2014 11:07:37 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:07:37 - XML: Start document: iteration 15
Sat 18 Jan 2014 11:07:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:07:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:07:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:07:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:07:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:07:52 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:07:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:07:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:07:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:07:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:07:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:07:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:07:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:07:57 - XML: Processed 655156 elements - found 475 jobs
Sat 18 Jan 2014 11:07:57 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:07:57 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:07:57 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:07:57 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:07:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:07:59 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:07:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:07:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:08:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:08:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:08:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:08:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:08:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:08:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43806693
Sat 18 Jan 2014 11:08:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:08:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43806693
Sat 18 Jan 2014 11:08:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:08:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:08:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:08:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:08:11 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:08:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:08:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:08:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:08:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:08:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:08:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:08:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:08:12 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:08:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:08:14 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:08:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:08:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:08:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:08:15 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:08:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:08:15 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:08:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 11:08:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 11:08:15 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:08:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9309 values 146832 bits 18354 bytes 
Sat 18 Jan 2014 11:08:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:08:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:08:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:08:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:08:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:08:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43825328
Sat 18 Jan 2014 11:08:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:08:16 - job_xml_thread(): Done retrieving: data size 43825328
Sat 18 Jan 2014 11:08:16 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:08:16 - XML: Start document: iteration 16
Sat 18 Jan 2014 11:08:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43825328
Sat 18 Jan 2014 11:08:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:08:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:08:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:08:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:08:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:08:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:08:33 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:08:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:08:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:08:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:08:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:08:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:08:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:08:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:08:38 - XML: Processed 655160 elements - found 477 jobs
Sat 18 Jan 2014 11:08:38 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 11:08:38 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 11:08:39 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 11:08:39 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:08:39 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:08:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:08:40 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:08:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:08:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:08:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:08:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:08:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:08:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:08:42 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:08:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 11:08:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:08:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:08:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43792311
Sat 18 Jan 2014 11:08:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:08:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43792311
Sat 18 Jan 2014 11:08:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:08:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:08:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:08:54 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:08:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:08:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:08:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:08:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:08:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:08:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:08:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:08:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:08:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:08:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:08:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:08:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:08:58 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:08:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:08:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:08:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:08:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:08:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:08:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:09:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:09:00 - job_xml_thread(): Done retrieving: data size 43810418
Sat 18 Jan 2014 11:09:00 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:09:00 - XML: Start document: iteration 17
Sat 18 Jan 2014 11:09:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43810418
Sat 18 Jan 2014 11:09:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:09:00 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 11:09:00 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:09:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43810418
Sat 18 Jan 2014 11:09:01 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:09:01 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 11:09:01 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 11:09:01 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:09:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:09:02 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 11:09:04 - size of cluster 'LISA Cluster': 624 hosts 79454 metrics 751246 values 11846687 bits 1480835 bytes 
Sat 18 Jan 2014 11:09:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:09:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:09:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:09:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:09:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:09:16 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:09:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:09:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 11:09:17 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:09:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7252 values 114256 bits 14282 bytes 
Sat 18 Jan 2014 11:09:17 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:09:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 11:09:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:09:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:09:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:09:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:09:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:09:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:09:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:09:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:09:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:09:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:09:20 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:09:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:09:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:09:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:09:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:09:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:09:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:09:23 - XML: Processed 655160 elements - found 477 jobs
Sat 18 Jan 2014 11:09:23 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:09:23 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:09:23 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:09:23 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:09:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:09:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43789692
Sat 18 Jan 2014 11:09:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:09:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43789692
Sat 18 Jan 2014 11:09:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:09:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:09:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:09:36 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:09:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 11:09:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:09:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:09:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:09:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:09:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:09:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:09:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:09:38 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:09:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:09:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:09:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:09:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:09:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:09:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:09:41 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:09:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:09:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:09:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:09:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:09:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:09:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:09:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:09:44 - job_xml_thread(): Done retrieving: data size 43804781
Sat 18 Jan 2014 11:09:44 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:09:44 - XML: Start document: iteration 18
Sat 18 Jan 2014 11:09:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43804781
Sat 18 Jan 2014 11:09:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43804781
Sat 18 Jan 2014 11:09:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:09:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:09:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:09:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:09:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:09:56 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:09:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:09:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:09:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:09:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:09:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:09:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:09:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:09:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:09:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:10:03 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:10:03 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 11:10:03 - XML: Processed 655160 elements - found 477 jobs
Sat 18 Jan 2014 11:10:03 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:10:03 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:10:03 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:10:03 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:10:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:10:05 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:10:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:10:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:10:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:10:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:10:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:10:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:10:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:10:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43770175
Sat 18 Jan 2014 11:10:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:10:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43770175
Sat 18 Jan 2014 11:10:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:10:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:10:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:10:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:10:17 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:10:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:10:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 11:10:18 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:10:18 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:10:18 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:10:18 - job_xml_thread(): Done retrieving: data size 43770175
Sat 18 Jan 2014 11:10:18 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:10:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9339 values 147287 bits 18410 bytes 
Sat 18 Jan 2014 11:10:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 11:10:18 - XML: Start document: iteration 19
Sat 18 Jan 2014 11:10:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:10:20 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:10:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:10:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:10:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:10:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:10:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:10:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:10:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:10:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:10:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:10:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:10:28 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:10:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:10:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:10:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:10:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:10:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:10:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:10:31 - XML: Processed 655160 elements - found 477 jobs
Sat 18 Jan 2014 11:10:31 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:10:31 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:10:31 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:10:31 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:10:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:10:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43791504
Sat 18 Jan 2014 11:10:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:10:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43791504
Sat 18 Jan 2014 11:10:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:10:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:10:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:10:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:10:43 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:10:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:10:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:10:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:10:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:10:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:10:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:10:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:10:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:10:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:10:46 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:10:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:10:50 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:10:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:10:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:10:50 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:10:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 11:10:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:10:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:10:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:10:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:10:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:10:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:10:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43787750
Sat 18 Jan 2014 11:10:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:10:53 - job_xml_thread(): Done retrieving: data size 43787750
Sat 18 Jan 2014 11:10:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43787750
Sat 18 Jan 2014 11:10:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:10:53 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:10:53 - XML: Start document: iteration 20
Sat 18 Jan 2014 11:10:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:10:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:11:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:11:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:11:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:11:07 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:11:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:11:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:11:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:11:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:11:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:11:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:11:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:11:16 - XML: Processed 655160 elements - found 477 jobs
Sat 18 Jan 2014 11:11:17 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:11:17 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:11:17 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:11:17 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:11:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:11:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:11:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:11:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:11:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:11:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:11:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:11:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:11:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:11:18 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:11:19 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:11:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 11:11:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:11:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 11:11:19 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:11:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5507 values 86795 bits 10849 bytes 
Sat 18 Jan 2014 11:11:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:11:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43727664
Sat 18 Jan 2014 11:11:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:11:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43727664
Sat 18 Jan 2014 11:11:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:11:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:11:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:11:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:11:31 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:11:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:11:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:11:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:11:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:11:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:11:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:11:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:11:32 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:11:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:11:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:11:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:11:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:11:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:11:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:11:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:11:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:11:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:11:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:11:38 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:11:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 11:11:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:11:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:11:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43225708
Sat 18 Jan 2014 11:11:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:11:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43225708
Sat 18 Jan 2014 11:11:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:11:41 - job_xml_thread(): Done retrieving: data size 43225708
Sat 18 Jan 2014 11:11:41 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:11:41 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 11:11:42 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 11:11:42 - Housekeeping: done.
Sat 18 Jan 2014 11:11:42 - XML: Start document: iteration 0
Sat 18 Jan 2014 11:11:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:11:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:11:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:11:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:11:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:11:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:11:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:11:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:11:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:11:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:11:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:11:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:11:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:11:59 - XML: Processed 648306 elements - found 477 jobs
Sat 18 Jan 2014 11:11:59 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:11:59 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:11:59 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:11:59 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:12:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:12:02 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:12:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:12:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:12:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:12:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:12:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:12:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:12:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:12:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43135066
Sat 18 Jan 2014 11:12:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:12:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43135066
Sat 18 Jan 2014 11:12:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:12:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:12:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:12:15 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:12:15 - job_xml_thread(): Done retrieving: data size 43135066
Sat 18 Jan 2014 11:12:15 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:12:15 - XML: Start document: iteration 1
Sat 18 Jan 2014 11:12:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:12:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:12:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:12:19 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:12:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:12:20 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:12:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:12:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:12:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:12:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 11:12:20 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:12:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 11:12:20 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:12:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7788 values 122754 bits 15344 bytes 
Sat 18 Jan 2014 11:12:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:12:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:12:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:12:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:12:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:12:28 - XML: Processed 647014 elements - found 477 jobs
Sat 18 Jan 2014 11:12:28 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:12:28 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:12:28 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:12:28 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:12:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:12:28 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:12:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:12:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:12:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:12:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:12:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:12:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:12:31 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 11:12:31 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 11:12:31 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:12:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:12:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43198098
Sat 18 Jan 2014 11:12:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:12:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43198098
Sat 18 Jan 2014 11:12:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:12:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:12:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:12:43 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:12:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:12:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:12:44 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:12:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:12:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:12:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:12:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:12:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:12:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:12:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:12:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:12:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:12:48 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:12:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:12:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:12:48 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:12:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 11:12:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:12:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:12:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:12:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:12:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:12:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:12:50 - job_xml_thread(): Done retrieving: data size 43745117
Sat 18 Jan 2014 11:12:50 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:12:50 - XML: Start document: iteration 2
Sat 18 Jan 2014 11:12:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43745117
Sat 18 Jan 2014 11:12:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43745117
Sat 18 Jan 2014 11:12:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:12:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:12:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:12:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:13:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:13:02 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:13:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:13:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:13:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:13:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:13:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:13:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:13:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:13:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:13:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:13:08 - XML: Processed 654368 elements - found 477 jobs
Sat 18 Jan 2014 11:13:08 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:13:08 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:13:08 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:13:08 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:13:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:13:10 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:13:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:13:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:13:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:13:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:13:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:13:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:13:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:13:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43781225
Sat 18 Jan 2014 11:13:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:13:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43781225
Sat 18 Jan 2014 11:13:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:13:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:13:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:13:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:13:20 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:13:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:13:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 11:13:21 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:13:21 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:13:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8990 values 141802 bits 17725 bytes 
Sat 18 Jan 2014 11:13:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 11:13:23 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:13:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:13:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:13:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:13:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:13:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:13:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:13:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:13:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:13:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:13:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:13:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:13:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:13:27 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:13:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:13:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:13:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:13:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:13:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:13:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:13:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:13:29 - job_xml_thread(): Done retrieving: data size 43796882
Sat 18 Jan 2014 11:13:29 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:13:29 - XML: Start document: iteration 3
Sat 18 Jan 2014 11:13:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43796882
Sat 18 Jan 2014 11:13:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43796882
Sat 18 Jan 2014 11:13:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:13:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:13:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:13:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:13:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:13:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:13:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:13:50 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:13:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:13:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:13:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:13:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:13:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:13:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:13:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:13:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:13:52 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:13:52 - XML: Processed 655160 elements - found 477 jobs
Sat 18 Jan 2014 11:13:52 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:13:52 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:13:52 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:13:52 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:13:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:13:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:13:52 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:13:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 11:13:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:13:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:13:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:13:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:13:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:13:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:13:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43791103
Sat 18 Jan 2014 11:13:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:13:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43791103
Sat 18 Jan 2014 11:13:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:14:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:14:02 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:14:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:14:05 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:14:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:14:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:14:07 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:14:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:14:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:14:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:14:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:14:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:14:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:14:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:14:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:14:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:14:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:14:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:14:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:14:08 - job_xml_thread(): Done retrieving: data size 43803658
Sat 18 Jan 2014 11:14:08 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:14:08 - XML: Start document: iteration 4
Sat 18 Jan 2014 11:14:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43803658
Sat 18 Jan 2014 11:14:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:14:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43803658
Sat 18 Jan 2014 11:14:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:14:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:14:22 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:14:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:14:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:14:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:14:23 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:14:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 11:14:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:14:23 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:14:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 11:14:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:14:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9231 values 145547 bits 18193 bytes 
Sat 18 Jan 2014 11:14:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:14:24 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:14:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:14:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:14:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:14:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:14:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:14:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:14:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:14:27 - XML: Processed 655157 elements - found 477 jobs
Sat 18 Jan 2014 11:14:27 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:14:27 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:14:27 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:14:27 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:14:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:14:31 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:14:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:14:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:14:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:14:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:14:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:14:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:14:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:14:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43814633
Sat 18 Jan 2014 11:14:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:14:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43814633
Sat 18 Jan 2014 11:14:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:14:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:14:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:14:42 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:14:42 - job_xml_thread(): Done retrieving: data size 43814633
Sat 18 Jan 2014 11:14:42 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:14:42 - XML: Start document: iteration 5
Sat 18 Jan 2014 11:14:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:14:45 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:14:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:14:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:14:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:14:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:14:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:14:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:14:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:14:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:14:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:14:50 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:14:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 11:14:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:14:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:14:53 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:14:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:14:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:14:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:14:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:14:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:14:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:14:55 - XML: Processed 655160 elements - found 477 jobs
Sat 18 Jan 2014 11:14:55 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:14:55 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:14:55 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:14:55 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:14:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:14:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43781506
Sat 18 Jan 2014 11:14:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:14:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43781506
Sat 18 Jan 2014 11:14:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:15:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:15:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:15:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:15:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:15:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:15:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:15:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:15:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:15:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:15:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:15:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:15:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:15:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:15:10 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:15:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:15:11 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:15:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:15:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:15:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:15:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:15:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:15:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:15:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:15:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43806776
Sat 18 Jan 2014 11:15:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:15:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43806776
Sat 18 Jan 2014 11:15:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:15:13 - job_xml_thread(): Done retrieving: data size 43806776
Sat 18 Jan 2014 11:15:13 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:15:14 - XML: Start document: iteration 6
Sat 18 Jan 2014 11:15:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:15:23 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:15:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:15:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:15:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:15:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 11:15:24 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:15:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 11:15:24 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:15:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8959 values 141243 bits 17655 bytes 
Sat 18 Jan 2014 11:15:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:15:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:15:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:15:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:15:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:15:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:15:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:15:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:15:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:15:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:15:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:15:34 - XML: Processed 655160 elements - found 477 jobs
Sat 18 Jan 2014 11:15:34 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:15:34 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:15:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:15:34 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:15:34 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:15:34 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:15:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:15:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:15:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:15:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:15:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:15:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:15:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:15:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43803510
Sat 18 Jan 2014 11:15:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:15:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43803510
Sat 18 Jan 2014 11:15:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:15:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:15:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:15:47 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:15:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 11:15:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:15:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:15:49 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:15:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:15:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:15:49 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:15:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:15:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:15:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:15:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:15:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:15:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:15:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:15:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:15:50 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:15:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:15:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:15:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:15:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:15:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:15:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:15:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:15:52 - job_xml_thread(): Done retrieving: data size 43800726
Sat 18 Jan 2014 11:15:52 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:15:52 - XML: Start document: iteration 7
Sat 18 Jan 2014 11:15:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43800726
Sat 18 Jan 2014 11:15:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:15:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43800726
Sat 18 Jan 2014 11:15:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:16:03 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 11:16:03 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:16:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:16:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:16:05 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:16:06 - XML: Processed 655160 elements - found 477 jobs
Sat 18 Jan 2014 11:16:06 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:16:06 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 11:16:06 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:16:06 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:16:06 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 11:16:06 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:16:06 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 11:16:06 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:16:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:16:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:16:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:16:11 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:16:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:16:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:16:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:16:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:16:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:16:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:16:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:16:14 - size of cluster 'LISA Cluster': 624 hosts 79474 metrics 824655 values 13001842 bits 1625230 bytes 
Sat 18 Jan 2014 11:16:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:16:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:16:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:16:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:16:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:16:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:16:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:16:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:16:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:16:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43819866
Sat 18 Jan 2014 11:16:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:16:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43819866
Sat 18 Jan 2014 11:16:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:16:21 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:16:22 - job_xml_thread(): Done retrieving: data size 43819866
Sat 18 Jan 2014 11:16:22 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:16:22 - XML: Start document: iteration 8
Sat 18 Jan 2014 11:16:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:16:24 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:16:26 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:16:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:16:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 11:16:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 11:16:26 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:16:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9320 values 147100 bits 18387 bytes 
Sat 18 Jan 2014 11:16:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:16:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:16:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:16:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:16:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:16:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:16:37 - XML: Processed 655160 elements - found 477 jobs
Sat 18 Jan 2014 11:16:37 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:16:37 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:16:37 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:16:37 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:16:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:16:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:16:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:16:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:16:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:16:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:16:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:16:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:16:42 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:16:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:16:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:16:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:16:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:16:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:16:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:16:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:16:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43818238
Sat 18 Jan 2014 11:16:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:16:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43818238
Sat 18 Jan 2014 11:16:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:16:52 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:16:52 - job_xml_thread(): Done retrieving: data size 43818238
Sat 18 Jan 2014 11:16:52 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:16:52 - XML: Start document: iteration 9
Sat 18 Jan 2014 11:16:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:16:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:16:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:16:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:16:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:16:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:16:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:16:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:16:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:16:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:16:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:16:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:16:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:17:05 - XML: Processed 655160 elements - found 477 jobs
Sat 18 Jan 2014 11:17:05 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:17:05 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:17:05 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:17:05 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:17:06 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:17:06 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 11:17:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:17:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:17:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:17:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:17:08 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:17:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 11:17:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:17:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:17:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:17:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:17:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:17:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:17:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43781856
Sat 18 Jan 2014 11:17:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:17:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43781856
Sat 18 Jan 2014 11:17:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:17:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:17:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:17:20 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:17:20 - job_xml_thread(): Done retrieving: data size 43781856
Sat 18 Jan 2014 11:17:20 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:17:20 - XML: Start document: iteration 10
Sat 18 Jan 2014 11:17:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:17:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:17:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:17:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:17:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:17:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:17:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:17:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:17:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:17:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:17:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:17:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:17:26 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:17:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:17:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 11:17:27 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:17:27 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:17:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 11:17:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5649 values 89304 bits 11163 bytes 
Sat 18 Jan 2014 11:17:31 - XML: Processed 655160 elements - found 477 jobs
Sat 18 Jan 2014 11:17:31 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:17:31 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:17:31 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:17:31 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:17:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:17:33 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:17:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:17:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:17:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:17:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:17:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:17:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:17:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:17:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43637696
Sat 18 Jan 2014 11:17:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:17:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43637696
Sat 18 Jan 2014 11:17:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:17:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:17:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:17:46 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:17:46 - job_xml_thread(): Done retrieving: data size 43637696
Sat 18 Jan 2014 11:17:46 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:17:46 - XML: Start document: iteration 11
Sat 18 Jan 2014 11:17:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:17:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:17:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:17:49 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:17:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:17:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:17:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:17:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:17:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:17:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:17:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:17:58 - XML: Processed 653382 elements - found 477 jobs
Sat 18 Jan 2014 11:17:58 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:17:58 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:17:58 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:17:58 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:18:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:18:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:18:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:18:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:18:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:18:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:18:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:18:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:18:00 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:18:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 11:18:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:18:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:18:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43141334
Sat 18 Jan 2014 11:18:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:18:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43141334
Sat 18 Jan 2014 11:18:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:18:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:18:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:18:13 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:18:13 - job_xml_thread(): Done retrieving: data size 43141334
Sat 18 Jan 2014 11:18:13 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:18:13 - XML: Start document: iteration 12
Sat 18 Jan 2014 11:18:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:18:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:18:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:18:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:18:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:18:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:18:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:18:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:18:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:18:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:18:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:18:26 - XML: Processed 647092 elements - found 476 jobs
Sat 18 Jan 2014 11:18:26 - job 7343616 appears to have finished
Sat 18 Jan 2014 11:18:26 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 11:18:26 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 11:18:27 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 11:18:27 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:18:27 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:18:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:18:27 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:18:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:18:27 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:18:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 11:18:27 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:18:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 11:18:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5637 values 89080 bits 11135 bytes 
Sat 18 Jan 2014 11:18:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:18:28 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:18:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:18:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:18:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:18:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:18:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:18:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:18:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:18:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43185385
Sat 18 Jan 2014 11:18:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:18:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43185385
Sat 18 Jan 2014 11:18:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:18:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:18:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:18:42 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:18:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:18:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:18:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:18:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:18:45 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:18:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:18:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:18:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:18:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:18:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:18:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:18:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:18:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:18:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:18:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:18:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:18:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:18:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:18:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:18:48 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:18:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 11:18:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:18:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:18:50 - job_xml_thread(): Done retrieving: data size 43735592
Sat 18 Jan 2014 11:18:50 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:18:50 - XML: Start document: iteration 13
Sat 18 Jan 2014 11:18:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43735592
Sat 18 Jan 2014 11:18:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:18:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43735592
Sat 18 Jan 2014 11:18:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:19:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:19:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:19:02 - XML: Processed 654082 elements - found 476 jobs
Sat 18 Jan 2014 11:19:02 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:19:02 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:19:02 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:19:02 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:19:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:19:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:19:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:19:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:19:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:19:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:19:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:19:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:19:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:19:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:19:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:19:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:19:13 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:19:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:19:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:19:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:19:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:19:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:19:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:19:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:19:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43795672
Sat 18 Jan 2014 11:19:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:19:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43795672
Sat 18 Jan 2014 11:19:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:19:17 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:19:17 - job_xml_thread(): Done retrieving: data size 43795672
Sat 18 Jan 2014 11:19:17 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:19:17 - XML: Start document: iteration 14
Sat 18 Jan 2014 11:19:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:19:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:19:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:19:27 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:19:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:19:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:19:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:19:28 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:19:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 11:19:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 11:19:29 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:19:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8490 values 133882 bits 16735 bytes 
Sat 18 Jan 2014 11:19:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:19:32 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:19:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:19:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:19:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:19:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:19:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:19:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:19:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:19:35 - XML: Processed 655158 elements - found 476 jobs
Sat 18 Jan 2014 11:19:35 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:19:35 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:19:35 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:19:35 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:19:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:19:40 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:19:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:19:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:19:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:19:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:19:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:19:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:19:44 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 11:19:44 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 11:19:44 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:19:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:19:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43772916
Sat 18 Jan 2014 11:19:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:19:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43772916
Sat 18 Jan 2014 11:19:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:19:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:19:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:19:51 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:19:51 - job_xml_thread(): Done retrieving: data size 43772916
Sat 18 Jan 2014 11:19:51 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:19:51 - XML: Start document: iteration 15
Sat 18 Jan 2014 11:19:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:19:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:19:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:19:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:19:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:19:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:19:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:19:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:19:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:19:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:19:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:20:05 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:20:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 11:20:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:20:07 - XML: Processed 655158 elements - found 476 jobs
Sat 18 Jan 2014 11:20:07 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:20:07 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:20:07 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:20:07 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:20:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:20:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:20:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:20:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:20:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:20:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:20:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:20:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:20:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:20:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43761453
Sat 18 Jan 2014 11:20:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:20:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43761453
Sat 18 Jan 2014 11:20:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:20:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:20:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:20:22 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:20:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:20:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:20:24 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:20:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:20:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:20:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:20:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:20:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:20:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:20:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:20:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:20:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:20:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:20:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:20:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:20:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:20:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:20:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:20:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:20:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:20:27 - job_xml_thread(): Done retrieving: data size 43791531
Sat 18 Jan 2014 11:20:27 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:20:27 - XML: Start document: iteration 16
Sat 18 Jan 2014 11:20:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43791531
Sat 18 Jan 2014 11:20:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:20:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43791531
Sat 18 Jan 2014 11:20:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:20:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:20:29 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:20:30 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:20:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 11:20:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:20:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 11:20:31 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:20:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8830 values 139256 bits 17407 bytes 
Sat 18 Jan 2014 11:20:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:20:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:20:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:20:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:20:44 - XML: Processed 655158 elements - found 476 jobs
Sat 18 Jan 2014 11:20:44 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:20:44 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:20:44 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:20:44 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:20:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:20:44 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:20:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:20:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:20:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:20:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:20:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:20:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:20:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:20:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:20:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:20:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:20:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:20:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:20:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:20:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:20:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:20:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:20:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43789612
Sat 18 Jan 2014 11:20:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:20:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43789612
Sat 18 Jan 2014 11:20:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:20:59 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:20:59 - job_xml_thread(): Done retrieving: data size 43789612
Sat 18 Jan 2014 11:20:59 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:20:59 - XML: Start document: iteration 17
Sat 18 Jan 2014 11:21:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:21:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:21:06 - XML: Processed 655158 elements - found 476 jobs
Sat 18 Jan 2014 11:21:06 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:21:06 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:21:06 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:21:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:21:06 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:21:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:21:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:21:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:21:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:21:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:21:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:21:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:21:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:21:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:21:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:21:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:21:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:21:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:21:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:21:15 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:21:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 11:21:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:21:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:21:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:21:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:21:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:21:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:21:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43824659
Sat 18 Jan 2014 11:21:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:21:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43824659
Sat 18 Jan 2014 11:21:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:21:21 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:21:21 - job_xml_thread(): Done retrieving: data size 43824659
Sat 18 Jan 2014 11:21:21 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:21:21 - XML: Start document: iteration 18
Sat 18 Jan 2014 11:21:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:21:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:21:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:21:30 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:21:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:21:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:21:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:21:32 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:21:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 11:21:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 11:21:32 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:21:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6181 values 97474 bits 12184 bytes 
Sat 18 Jan 2014 11:21:35 - XML: Processed 655158 elements - found 476 jobs
Sat 18 Jan 2014 11:21:35 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:21:35 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:21:35 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:21:35 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:21:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:21:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:21:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:21:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:21:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:21:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:21:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:21:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:21:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:21:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:21:41 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:21:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:21:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:21:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:21:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:21:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:21:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:21:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:21:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43793215
Sat 18 Jan 2014 11:21:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:21:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43793215
Sat 18 Jan 2014 11:21:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:21:50 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:21:51 - job_xml_thread(): Done retrieving: data size 43793215
Sat 18 Jan 2014 11:21:51 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:21:51 - XML: Start document: iteration 19
Sat 18 Jan 2014 11:21:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:21:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:21:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:21:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:21:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:21:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:21:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:21:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:22:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:22:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:22:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:22:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:22:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:22:04 - XML: Processed 655158 elements - found 476 jobs
Sat 18 Jan 2014 11:22:04 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:22:04 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:22:04 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:22:04 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:22:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:22:05 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:22:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:22:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:22:06 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:22:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 11:22:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:22:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:22:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:22:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:22:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:22:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:22:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43801527
Sat 18 Jan 2014 11:22:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:22:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43801527
Sat 18 Jan 2014 11:22:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:22:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:22:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:22:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:22:18 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:22:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:22:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:22:19 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:22:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:22:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:22:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:22:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:22:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:22:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:22:21 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:22:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:22:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:22:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:22:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:22:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:22:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:22:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:22:23 - job_xml_thread(): Done retrieving: data size 43807989
Sat 18 Jan 2014 11:22:23 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:22:23 - XML: Start document: iteration 20
Sat 18 Jan 2014 11:22:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43807989
Sat 18 Jan 2014 11:22:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:22:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43807989
Sat 18 Jan 2014 11:22:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:22:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:22:32 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:22:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:22:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 11:22:32 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:22:32 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:22:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 11:22:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9060 values 142969 bits 17871 bytes 
Sat 18 Jan 2014 11:22:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:22:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:22:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:22:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:22:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:22:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:22:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:22:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:22:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:22:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:22:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:22:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:22:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:22:41 - XML: Processed 655160 elements - found 477 jobs
Sat 18 Jan 2014 11:22:41 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 11:22:41 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 11:22:41 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 11:22:41 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:22:41 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:22:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:22:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:22:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:22:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:22:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:22:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:22:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:22:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:22:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:22:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43796710
Sat 18 Jan 2014 11:22:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:22:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43796710
Sat 18 Jan 2014 11:22:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:22:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:22:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:22:56 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:22:56 - job_xml_thread(): Done retrieving: data size 43796710
Sat 18 Jan 2014 11:22:56 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:22:56 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 11:22:56 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 11:22:56 - Housekeeping: done.
Sat 18 Jan 2014 11:22:56 - XML: Start document: iteration 0
Sat 18 Jan 2014 11:22:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:22:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:22:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:22:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:23:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:23:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:23:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:23:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:23:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:23:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:23:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:23:06 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 11:23:06 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:23:07 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:23:07 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 11:23:07 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:23:07 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 11:23:07 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 11:23:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:23:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:23:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:23:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:23:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:23:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:23:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:23:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:23:11 - size of cluster 'LISA Cluster': 624 hosts 79487 metrics 866148 values 13667643 bits 1708455 bytes 
Sat 18 Jan 2014 11:23:12 - XML: Processed 655160 elements - found 477 jobs
Sat 18 Jan 2014 11:23:12 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:23:12 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:23:12 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:23:12 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:23:13 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:23:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 11:23:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:23:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:23:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:23:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:23:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43775758
Sat 18 Jan 2014 11:23:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:23:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43775758
Sat 18 Jan 2014 11:23:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:23:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:23:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:23:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:23:25 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:23:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:23:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:23:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:23:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:23:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:23:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43775758
Sat 18 Jan 2014 11:23:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:23:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:23:28 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:23:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:23:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:23:32 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:23:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:23:33 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:23:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:23:33 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:23:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 11:23:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 11:23:33 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:23:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5707 values 89997 bits 11249 bytes 
Sat 18 Jan 2014 11:23:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:23:38 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:23:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:23:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:23:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:23:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:23:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:23:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:23:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:23:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:23:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:23:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:23:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:23:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:23:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:23:41 - job_xml_thread(): Done retrieving: data size 43321909
Sat 18 Jan 2014 11:23:41 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:23:41 - XML: Start document: iteration 1
Sat 18 Jan 2014 11:23:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43321909
Sat 18 Jan 2014 11:23:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:23:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43321909
Sat 18 Jan 2014 11:23:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:23:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:23:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:23:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:23:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:23:58 - XML: Processed 649649 elements - found 477 jobs
Sat 18 Jan 2014 11:23:58 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:23:58 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:23:58 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:23:58 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:24:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:24:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:24:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:24:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:24:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:24:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:24:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:24:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:24:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:24:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:24:05 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:24:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:24:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:24:05 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:24:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 11:24:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:24:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:24:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:24:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:24:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:24:07 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:24:07 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 11:24:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:24:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43158901
Sat 18 Jan 2014 11:24:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:24:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43158901
Sat 18 Jan 2014 11:24:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:24:14 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:24:14 - job_xml_thread(): Done retrieving: data size 43158901
Sat 18 Jan 2014 11:24:14 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:24:14 - XML: Start document: iteration 2
Sat 18 Jan 2014 11:24:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:24:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:24:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:24:19 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:24:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:24:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:24:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:24:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:24:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:24:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:24:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:24:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:24:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:24:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:24:28 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:24:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:24:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:24:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:24:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:24:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:24:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:24:30 - XML: Processed 647164 elements - found 477 jobs
Sat 18 Jan 2014 11:24:30 - job 7348844 field 'start_timestamp' changed since saved from: 1390040487 to: 1390040452
Sat 18 Jan 2014 11:24:30 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 11:24:30 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 11:24:30 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 11:24:30 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:24:30 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:24:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:24:33 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:24:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:24:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43184849
Sat 18 Jan 2014 11:24:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:24:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43184849
Sat 18 Jan 2014 11:24:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:24:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:24:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 11:24:35 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:24:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9026 values 142353 bits 17794 bytes 
Sat 18 Jan 2014 11:24:35 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:24:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 11:24:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:24:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:24:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:24:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:24:45 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:24:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:24:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:24:46 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:24:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:24:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:24:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:24:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:24:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:24:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:24:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:24:48 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:24:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:24:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:24:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:24:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:24:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:24:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:24:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:24:52 - job_xml_thread(): Done retrieving: data size 43742237
Sat 18 Jan 2014 11:24:52 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:24:52 - XML: Start document: iteration 3
Sat 18 Jan 2014 11:24:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43742237
Sat 18 Jan 2014 11:24:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:24:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43742237
Sat 18 Jan 2014 11:24:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:25:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:25:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:25:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:25:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:25:04 - XML: Processed 654208 elements - found 477 jobs
Sat 18 Jan 2014 11:25:04 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:25:04 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:25:04 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:25:04 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:25:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:25:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:25:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:25:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:25:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:25:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:25:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:25:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:25:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:25:13 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:25:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 11:25:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:25:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:25:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:25:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:25:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:25:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:25:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:25:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:25:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:25:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:25:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43811993
Sat 18 Jan 2014 11:25:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:25:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43811993
Sat 18 Jan 2014 11:25:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:25:20 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:25:20 - job_xml_thread(): Done retrieving: data size 43811993
Sat 18 Jan 2014 11:25:20 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:25:20 - XML: Start document: iteration 4
Sat 18 Jan 2014 11:25:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:25:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:25:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:25:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:25:33 - XML: Processed 655160 elements - found 477 jobs
Sat 18 Jan 2014 11:25:33 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:25:33 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:25:33 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:25:33 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:25:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:25:35 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:25:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:25:36 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:25:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 11:25:36 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:25:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 11:25:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5906 values 93189 bits 11648 bytes 
Sat 18 Jan 2014 11:25:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:25:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:25:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:25:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:25:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:25:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:25:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:25:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:25:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:25:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:25:41 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:25:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:25:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:25:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:25:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:25:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:25:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:25:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:25:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43797315
Sat 18 Jan 2014 11:25:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:25:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43797315
Sat 18 Jan 2014 11:25:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:25:48 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:25:48 - job_xml_thread(): Done retrieving: data size 43797315
Sat 18 Jan 2014 11:25:48 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:25:48 - XML: Start document: iteration 5
Sat 18 Jan 2014 11:25:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:25:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:25:55 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:25:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 11:25:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:25:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:25:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:26:01 - XML: Processed 655160 elements - found 477 jobs
Sat 18 Jan 2014 11:26:01 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:26:01 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:26:01 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:26:01 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:26:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:26:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:26:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:26:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:26:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:26:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:26:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:26:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:26:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:26:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:26:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:26:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:26:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:26:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:26:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:26:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:26:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:26:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:26:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43799498
Sat 18 Jan 2014 11:26:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:26:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43799498
Sat 18 Jan 2014 11:26:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:26:16 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:26:16 - job_xml_thread(): Done retrieving: data size 43799498
Sat 18 Jan 2014 11:26:16 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:26:16 - XML: Start document: iteration 6
Sat 18 Jan 2014 11:26:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:26:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:26:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:26:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:26:26 - XML: Processed 655158 elements - found 476 jobs
Sat 18 Jan 2014 11:26:26 - job 7346484 appears to have finished
Sat 18 Jan 2014 11:26:26 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 11:26:26 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 11:26:27 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 11:26:27 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:26:27 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:26:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:26:30 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:26:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:26:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:26:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:26:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:26:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:26:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:26:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:26:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:26:34 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:26:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:26:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:26:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:26:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:26:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:26:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:26:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:26:36 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:26:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:26:36 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:26:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 11:26:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 11:26:36 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:26:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6013 values 94800 bits 11850 bytes 
Sat 18 Jan 2014 11:26:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:26:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43820673
Sat 18 Jan 2014 11:26:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:26:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43820673
Sat 18 Jan 2014 11:26:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:26:42 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:26:42 - job_xml_thread(): Done retrieving: data size 43820673
Sat 18 Jan 2014 11:26:42 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:26:42 - XML: Start document: iteration 7
Sat 18 Jan 2014 11:26:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:26:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:26:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:26:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:26:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:26:52 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:26:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:26:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:26:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:26:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:26:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:26:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:26:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:26:58 - XML: Processed 655158 elements - found 476 jobs
Sat 18 Jan 2014 11:26:58 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:26:58 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:26:58 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:26:58 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:26:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:26:59 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:26:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:26:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:27:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:27:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:27:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:27:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:27:01 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:27:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 11:27:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:27:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:27:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43795843
Sat 18 Jan 2014 11:27:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:27:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43795843
Sat 18 Jan 2014 11:27:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:27:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:27:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:27:13 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:27:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:27:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:27:14 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:27:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:27:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:27:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:27:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:27:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:27:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:27:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:27:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:27:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:27:16 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:27:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:27:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:27:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:27:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:27:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:27:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:27:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:27:19 - job_xml_thread(): Done retrieving: data size 43820607
Sat 18 Jan 2014 11:27:19 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:27:19 - XML: Start document: iteration 8
Sat 18 Jan 2014 11:27:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43820607
Sat 18 Jan 2014 11:27:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43820607
Sat 18 Jan 2014 11:27:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:27:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:27:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:27:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:27:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:27:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:27:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:27:36 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:27:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:27:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 11:27:37 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:27:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 11:27:37 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:27:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7136 values 112563 bits 14070 bytes 
Sat 18 Jan 2014 11:27:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:27:39 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:27:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:27:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:27:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:27:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:27:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:27:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:27:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:27:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:27:42 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:27:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:27:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:27:42 - XML: Processed 655158 elements - found 476 jobs
Sat 18 Jan 2014 11:27:42 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:27:42 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:27:42 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:27:42 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:27:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:27:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:27:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:27:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:27:45 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 11:27:45 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 11:27:45 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:27:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:27:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43807347
Sat 18 Jan 2014 11:27:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:27:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43807347
Sat 18 Jan 2014 11:27:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:27:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:27:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:27:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:27:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:27:57 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:27:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:27:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:27:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:27:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:27:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:27:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:27:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:28:00 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:28:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 11:28:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:28:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:28:02 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:28:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:28:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:28:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:28:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:28:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:28:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:28:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:28:03 - job_xml_thread(): Done retrieving: data size 43808377
Sat 18 Jan 2014 11:28:03 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:28:03 - XML: Start document: iteration 9
Sat 18 Jan 2014 11:28:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43808377
Sat 18 Jan 2014 11:28:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:28:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43808377
Sat 18 Jan 2014 11:28:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:28:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:28:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:28:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:28:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:28:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:28:18 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:28:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:28:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:28:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:28:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:28:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:28:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:28:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:28:25 - XML: Processed 655158 elements - found 476 jobs
Sat 18 Jan 2014 11:28:25 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:28:25 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:28:25 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:28:25 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:28:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:28:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:28:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:28:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:28:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:28:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:28:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:28:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:28:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:28:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43782806
Sat 18 Jan 2014 11:28:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:28:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43782806
Sat 18 Jan 2014 11:28:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:28:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:28:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:28:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:28:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:28:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:28:37 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:28:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:28:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:28:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:28:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:28:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:28:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:28:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:28:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:28:38 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:28:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 11:28:38 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:28:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9140 values 144202 bits 18025 bytes 
Sat 18 Jan 2014 11:28:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 11:28:40 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:28:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:28:41 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:28:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:28:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:28:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:28:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:28:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:28:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:28:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:28:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43800641
Sat 18 Jan 2014 11:28:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:28:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43800641
Sat 18 Jan 2014 11:28:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:28:44 - job_xml_thread(): Done retrieving: data size 43800641
Sat 18 Jan 2014 11:28:44 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:28:44 - XML: Start document: iteration 10
Sat 18 Jan 2014 11:28:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:28:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:28:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:28:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:28:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:28:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:28:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:28:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:28:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:28:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:28:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:28:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:28:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:29:02 - XML: Processed 655158 elements - found 476 jobs
Sat 18 Jan 2014 11:29:02 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:29:02 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:29:02 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:29:02 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:29:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:29:07 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:29:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:29:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:29:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:29:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:29:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:29:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:29:07 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:29:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 11:29:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:29:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:29:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43794136
Sat 18 Jan 2014 11:29:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:29:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43794136
Sat 18 Jan 2014 11:29:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:29:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:29:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:29:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:29:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:29:17 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:29:17 - job_xml_thread(): Done retrieving: data size 43794136
Sat 18 Jan 2014 11:29:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:29:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:29:17 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:29:18 - XML: Start document: iteration 11
Sat 18 Jan 2014 11:29:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:29:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:29:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:29:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:29:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:29:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:29:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:29:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:29:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:29:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:29:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:29:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:29:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:29:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:29:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:29:28 - XML: Processed 655158 elements - found 476 jobs
Sat 18 Jan 2014 11:29:28 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:29:28 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:29:28 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:29:28 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:29:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:29:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43721592
Sat 18 Jan 2014 11:29:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:29:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43721592
Sat 18 Jan 2014 11:29:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:29:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:29:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:29:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:29:39 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:29:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:29:39 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:29:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 11:29:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 11:29:39 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:29:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8677 values 136803 bits 17100 bytes 
Sat 18 Jan 2014 11:29:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:29:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:29:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:29:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:29:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:29:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:29:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:29:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:29:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:29:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:29:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:29:43 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:29:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:29:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:29:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:29:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:29:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:29:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:29:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:29:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:29:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:29:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43205864
Sat 18 Jan 2014 11:29:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:29:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43205864
Sat 18 Jan 2014 11:29:48 - job_xml_thread(): Done retrieving: data size 43205864
Sat 18 Jan 2014 11:29:48 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:29:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:29:48 - XML: Start document: iteration 12
Sat 18 Jan 2014 11:29:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:29:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:30:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:30:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:30:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:30:07 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:30:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:30:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:30:07 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 11:30:07 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:30:07 - XML: Processed 647628 elements - found 476 jobs
Sat 18 Jan 2014 11:30:07 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:30:07 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:30:07 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:30:07 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:30:08 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:30:08 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:30:08 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 11:30:08 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 11:30:08 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 11:30:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:30:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:30:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:30:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:30:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:30:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:30:10 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:30:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:30:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:30:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:30:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:30:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:30:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:30:11 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:30:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 11:30:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:30:11 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 780994 values 12309458 bits 1538682 bytes 
Sat 18 Jan 2014 11:30:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:30:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43202262
Sat 18 Jan 2014 11:30:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:30:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43202262
Sat 18 Jan 2014 11:30:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:30:22 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:30:23 - job_xml_thread(): Done retrieving: data size 43202262
Sat 18 Jan 2014 11:30:23 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:30:23 - XML: Start document: iteration 13
Sat 18 Jan 2014 11:30:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:30:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:30:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:30:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:30:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:30:26 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:30:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:30:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:30:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:30:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:30:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:30:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:30:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:30:35 - XML: Processed 647700 elements - found 476 jobs
Sat 18 Jan 2014 11:30:35 - job 7348834 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 11:30:35 - job 7346487 appears to have finished
Sat 18 Jan 2014 11:30:35 - job_xml_thread(): Found 3 updated jobs.
Sat 18 Jan 2014 11:30:35 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 11:30:36 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Sat 18 Jan 2014 11:30:36 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:30:36 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:30:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:30:37 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:30:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:30:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:30:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:30:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:30:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:30:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:30:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:30:39 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:30:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:30:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43674929
Sat 18 Jan 2014 11:30:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:30:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43674929
Sat 18 Jan 2014 11:30:40 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:30:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:30:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:30:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 11:30:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 11:30:40 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:30:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6138 values 96837 bits 12104 bytes 
Sat 18 Jan 2014 11:30:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:30:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:30:51 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:30:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:30:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:30:52 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:30:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:30:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:30:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:30:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:30:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:30:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:30:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:30:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:30:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:30:57 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:30:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:30:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:30:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:30:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:30:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:30:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:31:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:31:00 - job_xml_thread(): Done retrieving: data size 43779869
Sat 18 Jan 2014 11:31:00 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:31:00 - XML: Start document: iteration 14
Sat 18 Jan 2014 11:31:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43779869
Sat 18 Jan 2014 11:31:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:31:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43779869
Sat 18 Jan 2014 11:31:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:31:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:31:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:31:08 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:31:08 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 11:31:11 - XML: Processed 655014 elements - found 476 jobs
Sat 18 Jan 2014 11:31:12 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:31:12 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:31:12 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:31:12 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:31:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:31:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:31:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:31:19 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:31:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:31:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:31:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:31:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:31:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:31:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:31:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:31:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:31:22 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:31:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:31:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:31:22 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:31:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 11:31:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:31:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:31:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:31:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:31:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:31:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:31:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43790343
Sat 18 Jan 2014 11:31:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:31:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43790343
Sat 18 Jan 2014 11:31:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:31:27 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:31:27 - job_xml_thread(): Done retrieving: data size 43790343
Sat 18 Jan 2014 11:31:27 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:31:27 - XML: Start document: iteration 15
Sat 18 Jan 2014 11:31:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:31:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:31:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:31:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:31:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:31:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:31:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:31:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:31:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:31:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:31:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:31:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:31:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:31:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:31:40 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:31:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:31:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 11:31:40 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:31:40 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:31:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 11:31:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5775 values 91132 bits 11391 bytes 
Sat 18 Jan 2014 11:31:43 - XML: Processed 655158 elements - found 476 jobs
Sat 18 Jan 2014 11:31:43 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:31:43 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:31:43 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:31:43 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:31:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:31:49 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:31:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:31:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:31:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:31:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:31:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:31:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:31:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:31:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43769331
Sat 18 Jan 2014 11:31:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:31:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43769331
Sat 18 Jan 2014 11:31:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:31:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:31:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:31:59 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:31:59 - job_xml_thread(): Done retrieving: data size 43769331
Sat 18 Jan 2014 11:31:59 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:31:59 - XML: Start document: iteration 16
Sat 18 Jan 2014 11:32:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:32:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:32:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:32:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:32:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:32:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:32:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:32:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:32:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:32:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:32:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:32:13 - XML: Processed 655153 elements - found 476 jobs
Sat 18 Jan 2014 11:32:13 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:32:13 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:32:13 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:32:13 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:32:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:32:14 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:32:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:32:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:32:14 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:32:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:32:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:32:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:32:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:32:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 11:32:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:32:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:32:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43790554
Sat 18 Jan 2014 11:32:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:32:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43790554
Sat 18 Jan 2014 11:32:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:32:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:32:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:32:28 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:32:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:32:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:32:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:32:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:32:30 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:32:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:32:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:32:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:32:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:32:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:32:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:32:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:32:33 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:32:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:32:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:32:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:32:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:32:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:32:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:32:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:32:36 - job_xml_thread(): Done retrieving: data size 43797865
Sat 18 Jan 2014 11:32:36 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:32:36 - XML: Start document: iteration 17
Sat 18 Jan 2014 11:32:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43797865
Sat 18 Jan 2014 11:32:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:32:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43797865
Sat 18 Jan 2014 11:32:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:32:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:32:41 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:32:42 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:32:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 11:32:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:32:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 11:32:42 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:32:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8887 values 140600 bits 17575 bytes 
Sat 18 Jan 2014 11:32:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:32:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:32:48 - XML: Processed 655156 elements - found 475 jobs
Sat 18 Jan 2014 11:32:48 - job 7348836 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 11:32:48 - job 7335127 appears to have finished
Sat 18 Jan 2014 11:32:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:32:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:32:49 - job 7346488 appears to have finished
Sat 18 Jan 2014 11:32:49 - job_xml_thread(): Found 4 updated jobs.
Sat 18 Jan 2014 11:32:49 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 11:32:51 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Sat 18 Jan 2014 11:32:51 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:32:51 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:32:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:32:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:32:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:32:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:32:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:32:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:32:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:32:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:32:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:33:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:33:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:33:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:33:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:33:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:33:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:33:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:33:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:33:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:33:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43807549
Sat 18 Jan 2014 11:33:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:33:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43807549
Sat 18 Jan 2014 11:33:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:33:06 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:33:06 - job_xml_thread(): Done retrieving: data size 43807549
Sat 18 Jan 2014 11:33:06 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:33:06 - XML: Start document: iteration 18
Sat 18 Jan 2014 11:33:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:33:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:33:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:33:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:33:20 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:33:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 11:33:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:33:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:33:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:33:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:33:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:33:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:33:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:33:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:33:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:33:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:33:24 - XML: Processed 655156 elements - found 475 jobs
Sat 18 Jan 2014 11:33:24 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:33:24 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:33:24 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:33:24 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:33:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:33:28 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:33:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:33:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:33:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:33:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:33:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:33:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:33:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:33:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43805684
Sat 18 Jan 2014 11:33:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:33:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43805684
Sat 18 Jan 2014 11:33:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:33:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:33:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:33:40 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:33:40 - job_xml_thread(): Done retrieving: data size 43805684
Sat 18 Jan 2014 11:33:40 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:33:40 - XML: Start document: iteration 19
Sat 18 Jan 2014 11:33:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:33:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:33:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:33:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:33:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:33:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:33:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:33:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:33:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:33:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:33:42 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:33:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:33:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 11:33:43 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:33:43 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:33:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 11:33:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5994 values 94646 bits 11830 bytes 
Sat 18 Jan 2014 11:33:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:33:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:33:51 - XML: Processed 655156 elements - found 475 jobs
Sat 18 Jan 2014 11:33:51 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:33:51 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:33:51 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:33:51 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:33:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:33:54 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:33:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:33:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:33:55 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 11:33:55 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 11:33:55 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:33:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:33:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:33:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:33:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:33:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:33:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43775008
Sat 18 Jan 2014 11:33:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:33:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43775008
Sat 18 Jan 2014 11:33:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:33:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:33:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:34:06 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:34:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:34:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:34:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:34:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:34:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:34:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:34:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:34:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:34:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:34:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:34:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:34:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:34:12 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:34:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:34:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:34:12 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:34:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 11:34:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:34:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:34:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:34:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:34:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:34:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:34:14 - job_xml_thread(): Done retrieving: data size 43803172
Sat 18 Jan 2014 11:34:14 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:34:14 - XML: Start document: iteration 20
Sat 18 Jan 2014 11:34:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43803172
Sat 18 Jan 2014 11:34:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:34:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43803172
Sat 18 Jan 2014 11:34:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:34:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:34:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:34:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:34:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:34:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:34:33 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:34:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:34:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:34:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:34:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:34:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:34:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:34:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:34:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:34:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:34:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:34:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:34:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:34:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:34:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:34:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:34:36 - XML: Processed 655152 elements - found 473 jobs
Sat 18 Jan 2014 11:34:36 - job 7348834 appears to have finished
Sat 18 Jan 2014 11:34:36 - job 7348837 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 11:34:36 - job 7343577 appears to have finished
Sat 18 Jan 2014 11:34:36 - job_xml_thread(): Found 3 updated jobs.
Sat 18 Jan 2014 11:34:36 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 11:34:36 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Sat 18 Jan 2014 11:34:36 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:34:36 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:34:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:34:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43813462
Sat 18 Jan 2014 11:34:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:34:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43813462
Sat 18 Jan 2014 11:34:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:34:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:34:43 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:34:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:34:45 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:34:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 11:34:45 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:34:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 11:34:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9027 values 142424 bits 17803 bytes 
Sat 18 Jan 2014 11:34:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:34:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:34:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:34:50 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:34:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:34:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:34:51 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:34:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:34:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:34:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:34:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:34:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:34:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:34:54 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:34:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:34:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:34:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:34:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:34:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:34:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:34:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:34:57 - job_xml_thread(): Done retrieving: data size 43810585
Sat 18 Jan 2014 11:34:57 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:34:57 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 11:34:57 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 11:34:57 - Housekeeping: done.
Sat 18 Jan 2014 11:34:57 - XML: Start document: iteration 0
Sat 18 Jan 2014 11:34:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43810585
Sat 18 Jan 2014 11:34:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:34:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43810585
Sat 18 Jan 2014 11:34:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:35:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:35:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:35:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:35:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:35:15 - XML: Processed 655149 elements - found 473 jobs
Sat 18 Jan 2014 11:35:15 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:35:15 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:35:15 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:35:15 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:35:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:35:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:35:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:35:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:35:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:35:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:35:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:35:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:35:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:35:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:35:19 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:35:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:35:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:35:19 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:35:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 11:35:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:35:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:35:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:35:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:35:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:35:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:35:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43734978
Sat 18 Jan 2014 11:35:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:35:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43734978
Sat 18 Jan 2014 11:35:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:35:30 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:35:31 - job_xml_thread(): Done retrieving: data size 43734978
Sat 18 Jan 2014 11:35:31 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:35:31 - XML: Start document: iteration 1
Sat 18 Jan 2014 11:35:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:35:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:35:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:35:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:35:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:35:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:35:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:35:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:35:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:35:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:35:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:35:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:35:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:35:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:35:42 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:35:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:35:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:35:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:35:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:35:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:35:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:35:43 - XML: Processed 654404 elements - found 473 jobs
Sat 18 Jan 2014 11:35:43 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:35:43 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:35:43 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:35:43 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:35:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:35:45 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:35:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:35:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43196531
Sat 18 Jan 2014 11:35:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:35:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43196531
Sat 18 Jan 2014 11:35:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:35:45 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:35:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:35:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 11:35:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 11:35:45 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:35:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5829 values 91966 bits 11495 bytes 
Sat 18 Jan 2014 11:35:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:35:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:35:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:35:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:35:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:35:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:35:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:35:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:35:58 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:35:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:35:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:35:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:35:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:35:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:36:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:36:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:36:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:36:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:36:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:36:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:36:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:36:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:36:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:36:02 - job_xml_thread(): Done retrieving: data size 43134283
Sat 18 Jan 2014 11:36:02 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:36:02 - XML: Start document: iteration 2
Sat 18 Jan 2014 11:36:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43134283
Sat 18 Jan 2014 11:36:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:36:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43134283
Sat 18 Jan 2014 11:36:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:36:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:36:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:36:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:36:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:36:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:36:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:36:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:36:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:36:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:36:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:36:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:36:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:36:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:36:21 - XML: Processed 646950 elements - found 472 jobs
Sat 18 Jan 2014 11:36:21 - job 7348836 appears to have finished
Sat 18 Jan 2014 11:36:21 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 11:36:21 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 11:36:21 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 11:36:21 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:36:21 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:36:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:36:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:36:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:36:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:36:25 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:36:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 11:36:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:36:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:36:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:36:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:36:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:36:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:36:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43211265
Sat 18 Jan 2014 11:36:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:36:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43211265
Sat 18 Jan 2014 11:36:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:36:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:36:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:36:36 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:36:36 - job_xml_thread(): Done retrieving: data size 43211265
Sat 18 Jan 2014 11:36:36 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:36:36 - XML: Start document: iteration 3
Sat 18 Jan 2014 11:36:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:36:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:36:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:36:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:36:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:36:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:36:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:36:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:36:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:36:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:36:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:36:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:36:45 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:36:46 - XML: Processed 647698 elements - found 472 jobs
Sat 18 Jan 2014 11:36:46 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:36:46 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:36:46 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:36:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:36:46 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:36:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 11:36:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 11:36:46 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:36:46 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:36:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5671 values 89403 bits 11175 bytes 
Sat 18 Jan 2014 11:36:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:36:48 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:36:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:36:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:36:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:36:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:36:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:36:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:36:50 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:36:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 11:36:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:36:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:36:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43738233
Sat 18 Jan 2014 11:36:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:36:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43738233
Sat 18 Jan 2014 11:36:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:36:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:36:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:37:02 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:37:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:37:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:37:03 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:37:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:37:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:37:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:37:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:37:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:37:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:37:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:37:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:37:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:37:06 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:37:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:37:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:37:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:37:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:37:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:37:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:37:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:37:08 - job_xml_thread(): Done retrieving: data size 43802174
Sat 18 Jan 2014 11:37:08 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:37:08 - XML: Start document: iteration 4
Sat 18 Jan 2014 11:37:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43802174
Sat 18 Jan 2014 11:37:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:37:08 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 11:37:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43802174
Sat 18 Jan 2014 11:37:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:37:10 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:37:11 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:37:11 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 11:37:11 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:37:11 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 11:37:11 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 11:37:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:37:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:37:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:37:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:37:25 - XML: Processed 655147 elements - found 472 jobs
Sat 18 Jan 2014 11:37:25 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:37:25 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:37:25 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:37:25 - job_xml_thread(): Sleeping.. (15s)
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sat 18 Jan 2014 11:37:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:37:29 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:37:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:37:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:37:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:37:31 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:37:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:37:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:37:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:37:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:37:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:37:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:37:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:37:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:37:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:37:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:37:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:37:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:37:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43804461
Sat 18 Jan 2014 11:37:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:37:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43804461
Sat 18 Jan 2014 11:37:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:37:40 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:37:40 - job_xml_thread(): Done retrieving: data size 43804461
Sat 18 Jan 2014 11:37:40 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:37:41 - XML: Start document: iteration 5
Sat 18 Jan 2014 11:37:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:37:43 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:37:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:37:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:37:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:37:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:37:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:37:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:37:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:37:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:37:47 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:37:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:37:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:37:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:37:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 11:37:48 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:37:48 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:37:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 11:37:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148660 bits 18582 bytes 
Sat 18 Jan 2014 11:37:53 - XML: Processed 655150 elements - found 472 jobs
Sat 18 Jan 2014 11:37:53 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:37:53 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:37:53 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:37:53 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:37:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:37:56 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:37:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:37:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:37:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:37:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:37:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:37:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:37:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:37:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43799745
Sat 18 Jan 2014 11:37:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:37:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43799745
Sat 18 Jan 2014 11:37:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:38:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:38:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:38:09 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:38:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:38:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:38:10 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:38:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:38:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:38:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:38:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:38:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:38:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:38:12 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:38:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:38:12 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:38:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:38:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:38:13 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:38:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:38:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:38:13 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:38:13 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:38:13 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 11:38:13 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 11:38:13 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 11:38:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:38:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:38:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:38:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:38:14 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 964408 values 15217104 bits 1902138 bytes 
Sat 18 Jan 2014 11:38:15 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:38:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 11:38:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:38:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:38:18 - job_xml_thread(): Done retrieving: data size 43787629
Sat 18 Jan 2014 11:38:18 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:38:18 - XML: Start document: iteration 6
Sat 18 Jan 2014 11:38:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43787629
Sat 18 Jan 2014 11:38:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43787629
Sat 18 Jan 2014 11:38:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:38:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:38:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:38:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:38:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:38:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:38:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:38:32 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:38:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:38:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:38:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:38:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:38:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:38:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:38:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:38:40 - XML: Processed 655154 elements - found 474 jobs
Sat 18 Jan 2014 11:38:40 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 11:38:40 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 11:38:40 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 11:38:40 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:38:40 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:38:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:38:41 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:38:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:38:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:38:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:38:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:38:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:38:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:38:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:38:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43801430
Sat 18 Jan 2014 11:38:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:38:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43801430
Sat 18 Jan 2014 11:38:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:38:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:38:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:38:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:38:48 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:38:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:38:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 11:38:49 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:38:49 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:38:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 11:38:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8661 values 136585 bits 17073 bytes 
Sat 18 Jan 2014 11:38:55 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:38:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:38:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:38:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:38:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:38:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:38:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:38:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:38:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:38:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:38:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:38:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:39:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:39:01 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:39:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:39:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:39:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:39:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:39:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:39:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:39:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:39:05 - job_xml_thread(): Done retrieving: data size 43784537
Sat 18 Jan 2014 11:39:05 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:39:05 - XML: Start document: iteration 7
Sat 18 Jan 2014 11:39:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43784537
Sat 18 Jan 2014 11:39:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43784537
Sat 18 Jan 2014 11:39:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:39:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:39:11 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:39:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 11:39:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:39:13 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:39:13 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 11:39:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:39:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:39:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:39:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:39:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:39:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:39:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:39:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:39:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:39:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:39:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:39:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:39:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:39:29 - XML: Processed 655154 elements - found 474 jobs
Sat 18 Jan 2014 11:39:29 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:39:29 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:39:29 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:39:29 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:39:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:39:29 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:39:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:39:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:39:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:39:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:39:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:39:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:39:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:39:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43795386
Sat 18 Jan 2014 11:39:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:39:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43795386
Sat 18 Jan 2014 11:39:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:39:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:39:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:39:44 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:39:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:39:44 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:39:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:39:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:39:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:39:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:39:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:39:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:39:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:39:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:39:48 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:39:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:39:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:39:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:39:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:39:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:39:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:39:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:39:49 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:39:51 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:39:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:39:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 11:39:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 11:39:51 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:39:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6253 values 98632 bits 12329 bytes 
Sat 18 Jan 2014 11:39:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:39:53 - job_xml_thread(): Done retrieving: data size 43789521
Sat 18 Jan 2014 11:39:53 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:39:53 - XML: Start document: iteration 8
Sat 18 Jan 2014 11:39:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43789521
Sat 18 Jan 2014 11:39:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43789521
Sat 18 Jan 2014 11:39:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:39:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:40:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:40:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:40:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:40:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:40:05 - XML: Processed 655154 elements - found 474 jobs
Sat 18 Jan 2014 11:40:05 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:40:05 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:40:06 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:40:06 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:40:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:40:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:40:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:40:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:40:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:40:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:40:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:40:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:40:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:40:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:40:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:40:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:40:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:40:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:40:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:40:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:40:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:40:19 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:40:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 11:40:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:40:21 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:40:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:40:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43791618
Sat 18 Jan 2014 11:40:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:40:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43791618
Sat 18 Jan 2014 11:40:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:40:22 - job_xml_thread(): Done retrieving: data size 43791618
Sat 18 Jan 2014 11:40:22 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:40:22 - XML: Start document: iteration 9
Sat 18 Jan 2014 11:40:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:40:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:40:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:40:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:40:39 - XML: Processed 655152 elements - found 473 jobs
Sat 18 Jan 2014 11:40:39 - job 7346470 appears to have finished
Sat 18 Jan 2014 11:40:39 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 11:40:39 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 11:40:40 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 11:40:40 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:40:40 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:40:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:40:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:40:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:40:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:40:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:40:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:40:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:40:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:40:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:40:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:40:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:40:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:40:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:40:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:40:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:40:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:40:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:40:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:40:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43787339
Sat 18 Jan 2014 11:40:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:40:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43787339
Sat 18 Jan 2014 11:40:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:40:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:40:51 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:40:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:40:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 11:40:52 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:40:52 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:40:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 11:40:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7797 values 122971 bits 15371 bytes 
Sat 18 Jan 2014 11:40:55 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:40:55 - job_xml_thread(): Done retrieving: data size 43787339
Sat 18 Jan 2014 11:40:55 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:40:55 - XML: Start document: iteration 10
Sat 18 Jan 2014 11:40:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:40:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:41:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:41:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:41:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:41:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:41:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:41:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:41:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:41:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:41:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:41:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:41:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:41:11 - XML: Processed 655152 elements - found 473 jobs
Sat 18 Jan 2014 11:41:11 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:41:11 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:41:11 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:41:11 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:41:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:41:13 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:41:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:41:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:41:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:41:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:41:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:41:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:41:15 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 11:41:15 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 11:41:15 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:41:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:41:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43725117
Sat 18 Jan 2014 11:41:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:41:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43725117
Sat 18 Jan 2014 11:41:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:41:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:41:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:41:27 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:41:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:41:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:41:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:41:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:41:30 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:41:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:41:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:41:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:41:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:41:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:41:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:41:32 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:41:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 11:41:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:41:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:41:33 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:41:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:41:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:41:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:41:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:41:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:41:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:41:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:41:35 - job_xml_thread(): Done retrieving: data size 43354902
Sat 18 Jan 2014 11:41:35 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:41:35 - XML: Start document: iteration 11
Sat 18 Jan 2014 11:41:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43354902
Sat 18 Jan 2014 11:41:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:41:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43354902
Sat 18 Jan 2014 11:41:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:41:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:41:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:41:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:41:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:41:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:41:52 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:41:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:41:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 11:41:52 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:41:52 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:41:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 11:41:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6058 values 95557 bits 11944 bytes 
Sat 18 Jan 2014 11:41:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:41:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:41:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:41:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:41:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:41:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:41:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:41:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:41:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:41:58 - XML: Processed 649970 elements - found 473 jobs
Sat 18 Jan 2014 11:41:58 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:41:58 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:41:58 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:41:58 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:42:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:42:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:42:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:42:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:42:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:42:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:42:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:42:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:42:02 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:42:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 11:42:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:42:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:42:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43137919
Sat 18 Jan 2014 11:42:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:42:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43137919
Sat 18 Jan 2014 11:42:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:42:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:42:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:42:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:42:13 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:42:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:42:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:42:14 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:42:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:42:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:42:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:42:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:42:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:42:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:42:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:42:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:42:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:42:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:42:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:42:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:42:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:42:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:42:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:42:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:42:18 - job_xml_thread(): Done retrieving: data size 43175772
Sat 18 Jan 2014 11:42:18 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:42:18 - XML: Start document: iteration 12
Sat 18 Jan 2014 11:42:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43175772
Sat 18 Jan 2014 11:42:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43175772
Sat 18 Jan 2014 11:42:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:42:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:42:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:42:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:42:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:42:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:42:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:42:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:42:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:42:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:42:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:42:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:42:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:42:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:42:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:42:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:42:40 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:42:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:42:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:42:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:42:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:42:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:42:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:42:41 - XML: Processed 647384 elements - found 473 jobs
Sat 18 Jan 2014 11:42:41 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:42:41 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:42:41 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:42:41 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:42:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:42:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43675156
Sat 18 Jan 2014 11:42:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:42:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43675156
Sat 18 Jan 2014 11:42:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:42:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:42:53 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:42:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:42:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:42:54 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:42:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 11:42:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:42:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 11:42:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:42:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:42:54 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:42:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148664 bits 18583 bytes 
Sat 18 Jan 2014 11:42:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:42:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:42:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:42:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:42:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:42:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:42:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:42:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:42:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:42:56 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:42:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:42:57 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:42:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:42:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:42:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:42:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:42:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:42:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:42:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:42:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43792649
Sat 18 Jan 2014 11:42:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:43:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43792649
Sat 18 Jan 2014 11:43:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:43:00 - job_xml_thread(): Done retrieving: data size 43792649
Sat 18 Jan 2014 11:43:00 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:43:01 - XML: Start document: iteration 13
Sat 18 Jan 2014 11:43:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:43:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:43:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:43:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:43:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:43:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:43:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:43:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:43:18 - XML: Processed 654795 elements - found 473 jobs
Sat 18 Jan 2014 11:43:18 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:43:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:43:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:43:18 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:43:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:43:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:43:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:43:18 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:43:18 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:43:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:43:21 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:43:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:43:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:43:22 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:43:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 11:43:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:43:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:43:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:43:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:43:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:43:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:43:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43796287
Sat 18 Jan 2014 11:43:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:43:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43796287
Sat 18 Jan 2014 11:43:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:43:33 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:43:33 - job_xml_thread(): Done retrieving: data size 43796287
Sat 18 Jan 2014 11:43:34 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:43:34 - XML: Start document: iteration 14
Sat 18 Jan 2014 11:43:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:43:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:43:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:43:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:43:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:43:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:43:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:43:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:43:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:43:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:43:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:43:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:43:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:43:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:43:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:43:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:43:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:43:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:43:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:43:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:43:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:43:47 - XML: Processed 655152 elements - found 473 jobs
Sat 18 Jan 2014 11:43:47 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:43:47 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:43:47 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:43:47 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:43:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:43:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43785637
Sat 18 Jan 2014 11:43:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:43:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43785637
Sat 18 Jan 2014 11:43:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:43:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:43:55 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:43:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:43:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 11:43:56 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:43:56 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:43:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 11:43:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8822 values 139132 bits 17391 bytes 
Sat 18 Jan 2014 11:43:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:43:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:43:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:43:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:43:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:43:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:43:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:43:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:43:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:43:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:43:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:44:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:44:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:44:02 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:44:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:44:02 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:44:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:44:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:44:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:44:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:44:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:44:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:44:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:44:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43783749
Sat 18 Jan 2014 11:44:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:44:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43783749
Sat 18 Jan 2014 11:44:06 - job_xml_thread(): Done retrieving: data size 43783749
Sat 18 Jan 2014 11:44:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:44:06 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:44:07 - XML: Start document: iteration 15
Sat 18 Jan 2014 11:44:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:44:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:44:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:44:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:44:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:44:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:44:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:44:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:44:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:44:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:44:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:44:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:44:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:44:25 - XML: Processed 655152 elements - found 473 jobs
Sat 18 Jan 2014 11:44:25 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:44:25 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:44:25 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:44:25 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:44:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:44:30 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:44:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:44:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:44:31 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:44:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 11:44:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:44:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:44:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:44:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:44:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:44:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:44:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43792782
Sat 18 Jan 2014 11:44:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:44:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43792782
Sat 18 Jan 2014 11:44:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:44:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:44:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:44:40 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:44:40 - job_xml_thread(): Done retrieving: data size 43792782
Sat 18 Jan 2014 11:44:40 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:44:40 - XML: Start document: iteration 16
Sat 18 Jan 2014 11:44:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:44:44 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:44:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:44:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:44:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:44:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:44:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:44:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:44:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:44:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:44:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:44:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:44:54 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:44:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:44:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:44:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:44:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:44:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:44:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:44:55 - XML: Processed 655152 elements - found 473 jobs
Sat 18 Jan 2014 11:44:55 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:44:55 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:44:55 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:44:55 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:44:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:44:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43787178
Sat 18 Jan 2014 11:44:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:44:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43787178
Sat 18 Jan 2014 11:44:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:44:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:44:58 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:45:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:45:00 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:45:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 11:45:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:45:01 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:45:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:45:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 11:45:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8450 values 133246 bits 16655 bytes 
Sat 18 Jan 2014 11:45:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:45:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:45:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:45:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:45:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:45:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:45:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:45:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:45:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:45:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:45:11 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:45:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:45:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:45:12 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:45:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:45:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:45:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:45:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:45:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:45:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:45:13 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 11:45:13 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:45:14 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:45:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 11:45:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:45:14 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:45:14 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:45:14 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 11:45:14 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 11:45:14 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 11:45:15 - size of cluster 'LISA Cluster': 624 hosts 79475 metrics 863330 values 13612220 bits 1701527 bytes 
Sat 18 Jan 2014 11:45:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:45:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43814059
Sat 18 Jan 2014 11:45:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:45:16 - job_xml_thread(): Done retrieving: data size 43814059
Sat 18 Jan 2014 11:45:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43814059
Sat 18 Jan 2014 11:45:16 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:45:16 - XML: Start document: iteration 17
Sat 18 Jan 2014 11:45:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:45:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:45:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:45:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:45:26 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:45:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:45:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:45:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:45:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:45:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:45:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:45:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:45:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:45:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:45:31 - XML: Processed 655148 elements - found 473 jobs
Sat 18 Jan 2014 11:45:31 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:45:31 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:45:31 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:45:31 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:45:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:45:35 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:45:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:45:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:45:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:45:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:45:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:45:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:45:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:45:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43778306
Sat 18 Jan 2014 11:45:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:45:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43778306
Sat 18 Jan 2014 11:45:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:45:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:45:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:45:46 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:45:46 - job_xml_thread(): Done retrieving: data size 43778306
Sat 18 Jan 2014 11:45:46 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:45:47 - XML: Start document: iteration 18
Sat 18 Jan 2014 11:45:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:45:47 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:45:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:45:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:45:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:45:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:45:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:45:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:45:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:45:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:45:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:45:56 - XML: Processed 655152 elements - found 473 jobs
Sat 18 Jan 2014 11:45:56 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:45:56 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:45:56 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:45:56 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:45:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:45:59 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:45:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:45:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:46:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:46:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:46:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:46:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:46:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:46:01 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:46:02 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:46:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:46:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 11:46:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 11:46:02 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:46:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6139 values 96843 bits 12105 bytes 
Sat 18 Jan 2014 11:46:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:46:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43786375
Sat 18 Jan 2014 11:46:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:46:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43786375
Sat 18 Jan 2014 11:46:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:46:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:46:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:46:11 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:46:11 - job_xml_thread(): Done retrieving: data size 43786375
Sat 18 Jan 2014 11:46:11 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:46:11 - XML: Start document: iteration 19
Sat 18 Jan 2014 11:46:14 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:46:14 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 11:46:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:46:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:46:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:46:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:46:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:46:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:46:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:46:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:46:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:46:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:46:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:46:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:46:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:46:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:46:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:46:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:46:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:46:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:46:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:46:27 - XML: Processed 655152 elements - found 473 jobs
Sat 18 Jan 2014 11:46:27 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:46:27 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:46:27 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:46:27 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:46:30 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:46:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 11:46:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:46:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:46:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43793523
Sat 18 Jan 2014 11:46:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:46:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43793523
Sat 18 Jan 2014 11:46:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:46:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:46:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:46:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:46:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:46:42 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:46:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:46:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:46:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:46:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:46:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:46:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:46:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:46:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:46:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:46:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:46:46 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:46:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:46:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:46:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:46:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:46:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:46:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:46:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:46:49 - job_xml_thread(): Done retrieving: data size 43806099
Sat 18 Jan 2014 11:46:49 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:46:49 - XML: Start document: iteration 20
Sat 18 Jan 2014 11:46:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43806099
Sat 18 Jan 2014 11:46:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:46:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43806099
Sat 18 Jan 2014 11:46:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:47:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:47:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:47:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:47:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:47:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:47:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:47:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:47:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:47:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:47:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:47:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:47:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:47:02 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:47:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:47:02 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:47:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 11:47:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 11:47:02 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:47:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6700 values 105966 bits 13245 bytes 
Sat 18 Jan 2014 11:47:07 - XML: Processed 655152 elements - found 473 jobs
Sat 18 Jan 2014 11:47:07 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:47:07 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:47:07 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:47:07 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:47:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:47:11 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:47:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:47:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:47:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:47:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:47:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:47:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:47:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:47:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43788678
Sat 18 Jan 2014 11:47:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:47:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43788678
Sat 18 Jan 2014 11:47:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:47:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:47:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:47:21 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:47:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 11:47:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:47:23 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:47:23 - job_xml_thread(): Done retrieving: data size 43788678
Sat 18 Jan 2014 11:47:23 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:47:23 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 11:47:23 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 11:47:23 - Housekeeping: done.
Sat 18 Jan 2014 11:47:23 - XML: Start document: iteration 0
Sat 18 Jan 2014 11:47:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:47:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:47:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:47:30 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:47:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:47:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:47:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:47:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:47:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:47:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:47:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:47:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:47:35 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:47:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:47:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:47:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:47:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:47:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:47:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:47:38 - XML: Processed 655152 elements - found 473 jobs
Sat 18 Jan 2014 11:47:38 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:47:38 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:47:38 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:47:38 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:47:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:47:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43252748
Sat 18 Jan 2014 11:47:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:47:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43252748
Sat 18 Jan 2014 11:47:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:47:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:47:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:47:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:47:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:47:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:47:51 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:47:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:47:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:47:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:47:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:47:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:47:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:47:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:47:53 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:47:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:47:56 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:47:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:47:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:47:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:47:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:47:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:47:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:47:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:47:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43148309
Sat 18 Jan 2014 11:47:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:48:00 - job_xml_thread(): Done retrieving: data size 43148309
Sat 18 Jan 2014 11:48:00 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:48:00 - XML: Start document: iteration 1
Sat 18 Jan 2014 11:48:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43148309
Sat 18 Jan 2014 11:48:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:48:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:48:03 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:48:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:48:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 11:48:04 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:48:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9371 values 148221 bits 18527 bytes 
Sat 18 Jan 2014 11:48:04 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:48:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 11:48:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:48:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:48:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:48:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:48:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:48:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:48:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:48:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:48:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:48:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:48:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:48:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:48:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:48:22 - XML: Processed 647002 elements - found 473 jobs
Sat 18 Jan 2014 11:48:22 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:48:22 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:48:22 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:48:22 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:48:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:48:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:48:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:48:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:48:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:48:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:48:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:48:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:48:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:48:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43202929
Sat 18 Jan 2014 11:48:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:48:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43202929
Sat 18 Jan 2014 11:48:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:48:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:48:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:48:37 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:48:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:48:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:48:39 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:48:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:48:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:48:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:48:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:48:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:48:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:48:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:48:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:48:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:48:42 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:48:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:48:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:48:42 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:48:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 11:48:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:48:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:48:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:48:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:48:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:48:44 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 11:48:44 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 11:48:44 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:48:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:48:45 - job_xml_thread(): Done retrieving: data size 43691875
Sat 18 Jan 2014 11:48:45 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:48:45 - XML: Start document: iteration 2
Sat 18 Jan 2014 11:48:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43691875
Sat 18 Jan 2014 11:48:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43691875
Sat 18 Jan 2014 11:48:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:48:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:48:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:48:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:48:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:48:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:49:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:49:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:49:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:49:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:49:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:49:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:49:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:49:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:49:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:49:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:49:05 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:49:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:49:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 11:49:06 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:49:06 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:49:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5856 values 92454 bits 11556 bytes 
Sat 18 Jan 2014 11:49:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 11:49:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:49:07 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:49:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:49:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:49:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:49:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:49:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:49:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:49:08 - XML: Processed 653642 elements - found 473 jobs
Sat 18 Jan 2014 11:49:08 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:49:08 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:49:08 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:49:08 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:49:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:49:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43790106
Sat 18 Jan 2014 11:49:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:49:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43790106
Sat 18 Jan 2014 11:49:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:49:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:49:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:49:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:49:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:49:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:49:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:49:23 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:49:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:49:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:49:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:49:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:49:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:49:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:49:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:49:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:49:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:49:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:49:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:49:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:49:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:49:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:49:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:49:26 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:49:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 11:49:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:49:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:49:28 - job_xml_thread(): Done retrieving: data size 43807500
Sat 18 Jan 2014 11:49:28 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:49:28 - XML: Start document: iteration 3
Sat 18 Jan 2014 11:49:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43807500
Sat 18 Jan 2014 11:49:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:49:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43807500
Sat 18 Jan 2014 11:49:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:49:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:49:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:49:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:49:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:49:44 - XML: Processed 655152 elements - found 473 jobs
Sat 18 Jan 2014 11:49:44 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:49:44 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:49:44 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:49:45 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:49:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:49:47 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:49:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:49:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:49:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:49:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:49:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:49:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:49:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:49:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:49:50 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:49:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:49:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:49:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:49:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:49:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:49:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:49:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:49:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43793248
Sat 18 Jan 2014 11:49:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:49:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43793248
Sat 18 Jan 2014 11:49:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:50:00 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:50:00 - job_xml_thread(): Done retrieving: data size 43793248
Sat 18 Jan 2014 11:50:00 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:50:00 - XML: Start document: iteration 4
Sat 18 Jan 2014 11:50:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:50:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:50:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:50:06 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:50:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:50:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:50:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:50:06 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:50:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 11:50:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 11:50:07 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:50:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8828 values 139188 bits 17398 bytes 
Sat 18 Jan 2014 11:50:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:50:10 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:50:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:50:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:50:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:50:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:50:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:50:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:50:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:50:11 - XML: Processed 655152 elements - found 473 jobs
Sat 18 Jan 2014 11:50:11 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:50:11 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:50:11 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:50:11 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:50:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:50:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:50:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:50:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:50:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:50:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:50:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:50:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:50:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:50:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43810285
Sat 18 Jan 2014 11:50:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:50:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43810285
Sat 18 Jan 2014 11:50:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:50:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:50:25 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:50:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:50:26 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:50:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:50:26 - job_xml_thread(): Done retrieving: data size 43810285
Sat 18 Jan 2014 11:50:27 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:50:27 - XML: Start document: iteration 5
Sat 18 Jan 2014 11:50:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:50:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:50:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:50:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:50:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:50:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:50:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:50:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:50:35 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:50:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:50:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:50:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:50:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:50:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:50:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:50:37 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:50:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 11:50:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:50:38 - XML: Processed 655152 elements - found 473 jobs
Sat 18 Jan 2014 11:50:38 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:50:38 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:50:38 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:50:38 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:50:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:50:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43771512
Sat 18 Jan 2014 11:50:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:50:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43771512
Sat 18 Jan 2014 11:50:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:50:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:50:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:50:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:50:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:50:53 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:50:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:50:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:50:54 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:50:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:50:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:50:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:50:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:50:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:50:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:50:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:50:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:50:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:50:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:50:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:50:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:50:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:50:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:50:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:50:56 - job_xml_thread(): Done retrieving: data size 43817047
Sat 18 Jan 2014 11:50:56 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:50:56 - XML: Start document: iteration 6
Sat 18 Jan 2014 11:50:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43817047
Sat 18 Jan 2014 11:50:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43817047
Sat 18 Jan 2014 11:50:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:50:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:51:05 - XML: Processed 655152 elements - found 473 jobs
Sat 18 Jan 2014 11:51:05 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:51:05 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:51:05 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:51:05 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:51:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:51:07 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:51:08 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:51:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 11:51:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:51:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 11:51:08 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:51:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9116 values 143850 bits 17981 bytes 
Sat 18 Jan 2014 11:51:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:51:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:51:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:51:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:51:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:51:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:51:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:51:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:51:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:51:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:51:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:51:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:51:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:51:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:51:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:51:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:51:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:51:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:51:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:51:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:51:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:51:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:51:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43799107
Sat 18 Jan 2014 11:51:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:51:20 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:51:20 - job_xml_thread(): Done retrieving: data size 43799107
Sat 18 Jan 2014 11:51:20 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:51:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43799107
Sat 18 Jan 2014 11:51:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:51:20 - XML: Start document: iteration 7
Sat 18 Jan 2014 11:51:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:51:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:51:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:51:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:51:38 - XML: Processed 655149 elements - found 473 jobs
Sat 18 Jan 2014 11:51:38 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:51:38 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:51:38 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:51:38 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:51:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:51:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:51:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:51:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:51:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:51:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:51:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:51:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:51:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:51:43 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:51:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 11:51:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:51:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:51:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:51:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:51:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:51:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:51:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:51:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:51:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:51:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:51:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43819460
Sat 18 Jan 2014 11:51:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:51:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43819460
Sat 18 Jan 2014 11:51:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:51:53 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:51:53 - job_xml_thread(): Done retrieving: data size 43819460
Sat 18 Jan 2014 11:51:53 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:51:53 - XML: Start document: iteration 8
Sat 18 Jan 2014 11:51:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:51:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:51:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:51:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:51:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:51:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:51:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:51:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:51:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:51:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:51:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:52:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:52:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:52:07 - XML: Processed 655152 elements - found 473 jobs
Sat 18 Jan 2014 11:52:07 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:52:07 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:52:07 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:52:07 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:52:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:52:08 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:52:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:52:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:52:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:52:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:52:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:52:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 11:52:08 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:52:08 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:52:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5915 values 93287 bits 11660 bytes 
Sat 18 Jan 2014 11:52:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 11:52:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:52:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:52:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:52:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:52:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:52:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43777778
Sat 18 Jan 2014 11:52:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:52:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43777778
Sat 18 Jan 2014 11:52:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:52:14 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 11:52:14 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:52:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:52:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:52:15 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:52:15 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 11:52:16 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 11:52:16 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:52:16 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 11:52:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:52:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:52:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:52:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:52:22 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:52:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:52:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:52:23 - size of cluster 'LISA Cluster': 624 hosts 79468 metrics 800918 values 12640898 bits 1580112 bytes 
Sat 18 Jan 2014 11:52:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:52:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:52:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:52:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:52:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:52:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:52:27 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:52:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:52:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:52:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:52:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:52:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:52:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:52:29 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:52:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 11:52:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:52:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:52:31 - job_xml_thread(): Done retrieving: data size 43808648
Sat 18 Jan 2014 11:52:31 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:52:31 - XML: Start document: iteration 9
Sat 18 Jan 2014 11:52:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43808648
Sat 18 Jan 2014 11:52:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:52:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43808648
Sat 18 Jan 2014 11:52:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:52:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:52:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:52:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:52:43 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:52:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:52:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:52:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:52:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:52:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:52:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:52:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:52:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:52:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:52:52 - XML: Processed 655152 elements - found 473 jobs
Sat 18 Jan 2014 11:52:52 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:52:52 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:52:52 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:52:52 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:52:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:52:53 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:52:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:52:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:52:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:52:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:52:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:52:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:52:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:52:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43785405
Sat 18 Jan 2014 11:52:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:52:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43785405
Sat 18 Jan 2014 11:52:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:53:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:53:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:53:07 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:53:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:53:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:53:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:53:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:53:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:53:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:53:08 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:53:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:53:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:53:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:53:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:53:09 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:53:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 11:53:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:53:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 11:53:09 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:53:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8300 values 130926 bits 16365 bytes 
Sat 18 Jan 2014 11:53:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:53:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:53:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:53:11 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:53:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:53:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:53:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:53:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:53:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:53:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:53:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:53:15 - job_xml_thread(): Done retrieving: data size 43743148
Sat 18 Jan 2014 11:53:15 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:53:15 - XML: Start document: iteration 10
Sat 18 Jan 2014 11:53:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43743148
Sat 18 Jan 2014 11:53:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:53:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43743148
Sat 18 Jan 2014 11:53:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:53:16 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:53:16 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 11:53:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:53:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:53:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:53:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:53:38 - XML: Processed 654404 elements - found 473 jobs
Sat 18 Jan 2014 11:53:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:53:38 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:53:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:53:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:53:39 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:53:39 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:53:39 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:53:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:53:39 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:53:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:53:39 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:53:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:53:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:53:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:53:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:53:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:53:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:53:39 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:53:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 11:53:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:53:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:53:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:53:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:53:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:53:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:53:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43237289
Sat 18 Jan 2014 11:53:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:53:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43237289
Sat 18 Jan 2014 11:53:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:53:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:53:51 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:53:54 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:53:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:53:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:53:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:53:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:53:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:53:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:53:56 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:53:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:53:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:53:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:53:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:53:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:53:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:53:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:53:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:53:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:53:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:53:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:53:59 - job_xml_thread(): Done retrieving: data size 43155602
Sat 18 Jan 2014 11:53:59 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:53:59 - XML: Start document: iteration 11
Sat 18 Jan 2014 11:54:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43155602
Sat 18 Jan 2014 11:54:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43155602
Sat 18 Jan 2014 11:54:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:54:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:54:07 - XML: Processed 646978 elements - found 473 jobs
Sat 18 Jan 2014 11:54:07 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:54:07 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:54:07 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:54:07 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:54:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:54:09 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:54:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:54:09 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:54:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 11:54:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 11:54:09 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:54:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8722 values 137468 bits 17183 bytes 
Sat 18 Jan 2014 11:54:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:54:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:54:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:54:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:54:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:54:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:54:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:54:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:54:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:54:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:54:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:54:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:54:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:54:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:54:20 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:54:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:54:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:54:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:54:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:54:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:54:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:54:22 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:54:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:54:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43193508
Sat 18 Jan 2014 11:54:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:54:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43193508
Sat 18 Jan 2014 11:54:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:54:24 - job_xml_thread(): Done retrieving: data size 43193508
Sat 18 Jan 2014 11:54:25 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:54:25 - XML: Start document: iteration 12
Sat 18 Jan 2014 11:54:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:54:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:54:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:54:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:54:39 - XML: Processed 647702 elements - found 474 jobs
Sat 18 Jan 2014 11:54:39 - job 7348257 appears to have finished
Sat 18 Jan 2014 11:54:39 - job_xml_thread(): Found 3 updated jobs.
Sat 18 Jan 2014 11:54:39 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 11:54:41 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Sat 18 Jan 2014 11:54:41 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:54:41 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:54:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:54:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:54:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:54:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:54:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:54:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:54:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:54:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:54:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:54:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:54:46 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:54:46 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:54:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 11:54:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:54:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:54:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:54:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:54:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:54:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:54:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:54:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:54:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43750155
Sat 18 Jan 2014 11:54:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:54:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43750155
Sat 18 Jan 2014 11:54:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:54:56 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:54:56 - job_xml_thread(): Done retrieving: data size 43750155
Sat 18 Jan 2014 11:54:56 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:54:56 - XML: Start document: iteration 13
Sat 18 Jan 2014 11:54:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:54:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:54:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:54:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:54:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:54:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:55:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:55:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:55:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:55:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:55:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:55:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:55:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:55:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:55:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:55:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:55:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:55:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:55:09 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:55:10 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:55:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 11:55:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:55:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 11:55:10 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:55:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:55:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:55:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5793 values 91335 bits 11416 bytes 
Sat 18 Jan 2014 11:55:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:55:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:55:11 - XML: Processed 654609 elements - found 474 jobs
Sat 18 Jan 2014 11:55:11 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:55:11 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:55:11 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:55:11 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:55:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:55:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43773831
Sat 18 Jan 2014 11:55:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:55:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43773831
Sat 18 Jan 2014 11:55:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:55:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:55:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:55:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:55:25 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:55:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:55:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:55:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:55:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:55:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:55:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:55:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:55:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:55:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:55:26 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:55:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:55:30 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:55:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:55:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:55:31 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:55:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 11:55:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:55:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:55:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:55:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:55:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:55:33 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 11:55:33 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 11:55:33 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:55:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:55:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43787539
Sat 18 Jan 2014 11:55:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:55:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43787539
Sat 18 Jan 2014 11:55:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:55:33 - job_xml_thread(): Done retrieving: data size 43787539
Sat 18 Jan 2014 11:55:34 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:55:34 - XML: Start document: iteration 14
Sat 18 Jan 2014 11:55:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:55:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:55:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:55:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:55:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:55:49 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:55:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:55:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:55:51 - XML: Processed 655149 elements - found 474 jobs
Sat 18 Jan 2014 11:55:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:55:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:55:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:55:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:55:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:55:51 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:55:51 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:55:51 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:55:51 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:55:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:55:54 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:55:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:55:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:55:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:55:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:55:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:55:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:55:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:55:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43807530
Sat 18 Jan 2014 11:55:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:55:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43807530
Sat 18 Jan 2014 11:55:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:56:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:56:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:56:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:56:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:56:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:56:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:56:06 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:56:06 - job_xml_thread(): Done retrieving: data size 43807530
Sat 18 Jan 2014 11:56:06 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:56:06 - XML: Start document: iteration 15
Sat 18 Jan 2014 11:56:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:56:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:56:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:56:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:56:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:56:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:56:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:56:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:56:10 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:56:10 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:56:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:56:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 11:56:10 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:56:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 11:56:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8900 values 140321 bits 17540 bytes 
Sat 18 Jan 2014 11:56:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:56:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:56:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:56:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:56:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:56:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:56:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:56:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:56:18 - XML: Processed 655154 elements - found 474 jobs
Sat 18 Jan 2014 11:56:18 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:56:18 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:56:18 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:56:18 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:56:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:56:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43776205
Sat 18 Jan 2014 11:56:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:56:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43776205
Sat 18 Jan 2014 11:56:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:56:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:56:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:56:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:56:30 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:56:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:56:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:56:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:56:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:56:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:56:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:56:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:56:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:56:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:56:33 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:56:33 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:56:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 11:56:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:56:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:56:35 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:56:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:56:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:56:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:56:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:56:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:56:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:56:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:56:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43794606
Sat 18 Jan 2014 11:56:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:56:37 - job_xml_thread(): Done retrieving: data size 43794606
Sat 18 Jan 2014 11:56:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43794606
Sat 18 Jan 2014 11:56:37 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:56:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:56:38 - XML: Start document: iteration 16
Sat 18 Jan 2014 11:56:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:56:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:56:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:56:50 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:56:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:56:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:56:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:56:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:56:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:56:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:56:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:56:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:56:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:56:53 - XML: Processed 655154 elements - found 474 jobs
Sat 18 Jan 2014 11:56:53 - job 7348849 field 'start_timestamp' changed since saved from: 1390042432 to: 1390042381
Sat 18 Jan 2014 11:56:53 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 11:56:53 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 11:56:54 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 11:56:54 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:56:54 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:56:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:56:57 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:56:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:56:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:56:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:56:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:56:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:56:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:57:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:57:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43807546
Sat 18 Jan 2014 11:57:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:57:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43807546
Sat 18 Jan 2014 11:57:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:57:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:57:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:57:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:57:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:57:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:57:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:57:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:57:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:57:09 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:57:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:57:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:57:09 - job_xml_thread(): Done retrieving: data size 43807546
Sat 18 Jan 2014 11:57:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43807546
Sat 18 Jan 2014 11:57:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:57:10 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:57:10 - XML: Start document: iteration 17
Sat 18 Jan 2014 11:57:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:57:11 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:57:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:57:13 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:57:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 11:57:13 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:57:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 11:57:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9013 values 142126 bits 17765 bytes 
Sat 18 Jan 2014 11:57:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:57:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:57:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:57:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:57:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:57:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:57:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:57:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:57:28 - XML: Processed 655154 elements - found 474 jobs
Sat 18 Jan 2014 11:57:28 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:57:28 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:57:28 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:57:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:57:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:57:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:57:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:57:28 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:57:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:57:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:57:29 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:57:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:57:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:57:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:57:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:57:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:57:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:57:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:57:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43821358
Sat 18 Jan 2014 11:57:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:57:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43821358
Sat 18 Jan 2014 11:57:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:57:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:57:42 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:57:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:57:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:57:43 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:57:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:57:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:57:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:57:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:57:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:57:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:57:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:57:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:57:48 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:57:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:57:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:57:48 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:57:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 11:57:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:57:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:57:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:57:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:57:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:57:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:57:49 - job_xml_thread(): Done retrieving: data size 43802591
Sat 18 Jan 2014 11:57:49 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:57:49 - XML: Start document: iteration 18
Sat 18 Jan 2014 11:57:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43802591
Sat 18 Jan 2014 11:57:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43802591
Sat 18 Jan 2014 11:57:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:57:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:58:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:58:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:58:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:58:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:58:08 - XML: Processed 655149 elements - found 474 jobs
Sat 18 Jan 2014 11:58:08 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:58:08 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:58:08 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:58:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:58:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:58:09 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:58:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:58:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:58:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:58:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:58:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:58:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:58:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:58:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:58:12 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:58:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:58:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:58:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:58:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:58:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:58:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:58:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:58:13 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:58:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:58:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 11:58:13 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:58:13 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:58:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 11:58:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5688 values 89685 bits 11210 bytes 
Sat 18 Jan 2014 11:58:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:58:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43808636
Sat 18 Jan 2014 11:58:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:58:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43808636
Sat 18 Jan 2014 11:58:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:58:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:58:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:58:24 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:58:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:58:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:58:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:58:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:58:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:58:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:58:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:58:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:58:27 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:58:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:58:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:58:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:58:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:58:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:58:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:58:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:58:29 - job_xml_thread(): Done retrieving: data size 43809449
Sat 18 Jan 2014 11:58:29 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:58:29 - XML: Start document: iteration 19
Sat 18 Jan 2014 11:58:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43809449
Sat 18 Jan 2014 11:58:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:58:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43809449
Sat 18 Jan 2014 11:58:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:58:40 - XML: Processed 655154 elements - found 474 jobs
Sat 18 Jan 2014 11:58:40 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:58:40 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:58:40 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:58:40 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:58:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:58:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:58:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:58:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:58:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:58:50 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:58:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:58:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:58:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:58:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:58:51 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:58:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 11:58:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:58:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:58:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:58:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:58:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:58:52 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:58:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:58:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:58:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:58:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:58:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:58:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:58:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:58:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43813322
Sat 18 Jan 2014 11:58:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:58:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43813322
Sat 18 Jan 2014 11:58:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:58:55 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:58:55 - job_xml_thread(): Done retrieving: data size 43813322
Sat 18 Jan 2014 11:58:55 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:58:55 - XML: Start document: iteration 20
Sat 18 Jan 2014 11:59:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:59:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:59:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:59:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:59:09 - XML: Processed 655150 elements - found 474 jobs
Sat 18 Jan 2014 11:59:10 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:59:10 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:59:10 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:59:10 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:59:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:59:13 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:59:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:59:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:59:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:59:13 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:59:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:59:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:59:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:59:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:59:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:59:14 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:59:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 11:59:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:59:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 11:59:15 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:59:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6714 values 105834 bits 13229 bytes 
Sat 18 Jan 2014 11:59:16 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 11:59:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:59:16 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:59:16 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:59:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:59:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:59:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:59:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:59:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:59:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:59:17 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:59:17 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 11:59:17 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:59:17 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 11:59:17 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 11:59:18 - size of cluster 'LISA Cluster': 624 hosts 79482 metrics 874070 values 13778341 bits 1722292 bytes 
Sat 18 Jan 2014 11:59:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:59:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43743402
Sat 18 Jan 2014 11:59:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:59:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43743402
Sat 18 Jan 2014 11:59:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:59:25 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:59:25 - job_xml_thread(): Done retrieving: data size 43743402
Sat 18 Jan 2014 11:59:25 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 11:59:25 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 11:59:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:59:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:59:30 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 11:59:30 - Housekeeping: done.
Sat 18 Jan 2014 11:59:30 - XML: Start document: iteration 0
Sat 18 Jan 2014 11:59:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 11:59:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:59:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 11:59:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 11:59:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 11:59:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:59:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:59:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 11:59:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 11:59:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 11:59:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 11:59:44 - XML: Processed 654406 elements - found 474 jobs
Sat 18 Jan 2014 11:59:44 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 11:59:44 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 11:59:44 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 11:59:44 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 11:59:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 11:59:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 11:59:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 11:59:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 11:59:45 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 11:59:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 11:59:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 11:59:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:59:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 11:59:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 11:59:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 11:59:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 11:59:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43179367
Sat 18 Jan 2014 11:59:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 11:59:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43179367
Sat 18 Jan 2014 11:59:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 11:59:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 11:59:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 11:59:59 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 11:59:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:00:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:00:00 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:00:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:00:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:00:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:00:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:00:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:00:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:00:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:00:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:00:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:00:04 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:00:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:00:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:00:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:00:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:00:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:00:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:00:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:00:07 - job_xml_thread(): Done retrieving: data size 43152175
Sat 18 Jan 2014 12:00:07 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:00:07 - XML: Start document: iteration 1
Sat 18 Jan 2014 12:00:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43152175
Sat 18 Jan 2014 12:00:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:00:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43152175
Sat 18 Jan 2014 12:00:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:00:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:00:15 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:00:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:00:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:00:17 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:00:17 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 12:00:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:00:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 12:00:18 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:00:18 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:00:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 12:00:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:00:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:00:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9091 values 143403 bits 17925 bytes 
Sat 18 Jan 2014 12:00:25 - XML: Processed 647174 elements - found 474 jobs
Sat 18 Jan 2014 12:00:25 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:00:25 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:00:25 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:00:25 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:00:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:00:29 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:00:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:00:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:00:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:00:30 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:00:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:00:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:00:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:00:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:00:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:00:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:00:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:00:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:00:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:00:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:00:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:00:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:00:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43215930
Sat 18 Jan 2014 12:00:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:00:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43215930
Sat 18 Jan 2014 12:00:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:00:41 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:00:41 - job_xml_thread(): Done retrieving: data size 43215930
Sat 18 Jan 2014 12:00:41 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:00:41 - XML: Start document: iteration 2
Sat 18 Jan 2014 12:00:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:00:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:00:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:00:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:00:52 - XML: Processed 647702 elements - found 474 jobs
Sat 18 Jan 2014 12:00:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:00:52 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:00:52 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:00:52 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:00:52 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:00:52 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:00:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:00:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:00:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:00:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:00:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:00:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:00:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:00:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:00:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:00:55 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:00:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 12:00:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:00:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:00:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:00:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:00:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:00:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:00:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:00:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:00:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43794583
Sat 18 Jan 2014 12:00:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:00:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43794583
Sat 18 Jan 2014 12:00:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:01:07 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:01:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:01:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:01:08 - job_xml_thread(): Done retrieving: data size 43794583
Sat 18 Jan 2014 12:01:08 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:01:08 - XML: Start document: iteration 3
Sat 18 Jan 2014 12:01:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:01:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:01:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:01:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:01:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:01:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:01:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:01:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:01:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:01:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:01:18 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:01:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:01:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:01:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:01:19 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:01:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:01:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:01:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:01:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:01:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:01:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 12:01:19 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:01:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6033 values 95160 bits 11895 bytes 
Sat 18 Jan 2014 12:01:19 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:01:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 12:01:21 - XML: Processed 655022 elements - found 474 jobs
Sat 18 Jan 2014 12:01:21 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:01:21 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:01:21 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:01:21 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:01:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:01:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:01:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:01:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43767700
Sat 18 Jan 2014 12:01:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:01:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43767700
Sat 18 Jan 2014 12:01:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:01:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:01:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:01:36 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:01:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:01:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:01:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:01:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:01:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:01:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:01:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:01:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:01:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:01:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:01:41 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:01:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:01:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:01:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:01:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:01:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:01:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:01:42 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:01:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 12:01:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:01:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:01:45 - job_xml_thread(): Done retrieving: data size 43792004
Sat 18 Jan 2014 12:01:45 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:01:45 - XML: Start document: iteration 4
Sat 18 Jan 2014 12:01:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43792004
Sat 18 Jan 2014 12:01:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:01:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43792004
Sat 18 Jan 2014 12:01:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:01:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:01:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:01:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:01:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:01:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:01:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:01:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:01:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:02:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:02:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:02:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:02:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:02:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:02:02 - XML: Processed 655154 elements - found 474 jobs
Sat 18 Jan 2014 12:02:02 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:02:02 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:02:02 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:02:02 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:02:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:02:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:02:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:02:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:02:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:02:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:02:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:02:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:02:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:02:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43779013
Sat 18 Jan 2014 12:02:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:02:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43779013
Sat 18 Jan 2014 12:02:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:02:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:02:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:02:17 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:02:17 - job_xml_thread(): Done retrieving: data size 43779013
Sat 18 Jan 2014 12:02:17 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:02:18 - XML: Start document: iteration 5
Sat 18 Jan 2014 12:02:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:02:19 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:02:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:02:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 12:02:20 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:02:20 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:02:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8974 values 141895 bits 17736 bytes 
Sat 18 Jan 2014 12:02:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 12:02:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:02:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:02:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:02:25 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:02:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:02:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:02:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:02:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:02:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:02:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:02:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:02:33 - XML: Processed 655154 elements - found 474 jobs
Sat 18 Jan 2014 12:02:33 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:02:33 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:02:33 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:02:33 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:02:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:02:37 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:02:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:02:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:02:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:02:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:02:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:02:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:02:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:02:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43775941
Sat 18 Jan 2014 12:02:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:02:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43775941
Sat 18 Jan 2014 12:02:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:02:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:02:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:02:48 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:02:49 - job_xml_thread(): Done retrieving: data size 43775941
Sat 18 Jan 2014 12:02:49 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:02:49 - XML: Start document: iteration 6
Sat 18 Jan 2014 12:02:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:02:52 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:02:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:02:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:02:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:02:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:02:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:02:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:02:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:02:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:02:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:02:55 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:02:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 12:02:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:03:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:03:01 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:03:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:03:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:03:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:03:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:03:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:03:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:03:03 - XML: Processed 655152 elements - found 474 jobs
Sat 18 Jan 2014 12:03:03 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:03:03 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:03:03 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:03:03 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:03:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:03:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43787209
Sat 18 Jan 2014 12:03:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:03:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43787209
Sat 18 Jan 2014 12:03:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:03:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:03:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:03:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:03:14 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:03:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:03:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:03:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:03:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:03:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43787209
Sat 18 Jan 2014 12:03:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:03:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:03:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:03:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:03:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:03:18 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:03:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:03:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:03:20 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:03:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:03:22 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:03:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 12:03:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 12:03:22 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:03:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6002 values 94903 bits 11862 bytes 
Sat 18 Jan 2014 12:03:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:03:27 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:03:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:03:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:03:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:03:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:03:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:03:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:03:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:03:29 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:03:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:03:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:03:31 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 12:03:31 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 12:03:31 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:03:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:03:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:03:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:03:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:03:32 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:03:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 12:03:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:03:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:03:32 - job_xml_thread(): Done retrieving: data size 43779088
Sat 18 Jan 2014 12:03:32 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:03:32 - XML: Start document: iteration 7
Sat 18 Jan 2014 12:03:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43779088
Sat 18 Jan 2014 12:03:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:03:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43779088
Sat 18 Jan 2014 12:03:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:03:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:03:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:03:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:03:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:03:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:03:51 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:03:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:03:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:03:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:03:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:03:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:03:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:03:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:03:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:03:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:03:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:03:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:03:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:03:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:03:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:03:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:03:54 - XML: Processed 655154 elements - found 474 jobs
Sat 18 Jan 2014 12:03:54 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:03:54 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:03:54 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:03:54 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:03:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:03:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43809179
Sat 18 Jan 2014 12:03:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:03:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43809179
Sat 18 Jan 2014 12:03:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:04:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:04:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:04:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:04:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:04:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:04:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:04:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:04:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:04:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:04:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:04:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:04:09 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:04:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:04:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:04:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:04:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:04:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:04:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:04:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:04:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:04:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:04:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43814464
Sat 18 Jan 2014 12:04:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:04:12 - job_xml_thread(): Done retrieving: data size 43814464
Sat 18 Jan 2014 12:04:12 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:04:12 - XML: Start document: iteration 8
Sat 18 Jan 2014 12:04:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43814464
Sat 18 Jan 2014 12:04:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:04:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:04:22 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:04:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:04:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 12:04:23 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:04:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 12:04:23 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:04:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:04:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:04:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148739 bits 18592 bytes 
Sat 18 Jan 2014 12:04:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:04:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:04:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:04:27 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:04:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:04:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:04:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:04:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:04:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:04:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:04:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:04:34 - XML: Processed 655152 elements - found 473 jobs
Sat 18 Jan 2014 12:04:34 - job 7346759 appears to have finished
Sat 18 Jan 2014 12:04:34 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 12:04:34 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 12:04:35 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 12:04:35 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:04:35 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:04:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:04:35 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:04:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:04:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:04:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:04:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:04:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:04:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:04:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:04:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43785090
Sat 18 Jan 2014 12:04:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:04:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43785090
Sat 18 Jan 2014 12:04:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:04:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:04:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:04:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:04:47 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:04:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:04:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:04:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:04:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:04:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:04:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:04:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:04:50 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:04:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:04:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:04:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:04:52 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:04:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:04:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:04:53 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:04:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 12:04:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:04:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:04:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:04:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:04:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:04:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:04:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43795230
Sat 18 Jan 2014 12:04:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:04:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43795230
Sat 18 Jan 2014 12:04:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:04:55 - job_xml_thread(): Done retrieving: data size 43795230
Sat 18 Jan 2014 12:04:55 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:04:55 - XML: Start document: iteration 9
Sat 18 Jan 2014 12:05:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:05:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:05:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:05:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:05:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:05:13 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:05:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:05:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:05:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:05:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:05:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:05:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:05:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:05:14 - XML: Processed 655152 elements - found 473 jobs
Sat 18 Jan 2014 12:05:14 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:05:14 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:05:14 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:05:14 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:05:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:05:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:05:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:05:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:05:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:05:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:05:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:05:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:05:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:05:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43743424
Sat 18 Jan 2014 12:05:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:05:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43743424
Sat 18 Jan 2014 12:05:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:05:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:05:23 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:05:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:05:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 12:05:25 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:05:25 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:05:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8767 values 138266 bits 17283 bytes 
Sat 18 Jan 2014 12:05:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 12:05:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:05:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:05:29 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:05:29 - job_xml_thread(): Done retrieving: data size 43743424
Sat 18 Jan 2014 12:05:29 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:05:29 - XML: Start document: iteration 10
Sat 18 Jan 2014 12:05:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:05:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:05:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:05:33 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:05:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:05:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:05:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:05:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:05:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:05:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:05:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:05:38 - XML: Processed 654404 elements - found 473 jobs
Sat 18 Jan 2014 12:05:38 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:05:38 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:05:38 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:05:38 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:05:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:05:42 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:05:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:05:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:05:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:05:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:05:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:05:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:05:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:05:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43232344
Sat 18 Jan 2014 12:05:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:05:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43232344
Sat 18 Jan 2014 12:05:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:05:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:05:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:05:53 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:05:53 - job_xml_thread(): Done retrieving: data size 43232344
Sat 18 Jan 2014 12:05:53 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:05:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:05:53 - XML: Start document: iteration 11
Sat 18 Jan 2014 12:05:53 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:05:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:05:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:05:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:05:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:05:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:05:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:05:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:05:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:05:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:06:04 - XML: Processed 648276 elements - found 473 jobs
Sat 18 Jan 2014 12:06:04 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:06:04 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:06:04 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:06:04 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:06:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:06:06 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:06:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:06:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:06:06 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:06:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 12:06:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:06:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:06:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:06:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:06:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:06:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:06:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43161138
Sat 18 Jan 2014 12:06:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:06:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43161138
Sat 18 Jan 2014 12:06:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:06:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:06:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:06:18 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 12:06:18 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:06:19 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:06:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:06:19 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:06:19 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:06:19 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 12:06:19 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 12:06:19 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sat 18 Jan 2014 12:06:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:06:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:06:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:06:22 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:06:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:06:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:06:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:06:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:06:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:06:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:06:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:06:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:06:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:06:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:06:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:06:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:06:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:06:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:06:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:06:25 - job_xml_thread(): Done retrieving: data size 43195593
Sat 18 Jan 2014 12:06:25 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:06:25 - XML: Start document: iteration 12
Sat 18 Jan 2014 12:06:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43195593
Sat 18 Jan 2014 12:06:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43195593
Sat 18 Jan 2014 12:06:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:06:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:06:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:06:26 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:06:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:06:27 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:06:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 12:06:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 12:06:29 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:06:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5578 values 87886 bits 10985 bytes 
Sat 18 Jan 2014 12:06:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:06:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:06:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:06:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:06:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:06:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:06:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:06:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:06:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:06:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:06:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:06:44 - XML: Processed 647700 elements - found 473 jobs
Sat 18 Jan 2014 12:06:44 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:06:44 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:06:44 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:06:44 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:06:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:06:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:06:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:06:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:06:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:06:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:06:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:06:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:06:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:06:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43747453
Sat 18 Jan 2014 12:06:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:06:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43747453
Sat 18 Jan 2014 12:06:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:06:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:06:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:06:59 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:06:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:07:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:07:00 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:07:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:07:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:07:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:07:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:07:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:07:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:07:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:07:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:07:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:07:05 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:07:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:07:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:07:05 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:07:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 12:07:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:07:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:07:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:07:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:07:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:07:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:07:06 - job_xml_thread(): Done retrieving: data size 43783655
Sat 18 Jan 2014 12:07:06 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:07:06 - XML: Start document: iteration 13
Sat 18 Jan 2014 12:07:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43783655
Sat 18 Jan 2014 12:07:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:07:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43783655
Sat 18 Jan 2014 12:07:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:07:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:07:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:07:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:07:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:07:19 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:07:19 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:07:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:07:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:07:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:07:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:07:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:07:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:07:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:07:20 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:07:20 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 12:07:20 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 12:07:21 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:07:21 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 12:07:25 - XML: Processed 655140 elements - found 473 jobs
Sat 18 Jan 2014 12:07:25 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:07:25 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:07:25 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:07:25 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:07:26 - size of cluster 'LISA Cluster': 624 hosts 79481 metrics 876502 values 13832214 bits 1729026 bytes 
Sat 18 Jan 2014 12:07:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:07:28 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:07:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:07:29 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:07:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:07:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:07:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:07:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:07:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:07:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:07:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 12:07:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:07:29 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:07:29 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:07:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 12:07:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6060 values 95552 bits 11944 bytes 
Sat 18 Jan 2014 12:07:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:07:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43784880
Sat 18 Jan 2014 12:07:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:07:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43784880
Sat 18 Jan 2014 12:07:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:07:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:07:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:07:40 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:07:40 - job_xml_thread(): Done retrieving: data size 43784880
Sat 18 Jan 2014 12:07:41 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:07:41 - XML: Start document: iteration 14
Sat 18 Jan 2014 12:07:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:07:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:07:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:07:46 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:07:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:07:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:07:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:07:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:07:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:07:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:07:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:07:51 - XML: Processed 655152 elements - found 473 jobs
Sat 18 Jan 2014 12:07:51 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:07:51 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:07:51 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:07:51 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:07:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:07:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:07:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:07:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:07:55 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:07:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 12:07:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:07:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:07:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:07:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:07:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:07:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:07:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43797846
Sat 18 Jan 2014 12:07:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:07:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43797846
Sat 18 Jan 2014 12:08:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:08:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:08:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:08:07 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:08:07 - job_xml_thread(): Done retrieving: data size 43797846
Sat 18 Jan 2014 12:08:07 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:08:07 - XML: Start document: iteration 15
Sat 18 Jan 2014 12:08:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:08:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:08:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:08:15 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:08:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:08:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:08:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:08:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:08:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:08:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:08:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:08:21 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:08:21 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 12:08:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:08:23 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:08:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:08:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:08:23 - XML: Processed 655152 elements - found 473 jobs
Sat 18 Jan 2014 12:08:23 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:08:23 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:08:23 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:08:23 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:08:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:08:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:08:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:08:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:08:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:08:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43793010
Sat 18 Jan 2014 12:08:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:08:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43793010
Sat 18 Jan 2014 12:08:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:08:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:08:29 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:08:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:08:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:08:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:08:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 12:08:32 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:08:32 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:08:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8883 values 140072 bits 17509 bytes 
Sat 18 Jan 2014 12:08:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 12:08:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:08:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:08:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:08:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:08:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:08:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:08:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43793010
Sat 18 Jan 2014 12:08:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:08:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:08:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:08:38 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:08:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:08:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:08:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:08:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:08:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:08:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:08:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:08:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:08:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:08:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:08:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:08:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:08:49 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:08:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:08:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:08:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:08:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:08:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:08:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:08:52 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:08:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 12:08:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:08:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:08:53 - job_xml_thread(): Done retrieving: data size 43767488
Sat 18 Jan 2014 12:08:53 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:08:53 - XML: Start document: iteration 16
Sat 18 Jan 2014 12:08:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43767488
Sat 18 Jan 2014 12:08:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:08:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43767488
Sat 18 Jan 2014 12:08:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:09:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:09:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:09:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:09:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:09:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:09:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:09:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:09:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:09:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:09:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:09:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:09:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:09:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:09:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:09:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:09:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:09:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:09:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:09:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:09:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:09:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:09:17 - XML: Processed 655152 elements - found 473 jobs
Sat 18 Jan 2014 12:09:17 - job 7346012 appears to have finished
Sat 18 Jan 2014 12:09:17 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 12:09:17 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 12:09:17 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 12:09:17 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:09:17 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:09:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:09:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43806501
Sat 18 Jan 2014 12:09:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:09:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43806501
Sat 18 Jan 2014 12:09:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:09:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:09:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:09:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:09:31 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:09:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:09:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:09:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:09:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:09:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:09:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:09:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:09:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:09:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:09:32 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:09:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:09:32 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:09:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:09:33 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:09:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 12:09:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 12:09:33 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:09:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6531 values 102993 bits 12874 bytes 
Sat 18 Jan 2014 12:09:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:09:35 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:09:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:09:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:09:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:09:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:09:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:09:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:09:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:09:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43787282
Sat 18 Jan 2014 12:09:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:09:40 - job_xml_thread(): Done retrieving: data size 43787282
Sat 18 Jan 2014 12:09:40 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:09:40 - XML: Start document: iteration 17
Sat 18 Jan 2014 12:09:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43787282
Sat 18 Jan 2014 12:09:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:09:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:09:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:09:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:09:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:09:54 - XML: Processed 655152 elements - found 473 jobs
Sat 18 Jan 2014 12:09:55 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:09:55 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:09:55 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:09:55 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:10:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:10:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:10:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:10:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:10:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:10:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:10:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:10:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:10:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:10:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:10:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:10:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:10:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:10:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:10:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:10:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:10:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:10:02 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:10:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 12:10:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:10:03 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 12:10:03 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 12:10:03 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:10:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:10:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43807953
Sat 18 Jan 2014 12:10:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:10:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43807953
Sat 18 Jan 2014 12:10:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:10:10 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:10:10 - job_xml_thread(): Done retrieving: data size 43807953
Sat 18 Jan 2014 12:10:10 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:10:10 - XML: Start document: iteration 18
Sat 18 Jan 2014 12:10:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:10:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:10:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:10:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:10:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:10:18 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:10:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:10:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:10:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:10:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:10:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:10:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:10:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:10:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:10:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:10:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:10:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:10:26 - XML: Processed 655152 elements - found 473 jobs
Sat 18 Jan 2014 12:10:26 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:10:26 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:10:26 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:10:26 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:10:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:10:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:10:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:10:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:10:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:10:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43798301
Sat 18 Jan 2014 12:10:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:10:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43798301
Sat 18 Jan 2014 12:10:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:10:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:10:34 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:10:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:10:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:10:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:10:36 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:10:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 12:10:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 12:10:36 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:10:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8864 values 139758 bits 17469 bytes 
Sat 18 Jan 2014 12:10:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:10:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:10:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:10:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:10:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:10:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:10:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:10:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:10:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:10:41 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:10:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:10:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:10:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:10:42 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:10:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:10:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:10:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:10:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:10:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:10:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:10:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:10:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43818224
Sat 18 Jan 2014 12:10:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:10:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43818224
Sat 18 Jan 2014 12:10:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:10:45 - job_xml_thread(): Done retrieving: data size 43818224
Sat 18 Jan 2014 12:10:45 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:10:45 - XML: Start document: iteration 19
Sat 18 Jan 2014 12:10:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:10:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:10:57 - XML: Processed 655156 elements - found 475 jobs
Sat 18 Jan 2014 12:10:57 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 12:10:57 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 12:10:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:10:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:10:59 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 12:10:59 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:10:59 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:11:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:11:05 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:11:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:11:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:11:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:11:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:11:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:11:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:11:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:11:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:11:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:11:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:11:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:11:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:11:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:11:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:11:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:11:06 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:11:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 12:11:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:11:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:11:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43736420
Sat 18 Jan 2014 12:11:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:11:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43736420
Sat 18 Jan 2014 12:11:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:11:14 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:11:15 - job_xml_thread(): Done retrieving: data size 43736420
Sat 18 Jan 2014 12:11:15 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:11:15 - XML: Start document: iteration 20
Sat 18 Jan 2014 12:11:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:11:20 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:11:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:11:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:11:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:11:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:11:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:11:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:11:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:11:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:11:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:11:29 - XML: Processed 654408 elements - found 475 jobs
Sat 18 Jan 2014 12:11:29 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:11:29 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:11:29 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:11:29 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:11:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:11:30 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:11:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:11:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:11:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:11:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:11:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:11:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:11:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:11:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43736685
Sat 18 Jan 2014 12:11:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:11:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43736685
Sat 18 Jan 2014 12:11:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:11:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:11:36 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:11:37 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:11:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:11:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 12:11:38 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:11:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 12:11:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:11:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:11:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8921 values 140616 bits 17577 bytes 
Sat 18 Jan 2014 12:11:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:11:43 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:11:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:11:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:11:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:11:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:11:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:11:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:11:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:11:45 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:11:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:11:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:11:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:11:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:11:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:11:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:11:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:11:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:11:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:11:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:11:49 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:11:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 12:11:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:11:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:11:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43174730
Sat 18 Jan 2014 12:11:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:11:50 - job_xml_thread(): Done retrieving: data size 43174730
Sat 18 Jan 2014 12:11:50 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:11:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43174730
Sat 18 Jan 2014 12:11:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:11:50 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 12:11:52 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 12:11:52 - Housekeeping: done.
Sat 18 Jan 2014 12:11:52 - XML: Start document: iteration 0
Sat 18 Jan 2014 12:11:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:11:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:12:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:12:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:12:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:12:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:12:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:12:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:12:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:12:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:12:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:12:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:12:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:12:06 - XML: Processed 647390 elements - found 475 jobs
Sat 18 Jan 2014 12:12:07 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:12:07 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:12:07 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:12:07 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:12:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:12:12 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:12:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:12:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:12:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:12:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:12:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:12:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:12:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:12:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43173021
Sat 18 Jan 2014 12:12:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:12:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43173021
Sat 18 Jan 2014 12:12:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:12:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:12:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:12:22 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:12:22 - job_xml_thread(): Done retrieving: data size 43173021
Sat 18 Jan 2014 12:12:22 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:12:22 - XML: Start document: iteration 1
Sat 18 Jan 2014 12:12:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:12:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:12:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:12:29 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:12:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:12:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:12:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:12:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:12:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:12:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:12:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:12:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:12:35 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:12:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:12:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:12:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:12:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:12:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:12:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:12:37 - XML: Processed 647396 elements - found 475 jobs
Sat 18 Jan 2014 12:12:37 - job 7348841 report time 1390043378 does not match current heartbeat 1390043498 : ignoring job
Sat 18 Jan 2014 12:12:37 - job 7348840 report time 1390043378 does not match current heartbeat 1390043498 : ignoring job
Sat 18 Jan 2014 12:12:37 - job 7348852 field 'start_timestamp' changed since saved from: 1390043383 to: 1390043329
Sat 18 Jan 2014 12:12:37 - job 7348853 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 12:12:37 - job 7348851 appears to have finished
Sat 18 Jan 2014 12:12:37 - job_xml_thread(): Found 4 updated jobs.
Sat 18 Jan 2014 12:12:37 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 12:12:37 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Sat 18 Jan 2014 12:12:37 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:12:37 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:12:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:12:38 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:12:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:12:38 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:12:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 12:12:38 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:12:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 12:12:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99080 bits 12385 bytes 
Sat 18 Jan 2014 12:12:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:12:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43658597
Sat 18 Jan 2014 12:12:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:12:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43658597
Sat 18 Jan 2014 12:12:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:12:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:12:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:12:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:12:48 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:12:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:12:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:12:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:12:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:12:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:12:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:12:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:12:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:12:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:12:52 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:12:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:12:53 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:12:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:12:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:12:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:12:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:12:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:12:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:12:54 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:12:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 12:12:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:12:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:12:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43773396
Sat 18 Jan 2014 12:12:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:12:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43773396
Sat 18 Jan 2014 12:12:56 - job_xml_thread(): Done retrieving: data size 43773396
Sat 18 Jan 2014 12:12:56 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:12:56 - XML: Start document: iteration 2
Sat 18 Jan 2014 12:12:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:13:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:13:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:13:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:13:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:13:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:13:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:13:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:13:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:13:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:13:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:13:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:13:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:13:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:13:14 - XML: Processed 654916 elements - found 475 jobs
Sat 18 Jan 2014 12:13:14 - job 7348841 report time 1390043378 does not match current heartbeat 1390043498 : ignoring job
Sat 18 Jan 2014 12:13:14 - job 7348840 report time 1390043378 does not match current heartbeat 1390043498 : ignoring job
Sat 18 Jan 2014 12:13:14 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:13:14 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:13:14 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:13:14 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:13:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:13:16 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:13:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:13:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:13:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:13:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:13:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:13:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:13:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:13:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43796546
Sat 18 Jan 2014 12:13:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:13:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43796546
Sat 18 Jan 2014 12:13:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:13:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:13:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:13:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:13:29 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:13:29 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:13:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:13:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:13:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:13:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:13:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:13:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:13:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:13:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:13:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:13:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:13:33 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:13:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:13:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:13:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:13:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:13:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:13:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:13:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:13:34 - job_xml_thread(): Done retrieving: data size 43794262
Sat 18 Jan 2014 12:13:34 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:13:34 - XML: Start document: iteration 3
Sat 18 Jan 2014 12:13:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43794262
Sat 18 Jan 2014 12:13:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:13:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43794262
Sat 18 Jan 2014 12:13:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:13:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:13:39 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:13:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:13:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 12:13:41 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:13:41 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:13:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 12:13:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 10058 values 158616 bits 19827 bytes 
Sat 18 Jan 2014 12:13:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:13:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:13:47 - XML: Processed 655156 elements - found 475 jobs
Sat 18 Jan 2014 12:13:47 - job 7348841 report time 1390043378 does not match current heartbeat 1390043498 : ignoring job
Sat 18 Jan 2014 12:13:47 - job 7348840 report time 1390043378 does not match current heartbeat 1390043498 : ignoring job
Sat 18 Jan 2014 12:13:47 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:13:47 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:13:47 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:13:47 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:13:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:13:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:13:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:13:52 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:13:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:13:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:13:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:13:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:13:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:13:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:13:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:13:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:13:58 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:13:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:13:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:13:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:13:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:13:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:13:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:14:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:14:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43812337
Sat 18 Jan 2014 12:14:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:14:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43812337
Sat 18 Jan 2014 12:14:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:14:02 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:14:02 - job_xml_thread(): Done retrieving: data size 43812337
Sat 18 Jan 2014 12:14:02 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:14:02 - XML: Start document: iteration 4
Sat 18 Jan 2014 12:14:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:14:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:14:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:14:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:14:14 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:14:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 12:14:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:14:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:14:15 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:14:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:14:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:14:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:14:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:14:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:14:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:14:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:14:19 - XML: Processed 655156 elements - found 475 jobs
Sat 18 Jan 2014 12:14:19 - job 7348841 report time 1390043378 does not match current heartbeat 1390043498 : ignoring job
Sat 18 Jan 2014 12:14:19 - job 7348840 report time 1390043378 does not match current heartbeat 1390043498 : ignoring job
Sat 18 Jan 2014 12:14:19 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:14:19 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:14:19 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:14:19 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:14:21 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 12:14:21 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:14:22 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:14:22 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 12:14:22 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:14:22 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 12:14:22 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 12:14:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:14:23 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:14:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:14:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:14:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:14:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:14:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:14:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:14:24 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 938226 values 14789943 bits 1848742 bytes 
Sat 18 Jan 2014 12:14:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:14:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43780897
Sat 18 Jan 2014 12:14:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:14:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43780897
Sat 18 Jan 2014 12:14:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:14:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:14:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:14:35 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:14:35 - job_xml_thread(): Done retrieving: data size 43780897
Sat 18 Jan 2014 12:14:35 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:14:35 - XML: Start document: iteration 5
Sat 18 Jan 2014 12:14:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:14:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:14:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:14:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:14:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:14:42 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:14:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:14:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:14:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:14:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:14:42 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:14:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:14:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:14:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:14:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 12:14:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:14:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 12:14:42 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:14:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5989 values 94413 bits 11801 bytes 
Sat 18 Jan 2014 12:14:44 - XML: Processed 655152 elements - found 473 jobs
Sat 18 Jan 2014 12:14:44 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:14:44 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:14:44 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:14:44 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:14:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:14:49 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:14:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:14:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:14:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:14:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:14:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:14:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:14:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:14:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43781985
Sat 18 Jan 2014 12:14:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:14:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43781985
Sat 18 Jan 2014 12:14:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:14:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:14:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:14:59 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:14:59 - job_xml_thread(): Done retrieving: data size 43781985
Sat 18 Jan 2014 12:14:59 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:14:59 - XML: Start document: iteration 6
Sat 18 Jan 2014 12:15:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:15:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:15:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:15:07 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:15:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:15:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:15:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:15:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:15:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:15:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:15:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:15:14 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:15:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 12:15:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:15:15 - XML: Processed 655152 elements - found 473 jobs
Sat 18 Jan 2014 12:15:15 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:15:15 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:15:15 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:15:15 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:15:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:15:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:15:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:15:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:15:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:15:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:15:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:15:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:15:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:15:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43775321
Sat 18 Jan 2014 12:15:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:15:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43775321
Sat 18 Jan 2014 12:15:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:15:22 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:15:23 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 12:15:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:15:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:15:30 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:15:30 - job_xml_thread(): Done retrieving: data size 43775321
Sat 18 Jan 2014 12:15:30 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:15:30 - XML: Start document: iteration 7
Sat 18 Jan 2014 12:15:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:15:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:15:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:15:33 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:15:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:15:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:15:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:15:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:15:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:15:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:15:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:15:42 - XML: Processed 655152 elements - found 473 jobs
Sat 18 Jan 2014 12:15:42 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:15:42 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:15:42 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:15:42 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:15:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:15:43 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:15:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:15:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 12:15:44 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:15:44 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:15:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5964 values 94073 bits 11759 bytes 
Sat 18 Jan 2014 12:15:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 12:15:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:15:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:15:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:15:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:15:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:15:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:15:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:15:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:15:49 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:15:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 12:15:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:15:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:15:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43779229
Sat 18 Jan 2014 12:15:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:15:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:15:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:15:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43779229
Sat 18 Jan 2014 12:15:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:15:57 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:15:57 - job_xml_thread(): Done retrieving: data size 43779229
Sat 18 Jan 2014 12:15:57 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:15:57 - XML: Start document: iteration 8
Sat 18 Jan 2014 12:16:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:16:00 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:16:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:16:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:16:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:16:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:16:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:16:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:16:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:16:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:16:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:16:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:16:10 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:16:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:16:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:16:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:16:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:16:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:16:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:16:11 - XML: Processed 655147 elements - found 473 jobs
Sat 18 Jan 2014 12:16:11 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:16:11 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:16:11 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:16:11 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:16:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:16:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43789770
Sat 18 Jan 2014 12:16:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:16:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43789770
Sat 18 Jan 2014 12:16:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:16:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:16:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:16:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:16:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:16:26 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:16:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:16:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:16:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:16:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:16:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:16:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:16:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:16:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:16:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:16:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:16:30 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:16:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:16:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:16:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:16:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:16:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:16:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:16:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:16:33 - job_xml_thread(): Done retrieving: data size 43812648
Sat 18 Jan 2014 12:16:33 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:16:33 - XML: Start document: iteration 9
Sat 18 Jan 2014 12:16:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43812648
Sat 18 Jan 2014 12:16:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:16:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43812648
Sat 18 Jan 2014 12:16:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:16:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:16:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:16:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:16:44 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:16:45 - XML: Processed 655147 elements - found 472 jobs
Sat 18 Jan 2014 12:16:45 - job 7348854 appears to have finished
Sat 18 Jan 2014 12:16:45 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 12:16:45 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 12:16:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:16:45 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:16:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 12:16:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 12:16:45 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:16:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148764 bits 18595 bytes 
Sat 18 Jan 2014 12:16:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:16:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:16:46 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 12:16:46 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:16:46 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:16:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:16:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:16:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:16:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:16:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:16:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:16:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:16:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:16:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:16:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:16:56 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:16:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:16:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:16:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:16:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:16:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:16:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:17:00 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:17:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 12:17:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:17:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:17:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43827132
Sat 18 Jan 2014 12:17:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:17:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43827132
Sat 18 Jan 2014 12:17:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:17:02 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:17:02 - job_xml_thread(): Done retrieving: data size 43827132
Sat 18 Jan 2014 12:17:02 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:17:02 - XML: Start document: iteration 10
Sat 18 Jan 2014 12:17:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:17:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:17:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:17:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:17:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:17:13 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:17:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:17:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:17:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:17:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:17:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:17:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:17:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:17:23 - XML: Processed 655150 elements - found 472 jobs
Sat 18 Jan 2014 12:17:23 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:17:23 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:17:23 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:17:23 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:17:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:17:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:17:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:17:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:17:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:17:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:17:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:17:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:17:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:17:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:17:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43721456
Sat 18 Jan 2014 12:17:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:17:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:17:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43721456
Sat 18 Jan 2014 12:17:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:17:38 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:17:38 - job_xml_thread(): Done retrieving: data size 43721456
Sat 18 Jan 2014 12:17:38 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:17:38 - XML: Start document: iteration 11
Sat 18 Jan 2014 12:17:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:17:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:17:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:17:45 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:17:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:17:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:17:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:17:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:17:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:17:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:17:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:17:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:17:46 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:17:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:17:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 12:17:46 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:17:46 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:17:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 12:17:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99418 bits 12427 bytes 
Sat 18 Jan 2014 12:17:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:17:53 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:17:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:17:53 - XML: Processed 654402 elements - found 472 jobs
Sat 18 Jan 2014 12:17:53 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:17:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:17:53 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:17:53 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:17:53 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:17:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:17:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:17:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:17:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:17:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:17:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43163260
Sat 18 Jan 2014 12:17:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:17:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43163260
Sat 18 Jan 2014 12:17:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:18:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:18:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:18:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:18:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:18:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:18:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:18:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:18:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:18:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:18:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:18:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43163260
Sat 18 Jan 2014 12:18:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:18:08 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:18:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:18:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:18:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:18:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:18:15 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:18:19 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:18:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 12:18:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:18:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:18:19 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:18:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:18:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:18:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:18:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:18:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:18:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:18:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:18:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:18:21 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 12:18:21 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 12:18:21 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:18:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:18:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:18:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:18:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:18:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:18:22 - job_xml_thread(): Done retrieving: data size 43176177
Sat 18 Jan 2014 12:18:22 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:18:22 - XML: Start document: iteration 12
Sat 18 Jan 2014 12:18:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43176177
Sat 18 Jan 2014 12:18:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:18:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43176177
Sat 18 Jan 2014 12:18:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:18:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:18:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:18:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:18:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:18:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:18:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:18:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:18:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:18:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:18:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:18:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:18:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:18:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:18:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:18:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:18:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:18:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:18:45 - XML: Processed 647698 elements - found 472 jobs
Sat 18 Jan 2014 12:18:45 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:18:45 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:18:45 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:18:45 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:18:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:18:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:18:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:18:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:18:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:18:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43742429
Sat 18 Jan 2014 12:18:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:18:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:18:46 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:18:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43742429
Sat 18 Jan 2014 12:18:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:18:47 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:18:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:18:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 12:18:47 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:18:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 12:18:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8961 values 141514 bits 17689 bytes 
Sat 18 Jan 2014 12:18:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:18:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:18:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:18:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:18:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:18:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:18:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:18:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:19:00 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:19:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:19:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:19:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:19:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:19:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:19:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:19:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:19:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:19:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:19:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:19:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:19:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:19:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:19:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:19:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43806732
Sat 18 Jan 2014 12:19:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:19:03 - job_xml_thread(): Done retrieving: data size 43806732
Sat 18 Jan 2014 12:19:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43806732
Sat 18 Jan 2014 12:19:03 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:19:03 - XML: Start document: iteration 13
Sat 18 Jan 2014 12:19:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:19:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:19:15 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:19:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:19:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:19:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:19:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:19:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:19:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:19:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:19:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:19:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:19:21 - XML: Processed 655112 elements - found 472 jobs
Sat 18 Jan 2014 12:19:21 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:19:21 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:19:21 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:19:21 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:19:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:19:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:19:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:19:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:19:25 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:19:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 12:19:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:19:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:19:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:19:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:19:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:19:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:19:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43789463
Sat 18 Jan 2014 12:19:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:19:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43789463
Sat 18 Jan 2014 12:19:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:19:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:19:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:19:36 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:19:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:19:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:19:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:19:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:19:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:19:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:19:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:19:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:19:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:19:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:19:39 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:19:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:19:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:19:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:19:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:19:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:19:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:19:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:19:42 - job_xml_thread(): Done retrieving: data size 43806988
Sat 18 Jan 2014 12:19:42 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:19:42 - XML: Start document: iteration 14
Sat 18 Jan 2014 12:19:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43806988
Sat 18 Jan 2014 12:19:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:19:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43806988
Sat 18 Jan 2014 12:19:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:19:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:19:49 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:19:50 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:19:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 12:19:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:19:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 12:19:50 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:19:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9061 values 142946 bits 17868 bytes 
Sat 18 Jan 2014 12:19:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:19:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:19:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:19:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:19:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:19:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:19:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:19:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:20:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:20:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:20:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:20:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:20:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:20:01 - XML: Processed 655150 elements - found 472 jobs
Sat 18 Jan 2014 12:20:01 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:20:01 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:20:01 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:20:01 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:20:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:20:04 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:20:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:20:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:20:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:20:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:20:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:20:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:20:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:20:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43795209
Sat 18 Jan 2014 12:20:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:20:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43795209
Sat 18 Jan 2014 12:20:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:20:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:20:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:20:16 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:20:16 - job_xml_thread(): Done retrieving: data size 43795209
Sat 18 Jan 2014 12:20:16 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:20:16 - XML: Start document: iteration 15
Sat 18 Jan 2014 12:20:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:20:18 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:20:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:20:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:20:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:20:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:20:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:20:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:20:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:20:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:20:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:20:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:20:29 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:20:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:20:29 - XML: Processed 655148 elements - found 472 jobs
Sat 18 Jan 2014 12:20:29 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:20:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:20:29 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:20:29 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:20:29 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:20:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:20:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:20:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:20:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:20:30 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:20:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 12:20:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:20:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:20:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43782542
Sat 18 Jan 2014 12:20:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:20:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43782542
Sat 18 Jan 2014 12:20:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:20:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:20:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:20:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:20:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:20:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:20:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:20:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:20:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:20:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:20:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:20:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43782542
Sat 18 Jan 2014 12:20:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:20:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:20:45 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:20:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:20:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:20:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:20:50 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:20:50 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:20:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 12:20:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:20:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 12:20:51 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:20:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5985 values 94428 bits 11803 bytes 
Sat 18 Jan 2014 12:20:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:20:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:20:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:20:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:20:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:20:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:20:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:20:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:20:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:20:53 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:20:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:20:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:20:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:20:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:20:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:20:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:20:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:20:56 - job_xml_thread(): Done retrieving: data size 43793500
Sat 18 Jan 2014 12:20:56 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:20:56 - XML: Start document: iteration 16
Sat 18 Jan 2014 12:20:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43793500
Sat 18 Jan 2014 12:20:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:20:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43793500
Sat 18 Jan 2014 12:20:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:21:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:21:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:21:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:21:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:21:13 - XML: Processed 655148 elements - found 471 jobs
Sat 18 Jan 2014 12:21:13 - job 7341523 appears to have finished
Sat 18 Jan 2014 12:21:13 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 12:21:14 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 12:21:15 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 12:21:15 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:21:15 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:21:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:21:18 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:21:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:21:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:21:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:21:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:21:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:21:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:21:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:21:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:21:19 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:21:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:21:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:21:19 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:21:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 12:21:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:21:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:21:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:21:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:21:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:21:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:21:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43816521
Sat 18 Jan 2014 12:21:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:21:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43816521
Sat 18 Jan 2014 12:21:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:21:23 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 12:21:23 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:21:25 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:21:25 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 12:21:25 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 12:21:25 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:21:25 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sat 18 Jan 2014 12:21:31 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:21:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:21:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:21:33 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:21:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:21:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:21:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:21:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:21:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:21:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:21:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:21:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:21:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:21:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:21:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:21:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:21:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:21:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:21:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:21:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:21:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:21:37 - job_xml_thread(): Done retrieving: data size 43811002
Sat 18 Jan 2014 12:21:37 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:21:37 - XML: Start document: iteration 17
Sat 18 Jan 2014 12:21:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43811002
Sat 18 Jan 2014 12:21:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43811002
Sat 18 Jan 2014 12:21:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:21:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:21:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:21:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:21:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:21:51 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:21:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:21:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:21:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:21:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 12:21:52 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:21:52 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:21:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 12:21:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:21:53 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:21:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:21:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9125 values 143889 bits 17986 bytes 
Sat 18 Jan 2014 12:21:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:21:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:21:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:21:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:21:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:21:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:21:59 - XML: Processed 655148 elements - found 471 jobs
Sat 18 Jan 2014 12:21:59 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:21:59 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:22:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:22:00 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:22:00 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:22:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:22:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:22:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:22:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:22:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:22:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:22:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:22:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:22:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43803049
Sat 18 Jan 2014 12:22:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:22:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43803049
Sat 18 Jan 2014 12:22:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:22:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:22:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:22:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:22:14 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:22:15 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:22:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:22:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:22:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:22:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:22:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:22:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:22:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:22:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:22:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:22:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:22:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:22:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:22:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:22:18 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:22:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 12:22:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:22:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:22:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:22:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:22:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:22:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:22:19 - job_xml_thread(): Done retrieving: data size 43801355
Sat 18 Jan 2014 12:22:19 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:22:19 - XML: Start document: iteration 18
Sat 18 Jan 2014 12:22:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43801355
Sat 18 Jan 2014 12:22:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:22:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43801355
Sat 18 Jan 2014 12:22:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:22:25 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:22:25 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:22:27 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:22:27 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:22:27 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 12:22:27 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 12:22:27 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 12:22:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:22:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:22:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:22:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:22:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:22:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:22:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:22:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:22:39 - size of cluster 'LISA Cluster': 624 hosts 79477 metrics 909513 values 14356292 bits 1794536 bytes 
Sat 18 Jan 2014 12:22:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:22:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:22:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:22:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:22:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:22:42 - XML: Processed 655150 elements - found 472 jobs
Sat 18 Jan 2014 12:22:42 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 12:22:42 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 12:22:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:22:43 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 12:22:43 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:22:43 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:22:43 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:22:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:22:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:22:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:22:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:22:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:22:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:22:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:22:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43821124
Sat 18 Jan 2014 12:22:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:22:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43821124
Sat 18 Jan 2014 12:22:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:22:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:22:53 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:22:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:22:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:22:55 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:22:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 12:22:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:22:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:22:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:22:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 12:22:55 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:22:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8780 values 138460 bits 17307 bytes 
Sat 18 Jan 2014 12:22:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:22:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:22:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:22:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:22:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43821124
Sat 18 Jan 2014 12:22:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:22:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:22:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:22:58 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:22:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:22:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:22:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:23:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:23:07 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:23:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:23:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:23:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:23:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:23:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:23:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:23:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:23:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:23:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:23:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:23:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:23:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:23:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:23:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:23:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:23:13 - job_xml_thread(): Done retrieving: data size 43785416
Sat 18 Jan 2014 12:23:13 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:23:13 - XML: Start document: iteration 19
Sat 18 Jan 2014 12:23:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43785416
Sat 18 Jan 2014 12:23:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:23:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43785416
Sat 18 Jan 2014 12:23:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:23:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:23:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:23:26 - XML: Processed 655150 elements - found 472 jobs
Sat 18 Jan 2014 12:23:26 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:23:26 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:23:26 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:23:26 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:23:27 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:23:27 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 12:23:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:23:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:23:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:23:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:23:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:23:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:23:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:23:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:23:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:23:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:23:36 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:23:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 12:23:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:23:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:23:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:23:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:23:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:23:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:23:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:23:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:23:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:23:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:23:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:23:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43217488
Sat 18 Jan 2014 12:23:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:23:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43217488
Sat 18 Jan 2014 12:23:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:23:41 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:23:42 - job_xml_thread(): Done retrieving: data size 43217488
Sat 18 Jan 2014 12:23:42 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:23:42 - XML: Start document: iteration 20
Sat 18 Jan 2014 12:23:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:23:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:23:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:23:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:23:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:23:52 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:23:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:23:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:23:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:23:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:23:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:23:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:23:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:23:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:23:55 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:23:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:23:56 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:23:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 12:23:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 12:23:56 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:23:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5750 values 90633 bits 11329 bytes 
Sat 18 Jan 2014 12:24:02 - XML: Processed 647924 elements - found 472 jobs
Sat 18 Jan 2014 12:24:02 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:24:02 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:24:02 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:24:02 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:24:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:24:04 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:24:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:24:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:24:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:24:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:24:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:24:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:24:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:24:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43108017
Sat 18 Jan 2014 12:24:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:24:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43108017
Sat 18 Jan 2014 12:24:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:24:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:24:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:24:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:24:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:24:17 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:24:17 - job_xml_thread(): Done retrieving: data size 43108017
Sat 18 Jan 2014 12:24:17 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:24:17 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 12:24:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:24:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:24:17 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 12:24:17 - Housekeeping: done.
Sat 18 Jan 2014 12:24:17 - XML: Start document: iteration 0
Sat 18 Jan 2014 12:24:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:24:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:24:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:24:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:24:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:24:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:24:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:24:30 - XML: Processed 646968 elements - found 472 jobs
Sat 18 Jan 2014 12:24:31 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:24:31 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:24:31 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:24:31 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:24:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:24:31 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:24:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:24:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:24:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:24:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:24:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:24:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:24:31 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:24:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 12:24:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:24:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:24:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:24:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:24:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43426317
Sat 18 Jan 2014 12:24:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:24:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43426317
Sat 18 Jan 2014 12:24:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:24:46 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:24:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:24:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:24:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:24:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:24:49 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:24:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:24:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:24:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:24:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:24:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:24:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:24:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:24:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:24:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:24:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:24:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:24:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:24:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:24:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:24:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:24:54 - job_xml_thread(): Done retrieving: data size 43758754
Sat 18 Jan 2014 12:24:54 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:24:54 - XML: Start document: iteration 1
Sat 18 Jan 2014 12:24:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43758754
Sat 18 Jan 2014 12:24:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43758754
Sat 18 Jan 2014 12:24:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:24:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:24:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:24:56 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:24:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:24:57 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:24:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 12:24:57 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:24:59 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8835 values 139273 bits 17409 bytes 
Sat 18 Jan 2014 12:24:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 12:25:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:25:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:25:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:25:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:25:07 - XML: Processed 654708 elements - found 471 jobs
Sat 18 Jan 2014 12:25:07 - job 7335600 appears to have finished
Sat 18 Jan 2014 12:25:07 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 12:25:07 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 12:25:08 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 12:25:08 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:25:08 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:25:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:25:13 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:25:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:25:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:25:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:25:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:25:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:25:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:25:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:25:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:25:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:25:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:25:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:25:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:25:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:25:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:25:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:25:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:25:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43794252
Sat 18 Jan 2014 12:25:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:25:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43794252
Sat 18 Jan 2014 12:25:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:25:23 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:25:23 - job_xml_thread(): Done retrieving: data size 43794252
Sat 18 Jan 2014 12:25:23 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:25:23 - XML: Start document: iteration 2
Sat 18 Jan 2014 12:25:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:25:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:25:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:25:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:25:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:25:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:25:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:25:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:25:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:25:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:25:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:25:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:25:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:25:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:25:43 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:25:44 - XML: Processed 655145 elements - found 471 jobs
Sat 18 Jan 2014 12:25:44 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:25:44 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:25:44 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:25:44 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:25:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:25:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:25:44 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 12:25:44 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 12:25:44 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:25:44 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:25:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 12:25:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:25:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:25:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:25:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:25:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:25:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:25:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43786571
Sat 18 Jan 2014 12:25:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:25:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43786571
Sat 18 Jan 2014 12:25:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:25:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:25:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:25:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:25:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:25:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:25:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:25:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:25:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:25:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:25:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:25:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:25:59 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:25:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:25:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:25:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:25:59 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:25:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:25:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 12:25:59 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:25:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 12:25:59 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:25:59 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5987 values 94411 bits 11801 bytes 
Sat 18 Jan 2014 12:26:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:26:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:26:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:26:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:26:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:26:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:26:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:26:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:26:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:26:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43794005
Sat 18 Jan 2014 12:26:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:26:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43794005
Sat 18 Jan 2014 12:26:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:26:03 - job_xml_thread(): Done retrieving: data size 43794005
Sat 18 Jan 2014 12:26:03 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:26:03 - XML: Start document: iteration 3
Sat 18 Jan 2014 12:26:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:26:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:26:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:26:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:26:17 - XML: Processed 655143 elements - found 471 jobs
Sat 18 Jan 2014 12:26:17 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:26:17 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:26:17 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:26:17 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:26:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:26:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:26:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:26:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:26:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:26:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:26:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:26:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:26:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:26:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:26:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:26:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:26:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:26:25 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:26:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 12:26:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:26:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:26:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:26:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:26:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:26:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:26:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43811117
Sat 18 Jan 2014 12:26:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:26:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43811117
Sat 18 Jan 2014 12:26:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:26:33 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:26:33 - job_xml_thread(): Done retrieving: data size 43811117
Sat 18 Jan 2014 12:26:33 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:26:33 - XML: Start document: iteration 4
Sat 18 Jan 2014 12:26:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:26:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:26:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:26:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:26:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:26:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:26:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:26:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:26:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:26:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:26:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:26:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:26:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:26:44 - XML: Processed 655148 elements - found 471 jobs
Sat 18 Jan 2014 12:26:44 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:26:44 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:26:44 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:26:44 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:26:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:26:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:26:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:26:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:26:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:26:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:26:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:26:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:26:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:26:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43776255
Sat 18 Jan 2014 12:26:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:26:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43776255
Sat 18 Jan 2014 12:26:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:26:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:26:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:26:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:26:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:26:59 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:26:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:26:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:26:59 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:27:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:27:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:27:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:27:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:27:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:27:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:27:00 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:27:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:27:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 12:27:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 12:27:00 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:27:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8868 values 139807 bits 17475 bytes 
Sat 18 Jan 2014 12:27:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:27:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:27:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:27:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:27:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:27:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:27:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:27:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:27:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:27:05 - job_xml_thread(): Done retrieving: data size 43798017
Sat 18 Jan 2014 12:27:05 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:27:05 - XML: Start document: iteration 5
Sat 18 Jan 2014 12:27:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43798017
Sat 18 Jan 2014 12:27:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:27:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43798017
Sat 18 Jan 2014 12:27:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:27:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:27:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:27:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:27:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:27:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:27:24 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:27:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:27:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:27:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:27:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:27:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:27:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:27:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:27:25 - XML: Processed 655145 elements - found 471 jobs
Sat 18 Jan 2014 12:27:25 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:27:25 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:27:25 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:27:25 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:27:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:27:28 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:27:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:27:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:27:28 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:27:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 12:27:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:27:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:27:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:27:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:27:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:27:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:27:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43813652
Sat 18 Jan 2014 12:27:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:27:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43813652
Sat 18 Jan 2014 12:27:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:27:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:27:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:27:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:27:40 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:27:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:27:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:27:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:27:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:27:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:27:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:27:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:27:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:27:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:27:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:27:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:27:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:27:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:27:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:27:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:27:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:27:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:27:47 - job_xml_thread(): Done retrieving: data size 43809935
Sat 18 Jan 2014 12:27:47 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:27:47 - XML: Start document: iteration 6
Sat 18 Jan 2014 12:27:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43809935
Sat 18 Jan 2014 12:27:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:27:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43809935
Sat 18 Jan 2014 12:27:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:27:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:27:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:27:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:27:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:28:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:28:00 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:28:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:28:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:28:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:28:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:28:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:28:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:28:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:28:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:28:01 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:28:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:28:01 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:28:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 12:28:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 12:28:02 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:28:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8697 values 137102 bits 17137 bytes 
Sat 18 Jan 2014 12:28:08 - XML: Processed 655148 elements - found 471 jobs
Sat 18 Jan 2014 12:28:08 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:28:08 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:28:08 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:28:08 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:28:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:28:11 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:28:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:28:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:28:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:28:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:28:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:28:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:28:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:28:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43789411
Sat 18 Jan 2014 12:28:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:28:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43789411
Sat 18 Jan 2014 12:28:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:28:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:28:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:28:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:28:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:28:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:28:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:28:23 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:28:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:28:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:28:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:28:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:28:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:28:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:28:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:28:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:28:28 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:28:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:28:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:28:28 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:28:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 12:28:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:28:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:28:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:28:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:28:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:28:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:28:30 - job_xml_thread(): Done retrieving: data size 43816245
Sat 18 Jan 2014 12:28:30 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:28:30 - XML: Start document: iteration 7
Sat 18 Jan 2014 12:28:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43816245
Sat 18 Jan 2014 12:28:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:28:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43816245
Sat 18 Jan 2014 12:28:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:28:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:28:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:28:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:28:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:28:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:28:48 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:28:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:28:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:28:49 - XML: Processed 655148 elements - found 471 jobs
Sat 18 Jan 2014 12:28:49 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:28:49 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:28:49 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:28:49 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:28:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:28:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:28:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:28:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:28:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:28:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:28:53 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:28:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:28:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:28:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:28:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:28:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:28:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:28:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:28:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43812836
Sat 18 Jan 2014 12:28:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:28:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43812836
Sat 18 Jan 2014 12:28:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:29:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:29:01 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:29:03 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:29:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 12:29:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:29:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 12:29:03 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:29:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8813 values 138912 bits 17364 bytes 
Sat 18 Jan 2014 12:29:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:29:04 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:29:04 - job_xml_thread(): Done retrieving: data size 43812836
Sat 18 Jan 2014 12:29:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:29:04 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:29:04 - XML: Start document: iteration 8
Sat 18 Jan 2014 12:29:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:29:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:29:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:29:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:29:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:29:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:29:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:29:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:29:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:29:15 - XML: Processed 655148 elements - found 471 jobs
Sat 18 Jan 2014 12:29:15 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:29:16 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:29:16 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:29:16 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:29:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:29:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:29:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:29:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:29:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:29:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:29:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:29:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:29:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:29:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43714892
Sat 18 Jan 2014 12:29:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:29:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43714892
Sat 18 Jan 2014 12:29:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:29:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:29:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:29:27 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 12:29:27 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:29:28 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:29:28 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:29:28 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 12:29:28 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 12:29:28 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 12:29:31 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:29:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:29:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:29:32 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:29:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:29:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:29:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:29:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:29:33 - size of cluster 'LISA Cluster': 624 hosts 79476 metrics 856300 values 13500106 bits 1687513 bytes 
Sat 18 Jan 2014 12:29:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:29:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:29:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:29:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:29:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:29:35 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:29:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:29:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:29:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:29:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:29:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:29:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:29:36 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:29:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 12:29:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:29:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:29:38 - job_xml_thread(): Done retrieving: data size 43271486
Sat 18 Jan 2014 12:29:38 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:29:38 - XML: Start document: iteration 9
Sat 18 Jan 2014 12:29:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43271486
Sat 18 Jan 2014 12:29:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:29:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43271486
Sat 18 Jan 2014 12:29:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:29:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:29:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:29:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:29:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:29:58 - XML: Processed 648722 elements - found 471 jobs
Sat 18 Jan 2014 12:29:58 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:29:58 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:29:58 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:29:58 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:30:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:30:00 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:30:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:30:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:30:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:30:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:30:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:30:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:30:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:30:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:30:02 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:30:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:30:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:30:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:30:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:30:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:30:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:30:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:30:03 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:30:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:30:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 12:30:04 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:30:04 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:30:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 12:30:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5674 values 89419 bits 11177 bytes 
Sat 18 Jan 2014 12:30:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:30:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43142042
Sat 18 Jan 2014 12:30:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:30:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43142042
Sat 18 Jan 2014 12:30:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:30:13 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:30:13 - job_xml_thread(): Done retrieving: data size 43142042
Sat 18 Jan 2014 12:30:13 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:30:13 - XML: Start document: iteration 10
Sat 18 Jan 2014 12:30:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:30:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:30:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:30:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:30:25 - XML: Processed 646946 elements - found 471 jobs
Sat 18 Jan 2014 12:30:25 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:30:25 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:30:25 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:30:25 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:30:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:30:25 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:30:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:30:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:30:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:30:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:30:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:30:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:30:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:30:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:30:28 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:30:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:30:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:30:28 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:30:28 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 12:30:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:30:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:30:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:30:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:30:31 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:30:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 12:30:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:30:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:30:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43240822
Sat 18 Jan 2014 12:30:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:30:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43240822
Sat 18 Jan 2014 12:30:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:30:40 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:30:40 - job_xml_thread(): Done retrieving: data size 43240822
Sat 18 Jan 2014 12:30:40 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:30:40 - XML: Start document: iteration 11
Sat 18 Jan 2014 12:30:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:30:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:30:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:30:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:30:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:30:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:30:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:30:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:30:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:30:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:30:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:30:50 - XML: Processed 647980 elements - found 470 jobs
Sat 18 Jan 2014 12:30:50 - job 7348838 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 12:30:50 - job 7348437 appears to have finished
Sat 18 Jan 2014 12:30:50 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 12:30:50 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 12:30:51 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 12:30:51 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:30:51 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:30:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:30:54 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:30:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:30:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:30:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:30:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:30:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:30:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:30:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:30:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:30:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:30:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43758372
Sat 18 Jan 2014 12:30:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:30:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43758372
Sat 18 Jan 2014 12:30:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:31:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:31:04 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:31:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:31:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:31:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:31:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:31:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:31:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 12:31:05 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:31:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7267 values 114629 bits 14328 bytes 
Sat 18 Jan 2014 12:31:05 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:31:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 12:31:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:31:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:31:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:31:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:31:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43758372
Sat 18 Jan 2014 12:31:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:31:06 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:31:06 - job_xml_thread(): Done retrieving: data size 43758372
Sat 18 Jan 2014 12:31:06 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:31:06 - XML: Start document: iteration 12
Sat 18 Jan 2014 12:31:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:31:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:31:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:31:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:31:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:31:23 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:31:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:31:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:31:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:31:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:31:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:31:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:31:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:31:25 - XML: Processed 654948 elements - found 470 jobs
Sat 18 Jan 2014 12:31:25 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:31:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:31:25 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:31:25 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:31:25 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:31:25 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:31:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:31:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:31:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:31:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:31:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:31:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:31:28 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:31:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 12:31:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:31:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:31:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43811468
Sat 18 Jan 2014 12:31:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:31:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43811468
Sat 18 Jan 2014 12:31:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:31:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:31:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:31:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:31:39 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:31:40 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:31:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:31:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:31:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:31:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:31:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:31:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:31:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:31:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:31:43 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:31:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:31:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:31:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:31:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:31:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:31:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:31:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:31:46 - job_xml_thread(): Done retrieving: data size 43810491
Sat 18 Jan 2014 12:31:46 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:31:46 - XML: Start document: iteration 13
Sat 18 Jan 2014 12:31:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43810491
Sat 18 Jan 2014 12:31:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:31:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43810491
Sat 18 Jan 2014 12:31:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:31:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:31:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:31:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:31:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:32:02 - XML: Processed 655146 elements - found 470 jobs
Sat 18 Jan 2014 12:32:02 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:32:02 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:32:02 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:32:02 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:32:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:32:06 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:32:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:32:08 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:32:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 12:32:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 12:32:08 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:32:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6314 values 99825 bits 12478 bytes 
Sat 18 Jan 2014 12:32:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:32:10 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:32:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:32:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:32:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:32:10 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:32:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:32:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:32:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:32:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:32:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:32:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:32:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:32:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:32:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:32:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:32:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:32:16 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:32:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 12:32:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:32:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:32:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43818379
Sat 18 Jan 2014 12:32:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:32:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43818379
Sat 18 Jan 2014 12:32:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:32:17 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:32:19 - job_xml_thread(): Done retrieving: data size 43818379
Sat 18 Jan 2014 12:32:19 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:32:19 - XML: Start document: iteration 14
Sat 18 Jan 2014 12:32:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:32:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:32:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:32:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:32:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:32:30 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:32:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:32:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:32:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:32:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:32:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:32:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:32:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:32:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:32:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:32:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:32:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:32:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:32:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:32:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:32:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:32:38 - XML: Processed 655144 elements - found 469 jobs
Sat 18 Jan 2014 12:32:38 - job 7348597 appears to have finished
Sat 18 Jan 2014 12:32:38 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 12:32:38 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 12:32:38 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 12:32:38 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:32:38 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:32:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:32:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43798028
Sat 18 Jan 2014 12:32:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:32:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43798028
Sat 18 Jan 2014 12:32:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:32:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:32:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:32:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:32:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:32:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:32:53 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:32:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:32:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:32:54 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:32:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:32:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:32:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:32:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:32:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:32:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:32:56 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:32:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:32:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:32:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:32:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:32:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:32:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:32:58 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 12:32:58 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 12:32:58 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:32:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:32:59 - job_xml_thread(): Done retrieving: data size 43820815
Sat 18 Jan 2014 12:32:59 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:32:59 - XML: Start document: iteration 15
Sat 18 Jan 2014 12:32:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43820815
Sat 18 Jan 2014 12:32:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:32:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43820815
Sat 18 Jan 2014 12:33:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:33:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:33:08 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:33:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:33:09 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:33:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 12:33:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 12:33:09 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:33:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:33:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9279 values 146739 bits 18342 bytes 
Sat 18 Jan 2014 12:33:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:33:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:33:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:33:17 - XML: Processed 655144 elements - found 469 jobs
Sat 18 Jan 2014 12:33:17 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:33:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:33:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:33:17 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:33:17 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:33:17 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:33:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:33:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:33:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:33:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:33:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:33:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:33:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:33:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:33:23 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:33:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:33:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:33:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:33:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:33:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:33:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:33:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:33:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43805662
Sat 18 Jan 2014 12:33:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:33:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43805662
Sat 18 Jan 2014 12:33:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:33:32 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:33:32 - job_xml_thread(): Done retrieving: data size 43805662
Sat 18 Jan 2014 12:33:32 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:33:32 - XML: Start document: iteration 16
Sat 18 Jan 2014 12:33:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:33:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:33:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:33:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:33:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:33:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:33:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:33:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:33:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:33:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:33:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:33:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:33:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:33:43 - XML: Processed 655144 elements - found 469 jobs
Sat 18 Jan 2014 12:33:43 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:33:43 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:33:43 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:33:43 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:33:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:33:46 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:33:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:33:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:33:47 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:33:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 12:33:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:33:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:33:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:33:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:33:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:33:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:33:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43773723
Sat 18 Jan 2014 12:33:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:33:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43773723
Sat 18 Jan 2014 12:33:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:33:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:33:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:33:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:33:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:33:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:33:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:33:58 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:33:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:33:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:33:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:33:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:33:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:34:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:34:01 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:34:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:34:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:34:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:34:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:34:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:34:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:34:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:34:03 - job_xml_thread(): Done retrieving: data size 43790081
Sat 18 Jan 2014 12:34:03 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:34:03 - XML: Start document: iteration 17
Sat 18 Jan 2014 12:34:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43790081
Sat 18 Jan 2014 12:34:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:34:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43790081
Sat 18 Jan 2014 12:34:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:34:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:34:09 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:34:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:34:11 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:34:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 12:34:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 12:34:11 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:34:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8945 values 141191 bits 17648 bytes 
Sat 18 Jan 2014 12:34:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:34:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:34:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:34:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:34:18 - XML: Processed 655144 elements - found 469 jobs
Sat 18 Jan 2014 12:34:18 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:34:18 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:34:18 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:34:18 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:34:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:34:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:34:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:34:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:34:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:34:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:34:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:34:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:34:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:34:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:34:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:34:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:34:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:34:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:34:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:34:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:34:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:34:28 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:34:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 12:34:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:34:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:34:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43810941
Sat 18 Jan 2014 12:34:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:34:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43810941
Sat 18 Jan 2014 12:34:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:34:33 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:34:33 - job_xml_thread(): Done retrieving: data size 43810941
Sat 18 Jan 2014 12:34:33 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:34:33 - XML: Start document: iteration 18
Sat 18 Jan 2014 12:34:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:34:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:34:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:34:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:34:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:34:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:34:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:34:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:34:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:34:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:34:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:34:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:34:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:34:49 - XML: Processed 655144 elements - found 469 jobs
Sat 18 Jan 2014 12:34:49 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:34:49 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:34:49 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:34:49 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:34:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:34:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:34:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:34:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:34:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:34:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:34:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:34:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:34:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:34:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43772505
Sat 18 Jan 2014 12:34:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:34:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43772505
Sat 18 Jan 2014 12:34:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:34:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:34:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:35:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:35:03 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:35:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:35:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:35:04 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:35:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:35:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:35:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:35:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:35:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:35:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:35:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:35:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:35:07 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:35:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:35:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:35:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:35:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:35:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:35:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:35:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:35:09 - job_xml_thread(): Done retrieving: data size 43744603
Sat 18 Jan 2014 12:35:09 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:35:09 - XML: Start document: iteration 19
Sat 18 Jan 2014 12:35:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43744603
Sat 18 Jan 2014 12:35:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:35:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43744603
Sat 18 Jan 2014 12:35:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:35:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:35:12 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:35:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:35:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 12:35:12 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:35:12 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:35:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sat 18 Jan 2014 12:35:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:35:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:35:21 - XML: Processed 654396 elements - found 469 jobs
Sat 18 Jan 2014 12:35:21 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:35:21 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:35:21 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:35:22 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:35:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:35:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:35:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:35:25 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:35:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:35:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:35:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:35:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:35:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:35:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:35:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:35:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:35:29 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:35:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:35:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:35:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:35:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:35:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:35:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:35:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:35:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43390391
Sat 18 Jan 2014 12:35:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:35:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43390391
Sat 18 Jan 2014 12:35:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:35:37 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:35:37 - job_xml_thread(): Done retrieving: data size 43390391
Sat 18 Jan 2014 12:35:37 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:35:38 - XML: Start document: iteration 20
Sat 18 Jan 2014 12:35:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:35:39 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:35:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:35:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:35:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:35:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:35:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:35:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:35:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:35:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:35:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:35:50 - XML: Processed 649976 elements - found 469 jobs
Sat 18 Jan 2014 12:35:50 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:35:50 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:35:50 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:35:51 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:35:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:35:53 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:35:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:35:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:35:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:35:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:35:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:35:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:35:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:35:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43151888
Sat 18 Jan 2014 12:35:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:35:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43151888
Sat 18 Jan 2014 12:35:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:35:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:35:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:36:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:36:03 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:36:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:36:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:36:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:36:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:36:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:36:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:36:06 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:36:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:36:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:36:07 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:36:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:36:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:36:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:36:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:36:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:36:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:36:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:36:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43161389
Sat 18 Jan 2014 12:36:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:36:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43161389
Sat 18 Jan 2014 12:36:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:36:10 - job_xml_thread(): Done retrieving: data size 43161389
Sat 18 Jan 2014 12:36:11 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:36:12 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 12:36:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:36:13 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:36:14 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:36:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 12:36:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:36:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 12:36:14 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:36:16 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 12:36:16 - Housekeeping: done.
Sat 18 Jan 2014 12:36:16 - XML: Start document: iteration 0
Sat 18 Jan 2014 12:36:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 18840 values 297197 bits 37149 bytes 
Sat 18 Jan 2014 12:36:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:36:20 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:36:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:36:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:36:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:36:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:36:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:36:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:36:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:36:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:36:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:36:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:36:28 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:36:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:36:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:36:28 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 12:36:28 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:36:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:36:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:36:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:36:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:36:29 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:36:29 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 12:36:29 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:36:29 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 12:36:30 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 12:36:31 - XML: Processed 647016 elements - found 468 jobs
Sat 18 Jan 2014 12:36:31 - job 7346010 appears to have finished
Sat 18 Jan 2014 12:36:31 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 12:36:31 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 12:36:32 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 12:36:32 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:36:32 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 912464 values 14402089 bits 1800261 bytes 
Sat 18 Jan 2014 12:36:32 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:36:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:36:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:36:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:36:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43615985
Sat 18 Jan 2014 12:36:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:36:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43615985
Sat 18 Jan 2014 12:36:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:36:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:36:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:36:47 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:36:47 - job_xml_thread(): Done retrieving: data size 43615985
Sat 18 Jan 2014 12:36:47 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:36:47 - XML: Start document: iteration 1
Sat 18 Jan 2014 12:36:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:36:51 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:36:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:36:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:36:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:36:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:36:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:36:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:36:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:36:58 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:36:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 12:36:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:37:01 - XML: Processed 653330 elements - found 468 jobs
Sat 18 Jan 2014 12:37:01 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:37:01 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:37:01 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:37:01 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:37:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:37:02 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:37:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:37:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:37:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:37:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:37:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:37:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:37:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:37:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43771834
Sat 18 Jan 2014 12:37:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:37:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43771834
Sat 18 Jan 2014 12:37:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:37:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:37:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:37:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:37:14 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:37:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:37:14 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:37:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:37:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:37:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:37:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:37:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43771834
Sat 18 Jan 2014 12:37:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:37:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:37:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:37:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:37:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 12:37:15 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:37:15 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:37:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 12:37:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5951 values 93919 bits 11739 bytes 
Sat 18 Jan 2014 12:37:17 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:37:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:37:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:37:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:37:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:37:21 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:37:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:37:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:37:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:37:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:37:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:37:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:37:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:37:25 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:37:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:37:29 - job_xml_thread(): Done retrieving: data size 43783675
Sat 18 Jan 2014 12:37:29 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:37:29 - XML: Start document: iteration 2
Sat 18 Jan 2014 12:37:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:37:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:37:30 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:37:30 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 12:37:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43783675
Sat 18 Jan 2014 12:37:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:37:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:37:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:37:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:37:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43783675
Sat 18 Jan 2014 12:37:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:37:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:37:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:37:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:37:45 - XML: Processed 655142 elements - found 468 jobs
Sat 18 Jan 2014 12:37:45 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:37:46 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:37:46 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:37:46 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:37:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:37:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:37:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:37:51 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:37:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:37:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:37:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:37:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:37:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:37:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:37:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:37:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:37:54 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:37:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:37:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:37:54 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:37:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 12:37:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:37:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:37:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:37:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:37:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:37:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:37:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43814202
Sat 18 Jan 2014 12:37:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:37:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43814202
Sat 18 Jan 2014 12:37:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:38:01 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:38:01 - job_xml_thread(): Done retrieving: data size 43814202
Sat 18 Jan 2014 12:38:01 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:38:01 - XML: Start document: iteration 3
Sat 18 Jan 2014 12:38:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:38:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:38:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:38:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:38:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:38:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:38:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:38:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:38:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:38:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:38:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:38:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:38:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:38:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:38:15 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:38:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:38:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 12:38:15 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:38:15 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:38:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 12:38:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5998 values 94648 bits 11831 bytes 
Sat 18 Jan 2014 12:38:17 - XML: Processed 655142 elements - found 468 jobs
Sat 18 Jan 2014 12:38:17 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:38:17 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:38:17 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:38:17 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:38:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:38:19 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:38:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:38:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:38:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:38:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:38:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:38:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:38:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:38:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43770368
Sat 18 Jan 2014 12:38:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:38:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43770368
Sat 18 Jan 2014 12:38:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:38:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:38:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:38:32 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:38:32 - job_xml_thread(): Done retrieving: data size 43770368
Sat 18 Jan 2014 12:38:32 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:38:32 - XML: Start document: iteration 4
Sat 18 Jan 2014 12:38:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:38:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:38:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:38:39 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:38:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:38:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:38:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:38:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:38:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:38:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:38:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:38:45 - XML: Processed 655142 elements - found 468 jobs
Sat 18 Jan 2014 12:38:45 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:38:45 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:38:45 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:38:45 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:38:45 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:38:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 12:38:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:38:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:38:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:38:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:38:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:38:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:38:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:38:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:38:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:38:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:38:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43809590
Sat 18 Jan 2014 12:38:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43809590
Sat 18 Jan 2014 12:38:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:38:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:38:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:38:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:39:00 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:39:00 - job_xml_thread(): Done retrieving: data size 43809590
Sat 18 Jan 2014 12:39:00 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:39:00 - XML: Start document: iteration 5
Sat 18 Jan 2014 12:39:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:39:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:39:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:39:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:39:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:39:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:39:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:39:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:39:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:39:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:39:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:39:10 - XML: Processed 655142 elements - found 468 jobs
Sat 18 Jan 2014 12:39:10 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:39:10 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:39:10 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:39:10 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:39:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:39:12 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:39:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:39:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:39:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:39:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:39:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:39:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:39:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:39:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43778502
Sat 18 Jan 2014 12:39:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:39:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43778502
Sat 18 Jan 2014 12:39:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:39:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:39:15 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:39:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:39:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 12:39:16 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:39:16 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:39:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 12:39:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:39:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9143 values 144183 bits 18022 bytes 
Sat 18 Jan 2014 12:39:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:39:25 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:39:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:39:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:39:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:39:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:39:29 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:39:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:39:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:39:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:39:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:39:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:39:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:39:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:39:33 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:39:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:39:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:39:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:39:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:39:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:39:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:39:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:39:36 - job_xml_thread(): Done retrieving: data size 43789502
Sat 18 Jan 2014 12:39:36 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:39:36 - XML: Start document: iteration 6
Sat 18 Jan 2014 12:39:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43789502
Sat 18 Jan 2014 12:39:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:39:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43789502
Sat 18 Jan 2014 12:39:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:39:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:39:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:39:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:39:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:39:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:39:52 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:39:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:39:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:39:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:39:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:39:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:39:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:39:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:39:55 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:39:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 12:39:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:39:56 - XML: Processed 655135 elements - found 468 jobs
Sat 18 Jan 2014 12:39:56 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:39:56 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:39:56 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:39:56 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:40:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:40:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:40:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:40:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:40:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:40:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:40:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:40:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:40:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:40:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43789675
Sat 18 Jan 2014 12:40:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:40:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43789675
Sat 18 Jan 2014 12:40:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:40:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:40:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:40:11 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:40:11 - job_xml_thread(): Done retrieving: data size 43789675
Sat 18 Jan 2014 12:40:11 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:40:11 - XML: Start document: iteration 7
Sat 18 Jan 2014 12:40:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:40:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:40:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:40:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:40:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:40:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:40:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:40:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:40:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:40:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:40:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:40:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:40:17 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:40:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:40:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 12:40:18 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:40:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5982 values 94329 bits 11791 bytes 
Sat 18 Jan 2014 12:40:18 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:40:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 12:40:25 - XML: Processed 655142 elements - found 468 jobs
Sat 18 Jan 2014 12:40:25 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:40:25 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:40:25 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:40:25 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:40:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:40:27 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:40:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:40:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:40:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:40:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:40:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:40:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:40:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:40:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43775275
Sat 18 Jan 2014 12:40:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:40:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43775275
Sat 18 Jan 2014 12:40:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:40:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:40:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:40:40 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:40:40 - job_xml_thread(): Done retrieving: data size 43775275
Sat 18 Jan 2014 12:40:40 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:40:40 - XML: Start document: iteration 8
Sat 18 Jan 2014 12:40:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:40:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:40:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:40:50 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:40:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:40:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:40:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:40:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:40:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:40:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:40:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:40:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:40:56 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:40:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:40:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:40:56 - XML: Processed 655142 elements - found 468 jobs
Sat 18 Jan 2014 12:40:56 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:40:56 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:40:56 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:40:56 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:40:56 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:40:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 12:40:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:40:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:40:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:40:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:40:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:40:58 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 12:40:58 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 12:40:58 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:40:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:40:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43789154
Sat 18 Jan 2014 12:40:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:40:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43789154
Sat 18 Jan 2014 12:40:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:41:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:41:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:41:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:41:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:41:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:41:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:41:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:41:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:41:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:41:11 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:41:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:41:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:41:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:41:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:41:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:41:12 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:41:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:41:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:41:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:41:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:41:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:41:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:41:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:41:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43737781
Sat 18 Jan 2014 12:41:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:41:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43737781
Sat 18 Jan 2014 12:41:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:41:14 - job_xml_thread(): Done retrieving: data size 43737781
Sat 18 Jan 2014 12:41:14 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:41:15 - XML: Start document: iteration 9
Sat 18 Jan 2014 12:41:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:41:18 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:41:19 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:41:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:41:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 12:41:19 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:41:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 12:41:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9034 values 142452 bits 17806 bytes 
Sat 18 Jan 2014 12:41:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:41:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:41:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:41:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:41:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:41:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:41:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:41:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:41:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:41:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:41:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:41:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:41:37 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:41:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:41:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:41:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:41:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:41:37 - XML: Processed 654394 elements - found 468 jobs
Sat 18 Jan 2014 12:41:37 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:41:37 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:41:37 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:41:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:41:37 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:41:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:41:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:41:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:41:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:41:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43236220
Sat 18 Jan 2014 12:41:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:41:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43236220
Sat 18 Jan 2014 12:41:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:41:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:41:50 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:41:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:41:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:41:53 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:41:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:41:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:41:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:41:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:41:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:41:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:41:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:41:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:41:54 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:41:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:41:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:41:54 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:41:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 12:41:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:41:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:41:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:41:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:41:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:41:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:41:55 - job_xml_thread(): Done retrieving: data size 43157339
Sat 18 Jan 2014 12:41:55 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:41:55 - XML: Start document: iteration 10
Sat 18 Jan 2014 12:41:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43157339
Sat 18 Jan 2014 12:41:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:41:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43157339
Sat 18 Jan 2014 12:41:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:42:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:42:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:42:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:42:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:42:11 - XML: Processed 647026 elements - found 468 jobs
Sat 18 Jan 2014 12:42:11 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:42:11 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:42:11 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:42:11 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:42:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:42:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:42:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:42:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:42:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:42:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:42:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:42:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:42:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:42:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:42:16 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:42:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:42:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:42:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:42:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:42:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:42:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:42:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:42:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43220938
Sat 18 Jan 2014 12:42:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:42:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43220938
Sat 18 Jan 2014 12:42:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:42:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:42:19 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:42:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:42:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 12:42:22 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:42:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 12:42:22 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:42:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8791 values 138603 bits 17325 bytes 
Sat 18 Jan 2014 12:42:26 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:42:26 - job_xml_thread(): Done retrieving: data size 43220938
Sat 18 Jan 2014 12:42:26 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:42:26 - XML: Start document: iteration 11
Sat 18 Jan 2014 12:42:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:42:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:42:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:42:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:42:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:42:32 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:42:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:42:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:42:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:42:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:42:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:42:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:42:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:42:40 - XML: Processed 647668 elements - found 467 jobs
Sat 18 Jan 2014 12:42:40 - job 7348855 appears to have finished
Sat 18 Jan 2014 12:42:40 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 12:42:40 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 12:42:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:42:41 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 12:42:41 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:42:41 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:42:41 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:42:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:42:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:42:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:42:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:42:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:42:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:42:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:42:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43686513
Sat 18 Jan 2014 12:42:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:42:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43686513
Sat 18 Jan 2014 12:42:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:42:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:42:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:42:56 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:42:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:42:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:42:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:42:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:42:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:42:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:42:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:42:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:42:59 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:42:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:42:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:42:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:42:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:42:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:42:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:42:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:42:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:42:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:42:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:43:00 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:43:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 12:43:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:43:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:43:01 - job_xml_thread(): Done retrieving: data size 43803988
Sat 18 Jan 2014 12:43:01 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:43:01 - XML: Start document: iteration 12
Sat 18 Jan 2014 12:43:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43803988
Sat 18 Jan 2014 12:43:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43803988
Sat 18 Jan 2014 12:43:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:43:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:43:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:43:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:43:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:43:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:43:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:43:19 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:43:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:43:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:43:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:43:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:43:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:43:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:43:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:43:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:43:22 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:43:22 - XML: Processed 655048 elements - found 487 jobs
Sat 18 Jan 2014 12:43:23 - job_xml_thread(): Found 20 updated jobs.
Sat 18 Jan 2014 12:43:23 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 12:43:23 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:43:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:43:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 12:43:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 12:43:23 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:43:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5610 values 88451 bits 11056 bytes 
Sat 18 Jan 2014 12:43:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:43:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:43:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:43:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:43:24 - job_xml_thread(): Done storing. succesfully stored: 20 jobs
Sat 18 Jan 2014 12:43:24 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:43:24 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:43:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:43:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:43:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:43:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:43:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:43:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43793161
Sat 18 Jan 2014 12:43:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:43:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43793161
Sat 18 Jan 2014 12:43:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:43:30 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 12:43:31 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:43:32 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:43:32 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:43:32 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 12:43:32 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 12:43:32 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 12:43:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:43:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sat 18 Jan 2014 12:43:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:43:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:43:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:43:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:43:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:43:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:43:40 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:43:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:43:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:43:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:43:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:43:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:43:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:43:42 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:43:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:43:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:43:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:43:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:43:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:43:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:43:43 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:43:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 12:43:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:43:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:43:44 - job_xml_thread(): Done retrieving: data size 43812248
Sat 18 Jan 2014 12:43:44 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:43:44 - XML: Start document: iteration 13
Sat 18 Jan 2014 12:43:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43812248
Sat 18 Jan 2014 12:43:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:43:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43812248
Sat 18 Jan 2014 12:43:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:43:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:43:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:43:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:43:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:44:01 - XML: Processed 655180 elements - found 487 jobs
Sat 18 Jan 2014 12:44:01 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:44:01 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:44:01 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:44:01 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:44:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:44:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:44:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:44:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:44:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:44:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:44:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:44:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:44:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:44:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:44:05 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:44:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:44:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:44:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:44:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:44:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:44:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:44:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:44:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43814620
Sat 18 Jan 2014 12:44:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:44:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43814620
Sat 18 Jan 2014 12:44:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:44:16 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:44:16 - job_xml_thread(): Done retrieving: data size 43814620
Sat 18 Jan 2014 12:44:16 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:44:17 - XML: Start document: iteration 14
Sat 18 Jan 2014 12:44:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:44:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:44:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:44:19 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:44:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:44:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:44:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:44:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:44:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:44:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:44:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:44:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:44:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:44:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:44:23 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:44:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:44:26 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:44:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 12:44:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 12:44:26 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:44:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8542 values 134637 bits 16829 bytes 
Sat 18 Jan 2014 12:44:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:44:27 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:44:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:44:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:44:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:44:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:44:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:44:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:44:29 - XML: Processed 655179 elements - found 487 jobs
Sat 18 Jan 2014 12:44:29 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:44:29 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:44:29 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:44:29 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:44:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:44:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43800509
Sat 18 Jan 2014 12:44:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:44:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43800509
Sat 18 Jan 2014 12:44:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:44:32 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:44:32 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:44:33 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:44:33 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 12:44:33 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:44:33 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 12:44:33 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 12:44:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:44:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:44:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:44:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:44:45 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:44:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:44:45 - size of cluster 'LISA Cluster': 624 hosts 79474 metrics 882523 values 13912063 bits 1739007 bytes 
Sat 18 Jan 2014 12:44:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:44:46 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:44:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:44:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:44:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:44:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:44:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:44:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:44:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:44:48 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:44:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:44:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:44:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:44:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:44:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:44:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:44:50 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:44:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 12:44:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:44:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:44:52 - job_xml_thread(): Done retrieving: data size 43820114
Sat 18 Jan 2014 12:44:52 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:44:52 - XML: Start document: iteration 15
Sat 18 Jan 2014 12:44:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43820114
Sat 18 Jan 2014 12:44:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:44:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43820114
Sat 18 Jan 2014 12:44:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:45:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:45:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:45:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:45:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:45:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:45:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:45:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:45:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:45:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:45:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:45:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:45:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:45:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:45:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:45:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:45:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:45:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:45:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:45:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:45:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:45:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:45:15 - XML: Processed 655180 elements - found 487 jobs
Sat 18 Jan 2014 12:45:15 - job 7348874 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 12:45:15 - job 7348869 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 12:45:15 - job 7348868 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 12:45:15 - job 7348863 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 12:45:15 - job 7348862 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 12:45:15 - job 7348861 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 12:45:15 - job 7348860 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 12:45:15 - job 7348867 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 12:45:15 - job 7348866 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 12:45:15 - job 7348865 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 12:45:15 - job 7348864 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 12:45:15 - job 7348870 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 12:45:15 - job 7348871 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 12:45:15 - job 7348872 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 12:45:15 - job 7348873 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 12:45:15 - job 7348875 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 12:45:15 - job 7348876 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 12:45:15 - job 7348877 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 12:45:15 - job 7348858 report time 1390045305 does not match current heartbeat 1390045426 : ignoring job
Sat 18 Jan 2014 12:45:15 - job 7348859 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 12:45:15 - job_xml_thread(): Found 19 updated jobs.
Sat 18 Jan 2014 12:45:15 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 12:45:15 - job_xml_thread(): Done storing. succesfully stored: 19 jobs
Sat 18 Jan 2014 12:45:15 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:45:15 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:45:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:45:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43805203
Sat 18 Jan 2014 12:45:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:45:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43805203
Sat 18 Jan 2014 12:45:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:45:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:45:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:45:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:45:26 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:45:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:45:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 12:45:27 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:45:27 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:45:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 12:45:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8662 values 136562 bits 17070 bytes 
Sat 18 Jan 2014 12:45:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:45:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:45:30 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:45:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:45:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:45:31 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:45:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:45:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:45:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:45:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:45:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:45:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:45:33 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:45:33 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 12:45:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:45:34 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:45:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:45:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:45:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:45:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:45:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:45:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:45:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:45:37 - job_xml_thread(): Done retrieving: data size 43812875
Sat 18 Jan 2014 12:45:37 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:45:37 - XML: Start document: iteration 16
Sat 18 Jan 2014 12:45:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43812875
Sat 18 Jan 2014 12:45:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43812875
Sat 18 Jan 2014 12:45:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:45:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:45:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:45:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:45:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:45:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:45:57 - XML: Processed 655180 elements - found 487 jobs
Sat 18 Jan 2014 12:45:57 - job 7348858 report time 1390045305 does not match current heartbeat 1390045426 : ignoring job
Sat 18 Jan 2014 12:45:57 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:45:57 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:45:57 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:45:57 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:45:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:45:58 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:45:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:45:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:45:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:45:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:45:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:45:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:45:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:45:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:45:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:45:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:45:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:45:59 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:45:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 12:45:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:46:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:46:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:46:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:46:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:46:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:46:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43832365
Sat 18 Jan 2014 12:46:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:46:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43832365
Sat 18 Jan 2014 12:46:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:46:12 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:46:12 - job_xml_thread(): Done retrieving: data size 43832365
Sat 18 Jan 2014 12:46:12 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:46:12 - XML: Start document: iteration 17
Sat 18 Jan 2014 12:46:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:46:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:46:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:46:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:46:15 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:46:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:46:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:46:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:46:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:46:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:46:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:46:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:46:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:46:26 - XML: Processed 655180 elements - found 487 jobs
Sat 18 Jan 2014 12:46:26 - job 7348858 report time 1390045305 does not match current heartbeat 1390045426 : ignoring job
Sat 18 Jan 2014 12:46:26 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:46:26 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:46:26 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:46:26 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:46:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:46:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:46:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:46:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:46:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:46:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:46:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:46:27 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:46:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:46:28 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:46:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 12:46:28 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:46:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 12:46:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5901 values 93043 bits 11630 bytes 
Sat 18 Jan 2014 12:46:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:46:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43782895
Sat 18 Jan 2014 12:46:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:46:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43782895
Sat 18 Jan 2014 12:46:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:46:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:46:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:46:41 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:46:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:46:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:46:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:46:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:46:42 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:46:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:46:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:46:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:46:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:46:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:46:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:46:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:46:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:46:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:46:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:46:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:46:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:46:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:46:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:46:49 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:46:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 12:46:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:46:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:46:49 - job_xml_thread(): Done retrieving: data size 43822190
Sat 18 Jan 2014 12:46:49 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:46:49 - XML: Start document: iteration 18
Sat 18 Jan 2014 12:46:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43822190
Sat 18 Jan 2014 12:46:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:46:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43822190
Sat 18 Jan 2014 12:46:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:46:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:46:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:47:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:47:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:47:07 - XML: Processed 655184 elements - found 489 jobs
Sat 18 Jan 2014 12:47:07 - job_xml_thread(): Found 3 updated jobs.
Sat 18 Jan 2014 12:47:07 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 12:47:08 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Sat 18 Jan 2014 12:47:08 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:47:08 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:47:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:47:10 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:47:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:47:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:47:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:47:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:47:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:47:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:47:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:47:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:47:13 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:47:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:47:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:47:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:47:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:47:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:47:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:47:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:47:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43758394
Sat 18 Jan 2014 12:47:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:47:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43758394
Sat 18 Jan 2014 12:47:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:47:23 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:47:23 - job_xml_thread(): Done retrieving: data size 43758394
Sat 18 Jan 2014 12:47:23 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:47:23 - XML: Start document: iteration 19
Sat 18 Jan 2014 12:47:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:47:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:47:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:47:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:47:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:47:29 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:47:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:47:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 12:47:30 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:47:30 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:47:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 12:47:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6714 values 106272 bits 13284 bytes 
Sat 18 Jan 2014 12:47:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:47:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:47:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:47:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:47:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:47:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:47:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:47:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:47:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:47:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:47:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:47:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:47:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:47:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:47:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:47:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:47:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:47:39 - XML: Processed 654436 elements - found 489 jobs
Sat 18 Jan 2014 12:47:39 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:47:39 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:47:39 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:47:39 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:47:42 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 12:47:42 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 12:47:42 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:47:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:47:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43218881
Sat 18 Jan 2014 12:47:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:47:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43218881
Sat 18 Jan 2014 12:47:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:47:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:47:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:47:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:47:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:47:54 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:47:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:47:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:47:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:47:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:47:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:47:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:47:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:47:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:47:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:47:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:47:59 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:47:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:47:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:47:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:47:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:47:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:47:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:47:59 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:47:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 12:47:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:48:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:48:01 - job_xml_thread(): Done retrieving: data size 43149181
Sat 18 Jan 2014 12:48:01 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:48:01 - XML: Start document: iteration 20
Sat 18 Jan 2014 12:48:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43149181
Sat 18 Jan 2014 12:48:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:48:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43149181
Sat 18 Jan 2014 12:48:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:48:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:48:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:48:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:48:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:48:17 - XML: Processed 646984 elements - found 489 jobs
Sat 18 Jan 2014 12:48:17 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:48:17 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:48:17 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:48:17 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:48:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:48:19 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:48:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:48:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:48:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:48:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:48:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:48:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:48:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:48:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:48:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:48:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:48:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:48:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:48:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:48:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:48:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:48:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:48:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43202835
Sat 18 Jan 2014 12:48:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:48:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43202835
Sat 18 Jan 2014 12:48:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:48:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:48:30 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:48:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:48:32 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:48:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 12:48:33 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:48:33 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:48:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 12:48:33 - job_xml_thread(): Done retrieving: data size 43202835
Sat 18 Jan 2014 12:48:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8820 values 139433 bits 17429 bytes 
Sat 18 Jan 2014 12:48:33 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:48:33 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 12:48:34 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 12:48:34 - Housekeeping: done.
Sat 18 Jan 2014 12:48:34 - XML: Start document: iteration 0
Sat 18 Jan 2014 12:48:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:48:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:48:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:48:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:48:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:48:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:48:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:48:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:48:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:48:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:48:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:48:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:48:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:48:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:48:49 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:48:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:48:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:48:49 - XML: Processed 647732 elements - found 489 jobs
Sat 18 Jan 2014 12:48:49 - job 7348881 report time 1390045546 does not match current heartbeat 1390045667 : ignoring job
Sat 18 Jan 2014 12:48:49 - job 7348882 report time 1390045546 does not match current heartbeat 1390045667 : ignoring job
Sat 18 Jan 2014 12:48:49 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:48:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:48:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:48:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:48:49 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:48:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:48:49 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:48:49 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:48:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:48:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43734711
Sat 18 Jan 2014 12:48:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:48:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43734711
Sat 18 Jan 2014 12:48:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:48:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:48:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:49:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:49:02 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:49:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:49:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:49:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:49:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:49:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:49:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:49:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:49:04 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:49:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:49:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:49:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:49:07 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:49:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:49:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:49:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:49:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:49:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:49:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:49:08 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:49:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 12:49:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:49:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:49:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43791478
Sat 18 Jan 2014 12:49:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:49:10 - job_xml_thread(): Done retrieving: data size 43791478
Sat 18 Jan 2014 12:49:10 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:49:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43791478
Sat 18 Jan 2014 12:49:10 - XML: Start document: iteration 1
Sat 18 Jan 2014 12:49:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:49:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:49:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:49:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:49:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:49:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:49:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:49:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:49:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:49:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:49:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:49:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:49:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:49:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:49:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:49:29 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:49:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:49:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:49:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:49:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:49:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:49:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:49:32 - XML: Processed 655181 elements - found 489 jobs
Sat 18 Jan 2014 12:49:32 - job 7348881 report time 1390045546 does not match current heartbeat 1390045667 : ignoring job
Sat 18 Jan 2014 12:49:32 - job 7348882 report time 1390045546 does not match current heartbeat 1390045667 : ignoring job
Sat 18 Jan 2014 12:49:32 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:49:32 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:49:32 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:49:32 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:49:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:49:33 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:49:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:49:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 12:49:33 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:49:33 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:49:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 12:49:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5847 values 92294 bits 11536 bytes 
Sat 18 Jan 2014 12:49:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:49:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43801143
Sat 18 Jan 2014 12:49:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:49:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43801143
Sat 18 Jan 2014 12:49:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:49:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:49:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:49:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:49:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:49:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:49:47 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:49:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:49:47 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:49:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:49:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:49:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:49:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:49:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:49:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:49:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:49:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:49:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:49:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:49:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:49:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:49:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:49:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:49:52 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:49:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 12:49:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:49:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:49:53 - job_xml_thread(): Done retrieving: data size 43803047
Sat 18 Jan 2014 12:49:53 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:49:53 - XML: Start document: iteration 2
Sat 18 Jan 2014 12:49:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43803047
Sat 18 Jan 2014 12:49:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43803047
Sat 18 Jan 2014 12:49:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:49:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:50:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:50:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:50:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:50:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:50:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:50:13 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:50:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:50:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:50:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:50:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:50:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:50:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:50:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:50:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:50:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:50:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:50:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:50:16 - XML: Processed 655184 elements - found 489 jobs
Sat 18 Jan 2014 12:50:16 - job 7348881 report time 1390045546 does not match current heartbeat 1390045667 : ignoring job
Sat 18 Jan 2014 12:50:16 - job 7348882 report time 1390045546 does not match current heartbeat 1390045667 : ignoring job
Sat 18 Jan 2014 12:50:16 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:50:16 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:50:16 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:50:16 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:50:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:50:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:50:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:50:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:50:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:50:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43832857
Sat 18 Jan 2014 12:50:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:50:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43832857
Sat 18 Jan 2014 12:50:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:50:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:50:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:50:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:50:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:50:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:50:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:50:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:50:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:50:31 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:50:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:50:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:50:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:50:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:50:31 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:50:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:50:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:50:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:50:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:50:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:50:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:50:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:50:33 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:50:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:50:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43835252
Sat 18 Jan 2014 12:50:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:50:34 - job_xml_thread(): Done retrieving: data size 43835252
Sat 18 Jan 2014 12:50:34 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:50:34 - XML: Start document: iteration 3
Sat 18 Jan 2014 12:50:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43835252
Sat 18 Jan 2014 12:50:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:50:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:50:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 12:50:35 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:50:35 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:50:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sat 18 Jan 2014 12:50:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:50:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:50:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:50:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:50:50 - XML: Processed 655178 elements - found 486 jobs
Sat 18 Jan 2014 12:50:50 - job 7348880 appears to have finished
Sat 18 Jan 2014 12:50:50 - job 7335214 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 12:50:50 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 12:50:50 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 12:50:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:50:52 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:50:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:50:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:50:53 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 12:50:53 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:50:53 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:50:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:50:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:50:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:50:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:50:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:50:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:50:56 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:50:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:50:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:50:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:50:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:50:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:50:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:50:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:50:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43811743
Sat 18 Jan 2014 12:50:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:50:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43811743
Sat 18 Jan 2014 12:50:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:51:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:51:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:51:08 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:51:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:51:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:51:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:51:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:51:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:51:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:51:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:51:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:51:11 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:51:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:51:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:51:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:51:12 - job_xml_thread(): Done retrieving: data size 43808342
Sat 18 Jan 2014 12:51:12 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:51:12 - XML: Start document: iteration 4
Sat 18 Jan 2014 12:51:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43808342
Sat 18 Jan 2014 12:51:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:51:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:51:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:51:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:51:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:51:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43808342
Sat 18 Jan 2014 12:51:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:51:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:51:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:51:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:51:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:51:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:51:29 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:51:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:51:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:51:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:51:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:51:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:51:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:51:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:51:31 - XML: Processed 655178 elements - found 486 jobs
Sat 18 Jan 2014 12:51:32 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:51:32 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:51:32 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:51:32 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:51:34 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 12:51:34 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:51:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:51:35 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:51:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:51:35 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:51:35 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:51:35 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:51:35 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 12:51:35 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 12:51:35 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 12:51:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:51:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:51:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:51:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 12:51:36 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:51:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 12:51:36 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:51:36 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 923294 values 14580865 bits 1822608 bytes 
Sat 18 Jan 2014 12:51:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 17846 values 281599 bits 35199 bytes 
Sat 18 Jan 2014 12:51:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:51:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:51:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:51:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:51:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:51:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43787569
Sat 18 Jan 2014 12:51:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:51:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43787569
Sat 18 Jan 2014 12:51:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:51:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:51:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:51:47 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:51:47 - job_xml_thread(): Done retrieving: data size 43787569
Sat 18 Jan 2014 12:51:47 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:51:47 - XML: Start document: iteration 5
Sat 18 Jan 2014 12:51:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:51:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:51:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:51:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:51:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:51:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:52:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:52:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:52:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:52:01 - XML: Processed 655178 elements - found 486 jobs
Sat 18 Jan 2014 12:52:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:52:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:52:01 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:52:01 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:52:01 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:52:01 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:52:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:52:02 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:52:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:52:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:52:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:52:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:52:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:52:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:52:03 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:52:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 12:52:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:52:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:52:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43834358
Sat 18 Jan 2014 12:52:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:52:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43834358
Sat 18 Jan 2014 12:52:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:52:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:52:15 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:52:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:52:16 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:52:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:52:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:52:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:52:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:52:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:52:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:52:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:52:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:52:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:52:21 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:52:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:52:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:52:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:52:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:52:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:52:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:52:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:52:24 - job_xml_thread(): Done retrieving: data size 43795588
Sat 18 Jan 2014 12:52:24 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:52:24 - XML: Start document: iteration 6
Sat 18 Jan 2014 12:52:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43795588
Sat 18 Jan 2014 12:52:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43795588
Sat 18 Jan 2014 12:52:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:52:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:52:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:52:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:52:35 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:52:35 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 12:52:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:52:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:52:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:52:36 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:52:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:52:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:52:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:52:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:52:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:52:38 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:52:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 12:52:38 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:52:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 12:52:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8690 values 137108 bits 17138 bytes 
Sat 18 Jan 2014 12:52:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:52:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:52:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:52:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:52:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:52:44 - XML: Processed 655187 elements - found 492 jobs
Sat 18 Jan 2014 12:52:44 - job 7348598 appears to have finished
Sat 18 Jan 2014 12:52:44 - job_xml_thread(): Found 8 updated jobs.
Sat 18 Jan 2014 12:52:45 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 12:52:45 - job_xml_thread(): Done storing. succesfully stored: 8 jobs
Sat 18 Jan 2014 12:52:45 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:52:45 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:52:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:52:49 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:52:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:52:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:52:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:52:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:52:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:52:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:52:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:52:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43803703
Sat 18 Jan 2014 12:52:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:52:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43803703
Sat 18 Jan 2014 12:52:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:52:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:52:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:53:00 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:53:00 - job_xml_thread(): Done retrieving: data size 43803703
Sat 18 Jan 2014 12:53:01 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:53:01 - XML: Start document: iteration 7
Sat 18 Jan 2014 12:53:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:53:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:53:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:53:11 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:53:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:53:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:53:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:53:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:53:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:53:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:53:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:53:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:53:13 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:53:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:53:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:53:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:53:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:53:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:53:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:53:15 - XML: Processed 655190 elements - found 492 jobs
Sat 18 Jan 2014 12:53:15 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:53:15 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:53:15 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:53:15 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:53:16 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:53:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 12:53:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:53:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:53:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43754313
Sat 18 Jan 2014 12:53:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:53:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43754313
Sat 18 Jan 2014 12:53:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:53:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:53:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:53:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:53:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:53:30 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:53:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:53:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:53:31 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:53:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:53:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:53:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:53:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:53:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:53:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:53:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:53:35 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:53:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:53:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:53:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:53:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:53:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:53:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:53:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:53:37 - job_xml_thread(): Done retrieving: data size 43299081
Sat 18 Jan 2014 12:53:37 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:53:37 - XML: Start document: iteration 8
Sat 18 Jan 2014 12:53:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43299081
Sat 18 Jan 2014 12:53:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:53:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:53:38 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:53:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43299081
Sat 18 Jan 2014 12:53:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:53:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:53:40 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:53:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 12:53:40 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:53:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 12:53:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5841 values 92162 bits 11520 bytes 
Sat 18 Jan 2014 12:53:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:53:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:53:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:53:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:54:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:54:00 - XML: Processed 648844 elements - found 492 jobs
Sat 18 Jan 2014 12:54:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:54:00 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:54:00 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:54:00 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:54:00 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:54:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:54:00 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:54:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:54:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:54:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:54:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:54:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:54:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:54:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:54:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:54:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:54:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:54:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:54:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:54:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:54:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:54:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43173595
Sat 18 Jan 2014 12:54:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:54:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43173595
Sat 18 Jan 2014 12:54:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:54:15 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:54:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:54:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:54:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:54:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:54:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:54:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:54:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:54:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:54:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:54:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:54:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:54:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:54:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:54:17 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:54:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 12:54:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:54:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:54:20 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:54:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:54:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:54:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:54:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:54:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:54:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:54:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:54:23 - job_xml_thread(): Done retrieving: data size 43212928
Sat 18 Jan 2014 12:54:23 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:54:23 - XML: Start document: iteration 9
Sat 18 Jan 2014 12:54:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43212928
Sat 18 Jan 2014 12:54:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:54:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43212928
Sat 18 Jan 2014 12:54:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:54:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:54:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:54:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:54:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:54:41 - XML: Processed 647738 elements - found 492 jobs
Sat 18 Jan 2014 12:54:41 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:54:41 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:54:41 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:54:41 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:54:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:54:42 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:54:43 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:54:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:54:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 12:54:43 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:54:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5965 values 94050 bits 11756 bytes 
Sat 18 Jan 2014 12:54:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 12:54:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:54:46 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:54:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:54:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:54:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:54:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:54:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:54:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:54:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:54:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:54:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:54:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:54:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:54:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:54:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:54:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:54:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:54:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:54:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43778576
Sat 18 Jan 2014 12:54:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:54:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43778576
Sat 18 Jan 2014 12:54:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:54:56 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:54:56 - job_xml_thread(): Done retrieving: data size 43778576
Sat 18 Jan 2014 12:54:56 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:54:56 - XML: Start document: iteration 10
Sat 18 Jan 2014 12:55:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:55:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:55:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:55:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:55:08 - XML: Processed 654582 elements - found 493 jobs
Sat 18 Jan 2014 12:55:08 - job 7348892 field 'start_timestamp' changed since saved from: 1390045938 to: 1390045891
Sat 18 Jan 2014 12:55:08 - job 7348898 field 'start_timestamp' changed since saved from: 1390045950 to: 1390045891
Sat 18 Jan 2014 12:55:08 - job_xml_thread(): Found 3 updated jobs.
Sat 18 Jan 2014 12:55:08 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 12:55:08 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:55:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 12:55:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:55:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:55:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:55:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:55:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:55:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:55:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:55:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:55:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:55:13 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Sat 18 Jan 2014 12:55:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:55:13 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:55:13 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:55:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:55:14 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:55:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:55:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:55:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:55:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:55:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:55:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:55:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:55:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43826326
Sat 18 Jan 2014 12:55:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:55:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43826326
Sat 18 Jan 2014 12:55:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:55:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:55:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:55:28 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:55:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:55:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:55:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:55:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:55:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:55:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:55:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:55:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:55:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:55:30 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 12:55:30 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 12:55:30 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:55:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:55:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:55:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:55:32 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:55:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:55:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:55:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:55:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:55:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:55:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:55:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:55:34 - job_xml_thread(): Done retrieving: data size 43819838
Sat 18 Jan 2014 12:55:34 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:55:34 - XML: Start document: iteration 11
Sat 18 Jan 2014 12:55:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43819838
Sat 18 Jan 2014 12:55:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:55:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43819838
Sat 18 Jan 2014 12:55:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:55:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:55:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:55:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:55:44 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:55:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:55:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 12:55:45 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:55:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9219 values 145466 bits 18183 bytes 
Sat 18 Jan 2014 12:55:45 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:55:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 12:55:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:55:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:55:51 - XML: Processed 655189 elements - found 493 jobs
Sat 18 Jan 2014 12:55:51 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:55:51 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:55:51 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:55:51 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:55:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:55:56 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:55:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:55:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:55:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:55:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:55:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:55:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:55:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:55:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:55:58 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:55:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:55:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:55:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:55:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:55:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:55:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:56:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:56:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43821277
Sat 18 Jan 2014 12:56:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:56:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43821277
Sat 18 Jan 2014 12:56:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:56:06 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:56:06 - job_xml_thread(): Done retrieving: data size 43821277
Sat 18 Jan 2014 12:56:06 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:56:06 - XML: Start document: iteration 12
Sat 18 Jan 2014 12:56:07 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:56:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 12:56:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:56:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:56:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:56:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:56:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:56:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:56:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:56:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:56:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:56:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:56:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:56:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:56:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:56:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:56:18 - XML: Processed 655192 elements - found 493 jobs
Sat 18 Jan 2014 12:56:19 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:56:19 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:56:19 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:56:19 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:56:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:56:21 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:56:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:56:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:56:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:56:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:56:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:56:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:56:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:56:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43797378
Sat 18 Jan 2014 12:56:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:56:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43797378
Sat 18 Jan 2014 12:56:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:56:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:56:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:56:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:56:32 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:56:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:56:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:56:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:56:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:56:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:56:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:56:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:56:34 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:56:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:56:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:56:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:56:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:56:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:56:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:56:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:56:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:56:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:56:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43822831
Sat 18 Jan 2014 12:56:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:56:38 - job_xml_thread(): Done retrieving: data size 43822831
Sat 18 Jan 2014 12:56:38 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:56:38 - XML: Start document: iteration 13
Sat 18 Jan 2014 12:56:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43822831
Sat 18 Jan 2014 12:56:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:56:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:56:46 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:56:46 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:56:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 12:56:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:56:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 12:56:47 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:56:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9345 values 147408 bits 18426 bytes 
Sat 18 Jan 2014 12:56:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:56:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:56:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:56:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:56:53 - XML: Processed 655194 elements - found 494 jobs
Sat 18 Jan 2014 12:56:53 - job 7348891 appears to have finished
Sat 18 Jan 2014 12:56:53 - job_xml_thread(): Found 3 updated jobs.
Sat 18 Jan 2014 12:56:53 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 12:56:56 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Sat 18 Jan 2014 12:56:56 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:56:56 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:56:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:56:59 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:56:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:56:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:56:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:56:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:56:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:56:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:57:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:57:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:57:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:57:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:57:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:57:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:57:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:57:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:57:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:57:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:57:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43842946
Sat 18 Jan 2014 12:57:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:57:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43842946
Sat 18 Jan 2014 12:57:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:57:11 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:57:11 - job_xml_thread(): Done retrieving: data size 43842946
Sat 18 Jan 2014 12:57:11 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:57:11 - XML: Start document: iteration 14
Sat 18 Jan 2014 12:57:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:57:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:57:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:57:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:57:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:57:15 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:57:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:57:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:57:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:57:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:57:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:57:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:57:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:57:17 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:57:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 12:57:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:57:24 - XML: Processed 655194 elements - found 494 jobs
Sat 18 Jan 2014 12:57:24 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:57:24 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:57:25 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:57:25 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:57:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:57:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:57:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:57:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:57:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:57:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:57:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:57:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:57:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:57:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43794975
Sat 18 Jan 2014 12:57:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:57:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43794975
Sat 18 Jan 2014 12:57:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:57:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:57:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:57:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:57:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:57:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:57:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:57:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:57:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:57:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:57:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:57:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:57:40 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:57:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:57:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:57:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:57:41 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:57:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:57:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:57:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:57:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:57:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:57:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:57:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:57:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43822205
Sat 18 Jan 2014 12:57:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:57:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43822205
Sat 18 Jan 2014 12:57:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:57:44 - job_xml_thread(): Done retrieving: data size 43822205
Sat 18 Jan 2014 12:57:44 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:57:44 - XML: Start document: iteration 15
Sat 18 Jan 2014 12:57:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:57:47 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:57:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:57:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 12:57:48 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:57:48 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:57:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 12:57:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9246 values 145891 bits 18236 bytes 
Sat 18 Jan 2014 12:57:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:57:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:57:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:57:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:58:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:58:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:58:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:58:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:58:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:58:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:58:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:58:05 - XML: Processed 655194 elements - found 494 jobs
Sat 18 Jan 2014 12:58:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:58:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:58:06 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:58:06 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:58:06 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:58:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:58:06 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:58:06 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:58:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:58:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:58:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:58:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:58:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:58:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:58:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:58:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43815670
Sat 18 Jan 2014 12:58:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:58:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43815670
Sat 18 Jan 2014 12:58:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:58:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:58:20 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:58:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:58:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:58:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:58:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:58:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:58:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:58:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:58:21 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:58:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:58:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:58:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:58:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:58:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:58:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:58:24 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:58:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 12:58:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:58:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:58:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:58:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:58:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:58:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:58:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43813367
Sat 18 Jan 2014 12:58:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:58:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43813367
Sat 18 Jan 2014 12:58:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:58:27 - job_xml_thread(): Done retrieving: data size 43813367
Sat 18 Jan 2014 12:58:27 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:58:27 - XML: Start document: iteration 16
Sat 18 Jan 2014 12:58:36 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 12:58:36 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:58:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:58:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:58:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:58:37 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:58:37 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 12:58:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:58:37 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:58:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:58:38 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 12:58:38 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 12:58:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:58:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:58:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:58:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:58:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:58:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:58:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:58:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:58:46 - size of cluster 'LISA Cluster': 624 hosts 79475 metrics 811843 values 12802116 bits 1600264 bytes 
Sat 18 Jan 2014 12:58:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:58:48 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:58:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:58:49 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:58:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 12:58:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 12:58:49 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:58:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5789 values 91283 bits 11410 bytes 
Sat 18 Jan 2014 12:58:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:58:50 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:58:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:58:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:58:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:58:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:58:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:58:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:58:51 - XML: Processed 655210 elements - found 502 jobs
Sat 18 Jan 2014 12:58:51 - job 7348839 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 12:58:51 - job 7348899 appears to have finished
Sat 18 Jan 2014 12:58:51 - job 7348901 field 'start_timestamp' changed since saved from: 1390046149 to: 1390046148
Sat 18 Jan 2014 12:58:51 - job_xml_thread(): Found 12 updated jobs.
Sat 18 Jan 2014 12:58:51 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 12:58:51 - job_xml_thread(): Done storing. succesfully stored: 12 jobs
Sat 18 Jan 2014 12:58:51 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:58:51 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:58:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:58:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:58:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:58:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43799292
Sat 18 Jan 2014 12:58:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:58:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43799292
Sat 18 Jan 2014 12:58:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:59:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:59:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:59:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:59:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:59:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:59:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:59:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:59:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:59:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:59:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:59:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:59:06 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:59:10 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:59:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 12:59:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:59:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:59:11 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:59:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:59:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:59:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:59:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:59:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:59:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:59:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:59:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43738647
Sat 18 Jan 2014 12:59:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:59:14 - job_xml_thread(): Done retrieving: data size 43738647
Sat 18 Jan 2014 12:59:14 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 12:59:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43738647
Sat 18 Jan 2014 12:59:14 - XML: Start document: iteration 17
Sat 18 Jan 2014 12:59:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:59:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:59:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:59:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:59:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:59:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:59:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:59:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:59:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:59:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:59:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:59:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:59:37 - XML: Processed 654462 elements - found 502 jobs
Sat 18 Jan 2014 12:59:37 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 12:59:37 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 12:59:37 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 12:59:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:59:37 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 12:59:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:59:37 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:59:37 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 12:59:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:59:38 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:59:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:59:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:59:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:59:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:59:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 12:59:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:59:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 12:59:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43212407
Sat 18 Jan 2014 12:59:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 12:59:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43212407
Sat 18 Jan 2014 12:59:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 12:59:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:59:49 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:59:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:59:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 12:59:50 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 12:59:50 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:59:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 12:59:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8949 values 141067 bits 17633 bytes 
Sat 18 Jan 2014 12:59:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 12:59:52 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 12:59:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:59:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 12:59:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 12:59:53 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 12:59:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 12:59:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 12:59:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:59:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 12:59:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 12:59:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 12:59:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 12:59:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 12:59:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 12:59:56 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 12:59:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 12:59:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 12:59:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:59:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 12:59:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 12:59:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:00:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:00:00 - job_xml_thread(): Done retrieving: data size 43145174
Sat 18 Jan 2014 13:00:00 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:00:00 - XML: Start document: iteration 18
Sat 18 Jan 2014 13:00:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43145174
Sat 18 Jan 2014 13:00:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:00:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43145174
Sat 18 Jan 2014 13:00:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:00:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:00:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:00:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:00:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:00:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:00:15 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:00:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:00:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:00:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:00:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:00:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:00:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:00:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:00:18 - XML: Processed 647046 elements - found 502 jobs
Sat 18 Jan 2014 13:00:18 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:00:18 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:00:18 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:00:18 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:00:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:00:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:00:24 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:00:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 13:00:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:00:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:00:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:00:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:00:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:00:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:00:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:00:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:00:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43188374
Sat 18 Jan 2014 13:00:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:00:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43188374
Sat 18 Jan 2014 13:00:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:00:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:00:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:00:33 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:00:33 - job_xml_thread(): Done retrieving: data size 43188374
Sat 18 Jan 2014 13:00:33 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:00:33 - XML: Start document: iteration 19
Sat 18 Jan 2014 13:00:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:00:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:00:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:00:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:00:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:00:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:00:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:00:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:00:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:00:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:00:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:00:45 - XML: Processed 647758 elements - found 501 jobs
Sat 18 Jan 2014 13:00:45 - job 7348913 report time 1390046269 does not match current heartbeat 1390046390 : ignoring job
Sat 18 Jan 2014 13:00:45 - job 7348912 report time 1390046269 does not match current heartbeat 1390046390 : ignoring job
Sat 18 Jan 2014 13:00:45 - job 7348911 report time 1390046269 does not match current heartbeat 1390046390 : ignoring job
Sat 18 Jan 2014 13:00:45 - job 7348910 report time 1390046269 does not match current heartbeat 1390046390 : ignoring job
Sat 18 Jan 2014 13:00:45 - job 7348916 report time 1390046269 does not match current heartbeat 1390046390 : ignoring job
Sat 18 Jan 2014 13:00:45 - job 7348915 report time 1390046269 does not match current heartbeat 1390046390 : ignoring job
Sat 18 Jan 2014 13:00:45 - job 7348914 report time 1390046269 does not match current heartbeat 1390046390 : ignoring job
Sat 18 Jan 2014 13:00:45 - job 7348599 appears to have finished
Sat 18 Jan 2014 13:00:45 - job 7348908 report time 1390046269 does not match current heartbeat 1390046390 : ignoring job
Sat 18 Jan 2014 13:00:45 - job 7348909 report time 1390046269 does not match current heartbeat 1390046390 : ignoring job
Sat 18 Jan 2014 13:00:45 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 13:00:45 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 13:00:46 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 13:00:46 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:00:46 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:00:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:00:48 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:00:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:00:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:00:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:00:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:00:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:00:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:00:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:00:50 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:00:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:00:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 13:00:51 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:00:51 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:00:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 13:00:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5638 values 88867 bits 11108 bytes 
Sat 18 Jan 2014 13:00:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:00:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43729647
Sat 18 Jan 2014 13:00:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:00:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43729647
Sat 18 Jan 2014 13:00:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:00:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:00:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:01:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:01:00 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:01:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:01:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:01:01 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:01:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:01:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:01:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:01:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:01:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:01:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:01:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:01:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:01:05 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:01:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:01:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:01:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:01:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:01:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:01:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:01:08 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:01:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 13:01:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:01:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:01:08 - job_xml_thread(): Done retrieving: data size 43807672
Sat 18 Jan 2014 13:01:08 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:01:08 - XML: Start document: iteration 20
Sat 18 Jan 2014 13:01:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43807672
Sat 18 Jan 2014 13:01:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:01:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43807672
Sat 18 Jan 2014 13:01:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:01:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:01:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:01:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:01:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:01:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:01:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:01:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:01:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:01:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:01:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:01:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:01:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:01:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:01:27 - XML: Processed 655166 elements - found 501 jobs
Sat 18 Jan 2014 13:01:27 - job 7348913 report time 1390046269 does not match current heartbeat 1390046390 : ignoring job
Sat 18 Jan 2014 13:01:27 - job 7348912 report time 1390046269 does not match current heartbeat 1390046390 : ignoring job
Sat 18 Jan 2014 13:01:27 - job 7348911 report time 1390046269 does not match current heartbeat 1390046390 : ignoring job
Sat 18 Jan 2014 13:01:27 - job 7348910 report time 1390046269 does not match current heartbeat 1390046390 : ignoring job
Sat 18 Jan 2014 13:01:27 - job 7348916 report time 1390046269 does not match current heartbeat 1390046390 : ignoring job
Sat 18 Jan 2014 13:01:27 - job 7348915 report time 1390046269 does not match current heartbeat 1390046390 : ignoring job
Sat 18 Jan 2014 13:01:27 - job 7348914 report time 1390046269 does not match current heartbeat 1390046390 : ignoring job
Sat 18 Jan 2014 13:01:27 - job 7348908 report time 1390046269 does not match current heartbeat 1390046390 : ignoring job
Sat 18 Jan 2014 13:01:27 - job 7348909 report time 1390046269 does not match current heartbeat 1390046390 : ignoring job
Sat 18 Jan 2014 13:01:27 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:01:27 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:01:27 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:01:27 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:01:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:01:31 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:01:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:01:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:01:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:01:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:01:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:01:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:01:35 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 13:01:35 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 13:01:35 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:01:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:01:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43806848
Sat 18 Jan 2014 13:01:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:01:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43806848
Sat 18 Jan 2014 13:01:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:01:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:01:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:01:42 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:01:43 - job_xml_thread(): Done retrieving: data size 43806848
Sat 18 Jan 2014 13:01:43 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:01:43 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 13:01:43 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 13:01:43 - Housekeeping: done.
Sat 18 Jan 2014 13:01:44 - XML: Start document: iteration 0
Sat 18 Jan 2014 13:01:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:01:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:01:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:01:47 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:01:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:01:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:01:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:01:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:01:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:01:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:01:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:01:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:01:51 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:01:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:01:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 13:01:51 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:01:51 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:01:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 13:01:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6240 values 98570 bits 12321 bytes 
Sat 18 Jan 2014 13:01:56 - XML: Processed 655208 elements - found 501 jobs
Sat 18 Jan 2014 13:01:56 - job 7348913 report time 1390046269 does not match current heartbeat 1390046390 : ignoring job
Sat 18 Jan 2014 13:01:56 - job 7348912 report time 1390046269 does not match current heartbeat 1390046390 : ignoring job
Sat 18 Jan 2014 13:01:56 - job 7348911 report time 1390046269 does not match current heartbeat 1390046390 : ignoring job
Sat 18 Jan 2014 13:01:56 - job 7348910 report time 1390046269 does not match current heartbeat 1390046390 : ignoring job
Sat 18 Jan 2014 13:01:56 - job 7348916 report time 1390046269 does not match current heartbeat 1390046390 : ignoring job
Sat 18 Jan 2014 13:01:56 - job 7348915 report time 1390046269 does not match current heartbeat 1390046390 : ignoring job
Sat 18 Jan 2014 13:01:56 - job 7348914 report time 1390046269 does not match current heartbeat 1390046390 : ignoring job
Sat 18 Jan 2014 13:01:56 - job 7348908 report time 1390046269 does not match current heartbeat 1390046390 : ignoring job
Sat 18 Jan 2014 13:01:56 - job 7348909 report time 1390046269 does not match current heartbeat 1390046390 : ignoring job
Sat 18 Jan 2014 13:01:56 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:01:56 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:01:56 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:01:57 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:01:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:01:57 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:01:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:01:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:01:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:01:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:01:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:01:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:01:59 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:01:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 13:01:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:02:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:02:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43794442
Sat 18 Jan 2014 13:02:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:02:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43794442
Sat 18 Jan 2014 13:02:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:02:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:02:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:02:12 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:02:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:02:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:02:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:02:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:02:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:02:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:02:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:02:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:02:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:02:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:02:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:02:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:02:14 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:02:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:02:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:02:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:02:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:02:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:02:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:02:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:02:16 - job_xml_thread(): Done retrieving: data size 43828544
Sat 18 Jan 2014 13:02:16 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:02:16 - XML: Start document: iteration 1
Sat 18 Jan 2014 13:02:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43828544
Sat 18 Jan 2014 13:02:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43828544
Sat 18 Jan 2014 13:02:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:02:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:02:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:02:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:02:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:02:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:02:32 - XML: Processed 655208 elements - found 501 jobs
Sat 18 Jan 2014 13:02:32 - job 7348913 report time 1390046269 does not match current heartbeat 1390046390 : ignoring job
Sat 18 Jan 2014 13:02:32 - job 7348912 report time 1390046269 does not match current heartbeat 1390046390 : ignoring job
Sat 18 Jan 2014 13:02:32 - job 7348911 report time 1390046269 does not match current heartbeat 1390046390 : ignoring job
Sat 18 Jan 2014 13:02:33 - job 7348910 report time 1390046269 does not match current heartbeat 1390046390 : ignoring job
Sat 18 Jan 2014 13:02:33 - job 7348916 report time 1390046269 does not match current heartbeat 1390046390 : ignoring job
Sat 18 Jan 2014 13:02:33 - job 7348915 report time 1390046269 does not match current heartbeat 1390046390 : ignoring job
Sat 18 Jan 2014 13:02:33 - job 7348914 report time 1390046269 does not match current heartbeat 1390046390 : ignoring job
Sat 18 Jan 2014 13:02:33 - job 7348908 report time 1390046269 does not match current heartbeat 1390046390 : ignoring job
Sat 18 Jan 2014 13:02:33 - job 7348909 report time 1390046269 does not match current heartbeat 1390046390 : ignoring job
Sat 18 Jan 2014 13:02:33 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:02:33 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:02:33 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:02:33 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:02:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:02:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:02:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:02:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:02:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:02:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:02:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:02:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:02:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:02:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:02:38 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:02:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:02:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:02:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:02:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:02:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:02:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:02:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:02:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43816679
Sat 18 Jan 2014 13:02:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:02:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43816679
Sat 18 Jan 2014 13:02:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:02:48 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:02:49 - job_xml_thread(): Done retrieving: data size 43816679
Sat 18 Jan 2014 13:02:49 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:02:49 - XML: Start document: iteration 2
Sat 18 Jan 2014 13:02:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:02:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:02:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:02:51 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:02:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:02:53 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:02:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 13:02:53 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:02:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 149051 bits 18631 bytes 
Sat 18 Jan 2014 13:02:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 13:02:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:02:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:02:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:02:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:02:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:02:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:02:58 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:02:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:02:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:02:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:02:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:02:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:02:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:02:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:02:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:03:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:03:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:03:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:03:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:03:02 - XML: Processed 655190 elements - found 492 jobs
Sat 18 Jan 2014 13:03:02 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:03:02 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:03:02 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:03:02 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:03:04 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:03:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 13:03:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:03:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:03:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43834608
Sat 18 Jan 2014 13:03:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:03:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43834608
Sat 18 Jan 2014 13:03:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:03:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:03:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:03:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:03:14 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:03:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:03:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:03:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:03:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:03:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:03:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:03:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:03:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:03:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:03:17 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:03:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:03:18 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:03:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:03:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:03:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:03:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:03:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:03:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:03:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:03:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43834793
Sat 18 Jan 2014 13:03:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:03:21 - job_xml_thread(): Done retrieving: data size 43834793
Sat 18 Jan 2014 13:03:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43834793
Sat 18 Jan 2014 13:03:21 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:03:21 - XML: Start document: iteration 3
Sat 18 Jan 2014 13:03:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:03:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:03:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:03:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:03:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:03:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:03:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:03:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:03:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:03:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:03:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:03:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:03:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:03:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:03:38 - XML: Processed 655190 elements - found 492 jobs
Sat 18 Jan 2014 13:03:38 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:03:38 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:03:38 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:03:38 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:03:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:03:42 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:03:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:03:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:03:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:03:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:03:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:03:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:03:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:03:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43796016
Sat 18 Jan 2014 13:03:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:03:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43796016
Sat 18 Jan 2014 13:03:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:03:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:03:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:03:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:03:53 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:03:53 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:03:53 - job_xml_thread(): Done retrieving: data size 43796016
Sat 18 Jan 2014 13:03:53 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:03:53 - XML: Start document: iteration 4
Sat 18 Jan 2014 13:03:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:03:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:03:54 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:03:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:03:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 13:03:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 13:03:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:03:54 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:03:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148793 bits 18599 bytes 
Sat 18 Jan 2014 13:03:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:03:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:03:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:03:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:03:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:03:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:03:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:03:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:04:05 - XML: Processed 655190 elements - found 492 jobs
Sat 18 Jan 2014 13:04:06 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:04:06 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:04:06 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:04:06 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:04:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:04:07 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:04:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:04:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:04:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:04:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:04:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:04:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:04:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:04:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43789283
Sat 18 Jan 2014 13:04:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:04:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43789283
Sat 18 Jan 2014 13:04:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:04:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:04:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:04:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:04:20 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:04:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:04:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:04:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:04:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:04:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:04:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:04:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:04:21 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:04:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:04:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:04:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:04:23 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:04:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:04:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:04:24 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:04:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 13:04:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:04:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:04:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:04:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:04:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:04:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:04:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43806871
Sat 18 Jan 2014 13:04:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:04:26 - job_xml_thread(): Done retrieving: data size 43806871
Sat 18 Jan 2014 13:04:26 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:04:26 - XML: Start document: iteration 5
Sat 18 Jan 2014 13:04:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43806871
Sat 18 Jan 2014 13:04:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:04:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:04:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:04:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:04:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:04:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:04:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:04:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:04:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:04:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:04:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:04:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:04:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:04:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:04:43 - XML: Processed 655188 elements - found 491 jobs
Sat 18 Jan 2014 13:04:44 - job 7348842 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 13:04:44 - job 7348777 appears to have finished
Sat 18 Jan 2014 13:04:44 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 13:04:44 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 13:04:44 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 13:04:44 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:04:44 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:04:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:04:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:04:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:04:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:04:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:04:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:04:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:04:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:04:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:04:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43812695
Sat 18 Jan 2014 13:04:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:04:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43812695
Sat 18 Jan 2014 13:04:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:04:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:04:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:04:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:04:54 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:04:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:04:55 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:04:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 13:04:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 13:04:55 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:04:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8877 values 140009 bits 17501 bytes 
Sat 18 Jan 2014 13:04:59 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:04:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:05:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:05:00 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:05:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:05:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:05:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:05:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:05:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:05:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:05:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:05:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:05:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:05:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:05:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:05:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:05:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:05:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:05:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:05:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:05:05 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:05:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 13:05:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:05:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:05:06 - job_xml_thread(): Done retrieving: data size 43832567
Sat 18 Jan 2014 13:05:06 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:05:06 - XML: Start document: iteration 6
Sat 18 Jan 2014 13:05:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43832567
Sat 18 Jan 2014 13:05:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:05:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43832567
Sat 18 Jan 2014 13:05:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:05:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:05:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:05:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:05:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:05:24 - XML: Processed 655188 elements - found 491 jobs
Sat 18 Jan 2014 13:05:25 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:05:25 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:05:25 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:05:25 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:05:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:05:26 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:05:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:05:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:05:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:05:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:05:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:05:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:05:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:05:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:05:29 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:05:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:05:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:05:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:05:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:05:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:05:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:05:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:05:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43390238
Sat 18 Jan 2014 13:05:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:05:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43390238
Sat 18 Jan 2014 13:05:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:05:37 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 13:05:37 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:05:39 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:05:39 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 13:05:39 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 13:05:39 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:05:39 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 13:05:40 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:05:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:05:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:05:41 - job_xml_thread(): Done retrieving: data size 43390238
Sat 18 Jan 2014 13:05:41 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:05:41 - XML: Start document: iteration 7
Sat 18 Jan 2014 13:05:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:05:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:05:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:05:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:05:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:05:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:05:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:05:44 - size of cluster 'LISA Cluster': 624 hosts 79467 metrics 827304 values 13068217 bits 1633527 bytes 
Sat 18 Jan 2014 13:05:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:05:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:05:51 - XML: Processed 649942 elements - found 491 jobs
Sat 18 Jan 2014 13:05:51 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:05:51 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:05:51 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:05:51 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:05:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:05:53 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:05:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:05:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:05:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:05:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:05:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:05:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:05:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:05:55 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:05:56 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:05:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:05:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 13:05:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 13:05:56 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:05:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99088 bits 12386 bytes 
Sat 18 Jan 2014 13:05:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:05:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43178319
Sat 18 Jan 2014 13:05:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:05:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43178319
Sat 18 Jan 2014 13:05:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:05:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:05:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:06:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:06:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:06:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:06:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:06:06 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:06:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:06:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:06:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:06:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:06:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:06:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:06:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:06:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:06:11 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:06:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:06:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:06:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:06:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:06:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:06:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:06:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:06:15 - job_xml_thread(): Done retrieving: data size 43197959
Sat 18 Jan 2014 13:06:15 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:06:15 - XML: Start document: iteration 8
Sat 18 Jan 2014 13:06:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43197959
Sat 18 Jan 2014 13:06:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43197959
Sat 18 Jan 2014 13:06:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:06:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:06:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:06:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:06:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:06:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:06:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:06:30 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:06:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:06:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:06:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:06:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:06:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:06:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:06:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:06:34 - XML: Processed 647662 elements - found 491 jobs
Sat 18 Jan 2014 13:06:34 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:06:34 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:06:34 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:06:34 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:06:37 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:06:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 13:06:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:06:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:06:37 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:06:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:06:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:06:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:06:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:06:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:06:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:06:39 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:06:39 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 13:06:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:06:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43597756
Sat 18 Jan 2014 13:06:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:06:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43597756
Sat 18 Jan 2014 13:06:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:06:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:06:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:06:49 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:06:49 - job_xml_thread(): Done retrieving: data size 43597756
Sat 18 Jan 2014 13:06:49 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:06:49 - XML: Start document: iteration 9
Sat 18 Jan 2014 13:06:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:06:50 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:06:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:06:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:06:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:06:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:06:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:06:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:06:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:06:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:06:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:06:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:06:56 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:06:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:06:56 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:06:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 13:06:56 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:06:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 13:06:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6197 values 97716 bits 12214 bytes 
Sat 18 Jan 2014 13:07:00 - XML: Processed 652752 elements - found 492 jobs
Sat 18 Jan 2014 13:07:00 - job 7348843 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 13:07:00 - job 7348600 appears to have finished
Sat 18 Jan 2014 13:07:00 - job_xml_thread(): Found 4 updated jobs.
Sat 18 Jan 2014 13:07:00 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 13:07:01 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Sat 18 Jan 2014 13:07:01 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:07:01 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:07:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:07:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:07:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:07:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:07:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:07:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:07:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:07:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:07:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:07:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43792159
Sat 18 Jan 2014 13:07:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:07:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43792159
Sat 18 Jan 2014 13:07:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:07:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:07:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:07:16 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:07:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:07:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:07:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:07:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:07:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:07:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:07:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:07:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:07:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:07:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:07:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:07:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:07:22 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:07:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:07:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:07:23 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:07:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 13:07:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:07:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:07:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:07:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:07:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:07:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:07:26 - job_xml_thread(): Done retrieving: data size 43787679
Sat 18 Jan 2014 13:07:26 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:07:26 - XML: Start document: iteration 10
Sat 18 Jan 2014 13:07:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43787679
Sat 18 Jan 2014 13:07:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:07:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43787679
Sat 18 Jan 2014 13:07:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:07:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:07:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:07:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:07:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:07:42 - XML: Processed 655190 elements - found 492 jobs
Sat 18 Jan 2014 13:07:42 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:07:42 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:07:42 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:07:42 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:07:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:07:47 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:07:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:07:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:07:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:07:49 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:07:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:07:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:07:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:07:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:07:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:07:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:07:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:07:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:07:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:07:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:07:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:07:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:07:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43814785
Sat 18 Jan 2014 13:07:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:07:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43814785
Sat 18 Jan 2014 13:07:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:07:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:07:56 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:07:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:07:57 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:07:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 13:07:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 13:07:57 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:07:57 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:07:57 - job_xml_thread(): Done retrieving: data size 43814785
Sat 18 Jan 2014 13:07:57 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:07:57 - XML: Start document: iteration 11
Sat 18 Jan 2014 13:07:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8629 values 136044 bits 17005 bytes 
Sat 18 Jan 2014 13:08:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:08:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:08:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:08:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:08:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:08:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:08:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:08:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:08:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:08:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:08:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:08:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:08:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:08:13 - XML: Processed 655189 elements - found 492 jobs
Sat 18 Jan 2014 13:08:14 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:08:14 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:08:14 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:08:14 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:08:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:08:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:08:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:08:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:08:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:08:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:08:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:08:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:08:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:08:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43801389
Sat 18 Jan 2014 13:08:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:08:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43801389
Sat 18 Jan 2014 13:08:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:08:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:08:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:08:29 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:08:29 - job_xml_thread(): Done retrieving: data size 43801389
Sat 18 Jan 2014 13:08:29 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:08:29 - XML: Start document: iteration 12
Sat 18 Jan 2014 13:08:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:08:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:08:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:08:33 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:08:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:08:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:08:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:08:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:08:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:08:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:08:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:08:42 - XML: Processed 655190 elements - found 492 jobs
Sat 18 Jan 2014 13:08:42 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:08:42 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:08:42 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:08:42 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:08:43 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:08:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 13:08:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:08:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:08:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:08:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:08:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:08:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:08:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:08:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:08:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:08:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:08:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43795245
Sat 18 Jan 2014 13:08:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:08:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43795245
Sat 18 Jan 2014 13:08:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:08:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:08:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:08:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:08:57 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:08:57 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:08:57 - job_xml_thread(): Done retrieving: data size 43795245
Sat 18 Jan 2014 13:08:57 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:08:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:08:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 13:08:57 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:08:57 - XML: Start document: iteration 13
Sat 18 Jan 2014 13:08:57 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:08:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 13:08:59 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5652 values 89069 bits 11133 bytes 
Sat 18 Jan 2014 13:09:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:09:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:09:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:09:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:09:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:09:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:09:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:09:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:09:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:09:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:09:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:09:11 - XML: Processed 655188 elements - found 491 jobs
Sat 18 Jan 2014 13:09:11 - job 7348918 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 13:09:11 - job 7348917 field 'start_timestamp' changed since saved from: 1390046753 to: 1390046709
Sat 18 Jan 2014 13:09:11 - job 7348601 appears to have finished
Sat 18 Jan 2014 13:09:11 - job_xml_thread(): Found 3 updated jobs.
Sat 18 Jan 2014 13:09:11 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 13:09:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:09:11 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:09:11 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Sat 18 Jan 2014 13:09:11 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:09:11 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:09:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:09:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:09:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:09:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:09:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:09:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:09:13 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 13:09:13 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 13:09:13 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:09:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:09:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43801537
Sat 18 Jan 2014 13:09:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:09:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43801537
Sat 18 Jan 2014 13:09:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:09:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:09:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:09:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:09:26 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:09:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:09:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:09:26 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:09:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:09:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:09:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:09:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:09:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:09:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:09:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:09:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:09:29 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:09:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:09:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:09:29 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:09:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 13:09:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:09:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:09:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:09:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:09:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:09:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:09:32 - job_xml_thread(): Done retrieving: data size 43822356
Sat 18 Jan 2014 13:09:32 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:09:32 - XML: Start document: iteration 14
Sat 18 Jan 2014 13:09:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43822356
Sat 18 Jan 2014 13:09:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:09:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43822356
Sat 18 Jan 2014 13:09:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:09:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:09:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:09:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:09:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:09:48 - XML: Processed 655188 elements - found 491 jobs
Sat 18 Jan 2014 13:09:48 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:09:48 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:09:48 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:09:48 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:09:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:09:52 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:09:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:09:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:09:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:09:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:09:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:09:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:09:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:09:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:09:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:09:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:09:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:09:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:09:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:09:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:09:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:09:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:09:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43813075
Sat 18 Jan 2014 13:09:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:09:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43813075
Sat 18 Jan 2014 13:09:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:09:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:09:58 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:09:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:09:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 13:09:59 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:09:59 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:09:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 13:09:59 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9035 values 142463 bits 17807 bytes 
Sat 18 Jan 2014 13:10:03 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:10:03 - job_xml_thread(): Done retrieving: data size 43813075
Sat 18 Jan 2014 13:10:03 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:10:03 - XML: Start document: iteration 15
Sat 18 Jan 2014 13:10:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:10:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:10:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:10:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:10:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:10:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:10:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:10:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:10:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:10:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:10:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:10:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:10:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:10:17 - XML: Processed 655188 elements - found 491 jobs
Sat 18 Jan 2014 13:10:17 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:10:17 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:10:17 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:10:17 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:10:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:10:18 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:10:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:10:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:10:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:10:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:10:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:10:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:10:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:10:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43823065
Sat 18 Jan 2014 13:10:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:10:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43823065
Sat 18 Jan 2014 13:10:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:10:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:10:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:10:32 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:10:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:10:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:10:33 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:10:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:10:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:10:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:10:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:10:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:10:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:10:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:10:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:10:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:10:37 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:10:37 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:10:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 13:10:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:10:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:10:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:10:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:10:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:10:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:10:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:10:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:10:39 - job_xml_thread(): Done retrieving: data size 43808217
Sat 18 Jan 2014 13:10:39 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:10:39 - XML: Start document: iteration 16
Sat 18 Jan 2014 13:10:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43808217
Sat 18 Jan 2014 13:10:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:10:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43808217
Sat 18 Jan 2014 13:10:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:10:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:10:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:10:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:10:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:10:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:10:59 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:10:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:10:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:10:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:10:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:10:59 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:10:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:10:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 13:10:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 13:10:59 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:11:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5739 values 90510 bits 11313 bytes 
Sat 18 Jan 2014 13:11:00 - XML: Processed 655192 elements - found 493 jobs
Sat 18 Jan 2014 13:11:00 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 13:11:00 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 13:11:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:11:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:11:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:11:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:11:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:11:01 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 13:11:01 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:11:01 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:11:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:11:02 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:11:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:11:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:11:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:11:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:11:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:11:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:11:05 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:11:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 13:11:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:11:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:11:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43840707
Sat 18 Jan 2014 13:11:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:11:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43840707
Sat 18 Jan 2014 13:11:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:11:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:11:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:11:16 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:11:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:11:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:11:18 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:11:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:11:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:11:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:11:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:11:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:11:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:11:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:11:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:11:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:11:20 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:11:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:11:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:11:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:11:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:11:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:11:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:11:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:11:22 - job_xml_thread(): Done retrieving: data size 43751924
Sat 18 Jan 2014 13:11:22 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:11:22 - XML: Start document: iteration 17
Sat 18 Jan 2014 13:11:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43751924
Sat 18 Jan 2014 13:11:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:11:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43751924
Sat 18 Jan 2014 13:11:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:11:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:11:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:11:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:11:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:11:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:11:43 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:11:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:11:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:11:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:11:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:11:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:11:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:11:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:11:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:11:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:11:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:11:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:11:46 - XML: Processed 654442 elements - found 493 jobs
Sat 18 Jan 2014 13:11:46 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:11:46 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:11:46 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:11:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:11:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:11:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:11:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:11:46 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:11:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:11:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43207845
Sat 18 Jan 2014 13:11:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:11:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43207845
Sat 18 Jan 2014 13:11:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:11:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:11:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:11:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:11:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:12:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:12:00 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:12:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:12:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:12:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:12:01 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:12:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:12:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:12:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:12:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:12:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:12:01 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:12:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 13:12:01 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:12:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 13:12:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148544 bits 18568 bytes 
Sat 18 Jan 2014 13:12:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:12:02 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:12:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:12:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:12:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:12:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:12:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:12:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:12:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:12:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43170628
Sat 18 Jan 2014 13:12:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:12:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43170628
Sat 18 Jan 2014 13:12:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:12:05 - job_xml_thread(): Done retrieving: data size 43170628
Sat 18 Jan 2014 13:12:05 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:12:05 - XML: Start document: iteration 18
Sat 18 Jan 2014 13:12:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:12:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:12:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:12:18 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:12:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:12:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:12:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:12:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:12:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:12:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:12:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:12:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:12:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:12:23 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:12:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 13:12:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:12:24 - XML: Processed 646992 elements - found 493 jobs
Sat 18 Jan 2014 13:12:24 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:12:24 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:12:24 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:12:24 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:12:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:12:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:12:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:12:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:12:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:12:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:12:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:12:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:12:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:12:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43198313
Sat 18 Jan 2014 13:12:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:12:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43198313
Sat 18 Jan 2014 13:12:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:12:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:12:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:12:39 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 13:12:39 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:12:40 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:12:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:12:40 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:12:40 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:12:40 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 13:12:40 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 13:12:40 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 13:12:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:12:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:12:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:12:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:12:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:12:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:12:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:12:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:12:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:12:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:12:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:12:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:12:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:12:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:12:44 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 910230 values 14355107 bits 1794388 bytes 
Sat 18 Jan 2014 13:12:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:12:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:12:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:12:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:12:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:12:47 - job_xml_thread(): Done retrieving: data size 43726655
Sat 18 Jan 2014 13:12:47 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:12:47 - XML: Start document: iteration 19
Sat 18 Jan 2014 13:12:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43726655
Sat 18 Jan 2014 13:12:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43726655
Sat 18 Jan 2014 13:12:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:12:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:12:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:12:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:13:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:13:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:13:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:13:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:13:01 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:13:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:13:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:13:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:13:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:13:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 13:13:02 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:13:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8940 values 141003 bits 17625 bytes 
Sat 18 Jan 2014 13:13:02 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:13:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 13:13:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:13:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:13:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:13:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:13:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:13:05 - XML: Processed 654012 elements - found 492 jobs
Sat 18 Jan 2014 13:13:05 - job 7348918 appears to have finished
Sat 18 Jan 2014 13:13:05 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 13:13:05 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 13:13:06 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 13:13:06 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:13:06 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:13:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:13:10 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:13:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:13:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:13:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:13:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:13:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:13:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:13:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:13:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43787331
Sat 18 Jan 2014 13:13:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:13:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43787331
Sat 18 Jan 2014 13:13:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:13:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:13:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:13:21 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:13:21 - job_xml_thread(): Done retrieving: data size 43787331
Sat 18 Jan 2014 13:13:21 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:13:21 - XML: Start document: iteration 20
Sat 18 Jan 2014 13:13:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:13:24 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:13:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:13:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:13:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:13:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:13:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:13:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:13:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:13:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:13:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:13:34 - XML: Processed 655190 elements - found 492 jobs
Sat 18 Jan 2014 13:13:34 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:13:34 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:13:34 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:13:34 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:13:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:13:37 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:13:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:13:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:13:37 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:13:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 13:13:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:13:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:13:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:13:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:13:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:13:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:13:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43782842
Sat 18 Jan 2014 13:13:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:13:40 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:13:41 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 13:13:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43782842
Sat 18 Jan 2014 13:13:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:13:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:13:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:13:49 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:13:49 - job_xml_thread(): Done retrieving: data size 43782842
Sat 18 Jan 2014 13:13:49 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:13:49 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 13:13:50 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 13:13:50 - Housekeeping: done.
Sat 18 Jan 2014 13:13:50 - XML: Start document: iteration 0
Sat 18 Jan 2014 13:13:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:13:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:13:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:13:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:13:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:13:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:13:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:13:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:13:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:13:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:13:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:14:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:14:01 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:14:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:14:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:14:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:14:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:14:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:14:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:14:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:14:03 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:14:03 - XML: Processed 655190 elements - found 492 jobs
Sat 18 Jan 2014 13:14:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:14:03 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:14:03 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:14:03 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:14:03 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:14:03 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:14:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 13:14:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 13:14:03 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:14:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5725 values 90225 bits 11278 bytes 
Sat 18 Jan 2014 13:14:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:14:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43810054
Sat 18 Jan 2014 13:14:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:14:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43810054
Sat 18 Jan 2014 13:14:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:14:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:14:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:14:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:14:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:14:18 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:14:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:14:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:14:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:14:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:14:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:14:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:14:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:14:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:14:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:14:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:14:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:14:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:14:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:14:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:14:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:14:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:14:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:14:25 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:14:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 13:14:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:14:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:14:28 - job_xml_thread(): Done retrieving: data size 43791651
Sat 18 Jan 2014 13:14:28 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:14:28 - XML: Start document: iteration 1
Sat 18 Jan 2014 13:14:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43791651
Sat 18 Jan 2014 13:14:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:14:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43791651
Sat 18 Jan 2014 13:14:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:14:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:14:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:14:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:14:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:14:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:14:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:14:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:14:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:14:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:14:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:14:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:14:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:14:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:14:47 - XML: Processed 655188 elements - found 491 jobs
Sat 18 Jan 2014 13:14:47 - job 7348853 appears to have finished
Sat 18 Jan 2014 13:14:47 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 13:14:47 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 13:14:47 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 13:14:47 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:14:47 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:14:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:14:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:14:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:14:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:14:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:14:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:14:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:14:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:14:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:14:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43812009
Sat 18 Jan 2014 13:14:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:14:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43812009
Sat 18 Jan 2014 13:14:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:14:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:14:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:15:02 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:15:02 - job_xml_thread(): Done retrieving: data size 43812009
Sat 18 Jan 2014 13:15:02 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:15:02 - XML: Start document: iteration 2
Sat 18 Jan 2014 13:15:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:15:04 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:15:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:15:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 13:15:05 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:15:05 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:15:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 13:15:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8780 values 138399 bits 17299 bytes 
Sat 18 Jan 2014 13:15:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:15:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:15:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:15:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:15:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:15:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:15:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:15:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:15:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:15:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:15:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:15:17 - XML: Processed 655188 elements - found 491 jobs
Sat 18 Jan 2014 13:15:17 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:15:17 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:15:17 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:15:17 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:15:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:15:19 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:15:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:15:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:15:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:15:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:15:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:15:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:15:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:15:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43808880
Sat 18 Jan 2014 13:15:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:15:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43808880
Sat 18 Jan 2014 13:15:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:15:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:15:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:15:32 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:15:32 - job_xml_thread(): Done retrieving: data size 43808880
Sat 18 Jan 2014 13:15:32 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:15:32 - XML: Start document: iteration 3
Sat 18 Jan 2014 13:15:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:15:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:15:43 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:15:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 13:15:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:15:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:15:45 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:15:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:15:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:15:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:15:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:15:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:15:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:15:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:15:47 - XML: Processed 655188 elements - found 491 jobs
Sat 18 Jan 2014 13:15:47 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:15:47 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:15:47 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:15:47 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:15:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:15:48 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:15:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:15:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:15:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:15:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:15:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:15:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:15:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:15:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43827651
Sat 18 Jan 2014 13:15:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:15:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43827651
Sat 18 Jan 2014 13:15:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:16:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:16:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:16:02 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:16:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:16:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:16:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:16:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:16:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:16:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:16:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:16:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:16:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:16:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:16:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:16:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:16:06 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:16:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:16:06 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:16:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 13:16:06 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:16:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 13:16:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6101 values 96261 bits 12032 bytes 
Sat 18 Jan 2014 13:16:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:16:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:16:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:16:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:16:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:16:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:16:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:16:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:16:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:16:12 - job_xml_thread(): Done retrieving: data size 43816443
Sat 18 Jan 2014 13:16:12 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:16:12 - XML: Start document: iteration 4
Sat 18 Jan 2014 13:16:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43816443
Sat 18 Jan 2014 13:16:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:16:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43816443
Sat 18 Jan 2014 13:16:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:16:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:16:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:16:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:16:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:16:29 - XML: Processed 655188 elements - found 491 jobs
Sat 18 Jan 2014 13:16:29 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:16:29 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:16:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:16:30 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:16:30 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:16:30 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:16:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:16:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:16:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:16:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:16:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:16:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:16:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:16:34 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:16:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 13:16:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:16:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:16:35 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:16:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:16:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:16:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:16:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:16:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:16:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:16:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:16:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43821185
Sat 18 Jan 2014 13:16:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:16:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43821185
Sat 18 Jan 2014 13:16:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:16:45 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:16:45 - job_xml_thread(): Done retrieving: data size 43821185
Sat 18 Jan 2014 13:16:45 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:16:45 - XML: Start document: iteration 5
Sat 18 Jan 2014 13:16:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:16:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:16:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:16:48 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:16:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:16:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:16:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:16:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:16:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:16:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:16:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:16:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:16:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:16:55 - XML: Processed 655190 elements - found 492 jobs
Sat 18 Jan 2014 13:16:55 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 13:16:55 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 13:16:56 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 13:16:56 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:16:56 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:17:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:17:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:17:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:17:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:17:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:17:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:17:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:17:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:17:03 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 13:17:03 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 13:17:03 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:17:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:17:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43791026
Sat 18 Jan 2014 13:17:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:17:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43791026
Sat 18 Jan 2014 13:17:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:17:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:17:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:17:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:17:06 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:17:07 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:17:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:17:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 13:17:07 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:17:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 13:17:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8906 values 140800 bits 17600 bytes 
Sat 18 Jan 2014 13:17:11 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:17:11 - job_xml_thread(): Done retrieving: data size 43791026
Sat 18 Jan 2014 13:17:11 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:17:11 - XML: Start document: iteration 6
Sat 18 Jan 2014 13:17:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:17:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:17:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:17:20 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:17:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:17:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:17:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:17:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:17:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:17:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:17:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:17:23 - XML: Processed 655190 elements - found 492 jobs
Sat 18 Jan 2014 13:17:23 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:17:23 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:17:23 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:17:23 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:17:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:17:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:17:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:17:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:17:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:17:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:17:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:17:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:17:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:17:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43747211
Sat 18 Jan 2014 13:17:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:17:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43747211
Sat 18 Jan 2014 13:17:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:17:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:17:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:17:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:17:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:17:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:17:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:17:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:17:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:17:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:17:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:17:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43747211
Sat 18 Jan 2014 13:17:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:17:38 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:17:38 - job_xml_thread(): Done retrieving: data size 43747211
Sat 18 Jan 2014 13:17:38 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:17:38 - XML: Start document: iteration 7
Sat 18 Jan 2014 13:17:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:17:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:17:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:17:50 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:17:52 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:17:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 13:17:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:17:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:17:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:17:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:17:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:17:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:17:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:17:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:17:55 - XML: Processed 654442 elements - found 492 jobs
Sat 18 Jan 2014 13:17:55 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:17:55 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:17:55 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:17:55 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:17:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:17:57 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:17:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:17:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:17:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:17:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:17:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:17:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:17:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:17:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43164827
Sat 18 Jan 2014 13:17:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:17:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43164827
Sat 18 Jan 2014 13:17:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:18:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:18:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:18:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:18:08 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:18:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:18:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:18:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:18:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:18:08 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:18:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:18:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 13:18:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 13:18:08 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:18:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6208 values 98247 bits 12280 bytes 
Sat 18 Jan 2014 13:18:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:18:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:18:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:18:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:18:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:18:10 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:18:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:18:12 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:18:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:18:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:18:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:18:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:18:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:18:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:18:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:18:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43190688
Sat 18 Jan 2014 13:18:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:18:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43190688
Sat 18 Jan 2014 13:18:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:18:16 - job_xml_thread(): Done retrieving: data size 43190688
Sat 18 Jan 2014 13:18:16 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:18:16 - XML: Start document: iteration 8
Sat 18 Jan 2014 13:18:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:18:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:18:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:18:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:18:31 - XML: Processed 647385 elements - found 492 jobs
Sat 18 Jan 2014 13:18:31 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:18:31 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:18:31 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:18:31 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:18:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:18:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:18:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:18:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:18:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:18:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:18:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:18:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:18:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:18:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:18:37 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:18:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:18:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:18:37 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:18:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 13:18:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:18:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:18:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:18:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:18:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:18:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:18:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43643635
Sat 18 Jan 2014 13:18:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:18:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43643635
Sat 18 Jan 2014 13:18:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:18:47 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:18:47 - job_xml_thread(): Done retrieving: data size 43643635
Sat 18 Jan 2014 13:18:47 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:18:47 - XML: Start document: iteration 9
Sat 18 Jan 2014 13:18:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:18:51 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:18:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:18:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:18:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:18:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:18:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:18:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:18:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:18:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:18:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:19:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:19:01 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:19:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:19:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:19:02 - XML: Processed 652810 elements - found 492 jobs
Sat 18 Jan 2014 13:19:02 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:19:02 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:19:02 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:19:02 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:19:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:19:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:19:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:19:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:19:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:19:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43786615
Sat 18 Jan 2014 13:19:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:19:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43786615
Sat 18 Jan 2014 13:19:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:19:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:19:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:19:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:19:08 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:19:11 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:19:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 13:19:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:19:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 13:19:12 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:19:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8998 values 142017 bits 17752 bytes 
Sat 18 Jan 2014 13:19:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:19:14 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:19:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:19:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:19:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:19:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:19:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:19:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:19:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:19:17 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:19:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:19:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:19:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:19:18 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:19:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:19:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:19:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:19:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:19:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:19:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:19:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:19:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43813927
Sat 18 Jan 2014 13:19:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:19:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43813927
Sat 18 Jan 2014 13:19:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:19:21 - job_xml_thread(): Done retrieving: data size 43813927
Sat 18 Jan 2014 13:19:21 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:19:21 - XML: Start document: iteration 10
Sat 18 Jan 2014 13:19:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:19:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:19:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:19:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:19:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:19:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:19:38 - XML: Processed 655190 elements - found 492 jobs
Sat 18 Jan 2014 13:19:38 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:19:38 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:19:38 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:19:38 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:19:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:19:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:19:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:19:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:19:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:19:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:19:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:19:41 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 13:19:41 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:19:42 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:19:42 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 13:19:42 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:19:42 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 13:19:42 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 13:19:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:19:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:19:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:19:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:19:45 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 801101 values 12656614 bits 1582076 bytes 
Sat 18 Jan 2014 13:19:45 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:19:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 13:19:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:19:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:19:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:19:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:19:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:19:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:19:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43791695
Sat 18 Jan 2014 13:19:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:19:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43791695
Sat 18 Jan 2014 13:19:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:19:54 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:19:54 - job_xml_thread(): Done retrieving: data size 43791695
Sat 18 Jan 2014 13:19:54 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:19:54 - XML: Start document: iteration 11
Sat 18 Jan 2014 13:19:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:19:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:20:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:20:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:20:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:20:00 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:20:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:20:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:20:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:20:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:20:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:20:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:20:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:20:10 - XML: Processed 655190 elements - found 492 jobs
Sat 18 Jan 2014 13:20:11 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:20:11 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:20:11 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:20:11 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:20:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:20:11 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:20:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:20:11 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:20:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 13:20:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 13:20:11 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:20:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:20:12 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:20:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5740 values 90509 bits 11313 bytes 
Sat 18 Jan 2014 13:20:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:20:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:20:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:20:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:20:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:20:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:20:16 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:20:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 13:20:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:20:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:20:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:20:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:20:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43774013
Sat 18 Jan 2014 13:20:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:20:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43774013
Sat 18 Jan 2014 13:20:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:20:26 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:20:26 - job_xml_thread(): Done retrieving: data size 43774013
Sat 18 Jan 2014 13:20:26 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:20:26 - XML: Start document: iteration 12
Sat 18 Jan 2014 13:20:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:20:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:20:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:20:31 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:20:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:20:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:20:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:20:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:20:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:20:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:20:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:20:40 - XML: Processed 655190 elements - found 492 jobs
Sat 18 Jan 2014 13:20:41 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:20:41 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:20:41 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:20:41 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:20:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:20:41 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:20:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:20:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:20:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:20:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:20:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:20:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:20:42 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:20:42 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 13:20:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:20:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43783005
Sat 18 Jan 2014 13:20:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:20:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43783005
Sat 18 Jan 2014 13:20:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:20:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:20:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:20:56 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:20:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:20:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:20:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:20:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:20:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:20:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:20:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:20:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:20:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:20:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:20:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:21:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:21:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:21:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:21:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:21:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:21:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:21:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:21:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:21:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:21:03 - job_xml_thread(): Done retrieving: data size 43814354
Sat 18 Jan 2014 13:21:03 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:21:03 - XML: Start document: iteration 13
Sat 18 Jan 2014 13:21:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43814354
Sat 18 Jan 2014 13:21:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:21:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43814354
Sat 18 Jan 2014 13:21:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:21:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:21:11 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:21:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:21:12 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:21:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 13:21:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 13:21:12 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:21:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9279 values 146454 bits 18306 bytes 
Sat 18 Jan 2014 13:21:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:21:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:21:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:21:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:21:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:21:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:21:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:21:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:21:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:21:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:21:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:21:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:21:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:21:25 - XML: Processed 655192 elements - found 493 jobs
Sat 18 Jan 2014 13:21:25 - job 7348849 appears to have finished
Sat 18 Jan 2014 13:21:25 - job_xml_thread(): Found 3 updated jobs.
Sat 18 Jan 2014 13:21:25 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 13:21:25 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Sat 18 Jan 2014 13:21:25 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:21:25 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:21:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:21:27 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:21:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:21:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:21:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:21:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:21:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:21:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:21:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:21:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43811291
Sat 18 Jan 2014 13:21:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:21:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43811291
Sat 18 Jan 2014 13:21:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:21:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:21:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:21:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:21:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:21:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:21:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:21:40 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:21:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 13:21:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:21:40 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:21:40 - job_xml_thread(): Done retrieving: data size 43811291
Sat 18 Jan 2014 13:21:40 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:21:40 - XML: Start document: iteration 14
Sat 18 Jan 2014 13:21:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:21:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:21:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:21:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43811291
Sat 18 Jan 2014 13:21:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:21:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:21:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:21:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:21:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:21:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:21:58 - XML: Processed 655192 elements - found 493 jobs
Sat 18 Jan 2014 13:21:58 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:21:58 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:21:58 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:21:58 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:21:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:21:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:21:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:21:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:22:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:22:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:22:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:22:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:22:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:22:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:22:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:22:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:22:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:22:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:22:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:22:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:22:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:22:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:22:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43838360
Sat 18 Jan 2014 13:22:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:22:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43838360
Sat 18 Jan 2014 13:22:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:22:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:22:12 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:22:13 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:22:13 - job_xml_thread(): Done retrieving: data size 43838360
Sat 18 Jan 2014 13:22:13 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:22:13 - XML: Start document: iteration 15
Sat 18 Jan 2014 13:22:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:22:13 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:22:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:22:13 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:22:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 13:22:13 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:22:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 13:22:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99073 bits 12384 bytes 
Sat 18 Jan 2014 13:22:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:22:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:22:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:22:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:22:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:22:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:22:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:22:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:22:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:22:24 - XML: Processed 655192 elements - found 493 jobs
Sat 18 Jan 2014 13:22:24 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:22:25 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:22:25 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:22:25 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:22:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:22:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:22:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:22:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:22:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:22:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:22:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:22:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:22:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:22:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43782742
Sat 18 Jan 2014 13:22:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:22:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43782742
Sat 18 Jan 2014 13:22:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:22:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:22:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:22:40 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:22:40 - job_xml_thread(): Done retrieving: data size 43782742
Sat 18 Jan 2014 13:22:40 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:22:40 - XML: Start document: iteration 16
Sat 18 Jan 2014 13:22:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:22:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:22:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:22:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:22:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:22:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:22:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:22:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:22:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:22:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:22:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:22:45 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:22:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 13:22:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:22:50 - XML: Processed 655190 elements - found 492 jobs
Sat 18 Jan 2014 13:22:50 - job 7348921 appears to have finished
Sat 18 Jan 2014 13:22:50 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 13:22:50 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 13:22:51 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 13:22:51 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:22:51 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:22:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:22:54 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:22:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:22:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:22:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:22:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:22:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:22:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:22:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:22:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43789553
Sat 18 Jan 2014 13:22:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:22:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:22:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:22:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43789553
Sat 18 Jan 2014 13:22:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:23:06 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:23:06 - job_xml_thread(): Done retrieving: data size 43789553
Sat 18 Jan 2014 13:23:06 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:23:06 - XML: Start document: iteration 17
Sat 18 Jan 2014 13:23:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:23:07 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:23:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:23:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:23:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:23:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:23:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:23:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:23:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:23:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:23:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:23:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:23:13 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:23:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:23:14 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:23:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 13:23:14 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:23:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 13:23:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5977 values 94363 bits 11795 bytes 
Sat 18 Jan 2014 13:23:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:23:19 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:23:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:23:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:23:20 - XML: Processed 655187 elements - found 492 jobs
Sat 18 Jan 2014 13:23:20 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:23:20 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:23:20 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:23:20 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:23:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:23:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:23:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:23:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:23:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:23:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43733534
Sat 18 Jan 2014 13:23:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:23:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43733534
Sat 18 Jan 2014 13:23:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:23:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:23:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:23:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:23:33 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:23:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:23:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:23:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:23:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:23:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:23:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:23:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:23:35 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:23:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:23:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:23:38 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:23:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 13:23:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:23:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:23:39 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:23:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:23:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:23:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:23:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:23:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:23:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:23:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:23:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43228704
Sat 18 Jan 2014 13:23:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:23:42 - job_xml_thread(): Done retrieving: data size 43228704
Sat 18 Jan 2014 13:23:42 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:23:42 - XML: Start document: iteration 18
Sat 18 Jan 2014 13:23:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43228704
Sat 18 Jan 2014 13:23:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:23:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:23:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:23:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:23:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:24:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:24:01 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:24:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:24:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:24:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:24:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:24:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:24:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:24:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:24:04 - XML: Processed 647949 elements - found 492 jobs
Sat 18 Jan 2014 13:24:05 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:24:05 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:24:05 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:24:05 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:24:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:24:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:24:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:24:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:24:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:24:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:24:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:24:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:24:08 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 13:24:08 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 13:24:08 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:24:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:24:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43159377
Sat 18 Jan 2014 13:24:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:24:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43159377
Sat 18 Jan 2014 13:24:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:24:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:24:14 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:24:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:24:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 13:24:16 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:24:16 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:24:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 13:24:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:24:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:24:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8881 values 140048 bits 17506 bytes 
Sat 18 Jan 2014 13:24:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:24:19 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:24:20 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:24:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:24:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:24:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:24:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:24:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:24:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:24:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:24:23 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:24:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:24:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:24:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:24:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:24:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:24:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:24:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:24:25 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:24:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 13:24:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:24:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:24:25 - job_xml_thread(): Done retrieving: data size 43236161
Sat 18 Jan 2014 13:24:25 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:24:25 - XML: Start document: iteration 19
Sat 18 Jan 2014 13:24:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43236161
Sat 18 Jan 2014 13:24:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:24:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43236161
Sat 18 Jan 2014 13:24:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:24:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:24:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:24:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:24:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:24:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:24:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:24:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:24:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:24:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:24:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:24:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:24:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:24:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:24:43 - XML: Processed 647748 elements - found 491 jobs
Sat 18 Jan 2014 13:24:43 - job 7348848 appears to have finished
Sat 18 Jan 2014 13:24:43 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 13:24:43 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 13:24:44 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 13:24:44 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:24:44 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:24:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:24:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:24:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:24:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:24:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:24:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:24:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:24:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:24:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:24:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43730337
Sat 18 Jan 2014 13:24:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:24:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43730337
Sat 18 Jan 2014 13:24:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:24:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:24:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:24:59 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:24:59 - job_xml_thread(): Done retrieving: data size 43730337
Sat 18 Jan 2014 13:24:59 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:24:59 - XML: Start document: iteration 20
Sat 18 Jan 2014 13:25:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:25:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:25:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:25:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:25:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:25:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:25:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:25:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:25:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:25:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:25:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:25:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:25:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:25:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:25:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:25:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:25:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:25:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:25:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:25:11 - XML: Processed 654324 elements - found 491 jobs
Sat 18 Jan 2014 13:25:11 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:25:11 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:25:11 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:25:11 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:25:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:25:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43793283
Sat 18 Jan 2014 13:25:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:25:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43793283
Sat 18 Jan 2014 13:25:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:25:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:25:16 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:25:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:25:16 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:25:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 13:25:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 13:25:16 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:25:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9268 values 146175 bits 18271 bytes 
Sat 18 Jan 2014 13:25:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:25:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:25:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:25:24 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:25:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:25:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:25:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:25:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:25:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:25:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:25:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:25:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:25:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:25:26 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:25:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:25:27 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:25:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:25:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:25:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:25:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:25:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:25:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:25:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:25:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43803991
Sat 18 Jan 2014 13:25:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:25:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43803991
Sat 18 Jan 2014 13:25:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:25:30 - job_xml_thread(): Done retrieving: data size 43803991
Sat 18 Jan 2014 13:25:30 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:25:30 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 13:25:30 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 13:25:30 - Housekeeping: done.
Sat 18 Jan 2014 13:25:31 - XML: Start document: iteration 0
Sat 18 Jan 2014 13:25:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:25:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:25:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:25:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:25:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:25:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:25:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:25:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:25:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:25:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:25:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:25:49 - XML: Processed 655188 elements - found 491 jobs
Sat 18 Jan 2014 13:25:49 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:25:49 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:25:50 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:25:50 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:25:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:25:53 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:25:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:25:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:25:53 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:25:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 13:25:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:25:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:25:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:25:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:25:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:25:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:25:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43801824
Sat 18 Jan 2014 13:25:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:25:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43801824
Sat 18 Jan 2014 13:25:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:25:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:25:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:26:05 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:26:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:26:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:26:07 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:26:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:26:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:26:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:26:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:26:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:26:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:26:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:26:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:26:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:26:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:26:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:26:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:26:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:26:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:26:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:26:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:26:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:26:11 - job_xml_thread(): Done retrieving: data size 43826601
Sat 18 Jan 2014 13:26:11 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:26:11 - XML: Start document: iteration 1
Sat 18 Jan 2014 13:26:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43826601
Sat 18 Jan 2014 13:26:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:26:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43826601
Sat 18 Jan 2014 13:26:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:26:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:26:16 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:26:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:26:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 13:26:18 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:26:18 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:26:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 13:26:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9021 values 142255 bits 17781 bytes 
Sat 18 Jan 2014 13:26:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:26:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:26:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:26:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:26:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:26:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:26:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:26:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:26:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:26:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:26:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:26:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:26:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:26:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:26:33 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:26:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:26:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:26:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:26:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:26:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:26:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:26:34 - XML: Processed 655188 elements - found 491 jobs
Sat 18 Jan 2014 13:26:34 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:26:34 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:26:34 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:26:34 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:26:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:26:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43815292
Sat 18 Jan 2014 13:26:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:26:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43815292
Sat 18 Jan 2014 13:26:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:26:42 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 13:26:42 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:26:45 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:26:45 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:26:45 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 13:26:45 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 13:26:45 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 13:26:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:26:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:26:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:26:46 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:26:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:26:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:26:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:26:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:26:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:26:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:26:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:26:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:26:49 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:26:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:26:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:26:52 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:26:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:26:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:26:52 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 814403 values 12838799 bits 1604849 bytes 
Sat 18 Jan 2014 13:26:53 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:26:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 13:26:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:26:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:26:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:26:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:26:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:26:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:26:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43827636
Sat 18 Jan 2014 13:26:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:26:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43827636
Sat 18 Jan 2014 13:26:56 - job_xml_thread(): Done retrieving: data size 43827636
Sat 18 Jan 2014 13:26:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:26:56 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:26:56 - XML: Start document: iteration 2
Sat 18 Jan 2014 13:27:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:27:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:27:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:27:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:27:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:27:13 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:27:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:27:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:27:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:27:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:27:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:27:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:27:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:27:15 - XML: Processed 655188 elements - found 491 jobs
Sat 18 Jan 2014 13:27:15 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:27:15 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:27:15 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:27:15 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:27:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:27:18 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:27:19 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:27:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 13:27:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:27:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 13:27:19 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:27:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5962 values 94094 bits 11761 bytes 
Sat 18 Jan 2014 13:27:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:27:19 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:27:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:27:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:27:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:27:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:27:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:27:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:27:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:27:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43808958
Sat 18 Jan 2014 13:27:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:27:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43808958
Sat 18 Jan 2014 13:27:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:27:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:27:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:27:30 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:27:30 - job_xml_thread(): Done retrieving: data size 43808958
Sat 18 Jan 2014 13:27:30 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:27:30 - XML: Start document: iteration 3
Sat 18 Jan 2014 13:27:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:27:33 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:27:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:27:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:27:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:27:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:27:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:27:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:27:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:27:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:27:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:27:39 - XML: Processed 655188 elements - found 491 jobs
Sat 18 Jan 2014 13:27:39 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:27:39 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:27:39 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:27:39 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:27:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:27:43 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:27:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:27:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:27:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:27:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:27:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:27:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:27:44 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:27:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 13:27:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:27:45 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:27:45 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 13:27:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:27:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43787362
Sat 18 Jan 2014 13:27:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:27:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43787362
Sat 18 Jan 2014 13:27:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:27:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:27:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:27:54 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:27:55 - job_xml_thread(): Done retrieving: data size 43787362
Sat 18 Jan 2014 13:27:55 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:27:55 - XML: Start document: iteration 4
Sat 18 Jan 2014 13:27:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:27:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:27:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:27:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:27:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:27:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:27:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:27:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:27:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:27:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:27:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:28:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:28:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:28:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:28:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:28:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:28:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:28:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:28:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:28:11 - XML: Processed 655188 elements - found 491 jobs
Sat 18 Jan 2014 13:28:11 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:28:11 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:28:11 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:28:11 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:28:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:28:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43791339
Sat 18 Jan 2014 13:28:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:28:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43791339
Sat 18 Jan 2014 13:28:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:28:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:28:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:28:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:28:19 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:28:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:28:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 13:28:20 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:28:20 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:28:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 13:28:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8535 values 134611 bits 16826 bytes 
Sat 18 Jan 2014 13:28:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:28:24 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:28:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:28:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:28:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:28:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:28:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:28:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:28:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:28:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:28:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:28:26 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:28:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:28:30 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:28:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:28:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:28:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:28:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:28:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:28:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:28:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:28:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43801710
Sat 18 Jan 2014 13:28:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:28:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43801710
Sat 18 Jan 2014 13:28:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:28:34 - job_xml_thread(): Done retrieving: data size 43801710
Sat 18 Jan 2014 13:28:34 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:28:34 - XML: Start document: iteration 5
Sat 18 Jan 2014 13:28:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:28:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:28:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:28:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:28:50 - XML: Processed 655188 elements - found 491 jobs
Sat 18 Jan 2014 13:28:50 - job 7348852 appears to have finished
Sat 18 Jan 2014 13:28:50 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 13:28:50 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 13:28:52 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 13:28:52 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:28:52 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:28:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:28:52 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:28:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:28:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:28:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:28:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:28:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:28:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:28:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:28:56 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:28:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 13:28:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:28:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:28:57 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:28:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:28:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:28:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:28:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:28:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:28:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:28:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:28:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43815796
Sat 18 Jan 2014 13:28:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:28:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43815796
Sat 18 Jan 2014 13:29:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:29:07 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:29:08 - job_xml_thread(): Done retrieving: data size 43815796
Sat 18 Jan 2014 13:29:08 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:29:08 - XML: Start document: iteration 6
Sat 18 Jan 2014 13:29:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:29:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:29:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:29:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:29:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:29:15 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:29:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:29:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:29:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:29:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:29:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:29:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:29:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:29:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:29:20 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:29:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:29:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 13:29:20 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:29:20 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:29:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 13:29:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5782 values 91176 bits 11397 bytes 
Sat 18 Jan 2014 13:29:23 - XML: Processed 655188 elements - found 491 jobs
Sat 18 Jan 2014 13:29:23 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:29:23 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:29:23 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:29:23 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:29:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:29:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:29:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:29:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:29:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:29:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:29:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:29:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:29:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:29:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43742385
Sat 18 Jan 2014 13:29:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:29:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43742385
Sat 18 Jan 2014 13:29:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:29:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:29:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:29:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:29:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:29:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:29:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:29:38 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:29:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:29:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:29:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:29:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:29:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:29:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:29:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:29:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:29:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:29:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:29:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:29:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:29:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:29:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:29:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:29:44 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:29:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 13:29:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:29:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:29:47 - job_xml_thread(): Done retrieving: data size 43212010
Sat 18 Jan 2014 13:29:47 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:29:47 - XML: Start document: iteration 7
Sat 18 Jan 2014 13:29:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43212010
Sat 18 Jan 2014 13:29:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:29:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43212010
Sat 18 Jan 2014 13:29:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:29:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:29:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:29:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:29:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:30:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:30:03 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:30:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:30:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:30:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:30:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:30:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:30:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:30:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:30:07 - XML: Processed 647996 elements - found 491 jobs
Sat 18 Jan 2014 13:30:07 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:30:07 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:30:07 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:30:07 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:30:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:30:11 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:30:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:30:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:30:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:30:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:30:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:30:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:30:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:30:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43170534
Sat 18 Jan 2014 13:30:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:30:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43170534
Sat 18 Jan 2014 13:30:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:30:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:30:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:30:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:30:20 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:30:21 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:30:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:30:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 13:30:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 13:30:21 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:30:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8856 values 139652 bits 17456 bytes 
Sat 18 Jan 2014 13:30:22 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:30:23 - job_xml_thread(): Done retrieving: data size 43170534
Sat 18 Jan 2014 13:30:23 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:30:23 - XML: Start document: iteration 8
Sat 18 Jan 2014 13:30:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:30:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:30:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:30:31 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:30:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:30:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:30:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:30:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:30:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:30:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:30:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:30:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:30:32 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:30:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:30:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:30:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:30:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:30:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:30:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:30:35 - XML: Processed 647307 elements - found 491 jobs
Sat 18 Jan 2014 13:30:35 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:30:35 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:30:35 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:30:35 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:30:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:30:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575268
Sat 18 Jan 2014 13:30:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:30:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575268
Sat 18 Jan 2014 13:30:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:30:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:30:46 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:30:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:30:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:30:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:30:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:30:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:30:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:30:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:30:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:30:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:30:48 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:30:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 13:30:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:30:50 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:30:51 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 13:30:51 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 13:30:51 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:30:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:30:52 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:30:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:30:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:30:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:30:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:30:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:30:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:30:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:30:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43776322
Sat 18 Jan 2014 13:30:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:30:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43776322
Sat 18 Jan 2014 13:30:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:30:55 - job_xml_thread(): Done retrieving: data size 43776322
Sat 18 Jan 2014 13:30:55 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:30:55 - XML: Start document: iteration 9
Sat 18 Jan 2014 13:31:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:31:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:31:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:31:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:31:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:31:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:31:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:31:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:31:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:31:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:31:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:31:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:31:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:31:15 - XML: Processed 654654 elements - found 491 jobs
Sat 18 Jan 2014 13:31:15 - job 7348924 field 'start_timestamp' changed since saved from: 1390048117 to: 1390048039
Sat 18 Jan 2014 13:31:15 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 13:31:15 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 13:31:17 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 13:31:17 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:31:17 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:31:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:31:18 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:31:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:31:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:31:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:31:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:31:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:31:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:31:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:31:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43810133
Sat 18 Jan 2014 13:31:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:31:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43810133
Sat 18 Jan 2014 13:31:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:31:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:31:21 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:31:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:31:22 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:31:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 13:31:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 13:31:23 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:31:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9158 values 144585 bits 18073 bytes 
Sat 18 Jan 2014 13:31:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:31:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:31:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:31:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:31:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:31:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:31:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:31:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:31:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:31:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:31:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43810133
Sat 18 Jan 2014 13:31:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:31:32 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:31:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:31:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:31:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:31:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:31:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:31:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:31:40 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:31:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:31:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:31:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:31:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:31:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:31:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:31:42 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:31:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 13:31:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:31:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:31:43 - job_xml_thread(): Done retrieving: data size 43792065
Sat 18 Jan 2014 13:31:43 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:31:43 - XML: Start document: iteration 10
Sat 18 Jan 2014 13:31:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43792065
Sat 18 Jan 2014 13:31:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:31:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:31:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:31:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:31:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:31:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:31:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:31:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43792065
Sat 18 Jan 2014 13:31:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:31:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:31:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:31:56 - XML: Processed 655188 elements - found 491 jobs
Sat 18 Jan 2014 13:31:56 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:31:56 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:31:56 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:31:56 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:31:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:31:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:32:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:32:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:32:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:32:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:32:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:32:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:32:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:32:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:32:02 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:32:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:32:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:32:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:32:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:32:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:32:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:32:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:32:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43828131
Sat 18 Jan 2014 13:32:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:32:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43828131
Sat 18 Jan 2014 13:32:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:32:11 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:32:11 - job_xml_thread(): Done retrieving: data size 43828131
Sat 18 Jan 2014 13:32:11 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:32:11 - XML: Start document: iteration 11
Sat 18 Jan 2014 13:32:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:32:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:32:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:32:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:32:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:32:20 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:32:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:32:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:32:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:32:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:32:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:32:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:32:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:32:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:32:23 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:32:24 - XML: Processed 655188 elements - found 491 jobs
Sat 18 Jan 2014 13:32:24 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:32:24 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:32:24 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:32:24 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:32:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:32:24 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:32:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 13:32:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 13:32:24 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:32:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6373 values 100776 bits 12597 bytes 
Sat 18 Jan 2014 13:32:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:32:27 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:32:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:32:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:32:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:32:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:32:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:32:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:32:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:32:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43796828
Sat 18 Jan 2014 13:32:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:32:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43796828
Sat 18 Jan 2014 13:32:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:32:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:32:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:32:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:32:39 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:32:39 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:32:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:32:39 - job_xml_thread(): Done retrieving: data size 43796828
Sat 18 Jan 2014 13:32:39 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:32:39 - XML: Start document: iteration 12
Sat 18 Jan 2014 13:32:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:32:39 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:32:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 13:32:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:32:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:32:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:32:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:32:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:32:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:32:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:32:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:32:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:32:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:32:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:32:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:32:52 - XML: Processed 655188 elements - found 491 jobs
Sat 18 Jan 2014 13:32:52 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:32:52 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:32:52 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:32:52 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:32:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:32:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:32:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:32:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:32:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:32:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43812448
Sat 18 Jan 2014 13:32:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:32:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43812448
Sat 18 Jan 2014 13:32:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:32:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:32:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:33:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:33:02 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:33:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:33:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:33:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:33:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:33:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:33:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:33:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43812448
Sat 18 Jan 2014 13:33:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:33:07 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:33:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:33:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:33:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:33:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:33:15 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:33:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:33:16 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:33:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:33:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:33:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:33:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:33:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:33:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:33:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:33:18 - job_xml_thread(): Done retrieving: data size 43798934
Sat 18 Jan 2014 13:33:18 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:33:18 - XML: Start document: iteration 13
Sat 18 Jan 2014 13:33:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:33:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:33:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43798934
Sat 18 Jan 2014 13:33:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:33:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:33:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:33:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43798934
Sat 18 Jan 2014 13:33:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:33:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:33:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:33:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:33:24 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:33:25 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:33:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:33:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 13:33:25 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:33:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9347 values 147823 bits 18477 bytes 
Sat 18 Jan 2014 13:33:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 13:33:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:33:31 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:33:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:33:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:33:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:33:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:33:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:33:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:33:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:33:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:33:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:33:39 - XML: Processed 655188 elements - found 491 jobs
Sat 18 Jan 2014 13:33:39 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:33:39 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:33:39 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:33:39 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:33:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:33:40 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:33:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:33:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:33:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:33:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:33:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:33:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:33:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:33:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43810107
Sat 18 Jan 2014 13:33:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:33:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43810107
Sat 18 Jan 2014 13:33:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:33:45 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 13:33:45 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:33:46 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:33:46 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 13:33:46 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 13:33:46 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:33:46 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 13:33:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:33:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:33:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:33:52 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:33:52 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:33:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 13:33:52 - size of cluster 'LISA Cluster': 624 hosts 79468 metrics 738823 values 11670841 bits 1458855 bytes 
Sat 18 Jan 2014 13:33:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:33:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:33:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:33:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:33:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:33:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:33:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:33:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:33:54 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:33:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:33:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:33:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:33:57 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:33:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:33:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:33:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:33:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:33:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:33:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:34:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:34:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43806436
Sat 18 Jan 2014 13:34:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:34:00 - job_xml_thread(): Done retrieving: data size 43806436
Sat 18 Jan 2014 13:34:00 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:34:00 - XML: Start document: iteration 14
Sat 18 Jan 2014 13:34:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43806436
Sat 18 Jan 2014 13:34:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:34:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:34:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:34:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:34:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:34:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:34:18 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:34:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:34:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:34:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:34:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:34:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:34:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:34:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:34:20 - XML: Processed 655188 elements - found 491 jobs
Sat 18 Jan 2014 13:34:20 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:34:20 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:34:20 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:34:20 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:34:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:34:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:34:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:34:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:34:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:34:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:34:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:34:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:34:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:34:25 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:34:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:34:26 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:34:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 13:34:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 13:34:26 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:34:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6205 values 97920 bits 12240 bytes 
Sat 18 Jan 2014 13:34:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:34:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43815459
Sat 18 Jan 2014 13:34:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:34:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43815459
Sat 18 Jan 2014 13:34:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:34:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:34:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:34:35 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:34:35 - job_xml_thread(): Done retrieving: data size 43815459
Sat 18 Jan 2014 13:34:35 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:34:35 - XML: Start document: iteration 15
Sat 18 Jan 2014 13:34:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:34:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:34:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:34:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:34:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:34:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:34:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43815459
Sat 18 Jan 2014 13:34:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:34:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:34:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:34:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:34:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:34:46 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:34:46 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 13:34:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:34:48 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:34:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:34:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:34:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:34:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:34:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:34:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:34:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:34:54 - XML: Processed 655186 elements - found 491 jobs
Sat 18 Jan 2014 13:34:54 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:34:54 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:34:54 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:34:54 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:34:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:34:58 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:34:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:34:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:34:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:34:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:34:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:34:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:35:02 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:35:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 13:35:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:35:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:35:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43792573
Sat 18 Jan 2014 13:35:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:35:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43792573
Sat 18 Jan 2014 13:35:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:35:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:35:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:35:09 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:35:09 - job_xml_thread(): Done retrieving: data size 43792573
Sat 18 Jan 2014 13:35:09 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:35:09 - XML: Start document: iteration 16
Sat 18 Jan 2014 13:35:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:35:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:35:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:35:18 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:35:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:35:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:35:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:35:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:35:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:35:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:35:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:35:23 - XML: Processed 655182 elements - found 490 jobs
Sat 18 Jan 2014 13:35:23 - job 7348922 appears to have finished
Sat 18 Jan 2014 13:35:23 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 13:35:23 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 13:35:23 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 13:35:23 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:35:23 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:35:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:35:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:35:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:35:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:35:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:35:26 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:35:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:35:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:35:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:35:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:35:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:35:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 13:35:27 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:35:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 13:35:27 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:35:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 3429 values 54104 bits 6763 bytes 
Sat 18 Jan 2014 13:35:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:35:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43722902
Sat 18 Jan 2014 13:35:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:35:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43722902
Sat 18 Jan 2014 13:35:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:35:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:35:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:35:38 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:35:38 - job_xml_thread(): Done retrieving: data size 43722902
Sat 18 Jan 2014 13:35:38 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:35:38 - XML: Start document: iteration 17
Sat 18 Jan 2014 13:35:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:35:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:35:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:35:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:35:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:35:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:35:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:35:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:35:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:35:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:35:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:35:53 - XML: Processed 654437 elements - found 490 jobs
Sat 18 Jan 2014 13:35:53 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:35:53 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:35:53 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:35:53 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:35:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:35:53 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:35:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:35:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:35:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:35:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:35:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:35:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:35:54 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:35:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 13:35:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:35:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:35:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43182356
Sat 18 Jan 2014 13:35:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:35:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:35:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:35:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43182356
Sat 18 Jan 2014 13:35:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:36:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:36:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:36:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:36:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:36:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:36:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:36:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:36:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:36:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:36:08 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:36:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:36:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:36:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:36:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:36:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:36:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:36:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:36:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:36:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:36:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:36:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:36:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43187047
Sat 18 Jan 2014 13:36:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:36:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43187047
Sat 18 Jan 2014 13:36:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:36:13 - job_xml_thread(): Done retrieving: data size 43187047
Sat 18 Jan 2014 13:36:13 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:36:13 - XML: Start document: iteration 18
Sat 18 Jan 2014 13:36:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:36:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:36:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:36:24 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:36:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:36:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:36:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:36:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:36:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:36:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:36:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:36:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:36:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:36:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:36:27 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:36:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:36:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 13:36:27 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:36:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 13:36:27 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:36:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7962 values 125529 bits 15691 bytes 
Sat 18 Jan 2014 13:36:34 - XML: Processed 647422 elements - found 490 jobs
Sat 18 Jan 2014 13:36:34 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:36:34 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:36:34 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:36:34 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:36:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:36:35 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:36:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:36:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:36:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:36:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:36:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:36:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:36:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:36:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43417641
Sat 18 Jan 2014 13:36:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:36:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43417641
Sat 18 Jan 2014 13:36:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:36:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:36:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:36:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:36:48 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:36:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:36:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:36:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:36:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:36:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:36:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43417641
Sat 18 Jan 2014 13:36:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:36:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:36:49 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:36:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:36:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:36:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:36:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:36:56 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:37:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:37:01 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:37:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:37:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:37:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:37:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:37:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:37:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:37:01 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:37:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 13:37:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:37:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:37:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:37:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:37:03 - job_xml_thread(): Done retrieving: data size 43782086
Sat 18 Jan 2014 13:37:03 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:37:03 - XML: Start document: iteration 19
Sat 18 Jan 2014 13:37:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43782086
Sat 18 Jan 2014 13:37:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:37:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:37:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:37:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:37:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:37:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43782086
Sat 18 Jan 2014 13:37:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:37:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:37:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:37:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:37:19 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:37:20 - XML: Processed 655184 elements - found 489 jobs
Sat 18 Jan 2014 13:37:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:37:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:37:20 - job 7348924 appears to have finished
Sat 18 Jan 2014 13:37:20 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 13:37:20 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 13:37:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:37:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:37:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:37:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:37:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:37:21 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 13:37:21 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:37:21 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:37:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:37:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:37:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:37:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:37:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:37:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:37:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:37:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:37:27 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 13:37:27 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 13:37:27 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:37:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:37:27 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:37:28 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:37:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:37:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 13:37:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 13:37:28 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:37:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5683 values 89576 bits 11197 bytes 
Sat 18 Jan 2014 13:37:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:37:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43811392
Sat 18 Jan 2014 13:37:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:37:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43811392
Sat 18 Jan 2014 13:37:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:37:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:37:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:37:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:37:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:37:36 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:37:36 - job_xml_thread(): Done retrieving: data size 43811392
Sat 18 Jan 2014 13:37:36 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:37:36 - XML: Start document: iteration 20
Sat 18 Jan 2014 13:37:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:37:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:37:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:37:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:37:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43811392
Sat 18 Jan 2014 13:37:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:37:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:37:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:37:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:37:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:37:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:37:46 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:37:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:37:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:37:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:37:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:37:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:37:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:37:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:37:55 - XML: Processed 655184 elements - found 489 jobs
Sat 18 Jan 2014 13:37:55 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:37:55 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:37:55 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:37:55 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:37:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:37:57 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:37:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:37:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:37:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:37:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:37:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:37:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:37:59 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:37:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 13:37:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:37:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:37:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43813705
Sat 18 Jan 2014 13:37:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:38:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43813705
Sat 18 Jan 2014 13:38:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:38:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:38:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:38:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:38:10 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:38:10 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:38:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:38:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:38:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:38:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:38:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:38:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:38:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:38:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:38:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:38:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:38:14 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:38:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:38:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:38:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:38:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:38:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:38:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:38:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:38:15 - job_xml_thread(): Done retrieving: data size 43823387
Sat 18 Jan 2014 13:38:15 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:38:15 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 13:38:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43823387
Sat 18 Jan 2014 13:38:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:38:16 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 13:38:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43823387
Sat 18 Jan 2014 13:38:16 - Housekeeping: done.
Sat 18 Jan 2014 13:38:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:38:16 - XML: Start document: iteration 0
Sat 18 Jan 2014 13:38:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:38:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:38:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:38:28 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:38:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:38:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 13:38:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:38:29 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:38:29 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:38:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 13:38:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:38:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6879 values 108449 bits 13556 bytes 
Sat 18 Jan 2014 13:38:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:38:32 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:38:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:38:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:38:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:38:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:38:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:38:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:38:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:38:36 - XML: Processed 655184 elements - found 489 jobs
Sat 18 Jan 2014 13:38:36 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:38:36 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:38:36 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:38:36 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:38:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:38:39 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:38:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:38:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:38:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:38:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:38:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:38:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:38:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:38:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43823607
Sat 18 Jan 2014 13:38:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:38:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43823607
Sat 18 Jan 2014 13:38:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:38:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:38:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:38:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:38:50 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:38:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:38:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:38:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:38:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:38:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:38:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:38:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:38:51 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:38:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:38:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:38:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:38:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:38:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:38:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:38:55 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:38:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 13:38:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:38:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:38:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:38:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:38:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:38:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:38:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43835275
Sat 18 Jan 2014 13:38:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:38:57 - job_xml_thread(): Done retrieving: data size 43835275
Sat 18 Jan 2014 13:38:57 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:38:57 - XML: Start document: iteration 1
Sat 18 Jan 2014 13:38:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43835275
Sat 18 Jan 2014 13:38:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:39:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:39:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:39:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:39:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:39:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:39:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:39:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:39:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:39:14 - XML: Processed 655182 elements - found 488 jobs
Sat 18 Jan 2014 13:39:14 - job 7348923 appears to have finished
Sat 18 Jan 2014 13:39:14 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 13:39:14 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 13:39:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:39:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:39:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:39:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:39:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:39:15 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 13:39:15 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:39:15 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:39:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:39:18 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:39:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:39:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:39:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:39:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:39:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:39:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:39:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:39:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43810390
Sat 18 Jan 2014 13:39:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:39:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43810390
Sat 18 Jan 2014 13:39:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:39:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:39:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:39:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:39:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:39:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:39:29 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:39:30 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:39:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:39:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:39:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:39:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:39:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:39:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:39:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 13:39:30 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:39:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 13:39:30 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:39:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8938 values 140949 bits 17618 bytes 
Sat 18 Jan 2014 13:39:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:39:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:39:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:39:34 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:39:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:39:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:39:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:39:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:39:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:39:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:39:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:39:36 - job_xml_thread(): Done retrieving: data size 43804882
Sat 18 Jan 2014 13:39:36 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:39:36 - XML: Start document: iteration 2
Sat 18 Jan 2014 13:39:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43804882
Sat 18 Jan 2014 13:39:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:39:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43804882
Sat 18 Jan 2014 13:39:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:39:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:39:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:39:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:39:47 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:39:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:39:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:39:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:39:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:39:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:39:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:39:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:39:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:39:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:39:54 - XML: Processed 655182 elements - found 488 jobs
Sat 18 Jan 2014 13:39:55 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:39:55 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:39:55 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:39:55 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:39:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:39:58 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:39:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:39:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:39:58 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:39:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 13:39:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:39:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:39:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:39:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:39:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:40:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:40:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43795548
Sat 18 Jan 2014 13:40:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:40:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43795548
Sat 18 Jan 2014 13:40:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:40:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:40:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:40:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:40:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:40:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:40:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:40:10 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:40:10 - job_xml_thread(): Done retrieving: data size 43795548
Sat 18 Jan 2014 13:40:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:40:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:40:10 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:40:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:40:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:40:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:40:10 - XML: Start document: iteration 3
Sat 18 Jan 2014 13:40:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:40:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:40:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:40:14 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:40:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:40:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:40:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:40:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:40:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:40:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:40:18 - XML: Processed 655182 elements - found 488 jobs
Sat 18 Jan 2014 13:40:18 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:40:18 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:40:18 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:40:18 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:40:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:40:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43786564
Sat 18 Jan 2014 13:40:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:40:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43786564
Sat 18 Jan 2014 13:40:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:40:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:40:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:40:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:40:30 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:40:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:40:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:40:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:40:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 13:40:31 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:40:31 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:40:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 13:40:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8975 values 141519 bits 17689 bytes 
Sat 18 Jan 2014 13:40:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:40:31 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:40:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:40:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:40:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:40:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:40:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:40:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:40:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:40:33 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:40:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:40:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:40:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:40:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:40:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:40:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:40:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:40:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:40:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:40:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43808612
Sat 18 Jan 2014 13:40:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:40:39 - job_xml_thread(): Done retrieving: data size 43808612
Sat 18 Jan 2014 13:40:39 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:40:39 - XML: Start document: iteration 4
Sat 18 Jan 2014 13:40:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43808612
Sat 18 Jan 2014 13:40:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:40:47 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 13:40:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:40:47 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:40:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:40:50 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:40:50 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 13:40:50 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 13:40:50 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:40:50 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 13:40:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:40:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:40:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:40:52 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:40:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:40:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:40:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:40:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:40:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:40:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:40:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:40:55 - XML: Processed 655184 elements - found 489 jobs
Sat 18 Jan 2014 13:40:55 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 13:40:55 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 13:40:55 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 13:40:55 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:40:55 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:40:56 - size of cluster 'LISA Cluster': 624 hosts 79472 metrics 858807 values 13543636 bits 1692954 bytes 
Sat 18 Jan 2014 13:41:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:41:02 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:41:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:41:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:41:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:41:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:41:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:41:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:41:02 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:41:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 13:41:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:41:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:41:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43788725
Sat 18 Jan 2014 13:41:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:41:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43788725
Sat 18 Jan 2014 13:41:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:41:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:41:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:41:10 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:41:10 - job_xml_thread(): Done retrieving: data size 43788725
Sat 18 Jan 2014 13:41:10 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:41:10 - XML: Start document: iteration 5
Sat 18 Jan 2014 13:41:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:41:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:41:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:41:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:41:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:41:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:41:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:41:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:41:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:41:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:41:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:41:29 - XML: Processed 655184 elements - found 489 jobs
Sat 18 Jan 2014 13:41:29 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:41:29 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:41:29 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:41:29 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:41:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:41:30 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:41:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:41:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:41:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:41:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:41:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:41:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:41:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:41:31 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:41:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:41:31 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:41:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 13:41:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 13:41:31 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:41:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5540 values 87310 bits 10913 bytes 
Sat 18 Jan 2014 13:41:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:41:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:41:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:41:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43728994
Sat 18 Jan 2014 13:41:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:41:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43728994
Sat 18 Jan 2014 13:41:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:41:44 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:41:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:41:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:41:45 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:41:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:41:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:41:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:41:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:41:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:41:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:41:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:41:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:41:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:41:49 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:41:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:41:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:41:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:41:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:41:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:41:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:41:51 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:41:51 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 13:41:52 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:41:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 13:41:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:41:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:41:52 - job_xml_thread(): Done retrieving: data size 43173936
Sat 18 Jan 2014 13:41:52 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:41:52 - XML: Start document: iteration 6
Sat 18 Jan 2014 13:41:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43173936
Sat 18 Jan 2014 13:41:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:41:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43173936
Sat 18 Jan 2014 13:41:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:42:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:42:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:42:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:42:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:42:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:42:11 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:42:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:42:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:42:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:42:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:42:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:42:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:42:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:42:14 - XML: Processed 647440 elements - found 489 jobs
Sat 18 Jan 2014 13:42:14 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:42:14 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:42:14 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:42:14 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:42:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:42:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:42:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:42:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:42:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:42:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:42:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:42:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:42:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:42:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43191984
Sat 18 Jan 2014 13:42:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:42:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43191984
Sat 18 Jan 2014 13:42:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:42:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:42:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:42:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:42:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:42:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:42:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:42:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:42:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:42:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:42:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:42:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43191984
Sat 18 Jan 2014 13:42:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:42:29 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:42:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:42:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:42:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:42:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:42:32 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:42:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:42:32 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:42:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 13:42:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 13:42:32 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:42:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7297 values 115011 bits 14376 bytes 
Sat 18 Jan 2014 13:42:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:42:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:42:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:42:40 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:42:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:42:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:42:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:42:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:42:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:42:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:42:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:42:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:42:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:42:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:42:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:42:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:42:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:42:45 - job_xml_thread(): Done retrieving: data size 43648695
Sat 18 Jan 2014 13:42:45 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:42:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43648695
Sat 18 Jan 2014 13:42:45 - XML: Start document: iteration 7
Sat 18 Jan 2014 13:42:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:42:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43648695
Sat 18 Jan 2014 13:42:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:42:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:42:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:42:59 - XML: Processed 653366 elements - found 489 jobs
Sat 18 Jan 2014 13:42:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:42:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:42:59 - job 7348926 report time 1390048799 does not match current heartbeat 1390048920 : ignoring job
Sat 18 Jan 2014 13:42:59 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:43:00 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:43:00 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:43:00 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:43:04 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:43:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 13:43:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:43:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:43:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:43:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:43:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:43:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:43:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:43:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:43:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:43:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:43:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:43:06 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:43:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:43:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:43:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:43:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:43:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:43:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:43:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:43:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43816230
Sat 18 Jan 2014 13:43:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:43:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43816230
Sat 18 Jan 2014 13:43:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:43:15 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:43:15 - job_xml_thread(): Done retrieving: data size 43816230
Sat 18 Jan 2014 13:43:15 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:43:15 - XML: Start document: iteration 8
Sat 18 Jan 2014 13:43:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:43:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:43:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:43:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:43:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:43:27 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:43:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:43:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:43:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:43:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:43:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:43:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:43:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:43:29 - XML: Processed 655184 elements - found 489 jobs
Sat 18 Jan 2014 13:43:29 - job 7348926 report time 1390048799 does not match current heartbeat 1390048920 : ignoring job
Sat 18 Jan 2014 13:43:29 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:43:29 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:43:29 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:43:29 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:43:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:43:32 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:43:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:43:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:43:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:43:32 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:43:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:43:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:43:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:43:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:43:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 13:43:33 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:43:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:43:33 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:43:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 13:43:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6117 values 96491 bits 12061 bytes 
Sat 18 Jan 2014 13:43:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:43:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43795052
Sat 18 Jan 2014 13:43:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:43:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43795052
Sat 18 Jan 2014 13:43:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:43:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:43:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:43:44 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:43:44 - job_xml_thread(): Done retrieving: data size 43795052
Sat 18 Jan 2014 13:43:44 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:43:44 - XML: Start document: iteration 9
Sat 18 Jan 2014 13:43:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:43:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:43:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:43:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:43:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:43:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:43:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:43:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:43:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:43:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:43:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:44:00 - XML: Processed 655184 elements - found 489 jobs
Sat 18 Jan 2014 13:44:00 - job 7348926 report time 1390048799 does not match current heartbeat 1390048920 : ignoring job
Sat 18 Jan 2014 13:44:00 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:44:00 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:44:00 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:44:00 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:44:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:44:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:44:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:44:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:44:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:44:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:44:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:44:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:44:01 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:44:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 13:44:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:44:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:44:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43808354
Sat 18 Jan 2014 13:44:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:44:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43808354
Sat 18 Jan 2014 13:44:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:44:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:44:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:44:15 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:44:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:44:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:44:15 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:44:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:44:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:44:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:44:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:44:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:44:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:44:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:44:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:44:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:44:19 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:44:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:44:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:44:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:44:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:44:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:44:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:44:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:44:23 - job_xml_thread(): Done retrieving: data size 43801799
Sat 18 Jan 2014 13:44:23 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:44:23 - XML: Start document: iteration 10
Sat 18 Jan 2014 13:44:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43801799
Sat 18 Jan 2014 13:44:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:44:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43801799
Sat 18 Jan 2014 13:44:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:44:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:44:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:44:32 - XML: Processed 655184 elements - found 489 jobs
Sat 18 Jan 2014 13:44:32 - job 7348926 report time 1390048799 does not match current heartbeat 1390048920 : ignoring job
Sat 18 Jan 2014 13:44:32 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:44:32 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:44:32 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:44:32 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:44:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:44:33 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:44:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:44:34 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:44:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 13:44:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 13:44:35 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:44:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:44:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8416 values 132632 bits 16579 bytes 
Sat 18 Jan 2014 13:44:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:44:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:44:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:44:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:44:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:44:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:44:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:44:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:44:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:44:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:44:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:44:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:44:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:44:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:44:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:44:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:44:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:44:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:44:47 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:44:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:44:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43815324
Sat 18 Jan 2014 13:44:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:44:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43815324
Sat 18 Jan 2014 13:44:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:44:49 - job_xml_thread(): Done retrieving: data size 43815324
Sat 18 Jan 2014 13:44:49 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:44:49 - XML: Start document: iteration 11
Sat 18 Jan 2014 13:44:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:44:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:45:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:45:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:45:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:45:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:45:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:45:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:45:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:45:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:45:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:45:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:45:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:45:11 - XML: Processed 655182 elements - found 488 jobs
Sat 18 Jan 2014 13:45:11 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:45:11 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:45:11 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:45:11 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:45:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:45:12 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:45:12 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:45:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 13:45:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:45:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:45:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:45:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:45:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:45:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:45:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:45:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:45:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43819484
Sat 18 Jan 2014 13:45:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:45:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43819484
Sat 18 Jan 2014 13:45:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:45:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:45:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:45:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:45:25 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:45:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:45:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:45:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:45:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:45:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:45:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:45:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:45:26 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:45:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:45:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:45:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:45:29 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:45:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:45:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:45:29 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 13:45:29 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 13:45:29 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:45:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:45:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:45:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:45:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:45:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:45:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43824678
Sat 18 Jan 2014 13:45:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:45:31 - job_xml_thread(): Done retrieving: data size 43824678
Sat 18 Jan 2014 13:45:31 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:45:31 - XML: Start document: iteration 12
Sat 18 Jan 2014 13:45:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43824678
Sat 18 Jan 2014 13:45:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:45:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:45:35 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:45:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:45:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 13:45:36 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:45:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 13:45:36 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:45:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9131 values 143994 bits 17999 bytes 
Sat 18 Jan 2014 13:45:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:45:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:45:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:45:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:45:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:45:47 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:45:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:45:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:45:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:45:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:45:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:45:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:45:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:45:48 - XML: Processed 655182 elements - found 488 jobs
Sat 18 Jan 2014 13:45:48 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:45:48 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:45:48 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:45:48 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:45:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:45:52 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:45:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:45:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:45:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:45:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:45:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:45:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:45:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:45:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43811866
Sat 18 Jan 2014 13:45:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:45:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43811866
Sat 18 Jan 2014 13:45:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:46:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:46:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:46:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:46:03 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:46:03 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:46:03 - job_xml_thread(): Done retrieving: data size 43811866
Sat 18 Jan 2014 13:46:03 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:46:03 - XML: Start document: iteration 13
Sat 18 Jan 2014 13:46:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:46:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:46:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:46:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:46:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:46:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:46:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:46:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:46:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:46:11 - XML: Processed 655182 elements - found 488 jobs
Sat 18 Jan 2014 13:46:11 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:46:11 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:46:11 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:46:11 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:46:12 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:46:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 13:46:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:46:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:46:14 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:46:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:46:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:46:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:46:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:46:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:46:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:46:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:46:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43798920
Sat 18 Jan 2014 13:46:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:46:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43798920
Sat 18 Jan 2014 13:46:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:46:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:46:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:46:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:46:25 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:46:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:46:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:46:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:46:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:46:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:46:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:46:26 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:46:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:46:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:46:29 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:46:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:46:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:46:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:46:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:46:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:46:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:46:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:46:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43832614
Sat 18 Jan 2014 13:46:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:46:31 - job_xml_thread(): Done retrieving: data size 43832614
Sat 18 Jan 2014 13:46:31 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:46:31 - XML: Start document: iteration 14
Sat 18 Jan 2014 13:46:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43832614
Sat 18 Jan 2014 13:46:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:46:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:46:37 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:46:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:46:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 13:46:37 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:46:37 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:46:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 13:46:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:46:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:46:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:46:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:46:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9165 values 144718 bits 18089 bytes 
Sat 18 Jan 2014 13:46:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:46:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:46:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:46:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:46:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:46:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:46:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:46:47 - XML: Processed 655181 elements - found 488 jobs
Sat 18 Jan 2014 13:46:47 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:46:47 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:46:47 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:46:47 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:46:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:46:50 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:46:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:46:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:46:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:46:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:46:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:46:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:46:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:46:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43803392
Sat 18 Jan 2014 13:46:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:46:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43803392
Sat 18 Jan 2014 13:46:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:46:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:46:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:47:02 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:47:02 - job_xml_thread(): Done retrieving: data size 43803392
Sat 18 Jan 2014 13:47:02 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:47:02 - XML: Start document: iteration 15
Sat 18 Jan 2014 13:47:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:47:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:47:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:47:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:47:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:47:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:47:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:47:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:47:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:47:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:47:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:47:10 - XML: Processed 655186 elements - found 490 jobs
Sat 18 Jan 2014 13:47:10 - job 7348845 report time 1390049040 does not match current heartbeat 1390049161 : ignoring job
Sat 18 Jan 2014 13:47:10 - job 7348846 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 13:47:10 - job_xml_thread(): Found 3 updated jobs.
Sat 18 Jan 2014 13:47:10 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 13:47:12 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Sat 18 Jan 2014 13:47:12 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:47:12 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:47:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:47:14 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:47:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:47:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:47:14 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:47:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 13:47:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:47:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:47:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:47:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:47:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:47:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:47:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43751332
Sat 18 Jan 2014 13:47:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:47:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43751332
Sat 18 Jan 2014 13:47:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:47:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:47:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:47:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:47:25 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:47:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:47:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:47:27 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:47:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:47:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:47:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:47:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:47:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:47:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:47:29 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:47:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:47:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:47:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:47:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:47:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:47:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:47:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:47:31 - job_xml_thread(): Done retrieving: data size 43373275
Sat 18 Jan 2014 13:47:31 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:47:31 - XML: Start document: iteration 16
Sat 18 Jan 2014 13:47:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43373275
Sat 18 Jan 2014 13:47:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:47:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43373275
Sat 18 Jan 2014 13:47:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:47:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:47:38 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:47:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:47:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 13:47:40 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:47:40 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:47:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 13:47:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8472 values 133981 bits 16747 bytes 
Sat 18 Jan 2014 13:47:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:47:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:47:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:47:44 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:47:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:47:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:47:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:47:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:47:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:47:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:47:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:47:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:47:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:47:49 - XML: Processed 649596 elements - found 490 jobs
Sat 18 Jan 2014 13:47:49 - job 7348845 report time 1390049040 does not match current heartbeat 1390049161 : ignoring job
Sat 18 Jan 2014 13:47:49 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:47:49 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:47:49 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:47:49 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:47:51 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 13:47:51 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:47:52 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:47:52 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 13:47:52 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 13:47:52 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:47:52 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 13:47:53 - size of cluster 'LISA Cluster': 624 hosts 79486 metrics 776921 values 12267187 bits 1533398 bytes 
Sat 18 Jan 2014 13:47:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:47:54 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:47:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:47:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:47:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:47:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:47:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:47:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:47:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:47:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43166613
Sat 18 Jan 2014 13:47:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:47:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43166613
Sat 18 Jan 2014 13:47:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:48:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:48:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:48:04 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:48:04 - job_xml_thread(): Done retrieving: data size 43166613
Sat 18 Jan 2014 13:48:04 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:48:04 - XML: Start document: iteration 17
Sat 18 Jan 2014 13:48:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:48:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:48:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:48:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:48:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:48:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:48:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:48:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:48:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:48:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:48:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:48:20 - XML: Processed 647272 elements - found 490 jobs
Sat 18 Jan 2014 13:48:20 - job 7348845 report time 1390049040 does not match current heartbeat 1390049161 : ignoring job
Sat 18 Jan 2014 13:48:20 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:48:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:48:20 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:48:20 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:48:20 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:48:20 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:48:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:48:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:48:21 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:48:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 13:48:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:48:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:48:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:48:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:48:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:48:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:48:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43187747
Sat 18 Jan 2014 13:48:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:48:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43187747
Sat 18 Jan 2014 13:48:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:48:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:48:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:48:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:48:32 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:48:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:48:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:48:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:48:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:48:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:48:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:48:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:48:35 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:48:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:48:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:48:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:48:37 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:48:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:48:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:48:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:48:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:48:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:48:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:48:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:48:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43676506
Sat 18 Jan 2014 13:48:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:48:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43676506
Sat 18 Jan 2014 13:48:39 - job_xml_thread(): Done retrieving: data size 43676506
Sat 18 Jan 2014 13:48:39 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:48:39 - XML: Start document: iteration 18
Sat 18 Jan 2014 13:48:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:48:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:48:40 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:48:40 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:48:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 13:48:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:48:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 13:48:40 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:48:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5694 values 89935 bits 11241 bytes 
Sat 18 Jan 2014 13:48:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:48:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:48:52 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:48:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:48:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:48:52 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 13:48:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:48:56 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:48:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:48:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:48:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:48:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:48:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:48:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:48:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:49:00 - XML: Processed 653384 elements - found 530 jobs
Sat 18 Jan 2014 13:49:00 - job 7348837 appears to have finished
Sat 18 Jan 2014 13:49:00 - job_xml_thread(): Found 43 updated jobs.
Sat 18 Jan 2014 13:49:00 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 13:49:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:49:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:49:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:49:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:49:04 - job_xml_thread(): Done storing. succesfully stored: 43 jobs
Sat 18 Jan 2014 13:49:04 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:49:04 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:49:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:49:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:49:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:49:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:49:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:49:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43806700
Sat 18 Jan 2014 13:49:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:49:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43806700
Sat 18 Jan 2014 13:49:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:49:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:49:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:49:19 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:49:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:49:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:49:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:49:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:49:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:49:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:49:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:49:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:49:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:49:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:49:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:49:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:49:23 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:49:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:49:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:49:23 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:49:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 13:49:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:49:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:49:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:49:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:49:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:49:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:49:26 - job_xml_thread(): Done retrieving: data size 43828522
Sat 18 Jan 2014 13:49:26 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:49:26 - XML: Start document: iteration 19
Sat 18 Jan 2014 13:49:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43828522
Sat 18 Jan 2014 13:49:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:49:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43828522
Sat 18 Jan 2014 13:49:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:49:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:49:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:49:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:49:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:49:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:49:41 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:49:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:49:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:49:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:49:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:49:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:49:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:49:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:49:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:49:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:49:42 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:49:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 13:49:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:49:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 13:49:42 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:49:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5994 values 94509 bits 11813 bytes 
Sat 18 Jan 2014 13:49:44 - XML: Processed 655266 elements - found 530 jobs
Sat 18 Jan 2014 13:49:44 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:49:44 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:49:44 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:49:44 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:49:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:49:49 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:49:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:49:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:49:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:49:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:49:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:49:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:49:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:49:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43811123
Sat 18 Jan 2014 13:49:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:49:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43811123
Sat 18 Jan 2014 13:49:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:49:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:49:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:50:00 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:50:00 - job_xml_thread(): Done retrieving: data size 43811123
Sat 18 Jan 2014 13:50:00 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:50:00 - XML: Start document: iteration 20
Sat 18 Jan 2014 13:50:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:50:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:50:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:50:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:50:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:50:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:50:14 - XML: Processed 655266 elements - found 530 jobs
Sat 18 Jan 2014 13:50:15 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:50:15 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:50:15 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:50:15 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:50:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:50:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:50:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:50:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:50:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:50:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:50:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:50:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:50:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:50:18 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:50:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 13:50:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:50:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:50:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:50:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:50:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:50:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:50:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43824277
Sat 18 Jan 2014 13:50:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:50:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43824277
Sat 18 Jan 2014 13:50:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:50:30 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:50:30 - job_xml_thread(): Done retrieving: data size 43824277
Sat 18 Jan 2014 13:50:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:50:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:50:30 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:50:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:50:31 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:50:31 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 13:50:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:50:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:50:31 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 13:50:31 - Housekeeping: done.
Sat 18 Jan 2014 13:50:31 - XML: Start document: iteration 0
Sat 18 Jan 2014 13:50:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:50:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:50:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:50:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:50:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:50:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:50:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:50:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:50:42 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:50:42 - XML: Processed 655266 elements - found 530 jobs
Sat 18 Jan 2014 13:50:42 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:50:42 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:50:42 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:50:42 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:50:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:50:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 13:50:43 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:50:43 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:50:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 13:50:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5902 values 93098 bits 11637 bytes 
Sat 18 Jan 2014 13:50:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:50:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:50:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:50:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:50:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:50:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:50:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:50:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:50:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:50:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:50:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:50:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43799985
Sat 18 Jan 2014 13:50:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:50:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43799985
Sat 18 Jan 2014 13:50:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:50:58 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:50:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:50:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:50:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:51:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:51:00 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:51:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:51:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:51:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:51:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:51:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:51:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:51:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:51:04 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:51:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:51:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:51:04 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:51:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 13:51:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:51:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:51:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:51:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:51:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:51:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:51:07 - job_xml_thread(): Done retrieving: data size 43816882
Sat 18 Jan 2014 13:51:07 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:51:07 - XML: Start document: iteration 1
Sat 18 Jan 2014 13:51:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43816882
Sat 18 Jan 2014 13:51:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:51:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43816882
Sat 18 Jan 2014 13:51:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:51:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:51:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:51:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:51:19 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:51:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:51:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:51:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:51:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:51:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:51:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:51:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:51:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:51:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:51:25 - XML: Processed 655266 elements - found 530 jobs
Sat 18 Jan 2014 13:51:25 - job 7348944 field 'start_timestamp' changed since saved from: 1390049282 to: 1390049201
Sat 18 Jan 2014 13:51:25 - job 7348945 field 'start_timestamp' changed since saved from: 1390049284 to: 1390049201
Sat 18 Jan 2014 13:51:25 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 13:51:25 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 13:51:26 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 13:51:26 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:51:26 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:51:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:51:30 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:51:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:51:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:51:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:51:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:51:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:51:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:51:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:51:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43801958
Sat 18 Jan 2014 13:51:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:51:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43801958
Sat 18 Jan 2014 13:51:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:51:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:51:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:51:41 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:51:41 - job_xml_thread(): Done retrieving: data size 43801958
Sat 18 Jan 2014 13:51:41 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:51:41 - XML: Start document: iteration 2
Sat 18 Jan 2014 13:51:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:51:44 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:51:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:51:45 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:51:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:51:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:51:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:51:45 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:51:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 13:51:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:51:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:51:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 13:51:45 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:51:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8515 values 134260 bits 16782 bytes 
Sat 18 Jan 2014 13:51:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:51:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:51:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:51:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:51:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:51:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:51:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:51:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:51:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:51:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:51:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:51:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:51:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:51:56 - XML: Processed 655265 elements - found 530 jobs
Sat 18 Jan 2014 13:51:56 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:51:56 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:51:56 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:51:56 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:51:57 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 13:51:57 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 13:51:57 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:51:59 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:51:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 13:51:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:51:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:51:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43827775
Sat 18 Jan 2014 13:51:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:52:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43827775
Sat 18 Jan 2014 13:52:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:52:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:52:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:52:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:52:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:52:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:52:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:52:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:52:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:52:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:52:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:52:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43827775
Sat 18 Jan 2014 13:52:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:52:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:52:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:52:11 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:52:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:52:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:52:18 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:52:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:52:19 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:52:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:52:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:52:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:52:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:52:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:52:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:52:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:52:21 - job_xml_thread(): Done retrieving: data size 43808807
Sat 18 Jan 2014 13:52:21 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:52:21 - XML: Start document: iteration 3
Sat 18 Jan 2014 13:52:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43808807
Sat 18 Jan 2014 13:52:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:52:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:52:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:52:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:52:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:52:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43808807
Sat 18 Jan 2014 13:52:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:52:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:52:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:52:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:52:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:52:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:52:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:52:40 - XML: Processed 655266 elements - found 530 jobs
Sat 18 Jan 2014 13:52:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:52:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:52:40 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:52:40 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:52:40 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:52:40 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:52:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:52:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:52:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:52:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:52:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:52:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:52:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:52:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:52:43 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:52:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:52:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:52:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:52:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:52:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:52:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:52:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:52:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43856390
Sat 18 Jan 2014 13:52:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:52:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43856390
Sat 18 Jan 2014 13:52:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:52:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:52:46 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:52:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:52:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 13:52:49 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:52:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 13:52:49 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:52:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148685 bits 18585 bytes 
Sat 18 Jan 2014 13:52:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:52:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:52:55 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:52:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:52:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:52:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:52:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:52:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:52:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:52:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:52:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:52:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:52:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:52:59 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:52:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:52:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:53:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:53:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:53:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:53:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:53:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:53:01 - job_xml_thread(): Done retrieving: data size 43838179
Sat 18 Jan 2014 13:53:01 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:53:01 - XML: Start document: iteration 4
Sat 18 Jan 2014 13:53:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43838179
Sat 18 Jan 2014 13:53:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:53:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43838179
Sat 18 Jan 2014 13:53:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:53:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:53:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:53:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:53:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:53:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:53:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:53:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:53:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:53:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:53:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:53:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:53:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:53:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:53:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:53:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:53:25 - XML: Processed 655266 elements - found 530 jobs
Sat 18 Jan 2014 13:53:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:53:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:53:25 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:53:25 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:53:25 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:53:25 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:53:25 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:53:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 13:53:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:53:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:53:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:53:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:53:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:53:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:53:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43766067
Sat 18 Jan 2014 13:53:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:53:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43766067
Sat 18 Jan 2014 13:53:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:53:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:53:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:53:40 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:53:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:53:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:53:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:53:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:53:42 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:53:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:53:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:53:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:53:42 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:53:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:53:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:53:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:53:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:53:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:53:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:53:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:53:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:53:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:53:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:53:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:53:45 - job_xml_thread(): Done retrieving: data size 43246556
Sat 18 Jan 2014 13:53:45 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:53:45 - XML: Start document: iteration 5
Sat 18 Jan 2014 13:53:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43246556
Sat 18 Jan 2014 13:53:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:53:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43246556
Sat 18 Jan 2014 13:53:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:53:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:53:49 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:53:51 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:53:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 13:53:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:53:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 13:53:51 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:53:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6522 values 102968 bits 12871 bytes 
Sat 18 Jan 2014 13:53:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:53:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:53:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:53:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:54:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:54:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:54:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:54:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:54:08 - XML: Processed 647844 elements - found 530 jobs
Sat 18 Jan 2014 13:54:08 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:54:08 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:54:08 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:54:08 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:54:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:54:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:54:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:54:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:54:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:54:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:54:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:54:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:54:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:54:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:54:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:54:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:54:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:54:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:54:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43189824
Sat 18 Jan 2014 13:54:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:54:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43189824
Sat 18 Jan 2014 13:54:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:54:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:54:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:54:23 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:54:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:54:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:54:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:54:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:54:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:54:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:54:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:54:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:54:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:54:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:54:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:54:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:54:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:54:25 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:54:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 13:54:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:54:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:54:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:54:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:54:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:54:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:54:27 - job_xml_thread(): Done retrieving: data size 43249828
Sat 18 Jan 2014 13:54:27 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:54:27 - XML: Start document: iteration 6
Sat 18 Jan 2014 13:54:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43249828
Sat 18 Jan 2014 13:54:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43249828
Sat 18 Jan 2014 13:54:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:54:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:54:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:54:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:54:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:54:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:54:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:54:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:54:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:54:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:54:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:54:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:54:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:54:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:54:48 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:54:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:54:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:54:48 - XML: Processed 647814 elements - found 530 jobs
Sat 18 Jan 2014 13:54:48 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:54:48 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:54:48 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:54:48 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:54:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:54:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:54:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:54:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:54:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:54:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43772503
Sat 18 Jan 2014 13:54:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:54:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43772503
Sat 18 Jan 2014 13:54:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:54:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:54:51 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:54:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:54:52 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:54:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 13:54:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 13:54:53 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:54:53 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 13:54:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8979 values 141642 bits 17705 bytes 
Sat 18 Jan 2014 13:54:53 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:54:54 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:54:54 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:54:54 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 13:54:55 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 13:54:55 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 13:54:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:54:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:55:02 - size of cluster 'LISA Cluster': 624 hosts 79474 metrics 824560 values 13004668 bits 1625583 bytes 
Sat 18 Jan 2014 13:55:03 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:55:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:55:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:55:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:55:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:55:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:55:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:55:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:55:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:55:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:55:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:55:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:55:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:55:06 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:55:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:55:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:55:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:55:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:55:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:55:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:55:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:55:09 - job_xml_thread(): Done retrieving: data size 43819876
Sat 18 Jan 2014 13:55:09 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:55:09 - XML: Start document: iteration 7
Sat 18 Jan 2014 13:55:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43819876
Sat 18 Jan 2014 13:55:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:55:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43819876
Sat 18 Jan 2014 13:55:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:55:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:55:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:55:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:55:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:55:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:55:24 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:55:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:55:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:55:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:55:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:55:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:55:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:55:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:55:28 - XML: Processed 655266 elements - found 530 jobs
Sat 18 Jan 2014 13:55:28 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:55:28 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:55:28 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:55:28 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:55:30 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:55:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 13:55:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:55:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:55:32 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:55:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:55:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:55:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:55:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:55:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:55:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:55:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:55:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43799164
Sat 18 Jan 2014 13:55:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:55:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43799164
Sat 18 Jan 2014 13:55:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:55:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:55:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:55:43 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:55:43 - job_xml_thread(): Done retrieving: data size 43799164
Sat 18 Jan 2014 13:55:44 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:55:44 - XML: Start document: iteration 8
Sat 18 Jan 2014 13:55:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:55:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:55:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:55:53 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:55:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:55:53 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:55:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:55:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:55:54 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:55:54 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 13:55:54 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:55:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 13:55:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:55:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 13:55:54 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:55:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:55:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:55:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:55:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5737 values 90439 bits 11304 bytes 
Sat 18 Jan 2014 13:55:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:55:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:55:59 - XML: Processed 655266 elements - found 530 jobs
Sat 18 Jan 2014 13:55:59 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:55:59 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:55:59 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:55:59 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:56:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:56:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:56:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:56:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:56:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:56:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:56:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:56:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:56:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:56:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43828520
Sat 18 Jan 2014 13:56:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:56:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43828520
Sat 18 Jan 2014 13:56:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:56:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:56:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:56:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:56:11 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:56:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:56:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:56:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:56:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:56:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43828520
Sat 18 Jan 2014 13:56:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:56:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:56:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:56:15 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:56:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:56:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:56:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:56:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:56:24 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:56:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:56:27 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:56:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:56:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:56:27 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:56:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 13:56:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:56:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:56:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:56:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:56:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:56:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:56:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:56:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:56:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:56:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:56:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:56:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:56:30 - job_xml_thread(): Done retrieving: data size 43814176
Sat 18 Jan 2014 13:56:30 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:56:30 - XML: Start document: iteration 9
Sat 18 Jan 2014 13:56:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43814176
Sat 18 Jan 2014 13:56:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:56:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43814176
Sat 18 Jan 2014 13:56:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:56:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:56:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:56:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:56:43 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:56:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:56:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:56:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:56:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:56:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:56:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:56:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:56:48 - XML: Processed 655266 elements - found 530 jobs
Sat 18 Jan 2014 13:56:48 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:56:48 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:56:48 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:56:48 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:56:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:56:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:56:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:56:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:56:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:56:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:56:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:56:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:56:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:56:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43817104
Sat 18 Jan 2014 13:56:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:56:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43817104
Sat 18 Jan 2014 13:56:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:56:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:56:54 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:56:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:56:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 13:56:55 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:56:55 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:56:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 13:56:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8925 values 140697 bits 17587 bytes 
Sat 18 Jan 2014 13:56:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:56:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:57:03 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:57:03 - job_xml_thread(): Done retrieving: data size 43817104
Sat 18 Jan 2014 13:57:03 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:57:03 - XML: Start document: iteration 10
Sat 18 Jan 2014 13:57:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:57:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:57:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:57:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:57:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:57:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:57:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:57:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:57:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:57:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:57:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:57:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:57:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:57:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:57:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:57:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:57:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:57:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:57:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:57:18 - XML: Processed 655264 elements - found 529 jobs
Sat 18 Jan 2014 13:57:18 - job 7348928 appears to have finished
Sat 18 Jan 2014 13:57:18 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 13:57:18 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 13:57:18 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 13:57:18 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:57:18 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:57:20 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:57:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 13:57:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:57:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:57:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43801682
Sat 18 Jan 2014 13:57:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:57:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43801682
Sat 18 Jan 2014 13:57:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:57:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:57:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:57:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:57:32 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:57:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:57:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:57:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:57:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:57:33 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:57:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:57:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:57:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:57:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:57:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:57:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:57:37 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:57:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:57:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:57:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:57:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:57:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:57:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:57:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:57:40 - job_xml_thread(): Done retrieving: data size 43827360
Sat 18 Jan 2014 13:57:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43827360
Sat 18 Jan 2014 13:57:40 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:57:40 - XML: Start document: iteration 11
Sat 18 Jan 2014 13:57:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:57:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43827360
Sat 18 Jan 2014 13:57:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:57:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:57:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:57:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:57:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:57:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:57:56 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:57:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:57:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 13:57:57 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:57:57 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:57:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 13:57:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99093 bits 12386 bytes 
Sat 18 Jan 2014 13:57:59 - XML: Processed 655264 elements - found 529 jobs
Sat 18 Jan 2014 13:57:59 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:57:59 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:57:59 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:57:59 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:57:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:57:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:57:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:57:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:58:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:58:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:58:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:58:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:58:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:58:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:58:04 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:58:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:58:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:58:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:58:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:58:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:58:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:58:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:58:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43825625
Sat 18 Jan 2014 13:58:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:58:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43825625
Sat 18 Jan 2014 13:58:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:58:14 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:58:14 - job_xml_thread(): Done retrieving: data size 43825625
Sat 18 Jan 2014 13:58:14 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:58:14 - XML: Start document: iteration 12
Sat 18 Jan 2014 13:58:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:58:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:58:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:58:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:58:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:58:25 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:58:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:58:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:58:27 - XML: Processed 655261 elements - found 529 jobs
Sat 18 Jan 2014 13:58:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:58:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:58:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:58:27 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:58:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:58:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:58:27 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:58:27 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:58:27 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:58:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:58:30 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:58:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:58:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:58:30 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:58:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 13:58:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:58:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:58:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:58:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:58:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:58:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:58:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43829625
Sat 18 Jan 2014 13:58:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:58:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43829625
Sat 18 Jan 2014 13:58:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:58:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:58:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:58:43 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:58:43 - job_xml_thread(): Done retrieving: data size 43829625
Sat 18 Jan 2014 13:58:43 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:58:43 - XML: Start document: iteration 13
Sat 18 Jan 2014 13:58:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:58:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:58:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:58:46 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:58:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:58:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:58:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:58:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:58:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:58:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:58:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:58:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:58:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:58:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:58:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:58:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:58:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:58:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:58:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:58:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:58:57 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:58:58 - XML: Processed 655260 elements - found 529 jobs
Sat 18 Jan 2014 13:58:58 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:58:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 13:58:58 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:58:58 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:58:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:58:58 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:58:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 13:58:58 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:58:58 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:58:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5930 values 93525 bits 11690 bytes 
Sat 18 Jan 2014 13:58:59 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 13:58:59 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 13:58:59 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:59:00 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 13:59:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 13:59:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:59:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:59:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43822230
Sat 18 Jan 2014 13:59:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:59:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43822230
Sat 18 Jan 2014 13:59:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:59:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:59:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:59:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:59:10 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:59:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:59:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:59:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:59:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:59:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:59:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:59:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:59:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:59:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:59:13 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:59:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:59:14 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:59:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:59:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:59:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:59:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:59:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:59:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:59:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:59:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43765647
Sat 18 Jan 2014 13:59:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:59:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43765647
Sat 18 Jan 2014 13:59:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:59:17 - job_xml_thread(): Done retrieving: data size 43765647
Sat 18 Jan 2014 13:59:17 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:59:17 - XML: Start document: iteration 14
Sat 18 Jan 2014 13:59:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:59:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:59:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:59:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:59:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:59:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:59:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:59:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:59:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:59:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:59:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:59:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:59:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:59:38 - XML: Processed 654516 elements - found 529 jobs
Sat 18 Jan 2014 13:59:38 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 13:59:38 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 13:59:38 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 13:59:38 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 13:59:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:59:40 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:59:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 13:59:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:59:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:59:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:59:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:59:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:59:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:59:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43233175
Sat 18 Jan 2014 13:59:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:59:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43233175
Sat 18 Jan 2014 13:59:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:59:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:59:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 13:59:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 13:59:52 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 13:59:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 13:59:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:59:53 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 13:59:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 13:59:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:59:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 13:59:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:59:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 13:59:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 13:59:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 13:59:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 13:59:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 13:59:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:59:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 13:59:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 13:59:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 13:59:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 13:59:57 - job_xml_thread(): Done retrieving: data size 43170672
Sat 18 Jan 2014 13:59:57 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 13:59:57 - XML: Start document: iteration 15
Sat 18 Jan 2014 13:59:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 13:59:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43170672
Sat 18 Jan 2014 13:59:58 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 13:59:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43170672
Sat 18 Jan 2014 13:59:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 13:59:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 13:59:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:59:59 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 13:59:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 13:59:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 13:59:59 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:00:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9776 values 154265 bits 19283 bytes 
Sat 18 Jan 2014 14:00:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:00:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:00:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:00:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:00:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:00:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:00:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:00:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:00:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:00:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:00:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:00:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:00:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:00:12 - XML: Processed 647094 elements - found 529 jobs
Sat 18 Jan 2014 14:00:12 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:00:12 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:00:12 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:00:12 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:00:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:00:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:00:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:00:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:00:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:00:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:00:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:00:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:00:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:00:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43179958
Sat 18 Jan 2014 14:00:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:00:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43179958
Sat 18 Jan 2014 14:00:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:00:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:00:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:00:27 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:00:27 - job_xml_thread(): Done retrieving: data size 43179958
Sat 18 Jan 2014 14:00:27 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:00:27 - XML: Start document: iteration 16
Sat 18 Jan 2014 14:00:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:00:29 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:00:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:00:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:00:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:00:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:00:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:00:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:00:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:00:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:00:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:00:37 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:00:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 14:00:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:00:40 - XML: Processed 647444 elements - found 529 jobs
Sat 18 Jan 2014 14:00:40 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:00:40 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:00:40 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:00:40 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:00:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:00:42 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:00:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:00:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:00:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:00:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:00:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:00:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:00:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:00:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43671093
Sat 18 Jan 2014 14:00:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:00:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43671093
Sat 18 Jan 2014 14:00:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:00:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:00:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:00:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:00:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:00:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:00:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:00:55 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:00:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:00:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:00:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:00:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:00:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:00:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:00:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:00:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:00:59 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:00:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:00:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:00:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:00:59 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:01:00 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:01:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 14:01:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:01:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 14:01:00 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:01:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:01:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5794 values 91396 bits 11424 bytes 
Sat 18 Jan 2014 14:01:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:01:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:01:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:01:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:01:01 - job_xml_thread(): Done retrieving: data size 43812458
Sat 18 Jan 2014 14:01:01 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:01:01 - XML: Start document: iteration 17
Sat 18 Jan 2014 14:01:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43812458
Sat 18 Jan 2014 14:01:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:01:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43812458
Sat 18 Jan 2014 14:01:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:01:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:01:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:01:12 - XML: Processed 655006 elements - found 529 jobs
Sat 18 Jan 2014 14:01:12 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:01:12 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:01:12 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:01:12 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:01:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:01:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:01:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:01:20 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:01:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:01:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:01:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:01:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:01:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:01:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:01:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:01:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:01:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:01:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:01:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:01:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:01:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:01:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:01:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:01:22 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:01:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 14:01:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:01:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:01:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43840728
Sat 18 Jan 2014 14:01:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:01:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43840728
Sat 18 Jan 2014 14:01:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:01:27 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:01:27 - job_xml_thread(): Done retrieving: data size 43840728
Sat 18 Jan 2014 14:01:27 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:01:27 - XML: Start document: iteration 18
Sat 18 Jan 2014 14:01:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:01:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:01:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:01:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:01:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:01:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:01:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:01:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:01:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:01:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:01:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:01:42 - XML: Processed 655264 elements - found 529 jobs
Sat 18 Jan 2014 14:01:42 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:01:42 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:01:42 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:01:42 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:01:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:01:46 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:01:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:01:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:01:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:01:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:01:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:01:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:01:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:01:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43818984
Sat 18 Jan 2014 14:01:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:01:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43818984
Sat 18 Jan 2014 14:01:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:01:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:01:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:01:54 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 14:01:55 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:01:56 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:01:56 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 14:01:56 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:01:56 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 14:01:56 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 14:01:57 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:01:57 - job_xml_thread(): Done retrieving: data size 43818984
Sat 18 Jan 2014 14:01:57 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:01:57 - XML: Start document: iteration 19
Sat 18 Jan 2014 14:01:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:01:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:01:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:01:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:01:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:01:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:01:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:01:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:02:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:02:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:02:00 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:02:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:02:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 14:02:01 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:02:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 14:02:01 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:02:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7924 values 125232 bits 15654 bytes 
Sat 18 Jan 2014 14:02:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:02:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:02:07 - XML: Processed 655255 elements - found 529 jobs
Sat 18 Jan 2014 14:02:07 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:02:07 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:02:07 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:02:07 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:02:07 - size of cluster 'LISA Cluster': 624 hosts 79477 metrics 814802 values 12854392 bits 1606799 bytes 
Sat 18 Jan 2014 14:02:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:02:11 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:02:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:02:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:02:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:02:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:02:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:02:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:02:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:02:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:02:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:02:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43805404
Sat 18 Jan 2014 14:02:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:02:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43805404
Sat 18 Jan 2014 14:02:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:02:17 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:02:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 14:02:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:02:22 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:02:22 - job_xml_thread(): Done retrieving: data size 43805404
Sat 18 Jan 2014 14:02:22 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:02:22 - XML: Start document: iteration 20
Sat 18 Jan 2014 14:02:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:02:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:02:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:02:33 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:02:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:02:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:02:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:02:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:02:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:02:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:02:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:02:36 - XML: Processed 655264 elements - found 529 jobs
Sat 18 Jan 2014 14:02:36 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:02:36 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:02:36 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:02:36 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:02:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:02:38 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:02:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:02:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:02:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:02:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:02:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:02:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:02:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:02:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43832086
Sat 18 Jan 2014 14:02:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:02:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43832086
Sat 18 Jan 2014 14:02:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:02:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:02:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:02:52 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:02:52 - job_xml_thread(): Done retrieving: data size 43832086
Sat 18 Jan 2014 14:02:52 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:02:52 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 14:02:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:02:52 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:02:52 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 14:02:52 - Housekeeping: done.
Sat 18 Jan 2014 14:02:52 - XML: Start document: iteration 0
Sat 18 Jan 2014 14:02:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:02:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:02:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:02:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:02:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:02:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:02:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:02:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:02:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:02:56 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:02:57 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 14:03:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:03:01 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:03:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:03:01 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:03:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 14:03:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 14:03:01 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:03:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6268 values 99213 bits 12401 bytes 
Sat 18 Jan 2014 14:03:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:03:04 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:03:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:03:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:03:05 - XML: Processed 655264 elements - found 529 jobs
Sat 18 Jan 2014 14:03:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:03:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:03:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:03:05 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:03:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:03:05 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:03:05 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:03:05 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:03:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:03:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:03:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:03:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43791279
Sat 18 Jan 2014 14:03:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:03:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43791279
Sat 18 Jan 2014 14:03:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:03:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:03:20 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:03:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:03:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:03:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:03:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:03:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:03:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:03:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:03:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:03:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:03:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:03:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:03:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:03:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:03:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:03:26 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:03:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 14:03:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:03:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:03:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:03:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:03:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:03:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:03:28 - job_xml_thread(): Done retrieving: data size 43834051
Sat 18 Jan 2014 14:03:28 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:03:28 - XML: Start document: iteration 1
Sat 18 Jan 2014 14:03:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43834051
Sat 18 Jan 2014 14:03:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:03:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43834051
Sat 18 Jan 2014 14:03:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:03:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:03:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:03:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:03:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:03:46 - XML: Processed 655264 elements - found 529 jobs
Sat 18 Jan 2014 14:03:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:03:46 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:03:46 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:03:46 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:03:46 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:03:46 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:03:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:03:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:03:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:03:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:03:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:03:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:03:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:03:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:03:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:03:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:03:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:03:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:03:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:03:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:03:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:03:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:03:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43824622
Sat 18 Jan 2014 14:03:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:03:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43824622
Sat 18 Jan 2014 14:03:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:04:02 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:04:02 - job_xml_thread(): Done retrieving: data size 43824622
Sat 18 Jan 2014 14:04:02 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:04:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:04:02 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:04:02 - XML: Start document: iteration 2
Sat 18 Jan 2014 14:04:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:04:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:04:02 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:04:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 14:04:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:04:03 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:04:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:04:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 14:04:03 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:04:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:04:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:04:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8782 values 138653 bits 17331 bytes 
Sat 18 Jan 2014 14:04:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:04:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:04:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:04:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:04:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:04:15 - XML: Processed 655264 elements - found 529 jobs
Sat 18 Jan 2014 14:04:15 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:04:15 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:04:15 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:04:15 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:04:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:04:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:04:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:04:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:04:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:04:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:04:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:04:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:04:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:04:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:04:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:04:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43801900
Sat 18 Jan 2014 14:04:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:04:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43801900
Sat 18 Jan 2014 14:04:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:04:31 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:04:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:04:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:04:32 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:04:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:04:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:04:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:04:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:04:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:04:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:04:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:04:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:04:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:04:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:04:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:04:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:04:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:04:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:04:36 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:04:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 14:04:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:04:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:04:38 - job_xml_thread(): Done retrieving: data size 43821379
Sat 18 Jan 2014 14:04:38 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:04:38 - XML: Start document: iteration 3
Sat 18 Jan 2014 14:04:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43821379
Sat 18 Jan 2014 14:04:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:04:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43821379
Sat 18 Jan 2014 14:04:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:04:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:04:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:04:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:04:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:04:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:04:59 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:04:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:04:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:05:00 - XML: Processed 655264 elements - found 529 jobs
Sat 18 Jan 2014 14:05:00 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:05:00 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:05:00 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:05:01 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:05:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:05:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:05:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:05:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:05:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:05:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:05:02 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:05:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:05:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:05:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:05:02 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:05:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:05:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:05:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:05:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:05:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:05:02 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:05:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 14:05:02 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:05:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5526 values 87125 bits 10890 bytes 
Sat 18 Jan 2014 14:05:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 14:05:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:05:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43827749
Sat 18 Jan 2014 14:05:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:05:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43827749
Sat 18 Jan 2014 14:05:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:05:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:05:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:05:16 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:05:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:05:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:05:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:05:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:05:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:05:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:05:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:05:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:05:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:05:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:05:20 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:05:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:05:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:05:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:05:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:05:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:05:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:05:21 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:05:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 14:05:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:05:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:05:23 - job_xml_thread(): Done retrieving: data size 43751742
Sat 18 Jan 2014 14:05:23 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:05:23 - XML: Start document: iteration 4
Sat 18 Jan 2014 14:05:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43751742
Sat 18 Jan 2014 14:05:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:05:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43751742
Sat 18 Jan 2014 14:05:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:05:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:05:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:05:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:05:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:05:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:05:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:05:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:05:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:05:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:05:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:05:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:05:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:05:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:05:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:05:46 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:05:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:05:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:05:47 - XML: Processed 654516 elements - found 529 jobs
Sat 18 Jan 2014 14:05:47 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:05:47 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:05:47 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:05:47 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:05:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:05:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:05:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:05:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:05:50 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 14:05:50 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 14:05:50 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:05:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:05:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43217044
Sat 18 Jan 2014 14:05:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:05:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43217044
Sat 18 Jan 2014 14:05:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:05:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:05:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:06:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:06:02 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:06:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:06:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:06:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:06:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:06:02 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:06:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:06:02 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:06:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:06:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:06:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:06:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:06:04 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:06:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:06:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 14:06:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:06:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 14:06:04 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:06:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8468 values 133512 bits 16689 bytes 
Sat 18 Jan 2014 14:06:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:06:05 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:06:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:06:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:06:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:06:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:06:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:06:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:06:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:06:07 - job_xml_thread(): Done retrieving: data size 43167281
Sat 18 Jan 2014 14:06:07 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:06:07 - XML: Start document: iteration 5
Sat 18 Jan 2014 14:06:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43167281
Sat 18 Jan 2014 14:06:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:06:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43167281
Sat 18 Jan 2014 14:06:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:06:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:06:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:06:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:06:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:06:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:06:25 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:06:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:06:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:06:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:06:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:06:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:06:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:06:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:06:26 - XML: Processed 647064 elements - found 529 jobs
Sat 18 Jan 2014 14:06:26 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:06:26 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:06:26 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:06:26 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:06:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:06:31 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:06:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:06:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:06:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:06:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:06:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:06:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:06:31 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:06:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 14:06:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:06:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:06:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43422562
Sat 18 Jan 2014 14:06:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:06:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43422562
Sat 18 Jan 2014 14:06:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:06:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:06:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:06:41 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:06:41 - job_xml_thread(): Done retrieving: data size 43422562
Sat 18 Jan 2014 14:06:41 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:06:42 - XML: Start document: iteration 6
Sat 18 Jan 2014 14:06:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:06:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:06:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:06:47 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:06:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:06:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:06:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:06:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:06:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:06:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:06:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:06:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:06:53 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:06:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:06:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:06:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:06:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:06:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:06:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:06:55 - XML: Processed 650258 elements - found 529 jobs
Sat 18 Jan 2014 14:06:55 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:06:55 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:06:55 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:06:55 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:06:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:06:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43789928
Sat 18 Jan 2014 14:06:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:06:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43789928
Sat 18 Jan 2014 14:06:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:07:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:07:04 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:07:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:07:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:07:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:07:04 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:07:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 14:07:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 14:07:05 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:07:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8770 values 138227 bits 17278 bytes 
Sat 18 Jan 2014 14:07:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:07:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:07:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:07:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:07:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:07:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:07:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:07:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:07:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:07:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:07:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:07:10 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:07:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:07:12 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:07:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:07:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:07:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:07:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:07:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:07:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:07:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:07:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43832273
Sat 18 Jan 2014 14:07:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:07:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43832273
Sat 18 Jan 2014 14:07:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:07:15 - job_xml_thread(): Done retrieving: data size 43832273
Sat 18 Jan 2014 14:07:15 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:07:15 - XML: Start document: iteration 7
Sat 18 Jan 2014 14:07:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:07:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:07:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:07:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:07:31 - XML: Processed 655228 elements - found 511 jobs
Sat 18 Jan 2014 14:07:31 - job 7348874 appears to have finished
Sat 18 Jan 2014 14:07:31 - job 7348869 appears to have finished
Sat 18 Jan 2014 14:07:31 - job 7348868 appears to have finished
Sat 18 Jan 2014 14:07:31 - job 7348863 appears to have finished
Sat 18 Jan 2014 14:07:31 - job 7348862 appears to have finished
Sat 18 Jan 2014 14:07:31 - job 7348861 appears to have finished
Sat 18 Jan 2014 14:07:31 - job 7348860 appears to have finished
Sat 18 Jan 2014 14:07:31 - job 7348867 appears to have finished
Sat 18 Jan 2014 14:07:31 - job 7348866 appears to have finished
Sat 18 Jan 2014 14:07:31 - job 7348865 appears to have finished
Sat 18 Jan 2014 14:07:31 - job 7348864 appears to have finished
Sat 18 Jan 2014 14:07:31 - job 7348870 appears to have finished
Sat 18 Jan 2014 14:07:31 - job 7348872 appears to have finished
Sat 18 Jan 2014 14:07:31 - job 7348873 appears to have finished
Sat 18 Jan 2014 14:07:31 - job 7348875 appears to have finished
Sat 18 Jan 2014 14:07:31 - job 7348876 appears to have finished
Sat 18 Jan 2014 14:07:31 - job 7348877 appears to have finished
Sat 18 Jan 2014 14:07:32 - job 7348859 appears to have finished
Sat 18 Jan 2014 14:07:32 - job_xml_thread(): Found 18 updated jobs.
Sat 18 Jan 2014 14:07:32 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 14:07:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:07:33 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:07:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:07:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:07:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:07:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:07:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:07:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:07:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:07:34 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:07:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 14:07:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:07:35 - job_xml_thread(): Done storing. succesfully stored: 18 jobs
Sat 18 Jan 2014 14:07:35 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:07:35 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:07:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:07:38 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:07:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:07:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:07:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:07:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:07:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:07:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:07:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:07:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43820987
Sat 18 Jan 2014 14:07:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:07:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43820987
Sat 18 Jan 2014 14:07:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:07:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:07:49 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:07:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:07:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:07:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:07:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:07:50 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:07:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:07:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:07:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:07:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:07:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:07:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:07:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:07:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:07:54 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:07:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:07:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:07:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:07:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:07:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:07:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:07:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:07:55 - job_xml_thread(): Done retrieving: data size 43827069
Sat 18 Jan 2014 14:07:55 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:07:55 - XML: Start document: iteration 8
Sat 18 Jan 2014 14:07:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43827069
Sat 18 Jan 2014 14:07:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:07:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43827069
Sat 18 Jan 2014 14:07:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:08:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:08:05 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:08:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:08:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:08:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:08:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 14:08:06 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:08:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 14:08:07 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:08:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9127 values 144002 bits 18000 bytes 
Sat 18 Jan 2014 14:08:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:08:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:08:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:08:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:08:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:08:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:08:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:08:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:08:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:08:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:08:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:08:14 - XML: Processed 655228 elements - found 511 jobs
Sat 18 Jan 2014 14:08:14 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:08:14 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:08:14 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:08:14 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:08:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:08:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:08:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:08:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:08:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:08:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:08:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:08:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:08:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:08:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43799386
Sat 18 Jan 2014 14:08:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:08:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43799386
Sat 18 Jan 2014 14:08:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:08:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:08:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:08:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:08:30 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:08:30 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:08:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:08:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:08:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:08:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:08:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:08:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:08:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:08:32 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:08:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 14:08:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:08:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:08:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:08:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:08:33 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:08:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:08:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:08:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:08:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:08:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:08:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:08:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:08:35 - job_xml_thread(): Done retrieving: data size 43809980
Sat 18 Jan 2014 14:08:35 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:08:35 - XML: Start document: iteration 9
Sat 18 Jan 2014 14:08:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43809980
Sat 18 Jan 2014 14:08:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43809980
Sat 18 Jan 2014 14:08:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:08:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:08:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:08:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:08:49 - XML: Processed 655226 elements - found 510 jobs
Sat 18 Jan 2014 14:08:49 - job 7348871 appears to have finished
Sat 18 Jan 2014 14:08:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:08:49 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 14:08:49 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 14:08:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:08:50 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 14:08:51 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:08:51 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:08:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:08:53 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:08:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:08:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:08:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:08:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:08:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:08:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:08:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:08:57 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 14:08:57 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:08:57 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:08:57 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:08:57 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 14:08:57 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 14:08:57 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 14:08:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:08:58 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:08:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:08:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:08:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:08:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:08:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:08:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:08:59 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 855021 values 13484975 bits 1685621 bytes 
Sat 18 Jan 2014 14:09:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:09:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43823343
Sat 18 Jan 2014 14:09:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:09:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43823343
Sat 18 Jan 2014 14:09:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:09:06 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:09:06 - job_xml_thread(): Done retrieving: data size 43823343
Sat 18 Jan 2014 14:09:06 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:09:06 - XML: Start document: iteration 10
Sat 18 Jan 2014 14:09:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:09:07 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:09:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:09:11 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:09:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 14:09:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:09:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 14:09:11 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:09:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:09:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9383 values 147990 bits 18498 bytes 
Sat 18 Jan 2014 14:09:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:09:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:09:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:09:18 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:09:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:09:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:09:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:09:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:09:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:09:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:09:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:09:24 - XML: Processed 655226 elements - found 510 jobs
Sat 18 Jan 2014 14:09:24 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:09:24 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:09:24 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:09:24 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:09:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:09:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:09:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:09:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:09:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:09:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:09:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:09:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:09:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:09:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43829967
Sat 18 Jan 2014 14:09:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:09:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43829967
Sat 18 Jan 2014 14:09:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:09:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:09:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:09:39 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:09:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:09:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:09:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:09:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:09:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:09:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:09:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:09:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:09:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:09:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:09:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:09:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:09:46 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:09:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:09:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:09:46 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:09:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 14:09:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:09:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:09:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:09:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:09:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:09:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:09:49 - job_xml_thread(): Done retrieving: data size 43800501
Sat 18 Jan 2014 14:09:49 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:09:49 - XML: Start document: iteration 11
Sat 18 Jan 2014 14:09:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43800501
Sat 18 Jan 2014 14:09:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:09:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43800501
Sat 18 Jan 2014 14:09:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:09:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:09:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:09:58 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:09:58 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 14:10:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:10:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:10:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:10:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:10:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:10:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:10:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:10:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:10:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:10:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:10:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:10:10 - XML: Processed 655226 elements - found 510 jobs
Sat 18 Jan 2014 14:10:10 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:10:10 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:10:10 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:10:10 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:10:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:10:12 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:10:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:10:12 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:10:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:10:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:10:12 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:10:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:10:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 14:10:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 14:10:12 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:10:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5538 values 87271 bits 10908 bytes 
Sat 18 Jan 2014 14:10:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:10:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:10:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:10:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:10:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:10:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43812702
Sat 18 Jan 2014 14:10:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:10:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43812702
Sat 18 Jan 2014 14:10:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:10:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:10:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:10:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:10:25 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:10:25 - job_xml_thread(): Done retrieving: data size 43812702
Sat 18 Jan 2014 14:10:25 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:10:25 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:10:25 - XML: Start document: iteration 12
Sat 18 Jan 2014 14:10:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:10:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:10:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:10:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:10:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:10:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:10:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:10:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:10:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:10:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:10:38 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:10:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:10:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:10:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:10:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:10:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:10:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:10:39 - XML: Processed 655222 elements - found 510 jobs
Sat 18 Jan 2014 14:10:39 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:10:39 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:10:39 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:10:39 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:10:39 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:10:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 14:10:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:10:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:10:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:10:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:10:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43803205
Sat 18 Jan 2014 14:10:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:10:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43803205
Sat 18 Jan 2014 14:10:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:10:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:10:51 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:10:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:10:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:10:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:10:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:10:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43803205
Sat 18 Jan 2014 14:10:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:10:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:10:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:10:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:10:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:10:54 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:10:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:11:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:11:02 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:11:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:11:05 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:11:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:11:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:11:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:11:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:11:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:11:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:11:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:11:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:11:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:11:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:11:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:11:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:11:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:11:08 - job_xml_thread(): Done retrieving: data size 43797028
Sat 18 Jan 2014 14:11:08 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:11:08 - XML: Start document: iteration 13
Sat 18 Jan 2014 14:11:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43797028
Sat 18 Jan 2014 14:11:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:11:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43797028
Sat 18 Jan 2014 14:11:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:11:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:11:13 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:11:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:11:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 14:11:14 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:11:14 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:11:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 14:11:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8831 values 139181 bits 17397 bytes 
Sat 18 Jan 2014 14:11:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:11:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:11:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:11:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:11:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:11:24 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:11:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:11:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:11:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:11:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:11:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:11:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:11:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:11:27 - XML: Processed 655262 elements - found 528 jobs
Sat 18 Jan 2014 14:11:27 - job_xml_thread(): Found 18 updated jobs.
Sat 18 Jan 2014 14:11:27 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 14:11:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:11:31 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:11:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:11:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:11:31 - job_xml_thread(): Done storing. succesfully stored: 18 jobs
Sat 18 Jan 2014 14:11:31 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:11:31 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:11:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:11:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:11:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:11:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:11:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:11:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43486217
Sat 18 Jan 2014 14:11:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:11:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43486217
Sat 18 Jan 2014 14:11:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:11:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:11:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:11:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:11:46 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:11:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:11:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:11:46 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:11:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:11:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:11:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:11:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:11:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:11:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:11:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:11:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:11:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:11:51 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:11:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 14:11:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:11:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:11:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:11:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:11:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:11:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:11:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:11:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:11:54 - job_xml_thread(): Done retrieving: data size 43179942
Sat 18 Jan 2014 14:11:54 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:11:54 - XML: Start document: iteration 14
Sat 18 Jan 2014 14:11:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43179942
Sat 18 Jan 2014 14:11:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43179942
Sat 18 Jan 2014 14:11:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:11:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:12:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:12:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:12:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:12:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:12:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:12:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:12:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:12:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:12:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:12:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:12:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:12:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:12:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:12:14 - XML: Processed 647332 elements - found 528 jobs
Sat 18 Jan 2014 14:12:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:12:14 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:12:14 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:12:14 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:12:14 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:12:14 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:12:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:12:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 14:12:15 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:12:15 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:12:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 14:12:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5885 values 92792 bits 11599 bytes 
Sat 18 Jan 2014 14:12:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:12:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:12:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:12:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:12:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:12:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:12:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:12:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:12:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:12:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43192618
Sat 18 Jan 2014 14:12:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:12:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43192618
Sat 18 Jan 2014 14:12:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:12:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:12:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:12:29 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:12:29 - job_xml_thread(): Done retrieving: data size 43192618
Sat 18 Jan 2014 14:12:29 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:12:29 - XML: Start document: iteration 15
Sat 18 Jan 2014 14:12:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:12:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:12:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:12:33 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:12:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:12:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:12:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:12:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:12:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:12:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:12:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:12:44 - XML: Processed 647712 elements - found 528 jobs
Sat 18 Jan 2014 14:12:45 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:12:45 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:12:45 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:12:45 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:12:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:12:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:12:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:12:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:12:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:12:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:12:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:12:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:12:45 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:12:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 14:12:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:12:47 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 14:12:47 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 14:12:47 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:12:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:12:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43729892
Sat 18 Jan 2014 14:12:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:12:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43729892
Sat 18 Jan 2014 14:12:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:12:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:12:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:12:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:12:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:12:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:12:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:12:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:12:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:12:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:12:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:12:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:13:00 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:13:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:13:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:13:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:13:02 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:13:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:13:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:13:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:13:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:13:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:13:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:13:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:13:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43819183
Sat 18 Jan 2014 14:13:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:13:03 - job_xml_thread(): Done retrieving: data size 43819183
Sat 18 Jan 2014 14:13:03 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:13:03 - XML: Start document: iteration 16
Sat 18 Jan 2014 14:13:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43819183
Sat 18 Jan 2014 14:13:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:13:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:13:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:13:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:13:15 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:13:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:13:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:13:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:13:17 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:13:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 14:13:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 14:13:17 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:13:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8678 values 136872 bits 17109 bytes 
Sat 18 Jan 2014 14:13:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:13:20 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:13:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:13:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:13:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:13:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:13:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:13:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:13:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:13:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:13:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:13:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:13:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:13:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:13:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:13:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:13:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:13:23 - XML: Processed 655259 elements - found 529 jobs
Sat 18 Jan 2014 14:13:23 - job 7348981 field 'start_timestamp' changed since saved from: 1390050661 to: 1390050596
Sat 18 Jan 2014 14:13:23 - job 7348988 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 14:13:23 - job 7348989 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 14:13:23 - job 7348974 field 'start_timestamp' changed since saved from: 1390050647 to: 1390050596
Sat 18 Jan 2014 14:13:23 - job 7348976 field 'start_timestamp' changed since saved from: 1390050651 to: 1390050596
Sat 18 Jan 2014 14:13:23 - job 7348978 field 'start_timestamp' changed since saved from: 1390050655 to: 1390050596
Sat 18 Jan 2014 14:13:23 - job 7348985 field 'start_timestamp' changed since saved from: 1390050669 to: 1390050596
Sat 18 Jan 2014 14:13:23 - job 7348987 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 14:13:23 - job_xml_thread(): Found 9 updated jobs.
Sat 18 Jan 2014 14:13:23 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 14:13:23 - job_xml_thread(): Done storing. succesfully stored: 9 jobs
Sat 18 Jan 2014 14:13:24 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:13:24 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:13:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:13:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43840329
Sat 18 Jan 2014 14:13:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:13:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43840329
Sat 18 Jan 2014 14:13:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:13:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:13:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:13:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:13:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:13:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:13:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:13:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:13:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:13:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:13:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:13:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:13:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:13:39 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:13:39 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:13:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:13:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:13:39 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:13:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 14:13:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:13:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:13:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:13:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:13:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:13:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:13:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43838503
Sat 18 Jan 2014 14:13:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:13:41 - job_xml_thread(): Done retrieving: data size 43838503
Sat 18 Jan 2014 14:13:41 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:13:41 - XML: Start document: iteration 17
Sat 18 Jan 2014 14:13:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43838503
Sat 18 Jan 2014 14:13:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:13:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:13:52 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:13:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:13:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:13:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:13:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:13:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:13:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:13:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:13:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:13:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:13:58 - XML: Processed 655264 elements - found 529 jobs
Sat 18 Jan 2014 14:13:58 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:13:58 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:13:58 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:13:58 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:14:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:14:01 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:14:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:14:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:14:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:14:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:14:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:14:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:14:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:14:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43817455
Sat 18 Jan 2014 14:14:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:14:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43817455
Sat 18 Jan 2014 14:14:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:14:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:14:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:14:13 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:14:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:14:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:14:13 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:14:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:14:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:14:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:14:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:14:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:14:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:14:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:14:16 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:14:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:14:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:14:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:14:17 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:14:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:14:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:14:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:14:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:14:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:14:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 14:14:17 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:14:17 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:14:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 14:14:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8717 values 137403 bits 17175 bytes 
Sat 18 Jan 2014 14:14:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:14:18 - job_xml_thread(): Done retrieving: data size 43834501
Sat 18 Jan 2014 14:14:18 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:14:18 - XML: Start document: iteration 18
Sat 18 Jan 2014 14:14:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43834501
Sat 18 Jan 2014 14:14:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:14:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43834501
Sat 18 Jan 2014 14:14:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:14:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:14:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:14:32 - XML: Processed 655264 elements - found 529 jobs
Sat 18 Jan 2014 14:14:32 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:14:32 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:14:32 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:14:32 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:14:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:14:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:14:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:14:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:14:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:14:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:14:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:14:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:14:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:14:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:14:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:14:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:14:42 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:14:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:14:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:14:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:14:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:14:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:14:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:14:44 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:14:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 14:14:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:14:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:14:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43839957
Sat 18 Jan 2014 14:14:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:14:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43839957
Sat 18 Jan 2014 14:14:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:14:48 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:14:48 - job_xml_thread(): Done retrieving: data size 43839957
Sat 18 Jan 2014 14:14:48 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:14:48 - XML: Start document: iteration 19
Sat 18 Jan 2014 14:14:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:14:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:14:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:14:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:14:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:14:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:14:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:14:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:14:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:14:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:14:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:14:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:14:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:15:03 - XML: Processed 655266 elements - found 530 jobs
Sat 18 Jan 2014 14:15:04 - job 7335215 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 14:15:04 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 14:15:04 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 14:15:05 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 14:15:05 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:15:05 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:15:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:15:06 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:15:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:15:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:15:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:15:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:15:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:15:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:15:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:15:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43800414
Sat 18 Jan 2014 14:15:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:15:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43800414
Sat 18 Jan 2014 14:15:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:15:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:15:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:15:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:15:17 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:15:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:15:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 14:15:19 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:15:19 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:15:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 14:15:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6799 values 107227 bits 13403 bytes 
Sat 18 Jan 2014 14:15:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:15:20 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:15:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:15:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:15:20 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:15:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:15:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:15:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:15:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:15:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:15:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:15:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:15:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:15:22 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:15:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:15:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:15:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:15:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:15:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:15:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:15:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:15:24 - job_xml_thread(): Done retrieving: data size 43841133
Sat 18 Jan 2014 14:15:24 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:15:24 - XML: Start document: iteration 20
Sat 18 Jan 2014 14:15:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43841133
Sat 18 Jan 2014 14:15:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:15:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43841133
Sat 18 Jan 2014 14:15:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:15:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:15:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:15:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:15:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:15:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:15:42 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:15:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:15:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:15:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:15:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:15:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:15:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:15:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:15:44 - XML: Processed 655266 elements - found 530 jobs
Sat 18 Jan 2014 14:15:44 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:15:44 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:15:44 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:15:44 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:15:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:15:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:15:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:15:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:15:47 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:15:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 14:15:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:15:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:15:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:15:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:15:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:15:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:15:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43813835
Sat 18 Jan 2014 14:15:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:15:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43813835
Sat 18 Jan 2014 14:15:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:15:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:15:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:15:58 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 14:15:58 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:15:58 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:15:58 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:15:58 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 14:15:59 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 14:15:59 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 14:15:59 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:16:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:16:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:16:00 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:16:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:16:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:16:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:16:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:16:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:16:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:16:02 - size of cluster 'LISA Cluster': 624 hosts 79481 metrics 869802 values 13715704 bits 1714463 bytes 
Sat 18 Jan 2014 14:16:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:16:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:16:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:16:04 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:16:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:16:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:16:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:16:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:16:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:16:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:16:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:16:07 - job_xml_thread(): Done retrieving: data size 43826473
Sat 18 Jan 2014 14:16:07 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:16:07 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 14:16:07 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 14:16:07 - Housekeeping: done.
Sat 18 Jan 2014 14:16:07 - XML: Start document: iteration 0
Sat 18 Jan 2014 14:16:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43826473
Sat 18 Jan 2014 14:16:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:16:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43826473
Sat 18 Jan 2014 14:16:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:16:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:16:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:16:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:16:20 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:16:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:16:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:16:20 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:16:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:16:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 14:16:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 14:16:20 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:16:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8879 values 140079 bits 17509 bytes 
Sat 18 Jan 2014 14:16:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:16:24 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:16:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:16:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:16:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:16:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:16:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:16:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:16:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:16:30 - XML: Processed 655266 elements - found 530 jobs
Sat 18 Jan 2014 14:16:30 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:16:31 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:16:31 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:16:31 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:16:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:16:32 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:16:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:16:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:16:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:16:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:16:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:16:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:16:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:16:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43808688
Sat 18 Jan 2014 14:16:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:16:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43808688
Sat 18 Jan 2014 14:16:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:16:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:16:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:16:46 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:16:46 - job_xml_thread(): Done retrieving: data size 43808688
Sat 18 Jan 2014 14:16:46 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:16:46 - XML: Start document: iteration 1
Sat 18 Jan 2014 14:16:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:16:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:16:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:16:51 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:16:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:16:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:16:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:16:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:16:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:16:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:16:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:16:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:16:59 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:16:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:16:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:16:59 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:16:59 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 14:16:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:16:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:16:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:16:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:17:00 - XML: Processed 655266 elements - found 530 jobs
Sat 18 Jan 2014 14:17:00 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:17:00 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:17:00 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:17:00 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:17:00 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:17:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 14:17:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:17:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:17:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43815699
Sat 18 Jan 2014 14:17:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:17:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43815699
Sat 18 Jan 2014 14:17:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:17:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:17:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:17:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:17:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:17:15 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:17:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:17:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:17:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:17:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:17:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:17:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:17:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:17:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:17:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:17:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:17:19 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:17:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:17:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:17:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:17:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:17:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:17:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:17:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:17:20 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:17:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:17:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 14:17:21 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:17:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 14:17:21 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:17:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5792 values 91589 bits 11448 bytes 
Sat 18 Jan 2014 14:17:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:17:23 - job_xml_thread(): Done retrieving: data size 43760349
Sat 18 Jan 2014 14:17:23 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:17:23 - XML: Start document: iteration 2
Sat 18 Jan 2014 14:17:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43760349
Sat 18 Jan 2014 14:17:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:17:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43760349
Sat 18 Jan 2014 14:17:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:17:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:17:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:17:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:17:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:17:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:17:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:17:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:17:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:17:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:17:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:17:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:17:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:17:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:17:42 - XML: Processed 654516 elements - found 529 jobs
Sat 18 Jan 2014 14:17:42 - job 7335179 appears to have finished
Sat 18 Jan 2014 14:17:42 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 14:17:42 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 14:17:42 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 14:17:42 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:17:42 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:17:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:17:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:17:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:17:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:17:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:17:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:17:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:17:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:17:46 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:17:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 14:17:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:17:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:17:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43229190
Sat 18 Jan 2014 14:17:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:17:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43229190
Sat 18 Jan 2014 14:17:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:17:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:17:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:17:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:17:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:17:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:17:57 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:17:57 - job_xml_thread(): Done retrieving: data size 43229190
Sat 18 Jan 2014 14:17:57 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:17:57 - XML: Start document: iteration 3
Sat 18 Jan 2014 14:17:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:17:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:17:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:17:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:17:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:17:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:18:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:18:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:18:06 - XML: Processed 647822 elements - found 529 jobs
Sat 18 Jan 2014 14:18:06 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:18:06 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:18:06 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:18:06 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:18:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:18:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:18:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:18:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:18:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:18:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:18:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:18:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:18:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:18:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43147618
Sat 18 Jan 2014 14:18:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:18:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43147618
Sat 18 Jan 2014 14:18:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:18:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:18:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:18:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:18:21 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:18:21 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:18:21 - job_xml_thread(): Done retrieving: data size 43147618
Sat 18 Jan 2014 14:18:22 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:18:22 - XML: Start document: iteration 4
Sat 18 Jan 2014 14:18:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:18:23 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:18:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 14:18:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 14:18:23 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:18:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7596 values 120194 bits 15024 bytes 
Sat 18 Jan 2014 14:18:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:18:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:18:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:18:31 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:18:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:18:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:18:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:18:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:18:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:18:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:18:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:18:33 - XML: Processed 647064 elements - found 529 jobs
Sat 18 Jan 2014 14:18:33 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:18:33 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:18:33 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:18:33 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:18:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:18:35 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:18:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:18:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:18:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:18:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:18:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:18:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:18:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:18:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43706751
Sat 18 Jan 2014 14:18:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:18:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43706751
Sat 18 Jan 2014 14:18:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:18:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:18:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:18:48 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:18:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:18:49 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:18:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:18:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:18:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:18:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:18:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:18:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:18:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:18:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:18:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:18:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:18:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:18:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:18:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:18:55 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:18:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 14:18:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:18:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:18:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:18:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:18:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:18:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:18:58 - job_xml_thread(): Done retrieving: data size 43803241
Sat 18 Jan 2014 14:18:58 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:18:58 - XML: Start document: iteration 5
Sat 18 Jan 2014 14:18:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43803241
Sat 18 Jan 2014 14:18:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43803241
Sat 18 Jan 2014 14:18:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:18:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:19:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:19:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:19:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:19:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:19:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:19:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:19:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:19:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:19:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:19:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:19:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:19:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:19:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:19:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:19:19 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:19:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:19:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:19:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:19:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:19:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:19:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:19:21 - XML: Processed 654999 elements - found 529 jobs
Sat 18 Jan 2014 14:19:21 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:19:21 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:19:21 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:19:21 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:19:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:19:23 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:19:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:19:23 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:19:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 14:19:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 14:19:23 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:19:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5909 values 93252 bits 11656 bytes 
Sat 18 Jan 2014 14:19:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:19:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43815079
Sat 18 Jan 2014 14:19:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:19:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43815079
Sat 18 Jan 2014 14:19:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:19:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:19:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:19:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:19:33 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:19:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:19:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:19:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:19:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:19:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:19:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:19:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:19:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:19:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:19:36 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:19:37 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 14:19:37 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 14:19:37 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:19:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:19:39 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:19:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:19:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:19:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:19:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:19:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:19:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:19:41 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:19:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 14:19:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:19:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:19:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43822345
Sat 18 Jan 2014 14:19:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:19:42 - job_xml_thread(): Done retrieving: data size 43822345
Sat 18 Jan 2014 14:19:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43822345
Sat 18 Jan 2014 14:19:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:19:42 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:19:42 - XML: Start document: iteration 6
Sat 18 Jan 2014 14:19:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:19:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:19:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:19:52 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:19:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:19:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:19:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:19:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:19:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:19:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:19:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:19:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:19:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:20:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:20:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:20:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:20:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:20:04 - XML: Processed 655264 elements - found 529 jobs
Sat 18 Jan 2014 14:20:04 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:20:04 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:20:04 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:20:04 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:20:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:20:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:20:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:20:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:20:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:20:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43788760
Sat 18 Jan 2014 14:20:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:20:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43788760
Sat 18 Jan 2014 14:20:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:20:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:20:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:20:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:20:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:20:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:20:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:20:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:20:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:20:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:20:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:20:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:20:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:20:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:20:20 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:20:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:20:20 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:20:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:20:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:20:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:20:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:20:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:20:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:20:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:20:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43818779
Sat 18 Jan 2014 14:20:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:20:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:20:23 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:20:24 - job_xml_thread(): Done retrieving: data size 43818779
Sat 18 Jan 2014 14:20:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43818779
Sat 18 Jan 2014 14:20:24 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:20:24 - XML: Start document: iteration 7
Sat 18 Jan 2014 14:20:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:20:25 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:20:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:20:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 14:20:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 14:20:26 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:20:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 10185 values 160744 bits 20093 bytes 
Sat 18 Jan 2014 14:20:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:20:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:20:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:20:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:20:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:20:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:20:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:20:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:20:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:20:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:20:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:20:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:20:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:20:45 - XML: Processed 655264 elements - found 529 jobs
Sat 18 Jan 2014 14:20:46 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:20:46 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:20:46 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:20:46 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:20:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:20:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:20:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:20:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:20:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:20:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:20:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:20:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:20:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:20:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43816790
Sat 18 Jan 2014 14:20:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:20:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43816790
Sat 18 Jan 2014 14:20:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:20:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:20:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:21:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:21:00 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:21:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:21:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:21:01 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:21:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:21:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:21:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:21:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:21:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:21:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:21:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:21:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:21:04 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:21:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:21:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:21:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:21:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:21:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:21:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:21:04 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:21:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 14:21:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:21:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:21:06 - job_xml_thread(): Done retrieving: data size 43823654
Sat 18 Jan 2014 14:21:06 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:21:06 - XML: Start document: iteration 8
Sat 18 Jan 2014 14:21:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43823654
Sat 18 Jan 2014 14:21:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43823654
Sat 18 Jan 2014 14:21:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:21:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:21:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:21:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:21:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:21:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:21:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:21:19 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:21:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:21:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:21:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:21:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:21:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:21:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:21:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:21:22 - XML: Processed 655264 elements - found 529 jobs
Sat 18 Jan 2014 14:21:22 - job 7348847 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 14:21:22 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 14:21:22 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 14:21:23 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 14:21:23 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:21:23 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:21:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:21:26 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:21:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:21:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 14:21:27 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:21:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5249 values 82724 bits 10340 bytes 
Sat 18 Jan 2014 14:21:27 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:21:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 14:21:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:21:27 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:21:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:21:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:21:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:21:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:21:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:21:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:21:29 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:21:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 14:21:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:21:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:21:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43822291
Sat 18 Jan 2014 14:21:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:21:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43822291
Sat 18 Jan 2014 14:21:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:21:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:21:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:21:38 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:21:38 - job_xml_thread(): Done retrieving: data size 43822291
Sat 18 Jan 2014 14:21:38 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:21:38 - XML: Start document: iteration 9
Sat 18 Jan 2014 14:21:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:21:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:21:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:21:46 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:21:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:21:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:21:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:21:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:21:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:21:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:21:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:21:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:21:49 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:21:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:21:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:21:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:21:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:21:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:21:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:21:51 - XML: Processed 655264 elements - found 529 jobs
Sat 18 Jan 2014 14:21:51 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:21:51 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:21:51 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:21:51 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:21:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:21:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43825042
Sat 18 Jan 2014 14:21:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:21:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43825042
Sat 18 Jan 2014 14:21:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:22:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:22:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:22:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:22:03 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:22:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:22:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:22:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:22:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:22:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:22:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:22:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:22:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:22:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:22:06 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:22:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:22:06 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:22:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:22:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:22:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:22:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:22:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:22:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:22:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:22:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43833599
Sat 18 Jan 2014 14:22:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:22:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43833599
Sat 18 Jan 2014 14:22:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:22:09 - job_xml_thread(): Done retrieving: data size 43833599
Sat 18 Jan 2014 14:22:09 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:22:09 - XML: Start document: iteration 10
Sat 18 Jan 2014 14:22:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:22:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:22:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:22:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:22:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:22:24 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:22:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:22:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:22:26 - XML: Processed 655264 elements - found 529 jobs
Sat 18 Jan 2014 14:22:26 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:22:26 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:22:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:22:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:22:26 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:22:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:22:26 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:22:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:22:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:22:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:22:27 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:22:27 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:22:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 14:22:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:22:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 14:22:27 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:22:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9268 values 146172 bits 18271 bytes 
Sat 18 Jan 2014 14:22:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:22:32 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:22:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:22:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:22:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:22:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:22:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:22:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:22:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:22:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43838819
Sat 18 Jan 2014 14:22:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:22:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43838819
Sat 18 Jan 2014 14:22:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:22:42 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:22:42 - job_xml_thread(): Done retrieving: data size 43838819
Sat 18 Jan 2014 14:22:42 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:22:42 - XML: Start document: iteration 11
Sat 18 Jan 2014 14:22:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:22:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:22:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:22:43 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:22:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:22:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:22:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:22:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:22:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:22:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:22:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:22:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:22:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:22:53 - XML: Processed 655261 elements - found 529 jobs
Sat 18 Jan 2014 14:22:53 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:22:53 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:22:53 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:22:54 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:22:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:22:56 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:22:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:22:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:22:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:22:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:22:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:22:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:22:57 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:22:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 14:22:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:22:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:22:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43810872
Sat 18 Jan 2014 14:22:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:22:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43810872
Sat 18 Jan 2014 14:22:59 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 14:22:59 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:22:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:23:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:23:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:23:01 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:23:01 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:23:01 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 14:23:01 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 14:23:02 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 14:23:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:23:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:23:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:23:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:23:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:23:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:23:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:23:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:23:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43810872
Sat 18 Jan 2014 14:23:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:23:09 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:23:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:23:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:23:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sat 18 Jan 2014 14:23:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:23:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:23:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:23:20 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:23:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:23:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:23:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:23:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:23:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:23:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:23:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:23:21 - job_xml_thread(): Done retrieving: data size 43732159
Sat 18 Jan 2014 14:23:21 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:23:21 - XML: Start document: iteration 12
Sat 18 Jan 2014 14:23:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:23:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:23:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43732159
Sat 18 Jan 2014 14:23:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:23:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:23:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:23:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43732159
Sat 18 Jan 2014 14:23:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:23:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:23:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:23:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:23:28 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:23:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:23:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 14:23:29 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:23:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 14:23:29 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:23:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8521 values 134373 bits 16796 bytes 
Sat 18 Jan 2014 14:23:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:23:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:23:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:23:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:23:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:23:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:23:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:23:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:23:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:23:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:23:40 - XML: Processed 654511 elements - found 528 jobs
Sat 18 Jan 2014 14:23:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:23:40 - job 7348628 appears to have finished
Sat 18 Jan 2014 14:23:40 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 14:23:40 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 14:23:41 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 14:23:41 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:23:41 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:23:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:23:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:23:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:23:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:23:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:23:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:23:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:23:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:23:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:23:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43221352
Sat 18 Jan 2014 14:23:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:23:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43221352
Sat 18 Jan 2014 14:23:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:23:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:23:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:23:56 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:23:56 - job_xml_thread(): Done retrieving: data size 43221352
Sat 18 Jan 2014 14:23:56 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:23:56 - XML: Start document: iteration 13
Sat 18 Jan 2014 14:23:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:23:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:24:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:24:00 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:24:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:24:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:24:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:24:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:24:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:24:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:24:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:24:02 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:24:02 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:24:03 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:24:05 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:24:05 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 14:24:05 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 14:24:05 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 14:24:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:24:07 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:24:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:24:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:24:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:24:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:24:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:24:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:24:10 - XML: Processed 647714 elements - found 528 jobs
Sat 18 Jan 2014 14:24:10 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:24:10 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:24:10 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:24:10 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:24:11 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 955420 values 15073044 bits 1884130 bytes 
Sat 18 Jan 2014 14:24:12 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:24:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 14:24:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:24:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:24:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43147717
Sat 18 Jan 2014 14:24:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:24:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43147717
Sat 18 Jan 2014 14:24:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:24:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:24:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:24:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:24:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:24:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:24:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:24:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:24:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:24:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:24:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:24:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:24:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:24:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43147717
Sat 18 Jan 2014 14:24:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:24:25 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:24:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:24:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:24:29 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:24:31 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:24:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 14:24:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:24:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 14:24:31 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:24:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5447 values 85815 bits 10726 bytes 
Sat 18 Jan 2014 14:24:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:24:32 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:24:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:24:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:24:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:24:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:24:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:24:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:24:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:24:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:24:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:24:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:24:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:24:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:24:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:24:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:24:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:24:40 - job_xml_thread(): Done retrieving: data size 43651740
Sat 18 Jan 2014 14:24:40 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:24:40 - XML: Start document: iteration 14
Sat 18 Jan 2014 14:24:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43651740
Sat 18 Jan 2014 14:24:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43651740
Sat 18 Jan 2014 14:24:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:24:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:24:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:24:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:24:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:24:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:24:56 - XML: Processed 653522 elements - found 528 jobs
Sat 18 Jan 2014 14:24:56 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:24:56 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:24:56 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:24:56 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:24:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:24:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:24:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:24:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:25:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:25:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:25:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:25:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:25:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:25:01 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:25:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 14:25:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:25:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:25:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:25:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:25:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:25:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:25:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:25:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:25:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:25:05 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:25:05 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 14:25:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:25:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43815007
Sat 18 Jan 2014 14:25:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:25:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43815007
Sat 18 Jan 2014 14:25:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:25:12 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:25:12 - job_xml_thread(): Done retrieving: data size 43815007
Sat 18 Jan 2014 14:25:12 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:25:12 - XML: Start document: iteration 15
Sat 18 Jan 2014 14:25:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:25:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:25:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:25:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:25:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:25:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:25:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:25:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:25:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:25:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:25:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:25:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:25:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:25:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:25:29 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:25:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:25:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:25:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:25:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:25:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:25:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:25:30 - XML: Processed 655262 elements - found 528 jobs
Sat 18 Jan 2014 14:25:30 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:25:30 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:25:30 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:25:30 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:25:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:25:31 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:25:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:25:31 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:25:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 14:25:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 14:25:31 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:25:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5980 values 94322 bits 11790 bytes 
Sat 18 Jan 2014 14:25:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:25:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43824502
Sat 18 Jan 2014 14:25:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:25:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43824502
Sat 18 Jan 2014 14:25:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:25:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:25:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:25:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:25:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:25:45 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:25:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:25:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:25:47 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:25:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:25:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:25:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:25:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:25:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:25:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:25:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:25:50 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:25:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:25:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:25:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:25:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:25:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:25:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:25:52 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:25:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 14:25:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:25:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:25:53 - job_xml_thread(): Done retrieving: data size 43810319
Sat 18 Jan 2014 14:25:53 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:25:53 - XML: Start document: iteration 16
Sat 18 Jan 2014 14:25:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43810319
Sat 18 Jan 2014 14:25:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43810319
Sat 18 Jan 2014 14:25:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:25:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:26:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:26:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:26:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:26:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:26:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:26:10 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:26:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:26:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:26:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:26:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:26:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:26:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:26:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:26:13 - XML: Processed 655262 elements - found 528 jobs
Sat 18 Jan 2014 14:26:13 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:26:13 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:26:13 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:26:13 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:26:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:26:16 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:26:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:26:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:26:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:26:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:26:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:26:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:26:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:26:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43832837
Sat 18 Jan 2014 14:26:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:26:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43832837
Sat 18 Jan 2014 14:26:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:26:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:26:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:26:28 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:26:28 - job_xml_thread(): Done retrieving: data size 43832837
Sat 18 Jan 2014 14:26:29 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:26:29 - XML: Start document: iteration 17
Sat 18 Jan 2014 14:26:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:26:31 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:26:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:26:31 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:26:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:26:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:26:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:26:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:26:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:26:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:26:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:26:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:26:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:26:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:26:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 14:26:33 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:26:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8013 values 126289 bits 15786 bytes 
Sat 18 Jan 2014 14:26:33 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:26:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 14:26:42 - XML: Processed 655262 elements - found 528 jobs
Sat 18 Jan 2014 14:26:42 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:26:42 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:26:42 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:26:42 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:26:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:26:43 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:26:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:26:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:26:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:26:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:26:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:26:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:26:45 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 14:26:45 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 14:26:45 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:26:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:26:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43812551
Sat 18 Jan 2014 14:26:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:26:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43812551
Sat 18 Jan 2014 14:26:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:26:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:26:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:26:57 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:26:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:26:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:26:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:26:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:26:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:26:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:26:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:26:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:26:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:26:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:26:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:27:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:27:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:27:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:27:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:27:01 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:27:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 14:27:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:27:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:27:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:27:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:27:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:27:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:27:02 - job_xml_thread(): Done retrieving: data size 43846605
Sat 18 Jan 2014 14:27:02 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:27:02 - XML: Start document: iteration 18
Sat 18 Jan 2014 14:27:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43846605
Sat 18 Jan 2014 14:27:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:27:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43846605
Sat 18 Jan 2014 14:27:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:27:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:27:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:27:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:27:14 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:27:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:27:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:27:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:27:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:27:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:27:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:27:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:27:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:27:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:27:21 - XML: Processed 655260 elements - found 527 jobs
Sat 18 Jan 2014 14:27:21 - job 7347725 appears to have finished
Sat 18 Jan 2014 14:27:21 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 14:27:21 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 14:27:21 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 14:27:21 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:27:21 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:27:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:27:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:27:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:27:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:27:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:27:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:27:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:27:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:27:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:27:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43804989
Sat 18 Jan 2014 14:27:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:27:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43804989
Sat 18 Jan 2014 14:27:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:27:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:27:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:27:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:27:34 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:27:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:27:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 14:27:34 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:27:34 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:27:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 14:27:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8929 values 140830 bits 17603 bytes 
Sat 18 Jan 2014 14:27:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:27:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:27:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:27:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:27:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:27:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:27:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:27:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:27:36 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:27:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:27:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:27:40 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:27:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:27:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:27:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:27:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:27:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:27:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:27:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:27:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43824180
Sat 18 Jan 2014 14:27:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:27:42 - job_xml_thread(): Done retrieving: data size 43824180
Sat 18 Jan 2014 14:27:42 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:27:42 - XML: Start document: iteration 19
Sat 18 Jan 2014 14:27:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43824180
Sat 18 Jan 2014 14:27:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:27:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:27:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:27:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:27:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:27:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:27:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:27:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:27:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:27:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:27:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:27:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:27:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:27:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:28:05 - XML: Processed 655260 elements - found 527 jobs
Sat 18 Jan 2014 14:28:05 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:28:05 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:28:05 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:28:05 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:28:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:28:06 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:28:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:28:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:28:06 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:28:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 14:28:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:28:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:28:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:28:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:28:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:28:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:28:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43806079
Sat 18 Jan 2014 14:28:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:28:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43806079
Sat 18 Jan 2014 14:28:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:28:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:28:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:28:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:28:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:28:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:28:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:28:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:28:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:28:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:28:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:28:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:28:20 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:28:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:28:21 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:28:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:28:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:28:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:28:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:28:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:28:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:28:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:28:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43830166
Sat 18 Jan 2014 14:28:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:28:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43830166
Sat 18 Jan 2014 14:28:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:28:24 - job_xml_thread(): Done retrieving: data size 43830166
Sat 18 Jan 2014 14:28:24 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:28:24 - XML: Start document: iteration 20
Sat 18 Jan 2014 14:28:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:28:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:28:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:28:35 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:28:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:28:37 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:28:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 14:28:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 14:28:37 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:28:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:28:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:28:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9024 values 142327 bits 17790 bytes 
Sat 18 Jan 2014 14:28:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:28:39 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:28:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:28:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:28:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:28:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:28:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:28:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:28:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:28:42 - XML: Processed 655260 elements - found 527 jobs
Sat 18 Jan 2014 14:28:42 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:28:42 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:28:42 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:28:42 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:28:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:28:46 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:28:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:28:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:28:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:28:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:28:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:28:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:28:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:28:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43833239
Sat 18 Jan 2014 14:28:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:28:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43833239
Sat 18 Jan 2014 14:28:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:28:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:28:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:28:57 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:28:57 - job_xml_thread(): Done retrieving: data size 43833239
Sat 18 Jan 2014 14:28:57 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:28:57 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 14:28:57 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 14:28:57 - Housekeeping: done.
Sat 18 Jan 2014 14:28:57 - XML: Start document: iteration 0
Sat 18 Jan 2014 14:29:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:29:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:29:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:29:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:29:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:29:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:29:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:29:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:29:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:29:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:29:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:29:09 - XML: Processed 655260 elements - found 527 jobs
Sat 18 Jan 2014 14:29:09 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:29:09 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:29:09 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:29:09 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:29:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:29:10 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:29:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:29:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:29:10 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:29:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 14:29:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:29:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:29:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:29:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:29:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:29:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:29:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43800063
Sat 18 Jan 2014 14:29:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:29:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43800063
Sat 18 Jan 2014 14:29:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:29:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:29:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:29:25 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:29:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:29:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:29:25 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:29:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:29:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:29:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:29:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:29:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:29:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:29:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:29:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:29:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:29:27 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:29:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:29:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:29:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:29:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:29:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:29:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:29:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:29:29 - job_xml_thread(): Done retrieving: data size 43624200
Sat 18 Jan 2014 14:29:29 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:29:29 - XML: Start document: iteration 1
Sat 18 Jan 2014 14:29:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43624200
Sat 18 Jan 2014 14:29:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:29:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43624200
Sat 18 Jan 2014 14:29:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:29:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:29:37 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:29:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:29:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 14:29:38 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:29:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 14:29:38 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:29:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8977 values 141554 bits 17694 bytes 
Sat 18 Jan 2014 14:29:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:29:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:29:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:29:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:29:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:29:49 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:29:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:29:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:29:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:29:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:29:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:29:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:29:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:29:52 - XML: Processed 652838 elements - found 527 jobs
Sat 18 Jan 2014 14:29:52 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:29:52 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:29:52 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:29:52 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:29:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:29:53 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:29:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:29:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:29:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:29:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:29:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:29:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:29:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:29:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43173089
Sat 18 Jan 2014 14:29:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:29:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43173089
Sat 18 Jan 2014 14:29:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:30:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:30:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:30:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:30:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:30:07 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:30:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:30:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:30:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:30:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:30:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:30:07 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:30:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 14:30:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:30:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:30:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:30:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:30:10 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:30:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:30:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:30:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:30:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:30:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:30:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:30:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:30:11 - job_xml_thread(): Done retrieving: data size 43224118
Sat 18 Jan 2014 14:30:11 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:30:11 - XML: Start document: iteration 2
Sat 18 Jan 2014 14:30:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43224118
Sat 18 Jan 2014 14:30:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43224118
Sat 18 Jan 2014 14:30:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:30:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:30:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:30:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:30:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:30:25 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:30:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:30:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:30:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:30:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:30:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:30:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:30:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:30:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:30:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:30:30 - XML: Processed 647746 elements - found 527 jobs
Sat 18 Jan 2014 14:30:30 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:30:30 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:30:30 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:30:30 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:30:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:30:32 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:30:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:30:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:30:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:30:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:30:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:30:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:30:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:30:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43233975
Sat 18 Jan 2014 14:30:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:30:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43233975
Sat 18 Jan 2014 14:30:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:30:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:30:39 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:30:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:30:39 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:30:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 14:30:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 14:30:39 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:30:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9124 values 143896 bits 17987 bytes 
Sat 18 Jan 2014 14:30:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:30:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:30:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:30:44 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:30:45 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:30:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:30:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:30:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:30:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:30:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:30:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:30:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:30:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:30:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:30:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:30:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:30:48 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:30:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 14:30:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:30:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:30:49 - job_xml_thread(): Done retrieving: data size 43769585
Sat 18 Jan 2014 14:30:49 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:30:49 - XML: Start document: iteration 3
Sat 18 Jan 2014 14:30:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43769585
Sat 18 Jan 2014 14:30:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:30:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:30:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:30:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:30:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:30:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43769585
Sat 18 Jan 2014 14:30:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:31:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:31:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:31:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:31:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:31:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:31:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:31:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:31:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:31:05 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 14:31:05 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:31:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:31:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:31:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:31:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:31:05 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:31:05 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 14:31:05 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 14:31:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:31:05 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:31:05 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sat 18 Jan 2014 14:31:08 - XML: Processed 654346 elements - found 529 jobs
Sat 18 Jan 2014 14:31:08 - job 7348927 report time 1390051692 does not match current heartbeat 1390051812 : ignoring job
Sat 18 Jan 2014 14:31:08 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 14:31:08 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 14:31:08 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 14:31:08 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:31:08 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:31:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:31:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:31:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:31:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:31:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:31:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:31:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:31:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:31:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:31:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43816817
Sat 18 Jan 2014 14:31:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:31:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43816817
Sat 18 Jan 2014 14:31:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:31:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:31:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:31:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:31:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:31:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:31:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:31:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:31:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:31:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:31:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:31:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:31:23 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:31:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:31:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:31:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:31:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:31:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:31:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:31:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:31:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:31:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:31:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:31:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:31:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43828319
Sat 18 Jan 2014 14:31:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:31:27 - job_xml_thread(): Done retrieving: data size 43828319
Sat 18 Jan 2014 14:31:27 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:31:27 - XML: Start document: iteration 4
Sat 18 Jan 2014 14:31:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43828319
Sat 18 Jan 2014 14:31:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:31:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:31:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:31:39 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:31:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:31:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:31:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 14:31:41 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:31:41 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:31:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 14:31:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148783 bits 18597 bytes 
Sat 18 Jan 2014 14:31:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:31:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:31:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:31:49 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:31:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:31:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:31:50 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:31:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:31:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:31:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:31:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:31:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:31:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:31:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:31:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:31:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:31:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:31:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:31:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:31:52 - XML: Processed 655264 elements - found 529 jobs
Sat 18 Jan 2014 14:31:52 - job 7348927 report time 1390051692 does not match current heartbeat 1390051812 : ignoring job
Sat 18 Jan 2014 14:31:52 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:31:52 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:31:52 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:31:52 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:31:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:31:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43830604
Sat 18 Jan 2014 14:31:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:31:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43830604
Sat 18 Jan 2014 14:31:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:32:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:32:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:32:05 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:32:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:32:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:32:05 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:32:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:32:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:32:06 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:32:06 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:32:06 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 14:32:06 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 14:32:06 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 14:32:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:32:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:32:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:32:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:32:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:32:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:32:07 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:32:07 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:32:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:32:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:32:08 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 1002259 values 15812695 bits 1976586 bytes 
Sat 18 Jan 2014 14:32:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:32:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:32:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:32:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:32:09 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:32:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 14:32:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:32:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:32:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43831678
Sat 18 Jan 2014 14:32:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:32:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43831678
Sat 18 Jan 2014 14:32:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:32:12 - job_xml_thread(): Done retrieving: data size 43831678
Sat 18 Jan 2014 14:32:12 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:32:12 - XML: Start document: iteration 5
Sat 18 Jan 2014 14:32:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:32:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:32:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:32:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:32:31 - XML: Processed 655264 elements - found 529 jobs
Sat 18 Jan 2014 14:32:31 - job 7348927 report time 1390051692 does not match current heartbeat 1390051812 : ignoring job
Sat 18 Jan 2014 14:32:31 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:32:31 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:32:31 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:32:31 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:32:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:32:33 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:32:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:32:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:32:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:32:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:32:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:32:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:32:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:32:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:32:35 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:32:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:32:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:32:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:32:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:32:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:32:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:32:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:32:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43838912
Sat 18 Jan 2014 14:32:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:32:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43838912
Sat 18 Jan 2014 14:32:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:32:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:32:42 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:32:43 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:32:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:32:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 14:32:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 14:32:43 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:32:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8884 values 140436 bits 17554 bytes 
Sat 18 Jan 2014 14:32:46 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:32:46 - job_xml_thread(): Done retrieving: data size 43838912
Sat 18 Jan 2014 14:32:46 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:32:46 - XML: Start document: iteration 6
Sat 18 Jan 2014 14:32:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:32:47 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:32:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:32:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:32:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:32:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:32:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:32:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:32:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:32:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:32:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:32:59 - XML: Processed 655264 elements - found 529 jobs
Sat 18 Jan 2014 14:32:59 - job 7348927 report time 1390051692 does not match current heartbeat 1390051812 : ignoring job
Sat 18 Jan 2014 14:32:59 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:32:59 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:32:59 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:32:59 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:33:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:33:01 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:33:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:33:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:33:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:33:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:33:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:33:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:33:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:33:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43815994
Sat 18 Jan 2014 14:33:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:33:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:33:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:33:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43815994
Sat 18 Jan 2014 14:33:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:33:06 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:33:06 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 14:33:14 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:33:14 - job_xml_thread(): Done retrieving: data size 43815994
Sat 18 Jan 2014 14:33:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:33:14 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:33:15 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:33:15 - XML: Start document: iteration 7
Sat 18 Jan 2014 14:33:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:33:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:33:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:33:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:33:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:33:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:33:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:33:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:33:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:33:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:33:23 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:33:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:33:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:33:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:33:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:33:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:33:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:33:26 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:33:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 14:33:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:33:27 - XML: Processed 655262 elements - found 528 jobs
Sat 18 Jan 2014 14:33:27 - job 7335148 appears to have finished
Sat 18 Jan 2014 14:33:27 - job 7348992 report time 1390051812 does not match current heartbeat 1390051933 : ignoring job
Sat 18 Jan 2014 14:33:27 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 14:33:27 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 14:33:27 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 14:33:27 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:33:27 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:33:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:33:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43802085
Sat 18 Jan 2014 14:33:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:33:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43802085
Sat 18 Jan 2014 14:33:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:33:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:33:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:33:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:33:39 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:33:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:33:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:33:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:33:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:33:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:33:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43802085
Sat 18 Jan 2014 14:33:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:33:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:33:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:33:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:33:42 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:33:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:33:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:33:43 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:33:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:33:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 14:33:44 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:33:44 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:33:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5737 values 90653 bits 11331 bytes 
Sat 18 Jan 2014 14:33:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 14:33:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:33:48 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:33:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:33:52 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:33:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:33:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:33:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:33:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:33:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:33:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:33:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:33:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:33:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:33:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:33:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:33:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:33:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:33:55 - job_xml_thread(): Done retrieving: data size 43800022
Sat 18 Jan 2014 14:33:55 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:33:55 - XML: Start document: iteration 8
Sat 18 Jan 2014 14:33:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43800022
Sat 18 Jan 2014 14:33:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:33:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43800022
Sat 18 Jan 2014 14:33:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:34:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:34:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:34:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:34:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:34:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:34:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:34:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:34:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:34:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:34:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:34:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:34:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:34:18 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:34:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:34:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:34:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:34:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:34:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:34:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:34:19 - XML: Processed 655259 elements - found 528 jobs
Sat 18 Jan 2014 14:34:19 - job 7348992 report time 1390051812 does not match current heartbeat 1390051933 : ignoring job
Sat 18 Jan 2014 14:34:19 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:34:19 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:34:19 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:34:19 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:34:20 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:34:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 14:34:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:34:20 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 14:34:20 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 14:34:20 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:34:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:34:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43815668
Sat 18 Jan 2014 14:34:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:34:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43815668
Sat 18 Jan 2014 14:34:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:34:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:34:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:34:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:34:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:34:34 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:34:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:34:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:34:37 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:34:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:34:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:34:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:34:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:34:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:34:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:34:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:34:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:34:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:34:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:34:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:34:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:34:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:34:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:34:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:34:40 - job_xml_thread(): Done retrieving: data size 43827382
Sat 18 Jan 2014 14:34:40 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:34:40 - XML: Start document: iteration 9
Sat 18 Jan 2014 14:34:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43827382
Sat 18 Jan 2014 14:34:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:34:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43827382
Sat 18 Jan 2014 14:34:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:34:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:34:45 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:34:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:34:45 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:34:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 14:34:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 14:34:45 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:34:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8746 values 137952 bits 17244 bytes 
Sat 18 Jan 2014 14:34:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:34:51 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:34:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:34:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:34:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:34:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:34:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:34:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:34:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:34:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:34:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:35:03 - XML: Processed 655260 elements - found 527 jobs
Sat 18 Jan 2014 14:35:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:35:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:35:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:35:03 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:35:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:35:03 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:35:03 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:35:03 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:35:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:35:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:35:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:35:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:35:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:35:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43823468
Sat 18 Jan 2014 14:35:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:35:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43823468
Sat 18 Jan 2014 14:35:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:35:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:35:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:35:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:35:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:35:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:35:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:35:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:35:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:35:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:35:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:35:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:35:19 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:35:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:35:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:35:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:35:19 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:35:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:35:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:35:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:35:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:35:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:35:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:35:20 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:35:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 14:35:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:35:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:35:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43770045
Sat 18 Jan 2014 14:35:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:35:22 - job_xml_thread(): Done retrieving: data size 43770045
Sat 18 Jan 2014 14:35:22 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:35:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43770045
Sat 18 Jan 2014 14:35:22 - XML: Start document: iteration 10
Sat 18 Jan 2014 14:35:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:35:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:35:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:35:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:35:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:35:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:35:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:35:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:35:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:35:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:35:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:35:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:35:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:35:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:35:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:35:43 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:35:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:35:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:35:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:35:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:35:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:35:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:35:44 - XML: Processed 654514 elements - found 528 jobs
Sat 18 Jan 2014 14:35:44 - job 7348994 report time 1390051933 does not match current heartbeat 1390052053 : ignoring job
Sat 18 Jan 2014 14:35:44 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 14:35:44 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 14:35:44 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 14:35:44 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:35:44 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:35:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:35:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:35:45 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:35:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43226765
Sat 18 Jan 2014 14:35:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:35:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43226765
Sat 18 Jan 2014 14:35:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:35:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:35:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 14:35:46 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:35:46 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:35:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 14:35:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6428 values 101395 bits 12674 bytes 
Sat 18 Jan 2014 14:35:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:35:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:35:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:35:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:35:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:35:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:35:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:35:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:35:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:35:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:35:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:35:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:35:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:35:59 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:36:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:36:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:36:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:36:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:36:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:36:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:36:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:36:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:36:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:36:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43183107
Sat 18 Jan 2014 14:36:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:36:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43183107
Sat 18 Jan 2014 14:36:03 - job_xml_thread(): Done retrieving: data size 43183107
Sat 18 Jan 2014 14:36:03 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:36:03 - XML: Start document: iteration 11
Sat 18 Jan 2014 14:36:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:36:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:36:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:36:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:36:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:36:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:36:19 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:36:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:36:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:36:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:36:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:36:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:36:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:36:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:36:21 - XML: Processed 647062 elements - found 528 jobs
Sat 18 Jan 2014 14:36:21 - job 7348994 report time 1390051933 does not match current heartbeat 1390052053 : ignoring job
Sat 18 Jan 2014 14:36:21 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:36:21 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:36:21 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:36:21 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:36:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:36:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:36:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:36:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:36:26 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:36:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 14:36:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:36:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:36:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:36:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:36:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:36:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:36:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43222676
Sat 18 Jan 2014 14:36:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:36:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43222676
Sat 18 Jan 2014 14:36:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:36:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:36:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:36:37 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:36:37 - job_xml_thread(): Done retrieving: data size 43222676
Sat 18 Jan 2014 14:36:37 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:36:37 - XML: Start document: iteration 12
Sat 18 Jan 2014 14:36:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:36:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:36:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:36:42 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:36:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:36:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:36:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:36:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:36:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:36:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:36:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:36:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:36:47 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:36:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:36:47 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:36:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 14:36:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 14:36:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:36:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:36:47 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:36:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5520 values 87019 bits 10877 bytes 
Sat 18 Jan 2014 14:36:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:36:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:36:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:36:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:36:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:36:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:36:51 - XML: Processed 647810 elements - found 528 jobs
Sat 18 Jan 2014 14:36:51 - job 7348994 report time 1390051933 does not match current heartbeat 1390052053 : ignoring job
Sat 18 Jan 2014 14:36:51 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:36:51 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:36:51 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:36:51 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:36:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:36:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43789487
Sat 18 Jan 2014 14:36:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:36:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43789487
Sat 18 Jan 2014 14:36:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:36:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:36:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:37:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:37:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:37:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:37:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:37:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:37:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:37:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:37:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:37:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43789487
Sat 18 Jan 2014 14:37:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:37:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:37:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:37:06 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:37:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:37:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:37:13 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:37:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:37:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:37:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:37:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:37:16 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:37:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 14:37:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:37:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:37:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:37:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:37:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:37:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:37:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:37:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:37:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:37:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:37:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:37:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:37:17 - job_xml_thread(): Done retrieving: data size 43814218
Sat 18 Jan 2014 14:37:17 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:37:17 - XML: Start document: iteration 13
Sat 18 Jan 2014 14:37:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43814218
Sat 18 Jan 2014 14:37:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:37:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43814218
Sat 18 Jan 2014 14:37:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:37:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:37:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:37:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:37:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:37:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:37:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:37:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:37:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:37:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:37:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:37:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:37:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:37:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:37:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:37:38 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:37:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:37:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:37:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:37:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:37:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:37:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:37:40 - XML: Processed 655262 elements - found 528 jobs
Sat 18 Jan 2014 14:37:40 - job 7348996 report time 1390052053 does not match current heartbeat 1390052174 : ignoring job
Sat 18 Jan 2014 14:37:40 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 14:37:40 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 14:37:40 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 14:37:40 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:37:40 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:37:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:37:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43820544
Sat 18 Jan 2014 14:37:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:37:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43820544
Sat 18 Jan 2014 14:37:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:37:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:37:47 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:37:48 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:37:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 14:37:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:37:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 14:37:49 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:37:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8933 values 140951 bits 17618 bytes 
Sat 18 Jan 2014 14:37:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:37:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:37:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:37:53 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:37:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:37:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:37:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:37:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:37:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:37:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:37:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:37:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:37:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:37:55 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:37:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:37:56 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:37:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:37:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:37:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:37:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:37:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:37:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:37:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:37:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43829440
Sat 18 Jan 2014 14:37:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:37:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43829440
Sat 18 Jan 2014 14:37:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:37:59 - job_xml_thread(): Done retrieving: data size 43829440
Sat 18 Jan 2014 14:37:59 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:37:59 - XML: Start document: iteration 14
Sat 18 Jan 2014 14:38:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:38:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:38:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:38:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:38:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:38:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:38:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:38:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:38:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:38:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:38:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:38:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:38:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:38:17 - XML: Processed 655262 elements - found 528 jobs
Sat 18 Jan 2014 14:38:17 - job 7348996 report time 1390052053 does not match current heartbeat 1390052174 : ignoring job
Sat 18 Jan 2014 14:38:17 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:38:17 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:38:17 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:38:17 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:38:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:38:21 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:38:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:38:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:38:21 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:38:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 14:38:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:38:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:38:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:38:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:38:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:38:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:38:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43829563
Sat 18 Jan 2014 14:38:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:38:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43829563
Sat 18 Jan 2014 14:38:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:38:32 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:38:32 - job_xml_thread(): Done retrieving: data size 43829563
Sat 18 Jan 2014 14:38:32 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:38:32 - XML: Start document: iteration 15
Sat 18 Jan 2014 14:38:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:38:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:38:33 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:38:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:38:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:38:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:38:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:38:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:38:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:38:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:38:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:38:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:38:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:38:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:38:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:38:45 - XML: Processed 655262 elements - found 528 jobs
Sat 18 Jan 2014 14:38:46 - job 7348996 report time 1390052053 does not match current heartbeat 1390052174 : ignoring job
Sat 18 Jan 2014 14:38:46 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:38:46 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:38:46 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:38:46 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:38:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:38:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:38:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:38:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:38:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:38:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43822518
Sat 18 Jan 2014 14:38:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:38:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43822518
Sat 18 Jan 2014 14:38:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:38:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:38:49 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:38:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:38:49 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:38:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 14:38:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 14:38:50 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:38:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8721 values 137464 bits 17183 bytes 
Sat 18 Jan 2014 14:38:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:38:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:38:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:38:56 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:38:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:38:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:38:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:38:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:38:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:38:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:38:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43822518
Sat 18 Jan 2014 14:38:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:39:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:39:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:39:01 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:39:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:39:06 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 14:39:07 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:39:07 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:39:07 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:39:07 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 14:39:07 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 14:39:07 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 14:39:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:39:07 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:39:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:39:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:39:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:39:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:39:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:39:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:39:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:39:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:39:10 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 953608 values 15044293 bits 1880536 bytes 
Sat 18 Jan 2014 14:39:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:39:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:39:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:39:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:39:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:39:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:39:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:39:14 - job_xml_thread(): Done retrieving: data size 43807212
Sat 18 Jan 2014 14:39:14 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:39:14 - XML: Start document: iteration 16
Sat 18 Jan 2014 14:39:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43807212
Sat 18 Jan 2014 14:39:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43807212
Sat 18 Jan 2014 14:39:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:39:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:39:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:39:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:39:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:39:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:39:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:39:29 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:39:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:39:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:39:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:39:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:39:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:39:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:39:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:39:35 - XML: Processed 655262 elements - found 528 jobs
Sat 18 Jan 2014 14:39:35 - job 7344571 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 14:39:35 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 14:39:35 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 14:39:36 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 14:39:36 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:39:36 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:39:36 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:39:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 14:39:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:39:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:39:38 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:39:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:39:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:39:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:39:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:39:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:39:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:39:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:39:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43806564
Sat 18 Jan 2014 14:39:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:39:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43806564
Sat 18 Jan 2014 14:39:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:39:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:39:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:39:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:39:49 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:39:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:39:50 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:39:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 14:39:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 14:39:50 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:39:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5828 values 91853 bits 11481 bytes 
Sat 18 Jan 2014 14:39:51 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:39:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:39:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:39:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:39:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:39:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:39:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:39:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:39:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:39:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:39:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:39:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:39:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:39:57 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:39:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:39:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:39:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:39:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:39:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:39:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:40:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:40:01 - job_xml_thread(): Done retrieving: data size 43813811
Sat 18 Jan 2014 14:40:01 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:40:01 - XML: Start document: iteration 17
Sat 18 Jan 2014 14:40:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43813811
Sat 18 Jan 2014 14:40:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:40:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43813811
Sat 18 Jan 2014 14:40:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:40:08 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:40:08 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 14:40:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:40:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:40:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:40:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:40:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:40:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:40:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:40:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:40:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:40:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:40:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:40:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:40:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:40:22 - XML: Processed 655262 elements - found 528 jobs
Sat 18 Jan 2014 14:40:22 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:40:22 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:40:22 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:40:22 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:40:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:40:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:40:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:40:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:40:24 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:40:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 14:40:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:40:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:40:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:40:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:40:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:40:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:40:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43805260
Sat 18 Jan 2014 14:40:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:40:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43805260
Sat 18 Jan 2014 14:40:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:40:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:40:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:40:37 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:40:37 - job_xml_thread(): Done retrieving: data size 43805260
Sat 18 Jan 2014 14:40:37 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:40:37 - XML: Start document: iteration 18
Sat 18 Jan 2014 14:40:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:40:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:40:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:40:42 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:40:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:40:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:40:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:40:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:40:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:40:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:40:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:40:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:40:49 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:40:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:40:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:40:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:40:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:40:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:40:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:40:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:40:50 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:40:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:40:51 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:40:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 14:40:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 14:40:51 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:40:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5828 values 91886 bits 11485 bytes 
Sat 18 Jan 2014 14:40:52 - XML: Processed 655262 elements - found 528 jobs
Sat 18 Jan 2014 14:40:52 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:40:52 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:40:52 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:40:52 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:40:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:40:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43817643
Sat 18 Jan 2014 14:40:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:40:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43817643
Sat 18 Jan 2014 14:40:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:40:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:40:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:41:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:41:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:41:07 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:41:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:41:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:41:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:41:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:41:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:41:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:41:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:41:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:41:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:41:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:41:11 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:41:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:41:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:41:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:41:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:41:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:41:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:41:12 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:41:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 14:41:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:41:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:41:14 - job_xml_thread(): Done retrieving: data size 43753334
Sat 18 Jan 2014 14:41:14 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:41:14 - XML: Start document: iteration 19
Sat 18 Jan 2014 14:41:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43753334
Sat 18 Jan 2014 14:41:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:41:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43753334
Sat 18 Jan 2014 14:41:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:41:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:41:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:41:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:41:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:41:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:41:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:41:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:41:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:41:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:41:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:41:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:41:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:41:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:41:37 - XML: Processed 654509 elements - found 527 jobs
Sat 18 Jan 2014 14:41:37 - job 7348627 appears to have finished
Sat 18 Jan 2014 14:41:37 - job 7344571 field 'start_timestamp' changed since saved from: 1390052296 to: 1390052294
Sat 18 Jan 2014 14:41:37 - job 7348997 appears to have finished
Sat 18 Jan 2014 14:41:37 - job_xml_thread(): Found 4 updated jobs.
Sat 18 Jan 2014 14:41:37 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 14:41:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:41:39 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:41:39 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Sat 18 Jan 2014 14:41:39 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:41:39 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:41:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:41:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:41:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:41:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:41:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:41:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:41:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:41:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43310928
Sat 18 Jan 2014 14:41:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:41:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43310928
Sat 18 Jan 2014 14:41:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:41:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:41:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:41:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:41:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:41:51 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:41:51 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:41:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:41:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:41:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:41:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:41:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:41:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:41:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:41:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:41:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 14:41:52 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:41:52 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:41:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 14:41:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8634 values 136100 bits 17012 bytes 
Sat 18 Jan 2014 14:41:54 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:41:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:41:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:41:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:41:56 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:41:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:41:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:41:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:41:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:41:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:41:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:41:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:41:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43165774
Sat 18 Jan 2014 14:41:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:41:59 - job_xml_thread(): Done retrieving: data size 43165774
Sat 18 Jan 2014 14:41:59 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:41:59 - XML: Start document: iteration 20
Sat 18 Jan 2014 14:41:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43165774
Sat 18 Jan 2014 14:41:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:42:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:42:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:42:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:42:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:42:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:42:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:42:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:42:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:42:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:42:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:42:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:42:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:42:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:42:23 - XML: Processed 647139 elements - found 527 jobs
Sat 18 Jan 2014 14:42:23 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:42:23 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:42:23 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:42:23 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:42:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:42:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:42:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:42:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:42:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:42:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:42:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:42:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:42:24 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:42:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 14:42:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:42:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:42:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43244220
Sat 18 Jan 2014 14:42:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:42:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43244220
Sat 18 Jan 2014 14:42:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:42:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:42:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:42:38 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:42:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:42:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:42:39 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:42:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:42:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:42:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:42:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:42:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:42:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:42:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:42:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:42:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:42:42 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:42:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:42:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:42:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:42:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:42:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:42:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:42:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:42:45 - job_xml_thread(): Done retrieving: data size 43755826
Sat 18 Jan 2014 14:42:45 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:42:45 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 14:42:45 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 14:42:45 - Housekeeping: done.
Sat 18 Jan 2014 14:42:45 - XML: Start document: iteration 0
Sat 18 Jan 2014 14:42:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43755826
Sat 18 Jan 2014 14:42:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:42:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43755826
Sat 18 Jan 2014 14:42:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:42:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:42:52 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:42:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:42:53 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:42:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 14:42:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 14:42:53 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:42:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8807 values 138831 bits 17353 bytes 
Sat 18 Jan 2014 14:42:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:42:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:42:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:42:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:43:03 - XML: Processed 654568 elements - found 527 jobs
Sat 18 Jan 2014 14:43:04 - job 7349001 report time 1390052415 does not match current heartbeat 1390052535 : ignoring job
Sat 18 Jan 2014 14:43:04 - job 7348999 appears to have finished
Sat 18 Jan 2014 14:43:04 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 14:43:04 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 14:43:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:43:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:43:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:43:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:43:05 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 14:43:05 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:43:05 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:43:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:43:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:43:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:43:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:43:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:43:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:43:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:43:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:43:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:43:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:43:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:43:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:43:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:43:10 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 14:43:10 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 14:43:10 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:43:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:43:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43814247
Sat 18 Jan 2014 14:43:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:43:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43814247
Sat 18 Jan 2014 14:43:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:43:18 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:43:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 14:43:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:43:20 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:43:20 - job_xml_thread(): Done retrieving: data size 43814247
Sat 18 Jan 2014 14:43:20 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:43:20 - XML: Start document: iteration 1
Sat 18 Jan 2014 14:43:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:43:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:43:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:43:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:43:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:43:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:43:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:43:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:43:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:43:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:43:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:43:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:43:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:43:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:43:31 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:43:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:43:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:43:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:43:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:43:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:43:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:43:34 - XML: Processed 655260 elements - found 527 jobs
Sat 18 Jan 2014 14:43:34 - job 7349001 report time 1390052415 does not match current heartbeat 1390052535 : ignoring job
Sat 18 Jan 2014 14:43:34 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:43:34 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:43:34 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:43:34 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:43:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:43:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43807472
Sat 18 Jan 2014 14:43:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:43:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43807472
Sat 18 Jan 2014 14:43:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:43:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:43:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:43:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:43:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:43:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:43:48 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:43:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:43:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:43:49 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:43:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:43:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:43:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:43:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:43:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:43:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:43:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:43:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:43:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:43:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:43:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:43:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:43:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:43:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:43:52 - job_xml_thread(): Done retrieving: data size 43845128
Sat 18 Jan 2014 14:43:52 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:43:52 - XML: Start document: iteration 2
Sat 18 Jan 2014 14:43:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:43:53 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:43:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43845128
Sat 18 Jan 2014 14:43:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:43:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43845128
Sat 18 Jan 2014 14:43:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:43:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:43:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 14:43:53 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:43:53 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:43:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 14:43:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6253 values 98597 bits 12324 bytes 
Sat 18 Jan 2014 14:44:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:44:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:44:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:44:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:44:10 - XML: Processed 655260 elements - found 527 jobs
Sat 18 Jan 2014 14:44:11 - job 7349001 report time 1390052415 does not match current heartbeat 1390052535 : ignoring job
Sat 18 Jan 2014 14:44:11 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:44:11 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:44:11 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:44:11 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:44:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:44:11 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:44:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:44:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:44:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:44:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:44:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:44:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:44:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:44:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:44:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:44:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:44:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:44:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:44:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:44:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:44:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:44:17 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:44:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 14:44:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:44:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:44:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43824044
Sat 18 Jan 2014 14:44:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:44:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43824044
Sat 18 Jan 2014 14:44:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:44:27 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:44:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:44:27 - job_xml_thread(): Done retrieving: data size 43824044
Sat 18 Jan 2014 14:44:27 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:44:27 - XML: Start document: iteration 3
Sat 18 Jan 2014 14:44:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:44:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:44:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:44:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:44:32 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:44:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:44:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:44:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:44:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:44:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:44:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:44:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:44:38 - XML: Processed 655260 elements - found 527 jobs
Sat 18 Jan 2014 14:44:38 - job 7349001 report time 1390052415 does not match current heartbeat 1390052535 : ignoring job
Sat 18 Jan 2014 14:44:38 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:44:38 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:44:38 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:44:38 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:44:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:44:41 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:44:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:44:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:44:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:44:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:44:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:44:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:44:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:44:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43825255
Sat 18 Jan 2014 14:44:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:44:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43825255
Sat 18 Jan 2014 14:44:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:44:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:44:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:44:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:44:53 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:44:54 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:44:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:44:54 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:44:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:44:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:44:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:44:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:44:54 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:44:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 14:44:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 14:44:54 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:44:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6295 values 99297 bits 12412 bytes 
Sat 18 Jan 2014 14:44:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:44:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:44:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:44:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:44:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:44:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:44:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:44:58 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:44:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:44:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:44:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:44:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:44:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:44:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:45:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:45:00 - job_xml_thread(): Done retrieving: data size 43826658
Sat 18 Jan 2014 14:45:00 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:45:00 - XML: Start document: iteration 4
Sat 18 Jan 2014 14:45:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43826658
Sat 18 Jan 2014 14:45:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:45:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43826658
Sat 18 Jan 2014 14:45:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:45:09 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:45:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 14:45:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:45:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:45:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:45:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:45:13 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:45:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:45:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:45:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:45:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:45:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:45:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:45:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:45:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:45:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:45:17 - XML: Processed 655262 elements - found 528 jobs
Sat 18 Jan 2014 14:45:17 - job 7349003 report time 1390052535 does not match current heartbeat 1390052656 : ignoring job
Sat 18 Jan 2014 14:45:17 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 14:45:17 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 14:45:18 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 14:45:18 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:45:18 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:45:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:45:21 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:45:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:45:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:45:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:45:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:45:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:45:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:45:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:45:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43825146
Sat 18 Jan 2014 14:45:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:45:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43825146
Sat 18 Jan 2014 14:45:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:45:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:45:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:45:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:45:32 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:45:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:45:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:45:33 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:45:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:45:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:45:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:45:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:45:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:45:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:45:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:45:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:45:37 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:45:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:45:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:45:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:45:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:45:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:45:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:45:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:45:39 - job_xml_thread(): Done retrieving: data size 43845157
Sat 18 Jan 2014 14:45:39 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:45:39 - XML: Start document: iteration 5
Sat 18 Jan 2014 14:45:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43845157
Sat 18 Jan 2014 14:45:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:45:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43845157
Sat 18 Jan 2014 14:45:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:45:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:45:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:45:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:45:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:45:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:45:53 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:45:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:45:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:45:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:45:54 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:45:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:45:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:45:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:45:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:45:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:45:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:45:55 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:45:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 14:45:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 14:45:55 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:45:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9378 values 147929 bits 18491 bytes 
Sat 18 Jan 2014 14:45:57 - XML: Processed 655262 elements - found 528 jobs
Sat 18 Jan 2014 14:45:57 - job 7349003 report time 1390052535 does not match current heartbeat 1390052656 : ignoring job
Sat 18 Jan 2014 14:45:57 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:45:57 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:45:57 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:45:57 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:46:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:46:01 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:46:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:46:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:46:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:46:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:46:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:46:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:46:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:46:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43814880
Sat 18 Jan 2014 14:46:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:46:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43814880
Sat 18 Jan 2014 14:46:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:46:08 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 14:46:08 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:46:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:46:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:46:10 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:46:10 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 14:46:10 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:46:10 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 14:46:10 - Entering storeMetrics(): cluster LISA Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sat 18 Jan 2014 14:46:12 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:46:12 - job_xml_thread(): Done retrieving: data size 43814880
Sat 18 Jan 2014 14:46:12 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:46:13 - XML: Start document: iteration 6
Sat 18 Jan 2014 14:46:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:46:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:46:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:46:18 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:46:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:46:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:46:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:46:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:46:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:46:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:46:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:46:24 - XML: Processed 655262 elements - found 528 jobs
Sat 18 Jan 2014 14:46:24 - job 7349003 report time 1390052535 does not match current heartbeat 1390052656 : ignoring job
Sat 18 Jan 2014 14:46:24 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:46:24 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:46:24 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:46:24 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:46:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:46:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:46:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:46:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:46:25 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:46:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 14:46:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:46:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:46:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:46:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:46:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:46:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:46:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43832139
Sat 18 Jan 2014 14:46:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:46:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43832139
Sat 18 Jan 2014 14:46:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:46:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:46:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:46:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:46:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:46:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:46:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:46:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:46:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:46:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:46:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:46:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:46:39 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:46:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:46:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:46:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:46:40 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:46:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:46:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:46:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:46:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:46:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:46:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:46:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:46:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43842288
Sat 18 Jan 2014 14:46:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:46:42 - job_xml_thread(): Done retrieving: data size 43842288
Sat 18 Jan 2014 14:46:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43842288
Sat 18 Jan 2014 14:46:42 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:46:42 - XML: Start document: iteration 7
Sat 18 Jan 2014 14:46:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:46:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:46:51 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:46:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:46:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:46:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:46:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:46:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:46:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:46:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:46:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:46:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:46:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:46:56 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:46:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:46:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 14:46:56 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:46:56 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:46:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8678 values 137072 bits 17134 bytes 
Sat 18 Jan 2014 14:46:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 14:47:01 - XML: Processed 655260 elements - found 527 jobs
Sat 18 Jan 2014 14:47:01 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:47:01 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:47:01 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:47:01 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:47:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:47:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:47:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:47:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:47:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:47:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:47:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:47:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:47:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:47:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43823374
Sat 18 Jan 2014 14:47:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:47:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43823374
Sat 18 Jan 2014 14:47:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:47:10 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:47:10 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:47:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:47:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:47:11 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:47:11 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 14:47:11 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 14:47:11 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:47:11 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 14:47:16 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:47:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:47:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:47:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:47:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:47:19 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:47:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:47:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:47:20 - size of cluster 'LISA Cluster': 624 hosts 79481 metrics 911532 values 14381681 bits 1797710 bytes 
Sat 18 Jan 2014 14:47:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:47:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:47:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:47:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:47:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:47:23 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:47:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:47:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:47:23 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:47:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 14:47:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:47:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:47:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:47:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:47:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:47:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:47:25 - job_xml_thread(): Done retrieving: data size 43755601
Sat 18 Jan 2014 14:47:25 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:47:25 - XML: Start document: iteration 8
Sat 18 Jan 2014 14:47:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43755601
Sat 18 Jan 2014 14:47:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:47:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43755601
Sat 18 Jan 2014 14:47:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:47:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:47:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:47:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:47:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:47:44 - XML: Processed 654514 elements - found 528 jobs
Sat 18 Jan 2014 14:47:44 - job 7349006 report time 1390052656 does not match current heartbeat 1390052776 : ignoring job
Sat 18 Jan 2014 14:47:44 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 14:47:44 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 14:47:44 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 14:47:44 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:47:44 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:47:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:47:45 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:47:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:47:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:47:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:47:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:47:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:47:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:47:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:47:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:47:49 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:47:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:47:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:47:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:47:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:47:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:47:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:47:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:47:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43199386
Sat 18 Jan 2014 14:47:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:47:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43199386
Sat 18 Jan 2014 14:47:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:47:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:47:57 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:47:59 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:47:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 14:48:00 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:48:00 - job_xml_thread(): Done retrieving: data size 43199386
Sat 18 Jan 2014 14:48:00 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:48:00 - XML: Start document: iteration 9
Sat 18 Jan 2014 14:48:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:48:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 14:48:01 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:48:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8703 values 137624 bits 17203 bytes 
Sat 18 Jan 2014 14:48:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:48:02 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:48:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:48:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:48:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:48:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:48:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:48:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:48:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:48:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:48:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:48:11 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:48:11 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 14:48:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:48:12 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:48:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:48:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:48:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:48:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:48:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:48:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:48:15 - XML: Processed 647230 elements - found 528 jobs
Sat 18 Jan 2014 14:48:15 - job 7349006 report time 1390052656 does not match current heartbeat 1390052776 : ignoring job
Sat 18 Jan 2014 14:48:15 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:48:15 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:48:15 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:48:15 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:48:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:48:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:48:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:48:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43201668
Sat 18 Jan 2014 14:48:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:48:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43201668
Sat 18 Jan 2014 14:48:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:48:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:48:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:48:30 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:48:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:48:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:48:32 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:48:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:48:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:48:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:48:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:48:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:48:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:48:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:48:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:48:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:48:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:48:36 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:48:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 14:48:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:48:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:48:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:48:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:48:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:48:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:48:40 - job_xml_thread(): Done retrieving: data size 43367723
Sat 18 Jan 2014 14:48:40 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:48:40 - XML: Start document: iteration 10
Sat 18 Jan 2014 14:48:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43367723
Sat 18 Jan 2014 14:48:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:48:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43367723
Sat 18 Jan 2014 14:48:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:48:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:48:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:48:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:48:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:48:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:48:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:48:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:48:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:48:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:48:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:48:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:48:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:48:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:49:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:49:00 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:49:00 - XML: Processed 649532 elements - found 528 jobs
Sat 18 Jan 2014 14:49:00 - job 7349006 report time 1390052656 does not match current heartbeat 1390052776 : ignoring job
Sat 18 Jan 2014 14:49:00 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:49:00 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:49:00 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:49:00 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:49:00 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:49:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:49:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 14:49:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 14:49:00 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:49:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5992 values 94620 bits 11827 bytes 
Sat 18 Jan 2014 14:49:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:49:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:49:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:49:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:49:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:49:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:49:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:49:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:49:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:49:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43814635
Sat 18 Jan 2014 14:49:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:49:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43814635
Sat 18 Jan 2014 14:49:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:49:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:49:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:49:15 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:49:15 - job_xml_thread(): Done retrieving: data size 43814635
Sat 18 Jan 2014 14:49:15 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:49:15 - XML: Start document: iteration 11
Sat 18 Jan 2014 14:49:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:49:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:49:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:49:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:49:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:49:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:49:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:49:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:49:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:49:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:49:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:49:28 - XML: Processed 655212 elements - found 527 jobs
Sat 18 Jan 2014 14:49:28 - job 7344645 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 14:49:28 - job 7349008 report time 1390052776 does not match current heartbeat 1390052897 : ignoring job
Sat 18 Jan 2014 14:49:28 - job 7349005 appears to have finished
Sat 18 Jan 2014 14:49:28 - job_xml_thread(): Found 3 updated jobs.
Sat 18 Jan 2014 14:49:28 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 14:49:28 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Sat 18 Jan 2014 14:49:28 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:49:28 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:49:31 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:49:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 14:49:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:49:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:49:32 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:49:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:49:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:49:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:49:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:49:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:49:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:49:33 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 14:49:33 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 14:49:33 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:49:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:49:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:49:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:49:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43802309
Sat 18 Jan 2014 14:49:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:49:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43802309
Sat 18 Jan 2014 14:49:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:49:43 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:49:43 - job_xml_thread(): Done retrieving: data size 43802309
Sat 18 Jan 2014 14:49:44 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:49:44 - XML: Start document: iteration 12
Sat 18 Jan 2014 14:49:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:49:45 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:49:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:49:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:49:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:49:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:49:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:49:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:49:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:49:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:49:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:49:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:49:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:49:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:49:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:49:56 - XML: Processed 655260 elements - found 527 jobs
Sat 18 Jan 2014 14:49:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:49:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:49:56 - job 7349008 report time 1390052776 does not match current heartbeat 1390052897 : ignoring job
Sat 18 Jan 2014 14:49:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:49:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:49:56 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:49:56 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:49:56 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:49:56 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:49:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:49:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43802702
Sat 18 Jan 2014 14:49:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:49:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43802702
Sat 18 Jan 2014 14:49:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:50:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:50:01 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:50:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:50:02 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:50:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 14:50:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 14:50:02 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:50:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8664 values 136616 bits 17077 bytes 
Sat 18 Jan 2014 14:50:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:50:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:50:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:50:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:50:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:50:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:50:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:50:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:50:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:50:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:50:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:50:11 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:50:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:50:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:50:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:50:13 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:50:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:50:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:50:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:50:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:50:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:50:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:50:15 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:50:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 14:50:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:50:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:50:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43822360
Sat 18 Jan 2014 14:50:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:50:16 - job_xml_thread(): Done retrieving: data size 43822360
Sat 18 Jan 2014 14:50:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43822360
Sat 18 Jan 2014 14:50:17 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:50:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:50:17 - XML: Start document: iteration 13
Sat 18 Jan 2014 14:50:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:50:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:50:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:50:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:50:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:50:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:50:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:50:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:50:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:50:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:50:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:50:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:50:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:50:36 - XML: Processed 655260 elements - found 527 jobs
Sat 18 Jan 2014 14:50:36 - job 7349008 report time 1390052776 does not match current heartbeat 1390052897 : ignoring job
Sat 18 Jan 2014 14:50:36 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:50:36 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:50:36 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:50:36 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:50:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:50:38 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:50:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:50:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:50:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:50:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:50:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:50:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:50:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:50:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43807722
Sat 18 Jan 2014 14:50:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:50:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43807722
Sat 18 Jan 2014 14:50:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:50:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:50:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:50:51 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:50:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:50:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:50:52 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:50:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:50:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:50:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:50:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:50:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:50:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:50:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:50:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:50:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:50:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:50:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:50:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:50:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:50:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:50:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:50:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:50:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:50:57 - job_xml_thread(): Done retrieving: data size 43825438
Sat 18 Jan 2014 14:50:57 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:50:57 - XML: Start document: iteration 14
Sat 18 Jan 2014 14:50:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43825438
Sat 18 Jan 2014 14:50:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:50:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43825438
Sat 18 Jan 2014 14:50:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:51:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:51:03 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:51:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:51:05 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:51:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 14:51:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 14:51:05 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:51:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9268 values 146186 bits 18273 bytes 
Sat 18 Jan 2014 14:51:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:51:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:51:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:51:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:51:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:51:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:51:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:51:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:51:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:51:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:51:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:51:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:51:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:51:17 - XML: Processed 655258 elements - found 526 jobs
Sat 18 Jan 2014 14:51:17 - job 7348838 appears to have finished
Sat 18 Jan 2014 14:51:18 - job 7349010 report time 1390052897 does not match current heartbeat 1390053017 : ignoring job
Sat 18 Jan 2014 14:51:18 - job 7335216 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 14:51:18 - job_xml_thread(): Found 3 updated jobs.
Sat 18 Jan 2014 14:51:18 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 14:51:18 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Sat 18 Jan 2014 14:51:18 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:51:18 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:51:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:51:20 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:51:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:51:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:51:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:51:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:51:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:51:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:51:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:51:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43823019
Sat 18 Jan 2014 14:51:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:51:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43823019
Sat 18 Jan 2014 14:51:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:51:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:51:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:51:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:51:30 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:51:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:51:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:51:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:51:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:51:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:51:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:51:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43823019
Sat 18 Jan 2014 14:51:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:51:33 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:51:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:51:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:51:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:51:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:51:44 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:51:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:51:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:51:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:51:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:51:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:51:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:51:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:51:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:51:45 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:51:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 14:51:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:51:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:51:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:51:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:51:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:51:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:51:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:51:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:51:46 - job_xml_thread(): Done retrieving: data size 43802502
Sat 18 Jan 2014 14:51:46 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:51:46 - XML: Start document: iteration 15
Sat 18 Jan 2014 14:51:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43802502
Sat 18 Jan 2014 14:51:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:51:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43802502
Sat 18 Jan 2014 14:51:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:52:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:52:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:52:00 - XML: Processed 655258 elements - found 526 jobs
Sat 18 Jan 2014 14:52:00 - job 7349010 report time 1390052897 does not match current heartbeat 1390053017 : ignoring job
Sat 18 Jan 2014 14:52:00 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:52:00 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:52:00 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:52:00 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:52:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:52:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:52:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:52:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:52:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:52:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:52:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:52:05 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:52:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:52:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:52:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:52:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:52:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:52:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:52:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 14:52:06 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:52:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 14:52:06 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:52:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5985 values 94402 bits 11800 bytes 
Sat 18 Jan 2014 14:52:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:52:07 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:52:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:52:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:52:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:52:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:52:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:52:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:52:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:52:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43841501
Sat 18 Jan 2014 14:52:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:52:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43841501
Sat 18 Jan 2014 14:52:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:52:15 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:52:15 - job_xml_thread(): Done retrieving: data size 43841501
Sat 18 Jan 2014 14:52:15 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:52:15 - XML: Start document: iteration 16
Sat 18 Jan 2014 14:52:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:52:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:52:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:52:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:52:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:52:25 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:52:25 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:52:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:52:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:52:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 14:52:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:52:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:52:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:52:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:52:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:52:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:52:30 - XML: Processed 655258 elements - found 526 jobs
Sat 18 Jan 2014 14:52:30 - job 7349010 report time 1390052897 does not match current heartbeat 1390053017 : ignoring job
Sat 18 Jan 2014 14:52:31 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:52:31 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:52:31 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:52:31 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:52:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:52:32 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:52:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:52:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:52:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:52:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:52:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:52:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:52:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:52:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43825465
Sat 18 Jan 2014 14:52:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:52:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43825465
Sat 18 Jan 2014 14:52:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:52:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:52:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:52:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:52:42 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:52:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:52:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:52:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:52:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:52:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:52:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:52:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:52:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:52:46 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:52:46 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:52:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:52:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:52:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:52:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:52:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:52:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:52:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:52:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43835574
Sat 18 Jan 2014 14:52:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:52:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43835574
Sat 18 Jan 2014 14:52:48 - job_xml_thread(): Done retrieving: data size 43835574
Sat 18 Jan 2014 14:52:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:52:49 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:52:49 - XML: Start document: iteration 17
Sat 18 Jan 2014 14:52:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:52:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:53:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:53:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:53:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:53:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:53:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:53:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:53:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:53:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:53:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:53:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:53:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:53:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:53:06 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:53:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:53:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 14:53:07 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:53:07 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:53:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 14:53:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9037 values 142523 bits 17815 bytes 
Sat 18 Jan 2014 14:53:09 - XML: Processed 655256 elements - found 525 jobs
Sat 18 Jan 2014 14:53:09 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:53:09 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:53:09 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:53:09 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:53:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:53:11 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:53:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:53:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:53:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:53:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:53:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:53:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:53:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:53:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43749149
Sat 18 Jan 2014 14:53:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:53:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43749149
Sat 18 Jan 2014 14:53:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:53:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:53:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:53:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:53:24 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:53:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:53:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:53:24 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:53:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:53:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:53:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:53:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:53:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:53:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:53:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:53:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:53:29 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:53:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:53:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:53:29 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:53:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 14:53:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:53:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:53:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:53:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:53:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:53:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:53:31 - job_xml_thread(): Done retrieving: data size 43725207
Sat 18 Jan 2014 14:53:31 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:53:31 - XML: Start document: iteration 18
Sat 18 Jan 2014 14:53:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43725207
Sat 18 Jan 2014 14:53:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43725207
Sat 18 Jan 2014 14:53:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:53:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:53:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:53:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:53:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:53:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:53:45 - XML: Processed 654156 elements - found 525 jobs
Sat 18 Jan 2014 14:53:45 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:53:45 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:53:45 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:53:45 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:53:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:53:49 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:53:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:53:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:53:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:53:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:53:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:53:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:53:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:53:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:53:53 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:53:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:53:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:53:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:53:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:53:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:53:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:53:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:53:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43171699
Sat 18 Jan 2014 14:53:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:53:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43171699
Sat 18 Jan 2014 14:53:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:54:00 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:54:00 - job_xml_thread(): Done retrieving: data size 43171699
Sat 18 Jan 2014 14:54:00 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:54:00 - XML: Start document: iteration 19
Sat 18 Jan 2014 14:54:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:54:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:54:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:54:07 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:54:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:54:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:54:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:54:08 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:54:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:54:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 14:54:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:54:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 14:54:08 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:54:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:54:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:54:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8470 values 133480 bits 16685 bytes 
Sat 18 Jan 2014 14:54:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:54:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:54:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:54:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:54:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:54:11 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 14:54:11 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:54:11 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:54:11 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:54:11 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 14:54:11 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 14:54:11 - Entering storeMetrics(): cluster LISA Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sat 18 Jan 2014 14:54:17 - XML: Processed 647176 elements - found 525 jobs
Sat 18 Jan 2014 14:54:17 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:54:17 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:54:17 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:54:17 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:54:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:54:19 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:54:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:54:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:54:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:54:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:54:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:54:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:54:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:54:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43226821
Sat 18 Jan 2014 14:54:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:54:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43226821
Sat 18 Jan 2014 14:54:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:54:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:54:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:54:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:54:31 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:54:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:54:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:54:32 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:54:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:54:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:54:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:54:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:54:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:54:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:54:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:54:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:54:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:54:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:54:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:54:36 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:54:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 14:54:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:54:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:54:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:54:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:54:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:54:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:54:37 - job_xml_thread(): Done retrieving: data size 43357593
Sat 18 Jan 2014 14:54:37 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:54:37 - XML: Start document: iteration 20
Sat 18 Jan 2014 14:54:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43357593
Sat 18 Jan 2014 14:54:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:54:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43357593
Sat 18 Jan 2014 14:54:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:54:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:54:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:54:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:54:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:54:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:54:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:54:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:54:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:54:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:54:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:54:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:54:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:54:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:54:58 - XML: Processed 649302 elements - found 525 jobs
Sat 18 Jan 2014 14:54:58 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:54:58 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:54:58 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:54:58 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:55:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:55:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:55:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:55:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:55:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:55:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:55:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:55:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:55:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:55:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43820455
Sat 18 Jan 2014 14:55:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:55:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43820455
Sat 18 Jan 2014 14:55:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:55:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:55:09 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:55:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:55:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 14:55:10 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:55:10 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:55:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 14:55:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8887 values 140090 bits 17511 bytes 
Sat 18 Jan 2014 14:55:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:55:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:55:12 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:55:12 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:55:12 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:55:12 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 14:55:12 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 14:55:12 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:55:12 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 14:55:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:55:13 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:55:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:55:13 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:55:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:55:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:55:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:55:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:55:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:55:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:55:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:55:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:55:15 - size of cluster 'LISA Cluster': 624 hosts 79482 metrics 885972 values 13972671 bits 1746583 bytes 
Sat 18 Jan 2014 14:55:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:55:18 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:55:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:55:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:55:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:55:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:55:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:55:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:55:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:55:22 - job_xml_thread(): Done retrieving: data size 43825219
Sat 18 Jan 2014 14:55:22 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:55:22 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 14:55:22 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 14:55:22 - Housekeeping: done.
Sat 18 Jan 2014 14:55:22 - XML: Start document: iteration 0
Sat 18 Jan 2014 14:55:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43825219
Sat 18 Jan 2014 14:55:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:55:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43825219
Sat 18 Jan 2014 14:55:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:55:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:55:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:55:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:55:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:55:38 - XML: Processed 655258 elements - found 526 jobs
Sat 18 Jan 2014 14:55:38 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 14:55:38 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 14:55:40 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 14:55:40 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:55:41 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:55:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:55:44 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:55:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:55:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:55:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:55:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:55:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:55:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:55:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:55:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:55:46 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:55:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:55:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:55:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:55:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:55:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:55:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:55:47 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:55:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 14:55:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:55:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:55:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43840255
Sat 18 Jan 2014 14:55:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:55:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43840255
Sat 18 Jan 2014 14:55:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:55:56 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:55:57 - job_xml_thread(): Done retrieving: data size 43840255
Sat 18 Jan 2014 14:55:57 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:55:57 - XML: Start document: iteration 1
Sat 18 Jan 2014 14:56:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:56:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:56:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:56:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:56:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:56:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:56:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:56:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:56:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:56:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:56:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:56:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:56:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:56:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:56:10 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:56:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:56:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 14:56:10 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:56:10 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:56:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 14:56:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5805 values 91502 bits 11437 bytes 
Sat 18 Jan 2014 14:56:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:56:12 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:56:12 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:56:12 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 14:56:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:56:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:56:13 - XML: Processed 655258 elements - found 526 jobs
Sat 18 Jan 2014 14:56:13 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:56:13 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:56:13 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:56:13 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:56:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:56:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:56:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:56:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:56:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:56:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43804788
Sat 18 Jan 2014 14:56:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:56:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43804788
Sat 18 Jan 2014 14:56:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:56:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:56:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:56:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:56:27 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:56:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:56:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:56:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:56:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:56:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:56:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:56:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:56:28 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:56:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:56:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:56:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:56:33 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:56:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:56:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:56:33 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:56:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 14:56:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:56:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:56:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:56:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:56:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:56:36 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 14:56:36 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 14:56:36 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:56:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:56:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43837286
Sat 18 Jan 2014 14:56:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:56:37 - job_xml_thread(): Done retrieving: data size 43837286
Sat 18 Jan 2014 14:56:37 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:56:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43837286
Sat 18 Jan 2014 14:56:37 - XML: Start document: iteration 2
Sat 18 Jan 2014 14:56:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:56:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:56:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:56:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:56:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:56:51 - XML: Processed 655258 elements - found 526 jobs
Sat 18 Jan 2014 14:56:51 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:56:51 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:56:51 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:56:51 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:56:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:56:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:56:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:56:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:56:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:56:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:56:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:56:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:56:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:56:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:56:58 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:56:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:56:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:56:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:56:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:56:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:56:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:57:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:57:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43837820
Sat 18 Jan 2014 14:57:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:57:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43837820
Sat 18 Jan 2014 14:57:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:57:06 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:57:06 - job_xml_thread(): Done retrieving: data size 43837820
Sat 18 Jan 2014 14:57:06 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:57:06 - XML: Start document: iteration 3
Sat 18 Jan 2014 14:57:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:57:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:57:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:57:10 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:57:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:57:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 14:57:11 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:57:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 14:57:11 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:57:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8832 values 139222 bits 17402 bytes 
Sat 18 Jan 2014 14:57:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:57:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:57:19 - XML: Processed 655258 elements - found 526 jobs
Sat 18 Jan 2014 14:57:19 - job 7349013 field 'start_timestamp' changed since saved from: 1390053290 to: 1390053232
Sat 18 Jan 2014 14:57:19 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 14:57:19 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 14:57:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:57:22 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:57:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:57:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:57:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:57:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:57:22 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 14:57:22 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:57:22 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:57:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:57:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:57:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:57:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:57:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:57:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:57:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:57:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:57:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:57:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:57:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:57:25 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:57:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 14:57:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:57:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:57:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43842212
Sat 18 Jan 2014 14:57:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:57:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43842212
Sat 18 Jan 2014 14:57:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:57:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:57:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:57:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:57:38 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:57:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:57:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:57:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:57:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:57:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:57:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:57:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:57:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:57:39 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:57:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:57:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:57:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:57:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:57:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:57:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:57:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:57:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:57:40 - job_xml_thread(): Done retrieving: data size 43836424
Sat 18 Jan 2014 14:57:40 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:57:40 - XML: Start document: iteration 4
Sat 18 Jan 2014 14:57:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43836424
Sat 18 Jan 2014 14:57:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43836424
Sat 18 Jan 2014 14:57:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:57:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:57:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:57:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:57:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:57:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:57:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:57:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:57:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:57:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:57:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:57:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:57:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:58:00 - XML: Processed 655253 elements - found 526 jobs
Sat 18 Jan 2014 14:58:00 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:58:00 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:58:00 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:58:00 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:58:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:58:02 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:58:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:58:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:58:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:58:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:58:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:58:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:58:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:58:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43823245
Sat 18 Jan 2014 14:58:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:58:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43823245
Sat 18 Jan 2014 14:58:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:58:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:58:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:58:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:58:11 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:58:12 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:58:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:58:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 14:58:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 14:58:13 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:58:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148610 bits 18576 bytes 
Sat 18 Jan 2014 14:58:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:58:15 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:58:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:58:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:58:15 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:58:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:58:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:58:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:58:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:58:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:58:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:58:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:58:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:58:18 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:58:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:58:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:58:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:58:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:58:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:58:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:58:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:58:21 - job_xml_thread(): Done retrieving: data size 43838804
Sat 18 Jan 2014 14:58:21 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:58:21 - XML: Start document: iteration 5
Sat 18 Jan 2014 14:58:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43838804
Sat 18 Jan 2014 14:58:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43838804
Sat 18 Jan 2014 14:58:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:58:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:58:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:58:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:58:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:58:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:58:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:58:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:58:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:58:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:58:37 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:58:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 14:58:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:58:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:58:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:58:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:58:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:58:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:58:42 - XML: Processed 655258 elements - found 526 jobs
Sat 18 Jan 2014 14:58:42 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 14:58:42 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 14:58:42 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:58:42 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:58:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:58:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:58:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:58:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:58:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:58:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:58:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:58:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:58:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:58:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43824374
Sat 18 Jan 2014 14:58:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:58:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43824374
Sat 18 Jan 2014 14:58:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:58:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:58:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:58:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:58:57 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:58:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:58:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:58:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:58:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:58:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:58:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:58:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:58:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:59:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:59:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:59:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:59:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:59:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:59:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:59:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:59:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:59:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:59:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:59:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:59:03 - job_xml_thread(): Done retrieving: data size 43837322
Sat 18 Jan 2014 14:59:03 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:59:03 - XML: Start document: iteration 6
Sat 18 Jan 2014 14:59:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43837322
Sat 18 Jan 2014 14:59:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:59:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43837322
Sat 18 Jan 2014 14:59:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:59:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:59:13 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:59:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:59:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:59:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:59:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 14:59:14 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:59:14 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:59:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 14:59:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9216 values 145270 bits 18158 bytes 
Sat 18 Jan 2014 14:59:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:59:15 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:59:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:59:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:59:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:59:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:59:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:59:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:59:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:59:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:59:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:59:24 - XML: Processed 655254 elements - found 524 jobs
Sat 18 Jan 2014 14:59:24 - job 7348920 appears to have finished
Sat 18 Jan 2014 14:59:24 - job 7346236 appears to have finished
Sat 18 Jan 2014 14:59:25 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 14:59:25 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 14:59:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:59:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:59:26 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 14:59:26 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 14:59:26 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 14:59:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:59:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:59:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:59:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:59:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:59:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:59:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:59:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43725836
Sat 18 Jan 2014 14:59:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:59:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43725836
Sat 18 Jan 2014 14:59:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:59:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:59:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:59:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:59:39 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:59:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:59:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:59:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:59:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:59:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:59:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:59:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:59:41 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 14:59:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:59:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:59:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 14:59:43 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 14:59:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 14:59:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 14:59:43 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 14:59:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 14:59:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:59:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:59:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 14:59:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 14:59:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 14:59:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 14:59:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43208862
Sat 18 Jan 2014 14:59:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 14:59:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43208862
Sat 18 Jan 2014 14:59:46 - job_xml_thread(): Done retrieving: data size 43208862
Sat 18 Jan 2014 14:59:46 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 14:59:46 - XML: Start document: iteration 7
Sat 18 Jan 2014 14:59:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 14:59:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 14:59:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 14:59:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 14:59:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 14:59:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 14:59:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 14:59:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:59:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 14:59:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 14:59:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 14:59:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 14:59:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 14:59:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:00:06 - XML: Processed 647726 elements - found 524 jobs
Sat 18 Jan 2014 15:00:06 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:00:06 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:00:06 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:00:06 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:00:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:00:07 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:00:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:00:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:00:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:00:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:00:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:00:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:00:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:00:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43146691
Sat 18 Jan 2014 15:00:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:00:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43146691
Sat 18 Jan 2014 15:00:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:00:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:00:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:00:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:00:15 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:00:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:00:16 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:00:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 15:00:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 15:00:16 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:00:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8918 values 140545 bits 17568 bytes 
Sat 18 Jan 2014 15:00:21 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:00:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:00:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:00:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:00:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:00:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:00:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:00:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:00:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:00:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:00:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:00:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:00:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:00:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:00:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:00:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:00:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:00:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:00:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:00:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:00:27 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:00:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 15:00:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:00:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:00:27 - job_xml_thread(): Done retrieving: data size 43287635
Sat 18 Jan 2014 15:00:27 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:00:27 - XML: Start document: iteration 8
Sat 18 Jan 2014 15:00:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43287635
Sat 18 Jan 2014 15:00:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:00:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43287635
Sat 18 Jan 2014 15:00:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:00:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:00:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:00:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:00:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:00:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:00:42 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:00:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:00:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:00:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:00:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:00:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:00:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:00:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:00:45 - XML: Processed 648690 elements - found 524 jobs
Sat 18 Jan 2014 15:00:45 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:00:45 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:00:45 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:00:45 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:00:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:00:49 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:00:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:00:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:00:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:00:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:00:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:00:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:00:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:00:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43753598
Sat 18 Jan 2014 15:00:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:00:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43753598
Sat 18 Jan 2014 15:00:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:00:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:00:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:01:00 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:01:00 - job_xml_thread(): Done retrieving: data size 43753598
Sat 18 Jan 2014 15:01:00 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:01:00 - XML: Start document: iteration 9
Sat 18 Jan 2014 15:01:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:01:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:01:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:01:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:01:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:01:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:01:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:01:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:01:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:01:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:01:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:01:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:01:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:01:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:01:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:01:15 - XML: Processed 654392 elements - found 524 jobs
Sat 18 Jan 2014 15:01:15 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:01:15 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:01:15 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:01:15 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:01:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:01:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:01:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:01:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:01:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:01:16 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:01:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:01:17 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:01:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 15:01:17 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:01:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 15:01:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99057 bits 12382 bytes 
Sat 18 Jan 2014 15:01:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:01:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43797932
Sat 18 Jan 2014 15:01:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:01:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43797932
Sat 18 Jan 2014 15:01:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:01:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:01:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:01:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:01:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:01:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:01:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:01:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:01:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:01:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:01:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:01:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:01:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:01:30 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:01:30 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:01:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:01:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:01:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:01:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:01:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:01:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:01:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:01:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43835540
Sat 18 Jan 2014 15:01:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:01:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43835540
Sat 18 Jan 2014 15:01:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:01:33 - job_xml_thread(): Done retrieving: data size 43835540
Sat 18 Jan 2014 15:01:33 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:01:33 - XML: Start document: iteration 10
Sat 18 Jan 2014 15:01:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:01:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:01:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:01:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:01:51 - XML: Processed 655254 elements - found 524 jobs
Sat 18 Jan 2014 15:01:51 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:01:51 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:01:51 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:01:51 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:01:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:01:52 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:01:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:01:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:01:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:01:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:01:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:01:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:01:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:01:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:01:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:01:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:01:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:01:55 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:01:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 15:01:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:01:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:01:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:01:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:01:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:01:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:01:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43828493
Sat 18 Jan 2014 15:01:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:01:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43828493
Sat 18 Jan 2014 15:01:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:02:06 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:02:06 - job_xml_thread(): Done retrieving: data size 43828493
Sat 18 Jan 2014 15:02:06 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:02:06 - XML: Start document: iteration 11
Sat 18 Jan 2014 15:02:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:02:07 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:02:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:02:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:02:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:02:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:02:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:02:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:02:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:02:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:02:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:02:12 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 15:02:12 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:02:13 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:02:13 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:02:13 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 15:02:13 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 15:02:13 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 15:02:15 - size of cluster 'LISA Cluster': 624 hosts 79478 metrics 966272 values 15247679 bits 1905959 bytes 
Sat 18 Jan 2014 15:02:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:02:17 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:02:17 - XML: Processed 655254 elements - found 524 jobs
Sat 18 Jan 2014 15:02:17 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:02:17 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:02:17 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:02:17 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:02:17 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:02:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 15:02:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:02:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 15:02:17 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:02:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5936 values 93882 bits 11735 bytes 
Sat 18 Jan 2014 15:02:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:02:20 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:02:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:02:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:02:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:02:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:02:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:02:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:02:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:02:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43811601
Sat 18 Jan 2014 15:02:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:02:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43811601
Sat 18 Jan 2014 15:02:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:02:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:02:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:02:32 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:02:32 - job_xml_thread(): Done retrieving: data size 43811601
Sat 18 Jan 2014 15:02:32 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:02:32 - XML: Start document: iteration 12
Sat 18 Jan 2014 15:02:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:02:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:02:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:02:46 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:02:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:02:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:02:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:02:46 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:02:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:02:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:02:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:02:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:02:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:02:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:02:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:02:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:02:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:02:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:02:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:02:47 - XML: Processed 655254 elements - found 524 jobs
Sat 18 Jan 2014 15:02:47 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:02:47 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:02:47 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:02:47 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:02:47 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:02:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 15:02:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:02:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:02:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853239
Sat 18 Jan 2014 15:02:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:02:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853239
Sat 18 Jan 2014 15:02:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:03:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:03:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:03:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:03:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:03:02 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:03:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:03:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:03:07 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:03:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:03:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:03:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:03:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:03:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:03:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:03:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:03:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:03:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:03:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:03:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:03:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:03:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:03:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:03:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:03:11 - job_xml_thread(): Done retrieving: data size 43838086
Sat 18 Jan 2014 15:03:11 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:03:11 - XML: Start document: iteration 13
Sat 18 Jan 2014 15:03:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43838086
Sat 18 Jan 2014 15:03:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:03:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43838086
Sat 18 Jan 2014 15:03:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:03:14 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:03:14 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 15:03:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:03:17 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:03:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:03:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 15:03:18 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:03:18 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:03:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 15:03:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8678 values 137250 bits 17156 bytes 
Sat 18 Jan 2014 15:03:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:03:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:03:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:03:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:03:25 - XML: Processed 655252 elements - found 523 jobs
Sat 18 Jan 2014 15:03:25 - job 7348919 appears to have finished
Sat 18 Jan 2014 15:03:25 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 15:03:25 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 15:03:26 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 15:03:26 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:03:26 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:03:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:03:30 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:03:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:03:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:03:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:03:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:03:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:03:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:03:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:03:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:03:34 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:03:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:03:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:03:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:03:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:03:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:03:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:03:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:03:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43832640
Sat 18 Jan 2014 15:03:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:03:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43832640
Sat 18 Jan 2014 15:03:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:03:42 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:03:42 - job_xml_thread(): Done retrieving: data size 43832640
Sat 18 Jan 2014 15:03:42 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:03:42 - XML: Start document: iteration 14
Sat 18 Jan 2014 15:03:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:03:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:03:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:03:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:03:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:03:53 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:03:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:03:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:03:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:03:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:03:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:03:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:03:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:04:01 - XML: Processed 655252 elements - found 523 jobs
Sat 18 Jan 2014 15:04:01 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:04:01 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:04:01 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:04:01 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:04:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:04:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:04:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:04:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:04:03 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:04:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 15:04:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:04:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:04:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:04:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:04:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:04:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:04:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43810126
Sat 18 Jan 2014 15:04:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:04:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43810126
Sat 18 Jan 2014 15:04:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:04:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:04:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:04:16 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:04:16 - job_xml_thread(): Done retrieving: data size 43810126
Sat 18 Jan 2014 15:04:16 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:04:16 - XML: Start document: iteration 15
Sat 18 Jan 2014 15:04:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:04:18 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:04:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:04:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:04:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:04:18 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:04:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:04:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:04:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:04:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:04:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:04:18 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:04:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 15:04:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:04:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 15:04:19 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:04:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5668 values 89377 bits 11172 bytes 
Sat 18 Jan 2014 15:04:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:04:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:04:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:04:28 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:04:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:04:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:04:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:04:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:04:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:04:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:04:30 - XML: Processed 655252 elements - found 523 jobs
Sat 18 Jan 2014 15:04:30 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:04:30 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:04:30 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:04:30 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:04:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:04:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43795915
Sat 18 Jan 2014 15:04:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:04:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:04:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:04:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43795915
Sat 18 Jan 2014 15:04:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:04:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:04:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:04:45 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:04:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:04:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:04:47 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:04:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:04:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:04:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:04:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:04:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:04:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:04:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:04:50 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:04:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:04:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:04:50 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:04:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 15:04:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:04:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:04:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:04:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:04:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:04:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:04:53 - job_xml_thread(): Done retrieving: data size 43826323
Sat 18 Jan 2014 15:04:53 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:04:53 - XML: Start document: iteration 16
Sat 18 Jan 2014 15:04:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43826323
Sat 18 Jan 2014 15:04:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:04:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43826323
Sat 18 Jan 2014 15:04:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:05:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:05:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:05:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:05:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:05:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:05:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:05:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:05:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:05:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:05:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:05:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:05:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:05:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:05:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:05:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:05:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:05:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:05:15 - XML: Processed 655250 elements - found 522 jobs
Sat 18 Jan 2014 15:05:15 - job 7349013 appears to have finished
Sat 18 Jan 2014 15:05:15 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 15:05:15 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 15:05:15 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 15:05:15 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:05:15 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:05:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:05:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:05:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:05:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:05:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:05:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43739250
Sat 18 Jan 2014 15:05:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:05:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:05:19 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:05:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43739250
Sat 18 Jan 2014 15:05:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:05:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:05:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 15:05:19 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:05:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 15:05:19 - Entering storeMetrics(): cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sat 18 Jan 2014 15:05:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:05:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:05:30 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:05:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:05:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:05:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:05:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:05:32 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:05:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:05:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:05:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:05:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:05:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:05:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:05:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:05:33 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:05:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:05:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:05:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:05:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:05:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:05:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:05:35 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 15:05:35 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 15:05:35 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:05:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:05:36 - job_xml_thread(): Done retrieving: data size 43297659
Sat 18 Jan 2014 15:05:36 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:05:36 - XML: Start document: iteration 17
Sat 18 Jan 2014 15:05:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43297659
Sat 18 Jan 2014 15:05:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:05:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43297659
Sat 18 Jan 2014 15:05:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:05:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:05:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:05:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:05:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:05:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:05:52 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:05:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:05:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:05:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:05:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:05:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:05:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:05:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:05:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:05:58 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:05:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:05:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:05:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:05:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:05:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:05:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:06:00 - XML: Processed 648686 elements - found 522 jobs
Sat 18 Jan 2014 15:06:00 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:06:00 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:06:00 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:06:00 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:06:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:06:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43141928
Sat 18 Jan 2014 15:06:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:06:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43141928
Sat 18 Jan 2014 15:06:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:06:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:06:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:06:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:06:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:06:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:06:14 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:06:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:06:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:06:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:06:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:06:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:06:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:06:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:06:15 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:06:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:06:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:06:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:06:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:06:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:06:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:06:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:06:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:06:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:06:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43231071
Sat 18 Jan 2014 15:06:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:06:19 - job_xml_thread(): Done retrieving: data size 43231071
Sat 18 Jan 2014 15:06:19 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:06:19 - XML: Start document: iteration 18
Sat 18 Jan 2014 15:06:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:06:19 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:06:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43231071
Sat 18 Jan 2014 15:06:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:06:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:06:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 15:06:20 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:06:20 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:06:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 15:06:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 15707 values 247857 bits 30982 bytes 
Sat 18 Jan 2014 15:06:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:06:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:06:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:06:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:06:33 - XML: Processed 647798 elements - found 522 jobs
Sat 18 Jan 2014 15:06:33 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:06:33 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:06:33 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:06:33 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:06:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:06:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:06:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:06:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:06:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:06:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:06:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:06:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:06:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:06:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:06:40 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:06:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:06:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:06:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:06:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:06:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:06:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:06:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:06:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43648791
Sat 18 Jan 2014 15:06:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:06:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43648791
Sat 18 Jan 2014 15:06:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:06:49 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:06:49 - job_xml_thread(): Done retrieving: data size 43648791
Sat 18 Jan 2014 15:06:49 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:06:49 - XML: Start document: iteration 19
Sat 18 Jan 2014 15:06:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:06:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:06:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:06:52 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:06:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:06:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:06:52 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:06:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 15:06:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:06:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:06:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:06:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:06:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:06:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:06:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:06:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:07:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:07:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:07:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:07:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:07:04 - XML: Processed 652917 elements - found 522 jobs
Sat 18 Jan 2014 15:07:04 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:07:04 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:07:04 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:07:04 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:07:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:07:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:07:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:07:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:07:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:07:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43793538
Sat 18 Jan 2014 15:07:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:07:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43793538
Sat 18 Jan 2014 15:07:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:07:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:07:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:07:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:07:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:07:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:07:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:07:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:07:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:07:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:07:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:07:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:07:19 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:07:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:07:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:07:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:07:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:07:20 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:07:20 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:07:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:07:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:07:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:07:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:07:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:07:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:07:21 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:07:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 15:07:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:07:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 15:07:21 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:07:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6180 values 97453 bits 12181 bytes 
Sat 18 Jan 2014 15:07:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:07:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43826095
Sat 18 Jan 2014 15:07:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:07:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43826095
Sat 18 Jan 2014 15:07:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:07:23 - job_xml_thread(): Done retrieving: data size 43826095
Sat 18 Jan 2014 15:07:23 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:07:23 - XML: Start document: iteration 20
Sat 18 Jan 2014 15:07:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:07:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:07:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:07:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:07:36 - XML: Processed 655252 elements - found 523 jobs
Sat 18 Jan 2014 15:07:36 - job 7349011 report time 1390053861 does not match current heartbeat 1390053981 : ignoring job
Sat 18 Jan 2014 15:07:36 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 15:07:36 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 15:07:36 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 15:07:36 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:07:36 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:07:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:07:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:07:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:07:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:07:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:07:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:07:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:07:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:07:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:07:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:07:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:07:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:07:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:07:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:07:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:07:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:07:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:07:45 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:07:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 15:07:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:07:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:07:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43833209
Sat 18 Jan 2014 15:07:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:07:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43833209
Sat 18 Jan 2014 15:07:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:07:51 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:07:51 - job_xml_thread(): Done retrieving: data size 43833209
Sat 18 Jan 2014 15:07:51 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:07:51 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 15:07:52 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 15:07:53 - Housekeeping: done.
Sat 18 Jan 2014 15:07:53 - XML: Start document: iteration 0
Sat 18 Jan 2014 15:07:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:07:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:07:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:07:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:07:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:07:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:08:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:08:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:08:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:08:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:08:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:08:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:08:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:08:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:08:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:08:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:08:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:08:09 - XML: Processed 655252 elements - found 523 jobs
Sat 18 Jan 2014 15:08:09 - job 7349011 report time 1390053861 does not match current heartbeat 1390053981 : ignoring job
Sat 18 Jan 2014 15:08:09 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:08:09 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:08:09 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:08:09 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:08:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:08:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:08:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:08:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:08:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:08:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43813712
Sat 18 Jan 2014 15:08:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:08:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43813712
Sat 18 Jan 2014 15:08:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:08:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:08:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:08:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:08:21 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:08:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:08:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:08:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:08:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:08:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:08:23 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:08:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 15:08:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 15:08:23 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:08:24 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:08:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:08:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7605 values 119932 bits 14991 bytes 
Sat 18 Jan 2014 15:08:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:08:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:08:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:08:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:08:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:08:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:08:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:08:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:08:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:08:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:08:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:08:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:08:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:08:26 - job_xml_thread(): Done retrieving: data size 43847966
Sat 18 Jan 2014 15:08:26 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:08:26 - XML: Start document: iteration 1
Sat 18 Jan 2014 15:08:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43847966
Sat 18 Jan 2014 15:08:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:08:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43847966
Sat 18 Jan 2014 15:08:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:08:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:08:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:08:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:08:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:08:45 - XML: Processed 655252 elements - found 523 jobs
Sat 18 Jan 2014 15:08:45 - job 7349011 report time 1390053861 does not match current heartbeat 1390053981 : ignoring job
Sat 18 Jan 2014 15:08:45 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:08:45 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:08:45 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:08:45 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:08:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:08:47 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:08:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:08:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:08:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:08:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:08:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:08:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:08:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:08:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:08:49 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:08:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:08:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:08:49 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:08:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 15:08:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:08:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:08:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:08:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:08:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:08:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:08:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43837906
Sat 18 Jan 2014 15:08:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:08:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43837906
Sat 18 Jan 2014 15:08:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:09:00 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:09:00 - job_xml_thread(): Done retrieving: data size 43837906
Sat 18 Jan 2014 15:09:00 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:09:00 - XML: Start document: iteration 2
Sat 18 Jan 2014 15:09:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:09:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:09:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:09:03 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:09:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:09:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:09:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:09:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:09:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:09:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:09:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:09:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:09:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:09:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:09:13 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:09:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:09:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:09:14 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 15:09:14 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:09:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:09:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:09:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:09:14 - XML: Processed 655248 elements - found 521 jobs
Sat 18 Jan 2014 15:09:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:09:14 - job 7348839 appears to have finished
Sat 18 Jan 2014 15:09:14 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:09:14 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 15:09:14 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 15:09:14 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 15:09:14 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:09:14 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 15:09:15 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 15:09:15 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 15:09:15 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:09:15 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:09:15 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 811316 values 12796078 bits 1599509 bytes 
Sat 18 Jan 2014 15:09:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:09:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43798493
Sat 18 Jan 2014 15:09:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:09:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43798493
Sat 18 Jan 2014 15:09:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:09:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:09:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:09:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:09:23 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:09:24 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:09:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:09:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 15:09:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 15:09:24 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:09:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9195 values 145072 bits 18134 bytes 
Sat 18 Jan 2014 15:09:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:09:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:09:30 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:09:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:09:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:09:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:09:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:09:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:09:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:09:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:09:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:09:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:09:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:09:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:09:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:09:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:09:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:09:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:09:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:09:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:09:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:09:39 - job_xml_thread(): Done retrieving: data size 43815374
Sat 18 Jan 2014 15:09:39 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:09:39 - XML: Start document: iteration 3
Sat 18 Jan 2014 15:09:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43815374
Sat 18 Jan 2014 15:09:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43815374
Sat 18 Jan 2014 15:09:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:09:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:09:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:09:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:09:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:09:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:09:55 - XML: Processed 655250 elements - found 522 jobs
Sat 18 Jan 2014 15:09:55 - job 7349015 report time 1390053981 does not match current heartbeat 1390054102 : ignoring job
Sat 18 Jan 2014 15:09:55 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 15:09:55 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 15:09:56 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 15:09:56 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:09:56 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:09:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:09:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:09:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:09:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:09:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:09:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:09:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:09:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:09:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:10:00 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:10:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 15:10:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:10:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:10:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:10:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:10:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:10:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:10:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:10:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:10:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:10:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:10:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43813523
Sat 18 Jan 2014 15:10:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:10:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43813523
Sat 18 Jan 2014 15:10:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:10:11 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:10:11 - job_xml_thread(): Done retrieving: data size 43813523
Sat 18 Jan 2014 15:10:11 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:10:11 - XML: Start document: iteration 4
Sat 18 Jan 2014 15:10:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:10:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:10:15 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:10:15 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 15:10:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:10:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:10:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:10:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:10:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:10:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:10:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:10:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:10:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:10:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:10:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:10:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:10:24 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:10:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:10:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 15:10:25 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:10:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 15:10:25 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:10:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5943 values 93758 bits 11719 bytes 
Sat 18 Jan 2014 15:10:26 - XML: Processed 655250 elements - found 522 jobs
Sat 18 Jan 2014 15:10:26 - job 7349015 report time 1390053981 does not match current heartbeat 1390054102 : ignoring job
Sat 18 Jan 2014 15:10:26 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:10:26 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:10:26 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:10:26 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:10:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:10:29 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:10:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:10:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:10:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:10:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:10:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:10:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:10:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:10:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43803122
Sat 18 Jan 2014 15:10:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:10:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43803122
Sat 18 Jan 2014 15:10:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:10:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:10:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:10:41 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:10:41 - job_xml_thread(): Done retrieving: data size 43803122
Sat 18 Jan 2014 15:10:41 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:10:41 - XML: Start document: iteration 5
Sat 18 Jan 2014 15:10:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:10:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:10:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:10:47 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:10:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:10:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:10:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:10:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:10:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:10:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:10:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:10:52 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:10:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 15:10:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:10:56 - XML: Processed 655250 elements - found 522 jobs
Sat 18 Jan 2014 15:10:56 - job 7349015 report time 1390053981 does not match current heartbeat 1390054102 : ignoring job
Sat 18 Jan 2014 15:10:56 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:10:56 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:10:56 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:10:56 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:10:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:10:58 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:10:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:10:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:10:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:10:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:10:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:10:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:11:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:11:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43819470
Sat 18 Jan 2014 15:11:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:11:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43819470
Sat 18 Jan 2014 15:11:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:11:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:11:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:11:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:11:10 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:11:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:11:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:11:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:11:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:11:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:11:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:11:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:11:11 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:11:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:11:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:11:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:11:16 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:11:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:11:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:11:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:11:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:11:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:11:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:11:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:11:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43741481
Sat 18 Jan 2014 15:11:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:11:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43741481
Sat 18 Jan 2014 15:11:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:11:20 - job_xml_thread(): Done retrieving: data size 43741481
Sat 18 Jan 2014 15:11:20 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:11:20 - XML: Start document: iteration 6
Sat 18 Jan 2014 15:11:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:11:25 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:11:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:11:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:11:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:11:26 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:11:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 15:11:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 15:11:26 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:11:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8741 values 137792 bits 17224 bytes 
Sat 18 Jan 2014 15:11:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:11:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:11:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:11:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:11:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:11:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:11:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:11:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:11:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:11:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:11:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:11:39 - XML: Processed 654502 elements - found 522 jobs
Sat 18 Jan 2014 15:11:39 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 15:11:39 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 15:11:39 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 15:11:39 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:11:39 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:11:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:11:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:11:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:11:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:11:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:11:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:11:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:11:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:11:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:11:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43210093
Sat 18 Jan 2014 15:11:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:11:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43210093
Sat 18 Jan 2014 15:11:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:11:52 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:11:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 15:11:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:11:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:11:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:11:54 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:11:54 - job_xml_thread(): Done retrieving: data size 43210093
Sat 18 Jan 2014 15:11:54 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:11:54 - XML: Start document: iteration 7
Sat 18 Jan 2014 15:12:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:12:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:12:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:12:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:12:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:12:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:12:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:12:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:12:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:12:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:12:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:12:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:12:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:12:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:12:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:12:09 - XML: Processed 647814 elements - found 522 jobs
Sat 18 Jan 2014 15:12:09 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:12:09 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:12:09 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:12:09 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:12:10 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 15:12:10 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 15:12:10 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:12:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:12:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:12:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:12:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:12:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:12:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43164385
Sat 18 Jan 2014 15:12:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:12:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43164385
Sat 18 Jan 2014 15:12:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:12:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:12:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:12:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:12:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:12:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:12:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:12:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:12:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:12:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:12:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:12:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:12:24 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:12:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:12:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:12:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:12:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:12:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:12:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:12:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:12:26 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:12:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:12:26 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:12:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 15:12:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 15:12:26 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:12:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6199 values 97792 bits 12224 bytes 
Sat 18 Jan 2014 15:12:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:12:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:12:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:12:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:12:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:12:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43254065
Sat 18 Jan 2014 15:12:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:12:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43254065
Sat 18 Jan 2014 15:12:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:12:28 - job_xml_thread(): Done retrieving: data size 43254065
Sat 18 Jan 2014 15:12:29 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:12:29 - XML: Start document: iteration 8
Sat 18 Jan 2014 15:12:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:12:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:12:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:12:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:12:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:12:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:12:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:12:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:12:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:12:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:12:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:12:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:12:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:12:46 - XML: Processed 647862 elements - found 522 jobs
Sat 18 Jan 2014 15:12:46 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:12:46 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:12:47 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:12:47 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:12:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:12:49 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:12:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:12:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:12:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:12:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:12:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:12:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:12:50 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:12:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 15:12:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:12:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:12:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43753243
Sat 18 Jan 2014 15:12:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:12:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43753243
Sat 18 Jan 2014 15:12:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:12:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:12:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:13:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:13:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:13:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:13:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:13:02 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:13:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:13:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:13:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:13:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:13:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:13:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:13:05 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:13:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:13:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:13:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:13:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:13:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:13:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:13:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:13:07 - job_xml_thread(): Done retrieving: data size 43824670
Sat 18 Jan 2014 15:13:07 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:13:07 - XML: Start document: iteration 9
Sat 18 Jan 2014 15:13:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43824670
Sat 18 Jan 2014 15:13:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:13:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43824670
Sat 18 Jan 2014 15:13:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:13:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:13:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:13:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:13:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:13:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:13:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:13:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:13:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:13:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:13:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:13:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:13:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:13:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:13:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:13:27 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:13:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:13:28 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:13:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 15:13:28 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:13:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 15:13:29 - XML: Processed 655248 elements - found 521 jobs
Sat 18 Jan 2014 15:13:29 - job 7348629 appears to have finished
Sat 18 Jan 2014 15:13:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8024 values 126491 bits 15811 bytes 
Sat 18 Jan 2014 15:13:29 - job 7344657 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 15:13:29 - job 7349016 appears to have finished
Sat 18 Jan 2014 15:13:29 - job 7349018 report time 1390054222 does not match current heartbeat 1390054343 : ignoring job
Sat 18 Jan 2014 15:13:29 - job_xml_thread(): Found 4 updated jobs.
Sat 18 Jan 2014 15:13:29 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 15:13:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:13:30 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:13:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:13:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:13:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:13:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:13:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:13:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:13:32 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Sat 18 Jan 2014 15:13:32 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:13:32 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:13:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:13:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43803870
Sat 18 Jan 2014 15:13:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:13:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43803870
Sat 18 Jan 2014 15:13:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:13:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:13:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:13:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:13:44 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:13:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:13:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:13:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:13:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:13:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:13:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:13:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:13:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:13:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:13:47 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:13:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 15:13:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:13:47 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:13:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:13:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:13:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:13:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:13:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:13:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:13:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:13:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:13:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:13:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43827293
Sat 18 Jan 2014 15:13:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:13:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43827293
Sat 18 Jan 2014 15:13:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:13:49 - job_xml_thread(): Done retrieving: data size 43827293
Sat 18 Jan 2014 15:13:49 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:13:49 - XML: Start document: iteration 10
Sat 18 Jan 2014 15:14:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:14:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:14:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:14:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:14:05 - XML: Processed 655248 elements - found 521 jobs
Sat 18 Jan 2014 15:14:05 - job 7349018 report time 1390054222 does not match current heartbeat 1390054343 : ignoring job
Sat 18 Jan 2014 15:14:05 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:14:05 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:14:05 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:14:05 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:14:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:14:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:14:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:14:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:14:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:14:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:14:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:14:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:14:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:14:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:14:11 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:14:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:14:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:14:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:14:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:14:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:14:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:14:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:14:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43823147
Sat 18 Jan 2014 15:14:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:14:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43823147
Sat 18 Jan 2014 15:14:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:14:20 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:14:20 - job_xml_thread(): Done retrieving: data size 43823147
Sat 18 Jan 2014 15:14:20 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:14:20 - XML: Start document: iteration 11
Sat 18 Jan 2014 15:14:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:14:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:14:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:14:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:14:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:14:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:14:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:14:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:14:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:14:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:14:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:14:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:14:29 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:14:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:14:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 15:14:29 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:14:29 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:14:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 15:14:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9280 values 146325 bits 18290 bytes 
Sat 18 Jan 2014 15:14:32 - XML: Processed 655248 elements - found 521 jobs
Sat 18 Jan 2014 15:14:32 - job 7349018 report time 1390054222 does not match current heartbeat 1390054343 : ignoring job
Sat 18 Jan 2014 15:14:32 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:14:32 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:14:32 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:14:33 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:14:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:14:34 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:14:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:14:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:14:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:14:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:14:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:14:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:14:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:14:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43809340
Sat 18 Jan 2014 15:14:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:14:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43809340
Sat 18 Jan 2014 15:14:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:14:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:14:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:14:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:14:46 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:14:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:14:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:14:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:14:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:14:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:14:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43809340
Sat 18 Jan 2014 15:14:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:14:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:14:48 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:14:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:14:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:14:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:14:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:14:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:15:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:15:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:15:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:15:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:15:00 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:15:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 15:15:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:15:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:15:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:15:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:15:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:15:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:15:01 - job_xml_thread(): Done retrieving: data size 43795608
Sat 18 Jan 2014 15:15:01 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:15:01 - XML: Start document: iteration 12
Sat 18 Jan 2014 15:15:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:15:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:15:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43795608
Sat 18 Jan 2014 15:15:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:15:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:15:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:15:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:15:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43795608
Sat 18 Jan 2014 15:15:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:15:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:15:11 - XML: Processed 655248 elements - found 521 jobs
Sat 18 Jan 2014 15:15:11 - job 7349020 report time 1390054343 does not match current heartbeat 1390054463 : ignoring job
Sat 18 Jan 2014 15:15:11 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 15:15:11 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 15:15:12 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 15:15:12 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:15:12 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:15:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:15:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:15:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:15:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:15:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:15:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:15:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:15:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:15:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:15:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:15:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:15:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:15:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:15:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:15:22 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:15:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:15:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:15:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:15:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:15:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:15:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:15:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:15:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43842438
Sat 18 Jan 2014 15:15:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:15:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43842438
Sat 18 Jan 2014 15:15:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:15:27 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:15:27 - job_xml_thread(): Done retrieving: data size 43842438
Sat 18 Jan 2014 15:15:28 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:15:29 - XML: Start document: iteration 13
Sat 18 Jan 2014 15:15:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:15:30 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:15:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:15:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 15:15:31 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:15:31 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:15:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 15:15:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9184 values 144853 bits 18106 bytes 
Sat 18 Jan 2014 15:15:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:15:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:15:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:15:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:15:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:15:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:15:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:15:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:15:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:15:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:15:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:15:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:15:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:15:45 - XML: Processed 655248 elements - found 521 jobs
Sat 18 Jan 2014 15:15:45 - job 7349020 report time 1390054343 does not match current heartbeat 1390054463 : ignoring job
Sat 18 Jan 2014 15:15:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:15:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:15:45 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:15:45 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:15:45 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:15:45 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:15:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:15:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:15:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:15:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:15:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:15:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:15:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:15:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43812851
Sat 18 Jan 2014 15:15:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:15:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43812851
Sat 18 Jan 2014 15:15:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:15:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:15:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:15:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:15:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:15:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:15:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:16:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:16:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:16:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:16:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:16:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:16:00 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:16:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:16:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:16:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:16:02 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:16:02 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:16:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 15:16:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:16:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:16:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:16:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:16:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:16:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:16:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:16:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:16:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43841398
Sat 18 Jan 2014 15:16:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:16:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43841398
Sat 18 Jan 2014 15:16:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:16:05 - job_xml_thread(): Done retrieving: data size 43841398
Sat 18 Jan 2014 15:16:05 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:16:05 - XML: Start document: iteration 14
Sat 18 Jan 2014 15:16:15 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 15:16:15 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:16:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:16:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:16:16 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:16:16 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 15:16:16 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:16:16 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 15:16:16 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 15:16:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:16:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:16:19 - XML: Processed 655248 elements - found 521 jobs
Sat 18 Jan 2014 15:16:19 - job 7349020 report time 1390054343 does not match current heartbeat 1390054463 : ignoring job
Sat 18 Jan 2014 15:16:19 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:16:19 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:16:19 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:16:19 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:16:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:16:19 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:16:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:16:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:16:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:16:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:16:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:16:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:16:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:16:22 - size of cluster 'LISA Cluster': 624 hosts 79483 metrics 882764 values 13917894 bits 1739736 bytes 
Sat 18 Jan 2014 15:16:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:16:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:16:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:16:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:16:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:16:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:16:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:16:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:16:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:16:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43823255
Sat 18 Jan 2014 15:16:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:16:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43823255
Sat 18 Jan 2014 15:16:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:16:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:16:31 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:16:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:16:33 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:16:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 15:16:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 15:16:33 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:16:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9006 values 142269 bits 17783 bytes 
Sat 18 Jan 2014 15:16:34 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:16:34 - job_xml_thread(): Done retrieving: data size 43823255
Sat 18 Jan 2014 15:16:34 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:16:34 - XML: Start document: iteration 15
Sat 18 Jan 2014 15:16:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:16:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:16:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:16:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:16:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:16:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:16:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:16:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:16:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:16:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:16:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43823255
Sat 18 Jan 2014 15:16:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:16:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:16:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:16:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:16:51 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:16:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:16:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:16:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:16:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:16:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:16:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:16:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:16:55 - XML: Processed 655248 elements - found 521 jobs
Sat 18 Jan 2014 15:16:55 - job 7349020 report time 1390054343 does not match current heartbeat 1390054463 : ignoring job
Sat 18 Jan 2014 15:16:55 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:16:55 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:16:55 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:16:55 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:16:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:16:59 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:16:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:16:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:16:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:16:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:16:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:16:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:17:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:17:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43819810
Sat 18 Jan 2014 15:17:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:17:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43819810
Sat 18 Jan 2014 15:17:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:17:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:17:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:17:10 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:17:10 - job_xml_thread(): Done retrieving: data size 43819810
Sat 18 Jan 2014 15:17:10 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:17:10 - XML: Start document: iteration 16
Sat 18 Jan 2014 15:17:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:17:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:17:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:17:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:17:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:17:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:17:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:17:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:17:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:17:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:17:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:17:17 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:17:17 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 15:17:23 - XML: Processed 655248 elements - found 521 jobs
Sat 18 Jan 2014 15:17:23 - job 7349022 report time 1390054463 does not match current heartbeat 1390054584 : ignoring job
Sat 18 Jan 2014 15:17:23 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 15:17:23 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 15:17:23 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 15:17:23 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:17:23 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:17:23 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:17:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 15:17:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:17:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:17:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:17:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:17:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:17:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:17:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:17:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:17:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:17:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:17:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:17:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:17:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43730402
Sat 18 Jan 2014 15:17:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:17:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43730402
Sat 18 Jan 2014 15:17:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:17:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:17:33 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:17:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:17:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 15:17:34 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:17:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5885 values 93099 bits 11637 bytes 
Sat 18 Jan 2014 15:17:34 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:17:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 15:17:38 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:17:38 - job_xml_thread(): Done retrieving: data size 43730402
Sat 18 Jan 2014 15:17:38 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:17:38 - XML: Start document: iteration 17
Sat 18 Jan 2014 15:17:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:17:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:17:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:17:42 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:17:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:17:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:17:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:17:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:17:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:17:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:17:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:17:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:17:52 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:17:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:17:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:17:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:17:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:17:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:17:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:17:53 - XML: Processed 654500 elements - found 521 jobs
Sat 18 Jan 2014 15:17:53 - job 7349022 report time 1390054463 does not match current heartbeat 1390054584 : ignoring job
Sat 18 Jan 2014 15:17:53 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:17:53 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:17:53 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:17:53 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:17:56 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:17:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 15:17:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:17:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:17:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43198264
Sat 18 Jan 2014 15:17:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:17:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43198264
Sat 18 Jan 2014 15:17:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:17:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:17:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:18:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:18:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:18:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:18:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:18:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:18:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:18:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:18:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:18:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:18:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:18:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:18:08 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:18:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:18:12 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:18:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:18:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:18:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:18:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:18:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:18:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:18:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:18:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43214482
Sat 18 Jan 2014 15:18:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:18:16 - job_xml_thread(): Done retrieving: data size 43214482
Sat 18 Jan 2014 15:18:16 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:18:16 - XML: Start document: iteration 18
Sat 18 Jan 2014 15:18:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43214482
Sat 18 Jan 2014 15:18:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:18:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:18:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:18:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:18:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:18:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:18:27 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:18:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:18:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:18:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:18:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:18:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:18:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:18:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:18:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:18:34 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:18:35 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:18:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:18:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 15:18:35 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:18:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 15:18:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99312 bits 12414 bytes 
Sat 18 Jan 2014 15:18:36 - XML: Processed 647722 elements - found 521 jobs
Sat 18 Jan 2014 15:18:36 - job 7349022 report time 1390054463 does not match current heartbeat 1390054584 : ignoring job
Sat 18 Jan 2014 15:18:36 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:18:36 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:18:36 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:18:36 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:18:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:18:39 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:18:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:18:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:18:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:18:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:18:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:18:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:18:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:18:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564778
Sat 18 Jan 2014 15:18:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:18:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564778
Sat 18 Jan 2014 15:18:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:18:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:18:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:18:51 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:18:51 - job_xml_thread(): Done retrieving: data size 43564778
Sat 18 Jan 2014 15:18:51 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:18:51 - XML: Start document: iteration 19
Sat 18 Jan 2014 15:18:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:18:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:19:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:19:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:19:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:19:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:19:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:19:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:19:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:19:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:19:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:19:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:19:05 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:19:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:19:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:19:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:19:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:19:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:19:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:19:06 - XML: Processed 652290 elements - found 521 jobs
Sat 18 Jan 2014 15:19:06 - job 7349022 report time 1390054463 does not match current heartbeat 1390054584 : ignoring job
Sat 18 Jan 2014 15:19:06 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:19:06 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:19:06 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:19:06 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:19:07 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:19:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 15:19:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:19:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:19:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43828892
Sat 18 Jan 2014 15:19:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:19:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43828892
Sat 18 Jan 2014 15:19:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:19:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:19:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:19:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:19:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:19:21 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:19:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:19:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:19:25 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:19:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:19:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:19:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:19:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:19:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:19:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:19:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:19:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:19:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:19:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:19:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:19:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:19:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:19:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:19:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:19:29 - job_xml_thread(): Done retrieving: data size 43811880
Sat 18 Jan 2014 15:19:29 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:19:29 - XML: Start document: iteration 20
Sat 18 Jan 2014 15:19:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43811880
Sat 18 Jan 2014 15:19:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:19:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43811880
Sat 18 Jan 2014 15:19:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:19:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:19:35 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:19:37 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:19:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 15:19:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:19:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 15:19:38 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:19:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8430 values 133005 bits 16625 bytes 
Sat 18 Jan 2014 15:19:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:19:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:19:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:19:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:19:42 - XML: Processed 655250 elements - found 522 jobs
Sat 18 Jan 2014 15:19:42 - job 7349024 report time 1390054584 does not match current heartbeat 1390054705 : ignoring job
Sat 18 Jan 2014 15:19:42 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 15:19:42 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 15:19:44 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 15:19:44 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:19:44 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:19:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:19:46 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:19:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:19:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:19:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:19:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:19:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:19:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:19:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:19:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:19:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:19:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:19:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:19:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:19:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:19:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:19:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:19:51 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 15:19:51 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 15:19:51 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:19:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:19:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43825430
Sat 18 Jan 2014 15:19:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:19:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43825430
Sat 18 Jan 2014 15:19:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:19:59 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:19:59 - job_xml_thread(): Done retrieving: data size 43825430
Sat 18 Jan 2014 15:20:00 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:20:00 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 15:20:00 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 15:20:00 - Housekeeping: done.
Sat 18 Jan 2014 15:20:00 - XML: Start document: iteration 0
Sat 18 Jan 2014 15:20:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:20:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:20:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:20:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:20:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:20:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:20:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:20:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:20:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:20:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:20:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:20:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:20:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:20:14 - XML: Processed 655250 elements - found 522 jobs
Sat 18 Jan 2014 15:20:14 - job 7349024 report time 1390054584 does not match current heartbeat 1390054705 : ignoring job
Sat 18 Jan 2014 15:20:14 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:20:14 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:20:14 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:20:15 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:20:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:20:16 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:20:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:20:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:20:16 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:20:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 15:20:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:20:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:20:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:20:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:20:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:20:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:20:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43791078
Sat 18 Jan 2014 15:20:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:20:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43791078
Sat 18 Jan 2014 15:20:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:20:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:20:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:20:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:20:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:20:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:20:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:20:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:20:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:20:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:20:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:20:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:20:30 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:20:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:20:32 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:20:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:20:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:20:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:20:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:20:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:20:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:20:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:20:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43827611
Sat 18 Jan 2014 15:20:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:20:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43827611
Sat 18 Jan 2014 15:20:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:20:35 - job_xml_thread(): Done retrieving: data size 43827611
Sat 18 Jan 2014 15:20:35 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:20:35 - XML: Start document: iteration 1
Sat 18 Jan 2014 15:20:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:20:37 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:20:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:20:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 15:20:39 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:20:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 15:20:39 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:20:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9009 values 142169 bits 17771 bytes 
Sat 18 Jan 2014 15:20:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:20:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:20:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:20:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:20:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:20:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:20:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:20:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:20:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:20:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:20:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:20:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:20:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:20:56 - XML: Processed 655250 elements - found 522 jobs
Sat 18 Jan 2014 15:20:56 - job 7349024 report time 1390054584 does not match current heartbeat 1390054705 : ignoring job
Sat 18 Jan 2014 15:20:56 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:20:56 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:20:56 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:20:56 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:20:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:20:57 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:20:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:20:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:20:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:20:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:20:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:20:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:20:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:20:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43816356
Sat 18 Jan 2014 15:20:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:21:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43816356
Sat 18 Jan 2014 15:21:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:21:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:21:07 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:21:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:21:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:21:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:21:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:21:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:21:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:21:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:21:11 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:21:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:21:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:21:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:21:14 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:21:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:21:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:21:14 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:21:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 15:21:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:21:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:21:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:21:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:21:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:21:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:21:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43820786
Sat 18 Jan 2014 15:21:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:21:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43820786
Sat 18 Jan 2014 15:21:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:21:17 - job_xml_thread(): Done retrieving: data size 43820786
Sat 18 Jan 2014 15:21:17 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:21:17 - XML: Start document: iteration 2
Sat 18 Jan 2014 15:21:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:21:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:21:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:21:29 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:21:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:21:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:21:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:21:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:21:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:21:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:21:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:21:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:21:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:21:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:21:38 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:21:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:21:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:21:39 - XML: Processed 655252 elements - found 523 jobs
Sat 18 Jan 2014 15:21:39 - job 7349026 field 'start_timestamp' changed since saved from: 1390054711 to: 1390054674
Sat 18 Jan 2014 15:21:39 - job 7349027 report time 1390054705 does not match current heartbeat 1390054825 : ignoring job
Sat 18 Jan 2014 15:21:39 - job_xml_thread(): Found 3 updated jobs.
Sat 18 Jan 2014 15:21:39 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 15:21:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:21:39 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:21:39 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Sat 18 Jan 2014 15:21:39 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:21:39 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:21:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:21:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:21:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:21:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:21:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:21:40 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:21:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 15:21:40 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:21:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 15:21:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5713 values 90130 bits 11266 bytes 
Sat 18 Jan 2014 15:21:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:21:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43816273
Sat 18 Jan 2014 15:21:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:21:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43816273
Sat 18 Jan 2014 15:21:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:21:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:21:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:21:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:21:51 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:21:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:21:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:21:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:21:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:21:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:21:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:21:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:21:54 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:21:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:21:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:21:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:21:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:21:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:21:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:21:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:21:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:21:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:21:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:21:56 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:21:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 15:21:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:21:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:21:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43830537
Sat 18 Jan 2014 15:21:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:21:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43830537
Sat 18 Jan 2014 15:21:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:21:57 - job_xml_thread(): Done retrieving: data size 43830537
Sat 18 Jan 2014 15:21:58 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:21:58 - XML: Start document: iteration 3
Sat 18 Jan 2014 15:22:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:22:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:22:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:22:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:22:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:22:13 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:22:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:22:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:22:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:22:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:22:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:22:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:22:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:22:18 - XML: Processed 655246 elements - found 523 jobs
Sat 18 Jan 2014 15:22:18 - job 7349027 report time 1390054705 does not match current heartbeat 1390054825 : ignoring job
Sat 18 Jan 2014 15:22:18 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:22:18 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:22:19 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:22:19 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:22:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:22:20 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:22:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:22:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:22:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:22:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:22:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:22:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:22:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:22:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43833915
Sat 18 Jan 2014 15:22:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:22:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43833915
Sat 18 Jan 2014 15:22:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:22:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:22:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:22:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:22:33 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:22:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:22:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:22:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:22:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:22:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:22:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:22:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:22:34 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:22:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:22:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:22:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:22:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:22:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:22:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:22:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:22:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:22:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:22:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:22:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:22:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43845302
Sat 18 Jan 2014 15:22:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:22:39 - job_xml_thread(): Done retrieving: data size 43845302
Sat 18 Jan 2014 15:22:39 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:22:39 - XML: Start document: iteration 4
Sat 18 Jan 2014 15:22:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43845302
Sat 18 Jan 2014 15:22:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:22:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:22:42 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:22:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:22:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 15:22:43 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:22:43 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:22:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 15:22:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 10901 values 171970 bits 21496 bytes 
Sat 18 Jan 2014 15:22:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:22:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:22:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:22:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:22:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:22:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:22:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:22:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:22:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:22:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:22:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:22:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:22:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:22:57 - XML: Processed 655247 elements - found 523 jobs
Sat 18 Jan 2014 15:22:57 - job 7349027 report time 1390054705 does not match current heartbeat 1390054825 : ignoring job
Sat 18 Jan 2014 15:22:57 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:22:57 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:22:57 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:22:57 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:23:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:23:01 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:23:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:23:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:23:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:23:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:23:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:23:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:23:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:23:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43823660
Sat 18 Jan 2014 15:23:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:23:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43823660
Sat 18 Jan 2014 15:23:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:23:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:23:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:23:12 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:23:12 - job_xml_thread(): Done retrieving: data size 43823660
Sat 18 Jan 2014 15:23:12 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:23:12 - XML: Start document: iteration 5
Sat 18 Jan 2014 15:23:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:23:14 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:23:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:23:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:23:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:23:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:23:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:23:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:23:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:23:17 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 15:23:17 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:23:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:23:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:23:18 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:23:18 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 15:23:18 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:23:18 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 15:23:18 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 15:23:22 - size of cluster 'LISA Cluster': 624 hosts 79478 metrics 889333 values 14031783 bits 1753972 bytes 
Sat 18 Jan 2014 15:23:24 - XML: Processed 655252 elements - found 523 jobs
Sat 18 Jan 2014 15:23:24 - job 7349030 report time 1390054825 does not match current heartbeat 1390054946 : ignoring job
Sat 18 Jan 2014 15:23:24 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 15:23:24 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 15:23:24 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 15:23:24 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:23:24 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:23:26 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:23:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 15:23:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:23:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:23:27 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:23:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:23:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:23:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:23:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:23:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:23:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:23:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:23:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:23:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:23:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43726346
Sat 18 Jan 2014 15:23:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:23:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43726346
Sat 18 Jan 2014 15:23:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:23:39 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:23:39 - job_xml_thread(): Done retrieving: data size 43726346
Sat 18 Jan 2014 15:23:39 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:23:39 - XML: Start document: iteration 6
Sat 18 Jan 2014 15:23:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:23:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:23:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:23:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:23:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:23:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:23:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:23:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:23:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:23:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:23:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:23:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:23:43 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:23:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:23:43 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:23:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 15:23:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 15:23:43 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:23:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5763 values 90898 bits 11362 bytes 
Sat 18 Jan 2014 15:23:49 - XML: Processed 654504 elements - found 523 jobs
Sat 18 Jan 2014 15:23:49 - job 7349030 report time 1390054825 does not match current heartbeat 1390054946 : ignoring job
Sat 18 Jan 2014 15:23:49 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:23:49 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:23:49 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:23:49 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:23:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:23:52 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:23:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:23:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:23:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:23:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:23:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:23:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:23:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:23:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43199246
Sat 18 Jan 2014 15:23:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:23:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:23:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:23:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43199246
Sat 18 Jan 2014 15:23:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:24:04 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:24:04 - job_xml_thread(): Done retrieving: data size 43199246
Sat 18 Jan 2014 15:24:04 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:24:04 - XML: Start document: iteration 7
Sat 18 Jan 2014 15:24:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:24:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:24:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:24:11 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:24:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:24:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:24:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:24:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:24:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:24:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:24:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:24:13 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:24:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 15:24:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:24:17 - XML: Processed 647670 elements - found 523 jobs
Sat 18 Jan 2014 15:24:17 - job 7349030 report time 1390054825 does not match current heartbeat 1390054946 : ignoring job
Sat 18 Jan 2014 15:24:17 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:24:17 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:24:17 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:24:17 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:24:18 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:24:18 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 15:24:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:24:19 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:24:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:24:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:24:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:24:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:24:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:24:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:24:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:24:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43234402
Sat 18 Jan 2014 15:24:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:24:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43234402
Sat 18 Jan 2014 15:24:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:24:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:24:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:24:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:24:30 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:24:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:24:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:24:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:24:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:24:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:24:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:24:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43234402
Sat 18 Jan 2014 15:24:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:24:32 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:24:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:24:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:24:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:24:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:24:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:24:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:24:43 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:24:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:24:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:24:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:24:43 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:24:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:24:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:24:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:24:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:24:44 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:24:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 15:24:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:24:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 15:24:44 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:24:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5889 values 92870 bits 11608 bytes 
Sat 18 Jan 2014 15:24:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:24:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:24:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:24:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:24:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:24:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:24:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:24:47 - job_xml_thread(): Done retrieving: data size 43722652
Sat 18 Jan 2014 15:24:47 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:24:47 - XML: Start document: iteration 8
Sat 18 Jan 2014 15:24:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43722652
Sat 18 Jan 2014 15:24:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:24:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43722652
Sat 18 Jan 2014 15:24:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:24:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:24:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:25:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:25:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:25:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:25:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:25:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:25:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:25:10 - XML: Processed 654462 elements - found 523 jobs
Sat 18 Jan 2014 15:25:10 - job 7349030 report time 1390054825 does not match current heartbeat 1390054946 : ignoring job
Sat 18 Jan 2014 15:25:10 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:25:10 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:25:10 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:25:10 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:25:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:25:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:25:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:25:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:25:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:25:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:25:11 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:25:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:25:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:25:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:25:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:25:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:25:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:25:13 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:25:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 15:25:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:25:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:25:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43818023
Sat 18 Jan 2014 15:25:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:25:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43818023
Sat 18 Jan 2014 15:25:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:25:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:25:25 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:25:25 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:25:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:25:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:25:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:25:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:25:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:25:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:25:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:25:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:25:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:25:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:25:30 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:25:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:25:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:25:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:25:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:25:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:25:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:25:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:25:33 - job_xml_thread(): Done retrieving: data size 43812606
Sat 18 Jan 2014 15:25:33 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:25:33 - XML: Start document: iteration 9
Sat 18 Jan 2014 15:25:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43812606
Sat 18 Jan 2014 15:25:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:25:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43812606
Sat 18 Jan 2014 15:25:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:25:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:25:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:25:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:25:44 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:25:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:25:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:25:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:25:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 15:25:46 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:25:46 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:25:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 15:25:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7798 values 122943 bits 15367 bytes 
Sat 18 Jan 2014 15:25:54 - XML: Processed 655252 elements - found 523 jobs
Sat 18 Jan 2014 15:25:54 - job 7349032 report time 1390054946 does not match current heartbeat 1390055066 : ignoring job
Sat 18 Jan 2014 15:25:54 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 15:25:54 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 15:25:54 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 15:25:54 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:25:54 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:25:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:25:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:25:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:25:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:25:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:25:56 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:25:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:25:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:25:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:25:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:25:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:25:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:25:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:25:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:25:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:25:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:25:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:26:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:26:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43822684
Sat 18 Jan 2014 15:26:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:26:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43822684
Sat 18 Jan 2014 15:26:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:26:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:26:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:26:09 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:26:09 - job_xml_thread(): Done retrieving: data size 43822684
Sat 18 Jan 2014 15:26:09 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:26:09 - XML: Start document: iteration 10
Sat 18 Jan 2014 15:26:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:26:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:26:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:26:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:26:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:26:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:26:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:26:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:26:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:26:14 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:26:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 15:26:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:26:18 - XML: Processed 655252 elements - found 523 jobs
Sat 18 Jan 2014 15:26:18 - job 7349032 report time 1390054946 does not match current heartbeat 1390055066 : ignoring job
Sat 18 Jan 2014 15:26:18 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:26:18 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:26:18 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:26:18 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:26:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:26:22 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:26:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:26:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:26:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:26:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:26:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:26:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:26:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:26:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43813106
Sat 18 Jan 2014 15:26:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:26:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43813106
Sat 18 Jan 2014 15:26:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:26:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:26:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:26:33 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:26:33 - job_xml_thread(): Done retrieving: data size 43813106
Sat 18 Jan 2014 15:26:33 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:26:33 - XML: Start document: iteration 11
Sat 18 Jan 2014 15:26:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:26:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:26:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:26:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:26:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:26:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:26:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:26:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:26:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:26:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:26:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:26:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:26:46 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:26:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:26:46 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:26:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 15:26:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 15:26:46 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:26:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5981 values 94362 bits 11795 bytes 
Sat 18 Jan 2014 15:26:48 - XML: Processed 655252 elements - found 523 jobs
Sat 18 Jan 2014 15:26:48 - job 7349032 report time 1390054946 does not match current heartbeat 1390055066 : ignoring job
Sat 18 Jan 2014 15:26:48 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:26:48 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:26:48 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:26:48 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:26:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:26:50 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:26:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:26:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:26:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:26:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:26:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:26:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:26:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:26:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43820515
Sat 18 Jan 2014 15:26:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:26:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:26:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:26:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43820515
Sat 18 Jan 2014 15:26:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:27:04 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:27:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:27:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:27:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:27:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:27:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:27:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:27:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:27:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:27:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:27:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:27:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:27:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:27:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:27:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:27:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:27:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:27:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:27:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:27:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:27:09 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:27:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 15:27:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:27:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:27:11 - job_xml_thread(): Done retrieving: data size 43820027
Sat 18 Jan 2014 15:27:11 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:27:11 - XML: Start document: iteration 12
Sat 18 Jan 2014 15:27:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43820027
Sat 18 Jan 2014 15:27:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:27:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43820027
Sat 18 Jan 2014 15:27:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:27:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:27:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:27:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:27:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:27:26 - XML: Processed 655252 elements - found 523 jobs
Sat 18 Jan 2014 15:27:26 - job 7349034 report time 1390055066 does not match current heartbeat 1390055187 : ignoring job
Sat 18 Jan 2014 15:27:26 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 15:27:26 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 15:27:26 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 15:27:26 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:27:26 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:27:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:27:31 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:27:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:27:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:27:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:27:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:27:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:27:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:27:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:27:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:27:33 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:27:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:27:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:27:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:27:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:27:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:27:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:27:35 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 15:27:35 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 15:27:35 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:27:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:27:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853987
Sat 18 Jan 2014 15:27:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:27:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853987
Sat 18 Jan 2014 15:27:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:27:42 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:27:42 - job_xml_thread(): Done retrieving: data size 43853987
Sat 18 Jan 2014 15:27:42 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:27:42 - XML: Start document: iteration 13
Sat 18 Jan 2014 15:27:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:27:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:27:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:27:47 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:27:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:27:47 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:27:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 15:27:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 15:27:47 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:27:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:27:48 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:27:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:27:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8395 values 132341 bits 16542 bytes 
Sat 18 Jan 2014 15:27:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:27:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:27:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:27:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:27:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:27:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:27:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:27:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:27:55 - XML: Processed 655252 elements - found 523 jobs
Sat 18 Jan 2014 15:27:55 - job 7349034 report time 1390055066 does not match current heartbeat 1390055187 : ignoring job
Sat 18 Jan 2014 15:27:55 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:27:55 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:27:55 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:27:55 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:27:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:27:59 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:27:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:27:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:27:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:27:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:27:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:27:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:28:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:28:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43812575
Sat 18 Jan 2014 15:28:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:28:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43812575
Sat 18 Jan 2014 15:28:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:28:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:28:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:28:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:28:11 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:28:11 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:28:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:28:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:28:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:28:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:28:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:28:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:28:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:28:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:28:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:28:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:28:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:28:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:28:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:28:16 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:28:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 15:28:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:28:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:28:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:28:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:28:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:28:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:28:17 - job_xml_thread(): Done retrieving: data size 43833312
Sat 18 Jan 2014 15:28:17 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:28:17 - XML: Start document: iteration 14
Sat 18 Jan 2014 15:28:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43833312
Sat 18 Jan 2014 15:28:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:28:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43833312
Sat 18 Jan 2014 15:28:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:28:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:28:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:28:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:28:30 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:28:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:28:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:28:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:28:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:28:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:28:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:28:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:28:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:28:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:28:36 - XML: Processed 655252 elements - found 523 jobs
Sat 18 Jan 2014 15:28:36 - job 7349034 report time 1390055066 does not match current heartbeat 1390055187 : ignoring job
Sat 18 Jan 2014 15:28:36 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:28:36 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:28:36 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:28:36 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:28:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:28:39 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:28:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:28:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:28:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:28:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:28:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:28:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:28:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:28:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43806688
Sat 18 Jan 2014 15:28:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:28:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43806688
Sat 18 Jan 2014 15:28:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:28:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:28:47 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:28:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:28:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:28:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:28:49 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:28:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 15:28:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 15:28:49 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:28:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8643 values 136245 bits 17030 bytes 
Sat 18 Jan 2014 15:28:51 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:28:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:28:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:28:52 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:28:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:28:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:28:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:28:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:28:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:28:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:28:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:28:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:28:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:28:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:28:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:28:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:28:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:28:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:28:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:28:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:28:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:28:58 - job_xml_thread(): Done retrieving: data size 43818785
Sat 18 Jan 2014 15:28:58 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:28:58 - XML: Start document: iteration 15
Sat 18 Jan 2014 15:28:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43818785
Sat 18 Jan 2014 15:28:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:28:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43818785
Sat 18 Jan 2014 15:28:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:29:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:29:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:29:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:29:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:29:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:29:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:29:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:29:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:29:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:29:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:29:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:29:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:29:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:29:17 - XML: Processed 655254 elements - found 524 jobs
Sat 18 Jan 2014 15:29:17 - job 7349036 report time 1390055187 does not match current heartbeat 1390055307 : ignoring job
Sat 18 Jan 2014 15:29:17 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 15:29:17 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 15:29:17 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 15:29:17 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:29:17 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:29:20 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:29:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 15:29:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:29:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:29:21 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:29:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:29:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:29:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:29:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:29:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:29:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:29:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:29:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43754197
Sat 18 Jan 2014 15:29:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:29:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43754197
Sat 18 Jan 2014 15:29:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:29:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:29:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:29:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:29:30 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:29:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:29:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:29:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:29:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:29:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:29:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:29:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43754197
Sat 18 Jan 2014 15:29:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:29:32 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:29:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:29:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:29:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:29:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:29:42 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:29:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:29:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:29:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:29:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:29:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:29:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:29:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:29:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:29:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:29:46 - job_xml_thread(): Done retrieving: data size 43244942
Sat 18 Jan 2014 15:29:46 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:29:46 - XML: Start document: iteration 16
Sat 18 Jan 2014 15:29:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:29:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:29:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43244942
Sat 18 Jan 2014 15:29:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:29:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:29:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:29:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43244942
Sat 18 Jan 2014 15:29:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:29:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:29:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:29:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:29:49 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:29:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:29:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 15:29:50 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:29:51 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:29:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 15:29:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9037 values 142518 bits 17814 bytes 
Sat 18 Jan 2014 15:29:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:29:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:30:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:30:02 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:30:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:30:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:30:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:30:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:30:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:30:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:30:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:30:06 - XML: Processed 648304 elements - found 524 jobs
Sat 18 Jan 2014 15:30:06 - job 7349036 report time 1390055187 does not match current heartbeat 1390055307 : ignoring job
Sat 18 Jan 2014 15:30:06 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:30:06 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:30:06 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:30:06 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:30:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:30:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:30:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:30:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:30:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:30:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:30:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:30:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:30:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:30:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43217846
Sat 18 Jan 2014 15:30:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:30:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43217846
Sat 18 Jan 2014 15:30:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:30:17 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:30:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 15:30:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:30:18 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 15:30:19 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:30:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:30:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:30:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:30:20 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:30:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:30:21 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:30:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:30:21 - job_xml_thread(): Done retrieving: data size 43217846
Sat 18 Jan 2014 15:30:21 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:30:21 - XML: Start document: iteration 17
Sat 18 Jan 2014 15:30:21 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:30:21 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:30:21 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 15:30:21 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 15:30:21 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 15:30:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:30:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:30:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:30:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:30:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sat 18 Jan 2014 15:30:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:30:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:30:33 - XML: Processed 647740 elements - found 524 jobs
Sat 18 Jan 2014 15:30:33 - job 7349036 report time 1390055187 does not match current heartbeat 1390055307 : ignoring job
Sat 18 Jan 2014 15:30:33 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:30:33 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:30:33 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:30:33 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:30:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:30:34 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:30:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:30:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:30:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:30:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:30:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:30:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:30:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:30:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43325208
Sat 18 Jan 2014 15:30:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:30:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43325208
Sat 18 Jan 2014 15:30:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:30:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:30:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:30:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:30:45 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:30:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:30:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:30:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:30:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:30:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:30:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:30:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:30:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:30:48 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:30:48 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:30:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:30:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:30:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:30:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43763665
Sat 18 Jan 2014 15:30:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:30:50 - job_xml_thread(): Done retrieving: data size 43763665
Sat 18 Jan 2014 15:30:50 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:30:50 - XML: Start document: iteration 18
Sat 18 Jan 2014 15:30:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:30:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:30:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:30:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:30:51 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:30:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:30:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43763665
Sat 18 Jan 2014 15:30:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:30:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:30:52 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:30:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 15:30:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 15:30:52 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:30:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8733 values 137812 bits 17226 bytes 
Sat 18 Jan 2014 15:31:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:31:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:31:03 - XML: Processed 654154 elements - found 524 jobs
Sat 18 Jan 2014 15:31:03 - job 7349036 report time 1390055187 does not match current heartbeat 1390055307 : ignoring job
Sat 18 Jan 2014 15:31:03 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:31:03 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:31:03 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:31:04 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:31:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:31:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:31:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:31:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:31:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:31:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:31:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:31:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:31:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:31:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:31:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:31:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:31:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:31:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:31:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:31:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:31:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:31:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:31:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:31:11 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:31:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 15:31:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:31:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:31:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43817292
Sat 18 Jan 2014 15:31:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:31:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43817292
Sat 18 Jan 2014 15:31:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:31:19 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:31:19 - job_xml_thread(): Done retrieving: data size 43817292
Sat 18 Jan 2014 15:31:19 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:31:19 - XML: Start document: iteration 19
Sat 18 Jan 2014 15:31:22 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:31:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:31:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:31:23 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:31:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:31:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:31:24 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:31:24 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 15:31:24 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:31:24 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 15:31:24 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 15:31:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:31:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:31:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:31:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:31:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:31:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:31:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:31:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:31:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:31:27 - size of cluster 'LISA Cluster': 624 hosts 79476 metrics 874641 values 13790695 bits 1723836 bytes 
Sat 18 Jan 2014 15:31:32 - XML: Processed 655254 elements - found 524 jobs
Sat 18 Jan 2014 15:31:32 - job 7349039 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 15:31:32 - job 7349038 report time 1390055307 does not match current heartbeat 1390055428 : ignoring job
Sat 18 Jan 2014 15:31:32 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 15:31:32 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 15:31:32 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 15:31:32 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:31:32 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:31:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:31:34 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:31:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:31:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:31:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:31:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:31:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:31:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:31:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:31:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43820045
Sat 18 Jan 2014 15:31:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:31:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43820045
Sat 18 Jan 2014 15:31:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:31:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:31:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:31:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:31:46 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:31:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:31:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:31:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:31:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:31:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:31:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:31:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43820045
Sat 18 Jan 2014 15:31:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:31:47 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:31:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:31:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:31:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:31:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:31:52 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:31:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:31:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 15:31:53 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:31:53 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:31:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 15:31:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99221 bits 12402 bytes 
Sat 18 Jan 2014 15:31:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:31:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:32:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:32:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:32:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:32:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:32:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:32:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:32:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:32:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:32:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:32:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:32:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:32:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:32:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:32:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:32:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:32:04 - job_xml_thread(): Done retrieving: data size 43803493
Sat 18 Jan 2014 15:32:04 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:32:04 - XML: Start document: iteration 20
Sat 18 Jan 2014 15:32:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43803493
Sat 18 Jan 2014 15:32:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:32:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43803493
Sat 18 Jan 2014 15:32:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:32:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:32:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:32:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:32:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:32:21 - XML: Processed 655254 elements - found 524 jobs
Sat 18 Jan 2014 15:32:21 - job 7349038 report time 1390055307 does not match current heartbeat 1390055428 : ignoring job
Sat 18 Jan 2014 15:32:21 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:32:21 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:32:21 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:32:21 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:32:24 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:32:24 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 15:32:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:32:24 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:32:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:32:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:32:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:32:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:32:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:32:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:32:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:32:29 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:32:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 15:32:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:32:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:32:29 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:32:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:32:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:32:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:32:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:32:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:32:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:32:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:32:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43837765
Sat 18 Jan 2014 15:32:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:32:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43837765
Sat 18 Jan 2014 15:32:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:32:36 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:32:36 - job_xml_thread(): Done retrieving: data size 43837765
Sat 18 Jan 2014 15:32:36 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:32:36 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 15:32:37 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 15:32:37 - Housekeeping: done.
Sat 18 Jan 2014 15:32:37 - XML: Start document: iteration 0
Sat 18 Jan 2014 15:32:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:32:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:32:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:32:42 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:32:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:32:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:32:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:32:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:32:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:32:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:32:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:32:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:32:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:32:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:32:53 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:32:54 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:32:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:32:54 - XML: Processed 655254 elements - found 524 jobs
Sat 18 Jan 2014 15:32:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 15:32:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 15:32:54 - job 7349038 report time 1390055307 does not match current heartbeat 1390055428 : ignoring job
Sat 18 Jan 2014 15:32:54 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:32:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5798 values 91770 bits 11471 bytes 
Sat 18 Jan 2014 15:32:54 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:32:54 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:32:54 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:32:54 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:32:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:32:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:32:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:32:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:32:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:32:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:32:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:32:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:32:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:32:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:32:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:32:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43800580
Sat 18 Jan 2014 15:32:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:32:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43800580
Sat 18 Jan 2014 15:32:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:33:09 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:33:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:33:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:33:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:33:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:33:13 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:33:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:33:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:33:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:33:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:33:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:33:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:33:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:33:14 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:33:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:33:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:33:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:33:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:33:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:33:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:33:15 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:33:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 15:33:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:33:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:33:18 - job_xml_thread(): Done retrieving: data size 43826000
Sat 18 Jan 2014 15:33:18 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:33:18 - XML: Start document: iteration 1
Sat 18 Jan 2014 15:33:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43826000
Sat 18 Jan 2014 15:33:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:33:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43826000
Sat 18 Jan 2014 15:33:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:33:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:33:30 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:33:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:33:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:33:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:33:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:33:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:33:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:33:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:33:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:33:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:33:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:33:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:33:33 - XML: Processed 655254 elements - found 524 jobs
Sat 18 Jan 2014 15:33:33 - job 7349041 report time 1390055428 does not match current heartbeat 1390055548 : ignoring job
Sat 18 Jan 2014 15:33:33 - job 7345969 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 15:33:33 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 15:33:33 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 15:33:34 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 15:33:34 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:33:34 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:33:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:33:38 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:33:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:33:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:33:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:33:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:33:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:33:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:33:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:33:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43813339
Sat 18 Jan 2014 15:33:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:33:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43813339
Sat 18 Jan 2014 15:33:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:33:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:33:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:33:50 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:33:50 - job_xml_thread(): Done retrieving: data size 43813339
Sat 18 Jan 2014 15:33:50 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:33:50 - XML: Start document: iteration 2
Sat 18 Jan 2014 15:33:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:33:52 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:33:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:33:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:33:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:33:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:33:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:33:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:33:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:33:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:33:54 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:33:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:33:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:33:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:33:55 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:33:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 15:33:55 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:33:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8571 values 135366 bits 16920 bytes 
Sat 18 Jan 2014 15:33:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 15:34:02 - XML: Processed 655254 elements - found 524 jobs
Sat 18 Jan 2014 15:34:02 - job 7349041 report time 1390055428 does not match current heartbeat 1390055548 : ignoring job
Sat 18 Jan 2014 15:34:02 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:34:02 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:34:02 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:34:02 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:34:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:34:04 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:34:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:34:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:34:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:34:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:34:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:34:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:34:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:34:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43818605
Sat 18 Jan 2014 15:34:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:34:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43818605
Sat 18 Jan 2014 15:34:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:34:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:34:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:34:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:34:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:34:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:34:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:34:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:34:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:34:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:34:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43818605
Sat 18 Jan 2014 15:34:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:34:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:34:17 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:34:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:34:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:34:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:34:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:34:29 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:34:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:34:31 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:34:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:34:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:34:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:34:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:34:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:34:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:34:31 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:34:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 15:34:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:34:31 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 15:34:31 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 15:34:31 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:34:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:34:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:34:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:34:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:34:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:34:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:34:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:34:33 - job_xml_thread(): Done retrieving: data size 43802388
Sat 18 Jan 2014 15:34:33 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:34:33 - XML: Start document: iteration 3
Sat 18 Jan 2014 15:34:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43802388
Sat 18 Jan 2014 15:34:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:34:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43802388
Sat 18 Jan 2014 15:34:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:34:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:34:45 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:34:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:34:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:34:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:34:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:34:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:34:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:34:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:34:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:34:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:34:51 - XML: Processed 655254 elements - found 524 jobs
Sat 18 Jan 2014 15:34:51 - job 7349041 report time 1390055428 does not match current heartbeat 1390055548 : ignoring job
Sat 18 Jan 2014 15:34:51 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:34:51 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:34:51 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:34:51 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:34:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:34:54 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:34:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:34:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:34:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:34:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:34:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:34:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:34:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:34:55 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:34:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:34:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 15:34:56 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:34:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5783 values 91253 bits 11406 bytes 
Sat 18 Jan 2014 15:34:56 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:34:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 15:34:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:34:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43822168
Sat 18 Jan 2014 15:34:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:34:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43822168
Sat 18 Jan 2014 15:34:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:35:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:35:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:35:06 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:35:06 - job_xml_thread(): Done retrieving: data size 43822168
Sat 18 Jan 2014 15:35:06 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:35:06 - XML: Start document: iteration 4
Sat 18 Jan 2014 15:35:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:35:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:35:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:35:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:35:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:35:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:35:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:35:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:35:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:35:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:35:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:35:18 - XML: Processed 655256 elements - found 525 jobs
Sat 18 Jan 2014 15:35:18 - job 7346097 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 15:35:18 - job 7349043 report time 1390055548 does not match current heartbeat 1390055669 : ignoring job
Sat 18 Jan 2014 15:35:18 - job 7349041 report time 1390055428 does not match current heartbeat 1390055669 : ignoring job
Sat 18 Jan 2014 15:35:18 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 15:35:18 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 15:35:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:35:19 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:35:19 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 15:35:19 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:35:19 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:35:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:35:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:35:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:35:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:35:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:35:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:35:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:35:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43756946
Sat 18 Jan 2014 15:35:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:35:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43756946
Sat 18 Jan 2014 15:35:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:35:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:35:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:35:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:35:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:35:35 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:35:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:35:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:35:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:35:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:35:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:35:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:35:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:35:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:35:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:35:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:35:37 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:35:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:35:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:35:37 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:35:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 15:35:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:35:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:35:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:35:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:35:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:35:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:35:39 - job_xml_thread(): Done retrieving: data size 43252407
Sat 18 Jan 2014 15:35:39 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:35:39 - XML: Start document: iteration 5
Sat 18 Jan 2014 15:35:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43252407
Sat 18 Jan 2014 15:35:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:35:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43252407
Sat 18 Jan 2014 15:35:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:35:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:35:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:35:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:35:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:35:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:35:56 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:35:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:35:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:35:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:35:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:35:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:35:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 15:35:57 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:35:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 15:35:57 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:35:58 - XML: Processed 648124 elements - found 523 jobs
Sat 18 Jan 2014 15:35:58 - job 7349043 report time 1390055548 does not match current heartbeat 1390055669 : ignoring job
Sat 18 Jan 2014 15:35:58 - job 7348623 appears to have finished
Sat 18 Jan 2014 15:35:58 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 15:35:58 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 15:35:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6300 values 99437 bits 12429 bytes 
Sat 18 Jan 2014 15:35:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:35:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:35:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:35:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:35:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:35:58 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 15:35:58 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:35:58 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:36:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:36:02 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:36:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:36:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:36:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:36:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:36:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:36:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:36:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:36:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43179479
Sat 18 Jan 2014 15:36:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:36:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43179479
Sat 18 Jan 2014 15:36:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:36:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:36:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:36:13 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:36:13 - job_xml_thread(): Done retrieving: data size 43179479
Sat 18 Jan 2014 15:36:13 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:36:13 - XML: Start document: iteration 6
Sat 18 Jan 2014 15:36:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:36:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:36:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:36:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:36:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:36:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:36:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:36:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:36:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:36:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:36:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:36:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:36:27 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:36:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:36:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:36:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:36:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:36:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:36:28 - XML: Processed 647052 elements - found 523 jobs
Sat 18 Jan 2014 15:36:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:36:28 - job 7349043 report time 1390055548 does not match current heartbeat 1390055669 : ignoring job
Sat 18 Jan 2014 15:36:28 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:36:28 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:36:28 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:36:28 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:36:28 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:36:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 15:36:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:36:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:36:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43226379
Sat 18 Jan 2014 15:36:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:36:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43226379
Sat 18 Jan 2014 15:36:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:36:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:36:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:36:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:36:39 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:36:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:36:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:36:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:36:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:36:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:36:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:36:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:36:43 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:36:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:36:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:36:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:36:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:36:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:36:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:36:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:36:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:36:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:36:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:36:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:36:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43740592
Sat 18 Jan 2014 15:36:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:36:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43740592
Sat 18 Jan 2014 15:36:46 - job_xml_thread(): Done retrieving: data size 43740592
Sat 18 Jan 2014 15:36:46 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:36:46 - XML: Start document: iteration 7
Sat 18 Jan 2014 15:36:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:36:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:36:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:36:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:36:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:36:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:36:57 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:36:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:36:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:36:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:36:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:36:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:36:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:36:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:36:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:36:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 15:36:57 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:36:57 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:36:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 15:36:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9144 values 144275 bits 18034 bytes 
Sat 18 Jan 2014 15:36:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:36:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:37:08 - XML: Processed 654008 elements - found 523 jobs
Sat 18 Jan 2014 15:37:08 - job 7349043 report time 1390055548 does not match current heartbeat 1390055669 : ignoring job
Sat 18 Jan 2014 15:37:08 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:37:08 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:37:08 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:37:08 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:37:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:37:10 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:37:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:37:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:37:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:37:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:37:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:37:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:37:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:37:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43790749
Sat 18 Jan 2014 15:37:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:37:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:37:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:37:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43790749
Sat 18 Jan 2014 15:37:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:37:23 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:37:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:37:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:37:25 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:37:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:37:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:37:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:37:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:37:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:37:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:37:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:37:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:37:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:37:29 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:37:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:37:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:37:29 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:37:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 15:37:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:37:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:37:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:37:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:37:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:37:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:37:31 - job_xml_thread(): Done retrieving: data size 43819898
Sat 18 Jan 2014 15:37:31 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:37:31 - XML: Start document: iteration 8
Sat 18 Jan 2014 15:37:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43819898
Sat 18 Jan 2014 15:37:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:37:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43819898
Sat 18 Jan 2014 15:37:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:37:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:37:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:37:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:37:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:37:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:37:47 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:37:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:37:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:37:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:37:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:37:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:37:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:37:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:37:52 - XML: Processed 655248 elements - found 521 jobs
Sat 18 Jan 2014 15:37:52 - job 7349045 report time 1390055669 does not match current heartbeat 1390055789 : ignoring job
Sat 18 Jan 2014 15:37:52 - job 7345969 appears to have finished
Sat 18 Jan 2014 15:37:52 - job 7348917 appears to have finished
Sat 18 Jan 2014 15:37:52 - job_xml_thread(): Found 3 updated jobs.
Sat 18 Jan 2014 15:37:52 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 15:37:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:37:54 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:37:54 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Sat 18 Jan 2014 15:37:54 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:37:54 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:37:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:37:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:37:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:37:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:37:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:37:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:37:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:37:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43828228
Sat 18 Jan 2014 15:37:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:37:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43828228
Sat 18 Jan 2014 15:37:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:37:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:37:57 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:37:58 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:37:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:37:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 15:37:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 15:37:59 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:38:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8824 values 139180 bits 17397 bytes 
Sat 18 Jan 2014 15:38:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:38:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:38:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:38:07 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:38:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:38:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:38:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:38:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:38:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:38:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:38:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:38:09 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:38:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:38:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:38:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:38:11 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:38:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:38:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:38:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:38:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:38:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:38:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:38:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:38:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43828316
Sat 18 Jan 2014 15:38:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:38:13 - job_xml_thread(): Done retrieving: data size 43828316
Sat 18 Jan 2014 15:38:13 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:38:13 - XML: Start document: iteration 9
Sat 18 Jan 2014 15:38:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43828316
Sat 18 Jan 2014 15:38:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:38:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:38:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:38:24 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 15:38:24 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:38:24 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:38:24 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:38:24 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 15:38:24 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 15:38:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:38:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:38:26 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 15:38:29 - XML: Processed 655248 elements - found 521 jobs
Sat 18 Jan 2014 15:38:29 - job 7349045 report time 1390055669 does not match current heartbeat 1390055789 : ignoring job
Sat 18 Jan 2014 15:38:29 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:38:30 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:38:30 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:38:30 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:38:32 - size of cluster 'LISA Cluster': 624 hosts 79478 metrics 867069 values 13681745 bits 1710218 bytes 
Sat 18 Jan 2014 15:38:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:38:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:38:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:38:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:38:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:38:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:38:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:38:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:38:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:38:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:38:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:38:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:38:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:38:36 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:38:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 15:38:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:38:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:38:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:38:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:38:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:38:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:38:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43843055
Sat 18 Jan 2014 15:38:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:38:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43843055
Sat 18 Jan 2014 15:38:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:38:45 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:38:45 - job_xml_thread(): Done retrieving: data size 43843055
Sat 18 Jan 2014 15:38:45 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:38:45 - XML: Start document: iteration 10
Sat 18 Jan 2014 15:38:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:38:50 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:38:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:38:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:38:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:38:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:38:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:38:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:38:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:38:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:38:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:38:56 - XML: Processed 655248 elements - found 521 jobs
Sat 18 Jan 2014 15:38:56 - job 7349045 report time 1390055669 does not match current heartbeat 1390055789 : ignoring job
Sat 18 Jan 2014 15:38:56 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:38:56 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:38:56 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:38:56 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:38:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:38:59 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:38:59 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:38:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:38:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 15:38:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 15:38:59 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:39:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5820 values 91783 bits 11472 bytes 
Sat 18 Jan 2014 15:39:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:39:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:39:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:39:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:39:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:39:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:39:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:39:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:39:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:39:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43830206
Sat 18 Jan 2014 15:39:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:39:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43830206
Sat 18 Jan 2014 15:39:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:39:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:39:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:39:12 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:39:12 - job_xml_thread(): Done retrieving: data size 43830206
Sat 18 Jan 2014 15:39:12 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:39:12 - XML: Start document: iteration 11
Sat 18 Jan 2014 15:39:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:39:13 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:39:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:39:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:39:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:39:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:39:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:39:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:39:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:39:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:39:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:39:22 - XML: Processed 655246 elements - found 520 jobs
Sat 18 Jan 2014 15:39:22 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:39:22 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:39:22 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:39:22 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:39:26 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:39:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:39:27 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:39:27 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 15:39:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:39:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:39:27 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:39:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 15:39:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:39:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:39:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:39:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:39:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:39:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:39:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:39:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:39:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43802381
Sat 18 Jan 2014 15:39:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:39:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43802381
Sat 18 Jan 2014 15:39:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:39:37 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:39:37 - job_xml_thread(): Done retrieving: data size 43802381
Sat 18 Jan 2014 15:39:37 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:39:38 - XML: Start document: iteration 12
Sat 18 Jan 2014 15:39:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:39:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:39:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:39:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:39:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:39:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:39:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:39:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:39:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:39:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:39:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:39:46 - XML: Processed 655250 elements - found 522 jobs
Sat 18 Jan 2014 15:39:46 - job 7349047 report time 1390055789 does not match current heartbeat 1390055910 : ignoring job
Sat 18 Jan 2014 15:39:46 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 15:39:46 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 15:39:46 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 15:39:46 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:39:46 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:39:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:39:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:39:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:39:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:39:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:39:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:39:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:39:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:39:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:39:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43802300
Sat 18 Jan 2014 15:39:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:39:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43802300
Sat 18 Jan 2014 15:39:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:39:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:39:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:39:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:39:59 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:40:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:40:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 15:40:00 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:40:00 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:40:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9021 values 142267 bits 17783 bytes 
Sat 18 Jan 2014 15:40:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 15:40:02 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:40:02 - job_xml_thread(): Done retrieving: data size 43802300
Sat 18 Jan 2014 15:40:02 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:40:02 - XML: Start document: iteration 13
Sat 18 Jan 2014 15:40:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:40:07 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:40:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:40:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:40:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:40:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:40:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:40:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:40:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:40:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:40:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:40:16 - XML: Processed 655250 elements - found 522 jobs
Sat 18 Jan 2014 15:40:16 - job 7349047 report time 1390055789 does not match current heartbeat 1390055910 : ignoring job
Sat 18 Jan 2014 15:40:16 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:40:16 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:40:16 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:40:16 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:40:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:40:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:40:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:40:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:40:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:40:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:40:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:40:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:40:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:40:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43802426
Sat 18 Jan 2014 15:40:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:40:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43802426
Sat 18 Jan 2014 15:40:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:40:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:40:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:40:31 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:40:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:40:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:40:31 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:40:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:40:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:40:32 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:40:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 15:40:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:40:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:40:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:40:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:40:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:40:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:40:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:40:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:40:37 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:40:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:40:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:40:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:40:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:40:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:40:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:40:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:40:40 - job_xml_thread(): Done retrieving: data size 43810040
Sat 18 Jan 2014 15:40:40 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:40:40 - XML: Start document: iteration 14
Sat 18 Jan 2014 15:40:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43810040
Sat 18 Jan 2014 15:40:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43810040
Sat 18 Jan 2014 15:40:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:40:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:40:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:40:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:40:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:40:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:41:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:41:00 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:41:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:41:02 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:41:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 15:41:02 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:41:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 15:41:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6130 values 96703 bits 12087 bytes 
Sat 18 Jan 2014 15:41:03 - XML: Processed 655250 elements - found 522 jobs
Sat 18 Jan 2014 15:41:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:41:03 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:41:03 - job 7349047 report time 1390055789 does not match current heartbeat 1390055910 : ignoring job
Sat 18 Jan 2014 15:41:04 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:41:04 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:41:04 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:41:04 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:41:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:41:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:41:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:41:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:41:04 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:41:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:41:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:41:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:41:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:41:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:41:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:41:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:41:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:41:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:41:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:41:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:41:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43760728
Sat 18 Jan 2014 15:41:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:41:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43760728
Sat 18 Jan 2014 15:41:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:41:19 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:41:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:41:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:41:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:41:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:41:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:41:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:41:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:41:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:41:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:41:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:41:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:41:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:41:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:41:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:41:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:41:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:41:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:41:25 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:41:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 15:41:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:41:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:41:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:41:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:41:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:41:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:41:28 - job_xml_thread(): Done retrieving: data size 43759434
Sat 18 Jan 2014 15:41:28 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:41:28 - XML: Start document: iteration 15
Sat 18 Jan 2014 15:41:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43759434
Sat 18 Jan 2014 15:41:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43759434
Sat 18 Jan 2014 15:41:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:41:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:41:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:41:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:41:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:41:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:41:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:41:48 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:41:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:41:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:41:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:41:50 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:41:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:41:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:41:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:41:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:41:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:41:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:41:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:41:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:41:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:41:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:41:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:41:52 - XML: Processed 654502 elements - found 522 jobs
Sat 18 Jan 2014 15:41:52 - job 7349050 report time 1390055910 does not match current heartbeat 1390056030 : ignoring job
Sat 18 Jan 2014 15:41:52 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 15:41:52 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 15:41:52 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 15:41:52 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:41:52 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:41:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:41:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43183320
Sat 18 Jan 2014 15:41:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:41:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43183320
Sat 18 Jan 2014 15:41:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:42:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:42:02 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:42:03 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:42:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 15:42:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:42:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 15:42:03 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:42:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9061 values 142907 bits 17863 bytes 
Sat 18 Jan 2014 15:42:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:42:03 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:42:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:42:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:42:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:42:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:42:07 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:42:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:42:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:42:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:42:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:42:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:42:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:42:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:42:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:42:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:42:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:42:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:42:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:42:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:42:11 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 15:42:11 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 15:42:11 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:42:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:42:12 - job_xml_thread(): Done retrieving: data size 43181683
Sat 18 Jan 2014 15:42:12 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:42:12 - XML: Start document: iteration 16
Sat 18 Jan 2014 15:42:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43181683
Sat 18 Jan 2014 15:42:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:42:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43181683
Sat 18 Jan 2014 15:42:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:42:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:42:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:42:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:42:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:42:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:42:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:42:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:42:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:42:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:42:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:42:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:42:29 - XML: Processed 647144 elements - found 522 jobs
Sat 18 Jan 2014 15:42:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:42:29 - job 7349050 report time 1390055910 does not match current heartbeat 1390056030 : ignoring job
Sat 18 Jan 2014 15:42:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:42:30 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:42:30 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:42:30 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:42:30 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:42:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:42:35 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:42:35 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:42:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 15:42:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:42:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:42:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:42:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:42:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:42:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:42:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:42:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:42:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43664614
Sat 18 Jan 2014 15:42:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:42:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43664614
Sat 18 Jan 2014 15:42:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:42:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:42:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:42:45 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:42:45 - job_xml_thread(): Done retrieving: data size 43664614
Sat 18 Jan 2014 15:42:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:42:45 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:42:45 - XML: Start document: iteration 17
Sat 18 Jan 2014 15:42:45 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:42:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:42:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:42:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:42:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:42:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43664614
Sat 18 Jan 2014 15:42:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:42:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:42:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:42:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:42:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:42:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:42:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:43:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:43:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:43:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:43:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:43:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:43:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:43:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:43:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:43:03 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:43:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:43:04 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:43:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:43:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:43:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:43:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 15:43:04 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:43:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 15:43:04 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:43:04 - XML: Processed 653478 elements - found 522 jobs
Sat 18 Jan 2014 15:43:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5825 values 91865 bits 11483 bytes 
Sat 18 Jan 2014 15:43:04 - job 7349050 report time 1390055910 does not match current heartbeat 1390056030 : ignoring job
Sat 18 Jan 2014 15:43:04 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:43:04 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:43:04 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:43:04 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:43:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:43:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:43:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:43:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:43:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:43:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43818706
Sat 18 Jan 2014 15:43:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:43:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43818706
Sat 18 Jan 2014 15:43:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:43:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:43:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:43:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:43:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:43:19 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:43:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:43:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:43:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:43:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:43:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:43:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:43:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:43:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:43:22 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:43:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:43:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:43:22 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:43:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 15:43:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:43:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:43:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:43:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:43:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:43:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:43:24 - job_xml_thread(): Done retrieving: data size 43819062
Sat 18 Jan 2014 15:43:24 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:43:24 - XML: Start document: iteration 18
Sat 18 Jan 2014 15:43:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43819062
Sat 18 Jan 2014 15:43:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:43:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43819062
Sat 18 Jan 2014 15:43:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:43:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:43:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:43:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:43:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:43:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:43:39 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:43:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:43:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:43:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:43:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:43:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:43:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:43:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:43:43 - XML: Processed 655250 elements - found 522 jobs
Sat 18 Jan 2014 15:43:43 - job 7349052 report time 1390056030 does not match current heartbeat 1390056151 : ignoring job
Sat 18 Jan 2014 15:43:43 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 15:43:43 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 15:43:44 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 15:43:44 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:43:44 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:43:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:43:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:43:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:43:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:43:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:43:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:43:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:43:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:43:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:43:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43828206
Sat 18 Jan 2014 15:43:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:43:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43828206
Sat 18 Jan 2014 15:43:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:43:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:43:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:43:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:43:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:43:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:43:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:43:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:43:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:43:59 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:43:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:43:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:43:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:44:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:44:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:44:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:44:02 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:44:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:44:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:44:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:44:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:44:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:44:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:44:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:44:03 - job_xml_thread(): Done retrieving: data size 43833760
Sat 18 Jan 2014 15:44:03 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:44:03 - XML: Start document: iteration 19
Sat 18 Jan 2014 15:44:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43833760
Sat 18 Jan 2014 15:44:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:44:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43833760
Sat 18 Jan 2014 15:44:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:44:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:44:04 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:44:06 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:44:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:44:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 15:44:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 15:44:06 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:44:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8991 values 141812 bits 17726 bytes 
Sat 18 Jan 2014 15:44:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:44:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:44:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:44:18 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:44:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:44:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:44:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:44:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:44:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:44:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:44:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:44:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:44:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:44:24 - XML: Processed 655250 elements - found 522 jobs
Sat 18 Jan 2014 15:44:24 - job 7349052 report time 1390056030 does not match current heartbeat 1390056151 : ignoring job
Sat 18 Jan 2014 15:44:24 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:44:24 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:44:24 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:44:24 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:44:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:44:27 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:44:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:44:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:44:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:44:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:44:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:44:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:44:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:44:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43828668
Sat 18 Jan 2014 15:44:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:44:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43828668
Sat 18 Jan 2014 15:44:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:44:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:44:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:44:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:44:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:44:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:44:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:44:39 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:44:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:44:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:44:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:44:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:44:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:44:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:44:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:44:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:44:42 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:44:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:44:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:44:42 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:44:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 15:44:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:44:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:44:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:44:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:44:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:44:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:44:44 - job_xml_thread(): Done retrieving: data size 43853792
Sat 18 Jan 2014 15:44:44 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:44:44 - XML: Start document: iteration 20
Sat 18 Jan 2014 15:44:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43853792
Sat 18 Jan 2014 15:44:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:44:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43853792
Sat 18 Jan 2014 15:44:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:44:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:44:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:44:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:44:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:44:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:44:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:44:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:44:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:45:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:45:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:45:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:45:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:45:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:45:04 - XML: Processed 655250 elements - found 522 jobs
Sat 18 Jan 2014 15:45:04 - job 7349052 report time 1390056030 does not match current heartbeat 1390056151 : ignoring job
Sat 18 Jan 2014 15:45:04 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:45:04 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:45:04 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:45:04 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:45:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:45:06 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:45:06 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:45:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:45:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 15:45:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 15:45:06 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:45:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6058 values 95483 bits 11935 bytes 
Sat 18 Jan 2014 15:45:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:45:07 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:45:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:45:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:45:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:45:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:45:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:45:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:45:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:45:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43812350
Sat 18 Jan 2014 15:45:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:45:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43812350
Sat 18 Jan 2014 15:45:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:45:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:45:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:45:19 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:45:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:45:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:45:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:45:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:45:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:45:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:45:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:45:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:45:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:45:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:45:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:45:23 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:45:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 15:45:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:45:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:45:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:45:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:45:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:45:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:45:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:45:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:45:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:45:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:45:26 - job_xml_thread(): Done retrieving: data size 43830029
Sat 18 Jan 2014 15:45:26 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:45:26 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 15:45:26 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 15:45:26 - Housekeeping: done.
Sat 18 Jan 2014 15:45:26 - XML: Start document: iteration 0
Sat 18 Jan 2014 15:45:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43830029
Sat 18 Jan 2014 15:45:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43830029
Sat 18 Jan 2014 15:45:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:45:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:45:27 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 15:45:27 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:45:30 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:45:30 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:45:30 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 15:45:31 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 15:45:31 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 15:45:34 - size of cluster 'LISA Cluster': 624 hosts 79459 metrics 811152 values 12786201 bits 1598275 bytes 
Sat 18 Jan 2014 15:45:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:45:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:45:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:45:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:45:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:45:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:45:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:45:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:45:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:45:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:45:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:45:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:45:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:45:43 - XML: Processed 655250 elements - found 522 jobs
Sat 18 Jan 2014 15:45:43 - job 7349054 report time 1390056151 does not match current heartbeat 1390056271 : ignoring job
Sat 18 Jan 2014 15:45:43 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 15:45:43 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 15:45:43 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 15:45:43 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:45:43 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:45:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:45:48 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:45:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:45:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:45:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:45:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:45:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:45:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:45:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:45:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43819284
Sat 18 Jan 2014 15:45:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:45:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43819284
Sat 18 Jan 2014 15:45:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:45:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:45:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:45:58 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:45:59 - job_xml_thread(): Done retrieving: data size 43819284
Sat 18 Jan 2014 15:45:59 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:45:59 - XML: Start document: iteration 1
Sat 18 Jan 2014 15:46:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:46:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:46:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:46:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:46:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:46:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:46:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:46:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:46:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:46:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:46:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:46:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:46:06 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:46:07 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:46:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 15:46:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:46:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 15:46:07 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:46:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8945 values 141146 bits 17643 bytes 
Sat 18 Jan 2014 15:46:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:46:12 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:46:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:46:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:46:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:46:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:46:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:46:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:46:13 - XML: Processed 655250 elements - found 522 jobs
Sat 18 Jan 2014 15:46:13 - job 7349054 report time 1390056151 does not match current heartbeat 1390056271 : ignoring job
Sat 18 Jan 2014 15:46:13 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:46:13 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:46:13 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:46:13 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:46:16 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:46:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 15:46:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:46:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:46:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43810949
Sat 18 Jan 2014 15:46:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:46:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:46:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:46:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43810949
Sat 18 Jan 2014 15:46:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:46:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:46:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:46:28 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:46:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:46:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:46:29 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:46:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:46:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:46:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:46:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:46:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:46:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:46:31 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:46:31 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 15:46:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:46:32 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:46:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:46:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:46:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:46:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:46:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:46:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:46:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:46:35 - job_xml_thread(): Done retrieving: data size 43841251
Sat 18 Jan 2014 15:46:35 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:46:35 - XML: Start document: iteration 2
Sat 18 Jan 2014 15:46:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43841251
Sat 18 Jan 2014 15:46:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:46:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43841251
Sat 18 Jan 2014 15:46:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:46:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:46:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:46:47 - XML: Processed 655250 elements - found 522 jobs
Sat 18 Jan 2014 15:46:47 - job 7349054 report time 1390056151 does not match current heartbeat 1390056271 : ignoring job
Sat 18 Jan 2014 15:46:47 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:46:47 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:46:47 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:46:47 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:46:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:46:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:46:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:46:58 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:46:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:46:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:46:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:46:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:46:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:46:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:46:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:46:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:46:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:46:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:46:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:46:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:46:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:46:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:46:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:47:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:47:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43862107
Sat 18 Jan 2014 15:47:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:47:02 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:47:02 - job_xml_thread(): Done retrieving: data size 43862107
Sat 18 Jan 2014 15:47:02 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:47:02 - XML: Start document: iteration 3
Sat 18 Jan 2014 15:47:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43862107
Sat 18 Jan 2014 15:47:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:47:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:47:07 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:47:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:47:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 15:47:09 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:47:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148980 bits 18622 bytes 
Sat 18 Jan 2014 15:47:10 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:47:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 15:47:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:47:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:47:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:47:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:47:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:47:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:47:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:47:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:47:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:47:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:47:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:47:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:47:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:47:22 - XML: Processed 655248 elements - found 521 jobs
Sat 18 Jan 2014 15:47:22 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:47:22 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:47:22 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:47:22 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:47:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:47:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:47:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:47:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:47:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:47:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:47:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:47:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:47:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:47:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43750153
Sat 18 Jan 2014 15:47:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:47:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43750153
Sat 18 Jan 2014 15:47:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:47:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:47:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:47:37 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:47:37 - job_xml_thread(): Done retrieving: data size 43750153
Sat 18 Jan 2014 15:47:38 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:47:38 - XML: Start document: iteration 4
Sat 18 Jan 2014 15:47:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:47:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:47:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:47:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:47:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:47:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:47:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:47:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:47:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:47:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:47:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:47:50 - XML: Processed 654502 elements - found 522 jobs
Sat 18 Jan 2014 15:47:50 - job 7349056 report time 1390056271 does not match current heartbeat 1390056392 : ignoring job
Sat 18 Jan 2014 15:47:50 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 15:47:50 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 15:47:51 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 15:47:51 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:47:51 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:47:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:47:53 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:47:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:47:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:47:53 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:47:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 15:47:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:47:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:47:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:47:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:47:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:47:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:47:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43175767
Sat 18 Jan 2014 15:47:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:47:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43175767
Sat 18 Jan 2014 15:47:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:47:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:47:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:48:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:48:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:48:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:48:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:48:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:48:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:48:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:48:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43175767
Sat 18 Jan 2014 15:48:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:48:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:48:06 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:48:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:48:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:48:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:48:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:48:10 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:48:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:48:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 15:48:10 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:48:10 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:48:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 15:48:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5731 values 90603 bits 11325 bytes 
Sat 18 Jan 2014 15:48:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:48:14 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:48:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:48:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:48:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:48:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:48:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:48:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:48:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:48:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:48:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:48:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:48:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:48:20 - job_xml_thread(): Done retrieving: data size 43219953
Sat 18 Jan 2014 15:48:20 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:48:20 - XML: Start document: iteration 5
Sat 18 Jan 2014 15:48:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:48:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:48:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:48:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:48:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43219953
Sat 18 Jan 2014 15:48:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:48:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43219953
Sat 18 Jan 2014 15:48:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:48:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:48:34 - XML: Processed 647798 elements - found 522 jobs
Sat 18 Jan 2014 15:48:34 - job 7349056 report time 1390056271 does not match current heartbeat 1390056392 : ignoring job
Sat 18 Jan 2014 15:48:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:48:34 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:48:34 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:48:34 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:48:34 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:48:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:48:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:48:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:48:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:48:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:48:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:48:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:48:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:48:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:48:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:48:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:48:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:48:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:48:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:48:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:48:44 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:48:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 15:48:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:48:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:48:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:48:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:48:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:48:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:48:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43754981
Sat 18 Jan 2014 15:48:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:48:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43754981
Sat 18 Jan 2014 15:48:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:48:49 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:48:49 - job_xml_thread(): Done retrieving: data size 43754981
Sat 18 Jan 2014 15:48:49 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:48:49 - XML: Start document: iteration 6
Sat 18 Jan 2014 15:48:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:48:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:49:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:49:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:49:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:49:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:49:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:49:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:49:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:49:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:49:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:49:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:49:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:49:06 - XML: Processed 654090 elements - found 522 jobs
Sat 18 Jan 2014 15:49:06 - job 7349056 report time 1390056271 does not match current heartbeat 1390056392 : ignoring job
Sat 18 Jan 2014 15:49:06 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:49:06 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:49:06 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:49:06 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:49:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:49:10 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:49:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:49:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:49:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:49:11 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:49:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:49:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:49:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:49:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:49:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:49:11 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:49:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 15:49:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 15:49:11 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:49:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5574 values 87949 bits 10993 bytes 
Sat 18 Jan 2014 15:49:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:49:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43814316
Sat 18 Jan 2014 15:49:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:49:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43814316
Sat 18 Jan 2014 15:49:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:49:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:49:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:49:21 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:49:21 - job_xml_thread(): Done retrieving: data size 43814316
Sat 18 Jan 2014 15:49:21 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:49:21 - XML: Start document: iteration 7
Sat 18 Jan 2014 15:49:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:49:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:49:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:49:27 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:49:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:49:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:49:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:49:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:49:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:49:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:49:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:49:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:49:37 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:49:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:49:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:49:38 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 15:49:38 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 15:49:38 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:49:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:49:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:49:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:49:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:49:39 - XML: Processed 655250 elements - found 522 jobs
Sat 18 Jan 2014 15:49:39 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 15:49:39 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 15:49:39 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 15:49:39 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:49:39 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:49:39 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:49:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 15:49:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:49:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:49:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43794541
Sat 18 Jan 2014 15:49:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:49:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43794541
Sat 18 Jan 2014 15:49:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:49:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:49:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:49:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:49:50 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:49:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:49:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:49:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:49:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:49:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:49:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:49:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:49:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:49:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:49:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:49:53 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:49:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:49:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:49:54 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:49:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:49:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:49:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:49:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:49:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:49:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43831445
Sat 18 Jan 2014 15:49:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:49:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43831445
Sat 18 Jan 2014 15:49:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:49:56 - job_xml_thread(): Done retrieving: data size 43831445
Sat 18 Jan 2014 15:49:56 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:49:56 - XML: Start document: iteration 8
Sat 18 Jan 2014 15:50:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:50:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:50:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:50:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:50:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:50:10 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:50:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:50:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:50:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:50:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:50:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:50:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:50:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:50:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:50:11 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:50:12 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:50:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 15:50:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:50:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 15:50:12 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:50:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8088 values 127502 bits 15937 bytes 
Sat 18 Jan 2014 15:50:17 - XML: Processed 655250 elements - found 522 jobs
Sat 18 Jan 2014 15:50:17 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:50:17 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:50:17 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:50:17 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:50:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:50:19 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:50:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:50:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:50:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:50:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:50:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:50:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:50:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:50:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43827170
Sat 18 Jan 2014 15:50:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:50:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43827170
Sat 18 Jan 2014 15:50:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:50:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:50:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:50:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:50:30 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:50:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:50:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:50:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:50:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:50:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43827170
Sat 18 Jan 2014 15:50:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:50:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:50:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:50:32 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:50:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:50:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:50:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:50:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:50:44 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:50:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:50:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:50:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:50:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:50:45 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:50:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 15:50:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:50:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:50:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:50:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:50:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:50:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:50:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:50:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:50:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:50:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:50:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:50:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:50:46 - job_xml_thread(): Done retrieving: data size 43808120
Sat 18 Jan 2014 15:50:46 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:50:46 - XML: Start document: iteration 9
Sat 18 Jan 2014 15:50:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43808120
Sat 18 Jan 2014 15:50:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43808120
Sat 18 Jan 2014 15:50:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:50:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:51:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:51:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:51:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:51:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:51:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:51:02 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:51:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:51:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:51:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:51:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:51:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:51:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:51:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:51:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:51:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:51:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:51:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:51:09 - XML: Processed 655250 elements - found 522 jobs
Sat 18 Jan 2014 15:51:09 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:51:09 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:51:09 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:51:09 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:51:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:51:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:51:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:51:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:51:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:51:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43805196
Sat 18 Jan 2014 15:51:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:51:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43805196
Sat 18 Jan 2014 15:51:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:51:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:51:12 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:51:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:51:14 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:51:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 15:51:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 15:51:14 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:51:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8931 values 140879 bits 17609 bytes 
Sat 18 Jan 2014 15:51:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:51:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:51:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:51:20 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:51:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:51:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:51:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:51:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:51:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43805196
Sat 18 Jan 2014 15:51:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:51:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:51:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:51:25 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:51:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:51:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:51:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:51:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:51:29 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:51:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:51:33 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:51:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:51:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:51:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:51:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:51:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:51:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:51:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:51:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:51:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:51:36 - job_xml_thread(): Done retrieving: data size 43826657
Sat 18 Jan 2014 15:51:36 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:51:36 - XML: Start document: iteration 10
Sat 18 Jan 2014 15:51:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43826657
Sat 18 Jan 2014 15:51:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:51:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:51:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:51:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:51:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:51:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43826657
Sat 18 Jan 2014 15:51:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:51:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:51:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:51:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:51:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:51:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:51:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:51:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:51:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:51:55 - XML: Processed 655250 elements - found 522 jobs
Sat 18 Jan 2014 15:51:55 - job 7349057 appears to have finished
Sat 18 Jan 2014 15:51:55 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 15:51:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:51:55 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 15:51:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:51:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:51:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:51:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:51:55 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 15:51:55 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:51:55 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:51:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:51:59 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:51:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:51:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:51:59 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:51:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 15:51:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:51:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:51:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:51:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:51:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:52:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:52:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43839874
Sat 18 Jan 2014 15:52:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:52:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43839874
Sat 18 Jan 2014 15:52:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:52:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:52:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:52:10 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:52:10 - job_xml_thread(): Done retrieving: data size 43839874
Sat 18 Jan 2014 15:52:10 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:52:10 - XML: Start document: iteration 11
Sat 18 Jan 2014 15:52:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:52:13 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:52:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:52:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:52:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:52:14 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:52:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:52:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:52:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:52:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:52:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:52:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:52:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:52:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:52:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 15:52:15 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:52:15 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:52:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 15:52:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5827 values 91875 bits 11484 bytes 
Sat 18 Jan 2014 15:52:22 - XML: Processed 655250 elements - found 522 jobs
Sat 18 Jan 2014 15:52:22 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:52:22 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:52:22 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:52:22 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:52:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:52:23 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:52:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:52:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:52:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:52:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:52:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:52:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:52:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:52:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43802468
Sat 18 Jan 2014 15:52:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:52:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43802468
Sat 18 Jan 2014 15:52:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:52:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:52:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:52:32 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 15:52:32 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:52:33 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:52:33 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:52:33 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 15:52:33 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 15:52:33 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 15:52:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:52:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:52:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:52:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sat 18 Jan 2014 15:52:37 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:52:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:52:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:52:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:52:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:52:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:52:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:52:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:52:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:52:40 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:52:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:52:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:52:41 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:52:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 15:52:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:52:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:52:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:52:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:52:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:52:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:52:42 - job_xml_thread(): Done retrieving: data size 43831697
Sat 18 Jan 2014 15:52:42 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:52:42 - XML: Start document: iteration 12
Sat 18 Jan 2014 15:52:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43831697
Sat 18 Jan 2014 15:52:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43831697
Sat 18 Jan 2014 15:52:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:52:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:52:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:52:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:52:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:52:56 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:52:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:52:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:52:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:52:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:52:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:52:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:52:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:52:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:52:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:52:59 - XML: Processed 655250 elements - found 522 jobs
Sat 18 Jan 2014 15:52:59 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:52:59 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:52:59 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:52:59 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:53:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:53:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:53:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:53:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:53:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:53:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:53:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:53:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:53:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:53:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43835593
Sat 18 Jan 2014 15:53:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:53:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43835593
Sat 18 Jan 2014 15:53:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:53:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:53:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:53:14 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:53:14 - job_xml_thread(): Done retrieving: data size 43835593
Sat 18 Jan 2014 15:53:14 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:53:15 - XML: Start document: iteration 13
Sat 18 Jan 2014 15:53:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:53:15 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:53:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:53:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:53:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:53:15 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:53:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:53:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:53:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:53:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 15:53:16 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:53:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:53:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:53:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8614 values 135839 bits 16979 bytes 
Sat 18 Jan 2014 15:53:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:53:16 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:53:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 15:53:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:53:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:53:27 - XML: Processed 655247 elements - found 521 jobs
Sat 18 Jan 2014 15:53:27 - job 7349059 appears to have finished
Sat 18 Jan 2014 15:53:27 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 15:53:27 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 15:53:27 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 15:53:27 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:53:27 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:53:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:53:28 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:53:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:53:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:53:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:53:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:53:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:53:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:53:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:53:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43735042
Sat 18 Jan 2014 15:53:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:53:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:53:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:53:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43735042
Sat 18 Jan 2014 15:53:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:53:33 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:53:33 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:53:34 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:53:34 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:53:34 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 15:53:34 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 15:53:34 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 15:53:37 - size of cluster 'LISA Cluster': 624 hosts 79471 metrics 842846 values 13298620 bits 1662327 bytes 
Sat 18 Jan 2014 15:53:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:53:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:53:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:53:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:53:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:53:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:53:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:53:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:53:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:53:42 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:53:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:53:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:53:45 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:53:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 15:53:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:53:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:53:46 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:53:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:53:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:53:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:53:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:53:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:53:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:53:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:53:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43231970
Sat 18 Jan 2014 15:53:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:53:50 - job_xml_thread(): Done retrieving: data size 43231970
Sat 18 Jan 2014 15:53:50 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:53:50 - XML: Start document: iteration 14
Sat 18 Jan 2014 15:53:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43231970
Sat 18 Jan 2014 15:53:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:53:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:53:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:54:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:54:00 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:54:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:54:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:54:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:54:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:54:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:54:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:54:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:54:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:54:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:54:08 - XML: Processed 647736 elements - found 522 jobs
Sat 18 Jan 2014 15:54:08 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 15:54:08 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 15:54:09 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 15:54:09 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:54:09 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:54:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:54:13 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:54:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:54:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:54:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:54:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:54:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:54:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:54:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:54:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:54:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:54:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43200238
Sat 18 Jan 2014 15:54:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:54:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:54:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43200238
Sat 18 Jan 2014 15:54:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:54:16 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:54:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:54:17 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:54:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 15:54:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 15:54:17 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:54:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8932 values 140842 bits 17605 bytes 
Sat 18 Jan 2014 15:54:24 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:54:24 - job_xml_thread(): Done retrieving: data size 43200238
Sat 18 Jan 2014 15:54:24 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:54:24 - XML: Start document: iteration 15
Sat 18 Jan 2014 15:54:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:54:25 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:54:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:54:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:54:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:54:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:54:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:54:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:54:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:54:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:54:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:54:34 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:54:34 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 15:54:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:54:38 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:54:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:54:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:54:39 - XML: Processed 647724 elements - found 522 jobs
Sat 18 Jan 2014 15:54:39 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:54:39 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:54:39 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:54:39 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:54:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:54:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:54:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:54:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:54:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:54:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43696452
Sat 18 Jan 2014 15:54:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:54:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:54:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:54:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43696452
Sat 18 Jan 2014 15:54:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:54:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:54:51 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:54:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:54:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:54:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:54:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:54:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:54:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:54:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43696452
Sat 18 Jan 2014 15:54:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:54:54 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:54:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:54:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:54:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:55:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:55:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:55:05 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:55:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 15:55:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:55:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:55:06 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:55:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:55:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:55:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:55:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:55:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:55:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:55:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:55:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:55:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:55:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:55:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:55:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:55:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:55:09 - job_xml_thread(): Done retrieving: data size 43798390
Sat 18 Jan 2014 15:55:09 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:55:09 - XML: Start document: iteration 16
Sat 18 Jan 2014 15:55:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43798390
Sat 18 Jan 2014 15:55:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:55:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43798390
Sat 18 Jan 2014 15:55:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:55:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:55:18 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:55:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:55:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 15:55:19 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:55:19 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:55:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5954 values 93931 bits 11741 bytes 
Sat 18 Jan 2014 15:55:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 15:55:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:55:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:55:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:55:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:55:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:55:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:55:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:55:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:55:29 - XML: Processed 655236 elements - found 523 jobs
Sat 18 Jan 2014 15:55:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:55:29 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 15:55:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:55:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:55:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:55:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:55:29 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 15:55:29 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 15:55:29 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:55:29 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:55:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:55:33 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:55:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:55:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:55:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:55:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:55:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:55:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:55:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:55:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43834834
Sat 18 Jan 2014 15:55:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:55:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43834834
Sat 18 Jan 2014 15:55:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:55:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:55:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:55:44 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:55:44 - job_xml_thread(): Done retrieving: data size 43834834
Sat 18 Jan 2014 15:55:44 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:55:44 - XML: Start document: iteration 17
Sat 18 Jan 2014 15:55:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:55:45 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:55:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:55:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:55:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:55:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:55:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43834834
Sat 18 Jan 2014 15:55:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:55:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:55:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:55:47 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:55:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 15:55:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:55:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:55:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:56:02 - XML: Processed 655249 elements - found 522 jobs
Sat 18 Jan 2014 15:56:02 - job 7349061 appears to have finished
Sat 18 Jan 2014 15:56:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:56:02 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 15:56:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:56:02 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 15:56:02 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 15:56:02 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:56:02 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:56:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:56:03 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:56:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:56:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:56:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:56:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:56:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:56:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:56:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:56:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:56:06 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:56:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:56:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:56:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:56:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:56:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:56:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:56:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:56:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43817551
Sat 18 Jan 2014 15:56:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:56:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43817551
Sat 18 Jan 2014 15:56:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:56:17 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:56:17 - job_xml_thread(): Done retrieving: data size 43817551
Sat 18 Jan 2014 15:56:17 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:56:17 - XML: Start document: iteration 18
Sat 18 Jan 2014 15:56:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:56:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:56:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:56:20 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:56:21 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:56:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:56:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 15:56:21 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:56:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 15:56:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99033 bits 12379 bytes 
Sat 18 Jan 2014 15:56:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:56:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:56:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:56:26 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:56:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:56:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:56:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:56:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:56:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:56:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:56:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:56:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:56:30 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:56:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:56:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:56:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:56:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:56:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:56:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:56:33 - XML: Processed 655250 elements - found 522 jobs
Sat 18 Jan 2014 15:56:33 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:56:33 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:56:33 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:56:33 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:56:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:56:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43834454
Sat 18 Jan 2014 15:56:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:56:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43834454
Sat 18 Jan 2014 15:56:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:56:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:56:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:56:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:56:46 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:56:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:56:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:56:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:56:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:56:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:56:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:56:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:56:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:56:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:56:48 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:56:51 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:56:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 15:56:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:56:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:56:52 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:56:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:56:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:56:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:56:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:56:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:56:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:56:54 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 15:56:54 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 15:56:54 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:56:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:56:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43823262
Sat 18 Jan 2014 15:56:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:56:55 - job_xml_thread(): Done retrieving: data size 43823262
Sat 18 Jan 2014 15:56:55 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:56:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43823262
Sat 18 Jan 2014 15:56:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:56:55 - XML: Start document: iteration 19
Sat 18 Jan 2014 15:57:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:57:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:57:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:57:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:57:12 - XML: Processed 655250 elements - found 522 jobs
Sat 18 Jan 2014 15:57:12 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:57:12 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:57:12 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:57:12 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:57:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:57:13 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:57:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:57:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:57:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:57:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:57:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:57:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:57:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:57:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:57:16 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:57:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:57:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:57:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:57:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:57:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:57:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:57:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:57:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43860253
Sat 18 Jan 2014 15:57:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:57:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43860253
Sat 18 Jan 2014 15:57:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:57:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:57:21 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:57:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:57:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 15:57:22 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:57:22 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:57:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 15:57:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8960 values 141277 bits 17659 bytes 
Sat 18 Jan 2014 15:57:27 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:57:27 - job_xml_thread(): Done retrieving: data size 43860253
Sat 18 Jan 2014 15:57:27 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:57:27 - XML: Start document: iteration 20
Sat 18 Jan 2014 15:57:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:57:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:57:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:57:30 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:57:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:57:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:57:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:57:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:57:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:57:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:57:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:57:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:57:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:57:37 - XML: Processed 655250 elements - found 522 jobs
Sat 18 Jan 2014 15:57:37 - job 7349063 appears to have finished
Sat 18 Jan 2014 15:57:38 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 15:57:38 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 15:57:38 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 15:57:38 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:57:38 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:57:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:57:41 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:57:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:57:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:57:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:57:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:57:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:57:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:57:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:57:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43811047
Sat 18 Jan 2014 15:57:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:57:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43811047
Sat 18 Jan 2014 15:57:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:57:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:57:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:57:53 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:57:53 - job_xml_thread(): Done retrieving: data size 43811047
Sat 18 Jan 2014 15:57:53 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:57:53 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 15:57:54 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 15:57:54 - Housekeeping: done.
Sat 18 Jan 2014 15:57:54 - XML: Start document: iteration 0
Sat 18 Jan 2014 15:57:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:57:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:57:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:57:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:57:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:57:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:57:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:57:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:57:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:57:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:57:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:58:05 - XML: Processed 655250 elements - found 522 jobs
Sat 18 Jan 2014 15:58:05 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:58:05 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:58:05 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:58:05 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:58:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:58:07 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:58:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:58:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:58:07 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:58:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 15:58:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:58:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:58:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:58:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:58:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:58:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:58:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43815334
Sat 18 Jan 2014 15:58:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:58:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43815334
Sat 18 Jan 2014 15:58:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:58:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:58:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:58:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:58:18 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:58:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:58:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:58:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:58:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:58:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:58:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:58:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:58:20 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:58:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:58:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:58:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:58:22 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:58:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:58:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:58:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:58:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:58:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:58:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:58:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:58:23 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:58:23 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:58:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:58:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 15:58:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 15:58:23 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:58:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5736 values 90450 bits 11306 bytes 
Sat 18 Jan 2014 15:58:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:58:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43834026
Sat 18 Jan 2014 15:58:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:58:24 - job_xml_thread(): Done retrieving: data size 43834026
Sat 18 Jan 2014 15:58:24 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:58:24 - XML: Start document: iteration 1
Sat 18 Jan 2014 15:58:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43834026
Sat 18 Jan 2014 15:58:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:58:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:58:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:58:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:58:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:58:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:58:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:58:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:58:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:58:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:58:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:58:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:58:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:58:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:58:42 - XML: Processed 655250 elements - found 522 jobs
Sat 18 Jan 2014 15:58:42 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:58:43 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:58:43 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:58:43 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:58:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:58:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:58:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:58:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:58:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:58:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:58:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:58:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:58:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:58:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43821096
Sat 18 Jan 2014 15:58:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:58:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43821096
Sat 18 Jan 2014 15:58:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:58:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:58:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:58:58 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:58:59 - job_xml_thread(): Done retrieving: data size 43821096
Sat 18 Jan 2014 15:58:59 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:58:59 - XML: Start document: iteration 2
Sat 18 Jan 2014 15:59:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:59:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:59:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:59:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:59:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:59:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:59:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:59:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:59:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:59:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:59:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:59:11 - XML: Processed 655250 elements - found 522 jobs
Sat 18 Jan 2014 15:59:11 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 15:59:11 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 15:59:11 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:59:11 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:59:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:59:13 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:59:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:59:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:59:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:59:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:59:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:59:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:59:15 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:59:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 15:59:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:59:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:59:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43745111
Sat 18 Jan 2014 15:59:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:59:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43745111
Sat 18 Jan 2014 15:59:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:59:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:59:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:59:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:59:24 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:59:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:59:25 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:59:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 15:59:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 15:59:25 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:59:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5185 values 81739 bits 10217 bytes 
Sat 18 Jan 2014 15:59:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:59:26 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:59:26 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 15:59:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:59:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:59:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:59:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:59:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:59:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:59:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:59:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:59:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:59:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:59:30 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:59:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:59:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:59:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:59:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:59:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:59:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:59:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:59:32 - job_xml_thread(): Done retrieving: data size 43441112
Sat 18 Jan 2014 15:59:32 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 15:59:32 - XML: Start document: iteration 3
Sat 18 Jan 2014 15:59:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43441112
Sat 18 Jan 2014 15:59:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 15:59:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43441112
Sat 18 Jan 2014 15:59:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:59:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 15:59:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:59:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 15:59:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 15:59:52 - XML: Processed 650518 elements - found 521 jobs
Sat 18 Jan 2014 15:59:52 - job 7332010 appears to have finished
Sat 18 Jan 2014 15:59:52 - job 7349065 appears to have finished
Sat 18 Jan 2014 15:59:53 - job_xml_thread(): Found 3 updated jobs.
Sat 18 Jan 2014 15:59:53 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 15:59:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 15:59:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 15:59:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 15:59:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:59:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:59:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 15:59:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 15:59:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 15:59:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 15:59:54 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Sat 18 Jan 2014 15:59:54 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 15:59:54 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 15:59:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 15:59:57 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 15:59:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 15:59:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 15:59:57 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 15:59:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 15:59:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 15:59:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:59:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 15:59:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 15:59:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 15:59:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 15:59:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43161546
Sat 18 Jan 2014 15:59:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 15:59:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43161546
Sat 18 Jan 2014 15:59:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:00:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:00:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:00:09 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:00:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:00:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:00:11 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:00:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:00:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:00:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:00:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:00:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:00:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:00:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:00:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:00:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:00:13 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:00:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:00:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:00:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:00:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:00:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:00:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:00:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:00:15 - job_xml_thread(): Done retrieving: data size 43223524
Sat 18 Jan 2014 16:00:15 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:00:15 - XML: Start document: iteration 4
Sat 18 Jan 2014 16:00:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43223524
Sat 18 Jan 2014 16:00:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:00:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43223524
Sat 18 Jan 2014 16:00:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:00:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:00:25 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:00:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:00:26 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:00:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 16:00:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 16:00:26 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:00:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:00:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:00:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8949 values 141112 bits 17639 bytes 
Sat 18 Jan 2014 16:00:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:00:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:00:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:00:32 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:00:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:00:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:00:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:00:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:00:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:00:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:00:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:00:34 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 16:00:34 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:00:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:00:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:00:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:00:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:00:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:00:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:00:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:00:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:00:36 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:00:36 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:00:36 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 16:00:36 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 16:00:36 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 16:00:36 - XML: Processed 647722 elements - found 521 jobs
Sat 18 Jan 2014 16:00:36 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:00:36 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:00:36 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:00:36 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:00:37 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 1044188 values 16465554 bits 2058194 bytes 
Sat 18 Jan 2014 16:00:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:00:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43619136
Sat 18 Jan 2014 16:00:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:00:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43619136
Sat 18 Jan 2014 16:00:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:00:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:00:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:00:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:00:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:00:52 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:00:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:00:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:00:53 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:00:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:00:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:00:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:00:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:00:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:00:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:00:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:00:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:00:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:00:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:00:56 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:00:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 16:00:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:00:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:00:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:00:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:00:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:00:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:00:59 - job_xml_thread(): Done retrieving: data size 43812519
Sat 18 Jan 2014 16:00:59 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:00:59 - XML: Start document: iteration 5
Sat 18 Jan 2014 16:00:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43812519
Sat 18 Jan 2014 16:00:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:01:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43812519
Sat 18 Jan 2014 16:01:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:01:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:01:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:01:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:01:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:01:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:01:14 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:01:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:01:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:01:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:01:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:01:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:01:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:01:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:01:19 - XML: Processed 655196 elements - found 521 jobs
Sat 18 Jan 2014 16:01:19 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:01:19 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:01:19 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:01:19 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:01:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:01:22 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:01:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:01:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:01:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:01:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:01:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:01:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:01:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:01:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43803978
Sat 18 Jan 2014 16:01:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:01:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43803978
Sat 18 Jan 2014 16:01:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:01:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:01:26 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:01:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:01:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 16:01:27 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:01:27 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:01:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 16:01:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7188 values 113494 bits 14186 bytes 
Sat 18 Jan 2014 16:01:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:01:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:01:34 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:01:34 - job_xml_thread(): Done retrieving: data size 43803978
Sat 18 Jan 2014 16:01:34 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:01:34 - XML: Start document: iteration 6
Sat 18 Jan 2014 16:01:36 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:01:36 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 16:01:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:01:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:01:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:01:42 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:01:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:01:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:01:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:01:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:01:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:01:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:01:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:01:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:01:45 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:01:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:01:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:01:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:01:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:01:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:01:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:01:49 - XML: Processed 655240 elements - found 517 jobs
Sat 18 Jan 2014 16:01:49 - job 7332021 appears to have finished
Sat 18 Jan 2014 16:01:49 - job 7332015 appears to have finished
Sat 18 Jan 2014 16:01:49 - job 7333287 appears to have finished
Sat 18 Jan 2014 16:01:49 - job 7333286 appears to have finished
Sat 18 Jan 2014 16:01:49 - job 7349067 appears to have finished
Sat 18 Jan 2014 16:01:49 - job_xml_thread(): Found 6 updated jobs.
Sat 18 Jan 2014 16:01:49 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 16:01:49 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Sat 18 Jan 2014 16:01:49 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:01:49 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:01:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:01:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43833556
Sat 18 Jan 2014 16:01:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:01:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43833556
Sat 18 Jan 2014 16:01:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:01:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:01:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:02:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:02:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:02:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:02:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:02:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:02:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:02:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:02:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43833556
Sat 18 Jan 2014 16:02:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:02:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:02:04 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:02:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:02:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:02:14 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:02:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:02:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:02:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:02:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:02:16 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:02:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 16:02:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:02:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:02:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:02:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:02:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:02:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:02:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:02:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:02:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:02:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:02:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:02:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:02:18 - job_xml_thread(): Done retrieving: data size 43800364
Sat 18 Jan 2014 16:02:18 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:02:18 - XML: Start document: iteration 7
Sat 18 Jan 2014 16:02:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43800364
Sat 18 Jan 2014 16:02:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43800364
Sat 18 Jan 2014 16:02:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:02:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:02:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:02:28 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:02:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:02:28 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:02:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 16:02:29 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:02:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 16:02:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5868 values 92838 bits 11604 bytes 
Sat 18 Jan 2014 16:02:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:02:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:02:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:02:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:02:35 - XML: Processed 655240 elements - found 517 jobs
Sat 18 Jan 2014 16:02:35 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:02:35 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:02:35 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:02:35 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:02:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:02:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:02:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:02:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:02:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:02:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:02:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:02:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:02:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:02:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:02:41 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:02:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:02:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:02:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:02:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:02:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:02:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:02:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:02:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43829655
Sat 18 Jan 2014 16:02:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:02:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43829655
Sat 18 Jan 2014 16:02:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:02:50 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:02:50 - job_xml_thread(): Done retrieving: data size 43829655
Sat 18 Jan 2014 16:02:50 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:02:50 - XML: Start document: iteration 8
Sat 18 Jan 2014 16:02:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:02:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:02:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:02:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:03:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:03:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:03:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:03:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:03:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:03:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:03:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:03:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:03:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:03:05 - XML: Processed 655240 elements - found 517 jobs
Sat 18 Jan 2014 16:03:05 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:03:05 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:03:05 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:03:05 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:03:05 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:03:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 16:03:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:03:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:03:10 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:03:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:03:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:03:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:03:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:03:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:03:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:03:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:03:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43802682
Sat 18 Jan 2014 16:03:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:03:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43802682
Sat 18 Jan 2014 16:03:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:03:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:03:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:03:20 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:03:20 - job_xml_thread(): Done retrieving: data size 43802682
Sat 18 Jan 2014 16:03:20 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:03:20 - XML: Start document: iteration 9
Sat 18 Jan 2014 16:03:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:03:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:03:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:03:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:03:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:03:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:03:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:03:29 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:03:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:03:29 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:03:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 16:03:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:03:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:03:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:03:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 16:03:29 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:03:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:03:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:03:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5868 values 92752 bits 11594 bytes 
Sat 18 Jan 2014 16:03:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:03:33 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:03:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:03:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:03:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:03:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:03:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:03:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:03:35 - XML: Processed 655240 elements - found 517 jobs
Sat 18 Jan 2014 16:03:35 - job 7349071 report time 1390057235 does not match current heartbeat 1390057356 : ignoring job
Sat 18 Jan 2014 16:03:35 - job 7349069 appears to have finished
Sat 18 Jan 2014 16:03:35 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 16:03:35 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 16:03:35 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 16:03:35 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:03:35 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:03:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:03:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43823141
Sat 18 Jan 2014 16:03:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:03:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43823141
Sat 18 Jan 2014 16:03:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:03:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:03:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:03:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:03:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:03:50 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:03:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:03:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:03:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:03:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:03:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:03:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:03:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:03:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:03:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:03:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:03:56 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:03:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:03:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:03:56 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:03:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 16:03:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:03:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:03:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:03:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:03:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:03:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:03:59 - job_xml_thread(): Done retrieving: data size 43812811
Sat 18 Jan 2014 16:03:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43812811
Sat 18 Jan 2014 16:03:59 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:03:59 - XML: Start document: iteration 10
Sat 18 Jan 2014 16:03:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:04:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43812811
Sat 18 Jan 2014 16:04:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:04:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:04:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:04:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:04:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:04:15 - XML: Processed 655240 elements - found 517 jobs
Sat 18 Jan 2014 16:04:16 - job 7349071 report time 1390057235 does not match current heartbeat 1390057356 : ignoring job
Sat 18 Jan 2014 16:04:16 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:04:16 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:04:17 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:04:17 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:04:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:04:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:04:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:04:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:04:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:04:23 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:04:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:04:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:04:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:04:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:04:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:04:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:04:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:04:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:04:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:04:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:04:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:04:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:04:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43829527
Sat 18 Jan 2014 16:04:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:04:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43829527
Sat 18 Jan 2014 16:04:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:04:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:04:29 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:04:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:04:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 16:04:29 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:04:29 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:04:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 16:04:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6662 values 105067 bits 13133 bytes 
Sat 18 Jan 2014 16:04:32 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:04:32 - job_xml_thread(): Done retrieving: data size 43829527
Sat 18 Jan 2014 16:04:32 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:04:32 - XML: Start document: iteration 11
Sat 18 Jan 2014 16:04:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:04:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:04:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:04:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:04:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:04:44 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:04:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:04:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:04:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:04:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:04:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:04:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:04:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:04:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:04:50 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:04:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:04:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:04:51 - XML: Processed 655240 elements - found 517 jobs
Sat 18 Jan 2014 16:04:51 - job 7349071 report time 1390057235 does not match current heartbeat 1390057356 : ignoring job
Sat 18 Jan 2014 16:04:51 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:04:51 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:04:51 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:04:51 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:04:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:04:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:04:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:04:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:04:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:04:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43836280
Sat 18 Jan 2014 16:04:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:04:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43836280
Sat 18 Jan 2014 16:04:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:05:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:05:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:05:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:05:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:05:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:05:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:05:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:05:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:05:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:05:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:05:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43836280
Sat 18 Jan 2014 16:05:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:05:06 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:05:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:05:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:05:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:05:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:05:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:05:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:05:18 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:05:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:05:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:05:19 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:05:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 16:05:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:05:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:05:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:05:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:05:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:05:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:05:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:05:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:05:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:05:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:05:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:05:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:05:21 - job_xml_thread(): Done retrieving: data size 43745203
Sat 18 Jan 2014 16:05:21 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:05:21 - XML: Start document: iteration 12
Sat 18 Jan 2014 16:05:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43745203
Sat 18 Jan 2014 16:05:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:05:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43745203
Sat 18 Jan 2014 16:05:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:05:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:05:30 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:05:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:05:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 16:05:31 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:05:32 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:05:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 16:05:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5796 values 91427 bits 11428 bytes 
Sat 18 Jan 2014 16:05:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:05:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:05:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:05:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:05:37 - XML: Processed 654492 elements - found 517 jobs
Sat 18 Jan 2014 16:05:37 - job 7349073 report time 1390057356 does not match current heartbeat 1390057476 : ignoring job
Sat 18 Jan 2014 16:05:37 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 16:05:37 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 16:05:37 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 16:05:37 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:05:37 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:05:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:05:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:05:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:05:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:05:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:05:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:05:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:05:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:05:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:05:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:05:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:05:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:05:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:05:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:05:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:05:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:05:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:05:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:05:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43222948
Sat 18 Jan 2014 16:05:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:05:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43222948
Sat 18 Jan 2014 16:05:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:05:52 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:05:52 - job_xml_thread(): Done retrieving: data size 43222948
Sat 18 Jan 2014 16:05:52 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:05:52 - XML: Start document: iteration 13
Sat 18 Jan 2014 16:05:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:05:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:06:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:06:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:06:02 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:06:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 16:06:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:06:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:06:10 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:06:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:06:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:06:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:06:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:06:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:06:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:06:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:06:13 - XML: Processed 647662 elements - found 517 jobs
Sat 18 Jan 2014 16:06:13 - job 7349073 report time 1390057356 does not match current heartbeat 1390057476 : ignoring job
Sat 18 Jan 2014 16:06:13 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:06:14 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:06:14 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:06:14 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:06:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:06:14 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:06:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:06:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:06:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:06:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:06:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:06:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:06:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:06:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43229224
Sat 18 Jan 2014 16:06:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:06:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43229224
Sat 18 Jan 2014 16:06:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:06:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:06:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:06:29 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:06:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:06:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:06:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:06:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:06:31 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:06:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:06:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:06:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:06:32 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:06:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:06:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:06:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:06:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:06:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:06:32 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:06:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 16:06:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 16:06:32 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:06:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6128 values 96651 bits 12081 bytes 
Sat 18 Jan 2014 16:06:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:06:34 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:06:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:06:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:06:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:06:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:06:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:06:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:06:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:06:38 - job_xml_thread(): Done retrieving: data size 43389250
Sat 18 Jan 2014 16:06:38 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:06:38 - XML: Start document: iteration 14
Sat 18 Jan 2014 16:06:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43389250
Sat 18 Jan 2014 16:06:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:06:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43389250
Sat 18 Jan 2014 16:06:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:06:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:06:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:06:48 - XML: Processed 649877 elements - found 517 jobs
Sat 18 Jan 2014 16:06:48 - job 7349073 report time 1390057356 does not match current heartbeat 1390057476 : ignoring job
Sat 18 Jan 2014 16:06:48 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:06:48 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:06:48 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:06:48 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:06:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:06:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:06:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:06:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:06:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:06:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:06:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:06:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:06:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:06:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:06:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:07:01 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:07:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 16:07:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:07:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:07:02 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:07:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:07:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:07:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:07:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:07:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:07:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:07:03 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:07:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:07:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43827859
Sat 18 Jan 2014 16:07:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:07:05 - job_xml_thread(): Done retrieving: data size 43827859
Sat 18 Jan 2014 16:07:05 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:07:06 - XML: Start document: iteration 15
Sat 18 Jan 2014 16:07:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43827859
Sat 18 Jan 2014 16:07:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:07:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:07:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:07:16 - XML: Processed 655078 elements - found 517 jobs
Sat 18 Jan 2014 16:07:16 - job 7349073 report time 1390057356 does not match current heartbeat 1390057476 : ignoring job
Sat 18 Jan 2014 16:07:16 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:07:17 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:07:17 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:07:17 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:07:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:07:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:07:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:07:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:07:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:07:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:07:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:07:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:07:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:07:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:07:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:07:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:07:28 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:07:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:07:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:07:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:07:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:07:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:07:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:07:32 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:07:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:07:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43823823
Sat 18 Jan 2014 16:07:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:07:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:07:32 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:07:33 - job_xml_thread(): Done retrieving: data size 43823823
Sat 18 Jan 2014 16:07:33 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:07:33 - XML: Start document: iteration 16
Sat 18 Jan 2014 16:07:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43823823
Sat 18 Jan 2014 16:07:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:07:35 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:07:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 16:07:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:07:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 16:07:36 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:07:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9021 values 142306 bits 17788 bytes 
Sat 18 Jan 2014 16:07:37 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 16:07:37 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:07:39 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:07:39 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:07:39 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 16:07:39 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 16:07:39 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 16:07:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:07:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:07:42 - XML: Processed 655238 elements - found 516 jobs
Sat 18 Jan 2014 16:07:42 - job 7349039 appears to have finished
Sat 18 Jan 2014 16:07:42 - job 7349075 report time 1390057476 does not match current heartbeat 1390057597 : ignoring job
Sat 18 Jan 2014 16:07:42 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 16:07:42 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 16:07:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:07:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:07:43 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 16:07:43 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:07:43 - job_xml_thread(): Sleeping.. (15s)
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sat 18 Jan 2014 16:07:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:07:51 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:07:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:07:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:07:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:07:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:07:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:07:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:07:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:07:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:07:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:07:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:07:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:07:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:07:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:07:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:07:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:07:58 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:08:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:08:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43822165
Sat 18 Jan 2014 16:08:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:08:00 - job_xml_thread(): Done retrieving: data size 43822165
Sat 18 Jan 2014 16:08:00 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:08:00 - XML: Start document: iteration 17
Sat 18 Jan 2014 16:08:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43822165
Sat 18 Jan 2014 16:08:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:08:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:08:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:08:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:08:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:08:14 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:08:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 16:08:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:08:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:08:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:08:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:08:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:08:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:08:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:08:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:08:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:08:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:08:21 - XML: Processed 655238 elements - found 516 jobs
Sat 18 Jan 2014 16:08:21 - job 7349075 report time 1390057476 does not match current heartbeat 1390057597 : ignoring job
Sat 18 Jan 2014 16:08:21 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:08:21 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:08:21 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:08:21 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:08:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:08:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:08:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:08:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:08:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:08:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:08:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:08:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:08:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:08:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43809800
Sat 18 Jan 2014 16:08:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:08:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43809800
Sat 18 Jan 2014 16:08:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:08:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:08:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:08:36 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:08:36 - job_xml_thread(): Done retrieving: data size 43809800
Sat 18 Jan 2014 16:08:36 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:08:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:08:37 - XML: Start document: iteration 18
Sat 18 Jan 2014 16:08:37 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:08:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:08:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 16:08:38 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:08:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 16:08:38 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:08:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6183 values 97511 bits 12188 bytes 
Sat 18 Jan 2014 16:08:39 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:08:39 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:08:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:08:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:08:40 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:08:40 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 16:08:40 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:08:40 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 16:08:40 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 16:08:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:08:44 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:08:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:08:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:08:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:08:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:08:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:08:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:08:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:08:51 - size of cluster 'LISA Cluster': 624 hosts 79478 metrics 1180460 values 18627552 bits 2328444 bytes 
Sat 18 Jan 2014 16:08:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:08:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:08:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:08:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:08:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:08:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:08:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:08:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:08:58 - XML: Processed 655232 elements - found 516 jobs
Sat 18 Jan 2014 16:08:58 - job 7349075 report time 1390057476 does not match current heartbeat 1390057597 : ignoring job
Sat 18 Jan 2014 16:08:58 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:08:58 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:08:58 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:08:58 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:09:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:09:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:09:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:09:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43801425
Sat 18 Jan 2014 16:09:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:09:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43801425
Sat 18 Jan 2014 16:09:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:09:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:09:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:09:13 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:09:13 - job_xml_thread(): Done retrieving: data size 43801425
Sat 18 Jan 2014 16:09:13 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:09:13 - XML: Start document: iteration 19
Sat 18 Jan 2014 16:09:17 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:09:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 16:09:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:09:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:09:27 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:09:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:09:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:09:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:09:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:09:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:09:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:09:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:09:28 - XML: Processed 655238 elements - found 516 jobs
Sat 18 Jan 2014 16:09:29 - job 7349075 report time 1390057476 does not match current heartbeat 1390057597 : ignoring job
Sat 18 Jan 2014 16:09:29 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:09:29 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:09:29 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:09:29 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:09:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:09:30 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:09:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:09:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:09:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:09:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:09:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:09:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:09:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:09:38 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:09:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:09:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 16:09:38 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:09:38 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:09:38 - size of cluster 'Render Cluster': 20 hosts 3138 metrics 2913 values 45925 bits 5740 bytes 
Sat 18 Jan 2014 16:09:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 16:09:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:09:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43828877
Sat 18 Jan 2014 16:09:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:09:40 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:09:40 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 16:09:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43828877
Sat 18 Jan 2014 16:09:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:09:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:09:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:09:44 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:09:44 - job_xml_thread(): Done retrieving: data size 43828877
Sat 18 Jan 2014 16:09:44 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:09:44 - XML: Start document: iteration 20
Sat 18 Jan 2014 16:09:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:09:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:09:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:09:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:09:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:09:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:09:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:09:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:09:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:09:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:09:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:10:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:10:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:10:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:10:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:10:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:10:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:10:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:10:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:10:05 - XML: Processed 655235 elements - found 516 jobs
Sat 18 Jan 2014 16:10:05 - job 7349077 report time 1390057597 does not match current heartbeat 1390057717 : ignoring job
Sat 18 Jan 2014 16:10:05 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 16:10:05 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 16:10:06 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 16:10:06 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:10:06 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:10:12 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:10:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 16:10:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:10:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:10:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:10:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:10:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43795394
Sat 18 Jan 2014 16:10:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:10:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43795394
Sat 18 Jan 2014 16:10:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:10:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:10:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:10:21 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:10:21 - job_xml_thread(): Done retrieving: data size 43795394
Sat 18 Jan 2014 16:10:21 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:10:21 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 16:10:22 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 16:10:22 - Housekeeping: done.
Sat 18 Jan 2014 16:10:22 - XML: Start document: iteration 0
Sat 18 Jan 2014 16:10:36 - XML: Processed 655238 elements - found 516 jobs
Sat 18 Jan 2014 16:10:36 - job 7349077 report time 1390057597 does not match current heartbeat 1390057717 : ignoring job
Sat 18 Jan 2014 16:10:36 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:10:36 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:10:36 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:10:36 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:10:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:10:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:10:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:10:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:10:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:10:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:10:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:10:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:10:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:10:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:10:38 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:10:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:10:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:10:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:10:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:10:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:10:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:10:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:10:38 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:10:39 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:10:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 16:10:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:10:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 16:10:40 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:10:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 3639 values 57374 bits 7171 bytes 
Sat 18 Jan 2014 16:10:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:10:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43829872
Sat 18 Jan 2014 16:10:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:10:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43829872
Sat 18 Jan 2014 16:10:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:10:52 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:10:52 - job_xml_thread(): Done retrieving: data size 43829872
Sat 18 Jan 2014 16:10:52 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:10:52 - XML: Start document: iteration 1
Sat 18 Jan 2014 16:10:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:10:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:10:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:10:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:11:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:11:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:11:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:11:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:11:10 - XML: Processed 655238 elements - found 516 jobs
Sat 18 Jan 2014 16:11:10 - job 7349077 report time 1390057597 does not match current heartbeat 1390057717 : ignoring job
Sat 18 Jan 2014 16:11:10 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:11:10 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:11:10 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:11:10 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:11:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:11:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:11:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:11:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:11:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:11:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:11:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:11:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:11:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:11:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:11:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:11:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:11:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:11:20 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:11:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 16:11:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:11:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:11:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:11:26 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:11:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:11:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43741904
Sat 18 Jan 2014 16:11:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:11:28 - job_xml_thread(): Done retrieving: data size 43741904
Sat 18 Jan 2014 16:11:28 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:11:28 - XML: Start document: iteration 2
Sat 18 Jan 2014 16:11:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43741904
Sat 18 Jan 2014 16:11:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:11:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:11:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:11:37 - XML: Processed 654490 elements - found 516 jobs
Sat 18 Jan 2014 16:11:37 - job 7349079 report time 1390057717 does not match current heartbeat 1390057838 : ignoring job
Sat 18 Jan 2014 16:11:37 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 16:11:37 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 16:11:38 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 16:11:38 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:11:38 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:11:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:11:40 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:11:41 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:11:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:11:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 16:11:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 16:11:41 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:11:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5029 values 79227 bits 9903 bytes 
Sat 18 Jan 2014 16:11:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:11:46 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:11:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:11:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:11:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:11:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:11:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:11:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:11:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:11:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:11:50 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:11:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:11:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:11:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:11:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:11:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:11:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:11:53 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:11:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:11:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43165051
Sat 18 Jan 2014 16:11:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:11:57 - job_xml_thread(): Done retrieving: data size 43165051
Sat 18 Jan 2014 16:11:57 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:11:57 - XML: Start document: iteration 3
Sat 18 Jan 2014 16:11:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43165051
Sat 18 Jan 2014 16:11:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:12:01 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:12:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 16:12:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:12:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:12:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:12:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:12:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:12:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:12:11 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:12:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:12:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:12:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:12:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:12:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:12:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:12:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:12:15 - XML: Processed 647284 elements - found 516 jobs
Sat 18 Jan 2014 16:12:15 - job 7349079 report time 1390057717 does not match current heartbeat 1390057838 : ignoring job
Sat 18 Jan 2014 16:12:15 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:12:15 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:12:15 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:12:15 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:12:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:12:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:12:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:12:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:12:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:12:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:12:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:12:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:12:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:12:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43220835
Sat 18 Jan 2014 16:12:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:12:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43220835
Sat 18 Jan 2014 16:12:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:12:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:12:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:12:30 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:12:30 - job_xml_thread(): Done retrieving: data size 43220835
Sat 18 Jan 2014 16:12:30 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:12:30 - XML: Start document: iteration 4
Sat 18 Jan 2014 16:12:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:12:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:12:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:12:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:12:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:12:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:12:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:12:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:12:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:12:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:12:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:12:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:12:41 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:12:43 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:12:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 16:12:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:12:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 16:12:43 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:12:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6109 values 96351 bits 12043 bytes 
Sat 18 Jan 2014 16:12:47 - XML: Processed 647712 elements - found 516 jobs
Sat 18 Jan 2014 16:12:47 - job 7349079 report time 1390057717 does not match current heartbeat 1390057838 : ignoring job
Sat 18 Jan 2014 16:12:47 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:12:47 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:12:47 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:12:47 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:12:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:12:48 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:12:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:12:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:12:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:12:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:12:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:12:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:12:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:12:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:12:54 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 16:12:54 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 16:12:54 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:12:54 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:12:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 16:12:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:12:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:12:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43757245
Sat 18 Jan 2014 16:12:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:12:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43757245
Sat 18 Jan 2014 16:12:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:13:02 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:13:02 - job_xml_thread(): Done retrieving: data size 43757245
Sat 18 Jan 2014 16:13:02 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:13:02 - XML: Start document: iteration 5
Sat 18 Jan 2014 16:13:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:13:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:13:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:13:11 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:13:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:13:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:13:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:13:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:13:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:13:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:13:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:13:17 - XML: Processed 654794 elements - found 516 jobs
Sat 18 Jan 2014 16:13:17 - job 7349079 report time 1390057717 does not match current heartbeat 1390057838 : ignoring job
Sat 18 Jan 2014 16:13:17 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:13:17 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:13:17 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:13:17 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:13:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:13:18 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:13:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:13:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:13:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:13:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:13:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:13:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:13:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:13:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43815885
Sat 18 Jan 2014 16:13:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:13:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43815885
Sat 18 Jan 2014 16:13:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:13:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:13:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:13:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:13:31 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:13:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:13:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:13:32 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:13:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:13:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:13:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:13:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:13:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:13:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:13:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:13:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:13:35 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:13:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:13:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:13:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:13:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:13:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:13:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:13:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:13:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43820876
Sat 18 Jan 2014 16:13:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:13:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43820876
Sat 18 Jan 2014 16:13:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:13:39 - job_xml_thread(): Done retrieving: data size 43820876
Sat 18 Jan 2014 16:13:39 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:13:39 - XML: Start document: iteration 6
Sat 18 Jan 2014 16:13:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:13:45 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:13:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:13:48 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:13:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:13:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:13:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 16:13:48 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:13:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 16:13:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148597 bits 18574 bytes 
Sat 18 Jan 2014 16:13:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:13:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:13:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:13:53 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:13:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:13:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:13:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:13:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:13:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:13:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:13:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:13:54 - XML: Processed 655238 elements - found 516 jobs
Sat 18 Jan 2014 16:13:54 - job 7348962 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 16:13:54 - job 7349081 report time 1390057838 does not match current heartbeat 1390057958 : ignoring job
Sat 18 Jan 2014 16:13:54 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 16:13:54 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 16:13:55 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 16:13:55 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:13:55 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:14:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:14:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:14:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:14:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:14:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:14:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:14:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:14:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:14:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:14:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43821145
Sat 18 Jan 2014 16:14:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:14:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43821145
Sat 18 Jan 2014 16:14:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:14:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:14:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:14:10 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:14:10 - job_xml_thread(): Done retrieving: data size 43821145
Sat 18 Jan 2014 16:14:10 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:14:10 - XML: Start document: iteration 7
Sat 18 Jan 2014 16:14:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:14:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:14:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:14:18 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:14:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:14:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:14:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:14:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:14:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:14:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:14:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:14:25 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:14:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 16:14:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:14:26 - XML: Processed 655238 elements - found 516 jobs
Sat 18 Jan 2014 16:14:26 - job 7349081 report time 1390057838 does not match current heartbeat 1390057958 : ignoring job
Sat 18 Jan 2014 16:14:26 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:14:26 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:14:26 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:14:26 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:14:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:14:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:14:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:14:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:14:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:14:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:14:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:14:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:14:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:14:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43817133
Sat 18 Jan 2014 16:14:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:14:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43817133
Sat 18 Jan 2014 16:14:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:14:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:14:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:14:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:14:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:14:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:14:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:14:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:14:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:14:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43817133
Sat 18 Jan 2014 16:14:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:14:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:14:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:14:41 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:14:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:14:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:14:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:14:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:14:47 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:14:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:14:49 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:14:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:14:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 16:14:49 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:14:49 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:14:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 16:14:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5914 values 93256 bits 11657 bytes 
Sat 18 Jan 2014 16:14:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:14:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:14:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:14:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:14:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:14:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:14:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:14:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:14:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:14:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:14:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:14:54 - job_xml_thread(): Done retrieving: data size 43800270
Sat 18 Jan 2014 16:14:54 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:14:54 - XML: Start document: iteration 8
Sat 18 Jan 2014 16:14:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43800270
Sat 18 Jan 2014 16:14:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:14:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:14:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:14:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:14:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:14:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43800270
Sat 18 Jan 2014 16:14:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:15:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:15:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:15:10 - XML: Processed 655238 elements - found 516 jobs
Sat 18 Jan 2014 16:15:10 - job 7349081 report time 1390057838 does not match current heartbeat 1390057958 : ignoring job
Sat 18 Jan 2014 16:15:10 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:15:10 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:15:10 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:15:10 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:15:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:15:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:15:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:15:14 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:15:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:15:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:15:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:15:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:15:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:15:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:15:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:15:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:15:18 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:15:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:15:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:15:18 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:15:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 16:15:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:15:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:15:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:15:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:15:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:15:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:15:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43837958
Sat 18 Jan 2014 16:15:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:15:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43837958
Sat 18 Jan 2014 16:15:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:15:25 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:15:25 - job_xml_thread(): Done retrieving: data size 43837958
Sat 18 Jan 2014 16:15:25 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:15:25 - XML: Start document: iteration 9
Sat 18 Jan 2014 16:15:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:15:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:15:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:15:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:15:37 - XML: Processed 655238 elements - found 516 jobs
Sat 18 Jan 2014 16:15:37 - job 7349083 report time 1390057958 does not match current heartbeat 1390058079 : ignoring job
Sat 18 Jan 2014 16:15:37 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 16:15:37 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 16:15:37 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 16:15:37 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:15:37 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:15:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:15:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:15:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:15:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:15:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:15:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:15:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:15:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:15:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:15:40 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 16:15:40 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:15:41 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:15:41 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:15:41 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 16:15:41 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 16:15:41 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 16:15:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:15:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:15:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:15:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:15:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:15:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:15:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:15:44 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 648410 values 10221550 bits 1277693 bytes 
Sat 18 Jan 2014 16:15:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:15:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:15:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43825385
Sat 18 Jan 2014 16:15:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:15:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43825385
Sat 18 Jan 2014 16:15:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:15:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:15:49 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:15:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:15:49 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:15:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 16:15:49 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:15:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 16:15:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8763 values 138145 bits 17268 bytes 
Sat 18 Jan 2014 16:15:52 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:15:52 - job_xml_thread(): Done retrieving: data size 43825385
Sat 18 Jan 2014 16:15:52 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:15:52 - XML: Start document: iteration 10
Sat 18 Jan 2014 16:15:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:15:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:15:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:15:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:16:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:16:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:16:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:16:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:16:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:16:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:16:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:16:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:16:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:16:06 - XML: Processed 655238 elements - found 516 jobs
Sat 18 Jan 2014 16:16:06 - job 7349083 report time 1390057958 does not match current heartbeat 1390058079 : ignoring job
Sat 18 Jan 2014 16:16:06 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:16:06 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:16:06 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:16:06 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:16:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:16:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:16:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:16:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:16:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:16:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:16:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:16:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:16:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:16:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43832312
Sat 18 Jan 2014 16:16:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:16:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43832312
Sat 18 Jan 2014 16:16:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:16:17 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:16:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 16:16:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:16:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:16:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:16:21 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:16:21 - job_xml_thread(): Done retrieving: data size 43832312
Sat 18 Jan 2014 16:16:21 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:16:21 - XML: Start document: iteration 11
Sat 18 Jan 2014 16:16:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:16:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:16:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:16:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:16:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:16:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:16:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:16:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:16:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:16:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:16:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:16:32 - XML: Processed 655238 elements - found 516 jobs
Sat 18 Jan 2014 16:16:32 - job 7349083 report time 1390057958 does not match current heartbeat 1390058079 : ignoring job
Sat 18 Jan 2014 16:16:32 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:16:32 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:16:32 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:16:32 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:16:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:16:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:16:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:16:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:16:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:16:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:16:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:16:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:16:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:16:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43806702
Sat 18 Jan 2014 16:16:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:16:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43806702
Sat 18 Jan 2014 16:16:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:16:41 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:16:41 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 16:16:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:16:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:16:47 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:16:47 - job_xml_thread(): Done retrieving: data size 43806702
Sat 18 Jan 2014 16:16:47 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:16:47 - XML: Start document: iteration 12
Sat 18 Jan 2014 16:16:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:16:49 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:16:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:16:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 16:16:50 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:16:50 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:16:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 16:16:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6143 values 97109 bits 12138 bytes 
Sat 18 Jan 2014 16:16:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:16:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:16:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:16:56 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:16:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:16:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:16:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:16:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:16:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:16:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:16:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:16:59 - XML: Processed 655238 elements - found 516 jobs
Sat 18 Jan 2014 16:16:59 - job 7349083 report time 1390057958 does not match current heartbeat 1390058079 : ignoring job
Sat 18 Jan 2014 16:16:59 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:16:59 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:16:59 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:16:59 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:17:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:17:04 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:17:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:17:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:17:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:17:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:17:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:17:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:17:08 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:17:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 16:17:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:17:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:17:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43825303
Sat 18 Jan 2014 16:17:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:17:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43825303
Sat 18 Jan 2014 16:17:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:17:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:17:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:17:14 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:17:14 - job_xml_thread(): Done retrieving: data size 43825303
Sat 18 Jan 2014 16:17:14 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:17:14 - XML: Start document: iteration 13
Sat 18 Jan 2014 16:17:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:17:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:17:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:17:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:17:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:17:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:17:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:17:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:17:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:17:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:17:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:17:30 - XML: Processed 655233 elements - found 516 jobs
Sat 18 Jan 2014 16:17:30 - job 7349083 report time 1390057958 does not match current heartbeat 1390058079 : ignoring job
Sat 18 Jan 2014 16:17:30 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:17:30 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:17:30 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:17:30 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:17:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:17:31 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:17:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:17:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:17:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:17:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:17:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:17:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:17:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:17:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43756018
Sat 18 Jan 2014 16:17:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:17:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:17:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:17:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43756018
Sat 18 Jan 2014 16:17:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:17:46 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:17:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:17:46 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:17:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:17:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:17:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:17:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:17:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:17:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:17:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:17:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:17:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:17:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:17:51 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:17:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:17:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:17:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:17:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:17:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:17:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:17:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:17:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:17:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:17:51 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:17:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 16:17:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 16:17:51 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:17:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99399 bits 12424 bytes 
Sat 18 Jan 2014 16:17:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:17:55 - job_xml_thread(): Done retrieving: data size 43176774
Sat 18 Jan 2014 16:17:55 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:17:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43176774
Sat 18 Jan 2014 16:17:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:17:55 - XML: Start document: iteration 14
Sat 18 Jan 2014 16:17:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43176774
Sat 18 Jan 2014 16:17:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:18:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:18:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:18:06 - XML: Processed 647380 elements - found 517 jobs
Sat 18 Jan 2014 16:18:06 - job 7349085 report time 1390058079 does not match current heartbeat 1390058199 : ignoring job
Sat 18 Jan 2014 16:18:06 - job 7347695 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 16:18:06 - job_xml_thread(): Found 3 updated jobs.
Sat 18 Jan 2014 16:18:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:18:06 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 16:18:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:18:06 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Sat 18 Jan 2014 16:18:06 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:18:07 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:18:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:18:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:18:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:18:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:18:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:18:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:18:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:18:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:18:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:18:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:18:18 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:18:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:18:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:18:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:18:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:18:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:18:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:18:18 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:18:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 16:18:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:18:22 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:18:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:18:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43231043
Sat 18 Jan 2014 16:18:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:18:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43231043
Sat 18 Jan 2014 16:18:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:18:23 - job_xml_thread(): Done retrieving: data size 43231043
Sat 18 Jan 2014 16:18:23 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:18:23 - XML: Start document: iteration 15
Sat 18 Jan 2014 16:18:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:18:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:18:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:18:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:18:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:18:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:18:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:18:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:18:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:18:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:18:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:18:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:18:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:18:39 - XML: Processed 647785 elements - found 517 jobs
Sat 18 Jan 2014 16:18:39 - job 7349085 report time 1390058079 does not match current heartbeat 1390058199 : ignoring job
Sat 18 Jan 2014 16:18:39 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:18:39 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:18:39 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:18:39 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:18:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:18:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:18:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:18:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:18:45 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 16:18:45 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 16:18:45 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:18:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:18:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:18:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:18:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:18:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:18:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43741441
Sat 18 Jan 2014 16:18:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:18:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43741441
Sat 18 Jan 2014 16:18:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:18:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:18:52 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:18:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:18:53 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:18:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 16:18:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:18:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:18:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 16:18:54 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:18:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8690 values 137196 bits 17149 bytes 
Sat 18 Jan 2014 16:18:54 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:18:55 - job_xml_thread(): Done retrieving: data size 43741441
Sat 18 Jan 2014 16:18:55 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:18:55 - XML: Start document: iteration 16
Sat 18 Jan 2014 16:18:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:18:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:18:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:18:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:19:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:19:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:19:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:19:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:19:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:19:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:19:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:19:08 - XML: Processed 654057 elements - found 517 jobs
Sat 18 Jan 2014 16:19:08 - job 7349085 report time 1390058079 does not match current heartbeat 1390058199 : ignoring job
Sat 18 Jan 2014 16:19:08 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:19:08 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:19:08 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:19:08 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:19:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:19:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:19:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:19:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:19:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:19:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:19:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:19:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:19:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:19:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43798701
Sat 18 Jan 2014 16:19:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:19:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43798701
Sat 18 Jan 2014 16:19:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:19:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:19:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:19:23 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:19:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:19:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:19:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:19:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:19:26 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:19:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:19:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:19:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:19:27 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:19:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:19:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:19:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:19:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:19:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:19:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:19:27 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:19:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 16:19:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:19:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:19:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:19:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:19:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:19:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:19:30 - job_xml_thread(): Done retrieving: data size 43834916
Sat 18 Jan 2014 16:19:30 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:19:30 - XML: Start document: iteration 17
Sat 18 Jan 2014 16:19:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43834916
Sat 18 Jan 2014 16:19:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:19:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43834916
Sat 18 Jan 2014 16:19:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:19:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:19:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:19:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:19:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:19:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:19:48 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:19:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:19:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:19:49 - XML: Processed 655238 elements - found 516 jobs
Sat 18 Jan 2014 16:19:49 - job 7349087 report time 1390058199 does not match current heartbeat 1390058320 : ignoring job
Sat 18 Jan 2014 16:19:49 - job 7335140 appears to have finished
Sat 18 Jan 2014 16:19:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:19:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:19:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:19:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:19:49 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 16:19:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:19:49 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 16:19:49 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 16:19:49 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:19:49 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:19:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:19:53 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:19:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:19:54 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:19:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:19:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:19:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:19:54 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:19:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 16:19:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 16:19:54 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:19:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5725 values 90275 bits 11284 bytes 
Sat 18 Jan 2014 16:19:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:19:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:19:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:19:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:19:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:19:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43818975
Sat 18 Jan 2014 16:19:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:19:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43818975
Sat 18 Jan 2014 16:19:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:20:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:20:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:20:05 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:20:05 - job_xml_thread(): Done retrieving: data size 43818975
Sat 18 Jan 2014 16:20:05 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:20:05 - XML: Start document: iteration 18
Sat 18 Jan 2014 16:20:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:20:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:20:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:20:11 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:20:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:20:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:20:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:20:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:20:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:20:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:20:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:20:18 - XML: Processed 655238 elements - found 516 jobs
Sat 18 Jan 2014 16:20:18 - job 7349087 report time 1390058199 does not match current heartbeat 1390058320 : ignoring job
Sat 18 Jan 2014 16:20:18 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:20:18 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:20:18 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:20:18 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:20:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:20:19 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:20:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:20:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:20:20 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:20:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 16:20:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:20:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:20:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:20:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:20:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:20:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:20:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43802474
Sat 18 Jan 2014 16:20:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:20:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43802474
Sat 18 Jan 2014 16:20:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:20:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:20:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:20:33 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:20:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:20:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:20:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:20:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:20:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:20:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:20:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:20:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:20:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:20:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:20:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:20:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:20:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:20:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:20:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:20:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:20:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:20:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:20:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:20:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:20:38 - job_xml_thread(): Done retrieving: data size 43816571
Sat 18 Jan 2014 16:20:38 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:20:38 - XML: Start document: iteration 19
Sat 18 Jan 2014 16:20:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43816571
Sat 18 Jan 2014 16:20:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:20:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43816571
Sat 18 Jan 2014 16:20:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:20:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:20:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:20:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:20:51 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:20:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:20:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:20:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:20:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:20:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:20:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:20:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:20:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:20:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:20:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:20:54 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:20:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:20:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 16:20:55 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:20:55 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:20:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 16:20:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8325 values 131297 bits 16412 bytes 
Sat 18 Jan 2014 16:20:56 - XML: Processed 655238 elements - found 516 jobs
Sat 18 Jan 2014 16:20:56 - job 7349087 report time 1390058199 does not match current heartbeat 1390058320 : ignoring job
Sat 18 Jan 2014 16:20:56 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:20:56 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:20:56 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:20:56 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:21:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:21:02 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:21:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:21:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:21:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:21:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:21:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:21:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:21:04 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 16:21:04 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 16:21:04 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:21:05 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:21:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 16:21:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:21:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:21:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43821992
Sat 18 Jan 2014 16:21:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:21:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43821992
Sat 18 Jan 2014 16:21:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:21:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:21:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:21:11 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:21:11 - job_xml_thread(): Done retrieving: data size 43821992
Sat 18 Jan 2014 16:21:12 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:21:12 - XML: Start document: iteration 20
Sat 18 Jan 2014 16:21:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:21:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:21:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:21:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:21:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:21:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:21:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:21:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:21:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:21:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:21:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:21:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:21:21 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:21:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:21:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:21:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:21:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:21:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:21:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:21:24 - XML: Processed 655238 elements - found 516 jobs
Sat 18 Jan 2014 16:21:24 - job 7349087 report time 1390058199 does not match current heartbeat 1390058320 : ignoring job
Sat 18 Jan 2014 16:21:24 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:21:24 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:21:24 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:21:24 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:21:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:21:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43819487
Sat 18 Jan 2014 16:21:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:21:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43819487
Sat 18 Jan 2014 16:21:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:21:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:21:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:21:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:21:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:21:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:21:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:21:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:21:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:21:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:21:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:21:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:21:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:21:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:21:39 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:21:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:21:40 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:21:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:21:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:21:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:21:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:21:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:21:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:21:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:21:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43839268
Sat 18 Jan 2014 16:21:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:21:42 - job_xml_thread(): Done retrieving: data size 43839268
Sat 18 Jan 2014 16:21:42 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:21:42 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 16:21:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43839268
Sat 18 Jan 2014 16:21:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:21:43 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 16:21:43 - Housekeeping: done.
Sat 18 Jan 2014 16:21:43 - XML: Start document: iteration 0
Sat 18 Jan 2014 16:21:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:21:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:21:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:21:55 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:21:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:21:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:21:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:21:56 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:21:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:21:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:21:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 16:21:57 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:21:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:21:57 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:21:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 16:21:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148568 bits 18571 bytes 
Sat 18 Jan 2014 16:21:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:21:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:21:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:21:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:21:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:22:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:22:04 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:22:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:22:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:22:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:22:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:22:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:22:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:22:06 - XML: Processed 655238 elements - found 516 jobs
Sat 18 Jan 2014 16:22:06 - job 7349089 report time 1390058320 does not match current heartbeat 1390058440 : ignoring job
Sat 18 Jan 2014 16:22:06 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 16:22:06 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 16:22:06 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 16:22:06 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:22:06 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:22:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:22:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43797917
Sat 18 Jan 2014 16:22:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:22:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43797917
Sat 18 Jan 2014 16:22:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:22:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:22:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:22:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:22:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:22:21 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:22:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:22:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:22:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:22:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:22:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:22:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:22:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:22:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:22:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:22:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:22:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:22:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:22:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:22:24 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:22:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 16:22:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:22:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:22:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:22:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:22:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:22:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:22:26 - job_xml_thread(): Done retrieving: data size 43835600
Sat 18 Jan 2014 16:22:26 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:22:26 - XML: Start document: iteration 1
Sat 18 Jan 2014 16:22:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43835600
Sat 18 Jan 2014 16:22:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43835600
Sat 18 Jan 2014 16:22:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:22:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:22:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:22:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:22:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:22:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:22:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:22:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:22:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:22:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:22:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:22:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:22:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:22:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:22:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:22:41 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 16:22:41 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:22:41 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:22:41 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:22:41 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 16:22:41 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 16:22:41 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 16:22:44 - XML: Processed 655238 elements - found 516 jobs
Sat 18 Jan 2014 16:22:44 - job 7349089 report time 1390058320 does not match current heartbeat 1390058440 : ignoring job
Sat 18 Jan 2014 16:22:45 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:22:45 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:22:45 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:22:45 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:22:48 - size of cluster 'LISA Cluster': 624 hosts 79485 metrics 714006 values 11260709 bits 1407588 bytes 
Sat 18 Jan 2014 16:22:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:22:49 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:22:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:22:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:22:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:22:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:22:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:22:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:22:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:22:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43803148
Sat 18 Jan 2014 16:22:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:22:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43803148
Sat 18 Jan 2014 16:22:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:22:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:22:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:22:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:22:57 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:22:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:22:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 16:22:58 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:22:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 16:22:58 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:22:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8679 values 136886 bits 17110 bytes 
Sat 18 Jan 2014 16:23:00 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:23:00 - job_xml_thread(): Done retrieving: data size 43803148
Sat 18 Jan 2014 16:23:00 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:23:00 - XML: Start document: iteration 2
Sat 18 Jan 2014 16:23:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:23:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:23:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:23:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:23:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:23:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:23:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:23:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:23:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:23:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:23:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:23:13 - XML: Processed 655238 elements - found 516 jobs
Sat 18 Jan 2014 16:23:13 - job 7349089 report time 1390058320 does not match current heartbeat 1390058440 : ignoring job
Sat 18 Jan 2014 16:23:13 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:23:13 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:23:13 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:23:13 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:23:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:23:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:23:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:23:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:23:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:23:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:23:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:23:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:23:20 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:23:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 16:23:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:23:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:23:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43735313
Sat 18 Jan 2014 16:23:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:23:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:23:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:23:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43735313
Sat 18 Jan 2014 16:23:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:23:28 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:23:28 - job_xml_thread(): Done retrieving: data size 43735313
Sat 18 Jan 2014 16:23:28 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:23:28 - XML: Start document: iteration 3
Sat 18 Jan 2014 16:23:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:23:32 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:23:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:23:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:23:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:23:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:23:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:23:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:23:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:23:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:23:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:23:41 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:23:41 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 16:23:44 - XML: Processed 654492 elements - found 517 jobs
Sat 18 Jan 2014 16:23:44 - job 7349091 report time 1390058440 does not match current heartbeat 1390058561 : ignoring job
Sat 18 Jan 2014 16:23:44 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 16:23:44 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 16:23:44 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 16:23:44 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:23:44 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:23:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:23:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:23:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:23:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:23:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:23:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:23:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:23:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:23:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:23:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43238167
Sat 18 Jan 2014 16:23:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:23:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43238167
Sat 18 Jan 2014 16:23:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:23:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:23:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:23:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:23:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:23:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:23:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:23:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:23:58 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:23:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:23:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:23:59 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:23:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 16:23:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:23:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:23:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:23:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:23:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 16:23:59 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:23:59 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99052 bits 12381 bytes 
Sat 18 Jan 2014 16:23:59 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:24:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:24:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:24:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:24:02 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:24:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:24:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:24:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:24:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:24:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:24:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:24:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:24:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43184353
Sat 18 Jan 2014 16:24:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:24:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43184353
Sat 18 Jan 2014 16:24:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:24:07 - job_xml_thread(): Done retrieving: data size 43184353
Sat 18 Jan 2014 16:24:07 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:24:07 - XML: Start document: iteration 4
Sat 18 Jan 2014 16:24:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:24:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:24:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:24:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:24:21 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:24:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 16:24:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:24:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:24:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:24:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:24:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:24:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:24:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:24:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:24:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:24:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:24:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:24:28 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:24:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:24:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:24:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:24:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:24:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:24:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:24:29 - XML: Processed 647284 elements - found 517 jobs
Sat 18 Jan 2014 16:24:29 - job 7349091 report time 1390058440 does not match current heartbeat 1390058561 : ignoring job
Sat 18 Jan 2014 16:24:29 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:24:29 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:24:29 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:24:29 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:24:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:24:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43234632
Sat 18 Jan 2014 16:24:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:24:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43234632
Sat 18 Jan 2014 16:24:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:24:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:24:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:24:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:24:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:24:44 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:24:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:24:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:24:45 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:24:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:24:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:24:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:24:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:24:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:24:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:24:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:24:48 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:24:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:24:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:24:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:24:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:24:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:24:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:24:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:24:50 - job_xml_thread(): Done retrieving: data size 43761430
Sat 18 Jan 2014 16:24:50 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:24:50 - XML: Start document: iteration 5
Sat 18 Jan 2014 16:24:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43761430
Sat 18 Jan 2014 16:24:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:24:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43761430
Sat 18 Jan 2014 16:24:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:24:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:24:59 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:25:00 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:25:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 16:25:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:25:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 16:25:00 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:25:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8977 values 141521 bits 17690 bytes 
Sat 18 Jan 2014 16:25:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:25:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:25:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:25:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:25:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:25:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:25:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:25:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:25:10 - XML: Processed 654394 elements - found 517 jobs
Sat 18 Jan 2014 16:25:10 - job 7349091 report time 1390058440 does not match current heartbeat 1390058561 : ignoring job
Sat 18 Jan 2014 16:25:10 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:25:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:25:10 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:25:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:25:10 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:25:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:25:10 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:25:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:25:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:25:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:25:12 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:25:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:25:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:25:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:25:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:25:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:25:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:25:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:25:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43832919
Sat 18 Jan 2014 16:25:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:25:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43832919
Sat 18 Jan 2014 16:25:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:25:25 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:25:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:25:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:25:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:25:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:25:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:25:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:25:29 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:25:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:25:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:25:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:25:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:25:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:25:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:25:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:25:31 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:25:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:25:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:25:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:25:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:25:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:25:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:25:32 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:25:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 16:25:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:25:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:25:34 - job_xml_thread(): Done retrieving: data size 43821365
Sat 18 Jan 2014 16:25:34 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:25:34 - XML: Start document: iteration 6
Sat 18 Jan 2014 16:25:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43821365
Sat 18 Jan 2014 16:25:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:25:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43821365
Sat 18 Jan 2014 16:25:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:25:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:25:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:25:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:25:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:25:49 - XML: Processed 655244 elements - found 519 jobs
Sat 18 Jan 2014 16:25:49 - job 7349094 report time 1390058561 does not match current heartbeat 1390058681 : ignoring job
Sat 18 Jan 2014 16:25:50 - job_xml_thread(): Found 3 updated jobs.
Sat 18 Jan 2014 16:25:50 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 16:25:54 - job_xml_thread(): Done storing. succesfully stored: 3 jobs
Sat 18 Jan 2014 16:25:54 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:25:54 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:25:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:25:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:25:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:25:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:25:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:25:56 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:25:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:25:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:25:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:25:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:25:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:25:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:25:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:25:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:25:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:25:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:25:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:26:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:26:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43833897
Sat 18 Jan 2014 16:26:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:26:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:26:01 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:26:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:26:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 16:26:01 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:26:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43833897
Sat 18 Jan 2014 16:26:01 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:26:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:26:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 16:26:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7908 values 124687 bits 15585 bytes 
Sat 18 Jan 2014 16:26:09 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:26:09 - job_xml_thread(): Done retrieving: data size 43833897
Sat 18 Jan 2014 16:26:09 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:26:09 - XML: Start document: iteration 7
Sat 18 Jan 2014 16:26:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:26:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:26:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:26:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:26:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:26:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:26:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:26:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:26:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:26:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:26:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:26:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:26:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:26:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:26:21 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:26:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:26:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:26:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:26:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:26:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:26:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:26:24 - XML: Processed 655244 elements - found 519 jobs
Sat 18 Jan 2014 16:26:24 - job 7349094 report time 1390058561 does not match current heartbeat 1390058681 : ignoring job
Sat 18 Jan 2014 16:26:24 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:26:24 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:26:24 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:26:24 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:26:26 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 16:26:26 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 16:26:26 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:26:27 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:26:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 16:26:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:26:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:26:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43819486
Sat 18 Jan 2014 16:26:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:26:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43819486
Sat 18 Jan 2014 16:26:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:26:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:26:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:26:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:26:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:26:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:26:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:26:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:26:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:26:39 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:26:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:26:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:26:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:26:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:26:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:26:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:26:41 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:26:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:26:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:26:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:26:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:26:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:26:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:26:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:26:43 - job_xml_thread(): Done retrieving: data size 43844758
Sat 18 Jan 2014 16:26:43 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:26:43 - XML: Start document: iteration 8
Sat 18 Jan 2014 16:26:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43844758
Sat 18 Jan 2014 16:26:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:26:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43844758
Sat 18 Jan 2014 16:26:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:26:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:26:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:26:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:26:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:27:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:27:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:27:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:27:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:27:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:27:01 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:27:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:27:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:27:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:27:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:27:02 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:27:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:27:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:27:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 16:27:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 16:27:02 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:27:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6128 values 96608 bits 12076 bytes 
Sat 18 Jan 2014 16:27:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:27:04 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:27:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:27:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:27:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:27:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:27:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:27:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:27:05 - XML: Processed 655244 elements - found 519 jobs
Sat 18 Jan 2014 16:27:05 - job 7349094 report time 1390058561 does not match current heartbeat 1390058681 : ignoring job
Sat 18 Jan 2014 16:27:05 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:27:05 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:27:05 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:27:05 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:27:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:27:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43819472
Sat 18 Jan 2014 16:27:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:27:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43819472
Sat 18 Jan 2014 16:27:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:27:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:27:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:27:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:27:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:27:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:27:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:27:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:27:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:27:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:27:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:27:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:27:20 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:27:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:27:22 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:27:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:27:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:27:22 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:27:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 16:27:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:27:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:27:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:27:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:27:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:27:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:27:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43821241
Sat 18 Jan 2014 16:27:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:27:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43821241
Sat 18 Jan 2014 16:27:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:27:24 - job_xml_thread(): Done retrieving: data size 43821241
Sat 18 Jan 2014 16:27:24 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:27:24 - XML: Start document: iteration 9
Sat 18 Jan 2014 16:27:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:27:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:27:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:27:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:27:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:27:43 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:27:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:27:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:27:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:27:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:27:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:27:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:27:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:27:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:27:46 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:27:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:27:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:27:47 - XML: Processed 655244 elements - found 519 jobs
Sat 18 Jan 2014 16:27:47 - job 7348398 appears to have finished
Sat 18 Jan 2014 16:27:47 - job 7337092 appears to have finished
Sat 18 Jan 2014 16:27:47 - job 7349098 report time 1390058681 does not match current heartbeat 1390058802 : ignoring job
Sat 18 Jan 2014 16:27:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:27:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:27:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:27:47 - job_xml_thread(): Found 5 updated jobs.
Sat 18 Jan 2014 16:27:47 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 16:27:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:27:47 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Sat 18 Jan 2014 16:27:47 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:27:47 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:27:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:27:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43835054
Sat 18 Jan 2014 16:27:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:27:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43835054
Sat 18 Jan 2014 16:27:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:27:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:27:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:28:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:28:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:28:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:28:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:28:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:28:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:28:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:28:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:28:01 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:28:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:28:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:28:02 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:28:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:28:02 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:28:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:28:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:28:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:28:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:28:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:28:03 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:28:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 16:28:03 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:28:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 16:28:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9154 values 144398 bits 18049 bytes 
Sat 18 Jan 2014 16:28:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:28:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43838708
Sat 18 Jan 2014 16:28:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:28:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43838708
Sat 18 Jan 2014 16:28:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:28:04 - job_xml_thread(): Done retrieving: data size 43838708
Sat 18 Jan 2014 16:28:04 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:28:04 - XML: Start document: iteration 10
Sat 18 Jan 2014 16:28:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:28:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:28:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:28:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:28:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:28:20 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:28:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:28:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:28:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:28:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:28:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:28:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:28:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:28:25 - XML: Processed 655238 elements - found 519 jobs
Sat 18 Jan 2014 16:28:25 - job 7349098 report time 1390058681 does not match current heartbeat 1390058802 : ignoring job
Sat 18 Jan 2014 16:28:26 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:28:26 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:28:26 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:28:26 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:28:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:28:28 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:28:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:28:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:28:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:28:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:28:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:28:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:28:30 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:28:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 16:28:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:28:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:28:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43836862
Sat 18 Jan 2014 16:28:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:28:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43836862
Sat 18 Jan 2014 16:28:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:28:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:28:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:28:41 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:28:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:28:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:28:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:28:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:28:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:28:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:28:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:28:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:28:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:28:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:28:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:28:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:28:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:28:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:28:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:28:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:28:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:28:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:28:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:28:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:28:46 - job_xml_thread(): Done retrieving: data size 43842601
Sat 18 Jan 2014 16:28:46 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:28:46 - XML: Start document: iteration 11
Sat 18 Jan 2014 16:28:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43842601
Sat 18 Jan 2014 16:28:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:28:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43842601
Sat 18 Jan 2014 16:28:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:28:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:28:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:29:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:29:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:29:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:29:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:29:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:29:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:29:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:29:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:29:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:29:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:29:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:29:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:29:03 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:29:03 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:29:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 16:29:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:29:03 - XML: Processed 655244 elements - found 519 jobs
Sat 18 Jan 2014 16:29:03 - job 7349098 report time 1390058681 does not match current heartbeat 1390058802 : ignoring job
Sat 18 Jan 2014 16:29:03 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:29:03 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:29:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 16:29:03 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:29:03 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:29:03 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:29:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6865 values 108247 bits 13530 bytes 
Sat 18 Jan 2014 16:29:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:29:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:29:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:29:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:29:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:29:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:29:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:29:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:29:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:29:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43810311
Sat 18 Jan 2014 16:29:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:29:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43810311
Sat 18 Jan 2014 16:29:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:29:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:29:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:29:18 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:29:18 - job_xml_thread(): Done retrieving: data size 43810311
Sat 18 Jan 2014 16:29:18 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:29:18 - XML: Start document: iteration 12
Sat 18 Jan 2014 16:29:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:29:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:29:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:29:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:29:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:29:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:29:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:29:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:29:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:29:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:29:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:29:29 - XML: Processed 655142 elements - found 519 jobs
Sat 18 Jan 2014 16:29:30 - job 7349098 report time 1390058681 does not match current heartbeat 1390058802 : ignoring job
Sat 18 Jan 2014 16:29:30 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:29:30 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:29:30 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:29:30 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:29:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:29:34 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:29:34 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:29:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 16:29:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:29:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:29:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:29:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:29:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:29:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:29:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:29:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:29:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43666536
Sat 18 Jan 2014 16:29:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:29:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43666536
Sat 18 Jan 2014 16:29:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:29:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:29:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:29:42 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 16:29:42 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:29:44 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:29:44 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 16:29:44 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:29:44 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 16:29:44 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 16:29:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:29:45 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:29:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:29:45 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:29:45 - job_xml_thread(): Done retrieving: data size 43666536
Sat 18 Jan 2014 16:29:45 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:29:45 - XML: Start document: iteration 13
Sat 18 Jan 2014 16:29:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:29:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:29:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:29:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:29:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:29:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:29:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:29:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:29:55 - XML: Processed 653660 elements - found 519 jobs
Sat 18 Jan 2014 16:29:55 - job 7349100 report time 1390058802 does not match current heartbeat 1390058922 : ignoring job
Sat 18 Jan 2014 16:29:55 - job 7348402 appears to have finished
Sat 18 Jan 2014 16:29:55 - job 7349102 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 16:29:55 - job 7349101 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 16:29:55 - job_xml_thread(): Found 5 updated jobs.
Sat 18 Jan 2014 16:29:55 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 16:29:56 - size of cluster 'LISA Cluster': 624 hosts 79464 metrics 838273 values 13209286 bits 1651160 bytes 
Sat 18 Jan 2014 16:29:57 - job_xml_thread(): Done storing. succesfully stored: 5 jobs
Sat 18 Jan 2014 16:29:57 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:29:57 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:30:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:30:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:30:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:30:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:30:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:30:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:30:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:30:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:30:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:30:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:30:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:30:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43176873
Sat 18 Jan 2014 16:30:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:30:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43176873
Sat 18 Jan 2014 16:30:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:30:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:30:03 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:30:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:30:04 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:30:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 16:30:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 16:30:04 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:30:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9098 values 143551 bits 17943 bytes 
Sat 18 Jan 2014 16:30:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:30:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:30:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:30:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:30:12 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:30:12 - job_xml_thread(): Done retrieving: data size 43176873
Sat 18 Jan 2014 16:30:12 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:30:12 - XML: Start document: iteration 14
Sat 18 Jan 2014 16:30:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:30:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:30:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:30:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:30:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:30:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:30:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:30:23 - XML: Processed 647415 elements - found 519 jobs
Sat 18 Jan 2014 16:30:23 - job 7349100 report time 1390058802 does not match current heartbeat 1390058922 : ignoring job
Sat 18 Jan 2014 16:30:23 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:30:23 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:30:23 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:30:23 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:30:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:30:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:30:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:30:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:30:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:30:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:30:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:30:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:30:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:30:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43195074
Sat 18 Jan 2014 16:30:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:30:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43195074
Sat 18 Jan 2014 16:30:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:30:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:30:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:30:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:30:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:30:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:30:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:30:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:30:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:30:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43195074
Sat 18 Jan 2014 16:30:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:30:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:30:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:30:38 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:30:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:30:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:30:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:30:44 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:30:44 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 16:30:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:30:48 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:30:50 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:30:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 16:30:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:30:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:30:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:30:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:30:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:30:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:30:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:30:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:30:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:30:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:30:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:30:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:30:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:30:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:30:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:30:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:30:54 - job_xml_thread(): Done retrieving: data size 43780565
Sat 18 Jan 2014 16:30:54 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:30:54 - XML: Start document: iteration 15
Sat 18 Jan 2014 16:30:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43780565
Sat 18 Jan 2014 16:30:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:30:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43780565
Sat 18 Jan 2014 16:30:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:31:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:31:04 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:31:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:31:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 16:31:05 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:31:05 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:31:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5843 values 92137 bits 11517 bytes 
Sat 18 Jan 2014 16:31:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 16:31:07 - XML: Processed 655154 elements - found 519 jobs
Sat 18 Jan 2014 16:31:07 - job 7349100 report time 1390058802 does not match current heartbeat 1390058922 : ignoring job
Sat 18 Jan 2014 16:31:07 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:31:07 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:31:07 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:31:07 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:31:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:31:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:31:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:31:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:31:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:31:11 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:31:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:31:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:31:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:31:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:31:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:31:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:31:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:31:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:31:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:31:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:31:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:31:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:31:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:31:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:31:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:31:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:31:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43829959
Sat 18 Jan 2014 16:31:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:31:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43829959
Sat 18 Jan 2014 16:31:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:31:22 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:31:22 - job_xml_thread(): Done retrieving: data size 43829959
Sat 18 Jan 2014 16:31:22 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:31:22 - XML: Start document: iteration 16
Sat 18 Jan 2014 16:31:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:31:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:31:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:31:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:31:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:31:32 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:31:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:31:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:31:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:31:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:31:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:31:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:31:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:31:37 - XML: Processed 655238 elements - found 516 jobs
Sat 18 Jan 2014 16:31:37 - job 7348403 appears to have finished
Sat 18 Jan 2014 16:31:37 - job 7348748 appears to have finished
Sat 18 Jan 2014 16:31:37 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 16:31:37 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 16:31:37 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 16:31:37 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:31:37 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:31:38 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:31:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 16:31:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:31:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:31:41 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:31:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:31:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:31:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:31:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:31:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:31:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:31:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:31:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43810942
Sat 18 Jan 2014 16:31:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:31:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43810942
Sat 18 Jan 2014 16:31:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:31:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:31:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:31:52 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:31:52 - job_xml_thread(): Done retrieving: data size 43810942
Sat 18 Jan 2014 16:31:52 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:31:52 - XML: Start document: iteration 17
Sat 18 Jan 2014 16:31:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:31:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:31:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:31:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:31:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:31:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:32:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:32:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:32:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:32:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:32:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:32:03 - XML: Processed 655240 elements - found 517 jobs
Sat 18 Jan 2014 16:32:03 - job 7349105 report time 1390058922 does not match current heartbeat 1390059043 : ignoring job
Sat 18 Jan 2014 16:32:03 - job 7349104 field 'start_timestamp' changed since saved from: 1390058962 to: 1390058883
Sat 18 Jan 2014 16:32:03 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 16:32:03 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 16:32:03 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 16:32:03 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:32:03 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:32:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:32:05 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:32:05 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:32:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:32:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 16:32:05 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:32:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5714 values 90303 bits 11287 bytes 
Sat 18 Jan 2014 16:32:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 16:32:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:32:06 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:32:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:32:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:32:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:32:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:32:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:32:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:32:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:32:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43806030
Sat 18 Jan 2014 16:32:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:32:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43806030
Sat 18 Jan 2014 16:32:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:32:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:32:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:32:18 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:32:19 - job_xml_thread(): Done retrieving: data size 43806030
Sat 18 Jan 2014 16:32:19 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:32:19 - XML: Start document: iteration 18
Sat 18 Jan 2014 16:32:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:32:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:32:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:32:27 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:32:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:32:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:32:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:32:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:32:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:32:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:32:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:32:31 - XML: Processed 655240 elements - found 517 jobs
Sat 18 Jan 2014 16:32:31 - job 7349105 report time 1390058922 does not match current heartbeat 1390059043 : ignoring job
Sat 18 Jan 2014 16:32:31 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:32:31 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:32:31 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:32:31 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:32:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:32:34 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:32:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:32:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:32:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:32:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:32:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:32:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:32:35 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:32:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 16:32:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:32:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:32:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43821014
Sat 18 Jan 2014 16:32:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:32:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43821014
Sat 18 Jan 2014 16:32:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:32:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:32:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:32:46 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:32:46 - job_xml_thread(): Done retrieving: data size 43821014
Sat 18 Jan 2014 16:32:46 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:32:46 - XML: Start document: iteration 19
Sat 18 Jan 2014 16:32:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:32:48 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:32:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:32:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:32:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:32:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:32:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:32:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:32:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:32:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:32:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:32:59 - XML: Processed 655240 elements - found 517 jobs
Sat 18 Jan 2014 16:33:00 - job 7349105 report time 1390058922 does not match current heartbeat 1390059043 : ignoring job
Sat 18 Jan 2014 16:33:00 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:33:00 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:33:00 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:33:00 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:33:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:33:01 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:33:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:33:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:33:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:33:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:33:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:33:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:33:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:33:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:33:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:33:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43807515
Sat 18 Jan 2014 16:33:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:33:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:33:05 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:33:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43807515
Sat 18 Jan 2014 16:33:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:33:06 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:33:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:33:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 16:33:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 16:33:06 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:33:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8551 values 135136 bits 16892 bytes 
Sat 18 Jan 2014 16:33:15 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:33:15 - job_xml_thread(): Done retrieving: data size 43807515
Sat 18 Jan 2014 16:33:15 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:33:15 - XML: Start document: iteration 20
Sat 18 Jan 2014 16:33:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:33:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:33:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:33:18 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:33:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:33:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:33:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:33:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:33:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:33:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:33:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:33:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:33:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:33:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:33:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:33:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:33:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:33:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:33:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:33:27 - XML: Processed 655240 elements - found 517 jobs
Sat 18 Jan 2014 16:33:27 - job 7349105 report time 1390058922 does not match current heartbeat 1390059043 : ignoring job
Sat 18 Jan 2014 16:33:27 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:33:27 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:33:27 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:33:27 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:33:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:33:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43810963
Sat 18 Jan 2014 16:33:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:33:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43810963
Sat 18 Jan 2014 16:33:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:33:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:33:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:33:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:33:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:33:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:33:42 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:33:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:33:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:33:42 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:33:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:33:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:33:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:33:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:33:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:33:45 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:33:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 16:33:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:33:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:33:46 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:33:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:33:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:33:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:33:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:33:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:33:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:33:48 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 16:33:48 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 16:33:48 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:33:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:33:49 - job_xml_thread(): Done retrieving: data size 43829831
Sat 18 Jan 2014 16:33:49 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:33:49 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 16:33:49 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 16:33:49 - Housekeeping: done.
Sat 18 Jan 2014 16:33:49 - XML: Start document: iteration 0
Sat 18 Jan 2014 16:33:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43829831
Sat 18 Jan 2014 16:33:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43829831
Sat 18 Jan 2014 16:33:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:33:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:33:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:33:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:34:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:34:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:34:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:34:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:34:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:34:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:34:07 - XML: Processed 655242 elements - found 518 jobs
Sat 18 Jan 2014 16:34:07 - job 7349107 report time 1390059043 does not match current heartbeat 1390059163 : ignoring job
Sat 18 Jan 2014 16:34:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:34:07 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:34:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:34:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:34:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:34:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:34:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:34:07 - job 7348404 appears to have finished
Sat 18 Jan 2014 16:34:07 - job 7349102 appears to have finished
Sat 18 Jan 2014 16:34:07 - job_xml_thread(): Found 6 updated jobs.
Sat 18 Jan 2014 16:34:07 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 16:34:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:34:08 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:34:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 16:34:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 16:34:08 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:34:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5899 values 93116 bits 11639 bytes 
Sat 18 Jan 2014 16:34:08 - job_xml_thread(): Done storing. succesfully stored: 6 jobs
Sat 18 Jan 2014 16:34:08 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:34:08 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:34:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:34:11 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:34:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:34:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:34:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:34:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:34:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:34:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:34:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:34:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43822273
Sat 18 Jan 2014 16:34:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:34:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43822273
Sat 18 Jan 2014 16:34:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:34:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:34:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:34:23 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:34:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:34:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:34:26 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:34:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:34:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:34:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:34:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:34:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:34:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:34:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:34:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:34:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:34:29 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:34:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:34:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:34:29 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:34:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 16:34:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:34:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:34:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:34:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:34:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:34:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:34:30 - job_xml_thread(): Done retrieving: data size 43827868
Sat 18 Jan 2014 16:34:30 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:34:30 - XML: Start document: iteration 1
Sat 18 Jan 2014 16:34:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43827868
Sat 18 Jan 2014 16:34:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:34:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43827868
Sat 18 Jan 2014 16:34:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:34:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:34:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:34:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:34:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:34:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:34:45 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:34:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:34:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:34:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:34:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:34:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:34:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:34:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:34:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:34:49 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:34:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:34:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:34:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:34:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:34:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:34:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:34:52 - XML: Processed 655242 elements - found 518 jobs
Sat 18 Jan 2014 16:34:52 - job 7349107 report time 1390059043 does not match current heartbeat 1390059163 : ignoring job
Sat 18 Jan 2014 16:34:52 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:34:52 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:34:52 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:34:52 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:34:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:34:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43834123
Sat 18 Jan 2014 16:34:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:34:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43834123
Sat 18 Jan 2014 16:34:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:35:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:35:02 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:35:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:35:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:35:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:35:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:35:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:35:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:35:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:35:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:35:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:35:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:35:05 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:35:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:35:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:35:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:35:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:35:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:35:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:35:07 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:35:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:35:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43779631
Sat 18 Jan 2014 16:35:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:35:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43779631
Sat 18 Jan 2014 16:35:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:35:08 - job_xml_thread(): Done retrieving: data size 43779631
Sat 18 Jan 2014 16:35:08 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:35:08 - XML: Start document: iteration 2
Sat 18 Jan 2014 16:35:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:35:08 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:35:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:35:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 16:35:09 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:35:09 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:35:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9133 values 144087 bits 18010 bytes 
Sat 18 Jan 2014 16:35:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 16:35:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:35:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:35:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:35:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:35:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:35:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:35:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:35:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:35:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:35:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:35:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:35:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:35:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:35:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:35:30 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:35:30 - XML: Processed 654494 elements - found 518 jobs
Sat 18 Jan 2014 16:35:30 - job 7349107 report time 1390059043 does not match current heartbeat 1390059163 : ignoring job
Sat 18 Jan 2014 16:35:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:35:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:35:30 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:35:30 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:35:30 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:35:30 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:35:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:35:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:35:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:35:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:35:32 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:35:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 16:35:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:35:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:35:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43362521
Sat 18 Jan 2014 16:35:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:35:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43362521
Sat 18 Jan 2014 16:35:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:35:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:35:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:35:45 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:35:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:35:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:35:45 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:35:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:35:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:35:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:35:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:35:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:35:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:35:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:35:48 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:35:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:35:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:35:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:35:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:35:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:35:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:35:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:35:49 - job_xml_thread(): Done retrieving: data size 43204302
Sat 18 Jan 2014 16:35:49 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:35:49 - XML: Start document: iteration 3
Sat 18 Jan 2014 16:35:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43204302
Sat 18 Jan 2014 16:35:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:35:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43204302
Sat 18 Jan 2014 16:35:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:36:02 - XML: Processed 647372 elements - found 518 jobs
Sat 18 Jan 2014 16:36:02 - job 7349112 report time 1390059163 does not match current heartbeat 1390059284 : ignoring job
Sat 18 Jan 2014 16:36:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:36:02 - job 7335217 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 16:36:02 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 16:36:02 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 16:36:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:36:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:36:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:36:04 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 16:36:04 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:36:04 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:36:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:36:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:36:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:36:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:36:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:36:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:36:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:36:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:36:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:36:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:36:09 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:36:10 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:36:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 16:36:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:36:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 16:36:10 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:36:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6288 values 99216 bits 12402 bytes 
Sat 18 Jan 2014 16:36:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:36:10 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:36:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:36:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:36:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:36:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:36:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:36:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:36:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:36:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43223338
Sat 18 Jan 2014 16:36:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:36:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43223338
Sat 18 Jan 2014 16:36:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:36:19 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:36:19 - job_xml_thread(): Done retrieving: data size 43223338
Sat 18 Jan 2014 16:36:19 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:36:19 - XML: Start document: iteration 4
Sat 18 Jan 2014 16:36:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:36:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:36:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:36:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:36:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:36:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:36:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:36:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:36:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:36:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:36:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:36:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:36:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:36:36 - XML: Processed 647714 elements - found 518 jobs
Sat 18 Jan 2014 16:36:36 - job 7349112 report time 1390059163 does not match current heartbeat 1390059284 : ignoring job
Sat 18 Jan 2014 16:36:36 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:36:37 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:36:37 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:36:37 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:36:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:36:37 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:36:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:36:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:36:37 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:36:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 16:36:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:36:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:36:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:36:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:36:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:36:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:36:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43539507
Sat 18 Jan 2014 16:36:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43539507
Sat 18 Jan 2014 16:36:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:36:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:36:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:36:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:36:44 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 16:36:45 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:36:45 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:36:45 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 16:36:45 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:36:45 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 16:36:45 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 16:36:49 - size of cluster 'LISA Cluster': 624 hosts 79458 metrics 755831 values 11928372 bits 1491046 bytes 
Sat 18 Jan 2014 16:36:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:36:50 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:36:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:36:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:36:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:36:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:36:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:36:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:36:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:36:52 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:36:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:36:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:36:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:36:54 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:36:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:36:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:36:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:36:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:36:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:36:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:36:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:36:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43810775
Sat 18 Jan 2014 16:36:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:36:58 - job_xml_thread(): Done retrieving: data size 43810775
Sat 18 Jan 2014 16:36:58 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:36:58 - XML: Start document: iteration 5
Sat 18 Jan 2014 16:36:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43810775
Sat 18 Jan 2014 16:36:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:37:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:37:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:37:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:37:10 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:37:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:37:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:37:12 - XML: Processed 655098 elements - found 518 jobs
Sat 18 Jan 2014 16:37:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:37:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 16:37:12 - job 7349112 report time 1390059163 does not match current heartbeat 1390059284 : ignoring job
Sat 18 Jan 2014 16:37:12 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:37:12 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:37:12 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:37:12 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:37:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9060 values 142926 bits 17865 bytes 
Sat 18 Jan 2014 16:37:12 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:37:12 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:37:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 16:37:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:37:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:37:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:37:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:37:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:37:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:37:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:37:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:37:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:37:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:37:21 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:37:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:37:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:37:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:37:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:37:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:37:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:37:24 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:37:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 16:37:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:37:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:37:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43825814
Sat 18 Jan 2014 16:37:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:37:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43825814
Sat 18 Jan 2014 16:37:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:37:28 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:37:28 - job_xml_thread(): Done retrieving: data size 43825814
Sat 18 Jan 2014 16:37:28 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:37:28 - XML: Start document: iteration 6
Sat 18 Jan 2014 16:37:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:37:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:37:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:37:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:37:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:37:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:37:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:37:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:37:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:37:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:37:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:37:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:37:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:37:45 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:37:45 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 16:37:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:37:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:37:48 - XML: Processed 655236 elements - found 517 jobs
Sat 18 Jan 2014 16:37:48 - job 7348975 appears to have finished
Sat 18 Jan 2014 16:37:48 - job 7349111 appears to have finished
Sat 18 Jan 2014 16:37:48 - job_xml_thread(): Found 4 updated jobs.
Sat 18 Jan 2014 16:37:48 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 16:37:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:37:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:37:48 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Sat 18 Jan 2014 16:37:48 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:37:48 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:37:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:37:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:37:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:37:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:37:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:37:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43811682
Sat 18 Jan 2014 16:37:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:37:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43811682
Sat 18 Jan 2014 16:37:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:37:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:37:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:38:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:38:00 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:38:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:38:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:38:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:38:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:38:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:38:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:38:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43811682
Sat 18 Jan 2014 16:38:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:38:03 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:38:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:38:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:38:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:38:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:38:10 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:38:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:38:13 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:38:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:38:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 16:38:13 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:38:13 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:38:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 16:38:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99092 bits 12386 bytes 
Sat 18 Jan 2014 16:38:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:38:14 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:38:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:38:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:38:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:38:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:38:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:38:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:38:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:38:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:38:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:38:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:38:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:38:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:38:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:38:18 - job_xml_thread(): Done retrieving: data size 43803848
Sat 18 Jan 2014 16:38:18 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:38:18 - XML: Start document: iteration 7
Sat 18 Jan 2014 16:38:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43803848
Sat 18 Jan 2014 16:38:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:38:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43803848
Sat 18 Jan 2014 16:38:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:38:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:38:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:38:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:38:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:38:32 - XML: Processed 655240 elements - found 517 jobs
Sat 18 Jan 2014 16:38:33 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:38:33 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:38:33 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:38:33 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:38:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:38:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:38:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:38:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:38:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:38:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:38:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:38:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:38:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:38:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:38:40 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:38:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:38:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:38:40 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:38:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 16:38:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:38:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:38:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:38:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:38:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:38:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:38:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43840071
Sat 18 Jan 2014 16:38:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:38:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43840071
Sat 18 Jan 2014 16:38:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:38:48 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:38:48 - job_xml_thread(): Done retrieving: data size 43840071
Sat 18 Jan 2014 16:38:48 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:38:48 - XML: Start document: iteration 8
Sat 18 Jan 2014 16:38:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:38:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:38:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:38:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:39:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:39:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:39:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:39:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:39:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:39:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:39:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:39:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:39:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:39:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:39:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:39:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:39:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:39:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:39:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:39:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:39:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:39:05 - XML: Processed 655240 elements - found 517 jobs
Sat 18 Jan 2014 16:39:05 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:39:05 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:39:05 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:39:05 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:39:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:39:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43839968
Sat 18 Jan 2014 16:39:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:39:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43839968
Sat 18 Jan 2014 16:39:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:39:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:39:13 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:39:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:39:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 16:39:15 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:39:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 16:39:15 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:39:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9061 values 142904 bits 17863 bytes 
Sat 18 Jan 2014 16:39:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:39:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:39:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:39:18 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:39:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:39:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:39:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:39:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:39:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:39:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:39:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:39:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:39:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:39:20 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:39:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:39:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:39:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:39:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:39:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:39:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:39:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:39:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:39:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:39:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43812833
Sat 18 Jan 2014 16:39:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:39:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43812833
Sat 18 Jan 2014 16:39:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:39:29 - job_xml_thread(): Done retrieving: data size 43812833
Sat 18 Jan 2014 16:39:29 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:39:29 - XML: Start document: iteration 9
Sat 18 Jan 2014 16:39:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:39:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:39:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:39:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:39:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:39:43 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:39:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:39:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:39:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:39:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:39:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:39:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:39:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:39:48 - XML: Processed 655238 elements - found 516 jobs
Sat 18 Jan 2014 16:39:48 - job 7349116 field 'start_timestamp' changed since saved from: 1390059436 to: 1390059371
Sat 18 Jan 2014 16:39:48 - job 7349109 appears to have finished
Sat 18 Jan 2014 16:39:48 - job 7349110 appears to have finished
Sat 18 Jan 2014 16:39:48 - job_xml_thread(): Found 4 updated jobs.
Sat 18 Jan 2014 16:39:48 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 16:39:48 - job_xml_thread(): Done storing. succesfully stored: 4 jobs
Sat 18 Jan 2014 16:39:48 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:39:48 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:39:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:39:53 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:39:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:39:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:39:53 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:39:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 16:39:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:39:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:39:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:39:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:39:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:39:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:39:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43804702
Sat 18 Jan 2014 16:39:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:39:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43804702
Sat 18 Jan 2014 16:39:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:40:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:40:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:40:03 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:40:03 - job_xml_thread(): Done retrieving: data size 43804702
Sat 18 Jan 2014 16:40:03 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:40:03 - XML: Start document: iteration 10
Sat 18 Jan 2014 16:40:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:40:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:40:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:40:13 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:40:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:40:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:40:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:40:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:40:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:40:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:40:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:40:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:40:15 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:40:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:40:15 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:40:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 16:40:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 16:40:15 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:40:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5858 values 92394 bits 11549 bytes 
Sat 18 Jan 2014 16:40:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:40:18 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:40:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:40:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:40:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:40:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:40:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:40:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:40:19 - XML: Processed 655238 elements - found 516 jobs
Sat 18 Jan 2014 16:40:19 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:40:19 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:40:19 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:40:19 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:40:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:40:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43823647
Sat 18 Jan 2014 16:40:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:40:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43823647
Sat 18 Jan 2014 16:40:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:40:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:40:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:40:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:40:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:40:34 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:40:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:40:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:40:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:40:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:40:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:40:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:40:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:40:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:40:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:40:39 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:40:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 16:40:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:40:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:40:40 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:40:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:40:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:40:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:40:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:40:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:40:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:40:42 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 16:40:42 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 16:40:42 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:40:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:40:43 - job_xml_thread(): Done retrieving: data size 43808621
Sat 18 Jan 2014 16:40:43 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:40:43 - XML: Start document: iteration 11
Sat 18 Jan 2014 16:40:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43808621
Sat 18 Jan 2014 16:40:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43808621
Sat 18 Jan 2014 16:40:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:40:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:40:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:40:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:40:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:40:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:40:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:40:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:40:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:40:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:40:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:40:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:40:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:40:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:40:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:41:05 - XML: Processed 655238 elements - found 516 jobs
Sat 18 Jan 2014 16:41:05 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:41:05 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:41:05 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:41:05 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:41:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:41:06 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:41:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:41:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:41:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:41:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:41:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:41:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:41:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:41:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43818712
Sat 18 Jan 2014 16:41:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:41:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43818712
Sat 18 Jan 2014 16:41:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:41:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:41:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:41:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:41:15 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:41:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:41:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 16:41:16 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:41:16 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:41:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 16:41:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9069 values 143046 bits 17880 bytes 
Sat 18 Jan 2014 16:41:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:41:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:41:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:41:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:41:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:41:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:41:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:41:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:41:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:41:20 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:41:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:41:21 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:41:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:41:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:41:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:41:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:41:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:41:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:41:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:41:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43746096
Sat 18 Jan 2014 16:41:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:41:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43746096
Sat 18 Jan 2014 16:41:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:41:25 - job_xml_thread(): Done retrieving: data size 43746096
Sat 18 Jan 2014 16:41:25 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:41:25 - XML: Start document: iteration 12
Sat 18 Jan 2014 16:41:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:41:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:41:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:41:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:41:41 - XML: Processed 654490 elements - found 516 jobs
Sat 18 Jan 2014 16:41:41 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:41:41 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:41:41 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:41:41 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:41:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:41:43 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:41:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:41:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:41:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:41:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:41:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:41:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:41:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:41:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:41:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:41:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:41:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:41:47 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:41:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 16:41:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:41:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:41:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:41:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:41:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:41:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:41:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43224946
Sat 18 Jan 2014 16:41:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:41:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43224946
Sat 18 Jan 2014 16:41:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:41:56 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:41:56 - job_xml_thread(): Done retrieving: data size 43224946
Sat 18 Jan 2014 16:41:57 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:41:57 - XML: Start document: iteration 13
Sat 18 Jan 2014 16:41:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:42:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:42:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:42:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:42:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:42:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:42:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:42:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:42:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:42:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:42:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:42:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:42:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:42:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:42:06 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:42:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:42:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:42:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:42:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:42:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:42:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:42:08 - XML: Processed 647658 elements - found 516 jobs
Sat 18 Jan 2014 16:42:08 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:42:08 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:42:08 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:42:08 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:42:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:42:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43215715
Sat 18 Jan 2014 16:42:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:42:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43215715
Sat 18 Jan 2014 16:42:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:42:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:42:17 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:42:17 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:42:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:42:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 16:42:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 16:42:17 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:42:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8959 values 141288 bits 17661 bytes 
Sat 18 Jan 2014 16:42:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:42:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:42:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:42:20 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:42:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:42:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:42:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:42:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:42:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:42:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:42:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:42:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:42:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:42:23 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:42:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:42:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:42:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:42:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:42:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:42:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:42:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:42:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:42:26 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:42:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 16:42:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:42:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:42:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43227478
Sat 18 Jan 2014 16:42:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:42:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43227478
Sat 18 Jan 2014 16:42:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:42:27 - job_xml_thread(): Done retrieving: data size 43227478
Sat 18 Jan 2014 16:42:27 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:42:27 - XML: Start document: iteration 14
Sat 18 Jan 2014 16:42:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:42:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:42:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:42:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:42:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:42:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:42:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:42:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:42:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:42:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:42:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:42:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:42:42 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:42:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:42:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:42:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:42:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:42:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:42:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:42:45 - XML: Processed 647786 elements - found 516 jobs
Sat 18 Jan 2014 16:42:45 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:42:45 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:42:45 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:42:45 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:42:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:42:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43751103
Sat 18 Jan 2014 16:42:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:42:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43751103
Sat 18 Jan 2014 16:42:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:42:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:42:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:42:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:42:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:42:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:42:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:42:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:42:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:43:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:43:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:43:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:43:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:43:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:43:00 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:43:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:43:02 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:43:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:43:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:43:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:43:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:43:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:43:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:43:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:43:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43830275
Sat 18 Jan 2014 16:43:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:43:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43830275
Sat 18 Jan 2014 16:43:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:43:04 - job_xml_thread(): Done retrieving: data size 43830275
Sat 18 Jan 2014 16:43:04 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:43:04 - XML: Start document: iteration 15
Sat 18 Jan 2014 16:43:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:43:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:43:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:43:17 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:43:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:43:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:43:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:43:19 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:43:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 16:43:19 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:43:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 16:43:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148618 bits 18577 bytes 
Sat 18 Jan 2014 16:43:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:43:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:43:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:43:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:43:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:43:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:43:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:43:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:43:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:43:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:43:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:43:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:43:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:43:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:43:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:43:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:43:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:43:27 - XML: Processed 655198 elements - found 516 jobs
Sat 18 Jan 2014 16:43:27 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:43:27 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:43:27 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:43:27 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:43:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:43:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43824324
Sat 18 Jan 2014 16:43:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:43:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43824324
Sat 18 Jan 2014 16:43:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:43:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:43:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:43:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:43:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:43:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:43:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:43:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:43:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:43:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:43:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:43:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:43:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:43:42 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:43:42 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:43:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:43:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:43:42 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:43:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 16:43:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:43:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:43:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:43:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:43:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:43:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:43:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43829592
Sat 18 Jan 2014 16:43:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:43:44 - job_xml_thread(): Done retrieving: data size 43829592
Sat 18 Jan 2014 16:43:44 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:43:44 - XML: Start document: iteration 16
Sat 18 Jan 2014 16:43:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43829592
Sat 18 Jan 2014 16:43:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:43:46 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 16:43:46 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:43:48 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:43:48 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 16:43:48 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 16:43:48 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:43:48 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 16:43:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:43:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:43:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:43:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:44:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:44:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:44:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:44:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:44:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:44:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:44:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:44:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:44:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:44:05 - size of cluster 'LISA Cluster': 624 hosts 79473 metrics 847621 values 13361494 bits 1670186 bytes 
Sat 18 Jan 2014 16:44:06 - XML: Processed 655238 elements - found 516 jobs
Sat 18 Jan 2014 16:44:06 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:44:06 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:44:06 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:44:07 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:44:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:44:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:44:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:44:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:44:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:44:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:44:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:44:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:44:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:44:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43823458
Sat 18 Jan 2014 16:44:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:44:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43823458
Sat 18 Jan 2014 16:44:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:44:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:44:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:44:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:44:20 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:44:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:44:20 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:44:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:44:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 16:44:20 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:44:20 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:44:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:44:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:44:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 16:44:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9117 values 143773 bits 17971 bytes 
Sat 18 Jan 2014 16:44:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:44:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:44:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:44:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:44:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:44:22 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:44:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:44:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:44:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:44:27 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:44:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:44:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:44:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:44:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:44:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:44:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:44:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:44:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43812920
Sat 18 Jan 2014 16:44:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:44:32 - job_xml_thread(): Done retrieving: data size 43812920
Sat 18 Jan 2014 16:44:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43812920
Sat 18 Jan 2014 16:44:32 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:44:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:44:32 - XML: Start document: iteration 17
Sat 18 Jan 2014 16:44:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:44:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:44:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:44:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:44:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:44:46 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:44:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:44:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:44:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:44:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:44:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:44:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:44:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:44:48 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:44:48 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 16:44:51 - XML: Processed 655238 elements - found 516 jobs
Sat 18 Jan 2014 16:44:51 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:44:51 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:44:51 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:44:51 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:44:54 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:44:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 16:44:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:44:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:44:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:44:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:44:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:44:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:44:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:44:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:44:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:44:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:44:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43806215
Sat 18 Jan 2014 16:44:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:44:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43806215
Sat 18 Jan 2014 16:44:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:45:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:45:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:45:06 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:45:06 - job_xml_thread(): Done retrieving: data size 43806215
Sat 18 Jan 2014 16:45:06 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:45:06 - XML: Start document: iteration 18
Sat 18 Jan 2014 16:45:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:45:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:45:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:45:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:45:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:45:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:45:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:45:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:45:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:45:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:45:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:45:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:45:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:45:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:45:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:45:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:45:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:45:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:45:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:45:20 - XML: Processed 655238 elements - found 516 jobs
Sat 18 Jan 2014 16:45:20 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:45:20 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:45:20 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:45:20 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:45:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:45:20 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:45:21 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:45:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:45:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 16:45:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 16:45:21 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:45:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5693 values 89702 bits 11212 bytes 
Sat 18 Jan 2014 16:45:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:45:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43812151
Sat 18 Jan 2014 16:45:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:45:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:45:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:45:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43812151
Sat 18 Jan 2014 16:45:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:45:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:45:32 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:45:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:45:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:45:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:45:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:45:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:45:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:45:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:45:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:45:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:45:35 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:45:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:45:37 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:45:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:45:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:45:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:45:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:45:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:45:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:45:39 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:45:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 16:45:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:45:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:45:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43824550
Sat 18 Jan 2014 16:45:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:45:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43824550
Sat 18 Jan 2014 16:45:42 - job_xml_thread(): Done retrieving: data size 43824550
Sat 18 Jan 2014 16:45:42 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:45:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:45:42 - XML: Start document: iteration 19
Sat 18 Jan 2014 16:45:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:45:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:45:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:45:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:45:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:45:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:45:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:45:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:45:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:45:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:45:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:45:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:45:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:46:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:46:02 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:46:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:46:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:46:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:46:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:46:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:46:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:46:05 - XML: Processed 655238 elements - found 516 jobs
Sat 18 Jan 2014 16:46:05 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:46:05 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:46:05 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:46:05 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:46:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:46:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43823630
Sat 18 Jan 2014 16:46:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:46:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43823630
Sat 18 Jan 2014 16:46:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:46:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:46:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:46:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:46:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:46:20 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:46:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:46:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:46:20 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:46:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:46:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:46:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:46:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:46:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:46:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:46:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:46:21 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:46:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:46:22 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:46:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 16:46:22 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:46:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 16:46:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7795 values 122938 bits 15367 bytes 
Sat 18 Jan 2014 16:46:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:46:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:46:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:46:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:46:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:46:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:46:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:46:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:46:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:46:28 - job_xml_thread(): Done retrieving: data size 43821480
Sat 18 Jan 2014 16:46:28 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:46:28 - XML: Start document: iteration 20
Sat 18 Jan 2014 16:46:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43821480
Sat 18 Jan 2014 16:46:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43821480
Sat 18 Jan 2014 16:46:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:46:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:46:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:46:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:46:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:46:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:46:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:46:49 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:46:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:46:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:46:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:46:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:46:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:46:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:46:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:46:51 - XML: Processed 655238 elements - found 516 jobs
Sat 18 Jan 2014 16:46:51 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:46:51 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:46:51 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:46:51 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:46:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:46:52 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:46:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:46:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:46:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:46:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:46:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:46:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:46:53 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:46:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 16:46:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:46:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:46:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43847453
Sat 18 Jan 2014 16:46:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:46:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43847453
Sat 18 Jan 2014 16:46:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:47:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:47:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:47:06 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:47:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:47:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:47:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:47:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:47:11 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:47:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:47:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:47:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:47:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:47:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:47:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:47:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:47:11 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:47:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:47:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:47:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:47:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:47:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:47:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:47:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:47:14 - job_xml_thread(): Done retrieving: data size 43748425
Sat 18 Jan 2014 16:47:14 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:47:14 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 16:47:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43748425
Sat 18 Jan 2014 16:47:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:47:14 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 16:47:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43748425
Sat 18 Jan 2014 16:47:14 - Housekeeping: done.
Sat 18 Jan 2014 16:47:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:47:14 - XML: Start document: iteration 0
Sat 18 Jan 2014 16:47:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:47:22 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:47:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:47:23 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:47:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 16:47:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 16:47:24 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:47:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8819 values 139411 bits 17426 bytes 
Sat 18 Jan 2014 16:47:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:47:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:47:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:47:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:47:32 - XML: Processed 654490 elements - found 516 jobs
Sat 18 Jan 2014 16:47:32 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:47:32 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:47:32 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:47:32 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:47:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:47:33 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:47:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:47:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:47:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:47:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:47:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:47:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:47:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:47:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:47:37 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:47:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:47:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:47:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:47:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:47:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:47:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:47:39 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 16:47:39 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 16:47:39 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:47:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:47:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43261483
Sat 18 Jan 2014 16:47:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:47:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43261483
Sat 18 Jan 2014 16:47:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:47:47 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:47:47 - job_xml_thread(): Done retrieving: data size 43261483
Sat 18 Jan 2014 16:47:47 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:47:47 - XML: Start document: iteration 1
Sat 18 Jan 2014 16:47:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:47:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:47:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:47:49 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:47:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:47:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:47:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:47:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:47:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:47:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43261483
Sat 18 Jan 2014 16:47:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:47:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:47:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:47:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:48:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:48:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:48:04 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:48:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 16:48:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:48:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:48:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:48:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:48:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:48:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:48:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:48:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:48:07 - XML: Processed 648184 elements - found 516 jobs
Sat 18 Jan 2014 16:48:07 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:48:07 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:48:07 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:48:07 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:48:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:48:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:48:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:48:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:48:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:48:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:48:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:48:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:48:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:48:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43193302
Sat 18 Jan 2014 16:48:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:48:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43193302
Sat 18 Jan 2014 16:48:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:48:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:48:19 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:48:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:48:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:48:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:48:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:48:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:48:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:48:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:48:22 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:48:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:48:23 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:48:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:48:23 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:48:23 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:48:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:48:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 16:48:23 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:48:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6046 values 95593 bits 11949 bytes 
Sat 18 Jan 2014 16:48:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 16:48:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:48:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:48:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:48:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:48:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:48:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:48:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:48:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43252382
Sat 18 Jan 2014 16:48:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:48:25 - job_xml_thread(): Done retrieving: data size 43252382
Sat 18 Jan 2014 16:48:25 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:48:25 - XML: Start document: iteration 2
Sat 18 Jan 2014 16:48:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43252382
Sat 18 Jan 2014 16:48:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:48:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:48:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:48:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:48:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:48:43 - XML: Processed 647892 elements - found 516 jobs
Sat 18 Jan 2014 16:48:43 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:48:43 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:48:43 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:48:43 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:48:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:48:45 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:48:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:48:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:48:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:48:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:48:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:48:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:48:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:48:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:48:48 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:48:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:48:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:48:48 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:48:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 16:48:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:48:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:48:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:48:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:48:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:48:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:48:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43744246
Sat 18 Jan 2014 16:48:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:48:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43744246
Sat 18 Jan 2014 16:48:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:48:59 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:48:59 - job_xml_thread(): Done retrieving: data size 43744246
Sat 18 Jan 2014 16:48:59 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:48:59 - XML: Start document: iteration 3
Sat 18 Jan 2014 16:49:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:49:00 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:49:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:49:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:49:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:49:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:49:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:49:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:49:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:49:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:49:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:49:09 - XML: Processed 654134 elements - found 516 jobs
Sat 18 Jan 2014 16:49:09 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:49:09 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:49:09 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:49:09 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:49:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:49:11 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:49:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:49:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:49:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:49:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:49:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:49:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:49:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:49:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43792265
Sat 18 Jan 2014 16:49:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:49:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43792265
Sat 18 Jan 2014 16:49:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:49:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:49:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:49:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:49:24 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:49:24 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:49:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:49:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:49:24 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:49:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:49:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:49:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:49:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:49:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:49:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:49:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:49:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 16:49:25 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:49:25 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:49:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 16:49:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8778 values 138503 bits 17312 bytes 
Sat 18 Jan 2014 16:49:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:49:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:49:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:49:27 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:49:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:49:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:49:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:49:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:49:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:49:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:49:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:49:29 - job_xml_thread(): Done retrieving: data size 43821341
Sat 18 Jan 2014 16:49:29 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:49:29 - XML: Start document: iteration 4
Sat 18 Jan 2014 16:49:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43821341
Sat 18 Jan 2014 16:49:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:49:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43821341
Sat 18 Jan 2014 16:49:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:49:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:49:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:49:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:49:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:49:43 - XML: Processed 655238 elements - found 516 jobs
Sat 18 Jan 2014 16:49:43 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:49:43 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:49:43 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:49:43 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:49:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:49:48 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:49:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:49:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:49:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:49:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:49:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:49:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:49:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:49:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:49:52 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:49:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:49:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:49:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:49:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:49:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:49:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:49:53 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:49:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 16:49:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:49:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:49:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43827713
Sat 18 Jan 2014 16:49:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:49:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43827713
Sat 18 Jan 2014 16:49:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:49:58 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:49:58 - job_xml_thread(): Done retrieving: data size 43827713
Sat 18 Jan 2014 16:49:59 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:49:59 - XML: Start document: iteration 5
Sat 18 Jan 2014 16:50:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:50:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:50:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:50:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:50:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:50:10 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:50:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:50:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:50:12 - XML: Processed 655238 elements - found 516 jobs
Sat 18 Jan 2014 16:50:12 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:50:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:50:12 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:50:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:50:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:50:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:50:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:50:12 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:50:12 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:50:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:50:16 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:50:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:50:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:50:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:50:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:50:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:50:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:50:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:50:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43838391
Sat 18 Jan 2014 16:50:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:50:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43838391
Sat 18 Jan 2014 16:50:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:50:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:50:26 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:50:28 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:50:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:50:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:50:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:50:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:50:29 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:50:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 16:50:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 16:50:29 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:50:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:50:30 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:50:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8861 values 139781 bits 17472 bytes 
Sat 18 Jan 2014 16:50:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:50:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:50:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:50:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:50:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:50:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:50:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:50:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:50:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:50:33 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:50:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:50:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:50:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:50:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:50:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:50:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:50:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:50:35 - job_xml_thread(): Done retrieving: data size 43830949
Sat 18 Jan 2014 16:50:35 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:50:35 - XML: Start document: iteration 6
Sat 18 Jan 2014 16:50:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43830949
Sat 18 Jan 2014 16:50:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43830949
Sat 18 Jan 2014 16:50:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:50:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:50:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:50:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:50:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:50:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:50:49 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 16:50:49 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:50:50 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:50:50 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 16:50:50 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:50:50 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 16:50:50 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 16:50:53 - size of cluster 'LISA Cluster': 624 hosts 79472 metrics 828771 values 13083447 bits 1635430 bytes 
Sat 18 Jan 2014 16:50:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:50:56 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:50:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:50:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:50:56 - XML: Processed 655238 elements - found 516 jobs
Sat 18 Jan 2014 16:50:56 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:50:56 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:50:56 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:50:56 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:50:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:50:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:50:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:50:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:50:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:50:59 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:50:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 16:50:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:51:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:51:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:51:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:51:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:51:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:51:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:51:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:51:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:51:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:51:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43839062
Sat 18 Jan 2014 16:51:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:51:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43839062
Sat 18 Jan 2014 16:51:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:51:11 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:51:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:51:11 - job_xml_thread(): Done retrieving: data size 43839062
Sat 18 Jan 2014 16:51:11 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:51:11 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:51:11 - XML: Start document: iteration 7
Sat 18 Jan 2014 16:51:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:51:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:51:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:51:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:51:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:51:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:51:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:51:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:51:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:51:23 - XML: Processed 655237 elements - found 516 jobs
Sat 18 Jan 2014 16:51:23 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:51:23 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:51:24 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:51:24 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:51:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:51:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:51:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:51:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:51:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:51:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:51:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:51:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:51:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:51:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43792550
Sat 18 Jan 2014 16:51:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:51:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:51:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:51:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43792550
Sat 18 Jan 2014 16:51:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:51:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:51:30 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:51:32 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:51:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 16:51:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:51:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 16:51:32 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:51:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8896 values 140309 bits 17538 bytes 
Sat 18 Jan 2014 16:51:39 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:51:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:51:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:51:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:51:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:51:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:51:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:51:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:51:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:51:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:51:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:51:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:51:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:51:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:51:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:51:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:51:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:51:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:51:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:51:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:51:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:51:48 - job_xml_thread(): Done retrieving: data size 43824795
Sat 18 Jan 2014 16:51:48 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:51:48 - XML: Start document: iteration 8
Sat 18 Jan 2014 16:51:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43824795
Sat 18 Jan 2014 16:51:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:51:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43824795
Sat 18 Jan 2014 16:51:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:51:50 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:51:50 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 16:51:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:51:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:52:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:52:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:52:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:52:03 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:52:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:52:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:52:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:52:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:52:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:52:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:52:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:52:05 - XML: Processed 655238 elements - found 516 jobs
Sat 18 Jan 2014 16:52:05 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:52:05 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:52:05 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:52:05 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:52:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:52:11 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:52:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:52:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:52:12 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:52:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 16:52:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:52:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:52:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:52:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:52:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:52:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:52:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43806601
Sat 18 Jan 2014 16:52:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:52:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43806601
Sat 18 Jan 2014 16:52:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:52:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:52:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:52:20 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:52:20 - job_xml_thread(): Done retrieving: data size 43806601
Sat 18 Jan 2014 16:52:20 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:52:21 - XML: Start document: iteration 9
Sat 18 Jan 2014 16:52:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:52:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:52:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:52:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:52:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:52:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:52:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:52:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:52:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:52:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:52:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:52:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:52:32 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:52:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:52:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 16:52:32 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:52:32 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:52:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 16:52:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5634 values 88833 bits 11104 bytes 
Sat 18 Jan 2014 16:52:33 - XML: Processed 655238 elements - found 516 jobs
Sat 18 Jan 2014 16:52:33 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:52:33 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:52:33 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:52:33 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:52:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:52:38 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:52:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:52:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:52:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:52:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:52:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:52:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:52:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:52:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43795965
Sat 18 Jan 2014 16:52:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:52:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43795965
Sat 18 Jan 2014 16:52:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:52:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:52:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:52:49 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:52:49 - job_xml_thread(): Done retrieving: data size 43795965
Sat 18 Jan 2014 16:52:49 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:52:49 - XML: Start document: iteration 10
Sat 18 Jan 2014 16:52:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:52:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:52:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:52:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:52:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:52:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:52:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:52:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:52:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:52:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:52:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:53:00 - XML: Processed 655238 elements - found 516 jobs
Sat 18 Jan 2014 16:53:00 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:53:00 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:53:00 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:53:00 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:53:04 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:53:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 16:53:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:53:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:53:04 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:53:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:53:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:53:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:53:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:53:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:53:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:53:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:53:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43820344
Sat 18 Jan 2014 16:53:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:53:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43820344
Sat 18 Jan 2014 16:53:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:53:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:53:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:53:15 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:53:16 - job_xml_thread(): Done retrieving: data size 43820344
Sat 18 Jan 2014 16:53:16 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:53:16 - XML: Start document: iteration 11
Sat 18 Jan 2014 16:53:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:53:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:53:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:53:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:53:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:53:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:53:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:53:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:53:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:53:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:53:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:53:27 - XML: Processed 655238 elements - found 516 jobs
Sat 18 Jan 2014 16:53:27 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:53:27 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:53:27 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:53:27 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:53:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:53:30 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:53:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:53:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:53:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:53:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:53:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:53:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:53:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:53:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43757726
Sat 18 Jan 2014 16:53:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:53:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:53:32 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:53:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43757726
Sat 18 Jan 2014 16:53:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:53:33 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:53:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:53:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 16:53:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 16:53:33 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:53:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7470 values 117853 bits 14731 bytes 
Sat 18 Jan 2014 16:53:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:53:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:53:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:53:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:53:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:53:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:53:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:53:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:53:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43757726
Sat 18 Jan 2014 16:53:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:53:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:53:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:53:42 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:53:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:53:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:53:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:53:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:53:50 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:53:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:53:54 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:53:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:53:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:53:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:53:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:53:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:53:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:53:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:53:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:53:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:53:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:53:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:53:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:53:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:53:58 - job_xml_thread(): Done retrieving: data size 43192334
Sat 18 Jan 2014 16:53:58 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:53:58 - XML: Start document: iteration 12
Sat 18 Jan 2014 16:53:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43192334
Sat 18 Jan 2014 16:53:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43192334
Sat 18 Jan 2014 16:53:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:53:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:54:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:54:10 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:54:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:54:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:54:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:54:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:54:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:54:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:54:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:54:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:54:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:54:15 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:54:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 16:54:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:54:17 - XML: Processed 647808 elements - found 517 jobs
Sat 18 Jan 2014 16:54:17 - job 7349093 field 'status' changed since saved from: R to: Q
Sat 18 Jan 2014 16:54:17 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 16:54:17 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 16:54:17 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 16:54:17 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:54:17 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:54:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:54:20 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:54:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:54:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:54:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:54:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:54:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:54:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:54:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:54:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43204171
Sat 18 Jan 2014 16:54:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:54:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43204171
Sat 18 Jan 2014 16:54:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:54:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:54:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:54:33 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:54:33 - job_xml_thread(): Done retrieving: data size 43204171
Sat 18 Jan 2014 16:54:33 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:54:33 - XML: Start document: iteration 13
Sat 18 Jan 2014 16:54:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:54:33 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:54:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:54:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:54:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:54:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:54:34 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:54:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:54:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 16:54:34 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:54:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 16:54:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6285 values 99109 bits 12388 bytes 
Sat 18 Jan 2014 16:54:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:54:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:54:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:54:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:54:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:54:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:54:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:54:45 - XML: Processed 647722 elements - found 517 jobs
Sat 18 Jan 2014 16:54:46 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:54:46 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:54:46 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:54:46 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:54:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:54:46 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:54:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:54:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:54:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:54:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:54:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:54:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:54:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:54:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43716500
Sat 18 Jan 2014 16:54:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:54:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43716500
Sat 18 Jan 2014 16:54:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:54:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:54:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:54:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:54:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:54:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:54:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:54:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:54:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:54:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:54:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:54:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43716500
Sat 18 Jan 2014 16:54:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:55:01 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:55:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:55:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:55:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:55:08 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:55:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 16:55:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:55:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:55:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:55:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:55:13 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:55:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:55:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:55:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:55:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:55:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:55:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:55:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:55:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:55:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:55:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:55:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:55:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:55:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:55:16 - job_xml_thread(): Done retrieving: data size 43794825
Sat 18 Jan 2014 16:55:16 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:55:16 - XML: Start document: iteration 14
Sat 18 Jan 2014 16:55:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43794825
Sat 18 Jan 2014 16:55:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:55:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43794825
Sat 18 Jan 2014 16:55:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:55:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:55:27 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:55:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:55:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:55:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:55:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:55:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:55:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:55:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:55:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:55:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:55:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:55:35 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:55:35 - XML: Processed 655240 elements - found 517 jobs
Sat 18 Jan 2014 16:55:35 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:55:35 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:55:35 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:55:35 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:55:35 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:55:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:55:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 16:55:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 16:55:36 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:55:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5958 values 93994 bits 11749 bytes 
Sat 18 Jan 2014 16:55:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:55:37 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:55:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:55:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:55:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:55:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:55:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:55:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:55:38 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 16:55:38 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 16:55:38 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:55:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:55:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43802790
Sat 18 Jan 2014 16:55:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:55:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43802790
Sat 18 Jan 2014 16:55:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:55:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:55:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:55:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:55:48 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:55:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:55:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:55:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:55:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:55:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:55:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43802790
Sat 18 Jan 2014 16:55:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:55:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:55:50 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:55:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:55:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:55:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:55:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:55:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:56:00 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:56:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 16:56:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:56:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:56:02 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:56:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:56:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:56:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:56:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:56:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:56:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:56:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:56:03 - job_xml_thread(): Done retrieving: data size 43812517
Sat 18 Jan 2014 16:56:03 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:56:03 - XML: Start document: iteration 15
Sat 18 Jan 2014 16:56:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:56:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:56:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43812517
Sat 18 Jan 2014 16:56:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:56:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:56:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:56:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:56:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:56:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43812517
Sat 18 Jan 2014 16:56:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:56:17 - XML: Processed 655240 elements - found 517 jobs
Sat 18 Jan 2014 16:56:17 - job 7335128 appears to have finished
Sat 18 Jan 2014 16:56:17 - job_xml_thread(): Found 2 updated jobs.
Sat 18 Jan 2014 16:56:17 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 16:56:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:56:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:56:18 - job_xml_thread(): Done storing. succesfully stored: 2 jobs
Sat 18 Jan 2014 16:56:18 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:56:18 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:56:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:56:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:56:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:56:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:56:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:56:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:56:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:56:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:56:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:56:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:56:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:56:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:56:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:56:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:56:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:56:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:56:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:56:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:56:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:56:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:56:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43836137
Sat 18 Jan 2014 16:56:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:56:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43836137
Sat 18 Jan 2014 16:56:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:56:33 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:56:33 - job_xml_thread(): Done retrieving: data size 43836137
Sat 18 Jan 2014 16:56:33 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:56:33 - XML: Start document: iteration 16
Sat 18 Jan 2014 16:56:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:56:36 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:56:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:56:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:56:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:56:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 16:56:37 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:56:37 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:56:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9013 values 142131 bits 17766 bytes 
Sat 18 Jan 2014 16:56:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 16:56:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:56:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:56:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:56:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:56:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:56:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:56:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:56:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:56:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:56:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:56:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:56:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:56:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:56:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:56:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:56:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:56:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:56:50 - XML: Processed 655240 elements - found 517 jobs
Sat 18 Jan 2014 16:56:50 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:56:50 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:56:50 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:56:50 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:56:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:56:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43824496
Sat 18 Jan 2014 16:56:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:56:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43824496
Sat 18 Jan 2014 16:56:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:56:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:56:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:56:57 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:56:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 16:56:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:56:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:56:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:56:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:56:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:57:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:57:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:57:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:57:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43824496
Sat 18 Jan 2014 16:57:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:57:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:57:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:57:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:57:05 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:57:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:57:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:57:06 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:57:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:57:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:57:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:57:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:57:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:57:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:57:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:57:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:57:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:57:11 - job_xml_thread(): Done retrieving: data size 43817786
Sat 18 Jan 2014 16:57:11 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:57:11 - XML: Start document: iteration 17
Sat 18 Jan 2014 16:57:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43817786
Sat 18 Jan 2014 16:57:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:57:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:57:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:57:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:57:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:57:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:57:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:57:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43817786
Sat 18 Jan 2014 16:57:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:57:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:57:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:57:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:57:31 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:57:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:57:32 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:57:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:57:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:57:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:57:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:57:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:57:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:57:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:57:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:57:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:57:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:57:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:57:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:57:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:57:34 - XML: Processed 655240 elements - found 517 jobs
Sat 18 Jan 2014 16:57:34 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:57:34 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:57:34 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:57:34 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:57:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:57:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43850443
Sat 18 Jan 2014 16:57:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:57:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43850443
Sat 18 Jan 2014 16:57:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:57:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:57:37 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:57:38 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:57:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 16:57:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:57:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 16:57:38 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:57:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148629 bits 18578 bytes 
Sat 18 Jan 2014 16:57:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:57:46 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:57:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:57:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:57:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:57:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:57:49 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:57:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:57:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:57:50 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:57:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:57:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:57:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:57:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:57:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:57:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:57:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:57:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:57:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:57:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:57:50 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 16:57:50 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:57:51 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:57:51 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 16:57:51 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 16:57:51 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:57:51 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 16:57:52 - size of cluster 'LISA Cluster': 624 hosts 79480 metrics 810228 values 12775162 bits 1596895 bytes 
Sat 18 Jan 2014 16:57:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:57:54 - job_xml_thread(): Done retrieving: data size 43836020
Sat 18 Jan 2014 16:57:54 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:57:54 - XML: Start document: iteration 18
Sat 18 Jan 2014 16:57:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43836020
Sat 18 Jan 2014 16:57:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:57:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43836020
Sat 18 Jan 2014 16:57:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:58:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:58:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:58:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:58:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:58:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:58:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:58:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:58:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:58:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:58:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:58:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:58:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:58:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:58:12 - XML: Processed 655238 elements - found 516 jobs
Sat 18 Jan 2014 16:58:12 - job 7349116 appears to have finished
Sat 18 Jan 2014 16:58:12 - job_xml_thread(): Found 1 updated jobs.
Sat 18 Jan 2014 16:58:12 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 16:58:13 - job_xml_thread(): Done storing. succesfully stored: 1 jobs
Sat 18 Jan 2014 16:58:13 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:58:13 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:58:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:58:18 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:58:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:58:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:58:18 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:58:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 16:58:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:58:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:58:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:58:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:58:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:58:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:58:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43831764
Sat 18 Jan 2014 16:58:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:58:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43831764
Sat 18 Jan 2014 16:58:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:58:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:58:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:58:28 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:58:28 - job_xml_thread(): Done retrieving: data size 43831764
Sat 18 Jan 2014 16:58:28 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:58:28 - XML: Start document: iteration 19
Sat 18 Jan 2014 16:58:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:58:31 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:58:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:58:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:58:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:58:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:58:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:58:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:58:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:58:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:58:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:58:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:58:38 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:58:39 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:58:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 16:58:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:58:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 16:58:39 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:58:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5860 values 92440 bits 11555 bytes 
Sat 18 Jan 2014 16:58:43 - XML: Processed 655238 elements - found 516 jobs
Sat 18 Jan 2014 16:58:43 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:58:43 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:58:43 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:58:43 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:58:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:58:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:58:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:58:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:58:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:58:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:58:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:58:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:58:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:58:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43806892
Sat 18 Jan 2014 16:58:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:58:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:58:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:58:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43806892
Sat 18 Jan 2014 16:58:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:58:51 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:58:51 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 16:58:58 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:58:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:58:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:58:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:58:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:58:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:58:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:58:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:59:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:59:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:59:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:59:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:59:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:59:05 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:59:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:59:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:59:05 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:59:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 16:59:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:59:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:59:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:59:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:59:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:59:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:59:08 - job_xml_thread(): Done retrieving: data size 43835274
Sat 18 Jan 2014 16:59:08 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:59:08 - XML: Start document: iteration 20
Sat 18 Jan 2014 16:59:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43835274
Sat 18 Jan 2014 16:59:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:59:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43835274
Sat 18 Jan 2014 16:59:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:59:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:59:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:59:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:59:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:59:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:59:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:59:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:59:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:59:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:59:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:59:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:59:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:59:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:59:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:59:31 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:59:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:59:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:59:32 - XML: Processed 655238 elements - found 516 jobs
Sat 18 Jan 2014 16:59:32 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 16:59:32 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 16:59:32 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 16:59:32 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 16:59:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:59:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:59:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:59:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:59:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:59:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43329410
Sat 18 Jan 2014 16:59:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 16:59:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43329410
Sat 18 Jan 2014 16:59:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:59:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:59:39 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:59:40 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:59:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:59:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 16:59:40 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 16:59:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8669 values 136655 bits 17081 bytes 
Sat 18 Jan 2014 16:59:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 16:59:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 16:59:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:59:47 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 16:59:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 16:59:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 16:59:48 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 16:59:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 16:59:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 16:59:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 16:59:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 16:59:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:59:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 16:59:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 16:59:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 16:59:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 16:59:52 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 16:59:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 16:59:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 16:59:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:59:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 16:59:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 16:59:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 16:59:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 16:59:56 - job_xml_thread(): Done retrieving: data size 43158855
Sat 18 Jan 2014 16:59:56 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 16:59:56 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 16:59:56 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 16:59:56 - Housekeeping: done.
Sat 18 Jan 2014 16:59:56 - XML: Start document: iteration 0
Sat 18 Jan 2014 16:59:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43158855
Sat 18 Jan 2014 16:59:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 16:59:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43158855
Sat 18 Jan 2014 16:59:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:00:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:00:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:00:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:00:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:00:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:00:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:00:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:00:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:00:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:00:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:00:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:00:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:00:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:00:18 - XML: Processed 647190 elements - found 516 jobs
Sat 18 Jan 2014 17:00:18 - job 7335221 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:18 - job 7335220 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:18 - job 7335223 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:18 - job 7335222 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:18 - job 7335225 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:18 - job 7335224 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:18 - job 7335227 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:18 - job 7335226 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:18 - job 7335229 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:18 - job 7335228 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:18 - job 7346015 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:18 - job 7339776 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:18 - job 7341721 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:18 - job 7340333 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:18 - job 7340330 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:18 - job 7340337 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:18 - job 7340484 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:18 - job 7337749 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:18 - job 7337590 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:18 - job 7343918 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:18 - job 7344401 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:18 - job 7344400 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:18 - job 7344403 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:18 - job 7344402 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:18 - job 7344405 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:18 - job 7344404 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:18 - job 7344407 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:18 - job 7344406 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:18 - job 7344409 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:18 - job 7344408 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:18 - job 7343768 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:18 - job 7341823 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:18 - job 7338797 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:18 - job 7338790 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:18 - job 7335699 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:18 - job 7348454 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:18 - job 7335439 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:18 - job 7335239 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:18 - job 7335232 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:18 - job 7335230 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:18 - job 7335231 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:18 - job 7344382 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:18 - job 7339993 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:18 - job 7344418 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:18 - job 7340781 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:18 - job 7344416 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:18 - job 7344417 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:18 - job 7344414 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:18 - job 7344415 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7344412 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7344413 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7344410 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7344411 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7338953 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7338775 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7343787 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7337863 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7335401 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7335400 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7335403 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7335402 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7335405 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7335404 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7335406 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7348632 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7348633 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7335249 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7335248 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7335246 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7348255 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7340339 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7337345 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7337341 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7336194 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7344419 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7339232 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7337500 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7340310 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7336999 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7344427 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7337261 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7341893 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7344399 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7344398 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7344016 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7344391 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7344390 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7344393 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7344392 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7344395 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7344394 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7344397 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7344396 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7338806 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7338411 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7335485 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7338343 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7348435 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7342415 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7335259 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7335250 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7335254 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7335255 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7337272 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7340972 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7345705 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7337799 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7337400 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7341273 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7338475 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7338870 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7343952 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7344379 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7344378 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7344373 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7344372 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7344371 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7344370 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7344377 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7344376 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7344375 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7344374 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7344386 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7344387 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7344384 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7344385 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7338572 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7344383 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7344380 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7344381 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7344388 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7344389 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7335544 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7335395 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7335397 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7337899 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7342698 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7348970 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7335260 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7339484 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7347391 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7346830 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7347335 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7336565 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7346841 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7337641 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7337640 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7337643 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7337645 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7337646 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7345031 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7344430 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7344431 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7349113 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7349097 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7344368 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7344369 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7344360 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7344361 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7344362 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7344363 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7344364 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7344365 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7344366 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7344367 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7344440 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7335389 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7335576 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7348968 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7348969 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7348966 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7348967 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7348964 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7348965 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7348963 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7335273 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7335271 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7335276 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7335376 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7335375 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7339391 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7339156 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7341677 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7345099 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7341100 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7341194 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7340351 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7343632 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7343634 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7343639 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7344425 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7344356 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:19 - job 7338208 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:20 - job 7344422 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:20 - job 7344421 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:20 - job 7344420 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:20 - job 7344426 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:20 - job 7344357 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:20 - job 7344424 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:20 - job 7344423 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:20 - job 7335866 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:20 - job 7344359 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:20 - job 7344358 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:20 - job 7344429 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:20 - job 7344428 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:20 - job 7338514 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:00:20 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:00:20 - job 7340309 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:20 - job 7348773 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:20 - job 7335361 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:20 - job 7335364 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:20 - job 7335365 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:20 - job 7335218 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:20 - job 7335219 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:20 - job 7341443 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:20 - job 7339966 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:20 - job 7341063 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:20 - job 7345647 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:20 - job 7344434 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:20 - job 7344435 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:20 - job 7344436 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:20 - job 7344437 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:20 - job 7344432 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:20 - job 7344433 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:20 - job 7344438 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:20 - job 7344439 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:20 - job 7343751 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:20 - job 7343472 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:20 - job 7340659 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:20 - job 7338784 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:20 - job 7335903 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:20 - job 7342715 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:20 - job 7342714 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:20 - job 7335424 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:20 - job 7335423 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:20 - job 7335422 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:20 - job 7335421 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:20 - job 7338025 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:20 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:00:20 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:00:20 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:00:20 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:00:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:00:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:00:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:00:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:00:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:00:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:00:20 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:00:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 17:00:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:00:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:00:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43212127
Sat 18 Jan 2014 17:00:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:00:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43212127
Sat 18 Jan 2014 17:00:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:00:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:00:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:00:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:00:33 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:00:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:00:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:00:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:00:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:00:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:00:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:00:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:00:35 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:00:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:00:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:00:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:00:37 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:00:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:00:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:00:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:00:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:00:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:00:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:00:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:00:40 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:00:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:00:40 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:00:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 17:00:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 17:00:40 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:00:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5800 values 91434 bits 11429 bytes 
Sat 18 Jan 2014 17:00:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:00:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43696430
Sat 18 Jan 2014 17:00:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:00:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43696430
Sat 18 Jan 2014 17:00:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:00:41 - job_xml_thread(): Done retrieving: data size 43696430
Sat 18 Jan 2014 17:00:41 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:00:41 - XML: Start document: iteration 1
Sat 18 Jan 2014 17:00:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:00:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:00:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:00:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:00:57 - XML: Processed 653936 elements - found 516 jobs
Sat 18 Jan 2014 17:00:57 - job 7335221 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:57 - job 7335220 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:57 - job 7335223 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:57 - job 7335222 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:57 - job 7335225 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:57 - job 7335224 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:57 - job 7335227 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:57 - job 7335226 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:57 - job 7335229 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:57 - job 7335228 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:57 - job 7346015 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:57 - job 7339776 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:57 - job 7341721 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:57 - job 7340333 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:57 - job 7340330 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:58 - job 7340337 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:58 - job 7340484 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:58 - job 7337749 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:58 - job 7337590 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:58 - job 7343918 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:58 - job 7344401 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:58 - job 7344400 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:58 - job 7344403 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:58 - job 7344402 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:58 - job 7344405 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:58 - job 7344404 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:58 - job 7344407 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:58 - job 7344406 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:58 - job 7344409 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:58 - job 7344408 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:58 - job 7343768 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:58 - job 7341823 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:58 - job 7338797 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:58 - job 7338790 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:58 - job 7335699 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:58 - job 7348454 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:58 - job 7335439 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:58 - job 7335239 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:58 - job 7335232 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:58 - job 7335230 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:58 - job 7335231 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:58 - job 7344382 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:58 - job 7339993 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:58 - job 7344418 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:58 - job 7340781 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:58 - job 7344416 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:58 - job 7344417 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:58 - job 7344414 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:58 - job 7344415 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:58 - job 7344412 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:58 - job 7344413 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:58 - job 7344410 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:58 - job 7344411 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:00:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:00:58 - job 7338953 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:58 - job 7338775 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:58 - job 7343787 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:58 - job 7337863 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:58 - job 7335401 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:00:58 - job 7335400 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:58 - job 7335403 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:00:58 - job 7335402 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:58 - job 7335405 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:58 - job 7335404 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7335406 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7348632 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7348633 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7335249 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7335248 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7335246 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7348255 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7340339 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7337345 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7337341 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7336194 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7344419 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7339232 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7337500 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7340310 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7336999 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7344427 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7337261 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7341893 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7344399 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7344398 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7344016 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7344391 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7344390 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7344393 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7344392 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7344395 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7344394 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7344397 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7344396 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7338806 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7338411 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7335485 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7338343 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7348435 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7342415 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7335259 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7335250 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7335254 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7335255 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7340309 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7337272 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7340972 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7345705 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7337799 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7337400 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7341273 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7338475 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7338870 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7343952 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7344379 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7344378 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7344373 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7344372 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7344371 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7344370 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7344377 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7344376 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7344375 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7344374 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7344386 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7344387 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7344384 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7344385 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7338572 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:00:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:00:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:00:59 - job 7344383 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7344380 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7344381 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7344388 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7344389 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7335544 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7335395 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:00:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:00:59 - job 7335397 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7337899 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7342698 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7348970 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7335260 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7339484 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7347391 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:00:59 - job 7346830 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7347335 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7336565 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7346841 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7337641 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7337640 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7337643 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7337645 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7337646 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7345031 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7344433 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7349097 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7344368 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7344369 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7344360 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7344361 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7344362 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7344363 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7344364 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7344365 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7344366 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7344367 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7344440 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7335389 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7335576 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7348968 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7348969 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7348966 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7348967 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7348964 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7348965 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7348963 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7335273 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7335271 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7335276 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7335376 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7335375 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7339391 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7339156 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7341677 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7345099 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7341100 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7341194 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7340351 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7343632 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7343634 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7343639 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7344425 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7344356 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7338208 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7344421 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7344420 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7344426 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7344357 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7344424 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7344423 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7344422 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7335866 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7344359 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7344358 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7344429 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7344428 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7338514 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7348773 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7335361 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7335364 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7335365 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7335218 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7335219 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7341443 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7339966 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7341063 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7345647 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7344434 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7344435 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7344436 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7344437 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7344430 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7344431 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7344432 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7349113 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7344438 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7344439 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7343751 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7343472 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7340659 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7338784 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7335903 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7342715 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7342714 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7335424 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7335423 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7335422 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7335421 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job 7338025 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:00 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:01:00 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:01:00 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:01:00 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:01:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:01:02 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:01:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:01:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:01:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:01:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:01:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:01:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:01:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:01:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43827307
Sat 18 Jan 2014 17:01:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:01:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43827307
Sat 18 Jan 2014 17:01:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:01:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:01:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:01:15 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:01:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 17:01:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:01:16 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:01:16 - job_xml_thread(): Done retrieving: data size 43827307
Sat 18 Jan 2014 17:01:16 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:01:16 - XML: Start document: iteration 2
Sat 18 Jan 2014 17:01:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:01:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:01:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:01:19 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:01:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:01:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:01:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:01:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:01:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:01:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:01:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:01:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:01:27 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:01:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:01:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:01:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:01:29 - XML: Processed 655076 elements - found 516 jobs
Sat 18 Jan 2014 17:01:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:01:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:01:29 - job 7335221 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7335220 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7335223 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:01:29 - job 7335222 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7335225 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7335224 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7335227 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7335226 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7335229 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7335228 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7346015 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7339776 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7341721 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7340333 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7340330 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7340337 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7340484 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7337749 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7337590 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7343918 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344401 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344400 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344403 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344402 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344405 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344404 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344407 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344406 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344409 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344408 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7343768 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7341823 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7338797 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7338790 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7335699 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7348454 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7335439 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7335239 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7335232 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7335230 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7335231 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344382 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7339993 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344418 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7340781 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344416 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344417 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344414 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344415 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344412 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344413 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344410 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344411 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7338953 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7338775 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7343787 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7337863 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7335401 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7335400 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7335403 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7335402 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7335405 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7335404 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7335406 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7348632 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7348633 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7335249 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7335248 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7335246 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7348255 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7340339 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7337345 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7337341 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7336194 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344419 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7339232 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7337500 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7340310 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7336999 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344427 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7337261 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7341893 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344399 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344398 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344016 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344391 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344390 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344393 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344392 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344395 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344394 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344397 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344396 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7338806 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7338411 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7335485 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7338343 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7348435 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7342415 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7335259 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7335250 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7335254 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7335255 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7340309 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7337272 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7340972 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7345705 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7337799 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7337400 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7341273 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7338475 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7338870 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7343952 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344379 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344378 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344373 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344372 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344371 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344370 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344377 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344376 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344375 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344374 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344386 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344387 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344384 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344385 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7338572 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344383 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344380 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344381 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344388 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344389 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7335544 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7335395 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7335397 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7337899 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7342698 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7348970 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7335260 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7339484 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7347391 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7346830 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7347335 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7336565 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7346841 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7337641 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7337640 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7337643 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7337645 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7337646 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7345031 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344433 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7349097 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344368 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344369 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344360 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344361 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344362 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344363 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344364 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344365 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344366 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344367 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344440 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7335389 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7335576 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7348968 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7348969 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7348966 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7348967 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7348964 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7348965 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7348963 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7335273 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7335271 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7335276 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7335376 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7335375 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7339391 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7339156 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7341677 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7345099 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7341100 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7341194 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7340351 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7343632 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7343634 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7343639 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344425 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344356 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7338208 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344421 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344420 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344426 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344357 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344424 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344423 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344422 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7335866 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344359 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344358 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344429 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344428 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7338514 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7348773 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7335361 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7335364 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7335365 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7335218 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7335219 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7341443 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7339966 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7341063 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7345647 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344434 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344435 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344436 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344437 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344430 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344431 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344432 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7349113 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344438 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7344439 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7343751 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7343472 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7340659 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7338784 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7335903 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7342715 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7342714 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7335424 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7335423 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7335422 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7335421 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job 7338025 report time 1390060609 does not match current heartbeat 0 : ignoring job
Sat 18 Jan 2014 17:01:29 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:01:29 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:01:29 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:01:29 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:01:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:01:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43814150
Sat 18 Jan 2014 17:01:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:01:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43814150
Sat 18 Jan 2014 17:01:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:01:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:01:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:01:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:01:40 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:01:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:01:41 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:01:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 17:01:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 17:01:41 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:01:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6265 values 98981 bits 12372 bytes 
Sat 18 Jan 2014 17:01:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:01:44 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:01:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:01:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:01:44 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:01:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:01:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:01:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:01:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:01:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:01:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:01:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:01:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:01:48 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:01:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:01:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:01:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:01:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:01:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:01:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:01:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:01:51 - job_xml_thread(): Done retrieving: data size 43817799
Sat 18 Jan 2014 17:01:51 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:01:51 - XML: Start document: iteration 3
Sat 18 Jan 2014 17:01:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43817799
Sat 18 Jan 2014 17:01:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:01:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43817799
Sat 18 Jan 2014 17:01:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:02:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:02:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:02:00 - XML: Processed 655235 elements - found 516 jobs
Sat 18 Jan 2014 17:02:00 - job 7335221 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:00 - job 7335220 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:00 - job 7335223 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:00 - job 7335222 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:00 - job 7335225 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:00 - job 7335224 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:00 - job 7335227 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:00 - job 7335226 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7335229 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7335228 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7346015 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7339776 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7341721 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7340333 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7340330 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7340337 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7340484 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7337749 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7337590 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7343918 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7344401 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7344400 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7344403 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7344402 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7344405 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7344404 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7344407 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7344406 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7344409 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7344408 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7343768 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7341823 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7338797 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7338790 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7335699 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7348454 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7335439 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7335239 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7335232 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7335230 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7335231 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7344382 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7339993 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7344418 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7340781 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7344416 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7344417 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7344414 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7344415 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7344412 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7344413 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7344410 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7344411 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7338953 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7338775 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7343787 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7337863 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7335401 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7335400 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7335403 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7335402 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7335405 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7335404 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7335406 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7348632 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7348633 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7335249 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7335248 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7335246 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7348255 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7340339 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7337345 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7337341 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7336194 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7344419 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7339232 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7337500 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7340310 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7336999 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7344427 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7337261 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7341893 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7344399 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7344398 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7344016 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7344391 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7344390 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7344393 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7344392 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7344395 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7344394 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7344397 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7344396 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7338806 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7338411 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7335485 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7338343 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7348435 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7342415 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7335259 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7335250 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7335254 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7335255 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7340309 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7337272 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7340972 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7345705 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7337799 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7337400 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7341273 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7338475 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7338870 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7343952 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7344379 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7344378 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7344373 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7344372 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7344371 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7344370 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7344377 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7344376 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7344375 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7344374 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7344386 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7344387 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7344384 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7344385 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7338572 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:01 - job 7344383 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:02 - job 7344380 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:02 - job 7344381 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:02 - job 7344388 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:02 - job 7344389 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:02 - job 7335544 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:02 - job 7335395 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:02 - job 7335397 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:02 - job 7337899 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:02 - job 7342698 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:02 - job 7348970 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:02 - job 7335260 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:02 - job 7339484 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:02 - job 7347391 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:02 - job 7346830 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:02 - job 7347335 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:02 - job 7336565 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:02 - job 7346841 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:02 - job 7337641 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:02 - job 7337640 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:02 - job 7337643 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:02 - job 7337645 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:02 - job 7337646 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:02 - job 7345031 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:02 - job 7344433 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:02 - job 7349097 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:02 - job 7344368 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:02 - job 7344369 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:02 - job 7344360 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:02 - job 7344361 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:02 - job 7344362 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:02 - job 7344363 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:02 - job 7344364 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:02 - job 7344365 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:02 - job 7344366 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:02 - job 7344367 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:02 - job 7344440 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:02 - job 7335389 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:02 - job 7335576 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:02 - job 7348968 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:02 - job 7348969 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7348966 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7348967 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7348964 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7348965 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7348963 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7335273 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7335271 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7335276 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7335376 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7335375 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7339391 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7339156 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7341677 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7345099 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7341100 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7341194 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7340351 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7343632 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7343634 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7343639 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7344425 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7344356 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7338208 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7344421 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7344420 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7344426 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7344357 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7344424 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7344423 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7344422 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7335866 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7344359 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7344358 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7344429 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7344428 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7338514 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7348773 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7335361 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7335364 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7335365 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7335218 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7335219 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7341443 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7339966 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7341063 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7345647 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7344434 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7344435 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:02:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:02:03 - job 7344436 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7344437 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7344430 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7344431 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7344432 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7349113 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7344438 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7344439 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7343751 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7343472 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7340659 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7338784 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7335903 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7342715 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7342714 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7335424 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7335423 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7335422 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7335421 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job 7338025 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:03 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:02:03 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:02:03 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:02:03 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:02:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:02:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:02:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:02:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:02:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:02:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:02:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:02:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:02:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:02:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:02:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:02:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:02:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:02:16 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:02:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 17:02:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:02:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:02:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:02:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:02:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:02:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:02:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43848587
Sat 18 Jan 2014 17:02:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:02:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43848587
Sat 18 Jan 2014 17:02:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:02:20 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:02:20 - job_xml_thread(): Done retrieving: data size 43848587
Sat 18 Jan 2014 17:02:20 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:02:20 - XML: Start document: iteration 4
Sat 18 Jan 2014 17:02:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:02:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:02:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:02:29 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:02:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:02:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:02:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:02:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:02:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:02:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:02:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:02:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:02:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:02:36 - XML: Processed 655238 elements - found 516 jobs
Sat 18 Jan 2014 17:02:36 - job 7335221 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7335220 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7335223 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7335222 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7335225 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7335224 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7335227 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7335226 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7335229 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7335228 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7346015 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7339776 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7341721 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7340333 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7340330 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7340337 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7340484 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7337749 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7337590 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7343918 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344401 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344400 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344403 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344402 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344405 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344404 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344407 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344406 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344409 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344408 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7343768 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7341823 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7338797 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7338790 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7335699 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7348454 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7335439 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7335239 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7335232 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7335230 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7335231 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344382 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7339993 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344418 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7340781 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344416 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344417 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344414 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344415 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344412 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344413 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344410 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344411 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7338953 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7338775 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7343787 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7337863 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7335401 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7335400 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7335403 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7335402 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7335405 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7335404 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7335406 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7348632 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7348633 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7335249 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7335248 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7335246 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7348255 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7340339 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7337345 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7337341 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7336194 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344419 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7339232 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7337500 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7340310 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7336999 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344427 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7337261 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7341893 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344399 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344398 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344016 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344391 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344390 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344393 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344392 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344395 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344394 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344397 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344396 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7338806 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7338411 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7335485 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7338343 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7348435 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7342415 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7335259 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7335250 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7335254 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7335255 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7340309 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7337272 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7340972 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7345705 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7337799 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7337400 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7341273 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7338475 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7338870 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7343952 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344379 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344378 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344373 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344372 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344371 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344370 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344377 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344376 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344375 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344374 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344386 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344387 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344384 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344385 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7338572 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344383 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344380 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344381 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344388 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344389 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7335544 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7335395 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7335397 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7337899 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7342698 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7348970 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7335260 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7339484 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7347391 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7346830 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7347335 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7336565 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7346841 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7337641 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7337640 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7337643 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7337645 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7337646 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7345031 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344433 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7349097 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344368 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344369 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344360 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344361 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344362 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344363 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344364 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344365 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344366 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344367 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344440 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7335389 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7335576 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7348968 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7348969 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7348966 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7348967 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7348964 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7348965 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7348963 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7335273 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7335271 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7335276 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7335376 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7335375 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7339391 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7339156 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7341677 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7345099 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7341100 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7341194 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7340351 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7343632 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7343634 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7343639 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344425 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344356 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7338208 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344421 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344420 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344426 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344357 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344424 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344423 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344422 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7335866 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344359 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344358 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344429 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344428 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7338514 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7348773 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7335361 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7335364 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7335365 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7335218 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7335219 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7341443 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7339966 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7341063 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7345647 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344434 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344435 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344436 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344437 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344430 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344431 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344432 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7349113 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344438 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7344439 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7343751 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7343472 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7340659 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7338784 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7335903 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7342715 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7342714 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7335424 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7335423 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7335422 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7335421 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job 7338025 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:02:36 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:02:36 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:02:36 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:02:36 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:02:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:02:40 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:02:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:02:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:02:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:02:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:02:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:02:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:02:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:02:41 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:02:42 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:02:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 17:02:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:02:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 17:02:42 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:02:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5820 values 92108 bits 11513 bytes 
Sat 18 Jan 2014 17:02:42 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 17:02:42 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 17:02:42 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:02:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:02:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43805943
Sat 18 Jan 2014 17:02:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:02:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43805943
Sat 18 Jan 2014 17:02:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:02:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:02:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:02:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:02:51 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:02:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:02:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:02:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:02:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:02:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:02:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:02:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43805943
Sat 18 Jan 2014 17:02:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:02:52 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:02:52 - job_xml_thread(): Done retrieving: data size 43805943
Sat 18 Jan 2014 17:02:52 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:02:52 - XML: Start document: iteration 5
Sat 18 Jan 2014 17:02:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:02:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:03:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:03:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:03:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:03:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:03:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:03:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:03:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:03:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:03:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:03:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:03:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:03:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:03:10 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:03:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:03:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:03:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:03:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:03:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:03:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:03:11 - XML: Processed 655238 elements - found 516 jobs
Sat 18 Jan 2014 17:03:11 - job 7335221 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7335220 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7335223 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7335222 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7335225 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7335224 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7335227 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7335226 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7335229 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7335228 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7346015 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7339776 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7341721 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7340333 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7340330 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7340337 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7340484 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7337749 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7337590 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7343918 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344401 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344400 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344403 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344402 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344405 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344404 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344407 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344406 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344409 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344408 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7343768 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7341823 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7338797 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7338790 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7335699 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7348454 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7335439 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7335239 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7335232 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7335230 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7335231 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344382 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7339993 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344418 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7340781 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344416 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344417 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344414 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344415 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344412 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344413 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344410 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344411 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7338953 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7338775 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7343787 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7337863 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7335401 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7335400 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7335403 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7335402 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7335405 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7335404 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7335406 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7348632 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7348633 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7335249 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7335248 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7335246 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7348255 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7340339 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7337345 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7337341 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7336194 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344419 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7339232 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7337500 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7340310 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7336999 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344427 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7337261 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7341893 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344399 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344398 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344016 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344391 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344390 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344393 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344392 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344395 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344394 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344397 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344396 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7338806 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7338411 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7335485 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7338343 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7348435 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7342415 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7335259 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7335250 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7335254 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7335255 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7340309 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7337272 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7340972 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7345705 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7337799 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7337400 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7341273 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7338475 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7338870 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7343952 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344379 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344378 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344373 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344372 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344371 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344370 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344377 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344376 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344375 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344374 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344386 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344387 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344384 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344385 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7338572 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344383 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344380 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344381 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344388 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344389 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7335544 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7335395 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7335397 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7337899 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7342698 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7348970 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7335260 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7339484 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7347391 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7346830 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7347335 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7336565 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7346841 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7337641 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7337640 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7337643 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7337645 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7337646 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7345031 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344433 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7349097 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344368 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344369 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344360 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344361 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344362 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344363 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344364 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344365 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344366 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344367 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344440 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7335389 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7335576 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7348968 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7348969 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7348966 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7348967 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7348964 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7348965 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7348963 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7335273 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7335271 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7335276 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7335376 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7335375 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7339391 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7339156 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7341677 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7345099 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7341100 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7341194 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7340351 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7343632 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7343634 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7343639 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344425 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344356 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7338208 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344421 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344420 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344426 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344357 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344424 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344423 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344422 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7335866 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344359 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344358 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344429 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344428 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7338514 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7348773 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7335361 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7335364 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7335365 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7335218 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7335219 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7341443 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7339966 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7341063 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7345647 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344434 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344435 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344436 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344437 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344430 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344431 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344432 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7349113 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344438 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7344439 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7343751 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7343472 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7340659 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7338784 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7335903 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7342715 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7342714 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7335424 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7335423 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7335422 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7335421 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job 7338025 report time 1390060609 does not match current heartbeat 1390060850 : ignoring job
Sat 18 Jan 2014 17:03:11 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:03:11 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:03:11 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:03:11 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:03:12 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:03:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 17:03:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:03:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:03:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43835379
Sat 18 Jan 2014 17:03:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:03:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43835379
Sat 18 Jan 2014 17:03:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:03:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:03:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:03:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:03:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:03:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:03:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:03:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:03:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:03:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:03:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:03:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:03:26 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:03:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:03:27 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:03:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:03:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:03:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:03:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:03:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:03:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:03:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:03:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43648701
Sat 18 Jan 2014 17:03:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:03:29 - job_xml_thread(): Done retrieving: data size 43648701
Sat 18 Jan 2014 17:03:29 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:03:29 - XML: Start document: iteration 6
Sat 18 Jan 2014 17:03:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43648701
Sat 18 Jan 2014 17:03:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:03:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:03:39 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:03:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:03:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:03:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:03:42 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:03:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:03:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:03:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:03:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:03:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:03:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:03:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:03:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:03:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 17:03:43 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:03:43 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:03:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 17:03:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7503 values 118544 bits 14818 bytes 
Sat 18 Jan 2014 17:03:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:03:49 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:03:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:03:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:03:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:03:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:03:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:03:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:03:51 - XML: Processed 654202 elements - found 0 jobs
Sat 18 Jan 2014 17:03:51 - job 7345079 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7345078 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7345077 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7345076 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7345075 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7345074 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7345073 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7345072 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7345071 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7345070 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7344758 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7337117 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7337112 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7344751 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7344750 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7344753 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7344752 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7344755 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7337118 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7344757 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7344756 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7343761 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7335168 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7335160 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7335166 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7335167 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7335164 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7335165 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7349028 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7349104 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7344351 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7335184 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348981 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348982 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7335187 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7335180 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7335181 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7335182 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7335183 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348988 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348989 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7335188 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7335189 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348338 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348331 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348607 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348935 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348934 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348937 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348936 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348931 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348930 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348933 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348932 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348939 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348938 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7346092 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7346097 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7345068 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7345069 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7345064 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7345065 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7345066 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7345067 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7345998 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7345999 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7346784 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7337106 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7337104 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7340327 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7337217 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7344746 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7344748 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7344749 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7349048 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7335615 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7344354 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348423 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348421 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348634 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348326 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348957 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7344759 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348955 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348954 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348953 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348952 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348951 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348950 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348959 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348958 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7346256 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7346255 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348889 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348251 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348929 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7344754 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7346047 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7346724 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7336991 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7345934 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7344645 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7345081 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7345944 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7345949 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7349026 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7335133 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7335132 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7335135 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7335134 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7335136 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348436 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348647 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348646 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348319 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348944 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348945 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348940 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348941 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348942 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348943 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7347713 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348980 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348896 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348894 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348892 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348890 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348898 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7346235 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7346757 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7340349 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348378 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7337572 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7344657 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7336871 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7336870 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7336879 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7345957 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7344571 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348946 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348947 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348948 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348949 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348302 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348303 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348308 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348973 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348972 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348974 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348977 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348976 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348979 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348978 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7335061 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7349115 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7349117 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7349118 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7349093 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7349095 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7335152 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7335151 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7335150 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7335157 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7335156 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7335159 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7335158 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348384 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348956 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348684 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348683 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348682 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348962 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348960 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348961 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348362 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7347823 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7335207 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7335206 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7335205 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7335204 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7335203 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7335202 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7335200 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7335208 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348844 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348847 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348846 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348843 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348842 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7341372 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7344355 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7344353 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7344352 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348983 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348984 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348985 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348986 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348987 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7335141 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7335142 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7335143 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7335144 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7335149 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7337829 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7343590 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7349101 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7337098 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348678 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348677 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348690 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348692 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348591 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348590 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348218 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348219 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348609 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348608 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348606 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348605 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348604 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348603 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348602 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7347690 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7347695 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7335214 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7335215 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7335216 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7335217 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7335210 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7335211 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7335212 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7335213 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7345082 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7345083 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7345080 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7345084 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7345085 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7346764 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7340346 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7340347 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7344760 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7344761 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7344762 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7344763 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7343905 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7343691 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7343754 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7335175 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7335174 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7335176 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7335171 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7335173 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7335172 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348589 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7335190 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348449 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348448 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348445 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348446 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348900 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348901 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7335197 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7335196 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7335195 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348990 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348588 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7335192 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7335191 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348587 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7335199 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7335198 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348618 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348614 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348616 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348617 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348610 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348611 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348612 appears to have finished
Sat 18 Jan 2014 17:03:51 - job 7348613 appears to have finished
Sat 18 Jan 2014 17:03:51 - job_xml_thread(): Found 279 updated jobs.
Sat 18 Jan 2014 17:03:51 - job_xml_thread(): Storing jobs to database..
Sat 18 Jan 2014 17:03:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:03:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43621515
Sat 18 Jan 2014 17:03:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:03:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43621515
Sat 18 Jan 2014 17:03:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:03:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:03:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:04:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:04:03 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:04:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:04:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:04:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:04:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:04:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:04:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:04:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:04:04 - job_xml_thread(): Done storing. succesfully stored: 279 jobs
Sat 18 Jan 2014 17:04:04 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:04:04 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:04:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:04:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:04:06 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:04:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 17:04:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:04:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:04:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:04:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:04:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:04:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:04:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:04:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:04:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:04:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:04:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43624490
Sat 18 Jan 2014 17:04:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:04:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43624490
Sat 18 Jan 2014 17:04:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:04:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:04:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:04:19 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:04:19 - job_xml_thread(): Done retrieving: data size 43624490
Sat 18 Jan 2014 17:04:19 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:04:19 - XML: Start document: iteration 7
Sat 18 Jan 2014 17:04:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:04:20 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:04:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:04:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:04:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:04:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:04:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:04:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:04:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:04:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:04:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:04:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:04:30 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:04:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:04:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:04:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:04:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:04:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:04:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:04:32 - XML: Processed 654202 elements - found 0 jobs
Sat 18 Jan 2014 17:04:32 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:04:32 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:04:32 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:04:32 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:04:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:04:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43626033
Sat 18 Jan 2014 17:04:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:04:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43626033
Sat 18 Jan 2014 17:04:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:04:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:04:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:04:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:04:42 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:04:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:04:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:04:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:04:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:04:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:04:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:04:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:04:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:04:43 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:04:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:04:44 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:04:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 17:04:44 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:04:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 17:04:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9066 values 143062 bits 17882 bytes 
Sat 18 Jan 2014 17:04:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:04:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:04:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:04:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:04:47 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:04:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:04:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:04:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:04:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:04:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:04:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43659086
Sat 18 Jan 2014 17:04:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:04:48 - job_xml_thread(): Done retrieving: data size 43659086
Sat 18 Jan 2014 17:04:48 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:04:48 - XML: Start document: iteration 8
Sat 18 Jan 2014 17:04:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43659086
Sat 18 Jan 2014 17:04:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:04:51 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 17:04:51 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:04:53 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:04:53 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 17:04:53 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 17:04:53 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:04:55 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 17:04:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:04:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:05:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:05:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:05:05 - size of cluster 'LISA Cluster': 624 hosts 79471 metrics 796319 values 12576222 bits 1572027 bytes 
Sat 18 Jan 2014 17:05:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:05:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:05:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:05:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:05:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:05:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:05:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:05:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:05:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:05:11 - XML: Processed 654202 elements - found 0 jobs
Sat 18 Jan 2014 17:05:11 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:05:11 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:05:11 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:05:11 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:05:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:05:12 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:05:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:05:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:05:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:05:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:05:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:05:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:05:12 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:05:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 17:05:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:05:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:05:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577402
Sat 18 Jan 2014 17:05:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:05:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577402
Sat 18 Jan 2014 17:05:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:05:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:05:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:05:26 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:05:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:05:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:05:26 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:05:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:05:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:05:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:05:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:05:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:05:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:05:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:05:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:05:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:05:29 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:05:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:05:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:05:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:05:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:05:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:05:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:05:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:05:32 - job_xml_thread(): Done retrieving: data size 43208953
Sat 18 Jan 2014 17:05:32 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:05:32 - XML: Start document: iteration 9
Sat 18 Jan 2014 17:05:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43208953
Sat 18 Jan 2014 17:05:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43208953
Sat 18 Jan 2014 17:05:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:05:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:05:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:05:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:05:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:05:44 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:05:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:05:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 17:05:44 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:05:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 17:05:44 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:05:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8970 values 141490 bits 17686 bytes 
Sat 18 Jan 2014 17:05:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:05:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:05:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:05:46 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:05:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:05:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:05:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:05:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:05:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:05:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:05:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:05:51 - XML: Processed 648736 elements - found 0 jobs
Sat 18 Jan 2014 17:05:51 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:05:51 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:05:51 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:05:51 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:05:55 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:05:55 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 17:05:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:05:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:05:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:05:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:05:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:05:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:05:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:05:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:05:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:05:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42977081
Sat 18 Jan 2014 17:05:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:06:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42977081
Sat 18 Jan 2014 17:06:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:06:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:06:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:06:07 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:06:07 - job_xml_thread(): Done retrieving: data size 42977081
Sat 18 Jan 2014 17:06:07 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:06:07 - XML: Start document: iteration 10
Sat 18 Jan 2014 17:06:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:06:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:06:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:06:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:06:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:06:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:06:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:06:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:06:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:06:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:06:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:06:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:06:20 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:06:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:06:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:06:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:06:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:06:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:06:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:06:22 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:06:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 17:06:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:06:22 - XML: Processed 646292 elements - found 0 jobs
Sat 18 Jan 2014 17:06:22 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:06:22 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:06:22 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:06:22 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:06:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:06:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43005548
Sat 18 Jan 2014 17:06:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:06:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43005548
Sat 18 Jan 2014 17:06:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:06:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:06:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:06:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:06:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:06:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:06:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:06:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:06:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:06:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:06:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:06:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:06:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:06:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:06:38 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:06:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:06:39 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:06:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:06:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:06:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:06:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:06:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:06:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:06:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:06:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43530242
Sat 18 Jan 2014 17:06:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:06:43 - job_xml_thread(): Done retrieving: data size 43530242
Sat 18 Jan 2014 17:06:43 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:06:43 - XML: Start document: iteration 11
Sat 18 Jan 2014 17:06:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43530242
Sat 18 Jan 2014 17:06:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:06:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:06:45 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:06:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:06:46 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:06:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 17:06:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 17:06:46 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:06:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8750 values 138008 bits 17251 bytes 
Sat 18 Jan 2014 17:06:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:06:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:06:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:06:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:06:57 - XML: Processed 653046 elements - found 0 jobs
Sat 18 Jan 2014 17:06:57 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:06:57 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:06:57 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:06:57 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:06:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:06:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:06:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:06:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:06:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:06:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:06:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:06:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:06:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:07:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:07:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:07:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:07:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:07:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:07:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:07:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:07:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:07:07 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:07:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 17:07:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:07:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:07:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43622050
Sat 18 Jan 2014 17:07:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:07:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43622050
Sat 18 Jan 2014 17:07:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:07:12 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:07:12 - job_xml_thread(): Done retrieving: data size 43622050
Sat 18 Jan 2014 17:07:12 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:07:12 - XML: Start document: iteration 12
Sat 18 Jan 2014 17:07:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:07:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:07:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:07:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:07:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:07:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:07:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:07:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:07:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:07:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:07:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:07:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:07:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:07:29 - XML: Processed 654184 elements - found 0 jobs
Sat 18 Jan 2014 17:07:29 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:07:29 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:07:29 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:07:29 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:07:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:07:31 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:07:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:07:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:07:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:07:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:07:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:07:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:07:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:07:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43637096
Sat 18 Jan 2014 17:07:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:07:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43637096
Sat 18 Jan 2014 17:07:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:07:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:07:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:07:44 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:07:44 - job_xml_thread(): Done retrieving: data size 43637096
Sat 18 Jan 2014 17:07:44 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:07:44 - XML: Start document: iteration 13
Sat 18 Jan 2014 17:07:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:07:46 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:07:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:07:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:07:47 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:07:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:07:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 17:07:47 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:07:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 17:07:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99080 bits 12385 bytes 
Sat 18 Jan 2014 17:07:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:07:49 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:07:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:07:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:07:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:07:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:07:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:07:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:07:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:07:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:07:52 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:07:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:07:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:07:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:07:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:07:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:07:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:07:57 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 17:07:57 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:07:57 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:07:57 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:07:57 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:08:01 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:08:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 17:08:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:08:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:08:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43627849
Sat 18 Jan 2014 17:08:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:08:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43627849
Sat 18 Jan 2014 17:08:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:08:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:08:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:08:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:08:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:08:12 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:08:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:08:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:08:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:08:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:08:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:08:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:08:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:08:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:08:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:08:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:08:18 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:08:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:08:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:08:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:08:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:08:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:08:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:08:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:08:21 - job_xml_thread(): Done retrieving: data size 43633353
Sat 18 Jan 2014 17:08:21 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:08:21 - XML: Start document: iteration 14
Sat 18 Jan 2014 17:08:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43633353
Sat 18 Jan 2014 17:08:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:08:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43633353
Sat 18 Jan 2014 17:08:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:08:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:08:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:08:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:08:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:08:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:08:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:08:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:08:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:08:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:08:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:08:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:08:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:08:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:08:41 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 17:08:41 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:08:41 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:08:41 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:08:41 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:08:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:08:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:08:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:08:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:08:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:08:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:08:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:08:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:08:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:08:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43652739
Sat 18 Jan 2014 17:08:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:08:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43652739
Sat 18 Jan 2014 17:08:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:08:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:08:48 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:08:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:08:49 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:08:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 17:08:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 17:08:49 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:08:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9381 values 147951 bits 18493 bytes 
Sat 18 Jan 2014 17:08:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:08:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:08:56 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:08:56 - job_xml_thread(): Done retrieving: data size 43652739
Sat 18 Jan 2014 17:08:56 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:08:56 - XML: Start document: iteration 15
Sat 18 Jan 2014 17:09:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:09:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:09:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:09:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:09:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:09:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:09:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:09:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:09:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:09:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:09:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:09:07 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 17:09:07 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:09:07 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:09:07 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:09:07 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:09:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:09:11 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:09:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:09:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:09:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:09:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:09:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:09:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:09:14 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 17:09:14 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 17:09:14 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:09:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:09:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43635689
Sat 18 Jan 2014 17:09:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:09:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43635689
Sat 18 Jan 2014 17:09:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:09:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:09:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:09:23 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:09:23 - job_xml_thread(): Done retrieving: data size 43635689
Sat 18 Jan 2014 17:09:23 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:09:23 - XML: Start document: iteration 16
Sat 18 Jan 2014 17:09:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:09:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:09:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:09:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:09:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:09:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:09:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:09:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:09:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:09:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:09:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:09:34 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 17:09:34 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:09:34 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:09:34 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:09:34 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:09:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:09:37 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:09:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:09:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:09:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:09:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:09:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:09:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:09:37 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:09:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 17:09:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:09:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:09:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43611646
Sat 18 Jan 2014 17:09:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:09:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43611646
Sat 18 Jan 2014 17:09:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:09:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:09:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:09:49 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:09:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:09:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:09:49 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:09:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:09:49 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:09:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:09:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:09:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:09:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:09:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:09:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 17:09:50 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:09:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:09:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5845 values 92192 bits 11524 bytes 
Sat 18 Jan 2014 17:09:50 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:09:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:09:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 17:09:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:09:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:09:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:09:53 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:09:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:09:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:09:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:09:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:09:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:09:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:09:55 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:09:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 17:09:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:09:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:09:55 - job_xml_thread(): Done retrieving: data size 43630973
Sat 18 Jan 2014 17:09:55 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:09:55 - XML: Start document: iteration 17
Sat 18 Jan 2014 17:09:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43630973
Sat 18 Jan 2014 17:09:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43630973
Sat 18 Jan 2014 17:09:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:09:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:10:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:10:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:10:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:10:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:10:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:10:15 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:10:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:10:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:10:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:10:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:10:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:10:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:10:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:10:17 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 17:10:17 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:10:17 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:10:17 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:10:17 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:10:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:10:19 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:10:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:10:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:10:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:10:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:10:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:10:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:10:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:10:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43647052
Sat 18 Jan 2014 17:10:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:10:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43647052
Sat 18 Jan 2014 17:10:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:10:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:10:31 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:10:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:10:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:10:32 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:10:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:10:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:10:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:10:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:10:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:10:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:10:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:10:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:10:34 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:10:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:10:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:10:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:10:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:10:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:10:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:10:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:10:36 - job_xml_thread(): Done retrieving: data size 43641475
Sat 18 Jan 2014 17:10:36 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:10:36 - XML: Start document: iteration 18
Sat 18 Jan 2014 17:10:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43641475
Sat 18 Jan 2014 17:10:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43641475
Sat 18 Jan 2014 17:10:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:10:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:10:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:10:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:10:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:10:49 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:10:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:10:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:10:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:10:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:10:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:10:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:10:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:10:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:10:50 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:10:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:10:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:10:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:10:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 17:10:51 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:10:51 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:10:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 17:10:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148586 bits 18573 bytes 
Sat 18 Jan 2014 17:10:55 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 17:10:55 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:10:55 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:10:55 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:10:55 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:10:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:10:58 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:10:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:10:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:10:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:10:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:10:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:10:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:11:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:11:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43634451
Sat 18 Jan 2014 17:11:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:11:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43634451
Sat 18 Jan 2014 17:11:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:11:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:11:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:11:10 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:11:10 - job_xml_thread(): Done retrieving: data size 43634451
Sat 18 Jan 2014 17:11:10 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:11:10 - XML: Start document: iteration 19
Sat 18 Jan 2014 17:11:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:11:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:11:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:11:14 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:11:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:11:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:11:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:11:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:11:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:11:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:11:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:11:22 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 17:11:22 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:11:22 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:11:22 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:11:22 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:11:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:11:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:11:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:11:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:11:24 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:11:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 17:11:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:11:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:11:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:11:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:11:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:11:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:11:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553521
Sat 18 Jan 2014 17:11:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:11:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553521
Sat 18 Jan 2014 17:11:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:11:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:11:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:11:37 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:11:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:11:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:11:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:11:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:11:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:11:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:11:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:11:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:11:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:11:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:11:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:11:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:11:39 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:11:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:11:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:11:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:11:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:11:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:11:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:11:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:11:42 - job_xml_thread(): Done retrieving: data size 43044036
Sat 18 Jan 2014 17:11:42 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:11:42 - XML: Start document: iteration 20
Sat 18 Jan 2014 17:11:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43044036
Sat 18 Jan 2014 17:11:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:11:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43044036
Sat 18 Jan 2014 17:11:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:11:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:11:51 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:11:52 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:11:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:11:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 17:11:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 17:11:53 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:11:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8887 values 140121 bits 17515 bytes 
Sat 18 Jan 2014 17:11:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:11:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:11:55 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 17:11:55 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:11:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:11:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:11:57 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:11:57 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:11:57 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 17:11:57 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 17:11:57 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 17:12:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:12:00 - ganglia_parse_thread(): finished: Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sat 18 Jan 2014 17:12:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:12:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:12:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:12:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:12:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:12:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:12:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:12:04 - XML: Processed 646934 elements - found 0 jobs
Sat 18 Jan 2014 17:12:04 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:12:04 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:12:04 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:12:04 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:12:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:12:05 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:12:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:12:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:12:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:12:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:12:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:12:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:12:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:12:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42963622
Sat 18 Jan 2014 17:12:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:12:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42963622
Sat 18 Jan 2014 17:12:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:12:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:12:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:12:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:12:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:12:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:12:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:12:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:12:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:12:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:12:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:12:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:12:19 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:12:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:12:21 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:12:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:12:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:12:21 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:12:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 17:12:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:12:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:12:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:12:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:12:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:12:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:12:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43040757
Sat 18 Jan 2014 17:12:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:12:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43040757
Sat 18 Jan 2014 17:12:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:12:23 - job_xml_thread(): Done retrieving: data size 43040757
Sat 18 Jan 2014 17:12:24 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:12:24 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 17:12:25 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 17:12:25 - Housekeeping: done.
Sat 18 Jan 2014 17:12:25 - XML: Start document: iteration 0
Sat 18 Jan 2014 17:12:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:12:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:12:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:12:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:12:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:12:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:12:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:12:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:12:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:12:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:12:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:12:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:12:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:12:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:12:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:12:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:12:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:12:44 - XML: Processed 646744 elements - found 0 jobs
Sat 18 Jan 2014 17:12:44 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:12:44 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:12:44 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:12:44 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:12:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:12:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:12:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:12:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:12:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:12:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43496566
Sat 18 Jan 2014 17:12:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:12:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43496566
Sat 18 Jan 2014 17:12:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:12:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:12:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:12:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:12:53 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:12:53 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:12:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:12:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 17:12:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 17:12:53 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:12:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8915 values 140607 bits 17575 bytes 
Sat 18 Jan 2014 17:12:57 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:12:57 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:12:57 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:12:57 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 17:12:57 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 17:12:57 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:12:57 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 17:12:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:12:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:12:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:12:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:12:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:12:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:12:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:12:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:12:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:12:59 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:13:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:13:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:13:01 - size of cluster 'LISA Cluster': 624 hosts 79484 metrics 907574 values 14365975 bits 1795746 bytes 
Sat 18 Jan 2014 17:13:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:13:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:13:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:13:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:13:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:13:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:13:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:13:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:13:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:13:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43612435
Sat 18 Jan 2014 17:13:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:13:07 - job_xml_thread(): Done retrieving: data size 43612435
Sat 18 Jan 2014 17:13:07 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:13:07 - XML: Start document: iteration 1
Sat 18 Jan 2014 17:13:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43612435
Sat 18 Jan 2014 17:13:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:13:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:13:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:13:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:13:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:13:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:13:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:13:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:13:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:13:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:13:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:13:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:13:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:13:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:13:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:13:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:13:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:13:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:13:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:13:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:13:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:13:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:13:29 - XML: Processed 654180 elements - found 0 jobs
Sat 18 Jan 2014 17:13:29 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:13:29 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:13:29 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:13:29 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:13:30 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:13:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 17:13:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:13:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:13:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43630502
Sat 18 Jan 2014 17:13:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:13:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43630502
Sat 18 Jan 2014 17:13:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:13:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:13:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:13:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:13:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:13:44 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:13:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:13:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:13:46 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:13:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:13:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:13:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:13:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:13:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:13:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:13:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:13:49 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:13:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:13:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:13:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:13:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:13:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:13:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:13:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:13:52 - job_xml_thread(): Done retrieving: data size 43624701
Sat 18 Jan 2014 17:13:52 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:13:52 - XML: Start document: iteration 2
Sat 18 Jan 2014 17:13:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43624701
Sat 18 Jan 2014 17:13:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:13:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43624701
Sat 18 Jan 2014 17:13:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:13:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:13:53 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:13:54 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:13:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:13:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 17:13:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 17:13:54 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:13:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5563 values 87660 bits 10957 bytes 
Sat 18 Jan 2014 17:13:57 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:13:57 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 17:14:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:14:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:14:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:14:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:14:10 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 17:14:10 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:14:10 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:14:10 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:14:10 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:14:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:14:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:14:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:14:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:14:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:14:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:14:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:14:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:14:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:14:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:14:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:14:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:14:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:14:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:14:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:14:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:14:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:14:21 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:14:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 17:14:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:14:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:14:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43623741
Sat 18 Jan 2014 17:14:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:14:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43623741
Sat 18 Jan 2014 17:14:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:14:25 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:14:25 - job_xml_thread(): Done retrieving: data size 43623741
Sat 18 Jan 2014 17:14:25 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:14:25 - XML: Start document: iteration 3
Sat 18 Jan 2014 17:14:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:14:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:14:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:14:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:14:36 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 17:14:36 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:14:36 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:14:36 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:14:36 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:14:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:14:39 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:14:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:14:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:14:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:14:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:14:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:14:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:14:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:14:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:14:43 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:14:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:14:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:14:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:14:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:14:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:14:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:14:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:14:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43656504
Sat 18 Jan 2014 17:14:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:14:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43656504
Sat 18 Jan 2014 17:14:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:14:51 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:14:51 - job_xml_thread(): Done retrieving: data size 43656504
Sat 18 Jan 2014 17:14:51 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:14:51 - XML: Start document: iteration 4
Sat 18 Jan 2014 17:14:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:14:54 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:14:55 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:14:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 17:14:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:14:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 17:14:55 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:14:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6284 values 99119 bits 12389 bytes 
Sat 18 Jan 2014 17:14:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:14:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:14:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:14:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:14:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:14:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:14:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:14:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:14:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:14:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:14:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:14:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:14:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:15:06 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 17:15:06 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:15:06 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:15:06 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:15:06 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:15:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:15:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:15:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:15:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:15:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:15:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:15:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:15:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:15:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:15:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43620453
Sat 18 Jan 2014 17:15:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:15:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43620453
Sat 18 Jan 2014 17:15:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:15:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:15:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:15:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:15:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:15:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:15:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:15:21 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:15:21 - job_xml_thread(): Done retrieving: data size 43620453
Sat 18 Jan 2014 17:15:21 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:15:21 - XML: Start document: iteration 5
Sat 18 Jan 2014 17:15:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:15:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:15:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:15:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:15:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43620453
Sat 18 Jan 2014 17:15:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:15:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:15:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:15:29 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:15:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 17:15:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:15:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:15:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:15:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:15:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:15:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:15:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:15:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:15:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:15:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:15:39 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 17:15:39 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:15:39 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:15:39 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:15:39 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:15:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:15:41 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:15:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:15:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:15:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:15:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:15:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:15:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:15:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:15:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43647570
Sat 18 Jan 2014 17:15:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:15:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43647570
Sat 18 Jan 2014 17:15:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:15:49 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 17:15:49 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 17:15:49 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:15:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:15:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:15:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:15:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:15:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:15:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:15:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:15:55 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:15:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:15:55 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:15:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:15:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:15:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:15:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:15:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:15:56 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:15:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 17:15:56 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:15:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6155 values 97113 bits 12139 bytes 
Sat 18 Jan 2014 17:15:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 17:15:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:15:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:15:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:15:58 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:15:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:15:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:15:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:15:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:15:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:15:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:16:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:16:00 - job_xml_thread(): Done retrieving: data size 43640815
Sat 18 Jan 2014 17:16:00 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:16:00 - XML: Start document: iteration 6
Sat 18 Jan 2014 17:16:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43640815
Sat 18 Jan 2014 17:16:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:16:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43640815
Sat 18 Jan 2014 17:16:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:16:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:16:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:16:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:16:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:16:17 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 17:16:17 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:16:17 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:16:17 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:16:17 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:16:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:16:21 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:16:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:16:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:16:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:16:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:16:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:16:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:16:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:16:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:16:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:16:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:16:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:16:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:16:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:16:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:16:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:16:21 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:16:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 17:16:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:16:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:16:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43665985
Sat 18 Jan 2014 17:16:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:16:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43665985
Sat 18 Jan 2014 17:16:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:16:33 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:16:33 - job_xml_thread(): Done retrieving: data size 43665985
Sat 18 Jan 2014 17:16:33 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:16:33 - XML: Start document: iteration 7
Sat 18 Jan 2014 17:16:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:16:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:16:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:16:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:16:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:16:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:16:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:16:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:16:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:16:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:16:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:16:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:16:43 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:16:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:16:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:16:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:16:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:16:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:16:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:16:45 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 17:16:45 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:16:45 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:16:45 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:16:45 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:16:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:16:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43626933
Sat 18 Jan 2014 17:16:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:16:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43626933
Sat 18 Jan 2014 17:16:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:16:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:16:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:16:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:16:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:16:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:16:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:16:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:16:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:16:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:16:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:16:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43626933
Sat 18 Jan 2014 17:16:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:16:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:16:57 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:16:57 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:16:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:16:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 17:16:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 17:16:57 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:16:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8851 values 139854 bits 17481 bytes 
Sat 18 Jan 2014 17:16:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:16:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:17:00 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:17:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:17:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:17:06 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:17:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:17:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:17:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:17:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:17:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:17:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:17:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:17:07 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:17:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:17:09 - job_xml_thread(): Done retrieving: data size 43640860
Sat 18 Jan 2014 17:17:09 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:17:09 - XML: Start document: iteration 8
Sat 18 Jan 2014 17:17:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43640860
Sat 18 Jan 2014 17:17:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:17:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:17:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:17:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:17:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:17:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:17:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:17:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43640860
Sat 18 Jan 2014 17:17:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:17:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:17:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:17:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:17:25 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:17:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:17:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:17:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:17:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:17:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:17:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:17:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:17:28 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 17:17:28 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:17:28 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:17:28 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:17:28 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:17:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:17:32 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:17:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:17:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:17:32 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:17:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 17:17:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:17:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:17:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:17:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:17:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:17:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:17:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43189259
Sat 18 Jan 2014 17:17:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:17:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43189259
Sat 18 Jan 2014 17:17:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:17:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:17:42 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:17:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:17:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:17:43 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:17:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:17:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:17:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:17:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:17:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:17:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:17:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:17:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:17:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:17:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:17:47 - job_xml_thread(): Done retrieving: data size 43033312
Sat 18 Jan 2014 17:17:47 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:17:47 - XML: Start document: iteration 9
Sat 18 Jan 2014 17:17:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43033312
Sat 18 Jan 2014 17:17:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:17:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:17:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:17:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:17:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:17:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43033312
Sat 18 Jan 2014 17:17:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:17:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:17:57 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:17:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:17:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:18:00 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:18:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:18:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 17:18:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 17:18:00 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:18:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8816 values 139547 bits 17443 bytes 
Sat 18 Jan 2014 17:18:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:18:00 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:18:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:18:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:18:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:18:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:18:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:18:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:18:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:18:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:18:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:18:06 - XML: Processed 646708 elements - found 0 jobs
Sat 18 Jan 2014 17:18:06 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:18:06 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:18:06 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:18:06 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:18:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:18:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:18:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:18:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:18:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:18:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:18:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:18:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:18:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:18:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42976642
Sat 18 Jan 2014 17:18:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:18:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42976642
Sat 18 Jan 2014 17:18:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:18:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:18:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:18:21 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:18:21 - job_xml_thread(): Done retrieving: data size 42976642
Sat 18 Jan 2014 17:18:21 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:18:21 - XML: Start document: iteration 10
Sat 18 Jan 2014 17:18:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:18:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:18:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:18:25 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:18:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:18:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:18:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:18:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:18:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:18:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:18:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:18:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:18:28 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:18:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:18:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:18:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:18:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:18:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:18:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:18:31 - XML: Processed 646012 elements - found 0 jobs
Sat 18 Jan 2014 17:18:31 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:18:31 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:18:31 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:18:31 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:18:31 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:18:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 17:18:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:18:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:18:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43471813
Sat 18 Jan 2014 17:18:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:18:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43471813
Sat 18 Jan 2014 17:18:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:18:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:18:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:18:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:18:44 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:18:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:18:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:18:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:18:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:18:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:18:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:18:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:18:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:18:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:18:47 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:18:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:18:48 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:18:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:18:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:18:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:18:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:18:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:18:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:18:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:18:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43600958
Sat 18 Jan 2014 17:18:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:18:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43600958
Sat 18 Jan 2014 17:18:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:18:51 - job_xml_thread(): Done retrieving: data size 43600958
Sat 18 Jan 2014 17:18:51 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:18:51 - XML: Start document: iteration 11
Sat 18 Jan 2014 17:19:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:19:00 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:19:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:19:00 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:19:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:19:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:19:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:19:01 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:19:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 17:19:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 17:19:01 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:19:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9230 values 145744 bits 18218 bytes 
Sat 18 Jan 2014 17:19:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:19:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:19:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:19:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:19:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:19:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:19:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:19:06 - XML: Processed 653828 elements - found 0 jobs
Sat 18 Jan 2014 17:19:06 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:19:06 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:19:06 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:19:06 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:19:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:19:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:19:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:19:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:19:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:19:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:19:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:19:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:19:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:19:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43624395
Sat 18 Jan 2014 17:19:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:19:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43624395
Sat 18 Jan 2014 17:19:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:19:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:19:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:19:21 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:19:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:19:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:19:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:19:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:19:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:19:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:19:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:19:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:19:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:19:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:19:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:19:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:19:27 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:19:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:19:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:19:27 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:19:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 17:19:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:19:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:19:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:19:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:19:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:19:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:19:30 - job_xml_thread(): Done retrieving: data size 43634192
Sat 18 Jan 2014 17:19:30 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:19:30 - XML: Start document: iteration 12
Sat 18 Jan 2014 17:19:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43634192
Sat 18 Jan 2014 17:19:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43634192
Sat 18 Jan 2014 17:19:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:19:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:19:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:19:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:19:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:19:43 - XML: Processed 654176 elements - found 0 jobs
Sat 18 Jan 2014 17:19:43 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:19:43 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:19:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:19:43 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:19:43 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:19:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:19:48 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:19:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:19:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:19:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:19:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:19:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:19:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:19:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:19:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:19:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:19:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:19:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:19:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:19:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:19:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:19:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:19:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:19:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43635392
Sat 18 Jan 2014 17:19:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:19:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43635392
Sat 18 Jan 2014 17:19:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:19:58 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 17:19:58 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:19:58 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:19:58 - job_xml_thread(): Done retrieving: data size 43635392
Sat 18 Jan 2014 17:19:58 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:19:58 - XML: Start document: iteration 13
Sat 18 Jan 2014 17:20:00 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:20:00 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 17:20:00 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:20:01 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 17:20:01 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 17:20:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:20:01 - ganglia_store_thread(): finished: cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sat 18 Jan 2014 17:20:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:20:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:20:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:20:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:20:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:20:05 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:20:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 17:20:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 17:20:05 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:20:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8860 values 139795 bits 17474 bytes 
Sat 18 Jan 2014 17:20:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:20:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:20:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:20:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:20:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:20:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:20:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:20:11 - XML: Processed 654184 elements - found 0 jobs
Sat 18 Jan 2014 17:20:11 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:20:11 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:20:11 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:20:11 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:20:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:20:13 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:20:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:20:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:20:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:20:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:20:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:20:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:20:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:20:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43635200
Sat 18 Jan 2014 17:20:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:20:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43635200
Sat 18 Jan 2014 17:20:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:20:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:20:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:20:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:20:24 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:20:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:20:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:20:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:20:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:20:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:20:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:20:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:20:27 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:20:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:20:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:20:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:20:29 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:20:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:20:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:20:29 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:20:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 17:20:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:20:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:20:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:20:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:20:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:20:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:20:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43650639
Sat 18 Jan 2014 17:20:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:20:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43650639
Sat 18 Jan 2014 17:20:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:20:32 - job_xml_thread(): Done retrieving: data size 43650639
Sat 18 Jan 2014 17:20:32 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:20:32 - XML: Start document: iteration 14
Sat 18 Jan 2014 17:20:38 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 17:20:38 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:20:38 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:20:38 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:20:38 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:20:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:20:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:20:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:20:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:20:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:20:47 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:20:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:20:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:20:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:20:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:20:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:20:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:20:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:20:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:20:50 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:20:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:20:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:20:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:20:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:20:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:20:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:20:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:20:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43645996
Sat 18 Jan 2014 17:20:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:20:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43645996
Sat 18 Jan 2014 17:20:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:20:53 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:20:54 - job_xml_thread(): Done retrieving: data size 43645996
Sat 18 Jan 2014 17:20:54 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:20:54 - XML: Start document: iteration 15
Sat 18 Jan 2014 17:21:02 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:21:02 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:21:03 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:21:03 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:21:03 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 17:21:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:21:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:21:04 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 17:21:04 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 17:21:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:21:05 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:21:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:21:06 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:21:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 17:21:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 17:21:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:21:06 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:21:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8684 values 137077 bits 17134 bytes 
Sat 18 Jan 2014 17:21:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:21:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:21:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:21:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:21:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:21:16 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 17:21:16 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:21:16 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:21:16 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:21:16 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:21:17 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 923796 values 14649268 bits 1831158 bytes 
Sat 18 Jan 2014 17:21:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:21:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:21:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:21:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:21:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:21:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:21:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:21:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:21:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:21:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:21:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:21:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:21:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:21:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:21:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43638010
Sat 18 Jan 2014 17:21:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:21:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43638010
Sat 18 Jan 2014 17:21:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:21:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:21:29 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:21:31 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:21:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:21:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:21:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:21:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:21:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:21:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:21:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:21:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:21:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:21:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:21:35 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:21:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:21:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:21:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:21:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:21:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:21:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:21:36 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:21:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 17:21:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:21:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:21:39 - job_xml_thread(): Done retrieving: data size 43632617
Sat 18 Jan 2014 17:21:39 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:21:39 - XML: Start document: iteration 16
Sat 18 Jan 2014 17:21:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43632617
Sat 18 Jan 2014 17:21:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:21:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43632617
Sat 18 Jan 2014 17:21:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:21:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:21:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:21:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:21:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:21:52 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:21:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:21:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:21:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:21:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:21:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:21:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:21:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:21:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:21:56 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 17:21:56 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:21:56 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:21:56 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:21:56 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:22:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:22:01 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:22:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:22:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:22:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:22:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:22:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:22:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:22:03 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:22:03 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 17:22:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:22:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43626127
Sat 18 Jan 2014 17:22:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:22:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43626127
Sat 18 Jan 2014 17:22:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:22:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:22:06 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:22:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:22:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 17:22:07 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:22:07 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:22:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 17:22:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8623 values 135983 bits 16997 bytes 
Sat 18 Jan 2014 17:22:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:22:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:22:11 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:22:11 - job_xml_thread(): Done retrieving: data size 43626127
Sat 18 Jan 2014 17:22:11 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:22:11 - XML: Start document: iteration 17
Sat 18 Jan 2014 17:22:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:22:13 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:22:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:22:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:22:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:22:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:22:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:22:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43626127
Sat 18 Jan 2014 17:22:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:22:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:22:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:22:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:22:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:22:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:22:30 - XML: Processed 654194 elements - found 0 jobs
Sat 18 Jan 2014 17:22:30 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:22:30 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:22:30 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:22:30 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:22:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:22:32 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:22:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:22:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:22:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:22:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:22:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:22:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:22:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:22:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:22:35 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:22:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:22:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:22:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:22:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:22:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:22:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:22:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:22:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43634307
Sat 18 Jan 2014 17:22:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:22:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43634307
Sat 18 Jan 2014 17:22:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:22:45 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:22:45 - job_xml_thread(): Done retrieving: data size 43634307
Sat 18 Jan 2014 17:22:45 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:22:45 - XML: Start document: iteration 18
Sat 18 Jan 2014 17:22:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:22:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:22:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:22:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:22:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:22:52 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:22:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:22:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:22:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:22:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:22:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:22:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:22:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:23:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:23:02 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:23:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:23:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:23:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:23:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:23:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:23:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:23:02 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:23:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 17:23:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:23:04 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 17:23:04 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:23:04 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:23:04 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:23:04 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:23:07 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 17:23:07 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 17:23:07 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:23:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:23:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43606938
Sat 18 Jan 2014 17:23:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:23:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43606938
Sat 18 Jan 2014 17:23:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:23:08 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:23:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:23:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:23:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:23:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:23:08 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:23:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 17:23:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 17:23:08 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:23:10 - size of cluster 'Render Cluster': 20 hosts 3138 metrics 3340 values 52745 bits 6593 bytes 
Sat 18 Jan 2014 17:23:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:23:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:23:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:23:18 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:23:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:23:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:23:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:23:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:23:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:23:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:23:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:23:19 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:23:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:23:21 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:23:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:23:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:23:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:23:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:23:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:23:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:23:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:23:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572638
Sat 18 Jan 2014 17:23:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:23:25 - job_xml_thread(): Done retrieving: data size 43572638
Sat 18 Jan 2014 17:23:25 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:23:25 - XML: Start document: iteration 19
Sat 18 Jan 2014 17:23:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572638
Sat 18 Jan 2014 17:23:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:23:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:23:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:23:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:23:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:23:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:23:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:23:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:23:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:23:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:23:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:23:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:23:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:23:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:23:47 - XML: Processed 653448 elements - found 0 jobs
Sat 18 Jan 2014 17:23:47 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:23:47 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:23:47 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:23:47 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:23:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:23:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:23:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:23:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:23:48 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:23:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 17:23:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:23:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:23:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:23:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:23:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:23:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:23:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43033816
Sat 18 Jan 2014 17:23:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:23:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43033816
Sat 18 Jan 2014 17:23:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:23:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:23:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:23:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:23:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:23:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:23:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:24:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:24:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:24:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:24:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:24:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:24:02 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:24:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:24:02 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:24:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:24:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:24:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:24:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:24:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:24:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:24:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:24:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42976575
Sat 18 Jan 2014 17:24:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:24:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42976575
Sat 18 Jan 2014 17:24:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:24:05 - job_xml_thread(): Done retrieving: data size 42976575
Sat 18 Jan 2014 17:24:05 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:24:05 - XML: Start document: iteration 20
Sat 18 Jan 2014 17:24:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:24:08 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:24:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:24:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 17:24:09 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:24:09 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:24:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 17:24:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6520 values 102876 bits 12859 bytes 
Sat 18 Jan 2014 17:24:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:24:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:24:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:24:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:24:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:24:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:24:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:24:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:24:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:24:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:24:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:24:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:24:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:24:23 - XML: Processed 646052 elements - found 0 jobs
Sat 18 Jan 2014 17:24:23 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:24:23 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:24:23 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:24:23 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:24:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:24:28 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:24:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:24:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:24:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:24:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:24:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:24:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:24:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:24:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43036390
Sat 18 Jan 2014 17:24:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:24:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43036390
Sat 18 Jan 2014 17:24:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:24:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:24:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:24:38 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:24:38 - job_xml_thread(): Done retrieving: data size 43036390
Sat 18 Jan 2014 17:24:38 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:24:38 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 17:24:38 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 17:24:38 - Housekeeping: done.
Sat 18 Jan 2014 17:24:38 - XML: Start document: iteration 0
Sat 18 Jan 2014 17:24:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:24:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:24:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:24:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:24:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:24:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:24:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:24:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:24:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:24:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:24:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:24:49 - XML: Processed 646773 elements - found 0 jobs
Sat 18 Jan 2014 17:24:49 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:24:49 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:24:49 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:24:49 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:24:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:24:53 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:24:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:24:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:24:53 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:24:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 17:24:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:24:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:24:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:24:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:24:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:24:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:24:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43542075
Sat 18 Jan 2014 17:24:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:24:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43542075
Sat 18 Jan 2014 17:24:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:24:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:24:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:25:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:25:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:25:04 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:25:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:25:04 - job_xml_thread(): Done retrieving: data size 43542075
Sat 18 Jan 2014 17:25:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:25:04 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:25:04 - XML: Start document: iteration 1
Sat 18 Jan 2014 17:25:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:25:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:25:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:25:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:25:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:25:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:25:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:25:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:25:10 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:25:10 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:25:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:25:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 17:25:11 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:25:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 17:25:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5548 values 87416 bits 10927 bytes 
Sat 18 Jan 2014 17:25:13 - XML: Processed 653284 elements - found 0 jobs
Sat 18 Jan 2014 17:25:13 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:25:13 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:25:13 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:25:13 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:25:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:25:14 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:25:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:25:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:25:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:25:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:25:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:25:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:25:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:25:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43613774
Sat 18 Jan 2014 17:25:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:25:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43613774
Sat 18 Jan 2014 17:25:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:25:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:25:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:25:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:25:26 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:25:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:25:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:25:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:25:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:25:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:25:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:25:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:25:28 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:25:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:25:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:25:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:25:31 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:25:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:25:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:25:32 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:25:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 17:25:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:25:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:25:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:25:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:25:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:25:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:25:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43614613
Sat 18 Jan 2014 17:25:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:25:34 - job_xml_thread(): Done retrieving: data size 43614613
Sat 18 Jan 2014 17:25:34 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:25:34 - XML: Start document: iteration 2
Sat 18 Jan 2014 17:25:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43614613
Sat 18 Jan 2014 17:25:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:25:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:25:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:25:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:25:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:25:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:25:50 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:25:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:25:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:25:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:25:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:25:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:25:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:25:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:25:53 - XML: Processed 654190 elements - found 0 jobs
Sat 18 Jan 2014 17:25:53 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:25:53 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:25:53 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:25:53 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:25:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:25:56 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:25:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:25:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:25:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:25:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:25:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:25:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:25:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:25:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43657718
Sat 18 Jan 2014 17:25:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:26:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43657718
Sat 18 Jan 2014 17:26:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:26:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:26:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:26:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:26:07 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:26:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:26:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:26:09 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:26:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:26:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:26:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:26:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:26:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:26:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:26:11 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:26:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:26:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:26:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:26:12 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:26:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:26:12 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:26:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 17:26:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 17:26:12 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:26:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8678 values 136827 bits 17103 bytes 
Sat 18 Jan 2014 17:26:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:26:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:26:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:26:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:26:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:26:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:26:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:26:15 - job_xml_thread(): Done retrieving: data size 43647363
Sat 18 Jan 2014 17:26:15 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:26:15 - XML: Start document: iteration 3
Sat 18 Jan 2014 17:26:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43647363
Sat 18 Jan 2014 17:26:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:26:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43647363
Sat 18 Jan 2014 17:26:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:26:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:26:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:26:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:26:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:26:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:26:32 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:26:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:26:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:26:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:26:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:26:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:26:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:26:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:26:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:26:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:26:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:26:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:26:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:26:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:26:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:26:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:26:37 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 17:26:37 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:26:37 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:26:37 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:26:37 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:26:37 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:26:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 17:26:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:26:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:26:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43642275
Sat 18 Jan 2014 17:26:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:26:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43642275
Sat 18 Jan 2014 17:26:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:26:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:26:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:26:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:26:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:26:53 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:26:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:26:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:26:53 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:26:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:26:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:26:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:26:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:26:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:26:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:26:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:26:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:26:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:26:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:26:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:26:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:26:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:26:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:26:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:26:58 - job_xml_thread(): Done retrieving: data size 43665945
Sat 18 Jan 2014 17:26:58 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:26:58 - XML: Start document: iteration 4
Sat 18 Jan 2014 17:26:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43665945
Sat 18 Jan 2014 17:26:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:26:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43665945
Sat 18 Jan 2014 17:26:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:27:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:27:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:27:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:27:10 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:27:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:27:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:27:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:27:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:27:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:27:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:27:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:27:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:27:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:27:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:27:12 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:27:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:27:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 17:27:13 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:27:13 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:27:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 17:27:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8944 values 141054 bits 17631 bytes 
Sat 18 Jan 2014 17:27:16 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 17:27:16 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:27:16 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:27:16 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:27:16 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:27:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:27:22 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:27:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:27:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:27:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:27:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:27:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:27:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:27:23 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:27:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 17:27:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:27:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:27:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43617360
Sat 18 Jan 2014 17:27:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:27:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43617360
Sat 18 Jan 2014 17:27:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:27:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:27:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:27:31 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:27:31 - job_xml_thread(): Done retrieving: data size 43617360
Sat 18 Jan 2014 17:27:32 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:27:32 - XML: Start document: iteration 5
Sat 18 Jan 2014 17:27:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:27:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:27:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:27:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:27:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:27:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:27:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:27:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:27:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:27:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:27:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:27:41 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 17:27:41 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:27:41 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:27:41 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:27:41 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:27:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:27:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:27:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:27:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:27:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:27:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:27:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:27:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:27:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:27:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43630392
Sat 18 Jan 2014 17:27:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:27:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43630392
Sat 18 Jan 2014 17:27:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:27:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:27:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:27:56 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:27:57 - job_xml_thread(): Done retrieving: data size 43630392
Sat 18 Jan 2014 17:27:57 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:27:57 - XML: Start document: iteration 6
Sat 18 Jan 2014 17:27:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:27:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:27:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:27:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:27:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:27:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:27:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:27:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:27:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:28:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:28:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:28:04 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 17:28:04 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:28:05 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:28:05 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 17:28:05 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 17:28:05 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:28:05 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 17:28:07 - size of cluster 'LISA Cluster': 624 hosts 79482 metrics 867747 values 13742522 bits 1717815 bytes 
Sat 18 Jan 2014 17:28:09 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 17:28:09 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:28:09 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:28:09 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:28:09 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:28:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:28:11 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:28:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:28:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:28:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:28:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:28:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:28:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:28:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:28:13 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:28:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:28:13 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:28:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 17:28:13 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:28:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99059 bits 12382 bytes 
Sat 18 Jan 2014 17:28:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 17:28:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:28:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43624436
Sat 18 Jan 2014 17:28:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:28:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43624436
Sat 18 Jan 2014 17:28:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:28:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:28:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:28:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:28:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:28:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:28:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:28:24 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:28:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:28:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:28:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:28:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:28:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:28:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:28:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:28:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:28:29 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:28:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:28:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:28:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:28:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:28:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:28:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:28:33 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:28:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 17:28:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:28:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:28:33 - job_xml_thread(): Done retrieving: data size 43637719
Sat 18 Jan 2014 17:28:33 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:28:33 - XML: Start document: iteration 7
Sat 18 Jan 2014 17:28:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43637719
Sat 18 Jan 2014 17:28:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:28:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43637719
Sat 18 Jan 2014 17:28:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:28:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:28:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:28:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:28:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:28:49 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 17:28:49 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:28:49 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:28:49 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:28:49 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:28:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:28:52 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:28:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:28:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:28:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:28:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:28:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:28:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:28:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:28:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:28:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:28:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:28:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:28:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:28:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:28:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:28:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:28:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:28:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43664245
Sat 18 Jan 2014 17:28:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:28:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43664245
Sat 18 Jan 2014 17:28:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:29:04 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:29:04 - job_xml_thread(): Done retrieving: data size 43664245
Sat 18 Jan 2014 17:29:04 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:29:04 - XML: Start document: iteration 8
Sat 18 Jan 2014 17:29:06 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:29:06 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 17:29:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:29:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:29:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:29:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:29:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:29:13 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:29:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:29:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 17:29:15 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:29:16 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:29:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 17:29:17 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 17:29:17 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:29:17 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:29:17 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:29:17 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:29:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6531 values 102963 bits 12870 bytes 
Sat 18 Jan 2014 17:29:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:29:21 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:29:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:29:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:29:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:29:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:29:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:29:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:29:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:29:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:29:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:29:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:29:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:29:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:29:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:29:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:29:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:29:26 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:29:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 17:29:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:29:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:29:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43585619
Sat 18 Jan 2014 17:29:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:29:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43585619
Sat 18 Jan 2014 17:29:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:29:32 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:29:32 - job_xml_thread(): Done retrieving: data size 43585619
Sat 18 Jan 2014 17:29:32 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:29:32 - XML: Start document: iteration 9
Sat 18 Jan 2014 17:29:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:29:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:29:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:29:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:29:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:29:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:29:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:29:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:29:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:29:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:29:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:29:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:29:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:29:45 - XML: Processed 653428 elements - found 0 jobs
Sat 18 Jan 2014 17:29:45 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:29:45 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:29:45 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:29:45 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:29:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:29:48 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:29:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:29:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:29:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:29:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:29:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:29:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:29:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:29:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43046728
Sat 18 Jan 2014 17:29:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:29:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43046728
Sat 18 Jan 2014 17:29:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:29:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:29:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:30:01 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:30:01 - job_xml_thread(): Done retrieving: data size 43046728
Sat 18 Jan 2014 17:30:01 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:30:01 - XML: Start document: iteration 10
Sat 18 Jan 2014 17:30:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:30:03 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:30:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:30:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:30:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:30:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:30:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:30:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:30:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:30:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:30:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:30:11 - XML: Processed 647158 elements - found 0 jobs
Sat 18 Jan 2014 17:30:11 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:30:11 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:30:11 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:30:12 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:30:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:30:12 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:30:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:30:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:30:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:30:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:30:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:30:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:30:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:30:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42973967
Sat 18 Jan 2014 17:30:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:30:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42973967
Sat 18 Jan 2014 17:30:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:30:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:30:16 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:30:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:30:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 17:30:17 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:30:17 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:30:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 17:30:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8148 values 128562 bits 16070 bytes 
Sat 18 Jan 2014 17:30:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:30:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:30:27 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:30:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:30:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:30:27 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:30:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:30:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:30:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:30:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:30:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:30:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:30:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:30:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:30:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:30:31 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:30:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:30:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:30:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:30:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:30:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:30:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:30:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:30:34 - job_xml_thread(): Done retrieving: data size 43280930
Sat 18 Jan 2014 17:30:34 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:30:34 - XML: Start document: iteration 11
Sat 18 Jan 2014 17:30:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43280930
Sat 18 Jan 2014 17:30:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:30:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43280930
Sat 18 Jan 2014 17:30:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:30:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:30:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:30:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:30:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:30:50 - XML: Processed 649900 elements - found 0 jobs
Sat 18 Jan 2014 17:30:50 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:30:50 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:30:50 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:30:50 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:30:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:30:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:30:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:30:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:30:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:30:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:30:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:30:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:30:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:30:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:30:59 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:30:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:30:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:30:59 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:30:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 17:30:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:31:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:31:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:31:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:31:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:31:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:31:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43611299
Sat 18 Jan 2014 17:31:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:31:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43611299
Sat 18 Jan 2014 17:31:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:31:05 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:31:05 - job_xml_thread(): Done retrieving: data size 43611299
Sat 18 Jan 2014 17:31:05 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:31:05 - XML: Start document: iteration 12
Sat 18 Jan 2014 17:31:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:31:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:31:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:31:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:31:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:31:19 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:31:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:31:20 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:31:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 17:31:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 17:31:20 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:31:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5743 values 90602 bits 11325 bytes 
Sat 18 Jan 2014 17:31:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:31:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:31:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:31:22 - XML: Processed 653744 elements - found 0 jobs
Sat 18 Jan 2014 17:31:22 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:31:22 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:31:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:31:22 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:31:22 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:31:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:31:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:31:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:31:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:31:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:31:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:31:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:31:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:31:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:31:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:31:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:31:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:31:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:31:25 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 17:31:25 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 17:31:25 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:31:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:31:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43648655
Sat 18 Jan 2014 17:31:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:31:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43648655
Sat 18 Jan 2014 17:31:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:31:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:31:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:31:37 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:31:37 - job_xml_thread(): Done retrieving: data size 43648655
Sat 18 Jan 2014 17:31:37 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:31:37 - XML: Start document: iteration 13
Sat 18 Jan 2014 17:31:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:31:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:31:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:31:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:31:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:31:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:31:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:31:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:31:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:31:47 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:31:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 17:31:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:31:48 - XML: Processed 654146 elements - found 0 jobs
Sat 18 Jan 2014 17:31:48 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:31:48 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:31:48 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:31:48 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:31:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:31:50 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:31:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:31:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:31:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:31:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:31:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:31:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:31:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:31:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43600355
Sat 18 Jan 2014 17:31:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:31:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43600355
Sat 18 Jan 2014 17:31:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:31:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:31:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:32:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:32:02 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:32:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:32:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:32:03 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:32:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:32:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:32:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:32:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:32:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:32:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:32:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:32:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:32:05 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:32:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:32:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:32:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:32:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:32:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:32:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:32:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:32:07 - job_xml_thread(): Done retrieving: data size 43633153
Sat 18 Jan 2014 17:32:07 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:32:07 - XML: Start document: iteration 14
Sat 18 Jan 2014 17:32:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43633153
Sat 18 Jan 2014 17:32:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43633153
Sat 18 Jan 2014 17:32:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:32:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:32:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:32:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:32:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:32:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:32:20 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:32:20 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:32:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:32:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:32:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:32:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:32:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:32:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:32:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:32:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:32:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:32:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:32:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 17:32:21 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:32:21 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:32:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8940 values 141414 bits 17676 bytes 
Sat 18 Jan 2014 17:32:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 17:32:27 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 17:32:27 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:32:27 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:32:27 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:32:27 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:32:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:32:31 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:32:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:32:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:32:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:32:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:32:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:32:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:32:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:32:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43628738
Sat 18 Jan 2014 17:32:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:32:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43628738
Sat 18 Jan 2014 17:32:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:32:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:32:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:32:42 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:32:42 - job_xml_thread(): Done retrieving: data size 43628738
Sat 18 Jan 2014 17:32:42 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:32:43 - XML: Start document: iteration 15
Sat 18 Jan 2014 17:32:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:32:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:32:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:32:47 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:32:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:32:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:32:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:32:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:32:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:32:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:32:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:32:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:32:54 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:32:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:32:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:32:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:32:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:32:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:32:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:32:57 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 17:32:57 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:32:57 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:32:57 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:32:57 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:32:57 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:32:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 17:32:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:32:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:32:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43636907
Sat 18 Jan 2014 17:32:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:32:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43636907
Sat 18 Jan 2014 17:33:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:33:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:33:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:33:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:33:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:33:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:33:12 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:33:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:33:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:33:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:33:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:33:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:33:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:33:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:33:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:33:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:33:14 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:33:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:33:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:33:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:33:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:33:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:33:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:33:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:33:15 - job_xml_thread(): Done retrieving: data size 43659604
Sat 18 Jan 2014 17:33:15 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:33:15 - XML: Start document: iteration 16
Sat 18 Jan 2014 17:33:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43659604
Sat 18 Jan 2014 17:33:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43659604
Sat 18 Jan 2014 17:33:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:33:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:33:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:33:22 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:33:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:33:24 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:33:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 17:33:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 17:33:24 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:33:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8764 values 138460 bits 17307 bytes 
Sat 18 Jan 2014 17:33:27 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 17:33:27 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:33:27 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:33:27 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:33:27 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:33:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:33:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:33:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:33:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:33:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:33:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:33:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:33:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:33:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:33:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:33:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:33:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:33:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:33:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:33:37 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:33:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:33:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:33:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:33:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:33:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:33:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:33:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:33:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43647049
Sat 18 Jan 2014 17:33:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:33:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43647049
Sat 18 Jan 2014 17:33:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:33:42 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:33:42 - job_xml_thread(): Done retrieving: data size 43647049
Sat 18 Jan 2014 17:33:42 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:33:42 - XML: Start document: iteration 17
Sat 18 Jan 2014 17:33:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:33:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:33:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:33:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:33:54 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 17:33:54 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:33:54 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:33:54 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:33:54 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:34:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:34:00 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:34:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:34:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:34:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:34:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:34:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:34:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:34:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:34:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:34:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:34:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:34:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:34:03 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:34:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 17:34:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:34:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:34:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:34:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:34:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:34:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:34:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43636376
Sat 18 Jan 2014 17:34:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:34:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43636376
Sat 18 Jan 2014 17:34:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:34:09 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:34:09 - job_xml_thread(): Done retrieving: data size 43636376
Sat 18 Jan 2014 17:34:09 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:34:09 - XML: Start document: iteration 18
Sat 18 Jan 2014 17:34:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:34:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:34:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:34:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:34:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:34:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:34:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:34:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:34:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:34:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:34:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:34:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:34:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:34:22 - XML: Processed 654193 elements - found 0 jobs
Sat 18 Jan 2014 17:34:22 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:34:22 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:34:22 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:34:22 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:34:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:34:24 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:34:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:34:24 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:34:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 17:34:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 17:34:24 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:34:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5933 values 93626 bits 11703 bytes 
Sat 18 Jan 2014 17:34:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:34:27 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:34:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:34:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:34:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:34:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:34:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:34:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:34:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:34:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43647905
Sat 18 Jan 2014 17:34:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:34:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43647905
Sat 18 Jan 2014 17:34:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:34:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:34:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:34:37 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:34:38 - job_xml_thread(): Done retrieving: data size 43647905
Sat 18 Jan 2014 17:34:38 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:34:39 - XML: Start document: iteration 19
Sat 18 Jan 2014 17:34:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:34:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:34:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:34:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:34:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:34:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:34:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:34:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:34:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:34:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:34:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:34:47 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:34:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 17:34:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:34:53 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 17:34:53 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:34:53 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:34:53 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:34:53 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:34:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:34:53 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:34:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:34:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:34:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:34:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:34:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:34:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:34:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:34:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43624163
Sat 18 Jan 2014 17:34:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:34:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43624163
Sat 18 Jan 2014 17:34:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:34:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:34:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:35:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:35:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:35:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:35:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:35:06 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 17:35:06 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:35:07 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:35:07 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 17:35:07 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:35:07 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 17:35:07 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 17:35:08 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:35:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:35:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:35:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:35:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:35:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:35:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:35:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:35:10 - size of cluster 'LISA Cluster': 624 hosts 79486 metrics 883316 values 13988052 bits 1748506 bytes 
Sat 18 Jan 2014 17:35:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:35:11 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:35:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:35:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:35:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:35:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:35:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:35:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:35:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:35:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584984
Sat 18 Jan 2014 17:35:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:35:14 - job_xml_thread(): Done retrieving: data size 43584984
Sat 18 Jan 2014 17:35:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584984
Sat 18 Jan 2014 17:35:14 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:35:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:35:15 - XML: Start document: iteration 20
Sat 18 Jan 2014 17:35:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:35:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:35:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:35:24 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:35:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:35:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:35:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:35:25 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:35:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:35:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:35:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:35:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:35:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:35:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:35:25 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:35:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 17:35:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 17:35:25 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:35:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9061 values 142956 bits 17869 bytes 
Sat 18 Jan 2014 17:35:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:35:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:35:33 - XML: Processed 653414 elements - found 0 jobs
Sat 18 Jan 2014 17:35:33 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:35:33 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:35:33 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:35:33 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:35:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:35:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:35:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:35:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:35:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:35:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:35:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:35:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:35:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:35:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43350961
Sat 18 Jan 2014 17:35:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:35:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:35:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:35:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43350961
Sat 18 Jan 2014 17:35:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:35:48 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:35:48 - job_xml_thread(): Done retrieving: data size 43350961
Sat 18 Jan 2014 17:35:48 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:35:48 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 17:35:48 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 17:35:48 - Housekeeping: done.
Sat 18 Jan 2014 17:35:48 - XML: Start document: iteration 0
Sat 18 Jan 2014 17:35:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:35:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:35:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:35:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:36:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:36:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:36:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:36:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:36:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:36:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:36:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:36:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:36:04 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:36:04 - XML: Processed 651034 elements - found 0 jobs
Sat 18 Jan 2014 17:36:04 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:36:04 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:36:04 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:36:04 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:36:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:36:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:36:04 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:36:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 17:36:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:36:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:36:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:36:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:36:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:36:07 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:36:07 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 17:36:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:36:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42968741
Sat 18 Jan 2014 17:36:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:36:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42968741
Sat 18 Jan 2014 17:36:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:36:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:36:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:36:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:36:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:36:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:36:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:36:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:36:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:36:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:36:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:36:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:36:19 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:36:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:36:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:36:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:36:21 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:36:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:36:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:36:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:36:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:36:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:36:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:36:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:36:25 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:36:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:36:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43041475
Sat 18 Jan 2014 17:36:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:36:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43041475
Sat 18 Jan 2014 17:36:26 - job_xml_thread(): Done retrieving: data size 43041475
Sat 18 Jan 2014 17:36:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:36:26 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:36:26 - XML: Start document: iteration 1
Sat 18 Jan 2014 17:36:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:36:27 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:36:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 17:36:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 17:36:28 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:36:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7166 values 113046 bits 14130 bytes 
Sat 18 Jan 2014 17:36:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:36:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:36:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:36:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:36:43 - XML: Processed 646818 elements - found 0 jobs
Sat 18 Jan 2014 17:36:43 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:36:43 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:36:43 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:36:43 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:36:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:36:45 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:36:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:36:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:36:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:36:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:36:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:36:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:36:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:36:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:36:50 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:36:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:36:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:36:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:36:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:36:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:36:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:36:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:36:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43598354
Sat 18 Jan 2014 17:36:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:36:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43598354
Sat 18 Jan 2014 17:36:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:36:58 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:36:58 - job_xml_thread(): Done retrieving: data size 43598354
Sat 18 Jan 2014 17:36:58 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:36:58 - XML: Start document: iteration 2
Sat 18 Jan 2014 17:37:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:37:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:37:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:37:03 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:37:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:37:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:37:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:37:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:37:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:37:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:37:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:37:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:37:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:37:12 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:37:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 17:37:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:37:14 - XML: Processed 653846 elements - found 0 jobs
Sat 18 Jan 2014 17:37:14 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:37:14 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:37:14 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:37:14 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:37:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:37:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:37:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:37:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:37:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:37:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:37:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:37:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:37:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:37:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43602737
Sat 18 Jan 2014 17:37:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:37:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:37:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:37:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43602737
Sat 18 Jan 2014 17:37:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:37:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:37:28 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:37:29 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:37:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 17:37:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:37:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 17:37:29 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:37:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5916 values 93331 bits 11666 bytes 
Sat 18 Jan 2014 17:37:29 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:37:29 - job_xml_thread(): Done retrieving: data size 43602737
Sat 18 Jan 2014 17:37:29 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:37:29 - XML: Start document: iteration 3
Sat 18 Jan 2014 17:37:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:37:32 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:37:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:37:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:37:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:37:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:37:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:37:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:37:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:37:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:37:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:37:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:37:40 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:37:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:37:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:37:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:37:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:37:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:37:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:37:44 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 17:37:44 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:37:44 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:37:44 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:37:44 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:37:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:37:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43619584
Sat 18 Jan 2014 17:37:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:37:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43619584
Sat 18 Jan 2014 17:37:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:37:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:37:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:37:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:37:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:37:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:37:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:37:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:37:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:37:59 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:37:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:38:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:38:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:38:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:38:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:38:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:38:02 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:38:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:38:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:38:02 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:38:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 17:38:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:38:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:38:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:38:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:38:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:38:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:38:04 - job_xml_thread(): Done retrieving: data size 43626494
Sat 18 Jan 2014 17:38:04 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:38:04 - XML: Start document: iteration 4
Sat 18 Jan 2014 17:38:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43626494
Sat 18 Jan 2014 17:38:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:38:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43626494
Sat 18 Jan 2014 17:38:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:38:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:38:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:38:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:38:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:38:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:38:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:38:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:38:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:38:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:38:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:38:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:38:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:38:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:38:24 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 17:38:24 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:38:24 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:38:24 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:38:25 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:38:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:38:27 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:38:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:38:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:38:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:38:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:38:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:38:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:38:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:38:29 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:38:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:38:29 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:38:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 17:38:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 17:38:29 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:38:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5807 values 91594 bits 11449 bytes 
Sat 18 Jan 2014 17:38:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:38:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43649511
Sat 18 Jan 2014 17:38:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:38:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43649511
Sat 18 Jan 2014 17:38:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:38:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:38:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:38:40 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:38:40 - job_xml_thread(): Done retrieving: data size 43649511
Sat 18 Jan 2014 17:38:40 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:38:40 - XML: Start document: iteration 5
Sat 18 Jan 2014 17:38:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:38:43 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:38:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:38:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:38:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:38:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:38:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:38:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:38:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:38:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:38:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:38:52 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 17:38:52 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:38:52 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:38:52 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:38:52 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:38:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:38:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:38:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:38:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:38:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:38:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:38:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:38:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:38:57 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:38:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 17:38:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:38:58 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 17:38:58 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 17:38:58 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:38:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:38:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43624395
Sat 18 Jan 2014 17:38:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:38:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43624395
Sat 18 Jan 2014 17:38:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:38:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:39:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:39:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:39:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:39:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:39:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:39:07 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:39:07 - job_xml_thread(): Done retrieving: data size 43624395
Sat 18 Jan 2014 17:39:07 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:39:08 - XML: Start document: iteration 6
Sat 18 Jan 2014 17:39:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:39:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:39:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:39:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:39:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43624395
Sat 18 Jan 2014 17:39:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:39:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:39:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:39:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:39:19 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:39:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:39:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:39:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:39:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:39:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:39:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:39:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:39:27 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 17:39:27 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:39:27 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:39:27 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:39:27 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:39:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:39:28 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:39:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:39:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:39:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:39:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:39:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:39:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:39:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:39:29 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:39:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:39:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43651990
Sat 18 Jan 2014 17:39:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:39:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43651990
Sat 18 Jan 2014 17:39:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:39:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:39:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 17:39:30 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:39:30 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:39:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7376 values 116275 bits 14534 bytes 
Sat 18 Jan 2014 17:39:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 17:39:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:39:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:39:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:39:39 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:39:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:39:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:39:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:39:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:39:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:39:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:39:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:39:42 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:39:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:39:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:39:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:39:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:39:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:39:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:39:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:39:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:39:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:39:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:39:48 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:39:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 17:39:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:39:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:39:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43631549
Sat 18 Jan 2014 17:39:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:39:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43631549
Sat 18 Jan 2014 17:39:49 - job_xml_thread(): Done retrieving: data size 43631549
Sat 18 Jan 2014 17:39:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:39:49 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:39:49 - XML: Start document: iteration 7
Sat 18 Jan 2014 17:39:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:39:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:40:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:40:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:40:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:40:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:40:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:40:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:40:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:40:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:40:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:40:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:40:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:40:09 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 17:40:09 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:40:09 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:40:10 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:40:10 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:40:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:40:12 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:40:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:40:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:40:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:40:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:40:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:40:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:40:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:40:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43634812
Sat 18 Jan 2014 17:40:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:40:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43634812
Sat 18 Jan 2014 17:40:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:40:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:40:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:40:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:40:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:40:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:40:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:40:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:40:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:40:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43634812
Sat 18 Jan 2014 17:40:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:40:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:40:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:40:25 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:40:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:40:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:40:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:40:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:40:31 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:40:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:40:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 17:40:31 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:40:31 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:40:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 17:40:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99068 bits 12383 bytes 
Sat 18 Jan 2014 17:40:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:40:32 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:40:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:40:32 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:40:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:40:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:40:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:40:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:40:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:40:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:40:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:40:34 - job_xml_thread(): Done retrieving: data size 43610538
Sat 18 Jan 2014 17:40:34 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:40:34 - XML: Start document: iteration 8
Sat 18 Jan 2014 17:40:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43610538
Sat 18 Jan 2014 17:40:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:40:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:40:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:40:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:40:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:40:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43610538
Sat 18 Jan 2014 17:40:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:40:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:40:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:40:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:40:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:40:52 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 17:40:52 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:40:52 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:40:52 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:40:52 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:40:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:40:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:40:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:40:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:40:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:40:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:40:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:40:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:40:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:40:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:40:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:40:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:40:58 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:40:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:40:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:40:58 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:40:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 17:40:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:40:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:40:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:40:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:40:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:41:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:41:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43662912
Sat 18 Jan 2014 17:41:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:41:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43662912
Sat 18 Jan 2014 17:41:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:41:08 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:41:08 - job_xml_thread(): Done retrieving: data size 43662912
Sat 18 Jan 2014 17:41:08 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:41:08 - XML: Start document: iteration 9
Sat 18 Jan 2014 17:41:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:41:10 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:41:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:41:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:41:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:41:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:41:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:41:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:41:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:41:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:41:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:41:19 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 17:41:19 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:41:19 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:41:19 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:41:19 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:41:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:41:22 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:41:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:41:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:41:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:41:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:41:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:41:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:41:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:41:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43537135
Sat 18 Jan 2014 17:41:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:41:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43537135
Sat 18 Jan 2014 17:41:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:41:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:41:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:41:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:41:32 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:41:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:41:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 17:41:33 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:41:33 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:41:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 17:41:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9043 values 142598 bits 17824 bytes 
Sat 18 Jan 2014 17:41:34 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:41:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:41:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:41:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:41:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:41:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:41:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:41:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:41:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:41:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:41:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:41:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:41:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:41:39 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:41:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:41:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:41:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:41:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:41:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:41:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:41:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:41:41 - job_xml_thread(): Done retrieving: data size 43071800
Sat 18 Jan 2014 17:41:41 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:41:41 - XML: Start document: iteration 10
Sat 18 Jan 2014 17:41:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43071800
Sat 18 Jan 2014 17:41:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:41:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43071800
Sat 18 Jan 2014 17:41:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:41:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:41:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:41:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:41:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:41:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:41:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:41:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:41:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:41:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:41:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:41:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:41:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:41:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:42:03 - XML: Processed 647278 elements - found 0 jobs
Sat 18 Jan 2014 17:42:03 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:42:03 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:42:03 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:42:03 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:42:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:42:05 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:42:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:42:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:42:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:42:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:42:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:42:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:42:05 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:42:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 17:42:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:42:07 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 17:42:07 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:42:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:42:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42948000
Sat 18 Jan 2014 17:42:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:42:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42948000
Sat 18 Jan 2014 17:42:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:42:08 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:42:08 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:42:08 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 17:42:08 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 17:42:08 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 17:42:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:42:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:42:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:42:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:42:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:42:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:42:18 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:42:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:42:18 - size of cluster 'LISA Cluster': 624 hosts 79458 metrics 763010 values 12034797 bits 1504349 bytes 
Sat 18 Jan 2014 17:42:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:42:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:42:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:42:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:42:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:42:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:42:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:42:22 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:42:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:42:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:42:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:42:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:42:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:42:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:42:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:42:26 - job_xml_thread(): Done retrieving: data size 43037755
Sat 18 Jan 2014 17:42:26 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:42:26 - XML: Start document: iteration 11
Sat 18 Jan 2014 17:42:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43037755
Sat 18 Jan 2014 17:42:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:42:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43037755
Sat 18 Jan 2014 17:42:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:42:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:42:33 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:42:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:42:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:42:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:42:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 17:42:35 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:42:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 17:42:35 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:42:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8815 values 138957 bits 17369 bytes 
Sat 18 Jan 2014 17:42:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:42:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:42:45 - XML: Processed 646744 elements - found 0 jobs
Sat 18 Jan 2014 17:42:45 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:42:45 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:42:45 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:42:45 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:42:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:42:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:42:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:42:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:42:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:42:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:42:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:42:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:42:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:42:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:42:49 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:42:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:42:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:42:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:42:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:42:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:42:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:42:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:42:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43596689
Sat 18 Jan 2014 17:42:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:42:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43596689
Sat 18 Jan 2014 17:42:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:43:00 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:43:00 - job_xml_thread(): Done retrieving: data size 43596689
Sat 18 Jan 2014 17:43:00 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:43:00 - XML: Start document: iteration 12
Sat 18 Jan 2014 17:43:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:43:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:43:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:43:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:43:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:43:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:43:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:43:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:43:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:43:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:43:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:43:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:43:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:43:09 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:43:09 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 17:43:15 - XML: Processed 653714 elements - found 0 jobs
Sat 18 Jan 2014 17:43:15 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:43:15 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:43:15 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:43:15 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:43:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:43:16 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:43:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:43:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:43:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:43:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:43:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:43:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:43:17 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:43:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 17:43:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:43:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:43:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43591632
Sat 18 Jan 2014 17:43:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:43:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43591632
Sat 18 Jan 2014 17:43:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:43:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:43:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:43:31 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:43:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:43:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:43:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:43:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:43:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:43:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:43:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:43:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:43:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:43:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:43:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:43:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:43:35 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:43:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:43:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:43:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:43:35 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:43:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:43:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:43:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:43:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:43:36 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:43:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:43:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 17:43:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 17:43:36 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:43:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5746 values 90579 bits 11322 bytes 
Sat 18 Jan 2014 17:43:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:43:38 - job_xml_thread(): Done retrieving: data size 43624907
Sat 18 Jan 2014 17:43:38 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:43:38 - XML: Start document: iteration 13
Sat 18 Jan 2014 17:43:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43624907
Sat 18 Jan 2014 17:43:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:43:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43624907
Sat 18 Jan 2014 17:43:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:43:48 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 17:43:48 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:43:48 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:43:48 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:43:48 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:43:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:43:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:43:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:43:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:43:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:43:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:43:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:43:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:43:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:43:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:43:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:43:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:43:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:43:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:43:59 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:43:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:43:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:44:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:44:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:44:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:44:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:44:01 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:44:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 17:44:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:44:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:44:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43627704
Sat 18 Jan 2014 17:44:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:44:03 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:44:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43627704
Sat 18 Jan 2014 17:44:03 - job_xml_thread(): Done retrieving: data size 43627704
Sat 18 Jan 2014 17:44:03 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:44:03 - XML: Start document: iteration 14
Sat 18 Jan 2014 17:44:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:44:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:44:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:44:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:44:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:44:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:44:18 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:44:18 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 17:44:18 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:44:18 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:44:18 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:44:18 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:44:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:44:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:44:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:44:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:44:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:44:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:44:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:44:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:44:23 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:44:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:44:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:44:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:44:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:44:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:44:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:44:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:44:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43639389
Sat 18 Jan 2014 17:44:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:44:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43639389
Sat 18 Jan 2014 17:44:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:44:33 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:44:33 - job_xml_thread(): Done retrieving: data size 43639389
Sat 18 Jan 2014 17:44:33 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:44:33 - XML: Start document: iteration 15
Sat 18 Jan 2014 17:44:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:44:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:44:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:44:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:44:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:44:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:44:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:44:36 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:44:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:44:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:44:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:44:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:44:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:44:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:44:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 17:44:37 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:44:37 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:44:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 17:44:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8100 values 127662 bits 15957 bytes 
Sat 18 Jan 2014 17:44:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:44:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:44:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:44:49 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:44:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:44:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:44:50 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 17:44:50 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:44:50 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:44:50 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:44:50 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:44:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:44:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:44:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:44:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:44:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:44:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:44:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:44:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43604830
Sat 18 Jan 2014 17:44:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:44:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43604830
Sat 18 Jan 2014 17:44:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:45:05 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:45:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:45:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:45:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:45:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:45:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:45:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:45:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:45:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:45:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:45:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:45:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:45:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:45:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:45:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:45:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:45:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:45:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:45:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:45:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:45:10 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:45:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 17:45:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:45:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:45:12 - job_xml_thread(): Done retrieving: data size 43642608
Sat 18 Jan 2014 17:45:12 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:45:12 - XML: Start document: iteration 16
Sat 18 Jan 2014 17:45:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43642608
Sat 18 Jan 2014 17:45:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:45:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43642608
Sat 18 Jan 2014 17:45:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:45:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:45:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:45:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:45:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:45:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:45:29 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:45:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:45:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:45:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:45:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:45:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:45:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:45:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:45:31 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 17:45:31 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:45:31 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:45:31 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:45:31 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:45:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:45:33 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:45:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:45:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:45:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:45:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:45:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:45:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:45:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:45:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43626965
Sat 18 Jan 2014 17:45:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:45:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43626965
Sat 18 Jan 2014 17:45:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:45:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:45:37 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:45:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:45:38 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:45:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 17:45:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 17:45:38 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:45:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8744 values 137890 bits 17236 bytes 
Sat 18 Jan 2014 17:45:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:45:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:45:46 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:45:46 - job_xml_thread(): Done retrieving: data size 43626965
Sat 18 Jan 2014 17:45:46 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:45:46 - XML: Start document: iteration 17
Sat 18 Jan 2014 17:45:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:45:49 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:45:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:45:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:45:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:45:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:45:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:45:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:45:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:45:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:45:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:45:57 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 17:45:57 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:45:57 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:45:57 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:45:57 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:45:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:45:59 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:45:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:45:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:46:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:46:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:46:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:46:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:46:01 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 17:46:01 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 17:46:01 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:46:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:46:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43620397
Sat 18 Jan 2014 17:46:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:46:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43620397
Sat 18 Jan 2014 17:46:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:46:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:46:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:46:12 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:46:12 - job_xml_thread(): Done retrieving: data size 43620397
Sat 18 Jan 2014 17:46:12 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:46:12 - XML: Start document: iteration 18
Sat 18 Jan 2014 17:46:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:46:13 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:46:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:46:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:46:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:46:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:46:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:46:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:46:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:46:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:46:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:46:16 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:46:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 17:46:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:46:25 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 17:46:25 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:46:25 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:46:25 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:46:25 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:46:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:46:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:46:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:46:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:46:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:46:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:46:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:46:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:46:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:46:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43619382
Sat 18 Jan 2014 17:46:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:46:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43619382
Sat 18 Jan 2014 17:46:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:46:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:46:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:46:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:46:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:46:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:46:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:46:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:46:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:46:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:46:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43619382
Sat 18 Jan 2014 17:46:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:46:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:46:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:46:38 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:46:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:46:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 17:46:40 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:46:40 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:46:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 17:46:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6079 values 96000 bits 12000 bytes 
Sat 18 Jan 2014 17:46:41 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:46:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:46:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:46:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:46:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:46:46 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:46:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:46:49 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:46:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:46:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:46:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:46:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:46:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:46:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:46:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:46:51 - job_xml_thread(): Done retrieving: data size 43615763
Sat 18 Jan 2014 17:46:51 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:46:51 - XML: Start document: iteration 19
Sat 18 Jan 2014 17:46:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:46:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:46:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43615763
Sat 18 Jan 2014 17:46:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:46:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:46:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:46:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43615763
Sat 18 Jan 2014 17:46:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:46:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:46:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:47:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:47:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:47:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:47:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:47:05 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:47:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 17:47:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:47:08 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 17:47:08 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:47:08 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:47:08 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:47:08 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:47:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:47:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:47:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:47:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:47:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:47:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:47:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:47:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:47:12 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:47:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:47:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:47:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:47:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:47:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:47:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:47:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:47:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43597394
Sat 18 Jan 2014 17:47:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:47:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43597394
Sat 18 Jan 2014 17:47:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:47:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:47:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:47:23 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:47:23 - job_xml_thread(): Done retrieving: data size 43597394
Sat 18 Jan 2014 17:47:23 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:47:23 - XML: Start document: iteration 20
Sat 18 Jan 2014 17:47:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:47:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:47:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:47:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:47:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:47:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:47:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:47:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:47:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:47:34 - XML: Processed 653448 elements - found 0 jobs
Sat 18 Jan 2014 17:47:34 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:47:34 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:47:34 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:47:34 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:47:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:47:35 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:47:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:47:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:47:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:47:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:47:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:47:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:47:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:47:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43196551
Sat 18 Jan 2014 17:47:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:47:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43196551
Sat 18 Jan 2014 17:47:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:47:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:47:41 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:47:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:47:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:47:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:47:42 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:47:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 17:47:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 17:47:43 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:47:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9104 values 144117 bits 18014 bytes 
Sat 18 Jan 2014 17:47:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:47:47 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:47:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:47:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:47:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:47:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:47:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:47:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:47:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:47:49 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:47:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:47:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:47:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:47:52 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:47:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:47:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:47:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:47:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:47:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:47:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:47:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:47:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42990420
Sat 18 Jan 2014 17:47:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:47:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42990420
Sat 18 Jan 2014 17:47:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:47:55 - job_xml_thread(): Done retrieving: data size 42990420
Sat 18 Jan 2014 17:47:55 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:47:55 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 17:47:56 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 17:47:56 - Housekeeping: done.
Sat 18 Jan 2014 17:47:56 - XML: Start document: iteration 0
Sat 18 Jan 2014 17:48:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:48:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:48:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:48:07 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:48:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:48:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:48:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:48:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:48:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:48:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:48:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:48:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:48:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:48:17 - XML: Processed 646131 elements - found 0 jobs
Sat 18 Jan 2014 17:48:17 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:48:17 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:48:17 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:48:17 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:48:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:48:18 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:48:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:48:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:48:18 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:48:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 17:48:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:48:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:48:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:48:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:48:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:48:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:48:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43001308
Sat 18 Jan 2014 17:48:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:48:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43001308
Sat 18 Jan 2014 17:48:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:48:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:48:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:48:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:48:30 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:48:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:48:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:48:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:48:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:48:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:48:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:48:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:48:33 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:48:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:48:33 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:48:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:48:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:48:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:48:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:48:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:48:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:48:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:48:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43461852
Sat 18 Jan 2014 17:48:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:48:35 - job_xml_thread(): Done retrieving: data size 43461852
Sat 18 Jan 2014 17:48:35 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:48:35 - XML: Start document: iteration 1
Sat 18 Jan 2014 17:48:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43461852
Sat 18 Jan 2014 17:48:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:48:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:48:42 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:48:43 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:48:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 17:48:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:48:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 17:48:43 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:48:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8882 values 140275 bits 17534 bytes 
Sat 18 Jan 2014 17:48:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:48:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:48:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:48:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:48:50 - XML: Processed 652128 elements - found 0 jobs
Sat 18 Jan 2014 17:48:50 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:48:50 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:48:50 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:48:50 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:48:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:48:53 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:48:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:48:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:48:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:48:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:48:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:48:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:48:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:48:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:48:57 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:48:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:48:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:48:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:48:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:48:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:48:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:48:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:48:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43615939
Sat 18 Jan 2014 17:48:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:49:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43615939
Sat 18 Jan 2014 17:49:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:49:06 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:49:06 - job_xml_thread(): Done retrieving: data size 43615939
Sat 18 Jan 2014 17:49:06 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:49:06 - XML: Start document: iteration 2
Sat 18 Jan 2014 17:49:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:49:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:49:09 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 17:49:09 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:49:11 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:49:11 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:49:11 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 17:49:11 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 17:49:12 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 17:49:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:49:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:49:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:49:14 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:49:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:49:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:49:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:49:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:49:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:49:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:49:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:49:17 - XML: Processed 653680 elements - found 0 jobs
Sat 18 Jan 2014 17:49:17 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:49:17 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:49:17 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:49:17 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:49:19 - size of cluster 'LISA Cluster': 624 hosts 79471 metrics 850323 values 13431596 bits 1678949 bytes 
Sat 18 Jan 2014 17:49:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:49:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:49:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:49:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:49:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:49:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:49:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:49:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:49:24 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:49:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 17:49:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:49:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:49:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43623453
Sat 18 Jan 2014 17:49:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:49:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43623453
Sat 18 Jan 2014 17:49:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:49:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:49:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:49:33 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:49:33 - job_xml_thread(): Done retrieving: data size 43623453
Sat 18 Jan 2014 17:49:33 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:49:33 - XML: Start document: iteration 3
Sat 18 Jan 2014 17:49:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:49:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:49:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:49:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:49:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:49:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:49:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:49:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:49:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:49:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:49:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:49:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:49:43 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:49:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:49:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 17:49:44 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:49:44 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:49:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 17:49:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5735 values 90461 bits 11307 bytes 
Sat 18 Jan 2014 17:49:47 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 17:49:47 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:49:47 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:49:47 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:49:47 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:49:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:49:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:49:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:49:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:49:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:49:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:49:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:49:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:49:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:49:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43611852
Sat 18 Jan 2014 17:49:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:49:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43611852
Sat 18 Jan 2014 17:49:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:49:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:49:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:50:02 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:50:02 - job_xml_thread(): Done retrieving: data size 43611852
Sat 18 Jan 2014 17:50:02 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:50:02 - XML: Start document: iteration 4
Sat 18 Jan 2014 17:50:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:50:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:50:12 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:50:12 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 17:50:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:50:13 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:50:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:50:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:50:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:50:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:50:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:50:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:50:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:50:15 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 17:50:15 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:50:15 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:50:15 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:50:15 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:50:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:50:18 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:50:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:50:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:50:19 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:50:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 17:50:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:50:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:50:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:50:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:50:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:50:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:50:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43626160
Sat 18 Jan 2014 17:50:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:50:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43626160
Sat 18 Jan 2014 17:50:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:50:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:50:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:50:30 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:50:30 - job_xml_thread(): Done retrieving: data size 43626160
Sat 18 Jan 2014 17:50:31 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:50:31 - XML: Start document: iteration 5
Sat 18 Jan 2014 17:50:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:50:32 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:50:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:50:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:50:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:50:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:50:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:50:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:50:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:50:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:50:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:50:43 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 17:50:43 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:50:43 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:50:43 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:50:43 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:50:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:50:44 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:50:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:50:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 17:50:45 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:50:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 17:50:45 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:50:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5601 values 88296 bits 11037 bytes 
Sat 18 Jan 2014 17:50:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:50:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:50:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:50:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:50:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:50:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:50:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:50:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:50:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:50:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:50:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:50:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43602159
Sat 18 Jan 2014 17:50:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:50:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43602159
Sat 18 Jan 2014 17:50:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:50:58 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:50:58 - job_xml_thread(): Done retrieving: data size 43602159
Sat 18 Jan 2014 17:50:58 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:50:58 - XML: Start document: iteration 6
Sat 18 Jan 2014 17:51:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:51:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:51:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:51:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:51:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:51:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:51:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:51:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:51:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:51:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:51:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:51:14 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 17:51:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:51:14 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:51:14 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:51:14 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:51:14 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:51:14 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:51:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:51:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:51:15 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:51:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 17:51:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:51:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:51:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:51:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:51:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:51:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:51:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43629938
Sat 18 Jan 2014 17:51:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:51:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43629938
Sat 18 Jan 2014 17:51:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:51:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:51:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:51:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:51:27 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:51:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:51:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:51:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:51:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:51:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:51:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:51:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:51:29 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:51:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:51:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:51:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:51:32 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:51:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:51:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:51:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:51:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:51:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:51:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:51:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:51:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43618495
Sat 18 Jan 2014 17:51:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:51:36 - job_xml_thread(): Done retrieving: data size 43618495
Sat 18 Jan 2014 17:51:36 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:51:36 - XML: Start document: iteration 7
Sat 18 Jan 2014 17:51:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43618495
Sat 18 Jan 2014 17:51:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:51:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:51:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:51:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:51:45 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:51:45 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:51:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 17:51:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:51:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 17:51:45 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:51:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8799 values 138758 bits 17344 bytes 
Sat 18 Jan 2014 17:51:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:51:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:51:54 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 17:51:54 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:51:54 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:51:54 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:51:55 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:51:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:51:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:51:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:51:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:51:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:51:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:51:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:51:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:51:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:52:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:52:01 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:52:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:52:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:52:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:52:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:52:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:52:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:52:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:52:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43632429
Sat 18 Jan 2014 17:52:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:52:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43632429
Sat 18 Jan 2014 17:52:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:52:10 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:52:10 - job_xml_thread(): Done retrieving: data size 43632429
Sat 18 Jan 2014 17:52:10 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:52:10 - XML: Start document: iteration 8
Sat 18 Jan 2014 17:52:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:52:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:52:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:52:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:52:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:52:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:52:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:52:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:52:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:52:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:52:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:52:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:52:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:52:26 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 17:52:27 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:52:27 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:52:27 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:52:27 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:52:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:52:28 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:52:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:52:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:52:28 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:52:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 17:52:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:52:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:52:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:52:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:52:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:52:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:52:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43627151
Sat 18 Jan 2014 17:52:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:52:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43627151
Sat 18 Jan 2014 17:52:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:52:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:52:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:52:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:52:42 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:52:42 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:52:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:52:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:52:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:52:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:52:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:52:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:52:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:52:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:52:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:52:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:52:45 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:52:46 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:52:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:52:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 17:52:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 17:52:46 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:52:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5862 values 92459 bits 11557 bytes 
Sat 18 Jan 2014 17:52:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:52:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:52:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:52:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:52:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:52:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:52:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:52:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:52:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:52:50 - job_xml_thread(): Done retrieving: data size 43622462
Sat 18 Jan 2014 17:52:50 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:52:50 - XML: Start document: iteration 9
Sat 18 Jan 2014 17:52:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43622462
Sat 18 Jan 2014 17:52:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:52:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43622462
Sat 18 Jan 2014 17:52:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:52:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:52:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:53:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:53:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:53:03 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 17:53:03 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:53:04 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:53:04 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:53:04 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:53:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:53:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:53:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:53:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:53:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:53:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:53:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:53:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:53:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:53:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:53:14 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:53:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:53:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:53:14 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:53:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 17:53:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:53:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:53:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:53:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:53:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:53:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:53:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564972
Sat 18 Jan 2014 17:53:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:53:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564972
Sat 18 Jan 2014 17:53:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:53:19 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:53:19 - job_xml_thread(): Done retrieving: data size 43564972
Sat 18 Jan 2014 17:53:19 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:53:19 - XML: Start document: iteration 10
Sat 18 Jan 2014 17:53:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:53:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:53:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:53:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:53:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:53:33 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:53:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:53:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:53:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:53:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:53:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:53:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:53:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:53:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:53:40 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:53:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:53:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:53:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:53:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:53:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:53:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:53:41 - XML: Processed 653448 elements - found 0 jobs
Sat 18 Jan 2014 17:53:41 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:53:41 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:53:41 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:53:41 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:53:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:53:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43079769
Sat 18 Jan 2014 17:53:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:53:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43079769
Sat 18 Jan 2014 17:53:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:53:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:53:46 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:53:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:53:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 17:53:47 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:53:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8772 values 138302 bits 17287 bytes 
Sat 18 Jan 2014 17:53:47 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:53:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 17:53:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:53:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:53:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:53:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:53:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:53:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:53:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:53:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:53:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:53:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:53:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:53:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:53:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:53:56 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:54:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:54:01 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:54:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:54:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:54:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:54:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:54:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:54:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:54:03 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 17:54:03 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 17:54:03 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:54:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:54:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42954554
Sat 18 Jan 2014 17:54:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:54:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42954554
Sat 18 Jan 2014 17:54:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:54:04 - job_xml_thread(): Done retrieving: data size 42954554
Sat 18 Jan 2014 17:54:04 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:54:04 - XML: Start document: iteration 11
Sat 18 Jan 2014 17:54:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:54:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:54:13 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:54:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 17:54:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:54:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:54:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:54:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:54:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:54:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:54:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:54:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:54:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:54:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:54:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:54:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:54:26 - XML: Processed 645996 elements - found 0 jobs
Sat 18 Jan 2014 17:54:26 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:54:26 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:54:26 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:54:26 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:54:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:54:28 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:54:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:54:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:54:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:54:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:54:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:54:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:54:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:54:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43081120
Sat 18 Jan 2014 17:54:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:54:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43081120
Sat 18 Jan 2014 17:54:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:54:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:54:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:54:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:54:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:54:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:54:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:54:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:54:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:54:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:54:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:54:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43081120
Sat 18 Jan 2014 17:54:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:54:41 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:54:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:54:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:54:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:54:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:54:47 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:54:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:54:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:54:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:54:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:54:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:54:48 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:54:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 17:54:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 17:54:48 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:54:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6150 values 96947 bits 12118 bytes 
Sat 18 Jan 2014 17:54:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:54:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:54:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:54:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:54:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:54:49 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:54:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:54:52 - job_xml_thread(): Done retrieving: data size 43579861
Sat 18 Jan 2014 17:54:52 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:54:52 - XML: Start document: iteration 12
Sat 18 Jan 2014 17:54:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579861
Sat 18 Jan 2014 17:54:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:54:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:54:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:54:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:54:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:54:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579861
Sat 18 Jan 2014 17:54:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:54:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:54:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:55:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:55:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:55:09 - XML: Processed 653810 elements - found 0 jobs
Sat 18 Jan 2014 17:55:09 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:55:09 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:55:09 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:55:10 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:55:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:55:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:55:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:55:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:55:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:55:16 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:55:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:55:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:55:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:55:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:55:16 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:55:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 17:55:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:55:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:55:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:55:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:55:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:55:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:55:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:55:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:55:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:55:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:55:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:55:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43631468
Sat 18 Jan 2014 17:55:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:55:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43631468
Sat 18 Jan 2014 17:55:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:55:25 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:55:25 - job_xml_thread(): Done retrieving: data size 43631468
Sat 18 Jan 2014 17:55:25 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:55:25 - XML: Start document: iteration 13
Sat 18 Jan 2014 17:55:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:55:29 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:55:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:55:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:55:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:55:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:55:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:55:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:55:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:55:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:55:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:55:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:55:40 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:55:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:55:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:55:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:55:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:55:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:55:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:55:41 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 17:55:41 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:55:41 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:55:41 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:55:41 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:55:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:55:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43628387
Sat 18 Jan 2014 17:55:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:55:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43628387
Sat 18 Jan 2014 17:55:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:55:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:55:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:55:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:55:48 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:55:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:55:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 17:55:50 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:55:50 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:55:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 17:55:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8944 values 141076 bits 17634 bytes 
Sat 18 Jan 2014 17:55:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:55:51 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:55:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:55:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:55:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:55:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:55:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:55:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:55:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:55:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:55:56 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:55:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:55:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:55:56 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:55:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:55:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:55:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:55:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:55:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:55:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:55:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:55:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43638293
Sat 18 Jan 2014 17:55:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:55:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43638293
Sat 18 Jan 2014 17:55:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:55:59 - job_xml_thread(): Done retrieving: data size 43638293
Sat 18 Jan 2014 17:55:59 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:55:59 - XML: Start document: iteration 14
Sat 18 Jan 2014 17:56:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:56:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:56:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:56:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:56:13 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 17:56:13 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:56:13 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:56:13 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 17:56:13 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 17:56:13 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:56:13 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 17:56:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:56:18 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:56:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:56:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:56:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:56:18 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:56:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:56:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:56:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:56:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:56:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:56:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:56:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:56:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:56:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:56:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:56:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:56:21 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 799002 values 12598537 bits 1574817 bytes 
Sat 18 Jan 2014 17:56:22 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 17:56:22 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:56:22 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:56:22 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:56:22 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:56:22 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:56:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 17:56:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:56:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:56:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43651834
Sat 18 Jan 2014 17:56:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:56:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43651834
Sat 18 Jan 2014 17:56:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:56:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:56:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:56:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:56:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:56:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:56:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:56:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:56:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:56:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:56:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:56:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:56:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:56:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:56:37 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:56:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:56:40 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:56:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:56:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:56:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:56:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:56:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:56:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:56:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:56:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43639240
Sat 18 Jan 2014 17:56:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:56:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43639240
Sat 18 Jan 2014 17:56:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:56:44 - job_xml_thread(): Done retrieving: data size 43639240
Sat 18 Jan 2014 17:56:44 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:56:44 - XML: Start document: iteration 15
Sat 18 Jan 2014 17:56:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:56:50 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:56:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:56:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:56:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:56:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 17:56:51 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:56:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8932 values 140805 bits 17600 bytes 
Sat 18 Jan 2014 17:56:51 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:56:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 17:56:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:56:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:56:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:56:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:56:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:56:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:57:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:57:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:57:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:57:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:57:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:57:03 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 17:57:04 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:57:04 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:57:04 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:57:04 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:57:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:57:06 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:57:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:57:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:57:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:57:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:57:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:57:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:57:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:57:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43641841
Sat 18 Jan 2014 17:57:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:57:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43641841
Sat 18 Jan 2014 17:57:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:57:14 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:57:14 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 17:57:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:57:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:57:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:57:18 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:57:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:57:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:57:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:57:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:57:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:57:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:57:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43641841
Sat 18 Jan 2014 17:57:19 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:57:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:57:19 - job_xml_thread(): Done retrieving: data size 43641841
Sat 18 Jan 2014 17:57:19 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:57:19 - XML: Start document: iteration 16
Sat 18 Jan 2014 17:57:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:57:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:57:25 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:57:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 17:57:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:57:31 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 17:57:31 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:57:31 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:57:31 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:57:31 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:57:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:57:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:57:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:57:39 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:57:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:57:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:57:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:57:39 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:57:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:57:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:57:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:57:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:57:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:57:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:57:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:57:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:57:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:57:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:57:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:57:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:57:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43651651
Sat 18 Jan 2014 17:57:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:57:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43651651
Sat 18 Jan 2014 17:57:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:57:46 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:57:46 - job_xml_thread(): Done retrieving: data size 43651651
Sat 18 Jan 2014 17:57:46 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:57:46 - XML: Start document: iteration 17
Sat 18 Jan 2014 17:57:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:57:51 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:57:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:57:52 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:57:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:57:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 17:57:53 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:57:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 17:57:53 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:57:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99047 bits 12380 bytes 
Sat 18 Jan 2014 17:57:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:57:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:57:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:57:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:57:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:57:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:57:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:57:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:57:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:58:00 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 17:58:00 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:58:00 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:58:00 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:58:00 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:58:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:58:05 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:58:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:58:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:58:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:58:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:58:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:58:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:58:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:58:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43627457
Sat 18 Jan 2014 17:58:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:58:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43627457
Sat 18 Jan 2014 17:58:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:58:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:58:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:58:15 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:58:15 - job_xml_thread(): Done retrieving: data size 43627457
Sat 18 Jan 2014 17:58:15 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:58:15 - XML: Start document: iteration 18
Sat 18 Jan 2014 17:58:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:58:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:58:22 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:58:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 17:58:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:58:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:58:27 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:58:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:58:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:58:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:58:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:58:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:58:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:58:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:58:30 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 17:58:30 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:58:30 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:58:30 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:58:30 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:58:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:58:32 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:58:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:58:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:58:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:58:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:58:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:58:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:58:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:58:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43640384
Sat 18 Jan 2014 17:58:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:58:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43640384
Sat 18 Jan 2014 17:58:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:58:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:58:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:58:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:58:43 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:58:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:58:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:58:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:58:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:58:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:58:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43640384
Sat 18 Jan 2014 17:58:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:58:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:58:45 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:58:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:58:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:58:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:58:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:58:53 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:58:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:58:54 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:58:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 17:58:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 17:58:54 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:58:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6064 values 95595 bits 11949 bytes 
Sat 18 Jan 2014 17:58:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:58:56 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:58:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:58:57 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:58:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:58:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:58:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:58:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:58:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:58:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:58:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:58:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:59:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:59:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:59:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:59:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:59:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:59:01 - job_xml_thread(): Done retrieving: data size 43604594
Sat 18 Jan 2014 17:59:01 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:59:01 - XML: Start document: iteration 19
Sat 18 Jan 2014 17:59:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43604594
Sat 18 Jan 2014 17:59:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43604594
Sat 18 Jan 2014 17:59:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:59:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:59:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:59:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:59:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:59:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:59:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:59:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:59:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 17:59:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:59:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:59:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:59:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:59:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:59:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:59:22 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 17:59:22 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:59:22 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:59:22 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:59:22 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:59:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:59:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:59:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:59:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:59:25 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:59:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 17:59:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:59:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:59:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:59:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:59:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:59:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:59:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559236
Sat 18 Jan 2014 17:59:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:59:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559236
Sat 18 Jan 2014 17:59:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:59:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 17:59:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 17:59:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:59:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:59:37 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 17:59:37 - job_xml_thread(): Done retrieving: data size 43559236
Sat 18 Jan 2014 17:59:37 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 17:59:38 - XML: Start document: iteration 20
Sat 18 Jan 2014 17:59:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:59:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:59:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 17:59:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 17:59:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 17:59:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 17:59:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:59:48 - XML: Processed 653444 elements - found 0 jobs
Sat 18 Jan 2014 17:59:48 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 17:59:48 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 17:59:48 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 17:59:48 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 17:59:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 17:59:49 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 17:59:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 17:59:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 17:59:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:59:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 17:59:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 17:59:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 17:59:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 17:59:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43010944
Sat 18 Jan 2014 17:59:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 17:59:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43010944
Sat 18 Jan 2014 17:59:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 17:59:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:59:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 17:59:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 17:59:54 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 17:59:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:59:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 17:59:55 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 17:59:55 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 17:59:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 17:59:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8819 values 138991 bits 17373 bytes 
Sat 18 Jan 2014 18:00:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:00:02 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:00:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:00:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:00:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:00:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:00:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43010944
Sat 18 Jan 2014 18:00:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:00:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:00:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:00:03 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:00:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:00:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:00:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:00:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:00:13 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:00:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:00:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:00:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:00:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:00:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:00:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:00:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:00:15 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:00:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:00:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:00:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:00:18 - job_xml_thread(): Done retrieving: data size 42993369
Sat 18 Jan 2014 18:00:18 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:00:18 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 18:00:18 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 18:00:18 - Housekeeping: done.
Sat 18 Jan 2014 18:00:18 - XML: Start document: iteration 0
Sat 18 Jan 2014 18:00:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42993369
Sat 18 Jan 2014 18:00:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:00:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:00:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:00:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42993369
Sat 18 Jan 2014 18:00:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:00:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:00:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:00:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:00:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:00:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:00:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:00:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:00:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:00:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:00:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:00:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:00:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:00:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:00:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:00:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:00:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:00:39 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:00:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:00:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:00:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:00:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:00:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:00:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:00:41 - XML: Processed 646670 elements - found 0 jobs
Sat 18 Jan 2014 18:00:41 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:00:41 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:00:41 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:00:41 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:00:41 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:00:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 18:00:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:00:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:00:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43542273
Sat 18 Jan 2014 18:00:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:00:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43542273
Sat 18 Jan 2014 18:00:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:00:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:00:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:00:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:00:55 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:00:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:00:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:00:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:00:56 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:00:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 18:00:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 18:00:56 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:00:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6061 values 95582 bits 11947 bytes 
Sat 18 Jan 2014 18:00:56 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:00:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:00:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:00:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:00:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:00:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:00:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:00:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:00:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:00:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:01:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:01:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:01:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:01:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:01:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:01:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:01:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:01:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:01:03 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 18:01:03 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 18:01:03 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:01:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:01:03 - job_xml_thread(): Done retrieving: data size 43625706
Sat 18 Jan 2014 18:01:03 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:01:03 - XML: Start document: iteration 1
Sat 18 Jan 2014 18:01:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43625706
Sat 18 Jan 2014 18:01:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:01:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43625706
Sat 18 Jan 2014 18:01:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:01:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:01:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:01:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:01:14 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:01:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:01:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:01:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:01:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:01:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:01:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:01:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:01:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:01:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:01:21 - XML: Processed 654184 elements - found 0 jobs
Sat 18 Jan 2014 18:01:21 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:01:21 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:01:21 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:01:21 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:01:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:01:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:01:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:01:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:01:25 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:01:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 18:01:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:01:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:01:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:01:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:01:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:01:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:01:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43597209
Sat 18 Jan 2014 18:01:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:01:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43597209
Sat 18 Jan 2014 18:01:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:01:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:01:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:01:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:01:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:01:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:01:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:01:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:01:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:01:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:01:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:01:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43597209
Sat 18 Jan 2014 18:01:36 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:01:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:01:36 - job_xml_thread(): Done retrieving: data size 43597209
Sat 18 Jan 2014 18:01:36 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:01:36 - XML: Start document: iteration 2
Sat 18 Jan 2014 18:01:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:01:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:01:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:01:46 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:01:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:01:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:01:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:01:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:01:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:01:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:01:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:01:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:01:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:01:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:01:52 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:01:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:01:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:01:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:01:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:01:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:01:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:01:54 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:01:54 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:01:54 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:01:54 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:01:54 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:01:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:01:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43639863
Sat 18 Jan 2014 18:01:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:01:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43639863
Sat 18 Jan 2014 18:01:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:01:56 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:01:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:01:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:01:57 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:01:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 18:01:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 18:01:57 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:01:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9099 values 143830 bits 17978 bytes 
Sat 18 Jan 2014 18:02:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:02:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:02:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:02:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:02:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:02:07 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:02:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:02:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:02:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:02:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:02:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:02:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:02:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:02:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:02:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:02:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:02:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:02:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:02:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:02:09 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:02:09 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:02:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 18:02:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:02:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:02:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43651180
Sat 18 Jan 2014 18:02:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:02:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43651180
Sat 18 Jan 2014 18:02:11 - job_xml_thread(): Done retrieving: data size 43651180
Sat 18 Jan 2014 18:02:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:02:11 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:02:12 - XML: Start document: iteration 3
Sat 18 Jan 2014 18:02:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:02:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:02:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:02:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:02:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:02:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:02:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:02:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:02:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:02:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:02:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:02:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:02:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:02:29 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:02:30 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:02:30 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:02:30 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:02:30 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:02:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:02:31 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:02:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:02:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:02:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:02:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:02:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:02:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:02:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:02:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43628510
Sat 18 Jan 2014 18:02:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:02:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43628510
Sat 18 Jan 2014 18:02:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:02:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:02:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:02:45 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:02:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:02:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:02:45 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:02:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:02:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:02:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:02:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:02:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:02:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:02:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:02:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:02:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:02:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:02:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:02:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:02:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:02:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:02:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:02:49 - job_xml_thread(): Done retrieving: data size 43646412
Sat 18 Jan 2014 18:02:49 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:02:49 - XML: Start document: iteration 4
Sat 18 Jan 2014 18:02:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43646412
Sat 18 Jan 2014 18:02:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43646412
Sat 18 Jan 2014 18:02:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:02:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:02:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:02:57 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:02:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:02:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 18:02:59 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:02:59 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:02:59 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 149123 bits 18640 bytes 
Sat 18 Jan 2014 18:02:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 18:03:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:03:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:03:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:03:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:03:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:03:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:03:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:03:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:03:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:03:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:03:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:03:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:03:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:03:07 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:03:07 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:03:07 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:03:07 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:03:07 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:03:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:03:11 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:03:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:03:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:03:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:03:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:03:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:03:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:03:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:03:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43625157
Sat 18 Jan 2014 18:03:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:03:14 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 18:03:14 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:03:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43625157
Sat 18 Jan 2014 18:03:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:03:15 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:03:15 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 18:03:15 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 18:03:15 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:03:15 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 18:03:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:03:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:03:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:03:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:03:22 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:03:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:03:22 - job_xml_thread(): Done retrieving: data size 43625157
Sat 18 Jan 2014 18:03:22 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:03:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:03:22 - XML: Start document: iteration 5
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sat 18 Jan 2014 18:03:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:03:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:03:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:03:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:03:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43625157
Sat 18 Jan 2014 18:03:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:03:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:03:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:03:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:03:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:03:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:03:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:03:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:03:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:03:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:03:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:03:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:03:41 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:03:41 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:03:41 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:03:41 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:03:41 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:03:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:03:43 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:03:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:03:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:03:43 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:03:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 18:03:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:03:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:03:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:03:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:03:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:03:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:03:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43630787
Sat 18 Jan 2014 18:03:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:03:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43630787
Sat 18 Jan 2014 18:03:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:03:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:03:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:03:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:03:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:03:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:03:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:03:56 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:03:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:03:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:03:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:03:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:03:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:03:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:03:57 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:03:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:03:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:03:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:03:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:03:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:03:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:03:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:03:59 - job_xml_thread(): Done retrieving: data size 43636296
Sat 18 Jan 2014 18:03:59 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:03:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43636296
Sat 18 Jan 2014 18:03:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:03:59 - XML: Start document: iteration 6
Sat 18 Jan 2014 18:04:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:04:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43636296
Sat 18 Jan 2014 18:04:00 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:04:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:04:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:04:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 18:04:01 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:04:03 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:04:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 18:04:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8945 values 141171 bits 17646 bytes 
Sat 18 Jan 2014 18:04:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:04:11 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:04:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:04:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:04:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:04:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:04:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:04:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:04:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:04:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:04:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:04:15 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:04:15 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:04:16 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:04:16 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:04:16 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 18:04:16 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 18:04:16 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 18:04:22 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:04:22 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:04:22 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:04:22 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:04:22 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:04:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:04:23 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:04:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:04:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:04:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:04:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:04:23 - size of cluster 'LISA Cluster': 624 hosts 79487 metrics 857884 values 13550055 bits 1693756 bytes 
Sat 18 Jan 2014 18:04:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:04:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:04:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:04:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43612431
Sat 18 Jan 2014 18:04:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:04:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43612431
Sat 18 Jan 2014 18:04:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:04:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:04:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:04:30 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:04:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 18:04:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:04:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:04:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:04:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:04:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:04:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:04:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:04:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:04:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:04:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43612431
Sat 18 Jan 2014 18:04:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:04:37 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:04:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:04:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:04:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:04:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:04:46 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:04:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:04:48 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:04:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:04:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:04:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:04:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:04:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:04:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:04:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:04:51 - job_xml_thread(): Done retrieving: data size 43616364
Sat 18 Jan 2014 18:04:51 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:04:51 - XML: Start document: iteration 7
Sat 18 Jan 2014 18:04:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43616364
Sat 18 Jan 2014 18:04:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:04:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:04:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:04:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:04:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:04:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:04:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:04:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43616364
Sat 18 Jan 2014 18:04:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:05:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:05:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:05:04 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:05:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:05:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:05:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 18:05:04 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:05:04 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:05:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 18:05:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99112 bits 12389 bytes 
Sat 18 Jan 2014 18:05:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:05:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:05:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:05:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:05:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:05:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:05:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:05:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:05:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:05:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:05:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:05:11 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:05:11 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:05:11 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:05:11 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:05:11 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:05:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:05:14 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:05:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:05:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:05:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:05:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:05:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:05:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:05:16 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:05:16 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 18:05:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:05:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553272
Sat 18 Jan 2014 18:05:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:05:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553272
Sat 18 Jan 2014 18:05:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:05:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:05:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:05:26 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:05:26 - job_xml_thread(): Done retrieving: data size 43553272
Sat 18 Jan 2014 18:05:26 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:05:26 - XML: Start document: iteration 8
Sat 18 Jan 2014 18:05:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:05:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:05:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:05:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:05:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:05:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:05:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:05:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:05:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:05:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:05:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:05:39 - XML: Processed 653448 elements - found 0 jobs
Sat 18 Jan 2014 18:05:39 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:05:39 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:05:39 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:05:39 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:05:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:05:40 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:05:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:05:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:05:40 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:05:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 18:05:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:05:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:05:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:05:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:05:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:05:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:05:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43033210
Sat 18 Jan 2014 18:05:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:05:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43033210
Sat 18 Jan 2014 18:05:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:05:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:05:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:05:54 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:05:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:05:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:05:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:05:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:05:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:05:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:05:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:05:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:05:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:05:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:05:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:05:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:05:58 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:05:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:05:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:05:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:05:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:05:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:05:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:06:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:06:02 - job_xml_thread(): Done retrieving: data size 42961711
Sat 18 Jan 2014 18:06:02 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:06:02 - XML: Start document: iteration 9
Sat 18 Jan 2014 18:06:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42961711
Sat 18 Jan 2014 18:06:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:06:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42961711
Sat 18 Jan 2014 18:06:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:06:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:06:05 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:06:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:06:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 18:06:06 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:06:06 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:06:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8929 values 140890 bits 17611 bytes 
Sat 18 Jan 2014 18:06:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 18:06:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:06:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:06:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:06:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:06:21 - XML: Processed 646014 elements - found 0 jobs
Sat 18 Jan 2014 18:06:21 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:06:21 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:06:21 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:06:21 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:06:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:06:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:06:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:06:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:06:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:06:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:06:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:06:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:06:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:06:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:06:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:06:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:06:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:06:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:06:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:06:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:06:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:06:27 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:06:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 18:06:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:06:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:06:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43028503
Sat 18 Jan 2014 18:06:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:06:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43028503
Sat 18 Jan 2014 18:06:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:06:36 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:06:36 - job_xml_thread(): Done retrieving: data size 43028503
Sat 18 Jan 2014 18:06:36 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:06:36 - XML: Start document: iteration 10
Sat 18 Jan 2014 18:06:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:06:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:06:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:06:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:06:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:06:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:06:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:06:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:06:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:06:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:06:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:06:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:06:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:06:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:06:50 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:06:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:06:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:06:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:06:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:06:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:06:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:06:51 - XML: Processed 646738 elements - found 0 jobs
Sat 18 Jan 2014 18:06:51 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:06:51 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:06:51 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:06:51 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:06:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:06:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582180
Sat 18 Jan 2014 18:06:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:06:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:06:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:06:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582180
Sat 18 Jan 2014 18:06:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:07:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:07:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:07:06 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:07:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:07:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:07:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:07:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:07:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:07:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:07:07 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:07:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:07:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:07:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:07:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:07:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:07:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 18:07:07 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:07:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 18:07:07 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:07:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99053 bits 12381 bytes 
Sat 18 Jan 2014 18:07:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:07:11 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:07:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:07:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:07:11 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 18:07:11 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 18:07:11 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:07:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:07:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:07:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:07:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:07:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:07:13 - job_xml_thread(): Done retrieving: data size 43614543
Sat 18 Jan 2014 18:07:13 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:07:13 - XML: Start document: iteration 11
Sat 18 Jan 2014 18:07:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43614543
Sat 18 Jan 2014 18:07:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:07:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43614543
Sat 18 Jan 2014 18:07:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:07:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:07:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:07:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:07:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:07:28 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:07:28 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:07:28 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:07:28 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:07:28 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:07:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:07:32 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:07:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:07:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:07:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:07:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:07:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:07:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:07:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:07:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:07:35 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:07:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:07:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:07:36 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:07:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 18:07:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:07:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:07:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:07:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:07:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:07:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:07:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43647380
Sat 18 Jan 2014 18:07:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:07:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43647380
Sat 18 Jan 2014 18:07:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:07:43 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:07:43 - job_xml_thread(): Done retrieving: data size 43647380
Sat 18 Jan 2014 18:07:43 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:07:43 - XML: Start document: iteration 12
Sat 18 Jan 2014 18:07:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:07:47 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:07:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:07:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:07:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:07:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:07:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:07:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:07:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:07:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:07:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:07:54 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:07:54 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:07:54 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:07:54 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:07:54 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:07:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:07:58 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:07:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:07:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:07:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:07:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:07:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:07:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:08:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:08:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43607933
Sat 18 Jan 2014 18:08:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:08:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43607933
Sat 18 Jan 2014 18:08:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:08:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:08:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:08:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:08:08 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:08:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:08:09 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:08:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 18:08:09 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:08:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 18:08:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8829 values 139291 bits 17411 bytes 
Sat 18 Jan 2014 18:08:09 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:08:09 - job_xml_thread(): Done retrieving: data size 43607933
Sat 18 Jan 2014 18:08:09 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:08:10 - XML: Start document: iteration 13
Sat 18 Jan 2014 18:08:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:08:13 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:08:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:08:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:08:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:08:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:08:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:08:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:08:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:08:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:08:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:08:19 - XML: Processed 654193 elements - found 0 jobs
Sat 18 Jan 2014 18:08:19 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:08:19 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:08:19 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:08:19 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:08:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:08:22 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:08:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:08:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:08:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:08:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:08:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:08:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:08:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:08:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43625088
Sat 18 Jan 2014 18:08:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:08:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43625088
Sat 18 Jan 2014 18:08:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:08:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:08:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:08:34 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:08:34 - job_xml_thread(): Done retrieving: data size 43625088
Sat 18 Jan 2014 18:08:34 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:08:34 - XML: Start document: iteration 14
Sat 18 Jan 2014 18:08:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:08:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:08:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:08:39 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:08:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:08:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:08:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:08:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:08:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:08:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:08:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:08:45 - XML: Processed 654192 elements - found 0 jobs
Sat 18 Jan 2014 18:08:45 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:08:45 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:08:45 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:08:45 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:08:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:08:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:08:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:08:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:08:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:08:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:08:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:08:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:08:48 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:08:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 18:08:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:08:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:08:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43630746
Sat 18 Jan 2014 18:08:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:08:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43630746
Sat 18 Jan 2014 18:08:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:08:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:08:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:09:00 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:09:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:09:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:09:00 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:09:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:09:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:09:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:09:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:09:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:09:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:09:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:09:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:09:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:09:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:09:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:09:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:09:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:09:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:09:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:09:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:09:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:09:06 - job_xml_thread(): Done retrieving: data size 43649698
Sat 18 Jan 2014 18:09:06 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:09:06 - XML: Start document: iteration 15
Sat 18 Jan 2014 18:09:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43649698
Sat 18 Jan 2014 18:09:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:09:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43649698
Sat 18 Jan 2014 18:09:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:09:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:09:09 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:09:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:09:11 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:09:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 18:09:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 18:09:11 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:09:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8591 values 135411 bits 16926 bytes 
Sat 18 Jan 2014 18:09:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:09:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:09:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:09:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:09:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:09:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:09:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:09:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:09:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:09:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:09:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:09:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:09:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:09:25 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:09:25 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:09:25 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:09:25 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:09:25 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:09:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:09:28 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:09:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:09:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:09:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:09:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:09:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:09:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:09:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:09:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43630982
Sat 18 Jan 2014 18:09:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:09:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43630982
Sat 18 Jan 2014 18:09:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:09:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:09:40 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:09:40 - job_xml_thread(): Done retrieving: data size 43630982
Sat 18 Jan 2014 18:09:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:09:40 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:09:40 - XML: Start document: iteration 16
Sat 18 Jan 2014 18:09:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:09:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:09:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:09:47 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:09:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:09:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:09:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:09:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:09:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:09:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:09:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:09:52 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:09:52 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:09:52 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:09:52 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:09:52 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:09:53 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:09:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 18:09:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:09:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:09:54 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:09:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:09:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:09:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:09:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:09:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:09:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:09:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:09:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43629399
Sat 18 Jan 2014 18:09:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:09:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43629399
Sat 18 Jan 2014 18:09:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:10:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:10:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:10:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:10:08 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:10:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:10:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:10:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:10:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:10:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:10:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:10:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:10:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:10:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:10:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:10:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:10:10 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:10:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:10:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:10:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:10:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:10:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:10:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:10:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:10:12 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:10:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:10:12 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:10:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 18:10:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 18:10:12 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:10:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6134 values 96725 bits 12090 bytes 
Sat 18 Jan 2014 18:10:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:10:12 - job_xml_thread(): Done retrieving: data size 43622199
Sat 18 Jan 2014 18:10:12 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:10:12 - XML: Start document: iteration 17
Sat 18 Jan 2014 18:10:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43622199
Sat 18 Jan 2014 18:10:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43622199
Sat 18 Jan 2014 18:10:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:10:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:10:22 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:10:22 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:10:22 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:10:22 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:10:23 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:10:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:10:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:10:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:10:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:10:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:10:29 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:10:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:10:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:10:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:10:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:10:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:10:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:10:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:10:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:10:34 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:10:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:10:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:10:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:10:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:10:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:10:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:10:36 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:10:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 18:10:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:10:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:10:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43648217
Sat 18 Jan 2014 18:10:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:10:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43648217
Sat 18 Jan 2014 18:10:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:10:38 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:10:38 - job_xml_thread(): Done retrieving: data size 43648217
Sat 18 Jan 2014 18:10:38 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:10:38 - XML: Start document: iteration 18
Sat 18 Jan 2014 18:10:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:10:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:10:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:10:48 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:10:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:10:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:10:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:10:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:10:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:10:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:10:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:10:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:10:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:10:56 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:10:56 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:10:56 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:10:56 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:10:57 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:11:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:11:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:11:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:11:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:11:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:11:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:11:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:11:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:11:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:11:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43612744
Sat 18 Jan 2014 18:11:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:11:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43612744
Sat 18 Jan 2014 18:11:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:11:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:11:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:11:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:11:12 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:11:12 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:11:12 - job_xml_thread(): Done retrieving: data size 43612744
Sat 18 Jan 2014 18:11:12 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:11:12 - XML: Start document: iteration 19
Sat 18 Jan 2014 18:11:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:11:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 18:11:13 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:11:13 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:11:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7115 values 112183 bits 14022 bytes 
Sat 18 Jan 2014 18:11:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 18:11:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:11:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:11:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:11:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:11:16 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 18:11:16 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:11:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:11:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:11:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:11:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:11:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:11:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:11:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:11:17 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:11:17 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 18:11:17 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 18:11:17 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:11:17 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 18:11:21 - size of cluster 'LISA Cluster': 624 hosts 79480 metrics 850693 values 13409681 bits 1676210 bytes 
Sat 18 Jan 2014 18:11:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:11:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:11:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:11:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:11:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:11:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:11:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:11:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:11:28 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:11:28 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:11:28 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:11:28 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:11:28 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:11:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:11:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43535287
Sat 18 Jan 2014 18:11:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:11:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:11:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:11:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43535287
Sat 18 Jan 2014 18:11:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:11:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:11:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:11:43 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:11:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:11:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:11:43 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:11:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:11:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:11:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:11:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:11:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:11:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:11:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:11:48 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:11:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:11:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:11:48 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:11:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 18:11:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:11:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:11:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:11:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:11:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:11:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:11:51 - job_xml_thread(): Done retrieving: data size 43011745
Sat 18 Jan 2014 18:11:51 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:11:51 - XML: Start document: iteration 20
Sat 18 Jan 2014 18:11:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43011745
Sat 18 Jan 2014 18:11:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:11:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43011745
Sat 18 Jan 2014 18:11:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:11:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:11:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:12:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:12:02 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:12:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:12:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:12:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:12:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:12:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:12:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:12:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:12:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:12:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:12:12 - XML: Processed 646454 elements - found 0 jobs
Sat 18 Jan 2014 18:12:12 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:12:12 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:12:12 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:12:12 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:12:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:12:13 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:12:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:12:13 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:12:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:12:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:12:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:12:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:12:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:12:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:12:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 18:12:14 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:12:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 18:12:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:12:14 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:12:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5817 values 91733 bits 11466 bytes 
Sat 18 Jan 2014 18:12:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:12:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43000300
Sat 18 Jan 2014 18:12:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:12:17 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:12:17 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 18:12:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43000300
Sat 18 Jan 2014 18:12:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:12:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:12:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:12:27 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:12:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:12:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:12:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:12:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:12:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:12:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:12:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:12:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:12:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:12:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:12:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:12:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:12:31 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:12:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:12:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:12:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:12:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:12:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:12:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:12:33 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:12:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 18:12:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:12:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:12:34 - job_xml_thread(): Done retrieving: data size 43147165
Sat 18 Jan 2014 18:12:34 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:12:34 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 18:12:34 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 18:12:34 - Housekeeping: done.
Sat 18 Jan 2014 18:12:34 - XML: Start document: iteration 0
Sat 18 Jan 2014 18:12:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43147165
Sat 18 Jan 2014 18:12:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:12:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43147165
Sat 18 Jan 2014 18:12:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:12:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:12:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:12:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:12:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:12:48 - XML: Processed 648100 elements - found 0 jobs
Sat 18 Jan 2014 18:12:48 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:12:48 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:12:48 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:12:48 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:12:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:12:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:12:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:12:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:12:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:12:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:12:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:12:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:12:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:12:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:12:58 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:12:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:12:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:12:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:12:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:12:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:12:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:13:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:13:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43623092
Sat 18 Jan 2014 18:13:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:13:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43623092
Sat 18 Jan 2014 18:13:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:13:03 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:13:03 - job_xml_thread(): Done retrieving: data size 43623092
Sat 18 Jan 2014 18:13:03 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:13:03 - XML: Start document: iteration 1
Sat 18 Jan 2014 18:13:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:13:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:13:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:13:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:13:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:13:14 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:13:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:13:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:13:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 18:13:16 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:13:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:13:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:13:16 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:13:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:13:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 18:13:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8124 values 128156 bits 16019 bytes 
Sat 18 Jan 2014 18:13:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:13:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:13:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:13:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:13:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:13:20 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:13:20 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:13:20 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:13:20 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:13:20 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:13:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:13:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:13:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:13:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:13:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:13:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:13:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:13:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:13:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:13:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43607852
Sat 18 Jan 2014 18:13:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:13:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43607852
Sat 18 Jan 2014 18:13:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:13:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:13:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:13:35 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:13:35 - job_xml_thread(): Done retrieving: data size 43607852
Sat 18 Jan 2014 18:13:36 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:13:36 - XML: Start document: iteration 2
Sat 18 Jan 2014 18:13:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:13:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:13:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:13:46 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:13:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:13:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:13:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:13:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:13:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:13:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:13:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:13:51 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:13:51 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:13:51 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:13:51 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:13:51 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:13:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:13:52 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:13:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:13:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:13:53 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:13:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 18:13:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:13:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:13:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:13:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:13:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:13:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:13:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43639998
Sat 18 Jan 2014 18:13:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:13:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43639998
Sat 18 Jan 2014 18:13:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:14:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:14:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:14:06 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:14:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:14:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:14:07 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:14:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:14:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:14:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:14:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:14:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:14:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:14:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:14:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:14:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:14:11 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:14:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:14:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:14:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:14:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:14:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:14:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:14:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:14:15 - job_xml_thread(): Done retrieving: data size 43616224
Sat 18 Jan 2014 18:14:15 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:14:15 - XML: Start document: iteration 3
Sat 18 Jan 2014 18:14:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43616224
Sat 18 Jan 2014 18:14:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:14:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43616224
Sat 18 Jan 2014 18:14:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:14:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:14:17 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:14:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:14:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 18:14:18 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:14:18 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:14:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 18:14:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8728 values 137630 bits 17203 bytes 
Sat 18 Jan 2014 18:14:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:14:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:14:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:14:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:14:35 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:14:35 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:14:35 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:14:35 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:14:35 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:14:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:14:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:14:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:14:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:14:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:14:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:14:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:14:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:14:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:14:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:14:39 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:14:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:14:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:14:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:14:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:14:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:14:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:14:42 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 18:14:42 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 18:14:42 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:14:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:14:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43625750
Sat 18 Jan 2014 18:14:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:14:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43625750
Sat 18 Jan 2014 18:14:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:14:51 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:14:51 - job_xml_thread(): Done retrieving: data size 43625750
Sat 18 Jan 2014 18:14:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:14:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:14:51 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:14:51 - XML: Start document: iteration 4
Sat 18 Jan 2014 18:14:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:14:52 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:14:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:14:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:14:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:14:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:14:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:14:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:14:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:14:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:14:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:15:04 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:15:04 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:15:04 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:15:04 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:15:04 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:15:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:15:05 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:15:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:15:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:15:05 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:15:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 18:15:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:15:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:15:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:15:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:15:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:15:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:15:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43624276
Sat 18 Jan 2014 18:15:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:15:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43624276
Sat 18 Jan 2014 18:15:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:15:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:15:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:15:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:15:18 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:15:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:15:18 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:15:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:15:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:15:19 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:15:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:15:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:15:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:15:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:15:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:15:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:15:20 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:15:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 18:15:20 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:15:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 18:15:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5793 values 91353 bits 11419 bytes 
Sat 18 Jan 2014 18:15:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:15:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:15:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:15:22 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:15:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:15:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:15:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:15:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:15:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:15:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:15:24 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:15:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 18:15:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:15:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:15:25 - job_xml_thread(): Done retrieving: data size 43637491
Sat 18 Jan 2014 18:15:25 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:15:25 - XML: Start document: iteration 5
Sat 18 Jan 2014 18:15:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43637491
Sat 18 Jan 2014 18:15:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43637491
Sat 18 Jan 2014 18:15:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:15:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:15:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:15:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:15:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:15:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:15:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:15:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:15:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:15:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:15:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:15:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:15:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:15:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:15:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:15:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:15:46 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:15:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:15:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:15:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:15:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:15:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:15:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:15:47 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:15:47 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:15:47 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:15:47 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:15:47 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:15:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:15:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43628259
Sat 18 Jan 2014 18:15:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:15:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43628259
Sat 18 Jan 2014 18:15:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:15:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:15:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:16:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:16:00 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:16:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:16:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:16:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:16:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:16:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:16:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:16:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:16:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:16:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:16:02 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:16:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:16:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:16:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:16:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:16:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:16:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:16:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:16:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:16:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:16:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43660614
Sat 18 Jan 2014 18:16:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:16:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43660614
Sat 18 Jan 2014 18:16:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:16:06 - job_xml_thread(): Done retrieving: data size 43660614
Sat 18 Jan 2014 18:16:06 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:16:06 - XML: Start document: iteration 6
Sat 18 Jan 2014 18:16:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:16:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:16:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:16:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:16:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:16:20 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:16:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:16:20 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:16:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 18:16:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 18:16:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:16:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:16:21 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:16:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:16:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148728 bits 18591 bytes 
Sat 18 Jan 2014 18:16:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:16:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:16:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:16:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:16:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:16:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:16:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:16:23 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:16:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:16:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:16:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:16:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:16:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:16:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:16:25 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:16:25 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:16:25 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:16:25 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:16:25 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:16:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:16:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43633942
Sat 18 Jan 2014 18:16:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:16:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43633942
Sat 18 Jan 2014 18:16:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:16:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:16:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:16:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:16:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:16:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:16:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:16:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:16:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:16:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:16:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:16:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:16:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:16:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:16:40 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:16:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:16:42 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:16:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:16:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:16:43 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:16:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 18:16:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:16:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:16:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:16:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:16:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:16:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:16:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43637330
Sat 18 Jan 2014 18:16:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:16:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43637330
Sat 18 Jan 2014 18:16:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:16:45 - job_xml_thread(): Done retrieving: data size 43637330
Sat 18 Jan 2014 18:16:45 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:16:45 - XML: Start document: iteration 7
Sat 18 Jan 2014 18:16:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:16:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:16:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:16:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:17:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:17:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:17:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:17:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:17:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:17:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:17:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:17:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:17:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:17:06 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:17:06 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:17:06 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:17:06 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:17:06 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:17:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:17:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:17:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:17:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:17:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:17:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:17:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:17:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:17:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:17:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570729
Sat 18 Jan 2014 18:17:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:17:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570729
Sat 18 Jan 2014 18:17:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:17:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:17:19 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:17:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:17:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:17:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:17:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:17:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:17:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:17:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:17:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:17:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:17:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:17:21 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:17:21 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:17:22 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:17:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:17:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 18:17:23 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:17:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8953 values 141574 bits 17696 bytes 
Sat 18 Jan 2014 18:17:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 18:17:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:17:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:17:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:17:23 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:17:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:17:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:17:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:17:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:17:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:17:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:17:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:17:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567479
Sat 18 Jan 2014 18:17:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:17:26 - job_xml_thread(): Done retrieving: data size 43567479
Sat 18 Jan 2014 18:17:26 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:17:26 - XML: Start document: iteration 8
Sat 18 Jan 2014 18:17:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567479
Sat 18 Jan 2014 18:17:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:17:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:17:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:17:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:17:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:17:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:17:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:17:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:17:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:17:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:17:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:17:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:17:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:17:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:17:43 - XML: Processed 653448 elements - found 0 jobs
Sat 18 Jan 2014 18:17:43 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:17:43 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:17:43 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:17:43 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:17:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:17:48 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:17:48 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:17:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 18:17:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:17:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:17:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:17:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:17:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:17:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:17:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:17:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:17:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43045426
Sat 18 Jan 2014 18:17:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:17:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43045426
Sat 18 Jan 2014 18:17:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:17:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:17:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:17:58 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:17:58 - job_xml_thread(): Done retrieving: data size 43045426
Sat 18 Jan 2014 18:17:58 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:17:58 - XML: Start document: iteration 9
Sat 18 Jan 2014 18:17:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:17:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:17:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:17:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:17:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:17:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:17:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:17:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43045426
Sat 18 Jan 2014 18:17:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:17:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:18:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:18:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:18:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:18:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:18:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:18:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:18:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:18:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:18:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:18:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:18:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:18:17 - XML: Processed 646832 elements - found 0 jobs
Sat 18 Jan 2014 18:18:17 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:18:17 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:18:17 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:18:17 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:18:17 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 18:18:17 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:18:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:18:18 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:18:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:18:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:18:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:18:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:18:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:18:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:18:19 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:18:19 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:18:19 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 18:18:19 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 18:18:19 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 18:18:20 - size of cluster 'LISA Cluster': 624 hosts 79475 metrics 870488 values 13744424 bits 1718053 bytes 
Sat 18 Jan 2014 18:18:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:18:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43051751
Sat 18 Jan 2014 18:18:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:18:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43051751
Sat 18 Jan 2014 18:18:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:18:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:18:23 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:18:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:18:24 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:18:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 18:18:24 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:18:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 18:18:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8898 values 140683 bits 17585 bytes 
Sat 18 Jan 2014 18:18:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:18:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:18:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:18:30 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:18:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:18:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:18:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:18:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:18:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:18:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:18:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43051751
Sat 18 Jan 2014 18:18:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:18:32 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:18:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:18:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:18:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:18:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:18:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:18:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:18:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:18:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:18:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:18:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:18:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:18:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:18:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:18:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:18:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:18:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:18:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:18:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:18:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:18:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:18:48 - job_xml_thread(): Done retrieving: data size 43530371
Sat 18 Jan 2014 18:18:48 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:18:48 - XML: Start document: iteration 10
Sat 18 Jan 2014 18:18:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43530371
Sat 18 Jan 2014 18:18:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:18:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43530371
Sat 18 Jan 2014 18:18:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:19:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:19:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:19:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:19:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:19:06 - XML: Processed 653202 elements - found 0 jobs
Sat 18 Jan 2014 18:19:06 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:19:06 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:19:06 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:19:06 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:19:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:19:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:19:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:19:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:19:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:19:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:19:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:19:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:19:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:19:08 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:19:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 18:19:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:19:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:19:12 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:19:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:19:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:19:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:19:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:19:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:19:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:19:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:19:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43624132
Sat 18 Jan 2014 18:19:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:19:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43624132
Sat 18 Jan 2014 18:19:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:19:19 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:19:19 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 18:19:21 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:19:21 - job_xml_thread(): Done retrieving: data size 43624132
Sat 18 Jan 2014 18:19:21 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:19:21 - XML: Start document: iteration 11
Sat 18 Jan 2014 18:19:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:19:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:19:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:19:24 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:19:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:19:25 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:19:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 18:19:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 18:19:26 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:19:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:19:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:19:30 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:19:30 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:19:30 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:19:30 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:19:30 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:19:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6232 values 98307 bits 12288 bytes 
Sat 18 Jan 2014 18:19:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:19:33 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:19:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:19:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:19:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:19:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:19:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:19:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:19:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:19:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:19:37 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:19:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:19:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:19:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:19:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:19:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:19:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:19:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:19:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43619450
Sat 18 Jan 2014 18:19:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:19:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43619450
Sat 18 Jan 2014 18:19:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:19:45 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:19:45 - job_xml_thread(): Done retrieving: data size 43619450
Sat 18 Jan 2014 18:19:45 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:19:45 - XML: Start document: iteration 12
Sat 18 Jan 2014 18:19:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:19:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:19:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:19:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:19:58 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:19:58 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:19:58 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:19:59 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:19:59 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:20:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:20:03 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:20:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:20:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:20:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:20:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:20:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:20:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:20:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:20:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:20:04 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:20:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:20:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:20:05 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:20:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 18:20:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:20:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:20:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:20:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:20:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:20:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:20:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43632795
Sat 18 Jan 2014 18:20:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:20:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43632795
Sat 18 Jan 2014 18:20:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:20:15 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:20:15 - job_xml_thread(): Done retrieving: data size 43632795
Sat 18 Jan 2014 18:20:15 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:20:15 - XML: Start document: iteration 13
Sat 18 Jan 2014 18:20:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:20:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:20:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:20:19 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:20:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:20:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:20:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:20:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:20:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:20:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:20:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:20:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:20:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:20:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:20:26 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:20:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:20:27 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:20:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 18:20:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 18:20:27 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:20:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5734 values 90404 bits 11300 bytes 
Sat 18 Jan 2014 18:20:28 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:20:28 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:20:28 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:20:28 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:20:28 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:20:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:20:31 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:20:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:20:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:20:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:20:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:20:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:20:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:20:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:20:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43619900
Sat 18 Jan 2014 18:20:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:20:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43619900
Sat 18 Jan 2014 18:20:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:20:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:20:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:20:43 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:20:43 - job_xml_thread(): Done retrieving: data size 43619900
Sat 18 Jan 2014 18:20:43 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:20:43 - XML: Start document: iteration 14
Sat 18 Jan 2014 18:20:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:20:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:20:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:20:48 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:20:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:20:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:20:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:20:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:20:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:20:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:20:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:20:56 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:20:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 18:20:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:21:00 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:21:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:21:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:21:00 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:21:00 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:21:00 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:21:00 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:21:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:21:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:21:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:21:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:21:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:21:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:21:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:21:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43616600
Sat 18 Jan 2014 18:21:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:21:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43616600
Sat 18 Jan 2014 18:21:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:21:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:21:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:21:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:21:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:21:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:21:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:21:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:21:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:21:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:21:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:21:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:21:15 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:21:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:21:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:21:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:21:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:21:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:21:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:21:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:21:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:21:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:21:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:21:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:21:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43645351
Sat 18 Jan 2014 18:21:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:21:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43645351
Sat 18 Jan 2014 18:21:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:21:21 - job_xml_thread(): Done retrieving: data size 43645351
Sat 18 Jan 2014 18:21:21 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:21:21 - XML: Start document: iteration 15
Sat 18 Jan 2014 18:21:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:21:27 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:21:28 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:21:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 18:21:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:21:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 18:21:28 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:21:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:21:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:21:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8862 values 139778 bits 17472 bytes 
Sat 18 Jan 2014 18:21:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:21:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:21:34 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:21:34 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:21:34 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:21:34 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:21:34 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:21:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:21:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:21:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:21:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:21:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:21:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:21:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:21:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:21:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:21:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:21:43 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:21:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:21:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:21:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:21:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:21:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:21:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:21:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:21:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43633021
Sat 18 Jan 2014 18:21:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:21:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43633021
Sat 18 Jan 2014 18:21:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:21:49 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:21:49 - job_xml_thread(): Done retrieving: data size 43633021
Sat 18 Jan 2014 18:21:49 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:21:49 - XML: Start document: iteration 16
Sat 18 Jan 2014 18:21:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:21:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:21:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:21:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:21:59 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:21:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 18:21:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:22:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:22:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:22:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:22:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:22:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:22:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:22:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:22:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:22:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:22:07 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:22:07 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:22:07 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:22:07 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:22:07 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:22:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:22:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:22:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:22:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:22:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:22:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:22:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:22:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:22:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:22:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43635617
Sat 18 Jan 2014 18:22:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:22:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43635617
Sat 18 Jan 2014 18:22:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:22:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:22:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:22:22 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:22:22 - job_xml_thread(): Done retrieving: data size 43635617
Sat 18 Jan 2014 18:22:22 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:22:22 - XML: Start document: iteration 17
Sat 18 Jan 2014 18:22:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:22:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:22:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:22:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:22:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:22:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:22:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:22:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:22:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:22:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:22:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:22:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:22:28 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:22:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:22:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 18:22:29 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:22:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6060 values 95593 bits 11949 bytes 
Sat 18 Jan 2014 18:22:29 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:22:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 18:22:36 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:22:36 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:22:36 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:22:36 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:22:36 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:22:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:22:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:22:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:22:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:22:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:22:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:22:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:22:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:22:39 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 18:22:39 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 18:22:39 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:22:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:22:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:22:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:22:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43602510
Sat 18 Jan 2014 18:22:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:22:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43602510
Sat 18 Jan 2014 18:22:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:22:51 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:22:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:22:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:22:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:22:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:22:52 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:22:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:22:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:22:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:22:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:22:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:22:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:22:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:22:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:22:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:22:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:22:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:22:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:22:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:22:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:22:55 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:22:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 18:22:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:22:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:22:57 - job_xml_thread(): Done retrieving: data size 43648177
Sat 18 Jan 2014 18:22:57 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:22:57 - XML: Start document: iteration 18
Sat 18 Jan 2014 18:22:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43648177
Sat 18 Jan 2014 18:22:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:22:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43648177
Sat 18 Jan 2014 18:22:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:23:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:23:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:23:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:23:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:23:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:23:10 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:23:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:23:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:23:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:23:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:23:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:23:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:23:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:23:16 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:23:16 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:23:17 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:23:17 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:23:17 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:23:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:23:19 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:23:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:23:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:23:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:23:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:23:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:23:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:23:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:23:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43546790
Sat 18 Jan 2014 18:23:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:23:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43546790
Sat 18 Jan 2014 18:23:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:23:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:23:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:23:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:23:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:23:30 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:23:30 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:23:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:23:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:23:30 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:23:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 18:23:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:23:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 18:23:30 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:23:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9036 values 142543 bits 17817 bytes 
Sat 18 Jan 2014 18:23:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:23:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:23:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:23:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:23:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:23:32 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:23:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:23:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:23:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:23:35 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:23:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:23:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:23:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:23:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:23:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:23:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:23:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:23:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43061574
Sat 18 Jan 2014 18:23:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:23:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43061574
Sat 18 Jan 2014 18:23:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:23:38 - job_xml_thread(): Done retrieving: data size 43061574
Sat 18 Jan 2014 18:23:39 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:23:39 - XML: Start document: iteration 19
Sat 18 Jan 2014 18:23:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:23:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:23:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:23:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:23:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:23:52 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:23:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:23:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:23:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:23:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:23:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:23:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:23:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:23:59 - XML: Processed 647266 elements - found 0 jobs
Sat 18 Jan 2014 18:23:59 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:23:59 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:23:59 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:23:59 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:24:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:24:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:24:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:24:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:24:00 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:24:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 18:24:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:24:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:24:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:24:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:24:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:24:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:24:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42968191
Sat 18 Jan 2014 18:24:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:24:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42968191
Sat 18 Jan 2014 18:24:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:24:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:24:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:24:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:24:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:24:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:24:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:24:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:24:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:24:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:24:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:24:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:24:14 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:24:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:24:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:24:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:24:16 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:24:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:24:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:24:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:24:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:24:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:24:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:24:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:24:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43046191
Sat 18 Jan 2014 18:24:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:24:18 - job_xml_thread(): Done retrieving: data size 43046191
Sat 18 Jan 2014 18:24:18 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:24:18 - XML: Start document: iteration 20
Sat 18 Jan 2014 18:24:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43046191
Sat 18 Jan 2014 18:24:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:24:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:24:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:24:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:24:30 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:24:31 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:24:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:24:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 18:24:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 18:24:31 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:24:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8977 values 141530 bits 17691 bytes 
Sat 18 Jan 2014 18:24:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:24:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:24:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:24:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:24:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:24:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:24:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:24:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:24:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:24:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:24:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:24:35 - XML: Processed 646682 elements - found 0 jobs
Sat 18 Jan 2014 18:24:35 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:24:35 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:24:35 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:24:35 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:24:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:24:39 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:24:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:24:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:24:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:24:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:24:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:24:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:24:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:24:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43527490
Sat 18 Jan 2014 18:24:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:24:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43527490
Sat 18 Jan 2014 18:24:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:24:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:24:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:24:50 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:24:50 - job_xml_thread(): Done retrieving: data size 43527490
Sat 18 Jan 2014 18:24:50 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:24:50 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 18:24:50 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 18:24:50 - Housekeeping: done.
Sat 18 Jan 2014 18:24:50 - XML: Start document: iteration 0
Sat 18 Jan 2014 18:24:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:24:51 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:24:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:24:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:24:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:24:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:24:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:24:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:24:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:24:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:24:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:25:03 - XML: Processed 652976 elements - found 0 jobs
Sat 18 Jan 2014 18:25:03 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:25:03 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:25:03 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:25:03 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:25:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:25:04 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:25:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:25:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:25:04 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:25:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 18:25:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:25:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:25:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:25:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:25:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:25:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:25:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43612960
Sat 18 Jan 2014 18:25:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:25:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43612960
Sat 18 Jan 2014 18:25:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:25:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:25:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:25:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:25:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:25:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:25:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:25:18 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:25:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:25:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:25:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:25:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:25:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:25:19 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 18:25:19 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:25:19 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:25:19 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:25:19 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 18:25:19 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 18:25:19 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 18:25:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:25:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:25:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:25:21 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:25:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:25:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:25:22 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 820704 values 12939330 bits 1617416 bytes 
Sat 18 Jan 2014 18:25:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:25:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:25:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:25:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:25:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:25:24 - job_xml_thread(): Done retrieving: data size 43616963
Sat 18 Jan 2014 18:25:24 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:25:24 - XML: Start document: iteration 1
Sat 18 Jan 2014 18:25:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43616963
Sat 18 Jan 2014 18:25:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:25:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43616963
Sat 18 Jan 2014 18:25:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:25:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:25:31 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:25:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:25:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 18:25:32 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:25:32 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:25:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 18:25:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8909 values 140462 bits 17557 bytes 
Sat 18 Jan 2014 18:25:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:25:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:25:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:25:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:25:44 - XML: Processed 654193 elements - found 0 jobs
Sat 18 Jan 2014 18:25:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:25:44 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:25:44 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:25:44 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:25:44 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:25:44 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:25:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:25:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:25:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:25:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:25:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:25:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:25:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:25:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:25:49 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:25:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:25:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:25:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:25:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:25:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:25:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:25:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:25:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43641591
Sat 18 Jan 2014 18:25:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:25:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43641591
Sat 18 Jan 2014 18:25:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:25:59 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:26:00 - job_xml_thread(): Done retrieving: data size 43641591
Sat 18 Jan 2014 18:26:00 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:26:00 - XML: Start document: iteration 2
Sat 18 Jan 2014 18:26:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:26:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:26:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:26:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:26:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:26:10 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:26:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:26:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:26:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:26:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:26:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:26:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:26:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:26:14 - XML: Processed 654190 elements - found 0 jobs
Sat 18 Jan 2014 18:26:14 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:26:14 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:26:14 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:26:14 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:26:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:26:16 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:26:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:26:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:26:16 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:26:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 18:26:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:26:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:26:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:26:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:26:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:26:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:26:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43628360
Sat 18 Jan 2014 18:26:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:26:19 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:26:19 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 18:26:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43628360
Sat 18 Jan 2014 18:26:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:26:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:26:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:26:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:26:29 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:26:29 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:26:29 - job_xml_thread(): Done retrieving: data size 43628360
Sat 18 Jan 2014 18:26:29 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:26:29 - XML: Start document: iteration 3
Sat 18 Jan 2014 18:26:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:26:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:26:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:26:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:26:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:26:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:26:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:26:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:26:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:26:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:26:32 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:26:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:26:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 18:26:33 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:26:33 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:26:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 18:26:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5750 values 90646 bits 11330 bytes 
Sat 18 Jan 2014 18:26:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:26:41 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:26:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:26:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:26:42 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:26:42 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:26:42 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:26:42 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:26:42 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:26:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:26:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:26:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:26:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:26:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:26:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43604159
Sat 18 Jan 2014 18:26:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:26:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43604159
Sat 18 Jan 2014 18:26:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:26:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:26:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:26:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:26:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:26:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:26:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:26:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:26:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:26:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:26:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:26:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:26:57 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:26:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:26:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:26:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:26:59 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:26:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:26:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:27:00 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:27:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 18:27:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:27:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:27:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:27:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:27:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:27:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:27:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43639557
Sat 18 Jan 2014 18:27:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:27:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43639557
Sat 18 Jan 2014 18:27:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:27:04 - job_xml_thread(): Done retrieving: data size 43639557
Sat 18 Jan 2014 18:27:04 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:27:04 - XML: Start document: iteration 4
Sat 18 Jan 2014 18:27:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:27:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:27:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:27:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:27:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:27:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:27:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:27:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:27:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:27:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:27:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:27:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:27:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:27:25 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:27:25 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:27:25 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:27:25 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:27:25 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:27:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:27:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:27:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:27:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:27:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:27:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:27:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:27:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:27:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:27:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43631485
Sat 18 Jan 2014 18:27:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:27:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43631485
Sat 18 Jan 2014 18:27:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:27:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:27:33 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:27:35 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:27:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:27:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 18:27:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 18:27:35 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:27:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8682 values 136903 bits 17112 bytes 
Sat 18 Jan 2014 18:27:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:27:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:27:40 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:27:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:27:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:27:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:27:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:27:42 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:27:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:27:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:27:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:27:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:27:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:27:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:27:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:27:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:27:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:27:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:27:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:27:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:27:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:27:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:27:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:27:49 - job_xml_thread(): Done retrieving: data size 43632303
Sat 18 Jan 2014 18:27:49 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:27:49 - XML: Start document: iteration 5
Sat 18 Jan 2014 18:27:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43632303
Sat 18 Jan 2014 18:27:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:27:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43632303
Sat 18 Jan 2014 18:27:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:27:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:27:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:28:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:28:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:28:07 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:28:08 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:28:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:28:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:28:08 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:28:08 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:28:08 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:28:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:28:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:28:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:28:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:28:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:28:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:28:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:28:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:28:12 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:28:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:28:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:28:13 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:28:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 18:28:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:28:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:28:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:28:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:28:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:28:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:28:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43632753
Sat 18 Jan 2014 18:28:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:28:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43632753
Sat 18 Jan 2014 18:28:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:28:23 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:28:23 - job_xml_thread(): Done retrieving: data size 43632753
Sat 18 Jan 2014 18:28:23 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:28:24 - XML: Start document: iteration 6
Sat 18 Jan 2014 18:28:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:28:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:28:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:28:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:28:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:28:32 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:28:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:28:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:28:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:28:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:28:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:28:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:28:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:28:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:28:35 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:28:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:28:35 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:28:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 18:28:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 18:28:35 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:28:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5748 values 90602 bits 11325 bytes 
Sat 18 Jan 2014 18:28:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:28:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:28:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:28:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:28:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:28:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:28:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:28:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:28:38 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:28:38 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:28:38 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:28:38 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:28:38 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:28:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:28:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43618098
Sat 18 Jan 2014 18:28:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:28:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43618098
Sat 18 Jan 2014 18:28:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:28:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:28:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:28:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:28:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:28:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:28:52 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:28:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:28:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:28:53 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:28:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:28:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:28:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:28:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:28:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:28:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:28:58 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:28:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:28:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:28:58 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:28:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 18:28:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:28:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:28:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:28:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:28:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:29:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:29:00 - job_xml_thread(): Done retrieving: data size 43638782
Sat 18 Jan 2014 18:29:00 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:29:00 - XML: Start document: iteration 7
Sat 18 Jan 2014 18:29:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43638782
Sat 18 Jan 2014 18:29:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43638782
Sat 18 Jan 2014 18:29:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:29:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:29:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:29:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:29:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:29:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:29:18 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:29:18 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:29:18 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:29:18 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:29:18 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:29:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:29:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:29:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:29:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:29:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:29:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:29:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:29:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:29:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:29:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:29:23 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:29:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:29:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:29:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:29:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:29:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:29:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:29:26 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 18:29:26 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 18:29:26 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:29:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:29:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569792
Sat 18 Jan 2014 18:29:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:29:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569792
Sat 18 Jan 2014 18:29:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:29:33 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:29:33 - job_xml_thread(): Done retrieving: data size 43569792
Sat 18 Jan 2014 18:29:33 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:29:34 - XML: Start document: iteration 8
Sat 18 Jan 2014 18:29:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:29:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:29:36 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:29:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:29:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:29:36 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:29:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 18:29:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 18:29:36 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:29:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8649 values 136325 bits 17040 bytes 
Sat 18 Jan 2014 18:29:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:29:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:29:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:29:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:29:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:29:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:29:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:29:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:29:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:29:46 - XML: Processed 653444 elements - found 0 jobs
Sat 18 Jan 2014 18:29:46 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:29:46 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:29:46 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:29:46 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:29:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:29:49 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:29:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:29:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:29:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:29:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:29:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:29:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:29:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:29:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43037780
Sat 18 Jan 2014 18:29:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:29:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43037780
Sat 18 Jan 2014 18:29:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:29:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:29:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:30:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:30:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:30:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:30:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:30:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:30:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:30:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:30:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:30:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:30:01 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:30:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:30:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:30:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:30:05 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:30:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:30:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:30:05 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:30:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 18:30:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:30:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:30:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:30:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:30:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:30:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:30:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42995716
Sat 18 Jan 2014 18:30:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:30:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42995716
Sat 18 Jan 2014 18:30:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:30:08 - job_xml_thread(): Done retrieving: data size 42995716
Sat 18 Jan 2014 18:30:08 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:30:08 - XML: Start document: iteration 9
Sat 18 Jan 2014 18:30:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:30:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:30:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:30:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:30:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:30:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:30:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:30:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:30:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:30:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:30:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:30:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:30:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:30:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:30:29 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:30:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:30:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:30:29 - XML: Processed 646278 elements - found 0 jobs
Sat 18 Jan 2014 18:30:29 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:30:29 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:30:29 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:30:29 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:30:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:30:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:30:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:30:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:30:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:30:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43030289
Sat 18 Jan 2014 18:30:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:30:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43030289
Sat 18 Jan 2014 18:30:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:30:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:30:36 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:30:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:30:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:30:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:30:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:30:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:30:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:30:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:30:38 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:30:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 18:30:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 18:30:38 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:30:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8933 values 140845 bits 17605 bytes 
Sat 18 Jan 2014 18:30:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:30:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:30:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:30:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43030289
Sat 18 Jan 2014 18:30:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:30:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:30:44 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:30:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:30:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:30:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:30:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:30:49 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:30:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:30:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:30:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:30:50 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:30:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:30:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:30:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:30:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:30:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:30:52 - job_xml_thread(): Done retrieving: data size 43600521
Sat 18 Jan 2014 18:30:52 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:30:52 - XML: Start document: iteration 10
Sat 18 Jan 2014 18:30:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43600521
Sat 18 Jan 2014 18:30:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:30:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:30:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:30:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:30:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:30:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:30:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43600521
Sat 18 Jan 2014 18:30:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:30:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:31:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:31:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:31:09 - XML: Processed 653996 elements - found 0 jobs
Sat 18 Jan 2014 18:31:09 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:31:09 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:31:09 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:31:09 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:31:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:31:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:31:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:31:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:31:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:31:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:31:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:31:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:31:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:31:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:31:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:31:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:31:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:31:15 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:31:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 18:31:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:31:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:31:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:31:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:31:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:31:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:31:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:31:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:31:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43646112
Sat 18 Jan 2014 18:31:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:31:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43646112
Sat 18 Jan 2014 18:31:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:31:24 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:31:24 - job_xml_thread(): Done retrieving: data size 43646112
Sat 18 Jan 2014 18:31:24 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:31:24 - XML: Start document: iteration 11
Sat 18 Jan 2014 18:31:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:31:26 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:31:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:31:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:31:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:31:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:31:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:31:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:31:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:31:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:31:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:31:36 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:31:36 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:31:36 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:31:36 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:31:36 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:31:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:31:38 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:31:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:31:38 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:31:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:31:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:31:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:31:39 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:31:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 18:31:39 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:31:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 18:31:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6022 values 95094 bits 11886 bytes 
Sat 18 Jan 2014 18:31:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:31:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:31:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:31:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:31:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:31:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43601111
Sat 18 Jan 2014 18:31:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:31:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43601111
Sat 18 Jan 2014 18:31:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:31:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:31:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:31:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:31:52 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:31:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:31:52 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:31:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:31:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:31:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:31:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:31:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:31:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:31:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:31:54 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:31:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:31:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:31:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:31:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:31:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:31:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:31:55 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:31:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 18:31:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:31:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:31:56 - job_xml_thread(): Done retrieving: data size 43637965
Sat 18 Jan 2014 18:31:56 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:31:56 - XML: Start document: iteration 12
Sat 18 Jan 2014 18:31:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43637965
Sat 18 Jan 2014 18:31:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43637965
Sat 18 Jan 2014 18:31:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:31:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:32:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:32:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:32:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:32:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:32:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:32:13 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:32:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:32:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:32:14 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:32:14 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:32:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:32:14 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:32:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:32:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:32:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:32:14 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:32:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:32:14 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:32:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:32:18 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:32:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:32:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:32:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:32:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:32:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:32:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:32:19 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 18:32:19 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:32:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:32:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43652206
Sat 18 Jan 2014 18:32:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:32:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43652206
Sat 18 Jan 2014 18:32:20 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:32:20 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:32:20 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 18:32:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:32:21 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 18:32:21 - Entering storeMetrics(): cluster LISA Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sat 18 Jan 2014 18:32:29 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:32:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:32:29 - job_xml_thread(): Done retrieving: data size 43652206
Sat 18 Jan 2014 18:32:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:32:30 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:32:30 - XML: Start document: iteration 13
Sat 18 Jan 2014 18:32:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:32:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:32:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:32:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:32:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:32:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:32:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:32:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:32:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:32:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:32:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:32:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:32:39 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:32:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:32:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 18:32:40 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:32:40 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:32:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 18:32:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7753 values 122781 bits 15347 bytes 
Sat 18 Jan 2014 18:32:44 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:32:44 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:32:44 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:32:44 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:32:44 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:32:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:32:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:32:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:32:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:32:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:32:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:32:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:32:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:32:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:32:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43632096
Sat 18 Jan 2014 18:32:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:32:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43632096
Sat 18 Jan 2014 18:32:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:32:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:32:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:32:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:32:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:32:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:32:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:32:59 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:32:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:32:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:32:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:32:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:32:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:33:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:33:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:33:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:33:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:33:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:33:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:33:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:33:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:33:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:33:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:33:01 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:33:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 18:33:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:33:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:33:02 - job_xml_thread(): Done retrieving: data size 43653762
Sat 18 Jan 2014 18:33:02 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:33:02 - XML: Start document: iteration 14
Sat 18 Jan 2014 18:33:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43653762
Sat 18 Jan 2014 18:33:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:33:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43653762
Sat 18 Jan 2014 18:33:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:33:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:33:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:33:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:33:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:33:19 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:33:20 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:33:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:33:20 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:33:20 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:33:20 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:33:20 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:33:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:33:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:33:21 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:33:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:33:21 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:33:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:33:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:33:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:33:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:33:22 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:33:22 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:33:22 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 18:33:22 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 18:33:22 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 18:33:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:33:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:33:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:33:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:33:24 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 931591 values 14706595 bits 1838324 bytes 
Sat 18 Jan 2014 18:33:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:33:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:33:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:33:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:33:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:33:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43629578
Sat 18 Jan 2014 18:33:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:33:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43629578
Sat 18 Jan 2014 18:33:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:33:35 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:33:35 - job_xml_thread(): Done retrieving: data size 43629578
Sat 18 Jan 2014 18:33:35 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:33:35 - XML: Start document: iteration 15
Sat 18 Jan 2014 18:33:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:33:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:33:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:33:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:33:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:33:40 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:33:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:33:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:33:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:33:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 18:33:41 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:33:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 18:33:41 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:33:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:33:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:33:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8859 values 139925 bits 17490 bytes 
Sat 18 Jan 2014 18:33:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:33:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:33:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:33:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:33:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:33:47 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:33:47 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:33:47 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:33:47 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:33:47 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:33:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:33:50 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:33:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:33:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:33:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:33:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:33:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:33:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:33:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:33:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43620749
Sat 18 Jan 2014 18:33:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:33:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43620749
Sat 18 Jan 2014 18:33:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:33:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:33:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:34:02 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:34:02 - job_xml_thread(): Done retrieving: data size 43620749
Sat 18 Jan 2014 18:34:02 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:34:02 - XML: Start document: iteration 16
Sat 18 Jan 2014 18:34:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:34:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:34:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:34:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:34:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:34:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:34:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:34:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:34:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:34:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:34:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:34:11 - XML: Processed 654195 elements - found 0 jobs
Sat 18 Jan 2014 18:34:11 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:34:11 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:34:11 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:34:11 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:34:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:34:16 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:34:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:34:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:34:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:34:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:34:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:34:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:34:16 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:34:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 18:34:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:34:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:34:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43634523
Sat 18 Jan 2014 18:34:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:34:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43634523
Sat 18 Jan 2014 18:34:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:34:22 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:34:22 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 18:34:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:34:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:34:26 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:34:26 - job_xml_thread(): Done retrieving: data size 43634523
Sat 18 Jan 2014 18:34:26 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:34:26 - XML: Start document: iteration 17
Sat 18 Jan 2014 18:34:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:34:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:34:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:34:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:34:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:34:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:34:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:34:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:34:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:34:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:34:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:34:38 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:34:38 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:34:38 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:34:38 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:34:38 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:34:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:34:41 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:34:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:34:42 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:34:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:34:42 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:34:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 18:34:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 18:34:42 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:34:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5660 values 89276 bits 11159 bytes 
Sat 18 Jan 2014 18:34:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:34:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:34:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:34:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:34:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:34:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:34:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:34:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43624602
Sat 18 Jan 2014 18:34:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:34:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43624602
Sat 18 Jan 2014 18:34:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:34:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:34:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:34:54 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:34:54 - job_xml_thread(): Done retrieving: data size 43624602
Sat 18 Jan 2014 18:34:54 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:34:54 - XML: Start document: iteration 18
Sat 18 Jan 2014 18:34:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:34:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:34:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:34:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:34:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:34:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:34:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:34:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:34:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43624602
Sat 18 Jan 2014 18:34:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:34:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:34:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:35:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:35:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:35:13 - XML: Processed 654195 elements - found 0 jobs
Sat 18 Jan 2014 18:35:13 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:35:13 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:35:13 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:35:13 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:35:14 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:35:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 18:35:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:35:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:35:14 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:35:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:35:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:35:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:35:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:35:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:35:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:35:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:35:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:35:18 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:35:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:35:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:35:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:35:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:35:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:35:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:35:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:35:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578491
Sat 18 Jan 2014 18:35:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:35:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578491
Sat 18 Jan 2014 18:35:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:35:28 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:35:28 - job_xml_thread(): Done retrieving: data size 43578491
Sat 18 Jan 2014 18:35:28 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:35:28 - XML: Start document: iteration 19
Sat 18 Jan 2014 18:35:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:35:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:35:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:35:31 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:35:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:35:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:35:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:35:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:35:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:35:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:35:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:35:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:35:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:35:41 - XML: Processed 653448 elements - found 0 jobs
Sat 18 Jan 2014 18:35:41 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:35:41 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:35:41 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:35:41 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:35:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:35:42 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:35:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:35:43 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:35:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 18:35:43 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:35:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 18:35:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5805 values 91588 bits 11448 bytes 
Sat 18 Jan 2014 18:35:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:35:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:35:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:35:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:35:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:35:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:35:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:35:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:35:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:35:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:35:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:35:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43035986
Sat 18 Jan 2014 18:35:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:35:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43035986
Sat 18 Jan 2014 18:35:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:35:56 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:35:56 - job_xml_thread(): Done retrieving: data size 43035986
Sat 18 Jan 2014 18:35:56 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:35:56 - XML: Start document: iteration 20
Sat 18 Jan 2014 18:35:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:35:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:36:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:36:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:36:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:36:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:36:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:36:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:36:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:36:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:36:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:36:09 - XML: Processed 647206 elements - found 0 jobs
Sat 18 Jan 2014 18:36:09 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:36:09 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:36:09 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:36:09 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:36:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:36:11 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:36:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:36:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:36:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:36:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:36:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:36:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:36:12 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:36:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 18:36:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:36:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:36:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42996000
Sat 18 Jan 2014 18:36:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:36:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42996000
Sat 18 Jan 2014 18:36:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:36:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:36:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:36:24 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:36:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:36:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:36:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:36:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:36:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:36:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:36:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:36:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:36:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:36:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:36:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:36:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:36:30 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:36:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:36:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:36:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:36:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:36:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:36:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:36:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:36:34 - job_xml_thread(): Done retrieving: data size 43239350
Sat 18 Jan 2014 18:36:34 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:36:34 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 18:36:34 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 18:36:34 - Housekeeping: done.
Sat 18 Jan 2014 18:36:34 - XML: Start document: iteration 0
Sat 18 Jan 2014 18:36:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43239350
Sat 18 Jan 2014 18:36:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43239350
Sat 18 Jan 2014 18:36:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:36:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:36:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:36:43 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:36:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:36:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:36:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:36:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 18:36:44 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:36:44 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:36:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 18:36:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8415 values 132709 bits 16588 bytes 
Sat 18 Jan 2014 18:36:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:36:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:36:54 - XML: Processed 649468 elements - found 0 jobs
Sat 18 Jan 2014 18:36:55 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:36:55 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:36:55 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:36:55 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:36:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:36:56 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:36:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:36:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:36:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:36:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:36:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:36:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:36:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:36:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:36:58 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:36:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:36:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:36:58 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 18:36:58 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 18:36:58 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:36:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:36:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:36:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:36:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:37:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:37:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43636255
Sat 18 Jan 2014 18:37:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:37:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43636255
Sat 18 Jan 2014 18:37:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:37:10 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:37:10 - job_xml_thread(): Done retrieving: data size 43636255
Sat 18 Jan 2014 18:37:10 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:37:10 - XML: Start document: iteration 1
Sat 18 Jan 2014 18:37:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:37:11 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:37:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:37:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:37:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:37:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:37:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:37:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:37:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:37:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:37:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:37:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:37:21 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:37:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:37:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:37:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:37:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:37:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:37:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:37:23 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:37:23 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:37:23 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:37:23 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:37:23 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:37:23 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:37:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 18:37:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:37:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:37:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43624052
Sat 18 Jan 2014 18:37:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:37:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43624052
Sat 18 Jan 2014 18:37:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:37:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:37:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:37:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:37:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:37:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:37:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:37:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:37:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:37:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:37:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:37:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:37:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:37:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:37:38 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:37:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:37:39 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:37:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:37:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:37:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:37:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:37:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:37:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:37:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:37:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43632279
Sat 18 Jan 2014 18:37:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:37:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43632279
Sat 18 Jan 2014 18:37:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:37:42 - job_xml_thread(): Done retrieving: data size 43632279
Sat 18 Jan 2014 18:37:42 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:37:42 - XML: Start document: iteration 2
Sat 18 Jan 2014 18:37:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:37:45 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:37:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:37:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 18:37:48 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:37:48 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:37:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 18:37:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9016 values 142296 bits 17787 bytes 
Sat 18 Jan 2014 18:37:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:37:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:37:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:37:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:38:00 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:38:00 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:38:00 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:38:00 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:38:00 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:38:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:38:02 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:38:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:38:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:38:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:38:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:38:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:38:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:38:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:38:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:38:06 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:38:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:38:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:38:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:38:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:38:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:38:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:38:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:38:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43650903
Sat 18 Jan 2014 18:38:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:38:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43650903
Sat 18 Jan 2014 18:38:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:38:15 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:38:15 - job_xml_thread(): Done retrieving: data size 43650903
Sat 18 Jan 2014 18:38:15 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:38:15 - XML: Start document: iteration 3
Sat 18 Jan 2014 18:38:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:38:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:38:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:38:20 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:38:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:38:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:38:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:38:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:38:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:38:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:38:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:38:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:38:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:38:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:38:31 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:38:32 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:38:32 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:38:32 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:38:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:38:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:38:32 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:38:32 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:38:32 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:38:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 18:38:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:38:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:38:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:38:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:38:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:38:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:38:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43621710
Sat 18 Jan 2014 18:38:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:38:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43621710
Sat 18 Jan 2014 18:38:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:38:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:38:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:38:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:38:43 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:38:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:38:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:38:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:38:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:38:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:38:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:38:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:38:47 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:38:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:38:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:38:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:38:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43649486
Sat 18 Jan 2014 18:38:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:38:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:38:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:38:48 - job_xml_thread(): Done retrieving: data size 43649486
Sat 18 Jan 2014 18:38:48 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:38:48 - XML: Start document: iteration 4
Sat 18 Jan 2014 18:38:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:38:49 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:38:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:38:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:38:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43649486
Sat 18 Jan 2014 18:38:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:38:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:38:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:38:49 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:38:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:38:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 18:38:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 18:38:49 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:38:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8638 values 136149 bits 17018 bytes 
Sat 18 Jan 2014 18:38:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:39:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:39:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:39:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:39:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:39:07 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:39:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:39:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:39:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:39:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:39:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:39:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:39:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:39:09 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:39:09 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:39:10 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:39:10 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:39:10 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:39:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:39:11 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:39:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:39:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:39:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:39:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:39:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:39:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:39:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:39:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43626854
Sat 18 Jan 2014 18:39:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:39:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43626854
Sat 18 Jan 2014 18:39:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:39:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:39:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:39:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:39:25 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:39:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:39:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:39:25 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:39:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:39:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:39:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:39:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:39:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:39:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:39:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:39:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:39:29 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:39:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:39:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:39:29 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:39:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 18:39:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:39:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:39:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:39:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:39:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:39:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:39:31 - job_xml_thread(): Done retrieving: data size 43627329
Sat 18 Jan 2014 18:39:31 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:39:31 - XML: Start document: iteration 5
Sat 18 Jan 2014 18:39:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43627329
Sat 18 Jan 2014 18:39:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:39:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43627329
Sat 18 Jan 2014 18:39:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:39:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:39:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:39:41 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:39:41 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:39:41 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:39:41 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:39:41 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:39:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:39:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:39:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:39:47 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:39:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:39:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:39:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:39:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:39:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:39:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:39:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:39:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:39:50 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:39:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:39:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 18:39:50 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:39:50 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:39:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5834 values 91961 bits 11495 bytes 
Sat 18 Jan 2014 18:39:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 18:39:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:39:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:39:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:39:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:39:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:39:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:39:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:39:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:39:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:39:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43645758
Sat 18 Jan 2014 18:39:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:39:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43645758
Sat 18 Jan 2014 18:39:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:39:56 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:39:56 - job_xml_thread(): Done retrieving: data size 43645758
Sat 18 Jan 2014 18:39:56 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:39:56 - XML: Start document: iteration 6
Sat 18 Jan 2014 18:40:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:40:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:40:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:40:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:40:11 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:40:11 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:40:11 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:40:11 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:40:11 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:40:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:40:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:40:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:40:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:40:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:40:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:40:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:40:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:40:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:40:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:40:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:40:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:40:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:40:15 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:40:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 18:40:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:40:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:40:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:40:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:40:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:40:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:40:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43633411
Sat 18 Jan 2014 18:40:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:40:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43633411
Sat 18 Jan 2014 18:40:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:40:22 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 18:40:22 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:40:24 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:40:24 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 18:40:24 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:40:24 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 18:40:24 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 18:40:26 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:40:27 - job_xml_thread(): Done retrieving: data size 43633411
Sat 18 Jan 2014 18:40:27 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:40:27 - XML: Start document: iteration 7
Sat 18 Jan 2014 18:40:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:40:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:40:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:40:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:40:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:40:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:40:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:40:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:40:38 - size of cluster 'LISA Cluster': 624 hosts 79481 metrics 907750 values 14310870 bits 1788858 bytes 
Sat 18 Jan 2014 18:40:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:40:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:40:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:40:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:40:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:40:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:40:40 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:40:40 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:40:40 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:40:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:40:40 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:40:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:40:40 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:40:40 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:40:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:40:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:40:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:40:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:40:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:40:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43624258
Sat 18 Jan 2014 18:40:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:40:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43624258
Sat 18 Jan 2014 18:40:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:40:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:40:50 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:40:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:40:53 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:40:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:40:54 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:40:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 18:40:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 18:40:54 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:40:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9171 values 144680 bits 18085 bytes 
Sat 18 Jan 2014 18:40:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:40:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:40:55 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:40:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:40:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:40:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:40:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:40:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:40:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:40:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:40:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:40:58 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:40:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:40:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:40:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:40:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:40:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:40:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:41:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:41:01 - job_xml_thread(): Done retrieving: data size 43627257
Sat 18 Jan 2014 18:41:01 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:41:01 - XML: Start document: iteration 8
Sat 18 Jan 2014 18:41:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43627257
Sat 18 Jan 2014 18:41:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:41:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43627257
Sat 18 Jan 2014 18:41:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:41:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:41:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:41:13 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:41:13 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:41:13 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:41:13 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:41:13 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:41:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:41:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:41:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:41:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:41:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:41:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:41:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:41:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:41:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:41:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:41:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:41:24 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:41:24 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 18:41:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:41:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:41:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:41:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:41:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:41:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:41:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:41:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:41:26 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:41:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 18:41:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:41:28 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:41:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:41:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43552166
Sat 18 Jan 2014 18:41:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:41:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43552166
Sat 18 Jan 2014 18:41:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:41:30 - job_xml_thread(): Done retrieving: data size 43552166
Sat 18 Jan 2014 18:41:30 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:41:30 - XML: Start document: iteration 9
Sat 18 Jan 2014 18:41:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:41:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:41:41 - XML: Processed 653438 elements - found 0 jobs
Sat 18 Jan 2014 18:41:41 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:41:41 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:41:41 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:41:41 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:41:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:41:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:41:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:41:50 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:41:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:41:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:41:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:41:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:41:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:41:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:41:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:41:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:41:52 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:41:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:41:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:41:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:41:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:41:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:41:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:41:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:41:54 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:41:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:41:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42995211
Sat 18 Jan 2014 18:41:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:41:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:41:55 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:41:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 18:41:55 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:41:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8633 values 136101 bits 17012 bytes 
Sat 18 Jan 2014 18:41:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 18:41:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42995211
Sat 18 Jan 2014 18:41:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:41:56 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:41:56 - job_xml_thread(): Done retrieving: data size 42995211
Sat 18 Jan 2014 18:41:56 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:41:56 - XML: Start document: iteration 10
Sat 18 Jan 2014 18:42:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:42:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:42:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:42:07 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:42:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:42:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:42:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:42:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:42:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:42:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:42:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:42:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:42:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:42:10 - XML: Processed 646182 elements - found 0 jobs
Sat 18 Jan 2014 18:42:10 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:42:10 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:42:10 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:42:10 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:42:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:42:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:42:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:42:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:42:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:42:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:42:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:42:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:42:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:42:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43025737
Sat 18 Jan 2014 18:42:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:42:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43025737
Sat 18 Jan 2014 18:42:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:42:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:42:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:42:25 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:42:25 - job_xml_thread(): Done retrieving: data size 43025737
Sat 18 Jan 2014 18:42:25 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:42:25 - XML: Start document: iteration 11
Sat 18 Jan 2014 18:42:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:42:30 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:42:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:42:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:42:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:42:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:42:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:42:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:42:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:42:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:42:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:42:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:42:41 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:42:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:42:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:42:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:42:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:42:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:42:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:42:42 - XML: Processed 646670 elements - found 0 jobs
Sat 18 Jan 2014 18:42:42 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:42:42 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:42:42 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:42:42 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:42:42 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:42:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 18:42:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:42:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:42:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43539249
Sat 18 Jan 2014 18:42:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:42:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43539249
Sat 18 Jan 2014 18:42:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:42:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:42:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:42:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:42:55 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:42:56 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:42:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 18:42:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:42:57 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:42:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:42:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:42:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:42:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 18:42:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:42:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:42:57 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:42:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:42:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:42:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5934 values 93614 bits 11701 bytes 
Sat 18 Jan 2014 18:42:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:42:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:42:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:42:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:43:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:43:01 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:43:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:43:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:43:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:43:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:43:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:43:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:43:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:43:05 - job_xml_thread(): Done retrieving: data size 43632115
Sat 18 Jan 2014 18:43:05 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:43:05 - XML: Start document: iteration 12
Sat 18 Jan 2014 18:43:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43632115
Sat 18 Jan 2014 18:43:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:43:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43632115
Sat 18 Jan 2014 18:43:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:43:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:43:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:43:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:43:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:43:18 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:43:18 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:43:18 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:43:18 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:43:18 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:43:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:43:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:43:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:43:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:43:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:43:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:43:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:43:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:43:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:43:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:43:28 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:43:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:43:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:43:29 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:43:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 18:43:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:43:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:43:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:43:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:43:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:43:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:43:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43621021
Sat 18 Jan 2014 18:43:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:43:33 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:43:33 - job_xml_thread(): Done retrieving: data size 43621021
Sat 18 Jan 2014 18:43:33 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:43:33 - XML: Start document: iteration 13
Sat 18 Jan 2014 18:43:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43621021
Sat 18 Jan 2014 18:43:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:43:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:43:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:43:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:43:42 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:43:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:43:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:43:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:43:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:43:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:43:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:43:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:43:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:43:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:43:52 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:43:52 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:43:52 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:43:52 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:43:52 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:43:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:43:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:43:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:43:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:43:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:43:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:43:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:43:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:43:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:43:56 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:43:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:43:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 18:43:57 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:43:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5833 values 91989 bits 11498 bytes 
Sat 18 Jan 2014 18:43:57 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:43:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 18:43:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:43:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43601636
Sat 18 Jan 2014 18:43:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:43:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43601636
Sat 18 Jan 2014 18:43:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:44:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:44:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:44:07 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:44:07 - job_xml_thread(): Done retrieving: data size 43601636
Sat 18 Jan 2014 18:44:07 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:44:07 - XML: Start document: iteration 14
Sat 18 Jan 2014 18:44:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:44:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:44:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:44:13 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:44:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:44:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:44:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:44:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:44:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:44:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:44:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:44:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:44:21 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:44:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:44:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:44:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:44:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:44:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:44:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:44:23 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:44:23 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:44:23 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:44:23 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:44:23 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:44:25 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:44:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 18:44:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:44:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:44:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43618750
Sat 18 Jan 2014 18:44:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:44:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43618750
Sat 18 Jan 2014 18:44:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:44:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:44:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:44:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:44:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:44:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:44:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:44:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:44:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:44:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:44:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:44:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43618750
Sat 18 Jan 2014 18:44:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:44:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:44:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:44:38 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:44:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:44:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:44:48 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:44:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:44:49 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:44:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:44:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:44:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:44:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:44:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:44:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:44:51 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 18:44:51 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 18:44:51 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:44:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:44:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:44:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:44:52 - job_xml_thread(): Done retrieving: data size 43617501
Sat 18 Jan 2014 18:44:52 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:44:52 - XML: Start document: iteration 15
Sat 18 Jan 2014 18:44:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43617501
Sat 18 Jan 2014 18:44:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:44:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:44:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:44:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:44:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:44:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43617501
Sat 18 Jan 2014 18:44:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:44:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:44:57 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:44:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:44:58 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:44:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 18:44:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 18:44:59 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:44:59 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7039 values 110971 bits 13871 bytes 
Sat 18 Jan 2014 18:45:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:45:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:45:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:45:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:45:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:45:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:45:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:45:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:45:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:45:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:45:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:45:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:45:13 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:45:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:45:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:45:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:45:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:45:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:45:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:45:15 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:45:15 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:45:15 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:45:15 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:45:15 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:45:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:45:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43613477
Sat 18 Jan 2014 18:45:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:45:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43613477
Sat 18 Jan 2014 18:45:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:45:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:45:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:45:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:45:27 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:45:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:45:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:45:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:45:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:45:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:45:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:45:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43613477
Sat 18 Jan 2014 18:45:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:45:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:45:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:45:30 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:45:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:45:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:45:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:45:36 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:45:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 18:45:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:45:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:45:38 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:45:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:45:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:45:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:45:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:45:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:45:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:45:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:45:40 - job_xml_thread(): Done retrieving: data size 43640391
Sat 18 Jan 2014 18:45:40 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:45:40 - XML: Start document: iteration 16
Sat 18 Jan 2014 18:45:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43640391
Sat 18 Jan 2014 18:45:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:45:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:45:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:45:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:45:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:45:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:45:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43640391
Sat 18 Jan 2014 18:45:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:45:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:45:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:45:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:45:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:45:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:45:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:45:59 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:45:59 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:45:59 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:45:59 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:45:59 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:45:59 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:45:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:45:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:45:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:45:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:46:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:46:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:46:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:46:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 18:46:00 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:46:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6129 values 96664 bits 12083 bytes 
Sat 18 Jan 2014 18:46:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:46:00 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:46:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 18:46:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:46:01 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:46:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:46:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:46:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:46:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:46:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:46:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:46:03 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:46:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 18:46:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:46:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:46:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43637576
Sat 18 Jan 2014 18:46:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:46:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43637576
Sat 18 Jan 2014 18:46:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:46:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:46:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:46:14 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:46:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:46:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:46:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:46:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:46:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:46:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:46:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:46:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:46:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:46:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:46:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:46:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:46:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:46:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:46:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:46:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:46:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:46:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:46:18 - job_xml_thread(): Done retrieving: data size 43632601
Sat 18 Jan 2014 18:46:18 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:46:18 - XML: Start document: iteration 17
Sat 18 Jan 2014 18:46:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43632601
Sat 18 Jan 2014 18:46:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:46:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43632601
Sat 18 Jan 2014 18:46:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:46:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:46:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:46:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:46:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:46:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:46:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:46:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:46:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:46:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:46:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:46:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:46:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:46:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:46:38 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:46:38 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:46:38 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:46:38 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:46:38 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:46:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:46:40 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:46:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:46:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:46:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:46:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:46:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:46:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:46:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:46:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43654184
Sat 18 Jan 2014 18:46:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:46:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43654184
Sat 18 Jan 2014 18:46:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:46:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:46:51 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:46:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:46:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:46:53 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:46:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:46:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:46:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:46:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:46:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:46:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:46:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:46:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:46:56 - job_xml_thread(): Done retrieving: data size 43661376
Sat 18 Jan 2014 18:46:56 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:46:56 - XML: Start document: iteration 18
Sat 18 Jan 2014 18:46:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:46:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:46:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43661376
Sat 18 Jan 2014 18:46:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:46:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:46:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:46:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:46:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43661376
Sat 18 Jan 2014 18:46:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:46:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:47:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:47:00 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:47:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:47:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 18:47:01 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:47:01 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:47:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 18:47:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 10716 values 169331 bits 21166 bytes 
Sat 18 Jan 2014 18:47:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:47:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:47:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:47:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:47:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:47:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:47:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:47:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:47:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:47:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:47:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:47:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:47:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:47:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:47:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:47:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:47:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:47:17 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:47:17 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:47:17 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:47:17 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:47:17 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:47:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:47:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:47:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:47:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:47:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:47:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558676
Sat 18 Jan 2014 18:47:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:47:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558676
Sat 18 Jan 2014 18:47:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:47:24 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 18:47:24 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:47:26 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:47:26 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 18:47:26 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:47:26 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 18:47:26 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 18:47:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:47:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:47:32 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:47:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:47:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:47:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:47:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:47:34 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:47:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:47:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:47:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:47:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:47:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:47:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:47:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:47:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:47:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:47:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:47:36 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 812653 values 12823432 bits 1602929 bytes 
Sat 18 Jan 2014 18:47:37 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:47:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 18:47:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:47:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:47:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:47:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:47:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:47:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:47:40 - job_xml_thread(): Done retrieving: data size 43067413
Sat 18 Jan 2014 18:47:40 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:47:40 - XML: Start document: iteration 19
Sat 18 Jan 2014 18:47:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43067413
Sat 18 Jan 2014 18:47:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:47:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43067413
Sat 18 Jan 2014 18:47:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:47:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:47:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:47:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:47:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:47:59 - XML: Processed 646984 elements - found 0 jobs
Sat 18 Jan 2014 18:47:59 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:47:59 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:47:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:47:59 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:47:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:47:59 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:47:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:47:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:48:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:48:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:48:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:48:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:48:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:48:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:48:02 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:48:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:48:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 18:48:02 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:48:02 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:48:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 18:48:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6074 values 96097 bits 12012 bytes 
Sat 18 Jan 2014 18:48:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:48:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:48:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:48:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:48:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:48:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:48:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:48:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:48:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:48:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42974664
Sat 18 Jan 2014 18:48:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:48:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42974664
Sat 18 Jan 2014 18:48:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:48:14 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:48:14 - job_xml_thread(): Done retrieving: data size 42974664
Sat 18 Jan 2014 18:48:14 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:48:15 - XML: Start document: iteration 20
Sat 18 Jan 2014 18:48:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:48:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:48:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:48:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:48:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:48:27 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:48:27 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:48:27 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 18:48:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:48:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:48:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:48:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:48:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:48:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:48:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:48:31 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:48:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 18:48:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:48:32 - XML: Processed 645996 elements - found 0 jobs
Sat 18 Jan 2014 18:48:32 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:48:32 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:48:32 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:48:32 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:48:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:48:33 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:48:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:48:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:48:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:48:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:48:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:48:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:48:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:48:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43362647
Sat 18 Jan 2014 18:48:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:48:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43362647
Sat 18 Jan 2014 18:48:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:48:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:48:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:48:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:48:46 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:48:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:48:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:48:47 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:48:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:48:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:48:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:48:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:48:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:48:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:48:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:48:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:48:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:48:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:48:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:48:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:48:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:48:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:48:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:48:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:48:57 - job_xml_thread(): Done retrieving: data size 43591061
Sat 18 Jan 2014 18:48:57 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:48:57 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 18:48:57 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 18:48:57 - Housekeeping: done.
Sat 18 Jan 2014 18:48:57 - XML: Start document: iteration 0
Sat 18 Jan 2014 18:48:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43591061
Sat 18 Jan 2014 18:48:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:48:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43591061
Sat 18 Jan 2014 18:48:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:49:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:49:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:49:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:49:03 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:49:04 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:49:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:49:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 18:49:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 18:49:04 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:49:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9311 values 147084 bits 18385 bytes 
Sat 18 Jan 2014 18:49:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:49:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:49:16 - XML: Processed 653586 elements - found 0 jobs
Sat 18 Jan 2014 18:49:16 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:49:16 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:49:16 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:49:16 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:49:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:49:19 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:49:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:49:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:49:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:49:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:49:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:49:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:49:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:49:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:49:20 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:49:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:49:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:49:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:49:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:49:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:49:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:49:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:49:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43654100
Sat 18 Jan 2014 18:49:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:49:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43654100
Sat 18 Jan 2014 18:49:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:49:31 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:49:31 - job_xml_thread(): Done retrieving: data size 43654100
Sat 18 Jan 2014 18:49:32 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:49:32 - XML: Start document: iteration 1
Sat 18 Jan 2014 18:49:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:49:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:49:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:49:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:49:43 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:49:43 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:49:43 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:49:43 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:49:43 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:49:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:49:44 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:49:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:49:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:49:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:49:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:49:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:49:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:49:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:49:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:49:48 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:49:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:49:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:49:48 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:49:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 18:49:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:49:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:49:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:49:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:49:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:49:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:49:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43630981
Sat 18 Jan 2014 18:49:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:49:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43630981
Sat 18 Jan 2014 18:49:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:49:58 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:49:58 - job_xml_thread(): Done retrieving: data size 43630981
Sat 18 Jan 2014 18:49:58 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:49:58 - XML: Start document: iteration 2
Sat 18 Jan 2014 18:50:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:50:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:50:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:50:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:50:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:50:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:50:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:50:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:50:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:50:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:50:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:50:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:50:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:50:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:50:04 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:50:05 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:50:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:50:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 18:50:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 18:50:05 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:50:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5906 values 93169 bits 11646 bytes 
Sat 18 Jan 2014 18:50:11 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:50:11 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:50:11 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:50:11 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:50:11 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:50:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:50:13 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:50:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:50:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:50:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:50:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:50:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:50:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:50:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:50:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43601098
Sat 18 Jan 2014 18:50:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:50:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:50:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:50:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43601098
Sat 18 Jan 2014 18:50:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:50:27 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:50:27 - job_xml_thread(): Done retrieving: data size 43601098
Sat 18 Jan 2014 18:50:27 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:50:27 - XML: Start document: iteration 3
Sat 18 Jan 2014 18:50:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:50:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:50:31 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:50:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 18:50:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:50:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:50:33 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:50:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:50:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:50:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:50:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:50:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:50:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:50:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:50:37 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:50:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:50:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:50:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:50:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:50:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:50:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:50:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:50:39 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:50:39 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:50:39 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:50:39 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:50:39 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:50:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:50:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43661378
Sat 18 Jan 2014 18:50:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:50:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43661378
Sat 18 Jan 2014 18:50:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:50:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:50:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:50:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:50:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:50:54 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:50:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:50:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:50:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:50:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:50:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:50:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:50:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:50:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:50:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:50:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:50:58 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:50:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:50:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:50:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:50:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:50:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:50:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:51:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:51:02 - job_xml_thread(): Done retrieving: data size 43631361
Sat 18 Jan 2014 18:51:02 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:51:02 - XML: Start document: iteration 4
Sat 18 Jan 2014 18:51:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43631361
Sat 18 Jan 2014 18:51:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:51:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43631361
Sat 18 Jan 2014 18:51:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:51:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:51:06 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:51:07 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:51:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 18:51:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:51:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 18:51:07 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:51:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7468 values 117854 bits 14731 bytes 
Sat 18 Jan 2014 18:51:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:51:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:51:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:51:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:51:14 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:51:14 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:51:14 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:51:14 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:51:14 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:51:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:51:24 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:51:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:51:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:51:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:51:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:51:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:51:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:51:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:51:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:51:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:51:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:51:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:51:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:51:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:51:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:51:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:51:28 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 18:51:28 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 18:51:28 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:51:29 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:51:29 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:51:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 18:51:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:51:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:51:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43649076
Sat 18 Jan 2014 18:51:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:51:30 - job_xml_thread(): Done retrieving: data size 43649076
Sat 18 Jan 2014 18:51:30 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:51:30 - XML: Start document: iteration 5
Sat 18 Jan 2014 18:51:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43649076
Sat 18 Jan 2014 18:51:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:51:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:51:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:51:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:51:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:51:47 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:51:47 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:51:47 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:51:47 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:51:47 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:51:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:51:50 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:51:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:51:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:51:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:51:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:51:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:51:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:51:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:51:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:51:52 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:51:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:51:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:51:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:51:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:51:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:51:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:51:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:51:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43661006
Sat 18 Jan 2014 18:51:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:51:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43661006
Sat 18 Jan 2014 18:51:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:52:02 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:52:02 - job_xml_thread(): Done retrieving: data size 43661006
Sat 18 Jan 2014 18:52:02 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:52:02 - XML: Start document: iteration 6
Sat 18 Jan 2014 18:52:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:52:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:52:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:52:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:52:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:52:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:52:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:52:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:52:07 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:52:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:52:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:52:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:52:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:52:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:52:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 18:52:08 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:52:09 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:52:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 18:52:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99044 bits 12380 bytes 
Sat 18 Jan 2014 18:52:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:52:16 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:52:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:52:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:52:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:52:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:52:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:52:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:52:18 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:52:18 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:52:18 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:52:18 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:52:18 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:52:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:52:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43604833
Sat 18 Jan 2014 18:52:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:52:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43604833
Sat 18 Jan 2014 18:52:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:52:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:52:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:52:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:52:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:52:33 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:52:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:52:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:52:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:52:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:52:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:52:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:52:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:52:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:52:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:52:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:52:37 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:52:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:52:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:52:37 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:52:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 18:52:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:52:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:52:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:52:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:52:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:52:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:52:40 - job_xml_thread(): Done retrieving: data size 43645676
Sat 18 Jan 2014 18:52:40 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:52:40 - XML: Start document: iteration 7
Sat 18 Jan 2014 18:52:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43645676
Sat 18 Jan 2014 18:52:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43645676
Sat 18 Jan 2014 18:52:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:52:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:52:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:52:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:52:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:52:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:52:59 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:52:59 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:53:00 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:53:00 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:53:00 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:53:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:53:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:53:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:53:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:53:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:53:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:53:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:53:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:53:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:53:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:53:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:53:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:53:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:53:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:53:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:53:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:53:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:53:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:53:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43638910
Sat 18 Jan 2014 18:53:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:53:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43638910
Sat 18 Jan 2014 18:53:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:53:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:53:09 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:53:10 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:53:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:53:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 18:53:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 18:53:10 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:53:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9151 values 144357 bits 18044 bytes 
Sat 18 Jan 2014 18:53:15 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:53:15 - job_xml_thread(): Done retrieving: data size 43638910
Sat 18 Jan 2014 18:53:15 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:53:15 - XML: Start document: iteration 8
Sat 18 Jan 2014 18:53:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:53:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:53:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:53:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:53:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:53:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:53:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:53:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:53:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:53:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:53:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:53:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:53:27 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:53:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:53:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:53:28 - XML: Processed 654194 elements - found 0 jobs
Sat 18 Jan 2014 18:53:28 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:53:28 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:53:28 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:53:28 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:53:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:53:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:53:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:53:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:53:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:53:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557979
Sat 18 Jan 2014 18:53:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:53:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557979
Sat 18 Jan 2014 18:53:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:53:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:53:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:53:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:53:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:53:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:53:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:53:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:53:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:53:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:53:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:53:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:53:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:53:43 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:53:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:53:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:53:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:53:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:53:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:53:46 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:53:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 18:53:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:53:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:53:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:53:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:53:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:53:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:53:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43010274
Sat 18 Jan 2014 18:53:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:53:48 - job_xml_thread(): Done retrieving: data size 43010274
Sat 18 Jan 2014 18:53:48 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:53:48 - XML: Start document: iteration 9
Sat 18 Jan 2014 18:53:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43010274
Sat 18 Jan 2014 18:53:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:53:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:53:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:54:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:54:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:54:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:54:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:54:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:54:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:54:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:54:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:54:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:54:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:54:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:54:05 - XML: Processed 646650 elements - found 0 jobs
Sat 18 Jan 2014 18:54:05 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:54:05 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:54:05 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:54:05 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:54:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:54:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:54:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:54:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:54:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:54:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:54:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:54:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:54:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:54:10 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:54:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:54:11 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:54:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 18:54:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 18:54:11 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:54:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5954 values 93888 bits 11736 bytes 
Sat 18 Jan 2014 18:54:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:54:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42972586
Sat 18 Jan 2014 18:54:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:54:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42972586
Sat 18 Jan 2014 18:54:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:54:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:54:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:54:20 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:54:20 - job_xml_thread(): Done retrieving: data size 42972586
Sat 18 Jan 2014 18:54:21 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:54:21 - XML: Start document: iteration 10
Sat 18 Jan 2014 18:54:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:54:25 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:54:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:54:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:54:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:54:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:54:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:54:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:54:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:54:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:54:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:54:28 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 18:54:28 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:54:28 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:54:28 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:54:28 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 18:54:28 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 18:54:28 - Entering storeMetrics(): cluster LISA Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sat 18 Jan 2014 18:54:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:54:32 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:54:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:54:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:54:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:54:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:54:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:54:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:54:35 - XML: Processed 646010 elements - found 0 jobs
Sat 18 Jan 2014 18:54:35 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:54:35 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:54:35 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:54:35 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:54:40 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:54:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 18:54:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:54:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:54:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43401397
Sat 18 Jan 2014 18:54:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:54:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43401397
Sat 18 Jan 2014 18:54:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:54:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:54:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:54:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:54:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:54:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:54:50 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:54:50 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:54:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:54:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:54:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:54:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:54:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:54:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:54:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:54:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:54:54 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:54:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:54:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:54:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:54:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:54:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:54:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:54:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:54:57 - job_xml_thread(): Done retrieving: data size 43601643
Sat 18 Jan 2014 18:54:57 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:54:57 - XML: Start document: iteration 11
Sat 18 Jan 2014 18:54:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43601643
Sat 18 Jan 2014 18:54:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:54:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43601643
Sat 18 Jan 2014 18:54:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:55:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:55:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:55:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:55:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:55:11 - XML: Processed 653596 elements - found 0 jobs
Sat 18 Jan 2014 18:55:11 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:55:11 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:55:11 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:55:11 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:55:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:55:11 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:55:12 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:55:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:55:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 18:55:12 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:55:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 18:55:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7225 values 113861 bits 14232 bytes 
Sat 18 Jan 2014 18:55:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:55:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:55:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:55:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:55:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:55:18 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:55:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:55:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:55:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:55:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:55:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:55:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:55:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:55:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:55:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:55:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:55:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:55:21 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:55:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 18:55:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:55:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:55:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43634642
Sat 18 Jan 2014 18:55:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:55:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43634642
Sat 18 Jan 2014 18:55:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:55:26 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:55:26 - job_xml_thread(): Done retrieving: data size 43634642
Sat 18 Jan 2014 18:55:26 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:55:26 - XML: Start document: iteration 12
Sat 18 Jan 2014 18:55:29 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:55:29 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:55:31 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:55:32 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 18:55:32 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 18:55:32 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:55:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:55:32 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 18:55:32 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:55:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:55:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:55:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:55:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:55:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:55:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:55:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:55:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:55:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sat 18 Jan 2014 18:55:43 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:55:43 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:55:43 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:55:43 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:55:43 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:55:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:55:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:55:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:55:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:55:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:55:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:55:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:55:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:55:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:55:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43615363
Sat 18 Jan 2014 18:55:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:55:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43615363
Sat 18 Jan 2014 18:55:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:55:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:55:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:55:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:55:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:55:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:55:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:55:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:55:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:55:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:55:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:55:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:55:59 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:56:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:56:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:56:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:56:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:56:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:56:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:56:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:56:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:56:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:56:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43634498
Sat 18 Jan 2014 18:56:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:56:02 - job_xml_thread(): Done retrieving: data size 43634498
Sat 18 Jan 2014 18:56:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43634498
Sat 18 Jan 2014 18:56:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:56:02 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:56:02 - XML: Start document: iteration 13
Sat 18 Jan 2014 18:56:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:56:12 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:56:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:56:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:56:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:56:13 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:56:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:56:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:56:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:56:13 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:56:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 18:56:13 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:56:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8610 values 135792 bits 16974 bytes 
Sat 18 Jan 2014 18:56:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 18:56:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:56:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:56:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:56:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:56:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:56:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:56:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:56:21 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:56:21 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:56:21 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:56:21 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:56:21 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:56:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:56:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:56:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:56:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:56:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:56:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:56:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:56:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:56:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:56:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43627185
Sat 18 Jan 2014 18:56:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:56:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43627185
Sat 18 Jan 2014 18:56:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:56:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:56:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:56:32 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:56:32 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:56:34 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:56:34 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 18:56:34 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:56:34 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 18:56:35 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 18:56:37 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:56:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:56:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:56:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:56:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:56:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:56:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:56:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:56:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:56:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:56:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:56:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:56:41 - size of cluster 'LISA Cluster': 624 hosts 79481 metrics 949775 values 14971760 bits 1871470 bytes 
Sat 18 Jan 2014 18:56:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:56:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:56:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:56:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:56:44 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:56:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 18:56:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:56:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:56:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:56:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:56:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:56:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:56:53 - job_xml_thread(): Done retrieving: data size 43613835
Sat 18 Jan 2014 18:56:53 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:56:53 - XML: Start document: iteration 14
Sat 18 Jan 2014 18:56:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43613835
Sat 18 Jan 2014 18:56:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43613835
Sat 18 Jan 2014 18:56:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:56:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:56:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:56:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:57:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:57:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:57:05 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:57:05 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:57:05 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:57:05 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:57:05 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:57:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:57:13 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:57:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:57:14 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:57:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:57:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:57:14 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:57:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 18:57:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:57:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 18:57:15 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:57:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6052 values 95437 bits 11929 bytes 
Sat 18 Jan 2014 18:57:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:57:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:57:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:57:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:57:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:57:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:57:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:57:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:57:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:57:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:57:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:57:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:57:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:57:20 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:57:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:57:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43635441
Sat 18 Jan 2014 18:57:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:57:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43635441
Sat 18 Jan 2014 18:57:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:57:22 - job_xml_thread(): Done retrieving: data size 43635441
Sat 18 Jan 2014 18:57:22 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:57:22 - XML: Start document: iteration 15
Sat 18 Jan 2014 18:57:29 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:57:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 18:57:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:57:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:57:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:57:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:57:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:57:34 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:57:34 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 18:57:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:57:42 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:57:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:57:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:57:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:57:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:57:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:57:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:57:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:57:44 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:57:44 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:57:44 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:57:44 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:57:44 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:57:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:57:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:57:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:57:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:57:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:57:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:57:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:57:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:57:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:57:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43628700
Sat 18 Jan 2014 18:57:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:57:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43628700
Sat 18 Jan 2014 18:57:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:57:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:57:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:57:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:57:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:57:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:57:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:57:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:57:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:57:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:57:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43628700
Sat 18 Jan 2014 18:57:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:57:59 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:57:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:57:59 - job_xml_thread(): Done retrieving: data size 43628700
Sat 18 Jan 2014 18:57:59 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:57:59 - XML: Start document: iteration 16
Sat 18 Jan 2014 18:58:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:58:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:58:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:58:14 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:58:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:58:14 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:58:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:58:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:58:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:58:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:58:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:58:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:58:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:58:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:58:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 18:58:15 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:58:15 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:58:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 18:58:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6219 values 98081 bits 12260 bytes 
Sat 18 Jan 2014 18:58:19 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:58:19 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:58:19 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:58:19 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:58:19 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:58:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:58:20 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:58:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:58:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:58:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:58:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:58:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:58:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:58:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:58:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43639978
Sat 18 Jan 2014 18:58:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:58:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43639978
Sat 18 Jan 2014 18:58:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:58:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:58:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:58:34 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:58:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:58:34 - job_xml_thread(): Done retrieving: data size 43639978
Sat 18 Jan 2014 18:58:34 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:58:34 - XML: Start document: iteration 17
Sat 18 Jan 2014 18:58:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:58:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:58:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:58:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:58:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:58:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:58:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:58:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43639978
Sat 18 Jan 2014 18:58:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:58:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:58:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:58:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:58:50 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:58:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:58:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:58:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:58:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:58:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:58:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:58:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:58:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:58:54 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:58:54 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 18:58:54 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:58:54 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:58:54 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:58:54 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:58:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:58:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:58:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:58:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:58:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:58:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:58:55 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:58:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 18:58:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:58:55 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 18:58:55 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 18:58:55 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:58:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:58:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43646828
Sat 18 Jan 2014 18:58:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:58:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43646828
Sat 18 Jan 2014 18:58:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:59:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:59:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:59:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:59:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:59:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:59:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:59:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:59:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43646828
Sat 18 Jan 2014 18:59:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:59:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:59:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:59:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:59:10 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:59:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:59:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:59:15 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:59:16 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:59:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 18:59:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:59:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 18:59:16 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:59:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5864 values 92419 bits 11552 bytes 
Sat 18 Jan 2014 18:59:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:59:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:59:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:59:18 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:59:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:59:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:59:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:59:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:59:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:59:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:59:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:59:20 - job_xml_thread(): Done retrieving: data size 43542315
Sat 18 Jan 2014 18:59:20 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:59:20 - XML: Start document: iteration 18
Sat 18 Jan 2014 18:59:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43542315
Sat 18 Jan 2014 18:59:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:59:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:59:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:59:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:59:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:59:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:59:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43542315
Sat 18 Jan 2014 18:59:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:59:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:59:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:59:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:59:37 - XML: Processed 653448 elements - found 0 jobs
Sat 18 Jan 2014 18:59:37 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 18:59:37 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 18:59:37 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 18:59:37 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 18:59:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:59:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:59:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:59:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:59:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:59:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:59:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:59:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:59:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 18:59:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 18:59:42 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 18:59:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 18:59:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 18:59:42 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 18:59:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 18:59:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:59:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:59:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 18:59:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 18:59:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 18:59:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 18:59:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43019861
Sat 18 Jan 2014 18:59:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 18:59:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43019861
Sat 18 Jan 2014 18:59:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 18:59:52 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 18:59:52 - job_xml_thread(): Done retrieving: data size 43019861
Sat 18 Jan 2014 18:59:53 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 18:59:53 - XML: Start document: iteration 19
Sat 18 Jan 2014 18:59:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 18:59:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:59:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 18:59:56 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 18:59:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 18:59:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 18:59:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 18:59:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 18:59:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:59:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 18:59:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 18:59:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 18:59:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:00:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:00:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:00:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:00:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:00:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:00:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:00:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:00:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:00:06 - XML: Processed 646698 elements - found 0 jobs
Sat 18 Jan 2014 19:00:06 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:00:06 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:00:06 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:00:06 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:00:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:00:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42953170
Sat 18 Jan 2014 19:00:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:00:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42953170
Sat 18 Jan 2014 19:00:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:00:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:00:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:00:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:00:15 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:00:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:00:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:00:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:00:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:00:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:00:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:00:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:00:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42953170
Sat 18 Jan 2014 19:00:17 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:00:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:00:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:00:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 19:00:18 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:00:18 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:00:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 19:00:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9186 values 144837 bits 18104 bytes 
Sat 18 Jan 2014 19:00:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:00:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:00:21 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:00:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:00:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:00:29 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:00:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:00:29 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:00:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:00:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:00:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:00:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:00:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:00:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:00:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:00:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:00:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:00:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:00:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:00:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:00:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:00:32 - job_xml_thread(): Done retrieving: data size 43352317
Sat 18 Jan 2014 19:00:32 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:00:32 - XML: Start document: iteration 20
Sat 18 Jan 2014 19:00:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43352317
Sat 18 Jan 2014 19:00:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:00:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43352317
Sat 18 Jan 2014 19:00:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:00:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:00:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:00:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:00:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:00:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:00:49 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:00:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:00:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:00:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:00:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:00:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:00:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:00:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:00:52 - XML: Processed 651134 elements - found 0 jobs
Sat 18 Jan 2014 19:00:52 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:00:52 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:00:52 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:00:52 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:00:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:00:56 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:00:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:00:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:00:56 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:00:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 19:00:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:00:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:00:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:00:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:00:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:00:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:00:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43603860
Sat 18 Jan 2014 19:00:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:00:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43603860
Sat 18 Jan 2014 19:00:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:01:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:01:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:01:07 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:01:07 - job_xml_thread(): Done retrieving: data size 43603860
Sat 18 Jan 2014 19:01:07 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:01:07 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 19:01:08 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 19:01:08 - Housekeeping: done.
Sat 18 Jan 2014 19:01:09 - XML: Start document: iteration 0
Sat 18 Jan 2014 19:01:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:01:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:01:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:01:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:01:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:01:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:01:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:01:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:01:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:01:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:01:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:01:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:01:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:01:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:01:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:01:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:01:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:01:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:01:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:01:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:01:19 - XML: Processed 653652 elements - found 0 jobs
Sat 18 Jan 2014 19:01:19 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:01:19 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:01:19 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:01:19 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:01:19 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:01:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:01:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 19:01:20 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:01:20 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:01:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5693 values 89762 bits 11220 bytes 
Sat 18 Jan 2014 19:01:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 19:01:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:01:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43610824
Sat 18 Jan 2014 19:01:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:01:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43610824
Sat 18 Jan 2014 19:01:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:01:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:01:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:01:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:01:33 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:01:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:01:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:01:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:01:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:01:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:01:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:01:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:01:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:01:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:01:34 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:01:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:01:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:01:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:01:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:01:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:01:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:01:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:01:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:01:38 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:01:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 19:01:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:01:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:01:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43647951
Sat 18 Jan 2014 19:01:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:01:39 - job_xml_thread(): Done retrieving: data size 43647951
Sat 18 Jan 2014 19:01:39 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:01:39 - XML: Start document: iteration 1
Sat 18 Jan 2014 19:01:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43647951
Sat 18 Jan 2014 19:01:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:01:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:01:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:01:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:01:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:01:54 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 19:01:55 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:01:55 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:01:55 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:01:55 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:01:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:01:56 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:01:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:01:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:01:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:01:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:01:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:01:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:01:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:02:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:02:01 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:02:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:02:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:02:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:02:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:02:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:02:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:02:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:02:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43622470
Sat 18 Jan 2014 19:02:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:02:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43622470
Sat 18 Jan 2014 19:02:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:02:10 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:02:10 - job_xml_thread(): Done retrieving: data size 43622470
Sat 18 Jan 2014 19:02:10 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:02:10 - XML: Start document: iteration 2
Sat 18 Jan 2014 19:02:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:02:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:02:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:02:13 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:02:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:02:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:02:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:02:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:02:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:02:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:02:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:02:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:02:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:02:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:02:20 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:02:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:02:20 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:02:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 19:02:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 19:02:20 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:02:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7365 values 116510 bits 14563 bytes 
Sat 18 Jan 2014 19:02:21 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 19:02:21 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:02:21 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:02:21 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:02:21 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:02:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:02:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:02:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:02:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:02:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:02:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:02:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:02:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:02:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:02:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43618859
Sat 18 Jan 2014 19:02:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:02:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43618859
Sat 18 Jan 2014 19:02:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:02:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:02:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:02:37 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:02:37 - job_xml_thread(): Done retrieving: data size 43618859
Sat 18 Jan 2014 19:02:37 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:02:37 - XML: Start document: iteration 3
Sat 18 Jan 2014 19:02:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:02:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:02:42 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:02:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 19:02:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:02:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:02:44 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:02:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:02:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:02:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:02:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:02:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:02:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:02:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:02:50 - XML: Processed 654193 elements - found 0 jobs
Sat 18 Jan 2014 19:02:50 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:02:50 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:02:50 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:02:50 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:02:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:02:53 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:02:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:02:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:02:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:02:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:02:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:02:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:02:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:02:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43642930
Sat 18 Jan 2014 19:02:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:02:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43642930
Sat 18 Jan 2014 19:02:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:03:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:03:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:03:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:03:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:03:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:03:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:03:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:03:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:03:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:03:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:03:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43642930
Sat 18 Jan 2014 19:03:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:03:05 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:03:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:03:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:03:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:03:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:03:13 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:03:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:03:16 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:03:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:03:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:03:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:03:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:03:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:03:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:03:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:03:18 - job_xml_thread(): Done retrieving: data size 43611402
Sat 18 Jan 2014 19:03:18 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:03:18 - XML: Start document: iteration 4
Sat 18 Jan 2014 19:03:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43611402
Sat 18 Jan 2014 19:03:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:03:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:03:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:03:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:03:21 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:03:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:03:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:03:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:03:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43611402
Sat 18 Jan 2014 19:03:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:03:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:03:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:03:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 19:03:22 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:03:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 19:03:22 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:03:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6125 values 96851 bits 12106 bytes 
Sat 18 Jan 2014 19:03:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:03:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:03:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:03:33 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:03:34 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 19:03:34 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:03:37 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:03:37 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:03:37 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 19:03:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:03:37 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 19:03:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:03:37 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 19:03:39 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 19:03:39 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:03:39 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:03:39 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:03:39 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:03:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:03:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:03:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:03:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:03:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:03:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:03:41 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:03:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:03:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:03:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:03:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:03:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:03:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:03:42 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 956392 values 15101367 bits 1887670 bytes 
Sat 18 Jan 2014 19:03:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:03:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43624170
Sat 18 Jan 2014 19:03:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:03:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43624170
Sat 18 Jan 2014 19:03:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:03:55 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:03:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:03:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:03:55 - job_xml_thread(): Done retrieving: data size 43624170
Sat 18 Jan 2014 19:03:56 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:03:56 - XML: Start document: iteration 5
Sat 18 Jan 2014 19:03:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:03:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:03:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:03:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:04:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:04:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:04:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:04:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:04:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:04:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:04:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:04:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:04:07 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:04:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:04:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:04:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:04:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:04:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:04:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:04:09 - XML: Processed 654191 elements - found 0 jobs
Sat 18 Jan 2014 19:04:09 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:04:09 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:04:09 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:04:09 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:04:10 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:04:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 19:04:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:04:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:04:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43634196
Sat 18 Jan 2014 19:04:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:04:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43634196
Sat 18 Jan 2014 19:04:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:04:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:04:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:04:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:04:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:04:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:04:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:04:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:04:22 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:04:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:04:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:04:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:04:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:04:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:04:23 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:04:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:04:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 19:04:23 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:04:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 19:04:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5828 values 91937 bits 11492 bytes 
Sat 18 Jan 2014 19:04:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:04:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:04:24 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:04:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:04:27 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:04:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:04:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:04:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:04:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:04:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:04:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:04:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:04:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43616519
Sat 18 Jan 2014 19:04:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:04:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43616519
Sat 18 Jan 2014 19:04:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:04:35 - job_xml_thread(): Done retrieving: data size 43616519
Sat 18 Jan 2014 19:04:35 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:04:35 - XML: Start document: iteration 6
Sat 18 Jan 2014 19:04:37 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:04:37 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 19:04:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:04:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:04:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:04:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:04:55 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 19:04:55 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:04:55 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:04:55 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:04:55 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:04:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:04:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:04:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:04:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:04:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:04:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:04:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:04:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:04:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:04:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:04:59 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:04:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:04:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:05:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:05:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:05:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:05:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:05:00 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:05:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 19:05:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:05:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:05:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43634478
Sat 18 Jan 2014 19:05:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:05:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43634478
Sat 18 Jan 2014 19:05:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:05:10 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:05:10 - job_xml_thread(): Done retrieving: data size 43634478
Sat 18 Jan 2014 19:05:10 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:05:10 - XML: Start document: iteration 7
Sat 18 Jan 2014 19:05:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:05:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:05:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:05:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:05:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:05:18 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:05:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:05:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:05:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:05:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:05:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:05:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:05:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:05:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:05:24 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:05:24 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 19:05:24 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:05:24 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:05:24 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:05:24 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:05:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:05:24 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:05:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 19:05:24 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:05:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 19:05:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5768 values 90925 bits 11365 bytes 
Sat 18 Jan 2014 19:05:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:05:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:05:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:05:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:05:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:05:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:05:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:05:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:05:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:05:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556841
Sat 18 Jan 2014 19:05:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:05:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556841
Sat 18 Jan 2014 19:05:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:05:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:05:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:05:39 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:05:39 - job_xml_thread(): Done retrieving: data size 43556841
Sat 18 Jan 2014 19:05:39 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:05:39 - XML: Start document: iteration 8
Sat 18 Jan 2014 19:05:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:05:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:05:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:05:43 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:05:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:05:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:05:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:05:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:05:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:05:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:05:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:05:50 - XML: Processed 653448 elements - found 0 jobs
Sat 18 Jan 2014 19:05:50 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:05:50 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:05:50 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:05:50 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:05:51 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:05:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 19:05:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:05:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:05:53 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:05:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:05:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:05:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:05:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:05:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:05:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:05:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:05:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43009553
Sat 18 Jan 2014 19:05:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:05:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43009553
Sat 18 Jan 2014 19:05:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:05:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:05:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:06:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:06:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:06:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:06:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:06:05 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:06:05 - job_xml_thread(): Done retrieving: data size 43009553
Sat 18 Jan 2014 19:06:05 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:06:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:06:06 - XML: Start document: iteration 9
Sat 18 Jan 2014 19:06:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:06:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:06:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43009553
Sat 18 Jan 2014 19:06:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:06:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:06:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:06:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:06:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:06:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:06:24 - XML: Processed 646606 elements - found 0 jobs
Sat 18 Jan 2014 19:06:24 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:06:24 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:06:24 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:06:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:06:24 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:06:24 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:06:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:06:24 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:06:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:06:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:06:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:06:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:06:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:06:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:06:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:06:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:06:26 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:06:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 19:06:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 19:06:26 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:06:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5903 values 93098 bits 11637 bytes 
Sat 18 Jan 2014 19:06:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:06:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:06:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:06:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:06:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:06:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:06:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:06:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:06:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:06:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43165456
Sat 18 Jan 2014 19:06:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:06:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43165456
Sat 18 Jan 2014 19:06:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:06:39 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:06:39 - job_xml_thread(): Done retrieving: data size 43165456
Sat 18 Jan 2014 19:06:39 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:06:39 - XML: Start document: iteration 10
Sat 18 Jan 2014 19:06:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:06:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:06:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:06:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:06:43 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:06:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 19:06:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:06:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:06:44 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:06:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:06:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:06:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:06:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:06:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:06:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:06:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:06:52 - XML: Processed 648206 elements - found 0 jobs
Sat 18 Jan 2014 19:06:52 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:06:52 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:06:52 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:06:52 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:06:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:06:53 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:06:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:06:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:06:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:06:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:06:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:06:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:06:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:06:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43598670
Sat 18 Jan 2014 19:06:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:06:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43598670
Sat 18 Jan 2014 19:06:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:07:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:07:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:07:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:07:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:07:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:07:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:07:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:07:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:07:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:07:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:07:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43598670
Sat 18 Jan 2014 19:07:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:07:07 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:07:07 - job_xml_thread(): Done retrieving: data size 43598670
Sat 18 Jan 2014 19:07:07 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:07:07 - XML: Start document: iteration 11
Sat 18 Jan 2014 19:07:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:07:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:07:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:07:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:07:22 - XML: Processed 653830 elements - found 0 jobs
Sat 18 Jan 2014 19:07:22 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:07:22 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:07:22 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:07:22 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:07:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:07:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:07:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:07:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:07:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:07:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:07:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:07:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:07:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:07:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:07:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:07:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:07:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:07:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:07:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:07:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:07:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:07:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:07:26 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:07:27 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:07:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:07:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 19:07:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 19:07:27 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:07:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6169 values 97290 bits 12161 bytes 
Sat 18 Jan 2014 19:07:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:07:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43646393
Sat 18 Jan 2014 19:07:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:07:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43646393
Sat 18 Jan 2014 19:07:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:07:37 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:07:37 - job_xml_thread(): Done retrieving: data size 43646393
Sat 18 Jan 2014 19:07:37 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:07:38 - XML: Start document: iteration 12
Sat 18 Jan 2014 19:07:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:07:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:07:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:07:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:07:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:07:46 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:07:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:07:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:07:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:07:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:07:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:07:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:07:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:07:49 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 19:07:49 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:07:49 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:07:49 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:07:49 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:07:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:07:54 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:07:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:07:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:07:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:07:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:07:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:07:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:07:56 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:07:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 19:07:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:07:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:07:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43628512
Sat 18 Jan 2014 19:07:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:07:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43628512
Sat 18 Jan 2014 19:07:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:08:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:08:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:08:04 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:08:05 - job_xml_thread(): Done retrieving: data size 43628512
Sat 18 Jan 2014 19:08:05 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:08:05 - XML: Start document: iteration 13
Sat 18 Jan 2014 19:08:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:08:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:08:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:08:15 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:08:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:08:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:08:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:08:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:08:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:08:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:08:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:08:17 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 19:08:17 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:08:17 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:08:17 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:08:17 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:08:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:08:20 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:08:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:08:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:08:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:08:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:08:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:08:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:08:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:08:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43632877
Sat 18 Jan 2014 19:08:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:08:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43632877
Sat 18 Jan 2014 19:08:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:08:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:08:27 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:08:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:08:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 19:08:28 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:08:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 19:08:28 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:08:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7919 values 124860 bits 15607 bytes 
Sat 18 Jan 2014 19:08:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:08:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:08:32 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:08:32 - job_xml_thread(): Done retrieving: data size 43632877
Sat 18 Jan 2014 19:08:32 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:08:32 - XML: Start document: iteration 14
Sat 18 Jan 2014 19:08:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:08:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:08:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:08:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:08:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:08:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:08:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:08:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:08:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:08:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:08:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:08:43 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 19:08:43 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:08:43 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:08:43 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:08:43 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:08:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:08:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:08:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:08:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:08:47 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 19:08:47 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 19:08:47 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:08:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:08:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:08:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:08:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:08:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:08:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43603011
Sat 18 Jan 2014 19:08:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:08:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43603011
Sat 18 Jan 2014 19:08:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:08:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:08:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:08:58 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:08:58 - job_xml_thread(): Done retrieving: data size 43603011
Sat 18 Jan 2014 19:08:58 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:08:58 - XML: Start document: iteration 15
Sat 18 Jan 2014 19:08:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:08:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:08:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:08:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:09:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:09:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:09:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:09:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:09:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:09:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:09:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:09:06 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:09:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 19:09:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:09:10 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 19:09:10 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:09:10 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:09:10 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:09:10 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:09:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:09:12 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:09:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:09:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:09:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:09:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:09:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:09:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:09:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:09:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43620529
Sat 18 Jan 2014 19:09:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:09:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43620529
Sat 18 Jan 2014 19:09:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:09:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:09:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:09:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:09:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:09:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:09:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:09:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:09:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:09:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:09:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:09:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:09:25 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:09:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:09:27 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:09:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:09:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:09:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:09:28 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:09:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:09:29 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:09:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 19:09:29 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:09:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6105 values 96261 bits 12032 bytes 
Sat 18 Jan 2014 19:09:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 19:09:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:09:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:09:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:09:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:09:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:09:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43639976
Sat 18 Jan 2014 19:09:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:09:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43639976
Sat 18 Jan 2014 19:09:31 - job_xml_thread(): Done retrieving: data size 43639976
Sat 18 Jan 2014 19:09:31 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:09:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:09:31 - XML: Start document: iteration 16
Sat 18 Jan 2014 19:09:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:09:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:09:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:09:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:09:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:09:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:09:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:09:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:09:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:09:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:09:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:09:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:09:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:09:49 - XML: Processed 654193 elements - found 0 jobs
Sat 18 Jan 2014 19:09:49 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:09:49 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:09:49 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:09:49 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:09:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:09:53 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:09:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:09:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:09:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:09:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:09:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:09:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:09:55 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:09:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 19:09:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:09:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:09:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43620360
Sat 18 Jan 2014 19:09:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:09:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43620360
Sat 18 Jan 2014 19:09:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:09:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:09:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:10:04 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:10:04 - job_xml_thread(): Done retrieving: data size 43620360
Sat 18 Jan 2014 19:10:04 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:10:04 - XML: Start document: iteration 17
Sat 18 Jan 2014 19:10:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:10:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:10:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:10:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:10:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:10:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:10:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:10:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:10:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:10:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:10:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:10:17 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 19:10:17 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:10:17 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:10:18 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:10:18 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:10:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:10:18 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:10:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:10:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:10:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:10:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:10:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:10:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:10:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:10:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43614131
Sat 18 Jan 2014 19:10:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:10:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43614131
Sat 18 Jan 2014 19:10:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:10:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:10:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:10:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:10:29 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:10:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:10:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:10:30 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:10:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 19:10:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 19:10:30 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:10:30 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:10:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:10:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:10:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7335 values 115651 bits 14456 bytes 
Sat 18 Jan 2014 19:10:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:10:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:10:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:10:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43614131
Sat 18 Jan 2014 19:10:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:10:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:10:33 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:10:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:10:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:10:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:10:37 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 19:10:37 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:10:38 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:10:38 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 19:10:38 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 19:10:38 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:10:38 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 19:10:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:10:42 - ganglia_parse_thread(): finished: Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sat 18 Jan 2014 19:10:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:10:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:10:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:10:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:10:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:10:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:10:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:10:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:10:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:10:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:10:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:10:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:10:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:10:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:10:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:10:50 - job_xml_thread(): Done retrieving: data size 43603699
Sat 18 Jan 2014 19:10:50 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:10:50 - XML: Start document: iteration 18
Sat 18 Jan 2014 19:10:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43603699
Sat 18 Jan 2014 19:10:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:10:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43603699
Sat 18 Jan 2014 19:10:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:11:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:11:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:11:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:11:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:11:03 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:11:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 19:11:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:11:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:11:07 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:11:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:11:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:11:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:11:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:11:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:11:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:11:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:11:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:11:10 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:11:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:11:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:11:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:11:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:11:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:11:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:11:13 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 19:11:13 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:11:13 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:11:13 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:11:13 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:11:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:11:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557494
Sat 18 Jan 2014 19:11:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:11:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557494
Sat 18 Jan 2014 19:11:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:11:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:11:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:11:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:11:26 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:11:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:11:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:11:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:11:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:11:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:11:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:11:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:11:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:11:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:11:28 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:11:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:11:29 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:11:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:11:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:11:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:11:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:11:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:11:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:11:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:11:30 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:11:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:11:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43200434
Sat 18 Jan 2014 19:11:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:11:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43200434
Sat 18 Jan 2014 19:11:31 - job_xml_thread(): Done retrieving: data size 43200434
Sat 18 Jan 2014 19:11:31 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:11:31 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:11:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:11:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:11:31 - XML: Start document: iteration 19
Sat 18 Jan 2014 19:11:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 19:11:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 19:11:31 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:11:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6359 values 100310 bits 12538 bytes 
Sat 18 Jan 2014 19:11:39 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:11:39 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:11:40 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:11:40 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 19:11:40 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:11:40 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 19:11:40 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 19:11:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:11:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:11:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:11:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:11:47 - size of cluster 'LISA Cluster': 624 hosts 79472 metrics 795418 values 12538222 bits 1567277 bytes 
Sat 18 Jan 2014 19:11:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:11:51 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:11:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:11:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:11:54 - XML: Processed 648860 elements - found 0 jobs
Sat 18 Jan 2014 19:11:54 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:11:54 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:11:54 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:11:54 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:11:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:11:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:11:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:11:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:11:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:11:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:11:54 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:11:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:11:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:11:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:11:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:11:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:11:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:12:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:12:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42988627
Sat 18 Jan 2014 19:12:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:12:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42988627
Sat 18 Jan 2014 19:12:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:12:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:12:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:12:09 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:12:09 - job_xml_thread(): Done retrieving: data size 42988627
Sat 18 Jan 2014 19:12:09 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:12:09 - XML: Start document: iteration 20
Sat 18 Jan 2014 19:12:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:12:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:12:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:12:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:12:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:12:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:12:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:12:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:12:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:12:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:12:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:12:22 - XML: Processed 645996 elements - found 0 jobs
Sat 18 Jan 2014 19:12:22 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:12:22 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:12:22 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:12:22 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:12:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:12:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:12:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:12:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:12:25 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:12:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 19:12:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:12:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:12:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:12:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:12:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:12:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:12:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43055980
Sat 18 Jan 2014 19:12:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:12:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43055980
Sat 18 Jan 2014 19:12:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:12:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:12:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:12:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:12:32 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:12:33 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:12:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:12:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 19:12:33 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:12:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5600 values 88254 bits 11031 bytes 
Sat 18 Jan 2014 19:12:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 19:12:37 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:12:37 - job_xml_thread(): Done retrieving: data size 43055980
Sat 18 Jan 2014 19:12:37 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:12:37 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 19:12:37 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 19:12:37 - Housekeeping: done.
Sat 18 Jan 2014 19:12:37 - XML: Start document: iteration 0
Sat 18 Jan 2014 19:12:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:12:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:12:41 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:12:41 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 19:12:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:12:48 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:12:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:12:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:12:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:12:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:12:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:12:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:12:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:12:51 - XML: Processed 647159 elements - found 0 jobs
Sat 18 Jan 2014 19:12:51 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:12:51 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:12:51 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:12:51 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:12:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:12:52 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:12:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:12:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:12:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:12:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:12:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:12:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:12:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:12:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570318
Sat 18 Jan 2014 19:12:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:12:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570318
Sat 18 Jan 2014 19:12:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:13:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:13:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:13:06 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:13:06 - job_xml_thread(): Done retrieving: data size 43570318
Sat 18 Jan 2014 19:13:06 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:13:06 - XML: Start document: iteration 1
Sat 18 Jan 2014 19:13:07 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:13:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 19:13:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:13:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:13:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:13:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:13:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:13:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:13:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:13:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:13:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:13:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:13:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:13:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:13:21 - XML: Processed 653286 elements - found 0 jobs
Sat 18 Jan 2014 19:13:21 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:13:21 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:13:21 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:13:21 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:13:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:13:23 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:13:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:13:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:13:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:13:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:13:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:13:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:13:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:13:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:13:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:13:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43612334
Sat 18 Jan 2014 19:13:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:13:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43612334
Sat 18 Jan 2014 19:13:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:13:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:13:34 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:13:35 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:13:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:13:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 19:13:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 19:13:35 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:13:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6160 values 97133 bits 12141 bytes 
Sat 18 Jan 2014 19:13:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:13:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:13:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:13:36 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:13:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:13:36 - job_xml_thread(): Done retrieving: data size 43612334
Sat 18 Jan 2014 19:13:36 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:13:36 - XML: Start document: iteration 2
Sat 18 Jan 2014 19:13:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:13:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:13:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:13:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:13:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:13:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:13:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:13:50 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 19:13:50 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:13:50 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:13:50 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:13:50 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:13:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:13:50 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:13:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:13:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:13:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:13:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:13:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:13:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:13:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:13:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:13:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:13:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43599625
Sat 18 Jan 2014 19:13:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:13:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43599625
Sat 18 Jan 2014 19:13:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:14:05 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:14:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:14:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:14:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:14:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:14:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:14:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:14:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:14:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:14:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:14:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:14:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:14:08 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:14:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 19:14:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:14:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:14:12 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:14:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:14:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:14:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:14:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:14:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:14:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:14:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:14:15 - job_xml_thread(): Done retrieving: data size 43631281
Sat 18 Jan 2014 19:14:15 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:14:15 - XML: Start document: iteration 3
Sat 18 Jan 2014 19:14:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43631281
Sat 18 Jan 2014 19:14:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:14:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43631281
Sat 18 Jan 2014 19:14:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:14:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:14:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:14:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:14:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:14:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:14:32 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:14:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:14:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:14:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:14:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:14:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:14:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:14:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:14:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:14:35 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:14:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:14:36 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 19:14:36 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:14:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 19:14:36 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:14:36 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:14:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 19:14:36 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:14:36 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:14:36 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:14:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5852 values 92254 bits 11531 bytes 
Sat 18 Jan 2014 19:14:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:14:39 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:14:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:14:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:14:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:14:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:14:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:14:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:14:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:14:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43645161
Sat 18 Jan 2014 19:14:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:14:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43645161
Sat 18 Jan 2014 19:14:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:14:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:14:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:14:51 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:14:51 - job_xml_thread(): Done retrieving: data size 43645161
Sat 18 Jan 2014 19:14:51 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:14:51 - XML: Start document: iteration 4
Sat 18 Jan 2014 19:14:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:14:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:14:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:14:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:14:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:14:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:14:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:14:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:14:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:14:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:14:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:15:07 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 19:15:07 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:15:07 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:15:07 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:15:07 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:15:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:15:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:15:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:15:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:15:08 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:15:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 19:15:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:15:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:15:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:15:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:15:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:15:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:15:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43627705
Sat 18 Jan 2014 19:15:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:15:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43627705
Sat 18 Jan 2014 19:15:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:15:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:15:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:15:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:15:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:15:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:15:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:15:22 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:15:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:15:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:15:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:15:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:15:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:15:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:15:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:15:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:15:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:15:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:15:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:15:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:15:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:15:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:15:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:15:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:15:30 - job_xml_thread(): Done retrieving: data size 43646442
Sat 18 Jan 2014 19:15:30 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:15:30 - XML: Start document: iteration 5
Sat 18 Jan 2014 19:15:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43646442
Sat 18 Jan 2014 19:15:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43646442
Sat 18 Jan 2014 19:15:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:15:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:15:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:15:36 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:15:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:15:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 19:15:37 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:15:37 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:15:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 19:15:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9130 values 143981 bits 17997 bytes 
Sat 18 Jan 2014 19:15:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:15:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:15:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:15:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:15:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:15:42 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:15:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:15:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:15:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:15:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:15:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:15:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:15:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:15:48 - XML: Processed 654195 elements - found 0 jobs
Sat 18 Jan 2014 19:15:48 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:15:48 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:15:48 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:15:48 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:15:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:15:53 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:15:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:15:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:15:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:15:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:15:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:15:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:15:53 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 19:15:53 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 19:15:53 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:15:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:15:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43626070
Sat 18 Jan 2014 19:15:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:15:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43626070
Sat 18 Jan 2014 19:15:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:15:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:15:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:16:04 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:16:04 - job_xml_thread(): Done retrieving: data size 43626070
Sat 18 Jan 2014 19:16:04 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:16:04 - XML: Start document: iteration 6
Sat 18 Jan 2014 19:16:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:16:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:16:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:16:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:16:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:16:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:16:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:16:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:16:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:16:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:16:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:16:16 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:16:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 19:16:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:16:16 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 19:16:16 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:16:16 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:16:16 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:16:16 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:16:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:16:19 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:16:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:16:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:16:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:16:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:16:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:16:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:16:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:16:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43614465
Sat 18 Jan 2014 19:16:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:16:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43614465
Sat 18 Jan 2014 19:16:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:16:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:16:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:16:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:16:31 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:16:31 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:16:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:16:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:16:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:16:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:16:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:16:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:16:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:16:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:16:34 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:16:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:16:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:16:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:16:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:16:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:16:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:16:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:16:36 - job_xml_thread(): Done retrieving: data size 43636868
Sat 18 Jan 2014 19:16:36 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:16:36 - XML: Start document: iteration 7
Sat 18 Jan 2014 19:16:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43636868
Sat 18 Jan 2014 19:16:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:16:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:16:38 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:16:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43636868
Sat 18 Jan 2014 19:16:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:16:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:16:40 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:16:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 19:16:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 19:16:40 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:16:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5910 values 93262 bits 11657 bytes 
Sat 18 Jan 2014 19:16:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:16:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:16:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:16:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:16:52 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 19:16:52 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:16:52 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:16:52 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:16:52 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:16:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:16:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:16:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:16:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:16:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:16:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:16:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:16:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:16:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:16:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:16:59 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:16:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:16:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:17:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:17:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:17:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:17:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:17:01 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:17:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 19:17:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:17:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:17:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43649988
Sat 18 Jan 2014 19:17:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:17:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43649988
Sat 18 Jan 2014 19:17:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:17:07 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:17:07 - job_xml_thread(): Done retrieving: data size 43649988
Sat 18 Jan 2014 19:17:07 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:17:07 - XML: Start document: iteration 8
Sat 18 Jan 2014 19:17:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:17:15 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:17:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:17:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:17:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:17:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:17:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:17:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:17:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:17:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:17:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:17:21 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 19:17:21 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:17:21 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:17:21 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:17:21 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:17:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:17:23 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:17:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:17:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:17:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:17:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:17:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:17:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:17:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:17:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577629
Sat 18 Jan 2014 19:17:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:17:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577629
Sat 18 Jan 2014 19:17:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:17:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:17:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:17:36 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:17:36 - job_xml_thread(): Done retrieving: data size 43577629
Sat 18 Jan 2014 19:17:36 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:17:36 - XML: Start document: iteration 9
Sat 18 Jan 2014 19:17:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:17:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:17:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:17:40 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:17:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:17:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 19:17:41 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:17:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6281 values 99396 bits 12424 bytes 
Sat 18 Jan 2014 19:17:42 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:17:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 19:17:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:17:42 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:17:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:17:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:17:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:17:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:17:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:17:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:17:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:17:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:17:46 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:17:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:17:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:17:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:17:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:17:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:17:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:17:49 - XML: Processed 653448 elements - found 0 jobs
Sat 18 Jan 2014 19:17:49 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:17:49 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:17:49 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:17:49 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:17:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:17:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43023610
Sat 18 Jan 2014 19:17:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:17:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43023610
Sat 18 Jan 2014 19:17:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:17:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:17:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:18:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:18:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:18:04 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:18:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:18:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:18:07 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:18:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:18:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:18:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:18:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:18:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:18:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:18:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:18:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:18:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:18:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:18:09 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:18:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 19:18:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:18:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:18:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:18:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:18:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:18:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:18:11 - job_xml_thread(): Done retrieving: data size 42984931
Sat 18 Jan 2014 19:18:11 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:18:11 - XML: Start document: iteration 10
Sat 18 Jan 2014 19:18:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42984931
Sat 18 Jan 2014 19:18:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:18:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42984931
Sat 18 Jan 2014 19:18:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:18:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:18:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:18:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:18:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:18:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:18:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:18:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:18:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:18:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:18:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:18:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:18:27 - XML: Processed 645996 elements - found 0 jobs
Sat 18 Jan 2014 19:18:27 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:18:27 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:18:27 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:18:27 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:18:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:18:32 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:18:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:18:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:18:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:18:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:18:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:18:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:18:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:18:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43465277
Sat 18 Jan 2014 19:18:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:18:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43465277
Sat 18 Jan 2014 19:18:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:18:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:18:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:18:41 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 19:18:41 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:18:42 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:18:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:18:42 - job_xml_thread(): Done retrieving: data size 43465277
Sat 18 Jan 2014 19:18:42 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:18:42 - XML: Start document: iteration 11
Sat 18 Jan 2014 19:18:42 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:18:42 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:18:42 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 19:18:42 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:18:42 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 19:18:42 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 19:18:44 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:18:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:18:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 19:18:44 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:18:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 19:18:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8846 values 139830 bits 17478 bytes 
Sat 18 Jan 2014 19:18:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:18:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:18:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:18:51 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:18:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:18:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:18:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:18:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:18:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:18:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:18:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:18:54 - XML: Processed 652408 elements - found 0 jobs
Sat 18 Jan 2014 19:18:54 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:18:54 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:18:54 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:18:54 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:18:54 - size of cluster 'LISA Cluster': 624 hosts 79466 metrics 759558 values 12002614 bits 1500326 bytes 
Sat 18 Jan 2014 19:19:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:19:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:19:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:19:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:19:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:19:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:19:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:19:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:19:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:19:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43604005
Sat 18 Jan 2014 19:19:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:19:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43604005
Sat 18 Jan 2014 19:19:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:19:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:19:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:19:09 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:19:09 - job_xml_thread(): Done retrieving: data size 43604005
Sat 18 Jan 2014 19:19:09 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:19:09 - XML: Start document: iteration 12
Sat 18 Jan 2014 19:19:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:19:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:19:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:19:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:19:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:19:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:19:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:19:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:19:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:19:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:19:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:19:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:19:28 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:19:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:19:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:19:29 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 19:19:29 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:19:29 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:19:29 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:19:29 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:19:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:19:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:19:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:19:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:19:29 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:19:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 19:19:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:19:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:19:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43630729
Sat 18 Jan 2014 19:19:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:19:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43630729
Sat 18 Jan 2014 19:19:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:19:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:19:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:19:43 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:19:43 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 19:19:44 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:19:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:19:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:19:44 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:19:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:19:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:19:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:19:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:19:44 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:19:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:19:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:19:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:19:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:19:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:19:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:19:46 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:19:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 19:19:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 19:19:46 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:19:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5862 values 92495 bits 11561 bytes 
Sat 18 Jan 2014 19:19:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:19:48 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:19:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:19:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:19:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:19:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:19:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:19:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:19:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:19:53 - job_xml_thread(): Done retrieving: data size 43615498
Sat 18 Jan 2014 19:19:53 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:19:53 - XML: Start document: iteration 13
Sat 18 Jan 2014 19:19:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43615498
Sat 18 Jan 2014 19:19:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:19:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43615498
Sat 18 Jan 2014 19:19:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:20:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:20:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:20:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:20:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:20:09 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:20:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 19:20:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:20:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:20:11 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:20:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:20:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:20:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:20:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:20:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:20:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:20:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:20:13 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 19:20:13 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:20:13 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:20:13 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:20:14 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:20:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:20:19 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:20:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:20:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:20:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:20:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:20:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:20:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:20:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:20:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43612341
Sat 18 Jan 2014 19:20:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:20:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43612341
Sat 18 Jan 2014 19:20:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:20:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:20:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:20:29 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:20:29 - job_xml_thread(): Done retrieving: data size 43612341
Sat 18 Jan 2014 19:20:30 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:20:30 - XML: Start document: iteration 14
Sat 18 Jan 2014 19:20:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:20:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:20:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:20:41 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:20:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:20:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:20:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:20:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:20:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:20:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:20:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:20:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:20:43 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:20:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:20:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:20:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:20:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:20:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:20:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:20:44 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 19:20:44 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:20:44 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:20:44 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:20:44 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:20:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:20:46 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:20:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:20:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 19:20:46 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:20:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 19:20:46 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:20:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6078 values 95892 bits 11986 bytes 
Sat 18 Jan 2014 19:20:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:20:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43621589
Sat 18 Jan 2014 19:20:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:20:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43621589
Sat 18 Jan 2014 19:20:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:20:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:20:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:20:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:20:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:20:59 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:20:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:21:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:21:00 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:21:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:21:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:21:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:21:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:21:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:21:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:21:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:21:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:21:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:21:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:21:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:21:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:21:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:21:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:21:06 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:21:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 19:21:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:21:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:21:08 - job_xml_thread(): Done retrieving: data size 43628086
Sat 18 Jan 2014 19:21:08 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:21:08 - XML: Start document: iteration 15
Sat 18 Jan 2014 19:21:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43628086
Sat 18 Jan 2014 19:21:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:21:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43628086
Sat 18 Jan 2014 19:21:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:21:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:21:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:21:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:21:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:21:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:21:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:21:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:21:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:21:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:21:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:21:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:21:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:21:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:21:30 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 19:21:30 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:21:30 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:21:30 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:21:30 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:21:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:21:31 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:21:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:21:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:21:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:21:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:21:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:21:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:21:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:21:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43628656
Sat 18 Jan 2014 19:21:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:21:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43628656
Sat 18 Jan 2014 19:21:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:21:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:21:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:21:45 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:21:45 - job_xml_thread(): Done retrieving: data size 43628656
Sat 18 Jan 2014 19:21:45 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:21:45 - XML: Start document: iteration 16
Sat 18 Jan 2014 19:21:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:21:46 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:21:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:21:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 19:21:47 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:21:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:21:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:21:47 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:21:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7852 values 123805 bits 15475 bytes 
Sat 18 Jan 2014 19:21:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 19:21:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:21:51 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:21:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:21:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:21:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:21:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:21:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:21:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:21:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:21:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:21:53 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:21:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:21:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:21:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:21:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:21:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:21:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:21:57 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 19:21:57 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:21:57 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:21:57 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:21:57 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:22:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:22:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43633754
Sat 18 Jan 2014 19:22:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:22:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43633754
Sat 18 Jan 2014 19:22:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:22:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:22:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:22:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:22:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:22:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:22:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:22:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:22:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:22:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:22:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:22:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:22:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43633754
Sat 18 Jan 2014 19:22:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:22:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:22:12 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:22:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:22:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:22:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:22:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:22:23 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:22:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:22:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:22:23 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:22:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 19:22:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:22:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:22:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:22:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:22:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:22:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:22:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:22:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:22:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:22:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:22:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:22:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:22:26 - job_xml_thread(): Done retrieving: data size 43626601
Sat 18 Jan 2014 19:22:26 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:22:26 - XML: Start document: iteration 17
Sat 18 Jan 2014 19:22:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43626601
Sat 18 Jan 2014 19:22:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:22:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43626601
Sat 18 Jan 2014 19:22:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:22:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:22:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:22:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:22:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:22:46 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 19:22:46 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:22:46 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:22:46 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:22:46 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:22:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:22:47 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:22:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:22:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:22:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:22:47 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:22:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:22:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:22:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:22:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:22:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:22:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:22:48 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:22:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 19:22:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 19:22:48 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:22:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5729 values 90322 bits 11290 bytes 
Sat 18 Jan 2014 19:22:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:22:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:22:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:22:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:22:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:22:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:22:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:22:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:22:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:22:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43650284
Sat 18 Jan 2014 19:22:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:22:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43650284
Sat 18 Jan 2014 19:22:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:23:01 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:23:01 - job_xml_thread(): Done retrieving: data size 43650284
Sat 18 Jan 2014 19:23:01 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:23:01 - XML: Start document: iteration 18
Sat 18 Jan 2014 19:23:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:23:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:23:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:23:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:23:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:23:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:23:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:23:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:23:10 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:23:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 19:23:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:23:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:23:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:23:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:23:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:23:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:23:16 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 19:23:16 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:23:16 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:23:16 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:23:16 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:23:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:23:19 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:23:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:23:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:23:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:23:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:23:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:23:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:23:22 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 19:23:22 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 19:23:22 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:23:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:23:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43546255
Sat 18 Jan 2014 19:23:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:23:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43546255
Sat 18 Jan 2014 19:23:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:23:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:23:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:23:31 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:23:31 - job_xml_thread(): Done retrieving: data size 43546255
Sat 18 Jan 2014 19:23:32 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:23:32 - XML: Start document: iteration 19
Sat 18 Jan 2014 19:23:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:23:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:23:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:23:39 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:23:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:23:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:23:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:23:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:23:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:23:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:23:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:23:44 - XML: Processed 653448 elements - found 0 jobs
Sat 18 Jan 2014 19:23:44 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:23:44 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:23:44 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:23:44 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:23:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:23:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:23:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:23:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:23:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:23:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:23:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:23:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:23:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:23:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43005873
Sat 18 Jan 2014 19:23:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:23:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43005873
Sat 18 Jan 2014 19:23:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:23:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:23:49 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:23:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:23:50 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:23:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 19:23:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 19:23:50 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:23:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9201 values 145136 bits 18142 bytes 
Sat 18 Jan 2014 19:23:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:23:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:23:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:23:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:23:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:23:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:23:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:23:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:23:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:23:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:23:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:23:59 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:24:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:24:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:24:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:24:01 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:24:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:24:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:24:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:24:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:24:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:24:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:24:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:24:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42964080
Sat 18 Jan 2014 19:24:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:24:04 - job_xml_thread(): Done retrieving: data size 42964080
Sat 18 Jan 2014 19:24:04 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:24:04 - XML: Start document: iteration 20
Sat 18 Jan 2014 19:24:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42964080
Sat 18 Jan 2014 19:24:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:24:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:24:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:24:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:24:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:24:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:24:24 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:24:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:24:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:24:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:24:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:24:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:24:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:24:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:24:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:24:27 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:24:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:24:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:24:27 - XML: Processed 645996 elements - found 0 jobs
Sat 18 Jan 2014 19:24:27 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:24:27 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:24:27 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:24:27 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:24:28 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:24:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 19:24:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:24:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:24:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:24:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:24:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:24:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:24:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43180497
Sat 18 Jan 2014 19:24:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:24:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43180497
Sat 18 Jan 2014 19:24:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:24:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:24:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:24:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:24:42 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:24:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:24:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:24:42 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:24:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:24:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:24:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:24:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:24:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:24:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:24:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:24:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:24:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:24:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:24:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:24:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:24:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:24:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:24:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:24:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:24:49 - job_xml_thread(): Done retrieving: data size 43568551
Sat 18 Jan 2014 19:24:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568551
Sat 18 Jan 2014 19:24:49 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:24:49 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 19:24:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:24:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568551
Sat 18 Jan 2014 19:24:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:24:50 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 19:24:50 - Housekeeping: done.
Sat 18 Jan 2014 19:24:50 - XML: Start document: iteration 0
Sat 18 Jan 2014 19:24:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:24:51 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:24:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:24:52 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:24:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 19:24:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 19:24:52 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:24:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8190 values 129175 bits 16146 bytes 
Sat 18 Jan 2014 19:24:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:24:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:25:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:25:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:25:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:25:10 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:25:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:25:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:25:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:25:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:25:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:25:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:25:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:25:12 - XML: Processed 653568 elements - found 0 jobs
Sat 18 Jan 2014 19:25:12 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:25:12 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:25:12 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:25:12 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:25:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:25:14 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:25:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:25:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:25:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:25:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:25:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:25:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:25:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:25:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43616756
Sat 18 Jan 2014 19:25:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:25:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43616756
Sat 18 Jan 2014 19:25:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:25:22 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:25:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 19:25:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:25:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:25:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:25:27 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:25:27 - job_xml_thread(): Done retrieving: data size 43616756
Sat 18 Jan 2014 19:25:27 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:25:27 - XML: Start document: iteration 1
Sat 18 Jan 2014 19:25:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:25:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:25:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:25:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:25:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:25:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:25:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:25:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:25:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:25:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:25:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:25:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:25:35 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:25:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:25:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:25:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:25:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:25:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:25:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:25:39 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 19:25:39 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:25:39 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:25:39 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:25:39 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:25:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:25:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43621260
Sat 18 Jan 2014 19:25:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:25:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43621260
Sat 18 Jan 2014 19:25:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:25:43 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 19:25:44 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:25:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:25:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:25:45 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:25:45 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 19:25:45 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 19:25:45 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:25:45 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 19:25:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:25:51 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:25:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:25:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:25:52 - size of cluster 'LISA Cluster': 624 hosts 79474 metrics 752418 values 11871996 bits 1483999 bytes 
Sat 18 Jan 2014 19:25:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:25:53 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:25:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:25:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:25:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:25:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:25:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:25:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:25:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:25:53 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:25:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:25:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 19:25:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 19:25:53 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:25:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6251 values 98580 bits 12322 bytes 
Sat 18 Jan 2014 19:25:54 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:25:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:25:57 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:25:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:25:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:25:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:25:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:25:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:25:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:26:03 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:26:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 19:26:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:26:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:26:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43607624
Sat 18 Jan 2014 19:26:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:26:04 - job_xml_thread(): Done retrieving: data size 43607624
Sat 18 Jan 2014 19:26:04 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:26:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43607624
Sat 18 Jan 2014 19:26:04 - XML: Start document: iteration 2
Sat 18 Jan 2014 19:26:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:26:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:26:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:26:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:26:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:26:16 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 19:26:16 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:26:16 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:26:16 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:26:16 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:26:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:26:20 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:26:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:26:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:26:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:26:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:26:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:26:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:26:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:26:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:26:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:26:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:26:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:26:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:26:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:26:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:26:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:26:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:26:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43650914
Sat 18 Jan 2014 19:26:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:26:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43650914
Sat 18 Jan 2014 19:26:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:26:32 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:26:32 - job_xml_thread(): Done retrieving: data size 43650914
Sat 18 Jan 2014 19:26:32 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:26:32 - XML: Start document: iteration 3
Sat 18 Jan 2014 19:26:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:26:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:26:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:26:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:26:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:26:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:26:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:26:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:26:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43650914
Sat 18 Jan 2014 19:26:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:26:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:26:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:26:46 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:26:46 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 19:26:53 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 19:26:53 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:26:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:26:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:26:53 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:26:53 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:26:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:26:53 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:26:53 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:26:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:26:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:26:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:26:54 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:26:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:26:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:26:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:26:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:26:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:26:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:26:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 19:26:54 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:26:54 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:26:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 19:26:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99036 bits 12379 bytes 
Sat 18 Jan 2014 19:26:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:26:58 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:26:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:26:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:26:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:26:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:26:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:26:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:27:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:27:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43616049
Sat 18 Jan 2014 19:27:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:27:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43616049
Sat 18 Jan 2014 19:27:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:27:08 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:27:08 - job_xml_thread(): Done retrieving: data size 43616049
Sat 18 Jan 2014 19:27:08 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:27:08 - XML: Start document: iteration 4
Sat 18 Jan 2014 19:27:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:27:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:27:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:27:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:27:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:27:25 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:27:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:27:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:27:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:27:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:27:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:27:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:27:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:27:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:27:27 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:27:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:27:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:27:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:27:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:27:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:27:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:27:28 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:27:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 19:27:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:27:29 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 19:27:29 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:27:29 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:27:29 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:27:29 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:27:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:27:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43621445
Sat 18 Jan 2014 19:27:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:27:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43621445
Sat 18 Jan 2014 19:27:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:27:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:27:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:27:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:27:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:27:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:27:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:27:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43621445
Sat 18 Jan 2014 19:27:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:27:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:27:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:27:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:27:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:27:44 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:27:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:27:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:27:51 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:27:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:27:55 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:27:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:27:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:27:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:27:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 19:27:55 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:27:55 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:27:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 19:27:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:27:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6062 values 95608 bits 11951 bytes 
Sat 18 Jan 2014 19:27:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:27:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:27:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:27:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:27:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:27:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:27:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:27:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:27:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:27:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:27:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:27:59 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:27:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:27:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 19:27:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:27:59 - job_xml_thread(): Done retrieving: data size 43620055
Sat 18 Jan 2014 19:27:59 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:27:59 - XML: Start document: iteration 5
Sat 18 Jan 2014 19:27:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43620055
Sat 18 Jan 2014 19:27:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43620055
Sat 18 Jan 2014 19:27:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:28:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:28:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:28:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:28:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:28:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:28:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:28:14 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:28:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:28:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:28:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:28:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:28:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:28:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:28:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:28:23 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 19:28:23 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:28:23 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:28:23 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:28:23 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:28:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:28:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:28:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:28:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:28:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:28:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:28:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:28:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:28:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:28:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43630552
Sat 18 Jan 2014 19:28:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:28:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43630552
Sat 18 Jan 2014 19:28:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:28:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:28:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:28:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:28:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:28:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:28:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:28:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:28:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:28:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:28:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:28:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:28:39 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:28:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:28:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:28:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:28:42 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:28:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:28:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:28:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:28:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:28:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:28:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:28:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:28:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43638915
Sat 18 Jan 2014 19:28:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:28:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43638915
Sat 18 Jan 2014 19:28:45 - job_xml_thread(): Done retrieving: data size 43638915
Sat 18 Jan 2014 19:28:45 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:28:45 - XML: Start document: iteration 6
Sat 18 Jan 2014 19:28:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:28:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:28:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:28:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:28:55 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:28:56 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:28:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 19:28:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:28:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 19:28:56 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:28:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148585 bits 18573 bytes 
Sat 18 Jan 2014 19:28:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:28:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:29:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:29:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:29:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:29:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:29:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:29:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:29:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:29:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:29:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:29:05 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 19:29:05 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:29:05 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:29:05 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:29:05 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:29:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:29:10 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:29:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:29:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:29:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:29:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:29:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:29:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:29:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:29:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43635105
Sat 18 Jan 2014 19:29:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:29:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43635105
Sat 18 Jan 2014 19:29:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:29:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:29:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:29:20 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:29:20 - job_xml_thread(): Done retrieving: data size 43635105
Sat 18 Jan 2014 19:29:20 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:29:20 - XML: Start document: iteration 7
Sat 18 Jan 2014 19:29:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:29:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:29:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:29:29 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:29:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:29:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:29:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:29:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:29:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:29:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:29:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:29:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:29:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:29:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:29:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:29:37 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 19:29:37 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:29:37 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:29:37 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:29:37 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:29:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:29:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:29:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:29:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:29:38 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:29:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 19:29:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:29:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:29:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43113408
Sat 18 Jan 2014 19:29:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:29:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43113408
Sat 18 Jan 2014 19:29:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:29:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:29:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:29:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:29:50 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:29:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:29:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:29:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:29:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:29:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:29:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:29:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43113408
Sat 18 Jan 2014 19:29:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:29:52 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:29:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:29:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:29:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:29:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:29:56 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:29:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:29:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 19:29:56 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:29:56 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:29:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5797 values 91386 bits 11423 bytes 
Sat 18 Jan 2014 19:29:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 19:30:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:30:03 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:30:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:30:04 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:30:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:30:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:30:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:30:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:30:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:30:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:30:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:30:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:30:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:30:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:30:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:30:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:30:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:30:08 - job_xml_thread(): Done retrieving: data size 42947695
Sat 18 Jan 2014 19:30:08 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:30:08 - XML: Start document: iteration 8
Sat 18 Jan 2014 19:30:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42947695
Sat 18 Jan 2014 19:30:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:30:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42947695
Sat 18 Jan 2014 19:30:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:30:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:30:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:30:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:30:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:30:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:30:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:30:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:30:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:30:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:30:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:30:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:30:29 - XML: Processed 646078 elements - found 0 jobs
Sat 18 Jan 2014 19:30:29 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:30:29 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:30:29 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:30:29 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:30:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:30:30 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:30:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:30:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:30:31 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:30:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 19:30:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:30:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:30:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:30:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:30:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:30:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:30:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43405246
Sat 18 Jan 2014 19:30:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43405246
Sat 18 Jan 2014 19:30:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:30:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:30:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:30:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:30:44 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:30:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:30:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:30:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:30:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:30:47 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:30:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:30:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:30:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:30:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:30:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:30:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:30:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:30:48 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:30:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:30:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:30:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:30:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:30:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:30:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:30:50 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 19:30:50 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 19:30:50 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:30:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:30:50 - job_xml_thread(): Done retrieving: data size 43585423
Sat 18 Jan 2014 19:30:50 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:30:50 - XML: Start document: iteration 9
Sat 18 Jan 2014 19:30:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43585423
Sat 18 Jan 2014 19:30:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:30:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43585423
Sat 18 Jan 2014 19:30:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:30:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:30:56 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:30:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:30:57 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:30:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 19:30:57 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:30:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 19:30:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8670 values 136717 bits 17089 bytes 
Sat 18 Jan 2014 19:31:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:31:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:31:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:31:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:31:06 - XML: Processed 653730 elements - found 0 jobs
Sat 18 Jan 2014 19:31:06 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:31:06 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:31:06 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:31:06 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:31:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:31:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:31:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:31:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:31:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:31:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:31:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:31:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:31:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:31:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:31:12 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:31:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:31:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:31:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:31:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:31:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:31:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:31:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:31:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43638953
Sat 18 Jan 2014 19:31:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:31:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43638953
Sat 18 Jan 2014 19:31:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:31:21 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:31:21 - job_xml_thread(): Done retrieving: data size 43638953
Sat 18 Jan 2014 19:31:22 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:31:22 - XML: Start document: iteration 10
Sat 18 Jan 2014 19:31:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:31:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:31:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:31:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:31:36 - XML: Processed 654194 elements - found 0 jobs
Sat 18 Jan 2014 19:31:36 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:31:36 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:31:36 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:31:36 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:31:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:31:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:31:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:31:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:31:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:31:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:31:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:31:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:31:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:31:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:31:38 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:31:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:31:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:31:39 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:31:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 19:31:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:31:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:31:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:31:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:31:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:31:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:31:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43652914
Sat 18 Jan 2014 19:31:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:31:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43652914
Sat 18 Jan 2014 19:31:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:31:51 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:31:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:31:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:31:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:31:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:31:53 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:31:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:31:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:31:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:31:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:31:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:31:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:31:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:31:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:31:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:31:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:31:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:31:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:31:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:31:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:31:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:31:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:31:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:31:57 - job_xml_thread(): Done retrieving: data size 43656467
Sat 18 Jan 2014 19:31:57 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:31:57 - XML: Start document: iteration 11
Sat 18 Jan 2014 19:31:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:31:58 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:31:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43656467
Sat 18 Jan 2014 19:31:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:31:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:31:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43656467
Sat 18 Jan 2014 19:31:59 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:31:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:31:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 19:31:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 19:31:59 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:32:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5932 values 93704 bits 11713 bytes 
Sat 18 Jan 2014 19:32:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:32:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:32:11 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 19:32:11 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:32:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:32:11 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:32:11 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:32:11 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:32:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:32:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:32:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:32:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:32:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:32:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:32:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:32:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:32:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:32:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:32:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:32:20 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:32:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:32:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:32:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:32:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:32:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:32:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:32:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:32:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43645610
Sat 18 Jan 2014 19:32:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:32:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43645610
Sat 18 Jan 2014 19:32:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:32:26 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:32:26 - job_xml_thread(): Done retrieving: data size 43645610
Sat 18 Jan 2014 19:32:26 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:32:26 - XML: Start document: iteration 12
Sat 18 Jan 2014 19:32:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:32:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:32:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:32:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:32:40 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 19:32:40 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:32:40 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:32:40 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:32:40 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:32:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:32:42 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:32:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:32:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:32:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:32:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:32:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:32:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:32:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:32:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:32:46 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:32:46 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 19:32:46 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:32:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:32:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:32:47 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:32:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 19:32:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:32:47 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:32:47 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 19:32:47 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:32:47 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 19:32:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:32:47 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 19:32:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:32:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:32:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:32:47 - size of cluster 'LISA Cluster': 624 hosts 79486 metrics 758286 values 11974898 bits 1496862 bytes 
Sat 18 Jan 2014 19:32:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:32:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43632392
Sat 18 Jan 2014 19:32:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:32:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43632392
Sat 18 Jan 2014 19:32:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:32:55 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:32:55 - job_xml_thread(): Done retrieving: data size 43632392
Sat 18 Jan 2014 19:32:55 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:32:55 - XML: Start document: iteration 13
Sat 18 Jan 2014 19:32:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:32:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:32:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:33:00 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:33:01 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:33:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 19:33:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:33:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 19:33:01 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:33:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:33:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:33:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5795 values 91638 bits 11454 bytes 
Sat 18 Jan 2014 19:33:07 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 19:33:07 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:33:07 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:33:07 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:33:07 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:33:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:33:11 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:33:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:33:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:33:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:33:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:33:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:33:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:33:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:33:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:33:14 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:33:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:33:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:33:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:33:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:33:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:33:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:33:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:33:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43625320
Sat 18 Jan 2014 19:33:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:33:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43625320
Sat 18 Jan 2014 19:33:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:33:22 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:33:22 - job_xml_thread(): Done retrieving: data size 43625320
Sat 18 Jan 2014 19:33:22 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:33:22 - XML: Start document: iteration 14
Sat 18 Jan 2014 19:33:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:33:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:33:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:33:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:33:32 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 19:33:32 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:33:32 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:33:32 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:33:32 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:33:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:33:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:33:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:33:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:33:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:33:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:33:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:33:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:33:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:33:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:33:42 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:33:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:33:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:33:42 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:33:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 19:33:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:33:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:33:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:33:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:33:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:33:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:33:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43628341
Sat 18 Jan 2014 19:33:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:33:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43628341
Sat 18 Jan 2014 19:33:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:33:47 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:33:47 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:33:47 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 19:33:47 - job_xml_thread(): Done retrieving: data size 43628341
Sat 18 Jan 2014 19:33:47 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:33:47 - XML: Start document: iteration 15
Sat 18 Jan 2014 19:33:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:33:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:33:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:33:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:34:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:34:00 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:34:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:34:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:34:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:34:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:34:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:34:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:34:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:34:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:34:01 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:34:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:34:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 19:34:02 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:34:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 19:34:02 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:34:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5928 values 93601 bits 11700 bytes 
Sat 18 Jan 2014 19:34:03 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 19:34:03 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:34:03 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:34:03 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:34:03 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:34:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:34:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:34:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:34:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:34:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:34:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:34:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:34:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:34:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:34:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43633910
Sat 18 Jan 2014 19:34:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:34:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43633910
Sat 18 Jan 2014 19:34:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:34:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:34:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:34:18 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:34:18 - job_xml_thread(): Done retrieving: data size 43633910
Sat 18 Jan 2014 19:34:18 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:34:18 - XML: Start document: iteration 16
Sat 18 Jan 2014 19:34:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:34:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:34:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:34:24 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:34:24 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:34:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 19:34:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:34:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:34:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:34:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:34:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:34:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:34:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:34:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:34:34 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 19:34:34 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:34:34 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:34:34 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:34:34 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:34:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:34:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:34:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:34:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:34:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:34:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:34:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:34:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:34:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:34:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43622416
Sat 18 Jan 2014 19:34:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:34:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43622416
Sat 18 Jan 2014 19:34:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:34:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:34:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:34:49 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:34:49 - job_xml_thread(): Done retrieving: data size 43622416
Sat 18 Jan 2014 19:34:49 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:34:49 - XML: Start document: iteration 17
Sat 18 Jan 2014 19:34:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:34:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:34:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:34:53 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:34:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:34:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:34:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:34:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:34:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:34:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:34:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:35:01 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 19:35:01 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:35:01 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:35:01 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:35:01 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:35:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:35:03 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:35:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:35:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:35:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:35:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:35:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:35:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 19:35:03 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:35:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 19:35:03 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:35:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5884 values 92822 bits 11602 bytes 
Sat 18 Jan 2014 19:35:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:35:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:35:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:35:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:35:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:35:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43613964
Sat 18 Jan 2014 19:35:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:35:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43613964
Sat 18 Jan 2014 19:35:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:35:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:35:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:35:16 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:35:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:35:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:35:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:35:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:35:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:35:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:35:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:35:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:35:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:35:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:35:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:35:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:35:22 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:35:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:35:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:35:23 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:35:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 19:35:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:35:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:35:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:35:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:35:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:35:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:35:26 - job_xml_thread(): Done retrieving: data size 43564271
Sat 18 Jan 2014 19:35:26 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:35:26 - XML: Start document: iteration 18
Sat 18 Jan 2014 19:35:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564271
Sat 18 Jan 2014 19:35:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:35:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564271
Sat 18 Jan 2014 19:35:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:35:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:35:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:35:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:35:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:35:41 - XML: Processed 653448 elements - found 0 jobs
Sat 18 Jan 2014 19:35:41 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:35:41 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:35:41 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:35:41 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:35:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:35:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:35:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:35:48 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:35:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:35:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:35:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:35:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:35:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:35:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:35:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:35:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:35:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:35:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:35:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:35:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:35:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:35:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:35:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42983246
Sat 18 Jan 2014 19:35:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:35:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42983246
Sat 18 Jan 2014 19:35:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:35:56 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:35:56 - job_xml_thread(): Done retrieving: data size 42983246
Sat 18 Jan 2014 19:35:56 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:35:56 - XML: Start document: iteration 19
Sat 18 Jan 2014 19:36:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:36:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:36:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:36:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:36:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:36:03 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:36:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:36:06 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:36:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 19:36:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 19:36:06 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:36:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8586 values 135410 bits 16926 bytes 
Sat 18 Jan 2014 19:36:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:36:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:36:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:36:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:36:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:36:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:36:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:36:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:36:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:36:12 - XML: Processed 646106 elements - found 0 jobs
Sat 18 Jan 2014 19:36:12 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:36:12 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:36:12 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:36:12 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:36:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:36:16 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:36:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:36:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:36:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:36:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:36:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:36:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:36:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:36:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42999101
Sat 18 Jan 2014 19:36:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:36:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42999101
Sat 18 Jan 2014 19:36:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:36:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:36:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:36:27 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:36:27 - job_xml_thread(): Done retrieving: data size 42999101
Sat 18 Jan 2014 19:36:27 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:36:27 - XML: Start document: iteration 20
Sat 18 Jan 2014 19:36:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:36:31 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:36:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:36:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:36:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:36:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:36:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:36:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:36:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:36:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:36:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:36:33 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:36:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 19:36:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:36:38 - XML: Processed 646414 elements - found 0 jobs
Sat 18 Jan 2014 19:36:38 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:36:38 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:36:38 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:36:38 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:36:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:36:42 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:36:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:36:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:36:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:36:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:36:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:36:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:36:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:36:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43489136
Sat 18 Jan 2014 19:36:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:36:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43489136
Sat 18 Jan 2014 19:36:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:36:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:36:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:36:53 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:36:53 - job_xml_thread(): Done retrieving: data size 43489136
Sat 18 Jan 2014 19:36:53 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:36:53 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 19:36:54 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 19:36:54 - Housekeeping: done.
Sat 18 Jan 2014 19:36:54 - XML: Start document: iteration 0
Sat 18 Jan 2014 19:36:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:36:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:36:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:36:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:36:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:36:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:36:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:36:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:36:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:36:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:36:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:37:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:37:06 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:37:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:37:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 19:37:07 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:37:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6022 values 95010 bits 11876 bytes 
Sat 18 Jan 2014 19:37:07 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:37:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 19:37:09 - XML: Processed 652492 elements - found 0 jobs
Sat 18 Jan 2014 19:37:09 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:37:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:37:09 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:37:09 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:37:09 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:37:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:37:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:37:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:37:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:37:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:37:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:37:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:37:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:37:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43618310
Sat 18 Jan 2014 19:37:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:37:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43618310
Sat 18 Jan 2014 19:37:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:37:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:37:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:37:24 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:37:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:37:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:37:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:37:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:37:28 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:37:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:37:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:37:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:37:29 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:37:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:37:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:37:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:37:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:37:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:37:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:37:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:37:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:37:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:37:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:37:29 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:37:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 19:37:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:37:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:37:33 - job_xml_thread(): Done retrieving: data size 43639662
Sat 18 Jan 2014 19:37:33 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:37:33 - XML: Start document: iteration 1
Sat 18 Jan 2014 19:37:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43639662
Sat 18 Jan 2014 19:37:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43639662
Sat 18 Jan 2014 19:37:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:37:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:37:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:37:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:37:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:37:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:37:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:37:50 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:37:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:37:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:37:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:37:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:37:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:37:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:37:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:37:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:37:56 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:37:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:37:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:37:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:37:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:37:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:37:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:37:57 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 19:37:57 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:37:57 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:37:57 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:37:57 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:37:58 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 19:37:58 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 19:37:58 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:37:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:37:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43644813
Sat 18 Jan 2014 19:37:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:38:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43644813
Sat 18 Jan 2014 19:38:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:38:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:38:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:38:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:38:08 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:38:09 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:38:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 19:38:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:38:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 19:38:09 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:38:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8898 values 140355 bits 17544 bytes 
Sat 18 Jan 2014 19:38:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:38:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:38:12 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:38:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:38:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:38:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:38:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:38:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:38:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:38:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:38:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:38:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:38:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:38:14 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:38:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:38:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:38:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:38:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:38:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:38:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:38:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:38:17 - job_xml_thread(): Done retrieving: data size 43658885
Sat 18 Jan 2014 19:38:17 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:38:17 - XML: Start document: iteration 2
Sat 18 Jan 2014 19:38:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43658885
Sat 18 Jan 2014 19:38:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43658885
Sat 18 Jan 2014 19:38:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:38:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:38:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:38:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:38:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:38:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:38:34 - XML: Processed 654193 elements - found 0 jobs
Sat 18 Jan 2014 19:38:34 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:38:34 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:38:34 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:38:34 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:38:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:38:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:38:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:38:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:38:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:38:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:38:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:38:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:38:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:38:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:38:39 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:38:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:38:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:38:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:38:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:38:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:38:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:38:39 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:38:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 19:38:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:38:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:38:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43644673
Sat 18 Jan 2014 19:38:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:38:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43644673
Sat 18 Jan 2014 19:38:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:38:49 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:38:49 - job_xml_thread(): Done retrieving: data size 43644673
Sat 18 Jan 2014 19:38:49 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:38:49 - XML: Start document: iteration 3
Sat 18 Jan 2014 19:38:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:38:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:38:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:38:51 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:38:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:38:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:38:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:38:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:38:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:38:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:38:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:38:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:38:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:38:59 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 19:38:59 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:38:59 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:38:59 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:38:59 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:39:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:39:04 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:39:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:39:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:39:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:39:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:39:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:39:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:39:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:39:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43624839
Sat 18 Jan 2014 19:39:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:39:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43624839
Sat 18 Jan 2014 19:39:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:39:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:39:09 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:39:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:39:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 19:39:10 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:39:10 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:39:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 19:39:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8795 values 138634 bits 17329 bytes 
Sat 18 Jan 2014 19:39:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:39:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:39:14 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:39:14 - job_xml_thread(): Done retrieving: data size 43624839
Sat 18 Jan 2014 19:39:14 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:39:14 - XML: Start document: iteration 4
Sat 18 Jan 2014 19:39:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:39:19 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:39:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:39:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:39:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:39:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:39:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:39:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:39:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:39:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:39:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:39:27 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 19:39:27 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:39:27 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:39:27 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:39:27 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:39:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:39:31 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:39:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:39:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:39:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:39:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:39:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:39:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:39:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:39:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:39:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:39:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43615439
Sat 18 Jan 2014 19:39:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:39:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43615439
Sat 18 Jan 2014 19:39:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:39:42 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:39:42 - job_xml_thread(): Done retrieving: data size 43615439
Sat 18 Jan 2014 19:39:42 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:39:42 - XML: Start document: iteration 5
Sat 18 Jan 2014 19:39:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:39:44 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:39:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:39:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:39:45 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:39:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 19:39:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:39:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:39:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:39:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:39:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:39:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:39:47 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 19:39:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:39:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:39:48 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:39:49 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:39:49 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:39:49 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 19:39:49 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 19:39:49 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 19:39:51 - XML: Processed 654195 elements - found 0 jobs
Sat 18 Jan 2014 19:39:51 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:39:51 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:39:51 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:39:51 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:39:53 - size of cluster 'LISA Cluster': 624 hosts 79480 metrics 733643 values 11575832 bits 1446979 bytes 
Sat 18 Jan 2014 19:39:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:39:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:39:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:39:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:39:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:39:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:39:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:39:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:39:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:39:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43611088
Sat 18 Jan 2014 19:39:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:40:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43611088
Sat 18 Jan 2014 19:40:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:40:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:40:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:40:06 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:40:06 - job_xml_thread(): Done retrieving: data size 43611088
Sat 18 Jan 2014 19:40:06 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:40:06 - XML: Start document: iteration 6
Sat 18 Jan 2014 19:40:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:40:10 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:40:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:40:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:40:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:40:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 19:40:11 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:40:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6252 values 98572 bits 12321 bytes 
Sat 18 Jan 2014 19:40:12 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:40:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 19:40:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:40:14 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:40:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:40:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:40:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:40:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:40:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:40:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:40:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:40:19 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 19:40:19 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:40:19 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:40:19 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:40:19 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:40:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:40:22 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:40:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:40:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:40:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:40:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:40:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:40:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:40:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:40:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43608216
Sat 18 Jan 2014 19:40:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:40:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43608216
Sat 18 Jan 2014 19:40:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:40:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:40:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:40:34 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:40:34 - job_xml_thread(): Done retrieving: data size 43608216
Sat 18 Jan 2014 19:40:34 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:40:34 - XML: Start document: iteration 7
Sat 18 Jan 2014 19:40:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:40:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:40:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:40:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:40:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:40:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:40:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:40:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:40:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:40:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:40:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:40:44 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 19:40:44 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:40:44 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:40:44 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:40:44 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:40:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:40:49 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:40:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:40:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:40:50 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:40:50 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 19:40:50 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:40:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 19:40:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:40:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:40:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:40:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:40:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:40:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:40:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43614451
Sat 18 Jan 2014 19:40:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:40:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43614451
Sat 18 Jan 2014 19:40:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:40:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:40:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:40:59 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:40:59 - job_xml_thread(): Done retrieving: data size 43614451
Sat 18 Jan 2014 19:40:59 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:40:59 - XML: Start document: iteration 8
Sat 18 Jan 2014 19:41:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:41:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:41:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:41:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:41:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:41:08 - XML: Processed 654194 elements - found 0 jobs
Sat 18 Jan 2014 19:41:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:41:09 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:41:09 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:41:09 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:41:09 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:41:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:41:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:41:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:41:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:41:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:41:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:41:12 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:41:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:41:13 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:41:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 19:41:13 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:41:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5878 values 92719 bits 11589 bytes 
Sat 18 Jan 2014 19:41:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 19:41:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:41:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:41:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:41:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:41:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:41:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:41:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:41:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:41:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:41:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571253
Sat 18 Jan 2014 19:41:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:41:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571253
Sat 18 Jan 2014 19:41:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:41:24 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:41:24 - job_xml_thread(): Done retrieving: data size 43571253
Sat 18 Jan 2014 19:41:24 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:41:24 - XML: Start document: iteration 9
Sat 18 Jan 2014 19:41:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:41:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:41:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:41:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:41:36 - XML: Processed 653445 elements - found 0 jobs
Sat 18 Jan 2014 19:41:36 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:41:36 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:41:36 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:41:36 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:41:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:41:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:41:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:41:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:41:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:41:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:41:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:41:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:41:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:41:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:41:42 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:41:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:41:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:41:43 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:41:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 19:41:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:41:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:41:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:41:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:41:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:41:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:41:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43056136
Sat 18 Jan 2014 19:41:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:41:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43056136
Sat 18 Jan 2014 19:41:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:41:51 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:41:51 - job_xml_thread(): Done retrieving: data size 43056136
Sat 18 Jan 2014 19:41:51 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:41:51 - XML: Start document: iteration 10
Sat 18 Jan 2014 19:41:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:41:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:41:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:41:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:42:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:42:02 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:42:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:42:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:42:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:42:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:42:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:42:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:42:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:42:06 - XML: Processed 646868 elements - found 0 jobs
Sat 18 Jan 2014 19:42:06 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:42:06 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:42:06 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:42:06 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:42:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:42:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:42:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:42:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:42:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:42:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:42:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:42:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:42:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:42:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42974313
Sat 18 Jan 2014 19:42:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:42:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42974313
Sat 18 Jan 2014 19:42:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:42:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:42:13 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:42:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:42:15 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:42:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 19:42:15 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:42:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 19:42:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8825 values 139128 bits 17391 bytes 
Sat 18 Jan 2014 19:42:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:42:20 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:42:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:42:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:42:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:42:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:42:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:42:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:42:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42974313
Sat 18 Jan 2014 19:42:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:42:21 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:42:21 - job_xml_thread(): Done retrieving: data size 42974313
Sat 18 Jan 2014 19:42:21 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:42:21 - XML: Start document: iteration 11
Sat 18 Jan 2014 19:42:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:42:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:42:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:42:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:42:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:42:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:42:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:42:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:42:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:42:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:42:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:42:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:42:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:42:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:42:40 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:42:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:42:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:42:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:42:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:42:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:42:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:42:42 - XML: Processed 645996 elements - found 0 jobs
Sat 18 Jan 2014 19:42:42 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:42:42 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:42:42 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:42:42 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:42:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:42:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43541801
Sat 18 Jan 2014 19:42:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:42:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43541801
Sat 18 Jan 2014 19:42:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:42:47 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:42:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 19:42:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:42:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:42:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:42:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:42:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:42:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:42:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:42:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:42:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:42:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:42:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:42:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:42:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:42:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:42:57 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:43:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:43:01 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:43:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:43:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:43:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:43:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:43:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:43:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:43:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:43:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43626191
Sat 18 Jan 2014 19:43:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:43:04 - job_xml_thread(): Done retrieving: data size 43626191
Sat 18 Jan 2014 19:43:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43626191
Sat 18 Jan 2014 19:43:04 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:43:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:43:04 - XML: Start document: iteration 12
Sat 18 Jan 2014 19:43:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:43:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:43:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:43:15 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:43:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:43:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 19:43:16 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:43:16 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:43:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 19:43:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:43:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:43:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6317 values 99620 bits 12452 bytes 
Sat 18 Jan 2014 19:43:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:43:18 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:43:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:43:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:43:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:43:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:43:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:43:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:43:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:43:27 - XML: Processed 654105 elements - found 0 jobs
Sat 18 Jan 2014 19:43:27 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:43:27 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:43:27 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:43:27 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:43:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:43:29 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:43:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:43:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:43:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:43:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:43:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:43:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:43:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:43:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43621798
Sat 18 Jan 2014 19:43:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:43:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43621798
Sat 18 Jan 2014 19:43:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:43:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:43:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:43:37 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:43:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 19:43:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:43:42 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:43:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:43:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:43:42 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:43:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:43:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:43:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:43:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:43:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:43:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:43:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:43:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:43:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:43:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:43:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:43:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:43:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:43:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:43:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:43:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:43:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:43:50 - job_xml_thread(): Done retrieving: data size 43612025
Sat 18 Jan 2014 19:43:50 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:43:50 - XML: Start document: iteration 13
Sat 18 Jan 2014 19:43:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43612025
Sat 18 Jan 2014 19:43:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43612025
Sat 18 Jan 2014 19:43:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:43:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:43:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:43:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:44:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:44:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:44:10 - XML: Processed 654195 elements - found 0 jobs
Sat 18 Jan 2014 19:44:10 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:44:10 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:44:10 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:44:10 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:44:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:44:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:44:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:44:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:44:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:44:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:44:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:44:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:44:13 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:44:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:44:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:44:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:44:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:44:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:44:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:44:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:44:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:44:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:44:16 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:44:17 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:44:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:44:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 19:44:17 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:44:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 19:44:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6222 values 98086 bits 12260 bytes 
Sat 18 Jan 2014 19:44:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:44:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43651626
Sat 18 Jan 2014 19:44:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:44:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43651626
Sat 18 Jan 2014 19:44:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:44:25 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:44:25 - job_xml_thread(): Done retrieving: data size 43651626
Sat 18 Jan 2014 19:44:25 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:44:25 - XML: Start document: iteration 14
Sat 18 Jan 2014 19:44:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:44:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:44:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:44:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:44:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:44:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:44:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:44:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:44:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:44:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:44:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:44:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:44:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:44:39 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 19:44:39 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:44:39 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:44:39 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:44:39 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:44:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:44:42 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:44:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:44:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:44:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:44:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:44:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:44:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:44:46 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 19:44:46 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 19:44:46 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:44:47 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:44:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 19:44:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:44:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:44:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43643283
Sat 18 Jan 2014 19:44:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:44:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43643283
Sat 18 Jan 2014 19:44:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:44:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:44:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:44:54 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:44:54 - job_xml_thread(): Done retrieving: data size 43643283
Sat 18 Jan 2014 19:44:54 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:44:54 - XML: Start document: iteration 15
Sat 18 Jan 2014 19:44:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:44:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:45:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:45:00 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:45:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:45:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:45:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:45:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:45:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:45:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:45:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:45:08 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 19:45:08 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:45:08 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:45:08 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:45:08 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:45:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:45:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:45:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:45:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:45:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:45:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:45:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:45:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:45:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:45:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43624955
Sat 18 Jan 2014 19:45:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:45:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43624955
Sat 18 Jan 2014 19:45:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:45:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:45:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:45:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:45:17 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:45:18 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:45:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 19:45:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:45:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 19:45:18 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:45:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6898 values 108717 bits 13589 bytes 
Sat 18 Jan 2014 19:45:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:45:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:45:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:45:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:45:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:45:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:45:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:45:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:45:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:45:23 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:45:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:45:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:45:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:45:27 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:45:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:45:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:45:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:45:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:45:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:45:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:45:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:45:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43647303
Sat 18 Jan 2014 19:45:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:45:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43647303
Sat 18 Jan 2014 19:45:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:45:32 - job_xml_thread(): Done retrieving: data size 43647303
Sat 18 Jan 2014 19:45:32 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:45:33 - XML: Start document: iteration 16
Sat 18 Jan 2014 19:45:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:45:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:45:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:45:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:45:49 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 19:45:49 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:45:49 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:45:49 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:45:49 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:45:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:45:51 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:45:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:45:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:45:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:45:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:45:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:45:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:45:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:45:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:45:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:45:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:45:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:45:55 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:45:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 19:45:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:45:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:45:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:45:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:45:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:46:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:46:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43644662
Sat 18 Jan 2014 19:46:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:46:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43644662
Sat 18 Jan 2014 19:46:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:46:05 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:46:05 - job_xml_thread(): Done retrieving: data size 43644662
Sat 18 Jan 2014 19:46:05 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:46:05 - XML: Start document: iteration 17
Sat 18 Jan 2014 19:46:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:46:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:46:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:46:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:46:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:46:14 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:46:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:46:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:46:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:46:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:46:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:46:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:46:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:46:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:46:18 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:46:19 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:46:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:46:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 19:46:19 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 19:46:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 19:46:19 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:46:19 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:46:19 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:46:19 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:46:19 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:46:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5655 values 89213 bits 11151 bytes 
Sat 18 Jan 2014 19:46:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:46:19 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:46:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:46:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:46:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:46:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:46:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:46:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:46:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:46:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43622911
Sat 18 Jan 2014 19:46:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:46:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43622911
Sat 18 Jan 2014 19:46:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:46:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:46:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:46:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:46:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:46:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:46:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:46:34 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:46:34 - job_xml_thread(): Done retrieving: data size 43622911
Sat 18 Jan 2014 19:46:34 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:46:34 - XML: Start document: iteration 18
Sat 18 Jan 2014 19:46:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:46:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:46:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:46:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:46:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43622911
Sat 18 Jan 2014 19:46:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:46:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:46:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:46:47 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 19:46:48 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:46:48 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:46:48 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:46:48 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:46:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:46:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:46:50 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 19:46:50 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:46:51 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:46:51 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:46:51 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 19:46:51 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 19:46:51 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 19:46:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:46:52 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:46:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:46:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:46:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:46:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:46:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:46:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:46:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:46:55 - size of cluster 'LISA Cluster': 624 hosts 79487 metrics 739009 values 11653051 bits 1456631 bytes 
Sat 18 Jan 2014 19:46:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:46:56 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:46:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:46:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:46:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:46:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:46:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:46:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:46:57 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:46:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 19:46:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:47:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:47:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43662588
Sat 18 Jan 2014 19:47:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:47:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43662588
Sat 18 Jan 2014 19:47:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:47:03 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:47:03 - job_xml_thread(): Done retrieving: data size 43662588
Sat 18 Jan 2014 19:47:03 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:47:03 - XML: Start document: iteration 19
Sat 18 Jan 2014 19:47:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:47:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:47:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:47:10 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:47:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:47:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:47:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:47:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:47:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:47:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:47:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:47:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:47:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:47:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:47:19 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:47:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:47:20 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:47:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 19:47:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 19:47:20 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:47:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5593 values 88321 bits 11040 bytes 
Sat 18 Jan 2014 19:47:20 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 19:47:20 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:47:20 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:47:20 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:47:20 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:47:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:47:23 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:47:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:47:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:47:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:47:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:47:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:47:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:47:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:47:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:47:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:47:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43544026
Sat 18 Jan 2014 19:47:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:47:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43544026
Sat 18 Jan 2014 19:47:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:47:36 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:47:36 - job_xml_thread(): Done retrieving: data size 43544026
Sat 18 Jan 2014 19:47:36 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:47:36 - XML: Start document: iteration 20
Sat 18 Jan 2014 19:47:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:47:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:47:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:47:42 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:47:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:47:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:47:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:47:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:47:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:47:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:47:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:47:50 - XML: Processed 653448 elements - found 0 jobs
Sat 18 Jan 2014 19:47:50 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:47:50 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:47:50 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:47:50 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:47:51 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:47:51 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 19:47:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:47:52 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:47:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:47:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:47:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:47:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:47:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:47:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:47:53 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:47:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 19:47:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:47:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:47:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42996320
Sat 18 Jan 2014 19:47:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:47:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42996320
Sat 18 Jan 2014 19:47:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:47:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:47:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:48:05 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:48:05 - job_xml_thread(): Done retrieving: data size 42996320
Sat 18 Jan 2014 19:48:05 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:48:05 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 19:48:05 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 19:48:05 - Housekeeping: done.
Sat 18 Jan 2014 19:48:05 - XML: Start document: iteration 0
Sat 18 Jan 2014 19:48:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:48:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:48:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:48:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:48:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:48:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:48:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:48:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:48:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:48:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:48:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:48:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:48:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:48:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:48:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:48:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:48:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:48:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:48:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:48:19 - XML: Processed 646488 elements - found 0 jobs
Sat 18 Jan 2014 19:48:19 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:48:19 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:48:19 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:48:19 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:48:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:48:20 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:48:20 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:48:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 19:48:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:48:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 19:48:20 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:48:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5552 values 87742 bits 10967 bytes 
Sat 18 Jan 2014 19:48:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:48:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43009108
Sat 18 Jan 2014 19:48:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:48:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43009108
Sat 18 Jan 2014 19:48:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:48:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:48:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:48:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:48:33 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:48:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:48:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:48:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:48:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:48:34 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:48:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:48:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:48:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:48:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:48:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:48:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:48:38 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:48:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:48:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:48:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:48:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:48:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:48:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:48:41 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:48:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 19:48:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:48:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:48:42 - job_xml_thread(): Done retrieving: data size 43452730
Sat 18 Jan 2014 19:48:42 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:48:42 - XML: Start document: iteration 1
Sat 18 Jan 2014 19:48:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43452730
Sat 18 Jan 2014 19:48:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:48:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43452730
Sat 18 Jan 2014 19:48:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:48:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:48:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:48:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:48:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:49:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:49:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:49:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:49:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:49:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:49:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:49:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:49:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:49:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:49:03 - XML: Processed 651906 elements - found 0 jobs
Sat 18 Jan 2014 19:49:03 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:49:03 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:49:03 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:49:03 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:49:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:49:04 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:49:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:49:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:49:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:49:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:49:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:49:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:49:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:49:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43630686
Sat 18 Jan 2014 19:49:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:49:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43630686
Sat 18 Jan 2014 19:49:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:49:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:49:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:49:18 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:49:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:49:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:49:20 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:49:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:49:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:49:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:49:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:49:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:49:21 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:49:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:49:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:49:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:49:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:49:21 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:49:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:49:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 19:49:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 19:49:21 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:49:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7335 values 115697 bits 14462 bytes 
Sat 18 Jan 2014 19:49:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:49:22 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:49:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:49:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:49:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:49:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:49:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:49:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:49:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:49:25 - job_xml_thread(): Done retrieving: data size 43628139
Sat 18 Jan 2014 19:49:25 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:49:25 - XML: Start document: iteration 2
Sat 18 Jan 2014 19:49:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43628139
Sat 18 Jan 2014 19:49:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:49:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43628139
Sat 18 Jan 2014 19:49:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:49:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:49:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:49:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:49:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:49:40 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 19:49:40 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:49:40 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:49:40 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:49:40 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:49:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:49:43 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:49:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:49:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:49:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:49:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:49:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:49:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:49:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:49:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:49:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:49:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:49:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:49:48 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:49:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 19:49:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:49:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:49:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:49:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:49:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:49:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:49:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43619446
Sat 18 Jan 2014 19:49:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:49:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43619446
Sat 18 Jan 2014 19:49:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:49:55 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:49:55 - job_xml_thread(): Done retrieving: data size 43619446
Sat 18 Jan 2014 19:49:56 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:49:56 - XML: Start document: iteration 3
Sat 18 Jan 2014 19:49:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:49:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:50:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:50:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:50:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:50:07 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:50:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:50:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:50:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:50:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:50:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:50:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:50:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:50:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:50:11 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:50:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:50:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:50:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:50:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:50:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:50:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:50:14 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 19:50:14 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:50:14 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:50:14 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:50:14 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:50:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:50:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43638758
Sat 18 Jan 2014 19:50:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:50:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43638758
Sat 18 Jan 2014 19:50:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:50:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:50:21 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:50:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:50:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 19:50:22 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:50:22 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:50:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 19:50:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8850 values 139551 bits 17443 bytes 
Sat 18 Jan 2014 19:50:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:50:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:50:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:50:24 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:50:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:50:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:50:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:50:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:50:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:50:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:50:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43638758
Sat 18 Jan 2014 19:50:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:50:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:50:29 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:50:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:50:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:50:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:50:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:50:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:50:39 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:50:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:50:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:50:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:50:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:50:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:50:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:50:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:50:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:50:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:50:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:50:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:50:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:50:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:50:42 - job_xml_thread(): Done retrieving: data size 43618448
Sat 18 Jan 2014 19:50:42 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:50:42 - XML: Start document: iteration 4
Sat 18 Jan 2014 19:50:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43618448
Sat 18 Jan 2014 19:50:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:50:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43618448
Sat 18 Jan 2014 19:50:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:50:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:50:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:50:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:50:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:51:01 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 19:51:01 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:51:01 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:51:01 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:51:01 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:51:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:51:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:51:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:51:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:51:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:51:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:51:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:51:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:51:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:51:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:51:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:51:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:51:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:51:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:51:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:51:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:51:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:51:09 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:51:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 19:51:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:51:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:51:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43644175
Sat 18 Jan 2014 19:51:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:51:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43644175
Sat 18 Jan 2014 19:51:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:51:16 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:51:16 - job_xml_thread(): Done retrieving: data size 43644175
Sat 18 Jan 2014 19:51:16 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:51:17 - XML: Start document: iteration 5
Sat 18 Jan 2014 19:51:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:51:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:51:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:51:23 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:51:23 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:51:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:51:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 19:51:23 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:51:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 19:51:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5814 values 91646 bits 11455 bytes 
Sat 18 Jan 2014 19:51:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:51:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:51:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:51:32 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:51:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:51:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:51:33 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 19:51:33 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:51:33 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:51:33 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:51:33 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:51:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:51:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:51:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:51:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:51:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:51:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:51:35 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:51:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:51:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:51:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:51:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:51:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:51:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:51:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:51:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43631271
Sat 18 Jan 2014 19:51:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:51:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43631271
Sat 18 Jan 2014 19:51:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:51:48 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:51:48 - job_xml_thread(): Done retrieving: data size 43631271
Sat 18 Jan 2014 19:51:48 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:51:48 - XML: Start document: iteration 6
Sat 18 Jan 2014 19:51:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:51:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:51:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:51:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:51:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:51:53 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:51:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:51:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:51:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:51:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:51:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:51:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:51:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:51:56 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:51:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 19:51:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:51:59 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 19:51:59 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:51:59 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:51:59 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:51:59 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:52:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:52:01 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:52:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:52:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:52:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:52:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:52:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:52:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:52:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:52:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43612653
Sat 18 Jan 2014 19:52:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:52:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43612653
Sat 18 Jan 2014 19:52:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:52:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:52:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:52:14 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:52:14 - job_xml_thread(): Done retrieving: data size 43612653
Sat 18 Jan 2014 19:52:14 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:52:14 - XML: Start document: iteration 7
Sat 18 Jan 2014 19:52:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:52:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:52:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:52:19 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:52:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:52:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:52:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:52:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:52:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:52:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:52:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:52:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:52:23 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:52:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:52:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 19:52:25 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:52:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6068 values 95716 bits 11964 bytes 
Sat 18 Jan 2014 19:52:25 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:52:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 19:52:28 - XML: Processed 654195 elements - found 0 jobs
Sat 18 Jan 2014 19:52:28 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:52:28 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:52:28 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:52:28 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:52:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:52:29 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:52:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:52:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:52:31 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 19:52:31 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 19:52:31 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:52:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:52:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:52:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:52:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:52:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:52:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43616875
Sat 18 Jan 2014 19:52:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:52:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43616875
Sat 18 Jan 2014 19:52:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:52:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:52:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:52:43 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:52:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:52:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:52:47 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:52:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:52:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:52:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:52:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:52:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:52:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:52:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:52:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:52:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:52:49 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:52:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:52:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:52:49 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:52:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 19:52:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:52:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:52:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:52:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:52:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:52:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:52:51 - job_xml_thread(): Done retrieving: data size 43621124
Sat 18 Jan 2014 19:52:51 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:52:51 - XML: Start document: iteration 8
Sat 18 Jan 2014 19:52:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43621124
Sat 18 Jan 2014 19:52:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:52:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43621124
Sat 18 Jan 2014 19:52:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:53:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:53:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:53:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:53:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:53:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:53:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:53:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:53:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:53:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:53:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:53:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:53:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:53:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:53:13 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 19:53:13 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:53:13 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:53:13 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:53:13 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:53:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:53:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:53:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:53:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:53:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:53:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:53:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:53:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:53:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:53:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567812
Sat 18 Jan 2014 19:53:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:53:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567812
Sat 18 Jan 2014 19:53:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:53:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:53:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:53:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:53:25 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:53:25 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:53:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 19:53:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:53:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 19:53:26 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:53:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8779 values 138460 bits 17307 bytes 
Sat 18 Jan 2014 19:53:28 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:53:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:53:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:53:29 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:53:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:53:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:53:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:53:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:53:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:53:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:53:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:53:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:53:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:53:34 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:53:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:53:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:53:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:53:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:53:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:53:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:53:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:53:36 - job_xml_thread(): Done retrieving: data size 43147643
Sat 18 Jan 2014 19:53:36 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:53:36 - XML: Start document: iteration 9
Sat 18 Jan 2014 19:53:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43147643
Sat 18 Jan 2014 19:53:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:53:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43147643
Sat 18 Jan 2014 19:53:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:53:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:53:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:53:45 - XML: Processed 648450 elements - found 0 jobs
Sat 18 Jan 2014 19:53:45 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:53:45 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:53:45 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:53:45 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:53:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:53:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:53:51 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 19:53:51 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:53:53 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:53:53 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 19:53:53 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:53:53 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 19:53:53 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 19:53:55 - size of cluster 'LISA Cluster': 624 hosts 79487 metrics 752482 values 11867751 bits 1483468 bytes 
Sat 18 Jan 2014 19:53:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:53:57 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:53:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:53:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:53:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:53:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:53:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:53:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:53:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:53:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:53:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:53:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:53:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:53:59 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:53:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 19:53:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:53:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:53:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:53:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:53:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:54:00 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:54:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:54:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42980300
Sat 18 Jan 2014 19:54:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:54:03 - job_xml_thread(): Done retrieving: data size 42980300
Sat 18 Jan 2014 19:54:03 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:54:03 - XML: Start document: iteration 10
Sat 18 Jan 2014 19:54:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42980300
Sat 18 Jan 2014 19:54:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:54:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:54:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:54:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:54:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:54:20 - XML: Processed 645996 elements - found 0 jobs
Sat 18 Jan 2014 19:54:20 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:54:20 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:54:20 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:54:20 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:54:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:54:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:54:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:54:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:54:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:54:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:54:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:54:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:54:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:54:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:54:26 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:54:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:54:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:54:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:54:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:54:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:54:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:54:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:54:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:54:27 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:54:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:54:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 19:54:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 19:54:27 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:54:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6098 values 96219 bits 12027 bytes 
Sat 18 Jan 2014 19:54:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:54:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43121228
Sat 18 Jan 2014 19:54:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:54:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43121228
Sat 18 Jan 2014 19:54:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:54:35 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:54:35 - job_xml_thread(): Done retrieving: data size 43121228
Sat 18 Jan 2014 19:54:35 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:54:35 - XML: Start document: iteration 11
Sat 18 Jan 2014 19:54:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:54:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:54:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:54:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:54:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:54:50 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:54:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:54:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:54:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:54:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:54:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:54:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:54:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:54:53 - XML: Processed 647672 elements - found 0 jobs
Sat 18 Jan 2014 19:54:53 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:54:53 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:54:53 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:54:53 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:54:53 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:54:53 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 19:54:54 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:54:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 19:54:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:54:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:54:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:54:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:54:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:54:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:54:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:54:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:54:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:54:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:54:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43603498
Sat 18 Jan 2014 19:54:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:54:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43603498
Sat 18 Jan 2014 19:54:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:55:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:55:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:55:08 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:55:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:55:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:55:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:55:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:55:11 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:55:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:55:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:55:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:55:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:55:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:55:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:55:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:55:14 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:55:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:55:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:55:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:55:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:55:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:55:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:55:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:55:17 - job_xml_thread(): Done retrieving: data size 43613629
Sat 18 Jan 2014 19:55:17 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:55:17 - XML: Start document: iteration 12
Sat 18 Jan 2014 19:55:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43613629
Sat 18 Jan 2014 19:55:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:55:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43613629
Sat 18 Jan 2014 19:55:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:55:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:55:28 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:55:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:55:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:55:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:55:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:55:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:55:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 19:55:30 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:55:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 19:55:30 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:55:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9109 values 143689 bits 17961 bytes 
Sat 18 Jan 2014 19:55:36 - XML: Processed 654193 elements - found 0 jobs
Sat 18 Jan 2014 19:55:36 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:55:36 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:55:36 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:55:36 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:55:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:55:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:55:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:55:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:55:41 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:55:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:55:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:55:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:55:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:55:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:55:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:55:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:55:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:55:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:55:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:55:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:55:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:55:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:55:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43645301
Sat 18 Jan 2014 19:55:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:55:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43645301
Sat 18 Jan 2014 19:55:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:55:51 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:55:51 - job_xml_thread(): Done retrieving: data size 43645301
Sat 18 Jan 2014 19:55:51 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:55:52 - XML: Start document: iteration 13
Sat 18 Jan 2014 19:55:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:55:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:55:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:55:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:56:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:56:02 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:56:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:56:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:56:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:56:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:56:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:56:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:56:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:56:06 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 19:56:06 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:56:06 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:56:06 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:56:06 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:56:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:56:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:56:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:56:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:56:09 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:56:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 19:56:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:56:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:56:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:56:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:56:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:56:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:56:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43634756
Sat 18 Jan 2014 19:56:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:56:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43634756
Sat 18 Jan 2014 19:56:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:56:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:56:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:56:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:56:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:56:22 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:56:22 - job_xml_thread(): Done retrieving: data size 43634756
Sat 18 Jan 2014 19:56:22 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:56:22 - XML: Start document: iteration 14
Sat 18 Jan 2014 19:56:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:56:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:56:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:56:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:56:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:56:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:56:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:56:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:56:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:56:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:56:30 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:56:32 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:56:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 19:56:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:56:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 19:56:32 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:56:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5976 values 94255 bits 11781 bytes 
Sat 18 Jan 2014 19:56:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:56:33 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:56:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:56:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:56:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:56:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:56:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:56:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:56:34 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 19:56:34 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:56:34 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:56:34 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:56:34 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:56:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:56:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:56:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:56:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43607566
Sat 18 Jan 2014 19:56:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:56:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43607566
Sat 18 Jan 2014 19:56:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:56:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:56:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:56:49 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:56:49 - job_xml_thread(): Done retrieving: data size 43607566
Sat 18 Jan 2014 19:56:49 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:56:49 - XML: Start document: iteration 15
Sat 18 Jan 2014 19:56:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:56:52 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:56:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:56:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:56:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:56:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:56:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:56:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:56:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:57:01 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 19:57:01 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:57:01 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:57:01 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:57:01 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:57:01 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:57:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 19:57:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:57:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:57:02 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:57:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:57:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:57:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:57:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:57:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:57:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:57:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:57:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43613525
Sat 18 Jan 2014 19:57:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:57:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43613525
Sat 18 Jan 2014 19:57:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:57:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:57:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:57:16 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:57:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:57:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:57:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:57:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:57:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:57:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:57:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:57:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:57:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:57:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:57:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:57:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:57:21 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:57:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:57:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:57:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:57:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:57:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:57:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:57:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:57:25 - job_xml_thread(): Done retrieving: data size 43633390
Sat 18 Jan 2014 19:57:25 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:57:25 - XML: Start document: iteration 16
Sat 18 Jan 2014 19:57:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43633390
Sat 18 Jan 2014 19:57:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:57:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43633390
Sat 18 Jan 2014 19:57:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:57:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:57:32 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:57:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:57:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 19:57:34 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:57:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:57:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 19:57:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:57:34 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:57:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9022 values 142314 bits 17789 bytes 
Sat 18 Jan 2014 19:57:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:57:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:57:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:57:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:57:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:57:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:57:45 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 19:57:45 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:57:45 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:57:45 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:57:45 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:57:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:57:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:57:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:57:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:57:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:57:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:57:48 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:57:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:57:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:57:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:57:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:57:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:57:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:57:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:57:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43644988
Sat 18 Jan 2014 19:57:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:57:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43644988
Sat 18 Jan 2014 19:57:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:58:00 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:58:00 - job_xml_thread(): Done retrieving: data size 43644988
Sat 18 Jan 2014 19:58:00 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:58:00 - XML: Start document: iteration 17
Sat 18 Jan 2014 19:58:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:58:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:58:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:58:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:58:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:58:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:58:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:58:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:58:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:58:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:58:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:58:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:58:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:58:14 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 19:58:14 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:58:14 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:58:14 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:58:14 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:58:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:58:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:58:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:58:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:58:15 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:58:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 19:58:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:58:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:58:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:58:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:58:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:58:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:58:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43621126
Sat 18 Jan 2014 19:58:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:58:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43621126
Sat 18 Jan 2014 19:58:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:58:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:58:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:58:29 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:58:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:58:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:58:30 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:58:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:58:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:58:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:58:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:58:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:58:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:58:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:58:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:58:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:58:33 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:58:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:58:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:58:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:58:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:58:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:58:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:58:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:58:34 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:58:35 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:58:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:58:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 19:58:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 19:58:35 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:58:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5700 values 89869 bits 11233 bytes 
Sat 18 Jan 2014 19:58:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:58:36 - job_xml_thread(): Done retrieving: data size 43637952
Sat 18 Jan 2014 19:58:36 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:58:36 - XML: Start document: iteration 18
Sat 18 Jan 2014 19:58:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43637952
Sat 18 Jan 2014 19:58:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:58:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43637952
Sat 18 Jan 2014 19:58:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:58:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:58:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:58:47 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 19:58:47 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 19:58:47 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:58:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:58:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:58:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:58:51 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:58:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:58:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:58:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:58:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:58:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:58:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:58:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:58:52 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 19:58:52 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:58:52 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:58:52 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:58:52 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:58:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:58:56 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:58:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:58:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:58:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:58:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:58:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:58:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:58:58 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:58:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 19:58:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:58:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:58:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43650290
Sat 18 Jan 2014 19:58:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:58:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43650290
Sat 18 Jan 2014 19:58:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:59:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:59:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:59:07 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:59:07 - job_xml_thread(): Done retrieving: data size 43650290
Sat 18 Jan 2014 19:59:07 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:59:07 - XML: Start document: iteration 19
Sat 18 Jan 2014 19:59:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:59:11 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:59:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:59:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:59:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:59:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:59:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:59:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:59:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:59:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:59:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:59:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:59:16 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:59:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:59:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:59:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:59:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:59:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:59:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:59:19 - XML: Processed 654191 elements - found 0 jobs
Sat 18 Jan 2014 19:59:19 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:59:19 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:59:19 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:59:19 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:59:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:59:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43546186
Sat 18 Jan 2014 19:59:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:59:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43546186
Sat 18 Jan 2014 19:59:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:59:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:59:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:59:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 19:59:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:59:34 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:59:34 - job_xml_thread(): Done retrieving: data size 43546186
Sat 18 Jan 2014 19:59:34 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 19:59:34 - XML: Start document: iteration 20
Sat 18 Jan 2014 19:59:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:59:35 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:59:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:59:36 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:59:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 19:59:36 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:59:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 19:59:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 19:59:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 19:59:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 19:59:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:59:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7065 values 111400 bits 13925 bytes 
Sat 18 Jan 2014 19:59:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:59:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 19:59:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 19:59:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 19:59:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 19:59:43 - XML: Processed 653448 elements - found 0 jobs
Sat 18 Jan 2014 19:59:43 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 19:59:43 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 19:59:43 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 19:59:43 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 19:59:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 19:59:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 19:59:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 19:59:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 19:59:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:59:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 19:59:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 19:59:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 19:59:47 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 19:59:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 19:59:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 19:59:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 19:59:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43015138
Sat 18 Jan 2014 19:59:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 19:59:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43015138
Sat 18 Jan 2014 19:59:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 19:59:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 19:59:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 19:59:59 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 19:59:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:00:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:00:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:00:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:00:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:00:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:00:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:00:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:00:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:00:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:00:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:00:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:00:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:00:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:00:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:00:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:00:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:00:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:00:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:00:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:00:08 - job_xml_thread(): Done retrieving: data size 42955131
Sat 18 Jan 2014 20:00:08 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:00:08 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 20:00:08 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 20:00:08 - Housekeeping: done.
Sat 18 Jan 2014 20:00:08 - XML: Start document: iteration 0
Sat 18 Jan 2014 20:00:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42955131
Sat 18 Jan 2014 20:00:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:00:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42955131
Sat 18 Jan 2014 20:00:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:00:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:00:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:00:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:00:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:00:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:00:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:00:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:00:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:00:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:00:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:00:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:00:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:00:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:00:28 - XML: Processed 645998 elements - found 0 jobs
Sat 18 Jan 2014 20:00:28 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:00:28 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:00:28 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:00:28 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:00:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:00:30 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:00:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:00:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:00:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:00:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:00:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:00:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:00:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:00:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43253671
Sat 18 Jan 2014 20:00:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:00:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43253671
Sat 18 Jan 2014 20:00:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:00:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:00:36 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:00:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:00:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 20:00:38 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:00:38 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:00:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 20:00:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148601 bits 18575 bytes 
Sat 18 Jan 2014 20:00:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:00:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:00:43 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:00:43 - job_xml_thread(): Done retrieving: data size 43253671
Sat 18 Jan 2014 20:00:43 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:00:43 - XML: Start document: iteration 1
Sat 18 Jan 2014 20:00:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:00:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:00:54 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 20:00:54 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:00:54 - XML: Processed 649709 elements - found 0 jobs
Sat 18 Jan 2014 20:00:54 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:00:54 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:00:54 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:00:54 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:00:54 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:00:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:00:54 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 20:00:54 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 20:00:54 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:00:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:00:54 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 20:00:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:00:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:00:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:00:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:00:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:00:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:00:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:00:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:00:57 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:00:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:00:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:00:58 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 766048 values 12077243 bits 1509655 bytes 
Sat 18 Jan 2014 20:00:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:00:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:00:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:00:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:01:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:01:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43619465
Sat 18 Jan 2014 20:01:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:01:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43619465
Sat 18 Jan 2014 20:01:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:01:09 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:01:09 - job_xml_thread(): Done retrieving: data size 43619465
Sat 18 Jan 2014 20:01:09 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:01:09 - XML: Start document: iteration 2
Sat 18 Jan 2014 20:01:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:01:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:01:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:01:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:01:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:01:19 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:01:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:01:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:01:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:01:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:01:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:01:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:01:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:01:21 - XML: Processed 653984 elements - found 0 jobs
Sat 18 Jan 2014 20:01:21 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:01:21 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:01:21 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:01:21 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:01:23 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:01:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 20:01:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:01:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:01:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:01:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:01:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:01:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:01:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:01:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:01:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:01:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:01:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43630610
Sat 18 Jan 2014 20:01:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:01:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43630610
Sat 18 Jan 2014 20:01:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:01:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:01:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:01:36 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:01:36 - job_xml_thread(): Done retrieving: data size 43630610
Sat 18 Jan 2014 20:01:36 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:01:36 - XML: Start document: iteration 3
Sat 18 Jan 2014 20:01:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:01:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:01:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:01:38 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:01:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:01:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:01:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:01:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:01:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:01:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:01:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 20:01:39 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:01:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6157 values 97351 bits 12168 bytes 
Sat 18 Jan 2014 20:01:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:01:39 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:01:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 20:01:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:01:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:01:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:01:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:01:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:01:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:01:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:01:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:01:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:01:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:01:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:01:52 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 20:01:52 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:01:52 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:01:52 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:01:52 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:01:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:01:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:01:54 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:01:54 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 20:01:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:01:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43600863
Sat 18 Jan 2014 20:01:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:01:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43600863
Sat 18 Jan 2014 20:01:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:02:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:02:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:02:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:02:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:02:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:02:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:02:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:02:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:02:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:02:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43600863
Sat 18 Jan 2014 20:02:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:02:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:02:07 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:02:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:02:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:02:16 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:02:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:02:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:02:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:02:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:02:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:02:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:02:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:02:18 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:02:18 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:02:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 20:02:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:02:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:02:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:02:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:02:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:02:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:02:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:02:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:02:21 - job_xml_thread(): Done retrieving: data size 43605436
Sat 18 Jan 2014 20:02:21 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:02:21 - XML: Start document: iteration 4
Sat 18 Jan 2014 20:02:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43605436
Sat 18 Jan 2014 20:02:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:02:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43605436
Sat 18 Jan 2014 20:02:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:02:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:02:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:02:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:02:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:02:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:02:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:02:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:02:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:02:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:02:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:02:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:02:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:02:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:02:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:02:39 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:02:39 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:02:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 20:02:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:02:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 20:02:39 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:02:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5818 values 91981 bits 11497 bytes 
Sat 18 Jan 2014 20:02:41 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 20:02:41 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:02:41 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:02:41 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:02:41 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:02:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:02:46 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:02:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:02:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:02:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:02:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:02:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:02:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:02:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:02:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43609967
Sat 18 Jan 2014 20:02:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:02:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43609967
Sat 18 Jan 2014 20:02:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:02:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:02:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:02:56 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:02:56 - job_xml_thread(): Done retrieving: data size 43609967
Sat 18 Jan 2014 20:02:56 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:02:56 - XML: Start document: iteration 5
Sat 18 Jan 2014 20:03:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:03:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:03:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:03:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:03:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:03:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:03:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:03:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:03:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:03:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:03:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:03:12 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 20:03:12 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:03:12 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:03:12 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:03:12 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:03:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:03:14 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:03:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:03:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:03:14 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:03:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 20:03:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:03:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:03:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:03:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:03:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:03:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:03:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43617299
Sat 18 Jan 2014 20:03:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:03:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43617299
Sat 18 Jan 2014 20:03:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:03:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:03:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:03:28 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:03:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:03:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:03:29 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:03:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:03:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:03:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:03:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:03:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:03:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:03:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:03:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:03:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:03:33 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:03:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:03:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:03:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:03:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:03:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:03:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:03:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:03:35 - job_xml_thread(): Done retrieving: data size 43622725
Sat 18 Jan 2014 20:03:35 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:03:35 - XML: Start document: iteration 6
Sat 18 Jan 2014 20:03:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43622725
Sat 18 Jan 2014 20:03:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:03:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43622725
Sat 18 Jan 2014 20:03:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:03:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:03:40 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:03:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:03:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 20:03:41 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:03:42 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:03:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 20:03:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8003 values 126407 bits 15800 bytes 
Sat 18 Jan 2014 20:03:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:03:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:03:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:03:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:03:49 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 20:03:49 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:03:49 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:03:49 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:03:49 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:03:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:03:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:03:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:03:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:03:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:03:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:03:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:03:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:03:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:03:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:03:59 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:03:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:03:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:04:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:04:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:04:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:04:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:04:04 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:04:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:04:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43621588
Sat 18 Jan 2014 20:04:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:04:05 - job_xml_thread(): Done retrieving: data size 43621588
Sat 18 Jan 2014 20:04:05 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:04:05 - XML: Start document: iteration 7
Sat 18 Jan 2014 20:04:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43621588
Sat 18 Jan 2014 20:04:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:04:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:04:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:04:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:04:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:04:20 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:04:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 20:04:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:04:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:04:24 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:04:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:04:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:04:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:04:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:04:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:04:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:04:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:04:25 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 20:04:25 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:04:25 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:04:25 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:04:25 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:04:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:04:29 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:04:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:04:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:04:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:04:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:04:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:04:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:04:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:04:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43630144
Sat 18 Jan 2014 20:04:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:04:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43630144
Sat 18 Jan 2014 20:04:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:04:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:04:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:04:40 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:04:40 - job_xml_thread(): Done retrieving: data size 43630144
Sat 18 Jan 2014 20:04:40 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:04:40 - XML: Start document: iteration 8
Sat 18 Jan 2014 20:04:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:04:42 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:04:43 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:04:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 20:04:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:04:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 20:04:43 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:04:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6105 values 96339 bits 12042 bytes 
Sat 18 Jan 2014 20:04:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:04:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:04:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:04:47 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:04:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:04:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:04:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:04:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:04:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:04:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:04:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:04:52 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 20:04:52 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:04:52 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:04:52 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:04:52 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:04:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:04:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:04:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:04:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:04:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:04:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:04:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:04:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:04:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:04:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43634859
Sat 18 Jan 2014 20:04:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:04:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43634859
Sat 18 Jan 2014 20:04:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:05:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:05:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:05:07 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:05:07 - job_xml_thread(): Done retrieving: data size 43634859
Sat 18 Jan 2014 20:05:07 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:05:07 - XML: Start document: iteration 9
Sat 18 Jan 2014 20:05:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:05:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:05:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:05:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:05:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:05:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:05:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:05:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:05:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:05:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:05:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:05:19 - XML: Processed 654189 elements - found 0 jobs
Sat 18 Jan 2014 20:05:19 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:05:19 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:05:19 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:05:19 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:05:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:05:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:05:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:05:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:05:24 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:05:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 20:05:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:05:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:05:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:05:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:05:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:05:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:05:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566814
Sat 18 Jan 2014 20:05:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:05:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566814
Sat 18 Jan 2014 20:05:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:05:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:05:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:05:34 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:05:34 - job_xml_thread(): Done retrieving: data size 43566814
Sat 18 Jan 2014 20:05:35 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:05:35 - XML: Start document: iteration 10
Sat 18 Jan 2014 20:05:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:05:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:05:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:05:44 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:05:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:05:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 20:05:45 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:05:45 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:05:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 20:05:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5828 values 91932 bits 11491 bytes 
Sat 18 Jan 2014 20:05:47 - XML: Processed 653448 elements - found 0 jobs
Sat 18 Jan 2014 20:05:47 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:05:47 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:05:47 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:05:47 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:05:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:05:48 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:05:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:05:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:05:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:05:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:05:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:05:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:05:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:05:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:05:50 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:05:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:05:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:05:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:05:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:05:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:05:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:05:53 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 20:05:53 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 20:05:53 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:05:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:05:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43003102
Sat 18 Jan 2014 20:05:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:05:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43003102
Sat 18 Jan 2014 20:05:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:06:02 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:06:02 - job_xml_thread(): Done retrieving: data size 43003102
Sat 18 Jan 2014 20:06:02 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:06:02 - XML: Start document: iteration 11
Sat 18 Jan 2014 20:06:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:06:02 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:06:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:06:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:06:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:06:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:06:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:06:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:06:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:06:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:06:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:06:11 - XML: Processed 646216 elements - found 0 jobs
Sat 18 Jan 2014 20:06:11 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:06:11 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:06:11 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:06:11 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:06:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:06:14 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:06:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:06:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:06:15 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:06:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 20:06:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:06:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:06:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:06:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:06:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:06:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:06:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42994381
Sat 18 Jan 2014 20:06:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:06:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42994381
Sat 18 Jan 2014 20:06:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:06:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:06:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:06:26 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:06:26 - job_xml_thread(): Done retrieving: data size 42994381
Sat 18 Jan 2014 20:06:26 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:06:26 - XML: Start document: iteration 12
Sat 18 Jan 2014 20:06:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:06:26 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:06:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:06:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:06:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:06:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:06:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:06:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:06:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:06:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:06:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:06:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:06:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:06:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:06:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:06:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:06:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:06:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:06:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:06:38 - XML: Processed 646626 elements - found 0 jobs
Sat 18 Jan 2014 20:06:38 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:06:38 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:06:38 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:06:38 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:06:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:06:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43391051
Sat 18 Jan 2014 20:06:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:06:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43391051
Sat 18 Jan 2014 20:06:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:06:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:06:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:06:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:06:46 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:06:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:06:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 20:06:47 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:06:47 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:06:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 20:06:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8786 values 138570 bits 17321 bytes 
Sat 18 Jan 2014 20:06:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:06:51 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:06:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:06:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:06:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:06:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:06:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:06:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:06:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:06:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:06:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:06:53 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:06:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:06:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:06:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:06:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:06:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:06:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:06:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:06:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:06:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:06:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43608948
Sat 18 Jan 2014 20:06:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:06:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43608948
Sat 18 Jan 2014 20:06:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:06:58 - job_xml_thread(): Done retrieving: data size 43608948
Sat 18 Jan 2014 20:06:58 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:06:58 - XML: Start document: iteration 13
Sat 18 Jan 2014 20:07:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:07:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:07:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:07:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:07:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:07:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:07:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:07:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:07:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:07:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:07:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:07:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:07:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:07:16 - XML: Processed 653711 elements - found 0 jobs
Sat 18 Jan 2014 20:07:16 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:07:16 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:07:16 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:07:16 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:07:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:07:19 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:07:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:07:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:07:19 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:07:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 20:07:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:07:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:07:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:07:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:07:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:07:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:07:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43613479
Sat 18 Jan 2014 20:07:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:07:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43613479
Sat 18 Jan 2014 20:07:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:07:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:07:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:07:31 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:07:31 - job_xml_thread(): Done retrieving: data size 43613479
Sat 18 Jan 2014 20:07:31 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:07:31 - XML: Start document: iteration 14
Sat 18 Jan 2014 20:07:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:07:32 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:07:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:07:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:07:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:07:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:07:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:07:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:07:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:07:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:07:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:07:39 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 20:07:39 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:07:39 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:07:39 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:07:39 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:07:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:07:43 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:07:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:07:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:07:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:07:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:07:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:07:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:07:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:07:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43601694
Sat 18 Jan 2014 20:07:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:07:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43601694
Sat 18 Jan 2014 20:07:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:07:47 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:07:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:07:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:07:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 20:07:48 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:07:48 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:07:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 20:07:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8920 values 140715 bits 17589 bytes 
Sat 18 Jan 2014 20:07:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:07:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:07:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:07:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:07:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:07:54 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:07:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:07:54 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 20:07:54 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:07:54 - job_xml_thread(): Done retrieving: data size 43601694
Sat 18 Jan 2014 20:07:54 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:07:54 - XML: Start document: iteration 15
Sat 18 Jan 2014 20:07:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:07:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:07:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:07:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43601694
Sat 18 Jan 2014 20:07:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:07:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:07:58 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:07:58 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 20:07:58 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 20:07:59 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:07:59 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 20:07:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:07:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:08:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:08:10 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:08:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:08:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:08:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:08:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:08:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:08:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:08:11 - size of cluster 'LISA Cluster': 624 hosts 79482 metrics 782596 values 12348309 bits 1543538 bytes 
Sat 18 Jan 2014 20:08:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:08:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:08:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:08:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:08:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:08:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:08:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:08:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:08:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:08:16 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 20:08:16 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:08:16 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:08:16 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:08:16 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:08:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:08:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43620193
Sat 18 Jan 2014 20:08:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:08:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43620193
Sat 18 Jan 2014 20:08:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:08:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:08:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:08:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:08:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:08:31 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:08:31 - job_xml_thread(): Done retrieving: data size 43620193
Sat 18 Jan 2014 20:08:31 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:08:31 - XML: Start document: iteration 16
Sat 18 Jan 2014 20:08:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:08:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:08:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:08:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:08:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:08:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:08:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:08:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:08:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:08:40 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:08:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 20:08:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:08:44 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 20:08:44 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:08:44 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:08:44 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:08:44 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:08:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:08:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:08:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:08:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:08:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:08:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:08:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:08:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:08:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:08:48 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:08:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:08:49 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:08:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 20:08:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 20:08:49 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:08:49 - size of cluster 'Render Cluster': 20 hosts 3139 metrics 3050 values 48120 bits 6015 bytes 
Sat 18 Jan 2014 20:08:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:08:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43605739
Sat 18 Jan 2014 20:08:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:08:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43605739
Sat 18 Jan 2014 20:08:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:08:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:08:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:08:59 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:08:59 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 20:08:59 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:08:59 - job_xml_thread(): Done retrieving: data size 43605739
Sat 18 Jan 2014 20:08:59 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:08:59 - XML: Start document: iteration 17
Sat 18 Jan 2014 20:09:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:09:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:09:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:09:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:09:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:09:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:09:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:09:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:09:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:09:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:09:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:09:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:09:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:09:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:09:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:09:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:09:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:09:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:09:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:09:12 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 20:09:12 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:09:12 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:09:12 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:09:12 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:09:16 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:09:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 20:09:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:09:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:09:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43626594
Sat 18 Jan 2014 20:09:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43626594
Sat 18 Jan 2014 20:09:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:09:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:09:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:09:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:09:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:09:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:09:27 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:09:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:09:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:09:30 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:09:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:09:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:09:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:09:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:09:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:09:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:09:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:09:33 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:09:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:09:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:09:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:09:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:09:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:09:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:09:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:09:37 - job_xml_thread(): Done retrieving: data size 43618673
Sat 18 Jan 2014 20:09:37 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:09:37 - XML: Start document: iteration 18
Sat 18 Jan 2014 20:09:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43618673
Sat 18 Jan 2014 20:09:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43618673
Sat 18 Jan 2014 20:09:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:09:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:09:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:09:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:09:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:09:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:09:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:09:49 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:09:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:09:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 20:09:50 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:09:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6623 values 104448 bits 13056 bytes 
Sat 18 Jan 2014 20:09:50 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:09:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 20:09:55 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 20:09:55 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:09:55 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:09:55 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:09:55 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:09:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:09:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:09:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:09:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:09:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:09:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:09:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:09:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:09:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:10:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:10:01 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:10:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:10:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:10:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:10:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:10:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:10:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:10:05 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:10:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 20:10:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:10:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:10:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43622904
Sat 18 Jan 2014 20:10:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:10:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43622904
Sat 18 Jan 2014 20:10:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:10:11 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:10:11 - job_xml_thread(): Done retrieving: data size 43622904
Sat 18 Jan 2014 20:10:11 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:10:11 - XML: Start document: iteration 19
Sat 18 Jan 2014 20:10:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:10:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:10:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:10:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:10:20 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 20:10:20 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:10:20 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:10:20 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:10:20 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:10:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:10:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:10:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:10:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:10:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:10:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:10:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:10:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:10:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:10:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:10:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:10:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:10:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:10:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:10:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:10:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:10:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:10:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:10:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43644990
Sat 18 Jan 2014 20:10:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:10:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43644990
Sat 18 Jan 2014 20:10:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:10:35 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:10:35 - job_xml_thread(): Done retrieving: data size 43644990
Sat 18 Jan 2014 20:10:35 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:10:35 - XML: Start document: iteration 20
Sat 18 Jan 2014 20:10:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:10:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:10:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:10:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:10:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:10:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:10:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:10:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:10:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:10:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:10:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:10:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:10:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:10:48 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 20:10:48 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:10:48 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:10:48 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:10:48 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:10:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:10:50 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:10:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:10:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 20:10:51 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:10:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99058 bits 12382 bytes 
Sat 18 Jan 2014 20:10:51 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:10:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 20:10:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:10:52 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:10:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:10:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:10:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:10:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:10:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:10:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:10:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:10:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43621859
Sat 18 Jan 2014 20:10:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:10:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43621859
Sat 18 Jan 2014 20:10:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:10:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:10:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:11:03 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:11:03 - job_xml_thread(): Done retrieving: data size 43621859
Sat 18 Jan 2014 20:11:03 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:11:03 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 20:11:03 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 20:11:03 - Housekeeping: done.
Sat 18 Jan 2014 20:11:03 - XML: Start document: iteration 0
Sat 18 Jan 2014 20:11:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:11:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:11:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:11:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:11:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:11:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:11:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:11:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:11:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:11:16 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 20:11:16 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:11:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:11:16 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:11:16 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:11:16 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:11:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:11:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:11:19 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:11:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:11:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:11:19 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:11:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 20:11:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:11:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:11:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:11:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:11:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:11:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:11:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566583
Sat 18 Jan 2014 20:11:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:11:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566583
Sat 18 Jan 2014 20:11:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:11:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:11:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:11:32 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:11:32 - job_xml_thread(): Done retrieving: data size 43566583
Sat 18 Jan 2014 20:11:32 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:11:32 - XML: Start document: iteration 1
Sat 18 Jan 2014 20:11:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:11:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:11:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:11:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:11:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:11:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:11:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:11:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:11:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:11:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:11:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:11:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:11:43 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:11:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:11:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:11:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:11:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:11:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:11:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:11:45 - XML: Processed 653445 elements - found 0 jobs
Sat 18 Jan 2014 20:11:45 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:11:45 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:11:45 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:11:45 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:11:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:11:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43013335
Sat 18 Jan 2014 20:11:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:11:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43013335
Sat 18 Jan 2014 20:11:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:11:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:11:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:11:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:11:52 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:11:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:11:53 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:11:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 20:11:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 20:11:54 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:11:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8768 values 138217 bits 17277 bytes 
Sat 18 Jan 2014 20:12:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:12:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:12:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:12:00 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:12:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:12:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:12:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:12:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:12:00 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:12:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:12:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:12:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:12:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:12:05 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:12:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:12:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:12:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:12:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:12:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:12:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:12:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:12:09 - job_xml_thread(): Done retrieving: data size 42964516
Sat 18 Jan 2014 20:12:09 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:12:09 - XML: Start document: iteration 2
Sat 18 Jan 2014 20:12:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42964516
Sat 18 Jan 2014 20:12:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42964516
Sat 18 Jan 2014 20:12:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:12:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:12:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:12:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:12:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:12:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:12:23 - XML: Processed 645996 elements - found 0 jobs
Sat 18 Jan 2014 20:12:23 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:12:23 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:12:23 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:12:23 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:12:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:12:29 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:12:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:12:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:12:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:12:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:12:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:12:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:12:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:12:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:12:32 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:12:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:12:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:12:32 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:12:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 20:12:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:12:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:12:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:12:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:12:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:12:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:12:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43444439
Sat 18 Jan 2014 20:12:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:12:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43444439
Sat 18 Jan 2014 20:12:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:12:38 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:12:38 - job_xml_thread(): Done retrieving: data size 43444439
Sat 18 Jan 2014 20:12:38 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:12:38 - XML: Start document: iteration 3
Sat 18 Jan 2014 20:12:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:12:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:12:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:12:46 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:12:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:12:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:12:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:12:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:12:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:12:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:12:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:12:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:12:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:12:51 - XML: Processed 651942 elements - found 0 jobs
Sat 18 Jan 2014 20:12:51 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:12:51 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:12:51 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:12:51 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:12:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:12:53 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:12:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:12:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 20:12:54 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:12:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 20:12:55 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:12:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5684 values 89558 bits 11194 bytes 
Sat 18 Jan 2014 20:12:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:12:58 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:12:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:12:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:12:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:12:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:12:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:12:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:13:01 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:13:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 20:13:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:13:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:13:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43588943
Sat 18 Jan 2014 20:13:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:13:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:13:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:13:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43588943
Sat 18 Jan 2014 20:13:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:13:06 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:13:07 - job_xml_thread(): Done retrieving: data size 43588943
Sat 18 Jan 2014 20:13:07 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:13:07 - XML: Start document: iteration 4
Sat 18 Jan 2014 20:13:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:13:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:13:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:13:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:13:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:13:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:13:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:13:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:13:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:13:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:13:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:13:23 - XML: Processed 653796 elements - found 0 jobs
Sat 18 Jan 2014 20:13:23 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:13:23 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:13:23 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:13:23 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:13:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:13:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:13:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:13:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:13:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:13:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:13:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:13:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:13:26 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 20:13:26 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 20:13:26 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:13:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:13:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43647771
Sat 18 Jan 2014 20:13:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:13:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43647771
Sat 18 Jan 2014 20:13:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:13:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:13:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:13:38 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:13:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:13:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:13:39 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:13:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:13:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:13:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:13:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:13:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:13:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:13:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:13:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:13:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:13:42 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:13:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:13:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:13:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:13:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:13:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:13:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:13:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:13:46 - job_xml_thread(): Done retrieving: data size 43635976
Sat 18 Jan 2014 20:13:46 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:13:46 - XML: Start document: iteration 5
Sat 18 Jan 2014 20:13:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43635976
Sat 18 Jan 2014 20:13:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:13:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43635976
Sat 18 Jan 2014 20:13:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:13:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:13:55 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:13:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:13:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:13:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:13:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:13:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:13:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 20:13:57 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:13:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 20:13:58 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:13:59 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148577 bits 18572 bytes 
Sat 18 Jan 2014 20:14:05 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 20:14:06 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:14:06 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:14:06 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:14:06 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:14:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:14:10 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:14:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:14:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:14:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:14:11 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:14:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:14:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:14:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:14:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:14:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:14:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:14:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:14:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:14:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:14:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:14:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:14:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:14:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43659873
Sat 18 Jan 2014 20:14:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:14:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43659873
Sat 18 Jan 2014 20:14:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:14:21 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:14:21 - job_xml_thread(): Done retrieving: data size 43659873
Sat 18 Jan 2014 20:14:21 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:14:21 - XML: Start document: iteration 6
Sat 18 Jan 2014 20:14:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:14:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:14:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:14:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:14:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:14:31 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:14:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:14:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:14:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:14:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:14:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:14:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:14:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:14:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:14:37 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:14:37 - XML: Processed 654195 elements - found 0 jobs
Sat 18 Jan 2014 20:14:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:14:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:14:37 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:14:37 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:14:37 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:14:37 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:14:37 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:14:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 20:14:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:14:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:14:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:14:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:14:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:14:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:14:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43630385
Sat 18 Jan 2014 20:14:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:14:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43630385
Sat 18 Jan 2014 20:14:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:14:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:14:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:14:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:14:51 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:14:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:14:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:14:52 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:14:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:14:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:14:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:14:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:14:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:14:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:14:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:14:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:14:54 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:14:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:14:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:14:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:14:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:14:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:14:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:14:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:14:56 - job_xml_thread(): Done retrieving: data size 43655992
Sat 18 Jan 2014 20:14:56 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:14:56 - XML: Start document: iteration 7
Sat 18 Jan 2014 20:14:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43655992
Sat 18 Jan 2014 20:14:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:14:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43655992
Sat 18 Jan 2014 20:14:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:14:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:14:58 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:14:59 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 20:15:00 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:15:00 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:15:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 20:15:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:15:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 20:15:01 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:15:01 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:15:02 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:15:02 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 20:15:02 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 20:15:02 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 20:15:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9009 values 142105 bits 17763 bytes 
Sat 18 Jan 2014 20:15:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:15:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:15:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:15:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:15:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:15:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:15:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:15:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:15:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:15:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:15:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:15:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:15:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:15:15 - size of cluster 'LISA Cluster': 624 hosts 79468 metrics 707042 values 11144905 bits 1393113 bytes 
Sat 18 Jan 2014 20:15:15 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 20:15:15 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:15:15 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:15:15 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:15:15 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:15:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:15:20 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:15:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:15:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:15:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:15:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:15:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:15:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:15:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:15:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43617863
Sat 18 Jan 2014 20:15:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:15:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43617863
Sat 18 Jan 2014 20:15:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:15:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:15:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:15:31 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:15:31 - job_xml_thread(): Done retrieving: data size 43617863
Sat 18 Jan 2014 20:15:31 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:15:31 - XML: Start document: iteration 8
Sat 18 Jan 2014 20:15:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:15:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:15:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:15:42 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:15:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:15:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:15:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:15:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:15:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:15:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:15:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:15:43 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 20:15:43 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:15:43 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:15:43 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:15:43 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:15:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:15:46 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:15:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:15:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:15:46 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:15:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 20:15:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:15:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:15:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:15:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:15:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:15:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:15:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43623192
Sat 18 Jan 2014 20:15:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:15:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43623192
Sat 18 Jan 2014 20:15:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:15:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:15:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:15:58 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:15:58 - job_xml_thread(): Done retrieving: data size 43623192
Sat 18 Jan 2014 20:15:59 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:15:59 - XML: Start document: iteration 9
Sat 18 Jan 2014 20:16:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:16:01 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:16:01 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:16:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:16:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 20:16:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 20:16:02 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:16:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6065 values 95670 bits 11958 bytes 
Sat 18 Jan 2014 20:16:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:16:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:16:02 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:16:02 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 20:16:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:16:07 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:16:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:16:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:16:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:16:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:16:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:16:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:16:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:16:11 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 20:16:11 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:16:11 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:16:11 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:16:11 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:16:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:16:13 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:16:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:16:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:16:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:16:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:16:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:16:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:16:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:16:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43631787
Sat 18 Jan 2014 20:16:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:16:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43631787
Sat 18 Jan 2014 20:16:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:16:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:16:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:16:26 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:16:26 - job_xml_thread(): Done retrieving: data size 43631787
Sat 18 Jan 2014 20:16:26 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:16:26 - XML: Start document: iteration 10
Sat 18 Jan 2014 20:16:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:16:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:16:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:16:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:16:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:16:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:16:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:16:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:16:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:16:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:16:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:16:40 - XML: Processed 654194 elements - found 0 jobs
Sat 18 Jan 2014 20:16:40 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:16:40 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:16:40 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:16:40 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:16:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:16:42 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:16:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:16:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:16:42 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:16:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 20:16:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:16:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:16:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:16:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:16:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:16:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:16:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43644464
Sat 18 Jan 2014 20:16:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:16:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43644464
Sat 18 Jan 2014 20:16:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:16:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:16:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:16:55 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:16:55 - job_xml_thread(): Done retrieving: data size 43644464
Sat 18 Jan 2014 20:16:55 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:16:55 - XML: Start document: iteration 11
Sat 18 Jan 2014 20:16:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:16:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:16:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:16:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:16:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:16:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:16:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:16:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:16:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:16:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:16:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:17:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:17:02 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:17:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:17:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 20:17:02 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:17:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 20:17:02 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:17:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5749 values 90913 bits 11364 bytes 
Sat 18 Jan 2014 20:17:04 - XML: Processed 654193 elements - found 0 jobs
Sat 18 Jan 2014 20:17:04 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:17:04 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:17:04 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:17:04 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:17:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:17:07 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:17:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:17:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:17:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:17:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:17:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:17:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:17:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:17:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43631133
Sat 18 Jan 2014 20:17:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:17:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43631133
Sat 18 Jan 2014 20:17:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:17:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:17:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:17:19 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:17:19 - job_xml_thread(): Done retrieving: data size 43631133
Sat 18 Jan 2014 20:17:19 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:17:19 - XML: Start document: iteration 12
Sat 18 Jan 2014 20:17:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:17:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:17:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:17:24 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:17:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:17:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:17:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:17:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:17:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:17:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:17:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:17:30 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 20:17:30 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:17:30 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:17:30 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:17:30 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:17:32 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:17:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 20:17:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:17:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:17:34 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:17:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:17:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:17:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:17:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:17:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:17:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:17:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:17:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43404609
Sat 18 Jan 2014 20:17:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:17:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43404609
Sat 18 Jan 2014 20:17:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:17:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:17:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:17:45 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:17:45 - job_xml_thread(): Done retrieving: data size 43404609
Sat 18 Jan 2014 20:17:45 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:17:45 - XML: Start document: iteration 13
Sat 18 Jan 2014 20:17:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:17:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:17:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:17:53 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:17:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:17:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:17:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:17:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:17:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:17:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:17:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:17:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:17:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:17:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:17:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:17:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:17:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:17:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:17:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:17:59 - XML: Processed 651642 elements - found 0 jobs
Sat 18 Jan 2014 20:17:59 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:17:59 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:17:59 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:17:59 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:18:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:18:02 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:18:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:18:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42958827
Sat 18 Jan 2014 20:18:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:18:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42958827
Sat 18 Jan 2014 20:18:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:18:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:18:04 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:18:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 20:18:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 20:18:05 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:18:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6272 values 99208 bits 12401 bytes 
Sat 18 Jan 2014 20:18:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:18:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:18:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:18:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:18:14 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:18:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:18:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:18:16 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:18:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:18:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:18:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:18:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:18:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:18:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:18:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:18:19 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:18:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:18:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:18:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:18:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:18:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:18:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:18:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:18:23 - job_xml_thread(): Done retrieving: data size 43026643
Sat 18 Jan 2014 20:18:23 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:18:23 - XML: Start document: iteration 14
Sat 18 Jan 2014 20:18:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43026643
Sat 18 Jan 2014 20:18:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:18:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43026643
Sat 18 Jan 2014 20:18:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:18:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:18:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:18:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:18:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:18:39 - XML: Processed 646744 elements - found 0 jobs
Sat 18 Jan 2014 20:18:39 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:18:39 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:18:39 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:18:39 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:18:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:18:43 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:18:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:18:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:18:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:18:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:18:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:18:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:18:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:18:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:18:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:18:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:18:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:18:47 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:18:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 20:18:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:18:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:18:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:18:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:18:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:18:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:18:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43591257
Sat 18 Jan 2014 20:18:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:18:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43591257
Sat 18 Jan 2014 20:18:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:18:55 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:18:55 - job_xml_thread(): Done retrieving: data size 43591257
Sat 18 Jan 2014 20:18:55 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:18:55 - XML: Start document: iteration 15
Sat 18 Jan 2014 20:19:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:19:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:19:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:19:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:19:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:19:04 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:19:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:19:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 20:19:05 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:19:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 20:19:06 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:19:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6100 values 96289 bits 12036 bytes 
Sat 18 Jan 2014 20:19:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:19:07 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:19:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:19:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:19:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:19:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:19:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:19:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:19:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:19:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:19:14 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:19:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:19:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:19:14 - XML: Processed 653664 elements - found 0 jobs
Sat 18 Jan 2014 20:19:14 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:19:14 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:19:14 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:19:14 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:19:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:19:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:19:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:19:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:19:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:19:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43618277
Sat 18 Jan 2014 20:19:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:19:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43618277
Sat 18 Jan 2014 20:19:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:19:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:19:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:19:29 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:19:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:19:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:19:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:19:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:19:30 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:19:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:19:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:19:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:19:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:19:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:19:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:19:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:19:35 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:19:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:19:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:19:35 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:19:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 20:19:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:19:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:19:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:19:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:19:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:19:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:19:39 - job_xml_thread(): Done retrieving: data size 43617524
Sat 18 Jan 2014 20:19:39 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:19:39 - XML: Start document: iteration 16
Sat 18 Jan 2014 20:19:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43617524
Sat 18 Jan 2014 20:19:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:19:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43617524
Sat 18 Jan 2014 20:19:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:19:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:19:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:19:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:19:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:19:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:19:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:19:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:19:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:19:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:19:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:19:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:19:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:19:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:20:01 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 20:20:01 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:20:01 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:20:01 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:20:01 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:20:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:20:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:20:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:20:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:20:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:20:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:20:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:20:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:20:05 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 20:20:05 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 20:20:05 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:20:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:20:05 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:20:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:20:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43614057
Sat 18 Jan 2014 20:20:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:20:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43614057
Sat 18 Jan 2014 20:20:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:20:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:20:07 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:20:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 20:20:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 20:20:07 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:20:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8959 values 141336 bits 17667 bytes 
Sat 18 Jan 2014 20:20:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:20:14 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:20:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:20:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:20:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:20:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:20:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:20:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:20:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:20:16 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:20:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:20:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:20:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:20:19 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:20:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:20:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:20:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:20:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:20:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:20:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:20:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:20:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43625362
Sat 18 Jan 2014 20:20:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:20:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43625362
Sat 18 Jan 2014 20:20:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:20:23 - job_xml_thread(): Done retrieving: data size 43625362
Sat 18 Jan 2014 20:20:23 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:20:23 - XML: Start document: iteration 17
Sat 18 Jan 2014 20:20:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:20:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:20:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:20:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:20:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:20:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:20:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:20:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:20:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:20:42 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:20:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:20:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:20:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:20:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:20:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:20:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:20:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:20:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:20:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:20:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:20:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:20:45 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 20:20:45 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:20:45 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:20:45 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:20:45 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:20:45 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:20:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 20:20:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:20:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:20:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43631393
Sat 18 Jan 2014 20:20:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:20:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43631393
Sat 18 Jan 2014 20:20:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:20:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:20:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:20:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:20:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:20:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:20:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:20:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:20:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:20:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:20:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:20:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:21:00 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:21:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:21:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:21:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:21:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:21:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:21:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:21:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:21:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:21:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:21:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43631084
Sat 18 Jan 2014 20:21:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:21:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43631084
Sat 18 Jan 2014 20:21:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:21:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:21:08 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:21:08 - job_xml_thread(): Done retrieving: data size 43631084
Sat 18 Jan 2014 20:21:08 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:21:08 - XML: Start document: iteration 18
Sat 18 Jan 2014 20:21:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:21:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 20:21:10 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:21:10 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:21:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6123 values 96626 bits 12078 bytes 
Sat 18 Jan 2014 20:21:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 20:21:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:21:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:21:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:21:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:21:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:21:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:21:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:21:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:21:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:21:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:21:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:21:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:21:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:21:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:21:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:21:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:21:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:21:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:21:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:21:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:21:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:21:29 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 20:21:29 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:21:29 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:21:29 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:21:29 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:21:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:21:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43628386
Sat 18 Jan 2014 20:21:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:21:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43628386
Sat 18 Jan 2014 20:21:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:21:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:21:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:21:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:21:42 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:21:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:21:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:21:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:21:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:21:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:21:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:21:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:21:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:21:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:21:44 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:21:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:21:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:21:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:21:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:21:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:21:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:21:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:21:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:21:46 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:21:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 20:21:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:21:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:21:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43623680
Sat 18 Jan 2014 20:21:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:21:50 - job_xml_thread(): Done retrieving: data size 43623680
Sat 18 Jan 2014 20:21:50 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:21:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43623680
Sat 18 Jan 2014 20:21:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:21:50 - XML: Start document: iteration 19
Sat 18 Jan 2014 20:21:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:21:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:22:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:22:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:22:02 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 20:22:03 - XML: Processed 654194 elements - found 0 jobs
Sat 18 Jan 2014 20:22:03 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:22:03 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:22:03 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:22:04 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:22:04 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:22:04 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:22:04 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:22:04 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 20:22:04 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 20:22:04 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 20:22:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:22:06 - ganglia_parse_thread(): finished: Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sat 18 Jan 2014 20:22:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:22:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:22:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:22:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:22:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:22:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:22:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:22:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:22:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:22:10 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:22:10 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:22:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:22:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:22:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:22:11 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:22:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 20:22:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 20:22:11 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:22:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6064 values 95660 bits 11957 bytes 
Sat 18 Jan 2014 20:22:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:22:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:22:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:22:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:22:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:22:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43654499
Sat 18 Jan 2014 20:22:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:22:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43654499
Sat 18 Jan 2014 20:22:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:22:19 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:22:19 - job_xml_thread(): Done retrieving: data size 43654499
Sat 18 Jan 2014 20:22:19 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:22:19 - XML: Start document: iteration 20
Sat 18 Jan 2014 20:22:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:22:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:22:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:22:24 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:22:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:22:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:22:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:22:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:22:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:22:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:22:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:22:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:22:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:22:32 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 20:22:33 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:22:33 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:22:33 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:22:33 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:22:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:22:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:22:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:22:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:22:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:22:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:22:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:22:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:22:36 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:22:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 20:22:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:22:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:22:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43614483
Sat 18 Jan 2014 20:22:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:22:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43614483
Sat 18 Jan 2014 20:22:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:22:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:22:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:22:48 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:22:48 - job_xml_thread(): Done retrieving: data size 43614483
Sat 18 Jan 2014 20:22:48 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:22:48 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 20:22:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:22:49 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:22:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:22:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:22:49 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 20:22:49 - Housekeeping: done.
Sat 18 Jan 2014 20:22:49 - XML: Start document: iteration 0
Sat 18 Jan 2014 20:22:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:22:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:22:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:22:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:22:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:22:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:22:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:22:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:22:59 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:22:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:22:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:23:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:23:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:23:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:23:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:23:00 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 20:23:00 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:23:00 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:23:00 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:23:00 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:23:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:23:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43609786
Sat 18 Jan 2014 20:23:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:23:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43609786
Sat 18 Jan 2014 20:23:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:23:04 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:23:04 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:23:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:23:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:23:06 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:23:06 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:23:06 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 20:23:06 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 20:23:06 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 20:23:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:23:11 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:23:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:23:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:23:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:23:12 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:23:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:23:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:23:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 20:23:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 20:23:12 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:23:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8696 values 137111 bits 17138 bytes 
Sat 18 Jan 2014 20:23:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:23:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:23:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:23:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:23:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:23:14 - size of cluster 'LISA Cluster': 624 hosts 79473 metrics 836416 values 13192968 bits 1649121 bytes 
Sat 18 Jan 2014 20:23:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:23:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:23:15 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:23:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:23:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:23:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:23:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:23:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:23:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:23:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:23:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:23:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:23:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553116
Sat 18 Jan 2014 20:23:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:23:25 - job_xml_thread(): Done retrieving: data size 43553116
Sat 18 Jan 2014 20:23:25 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:23:25 - XML: Start document: iteration 1
Sat 18 Jan 2014 20:23:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553116
Sat 18 Jan 2014 20:23:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:23:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:23:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:23:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:23:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:23:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:23:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:23:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:23:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:23:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:23:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:23:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:23:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:23:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:23:40 - XML: Processed 653448 elements - found 0 jobs
Sat 18 Jan 2014 20:23:40 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:23:40 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:23:40 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:23:40 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:23:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:23:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:23:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:23:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:23:46 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:23:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 20:23:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:23:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:23:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:23:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:23:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:23:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:23:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43012137
Sat 18 Jan 2014 20:23:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:23:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43012137
Sat 18 Jan 2014 20:23:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:23:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:23:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:23:55 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:23:55 - job_xml_thread(): Done retrieving: data size 43012137
Sat 18 Jan 2014 20:23:55 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:23:55 - XML: Start document: iteration 2
Sat 18 Jan 2014 20:24:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:24:00 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:24:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:24:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:24:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:24:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:24:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:24:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:24:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:24:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:24:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:24:06 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:24:06 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 20:24:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:24:12 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:24:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:24:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 20:24:12 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:24:12 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:24:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 20:24:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:24:13 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:24:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:24:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:24:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5664 values 89278 bits 11159 bytes 
Sat 18 Jan 2014 20:24:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:24:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:24:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:24:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:24:14 - XML: Processed 646886 elements - found 0 jobs
Sat 18 Jan 2014 20:24:14 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:24:14 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:24:14 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:24:14 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:24:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:24:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42990322
Sat 18 Jan 2014 20:24:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:24:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:24:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:24:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42990322
Sat 18 Jan 2014 20:24:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:24:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:24:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:24:29 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:24:29 - job_xml_thread(): Done retrieving: data size 42990322
Sat 18 Jan 2014 20:24:29 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:24:29 - XML: Start document: iteration 3
Sat 18 Jan 2014 20:24:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:24:30 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:24:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:24:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:24:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:24:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:24:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:24:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:24:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:24:34 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:24:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 20:24:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:24:43 - XML: Processed 646556 elements - found 0 jobs
Sat 18 Jan 2014 20:24:43 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:24:43 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:24:43 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:24:43 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:24:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:24:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:24:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:24:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:24:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:24:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:24:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:24:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:24:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:24:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:24:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:24:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43531672
Sat 18 Jan 2014 20:24:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:24:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43531672
Sat 18 Jan 2014 20:24:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:24:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:24:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:24:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:24:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:24:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:24:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:24:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:24:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:24:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:24:58 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:25:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:25:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:25:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:25:01 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:25:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:25:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:25:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:25:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:25:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:25:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:25:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:25:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43617972
Sat 18 Jan 2014 20:25:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:25:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43617972
Sat 18 Jan 2014 20:25:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:25:06 - job_xml_thread(): Done retrieving: data size 43617972
Sat 18 Jan 2014 20:25:06 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:25:06 - XML: Start document: iteration 4
Sat 18 Jan 2014 20:25:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:25:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:25:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:25:13 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:25:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:25:14 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:25:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 20:25:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 20:25:14 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:25:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8920 values 140672 bits 17584 bytes 
Sat 18 Jan 2014 20:25:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:25:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:25:23 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 20:25:23 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:25:23 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:25:23 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:25:23 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:25:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:25:25 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:25:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:25:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:25:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:25:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:25:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:25:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:25:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:25:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:25:29 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:25:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:25:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:25:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:25:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:25:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:25:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:25:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:25:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43623863
Sat 18 Jan 2014 20:25:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:25:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43623863
Sat 18 Jan 2014 20:25:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:25:38 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:25:38 - job_xml_thread(): Done retrieving: data size 43623863
Sat 18 Jan 2014 20:25:38 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:25:38 - XML: Start document: iteration 5
Sat 18 Jan 2014 20:25:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:25:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:25:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:25:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:25:55 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 20:25:55 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:25:55 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:25:56 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:25:56 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:25:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:25:56 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:25:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:25:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:25:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:25:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:25:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:25:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:25:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:25:57 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:25:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 20:25:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:25:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:25:59 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:25:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:25:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:26:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:26:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:26:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:26:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:26:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:26:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43633355
Sat 18 Jan 2014 20:26:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:26:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43633355
Sat 18 Jan 2014 20:26:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:26:11 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:26:11 - job_xml_thread(): Done retrieving: data size 43633355
Sat 18 Jan 2014 20:26:11 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:26:11 - XML: Start document: iteration 6
Sat 18 Jan 2014 20:26:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:26:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:26:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:26:14 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:26:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:26:14 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:26:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:26:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:26:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:26:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:26:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:26:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:26:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:26:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:26:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:26:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:26:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 20:26:15 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:26:15 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:26:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 20:26:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5960 values 94029 bits 11753 bytes 
Sat 18 Jan 2014 20:26:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:26:18 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:26:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:26:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:26:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:26:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:26:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:26:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:26:21 - XML: Processed 654193 elements - found 0 jobs
Sat 18 Jan 2014 20:26:21 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:26:21 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:26:21 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:26:21 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:26:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:26:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43624178
Sat 18 Jan 2014 20:26:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:26:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43624178
Sat 18 Jan 2014 20:26:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:26:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:26:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:26:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:26:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:26:36 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:26:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:26:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:26:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:26:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:26:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:26:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:26:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:26:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:26:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:26:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:26:42 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:26:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:26:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:26:42 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:26:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 20:26:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:26:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:26:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:26:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:26:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:26:46 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 20:26:46 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 20:26:46 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:26:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:26:46 - job_xml_thread(): Done retrieving: data size 43641116
Sat 18 Jan 2014 20:26:46 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:26:46 - XML: Start document: iteration 7
Sat 18 Jan 2014 20:26:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43641116
Sat 18 Jan 2014 20:26:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43641116
Sat 18 Jan 2014 20:26:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:26:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:26:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:26:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:26:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:26:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:27:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:27:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:27:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:27:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:27:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:27:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:27:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:27:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:27:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:27:08 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 20:27:08 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:27:08 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:27:08 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:27:08 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:27:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:27:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:27:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:27:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:27:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:27:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:27:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:27:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:27:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:27:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43655656
Sat 18 Jan 2014 20:27:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:27:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43655656
Sat 18 Jan 2014 20:27:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:27:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:27:15 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:27:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:27:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 20:27:16 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:27:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 20:27:16 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:27:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8860 values 139775 bits 17471 bytes 
Sat 18 Jan 2014 20:27:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:27:19 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:27:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:27:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:27:23 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:27:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:27:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:27:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:27:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:27:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:27:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:27:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:27:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:27:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:27:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:27:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:27:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:27:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:27:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:27:27 - job_xml_thread(): Done retrieving: data size 43661447
Sat 18 Jan 2014 20:27:27 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:27:27 - XML: Start document: iteration 8
Sat 18 Jan 2014 20:27:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43661447
Sat 18 Jan 2014 20:27:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:27:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43661447
Sat 18 Jan 2014 20:27:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:27:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:27:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:27:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:27:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:27:44 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 20:27:44 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:27:44 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:27:44 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:27:44 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:27:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:27:45 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:27:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:27:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:27:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:27:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:27:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:27:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:27:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:27:47 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:27:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 20:27:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:27:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:27:50 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:27:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:27:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:27:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:27:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:27:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:27:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:27:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:27:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43628142
Sat 18 Jan 2014 20:27:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:27:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43628142
Sat 18 Jan 2014 20:27:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:27:59 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:27:59 - job_xml_thread(): Done retrieving: data size 43628142
Sat 18 Jan 2014 20:28:00 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:28:00 - XML: Start document: iteration 9
Sat 18 Jan 2014 20:28:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:28:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:28:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:28:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:28:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:28:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:28:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:28:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:28:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:28:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:28:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:28:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:28:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:28:11 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 20:28:11 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:28:11 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:28:11 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:28:11 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:28:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:28:14 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:28:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:28:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:28:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:28:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:28:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:28:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:28:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:28:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43630528
Sat 18 Jan 2014 20:28:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:28:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:28:16 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:28:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43630528
Sat 18 Jan 2014 20:28:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:28:17 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:28:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:28:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 20:28:17 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:28:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7836 values 123643 bits 15455 bytes 
Sat 18 Jan 2014 20:28:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 20:28:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:28:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:28:26 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:28:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:28:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:28:27 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:28:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:28:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:28:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:28:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:28:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:28:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:28:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:28:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:28:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:28:31 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:28:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:28:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:28:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:28:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:28:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:28:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:28:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:28:35 - job_xml_thread(): Done retrieving: data size 43616382
Sat 18 Jan 2014 20:28:35 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:28:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43616382
Sat 18 Jan 2014 20:28:35 - XML: Start document: iteration 10
Sat 18 Jan 2014 20:28:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:28:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43616382
Sat 18 Jan 2014 20:28:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:28:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:28:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:28:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:28:45 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:28:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:28:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:28:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:28:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:28:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:28:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:28:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:28:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:28:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:28:54 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 20:28:54 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:28:54 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:28:54 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:28:54 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:28:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:28:57 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:28:57 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:28:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 20:28:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:28:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:28:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:28:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:28:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:28:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:28:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:29:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:29:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43625960
Sat 18 Jan 2014 20:29:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:29:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43625960
Sat 18 Jan 2014 20:29:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:29:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:29:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:29:09 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:29:10 - job_xml_thread(): Done retrieving: data size 43625960
Sat 18 Jan 2014 20:29:10 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:29:10 - XML: Start document: iteration 11
Sat 18 Jan 2014 20:29:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:29:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:29:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:29:15 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:29:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:29:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:29:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:29:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:29:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:29:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:29:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:29:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:29:17 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:29:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:29:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 20:29:19 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:29:19 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:29:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 20:29:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5867 values 92610 bits 11576 bytes 
Sat 18 Jan 2014 20:29:21 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 20:29:21 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:29:21 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:29:21 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:29:21 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:29:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:29:23 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:29:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:29:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:29:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:29:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:29:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:29:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:29:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:29:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567945
Sat 18 Jan 2014 20:29:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:29:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567945
Sat 18 Jan 2014 20:29:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:29:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:29:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:29:36 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:29:36 - job_xml_thread(): Done retrieving: data size 43567945
Sat 18 Jan 2014 20:29:36 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:29:36 - XML: Start document: iteration 12
Sat 18 Jan 2014 20:29:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:29:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:29:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:29:45 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:29:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:29:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:29:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:29:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:29:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:29:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:29:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:29:47 - XML: Processed 653448 elements - found 0 jobs
Sat 18 Jan 2014 20:29:48 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:29:48 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:29:48 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:29:48 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:29:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:29:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:29:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:29:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:29:52 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:29:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 20:29:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:29:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:29:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:29:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:29:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:29:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:29:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42987417
Sat 18 Jan 2014 20:29:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42987417
Sat 18 Jan 2014 20:29:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:29:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:30:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:30:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:30:03 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:30:03 - job_xml_thread(): Done retrieving: data size 42987417
Sat 18 Jan 2014 20:30:03 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:30:03 - XML: Start document: iteration 13
Sat 18 Jan 2014 20:30:07 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 20:30:07 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:30:07 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:30:07 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 20:30:07 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 20:30:07 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:30:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:30:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:30:07 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 20:30:10 - size of cluster 'LISA Cluster': 624 hosts 79480 metrics 857689 values 13519052 bits 1689881 bytes 
Sat 18 Jan 2014 20:30:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:30:11 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:30:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:30:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:30:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:30:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:30:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:30:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:30:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:30:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:30:18 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:30:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:30:18 - XML: Processed 646254 elements - found 0 jobs
Sat 18 Jan 2014 20:30:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:30:18 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:30:18 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:30:18 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:30:18 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:30:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:30:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:30:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:30:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:30:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:30:19 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:30:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:30:19 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:30:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 20:30:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 20:30:19 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:30:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5651 values 89095 bits 11136 bytes 
Sat 18 Jan 2014 20:30:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:30:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43017041
Sat 18 Jan 2014 20:30:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:30:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43017041
Sat 18 Jan 2014 20:30:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:30:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:30:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:30:33 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:30:33 - job_xml_thread(): Done retrieving: data size 43017041
Sat 18 Jan 2014 20:30:33 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:30:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:30:33 - XML: Start document: iteration 14
Sat 18 Jan 2014 20:30:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:30:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:30:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:30:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:30:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:30:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:30:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:30:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:30:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:30:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:30:43 - XML: Processed 646744 elements - found 0 jobs
Sat 18 Jan 2014 20:30:43 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:30:43 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:30:43 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:30:43 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:30:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:30:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:30:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:30:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:30:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:30:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:30:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:30:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:30:48 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:30:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 20:30:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:30:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:30:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:30:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:30:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569590
Sat 18 Jan 2014 20:30:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:30:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569590
Sat 18 Jan 2014 20:30:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:30:58 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:30:58 - job_xml_thread(): Done retrieving: data size 43569590
Sat 18 Jan 2014 20:30:58 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:30:58 - XML: Start document: iteration 15
Sat 18 Jan 2014 20:31:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:31:03 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:31:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:31:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:31:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:31:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:31:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:31:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:31:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:31:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:31:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:31:07 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:31:07 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 20:31:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:31:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:31:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:31:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:31:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:31:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:31:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:31:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:31:10 - XML: Processed 653872 elements - found 0 jobs
Sat 18 Jan 2014 20:31:10 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:31:10 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:31:10 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:31:10 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:31:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:31:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43637543
Sat 18 Jan 2014 20:31:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:31:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43637543
Sat 18 Jan 2014 20:31:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:31:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:31:20 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:31:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:31:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 20:31:20 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:31:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 20:31:20 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:31:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8355 values 131806 bits 16475 bytes 
Sat 18 Jan 2014 20:31:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:31:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:31:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:31:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:31:25 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:31:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:31:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:31:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:31:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:31:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:31:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:31:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:31:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:31:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:31:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:31:31 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:31:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:31:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:31:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:31:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:31:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:31:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:31:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:31:35 - job_xml_thread(): Done retrieving: data size 43606886
Sat 18 Jan 2014 20:31:35 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:31:35 - XML: Start document: iteration 16
Sat 18 Jan 2014 20:31:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43606886
Sat 18 Jan 2014 20:31:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:31:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43606886
Sat 18 Jan 2014 20:31:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:31:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:31:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:31:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:31:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:31:54 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 20:31:54 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:31:54 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:31:54 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:31:54 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:31:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:31:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:31:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:31:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:31:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:31:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:31:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:31:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:31:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:32:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:32:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:32:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:32:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:32:00 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:32:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 20:32:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:32:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:32:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:32:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:32:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:32:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:32:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43626301
Sat 18 Jan 2014 20:32:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:32:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43626301
Sat 18 Jan 2014 20:32:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:32:09 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:32:09 - job_xml_thread(): Done retrieving: data size 43626301
Sat 18 Jan 2014 20:32:09 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:32:09 - XML: Start document: iteration 17
Sat 18 Jan 2014 20:32:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:32:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:32:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:32:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:32:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:32:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:32:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:32:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:32:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:32:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:32:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:32:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:32:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:32:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:32:20 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:32:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:32:21 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:32:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 20:32:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 20:32:21 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:32:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5806 values 91857 bits 11482 bytes 
Sat 18 Jan 2014 20:32:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:32:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:32:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:32:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:32:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:32:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:32:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:32:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:32:26 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 20:32:26 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:32:26 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:32:26 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:32:26 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:32:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:32:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43630113
Sat 18 Jan 2014 20:32:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:32:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43630113
Sat 18 Jan 2014 20:32:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:32:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:32:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:32:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:32:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:32:42 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:32:42 - job_xml_thread(): Done retrieving: data size 43630113
Sat 18 Jan 2014 20:32:42 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:32:42 - XML: Start document: iteration 18
Sat 18 Jan 2014 20:32:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:32:50 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:32:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:32:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:32:51 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:32:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 20:32:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:32:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:32:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:32:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:32:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:32:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:32:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:32:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:32:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:32:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:32:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:32:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:32:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:32:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:32:55 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 20:32:55 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:32:55 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:32:55 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:32:55 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:32:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:32:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43651495
Sat 18 Jan 2014 20:32:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:32:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43651495
Sat 18 Jan 2014 20:32:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:33:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:33:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:33:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:33:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:33:10 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:33:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:33:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:33:11 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:33:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:33:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:33:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:33:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:33:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:33:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:33:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:33:14 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:33:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:33:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:33:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:33:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:33:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:33:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:33:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:33:18 - job_xml_thread(): Done retrieving: data size 43637208
Sat 18 Jan 2014 20:33:18 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:33:18 - XML: Start document: iteration 19
Sat 18 Jan 2014 20:33:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43637208
Sat 18 Jan 2014 20:33:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:33:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43637208
Sat 18 Jan 2014 20:33:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:33:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:33:21 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:33:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:33:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 20:33:22 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:33:22 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:33:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 20:33:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8713 values 137832 bits 17229 bytes 
Sat 18 Jan 2014 20:33:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:33:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:33:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:33:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:33:35 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 20:33:35 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:33:35 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:33:35 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:33:35 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:33:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:33:39 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:33:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:33:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:33:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:33:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:33:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:33:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:33:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:33:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:33:41 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:33:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:33:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:33:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:33:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:33:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:33:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:33:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:33:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43659154
Sat 18 Jan 2014 20:33:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:33:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43659154
Sat 18 Jan 2014 20:33:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:33:50 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:33:50 - job_xml_thread(): Done retrieving: data size 43659154
Sat 18 Jan 2014 20:33:50 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:33:50 - XML: Start document: iteration 20
Sat 18 Jan 2014 20:33:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:33:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:33:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:33:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:33:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:33:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:33:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:33:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:33:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:33:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:33:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:33:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:33:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:34:02 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 20:34:02 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:34:02 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:34:02 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:34:02 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:34:05 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:34:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 20:34:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:34:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:34:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:34:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:34:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:34:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:34:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:34:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:34:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:34:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:34:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43612579
Sat 18 Jan 2014 20:34:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:34:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43612579
Sat 18 Jan 2014 20:34:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:34:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:34:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:34:17 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:34:17 - job_xml_thread(): Done retrieving: data size 43612579
Sat 18 Jan 2014 20:34:18 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:34:18 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 20:34:18 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 20:34:18 - Housekeeping: done.
Sat 18 Jan 2014 20:34:18 - XML: Start document: iteration 0
Sat 18 Jan 2014 20:34:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:34:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:34:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:34:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:34:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:34:22 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:34:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:34:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:34:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:34:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:34:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:34:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:34:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:34:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:34:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 20:34:24 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:34:24 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:34:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5909 values 93300 bits 11662 bytes 
Sat 18 Jan 2014 20:34:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 20:34:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:34:34 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:34:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:34:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:34:35 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 20:34:35 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:34:35 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:34:35 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:34:35 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:34:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:34:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:34:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:34:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:34:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:34:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:34:41 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:34:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 20:34:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:34:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:34:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43604106
Sat 18 Jan 2014 20:34:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:34:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43604106
Sat 18 Jan 2014 20:34:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:34:50 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:34:50 - job_xml_thread(): Done retrieving: data size 43604106
Sat 18 Jan 2014 20:34:50 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:34:50 - XML: Start document: iteration 1
Sat 18 Jan 2014 20:34:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:34:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:34:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:34:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:34:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:34:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:34:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:34:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:34:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:34:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:34:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:34:59 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:34:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:34:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:34:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:35:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:35:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:35:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:35:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:35:03 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 20:35:03 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:35:03 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:35:03 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:35:03 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:35:05 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 20:35:05 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 20:35:05 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:35:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:35:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43619281
Sat 18 Jan 2014 20:35:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:35:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43619281
Sat 18 Jan 2014 20:35:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:35:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:35:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:35:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:35:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:35:19 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:35:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:35:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:35:20 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:35:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:35:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:35:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:35:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:35:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:35:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:35:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:35:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:35:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:35:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:35:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:35:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:35:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:35:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:35:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:35:23 - job_xml_thread(): Done retrieving: data size 43568938
Sat 18 Jan 2014 20:35:23 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:35:23 - XML: Start document: iteration 2
Sat 18 Jan 2014 20:35:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568938
Sat 18 Jan 2014 20:35:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:35:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568938
Sat 18 Jan 2014 20:35:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:35:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:35:25 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:35:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:35:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 20:35:27 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:35:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9009 values 142161 bits 17770 bytes 
Sat 18 Jan 2014 20:35:27 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:35:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 20:35:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:35:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:35:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:35:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:35:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:35:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:35:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:35:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:35:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:35:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:35:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:35:42 - XML: Processed 653448 elements - found 0 jobs
Sat 18 Jan 2014 20:35:42 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:35:42 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:35:42 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:35:42 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:35:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:35:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:35:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:35:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:35:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:35:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:35:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:35:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:35:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:35:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43021238
Sat 18 Jan 2014 20:35:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:35:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43021238
Sat 18 Jan 2014 20:35:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:35:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:35:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:35:58 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:35:58 - job_xml_thread(): Done retrieving: data size 43021238
Sat 18 Jan 2014 20:35:58 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:35:58 - XML: Start document: iteration 3
Sat 18 Jan 2014 20:36:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:36:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:36:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:36:02 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:36:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:36:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:36:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:36:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:36:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:36:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:36:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:36:05 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:36:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 20:36:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:36:12 - XML: Processed 646712 elements - found 0 jobs
Sat 18 Jan 2014 20:36:12 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:36:13 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:36:13 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:36:13 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:36:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:36:13 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:36:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:36:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:36:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:36:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:36:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:36:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:36:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:36:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42976035
Sat 18 Jan 2014 20:36:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:36:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42976035
Sat 18 Jan 2014 20:36:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:36:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:36:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:36:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:36:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:36:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:36:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:36:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:36:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:36:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:36:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:36:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42976035
Sat 18 Jan 2014 20:36:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:36:28 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:36:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:36:28 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:36:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:36:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:36:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:36:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:36:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 20:36:29 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:36:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 20:36:29 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:36:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6174 values 97395 bits 12174 bytes 
Sat 18 Jan 2014 20:36:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:36:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:36:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:36:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:36:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:36:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:36:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:36:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:36:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:36:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:36:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:36:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:36:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:36:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:36:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:36:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:36:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:36:40 - job_xml_thread(): Done retrieving: data size 43480674
Sat 18 Jan 2014 20:36:40 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:36:40 - XML: Start document: iteration 4
Sat 18 Jan 2014 20:36:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43480674
Sat 18 Jan 2014 20:36:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:36:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43480674
Sat 18 Jan 2014 20:36:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:36:52 - XML: Processed 652594 elements - found 0 jobs
Sat 18 Jan 2014 20:36:52 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:36:52 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:36:52 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:36:52 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:36:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:36:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:36:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:36:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:36:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:36:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:36:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:36:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:36:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:36:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:36:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:36:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:36:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:37:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:37:01 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:37:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:37:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:37:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:37:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:37:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:37:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:37:02 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:37:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 20:37:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:37:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:37:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43630107
Sat 18 Jan 2014 20:37:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:37:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43630107
Sat 18 Jan 2014 20:37:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:37:07 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:37:07 - job_xml_thread(): Done retrieving: data size 43630107
Sat 18 Jan 2014 20:37:07 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:37:07 - XML: Start document: iteration 5
Sat 18 Jan 2014 20:37:08 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 20:37:08 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:37:09 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:37:09 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:37:09 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 20:37:09 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 20:37:09 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 20:37:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:37:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:37:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:37:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:37:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:37:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:37:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:37:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:37:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:37:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:37:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:37:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:37:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:37:22 - XML: Processed 654100 elements - found 0 jobs
Sat 18 Jan 2014 20:37:22 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:37:22 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:37:22 - job_xml_thread(): Done parsing.
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sat 18 Jan 2014 20:37:22 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:37:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:37:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:37:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:37:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:37:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:37:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:37:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:37:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:37:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:37:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43638794
Sat 18 Jan 2014 20:37:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:37:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43638794
Sat 18 Jan 2014 20:37:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:37:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:37:29 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:37:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:37:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 20:37:31 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:37:31 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:37:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 20:37:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8874 values 139989 bits 17498 bytes 
Sat 18 Jan 2014 20:37:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:37:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:37:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:37:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:37:37 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:37:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:37:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:37:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:37:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:37:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:37:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:37:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:37:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:37:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:37:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:37:42 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:37:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:37:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:37:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:37:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:37:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:37:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:37:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:37:44 - job_xml_thread(): Done retrieving: data size 43651204
Sat 18 Jan 2014 20:37:44 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:37:44 - XML: Start document: iteration 6
Sat 18 Jan 2014 20:37:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43651204
Sat 18 Jan 2014 20:37:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:37:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43651204
Sat 18 Jan 2014 20:37:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:37:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:37:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:37:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:37:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:38:00 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 20:38:00 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:38:00 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:38:00 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:38:00 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:38:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:38:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:38:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:38:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:38:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:38:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:38:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:38:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:38:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:38:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:38:06 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:38:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:38:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:38:08 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:38:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 20:38:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:38:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:38:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:38:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:38:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:38:09 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:38:09 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:38:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:38:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43630620
Sat 18 Jan 2014 20:38:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:38:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43630620
Sat 18 Jan 2014 20:38:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:38:10 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:38:10 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:38:10 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 20:38:11 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 20:38:11 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 20:38:14 - size of cluster 'LISA Cluster': 624 hosts 79467 metrics 812379 values 12812731 bits 1601591 bytes 
Sat 18 Jan 2014 20:38:15 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:38:15 - job_xml_thread(): Done retrieving: data size 43630620
Sat 18 Jan 2014 20:38:15 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:38:15 - XML: Start document: iteration 7
Sat 18 Jan 2014 20:38:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:38:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:38:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:38:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:38:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:38:24 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:38:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:38:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:38:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:38:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:38:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:38:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:38:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:38:27 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 20:38:27 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:38:27 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:38:27 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:38:27 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:38:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:38:32 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:38:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:38:32 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:38:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:38:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:38:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:38:32 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:38:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 20:38:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 20:38:32 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:38:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5691 values 89818 bits 11227 bytes 
Sat 18 Jan 2014 20:38:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:38:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:38:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:38:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:38:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:38:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43614993
Sat 18 Jan 2014 20:38:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:38:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43614993
Sat 18 Jan 2014 20:38:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:38:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:38:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:38:42 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:38:43 - job_xml_thread(): Done retrieving: data size 43614993
Sat 18 Jan 2014 20:38:43 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:38:43 - XML: Start document: iteration 8
Sat 18 Jan 2014 20:38:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:38:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:38:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:38:53 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:38:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:38:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:38:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:38:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:38:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:38:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:38:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:38:57 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 20:38:57 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:38:57 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:38:57 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:38:57 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:39:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:39:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:39:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:39:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:39:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:39:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:39:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:39:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:39:02 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:39:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 20:39:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:39:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:39:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43638638
Sat 18 Jan 2014 20:39:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:39:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43638638
Sat 18 Jan 2014 20:39:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:39:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:39:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:39:11 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:39:11 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 20:39:12 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:39:12 - job_xml_thread(): Done retrieving: data size 43638638
Sat 18 Jan 2014 20:39:12 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:39:12 - XML: Start document: iteration 9
Sat 18 Jan 2014 20:39:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:39:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:39:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:39:18 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:39:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:39:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:39:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:39:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:39:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:39:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:39:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:39:28 - XML: Processed 654191 elements - found 0 jobs
Sat 18 Jan 2014 20:39:28 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:39:28 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:39:28 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:39:28 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:39:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:39:29 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:39:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:39:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:39:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:39:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:39:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:39:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:39:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:39:32 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:39:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:39:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43621128
Sat 18 Jan 2014 20:39:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:39:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:39:33 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:39:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 20:39:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 20:39:33 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:39:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43621128
Sat 18 Jan 2014 20:39:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:39:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5361 values 84494 bits 10561 bytes 
Sat 18 Jan 2014 20:39:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:39:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:39:43 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:39:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:39:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:39:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:39:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:39:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:39:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:39:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:39:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:39:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:39:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:39:47 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:39:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:39:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:39:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:39:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:39:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:39:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:39:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:39:52 - job_xml_thread(): Done retrieving: data size 43611805
Sat 18 Jan 2014 20:39:52 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:39:52 - XML: Start document: iteration 10
Sat 18 Jan 2014 20:39:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43611805
Sat 18 Jan 2014 20:39:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:39:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43611805
Sat 18 Jan 2014 20:39:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:39:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:39:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:40:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:40:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:40:05 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 20:40:05 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:40:05 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:40:05 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:40:05 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:40:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:40:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:40:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:40:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:40:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:40:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:40:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:40:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:40:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:40:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:40:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:40:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:40:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:40:17 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:40:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 20:40:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:40:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:40:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:40:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:40:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:40:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:40:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43629789
Sat 18 Jan 2014 20:40:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:40:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43629789
Sat 18 Jan 2014 20:40:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:40:21 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:40:21 - job_xml_thread(): Done retrieving: data size 43629789
Sat 18 Jan 2014 20:40:21 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:40:21 - XML: Start document: iteration 11
Sat 18 Jan 2014 20:40:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:40:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:40:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:40:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:40:33 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 20:40:33 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:40:33 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:40:33 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:40:33 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:40:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:40:33 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:40:34 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:40:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:40:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 20:40:34 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:40:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 20:40:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5777 values 91109 bits 11388 bytes 
Sat 18 Jan 2014 20:40:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:40:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:40:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:40:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:40:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:40:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:40:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:40:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:40:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:40:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:40:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:40:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:40:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:40:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:40:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:40:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:40:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:40:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:40:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43646682
Sat 18 Jan 2014 20:40:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:40:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43646682
Sat 18 Jan 2014 20:40:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:40:48 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:40:48 - job_xml_thread(): Done retrieving: data size 43646682
Sat 18 Jan 2014 20:40:48 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:40:48 - XML: Start document: iteration 12
Sat 18 Jan 2014 20:40:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:40:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:41:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:41:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:41:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:41:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:41:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:41:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:41:10 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 20:41:10 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:41:10 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:41:10 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:41:10 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:41:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:41:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:41:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:41:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:41:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:41:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:41:11 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:41:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:41:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:41:12 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:41:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 20:41:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:41:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:41:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:41:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:41:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:41:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:41:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43594684
Sat 18 Jan 2014 20:41:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:41:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43594684
Sat 18 Jan 2014 20:41:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:41:25 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:41:25 - job_xml_thread(): Done retrieving: data size 43594684
Sat 18 Jan 2014 20:41:25 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:41:25 - XML: Start document: iteration 13
Sat 18 Jan 2014 20:41:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:41:26 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:41:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:41:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:41:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:41:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:41:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:41:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:41:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:41:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:41:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:41:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:41:35 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:41:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:41:35 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:41:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 20:41:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 20:41:35 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:41:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5851 values 92259 bits 11532 bytes 
Sat 18 Jan 2014 20:41:38 - XML: Processed 653448 elements - found 0 jobs
Sat 18 Jan 2014 20:41:38 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:41:38 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:41:38 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:41:38 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:41:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:41:38 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:41:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:41:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:41:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:41:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:41:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:41:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:41:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:41:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:41:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:41:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43145444
Sat 18 Jan 2014 20:41:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:41:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43145444
Sat 18 Jan 2014 20:41:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:41:53 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:41:53 - job_xml_thread(): Done retrieving: data size 43145444
Sat 18 Jan 2014 20:41:53 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:41:53 - XML: Start document: iteration 14
Sat 18 Jan 2014 20:41:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:41:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:41:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:41:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:41:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:41:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:41:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:41:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:41:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:41:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:41:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:42:00 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:42:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 20:42:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:42:02 - XML: Processed 648488 elements - found 0 jobs
Sat 18 Jan 2014 20:42:02 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:42:02 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:42:02 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:42:02 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:42:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:42:06 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:42:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:42:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:42:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:42:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:42:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:42:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:42:07 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 20:42:07 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 20:42:07 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:42:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:42:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42940993
Sat 18 Jan 2014 20:42:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:42:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42940993
Sat 18 Jan 2014 20:42:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:42:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:42:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:42:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:42:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:42:18 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:42:18 - job_xml_thread(): Done retrieving: data size 42940993
Sat 18 Jan 2014 20:42:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:42:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:42:18 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:42:18 - XML: Start document: iteration 15
Sat 18 Jan 2014 20:42:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:42:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:42:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:42:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:42:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:42:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:42:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:42:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:42:27 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:42:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:42:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:42:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:42:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:42:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:42:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:42:30 - XML: Processed 645998 elements - found 0 jobs
Sat 18 Jan 2014 20:42:30 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:42:30 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:42:30 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:42:30 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:42:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:42:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43064015
Sat 18 Jan 2014 20:42:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:42:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43064015
Sat 18 Jan 2014 20:42:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:42:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:42:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:42:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:42:36 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:42:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:42:38 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:42:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 20:42:38 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:42:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 20:42:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9134 values 144063 bits 18007 bytes 
Sat 18 Jan 2014 20:42:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:42:43 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:42:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:42:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:42:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:42:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:42:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:42:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:42:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:42:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:42:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:42:45 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:42:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:42:46 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:42:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:42:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:42:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:42:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:42:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:42:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:42:49 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:42:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 20:42:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:42:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:42:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43590220
Sat 18 Jan 2014 20:42:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:42:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43590220
Sat 18 Jan 2014 20:42:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:42:50 - job_xml_thread(): Done retrieving: data size 43590220
Sat 18 Jan 2014 20:42:50 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:42:50 - XML: Start document: iteration 16
Sat 18 Jan 2014 20:42:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:42:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:43:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:43:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:43:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:43:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:43:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:43:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:43:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:43:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:43:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:43:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:43:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:43:08 - XML: Processed 653570 elements - found 0 jobs
Sat 18 Jan 2014 20:43:08 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:43:08 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:43:08 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:43:08 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:43:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:43:13 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:43:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:43:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:43:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:43:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:43:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:43:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:43:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:43:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43628273
Sat 18 Jan 2014 20:43:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:43:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43628273
Sat 18 Jan 2014 20:43:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:43:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:43:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:43:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:43:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:43:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:43:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:43:24 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:43:24 - job_xml_thread(): Done retrieving: data size 43628273
Sat 18 Jan 2014 20:43:24 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:43:24 - XML: Start document: iteration 17
Sat 18 Jan 2014 20:43:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:43:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:43:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:43:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:43:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43628273
Sat 18 Jan 2014 20:43:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:43:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:43:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:43:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:43:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:43:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:43:38 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:43:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:43:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 20:43:38 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:43:38 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:43:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 20:43:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99080 bits 12385 bytes 
Sat 18 Jan 2014 20:43:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:43:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:43:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:43:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:43:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:43:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:43:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:43:43 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 20:43:43 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:43:43 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:43:43 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:43:43 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:43:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:43:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:43:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:43:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:43:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:43:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:43:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:43:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:43:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:43:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43652936
Sat 18 Jan 2014 20:43:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:43:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43652936
Sat 18 Jan 2014 20:43:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:43:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:43:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:43:56 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:43:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 20:43:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:43:58 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:43:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:44:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:44:00 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:44:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:44:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:44:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:44:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:44:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:44:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:44:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:44:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:44:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:44:01 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:44:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:44:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:44:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:44:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:44:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:44:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:44:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:44:03 - job_xml_thread(): Done retrieving: data size 43641680
Sat 18 Jan 2014 20:44:03 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:44:03 - XML: Start document: iteration 18
Sat 18 Jan 2014 20:44:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43641680
Sat 18 Jan 2014 20:44:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:44:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43641680
Sat 18 Jan 2014 20:44:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:44:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:44:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:44:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:44:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:44:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:44:20 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:44:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:44:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:44:20 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 20:44:20 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:44:20 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:44:20 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:44:20 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:44:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:44:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:44:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:44:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:44:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:44:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:44:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:44:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:44:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:44:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:44:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:44:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:44:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:44:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:44:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43642795
Sat 18 Jan 2014 20:44:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:44:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43642795
Sat 18 Jan 2014 20:44:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:44:36 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:44:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:44:37 - job_xml_thread(): Done retrieving: data size 43642795
Sat 18 Jan 2014 20:44:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:44:37 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:44:37 - XML: Start document: iteration 19
Sat 18 Jan 2014 20:44:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:44:38 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:44:40 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:44:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 20:44:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:44:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 20:44:40 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:44:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9352 values 147470 bits 18433 bytes 
Sat 18 Jan 2014 20:44:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:44:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:44:49 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 20:44:49 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:44:49 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:44:49 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:44:49 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:44:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:44:49 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:44:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:44:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:44:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:44:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:44:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:44:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:44:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:44:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:44:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:44:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:44:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:44:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:44:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:44:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:44:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:44:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:44:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43635659
Sat 18 Jan 2014 20:44:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:44:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43635659
Sat 18 Jan 2014 20:44:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:45:04 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:45:04 - job_xml_thread(): Done retrieving: data size 43635659
Sat 18 Jan 2014 20:45:04 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:45:05 - XML: Start document: iteration 20
Sat 18 Jan 2014 20:45:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:45:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:45:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:45:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:45:11 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 20:45:11 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:45:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:45:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:45:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:45:12 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:45:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:45:12 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 20:45:12 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:45:12 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 20:45:13 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 20:45:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:45:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:45:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:45:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:45:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:45:15 - size of cluster 'LISA Cluster': 624 hosts 79479 metrics 835812 values 13174939 bits 1646867 bytes 
Sat 18 Jan 2014 20:45:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:45:19 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:45:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:45:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:45:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:45:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:45:21 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 20:45:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:45:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:45:21 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:45:21 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:45:21 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:45:21 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:45:21 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:45:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 20:45:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:45:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:45:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43609776
Sat 18 Jan 2014 20:45:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:45:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43609776
Sat 18 Jan 2014 20:45:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:45:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:45:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:45:36 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:45:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:45:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:45:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:45:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:45:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:45:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:45:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:45:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:45:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:45:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:45:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:45:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:45:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:45:40 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:45:40 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:45:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:45:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:45:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:45:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:45:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:45:40 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:45:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:45:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:45:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 20:45:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 20:45:40 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:45:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5853 values 92289 bits 11536 bytes 
Sat 18 Jan 2014 20:45:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:45:45 - job_xml_thread(): Done retrieving: data size 43633188
Sat 18 Jan 2014 20:45:45 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:45:45 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 20:45:45 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 20:45:45 - Housekeeping: done.
Sat 18 Jan 2014 20:45:45 - XML: Start document: iteration 0
Sat 18 Jan 2014 20:45:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43633188
Sat 18 Jan 2014 20:45:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:45:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43633188
Sat 18 Jan 2014 20:45:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:45:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:45:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:45:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:45:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:46:00 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 20:46:00 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:46:00 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:46:00 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:46:00 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:46:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:46:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:46:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:46:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:46:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:46:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:46:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:46:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:46:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:46:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:46:11 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:46:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:46:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:46:15 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:46:15 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 20:46:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:46:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:46:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:46:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:46:15 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:46:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 20:46:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:46:15 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:46:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:46:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43632298
Sat 18 Jan 2014 20:46:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:46:19 - job_xml_thread(): Done retrieving: data size 43632298
Sat 18 Jan 2014 20:46:19 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:46:19 - XML: Start document: iteration 1
Sat 18 Jan 2014 20:46:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43632298
Sat 18 Jan 2014 20:46:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:46:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:46:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:46:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:46:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:46:37 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 20:46:37 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:46:37 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:46:37 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:46:37 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:46:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:46:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:46:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:46:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:46:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:46:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:46:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:46:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:46:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:46:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:46:40 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:46:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:46:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:46:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:46:40 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:46:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:46:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:46:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:46:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:46:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:46:41 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:46:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 20:46:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 20:46:41 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:46:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5502 values 86792 bits 10849 bytes 
Sat 18 Jan 2014 20:46:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:46:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43653000
Sat 18 Jan 2014 20:46:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:46:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43653000
Sat 18 Jan 2014 20:46:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:46:52 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:46:52 - job_xml_thread(): Done retrieving: data size 43653000
Sat 18 Jan 2014 20:46:52 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:46:52 - XML: Start document: iteration 2
Sat 18 Jan 2014 20:46:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:46:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:46:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:46:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:46:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:46:56 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:46:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:46:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:46:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:46:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:46:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:46:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:46:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:47:09 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 20:47:09 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:47:09 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:47:09 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:47:09 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:47:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:47:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:47:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:47:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:47:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:47:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:47:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:47:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:47:10 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:47:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 20:47:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:47:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:47:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:47:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:47:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43609203
Sat 18 Jan 2014 20:47:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:47:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43609203
Sat 18 Jan 2014 20:47:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:47:24 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:47:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:47:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:47:25 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:47:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:47:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:47:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:47:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:47:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:47:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:47:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:47:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:47:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:47:29 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:47:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:47:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:47:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:47:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:47:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:47:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:47:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:47:33 - job_xml_thread(): Done retrieving: data size 43540574
Sat 18 Jan 2014 20:47:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43540574
Sat 18 Jan 2014 20:47:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:47:33 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:47:33 - XML: Start document: iteration 3
Sat 18 Jan 2014 20:47:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43540574
Sat 18 Jan 2014 20:47:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:47:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:47:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:47:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:47:41 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:47:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:47:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 20:47:42 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:47:42 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:47:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 20:47:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8939 values 141315 bits 17664 bytes 
Sat 18 Jan 2014 20:47:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:47:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:47:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:47:48 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:47:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:47:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:47:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:47:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:47:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:47:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:47:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:47:51 - XML: Processed 652920 elements - found 0 jobs
Sat 18 Jan 2014 20:47:51 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:47:51 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:47:51 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:47:51 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:47:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:47:56 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:47:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:47:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:47:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:47:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:47:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:47:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:48:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:48:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42970189
Sat 18 Jan 2014 20:48:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:48:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42970189
Sat 18 Jan 2014 20:48:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:48:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:48:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:48:06 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:48:07 - job_xml_thread(): Done retrieving: data size 42970189
Sat 18 Jan 2014 20:48:07 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:48:07 - XML: Start document: iteration 4
Sat 18 Jan 2014 20:48:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:48:07 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:48:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:48:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:48:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:48:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:48:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:48:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:48:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42970189
Sat 18 Jan 2014 20:48:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:48:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:48:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:48:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:48:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:48:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:48:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:48:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:48:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:48:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:48:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:48:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:48:27 - XML: Processed 646086 elements - found 0 jobs
Sat 18 Jan 2014 20:48:27 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:48:27 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:48:28 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:48:28 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:48:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:48:28 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:48:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:48:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:48:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:48:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:48:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:48:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:48:29 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:48:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 20:48:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:48:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:48:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43053513
Sat 18 Jan 2014 20:48:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:48:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43053513
Sat 18 Jan 2014 20:48:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:48:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:48:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:48:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:48:42 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:48:42 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:48:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 20:48:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:48:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 20:48:43 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:48:43 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:48:43 - job_xml_thread(): Done retrieving: data size 43053513
Sat 18 Jan 2014 20:48:43 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:48:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5841 values 92302 bits 11537 bytes 
Sat 18 Jan 2014 20:48:43 - XML: Start document: iteration 5
Sat 18 Jan 2014 20:48:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:48:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:48:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:48:44 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:48:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:48:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:48:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:48:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:48:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:48:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:48:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:48:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:48:54 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:48:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:48:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:48:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:48:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:48:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:48:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:48:57 - XML: Processed 646744 elements - found 0 jobs
Sat 18 Jan 2014 20:48:57 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:48:57 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:48:57 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:48:57 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:49:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:49:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:49:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:49:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43589064
Sat 18 Jan 2014 20:49:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:49:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43589064
Sat 18 Jan 2014 20:49:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:49:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:49:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:49:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:49:10 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:49:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:49:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:49:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:49:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:49:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:49:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:49:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:49:11 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:49:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 20:49:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:49:12 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:49:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:49:16 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:49:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:49:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:49:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:49:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:49:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:49:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:49:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:49:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43635255
Sat 18 Jan 2014 20:49:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:49:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43635255
Sat 18 Jan 2014 20:49:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:49:21 - job_xml_thread(): Done retrieving: data size 43635255
Sat 18 Jan 2014 20:49:21 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:49:21 - XML: Start document: iteration 6
Sat 18 Jan 2014 20:49:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:49:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:49:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:49:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:49:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:49:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:49:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:49:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:49:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:49:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:49:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:49:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:49:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:49:41 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 20:49:41 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:49:41 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:49:41 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:49:41 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:49:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:49:42 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:49:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:49:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 20:49:43 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:49:43 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:49:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 20:49:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6065 values 95711 bits 11963 bytes 
Sat 18 Jan 2014 20:49:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:49:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:49:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:49:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:49:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:49:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:49:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:49:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:49:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:49:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43626566
Sat 18 Jan 2014 20:49:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:49:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43626566
Sat 18 Jan 2014 20:49:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:49:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:49:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:49:56 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:49:56 - job_xml_thread(): Done retrieving: data size 43626566
Sat 18 Jan 2014 20:49:56 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:49:56 - XML: Start document: iteration 7
Sat 18 Jan 2014 20:49:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:49:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:50:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:50:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:50:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:50:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:50:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:50:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:50:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:50:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:50:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:50:08 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:50:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 20:50:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:50:11 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 20:50:11 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:50:11 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:50:11 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:50:11 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:50:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:50:13 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:50:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:50:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:50:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:50:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:50:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:50:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:50:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:50:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43634494
Sat 18 Jan 2014 20:50:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:50:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43634494
Sat 18 Jan 2014 20:50:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:50:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:50:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:50:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:50:25 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:50:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:50:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:50:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:50:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:50:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43634494
Sat 18 Jan 2014 20:50:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:50:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:50:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:50:26 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:50:26 - job_xml_thread(): Done retrieving: data size 43634494
Sat 18 Jan 2014 20:50:26 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:50:26 - XML: Start document: iteration 8
Sat 18 Jan 2014 20:50:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:50:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:50:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:50:39 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:50:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:50:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:50:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:50:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:50:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:50:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:50:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:50:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:50:43 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:50:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:50:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:50:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:50:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:50:44 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:50:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 20:50:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:50:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 20:50:44 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:50:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5938 values 93683 bits 11710 bytes 
Sat 18 Jan 2014 20:50:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:50:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:50:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:50:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:50:47 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 20:50:47 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:50:47 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:50:47 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:50:47 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:50:50 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 20:50:50 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 20:50:50 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:50:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:50:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43626390
Sat 18 Jan 2014 20:50:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:50:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43626390
Sat 18 Jan 2014 20:50:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:50:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:50:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:50:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:50:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:50:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:50:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:51:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:51:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:51:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:51:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:51:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:51:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:51:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:51:02 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:51:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:51:04 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:51:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:51:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:51:05 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:51:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 20:51:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:51:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:51:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:51:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:51:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:51:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:51:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43622874
Sat 18 Jan 2014 20:51:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:51:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43622874
Sat 18 Jan 2014 20:51:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:51:08 - job_xml_thread(): Done retrieving: data size 43622874
Sat 18 Jan 2014 20:51:08 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:51:08 - XML: Start document: iteration 9
Sat 18 Jan 2014 20:51:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:51:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:51:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:51:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:51:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:51:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:51:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:51:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:51:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:51:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:51:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:51:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:51:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:51:28 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 20:51:28 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:51:28 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:51:28 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:51:28 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:51:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:51:30 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:51:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:51:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:51:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:51:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:51:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:51:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:51:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:51:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43621643
Sat 18 Jan 2014 20:51:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:51:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43621643
Sat 18 Jan 2014 20:51:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:51:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:51:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:51:43 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:51:43 - job_xml_thread(): Done retrieving: data size 43621643
Sat 18 Jan 2014 20:51:44 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:51:44 - XML: Start document: iteration 10
Sat 18 Jan 2014 20:51:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:51:44 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:51:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:51:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 20:51:45 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:51:45 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:51:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8792 values 138654 bits 17331 bytes 
Sat 18 Jan 2014 20:51:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 20:51:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:51:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:51:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:51:49 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:51:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:51:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:51:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:51:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:51:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:51:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:51:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:51:57 - XML: Processed 654191 elements - found 0 jobs
Sat 18 Jan 2014 20:51:57 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:51:57 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:51:57 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:51:57 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:51:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:51:59 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:51:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:51:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:51:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:51:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:51:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:51:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:52:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:52:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43633285
Sat 18 Jan 2014 20:52:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:52:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43633285
Sat 18 Jan 2014 20:52:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:52:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:52:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:52:12 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:52:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:52:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:52:13 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:52:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:52:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:52:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:52:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:52:15 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 20:52:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:52:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:52:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:52:15 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:52:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:52:16 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:52:16 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 20:52:16 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 20:52:17 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:52:17 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 20:52:18 - size of cluster 'LISA Cluster': 624 hosts 79484 metrics 708542 values 11182683 bits 1397835 bytes 
Sat 18 Jan 2014 20:52:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:52:20 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:52:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:52:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:52:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:52:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:52:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:52:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:52:21 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:52:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 20:52:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:52:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:52:25 - job_xml_thread(): Done retrieving: data size 43613197
Sat 18 Jan 2014 20:52:25 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:52:25 - XML: Start document: iteration 11
Sat 18 Jan 2014 20:52:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43613197
Sat 18 Jan 2014 20:52:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43613197
Sat 18 Jan 2014 20:52:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:52:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:52:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:52:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:52:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:52:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:52:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:52:41 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:52:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:52:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:52:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:52:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:52:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:52:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:52:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:52:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:52:46 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:52:46 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 20:52:46 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:52:46 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:52:47 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:52:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:52:47 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:52:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 20:52:47 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:52:47 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:52:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5776 values 91073 bits 11384 bytes 
Sat 18 Jan 2014 20:52:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 20:52:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:52:48 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:52:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:52:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:52:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:52:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:52:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:52:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:52:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:52:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43620218
Sat 18 Jan 2014 20:52:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:52:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43620218
Sat 18 Jan 2014 20:52:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:52:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:52:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:53:03 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:53:03 - job_xml_thread(): Done retrieving: data size 43620218
Sat 18 Jan 2014 20:53:03 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:53:03 - XML: Start document: iteration 12
Sat 18 Jan 2014 20:53:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:53:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:53:07 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:53:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 20:53:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:53:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:53:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:53:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:53:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:53:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:53:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:53:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:53:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:53:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:53:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:53:14 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:53:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:53:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:53:15 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 20:53:15 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:53:15 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:53:15 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:53:15 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:53:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:53:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:53:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:53:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:53:17 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:53:17 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 20:53:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:53:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564559
Sat 18 Jan 2014 20:53:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:53:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564559
Sat 18 Jan 2014 20:53:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:53:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:53:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:53:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:53:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:53:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:53:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:53:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:53:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:53:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564559
Sat 18 Jan 2014 20:53:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:53:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:53:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:53:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:53:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:53:30 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:53:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:53:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:53:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:53:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:53:42 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:53:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:53:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:53:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:53:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:53:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:53:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:53:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:53:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:53:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:53:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:53:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:53:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:53:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:53:45 - job_xml_thread(): Done retrieving: data size 43084104
Sat 18 Jan 2014 20:53:45 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:53:45 - XML: Start document: iteration 13
Sat 18 Jan 2014 20:53:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43084104
Sat 18 Jan 2014 20:53:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:53:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43084104
Sat 18 Jan 2014 20:53:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:53:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:53:47 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:53:49 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:53:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:53:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 20:53:49 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:53:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 20:53:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6171 values 97368 bits 12171 bytes 
Sat 18 Jan 2014 20:53:54 - XML: Processed 647718 elements - found 0 jobs
Sat 18 Jan 2014 20:53:54 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:53:54 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:53:54 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:53:54 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:53:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:53:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:53:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:53:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:54:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:54:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:54:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:54:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:54:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:54:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:54:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:54:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:54:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:54:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:54:05 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:54:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:54:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:54:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:54:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:54:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:54:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:54:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:54:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43023141
Sat 18 Jan 2014 20:54:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:54:09 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:54:09 - job_xml_thread(): Done retrieving: data size 43023141
Sat 18 Jan 2014 20:54:09 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:54:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43023141
Sat 18 Jan 2014 20:54:09 - XML: Start document: iteration 14
Sat 18 Jan 2014 20:54:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:54:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:54:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:54:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:54:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:54:26 - XML: Processed 646624 elements - found 0 jobs
Sat 18 Jan 2014 20:54:26 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:54:26 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:54:26 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:54:26 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:54:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:54:31 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:54:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:54:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:54:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:54:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:54:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:54:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:54:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:54:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:54:33 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:54:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:54:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:54:33 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:54:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 20:54:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:54:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:54:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:54:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:54:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:54:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:54:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43193982
Sat 18 Jan 2014 20:54:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:54:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43193982
Sat 18 Jan 2014 20:54:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:54:41 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:54:41 - job_xml_thread(): Done retrieving: data size 43193982
Sat 18 Jan 2014 20:54:41 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:54:41 - XML: Start document: iteration 15
Sat 18 Jan 2014 20:54:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:54:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:54:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:54:48 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:54:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:54:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:54:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:54:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:54:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:54:49 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:54:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:54:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:54:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:54:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:54:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:54:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:54:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 20:54:50 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:54:50 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:54:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 20:54:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5822 values 91763 bits 11470 bytes 
Sat 18 Jan 2014 20:55:00 - XML: Processed 648698 elements - found 0 jobs
Sat 18 Jan 2014 20:55:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:55:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:55:00 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:55:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:55:00 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:55:00 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:55:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:55:00 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:55:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:55:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:55:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:55:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:55:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:55:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:55:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:55:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43605107
Sat 18 Jan 2014 20:55:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:55:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43605107
Sat 18 Jan 2014 20:55:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:55:16 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:55:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:55:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:55:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:55:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:55:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:55:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:55:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:55:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:55:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:55:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:55:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:55:19 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:55:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 20:55:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:55:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:55:21 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:55:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:55:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:55:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:55:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:55:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:55:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:55:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:55:23 - job_xml_thread(): Done retrieving: data size 43610214
Sat 18 Jan 2014 20:55:23 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:55:23 - XML: Start document: iteration 16
Sat 18 Jan 2014 20:55:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43610214
Sat 18 Jan 2014 20:55:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:55:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43610214
Sat 18 Jan 2014 20:55:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:55:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:55:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:55:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:55:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:55:42 - XML: Processed 654194 elements - found 0 jobs
Sat 18 Jan 2014 20:55:42 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:55:42 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:55:42 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:55:43 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:55:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:55:45 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:55:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:55:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:55:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:55:46 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:55:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:55:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:55:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:55:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:55:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:55:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:55:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:55:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:55:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:55:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:55:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:55:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:55:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43646771
Sat 18 Jan 2014 20:55:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:55:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:55:50 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:55:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:55:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 20:55:51 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:55:51 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:55:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 20:55:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7041 values 111138 bits 13892 bytes 
Sat 18 Jan 2014 20:55:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43646771
Sat 18 Jan 2014 20:55:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:55:58 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:55:59 - job_xml_thread(): Done retrieving: data size 43646771
Sat 18 Jan 2014 20:55:59 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:55:59 - XML: Start document: iteration 17
Sat 18 Jan 2014 20:56:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:56:00 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:56:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:56:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:56:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:56:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:56:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:56:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:56:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:56:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:56:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:56:11 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 20:56:11 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:56:11 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:56:11 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:56:11 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:56:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:56:14 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:56:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:56:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:56:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:56:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:56:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:56:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:56:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:56:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43615246
Sat 18 Jan 2014 20:56:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:56:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:56:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43615246
Sat 18 Jan 2014 20:56:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:56:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:56:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:56:26 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:56:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:56:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:56:27 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:56:27 - job_xml_thread(): Done retrieving: data size 43615246
Sat 18 Jan 2014 20:56:27 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:56:27 - XML: Start document: iteration 18
Sat 18 Jan 2014 20:56:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:56:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:56:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:56:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:56:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:56:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:56:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:56:38 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 20:56:38 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:56:38 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:56:38 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:56:38 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:56:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:56:40 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:56:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:56:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:56:40 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:56:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 20:56:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:56:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:56:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:56:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:56:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:56:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:56:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43608260
Sat 18 Jan 2014 20:56:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:56:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43608260
Sat 18 Jan 2014 20:56:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:56:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:56:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:56:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:56:51 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:56:52 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:56:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:56:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 20:56:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 20:56:52 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:56:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5911 values 93245 bits 11655 bytes 
Sat 18 Jan 2014 20:56:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:56:55 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:56:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:56:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:56:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:56:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:56:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:56:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:56:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:56:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:56:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:56:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:56:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:56:58 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:56:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:56:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:56:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:56:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:56:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:56:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:57:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:57:02 - job_xml_thread(): Done retrieving: data size 43653149
Sat 18 Jan 2014 20:57:02 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:57:02 - XML: Start document: iteration 19
Sat 18 Jan 2014 20:57:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43653149
Sat 18 Jan 2014 20:57:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:57:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43653149
Sat 18 Jan 2014 20:57:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:57:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:57:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:57:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:57:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:57:19 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 20:57:20 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:57:20 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:57:20 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:57:20 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:57:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:57:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:57:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:57:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:57:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:57:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:57:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:57:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:57:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:57:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:57:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:57:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:57:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:57:27 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:57:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 20:57:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:57:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:57:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:57:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:57:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:57:29 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 20:57:29 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 20:57:29 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:57:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:57:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43651375
Sat 18 Jan 2014 20:57:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:57:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43651375
Sat 18 Jan 2014 20:57:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:57:35 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:57:35 - job_xml_thread(): Done retrieving: data size 43651375
Sat 18 Jan 2014 20:57:35 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:57:35 - XML: Start document: iteration 20
Sat 18 Jan 2014 20:57:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:57:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:57:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:57:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:57:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:57:44 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:57:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:57:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:57:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:57:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:57:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:57:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:57:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:57:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:57:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:57:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:57:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:57:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:57:53 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:57:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:57:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:57:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:57:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:57:53 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 20:57:53 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:57:53 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:57:53 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:57:53 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:57:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:57:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 20:57:54 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:57:54 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:57:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5714 values 90124 bits 11265 bytes 
Sat 18 Jan 2014 20:57:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 20:57:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:57:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43614767
Sat 18 Jan 2014 20:57:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:57:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43614767
Sat 18 Jan 2014 20:57:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:58:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:58:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:58:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:58:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:58:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:58:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:58:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:58:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:58:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:58:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:58:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:58:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:58:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:58:08 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:58:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:58:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:58:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:58:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:58:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:58:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:58:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:58:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:58:10 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:58:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 20:58:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:58:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:58:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43637889
Sat 18 Jan 2014 20:58:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:58:11 - job_xml_thread(): Done retrieving: data size 43637889
Sat 18 Jan 2014 20:58:11 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:58:11 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 20:58:11 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 20:58:11 - Housekeeping: done.
Sat 18 Jan 2014 20:58:11 - XML: Start document: iteration 0
Sat 18 Jan 2014 20:58:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43637889
Sat 18 Jan 2014 20:58:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:58:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:58:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:58:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:58:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:58:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:58:31 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:58:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:58:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:58:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:58:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:58:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:58:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:58:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:58:33 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 20:58:33 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:58:33 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:58:33 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:58:33 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:58:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:58:34 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:58:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:58:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:58:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:58:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:58:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:58:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:58:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:58:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43636249
Sat 18 Jan 2014 20:58:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:58:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43636249
Sat 18 Jan 2014 20:58:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:58:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:58:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:58:48 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:58:48 - job_xml_thread(): Done retrieving: data size 43636249
Sat 18 Jan 2014 20:58:48 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:58:48 - XML: Start document: iteration 1
Sat 18 Jan 2014 20:58:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:58:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:58:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:58:54 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:58:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:58:55 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:58:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 20:58:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 20:58:55 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:58:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7589 values 119679 bits 14959 bytes 
Sat 18 Jan 2014 20:59:01 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 20:59:01 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:59:01 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:59:01 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:59:01 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:59:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:59:01 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:59:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:59:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:59:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:59:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:59:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:59:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:59:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:59:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:59:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:59:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:59:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:59:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:59:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:59:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:59:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:59:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:59:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43646368
Sat 18 Jan 2014 20:59:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:59:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43646368
Sat 18 Jan 2014 20:59:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:59:16 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:59:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:59:17 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 20:59:17 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:59:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:59:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:59:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:59:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:59:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:59:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:59:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:59:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:59:17 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:59:17 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:59:17 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 20:59:17 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 20:59:17 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 20:59:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:59:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:59:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:59:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sat 18 Jan 2014 20:59:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:59:20 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:59:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:59:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:59:20 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:59:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 20:59:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:59:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:59:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:59:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:59:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:59:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:59:22 - job_xml_thread(): Done retrieving: data size 43552205
Sat 18 Jan 2014 20:59:22 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:59:22 - XML: Start document: iteration 2
Sat 18 Jan 2014 20:59:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43552205
Sat 18 Jan 2014 20:59:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:59:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43552205
Sat 18 Jan 2014 20:59:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:59:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:59:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:59:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:59:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 20:59:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:59:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:59:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:59:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:59:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:59:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:59:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 20:59:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 20:59:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 20:59:40 - XML: Processed 653448 elements - found 0 jobs
Sat 18 Jan 2014 20:59:40 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 20:59:40 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 20:59:40 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 20:59:40 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 20:59:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 20:59:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 20:59:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 20:59:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 20:59:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:59:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 20:59:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 20:59:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 20:59:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 20:59:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43040712
Sat 18 Jan 2014 20:59:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 20:59:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43040712
Sat 18 Jan 2014 20:59:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 20:59:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:59:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 20:59:55 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 20:59:55 - job_xml_thread(): Done retrieving: data size 43040712
Sat 18 Jan 2014 20:59:55 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 20:59:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 20:59:55 - XML: Start document: iteration 3
Sat 18 Jan 2014 20:59:55 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:59:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:59:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 20:59:57 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 20:59:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 20:59:57 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 20:59:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 20:59:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 20:59:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 20:59:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 20:59:59 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9248 values 145919 bits 18239 bytes 
Sat 18 Jan 2014 21:00:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:00:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:00:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:00:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:00:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:00:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:00:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:00:07 - XML: Processed 646944 elements - found 0 jobs
Sat 18 Jan 2014 21:00:07 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:00:07 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:00:07 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:00:07 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:00:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:00:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:00:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:00:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:00:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:00:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:00:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:00:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:00:11 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:00:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 21:00:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:00:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:00:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42947423
Sat 18 Jan 2014 21:00:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:00:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42947423
Sat 18 Jan 2014 21:00:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:00:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:00:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:00:18 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:00:18 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:00:20 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:00:20 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 21:00:20 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 21:00:20 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:00:20 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 21:00:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:00:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:00:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:00:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:00:22 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:00:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:00:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:00:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:00:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:00:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:00:23 - size of cluster 'LISA Cluster': 624 hosts 79478 metrics 824333 values 12990026 bits 1623753 bytes 
Sat 18 Jan 2014 21:00:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:00:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:00:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:00:27 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:00:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:00:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:00:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:00:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:00:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:00:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:00:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:00:31 - job_xml_thread(): Done retrieving: data size 43081143
Sat 18 Jan 2014 21:00:31 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:00:31 - XML: Start document: iteration 4
Sat 18 Jan 2014 21:00:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43081143
Sat 18 Jan 2014 21:00:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:00:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43081143
Sat 18 Jan 2014 21:00:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:00:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:00:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:00:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:00:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:00:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:00:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:00:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:00:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:00:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:00:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:00:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:00:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:00:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:00:51 - XML: Processed 647222 elements - found 0 jobs
Sat 18 Jan 2014 21:00:51 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:00:51 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:00:51 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:00:51 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:00:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:00:52 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:00:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:00:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:00:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:00:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:00:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:00:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:00:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:00:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43612551
Sat 18 Jan 2014 21:00:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:00:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43612551
Sat 18 Jan 2014 21:00:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:00:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:00:57 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:00:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:00:58 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:00:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 21:00:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 21:00:58 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:00:59 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6592 values 104129 bits 13016 bytes 
Sat 18 Jan 2014 21:01:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:01:06 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:01:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:01:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:01:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:01:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:01:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:01:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:01:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:01:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:01:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:01:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:01:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:01:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:01:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:01:12 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:01:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:01:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:01:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:01:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:01:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:01:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:01:20 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:01:20 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 21:01:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:01:21 - job_xml_thread(): Done retrieving: data size 43617397
Sat 18 Jan 2014 21:01:21 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:01:21 - XML: Start document: iteration 5
Sat 18 Jan 2014 21:01:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43617397
Sat 18 Jan 2014 21:01:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:01:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43617397
Sat 18 Jan 2014 21:01:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:01:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:01:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:01:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:01:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:01:41 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:01:41 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:01:41 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:01:41 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:01:41 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:01:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:01:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:01:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:01:45 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:01:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:01:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:01:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:01:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:01:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:01:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:01:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:01:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:01:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:01:46 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:01:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 21:01:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:01:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:01:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:01:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:01:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:01:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:01:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43627390
Sat 18 Jan 2014 21:01:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:01:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43627390
Sat 18 Jan 2014 21:01:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:01:56 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:01:56 - job_xml_thread(): Done retrieving: data size 43627390
Sat 18 Jan 2014 21:01:56 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:01:56 - XML: Start document: iteration 6
Sat 18 Jan 2014 21:01:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:01:58 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:01:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:01:59 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:01:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 21:01:59 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:01:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 21:02:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5771 values 91172 bits 11396 bytes 
Sat 18 Jan 2014 21:02:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:02:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:02:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:02:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:02:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:02:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:02:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:02:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:02:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:02:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:02:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:02:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:02:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:02:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:02:11 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:02:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:02:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:02:11 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:02:11 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:02:11 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:02:11 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:02:11 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:02:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:02:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:02:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:02:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:02:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:02:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43652336
Sat 18 Jan 2014 21:02:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:02:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43652336
Sat 18 Jan 2014 21:02:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:02:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:02:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:02:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:02:25 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:02:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:02:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:02:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:02:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:02:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:02:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:02:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43652336
Sat 18 Jan 2014 21:02:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:02:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:02:27 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:02:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:02:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:02:31 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:02:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 21:02:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:02:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:02:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:02:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:02:38 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:02:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:02:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:02:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:02:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:02:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:02:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:02:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:02:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:02:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:02:41 - job_xml_thread(): Done retrieving: data size 43614579
Sat 18 Jan 2014 21:02:41 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:02:41 - XML: Start document: iteration 7
Sat 18 Jan 2014 21:02:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43614579
Sat 18 Jan 2014 21:02:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:02:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:02:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:02:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:02:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:02:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43614579
Sat 18 Jan 2014 21:02:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:02:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:02:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:02:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:02:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:03:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:03:00 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:03:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:03:01 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:03:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:03:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:03:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:03:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:03:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:03:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:03:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:03:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:03:01 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:03:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 21:03:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 21:03:01 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:03:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6171 values 97697 bits 12212 bytes 
Sat 18 Jan 2014 21:03:02 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:03:02 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:03:02 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:03:02 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:03:02 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:03:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:03:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:03:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:03:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:03:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:03:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:03:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:03:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:03:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:03:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43630411
Sat 18 Jan 2014 21:03:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:03:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43630411
Sat 18 Jan 2014 21:03:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:03:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:03:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:03:17 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:03:17 - job_xml_thread(): Done retrieving: data size 43630411
Sat 18 Jan 2014 21:03:17 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:03:17 - XML: Start document: iteration 8
Sat 18 Jan 2014 21:03:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:03:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:03:28 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:03:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 21:03:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:03:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:03:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:03:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:03:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:03:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:03:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:03:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:03:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:03:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:03:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:03:31 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:03:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:03:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:03:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:03:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:03:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:03:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:03:33 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:03:33 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:03:33 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:03:33 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:03:33 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:03:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:03:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43625300
Sat 18 Jan 2014 21:03:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:03:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43625300
Sat 18 Jan 2014 21:03:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:03:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:03:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:03:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:03:46 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:03:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:03:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:03:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:03:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:03:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:03:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:03:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:03:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:03:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:03:48 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:03:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:03:50 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:03:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:03:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:03:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:03:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:03:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:03:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:03:52 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 21:03:52 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 21:03:52 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:03:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:03:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43629214
Sat 18 Jan 2014 21:03:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:03:53 - job_xml_thread(): Done retrieving: data size 43629214
Sat 18 Jan 2014 21:03:53 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:03:53 - XML: Start document: iteration 9
Sat 18 Jan 2014 21:03:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43629214
Sat 18 Jan 2014 21:03:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:04:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:04:02 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:04:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:04:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:04:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:04:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 21:04:04 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:04:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 21:04:04 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:04:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:04:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:04:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:04:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:04:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9152 values 144668 bits 18083 bytes 
Sat 18 Jan 2014 21:04:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:04:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:04:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:04:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:04:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:04:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:04:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:04:14 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:04:14 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:04:14 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:04:14 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:04:14 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:04:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:04:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:04:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:04:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:04:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:04:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:04:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:04:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:04:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:04:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43617715
Sat 18 Jan 2014 21:04:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:04:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43617715
Sat 18 Jan 2014 21:04:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:04:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:04:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:04:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:04:26 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:04:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:04:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:04:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:04:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:04:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:04:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:04:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43617715
Sat 18 Jan 2014 21:04:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:04:29 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:04:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:04:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:04:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:04:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:04:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:04:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:04:40 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:04:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:04:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:04:40 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:04:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 21:04:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:04:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:04:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:04:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:04:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:04:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:04:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:04:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:04:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:04:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:04:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:04:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:04:42 - job_xml_thread(): Done retrieving: data size 43620709
Sat 18 Jan 2014 21:04:42 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:04:42 - XML: Start document: iteration 10
Sat 18 Jan 2014 21:04:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43620709
Sat 18 Jan 2014 21:04:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43620709
Sat 18 Jan 2014 21:04:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:04:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:04:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:04:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:04:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:04:56 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:04:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:04:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:04:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:04:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:04:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:04:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:04:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:05:01 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:05:01 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:05:01 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:05:01 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:05:01 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:05:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:05:04 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:05:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:05:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 21:05:05 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:05:05 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:05:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 21:05:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:05:05 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:05:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5922 values 93496 bits 11687 bytes 
Sat 18 Jan 2014 21:05:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:05:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:05:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:05:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:05:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:05:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:05:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:05:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43624295
Sat 18 Jan 2014 21:05:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:05:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43624295
Sat 18 Jan 2014 21:05:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:05:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:05:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:05:16 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:05:16 - job_xml_thread(): Done retrieving: data size 43624295
Sat 18 Jan 2014 21:05:16 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:05:16 - XML: Start document: iteration 11
Sat 18 Jan 2014 21:05:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:05:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:05:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:05:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:05:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:05:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:05:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:05:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:05:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:05:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:05:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:05:25 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:05:25 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:05:25 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:05:25 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:05:25 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:05:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:05:28 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:05:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:05:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:05:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:05:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:05:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:05:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:05:28 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:05:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 21:05:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:05:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:05:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563755
Sat 18 Jan 2014 21:05:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:05:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563755
Sat 18 Jan 2014 21:05:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:05:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:05:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:05:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:05:39 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:05:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:05:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:05:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:05:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:05:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:05:40 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:05:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563755
Sat 18 Jan 2014 21:05:40 - job_xml_thread(): Done retrieving: data size 43563755
Sat 18 Jan 2014 21:05:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:05:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:05:40 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:05:41 - XML: Start document: iteration 12
Sat 18 Jan 2014 21:05:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:05:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:05:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:05:54 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:05:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:05:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:05:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:05:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:05:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:05:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:05:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:05:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:05:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:05:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:05:56 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:05:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:05:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:05:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:05:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:05:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:05:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:05:58 - XML: Processed 653446 elements - found 0 jobs
Sat 18 Jan 2014 21:05:58 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:05:58 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:05:58 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:05:58 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:06:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:06:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42987105
Sat 18 Jan 2014 21:06:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:06:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42987105
Sat 18 Jan 2014 21:06:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:06:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:06:05 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:06:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:06:06 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:06:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 21:06:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 21:06:06 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:06:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8768 values 138329 bits 17291 bytes 
Sat 18 Jan 2014 21:06:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:06:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:06:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:06:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:06:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:06:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:06:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:06:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:06:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:06:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:06:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:06:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:06:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:06:13 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:06:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:06:16 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:06:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:06:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:06:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:06:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:06:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:06:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:06:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:06:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43020374
Sat 18 Jan 2014 21:06:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:06:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43020374
Sat 18 Jan 2014 21:06:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:06:19 - job_xml_thread(): Done retrieving: data size 43020374
Sat 18 Jan 2014 21:06:19 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:06:19 - XML: Start document: iteration 13
Sat 18 Jan 2014 21:06:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:06:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:06:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:06:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:06:38 - XML: Processed 646572 elements - found 0 jobs
Sat 18 Jan 2014 21:06:38 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:06:38 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:06:38 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:06:38 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:06:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:06:39 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:06:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:06:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:06:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:06:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:06:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:06:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:06:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:06:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:06:42 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:06:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:06:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:06:42 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:06:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 21:06:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:06:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:06:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:06:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:06:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:06:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:06:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43534664
Sat 18 Jan 2014 21:06:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:06:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43534664
Sat 18 Jan 2014 21:06:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:06:53 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:06:54 - job_xml_thread(): Done retrieving: data size 43534664
Sat 18 Jan 2014 21:06:54 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:06:54 - XML: Start document: iteration 14
Sat 18 Jan 2014 21:06:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:06:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:06:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:06:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:07:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:07:00 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:07:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:07:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:07:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:07:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:07:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:07:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:07:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:07:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:07:07 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:07:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:07:07 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:07:07 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:07:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:07:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 21:07:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 21:07:07 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:07:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:07:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:07:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5401 values 85144 bits 10643 bytes 
Sat 18 Jan 2014 21:07:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:07:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:07:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:07:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:07:09 - XML: Processed 652688 elements - found 0 jobs
Sat 18 Jan 2014 21:07:09 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:07:09 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:07:09 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:07:09 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:07:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:07:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43619736
Sat 18 Jan 2014 21:07:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:07:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43619736
Sat 18 Jan 2014 21:07:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:07:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:07:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:07:20 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 21:07:21 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:07:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:07:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:07:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:07:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:07:21 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:07:21 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:07:21 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 21:07:21 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 21:07:21 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 21:07:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:07:22 - ganglia_parse_thread(): started: cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sat 18 Jan 2014 21:07:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:07:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:07:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:07:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:07:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:07:24 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:07:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:07:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:07:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:07:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:07:26 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:07:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 21:07:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:07:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:07:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:07:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:07:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:07:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:07:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43637886
Sat 18 Jan 2014 21:07:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:07:28 - job_xml_thread(): Done retrieving: data size 43637886
Sat 18 Jan 2014 21:07:28 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:07:28 - XML: Start document: iteration 15
Sat 18 Jan 2014 21:07:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43637886
Sat 18 Jan 2014 21:07:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:07:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:07:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:07:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:07:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:07:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:07:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:07:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:07:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:07:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:07:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:07:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:07:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:07:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:07:45 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:07:45 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:07:45 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:07:45 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:07:45 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:07:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:07:50 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:07:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:07:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:07:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:07:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:07:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:07:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:07:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:07:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43597648
Sat 18 Jan 2014 21:07:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:07:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43597648
Sat 18 Jan 2014 21:07:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:07:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:07:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:08:00 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:08:00 - job_xml_thread(): Done retrieving: data size 43597648
Sat 18 Jan 2014 21:08:00 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:08:00 - XML: Start document: iteration 16
Sat 18 Jan 2014 21:08:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:08:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:08:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:08:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:08:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:08:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:08:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:08:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:08:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:08:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:08:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:08:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:08:07 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:08:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:08:07 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:08:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 21:08:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 21:08:07 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:08:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8992 values 141952 bits 17744 bytes 
Sat 18 Jan 2014 21:08:14 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:08:14 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:08:14 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:08:14 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:08:14 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:08:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:08:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:08:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:08:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:08:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:08:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:08:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:08:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:08:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:08:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43611887
Sat 18 Jan 2014 21:08:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:08:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43611887
Sat 18 Jan 2014 21:08:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:08:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:08:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:08:21 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:08:21 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:08:22 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:08:22 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 21:08:22 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:08:22 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 21:08:22 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 21:08:29 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:08:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:08:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:08:32 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:08:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:08:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:08:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:08:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:08:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:08:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:08:33 - size of cluster 'LISA Cluster': 624 hosts 79481 metrics 907555 values 14316460 bits 1789557 bytes 
Sat 18 Jan 2014 21:08:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:08:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:08:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:08:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:08:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:08:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:08:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:08:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:08:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:08:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:08:37 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:08:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 21:08:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:08:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:08:42 - job_xml_thread(): Done retrieving: data size 43615280
Sat 18 Jan 2014 21:08:42 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:08:42 - XML: Start document: iteration 17
Sat 18 Jan 2014 21:08:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43615280
Sat 18 Jan 2014 21:08:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43615280
Sat 18 Jan 2014 21:08:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:08:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:08:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:08:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:08:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:08:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:09:02 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:09:02 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:09:02 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:09:02 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:09:02 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:09:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:09:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:09:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:09:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:09:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:09:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:09:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:09:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:09:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:09:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:09:07 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:09:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:09:07 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:09:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:09:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:09:07 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:09:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:09:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:09:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 21:09:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:09:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:09:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 21:09:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:09:07 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:09:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5508 values 86820 bits 10852 bytes 
Sat 18 Jan 2014 21:09:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:09:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43631309
Sat 18 Jan 2014 21:09:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:09:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43631309
Sat 18 Jan 2014 21:09:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:09:18 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:09:18 - job_xml_thread(): Done retrieving: data size 43631309
Sat 18 Jan 2014 21:09:18 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:09:18 - XML: Start document: iteration 18
Sat 18 Jan 2014 21:09:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:09:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:09:22 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:09:22 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 21:09:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:09:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:09:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:09:25 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:09:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:09:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:09:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:09:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:09:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:09:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:09:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:09:34 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:09:34 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:09:34 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:09:34 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:09:34 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:09:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:09:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:09:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:09:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:09:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:09:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:09:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:09:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:09:38 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:09:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 21:09:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:09:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:09:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:09:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:09:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43602381
Sat 18 Jan 2014 21:09:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:09:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43602381
Sat 18 Jan 2014 21:09:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:09:49 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:09:49 - job_xml_thread(): Done retrieving: data size 43602381
Sat 18 Jan 2014 21:09:49 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:09:49 - XML: Start document: iteration 19
Sat 18 Jan 2014 21:09:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:09:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:09:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:09:53 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:09:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:09:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:09:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:09:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:09:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:09:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:09:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:10:04 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:10:04 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:10:04 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:10:04 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:10:04 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:10:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:10:06 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:10:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:10:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:10:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:10:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:10:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:10:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:10:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:10:07 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:10:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:10:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 21:10:08 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:10:08 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:10:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 21:10:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5430 values 85583 bits 10697 bytes 
Sat 18 Jan 2014 21:10:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:10:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:10:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:10:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43600012
Sat 18 Jan 2014 21:10:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:10:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43600012
Sat 18 Jan 2014 21:10:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:10:20 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:10:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:10:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:10:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:10:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:10:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:10:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:10:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:10:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:10:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:10:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:10:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:10:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:10:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:10:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:10:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:10:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:10:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:10:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:10:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:10:28 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:10:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 21:10:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:10:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:10:29 - job_xml_thread(): Done retrieving: data size 43630780
Sat 18 Jan 2014 21:10:29 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:10:29 - XML: Start document: iteration 20
Sat 18 Jan 2014 21:10:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43630780
Sat 18 Jan 2014 21:10:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:10:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43630780
Sat 18 Jan 2014 21:10:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:10:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:10:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:10:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:10:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:10:45 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:10:45 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:10:45 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:10:45 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:10:45 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:10:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:10:51 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:10:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:10:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:10:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:10:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:10:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:10:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:10:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:10:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:10:52 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:10:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:10:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:10:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:10:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:10:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:10:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:10:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:10:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43641408
Sat 18 Jan 2014 21:10:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:10:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43641408
Sat 18 Jan 2014 21:10:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:11:00 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:11:00 - job_xml_thread(): Done retrieving: data size 43641408
Sat 18 Jan 2014 21:11:00 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:11:00 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 21:11:00 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 21:11:00 - Housekeeping: done.
Sat 18 Jan 2014 21:11:00 - XML: Start document: iteration 0
Sat 18 Jan 2014 21:11:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:11:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:11:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:11:09 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:11:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:11:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:11:10 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:11:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:11:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 21:11:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 21:11:10 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:11:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6894 values 108884 bits 13610 bytes 
Sat 18 Jan 2014 21:11:15 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:11:15 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:11:15 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:11:15 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:11:15 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:11:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:11:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:11:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:11:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:11:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:11:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:11:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:11:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:11:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:11:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:11:20 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:11:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:11:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:11:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:11:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:11:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:11:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:11:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:11:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561214
Sat 18 Jan 2014 21:11:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:11:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561214
Sat 18 Jan 2014 21:11:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:11:30 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:11:30 - job_xml_thread(): Done retrieving: data size 43561214
Sat 18 Jan 2014 21:11:30 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:11:30 - XML: Start document: iteration 1
Sat 18 Jan 2014 21:11:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:11:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:11:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:11:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:11:40 - XML: Processed 653446 elements - found 0 jobs
Sat 18 Jan 2014 21:11:40 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:11:40 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:11:40 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:11:40 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:11:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:11:46 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:11:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:11:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:11:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:11:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:11:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:11:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:11:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:11:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:11:48 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:11:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:11:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:11:48 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:11:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 21:11:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:11:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:11:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:11:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:11:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:11:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:11:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42977581
Sat 18 Jan 2014 21:11:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:11:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42977581
Sat 18 Jan 2014 21:11:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:11:56 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:11:56 - job_xml_thread(): Done retrieving: data size 42977581
Sat 18 Jan 2014 21:11:56 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:11:56 - XML: Start document: iteration 2
Sat 18 Jan 2014 21:12:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:12:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:12:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:12:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:12:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:12:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:12:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:12:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:12:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:12:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:12:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:12:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:12:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:12:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:12:10 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:12:11 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:12:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 21:12:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:12:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 21:12:11 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:12:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6011 values 94939 bits 11867 bytes 
Sat 18 Jan 2014 21:12:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:12:12 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:12:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:12:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:12:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:12:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:12:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:12:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:12:14 - XML: Processed 646131 elements - found 0 jobs
Sat 18 Jan 2014 21:12:14 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:12:14 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:12:14 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:12:14 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:12:17 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 21:12:17 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 21:12:17 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:12:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:12:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43037711
Sat 18 Jan 2014 21:12:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:12:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43037711
Sat 18 Jan 2014 21:12:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:12:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:12:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:12:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:12:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:12:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:12:29 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:12:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:12:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:12:29 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:12:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:12:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:12:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:12:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:12:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:12:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:12:34 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:12:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:12:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:12:34 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:12:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 21:12:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:12:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:12:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:12:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:12:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:12:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:12:36 - job_xml_thread(): Done retrieving: data size 43228641
Sat 18 Jan 2014 21:12:36 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:12:36 - XML: Start document: iteration 3
Sat 18 Jan 2014 21:12:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43228641
Sat 18 Jan 2014 21:12:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43228641
Sat 18 Jan 2014 21:12:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:12:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:12:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:12:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:12:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:12:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:12:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:12:53 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:12:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:12:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:12:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:12:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:12:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:12:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:12:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:12:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:12:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:12:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:12:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:12:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:12:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:12:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:12:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:12:58 - XML: Processed 649206 elements - found 0 jobs
Sat 18 Jan 2014 21:12:58 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:12:58 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:12:58 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:12:58 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:13:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:13:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43631799
Sat 18 Jan 2014 21:13:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:13:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43631799
Sat 18 Jan 2014 21:13:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:13:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:13:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:13:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:13:11 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:13:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:13:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:13:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:13:11 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:13:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 21:13:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 21:13:11 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:13:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8808 values 139028 bits 17378 bytes 
Sat 18 Jan 2014 21:13:13 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:13:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:13:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:13:13 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:13:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:13:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:13:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:13:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:13:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:13:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:13:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:13:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:13:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:13:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:13:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:13:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:13:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:13:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:13:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:13:19 - job_xml_thread(): Done retrieving: data size 43649536
Sat 18 Jan 2014 21:13:19 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:13:19 - XML: Start document: iteration 4
Sat 18 Jan 2014 21:13:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43649536
Sat 18 Jan 2014 21:13:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:13:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43649536
Sat 18 Jan 2014 21:13:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:13:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:13:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:13:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:13:30 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:13:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:13:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:13:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:13:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:13:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:13:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:13:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:13:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:13:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:13:39 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:13:39 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:13:39 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:13:39 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:13:39 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:13:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:13:41 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:13:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:13:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:13:41 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:13:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 21:13:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:13:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:13:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:13:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:13:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:13:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:13:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43607216
Sat 18 Jan 2014 21:13:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:13:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43607216
Sat 18 Jan 2014 21:13:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:13:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:13:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:13:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:13:53 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:13:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:13:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:13:54 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:13:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:13:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:13:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:13:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:13:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:13:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:13:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:13:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:13:57 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:13:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:13:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:13:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:13:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:13:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:13:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:14:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:14:01 - job_xml_thread(): Done retrieving: data size 43636901
Sat 18 Jan 2014 21:14:01 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:14:01 - XML: Start document: iteration 5
Sat 18 Jan 2014 21:14:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43636901
Sat 18 Jan 2014 21:14:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:14:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43636901
Sat 18 Jan 2014 21:14:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:14:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:14:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:14:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:14:12 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:14:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:14:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:14:13 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:14:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:14:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 21:14:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 21:14:13 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:14:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8777 values 138543 bits 17317 bytes 
Sat 18 Jan 2014 21:14:20 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:14:20 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:14:20 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:14:20 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:14:20 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:14:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:14:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:14:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:14:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:14:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:14:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:14:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:14:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:14:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:14:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:14:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:14:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:14:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:14:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:14:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:14:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:14:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:14:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:14:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43642749
Sat 18 Jan 2014 21:14:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:14:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43642749
Sat 18 Jan 2014 21:14:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:14:35 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:14:35 - job_xml_thread(): Done retrieving: data size 43642749
Sat 18 Jan 2014 21:14:35 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:14:35 - XML: Start document: iteration 6
Sat 18 Jan 2014 21:14:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:14:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:14:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:14:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:14:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:14:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:14:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:14:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:14:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:14:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:14:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:14:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:14:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:14:46 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:14:46 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:14:46 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:14:46 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:14:46 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:14:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:14:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:14:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:14:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:14:51 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:14:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 21:14:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:14:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:14:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:14:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:14:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:14:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:14:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43609829
Sat 18 Jan 2014 21:14:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:14:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43609829
Sat 18 Jan 2014 21:14:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:14:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:14:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:15:01 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:15:01 - job_xml_thread(): Done retrieving: data size 43609829
Sat 18 Jan 2014 21:15:01 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:15:01 - XML: Start document: iteration 7
Sat 18 Jan 2014 21:15:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:15:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:15:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:15:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:15:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:15:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:15:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:15:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:15:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:15:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:15:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:15:13 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:15:13 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:15:13 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:15:13 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:15:13 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:15:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:15:14 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:15:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:15:16 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:15:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:15:16 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:15:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 21:15:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 21:15:16 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:15:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5784 values 91323 bits 11415 bytes 
Sat 18 Jan 2014 21:15:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:15:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:15:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:15:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:15:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:15:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:15:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:15:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43619256
Sat 18 Jan 2014 21:15:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:15:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43619256
Sat 18 Jan 2014 21:15:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:15:22 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 21:15:22 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:15:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:15:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:15:23 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:15:23 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 21:15:23 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:15:23 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 21:15:23 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 21:15:25 - size of cluster 'LISA Cluster': 624 hosts 79469 metrics 832330 values 13116756 bits 1639594 bytes 
Sat 18 Jan 2014 21:15:28 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:15:28 - job_xml_thread(): Done retrieving: data size 43619256
Sat 18 Jan 2014 21:15:28 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:15:29 - XML: Start document: iteration 8
Sat 18 Jan 2014 21:15:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:15:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:15:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:15:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:15:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:15:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:15:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:15:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:15:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:15:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:15:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:15:43 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:15:43 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:15:43 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:15:43 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:15:43 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:15:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:15:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:15:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:15:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:15:45 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:15:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 21:15:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:15:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:15:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:15:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:15:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:15:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:15:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43629946
Sat 18 Jan 2014 21:15:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:15:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43629946
Sat 18 Jan 2014 21:15:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:15:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:15:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:15:59 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:15:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:15:59 - job_xml_thread(): Done retrieving: data size 43629946
Sat 18 Jan 2014 21:15:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:15:59 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:15:59 - XML: Start document: iteration 9
Sat 18 Jan 2014 21:16:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:16:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:16:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:16:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:16:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:16:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:16:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:16:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:16:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:16:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:16:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:16:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:16:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:16:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:16:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:16:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:16:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:16:10 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:16:10 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:16:10 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:16:10 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:16:10 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:16:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:16:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43617765
Sat 18 Jan 2014 21:16:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:16:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43617765
Sat 18 Jan 2014 21:16:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:16:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:16:16 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:16:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:16:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:16:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:16:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 21:16:18 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:16:18 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:16:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8847 values 139781 bits 17472 bytes 
Sat 18 Jan 2014 21:16:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 21:16:23 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:16:23 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 21:16:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:16:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:16:25 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:16:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:16:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:16:30 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:16:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:16:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:16:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:16:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:16:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:16:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:16:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:16:31 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:16:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:16:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:16:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:16:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:16:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:16:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:16:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:16:38 - job_xml_thread(): Done retrieving: data size 43627794
Sat 18 Jan 2014 21:16:38 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:16:38 - XML: Start document: iteration 10
Sat 18 Jan 2014 21:16:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43627794
Sat 18 Jan 2014 21:16:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:16:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43627794
Sat 18 Jan 2014 21:16:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:16:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:16:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:16:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:16:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:16:52 - XML: Processed 654195 elements - found 0 jobs
Sat 18 Jan 2014 21:16:52 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:16:52 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:16:52 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:16:52 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:16:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:16:56 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:16:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:16:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:16:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:16:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:16:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:16:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:16:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:17:00 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:17:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 21:17:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:17:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:17:01 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:17:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:17:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:17:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:17:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:17:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:17:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:17:07 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:17:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:17:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43639240
Sat 18 Jan 2014 21:17:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:17:08 - job_xml_thread(): Done retrieving: data size 43639240
Sat 18 Jan 2014 21:17:08 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:17:08 - XML: Start document: iteration 11
Sat 18 Jan 2014 21:17:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43639240
Sat 18 Jan 2014 21:17:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:17:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:17:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:17:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:17:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:17:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:17:18 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:17:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:17:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 21:17:18 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:17:18 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:17:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 21:17:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5921 values 93663 bits 11707 bytes 
Sat 18 Jan 2014 21:17:18 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:17:18 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:17:18 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:17:18 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:17:18 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:17:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:17:24 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:17:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:17:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:17:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:17:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:17:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:17:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:17:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:17:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:17:29 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:17:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:17:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:17:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:17:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:17:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:17:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:17:34 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:17:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:17:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43313450
Sat 18 Jan 2014 21:17:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:17:35 - job_xml_thread(): Done retrieving: data size 43313450
Sat 18 Jan 2014 21:17:35 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:17:35 - XML: Start document: iteration 12
Sat 18 Jan 2014 21:17:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43313450
Sat 18 Jan 2014 21:17:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:17:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:17:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:17:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:17:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:17:48 - XML: Processed 650152 elements - found 0 jobs
Sat 18 Jan 2014 21:17:48 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:17:48 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:17:48 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:17:48 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:17:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:17:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:17:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:17:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:17:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:17:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:17:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:17:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:17:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:17:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:17:57 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:17:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:17:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:17:58 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:17:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 21:17:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:17:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:17:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:17:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:17:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:18:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:18:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42989080
Sat 18 Jan 2014 21:18:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:18:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42989080
Sat 18 Jan 2014 21:18:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:18:03 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:18:03 - job_xml_thread(): Done retrieving: data size 42989080
Sat 18 Jan 2014 21:18:03 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:18:03 - XML: Start document: iteration 13
Sat 18 Jan 2014 21:18:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:18:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:18:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:18:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:18:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:18:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:18:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:18:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:18:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:18:19 - XML: Processed 645996 elements - found 0 jobs
Sat 18 Jan 2014 21:18:19 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:18:19 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:18:19 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:18:19 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:18:19 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:18:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:18:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:18:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:18:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:18:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:18:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:18:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 21:18:20 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:18:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5836 values 92433 bits 11554 bytes 
Sat 18 Jan 2014 21:18:20 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:18:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 21:18:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:18:22 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:18:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:18:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:18:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:18:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:18:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:18:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:18:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:18:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43034305
Sat 18 Jan 2014 21:18:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:18:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43034305
Sat 18 Jan 2014 21:18:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:18:34 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:18:34 - job_xml_thread(): Done retrieving: data size 43034305
Sat 18 Jan 2014 21:18:34 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:18:34 - XML: Start document: iteration 14
Sat 18 Jan 2014 21:18:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:18:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:18:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:18:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:18:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:18:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:18:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:18:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:18:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:18:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:18:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:18:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:18:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:18:45 - XML: Processed 646746 elements - found 0 jobs
Sat 18 Jan 2014 21:18:45 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:18:45 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:18:45 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:18:45 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:18:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:18:49 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:18:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:18:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:18:49 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:18:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 21:18:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:18:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:18:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:18:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:18:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:18:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:18:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584885
Sat 18 Jan 2014 21:18:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:18:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584885
Sat 18 Jan 2014 21:18:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:18:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:18:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:19:00 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:19:00 - job_xml_thread(): Done retrieving: data size 43584885
Sat 18 Jan 2014 21:19:00 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:19:00 - XML: Start document: iteration 15
Sat 18 Jan 2014 21:19:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:19:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:19:14 - XML: Processed 653648 elements - found 0 jobs
Sat 18 Jan 2014 21:19:14 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:19:14 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:19:14 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:19:14 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:19:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:19:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:19:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:19:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:19:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:19:15 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:19:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:19:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:19:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:19:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:19:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:19:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:19:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:19:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:19:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:19:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:19:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:19:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:19:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43646371
Sat 18 Jan 2014 21:19:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:19:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43646371
Sat 18 Jan 2014 21:19:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:19:20 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:19:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:19:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:19:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 21:19:21 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:19:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 21:19:21 - Entering storeMetrics(): cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sat 18 Jan 2014 21:19:29 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:19:29 - job_xml_thread(): Done retrieving: data size 43646371
Sat 18 Jan 2014 21:19:29 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:19:29 - XML: Start document: iteration 16
Sat 18 Jan 2014 21:19:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:19:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:19:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:19:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:19:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:19:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:19:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:19:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:19:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:19:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:19:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:19:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:19:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:19:38 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:19:38 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:19:38 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:19:38 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:19:38 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:19:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:19:42 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:19:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:19:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:19:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:19:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:19:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:19:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:19:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:19:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43625730
Sat 18 Jan 2014 21:19:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:19:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43625730
Sat 18 Jan 2014 21:19:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:19:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:19:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:19:53 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:19:54 - job_xml_thread(): Done retrieving: data size 43625730
Sat 18 Jan 2014 21:19:54 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:19:54 - XML: Start document: iteration 17
Sat 18 Jan 2014 21:19:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:19:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:20:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:20:02 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:20:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:20:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:20:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:20:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:20:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:20:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:20:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:20:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:20:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:20:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:20:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:20:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:20:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:20:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:20:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:20:09 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:20:09 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:20:09 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:20:09 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:20:09 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:20:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:20:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43612086
Sat 18 Jan 2014 21:20:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:20:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43612086
Sat 18 Jan 2014 21:20:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:20:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:20:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:20:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:20:22 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:20:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:20:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:20:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:20:23 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:20:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 21:20:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 21:20:24 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:20:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 15111 values 238560 bits 29820 bytes 
Sat 18 Jan 2014 21:20:24 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:20:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:20:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:20:27 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:20:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:20:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:20:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:20:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:20:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:20:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:20:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:20:28 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:20:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:20:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:20:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:20:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:20:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:20:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:20:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:20:34 - job_xml_thread(): Done retrieving: data size 43635103
Sat 18 Jan 2014 21:20:34 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:20:34 - XML: Start document: iteration 18
Sat 18 Jan 2014 21:20:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43635103
Sat 18 Jan 2014 21:20:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:20:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43635103
Sat 18 Jan 2014 21:20:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:20:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:20:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:20:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:20:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:20:53 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:20:53 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:20:53 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:20:53 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:20:53 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:20:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:20:56 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:20:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:20:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:20:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:20:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:20:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:20:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:20:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:20:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:20:58 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:20:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:20:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:20:58 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:20:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 21:20:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:20:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:20:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:20:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:20:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:20:59 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 21:20:59 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 21:20:59 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:21:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:21:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43663376
Sat 18 Jan 2014 21:21:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:21:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43663376
Sat 18 Jan 2014 21:21:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:21:09 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:21:09 - job_xml_thread(): Done retrieving: data size 43663376
Sat 18 Jan 2014 21:21:09 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:21:09 - XML: Start document: iteration 19
Sat 18 Jan 2014 21:21:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:21:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:21:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:21:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:21:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:21:19 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:21:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:21:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:21:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:21:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:21:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:21:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:21:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:21:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:21:23 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:21:24 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:21:24 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:21:24 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:21:24 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:21:24 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:21:24 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:21:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:21:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 21:21:24 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:21:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5842 values 92214 bits 11526 bytes 
Sat 18 Jan 2014 21:21:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 21:21:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:21:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:21:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:21:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:21:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:21:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:21:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:21:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:21:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:21:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43635987
Sat 18 Jan 2014 21:21:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:21:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43635987
Sat 18 Jan 2014 21:21:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:21:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:21:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:21:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:21:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:21:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:21:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:21:39 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:21:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:21:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:21:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:21:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:21:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:21:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:21:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:21:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:21:42 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:21:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:21:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:21:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:21:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:21:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:21:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:21:42 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:21:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 21:21:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:21:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:21:44 - job_xml_thread(): Done retrieving: data size 43646490
Sat 18 Jan 2014 21:21:44 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:21:44 - XML: Start document: iteration 20
Sat 18 Jan 2014 21:21:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43646490
Sat 18 Jan 2014 21:21:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:21:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43646490
Sat 18 Jan 2014 21:21:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:21:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:21:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:21:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:21:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:22:01 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:22:01 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:22:01 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:22:01 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:22:01 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:22:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:22:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:22:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:22:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:22:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:22:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:22:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:22:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:22:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:22:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:22:07 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:22:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:22:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:22:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:22:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:22:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:22:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:22:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:22:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43634376
Sat 18 Jan 2014 21:22:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:22:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43634376
Sat 18 Jan 2014 21:22:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:22:16 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:22:16 - job_xml_thread(): Done retrieving: data size 43634376
Sat 18 Jan 2014 21:22:16 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:22:16 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 21:22:18 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 21:22:18 - Housekeeping: done.
Sat 18 Jan 2014 21:22:18 - XML: Start document: iteration 0
Sat 18 Jan 2014 21:22:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:22:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:22:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:22:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:22:24 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 21:22:24 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:22:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:22:24 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:22:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:22:25 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:22:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:22:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:22:26 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:22:26 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:22:26 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 21:22:26 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 21:22:26 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 21:22:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:22:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:22:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:22:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:22:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:22:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:22:26 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:22:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 21:22:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 21:22:26 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:22:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9042 values 142821 bits 17852 bytes 
Sat 18 Jan 2014 21:22:31 - size of cluster 'LISA Cluster': 624 hosts 79475 metrics 677017 values 10681791 bits 1335223 bytes 
Sat 18 Jan 2014 21:22:32 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:22:32 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:22:32 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:22:32 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:22:32 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:22:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:22:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:22:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:22:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:22:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:22:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:22:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:22:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:22:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:22:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:22:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:22:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43603059
Sat 18 Jan 2014 21:22:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:22:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43603059
Sat 18 Jan 2014 21:22:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:22:47 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:22:47 - job_xml_thread(): Done retrieving: data size 43603059
Sat 18 Jan 2014 21:22:47 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:22:47 - XML: Start document: iteration 1
Sat 18 Jan 2014 21:22:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:22:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:23:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:23:00 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:23:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:23:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:23:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:23:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:23:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:23:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:23:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:23:01 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:23:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 21:23:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:23:02 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:23:02 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:23:02 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:23:02 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:23:02 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:23:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:23:06 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:23:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:23:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:23:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:23:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:23:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:23:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:23:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:23:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43616811
Sat 18 Jan 2014 21:23:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:23:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43616811
Sat 18 Jan 2014 21:23:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:23:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:23:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:23:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:23:17 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:23:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:23:17 - job_xml_thread(): Done retrieving: data size 43616811
Sat 18 Jan 2014 21:23:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:23:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:23:17 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:23:17 - XML: Start document: iteration 2
Sat 18 Jan 2014 21:23:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:23:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:23:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:23:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43616811
Sat 18 Jan 2014 21:23:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:23:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:23:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:23:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:23:26 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:23:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:23:26 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 21:23:27 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:23:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:23:29 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:23:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 21:23:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 21:23:29 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:23:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:23:30 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:23:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6046 values 95510 bits 11938 bytes 
Sat 18 Jan 2014 21:23:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:23:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:23:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:23:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:23:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:23:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:23:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:23:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:23:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:23:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:23:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:23:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:23:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:23:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:23:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:23:37 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:23:37 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:23:37 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:23:37 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:23:37 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:23:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:23:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43055536
Sat 18 Jan 2014 21:23:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:23:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43055536
Sat 18 Jan 2014 21:23:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:23:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:23:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:23:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:23:51 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:23:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:23:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:23:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:23:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:23:52 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:23:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:23:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:23:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:23:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:23:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:23:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:23:58 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:23:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:23:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:23:59 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:23:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 21:23:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:23:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:23:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:23:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:23:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:24:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:24:02 - job_xml_thread(): Done retrieving: data size 42966566
Sat 18 Jan 2014 21:24:02 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:24:02 - XML: Start document: iteration 3
Sat 18 Jan 2014 21:24:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42966566
Sat 18 Jan 2014 21:24:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42966566
Sat 18 Jan 2014 21:24:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:24:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:24:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:24:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:24:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:24:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:24:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:24:19 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:24:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:24:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:24:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:24:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:24:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:24:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:24:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:24:25 - XML: Processed 646014 elements - found 0 jobs
Sat 18 Jan 2014 21:24:25 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:24:25 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:24:25 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:24:25 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:24:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:24:25 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:24:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:24:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:24:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:24:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:24:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:24:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:24:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:24:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43035631
Sat 18 Jan 2014 21:24:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:24:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43035631
Sat 18 Jan 2014 21:24:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:24:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:24:29 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:24:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:24:30 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:24:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 21:24:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 21:24:30 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:24:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5962 values 94228 bits 11778 bytes 
Sat 18 Jan 2014 21:24:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:24:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:24:40 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:24:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:24:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:24:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:24:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:24:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:24:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:24:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:24:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:24:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:24:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:24:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:24:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:24:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:24:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:24:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:24:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:24:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:24:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:24:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:24:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:24:47 - job_xml_thread(): Done retrieving: data size 43537707
Sat 18 Jan 2014 21:24:47 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:24:47 - XML: Start document: iteration 4
Sat 18 Jan 2014 21:24:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43537707
Sat 18 Jan 2014 21:24:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:24:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43537707
Sat 18 Jan 2014 21:24:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:24:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:24:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:25:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:25:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:25:06 - XML: Processed 652892 elements - found 0 jobs
Sat 18 Jan 2014 21:25:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:25:06 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:25:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:25:06 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:25:06 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:25:06 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:25:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:25:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:25:06 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:25:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 21:25:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:25:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:25:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:25:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:25:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:25:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:25:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:25:10 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:25:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:25:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:25:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:25:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:25:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:25:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:25:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:25:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43633976
Sat 18 Jan 2014 21:25:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:25:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43633976
Sat 18 Jan 2014 21:25:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:25:21 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:25:21 - job_xml_thread(): Done retrieving: data size 43633976
Sat 18 Jan 2014 21:25:21 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:25:21 - XML: Start document: iteration 5
Sat 18 Jan 2014 21:25:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:25:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:25:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:25:24 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:25:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:25:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:25:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:25:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:25:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:25:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:25:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:25:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:25:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:25:29 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:25:29 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:25:29 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:25:29 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:25:29 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:25:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:25:30 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:25:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:25:30 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:25:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 21:25:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 21:25:30 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:25:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6112 values 96538 bits 12067 bytes 
Sat 18 Jan 2014 21:25:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:25:34 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:25:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:25:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:25:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:25:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:25:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:25:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:25:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:25:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43614179
Sat 18 Jan 2014 21:25:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:25:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43614179
Sat 18 Jan 2014 21:25:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:25:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:25:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:25:44 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:25:44 - job_xml_thread(): Done retrieving: data size 43614179
Sat 18 Jan 2014 21:25:44 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:25:44 - XML: Start document: iteration 6
Sat 18 Jan 2014 21:25:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:25:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:25:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:25:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:25:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:25:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:25:56 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:25:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 21:25:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:25:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:25:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:25:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:25:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:25:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:25:57 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:25:57 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:25:57 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:25:57 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:25:57 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:25:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:25:59 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:25:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:25:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:26:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:26:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:26:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:26:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:26:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:26:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43636270
Sat 18 Jan 2014 21:26:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:26:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43636270
Sat 18 Jan 2014 21:26:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:26:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:26:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:26:12 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:26:12 - job_xml_thread(): Done retrieving: data size 43636270
Sat 18 Jan 2014 21:26:12 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:26:12 - XML: Start document: iteration 7
Sat 18 Jan 2014 21:26:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:26:13 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:26:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:26:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:26:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:26:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:26:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:26:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:26:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:26:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:26:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:26:21 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:26:21 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:26:21 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:26:21 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:26:21 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:26:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:26:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:26:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:26:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:26:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:26:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:26:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:26:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:26:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:26:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43613021
Sat 18 Jan 2014 21:26:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:26:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43613021
Sat 18 Jan 2014 21:26:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:26:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:26:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:26:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:26:30 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:26:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:26:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 21:26:31 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:26:31 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:26:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 21:26:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9274 values 146469 bits 18308 bytes 
Sat 18 Jan 2014 21:26:36 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:26:36 - job_xml_thread(): Done retrieving: data size 43613021
Sat 18 Jan 2014 21:26:36 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:26:36 - XML: Start document: iteration 8
Sat 18 Jan 2014 21:26:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:26:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:26:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:26:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:26:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:26:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:26:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:26:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:26:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:26:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:26:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:26:46 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:26:46 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:26:46 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:26:46 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:26:46 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:26:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:26:50 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:26:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:26:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:26:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:26:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:26:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:26:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:26:53 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:26:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 21:26:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:26:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:26:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43608964
Sat 18 Jan 2014 21:26:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:26:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43608964
Sat 18 Jan 2014 21:26:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:26:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:26:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:27:01 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:27:01 - job_xml_thread(): Done retrieving: data size 43608964
Sat 18 Jan 2014 21:27:01 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:27:01 - XML: Start document: iteration 9
Sat 18 Jan 2014 21:27:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:27:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:27:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:27:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:27:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:27:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:27:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:27:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:27:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:27:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:27:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:27:13 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:27:13 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:27:13 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:27:13 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:27:13 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:27:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:27:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:27:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:27:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:27:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:27:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:27:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:27:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:27:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:27:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43624703
Sat 18 Jan 2014 21:27:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:27:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43624703
Sat 18 Jan 2014 21:27:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:27:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:27:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:27:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:27:27 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:27:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:27:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:27:28 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:27:28 - job_xml_thread(): Done retrieving: data size 43624703
Sat 18 Jan 2014 21:27:28 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:27:28 - XML: Start document: iteration 10
Sat 18 Jan 2014 21:27:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:27:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:27:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:27:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43624703
Sat 18 Jan 2014 21:27:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:27:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:27:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:27:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:27:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:27:31 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:27:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:27:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 21:27:32 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:27:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 21:27:32 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:27:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99178 bits 12397 bytes 
Sat 18 Jan 2014 21:27:40 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:27:40 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:27:40 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:27:40 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:27:40 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:27:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:27:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:27:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:27:48 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:27:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:27:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:27:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:27:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:27:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:27:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:27:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:27:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:27:50 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:27:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:27:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:27:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:27:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:27:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:27:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:27:52 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 21:27:52 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 21:27:52 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:27:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:27:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43638698
Sat 18 Jan 2014 21:27:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:27:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43638698
Sat 18 Jan 2014 21:27:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:27:55 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:27:55 - job_xml_thread(): Done retrieving: data size 43638698
Sat 18 Jan 2014 21:27:55 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:27:55 - XML: Start document: iteration 11
Sat 18 Jan 2014 21:28:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:28:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:28:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:28:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:28:05 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:28:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 21:28:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:28:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:28:07 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:28:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:28:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:28:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:28:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:28:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:28:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:28:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:28:11 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:28:11 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:28:11 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:28:11 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:28:11 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:28:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:28:14 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:28:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:28:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:28:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:28:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:28:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:28:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:28:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:28:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43633955
Sat 18 Jan 2014 21:28:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:28:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43633955
Sat 18 Jan 2014 21:28:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:28:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:28:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:28:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:28:26 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:28:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:28:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:28:26 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:28:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:28:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:28:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:28:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:28:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:28:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:28:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:28:30 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:28:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:28:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:28:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:28:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:28:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:28:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:28:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:28:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:28:32 - job_xml_thread(): Done retrieving: data size 43643166
Sat 18 Jan 2014 21:28:32 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:28:32 - XML: Start document: iteration 12
Sat 18 Jan 2014 21:28:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:28:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43643166
Sat 18 Jan 2014 21:28:32 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:28:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:28:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43643166
Sat 18 Jan 2014 21:28:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:28:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:28:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 21:28:34 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:28:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 21:28:34 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:28:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8646 values 136531 bits 17066 bytes 
Sat 18 Jan 2014 21:28:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:28:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:28:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:28:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:28:46 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:28:46 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:28:46 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:28:46 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:28:46 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:28:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:28:51 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:28:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:28:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:28:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:28:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:28:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:28:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:28:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:28:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:28:56 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:28:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:28:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:28:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:28:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:28:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:28:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:29:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:29:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43630823
Sat 18 Jan 2014 21:29:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:29:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43630823
Sat 18 Jan 2014 21:29:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:29:01 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:29:01 - job_xml_thread(): Done retrieving: data size 43630823
Sat 18 Jan 2014 21:29:01 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:29:01 - XML: Start document: iteration 13
Sat 18 Jan 2014 21:29:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:29:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:29:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:29:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:29:17 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:29:17 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:29:17 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:29:17 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:29:17 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:29:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:29:19 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:29:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:29:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:29:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:29:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:29:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:29:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:29:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:29:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:29:22 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:29:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:29:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:29:23 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:29:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 21:29:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:29:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:29:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:29:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:29:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:29:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:29:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562281
Sat 18 Jan 2014 21:29:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:29:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562281
Sat 18 Jan 2014 21:29:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:29:29 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 21:29:29 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:29:30 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:29:30 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 21:29:30 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:29:30 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 21:29:30 - Entering storeMetrics(): cluster LISA Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sat 18 Jan 2014 21:29:32 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:29:32 - job_xml_thread(): Done retrieving: data size 43562281
Sat 18 Jan 2014 21:29:32 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:29:32 - XML: Start document: iteration 14
Sat 18 Jan 2014 21:29:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:29:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:29:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:29:34 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:29:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:29:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 21:29:36 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:29:36 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:29:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 21:29:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5779 values 91205 bits 11400 bytes 
Sat 18 Jan 2014 21:29:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:29:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:29:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:29:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:29:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:29:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:29:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:29:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:29:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:29:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:29:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:29:45 - XML: Processed 653446 elements - found 0 jobs
Sat 18 Jan 2014 21:29:45 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:29:45 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:29:45 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:29:45 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:29:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:29:48 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:29:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:29:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:29:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:29:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:29:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:29:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:29:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:29:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43015702
Sat 18 Jan 2014 21:29:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:29:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43015702
Sat 18 Jan 2014 21:29:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:29:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:29:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:30:00 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:30:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:30:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:30:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:30:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:30:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:30:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:30:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:30:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:30:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:30:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:30:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:30:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:30:05 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:30:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:30:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:30:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:30:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:30:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:30:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:30:06 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:30:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 21:30:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:30:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:30:08 - job_xml_thread(): Done retrieving: data size 43002674
Sat 18 Jan 2014 21:30:08 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:30:08 - XML: Start document: iteration 15
Sat 18 Jan 2014 21:30:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43002674
Sat 18 Jan 2014 21:30:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:30:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43002674
Sat 18 Jan 2014 21:30:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:30:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:30:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:30:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:30:18 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:30:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:30:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:30:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:30:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:30:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:30:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:30:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:30:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:30:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:30:25 - XML: Processed 646426 elements - found 0 jobs
Sat 18 Jan 2014 21:30:25 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:30:25 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:30:25 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:30:25 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:30:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:30:28 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:30:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:30:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:30:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:30:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:30:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:30:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:30:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:30:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43020106
Sat 18 Jan 2014 21:30:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:30:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43020106
Sat 18 Jan 2014 21:30:30 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:30:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:30:30 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:30:33 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:30:33 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 21:30:33 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 21:30:33 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:30:34 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 21:30:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:30:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:30:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:30:37 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:30:38 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:30:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 21:30:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:30:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 21:30:39 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:30:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8812 values 139069 bits 17383 bytes 
Sat 18 Jan 2014 21:30:41 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:30:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:30:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:30:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:30:41 - size of cluster 'LISA Cluster': 624 hosts 79468 metrics 793207 values 12499453 bits 1562431 bytes 
Sat 18 Jan 2014 21:30:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:30:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:30:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:30:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:30:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:30:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:30:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:30:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:30:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:30:46 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:30:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:30:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:30:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:30:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:30:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:30:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:30:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:30:52 - job_xml_thread(): Done retrieving: data size 43578091
Sat 18 Jan 2014 21:30:52 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:30:52 - XML: Start document: iteration 16
Sat 18 Jan 2014 21:30:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578091
Sat 18 Jan 2014 21:30:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:30:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578091
Sat 18 Jan 2014 21:30:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:30:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:30:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:31:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:31:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:31:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:31:03 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:31:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:31:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:31:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:31:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:31:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:31:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:31:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:31:07 - XML: Processed 653590 elements - found 0 jobs
Sat 18 Jan 2014 21:31:07 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:31:07 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:31:07 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:31:07 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:31:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:31:11 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:31:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:31:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:31:12 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:31:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 21:31:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:31:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:31:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:31:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:31:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:31:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:31:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43611890
Sat 18 Jan 2014 21:31:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:31:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43611890
Sat 18 Jan 2014 21:31:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:31:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:31:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:31:22 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:31:22 - job_xml_thread(): Done retrieving: data size 43611890
Sat 18 Jan 2014 21:31:22 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:31:22 - XML: Start document: iteration 17
Sat 18 Jan 2014 21:31:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:31:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:31:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:31:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:31:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:31:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:31:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:31:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:31:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:31:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:31:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:31:34 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:31:34 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 21:31:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:31:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:31:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:31:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:31:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:31:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:31:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:31:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:31:37 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:31:37 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:31:37 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:31:37 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:31:37 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:31:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:31:38 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:31:38 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:31:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 21:31:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:31:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 21:31:38 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:31:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5708 values 90141 bits 11267 bytes 
Sat 18 Jan 2014 21:31:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:31:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43606304
Sat 18 Jan 2014 21:31:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:31:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43606304
Sat 18 Jan 2014 21:31:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:31:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:31:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:31:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:31:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:31:52 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:31:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:31:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:31:58 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:31:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:31:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:31:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:31:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:31:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:31:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:31:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:31:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:31:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:31:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:32:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:32:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:32:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:32:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:32:00 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:32:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 21:32:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:32:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:32:02 - job_xml_thread(): Done retrieving: data size 43626764
Sat 18 Jan 2014 21:32:02 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:32:02 - XML: Start document: iteration 18
Sat 18 Jan 2014 21:32:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43626764
Sat 18 Jan 2014 21:32:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:32:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43626764
Sat 18 Jan 2014 21:32:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:32:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:32:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:32:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:32:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:32:15 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:32:15 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:32:15 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:32:15 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:32:15 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:32:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:32:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:32:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:32:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:32:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:32:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:32:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:32:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:32:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:32:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:32:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:32:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:32:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:32:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:32:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:32:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:32:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:32:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:32:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43636478
Sat 18 Jan 2014 21:32:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:32:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43636478
Sat 18 Jan 2014 21:32:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:32:30 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:32:30 - job_xml_thread(): Done retrieving: data size 43636478
Sat 18 Jan 2014 21:32:30 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:32:30 - XML: Start document: iteration 19
Sat 18 Jan 2014 21:32:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:32:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:32:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:32:38 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:32:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:32:39 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:32:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 21:32:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 21:32:39 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:32:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8243 values 130468 bits 16308 bytes 
Sat 18 Jan 2014 21:32:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:32:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:32:47 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:32:47 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:32:47 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:32:47 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:32:47 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:32:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:32:51 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:32:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:32:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:32:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:32:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:32:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:32:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:32:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:32:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:32:52 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:32:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:32:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:32:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:32:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:32:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:32:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:32:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:32:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43638366
Sat 18 Jan 2014 21:32:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:32:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43638366
Sat 18 Jan 2014 21:32:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:33:03 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:33:03 - job_xml_thread(): Done retrieving: data size 43638366
Sat 18 Jan 2014 21:33:03 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:33:03 - XML: Start document: iteration 20
Sat 18 Jan 2014 21:33:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:33:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:33:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:33:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:33:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:33:15 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:33:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:33:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:33:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:33:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:33:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:33:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:33:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:33:18 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:33:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 21:33:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:33:18 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:33:19 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:33:19 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:33:19 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:33:19 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:33:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:33:19 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:33:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:33:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:33:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:33:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:33:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:33:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:33:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:33:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43636709
Sat 18 Jan 2014 21:33:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:33:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43636709
Sat 18 Jan 2014 21:33:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:33:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:33:31 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:33:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:33:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:33:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:33:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:33:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:33:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:33:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:33:34 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:33:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:33:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:33:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:33:35 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:33:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:33:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:33:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:33:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:33:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:33:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:33:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:33:39 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:33:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:33:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43627243
Sat 18 Jan 2014 21:33:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:33:40 - job_xml_thread(): Done retrieving: data size 43627243
Sat 18 Jan 2014 21:33:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43627243
Sat 18 Jan 2014 21:33:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:33:40 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:33:40 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 21:33:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:33:40 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:33:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 21:33:40 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:33:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8928 values 141274 bits 17659 bytes 
Sat 18 Jan 2014 21:33:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 21:33:41 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 21:33:41 - Housekeeping: done.
Sat 18 Jan 2014 21:33:41 - XML: Start document: iteration 0
Sat 18 Jan 2014 21:33:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:33:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:33:50 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:33:50 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:33:50 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:33:50 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:33:50 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:33:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:33:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:33:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:33:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:33:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:33:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:34:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:34:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:34:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:34:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:34:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:34:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:34:02 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:34:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:34:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:34:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:34:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:34:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:34:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:34:05 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:34:06 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 21:34:06 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 21:34:06 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:34:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:34:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43646220
Sat 18 Jan 2014 21:34:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:34:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43646220
Sat 18 Jan 2014 21:34:08 - job_xml_thread(): Done retrieving: data size 43646220
Sat 18 Jan 2014 21:34:08 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:34:08 - XML: Start document: iteration 1
Sat 18 Jan 2014 21:34:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:34:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:34:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:34:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:34:18 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:34:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:34:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:34:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:34:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:34:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:34:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:34:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:34:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:34:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:34:23 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:34:23 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:34:23 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:34:23 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:34:23 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:34:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:34:27 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:34:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:34:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:34:27 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:34:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 21:34:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:34:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:34:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:34:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:34:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:34:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:34:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43620134
Sat 18 Jan 2014 21:34:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:34:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43620134
Sat 18 Jan 2014 21:34:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:34:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:34:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:34:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:34:38 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:34:38 - job_xml_thread(): Done retrieving: data size 43620134
Sat 18 Jan 2014 21:34:38 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:34:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:34:38 - XML: Start document: iteration 2
Sat 18 Jan 2014 21:34:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:34:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:34:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:34:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:34:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:34:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:34:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:34:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:34:41 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:34:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:34:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 21:34:41 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:34:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 21:34:41 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:34:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5865 values 92635 bits 11579 bytes 
Sat 18 Jan 2014 21:34:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:34:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:34:51 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:34:51 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:34:51 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:34:51 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:34:51 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:34:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:34:52 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:34:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:34:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:34:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:34:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:34:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:34:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:34:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:34:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43601231
Sat 18 Jan 2014 21:34:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:34:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:34:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:34:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43601231
Sat 18 Jan 2014 21:34:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:35:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:35:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:35:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:35:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:35:06 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:35:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:35:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:35:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:35:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:35:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:35:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:35:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:35:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:35:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:35:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:35:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:35:09 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:35:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 21:35:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:35:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:35:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:35:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:35:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:35:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:35:10 - job_xml_thread(): Done retrieving: data size 43573776
Sat 18 Jan 2014 21:35:10 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:35:10 - XML: Start document: iteration 3
Sat 18 Jan 2014 21:35:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573776
Sat 18 Jan 2014 21:35:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573776
Sat 18 Jan 2014 21:35:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:35:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:35:17 - XML: Processed 653446 elements - found 0 jobs
Sat 18 Jan 2014 21:35:17 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:35:17 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:35:17 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:35:17 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:35:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:35:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:35:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:35:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:35:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:35:24 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:35:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:35:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:35:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:35:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:35:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:35:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:35:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:35:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:35:29 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:35:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:35:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:35:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:35:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:35:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:35:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:35:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:35:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43387244
Sat 18 Jan 2014 21:35:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:35:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43387244
Sat 18 Jan 2014 21:35:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:35:32 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:35:33 - job_xml_thread(): Done retrieving: data size 43387244
Sat 18 Jan 2014 21:35:33 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:35:34 - XML: Start document: iteration 4
Sat 18 Jan 2014 21:35:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:35:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:35:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:35:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:35:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:35:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:35:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:35:41 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:35:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:35:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:35:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:35:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:35:43 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:35:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:35:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:35:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 21:35:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 21:35:43 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:35:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9062 values 143157 bits 17894 bytes 
Sat 18 Jan 2014 21:35:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:35:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:35:47 - XML: Processed 651108 elements - found 0 jobs
Sat 18 Jan 2014 21:35:47 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:35:47 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:35:47 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:35:47 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:35:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:35:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:35:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:35:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:35:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:35:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:35:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:35:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:35:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:35:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42975429
Sat 18 Jan 2014 21:35:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:35:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42975429
Sat 18 Jan 2014 21:35:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:35:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:35:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:36:02 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:36:02 - job_xml_thread(): Done retrieving: data size 42975429
Sat 18 Jan 2014 21:36:02 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:36:02 - XML: Start document: iteration 5
Sat 18 Jan 2014 21:36:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:36:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:36:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:36:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:36:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:36:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:36:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:36:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:36:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:36:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:36:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:36:14 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:36:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 21:36:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:36:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:36:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:36:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:36:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:36:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:36:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:36:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:36:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:36:17 - XML: Processed 646384 elements - found 0 jobs
Sat 18 Jan 2014 21:36:17 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:36:17 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:36:17 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:36:17 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:36:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:36:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43018295
Sat 18 Jan 2014 21:36:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:36:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43018295
Sat 18 Jan 2014 21:36:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:36:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:36:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:36:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:36:31 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:36:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:36:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:36:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:36:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:36:32 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:36:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:36:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:36:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:36:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:36:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:36:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:36:35 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:36:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:36:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:36:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:36:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:36:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:36:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:36:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:36:37 - job_xml_thread(): Done retrieving: data size 43378175
Sat 18 Jan 2014 21:36:37 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:36:37 - XML: Start document: iteration 6
Sat 18 Jan 2014 21:36:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43378175
Sat 18 Jan 2014 21:36:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:36:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43378175
Sat 18 Jan 2014 21:36:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:36:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:36:43 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:36:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:36:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 21:36:43 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:36:43 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:36:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 21:36:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9188 values 145075 bits 18134 bytes 
Sat 18 Jan 2014 21:36:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:36:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:36:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:36:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:36:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:36:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:36:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:36:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:36:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:36:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:36:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:36:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:36:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:36:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:36:56 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:36:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:36:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:36:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:36:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:36:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:36:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:36:59 - XML: Processed 651026 elements - found 0 jobs
Sat 18 Jan 2014 21:36:59 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:36:59 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:36:59 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:36:59 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:37:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:37:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43623865
Sat 18 Jan 2014 21:37:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:37:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43623865
Sat 18 Jan 2014 21:37:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:37:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:37:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:37:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:37:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:37:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:37:14 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:37:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:37:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:37:14 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:37:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:37:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:37:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:37:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:37:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:37:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:37:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:37:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:37:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:37:18 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:37:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 21:37:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:37:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:37:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:37:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:37:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:37:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:37:22 - job_xml_thread(): Done retrieving: data size 43631114
Sat 18 Jan 2014 21:37:22 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:37:22 - XML: Start document: iteration 7
Sat 18 Jan 2014 21:37:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43631114
Sat 18 Jan 2014 21:37:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:37:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43631114
Sat 18 Jan 2014 21:37:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:37:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:37:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:37:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:37:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:37:34 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 21:37:34 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:37:36 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:37:36 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:37:36 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 21:37:36 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 21:37:36 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 21:37:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:37:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:37:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:37:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:37:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:37:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:37:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:37:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:37:42 - size of cluster 'LISA Cluster': 624 hosts 79485 metrics 918771 values 14498927 bits 1812365 bytes 
Sat 18 Jan 2014 21:37:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:37:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:37:43 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:37:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:37:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:37:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:37:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:37:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:37:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:37:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:37:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:37:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:37:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 21:37:44 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:37:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 21:37:44 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:37:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5667 values 89417 bits 11177 bytes 
Sat 18 Jan 2014 21:37:48 - XML: Processed 654193 elements - found 0 jobs
Sat 18 Jan 2014 21:37:48 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:37:48 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:37:48 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:37:48 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:37:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:37:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43618980
Sat 18 Jan 2014 21:37:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:37:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43618980
Sat 18 Jan 2014 21:37:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:37:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:37:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:37:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:37:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:38:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:38:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:38:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:38:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:38:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:38:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:38:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:38:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43618980
Sat 18 Jan 2014 21:38:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:38:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:38:03 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:38:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:38:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:38:15 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:38:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:38:16 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:38:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:38:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:38:16 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:38:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 21:38:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:38:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:38:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:38:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:38:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:38:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:38:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:38:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:38:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:38:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:38:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:38:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:38:20 - job_xml_thread(): Done retrieving: data size 43612684
Sat 18 Jan 2014 21:38:20 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:38:20 - XML: Start document: iteration 8
Sat 18 Jan 2014 21:38:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43612684
Sat 18 Jan 2014 21:38:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:38:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43612684
Sat 18 Jan 2014 21:38:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:38:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:38:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:38:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:38:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:38:36 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:38:36 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 21:38:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:38:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:38:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:38:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:38:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:38:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:38:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:38:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:38:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:38:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:38:45 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:38:45 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:38:45 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:38:45 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:38:45 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:38:45 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:38:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:38:46 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:38:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 21:38:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 21:38:46 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:38:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5759 values 90879 bits 11359 bytes 
Sat 18 Jan 2014 21:38:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:38:46 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:38:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:38:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:38:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:38:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:38:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:38:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:38:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:38:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43632142
Sat 18 Jan 2014 21:38:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:38:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43632142
Sat 18 Jan 2014 21:38:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:38:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:38:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:39:00 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:39:00 - job_xml_thread(): Done retrieving: data size 43632142
Sat 18 Jan 2014 21:39:00 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:39:00 - XML: Start document: iteration 9
Sat 18 Jan 2014 21:39:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:39:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:39:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:39:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:39:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:39:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:39:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:39:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:39:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:39:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:39:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:39:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:39:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:39:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:39:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:39:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:39:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:39:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:39:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:39:13 - XML: Processed 654189 elements - found 0 jobs
Sat 18 Jan 2014 21:39:13 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:39:13 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:39:13 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:39:13 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:39:14 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:39:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 21:39:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:39:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:39:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43633636
Sat 18 Jan 2014 21:39:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:39:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43633636
Sat 18 Jan 2014 21:39:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:39:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:39:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:39:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:39:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:39:29 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:39:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:39:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:39:31 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:39:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:39:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:39:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:39:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:39:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:39:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:39:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:39:34 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:39:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:39:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:39:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:39:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:39:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:39:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:39:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:39:37 - job_xml_thread(): Done retrieving: data size 43621452
Sat 18 Jan 2014 21:39:37 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:39:37 - XML: Start document: iteration 10
Sat 18 Jan 2014 21:39:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43621452
Sat 18 Jan 2014 21:39:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:39:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43621452
Sat 18 Jan 2014 21:39:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:39:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:39:46 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:39:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:39:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:39:47 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:39:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:39:47 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:39:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 21:39:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 21:39:47 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:39:47 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:39:47 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:39:47 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:39:47 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:39:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8836 values 139427 bits 17428 bytes 
Sat 18 Jan 2014 21:39:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:39:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:39:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:39:56 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:39:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:39:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:39:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:39:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:39:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:39:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:39:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:40:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:40:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:40:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:40:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:40:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:40:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:40:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:40:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:40:02 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:40:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:40:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43643291
Sat 18 Jan 2014 21:40:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:40:04 - job_xml_thread(): Done retrieving: data size 43643291
Sat 18 Jan 2014 21:40:04 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:40:05 - XML: Start document: iteration 11
Sat 18 Jan 2014 21:40:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43643291
Sat 18 Jan 2014 21:40:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:40:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:40:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:40:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:40:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:40:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:40:18 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:40:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:40:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:40:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:40:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:40:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:40:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:40:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:40:24 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:40:24 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:40:24 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:40:24 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:40:24 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:40:24 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:40:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 21:40:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:40:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:40:28 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:40:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:40:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:40:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:40:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:40:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:40:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:40:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:40:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43623051
Sat 18 Jan 2014 21:40:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:40:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43623051
Sat 18 Jan 2014 21:40:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:40:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:40:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:40:39 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:40:39 - job_xml_thread(): Done retrieving: data size 43623051
Sat 18 Jan 2014 21:40:39 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:40:39 - XML: Start document: iteration 12
Sat 18 Jan 2014 21:40:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:40:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:40:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:40:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:40:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:40:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:40:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:40:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:40:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:40:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:40:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:40:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:40:47 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:40:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:40:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 21:40:48 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:40:48 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:40:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6018 values 95056 bits 11882 bytes 
Sat 18 Jan 2014 21:40:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 21:40:48 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:40:48 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:40:48 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:40:48 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:40:49 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:40:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:40:54 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:40:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:40:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:40:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:40:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:40:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:40:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:40:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:40:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:40:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:40:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43602324
Sat 18 Jan 2014 21:40:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:40:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43602324
Sat 18 Jan 2014 21:40:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:41:04 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:41:04 - job_xml_thread(): Done retrieving: data size 43602324
Sat 18 Jan 2014 21:41:04 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:41:04 - XML: Start document: iteration 13
Sat 18 Jan 2014 21:41:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:41:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:41:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:41:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:41:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:41:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:41:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:41:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:41:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:41:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:41:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:41:18 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:41:18 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:41:18 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:41:18 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:41:18 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:41:20 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:41:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 21:41:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:41:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:41:23 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:41:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:41:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:41:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:41:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:41:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:41:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:41:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:41:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43539953
Sat 18 Jan 2014 21:41:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:41:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:41:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:41:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43539953
Sat 18 Jan 2014 21:41:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:41:33 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:41:34 - job_xml_thread(): Done retrieving: data size 43539953
Sat 18 Jan 2014 21:41:34 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:41:34 - XML: Start document: iteration 14
Sat 18 Jan 2014 21:41:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:41:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:41:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:41:42 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:41:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:41:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:41:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:41:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:41:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:41:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:41:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:41:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:41:48 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:41:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:41:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:41:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:41:48 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:41:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:41:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:41:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:41:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:41:49 - XML: Processed 653440 elements - found 0 jobs
Sat 18 Jan 2014 21:41:49 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:41:49 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:41:49 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:41:49 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:41:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:41:49 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:41:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 21:41:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 21:41:49 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:41:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5905 values 93256 bits 11657 bytes 
Sat 18 Jan 2014 21:41:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:41:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42988946
Sat 18 Jan 2014 21:41:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:41:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42988946
Sat 18 Jan 2014 21:41:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:42:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:42:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:42:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:42:02 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:42:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:42:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:42:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:42:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:42:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:42:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:42:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:42:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:42:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:42:04 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:42:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:42:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:42:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:42:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:42:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:42:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:42:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:42:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:42:09 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:42:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 21:42:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:42:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:42:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42995855
Sat 18 Jan 2014 21:42:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:42:13 - job_xml_thread(): Done retrieving: data size 42995855
Sat 18 Jan 2014 21:42:13 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:42:13 - XML: Start document: iteration 15
Sat 18 Jan 2014 21:42:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42995855
Sat 18 Jan 2014 21:42:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:42:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:42:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:42:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:42:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:42:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:42:31 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:42:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:42:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:42:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:42:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:42:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:42:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:42:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:42:34 - XML: Processed 646376 elements - found 0 jobs
Sat 18 Jan 2014 21:42:34 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:42:34 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:42:34 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:42:34 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:42:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:42:35 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:42:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:42:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:42:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:42:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:42:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:42:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:42:39 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 21:42:39 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 21:42:39 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:42:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:42:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43525919
Sat 18 Jan 2014 21:42:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:42:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43525919
Sat 18 Jan 2014 21:42:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:42:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:42:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:42:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:42:49 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:42:49 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:42:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:42:49 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:42:49 - job_xml_thread(): Done retrieving: data size 43525919
Sat 18 Jan 2014 21:42:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:42:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:42:49 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:42:49 - XML: Start document: iteration 16
Sat 18 Jan 2014 21:42:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:42:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:42:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:42:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:42:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 21:42:51 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:42:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:42:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8718 values 137559 bits 17194 bytes 
Sat 18 Jan 2014 21:42:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:42:51 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:42:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 21:42:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:42:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:42:59 - XML: Processed 653024 elements - found 0 jobs
Sat 18 Jan 2014 21:42:59 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:42:59 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:42:59 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:42:59 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:43:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:43:02 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:43:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:43:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:43:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:43:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:43:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:43:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:43:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:43:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43604979
Sat 18 Jan 2014 21:43:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:43:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43604979
Sat 18 Jan 2014 21:43:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:43:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:43:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:43:14 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:43:14 - job_xml_thread(): Done retrieving: data size 43604979
Sat 18 Jan 2014 21:43:14 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:43:14 - XML: Start document: iteration 17
Sat 18 Jan 2014 21:43:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:43:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:43:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:43:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:43:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:43:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:43:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:43:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:43:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:43:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:43:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:43:28 - XML: Processed 654148 elements - found 0 jobs
Sat 18 Jan 2014 21:43:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:43:28 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:43:28 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:43:28 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:43:28 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:43:28 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:43:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:43:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:43:29 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:43:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 21:43:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:43:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:43:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:43:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:43:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:43:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:43:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43639642
Sat 18 Jan 2014 21:43:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:43:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43639642
Sat 18 Jan 2014 21:43:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:43:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:43:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:43:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:43:42 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:43:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:43:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:43:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:43:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:43:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:43:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:43:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:43:44 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:43:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:43:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:43:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:43:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:43:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:43:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:43:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:43:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:43:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:43:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43646955
Sat 18 Jan 2014 21:43:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:43:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43646955
Sat 18 Jan 2014 21:43:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:43:48 - job_xml_thread(): Done retrieving: data size 43646955
Sat 18 Jan 2014 21:43:48 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:43:48 - XML: Start document: iteration 18
Sat 18 Jan 2014 21:43:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:43:51 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:43:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:43:51 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:43:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 21:43:51 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:43:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 21:43:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9242 values 145967 bits 18245 bytes 
Sat 18 Jan 2014 21:43:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:43:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:43:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:43:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:43:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:43:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:43:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:43:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:43:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:43:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:43:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:44:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:44:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:44:09 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:44:09 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:44:09 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:44:09 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:44:09 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:44:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:44:10 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:44:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:44:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:44:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:44:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:44:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:44:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:44:13 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:44:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 21:44:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:44:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:44:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43609751
Sat 18 Jan 2014 21:44:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:44:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43609751
Sat 18 Jan 2014 21:44:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:44:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:44:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:44:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:44:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:44:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:44:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:44:24 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:44:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:44:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:44:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:44:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:44:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:44:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:44:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:44:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:44:27 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:44:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:44:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:44:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:44:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:44:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:44:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:44:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:44:31 - job_xml_thread(): Done retrieving: data size 43643683
Sat 18 Jan 2014 21:44:31 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:44:31 - XML: Start document: iteration 19
Sat 18 Jan 2014 21:44:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43643683
Sat 18 Jan 2014 21:44:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:44:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43643683
Sat 18 Jan 2014 21:44:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:44:36 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 21:44:37 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:44:37 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:44:37 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:44:37 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 21:44:37 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 21:44:37 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 21:44:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:44:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:44:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:44:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:44:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:44:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:44:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:44:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:44:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:44:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:44:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:44:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:44:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:44:47 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:44:47 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:44:47 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:44:47 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:44:47 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:44:47 - size of cluster 'LISA Cluster': 624 hosts 79470 metrics 738791 values 11643056 bits 1455382 bytes 
Sat 18 Jan 2014 21:44:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:44:51 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:44:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:44:52 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:44:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:44:52 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:44:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 21:44:52 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:44:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 21:44:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99170 bits 12396 bytes 
Sat 18 Jan 2014 21:44:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:44:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:44:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:44:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:44:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:44:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:44:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:44:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:44:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:44:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43606257
Sat 18 Jan 2014 21:44:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:44:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43606257
Sat 18 Jan 2014 21:44:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:45:02 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:45:02 - job_xml_thread(): Done retrieving: data size 43606257
Sat 18 Jan 2014 21:45:02 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:45:02 - XML: Start document: iteration 20
Sat 18 Jan 2014 21:45:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:45:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:45:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:45:11 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:45:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:45:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:45:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:45:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:45:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:45:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:45:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:45:20 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:45:20 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:45:20 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:45:20 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:45:20 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:45:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:45:20 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:45:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:45:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:45:21 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:45:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 21:45:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:45:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:45:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:45:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:45:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:45:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:45:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43612289
Sat 18 Jan 2014 21:45:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:45:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43612289
Sat 18 Jan 2014 21:45:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:45:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:45:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:45:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:45:33 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:45:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:45:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:45:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:45:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:45:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:45:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:45:35 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:45:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43612289
Sat 18 Jan 2014 21:45:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:45:35 - job_xml_thread(): Done retrieving: data size 43612289
Sat 18 Jan 2014 21:45:35 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:45:35 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 21:45:36 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 21:45:36 - Housekeeping: done.
Sat 18 Jan 2014 21:45:36 - XML: Start document: iteration 0
Sat 18 Jan 2014 21:45:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:45:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:45:38 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:45:38 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 21:45:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:45:49 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:45:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:45:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:45:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:45:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:45:51 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:45:51 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:45:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:45:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:45:51 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:45:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:45:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:45:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:45:51 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:45:51 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:45:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:45:52 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:45:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:45:53 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:45:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 21:45:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 21:45:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:45:53 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:45:53 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:45:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5715 values 90163 bits 11270 bytes 
Sat 18 Jan 2014 21:45:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:45:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:45:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:45:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:45:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:45:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:45:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:45:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43634210
Sat 18 Jan 2014 21:45:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:45:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43634210
Sat 18 Jan 2014 21:45:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:46:06 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:46:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:46:06 - job_xml_thread(): Done retrieving: data size 43634210
Sat 18 Jan 2014 21:46:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:46:07 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:46:07 - XML: Start document: iteration 1
Sat 18 Jan 2014 21:46:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:46:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:46:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:46:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:46:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:46:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:46:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:46:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:46:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:46:18 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:46:18 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:46:18 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:46:18 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:46:18 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:46:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:46:20 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:46:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:46:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:46:20 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:46:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 21:46:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:46:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:46:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:46:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:46:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:46:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:46:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43608360
Sat 18 Jan 2014 21:46:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:46:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43608360
Sat 18 Jan 2014 21:46:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:46:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:46:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:46:33 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:46:33 - job_xml_thread(): Done retrieving: data size 43608360
Sat 18 Jan 2014 21:46:33 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:46:33 - XML: Start document: iteration 2
Sat 18 Jan 2014 21:46:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:46:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:46:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:46:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:46:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:46:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:46:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:46:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:46:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:46:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:46:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:46:42 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:46:42 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:46:42 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:46:42 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:46:42 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:46:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:46:46 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:46:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:46:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:46:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:46:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:46:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:46:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:46:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:46:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43615833
Sat 18 Jan 2014 21:46:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:46:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43615833
Sat 18 Jan 2014 21:46:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:46:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:46:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:46:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:46:53 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:46:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:46:54 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:46:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 21:46:54 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:46:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 21:46:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8883 values 140562 bits 17570 bytes 
Sat 18 Jan 2014 21:46:57 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:46:57 - job_xml_thread(): Done retrieving: data size 43615833
Sat 18 Jan 2014 21:46:57 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:46:57 - XML: Start document: iteration 3
Sat 18 Jan 2014 21:47:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:47:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:47:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:47:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:47:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:47:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:47:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:47:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:47:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:47:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:47:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:47:09 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:47:09 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:47:09 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:47:09 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:47:09 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:47:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:47:13 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:47:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:47:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:47:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:47:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:47:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:47:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:47:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:47:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43620279
Sat 18 Jan 2014 21:47:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:47:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:47:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:47:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43620279
Sat 18 Jan 2014 21:47:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:47:24 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:47:24 - job_xml_thread(): Done retrieving: data size 43620279
Sat 18 Jan 2014 21:47:24 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:47:24 - XML: Start document: iteration 4
Sat 18 Jan 2014 21:47:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:47:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:47:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:47:29 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:47:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:47:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:47:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:47:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:47:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:47:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:47:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:47:35 - XML: Processed 654143 elements - found 0 jobs
Sat 18 Jan 2014 21:47:35 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:47:35 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:47:35 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:47:35 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:47:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:47:40 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:47:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:47:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:47:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:47:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:47:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:47:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:47:40 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:47:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 21:47:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:47:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:47:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43064981
Sat 18 Jan 2014 21:47:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:47:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43064981
Sat 18 Jan 2014 21:47:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:47:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:47:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:47:51 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:47:51 - job_xml_thread(): Done retrieving: data size 43064981
Sat 18 Jan 2014 21:47:51 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:47:51 - XML: Start document: iteration 5
Sat 18 Jan 2014 21:47:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:47:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:47:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:47:55 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:47:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:47:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 21:47:57 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:47:57 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:47:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 21:47:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5632 values 89092 bits 11136 bytes 
Sat 18 Jan 2014 21:48:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:48:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:48:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:48:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:48:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:48:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:48:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:48:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:48:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:48:06 - XML: Processed 647310 elements - found 0 jobs
Sat 18 Jan 2014 21:48:06 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:48:06 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:48:06 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:48:06 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:48:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:48:06 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:48:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:48:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:48:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:48:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:48:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:48:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:48:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:48:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42961138
Sat 18 Jan 2014 21:48:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:48:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42961138
Sat 18 Jan 2014 21:48:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:48:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:48:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:48:21 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:48:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:48:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:48:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:48:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:48:24 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:48:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:48:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:48:25 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:48:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 21:48:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:48:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:48:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:48:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:48:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:48:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:48:27 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:48:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:48:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:48:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:48:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:48:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:48:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:48:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:48:31 - job_xml_thread(): Done retrieving: data size 43045776
Sat 18 Jan 2014 21:48:31 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:48:31 - XML: Start document: iteration 6
Sat 18 Jan 2014 21:48:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43045776
Sat 18 Jan 2014 21:48:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:48:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43045776
Sat 18 Jan 2014 21:48:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:48:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:48:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:48:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:48:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:48:48 - XML: Processed 646830 elements - found 0 jobs
Sat 18 Jan 2014 21:48:48 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:48:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:48:48 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:48:48 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:48:48 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:48:48 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:48:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:48:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:48:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:48:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:48:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:48:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:48:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:48:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:48:53 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:48:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:48:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:48:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:48:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:48:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:48:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:48:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:48:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43616964
Sat 18 Jan 2014 21:48:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:48:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43616964
Sat 18 Jan 2014 21:48:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:48:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:48:57 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:48:58 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:48:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 21:48:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:48:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 21:48:59 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:48:59 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9322 values 147355 bits 18419 bytes 
Sat 18 Jan 2014 21:49:03 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:49:03 - job_xml_thread(): Done retrieving: data size 43616964
Sat 18 Jan 2014 21:49:03 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:49:03 - XML: Start document: iteration 7
Sat 18 Jan 2014 21:49:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:49:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:49:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:49:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:49:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:49:11 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:49:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:49:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:49:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:49:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:49:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:49:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:49:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:49:19 - XML: Processed 653930 elements - found 0 jobs
Sat 18 Jan 2014 21:49:19 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:49:19 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:49:19 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:49:19 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:49:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:49:21 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:49:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:49:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:49:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:49:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:49:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:49:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:49:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:49:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43604454
Sat 18 Jan 2014 21:49:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:49:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43604454
Sat 18 Jan 2014 21:49:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:49:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:49:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:49:34 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:49:34 - job_xml_thread(): Done retrieving: data size 43604454
Sat 18 Jan 2014 21:49:34 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:49:34 - XML: Start document: iteration 8
Sat 18 Jan 2014 21:49:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:49:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:49:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:49:42 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:49:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:49:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:49:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:49:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:49:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:49:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:49:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:49:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:49:48 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:49:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:49:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:49:49 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:49:49 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:49:49 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:49:49 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:49:49 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:49:49 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:49:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 21:49:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:49:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:49:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:49:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:49:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:49:51 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 21:49:51 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 21:49:51 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:49:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:49:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43614003
Sat 18 Jan 2014 21:49:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:49:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43614003
Sat 18 Jan 2014 21:49:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:49:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:49:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:49:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:49:59 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:49:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:49:59 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:49:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 21:50:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 21:50:00 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:50:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5963 values 94183 bits 11772 bytes 
Sat 18 Jan 2014 21:50:04 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:50:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:50:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:50:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:50:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:50:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:50:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:50:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:50:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:50:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:50:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:50:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:50:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:50:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:50:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:50:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:50:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:50:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:50:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:50:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:50:10 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:50:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 21:50:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:50:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:50:11 - job_xml_thread(): Done retrieving: data size 43634318
Sat 18 Jan 2014 21:50:11 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:50:11 - XML: Start document: iteration 9
Sat 18 Jan 2014 21:50:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43634318
Sat 18 Jan 2014 21:50:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:50:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43634318
Sat 18 Jan 2014 21:50:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:50:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:50:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:50:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:50:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:50:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:50:25 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:50:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:50:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:50:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:50:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:50:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:50:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:50:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:50:28 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:50:28 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:50:28 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:50:28 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:50:28 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:50:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:50:32 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:50:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:50:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:50:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:50:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:50:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:50:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:50:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:50:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43636926
Sat 18 Jan 2014 21:50:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:50:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43636926
Sat 18 Jan 2014 21:50:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:50:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:50:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:50:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:50:43 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:50:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:50:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:50:43 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:50:43 - job_xml_thread(): Done retrieving: data size 43636926
Sat 18 Jan 2014 21:50:44 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:50:44 - XML: Start document: iteration 10
Sat 18 Jan 2014 21:50:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:50:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:50:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:50:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:50:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:50:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:50:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:50:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:50:53 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:50:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:50:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:50:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:50:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:50:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:50:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:50:56 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:50:56 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:50:56 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:50:56 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:50:56 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:50:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:50:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43610940
Sat 18 Jan 2014 21:50:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43610940
Sat 18 Jan 2014 21:50:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:50:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:50:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:50:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:51:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:51:00 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:51:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:51:01 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:51:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 21:51:01 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:51:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 21:51:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148719 bits 18589 bytes 
Sat 18 Jan 2014 21:51:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:51:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:51:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:51:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:51:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:51:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:51:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:51:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:51:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:51:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:51:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:51:11 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:51:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:51:13 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:51:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:51:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:51:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:51:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:51:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:51:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:51:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:51:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43637017
Sat 18 Jan 2014 21:51:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:51:16 - job_xml_thread(): Done retrieving: data size 43637017
Sat 18 Jan 2014 21:51:17 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:51:17 - XML: Start document: iteration 11
Sat 18 Jan 2014 21:51:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43637017
Sat 18 Jan 2014 21:51:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:51:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:51:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:51:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:51:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:51:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:51:30 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:51:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:51:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:51:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:51:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:51:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:51:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:51:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:51:33 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:51:33 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:51:34 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:51:34 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:51:34 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:51:38 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 21:51:38 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:51:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:51:38 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:51:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:51:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:51:38 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:51:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 21:51:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:51:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:51:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:51:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:51:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:51:39 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:51:39 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 21:51:39 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 21:51:39 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:51:39 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 21:51:40 - size of cluster 'LISA Cluster': 624 hosts 79480 metrics 723476 values 11419628 bits 1427453 bytes 
Sat 18 Jan 2014 21:51:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:51:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43617727
Sat 18 Jan 2014 21:51:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:51:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43617727
Sat 18 Jan 2014 21:51:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:51:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:51:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:51:49 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:51:49 - job_xml_thread(): Done retrieving: data size 43617727
Sat 18 Jan 2014 21:51:49 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:51:49 - XML: Start document: iteration 12
Sat 18 Jan 2014 21:51:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:51:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:52:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:52:01 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:52:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:52:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 21:52:02 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:52:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6004 values 94773 bits 11846 bytes 
Sat 18 Jan 2014 21:52:02 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:52:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 21:52:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:52:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:52:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:52:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:52:06 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:52:06 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:52:06 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:52:06 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:52:06 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:52:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:52:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:52:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:52:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:52:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:52:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:52:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:52:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:52:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:52:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:52:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:52:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:52:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:52:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:52:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43633667
Sat 18 Jan 2014 21:52:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:52:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43633667
Sat 18 Jan 2014 21:52:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:52:22 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:52:22 - job_xml_thread(): Done retrieving: data size 43633667
Sat 18 Jan 2014 21:52:22 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:52:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:52:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:52:22 - XML: Start document: iteration 13
Sat 18 Jan 2014 21:52:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:52:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:52:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:52:25 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:52:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:52:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:52:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:52:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:52:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:52:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:52:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:52:33 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:52:33 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:52:33 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:52:33 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:52:33 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:52:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:52:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:52:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:52:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:52:36 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:52:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 21:52:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:52:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:52:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:52:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:52:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:52:39 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:52:39 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 21:52:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:52:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43604618
Sat 18 Jan 2014 21:52:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:52:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43604618
Sat 18 Jan 2014 21:52:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:52:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:52:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:52:48 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:52:48 - job_xml_thread(): Done retrieving: data size 43604618
Sat 18 Jan 2014 21:52:48 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:52:48 - XML: Start document: iteration 14
Sat 18 Jan 2014 21:52:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:52:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:52:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:52:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:52:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:52:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:53:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:53:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:53:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:53:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:53:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:53:01 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:53:01 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:53:01 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:53:01 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:53:01 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:53:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:53:02 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:53:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:53:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 21:53:03 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:53:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5624 values 88675 bits 11084 bytes 
Sat 18 Jan 2014 21:53:03 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:53:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:53:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 21:53:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:53:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:53:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:53:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:53:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:53:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:53:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:53:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:53:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43632056
Sat 18 Jan 2014 21:53:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:53:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43632056
Sat 18 Jan 2014 21:53:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:53:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:53:16 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:53:16 - job_xml_thread(): Done retrieving: data size 43632056
Sat 18 Jan 2014 21:53:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:53:16 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:53:16 - XML: Start document: iteration 15
Sat 18 Jan 2014 21:53:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:53:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:53:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:53:24 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:53:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:53:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:53:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:53:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:53:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:53:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:53:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:53:30 - XML: Processed 654191 elements - found 0 jobs
Sat 18 Jan 2014 21:53:30 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:53:30 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:53:30 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:53:30 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:53:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:53:31 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:53:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:53:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:53:31 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:53:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 21:53:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:53:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:53:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:53:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:53:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:53:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:53:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43230855
Sat 18 Jan 2014 21:53:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:53:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43230855
Sat 18 Jan 2014 21:53:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:53:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:53:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:53:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:53:42 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:53:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:53:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:53:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:53:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:53:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:53:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:53:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:53:45 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:53:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:53:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:53:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:53:48 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:53:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:53:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:53:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:53:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:53:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:53:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:53:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:53:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42996076
Sat 18 Jan 2014 21:53:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:53:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42996076
Sat 18 Jan 2014 21:53:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:53:52 - job_xml_thread(): Done retrieving: data size 42996076
Sat 18 Jan 2014 21:53:52 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:53:52 - XML: Start document: iteration 16
Sat 18 Jan 2014 21:54:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:54:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:54:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:54:03 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:54:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:54:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:54:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:54:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:54:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:54:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:54:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:54:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:54:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:54:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:54:06 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:54:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 21:54:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:54:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:54:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 21:54:06 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:54:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8807 values 138858 bits 17357 bytes 
Sat 18 Jan 2014 21:54:11 - XML: Processed 646426 elements - found 0 jobs
Sat 18 Jan 2014 21:54:11 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:54:11 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:54:11 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:54:11 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:54:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:54:14 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:54:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:54:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:54:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:54:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:54:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:54:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:54:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:54:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42969916
Sat 18 Jan 2014 21:54:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:54:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42969916
Sat 18 Jan 2014 21:54:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:54:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:54:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:54:26 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:54:26 - job_xml_thread(): Done retrieving: data size 42969916
Sat 18 Jan 2014 21:54:26 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:54:26 - XML: Start document: iteration 17
Sat 18 Jan 2014 21:54:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:54:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:54:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:54:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:54:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:54:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:54:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:54:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:54:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:54:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:54:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:54:37 - XML: Processed 646056 elements - found 0 jobs
Sat 18 Jan 2014 21:54:37 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:54:37 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:54:37 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:54:37 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:54:40 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:54:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 21:54:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:54:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:54:42 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:54:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:54:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:54:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:54:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:54:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:54:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:54:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:54:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:54:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:54:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43507559
Sat 18 Jan 2014 21:54:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:54:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43507559
Sat 18 Jan 2014 21:54:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:54:52 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:54:52 - job_xml_thread(): Done retrieving: data size 43507559
Sat 18 Jan 2014 21:54:52 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:54:52 - XML: Start document: iteration 18
Sat 18 Jan 2014 21:54:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:54:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:54:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:54:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:54:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:54:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:55:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:55:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:55:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:55:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:55:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:55:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:55:06 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:55:06 - XML: Processed 652944 elements - found 0 jobs
Sat 18 Jan 2014 21:55:06 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:55:06 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:55:06 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:55:06 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:55:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:55:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 21:55:07 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:55:07 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:55:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5668 values 89327 bits 11165 bytes 
Sat 18 Jan 2014 21:55:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 21:55:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:55:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:55:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:55:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:55:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:55:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:55:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:55:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:55:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:55:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43615527
Sat 18 Jan 2014 21:55:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:55:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43615527
Sat 18 Jan 2014 21:55:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:55:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:55:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:55:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:55:19 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:55:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:55:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:55:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:55:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:55:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:55:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43615527
Sat 18 Jan 2014 21:55:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:55:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:55:22 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:55:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:55:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:55:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:55:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:55:28 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:55:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:55:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:55:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:55:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:55:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:55:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:55:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:55:32 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:55:32 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:55:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 21:55:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:55:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:55:34 - job_xml_thread(): Done retrieving: data size 43608045
Sat 18 Jan 2014 21:55:34 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:55:34 - XML: Start document: iteration 19
Sat 18 Jan 2014 21:55:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43608045
Sat 18 Jan 2014 21:55:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:55:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:55:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:55:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:55:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:55:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:55:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:55:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43608045
Sat 18 Jan 2014 21:55:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:55:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:55:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:55:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:55:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:55:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:55:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:55:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:55:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:55:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:55:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:55:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:55:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:55:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:55:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:55:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:55:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:55:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:55:58 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:55:58 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:55:58 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:55:58 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:55:58 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:55:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:55:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:55:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:55:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:56:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:56:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43649085
Sat 18 Jan 2014 21:56:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:56:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43649085
Sat 18 Jan 2014 21:56:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:56:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:56:07 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:56:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:56:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 21:56:08 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:56:08 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:56:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 21:56:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8967 values 141447 bits 17680 bytes 
Sat 18 Jan 2014 21:56:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:56:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:56:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:56:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:56:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:56:14 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:56:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:56:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:56:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:56:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:56:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:56:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:56:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:56:16 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:56:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:56:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:56:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:56:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:56:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:56:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:56:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:56:20 - job_xml_thread(): Done retrieving: data size 43630879
Sat 18 Jan 2014 21:56:20 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:56:20 - XML: Start document: iteration 20
Sat 18 Jan 2014 21:56:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43630879
Sat 18 Jan 2014 21:56:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:56:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43630879
Sat 18 Jan 2014 21:56:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:56:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:56:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:56:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:56:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:56:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:56:37 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:56:37 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:56:37 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:56:37 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:56:37 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:56:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:56:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:56:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:56:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:56:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:56:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:56:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:56:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:56:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:56:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:56:44 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:56:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 21:56:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:56:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:56:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:56:44 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 21:56:44 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 21:56:44 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:56:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:56:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:56:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:56:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:56:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:56:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43642241
Sat 18 Jan 2014 21:56:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:56:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43642241
Sat 18 Jan 2014 21:56:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:56:52 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:56:52 - job_xml_thread(): Done retrieving: data size 43642241
Sat 18 Jan 2014 21:56:52 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:56:52 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 21:56:53 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 21:56:53 - Housekeeping: done.
Sat 18 Jan 2014 21:56:53 - XML: Start document: iteration 0
Sat 18 Jan 2014 21:56:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:56:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:57:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:57:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:57:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:57:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:57:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:57:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:57:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:57:07 - XML: Processed 654195 elements - found 0 jobs
Sat 18 Jan 2014 21:57:07 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:57:07 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:57:07 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:57:07 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:57:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:57:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:57:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:57:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:57:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:57:07 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:57:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:57:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:57:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:57:08 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:57:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:57:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:57:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:57:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:57:08 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:57:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 21:57:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:57:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 21:57:08 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:57:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5774 values 91017 bits 11377 bytes 
Sat 18 Jan 2014 21:57:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:57:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43657450
Sat 18 Jan 2014 21:57:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:57:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43657450
Sat 18 Jan 2014 21:57:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:57:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:57:20 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:57:22 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:57:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:57:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:57:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:57:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:57:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:57:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:57:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:57:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:57:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:57:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:57:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:57:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:57:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:57:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:57:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:57:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:57:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:57:28 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:57:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 21:57:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:57:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:57:29 - job_xml_thread(): Done retrieving: data size 43651341
Sat 18 Jan 2014 21:57:29 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:57:29 - XML: Start document: iteration 1
Sat 18 Jan 2014 21:57:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43651341
Sat 18 Jan 2014 21:57:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43651341
Sat 18 Jan 2014 21:57:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:57:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:57:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:57:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:57:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:57:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:57:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:57:47 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:57:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:57:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:57:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:57:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:57:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:57:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:57:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:57:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:57:52 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:57:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:57:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:57:53 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:57:53 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:57:53 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:57:53 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:57:53 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:57:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:57:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:57:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:57:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:57:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:57:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43643069
Sat 18 Jan 2014 21:57:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:57:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43643069
Sat 18 Jan 2014 21:57:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:58:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:58:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:58:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:58:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:58:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:58:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:58:08 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:58:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:58:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:58:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:58:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:58:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:58:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:58:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:58:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:58:08 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:58:09 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:58:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:58:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 21:58:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 21:58:09 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:58:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7785 values 122820 bits 15352 bytes 
Sat 18 Jan 2014 21:58:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:58:11 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:58:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:58:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:58:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:58:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:58:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:58:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:58:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:58:14 - job_xml_thread(): Done retrieving: data size 43657767
Sat 18 Jan 2014 21:58:14 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:58:14 - XML: Start document: iteration 2
Sat 18 Jan 2014 21:58:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43657767
Sat 18 Jan 2014 21:58:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:58:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43657767
Sat 18 Jan 2014 21:58:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:58:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:58:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:58:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:58:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:58:31 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:58:31 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:58:31 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:58:31 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:58:31 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:58:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:58:32 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:58:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:58:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:58:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:58:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:58:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:58:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:58:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:58:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:58:37 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:58:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:58:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:58:37 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:58:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 21:58:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:58:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:58:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:58:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:58:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:58:39 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 21:58:39 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:58:39 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:58:39 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:58:39 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 21:58:39 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 21:58:39 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 21:58:40 - size of cluster 'LISA Cluster': 624 hosts 79464 metrics 728543 values 11481817 bits 1435227 bytes 
Sat 18 Jan 2014 21:58:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:58:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43646771
Sat 18 Jan 2014 21:58:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:58:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43646771
Sat 18 Jan 2014 21:58:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:58:46 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:58:46 - job_xml_thread(): Done retrieving: data size 43646771
Sat 18 Jan 2014 21:58:46 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:58:46 - XML: Start document: iteration 3
Sat 18 Jan 2014 21:58:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:58:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:58:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:58:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:58:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:58:56 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:58:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:58:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:58:57 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:58:57 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:58:57 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:58:57 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:58:57 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:58:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:58:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:58:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:58:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:58:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:59:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:59:02 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:59:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:59:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:59:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:59:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:59:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:59:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:59:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:59:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43626292
Sat 18 Jan 2014 21:59:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:59:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43626292
Sat 18 Jan 2014 21:59:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:59:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:59:09 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:59:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:59:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 21:59:10 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:59:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 21:59:10 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:59:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8828 values 139200 bits 17400 bytes 
Sat 18 Jan 2014 21:59:12 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:59:12 - job_xml_thread(): Done retrieving: data size 43626292
Sat 18 Jan 2014 21:59:12 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:59:12 - XML: Start document: iteration 4
Sat 18 Jan 2014 21:59:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:59:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:59:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:59:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:59:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:59:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:59:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:59:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:59:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:59:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:59:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:59:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:59:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:59:27 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 21:59:27 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 21:59:27 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 21:59:27 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 21:59:27 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 21:59:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:59:28 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:59:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:59:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:59:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:59:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:59:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:59:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:59:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:59:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565680
Sat 18 Jan 2014 21:59:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 21:59:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565680
Sat 18 Jan 2014 21:59:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:59:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 21:59:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:59:39 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:59:39 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 21:59:42 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 21:59:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 21:59:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 21:59:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 21:59:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 21:59:45 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 21:59:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 21:59:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:59:46 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 21:59:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 21:59:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 21:59:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:59:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 21:59:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 21:59:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 21:59:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 21:59:48 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 21:59:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 21:59:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 21:59:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:59:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 21:59:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 21:59:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 21:59:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 21:59:52 - job_xml_thread(): Done retrieving: data size 42994000
Sat 18 Jan 2014 21:59:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42994000
Sat 18 Jan 2014 21:59:52 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 21:59:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42994000
Sat 18 Jan 2014 21:59:52 - XML: Start document: iteration 5
Sat 18 Jan 2014 21:59:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 21:59:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:00:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:00:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:00:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:00:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:00:06 - XML: Processed 646656 elements - found 0 jobs
Sat 18 Jan 2014 22:00:06 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:00:06 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:00:06 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:00:06 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:00:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:00:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:00:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:00:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:00:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:00:10 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:00:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:00:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:00:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:00:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:00:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:00:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 22:00:11 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:00:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6079 values 95904 bits 11988 bytes 
Sat 18 Jan 2014 22:00:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:00:11 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:00:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 22:00:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:00:12 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:00:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:00:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:00:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:00:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:00:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:00:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:00:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:00:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42981811
Sat 18 Jan 2014 22:00:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:00:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42981811
Sat 18 Jan 2014 22:00:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:00:21 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:00:21 - job_xml_thread(): Done retrieving: data size 42981811
Sat 18 Jan 2014 22:00:21 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:00:21 - XML: Start document: iteration 6
Sat 18 Jan 2014 22:00:22 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:00:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 22:00:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:00:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:00:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:00:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:00:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:00:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:00:31 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:00:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:00:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:00:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:00:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:00:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:00:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:00:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:00:35 - XML: Processed 646004 elements - found 0 jobs
Sat 18 Jan 2014 22:00:35 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:00:35 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:00:35 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:00:35 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:00:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:00:39 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:00:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:00:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:00:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:00:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:00:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:00:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:00:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:00:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43494739
Sat 18 Jan 2014 22:00:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:00:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43494739
Sat 18 Jan 2014 22:00:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:00:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:00:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:00:50 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:00:50 - job_xml_thread(): Done retrieving: data size 43494739
Sat 18 Jan 2014 22:00:50 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:00:50 - XML: Start document: iteration 7
Sat 18 Jan 2014 22:00:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:00:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:01:00 - XML: Processed 652624 elements - found 0 jobs
Sat 18 Jan 2014 22:01:00 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:01:00 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:01:00 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:01:00 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:01:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:01:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:01:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:01:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:01:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:01:02 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:01:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:01:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:01:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:01:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:01:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:01:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:01:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:01:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:01:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:01:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:01:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:01:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:01:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43626945
Sat 18 Jan 2014 22:01:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:01:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43626945
Sat 18 Jan 2014 22:01:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:01:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:01:11 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:01:12 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:01:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 22:01:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:01:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 22:01:12 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:01:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9238 values 145872 bits 18234 bytes 
Sat 18 Jan 2014 22:01:15 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:01:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:01:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:01:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:01:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:01:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:01:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:01:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:01:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:01:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:01:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:01:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:01:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:01:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:01:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:01:20 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:01:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:01:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:01:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:01:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:01:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:01:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:01:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:01:23 - job_xml_thread(): Done retrieving: data size 43614350
Sat 18 Jan 2014 22:01:23 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:01:23 - XML: Start document: iteration 8
Sat 18 Jan 2014 22:01:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43614350
Sat 18 Jan 2014 22:01:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:01:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43614350
Sat 18 Jan 2014 22:01:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:01:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:01:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:01:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:01:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:01:39 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:01:39 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:01:39 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:01:39 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:01:39 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:01:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:01:43 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:01:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:01:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:01:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:01:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:01:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:01:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:01:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:01:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:01:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:01:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:01:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:01:47 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:01:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 22:01:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:01:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:01:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:01:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:01:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:01:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:01:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43629490
Sat 18 Jan 2014 22:01:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:01:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43629490
Sat 18 Jan 2014 22:01:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:01:54 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:01:54 - job_xml_thread(): Done retrieving: data size 43629490
Sat 18 Jan 2014 22:01:54 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:01:54 - XML: Start document: iteration 9
Sat 18 Jan 2014 22:01:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:01:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:02:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:02:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:02:09 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:02:09 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:02:09 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:02:09 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:02:09 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:02:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:02:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:02:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:02:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:02:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:02:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:02:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:02:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:02:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:02:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:02:12 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:02:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:02:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 22:02:12 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:02:12 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:02:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 22:02:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5637 values 89055 bits 11131 bytes 
Sat 18 Jan 2014 22:02:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:02:13 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:02:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:02:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:02:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:02:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:02:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:02:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:02:18 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:02:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 22:02:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:02:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:02:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43649958
Sat 18 Jan 2014 22:02:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:02:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43649958
Sat 18 Jan 2014 22:02:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:02:24 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:02:24 - job_xml_thread(): Done retrieving: data size 43649958
Sat 18 Jan 2014 22:02:24 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:02:24 - XML: Start document: iteration 10
Sat 18 Jan 2014 22:02:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:02:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:02:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:02:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:02:33 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:02:33 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:02:33 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:02:33 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:02:33 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:02:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:02:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:02:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:02:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:02:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:02:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:02:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:02:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:02:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:02:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:02:39 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:02:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:02:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:02:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:02:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:02:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:02:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:02:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:02:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43653849
Sat 18 Jan 2014 22:02:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:02:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43653849
Sat 18 Jan 2014 22:02:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:02:48 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:02:48 - job_xml_thread(): Done retrieving: data size 43653849
Sat 18 Jan 2014 22:02:48 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:02:48 - XML: Start document: iteration 11
Sat 18 Jan 2014 22:02:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:02:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:02:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:02:53 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:02:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:02:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:02:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:02:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:02:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:02:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:02:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:02:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:02:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:02:59 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:02:59 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:02:59 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:02:59 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:02:59 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:03:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:03:04 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:03:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:03:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:03:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:03:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:03:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:03:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:03:06 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 22:03:06 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 22:03:06 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:03:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:03:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43605372
Sat 18 Jan 2014 22:03:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:03:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43605372
Sat 18 Jan 2014 22:03:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:03:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:03:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:03:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:03:12 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:03:14 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:03:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:03:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 22:03:14 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:03:14 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:03:14 - job_xml_thread(): Done retrieving: data size 43605372
Sat 18 Jan 2014 22:03:14 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:03:14 - XML: Start document: iteration 12
Sat 18 Jan 2014 22:03:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 149184 bits 18648 bytes 
Sat 18 Jan 2014 22:03:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 22:03:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:03:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:03:24 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:03:24 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:03:24 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:03:24 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:03:24 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:03:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:03:26 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:03:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:03:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:03:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:03:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:03:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:03:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:03:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:03:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:03:29 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:03:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:03:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:03:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:03:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:03:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:03:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:03:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:03:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43642957
Sat 18 Jan 2014 22:03:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:03:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43642957
Sat 18 Jan 2014 22:03:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:03:40 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:03:40 - job_xml_thread(): Done retrieving: data size 43642957
Sat 18 Jan 2014 22:03:40 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:03:40 - XML: Start document: iteration 13
Sat 18 Jan 2014 22:03:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:03:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:03:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:03:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:03:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:03:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:03:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:03:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:03:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:03:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:03:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:03:42 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:03:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 22:03:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:03:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:03:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:03:52 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:03:52 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:03:52 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:03:52 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:03:52 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:03:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:03:54 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:03:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:03:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:03:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:03:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:03:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:03:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:03:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:03:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43609929
Sat 18 Jan 2014 22:03:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:03:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43609929
Sat 18 Jan 2014 22:03:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:03:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:03:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:04:07 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:04:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:04:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:04:07 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:04:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:04:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:04:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:04:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:04:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:04:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:04:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:04:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:04:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:04:10 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:04:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:04:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:04:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:04:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:04:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:04:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:04:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:04:13 - job_xml_thread(): Done retrieving: data size 43646461
Sat 18 Jan 2014 22:04:13 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:04:13 - XML: Start document: iteration 14
Sat 18 Jan 2014 22:04:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43646461
Sat 18 Jan 2014 22:04:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:04:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43646461
Sat 18 Jan 2014 22:04:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:04:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:04:14 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:04:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:04:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 22:04:16 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:04:16 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:04:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6189 values 97755 bits 12219 bytes 
Sat 18 Jan 2014 22:04:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 22:04:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:04:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:04:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:04:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:04:29 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:04:29 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:04:29 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:04:29 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:04:29 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:04:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:04:32 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:04:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:04:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:04:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:04:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:04:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:04:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:04:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:04:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:04:37 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:04:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:04:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:04:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:04:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:04:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:04:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:04:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:04:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43636648
Sat 18 Jan 2014 22:04:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:04:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43636648
Sat 18 Jan 2014 22:04:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:04:44 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:04:44 - job_xml_thread(): Done retrieving: data size 43636648
Sat 18 Jan 2014 22:04:44 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:04:44 - XML: Start document: iteration 15
Sat 18 Jan 2014 22:04:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:04:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:04:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:04:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:04:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:04:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:04:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:04:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:04:59 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:04:59 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:04:59 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:04:59 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:04:59 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:04:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:04:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:04:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:04:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:04:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:05:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:05:04 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:05:04 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:05:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 22:05:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:05:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:05:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:05:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:05:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:05:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:05:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:05:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:05:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43616975
Sat 18 Jan 2014 22:05:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:05:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43616975
Sat 18 Jan 2014 22:05:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:05:14 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:05:14 - job_xml_thread(): Done retrieving: data size 43616975
Sat 18 Jan 2014 22:05:14 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:05:14 - XML: Start document: iteration 16
Sat 18 Jan 2014 22:05:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:05:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:05:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:05:16 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:05:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:05:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 22:05:18 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:05:18 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:05:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 22:05:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6008 values 94829 bits 11853 bytes 
Sat 18 Jan 2014 22:05:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:05:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:05:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:05:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:05:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:05:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:05:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:05:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:05:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:05:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:05:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:05:24 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:05:24 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:05:24 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:05:24 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:05:24 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:05:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:05:30 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:05:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:05:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:05:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:05:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:05:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:05:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:05:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:05:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560563
Sat 18 Jan 2014 22:05:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:05:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560563
Sat 18 Jan 2014 22:05:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:05:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:05:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:05:39 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:05:39 - job_xml_thread(): Done retrieving: data size 43560563
Sat 18 Jan 2014 22:05:39 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:05:39 - XML: Start document: iteration 17
Sat 18 Jan 2014 22:05:40 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 22:05:40 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:05:40 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:05:40 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:05:40 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 22:05:40 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 22:05:40 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 22:05:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:05:44 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:05:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:05:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:05:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:05:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:05:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:05:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:05:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:05:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:05:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sat 18 Jan 2014 22:05:51 - XML: Processed 653445 elements - found 0 jobs
Sat 18 Jan 2014 22:05:51 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:05:51 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:05:51 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:05:51 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:05:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:05:53 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:05:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:05:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:05:54 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:05:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 22:05:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:05:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:05:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:05:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:05:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:05:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:05:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42993177
Sat 18 Jan 2014 22:05:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:05:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42993177
Sat 18 Jan 2014 22:05:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:06:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:06:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:06:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:06:03 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:06:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:06:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:06:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:06:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:06:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42993177
Sat 18 Jan 2014 22:06:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:06:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:06:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:06:06 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:06:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:06:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:06:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:06:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:06:14 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:06:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:06:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:06:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:06:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:06:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:06:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:06:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:06:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:06:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:06:16 - job_xml_thread(): Done retrieving: data size 42991172
Sat 18 Jan 2014 22:06:16 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:06:16 - XML: Start document: iteration 18
Sat 18 Jan 2014 22:06:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42991172
Sat 18 Jan 2014 22:06:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:06:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:06:18 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:06:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:06:18 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:06:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 22:06:18 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:06:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 22:06:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5755 values 90751 bits 11343 bytes 
Sat 18 Jan 2014 22:06:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:06:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:06:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:06:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:06:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:06:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:06:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42991172
Sat 18 Jan 2014 22:06:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:06:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:06:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:06:36 - XML: Processed 646465 elements - found 0 jobs
Sat 18 Jan 2014 22:06:36 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:06:36 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:06:36 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:06:36 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:06:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:06:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:06:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:06:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:06:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:06:38 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:06:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:06:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:06:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:06:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:06:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:06:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:06:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:06:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:06:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:06:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:06:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:06:40 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:06:40 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:06:40 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:06:40 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 22:06:40 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:06:40 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 22:06:40 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 22:06:41 - size of cluster 'LISA Cluster': 624 hosts 79473 metrics 812983 values 12830994 bits 1603874 bytes 
Sat 18 Jan 2014 22:06:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:06:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43523732
Sat 18 Jan 2014 22:06:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:06:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43523732
Sat 18 Jan 2014 22:06:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:06:51 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:06:51 - job_xml_thread(): Done retrieving: data size 43523732
Sat 18 Jan 2014 22:06:51 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:06:51 - XML: Start document: iteration 19
Sat 18 Jan 2014 22:06:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:06:53 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:06:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:06:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:06:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:06:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:06:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:06:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:06:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:06:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:06:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:06:56 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:06:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 22:06:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:07:06 - XML: Processed 652566 elements - found 0 jobs
Sat 18 Jan 2014 22:07:06 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:07:06 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:07:06 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:07:06 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:07:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:07:07 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:07:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:07:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:07:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:07:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:07:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:07:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:07:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:07:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:07:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:07:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43600704
Sat 18 Jan 2014 22:07:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:07:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43600704
Sat 18 Jan 2014 22:07:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:07:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:07:18 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:07:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:07:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:07:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:07:19 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:07:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:07:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:07:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:07:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43600704
Sat 18 Jan 2014 22:07:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:07:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:07:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:07:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 22:07:20 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:07:20 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:07:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 22:07:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6203 values 97898 bits 12237 bytes 
Sat 18 Jan 2014 22:07:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:07:22 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:07:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:07:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:07:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:07:31 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:07:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:07:33 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:07:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:07:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:07:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:07:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:07:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:07:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:07:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:07:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:07:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:07:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:07:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:07:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:07:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:07:38 - job_xml_thread(): Done retrieving: data size 43597760
Sat 18 Jan 2014 22:07:38 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:07:38 - XML: Start document: iteration 20
Sat 18 Jan 2014 22:07:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43597760
Sat 18 Jan 2014 22:07:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:07:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43597760
Sat 18 Jan 2014 22:07:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:07:40 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:07:41 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 22:07:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:07:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:07:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:07:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:07:55 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:07:55 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:07:55 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:07:55 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:07:55 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:07:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:07:56 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:07:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:07:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:07:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:07:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:07:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:07:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:07:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:08:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:08:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:08:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:08:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:08:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:08:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:08:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:08:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:08:03 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:08:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 22:08:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:08:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:08:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43612452
Sat 18 Jan 2014 22:08:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:08:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43612452
Sat 18 Jan 2014 22:08:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:08:10 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:08:10 - job_xml_thread(): Done retrieving: data size 43612452
Sat 18 Jan 2014 22:08:10 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:08:10 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 22:08:10 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 22:08:10 - Housekeeping: done.
Sat 18 Jan 2014 22:08:10 - XML: Start document: iteration 0
Sat 18 Jan 2014 22:08:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:08:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:08:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:08:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:08:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:08:21 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:08:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:08:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:08:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:08:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 22:08:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:08:22 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:08:22 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:08:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:08:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5722 values 90259 bits 11282 bytes 
Sat 18 Jan 2014 22:08:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 22:08:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:08:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:08:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:08:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:08:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:08:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:08:28 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:08:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:08:29 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:08:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:08:29 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:08:29 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:08:29 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:08:29 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:08:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:08:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:08:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:08:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:08:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:08:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43620553
Sat 18 Jan 2014 22:08:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:08:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43620553
Sat 18 Jan 2014 22:08:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:08:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:08:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:08:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:08:43 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:08:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:08:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:08:43 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:08:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 22:08:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:08:44 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:08:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:08:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:08:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:08:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:08:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:08:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:08:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:08:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:08:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:08:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:08:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:08:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:08:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:08:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:08:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:08:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:08:51 - job_xml_thread(): Done retrieving: data size 43627946
Sat 18 Jan 2014 22:08:51 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:08:51 - XML: Start document: iteration 1
Sat 18 Jan 2014 22:08:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43627946
Sat 18 Jan 2014 22:08:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:08:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43627946
Sat 18 Jan 2014 22:08:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:09:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:09:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:09:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:09:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:09:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:09:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:09:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:09:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:09:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:09:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:09:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:09:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:09:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:09:10 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:09:10 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:09:10 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:09:10 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:09:10 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:09:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:09:11 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:09:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:09:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:09:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:09:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:09:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:09:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:09:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:09:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43627223
Sat 18 Jan 2014 22:09:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:09:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43627223
Sat 18 Jan 2014 22:09:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:09:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:09:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:09:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:09:23 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:09:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:09:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 22:09:23 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:09:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 22:09:23 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:09:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9136 values 144143 bits 18017 bytes 
Sat 18 Jan 2014 22:09:25 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:09:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:09:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:09:26 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:09:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:09:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:09:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:09:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:09:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:09:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:09:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:09:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:09:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:09:31 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:09:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:09:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:09:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:09:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:09:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:09:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:09:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:09:35 - job_xml_thread(): Done retrieving: data size 43617442
Sat 18 Jan 2014 22:09:35 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:09:35 - XML: Start document: iteration 2
Sat 18 Jan 2014 22:09:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43617442
Sat 18 Jan 2014 22:09:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:09:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43617442
Sat 18 Jan 2014 22:09:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:09:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:09:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:09:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:09:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:09:51 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:09:51 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:09:51 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:09:51 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:09:51 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:09:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:09:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:09:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:09:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:09:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:09:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:09:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:09:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:09:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:09:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:09:58 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:09:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:09:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:09:58 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:09:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 22:09:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:09:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:09:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:09:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:09:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:09:59 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 22:09:59 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 22:09:59 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:10:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:10:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43635016
Sat 18 Jan 2014 22:10:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:10:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43635016
Sat 18 Jan 2014 22:10:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:10:07 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:10:07 - job_xml_thread(): Done retrieving: data size 43635016
Sat 18 Jan 2014 22:10:07 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:10:07 - XML: Start document: iteration 3
Sat 18 Jan 2014 22:10:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:10:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:10:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:10:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:10:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:10:15 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:10:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:10:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:10:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:10:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:10:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:10:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:10:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:10:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:10:20 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:10:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:10:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:10:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:10:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:10:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:10:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:10:21 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:10:21 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:10:21 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:10:21 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:10:21 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:10:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:10:23 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:10:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:10:24 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:10:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 22:10:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 22:10:24 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:10:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5914 values 93278 bits 11659 bytes 
Sat 18 Jan 2014 22:10:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:10:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43630919
Sat 18 Jan 2014 22:10:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43630919
Sat 18 Jan 2014 22:10:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:10:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:10:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:10:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:10:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:10:36 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:10:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:10:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:10:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:10:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:10:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:10:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:10:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:10:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:10:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:10:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:10:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:10:40 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:10:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:10:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:10:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:10:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:10:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:10:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:10:42 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:10:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 22:10:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:10:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:10:42 - job_xml_thread(): Done retrieving: data size 43634756
Sat 18 Jan 2014 22:10:42 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:10:42 - XML: Start document: iteration 4
Sat 18 Jan 2014 22:10:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43634756
Sat 18 Jan 2014 22:10:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:10:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43634756
Sat 18 Jan 2014 22:10:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:10:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:10:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:10:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:10:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:10:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:10:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:10:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:10:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:10:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:10:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:10:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:10:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:10:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:11:01 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:11:01 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:11:01 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:11:01 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:11:01 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:11:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:11:04 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:11:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:11:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:11:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:11:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:11:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:11:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:11:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:11:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43631113
Sat 18 Jan 2014 22:11:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:11:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43631113
Sat 18 Jan 2014 22:11:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:11:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:11:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:11:17 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:11:17 - job_xml_thread(): Done retrieving: data size 43631113
Sat 18 Jan 2014 22:11:17 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:11:17 - XML: Start document: iteration 5
Sat 18 Jan 2014 22:11:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:11:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:11:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:11:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:11:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:11:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:11:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:11:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:11:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:11:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:11:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:11:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:11:24 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:11:25 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:11:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:11:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 22:11:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 22:11:25 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:11:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7251 values 114360 bits 14295 bytes 
Sat 18 Jan 2014 22:11:30 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:11:30 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:11:30 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:11:30 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:11:30 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:11:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:11:30 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:11:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:11:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:11:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:11:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:11:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:11:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:11:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:11:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43544107
Sat 18 Jan 2014 22:11:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:11:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43544107
Sat 18 Jan 2014 22:11:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:11:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:11:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:11:45 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:11:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:11:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:11:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:11:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:11:47 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:11:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:11:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:11:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:11:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:11:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:11:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:11:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:11:49 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:11:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:11:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:11:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:11:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:11:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:11:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:11:49 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:11:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 22:11:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:11:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:11:51 - job_xml_thread(): Done retrieving: data size 42989291
Sat 18 Jan 2014 22:11:51 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:11:51 - XML: Start document: iteration 6
Sat 18 Jan 2014 22:11:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42989291
Sat 18 Jan 2014 22:11:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:11:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42989291
Sat 18 Jan 2014 22:11:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:12:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:12:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:12:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:12:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:12:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:12:12 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:12:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:12:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:12:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:12:13 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:12:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:12:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:12:14 - XML: Processed 646254 elements - found 0 jobs
Sat 18 Jan 2014 22:12:14 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:12:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:12:14 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:12:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:12:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:12:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:12:14 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:12:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:12:14 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:12:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:12:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:12:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:12:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:12:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:12:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43031743
Sat 18 Jan 2014 22:12:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:12:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43031743
Sat 18 Jan 2014 22:12:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:12:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:12:25 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:12:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:12:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 22:12:26 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:12:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 22:12:26 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:12:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8814 values 139001 bits 17375 bytes 
Sat 18 Jan 2014 22:12:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:12:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:12:29 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:12:30 - job_xml_thread(): Done retrieving: data size 43031743
Sat 18 Jan 2014 22:12:30 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:12:30 - XML: Start document: iteration 7
Sat 18 Jan 2014 22:12:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:12:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:12:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:12:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:12:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:12:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:12:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:12:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:12:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:12:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:12:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:12:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:12:39 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:12:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:12:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:12:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:12:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:12:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:12:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:12:42 - XML: Processed 646744 elements - found 0 jobs
Sat 18 Jan 2014 22:12:42 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:12:42 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:12:42 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:12:42 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:12:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:12:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43533316
Sat 18 Jan 2014 22:12:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:12:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43533316
Sat 18 Jan 2014 22:12:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:12:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:12:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:12:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:12:53 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:12:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:12:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:12:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:12:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:12:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:12:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:12:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43533316
Sat 18 Jan 2014 22:12:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:12:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:12:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:12:57 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:12:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:13:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:13:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:13:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:13:06 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:13:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:13:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:13:06 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:13:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 22:13:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:13:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:13:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:13:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:13:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:13:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:13:09 - job_xml_thread(): Done retrieving: data size 43624513
Sat 18 Jan 2014 22:13:09 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:13:09 - XML: Start document: iteration 8
Sat 18 Jan 2014 22:13:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43624513
Sat 18 Jan 2014 22:13:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:13:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:13:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:13:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:13:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:13:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:13:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:13:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43624513
Sat 18 Jan 2014 22:13:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:13:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:13:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:13:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:13:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:13:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:13:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:13:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:13:27 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:13:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:13:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:13:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:13:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:13:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:13:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:13:29 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:13:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 22:13:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 22:13:29 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:13:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5810 values 91653 bits 11456 bytes 
Sat 18 Jan 2014 22:13:30 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:13:30 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:13:30 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:13:30 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:13:30 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:13:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:13:31 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:13:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:13:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:13:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:13:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:13:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:13:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:13:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:13:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43625752
Sat 18 Jan 2014 22:13:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:13:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43625752
Sat 18 Jan 2014 22:13:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:13:42 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 22:13:42 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:13:43 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:13:43 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 22:13:43 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:13:43 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 22:13:43 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 22:13:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:13:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:13:45 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:13:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:13:46 - size of cluster 'LISA Cluster': 624 hosts 79467 metrics 860964 values 13571694 bits 1696461 bytes 
Sat 18 Jan 2014 22:13:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:13:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:13:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:13:47 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:13:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:13:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:13:47 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:13:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 22:13:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:13:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:13:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:13:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:13:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:13:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:13:52 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:13:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:13:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:13:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:13:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:13:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:13:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:13:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:13:59 - job_xml_thread(): Done retrieving: data size 43616611
Sat 18 Jan 2014 22:13:59 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:13:59 - XML: Start document: iteration 9
Sat 18 Jan 2014 22:13:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43616611
Sat 18 Jan 2014 22:13:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:13:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43616611
Sat 18 Jan 2014 22:14:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:14:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:14:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:14:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:14:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:14:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:14:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:14:21 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:14:21 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:14:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:14:21 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:14:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:14:21 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:14:21 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:14:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:14:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:14:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:14:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:14:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:14:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:14:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:14:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:14:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:14:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:14:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:14:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:14:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:14:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:14:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43652707
Sat 18 Jan 2014 22:14:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:14:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43652707
Sat 18 Jan 2014 22:14:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:14:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:14:30 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:14:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:14:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 22:14:30 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:14:30 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:14:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 22:14:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8870 values 139980 bits 17497 bytes 
Sat 18 Jan 2014 22:14:36 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:14:36 - job_xml_thread(): Done retrieving: data size 43652707
Sat 18 Jan 2014 22:14:36 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:14:36 - XML: Start document: iteration 10
Sat 18 Jan 2014 22:14:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:14:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:14:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:14:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:14:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:14:43 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:14:43 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:14:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:14:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:14:44 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 22:14:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:14:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:14:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:14:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:14:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:14:50 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:14:50 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:14:50 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:14:50 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:14:50 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:14:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:14:50 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:14:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:14:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:14:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:14:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:14:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:14:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:14:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:14:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43630335
Sat 18 Jan 2014 22:14:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:14:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43630335
Sat 18 Jan 2014 22:14:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:15:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:15:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:15:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:15:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:15:05 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:15:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:15:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:15:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:15:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:15:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:15:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:15:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:15:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:15:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:15:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:15:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:15:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:15:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:15:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:15:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:15:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:15:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:15:10 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:15:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 22:15:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:15:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:15:12 - job_xml_thread(): Done retrieving: data size 43644485
Sat 18 Jan 2014 22:15:12 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:15:12 - XML: Start document: iteration 11
Sat 18 Jan 2014 22:15:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43644485
Sat 18 Jan 2014 22:15:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:15:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43644485
Sat 18 Jan 2014 22:15:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:15:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:15:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:15:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:15:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:15:25 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:15:25 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:15:25 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:15:25 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:15:25 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:15:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:15:31 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:15:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:15:31 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:15:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:15:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:15:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:15:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:15:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:15:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:15:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:15:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:15:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 22:15:32 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:15:32 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:15:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5695 values 89792 bits 11224 bytes 
Sat 18 Jan 2014 22:15:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 22:15:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:15:35 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:15:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:15:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:15:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:15:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:15:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:15:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:15:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:15:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43639777
Sat 18 Jan 2014 22:15:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:15:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43639777
Sat 18 Jan 2014 22:15:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:15:40 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:15:40 - job_xml_thread(): Done retrieving: data size 43639777
Sat 18 Jan 2014 22:15:40 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:15:40 - XML: Start document: iteration 12
Sat 18 Jan 2014 22:15:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:15:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:15:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:15:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:15:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:15:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:16:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:16:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:16:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:16:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:16:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:16:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:16:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:16:02 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:16:02 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:16:02 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:16:02 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:16:02 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:16:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:16:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:16:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:16:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:16:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:16:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:16:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:16:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:16:04 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:16:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 22:16:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:16:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:16:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43645415
Sat 18 Jan 2014 22:16:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:16:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43645415
Sat 18 Jan 2014 22:16:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:16:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:16:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:16:17 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:16:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:16:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:16:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:16:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:16:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:16:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:16:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:16:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:16:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:16:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:16:20 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:16:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:16:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:16:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:16:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:16:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:16:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:16:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:16:23 - job_xml_thread(): Done retrieving: data size 43646090
Sat 18 Jan 2014 22:16:23 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:16:23 - XML: Start document: iteration 13
Sat 18 Jan 2014 22:16:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43646090
Sat 18 Jan 2014 22:16:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:16:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43646090
Sat 18 Jan 2014 22:16:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:16:32 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:16:32 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:16:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:16:33 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:16:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:16:33 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:16:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:16:33 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:16:33 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:16:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:16:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 22:16:34 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:16:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8812 values 139062 bits 17382 bytes 
Sat 18 Jan 2014 22:16:34 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:16:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 22:16:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:16:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:16:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:16:44 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:16:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:16:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:16:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:16:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:16:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:16:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:16:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:16:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:16:46 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:16:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:16:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:16:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:16:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:16:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:16:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:16:48 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:16:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:16:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43640905
Sat 18 Jan 2014 22:16:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:16:50 - job_xml_thread(): Done retrieving: data size 43640905
Sat 18 Jan 2014 22:16:50 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:16:51 - XML: Start document: iteration 14
Sat 18 Jan 2014 22:16:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43640905
Sat 18 Jan 2014 22:16:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:16:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:16:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:17:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:17:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:17:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:17:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:17:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:17:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:17:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:17:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:17:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:17:06 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:17:06 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:17:06 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:17:06 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:17:06 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:17:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:17:12 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:17:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:17:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:17:13 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:17:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 22:17:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:17:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:17:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:17:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:17:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:17:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:17:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43606952
Sat 18 Jan 2014 22:17:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:17:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:17:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43606952
Sat 18 Jan 2014 22:17:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:17:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:17:21 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:17:21 - job_xml_thread(): Done retrieving: data size 43606952
Sat 18 Jan 2014 22:17:21 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:17:21 - XML: Start document: iteration 15
Sat 18 Jan 2014 22:17:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:17:27 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:17:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:17:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:17:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:17:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:17:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:17:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:17:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:17:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:17:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:17:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:17:34 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:17:35 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:17:35 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:17:35 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:17:35 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:17:35 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:17:35 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:17:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:17:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 22:17:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 22:17:35 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:17:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5815 values 92020 bits 11502 bytes 
Sat 18 Jan 2014 22:17:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:17:39 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:17:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:17:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:17:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:17:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:17:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:17:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:17:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:17:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43138858
Sat 18 Jan 2014 22:17:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:17:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43138858
Sat 18 Jan 2014 22:17:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:17:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:17:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:17:50 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:17:50 - job_xml_thread(): Done retrieving: data size 43138858
Sat 18 Jan 2014 22:17:51 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:17:51 - XML: Start document: iteration 16
Sat 18 Jan 2014 22:17:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:17:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:18:00 - XML: Processed 648261 elements - found 0 jobs
Sat 18 Jan 2014 22:18:00 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:18:00 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:18:00 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:18:00 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:18:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:18:02 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:18:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:18:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:18:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:18:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:18:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:18:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:18:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:18:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:18:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:18:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:18:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:18:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:18:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:18:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:18:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:18:05 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:18:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 22:18:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:18:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:18:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42988470
Sat 18 Jan 2014 22:18:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:18:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42988470
Sat 18 Jan 2014 22:18:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:18:15 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:18:15 - job_xml_thread(): Done retrieving: data size 42988470
Sat 18 Jan 2014 22:18:15 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:18:15 - XML: Start document: iteration 17
Sat 18 Jan 2014 22:18:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:18:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:18:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:18:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:18:27 - XML: Processed 645996 elements - found 0 jobs
Sat 18 Jan 2014 22:18:27 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:18:27 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:18:27 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:18:27 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:18:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:18:30 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:18:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:18:30 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:18:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:18:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:18:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:18:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:18:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:18:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:18:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:18:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:18:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:18:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:18:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:18:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:18:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:18:32 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 22:18:32 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 22:18:32 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:18:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:18:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43396137
Sat 18 Jan 2014 22:18:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:18:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43396137
Sat 18 Jan 2014 22:18:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:18:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:18:36 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:18:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:18:37 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:18:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 22:18:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 22:18:37 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:18:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8998 values 142264 bits 17783 bytes 
Sat 18 Jan 2014 22:18:42 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:18:42 - job_xml_thread(): Done retrieving: data size 43396137
Sat 18 Jan 2014 22:18:42 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:18:42 - XML: Start document: iteration 18
Sat 18 Jan 2014 22:18:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:18:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:18:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:18:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:18:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:18:47 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:18:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:18:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:18:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:18:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:18:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:18:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:18:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:18:53 - XML: Processed 651178 elements - found 0 jobs
Sat 18 Jan 2014 22:18:53 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:18:53 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:18:53 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:18:53 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:18:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:18:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:18:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:18:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:18:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:18:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:18:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:18:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:18:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:18:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43615826
Sat 18 Jan 2014 22:18:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:18:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43615826
Sat 18 Jan 2014 22:18:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:19:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:19:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:19:09 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:19:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:19:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:19:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:19:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:19:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:19:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:19:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:19:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:19:14 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:19:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:19:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:19:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:19:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:19:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:19:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:19:14 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:19:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 22:19:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:19:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:19:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:19:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:19:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:19:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:19:17 - job_xml_thread(): Done retrieving: data size 43615889
Sat 18 Jan 2014 22:19:17 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:19:17 - XML: Start document: iteration 19
Sat 18 Jan 2014 22:19:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43615889
Sat 18 Jan 2014 22:19:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:19:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43615889
Sat 18 Jan 2014 22:19:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:19:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:19:27 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:19:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:19:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:19:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:19:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:19:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:19:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:19:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:19:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:19:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:19:35 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:19:35 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:19:35 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:19:35 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:19:35 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:19:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:19:37 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:19:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:19:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 22:19:38 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:19:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 22:19:38 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:19:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5765 values 90911 bits 11363 bytes 
Sat 18 Jan 2014 22:19:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:19:38 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:19:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:19:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:19:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:19:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:19:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:19:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:19:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:19:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43624425
Sat 18 Jan 2014 22:19:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:19:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43624425
Sat 18 Jan 2014 22:19:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:19:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:19:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:19:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:19:49 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:19:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:19:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:19:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:19:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:19:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:19:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43624425
Sat 18 Jan 2014 22:19:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:19:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:19:50 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:19:51 - job_xml_thread(): Done retrieving: data size 43624425
Sat 18 Jan 2014 22:19:51 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:19:51 - XML: Start document: iteration 20
Sat 18 Jan 2014 22:19:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:19:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:20:05 - XML: Processed 654195 elements - found 0 jobs
Sat 18 Jan 2014 22:20:05 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:20:05 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:20:05 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:20:05 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:20:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:20:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:20:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:20:07 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:20:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:20:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:20:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:20:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:20:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:20:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:20:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:20:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:20:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:20:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:20:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:20:10 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:20:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 22:20:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:20:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:20:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:20:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:20:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:20:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:20:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43637517
Sat 18 Jan 2014 22:20:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:20:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43637517
Sat 18 Jan 2014 22:20:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:20:20 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:20:20 - job_xml_thread(): Done retrieving: data size 43637517
Sat 18 Jan 2014 22:20:20 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:20:20 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 22:20:20 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 22:20:20 - Housekeeping: done.
Sat 18 Jan 2014 22:20:20 - XML: Start document: iteration 0
Sat 18 Jan 2014 22:20:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:20:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:20:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:20:24 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:20:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:20:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:20:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:20:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:20:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:20:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:20:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:20:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:20:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:20:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:20:30 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:20:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:20:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:20:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:20:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:20:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:20:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:20:32 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:20:32 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:20:32 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:20:32 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:20:32 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:20:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:20:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43619275
Sat 18 Jan 2014 22:20:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:20:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43619275
Sat 18 Jan 2014 22:20:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:20:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:20:38 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:20:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:20:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 22:20:39 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:20:39 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:20:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 22:20:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8979 values 141652 bits 17706 bytes 
Sat 18 Jan 2014 22:20:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:20:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:20:44 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 22:20:44 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:20:44 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:20:44 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 22:20:44 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 22:20:44 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:20:44 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 22:20:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:20:44 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:20:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:20:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:20:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:20:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:20:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43619275
Sat 18 Jan 2014 22:20:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:20:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:20:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:20:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:20:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:20:47 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:20:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:20:52 - size of cluster 'LISA Cluster': 624 hosts 79472 metrics 732793 values 11568730 bits 1446091 bytes 
Sat 18 Jan 2014 22:20:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:20:58 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:20:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:20:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:20:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:20:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:20:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:20:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:20:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:20:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:21:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:21:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:21:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:21:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:21:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:21:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:21:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:21:03 - job_xml_thread(): Done retrieving: data size 43600127
Sat 18 Jan 2014 22:21:03 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:21:03 - XML: Start document: iteration 1
Sat 18 Jan 2014 22:21:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43600127
Sat 18 Jan 2014 22:21:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:21:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43600127
Sat 18 Jan 2014 22:21:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:21:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:21:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:21:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:21:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:21:19 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:21:19 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:21:19 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:21:19 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:21:19 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:21:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:21:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:21:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:21:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:21:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:21:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:21:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:21:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:21:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:21:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:21:27 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:21:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:21:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:21:27 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:21:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 22:21:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:21:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:21:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:21:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:21:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:21:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:21:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43627368
Sat 18 Jan 2014 22:21:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:21:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43627368
Sat 18 Jan 2014 22:21:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:21:35 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:21:35 - job_xml_thread(): Done retrieving: data size 43627368
Sat 18 Jan 2014 22:21:35 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:21:35 - XML: Start document: iteration 2
Sat 18 Jan 2014 22:21:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:21:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:21:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:21:39 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:21:40 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:21:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 22:21:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:21:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 22:21:41 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:21:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5977 values 94328 bits 11791 bytes 
Sat 18 Jan 2014 22:21:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:21:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:21:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:21:44 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:21:44 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:21:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:21:44 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 22:21:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:21:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:21:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:21:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:21:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:21:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:21:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:21:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:21:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:21:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:21:52 - XML: Processed 654193 elements - found 0 jobs
Sat 18 Jan 2014 22:21:52 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:21:52 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:21:52 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:21:52 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:21:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:21:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:21:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:21:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:21:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:21:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43640580
Sat 18 Jan 2014 22:21:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:21:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43640580
Sat 18 Jan 2014 22:21:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:22:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:22:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:22:07 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:22:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:22:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:22:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:22:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:22:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:22:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:22:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:22:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:22:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:22:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:22:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:22:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:22:11 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:22:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:22:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:22:12 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:22:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 22:22:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:22:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:22:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:22:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:22:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:22:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:22:14 - job_xml_thread(): Done retrieving: data size 43626188
Sat 18 Jan 2014 22:22:14 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:22:14 - XML: Start document: iteration 3
Sat 18 Jan 2014 22:22:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43626188
Sat 18 Jan 2014 22:22:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43626188
Sat 18 Jan 2014 22:22:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:22:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:22:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:22:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:22:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:22:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:22:31 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:22:31 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:22:31 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:22:31 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:22:31 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:22:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:22:33 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:22:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:22:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:22:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:22:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:22:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:22:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:22:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:22:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:22:38 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:22:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:22:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:22:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:22:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:22:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:22:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:22:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:22:41 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:22:41 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:22:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:22:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 22:22:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 22:22:41 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:22:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5830 values 91943 bits 11492 bytes 
Sat 18 Jan 2014 22:22:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:22:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43643482
Sat 18 Jan 2014 22:22:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:22:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43643482
Sat 18 Jan 2014 22:22:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:22:47 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:22:47 - job_xml_thread(): Done retrieving: data size 43643482
Sat 18 Jan 2014 22:22:47 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:22:47 - XML: Start document: iteration 4
Sat 18 Jan 2014 22:22:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:22:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:22:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:22:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:22:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:22:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:22:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:22:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:22:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:22:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:22:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:22:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:22:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:23:03 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:23:03 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:23:03 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:23:03 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:23:03 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:23:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:23:05 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:23:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:23:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:23:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:23:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:23:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:23:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:23:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:23:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43632436
Sat 18 Jan 2014 22:23:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:23:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43632436
Sat 18 Jan 2014 22:23:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:23:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:23:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:23:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:23:18 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:23:18 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:23:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:23:18 - job_xml_thread(): Done retrieving: data size 43632436
Sat 18 Jan 2014 22:23:18 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:23:18 - XML: Start document: iteration 5
Sat 18 Jan 2014 22:23:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:23:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:23:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:23:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:23:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:23:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:23:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:23:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:23:23 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:23:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 22:23:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:23:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:23:31 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:23:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:23:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:23:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:23:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:23:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:23:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:23:31 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:23:31 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:23:31 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:23:31 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:23:31 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:23:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:23:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43540164
Sat 18 Jan 2014 22:23:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:23:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43540164
Sat 18 Jan 2014 22:23:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:23:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:23:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:23:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:23:41 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:23:42 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:23:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:23:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 22:23:42 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:23:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6433 values 101505 bits 12688 bytes 
Sat 18 Jan 2014 22:23:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 22:23:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:23:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:23:46 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:23:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:23:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:23:47 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:23:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:23:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:23:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:23:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:23:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:23:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:23:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:23:50 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:23:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:23:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:23:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:23:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:23:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:23:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:23:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:23:55 - job_xml_thread(): Done retrieving: data size 42997462
Sat 18 Jan 2014 22:23:55 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:23:55 - XML: Start document: iteration 6
Sat 18 Jan 2014 22:23:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42997462
Sat 18 Jan 2014 22:23:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:23:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42997462
Sat 18 Jan 2014 22:23:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:24:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:24:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:24:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:24:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:24:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:24:11 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:24:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:24:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:24:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:24:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:24:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:24:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:24:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:24:16 - XML: Processed 646260 elements - found 0 jobs
Sat 18 Jan 2014 22:24:16 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:24:16 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:24:16 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:24:16 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:24:16 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:24:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 22:24:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:24:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:24:18 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:24:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:24:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:24:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:24:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:24:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:24:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:24:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:24:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43029863
Sat 18 Jan 2014 22:24:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:24:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43029863
Sat 18 Jan 2014 22:24:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:24:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:24:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:24:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:24:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:24:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:24:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:24:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:24:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:24:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:24:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:24:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43029863
Sat 18 Jan 2014 22:24:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:24:31 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:24:31 - job_xml_thread(): Done retrieving: data size 43029863
Sat 18 Jan 2014 22:24:32 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:24:32 - XML: Start document: iteration 7
Sat 18 Jan 2014 22:24:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:24:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:24:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:24:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:24:44 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:24:44 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:24:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:24:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:24:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:24:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:24:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:24:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:24:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:24:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:24:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:24:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:24:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:24:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:24:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:24:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:24:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:24:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:24:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:24:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:24:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 22:24:47 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:24:47 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:24:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 22:24:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6046 values 95399 bits 11924 bytes 
Sat 18 Jan 2014 22:24:48 - XML: Processed 646746 elements - found 0 jobs
Sat 18 Jan 2014 22:24:48 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:24:48 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:24:48 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:24:48 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:24:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:24:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574460
Sat 18 Jan 2014 22:24:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:24:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574460
Sat 18 Jan 2014 22:24:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:25:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:25:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:25:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:25:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:25:03 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:25:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:25:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:25:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:25:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:25:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:25:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:25:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:25:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:25:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:25:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:25:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:25:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:25:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:25:08 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:25:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 22:25:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:25:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:25:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:25:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:25:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:25:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:25:11 - job_xml_thread(): Done retrieving: data size 43615864
Sat 18 Jan 2014 22:25:11 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:25:11 - XML: Start document: iteration 8
Sat 18 Jan 2014 22:25:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43615864
Sat 18 Jan 2014 22:25:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43615864
Sat 18 Jan 2014 22:25:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:25:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:25:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:25:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:25:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:25:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:25:24 - XML: Processed 654190 elements - found 0 jobs
Sat 18 Jan 2014 22:25:24 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:25:24 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:25:24 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:25:24 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:25:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:25:33 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:25:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:25:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:25:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:25:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:25:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:25:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:25:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:25:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:25:34 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:25:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:25:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:25:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:25:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:25:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:25:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:25:35 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 22:25:35 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 22:25:35 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:25:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:25:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43643611
Sat 18 Jan 2014 22:25:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:25:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43643611
Sat 18 Jan 2014 22:25:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:25:39 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:25:39 - job_xml_thread(): Done retrieving: data size 43643611
Sat 18 Jan 2014 22:25:39 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:25:39 - XML: Start document: iteration 9
Sat 18 Jan 2014 22:25:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:25:47 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:25:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:25:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 22:25:48 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:25:48 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:25:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:25:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 22:25:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9156 values 144433 bits 18054 bytes 
Sat 18 Jan 2014 22:25:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:25:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:25:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:25:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:25:50 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:25:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:25:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:25:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:25:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:25:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:25:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:25:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:25:57 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:25:57 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:25:57 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:25:57 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:25:57 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:26:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:26:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:26:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:26:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:26:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:26:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:26:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:26:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:26:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:26:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43619265
Sat 18 Jan 2014 22:26:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:26:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43619265
Sat 18 Jan 2014 22:26:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:26:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:26:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:26:12 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:26:12 - job_xml_thread(): Done retrieving: data size 43619265
Sat 18 Jan 2014 22:26:12 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:26:12 - XML: Start document: iteration 10
Sat 18 Jan 2014 22:26:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:26:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:26:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:26:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:26:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:26:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:26:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:26:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:26:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:26:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:26:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:26:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:26:21 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:26:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:26:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:26:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:26:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:26:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:26:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:26:24 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:26:24 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:26:24 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:26:24 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:26:24 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:26:24 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:26:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 22:26:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:26:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:26:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43620321
Sat 18 Jan 2014 22:26:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:26:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43620321
Sat 18 Jan 2014 22:26:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:26:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:26:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:26:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:26:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:26:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:26:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:26:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:26:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:26:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:26:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:26:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:26:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:26:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:26:39 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:26:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:26:41 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:26:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:26:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:26:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:26:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:26:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:26:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:26:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:26:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43635257
Sat 18 Jan 2014 22:26:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:26:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43635257
Sat 18 Jan 2014 22:26:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:26:45 - job_xml_thread(): Done retrieving: data size 43635257
Sat 18 Jan 2014 22:26:45 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:26:45 - XML: Start document: iteration 11
Sat 18 Jan 2014 22:26:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:26:49 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:26:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:26:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 22:26:49 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:26:49 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:26:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 22:26:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9034 values 142474 bits 17809 bytes 
Sat 18 Jan 2014 22:26:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:26:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:26:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:26:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:26:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:26:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:26:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:26:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:26:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:26:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:26:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:26:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:26:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:27:03 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:27:03 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:27:03 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:27:03 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:27:03 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:27:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:27:06 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:27:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:27:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:27:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:27:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:27:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:27:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:27:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:27:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43624124
Sat 18 Jan 2014 22:27:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:27:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43624124
Sat 18 Jan 2014 22:27:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:27:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:27:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:27:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:27:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:27:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:27:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:27:18 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:27:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:27:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:27:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43624124
Sat 18 Jan 2014 22:27:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:27:18 - job_xml_thread(): Done retrieving: data size 43624124
Sat 18 Jan 2014 22:27:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:27:18 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:27:18 - XML: Start document: iteration 12
Sat 18 Jan 2014 22:27:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:27:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:27:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:27:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:27:30 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:27:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:27:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:27:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:27:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:27:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:27:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:27:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:27:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:27:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:27:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:27:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:27:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:27:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:27:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:27:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:27:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:27:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:27:37 - XML: Processed 654190 elements - found 0 jobs
Sat 18 Jan 2014 22:27:37 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:27:37 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:27:37 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:27:37 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:27:37 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:27:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 22:27:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:27:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:27:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43624133
Sat 18 Jan 2014 22:27:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:27:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43624133
Sat 18 Jan 2014 22:27:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:27:44 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 22:27:44 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:27:45 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:27:45 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 22:27:45 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 22:27:45 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:27:45 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 22:27:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:27:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:27:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:27:49 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:27:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:27:50 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:27:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 22:27:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 22:27:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:27:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:27:50 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:27:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:27:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6102 values 96299 bits 12037 bytes 
Sat 18 Jan 2014 22:27:50 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:27:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:27:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:27:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:27:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:27:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:27:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:27:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:27:52 - job_xml_thread(): Retrieving XML data..
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sat 18 Jan 2014 22:27:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:27:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:27:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:27:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:27:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:27:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:27:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:27:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:27:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:27:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43628314
Sat 18 Jan 2014 22:27:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:27:57 - job_xml_thread(): Done retrieving: data size 43628314
Sat 18 Jan 2014 22:27:57 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:27:57 - XML: Start document: iteration 13
Sat 18 Jan 2014 22:27:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43628314
Sat 18 Jan 2014 22:27:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:28:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:28:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:28:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:28:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:28:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:28:13 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:28:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:28:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:28:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:28:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:28:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:28:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:28:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:28:15 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:28:15 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:28:15 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:28:15 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:28:15 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:28:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:28:20 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:28:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:28:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:28:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:28:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:28:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:28:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:28:21 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:28:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 22:28:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:28:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:28:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43635662
Sat 18 Jan 2014 22:28:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:28:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43635662
Sat 18 Jan 2014 22:28:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:28:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:28:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:28:30 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:28:30 - job_xml_thread(): Done retrieving: data size 43635662
Sat 18 Jan 2014 22:28:30 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:28:30 - XML: Start document: iteration 14
Sat 18 Jan 2014 22:28:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:28:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:28:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:28:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:28:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:28:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:28:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:28:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:28:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:28:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:28:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:28:43 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:28:43 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:28:43 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:28:43 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:28:43 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:28:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:28:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:28:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:28:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:28:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:28:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:28:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:28:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:28:45 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:28:45 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:28:46 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:28:46 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 22:28:46 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:28:46 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 22:28:46 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 22:28:47 - size of cluster 'LISA Cluster': 624 hosts 79466 metrics 786753 values 12394438 bits 1549304 bytes 
Sat 18 Jan 2014 22:28:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:28:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43633018
Sat 18 Jan 2014 22:28:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:28:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43633018
Sat 18 Jan 2014 22:28:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:28:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:28:50 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:28:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:28:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 22:28:52 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:28:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 22:28:52 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:28:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8811 values 138967 bits 17370 bytes 
Sat 18 Jan 2014 22:28:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:28:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:28:58 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:28:58 - job_xml_thread(): Done retrieving: data size 43633018
Sat 18 Jan 2014 22:28:58 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:28:58 - XML: Start document: iteration 15
Sat 18 Jan 2014 22:29:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:29:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:29:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:29:07 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:29:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:29:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:29:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:29:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:29:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:29:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:29:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:29:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:29:11 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:29:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:29:11 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:29:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:29:11 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:29:11 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:29:11 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:29:11 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:29:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:29:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:29:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:29:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:29:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:29:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556661
Sat 18 Jan 2014 22:29:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:29:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556661
Sat 18 Jan 2014 22:29:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:29:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:29:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:29:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:29:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:29:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:29:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:29:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:29:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:29:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:29:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556661
Sat 18 Jan 2014 22:29:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:29:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:29:26 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:29:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:29:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:29:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:29:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:29:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:29:36 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:29:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 22:29:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:29:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:29:37 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:29:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:29:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:29:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:29:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:29:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:29:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:29:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:29:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:29:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:29:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:29:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:29:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:29:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:29:40 - job_xml_thread(): Done retrieving: data size 43225802
Sat 18 Jan 2014 22:29:40 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:29:40 - XML: Start document: iteration 16
Sat 18 Jan 2014 22:29:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43225802
Sat 18 Jan 2014 22:29:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:29:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43225802
Sat 18 Jan 2014 22:29:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:29:46 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:29:46 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 22:29:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:29:52 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:29:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:29:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:29:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 22:29:53 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:29:53 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:29:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 22:29:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6155 values 97060 bits 12132 bytes 
Sat 18 Jan 2014 22:29:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:29:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:29:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:29:58 - XML: Processed 649424 elements - found 0 jobs
Sat 18 Jan 2014 22:29:58 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:29:58 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:29:58 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:29:58 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:30:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:30:02 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:30:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:30:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:30:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:30:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:30:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:30:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:30:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:30:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:30:06 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:30:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:30:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:30:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:30:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:30:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:30:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:30:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:30:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43000704
Sat 18 Jan 2014 22:30:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:30:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43000704
Sat 18 Jan 2014 22:30:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:30:13 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:30:13 - job_xml_thread(): Done retrieving: data size 43000704
Sat 18 Jan 2014 22:30:13 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:30:13 - XML: Start document: iteration 17
Sat 18 Jan 2014 22:30:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:30:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:30:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:30:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:30:22 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:30:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 22:30:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:30:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:30:26 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:30:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:30:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:30:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:30:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:30:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:30:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:30:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:30:30 - XML: Processed 646414 elements - found 0 jobs
Sat 18 Jan 2014 22:30:30 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:30:30 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:30:30 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:30:30 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:30:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:30:32 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:30:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:30:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:30:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:30:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:30:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:30:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:30:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:30:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43046706
Sat 18 Jan 2014 22:30:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:30:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43046706
Sat 18 Jan 2014 22:30:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:30:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:30:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:30:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:30:44 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:30:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:30:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:30:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:30:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:30:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:30:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:30:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:30:45 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:30:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:30:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:30:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:30:48 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:30:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:30:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:30:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:30:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:30:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:30:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:30:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:30:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578221
Sat 18 Jan 2014 22:30:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:30:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578221
Sat 18 Jan 2014 22:30:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:30:52 - job_xml_thread(): Done retrieving: data size 43578221
Sat 18 Jan 2014 22:30:52 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:30:52 - XML: Start document: iteration 18
Sat 18 Jan 2014 22:30:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:30:53 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:30:54 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:30:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:30:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 22:30:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 22:30:56 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:30:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9331 values 147277 bits 18409 bytes 
Sat 18 Jan 2014 22:31:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:31:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:31:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:31:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:31:09 - XML: Processed 653408 elements - found 0 jobs
Sat 18 Jan 2014 22:31:09 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:31:09 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:31:09 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:31:09 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:31:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:31:10 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:31:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:31:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:31:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:31:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:31:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:31:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:31:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:31:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:31:13 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:31:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:31:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:31:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:31:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:31:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:31:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:31:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:31:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43631281
Sat 18 Jan 2014 22:31:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:31:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43631281
Sat 18 Jan 2014 22:31:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:31:24 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:31:24 - job_xml_thread(): Done retrieving: data size 43631281
Sat 18 Jan 2014 22:31:24 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:31:24 - XML: Start document: iteration 19
Sat 18 Jan 2014 22:31:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:31:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:31:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:31:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:31:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:31:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:31:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:31:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:31:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:31:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:31:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:31:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:31:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:31:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:31:38 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:31:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:31:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:31:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:31:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:31:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:31:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:31:41 - XML: Processed 654195 elements - found 0 jobs
Sat 18 Jan 2014 22:31:41 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:31:41 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:31:41 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:31:41 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:31:41 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:31:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 22:31:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:31:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:31:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43614942
Sat 18 Jan 2014 22:31:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:31:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43614942
Sat 18 Jan 2014 22:31:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:31:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:31:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:31:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:31:53 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:31:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:31:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:31:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:31:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:31:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:31:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:31:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43614942
Sat 18 Jan 2014 22:31:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:31:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:31:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:31:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:31:56 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:31:56 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:31:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:31:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 22:31:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 22:31:56 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:31:57 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:31:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6024 values 95208 bits 11901 bytes 
Sat 18 Jan 2014 22:31:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:32:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:32:00 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:32:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:32:06 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:32:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:32:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:32:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:32:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:32:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:32:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:32:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:32:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:32:09 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 22:32:09 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 22:32:09 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:32:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:32:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:32:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:32:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:32:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:32:09 - job_xml_thread(): Done retrieving: data size 43630583
Sat 18 Jan 2014 22:32:09 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:32:09 - XML: Start document: iteration 20
Sat 18 Jan 2014 22:32:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43630583
Sat 18 Jan 2014 22:32:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43630583
Sat 18 Jan 2014 22:32:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:32:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:32:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:32:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:32:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:32:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:32:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:32:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:32:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:32:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:32:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:32:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:32:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:32:30 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:32:30 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:32:30 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:32:30 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:32:30 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:32:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:32:33 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:32:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:32:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:32:33 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:32:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 22:32:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:32:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:32:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:32:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:32:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:32:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:32:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43640728
Sat 18 Jan 2014 22:32:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:32:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43640728
Sat 18 Jan 2014 22:32:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:32:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:32:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:32:45 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:32:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:32:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:32:46 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:32:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:32:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:32:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:32:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:32:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:32:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:32:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:32:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:32:49 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:32:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:32:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:32:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:32:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:32:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:32:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:32:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:32:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:32:51 - job_xml_thread(): Done retrieving: data size 43658921
Sat 18 Jan 2014 22:32:51 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:32:51 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 22:32:51 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 22:32:51 - Housekeeping: done.
Sat 18 Jan 2014 22:32:51 - XML: Start document: iteration 0
Sat 18 Jan 2014 22:32:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43658921
Sat 18 Jan 2014 22:32:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:32:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43658921
Sat 18 Jan 2014 22:32:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:32:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:32:56 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:32:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:32:58 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:32:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 22:32:58 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:32:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 22:33:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8483 values 134123 bits 16765 bytes 
Sat 18 Jan 2014 22:33:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:33:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:33:03 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:33:03 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:33:03 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:33:03 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:33:03 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:33:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:33:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:33:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:33:14 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:33:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:33:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:33:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:33:14 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:33:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:33:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:33:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:33:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:33:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:33:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:33:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:33:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:33:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:33:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:33:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:33:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:33:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43654409
Sat 18 Jan 2014 22:33:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:33:18 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:33:18 - job_xml_thread(): Done retrieving: data size 43654409
Sat 18 Jan 2014 22:33:18 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:33:18 - XML: Start document: iteration 1
Sat 18 Jan 2014 22:33:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43654409
Sat 18 Jan 2014 22:33:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:33:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:33:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:33:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:33:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:33:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:33:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:33:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:33:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:33:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:33:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:33:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:33:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:33:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:33:37 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:33:37 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:33:37 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:33:37 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:33:37 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:33:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:33:39 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:33:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:33:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:33:40 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:33:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 22:33:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:33:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:33:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:33:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:33:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:33:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:33:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43629049
Sat 18 Jan 2014 22:33:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:33:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43629049
Sat 18 Jan 2014 22:33:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:33:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:33:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:33:53 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:33:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:33:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:33:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:33:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:33:56 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:33:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:33:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:33:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:33:58 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:33:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:33:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:33:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:33:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:33:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:33:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:33:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:33:58 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:33:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:33:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:33:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:33:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:33:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:33:58 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:33:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 22:33:58 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:33:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 22:33:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5780 values 91271 bits 11408 bytes 
Sat 18 Jan 2014 22:34:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:34:04 - job_xml_thread(): Done retrieving: data size 43628062
Sat 18 Jan 2014 22:34:04 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:34:04 - XML: Start document: iteration 2
Sat 18 Jan 2014 22:34:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43628062
Sat 18 Jan 2014 22:34:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43628062
Sat 18 Jan 2014 22:34:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:34:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:34:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:34:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:34:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:34:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:34:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:34:21 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:34:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:34:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:34:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:34:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:34:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:34:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:34:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:34:23 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:34:23 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:34:23 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:34:23 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:34:23 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:34:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:34:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:34:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:34:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:34:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:34:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:34:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:34:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:34:27 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:34:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 22:34:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:34:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:34:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43627108
Sat 18 Jan 2014 22:34:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:34:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43627108
Sat 18 Jan 2014 22:34:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:34:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:34:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:34:38 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:34:38 - job_xml_thread(): Done retrieving: data size 43627108
Sat 18 Jan 2014 22:34:38 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:34:39 - XML: Start document: iteration 3
Sat 18 Jan 2014 22:34:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:34:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:34:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:34:44 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:34:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:34:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:34:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:34:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:34:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:34:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:34:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:34:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:34:52 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:34:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:34:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:34:53 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:34:53 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:34:53 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:34:53 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:34:53 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:34:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:34:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:34:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:34:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:34:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:34:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43621898
Sat 18 Jan 2014 22:34:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:34:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43621898
Sat 18 Jan 2014 22:34:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:34:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:34:59 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:35:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:35:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:35:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:35:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 22:35:01 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:35:01 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:35:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 22:35:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8631 values 136129 bits 17016 bytes 
Sat 18 Jan 2014 22:35:08 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:35:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:35:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:35:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:35:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:35:12 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:35:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:35:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:35:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:35:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:35:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:35:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:35:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:35:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:35:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:35:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:35:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:35:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:35:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:35:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:35:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:35:15 - job_xml_thread(): Done retrieving: data size 43562026
Sat 18 Jan 2014 22:35:15 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:35:15 - XML: Start document: iteration 4
Sat 18 Jan 2014 22:35:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562026
Sat 18 Jan 2014 22:35:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:35:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562026
Sat 18 Jan 2014 22:35:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:35:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:35:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:35:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:35:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:35:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:35:30 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:35:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:35:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:35:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:35:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:35:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:35:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:35:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:35:37 - XML: Processed 653446 elements - found 0 jobs
Sat 18 Jan 2014 22:35:37 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:35:37 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:35:37 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:35:37 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:35:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:35:39 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:35:39 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:35:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 22:35:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:35:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:35:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:35:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:35:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:35:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:35:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:35:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:35:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43050330
Sat 18 Jan 2014 22:35:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:35:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43050330
Sat 18 Jan 2014 22:35:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:35:47 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 22:35:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:35:47 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:35:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:35:48 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:35:48 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 22:35:48 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 22:35:48 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:35:48 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 22:35:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:35:50 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:35:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:35:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:35:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:35:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:35:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43050330
Sat 18 Jan 2014 22:35:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:35:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:35:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:35:52 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:35:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:35:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:35:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:35:57 - size of cluster 'LISA Cluster': 624 hosts 79474 metrics 823046 values 12991889 bits 1623986 bytes 
Sat 18 Jan 2014 22:36:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:36:01 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:36:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:36:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 22:36:02 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:36:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 22:36:02 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:36:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5815 values 91719 bits 11464 bytes 
Sat 18 Jan 2014 22:36:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:36:02 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:36:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:36:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:36:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:36:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:36:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:36:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:36:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:36:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:36:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:36:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:36:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:36:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:36:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:36:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:36:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:36:11 - job_xml_thread(): Done retrieving: data size 42976826
Sat 18 Jan 2014 22:36:11 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:36:11 - XML: Start document: iteration 5
Sat 18 Jan 2014 22:36:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42976826
Sat 18 Jan 2014 22:36:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42976826
Sat 18 Jan 2014 22:36:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:36:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:36:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:36:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:36:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:36:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:36:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:36:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:36:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:36:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:36:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:36:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:36:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:36:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:36:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:36:29 - XML: Processed 646340 elements - found 0 jobs
Sat 18 Jan 2014 22:36:29 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:36:29 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:36:29 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:36:29 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:36:33 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:36:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 22:36:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:36:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:36:35 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:36:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:36:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:36:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:36:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:36:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:36:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:36:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:36:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43045582
Sat 18 Jan 2014 22:36:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:36:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43045582
Sat 18 Jan 2014 22:36:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:36:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:36:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:36:44 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:36:44 - job_xml_thread(): Done retrieving: data size 43045582
Sat 18 Jan 2014 22:36:44 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:36:45 - XML: Start document: iteration 6
Sat 18 Jan 2014 22:36:49 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:36:49 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 22:36:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:36:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:36:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:36:53 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:36:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:36:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:36:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:36:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:36:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:36:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:36:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:36:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:36:59 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:37:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:37:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:37:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:37:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:37:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:37:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:37:01 - XML: Processed 646908 elements - found 0 jobs
Sat 18 Jan 2014 22:37:01 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:37:01 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:37:01 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:37:01 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:37:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:37:02 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:37:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:37:03 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:37:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 22:37:03 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:37:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5814 values 91680 bits 11460 bytes 
Sat 18 Jan 2014 22:37:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 22:37:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:37:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43631823
Sat 18 Jan 2014 22:37:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:37:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43631823
Sat 18 Jan 2014 22:37:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:37:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:37:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:37:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:37:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:37:16 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:37:16 - job_xml_thread(): Done retrieving: data size 43631823
Sat 18 Jan 2014 22:37:16 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:37:16 - XML: Start document: iteration 7
Sat 18 Jan 2014 22:37:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:37:25 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:37:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:37:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:37:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:37:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:37:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:37:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:37:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:37:33 - XML: Processed 654190 elements - found 0 jobs
Sat 18 Jan 2014 22:37:33 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:37:33 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:37:33 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:37:33 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:37:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:37:34 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:37:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:37:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:37:34 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:37:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 22:37:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:37:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:37:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:37:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:37:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:37:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:37:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43630110
Sat 18 Jan 2014 22:37:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:37:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43630110
Sat 18 Jan 2014 22:37:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:37:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:37:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:37:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:37:48 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:37:49 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:37:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:37:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:37:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:37:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:37:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:37:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:37:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:37:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:37:49 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:37:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:37:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:37:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:37:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:37:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:37:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:37:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:37:53 - job_xml_thread(): Done retrieving: data size 43645165
Sat 18 Jan 2014 22:37:53 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:37:53 - XML: Start document: iteration 8
Sat 18 Jan 2014 22:37:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43645165
Sat 18 Jan 2014 22:37:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:37:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43645165
Sat 18 Jan 2014 22:37:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:38:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:38:03 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:38:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:38:04 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:38:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 22:38:04 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:38:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8909 values 140528 bits 17566 bytes 
Sat 18 Jan 2014 22:38:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 22:38:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:38:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:38:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:38:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:38:09 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:38:09 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:38:09 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:38:09 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:38:09 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:38:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:38:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:38:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:38:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:38:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:38:18 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:38:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:38:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:38:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:38:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:38:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:38:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:38:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:38:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:38:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:38:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:38:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:38:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:38:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43653368
Sat 18 Jan 2014 22:38:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:38:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43653368
Sat 18 Jan 2014 22:38:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:38:25 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:38:25 - job_xml_thread(): Done retrieving: data size 43653368
Sat 18 Jan 2014 22:38:25 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:38:25 - XML: Start document: iteration 9
Sat 18 Jan 2014 22:38:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:38:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:38:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:38:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:38:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:38:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:38:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:38:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:38:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:38:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:38:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:38:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:38:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:38:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:38:40 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:38:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:38:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:38:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:38:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:38:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:38:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:38:42 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:38:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 22:38:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:38:44 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:38:44 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:38:44 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:38:44 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:38:44 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:38:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:38:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43636558
Sat 18 Jan 2014 22:38:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:38:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43636558
Sat 18 Jan 2014 22:38:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:38:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:38:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:38:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:38:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:38:59 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:38:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:38:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:38:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:38:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:38:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:38:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:38:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:38:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:38:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:39:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:39:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:39:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:39:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:39:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:39:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:39:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:39:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:39:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:39:05 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:39:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:39:06 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:39:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 22:39:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 22:39:06 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:39:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5709 values 90018 bits 11252 bytes 
Sat 18 Jan 2014 22:39:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:39:07 - job_xml_thread(): Done retrieving: data size 43654999
Sat 18 Jan 2014 22:39:07 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:39:07 - XML: Start document: iteration 10
Sat 18 Jan 2014 22:39:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43654999
Sat 18 Jan 2014 22:39:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:39:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43654999
Sat 18 Jan 2014 22:39:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:39:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:39:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:39:16 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:39:16 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:39:16 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:39:16 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:39:16 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:39:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:39:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:39:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:39:25 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:39:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:39:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:39:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:39:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:39:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:39:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:39:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:39:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:39:31 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:39:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:39:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:39:31 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:39:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:39:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:39:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:39:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:39:35 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:39:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 22:39:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:39:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:39:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43642814
Sat 18 Jan 2014 22:39:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:39:35 - job_xml_thread(): Done retrieving: data size 43642814
Sat 18 Jan 2014 22:39:35 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:39:35 - XML: Start document: iteration 11
Sat 18 Jan 2014 22:39:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43642814
Sat 18 Jan 2014 22:39:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:39:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:39:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:39:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:39:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:39:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:39:51 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:39:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:39:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:39:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:39:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:39:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:39:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:39:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:39:58 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:39:58 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:39:58 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:39:58 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:39:58 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:39:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:40:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:40:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:40:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:40:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:40:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:40:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:40:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:40:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:40:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43622770
Sat 18 Jan 2014 22:40:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:40:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43622770
Sat 18 Jan 2014 22:40:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:40:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:40:06 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:40:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:40:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 22:40:07 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:40:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:40:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:40:07 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:40:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 22:40:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6508 values 102652 bits 12831 bytes 
Sat 18 Jan 2014 22:40:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:40:11 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:40:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:40:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:40:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:40:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:40:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:40:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:40:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43622770
Sat 18 Jan 2014 22:40:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:40:13 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:40:13 - job_xml_thread(): Done retrieving: data size 43622770
Sat 18 Jan 2014 22:40:13 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:40:13 - XML: Start document: iteration 12
Sat 18 Jan 2014 22:40:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:40:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:40:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:40:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:40:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:40:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:40:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:40:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:40:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:40:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:40:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:40:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:40:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:40:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:40:32 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:40:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:40:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:40:32 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:40:32 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:40:32 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:40:32 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:40:32 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:40:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:40:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:40:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:40:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:40:35 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 22:40:35 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 22:40:35 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:40:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:40:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43650811
Sat 18 Jan 2014 22:40:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:40:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43650811
Sat 18 Jan 2014 22:40:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:40:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:40:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:40:47 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:40:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:40:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:40:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:40:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:40:50 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:40:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:40:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:40:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:40:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:40:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:40:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:40:51 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:40:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 22:40:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:40:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:40:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:40:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:40:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:40:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:40:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:40:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:40:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:40:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:40:53 - job_xml_thread(): Done retrieving: data size 43638719
Sat 18 Jan 2014 22:40:53 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:40:53 - XML: Start document: iteration 13
Sat 18 Jan 2014 22:40:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43638719
Sat 18 Jan 2014 22:40:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43638719
Sat 18 Jan 2014 22:40:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:40:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:41:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:41:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:41:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:41:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:41:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:41:07 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:41:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:41:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:41:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:41:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:41:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:41:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:41:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:41:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:41:08 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:41:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:41:08 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:41:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 22:41:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 22:41:08 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:41:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6231 values 98337 bits 12292 bytes 
Sat 18 Jan 2014 22:41:16 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:41:16 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:41:16 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:41:16 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:41:16 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:41:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:41:19 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:41:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:41:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:41:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:41:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:41:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:41:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:41:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:41:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:41:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:41:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43549093
Sat 18 Jan 2014 22:41:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:41:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43549093
Sat 18 Jan 2014 22:41:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:41:26 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:41:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 22:41:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:41:31 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:41:31 - job_xml_thread(): Done retrieving: data size 43549093
Sat 18 Jan 2014 22:41:31 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:41:31 - XML: Start document: iteration 14
Sat 18 Jan 2014 22:41:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:41:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:41:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:41:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:41:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:41:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:41:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:41:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:41:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:41:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:41:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:41:44 - XML: Processed 653446 elements - found 0 jobs
Sat 18 Jan 2014 22:41:45 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:41:45 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:41:45 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:41:45 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:41:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:41:46 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:41:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:41:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:41:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:41:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:41:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:41:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:41:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:41:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43033320
Sat 18 Jan 2014 22:41:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:41:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43033320
Sat 18 Jan 2014 22:41:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:41:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:41:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:41:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:41:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:42:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:42:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:42:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:42:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:42:01 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:42:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:42:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:42:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:42:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:42:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:42:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:42:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:42:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:42:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:42:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:42:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:42:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:42:04 - job_xml_thread(): Done retrieving: data size 42996673
Sat 18 Jan 2014 22:42:04 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:42:04 - XML: Start document: iteration 15
Sat 18 Jan 2014 22:42:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42996673
Sat 18 Jan 2014 22:42:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42996673
Sat 18 Jan 2014 22:42:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:42:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:42:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:42:08 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:42:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:42:09 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:42:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 22:42:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 22:42:10 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:42:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9394 values 148215 bits 18526 bytes 
Sat 18 Jan 2014 22:42:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:42:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:42:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:42:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:42:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:42:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:42:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:42:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:42:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:42:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:42:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:42:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:42:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:42:25 - XML: Processed 645996 elements - found 0 jobs
Sat 18 Jan 2014 22:42:25 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:42:25 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:42:25 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:42:25 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:42:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:42:29 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:42:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:42:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:42:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:42:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:42:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:42:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:42:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:42:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43011814
Sat 18 Jan 2014 22:42:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:42:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43011814
Sat 18 Jan 2014 22:42:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:42:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:42:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:42:40 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:42:40 - job_xml_thread(): Done retrieving: data size 43011814
Sat 18 Jan 2014 22:42:41 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:42:41 - XML: Start document: iteration 16
Sat 18 Jan 2014 22:42:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:42:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:42:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:42:45 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:42:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:42:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:42:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:42:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:42:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:42:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:42:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:42:49 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 22:42:49 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:42:50 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:42:50 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:42:50 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 22:42:50 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 22:42:50 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 22:42:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:42:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:42:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:42:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:42:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:42:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:42:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:42:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:42:55 - XML: Processed 646746 elements - found 0 jobs
Sat 18 Jan 2014 22:42:55 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:42:55 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:42:55 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 774606 values 12208202 bits 1526025 bytes 
Sat 18 Jan 2014 22:42:55 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:42:55 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:42:56 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:42:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 22:42:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:43:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:43:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43595419
Sat 18 Jan 2014 22:43:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:43:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43595419
Sat 18 Jan 2014 22:43:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:43:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:43:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:43:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:43:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:43:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:43:09 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:43:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:43:10 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:43:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 22:43:10 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:43:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 22:43:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:43:10 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:43:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5825 values 91908 bits 11488 bytes 
Sat 18 Jan 2014 22:43:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:43:11 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:43:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:43:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:43:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:43:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:43:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:43:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:43:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:43:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:43:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:43:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:43:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:43:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:43:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:43:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:43:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:43:20 - job_xml_thread(): Done retrieving: data size 43634136
Sat 18 Jan 2014 22:43:20 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:43:20 - XML: Start document: iteration 17
Sat 18 Jan 2014 22:43:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43634136
Sat 18 Jan 2014 22:43:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:43:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43634136
Sat 18 Jan 2014 22:43:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:43:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:43:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:43:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:43:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:43:38 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:43:38 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:43:38 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:43:38 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:43:38 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:43:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:43:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:43:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:43:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:43:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:43:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:43:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:43:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:43:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:43:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:43:42 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:43:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:43:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:43:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:43:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:43:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:43:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:43:43 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:43:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 22:43:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:43:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:43:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43640020
Sat 18 Jan 2014 22:43:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:43:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43640020
Sat 18 Jan 2014 22:43:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:43:50 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:43:51 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 22:43:53 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:43:53 - job_xml_thread(): Done retrieving: data size 43640020
Sat 18 Jan 2014 22:43:54 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:43:54 - XML: Start document: iteration 18
Sat 18 Jan 2014 22:43:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:43:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:43:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:43:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:43:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:43:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:43:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:43:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:43:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:43:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:43:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:43:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:43:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:44:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:44:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:44:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:44:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:44:10 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:44:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:44:10 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:44:10 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:44:10 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:44:10 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:44:10 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:44:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:44:10 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:44:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 22:44:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 22:44:10 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:44:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5612 values 88486 bits 11060 bytes 
Sat 18 Jan 2014 22:44:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:44:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:44:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:44:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:44:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:44:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:44:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:44:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43599135
Sat 18 Jan 2014 22:44:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:44:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43599135
Sat 18 Jan 2014 22:44:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:44:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:44:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:44:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:44:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:44:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:44:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:44:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43599135
Sat 18 Jan 2014 22:44:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:44:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:44:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:44:25 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:44:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:44:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:44:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:44:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:44:30 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:44:36 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:44:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 22:44:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:44:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:44:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:44:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:44:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:44:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:44:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:44:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:44:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:44:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:44:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:44:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:44:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:44:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:44:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:44:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:44:39 - job_xml_thread(): Done retrieving: data size 43621186
Sat 18 Jan 2014 22:44:39 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:44:39 - XML: Start document: iteration 19
Sat 18 Jan 2014 22:44:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43621186
Sat 18 Jan 2014 22:44:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:44:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43621186
Sat 18 Jan 2014 22:44:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:44:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:44:51 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:44:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:44:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:44:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:44:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:44:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:44:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:44:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:44:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:44:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:44:57 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:44:57 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:44:57 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:44:57 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:44:57 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:45:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:45:02 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:45:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:45:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:45:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:45:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:45:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:45:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:45:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:45:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43636288
Sat 18 Jan 2014 22:45:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:45:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43636288
Sat 18 Jan 2014 22:45:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:45:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:45:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:45:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:45:10 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:45:11 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:45:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 22:45:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:45:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 22:45:12 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:45:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8819 values 139066 bits 17383 bytes 
Sat 18 Jan 2014 22:45:12 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:45:12 - job_xml_thread(): Done retrieving: data size 43636288
Sat 18 Jan 2014 22:45:12 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:45:12 - XML: Start document: iteration 20
Sat 18 Jan 2014 22:45:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:45:14 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:45:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:45:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:45:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:45:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:45:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:45:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:45:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:45:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:45:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:45:23 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:45:23 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:45:23 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:45:23 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:45:24 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:45:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:45:27 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:45:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:45:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:45:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:45:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:45:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:45:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:45:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:45:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:45:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:45:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43599819
Sat 18 Jan 2014 22:45:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:45:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43599819
Sat 18 Jan 2014 22:45:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:45:39 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:45:39 - job_xml_thread(): Done retrieving: data size 43599819
Sat 18 Jan 2014 22:45:39 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:45:39 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 22:45:39 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 22:45:39 - Housekeeping: done.
Sat 18 Jan 2014 22:45:39 - XML: Start document: iteration 0
Sat 18 Jan 2014 22:45:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:45:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:45:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:45:49 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:45:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:45:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:45:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:45:49 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:45:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:45:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:45:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:45:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:45:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:45:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:45:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:45:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:45:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:45:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:45:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:45:53 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:45:53 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:45:53 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:45:53 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:45:53 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:45:53 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:45:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 22:45:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:45:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:45:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43636078
Sat 18 Jan 2014 22:45:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:45:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43636078
Sat 18 Jan 2014 22:45:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:46:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:46:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:46:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:46:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:46:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:46:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:46:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:46:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:46:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:46:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:46:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:46:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:46:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:46:08 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:46:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:46:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:46:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:46:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:46:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:46:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:46:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:46:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:46:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:46:11 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:46:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:46:12 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:46:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 22:46:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 22:46:12 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:46:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5789 values 91347 bits 11418 bytes 
Sat 18 Jan 2014 22:46:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:46:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43630140
Sat 18 Jan 2014 22:46:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:46:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43630140
Sat 18 Jan 2014 22:46:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:46:13 - job_xml_thread(): Done retrieving: data size 43630140
Sat 18 Jan 2014 22:46:13 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:46:13 - XML: Start document: iteration 1
Sat 18 Jan 2014 22:46:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:46:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:46:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:46:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:46:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:46:30 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:46:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:46:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:46:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:46:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:46:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:46:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:46:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:46:33 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:46:33 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:46:33 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:46:33 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:46:33 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:46:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:46:37 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:46:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:46:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:46:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:46:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:46:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:46:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:46:40 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:46:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 22:46:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:46:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:46:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43626268
Sat 18 Jan 2014 22:46:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:46:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43626268
Sat 18 Jan 2014 22:46:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:46:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:46:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:46:48 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:46:48 - job_xml_thread(): Done retrieving: data size 43626268
Sat 18 Jan 2014 22:46:48 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:46:48 - XML: Start document: iteration 2
Sat 18 Jan 2014 22:46:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:46:52 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:46:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:46:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:46:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:46:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:46:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:46:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:46:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:46:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:46:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:47:01 - XML: Processed 654193 elements - found 0 jobs
Sat 18 Jan 2014 22:47:01 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:47:01 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:47:01 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:47:01 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:47:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:47:02 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:47:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:47:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:47:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:47:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:47:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:47:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:47:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:47:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43639449
Sat 18 Jan 2014 22:47:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:47:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43639449
Sat 18 Jan 2014 22:47:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:47:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:47:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:47:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:47:12 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:47:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:47:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 22:47:14 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:47:14 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:47:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6533 values 103406 bits 12925 bytes 
Sat 18 Jan 2014 22:47:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 22:47:16 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:47:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:47:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:47:18 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:47:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:47:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:47:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:47:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:47:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:47:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:47:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:47:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:47:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:47:21 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:47:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:47:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:47:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:47:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:47:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:47:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:47:26 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:47:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 22:47:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:47:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:47:27 - job_xml_thread(): Done retrieving: data size 43557855
Sat 18 Jan 2014 22:47:27 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:47:27 - XML: Start document: iteration 3
Sat 18 Jan 2014 22:47:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557855
Sat 18 Jan 2014 22:47:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:47:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557855
Sat 18 Jan 2014 22:47:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:47:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:47:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:47:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:47:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:47:44 - XML: Processed 653442 elements - found 0 jobs
Sat 18 Jan 2014 22:47:44 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:47:44 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:47:44 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:47:44 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:47:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:47:45 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:47:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:47:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:47:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:47:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:47:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:47:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:47:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:47:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:47:50 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:47:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:47:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:47:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:47:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:47:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:47:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:47:51 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 22:47:51 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 22:47:51 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:47:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:47:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43003017
Sat 18 Jan 2014 22:47:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:47:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43003017
Sat 18 Jan 2014 22:47:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:47:59 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:47:59 - job_xml_thread(): Done retrieving: data size 43003017
Sat 18 Jan 2014 22:47:59 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:47:59 - XML: Start document: iteration 4
Sat 18 Jan 2014 22:48:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:48:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:48:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:48:03 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:48:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:48:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:48:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:48:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:48:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:48:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:48:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:48:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:48:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:48:10 - XML: Processed 646234 elements - found 0 jobs
Sat 18 Jan 2014 22:48:10 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:48:10 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:48:10 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:48:10 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:48:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:48:13 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:48:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:48:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:48:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:48:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:48:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:48:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:48:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:48:14 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:48:15 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:48:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:48:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 22:48:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 22:48:15 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:48:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99456 bits 12432 bytes 
Sat 18 Jan 2014 22:48:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:48:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43009384
Sat 18 Jan 2014 22:48:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:48:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43009384
Sat 18 Jan 2014 22:48:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:48:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:48:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:48:25 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:48:25 - job_xml_thread(): Done retrieving: data size 43009384
Sat 18 Jan 2014 22:48:25 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:48:25 - XML: Start document: iteration 5
Sat 18 Jan 2014 22:48:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:48:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:48:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:48:34 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:48:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:48:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:48:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:48:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:48:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:48:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:48:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:48:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:48:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:48:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:48:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:48:37 - XML: Processed 646669 elements - found 0 jobs
Sat 18 Jan 2014 22:48:37 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:48:37 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:48:37 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:48:37 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:48:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:48:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:48:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:48:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:48:39 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:48:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 22:48:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:48:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:48:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43206666
Sat 18 Jan 2014 22:48:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:48:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43206666
Sat 18 Jan 2014 22:48:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:48:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:48:48 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:48:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:48:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:48:52 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:48:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:48:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:48:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:48:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:48:52 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:48:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:48:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:48:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:48:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:48:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:48:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:48:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:48:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:48:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:48:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:48:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:48:55 - job_xml_thread(): Done retrieving: data size 43606679
Sat 18 Jan 2014 22:48:55 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:48:55 - XML: Start document: iteration 6
Sat 18 Jan 2014 22:48:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43606679
Sat 18 Jan 2014 22:48:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:48:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43606679
Sat 18 Jan 2014 22:48:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:49:05 - XML: Processed 653716 elements - found 0 jobs
Sat 18 Jan 2014 22:49:05 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:49:05 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:49:05 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:49:05 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:49:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:49:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:49:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:49:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:49:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:49:15 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:49:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:49:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:49:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:49:15 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:49:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:49:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:49:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:49:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:49:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:49:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:49:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:49:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:49:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:49:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:49:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 22:49:16 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:49:16 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:49:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 22:49:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7745 values 122316 bits 15289 bytes 
Sat 18 Jan 2014 22:49:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:49:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:49:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:49:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:49:20 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:49:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:49:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43637996
Sat 18 Jan 2014 22:49:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:49:22 - job_xml_thread(): Done retrieving: data size 43637996
Sat 18 Jan 2014 22:49:23 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:49:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43637996
Sat 18 Jan 2014 22:49:23 - XML: Start document: iteration 7
Sat 18 Jan 2014 22:49:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:49:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:49:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:49:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:49:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:49:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:49:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:49:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:49:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:49:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:49:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:49:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:49:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:49:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:49:41 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:49:41 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:49:41 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:49:42 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:49:42 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:49:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:49:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:49:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:49:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:49:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:49:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:49:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:49:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:49:45 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:49:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 22:49:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:49:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:49:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43624463
Sat 18 Jan 2014 22:49:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:49:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43624463
Sat 18 Jan 2014 22:49:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:49:52 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 22:49:52 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:49:53 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:49:53 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:49:53 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 22:49:53 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 22:49:53 - Entering storeMetrics(): cluster LISA Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sat 18 Jan 2014 22:49:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:49:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:49:57 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:49:57 - job_xml_thread(): Done retrieving: data size 43624463
Sat 18 Jan 2014 22:49:57 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:49:57 - XML: Start document: iteration 8
Sat 18 Jan 2014 22:49:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:49:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:49:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:49:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:50:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:50:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:50:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:50:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:50:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:50:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:50:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:50:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:50:06 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:50:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:50:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:50:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:50:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:50:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:50:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:50:08 - XML: Processed 654194 elements - found 0 jobs
Sat 18 Jan 2014 22:50:08 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:50:08 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:50:08 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:50:08 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:50:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:50:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43639817
Sat 18 Jan 2014 22:50:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:50:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43639817
Sat 18 Jan 2014 22:50:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:50:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:50:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:50:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:50:17 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:50:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:50:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 22:50:19 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:50:19 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:50:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 22:50:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8932 values 140966 bits 17620 bytes 
Sat 18 Jan 2014 22:50:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:50:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:50:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:50:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:50:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:50:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:50:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:50:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:50:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:50:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:50:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:50:23 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:50:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:50:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:50:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:50:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:50:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:50:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:50:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:50:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:50:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:50:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43632132
Sat 18 Jan 2014 22:50:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:50:29 - job_xml_thread(): Done retrieving: data size 43632132
Sat 18 Jan 2014 22:50:29 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:50:29 - XML: Start document: iteration 9
Sat 18 Jan 2014 22:50:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43632132
Sat 18 Jan 2014 22:50:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:50:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:50:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:50:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:50:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:50:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:50:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:50:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:50:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:50:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:50:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:50:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:50:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:50:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:50:45 - XML: Processed 654191 elements - found 0 jobs
Sat 18 Jan 2014 22:50:45 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:50:45 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:50:45 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:50:45 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:50:49 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:50:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 22:50:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:50:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:50:50 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:50:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:50:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:50:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:50:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:50:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:50:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:50:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:50:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43630984
Sat 18 Jan 2014 22:50:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:50:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43630984
Sat 18 Jan 2014 22:50:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:50:54 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:50:54 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:50:55 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:50:55 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 22:50:55 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 22:50:55 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:50:55 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 22:50:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:50:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:51:00 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:51:00 - job_xml_thread(): Done retrieving: data size 43630984
Sat 18 Jan 2014 22:51:00 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:51:00 - XML: Start document: iteration 10
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sat 18 Jan 2014 22:51:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:51:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:51:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:51:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:51:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:51:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:51:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:51:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:51:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:51:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:51:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:51:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:51:10 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:51:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:51:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:51:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:51:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:51:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:51:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:51:14 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:51:14 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:51:14 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:51:14 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:51:14 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:51:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:51:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43609786
Sat 18 Jan 2014 22:51:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:51:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43609786
Sat 18 Jan 2014 22:51:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:51:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:51:19 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:51:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:51:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:51:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 22:51:21 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:51:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:51:21 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:51:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 22:51:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8981 values 141764 bits 17720 bytes 
Sat 18 Jan 2014 22:51:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:51:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:51:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:51:27 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:51:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:51:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:51:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:51:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:51:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:51:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:51:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:51:29 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:51:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:51:31 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:51:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:51:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:51:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:51:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:51:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:51:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:51:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:51:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43644749
Sat 18 Jan 2014 22:51:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:51:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43644749
Sat 18 Jan 2014 22:51:34 - job_xml_thread(): Done retrieving: data size 43644749
Sat 18 Jan 2014 22:51:34 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:51:34 - XML: Start document: iteration 11
Sat 18 Jan 2014 22:51:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:51:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:51:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:51:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:51:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:51:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:51:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:51:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:51:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:51:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:51:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:51:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:51:47 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:51:47 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:51:47 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:51:47 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:51:47 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:51:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:51:53 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:51:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:51:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:51:53 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:51:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 22:51:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:51:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:51:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:51:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:51:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:51:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:51:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43642478
Sat 18 Jan 2014 22:51:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:51:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43642478
Sat 18 Jan 2014 22:51:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:51:58 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:51:59 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:52:01 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:52:01 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:52:01 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 22:52:01 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 22:52:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:52:01 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 22:52:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:52:02 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:52:02 - job_xml_thread(): Done retrieving: data size 43642478
Sat 18 Jan 2014 22:52:02 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:52:02 - XML: Start document: iteration 12
Sat 18 Jan 2014 22:52:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:52:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:52:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:52:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:52:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:52:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:52:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:52:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:52:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:52:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:52:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:52:13 - size of cluster 'LISA Cluster': 624 hosts 79469 metrics 916769 values 14463630 bits 1807953 bytes 
Sat 18 Jan 2014 22:52:14 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:52:14 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:52:14 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:52:14 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:52:14 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:52:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:52:18 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:52:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:52:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:52:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:52:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:52:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:52:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:52:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:52:21 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:52:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:52:22 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:52:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 22:52:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 22:52:22 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:52:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5821 values 91824 bits 11478 bytes 
Sat 18 Jan 2014 22:52:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:52:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:52:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:52:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43617887
Sat 18 Jan 2014 22:52:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:52:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43617887
Sat 18 Jan 2014 22:52:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:52:29 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:52:29 - job_xml_thread(): Done retrieving: data size 43617887
Sat 18 Jan 2014 22:52:29 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:52:29 - XML: Start document: iteration 13
Sat 18 Jan 2014 22:52:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:52:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:52:40 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:52:40 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:52:40 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:52:40 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:52:40 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:52:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:52:43 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:52:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:52:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:52:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:52:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:52:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:52:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:52:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:52:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:52:48 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:52:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:52:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:52:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:52:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:52:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:52:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:52:50 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:52:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 22:52:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:52:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:52:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43634875
Sat 18 Jan 2014 22:52:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:52:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43634875
Sat 18 Jan 2014 22:52:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:52:55 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:52:55 - job_xml_thread(): Done retrieving: data size 43634875
Sat 18 Jan 2014 22:52:55 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:52:55 - XML: Start document: iteration 14
Sat 18 Jan 2014 22:52:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:52:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:53:02 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:53:02 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 22:53:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:53:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:53:05 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:53:05 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:53:05 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:53:05 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:53:05 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:53:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:53:10 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:53:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:53:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:53:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:53:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:53:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:53:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:53:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:53:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:53:14 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:53:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:53:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:53:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:53:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:53:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:53:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:53:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:53:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569559
Sat 18 Jan 2014 22:53:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:53:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569559
Sat 18 Jan 2014 22:53:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:53:21 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:53:21 - job_xml_thread(): Done retrieving: data size 43569559
Sat 18 Jan 2014 22:53:21 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:53:21 - XML: Start document: iteration 15
Sat 18 Jan 2014 22:53:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:53:22 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:53:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:53:23 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:53:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 22:53:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 22:53:24 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:53:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7986 values 126008 bits 15751 bytes 
Sat 18 Jan 2014 22:53:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:53:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:53:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:53:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:53:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:53:33 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:53:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:53:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:53:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:53:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:53:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:53:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:53:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:53:40 - XML: Processed 653446 elements - found 0 jobs
Sat 18 Jan 2014 22:53:40 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:53:40 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:53:40 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:53:40 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:53:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:53:42 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:53:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:53:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:53:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:53:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:53:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:53:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:53:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:53:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43040730
Sat 18 Jan 2014 22:53:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:53:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43040730
Sat 18 Jan 2014 22:53:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:53:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:53:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:53:55 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:53:55 - job_xml_thread(): Done retrieving: data size 43040730
Sat 18 Jan 2014 22:53:55 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:53:55 - XML: Start document: iteration 16
Sat 18 Jan 2014 22:53:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:53:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:54:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:54:02 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:54:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:54:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:54:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:54:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:54:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:54:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:54:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:54:06 - XML: Processed 647212 elements - found 0 jobs
Sat 18 Jan 2014 22:54:06 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:54:06 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:54:06 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:54:06 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:54:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:54:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:54:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:54:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:54:09 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:54:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 22:54:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:54:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:54:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:54:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:54:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:54:09 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 22:54:09 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 22:54:09 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:54:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:54:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42984062
Sat 18 Jan 2014 22:54:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:54:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42984062
Sat 18 Jan 2014 22:54:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:54:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:54:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:54:21 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:54:21 - job_xml_thread(): Done retrieving: data size 42984062
Sat 18 Jan 2014 22:54:21 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:54:21 - XML: Start document: iteration 17
Sat 18 Jan 2014 22:54:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:54:23 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:54:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:54:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 22:54:24 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:54:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 22:54:24 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:54:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5785 values 91200 bits 11400 bytes 
Sat 18 Jan 2014 22:54:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:54:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:54:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:54:31 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:54:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:54:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:54:32 - XML: Processed 646154 elements - found 0 jobs
Sat 18 Jan 2014 22:54:32 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:54:32 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:54:32 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:54:32 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:54:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:54:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:54:33 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:54:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:54:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:54:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:54:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:54:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:54:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:54:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:54:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:54:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:54:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:54:37 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:54:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 22:54:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:54:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:54:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43369232
Sat 18 Jan 2014 22:54:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:54:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43369232
Sat 18 Jan 2014 22:54:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:54:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:54:46 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:54:48 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:54:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:54:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:54:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:54:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:54:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:54:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:54:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:54:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:54:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:54:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:54:50 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:54:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:54:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:54:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:54:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:54:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:54:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:54:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:54:52 - job_xml_thread(): Done retrieving: data size 43603322
Sat 18 Jan 2014 22:54:52 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:54:52 - XML: Start document: iteration 18
Sat 18 Jan 2014 22:54:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43603322
Sat 18 Jan 2014 22:54:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43603322
Sat 18 Jan 2014 22:54:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:54:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:55:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:55:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:55:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:55:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:55:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:55:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:55:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:55:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:55:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:55:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:55:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:55:11 - XML: Processed 653702 elements - found 0 jobs
Sat 18 Jan 2014 22:55:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:55:11 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:55:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:55:11 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:55:11 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:55:11 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:55:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:55:14 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:55:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:55:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:55:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:55:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:55:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:55:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:55:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:55:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43624353
Sat 18 Jan 2014 22:55:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:55:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43624353
Sat 18 Jan 2014 22:55:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:55:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:55:24 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:55:26 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:55:26 - job_xml_thread(): Done retrieving: data size 43624353
Sat 18 Jan 2014 22:55:26 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:55:26 - XML: Start document: iteration 19
Sat 18 Jan 2014 22:55:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:55:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:55:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:55:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 22:55:26 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:55:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148651 bits 18581 bytes 
Sat 18 Jan 2014 22:55:27 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:55:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 22:55:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:55:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:55:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:55:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:55:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:55:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:55:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:55:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:55:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:55:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:55:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:55:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:55:37 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:55:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:55:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:55:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:55:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:55:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:55:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:55:38 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:55:38 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:55:38 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:55:38 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:55:38 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:55:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:55:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43625972
Sat 18 Jan 2014 22:55:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:55:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43625972
Sat 18 Jan 2014 22:55:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:55:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:55:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:55:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:55:52 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:55:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:55:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:55:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:55:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:55:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:55:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:55:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:55:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:55:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:55:53 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:55:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:55:55 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:55:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:55:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:55:55 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:55:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 22:55:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:55:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:55:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:55:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:55:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:55:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:55:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43645380
Sat 18 Jan 2014 22:55:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:55:58 - job_xml_thread(): Done retrieving: data size 43645380
Sat 18 Jan 2014 22:55:59 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:55:59 - XML: Start document: iteration 20
Sat 18 Jan 2014 22:55:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43645380
Sat 18 Jan 2014 22:55:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:56:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:56:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:56:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:56:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:56:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:56:13 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:56:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:56:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:56:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:56:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:56:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:56:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:56:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:56:18 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:56:18 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:56:18 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:56:18 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:56:18 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:56:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:56:21 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:56:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:56:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:56:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:56:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:56:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:56:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:56:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:56:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43631190
Sat 18 Jan 2014 22:56:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:56:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43631190
Sat 18 Jan 2014 22:56:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:56:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:56:29 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:56:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:56:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:56:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:56:29 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:56:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 22:56:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 22:56:30 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:56:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9076 values 143251 bits 17906 bytes 
Sat 18 Jan 2014 22:56:33 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:56:33 - job_xml_thread(): Done retrieving: data size 43631190
Sat 18 Jan 2014 22:56:33 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:56:33 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 22:56:33 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 22:56:33 - Housekeeping: done.
Sat 18 Jan 2014 22:56:33 - XML: Start document: iteration 0
Sat 18 Jan 2014 22:56:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:56:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:56:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:56:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:56:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:56:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:56:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:56:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:56:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:56:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:56:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:56:42 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:56:42 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:56:42 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:56:42 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:56:42 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:56:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:56:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:56:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:56:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:56:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:56:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:56:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:56:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:56:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:56:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43617121
Sat 18 Jan 2014 22:56:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:56:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43617121
Sat 18 Jan 2014 22:56:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:56:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:56:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:56:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:56:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:56:57 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:56:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:56:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 22:56:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:56:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:56:58 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:56:58 - job_xml_thread(): Done retrieving: data size 43617121
Sat 18 Jan 2014 22:56:58 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:56:58 - XML: Start document: iteration 1
Sat 18 Jan 2014 22:56:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:56:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:56:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:56:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:56:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43617121
Sat 18 Jan 2014 22:56:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:57:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:57:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:57:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:57:10 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:57:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:57:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:57:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:57:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:57:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:57:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:57:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:57:15 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:57:15 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:57:15 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:57:15 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:57:15 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:57:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:57:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:57:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:57:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:57:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:57:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:57:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:57:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:57:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:57:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43633255
Sat 18 Jan 2014 22:57:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:57:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43633255
Sat 18 Jan 2014 22:57:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:57:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:57:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:57:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:57:30 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:57:30 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:57:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:57:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:57:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 22:57:30 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:57:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 22:57:30 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:57:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99129 bits 12391 bytes 
Sat 18 Jan 2014 22:57:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:57:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:57:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:57:33 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:57:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:57:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:57:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:57:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:57:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:57:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:57:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:57:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:57:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:57:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:57:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:57:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:57:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:57:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:57:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:57:40 - job_xml_thread(): Done retrieving: data size 43641947
Sat 18 Jan 2014 22:57:40 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:57:40 - XML: Start document: iteration 2
Sat 18 Jan 2014 22:57:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43641947
Sat 18 Jan 2014 22:57:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:57:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43641947
Sat 18 Jan 2014 22:57:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:57:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:57:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:57:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:57:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:57:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:57:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:57:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:57:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:57:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:57:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:57:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:57:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:57:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:58:01 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:58:01 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:58:01 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:58:01 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:58:01 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:58:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:58:04 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:58:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:58:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:58:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:58:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:58:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:58:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:58:05 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:58:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 22:58:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:58:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:58:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:58:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:58:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43623251
Sat 18 Jan 2014 22:58:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:58:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43623251
Sat 18 Jan 2014 22:58:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:58:16 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:58:16 - job_xml_thread(): Done retrieving: data size 43623251
Sat 18 Jan 2014 22:58:16 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:58:16 - XML: Start document: iteration 3
Sat 18 Jan 2014 22:58:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:58:20 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:58:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:58:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:58:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:58:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:58:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:58:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:58:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:58:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:58:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:58:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:58:31 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:58:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:58:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:58:31 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:58:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 22:58:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 22:58:31 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:58:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5762 values 90877 bits 11359 bytes 
Sat 18 Jan 2014 22:58:31 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:58:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:58:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:58:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:58:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:58:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:58:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:58:32 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:58:32 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:58:32 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:58:32 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:58:32 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:58:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:58:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43622497
Sat 18 Jan 2014 22:58:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:58:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43622497
Sat 18 Jan 2014 22:58:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:58:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:58:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:58:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:58:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:58:47 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:58:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:58:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:58:50 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:58:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:58:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:58:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:58:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:58:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:58:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:58:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:58:52 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:58:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:58:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:58:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:58:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:58:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:58:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:58:53 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:58:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 22:58:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:58:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:58:55 - job_xml_thread(): Done retrieving: data size 43649544
Sat 18 Jan 2014 22:58:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43649544
Sat 18 Jan 2014 22:58:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:58:56 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:58:56 - XML: Start document: iteration 4
Sat 18 Jan 2014 22:58:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43649544
Sat 18 Jan 2014 22:58:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:59:02 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 22:59:02 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:59:04 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:59:04 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:59:04 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 22:59:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:59:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:59:05 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 22:59:05 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 22:59:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:59:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:59:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:59:11 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:59:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:59:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:59:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:59:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:59:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:59:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:59:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:59:15 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 22:59:15 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:59:15 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:59:15 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:59:15 - job_xml_thread(): Sleeping.. (15s)
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sat 18 Jan 2014 22:59:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:59:18 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:59:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:59:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:59:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:59:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:59:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:59:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:59:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:59:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567599
Sat 18 Jan 2014 22:59:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:59:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567599
Sat 18 Jan 2014 22:59:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:59:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:59:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:59:30 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:59:30 - job_xml_thread(): Done retrieving: data size 43567599
Sat 18 Jan 2014 22:59:30 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 22:59:30 - XML: Start document: iteration 5
Sat 18 Jan 2014 22:59:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:59:31 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:59:32 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:59:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 22:59:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:59:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 22:59:32 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 22:59:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8563 values 134998 bits 16874 bytes 
Sat 18 Jan 2014 22:59:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 22:59:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:59:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:59:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:59:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:59:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:59:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:59:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:59:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 22:59:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:59:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:59:43 - XML: Processed 653446 elements - found 0 jobs
Sat 18 Jan 2014 22:59:43 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 22:59:43 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 22:59:43 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 22:59:43 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 22:59:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 22:59:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 22:59:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 22:59:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 22:59:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:59:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 22:59:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 22:59:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 22:59:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 22:59:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43005641
Sat 18 Jan 2014 22:59:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:59:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43005641
Sat 18 Jan 2014 22:59:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 22:59:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 22:59:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 22:59:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 22:59:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 22:59:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 22:59:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 22:59:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:59:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 22:59:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 22:59:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 22:59:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43005641
Sat 18 Jan 2014 22:59:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 22:59:58 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 22:59:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:00:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:00:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:00:05 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:00:05 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:00:06 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:00:06 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 23:00:06 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:00:06 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 23:00:06 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 23:00:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:00:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:00:10 - size of cluster 'LISA Cluster': 624 hosts 79482 metrics 1002867 values 15807795 bits 1975974 bytes 
Sat 18 Jan 2014 23:00:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:00:11 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:00:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:00:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:00:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:00:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:00:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:00:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:00:11 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:00:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 23:00:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:00:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:00:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:00:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:00:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:00:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:00:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:00:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:00:18 - job_xml_thread(): Done retrieving: data size 42988600
Sat 18 Jan 2014 23:00:18 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:00:18 - XML: Start document: iteration 6
Sat 18 Jan 2014 23:00:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42988600
Sat 18 Jan 2014 23:00:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:00:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42988600
Sat 18 Jan 2014 23:00:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:00:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:00:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:00:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:00:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:00:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:00:32 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:00:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:00:33 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:00:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 23:00:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 23:00:33 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:00:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5789 values 91304 bits 11413 bytes 
Sat 18 Jan 2014 23:00:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:00:40 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:00:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:00:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:00:41 - XML: Processed 646632 elements - found 0 jobs
Sat 18 Jan 2014 23:00:41 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:00:41 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:00:41 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:00:41 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:00:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:00:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:00:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:00:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:00:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:00:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:00:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:00:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:00:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:00:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:00:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:00:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:00:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:00:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:00:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568134
Sat 18 Jan 2014 23:00:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568134
Sat 18 Jan 2014 23:00:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:00:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:00:56 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:00:56 - job_xml_thread(): Done retrieving: data size 43568134
Sat 18 Jan 2014 23:00:56 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:00:56 - XML: Start document: iteration 7
Sat 18 Jan 2014 23:00:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:00:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:00:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:00:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:01:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:01:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:01:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:01:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:01:06 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:01:06 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 23:01:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:01:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:01:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:01:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:01:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:01:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:01:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:01:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:01:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:01:08 - XML: Processed 653320 elements - found 0 jobs
Sat 18 Jan 2014 23:01:08 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:01:08 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:01:08 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:01:08 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:01:08 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:01:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 23:01:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:01:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:01:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:01:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:01:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:01:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:01:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43636410
Sat 18 Jan 2014 23:01:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:01:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43636410
Sat 18 Jan 2014 23:01:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:01:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:01:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:01:23 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:01:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:01:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:01:24 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:01:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:01:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:01:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:01:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:01:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:01:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:01:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:01:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:01:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:01:27 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:01:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:01:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:01:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:01:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:01:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:01:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:01:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:01:32 - job_xml_thread(): Done retrieving: data size 43624739
Sat 18 Jan 2014 23:01:32 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:01:32 - XML: Start document: iteration 8
Sat 18 Jan 2014 23:01:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43624739
Sat 18 Jan 2014 23:01:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:01:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43624739
Sat 18 Jan 2014 23:01:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:01:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:01:33 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:01:35 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:01:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 23:01:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:01:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 23:01:35 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:01:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7107 values 112331 bits 14041 bytes 
Sat 18 Jan 2014 23:01:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:01:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:01:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:01:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:01:52 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:01:52 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:01:52 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:01:52 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:01:52 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:01:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:01:53 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:01:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:01:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:01:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:01:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:01:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:01:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:01:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:01:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:01:56 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:01:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:01:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:01:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:01:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:01:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:01:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:02:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:02:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43632781
Sat 18 Jan 2014 23:02:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:02:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43632781
Sat 18 Jan 2014 23:02:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:02:07 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:02:07 - job_xml_thread(): Done retrieving: data size 43632781
Sat 18 Jan 2014 23:02:07 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:02:07 - XML: Start document: iteration 9
Sat 18 Jan 2014 23:02:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:02:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:02:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:02:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:02:21 - XML: Processed 654194 elements - found 0 jobs
Sat 18 Jan 2014 23:02:21 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:02:21 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:02:21 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:02:21 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:02:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:02:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:02:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:02:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:02:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:02:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:02:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:02:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:02:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:02:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:02:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:02:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:02:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:02:25 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:02:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 23:02:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:02:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:02:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:02:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:02:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:02:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:02:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43643188
Sat 18 Jan 2014 23:02:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:02:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43643188
Sat 18 Jan 2014 23:02:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:02:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:02:35 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:02:36 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:02:36 - job_xml_thread(): Done retrieving: data size 43643188
Sat 18 Jan 2014 23:02:36 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:02:36 - XML: Start document: iteration 10
Sat 18 Jan 2014 23:02:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:02:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 23:02:37 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:02:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5886 values 93162 bits 11645 bytes 
Sat 18 Jan 2014 23:02:37 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:02:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 23:02:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:02:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:02:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:02:40 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:02:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:02:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:02:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:02:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:02:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:02:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:02:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:02:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:02:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:02:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:02:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:02:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:02:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:02:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:02:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:02:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:02:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:02:51 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:02:51 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:02:51 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:02:51 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:02:51 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:02:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:02:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:02:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:02:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43627392
Sat 18 Jan 2014 23:02:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:02:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43627392
Sat 18 Jan 2014 23:02:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:03:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:03:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:03:06 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:03:06 - job_xml_thread(): Done retrieving: data size 43627392
Sat 18 Jan 2014 23:03:06 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:03:06 - XML: Start document: iteration 11
Sat 18 Jan 2014 23:03:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:03:11 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:03:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:03:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:03:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:03:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:03:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:03:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:03:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:03:21 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:03:21 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:03:21 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:03:21 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:03:21 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:03:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:03:21 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:03:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:03:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:03:21 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:03:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 23:03:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:03:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:03:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:03:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:03:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:03:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:03:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43624621
Sat 18 Jan 2014 23:03:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:03:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43624621
Sat 18 Jan 2014 23:03:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:03:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:03:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:03:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:03:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:03:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:03:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:03:36 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:03:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:03:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:03:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:03:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:03:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:03:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:03:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:03:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:03:37 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:03:38 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:03:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:03:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 23:03:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 23:03:38 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:03:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5879 values 92965 bits 11620 bytes 
Sat 18 Jan 2014 23:03:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:03:41 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:03:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:03:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:03:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:03:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:03:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:03:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:03:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:03:46 - job_xml_thread(): Done retrieving: data size 43618886
Sat 18 Jan 2014 23:03:46 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:03:46 - XML: Start document: iteration 12
Sat 18 Jan 2014 23:03:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43618886
Sat 18 Jan 2014 23:03:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:03:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43618886
Sat 18 Jan 2014 23:03:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:03:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:03:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:03:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:03:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:04:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:04:05 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:04:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:04:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:04:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:04:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:04:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:04:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:04:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:04:07 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:04:07 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:04:07 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:04:07 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:04:07 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:04:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:04:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:04:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:04:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:04:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:04:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:04:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:04:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:04:10 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:04:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 23:04:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:04:10 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 23:04:10 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 23:04:10 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:04:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:04:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43630528
Sat 18 Jan 2014 23:04:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:04:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43630528
Sat 18 Jan 2014 23:04:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:04:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:04:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:04:22 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:04:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:04:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:04:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:04:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:04:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:04:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:04:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:04:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:04:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:04:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:04:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:04:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:04:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:04:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:04:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:04:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:04:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:04:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:04:28 - job_xml_thread(): Done retrieving: data size 43630828
Sat 18 Jan 2014 23:04:28 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:04:28 - XML: Start document: iteration 13
Sat 18 Jan 2014 23:04:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43630828
Sat 18 Jan 2014 23:04:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:04:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43630828
Sat 18 Jan 2014 23:04:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:04:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:04:38 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:04:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:04:38 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:04:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 23:04:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 23:04:38 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:04:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8954 values 141337 bits 17667 bytes 
Sat 18 Jan 2014 23:04:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:04:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:04:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:04:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:04:49 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:04:49 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:04:49 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:04:49 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:04:49 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:04:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:04:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:04:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:04:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:04:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:04:52 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:04:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:04:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:04:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:04:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:04:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:04:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:04:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:04:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:04:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:04:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:04:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:04:54 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:04:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 23:04:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:04:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:04:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43655172
Sat 18 Jan 2014 23:04:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:04:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43655172
Sat 18 Jan 2014 23:04:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:05:05 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:05:05 - job_xml_thread(): Done retrieving: data size 43655172
Sat 18 Jan 2014 23:05:05 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:05:05 - XML: Start document: iteration 14
Sat 18 Jan 2014 23:05:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:05:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:05:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:05:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:05:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:05:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:05:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:05:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:05:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:05:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:05:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:05:15 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:05:15 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:05:15 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:05:15 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:05:15 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:05:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:05:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:05:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:05:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:05:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:05:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:05:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:05:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:05:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:05:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43550815
Sat 18 Jan 2014 23:05:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:05:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43550815
Sat 18 Jan 2014 23:05:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:05:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:05:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:05:30 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:05:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:05:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:05:31 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:05:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:05:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:05:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:05:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:05:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:05:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:05:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:05:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:05:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:05:34 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:05:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:05:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:05:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:05:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:05:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:05:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:05:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:05:38 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:05:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:05:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 23:05:39 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:05:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 23:05:39 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:05:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99174 bits 12396 bytes 
Sat 18 Jan 2014 23:05:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:05:39 - job_xml_thread(): Done retrieving: data size 43102178
Sat 18 Jan 2014 23:05:39 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:05:39 - XML: Start document: iteration 15
Sat 18 Jan 2014 23:05:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43102178
Sat 18 Jan 2014 23:05:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43102178
Sat 18 Jan 2014 23:05:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:05:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:05:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:05:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:05:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:05:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:06:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:06:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:06:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:06:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:06:01 - XML: Processed 647680 elements - found 0 jobs
Sat 18 Jan 2014 23:06:01 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:06:01 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:06:01 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:06:01 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:06:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:06:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:06:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:06:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:06:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:06:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:06:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:06:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:06:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:06:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:06:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:06:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:06:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:06:05 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:06:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 23:06:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:06:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:06:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42985027
Sat 18 Jan 2014 23:06:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:06:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42985027
Sat 18 Jan 2014 23:06:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:06:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:06:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:06:16 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:06:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:06:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:06:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:06:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:06:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:06:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:06:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:06:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:06:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:06:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:06:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:06:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:06:20 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:06:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:06:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:06:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:06:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:06:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:06:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:06:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:06:23 - job_xml_thread(): Done retrieving: data size 43047863
Sat 18 Jan 2014 23:06:23 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:06:23 - XML: Start document: iteration 16
Sat 18 Jan 2014 23:06:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43047863
Sat 18 Jan 2014 23:06:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:06:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43047863
Sat 18 Jan 2014 23:06:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:06:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:06:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:06:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:06:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:06:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:06:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:06:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:06:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:06:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:06:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:06:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:06:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:06:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:06:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:06:39 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:06:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:06:42 - XML: Processed 646750 elements - found 0 jobs
Sat 18 Jan 2014 23:06:42 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:06:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 23:06:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 23:06:42 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:06:42 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:06:42 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:06:42 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:06:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6493 values 102466 bits 12808 bytes 
Sat 18 Jan 2014 23:06:42 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:06:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:06:46 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:06:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:06:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:06:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:06:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:06:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:06:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:06:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:06:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565164
Sat 18 Jan 2014 23:06:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:06:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565164
Sat 18 Jan 2014 23:06:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:06:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:06:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:06:57 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:06:57 - job_xml_thread(): Done retrieving: data size 43565164
Sat 18 Jan 2014 23:06:57 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:06:57 - XML: Start document: iteration 17
Sat 18 Jan 2014 23:06:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:06:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:06:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:06:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:06:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:06:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:06:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:06:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:07:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:07:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:07:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:07:06 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 23:07:06 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:07:08 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:07:08 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 23:07:08 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 23:07:08 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:07:08 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 23:07:09 - XML: Processed 653480 elements - found 0 jobs
Sat 18 Jan 2014 23:07:09 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:07:09 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:07:09 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:07:09 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:07:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:07:11 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:07:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:07:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:07:12 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 842476 values 13298601 bits 1662325 bytes 
Sat 18 Jan 2014 23:07:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:07:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:07:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:07:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:07:13 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:07:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 23:07:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:07:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:07:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:07:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:07:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43594441
Sat 18 Jan 2014 23:07:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:07:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43594441
Sat 18 Jan 2014 23:07:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:07:24 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:07:24 - job_xml_thread(): Done retrieving: data size 43594441
Sat 18 Jan 2014 23:07:24 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:07:24 - XML: Start document: iteration 18
Sat 18 Jan 2014 23:07:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:07:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:07:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:07:31 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:07:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:07:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:07:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:07:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:07:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:07:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:07:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:07:34 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:07:34 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:07:34 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:07:34 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:07:34 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:07:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:07:38 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:07:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:07:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:07:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:07:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:07:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:07:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:07:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:07:42 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:07:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:07:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43625018
Sat 18 Jan 2014 23:07:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:07:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43625018
Sat 18 Jan 2014 23:07:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:07:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:07:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 23:07:43 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:07:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 23:07:43 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:07:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6414 values 101268 bits 12658 bytes 
Sat 18 Jan 2014 23:07:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:07:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:07:49 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:07:49 - job_xml_thread(): Done retrieving: data size 43625018
Sat 18 Jan 2014 23:07:49 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:07:49 - XML: Start document: iteration 19
Sat 18 Jan 2014 23:07:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:07:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:07:58 - XML: Processed 654194 elements - found 0 jobs
Sat 18 Jan 2014 23:07:58 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:07:58 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:07:58 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:07:58 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:08:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:08:00 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:08:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:08:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:08:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:08:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:08:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:08:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:08:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:08:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:08:06 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:08:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:08:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:08:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:08:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:08:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:08:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:08:08 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:08:08 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 23:08:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:08:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43634776
Sat 18 Jan 2014 23:08:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:08:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43634776
Sat 18 Jan 2014 23:08:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:08:13 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:08:13 - job_xml_thread(): Done retrieving: data size 43634776
Sat 18 Jan 2014 23:08:13 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:08:13 - XML: Start document: iteration 20
Sat 18 Jan 2014 23:08:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:08:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:08:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:08:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:08:23 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:08:23 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:08:23 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:08:23 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:08:23 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:08:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:08:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:08:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:08:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:08:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:08:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:08:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:08:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:08:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:08:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:08:31 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:08:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:08:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:08:32 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:08:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 23:08:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:08:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:08:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:08:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:08:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:08:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:08:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43642341
Sat 18 Jan 2014 23:08:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:08:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43642341
Sat 18 Jan 2014 23:08:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:08:38 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:08:38 - job_xml_thread(): Done retrieving: data size 43642341
Sat 18 Jan 2014 23:08:38 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:08:38 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 23:08:39 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 23:08:39 - Housekeeping: done.
Sat 18 Jan 2014 23:08:39 - XML: Start document: iteration 0
Sat 18 Jan 2014 23:08:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:08:43 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:08:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:08:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:08:44 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:08:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:08:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 23:08:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 23:08:44 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:08:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5761 values 90839 bits 11354 bytes 
Sat 18 Jan 2014 23:08:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:08:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:08:53 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:08:53 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:08:53 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:08:53 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:08:53 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:08:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:08:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:08:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:08:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:08:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:08:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:08:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:08:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:08:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:08:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:08:57 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:08:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:08:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:08:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:08:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:08:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:08:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:09:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:09:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43629328
Sat 18 Jan 2014 23:09:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:09:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43629328
Sat 18 Jan 2014 23:09:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:09:08 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:09:08 - job_xml_thread(): Done retrieving: data size 43629328
Sat 18 Jan 2014 23:09:08 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:09:08 - XML: Start document: iteration 1
Sat 18 Jan 2014 23:09:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:09:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:09:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:09:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:09:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:09:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:09:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:09:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:09:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:09:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:09:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:09:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:09:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:09:24 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:09:24 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:09:24 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:09:24 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:09:24 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:09:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:09:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:09:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:09:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:09:26 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:09:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 23:09:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:09:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:09:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:09:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:09:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:09:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:09:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43607426
Sat 18 Jan 2014 23:09:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:09:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43607426
Sat 18 Jan 2014 23:09:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:09:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:09:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:09:39 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:09:39 - job_xml_thread(): Done retrieving: data size 43607426
Sat 18 Jan 2014 23:09:39 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:09:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:09:39 - XML: Start document: iteration 2
Sat 18 Jan 2014 23:09:39 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:09:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:09:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:09:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:09:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:09:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:09:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:09:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:09:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:09:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:09:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:09:45 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:09:46 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:09:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:09:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 23:09:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 23:09:46 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:09:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5810 values 91635 bits 11454 bytes 
Sat 18 Jan 2014 23:09:52 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:09:52 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:09:52 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:09:52 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:09:52 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:09:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:09:53 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:09:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:09:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:09:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:09:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:09:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:09:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:09:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:09:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:09:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:09:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43613746
Sat 18 Jan 2014 23:09:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:09:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43613746
Sat 18 Jan 2014 23:09:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:10:07 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:10:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:10:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:10:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:10:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:10:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:10:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:10:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:10:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:10:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:10:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:10:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:10:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:10:13 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:10:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:10:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:10:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:10:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:10:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:10:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:10:14 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:10:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 23:10:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:10:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:10:16 - job_xml_thread(): Done retrieving: data size 43623401
Sat 18 Jan 2014 23:10:16 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:10:16 - XML: Start document: iteration 3
Sat 18 Jan 2014 23:10:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43623401
Sat 18 Jan 2014 23:10:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:10:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43623401
Sat 18 Jan 2014 23:10:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:10:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:10:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:10:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:10:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:10:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:10:30 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:10:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:10:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:10:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:10:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:10:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:10:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:10:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:10:35 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:10:35 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:10:35 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:10:35 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:10:35 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:10:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:10:40 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:10:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:10:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:10:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:10:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:10:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:10:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:10:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:10:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43607746
Sat 18 Jan 2014 23:10:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:10:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43607746
Sat 18 Jan 2014 23:10:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:10:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:10:46 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:10:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:10:47 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:10:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 23:10:47 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:10:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 23:10:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:10:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:10:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8455 values 133367 bits 16670 bytes 
Sat 18 Jan 2014 23:10:50 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:10:50 - job_xml_thread(): Done retrieving: data size 43607746
Sat 18 Jan 2014 23:10:50 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:10:50 - XML: Start document: iteration 4
Sat 18 Jan 2014 23:10:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:10:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:10:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:10:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:11:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:11:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:11:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:11:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:11:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:11:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:11:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:11:04 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:11:04 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:11:04 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:11:04 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:11:04 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:11:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:11:07 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:11:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:11:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:11:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:11:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:11:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:11:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:11:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:11:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572894
Sat 18 Jan 2014 23:11:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:11:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572894
Sat 18 Jan 2014 23:11:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:11:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:11:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:11:19 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:11:19 - job_xml_thread(): Done retrieving: data size 43572894
Sat 18 Jan 2014 23:11:19 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:11:19 - XML: Start document: iteration 5
Sat 18 Jan 2014 23:11:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:11:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:11:23 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:11:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 23:11:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:11:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:11:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:11:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:11:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:11:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:11:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:11:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:11:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:11:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:11:33 - XML: Processed 653518 elements - found 0 jobs
Sat 18 Jan 2014 23:11:33 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:11:33 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:11:33 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:11:33 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:11:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:11:35 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:11:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:11:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:11:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:11:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:11:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:11:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:11:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:11:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43469591
Sat 18 Jan 2014 23:11:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:11:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43469591
Sat 18 Jan 2014 23:11:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:11:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:11:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:11:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:11:48 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:11:48 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:11:48 - job_xml_thread(): Done retrieving: data size 43469591
Sat 18 Jan 2014 23:11:48 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:11:48 - XML: Start document: iteration 6
Sat 18 Jan 2014 23:11:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:11:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 23:11:49 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:11:49 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:11:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 23:11:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6134 values 96816 bits 12102 bytes 
Sat 18 Jan 2014 23:11:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:11:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:11:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:11:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:11:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:11:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:11:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:11:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:11:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:11:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:11:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:12:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:12:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:12:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:12:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:12:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:12:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:12:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:12:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:12:03 - XML: Processed 652400 elements - found 0 jobs
Sat 18 Jan 2014 23:12:03 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:12:03 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:12:03 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:12:03 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:12:06 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 23:12:06 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 23:12:06 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:12:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:12:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42965060
Sat 18 Jan 2014 23:12:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:12:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42965060
Sat 18 Jan 2014 23:12:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:12:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:12:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:12:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:12:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:12:18 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:12:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:12:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:12:20 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:12:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:12:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:12:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:12:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:12:22 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:12:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:12:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:12:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:12:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:12:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:12:22 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:12:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 23:12:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:12:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:12:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:12:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:12:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:12:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:12:23 - job_xml_thread(): Done retrieving: data size 43040850
Sat 18 Jan 2014 23:12:23 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:12:23 - XML: Start document: iteration 7
Sat 18 Jan 2014 23:12:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43040850
Sat 18 Jan 2014 23:12:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:12:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43040850
Sat 18 Jan 2014 23:12:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:12:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:12:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:12:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:12:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:12:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:12:42 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:12:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:12:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:12:42 - XML: Processed 646746 elements - found 0 jobs
Sat 18 Jan 2014 23:12:42 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:12:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:12:42 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:12:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:12:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:12:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:12:43 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:12:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:12:43 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:12:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:12:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:12:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:12:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:12:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:12:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:12:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:12:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:12:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:12:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556911
Sat 18 Jan 2014 23:12:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:12:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:12:50 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:12:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556911
Sat 18 Jan 2014 23:12:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:12:52 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:12:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 23:12:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:12:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 23:12:53 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:12:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9163 values 144615 bits 18076 bytes 
Sat 18 Jan 2014 23:12:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:12:58 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:12:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:12:58 - job_xml_thread(): Done retrieving: data size 43556911
Sat 18 Jan 2014 23:12:58 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:12:58 - XML: Start document: iteration 8
Sat 18 Jan 2014 23:12:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:12:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:12:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:12:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:12:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556911
Sat 18 Jan 2014 23:13:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:13:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:13:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:13:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:13:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:13:13 - XML: Processed 653178 elements - found 0 jobs
Sat 18 Jan 2014 23:13:13 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:13:14 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:13:14 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:13:14 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:13:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:13:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:13:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:13:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:13:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:13:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:13:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:13:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:13:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:13:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:13:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:13:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:13:19 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:13:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:13:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:13:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:13:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:13:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:13:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:13:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:13:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43642280
Sat 18 Jan 2014 23:13:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:13:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43642280
Sat 18 Jan 2014 23:13:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:13:29 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:13:29 - job_xml_thread(): Done retrieving: data size 43642280
Sat 18 Jan 2014 23:13:29 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:13:29 - XML: Start document: iteration 9
Sat 18 Jan 2014 23:13:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:13:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:13:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:13:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:13:43 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:13:43 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:13:43 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:13:43 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:13:43 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:13:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:13:44 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:13:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:13:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:13:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:13:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:13:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:13:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:13:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:13:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:13:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:13:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:13:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:13:45 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:13:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 23:13:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:13:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:13:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:13:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:13:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:13:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:13:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43652202
Sat 18 Jan 2014 23:13:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:13:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43652202
Sat 18 Jan 2014 23:13:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:13:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:13:54 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:13:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:13:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 23:13:56 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:13:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 23:13:56 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:13:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5803 values 91470 bits 11433 bytes 
Sat 18 Jan 2014 23:13:58 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:13:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:13:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:13:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:14:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:14:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:14:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:14:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:14:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:14:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:14:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:14:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:14:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:14:04 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:14:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:14:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:14:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:14:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:14:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:14:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:14:07 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:14:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 23:14:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:14:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:14:07 - job_xml_thread(): Done retrieving: data size 43635668
Sat 18 Jan 2014 23:14:07 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:14:07 - XML: Start document: iteration 10
Sat 18 Jan 2014 23:14:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43635668
Sat 18 Jan 2014 23:14:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43635668
Sat 18 Jan 2014 23:14:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:14:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:14:08 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 23:14:08 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:14:11 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:14:11 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:14:11 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 23:14:12 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 23:14:12 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 23:14:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:14:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:14:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:14:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:14:21 - size of cluster 'LISA Cluster': 624 hosts 79470 metrics 740492 values 11673128 bits 1459141 bytes 
Sat 18 Jan 2014 23:14:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:14:26 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:14:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:14:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:14:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:14:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:14:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:14:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:14:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:14:30 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:14:30 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:14:30 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:14:30 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:14:30 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:14:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:14:31 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:14:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:14:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:14:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:14:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:14:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:14:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:14:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:14:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43632112
Sat 18 Jan 2014 23:14:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:14:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43632112
Sat 18 Jan 2014 23:14:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:14:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:14:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:14:46 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:14:46 - job_xml_thread(): Done retrieving: data size 43632112
Sat 18 Jan 2014 23:14:46 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:14:46 - XML: Start document: iteration 11
Sat 18 Jan 2014 23:14:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:14:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:14:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:14:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:14:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:14:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:14:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:14:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:14:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:14:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:14:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:14:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:14:56 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:14:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:14:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 23:14:58 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:14:59 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:14:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 23:14:59 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99043 bits 12380 bytes 
Sat 18 Jan 2014 23:15:03 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:15:03 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:15:03 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:15:03 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:15:03 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:15:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:15:05 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:15:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:15:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:15:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:15:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:15:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:15:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:15:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:15:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43624341
Sat 18 Jan 2014 23:15:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:15:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43624341
Sat 18 Jan 2014 23:15:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:15:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:15:12 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:15:12 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 23:15:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:15:18 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:15:18 - job_xml_thread(): Done retrieving: data size 43624341
Sat 18 Jan 2014 23:15:18 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:15:18 - XML: Start document: iteration 12
Sat 18 Jan 2014 23:15:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:15:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:15:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:15:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:15:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:15:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:15:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:15:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:15:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:15:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:15:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:15:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:15:31 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:15:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:15:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:15:33 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:15:33 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:15:33 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:15:33 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:15:33 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:15:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:15:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:15:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:15:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:15:33 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:15:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 23:15:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:15:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:15:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43625921
Sat 18 Jan 2014 23:15:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:15:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43625921
Sat 18 Jan 2014 23:15:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:15:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:15:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:15:48 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:15:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:15:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:15:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:15:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:15:49 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:15:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:15:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:15:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:15:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:15:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:15:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:15:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:15:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:15:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:15:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:15:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:15:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:15:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:15:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:15:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:15:55 - job_xml_thread(): Done retrieving: data size 43629268
Sat 18 Jan 2014 23:15:55 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:15:55 - XML: Start document: iteration 13
Sat 18 Jan 2014 23:15:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43629268
Sat 18 Jan 2014 23:15:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43629268
Sat 18 Jan 2014 23:15:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:15:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:15:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:15:59 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:16:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:16:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 23:16:00 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:16:00 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:16:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 23:16:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6543 values 103263 bits 12907 bytes 
Sat 18 Jan 2014 23:16:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:16:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:16:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:16:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:16:13 - XML: Processed 654190 elements - found 0 jobs
Sat 18 Jan 2014 23:16:13 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:16:13 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:16:13 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:16:13 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:16:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:16:14 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:16:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:16:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:16:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:16:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:16:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:16:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:16:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:16:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:16:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:16:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:16:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:16:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:16:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:16:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:16:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:16:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:16:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43645689
Sat 18 Jan 2014 23:16:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:16:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43645689
Sat 18 Jan 2014 23:16:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:16:28 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:16:29 - job_xml_thread(): Done retrieving: data size 43645689
Sat 18 Jan 2014 23:16:29 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:16:29 - XML: Start document: iteration 14
Sat 18 Jan 2014 23:16:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:16:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:16:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:16:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:16:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:16:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:16:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:16:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:16:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:16:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:16:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:16:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:16:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:16:41 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:16:41 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:16:41 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:16:41 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:16:42 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:16:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:16:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:16:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:16:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:16:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:16:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:16:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:16:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:16:45 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:16:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 23:16:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:16:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:16:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43624256
Sat 18 Jan 2014 23:16:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:16:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43624256
Sat 18 Jan 2014 23:16:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:16:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:16:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:16:57 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:16:57 - job_xml_thread(): Done retrieving: data size 43624256
Sat 18 Jan 2014 23:16:57 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:16:57 - XML: Start document: iteration 15
Sat 18 Jan 2014 23:16:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:16:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:16:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:16:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:16:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:17:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:17:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:17:00 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:17:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:17:01 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:17:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 23:17:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 23:17:01 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:17:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:17:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:17:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:17:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5862 values 92686 bits 11585 bytes 
Sat 18 Jan 2014 23:17:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:17:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:17:11 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:17:11 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:17:11 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:17:11 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:17:11 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:17:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:17:13 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:17:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:17:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:17:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:17:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:17:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:17:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:17:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:17:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:17:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:17:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43610329
Sat 18 Jan 2014 23:17:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:17:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43610329
Sat 18 Jan 2014 23:17:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:17:26 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:17:27 - job_xml_thread(): Done retrieving: data size 43610329
Sat 18 Jan 2014 23:17:27 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:17:27 - XML: Start document: iteration 16
Sat 18 Jan 2014 23:17:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:17:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:17:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:17:34 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:17:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:17:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:17:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:17:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:17:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:17:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:17:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:17:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:17:38 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:17:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:17:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:17:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:17:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:17:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:17:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:17:41 - XML: Processed 654193 elements - found 0 jobs
Sat 18 Jan 2014 23:17:41 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:17:41 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:17:41 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:17:41 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:17:41 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:17:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 23:17:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:17:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:17:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43063241
Sat 18 Jan 2014 23:17:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:17:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43063241
Sat 18 Jan 2014 23:17:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:17:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:17:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:17:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:17:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:17:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:17:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:17:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:17:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:17:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:17:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:17:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:17:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:17:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:17:56 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:17:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:17:59 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:17:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:17:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:17:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:17:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:17:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:17:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:18:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:18:01 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:18:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:18:01 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:18:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 23:18:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 23:18:01 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:18:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5839 values 92378 bits 11547 bytes 
Sat 18 Jan 2014 23:18:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:18:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42975611
Sat 18 Jan 2014 23:18:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:18:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42975611
Sat 18 Jan 2014 23:18:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:18:04 - job_xml_thread(): Done retrieving: data size 42975611
Sat 18 Jan 2014 23:18:04 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:18:04 - XML: Start document: iteration 17
Sat 18 Jan 2014 23:18:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:18:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:18:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:18:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:18:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:18:19 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:18:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:18:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:18:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:18:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:18:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:18:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:18:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:18:24 - XML: Processed 645996 elements - found 0 jobs
Sat 18 Jan 2014 23:18:24 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:18:24 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:18:24 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:18:24 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:18:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:18:27 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:18:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:18:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:18:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:18:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:18:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:18:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:18:31 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:18:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 23:18:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:18:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:18:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43023229
Sat 18 Jan 2014 23:18:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:18:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43023229
Sat 18 Jan 2014 23:18:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:18:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:18:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:18:39 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:18:39 - job_xml_thread(): Done retrieving: data size 43023229
Sat 18 Jan 2014 23:18:39 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:18:39 - XML: Start document: iteration 18
Sat 18 Jan 2014 23:18:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:18:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:18:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:18:49 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:18:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:18:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:18:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:18:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:18:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:18:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:18:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:18:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:18:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:18:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:18:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:18:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:18:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:18:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:18:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:18:53 - XML: Processed 646746 elements - found 0 jobs
Sat 18 Jan 2014 23:18:53 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:18:53 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:18:53 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:18:53 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:18:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:18:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43612461
Sat 18 Jan 2014 23:18:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:18:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43612461
Sat 18 Jan 2014 23:18:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:19:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:19:01 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:19:01 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:19:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 23:19:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:19:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 23:19:01 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:19:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7266 values 114705 bits 14338 bytes 
Sat 18 Jan 2014 23:19:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:19:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:19:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:19:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:19:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:19:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:19:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:19:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:19:08 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:19:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:19:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:19:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:19:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:19:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:19:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:19:13 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:19:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:19:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:19:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:19:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:19:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:19:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:19:15 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 23:19:15 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 23:19:15 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:19:16 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:19:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 23:19:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:19:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:19:16 - job_xml_thread(): Done retrieving: data size 43625395
Sat 18 Jan 2014 23:19:16 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:19:16 - XML: Start document: iteration 19
Sat 18 Jan 2014 23:19:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43625395
Sat 18 Jan 2014 23:19:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:19:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43625395
Sat 18 Jan 2014 23:19:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:19:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:19:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:19:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:19:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:19:35 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:19:35 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:19:35 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:19:35 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:19:35 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:19:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:19:36 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:19:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:19:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:19:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:19:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:19:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:19:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:19:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:19:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:19:39 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:19:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:19:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:19:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:19:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:19:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:19:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:19:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:19:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43630799
Sat 18 Jan 2014 23:19:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:19:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43630799
Sat 18 Jan 2014 23:19:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:19:51 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:19:51 - job_xml_thread(): Done retrieving: data size 43630799
Sat 18 Jan 2014 23:19:51 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:19:51 - XML: Start document: iteration 20
Sat 18 Jan 2014 23:19:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:19:52 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:19:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:19:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:19:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:19:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:19:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:19:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:19:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:19:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:19:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:20:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:20:02 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:20:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:20:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 23:20:03 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:20:03 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:20:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 23:20:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99123 bits 12390 bytes 
Sat 18 Jan 2014 23:20:04 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:20:04 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:20:04 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:20:04 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:20:04 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:20:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:20:04 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:20:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:20:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:20:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:20:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:20:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:20:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:20:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:20:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43618729
Sat 18 Jan 2014 23:20:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:20:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43618729
Sat 18 Jan 2014 23:20:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:20:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:20:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:20:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:20:18 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:20:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:20:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:20:19 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:20:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:20:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:20:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:20:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:20:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:20:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:20:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:20:21 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:20:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 23:20:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:20:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:20:23 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:20:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:20:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:20:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:20:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:20:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:20:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:20:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:20:25 - job_xml_thread(): Done retrieving: data size 43630897
Sat 18 Jan 2014 23:20:25 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:20:25 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 23:20:25 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 23:20:25 - Housekeeping: done.
Sat 18 Jan 2014 23:20:25 - XML: Start document: iteration 0
Sat 18 Jan 2014 23:20:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43630897
Sat 18 Jan 2014 23:20:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43630897
Sat 18 Jan 2014 23:20:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:20:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:20:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:20:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:20:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:20:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:20:42 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:20:42 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:20:42 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:20:42 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:20:42 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:20:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:20:43 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:20:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:20:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:20:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:20:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:20:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:20:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:20:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:20:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:20:46 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:20:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:20:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:20:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:20:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:20:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:20:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:20:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:20:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43641356
Sat 18 Jan 2014 23:20:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:20:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43641356
Sat 18 Jan 2014 23:20:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:20:57 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:20:57 - job_xml_thread(): Done retrieving: data size 43641356
Sat 18 Jan 2014 23:20:57 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:20:57 - XML: Start document: iteration 1
Sat 18 Jan 2014 23:20:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:21:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:21:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:21:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:21:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:21:03 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:21:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:21:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 23:21:04 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:21:05 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:21:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 23:21:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:21:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9244 values 145850 bits 18231 bytes 
Sat 18 Jan 2014 23:21:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:21:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:21:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:21:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:21:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:21:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:21:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:21:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:21:11 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:21:11 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:21:11 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:21:11 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:21:11 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:21:12 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 23:21:12 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:21:13 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:21:13 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 23:21:13 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:21:13 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 23:21:13 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 23:21:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:21:14 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:21:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:21:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:21:15 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 748283 values 11809510 bits 1476188 bytes 
Sat 18 Jan 2014 23:21:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:21:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:21:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:21:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:21:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:21:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43614698
Sat 18 Jan 2014 23:21:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:21:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43614698
Sat 18 Jan 2014 23:21:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:21:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:21:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:21:26 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:21:26 - job_xml_thread(): Done retrieving: data size 43614698
Sat 18 Jan 2014 23:21:26 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:21:26 - XML: Start document: iteration 2
Sat 18 Jan 2014 23:21:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:21:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:21:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:21:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:21:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:21:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:21:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:21:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:21:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:21:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:21:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:21:37 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:21:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:21:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:21:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:21:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:21:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:21:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:21:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:21:40 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:21:40 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:21:40 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:21:40 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:21:40 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:21:41 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:21:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 23:21:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:21:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:21:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43631341
Sat 18 Jan 2014 23:21:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:21:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43631341
Sat 18 Jan 2014 23:21:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:21:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:21:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:21:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:21:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:21:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:21:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:21:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:21:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:21:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:21:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:21:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:21:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:21:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:21:55 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:21:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:21:59 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:21:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:21:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:21:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:21:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:21:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:21:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:22:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:22:05 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:22:06 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:22:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:22:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 23:22:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 23:22:06 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:22:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5592 values 88153 bits 11019 bytes 
Sat 18 Jan 2014 23:22:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:22:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43628944
Sat 18 Jan 2014 23:22:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:22:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43628944
Sat 18 Jan 2014 23:22:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:22:07 - job_xml_thread(): Done retrieving: data size 43628944
Sat 18 Jan 2014 23:22:07 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:22:07 - XML: Start document: iteration 3
Sat 18 Jan 2014 23:22:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:22:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:22:13 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:22:13 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 23:22:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:22:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:22:23 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:22:23 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:22:23 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:22:23 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:22:23 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:22:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:22:26 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:22:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:22:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:22:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:22:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:22:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:22:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:22:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:22:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:22:30 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:22:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:22:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:22:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:22:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:22:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:22:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:22:33 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:22:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 23:22:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:22:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:22:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43633243
Sat 18 Jan 2014 23:22:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:22:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43633243
Sat 18 Jan 2014 23:22:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:22:38 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:22:38 - job_xml_thread(): Done retrieving: data size 43633243
Sat 18 Jan 2014 23:22:38 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:22:38 - XML: Start document: iteration 4
Sat 18 Jan 2014 23:22:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:22:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:22:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:22:44 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:22:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:22:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:22:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:22:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:22:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:22:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:22:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:22:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:22:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:22:54 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:22:54 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:22:54 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:22:54 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:22:54 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:22:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:22:57 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:22:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:22:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:22:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:22:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:22:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:22:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:23:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:23:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43605684
Sat 18 Jan 2014 23:23:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:23:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:23:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:23:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43605684
Sat 18 Jan 2014 23:23:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:23:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:23:07 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:23:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:23:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 23:23:07 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:23:07 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:23:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 23:23:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6659 values 105046 bits 13130 bytes 
Sat 18 Jan 2014 23:23:09 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:23:09 - job_xml_thread(): Done retrieving: data size 43605684
Sat 18 Jan 2014 23:23:09 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:23:09 - XML: Start document: iteration 5
Sat 18 Jan 2014 23:23:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:23:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:23:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:23:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:23:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:23:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:23:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:23:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:23:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:23:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:23:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:23:24 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:23:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:23:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:23:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:23:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:23:24 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:23:24 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:23:24 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:23:24 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:23:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:23:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:23:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:23:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:23:27 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:23:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 23:23:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:23:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:23:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43546107
Sat 18 Jan 2014 23:23:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:23:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43546107
Sat 18 Jan 2014 23:23:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:23:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:23:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:23:40 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:23:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:23:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:23:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:23:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:23:42 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:23:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:23:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:23:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:23:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:23:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:23:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:23:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:23:44 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:23:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:23:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:23:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:23:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:23:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:23:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:23:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:23:47 - job_xml_thread(): Done retrieving: data size 43017811
Sat 18 Jan 2014 23:23:47 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:23:47 - XML: Start document: iteration 6
Sat 18 Jan 2014 23:23:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43017811
Sat 18 Jan 2014 23:23:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:23:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43017811
Sat 18 Jan 2014 23:23:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:23:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:23:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:23:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:23:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:24:01 - XML: Processed 646684 elements - found 0 jobs
Sat 18 Jan 2014 23:24:01 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:24:01 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:24:01 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:24:01 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:24:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:24:07 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:24:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:24:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:24:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:24:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:24:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:24:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:24:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:24:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:24:08 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:24:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:24:09 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:24:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 23:24:09 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:24:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 23:24:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99088 bits 12386 bytes 
Sat 18 Jan 2014 23:24:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:24:12 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:24:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:24:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:24:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:24:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:24:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:24:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:24:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:24:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43029403
Sat 18 Jan 2014 23:24:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:24:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43029403
Sat 18 Jan 2014 23:24:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:24:16 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:24:17 - job_xml_thread(): Done retrieving: data size 43029403
Sat 18 Jan 2014 23:24:17 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:24:17 - XML: Start document: iteration 7
Sat 18 Jan 2014 23:24:19 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:24:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 23:24:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:24:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:24:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:24:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:24:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:24:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:24:29 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:24:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:24:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:24:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:24:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:24:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:24:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:24:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:24:36 - XML: Processed 646740 elements - found 0 jobs
Sat 18 Jan 2014 23:24:36 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:24:36 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:24:36 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:24:36 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:24:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:24:39 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:24:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:24:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:24:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:24:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:24:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:24:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:24:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:24:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43360063
Sat 18 Jan 2014 23:24:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:24:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43360063
Sat 18 Jan 2014 23:24:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:24:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:24:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:24:51 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:24:51 - job_xml_thread(): Done retrieving: data size 43360063
Sat 18 Jan 2014 23:24:51 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:24:51 - XML: Start document: iteration 8
Sat 18 Jan 2014 23:24:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:24:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:24:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:24:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:24:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:24:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:24:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:24:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:24:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:24:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:24:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:25:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:25:02 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:25:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:25:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:25:03 - XML: Processed 651022 elements - found 0 jobs
Sat 18 Jan 2014 23:25:03 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:25:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:25:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:25:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:25:03 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:25:03 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:25:03 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:25:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:25:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:25:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43620325
Sat 18 Jan 2014 23:25:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:25:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43620325
Sat 18 Jan 2014 23:25:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:25:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:25:09 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:25:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:25:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 23:25:09 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:25:09 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:25:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 23:25:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9412 values 148527 bits 18565 bytes 
Sat 18 Jan 2014 23:25:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:25:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:25:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:25:14 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:25:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:25:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:25:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:25:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:25:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:25:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:25:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43620325
Sat 18 Jan 2014 23:25:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:25:18 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:25:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:25:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:25:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:25:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:25:25 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:25:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:25:29 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:25:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:25:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:25:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:25:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:25:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:25:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:25:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:25:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:25:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:25:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:25:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:25:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:25:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:25:33 - job_xml_thread(): Done retrieving: data size 43598622
Sat 18 Jan 2014 23:25:33 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:25:33 - XML: Start document: iteration 9
Sat 18 Jan 2014 23:25:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43598622
Sat 18 Jan 2014 23:25:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:25:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43598622
Sat 18 Jan 2014 23:25:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:25:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:25:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:25:45 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:25:45 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:25:45 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:25:45 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:25:45 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:25:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:25:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:25:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:25:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:25:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:25:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:25:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:25:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:25:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:25:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:25:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:25:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:25:56 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:25:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:25:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:25:56 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:25:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 23:25:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:25:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:25:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:25:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:25:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:25:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:25:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43634703
Sat 18 Jan 2014 23:25:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:26:00 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:26:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43634703
Sat 18 Jan 2014 23:26:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:26:01 - job_xml_thread(): Done retrieving: data size 43634703
Sat 18 Jan 2014 23:26:01 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:26:01 - XML: Start document: iteration 10
Sat 18 Jan 2014 23:26:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:26:09 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:26:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:26:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:26:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:26:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 23:26:11 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:26:11 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:26:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 23:26:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:26:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6044 values 95362 bits 11920 bytes 
Sat 18 Jan 2014 23:26:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:26:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:26:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:26:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:26:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:26:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:26:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:26:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:26:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:26:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:26:19 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:26:19 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:26:19 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:26:19 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:26:19 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:26:22 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 23:26:22 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 23:26:22 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:26:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:26:22 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:26:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:26:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:26:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:26:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:26:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:26:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:26:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:26:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43639916
Sat 18 Jan 2014 23:26:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:26:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43639916
Sat 18 Jan 2014 23:26:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:26:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:26:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:26:34 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:26:34 - job_xml_thread(): Done retrieving: data size 43639916
Sat 18 Jan 2014 23:26:34 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:26:35 - XML: Start document: iteration 11
Sat 18 Jan 2014 23:26:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:26:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:26:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:26:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:26:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:26:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:26:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:26:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:26:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:26:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:26:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:26:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:26:45 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:26:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:26:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:26:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:26:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:26:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:26:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:26:47 - XML: Processed 654193 elements - found 0 jobs
Sat 18 Jan 2014 23:26:47 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:26:47 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:26:47 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:26:47 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:26:48 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:26:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 23:26:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:26:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:26:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43629870
Sat 18 Jan 2014 23:26:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:26:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43629870
Sat 18 Jan 2014 23:26:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:26:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:26:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:26:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:26:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:26:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:26:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:26:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:26:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:26:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:26:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:26:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43629870
Sat 18 Jan 2014 23:26:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:27:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:27:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:27:02 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:27:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:27:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:27:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:27:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:27:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:27:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:27:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:27:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:27:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:27:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:27:11 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:27:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:27:12 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:27:12 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:27:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 23:27:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:27:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 23:27:12 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:27:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5673 values 89432 bits 11179 bytes 
Sat 18 Jan 2014 23:27:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:27:13 - job_xml_thread(): Done retrieving: data size 43618932
Sat 18 Jan 2014 23:27:13 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:27:13 - XML: Start document: iteration 12
Sat 18 Jan 2014 23:27:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43618932
Sat 18 Jan 2014 23:27:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:27:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:27:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:27:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:27:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:27:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:27:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:27:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43618932
Sat 18 Jan 2014 23:27:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:27:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:27:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:27:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:27:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:27:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:27:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:27:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:27:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:27:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:27:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:27:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:27:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:27:32 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:27:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:27:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:27:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:27:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:27:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:27:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:27:34 - XML: Processed 654195 elements - found 0 jobs
Sat 18 Jan 2014 23:27:34 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:27:34 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:27:34 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:27:34 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:27:37 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:27:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 23:27:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:27:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:27:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43621200
Sat 18 Jan 2014 23:27:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:27:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43621200
Sat 18 Jan 2014 23:27:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:27:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:27:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:27:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:27:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:27:49 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:27:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:27:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:27:50 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:27:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:27:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:27:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:27:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:27:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:27:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:27:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:27:53 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:27:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:27:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:27:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:27:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:27:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:27:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:27:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:27:55 - job_xml_thread(): Done retrieving: data size 43651371
Sat 18 Jan 2014 23:27:55 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:27:55 - XML: Start document: iteration 13
Sat 18 Jan 2014 23:27:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43651371
Sat 18 Jan 2014 23:27:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43651371
Sat 18 Jan 2014 23:27:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:27:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:28:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:28:07 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:28:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:28:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:28:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:28:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:28:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:28:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:28:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:28:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:28:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:28:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:28:12 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:28:14 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 23:28:14 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:28:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:28:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 23:28:14 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:28:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 23:28:14 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:28:14 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:28:14 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:28:14 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:28:14 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:28:14 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:28:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6922 values 109190 bits 13648 bytes 
Sat 18 Jan 2014 23:28:15 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:28:15 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 23:28:15 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 23:28:15 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:28:15 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 23:28:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:28:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:28:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:28:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:28:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:28:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:28:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:28:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:28:17 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 778791 values 12273100 bits 1534137 bytes 
Sat 18 Jan 2014 23:28:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:28:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:28:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:28:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43617290
Sat 18 Jan 2014 23:28:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:28:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43617290
Sat 18 Jan 2014 23:28:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:28:29 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:28:29 - job_xml_thread(): Done retrieving: data size 43617290
Sat 18 Jan 2014 23:28:29 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:28:29 - XML: Start document: iteration 14
Sat 18 Jan 2014 23:28:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:28:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:28:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:28:42 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:28:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:28:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:28:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:28:42 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:28:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:28:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:28:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:28:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:28:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:28:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:28:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:28:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:28:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:28:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:28:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:28:46 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:28:46 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:28:46 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:28:46 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:28:46 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:28:47 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:28:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 23:28:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:28:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:28:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43633645
Sat 18 Jan 2014 23:28:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:28:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43633645
Sat 18 Jan 2014 23:28:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:28:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:28:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:28:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:28:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:29:01 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:29:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:29:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:29:03 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:29:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:29:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:29:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:29:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:29:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:29:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:29:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:29:06 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:29:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:29:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:29:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:29:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:29:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:29:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:29:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:29:10 - job_xml_thread(): Done retrieving: data size 43640358
Sat 18 Jan 2014 23:29:10 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:29:10 - XML: Start document: iteration 15
Sat 18 Jan 2014 23:29:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43640358
Sat 18 Jan 2014 23:29:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:29:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43640358
Sat 18 Jan 2014 23:29:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:29:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:29:14 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:29:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:29:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 23:29:15 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:29:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 23:29:15 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:29:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8895 values 140231 bits 17528 bytes 
Sat 18 Jan 2014 23:29:15 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:29:15 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 23:29:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:29:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:29:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:29:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:29:25 - XML: Processed 654170 elements - found 0 jobs
Sat 18 Jan 2014 23:29:25 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:29:25 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:29:25 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:29:25 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:29:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:29:33 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:29:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:29:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:29:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:29:34 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:29:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:29:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:29:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:29:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:29:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:29:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:29:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:29:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:29:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:29:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:29:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:29:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:29:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43107839
Sat 18 Jan 2014 23:29:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:29:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43107839
Sat 18 Jan 2014 23:29:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:29:40 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:29:40 - job_xml_thread(): Done retrieving: data size 43107839
Sat 18 Jan 2014 23:29:40 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:29:40 - XML: Start document: iteration 16
Sat 18 Jan 2014 23:29:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:29:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:29:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:29:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:29:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:29:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:29:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:29:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:29:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:29:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:29:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:29:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:29:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:29:57 - XML: Processed 647512 elements - found 0 jobs
Sat 18 Jan 2014 23:29:57 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:29:57 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:29:57 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:29:57 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:29:57 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:29:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 23:29:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:30:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:30:00 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:30:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:30:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:30:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:30:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:30:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:30:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:30:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:30:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42967190
Sat 18 Jan 2014 23:30:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:30:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42967190
Sat 18 Jan 2014 23:30:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:30:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:30:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:30:12 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:30:12 - job_xml_thread(): Done retrieving: data size 42967190
Sat 18 Jan 2014 23:30:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:30:12 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:30:12 - XML: Start document: iteration 17
Sat 18 Jan 2014 23:30:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:30:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:30:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:30:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:30:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:30:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:30:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:30:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:30:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:30:15 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:30:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:30:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:30:16 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:30:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 23:30:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:30:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 23:30:17 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:30:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5810 values 91596 bits 11449 bytes 
Sat 18 Jan 2014 23:30:20 - XML: Processed 645996 elements - found 0 jobs
Sat 18 Jan 2014 23:30:20 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:30:20 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:30:20 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:30:20 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:30:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:30:24 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:30:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:30:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:30:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:30:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:30:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:30:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:30:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:30:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43076248
Sat 18 Jan 2014 23:30:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:30:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43076248
Sat 18 Jan 2014 23:30:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:30:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:30:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:30:35 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:30:36 - job_xml_thread(): Done retrieving: data size 43076248
Sat 18 Jan 2014 23:30:36 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:30:36 - XML: Start document: iteration 18
Sat 18 Jan 2014 23:30:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:30:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:30:42 - XML: Processed 647422 elements - found 0 jobs
Sat 18 Jan 2014 23:30:42 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:30:42 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:30:42 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:30:42 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:30:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:30:46 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:30:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:30:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:30:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:30:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:30:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:30:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:30:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:30:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:30:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:30:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:30:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:30:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:30:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:30:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:30:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:30:48 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:30:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 23:30:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:30:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:30:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43600531
Sat 18 Jan 2014 23:30:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:30:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43600531
Sat 18 Jan 2014 23:30:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:30:57 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:30:58 - job_xml_thread(): Done retrieving: data size 43600531
Sat 18 Jan 2014 23:30:58 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:30:58 - XML: Start document: iteration 19
Sat 18 Jan 2014 23:31:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:31:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:31:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:31:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:31:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:31:04 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:31:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:31:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:31:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:31:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:31:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:31:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:31:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:31:12 - XML: Processed 653776 elements - found 0 jobs
Sat 18 Jan 2014 23:31:12 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:31:12 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:31:12 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:31:12 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:31:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:31:14 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:31:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:31:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:31:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:31:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:31:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:31:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:31:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:31:17 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:31:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:31:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43606374
Sat 18 Jan 2014 23:31:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:31:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43606374
Sat 18 Jan 2014 23:31:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:31:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:31:18 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:31:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 23:31:18 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:31:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 23:31:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7936 values 125375 bits 15671 bytes 
Sat 18 Jan 2014 23:31:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:31:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:31:27 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:31:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:31:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:31:30 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:31:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:31:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:31:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:31:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:31:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:31:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:31:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:31:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:31:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:31:34 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:31:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:31:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:31:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:31:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:31:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:31:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:31:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:31:38 - job_xml_thread(): Done retrieving: data size 43611612
Sat 18 Jan 2014 23:31:38 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:31:38 - XML: Start document: iteration 20
Sat 18 Jan 2014 23:31:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43611612
Sat 18 Jan 2014 23:31:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:31:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43611612
Sat 18 Jan 2014 23:31:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:31:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:31:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:31:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:31:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:31:58 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:31:58 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:31:58 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:31:58 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:31:58 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:32:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:32:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:32:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:32:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:32:03 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:32:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:32:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:32:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:32:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:32:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:32:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:32:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:32:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:32:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:32:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:32:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:32:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:32:03 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:32:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 23:32:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:32:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:32:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43637980
Sat 18 Jan 2014 23:32:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:32:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43637980
Sat 18 Jan 2014 23:32:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:32:13 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:32:13 - job_xml_thread(): Done retrieving: data size 43637980
Sat 18 Jan 2014 23:32:13 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:32:13 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 23:32:14 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 23:32:14 - Housekeeping: done.
Sat 18 Jan 2014 23:32:14 - XML: Start document: iteration 0
Sat 18 Jan 2014 23:32:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:32:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:32:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:32:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:32:18 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:32:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:32:19 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:32:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 23:32:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:32:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 23:32:20 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:32:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5771 values 91189 bits 11398 bytes 
Sat 18 Jan 2014 23:32:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:32:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:32:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:32:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:32:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:32:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:32:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:32:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:32:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:32:28 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:32:28 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:32:28 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:32:28 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:32:28 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:32:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:32:30 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:32:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:32:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:32:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:32:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:32:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:32:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:32:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:32:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43631739
Sat 18 Jan 2014 23:32:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:32:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43631739
Sat 18 Jan 2014 23:32:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:32:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:32:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:32:43 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:32:43 - job_xml_thread(): Done retrieving: data size 43631739
Sat 18 Jan 2014 23:32:43 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:32:43 - XML: Start document: iteration 1
Sat 18 Jan 2014 23:32:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:32:45 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:32:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:32:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:32:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:32:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:32:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:32:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:32:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:32:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:32:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:32:52 - XML: Processed 654193 elements - found 0 jobs
Sat 18 Jan 2014 23:32:52 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:32:52 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:32:53 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:32:53 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:32:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:32:57 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:32:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:32:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:32:57 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:32:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 23:32:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:32:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:32:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:32:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:32:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:33:00 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 23:33:00 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 23:33:00 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:33:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:33:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43613862
Sat 18 Jan 2014 23:33:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:33:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43613862
Sat 18 Jan 2014 23:33:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:33:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:33:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:33:08 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:33:08 - job_xml_thread(): Done retrieving: data size 43613862
Sat 18 Jan 2014 23:33:08 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:33:08 - XML: Start document: iteration 2
Sat 18 Jan 2014 23:33:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:33:08 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:33:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:33:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:33:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:33:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:33:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:33:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:33:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:33:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:33:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:33:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:33:20 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:33:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:33:20 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:33:20 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:33:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:33:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 23:33:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 23:33:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:33:20 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:33:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:33:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5810 values 91837 bits 11479 bytes 
Sat 18 Jan 2014 23:33:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:33:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:33:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:33:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:33:21 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:33:21 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:33:21 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:33:21 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:33:21 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:33:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:33:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43615599
Sat 18 Jan 2014 23:33:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:33:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43615599
Sat 18 Jan 2014 23:33:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:33:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:33:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:33:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:33:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:33:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:33:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:33:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:33:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:33:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:33:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:33:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:33:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:33:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:33:36 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:33:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:33:39 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:33:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:33:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:33:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:33:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:33:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:33:39 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:33:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:33:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 23:33:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:33:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:33:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43640767
Sat 18 Jan 2014 23:33:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:33:44 - job_xml_thread(): Done retrieving: data size 43640767
Sat 18 Jan 2014 23:33:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43640767
Sat 18 Jan 2014 23:33:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:33:44 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:33:44 - XML: Start document: iteration 3
Sat 18 Jan 2014 23:33:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:33:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:33:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:33:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:34:01 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:34:01 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:34:02 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:34:02 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:34:02 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:34:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:34:03 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:34:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:34:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:34:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:34:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:34:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:34:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:34:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:34:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:34:06 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:34:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:34:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:34:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:34:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:34:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:34:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:34:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:34:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43645178
Sat 18 Jan 2014 23:34:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:34:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43645178
Sat 18 Jan 2014 23:34:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:34:17 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:34:17 - job_xml_thread(): Done retrieving: data size 43645178
Sat 18 Jan 2014 23:34:17 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:34:17 - XML: Start document: iteration 4
Sat 18 Jan 2014 23:34:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:34:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:34:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:34:20 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:34:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:34:22 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:34:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 23:34:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 23:34:22 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:34:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:34:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:34:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8701 values 137317 bits 17164 bytes 
Sat 18 Jan 2014 23:34:29 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:34:29 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:34:29 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:34:29 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:34:29 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:34:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:34:29 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:34:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:34:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:34:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:34:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:34:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:34:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:34:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:34:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:34:34 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:34:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:34:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:34:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:34:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:34:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:34:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:34:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:34:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43635213
Sat 18 Jan 2014 23:34:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:34:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43635213
Sat 18 Jan 2014 23:34:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:34:44 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:34:44 - job_xml_thread(): Done retrieving: data size 43635213
Sat 18 Jan 2014 23:34:44 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:34:44 - XML: Start document: iteration 5
Sat 18 Jan 2014 23:34:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:34:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:34:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:34:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:34:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:34:57 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:34:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:34:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:34:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:34:59 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:34:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:34:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:35:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:35:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:35:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:35:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:35:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:35:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:35:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:35:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:35:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:35:00 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:35:00 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:35:00 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:35:00 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:35:00 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:35:00 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:35:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 23:35:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:35:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:35:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43648904
Sat 18 Jan 2014 23:35:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:35:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43648904
Sat 18 Jan 2014 23:35:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:35:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:35:13 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:35:15 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:35:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:35:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:35:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:35:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:35:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:35:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:35:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:35:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:35:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:35:16 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 23:35:16 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:35:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:35:16 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:35:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:35:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:35:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:35:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:35:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:35:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:35:17 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:35:17 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:35:17 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 23:35:17 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 23:35:17 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 23:35:18 - size of cluster 'LISA Cluster': 624 hosts 79486 metrics 773800 values 12217361 bits 1527170 bytes 
Sat 18 Jan 2014 23:35:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:35:22 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:35:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:35:23 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:35:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 23:35:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 23:35:23 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:35:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5720 values 90173 bits 11271 bytes 
Sat 18 Jan 2014 23:35:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:35:25 - job_xml_thread(): Done retrieving: data size 43565705
Sat 18 Jan 2014 23:35:25 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:35:25 - XML: Start document: iteration 6
Sat 18 Jan 2014 23:35:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565705
Sat 18 Jan 2014 23:35:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565705
Sat 18 Jan 2014 23:35:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:35:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:35:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:35:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:35:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:35:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:35:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:35:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:35:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:35:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:35:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:35:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:35:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:35:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:35:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:35:44 - XML: Processed 653446 elements - found 0 jobs
Sat 18 Jan 2014 23:35:44 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:35:44 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:35:44 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:35:44 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:35:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:35:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:35:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:35:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:35:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:35:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:35:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:35:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:35:50 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:35:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 23:35:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:35:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:35:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43006947
Sat 18 Jan 2014 23:35:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:35:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43006947
Sat 18 Jan 2014 23:35:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:35:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:35:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:35:59 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:35:59 - job_xml_thread(): Done retrieving: data size 43006947
Sat 18 Jan 2014 23:36:00 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:36:00 - XML: Start document: iteration 7
Sat 18 Jan 2014 23:36:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:36:00 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:36:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:36:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:36:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:36:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:36:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:36:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43006947
Sat 18 Jan 2014 23:36:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:36:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:36:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:36:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:36:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:36:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:36:17 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:36:17 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 23:36:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:36:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:36:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:36:17 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:36:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:36:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:36:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:36:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:36:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:36:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:36:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:36:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:36:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:36:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:36:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:36:21 - XML: Processed 646722 elements - found 0 jobs
Sat 18 Jan 2014 23:36:21 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:36:21 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:36:21 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:36:21 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:36:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:36:23 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:36:24 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:36:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 23:36:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:36:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 23:36:24 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:36:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 4269 values 67296 bits 8412 bytes 
Sat 18 Jan 2014 23:36:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:36:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43047576
Sat 18 Jan 2014 23:36:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:36:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43047576
Sat 18 Jan 2014 23:36:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:36:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:36:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:36:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:36:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:36:36 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:36:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:36:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:36:37 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:36:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:36:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:36:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:36:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:36:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:36:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:36:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:36:41 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:36:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:36:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:36:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:36:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:36:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:36:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:36:46 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:36:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 23:36:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:36:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:36:46 - job_xml_thread(): Done retrieving: data size 43540634
Sat 18 Jan 2014 23:36:46 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:36:46 - XML: Start document: iteration 8
Sat 18 Jan 2014 23:36:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43540634
Sat 18 Jan 2014 23:36:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43540634
Sat 18 Jan 2014 23:36:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:36:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:36:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:36:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:36:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:36:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:36:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:36:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:36:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:36:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:37:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:37:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:37:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:37:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:37:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:37:05 - XML: Processed 653288 elements - found 0 jobs
Sat 18 Jan 2014 23:37:05 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:37:05 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:37:05 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:37:05 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:37:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:37:10 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:37:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:37:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:37:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:37:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:37:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:37:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:37:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:37:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43627470
Sat 18 Jan 2014 23:37:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:37:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43627470
Sat 18 Jan 2014 23:37:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:37:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:37:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:37:20 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:37:21 - job_xml_thread(): Done retrieving: data size 43627470
Sat 18 Jan 2014 23:37:21 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:37:21 - XML: Start document: iteration 9
Sat 18 Jan 2014 23:37:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:37:23 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:37:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:37:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:37:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:37:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:37:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:37:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:37:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:37:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:37:24 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:37:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:37:25 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:37:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 23:37:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 23:37:25 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:37:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6628 values 104516 bits 13064 bytes 
Sat 18 Jan 2014 23:37:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:37:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:37:32 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:37:32 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:37:32 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:37:32 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:37:32 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:37:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:37:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:37:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:37:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:37:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:37:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:37:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:37:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:37:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:37:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:37:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:37:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43614474
Sat 18 Jan 2014 23:37:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:37:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43614474
Sat 18 Jan 2014 23:37:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:37:47 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:37:47 - job_xml_thread(): Done retrieving: data size 43614474
Sat 18 Jan 2014 23:37:47 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:37:47 - XML: Start document: iteration 10
Sat 18 Jan 2014 23:37:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:37:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:37:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:37:59 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:37:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:37:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:37:59 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:37:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 23:37:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:37:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:37:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:38:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:38:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:38:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:38:01 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:38:01 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:38:01 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:38:01 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:38:01 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:38:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:38:04 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:38:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:38:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:38:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:38:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:38:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:38:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:38:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:38:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43630526
Sat 18 Jan 2014 23:38:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:38:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43630526
Sat 18 Jan 2014 23:38:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:38:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:38:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:38:16 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:38:16 - job_xml_thread(): Done retrieving: data size 43630526
Sat 18 Jan 2014 23:38:16 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:38:16 - XML: Start document: iteration 11
Sat 18 Jan 2014 23:38:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:38:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:38:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:38:20 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:38:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:38:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:38:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:38:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:38:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:38:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:38:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:38:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:38:25 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:38:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:38:26 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:38:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 23:38:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 23:38:26 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:38:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:38:27 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:38:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5958 values 93987 bits 11748 bytes 
Sat 18 Jan 2014 23:38:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:38:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:38:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:38:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:38:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:38:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:38:30 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:38:30 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:38:30 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:38:30 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:38:30 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:38:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:38:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43614597
Sat 18 Jan 2014 23:38:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:38:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43614597
Sat 18 Jan 2014 23:38:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:38:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:38:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:38:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:38:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:38:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:38:44 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:38:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:38:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:38:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:38:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:38:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:38:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:38:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:38:45 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:38:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:38:47 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:38:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:38:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:38:48 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:38:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 23:38:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:38:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:38:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:38:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:38:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:38:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:38:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43637113
Sat 18 Jan 2014 23:38:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:38:51 - job_xml_thread(): Done retrieving: data size 43637113
Sat 18 Jan 2014 23:38:51 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:38:51 - XML: Start document: iteration 12
Sat 18 Jan 2014 23:38:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43637113
Sat 18 Jan 2014 23:38:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:38:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:38:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:39:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:39:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:39:07 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:39:07 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:39:07 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:39:07 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:39:07 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:39:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:39:10 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:39:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:39:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:39:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:39:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:39:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:39:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:39:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:39:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:39:14 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:39:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:39:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:39:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:39:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:39:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:39:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:39:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:39:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43622496
Sat 18 Jan 2014 23:39:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:39:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43622496
Sat 18 Jan 2014 23:39:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:39:22 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:39:22 - job_xml_thread(): Done retrieving: data size 43622496
Sat 18 Jan 2014 23:39:22 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:39:22 - XML: Start document: iteration 13
Sat 18 Jan 2014 23:39:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:39:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:39:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:39:26 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:39:27 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:39:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 23:39:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:39:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 23:39:28 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:39:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8899 values 140329 bits 17541 bytes 
Sat 18 Jan 2014 23:39:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:39:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:39:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:39:33 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:39:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:39:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:39:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:39:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:39:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:39:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:39:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:39:36 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:39:36 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:39:36 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:39:36 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:39:36 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:39:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:39:41 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:39:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:39:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:39:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:39:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:39:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:39:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:39:46 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:39:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 23:39:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:39:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:39:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43617829
Sat 18 Jan 2014 23:39:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:39:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43617829
Sat 18 Jan 2014 23:39:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:39:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:39:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:39:51 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:39:51 - job_xml_thread(): Done retrieving: data size 43617829
Sat 18 Jan 2014 23:39:51 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:39:51 - XML: Start document: iteration 14
Sat 18 Jan 2014 23:39:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:39:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:40:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:40:00 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:40:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:40:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:40:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:40:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:40:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:40:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:40:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:40:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:40:07 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:40:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:40:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:40:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:40:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:40:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:40:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:40:09 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:40:09 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:40:09 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:40:09 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:40:09 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:40:11 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 23:40:11 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 23:40:11 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:40:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:40:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43629750
Sat 18 Jan 2014 23:40:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:40:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43629750
Sat 18 Jan 2014 23:40:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:40:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:40:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:40:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:40:20 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:40:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:40:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:40:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:40:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:40:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:40:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:40:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:40:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:40:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:40:24 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:40:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:40:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:40:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:40:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:40:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:40:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:40:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:40:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:40:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:40:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43643113
Sat 18 Jan 2014 23:40:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:40:27 - job_xml_thread(): Done retrieving: data size 43643113
Sat 18 Jan 2014 23:40:27 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:40:27 - XML: Start document: iteration 15
Sat 18 Jan 2014 23:40:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43643113
Sat 18 Jan 2014 23:40:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:40:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:40:29 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:40:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:40:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 23:40:30 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:40:30 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:40:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 23:40:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148570 bits 18571 bytes 
Sat 18 Jan 2014 23:40:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:40:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:40:40 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:40:40 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:40:40 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:40:40 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:40:40 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:40:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:40:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:40:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:40:45 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:40:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:40:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:40:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:40:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:40:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:40:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:40:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:40:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:40:49 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:40:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:40:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:40:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:40:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:40:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:40:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:40:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:40:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43634378
Sat 18 Jan 2014 23:40:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:40:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43634378
Sat 18 Jan 2014 23:40:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:40:55 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:40:56 - job_xml_thread(): Done retrieving: data size 43634378
Sat 18 Jan 2014 23:40:56 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:40:56 - XML: Start document: iteration 16
Sat 18 Jan 2014 23:41:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:41:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:41:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:41:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:41:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:41:06 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:41:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:41:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:41:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:41:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:41:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:41:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:41:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:41:11 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:41:11 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:41:11 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:41:11 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:41:11 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:41:12 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:41:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 23:41:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:41:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:41:14 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:41:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:41:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:41:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:41:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:41:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:41:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:41:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:41:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43545528
Sat 18 Jan 2014 23:41:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:41:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43545528
Sat 18 Jan 2014 23:41:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:41:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:41:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:41:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:41:26 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:41:26 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:41:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:41:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:41:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:41:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:41:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:41:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:41:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:41:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:41:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:41:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:41:30 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:41:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:41:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:41:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:41:32 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:41:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:41:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:41:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:41:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:41:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:41:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 23:41:33 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:41:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5952 values 93921 bits 11740 bytes 
Sat 18 Jan 2014 23:41:33 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:41:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 23:41:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:41:35 - job_xml_thread(): Done retrieving: data size 43188360
Sat 18 Jan 2014 23:41:35 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:41:35 - XML: Start document: iteration 17
Sat 18 Jan 2014 23:41:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43188360
Sat 18 Jan 2014 23:41:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43188360
Sat 18 Jan 2014 23:41:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:41:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:41:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:41:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:41:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:41:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:41:52 - XML: Processed 648896 elements - found 0 jobs
Sat 18 Jan 2014 23:41:52 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:41:52 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:41:52 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:41:52 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:41:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:41:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:41:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:41:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:41:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:41:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:41:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:41:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:41:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:41:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:41:58 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:41:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:41:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:41:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:41:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:41:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:41:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:41:59 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:41:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 23:41:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:42:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:42:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42966773
Sat 18 Jan 2014 23:42:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:42:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42966773
Sat 18 Jan 2014 23:42:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:42:08 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:42:08 - job_xml_thread(): Done retrieving: data size 42966773
Sat 18 Jan 2014 23:42:08 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:42:08 - XML: Start document: iteration 18
Sat 18 Jan 2014 23:42:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:42:10 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:42:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:42:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:42:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:42:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:42:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:42:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:42:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:42:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:42:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:42:17 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 23:42:17 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:42:19 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:42:19 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:42:19 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 23:42:19 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 23:42:19 - XML: Processed 645996 elements - found 0 jobs
Sat 18 Jan 2014 23:42:19 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:42:19 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 23:42:19 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:42:19 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:42:19 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:42:23 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 782775 values 12336725 bits 1542090 bytes 
Sat 18 Jan 2014 23:42:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:42:23 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:42:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:42:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:42:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:42:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:42:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:42:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:42:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:42:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43035056
Sat 18 Jan 2014 23:42:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:42:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43035056
Sat 18 Jan 2014 23:42:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:42:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:42:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:42:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:42:33 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:42:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:42:33 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:42:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 23:42:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 23:42:34 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:42:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8765 values 138258 bits 17282 bytes 
Sat 18 Jan 2014 23:42:34 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:42:34 - job_xml_thread(): Done retrieving: data size 43035056
Sat 18 Jan 2014 23:42:35 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:42:35 - XML: Start document: iteration 19
Sat 18 Jan 2014 23:42:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:42:38 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:42:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:42:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:42:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:42:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:42:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:42:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:42:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:42:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:42:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:42:47 - XML: Processed 646806 elements - found 0 jobs
Sat 18 Jan 2014 23:42:47 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:42:47 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:42:47 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:42:47 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:42:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:42:50 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:42:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:42:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:42:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:42:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:42:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:42:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:42:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:42:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:42:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:42:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564145
Sat 18 Jan 2014 23:42:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:42:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564145
Sat 18 Jan 2014 23:42:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:43:02 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:43:02 - job_xml_thread(): Done retrieving: data size 43564145
Sat 18 Jan 2014 23:43:02 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:43:02 - XML: Start document: iteration 20
Sat 18 Jan 2014 23:43:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:43:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:43:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:43:07 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:43:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:43:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:43:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:43:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:43:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:43:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:43:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:43:15 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:43:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 23:43:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:43:18 - XML: Processed 653668 elements - found 0 jobs
Sat 18 Jan 2014 23:43:18 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:43:18 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:43:18 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:43:18 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:43:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:43:19 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:43:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:43:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:43:19 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:43:19 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 23:43:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:43:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:43:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:43:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:43:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:43:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43601440
Sat 18 Jan 2014 23:43:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:43:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:43:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:43:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43601440
Sat 18 Jan 2014 23:43:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:43:33 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:43:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:43:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:43:33 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:43:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:43:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 23:43:34 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:43:34 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:43:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 23:43:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5831 values 91985 bits 11498 bytes 
Sat 18 Jan 2014 23:43:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:43:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:43:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:43:35 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:43:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:43:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:43:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:43:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:43:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:43:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:43:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:43:37 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:43:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:43:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:43:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:43:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:43:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:43:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:43:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:43:41 - job_xml_thread(): Done retrieving: data size 43635858
Sat 18 Jan 2014 23:43:41 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:43:41 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 23:43:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43635858
Sat 18 Jan 2014 23:43:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:43:42 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 23:43:42 - Housekeeping: done.
Sat 18 Jan 2014 23:43:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43635858
Sat 18 Jan 2014 23:43:43 - XML: Start document: iteration 0
Sat 18 Jan 2014 23:43:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:43:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:43:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:43:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:43:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:43:58 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:43:58 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:43:58 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:43:58 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:43:58 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:44:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:44:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:44:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:44:05 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:44:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:44:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:44:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:44:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:44:05 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:44:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 23:44:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:44:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:44:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:44:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:44:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:44:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:44:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:44:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:44:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:44:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:44:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:44:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43648050
Sat 18 Jan 2014 23:44:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:44:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43648050
Sat 18 Jan 2014 23:44:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:44:13 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:44:13 - job_xml_thread(): Done retrieving: data size 43648050
Sat 18 Jan 2014 23:44:13 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:44:13 - XML: Start document: iteration 1
Sat 18 Jan 2014 23:44:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:44:19 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:44:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:44:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:44:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:44:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:44:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:44:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:44:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:44:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:44:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:44:27 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:44:27 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:44:27 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:44:27 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:44:27 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:44:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:44:32 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:44:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:44:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:44:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:44:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:44:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:44:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:44:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:44:34 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:44:35 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:44:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:44:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 23:44:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 23:44:35 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:44:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5873 values 92626 bits 11578 bytes 
Sat 18 Jan 2014 23:44:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:44:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43607577
Sat 18 Jan 2014 23:44:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:44:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43607577
Sat 18 Jan 2014 23:44:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:44:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:44:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:44:42 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:44:42 - job_xml_thread(): Done retrieving: data size 43607577
Sat 18 Jan 2014 23:44:42 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:44:42 - XML: Start document: iteration 2
Sat 18 Jan 2014 23:44:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:44:44 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:44:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:44:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:44:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:44:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:44:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43607577
Sat 18 Jan 2014 23:44:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:44:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:44:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:44:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:44:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:44:54 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:44:54 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:44:54 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:44:54 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:44:54 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:45:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:45:00 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:45:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:45:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:45:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:45:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:45:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:45:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:45:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:45:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:45:05 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:45:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:45:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:45:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:45:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:45:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:45:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:45:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:45:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43638787
Sat 18 Jan 2014 23:45:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:45:09 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:45:09 - job_xml_thread(): Done retrieving: data size 43638787
Sat 18 Jan 2014 23:45:09 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:45:09 - XML: Start document: iteration 3
Sat 18 Jan 2014 23:45:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43638787
Sat 18 Jan 2014 23:45:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:45:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:45:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:45:18 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:45:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 23:45:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:45:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:45:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:45:24 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:45:24 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:45:24 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:45:24 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:45:24 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:45:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:45:27 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:45:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:45:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:45:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:45:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:45:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:45:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:45:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:45:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:45:31 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:45:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:45:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:45:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:45:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:45:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:45:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:45:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:45:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43635080
Sat 18 Jan 2014 23:45:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:45:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:45:35 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:45:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43635080
Sat 18 Jan 2014 23:45:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:45:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:45:36 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:45:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 23:45:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 23:45:36 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:45:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6514 values 102742 bits 12842 bytes 
Sat 18 Jan 2014 23:45:39 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:45:39 - job_xml_thread(): Done retrieving: data size 43635080
Sat 18 Jan 2014 23:45:39 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:45:39 - XML: Start document: iteration 4
Sat 18 Jan 2014 23:45:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:45:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:45:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:45:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:45:50 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:45:50 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:45:50 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:45:50 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:45:50 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:45:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:45:53 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:45:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:45:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:45:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:45:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:45:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:45:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:45:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:45:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:45:56 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:45:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:45:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:45:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:45:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:45:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:45:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:45:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:45:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43637206
Sat 18 Jan 2014 23:45:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:45:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43637206
Sat 18 Jan 2014 23:45:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:46:03 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:46:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 23:46:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:46:05 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:46:05 - job_xml_thread(): Done retrieving: data size 43637206
Sat 18 Jan 2014 23:46:05 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:46:05 - XML: Start document: iteration 5
Sat 18 Jan 2014 23:46:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:46:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:46:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:46:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:46:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:46:16 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:46:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:46:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:46:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:46:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:46:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:46:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:46:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:46:20 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:46:20 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:46:20 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:46:20 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:46:20 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:46:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:46:22 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:46:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:46:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:46:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:46:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:46:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:46:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:46:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:46:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43639162
Sat 18 Jan 2014 23:46:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:46:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43639162
Sat 18 Jan 2014 23:46:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:46:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:46:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:46:35 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:46:35 - job_xml_thread(): Done retrieving: data size 43639162
Sat 18 Jan 2014 23:46:35 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:46:35 - XML: Start document: iteration 6
Sat 18 Jan 2014 23:46:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:46:36 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:46:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:46:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 23:46:37 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:46:37 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:46:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 23:46:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6231 values 98439 bits 12304 bytes 
Sat 18 Jan 2014 23:46:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:46:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:46:46 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:46:46 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:46:46 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:46:46 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:46:46 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:46:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:46:49 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:46:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:46:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:46:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:46:49 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:46:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:46:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:46:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:46:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:46:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:46:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:46:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:46:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:46:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:46:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:46:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:46:53 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:46:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 23:46:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:46:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:46:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43658862
Sat 18 Jan 2014 23:46:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:46:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43658862
Sat 18 Jan 2014 23:46:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:47:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:47:01 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:47:01 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:47:01 - job_xml_thread(): Done retrieving: data size 43658862
Sat 18 Jan 2014 23:47:01 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:47:01 - XML: Start document: iteration 7
Sat 18 Jan 2014 23:47:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:47:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:47:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:47:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:47:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:47:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:47:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:47:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:47:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:47:07 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:47:07 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:47:07 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:47:07 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:47:07 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:47:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:47:12 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:47:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:47:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:47:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:47:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:47:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:47:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:47:14 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 23:47:14 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 23:47:14 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:47:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:47:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557277
Sat 18 Jan 2014 23:47:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:47:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557277
Sat 18 Jan 2014 23:47:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:47:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:47:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:47:22 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:47:22 - job_xml_thread(): Done retrieving: data size 43557277
Sat 18 Jan 2014 23:47:22 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:47:22 - XML: Start document: iteration 8
Sat 18 Jan 2014 23:47:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:47:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:47:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:47:31 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:47:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:47:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:47:32 - XML: Processed 653444 elements - found 0 jobs
Sat 18 Jan 2014 23:47:32 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:47:32 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:47:32 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:47:32 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:47:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:47:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:47:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:47:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:47:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:47:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:47:36 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:47:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:47:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:47:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:47:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:47:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:47:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:47:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:47:37 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:47:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:47:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43088869
Sat 18 Jan 2014 23:47:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:47:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43088869
Sat 18 Jan 2014 23:47:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:47:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:47:38 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:47:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 23:47:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 23:47:39 - Entering storeMetrics(): cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sat 18 Jan 2014 23:47:47 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:47:47 - job_xml_thread(): Done retrieving: data size 43088869
Sat 18 Jan 2014 23:47:47 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:47:47 - XML: Start document: iteration 9
Sat 18 Jan 2014 23:47:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:47:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:47:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:47:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:47:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:47:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:47:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:47:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:47:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:47:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:47:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:47:57 - XML: Processed 647352 elements - found 0 jobs
Sat 18 Jan 2014 23:47:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:47:57 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:47:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:47:57 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:47:57 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:47:57 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:47:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:47:59 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:47:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:47:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:47:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:47:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:47:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:47:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:48:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:48:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42966399
Sat 18 Jan 2014 23:48:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:48:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42966399
Sat 18 Jan 2014 23:48:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:48:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:48:12 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:48:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:48:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:48:13 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:48:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:48:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:48:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:48:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:48:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:48:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:48:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:48:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:48:15 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:48:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:48:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:48:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:48:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:48:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:48:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:48:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:48:20 - job_xml_thread(): Done retrieving: data size 43039143
Sat 18 Jan 2014 23:48:20 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:48:20 - XML: Start document: iteration 10
Sat 18 Jan 2014 23:48:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43039143
Sat 18 Jan 2014 23:48:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:48:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43039143
Sat 18 Jan 2014 23:48:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:48:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:48:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:48:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:48:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:48:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:48:39 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:48:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:48:41 - XML: Processed 646746 elements - found 0 jobs
Sat 18 Jan 2014 23:48:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 23:48:41 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:48:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 15700 values 248393 bits 31049 bytes 
Sat 18 Jan 2014 23:48:41 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:48:41 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:48:41 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:48:41 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:48:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 23:48:41 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:48:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:48:42 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:48:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:48:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:48:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:48:43 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:48:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:48:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:48:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:48:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:48:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:48:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:48:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:48:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:48:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:48:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:48:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:48:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:48:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581478
Sat 18 Jan 2014 23:48:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:48:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581478
Sat 18 Jan 2014 23:48:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:48:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:48:55 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:48:56 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:48:56 - job_xml_thread(): Done retrieving: data size 43581478
Sat 18 Jan 2014 23:48:56 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:48:56 - XML: Start document: iteration 11
Sat 18 Jan 2014 23:48:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:48:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:48:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:48:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:48:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:48:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:48:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:48:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:49:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:49:05 - XML: Processed 653560 elements - found 0 jobs
Sat 18 Jan 2014 23:49:05 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:49:05 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:49:05 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:49:05 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:49:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:49:08 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:49:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:49:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:49:08 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:49:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 23:49:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:49:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:49:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:49:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:49:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:49:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:49:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43628515
Sat 18 Jan 2014 23:49:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:49:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43628515
Sat 18 Jan 2014 23:49:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:49:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:49:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:49:19 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 23:49:20 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:49:20 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:49:20 - job_xml_thread(): Done retrieving: data size 43628515
Sat 18 Jan 2014 23:49:20 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:49:20 - XML: Start document: iteration 12
Sat 18 Jan 2014 23:49:22 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:49:22 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 23:49:22 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 23:49:22 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:49:22 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 23:49:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:49:22 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:49:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:49:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:49:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:49:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:49:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:49:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:49:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:49:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:49:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:49:26 - size of cluster 'LISA Cluster': 624 hosts 79478 metrics 744582 values 11759039 bits 1469879 bytes 
Sat 18 Jan 2014 23:49:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:49:31 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:49:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:49:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:49:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:49:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:49:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:49:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:49:34 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:49:34 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:49:34 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:49:34 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:49:34 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:49:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:49:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43609067
Sat 18 Jan 2014 23:49:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:49:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43609067
Sat 18 Jan 2014 23:49:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:49:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:49:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:49:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:49:41 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:49:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:49:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 23:49:41 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:49:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 23:49:41 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:49:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8862 values 139820 bits 17477 bytes 
Sat 18 Jan 2014 23:49:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:49:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:49:49 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:49:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:49:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:49:50 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:49:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:49:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:49:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:49:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:49:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:49:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:49:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:49:53 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:49:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:49:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:49:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:49:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:49:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:49:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:49:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:49:57 - job_xml_thread(): Done retrieving: data size 43638524
Sat 18 Jan 2014 23:49:57 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:49:57 - XML: Start document: iteration 13
Sat 18 Jan 2014 23:49:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43638524
Sat 18 Jan 2014 23:49:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:49:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43638524
Sat 18 Jan 2014 23:49:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:50:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:50:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:50:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:50:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:50:12 - XML: Processed 654194 elements - found 0 jobs
Sat 18 Jan 2014 23:50:12 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:50:12 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:50:12 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:50:12 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:50:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:50:13 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:50:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:50:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:50:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:50:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:50:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:50:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:50:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:50:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:50:18 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:50:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:50:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:50:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:50:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:50:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:50:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:50:20 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:50:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 23:50:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:50:22 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:50:22 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 23:50:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:50:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43629804
Sat 18 Jan 2014 23:50:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:50:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43629804
Sat 18 Jan 2014 23:50:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:50:29 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:50:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:50:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:50:29 - job_xml_thread(): Done retrieving: data size 43629804
Sat 18 Jan 2014 23:50:29 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:50:29 - XML: Start document: iteration 14
Sat 18 Jan 2014 23:50:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:50:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:50:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:50:42 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:50:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:50:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:50:43 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:50:43 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:50:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 23:50:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 23:50:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:50:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:50:43 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:50:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5588 values 88127 bits 11015 bytes 
Sat 18 Jan 2014 23:50:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:50:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:50:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:50:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:50:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:50:48 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:50:48 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:50:48 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:50:48 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:50:48 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:50:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:50:50 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:50:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:50:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:50:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:50:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:50:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:50:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:50:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:50:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43636736
Sat 18 Jan 2014 23:50:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:50:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43636736
Sat 18 Jan 2014 23:50:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:51:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:51:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:51:04 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:51:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:51:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:51:05 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:51:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:51:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:51:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:51:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:51:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:51:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:51:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:51:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:51:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:51:09 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:51:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:51:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:51:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:51:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:51:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:51:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:51:10 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:51:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 23:51:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:51:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:51:12 - job_xml_thread(): Done retrieving: data size 43638186
Sat 18 Jan 2014 23:51:12 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:51:12 - XML: Start document: iteration 15
Sat 18 Jan 2014 23:51:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43638186
Sat 18 Jan 2014 23:51:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:51:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43638186
Sat 18 Jan 2014 23:51:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:51:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:51:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:51:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:51:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:51:30 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:51:30 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:51:31 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:51:31 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:51:31 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:51:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:51:33 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:51:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:51:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:51:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:51:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:51:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:51:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:51:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:51:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:51:35 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:51:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:51:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:51:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:51:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:51:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:51:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:51:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:51:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43657173
Sat 18 Jan 2014 23:51:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:51:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43657173
Sat 18 Jan 2014 23:51:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:51:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:51:43 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:51:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:51:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 23:51:46 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:51:46 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:51:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 23:51:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8893 values 140285 bits 17535 bytes 
Sat 18 Jan 2014 23:51:46 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:51:46 - job_xml_thread(): Done retrieving: data size 43657173
Sat 18 Jan 2014 23:51:46 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:51:46 - XML: Start document: iteration 16
Sat 18 Jan 2014 23:51:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:51:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:51:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:51:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:51:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:51:54 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:51:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:51:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:51:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:51:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:51:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:51:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:51:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:52:03 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:52:03 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:52:03 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:52:03 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:52:03 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:52:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:52:03 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:52:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:52:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:52:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:52:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:52:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:52:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:52:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:52:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43626128
Sat 18 Jan 2014 23:52:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:52:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43626128
Sat 18 Jan 2014 23:52:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:52:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:52:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:52:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:52:17 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:52:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:52:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:52:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:52:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:52:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:52:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43626128
Sat 18 Jan 2014 23:52:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:52:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:52:18 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:52:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:52:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:52:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:52:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:52:28 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:52:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:52:30 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:52:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:52:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:52:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:52:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:52:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:52:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:52:30 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:52:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 23:52:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:52:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:52:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:52:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:52:33 - job_xml_thread(): Done retrieving: data size 43602153
Sat 18 Jan 2014 23:52:33 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:52:33 - XML: Start document: iteration 17
Sat 18 Jan 2014 23:52:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:52:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:52:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:52:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:52:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43602153
Sat 18 Jan 2014 23:52:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:52:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43602153
Sat 18 Jan 2014 23:52:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:52:42 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:52:42 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:52:42 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:52:42 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:52:42 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:52:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:52:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:52:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:52:46 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:52:46 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:52:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 23:52:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:52:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 23:52:46 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:52:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5920 values 93425 bits 11678 bytes 
Sat 18 Jan 2014 23:52:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:52:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:52:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:52:53 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:52:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:52:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:52:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:52:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:52:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:52:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:52:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:52:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:52:56 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:52:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:52:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:52:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:52:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:52:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:52:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:52:57 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:53:00 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:53:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 23:53:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:53:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:53:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43629626
Sat 18 Jan 2014 23:53:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:53:01 - job_xml_thread(): Done retrieving: data size 43629626
Sat 18 Jan 2014 23:53:01 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:53:01 - XML: Start document: iteration 18
Sat 18 Jan 2014 23:53:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43629626
Sat 18 Jan 2014 23:53:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:53:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:53:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:53:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:53:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:53:15 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:53:15 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:53:15 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:53:15 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:53:15 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:53:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:53:19 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:53:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:53:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:53:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:53:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:53:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:53:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:53:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:53:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:53:25 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:53:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:53:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:53:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:53:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:53:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:53:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:53:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:53:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566293
Sat 18 Jan 2014 23:53:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:53:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566293
Sat 18 Jan 2014 23:53:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:53:30 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:53:30 - job_xml_thread(): Done retrieving: data size 43566293
Sat 18 Jan 2014 23:53:30 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:53:30 - XML: Start document: iteration 19
Sat 18 Jan 2014 23:53:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:53:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:53:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:53:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:53:42 - XML: Processed 653446 elements - found 0 jobs
Sat 18 Jan 2014 23:53:42 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:53:42 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:53:42 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:53:42 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:53:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:53:45 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:53:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:53:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:53:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:53:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:53:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:53:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:53:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:53:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:53:46 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:53:47 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:53:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 23:53:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:53:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 23:53:47 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:53:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99120 bits 12390 bytes 
Sat 18 Jan 2014 23:53:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:53:51 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:53:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:53:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:53:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:53:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:53:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:53:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:53:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:53:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43008185
Sat 18 Jan 2014 23:53:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:53:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43008185
Sat 18 Jan 2014 23:53:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:53:58 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:53:58 - job_xml_thread(): Done retrieving: data size 43008185
Sat 18 Jan 2014 23:53:58 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:53:58 - XML: Start document: iteration 20
Sat 18 Jan 2014 23:54:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:54:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:54:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:54:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:54:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:54:14 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:54:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:54:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:54:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:54:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:54:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:54:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:54:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:54:17 - XML: Processed 646342 elements - found 0 jobs
Sat 18 Jan 2014 23:54:17 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:54:17 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:54:17 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:54:17 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:54:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:54:18 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:54:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:54:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:54:19 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:54:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 23:54:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:54:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:54:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:54:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:54:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:54:19 - Leaving storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 23:54:19 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sat 18 Jan 2014 23:54:19 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:54:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:54:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43044028
Sat 18 Jan 2014 23:54:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:54:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43044028
Sat 18 Jan 2014 23:54:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:54:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:54:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:54:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:54:31 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:54:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:54:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:54:32 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:54:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:54:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:54:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:54:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:54:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:54:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:54:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:54:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:54:34 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:54:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:54:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:54:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:54:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:54:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:54:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:54:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:54:37 - job_xml_thread(): Done retrieving: data size 43169962
Sat 18 Jan 2014 23:54:37 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:54:37 - Housekeeping: checking database for timed out jobs..
Sat 18 Jan 2014 23:54:37 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sat 18 Jan 2014 23:54:37 - Housekeeping: done.
Sat 18 Jan 2014 23:54:37 - XML: Start document: iteration 0
Sat 18 Jan 2014 23:54:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43169962
Sat 18 Jan 2014 23:54:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43169962
Sat 18 Jan 2014 23:54:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:54:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:54:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:54:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:54:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:54:48 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:54:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:54:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 23:54:49 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:54:49 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:54:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 23:54:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8467 values 133484 bits 16685 bytes 
Sat 18 Jan 2014 23:54:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:54:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:54:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:54:51 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:54:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:54:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:54:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:54:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:54:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:54:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:54:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:54:58 - XML: Processed 648160 elements - found 0 jobs
Sat 18 Jan 2014 23:54:58 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:54:58 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:54:58 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:54:58 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:55:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:55:01 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:55:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:55:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:55:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:55:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:55:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:55:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:55:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:55:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43611927
Sat 18 Jan 2014 23:55:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:55:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43611927
Sat 18 Jan 2014 23:55:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:55:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:55:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:55:13 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:55:13 - job_xml_thread(): Done retrieving: data size 43611927
Sat 18 Jan 2014 23:55:14 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:55:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:55:14 - XML: Start document: iteration 1
Sat 18 Jan 2014 23:55:14 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:55:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:55:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:55:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:55:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:55:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:55:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:55:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:55:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:55:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:55:23 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:55:23 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:55:23 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:55:23 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:55:23 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:55:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:55:27 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:55:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:55:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:55:27 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:55:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 23:55:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:55:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:55:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:55:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:55:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:55:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:55:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43592698
Sat 18 Jan 2014 23:55:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:55:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43592698
Sat 18 Jan 2014 23:55:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:55:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:55:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:55:38 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:55:38 - job_xml_thread(): Done retrieving: data size 43592698
Sat 18 Jan 2014 23:55:38 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:55:38 - XML: Start document: iteration 2
Sat 18 Jan 2014 23:55:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:55:42 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:55:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:55:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:55:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:55:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:55:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:55:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:55:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:55:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:55:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:55:49 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:55:49 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:55:49 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:55:49 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:55:49 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:55:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:55:49 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:55:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:55:49 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:55:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 23:55:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 23:55:49 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:55:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5857 values 92385 bits 11548 bytes 
Sat 18 Jan 2014 23:55:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:55:52 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:55:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:55:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:55:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:55:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:55:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:55:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:55:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:55:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43625805
Sat 18 Jan 2014 23:55:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:55:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43625805
Sat 18 Jan 2014 23:55:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:55:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:55:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:56:04 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:56:04 - job_xml_thread(): Done retrieving: data size 43625805
Sat 18 Jan 2014 23:56:04 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:56:04 - XML: Start document: iteration 3
Sat 18 Jan 2014 23:56:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:56:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:56:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:56:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:56:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:56:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:56:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:56:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:56:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:56:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:56:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:56:16 - XML: Processed 654193 elements - found 0 jobs
Sat 18 Jan 2014 23:56:16 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:56:16 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:56:16 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:56:16 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:56:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:56:18 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:56:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:56:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:56:18 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:56:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 23:56:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:56:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:56:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:56:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:56:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:56:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:56:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43624821
Sat 18 Jan 2014 23:56:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:56:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43624821
Sat 18 Jan 2014 23:56:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:56:23 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sat 18 Jan 2014 23:56:24 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:56:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:56:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:56:26 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:56:26 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:56:26 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 23:56:26 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 23:56:26 - Entering storeMetrics(): cluster LISA Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sat 18 Jan 2014 23:56:32 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:56:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:56:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:56:33 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:56:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:56:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:56:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:56:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:56:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:56:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:56:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:56:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:56:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:56:37 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:56:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:56:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:56:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:56:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:56:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:56:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:56:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:56:41 - job_xml_thread(): Done retrieving: data size 43648849
Sat 18 Jan 2014 23:56:41 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:56:41 - XML: Start document: iteration 4
Sat 18 Jan 2014 23:56:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43648849
Sat 18 Jan 2014 23:56:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43648849
Sat 18 Jan 2014 23:56:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:56:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:56:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:56:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:56:49 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:56:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:56:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:56:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 23:56:51 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:56:51 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:56:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 23:56:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8852 values 139562 bits 17445 bytes 
Sat 18 Jan 2014 23:56:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:56:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:56:54 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:56:54 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:56:55 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:56:55 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:56:55 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:56:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:56:58 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:56:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:56:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:56:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:56:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:56:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:56:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:56:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:57:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:57:02 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:57:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:57:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:57:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:57:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:57:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:57:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:57:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:57:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43647975
Sat 18 Jan 2014 23:57:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:57:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43647975
Sat 18 Jan 2014 23:57:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:57:10 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:57:10 - job_xml_thread(): Done retrieving: data size 43647975
Sat 18 Jan 2014 23:57:10 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:57:10 - XML: Start document: iteration 5
Sat 18 Jan 2014 23:57:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:57:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:57:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:57:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:57:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:57:19 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:57:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:57:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:57:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:57:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:57:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:57:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:57:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:57:24 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:57:24 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:57:24 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:57:24 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:57:24 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:57:26 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:57:26 - ganglia_store_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:57:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:57:26 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:57:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:57:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:57:27 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:57:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 23:57:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:57:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:57:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:57:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:57:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:57:27 - ganglia_store_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:57:27 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:57:27 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sat 18 Jan 2014 23:57:27 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sat 18 Jan 2014 23:57:27 - Entering storeMetrics(): cluster LISA Cluster
Sat 18 Jan 2014 23:57:28 - size of cluster 'LISA Cluster': 624 hosts 79480 metrics 820322 values 12930625 bits 1616328 bytes 
Sat 18 Jan 2014 23:57:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:57:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43625344
Sat 18 Jan 2014 23:57:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:57:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43625344
Sat 18 Jan 2014 23:57:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:57:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:57:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:57:40 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:57:40 - job_xml_thread(): Done retrieving: data size 43625344
Sat 18 Jan 2014 23:57:40 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:57:41 - XML: Start document: iteration 6
Sat 18 Jan 2014 23:57:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:57:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:57:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:57:43 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:57:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:57:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:57:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:57:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:57:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:57:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:57:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:57:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:57:50 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:57:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:57:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:57:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:57:51 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:57:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:57:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 23:57:51 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:57:51 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:57:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:57:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:57:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:57:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 23:57:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:57:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5904 values 93175 bits 11646 bytes 
Sat 18 Jan 2014 23:57:54 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:57:54 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:57:54 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:57:54 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:57:54 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:57:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:57:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43618626
Sat 18 Jan 2014 23:57:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:57:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:57:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:57:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43618626
Sat 18 Jan 2014 23:57:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:58:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:58:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:58:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:58:09 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:58:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:58:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:58:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:58:09 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:58:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:58:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:58:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:58:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:58:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:58:14 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:58:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:58:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:58:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:58:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:58:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:58:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:58:15 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:58:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 23:58:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:58:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:58:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43624214
Sat 18 Jan 2014 23:58:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:58:19 - job_xml_thread(): Done retrieving: data size 43624214
Sat 18 Jan 2014 23:58:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43624214
Sat 18 Jan 2014 23:58:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:58:19 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:58:19 - XML: Start document: iteration 7
Sat 18 Jan 2014 23:58:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:58:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:58:27 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:58:27 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sat 18 Jan 2014 23:58:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:58:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:58:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:58:41 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:58:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:58:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:58:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:58:41 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:58:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:58:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:58:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:58:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:58:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:58:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:58:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:58:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:58:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:58:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:58:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:58:43 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:58:43 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:58:43 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:58:43 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:58:43 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:58:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:58:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43637031
Sat 18 Jan 2014 23:58:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:58:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43637031
Sat 18 Jan 2014 23:58:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:58:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:58:51 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:58:52 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:58:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 23:58:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:58:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 23:58:53 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:58:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8712 values 137406 bits 17175 bytes 
Sat 18 Jan 2014 23:58:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:58:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:58:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:58:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:58:58 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:58:58 - job_xml_thread(): Done retrieving: data size 43637031
Sat 18 Jan 2014 23:58:58 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:58:58 - XML: Start document: iteration 8
Sat 18 Jan 2014 23:59:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:59:07 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:59:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:59:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:59:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:59:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:59:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:59:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:59:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:59:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:59:11 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:59:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:59:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:59:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:59:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:59:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:59:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:59:12 - XML: Processed 654196 elements - found 0 jobs
Sat 18 Jan 2014 23:59:12 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:59:12 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:59:12 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:59:12 - job_xml_thread(): Sleeping.. (15s)
Sat 18 Jan 2014 23:59:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:59:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43548659
Sat 18 Jan 2014 23:59:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:59:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43548659
Sat 18 Jan 2014 23:59:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:59:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:59:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:59:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:59:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:59:28 - job_xml_thread(): Retrieving XML data..
Sat 18 Jan 2014 23:59:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:59:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:59:29 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:59:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:59:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:59:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:59:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:59:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:59:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:59:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sat 18 Jan 2014 23:59:33 - ganglia_parse_thread(): finished: LISA Cluster
Sat 18 Jan 2014 23:59:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sat 18 Jan 2014 23:59:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sat 18 Jan 2014 23:59:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:59:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sat 18 Jan 2014 23:59:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sat 18 Jan 2014 23:59:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sat 18 Jan 2014 23:59:33 - Leaving storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:59:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sat 18 Jan 2014 23:59:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:59:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sat 18 Jan 2014 23:59:36 - job_xml_thread(): Done retrieving: data size 43146007
Sat 18 Jan 2014 23:59:36 - job_xml_thread(): Parsing XML..
Sat 18 Jan 2014 23:59:36 - XML: Start document: iteration 9
Sat 18 Jan 2014 23:59:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43146007
Sat 18 Jan 2014 23:59:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43146007
Sat 18 Jan 2014 23:59:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sat 18 Jan 2014 23:59:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sat 18 Jan 2014 23:59:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:59:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:59:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sat 18 Jan 2014 23:59:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sat 18 Jan 2014 23:59:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sat 18 Jan 2014 23:59:49 - ganglia_parse_thread(): finished: Render Cluster
Sat 18 Jan 2014 23:59:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sat 18 Jan 2014 23:59:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:59:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:59:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sat 18 Jan 2014 23:59:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:59:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sat 18 Jan 2014 23:59:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sat 18 Jan 2014 23:59:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sat 18 Jan 2014 23:59:53 - ganglia_store_thread(): finished: cluster Render Cluster
Sat 18 Jan 2014 23:59:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:59:54 - ganglia_store_thread(): started: cluster Render Cluster
Sat 18 Jan 2014 23:59:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sat 18 Jan 2014 23:59:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sat 18 Jan 2014 23:59:54 - Entering storeMetrics(): cluster Render Cluster
Sat 18 Jan 2014 23:59:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5884 values 92792 bits 11599 bytes 
Sat 18 Jan 2014 23:59:56 - XML: Processed 648322 elements - found 0 jobs
Sat 18 Jan 2014 23:59:56 - job_xml_thread(): Found 0 updated jobs.
Sat 18 Jan 2014 23:59:56 - job_xml_thread(): No jobs to store.
Sat 18 Jan 2014 23:59:56 - job_xml_thread(): Done parsing.
Sat 18 Jan 2014 23:59:56 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:00:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:00:01 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:00:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:00:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:00:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:00:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:00:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:00:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:00:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:00:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42944642
Sun 19 Jan 2014 00:00:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:00:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:00:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:00:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42944642
Sun 19 Jan 2014 00:00:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:00:11 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:00:11 - job_xml_thread(): Done retrieving: data size 42944642
Sun 19 Jan 2014 00:00:11 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:00:11 - XML: Start document: iteration 10
Sun 19 Jan 2014 00:00:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:00:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:00:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:00:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:00:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:00:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:00:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:00:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:00:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:00:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:00:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:00:24 - XML: Processed 646096 elements - found 0 jobs
Sun 19 Jan 2014 00:00:24 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:00:25 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:00:25 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:00:25 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:00:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:00:27 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:00:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:00:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:00:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:00:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:00:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:00:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:00:28 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:00:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 00:00:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:00:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:00:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43168911
Sun 19 Jan 2014 00:00:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:00:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43168911
Sun 19 Jan 2014 00:00:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:00:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:00:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:00:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:00:39 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:00:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:00:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:00:40 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:00:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:00:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:00:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:00:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:00:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:00:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:00:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:00:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:00:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:00:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:00:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:00:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:00:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:00:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:00:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:00:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:00:48 - job_xml_thread(): Done retrieving: data size 43550659
Sun 19 Jan 2014 00:00:48 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:00:48 - XML: Start document: iteration 11
Sun 19 Jan 2014 00:00:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43550659
Sun 19 Jan 2014 00:00:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:00:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43550659
Sun 19 Jan 2014 00:00:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:00:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:00:54 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:00:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:00:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:00:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 00:00:57 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:00:57 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:00:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8443 values 133107 bits 16638 bytes 
Sun 19 Jan 2014 00:00:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 00:00:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:00:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:01:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:01:02 - XML: Processed 653408 elements - found 0 jobs
Sun 19 Jan 2014 00:01:02 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:01:02 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:01:02 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:01:02 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:01:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:01:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:01:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:01:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:01:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:01:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:01:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:01:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:01:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:01:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:01:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:01:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:01:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:01:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:01:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:01:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:01:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:01:11 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 00:01:11 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 00:01:11 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:01:13 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:01:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 00:01:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:01:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:01:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43640350
Sun 19 Jan 2014 00:01:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:01:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43640350
Sun 19 Jan 2014 00:01:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:01:18 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:01:18 - job_xml_thread(): Done retrieving: data size 43640350
Sun 19 Jan 2014 00:01:18 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:01:18 - XML: Start document: iteration 12
Sun 19 Jan 2014 00:01:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:01:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:01:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:01:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:01:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:01:30 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:01:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:01:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:01:32 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 00:01:32 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:01:32 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:01:32 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:01:32 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:01:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:01:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:01:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:01:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:01:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:01:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:01:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:01:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:01:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:01:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:01:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:01:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:01:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:01:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:01:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43644174
Sun 19 Jan 2014 00:01:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:01:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43644174
Sun 19 Jan 2014 00:01:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:01:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:01:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:01:47 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:01:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:01:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:01:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:01:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:01:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:01:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:01:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:01:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:01:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:01:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:01:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:01:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:01:49 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:01:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:01:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:01:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:01:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:01:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:01:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:01:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:01:50 - job_xml_thread(): Done retrieving: data size 43650176
Sun 19 Jan 2014 00:01:50 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:01:50 - XML: Start document: iteration 13
Sun 19 Jan 2014 00:01:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43650176
Sun 19 Jan 2014 00:01:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43650176
Sun 19 Jan 2014 00:01:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:01:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:01:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:01:57 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:01:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:01:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 00:01:58 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:01:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 149106 bits 18638 bytes 
Sun 19 Jan 2014 00:01:58 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:01:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 00:02:03 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 00:02:03 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:02:03 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:02:03 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:02:03 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:02:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:02:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:02:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:02:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:02:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:02:06 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:02:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:02:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:02:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:02:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:02:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:02:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:02:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:02:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:02:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:02:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:02:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:02:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:02:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:02:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:02:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:02:15 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:02:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 00:02:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:02:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:02:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43624132
Sun 19 Jan 2014 00:02:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:02:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43624132
Sun 19 Jan 2014 00:02:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:02:18 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:02:18 - job_xml_thread(): Done retrieving: data size 43624132
Sun 19 Jan 2014 00:02:19 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:02:19 - XML: Start document: iteration 14
Sun 19 Jan 2014 00:02:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:02:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:02:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:02:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:02:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:02:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:02:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:02:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:02:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:02:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:02:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:02:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:02:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:02:38 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 00:02:38 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:02:38 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:02:38 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:02:38 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:02:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:02:39 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:02:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:02:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:02:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:02:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:02:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:02:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:02:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:02:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43643672
Sun 19 Jan 2014 00:02:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:02:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43643672
Sun 19 Jan 2014 00:02:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:02:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:02:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:02:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:02:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:02:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:02:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:02:53 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:02:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:02:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:02:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:02:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:02:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:02:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:02:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:02:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:02:57 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:02:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:02:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:02:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:02:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:02:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:02:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:02:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:02:58 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:02:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:02:58 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:02:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 00:02:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 00:02:58 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:02:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99581 bits 12447 bytes 
Sun 19 Jan 2014 00:03:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:03:00 - job_xml_thread(): Done retrieving: data size 43629299
Sun 19 Jan 2014 00:03:00 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:03:00 - XML: Start document: iteration 15
Sun 19 Jan 2014 00:03:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43629299
Sun 19 Jan 2014 00:03:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:03:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43629299
Sun 19 Jan 2014 00:03:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:03:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:03:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:03:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:03:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:03:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:03:13 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:03:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:03:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:03:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:03:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:03:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:03:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:03:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:03:21 - XML: Processed 654194 elements - found 0 jobs
Sun 19 Jan 2014 00:03:21 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:03:21 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:03:21 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:03:21 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:03:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:03:24 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:03:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:03:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:03:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:03:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:03:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:03:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:03:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:03:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:03:36 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:03:37 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:03:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 00:03:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:03:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:03:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43599916
Sun 19 Jan 2014 00:03:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:03:39 - job_xml_thread(): Done retrieving: data size 43599916
Sun 19 Jan 2014 00:03:39 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:03:39 - XML: Start document: iteration 16
Sun 19 Jan 2014 00:03:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43599916
Sun 19 Jan 2014 00:03:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:03:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:03:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:03:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:03:59 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:04:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:04:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 00:04:00 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:04:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 00:04:00 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:04:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 3915 values 61917 bits 7739 bytes 
Sun 19 Jan 2014 00:04:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:04:00 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:04:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:04:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:04:03 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 00:04:03 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:04:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:04:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:04:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:04:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:04:03 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:04:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:04:03 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:04:03 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:04:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:04:05 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:04:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:04:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:04:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:04:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:04:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:04:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:04:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:04:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43650321
Sun 19 Jan 2014 00:04:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:04:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43650321
Sun 19 Jan 2014 00:04:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:04:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:04:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:04:18 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:04:18 - job_xml_thread(): Done retrieving: data size 43650321
Sun 19 Jan 2014 00:04:19 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:04:19 - XML: Start document: iteration 17
Sun 19 Jan 2014 00:04:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:04:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:04:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:04:22 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:04:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:04:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:04:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:04:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:04:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:04:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:04:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:04:28 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 00:04:28 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:04:29 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:04:29 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:04:29 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 00:04:29 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 00:04:29 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 00:04:31 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 00:04:31 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:04:31 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:04:31 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:04:31 - job_xml_thread(): Sleeping.. (15s)
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sun 19 Jan 2014 00:04:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:04:34 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:04:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:04:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:04:34 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:04:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 00:04:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:04:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:04:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:04:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:04:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:04:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:04:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:04:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:04:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43614908
Sun 19 Jan 2014 00:04:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:04:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43614908
Sun 19 Jan 2014 00:04:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:04:46 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:04:46 - job_xml_thread(): Done retrieving: data size 43614908
Sun 19 Jan 2014 00:04:46 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:04:46 - XML: Start document: iteration 18
Sun 19 Jan 2014 00:04:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:04:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:04:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:04:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:04:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:04:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:04:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:04:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:04:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:04:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:04:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:05:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:05:00 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:05:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:05:00 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:05:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 00:05:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 00:05:00 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:05:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5960 values 94062 bits 11757 bytes 
Sun 19 Jan 2014 00:05:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:05:03 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:05:03 - XML: Processed 654194 elements - found 0 jobs
Sun 19 Jan 2014 00:05:03 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:05:03 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:05:03 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:05:03 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:05:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:05:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:05:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:05:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:05:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:05:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:05:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:05:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:05:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:05:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43614110
Sun 19 Jan 2014 00:05:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:05:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43614110
Sun 19 Jan 2014 00:05:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:05:18 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:05:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:05:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:05:18 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:05:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:05:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:05:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:05:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:05:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:05:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:05:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:05:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:05:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:05:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:05:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:05:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:05:22 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:05:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 00:05:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:05:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:05:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:05:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:05:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:05:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:05:24 - job_xml_thread(): Done retrieving: data size 43586180
Sun 19 Jan 2014 00:05:24 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:05:24 - XML: Start document: iteration 19
Sun 19 Jan 2014 00:05:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43586180
Sun 19 Jan 2014 00:05:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:05:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43586180
Sun 19 Jan 2014 00:05:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:05:29 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:05:29 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:05:30 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:05:30 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 00:05:30 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:05:30 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 00:05:30 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 00:05:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:05:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:05:35 - size of cluster 'LISA Cluster': 624 hosts 79468 metrics 874540 values 13815964 bits 1726995 bytes 
Sun 19 Jan 2014 00:05:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:05:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:05:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:05:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:05:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:05:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:05:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:05:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:05:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:05:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:05:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:05:45 - XML: Processed 653443 elements - found 0 jobs
Sun 19 Jan 2014 00:05:45 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:05:45 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:05:45 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:05:45 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:05:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:05:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:05:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:05:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:05:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:05:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:05:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:05:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:05:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:05:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:06:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:06:01 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:06:01 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:06:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:06:01 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:06:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 00:06:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 00:06:01 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:06:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5783 values 91251 bits 11406 bytes 
Sun 19 Jan 2014 00:06:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:06:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43008266
Sun 19 Jan 2014 00:06:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:06:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43008266
Sun 19 Jan 2014 00:06:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:06:04 - job_xml_thread(): Done retrieving: data size 43008266
Sun 19 Jan 2014 00:06:04 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:06:04 - XML: Start document: iteration 20
Sun 19 Jan 2014 00:06:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:06:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:06:18 - XML: Processed 646744 elements - found 0 jobs
Sun 19 Jan 2014 00:06:18 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:06:18 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:06:18 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:06:18 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:06:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:06:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:06:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:06:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:06:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:06:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:06:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:06:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:06:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:06:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:06:26 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:06:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:06:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:06:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:06:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:06:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:06:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:06:32 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:06:32 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 00:06:33 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:06:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:06:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43131212
Sun 19 Jan 2014 00:06:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:06:36 - job_xml_thread(): Done retrieving: data size 43131212
Sun 19 Jan 2014 00:06:36 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:06:36 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 00:06:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43131212
Sun 19 Jan 2014 00:06:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:06:36 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:06:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 00:06:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:06:36 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 00:06:36 - Housekeeping: done.
Sun 19 Jan 2014 00:06:36 - XML: Start document: iteration 0
Sun 19 Jan 2014 00:06:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:06:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:06:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:06:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:06:54 - XML: Processed 648132 elements - found 0 jobs
Sun 19 Jan 2014 00:06:54 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:06:54 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:06:54 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:06:54 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:06:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:06:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:06:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:06:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:06:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:06:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:06:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:06:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:06:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:06:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:06:59 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:06:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:06:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:07:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:07:02 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:07:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:07:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:07:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:07:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:07:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:07:03 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:07:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 00:07:03 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:07:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 00:07:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 3641 values 57418 bits 7177 bytes 
Sun 19 Jan 2014 00:07:09 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:07:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:07:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:07:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:07:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43603463
Sun 19 Jan 2014 00:07:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:07:15 - job_xml_thread(): Done retrieving: data size 43603463
Sun 19 Jan 2014 00:07:15 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:07:15 - XML: Start document: iteration 1
Sun 19 Jan 2014 00:07:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43603463
Sun 19 Jan 2014 00:07:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:07:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:07:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:07:29 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 00:07:29 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:07:29 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:07:29 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:07:29 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:07:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:07:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:07:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:07:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:07:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:07:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:07:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:07:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:07:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:07:34 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:07:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 00:07:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:07:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:07:39 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:07:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:07:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:07:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:07:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:07:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:07:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:07:44 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:07:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:07:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43615831
Sun 19 Jan 2014 00:07:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:07:45 - job_xml_thread(): Done retrieving: data size 43615831
Sun 19 Jan 2014 00:07:45 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:07:45 - XML: Start document: iteration 2
Sun 19 Jan 2014 00:07:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43615831
Sun 19 Jan 2014 00:07:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:07:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:07:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:07:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:07:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:08:02 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 00:08:02 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:08:02 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:08:02 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:08:02 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:08:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:08:03 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:08:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:08:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:08:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:08:03 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:08:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:08:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:08:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:08:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:08:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:08:05 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:08:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:08:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 00:08:05 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:08:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5884 values 92870 bits 11608 bytes 
Sun 19 Jan 2014 00:08:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 00:08:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:08:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:08:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:08:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:08:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:08:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:08:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:08:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:08:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:08:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43635427
Sun 19 Jan 2014 00:08:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:08:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43635427
Sun 19 Jan 2014 00:08:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:08:17 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:08:17 - job_xml_thread(): Done retrieving: data size 43635427
Sun 19 Jan 2014 00:08:17 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:08:17 - XML: Start document: iteration 3
Sun 19 Jan 2014 00:08:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:08:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:08:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:08:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:08:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:08:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:08:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:08:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:08:33 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 00:08:33 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:08:33 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:08:33 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:08:33 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:08:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:08:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:08:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:08:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:08:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:08:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:08:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:08:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:08:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:08:37 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:08:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 00:08:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:08:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:08:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:08:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:08:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:08:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:08:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43655628
Sun 19 Jan 2014 00:08:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:08:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43655628
Sun 19 Jan 2014 00:08:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:08:48 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:08:48 - job_xml_thread(): Done retrieving: data size 43655628
Sun 19 Jan 2014 00:08:48 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:08:48 - XML: Start document: iteration 4
Sun 19 Jan 2014 00:08:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:08:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:08:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:08:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:08:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:08:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:08:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:08:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:08:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:08:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:08:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:08:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:08:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:09:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:09:00 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:09:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:09:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:09:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:09:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:09:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:09:01 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 00:09:01 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:09:01 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:09:01 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:09:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:09:01 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:09:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:09:05 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:09:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:09:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:09:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:09:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43610402
Sun 19 Jan 2014 00:09:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:09:06 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:09:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 00:09:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:09:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 00:09:06 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:09:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5604 values 88323 bits 11040 bytes 
Sun 19 Jan 2014 00:09:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43610402
Sun 19 Jan 2014 00:09:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:09:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:09:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:09:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:09:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:09:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:09:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:09:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:09:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:09:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:09:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:09:16 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:09:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:09:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:09:21 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:09:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:09:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:09:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:09:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:09:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:09:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:09:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:09:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43636428
Sun 19 Jan 2014 00:09:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:09:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43636428
Sun 19 Jan 2014 00:09:27 - job_xml_thread(): Done retrieving: data size 43636428
Sun 19 Jan 2014 00:09:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:09:27 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:09:27 - XML: Start document: iteration 5
Sun 19 Jan 2014 00:09:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:09:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:09:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:09:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:09:38 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 00:09:38 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:09:38 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:09:38 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:09:38 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:09:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:09:47 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:09:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:09:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:09:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:09:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:09:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:09:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:09:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:09:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:09:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:09:50 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:09:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 00:09:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:09:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:09:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:09:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:09:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:09:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:09:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:09:53 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:09:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:09:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43657864
Sun 19 Jan 2014 00:09:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:09:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43657864
Sun 19 Jan 2014 00:09:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:09:55 - job_xml_thread(): Done retrieving: data size 43657864
Sun 19 Jan 2014 00:09:55 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:09:55 - XML: Start document: iteration 6
Sun 19 Jan 2014 00:10:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:10:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:10:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:10:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:10:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:10:06 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:10:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:10:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 00:10:06 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:10:06 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:10:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 00:10:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5895 values 92990 bits 11623 bytes 
Sun 19 Jan 2014 00:10:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:10:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:10:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:10:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:10:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:10:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:10:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:10:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:10:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:10:16 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 00:10:16 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:10:16 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:10:16 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:10:16 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:10:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:10:18 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:10:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:10:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:10:18 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 00:10:18 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 00:10:18 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:10:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:10:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:10:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:10:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:10:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:10:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43638412
Sun 19 Jan 2014 00:10:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:10:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43638412
Sun 19 Jan 2014 00:10:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:10:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:10:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:10:31 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:10:31 - job_xml_thread(): Done retrieving: data size 43638412
Sun 19 Jan 2014 00:10:31 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:10:31 - XML: Start document: iteration 7
Sun 19 Jan 2014 00:10:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:10:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:10:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:10:39 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:10:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:10:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:10:40 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 00:10:40 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:10:40 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:10:40 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:10:40 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:10:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:10:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:10:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:10:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:10:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:10:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:10:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:10:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:10:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:10:44 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:10:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 00:10:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:10:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:10:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:10:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:10:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:10:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:10:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43628298
Sun 19 Jan 2014 00:10:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:10:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43628298
Sun 19 Jan 2014 00:10:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:10:55 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:10:55 - job_xml_thread(): Done retrieving: data size 43628298
Sun 19 Jan 2014 00:10:55 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:10:55 - XML: Start document: iteration 8
Sun 19 Jan 2014 00:10:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:10:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:10:58 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:10:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:10:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:11:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:11:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:11:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:11:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:11:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:11:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:11:06 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 00:11:06 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:11:06 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:11:06 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:11:06 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:11:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:11:06 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:11:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:11:07 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:11:07 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:11:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:11:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 00:11:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 00:11:07 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:11:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5789 values 91365 bits 11420 bytes 
Sun 19 Jan 2014 00:11:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:11:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:11:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:11:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:11:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:11:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:11:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:11:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43639730
Sun 19 Jan 2014 00:11:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:11:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43639730
Sun 19 Jan 2014 00:11:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:11:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:11:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:11:21 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:11:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:11:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:11:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:11:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:11:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:11:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:11:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:11:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:11:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:11:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:11:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:11:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:11:25 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:11:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:11:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:11:25 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:11:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 00:11:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:11:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:11:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:11:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:11:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:11:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:11:27 - job_xml_thread(): Done retrieving: data size 43562020
Sun 19 Jan 2014 00:11:27 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:11:27 - XML: Start document: iteration 9
Sun 19 Jan 2014 00:11:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562020
Sun 19 Jan 2014 00:11:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:11:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562020
Sun 19 Jan 2014 00:11:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:11:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:11:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:11:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:11:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:11:43 - XML: Processed 653446 elements - found 0 jobs
Sun 19 Jan 2014 00:11:43 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:11:43 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:11:43 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:11:43 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:11:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:11:44 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:11:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:11:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:11:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:11:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:11:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:11:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:11:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:11:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:11:49 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:11:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:11:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:11:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:11:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:11:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:11:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:11:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:11:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43005370
Sun 19 Jan 2014 00:11:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:11:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43005370
Sun 19 Jan 2014 00:11:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:11:58 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:11:58 - job_xml_thread(): Done retrieving: data size 43005370
Sun 19 Jan 2014 00:11:58 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:11:58 - XML: Start document: iteration 10
Sun 19 Jan 2014 00:12:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:12:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:12:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:12:04 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:12:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:12:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:12:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:12:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:12:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:12:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:12:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:12:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:12:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:12:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:12:07 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:12:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:12:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 00:12:07 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:12:07 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:12:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 00:12:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9096 values 143529 bits 17941 bytes 
Sun 19 Jan 2014 00:12:12 - XML: Processed 646297 elements - found 0 jobs
Sun 19 Jan 2014 00:12:12 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:12:12 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:12:12 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:12:12 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:12:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:12:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:12:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:12:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:12:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:12:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:12:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:12:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:12:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:12:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42996645
Sun 19 Jan 2014 00:12:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:12:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42996645
Sun 19 Jan 2014 00:12:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:12:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:12:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:12:23 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:12:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 00:12:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:12:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:12:25 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:12:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:12:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:12:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:12:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:12:27 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:12:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:12:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:12:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:12:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:12:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:12:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:12:29 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:12:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:12:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:12:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:12:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:12:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:12:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:12:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:12:32 - job_xml_thread(): Done retrieving: data size 43158599
Sun 19 Jan 2014 00:12:32 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:12:32 - XML: Start document: iteration 11
Sun 19 Jan 2014 00:12:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43158599
Sun 19 Jan 2014 00:12:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:12:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43158599
Sun 19 Jan 2014 00:12:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:12:32 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 00:12:33 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:12:34 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:12:34 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 00:12:34 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:12:34 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 00:12:34 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 00:12:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:12:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:12:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:12:44 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:12:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:12:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:12:44 - size of cluster 'LISA Cluster': 624 hosts 79468 metrics 766213 values 12079284 bits 1509910 bytes 
Sun 19 Jan 2014 00:12:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:12:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:12:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:12:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:12:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:12:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:12:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:12:53 - XML: Processed 648282 elements - found 0 jobs
Sun 19 Jan 2014 00:12:53 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:12:53 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:12:53 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:12:53 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:12:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:12:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:12:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:12:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:12:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:12:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:12:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:12:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:13:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:13:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:13:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:13:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43592441
Sun 19 Jan 2014 00:13:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:13:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43592441
Sun 19 Jan 2014 00:13:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:13:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:13:08 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:13:08 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:13:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:13:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 00:13:09 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:13:09 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:13:09 - job_xml_thread(): Done retrieving: data size 43592441
Sun 19 Jan 2014 00:13:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 00:13:09 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:13:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9345 values 147514 bits 18439 bytes 
Sun 19 Jan 2014 00:13:09 - XML: Start document: iteration 12
Sun 19 Jan 2014 00:13:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:13:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:13:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:13:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:13:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:13:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:13:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:13:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:13:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:13:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:13:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:13:25 - XML: Processed 654190 elements - found 0 jobs
Sun 19 Jan 2014 00:13:25 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:13:25 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:13:25 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:13:25 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:13:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:13:28 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:13:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:13:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:13:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:13:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:13:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:13:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:13:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:13:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43622808
Sun 19 Jan 2014 00:13:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:13:34 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:13:34 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 00:13:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43622808
Sun 19 Jan 2014 00:13:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:13:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:13:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:13:40 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:13:40 - job_xml_thread(): Done retrieving: data size 43622808
Sun 19 Jan 2014 00:13:40 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:13:40 - XML: Start document: iteration 13
Sun 19 Jan 2014 00:13:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:13:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:13:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:13:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:13:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:13:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:13:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:13:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:13:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:13:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:13:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:13:54 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 00:13:54 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:13:54 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:13:54 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:13:54 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:13:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:13:57 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:13:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:13:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:13:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:13:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:13:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:13:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:13:57 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:13:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 00:13:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:14:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:14:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43610878
Sun 19 Jan 2014 00:14:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:14:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43610878
Sun 19 Jan 2014 00:14:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:14:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:14:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:14:09 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:14:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:14:09 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:14:09 - job_xml_thread(): Done retrieving: data size 43610878
Sun 19 Jan 2014 00:14:10 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:14:10 - XML: Start document: iteration 14
Sun 19 Jan 2014 00:14:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:14:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 00:14:10 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:14:10 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:14:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 00:14:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5809 values 91601 bits 11450 bytes 
Sun 19 Jan 2014 00:14:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:14:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:14:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:14:18 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:14:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:14:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:14:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:14:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:14:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:14:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:14:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:14:22 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 00:14:22 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:14:22 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:14:22 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:14:22 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:14:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:14:24 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:14:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:14:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:14:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:14:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:14:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:14:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:14:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:14:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43623793
Sun 19 Jan 2014 00:14:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:14:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43623793
Sun 19 Jan 2014 00:14:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:14:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:14:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:14:37 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:14:37 - job_xml_thread(): Done retrieving: data size 43623793
Sun 19 Jan 2014 00:14:37 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:14:37 - XML: Start document: iteration 15
Sun 19 Jan 2014 00:14:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:14:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:14:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:14:45 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:14:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:14:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:14:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:14:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:14:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:14:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:14:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:14:51 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 00:14:51 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:14:51 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:14:51 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:14:51 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:14:51 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:14:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 00:14:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:14:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:14:53 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:14:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:14:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:14:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:14:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:14:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:14:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:14:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:14:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43611555
Sun 19 Jan 2014 00:14:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:14:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43611555
Sun 19 Jan 2014 00:14:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:15:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:15:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:15:06 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:15:06 - job_xml_thread(): Done retrieving: data size 43611555
Sun 19 Jan 2014 00:15:06 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:15:06 - XML: Start document: iteration 16
Sun 19 Jan 2014 00:15:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:15:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:15:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:15:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:15:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:15:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:15:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:15:10 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:15:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:15:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:15:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:15:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:15:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:15:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:15:11 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:15:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 00:15:11 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:15:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6006 values 94780 bits 11847 bytes 
Sun 19 Jan 2014 00:15:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 00:15:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:15:21 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:15:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:15:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:15:21 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 00:15:21 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:15:21 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:15:21 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:15:21 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:15:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:15:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:15:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:15:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:15:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:15:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43606517
Sun 19 Jan 2014 00:15:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:15:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43606517
Sun 19 Jan 2014 00:15:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:15:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:15:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:15:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:15:36 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:15:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:15:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:15:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:15:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:15:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:15:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:15:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:15:36 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:15:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:15:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:15:39 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:15:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 00:15:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:15:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:15:40 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:15:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:15:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:15:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:15:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:15:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:15:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:15:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:15:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43621365
Sun 19 Jan 2014 00:15:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:15:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43621365
Sun 19 Jan 2014 00:15:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:15:44 - job_xml_thread(): Done retrieving: data size 43621365
Sun 19 Jan 2014 00:15:44 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:15:44 - XML: Start document: iteration 17
Sun 19 Jan 2014 00:15:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:15:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:15:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:15:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:15:58 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 00:15:58 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:15:58 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:15:58 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:15:58 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:16:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:16:03 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:16:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:16:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:16:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:16:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:16:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:16:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:16:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:16:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:16:07 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:16:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:16:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:16:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:16:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:16:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:16:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:16:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:16:11 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:16:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:16:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43620011
Sun 19 Jan 2014 00:16:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:16:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43620011
Sun 19 Jan 2014 00:16:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:16:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:16:12 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:16:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 00:16:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 00:16:12 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:16:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5835 values 92055 bits 11506 bytes 
Sun 19 Jan 2014 00:16:13 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:16:13 - job_xml_thread(): Done retrieving: data size 43620011
Sun 19 Jan 2014 00:16:13 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:16:13 - XML: Start document: iteration 18
Sun 19 Jan 2014 00:16:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:16:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:16:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:16:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:16:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:16:28 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:16:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:16:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:16:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:16:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:16:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:16:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:16:29 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 00:16:29 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:16:29 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:16:29 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:16:29 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:16:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:16:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:16:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:16:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:16:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:16:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:16:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:16:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:16:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:16:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:16:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43640298
Sun 19 Jan 2014 00:16:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:16:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43640298
Sun 19 Jan 2014 00:16:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:16:44 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:16:44 - job_xml_thread(): Done retrieving: data size 43640298
Sun 19 Jan 2014 00:16:44 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:16:44 - XML: Start document: iteration 19
Sun 19 Jan 2014 00:16:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:16:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:16:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:16:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:16:54 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 00:16:54 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:16:54 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:16:54 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:16:54 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:16:54 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:16:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 00:16:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:16:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:16:59 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:16:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:16:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:17:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:17:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:17:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:17:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:17:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:17:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:17:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:17:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:17:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:17:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:17:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:17:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:17:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:17:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:17:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43666332
Sun 19 Jan 2014 00:17:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:17:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43666332
Sun 19 Jan 2014 00:17:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:17:09 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:17:09 - job_xml_thread(): Done retrieving: data size 43666332
Sun 19 Jan 2014 00:17:09 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:17:09 - XML: Start document: iteration 20
Sun 19 Jan 2014 00:17:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:17:12 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:17:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:17:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 00:17:15 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:17:15 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:17:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:17:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:17:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 00:17:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6172 values 97598 bits 12199 bytes 
Sun 19 Jan 2014 00:17:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:17:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:17:21 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 00:17:21 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:17:21 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:17:22 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:17:22 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:17:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:17:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:17:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:17:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:17:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:17:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:17:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:17:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:17:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:17:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:17:28 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:17:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:17:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:17:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:17:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:17:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:17:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:17:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:17:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43544438
Sun 19 Jan 2014 00:17:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:17:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43544438
Sun 19 Jan 2014 00:17:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:17:37 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:17:37 - job_xml_thread(): Done retrieving: data size 43544438
Sun 19 Jan 2014 00:17:37 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:17:37 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 00:17:37 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 00:17:37 - Housekeeping: done.
Sun 19 Jan 2014 00:17:37 - XML: Start document: iteration 0
Sun 19 Jan 2014 00:17:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:17:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:17:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:17:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:17:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:17:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:17:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:17:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:17:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:17:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:17:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:17:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:17:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:17:53 - XML: Processed 653080 elements - found 0 jobs
Sun 19 Jan 2014 00:17:53 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:17:53 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:17:53 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:17:53 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:17:53 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:17:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 00:17:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:17:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:17:55 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:17:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:17:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:17:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:17:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:17:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:17:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:17:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:17:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42974345
Sun 19 Jan 2014 00:17:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:17:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42974345
Sun 19 Jan 2014 00:17:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:18:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:18:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:18:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:18:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:18:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:18:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:18:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:18:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:18:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:18:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:18:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42974345
Sun 19 Jan 2014 00:18:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:18:08 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:18:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:18:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:18:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:18:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:18:15 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:18:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:18:16 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:18:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 00:18:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 00:18:16 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:18:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5979 values 94651 bits 11831 bytes 
Sun 19 Jan 2014 00:18:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:18:19 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:18:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:18:20 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:18:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:18:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:18:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:18:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:18:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:18:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:18:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:18:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:18:22 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 00:18:22 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 00:18:22 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:18:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:18:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:18:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:18:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:18:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:18:23 - job_xml_thread(): Done retrieving: data size 43008527
Sun 19 Jan 2014 00:18:23 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:18:23 - XML: Start document: iteration 1
Sun 19 Jan 2014 00:18:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43008527
Sun 19 Jan 2014 00:18:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:18:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43008527
Sun 19 Jan 2014 00:18:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:18:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:18:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:18:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:18:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:18:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:18:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:18:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:18:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:18:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:18:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:18:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:18:41 - XML: Processed 646670 elements - found 0 jobs
Sun 19 Jan 2014 00:18:41 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:18:41 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:18:41 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:18:41 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:18:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:18:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:18:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:18:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:18:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:18:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:18:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:18:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:18:44 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:18:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 00:18:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:18:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:18:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43548131
Sun 19 Jan 2014 00:18:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:18:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43548131
Sun 19 Jan 2014 00:18:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:18:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:18:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:18:56 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:18:56 - job_xml_thread(): Done retrieving: data size 43548131
Sun 19 Jan 2014 00:18:56 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:18:57 - XML: Start document: iteration 2
Sun 19 Jan 2014 00:18:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:18:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:19:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:19:00 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:19:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:19:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:19:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:19:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:19:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:19:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:19:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:19:11 - XML: Processed 653112 elements - found 0 jobs
Sun 19 Jan 2014 00:19:11 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:19:11 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:19:11 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:19:11 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:19:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:19:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:19:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:19:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:19:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:19:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:19:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:19:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:19:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:19:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:19:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:19:16 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:19:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:19:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 00:19:16 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:19:16 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:19:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5623 values 88646 bits 11080 bytes 
Sun 19 Jan 2014 00:19:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 00:19:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:19:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43604233
Sun 19 Jan 2014 00:19:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:19:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43604233
Sun 19 Jan 2014 00:19:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:19:26 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:19:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:19:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:19:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:19:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:19:29 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:19:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:19:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:19:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:19:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:19:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:19:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:19:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:19:32 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:19:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:19:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:19:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:19:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:19:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:19:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:19:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:19:34 - job_xml_thread(): Done retrieving: data size 43621529
Sun 19 Jan 2014 00:19:34 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:19:34 - XML: Start document: iteration 3
Sun 19 Jan 2014 00:19:35 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 00:19:35 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:19:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43621529
Sun 19 Jan 2014 00:19:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:19:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43621529
Sun 19 Jan 2014 00:19:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:19:36 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:19:36 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:19:36 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 00:19:37 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 00:19:37 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 00:19:45 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 00:19:45 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:19:45 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:19:45 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:19:45 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:19:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:19:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:19:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:19:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:19:51 - size of cluster 'LISA Cluster': 624 hosts 79471 metrics 664667 values 10494335 bits 1311791 bytes 
Sun 19 Jan 2014 00:19:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:19:54 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:19:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:19:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:19:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:19:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:19:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:19:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:19:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:19:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:19:59 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:19:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:19:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:19:59 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:19:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 00:19:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:19:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:19:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:19:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:19:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:20:00 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:20:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:20:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43637903
Sun 19 Jan 2014 00:20:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:20:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43637903
Sun 19 Jan 2014 00:20:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:20:04 - job_xml_thread(): Done retrieving: data size 43637903
Sun 19 Jan 2014 00:20:04 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:20:05 - XML: Start document: iteration 4
Sun 19 Jan 2014 00:20:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:20:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:20:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:20:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:20:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:20:16 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:20:16 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:20:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:20:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 00:20:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 00:20:16 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:20:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6237 values 98431 bits 12303 bytes 
Sun 19 Jan 2014 00:20:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:20:19 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:20:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:20:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:20:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:20:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:20:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:20:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:20:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:20:26 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 00:20:26 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:20:26 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:20:26 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:20:26 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:20:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:20:27 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:20:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:20:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:20:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:20:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:20:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:20:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:20:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:20:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43625828
Sun 19 Jan 2014 00:20:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:20:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43625828
Sun 19 Jan 2014 00:20:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:20:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:20:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:20:36 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:20:36 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 00:20:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:20:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:20:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:20:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:20:41 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:20:41 - job_xml_thread(): Done retrieving: data size 43625828
Sun 19 Jan 2014 00:20:41 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:20:41 - XML: Start document: iteration 5
Sun 19 Jan 2014 00:20:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:20:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:20:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43625828
Sun 19 Jan 2014 00:20:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:20:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:20:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:20:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:20:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:20:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:20:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:21:00 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 00:21:01 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:21:01 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:21:01 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:21:01 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:21:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:21:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:21:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:21:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:21:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:21:03 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:21:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:21:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:21:03 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:21:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 00:21:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:21:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:21:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:21:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:21:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:21:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:21:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:21:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:21:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:21:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:21:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:21:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43629326
Sun 19 Jan 2014 00:21:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:21:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43629326
Sun 19 Jan 2014 00:21:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:21:16 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:21:16 - job_xml_thread(): Done retrieving: data size 43629326
Sun 19 Jan 2014 00:21:16 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:21:16 - XML: Start document: iteration 6
Sun 19 Jan 2014 00:21:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:21:17 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:21:18 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:21:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:21:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 00:21:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 00:21:18 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:21:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5933 values 93610 bits 11701 bytes 
Sun 19 Jan 2014 00:21:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:21:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:21:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:21:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:21:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:21:31 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:21:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:21:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:21:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:21:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:21:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:21:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:21:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:21:34 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 00:21:34 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:21:34 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:21:34 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:21:34 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:21:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:21:37 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:21:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:21:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:21:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:21:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:21:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:21:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:21:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:21:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43620748
Sun 19 Jan 2014 00:21:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:21:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43620748
Sun 19 Jan 2014 00:21:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:21:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:21:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:21:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:21:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:21:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:21:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:21:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:21:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:21:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:21:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:21:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43620748
Sun 19 Jan 2014 00:21:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:21:49 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:21:49 - job_xml_thread(): Done retrieving: data size 43620748
Sun 19 Jan 2014 00:21:49 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:21:49 - XML: Start document: iteration 7
Sun 19 Jan 2014 00:21:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:21:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:22:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:22:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:22:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:22:04 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:22:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:22:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:22:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:22:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:22:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:22:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:22:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:22:05 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:22:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 00:22:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:22:06 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 00:22:06 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:22:06 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:22:06 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:22:06 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:22:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:22:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:22:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:22:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:22:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:22:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:22:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:22:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:22:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:22:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43631487
Sun 19 Jan 2014 00:22:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:22:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43631487
Sun 19 Jan 2014 00:22:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:22:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:22:18 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:22:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:22:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 00:22:20 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:22:20 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:22:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5989 values 94517 bits 11814 bytes 
Sun 19 Jan 2014 00:22:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 00:22:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:22:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:22:21 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:22:21 - job_xml_thread(): Done retrieving: data size 43631487
Sun 19 Jan 2014 00:22:21 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:22:21 - XML: Start document: iteration 8
Sun 19 Jan 2014 00:22:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:22:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:22:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:22:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:22:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:22:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:22:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:22:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:22:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:22:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:22:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:22:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:22:34 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:22:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:22:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:22:34 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 00:22:34 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:22:34 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:22:34 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:22:34 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:22:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:22:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:22:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:22:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:22:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:22:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:22:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:22:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43608110
Sun 19 Jan 2014 00:22:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:22:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43608110
Sun 19 Jan 2014 00:22:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:22:42 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:22:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 00:22:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:22:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:22:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:22:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:22:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:22:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:22:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:22:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:22:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:22:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:22:49 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:22:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:22:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:22:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:22:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:22:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:22:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:22:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:22:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:22:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:22:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:22:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:22:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43630198
Sun 19 Jan 2014 00:22:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:22:57 - job_xml_thread(): Done retrieving: data size 43630198
Sun 19 Jan 2014 00:22:57 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:22:57 - XML: Start document: iteration 9
Sun 19 Jan 2014 00:22:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43630198
Sun 19 Jan 2014 00:22:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:23:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:23:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:23:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:23:06 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:23:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:23:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:23:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:23:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:23:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:23:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:23:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:23:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:23:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:23:13 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 00:23:13 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:23:13 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:23:13 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:23:14 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:23:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:23:18 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:23:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:23:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:23:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:23:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:23:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:23:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:23:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:23:20 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:23:20 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:23:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:23:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 00:23:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 00:23:20 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:23:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6208 values 97946 bits 12243 bytes 
Sun 19 Jan 2014 00:23:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:23:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43543047
Sun 19 Jan 2014 00:23:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:23:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:23:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43543047
Sun 19 Jan 2014 00:23:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:23:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:23:29 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:23:29 - job_xml_thread(): Done retrieving: data size 43543047
Sun 19 Jan 2014 00:23:29 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:23:29 - XML: Start document: iteration 10
Sun 19 Jan 2014 00:23:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:23:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:23:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:23:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:23:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:23:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:23:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:23:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:23:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:23:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:23:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:23:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:23:45 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:23:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:23:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:23:45 - XML: Processed 653446 elements - found 0 jobs
Sun 19 Jan 2014 00:23:45 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:23:45 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:23:45 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:23:45 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:23:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:23:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:23:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:23:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:23:47 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:23:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 00:23:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:23:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:23:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43030993
Sun 19 Jan 2014 00:23:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:23:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43030993
Sun 19 Jan 2014 00:23:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:23:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:23:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:23:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:23:59 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:23:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:23:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:24:00 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:24:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:24:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:24:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:24:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:24:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:24:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:24:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:24:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:24:03 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:24:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:24:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:24:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:24:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:24:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:24:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:24:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:24:06 - job_xml_thread(): Done retrieving: data size 42969999
Sun 19 Jan 2014 00:24:06 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:24:06 - XML: Start document: iteration 11
Sun 19 Jan 2014 00:24:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42969999
Sun 19 Jan 2014 00:24:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:24:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42969999
Sun 19 Jan 2014 00:24:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:24:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:24:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:24:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:24:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:24:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:24:20 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:24:21 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:24:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 00:24:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:24:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 00:24:21 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:24:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7508 values 118382 bits 14797 bytes 
Sun 19 Jan 2014 00:24:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:24:25 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:24:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:24:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:24:26 - XML: Processed 645996 elements - found 0 jobs
Sun 19 Jan 2014 00:24:26 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:24:26 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:24:26 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:24:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:24:26 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:24:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:24:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:24:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:24:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:24:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:24:29 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:24:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:24:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:24:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:24:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:24:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:24:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:24:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:24:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43094039
Sun 19 Jan 2014 00:24:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:24:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43094039
Sun 19 Jan 2014 00:24:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:24:41 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:24:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:24:41 - job_xml_thread(): Done retrieving: data size 43094039
Sun 19 Jan 2014 00:24:41 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:24:41 - XML: Start document: iteration 12
Sun 19 Jan 2014 00:24:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:24:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:24:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:24:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:24:45 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:24:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:24:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:24:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:24:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:24:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:24:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:24:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:24:56 - XML: Processed 647252 elements - found 0 jobs
Sun 19 Jan 2014 00:24:56 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:24:56 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:24:56 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:24:56 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:24:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:24:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:24:56 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:24:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 00:24:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:24:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:24:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:24:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:24:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:24:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:24:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:24:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:24:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43591511
Sun 19 Jan 2014 00:24:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:24:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43591511
Sun 19 Jan 2014 00:24:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:25:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:25:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:25:11 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:25:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:25:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:25:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:25:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:25:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:25:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:25:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:25:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:25:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:25:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:25:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:25:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:25:15 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:25:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:25:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:25:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:25:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:25:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:25:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:25:17 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 00:25:17 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 00:25:17 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:25:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:25:17 - job_xml_thread(): Done retrieving: data size 43645475
Sun 19 Jan 2014 00:25:17 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:25:17 - XML: Start document: iteration 13
Sun 19 Jan 2014 00:25:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43645475
Sun 19 Jan 2014 00:25:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:25:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43645475
Sun 19 Jan 2014 00:25:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:25:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:25:22 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:25:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:25:25 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:25:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 00:25:25 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:25:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 00:25:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8812 values 138913 bits 17364 bytes 
Sun 19 Jan 2014 00:25:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:25:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:25:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:25:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:25:38 - XML: Processed 654193 elements - found 0 jobs
Sun 19 Jan 2014 00:25:38 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:25:38 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:25:38 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:25:38 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:25:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:25:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:25:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:25:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:25:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:25:41 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:25:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:25:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:25:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:25:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:25:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:25:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:25:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:25:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:25:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:25:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:25:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:25:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:25:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43651061
Sun 19 Jan 2014 00:25:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:25:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43651061
Sun 19 Jan 2014 00:25:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:25:53 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:25:53 - job_xml_thread(): Done retrieving: data size 43651061
Sun 19 Jan 2014 00:25:53 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:25:53 - XML: Start document: iteration 14
Sun 19 Jan 2014 00:25:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:25:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:25:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:25:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:25:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:25:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:25:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:25:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:25:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:25:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:25:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:26:00 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:26:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 00:26:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:26:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:26:03 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:26:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:26:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:26:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:26:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:26:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:26:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:26:06 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 00:26:06 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:26:06 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:26:06 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:26:06 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:26:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:26:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43605371
Sun 19 Jan 2014 00:26:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:26:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43605371
Sun 19 Jan 2014 00:26:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:26:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:26:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:26:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:26:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:26:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:26:20 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:26:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:26:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:26:21 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:26:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:26:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:26:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:26:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:26:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:26:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:26:24 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:26:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:26:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:26:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:26:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:26:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:26:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:26:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:26:25 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:26:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:26:25 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:26:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 00:26:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 00:26:25 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:26:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6119 values 96543 bits 12067 bytes 
Sun 19 Jan 2014 00:26:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:26:27 - job_xml_thread(): Done retrieving: data size 43636910
Sun 19 Jan 2014 00:26:27 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:26:27 - XML: Start document: iteration 15
Sun 19 Jan 2014 00:26:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43636910
Sun 19 Jan 2014 00:26:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:26:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43636910
Sun 19 Jan 2014 00:26:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:26:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:26:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:26:37 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 00:26:37 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:26:38 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:26:38 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 00:26:38 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 00:26:38 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:26:38 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 00:26:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:26:39 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 00:26:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:26:39 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:26:39 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:26:39 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:26:39 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:26:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:26:46 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:26:46 - size of cluster 'LISA Cluster': 624 hosts 79471 metrics 653610 values 10299291 bits 1287411 bytes 
Sun 19 Jan 2014 00:26:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:26:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:26:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:26:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:26:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:26:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:26:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:26:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:26:49 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:26:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:26:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:26:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:26:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:26:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:26:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:26:52 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:26:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 00:26:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:26:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:26:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43624982
Sun 19 Jan 2014 00:26:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:26:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43624982
Sun 19 Jan 2014 00:26:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:26:54 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:26:54 - job_xml_thread(): Done retrieving: data size 43624982
Sun 19 Jan 2014 00:26:54 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:26:54 - XML: Start document: iteration 16
Sun 19 Jan 2014 00:27:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:27:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:27:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:27:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:27:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:27:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:27:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:27:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:27:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:27:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:27:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:27:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:27:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:27:10 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 00:27:10 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:27:10 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:27:10 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:27:10 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:27:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:27:15 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:27:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:27:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:27:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:27:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:27:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:27:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:27:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:27:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43636805
Sun 19 Jan 2014 00:27:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:27:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43636805
Sun 19 Jan 2014 00:27:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:27:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:27:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:27:25 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:27:25 - job_xml_thread(): Done retrieving: data size 43636805
Sun 19 Jan 2014 00:27:25 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:27:25 - XML: Start document: iteration 17
Sun 19 Jan 2014 00:27:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:27:26 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:27:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:27:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 00:27:28 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:27:28 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:27:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 00:27:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7713 values 121659 bits 15207 bytes 
Sun 19 Jan 2014 00:27:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:27:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:27:37 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 00:27:37 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:27:37 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:27:37 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:27:37 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:27:38 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:27:38 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 00:27:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:27:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:27:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:27:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:27:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:27:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:27:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:27:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:27:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:27:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:27:42 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:27:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:27:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:27:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:27:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:27:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:27:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:27:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:27:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43646232
Sun 19 Jan 2014 00:27:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:27:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43646232
Sun 19 Jan 2014 00:27:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:27:52 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:27:52 - job_xml_thread(): Done retrieving: data size 43646232
Sun 19 Jan 2014 00:27:52 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:27:53 - XML: Start document: iteration 18
Sun 19 Jan 2014 00:27:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:27:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:27:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:27:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:28:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:28:01 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:28:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:28:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:28:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:28:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:28:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:28:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:28:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:28:05 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:28:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 00:28:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:28:08 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 00:28:08 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:28:08 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:28:08 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:28:08 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:28:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:28:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:28:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:28:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:28:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:28:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:28:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:28:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:28:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:28:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43617104
Sun 19 Jan 2014 00:28:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:28:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43617104
Sun 19 Jan 2014 00:28:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:28:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:28:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:28:23 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:28:23 - job_xml_thread(): Done retrieving: data size 43617104
Sun 19 Jan 2014 00:28:23 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:28:23 - XML: Start document: iteration 19
Sun 19 Jan 2014 00:28:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:28:28 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:28:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:28:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:28:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:28:28 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:28:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:28:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:28:29 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:28:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:28:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 00:28:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:28:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:28:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 00:28:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:28:29 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:28:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6074 values 95854 bits 11981 bytes 
Sun 19 Jan 2014 00:28:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:28:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:28:36 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 00:28:36 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:28:36 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:28:36 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:28:36 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:28:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:28:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:28:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:28:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:28:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:28:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:28:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:28:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:28:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:28:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43612186
Sun 19 Jan 2014 00:28:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:28:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43612186
Sun 19 Jan 2014 00:28:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:28:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:28:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:28:51 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:28:52 - job_xml_thread(): Done retrieving: data size 43612186
Sun 19 Jan 2014 00:28:52 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:28:52 - XML: Start document: iteration 20
Sun 19 Jan 2014 00:28:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:28:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:29:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:29:00 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:29:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:29:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:29:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:29:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:29:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:29:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:29:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:29:04 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 00:29:04 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:29:04 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:29:04 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:29:04 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:29:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:29:06 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:29:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:29:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:29:06 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:29:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 00:29:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:29:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:29:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:29:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:29:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:29:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:29:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563053
Sun 19 Jan 2014 00:29:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:29:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563053
Sun 19 Jan 2014 00:29:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:29:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:29:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:29:19 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:29:19 - job_xml_thread(): Done retrieving: data size 43563053
Sun 19 Jan 2014 00:29:19 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:29:19 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 00:29:20 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 00:29:20 - Housekeeping: done.
Sun 19 Jan 2014 00:29:20 - XML: Start document: iteration 0
Sun 19 Jan 2014 00:29:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:29:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:29:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:29:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:29:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:29:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:29:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:29:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:29:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:29:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:29:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:29:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:29:29 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:29:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:29:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 00:29:30 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:29:30 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:29:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 00:29:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5850 values 92206 bits 11525 bytes 
Sun 19 Jan 2014 00:29:31 - XML: Processed 653466 elements - found 0 jobs
Sun 19 Jan 2014 00:29:31 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:29:31 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:29:31 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:29:31 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:29:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:29:32 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:29:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:29:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:29:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:29:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:29:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:29:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:29:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:29:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43431491
Sun 19 Jan 2014 00:29:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:29:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43431491
Sun 19 Jan 2014 00:29:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:29:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:29:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:29:46 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:29:46 - job_xml_thread(): Done retrieving: data size 43431491
Sun 19 Jan 2014 00:29:46 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:29:46 - XML: Start document: iteration 1
Sun 19 Jan 2014 00:29:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:29:47 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:29:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:29:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:29:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:29:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:29:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:29:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:29:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:29:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:29:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:29:56 - XML: Processed 651990 elements - found 0 jobs
Sun 19 Jan 2014 00:29:56 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:29:56 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:29:56 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:29:56 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:29:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:29:59 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:29:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:29:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:29:59 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:29:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 00:29:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:30:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:30:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:30:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:30:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:30:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:30:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42980883
Sun 19 Jan 2014 00:30:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:30:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42980883
Sun 19 Jan 2014 00:30:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:30:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:30:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:30:11 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:30:11 - job_xml_thread(): Done retrieving: data size 42980883
Sun 19 Jan 2014 00:30:11 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:30:11 - XML: Start document: iteration 2
Sun 19 Jan 2014 00:30:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:30:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:30:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:30:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:30:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:30:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:30:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:30:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:30:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:30:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:30:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:30:25 - XML: Processed 646232 elements - found 0 jobs
Sun 19 Jan 2014 00:30:25 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:30:25 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:30:25 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:30:25 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:30:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:30:25 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:30:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:30:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:30:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:30:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:30:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:30:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:30:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:30:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43021379
Sun 19 Jan 2014 00:30:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:30:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43021379
Sun 19 Jan 2014 00:30:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:30:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:30:30 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:30:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:30:30 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:30:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 00:30:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 00:30:30 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:30:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8691 values 136996 bits 17124 bytes 
Sun 19 Jan 2014 00:30:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:30:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:30:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:30:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:30:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:30:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:30:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:30:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:30:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:30:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:30:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:30:40 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:30:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:30:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:30:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:30:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:30:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:30:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:30:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:30:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:30:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:30:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:30:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:30:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553247
Sun 19 Jan 2014 00:30:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:30:50 - job_xml_thread(): Done retrieving: data size 43553247
Sun 19 Jan 2014 00:30:50 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:30:50 - XML: Start document: iteration 3
Sun 19 Jan 2014 00:30:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553247
Sun 19 Jan 2014 00:30:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:30:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:30:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:30:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:30:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:31:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:31:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:31:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:31:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:31:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:31:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:31:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:31:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:31:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:31:04 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:31:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 00:31:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:31:08 - XML: Processed 653216 elements - found 0 jobs
Sun 19 Jan 2014 00:31:08 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:31:08 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:31:08 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:31:08 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:31:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:31:14 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:31:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:31:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:31:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:31:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:31:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:31:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:31:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:31:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43616483
Sun 19 Jan 2014 00:31:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:31:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43616483
Sun 19 Jan 2014 00:31:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:31:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:31:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:31:23 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:31:23 - job_xml_thread(): Done retrieving: data size 43616483
Sun 19 Jan 2014 00:31:23 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:31:23 - XML: Start document: iteration 4
Sun 19 Jan 2014 00:31:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:31:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:31:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:31:30 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:31:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:31:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 00:31:31 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:31:31 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:31:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 00:31:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6005 values 94819 bits 11852 bytes 
Sun 19 Jan 2014 00:31:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:31:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:31:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:31:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:31:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:31:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:31:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:31:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:31:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:31:36 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 00:31:36 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:31:36 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:31:36 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:31:36 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:31:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:31:40 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:31:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:31:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:31:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:31:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:31:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:31:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:31:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:31:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43624347
Sun 19 Jan 2014 00:31:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:31:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43624347
Sun 19 Jan 2014 00:31:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:31:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:31:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:31:51 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:31:51 - job_xml_thread(): Done retrieving: data size 43624347
Sun 19 Jan 2014 00:31:51 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:31:51 - XML: Start document: iteration 5
Sun 19 Jan 2014 00:31:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:31:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:31:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:31:58 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:31:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:31:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:31:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:31:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:31:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:31:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:31:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:32:05 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:32:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 00:32:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:32:05 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 00:32:05 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:32:05 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:32:05 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:32:05 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:32:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:32:07 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:32:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:32:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:32:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:32:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:32:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:32:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:32:08 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 00:32:08 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 00:32:08 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:32:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:32:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43609115
Sun 19 Jan 2014 00:32:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:32:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43609115
Sun 19 Jan 2014 00:32:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:32:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:32:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:32:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:32:18 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:32:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:32:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:32:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:32:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:32:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:32:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:32:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43609115
Sun 19 Jan 2014 00:32:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:32:20 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:32:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:32:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:32:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:32:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:32:28 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:32:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:32:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:32:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:32:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:32:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:32:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:32:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:32:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:32:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:32:31 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:32:32 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:32:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:32:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 00:32:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 00:32:32 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:32:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5848 values 92488 bits 11561 bytes 
Sun 19 Jan 2014 00:32:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:32:32 - job_xml_thread(): Done retrieving: data size 43631507
Sun 19 Jan 2014 00:32:32 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:32:32 - XML: Start document: iteration 6
Sun 19 Jan 2014 00:32:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43631507
Sun 19 Jan 2014 00:32:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:32:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:32:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:32:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:32:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:32:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43631507
Sun 19 Jan 2014 00:32:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:32:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:32:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:32:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:32:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:32:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:32:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:32:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:32:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:32:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:32:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:32:53 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 00:32:53 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:32:53 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:32:53 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:32:53 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:32:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:32:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:32:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:32:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:32:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:32:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:32:55 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:32:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:32:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:32:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:32:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:32:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:32:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:33:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:33:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43642309
Sun 19 Jan 2014 00:33:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:33:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43642309
Sun 19 Jan 2014 00:33:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:33:08 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:33:08 - job_xml_thread(): Done retrieving: data size 43642309
Sun 19 Jan 2014 00:33:08 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:33:08 - XML: Start document: iteration 7
Sun 19 Jan 2014 00:33:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:33:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:33:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:33:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:33:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:33:14 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:33:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:33:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:33:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:33:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:33:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:33:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:33:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:33:22 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:33:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 00:33:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:33:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:33:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:33:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:33:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:33:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:33:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:33:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:33:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:33:24 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 00:33:24 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:33:24 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:33:24 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:33:24 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:33:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:33:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43617179
Sun 19 Jan 2014 00:33:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:33:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43617179
Sun 19 Jan 2014 00:33:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:33:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:33:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:33:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:33:32 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:33:33 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:33:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 00:33:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:33:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 00:33:33 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:33:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6296 values 99528 bits 12441 bytes 
Sun 19 Jan 2014 00:33:38 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 00:33:38 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:33:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:33:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:33:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:33:39 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:33:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:33:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:33:39 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:33:39 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 00:33:39 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:33:39 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 00:33:39 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 00:33:39 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:33:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:33:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:33:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:33:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:33:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:33:41 - size of cluster 'LISA Cluster': 624 hosts 79478 metrics 697493 values 11015467 bits 1376933 bytes 
Sun 19 Jan 2014 00:33:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:33:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:33:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:33:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:33:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:33:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:33:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:33:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:33:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:33:49 - job_xml_thread(): Done retrieving: data size 43641100
Sun 19 Jan 2014 00:33:49 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:33:49 - XML: Start document: iteration 8
Sun 19 Jan 2014 00:33:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43641100
Sun 19 Jan 2014 00:33:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:33:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43641100
Sun 19 Jan 2014 00:33:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:33:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:33:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:34:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:34:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:34:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:34:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:34:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:34:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:34:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:34:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:34:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:34:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:34:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:34:09 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:34:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 00:34:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:34:09 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 00:34:09 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:34:09 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:34:09 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:34:09 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:34:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:34:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:34:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:34:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:34:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:34:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:34:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:34:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:34:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:34:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43631927
Sun 19 Jan 2014 00:34:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:34:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43631927
Sun 19 Jan 2014 00:34:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:34:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:34:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:34:24 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:34:24 - job_xml_thread(): Done retrieving: data size 43631927
Sun 19 Jan 2014 00:34:24 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:34:24 - XML: Start document: iteration 9
Sun 19 Jan 2014 00:34:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:34:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:34:29 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:34:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:34:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:34:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:34:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:34:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:34:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:34:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:34:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:34:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:34:33 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:34:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:34:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 00:34:33 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:34:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 00:34:34 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:34:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6068 values 95726 bits 11965 bytes 
Sun 19 Jan 2014 00:34:38 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 00:34:38 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:34:38 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:34:38 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:34:38 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:34:39 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:34:39 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 00:34:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:34:42 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:34:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:34:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:34:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:34:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:34:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:34:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:34:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:34:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43619226
Sun 19 Jan 2014 00:34:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:34:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:34:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43619226
Sun 19 Jan 2014 00:34:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:34:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:34:53 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:34:53 - job_xml_thread(): Done retrieving: data size 43619226
Sun 19 Jan 2014 00:34:53 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:34:54 - XML: Start document: iteration 10
Sun 19 Jan 2014 00:34:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:34:54 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:34:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:34:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:34:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:34:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:34:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43619226
Sun 19 Jan 2014 00:34:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:34:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:34:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:34:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:34:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:35:09 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 00:35:09 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:35:09 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:35:09 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:35:09 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:35:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:35:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:35:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:35:13 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:35:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:35:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:35:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:35:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:35:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:35:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:35:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:35:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:35:16 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:35:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:35:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:35:17 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:35:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 00:35:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:35:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:35:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:35:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:35:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:35:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:35:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577736
Sun 19 Jan 2014 00:35:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:35:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577736
Sun 19 Jan 2014 00:35:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:35:25 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:35:25 - job_xml_thread(): Done retrieving: data size 43577736
Sun 19 Jan 2014 00:35:25 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:35:25 - XML: Start document: iteration 11
Sun 19 Jan 2014 00:35:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:35:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:35:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:35:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:35:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:35:34 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:35:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:35:35 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:35:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 00:35:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 00:35:35 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:35:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5728 values 90355 bits 11294 bytes 
Sun 19 Jan 2014 00:35:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:35:36 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:35:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:35:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:35:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:35:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:35:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:35:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:35:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:35:42 - XML: Processed 653446 elements - found 0 jobs
Sun 19 Jan 2014 00:35:42 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:35:42 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:35:42 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:35:42 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:35:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:35:45 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:35:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:35:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:35:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:35:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:35:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:35:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:35:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:35:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43028445
Sun 19 Jan 2014 00:35:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:35:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43028445
Sun 19 Jan 2014 00:35:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:35:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:35:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:35:57 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:35:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:36:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:36:00 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:36:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:36:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:36:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:36:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:36:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:36:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:36:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:36:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:36:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:36:03 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:36:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:36:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:36:03 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:36:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 00:36:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:36:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:36:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:36:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:36:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:36:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:36:06 - job_xml_thread(): Done retrieving: data size 43000381
Sun 19 Jan 2014 00:36:06 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:36:06 - XML: Start document: iteration 12
Sun 19 Jan 2014 00:36:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43000381
Sun 19 Jan 2014 00:36:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:36:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43000381
Sun 19 Jan 2014 00:36:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:36:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:36:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:36:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:36:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:36:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:36:21 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:36:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:36:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:36:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:36:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:36:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:36:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:36:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:36:27 - XML: Processed 646176 elements - found 0 jobs
Sun 19 Jan 2014 00:36:27 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:36:27 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:36:27 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:36:27 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:36:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:36:28 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:36:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:36:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:36:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:36:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:36:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:36:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:36:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:36:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43033698
Sun 19 Jan 2014 00:36:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:36:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43033698
Sun 19 Jan 2014 00:36:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:36:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:36:35 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:36:36 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:36:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 00:36:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:36:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 00:36:36 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:36:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:36:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:36:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9016 values 142207 bits 17775 bytes 
Sun 19 Jan 2014 00:36:42 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:36:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:36:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:36:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:36:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:36:44 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:36:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:36:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:36:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:36:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:36:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:36:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:36:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:36:48 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:36:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:36:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:36:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:36:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:36:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:36:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:36:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:36:52 - job_xml_thread(): Done retrieving: data size 43567800
Sun 19 Jan 2014 00:36:52 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:36:52 - XML: Start document: iteration 13
Sun 19 Jan 2014 00:36:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567800
Sun 19 Jan 2014 00:36:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567800
Sun 19 Jan 2014 00:36:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:36:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:37:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:37:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:37:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:37:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:37:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:37:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:37:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:37:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:37:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:37:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:37:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:37:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:37:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:37:14 - XML: Processed 653130 elements - found 0 jobs
Sun 19 Jan 2014 00:37:14 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:37:14 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:37:14 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:37:14 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:37:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:37:16 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:37:16 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:37:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 00:37:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:37:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:37:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:37:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:37:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:37:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:37:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:37:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:37:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43652349
Sun 19 Jan 2014 00:37:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:37:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43652349
Sun 19 Jan 2014 00:37:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:37:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:37:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:37:29 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:37:29 - job_xml_thread(): Done retrieving: data size 43652349
Sun 19 Jan 2014 00:37:29 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:37:29 - XML: Start document: iteration 14
Sun 19 Jan 2014 00:37:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:37:30 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:37:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:37:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:37:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:37:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:37:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:37:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:37:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:37:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:37:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:37:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:37:36 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:37:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:37:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 00:37:37 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:37:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:37:37 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:37:37 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:37:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 00:37:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:37:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5770 values 90965 bits 11370 bytes 
Sun 19 Jan 2014 00:37:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:37:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:37:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:37:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:37:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:37:42 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 00:37:42 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:37:42 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:37:42 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:37:42 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:37:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:37:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43608761
Sun 19 Jan 2014 00:37:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:37:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43608761
Sun 19 Jan 2014 00:37:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:37:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:37:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:37:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:37:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:37:57 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:37:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:37:58 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:37:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 00:37:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:38:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:38:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:38:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:38:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:38:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:38:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:38:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:38:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:38:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:38:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:38:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:38:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:38:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:38:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:38:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:38:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:38:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:38:05 - job_xml_thread(): Done retrieving: data size 43634769
Sun 19 Jan 2014 00:38:05 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:38:05 - XML: Start document: iteration 15
Sun 19 Jan 2014 00:38:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43634769
Sun 19 Jan 2014 00:38:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43634769
Sun 19 Jan 2014 00:38:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:38:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:38:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:38:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:38:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:38:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:38:21 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 00:38:21 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:38:21 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:38:21 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:38:21 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:38:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:38:28 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:38:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:38:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:38:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:38:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:38:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:38:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:38:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:38:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:38:29 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:38:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:38:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:38:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:38:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:38:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:38:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:38:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:38:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43659910
Sun 19 Jan 2014 00:38:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:38:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43659910
Sun 19 Jan 2014 00:38:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:38:36 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:38:36 - job_xml_thread(): Done retrieving: data size 43659910
Sun 19 Jan 2014 00:38:36 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:38:36 - XML: Start document: iteration 16
Sun 19 Jan 2014 00:38:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:38:38 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:38:39 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:38:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:38:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 00:38:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 00:38:39 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:38:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9202 values 145179 bits 18147 bytes 
Sun 19 Jan 2014 00:38:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:38:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:38:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:38:45 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:38:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:38:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:38:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:38:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:38:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:38:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:38:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:38:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:38:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:38:53 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 00:38:53 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:38:53 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:38:53 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:38:53 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:38:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:38:55 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:38:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:38:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:38:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:38:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:38:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:38:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:38:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:38:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43620561
Sun 19 Jan 2014 00:38:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:39:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43620561
Sun 19 Jan 2014 00:39:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:39:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:39:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:39:08 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:39:08 - job_xml_thread(): Done retrieving: data size 43620561
Sun 19 Jan 2014 00:39:09 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:39:09 - XML: Start document: iteration 17
Sun 19 Jan 2014 00:39:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:39:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:39:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:39:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:39:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:39:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:39:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:39:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:39:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:39:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:39:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:39:20 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 00:39:20 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:39:20 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:39:20 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:39:20 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:39:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:39:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:39:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:39:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:39:22 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 00:39:22 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 00:39:22 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:39:23 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:39:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 00:39:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:39:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:39:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:39:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:39:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:39:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:39:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43595930
Sun 19 Jan 2014 00:39:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:39:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43595930
Sun 19 Jan 2014 00:39:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:39:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:39:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:39:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:39:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:39:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:39:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:39:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:39:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:39:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:39:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:39:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:39:35 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:39:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:39:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:39:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:39:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:39:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:39:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:39:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:39:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:39:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:39:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:39:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:39:39 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:39:40 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:39:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 00:39:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:39:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 00:39:40 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:39:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5652 values 89035 bits 11129 bytes 
Sun 19 Jan 2014 00:39:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:39:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43624305
Sun 19 Jan 2014 00:39:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:39:41 - job_xml_thread(): Done retrieving: data size 43624305
Sun 19 Jan 2014 00:39:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43624305
Sun 19 Jan 2014 00:39:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:39:41 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:39:42 - XML: Start document: iteration 18
Sun 19 Jan 2014 00:39:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:39:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:39:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:39:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:39:59 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 00:39:59 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:39:59 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:39:59 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:39:59 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:40:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:40:00 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:40:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:40:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:40:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:40:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:40:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:40:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:40:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:40:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:40:03 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:40:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:40:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:40:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:40:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:40:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:40:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:40:06 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:40:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 00:40:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:40:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:40:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43638547
Sun 19 Jan 2014 00:40:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:40:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43638547
Sun 19 Jan 2014 00:40:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:40:14 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:40:14 - job_xml_thread(): Done retrieving: data size 43638547
Sun 19 Jan 2014 00:40:14 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:40:14 - XML: Start document: iteration 19
Sun 19 Jan 2014 00:40:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:40:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:40:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:40:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:40:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:40:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:40:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:40:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:40:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:40:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:40:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:40:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:40:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:40:27 - XML: Processed 654195 elements - found 0 jobs
Sun 19 Jan 2014 00:40:27 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:40:27 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:40:27 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:40:27 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:40:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:40:28 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:40:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:40:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:40:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:40:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:40:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:40:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:40:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:40:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43615850
Sun 19 Jan 2014 00:40:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:40:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43615850
Sun 19 Jan 2014 00:40:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:40:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:40:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:40:39 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 00:40:39 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:40:40 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:40:40 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 00:40:40 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 00:40:40 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:40:40 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 00:40:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:40:40 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:40:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:40:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 00:40:41 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:40:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:40:41 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:40:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 00:40:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7077 values 111662 bits 13957 bytes 
Sun 19 Jan 2014 00:40:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:40:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:40:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:40:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:40:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:40:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:40:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:40:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:40:42 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:40:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:40:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:40:45 - size of cluster 'LISA Cluster': 624 hosts 79482 metrics 723456 values 11404573 bits 1425571 bytes 
Sun 19 Jan 2014 00:40:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:40:47 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:40:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:40:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:40:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:40:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:40:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:40:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:40:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:40:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43605552
Sun 19 Jan 2014 00:40:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:40:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43605552
Sun 19 Jan 2014 00:40:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:40:55 - job_xml_thread(): Done retrieving: data size 43605552
Sun 19 Jan 2014 00:40:55 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:40:55 - XML: Start document: iteration 20
Sun 19 Jan 2014 00:40:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:40:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:41:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:41:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:41:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:41:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:41:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:41:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:41:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:41:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:41:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:41:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:41:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:41:15 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 00:41:16 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:41:16 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:41:16 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:41:16 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:41:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:41:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:41:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:41:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:41:17 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:41:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 00:41:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:41:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:41:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:41:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:41:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:41:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:41:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558798
Sun 19 Jan 2014 00:41:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:41:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558798
Sun 19 Jan 2014 00:41:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:41:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:41:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:41:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:41:31 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:41:31 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:41:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:41:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:41:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:41:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:41:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:41:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:41:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:41:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:41:34 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:41:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:41:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:41:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:41:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:41:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:41:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:41:40 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:41:40 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 00:41:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:41:42 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:41:42 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:41:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:41:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 00:41:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 00:41:42 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:41:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5875 values 92666 bits 11583 bytes 
Sun 19 Jan 2014 00:41:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:41:45 - job_xml_thread(): Done retrieving: data size 43090625
Sun 19 Jan 2014 00:41:45 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:41:45 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 00:41:45 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 00:41:45 - Housekeeping: done.
Sun 19 Jan 2014 00:41:45 - XML: Start document: iteration 0
Sun 19 Jan 2014 00:41:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43090625
Sun 19 Jan 2014 00:41:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43090625
Sun 19 Jan 2014 00:41:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:41:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:41:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:41:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:41:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:41:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:41:57 - XML: Processed 647656 elements - found 0 jobs
Sun 19 Jan 2014 00:41:57 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:41:57 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:41:57 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:41:57 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:42:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:42:07 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:42:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:42:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:42:07 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:42:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:42:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:42:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:42:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:42:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:42:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:42:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:42:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:42:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:42:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:42:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:42:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:42:11 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:42:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 00:42:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:42:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:42:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42981203
Sun 19 Jan 2014 00:42:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:42:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42981203
Sun 19 Jan 2014 00:42:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:42:12 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:42:12 - job_xml_thread(): Done retrieving: data size 42981203
Sun 19 Jan 2014 00:42:12 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:42:12 - XML: Start document: iteration 1
Sun 19 Jan 2014 00:42:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:42:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:42:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:42:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:42:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:42:30 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:42:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:42:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:42:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:42:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:42:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:42:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:42:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:42:33 - XML: Processed 646070 elements - found 0 jobs
Sun 19 Jan 2014 00:42:33 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:42:33 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:42:33 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:42:33 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:42:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:42:35 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:42:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:42:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:42:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:42:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:42:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:42:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:42:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:42:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43522099
Sun 19 Jan 2014 00:42:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:42:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43522099
Sun 19 Jan 2014 00:42:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:42:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:42:42 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:42:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:42:44 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:42:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 00:42:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 00:42:44 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:42:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7117 values 112205 bits 14025 bytes 
Sun 19 Jan 2014 00:42:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:42:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:42:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:42:47 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:42:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:42:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:42:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:42:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:42:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:42:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:42:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:42:48 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:42:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:42:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:42:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:42:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:42:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:42:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:42:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:42:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:42:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:42:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:42:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:42:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43610006
Sun 19 Jan 2014 00:42:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:42:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43610006
Sun 19 Jan 2014 00:42:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:42:59 - job_xml_thread(): Done retrieving: data size 43610006
Sun 19 Jan 2014 00:42:59 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:42:59 - XML: Start document: iteration 2
Sun 19 Jan 2014 00:43:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:43:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:43:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:43:07 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:43:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:43:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:43:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:43:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:43:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:43:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:43:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:43:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:43:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:43:16 - XML: Processed 654032 elements - found 0 jobs
Sun 19 Jan 2014 00:43:16 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:43:16 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:43:16 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:43:16 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:43:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:43:19 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:43:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:43:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:43:19 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:43:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 00:43:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:43:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:43:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:43:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:43:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:43:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:43:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43595881
Sun 19 Jan 2014 00:43:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:43:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43595881
Sun 19 Jan 2014 00:43:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:43:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:43:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:43:31 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:43:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:43:31 - job_xml_thread(): Done retrieving: data size 43595881
Sun 19 Jan 2014 00:43:31 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:43:31 - XML: Start document: iteration 3
Sun 19 Jan 2014 00:43:31 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:43:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:43:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:43:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:43:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:43:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:43:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:43:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:43:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:43:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:43:39 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 00:43:39 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:43:39 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:43:39 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:43:39 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:43:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:43:42 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:43:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:43:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:43:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:43:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:43:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:43:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:43:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:43:44 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:43:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:43:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 00:43:45 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:43:45 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:43:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5756 values 90735 bits 11341 bytes 
Sun 19 Jan 2014 00:43:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 00:43:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:43:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43618731
Sun 19 Jan 2014 00:43:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:43:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43618731
Sun 19 Jan 2014 00:43:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:43:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:43:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:43:54 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:43:54 - job_xml_thread(): Done retrieving: data size 43618731
Sun 19 Jan 2014 00:43:54 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:43:54 - XML: Start document: iteration 4
Sun 19 Jan 2014 00:43:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:43:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:43:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:43:59 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:43:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:44:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:44:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:44:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:44:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:44:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:44:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:44:10 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 00:44:10 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:44:10 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:44:10 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:44:10 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:44:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:44:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:44:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:44:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:44:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:44:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:44:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:44:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:44:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:44:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43612922
Sun 19 Jan 2014 00:44:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:44:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43612922
Sun 19 Jan 2014 00:44:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:44:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:44:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:44:25 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:44:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:44:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:44:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:44:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:44:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:44:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:44:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:44:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:44:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:44:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:44:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:44:29 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:44:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 00:44:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:44:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:44:31 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:44:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:44:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:44:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:44:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:44:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:44:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:44:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:44:33 - job_xml_thread(): Done retrieving: data size 43643866
Sun 19 Jan 2014 00:44:33 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:44:33 - XML: Start document: iteration 5
Sun 19 Jan 2014 00:44:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43643866
Sun 19 Jan 2014 00:44:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43643866
Sun 19 Jan 2014 00:44:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:44:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:44:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:44:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:44:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:44:46 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:44:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:44:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:44:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:44:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 00:44:47 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:44:47 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:44:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 00:44:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6087 values 95973 bits 11996 bytes 
Sun 19 Jan 2014 00:44:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:44:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:44:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:44:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:44:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:44:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:44:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:44:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:44:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:44:54 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 00:44:54 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:44:54 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:44:54 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:44:54 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:44:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:44:58 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:44:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:44:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:44:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:44:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:44:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:44:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:45:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:45:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43638914
Sun 19 Jan 2014 00:45:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:45:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43638914
Sun 19 Jan 2014 00:45:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:45:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:45:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:45:10 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:45:10 - job_xml_thread(): Done retrieving: data size 43638914
Sun 19 Jan 2014 00:45:10 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:45:10 - XML: Start document: iteration 6
Sun 19 Jan 2014 00:45:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:45:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:45:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:45:19 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:45:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:45:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:45:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:45:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:45:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:45:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:45:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:45:20 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:45:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 00:45:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:45:25 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 00:45:25 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:45:25 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:45:25 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:45:25 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:45:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:45:26 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:45:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:45:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:45:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:45:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:45:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:45:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:45:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:45:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43618900
Sun 19 Jan 2014 00:45:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:45:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43618900
Sun 19 Jan 2014 00:45:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:45:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:45:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:45:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:45:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:45:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:45:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:45:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:45:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:45:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:45:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:45:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:45:41 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:45:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:45:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:45:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:45:45 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:45:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:45:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:45:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:45:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:45:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:45:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:45:47 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 00:45:47 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 00:45:47 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:45:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:45:47 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:45:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:45:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43638162
Sun 19 Jan 2014 00:45:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:45:48 - job_xml_thread(): Done retrieving: data size 43638162
Sun 19 Jan 2014 00:45:48 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:45:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:45:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 00:45:48 - XML: Start document: iteration 7
Sun 19 Jan 2014 00:45:48 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:45:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 00:45:48 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:45:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43638162
Sun 19 Jan 2014 00:45:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:45:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6486 values 102337 bits 12792 bytes 
Sun 19 Jan 2014 00:45:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:45:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:46:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:46:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:46:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:46:04 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:46:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:46:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:46:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:46:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:46:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:46:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:46:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:46:06 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 00:46:06 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:46:06 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:46:06 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:46:06 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:46:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:46:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:46:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:46:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:46:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:46:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:46:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:46:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:46:13 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:46:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 00:46:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:46:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:46:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43629340
Sun 19 Jan 2014 00:46:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:46:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43629340
Sun 19 Jan 2014 00:46:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:46:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:46:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:46:21 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:46:21 - job_xml_thread(): Done retrieving: data size 43629340
Sun 19 Jan 2014 00:46:21 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:46:21 - XML: Start document: iteration 8
Sun 19 Jan 2014 00:46:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:46:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:46:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:46:31 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:46:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:46:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:46:32 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 00:46:32 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:46:32 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:46:33 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:46:33 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:46:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:46:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:46:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:46:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:46:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:46:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:46:34 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:46:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:46:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:46:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:46:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:46:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:46:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:46:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:46:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43650115
Sun 19 Jan 2014 00:46:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:46:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43650115
Sun 19 Jan 2014 00:46:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:46:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:46:45 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:46:48 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:46:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:46:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:46:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:46:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:46:48 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:46:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:46:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:46:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:46:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:46:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:46:49 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:46:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 00:46:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 00:46:49 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:46:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99214 bits 12401 bytes 
Sun 19 Jan 2014 00:46:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:46:49 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:46:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:46:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:46:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:46:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:46:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:46:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:46:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:46:52 - job_xml_thread(): Done retrieving: data size 43644902
Sun 19 Jan 2014 00:46:52 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:46:52 - XML: Start document: iteration 9
Sun 19 Jan 2014 00:46:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43644902
Sun 19 Jan 2014 00:46:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:46:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43644902
Sun 19 Jan 2014 00:46:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:47:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:47:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:47:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:47:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:47:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:47:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:47:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:47:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:47:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:47:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:47:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:47:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:47:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:47:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:47:15 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:47:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:47:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:47:17 - XML: Processed 654195 elements - found 0 jobs
Sun 19 Jan 2014 00:47:17 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:47:17 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:47:17 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:47:17 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:47:17 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:47:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 00:47:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:47:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:47:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:47:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:47:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:47:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:47:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43548144
Sun 19 Jan 2014 00:47:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:47:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43548144
Sun 19 Jan 2014 00:47:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:47:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:47:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:47:32 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:47:32 - job_xml_thread(): Done retrieving: data size 43548144
Sun 19 Jan 2014 00:47:32 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:47:32 - XML: Start document: iteration 10
Sun 19 Jan 2014 00:47:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:47:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:47:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:47:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:47:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:47:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:47:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:47:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:47:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:47:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:47:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:47:40 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 00:47:40 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:47:42 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:47:42 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 00:47:42 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:47:42 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 00:47:42 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 00:47:46 - XML: Processed 653444 elements - found 0 jobs
Sun 19 Jan 2014 00:47:46 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:47:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:47:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:47:46 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:47:46 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:47:46 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:47:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:47:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:47:47 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 757556 values 11957570 bits 1494696 bytes 
Sun 19 Jan 2014 00:47:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:47:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:47:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:47:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:47:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:47:49 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:47:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:47:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 00:47:49 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:47:49 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:47:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 00:47:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5715 values 90335 bits 11291 bytes 
Sun 19 Jan 2014 00:47:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:47:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:47:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:47:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43015017
Sun 19 Jan 2014 00:47:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:47:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43015017
Sun 19 Jan 2014 00:47:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:48:01 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:48:01 - job_xml_thread(): Done retrieving: data size 43015017
Sun 19 Jan 2014 00:48:01 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:48:01 - XML: Start document: iteration 11
Sun 19 Jan 2014 00:48:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:48:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:48:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:48:04 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:48:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:48:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:48:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:48:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:48:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:48:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:48:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:48:12 - XML: Processed 646894 elements - found 0 jobs
Sun 19 Jan 2014 00:48:12 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:48:12 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:48:12 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:48:12 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:48:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:48:14 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:48:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:48:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:48:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:48:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:48:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:48:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:48:16 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:48:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 00:48:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:48:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:48:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42984803
Sun 19 Jan 2014 00:48:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:48:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42984803
Sun 19 Jan 2014 00:48:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:48:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:48:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:48:27 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:48:27 - job_xml_thread(): Done retrieving: data size 42984803
Sun 19 Jan 2014 00:48:27 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:48:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:48:27 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:48:27 - XML: Start document: iteration 12
Sun 19 Jan 2014 00:48:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:48:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:48:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:48:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:48:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:48:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:48:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:48:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:48:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:48:39 - XML: Processed 646242 elements - found 0 jobs
Sun 19 Jan 2014 00:48:39 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:48:39 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:48:39 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:48:39 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:48:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:48:39 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:48:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:48:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:48:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:48:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:48:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:48:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:48:42 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:48:42 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 00:48:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:48:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43483184
Sun 19 Jan 2014 00:48:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:48:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43483184
Sun 19 Jan 2014 00:48:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:48:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:48:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:48:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:48:50 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:48:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:48:50 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:48:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 00:48:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 00:48:50 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:48:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7428 values 117314 bits 14664 bytes 
Sun 19 Jan 2014 00:48:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:48:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:48:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:48:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:48:54 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:48:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:48:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:48:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:48:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:48:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:48:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:48:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:48:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:48:58 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:48:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:48:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:48:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:48:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:48:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:48:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:49:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:49:03 - job_xml_thread(): Done retrieving: data size 43614932
Sun 19 Jan 2014 00:49:03 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:49:03 - XML: Start document: iteration 13
Sun 19 Jan 2014 00:49:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43614932
Sun 19 Jan 2014 00:49:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:49:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43614932
Sun 19 Jan 2014 00:49:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:49:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:49:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:49:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:49:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:49:21 - XML: Processed 653932 elements - found 0 jobs
Sun 19 Jan 2014 00:49:21 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:49:21 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:49:21 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:49:21 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:49:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:49:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:49:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:49:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:49:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:49:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:49:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:49:24 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:49:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 00:49:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:49:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:49:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:49:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:49:26 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:49:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:49:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:49:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:49:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:49:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:49:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:49:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:49:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43637211
Sun 19 Jan 2014 00:49:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:49:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43637211
Sun 19 Jan 2014 00:49:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:49:36 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:49:36 - job_xml_thread(): Done retrieving: data size 43637211
Sun 19 Jan 2014 00:49:36 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:49:37 - XML: Start document: iteration 14
Sun 19 Jan 2014 00:49:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:49:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:49:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:49:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:49:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:49:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:49:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:49:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:49:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:49:50 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:49:50 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 00:49:50 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:49:50 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:49:50 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:49:50 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:49:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:49:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:49:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:49:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:49:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:49:51 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:49:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 00:49:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:49:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 00:49:51 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:49:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5911 values 93312 bits 11664 bytes 
Sun 19 Jan 2014 00:49:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:49:52 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:49:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:49:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:49:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:49:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:49:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:49:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:49:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:49:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43628592
Sun 19 Jan 2014 00:49:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:49:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43628592
Sun 19 Jan 2014 00:49:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:50:05 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:50:05 - job_xml_thread(): Done retrieving: data size 43628592
Sun 19 Jan 2014 00:50:05 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:50:05 - XML: Start document: iteration 15
Sun 19 Jan 2014 00:50:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:50:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:50:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:50:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:50:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:50:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:50:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:50:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:50:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:50:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:50:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:50:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:50:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:50:18 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 00:50:18 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:50:18 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:50:18 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:50:18 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:50:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:50:21 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:50:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:50:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:50:21 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:50:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 00:50:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:50:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:50:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:50:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:50:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:50:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:50:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43607398
Sun 19 Jan 2014 00:50:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:50:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43607398
Sun 19 Jan 2014 00:50:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:50:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:50:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:50:33 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:50:33 - job_xml_thread(): Done retrieving: data size 43607398
Sun 19 Jan 2014 00:50:33 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:50:33 - XML: Start document: iteration 16
Sun 19 Jan 2014 00:50:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:50:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:50:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:50:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:50:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:50:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:50:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:50:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:50:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:50:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:50:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:50:46 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 00:50:46 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:50:46 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:50:46 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:50:46 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:50:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:50:47 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:50:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:50:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:50:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:50:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:50:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:50:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:50:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:50:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43611636
Sun 19 Jan 2014 00:50:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:50:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43611636
Sun 19 Jan 2014 00:50:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:50:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:50:51 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:50:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:50:52 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:50:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 00:50:52 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:50:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 00:50:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8430 values 133013 bits 16626 bytes 
Sun 19 Jan 2014 00:50:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:50:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:51:01 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:51:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:51:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:51:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:51:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:51:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:51:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:51:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:51:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:51:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:51:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:51:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:51:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:51:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:51:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:51:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:51:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:51:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:51:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:51:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:51:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:51:11 - job_xml_thread(): Done retrieving: data size 43625302
Sun 19 Jan 2014 00:51:11 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:51:11 - XML: Start document: iteration 17
Sun 19 Jan 2014 00:51:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43625302
Sun 19 Jan 2014 00:51:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:51:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43625302
Sun 19 Jan 2014 00:51:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:51:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:51:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:51:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:51:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:51:26 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 00:51:26 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:51:26 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:51:26 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:51:26 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:51:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:51:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:51:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:51:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:51:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:51:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:51:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:51:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:51:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:51:33 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:51:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 00:51:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:51:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:51:35 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:51:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:51:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:51:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:51:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:51:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:51:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:51:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:51:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43633221
Sun 19 Jan 2014 00:51:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:51:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43633221
Sun 19 Jan 2014 00:51:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:51:41 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:51:41 - job_xml_thread(): Done retrieving: data size 43633221
Sun 19 Jan 2014 00:51:41 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:51:41 - XML: Start document: iteration 18
Sun 19 Jan 2014 00:51:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:51:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:51:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:51:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:51:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:51:52 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:51:54 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:51:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:51:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 00:51:54 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:51:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5902 values 93149 bits 11643 bytes 
Sun 19 Jan 2014 00:51:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 00:51:55 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 00:51:55 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:51:55 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:51:55 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:51:55 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:51:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:51:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:51:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:51:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:51:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:51:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:51:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:51:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:51:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:52:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:52:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:52:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:52:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:52:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:52:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:52:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:52:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:52:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:52:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43621576
Sun 19 Jan 2014 00:52:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:52:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43621576
Sun 19 Jan 2014 00:52:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:52:10 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:52:10 - job_xml_thread(): Done retrieving: data size 43621576
Sun 19 Jan 2014 00:52:10 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:52:10 - XML: Start document: iteration 19
Sun 19 Jan 2014 00:52:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:52:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:52:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:52:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:52:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:52:22 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:52:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:52:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:52:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:52:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:52:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:52:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:52:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:52:24 - XML: Processed 654195 elements - found 0 jobs
Sun 19 Jan 2014 00:52:24 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:52:24 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:52:24 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:52:24 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:52:29 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:52:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 00:52:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:52:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:52:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:52:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:52:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:52:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:52:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:52:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:52:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:52:32 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 00:52:32 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 00:52:32 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:52:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:52:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43620798
Sun 19 Jan 2014 00:52:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:52:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43620798
Sun 19 Jan 2014 00:52:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:52:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:52:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:52:39 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:52:39 - job_xml_thread(): Done retrieving: data size 43620798
Sun 19 Jan 2014 00:52:39 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:52:40 - XML: Start document: iteration 20
Sun 19 Jan 2014 00:52:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:52:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:52:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:52:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:52:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:52:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:52:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:52:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:52:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:52:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:52:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:52:51 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 00:52:51 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:52:51 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:52:51 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:52:51 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:52:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:52:54 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:52:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:52:55 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:52:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:52:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:52:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:52:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:52:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:52:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:52:55 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:52:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 00:52:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 00:52:55 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:52:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:52:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5752 values 90737 bits 11342 bytes 
Sun 19 Jan 2014 00:52:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:52:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43640606
Sun 19 Jan 2014 00:52:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:52:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43640606
Sun 19 Jan 2014 00:52:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:53:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:53:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:53:06 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:53:06 - job_xml_thread(): Done retrieving: data size 43640606
Sun 19 Jan 2014 00:53:06 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:53:06 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 00:53:07 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 00:53:07 - Housekeeping: done.
Sun 19 Jan 2014 00:53:07 - XML: Start document: iteration 0
Sun 19 Jan 2014 00:53:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:53:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:53:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:53:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:53:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:53:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:53:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:53:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:53:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:53:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:53:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:53:21 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 00:53:21 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:53:21 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:53:21 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:53:21 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:53:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:53:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:53:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:53:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:53:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:53:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:53:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:53:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:53:23 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:53:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 00:53:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:53:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:53:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43541918
Sun 19 Jan 2014 00:53:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:53:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43541918
Sun 19 Jan 2014 00:53:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:53:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:53:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:53:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:53:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:53:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:53:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:53:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:53:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:53:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:53:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:53:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:53:36 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:53:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:53:37 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:53:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:53:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:53:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:53:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:53:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:53:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:53:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:53:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43060979
Sun 19 Jan 2014 00:53:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:53:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43060979
Sun 19 Jan 2014 00:53:42 - job_xml_thread(): Done retrieving: data size 43060979
Sun 19 Jan 2014 00:53:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:53:42 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:53:42 - XML: Start document: iteration 1
Sun 19 Jan 2014 00:53:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:53:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:53:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:53:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:53:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:53:55 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:53:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:53:57 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:53:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 00:53:57 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:53:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 00:53:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:53:58 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:53:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8161 values 128732 bits 16091 bytes 
Sun 19 Jan 2014 00:53:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:53:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:53:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:53:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:53:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:53:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:53:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:54:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:54:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:54:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:54:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:54:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:54:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:54:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:54:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:54:04 - XML: Processed 647084 elements - found 0 jobs
Sun 19 Jan 2014 00:54:04 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:54:04 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:54:04 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:54:04 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:54:08 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:54:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 00:54:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:54:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:54:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42962254
Sun 19 Jan 2014 00:54:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:54:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42962254
Sun 19 Jan 2014 00:54:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:54:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:54:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:54:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:54:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:54:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:54:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:54:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:54:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:54:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:54:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:54:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:54:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:54:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:54:20 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:54:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:54:21 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:54:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:54:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:54:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:54:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:54:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:54:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:54:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:54:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43033330
Sun 19 Jan 2014 00:54:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:54:24 - job_xml_thread(): Done retrieving: data size 43033330
Sun 19 Jan 2014 00:54:24 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:54:24 - XML: Start document: iteration 2
Sun 19 Jan 2014 00:54:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43033330
Sun 19 Jan 2014 00:54:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:54:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:54:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:54:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:54:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:54:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:54:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:54:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:54:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:54:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:54:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:54:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:54:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:54:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:54:42 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 00:54:42 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:54:43 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:54:43 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 00:54:43 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 00:54:43 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:54:43 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 00:54:45 - XML: Processed 646746 elements - found 0 jobs
Sun 19 Jan 2014 00:54:45 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:54:45 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:54:45 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:54:45 - job_xml_thread(): Sleeping.. (15s)
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sun 19 Jan 2014 00:54:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:54:47 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:54:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:54:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:54:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:54:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:54:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:54:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:54:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:54:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578239
Sun 19 Jan 2014 00:54:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:54:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578239
Sun 19 Jan 2014 00:54:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:54:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:54:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:54:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:54:57 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:54:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:54:59 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:54:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 00:54:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 00:54:59 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:55:00 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:55:00 - job_xml_thread(): Done retrieving: data size 43578239
Sun 19 Jan 2014 00:55:00 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:55:00 - XML: Start document: iteration 3
Sun 19 Jan 2014 00:55:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148642 bits 18580 bytes 
Sun 19 Jan 2014 00:55:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:55:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:55:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:55:04 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:55:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:55:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:55:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:55:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:55:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:55:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:55:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:55:13 - XML: Processed 653900 elements - found 0 jobs
Sun 19 Jan 2014 00:55:13 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:55:13 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:55:13 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:55:13 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:55:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:55:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:55:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:55:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:55:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:55:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:55:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:55:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:55:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:55:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43623807
Sun 19 Jan 2014 00:55:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:55:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43623807
Sun 19 Jan 2014 00:55:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:55:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:55:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:55:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:55:27 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:55:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:55:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:55:28 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:55:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:55:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:55:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:55:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:55:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:55:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:55:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:55:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:55:31 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:55:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:55:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:55:31 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:55:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 00:55:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:55:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:55:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:55:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:55:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:55:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:55:33 - job_xml_thread(): Done retrieving: data size 43629548
Sun 19 Jan 2014 00:55:33 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:55:33 - XML: Start document: iteration 4
Sun 19 Jan 2014 00:55:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43629548
Sun 19 Jan 2014 00:55:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:55:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43629548
Sun 19 Jan 2014 00:55:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:55:43 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:55:43 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:55:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:55:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:55:45 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:55:45 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 00:55:45 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 00:55:45 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:55:45 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 00:55:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:55:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:55:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:55:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:55:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:55:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:55:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:55:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:55:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:55:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:55:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:55:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:55:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:55:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:55:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:55:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:55:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:55:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:55:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:55:57 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 840362 values 13248282 bits 1656035 bytes 
Sun 19 Jan 2014 00:55:58 - XML: Processed 654193 elements - found 0 jobs
Sun 19 Jan 2014 00:55:58 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:55:58 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:55:58 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:55:58 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:55:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:55:59 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:56:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:56:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 00:56:00 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:56:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5856 values 92378 bits 11547 bytes 
Sun 19 Jan 2014 00:56:00 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:56:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 00:56:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:56:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:56:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:56:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43609802
Sun 19 Jan 2014 00:56:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:56:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43609802
Sun 19 Jan 2014 00:56:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:56:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:56:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:56:13 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:56:13 - job_xml_thread(): Done retrieving: data size 43609802
Sun 19 Jan 2014 00:56:13 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:56:13 - XML: Start document: iteration 5
Sun 19 Jan 2014 00:56:25 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 00:56:25 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:56:25 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:56:25 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:56:25 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:56:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:56:27 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:56:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:56:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:56:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:56:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:56:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:56:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:56:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:56:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:56:31 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:56:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:56:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:56:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:56:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:56:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:56:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:56:33 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:56:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 00:56:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:56:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:56:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43633905
Sun 19 Jan 2014 00:56:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:56:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43633905
Sun 19 Jan 2014 00:56:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:56:40 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:56:40 - job_xml_thread(): Done retrieving: data size 43633905
Sun 19 Jan 2014 00:56:40 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:56:41 - XML: Start document: iteration 6
Sun 19 Jan 2014 00:56:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:56:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:56:45 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:56:46 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 00:56:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:56:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:56:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:56:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:56:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:56:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:56:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:56:55 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:56:56 - XML: Processed 654194 elements - found 0 jobs
Sun 19 Jan 2014 00:56:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:56:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:56:56 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:56:56 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:56:56 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:56:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:56:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:56:56 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:56:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:56:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:56:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:56:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:56:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:56:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:56:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:57:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:57:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43661482
Sun 19 Jan 2014 00:57:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:57:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43661482
Sun 19 Jan 2014 00:57:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:57:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:57:01 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:57:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:57:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 00:57:04 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:57:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 00:57:04 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:57:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8206 values 129451 bits 16181 bytes 
Sun 19 Jan 2014 00:57:11 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:57:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:57:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:57:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:57:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:57:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:57:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:57:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:57:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:57:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:57:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:57:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:57:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:57:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:57:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:57:16 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:57:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:57:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:57:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:57:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:57:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:57:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:57:19 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:57:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 00:57:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:57:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:57:19 - job_xml_thread(): Done retrieving: data size 43650309
Sun 19 Jan 2014 00:57:19 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:57:19 - XML: Start document: iteration 7
Sun 19 Jan 2014 00:57:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43650309
Sun 19 Jan 2014 00:57:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:57:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43650309
Sun 19 Jan 2014 00:57:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:57:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:57:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:57:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:57:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:57:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:57:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:57:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:57:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:57:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:57:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:57:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:57:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:57:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:57:38 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 00:57:38 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:57:38 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:57:38 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:57:38 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:57:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:57:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:57:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:57:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:57:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:57:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:57:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:57:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:57:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:57:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43621982
Sun 19 Jan 2014 00:57:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:57:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43621982
Sun 19 Jan 2014 00:57:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:57:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:57:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:57:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:57:54 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:57:54 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:57:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:57:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:57:54 - job_xml_thread(): Done retrieving: data size 43621982
Sun 19 Jan 2014 00:57:54 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:57:54 - XML: Start document: iteration 8
Sun 19 Jan 2014 00:57:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:57:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:57:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:57:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:57:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:57:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:57:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:58:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:58:05 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:58:05 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 00:58:05 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:58:06 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:58:06 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:58:06 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:58:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:58:06 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:58:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 00:58:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 00:58:06 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:58:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99099 bits 12387 bytes 
Sun 19 Jan 2014 00:58:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:58:07 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:58:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:58:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:58:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:58:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:58:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:58:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:58:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:58:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:58:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:58:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43606039
Sun 19 Jan 2014 00:58:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:58:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43606039
Sun 19 Jan 2014 00:58:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:58:22 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:58:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:58:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:58:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:58:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:58:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:58:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:58:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:58:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:58:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:58:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:58:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:58:30 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:58:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 00:58:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:58:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:58:31 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:58:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:58:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:58:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:58:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:58:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:58:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:58:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:58:33 - job_xml_thread(): Done retrieving: data size 43633621
Sun 19 Jan 2014 00:58:33 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:58:33 - XML: Start document: iteration 9
Sun 19 Jan 2014 00:58:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43633621
Sun 19 Jan 2014 00:58:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43633621
Sun 19 Jan 2014 00:58:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:58:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:58:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:58:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:58:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:58:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:58:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:58:53 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:58:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:58:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:58:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:58:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:58:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:58:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:58:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:58:56 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 00:58:56 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:58:56 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:58:56 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:58:56 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:58:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:58:57 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:58:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:58:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:58:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:58:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:58:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:58:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:59:01 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 00:59:01 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 00:59:01 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:59:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:59:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43641323
Sun 19 Jan 2014 00:59:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:59:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43641323
Sun 19 Jan 2014 00:59:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:59:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:59:06 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:59:07 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:59:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:59:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 00:59:07 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:59:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 00:59:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8923 values 140709 bits 17588 bytes 
Sun 19 Jan 2014 00:59:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:59:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:59:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:59:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:59:11 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:59:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:59:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:59:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:59:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:59:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:59:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:59:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:59:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:59:16 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:59:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:59:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:59:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:59:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:59:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:59:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:59:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:59:19 - job_xml_thread(): Done retrieving: data size 43579911
Sun 19 Jan 2014 00:59:19 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:59:19 - XML: Start document: iteration 10
Sun 19 Jan 2014 00:59:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579911
Sun 19 Jan 2014 00:59:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579911
Sun 19 Jan 2014 00:59:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:59:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:59:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:59:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:59:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:59:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:59:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:59:36 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:59:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:59:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:59:37 - XML: Processed 653446 elements - found 0 jobs
Sun 19 Jan 2014 00:59:37 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 00:59:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:59:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:59:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:59:37 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 00:59:37 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 00:59:37 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 00:59:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:59:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 00:59:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 00:59:42 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 00:59:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 00:59:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 00:59:43 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 00:59:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 00:59:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:59:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:59:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 00:59:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 00:59:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 00:59:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 00:59:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43018333
Sun 19 Jan 2014 00:59:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:59:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43018333
Sun 19 Jan 2014 00:59:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 00:59:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 00:59:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 00:59:52 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 00:59:52 - job_xml_thread(): Done retrieving: data size 43018333
Sun 19 Jan 2014 00:59:52 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 00:59:53 - XML: Start document: iteration 11
Sun 19 Jan 2014 00:59:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 00:59:54 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 00:59:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 00:59:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 00:59:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:59:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 00:59:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 00:59:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43018333
Sun 19 Jan 2014 00:59:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 00:59:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 00:59:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 00:59:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:00:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:00:07 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:00:08 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:00:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:00:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 01:00:08 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:00:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5666 values 89294 bits 11161 bytes 
Sun 19 Jan 2014 01:00:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 01:00:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:00:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:00:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:00:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:00:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:00:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:00:11 - XML: Processed 646758 elements - found 0 jobs
Sun 19 Jan 2014 01:00:11 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:00:11 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:00:11 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:00:11 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:00:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:00:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:00:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:00:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:00:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:00:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:00:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:00:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:00:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:00:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:00:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:00:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:00:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:00:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:00:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43038166
Sun 19 Jan 2014 01:00:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:00:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43038166
Sun 19 Jan 2014 01:00:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:00:26 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:00:26 - job_xml_thread(): Done retrieving: data size 43038166
Sun 19 Jan 2014 01:00:26 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:00:26 - XML: Start document: iteration 12
Sun 19 Jan 2014 01:00:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:00:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:00:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:00:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:00:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:00:32 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:00:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:00:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:00:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:00:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:00:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:00:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:00:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:00:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:00:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:00:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:00:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:00:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:00:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:00:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:00:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:00:36 - XML: Processed 646746 elements - found 0 jobs
Sun 19 Jan 2014 01:00:36 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:00:36 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:00:36 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:00:36 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:00:37 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:00:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 01:00:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:00:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:00:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43433629
Sun 19 Jan 2014 01:00:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:00:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43433629
Sun 19 Jan 2014 01:00:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:00:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:00:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:00:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:00:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:00:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:00:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:00:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:00:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:00:51 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:00:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:00:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:00:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:00:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:00:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:00:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:00:53 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:00:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:00:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:00:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:00:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:00:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:00:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:00:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:00:56 - job_xml_thread(): Done retrieving: data size 43626027
Sun 19 Jan 2014 01:00:56 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:00:56 - XML: Start document: iteration 13
Sun 19 Jan 2014 01:00:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43626027
Sun 19 Jan 2014 01:00:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:00:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43626027
Sun 19 Jan 2014 01:00:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:01:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:01:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:01:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:01:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:01:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:01:09 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:01:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:01:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:01:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:01:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:01:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:01:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:01:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:01:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 01:01:09 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:01:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:01:09 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:01:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:01:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:01:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 01:01:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9084 values 143407 bits 17925 bytes 
Sun 19 Jan 2014 01:01:17 - XML: Processed 654111 elements - found 0 jobs
Sun 19 Jan 2014 01:01:17 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:01:17 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:01:17 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:01:17 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:01:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:01:18 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:01:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:01:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:01:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:01:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:01:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:01:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:01:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:01:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43619488
Sun 19 Jan 2014 01:01:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:01:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43619488
Sun 19 Jan 2014 01:01:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:01:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:01:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:01:32 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:01:32 - job_xml_thread(): Done retrieving: data size 43619488
Sun 19 Jan 2014 01:01:32 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:01:32 - XML: Start document: iteration 14
Sun 19 Jan 2014 01:01:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:01:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:01:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:01:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:01:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:01:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:01:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:01:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:01:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:01:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:01:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:01:42 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 01:01:42 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:01:42 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:01:42 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:01:42 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:01:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:01:45 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:01:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:01:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:01:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:01:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:01:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:01:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:01:46 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:01:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 01:01:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:01:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:01:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43635903
Sun 19 Jan 2014 01:01:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:01:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43635903
Sun 19 Jan 2014 01:01:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:01:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:01:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:01:57 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:01:57 - job_xml_thread(): Done retrieving: data size 43635903
Sun 19 Jan 2014 01:01:57 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:01:57 - XML: Start document: iteration 15
Sun 19 Jan 2014 01:01:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:01:58 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:01:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:01:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:02:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:02:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:02:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:02:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:02:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:02:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:02:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:02:05 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 01:02:05 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:02:05 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:02:05 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:02:05 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:02:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:02:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:02:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:02:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:02:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:02:09 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:02:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:02:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 01:02:09 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:02:09 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:02:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 01:02:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:02:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:02:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:02:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:02:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5538 values 87570 bits 10946 bytes 
Sun 19 Jan 2014 01:02:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:02:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43660704
Sun 19 Jan 2014 01:02:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:02:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43660704
Sun 19 Jan 2014 01:02:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:02:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:02:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:02:20 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:02:21 - job_xml_thread(): Done retrieving: data size 43660704
Sun 19 Jan 2014 01:02:21 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:02:21 - XML: Start document: iteration 16
Sun 19 Jan 2014 01:02:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:02:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:02:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:02:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:02:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:02:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:02:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:02:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:02:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:02:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:02:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:02:35 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 01:02:35 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:02:35 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:02:35 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:02:35 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:02:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:02:35 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:02:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:02:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:02:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:02:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:02:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:02:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:02:36 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:02:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 01:02:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:02:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:02:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43674263
Sun 19 Jan 2014 01:02:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:02:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43674263
Sun 19 Jan 2014 01:02:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:02:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:02:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:02:46 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 01:02:46 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:02:49 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:02:49 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:02:49 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 01:02:49 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 01:02:49 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 01:02:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:02:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:02:50 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:02:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:02:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:02:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:02:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:02:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:02:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:02:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:02:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:02:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:02:53 - size of cluster 'LISA Cluster': 624 hosts 79483 metrics 749215 values 11825617 bits 1478202 bytes 
Sun 19 Jan 2014 01:02:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:02:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:02:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:02:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:02:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:02:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:02:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:02:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:02:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:02:58 - job_xml_thread(): Done retrieving: data size 43696762
Sun 19 Jan 2014 01:02:58 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:02:58 - XML: Start document: iteration 17
Sun 19 Jan 2014 01:02:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43696762
Sun 19 Jan 2014 01:02:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:02:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43696762
Sun 19 Jan 2014 01:03:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:03:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:03:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:03:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:03:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:03:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:03:09 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:03:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:03:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 01:03:10 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:03:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 01:03:10 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:03:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8233 values 130232 bits 16279 bytes 
Sun 19 Jan 2014 01:03:15 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 01:03:15 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:03:15 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:03:15 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:03:15 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:03:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:03:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:03:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:03:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:03:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:03:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:03:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:03:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:03:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:03:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:03:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:03:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:03:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:03:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:03:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:03:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:03:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:03:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:03:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43747422
Sun 19 Jan 2014 01:03:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:03:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43747422
Sun 19 Jan 2014 01:03:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:03:30 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:03:30 - job_xml_thread(): Done retrieving: data size 43747422
Sun 19 Jan 2014 01:03:30 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:03:30 - XML: Start document: iteration 18
Sun 19 Jan 2014 01:03:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:03:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:03:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:03:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:03:40 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 01:03:40 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:03:40 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:03:40 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:03:40 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:03:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:03:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:03:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:03:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:03:49 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:03:49 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 01:03:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:03:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:03:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:03:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:03:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:03:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:03:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:03:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:03:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:03:50 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:03:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 01:03:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:03:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:03:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:03:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:03:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:03:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:03:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43747690
Sun 19 Jan 2014 01:03:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:03:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43747690
Sun 19 Jan 2014 01:03:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:03:55 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:03:55 - job_xml_thread(): Done retrieving: data size 43747690
Sun 19 Jan 2014 01:03:55 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:03:55 - XML: Start document: iteration 19
Sun 19 Jan 2014 01:04:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:04:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:04:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:04:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:04:08 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 01:04:08 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:04:08 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:04:08 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:04:08 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:04:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:04:10 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:04:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:04:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 01:04:11 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:04:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 01:04:11 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:04:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5949 values 93957 bits 11744 bytes 
Sun 19 Jan 2014 01:04:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:04:13 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:04:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:04:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:04:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:04:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:04:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:04:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:04:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:04:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:04:16 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:04:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:04:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:04:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:04:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:04:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:04:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:04:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:04:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43747339
Sun 19 Jan 2014 01:04:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:04:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43747339
Sun 19 Jan 2014 01:04:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:04:23 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:04:23 - job_xml_thread(): Done retrieving: data size 43747339
Sun 19 Jan 2014 01:04:23 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:04:23 - XML: Start document: iteration 20
Sun 19 Jan 2014 01:04:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:04:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:04:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:04:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:04:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:04:36 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:04:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:04:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:04:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:04:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:04:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:04:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:04:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:04:38 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:04:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 01:04:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:04:43 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 01:04:43 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:04:43 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:04:43 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:04:43 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:04:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:04:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:04:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:04:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:04:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:04:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:04:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:04:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:04:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:04:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43745158
Sun 19 Jan 2014 01:04:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:04:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43745158
Sun 19 Jan 2014 01:04:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:04:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:04:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:04:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:04:57 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:04:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:04:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:04:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:04:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:04:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:04:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:04:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:04:58 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:05:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:05:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:05:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:05:00 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:05:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:05:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:05:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:05:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:05:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:05:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:05:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:05:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43746502
Sun 19 Jan 2014 01:05:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:05:04 - job_xml_thread(): Done retrieving: data size 43746502
Sun 19 Jan 2014 01:05:04 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:05:04 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 01:05:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43746502
Sun 19 Jan 2014 01:05:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:05:05 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 01:05:05 - Housekeeping: done.
Sun 19 Jan 2014 01:05:05 - XML: Start document: iteration 0
Sun 19 Jan 2014 01:05:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:05:12 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:05:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:05:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:05:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:05:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 01:05:14 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:05:15 - XML: Processed 654196 elements - found 0 jobs
Sun 19 Jan 2014 01:05:15 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:05:15 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:05:15 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:05:15 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:05:15 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:05:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9030 values 142528 bits 17816 bytes 
Sun 19 Jan 2014 01:05:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 01:05:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:05:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:05:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:05:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:05:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:05:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:05:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:05:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:05:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:05:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:05:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:05:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:05:26 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:05:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:05:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:05:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:05:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:05:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:05:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:05:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:05:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43524331
Sun 19 Jan 2014 01:05:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:05:30 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:05:30 - job_xml_thread(): Done retrieving: data size 43524331
Sun 19 Jan 2014 01:05:30 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:05:30 - XML: Start document: iteration 1
Sun 19 Jan 2014 01:05:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43524331
Sun 19 Jan 2014 01:05:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:05:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:05:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:05:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:05:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:05:46 - XML: Processed 651534 elements - found 0 jobs
Sun 19 Jan 2014 01:05:46 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:05:46 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:05:46 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:05:46 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:05:48 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:05:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 01:05:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:05:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:05:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:05:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:05:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:05:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:05:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:05:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:05:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:05:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:05:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:05:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:05:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:05:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:05:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:05:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:05:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:05:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:05:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:05:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43082122
Sun 19 Jan 2014 01:05:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:05:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43082122
Sun 19 Jan 2014 01:05:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:06:01 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:06:01 - job_xml_thread(): Done retrieving: data size 43082122
Sun 19 Jan 2014 01:06:01 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:06:01 - XML: Start document: iteration 2
Sun 19 Jan 2014 01:06:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:06:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:06:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:06:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:06:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:06:10 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:06:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:06:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:06:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:06:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:06:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:06:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:06:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:06:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:06:15 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:06:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:06:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 01:06:16 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:06:16 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:06:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5664 values 89301 bits 11162 bytes 
Sun 19 Jan 2014 01:06:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 01:06:18 - XML: Processed 646014 elements - found 0 jobs
Sun 19 Jan 2014 01:06:18 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:06:18 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:06:18 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:06:18 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:06:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:06:19 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:06:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:06:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:06:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:06:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:06:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:06:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:06:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:06:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43083382
Sun 19 Jan 2014 01:06:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:06:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43083382
Sun 19 Jan 2014 01:06:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:06:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:06:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:06:33 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:06:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:06:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:06:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:06:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:06:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:06:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:06:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:06:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:06:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:06:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:06:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:06:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:06:39 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:06:39 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:06:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 01:06:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:06:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:06:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:06:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:06:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:06:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:06:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:06:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:06:41 - job_xml_thread(): Done retrieving: data size 43083269
Sun 19 Jan 2014 01:06:41 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:06:41 - XML: Start document: iteration 3
Sun 19 Jan 2014 01:06:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43083269
Sun 19 Jan 2014 01:06:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:06:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43083269
Sun 19 Jan 2014 01:06:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:06:49 - XML: Processed 646070 elements - found 0 jobs
Sun 19 Jan 2014 01:06:49 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:06:49 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:06:49 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:06:49 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:06:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:06:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:06:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:06:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:06:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:06:58 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:06:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:06:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:06:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:06:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:06:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:06:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:06:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:07:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:07:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:07:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:07:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:07:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:07:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:07:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:07:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:07:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:07:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43086535
Sun 19 Jan 2014 01:07:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:07:04 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:07:05 - job_xml_thread(): Done retrieving: data size 43086535
Sun 19 Jan 2014 01:07:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43086535
Sun 19 Jan 2014 01:07:05 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:07:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:07:05 - XML: Start document: iteration 4
Sun 19 Jan 2014 01:07:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:07:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:07:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:07:16 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:07:17 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:07:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:07:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 01:07:17 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:07:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 01:07:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9057 values 142886 bits 17860 bytes 
Sun 19 Jan 2014 01:07:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:07:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:07:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:07:18 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:07:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:07:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:07:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:07:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:07:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:07:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:07:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:07:28 - XML: Processed 646070 elements - found 0 jobs
Sun 19 Jan 2014 01:07:28 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:07:28 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:07:28 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:07:28 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:07:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:07:28 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:07:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:07:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:07:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:07:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:07:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:07:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:07:29 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 01:07:29 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 01:07:29 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:07:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:07:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43081910
Sun 19 Jan 2014 01:07:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:07:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43081910
Sun 19 Jan 2014 01:07:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:07:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:07:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:07:43 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:07:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:07:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:07:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:07:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:07:44 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:07:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:07:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:07:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:07:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:07:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:07:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:07:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:07:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:07:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:07:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:07:46 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:07:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 01:07:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:07:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:07:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:07:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:07:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:07:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:07:48 - job_xml_thread(): Done retrieving: data size 43086073
Sun 19 Jan 2014 01:07:48 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:07:48 - XML: Start document: iteration 5
Sun 19 Jan 2014 01:07:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43086073
Sun 19 Jan 2014 01:07:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:07:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43086073
Sun 19 Jan 2014 01:07:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:08:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:08:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:08:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:08:01 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:08:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:08:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:08:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:08:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:08:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:08:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:08:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:08:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:08:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:08:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:08:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:08:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:08:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:08:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:08:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:08:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:08:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:08:10 - XML: Processed 646070 elements - found 0 jobs
Sun 19 Jan 2014 01:08:10 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:08:10 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:08:10 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:08:10 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:08:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:08:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43083999
Sun 19 Jan 2014 01:08:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:08:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43083999
Sun 19 Jan 2014 01:08:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:08:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:08:17 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:08:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:08:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:08:18 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:08:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 01:08:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:08:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 01:08:18 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:08:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9096 values 143591 bits 17948 bytes 
Sun 19 Jan 2014 01:08:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:08:25 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:08:25 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:08:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:08:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:08:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:08:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:08:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:08:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:08:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:08:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:08:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:08:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:08:27 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:08:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:08:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:08:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:08:28 - job_xml_thread(): Done retrieving: data size 43086865
Sun 19 Jan 2014 01:08:28 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:08:28 - XML: Start document: iteration 6
Sun 19 Jan 2014 01:08:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43086865
Sun 19 Jan 2014 01:08:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:08:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:08:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:08:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:08:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:08:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43086865
Sun 19 Jan 2014 01:08:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:08:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:08:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:08:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:08:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:08:49 - XML: Processed 646067 elements - found 0 jobs
Sun 19 Jan 2014 01:08:49 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:08:49 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:08:49 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:08:49 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:08:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:08:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:08:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:08:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:08:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:08:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:08:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:08:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:08:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:08:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:08:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:08:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:08:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:08:52 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:08:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 01:08:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:08:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:08:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:08:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:08:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:08:53 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 01:08:53 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 01:08:53 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:08:53 - ganglia_store_thread(): Done waiting: storemetricthread() has finished: cluster LISA Cluster
Sun 19 Jan 2014 01:08:53 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:08:54 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:08:54 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 01:08:54 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 01:08:54 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:08:54 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 01:08:54 - size of cluster 'LISA Cluster': 624 hosts 79388 metrics 65923 values 1043667 bits 130458 bytes 
Sun 19 Jan 2014 01:08:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:08:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43088616
Sun 19 Jan 2014 01:08:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:08:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43088616
Sun 19 Jan 2014 01:08:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:09:05 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:09:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:09:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:09:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:09:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:09:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:09:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:09:07 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:09:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:09:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:09:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:09:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:09:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:09:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:09:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:09:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:09:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:09:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:09:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:09:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:09:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:09:10 - job_xml_thread(): Done retrieving: data size 43087637
Sun 19 Jan 2014 01:09:10 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:09:10 - XML: Start document: iteration 7
Sun 19 Jan 2014 01:09:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43087637
Sun 19 Jan 2014 01:09:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:09:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43087637
Sun 19 Jan 2014 01:09:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:09:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:09:19 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:09:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:09:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 01:09:22 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:09:22 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:09:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9204 values 145222 bits 18152 bytes 
Sun 19 Jan 2014 01:09:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 01:09:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:09:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:09:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:09:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:09:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:09:28 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:09:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:09:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:09:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:09:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:09:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:09:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:09:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:09:29 - XML: Processed 646070 elements - found 0 jobs
Sun 19 Jan 2014 01:09:29 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:09:29 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:09:30 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:09:30 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:09:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:09:32 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:09:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:09:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:09:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:09:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:09:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:09:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:09:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:09:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43088695
Sun 19 Jan 2014 01:09:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:09:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43088695
Sun 19 Jan 2014 01:09:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:09:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:09:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:09:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:09:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:09:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:09:45 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:09:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:09:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:09:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:09:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:09:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:09:45 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:09:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 01:09:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:09:45 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:09:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:09:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43088657
Sun 19 Jan 2014 01:09:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:09:47 - job_xml_thread(): Done retrieving: data size 43088657
Sun 19 Jan 2014 01:09:47 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:09:47 - XML: Start document: iteration 8
Sun 19 Jan 2014 01:09:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:09:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:09:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:09:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:09:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:09:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43088657
Sun 19 Jan 2014 01:09:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:09:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:09:54 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:09:54 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 01:09:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:10:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:10:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:10:00 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:10:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:10:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:10:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:10:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:10:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:10:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:10:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:10:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:10:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:10:08 - XML: Processed 646070 elements - found 0 jobs
Sun 19 Jan 2014 01:10:08 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:10:08 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:10:08 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:10:08 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:10:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:10:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:10:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:10:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:10:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:10:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:10:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:10:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:10:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:10:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43085375
Sun 19 Jan 2014 01:10:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:10:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43085375
Sun 19 Jan 2014 01:10:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:10:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:10:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:10:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:10:20 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:10:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:10:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:10:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:10:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:10:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:10:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:10:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:10:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:10:22 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:10:23 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:10:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:10:23 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:10:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 01:10:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 01:10:23 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:10:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8678 values 136788 bits 17098 bytes 
Sun 19 Jan 2014 01:10:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:10:24 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:10:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:10:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:10:25 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:10:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 01:10:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:10:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:10:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:10:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:10:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:10:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:10:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43086626
Sun 19 Jan 2014 01:10:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:10:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43086626
Sun 19 Jan 2014 01:10:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:10:26 - job_xml_thread(): Done retrieving: data size 43086626
Sun 19 Jan 2014 01:10:26 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:10:26 - XML: Start document: iteration 9
Sun 19 Jan 2014 01:10:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:10:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:10:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:10:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:10:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:10:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:10:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:10:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:10:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:10:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:10:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:10:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:10:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:10:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:10:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:10:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:10:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:10:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:10:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:10:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:10:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:10:47 - XML: Processed 646070 elements - found 0 jobs
Sun 19 Jan 2014 01:10:47 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:10:47 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:10:47 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:10:47 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:10:47 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 01:10:47 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 01:10:47 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:10:47 - ganglia_store_thread(): Done waiting: storemetricthread() has finished: cluster LISA Cluster
Sun 19 Jan 2014 01:10:47 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:10:48 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:10:48 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:10:48 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 01:10:48 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 01:10:48 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 01:10:48 - size of cluster 'LISA Cluster': 624 hosts 79468 metrics 75704 values 1198694 bits 149836 bytes 
Sun 19 Jan 2014 01:10:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:10:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43085799
Sun 19 Jan 2014 01:10:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:10:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43085799
Sun 19 Jan 2014 01:10:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:10:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:10:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:10:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:10:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:11:02 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:11:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:11:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:11:03 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:11:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:11:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:11:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:11:04 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:11:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:11:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:11:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:11:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:11:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:11:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:11:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:11:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:11:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:11:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:11:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:11:07 - job_xml_thread(): Done retrieving: data size 43081075
Sun 19 Jan 2014 01:11:07 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:11:07 - XML: Start document: iteration 10
Sun 19 Jan 2014 01:11:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43081075
Sun 19 Jan 2014 01:11:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43081075
Sun 19 Jan 2014 01:11:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:11:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:11:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:11:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:11:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:11:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:11:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:11:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:11:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:11:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:11:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:11:23 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:11:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:11:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:11:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:11:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:11:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:11:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:11:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 01:11:25 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:11:25 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:11:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 01:11:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148595 bits 18574 bytes 
Sun 19 Jan 2014 01:11:29 - XML: Processed 645996 elements - found 0 jobs
Sun 19 Jan 2014 01:11:29 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:11:29 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:11:29 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:11:30 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:11:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:11:31 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:11:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:11:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:11:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:11:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:11:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:11:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:11:32 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:11:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 01:11:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:11:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:11:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43079048
Sun 19 Jan 2014 01:11:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:11:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43079048
Sun 19 Jan 2014 01:11:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:11:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:11:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:11:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:11:44 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:11:45 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:11:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:11:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:11:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:11:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:11:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:11:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:11:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:11:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:11:47 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:11:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:11:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:11:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:11:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:11:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:11:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:11:48 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:11:48 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 01:11:49 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 01:11:49 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 01:11:49 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:11:49 - ganglia_store_thread(): Done waiting: storemetricthread() has finished: cluster LISA Cluster
Sun 19 Jan 2014 01:11:49 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:11:49 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:11:49 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:11:49 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 01:11:49 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 01:11:49 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 01:11:49 - size of cluster 'LISA Cluster': 624 hosts 79336 metrics 59094 values 935642 bits 116955 bytes 
Sun 19 Jan 2014 01:11:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:11:50 - job_xml_thread(): Done retrieving: data size 43082501
Sun 19 Jan 2014 01:11:50 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:11:50 - XML: Start document: iteration 11
Sun 19 Jan 2014 01:11:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43082501
Sun 19 Jan 2014 01:11:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:11:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43082501
Sun 19 Jan 2014 01:11:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:12:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:12:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:12:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:12:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:12:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:12:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:12:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:12:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:12:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:12:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:12:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:12:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:12:09 - XML: Processed 645996 elements - found 0 jobs
Sun 19 Jan 2014 01:12:09 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:12:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:12:09 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:12:09 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:12:09 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:12:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:12:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:12:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:12:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:12:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:12:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:12:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:12:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:12:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:12:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43086820
Sun 19 Jan 2014 01:12:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:12:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43086820
Sun 19 Jan 2014 01:12:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:12:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:12:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:12:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:12:25 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:12:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:12:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:12:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:12:25 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:12:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:12:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:12:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:12:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:12:27 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:12:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 01:12:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:12:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 01:12:27 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:12:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148647 bits 18580 bytes 
Sun 19 Jan 2014 01:12:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:12:27 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:12:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:12:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:12:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:12:28 - job_xml_thread(): Done retrieving: data size 43087567
Sun 19 Jan 2014 01:12:28 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:12:28 - XML: Start document: iteration 12
Sun 19 Jan 2014 01:12:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43087567
Sun 19 Jan 2014 01:12:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:12:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:12:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:12:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43087567
Sun 19 Jan 2014 01:12:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:12:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:12:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:12:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:12:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:12:45 - XML: Processed 646070 elements - found 0 jobs
Sun 19 Jan 2014 01:12:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:12:45 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:12:45 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:12:45 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:12:45 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:12:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:12:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:12:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:12:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:12:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:12:49 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:12:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:12:49 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 01:12:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:12:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:12:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:12:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:12:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:12:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:12:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:12:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:12:50 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:12:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 01:12:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:12:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:12:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:12:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:12:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:12:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:12:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43087749
Sun 19 Jan 2014 01:12:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:12:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43087749
Sun 19 Jan 2014 01:12:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:13:01 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:13:01 - job_xml_thread(): Done retrieving: data size 43087749
Sun 19 Jan 2014 01:13:01 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:13:01 - XML: Start document: iteration 13
Sun 19 Jan 2014 01:13:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:13:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:13:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:13:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:13:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:13:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:13:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:13:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:13:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:13:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:13:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:13:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:13:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:13:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:13:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:13:14 - XML: Processed 646070 elements - found 0 jobs
Sun 19 Jan 2014 01:13:14 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:13:14 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:13:14 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:13:14 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:13:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:13:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:13:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:13:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:13:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:13:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43084577
Sun 19 Jan 2014 01:13:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:13:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43084577
Sun 19 Jan 2014 01:13:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:13:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:13:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:13:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:13:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:13:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:13:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:13:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:13:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:13:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43084577
Sun 19 Jan 2014 01:13:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:13:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:13:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:13:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:13:27 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:13:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:13:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 01:13:29 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:13:29 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:13:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:13:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:13:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:13:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9229 values 145646 bits 18205 bytes 
Sun 19 Jan 2014 01:13:29 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:13:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 01:13:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:13:31 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:13:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:13:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:13:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:13:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:13:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:13:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:13:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:13:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:13:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:13:36 - job_xml_thread(): Done retrieving: data size 43086589
Sun 19 Jan 2014 01:13:36 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:13:36 - XML: Start document: iteration 14
Sun 19 Jan 2014 01:13:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43086589
Sun 19 Jan 2014 01:13:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:13:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:13:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:13:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:13:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:13:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43086589
Sun 19 Jan 2014 01:13:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:13:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:13:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:13:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:13:49 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:13:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:13:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:13:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:13:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:13:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:13:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:13:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:13:58 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:13:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 01:13:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:13:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:13:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:13:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:13:59 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:13:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:13:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:13:59 - XML: Processed 646070 elements - found 0 jobs
Sun 19 Jan 2014 01:13:59 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:13:59 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:13:59 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:13:59 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:13:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:13:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:13:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:13:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:14:00 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 01:14:00 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 01:14:00 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:14:00 - ganglia_store_thread(): Done waiting: storemetricthread() has finished: cluster LISA Cluster
Sun 19 Jan 2014 01:14:00 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:14:01 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:14:01 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:14:01 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 01:14:01 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 01:14:01 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 01:14:01 - size of cluster 'LISA Cluster': 624 hosts 79348 metrics 60695 values 961008 bits 120126 bytes 
Sun 19 Jan 2014 01:14:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:14:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43085132
Sun 19 Jan 2014 01:14:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43085132
Sun 19 Jan 2014 01:14:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:14:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:14:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:14:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:14:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:14:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:14:14 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:14:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:14:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:14:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:14:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:14:15 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:14:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:14:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:14:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:14:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:14:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:14:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:14:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:14:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:14:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:14:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:14:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:14:18 - job_xml_thread(): Done retrieving: data size 43089350
Sun 19 Jan 2014 01:14:18 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:14:18 - XML: Start document: iteration 15
Sun 19 Jan 2014 01:14:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43089350
Sun 19 Jan 2014 01:14:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43089350
Sun 19 Jan 2014 01:14:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:14:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:14:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:14:30 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:14:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:14:30 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:14:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:14:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:14:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:14:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:14:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:14:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:14:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:14:32 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:14:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 01:14:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 01:14:32 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:14:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9299 values 146689 bits 18336 bytes 
Sun 19 Jan 2014 01:14:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:14:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:14:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:14:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:14:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:14:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:14:39 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:14:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:14:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:14:40 - XML: Processed 646070 elements - found 0 jobs
Sun 19 Jan 2014 01:14:40 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:14:40 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:14:40 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:14:40 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:14:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:14:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:14:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:14:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:14:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:14:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43087625
Sun 19 Jan 2014 01:14:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:14:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43087625
Sun 19 Jan 2014 01:14:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:14:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:14:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:14:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:14:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:14:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:14:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:14:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:14:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:14:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43087625
Sun 19 Jan 2014 01:14:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:14:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:14:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:14:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:14:55 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:14:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:14:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:15:02 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:15:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:15:02 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 01:15:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:15:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:15:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:15:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:15:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:15:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:15:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:15:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:15:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:15:02 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:15:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 01:15:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:15:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:15:04 - job_xml_thread(): Done retrieving: data size 43087943
Sun 19 Jan 2014 01:15:04 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:15:04 - XML: Start document: iteration 16
Sun 19 Jan 2014 01:15:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43087943
Sun 19 Jan 2014 01:15:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:15:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:15:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:15:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:15:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:15:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:15:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:15:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43087943
Sun 19 Jan 2014 01:15:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:15:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:15:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:15:19 - XML: Processed 646070 elements - found 0 jobs
Sun 19 Jan 2014 01:15:19 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:15:19 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:15:19 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:15:19 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:15:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:15:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:15:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:15:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:15:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:15:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:15:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:15:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:15:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:15:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:15:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:15:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:15:25 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:15:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:15:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:15:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:15:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:15:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:15:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:15:27 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 01:15:27 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 01:15:27 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:15:27 - ganglia_store_thread(): Done waiting: storemetricthread() has finished: cluster LISA Cluster
Sun 19 Jan 2014 01:15:27 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:15:28 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:15:28 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 01:15:28 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 01:15:28 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:15:28 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 01:15:28 - size of cluster 'LISA Cluster': 624 hosts 79378 metrics 64432 values 1020238 bits 127529 bytes 
Sun 19 Jan 2014 01:15:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:15:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43088503
Sun 19 Jan 2014 01:15:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:15:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43088503
Sun 19 Jan 2014 01:15:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:15:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:15:33 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:15:34 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:15:34 - job_xml_thread(): Done retrieving: data size 43088503
Sun 19 Jan 2014 01:15:34 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:15:34 - XML: Start document: iteration 17
Sun 19 Jan 2014 01:15:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:15:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 01:15:34 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:15:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8804 values 138848 bits 17356 bytes 
Sun 19 Jan 2014 01:15:36 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:15:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 01:15:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:15:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:15:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:15:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:15:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:15:43 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:15:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:15:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:15:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:15:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:15:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:15:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:15:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:15:46 - XML: Processed 646070 elements - found 0 jobs
Sun 19 Jan 2014 01:15:46 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:15:46 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:15:46 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:15:46 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:15:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:15:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 1035691
Sun 19 Jan 2014 01:15:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:15:48 - FATAL ERROR: Non-recoverable XML error <unknown>:21804:0: unclosed token
Sun 19 Jan 2014 01:15:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:15:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:15:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:15:48 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:15:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:15:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:15:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:15:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:15:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:15:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:15:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 1035691
Sun 19 Jan 2014 01:15:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:15:49 - FATAL ERROR: Non-recoverable XML error <unknown>:21804:0: unclosed token
Sun 19 Jan 2014 01:15:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:15:49 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:15:50 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:15:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 01:15:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:15:53 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 01:15:53 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 01:15:53 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:16:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:16:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:16:01 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:16:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:16:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:16:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:16:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:16:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:16:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:16:02 - job_xml_thread(): Done retrieving: data size 14579213
Sun 19 Jan 2014 01:16:02 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:16:02 - XML: Start document: iteration 18
Sun 19 Jan 2014 01:16:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 14579213
Sun 19 Jan 2014 01:16:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:16:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:16:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:16:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:16:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:16:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 14579213
Sun 19 Jan 2014 01:16:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:16:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:16:07 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:16:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:16:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:16:08 - XML: Processed 211452 elements - found 0 jobs
Sun 19 Jan 2014 01:16:08 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:16:08 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:16:08 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:16:08 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:16:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:16:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:16:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:16:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:16:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:16:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:16:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:16:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:16:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:16:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:16:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 23371768
Sun 19 Jan 2014 01:16:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:16:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:16:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:16:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:16:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:16:23 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:16:23 - job_xml_thread(): Done retrieving: data size 23371768
Sun 19 Jan 2014 01:16:23 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:16:23 - XML: Start document: iteration 19
Sun 19 Jan 2014 01:16:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:16:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:16:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:16:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:16:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 23371768
Sun 19 Jan 2014 01:16:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:16:28 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:16:28 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:16:29 - XML: Processed 342524 elements - found 0 jobs
Sun 19 Jan 2014 01:16:29 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:16:29 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:16:29 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:16:29 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:16:29 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:16:29 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 01:16:29 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:16:30 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 01:16:30 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 01:16:30 - size of cluster 'LISA Cluster': 624 hosts 78919 metrics 30035 values 470031 bits 58753 bytes 
Sun 19 Jan 2014 01:16:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:16:31 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:16:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:16:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:16:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:16:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:16:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:16:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:16:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:16:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:16:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 31718054
Sun 19 Jan 2014 01:16:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:16:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:16:37 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:16:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:16:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:16:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:16:38 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:16:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 01:16:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 01:16:38 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:16:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9268 values 146320 bits 18290 bytes 
Sun 19 Jan 2014 01:16:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:16:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:16:39 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:16:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 01:16:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:16:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:16:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:16:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:16:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 31718054
Sun 19 Jan 2014 01:16:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:16:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:16:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:16:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:16:44 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:16:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:16:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:16:46 - job_xml_thread(): Done retrieving: data size 34255462
Sun 19 Jan 2014 01:16:46 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:16:46 - XML: Start document: iteration 20
Sun 19 Jan 2014 01:16:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:16:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:16:49 - XML: Processed 507654 elements - found 0 jobs
Sun 19 Jan 2014 01:16:49 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:16:49 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:16:49 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:16:49 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:16:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:16:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:16:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 34255462
Sun 19 Jan 2014 01:16:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:16:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:16:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:16:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:16:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:16:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:16:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:16:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:16:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:16:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 34255462
Sun 19 Jan 2014 01:16:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:16:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:16:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:17:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:17:00 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:17:04 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:17:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:17:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:17:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:17:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:17:05 - job_xml_thread(): Done retrieving: data size 36114056
Sun 19 Jan 2014 01:17:05 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:17:05 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 01:17:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:17:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:17:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:17:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:17:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 36114056
Sun 19 Jan 2014 01:17:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:17:07 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 01:17:07 - Housekeeping: done.
Sun 19 Jan 2014 01:17:07 - XML: Start document: iteration 0
Sun 19 Jan 2014 01:17:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:17:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:17:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:17:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:17:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:17:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 36114056
Sun 19 Jan 2014 01:17:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:17:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:17:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:17:14 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:17:17 - XML: Processed 537303 elements - found 0 jobs
Sun 19 Jan 2014 01:17:17 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:17:17 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:17:17 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:17:17 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:17:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:17:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:17:21 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:17:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:17:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:17:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:17:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:17:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:17:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:17:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:17:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 38237444
Sun 19 Jan 2014 01:17:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:17:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:17:27 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:17:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:17:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:17:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:17:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:17:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:17:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:17:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 38237444
Sun 19 Jan 2014 01:17:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:17:30 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:17:30 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 01:17:32 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:17:32 - job_xml_thread(): Done retrieving: data size 38237444
Sun 19 Jan 2014 01:17:32 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:17:33 - XML: Start document: iteration 1
Sun 19 Jan 2014 01:17:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:17:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:17:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:17:38 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:17:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:17:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:17:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:17:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:17:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 01:17:39 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:17:39 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:17:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:17:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 01:17:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:17:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9268 values 146775 bits 18346 bytes 
Sun 19 Jan 2014 01:17:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:17:39 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:17:41 - XML: Processed 571321 elements - found 0 jobs
Sun 19 Jan 2014 01:17:41 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:17:41 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:17:41 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:17:41 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:17:43 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 01:17:43 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 01:17:43 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:17:43 - ganglia_store_thread(): Done waiting: storemetricthread() has finished: cluster LISA Cluster
Sun 19 Jan 2014 01:17:43 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:17:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:17:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 39550927
Sun 19 Jan 2014 01:17:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:17:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:17:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:17:44 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:17:44 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:17:44 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 01:17:44 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 01:17:44 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 01:17:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:17:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:17:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:17:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:17:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 39550927
Sun 19 Jan 2014 01:17:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:17:47 - size of cluster 'LISA Cluster': 624 hosts 78881 metrics 169105 values 2650909 bits 331363 bytes 
Sun 19 Jan 2014 01:17:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:17:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:17:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:17:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:17:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:17:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:17:56 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:17:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:17:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:17:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:17:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:17:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:17:59 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:17:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 01:17:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:18:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:18:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:18:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:18:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:18:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:18:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:18:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:18:04 - job_xml_thread(): Done retrieving: data size 40211860
Sun 19 Jan 2014 01:18:04 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:18:04 - XML: Start document: iteration 2
Sun 19 Jan 2014 01:18:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 40211860
Sun 19 Jan 2014 01:18:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 40211860
Sun 19 Jan 2014 01:18:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:18:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:18:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:18:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:18:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:18:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:18:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:18:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:18:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:18:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:18:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:18:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:18:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:18:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:18:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:18:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:18:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:18:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:18:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:18:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:18:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:18:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:18:25 - XML: Processed 602641 elements - found 0 jobs
Sun 19 Jan 2014 01:18:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:18:25 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:18:25 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:18:25 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:18:25 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:18:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:18:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 40799556
Sun 19 Jan 2014 01:18:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:18:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 40799556
Sun 19 Jan 2014 01:18:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:18:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:18:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:18:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:18:39 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:18:40 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:18:40 - job_xml_thread(): Done retrieving: data size 40799556
Sun 19 Jan 2014 01:18:40 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:18:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:18:40 - XML: Start document: iteration 3
Sun 19 Jan 2014 01:18:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:18:41 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:18:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:18:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 01:18:41 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:18:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 01:18:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8769 values 138665 bits 17333 bytes 
Sun 19 Jan 2014 01:18:45 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:18:45 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 01:18:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:18:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:18:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:18:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:18:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:18:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:18:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:18:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:18:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:19:00 - XML: Processed 611352 elements - found 0 jobs
Sun 19 Jan 2014 01:19:00 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:19:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:19:00 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:19:00 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:19:00 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:19:00 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:19:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:19:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:19:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:19:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:19:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:19:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:19:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:19:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:19:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:19:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 41728149
Sun 19 Jan 2014 01:19:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:19:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 41728149
Sun 19 Jan 2014 01:19:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:19:15 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:19:15 - job_xml_thread(): Done retrieving: data size 41728149
Sun 19 Jan 2014 01:19:15 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:19:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:19:15 - XML: Start document: iteration 4
Sun 19 Jan 2014 01:19:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:19:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:19:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:19:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:19:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:19:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:19:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:19:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:19:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:19:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:19:26 - XML: Processed 624508 elements - found 0 jobs
Sun 19 Jan 2014 01:19:26 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:19:26 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:19:26 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:19:26 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:19:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:19:31 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:19:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:19:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:19:31 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:19:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 01:19:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:19:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:19:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:19:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:19:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:19:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:19:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42666316
Sun 19 Jan 2014 01:19:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:19:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42666316
Sun 19 Jan 2014 01:19:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:19:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:19:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:19:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:19:41 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:19:41 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:19:41 - job_xml_thread(): Done retrieving: data size 42666316
Sun 19 Jan 2014 01:19:41 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:19:41 - XML: Start document: iteration 5
Sun 19 Jan 2014 01:19:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:19:43 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:19:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 01:19:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:19:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 01:19:43 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:19:43 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:19:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5779 values 91114 bits 11389 bytes 
Sun 19 Jan 2014 01:19:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:19:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:19:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:19:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:19:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:19:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:19:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:19:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:19:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:19:53 - XML: Processed 638980 elements - found 0 jobs
Sun 19 Jan 2014 01:19:53 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:19:53 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:19:53 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:19:53 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:19:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:19:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:19:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:19:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:19:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:19:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:19:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:19:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:19:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:19:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42766314
Sun 19 Jan 2014 01:19:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:19:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42766314
Sun 19 Jan 2014 01:19:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:19:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:19:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:20:08 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:20:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:20:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:20:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:20:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:20:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:20:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:20:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:20:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:20:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:20:12 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:20:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 01:20:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:20:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:20:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:20:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:20:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:20:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:20:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:20:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:20:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:20:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:20:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:20:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:20:14 - job_xml_thread(): Done retrieving: data size 42837957
Sun 19 Jan 2014 01:20:14 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:20:14 - XML: Start document: iteration 6
Sun 19 Jan 2014 01:20:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42837957
Sun 19 Jan 2014 01:20:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:20:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42837957
Sun 19 Jan 2014 01:20:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:20:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:20:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:20:29 - XML: Processed 641830 elements - found 0 jobs
Sun 19 Jan 2014 01:20:29 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:20:29 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:20:29 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:20:29 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:20:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:20:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:20:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:20:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:20:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:20:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:20:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:20:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:20:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:20:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:20:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:20:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:20:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:20:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:20:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:20:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:20:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:20:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:20:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:20:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:20:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42846652
Sun 19 Jan 2014 01:20:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:20:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42846652
Sun 19 Jan 2014 01:20:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:20:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:20:43 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:20:44 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:20:44 - job_xml_thread(): Done retrieving: data size 42846652
Sun 19 Jan 2014 01:20:44 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:20:44 - XML: Start document: iteration 7
Sun 19 Jan 2014 01:20:45 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:20:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:20:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 01:20:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 01:20:45 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:20:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9223 values 145581 bits 18197 bytes 
Sun 19 Jan 2014 01:20:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:20:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:20:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:20:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:20:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:20:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:20:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:20:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:20:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:20:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:20:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:20:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:20:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:20:55 - XML: Processed 642140 elements - found 0 jobs
Sun 19 Jan 2014 01:20:55 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:20:55 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:20:55 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:20:55 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:20:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:20:58 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:20:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:20:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:20:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:20:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:20:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:20:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:21:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:21:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42866488
Sun 19 Jan 2014 01:21:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:21:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42866488
Sun 19 Jan 2014 01:21:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:21:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:21:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:21:10 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:21:10 - job_xml_thread(): Done retrieving: data size 42866488
Sun 19 Jan 2014 01:21:10 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:21:10 - XML: Start document: iteration 8
Sun 19 Jan 2014 01:21:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:21:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:21:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:21:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:21:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:21:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:21:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:21:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:21:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:21:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:21:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:21:19 - XML: Processed 642345 elements - found 0 jobs
Sun 19 Jan 2014 01:21:19 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:21:19 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:21:19 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:21:19 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:21:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:21:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:21:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:21:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:21:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:21:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:21:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:21:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:21:23 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:21:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 01:21:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:21:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:21:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42891650
Sun 19 Jan 2014 01:21:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:21:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42891650
Sun 19 Jan 2014 01:21:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:21:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:21:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:21:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:21:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:21:35 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:21:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:21:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:21:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:21:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:21:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:21:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:21:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:21:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:21:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:21:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:21:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:21:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:21:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:21:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:21:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:21:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:21:40 - job_xml_thread(): Done retrieving: data size 42903200
Sun 19 Jan 2014 01:21:40 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:21:40 - XML: Start document: iteration 9
Sun 19 Jan 2014 01:21:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42903200
Sun 19 Jan 2014 01:21:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:21:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42903200
Sun 19 Jan 2014 01:21:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:21:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:21:46 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:21:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:21:47 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:21:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 01:21:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 01:21:47 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:21:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8901 values 140432 bits 17554 bytes 
Sun 19 Jan 2014 01:21:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:21:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:21:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:21:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:21:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:21:54 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:21:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:21:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:21:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:21:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:21:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:21:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:21:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:21:57 - XML: Processed 643000 elements - found 0 jobs
Sun 19 Jan 2014 01:21:57 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:21:57 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:21:57 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:21:57 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:22:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:22:01 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:22:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:22:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:22:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:22:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:22:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:22:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:22:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:22:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42929590
Sun 19 Jan 2014 01:22:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:22:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42929590
Sun 19 Jan 2014 01:22:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:22:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:22:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:22:12 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:22:12 - job_xml_thread(): Done retrieving: data size 42929590
Sun 19 Jan 2014 01:22:12 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:22:12 - XML: Start document: iteration 10
Sun 19 Jan 2014 01:22:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:22:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:22:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:22:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:22:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:22:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:22:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:22:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:22:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:22:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:22:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:22:24 - XML: Processed 643120 elements - found 0 jobs
Sun 19 Jan 2014 01:22:24 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:22:24 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:22:24 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:22:24 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:22:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:22:27 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:22:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:22:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:22:27 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:22:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 01:22:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:22:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:22:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:22:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:22:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:22:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:22:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42922374
Sun 19 Jan 2014 01:22:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:22:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42922374
Sun 19 Jan 2014 01:22:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:22:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:22:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:22:39 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:22:39 - job_xml_thread(): Done retrieving: data size 42922374
Sun 19 Jan 2014 01:22:39 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:22:39 - XML: Start document: iteration 11
Sun 19 Jan 2014 01:22:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:22:43 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:22:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:22:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:22:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:22:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:22:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:22:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:22:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:22:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:22:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:22:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:22:47 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:22:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:22:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 01:22:48 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:22:48 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:22:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 01:22:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5896 values 93046 bits 11630 bytes 
Sun 19 Jan 2014 01:22:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:22:53 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:22:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:22:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:22:53 - XML: Processed 643400 elements - found 0 jobs
Sun 19 Jan 2014 01:22:53 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:22:53 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:22:53 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:22:53 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:22:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:22:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:22:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:22:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:22:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:22:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42918360
Sun 19 Jan 2014 01:22:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:22:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42918360
Sun 19 Jan 2014 01:22:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:22:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:22:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:23:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:23:06 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:23:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:23:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:23:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:23:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:23:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:23:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:23:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:23:08 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:23:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:23:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:23:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:23:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:23:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:23:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:23:10 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:23:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 01:23:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:23:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:23:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:23:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:23:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:23:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:23:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42885481
Sun 19 Jan 2014 01:23:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:23:15 - job_xml_thread(): Done retrieving: data size 42885481
Sun 19 Jan 2014 01:23:15 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:23:15 - XML: Start document: iteration 12
Sun 19 Jan 2014 01:23:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42885481
Sun 19 Jan 2014 01:23:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:23:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:23:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:23:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:23:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:23:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:23:27 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:23:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:23:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:23:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:23:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:23:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:23:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:23:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:23:34 - XML: Processed 642910 elements - found 0 jobs
Sun 19 Jan 2014 01:23:34 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:23:34 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:23:34 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:23:34 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:23:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:23:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:23:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:23:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:23:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:23:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:23:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:23:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:23:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:23:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42464389
Sun 19 Jan 2014 01:23:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:23:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42464389
Sun 19 Jan 2014 01:23:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:23:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:23:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:23:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:23:48 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:23:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:23:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 01:23:48 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:23:48 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:23:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 01:23:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8800 values 138771 bits 17346 bytes 
Sun 19 Jan 2014 01:23:49 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:23:49 - job_xml_thread(): Done retrieving: data size 42464389
Sun 19 Jan 2014 01:23:49 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:23:49 - XML: Start document: iteration 13
Sun 19 Jan 2014 01:23:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:23:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:23:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:23:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:23:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:23:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:23:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:23:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:23:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:23:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:23:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:24:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:24:00 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:24:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:24:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:24:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:24:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:24:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:24:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:24:03 - XML: Processed 638040 elements - found 0 jobs
Sun 19 Jan 2014 01:24:03 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:24:03 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:24:03 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:24:03 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:24:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:24:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42296843
Sun 19 Jan 2014 01:24:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:24:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42296843
Sun 19 Jan 2014 01:24:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:24:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:24:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:24:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:24:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:24:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:24:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:24:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:24:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:24:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:24:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:24:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:24:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:24:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:24:18 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:24:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:24:21 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:24:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:24:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:24:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:24:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:24:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:24:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:24:22 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:24:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 01:24:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:24:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:24:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42415843
Sun 19 Jan 2014 01:24:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:24:25 - job_xml_thread(): Done retrieving: data size 42415843
Sun 19 Jan 2014 01:24:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42415843
Sun 19 Jan 2014 01:24:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:24:25 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:24:25 - XML: Start document: iteration 14
Sun 19 Jan 2014 01:24:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:24:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:24:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:24:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:24:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:24:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:24:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:24:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:24:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:24:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:24:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:24:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:24:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:24:42 - XML: Processed 637146 elements - found 0 jobs
Sun 19 Jan 2014 01:24:42 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:24:42 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:24:42 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:24:42 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:24:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:24:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:24:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:24:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:24:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:24:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:24:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:24:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:24:45 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 01:24:45 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:24:45 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:24:45 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:24:45 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 01:24:45 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 01:24:45 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 01:24:46 - size of cluster 'LISA Cluster': 624 hosts 79364 metrics 911602 values 14381185 bits 1797648 bytes 
Sun 19 Jan 2014 01:24:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:24:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42905727
Sun 19 Jan 2014 01:24:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:24:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42905727
Sun 19 Jan 2014 01:24:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:24:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:24:48 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:24:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:24:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:24:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:24:51 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:24:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 01:24:51 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:24:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 01:24:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8789 values 138542 bits 17317 bytes 
Sun 19 Jan 2014 01:24:57 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:24:57 - job_xml_thread(): Done retrieving: data size 42905727
Sun 19 Jan 2014 01:24:57 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:24:57 - XML: Start document: iteration 15
Sun 19 Jan 2014 01:24:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:24:57 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:24:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:24:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:24:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:24:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:24:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:24:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:24:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:24:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:24:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:25:08 - XML: Processed 643374 elements - found 0 jobs
Sun 19 Jan 2014 01:25:08 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:25:08 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:25:08 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:25:08 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:25:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:25:11 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:25:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:25:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:25:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:25:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:25:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:25:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:25:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:25:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:25:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:25:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43016571
Sun 19 Jan 2014 01:25:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:25:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43016571
Sun 19 Jan 2014 01:25:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:25:23 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:25:23 - job_xml_thread(): Done retrieving: data size 43016571
Sun 19 Jan 2014 01:25:23 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:25:23 - XML: Start document: iteration 16
Sun 19 Jan 2014 01:25:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:25:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:25:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:25:27 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:25:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:25:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:25:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:25:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:25:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:25:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:25:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:25:28 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:25:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 01:25:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:25:37 - XML: Processed 645090 elements - found 0 jobs
Sun 19 Jan 2014 01:25:37 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:25:37 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:25:37 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:25:37 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:25:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:25:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:25:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:25:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:25:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:25:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:25:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:25:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:25:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:25:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:25:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:25:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43024781
Sun 19 Jan 2014 01:25:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:25:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43024781
Sun 19 Jan 2014 01:25:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:25:45 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:25:46 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 01:25:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:25:51 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:25:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:25:51 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:25:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 01:25:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 01:25:51 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:25:52 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:25:52 - job_xml_thread(): Done retrieving: data size 43024781
Sun 19 Jan 2014 01:25:52 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:25:52 - XML: Start document: iteration 17
Sun 19 Jan 2014 01:25:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6006 values 94793 bits 11849 bytes 
Sun 19 Jan 2014 01:25:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:25:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:26:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:26:00 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:26:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:26:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:26:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:26:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:26:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:26:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:26:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:26:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:26:06 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:26:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:26:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:26:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:26:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:26:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:26:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:26:08 - XML: Processed 645270 elements - found 0 jobs
Sun 19 Jan 2014 01:26:08 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:26:08 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:26:08 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:26:08 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:26:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:26:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43046879
Sun 19 Jan 2014 01:26:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:26:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43046879
Sun 19 Jan 2014 01:26:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:26:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:26:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:26:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:26:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:26:23 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:26:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:26:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:26:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:26:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:26:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:26:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:26:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:26:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:26:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:26:26 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:26:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 01:26:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:26:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:26:29 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:26:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:26:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:26:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:26:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:26:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:26:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:26:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:26:32 - job_xml_thread(): Done retrieving: data size 43077726
Sun 19 Jan 2014 01:26:32 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:26:32 - XML: Start document: iteration 18
Sun 19 Jan 2014 01:26:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43077726
Sun 19 Jan 2014 01:26:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43077726
Sun 19 Jan 2014 01:26:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:26:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:26:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:26:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:26:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:26:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:26:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:26:45 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:26:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:26:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:26:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:26:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:26:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:26:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:26:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:26:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:26:52 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:26:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:26:53 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:26:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 01:26:53 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:26:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 01:26:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5793 values 91343 bits 11417 bytes 
Sun 19 Jan 2014 01:26:54 - XML: Processed 645570 elements - found 0 jobs
Sun 19 Jan 2014 01:26:54 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:26:54 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:26:54 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:26:54 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:26:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:26:55 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:26:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:26:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:26:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:26:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:26:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:26:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:27:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:27:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43055321
Sun 19 Jan 2014 01:27:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:27:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43055321
Sun 19 Jan 2014 01:27:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:27:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:27:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:27:09 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:27:09 - job_xml_thread(): Done retrieving: data size 43055321
Sun 19 Jan 2014 01:27:09 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:27:09 - XML: Start document: iteration 19
Sun 19 Jan 2014 01:27:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:27:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:27:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:27:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:27:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:27:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:27:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:27:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:27:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:27:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:27:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:27:19 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:27:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 01:27:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:27:23 - XML: Processed 645590 elements - found 0 jobs
Sun 19 Jan 2014 01:27:23 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:27:23 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:27:23 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:27:23 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:27:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:27:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:27:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:27:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:27:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:27:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:27:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:27:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:27:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:27:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43077502
Sun 19 Jan 2014 01:27:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:27:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43077502
Sun 19 Jan 2014 01:27:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:27:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:27:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:27:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:27:37 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:27:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:27:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:27:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:27:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:27:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:27:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:27:38 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:27:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:27:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:27:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:27:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:27:41 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:27:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:27:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:27:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:27:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:27:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:27:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:27:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:27:45 - job_xml_thread(): Done retrieving: data size 43104952
Sun 19 Jan 2014 01:27:45 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:27:45 - XML: Start document: iteration 20
Sun 19 Jan 2014 01:27:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43104952
Sun 19 Jan 2014 01:27:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:27:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43104952
Sun 19 Jan 2014 01:27:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:27:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:27:53 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:27:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:27:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:27:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:27:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 01:27:54 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:27:54 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:27:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 01:27:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9016 values 142236 bits 17779 bytes 
Sun 19 Jan 2014 01:27:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:27:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:27:58 - XML: Processed 645995 elements - found 0 jobs
Sun 19 Jan 2014 01:27:58 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:27:58 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:27:58 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:27:58 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:28:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:28:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:28:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:28:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:28:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:28:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:28:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:28:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:28:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:28:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:28:07 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:28:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:28:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:28:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:28:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:28:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:28:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:28:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:28:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43103201
Sun 19 Jan 2014 01:28:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:28:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43103201
Sun 19 Jan 2014 01:28:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:28:13 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:28:13 - job_xml_thread(): Done retrieving: data size 43103201
Sun 19 Jan 2014 01:28:13 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:28:13 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 01:28:14 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 01:28:14 - Housekeeping: done.
Sun 19 Jan 2014 01:28:14 - XML: Start document: iteration 0
Sun 19 Jan 2014 01:28:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:28:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:28:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:28:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:28:30 - XML: Processed 646225 elements - found 0 jobs
Sun 19 Jan 2014 01:28:30 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:28:30 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:28:30 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:28:30 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:28:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:28:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:28:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:28:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:28:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:28:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:28:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:28:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:28:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:28:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:28:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:28:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:28:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:28:36 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:28:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 01:28:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:28:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:28:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:28:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:28:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:28:40 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 01:28:40 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 01:28:40 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:28:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:28:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43132105
Sun 19 Jan 2014 01:28:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:28:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43132105
Sun 19 Jan 2014 01:28:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:28:45 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:28:45 - job_xml_thread(): Done retrieving: data size 43132105
Sun 19 Jan 2014 01:28:45 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:28:45 - XML: Start document: iteration 1
Sun 19 Jan 2014 01:28:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:28:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:28:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:28:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:28:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:28:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:28:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:28:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:28:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:28:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:28:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:28:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:28:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:28:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:28:54 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:28:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:28:54 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:28:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 01:28:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 01:28:54 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:28:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5801 values 91492 bits 11436 bytes 
Sun 19 Jan 2014 01:29:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:29:01 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:29:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:29:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:29:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:29:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:29:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:29:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:29:03 - XML: Processed 646355 elements - found 0 jobs
Sun 19 Jan 2014 01:29:03 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:29:03 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:29:03 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:29:03 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:29:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:29:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43122084
Sun 19 Jan 2014 01:29:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:29:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43122084
Sun 19 Jan 2014 01:29:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:29:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:29:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:29:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:29:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:29:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:29:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:29:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:29:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:29:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:29:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:29:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:29:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:29:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:29:18 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:29:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:29:19 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:29:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:29:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:29:19 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:29:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 01:29:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:29:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:29:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:29:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:29:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:29:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:29:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43077612
Sun 19 Jan 2014 01:29:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:29:21 - job_xml_thread(): Done retrieving: data size 43077612
Sun 19 Jan 2014 01:29:21 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:29:21 - XML: Start document: iteration 2
Sun 19 Jan 2014 01:29:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43077612
Sun 19 Jan 2014 01:29:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:29:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:29:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:29:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:29:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:29:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:29:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:29:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:29:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:29:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:29:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:29:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:29:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:29:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:29:41 - XML: Processed 646090 elements - found 0 jobs
Sun 19 Jan 2014 01:29:41 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:29:41 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:29:41 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:29:42 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:29:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:29:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:29:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:29:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:29:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:29:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:29:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:29:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:29:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:29:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42583140
Sun 19 Jan 2014 01:29:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:29:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42583140
Sun 19 Jan 2014 01:29:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:29:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:29:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:29:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:29:54 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:29:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:29:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:29:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:29:54 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:29:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:29:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:29:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:29:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:29:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:29:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:29:56 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:29:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 01:29:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 01:29:56 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:29:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8943 values 141049 bits 17631 bytes 
Sun 19 Jan 2014 01:29:57 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:29:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:29:59 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:29:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:29:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:29:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:29:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:29:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:29:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:30:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:30:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42512423
Sun 19 Jan 2014 01:30:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:30:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42512423
Sun 19 Jan 2014 01:30:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:30:03 - job_xml_thread(): Done retrieving: data size 42512423
Sun 19 Jan 2014 01:30:03 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:30:03 - XML: Start document: iteration 3
Sun 19 Jan 2014 01:30:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:30:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:30:13 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:30:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 01:30:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:30:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:30:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:30:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:30:19 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:30:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:30:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:30:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:30:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:30:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:30:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:30:21 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:30:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:30:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:30:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:30:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:30:22 - XML: Processed 638805 elements - found 0 jobs
Sun 19 Jan 2014 01:30:22 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:30:22 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:30:22 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:30:22 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:30:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:30:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:30:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:30:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:30:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:30:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42588932
Sun 19 Jan 2014 01:30:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:30:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42588932
Sun 19 Jan 2014 01:30:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:30:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:30:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:30:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:30:37 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:30:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:30:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:30:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:30:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:30:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:30:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:30:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:30:37 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:30:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:30:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:30:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:30:39 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:30:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:30:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:30:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:30:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:30:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:30:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:30:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:30:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43109289
Sun 19 Jan 2014 01:30:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:30:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43109289
Sun 19 Jan 2014 01:30:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:30:46 - job_xml_thread(): Done retrieving: data size 43109289
Sun 19 Jan 2014 01:30:46 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:30:46 - XML: Start document: iteration 4
Sun 19 Jan 2014 01:30:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:30:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:30:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:30:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:30:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:30:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:30:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:30:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:30:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:30:57 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:30:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:30:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:30:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:30:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:30:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:30:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:30:57 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:30:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 01:30:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 01:30:57 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:30:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9135 values 144200 bits 18025 bytes 
Sun 19 Jan 2014 01:31:02 - XML: Processed 646380 elements - found 0 jobs
Sun 19 Jan 2014 01:31:02 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:31:02 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:31:02 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:31:02 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:31:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:31:04 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:31:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:31:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:31:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:31:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:31:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:31:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:31:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:31:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43180979
Sun 19 Jan 2014 01:31:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:31:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43180979
Sun 19 Jan 2014 01:31:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:31:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:31:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:31:17 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:31:17 - job_xml_thread(): Done retrieving: data size 43180979
Sun 19 Jan 2014 01:31:17 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:31:17 - XML: Start document: iteration 5
Sun 19 Jan 2014 01:31:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:31:19 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:31:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:31:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:31:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:31:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:31:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:31:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:31:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:31:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:31:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:31:22 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:31:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 01:31:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:31:28 - XML: Processed 647503 elements - found 0 jobs
Sun 19 Jan 2014 01:31:28 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:31:28 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:31:28 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:31:28 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:31:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:31:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:31:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:31:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:31:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:31:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:31:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:31:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:31:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:31:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43211709
Sun 19 Jan 2014 01:31:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:31:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43211709
Sun 19 Jan 2014 01:31:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:31:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:31:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:31:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:31:43 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:31:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:31:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:31:44 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:31:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:31:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:31:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:31:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:31:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:31:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:31:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:31:46 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 01:31:46 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:31:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:31:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:31:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:31:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:31:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:31:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:31:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:31:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:31:47 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:31:47 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 01:31:47 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:31:47 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 01:31:47 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 01:31:48 - size of cluster 'LISA Cluster': 624 hosts 79449 metrics 862241 values 13598109 bits 1699763 bytes 
Sun 19 Jan 2014 01:31:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:31:52 - job_xml_thread(): Done retrieving: data size 43230538
Sun 19 Jan 2014 01:31:52 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:31:52 - XML: Start document: iteration 6
Sun 19 Jan 2014 01:31:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43230538
Sun 19 Jan 2014 01:31:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:31:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43230538
Sun 19 Jan 2014 01:31:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:31:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:31:58 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:31:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:31:58 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:31:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 01:31:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 01:31:59 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:31:59 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8910 values 140922 bits 17615 bytes 
Sun 19 Jan 2014 01:32:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:32:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:32:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:32:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:32:05 - XML: Processed 647980 elements - found 0 jobs
Sun 19 Jan 2014 01:32:05 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:32:06 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:32:06 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:32:06 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:32:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:32:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:32:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:32:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:32:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:32:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:32:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:32:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:32:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:32:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:32:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:32:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:32:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:32:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:32:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:32:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:32:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:32:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:32:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43257754
Sun 19 Jan 2014 01:32:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:32:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43257754
Sun 19 Jan 2014 01:32:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:32:21 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:32:21 - job_xml_thread(): Done retrieving: data size 43257754
Sun 19 Jan 2014 01:32:21 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:32:21 - XML: Start document: iteration 7
Sun 19 Jan 2014 01:32:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:32:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:32:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:32:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:32:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:32:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:32:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:32:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:32:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:32:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:32:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:32:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:32:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:32:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:32:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:32:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:32:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:32:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:32:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:32:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:32:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:32:39 - XML: Processed 648380 elements - found 0 jobs
Sun 19 Jan 2014 01:32:39 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:32:39 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:32:39 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:32:39 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:32:40 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:32:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 01:32:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:32:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:32:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43254843
Sun 19 Jan 2014 01:32:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:32:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43254843
Sun 19 Jan 2014 01:32:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:32:47 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:32:47 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 01:32:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:32:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:32:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:32:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:32:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:32:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:32:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:32:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:32:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:32:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:32:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43254843
Sun 19 Jan 2014 01:32:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:32:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:32:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:32:54 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:32:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:32:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:32:59 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:33:00 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:33:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:33:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 01:33:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 01:33:00 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:33:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6008 values 95136 bits 11892 bytes 
Sun 19 Jan 2014 01:33:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:33:03 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:33:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:33:07 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:33:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:33:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:33:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:33:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:33:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:33:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:33:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:33:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:33:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:33:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:33:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:33:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:33:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:33:11 - job_xml_thread(): Done retrieving: data size 43235981
Sun 19 Jan 2014 01:33:11 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:33:11 - XML: Start document: iteration 8
Sun 19 Jan 2014 01:33:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43235981
Sun 19 Jan 2014 01:33:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:33:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43235981
Sun 19 Jan 2014 01:33:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:33:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:33:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:33:24 - XML: Processed 648670 elements - found 0 jobs
Sun 19 Jan 2014 01:33:24 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:33:24 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:33:24 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:33:24 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:33:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:33:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:33:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:33:30 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:33:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:33:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:33:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:33:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:33:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:33:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:33:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:33:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:33:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:33:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:33:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:33:33 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:33:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 01:33:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:33:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:33:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:33:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:33:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:33:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:33:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43290768
Sun 19 Jan 2014 01:33:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:33:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43290768
Sun 19 Jan 2014 01:33:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:33:39 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:33:39 - job_xml_thread(): Done retrieving: data size 43290768
Sun 19 Jan 2014 01:33:39 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:33:39 - XML: Start document: iteration 9
Sun 19 Jan 2014 01:33:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:33:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:33:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:33:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:33:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:33:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:33:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:33:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:33:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:33:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:33:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:33:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:33:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:33:59 - XML: Processed 648795 elements - found 0 jobs
Sun 19 Jan 2014 01:33:59 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:33:59 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:33:59 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:33:59 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:34:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:34:00 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:34:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:34:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:34:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:34:00 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:34:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:34:00 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:34:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 01:34:00 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:34:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 01:34:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5904 values 93290 bits 11661 bytes 
Sun 19 Jan 2014 01:34:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:34:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:34:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:34:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:34:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:34:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43290042
Sun 19 Jan 2014 01:34:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:34:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43290042
Sun 19 Jan 2014 01:34:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:34:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:34:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:34:14 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:34:14 - job_xml_thread(): Done retrieving: data size 43290042
Sun 19 Jan 2014 01:34:14 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:34:14 - XML: Start document: iteration 10
Sun 19 Jan 2014 01:34:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:34:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:34:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:34:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:34:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:34:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:34:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:34:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:34:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:34:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:34:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:34:22 - XML: Processed 648885 elements - found 0 jobs
Sun 19 Jan 2014 01:34:22 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:34:22 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:34:22 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:34:22 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:34:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:34:25 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:34:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:34:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:34:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:34:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:34:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:34:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:34:26 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:34:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 01:34:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:34:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:34:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43290569
Sun 19 Jan 2014 01:34:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:34:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43290569
Sun 19 Jan 2014 01:34:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:34:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:34:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:34:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:34:37 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:34:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:34:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:34:38 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:34:38 - job_xml_thread(): Done retrieving: data size 43290569
Sun 19 Jan 2014 01:34:38 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:34:38 - XML: Start document: iteration 11
Sun 19 Jan 2014 01:34:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:34:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:34:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:34:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:34:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43290569
Sun 19 Jan 2014 01:34:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:34:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:34:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:34:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:34:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:34:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:34:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:34:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:34:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:34:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:34:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:34:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:34:56 - XML: Processed 649175 elements - found 0 jobs
Sun 19 Jan 2014 01:34:56 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:34:56 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:34:56 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:34:56 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:34:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:34:57 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:34:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:34:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:34:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:34:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:34:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:34:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:35:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:35:00 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:35:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:35:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 01:35:00 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:35:00 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:35:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 01:35:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5221 values 82344 bits 10293 bytes 
Sun 19 Jan 2014 01:35:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:35:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43318698
Sun 19 Jan 2014 01:35:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:35:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43318698
Sun 19 Jan 2014 01:35:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:35:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:35:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:35:11 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:35:11 - job_xml_thread(): Done retrieving: data size 43318698
Sun 19 Jan 2014 01:35:11 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:35:11 - XML: Start document: iteration 12
Sun 19 Jan 2014 01:35:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:35:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:35:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:35:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:35:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:35:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:35:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:35:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:35:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:35:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:35:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:35:21 - XML: Processed 649349 elements - found 0 jobs
Sun 19 Jan 2014 01:35:21 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:35:21 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:35:21 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:35:21 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:35:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:35:25 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:35:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:35:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:35:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:35:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:35:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:35:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:35:28 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:35:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 01:35:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:35:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:35:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43241506
Sun 19 Jan 2014 01:35:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:35:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43241506
Sun 19 Jan 2014 01:35:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:35:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:35:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:35:36 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:35:36 - job_xml_thread(): Done retrieving: data size 43241506
Sun 19 Jan 2014 01:35:36 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:35:36 - XML: Start document: iteration 13
Sun 19 Jan 2014 01:35:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:35:39 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:35:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:35:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:35:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:35:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:35:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:35:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:35:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:35:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:35:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:35:48 - XML: Processed 648770 elements - found 0 jobs
Sun 19 Jan 2014 01:35:48 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:35:48 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:35:48 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:35:48 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:35:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:35:51 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:35:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:35:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:35:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:35:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:35:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:35:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:35:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:35:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42680031
Sun 19 Jan 2014 01:35:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:35:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42680031
Sun 19 Jan 2014 01:35:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:35:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:35:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:36:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:36:01 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:36:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:36:02 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:36:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 01:36:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 01:36:02 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:36:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7312 values 115407 bits 14425 bytes 
Sun 19 Jan 2014 01:36:03 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:36:03 - job_xml_thread(): Done retrieving: data size 42680031
Sun 19 Jan 2014 01:36:03 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:36:03 - XML: Start document: iteration 14
Sun 19 Jan 2014 01:36:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:36:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:36:15 - XML: Processed 641878 elements - found 0 jobs
Sun 19 Jan 2014 01:36:15 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:36:15 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:36:15 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:36:15 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:36:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:36:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:36:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:36:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:36:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:36:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:36:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:36:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:36:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:36:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:36:18 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:36:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:36:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:36:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:36:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:36:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:36:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:36:22 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 01:36:22 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 01:36:22 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:36:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:36:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42750809
Sun 19 Jan 2014 01:36:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:36:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42750809
Sun 19 Jan 2014 01:36:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:36:30 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:36:30 - job_xml_thread(): Done retrieving: data size 42750809
Sun 19 Jan 2014 01:36:30 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:36:30 - XML: Start document: iteration 15
Sun 19 Jan 2014 01:36:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:36:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:36:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:36:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:36:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:36:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:36:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:36:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:36:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:36:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:36:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:36:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:36:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:36:39 - XML: Processed 642195 elements - found 0 jobs
Sun 19 Jan 2014 01:36:39 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:36:39 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:36:39 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:36:39 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:36:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:36:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:36:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:36:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:36:44 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:36:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 01:36:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:36:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:36:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:36:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:36:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:36:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:36:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43241397
Sun 19 Jan 2014 01:36:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:36:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43241397
Sun 19 Jan 2014 01:36:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:36:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:36:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:36:55 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:36:55 - job_xml_thread(): Done retrieving: data size 43241397
Sun 19 Jan 2014 01:36:55 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:36:55 - XML: Start document: iteration 16
Sun 19 Jan 2014 01:36:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:36:58 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:36:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:36:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:36:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:36:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:36:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:37:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:37:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:37:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:37:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:37:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:37:03 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:37:04 - XML: Processed 648763 elements - found 0 jobs
Sun 19 Jan 2014 01:37:04 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:37:04 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:37:04 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:37:04 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:37:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:37:05 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:37:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:37:05 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:37:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 01:37:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 01:37:05 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:37:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5633 values 88803 bits 11100 bytes 
Sun 19 Jan 2014 01:37:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:37:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:37:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:37:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:37:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:37:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:37:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:37:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43332214
Sun 19 Jan 2014 01:37:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:37:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43332214
Sun 19 Jan 2014 01:37:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:37:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:37:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:37:19 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:37:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:37:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:37:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:37:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:37:20 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:37:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:37:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:37:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:37:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:37:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:37:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:37:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:37:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:37:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:37:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:37:23 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:37:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 01:37:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:37:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:37:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:37:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:37:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:37:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:37:24 - job_xml_thread(): Done retrieving: data size 43328260
Sun 19 Jan 2014 01:37:24 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:37:24 - XML: Start document: iteration 17
Sun 19 Jan 2014 01:37:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43328260
Sun 19 Jan 2014 01:37:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43328260
Sun 19 Jan 2014 01:37:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:37:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:37:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:37:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:37:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:37:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:37:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:37:39 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:37:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:37:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:37:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:37:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:37:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:37:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:37:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:37:42 - XML: Processed 649645 elements - found 0 jobs
Sun 19 Jan 2014 01:37:42 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:37:42 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:37:42 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:37:42 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:37:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:37:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:37:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:37:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:37:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:37:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:37:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:37:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:37:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:37:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43330366
Sun 19 Jan 2014 01:37:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:37:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43330366
Sun 19 Jan 2014 01:37:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:37:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:37:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:37:57 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:37:57 - job_xml_thread(): Done retrieving: data size 43330366
Sun 19 Jan 2014 01:37:57 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:37:57 - XML: Start document: iteration 18
Sun 19 Jan 2014 01:38:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:38:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:38:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:38:06 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:38:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:38:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 01:38:06 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:38:06 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:38:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 01:38:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8792 values 138780 bits 17347 bytes 
Sun 19 Jan 2014 01:38:11 - XML: Processed 649645 elements - found 0 jobs
Sun 19 Jan 2014 01:38:11 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:38:11 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:38:11 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:38:11 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:38:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:38:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:38:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:38:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:38:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:38:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:38:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:38:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:38:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:38:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:38:15 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:38:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:38:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:38:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:38:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:38:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:38:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:38:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:38:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43342429
Sun 19 Jan 2014 01:38:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:38:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43342429
Sun 19 Jan 2014 01:38:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:38:26 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:38:26 - job_xml_thread(): Done retrieving: data size 43342429
Sun 19 Jan 2014 01:38:26 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:38:26 - XML: Start document: iteration 19
Sun 19 Jan 2014 01:38:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:38:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:38:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:38:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:38:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:38:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:38:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:38:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:38:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:38:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:38:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:38:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:38:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:38:41 - XML: Processed 649655 elements - found 0 jobs
Sun 19 Jan 2014 01:38:41 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:38:41 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:38:41 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:38:41 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:38:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:38:41 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:38:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:38:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:38:41 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:38:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 01:38:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:38:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:38:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:38:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:38:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:38:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:38:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43318828
Sun 19 Jan 2014 01:38:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:38:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43318828
Sun 19 Jan 2014 01:38:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:38:48 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 01:38:48 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:38:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:38:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:38:49 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:38:49 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 01:38:49 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:38:49 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 01:38:50 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 01:38:56 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:38:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:38:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:38:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:38:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:38:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:38:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:38:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:38:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:38:56 - size of cluster 'LISA Cluster': 624 hosts 79470 metrics 737305 values 11632156 bits 1454019 bytes 
Sun 19 Jan 2014 01:38:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:38:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:38:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:39:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:39:01 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:39:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:39:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:39:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:39:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:39:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:39:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:39:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:39:07 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:39:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:39:07 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:39:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 01:39:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 01:39:07 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:39:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5849 values 92246 bits 11530 bytes 
Sun 19 Jan 2014 01:39:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:39:08 - job_xml_thread(): Done retrieving: data size 43336541
Sun 19 Jan 2014 01:39:08 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:39:08 - XML: Start document: iteration 20
Sun 19 Jan 2014 01:39:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43336541
Sun 19 Jan 2014 01:39:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:39:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43336541
Sun 19 Jan 2014 01:39:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:39:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:39:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:39:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:39:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:39:24 - XML: Processed 649660 elements - found 0 jobs
Sun 19 Jan 2014 01:39:24 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:39:24 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:39:24 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:39:24 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:39:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:39:30 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:39:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:39:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:39:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:39:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:39:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:39:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:39:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:39:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:39:32 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:39:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:39:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:39:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:39:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:39:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:39:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:39:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:39:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43349591
Sun 19 Jan 2014 01:39:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:39:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43349591
Sun 19 Jan 2014 01:39:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:39:39 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:39:39 - job_xml_thread(): Done retrieving: data size 43349591
Sun 19 Jan 2014 01:39:39 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:39:39 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 01:39:39 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 01:39:39 - Housekeeping: done.
Sun 19 Jan 2014 01:39:39 - XML: Start document: iteration 0
Sun 19 Jan 2014 01:39:44 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:39:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 01:39:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:39:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:39:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:39:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:39:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:39:49 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:39:49 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 01:39:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:39:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:39:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:39:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:39:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:39:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:39:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:39:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:39:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:39:57 - XML: Processed 649665 elements - found 0 jobs
Sun 19 Jan 2014 01:39:57 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:39:57 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:39:57 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:39:57 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:40:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:40:00 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:40:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:40:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:40:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:40:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:40:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:40:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:40:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:40:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43321167
Sun 19 Jan 2014 01:40:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:40:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43321167
Sun 19 Jan 2014 01:40:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:40:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:40:07 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:40:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:40:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 01:40:08 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:40:08 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:40:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 01:40:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:40:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:40:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6582 values 103837 bits 12979 bytes 
Sun 19 Jan 2014 01:40:12 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:40:12 - job_xml_thread(): Done retrieving: data size 43321167
Sun 19 Jan 2014 01:40:12 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:40:12 - XML: Start document: iteration 1
Sun 19 Jan 2014 01:40:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:40:14 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:40:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:40:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:40:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:40:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:40:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:40:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:40:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:40:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:40:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:40:24 - XML: Processed 649670 elements - found 0 jobs
Sun 19 Jan 2014 01:40:24 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:40:24 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:40:24 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:40:24 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:40:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:40:26 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:40:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:40:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:40:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:40:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:40:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:40:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:40:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:40:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:40:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:40:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43297750
Sun 19 Jan 2014 01:40:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:40:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43297750
Sun 19 Jan 2014 01:40:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:40:39 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:40:39 - job_xml_thread(): Done retrieving: data size 43297750
Sun 19 Jan 2014 01:40:39 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:40:39 - XML: Start document: iteration 2
Sun 19 Jan 2014 01:40:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:40:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:40:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:40:47 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:40:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:40:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:40:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:40:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:40:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:40:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:40:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:40:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:40:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:40:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:40:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:40:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:40:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:40:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:40:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:40:53 - XML: Processed 649675 elements - found 0 jobs
Sun 19 Jan 2014 01:40:53 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:40:53 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:40:53 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:40:53 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:40:53 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:40:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 01:40:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:40:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:40:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43312114
Sun 19 Jan 2014 01:40:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:40:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43312114
Sun 19 Jan 2014 01:40:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:41:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:41:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:41:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:41:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:41:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:41:08 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:41:08 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:41:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:41:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:41:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 01:41:08 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:41:08 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:41:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 01:41:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:41:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:41:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:41:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:41:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6023 values 95070 bits 11883 bytes 
Sun 19 Jan 2014 01:41:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:41:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:41:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:41:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:41:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:41:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:41:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:41:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:41:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:41:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:41:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:41:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:41:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:41:16 - job_xml_thread(): Done retrieving: data size 43267928
Sun 19 Jan 2014 01:41:16 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:41:16 - XML: Start document: iteration 3
Sun 19 Jan 2014 01:41:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43267928
Sun 19 Jan 2014 01:41:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:41:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43267928
Sun 19 Jan 2014 01:41:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:41:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:41:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:41:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:41:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:41:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:41:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:41:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:41:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:41:33 - XML: Processed 648955 elements - found 0 jobs
Sun 19 Jan 2014 01:41:33 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:41:33 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:41:33 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:41:33 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:41:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:41:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:41:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:41:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:41:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:41:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:41:39 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:41:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:41:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:41:39 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:41:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 01:41:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:41:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:41:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:41:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:41:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:41:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:41:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42759253
Sun 19 Jan 2014 01:41:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:41:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42759253
Sun 19 Jan 2014 01:41:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:41:48 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:41:48 - job_xml_thread(): Done retrieving: data size 42759253
Sun 19 Jan 2014 01:41:48 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:41:48 - XML: Start document: iteration 4
Sun 19 Jan 2014 01:41:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:41:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:41:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:41:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:41:59 - XML: Processed 642831 elements - found 0 jobs
Sun 19 Jan 2014 01:41:59 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:41:59 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:41:59 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:41:59 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:42:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:42:00 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:42:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:42:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:42:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:42:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:42:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:42:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:42:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:42:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:42:03 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:42:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:42:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:42:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:42:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:42:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:42:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:42:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:42:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42690862
Sun 19 Jan 2014 01:42:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:42:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42690862
Sun 19 Jan 2014 01:42:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:42:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:42:09 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:42:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:42:09 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:42:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 01:42:09 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:42:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 01:42:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8842 values 139402 bits 17425 bytes 
Sun 19 Jan 2014 01:42:14 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:42:14 - job_xml_thread(): Done retrieving: data size 42690862
Sun 19 Jan 2014 01:42:14 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:42:14 - XML: Start document: iteration 5
Sun 19 Jan 2014 01:42:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:42:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:42:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:42:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:42:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:42:26 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:42:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:42:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:42:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:42:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:42:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:42:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:42:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:42:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:42:27 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:42:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:42:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:42:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:42:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:42:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:42:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:42:29 - XML: Processed 641518 elements - found 0 jobs
Sun 19 Jan 2014 01:42:29 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:42:29 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:42:29 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:42:29 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:42:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:42:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42747450
Sun 19 Jan 2014 01:42:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:42:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42747450
Sun 19 Jan 2014 01:42:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:42:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:42:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:42:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:42:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:42:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:42:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:42:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:42:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:42:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:42:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:42:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:42:44 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:42:46 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:42:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 01:42:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:42:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:42:47 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:42:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:42:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:42:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:42:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:42:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:42:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:42:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:42:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43268019
Sun 19 Jan 2014 01:42:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:42:50 - job_xml_thread(): Done retrieving: data size 43268019
Sun 19 Jan 2014 01:42:50 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:42:50 - XML: Start document: iteration 6
Sun 19 Jan 2014 01:42:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43268019
Sun 19 Jan 2014 01:42:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:42:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:42:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:43:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:43:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:43:04 - XML: Processed 648810 elements - found 0 jobs
Sun 19 Jan 2014 01:43:04 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:43:04 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:43:05 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:43:05 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:43:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:43:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:43:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:43:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:43:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:43:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:43:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:43:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:43:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:43:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:43:09 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:43:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:43:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 01:43:10 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:43:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6065 values 95764 bits 11970 bytes 
Sun 19 Jan 2014 01:43:10 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:43:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 01:43:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:43:14 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:43:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:43:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:43:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:43:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:43:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:43:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:43:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:43:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43330385
Sun 19 Jan 2014 01:43:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:43:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43330385
Sun 19 Jan 2014 01:43:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:43:20 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:43:20 - job_xml_thread(): Done retrieving: data size 43330385
Sun 19 Jan 2014 01:43:20 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:43:20 - XML: Start document: iteration 7
Sun 19 Jan 2014 01:43:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:43:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:43:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:43:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:43:35 - XML: Processed 649729 elements - found 0 jobs
Sun 19 Jan 2014 01:43:35 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:43:35 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:43:35 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:43:35 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:43:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:43:36 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:43:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:43:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:43:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:43:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:43:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:43:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:43:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:43:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:43:41 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:43:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:43:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:43:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:43:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:43:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:43:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:43:41 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:43:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 01:43:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:43:43 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 01:43:43 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 01:43:43 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:43:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:43:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43318905
Sun 19 Jan 2014 01:43:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:43:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43318905
Sun 19 Jan 2014 01:43:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:43:50 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:43:50 - job_xml_thread(): Done retrieving: data size 43318905
Sun 19 Jan 2014 01:43:50 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:43:50 - XML: Start document: iteration 8
Sun 19 Jan 2014 01:43:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:43:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:43:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:43:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:43:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:43:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:43:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:43:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:43:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:43:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:43:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43318905
Sun 19 Jan 2014 01:43:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:43:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:43:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:44:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:44:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:44:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:44:10 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:44:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:44:10 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:44:10 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:44:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:44:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:44:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 01:44:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 01:44:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:44:11 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:44:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5686 values 89624 bits 11203 bytes 
Sun 19 Jan 2014 01:44:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:44:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:44:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:44:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:44:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:44:12 - XML: Processed 649730 elements - found 0 jobs
Sun 19 Jan 2014 01:44:12 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:44:12 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:44:12 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:44:12 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:44:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:44:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:44:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:44:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:44:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:44:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:44:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:44:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:44:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:44:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43351474
Sun 19 Jan 2014 01:44:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:44:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43351474
Sun 19 Jan 2014 01:44:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:44:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:44:25 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:44:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:44:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:44:28 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:44:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:44:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:44:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:44:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:44:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:44:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:44:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:44:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:44:29 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:44:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:44:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:44:29 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:44:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 01:44:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:44:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:44:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:44:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:44:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:44:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:44:32 - job_xml_thread(): Done retrieving: data size 43357017
Sun 19 Jan 2014 01:44:32 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:44:32 - XML: Start document: iteration 9
Sun 19 Jan 2014 01:44:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43357017
Sun 19 Jan 2014 01:44:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43357017
Sun 19 Jan 2014 01:44:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:44:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:44:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:44:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:44:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:44:43 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:44:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:44:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:44:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:44:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:44:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:44:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:44:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:44:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:44:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:44:49 - XML: Processed 649750 elements - found 0 jobs
Sun 19 Jan 2014 01:44:49 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:44:49 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:44:49 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:44:49 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:44:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:44:52 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:44:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:44:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:44:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:44:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:44:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:44:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:44:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:44:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43337169
Sun 19 Jan 2014 01:44:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:44:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43337169
Sun 19 Jan 2014 01:44:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:45:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:45:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:45:04 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:45:04 - job_xml_thread(): Done retrieving: data size 43337169
Sun 19 Jan 2014 01:45:04 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:45:04 - XML: Start document: iteration 10
Sun 19 Jan 2014 01:45:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:45:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:45:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:45:11 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:45:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:45:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:45:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:45:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:45:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:45:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:45:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:45:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:45:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:45:12 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:45:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 01:45:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:45:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 01:45:13 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:45:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9060 values 142895 bits 17861 bytes 
Sun 19 Jan 2014 01:45:16 - XML: Processed 649755 elements - found 0 jobs
Sun 19 Jan 2014 01:45:16 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:45:16 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:45:16 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:45:17 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:45:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:45:18 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:45:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:45:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:45:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:45:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:45:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:45:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:45:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:45:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43339436
Sun 19 Jan 2014 01:45:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:45:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43339436
Sun 19 Jan 2014 01:45:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:45:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:45:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:45:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:45:31 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:45:32 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:45:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:45:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:45:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:45:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:45:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:45:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:45:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:45:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:45:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:45:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:45:37 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:45:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:45:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:45:38 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:45:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 01:45:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:45:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:45:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:45:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:45:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:45:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:45:41 - job_xml_thread(): Done retrieving: data size 43332062
Sun 19 Jan 2014 01:45:41 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:45:41 - XML: Start document: iteration 11
Sun 19 Jan 2014 01:45:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43332062
Sun 19 Jan 2014 01:45:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:45:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43332062
Sun 19 Jan 2014 01:45:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:45:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:45:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:45:50 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 01:45:50 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:45:51 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:45:51 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:45:51 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 01:45:51 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 01:45:52 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 01:45:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:45:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:45:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:45:54 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:45:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:45:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:45:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:45:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:45:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:45:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:45:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:46:00 - XML: Processed 649780 elements - found 0 jobs
Sun 19 Jan 2014 01:46:00 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:46:00 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:46:00 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:46:00 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:46:00 - size of cluster 'LISA Cluster': 624 hosts 79462 metrics 695491 values 10963104 bits 1370388 bytes 
Sun 19 Jan 2014 01:46:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:46:04 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:46:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:46:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:46:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:46:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:46:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:46:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:46:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:46:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43338577
Sun 19 Jan 2014 01:46:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:46:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43338577
Sun 19 Jan 2014 01:46:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:46:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:46:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:46:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:46:12 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:46:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:46:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 01:46:14 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:46:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 01:46:14 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:46:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8934 values 141011 bits 17626 bytes 
Sun 19 Jan 2014 01:46:15 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:46:15 - job_xml_thread(): Done retrieving: data size 43338577
Sun 19 Jan 2014 01:46:16 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:46:16 - XML: Start document: iteration 12
Sun 19 Jan 2014 01:46:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:46:18 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:46:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:46:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:46:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:46:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:46:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:46:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:46:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:46:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:46:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:46:24 - XML: Processed 649785 elements - found 0 jobs
Sun 19 Jan 2014 01:46:24 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:46:24 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:46:24 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:46:24 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:46:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:46:28 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:46:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:46:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:46:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:46:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:46:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:46:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:46:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:46:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43321303
Sun 19 Jan 2014 01:46:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:46:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43321303
Sun 19 Jan 2014 01:46:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:46:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:46:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:46:39 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:46:39 - job_xml_thread(): Done retrieving: data size 43321303
Sun 19 Jan 2014 01:46:39 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:46:39 - XML: Start document: iteration 13
Sun 19 Jan 2014 01:46:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:46:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:46:50 - XML: Processed 649795 elements - found 0 jobs
Sun 19 Jan 2014 01:46:50 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:46:50 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:46:50 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:46:50 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:46:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:46:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:46:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:46:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:46:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:46:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:46:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:46:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:46:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:46:52 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:46:52 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 01:46:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:46:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:46:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:46:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:46:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:46:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:46:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:46:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:46:57 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:46:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 01:46:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:47:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:47:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43339319
Sun 19 Jan 2014 01:47:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:47:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43339319
Sun 19 Jan 2014 01:47:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:47:05 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:47:05 - job_xml_thread(): Done retrieving: data size 43339319
Sun 19 Jan 2014 01:47:05 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:47:05 - XML: Start document: iteration 14
Sun 19 Jan 2014 01:47:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:47:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:47:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:47:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:47:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:47:14 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:47:16 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:47:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:47:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 01:47:16 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:47:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 01:47:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5371 values 84917 bits 10614 bytes 
Sun 19 Jan 2014 01:47:18 - XML: Processed 649800 elements - found 0 jobs
Sun 19 Jan 2014 01:47:18 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:47:18 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:47:18 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:47:18 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:47:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:47:22 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:47:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:47:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:47:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:47:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:47:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:47:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:47:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:47:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:47:25 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:47:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:47:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:47:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:47:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:47:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:47:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:47:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:47:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43273813
Sun 19 Jan 2014 01:47:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:47:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43273813
Sun 19 Jan 2014 01:47:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:47:33 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:47:33 - job_xml_thread(): Done retrieving: data size 43273813
Sun 19 Jan 2014 01:47:33 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:47:33 - XML: Start document: iteration 15
Sun 19 Jan 2014 01:47:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:47:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:47:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:47:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:47:43 - XML: Processed 649050 elements - found 0 jobs
Sun 19 Jan 2014 01:47:43 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:47:43 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:47:43 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:47:44 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:47:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:47:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:47:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:47:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:47:51 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:47:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 01:47:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:47:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:47:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:47:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:47:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:47:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:47:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:47:53 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:47:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:47:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:47:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:47:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:47:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:47:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:47:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:47:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42683313
Sun 19 Jan 2014 01:47:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:47:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42683313
Sun 19 Jan 2014 01:47:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:47:59 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:47:59 - job_xml_thread(): Done retrieving: data size 42683313
Sun 19 Jan 2014 01:47:59 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:47:59 - XML: Start document: iteration 16
Sun 19 Jan 2014 01:48:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:48:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:48:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:48:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:48:11 - XML: Processed 641682 elements - found 0 jobs
Sun 19 Jan 2014 01:48:11 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:48:11 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:48:11 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:48:11 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:48:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:48:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:48:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:48:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:48:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:48:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:48:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:48:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:48:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:48:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:48:17 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:48:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:48:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 01:48:18 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:48:18 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:48:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 01:48:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6057 values 95907 bits 11988 bytes 
Sun 19 Jan 2014 01:48:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:48:21 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:48:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:48:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:48:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:48:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:48:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:48:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:48:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:48:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42749622
Sun 19 Jan 2014 01:48:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:48:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42749622
Sun 19 Jan 2014 01:48:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:48:26 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:48:26 - job_xml_thread(): Done retrieving: data size 42749622
Sun 19 Jan 2014 01:48:26 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:48:26 - XML: Start document: iteration 17
Sun 19 Jan 2014 01:48:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:48:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:48:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:48:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:48:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:48:39 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:48:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:48:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:48:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:48:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:48:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:48:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:48:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:48:41 - XML: Processed 642374 elements - found 0 jobs
Sun 19 Jan 2014 01:48:41 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:48:41 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:48:41 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:48:41 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:48:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:48:47 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:48:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:48:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:48:48 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:48:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 01:48:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:48:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:48:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:48:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:48:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:48:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:48:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43263362
Sun 19 Jan 2014 01:48:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:48:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43263362
Sun 19 Jan 2014 01:48:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:48:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:48:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:48:56 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:48:56 - job_xml_thread(): Done retrieving: data size 43263362
Sun 19 Jan 2014 01:48:56 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:48:56 - XML: Start document: iteration 18
Sun 19 Jan 2014 01:49:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:49:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:49:08 - XML: Processed 648898 elements - found 0 jobs
Sun 19 Jan 2014 01:49:08 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:49:08 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:49:08 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:49:09 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:49:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:49:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:49:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:49:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:49:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:49:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:49:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:49:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:49:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:49:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:49:11 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:49:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:49:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:49:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:49:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:49:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:49:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:49:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:49:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43344996
Sun 19 Jan 2014 01:49:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:49:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43344996
Sun 19 Jan 2014 01:49:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:49:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:49:18 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:49:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:49:21 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:49:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 01:49:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 01:49:21 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:49:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8639 values 136367 bits 17045 bytes 
Sun 19 Jan 2014 01:49:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:49:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:49:24 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:49:24 - job_xml_thread(): Done retrieving: data size 43344996
Sun 19 Jan 2014 01:49:24 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:49:24 - XML: Start document: iteration 19
Sun 19 Jan 2014 01:49:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:49:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:49:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:49:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:49:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:49:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:49:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:49:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:49:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:49:33 - XML: Processed 649840 elements - found 0 jobs
Sun 19 Jan 2014 01:49:33 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:49:33 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:49:33 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:49:33 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:49:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:49:35 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:49:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:49:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:49:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:49:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:49:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:49:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:49:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:49:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43338964
Sun 19 Jan 2014 01:49:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:49:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43338964
Sun 19 Jan 2014 01:49:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:49:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:49:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:49:48 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:49:48 - job_xml_thread(): Done retrieving: data size 43338964
Sun 19 Jan 2014 01:49:48 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:49:48 - XML: Start document: iteration 20
Sun 19 Jan 2014 01:49:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:49:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:49:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:49:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:49:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:49:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:49:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:49:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:49:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:49:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:49:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:49:59 - XML: Processed 649850 elements - found 0 jobs
Sun 19 Jan 2014 01:49:59 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:49:59 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:49:59 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:49:59 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:50:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:50:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:50:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:50:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:50:03 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:50:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 01:50:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:50:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:50:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:50:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:50:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:50:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:50:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:50:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:50:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43325808
Sun 19 Jan 2014 01:50:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:50:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43325808
Sun 19 Jan 2014 01:50:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:50:14 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:50:14 - job_xml_thread(): Done retrieving: data size 43325808
Sun 19 Jan 2014 01:50:15 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:50:15 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 01:50:15 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 01:50:15 - Housekeeping: done.
Sun 19 Jan 2014 01:50:15 - XML: Start document: iteration 0
Sun 19 Jan 2014 01:50:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:50:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:50:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:50:19 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:50:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:50:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:50:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:50:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:50:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:50:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:50:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:50:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:50:21 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:50:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:50:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 01:50:22 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:50:23 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:50:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 01:50:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5695 values 89839 bits 11229 bytes 
Sun 19 Jan 2014 01:50:29 - XML: Processed 649855 elements - found 0 jobs
Sun 19 Jan 2014 01:50:29 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:50:29 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:50:29 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:50:29 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:50:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:50:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:50:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:50:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:50:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:50:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:50:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:50:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:50:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:50:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43329618
Sun 19 Jan 2014 01:50:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:50:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:50:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:50:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43329618
Sun 19 Jan 2014 01:50:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:50:44 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:50:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:50:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:50:44 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:50:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:50:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:50:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:50:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:50:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:50:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:50:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:50:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:50:46 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:50:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 01:50:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:50:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:50:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:50:50 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 01:50:50 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 01:50:50 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:50:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:50:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:50:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:50:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:50:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:50:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:50:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:50:52 - job_xml_thread(): Done retrieving: data size 43356007
Sun 19 Jan 2014 01:50:52 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:50:52 - XML: Start document: iteration 1
Sun 19 Jan 2014 01:50:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43356007
Sun 19 Jan 2014 01:50:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:50:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43356007
Sun 19 Jan 2014 01:50:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:51:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:51:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:51:02 - XML: Processed 649860 elements - found 0 jobs
Sun 19 Jan 2014 01:51:02 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:51:02 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:51:02 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:51:02 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:51:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:51:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:51:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:51:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:51:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:51:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:51:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:51:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:51:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:51:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:51:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:51:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:51:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:51:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:51:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:51:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:51:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:51:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:51:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:51:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:51:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43348457
Sun 19 Jan 2014 01:51:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:51:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43348457
Sun 19 Jan 2014 01:51:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:51:17 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:51:17 - job_xml_thread(): Done retrieving: data size 43348457
Sun 19 Jan 2014 01:51:17 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:51:17 - XML: Start document: iteration 2
Sun 19 Jan 2014 01:51:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:51:23 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:51:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:51:24 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:51:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 01:51:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 01:51:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:51:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:51:25 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:51:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9061 values 143074 bits 17884 bytes 
Sun 19 Jan 2014 01:51:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:51:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:51:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:51:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:51:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:51:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:51:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:51:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:51:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:51:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:51:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:51:32 - XML: Processed 649885 elements - found 0 jobs
Sun 19 Jan 2014 01:51:32 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:51:32 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:51:32 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:51:32 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:51:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:51:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:51:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:51:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:51:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:51:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:51:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:51:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:51:38 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:51:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 01:51:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:51:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:51:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43334566
Sun 19 Jan 2014 01:51:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:51:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43334566
Sun 19 Jan 2014 01:51:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:51:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:51:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:51:47 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:51:48 - job_xml_thread(): Done retrieving: data size 43334566
Sun 19 Jan 2014 01:51:48 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:51:48 - XML: Start document: iteration 3
Sun 19 Jan 2014 01:51:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:51:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:51:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:51:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:51:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:51:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:51:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:51:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:51:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:51:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:51:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:51:58 - XML: Processed 649885 elements - found 0 jobs
Sun 19 Jan 2014 01:51:58 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:51:58 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:51:58 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:51:58 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:52:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:52:00 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:52:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:52:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:52:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:52:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:52:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:52:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:52:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:52:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43351581
Sun 19 Jan 2014 01:52:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:52:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43351581
Sun 19 Jan 2014 01:52:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:52:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:52:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:52:13 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:52:13 - job_xml_thread(): Done retrieving: data size 43351581
Sun 19 Jan 2014 01:52:13 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:52:13 - XML: Start document: iteration 4
Sun 19 Jan 2014 01:52:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:52:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:52:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:52:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:52:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:52:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:52:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:52:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:52:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:52:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:52:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:52:24 - XML: Processed 649885 elements - found 0 jobs
Sun 19 Jan 2014 01:52:24 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:52:24 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:52:24 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:52:24 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:52:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:52:24 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:52:26 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:52:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 01:52:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:52:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:52:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 01:52:26 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:52:26 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:52:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99119 bits 12389 bytes 
Sun 19 Jan 2014 01:52:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:52:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:52:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:52:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:52:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:52:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:52:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:52:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43334169
Sun 19 Jan 2014 01:52:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:52:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43334169
Sun 19 Jan 2014 01:52:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:52:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:52:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:52:39 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:52:39 - job_xml_thread(): Done retrieving: data size 43334169
Sun 19 Jan 2014 01:52:39 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:52:39 - XML: Start document: iteration 5
Sun 19 Jan 2014 01:52:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:52:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:52:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:52:46 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:52:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:52:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:52:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:52:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:52:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:52:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:52:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:52:52 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 01:52:52 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:52:52 - XML: Processed 649900 elements - found 0 jobs
Sun 19 Jan 2014 01:52:52 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:52:52 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:52:52 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:52:52 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:52:53 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:52:53 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 01:52:53 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 01:52:53 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:52:53 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 01:52:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:52:53 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:52:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:52:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:52:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:52:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:52:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:52:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:52:54 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 783127 values 12359768 bits 1544971 bytes 
Sun 19 Jan 2014 01:52:54 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:52:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 01:52:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:52:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:52:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43334364
Sun 19 Jan 2014 01:52:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:52:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43334364
Sun 19 Jan 2014 01:52:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:53:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:53:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:53:07 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:53:07 - job_xml_thread(): Done retrieving: data size 43334364
Sun 19 Jan 2014 01:53:07 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:53:07 - XML: Start document: iteration 6
Sun 19 Jan 2014 01:53:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:53:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:53:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:53:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:53:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:53:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:53:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:53:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:53:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:53:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:53:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:53:17 - XML: Processed 649905 elements - found 0 jobs
Sun 19 Jan 2014 01:53:17 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:53:17 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:53:17 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:53:17 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:53:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:53:20 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:53:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:53:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:53:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:53:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:53:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:53:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:53:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:53:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43281175
Sun 19 Jan 2014 01:53:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:53:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43281175
Sun 19 Jan 2014 01:53:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:53:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:53:28 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:53:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:53:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 01:53:30 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:53:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 01:53:30 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:53:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:53:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:53:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8913 values 140671 bits 17583 bytes 
Sun 19 Jan 2014 01:53:32 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:53:32 - job_xml_thread(): Done retrieving: data size 43281175
Sun 19 Jan 2014 01:53:32 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:53:32 - XML: Start document: iteration 7
Sun 19 Jan 2014 01:53:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:53:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:53:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:53:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:53:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:53:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:53:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:53:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:53:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:53:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:53:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:53:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:53:47 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:53:47 - XML: Processed 649166 elements - found 0 jobs
Sun 19 Jan 2014 01:53:47 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:53:47 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:53:47 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:53:47 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:53:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:53:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:53:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:53:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:53:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:53:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:53:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:53:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:53:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:53:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42766071
Sun 19 Jan 2014 01:53:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:53:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42766071
Sun 19 Jan 2014 01:53:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:53:53 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:53:53 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 01:54:02 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:54:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:54:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:54:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:54:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:54:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:54:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:54:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:54:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:54:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:54:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:54:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:54:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:54:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:54:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:54:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:54:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:54:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:54:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:54:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:54:09 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:54:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 01:54:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:54:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:54:11 - job_xml_thread(): Done retrieving: data size 42725975
Sun 19 Jan 2014 01:54:11 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:54:11 - XML: Start document: iteration 8
Sun 19 Jan 2014 01:54:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42725975
Sun 19 Jan 2014 01:54:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:54:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42725975
Sun 19 Jan 2014 01:54:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:54:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:54:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:54:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:54:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:54:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:54:30 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:54:31 - XML: Processed 642331 elements - found 0 jobs
Sun 19 Jan 2014 01:54:31 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:54:31 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:54:31 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:54:31 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:54:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:54:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 01:54:31 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:54:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5502 values 86744 bits 10843 bytes 
Sun 19 Jan 2014 01:54:31 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:54:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 01:54:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:54:32 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:54:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:54:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:54:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:54:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:54:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:54:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:54:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:54:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:54:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:54:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:54:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:54:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:54:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:54:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:54:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:54:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:54:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42946466
Sun 19 Jan 2014 01:54:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:54:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42946466
Sun 19 Jan 2014 01:54:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:54:46 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:54:46 - job_xml_thread(): Done retrieving: data size 42946466
Sun 19 Jan 2014 01:54:46 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:54:46 - XML: Start document: iteration 9
Sun 19 Jan 2014 01:54:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:54:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:54:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:54:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:54:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:54:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:54:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:54:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:54:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:54:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:54:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:54:58 - XML: Processed 644845 elements - found 0 jobs
Sun 19 Jan 2014 01:54:58 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:54:58 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:54:58 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:54:58 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:55:00 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:55:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 01:55:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:55:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:55:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:55:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:55:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:55:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:55:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:55:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:55:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:55:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:55:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43331340
Sun 19 Jan 2014 01:55:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:55:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43331340
Sun 19 Jan 2014 01:55:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:55:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:55:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:55:13 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:55:13 - job_xml_thread(): Done retrieving: data size 43331340
Sun 19 Jan 2014 01:55:13 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:55:13 - XML: Start document: iteration 10
Sun 19 Jan 2014 01:55:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:55:18 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:55:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:55:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:55:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:55:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:55:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:55:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:55:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:55:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:55:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:55:25 - XML: Processed 649861 elements - found 0 jobs
Sun 19 Jan 2014 01:55:25 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:55:25 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:55:25 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:55:25 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:55:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:55:27 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:55:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:55:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:55:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:55:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:55:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:55:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:55:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:55:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43331004
Sun 19 Jan 2014 01:55:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:55:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43331004
Sun 19 Jan 2014 01:55:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:55:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:55:31 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:55:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:55:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 01:55:32 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:55:32 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:55:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 01:55:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6346 values 100190 bits 12523 bytes 
Sun 19 Jan 2014 01:55:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:55:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:55:40 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:55:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:55:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:55:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:55:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:55:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:55:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:55:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:55:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:55:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:55:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:55:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:55:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:55:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:55:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:55:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:55:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:55:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:55:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:55:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:55:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:55:48 - job_xml_thread(): Done retrieving: data size 43354423
Sun 19 Jan 2014 01:55:48 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:55:48 - XML: Start document: iteration 11
Sun 19 Jan 2014 01:55:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43354423
Sun 19 Jan 2014 01:55:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:55:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43354423
Sun 19 Jan 2014 01:55:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:55:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:55:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:56:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:56:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:56:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:56:03 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:56:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:56:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:56:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:56:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:56:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:56:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:56:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:56:10 - XML: Processed 649955 elements - found 0 jobs
Sun 19 Jan 2014 01:56:10 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:56:10 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:56:10 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:56:10 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:56:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:56:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:56:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:56:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:56:12 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:56:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 01:56:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:56:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:56:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:56:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:56:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:56:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:56:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43334538
Sun 19 Jan 2014 01:56:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:56:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43334538
Sun 19 Jan 2014 01:56:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:56:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:56:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:56:25 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:56:25 - job_xml_thread(): Done retrieving: data size 43334538
Sun 19 Jan 2014 01:56:25 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:56:25 - XML: Start document: iteration 12
Sun 19 Jan 2014 01:56:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:56:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:56:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:56:30 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:56:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:56:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:56:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:56:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:56:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:56:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:56:33 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:56:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:56:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:56:34 - XML: Processed 649965 elements - found 0 jobs
Sun 19 Jan 2014 01:56:34 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:56:34 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:56:34 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:56:34 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:56:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:56:34 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:56:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 01:56:34 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:56:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5398 values 85105 bits 10638 bytes 
Sun 19 Jan 2014 01:56:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 01:56:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:56:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:56:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:56:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:56:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:56:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:56:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:56:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:56:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:56:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43347586
Sun 19 Jan 2014 01:56:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:56:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43347586
Sun 19 Jan 2014 01:56:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:56:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:56:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:56:49 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:56:49 - job_xml_thread(): Done retrieving: data size 43347586
Sun 19 Jan 2014 01:56:49 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:56:49 - XML: Start document: iteration 13
Sun 19 Jan 2014 01:56:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:56:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:56:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:56:57 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:56:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:56:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:56:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:56:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:56:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:56:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:56:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:57:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:57:05 - XML: Processed 649965 elements - found 0 jobs
Sun 19 Jan 2014 01:57:05 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:57:05 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:57:05 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:57:05 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:57:05 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:57:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:57:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:57:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:57:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:57:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:57:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:57:06 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:57:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 01:57:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:57:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:57:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43357238
Sun 19 Jan 2014 01:57:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:57:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43357238
Sun 19 Jan 2014 01:57:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:57:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:57:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:57:20 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:57:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:57:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:57:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:57:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:57:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:57:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:57:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:57:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:57:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:57:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:57:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:57:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:57:24 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:57:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:57:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:57:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:57:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:57:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:57:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:57:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:57:26 - job_xml_thread(): Done retrieving: data size 43348026
Sun 19 Jan 2014 01:57:26 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:57:26 - XML: Start document: iteration 14
Sun 19 Jan 2014 01:57:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43348026
Sun 19 Jan 2014 01:57:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:57:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43348026
Sun 19 Jan 2014 01:57:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:57:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:57:34 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:57:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:57:36 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:57:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 01:57:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 01:57:37 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:57:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:57:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:57:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8754 values 138098 bits 17262 bytes 
Sun 19 Jan 2014 01:57:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:57:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:57:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:57:39 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:57:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:57:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:57:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:57:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:57:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:57:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:57:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:57:46 - XML: Processed 649995 elements - found 0 jobs
Sun 19 Jan 2014 01:57:46 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:57:46 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:57:46 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:57:46 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:57:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:57:51 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:57:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:57:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:57:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:57:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:57:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:57:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:57:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:57:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43346527
Sun 19 Jan 2014 01:57:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:57:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43346527
Sun 19 Jan 2014 01:57:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:57:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:57:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:58:01 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:58:01 - job_xml_thread(): Done retrieving: data size 43346527
Sun 19 Jan 2014 01:58:01 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:58:01 - XML: Start document: iteration 15
Sun 19 Jan 2014 01:58:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:58:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:58:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:58:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:58:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:58:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:58:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:58:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:58:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:58:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:58:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:58:15 - XML: Processed 650000 elements - found 0 jobs
Sun 19 Jan 2014 01:58:15 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:58:15 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:58:15 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:58:15 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:58:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:58:16 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:58:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:58:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:58:16 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:58:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 01:58:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:58:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:58:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:58:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:58:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:58:18 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 01:58:18 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 01:58:18 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:58:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:58:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43341808
Sun 19 Jan 2014 01:58:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:58:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:58:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:58:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43341808
Sun 19 Jan 2014 01:58:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:58:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:58:27 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:58:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:58:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:58:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:58:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:58:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:58:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:58:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43341808
Sun 19 Jan 2014 01:58:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:58:30 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:58:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:58:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:58:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:58:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:58:37 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:58:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:58:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:58:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:58:38 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:58:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 01:58:38 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:58:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 01:58:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5785 values 91263 bits 11407 bytes 
Sun 19 Jan 2014 01:58:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:58:40 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:58:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:58:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:58:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:58:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:58:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:58:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:58:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:58:42 - job_xml_thread(): Done retrieving: data size 43336181
Sun 19 Jan 2014 01:58:42 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:58:42 - XML: Start document: iteration 16
Sun 19 Jan 2014 01:58:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43336181
Sun 19 Jan 2014 01:58:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:58:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:58:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:58:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:58:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:58:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:58:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43336181
Sun 19 Jan 2014 01:58:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:58:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:58:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:58:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:58:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:58:58 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:58:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:58:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:59:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:59:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:59:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:59:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:59:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:59:00 - XML: Processed 650010 elements - found 0 jobs
Sun 19 Jan 2014 01:59:00 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:59:00 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:59:00 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:59:00 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:59:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:59:05 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:59:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:59:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:59:05 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:59:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 01:59:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:59:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:59:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:59:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:59:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:59:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:59:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43387104
Sun 19 Jan 2014 01:59:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:59:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43387104
Sun 19 Jan 2014 01:59:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:59:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:59:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:59:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:59:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:59:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:59:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:59:16 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:59:16 - job_xml_thread(): Done retrieving: data size 43387104
Sun 19 Jan 2014 01:59:17 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:59:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:59:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:59:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:59:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:59:17 - XML: Start document: iteration 17
Sun 19 Jan 2014 01:59:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:59:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:59:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:59:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:59:24 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:59:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:59:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:59:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:59:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:59:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:59:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:59:27 - XML: Processed 650287 elements - found 0 jobs
Sun 19 Jan 2014 01:59:27 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 01:59:27 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 01:59:27 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 01:59:27 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 01:59:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:59:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43393947
Sun 19 Jan 2014 01:59:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:59:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43393947
Sun 19 Jan 2014 01:59:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:59:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:59:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:59:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 01:59:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 01:59:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 01:59:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:59:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:59:39 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 01:59:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:59:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 01:59:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:59:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 01:59:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 01:59:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:59:40 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 01:59:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 01:59:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 01:59:40 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 01:59:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8930 values 140890 bits 17611 bytes 
Sun 19 Jan 2014 01:59:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:59:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:59:42 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 01:59:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 01:59:42 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 01:59:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 01:59:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:59:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:59:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:59:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 01:59:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 01:59:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 01:59:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42876918
Sun 19 Jan 2014 01:59:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 01:59:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42876918
Sun 19 Jan 2014 01:59:46 - job_xml_thread(): Done retrieving: data size 42876918
Sun 19 Jan 2014 01:59:46 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 01:59:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 01:59:46 - XML: Start document: iteration 18
Sun 19 Jan 2014 01:59:53 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 01:59:53 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 01:59:53 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:59:53 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 01:59:53 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 01:59:53 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 01:59:53 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 01:59:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 01:59:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 01:59:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 01:59:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:00:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:00:00 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:00:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:00:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:00:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:00:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:00:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:00:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:00:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:00:02 - size of cluster 'LISA Cluster': 624 hosts 79472 metrics 710931 values 11208203 bits 1401025 bytes 
Sun 19 Jan 2014 02:00:08 - XML: Processed 644554 elements - found 0 jobs
Sun 19 Jan 2014 02:00:08 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:00:08 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:00:08 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:00:08 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:00:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:00:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:00:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:00:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:00:10 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:00:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 02:00:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:00:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:00:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:00:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:00:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:00:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:00:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42859069
Sun 19 Jan 2014 02:00:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:00:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42859069
Sun 19 Jan 2014 02:00:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:00:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:00:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:00:23 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:00:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:00:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:00:25 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:00:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:00:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:00:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:00:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:00:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:00:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:00:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:00:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:00:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:00:28 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:00:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:00:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:00:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:00:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:00:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:00:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:00:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:00:32 - job_xml_thread(): Done retrieving: data size 42893497
Sun 19 Jan 2014 02:00:32 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:00:32 - XML: Start document: iteration 19
Sun 19 Jan 2014 02:00:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42893497
Sun 19 Jan 2014 02:00:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:00:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42893497
Sun 19 Jan 2014 02:00:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:00:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:00:40 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:00:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:00:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:00:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:00:41 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:00:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 02:00:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 02:00:41 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:00:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8943 values 141104 bits 17638 bytes 
Sun 19 Jan 2014 02:00:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:00:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:00:50 - XML: Processed 644730 elements - found 0 jobs
Sun 19 Jan 2014 02:00:50 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:00:50 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:00:51 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:00:51 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:00:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:00:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:00:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:00:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:00:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:00:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:00:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:00:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:00:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:00:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:00:52 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:00:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:00:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:00:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:00:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:00:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:00:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:00:53 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:00:53 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 02:00:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:00:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43478888
Sun 19 Jan 2014 02:00:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:00:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43478888
Sun 19 Jan 2014 02:00:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:01:06 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:01:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:01:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:01:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:01:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:01:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:01:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:01:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:01:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:01:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:01:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:01:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:01:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:01:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:01:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:01:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:01:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:01:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:01:12 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:01:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 02:01:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:01:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:01:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:01:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:01:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:01:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:01:15 - job_xml_thread(): Done retrieving: data size 43484698
Sun 19 Jan 2014 02:01:15 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:01:15 - XML: Start document: iteration 20
Sun 19 Jan 2014 02:01:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43484698
Sun 19 Jan 2014 02:01:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:01:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43484698
Sun 19 Jan 2014 02:01:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:01:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:01:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:01:28 - XML: Processed 652210 elements - found 0 jobs
Sun 19 Jan 2014 02:01:28 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:01:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:01:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:01:28 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:01:28 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:01:28 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:01:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:01:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:01:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:01:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:01:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:01:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:01:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:01:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:01:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:01:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:01:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:01:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:01:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:01:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:01:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:01:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:01:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:01:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:01:41 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:01:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:01:41 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:01:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 02:01:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 02:01:41 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:01:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5744 values 90686 bits 11335 bytes 
Sun 19 Jan 2014 02:01:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:01:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43485032
Sun 19 Jan 2014 02:01:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:01:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43485032
Sun 19 Jan 2014 02:01:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:01:43 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:01:43 - job_xml_thread(): Done retrieving: data size 43485032
Sun 19 Jan 2014 02:01:43 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:01:43 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 02:01:43 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 02:01:43 - Housekeeping: done.
Sun 19 Jan 2014 02:01:43 - XML: Start document: iteration 0
Sun 19 Jan 2014 02:01:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:01:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:01:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:01:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:01:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:01:57 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:01:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:01:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:01:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:01:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:01:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:01:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:01:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:02:01 - XML: Processed 652210 elements - found 0 jobs
Sun 19 Jan 2014 02:02:01 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:02:01 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:02:01 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:02:01 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:02:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:02:06 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:02:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:02:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:02:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:02:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:02:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:02:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:02:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:02:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43476545
Sun 19 Jan 2014 02:02:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:02:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43476545
Sun 19 Jan 2014 02:02:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:02:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:02:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:02:16 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:02:16 - job_xml_thread(): Done retrieving: data size 43476545
Sun 19 Jan 2014 02:02:16 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:02:16 - XML: Start document: iteration 1
Sun 19 Jan 2014 02:02:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:02:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:02:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:02:25 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:02:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:02:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:02:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:02:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:02:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:02:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:02:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:02:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:02:34 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:02:34 - XML: Processed 652212 elements - found 0 jobs
Sun 19 Jan 2014 02:02:34 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:02:34 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:02:34 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:02:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:02:34 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:02:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:02:34 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:02:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 02:02:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:02:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:02:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:02:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:02:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:02:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:02:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43500330
Sun 19 Jan 2014 02:02:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:02:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43500330
Sun 19 Jan 2014 02:02:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:02:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:02:42 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:02:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:02:42 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:02:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 02:02:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:02:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:02:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 02:02:42 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:02:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5907 values 93550 bits 11693 bytes 
Sun 19 Jan 2014 02:02:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:02:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:02:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:02:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:02:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:02:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:02:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:02:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:02:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:02:49 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:02:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:02:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:02:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:02:52 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:02:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:02:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:02:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:02:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:02:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:02:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:02:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:02:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43486583
Sun 19 Jan 2014 02:02:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:02:56 - job_xml_thread(): Done retrieving: data size 43486583
Sun 19 Jan 2014 02:02:56 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:02:56 - XML: Start document: iteration 2
Sun 19 Jan 2014 02:02:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43486583
Sun 19 Jan 2014 02:02:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:03:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:03:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:03:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:03:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:03:14 - XML: Processed 652225 elements - found 0 jobs
Sun 19 Jan 2014 02:03:14 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:03:14 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:03:14 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:03:14 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:03:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:03:19 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:03:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:03:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:03:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:03:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:03:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:03:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:03:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:03:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:03:20 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:03:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:03:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:03:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:03:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:03:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:03:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:03:20 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:03:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 02:03:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:03:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:03:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43498576
Sun 19 Jan 2014 02:03:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:03:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43498576
Sun 19 Jan 2014 02:03:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:03:29 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:03:31 - job_xml_thread(): Done retrieving: data size 43498576
Sun 19 Jan 2014 02:03:31 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:03:31 - XML: Start document: iteration 3
Sun 19 Jan 2014 02:03:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:03:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:03:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:03:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:03:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:03:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:03:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:03:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:03:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:03:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:03:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:03:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:03:42 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:03:42 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:03:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:03:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 02:03:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 02:03:42 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:03:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5751 values 90870 bits 11358 bytes 
Sun 19 Jan 2014 02:03:45 - XML: Processed 652235 elements - found 0 jobs
Sun 19 Jan 2014 02:03:45 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:03:45 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:03:45 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:03:45 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:03:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:03:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:03:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:03:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:03:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:03:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:03:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:03:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:03:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:03:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43488186
Sun 19 Jan 2014 02:03:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:03:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43488186
Sun 19 Jan 2014 02:03:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:03:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:03:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:03:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:03:59 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:03:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:03:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:04:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:04:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:04:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:04:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:04:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:04:00 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:04:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:04:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:04:05 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:04:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 02:04:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:04:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:04:06 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:04:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:04:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:04:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:04:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:04:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:04:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:04:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:04:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43487336
Sun 19 Jan 2014 02:04:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:04:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43487336
Sun 19 Jan 2014 02:04:09 - job_xml_thread(): Done retrieving: data size 43487336
Sun 19 Jan 2014 02:04:09 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:04:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:04:09 - XML: Start document: iteration 4
Sun 19 Jan 2014 02:04:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:04:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:04:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:04:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:04:25 - XML: Processed 652240 elements - found 0 jobs
Sun 19 Jan 2014 02:04:25 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:04:25 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:04:25 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:04:25 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:04:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:04:25 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:04:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:04:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:04:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:04:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:04:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:04:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:04:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:04:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:04:32 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:04:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:04:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:04:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:04:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:04:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:04:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:04:34 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 02:04:34 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 02:04:34 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:04:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:04:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43511772
Sun 19 Jan 2014 02:04:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:04:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43511772
Sun 19 Jan 2014 02:04:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:04:40 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:04:41 - job_xml_thread(): Done retrieving: data size 43511772
Sun 19 Jan 2014 02:04:41 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:04:41 - XML: Start document: iteration 5
Sun 19 Jan 2014 02:04:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:04:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:04:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:04:42 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:04:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:04:43 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:04:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:04:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:04:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:04:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 02:04:44 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:04:44 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:04:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 02:04:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8723 values 137574 bits 17196 bytes 
Sun 19 Jan 2014 02:04:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:04:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:04:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:04:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:04:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:04:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:04:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:04:54 - XML: Processed 652240 elements - found 0 jobs
Sun 19 Jan 2014 02:04:54 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:04:54 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:04:54 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:04:54 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:04:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:04:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:04:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:04:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:04:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:04:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:04:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:04:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:04:58 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:04:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 02:04:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:04:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:04:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43478769
Sun 19 Jan 2014 02:04:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:04:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43478769
Sun 19 Jan 2014 02:04:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:04:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:04:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:05:09 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:05:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:05:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:05:10 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:05:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:05:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:05:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:05:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:05:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:05:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:05:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:05:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:05:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:05:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:05:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:05:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:05:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:05:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:05:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:05:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:05:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:05:14 - job_xml_thread(): Done retrieving: data size 43437778
Sun 19 Jan 2014 02:05:14 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:05:14 - XML: Start document: iteration 6
Sun 19 Jan 2014 02:05:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43437778
Sun 19 Jan 2014 02:05:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:05:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43437778
Sun 19 Jan 2014 02:05:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:05:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:05:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:05:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:05:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:05:31 - XML: Processed 651515 elements - found 0 jobs
Sun 19 Jan 2014 02:05:31 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:05:31 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:05:31 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:05:31 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:05:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:05:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:05:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:05:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:05:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:05:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:05:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:05:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:05:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:05:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:05:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:05:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:05:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:05:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:05:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:05:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:05:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:05:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:05:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42930000
Sun 19 Jan 2014 02:05:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:05:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42930000
Sun 19 Jan 2014 02:05:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:05:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:05:44 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:05:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:05:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 02:05:45 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:05:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 02:05:45 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:05:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148718 bits 18589 bytes 
Sun 19 Jan 2014 02:05:46 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:05:46 - job_xml_thread(): Done retrieving: data size 42930000
Sun 19 Jan 2014 02:05:46 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:05:46 - XML: Start document: iteration 7
Sun 19 Jan 2014 02:05:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:05:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:05:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:05:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:05:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:05:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:05:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:05:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:05:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:05:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:05:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:05:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:05:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:05:59 - XML: Processed 645352 elements - found 0 jobs
Sun 19 Jan 2014 02:05:59 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:05:59 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:05:59 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:05:59 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:06:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:06:01 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:06:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:06:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:06:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:06:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:06:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:06:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:06:03 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:06:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 02:06:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:06:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:06:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42837535
Sun 19 Jan 2014 02:06:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:06:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42837535
Sun 19 Jan 2014 02:06:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:06:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:06:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:06:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:06:13 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:06:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:06:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:06:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:06:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:06:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:06:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:06:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:06:14 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:06:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:06:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:06:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:06:17 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:06:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:06:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:06:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:06:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:06:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:06:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:06:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:06:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42902361
Sun 19 Jan 2014 02:06:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:06:19 - job_xml_thread(): Done retrieving: data size 42902361
Sun 19 Jan 2014 02:06:19 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:06:19 - XML: Start document: iteration 8
Sun 19 Jan 2014 02:06:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42902361
Sun 19 Jan 2014 02:06:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:06:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:06:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:06:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:06:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:06:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:06:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:06:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:06:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:06:35 - XML: Processed 644638 elements - found 0 jobs
Sun 19 Jan 2014 02:06:35 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:06:35 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:06:35 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:06:35 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:06:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:06:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:06:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:06:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:06:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:06:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:06:40 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:06:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:06:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:06:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:06:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:06:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:06:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:06:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:06:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43400751
Sun 19 Jan 2014 02:06:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:06:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43400751
Sun 19 Jan 2014 02:06:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:06:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:06:46 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:06:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:06:47 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:06:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 02:06:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 02:06:47 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:06:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148667 bits 18583 bytes 
Sun 19 Jan 2014 02:06:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:06:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:06:50 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:06:50 - job_xml_thread(): Done retrieving: data size 43400751
Sun 19 Jan 2014 02:06:50 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:06:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:06:50 - XML: Start document: iteration 9
Sun 19 Jan 2014 02:06:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:06:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:06:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:06:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:06:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:06:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:06:53 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 02:06:53 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:06:54 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:06:55 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 02:06:55 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 02:06:55 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:06:55 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 02:06:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:06:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:06:59 - XML: Processed 651187 elements - found 0 jobs
Sun 19 Jan 2014 02:06:59 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:06:59 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:06:59 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:06:59 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:07:00 - size of cluster 'LISA Cluster': 624 hosts 79470 metrics 756130 values 11941283 bits 1492660 bytes 
Sun 19 Jan 2014 02:07:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:07:03 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:07:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:07:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:07:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:07:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:07:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:07:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:07:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:07:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43470115
Sun 19 Jan 2014 02:07:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:07:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:07:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43470115
Sun 19 Jan 2014 02:07:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:07:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:07:15 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:07:15 - job_xml_thread(): Done retrieving: data size 43470115
Sun 19 Jan 2014 02:07:15 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:07:15 - XML: Start document: iteration 10
Sun 19 Jan 2014 02:07:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:07:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:07:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:07:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:07:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:07:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:07:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:07:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:07:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:07:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:07:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:07:27 - XML: Processed 652213 elements - found 0 jobs
Sun 19 Jan 2014 02:07:27 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:07:27 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:07:27 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:07:27 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:07:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:07:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:07:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:07:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:07:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:07:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:07:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:07:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:07:31 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:07:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 02:07:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:07:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:07:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43501404
Sun 19 Jan 2014 02:07:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:07:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43501404
Sun 19 Jan 2014 02:07:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:07:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:07:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:07:43 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:07:43 - job_xml_thread(): Done retrieving: data size 43501404
Sun 19 Jan 2014 02:07:43 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:07:43 - XML: Start document: iteration 11
Sun 19 Jan 2014 02:07:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:07:46 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:07:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:07:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:07:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:07:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:07:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:07:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:07:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:07:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:07:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:07:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:07:48 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:07:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:07:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 02:07:49 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:07:49 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:07:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 02:07:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5618 values 88602 bits 11075 bytes 
Sun 19 Jan 2014 02:07:55 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:07:55 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 02:07:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:07:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:07:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:07:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:07:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:07:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:07:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:07:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:07:57 - XML: Processed 652290 elements - found 0 jobs
Sun 19 Jan 2014 02:07:57 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:07:57 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:07:57 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:07:57 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:08:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:08:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:08:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:08:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43479072
Sun 19 Jan 2014 02:08:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:08:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43479072
Sun 19 Jan 2014 02:08:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:08:04 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:08:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 02:08:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:08:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:08:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:08:13 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:08:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:08:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:08:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:08:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:08:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:08:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:08:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:08:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:08:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:08:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:08:18 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:08:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:08:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:08:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:08:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:08:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:08:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:08:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:08:21 - job_xml_thread(): Done retrieving: data size 43492992
Sun 19 Jan 2014 02:08:21 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:08:21 - XML: Start document: iteration 12
Sun 19 Jan 2014 02:08:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43492992
Sun 19 Jan 2014 02:08:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:08:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43492992
Sun 19 Jan 2014 02:08:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:08:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:08:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:08:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:08:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:08:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:08:37 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:08:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:08:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:08:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:08:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:08:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:08:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:08:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:08:39 - XML: Processed 652290 elements - found 0 jobs
Sun 19 Jan 2014 02:08:39 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:08:39 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:08:39 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:08:39 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:08:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:08:45 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:08:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:08:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:08:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:08:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:08:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:08:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:08:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:08:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43508881
Sun 19 Jan 2014 02:08:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:08:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43508881
Sun 19 Jan 2014 02:08:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:08:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:08:49 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:08:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:08:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 02:08:49 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:08:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9408 values 148445 bits 18555 bytes 
Sun 19 Jan 2014 02:08:49 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:08:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 02:08:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:08:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:08:54 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:08:54 - job_xml_thread(): Done retrieving: data size 43508881
Sun 19 Jan 2014 02:08:54 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:08:54 - XML: Start document: iteration 13
Sun 19 Jan 2014 02:08:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:08:58 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:08:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:08:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:08:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:08:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:08:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:08:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:08:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:09:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:09:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:09:07 - XML: Processed 652290 elements - found 0 jobs
Sun 19 Jan 2014 02:09:07 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:09:07 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:09:07 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:09:07 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:09:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:09:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:09:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:09:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:09:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:09:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:09:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:09:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:09:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:09:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43480428
Sun 19 Jan 2014 02:09:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:09:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:09:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:09:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43480428
Sun 19 Jan 2014 02:09:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:09:22 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:09:23 - job_xml_thread(): Done retrieving: data size 43480428
Sun 19 Jan 2014 02:09:23 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:09:23 - XML: Start document: iteration 14
Sun 19 Jan 2014 02:09:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:09:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:09:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:09:29 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:09:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:09:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:09:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:09:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:09:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:09:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:09:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:09:33 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:09:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 02:09:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:09:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:09:35 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:09:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:09:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:09:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:09:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:09:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:09:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:09:38 - XML: Processed 652315 elements - found 0 jobs
Sun 19 Jan 2014 02:09:38 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:09:38 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:09:38 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:09:38 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:09:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:09:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43481694
Sun 19 Jan 2014 02:09:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43481694
Sun 19 Jan 2014 02:09:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:09:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:09:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:09:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:09:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:09:49 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:09:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:09:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 02:09:51 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:09:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 02:09:51 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:09:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5793 values 91334 bits 11416 bytes 
Sun 19 Jan 2014 02:09:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:09:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:09:53 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:09:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:09:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:09:54 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:09:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:09:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:09:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:09:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:09:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:09:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:09:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:09:58 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:09:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:09:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:09:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:09:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:09:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:09:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:10:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:10:01 - job_xml_thread(): Done retrieving: data size 43510519
Sun 19 Jan 2014 02:10:01 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:10:01 - XML: Start document: iteration 15
Sun 19 Jan 2014 02:10:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43510519
Sun 19 Jan 2014 02:10:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:10:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43510519
Sun 19 Jan 2014 02:10:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:10:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:10:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:10:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:10:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:10:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:10:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:10:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:10:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:10:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:10:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:10:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:10:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:10:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:10:24 - XML: Processed 652315 elements - found 0 jobs
Sun 19 Jan 2014 02:10:24 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:10:24 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:10:24 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:10:24 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:10:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:10:25 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:10:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:10:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:10:25 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:10:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 02:10:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:10:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:10:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:10:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:10:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:10:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:10:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43502888
Sun 19 Jan 2014 02:10:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:10:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43502888
Sun 19 Jan 2014 02:10:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:10:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:10:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:10:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:10:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:10:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:10:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:10:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:10:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:10:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:10:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:10:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:10:39 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:10:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:10:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:10:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:10:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:10:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:10:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:10:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:10:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:10:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:10:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:10:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:10:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43509476
Sun 19 Jan 2014 02:10:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:10:47 - job_xml_thread(): Done retrieving: data size 43509476
Sun 19 Jan 2014 02:10:47 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:10:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43509476
Sun 19 Jan 2014 02:10:47 - XML: Start document: iteration 16
Sun 19 Jan 2014 02:10:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:10:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:10:51 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:10:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:10:52 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:10:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 02:10:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 02:10:52 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:10:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8877 values 140065 bits 17508 bytes 
Sun 19 Jan 2014 02:10:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:10:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:10:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:10:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:11:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:11:06 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:11:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:11:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:11:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:11:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:11:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:11:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:11:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:11:07 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 02:11:07 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 02:11:07 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:11:09 - XML: Processed 652320 elements - found 0 jobs
Sun 19 Jan 2014 02:11:09 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:11:10 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:11:10 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:11:10 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:11:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:11:11 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:11:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:11:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:11:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:11:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:11:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:11:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:11:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:11:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43431961
Sun 19 Jan 2014 02:11:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:11:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43431961
Sun 19 Jan 2014 02:11:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:11:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:11:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:11:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:11:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:11:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:11:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:11:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:11:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:11:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:11:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:11:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:11:25 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:11:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:11:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:11:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:11:28 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:11:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:11:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:11:28 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:11:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 02:11:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:11:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:11:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:11:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:11:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:11:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:11:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43393722
Sun 19 Jan 2014 02:11:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:11:30 - job_xml_thread(): Done retrieving: data size 43393722
Sun 19 Jan 2014 02:11:30 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:11:30 - XML: Start document: iteration 17
Sun 19 Jan 2014 02:11:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43393722
Sun 19 Jan 2014 02:11:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:11:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:11:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:11:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:11:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:11:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:11:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:11:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:11:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:11:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:11:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:11:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:11:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:11:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:11:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:11:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:11:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:11:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:11:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:11:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:11:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:11:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:11:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:11:52 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:11:53 - XML: Processed 651053 elements - found 0 jobs
Sun 19 Jan 2014 02:11:53 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:11:53 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:11:53 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:11:53 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:11:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:11:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 02:11:53 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:11:53 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:11:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5788 values 91256 bits 11407 bytes 
Sun 19 Jan 2014 02:11:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 02:11:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:11:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42856409
Sun 19 Jan 2014 02:11:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:11:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42856409
Sun 19 Jan 2014 02:11:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:11:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:11:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:12:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:12:04 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:12:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:12:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:12:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:12:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:12:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:12:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:12:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:12:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:12:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:12:08 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:12:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:12:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:12:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:12:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:12:09 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:12:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 02:12:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:12:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:12:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:12:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:12:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:12:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:12:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42895690
Sun 19 Jan 2014 02:12:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:12:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42895690
Sun 19 Jan 2014 02:12:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:12:11 - job_xml_thread(): Done retrieving: data size 42895690
Sun 19 Jan 2014 02:12:11 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:12:11 - XML: Start document: iteration 18
Sun 19 Jan 2014 02:12:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:12:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:12:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:12:22 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:12:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:12:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:12:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:12:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:12:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:12:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:12:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:12:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:12:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:12:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:12:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:12:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:12:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:12:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:12:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:12:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:12:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:12:32 - XML: Processed 644821 elements - found 0 jobs
Sun 19 Jan 2014 02:12:32 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:12:32 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:12:32 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:12:32 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:12:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:12:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42907126
Sun 19 Jan 2014 02:12:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:12:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42907126
Sun 19 Jan 2014 02:12:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:12:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:12:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:12:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:12:44 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:12:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:12:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:12:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:12:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:12:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:12:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:12:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:12:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:12:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:12:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:12:47 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:12:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:12:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:12:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:12:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:12:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:12:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:12:47 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:12:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:12:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43434275
Sun 19 Jan 2014 02:12:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:12:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43434275
Sun 19 Jan 2014 02:12:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:12:49 - job_xml_thread(): Done retrieving: data size 43434275
Sun 19 Jan 2014 02:12:49 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:12:49 - XML: Start document: iteration 19
Sun 19 Jan 2014 02:12:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:12:53 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:12:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:12:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 02:12:56 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:12:56 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:12:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 02:12:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 11981 values 189012 bits 23626 bytes 
Sun 19 Jan 2014 02:12:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:12:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:13:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:13:01 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:13:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:13:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:13:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:13:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:13:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:13:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:13:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:13:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:13:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:13:09 - XML: Processed 651171 elements - found 0 jobs
Sun 19 Jan 2014 02:13:09 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:13:09 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:13:09 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:13:09 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:13:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:13:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:13:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:13:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:13:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:13:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:13:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:13:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:13:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:13:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43476523
Sun 19 Jan 2014 02:13:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:13:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43476523
Sun 19 Jan 2014 02:13:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:13:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:13:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:13:24 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:13:24 - job_xml_thread(): Done retrieving: data size 43476523
Sun 19 Jan 2014 02:13:24 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:13:24 - XML: Start document: iteration 20
Sun 19 Jan 2014 02:13:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:13:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:13:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:13:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:13:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:13:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:13:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:13:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:13:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:13:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:13:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:13:36 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:13:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 02:13:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:13:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:13:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:13:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:13:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:13:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:13:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:13:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:13:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:13:39 - XML: Processed 652350 elements - found 0 jobs
Sun 19 Jan 2014 02:13:39 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:13:39 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:13:39 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:13:39 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:13:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:13:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43492966
Sun 19 Jan 2014 02:13:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:13:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43492966
Sun 19 Jan 2014 02:13:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:13:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:13:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:13:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:13:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:13:54 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:13:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:13:55 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 02:13:55 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:13:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:13:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:13:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:13:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:13:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:13:56 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:13:56 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:13:56 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 02:13:56 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:13:56 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 02:13:56 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 02:13:56 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:13:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:13:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 02:13:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 02:13:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:13:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:13:57 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:13:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:13:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:13:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:13:57 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:13:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6167 values 97276 bits 12159 bytes 
Sun 19 Jan 2014 02:13:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:13:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:13:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:13:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:13:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:13:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:13:58 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 854016 values 13472710 bits 1684088 bytes 
Sun 19 Jan 2014 02:14:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:14:03 - job_xml_thread(): Done retrieving: data size 43504492
Sun 19 Jan 2014 02:14:03 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:14:03 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 02:14:03 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 02:14:03 - Housekeeping: done.
Sun 19 Jan 2014 02:14:03 - XML: Start document: iteration 0
Sun 19 Jan 2014 02:14:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43504492
Sun 19 Jan 2014 02:14:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:14:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43504492
Sun 19 Jan 2014 02:14:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:14:04 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:14:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 02:14:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:14:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:14:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:14:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:14:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:14:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:14:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:14:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:14:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:14:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:14:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:14:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:14:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:14:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:14:21 - XML: Processed 652355 elements - found 0 jobs
Sun 19 Jan 2014 02:14:21 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:14:21 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:14:21 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:14:21 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:14:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:14:25 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:14:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:14:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:14:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:14:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:14:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:14:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:14:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:14:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43493171
Sun 19 Jan 2014 02:14:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:14:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43493171
Sun 19 Jan 2014 02:14:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:14:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:14:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:14:36 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:14:36 - job_xml_thread(): Done retrieving: data size 43493171
Sun 19 Jan 2014 02:14:36 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:14:37 - XML: Start document: iteration 1
Sun 19 Jan 2014 02:14:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:14:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:14:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:14:43 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:14:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:14:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:14:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:14:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:14:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:14:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:14:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:14:51 - XML: Processed 652370 elements - found 0 jobs
Sun 19 Jan 2014 02:14:51 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:14:51 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:14:51 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:14:51 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:14:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:14:51 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:14:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:14:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:14:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:14:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:14:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:14:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:14:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:14:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43491707
Sun 19 Jan 2014 02:14:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:14:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43491707
Sun 19 Jan 2014 02:14:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:14:57 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:14:57 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 02:14:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:14:57 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:14:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:14:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 02:14:58 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:14:58 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:14:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 02:14:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148669 bits 18583 bytes 
Sun 19 Jan 2014 02:14:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:14:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:15:06 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:15:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:15:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:15:06 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:15:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:15:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:15:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:15:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:15:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:15:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:15:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:15:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:15:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:15:11 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:15:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:15:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:15:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:15:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:15:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:15:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:15:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:15:14 - job_xml_thread(): Done retrieving: data size 43500460
Sun 19 Jan 2014 02:15:14 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:15:14 - XML: Start document: iteration 2
Sun 19 Jan 2014 02:15:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43500460
Sun 19 Jan 2014 02:15:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:15:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43500460
Sun 19 Jan 2014 02:15:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:15:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:15:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:15:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:15:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:15:28 - XML: Processed 652375 elements - found 0 jobs
Sun 19 Jan 2014 02:15:28 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:15:28 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:15:28 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:15:28 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:15:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:15:36 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:15:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:15:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:15:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:15:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:15:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:15:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:15:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:15:38 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:15:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 02:15:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:15:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:15:39 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:15:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:15:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:15:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:15:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:15:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:15:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:15:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:15:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43507485
Sun 19 Jan 2014 02:15:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:15:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43507485
Sun 19 Jan 2014 02:15:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:15:44 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:15:44 - job_xml_thread(): Done retrieving: data size 43507485
Sun 19 Jan 2014 02:15:44 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:15:44 - XML: Start document: iteration 3
Sun 19 Jan 2014 02:15:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:15:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:15:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:15:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:15:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:15:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:15:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:15:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:15:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:15:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:15:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:15:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:15:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:15:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:15:59 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:16:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:16:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 02:16:00 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:16:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 02:16:00 - XML: Processed 652375 elements - found 0 jobs
Sun 19 Jan 2014 02:16:00 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:16:00 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:16:00 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:16:00 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:16:00 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:16:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5967 values 94186 bits 11773 bytes 
Sun 19 Jan 2014 02:16:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:16:03 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:16:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:16:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:16:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:16:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:16:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:16:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:16:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:16:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43498425
Sun 19 Jan 2014 02:16:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:16:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43498425
Sun 19 Jan 2014 02:16:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:16:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:16:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:16:15 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:16:15 - job_xml_thread(): Done retrieving: data size 43498425
Sun 19 Jan 2014 02:16:15 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:16:15 - XML: Start document: iteration 4
Sun 19 Jan 2014 02:16:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:16:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:16:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:16:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:16:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:16:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:16:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:16:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:16:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:16:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:16:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:16:26 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:16:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 02:16:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:16:28 - XML: Processed 652385 elements - found 0 jobs
Sun 19 Jan 2014 02:16:28 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:16:28 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:16:28 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:16:28 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:16:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:16:29 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:16:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:16:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:16:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:16:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:16:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:16:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:16:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:16:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:16:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:16:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43497992
Sun 19 Jan 2014 02:16:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:16:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43497992
Sun 19 Jan 2014 02:16:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:16:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:16:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:16:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:16:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:16:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:16:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:16:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:16:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:16:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43497992
Sun 19 Jan 2014 02:16:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:16:43 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:16:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:16:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:16:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:16:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:16:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:16:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:16:53 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:16:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:16:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:16:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:16:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:16:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:16:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:16:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:16:55 - job_xml_thread(): Done retrieving: data size 43496590
Sun 19 Jan 2014 02:16:55 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:16:55 - XML: Start document: iteration 5
Sun 19 Jan 2014 02:16:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43496590
Sun 19 Jan 2014 02:16:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:16:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:16:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:16:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:16:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:16:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:16:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:16:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43496590
Sun 19 Jan 2014 02:16:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:17:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:17:01 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:17:04 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:17:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:17:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 02:17:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 02:17:04 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:17:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9140 values 144518 bits 18064 bytes 
Sun 19 Jan 2014 02:17:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:17:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:17:13 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 02:17:13 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:17:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:17:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:17:13 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:17:13 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:17:13 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:17:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:17:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:17:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:17:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:17:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:17:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:17:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:17:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:17:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:17:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:17:17 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:17:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:17:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:17:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:17:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:17:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:17:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:17:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:17:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43442005
Sun 19 Jan 2014 02:17:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:17:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43442005
Sun 19 Jan 2014 02:17:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:17:28 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:17:28 - job_xml_thread(): Done retrieving: data size 43442005
Sun 19 Jan 2014 02:17:28 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:17:28 - XML: Start document: iteration 6
Sun 19 Jan 2014 02:17:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:17:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:17:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:17:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:17:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:17:37 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:17:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:17:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:17:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:17:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:17:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:17:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:17:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:17:41 - XML: Processed 651640 elements - found 0 jobs
Sun 19 Jan 2014 02:17:41 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:17:41 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:17:41 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:17:41 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:17:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:17:45 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:17:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:17:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:17:46 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:17:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 02:17:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:17:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:17:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:17:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:17:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:17:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:17:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42920925
Sun 19 Jan 2014 02:17:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:17:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42920925
Sun 19 Jan 2014 02:17:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:17:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:17:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:17:56 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:17:56 - job_xml_thread(): Done retrieving: data size 42920925
Sun 19 Jan 2014 02:17:56 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:17:56 - XML: Start document: iteration 7
Sun 19 Jan 2014 02:17:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:17:59 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:17:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:17:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:18:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:18:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:18:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:18:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:18:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:18:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:18:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:18:03 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 02:18:03 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 02:18:03 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:18:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:18:04 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:18:05 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:18:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:18:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 02:18:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 02:18:05 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:18:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5679 values 89792 bits 11224 bytes 
Sun 19 Jan 2014 02:18:10 - XML: Processed 645131 elements - found 0 jobs
Sun 19 Jan 2014 02:18:10 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:18:10 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:18:10 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:18:11 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:18:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:18:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:18:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:18:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:18:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:18:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:18:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:18:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:18:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:18:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42830777
Sun 19 Jan 2014 02:18:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:18:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42830777
Sun 19 Jan 2014 02:18:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:18:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:18:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:18:26 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:18:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:18:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:18:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:18:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:18:28 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:18:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:18:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:18:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:18:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:18:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:18:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:18:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:18:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:18:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:18:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:18:30 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:18:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 02:18:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:18:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:18:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:18:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:18:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:18:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:18:31 - job_xml_thread(): Done retrieving: data size 42972240
Sun 19 Jan 2014 02:18:31 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:18:31 - XML: Start document: iteration 8
Sun 19 Jan 2014 02:18:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42972240
Sun 19 Jan 2014 02:18:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42972240
Sun 19 Jan 2014 02:18:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:18:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:18:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:18:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:18:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:18:45 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:18:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:18:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:18:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:18:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:18:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:18:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:18:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:18:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:18:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:18:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:18:48 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:18:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:18:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:18:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:18:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:18:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:18:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:18:52 - XML: Processed 645378 elements - found 0 jobs
Sun 19 Jan 2014 02:18:52 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:18:52 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:18:52 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:18:52 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:18:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:18:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43482534
Sun 19 Jan 2014 02:18:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:18:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43482534
Sun 19 Jan 2014 02:18:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:19:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:19:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:19:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:19:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:19:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:19:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:19:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:19:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:19:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:19:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:19:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:19:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:19:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:19:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:19:05 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:19:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:19:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 02:19:06 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:19:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8933 values 141065 bits 17633 bytes 
Sun 19 Jan 2014 02:19:06 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:19:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 02:19:07 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:19:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:19:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:19:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:19:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:19:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:19:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:19:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:19:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:19:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:19:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43513382
Sun 19 Jan 2014 02:19:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:19:11 - job_xml_thread(): Done retrieving: data size 43513382
Sun 19 Jan 2014 02:19:11 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:19:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43513382
Sun 19 Jan 2014 02:19:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:19:11 - XML: Start document: iteration 9
Sun 19 Jan 2014 02:19:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:19:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:19:23 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 02:19:23 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:19:23 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:19:23 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:19:23 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:19:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:19:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:19:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:19:29 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:19:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:19:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:19:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:19:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:19:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:19:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:19:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:19:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:19:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:19:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:19:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:19:33 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:19:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 02:19:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:19:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:19:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:19:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:19:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:19:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:19:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43495024
Sun 19 Jan 2014 02:19:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:19:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43495024
Sun 19 Jan 2014 02:19:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:19:39 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:19:40 - job_xml_thread(): Done retrieving: data size 43495024
Sun 19 Jan 2014 02:19:40 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:19:40 - XML: Start document: iteration 10
Sun 19 Jan 2014 02:19:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:19:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:19:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:19:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:19:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:19:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:19:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:19:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:19:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:19:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:19:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:19:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:19:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:19:55 - XML: Processed 652388 elements - found 0 jobs
Sun 19 Jan 2014 02:19:55 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:19:55 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:19:55 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:19:55 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:19:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:19:57 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:19:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:19:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:19:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:19:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:19:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:19:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:19:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:19:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43504201
Sun 19 Jan 2014 02:19:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:19:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43504201
Sun 19 Jan 2014 02:19:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:20:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:20:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:20:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:20:07 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:20:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:20:08 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:20:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 02:20:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 02:20:09 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:20:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8763 values 138183 bits 17272 bytes 
Sun 19 Jan 2014 02:20:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:20:10 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:20:10 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:20:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:20:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:20:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:20:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:20:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:20:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:20:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:20:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:20:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:20:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:20:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:20:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:20:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:20:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:20:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:20:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:20:15 - job_xml_thread(): Done retrieving: data size 43520714
Sun 19 Jan 2014 02:20:15 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:20:15 - XML: Start document: iteration 11
Sun 19 Jan 2014 02:20:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43520714
Sun 19 Jan 2014 02:20:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:20:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43520714
Sun 19 Jan 2014 02:20:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:20:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:20:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:20:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:20:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:20:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:20:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:20:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:20:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:20:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:20:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:20:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:20:35 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 02:20:35 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:20:35 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:20:35 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:20:35 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:20:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:20:37 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:20:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:20:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:20:37 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:20:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 02:20:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:20:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:20:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:20:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:20:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:20:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:20:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43486018
Sun 19 Jan 2014 02:20:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:20:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43486018
Sun 19 Jan 2014 02:20:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:20:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:20:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:20:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:20:46 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:20:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:20:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:20:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:20:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:20:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:20:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:20:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43486018
Sun 19 Jan 2014 02:20:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:20:50 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:20:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:20:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:20:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:20:57 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 02:20:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:20:57 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:20:57 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:20:58 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:20:58 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 02:20:58 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:20:58 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 02:20:58 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 02:20:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:20:58 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:20:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:20:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:20:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:20:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:20:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:20:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:20:59 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 866489 values 13683784 bits 1710473 bytes 
Sun 19 Jan 2014 02:21:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:21:01 - job_xml_thread(): Done retrieving: data size 43493186
Sun 19 Jan 2014 02:21:01 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:21:01 - XML: Start document: iteration 12
Sun 19 Jan 2014 02:21:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43493186
Sun 19 Jan 2014 02:21:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:21:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:21:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:21:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:21:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:21:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:21:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43493186
Sun 19 Jan 2014 02:21:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:21:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:21:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:21:10 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:21:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:21:11 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:21:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 02:21:11 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:21:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 02:21:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8974 values 141579 bits 17697 bytes 
Sun 19 Jan 2014 02:21:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:21:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:21:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:21:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:21:19 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 02:21:19 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:21:19 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:21:19 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:21:19 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:21:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:21:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:21:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:21:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:21:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:21:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:21:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:21:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:21:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:21:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:21:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:21:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:21:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:21:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:21:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:21:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:21:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43519264
Sun 19 Jan 2014 02:21:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:21:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43519264
Sun 19 Jan 2014 02:21:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:21:34 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:21:34 - job_xml_thread(): Done retrieving: data size 43519264
Sun 19 Jan 2014 02:21:34 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:21:34 - XML: Start document: iteration 13
Sun 19 Jan 2014 02:21:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:21:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:21:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:21:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:21:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:21:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:21:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:21:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:21:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:21:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:21:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:21:44 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 02:21:44 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:21:45 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:21:45 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:21:45 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:21:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:21:49 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:21:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:21:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:21:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:21:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:21:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:21:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:21:50 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:21:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 02:21:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:21:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:21:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:21:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:21:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43477225
Sun 19 Jan 2014 02:21:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:21:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43477225
Sun 19 Jan 2014 02:21:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:21:58 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:21:58 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 02:22:00 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:22:00 - job_xml_thread(): Done retrieving: data size 43477225
Sun 19 Jan 2014 02:22:00 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:22:00 - XML: Start document: iteration 14
Sun 19 Jan 2014 02:22:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:22:03 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:22:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:22:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:22:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:22:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:22:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:22:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:22:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:22:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:22:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:22:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:22:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:22:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:22:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:22:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:22:11 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:22:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:22:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 02:22:11 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:22:11 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:22:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 02:22:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5519 values 87017 bits 10877 bytes 
Sun 19 Jan 2014 02:22:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:22:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:22:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:22:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:22:15 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 02:22:15 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:22:15 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:22:15 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:22:15 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:22:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:22:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43474225
Sun 19 Jan 2014 02:22:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:22:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43474225
Sun 19 Jan 2014 02:22:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:22:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:22:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:22:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:22:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:22:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:22:30 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:22:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:22:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:22:31 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:22:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:22:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:22:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:22:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:22:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:22:35 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:22:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 02:22:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:22:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:22:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:22:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:22:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:22:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:22:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:22:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:22:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:22:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:22:39 - job_xml_thread(): Done retrieving: data size 43502999
Sun 19 Jan 2014 02:22:39 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:22:39 - XML: Start document: iteration 15
Sun 19 Jan 2014 02:22:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43502999
Sun 19 Jan 2014 02:22:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:22:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43502999
Sun 19 Jan 2014 02:22:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:22:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:22:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:22:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:22:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:22:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:22:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:22:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:22:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:22:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:22:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:22:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:22:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:22:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:22:57 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 02:22:57 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:22:57 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:22:57 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:22:57 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:23:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:23:01 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:23:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:23:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:23:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:23:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:23:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:23:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:23:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:23:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43489515
Sun 19 Jan 2014 02:23:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:23:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43489515
Sun 19 Jan 2014 02:23:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:23:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:23:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:23:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:23:12 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:23:12 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:23:12 - job_xml_thread(): Done retrieving: data size 43489515
Sun 19 Jan 2014 02:23:12 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:23:12 - XML: Start document: iteration 16
Sun 19 Jan 2014 02:23:13 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:23:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:23:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 02:23:13 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:23:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 02:23:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8800 values 138832 bits 17354 bytes 
Sun 19 Jan 2014 02:23:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:23:14 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:23:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:23:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:23:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:23:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:23:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:23:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:23:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43489515
Sun 19 Jan 2014 02:23:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:23:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:23:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:23:28 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 02:23:28 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:23:28 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:23:28 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:23:28 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:23:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:23:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:23:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:23:30 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:23:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:23:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:23:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:23:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:23:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:23:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:23:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:23:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:23:32 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:23:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:23:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:23:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:23:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:23:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:23:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:23:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:23:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42942841
Sun 19 Jan 2014 02:23:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:23:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42942841
Sun 19 Jan 2014 02:23:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:23:43 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:23:43 - job_xml_thread(): Done retrieving: data size 42942841
Sun 19 Jan 2014 02:23:43 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:23:43 - XML: Start document: iteration 17
Sun 19 Jan 2014 02:23:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:23:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:23:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:23:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:23:56 - XML: Processed 645366 elements - found 0 jobs
Sun 19 Jan 2014 02:23:56 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:23:56 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:23:56 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:23:56 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:23:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:23:57 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:23:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:23:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:23:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:23:58 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:23:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:23:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:23:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:23:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:23:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:23:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:23:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:23:59 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:23:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 02:23:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:23:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:23:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:23:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:23:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:24:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:24:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42865442
Sun 19 Jan 2014 02:24:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:24:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42865442
Sun 19 Jan 2014 02:24:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:24:11 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:24:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:24:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:24:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:24:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:24:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:24:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:24:14 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:24:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:24:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:24:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:24:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:24:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:24:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:24:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:24:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 02:24:15 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:24:15 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:24:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 02:24:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5862 values 92399 bits 11549 bytes 
Sun 19 Jan 2014 02:24:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:24:16 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:24:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:24:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:24:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:24:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:24:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:24:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:24:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:24:19 - job_xml_thread(): Done retrieving: data size 42880824
Sun 19 Jan 2014 02:24:19 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:24:19 - XML: Start document: iteration 18
Sun 19 Jan 2014 02:24:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42880824
Sun 19 Jan 2014 02:24:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:24:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42880824
Sun 19 Jan 2014 02:24:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:24:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:24:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:24:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:24:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:24:41 - XML: Processed 644610 elements - found 0 jobs
Sun 19 Jan 2014 02:24:41 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:24:41 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:24:41 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:24:41 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:24:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:24:42 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:24:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:24:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:24:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:24:43 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:24:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:24:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:24:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:24:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:24:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:24:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:24:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:24:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:24:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:24:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:24:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:24:44 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:24:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 02:24:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:24:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:24:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43419399
Sun 19 Jan 2014 02:24:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:24:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43419399
Sun 19 Jan 2014 02:24:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:24:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:24:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:24:57 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:24:57 - job_xml_thread(): Done retrieving: data size 43419399
Sun 19 Jan 2014 02:24:57 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:24:57 - XML: Start document: iteration 19
Sun 19 Jan 2014 02:24:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:24:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:24:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:24:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:24:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:25:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:25:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:25:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:25:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:25:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:25:07 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:25:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:25:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:25:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:25:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:25:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:25:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:25:09 - XML: Processed 651066 elements - found 0 jobs
Sun 19 Jan 2014 02:25:09 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:25:09 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:25:09 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:25:09 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:25:10 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 02:25:10 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 02:25:10 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:25:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:25:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43484856
Sun 19 Jan 2014 02:25:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:25:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43484856
Sun 19 Jan 2014 02:25:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:25:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:25:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:25:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:25:15 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:25:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:25:16 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:25:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 02:25:16 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:25:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 02:25:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8768 values 138231 bits 17278 bytes 
Sun 19 Jan 2014 02:25:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:25:20 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:25:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:25:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:25:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:25:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:25:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:25:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:25:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43484856
Sun 19 Jan 2014 02:25:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:25:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:25:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:25:24 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:25:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:25:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:25:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:25:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:25:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:25:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:25:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:25:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:25:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:25:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:25:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:25:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:25:35 - job_xml_thread(): Done retrieving: data size 43481123
Sun 19 Jan 2014 02:25:35 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:25:35 - XML: Start document: iteration 20
Sun 19 Jan 2014 02:25:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43481123
Sun 19 Jan 2014 02:25:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:25:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:25:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:25:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:25:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:25:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:25:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43481123
Sun 19 Jan 2014 02:25:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:25:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:25:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:25:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:25:50 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:25:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 02:25:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:25:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:25:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:25:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:25:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:25:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:25:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:25:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:25:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:25:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:25:56 - XML: Processed 652387 elements - found 0 jobs
Sun 19 Jan 2014 02:25:56 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:25:56 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:25:56 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:25:56 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:25:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:25:58 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:25:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:25:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:25:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:25:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:25:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:25:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:26:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:26:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43509373
Sun 19 Jan 2014 02:26:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:26:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43509373
Sun 19 Jan 2014 02:26:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:26:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:26:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:26:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:26:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:26:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:26:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:26:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:26:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:26:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:26:11 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:26:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:26:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:26:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:26:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:26:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:26:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43528016
Sun 19 Jan 2014 02:26:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:26:15 - job_xml_thread(): Done retrieving: data size 43528016
Sun 19 Jan 2014 02:26:15 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:26:15 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 02:26:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:26:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:26:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:26:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43528016
Sun 19 Jan 2014 02:26:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:26:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:26:16 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 02:26:16 - Housekeeping: done.
Sun 19 Jan 2014 02:26:16 - XML: Start document: iteration 0
Sun 19 Jan 2014 02:26:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:26:16 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:26:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:26:17 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:26:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 02:26:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 02:26:17 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:26:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9479 values 149591 bits 18698 bytes 
Sun 19 Jan 2014 02:26:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:26:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:26:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:26:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:26:31 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 02:26:31 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:26:31 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:26:31 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:26:31 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:26:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:26:31 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:26:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:26:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:26:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:26:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:26:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:26:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:26:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:26:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:26:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:26:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:26:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:26:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:26:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:26:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:26:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:26:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:26:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43499775
Sun 19 Jan 2014 02:26:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:26:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43499775
Sun 19 Jan 2014 02:26:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:26:46 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:26:46 - job_xml_thread(): Done retrieving: data size 43499775
Sun 19 Jan 2014 02:26:46 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:26:46 - XML: Start document: iteration 1
Sun 19 Jan 2014 02:26:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:26:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:26:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:26:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:27:00 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 02:27:00 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:27:00 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:27:00 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:27:00 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:27:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:27:01 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:27:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:27:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:27:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:27:01 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:27:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:27:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:27:01 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:27:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 02:27:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:27:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:27:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:27:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:27:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:27:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:27:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:27:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:27:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:27:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:27:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:27:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43521716
Sun 19 Jan 2014 02:27:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:27:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43521716
Sun 19 Jan 2014 02:27:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:27:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:27:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:27:15 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:27:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:27:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:27:16 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:27:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:27:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:27:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:27:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:27:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:27:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:27:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:27:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:27:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:27:17 - job_xml_thread(): Done retrieving: data size 43528552
Sun 19 Jan 2014 02:27:17 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:27:17 - XML: Start document: iteration 2
Sun 19 Jan 2014 02:27:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:27:17 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:27:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43528552
Sun 19 Jan 2014 02:27:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:27:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:27:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:27:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:27:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:27:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43528552
Sun 19 Jan 2014 02:27:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:27:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:27:18 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:27:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 02:27:19 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:27:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 02:27:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6036 values 95226 bits 11903 bytes 
Sun 19 Jan 2014 02:27:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:27:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:27:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:27:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:27:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:27:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:27:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:27:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:27:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:27:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:27:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:27:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:27:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:27:37 - XML: Processed 652387 elements - found 0 jobs
Sun 19 Jan 2014 02:27:37 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:27:37 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:27:37 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:27:37 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:27:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:27:41 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:27:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:27:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:27:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:27:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:27:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:27:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:27:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:27:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43504007
Sun 19 Jan 2014 02:27:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:27:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43504007
Sun 19 Jan 2014 02:27:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:27:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:27:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:27:52 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:27:52 - job_xml_thread(): Done retrieving: data size 43504007
Sun 19 Jan 2014 02:27:52 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:27:52 - XML: Start document: iteration 3
Sun 19 Jan 2014 02:27:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:27:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:27:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:27:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:27:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:27:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:27:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:27:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:27:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:27:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:27:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:27:59 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 02:27:59 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:27:59 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:27:59 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 02:27:59 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 02:27:59 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:27:59 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sun 19 Jan 2014 02:28:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:28:01 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:28:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:28:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:28:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:28:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:28:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:28:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:28:05 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:28:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 02:28:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:28:06 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 02:28:06 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:28:06 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:28:06 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:28:06 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:28:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:28:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43480785
Sun 19 Jan 2014 02:28:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:28:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43480785
Sun 19 Jan 2014 02:28:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:28:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:28:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:28:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:28:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:28:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:28:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:28:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:28:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:28:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:28:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:28:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:28:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:28:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:28:19 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:28:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:28:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:28:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 02:28:20 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:28:20 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:28:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 02:28:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5933 values 93615 bits 11701 bytes 
Sun 19 Jan 2014 02:28:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:28:21 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:28:21 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:28:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:28:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:28:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:28:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:28:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:28:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:28:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:28:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43508291
Sun 19 Jan 2014 02:28:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:28:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43508291
Sun 19 Jan 2014 02:28:24 - job_xml_thread(): Done retrieving: data size 43508291
Sun 19 Jan 2014 02:28:24 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:28:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:28:24 - XML: Start document: iteration 4
Sun 19 Jan 2014 02:28:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:28:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:28:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:28:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:28:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:28:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:28:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:28:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:28:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:28:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:28:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:28:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:28:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:28:43 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 02:28:43 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:28:43 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:28:43 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:28:43 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:28:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:28:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:28:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:28:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:28:46 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:28:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 02:28:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:28:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:28:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:28:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:28:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:28:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:28:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43491566
Sun 19 Jan 2014 02:28:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:28:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43491566
Sun 19 Jan 2014 02:28:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:28:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:28:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:28:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:28:57 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:28:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:28:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:28:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:28:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:28:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:28:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:28:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:28:58 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:29:00 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:29:00 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:29:00 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:29:00 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 02:29:00 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 02:29:00 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:29:00 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 02:29:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:29:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:29:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:29:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:29:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:29:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:29:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:29:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:29:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:29:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:29:03 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 917398 values 14468230 bits 1808528 bytes 
Sun 19 Jan 2014 02:29:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:29:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43496923
Sun 19 Jan 2014 02:29:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:29:06 - job_xml_thread(): Done retrieving: data size 43496923
Sun 19 Jan 2014 02:29:06 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:29:06 - XML: Start document: iteration 5
Sun 19 Jan 2014 02:29:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43496923
Sun 19 Jan 2014 02:29:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:29:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:29:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:29:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:29:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:29:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:29:20 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:29:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:29:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:29:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:29:20 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:29:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:29:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:29:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:29:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:29:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:29:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:29:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 02:29:20 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:29:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8862 values 139706 bits 17463 bytes 
Sun 19 Jan 2014 02:29:20 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:29:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 02:29:29 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 02:29:29 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:29:29 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:29:29 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:29:29 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:29:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:29:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:29:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:29:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:29:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:29:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:29:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:29:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:29:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:29:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43434236
Sun 19 Jan 2014 02:29:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:29:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43434236
Sun 19 Jan 2014 02:29:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:29:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:29:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:29:44 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:29:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:29:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:29:45 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:29:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:29:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:29:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:29:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:29:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:29:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:29:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:29:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:29:46 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:29:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 02:29:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:29:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:29:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:29:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:29:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:29:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:29:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:29:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:29:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:29:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:29:53 - job_xml_thread(): Done retrieving: data size 42870260
Sun 19 Jan 2014 02:29:53 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:29:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42870260
Sun 19 Jan 2014 02:29:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:29:53 - XML: Start document: iteration 6
Sun 19 Jan 2014 02:29:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42870260
Sun 19 Jan 2014 02:29:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:30:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:30:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:30:01 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:30:01 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 02:30:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:30:01 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:30:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:30:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:30:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:30:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:30:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42870260
Sun 19 Jan 2014 02:30:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:30:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:30:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:30:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:30:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:30:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:30:13 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:30:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:30:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:30:17 - XML: Processed 644660 elements - found 0 jobs
Sun 19 Jan 2014 02:30:17 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:30:17 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:30:17 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:30:17 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:30:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:30:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:30:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:30:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:30:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:30:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:30:20 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:30:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:30:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:30:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:30:20 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:30:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:30:21 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:30:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 02:30:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 02:30:21 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:30:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6010 values 94814 bits 11851 bytes 
Sun 19 Jan 2014 02:30:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:30:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:30:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:30:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:30:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:30:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42909992
Sun 19 Jan 2014 02:30:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:30:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42909992
Sun 19 Jan 2014 02:30:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:30:32 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:30:32 - job_xml_thread(): Done retrieving: data size 42909992
Sun 19 Jan 2014 02:30:32 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:30:32 - XML: Start document: iteration 7
Sun 19 Jan 2014 02:30:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:30:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:30:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:30:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:30:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:30:44 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:30:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:30:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:30:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:30:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:30:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:30:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:30:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:30:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:30:47 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:30:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:30:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:30:48 - XML: Processed 644940 elements - found 0 jobs
Sun 19 Jan 2014 02:30:48 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:30:48 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:30:48 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:30:48 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:30:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:30:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:30:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:30:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:30:49 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:30:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 02:30:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:30:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:30:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43486843
Sun 19 Jan 2014 02:30:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:30:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43486843
Sun 19 Jan 2014 02:30:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:31:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:31:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:31:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:31:00 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:31:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:31:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:31:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:31:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:31:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:31:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:31:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:31:03 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:31:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:31:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:31:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:31:06 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:31:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:31:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:31:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:31:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:31:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:31:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:31:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:31:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43503076
Sun 19 Jan 2014 02:31:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:31:10 - job_xml_thread(): Done retrieving: data size 43503076
Sun 19 Jan 2014 02:31:10 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:31:10 - XML: Start document: iteration 8
Sun 19 Jan 2014 02:31:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43503076
Sun 19 Jan 2014 02:31:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:31:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:31:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:31:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:31:21 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:31:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:31:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:31:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:31:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:31:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:31:23 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:31:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 02:31:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 02:31:23 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:31:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:31:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:31:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8112 values 128003 bits 16000 bytes 
Sun 19 Jan 2014 02:31:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:31:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:31:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:31:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:31:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:31:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:31:28 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:31:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:31:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:31:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:31:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:31:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:31:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:31:31 - XML: Processed 652388 elements - found 0 jobs
Sun 19 Jan 2014 02:31:31 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:31:31 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:31:31 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:31:31 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:31:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:31:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43485928
Sun 19 Jan 2014 02:31:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:31:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43485928
Sun 19 Jan 2014 02:31:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:31:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:31:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:31:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:31:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:31:46 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:31:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:31:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:31:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:31:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:31:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:31:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:31:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:31:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:31:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:31:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:31:51 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:31:51 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:31:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 02:31:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:31:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:31:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:31:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:31:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:31:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:31:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:31:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:31:54 - job_xml_thread(): Done retrieving: data size 43508630
Sun 19 Jan 2014 02:31:54 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:31:54 - XML: Start document: iteration 9
Sun 19 Jan 2014 02:31:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43508630
Sun 19 Jan 2014 02:31:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:31:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43508630
Sun 19 Jan 2014 02:31:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:32:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:32:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:32:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:32:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:32:08 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 02:32:08 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 02:32:08 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:32:12 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 02:32:12 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:32:12 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:32:12 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:32:12 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:32:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:32:13 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:32:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:32:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:32:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:32:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:32:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:32:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:32:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:32:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:32:17 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:32:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:32:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:32:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:32:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:32:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:32:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:32:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:32:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43503931
Sun 19 Jan 2014 02:32:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:32:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43503931
Sun 19 Jan 2014 02:32:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:32:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:32:23 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:32:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:32:24 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:32:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 02:32:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 02:32:25 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:32:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9183 values 145303 bits 18162 bytes 
Sun 19 Jan 2014 02:32:27 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:32:27 - job_xml_thread(): Done retrieving: data size 43503931
Sun 19 Jan 2014 02:32:27 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:32:27 - XML: Start document: iteration 10
Sun 19 Jan 2014 02:32:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:32:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:32:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:32:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:32:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:32:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:32:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:32:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:32:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:32:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:32:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:32:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:32:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:32:41 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 02:32:41 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:32:41 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:32:41 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:32:41 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:32:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:32:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:32:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:32:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:32:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:32:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:32:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:32:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:32:45 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:32:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 02:32:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:32:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:32:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43509332
Sun 19 Jan 2014 02:32:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:32:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43509332
Sun 19 Jan 2014 02:32:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:32:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:32:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:32:56 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:32:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:32:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:32:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:32:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:32:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:32:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:32:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:32:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:32:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:32:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:32:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:33:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:33:00 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:33:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:33:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:33:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:33:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:33:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:33:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:33:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:33:01 - job_xml_thread(): Done retrieving: data size 43512844
Sun 19 Jan 2014 02:33:01 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:33:01 - XML: Start document: iteration 11
Sun 19 Jan 2014 02:33:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43512844
Sun 19 Jan 2014 02:33:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:33:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43512844
Sun 19 Jan 2014 02:33:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:33:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:33:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:33:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:33:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:33:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:33:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:33:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:33:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:33:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:33:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:33:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:33:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:33:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:33:21 - XML: Processed 652387 elements - found 0 jobs
Sun 19 Jan 2014 02:33:21 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:33:21 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:33:21 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:33:21 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:33:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:33:24 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:33:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:33:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:33:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:33:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:33:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:33:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:33:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:33:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43500774
Sun 19 Jan 2014 02:33:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:33:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43500774
Sun 19 Jan 2014 02:33:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:33:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:33:26 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:33:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:33:28 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:33:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 02:33:28 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:33:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 02:33:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9381 values 148380 bits 18547 bytes 
Sun 19 Jan 2014 02:33:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:33:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:33:36 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:33:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:33:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:33:36 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:33:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:33:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:33:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:33:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:33:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:33:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:33:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:33:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:33:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:33:40 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:33:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:33:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:33:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:33:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:33:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:33:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:33:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:33:42 - job_xml_thread(): Done retrieving: data size 43512782
Sun 19 Jan 2014 02:33:42 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:33:42 - XML: Start document: iteration 12
Sun 19 Jan 2014 02:33:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43512782
Sun 19 Jan 2014 02:33:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:33:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43512782
Sun 19 Jan 2014 02:33:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:33:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:33:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:33:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:33:54 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:33:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:33:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:33:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:33:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:33:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:33:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:33:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:33:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:33:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:34:06 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 02:34:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:34:06 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:34:06 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:34:06 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:34:06 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:34:06 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:34:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:34:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:34:06 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:34:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 02:34:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:34:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:34:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:34:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:34:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:34:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:34:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43480978
Sun 19 Jan 2014 02:34:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:34:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43480978
Sun 19 Jan 2014 02:34:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:34:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:34:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:34:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:34:20 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:34:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:34:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:34:21 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:34:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:34:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:34:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:34:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:34:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:34:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:34:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:34:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:34:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:34:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:34:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:34:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:34:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:34:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:34:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:34:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:34:24 - job_xml_thread(): Done retrieving: data size 43515945
Sun 19 Jan 2014 02:34:24 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:34:24 - XML: Start document: iteration 13
Sun 19 Jan 2014 02:34:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43515945
Sun 19 Jan 2014 02:34:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43515945
Sun 19 Jan 2014 02:34:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:34:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:34:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:34:28 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:34:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:34:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 02:34:29 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:34:29 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:34:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 02:34:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8832 values 139373 bits 17421 bytes 
Sun 19 Jan 2014 02:34:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:34:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:34:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:34:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:34:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:34:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:34:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:34:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:34:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:34:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:34:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:34:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:34:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:34:45 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 02:34:45 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:34:45 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:34:45 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:34:45 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:34:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:34:48 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:34:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:34:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:34:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:34:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:34:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:34:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:34:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:34:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43499529
Sun 19 Jan 2014 02:34:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:34:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43499529
Sun 19 Jan 2014 02:34:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:34:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:34:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:34:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:34:58 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:34:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:34:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:34:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:34:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:34:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:34:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:34:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43499529
Sun 19 Jan 2014 02:34:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:35:00 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:35:00 - job_xml_thread(): Done retrieving: data size 43499529
Sun 19 Jan 2014 02:35:00 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:35:00 - XML: Start document: iteration 14
Sun 19 Jan 2014 02:35:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:35:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:35:12 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:35:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 02:35:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:35:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:35:13 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:35:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:35:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:35:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:35:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:35:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:35:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:35:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:35:18 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 02:35:18 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:35:18 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:35:18 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:35:18 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:35:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:35:18 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:35:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:35:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:35:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:35:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:35:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:35:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:35:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:35:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43459595
Sun 19 Jan 2014 02:35:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:35:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43459595
Sun 19 Jan 2014 02:35:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:35:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:35:29 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:35:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:35:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 02:35:30 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:35:31 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:35:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6074 values 95906 bits 11988 bytes 
Sun 19 Jan 2014 02:35:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 02:35:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:35:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:35:33 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:35:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:35:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:35:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:35:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:35:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:35:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:35:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:35:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:35:35 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:35:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:35:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:35:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:35:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:35:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:35:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:35:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:35:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:35:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:35:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:35:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:35:37 - job_xml_thread(): Done retrieving: data size 42934072
Sun 19 Jan 2014 02:35:37 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:35:37 - XML: Start document: iteration 15
Sun 19 Jan 2014 02:35:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42934072
Sun 19 Jan 2014 02:35:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:35:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42934072
Sun 19 Jan 2014 02:35:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:35:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:35:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:35:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:35:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:35:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:35:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:35:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:35:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:35:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:35:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:35:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:35:55 - XML: Processed 645216 elements - found 0 jobs
Sun 19 Jan 2014 02:35:55 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:35:55 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:35:55 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:35:55 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:36:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:36:00 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:36:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:36:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:36:00 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:36:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 02:36:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:36:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:36:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:36:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:36:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:36:01 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 02:36:01 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:36:01 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:36:01 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:36:01 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 02:36:01 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 02:36:01 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 02:36:02 - size of cluster 'LISA Cluster': 624 hosts 79470 metrics 865266 values 13666617 bits 1708327 bytes 
Sun 19 Jan 2014 02:36:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:36:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42837771
Sun 19 Jan 2014 02:36:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:36:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42837771
Sun 19 Jan 2014 02:36:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:36:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:36:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:36:10 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:36:10 - job_xml_thread(): Done retrieving: data size 42837771
Sun 19 Jan 2014 02:36:10 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:36:10 - XML: Start document: iteration 16
Sun 19 Jan 2014 02:36:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:36:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:36:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:36:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:36:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:36:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:36:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:36:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:36:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:36:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:36:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:36:24 - XML: Processed 644256 elements - found 0 jobs
Sun 19 Jan 2014 02:36:24 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:36:24 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:36:24 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:36:24 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:36:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:36:25 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:36:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:36:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:36:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:36:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:36:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:36:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:36:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:36:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42887961
Sun 19 Jan 2014 02:36:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:36:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42887961
Sun 19 Jan 2014 02:36:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:36:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:36:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:36:31 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:36:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:36:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:36:33 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:36:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 02:36:33 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:36:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 02:36:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8533 values 134605 bits 16825 bytes 
Sun 19 Jan 2014 02:36:39 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:36:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:36:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:36:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:36:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:36:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:36:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:36:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:36:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:36:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:36:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:36:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:36:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:36:45 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:36:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:36:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:36:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:36:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:36:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:36:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:36:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:36:49 - job_xml_thread(): Done retrieving: data size 43418349
Sun 19 Jan 2014 02:36:49 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:36:49 - XML: Start document: iteration 17
Sun 19 Jan 2014 02:36:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43418349
Sun 19 Jan 2014 02:36:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:36:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43418349
Sun 19 Jan 2014 02:36:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:36:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:36:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:37:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:37:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:37:02 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:37:02 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 02:37:06 - XML: Processed 651212 elements - found 0 jobs
Sun 19 Jan 2014 02:37:06 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:37:06 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:37:06 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:37:06 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:37:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:37:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:37:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:37:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:37:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:37:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:37:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:37:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:37:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:37:09 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:37:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 02:37:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:37:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:37:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:37:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:37:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:37:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:37:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:37:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:37:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:37:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:37:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43509106
Sun 19 Jan 2014 02:37:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:37:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43509106
Sun 19 Jan 2014 02:37:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:37:22 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:37:22 - job_xml_thread(): Done retrieving: data size 43509106
Sun 19 Jan 2014 02:37:22 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:37:22 - XML: Start document: iteration 18
Sun 19 Jan 2014 02:37:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:37:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:37:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:37:25 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:37:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:37:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:37:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:37:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:37:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:37:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:37:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:37:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:37:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:37:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:37:33 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:37:33 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:37:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:37:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 02:37:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 02:37:33 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 02:37:33 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:37:33 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:37:33 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:37:33 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:37:33 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:37:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6027 values 95142 bits 11892 bytes 
Sun 19 Jan 2014 02:37:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:37:39 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:37:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:37:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:37:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:37:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:37:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:37:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:37:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:37:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:37:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:37:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43474638
Sun 19 Jan 2014 02:37:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:37:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43474638
Sun 19 Jan 2014 02:37:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:37:48 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:37:48 - job_xml_thread(): Done retrieving: data size 43474638
Sun 19 Jan 2014 02:37:48 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:37:48 - XML: Start document: iteration 19
Sun 19 Jan 2014 02:37:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:37:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:37:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:37:57 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:37:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:37:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:37:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:37:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:37:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:37:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:37:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:38:03 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 02:38:03 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:38:03 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:38:03 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:38:03 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:38:04 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:38:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 02:38:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:38:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:38:07 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:38:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:38:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:38:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:38:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:38:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:38:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:38:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:38:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43492244
Sun 19 Jan 2014 02:38:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:38:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43492244
Sun 19 Jan 2014 02:38:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:38:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:38:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:38:18 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:38:18 - job_xml_thread(): Done retrieving: data size 43492244
Sun 19 Jan 2014 02:38:18 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:38:19 - XML: Start document: iteration 20
Sun 19 Jan 2014 02:38:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:38:22 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:38:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:38:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:38:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:38:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:38:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:38:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:38:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:38:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:38:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:38:30 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 02:38:30 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:38:30 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:38:30 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:38:30 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:38:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:38:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:38:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:38:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:38:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:38:33 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:38:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:38:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:38:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:38:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:38:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:38:34 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:38:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 02:38:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 02:38:34 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:38:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5879 values 92768 bits 11596 bytes 
Sun 19 Jan 2014 02:38:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:38:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43501259
Sun 19 Jan 2014 02:38:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:38:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43501259
Sun 19 Jan 2014 02:38:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:38:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:38:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:38:45 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:38:46 - job_xml_thread(): Done retrieving: data size 43501259
Sun 19 Jan 2014 02:38:46 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:38:46 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 02:38:46 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 02:38:46 - Housekeeping: done.
Sun 19 Jan 2014 02:38:46 - XML: Start document: iteration 0
Sun 19 Jan 2014 02:38:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:38:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:38:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:38:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:38:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:38:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:38:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:38:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:38:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:38:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:38:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:39:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:39:00 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:39:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:39:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:39:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:39:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:39:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:39:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:39:01 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 02:39:01 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:39:01 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:39:01 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:39:01 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:39:03 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:39:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 02:39:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:39:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:39:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43511730
Sun 19 Jan 2014 02:39:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:39:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43511730
Sun 19 Jan 2014 02:39:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:39:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:39:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:39:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:39:14 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:39:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:39:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:39:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:39:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:39:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:39:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:39:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:39:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:39:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:39:17 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:39:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:39:19 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:39:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:39:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:39:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:39:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:39:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:39:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:39:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:39:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43511907
Sun 19 Jan 2014 02:39:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:39:23 - job_xml_thread(): Done retrieving: data size 43511907
Sun 19 Jan 2014 02:39:23 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:39:23 - XML: Start document: iteration 1
Sun 19 Jan 2014 02:39:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43511907
Sun 19 Jan 2014 02:39:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:39:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:39:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:39:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:39:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:39:34 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:39:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:39:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:39:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:39:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:39:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:39:36 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:39:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:39:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:39:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:39:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:39:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 02:39:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:39:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 02:39:36 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:39:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:39:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7773 values 122557 bits 15319 bytes 
Sun 19 Jan 2014 02:39:44 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 02:39:44 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:39:44 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:39:44 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:39:44 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:39:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:39:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:39:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:39:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:39:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:39:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:39:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:39:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:39:49 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 02:39:49 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 02:39:49 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:39:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:39:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43497202
Sun 19 Jan 2014 02:39:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:39:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43497202
Sun 19 Jan 2014 02:39:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:39:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:39:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:39:59 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:40:00 - job_xml_thread(): Done retrieving: data size 43497202
Sun 19 Jan 2014 02:40:00 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:40:00 - XML: Start document: iteration 2
Sun 19 Jan 2014 02:40:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:40:01 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:40:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:40:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:40:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:40:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:40:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:40:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:40:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:40:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:40:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:40:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:40:11 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:40:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:40:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:40:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:40:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:40:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:40:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:40:12 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 02:40:12 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:40:12 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:40:12 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:40:12 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:40:12 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:40:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 02:40:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:40:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:40:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43485450
Sun 19 Jan 2014 02:40:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:40:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43485450
Sun 19 Jan 2014 02:40:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:40:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:40:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:40:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:40:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:40:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:40:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:40:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:40:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:40:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:40:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:40:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:40:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:40:27 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:40:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:40:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:40:29 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:40:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:40:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:40:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:40:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:40:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:40:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:40:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:40:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43522986
Sun 19 Jan 2014 02:40:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:40:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43522986
Sun 19 Jan 2014 02:40:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:40:31 - job_xml_thread(): Done retrieving: data size 43522986
Sun 19 Jan 2014 02:40:31 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:40:31 - XML: Start document: iteration 3
Sun 19 Jan 2014 02:40:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:40:36 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:40:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:40:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 02:40:37 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:40:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8967 values 141437 bits 17679 bytes 
Sun 19 Jan 2014 02:40:38 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:40:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 02:40:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:40:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:40:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:40:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:40:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:40:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:40:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:40:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:40:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:40:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:40:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:40:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:40:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:40:53 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 02:40:53 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:40:53 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:40:53 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:40:53 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:40:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:40:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:40:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:40:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:40:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:40:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:40:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:40:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:40:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:40:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43500497
Sun 19 Jan 2014 02:40:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:40:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43500497
Sun 19 Jan 2014 02:40:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:41:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:41:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:41:08 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:41:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:41:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:41:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:41:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:41:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:41:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:41:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:41:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:41:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:41:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:41:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:41:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:41:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:41:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:41:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:41:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:41:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:41:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:41:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:41:13 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:41:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 02:41:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:41:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:41:15 - job_xml_thread(): Done retrieving: data size 43439251
Sun 19 Jan 2014 02:41:15 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:41:15 - XML: Start document: iteration 4
Sun 19 Jan 2014 02:41:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43439251
Sun 19 Jan 2014 02:41:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:41:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43439251
Sun 19 Jan 2014 02:41:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:41:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:41:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:41:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:41:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:41:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:41:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:41:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:41:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:41:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:41:36 - XML: Processed 651640 elements - found 0 jobs
Sun 19 Jan 2014 02:41:36 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:41:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:41:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:41:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:41:36 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:41:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:41:36 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:41:36 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:41:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:41:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:41:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:41:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:41:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:41:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:41:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:41:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:41:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:41:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42920024
Sun 19 Jan 2014 02:41:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:41:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42920024
Sun 19 Jan 2014 02:41:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:41:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:41:40 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:41:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:41:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 02:41:42 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:41:42 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:41:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 02:41:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8933 values 140905 bits 17613 bytes 
Sun 19 Jan 2014 02:41:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:41:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:41:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:41:51 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:41:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:41:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:41:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:41:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:41:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:41:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:41:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:41:53 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:41:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:41:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:41:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:41:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:41:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:41:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:41:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:41:56 - job_xml_thread(): Done retrieving: data size 42847953
Sun 19 Jan 2014 02:41:56 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:41:56 - XML: Start document: iteration 5
Sun 19 Jan 2014 02:41:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42847953
Sun 19 Jan 2014 02:41:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:41:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42847953
Sun 19 Jan 2014 02:41:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:42:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:42:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:42:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:42:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:42:11 - XML: Processed 644284 elements - found 0 jobs
Sun 19 Jan 2014 02:42:11 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:42:11 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:42:11 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:42:11 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:42:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:42:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:42:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:42:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:42:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:42:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:42:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:42:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:42:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:42:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:42:18 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:42:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:42:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:42:18 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:42:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 02:42:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:42:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:42:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:42:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:42:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:42:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:42:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42931175
Sun 19 Jan 2014 02:42:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:42:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42931175
Sun 19 Jan 2014 02:42:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:42:27 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:42:27 - job_xml_thread(): Done retrieving: data size 42931175
Sun 19 Jan 2014 02:42:27 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:42:27 - XML: Start document: iteration 6
Sun 19 Jan 2014 02:42:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:42:30 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:42:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:42:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:42:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:42:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:42:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:42:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:42:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:42:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:42:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:42:41 - XML: Processed 644940 elements - found 0 jobs
Sun 19 Jan 2014 02:42:41 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:42:41 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:42:41 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:42:41 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:42:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:42:42 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:42:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:42:42 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:42:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:42:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:42:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:42:43 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:42:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 02:42:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 02:42:43 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:42:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5854 values 92364 bits 11545 bytes 
Sun 19 Jan 2014 02:42:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:42:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:42:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:42:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:42:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:42:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43423996
Sun 19 Jan 2014 02:42:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:42:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43423996
Sun 19 Jan 2014 02:42:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:42:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:42:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:42:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:42:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:42:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:42:56 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:42:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:42:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:42:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:42:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:42:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:42:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:42:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:42:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:42:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:42:58 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:42:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:42:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:42:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:42:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:42:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:42:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:42:59 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:42:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 02:42:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:43:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:43:01 - job_xml_thread(): Done retrieving: data size 43513624
Sun 19 Jan 2014 02:43:01 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:43:01 - XML: Start document: iteration 7
Sun 19 Jan 2014 02:43:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43513624
Sun 19 Jan 2014 02:43:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43513624
Sun 19 Jan 2014 02:43:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:43:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:43:02 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 02:43:03 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:43:05 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:43:06 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 02:43:06 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:43:06 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 02:43:06 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 02:43:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:43:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:43:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:43:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:43:17 - size of cluster 'LISA Cluster': 624 hosts 79470 metrics 822226 values 12967412 bits 1620926 bytes 
Sun 19 Jan 2014 02:43:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:43:20 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:43:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:43:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:43:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:43:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:43:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:43:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:43:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:43:24 - XML: Processed 652382 elements - found 0 jobs
Sun 19 Jan 2014 02:43:24 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:43:24 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:43:24 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:43:24 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:43:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:43:26 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:43:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:43:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:43:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:43:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:43:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:43:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:43:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:43:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43491094
Sun 19 Jan 2014 02:43:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:43:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43491094
Sun 19 Jan 2014 02:43:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:43:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:43:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:43:39 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:43:39 - job_xml_thread(): Done retrieving: data size 43491094
Sun 19 Jan 2014 02:43:39 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:43:39 - XML: Start document: iteration 8
Sun 19 Jan 2014 02:43:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:43:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:43:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:43:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:43:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:43:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:43:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:43:43 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:43:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:43:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:43:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:43:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:43:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:43:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:43:44 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:43:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 02:43:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 02:43:44 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:43:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8095 values 127686 bits 15960 bytes 
Sun 19 Jan 2014 02:43:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:43:48 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:43:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:43:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:43:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:43:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:43:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:43:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:43:52 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 02:43:52 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:43:52 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:43:52 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:43:52 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:43:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:43:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43488768
Sun 19 Jan 2014 02:43:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:43:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43488768
Sun 19 Jan 2014 02:43:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:43:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:43:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:44:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:44:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:44:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:44:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:44:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:44:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:44:06 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:44:06 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 02:44:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:44:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:44:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:44:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:44:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:44:07 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:44:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:44:11 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:44:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:44:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:44:12 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:44:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 02:44:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:44:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:44:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:44:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:44:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:44:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:44:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43492235
Sun 19 Jan 2014 02:44:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:44:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43492235
Sun 19 Jan 2014 02:44:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:44:15 - job_xml_thread(): Done retrieving: data size 43492235
Sun 19 Jan 2014 02:44:15 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:44:15 - XML: Start document: iteration 9
Sun 19 Jan 2014 02:44:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:44:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:44:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:44:27 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:44:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:44:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:44:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:44:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:44:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:44:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:44:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:44:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:44:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:44:37 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 02:44:37 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:44:37 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:44:37 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:44:37 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:44:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:44:39 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:44:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:44:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:44:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:44:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:44:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:44:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:44:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:44:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43478177
Sun 19 Jan 2014 02:44:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43478177
Sun 19 Jan 2014 02:44:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:44:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:44:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:44:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:44:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:44:44 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:44:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:44:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 02:44:45 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:44:45 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:44:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8568 values 135058 bits 16882 bytes 
Sun 19 Jan 2014 02:44:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 02:44:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:44:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:44:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:44:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:44:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:44:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:44:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:44:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:44:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:44:52 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:44:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:44:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:44:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:44:58 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:44:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:44:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:44:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:44:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:44:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:44:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:45:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:45:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43500833
Sun 19 Jan 2014 02:45:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:45:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43500833
Sun 19 Jan 2014 02:45:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:45:01 - job_xml_thread(): Done retrieving: data size 43500833
Sun 19 Jan 2014 02:45:02 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:45:02 - XML: Start document: iteration 10
Sun 19 Jan 2014 02:45:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:45:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:45:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:45:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:45:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:45:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:45:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:45:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:45:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:45:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:45:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:45:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:45:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:45:18 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:45:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 02:45:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:45:19 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 02:45:19 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:45:19 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:45:19 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:45:19 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:45:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:45:24 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:45:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:45:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:45:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:45:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:45:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:45:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:45:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:45:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43478891
Sun 19 Jan 2014 02:45:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:45:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43478891
Sun 19 Jan 2014 02:45:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:45:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:45:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:45:34 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:45:34 - job_xml_thread(): Done retrieving: data size 43478891
Sun 19 Jan 2014 02:45:34 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:45:34 - XML: Start document: iteration 11
Sun 19 Jan 2014 02:45:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:45:36 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:45:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:45:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:45:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:45:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:45:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:45:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:45:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:45:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:45:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:45:43 - XML: Processed 652381 elements - found 0 jobs
Sun 19 Jan 2014 02:45:43 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:45:43 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:45:43 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:45:43 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:45:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:45:45 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:45:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:45:45 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:45:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 02:45:45 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:45:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 02:45:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5980 values 94377 bits 11797 bytes 
Sun 19 Jan 2014 02:45:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:45:47 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:45:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:45:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:45:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:45:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:45:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:45:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:45:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:45:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43498113
Sun 19 Jan 2014 02:45:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:45:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43498113
Sun 19 Jan 2014 02:45:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:45:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:45:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:45:58 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:45:58 - job_xml_thread(): Done retrieving: data size 43498113
Sun 19 Jan 2014 02:45:58 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:45:58 - XML: Start document: iteration 12
Sun 19 Jan 2014 02:46:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:46:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:46:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:46:06 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:46:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:46:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:46:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:46:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:46:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:46:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:46:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:46:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:46:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:46:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:46:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:46:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:46:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:46:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:46:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:46:14 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 02:46:14 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:46:14 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:46:14 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:46:14 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:46:15 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:46:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 02:46:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:46:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:46:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43506571
Sun 19 Jan 2014 02:46:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:46:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43506571
Sun 19 Jan 2014 02:46:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:46:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:46:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:46:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:46:25 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:46:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:46:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:46:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:46:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:46:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:46:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:46:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43506571
Sun 19 Jan 2014 02:46:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:46:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:46:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:46:29 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:46:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:46:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:46:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:46:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:46:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:46:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:46:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:46:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:46:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:46:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:46:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:46:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:46:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:46:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:46:41 - job_xml_thread(): Done retrieving: data size 43479770
Sun 19 Jan 2014 02:46:41 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:46:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:46:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:46:41 - XML: Start document: iteration 13
Sun 19 Jan 2014 02:46:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43479770
Sun 19 Jan 2014 02:46:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:46:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:46:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:46:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43479770
Sun 19 Jan 2014 02:46:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:46:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:46:46 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:46:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:46:46 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:46:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 02:46:46 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:46:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 02:46:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8417 values 132948 bits 16618 bytes 
Sun 19 Jan 2014 02:46:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:46:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:46:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:46:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:46:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:46:58 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:46:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:46:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:46:59 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 02:46:59 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:46:59 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:46:59 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:46:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:46:59 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:46:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:46:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:46:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:46:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:47:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:47:04 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:47:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:47:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:47:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:47:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:47:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:47:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:47:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:47:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43514251
Sun 19 Jan 2014 02:47:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:47:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43514251
Sun 19 Jan 2014 02:47:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:47:14 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:47:14 - job_xml_thread(): Done retrieving: data size 43514251
Sun 19 Jan 2014 02:47:14 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:47:14 - XML: Start document: iteration 14
Sun 19 Jan 2014 02:47:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:47:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:47:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:47:20 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:47:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:47:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:47:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:47:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:47:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:47:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:47:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:47:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:47:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:47:22 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:47:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 02:47:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:47:24 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 02:47:24 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:47:24 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:47:24 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:47:24 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:47:25 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 02:47:25 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 02:47:25 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:47:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:47:29 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:47:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:47:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:47:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:47:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:47:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:47:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:47:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:47:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43439675
Sun 19 Jan 2014 02:47:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:47:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43439675
Sun 19 Jan 2014 02:47:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:47:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:47:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:47:39 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:47:39 - job_xml_thread(): Done retrieving: data size 43439675
Sun 19 Jan 2014 02:47:39 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:47:39 - XML: Start document: iteration 15
Sun 19 Jan 2014 02:47:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:47:44 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:47:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:47:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:47:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:47:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:47:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:47:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:47:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:47:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:47:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:47:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:47:47 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:47:48 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:47:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 02:47:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:47:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 02:47:48 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:47:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6009 values 95037 bits 11879 bytes 
Sun 19 Jan 2014 02:47:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:47:52 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:47:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:47:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:47:53 - XML: Processed 651640 elements - found 0 jobs
Sun 19 Jan 2014 02:47:53 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:47:53 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:47:53 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:47:53 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:47:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:47:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:47:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:47:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:47:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:47:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42834580
Sun 19 Jan 2014 02:47:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:47:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42834580
Sun 19 Jan 2014 02:47:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:48:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:48:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:48:08 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:48:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:48:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:48:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:48:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:48:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:48:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:48:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:48:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:48:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:48:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:48:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:48:12 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:48:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 02:48:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:48:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:48:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:48:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:48:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:48:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:48:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:48:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:48:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:48:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:48:13 - job_xml_thread(): Done retrieving: data size 42906682
Sun 19 Jan 2014 02:48:13 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:48:13 - XML: Start document: iteration 16
Sun 19 Jan 2014 02:48:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42906682
Sun 19 Jan 2014 02:48:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:48:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42906682
Sun 19 Jan 2014 02:48:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:48:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:48:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:48:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:48:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:48:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:48:29 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:48:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:48:29 - XML: Processed 644866 elements - found 0 jobs
Sun 19 Jan 2014 02:48:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:48:29 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:48:29 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:48:29 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:48:29 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:48:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:48:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:48:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:48:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:48:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:48:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:48:34 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:48:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:48:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:48:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:48:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:48:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:48:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:48:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:48:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42998337
Sun 19 Jan 2014 02:48:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:48:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42998337
Sun 19 Jan 2014 02:48:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:48:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:48:45 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:48:45 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:48:45 - job_xml_thread(): Done retrieving: data size 42998337
Sun 19 Jan 2014 02:48:45 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:48:45 - XML: Start document: iteration 17
Sun 19 Jan 2014 02:48:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:48:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:48:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:48:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:48:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:48:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:48:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:48:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:48:49 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:48:49 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:48:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 02:48:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:48:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 02:48:49 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:48:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8933 values 141200 bits 17650 bytes 
Sun 19 Jan 2014 02:48:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:48:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:48:58 - XML: Processed 645909 elements - found 0 jobs
Sun 19 Jan 2014 02:48:58 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:48:58 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:48:58 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:48:58 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:48:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:48:59 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:48:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:48:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:48:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:48:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:48:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:48:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:49:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:49:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43477044
Sun 19 Jan 2014 02:49:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:49:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43477044
Sun 19 Jan 2014 02:49:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:49:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:49:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:49:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:49:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:49:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:49:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:49:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:49:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:49:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:49:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:49:13 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:49:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:49:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:49:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:49:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:49:15 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:49:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:49:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:49:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:49:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:49:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:49:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:49:15 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:49:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 02:49:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:49:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:49:17 - job_xml_thread(): Done retrieving: data size 43524606
Sun 19 Jan 2014 02:49:17 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:49:17 - XML: Start document: iteration 18
Sun 19 Jan 2014 02:49:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43524606
Sun 19 Jan 2014 02:49:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:49:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43524606
Sun 19 Jan 2014 02:49:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:49:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:49:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:49:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:49:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:49:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:49:31 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:49:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:49:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:49:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:49:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:49:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:49:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:49:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:49:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:49:37 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:49:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:49:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:49:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:49:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:49:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:49:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:49:39 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 02:49:39 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:49:39 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:49:39 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:49:39 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:49:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:49:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43486594
Sun 19 Jan 2014 02:49:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:49:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43486594
Sun 19 Jan 2014 02:49:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:49:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:49:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:49:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:49:49 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:49:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:49:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 02:49:50 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:49:50 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:49:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 02:49:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8791 values 138632 bits 17329 bytes 
Sun 19 Jan 2014 02:49:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:49:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:49:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:49:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:49:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:49:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:49:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:49:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:49:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:49:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:49:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:49:55 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:49:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:49:55 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:49:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:49:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:49:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:49:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:49:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:49:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:49:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:49:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43508160
Sun 19 Jan 2014 02:49:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:49:59 - job_xml_thread(): Done retrieving: data size 43508160
Sun 19 Jan 2014 02:49:59 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:49:59 - XML: Start document: iteration 19
Sun 19 Jan 2014 02:49:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43508160
Sun 19 Jan 2014 02:49:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:50:06 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 02:50:07 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:50:08 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:50:08 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 02:50:08 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 02:50:09 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:50:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:50:09 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 02:50:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:50:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:50:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sun 19 Jan 2014 02:50:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:50:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:50:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:50:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:50:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:50:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:50:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:50:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:50:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:50:16 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 02:50:16 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:50:17 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:50:17 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:50:17 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:50:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:50:19 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:50:20 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:50:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 02:50:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:50:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:50:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:50:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:50:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:50:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:50:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:50:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:50:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43522277
Sun 19 Jan 2014 02:50:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:50:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43522277
Sun 19 Jan 2014 02:50:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:50:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:50:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:50:32 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:50:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:50:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:50:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:50:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:50:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:50:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:50:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:50:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:50:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:50:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:50:35 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:50:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:50:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:50:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:50:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:50:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:50:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:50:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:50:37 - job_xml_thread(): Done retrieving: data size 43522504
Sun 19 Jan 2014 02:50:37 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:50:37 - XML: Start document: iteration 20
Sun 19 Jan 2014 02:50:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43522504
Sun 19 Jan 2014 02:50:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:50:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43522504
Sun 19 Jan 2014 02:50:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:50:48 - XML: Processed 652388 elements - found 0 jobs
Sun 19 Jan 2014 02:50:48 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:50:48 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:50:48 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:50:48 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:50:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:50:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:50:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:50:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:50:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:50:51 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:50:51 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:50:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:50:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 02:50:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 02:50:52 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:50:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9197 values 145165 bits 18145 bytes 
Sun 19 Jan 2014 02:50:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:50:58 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:50:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:50:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:50:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:50:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:50:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:50:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:50:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:51:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:51:00 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:51:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:51:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:51:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:51:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:51:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:51:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:51:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:51:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43523328
Sun 19 Jan 2014 02:51:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:51:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43523328
Sun 19 Jan 2014 02:51:03 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:51:03 - job_xml_thread(): Done retrieving: data size 43523328
Sun 19 Jan 2014 02:51:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:51:03 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:51:04 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 02:51:07 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 02:51:07 - Housekeeping: done.
Sun 19 Jan 2014 02:51:07 - XML: Start document: iteration 0
Sun 19 Jan 2014 02:51:09 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:51:09 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:51:10 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:51:10 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 02:51:10 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 02:51:10 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:51:10 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 02:51:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:51:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:51:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:51:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:51:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:51:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:51:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:51:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:51:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:51:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:51:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:51:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:51:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:51:27 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 02:51:27 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:51:27 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:51:27 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:51:27 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:51:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:51:28 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:51:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:51:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:51:28 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 909967 values 14372536 bits 1796567 bytes 
Sun 19 Jan 2014 02:51:28 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:51:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 02:51:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:51:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:51:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:51:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:51:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:51:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:51:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43502013
Sun 19 Jan 2014 02:51:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:51:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43502013
Sun 19 Jan 2014 02:51:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:51:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:51:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:51:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:51:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:51:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:51:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:51:42 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:51:42 - job_xml_thread(): Done retrieving: data size 43502013
Sun 19 Jan 2014 02:51:42 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:51:42 - XML: Start document: iteration 1
Sun 19 Jan 2014 02:51:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:51:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:51:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:51:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:51:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:51:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:51:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:51:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:51:52 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:51:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:51:52 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:51:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 02:51:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 02:51:52 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:51:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5820 values 91784 bits 11473 bytes 
Sun 19 Jan 2014 02:51:53 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 02:51:53 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:51:53 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:51:53 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:51:53 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:51:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:51:55 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:51:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:51:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:51:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:51:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:51:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:51:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:51:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:51:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:51:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:51:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43478799
Sun 19 Jan 2014 02:51:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:52:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43478799
Sun 19 Jan 2014 02:52:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:52:08 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:52:08 - job_xml_thread(): Done retrieving: data size 43478799
Sun 19 Jan 2014 02:52:08 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:52:08 - XML: Start document: iteration 2
Sun 19 Jan 2014 02:52:11 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:52:11 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 02:52:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:52:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:52:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:52:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:52:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:52:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:52:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:52:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:52:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:52:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:52:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:52:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:52:22 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:52:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:52:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 02:52:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:52:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:52:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:52:23 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 02:52:23 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:52:23 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:52:23 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:52:23 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:52:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:52:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:52:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:52:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:52:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:52:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43481446
Sun 19 Jan 2014 02:52:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:52:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43481446
Sun 19 Jan 2014 02:52:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:52:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:52:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:52:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:52:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:52:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:52:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:52:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:52:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:52:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:52:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43481446
Sun 19 Jan 2014 02:52:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:52:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:52:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:52:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:52:38 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:52:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:52:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:52:46 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:52:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:52:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:52:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:52:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:52:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:52:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:52:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:52:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:52:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:52:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:52:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:52:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:52:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:52:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:52:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:52:52 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:52:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:52:52 - job_xml_thread(): Done retrieving: data size 43490829
Sun 19 Jan 2014 02:52:52 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:52:52 - XML: Start document: iteration 3
Sun 19 Jan 2014 02:52:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43490829
Sun 19 Jan 2014 02:52:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:52:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43490829
Sun 19 Jan 2014 02:52:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:52:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:52:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 02:52:53 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:52:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5772 values 91046 bits 11380 bytes 
Sun 19 Jan 2014 02:52:54 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:52:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 02:53:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:53:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:53:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:53:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:53:13 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 02:53:13 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:53:13 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:53:13 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:53:13 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:53:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:53:17 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:53:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:53:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:53:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:53:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:53:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:53:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:53:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:53:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:53:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:53:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:53:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:53:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:53:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:53:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:53:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:53:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:53:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43454861
Sun 19 Jan 2014 02:53:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:53:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43454861
Sun 19 Jan 2014 02:53:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:53:28 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:53:28 - job_xml_thread(): Done retrieving: data size 43454861
Sun 19 Jan 2014 02:53:28 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:53:28 - XML: Start document: iteration 4
Sun 19 Jan 2014 02:53:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:53:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:53:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:53:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:53:37 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:53:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 02:53:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:53:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:53:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:53:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:53:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:53:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:53:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:53:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:53:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:53:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:53:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:53:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:53:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:53:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:53:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:53:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:53:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:53:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:53:46 - XML: Processed 651640 elements - found 0 jobs
Sun 19 Jan 2014 02:53:46 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:53:46 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:53:46 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:53:46 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:53:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:53:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42917454
Sun 19 Jan 2014 02:53:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:53:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42917454
Sun 19 Jan 2014 02:53:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:53:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:53:54 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:53:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:53:55 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:53:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 02:53:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 02:53:55 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:53:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6110 values 96376 bits 12047 bytes 
Sun 19 Jan 2014 02:53:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:53:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:54:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:54:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:54:01 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:54:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:54:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:54:04 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:54:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:54:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:54:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:54:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:54:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:54:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:54:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:54:05 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:54:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:54:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:54:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:54:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:54:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:54:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:54:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:54:09 - job_xml_thread(): Done retrieving: data size 42874386
Sun 19 Jan 2014 02:54:09 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:54:09 - XML: Start document: iteration 5
Sun 19 Jan 2014 02:54:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42874386
Sun 19 Jan 2014 02:54:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:54:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42874386
Sun 19 Jan 2014 02:54:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:54:12 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 02:54:12 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 02:54:12 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:54:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:54:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:54:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:54:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:54:28 - XML: Processed 644603 elements - found 0 jobs
Sun 19 Jan 2014 02:54:28 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:54:28 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:54:28 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:54:28 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:54:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:54:29 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:54:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:54:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:54:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:54:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:54:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:54:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:54:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:54:31 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:54:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 02:54:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:54:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:54:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:54:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:54:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:54:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:54:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:54:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:54:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:54:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:54:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42929932
Sun 19 Jan 2014 02:54:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:54:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42929932
Sun 19 Jan 2014 02:54:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:54:44 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:54:44 - job_xml_thread(): Done retrieving: data size 42929932
Sun 19 Jan 2014 02:54:44 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:54:45 - XML: Start document: iteration 6
Sun 19 Jan 2014 02:54:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:54:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:54:45 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:54:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:54:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:54:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:54:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:54:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:54:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:54:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:54:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:54:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:54:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:54:55 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:54:55 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:54:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:54:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:54:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:54:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 02:54:56 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:54:56 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:54:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5814 values 91734 bits 11466 bytes 
Sun 19 Jan 2014 02:54:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 02:54:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:54:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:54:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:54:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:54:56 - XML: Processed 644940 elements - found 0 jobs
Sun 19 Jan 2014 02:54:56 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:54:56 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:54:56 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:54:56 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:54:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:54:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43470256
Sun 19 Jan 2014 02:54:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:55:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43470256
Sun 19 Jan 2014 02:55:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:55:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:55:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:55:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:55:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:55:12 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:55:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:55:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:55:14 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:55:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:55:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:55:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:55:14 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:55:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:55:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:55:14 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:55:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 02:55:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:55:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:55:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:55:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:55:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:55:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:55:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:55:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:55:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:55:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:55:16 - job_xml_thread(): Done retrieving: data size 43508113
Sun 19 Jan 2014 02:55:16 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:55:16 - XML: Start document: iteration 7
Sun 19 Jan 2014 02:55:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43508113
Sun 19 Jan 2014 02:55:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:55:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43508113
Sun 19 Jan 2014 02:55:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:55:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:55:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:55:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:55:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:55:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:55:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:55:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:55:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:55:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:55:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:55:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:55:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:55:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:55:35 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 02:55:35 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:55:35 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:55:35 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:55:35 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:55:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:55:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:55:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:55:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:55:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:55:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:55:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:55:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:55:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:55:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43485242
Sun 19 Jan 2014 02:55:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:55:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43485242
Sun 19 Jan 2014 02:55:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:55:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:55:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:55:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:55:50 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:55:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:55:50 - job_xml_thread(): Done retrieving: data size 43485242
Sun 19 Jan 2014 02:55:50 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:55:50 - XML: Start document: iteration 8
Sun 19 Jan 2014 02:55:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:55:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:55:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:55:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:55:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:55:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:55:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:55:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:55:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:55:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:55:56 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:55:57 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:55:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 02:55:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:55:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 02:55:57 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:55:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9217 values 145391 bits 18173 bytes 
Sun 19 Jan 2014 02:56:02 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 02:56:02 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:56:02 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:56:02 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:56:02 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:56:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:56:03 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:56:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:56:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:56:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:56:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:56:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:56:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:56:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:56:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43493856
Sun 19 Jan 2014 02:56:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:56:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43493856
Sun 19 Jan 2014 02:56:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:56:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:56:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:56:08 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:56:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 02:56:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:56:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:56:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:56:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:56:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:56:17 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:56:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:56:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:56:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:56:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:56:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:56:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:56:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:56:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:56:19 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:56:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:56:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:56:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:56:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:56:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:56:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:56:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:56:21 - job_xml_thread(): Done retrieving: data size 43527088
Sun 19 Jan 2014 02:56:21 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:56:21 - XML: Start document: iteration 9
Sun 19 Jan 2014 02:56:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43527088
Sun 19 Jan 2014 02:56:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43527088
Sun 19 Jan 2014 02:56:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:56:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:56:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:56:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:56:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:56:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:56:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:56:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:56:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:56:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:56:39 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 02:56:39 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:56:40 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:56:40 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:56:40 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:56:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:56:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:56:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:56:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:56:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:56:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:56:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:56:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:56:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:56:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:56:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:56:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:56:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:56:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:56:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43517897
Sun 19 Jan 2014 02:56:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:56:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43517897
Sun 19 Jan 2014 02:56:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:56:55 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:56:55 - job_xml_thread(): Done retrieving: data size 43517897
Sun 19 Jan 2014 02:56:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:56:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:56:55 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:56:55 - XML: Start document: iteration 10
Sun 19 Jan 2014 02:56:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:56:57 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:56:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:56:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 02:56:58 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:56:58 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:56:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9266 values 146163 bits 18270 bytes 
Sun 19 Jan 2014 02:56:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 02:56:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:56:59 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:56:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:56:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:56:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:56:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:56:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:56:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:56:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:57:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:57:03 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:57:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:57:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:57:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:57:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:57:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:57:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:57:06 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 02:57:06 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:57:06 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:57:06 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:57:06 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:57:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:57:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43511801
Sun 19 Jan 2014 02:57:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:57:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43511801
Sun 19 Jan 2014 02:57:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:57:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:57:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:57:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:57:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:57:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:57:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:57:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:57:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:57:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:57:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:57:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:57:21 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:57:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:57:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:57:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:57:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:57:23 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:57:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 02:57:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:57:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:57:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:57:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:57:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:57:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:57:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43514877
Sun 19 Jan 2014 02:57:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:57:25 - job_xml_thread(): Done retrieving: data size 43514877
Sun 19 Jan 2014 02:57:25 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:57:25 - XML: Start document: iteration 11
Sun 19 Jan 2014 02:57:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43514877
Sun 19 Jan 2014 02:57:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:57:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:57:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:57:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:57:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:57:42 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 02:57:42 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:57:42 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:57:42 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:57:43 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:57:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:57:44 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:57:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:57:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:57:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:57:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:57:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:57:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:57:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:57:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:57:47 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:57:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:57:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:57:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:57:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:57:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:57:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:57:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:57:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43522629
Sun 19 Jan 2014 02:57:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:57:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43522629
Sun 19 Jan 2014 02:57:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:57:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:57:58 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:57:58 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:57:58 - job_xml_thread(): Done retrieving: data size 43522629
Sun 19 Jan 2014 02:57:58 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:57:58 - XML: Start document: iteration 12
Sun 19 Jan 2014 02:57:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:57:59 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:58:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:58:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:58:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:58:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:58:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:58:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:58:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:58:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:58:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 02:58:01 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:58:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8719 values 137543 bits 17192 bytes 
Sun 19 Jan 2014 02:58:01 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:58:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 02:58:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:58:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:58:10 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 02:58:10 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:58:10 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:58:10 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:58:10 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:58:11 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 02:58:11 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:58:11 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:58:11 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:58:11 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 02:58:11 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 02:58:11 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 02:58:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:58:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:58:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:58:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:58:13 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 857360 values 13521055 bits 1690131 bytes 
Sun 19 Jan 2014 02:58:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:58:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:58:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:58:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:58:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:58:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:58:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:58:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43482461
Sun 19 Jan 2014 02:58:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:58:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43482461
Sun 19 Jan 2014 02:58:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:58:25 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:58:25 - job_xml_thread(): Done retrieving: data size 43482461
Sun 19 Jan 2014 02:58:25 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:58:25 - XML: Start document: iteration 13
Sun 19 Jan 2014 02:58:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:58:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:58:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:58:32 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:58:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:58:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:58:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:58:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:58:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:58:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:58:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:58:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:58:36 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:58:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:58:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:58:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:58:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:58:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:58:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:58:39 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 02:58:39 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:58:39 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:58:39 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:58:39 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:58:40 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 02:58:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 02:58:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:58:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:58:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43489930
Sun 19 Jan 2014 02:58:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:58:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43489930
Sun 19 Jan 2014 02:58:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:58:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:58:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:58:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:58:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:58:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:58:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:58:54 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:58:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:58:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:58:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:58:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:58:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:58:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:58:58 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:58:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:58:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:58:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:58:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:58:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:58:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:59:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:59:01 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:59:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:59:02 - job_xml_thread(): Done retrieving: data size 43506737
Sun 19 Jan 2014 02:59:02 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:59:02 - XML: Start document: iteration 14
Sun 19 Jan 2014 02:59:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43506737
Sun 19 Jan 2014 02:59:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:59:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43506737
Sun 19 Jan 2014 02:59:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:59:02 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:59:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:59:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 02:59:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 02:59:02 - Entering storeMetrics(): cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sun 19 Jan 2014 02:59:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:59:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:59:11 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:59:11 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 02:59:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:59:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:59:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:59:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:59:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:59:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:59:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:59:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:59:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:59:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:59:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:59:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:59:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:59:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:59:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:59:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:59:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:59:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:59:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:59:24 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 02:59:24 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 02:59:24 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 02:59:24 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 02:59:24 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 02:59:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:59:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43408355
Sun 19 Jan 2014 02:59:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:59:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43408355
Sun 19 Jan 2014 02:59:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:59:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:59:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:59:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 02:59:37 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 02:59:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 02:59:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 02:59:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:59:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 02:59:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 02:59:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 02:59:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 02:59:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:59:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:59:39 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 02:59:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 02:59:41 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 02:59:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 02:59:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 02:59:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:59:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 02:59:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 02:59:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 02:59:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 02:59:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42901167
Sun 19 Jan 2014 02:59:44 - job_xml_thread(): Done retrieving: data size 42901167
Sun 19 Jan 2014 02:59:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 02:59:45 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 02:59:45 - XML: Start document: iteration 15
Sun 19 Jan 2014 02:59:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42901167
Sun 19 Jan 2014 02:59:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 02:59:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 02:59:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 02:59:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 02:59:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:00:01 - XML: Processed 645056 elements - found 0 jobs
Sun 19 Jan 2014 03:00:01 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:00:01 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:00:01 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:00:01 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:00:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:00:03 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:00:03 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:00:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 03:00:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:00:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 03:00:04 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:00:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 15200 values 239675 bits 29959 bytes 
Sun 19 Jan 2014 03:00:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:00:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:00:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:00:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:00:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:00:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:00:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:00:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:00:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:00:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:00:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:00:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:00:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:00:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:00:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:00:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:00:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:00:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:00:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42886780
Sun 19 Jan 2014 03:00:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:00:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42886780
Sun 19 Jan 2014 03:00:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:00:16 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:00:16 - job_xml_thread(): Done retrieving: data size 42886780
Sun 19 Jan 2014 03:00:16 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:00:16 - XML: Start document: iteration 16
Sun 19 Jan 2014 03:00:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:00:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:00:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:00:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:00:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:00:27 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:00:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:00:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:00:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:00:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:00:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:00:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:00:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:00:33 - XML: Processed 644801 elements - found 0 jobs
Sun 19 Jan 2014 03:00:33 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:00:33 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:00:33 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:00:33 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:00:33 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:00:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 03:00:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:00:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:00:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:00:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:00:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:00:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:00:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:00:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:00:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:00:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:00:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42931484
Sun 19 Jan 2014 03:00:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:00:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42931484
Sun 19 Jan 2014 03:00:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:00:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:00:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:00:48 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:00:48 - job_xml_thread(): Done retrieving: data size 42931484
Sun 19 Jan 2014 03:00:48 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:00:48 - XML: Start document: iteration 17
Sun 19 Jan 2014 03:00:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:00:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:00:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:00:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:00:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:00:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:00:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:00:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:00:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:00:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:00:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:00:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:00:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:00:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:00:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:00:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:00:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:00:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:00:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:00:58 - XML: Processed 645262 elements - found 0 jobs
Sun 19 Jan 2014 03:00:58 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:00:58 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:00:58 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:00:58 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:01:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:01:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43494018
Sun 19 Jan 2014 03:01:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:01:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43494018
Sun 19 Jan 2014 03:01:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:01:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:01:03 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:01:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:01:04 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:01:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 03:01:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 03:01:04 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:01:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9168 values 144643 bits 18080 bytes 
Sun 19 Jan 2014 03:01:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:01:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:01:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:01:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:01:13 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:01:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:01:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:01:14 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:01:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:01:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:01:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:01:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:01:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:01:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:01:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:01:17 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:01:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:01:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:01:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:01:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:01:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:01:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:01:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:01:20 - job_xml_thread(): Done retrieving: data size 43502316
Sun 19 Jan 2014 03:01:20 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:01:20 - XML: Start document: iteration 18
Sun 19 Jan 2014 03:01:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43502316
Sun 19 Jan 2014 03:01:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:01:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43502316
Sun 19 Jan 2014 03:01:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:01:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:01:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:01:31 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:01:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 03:01:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:01:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:01:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:01:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:01:39 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:01:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:01:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:01:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:01:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:01:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:01:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:01:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:01:40 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 03:01:40 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:01:40 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:01:40 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:01:40 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:01:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:01:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:01:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:01:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:01:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:01:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:01:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:01:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:01:46 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 03:01:46 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 03:01:46 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:01:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:01:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43491770
Sun 19 Jan 2014 03:01:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:01:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43491770
Sun 19 Jan 2014 03:01:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:01:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:01:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:01:55 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:01:55 - job_xml_thread(): Done retrieving: data size 43491770
Sun 19 Jan 2014 03:01:55 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:01:56 - XML: Start document: iteration 19
Sun 19 Jan 2014 03:01:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:01:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:02:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:02:06 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:02:06 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:02:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 03:02:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:02:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 03:02:07 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:02:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6173 values 97519 bits 12189 bytes 
Sun 19 Jan 2014 03:02:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:02:07 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:02:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:02:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:02:09 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 03:02:09 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:02:09 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:02:09 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:02:09 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:02:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:02:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:02:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:02:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:02:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:02:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:02:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:02:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:02:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:02:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:02:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:02:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:02:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:02:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:02:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43527868
Sun 19 Jan 2014 03:02:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:02:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43527868
Sun 19 Jan 2014 03:02:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:02:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:02:18 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:02:24 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:02:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:02:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:02:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:02:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:02:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:02:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:02:24 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:02:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:02:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:02:24 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:02:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 03:02:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:02:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:02:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:02:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:02:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:02:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:02:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:02:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:02:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:02:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:02:25 - job_xml_thread(): Done retrieving: data size 43528249
Sun 19 Jan 2014 03:02:25 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:02:25 - XML: Start document: iteration 20
Sun 19 Jan 2014 03:02:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43528249
Sun 19 Jan 2014 03:02:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:02:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43528249
Sun 19 Jan 2014 03:02:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:02:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:02:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:02:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:02:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:02:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:02:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:02:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:02:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:02:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:02:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:02:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:02:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:02:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:02:48 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 03:02:48 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:02:48 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:02:48 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:02:48 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:02:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:02:49 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:02:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:02:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:02:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:02:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:02:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:02:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:02:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:02:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43509594
Sun 19 Jan 2014 03:02:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:02:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43509594
Sun 19 Jan 2014 03:02:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:02:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:02:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:03:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:03:00 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:03:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:03:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:03:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:03:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:03:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:03:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:03:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:03:03 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:03:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:03:04 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:03:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:03:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:03:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:03:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:03:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:03:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:03:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:03:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43518410
Sun 19 Jan 2014 03:03:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:03:06 - job_xml_thread(): Done retrieving: data size 43518410
Sun 19 Jan 2014 03:03:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43518410
Sun 19 Jan 2014 03:03:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:03:07 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:03:07 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 03:03:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:03:07 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:03:07 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:03:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:03:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 03:03:07 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:03:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 03:03:07 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 03:03:07 - Housekeeping: done.
Sun 19 Jan 2014 03:03:07 - XML: Start document: iteration 0
Sun 19 Jan 2014 03:03:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 12073 values 191004 bits 23875 bytes 
Sun 19 Jan 2014 03:03:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:03:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:03:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:03:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:03:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:03:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:03:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:03:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:03:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:03:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:03:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:03:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:03:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:03:26 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 03:03:26 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:03:26 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:03:27 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:03:27 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:03:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:03:29 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:03:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:03:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:03:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:03:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:03:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:03:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:03:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:03:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43495564
Sun 19 Jan 2014 03:03:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:03:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43495564
Sun 19 Jan 2014 03:03:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:03:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:03:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:03:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:03:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:03:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:03:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:03:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:03:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:03:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:03:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:03:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:03:42 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:03:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:03:45 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:03:45 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:03:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 03:03:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:03:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:03:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:03:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:03:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:03:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:03:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:03:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:03:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43505647
Sun 19 Jan 2014 03:03:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:03:47 - job_xml_thread(): Done retrieving: data size 43505647
Sun 19 Jan 2014 03:03:47 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:03:47 - XML: Start document: iteration 1
Sun 19 Jan 2014 03:03:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43505647
Sun 19 Jan 2014 03:03:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:03:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:03:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:03:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:03:58 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:03:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:03:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:03:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:03:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:03:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:03:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:03:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:04:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:04:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:04:06 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 03:04:06 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:04:06 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:04:06 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:04:06 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:04:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:04:07 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:04:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:04:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 03:04:08 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:04:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 03:04:08 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:04:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5945 values 93900 bits 11737 bytes 
Sun 19 Jan 2014 03:04:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:04:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:04:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:04:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:04:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:04:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:04:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:04:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:04:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:04:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43506863
Sun 19 Jan 2014 03:04:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:04:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43506863
Sun 19 Jan 2014 03:04:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:04:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:04:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:04:22 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:04:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:04:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:04:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:04:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:04:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:04:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:04:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:04:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:04:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:04:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:04:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:04:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:04:28 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:04:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:04:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:04:28 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:04:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 03:04:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:04:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:04:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:04:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:04:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:04:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:04:30 - job_xml_thread(): Done retrieving: data size 43500600
Sun 19 Jan 2014 03:04:30 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:04:30 - XML: Start document: iteration 2
Sun 19 Jan 2014 03:04:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43500600
Sun 19 Jan 2014 03:04:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:04:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43500600
Sun 19 Jan 2014 03:04:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:04:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:04:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:04:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:04:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:04:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:04:46 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:04:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:04:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:04:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:04:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:04:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:04:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:04:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:04:50 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 03:04:50 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:04:50 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:04:50 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:04:50 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:04:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:04:52 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:04:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:04:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:04:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:04:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:04:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:04:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:04:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:04:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43516797
Sun 19 Jan 2014 03:04:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:04:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43516797
Sun 19 Jan 2014 03:04:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:05:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:05:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:05:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:05:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:05:05 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:05:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:05:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:05:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:05:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:05:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:05:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:05:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:05:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:05:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:05:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:05:08 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:05:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:05:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:05:08 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:05:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 03:05:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:05:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 03:05:08 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:05:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:05:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8933 values 140922 bits 17615 bytes 
Sun 19 Jan 2014 03:05:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:05:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:05:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:05:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:05:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:05:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:05:10 - job_xml_thread(): Done retrieving: data size 43461457
Sun 19 Jan 2014 03:05:10 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:05:10 - XML: Start document: iteration 3
Sun 19 Jan 2014 03:05:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43461457
Sun 19 Jan 2014 03:05:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:05:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43461457
Sun 19 Jan 2014 03:05:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:05:11 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 03:05:11 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:05:13 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:05:13 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 03:05:13 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:05:13 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 03:05:13 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 03:05:19 - size of cluster 'LISA Cluster': 624 hosts 79470 metrics 839156 values 13259790 bits 1657473 bytes 
Sun 19 Jan 2014 03:05:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:05:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:05:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:05:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:05:27 - XML: Processed 651640 elements - found 0 jobs
Sun 19 Jan 2014 03:05:27 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:05:27 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:05:27 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:05:27 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:05:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:05:28 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:05:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:05:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:05:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:05:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:05:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:05:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:05:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:05:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:05:32 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:05:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:05:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:05:33 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:05:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 03:05:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:05:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:05:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:05:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:05:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:05:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:05:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43036519
Sun 19 Jan 2014 03:05:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:05:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43036519
Sun 19 Jan 2014 03:05:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:05:43 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:05:43 - job_xml_thread(): Done retrieving: data size 43036519
Sun 19 Jan 2014 03:05:43 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:05:43 - XML: Start document: iteration 4
Sun 19 Jan 2014 03:05:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:05:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:05:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:05:46 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:05:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:05:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:05:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:05:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:05:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:05:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:05:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:05:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:05:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:05:53 - XML: Processed 646674 elements - found 0 jobs
Sun 19 Jan 2014 03:05:53 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:05:53 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:05:53 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:05:53 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:05:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:05:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:05:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:05:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:05:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:05:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:05:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:05:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:05:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:05:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42834827
Sun 19 Jan 2014 03:05:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:05:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42834827
Sun 19 Jan 2014 03:05:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:06:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:06:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:06:08 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:06:08 - job_xml_thread(): Done retrieving: data size 42834827
Sun 19 Jan 2014 03:06:08 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:06:08 - XML: Start document: iteration 5
Sun 19 Jan 2014 03:06:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:06:09 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:06:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:06:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 03:06:10 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:06:10 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:06:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8719 values 137557 bits 17194 bytes 
Sun 19 Jan 2014 03:06:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 03:06:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:06:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:06:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:06:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:06:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:06:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:06:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:06:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:06:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:06:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:06:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:06:13 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:06:13 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 03:06:18 - XML: Processed 644304 elements - found 0 jobs
Sun 19 Jan 2014 03:06:18 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:06:18 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:06:18 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:06:18 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:06:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:06:20 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:06:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:06:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:06:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:06:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:06:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:06:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:06:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:06:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42900403
Sun 19 Jan 2014 03:06:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:06:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42900403
Sun 19 Jan 2014 03:06:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:06:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:06:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:06:33 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:06:33 - job_xml_thread(): Done retrieving: data size 42900403
Sun 19 Jan 2014 03:06:33 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:06:33 - XML: Start document: iteration 6
Sun 19 Jan 2014 03:06:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:06:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:06:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:06:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:06:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:06:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:06:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:06:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:06:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:06:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:06:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:06:46 - XML: Processed 644886 elements - found 0 jobs
Sun 19 Jan 2014 03:06:46 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:06:46 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:06:46 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:06:46 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:06:46 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:06:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 03:06:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:06:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:06:47 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:06:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:06:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:06:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:06:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:06:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:06:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:06:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:06:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43434261
Sun 19 Jan 2014 03:06:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:06:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43434261
Sun 19 Jan 2014 03:06:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:06:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:06:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:07:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:07:00 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:07:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:07:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:07:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:07:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:07:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43434261
Sun 19 Jan 2014 03:07:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:07:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:07:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:07:01 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:07:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:07:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:07:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:07:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:07:07 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:07:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:07:10 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:07:10 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:07:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 03:07:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:07:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 03:07:11 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:07:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5879 values 92751 bits 11593 bytes 
Sun 19 Jan 2014 03:07:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:07:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:07:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:07:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:07:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:07:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:07:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:07:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:07:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:07:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:07:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:07:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:07:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:07:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:07:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:07:17 - job_xml_thread(): Done retrieving: data size 43465656
Sun 19 Jan 2014 03:07:17 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:07:17 - XML: Start document: iteration 7
Sun 19 Jan 2014 03:07:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43465656
Sun 19 Jan 2014 03:07:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43465656
Sun 19 Jan 2014 03:07:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:07:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:07:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:07:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:07:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:07:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:07:32 - XML: Processed 652388 elements - found 0 jobs
Sun 19 Jan 2014 03:07:32 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:07:32 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:07:32 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:07:32 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:07:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:07:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:07:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:07:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:07:35 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:07:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 03:07:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:07:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:07:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:07:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:07:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:07:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:07:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:07:41 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:07:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:07:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:07:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:07:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:07:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:07:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:07:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:07:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43502234
Sun 19 Jan 2014 03:07:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:07:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43502234
Sun 19 Jan 2014 03:07:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:07:47 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:07:47 - job_xml_thread(): Done retrieving: data size 43502234
Sun 19 Jan 2014 03:07:47 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:07:48 - XML: Start document: iteration 8
Sun 19 Jan 2014 03:07:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:07:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:07:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:07:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:08:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:08:01 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:08:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:08:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:08:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:08:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:08:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:08:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:08:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:08:04 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 03:08:04 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:08:04 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:08:04 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:08:04 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:08:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:08:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:08:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:08:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:08:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:08:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:08:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:08:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:08:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:08:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43506522
Sun 19 Jan 2014 03:08:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:08:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:08:11 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:08:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43506522
Sun 19 Jan 2014 03:08:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:08:11 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:08:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 03:08:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:08:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 03:08:11 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:08:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6835 values 107908 bits 13488 bytes 
Sun 19 Jan 2014 03:08:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:08:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:08:19 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:08:19 - job_xml_thread(): Done retrieving: data size 43506522
Sun 19 Jan 2014 03:08:19 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:08:20 - XML: Start document: iteration 9
Sun 19 Jan 2014 03:08:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:08:20 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:08:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:08:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:08:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:08:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:08:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:08:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:08:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:08:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:08:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:08:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:08:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:08:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:08:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:08:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:08:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:08:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:08:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:08:34 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 03:08:34 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:08:34 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:08:34 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:08:34 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:08:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:08:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:08:38 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:08:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 03:08:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:08:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:08:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43481140
Sun 19 Jan 2014 03:08:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:08:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43481140
Sun 19 Jan 2014 03:08:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:08:40 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 03:08:40 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 03:08:40 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:08:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:08:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:08:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:08:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:08:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:08:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:08:49 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:08:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:08:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:08:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:08:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:08:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:08:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:08:52 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:08:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:08:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:08:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:08:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:08:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:08:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:08:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:08:54 - job_xml_thread(): Done retrieving: data size 43521008
Sun 19 Jan 2014 03:08:54 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:08:54 - XML: Start document: iteration 10
Sun 19 Jan 2014 03:08:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43521008
Sun 19 Jan 2014 03:08:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:08:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43521008
Sun 19 Jan 2014 03:08:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:09:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:09:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:09:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:09:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:09:08 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 03:09:08 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:09:09 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:09:09 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:09:09 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:09:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:09:11 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:09:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:09:13 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:09:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 03:09:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 03:09:13 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:09:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99062 bits 12382 bytes 
Sun 19 Jan 2014 03:09:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:09:14 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:09:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:09:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:09:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:09:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:09:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:09:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:09:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:09:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:09:18 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:09:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:09:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:09:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:09:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:09:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:09:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:09:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:09:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43507157
Sun 19 Jan 2014 03:09:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:09:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43507157
Sun 19 Jan 2014 03:09:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:09:24 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:09:24 - job_xml_thread(): Done retrieving: data size 43507157
Sun 19 Jan 2014 03:09:24 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:09:24 - XML: Start document: iteration 11
Sun 19 Jan 2014 03:09:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:09:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:09:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:09:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:09:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:09:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:09:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:09:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:09:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:09:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:09:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:09:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:09:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:09:39 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 03:09:39 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:09:39 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:09:39 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:09:39 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:09:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:09:42 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:09:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:09:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:09:43 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:09:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 03:09:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:09:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:09:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:09:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:09:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:09:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:09:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43513204
Sun 19 Jan 2014 03:09:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:09:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43513204
Sun 19 Jan 2014 03:09:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:09:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:09:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:09:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:09:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:09:55 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:09:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:09:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:09:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:09:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:09:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:09:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:09:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:09:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:09:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:09:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:09:58 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:09:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:09:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:09:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:09:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:09:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:09:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:09:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:09:59 - job_xml_thread(): Done retrieving: data size 43508158
Sun 19 Jan 2014 03:09:59 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:09:59 - XML: Start document: iteration 12
Sun 19 Jan 2014 03:09:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43508158
Sun 19 Jan 2014 03:09:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:10:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43508158
Sun 19 Jan 2014 03:10:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:10:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:10:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:10:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:10:13 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:10:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:10:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:10:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:10:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 03:10:14 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:10:14 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:10:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 03:10:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9051 values 142767 bits 17845 bytes 
Sun 19 Jan 2014 03:10:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:10:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:10:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:10:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:10:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:10:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:10:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:10:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:10:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:10:21 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 03:10:21 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:10:21 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:10:21 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:10:21 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:10:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:10:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:10:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:10:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:10:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:10:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:10:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:10:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:10:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:10:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43510842
Sun 19 Jan 2014 03:10:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:10:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43510842
Sun 19 Jan 2014 03:10:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:10:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:10:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:10:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:10:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:10:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:10:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:10:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:10:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:10:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:10:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:10:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:10:37 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:10:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:10:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:10:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:10:40 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:10:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:10:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:10:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:10:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:10:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:10:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:10:41 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:10:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 03:10:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:10:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:10:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43515485
Sun 19 Jan 2014 03:10:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:10:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43515485
Sun 19 Jan 2014 03:10:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:10:43 - job_xml_thread(): Done retrieving: data size 43515485
Sun 19 Jan 2014 03:10:43 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:10:44 - XML: Start document: iteration 13
Sun 19 Jan 2014 03:10:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:10:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:10:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:10:54 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:10:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:10:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:10:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:10:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:10:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:10:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:10:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:10:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:10:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:11:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:11:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:11:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:11:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:11:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:11:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:11:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:11:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:11:05 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 03:11:05 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:11:05 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:11:05 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:11:05 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:11:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:11:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43493581
Sun 19 Jan 2014 03:11:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:11:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43493581
Sun 19 Jan 2014 03:11:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:11:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:11:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:11:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:11:15 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:11:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:11:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 03:11:16 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:11:16 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:11:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 03:11:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8678 values 136831 bits 17103 bytes 
Sun 19 Jan 2014 03:11:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:11:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:11:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:11:20 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:11:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:11:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:11:21 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:11:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:11:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:11:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:11:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:11:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:11:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:11:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:11:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:11:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:11:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:11:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:11:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:11:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:11:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:11:25 - job_xml_thread(): Done retrieving: data size 43460180
Sun 19 Jan 2014 03:11:25 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:11:25 - XML: Start document: iteration 14
Sun 19 Jan 2014 03:11:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43460180
Sun 19 Jan 2014 03:11:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43460180
Sun 19 Jan 2014 03:11:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:11:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:11:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:11:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:11:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:11:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:11:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:11:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:11:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:11:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:11:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:11:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:11:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:11:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:11:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:11:44 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:11:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 03:11:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:11:48 - XML: Processed 651640 elements - found 0 jobs
Sun 19 Jan 2014 03:11:48 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:11:48 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:11:48 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:11:48 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:11:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:11:49 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:11:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:11:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:11:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:11:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:11:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:11:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:11:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:11:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42879044
Sun 19 Jan 2014 03:11:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:11:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42879044
Sun 19 Jan 2014 03:11:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:11:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:11:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:11:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:11:59 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:11:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:11:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:12:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:12:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:12:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:12:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:12:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:12:03 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:12:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:12:03 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:12:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:12:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:12:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:12:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:12:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:12:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:12:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:12:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42844394
Sun 19 Jan 2014 03:12:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:12:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42844394
Sun 19 Jan 2014 03:12:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:12:06 - job_xml_thread(): Done retrieving: data size 42844394
Sun 19 Jan 2014 03:12:06 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:12:06 - XML: Start document: iteration 15
Sun 19 Jan 2014 03:12:14 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 03:12:14 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:12:15 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:12:15 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 03:12:15 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:12:15 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 03:12:15 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 03:12:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:12:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:12:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:12:17 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:12:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:12:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 03:12:18 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:12:18 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:12:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 03:12:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8896 values 140290 bits 17536 bytes 
Sun 19 Jan 2014 03:12:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:12:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:12:23 - XML: Processed 644190 elements - found 0 jobs
Sun 19 Jan 2014 03:12:23 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:12:23 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:12:23 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:12:23 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:12:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:12:27 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:12:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:12:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:12:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:12:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:12:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:12:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:12:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:12:28 - size of cluster 'LISA Cluster': 624 hosts 79474 metrics 877333 values 13835639 bits 1729454 bytes 
Sun 19 Jan 2014 03:12:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:12:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:12:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:12:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:12:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:12:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:12:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:12:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:12:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:12:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43287947
Sun 19 Jan 2014 03:12:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:12:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43287947
Sun 19 Jan 2014 03:12:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:12:38 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:12:38 - job_xml_thread(): Done retrieving: data size 43287947
Sun 19 Jan 2014 03:12:38 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:12:38 - XML: Start document: iteration 16
Sun 19 Jan 2014 03:12:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:12:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:12:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:12:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:12:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:12:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:12:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:12:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:12:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:12:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:12:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:12:51 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:12:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 03:12:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:12:51 - XML: Processed 649802 elements - found 0 jobs
Sun 19 Jan 2014 03:12:51 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:12:51 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:12:51 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:12:51 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:12:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:12:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:12:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:12:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:12:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:12:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:12:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:12:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:12:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:12:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43448274
Sun 19 Jan 2014 03:12:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:12:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43448274
Sun 19 Jan 2014 03:12:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:12:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:12:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:13:06 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:13:06 - job_xml_thread(): Done retrieving: data size 43448274
Sun 19 Jan 2014 03:13:06 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:13:06 - XML: Start document: iteration 17
Sun 19 Jan 2014 03:13:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:13:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:13:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:13:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:13:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:13:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:13:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:13:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:13:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:13:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:13:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:13:15 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:13:15 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 03:13:16 - XML: Processed 651842 elements - found 0 jobs
Sun 19 Jan 2014 03:13:16 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:13:16 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:13:16 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:13:16 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:13:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:13:18 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:13:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:13:19 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:13:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 03:13:19 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:13:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 03:13:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5704 values 89973 bits 11246 bytes 
Sun 19 Jan 2014 03:13:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:13:20 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:13:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:13:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:13:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:13:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:13:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:13:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:13:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:13:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43487504
Sun 19 Jan 2014 03:13:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:13:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43487504
Sun 19 Jan 2014 03:13:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:13:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:13:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:13:31 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:13:31 - job_xml_thread(): Done retrieving: data size 43487504
Sun 19 Jan 2014 03:13:31 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:13:31 - XML: Start document: iteration 18
Sun 19 Jan 2014 03:13:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:13:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:13:40 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 03:13:40 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:13:40 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:13:40 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:13:40 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:13:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:13:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:13:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:13:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:13:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:13:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:13:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:13:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:13:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:13:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:13:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:13:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:13:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:13:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:13:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:13:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:13:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:13:45 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:13:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 03:13:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:13:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:13:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43496254
Sun 19 Jan 2014 03:13:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:13:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43496254
Sun 19 Jan 2014 03:13:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:13:55 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:13:55 - job_xml_thread(): Done retrieving: data size 43496254
Sun 19 Jan 2014 03:13:55 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:13:55 - XML: Start document: iteration 19
Sun 19 Jan 2014 03:13:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:13:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:14:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:14:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:14:07 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 03:14:07 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:14:07 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:14:07 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:14:07 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:14:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:14:10 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:14:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:14:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:14:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:14:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:14:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:14:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:14:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:14:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:14:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:14:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:14:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:14:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:14:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:14:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:14:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:14:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:14:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43508828
Sun 19 Jan 2014 03:14:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:14:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43508828
Sun 19 Jan 2014 03:14:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:14:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:14:20 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:14:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:14:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 03:14:21 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:14:21 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:14:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 03:14:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8695 values 137043 bits 17130 bytes 
Sun 19 Jan 2014 03:14:22 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:14:23 - job_xml_thread(): Done retrieving: data size 43508828
Sun 19 Jan 2014 03:14:23 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:14:23 - XML: Start document: iteration 20
Sun 19 Jan 2014 03:14:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:14:25 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:14:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:14:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:14:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:14:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:14:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:14:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:14:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:14:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:14:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:14:36 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 03:14:36 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:14:36 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:14:36 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:14:36 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:14:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:14:39 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:14:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:14:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:14:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:14:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:14:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:14:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:14:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:14:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43491952
Sun 19 Jan 2014 03:14:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:14:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:14:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:14:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43491952
Sun 19 Jan 2014 03:14:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:14:51 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:14:51 - job_xml_thread(): Done retrieving: data size 43491952
Sun 19 Jan 2014 03:14:51 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:14:51 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 03:14:51 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 03:14:51 - Housekeeping: done.
Sun 19 Jan 2014 03:14:51 - XML: Start document: iteration 0
Sun 19 Jan 2014 03:14:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:14:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:14:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:14:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:14:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:14:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:14:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:14:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:14:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:14:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:14:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:15:00 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:15:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 03:15:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:15:02 - XML: Processed 652388 elements - found 0 jobs
Sun 19 Jan 2014 03:15:02 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:15:02 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:15:02 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:15:02 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:15:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:15:07 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:15:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:15:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:15:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:15:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:15:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:15:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:15:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:15:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:15:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:15:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43495538
Sun 19 Jan 2014 03:15:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:15:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43495538
Sun 19 Jan 2014 03:15:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:15:17 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:15:17 - job_xml_thread(): Done retrieving: data size 43495538
Sun 19 Jan 2014 03:15:17 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:15:17 - XML: Start document: iteration 1
Sun 19 Jan 2014 03:15:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:15:20 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:15:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:15:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:15:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:15:21 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:15:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:15:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:15:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:15:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:15:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:15:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:15:22 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:15:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 03:15:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 03:15:22 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:15:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:15:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:15:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5620 values 88606 bits 11075 bytes 
Sun 19 Jan 2014 03:15:27 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 03:15:27 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:15:27 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:15:27 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:15:27 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:15:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:15:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:15:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:15:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:15:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:15:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:15:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:15:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:15:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:15:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43486534
Sun 19 Jan 2014 03:15:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:15:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43486534
Sun 19 Jan 2014 03:15:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:15:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:15:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:15:43 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:15:43 - job_xml_thread(): Done retrieving: data size 43486534
Sun 19 Jan 2014 03:15:43 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:15:43 - XML: Start document: iteration 2
Sun 19 Jan 2014 03:15:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:15:43 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:15:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:15:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:15:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:15:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:15:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43486534
Sun 19 Jan 2014 03:15:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:15:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:15:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:15:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:15:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:15:58 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 03:15:58 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:15:58 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:15:58 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:15:58 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:15:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:15:59 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:16:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:16:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:16:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:16:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:16:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:16:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:16:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:16:02 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:16:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 03:16:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:16:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:16:04 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:16:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:16:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:16:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:16:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:16:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:16:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:16:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:16:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43517203
Sun 19 Jan 2014 03:16:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:16:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43517203
Sun 19 Jan 2014 03:16:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:16:13 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:16:13 - job_xml_thread(): Done retrieving: data size 43517203
Sun 19 Jan 2014 03:16:13 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:16:13 - XML: Start document: iteration 3
Sun 19 Jan 2014 03:16:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:16:14 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:16:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:16:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:16:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:16:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:16:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:16:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:16:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:16:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:16:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:16:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:16:22 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:16:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:16:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 03:16:22 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:16:22 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:16:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 03:16:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5973 values 94271 bits 11783 bytes 
Sun 19 Jan 2014 03:16:26 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 03:16:26 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:16:26 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:16:26 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:16:26 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:16:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:16:28 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:16:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:16:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:16:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:16:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:16:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:16:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:16:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:16:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43480304
Sun 19 Jan 2014 03:16:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:16:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43480304
Sun 19 Jan 2014 03:16:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:16:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:16:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:16:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:16:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:16:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:16:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:16:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:16:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:16:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:16:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:16:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43480304
Sun 19 Jan 2014 03:16:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:16:41 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:16:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:16:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:16:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:16:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:16:54 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:16:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:16:55 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:16:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:16:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:16:55 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:16:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 03:16:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:16:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:16:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:16:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:16:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:16:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:16:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:16:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:16:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:16:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:16:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:16:57 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 03:16:57 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 03:16:57 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:16:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:16:58 - job_xml_thread(): Done retrieving: data size 43491325
Sun 19 Jan 2014 03:16:58 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:16:58 - XML: Start document: iteration 4
Sun 19 Jan 2014 03:16:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43491325
Sun 19 Jan 2014 03:16:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:16:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43491325
Sun 19 Jan 2014 03:16:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:17:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:17:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:17:12 - XML: Processed 652386 elements - found 0 jobs
Sun 19 Jan 2014 03:17:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:17:12 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:17:12 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:17:12 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:17:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:17:12 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:17:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:17:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:17:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:17:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:17:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:17:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:17:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:17:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:17:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:17:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:17:19 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:17:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:17:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:17:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:17:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:17:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:17:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:17:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:17:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43460373
Sun 19 Jan 2014 03:17:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:17:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43460373
Sun 19 Jan 2014 03:17:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:17:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:17:22 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:17:25 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:17:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 03:17:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:17:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 03:17:25 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:17:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8924 values 141174 bits 17646 bytes 
Sun 19 Jan 2014 03:17:27 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:17:27 - job_xml_thread(): Done retrieving: data size 43460373
Sun 19 Jan 2014 03:17:27 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:17:27 - XML: Start document: iteration 5
Sun 19 Jan 2014 03:17:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:17:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:17:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:17:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:17:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:17:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:17:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:17:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:17:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:17:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:17:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:17:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:17:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:17:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:17:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:17:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:17:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:17:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:17:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:17:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:17:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:17:42 - XML: Processed 651640 elements - found 0 jobs
Sun 19 Jan 2014 03:17:42 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:17:42 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:17:42 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:17:42 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:17:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:17:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42919038
Sun 19 Jan 2014 03:17:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:17:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42919038
Sun 19 Jan 2014 03:17:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:17:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:17:54 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:17:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:17:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:17:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:17:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:17:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:17:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:17:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:17:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:17:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:17:57 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:17:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:17:59 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:17:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:17:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:17:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:17:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:17:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:17:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:18:00 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:18:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 03:18:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:18:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:18:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42855783
Sun 19 Jan 2014 03:18:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:18:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42855783
Sun 19 Jan 2014 03:18:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:18:01 - job_xml_thread(): Done retrieving: data size 42855783
Sun 19 Jan 2014 03:18:01 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:18:01 - XML: Start document: iteration 6
Sun 19 Jan 2014 03:18:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:18:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:18:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:18:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:18:15 - XML: Processed 644190 elements - found 0 jobs
Sun 19 Jan 2014 03:18:15 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:18:15 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:18:15 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:18:15 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:18:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:18:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:18:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:18:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:18:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:18:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:18:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:18:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:18:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:18:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:18:24 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:18:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:18:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:18:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:18:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:18:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:18:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:18:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:18:25 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:18:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:18:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42970049
Sun 19 Jan 2014 03:18:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:18:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:18:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 03:18:26 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:18:26 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:18:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 03:18:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42970049
Sun 19 Jan 2014 03:18:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:18:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5752 values 90940 bits 11367 bytes 
Sun 19 Jan 2014 03:18:30 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:18:30 - job_xml_thread(): Done retrieving: data size 42970049
Sun 19 Jan 2014 03:18:30 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:18:30 - XML: Start document: iteration 7
Sun 19 Jan 2014 03:18:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:18:37 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:18:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:18:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:18:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:18:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:18:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:18:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:18:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:18:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:18:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:18:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:18:45 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:18:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:18:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:18:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:18:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:18:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:18:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:18:46 - XML: Processed 645426 elements - found 0 jobs
Sun 19 Jan 2014 03:18:46 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:18:46 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:18:46 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:18:46 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:18:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:18:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43444836
Sun 19 Jan 2014 03:18:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:18:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43444836
Sun 19 Jan 2014 03:18:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:18:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:18:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:19:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:19:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:19:01 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:19:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:19:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:19:03 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:19:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:19:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:19:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:19:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:19:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:19:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:19:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:19:06 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:19:06 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:19:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 03:19:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:19:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:19:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:19:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:19:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:19:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:19:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:19:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:19:07 - job_xml_thread(): Done retrieving: data size 43517242
Sun 19 Jan 2014 03:19:07 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:19:07 - XML: Start document: iteration 8
Sun 19 Jan 2014 03:19:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43517242
Sun 19 Jan 2014 03:19:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:19:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43517242
Sun 19 Jan 2014 03:19:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:19:15 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 03:19:15 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:19:18 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:19:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:19:18 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 03:19:18 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:19:18 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:19:18 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 03:19:18 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 03:19:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:19:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:19:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:19:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:19:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:19:22 - ganglia_parse_thread(): started: cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sun 19 Jan 2014 03:19:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:19:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:19:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:19:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:19:27 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:19:28 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 03:19:28 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:19:28 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:19:28 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:19:28 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:19:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:19:28 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:19:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 03:19:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 03:19:29 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:19:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:19:29 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:19:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6060 values 95605 bits 11950 bytes 
Sun 19 Jan 2014 03:19:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:19:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:19:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:19:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:19:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:19:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:19:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:19:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43488201
Sun 19 Jan 2014 03:19:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:19:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43488201
Sun 19 Jan 2014 03:19:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:19:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:19:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:19:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:19:43 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:19:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:19:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:19:43 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:19:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:19:44 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:19:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 03:19:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:19:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:19:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:19:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:19:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:19:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:19:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:19:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:19:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:19:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:19:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:19:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:19:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:19:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:19:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:19:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:19:48 - job_xml_thread(): Done retrieving: data size 43508049
Sun 19 Jan 2014 03:19:48 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:19:48 - XML: Start document: iteration 9
Sun 19 Jan 2014 03:19:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43508049
Sun 19 Jan 2014 03:19:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:19:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43508049
Sun 19 Jan 2014 03:19:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:19:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:19:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:20:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:20:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:20:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:20:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:20:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:20:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:20:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:20:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:20:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:20:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:20:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:20:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:20:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:20:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:20:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:20:11 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 03:20:11 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:20:11 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:20:11 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:20:11 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:20:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:20:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:20:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:20:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:20:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:20:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43498238
Sun 19 Jan 2014 03:20:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:20:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43498238
Sun 19 Jan 2014 03:20:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:20:19 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:20:19 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:20:20 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:20:20 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 03:20:20 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:20:20 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 03:20:20 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 03:20:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:20:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:20:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:20:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:20:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:20:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:20:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:20:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:20:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:20:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:20:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:20:26 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:20:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:20:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:20:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:20:28 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:20:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:20:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:20:28 - size of cluster 'LISA Cluster': 624 hosts 79482 metrics 886487 values 14002900 bits 1750362 bytes 
Sun 19 Jan 2014 03:20:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:20:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:20:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:20:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:20:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:20:29 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:20:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:20:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 03:20:29 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:20:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9242 values 145814 bits 18226 bytes 
Sun 19 Jan 2014 03:20:29 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:20:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 03:20:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:20:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43499992
Sun 19 Jan 2014 03:20:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:20:32 - job_xml_thread(): Done retrieving: data size 43499992
Sun 19 Jan 2014 03:20:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43499992
Sun 19 Jan 2014 03:20:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:20:32 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:20:32 - XML: Start document: iteration 10
Sun 19 Jan 2014 03:20:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:20:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:20:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:20:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:20:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:20:45 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:20:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:20:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:20:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:20:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:20:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:20:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:20:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:20:50 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 03:20:50 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:20:50 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:20:50 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:20:51 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:20:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:20:55 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:20:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:20:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:20:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:20:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:20:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:20:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:20:57 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:20:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 03:20:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:20:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:20:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43504269
Sun 19 Jan 2014 03:20:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:20:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43504269
Sun 19 Jan 2014 03:20:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:21:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:21:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:21:07 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:21:07 - job_xml_thread(): Done retrieving: data size 43504269
Sun 19 Jan 2014 03:21:07 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:21:08 - XML: Start document: iteration 11
Sun 19 Jan 2014 03:21:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:21:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:21:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:21:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:21:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:21:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:21:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:21:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:21:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:21:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:21:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:21:19 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 03:21:19 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:21:19 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:21:19 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:21:19 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:21:20 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:21:21 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 03:21:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:21:21 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:21:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:21:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:21:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:21:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:21:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:21:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:21:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:21:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43486546
Sun 19 Jan 2014 03:21:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:21:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43486546
Sun 19 Jan 2014 03:21:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:21:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:21:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:21:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:21:29 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:21:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:21:30 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:21:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 03:21:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 03:21:30 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:21:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7863 values 124008 bits 15501 bytes 
Sun 19 Jan 2014 03:21:34 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:21:34 - job_xml_thread(): Done retrieving: data size 43486546
Sun 19 Jan 2014 03:21:34 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:21:34 - XML: Start document: iteration 12
Sun 19 Jan 2014 03:21:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:21:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:21:43 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 03:21:43 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:21:43 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:21:43 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:21:43 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:21:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:21:44 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:21:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:21:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:21:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:21:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:21:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:21:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:21:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:21:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:21:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:21:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:21:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:21:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:21:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:21:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:21:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:21:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:21:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43507560
Sun 19 Jan 2014 03:21:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:21:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43507560
Sun 19 Jan 2014 03:21:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:22:00 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:22:00 - job_xml_thread(): Done retrieving: data size 43507560
Sun 19 Jan 2014 03:22:00 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:22:00 - XML: Start document: iteration 13
Sun 19 Jan 2014 03:22:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:22:01 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:22:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:22:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:22:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:22:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:22:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:22:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:22:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:22:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:22:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:22:11 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 03:22:11 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:22:11 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:22:11 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:22:11 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:22:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:22:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:22:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:22:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:22:13 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:22:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 03:22:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:22:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:22:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:22:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:22:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:22:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:22:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43487366
Sun 19 Jan 2014 03:22:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:22:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43487366
Sun 19 Jan 2014 03:22:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:22:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:22:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:22:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:22:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:22:26 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:22:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:22:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:22:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:22:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:22:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:22:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:22:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:22:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:22:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:22:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:22:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:22:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:22:30 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:22:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:22:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:22:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:22:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:22:31 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:22:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:22:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 03:22:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 03:22:31 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:22:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5960 values 94052 bits 11756 bytes 
Sun 19 Jan 2014 03:22:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:22:34 - job_xml_thread(): Done retrieving: data size 43501833
Sun 19 Jan 2014 03:22:34 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:22:34 - XML: Start document: iteration 14
Sun 19 Jan 2014 03:22:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43501833
Sun 19 Jan 2014 03:22:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43501833
Sun 19 Jan 2014 03:22:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:22:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:22:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:22:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:22:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:22:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:22:49 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 03:22:49 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:22:49 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:22:49 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:22:49 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:22:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:22:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:22:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:22:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:22:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:22:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:22:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:22:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:22:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:22:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:22:58 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:22:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:22:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:22:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:22:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:22:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:22:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:22:59 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:22:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 03:22:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:23:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:23:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43503824
Sun 19 Jan 2014 03:23:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:23:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43503824
Sun 19 Jan 2014 03:23:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:23:04 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:23:04 - job_xml_thread(): Done retrieving: data size 43503824
Sun 19 Jan 2014 03:23:04 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:23:04 - XML: Start document: iteration 15
Sun 19 Jan 2014 03:23:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:23:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:23:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:23:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:23:15 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 03:23:15 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:23:15 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:23:15 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:23:15 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:23:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:23:19 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:23:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:23:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:23:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:23:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:23:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:23:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:23:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:23:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:23:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:23:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:23:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:23:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:23:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:23:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:23:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:23:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:23:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43448826
Sun 19 Jan 2014 03:23:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:23:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43448826
Sun 19 Jan 2014 03:23:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:23:30 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:23:30 - job_xml_thread(): Done retrieving: data size 43448826
Sun 19 Jan 2014 03:23:30 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:23:30 - XML: Start document: iteration 16
Sun 19 Jan 2014 03:23:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:23:31 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:23:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:23:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 03:23:32 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:23:32 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:23:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8208 values 129447 bits 16180 bytes 
Sun 19 Jan 2014 03:23:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 03:23:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:23:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:23:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:23:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:23:43 - XML: Processed 651640 elements - found 0 jobs
Sun 19 Jan 2014 03:23:43 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:23:43 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:23:43 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:23:43 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:23:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:23:44 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:23:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:23:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:23:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:23:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:23:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:23:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:23:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:23:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:23:49 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:23:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:23:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:23:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:23:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:23:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:23:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:23:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:23:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42859636
Sun 19 Jan 2014 03:23:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:23:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42859636
Sun 19 Jan 2014 03:23:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:23:57 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:23:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 03:23:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:23:58 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:23:58 - job_xml_thread(): Done retrieving: data size 42859636
Sun 19 Jan 2014 03:23:58 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:23:58 - XML: Start document: iteration 17
Sun 19 Jan 2014 03:24:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:24:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:24:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:24:03 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:24:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:24:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:24:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:24:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:24:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:24:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:24:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:24:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:24:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:24:16 - XML: Processed 644496 elements - found 0 jobs
Sun 19 Jan 2014 03:24:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:24:16 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:24:16 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:24:16 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:24:16 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:24:16 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:24:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:24:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:24:16 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 03:24:16 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 03:24:16 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:24:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:24:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:24:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:24:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:24:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:24:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42868972
Sun 19 Jan 2014 03:24:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:24:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42868972
Sun 19 Jan 2014 03:24:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:24:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:24:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:24:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:24:29 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:24:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:24:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:24:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:24:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:24:31 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:24:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:24:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:24:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:24:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:24:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:24:32 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:24:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:24:32 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:24:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:24:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:24:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:24:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:24:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 03:24:32 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:24:32 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:24:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 03:24:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6264 values 98756 bits 12344 bytes 
Sun 19 Jan 2014 03:24:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:24:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:24:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:24:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:24:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:24:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43351359
Sun 19 Jan 2014 03:24:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:24:35 - job_xml_thread(): Done retrieving: data size 43351359
Sun 19 Jan 2014 03:24:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43351359
Sun 19 Jan 2014 03:24:35 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:24:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:24:35 - XML: Start document: iteration 18
Sun 19 Jan 2014 03:24:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:24:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:24:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:24:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:24:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:24:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:24:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:24:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:24:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:24:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:24:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:24:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:24:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:24:57 - XML: Processed 650376 elements - found 0 jobs
Sun 19 Jan 2014 03:24:57 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:24:57 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:24:57 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:24:57 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:24:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:24:58 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:24:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:24:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:24:58 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:24:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 03:24:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:24:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:24:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:24:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:24:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:24:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:24:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43484504
Sun 19 Jan 2014 03:24:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:25:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43484504
Sun 19 Jan 2014 03:25:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:25:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:25:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:25:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:25:10 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:25:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:25:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:25:12 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:25:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:25:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:25:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:25:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:25:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:25:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:25:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:25:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:25:14 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:25:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:25:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:25:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:25:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:25:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:25:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:25:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:25:16 - job_xml_thread(): Done retrieving: data size 43506466
Sun 19 Jan 2014 03:25:16 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:25:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43506466
Sun 19 Jan 2014 03:25:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43506466
Sun 19 Jan 2014 03:25:16 - XML: Start document: iteration 19
Sun 19 Jan 2014 03:25:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:25:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:25:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:25:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:25:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:25:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:25:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:25:32 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:25:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:25:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:25:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:25:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:25:34 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:25:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 03:25:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:25:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 03:25:34 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:25:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8334 values 131400 bits 16425 bytes 
Sun 19 Jan 2014 03:25:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:25:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:25:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:25:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:25:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:25:38 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 03:25:38 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:25:38 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:25:38 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:25:38 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:25:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:25:39 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:25:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:25:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:25:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:25:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:25:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:25:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:25:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:25:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43505680
Sun 19 Jan 2014 03:25:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:25:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43505680
Sun 19 Jan 2014 03:25:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:25:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:25:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:25:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:25:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:25:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:25:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:25:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43505680
Sun 19 Jan 2014 03:25:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:25:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:25:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:25:54 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:25:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:25:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:25:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:25:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:25:59 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:26:00 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:26:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 03:26:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:26:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:26:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:26:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:26:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:26:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:26:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:26:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:26:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:26:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:26:03 - job_xml_thread(): Done retrieving: data size 43481303
Sun 19 Jan 2014 03:26:03 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:26:03 - XML: Start document: iteration 20
Sun 19 Jan 2014 03:26:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43481303
Sun 19 Jan 2014 03:26:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:26:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:26:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:26:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:26:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:26:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:26:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43481303
Sun 19 Jan 2014 03:26:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:26:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:26:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:26:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:26:20 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 03:26:20 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:26:20 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:26:20 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:26:21 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:26:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:26:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:26:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:26:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:26:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:26:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:26:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:26:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:26:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:26:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:26:25 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:26:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:26:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:26:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:26:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:26:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:26:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:26:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:26:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43524939
Sun 19 Jan 2014 03:26:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:26:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43524939
Sun 19 Jan 2014 03:26:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:26:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:26:35 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:26:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:26:36 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:26:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 03:26:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 03:26:36 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:26:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9265 values 146130 bits 18266 bytes 
Sun 19 Jan 2014 03:26:36 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:26:36 - job_xml_thread(): Done retrieving: data size 43524939
Sun 19 Jan 2014 03:26:36 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:26:36 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 03:26:36 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 03:26:36 - Housekeeping: done.
Sun 19 Jan 2014 03:26:36 - XML: Start document: iteration 0
Sun 19 Jan 2014 03:26:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:26:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:26:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:26:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:26:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:26:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:26:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:26:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:26:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:26:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:26:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:26:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:26:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:26:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:26:47 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:26:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:26:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:26:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:26:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:26:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:26:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:26:50 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 03:26:50 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:26:50 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:26:50 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:26:50 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:26:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:26:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43492924
Sun 19 Jan 2014 03:26:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:26:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43492924
Sun 19 Jan 2014 03:26:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:26:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:26:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:27:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:27:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:27:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:27:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:27:05 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:27:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:27:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:27:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:27:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:27:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:27:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:27:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:27:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:27:07 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:27:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:27:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:27:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:27:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:27:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:27:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:27:08 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:27:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 03:27:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:27:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:27:09 - job_xml_thread(): Done retrieving: data size 43520108
Sun 19 Jan 2014 03:27:09 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:27:09 - XML: Start document: iteration 1
Sun 19 Jan 2014 03:27:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43520108
Sun 19 Jan 2014 03:27:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:27:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43520108
Sun 19 Jan 2014 03:27:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:27:21 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 03:27:21 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:27:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:27:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:27:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:27:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:27:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:27:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:27:22 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:27:22 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 03:27:22 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:27:22 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 03:27:22 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 03:27:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:27:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:27:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:27:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:27:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:27:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:27:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sun 19 Jan 2014 03:27:27 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 03:27:27 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:27:27 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:27:27 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:27:27 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:27:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:27:31 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:27:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:27:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:27:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:27:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:27:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:27:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:27:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:27:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43487577
Sun 19 Jan 2014 03:27:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:27:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43487577
Sun 19 Jan 2014 03:27:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:27:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:27:36 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:27:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:27:36 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:27:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 03:27:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 03:27:37 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:27:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8658 values 136490 bits 17061 bytes 
Sun 19 Jan 2014 03:27:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:27:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:27:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:27:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:27:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:27:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:27:42 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:27:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:27:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:27:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:27:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:27:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:27:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:27:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:27:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:27:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:27:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:27:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:27:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:27:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:27:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:27:48 - job_xml_thread(): Done retrieving: data size 43502956
Sun 19 Jan 2014 03:27:48 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:27:48 - XML: Start document: iteration 2
Sun 19 Jan 2014 03:27:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43502956
Sun 19 Jan 2014 03:27:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:27:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43502956
Sun 19 Jan 2014 03:27:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:27:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:27:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:28:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:28:01 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:28:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:28:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:28:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:28:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:28:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:28:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:28:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:28:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:28:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:28:03 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:28:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 03:28:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:28:09 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 03:28:09 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:28:09 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:28:09 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:28:09 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:28:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:28:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:28:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:28:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:28:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:28:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:28:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:28:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:28:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:28:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43500444
Sun 19 Jan 2014 03:28:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:28:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43500444
Sun 19 Jan 2014 03:28:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:28:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:28:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:28:22 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:28:22 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:28:22 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:28:22 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:28:22 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 03:28:22 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 03:28:22 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 03:28:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:28:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:28:24 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:28:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:28:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:28:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sun 19 Jan 2014 03:28:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:28:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:28:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:28:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:28:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:28:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:28:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:28:27 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:28:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:28:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:28:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:28:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:28:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:28:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:28:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:28:29 - job_xml_thread(): Done retrieving: data size 43521981
Sun 19 Jan 2014 03:28:29 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:28:29 - XML: Start document: iteration 3
Sun 19 Jan 2014 03:28:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43521981
Sun 19 Jan 2014 03:28:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:28:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43521981
Sun 19 Jan 2014 03:28:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:28:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:28:37 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:28:38 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:28:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:28:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 03:28:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 03:28:39 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:28:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9093 values 143347 bits 17918 bytes 
Sun 19 Jan 2014 03:28:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:28:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:28:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:28:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:28:47 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 03:28:47 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:28:47 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:28:47 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:28:47 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:28:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:28:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:28:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:28:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:28:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:28:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:28:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:28:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:28:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:28:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:28:51 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:28:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:28:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:28:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:28:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:28:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:28:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:28:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:28:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43516558
Sun 19 Jan 2014 03:28:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:28:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43516558
Sun 19 Jan 2014 03:28:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:29:02 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:29:02 - job_xml_thread(): Done retrieving: data size 43516558
Sun 19 Jan 2014 03:29:02 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:29:02 - XML: Start document: iteration 4
Sun 19 Jan 2014 03:29:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:29:03 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:29:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:29:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:29:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:29:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:29:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:29:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:29:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:29:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:29:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:29:15 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 03:29:15 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:29:15 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:29:15 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:29:15 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:29:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:29:16 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:29:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:29:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:29:16 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:29:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 03:29:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:29:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:29:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:29:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:29:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:29:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:29:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43415785
Sun 19 Jan 2014 03:29:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:29:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43415785
Sun 19 Jan 2014 03:29:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:29:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:29:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:29:22 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:29:23 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:29:24 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:29:24 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:29:24 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 03:29:24 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 03:29:24 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 03:29:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:29:28 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:29:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:29:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:29:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:29:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:29:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:29:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:29:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:29:30 - size of cluster 'LISA Cluster': 624 hosts 79471 metrics 980638 values 15462635 bits 1932829 bytes 
Sun 19 Jan 2014 03:29:30 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:29:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:29:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:29:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:29:34 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:29:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:29:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:29:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:29:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:29:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:29:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:29:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:29:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42998469
Sun 19 Jan 2014 03:29:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:29:37 - job_xml_thread(): Done retrieving: data size 42998469
Sun 19 Jan 2014 03:29:37 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:29:37 - XML: Start document: iteration 5
Sun 19 Jan 2014 03:29:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42998469
Sun 19 Jan 2014 03:29:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:29:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:29:39 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:29:40 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:29:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:29:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 03:29:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 03:29:40 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:29:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8996 values 141813 bits 17726 bytes 
Sun 19 Jan 2014 03:29:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:29:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:29:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:29:47 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:29:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:29:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:29:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:29:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:29:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:29:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:29:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:29:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:29:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:29:54 - XML: Processed 646236 elements - found 0 jobs
Sun 19 Jan 2014 03:29:54 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:29:54 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:29:55 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:29:55 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:29:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:29:58 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:29:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:29:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:29:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:29:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:29:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:29:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:30:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:30:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42853666
Sun 19 Jan 2014 03:30:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:30:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42853666
Sun 19 Jan 2014 03:30:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:30:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:30:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:30:10 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:30:10 - job_xml_thread(): Done retrieving: data size 42853666
Sun 19 Jan 2014 03:30:10 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:30:10 - XML: Start document: iteration 6
Sun 19 Jan 2014 03:30:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:30:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:30:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:30:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:30:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:30:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:30:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:30:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:30:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:30:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:30:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:30:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:30:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:30:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:30:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:30:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:30:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:30:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:30:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:30:23 - XML: Processed 644396 elements - found 0 jobs
Sun 19 Jan 2014 03:30:23 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:30:23 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:30:23 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:30:23 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:30:24 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:30:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 03:30:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:30:24 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:30:24 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 03:30:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:30:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42881746
Sun 19 Jan 2014 03:30:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:30:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42881746
Sun 19 Jan 2014 03:30:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:30:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:30:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:30:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:30:37 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:30:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:30:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:30:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:30:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:30:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:30:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:30:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:30:39 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:30:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:30:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:30:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:30:40 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:30:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:30:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:30:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:30:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:30:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:30:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:30:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:30:41 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:30:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:30:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 03:30:42 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:30:42 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:30:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5671 values 89377 bits 11172 bytes 
Sun 19 Jan 2014 03:30:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 03:30:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:30:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43406205
Sun 19 Jan 2014 03:30:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:30:44 - job_xml_thread(): Done retrieving: data size 43406205
Sun 19 Jan 2014 03:30:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43406205
Sun 19 Jan 2014 03:30:44 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:30:44 - XML: Start document: iteration 7
Sun 19 Jan 2014 03:30:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:30:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:30:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:30:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:30:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:31:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:31:00 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:31:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:31:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:31:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:31:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:31:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:31:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:31:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:31:04 - XML: Processed 651016 elements - found 0 jobs
Sun 19 Jan 2014 03:31:04 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:31:04 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:31:04 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:31:04 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:31:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:31:05 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:31:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:31:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:31:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:31:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:31:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:31:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:31:09 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:31:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 03:31:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:31:09 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 03:31:09 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 03:31:09 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:31:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:31:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43510439
Sun 19 Jan 2014 03:31:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:31:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43510439
Sun 19 Jan 2014 03:31:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:31:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:31:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:31:19 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:31:19 - job_xml_thread(): Done retrieving: data size 43510439
Sun 19 Jan 2014 03:31:19 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:31:19 - XML: Start document: iteration 8
Sun 19 Jan 2014 03:31:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:31:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:31:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:31:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:31:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:31:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:31:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:31:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:31:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:31:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:31:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:31:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:31:29 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:31:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:31:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:31:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:31:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:31:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:31:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:31:31 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 03:31:31 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:31:31 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:31:31 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:31:31 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:31:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:31:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43479100
Sun 19 Jan 2014 03:31:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:31:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43479100
Sun 19 Jan 2014 03:31:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:31:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:31:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:31:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:31:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:31:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:31:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:31:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:31:42 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:31:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:31:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:31:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43479100
Sun 19 Jan 2014 03:31:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:31:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:31:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:31:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:31:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 03:31:42 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:31:42 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:31:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 03:31:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6914 values 109252 bits 13656 bytes 
Sun 19 Jan 2014 03:31:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:31:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:31:46 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:31:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:31:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:31:53 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:31:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:31:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:31:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:31:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:31:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:31:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:31:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:31:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:31:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:31:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:31:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:31:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:31:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:31:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:31:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:31:58 - job_xml_thread(): Done retrieving: data size 43499035
Sun 19 Jan 2014 03:31:58 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:31:58 - XML: Start document: iteration 9
Sun 19 Jan 2014 03:31:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43499035
Sun 19 Jan 2014 03:31:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:31:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43499035
Sun 19 Jan 2014 03:31:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:32:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:32:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:32:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:32:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:32:17 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:32:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:32:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 03:32:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:32:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:32:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:32:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:32:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:32:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:32:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:32:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:32:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:32:21 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 03:32:21 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:32:22 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:32:22 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:32:22 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:32:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:32:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:32:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:32:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:32:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:32:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:32:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:32:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:32:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:32:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43526205
Sun 19 Jan 2014 03:32:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:32:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43526205
Sun 19 Jan 2014 03:32:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:32:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:32:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:32:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:32:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:32:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:32:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:32:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:32:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:32:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:32:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:32:37 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:32:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:32:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:32:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:32:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:32:39 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:32:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:32:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:32:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:32:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:32:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:32:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:32:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:32:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43536693
Sun 19 Jan 2014 03:32:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:32:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43536693
Sun 19 Jan 2014 03:32:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:32:42 - job_xml_thread(): Done retrieving: data size 43536693
Sun 19 Jan 2014 03:32:42 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:32:42 - XML: Start document: iteration 10
Sun 19 Jan 2014 03:32:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:32:42 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:32:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:32:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 03:32:46 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:32:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9235 values 146034 bits 18254 bytes 
Sun 19 Jan 2014 03:32:47 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:32:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 03:32:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:32:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:32:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:32:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:32:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:32:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:32:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:32:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:32:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:32:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:32:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:32:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:32:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:33:00 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 03:33:00 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:33:00 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:33:00 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:33:01 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:33:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:33:03 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:33:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:33:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:33:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:33:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:33:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:33:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:33:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:33:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43491447
Sun 19 Jan 2014 03:33:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:33:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43491447
Sun 19 Jan 2014 03:33:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:33:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:33:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:33:16 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:33:16 - job_xml_thread(): Done retrieving: data size 43491447
Sun 19 Jan 2014 03:33:16 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:33:16 - XML: Start document: iteration 11
Sun 19 Jan 2014 03:33:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:33:18 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:33:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:33:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:33:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:33:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:33:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:33:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:33:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:33:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:33:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:33:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:33:25 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:33:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:33:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:33:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:33:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:33:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:33:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:33:29 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 03:33:29 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:33:29 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:33:29 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:33:29 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:33:30 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:33:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 03:33:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:33:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:33:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43485540
Sun 19 Jan 2014 03:33:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:33:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43485540
Sun 19 Jan 2014 03:33:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:33:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:33:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:33:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:33:39 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:33:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:33:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:33:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:33:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:33:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:33:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:33:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43485540
Sun 19 Jan 2014 03:33:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:33:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:33:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:33:44 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:33:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:33:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:33:47 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:33:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:33:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 03:33:48 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:33:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5936 values 93833 bits 11729 bytes 
Sun 19 Jan 2014 03:33:48 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:33:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 03:33:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:33:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:33:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:33:51 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:33:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:33:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:33:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:33:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:33:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:33:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:33:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:33:54 - job_xml_thread(): Done retrieving: data size 43500997
Sun 19 Jan 2014 03:33:54 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:33:54 - XML: Start document: iteration 12
Sun 19 Jan 2014 03:33:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43500997
Sun 19 Jan 2014 03:33:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:33:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:33:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:33:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:33:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:33:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43500997
Sun 19 Jan 2014 03:33:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:33:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:33:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:34:06 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 03:34:07 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:34:07 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:34:07 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:34:07 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:34:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:34:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:34:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:34:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:34:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:34:14 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:34:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:34:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:34:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:34:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:34:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:34:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:34:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:34:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:34:16 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:34:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:34:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:34:17 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:34:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 03:34:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:34:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:34:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:34:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:34:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:34:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:34:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43504851
Sun 19 Jan 2014 03:34:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:34:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43504851
Sun 19 Jan 2014 03:34:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:34:22 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:34:22 - job_xml_thread(): Done retrieving: data size 43504851
Sun 19 Jan 2014 03:34:22 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:34:22 - XML: Start document: iteration 13
Sun 19 Jan 2014 03:34:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:34:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:34:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:34:31 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:34:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:34:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:34:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:34:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:34:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:34:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:34:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:34:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:34:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:34:33 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 03:34:33 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:34:33 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:34:33 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:34:33 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:34:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:34:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:34:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:34:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:34:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:34:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:34:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:34:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:34:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:34:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43516579
Sun 19 Jan 2014 03:34:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:34:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43516579
Sun 19 Jan 2014 03:34:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:34:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:34:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:34:48 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:34:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:34:48 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:34:48 - job_xml_thread(): Done retrieving: data size 43516579
Sun 19 Jan 2014 03:34:48 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:34:48 - XML: Start document: iteration 14
Sun 19 Jan 2014 03:34:50 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:34:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 03:34:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:34:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 03:34:51 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:34:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8931 values 140879 bits 17609 bytes 
Sun 19 Jan 2014 03:34:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:34:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:34:58 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 03:34:58 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:34:58 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:34:58 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:34:58 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:34:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:34:58 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:34:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:34:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:35:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:35:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:35:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:35:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:35:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:35:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:35:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:35:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:35:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:35:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:35:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:35:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:35:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:35:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:35:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43505507
Sun 19 Jan 2014 03:35:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:35:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43505507
Sun 19 Jan 2014 03:35:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:35:13 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:35:13 - job_xml_thread(): Done retrieving: data size 43505507
Sun 19 Jan 2014 03:35:13 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:35:13 - XML: Start document: iteration 15
Sun 19 Jan 2014 03:35:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:35:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:35:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:35:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:35:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:35:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:35:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:35:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:35:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:35:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:35:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:35:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:35:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:35:22 - XML: Processed 652387 elements - found 0 jobs
Sun 19 Jan 2014 03:35:22 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:35:22 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:35:22 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:35:22 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:35:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:35:26 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:35:26 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:35:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 03:35:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:35:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:35:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:35:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:35:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:35:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:35:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:35:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:35:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43436482
Sun 19 Jan 2014 03:35:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:35:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43436482
Sun 19 Jan 2014 03:35:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:35:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:35:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:35:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:35:37 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:35:37 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:35:37 - job_xml_thread(): Done retrieving: data size 43436482
Sun 19 Jan 2014 03:35:37 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:35:37 - XML: Start document: iteration 16
Sun 19 Jan 2014 03:35:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:35:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:35:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:35:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:35:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:35:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:35:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:35:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:35:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:35:46 - XML: Processed 651640 elements - found 0 jobs
Sun 19 Jan 2014 03:35:46 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:35:46 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:35:46 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:35:46 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:35:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:35:49 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:35:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:35:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:35:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:35:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:35:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:35:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:35:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:35:50 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:35:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:35:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42866374
Sun 19 Jan 2014 03:35:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:35:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42866374
Sun 19 Jan 2014 03:35:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:35:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 03:35:52 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:35:52 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:35:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:35:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 03:35:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9021 values 142286 bits 17785 bytes 
Sun 19 Jan 2014 03:35:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:35:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:36:01 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:36:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:36:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:36:03 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:36:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:36:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:36:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:36:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:36:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:36:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:36:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:36:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:36:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:36:05 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:36:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:36:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:36:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:36:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:36:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:36:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:36:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:36:08 - job_xml_thread(): Done retrieving: data size 42847682
Sun 19 Jan 2014 03:36:08 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:36:08 - XML: Start document: iteration 17
Sun 19 Jan 2014 03:36:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42847682
Sun 19 Jan 2014 03:36:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:36:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42847682
Sun 19 Jan 2014 03:36:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:36:19 - XML: Processed 644190 elements - found 0 jobs
Sun 19 Jan 2014 03:36:19 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:36:19 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:36:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:36:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:36:19 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:36:19 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:36:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:36:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:36:24 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 03:36:25 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:36:25 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:36:25 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:36:26 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 03:36:26 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 03:36:26 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 03:36:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:36:29 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:36:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:36:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:36:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:36:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:36:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:36:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:36:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:36:32 - size of cluster 'LISA Cluster': 624 hosts 79477 metrics 993638 values 15687497 bits 1960937 bytes 
Sun 19 Jan 2014 03:36:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:36:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:36:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:36:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:36:34 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:36:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 03:36:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:36:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:36:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:36:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:36:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:36:34 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:36:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:36:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43368645
Sun 19 Jan 2014 03:36:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:36:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43368645
Sun 19 Jan 2014 03:36:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:36:37 - job_xml_thread(): Done retrieving: data size 43368645
Sun 19 Jan 2014 03:36:38 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:36:38 - XML: Start document: iteration 18
Sun 19 Jan 2014 03:36:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:36:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:36:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:36:47 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:36:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:36:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:36:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:36:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:36:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:36:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:36:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:36:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:36:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:36:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:36:52 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:36:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:36:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 03:36:52 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:36:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5619 values 88558 bits 11069 bytes 
Sun 19 Jan 2014 03:36:52 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:36:53 - XML: Processed 650750 elements - found 0 jobs
Sun 19 Jan 2014 03:36:53 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:36:53 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:36:53 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:36:53 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:36:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 03:36:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:36:58 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:36:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:36:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:36:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:36:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:36:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:36:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:37:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:37:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43469249
Sun 19 Jan 2014 03:37:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:37:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43469249
Sun 19 Jan 2014 03:37:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:37:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:37:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:37:08 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:37:08 - job_xml_thread(): Done retrieving: data size 43469249
Sun 19 Jan 2014 03:37:08 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:37:08 - XML: Start document: iteration 19
Sun 19 Jan 2014 03:37:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:37:10 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:37:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:37:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:37:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:37:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:37:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:37:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:37:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:37:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:37:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:37:18 - XML: Processed 652016 elements - found 0 jobs
Sun 19 Jan 2014 03:37:18 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:37:18 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:37:18 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:37:18 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:37:19 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:37:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 03:37:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:37:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:37:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:37:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:37:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:37:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:37:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:37:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:37:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:37:26 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:37:26 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 03:37:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:37:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43483215
Sun 19 Jan 2014 03:37:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:37:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43483215
Sun 19 Jan 2014 03:37:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:37:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:37:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:37:33 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:37:33 - job_xml_thread(): Done retrieving: data size 43483215
Sun 19 Jan 2014 03:37:33 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:37:33 - XML: Start document: iteration 20
Sun 19 Jan 2014 03:37:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:37:37 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:37:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:37:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:37:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:37:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:37:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:37:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:37:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:37:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:37:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:37:47 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 03:37:47 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:37:47 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:37:47 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:37:47 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:37:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:37:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:37:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:37:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:37:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:37:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:37:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:37:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:37:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:37:53 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:37:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:37:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 03:37:53 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:37:53 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:37:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 03:37:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5964 values 94064 bits 11758 bytes 
Sun 19 Jan 2014 03:37:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:37:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:37:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:37:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43479592
Sun 19 Jan 2014 03:37:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:37:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43479592
Sun 19 Jan 2014 03:37:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:38:02 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:38:02 - job_xml_thread(): Done retrieving: data size 43479592
Sun 19 Jan 2014 03:38:02 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:38:02 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 03:38:02 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 03:38:02 - Housekeeping: done.
Sun 19 Jan 2014 03:38:02 - XML: Start document: iteration 0
Sun 19 Jan 2014 03:38:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:38:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:38:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:38:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:38:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:38:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:38:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:38:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:38:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:38:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:38:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:38:16 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 03:38:16 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:38:16 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:38:16 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:38:16 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:38:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:38:17 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:38:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:38:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:38:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:38:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:38:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:38:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:38:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:38:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43492922
Sun 19 Jan 2014 03:38:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:38:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43492922
Sun 19 Jan 2014 03:38:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:38:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:38:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:38:31 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:38:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:38:33 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:38:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 03:38:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:38:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:38:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:38:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:38:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:38:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:38:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:38:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:38:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:38:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:38:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:38:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:38:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:38:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:38:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:38:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:38:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:38:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:38:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:38:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:38:39 - job_xml_thread(): Done retrieving: data size 43514594
Sun 19 Jan 2014 03:38:39 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:38:39 - XML: Start document: iteration 1
Sun 19 Jan 2014 03:38:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43514594
Sun 19 Jan 2014 03:38:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:38:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43514594
Sun 19 Jan 2014 03:38:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:38:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:38:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:38:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:38:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:38:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:38:53 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:38:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:38:54 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:38:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 03:38:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 03:38:54 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:38:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6342 values 100039 bits 12504 bytes 
Sun 19 Jan 2014 03:38:56 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 03:38:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:38:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:38:56 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:38:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:38:56 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:38:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:38:56 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:38:56 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:38:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:38:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:38:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:38:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:38:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:39:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:39:03 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:39:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:39:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:39:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:39:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:39:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:39:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:39:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:39:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43498503
Sun 19 Jan 2014 03:39:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:39:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43498503
Sun 19 Jan 2014 03:39:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:39:11 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:39:11 - job_xml_thread(): Done retrieving: data size 43498503
Sun 19 Jan 2014 03:39:11 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:39:11 - XML: Start document: iteration 2
Sun 19 Jan 2014 03:39:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:39:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:39:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:39:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:39:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:39:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:39:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:39:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:39:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:39:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:39:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:39:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:39:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:39:28 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 03:39:28 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:39:28 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:39:28 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:39:28 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:39:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:39:31 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:39:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:39:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:39:31 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:39:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 03:39:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:39:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:39:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:39:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:39:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:39:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:39:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43478673
Sun 19 Jan 2014 03:39:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:39:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43478673
Sun 19 Jan 2014 03:39:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:39:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:39:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:39:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:39:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:39:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:39:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:39:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:39:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:39:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43478673
Sun 19 Jan 2014 03:39:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:39:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:39:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:39:44 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:39:44 - job_xml_thread(): Done retrieving: data size 43478673
Sun 19 Jan 2014 03:39:44 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:39:44 - XML: Start document: iteration 3
Sun 19 Jan 2014 03:39:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:39:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:39:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:39:54 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:39:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:39:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 03:39:55 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:39:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 03:39:55 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:39:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5542 values 87311 bits 10913 bytes 
Sun 19 Jan 2014 03:39:57 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 03:39:57 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:39:57 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:39:57 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:39:57 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:39:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:39:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:40:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:40:01 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:40:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:40:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:40:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:40:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:40:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:40:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:40:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:40:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:40:03 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:40:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:40:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:40:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:40:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:40:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:40:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:40:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:40:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43515320
Sun 19 Jan 2014 03:40:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:40:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43515320
Sun 19 Jan 2014 03:40:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:40:12 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:40:12 - job_xml_thread(): Done retrieving: data size 43515320
Sun 19 Jan 2014 03:40:12 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:40:12 - XML: Start document: iteration 4
Sun 19 Jan 2014 03:40:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:40:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:40:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:40:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:40:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:40:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:40:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:40:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:40:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:40:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:40:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:40:25 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:40:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 03:40:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:40:27 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 03:40:27 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:40:27 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:40:27 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:40:27 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:40:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:40:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:40:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:40:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:40:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:40:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:40:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:40:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:40:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:40:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43472160
Sun 19 Jan 2014 03:40:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:40:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:40:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:40:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43472160
Sun 19 Jan 2014 03:40:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:40:42 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:40:42 - job_xml_thread(): Done retrieving: data size 43472160
Sun 19 Jan 2014 03:40:42 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:40:42 - XML: Start document: iteration 5
Sun 19 Jan 2014 03:40:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:40:43 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:40:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:40:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:40:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:40:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:40:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:40:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:40:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:40:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:40:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:40:55 - XML: Processed 652387 elements - found 0 jobs
Sun 19 Jan 2014 03:40:55 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:40:55 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:40:55 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:40:55 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:40:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:40:55 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:40:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:40:57 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:40:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:40:57 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:40:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 03:40:57 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:40:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 03:40:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5530 values 87151 bits 10893 bytes 
Sun 19 Jan 2014 03:40:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:40:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:40:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:40:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:40:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:40:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:40:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:40:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:41:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:41:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43471982
Sun 19 Jan 2014 03:41:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:41:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43471982
Sun 19 Jan 2014 03:41:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:41:10 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:41:10 - job_xml_thread(): Done retrieving: data size 43471982
Sun 19 Jan 2014 03:41:10 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:41:10 - XML: Start document: iteration 6
Sun 19 Jan 2014 03:41:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:41:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:41:14 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:41:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 03:41:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:41:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:41:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:41:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:41:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:41:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:41:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:41:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:41:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:41:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:41:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:41:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:41:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:41:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:41:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:41:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:41:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:41:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:41:25 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 03:41:25 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:41:25 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:41:25 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:41:25 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:41:26 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 03:41:26 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 03:41:26 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:41:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:41:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43444797
Sun 19 Jan 2014 03:41:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:41:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43444797
Sun 19 Jan 2014 03:41:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:41:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:41:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:41:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:41:37 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:41:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:41:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:41:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:41:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:41:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:41:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:41:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:41:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:41:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:41:40 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:41:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:41:41 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:41:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:41:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:41:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:41:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:41:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:41:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:41:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:41:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42931152
Sun 19 Jan 2014 03:41:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:41:42 - job_xml_thread(): Done retrieving: data size 42931152
Sun 19 Jan 2014 03:41:42 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:41:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42931152
Sun 19 Jan 2014 03:41:42 - XML: Start document: iteration 7
Sun 19 Jan 2014 03:41:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:41:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:41:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:41:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:41:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:41:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:41:57 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:41:58 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:41:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 03:41:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:41:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 03:41:58 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:41:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9152 values 144347 bits 18043 bytes 
Sun 19 Jan 2014 03:42:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:42:01 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:42:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:42:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:42:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:42:01 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:42:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:42:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:42:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:42:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:42:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:42:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:42:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:42:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:42:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:42:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:42:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:42:03 - XML: Processed 645140 elements - found 0 jobs
Sun 19 Jan 2014 03:42:03 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:42:03 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:42:03 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:42:03 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:42:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:42:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42856337
Sun 19 Jan 2014 03:42:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:42:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42856337
Sun 19 Jan 2014 03:42:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:42:08 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:42:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 03:42:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:42:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:42:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:42:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:42:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:42:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:42:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:42:18 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:42:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:42:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:42:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:42:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:42:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:42:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:42:20 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:42:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:42:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:42:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:42:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:42:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:42:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:42:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:42:22 - job_xml_thread(): Done retrieving: data size 42928114
Sun 19 Jan 2014 03:42:22 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:42:22 - XML: Start document: iteration 8
Sun 19 Jan 2014 03:42:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42928114
Sun 19 Jan 2014 03:42:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42928114
Sun 19 Jan 2014 03:42:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:42:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:42:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:42:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:42:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:42:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:42:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:42:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:42:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:42:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:42:42 - XML: Processed 644940 elements - found 0 jobs
Sun 19 Jan 2014 03:42:42 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:42:42 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:42:42 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:42:42 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:42:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:42:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:42:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:42:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:42:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:42:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:42:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:42:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:42:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:42:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:42:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:42:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:42:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:42:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:42:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43380396
Sun 19 Jan 2014 03:42:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:42:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43380396
Sun 19 Jan 2014 03:42:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:42:57 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:42:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:42:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:42:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:42:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:42:57 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:42:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:42:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:42:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:42:58 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:42:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:42:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:42:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:42:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:42:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:42:58 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:42:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:42:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 03:42:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:42:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 03:42:59 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:42:59 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9416 values 148521 bits 18565 bytes 
Sun 19 Jan 2014 03:43:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:43:00 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:43:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:43:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:43:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:43:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:43:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:43:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:43:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:43:02 - job_xml_thread(): Done retrieving: data size 43495673
Sun 19 Jan 2014 03:43:02 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:43:02 - XML: Start document: iteration 9
Sun 19 Jan 2014 03:43:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43495673
Sun 19 Jan 2014 03:43:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:43:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43495673
Sun 19 Jan 2014 03:43:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:43:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:43:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:43:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:43:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:43:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:43:19 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:43:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:43:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:43:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:43:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:43:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:43:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:43:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:43:25 - XML: Processed 652378 elements - found 0 jobs
Sun 19 Jan 2014 03:43:25 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:43:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:43:25 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:43:25 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:43:25 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:43:25 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:43:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:43:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:43:26 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:43:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 03:43:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:43:26 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 03:43:26 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:43:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:43:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:43:26 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:43:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:43:26 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 03:43:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:43:26 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 03:43:26 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:43:26 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 03:43:27 - size of cluster 'LISA Cluster': 624 hosts 79484 metrics 827562 values 13049895 bits 1631236 bytes 
Sun 19 Jan 2014 03:43:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:43:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43509624
Sun 19 Jan 2014 03:43:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:43:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43509624
Sun 19 Jan 2014 03:43:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:43:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:43:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:43:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:43:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:43:41 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:43:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:43:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:43:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:43:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:43:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:43:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:43:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:43:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:43:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:43:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:43:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:43:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:43:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:43:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:43:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:43:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:43:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:43:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:43:46 - job_xml_thread(): Done retrieving: data size 43494582
Sun 19 Jan 2014 03:43:46 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:43:46 - XML: Start document: iteration 10
Sun 19 Jan 2014 03:43:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43494582
Sun 19 Jan 2014 03:43:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:43:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43494582
Sun 19 Jan 2014 03:43:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:43:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:43:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:43:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:43:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:43:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:43:59 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:43:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:43:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 03:43:59 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:43:59 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:43:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 03:44:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8918 values 140589 bits 17573 bytes 
Sun 19 Jan 2014 03:44:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:44:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:44:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:44:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:44:03 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 03:44:03 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:44:03 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:44:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:44:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:44:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:44:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:44:03 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:44:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:44:03 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:44:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:44:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:44:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:44:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:44:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:44:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:44:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:44:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:44:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:44:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43511491
Sun 19 Jan 2014 03:44:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:44:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43511491
Sun 19 Jan 2014 03:44:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:44:19 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:44:19 - job_xml_thread(): Done retrieving: data size 43511491
Sun 19 Jan 2014 03:44:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:44:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:44:19 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:44:19 - XML: Start document: iteration 11
Sun 19 Jan 2014 03:44:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:44:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:44:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:44:25 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:44:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:44:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:44:26 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:44:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:44:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:44:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:44:26 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 03:44:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:44:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:44:32 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 03:44:32 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:44:32 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:44:32 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:44:32 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:44:37 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:44:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 03:44:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:44:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:44:37 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:44:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:44:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:44:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:44:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:44:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:44:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:44:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:44:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43491896
Sun 19 Jan 2014 03:44:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:44:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43491896
Sun 19 Jan 2014 03:44:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:44:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:44:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:44:47 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:44:47 - job_xml_thread(): Done retrieving: data size 43491896
Sun 19 Jan 2014 03:44:47 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:44:48 - XML: Start document: iteration 12
Sun 19 Jan 2014 03:44:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:44:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:44:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:44:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:44:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:44:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:44:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:44:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:44:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:44:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:44:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:44:59 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 03:44:59 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:44:59 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:44:59 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:44:59 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:44:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:44:59 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:45:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:45:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 03:45:00 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:45:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 03:45:00 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:45:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5538 values 87262 bits 10907 bytes 
Sun 19 Jan 2014 03:45:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:45:04 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:45:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:45:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:45:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:45:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:45:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:45:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:45:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:45:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43484050
Sun 19 Jan 2014 03:45:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:45:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:45:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43484050
Sun 19 Jan 2014 03:45:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:45:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:45:14 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:45:14 - job_xml_thread(): Done retrieving: data size 43484050
Sun 19 Jan 2014 03:45:14 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:45:14 - XML: Start document: iteration 13
Sun 19 Jan 2014 03:45:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:45:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:45:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:45:28 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:45:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:45:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:45:28 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 03:45:28 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:45:28 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:45:28 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:45:28 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:45:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:45:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:45:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:45:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:45:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:45:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:45:31 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:45:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:45:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:45:31 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:45:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 03:45:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:45:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:45:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:45:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:45:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:45:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:45:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43505325
Sun 19 Jan 2014 03:45:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:45:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43505325
Sun 19 Jan 2014 03:45:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:45:43 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:45:43 - job_xml_thread(): Done retrieving: data size 43505325
Sun 19 Jan 2014 03:45:43 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:45:43 - XML: Start document: iteration 14
Sun 19 Jan 2014 03:45:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:45:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:45:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:45:45 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:45:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:45:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:45:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:45:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:45:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:45:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:45:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:45:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:45:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:45:52 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 03:45:52 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:45:52 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:45:52 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:45:52 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:45:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:45:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:45:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:45:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:45:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:45:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:45:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:45:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:45:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:45:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43508770
Sun 19 Jan 2014 03:45:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:45:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43508770
Sun 19 Jan 2014 03:45:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:46:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:46:00 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:46:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:46:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:46:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:46:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 03:46:01 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:46:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8537 values 134633 bits 16829 bytes 
Sun 19 Jan 2014 03:46:02 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:46:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 03:46:08 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:46:08 - job_xml_thread(): Done retrieving: data size 43508770
Sun 19 Jan 2014 03:46:08 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:46:08 - XML: Start document: iteration 15
Sun 19 Jan 2014 03:46:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:46:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:46:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:46:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:46:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:46:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:46:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:46:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:46:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:46:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:46:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:46:19 - XML: Processed 652389 elements - found 0 jobs
Sun 19 Jan 2014 03:46:19 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:46:19 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:46:19 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:46:19 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:46:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:46:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:46:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:46:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:46:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:46:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:46:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:46:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:46:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:46:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:46:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:46:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43484021
Sun 19 Jan 2014 03:46:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:46:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43484021
Sun 19 Jan 2014 03:46:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:46:34 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:46:34 - job_xml_thread(): Done retrieving: data size 43484021
Sun 19 Jan 2014 03:46:34 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:46:34 - XML: Start document: iteration 16
Sun 19 Jan 2014 03:46:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:46:37 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:46:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:46:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:46:37 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:46:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 03:46:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:46:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:46:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:46:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:46:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:46:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:46:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:46:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:46:49 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 03:46:49 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:46:49 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:46:49 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:46:49 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:46:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:46:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:46:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:46:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:46:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:46:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:46:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:46:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:46:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:46:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:46:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:46:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43487442
Sun 19 Jan 2014 03:46:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:46:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43487442
Sun 19 Jan 2014 03:46:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:47:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:47:01 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:47:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:47:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:47:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:47:02 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:47:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:47:03 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:47:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 03:47:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:47:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 03:47:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:47:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:47:03 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:47:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:47:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6142 values 97080 bits 12135 bytes 
Sun 19 Jan 2014 03:47:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43487442
Sun 19 Jan 2014 03:47:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:47:04 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:47:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:47:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:47:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:47:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:47:14 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:47:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:47:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:47:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:47:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:47:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:47:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:47:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:47:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:47:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:47:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:47:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:47:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:47:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:47:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:47:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:47:19 - job_xml_thread(): Done retrieving: data size 43417615
Sun 19 Jan 2014 03:47:19 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:47:19 - XML: Start document: iteration 17
Sun 19 Jan 2014 03:47:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43417615
Sun 19 Jan 2014 03:47:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:47:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43417615
Sun 19 Jan 2014 03:47:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:47:30 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:47:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 03:47:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:47:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:47:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:47:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:47:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:47:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:47:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:47:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:47:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:47:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:47:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:47:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:47:36 - XML: Processed 651640 elements - found 0 jobs
Sun 19 Jan 2014 03:47:36 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:47:36 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:47:36 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:47:36 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:47:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:47:41 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:47:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:47:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:47:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:47:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:47:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:47:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:47:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:47:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42905751
Sun 19 Jan 2014 03:47:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:47:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42905751
Sun 19 Jan 2014 03:47:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:47:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:47:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:47:51 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:47:51 - job_xml_thread(): Done retrieving: data size 42905751
Sun 19 Jan 2014 03:47:51 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:47:51 - XML: Start document: iteration 18
Sun 19 Jan 2014 03:47:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:47:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:47:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:47:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:47:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:47:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:47:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:47:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:47:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:47:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:47:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:48:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:48:03 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:48:04 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:48:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 03:48:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:48:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 03:48:04 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:48:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5911 values 93569 bits 11696 bytes 
Sun 19 Jan 2014 03:48:05 - XML: Processed 645240 elements - found 0 jobs
Sun 19 Jan 2014 03:48:05 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:48:05 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:48:05 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:48:05 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:48:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:48:07 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:48:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:48:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:48:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:48:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:48:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:48:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:48:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:48:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42846196
Sun 19 Jan 2014 03:48:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:48:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42846196
Sun 19 Jan 2014 03:48:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:48:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:48:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:48:20 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:48:20 - job_xml_thread(): Done retrieving: data size 42846196
Sun 19 Jan 2014 03:48:20 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:48:20 - XML: Start document: iteration 19
Sun 19 Jan 2014 03:48:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:48:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:48:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:48:30 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:48:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:48:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:48:30 - XML: Processed 644274 elements - found 0 jobs
Sun 19 Jan 2014 03:48:30 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:48:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:48:30 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:48:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:48:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:48:30 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:48:30 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:48:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:48:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:48:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:48:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:48:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:48:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:48:34 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:48:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 03:48:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:48:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:48:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:48:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:48:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:48:36 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 03:48:36 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 03:48:36 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:48:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:48:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43206647
Sun 19 Jan 2014 03:48:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:48:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43206647
Sun 19 Jan 2014 03:48:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:48:45 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:48:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:48:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:48:45 - job_xml_thread(): Done retrieving: data size 43206647
Sun 19 Jan 2014 03:48:45 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:48:45 - XML: Start document: iteration 20
Sun 19 Jan 2014 03:48:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:48:46 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:48:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:48:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:48:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:48:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:48:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:48:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:48:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:48:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:48:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:48:52 - XML: Processed 648582 elements - found 0 jobs
Sun 19 Jan 2014 03:48:52 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:48:52 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:48:52 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:48:52 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:48:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:48:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:48:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:48:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:48:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:48:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:48:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:48:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:48:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:48:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43481339
Sun 19 Jan 2014 03:48:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:48:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43481339
Sun 19 Jan 2014 03:48:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:49:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:49:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:49:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:49:04 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:49:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:49:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 03:49:05 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:49:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 03:49:05 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:49:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8868 values 140044 bits 17505 bytes 
Sun 19 Jan 2014 03:49:08 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:49:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:49:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:49:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:49:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:49:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:49:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:49:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:49:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:49:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:49:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:49:11 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:49:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:49:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:49:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:49:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:49:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:49:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:49:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:49:14 - job_xml_thread(): Done retrieving: data size 43488865
Sun 19 Jan 2014 03:49:14 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:49:14 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 03:49:14 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 03:49:14 - Housekeeping: done.
Sun 19 Jan 2014 03:49:14 - XML: Start document: iteration 0
Sun 19 Jan 2014 03:49:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43488865
Sun 19 Jan 2014 03:49:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43488865
Sun 19 Jan 2014 03:49:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:49:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:49:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:49:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:49:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:49:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:49:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:49:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:49:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:49:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:49:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:49:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:49:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:49:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:49:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:49:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:49:37 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:49:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:49:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:49:38 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 03:49:38 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:49:38 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:49:38 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:49:38 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:49:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:49:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:49:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:49:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:49:38 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:49:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 03:49:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:49:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:49:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43515627
Sun 19 Jan 2014 03:49:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:49:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43515627
Sun 19 Jan 2014 03:49:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:49:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:49:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:49:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:49:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:49:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:49:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:49:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:49:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:49:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:49:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:49:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:49:53 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:49:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:49:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:49:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:49:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:49:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:49:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:49:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:49:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:49:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:49:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:49:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:49:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43516630
Sun 19 Jan 2014 03:49:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:49:55 - job_xml_thread(): Done retrieving: data size 43516630
Sun 19 Jan 2014 03:49:55 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:49:55 - XML: Start document: iteration 1
Sun 19 Jan 2014 03:49:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43516630
Sun 19 Jan 2014 03:49:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:50:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:50:05 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:50:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:50:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:50:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:50:07 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:50:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 03:50:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 03:50:07 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:50:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8827 values 139211 bits 17401 bytes 
Sun 19 Jan 2014 03:50:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:50:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:50:11 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 03:50:11 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:50:11 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:50:11 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:50:12 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:50:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:50:13 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:50:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:50:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:50:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:50:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:50:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:50:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:50:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:50:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:50:16 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:50:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:50:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:50:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:50:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:50:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:50:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:50:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:50:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43516998
Sun 19 Jan 2014 03:50:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:50:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43516998
Sun 19 Jan 2014 03:50:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:50:26 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 03:50:26 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:50:27 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:50:27 - job_xml_thread(): Done retrieving: data size 43516998
Sun 19 Jan 2014 03:50:27 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:50:27 - XML: Start document: iteration 2
Sun 19 Jan 2014 03:50:28 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:50:28 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 03:50:28 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:50:28 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 03:50:28 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 03:50:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:50:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:50:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:50:30 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:50:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:50:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:50:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:50:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:50:32 - size of cluster 'LISA Cluster': 624 hosts 79467 metrics 740657 values 11698356 bits 1462294 bytes 
Sun 19 Jan 2014 03:50:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:50:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:50:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:50:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:50:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:50:33 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:50:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 03:50:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:50:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:50:39 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:50:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:50:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:50:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:50:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:50:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:50:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:50:42 - XML: Processed 652387 elements - found 0 jobs
Sun 19 Jan 2014 03:50:42 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:50:42 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:50:42 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:50:42 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:50:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:50:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43480874
Sun 19 Jan 2014 03:50:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:50:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43480874
Sun 19 Jan 2014 03:50:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:50:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:50:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:50:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:50:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:50:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:50:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:50:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:50:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:50:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:50:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:50:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:50:57 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:50:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:50:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:51:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:51:00 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:51:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:51:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:51:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:51:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:51:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:51:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:51:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:51:03 - job_xml_thread(): Done retrieving: data size 43508609
Sun 19 Jan 2014 03:51:03 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:51:03 - XML: Start document: iteration 3
Sun 19 Jan 2014 03:51:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43508609
Sun 19 Jan 2014 03:51:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:51:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43508609
Sun 19 Jan 2014 03:51:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:51:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:51:07 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:51:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:51:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 03:51:09 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:51:09 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:51:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9345 values 147416 bits 18427 bytes 
Sun 19 Jan 2014 03:51:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 03:51:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:51:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:51:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:51:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:51:21 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 03:51:21 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:51:21 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:51:21 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:51:21 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:51:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:51:22 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:51:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:51:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:51:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:51:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:51:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:51:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:51:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:51:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:51:26 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:51:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:51:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:51:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:51:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:51:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:51:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:51:28 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:51:28 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 03:51:29 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:51:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 03:51:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:51:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:51:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43489793
Sun 19 Jan 2014 03:51:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:51:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43489793
Sun 19 Jan 2014 03:51:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:51:36 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:51:37 - job_xml_thread(): Done retrieving: data size 43489793
Sun 19 Jan 2014 03:51:37 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:51:37 - XML: Start document: iteration 4
Sun 19 Jan 2014 03:51:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:51:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:51:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:51:39 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:51:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:51:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:51:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:51:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:51:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:51:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:51:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:51:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:51:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:51:50 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 03:51:50 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:51:50 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:51:50 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:51:50 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:51:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:51:51 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:51:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:51:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:51:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:51:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:51:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:51:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:51:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:51:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43490778
Sun 19 Jan 2014 03:51:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:51:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43490778
Sun 19 Jan 2014 03:51:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:51:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:51:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:52:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:52:04 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:52:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:52:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:52:05 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:52:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:52:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:52:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:52:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:52:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:52:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:52:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:52:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:52:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:52:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:52:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:52:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:52:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:52:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:52:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:52:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:52:11 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:52:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:52:11 - job_xml_thread(): Done retrieving: data size 43531960
Sun 19 Jan 2014 03:52:11 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:52:11 - XML: Start document: iteration 5
Sun 19 Jan 2014 03:52:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43531960
Sun 19 Jan 2014 03:52:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:52:12 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:52:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:52:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 03:52:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 03:52:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43531960
Sun 19 Jan 2014 03:52:12 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:52:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:52:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6943 values 109576 bits 13697 bytes 
Sun 19 Jan 2014 03:52:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:52:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:52:21 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 03:52:21 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:52:21 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:52:21 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:52:21 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:52:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:52:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:52:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:52:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:52:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:52:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:52:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:52:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:52:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:52:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:52:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:52:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:52:34 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:52:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:52:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:52:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:52:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:52:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:52:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:52:36 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:52:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:52:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43519351
Sun 19 Jan 2014 03:52:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:52:39 - job_xml_thread(): Done retrieving: data size 43519351
Sun 19 Jan 2014 03:52:39 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:52:39 - XML: Start document: iteration 6
Sun 19 Jan 2014 03:52:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43519351
Sun 19 Jan 2014 03:52:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:52:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:52:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:52:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:52:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:52:53 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:52:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 03:52:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:52:54 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 03:52:54 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:52:54 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:52:54 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:52:54 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:52:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:52:58 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:52:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:52:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:52:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:52:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:52:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:52:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:52:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:53:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:53:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:53:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:53:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:53:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:53:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:53:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:53:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:53:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:53:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43507162
Sun 19 Jan 2014 03:53:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:53:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43507162
Sun 19 Jan 2014 03:53:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:53:09 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:53:09 - job_xml_thread(): Done retrieving: data size 43507162
Sun 19 Jan 2014 03:53:09 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:53:09 - XML: Start document: iteration 7
Sun 19 Jan 2014 03:53:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:53:14 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:53:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:53:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:53:15 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:53:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:53:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 03:53:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 03:53:15 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:53:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6163 values 97228 bits 12153 bytes 
Sun 19 Jan 2014 03:53:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:53:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:53:21 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 03:53:21 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:53:21 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:53:21 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:53:21 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:53:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:53:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:53:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:53:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:53:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:53:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:53:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:53:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:53:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:53:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:53:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:53:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:53:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:53:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:53:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:53:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:53:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:53:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:53:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43108964
Sun 19 Jan 2014 03:53:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:53:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43108964
Sun 19 Jan 2014 03:53:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:53:36 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:53:36 - job_xml_thread(): Done retrieving: data size 43108964
Sun 19 Jan 2014 03:53:36 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:53:36 - XML: Start document: iteration 8
Sun 19 Jan 2014 03:53:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:53:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:53:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:53:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:53:49 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:53:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 03:53:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:53:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:53:55 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:53:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:53:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:53:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:53:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:53:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:53:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:53:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:53:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:53:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:53:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:53:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:53:57 - XML: Processed 647658 elements - found 0 jobs
Sun 19 Jan 2014 03:53:57 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:53:57 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:53:57 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:53:57 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:53:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:53:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:53:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:53:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:54:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:54:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42846563
Sun 19 Jan 2014 03:54:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:54:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42846563
Sun 19 Jan 2014 03:54:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:54:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:54:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:54:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:54:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:54:12 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:54:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:54:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:54:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:54:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:54:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:54:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:54:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:54:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:54:15 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:54:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:54:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:54:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:54:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:54:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:54:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:54:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:54:15 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:54:16 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:54:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:54:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 03:54:16 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:54:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 03:54:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6105 values 96270 bits 12033 bytes 
Sun 19 Jan 2014 03:54:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:54:18 - job_xml_thread(): Done retrieving: data size 42901376
Sun 19 Jan 2014 03:54:18 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:54:18 - XML: Start document: iteration 9
Sun 19 Jan 2014 03:54:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42901376
Sun 19 Jan 2014 03:54:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:54:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42901376
Sun 19 Jan 2014 03:54:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:54:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:54:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:54:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:54:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:54:35 - XML: Processed 644904 elements - found 0 jobs
Sun 19 Jan 2014 03:54:35 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:54:35 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:54:35 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:54:35 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:54:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:54:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:54:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:54:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:54:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:54:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:54:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:54:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:54:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:54:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:54:41 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:54:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:54:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:54:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:54:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:54:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:54:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:54:42 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:54:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 03:54:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:54:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:54:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43435839
Sun 19 Jan 2014 03:54:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:54:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43435839
Sun 19 Jan 2014 03:54:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:54:50 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:54:50 - job_xml_thread(): Done retrieving: data size 43435839
Sun 19 Jan 2014 03:54:51 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:54:51 - XML: Start document: iteration 10
Sun 19 Jan 2014 03:54:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:54:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:54:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:54:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:54:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:54:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:54:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:54:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:54:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:54:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:54:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:54:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:54:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:55:00 - XML: Processed 651598 elements - found 0 jobs
Sun 19 Jan 2014 03:55:00 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:55:00 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:55:00 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:55:00 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:55:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:55:04 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:55:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:55:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:55:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:55:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:55:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:55:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:55:05 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 03:55:05 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 03:55:05 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:55:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:55:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43495549
Sun 19 Jan 2014 03:55:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:55:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43495549
Sun 19 Jan 2014 03:55:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:55:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:55:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:55:16 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:55:16 - job_xml_thread(): Done retrieving: data size 43495549
Sun 19 Jan 2014 03:55:16 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:55:16 - XML: Start document: iteration 11
Sun 19 Jan 2014 03:55:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:55:16 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:55:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:55:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:55:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:55:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:55:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:55:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:55:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:55:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:55:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:55:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:55:17 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:55:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 03:55:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 03:55:17 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:55:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7640 values 120487 bits 15060 bytes 
Sun 19 Jan 2014 03:55:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:55:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:55:25 - XML: Processed 652387 elements - found 0 jobs
Sun 19 Jan 2014 03:55:25 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:55:25 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:55:25 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:55:25 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:55:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:55:28 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:55:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:55:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:55:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:55:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:55:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:55:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:55:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:55:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43473442
Sun 19 Jan 2014 03:55:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:55:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43473442
Sun 19 Jan 2014 03:55:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:55:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:55:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:55:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:55:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:55:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:55:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:55:40 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:55:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:55:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:55:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:55:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:55:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:55:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:55:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:55:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:55:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:55:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:55:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:55:44 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:55:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 03:55:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:55:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:55:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:55:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:55:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:55:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:55:46 - job_xml_thread(): Done retrieving: data size 43487559
Sun 19 Jan 2014 03:55:46 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:55:46 - XML: Start document: iteration 12
Sun 19 Jan 2014 03:55:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43487559
Sun 19 Jan 2014 03:55:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43487559
Sun 19 Jan 2014 03:55:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:55:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:55:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:55:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:56:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:56:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:56:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:56:03 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:56:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:56:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:56:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:56:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:56:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:56:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:56:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:56:07 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 03:56:07 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:56:07 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:56:07 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:56:07 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:56:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:56:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:56:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:56:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:56:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:56:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:56:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:56:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:56:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:56:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43528963
Sun 19 Jan 2014 03:56:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:56:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43528963
Sun 19 Jan 2014 03:56:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:56:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:56:17 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:56:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:56:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 03:56:18 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:56:18 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:56:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 03:56:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9008 values 142069 bits 17758 bytes 
Sun 19 Jan 2014 03:56:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:56:18 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:56:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:56:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:56:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:56:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:56:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:56:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:56:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:56:22 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:56:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:56:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:56:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:56:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:56:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:56:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:56:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:56:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:56:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:56:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43533054
Sun 19 Jan 2014 03:56:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:56:25 - job_xml_thread(): Done retrieving: data size 43533054
Sun 19 Jan 2014 03:56:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43533054
Sun 19 Jan 2014 03:56:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:56:25 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:56:25 - XML: Start document: iteration 13
Sun 19 Jan 2014 03:56:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:56:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:56:37 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:56:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 03:56:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:56:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:56:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:56:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:56:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:56:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:56:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:56:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:56:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:56:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:56:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:56:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Exception in thread parsethread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1689, in parseThread
    xml.sax.parseString( my_data, self.myXMLHandler, self.myXMLError )
  File "/usr/lib/python2.6/xml/sax/__init__.py", line 49, in parseString
    parser.parse(inpsrc)
  File "/usr/lib/python2.6/xml/sax/expatreader.py", line 107, in parse
    xmlreader.IncrementalParser.parse(self, source)
  File "/usr/lib/python2.6/xml/sax/xmlreader.py", line 123, in parse
    self.feed(buffer)
  File "/usr/lib/python2.6/xml/sax/expatreader.py", line 207, in feed
    self._parser.Parse(data, isFinal)
  File "/usr/lib/python2.6/xml/sax/expatreader.py", line 301, in start_element
    self._cont_handler.startElement(name, AttributesImpl(attrs))
  File "./jobarchived.py", line 1311, in startElement
    self.rrd_handler.memMetric( self.hostName, { 'name': attrs.get( 'NAME', "" ), 'val': attrs.get( 'VAL',  "" ), 'time': self.hostReported } )
  File "./jobarchived.py", line 1912, in memMetric
    self.myMetrics[ host ][ metric['name'] ].append( metric )
KeyError: u'boottime'

Sun 19 Jan 2014 03:56:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:56:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:56:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:56:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:56:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:56:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:56:42 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 03:56:42 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:56:42 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:56:42 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:56:42 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:56:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:56:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43514998
Sun 19 Jan 2014 03:56:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:56:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43514998
Sun 19 Jan 2014 03:56:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:56:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:56:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:56:54 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:56:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:56:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:56:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:56:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:56:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:56:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:56:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:56:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:56:57 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:56:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:56:58 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:56:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:56:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:56:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:56:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:56:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:56:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:56:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:56:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43511841
Sun 19 Jan 2014 03:56:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:57:00 - job_xml_thread(): Done retrieving: data size 43511841
Sun 19 Jan 2014 03:57:00 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:57:00 - XML: Start document: iteration 14
Sun 19 Jan 2014 03:57:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43511841
Sun 19 Jan 2014 03:57:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:57:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:57:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:57:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:57:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:57:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:57:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:57:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:57:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:57:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:57:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:57:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:57:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:57:19 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:57:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:57:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 03:57:20 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:57:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 03:57:20 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:57:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9335 values 147261 bits 18407 bytes 
Sun 19 Jan 2014 03:57:20 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 03:57:20 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:57:20 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:57:20 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:57:20 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:57:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:57:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:57:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:57:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:57:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:57:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:57:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:57:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:57:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:57:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43489957
Sun 19 Jan 2014 03:57:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:57:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43489957
Sun 19 Jan 2014 03:57:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:57:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:57:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:57:29 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 03:57:29 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:57:30 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:57:30 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 03:57:30 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 03:57:30 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:57:30 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 03:57:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:57:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:57:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:57:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:57:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:57:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:57:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:57:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43489957
Sun 19 Jan 2014 03:57:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:57:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:57:35 - size of cluster 'LISA Cluster': 624 hosts 79471 metrics 697671 values 11004735 bits 1375591 bytes 
Sun 19 Jan 2014 03:57:35 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:57:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:57:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:57:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:57:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:57:47 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:57:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:57:47 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:57:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:57:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:57:48 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:57:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 03:57:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:57:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:57:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:57:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:57:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:57:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:57:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:57:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:57:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:57:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:57:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:57:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:57:50 - job_xml_thread(): Done retrieving: data size 43482900
Sun 19 Jan 2014 03:57:50 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:57:50 - XML: Start document: iteration 15
Sun 19 Jan 2014 03:57:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43482900
Sun 19 Jan 2014 03:57:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:57:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43482900
Sun 19 Jan 2014 03:57:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:58:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:58:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:58:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:58:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:58:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:58:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:58:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:58:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:58:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:58:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:58:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:58:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:58:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:58:13 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 03:58:13 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:58:13 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:58:13 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:58:13 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:58:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:58:14 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:58:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:58:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:58:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:58:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:58:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:58:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:58:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:58:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43505542
Sun 19 Jan 2014 03:58:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:58:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43505542
Sun 19 Jan 2014 03:58:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:58:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:58:20 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:58:21 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:58:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 03:58:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:58:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 03:58:21 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:58:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8819 values 139059 bits 17382 bytes 
Sun 19 Jan 2014 03:58:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:58:27 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:58:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:58:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:58:28 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:58:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:58:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:58:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:58:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:58:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:58:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:58:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:58:30 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:58:30 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 03:58:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:58:32 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:58:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:58:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:58:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:58:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:58:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:58:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:58:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:58:35 - job_xml_thread(): Done retrieving: data size 43506068
Sun 19 Jan 2014 03:58:35 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:58:35 - XML: Start document: iteration 16
Sun 19 Jan 2014 03:58:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43506068
Sun 19 Jan 2014 03:58:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:58:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43506068
Sun 19 Jan 2014 03:58:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:58:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:58:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:58:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:58:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:58:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:58:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:58:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:58:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:58:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:58:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:58:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:58:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:58:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:58:59 - XML: Processed 652390 elements - found 0 jobs
Sun 19 Jan 2014 03:58:59 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:58:59 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:58:59 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:58:59 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:59:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:59:00 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:59:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:59:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:59:00 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:59:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 03:59:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:59:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:59:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:59:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:59:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:59:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:59:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573356
Sun 19 Jan 2014 03:59:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:59:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573356
Sun 19 Jan 2014 03:59:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:59:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:59:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:59:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:59:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:59:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:59:14 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 03:59:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:59:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:59:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:59:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:59:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:59:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:59:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:59:16 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:59:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:59:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:59:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:59:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:59:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:59:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:59:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:59:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43497330
Sun 19 Jan 2014 03:59:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:59:20 - job_xml_thread(): Done retrieving: data size 43497330
Sun 19 Jan 2014 03:59:20 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 03:59:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43497330
Sun 19 Jan 2014 03:59:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 03:59:20 - XML: Start document: iteration 17
Sun 19 Jan 2014 03:59:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:59:21 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:59:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:59:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 03:59:21 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 03:59:21 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:59:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 03:59:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5940 values 93672 bits 11709 bytes 
Sun 19 Jan 2014 03:59:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:59:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:59:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 03:59:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:59:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 03:59:36 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 03:59:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 03:59:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 03:59:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:59:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 03:59:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 03:59:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 03:59:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 03:59:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 03:59:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 03:59:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 03:59:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 03:59:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:59:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 03:59:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 03:59:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 03:59:46 - XML: Processed 652600 elements - found 0 jobs
Sun 19 Jan 2014 03:59:46 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 03:59:46 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 03:59:46 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 03:59:46 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 03:59:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 03:59:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 03:59:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 03:59:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42947608
Sun 19 Jan 2014 03:59:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 03:59:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42947608
Sun 19 Jan 2014 03:59:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:00:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:00:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:00:01 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:00:02 - job_xml_thread(): Done retrieving: data size 42947608
Sun 19 Jan 2014 04:00:02 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:00:02 - XML: Start document: iteration 18
Sun 19 Jan 2014 04:00:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:00:14 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:00:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:00:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:00:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:00:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:00:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:00:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:00:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:00:18 - XML: Processed 645994 elements - found 0 jobs
Sun 19 Jan 2014 04:00:18 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:00:18 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:00:18 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:00:18 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:00:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:00:19 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:00:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:00:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:00:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:00:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:00:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:00:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:00:19 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:00:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 04:00:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:00:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:00:21 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:00:22 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:00:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:00:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 04:00:22 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:00:22 - size of cluster 'Render Cluster': 20 hosts 3135 metrics 2515 values 39593 bits 4949 bytes 
Sun 19 Jan 2014 04:00:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 04:00:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:00:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42970568
Sun 19 Jan 2014 04:00:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:00:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42970568
Sun 19 Jan 2014 04:00:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:00:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:00:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:00:33 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:00:33 - job_xml_thread(): Done retrieving: data size 42970568
Sun 19 Jan 2014 04:00:33 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:00:33 - XML: Start document: iteration 19
Sun 19 Jan 2014 04:00:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:00:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:00:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:00:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:00:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:00:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:00:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:00:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:00:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:00:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:00:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:00:48 - XML: Processed 645900 elements - found 0 jobs
Sun 19 Jan 2014 04:00:48 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:00:48 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:00:48 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:00:48 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:00:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:00:49 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:00:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:00:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:00:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:00:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:00:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:00:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:00:52 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:00:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 04:00:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:00:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:00:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43499443
Sun 19 Jan 2014 04:00:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:00:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:00:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:00:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43499443
Sun 19 Jan 2014 04:00:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:01:03 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:01:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:01:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:01:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:01:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:01:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:01:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:01:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:01:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:01:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:01:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:01:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:01:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:01:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:01:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:01:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:01:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:01:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:01:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:01:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:01:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:01:10 - job_xml_thread(): Done retrieving: data size 43582140
Sun 19 Jan 2014 04:01:10 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:01:10 - XML: Start document: iteration 20
Sun 19 Jan 2014 04:01:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582140
Sun 19 Jan 2014 04:01:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:01:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582140
Sun 19 Jan 2014 04:01:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:01:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:01:22 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:01:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:01:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:01:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:01:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:01:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:01:24 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:01:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 04:01:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 04:01:24 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:01:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6957 values 109863 bits 13732 bytes 
Sun 19 Jan 2014 04:01:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:01:28 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:01:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:01:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:01:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:01:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:01:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:01:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:01:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:01:31 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 04:01:31 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:01:31 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:01:31 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:01:31 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:01:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:01:34 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:01:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:01:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:01:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:01:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:01:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:01:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:01:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:01:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563347
Sun 19 Jan 2014 04:01:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:01:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563347
Sun 19 Jan 2014 04:01:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:01:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:01:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:01:46 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:01:46 - job_xml_thread(): Done retrieving: data size 43563347
Sun 19 Jan 2014 04:01:46 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:01:46 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 04:01:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:01:47 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:01:47 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 04:01:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:01:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:01:47 - Housekeeping: done.
Sun 19 Jan 2014 04:01:47 - XML: Start document: iteration 0
Sun 19 Jan 2014 04:01:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:01:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:01:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:01:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:01:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:01:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:01:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:01:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:01:52 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:01:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:01:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:01:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:01:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:01:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:01:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:01:57 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 04:01:57 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:01:57 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:01:57 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:01:57 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:01:57 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:01:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 04:01:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:01:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:01:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573052
Sun 19 Jan 2014 04:01:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:02:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573052
Sun 19 Jan 2014 04:02:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:02:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:02:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:02:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:02:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:02:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:02:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:02:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:02:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:02:13 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:02:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:02:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:02:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:02:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:02:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:02:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:02:20 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:02:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:02:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:02:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:02:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:02:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:02:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:02:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:02:23 - job_xml_thread(): Done retrieving: data size 43566021
Sun 19 Jan 2014 04:02:23 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:02:23 - XML: Start document: iteration 1
Sun 19 Jan 2014 04:02:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566021
Sun 19 Jan 2014 04:02:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566021
Sun 19 Jan 2014 04:02:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:02:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:02:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:02:24 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:02:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:02:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 04:02:26 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:02:26 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:02:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 04:02:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6236 values 98609 bits 12326 bytes 
Sun 19 Jan 2014 04:02:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:02:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:02:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:02:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:02:38 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 04:02:38 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:02:38 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:02:38 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:02:38 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:02:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:02:47 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:02:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:02:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:02:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:02:47 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:02:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:02:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:02:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:02:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:02:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:02:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:02:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:02:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:02:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:02:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:02:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:02:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:02:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581131
Sun 19 Jan 2014 04:02:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:02:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581131
Sun 19 Jan 2014 04:02:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:02:54 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:02:54 - job_xml_thread(): Done retrieving: data size 43581131
Sun 19 Jan 2014 04:02:54 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:02:54 - XML: Start document: iteration 2
Sun 19 Jan 2014 04:03:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:03:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:03:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:03:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:03:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:03:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:03:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:03:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:03:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:03:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:03:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:03:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:03:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:03:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:03:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:03:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:03:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:03:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:03:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:03:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:03:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:03:14 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 04:03:14 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:03:14 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:03:14 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:03:14 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:03:15 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:03:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 04:03:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:03:17 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 04:03:17 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 04:03:17 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:03:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:03:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574113
Sun 19 Jan 2014 04:03:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:03:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574113
Sun 19 Jan 2014 04:03:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:03:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:03:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:03:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:03:26 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:03:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:03:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 04:03:26 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:03:26 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:03:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 04:03:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5962 values 94292 bits 11786 bytes 
Sun 19 Jan 2014 04:03:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:03:27 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:03:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:03:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:03:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:03:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:03:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:03:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:03:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:03:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:03:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:03:29 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:03:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:03:31 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:03:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:03:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:03:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:03:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:03:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:03:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:03:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:03:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568663
Sun 19 Jan 2014 04:03:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:03:34 - job_xml_thread(): Done retrieving: data size 43568663
Sun 19 Jan 2014 04:03:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568663
Sun 19 Jan 2014 04:03:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:03:34 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:03:34 - XML: Start document: iteration 3
Sun 19 Jan 2014 04:03:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:03:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:03:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:03:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:03:50 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 04:03:50 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:03:50 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:03:50 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:03:50 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:03:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:03:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:03:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:03:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:03:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:03:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:03:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:03:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:03:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:03:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:03:57 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:03:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:03:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:03:57 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:03:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 04:03:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:03:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:03:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:03:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:03:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:03:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:03:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43597958
Sun 19 Jan 2014 04:03:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:03:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43597958
Sun 19 Jan 2014 04:03:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:04:05 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:04:05 - job_xml_thread(): Done retrieving: data size 43597958
Sun 19 Jan 2014 04:04:05 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:04:05 - XML: Start document: iteration 4
Sun 19 Jan 2014 04:04:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:04:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:04:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:04:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:04:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:04:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:04:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:04:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:04:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:04:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:04:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:04:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:04:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:04:16 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 04:04:16 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:04:16 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:04:16 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:04:16 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:04:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:04:19 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:04:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:04:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:04:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:04:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:04:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:04:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:04:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:04:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556496
Sun 19 Jan 2014 04:04:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:04:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556496
Sun 19 Jan 2014 04:04:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:04:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:04:27 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:04:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:04:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:04:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:04:28 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:04:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 04:04:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 04:04:28 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:04:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8845 values 139467 bits 17433 bytes 
Sun 19 Jan 2014 04:04:30 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 04:04:30 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:04:31 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:04:31 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:04:32 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 04:04:32 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 04:04:32 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:04:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:04:32 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 04:04:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sun 19 Jan 2014 04:04:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:04:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:04:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:04:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:04:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:04:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:04:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:04:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:04:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:04:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:04:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:04:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:04:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:04:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:04:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:04:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:04:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:04:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:04:39 - job_xml_thread(): Done retrieving: data size 43578048
Sun 19 Jan 2014 04:04:39 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:04:39 - XML: Start document: iteration 5
Sun 19 Jan 2014 04:04:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578048
Sun 19 Jan 2014 04:04:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:04:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578048
Sun 19 Jan 2014 04:04:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:04:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:04:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:04:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:04:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:04:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:04:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:04:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:04:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:04:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:04:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:04:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:04:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:04:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:05:01 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 04:05:01 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:05:01 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:05:01 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:05:01 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:05:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:05:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:05:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:05:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:05:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:05:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:05:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:05:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:05:02 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:05:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 04:05:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:05:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:05:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562708
Sun 19 Jan 2014 04:05:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:05:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562708
Sun 19 Jan 2014 04:05:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:05:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:05:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:05:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:05:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:05:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:05:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:05:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:05:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:05:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:05:16 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:05:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:05:17 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:05:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:05:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:05:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:05:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:05:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:05:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:05:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:05:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43506758
Sun 19 Jan 2014 04:05:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:05:19 - job_xml_thread(): Done retrieving: data size 43506758
Sun 19 Jan 2014 04:05:20 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:05:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43506758
Sun 19 Jan 2014 04:05:20 - XML: Start document: iteration 6
Sun 19 Jan 2014 04:05:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:05:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:05:28 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:05:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:05:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:05:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:05:30 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:05:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 04:05:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 04:05:30 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:05:32 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:05:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8672 values 136720 bits 17090 bytes 
Sun 19 Jan 2014 04:05:32 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:05:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:05:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:05:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:05:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:05:34 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:05:35 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:05:35 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 04:05:35 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 04:05:35 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 04:05:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:05:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:05:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:05:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:05:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:05:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:05:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:05:39 - XML: Processed 652600 elements - found 0 jobs
Sun 19 Jan 2014 04:05:39 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:05:39 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:05:39 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:05:39 - job_xml_thread(): Sleeping.. (15s)
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sun 19 Jan 2014 04:05:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:05:42 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:05:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:05:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:05:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:05:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:05:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:05:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:05:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:05:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43008458
Sun 19 Jan 2014 04:05:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:05:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43008458
Sun 19 Jan 2014 04:05:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:05:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:05:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:05:55 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:05:55 - job_xml_thread(): Done retrieving: data size 43008458
Sun 19 Jan 2014 04:05:55 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:05:55 - XML: Start document: iteration 7
Sun 19 Jan 2014 04:05:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:05:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:05:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:05:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:05:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:05:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:05:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:05:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:05:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:05:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:05:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:06:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:06:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:06:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:06:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:06:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:06:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:06:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:06:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:06:05 - XML: Processed 646272 elements - found 0 jobs
Sun 19 Jan 2014 04:06:05 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:06:05 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:06:05 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:06:05 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:06:05 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:06:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 04:06:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:06:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:06:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42891139
Sun 19 Jan 2014 04:06:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:06:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42891139
Sun 19 Jan 2014 04:06:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:06:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:06:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:06:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:06:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:06:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:06:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:06:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:06:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:06:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:06:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:06:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:06:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:06:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:06:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:06:20 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:06:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:06:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:06:20 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:06:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:06:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:06:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:06:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:06:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:06:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42985874
Sun 19 Jan 2014 04:06:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:06:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42985874
Sun 19 Jan 2014 04:06:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:06:22 - job_xml_thread(): Done retrieving: data size 42985874
Sun 19 Jan 2014 04:06:23 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:06:23 - XML: Start document: iteration 8
Sun 19 Jan 2014 04:06:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:06:30 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:06:32 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:06:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 04:06:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:06:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 04:06:33 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:06:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:06:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:06:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8829 values 139197 bits 17399 bytes 
Sun 19 Jan 2014 04:06:35 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:06:35 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:06:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:06:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:06:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:06:35 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:06:35 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:06:35 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 04:06:35 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 04:06:35 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 04:06:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:06:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:06:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:06:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:06:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:06:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:06:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:06:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sun 19 Jan 2014 04:06:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:06:41 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:06:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:06:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:06:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:06:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:06:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:06:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:06:43 - XML: Processed 645900 elements - found 0 jobs
Sun 19 Jan 2014 04:06:43 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:06:43 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:06:43 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:06:43 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:06:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:06:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43466156
Sun 19 Jan 2014 04:06:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:06:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43466156
Sun 19 Jan 2014 04:06:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:06:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:06:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:06:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:06:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:06:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:06:58 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:06:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:06:58 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:06:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:06:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:06:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:06:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:06:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:06:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:07:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:07:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:07:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:07:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:07:02 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:07:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 04:07:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:07:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:07:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:07:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:07:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:07:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:07:04 - job_xml_thread(): Done retrieving: data size 43564517
Sun 19 Jan 2014 04:07:04 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:07:04 - XML: Start document: iteration 9
Sun 19 Jan 2014 04:07:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564517
Sun 19 Jan 2014 04:07:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:07:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564517
Sun 19 Jan 2014 04:07:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:07:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:07:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:07:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:07:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:07:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:07:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:07:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:07:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:07:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:07:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:07:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:07:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:07:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:07:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:07:25 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:07:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:07:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:07:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:07:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:07:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:07:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:07:27 - XML: Processed 653288 elements - found 0 jobs
Sun 19 Jan 2014 04:07:27 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:07:27 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:07:27 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:07:27 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:07:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:07:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558123
Sun 19 Jan 2014 04:07:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:07:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558123
Sun 19 Jan 2014 04:07:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:07:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:07:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:07:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:07:33 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:07:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:07:35 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:07:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 04:07:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 04:07:35 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:07:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9011 values 142144 bits 17768 bytes 
Sun 19 Jan 2014 04:07:36 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:07:36 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:07:37 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:07:37 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:07:37 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 04:07:37 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 04:07:37 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 04:07:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:07:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:07:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:07:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:07:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:07:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:07:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:07:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:07:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:07:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:07:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:07:42 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:07:43 - size of cluster 'LISA Cluster': 624 hosts 79485 metrics 1458603 values 23017730 bits 2877216 bytes 
Sun 19 Jan 2014 04:07:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:07:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:07:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:07:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:07:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:07:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:07:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:07:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:07:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:07:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43546146
Sun 19 Jan 2014 04:07:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:07:51 - job_xml_thread(): Done retrieving: data size 43546146
Sun 19 Jan 2014 04:07:51 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:07:51 - XML: Start document: iteration 10
Sun 19 Jan 2014 04:07:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43546146
Sun 19 Jan 2014 04:07:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:07:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:07:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:08:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:08:00 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:08:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:08:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:08:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:08:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:08:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:08:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:08:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:08:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:08:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:08:07 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 04:08:07 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:08:07 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:08:07 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:08:07 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:08:09 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:08:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 04:08:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:08:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:08:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:08:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:08:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:08:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:08:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:08:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:08:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:08:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:08:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564168
Sun 19 Jan 2014 04:08:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:08:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564168
Sun 19 Jan 2014 04:08:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:08:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:08:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:08:23 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:08:23 - job_xml_thread(): Done retrieving: data size 43564168
Sun 19 Jan 2014 04:08:23 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:08:23 - XML: Start document: iteration 11
Sun 19 Jan 2014 04:08:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:08:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:08:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:08:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:08:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:08:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:08:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:08:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:08:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:08:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:08:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:08:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:08:35 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:08:35 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:08:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 04:08:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:08:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 04:08:35 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:08:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5868 values 92573 bits 11571 bytes 
Sun 19 Jan 2014 04:08:36 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 04:08:36 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:08:36 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:08:36 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:08:36 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:08:37 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:08:37 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 04:08:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:08:40 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:08:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:08:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:08:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:08:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:08:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:08:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:08:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:08:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574926
Sun 19 Jan 2014 04:08:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:08:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574926
Sun 19 Jan 2014 04:08:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:08:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:08:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:08:51 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:08:51 - job_xml_thread(): Done retrieving: data size 43574926
Sun 19 Jan 2014 04:08:51 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:08:51 - XML: Start document: iteration 12
Sun 19 Jan 2014 04:08:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:08:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:09:03 - XML: Processed 653347 elements - found 0 jobs
Sun 19 Jan 2014 04:09:03 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:09:04 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:09:04 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:09:04 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:09:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:09:07 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:09:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:09:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:09:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:09:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:09:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:09:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:09:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:09:08 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:09:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 04:09:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:09:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:09:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:09:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:09:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:09:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:09:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:09:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:09:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:09:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:09:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43598837
Sun 19 Jan 2014 04:09:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:09:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43598837
Sun 19 Jan 2014 04:09:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:09:19 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:09:19 - job_xml_thread(): Done retrieving: data size 43598837
Sun 19 Jan 2014 04:09:19 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:09:19 - XML: Start document: iteration 13
Sun 19 Jan 2014 04:09:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:09:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:09:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:09:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:09:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:09:28 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:09:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:09:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:09:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:09:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:09:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:09:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:09:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:09:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:09:35 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:09:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:09:35 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:09:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:09:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:09:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:09:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 04:09:36 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:09:36 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:09:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5874 values 92603 bits 11575 bytes 
Sun 19 Jan 2014 04:09:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 04:09:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:09:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:09:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:09:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:09:38 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 04:09:38 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:09:38 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:09:38 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:09:38 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:09:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:09:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565150
Sun 19 Jan 2014 04:09:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:09:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565150
Sun 19 Jan 2014 04:09:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:09:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:09:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:09:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:09:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:09:53 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:09:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:09:57 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:09:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 04:09:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:09:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:09:57 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:09:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:09:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:09:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:09:58 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:09:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:09:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:09:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:09:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:09:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:09:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:09:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:09:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:09:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:09:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:10:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:10:01 - job_xml_thread(): Done retrieving: data size 43574620
Sun 19 Jan 2014 04:10:01 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:10:01 - XML: Start document: iteration 14
Sun 19 Jan 2014 04:10:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574620
Sun 19 Jan 2014 04:10:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:10:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574620
Sun 19 Jan 2014 04:10:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:10:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:10:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:10:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:10:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:10:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:10:18 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:10:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:10:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:10:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:10:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:10:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:10:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:10:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:10:23 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 04:10:23 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:10:23 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:10:23 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:10:24 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:10:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:10:26 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:10:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:10:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:10:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:10:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:10:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:10:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:10:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:10:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583367
Sun 19 Jan 2014 04:10:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:10:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583367
Sun 19 Jan 2014 04:10:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:10:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:10:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:10:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:10:36 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:10:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:10:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 04:10:36 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:10:36 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:10:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 04:10:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9187 values 144872 bits 18109 bytes 
Sun 19 Jan 2014 04:10:40 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:10:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:10:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:10:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:10:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:10:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:10:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:10:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:10:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:10:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:10:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:10:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:10:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:10:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:10:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:10:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:10:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:10:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:10:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:10:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:10:48 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:10:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 04:10:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:10:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:10:49 - job_xml_thread(): Done retrieving: data size 43561295
Sun 19 Jan 2014 04:10:49 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:10:49 - XML: Start document: iteration 15
Sun 19 Jan 2014 04:10:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561295
Sun 19 Jan 2014 04:10:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:10:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561295
Sun 19 Jan 2014 04:10:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:10:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:10:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:11:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:11:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:11:08 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 04:11:08 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:11:08 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:11:08 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:11:08 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:11:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:11:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:11:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:11:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:11:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:11:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:11:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:11:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:11:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:11:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:11:14 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:11:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:11:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:11:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:11:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:11:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:11:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:11:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:11:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43494879
Sun 19 Jan 2014 04:11:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:11:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43494879
Sun 19 Jan 2014 04:11:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:11:23 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:11:23 - job_xml_thread(): Done retrieving: data size 43494879
Sun 19 Jan 2014 04:11:23 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:11:23 - XML: Start document: iteration 16
Sun 19 Jan 2014 04:11:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:11:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:11:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:11:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:11:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:11:31 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:11:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:11:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:11:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:11:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:11:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:11:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:11:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:11:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:11:36 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:11:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:11:37 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:11:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 04:11:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 04:11:37 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:11:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99035 bits 12379 bytes 
Sun 19 Jan 2014 04:11:38 - XML: Processed 652600 elements - found 0 jobs
Sun 19 Jan 2014 04:11:38 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:11:38 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:11:38 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:11:38 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:11:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:11:42 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:11:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:11:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:11:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:11:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:11:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:11:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:11:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:11:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43004325
Sun 19 Jan 2014 04:11:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:11:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43004325
Sun 19 Jan 2014 04:11:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:11:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:11:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:11:53 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:11:53 - job_xml_thread(): Done retrieving: data size 43004325
Sun 19 Jan 2014 04:11:53 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:11:53 - XML: Start document: iteration 17
Sun 19 Jan 2014 04:11:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:11:58 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:11:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:11:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:11:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:11:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:11:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:11:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:11:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:11:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:11:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:12:02 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:12:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 04:12:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:12:07 - XML: Processed 646512 elements - found 0 jobs
Sun 19 Jan 2014 04:12:07 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:12:07 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:12:07 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:12:07 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:12:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:12:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:12:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:12:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:12:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:12:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:12:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:12:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:12:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:12:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:12:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:12:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42899413
Sun 19 Jan 2014 04:12:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:12:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42899413
Sun 19 Jan 2014 04:12:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:12:22 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:12:22 - job_xml_thread(): Done retrieving: data size 42899413
Sun 19 Jan 2014 04:12:22 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:12:22 - XML: Start document: iteration 18
Sun 19 Jan 2014 04:12:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:12:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:12:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:12:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:12:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:12:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:12:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:12:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:12:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:12:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:12:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:12:34 - XML: Processed 645154 elements - found 0 jobs
Sun 19 Jan 2014 04:12:34 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:12:34 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:12:34 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:12:34 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:12:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:12:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:12:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:12:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:12:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:12:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:12:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:12:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:12:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:12:37 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:12:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:12:37 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:12:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 04:12:37 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:12:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 04:12:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5808 values 91591 bits 11448 bytes 
Sun 19 Jan 2014 04:12:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:12:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43380337
Sun 19 Jan 2014 04:12:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:12:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43380337
Sun 19 Jan 2014 04:12:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:12:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:12:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:12:50 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:12:50 - job_xml_thread(): Done retrieving: data size 43380337
Sun 19 Jan 2014 04:12:50 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:12:50 - XML: Start document: iteration 19
Sun 19 Jan 2014 04:12:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:12:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:12:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:12:59 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:12:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:12:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:13:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:13:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:13:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:13:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:13:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:13:03 - XML: Processed 651118 elements - found 0 jobs
Sun 19 Jan 2014 04:13:03 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:13:03 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:13:03 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:13:03 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:13:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:13:05 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:13:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:13:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:13:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:13:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:13:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:13:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:13:06 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:13:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 04:13:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:13:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:13:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563748
Sun 19 Jan 2014 04:13:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:13:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563748
Sun 19 Jan 2014 04:13:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:13:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:13:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:13:18 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:13:18 - job_xml_thread(): Done retrieving: data size 43563748
Sun 19 Jan 2014 04:13:18 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:13:18 - XML: Start document: iteration 20
Sun 19 Jan 2014 04:13:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:13:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:13:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:13:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:13:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:13:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:13:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:13:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:13:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:13:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:13:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:13:35 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 04:13:35 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:13:35 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:13:35 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:13:35 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:13:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:13:35 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:13:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:13:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:13:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:13:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:13:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:13:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:13:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:13:37 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:13:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:13:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 04:13:38 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:13:38 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:13:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 04:13:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 4988 values 78658 bits 9832 bytes 
Sun 19 Jan 2014 04:13:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:13:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:13:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:13:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43543102
Sun 19 Jan 2014 04:13:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:13:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43543102
Sun 19 Jan 2014 04:13:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:13:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:13:47 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:13:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:13:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:13:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:13:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:13:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:13:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:13:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43543102
Sun 19 Jan 2014 04:13:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:13:50 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:13:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:13:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:13:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:13:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:13:59 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:14:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:14:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:14:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:14:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:14:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:14:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:14:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:14:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:14:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:14:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:14:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:14:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:14:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:14:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:14:06 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:14:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 04:14:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:14:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:14:06 - job_xml_thread(): Done retrieving: data size 43540804
Sun 19 Jan 2014 04:14:06 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:14:06 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 04:14:06 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 04:14:06 - Housekeeping: done.
Sun 19 Jan 2014 04:14:06 - XML: Start document: iteration 0
Sun 19 Jan 2014 04:14:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43540804
Sun 19 Jan 2014 04:14:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43540804
Sun 19 Jan 2014 04:14:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:14:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:14:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:14:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:14:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:14:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:14:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:14:18 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:14:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:14:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:14:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:14:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:14:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:14:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:14:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:14:26 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 04:14:26 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:14:26 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:14:26 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:14:26 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:14:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:14:29 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:14:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:14:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:14:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:14:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:14:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:14:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:14:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:14:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43550358
Sun 19 Jan 2014 04:14:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:14:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43550358
Sun 19 Jan 2014 04:14:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:14:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:14:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:14:37 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 04:14:37 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:14:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:14:38 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:14:38 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:14:38 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:14:38 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 04:14:38 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 04:14:38 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 04:14:39 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:14:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:14:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 04:14:39 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:14:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 04:14:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7018 values 110612 bits 13826 bytes 
Sun 19 Jan 2014 04:14:41 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:14:41 - job_xml_thread(): Done retrieving: data size 43550358
Sun 19 Jan 2014 04:14:41 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:14:41 - XML: Start document: iteration 1
Sun 19 Jan 2014 04:14:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:14:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:14:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:14:47 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:14:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:14:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:14:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:14:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:14:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:14:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:14:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:14:50 - size of cluster 'LISA Cluster': 624 hosts 79458 metrics 1021282 values 16107488 bits 2013436 bytes 
Sun 19 Jan 2014 04:14:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:14:58 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:14:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:14:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:14:59 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 04:14:59 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:14:59 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:14:59 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:14:59 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:15:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:15:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:15:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:15:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:15:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:15:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:15:04 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:15:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 04:15:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:15:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:15:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43546065
Sun 19 Jan 2014 04:15:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:15:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43546065
Sun 19 Jan 2014 04:15:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:15:14 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:15:14 - job_xml_thread(): Done retrieving: data size 43546065
Sun 19 Jan 2014 04:15:14 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:15:14 - XML: Start document: iteration 2
Sun 19 Jan 2014 04:15:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:15:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:15:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:15:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:15:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:15:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:15:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:15:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:15:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:15:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:15:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:15:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:15:26 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:15:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:15:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:15:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:15:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:15:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:15:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:15:27 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 04:15:27 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:15:27 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:15:27 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:15:27 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:15:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:15:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553836
Sun 19 Jan 2014 04:15:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:15:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:15:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:15:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553836
Sun 19 Jan 2014 04:15:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:15:40 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:15:40 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 04:15:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:15:40 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:15:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:15:41 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:15:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 04:15:41 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:15:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 04:15:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99050 bits 12381 bytes 
Sun 19 Jan 2014 04:15:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:15:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:15:43 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:15:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:15:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:15:45 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:15:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:15:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:15:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:15:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:15:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:15:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:15:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:15:49 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:15:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:15:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:15:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:15:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:15:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:15:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:15:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:15:55 - job_xml_thread(): Done retrieving: data size 43561362
Sun 19 Jan 2014 04:15:55 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:15:55 - XML: Start document: iteration 3
Sun 19 Jan 2014 04:15:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561362
Sun 19 Jan 2014 04:15:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561362
Sun 19 Jan 2014 04:15:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:15:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:16:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:16:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:16:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:16:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:16:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:16:18 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:16:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:16:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:16:18 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 04:16:18 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:16:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:16:18 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:16:18 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:16:18 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:16:18 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:16:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:16:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:16:19 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:16:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 04:16:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:16:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:16:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:16:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:16:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:16:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:16:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:16:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:16:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:16:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:16:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:16:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583364
Sun 19 Jan 2014 04:16:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:16:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583364
Sun 19 Jan 2014 04:16:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:16:33 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:16:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:16:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:16:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:16:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:16:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:16:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:16:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:16:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:16:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:16:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:16:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:16:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:16:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:16:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:16:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:16:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:16:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:16:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:16:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:16:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:16:41 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:16:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:16:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 04:16:41 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:16:41 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:16:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 04:16:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5890 values 92997 bits 11624 bytes 
Sun 19 Jan 2014 04:16:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:16:44 - job_xml_thread(): Done retrieving: data size 43584822
Sun 19 Jan 2014 04:16:44 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:16:44 - XML: Start document: iteration 4
Sun 19 Jan 2014 04:16:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584822
Sun 19 Jan 2014 04:16:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:16:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584822
Sun 19 Jan 2014 04:16:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:16:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:16:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:16:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:16:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:17:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:17:01 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:17:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:17:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:17:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:17:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:17:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:17:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:17:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:17:03 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 04:17:03 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:17:03 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:17:03 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:17:03 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:17:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:17:07 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:17:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:17:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:17:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:17:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:17:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:17:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:17:10 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:17:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 04:17:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:17:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:17:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43585040
Sun 19 Jan 2014 04:17:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:17:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43585040
Sun 19 Jan 2014 04:17:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:17:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:17:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:17:18 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:17:18 - job_xml_thread(): Done retrieving: data size 43585040
Sun 19 Jan 2014 04:17:18 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:17:18 - XML: Start document: iteration 5
Sun 19 Jan 2014 04:17:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:17:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:17:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:17:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:17:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:17:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:17:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:17:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:17:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:17:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:17:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:17:34 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 04:17:34 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:17:34 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:17:34 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:17:34 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:17:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:17:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:17:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:17:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:17:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:17:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:17:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:17:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:17:38 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 04:17:38 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 04:17:38 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:17:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:17:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:17:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43397551
Sun 19 Jan 2014 04:17:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:17:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:17:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43397551
Sun 19 Jan 2014 04:17:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:17:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:17:42 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:17:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:17:44 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:17:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 04:17:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 04:17:44 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:17:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7478 values 118271 bits 14783 bytes 
Sun 19 Jan 2014 04:17:50 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:17:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:17:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:17:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:17:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:17:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:17:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:17:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:17:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:17:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:17:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:17:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:17:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:17:55 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:17:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:17:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:17:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:17:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:17:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:17:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:17:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:17:59 - job_xml_thread(): Done retrieving: data size 42931356
Sun 19 Jan 2014 04:17:59 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:17:59 - XML: Start document: iteration 6
Sun 19 Jan 2014 04:17:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42931356
Sun 19 Jan 2014 04:17:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:17:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42931356
Sun 19 Jan 2014 04:17:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:18:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:18:10 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:18:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:18:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:18:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:18:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:18:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:18:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:18:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:18:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:18:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:18:17 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:18:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 04:18:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:18:19 - XML: Processed 645312 elements - found 0 jobs
Sun 19 Jan 2014 04:18:19 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:18:19 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:18:19 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:18:19 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:18:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:18:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:18:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:18:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:18:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:18:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:18:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:18:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:18:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:18:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42959049
Sun 19 Jan 2014 04:18:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:18:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42959049
Sun 19 Jan 2014 04:18:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:18:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:18:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:18:34 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:18:34 - job_xml_thread(): Done retrieving: data size 42959049
Sun 19 Jan 2014 04:18:34 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:18:34 - XML: Start document: iteration 7
Sun 19 Jan 2014 04:18:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:18:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:18:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:18:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:18:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:18:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:18:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:18:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:18:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:18:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:18:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:18:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:18:44 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:18:45 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:18:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 04:18:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:18:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 04:18:45 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:18:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5956 values 94114 bits 11764 bytes 
Sun 19 Jan 2014 04:18:47 - XML: Processed 645900 elements - found 0 jobs
Sun 19 Jan 2014 04:18:47 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:18:47 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:18:47 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:18:47 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:18:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:18:48 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:18:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:18:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:18:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:18:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:18:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:18:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:18:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:18:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43531041
Sun 19 Jan 2014 04:18:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:18:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43531041
Sun 19 Jan 2014 04:18:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:18:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:18:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:19:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:19:01 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:19:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:19:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:19:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:19:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:19:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:19:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:19:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:19:02 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:19:03 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:19:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 04:19:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:19:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:19:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:19:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:19:06 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:19:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:19:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:19:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:19:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:19:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:19:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:19:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:19:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569089
Sun 19 Jan 2014 04:19:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:19:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569089
Sun 19 Jan 2014 04:19:09 - job_xml_thread(): Done retrieving: data size 43569089
Sun 19 Jan 2014 04:19:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:19:09 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:19:09 - XML: Start document: iteration 8
Sun 19 Jan 2014 04:19:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:19:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:19:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:19:19 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:19:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:19:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:19:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:19:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:19:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:19:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:19:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:19:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:19:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:19:27 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 04:19:27 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:19:27 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:19:27 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:19:27 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:19:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:19:31 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:19:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:19:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:19:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:19:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:19:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:19:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:19:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:19:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43536498
Sun 19 Jan 2014 04:19:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:19:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43536498
Sun 19 Jan 2014 04:19:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:19:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:19:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:19:43 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:19:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:19:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:19:43 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:19:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:19:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:19:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:19:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:19:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:19:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:19:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:19:45 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:19:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:19:45 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:19:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 04:19:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 04:19:45 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:19:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9009 values 142079 bits 17759 bytes 
Sun 19 Jan 2014 04:19:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:19:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:19:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:19:47 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:19:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:19:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:19:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:19:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:19:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:19:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:19:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:19:50 - job_xml_thread(): Done retrieving: data size 43563835
Sun 19 Jan 2014 04:19:50 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:19:50 - XML: Start document: iteration 9
Sun 19 Jan 2014 04:19:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563835
Sun 19 Jan 2014 04:19:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:19:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563835
Sun 19 Jan 2014 04:19:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:19:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:19:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:20:02 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 04:20:02 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:20:02 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:20:02 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:20:02 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:20:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:20:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:20:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:20:11 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:20:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:20:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:20:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:20:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:20:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:20:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:20:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:20:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:20:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:20:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:20:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:20:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:20:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:20:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:20:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:20:13 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:20:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 04:20:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:20:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:20:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579318
Sun 19 Jan 2014 04:20:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:20:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579318
Sun 19 Jan 2014 04:20:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:20:17 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:20:17 - job_xml_thread(): Done retrieving: data size 43579318
Sun 19 Jan 2014 04:20:17 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:20:17 - XML: Start document: iteration 10
Sun 19 Jan 2014 04:20:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:20:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:20:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:20:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:20:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:20:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:20:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:20:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:20:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:20:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:20:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:20:33 - XML: Processed 653344 elements - found 0 jobs
Sun 19 Jan 2014 04:20:33 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:20:33 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:20:33 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:20:33 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:20:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:20:37 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:20:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:20:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:20:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:20:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:20:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:20:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:20:39 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 04:20:39 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 04:20:39 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:20:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:20:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564607
Sun 19 Jan 2014 04:20:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:20:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564607
Sun 19 Jan 2014 04:20:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:20:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:20:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:20:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:20:45 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:20:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:20:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 04:20:47 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:20:47 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:20:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 04:20:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8819 values 139055 bits 17381 bytes 
Sun 19 Jan 2014 04:20:49 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:20:49 - job_xml_thread(): Done retrieving: data size 43564607
Sun 19 Jan 2014 04:20:49 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:20:49 - XML: Start document: iteration 11
Sun 19 Jan 2014 04:20:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:20:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:20:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:20:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:20:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:20:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:20:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:20:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:20:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:20:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:20:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:21:00 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 04:21:00 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:21:00 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:21:00 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:21:00 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:21:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:21:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:21:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:21:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:21:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:21:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:21:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:21:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:21:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:21:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555320
Sun 19 Jan 2014 04:21:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:21:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555320
Sun 19 Jan 2014 04:21:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:21:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:21:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:21:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:21:14 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:21:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:21:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:21:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:21:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:21:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:21:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:21:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:21:15 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:21:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:21:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:21:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:21:19 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:21:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:21:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:21:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:21:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:21:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:21:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:21:19 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:21:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 04:21:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:21:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:21:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569145
Sun 19 Jan 2014 04:21:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:21:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569145
Sun 19 Jan 2014 04:21:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:21:21 - job_xml_thread(): Done retrieving: data size 43569145
Sun 19 Jan 2014 04:21:21 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:21:21 - XML: Start document: iteration 12
Sun 19 Jan 2014 04:21:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:21:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:21:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:21:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:21:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:21:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:21:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:21:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:21:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:21:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:21:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:21:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:21:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:21:37 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 04:21:37 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:21:37 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:21:37 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:21:37 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:21:40 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 04:21:40 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:21:41 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:21:41 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 04:21:41 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 04:21:41 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:21:41 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 04:21:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:21:42 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:21:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:21:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:21:42 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 690242 values 10893138 bits 1361642 bytes 
Sun 19 Jan 2014 04:21:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:21:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:21:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:21:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:21:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:21:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567858
Sun 19 Jan 2014 04:21:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:21:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567858
Sun 19 Jan 2014 04:21:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:21:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:21:47 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:21:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:21:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:21:48 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:21:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 04:21:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:21:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 04:21:48 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:21:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8847 values 139523 bits 17440 bytes 
Sun 19 Jan 2014 04:21:52 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:21:52 - job_xml_thread(): Done retrieving: data size 43567858
Sun 19 Jan 2014 04:21:52 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:21:52 - XML: Start document: iteration 13
Sun 19 Jan 2014 04:21:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:21:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:22:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:22:01 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:22:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:22:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:22:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:22:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:22:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:22:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:22:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:22:07 - XML: Processed 653347 elements - found 0 jobs
Sun 19 Jan 2014 04:22:07 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:22:07 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:22:07 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:22:07 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:22:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:22:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:22:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:22:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:22:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:22:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:22:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:22:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:22:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:22:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571670
Sun 19 Jan 2014 04:22:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:22:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571670
Sun 19 Jan 2014 04:22:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:22:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:22:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:22:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:22:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:22:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:22:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:22:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:22:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:22:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:22:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:22:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:22:22 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:22:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:22:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:22:26 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:22:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 04:22:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:22:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:22:27 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:22:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:22:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:22:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:22:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:22:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:22:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:22:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:22:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43588452
Sun 19 Jan 2014 04:22:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:22:30 - job_xml_thread(): Done retrieving: data size 43588452
Sun 19 Jan 2014 04:22:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43588452
Sun 19 Jan 2014 04:22:31 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:22:31 - XML: Start document: iteration 14
Sun 19 Jan 2014 04:22:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:22:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:22:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:22:41 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:22:41 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 04:22:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:22:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:22:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:22:45 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:22:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:22:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:22:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:22:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:22:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:22:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:22:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:22:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:22:48 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:22:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:22:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 04:22:49 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:22:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6004 values 94718 bits 11839 bytes 
Sun 19 Jan 2014 04:22:49 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:22:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 04:22:50 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 04:22:50 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:22:50 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:22:50 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:22:50 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:22:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:22:53 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:22:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:22:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:22:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:22:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:22:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:22:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:22:57 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:22:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 04:22:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:22:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:22:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570387
Sun 19 Jan 2014 04:22:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:22:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570387
Sun 19 Jan 2014 04:22:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:23:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:23:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:23:05 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:23:05 - job_xml_thread(): Done retrieving: data size 43570387
Sun 19 Jan 2014 04:23:05 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:23:05 - XML: Start document: iteration 15
Sun 19 Jan 2014 04:23:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:23:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:23:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:23:14 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:23:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:23:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:23:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:23:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:23:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:23:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:23:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:23:17 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 04:23:17 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:23:17 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:23:17 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:23:17 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:23:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:23:19 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:23:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:23:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:23:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:23:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:23:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:23:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:23:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:23:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43500127
Sun 19 Jan 2014 04:23:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:23:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43500127
Sun 19 Jan 2014 04:23:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:23:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:23:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:23:32 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:23:32 - job_xml_thread(): Done retrieving: data size 43500127
Sun 19 Jan 2014 04:23:32 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:23:32 - XML: Start document: iteration 16
Sun 19 Jan 2014 04:23:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:23:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:23:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:23:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:23:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:23:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:23:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:23:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:23:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:23:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:23:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:23:41 - XML: Processed 652600 elements - found 0 jobs
Sun 19 Jan 2014 04:23:41 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:23:41 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:23:41 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:23:41 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:23:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:23:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:23:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:23:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:23:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:23:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:23:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:23:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:23:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:23:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42971083
Sun 19 Jan 2014 04:23:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:23:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42971083
Sun 19 Jan 2014 04:23:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:23:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:23:49 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:23:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:23:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 04:23:49 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:23:49 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:23:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 04:23:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:23:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:23:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148544 bits 18568 bytes 
Sun 19 Jan 2014 04:23:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:23:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:23:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:23:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:23:56 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:23:56 - job_xml_thread(): Done retrieving: data size 42971083
Sun 19 Jan 2014 04:23:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:23:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:23:57 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:23:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:23:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:23:57 - XML: Start document: iteration 17
Sun 19 Jan 2014 04:23:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:24:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:24:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:24:08 - XML: Processed 646084 elements - found 0 jobs
Sun 19 Jan 2014 04:24:08 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:24:08 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:24:08 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:24:08 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:24:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:24:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:24:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:24:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:24:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:24:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:24:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:24:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:24:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:24:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:24:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:24:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42892771
Sun 19 Jan 2014 04:24:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:24:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42892771
Sun 19 Jan 2014 04:24:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:24:23 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:24:23 - job_xml_thread(): Done retrieving: data size 42892771
Sun 19 Jan 2014 04:24:23 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:24:23 - XML: Start document: iteration 18
Sun 19 Jan 2014 04:24:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:24:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:24:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:24:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:24:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:24:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:24:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:24:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:24:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:24:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:24:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:24:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:24:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:24:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:24:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:24:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:24:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:24:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:24:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:24:36 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:24:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 04:24:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:24:36 - XML: Processed 645150 elements - found 0 jobs
Sun 19 Jan 2014 04:24:36 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:24:36 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:24:36 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:24:36 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:24:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:24:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43415398
Sun 19 Jan 2014 04:24:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:24:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43415398
Sun 19 Jan 2014 04:24:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:24:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:24:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:24:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:24:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:24:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:24:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:24:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:24:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:24:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:24:50 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:24:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:24:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:24:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:24:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:24:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:24:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:24:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 04:24:50 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:24:50 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:24:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5914 values 93248 bits 11656 bytes 
Sun 19 Jan 2014 04:24:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 04:24:51 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:24:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:24:53 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:24:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:24:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:24:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:24:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:24:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:24:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:24:55 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:24:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 04:24:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:24:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:24:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43545348
Sun 19 Jan 2014 04:24:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:24:57 - job_xml_thread(): Done retrieving: data size 43545348
Sun 19 Jan 2014 04:24:57 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:24:57 - XML: Start document: iteration 19
Sun 19 Jan 2014 04:24:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43545348
Sun 19 Jan 2014 04:24:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:25:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:25:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:25:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:25:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:25:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:25:14 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:25:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:25:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:25:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:25:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:25:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:25:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:25:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:25:18 - XML: Processed 652854 elements - found 0 jobs
Sun 19 Jan 2014 04:25:18 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:25:18 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:25:18 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:25:18 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:25:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:25:20 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:25:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:25:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:25:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:25:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:25:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:25:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:25:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:25:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559270
Sun 19 Jan 2014 04:25:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:25:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559270
Sun 19 Jan 2014 04:25:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:25:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:25:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:25:33 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:25:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:25:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:25:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:25:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:25:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:25:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:25:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:25:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:25:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:25:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:25:37 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:25:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:25:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:25:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:25:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:25:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:25:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:25:39 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 04:25:39 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 04:25:39 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:25:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:25:39 - job_xml_thread(): Done retrieving: data size 43570700
Sun 19 Jan 2014 04:25:39 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:25:39 - XML: Start document: iteration 20
Sun 19 Jan 2014 04:25:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570700
Sun 19 Jan 2014 04:25:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:25:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570700
Sun 19 Jan 2014 04:25:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:25:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:25:50 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:25:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:25:51 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:25:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 04:25:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:25:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 04:25:51 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:25:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:25:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9268 values 146105 bits 18263 bytes 
Sun 19 Jan 2014 04:25:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:25:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:26:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:26:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:26:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:26:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:26:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:26:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:26:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:26:03 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 04:26:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:26:03 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:26:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:26:03 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:26:03 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:26:03 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:26:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:26:04 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:26:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:26:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:26:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:26:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:26:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:26:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:26:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:26:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574182
Sun 19 Jan 2014 04:26:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:26:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574182
Sun 19 Jan 2014 04:26:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:26:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:26:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:26:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:26:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:26:18 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:26:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:26:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:26:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:26:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:26:19 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:26:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:26:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:26:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:26:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:26:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:26:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:26:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:26:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:26:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:26:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:26:20 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:26:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 04:26:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:26:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:26:21 - job_xml_thread(): Done retrieving: data size 43580111
Sun 19 Jan 2014 04:26:21 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:26:21 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 04:26:21 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 04:26:21 - Housekeeping: done.
Sun 19 Jan 2014 04:26:21 - XML: Start document: iteration 0
Sun 19 Jan 2014 04:26:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580111
Sun 19 Jan 2014 04:26:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:26:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580111
Sun 19 Jan 2014 04:26:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:26:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:26:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:26:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:26:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:26:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:26:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:26:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:26:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:26:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:26:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:26:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:26:40 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 04:26:40 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:26:40 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:26:40 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:26:40 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:26:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:26:42 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:26:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:26:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:26:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:26:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:26:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:26:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:26:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:26:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43586992
Sun 19 Jan 2014 04:26:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:26:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43586992
Sun 19 Jan 2014 04:26:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:26:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:26:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:26:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:26:52 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:26:53 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:26:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:26:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 04:26:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 04:26:53 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:26:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8879 values 139937 bits 17492 bytes 
Sun 19 Jan 2014 04:26:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:26:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:26:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:26:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:26:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:26:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:26:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:26:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:26:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:26:56 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:26:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:26:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:26:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:26:58 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:26:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:26:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:26:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:26:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:26:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:26:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:27:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:27:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43592260
Sun 19 Jan 2014 04:27:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:27:00 - job_xml_thread(): Done retrieving: data size 43592260
Sun 19 Jan 2014 04:27:00 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:27:00 - XML: Start document: iteration 1
Sun 19 Jan 2014 04:27:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43592260
Sun 19 Jan 2014 04:27:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:27:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:27:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:27:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:27:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:27:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:27:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:27:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:27:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:27:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:27:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:27:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:27:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:27:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:27:20 - XML: Processed 653347 elements - found 0 jobs
Sun 19 Jan 2014 04:27:20 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:27:20 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:27:20 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:27:20 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:27:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:27:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:27:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:27:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:27:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:27:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:27:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:27:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:27:23 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:27:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 04:27:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:27:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:27:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575191
Sun 19 Jan 2014 04:27:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:27:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575191
Sun 19 Jan 2014 04:27:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:27:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:27:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:27:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:27:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:27:35 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:27:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:27:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:27:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:27:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:27:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:27:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:27:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:27:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:27:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:27:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:27:39 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:27:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:27:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:27:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:27:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:27:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:27:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:27:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:27:40 - job_xml_thread(): Done retrieving: data size 43581122
Sun 19 Jan 2014 04:27:40 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:27:40 - XML: Start document: iteration 2
Sun 19 Jan 2014 04:27:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581122
Sun 19 Jan 2014 04:27:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:27:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581122
Sun 19 Jan 2014 04:27:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:27:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:27:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:27:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:27:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:27:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:27:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:27:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:27:53 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:27:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:27:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:27:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:27:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:27:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:27:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:27:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 04:27:54 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:27:54 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:27:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:27:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 04:27:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8597 values 135459 bits 16932 bytes 
Sun 19 Jan 2014 04:27:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:28:03 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 04:28:03 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:28:03 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:28:03 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:28:03 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:28:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:28:03 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:28:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:28:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:28:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:28:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:28:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:28:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:28:05 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:28:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 04:28:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:28:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:28:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554235
Sun 19 Jan 2014 04:28:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:28:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554235
Sun 19 Jan 2014 04:28:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:28:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:28:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:28:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:28:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:28:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:28:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:28:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:28:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:28:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:28:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:28:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:28:18 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:28:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:28:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:28:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:28:20 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:28:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:28:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:28:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:28:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:28:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:28:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:28:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:28:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579607
Sun 19 Jan 2014 04:28:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:28:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579607
Sun 19 Jan 2014 04:28:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:28:22 - job_xml_thread(): Done retrieving: data size 43579607
Sun 19 Jan 2014 04:28:22 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:28:22 - XML: Start document: iteration 3
Sun 19 Jan 2014 04:28:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:28:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:28:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:28:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:28:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:28:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:28:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:28:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:28:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:28:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:28:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:28:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:28:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:28:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:28:40 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:28:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:28:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:28:41 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 04:28:42 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:28:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:28:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:28:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:28:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:28:42 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:28:42 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 04:28:42 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 04:28:42 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:28:43 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 04:28:43 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 04:28:43 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:28:43 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:28:43 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:28:44 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:28:44 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 851636 values 13421607 bits 1677700 bytes 
Sun 19 Jan 2014 04:28:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:28:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43552689
Sun 19 Jan 2014 04:28:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:28:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43552689
Sun 19 Jan 2014 04:28:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:28:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:28:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:28:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:28:54 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:28:55 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:28:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:28:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 04:28:55 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:28:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 04:28:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148519 bits 18564 bytes 
Sun 19 Jan 2014 04:28:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:28:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:28:59 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:28:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:28:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:28:59 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:28:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:28:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:29:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:29:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:29:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:29:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:29:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:29:03 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:29:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:29:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:29:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:29:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:29:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:29:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:29:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:29:07 - job_xml_thread(): Done retrieving: data size 43572983
Sun 19 Jan 2014 04:29:07 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:29:07 - XML: Start document: iteration 4
Sun 19 Jan 2014 04:29:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572983
Sun 19 Jan 2014 04:29:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:29:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572983
Sun 19 Jan 2014 04:29:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:29:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:29:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:29:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:29:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:29:24 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 04:29:24 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:29:24 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:29:24 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:29:24 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:29:26 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:29:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 04:29:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:29:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:29:27 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:29:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:29:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:29:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:29:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:29:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:29:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:29:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:29:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:29:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:29:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:29:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:29:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:29:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:29:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:29:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:29:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:29:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43120935
Sun 19 Jan 2014 04:29:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:29:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43120935
Sun 19 Jan 2014 04:29:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:29:39 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:29:39 - job_xml_thread(): Done retrieving: data size 43120935
Sun 19 Jan 2014 04:29:39 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:29:39 - XML: Start document: iteration 5
Sun 19 Jan 2014 04:29:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:29:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:29:43 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:29:43 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 04:29:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:29:44 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:29:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:29:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:29:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:29:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:29:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:29:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:29:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:29:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:29:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:29:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:29:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:29:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:29:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:29:55 - XML: Processed 647742 elements - found 0 jobs
Sun 19 Jan 2014 04:29:55 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:29:55 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:29:55 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:29:55 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:29:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:29:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:29:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:29:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:29:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:29:56 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:29:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:29:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 04:29:57 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:29:57 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:29:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 04:29:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6030 values 95065 bits 11883 bytes 
Sun 19 Jan 2014 04:29:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:29:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42937608
Sun 19 Jan 2014 04:29:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:29:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42937608
Sun 19 Jan 2014 04:29:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:30:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:30:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:30:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:30:07 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:30:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:30:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:30:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:30:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:30:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:30:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:30:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:30:10 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:30:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:30:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:30:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:30:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:30:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:30:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:30:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:30:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:30:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:30:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:30:15 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:30:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 04:30:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:30:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:30:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42947772
Sun 19 Jan 2014 04:30:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:30:16 - job_xml_thread(): Done retrieving: data size 42947772
Sun 19 Jan 2014 04:30:16 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:30:16 - XML: Start document: iteration 6
Sun 19 Jan 2014 04:30:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42947772
Sun 19 Jan 2014 04:30:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:30:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:30:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:30:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:30:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:30:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:30:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:30:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:30:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:30:35 - XML: Processed 645698 elements - found 0 jobs
Sun 19 Jan 2014 04:30:35 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:30:35 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:30:35 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:30:35 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:30:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:30:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:30:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:30:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:30:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:30:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:30:37 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:30:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:30:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:30:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:30:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:30:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:30:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:30:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:30:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43370754
Sun 19 Jan 2014 04:30:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:30:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43370754
Sun 19 Jan 2014 04:30:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:30:50 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:30:50 - job_xml_thread(): Done retrieving: data size 43370754
Sun 19 Jan 2014 04:30:51 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:30:51 - XML: Start document: iteration 7
Sun 19 Jan 2014 04:30:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:30:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:30:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:30:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:30:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:30:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:30:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:30:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:30:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:30:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:30:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:30:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:30:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:30:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:30:57 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:30:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:30:57 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:30:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:30:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:30:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:30:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:30:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:30:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:30:57 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:30:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 04:30:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:30:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 04:30:57 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:30:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7077 values 111582 bits 13947 bytes 
Sun 19 Jan 2014 04:31:00 - XML: Processed 650602 elements - found 0 jobs
Sun 19 Jan 2014 04:31:00 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:31:00 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:31:00 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:31:00 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:31:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:31:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556016
Sun 19 Jan 2014 04:31:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:31:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556016
Sun 19 Jan 2014 04:31:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:31:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:31:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:31:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:31:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:31:15 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:31:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:31:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:31:21 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:31:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:31:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:31:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:31:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:31:21 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:31:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 04:31:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:31:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:31:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:31:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:31:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:31:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:31:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:31:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:31:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:31:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:31:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:31:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:31:24 - job_xml_thread(): Done retrieving: data size 43572237
Sun 19 Jan 2014 04:31:24 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:31:24 - XML: Start document: iteration 8
Sun 19 Jan 2014 04:31:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572237
Sun 19 Jan 2014 04:31:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:31:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572237
Sun 19 Jan 2014 04:31:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:31:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:31:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:31:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:31:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:31:39 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 04:31:39 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:31:39 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:31:39 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:31:39 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:31:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:31:46 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:31:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:31:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:31:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:31:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:31:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:31:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:31:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:31:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:31:48 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:31:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:31:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:31:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:31:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:31:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:31:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:31:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:31:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43588254
Sun 19 Jan 2014 04:31:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:31:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43588254
Sun 19 Jan 2014 04:31:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:31:55 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:31:55 - job_xml_thread(): Done retrieving: data size 43588254
Sun 19 Jan 2014 04:31:55 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:31:55 - XML: Start document: iteration 9
Sun 19 Jan 2014 04:31:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:31:58 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:32:00 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:32:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 04:32:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:32:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 04:32:01 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:32:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8814 values 139168 bits 17396 bytes 
Sun 19 Jan 2014 04:32:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:32:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:32:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:32:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:32:10 - XML: Processed 653349 elements - found 0 jobs
Sun 19 Jan 2014 04:32:10 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:32:10 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:32:10 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:32:10 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:32:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:32:10 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:32:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:32:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:32:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:32:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:32:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:32:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:32:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:32:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:32:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:32:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:32:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:32:12 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 04:32:12 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 04:32:12 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:32:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:32:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:32:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:32:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:32:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:32:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584040
Sun 19 Jan 2014 04:32:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:32:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584040
Sun 19 Jan 2014 04:32:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:32:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:32:25 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:32:25 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:32:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:32:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:32:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:32:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:32:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:32:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:32:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:32:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:32:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:32:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:32:29 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:32:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:32:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:32:29 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:32:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 04:32:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:32:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:32:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:32:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:32:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:32:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:32:31 - job_xml_thread(): Done retrieving: data size 43572428
Sun 19 Jan 2014 04:32:31 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:32:31 - XML: Start document: iteration 10
Sun 19 Jan 2014 04:32:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572428
Sun 19 Jan 2014 04:32:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:32:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572428
Sun 19 Jan 2014 04:32:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:32:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:32:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:32:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:32:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:32:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:32:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:32:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:32:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:32:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:32:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:32:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:32:51 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 04:32:51 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:32:51 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:32:51 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:32:51 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:32:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:32:52 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:32:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:32:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:32:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:32:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:32:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:32:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:32:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:32:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573680
Sun 19 Jan 2014 04:32:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:32:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573680
Sun 19 Jan 2014 04:32:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:32:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:32:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:33:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:33:01 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:33:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:33:02 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:33:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 04:33:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 04:33:02 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:33:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9043 values 143023 bits 17877 bytes 
Sun 19 Jan 2014 04:33:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:33:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:33:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:33:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:33:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:33:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:33:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:33:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:33:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:33:06 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:33:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:33:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:33:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:33:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:33:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:33:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:33:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:33:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:33:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:33:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:33:11 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:33:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 04:33:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:33:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:33:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582343
Sun 19 Jan 2014 04:33:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:33:13 - job_xml_thread(): Done retrieving: data size 43582343
Sun 19 Jan 2014 04:33:13 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:33:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582343
Sun 19 Jan 2014 04:33:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:33:13 - XML: Start document: iteration 11
Sun 19 Jan 2014 04:33:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:33:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:33:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:33:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:33:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:33:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:33:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:33:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:33:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:33:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:33:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:33:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:33:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:33:27 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 04:33:27 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:33:27 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:33:27 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:33:27 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:33:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:33:32 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:33:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:33:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:33:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:33:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:33:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:33:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:33:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:33:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566107
Sun 19 Jan 2014 04:33:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:33:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566107
Sun 19 Jan 2014 04:33:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:33:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:33:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:33:42 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:33:42 - job_xml_thread(): Done retrieving: data size 43566107
Sun 19 Jan 2014 04:33:42 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:33:42 - XML: Start document: iteration 12
Sun 19 Jan 2014 04:33:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:33:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:33:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:33:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:33:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:33:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:33:53 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 04:33:53 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:33:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:33:53 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:33:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:33:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:33:53 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:33:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:33:53 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:33:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:33:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:33:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:33:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:33:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:33:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:33:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:33:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:33:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:33:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:33:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43591635
Sun 19 Jan 2014 04:33:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:33:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43591635
Sun 19 Jan 2014 04:33:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:34:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:34:02 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:34:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:34:03 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:34:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 04:34:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 04:34:04 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:34:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148716 bits 18589 bytes 
Sun 19 Jan 2014 04:34:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:34:04 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:34:08 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:34:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:34:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:34:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:34:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:34:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:34:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:34:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:34:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:34:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:34:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:34:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:34:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:34:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:34:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:34:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:34:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:34:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:34:11 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:34:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 04:34:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:34:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:34:12 - job_xml_thread(): Done retrieving: data size 43570454
Sun 19 Jan 2014 04:34:12 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:34:12 - XML: Start document: iteration 13
Sun 19 Jan 2014 04:34:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570454
Sun 19 Jan 2014 04:34:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570454
Sun 19 Jan 2014 04:34:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:34:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:34:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:34:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:34:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:34:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:34:29 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 04:34:29 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:34:29 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:34:29 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:34:30 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:34:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:34:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:34:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:34:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:34:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:34:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:34:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:34:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:34:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:34:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:34:35 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:34:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:34:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:34:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:34:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:34:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:34:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:34:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:34:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43598570
Sun 19 Jan 2014 04:34:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:34:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43598570
Sun 19 Jan 2014 04:34:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:34:45 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:34:45 - job_xml_thread(): Done retrieving: data size 43598570
Sun 19 Jan 2014 04:34:45 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:34:45 - XML: Start document: iteration 14
Sun 19 Jan 2014 04:34:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:34:45 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:34:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:34:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:34:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:34:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:34:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:34:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:34:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:34:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:34:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:34:53 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 04:34:53 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:34:53 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:34:53 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:34:53 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:34:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:34:57 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:34:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:34:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:34:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:34:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:34:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:34:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:34:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:34:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563837
Sun 19 Jan 2014 04:34:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:34:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563837
Sun 19 Jan 2014 04:34:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:35:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:35:04 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:35:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:35:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:35:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:35:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 04:35:06 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:35:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 04:35:06 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:35:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9279 values 146402 bits 18300 bytes 
Sun 19 Jan 2014 04:35:08 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:35:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:35:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:35:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:35:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:35:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:35:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:35:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:35:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:35:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:35:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:35:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:35:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:35:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:35:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:35:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:35:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:35:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:35:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:35:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:35:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:35:14 - job_xml_thread(): Done retrieving: data size 43495905
Sun 19 Jan 2014 04:35:14 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:35:14 - XML: Start document: iteration 15
Sun 19 Jan 2014 04:35:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43495905
Sun 19 Jan 2014 04:35:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:35:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43495905
Sun 19 Jan 2014 04:35:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:35:26 - XML: Processed 652597 elements - found 0 jobs
Sun 19 Jan 2014 04:35:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:35:26 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:35:26 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:35:26 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:35:26 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:35:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:35:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:35:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:35:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:35:31 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:35:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:35:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:35:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:35:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:35:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:35:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:35:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:35:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:35:34 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:35:34 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:35:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:35:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 04:35:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:35:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:35:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:35:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:35:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:35:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:35:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:35:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43023203
Sun 19 Jan 2014 04:35:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:35:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43023203
Sun 19 Jan 2014 04:35:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:35:41 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:35:41 - job_xml_thread(): Done retrieving: data size 43023203
Sun 19 Jan 2014 04:35:41 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:35:41 - XML: Start document: iteration 16
Sun 19 Jan 2014 04:35:43 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 04:35:43 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:35:45 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:35:45 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 04:35:45 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 04:35:45 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:35:45 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 04:35:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:35:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:35:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:35:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:35:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:35:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:35:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:35:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:35:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:35:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:35:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:35:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:35:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:35:55 - size of cluster 'LISA Cluster': 624 hosts 79473 metrics 847547 values 13382532 bits 1672816 bytes 
Sun 19 Jan 2014 04:35:56 - XML: Processed 646410 elements - found 0 jobs
Sun 19 Jan 2014 04:35:56 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:35:56 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:35:56 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:35:56 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:35:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:35:59 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:35:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:35:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:36:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:36:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:36:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:36:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:36:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:36:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42901299
Sun 19 Jan 2014 04:36:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:36:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42901299
Sun 19 Jan 2014 04:36:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:36:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:36:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:36:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:36:07 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:36:08 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:36:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:36:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 04:36:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 04:36:08 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:36:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9192 values 145004 bits 18125 bytes 
Sun 19 Jan 2014 04:36:11 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:36:11 - job_xml_thread(): Done retrieving: data size 42901299
Sun 19 Jan 2014 04:36:11 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:36:11 - XML: Start document: iteration 17
Sun 19 Jan 2014 04:36:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:36:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:36:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:36:18 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:36:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:36:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:36:19 - XML: Processed 645174 elements - found 0 jobs
Sun 19 Jan 2014 04:36:19 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:36:19 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:36:19 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:36:19 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:36:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:36:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:36:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:36:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:36:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:36:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:36:24 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:36:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:36:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:36:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:36:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:36:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:36:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:36:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:36:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43035212
Sun 19 Jan 2014 04:36:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:36:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43035212
Sun 19 Jan 2014 04:36:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:36:34 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:36:34 - job_xml_thread(): Done retrieving: data size 43035212
Sun 19 Jan 2014 04:36:34 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:36:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:36:34 - XML: Start document: iteration 18
Sun 19 Jan 2014 04:36:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:36:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:36:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:36:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:36:44 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:36:44 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:36:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 04:36:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:36:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:36:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:36:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:36:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:36:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:36:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:36:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:36:45 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:36:45 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 04:36:49 - XML: Processed 646796 elements - found 0 jobs
Sun 19 Jan 2014 04:36:49 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:36:49 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:36:49 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:36:49 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:36:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:36:52 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:36:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:36:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:36:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:36:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:36:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:36:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:36:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:36:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43535221
Sun 19 Jan 2014 04:36:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:36:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43535221
Sun 19 Jan 2014 04:36:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:37:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:37:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:37:04 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:37:04 - job_xml_thread(): Done retrieving: data size 43535221
Sun 19 Jan 2014 04:37:04 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:37:04 - XML: Start document: iteration 19
Sun 19 Jan 2014 04:37:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:37:06 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:37:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:37:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:37:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:37:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:37:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:37:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:37:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:37:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:37:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:37:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:37:08 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:37:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:37:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 04:37:08 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:37:08 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:37:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 04:37:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5838 values 92061 bits 11507 bytes 
Sun 19 Jan 2014 04:37:17 - XML: Processed 652758 elements - found 0 jobs
Sun 19 Jan 2014 04:37:17 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:37:17 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:37:17 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:37:17 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:37:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:37:18 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:37:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:37:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:37:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:37:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:37:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:37:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:37:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:37:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:37:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:37:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43552744
Sun 19 Jan 2014 04:37:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:37:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43552744
Sun 19 Jan 2014 04:37:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:37:32 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:37:32 - job_xml_thread(): Done retrieving: data size 43552744
Sun 19 Jan 2014 04:37:32 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:37:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:37:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:37:32 - XML: Start document: iteration 20
Sun 19 Jan 2014 04:37:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:37:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:37:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:37:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:37:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:37:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:37:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:37:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:37:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:37:38 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:37:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 04:37:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:37:41 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 04:37:41 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:37:41 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:37:41 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:37:41 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:37:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:37:45 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:37:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:37:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:37:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:37:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:37:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:37:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:37:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:37:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43547304
Sun 19 Jan 2014 04:37:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:37:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43547304
Sun 19 Jan 2014 04:37:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:37:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:37:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:37:56 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:37:56 - job_xml_thread(): Done retrieving: data size 43547304
Sun 19 Jan 2014 04:37:56 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:37:56 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 04:37:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:37:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:37:56 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 04:37:56 - Housekeeping: done.
Sun 19 Jan 2014 04:37:56 - XML: Start document: iteration 0
Sun 19 Jan 2014 04:37:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:37:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:38:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:38:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:38:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:38:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:38:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:38:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:38:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:38:04 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 04:38:04 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:38:04 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:38:04 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:38:04 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:38:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:38:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:38:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:38:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:38:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:38:09 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:38:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:38:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:38:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:38:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:38:09 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:38:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:38:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 04:38:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 04:38:09 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:38:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5950 values 93861 bits 11732 bytes 
Sun 19 Jan 2014 04:38:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:38:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567752
Sun 19 Jan 2014 04:38:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:38:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567752
Sun 19 Jan 2014 04:38:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:38:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:38:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:38:19 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:38:19 - job_xml_thread(): Done retrieving: data size 43567752
Sun 19 Jan 2014 04:38:19 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:38:19 - XML: Start document: iteration 1
Sun 19 Jan 2014 04:38:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:38:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:38:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:38:30 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:38:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:38:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:38:31 - XML: Processed 653347 elements - found 0 jobs
Sun 19 Jan 2014 04:38:31 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:38:31 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:38:31 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:38:31 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:38:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:38:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:38:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:38:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:38:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:38:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:38:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:38:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:38:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:38:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:38:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:38:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:38:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:38:35 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:38:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 04:38:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:38:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:38:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43593246
Sun 19 Jan 2014 04:38:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:38:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43593246
Sun 19 Jan 2014 04:38:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:38:46 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:38:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:38:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:38:47 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:38:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:38:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:38:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:38:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:38:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:38:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:38:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:38:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:38:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:38:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:38:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:38:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:38:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:38:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:38:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:38:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:38:51 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 04:38:51 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 04:38:51 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:38:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:38:53 - job_xml_thread(): Done retrieving: data size 43591641
Sun 19 Jan 2014 04:38:53 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:38:53 - XML: Start document: iteration 2
Sun 19 Jan 2014 04:38:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43591641
Sun 19 Jan 2014 04:38:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:38:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43591641
Sun 19 Jan 2014 04:38:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:39:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:39:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:39:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:39:04 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:39:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:39:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:39:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:39:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:39:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:39:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:39:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:39:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:39:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:39:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:39:10 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:39:10 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:39:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:39:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 04:39:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 04:39:10 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:39:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8064 values 127152 bits 15894 bytes 
Sun 19 Jan 2014 04:39:12 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 04:39:12 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:39:12 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:39:12 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:39:12 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:39:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:39:15 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:39:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:39:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:39:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:39:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:39:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:39:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:39:17 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:39:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 04:39:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:39:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:39:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43549814
Sun 19 Jan 2014 04:39:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:39:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43549814
Sun 19 Jan 2014 04:39:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:39:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:39:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:39:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:39:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:39:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:39:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:39:27 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:39:27 - job_xml_thread(): Done retrieving: data size 43549814
Sun 19 Jan 2014 04:39:27 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:39:27 - XML: Start document: iteration 3
Sun 19 Jan 2014 04:39:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:39:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:39:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:39:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:39:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43549814
Sun 19 Jan 2014 04:39:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:39:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:39:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:39:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:39:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:39:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:39:43 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:39:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:39:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:39:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:39:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:39:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:39:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:39:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:39:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:39:45 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:39:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:39:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:39:46 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 04:39:46 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:39:46 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:39:46 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:39:46 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:39:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:39:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:39:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:39:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:39:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:39:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583412
Sun 19 Jan 2014 04:39:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:39:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583412
Sun 19 Jan 2014 04:39:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:40:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:40:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:40:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:40:00 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:40:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:40:01 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:40:01 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:40:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:40:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:40:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:40:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:40:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:40:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:40:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:40:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:40:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:40:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:40:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:40:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:40:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:40:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:40:03 - job_xml_thread(): Done retrieving: data size 43592406
Sun 19 Jan 2014 04:40:03 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:40:03 - XML: Start document: iteration 4
Sun 19 Jan 2014 04:40:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43592406
Sun 19 Jan 2014 04:40:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43592406
Sun 19 Jan 2014 04:40:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:40:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:40:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:40:12 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:40:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:40:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 04:40:13 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:40:14 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:40:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 04:40:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148548 bits 18568 bytes 
Sun 19 Jan 2014 04:40:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:40:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:40:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:40:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:40:20 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 04:40:20 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:40:20 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:40:20 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:40:20 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:40:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:40:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:40:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:40:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:40:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:40:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:40:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:40:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:40:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:40:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:40:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:40:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:40:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:40:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:40:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:40:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:40:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:40:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:40:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43587663
Sun 19 Jan 2014 04:40:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:40:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43587663
Sun 19 Jan 2014 04:40:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:40:35 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:40:35 - job_xml_thread(): Done retrieving: data size 43587663
Sun 19 Jan 2014 04:40:35 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:40:35 - XML: Start document: iteration 5
Sun 19 Jan 2014 04:40:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:40:36 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:40:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:40:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:40:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:40:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:40:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:40:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:40:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:40:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:40:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:40:45 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 04:40:45 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:40:45 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:40:45 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:40:45 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:40:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:40:48 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:40:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:40:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:40:48 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:40:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 04:40:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:40:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:40:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:40:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:40:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:40:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:40:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563760
Sun 19 Jan 2014 04:40:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:40:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563760
Sun 19 Jan 2014 04:40:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:40:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:40:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:41:00 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:41:00 - job_xml_thread(): Done retrieving: data size 43563760
Sun 19 Jan 2014 04:41:00 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:41:00 - XML: Start document: iteration 6
Sun 19 Jan 2014 04:41:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:41:00 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:41:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:41:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:41:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:41:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:41:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:41:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:41:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:41:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:41:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:41:10 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 04:41:10 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:41:10 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:41:10 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:41:10 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:41:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:41:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:41:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:41:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:41:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:41:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:41:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:41:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:41:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:41:14 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:41:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:41:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 04:41:14 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:41:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5798 values 91419 bits 11427 bytes 
Sun 19 Jan 2014 04:41:14 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:41:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 04:41:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:41:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43544790
Sun 19 Jan 2014 04:41:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:41:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43544790
Sun 19 Jan 2014 04:41:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:41:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:41:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:41:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:41:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:41:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:41:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:41:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:41:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:41:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:41:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:41:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:41:26 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:41:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:41:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:41:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:41:29 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:41:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:41:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:41:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:41:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:41:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:41:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:41:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:41:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43454115
Sun 19 Jan 2014 04:41:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:41:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43454115
Sun 19 Jan 2014 04:41:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:41:33 - job_xml_thread(): Done retrieving: data size 43454115
Sun 19 Jan 2014 04:41:33 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:41:33 - XML: Start document: iteration 7
Sun 19 Jan 2014 04:41:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:41:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:41:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:41:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:41:45 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:41:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 04:41:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:41:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:41:47 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:41:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:41:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:41:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:41:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:41:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:41:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:41:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:41:51 - XML: Processed 652080 elements - found 0 jobs
Sun 19 Jan 2014 04:41:51 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:41:51 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:41:51 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:41:51 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:41:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:41:53 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:41:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:41:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:41:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:41:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:41:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:41:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:41:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:41:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42928540
Sun 19 Jan 2014 04:41:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:41:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42928540
Sun 19 Jan 2014 04:41:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:42:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:42:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:42:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:42:04 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:42:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:42:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:42:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:42:06 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:42:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:42:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:42:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:42:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:42:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:42:07 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:42:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:42:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:42:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:42:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:42:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:42:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:42:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:42:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42929633
Sun 19 Jan 2014 04:42:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:42:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42929633
Sun 19 Jan 2014 04:42:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:42:10 - job_xml_thread(): Done retrieving: data size 42929633
Sun 19 Jan 2014 04:42:10 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:42:11 - XML: Start document: iteration 8
Sun 19 Jan 2014 04:42:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:42:14 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:42:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:42:15 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:42:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 04:42:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 04:42:15 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:42:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9520 values 150105 bits 18763 bytes 
Sun 19 Jan 2014 04:42:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:42:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:42:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:42:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:42:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:42:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:42:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:42:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:42:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:42:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:42:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:42:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:42:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:42:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:42:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:42:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:42:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:42:31 - XML: Processed 645186 elements - found 0 jobs
Sun 19 Jan 2014 04:42:31 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:42:31 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:42:31 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:42:31 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:42:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:42:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:42:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:42:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:42:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:42:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43039915
Sun 19 Jan 2014 04:42:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:42:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43039915
Sun 19 Jan 2014 04:42:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:42:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:42:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:42:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:42:44 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:42:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:42:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:42:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:42:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:42:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:42:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:42:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:42:45 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 04:42:45 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:42:46 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:42:46 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:42:46 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:42:46 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 04:42:46 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 04:42:46 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 04:42:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:42:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:42:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:42:47 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:42:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:42:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:42:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:42:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:42:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:42:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:42:48 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 866147 values 13651317 bits 1706414 bytes 
Sun 19 Jan 2014 04:42:50 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:42:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 04:42:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:42:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:42:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43534550
Sun 19 Jan 2014 04:42:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:42:53 - job_xml_thread(): Done retrieving: data size 43534550
Sun 19 Jan 2014 04:42:53 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:42:53 - XML: Start document: iteration 9
Sun 19 Jan 2014 04:42:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43534550
Sun 19 Jan 2014 04:42:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:43:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:43:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:43:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:43:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:43:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:43:04 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:43:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:43:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:43:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:43:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:43:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:43:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:43:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:43:14 - XML: Processed 652642 elements - found 0 jobs
Sun 19 Jan 2014 04:43:14 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:43:14 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:43:14 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:43:14 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:43:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:43:15 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:43:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:43:16 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:43:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:43:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:43:16 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:43:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:43:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 04:43:16 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:43:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 04:43:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5190 values 81826 bits 10228 bytes 
Sun 19 Jan 2014 04:43:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:43:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:43:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:43:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:43:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:43:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43552387
Sun 19 Jan 2014 04:43:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:43:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43552387
Sun 19 Jan 2014 04:43:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:43:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:43:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:43:29 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:43:29 - job_xml_thread(): Done retrieving: data size 43552387
Sun 19 Jan 2014 04:43:29 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:43:29 - XML: Start document: iteration 10
Sun 19 Jan 2014 04:43:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:43:31 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:43:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:43:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:43:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:43:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:43:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:43:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:43:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:43:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:43:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:43:42 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 04:43:42 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:43:42 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:43:42 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:43:42 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:43:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:43:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:43:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:43:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:43:44 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:43:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 04:43:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:43:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:43:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:43:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:43:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:43:46 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:43:46 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 04:43:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:43:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43546479
Sun 19 Jan 2014 04:43:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:43:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43546479
Sun 19 Jan 2014 04:43:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:43:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:43:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:43:57 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:43:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:43:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:43:58 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:43:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:43:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:43:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:43:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:43:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:43:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:43:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:43:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:44:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:44:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:44:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:44:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:44:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:44:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:44:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:44:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:44:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:44:05 - job_xml_thread(): Done retrieving: data size 43575052
Sun 19 Jan 2014 04:44:05 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:44:05 - XML: Start document: iteration 11
Sun 19 Jan 2014 04:44:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575052
Sun 19 Jan 2014 04:44:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:44:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575052
Sun 19 Jan 2014 04:44:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:44:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:44:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:44:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:44:16 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:44:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:44:17 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:44:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 04:44:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 04:44:17 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:44:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8147 values 128406 bits 16050 bytes 
Sun 19 Jan 2014 04:44:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:44:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:44:22 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 04:44:22 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:44:22 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:44:22 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:44:22 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:44:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:44:25 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:44:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:44:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:44:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:44:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:44:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:44:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:44:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:44:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:44:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:44:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:44:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:44:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:44:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:44:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:44:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:44:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:44:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572678
Sun 19 Jan 2014 04:44:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:44:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572678
Sun 19 Jan 2014 04:44:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:44:38 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:44:38 - job_xml_thread(): Done retrieving: data size 43572678
Sun 19 Jan 2014 04:44:38 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:44:38 - XML: Start document: iteration 12
Sun 19 Jan 2014 04:44:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:44:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:44:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:44:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:44:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:44:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:44:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:44:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:44:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:44:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:44:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:44:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:44:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:44:54 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 04:44:54 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:44:54 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:44:54 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:44:54 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:44:55 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:44:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 04:44:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:44:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:44:57 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:44:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:44:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:44:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:44:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:44:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:44:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:45:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:45:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564089
Sun 19 Jan 2014 04:45:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:45:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564089
Sun 19 Jan 2014 04:45:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:45:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:45:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:45:09 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:45:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:45:09 - job_xml_thread(): Done retrieving: data size 43564089
Sun 19 Jan 2014 04:45:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:45:09 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:45:09 - XML: Start document: iteration 13
Sun 19 Jan 2014 04:45:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:45:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:45:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:45:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:45:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:45:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:45:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:45:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:45:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:45:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:45:17 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:45:18 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:45:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:45:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 04:45:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 04:45:18 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:45:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5789 values 91258 bits 11407 bytes 
Sun 19 Jan 2014 04:45:20 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 04:45:20 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:45:20 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:45:20 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:45:20 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:45:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:45:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:45:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:45:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:45:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:45:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:45:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:45:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:45:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:45:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:45:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:45:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559449
Sun 19 Jan 2014 04:45:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:45:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559449
Sun 19 Jan 2014 04:45:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:45:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:45:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:45:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:45:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:45:35 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:45:35 - job_xml_thread(): Done retrieving: data size 43559449
Sun 19 Jan 2014 04:45:35 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:45:35 - XML: Start document: iteration 14
Sun 19 Jan 2014 04:45:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:45:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:45:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:45:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559449
Sun 19 Jan 2014 04:45:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:45:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:45:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:45:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:45:42 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:45:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 04:45:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:45:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:45:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:45:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:45:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:45:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:45:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:45:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:45:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:45:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:45:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:45:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:45:54 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 04:45:54 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:45:54 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:45:54 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:45:54 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:45:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:45:55 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:45:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:45:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:45:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:45:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:45:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:45:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:45:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:45:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568134
Sun 19 Jan 2014 04:45:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:45:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568134
Sun 19 Jan 2014 04:45:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:46:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:46:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:46:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:46:09 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:46:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:46:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:46:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:46:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:46:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:46:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:46:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:46:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:46:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:46:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:46:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:46:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:46:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:46:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:46:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:46:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:46:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:46:15 - job_xml_thread(): Done retrieving: data size 43573162
Sun 19 Jan 2014 04:46:15 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:46:15 - XML: Start document: iteration 15
Sun 19 Jan 2014 04:46:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573162
Sun 19 Jan 2014 04:46:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:46:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573162
Sun 19 Jan 2014 04:46:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:46:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:46:18 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:46:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:46:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 04:46:18 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:46:18 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:46:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 04:46:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9204 values 145230 bits 18153 bytes 
Sun 19 Jan 2014 04:46:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:46:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:46:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:46:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:46:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:46:29 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:46:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:46:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:46:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:46:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:46:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:46:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:46:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:46:35 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 04:46:35 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:46:35 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:46:35 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:46:35 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:46:37 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 04:46:37 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 04:46:37 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:46:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:46:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:46:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:46:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:46:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:46:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:46:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:46:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:46:39 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:46:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 04:46:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:46:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:46:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568723
Sun 19 Jan 2014 04:46:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:46:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568723
Sun 19 Jan 2014 04:46:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:46:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:46:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:46:50 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:46:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:46:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:46:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:46:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:46:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:46:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:46:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:46:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:46:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:46:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:46:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:46:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:46:55 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:46:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:46:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:46:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:46:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:46:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:46:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:46:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:46:56 - job_xml_thread(): Done retrieving: data size 43568170
Sun 19 Jan 2014 04:46:56 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:46:56 - XML: Start document: iteration 16
Sun 19 Jan 2014 04:46:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568170
Sun 19 Jan 2014 04:46:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568170
Sun 19 Jan 2014 04:46:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:46:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:47:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:47:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:47:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:47:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:47:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:47:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:47:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:47:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:47:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:47:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:47:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:47:16 - XML: Processed 653345 elements - found 0 jobs
Sun 19 Jan 2014 04:47:16 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:47:16 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:47:16 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:47:16 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:47:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:47:18 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:47:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:47:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:47:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:47:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:47:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:47:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:47:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:47:18 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:47:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:47:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43509541
Sun 19 Jan 2014 04:47:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:47:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:47:19 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:47:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 04:47:19 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:47:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 04:47:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43509541
Sun 19 Jan 2014 04:47:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:47:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 149142 bits 18642 bytes 
Sun 19 Jan 2014 04:47:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:47:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:47:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:47:27 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:47:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:47:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:47:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:47:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:47:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:47:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43509541
Sun 19 Jan 2014 04:47:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:47:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:47:31 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:47:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:47:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:47:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:47:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:47:39 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:47:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:47:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:47:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:47:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:47:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:47:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:47:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:47:39 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:47:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:47:41 - job_xml_thread(): Done retrieving: data size 43000567
Sun 19 Jan 2014 04:47:41 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:47:41 - XML: Start document: iteration 17
Sun 19 Jan 2014 04:47:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43000567
Sun 19 Jan 2014 04:47:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:47:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:47:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:47:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:47:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:47:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:47:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:47:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43000567
Sun 19 Jan 2014 04:47:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:47:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:47:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:47:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:47:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:48:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:48:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:48:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:48:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:48:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:48:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:48:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:48:01 - XML: Processed 646444 elements - found 0 jobs
Sun 19 Jan 2014 04:48:01 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:48:02 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:48:02 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:48:02 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:48:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:48:05 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:48:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:48:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:48:05 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:48:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 04:48:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:48:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:48:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:48:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:48:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:48:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:48:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42936093
Sun 19 Jan 2014 04:48:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:48:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42936093
Sun 19 Jan 2014 04:48:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:48:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:48:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:48:17 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:48:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:48:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:48:19 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:48:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:48:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:48:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:48:19 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:48:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:48:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:48:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:48:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:48:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:48:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 04:48:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:48:21 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:48:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 04:48:21 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:48:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:48:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5779 values 91341 bits 11417 bytes 
Sun 19 Jan 2014 04:48:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:48:21 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:48:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:48:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:48:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:48:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:48:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:48:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:48:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:48:23 - job_xml_thread(): Done retrieving: data size 42998614
Sun 19 Jan 2014 04:48:23 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:48:23 - XML: Start document: iteration 18
Sun 19 Jan 2014 04:48:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42998614
Sun 19 Jan 2014 04:48:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42998614
Sun 19 Jan 2014 04:48:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:48:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:48:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:48:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:48:37 - XML: Processed 645900 elements - found 0 jobs
Sun 19 Jan 2014 04:48:37 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:48:37 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:48:37 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:48:37 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:48:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:48:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:48:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:48:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:48:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:48:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:48:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:48:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:48:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:48:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:48:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:48:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:48:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:48:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:48:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:48:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:48:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:48:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:48:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:48:45 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:48:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 04:48:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:48:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:48:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43496384
Sun 19 Jan 2014 04:48:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:48:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43496384
Sun 19 Jan 2014 04:48:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:48:52 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:48:52 - job_xml_thread(): Done retrieving: data size 43496384
Sun 19 Jan 2014 04:48:52 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:48:52 - XML: Start document: iteration 19
Sun 19 Jan 2014 04:48:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:48:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:48:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:48:59 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:48:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:48:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:48:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:48:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:49:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:49:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:49:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:49:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:49:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:49:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:49:06 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:49:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:49:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:49:07 - XML: Processed 652374 elements - found 0 jobs
Sun 19 Jan 2014 04:49:07 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:49:07 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:49:07 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:49:07 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:49:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:49:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:49:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:49:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:49:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:49:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571956
Sun 19 Jan 2014 04:49:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:49:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571956
Sun 19 Jan 2014 04:49:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:49:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:49:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:49:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:49:18 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:49:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:49:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:49:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:49:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:49:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:49:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:49:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:49:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:49:21 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:49:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:49:21 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:49:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:49:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:49:22 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:49:22 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:49:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 04:49:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:49:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 04:49:22 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:49:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8844 values 139488 bits 17436 bytes 
Sun 19 Jan 2014 04:49:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:49:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43598542
Sun 19 Jan 2014 04:49:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:49:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:49:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:49:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:49:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:49:23 - job_xml_thread(): Done retrieving: data size 43598542
Sun 19 Jan 2014 04:49:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43598542
Sun 19 Jan 2014 04:49:23 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:49:23 - XML: Start document: iteration 20
Sun 19 Jan 2014 04:49:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:49:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:49:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:49:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:49:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:49:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:49:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:49:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:49:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:49:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:49:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:49:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:49:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:49:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:49:44 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 04:49:44 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:49:44 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:49:44 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:49:44 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:49:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:49:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:49:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:49:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:49:46 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 04:49:46 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:49:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:49:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:49:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:49:46 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:49:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:49:46 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 04:49:46 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 04:49:46 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:49:47 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 04:49:48 - size of cluster 'LISA Cluster': 624 hosts 79481 metrics 859659 values 13575640 bits 1696955 bytes 
Sun 19 Jan 2014 04:49:49 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:49:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 04:49:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:49:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:49:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573096
Sun 19 Jan 2014 04:49:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:49:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573096
Sun 19 Jan 2014 04:49:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:49:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:49:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:49:59 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:49:59 - job_xml_thread(): Done retrieving: data size 43573096
Sun 19 Jan 2014 04:49:59 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:49:59 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 04:49:59 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 04:49:59 - Housekeeping: done.
Sun 19 Jan 2014 04:49:59 - XML: Start document: iteration 0
Sun 19 Jan 2014 04:50:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:50:00 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:50:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:50:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:50:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:50:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:50:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:50:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:50:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:50:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:50:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:50:10 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 04:50:10 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:50:10 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:50:10 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:50:10 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:50:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:50:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:50:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:50:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:50:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:50:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:50:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:50:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:50:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:50:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43542227
Sun 19 Jan 2014 04:50:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:50:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43542227
Sun 19 Jan 2014 04:50:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:50:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:50:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:50:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:50:23 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:50:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:50:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 04:50:24 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:50:24 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:50:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7106 values 112057 bits 14007 bytes 
Sun 19 Jan 2014 04:50:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 04:50:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:50:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:50:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:50:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:50:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:50:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:50:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:50:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43542227
Sun 19 Jan 2014 04:50:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:50:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:50:25 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:50:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:50:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:50:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:50:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:50:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:50:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:50:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:50:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:50:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:50:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:50:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:50:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:50:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:50:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:50:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:50:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:50:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:50:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:50:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:50:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:50:42 - job_xml_thread(): Done retrieving: data size 43555949
Sun 19 Jan 2014 04:50:42 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:50:42 - XML: Start document: iteration 1
Sun 19 Jan 2014 04:50:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555949
Sun 19 Jan 2014 04:50:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:50:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555949
Sun 19 Jan 2014 04:50:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:50:47 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:50:47 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 04:50:51 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:50:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 04:50:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:50:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:50:54 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:50:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:50:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:50:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:50:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:50:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:50:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:50:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:50:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:50:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:50:59 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 04:50:59 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:51:00 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:51:00 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:51:00 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:51:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:51:05 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:51:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:51:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:51:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:51:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:51:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:51:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:51:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:51:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576951
Sun 19 Jan 2014 04:51:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:51:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576951
Sun 19 Jan 2014 04:51:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:51:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:51:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:51:15 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:51:15 - job_xml_thread(): Done retrieving: data size 43576951
Sun 19 Jan 2014 04:51:15 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:51:15 - XML: Start document: iteration 2
Sun 19 Jan 2014 04:51:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:51:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:51:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:51:24 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:51:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:51:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 04:51:24 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:51:24 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:51:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 04:51:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:51:25 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:51:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:51:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:51:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6221 values 98092 bits 12261 bytes 
Sun 19 Jan 2014 04:51:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:51:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:51:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:51:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:51:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:51:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:51:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:51:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:51:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:51:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:51:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:51:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:51:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:51:30 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 04:51:30 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:51:30 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:51:30 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:51:30 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:51:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:51:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575509
Sun 19 Jan 2014 04:51:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:51:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575509
Sun 19 Jan 2014 04:51:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:51:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:51:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:51:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:51:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:51:46 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:51:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:51:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:51:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:51:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:51:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:51:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:51:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:51:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:51:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:51:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:51:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:51:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:51:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:51:51 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:51:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 04:51:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:51:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:51:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:51:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:51:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:51:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:51:53 - job_xml_thread(): Done retrieving: data size 43588707
Sun 19 Jan 2014 04:51:53 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:51:53 - XML: Start document: iteration 3
Sun 19 Jan 2014 04:51:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43588707
Sun 19 Jan 2014 04:51:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:51:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43588707
Sun 19 Jan 2014 04:51:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:52:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:52:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:52:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:52:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:52:10 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 04:52:10 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:52:10 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:52:10 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:52:10 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:52:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:52:14 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:52:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:52:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:52:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:52:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:52:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:52:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:52:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:52:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:52:17 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:52:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:52:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:52:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:52:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:52:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:52:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:52:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:52:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43597849
Sun 19 Jan 2014 04:52:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:52:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43597849
Sun 19 Jan 2014 04:52:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:52:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:52:24 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:52:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:52:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 04:52:25 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:52:25 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:52:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 04:52:25 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:52:25 - job_xml_thread(): Done retrieving: data size 43597849
Sun 19 Jan 2014 04:52:25 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:52:25 - XML: Start document: iteration 4
Sun 19 Jan 2014 04:52:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8825 values 139145 bits 17393 bytes 
Sun 19 Jan 2014 04:52:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:52:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:52:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:52:31 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:52:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:52:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:52:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:52:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:52:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:52:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:52:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:52:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:52:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:52:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:52:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:52:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:52:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:52:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:52:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:52:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:52:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:52:44 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 04:52:44 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:52:44 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:52:44 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:52:44 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:52:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:52:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:52:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:52:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43547595
Sun 19 Jan 2014 04:52:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:52:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43547595
Sun 19 Jan 2014 04:52:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:52:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:52:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:52:59 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:52:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:53:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:53:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:53:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:53:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:53:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:53:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:53:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:53:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:53:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:53:05 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:53:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:53:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:53:05 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:53:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 04:53:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:53:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:53:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:53:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:53:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:53:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:53:08 - job_xml_thread(): Done retrieving: data size 43588276
Sun 19 Jan 2014 04:53:08 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:53:08 - XML: Start document: iteration 5
Sun 19 Jan 2014 04:53:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43588276
Sun 19 Jan 2014 04:53:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:53:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43588276
Sun 19 Jan 2014 04:53:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:53:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:53:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:53:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:53:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:53:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:53:25 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:53:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:53:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:53:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:53:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:53:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:53:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:53:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:53:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:53:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:53:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:53:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 04:53:26 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:53:26 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:53:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 04:53:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5872 values 92616 bits 11577 bytes 
Sun 19 Jan 2014 04:53:28 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 04:53:28 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:53:28 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:53:28 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:53:28 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:53:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:53:32 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:53:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:53:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:53:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:53:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:53:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:53:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:53:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:53:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43192731
Sun 19 Jan 2014 04:53:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:53:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43192731
Sun 19 Jan 2014 04:53:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:53:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:53:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:53:43 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:53:43 - job_xml_thread(): Done retrieving: data size 43192731
Sun 19 Jan 2014 04:53:43 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:53:43 - XML: Start document: iteration 6
Sun 19 Jan 2014 04:53:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:53:44 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:53:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:53:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:53:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:53:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:53:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:53:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:53:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43192731
Sun 19 Jan 2014 04:53:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:53:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:53:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:53:55 - XML: Processed 648664 elements - found 0 jobs
Sun 19 Jan 2014 04:53:55 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:53:55 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:53:55 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:53:55 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:54:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:54:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:54:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:54:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:54:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:54:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:54:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:54:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:54:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:54:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:54:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:54:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:54:03 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:54:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:54:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:54:03 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:54:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 04:54:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:54:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:54:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:54:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:54:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:54:05 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 04:54:05 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 04:54:05 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:54:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:54:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42936896
Sun 19 Jan 2014 04:54:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:54:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42936896
Sun 19 Jan 2014 04:54:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:54:10 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:54:10 - job_xml_thread(): Done retrieving: data size 42936896
Sun 19 Jan 2014 04:54:10 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:54:10 - XML: Start document: iteration 7
Sun 19 Jan 2014 04:54:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:54:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:54:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:54:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:54:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:54:19 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:54:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:54:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:54:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:54:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:54:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:54:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:54:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:54:22 - XML: Processed 645150 elements - found 0 jobs
Sun 19 Jan 2014 04:54:22 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:54:22 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:54:22 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:54:22 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:54:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:54:26 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:54:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:54:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:54:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:54:26 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:54:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:54:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 04:54:27 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:54:27 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:54:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 04:54:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6048 values 95375 bits 11921 bytes 
Sun 19 Jan 2014 04:54:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:54:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:54:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:54:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:54:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:54:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42965577
Sun 19 Jan 2014 04:54:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:54:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42965577
Sun 19 Jan 2014 04:54:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:54:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:54:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:54:37 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:54:37 - job_xml_thread(): Done retrieving: data size 42965577
Sun 19 Jan 2014 04:54:38 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:54:38 - XML: Start document: iteration 8
Sun 19 Jan 2014 04:54:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:54:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:54:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:54:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:54:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:54:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:54:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:54:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:54:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:54:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:54:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:54:50 - XML: Processed 645908 elements - found 0 jobs
Sun 19 Jan 2014 04:54:50 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:54:50 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:54:51 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:54:51 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:54:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:54:51 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:54:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:54:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:54:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:54:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:54:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:54:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:54:53 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:54:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 04:54:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:54:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:54:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43524802
Sun 19 Jan 2014 04:54:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:54:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43524802
Sun 19 Jan 2014 04:54:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:54:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:54:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:55:06 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:55:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:55:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:55:07 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:55:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:55:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:55:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:55:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:55:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:55:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:55:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:55:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:55:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:55:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:55:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:55:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:55:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:55:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:55:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:55:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:55:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:55:10 - job_xml_thread(): Done retrieving: data size 43563610
Sun 19 Jan 2014 04:55:10 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:55:10 - XML: Start document: iteration 9
Sun 19 Jan 2014 04:55:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563610
Sun 19 Jan 2014 04:55:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563610
Sun 19 Jan 2014 04:55:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:55:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:55:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:55:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:55:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:55:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:55:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:55:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:55:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:55:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:55:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:55:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:55:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:55:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:55:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:55:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:55:27 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:55:27 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:55:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:55:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 04:55:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 04:55:27 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:55:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7454 values 117487 bits 14685 bytes 
Sun 19 Jan 2014 04:55:29 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 04:55:29 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:55:29 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:55:29 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:55:29 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:55:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:55:31 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:55:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:55:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:55:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:55:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:55:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:55:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:55:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:55:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573736
Sun 19 Jan 2014 04:55:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:55:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573736
Sun 19 Jan 2014 04:55:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:55:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:55:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:55:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:55:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:55:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:55:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:55:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:55:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:55:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:55:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573736
Sun 19 Jan 2014 04:55:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:55:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:55:44 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:55:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:55:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:55:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:55:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:55:52 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:55:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:55:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:55:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:55:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:55:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:55:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:55:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:55:54 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:55:55 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:55:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 04:55:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:55:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:55:56 - job_xml_thread(): Done retrieving: data size 43543960
Sun 19 Jan 2014 04:55:56 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:55:56 - XML: Start document: iteration 10
Sun 19 Jan 2014 04:55:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43543960
Sun 19 Jan 2014 04:55:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:55:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:55:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:55:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:55:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:55:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:56:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:56:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43543960
Sun 19 Jan 2014 04:56:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:56:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:56:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:56:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:56:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:56:13 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 04:56:13 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:56:13 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:56:13 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:56:13 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:56:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:56:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:56:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:56:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:56:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:56:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:56:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:56:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:56:18 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:56:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:56:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:56:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:56:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:56:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:56:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:56:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:56:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43605599
Sun 19 Jan 2014 04:56:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:56:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43605599
Sun 19 Jan 2014 04:56:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:56:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:56:27 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:56:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:56:27 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:56:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 04:56:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 04:56:28 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:56:28 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:56:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8937 values 140918 bits 17614 bytes 
Sun 19 Jan 2014 04:56:28 - job_xml_thread(): Done retrieving: data size 43605599
Sun 19 Jan 2014 04:56:28 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:56:28 - XML: Start document: iteration 11
Sun 19 Jan 2014 04:56:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:56:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:56:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:56:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:56:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:56:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:56:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:56:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:56:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:56:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:56:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:56:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:56:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:56:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:56:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:56:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:56:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:56:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:56:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:56:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:56:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:56:40 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 04:56:40 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:56:40 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:56:40 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:56:40 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:56:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:56:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563741
Sun 19 Jan 2014 04:56:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:56:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563741
Sun 19 Jan 2014 04:56:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:56:47 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 04:56:47 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:56:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:56:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:56:48 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:56:48 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 04:56:48 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:56:48 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 04:56:48 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 04:56:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:56:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:56:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:56:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:56:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:56:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:56:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:56:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:56:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:56:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:56:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563741
Sun 19 Jan 2014 04:56:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:56:55 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:56:55 - XMLGatherer.retrieveData(): actually retrieving data..
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sun 19 Jan 2014 04:57:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:57:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:57:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:57:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:57:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:57:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:57:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:57:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:57:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:57:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:57:05 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:57:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 04:57:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:57:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:57:06 - job_xml_thread(): Done retrieving: data size 43571801
Sun 19 Jan 2014 04:57:06 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:57:06 - XML: Start document: iteration 12
Sun 19 Jan 2014 04:57:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:57:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:57:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571801
Sun 19 Jan 2014 04:57:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:57:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:57:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:57:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:57:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571801
Sun 19 Jan 2014 04:57:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:57:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:57:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:57:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:57:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:57:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:57:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:57:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:57:25 - XML: Processed 653346 elements - found 0 jobs
Sun 19 Jan 2014 04:57:25 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:57:25 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:57:25 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:57:25 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:57:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:57:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:57:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:57:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:57:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:57:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:57:27 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:57:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:57:28 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:57:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:57:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:57:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:57:28 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:57:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 04:57:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 04:57:28 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:57:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5851 values 92239 bits 11529 bytes 
Sun 19 Jan 2014 04:57:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:57:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:57:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:57:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:57:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:57:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43595504
Sun 19 Jan 2014 04:57:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:57:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43595504
Sun 19 Jan 2014 04:57:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:57:41 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:57:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:57:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:57:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:57:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:57:43 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:57:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:57:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:57:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:57:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:57:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:57:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:57:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:57:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:57:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:57:45 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:57:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:57:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:57:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:57:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:57:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:57:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:57:46 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:57:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 04:57:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:57:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:57:47 - job_xml_thread(): Done retrieving: data size 43589583
Sun 19 Jan 2014 04:57:47 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:57:47 - XML: Start document: iteration 13
Sun 19 Jan 2014 04:57:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43589583
Sun 19 Jan 2014 04:57:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:57:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43589583
Sun 19 Jan 2014 04:57:48 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:57:48 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:57:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:57:51 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:57:51 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 04:57:51 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:57:51 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 04:57:51 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 04:57:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:58:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:58:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:58:00 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:58:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:58:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:58:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:58:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:58:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:58:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:58:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:58:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:58:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:58:06 - size of cluster 'LISA Cluster': 624 hosts 79469 metrics 867481 values 13672271 bits 1709033 bytes 
Sun 19 Jan 2014 04:58:07 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 04:58:07 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:58:07 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:58:07 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:58:07 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:58:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:58:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:58:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:58:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:58:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:58:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:58:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:58:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:58:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:58:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43552256
Sun 19 Jan 2014 04:58:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:58:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43552256
Sun 19 Jan 2014 04:58:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:58:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:58:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:58:22 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:58:22 - job_xml_thread(): Done retrieving: data size 43552256
Sun 19 Jan 2014 04:58:22 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:58:22 - XML: Start document: iteration 14
Sun 19 Jan 2014 04:58:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:58:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:58:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:58:27 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:58:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:58:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:58:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:58:28 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:58:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:58:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:58:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:58:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:58:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:58:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:58:30 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:58:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 04:58:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 04:58:31 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:58:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8349 values 131667 bits 16458 bytes 
Sun 19 Jan 2014 04:58:35 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 04:58:35 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:58:35 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:58:35 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:58:35 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:58:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:58:35 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:58:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:58:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:58:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:58:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:58:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:58:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:58:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:58:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574973
Sun 19 Jan 2014 04:58:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:58:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574973
Sun 19 Jan 2014 04:58:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:58:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:58:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:58:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:58:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:58:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:58:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:58:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:58:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:58:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:58:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:58:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574973
Sun 19 Jan 2014 04:58:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:58:50 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:58:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:58:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:58:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:58:51 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:58:51 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 04:59:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:59:00 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:59:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:59:03 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:59:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:59:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:59:03 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:59:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 04:59:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:59:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:59:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:59:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:59:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:59:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:59:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:59:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:59:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:59:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:59:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:59:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:59:06 - job_xml_thread(): Done retrieving: data size 43565835
Sun 19 Jan 2014 04:59:06 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:59:06 - XML: Start document: iteration 15
Sun 19 Jan 2014 04:59:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565835
Sun 19 Jan 2014 04:59:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565835
Sun 19 Jan 2014 04:59:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:59:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:59:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:59:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:59:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:59:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:59:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:59:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:59:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:59:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:59:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:59:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:59:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:59:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:59:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:59:25 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 04:59:25 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:59:25 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:59:25 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:59:25 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:59:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:59:28 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:59:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:59:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:59:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:59:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:59:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:59:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 04:59:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:59:31 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:59:31 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:59:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 04:59:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:59:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 04:59:31 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 04:59:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5872 values 92607 bits 11575 bytes 
Sun 19 Jan 2014 04:59:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 04:59:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43490757
Sun 19 Jan 2014 04:59:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 04:59:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43490757
Sun 19 Jan 2014 04:59:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 04:59:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 04:59:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:59:40 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 04:59:40 - job_xml_thread(): Done retrieving: data size 43490757
Sun 19 Jan 2014 04:59:40 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 04:59:40 - XML: Start document: iteration 16
Sun 19 Jan 2014 04:59:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 04:59:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 04:59:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 04:59:45 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 04:59:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 04:59:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 04:59:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:59:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 04:59:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 04:59:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 04:59:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 04:59:51 - XML: Processed 652596 elements - found 0 jobs
Sun 19 Jan 2014 04:59:51 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 04:59:51 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 04:59:51 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 04:59:51 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 04:59:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 04:59:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 04:59:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 04:59:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 04:59:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:59:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 04:59:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 04:59:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:00:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:00:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42900279
Sun 19 Jan 2014 05:00:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:00:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42900279
Sun 19 Jan 2014 05:00:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:00:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:00:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:00:05 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:00:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 05:00:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:00:06 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:00:06 - job_xml_thread(): Done retrieving: data size 42900279
Sun 19 Jan 2014 05:00:06 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:00:06 - XML: Start document: iteration 17
Sun 19 Jan 2014 05:00:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:00:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:00:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:00:19 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:00:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:00:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:00:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:00:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:00:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:00:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:00:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:00:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:00:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:00:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:00:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:00:22 - XML: Processed 645362 elements - found 0 jobs
Sun 19 Jan 2014 05:00:22 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:00:22 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:00:22 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:00:22 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:00:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:00:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:00:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:00:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:00:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:00:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42971177
Sun 19 Jan 2014 05:00:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:00:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42971177
Sun 19 Jan 2014 05:00:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:00:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:00:31 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:00:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:00:34 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:00:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 05:00:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 05:00:35 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:00:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6659 values 104990 bits 13123 bytes 
Sun 19 Jan 2014 05:00:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:00:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:00:37 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:00:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:00:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:00:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:00:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:00:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:00:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:00:37 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:00:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:00:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:00:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:00:42 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:00:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:00:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:00:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:00:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:00:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:00:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:00:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:00:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43477842
Sun 19 Jan 2014 05:00:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:00:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43477842
Sun 19 Jan 2014 05:00:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:00:45 - job_xml_thread(): Done retrieving: data size 43477842
Sun 19 Jan 2014 05:00:46 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:00:46 - XML: Start document: iteration 18
Sun 19 Jan 2014 05:00:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:00:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:00:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:00:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:00:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:00:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:00:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:00:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:00:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:00:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:00:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:00:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:00:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:01:02 - XML: Processed 652328 elements - found 0 jobs
Sun 19 Jan 2014 05:01:02 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:01:02 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:01:02 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:01:02 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:01:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:01:07 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:01:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:01:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:01:07 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:01:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 05:01:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:01:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:01:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:01:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:01:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:01:09 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 05:01:09 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 05:01:09 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:01:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:01:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43544865
Sun 19 Jan 2014 05:01:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:01:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43544865
Sun 19 Jan 2014 05:01:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:01:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:01:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:01:17 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:01:17 - job_xml_thread(): Done retrieving: data size 43544865
Sun 19 Jan 2014 05:01:17 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:01:17 - XML: Start document: iteration 19
Sun 19 Jan 2014 05:01:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:01:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:01:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:01:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:01:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:01:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:01:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:01:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:01:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:01:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:01:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:01:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:01:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:01:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:01:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:01:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:01:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:01:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:01:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:01:28 - XML: Processed 653326 elements - found 0 jobs
Sun 19 Jan 2014 05:01:28 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:01:28 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:01:28 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:01:28 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:01:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:01:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575217
Sun 19 Jan 2014 05:01:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:01:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575217
Sun 19 Jan 2014 05:01:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:01:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:01:35 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:01:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:01:36 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:01:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 05:01:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 05:01:37 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:01:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8821 values 139363 bits 17420 bytes 
Sun 19 Jan 2014 05:01:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:01:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:01:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:01:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:01:43 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:01:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:01:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:01:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:01:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:01:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:01:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:01:44 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:01:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:01:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:01:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:01:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:01:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:01:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:01:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:01:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:01:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:01:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:01:47 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:01:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 05:01:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:01:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:01:47 - job_xml_thread(): Done retrieving: data size 43595889
Sun 19 Jan 2014 05:01:47 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:01:47 - XML: Start document: iteration 20
Sun 19 Jan 2014 05:01:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43595889
Sun 19 Jan 2014 05:01:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:01:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43595889
Sun 19 Jan 2014 05:01:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:02:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:02:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:02:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:02:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:02:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:02:05 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:02:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:02:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:02:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:02:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:02:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:02:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:02:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:02:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:02:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:02:09 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 05:02:09 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:02:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:02:09 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:02:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:02:09 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:02:09 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:02:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:02:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:02:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:02:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:02:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:02:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577550
Sun 19 Jan 2014 05:02:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:02:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577550
Sun 19 Jan 2014 05:02:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:02:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:02:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:02:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:02:22 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:02:24 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:02:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:02:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:02:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:02:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:02:25 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:02:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:02:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:02:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:02:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:02:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:02:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:02:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:02:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:02:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:02:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:02:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:02:27 - job_xml_thread(): Done retrieving: data size 43577876
Sun 19 Jan 2014 05:02:27 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:02:27 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 05:02:27 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 05:02:27 - Housekeeping: done.
Sun 19 Jan 2014 05:02:27 - XML: Start document: iteration 0
Sun 19 Jan 2014 05:02:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577876
Sun 19 Jan 2014 05:02:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:02:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577876
Sun 19 Jan 2014 05:02:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:02:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:02:37 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:02:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:02:38 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:02:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 05:02:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 05:02:39 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:02:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 149029 bits 18628 bytes 
Sun 19 Jan 2014 05:02:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:02:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:02:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:02:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:02:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:02:43 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:02:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:02:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:02:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:02:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:02:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:02:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:02:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:02:45 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 05:02:45 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:02:45 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:02:45 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:02:45 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:02:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:02:49 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:02:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:02:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:02:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:02:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:02:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:02:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:02:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:02:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43595802
Sun 19 Jan 2014 05:02:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:02:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43595802
Sun 19 Jan 2014 05:02:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:02:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:03:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:03:00 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:03:00 - job_xml_thread(): Done retrieving: data size 43595802
Sun 19 Jan 2014 05:03:00 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:03:00 - XML: Start document: iteration 1
Sun 19 Jan 2014 05:03:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:03:03 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:03:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:03:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:03:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:03:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:03:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:03:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:03:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:03:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:03:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:03:10 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:03:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 05:03:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:03:10 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 05:03:10 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:03:10 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:03:10 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:03:10 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:03:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:03:14 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:03:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:03:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:03:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:03:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:03:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:03:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:03:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:03:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560560
Sun 19 Jan 2014 05:03:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:03:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560560
Sun 19 Jan 2014 05:03:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:03:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:03:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:03:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:03:22 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:03:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:03:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:03:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:03:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:03:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:03:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:03:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560560
Sun 19 Jan 2014 05:03:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:03:25 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:03:25 - job_xml_thread(): Done retrieving: data size 43560560
Sun 19 Jan 2014 05:03:25 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:03:25 - XML: Start document: iteration 2
Sun 19 Jan 2014 05:03:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:03:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:03:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:03:37 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:03:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:03:37 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:03:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:03:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:03:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:03:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:03:38 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:03:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:03:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:03:39 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:03:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:03:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:03:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 05:03:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:03:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:03:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:03:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:03:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:03:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 05:03:39 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:03:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:03:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:03:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6050 values 95574 bits 11946 bytes 
Sun 19 Jan 2014 05:03:40 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 05:03:40 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:03:40 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:03:40 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:03:40 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:03:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:03:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578978
Sun 19 Jan 2014 05:03:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:03:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578978
Sun 19 Jan 2014 05:03:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:03:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:03:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:03:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:03:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:03:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:03:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:03:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:03:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:03:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:03:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:03:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:03:55 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:03:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:03:58 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:03:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:03:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:03:58 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:03:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 05:03:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:03:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:03:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:03:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:03:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:03:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:03:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581006
Sun 19 Jan 2014 05:03:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:03:59 - job_xml_thread(): Done retrieving: data size 43581006
Sun 19 Jan 2014 05:04:00 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:04:00 - XML: Start document: iteration 3
Sun 19 Jan 2014 05:04:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581006
Sun 19 Jan 2014 05:04:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:04:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:04:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:04:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:04:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:04:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:04:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:04:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:04:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:04:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:04:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:04:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:04:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:04:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:04:22 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 05:04:22 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:04:22 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:04:22 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:04:22 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:04:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:04:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:04:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:04:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:04:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:04:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:04:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:04:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:04:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:04:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560267
Sun 19 Jan 2014 05:04:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:04:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560267
Sun 19 Jan 2014 05:04:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:04:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:04:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:04:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:04:36 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:04:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:04:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:04:37 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:04:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:04:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:04:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:04:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:04:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:04:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:04:39 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:04:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:04:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:04:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:04:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 05:04:40 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:04:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 05:04:40 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:04:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9020 values 142283 bits 17785 bytes 
Sun 19 Jan 2014 05:04:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:04:40 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:04:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:04:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:04:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:04:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:04:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:04:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:04:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:04:43 - job_xml_thread(): Done retrieving: data size 43573491
Sun 19 Jan 2014 05:04:43 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:04:43 - XML: Start document: iteration 4
Sun 19 Jan 2014 05:04:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573491
Sun 19 Jan 2014 05:04:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:04:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573491
Sun 19 Jan 2014 05:04:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:04:51 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 05:04:51 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:04:52 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:04:52 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 05:04:53 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 05:04:53 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:04:53 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 05:04:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:04:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:04:55 - size of cluster 'LISA Cluster': 624 hosts 79469 metrics 900410 values 14220205 bits 1777525 bytes 
Sun 19 Jan 2014 05:04:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:04:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:04:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:04:59 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:04:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:04:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:05:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:05:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:05:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:05:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:05:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:05:05 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 05:05:06 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:05:06 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:05:06 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:05:06 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:05:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:05:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:05:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:05:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:05:08 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:05:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 05:05:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:05:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:05:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:05:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:05:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:05:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:05:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555432
Sun 19 Jan 2014 05:05:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:05:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555432
Sun 19 Jan 2014 05:05:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:05:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:05:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:05:21 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:05:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:05:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:05:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:05:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:05:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:05:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:05:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:05:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:05:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:05:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:05:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:05:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:05:25 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:05:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:05:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:05:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:05:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:05:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:05:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:05:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:05:29 - job_xml_thread(): Done retrieving: data size 43503036
Sun 19 Jan 2014 05:05:29 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:05:29 - XML: Start document: iteration 5
Sun 19 Jan 2014 05:05:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43503036
Sun 19 Jan 2014 05:05:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:05:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43503036
Sun 19 Jan 2014 05:05:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:05:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:05:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:05:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:05:40 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:05:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:05:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:05:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:05:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 05:05:41 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:05:41 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:05:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 05:05:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8853 values 139638 bits 17454 bytes 
Sun 19 Jan 2014 05:05:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:05:44 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:05:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:05:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:05:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:05:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:05:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:05:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:05:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:05:49 - XML: Processed 652596 elements - found 0 jobs
Sun 19 Jan 2014 05:05:49 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:05:49 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:05:49 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:05:49 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:05:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:05:51 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:05:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:05:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:05:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:05:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:05:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:05:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:05:53 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:05:53 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 05:05:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:05:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42924475
Sun 19 Jan 2014 05:05:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:05:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42924475
Sun 19 Jan 2014 05:05:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:06:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:06:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:06:04 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:06:04 - job_xml_thread(): Done retrieving: data size 42924475
Sun 19 Jan 2014 05:06:04 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:06:04 - XML: Start document: iteration 6
Sun 19 Jan 2014 05:06:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:06:07 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:06:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:06:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:06:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:06:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:06:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:06:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:06:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:06:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:06:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:06:10 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:06:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 05:06:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:06:18 - XML: Processed 645530 elements - found 0 jobs
Sun 19 Jan 2014 05:06:18 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:06:18 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:06:18 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:06:18 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:06:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:06:20 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:06:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:06:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:06:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:06:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:06:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:06:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:06:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:06:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42957081
Sun 19 Jan 2014 05:06:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:06:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42957081
Sun 19 Jan 2014 05:06:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:06:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:06:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:06:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:06:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:06:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:06:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:06:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:06:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:06:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:06:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:06:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:06:34 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:06:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:06:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:06:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:06:37 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:06:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:06:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:06:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:06:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:06:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:06:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:06:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:06:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43452853
Sun 19 Jan 2014 05:06:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:06:41 - job_xml_thread(): Done retrieving: data size 43452853
Sun 19 Jan 2014 05:06:41 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:06:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43452853
Sun 19 Jan 2014 05:06:41 - XML: Start document: iteration 7
Sun 19 Jan 2014 05:06:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:06:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:06:42 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:06:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:06:43 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:06:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 05:06:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 05:06:43 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:06:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9239 values 145719 bits 18214 bytes 
Sun 19 Jan 2014 05:06:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:06:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:06:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:06:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:06:59 - XML: Processed 651930 elements - found 0 jobs
Sun 19 Jan 2014 05:06:59 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:06:59 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:06:59 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:06:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:06:59 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:06:59 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:07:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:07:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:07:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:07:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:07:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:07:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:07:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:07:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:07:03 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:07:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:07:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:07:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:07:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:07:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:07:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:07:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:07:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43592806
Sun 19 Jan 2014 05:07:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:07:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43592806
Sun 19 Jan 2014 05:07:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:07:14 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:07:14 - job_xml_thread(): Done retrieving: data size 43592806
Sun 19 Jan 2014 05:07:14 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:07:14 - XML: Start document: iteration 8
Sun 19 Jan 2014 05:07:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:07:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:07:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:07:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:07:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:07:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:07:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:07:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:07:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:07:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:07:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:07:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:07:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:07:27 - XML: Processed 653304 elements - found 0 jobs
Sun 19 Jan 2014 05:07:27 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:07:27 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:07:27 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:07:27 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:07:27 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:07:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 05:07:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:07:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:07:29 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:07:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:07:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:07:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:07:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:07:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:07:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:07:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:07:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556459
Sun 19 Jan 2014 05:07:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:07:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556459
Sun 19 Jan 2014 05:07:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:07:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:07:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:07:42 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:07:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:07:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:07:44 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:07:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:07:44 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:07:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 05:07:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 05:07:44 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:07:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5689 values 89677 bits 11209 bytes 
Sun 19 Jan 2014 05:07:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:07:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:07:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:07:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:07:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:07:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:07:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:07:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:07:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:07:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:07:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:07:49 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:07:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:07:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:07:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:07:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:07:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:07:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:07:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:07:52 - job_xml_thread(): Done retrieving: data size 43578623
Sun 19 Jan 2014 05:07:52 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:07:52 - XML: Start document: iteration 9
Sun 19 Jan 2014 05:07:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578623
Sun 19 Jan 2014 05:07:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:07:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578623
Sun 19 Jan 2014 05:07:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:08:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:08:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:08:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:08:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:08:08 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:08:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 05:08:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:08:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:08:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:08:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:08:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:08:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:08:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:08:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:08:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:08:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:08:14 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 05:08:14 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:08:14 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:08:14 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:08:14 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:08:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:08:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:08:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:08:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:08:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:08:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:08:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:08:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:08:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:08:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43585748
Sun 19 Jan 2014 05:08:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:08:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43585748
Sun 19 Jan 2014 05:08:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:08:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:08:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:08:29 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:08:29 - job_xml_thread(): Done retrieving: data size 43585748
Sun 19 Jan 2014 05:08:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:08:29 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:08:29 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:08:29 - XML: Start document: iteration 10
Sun 19 Jan 2014 05:08:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:08:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:08:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:08:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:08:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:08:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:08:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:08:39 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 05:08:39 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:08:39 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:08:39 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:08:39 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:08:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:08:41 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:08:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:08:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:08:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:08:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:08:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:08:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:08:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:08:44 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:08:44 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:08:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:08:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 05:08:44 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:08:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 05:08:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6040 values 95272 bits 11909 bytes 
Sun 19 Jan 2014 05:08:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:08:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556468
Sun 19 Jan 2014 05:08:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:08:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556468
Sun 19 Jan 2014 05:08:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:08:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:08:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:08:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:08:54 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:08:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:08:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:08:54 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:08:54 - job_xml_thread(): Done retrieving: data size 43556468
Sun 19 Jan 2014 05:08:54 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:08:54 - XML: Start document: iteration 11
Sun 19 Jan 2014 05:08:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:08:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:08:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:08:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:08:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:08:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:08:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:09:03 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 05:09:03 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:09:03 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:09:03 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:09:03 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:09:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:09:06 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:09:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:09:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:09:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:09:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:09:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:09:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:09:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:09:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:09:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:09:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43549391
Sun 19 Jan 2014 05:09:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:09:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43549391
Sun 19 Jan 2014 05:09:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:09:18 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:09:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 05:09:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:09:18 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:09:18 - job_xml_thread(): Done retrieving: data size 43549391
Sun 19 Jan 2014 05:09:18 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:09:18 - XML: Start document: iteration 12
Sun 19 Jan 2014 05:09:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:09:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:09:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:09:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:09:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:09:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:09:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:09:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:09:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:09:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:09:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:09:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:09:34 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:09:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:09:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:09:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:09:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:09:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:09:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:09:34 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 05:09:34 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:09:34 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:09:34 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:09:34 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:09:36 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 05:09:36 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 05:09:36 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:09:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:09:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570318
Sun 19 Jan 2014 05:09:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:09:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570318
Sun 19 Jan 2014 05:09:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:09:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:09:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:09:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:09:45 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:09:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:09:46 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:09:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 05:09:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 05:09:46 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:09:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6180 values 97416 bits 12177 bytes 
Sun 19 Jan 2014 05:09:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:09:46 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:09:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:09:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:09:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:09:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:09:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:09:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:09:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:09:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:09:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:09:49 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:09:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:09:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:09:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:09:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:09:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:09:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:09:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:09:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:09:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:09:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579119
Sun 19 Jan 2014 05:09:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:09:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579119
Sun 19 Jan 2014 05:09:53 - job_xml_thread(): Done retrieving: data size 43579119
Sun 19 Jan 2014 05:09:54 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:09:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:09:54 - XML: Start document: iteration 13
Sun 19 Jan 2014 05:10:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:10:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:10:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:10:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:10:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:10:07 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:10:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:10:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:10:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:10:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:10:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:10:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:10:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:10:11 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 05:10:11 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:10:11 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:10:11 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:10:11 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:10:13 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:10:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 05:10:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:10:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:10:15 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:10:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:10:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:10:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:10:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:10:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:10:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:10:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:10:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566079
Sun 19 Jan 2014 05:10:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:10:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566079
Sun 19 Jan 2014 05:10:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:10:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:10:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:10:27 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:10:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:10:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:10:28 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:10:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:10:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:10:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:10:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:10:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:10:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:10:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:10:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:10:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:10:32 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:10:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:10:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:10:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:10:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:10:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:10:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:10:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:10:33 - job_xml_thread(): Done retrieving: data size 43586202
Sun 19 Jan 2014 05:10:33 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:10:33 - XML: Start document: iteration 14
Sun 19 Jan 2014 05:10:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43586202
Sun 19 Jan 2014 05:10:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:10:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43586202
Sun 19 Jan 2014 05:10:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:10:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:10:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:10:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:10:46 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:10:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:10:47 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:10:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 05:10:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 05:10:47 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:10:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:10:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:10:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9156 values 144359 bits 18044 bytes 
Sun 19 Jan 2014 05:10:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:10:54 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:10:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:10:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:10:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:10:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:10:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:10:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:10:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:10:55 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 05:10:55 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:10:55 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:10:55 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:10:55 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:10:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:10:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:10:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:10:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:10:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:10:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:10:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:10:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:10:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:10:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579010
Sun 19 Jan 2014 05:10:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:10:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579010
Sun 19 Jan 2014 05:10:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:11:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:11:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:11:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:11:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:11:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:11:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:11:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:11:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:11:11 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:11:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:11:12 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:11:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 05:11:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:11:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:11:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:11:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:11:14 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:11:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:11:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:11:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:11:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:11:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:11:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:11:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:11:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43510074
Sun 19 Jan 2014 05:11:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:11:17 - job_xml_thread(): Done retrieving: data size 43510074
Sun 19 Jan 2014 05:11:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43510074
Sun 19 Jan 2014 05:11:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:11:17 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:11:17 - XML: Start document: iteration 15
Sun 19 Jan 2014 05:11:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:11:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:11:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:11:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:11:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:11:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:11:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:11:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:11:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:11:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:11:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:11:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:11:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:11:35 - XML: Processed 652600 elements - found 0 jobs
Sun 19 Jan 2014 05:11:35 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:11:35 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:11:35 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:11:35 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:11:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:11:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:11:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:11:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:11:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:11:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:11:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:11:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:11:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:11:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43006024
Sun 19 Jan 2014 05:11:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:11:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43006024
Sun 19 Jan 2014 05:11:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:11:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:11:47 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:11:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:11:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 05:11:49 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:11:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 05:11:49 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:11:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9247 values 145800 bits 18225 bytes 
Sun 19 Jan 2014 05:11:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:11:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:11:50 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:11:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:11:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:11:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:11:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:11:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:11:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:11:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:11:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:11:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:11:53 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 05:11:53 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:11:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:11:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:11:53 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:11:53 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 05:11:53 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 05:11:53 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:11:53 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 05:11:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:11:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:11:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:11:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:11:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:11:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:11:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:11:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:11:55 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 840502 values 13247903 bits 1655987 bytes 
Sun 19 Jan 2014 05:11:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:11:58 - job_xml_thread(): Done retrieving: data size 42901033
Sun 19 Jan 2014 05:11:58 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:11:58 - XML: Start document: iteration 16
Sun 19 Jan 2014 05:11:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42901033
Sun 19 Jan 2014 05:11:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:11:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42901033
Sun 19 Jan 2014 05:11:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:12:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:12:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:12:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:12:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:12:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:12:19 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:12:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:12:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:12:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:12:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:12:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:12:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:12:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:12:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:12:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:12:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:12:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:12:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:12:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:12:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:12:22 - XML: Processed 645242 elements - found 0 jobs
Sun 19 Jan 2014 05:12:22 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:12:22 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:12:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:12:22 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:12:22 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:12:23 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:12:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 05:12:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:12:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:12:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42993569
Sun 19 Jan 2014 05:12:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:12:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42993569
Sun 19 Jan 2014 05:12:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:12:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:12:37 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:12:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:12:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:12:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:12:38 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:12:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:12:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:12:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:12:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:12:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:12:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:12:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:12:39 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:12:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:12:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:12:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:12:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:12:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:12:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:12:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:12:42 - job_xml_thread(): Done retrieving: data size 43438467
Sun 19 Jan 2014 05:12:42 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:12:42 - XML: Start document: iteration 17
Sun 19 Jan 2014 05:12:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43438467
Sun 19 Jan 2014 05:12:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43438467
Sun 19 Jan 2014 05:12:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:12:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:12:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:12:50 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:12:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:12:51 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:12:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 05:12:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 05:12:51 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:12:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9032 values 142438 bits 17804 bytes 
Sun 19 Jan 2014 05:12:53 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:12:53 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 05:12:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:12:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:12:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:12:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:12:56 - XML: Processed 651740 elements - found 0 jobs
Sun 19 Jan 2014 05:12:56 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:12:56 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:12:56 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:12:56 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:13:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:13:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:13:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:13:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:13:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:13:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:13:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:13:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:13:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:13:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:13:07 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:13:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:13:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:13:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:13:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:13:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:13:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:13:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:13:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573075
Sun 19 Jan 2014 05:13:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:13:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573075
Sun 19 Jan 2014 05:13:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:13:12 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:13:12 - job_xml_thread(): Done retrieving: data size 43573075
Sun 19 Jan 2014 05:13:12 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:13:12 - XML: Start document: iteration 18
Sun 19 Jan 2014 05:13:14 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:13:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 05:13:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:13:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:13:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:13:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:13:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:13:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:13:29 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:13:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:13:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:13:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:13:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:13:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:13:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:13:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:13:33 - XML: Processed 653344 elements - found 0 jobs
Sun 19 Jan 2014 05:13:33 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:13:33 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:13:33 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:13:33 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:13:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:13:34 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:13:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:13:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:13:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:13:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:13:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:13:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:13:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:13:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43592171
Sun 19 Jan 2014 05:13:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:13:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43592171
Sun 19 Jan 2014 05:13:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:13:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:13:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:13:48 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:13:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:13:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:13:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:13:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:13:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:13:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:13:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:13:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:13:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:13:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:13:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:13:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:13:51 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:13:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:13:52 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:13:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 05:13:52 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:13:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 05:13:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6272 values 98896 bits 12362 bytes 
Sun 19 Jan 2014 05:13:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:13:52 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:13:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:13:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:13:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:13:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:13:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:13:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:13:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:13:55 - job_xml_thread(): Done retrieving: data size 43573130
Sun 19 Jan 2014 05:13:55 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:13:55 - XML: Start document: iteration 19
Sun 19 Jan 2014 05:13:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573130
Sun 19 Jan 2014 05:13:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573130
Sun 19 Jan 2014 05:13:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:13:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:14:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:14:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:14:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:14:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:14:11 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 05:14:11 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:14:11 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:14:11 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:14:11 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:14:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:14:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:14:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:14:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:14:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:14:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:14:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:14:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:14:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:14:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:14:19 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:14:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:14:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:14:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:14:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:14:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:14:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:14:20 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:14:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 05:14:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:14:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:14:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43596840
Sun 19 Jan 2014 05:14:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:14:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43596840
Sun 19 Jan 2014 05:14:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:14:26 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:14:26 - job_xml_thread(): Done retrieving: data size 43596840
Sun 19 Jan 2014 05:14:26 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:14:26 - XML: Start document: iteration 20
Sun 19 Jan 2014 05:14:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:14:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:14:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:14:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:14:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:14:40 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 05:14:40 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:14:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:14:40 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:14:40 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:14:40 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:14:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:14:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:14:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:14:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:14:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:14:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:14:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:14:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:14:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:14:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:14:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:14:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:14:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:14:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:14:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:14:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:14:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43590547
Sun 19 Jan 2014 05:14:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:14:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43590547
Sun 19 Jan 2014 05:14:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:14:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:14:52 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:14:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:14:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 05:14:53 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:14:53 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:14:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 05:14:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8783 values 138407 bits 17300 bytes 
Sun 19 Jan 2014 05:14:56 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:14:56 - job_xml_thread(): Done retrieving: data size 43590547
Sun 19 Jan 2014 05:14:56 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:14:56 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 05:14:56 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 05:14:56 - Housekeeping: done.
Sun 19 Jan 2014 05:14:56 - XML: Start document: iteration 0
Sun 19 Jan 2014 05:14:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:14:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:15:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:15:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:15:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:15:04 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:15:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:15:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:15:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:15:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:15:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:15:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:15:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:15:09 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 05:15:09 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:15:09 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:15:09 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:15:09 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:15:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:15:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:15:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:15:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:15:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:15:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:15:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:15:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:15:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:15:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562539
Sun 19 Jan 2014 05:15:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:15:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562539
Sun 19 Jan 2014 05:15:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:15:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:15:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:15:24 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:15:24 - job_xml_thread(): Done retrieving: data size 43562539
Sun 19 Jan 2014 05:15:24 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:15:24 - XML: Start document: iteration 1
Sun 19 Jan 2014 05:15:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:15:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:15:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:15:30 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:15:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:15:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:15:30 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:15:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 05:15:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:15:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:15:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:15:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:15:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:15:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:15:37 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 05:15:37 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:15:37 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:15:37 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:15:37 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:15:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:15:39 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:15:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:15:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:15:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:15:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:15:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:15:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:15:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:15:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43550469
Sun 19 Jan 2014 05:15:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:15:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43550469
Sun 19 Jan 2014 05:15:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:15:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:15:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:15:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:15:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:15:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:15:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:15:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:15:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:15:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:15:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:15:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:15:53 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:15:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:15:53 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:15:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:15:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:15:54 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:15:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 05:15:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:15:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 05:15:54 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:15:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6094 values 96127 bits 12015 bytes 
Sun 19 Jan 2014 05:15:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:15:55 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:15:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:15:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:15:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:15:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:15:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:15:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:15:58 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 05:15:58 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 05:15:58 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:15:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:15:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573095
Sun 19 Jan 2014 05:15:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:15:59 - job_xml_thread(): Done retrieving: data size 43573095
Sun 19 Jan 2014 05:15:59 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:15:59 - XML: Start document: iteration 2
Sun 19 Jan 2014 05:15:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573095
Sun 19 Jan 2014 05:15:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:16:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:16:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:16:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:16:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:16:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:16:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:16:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:16:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:16:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:16:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:16:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:16:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:16:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:16:21 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 05:16:21 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:16:21 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:16:21 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:16:21 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:16:22 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:16:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 05:16:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:16:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:16:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:16:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:16:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:16:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:16:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:16:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:16:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:16:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:16:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554753
Sun 19 Jan 2014 05:16:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:16:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554753
Sun 19 Jan 2014 05:16:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:16:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:16:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:16:36 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:16:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:16:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:16:36 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:16:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:16:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:16:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:16:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:16:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:16:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:16:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:16:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:16:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:16:40 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:16:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:16:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:16:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:16:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:16:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:16:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:16:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:16:41 - job_xml_thread(): Done retrieving: data size 43579020
Sun 19 Jan 2014 05:16:41 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:16:41 - XML: Start document: iteration 3
Sun 19 Jan 2014 05:16:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579020
Sun 19 Jan 2014 05:16:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:16:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579020
Sun 19 Jan 2014 05:16:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:16:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:16:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:16:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:16:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:16:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:16:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:16:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:16:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:16:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:16:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:16:55 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:16:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:16:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:16:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:16:57 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:16:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 05:16:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 05:16:57 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:16:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9109 values 143886 bits 17985 bytes 
Sun 19 Jan 2014 05:17:01 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 05:17:01 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:17:01 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:17:01 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:17:01 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:17:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:17:03 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:17:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:17:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:17:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:17:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:17:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:17:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:17:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:17:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43585835
Sun 19 Jan 2014 05:17:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:17:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43585835
Sun 19 Jan 2014 05:17:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:17:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:17:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:17:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:17:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:17:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:17:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:17:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:17:16 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:17:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:17:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:17:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:17:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:17:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:17:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:17:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:17:20 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:17:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:17:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:17:20 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:17:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 05:17:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:17:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:17:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:17:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:17:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:17:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:17:22 - job_xml_thread(): Done retrieving: data size 43521655
Sun 19 Jan 2014 05:17:22 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:17:22 - XML: Start document: iteration 4
Sun 19 Jan 2014 05:17:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43521655
Sun 19 Jan 2014 05:17:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:17:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43521655
Sun 19 Jan 2014 05:17:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:17:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:17:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:17:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:17:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:17:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:17:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:17:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:17:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:17:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:17:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:17:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:17:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:17:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:17:40 - XML: Processed 652600 elements - found 0 jobs
Sun 19 Jan 2014 05:17:40 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:17:40 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:17:40 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:17:40 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:17:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:17:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:17:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:17:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:17:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:17:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:17:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:17:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:17:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:17:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42999718
Sun 19 Jan 2014 05:17:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:17:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42999718
Sun 19 Jan 2014 05:17:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:17:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:17:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:17:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:17:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:17:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:17:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:17:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:17:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:17:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:17:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:17:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42999718
Sun 19 Jan 2014 05:17:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:17:55 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:17:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:17:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:17:57 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:17:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:17:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:17:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:17:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 05:17:58 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:17:58 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:17:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 05:17:59 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8929 values 141274 bits 17659 bytes 
Sun 19 Jan 2014 05:18:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:18:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:18:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:18:06 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:18:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:18:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:18:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:18:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:18:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:18:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:18:08 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:18:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 05:18:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:18:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:18:08 - job_xml_thread(): Done retrieving: data size 42931908
Sun 19 Jan 2014 05:18:08 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:18:08 - XML: Start document: iteration 5
Sun 19 Jan 2014 05:18:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42931908
Sun 19 Jan 2014 05:18:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:18:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:18:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:18:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:18:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:18:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:18:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:18:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42931908
Sun 19 Jan 2014 05:18:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:18:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:18:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:18:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:18:22 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:18:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:18:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:18:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:18:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:18:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:18:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:18:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:18:28 - XML: Processed 645532 elements - found 0 jobs
Sun 19 Jan 2014 05:18:28 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:18:28 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:18:28 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:18:28 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:18:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:18:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:18:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:18:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:18:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:18:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:18:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:18:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:18:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:18:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42987699
Sun 19 Jan 2014 05:18:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:18:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42987699
Sun 19 Jan 2014 05:18:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:18:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:18:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:18:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:18:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:18:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:18:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:18:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:18:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:18:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:18:43 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:18:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:18:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:18:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:18:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:18:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:18:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:18:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:18:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:18:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:18:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43524171
Sun 19 Jan 2014 05:18:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:18:46 - job_xml_thread(): Done retrieving: data size 43524171
Sun 19 Jan 2014 05:18:46 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:18:46 - XML: Start document: iteration 6
Sun 19 Jan 2014 05:18:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43524171
Sun 19 Jan 2014 05:18:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:18:54 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 05:18:54 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:18:56 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:18:56 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 05:18:56 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:18:56 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 05:18:56 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 05:18:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:18:57 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:18:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:18:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:18:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:18:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:18:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:18:59 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:18:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:18:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:18:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:19:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:19:00 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:19:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 05:19:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 05:19:00 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:19:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99213 bits 12401 bytes 
Sun 19 Jan 2014 05:19:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:19:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:19:06 - size of cluster 'LISA Cluster': 624 hosts 79477 metrics 818795 values 12932343 bits 1616542 bytes 
Sun 19 Jan 2014 05:19:07 - XML: Processed 652472 elements - found 0 jobs
Sun 19 Jan 2014 05:19:07 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:19:07 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:19:07 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:19:07 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:19:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:19:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:19:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:19:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:19:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:19:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:19:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:19:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:19:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:19:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43541531
Sun 19 Jan 2014 05:19:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:19:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:19:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:19:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43541531
Sun 19 Jan 2014 05:19:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:19:22 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:19:22 - job_xml_thread(): Done retrieving: data size 43541531
Sun 19 Jan 2014 05:19:22 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:19:22 - XML: Start document: iteration 7
Sun 19 Jan 2014 05:19:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:19:25 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:19:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:19:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:19:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:19:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:19:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:19:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:19:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:19:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:19:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:19:33 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 05:19:33 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:19:33 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:19:33 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:19:33 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:19:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:19:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:19:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:19:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:19:38 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:19:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 05:19:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:19:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:19:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:19:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:19:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:19:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:19:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43539139
Sun 19 Jan 2014 05:19:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:19:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:19:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:19:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43539139
Sun 19 Jan 2014 05:19:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:19:48 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:19:48 - job_xml_thread(): Done retrieving: data size 43539139
Sun 19 Jan 2014 05:19:48 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:19:48 - XML: Start document: iteration 8
Sun 19 Jan 2014 05:19:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:19:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:19:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:19:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:19:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:19:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:19:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:19:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:19:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:19:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:19:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:19:57 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:19:57 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 05:20:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:20:00 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:20:00 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 05:20:00 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:20:00 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:20:00 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:20:00 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:20:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:20:00 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:20:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 05:20:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 05:20:00 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:20:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5584 values 88018 bits 11002 bytes 
Sun 19 Jan 2014 05:20:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:20:03 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:20:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:20:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:20:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:20:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:20:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:20:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:20:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:20:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562948
Sun 19 Jan 2014 05:20:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:20:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562948
Sun 19 Jan 2014 05:20:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:20:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:20:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:20:15 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:20:15 - job_xml_thread(): Done retrieving: data size 43562948
Sun 19 Jan 2014 05:20:15 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:20:15 - XML: Start document: iteration 9
Sun 19 Jan 2014 05:20:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:20:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:20:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:20:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:20:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:20:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:20:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:20:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:20:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:20:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:20:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:20:28 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 05:20:28 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:20:28 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:20:28 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:20:28 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:20:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:20:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:20:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:20:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:20:30 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:20:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 05:20:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:20:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:20:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:20:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:20:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:20:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:20:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:20:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:20:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43549555
Sun 19 Jan 2014 05:20:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:20:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43549555
Sun 19 Jan 2014 05:20:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:20:43 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:20:43 - job_xml_thread(): Done retrieving: data size 43549555
Sun 19 Jan 2014 05:20:43 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:20:43 - XML: Start document: iteration 10
Sun 19 Jan 2014 05:20:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:20:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:20:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:20:52 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:20:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:20:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:20:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:20:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:20:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:20:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:20:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:20:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:20:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:20:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:20:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:20:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:20:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:20:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:20:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:20:57 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 05:20:57 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:20:57 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:20:57 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:20:57 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:21:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:21:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582518
Sun 19 Jan 2014 05:21:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:21:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:21:00 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:21:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582518
Sun 19 Jan 2014 05:21:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:21:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:21:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 05:21:02 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:21:02 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:21:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 05:21:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6313 values 99630 bits 12453 bytes 
Sun 19 Jan 2014 05:21:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:21:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:21:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:21:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:21:12 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:21:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:21:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:21:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:21:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:21:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:21:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:21:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:21:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:21:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:21:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:21:17 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:21:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:21:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:21:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:21:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:21:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:21:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:21:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:21:20 - job_xml_thread(): Done retrieving: data size 43576738
Sun 19 Jan 2014 05:21:20 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:21:20 - XML: Start document: iteration 11
Sun 19 Jan 2014 05:21:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576738
Sun 19 Jan 2014 05:21:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:21:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576738
Sun 19 Jan 2014 05:21:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:21:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:21:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:21:32 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:21:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 05:21:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:21:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:21:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:21:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:21:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:21:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:21:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:21:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:21:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:21:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:21:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:21:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:21:41 - XML: Processed 653346 elements - found 0 jobs
Sun 19 Jan 2014 05:21:41 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:21:41 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:21:41 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:21:41 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:21:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:21:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:21:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:21:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:21:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:21:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:21:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:21:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:21:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:21:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572253
Sun 19 Jan 2014 05:21:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:21:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572253
Sun 19 Jan 2014 05:21:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:21:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:21:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:21:56 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:21:56 - job_xml_thread(): Done retrieving: data size 43572253
Sun 19 Jan 2014 05:21:56 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:21:56 - XML: Start document: iteration 12
Sun 19 Jan 2014 05:21:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:21:57 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:21:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:21:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:21:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:21:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:21:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:21:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:21:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:21:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:21:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:22:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:22:02 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:22:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:22:03 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:22:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 05:22:03 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:22:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 05:22:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5829 values 91906 bits 11488 bytes 
Sun 19 Jan 2014 05:22:05 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 05:22:05 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:22:05 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:22:05 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:22:05 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:22:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:22:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:22:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:22:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:22:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:22:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:22:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:22:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:22:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:22:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554209
Sun 19 Jan 2014 05:22:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:22:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554209
Sun 19 Jan 2014 05:22:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:22:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:22:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:22:20 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:22:20 - job_xml_thread(): Done retrieving: data size 43554209
Sun 19 Jan 2014 05:22:20 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:22:20 - XML: Start document: iteration 13
Sun 19 Jan 2014 05:22:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:22:22 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:22:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:22:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:22:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:22:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:22:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:22:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:22:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:22:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:22:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:22:25 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:22:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 05:22:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:22:32 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 05:22:32 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:22:32 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:22:32 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:22:32 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:22:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:22:35 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:22:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:22:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:22:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:22:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:22:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:22:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:22:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:22:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:22:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:22:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43543139
Sun 19 Jan 2014 05:22:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:22:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43543139
Sun 19 Jan 2014 05:22:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:22:47 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:22:47 - job_xml_thread(): Done retrieving: data size 43543139
Sun 19 Jan 2014 05:22:47 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:22:47 - XML: Start document: iteration 14
Sun 19 Jan 2014 05:22:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:22:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:22:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:22:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:22:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:22:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:22:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:22:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:22:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:22:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:22:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:22:57 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 05:22:57 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:22:57 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:22:57 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:22:57 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:23:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:23:00 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:23:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:23:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:23:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:23:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:23:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:23:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:23:02 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 05:23:02 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 05:23:02 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:23:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:23:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580442
Sun 19 Jan 2014 05:23:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:23:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580442
Sun 19 Jan 2014 05:23:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:23:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:23:03 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:23:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:23:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 05:23:04 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:23:04 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:23:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 05:23:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9150 values 144305 bits 18038 bytes 
Sun 19 Jan 2014 05:23:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:23:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:23:12 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:23:12 - job_xml_thread(): Done retrieving: data size 43580442
Sun 19 Jan 2014 05:23:12 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:23:12 - XML: Start document: iteration 15
Sun 19 Jan 2014 05:23:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:23:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:23:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:23:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:23:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:23:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:23:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:23:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:23:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:23:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:23:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:23:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:23:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:23:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:23:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:23:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:23:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:23:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:23:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:23:26 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 05:23:26 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:23:26 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:23:26 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:23:26 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:23:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:23:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43493381
Sun 19 Jan 2014 05:23:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:23:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43493381
Sun 19 Jan 2014 05:23:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:23:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:23:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:23:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:23:37 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:23:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:23:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:23:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:23:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:23:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:23:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:23:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43493381
Sun 19 Jan 2014 05:23:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:23:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:23:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:23:41 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:23:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:23:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:23:48 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:23:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:23:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:23:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:23:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:23:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:23:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:23:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:23:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:23:49 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:23:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 05:23:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:23:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:23:51 - job_xml_thread(): Done retrieving: data size 42919898
Sun 19 Jan 2014 05:23:51 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:23:51 - XML: Start document: iteration 16
Sun 19 Jan 2014 05:23:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42919898
Sun 19 Jan 2014 05:23:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:23:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:23:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:23:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:23:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:23:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:23:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42919898
Sun 19 Jan 2014 05:23:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:23:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:24:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:24:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:24:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:24:04 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:24:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:24:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:24:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:24:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 05:24:05 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:24:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5891 values 92858 bits 11607 bytes 
Sun 19 Jan 2014 05:24:05 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:24:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 05:24:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:24:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:24:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:24:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:24:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:24:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:24:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:24:10 - XML: Processed 645592 elements - found 0 jobs
Sun 19 Jan 2014 05:24:10 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:24:10 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:24:10 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:24:10 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:24:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:24:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:24:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:24:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:24:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:24:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:24:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:24:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:24:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:24:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42929167
Sun 19 Jan 2014 05:24:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:24:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42929167
Sun 19 Jan 2014 05:24:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:24:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:24:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:24:25 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:24:25 - job_xml_thread(): Done retrieving: data size 42929167
Sun 19 Jan 2014 05:24:25 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:24:25 - XML: Start document: iteration 17
Sun 19 Jan 2014 05:24:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:24:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:24:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:24:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:24:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:24:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:24:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:24:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:24:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:24:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:24:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:24:36 - XML: Processed 645234 elements - found 0 jobs
Sun 19 Jan 2014 05:24:36 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:24:36 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:24:36 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:24:36 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:24:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:24:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:24:38 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:24:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 05:24:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:24:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:24:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:24:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:24:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:24:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:24:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:24:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:24:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43426940
Sun 19 Jan 2014 05:24:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:24:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43426940
Sun 19 Jan 2014 05:24:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:24:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:24:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:24:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:24:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:24:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:24:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:24:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:24:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:24:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:24:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:24:51 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:24:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:24:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:24:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:24:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:24:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:24:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:24:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:24:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:24:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:24:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:24:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:24:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:24:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554443
Sun 19 Jan 2014 05:24:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:24:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554443
Sun 19 Jan 2014 05:24:56 - job_xml_thread(): Done retrieving: data size 43554443
Sun 19 Jan 2014 05:24:56 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:24:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:24:56 - XML: Start document: iteration 18
Sun 19 Jan 2014 05:25:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:25:06 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:25:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:25:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:25:07 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:25:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 05:25:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:25:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 05:25:07 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:25:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9032 values 142403 bits 17800 bytes 
Sun 19 Jan 2014 05:25:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:25:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:25:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:25:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:25:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:25:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:25:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:25:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:25:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:25:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:25:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:25:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:25:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:25:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:25:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:25:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:25:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:25:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:25:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:25:16 - XML: Processed 652990 elements - found 0 jobs
Sun 19 Jan 2014 05:25:16 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:25:16 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:25:16 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:25:16 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:25:18 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:25:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 05:25:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:25:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:25:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578885
Sun 19 Jan 2014 05:25:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:25:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578885
Sun 19 Jan 2014 05:25:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:25:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:25:27 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:25:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:25:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:25:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:25:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:25:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:25:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:25:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:25:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:25:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:25:31 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:25:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:25:32 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:25:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:25:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:25:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:25:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:25:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:25:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:25:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:25:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579906
Sun 19 Jan 2014 05:25:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:25:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579906
Sun 19 Jan 2014 05:25:34 - job_xml_thread(): Done retrieving: data size 43579906
Sun 19 Jan 2014 05:25:34 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:25:34 - XML: Start document: iteration 19
Sun 19 Jan 2014 05:25:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:25:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:25:45 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:25:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:25:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:25:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:25:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:25:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:25:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:25:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:25:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:25:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:25:54 - XML: Processed 653340 elements - found 0 jobs
Sun 19 Jan 2014 05:25:54 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:25:55 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:25:55 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:25:55 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:25:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:25:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:25:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:25:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:25:57 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 05:25:57 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:25:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:25:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:25:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:25:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:25:57 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:25:57 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:25:57 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 05:25:57 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 05:25:57 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 05:25:58 - size of cluster 'LISA Cluster': 624 hosts 79476 metrics 831534 values 13105872 bits 1638234 bytes 
Sun 19 Jan 2014 05:26:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:26:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556779
Sun 19 Jan 2014 05:26:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:26:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556779
Sun 19 Jan 2014 05:26:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:26:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:26:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:26:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:26:07 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:26:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:26:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 05:26:08 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:26:08 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:26:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148575 bits 18571 bytes 
Sun 19 Jan 2014 05:26:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 05:26:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:26:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:26:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:26:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:26:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:26:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:26:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:26:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:26:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556779
Sun 19 Jan 2014 05:26:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:26:10 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:26:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:26:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:26:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:26:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:26:22 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:26:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:26:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:26:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:26:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:26:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:26:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:26:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:26:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:26:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:26:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:26:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:26:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:26:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:26:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:26:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:26:26 - job_xml_thread(): Done retrieving: data size 43544631
Sun 19 Jan 2014 05:26:26 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:26:26 - XML: Start document: iteration 20
Sun 19 Jan 2014 05:26:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43544631
Sun 19 Jan 2014 05:26:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:26:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43544631
Sun 19 Jan 2014 05:26:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:26:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:26:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:26:39 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 05:26:39 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:26:40 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:26:40 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:26:40 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:26:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:26:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:26:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:26:44 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:26:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:26:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:26:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:26:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:26:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:26:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:26:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:26:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:26:48 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:26:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:26:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:26:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:26:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:26:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:26:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:26:49 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:26:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 05:26:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:26:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:26:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568217
Sun 19 Jan 2014 05:26:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:26:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568217
Sun 19 Jan 2014 05:26:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:26:55 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:26:55 - job_xml_thread(): Done retrieving: data size 43568217
Sun 19 Jan 2014 05:26:55 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:26:55 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 05:26:56 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 05:26:56 - Housekeeping: done.
Sun 19 Jan 2014 05:26:56 - XML: Start document: iteration 0
Sun 19 Jan 2014 05:26:57 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:26:57 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 05:27:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:27:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:27:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:27:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:27:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:27:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:27:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:27:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:27:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:27:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:27:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:27:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:27:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:27:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:27:09 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:27:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:27:10 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:27:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 05:27:10 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:27:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 05:27:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5532 values 87156 bits 10894 bytes 
Sun 19 Jan 2014 05:27:11 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 05:27:11 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:27:11 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:27:11 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:27:11 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:27:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:27:14 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:27:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:27:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:27:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:27:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:27:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:27:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:27:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:27:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577172
Sun 19 Jan 2014 05:27:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:27:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577172
Sun 19 Jan 2014 05:27:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:27:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:27:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:27:26 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:27:26 - job_xml_thread(): Done retrieving: data size 43577172
Sun 19 Jan 2014 05:27:26 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:27:26 - XML: Start document: iteration 1
Sun 19 Jan 2014 05:27:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:27:29 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:27:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:27:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:27:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:27:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:27:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:27:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:27:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:27:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:27:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:27:37 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 05:27:37 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:27:37 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:27:37 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:27:37 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:27:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:27:42 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:27:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:27:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:27:42 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:27:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 05:27:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:27:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:27:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:27:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:27:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:27:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:27:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558636
Sun 19 Jan 2014 05:27:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:27:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558636
Sun 19 Jan 2014 05:27:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:27:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:27:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:27:52 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:27:52 - job_xml_thread(): Done retrieving: data size 43558636
Sun 19 Jan 2014 05:27:52 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:27:52 - XML: Start document: iteration 2
Sun 19 Jan 2014 05:27:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:27:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:28:04 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 05:28:04 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:28:04 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:28:04 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:28:04 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:28:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:28:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:28:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:28:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:28:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:28:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:28:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:28:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:28:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:28:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:28:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:28:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:28:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:28:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:28:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:28:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:28:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:28:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:28:10 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:28:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:28:10 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:28:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 05:28:10 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:28:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 05:28:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5893 values 92930 bits 11616 bytes 
Sun 19 Jan 2014 05:28:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:28:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579889
Sun 19 Jan 2014 05:28:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579889
Sun 19 Jan 2014 05:28:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:28:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:28:19 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:28:19 - job_xml_thread(): Done retrieving: data size 43579889
Sun 19 Jan 2014 05:28:19 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:28:19 - XML: Start document: iteration 3
Sun 19 Jan 2014 05:28:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:28:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:28:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:28:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:28:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:28:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:28:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:28:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:28:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:28:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:28:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:28:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:28:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:28:31 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 05:28:31 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:28:31 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:28:31 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:28:31 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:28:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:28:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:28:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:28:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:28:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:28:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:28:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:28:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:28:36 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:28:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 05:28:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:28:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:28:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554718
Sun 19 Jan 2014 05:28:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:28:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554718
Sun 19 Jan 2014 05:28:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:28:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:28:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:28:46 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:28:46 - job_xml_thread(): Done retrieving: data size 43554718
Sun 19 Jan 2014 05:28:46 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:28:46 - XML: Start document: iteration 4
Sun 19 Jan 2014 05:28:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:28:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:28:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:28:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:28:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:28:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:28:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:28:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:28:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:28:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:28:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:28:57 - XML: Processed 653347 elements - found 0 jobs
Sun 19 Jan 2014 05:28:57 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:28:57 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:28:57 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:28:57 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:28:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:28:59 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:28:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:28:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:28:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:28:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:28:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:28:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:29:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:29:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584372
Sun 19 Jan 2014 05:29:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:29:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584372
Sun 19 Jan 2014 05:29:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:29:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:29:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:29:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:29:11 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:29:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:29:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 05:29:12 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:29:12 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:29:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 05:29:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7017 values 110612 bits 13826 bytes 
Sun 19 Jan 2014 05:29:12 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:29:12 - job_xml_thread(): Done retrieving: data size 43584372
Sun 19 Jan 2014 05:29:12 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:29:12 - XML: Start document: iteration 5
Sun 19 Jan 2014 05:29:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:29:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:29:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:29:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:29:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:29:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:29:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:29:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:29:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:29:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:29:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:29:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:29:25 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:29:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:29:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:29:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:29:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:29:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:29:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:29:26 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 05:29:26 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:29:26 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:29:26 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:29:26 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:29:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:29:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43469841
Sun 19 Jan 2014 05:29:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:29:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43469841
Sun 19 Jan 2014 05:29:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:29:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:29:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:29:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:29:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:29:41 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:29:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:29:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:29:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:29:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:29:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:29:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:29:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:29:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:29:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:29:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:29:46 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:29:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:29:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:29:46 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:29:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 05:29:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:29:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:29:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:29:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:29:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:29:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:29:50 - job_xml_thread(): Done retrieving: data size 42983941
Sun 19 Jan 2014 05:29:50 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:29:50 - XML: Start document: iteration 6
Sun 19 Jan 2014 05:29:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42983941
Sun 19 Jan 2014 05:29:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:29:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42983941
Sun 19 Jan 2014 05:29:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:29:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:30:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:30:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:30:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:30:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:30:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:30:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:30:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:30:09 - XML: Processed 645890 elements - found 0 jobs
Sun 19 Jan 2014 05:30:09 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:30:09 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:30:09 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:30:09 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:30:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:30:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:30:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:30:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:30:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:30:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:30:12 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:30:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:30:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:30:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:30:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:30:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:30:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:30:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:30:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:30:12 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:30:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 05:30:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:30:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 05:30:12 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:30:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5980 values 94265 bits 11783 bytes 
Sun 19 Jan 2014 05:30:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:30:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42984474
Sun 19 Jan 2014 05:30:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:30:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42984474
Sun 19 Jan 2014 05:30:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:30:24 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:30:24 - job_xml_thread(): Done retrieving: data size 42984474
Sun 19 Jan 2014 05:30:24 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:30:24 - XML: Start document: iteration 7
Sun 19 Jan 2014 05:30:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:30:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:30:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:30:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:30:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:30:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:30:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:30:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:30:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:30:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:30:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:30:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:30:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:30:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:30:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:30:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:30:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:30:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:30:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:30:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:30:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:30:39 - XML: Processed 645900 elements - found 0 jobs
Sun 19 Jan 2014 05:30:39 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:30:39 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:30:39 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:30:39 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:30:39 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:30:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 05:30:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:30:42 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 05:30:42 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 05:30:42 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:30:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:30:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43469398
Sun 19 Jan 2014 05:30:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:30:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43469398
Sun 19 Jan 2014 05:30:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:30:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:30:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:30:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:30:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:30:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:30:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:30:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:30:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:30:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:30:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:30:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43469398
Sun 19 Jan 2014 05:30:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:30:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:30:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:30:54 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:30:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:30:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:30:58 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:30:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:30:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:30:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:30:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:30:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:30:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:31:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:31:00 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:31:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:31:02 - job_xml_thread(): Done retrieving: data size 43566240
Sun 19 Jan 2014 05:31:02 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:31:02 - XML: Start document: iteration 8
Sun 19 Jan 2014 05:31:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566240
Sun 19 Jan 2014 05:31:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:31:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:31:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:31:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:31:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:31:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:31:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566240
Sun 19 Jan 2014 05:31:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:31:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:31:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:31:13 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:31:14 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:31:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 05:31:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:31:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:31:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 05:31:14 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:31:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:31:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8465 values 133467 bits 16683 bytes 
Sun 19 Jan 2014 05:31:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:31:18 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:31:21 - XML: Processed 653272 elements - found 0 jobs
Sun 19 Jan 2014 05:31:21 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:31:21 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:31:21 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:31:21 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:31:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:31:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:31:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:31:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:31:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:31:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:31:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:31:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:31:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:31:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:31:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:31:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:31:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:31:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:31:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:31:25 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:31:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 05:31:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:31:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:31:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580674
Sun 19 Jan 2014 05:31:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:31:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580674
Sun 19 Jan 2014 05:31:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:31:36 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:31:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:31:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:31:37 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:31:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:31:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:31:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:31:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:31:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:31:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:31:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:31:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:31:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:31:40 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:31:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:31:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:31:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:31:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:31:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:31:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:31:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:31:42 - job_xml_thread(): Done retrieving: data size 43573465
Sun 19 Jan 2014 05:31:42 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:31:42 - XML: Start document: iteration 9
Sun 19 Jan 2014 05:31:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573465
Sun 19 Jan 2014 05:31:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:31:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573465
Sun 19 Jan 2014 05:31:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:31:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:31:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:31:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:31:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:32:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:32:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:32:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:32:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:32:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:32:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:32:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:32:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:32:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:32:03 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:32:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:32:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:32:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:32:04 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 05:32:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:32:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:32:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:32:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:32:04 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:32:04 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:32:04 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:32:04 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:32:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:32:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43589859
Sun 19 Jan 2014 05:32:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:32:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43589859
Sun 19 Jan 2014 05:32:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:32:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:32:14 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:32:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:32:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:32:16 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:32:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:32:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 05:32:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 05:32:16 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:32:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148888 bits 18611 bytes 
Sun 19 Jan 2014 05:32:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:32:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:32:19 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:32:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:32:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:32:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:32:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:32:20 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:32:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:32:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:32:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:32:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:32:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:32:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:32:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:32:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:32:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:32:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:32:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:32:21 - job_xml_thread(): Done retrieving: data size 43590573
Sun 19 Jan 2014 05:32:21 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:32:21 - XML: Start document: iteration 10
Sun 19 Jan 2014 05:32:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43590573
Sun 19 Jan 2014 05:32:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:32:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43590573
Sun 19 Jan 2014 05:32:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:32:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:32:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:32:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:32:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:32:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:32:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:32:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:32:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:32:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:32:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:32:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:32:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:32:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:32:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:32:45 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:32:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:32:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:32:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:32:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:32:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:32:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:32:45 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 05:32:45 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:32:45 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:32:45 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:32:45 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:32:46 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:32:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 05:32:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:32:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:32:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43586398
Sun 19 Jan 2014 05:32:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:32:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43586398
Sun 19 Jan 2014 05:32:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:32:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:32:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:32:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:32:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:32:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:32:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:32:57 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 05:32:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:32:57 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:32:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:32:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:32:58 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:32:58 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 05:32:58 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:32:58 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 05:32:58 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 05:33:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:33:01 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:33:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:33:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:33:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:33:02 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 778856 values 12297626 bits 1537203 bytes 
Sun 19 Jan 2014 05:33:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:33:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:33:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:33:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:33:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:33:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:33:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:33:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43588892
Sun 19 Jan 2014 05:33:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:33:06 - job_xml_thread(): Done retrieving: data size 43588892
Sun 19 Jan 2014 05:33:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43588892
Sun 19 Jan 2014 05:33:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:33:07 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:33:07 - XML: Start document: iteration 11
Sun 19 Jan 2014 05:33:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:33:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:33:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:33:16 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:33:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:33:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 05:33:16 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:33:16 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:33:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8670 values 137004 bits 17125 bytes 
Sun 19 Jan 2014 05:33:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 05:33:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:33:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:33:22 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 05:33:22 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:33:22 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:33:22 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:33:22 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:33:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:33:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:33:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:33:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:33:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:33:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:33:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:33:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:33:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:33:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:33:27 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:33:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:33:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:33:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:33:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:33:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:33:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:33:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:33:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43586520
Sun 19 Jan 2014 05:33:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:33:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43586520
Sun 19 Jan 2014 05:33:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:33:37 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:33:38 - job_xml_thread(): Done retrieving: data size 43586520
Sun 19 Jan 2014 05:33:38 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:33:38 - XML: Start document: iteration 12
Sun 19 Jan 2014 05:33:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:33:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:33:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:33:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:33:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:33:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:33:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:33:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:33:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:33:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:33:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:33:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:33:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:33:53 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 05:33:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:33:53 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:33:53 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:33:53 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:33:53 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:33:53 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:33:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:33:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:33:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:33:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:33:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:33:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:33:53 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:33:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 05:33:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:33:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:33:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583077
Sun 19 Jan 2014 05:33:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:33:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583077
Sun 19 Jan 2014 05:33:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:33:58 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:33:59 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 05:34:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:34:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:34:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:34:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:34:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:34:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:34:08 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:34:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:34:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:34:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:34:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:34:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:34:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:34:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:34:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:34:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:34:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:34:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:34:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:34:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:34:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:34:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:34:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:34:15 - job_xml_thread(): Done retrieving: data size 43580746
Sun 19 Jan 2014 05:34:15 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:34:15 - XML: Start document: iteration 13
Sun 19 Jan 2014 05:34:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580746
Sun 19 Jan 2014 05:34:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580746
Sun 19 Jan 2014 05:34:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:34:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:34:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:34:17 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:34:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:34:19 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:34:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 05:34:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 05:34:19 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:34:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9001 values 142074 bits 17759 bytes 
Sun 19 Jan 2014 05:34:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:34:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:34:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:34:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:34:34 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 05:34:34 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:34:34 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:34:34 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:34:34 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:34:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:34:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:34:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:34:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:34:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:34:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:34:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:34:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:34:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:34:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:34:40 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:34:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:34:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:34:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:34:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:34:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:34:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:34:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:34:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43588208
Sun 19 Jan 2014 05:34:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:34:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43588208
Sun 19 Jan 2014 05:34:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:34:48 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:34:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 05:34:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:34:49 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:34:49 - job_xml_thread(): Done retrieving: data size 43588208
Sun 19 Jan 2014 05:34:49 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:34:49 - XML: Start document: iteration 14
Sun 19 Jan 2014 05:34:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:34:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:34:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:34:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:35:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:35:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:35:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:35:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:35:05 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 05:35:05 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:35:05 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:35:05 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:35:05 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:35:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:35:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:35:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:35:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:35:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:35:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:35:07 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:35:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:35:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:35:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:35:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:35:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:35:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:35:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:35:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43519073
Sun 19 Jan 2014 05:35:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:35:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43519073
Sun 19 Jan 2014 05:35:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:35:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:35:19 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:35:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:35:20 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:35:20 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:35:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:35:21 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:35:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 05:35:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:35:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 05:35:21 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:35:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6246 values 98531 bits 12316 bytes 
Sun 19 Jan 2014 05:35:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:35:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:35:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:35:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:35:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:35:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:35:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:35:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:35:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:35:24 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:35:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:35:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:35:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:35:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:35:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:35:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:35:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:35:28 - job_xml_thread(): Done retrieving: data size 43508804
Sun 19 Jan 2014 05:35:28 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:35:28 - XML: Start document: iteration 15
Sun 19 Jan 2014 05:35:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43508804
Sun 19 Jan 2014 05:35:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:35:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43508804
Sun 19 Jan 2014 05:35:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:35:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:35:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:35:39 - XML: Processed 652600 elements - found 0 jobs
Sun 19 Jan 2014 05:35:39 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:35:39 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:35:39 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:35:39 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:35:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:35:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:35:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:35:46 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:35:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:35:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:35:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:35:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:35:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:35:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:35:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:35:48 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:35:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 05:35:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:35:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:35:52 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:35:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:35:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:35:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:35:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:35:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:35:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:35:54 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:35:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:35:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42919441
Sun 19 Jan 2014 05:35:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:35:55 - job_xml_thread(): Done retrieving: data size 42919441
Sun 19 Jan 2014 05:35:55 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:35:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42919441
Sun 19 Jan 2014 05:35:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:35:55 - XML: Start document: iteration 16
Sun 19 Jan 2014 05:36:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:36:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:36:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:36:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:36:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:36:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:36:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:36:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:36:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:36:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:36:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:36:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:36:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:36:13 - XML: Processed 645270 elements - found 0 jobs
Sun 19 Jan 2014 05:36:13 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:36:13 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:36:13 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:36:13 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:36:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:36:16 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:36:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:36:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:36:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:36:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:36:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:36:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:36:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:36:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42980835
Sun 19 Jan 2014 05:36:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:36:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42980835
Sun 19 Jan 2014 05:36:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:36:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:36:22 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:36:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:36:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 05:36:22 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:36:22 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:36:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 05:36:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9165 values 144591 bits 18073 bytes 
Sun 19 Jan 2014 05:36:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:36:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:36:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:36:28 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:36:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:36:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:36:28 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:36:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:36:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:36:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:36:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:36:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:36:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:36:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:36:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:36:32 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:36:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:36:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:36:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:36:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:36:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:36:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:36:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:36:35 - job_xml_thread(): Done retrieving: data size 43144412
Sun 19 Jan 2014 05:36:35 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:36:35 - XML: Start document: iteration 17
Sun 19 Jan 2014 05:36:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43144412
Sun 19 Jan 2014 05:36:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:36:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43144412
Sun 19 Jan 2014 05:36:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:36:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:36:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:36:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:36:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:36:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:36:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:36:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:36:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:36:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:36:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:36:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:36:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:36:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:36:54 - XML: Processed 647864 elements - found 0 jobs
Sun 19 Jan 2014 05:36:54 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:36:54 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:36:54 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:36:54 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:36:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:36:58 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:36:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:36:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:36:58 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:36:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 05:36:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:36:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:36:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:36:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:36:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:36:59 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 05:36:59 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 05:36:59 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:37:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:37:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559917
Sun 19 Jan 2014 05:37:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:37:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559917
Sun 19 Jan 2014 05:37:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:37:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:37:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:37:09 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:37:09 - job_xml_thread(): Done retrieving: data size 43559917
Sun 19 Jan 2014 05:37:09 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:37:09 - XML: Start document: iteration 18
Sun 19 Jan 2014 05:37:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:37:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:37:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:37:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:37:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:37:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:37:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:37:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:37:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559917
Sun 19 Jan 2014 05:37:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:37:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:37:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:37:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:37:22 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:37:23 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:37:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:37:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 05:37:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 05:37:23 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:37:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5668 values 89321 bits 11165 bytes 
Sun 19 Jan 2014 05:37:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:37:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:37:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:37:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:37:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:37:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:37:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:37:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:37:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:37:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:37:29 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:37:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:37:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:37:29 - XML: Processed 653170 elements - found 0 jobs
Sun 19 Jan 2014 05:37:29 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:37:29 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:37:29 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:37:29 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:37:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:37:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:37:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:37:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:37:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:37:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584005
Sun 19 Jan 2014 05:37:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:37:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584005
Sun 19 Jan 2014 05:37:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:37:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:37:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:37:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:37:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:37:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:37:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:37:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:37:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:37:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:37:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:37:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:37:44 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:37:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:37:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:37:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:37:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:37:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:37:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:37:46 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:37:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 05:37:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:37:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:37:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:37:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:37:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:37:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:37:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43592134
Sun 19 Jan 2014 05:37:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:37:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43592134
Sun 19 Jan 2014 05:37:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:37:48 - job_xml_thread(): Done retrieving: data size 43592134
Sun 19 Jan 2014 05:37:48 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:37:48 - XML: Start document: iteration 19
Sun 19 Jan 2014 05:37:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:37:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:38:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:38:00 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:38:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:38:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:38:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:38:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:38:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:38:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:38:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:38:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:38:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:38:05 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 05:38:05 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:38:05 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:38:05 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:38:05 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:38:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:38:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:38:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:38:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:38:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:38:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:38:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:38:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:38:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:38:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565479
Sun 19 Jan 2014 05:38:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:38:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565479
Sun 19 Jan 2014 05:38:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:38:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:38:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:38:20 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:38:20 - job_xml_thread(): Done retrieving: data size 43565479
Sun 19 Jan 2014 05:38:20 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:38:20 - XML: Start document: iteration 20
Sun 19 Jan 2014 05:38:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:38:24 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:38:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:38:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 05:38:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:38:25 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:38:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:38:25 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:38:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 05:38:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8914 values 140590 bits 17573 bytes 
Sun 19 Jan 2014 05:38:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:38:29 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:38:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:38:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:38:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:38:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:38:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:38:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:38:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:38:33 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 05:38:33 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:38:33 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:38:33 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:38:33 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:38:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:38:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:38:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:38:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:38:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:38:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:38:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:38:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:38:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:38:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43597613
Sun 19 Jan 2014 05:38:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:38:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43597613
Sun 19 Jan 2014 05:38:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:38:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:38:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:38:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:38:45 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:38:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:38:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:38:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:38:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:38:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:38:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:38:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:38:49 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:38:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:38:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:38:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:38:51 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:38:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:38:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:38:51 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:38:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 05:38:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:38:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:38:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:38:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:38:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:38:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:38:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581306
Sun 19 Jan 2014 05:38:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:38:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581306
Sun 19 Jan 2014 05:38:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:38:53 - job_xml_thread(): Done retrieving: data size 43581306
Sun 19 Jan 2014 05:38:53 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:38:53 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 05:38:54 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 05:38:54 - Housekeeping: done.
Sun 19 Jan 2014 05:38:54 - XML: Start document: iteration 0
Sun 19 Jan 2014 05:39:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:39:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:39:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:39:03 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:39:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:39:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:39:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:39:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:39:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:39:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:39:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:39:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:39:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:39:11 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 05:39:11 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:39:11 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:39:11 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:39:11 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:39:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:39:14 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:39:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:39:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:39:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:39:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:39:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:39:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:39:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:39:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562283
Sun 19 Jan 2014 05:39:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:39:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562283
Sun 19 Jan 2014 05:39:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:39:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:39:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:39:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:39:25 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:39:26 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:39:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:39:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:39:27 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:39:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 05:39:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 05:39:27 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:39:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8650 values 136361 bits 17045 bytes 
Sun 19 Jan 2014 05:39:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:39:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:39:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:39:31 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:39:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:39:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:39:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:39:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:39:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:39:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:39:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:39:32 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:39:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:39:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:39:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:39:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:39:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:39:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:39:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:39:34 - job_xml_thread(): Done retrieving: data size 43579326
Sun 19 Jan 2014 05:39:34 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:39:34 - XML: Start document: iteration 1
Sun 19 Jan 2014 05:39:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579326
Sun 19 Jan 2014 05:39:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579326
Sun 19 Jan 2014 05:39:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:39:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:39:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:39:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:39:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:39:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:39:49 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 05:39:49 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:39:49 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:39:49 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:39:49 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:39:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:39:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:39:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:39:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:39:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:39:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:39:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:39:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:39:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:39:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:39:57 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:39:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:39:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:39:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:39:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:39:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:39:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:39:57 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:39:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 05:39:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:39:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:39:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583221
Sun 19 Jan 2014 05:39:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:39:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583221
Sun 19 Jan 2014 05:39:59 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 05:39:59 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:39:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:40:01 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:40:01 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:40:01 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 05:40:01 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 05:40:01 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 05:40:04 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:40:04 - job_xml_thread(): Done retrieving: data size 43583221
Sun 19 Jan 2014 05:40:04 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:40:04 - XML: Start document: iteration 2
Sun 19 Jan 2014 05:40:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:40:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:40:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:40:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:40:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:40:14 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:40:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:40:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:40:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:40:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:40:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:40:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:40:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:40:16 - size of cluster 'LISA Cluster': 624 hosts 79477 metrics 845365 values 13323994 bits 1665499 bytes 
Sun 19 Jan 2014 05:40:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:40:20 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:40:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:40:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:40:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:40:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:40:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:40:22 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 05:40:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:40:22 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:40:22 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:40:22 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:40:22 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:40:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:40:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557576
Sun 19 Jan 2014 05:40:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:40:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557576
Sun 19 Jan 2014 05:40:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:40:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:40:27 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:40:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:40:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 05:40:29 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:40:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8778 values 138393 bits 17299 bytes 
Sun 19 Jan 2014 05:40:29 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:40:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 05:40:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:40:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:40:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:40:37 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:40:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:40:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:40:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:40:41 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:40:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:40:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:40:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:40:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:40:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:40:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:40:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:40:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:40:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:40:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:40:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:40:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:40:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:40:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:40:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:40:46 - job_xml_thread(): Done retrieving: data size 43573023
Sun 19 Jan 2014 05:40:46 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:40:46 - XML: Start document: iteration 3
Sun 19 Jan 2014 05:40:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573023
Sun 19 Jan 2014 05:40:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:40:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573023
Sun 19 Jan 2014 05:40:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:40:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:40:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:40:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:40:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:40:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:40:59 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:40:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:40:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:41:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:41:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:41:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:41:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:41:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:41:02 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:41:02 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 05:41:02 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 05:41:02 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:41:02 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:41:02 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:41:02 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:41:07 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:41:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 05:41:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:41:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:41:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:41:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:41:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:41:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:41:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:41:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:41:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:41:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:41:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565960
Sun 19 Jan 2014 05:41:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:41:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565960
Sun 19 Jan 2014 05:41:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:41:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:41:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:41:17 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:41:17 - job_xml_thread(): Done retrieving: data size 43565960
Sun 19 Jan 2014 05:41:17 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:41:17 - XML: Start document: iteration 4
Sun 19 Jan 2014 05:41:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:41:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:41:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:41:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:41:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:41:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:41:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:41:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:41:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:41:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:41:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:41:29 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 05:41:29 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:41:29 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:41:29 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:41:29 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:41:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:41:30 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:41:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:41:30 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:41:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 05:41:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 05:41:30 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:41:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5906 values 93156 bits 11644 bytes 
Sun 19 Jan 2014 05:41:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:41:34 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:41:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:41:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:41:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:41:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:41:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:41:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:41:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:41:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43357633
Sun 19 Jan 2014 05:41:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:41:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43357633
Sun 19 Jan 2014 05:41:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:41:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:41:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:41:44 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:41:44 - job_xml_thread(): Done retrieving: data size 43357633
Sun 19 Jan 2014 05:41:44 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:41:44 - XML: Start document: iteration 5
Sun 19 Jan 2014 05:41:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:41:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:41:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:41:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:41:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:41:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:41:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:41:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:41:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:41:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:41:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:41:58 - XML: Processed 651080 elements - found 0 jobs
Sun 19 Jan 2014 05:41:58 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:41:58 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:41:58 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:41:58 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:42:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:42:01 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:42:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:42:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:42:02 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:42:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 05:42:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:42:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:42:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:42:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:42:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:42:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:42:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42910750
Sun 19 Jan 2014 05:42:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:42:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42910750
Sun 19 Jan 2014 05:42:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:42:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:42:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:42:13 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:42:13 - job_xml_thread(): Done retrieving: data size 42910750
Sun 19 Jan 2014 05:42:13 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:42:13 - XML: Start document: iteration 6
Sun 19 Jan 2014 05:42:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:42:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:42:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:42:18 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:42:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:42:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:42:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:42:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:42:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:42:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:42:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:42:27 - XML: Processed 645202 elements - found 0 jobs
Sun 19 Jan 2014 05:42:27 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:42:27 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:42:27 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:42:27 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:42:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:42:28 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:42:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:42:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:42:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:42:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:42:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:42:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:42:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:42:30 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:42:31 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:42:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:42:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 05:42:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 05:42:31 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:42:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5466 values 86148 bits 10768 bytes 
Sun 19 Jan 2014 05:42:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:42:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42970600
Sun 19 Jan 2014 05:42:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:42:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42970600
Sun 19 Jan 2014 05:42:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:42:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:42:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:42:42 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:42:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:42:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:42:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:42:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:42:45 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:42:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:42:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:42:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:42:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:42:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:42:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:42:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:42:47 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:42:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:42:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:42:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:42:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:42:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:42:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:42:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:42:51 - job_xml_thread(): Done retrieving: data size 43513738
Sun 19 Jan 2014 05:42:51 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:42:51 - XML: Start document: iteration 7
Sun 19 Jan 2014 05:42:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43513738
Sun 19 Jan 2014 05:42:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:42:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43513738
Sun 19 Jan 2014 05:42:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:42:56 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:42:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 05:42:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:43:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:43:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:43:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:43:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:43:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:43:04 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:43:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:43:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:43:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:43:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:43:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:43:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:43:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:43:08 - XML: Processed 652701 elements - found 0 jobs
Sun 19 Jan 2014 05:43:08 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:43:08 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:43:08 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:43:08 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:43:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:43:14 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:43:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:43:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:43:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:43:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:43:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:43:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:43:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:43:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567418
Sun 19 Jan 2014 05:43:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:43:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567418
Sun 19 Jan 2014 05:43:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:43:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:43:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:43:24 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:43:24 - job_xml_thread(): Done retrieving: data size 43567418
Sun 19 Jan 2014 05:43:24 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:43:24 - XML: Start document: iteration 8
Sun 19 Jan 2014 05:43:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:43:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:43:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:43:31 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:43:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:43:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 05:43:33 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:43:33 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:43:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 05:43:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:43:34 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:43:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6580 values 103761 bits 12970 bytes 
Sun 19 Jan 2014 05:43:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:43:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:43:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:43:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:43:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:43:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:43:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:43:41 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 05:43:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:43:41 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:43:41 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:43:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:43:41 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:43:41 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:43:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:43:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:43:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:43:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:43:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:43:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:43:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:43:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576010
Sun 19 Jan 2014 05:43:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:43:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576010
Sun 19 Jan 2014 05:43:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:43:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:43:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:43:56 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:43:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:43:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:43:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:44:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:44:00 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:44:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:44:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:44:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:44:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:44:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:44:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:44:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:44:01 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:44:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:44:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:44:01 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:44:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 05:44:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:44:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:44:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:44:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:44:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:44:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:44:05 - job_xml_thread(): Done retrieving: data size 43578164
Sun 19 Jan 2014 05:44:05 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:44:05 - XML: Start document: iteration 9
Sun 19 Jan 2014 05:44:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578164
Sun 19 Jan 2014 05:44:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:44:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578164
Sun 19 Jan 2014 05:44:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:44:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:44:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:44:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:44:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:44:20 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 05:44:20 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:44:20 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:44:20 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:44:20 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:44:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:44:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:44:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:44:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:44:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:44:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:44:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:44:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:44:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:44:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:44:26 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:44:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:44:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:44:26 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 05:44:26 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 05:44:26 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:44:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:44:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:44:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:44:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:44:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:44:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43600262
Sun 19 Jan 2014 05:44:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:44:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43600262
Sun 19 Jan 2014 05:44:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:44:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:44:34 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:44:35 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:44:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:44:36 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:44:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 05:44:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 05:44:36 - job_xml_thread(): Done retrieving: data size 43600262
Sun 19 Jan 2014 05:44:36 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:44:36 - XML: Start document: iteration 10
Sun 19 Jan 2014 05:44:36 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:44:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9075 values 143049 bits 17881 bytes 
Sun 19 Jan 2014 05:44:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:44:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:44:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:44:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:44:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:44:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:44:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:44:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:44:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:44:47 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:44:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:44:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:44:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:44:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:44:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:44:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:44:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:44:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:44:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:44:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:44:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:44:51 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 05:44:51 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:44:51 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:44:51 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:44:51 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:44:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:44:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575654
Sun 19 Jan 2014 05:44:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:44:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575654
Sun 19 Jan 2014 05:44:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:45:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:45:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:45:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:45:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:45:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:45:06 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:45:06 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:45:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:45:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:45:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:45:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:45:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:45:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:45:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:45:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:45:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:45:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:45:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:45:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:45:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:45:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:45:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:45:09 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:45:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 05:45:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:45:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:45:11 - job_xml_thread(): Done retrieving: data size 43580250
Sun 19 Jan 2014 05:45:11 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:45:11 - XML: Start document: iteration 11
Sun 19 Jan 2014 05:45:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580250
Sun 19 Jan 2014 05:45:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580250
Sun 19 Jan 2014 05:45:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:45:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:45:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:45:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:45:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:45:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:45:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:45:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:45:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:45:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:45:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:45:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:45:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:45:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:45:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:45:29 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 05:45:29 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:45:29 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:45:29 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:45:29 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:45:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:45:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:45:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:45:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:45:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:45:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:45:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:45:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:45:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:45:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566450
Sun 19 Jan 2014 05:45:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:45:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:45:36 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:45:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566450
Sun 19 Jan 2014 05:45:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:45:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:45:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 05:45:37 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:45:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8867 values 139820 bits 17477 bytes 
Sun 19 Jan 2014 05:45:37 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:45:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 05:45:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:45:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:45:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:45:43 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:45:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:45:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:45:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:45:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:45:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566450
Sun 19 Jan 2014 05:45:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:45:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:45:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:45:44 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:45:44 - job_xml_thread(): Done retrieving: data size 43566450
Sun 19 Jan 2014 05:45:44 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:45:44 - XML: Start document: iteration 12
Sun 19 Jan 2014 05:45:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:45:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:45:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:45:55 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:45:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:45:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:45:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:45:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:45:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:45:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:45:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:45:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:45:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:46:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:46:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:46:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:46:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:46:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:46:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:46:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:46:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:46:04 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 05:46:04 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:46:04 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:46:04 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:46:04 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:46:06 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:46:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 05:46:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:46:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:46:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568877
Sun 19 Jan 2014 05:46:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:46:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568877
Sun 19 Jan 2014 05:46:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:46:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:46:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:46:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:46:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:46:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:46:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:46:19 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:46:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:46:19 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:46:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:46:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:46:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:46:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:46:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:46:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:46:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:46:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:46:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:46:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:46:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:46:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:46:21 - job_xml_thread(): Done retrieving: data size 43584655
Sun 19 Jan 2014 05:46:21 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:46:21 - XML: Start document: iteration 13
Sun 19 Jan 2014 05:46:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584655
Sun 19 Jan 2014 05:46:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:46:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584655
Sun 19 Jan 2014 05:46:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:46:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:46:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:46:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:46:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:46:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:46:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:46:37 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:46:38 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:46:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:46:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:46:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:46:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:46:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:46:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:46:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:46:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 05:46:38 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:46:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 05:46:38 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:46:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:46:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6367 values 100481 bits 12560 bytes 
Sun 19 Jan 2014 05:46:39 - XML: Processed 653348 elements - found 0 jobs
Sun 19 Jan 2014 05:46:39 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:46:39 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:46:39 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:46:39 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:46:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:46:42 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:46:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:46:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:46:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:46:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:46:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:46:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:46:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:46:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43586731
Sun 19 Jan 2014 05:46:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:46:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43586731
Sun 19 Jan 2014 05:46:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:46:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:46:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:46:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:46:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:46:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:46:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:46:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:46:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:46:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:46:54 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:46:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:46:57 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:46:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:46:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:46:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:46:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:46:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:46:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:46:57 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:46:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 05:46:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:46:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:46:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43594116
Sun 19 Jan 2014 05:46:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:46:59 - job_xml_thread(): Done retrieving: data size 43594116
Sun 19 Jan 2014 05:46:59 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:46:59 - XML: Start document: iteration 14
Sun 19 Jan 2014 05:47:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43594116
Sun 19 Jan 2014 05:47:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:47:02 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 05:47:03 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:47:06 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:47:06 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:47:06 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 05:47:06 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 05:47:06 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 05:47:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:47:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:47:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:47:10 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:47:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:47:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:47:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:47:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sun 19 Jan 2014 05:47:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:47:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:47:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:47:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:47:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:47:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:47:19 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:47:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:47:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:47:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:47:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:47:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:47:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:47:21 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 05:47:21 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:47:21 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:47:21 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:47:21 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:47:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:47:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43490260
Sun 19 Jan 2014 05:47:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:47:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43490260
Sun 19 Jan 2014 05:47:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:47:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:47:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:47:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:47:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:47:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:47:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:47:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:47:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:47:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:47:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:47:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:47:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:47:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:47:36 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:47:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:47:37 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:47:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:47:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:47:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:47:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:47:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:47:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:47:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:47:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42982823
Sun 19 Jan 2014 05:47:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:47:39 - job_xml_thread(): Done retrieving: data size 42982823
Sun 19 Jan 2014 05:47:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:47:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42982823
Sun 19 Jan 2014 05:47:39 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:47:39 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:47:39 - XML: Start document: iteration 15
Sun 19 Jan 2014 05:47:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:47:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:47:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 05:47:41 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:47:41 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:47:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 05:47:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 11895 values 188172 bits 23521 bytes 
Sun 19 Jan 2014 05:47:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:47:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:47:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:47:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:47:55 - XML: Processed 645964 elements - found 0 jobs
Sun 19 Jan 2014 05:47:55 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:47:55 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:47:55 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:47:56 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:47:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:47:59 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:47:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:47:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:47:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:48:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:48:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:48:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:48:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:48:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:48:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:48:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:48:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:48:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:48:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:48:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:48:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:48:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:48:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42930401
Sun 19 Jan 2014 05:48:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:48:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42930401
Sun 19 Jan 2014 05:48:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:48:06 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:48:06 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:48:07 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:48:07 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 05:48:07 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:48:07 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 05:48:08 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 05:48:11 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:48:11 - job_xml_thread(): Done retrieving: data size 42930401
Sun 19 Jan 2014 05:48:11 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:48:12 - XML: Start document: iteration 16
Sun 19 Jan 2014 05:48:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:48:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:48:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:48:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:48:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:48:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:48:17 - size of cluster 'LISA Cluster': 624 hosts 79472 metrics 816371 values 12884170 bits 1610521 bytes 
Sun 19 Jan 2014 05:48:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:48:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:48:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:48:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:48:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:48:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:48:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:48:26 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:48:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 05:48:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:48:26 - XML: Processed 645150 elements - found 0 jobs
Sun 19 Jan 2014 05:48:26 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:48:26 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:48:26 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:48:26 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:48:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:48:29 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:48:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:48:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:48:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:48:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:48:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:48:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:48:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:48:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42953746
Sun 19 Jan 2014 05:48:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:48:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42953746
Sun 19 Jan 2014 05:48:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:48:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:48:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:48:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:48:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:48:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:48:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:48:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:48:41 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:48:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:48:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:48:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:48:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:48:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42953746
Sun 19 Jan 2014 05:48:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:48:41 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:48:41 - job_xml_thread(): Done retrieving: data size 42953746
Sun 19 Jan 2014 05:48:41 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:48:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 05:48:41 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:48:41 - XML: Start document: iteration 17
Sun 19 Jan 2014 05:48:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:48:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 05:48:41 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:48:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5974 values 94356 bits 11794 bytes 
Sun 19 Jan 2014 05:48:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:48:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:48:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:48:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:48:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:48:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:48:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:48:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:48:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:48:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:48:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:48:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:48:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:48:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:48:58 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:48:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:48:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:48:58 - XML: Processed 645900 elements - found 0 jobs
Sun 19 Jan 2014 05:48:58 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:48:58 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:48:58 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:48:58 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:48:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:48:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:48:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:48:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:49:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:49:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579189
Sun 19 Jan 2014 05:49:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:49:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579189
Sun 19 Jan 2014 05:49:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:49:07 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:49:07 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 05:49:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:49:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:49:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:49:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:49:13 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:49:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:49:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:49:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:49:14 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:49:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 05:49:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:49:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:49:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:49:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:49:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:49:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:49:18 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:49:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:49:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:49:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:49:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:49:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:49:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:49:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:49:21 - job_xml_thread(): Done retrieving: data size 43581833
Sun 19 Jan 2014 05:49:21 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:49:21 - XML: Start document: iteration 18
Sun 19 Jan 2014 05:49:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581833
Sun 19 Jan 2014 05:49:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581833
Sun 19 Jan 2014 05:49:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:49:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:49:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:49:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:49:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:49:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:49:40 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 05:49:40 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:49:40 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:49:40 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:49:40 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:49:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:49:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:49:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:49:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:49:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:49:41 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:49:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:49:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:49:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:49:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:49:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:49:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:49:42 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:49:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 05:49:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 05:49:42 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:49:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5896 values 92993 bits 11624 bytes 
Sun 19 Jan 2014 05:49:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:49:45 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:49:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:49:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:49:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:49:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:49:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:49:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:49:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:49:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584204
Sun 19 Jan 2014 05:49:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:49:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584204
Sun 19 Jan 2014 05:49:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:49:55 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:49:55 - job_xml_thread(): Done retrieving: data size 43584204
Sun 19 Jan 2014 05:49:55 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:49:55 - XML: Start document: iteration 19
Sun 19 Jan 2014 05:49:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:49:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:50:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:50:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:50:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:50:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:50:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:50:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:50:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:50:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:50:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:50:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:50:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:50:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:50:06 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:50:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:50:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:50:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:50:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:50:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:50:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:50:11 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:50:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 05:50:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:50:11 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 05:50:11 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:50:11 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:50:11 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:50:11 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:50:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:50:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563439
Sun 19 Jan 2014 05:50:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:50:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563439
Sun 19 Jan 2014 05:50:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:50:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:50:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:50:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:50:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:50:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:50:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:50:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:50:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:50:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:50:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:50:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:50:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:50:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:50:26 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:50:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:50:29 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:50:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:50:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:50:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:50:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:50:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:50:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:50:31 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 05:50:31 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 05:50:31 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:50:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:50:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43590406
Sun 19 Jan 2014 05:50:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:50:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43590406
Sun 19 Jan 2014 05:50:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:50:32 - job_xml_thread(): Done retrieving: data size 43590406
Sun 19 Jan 2014 05:50:32 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:50:32 - XML: Start document: iteration 20
Sun 19 Jan 2014 05:50:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:50:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:50:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:50:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:50:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:50:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:50:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:50:42 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:50:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:50:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:50:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:50:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:50:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:50:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:50:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 05:50:44 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:50:44 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:50:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 05:50:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8855 values 139612 bits 17451 bytes 
Sun 19 Jan 2014 05:50:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:50:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:50:52 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 05:50:52 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:50:52 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:50:52 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:50:52 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:50:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:50:55 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:50:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:50:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:50:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:50:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:50:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:50:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:50:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:50:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553747
Sun 19 Jan 2014 05:50:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:50:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553747
Sun 19 Jan 2014 05:50:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:50:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:50:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:51:07 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:51:07 - job_xml_thread(): Done retrieving: data size 43553747
Sun 19 Jan 2014 05:51:07 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:51:07 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 05:51:07 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 05:51:07 - Housekeeping: done.
Sun 19 Jan 2014 05:51:07 - XML: Start document: iteration 0
Sun 19 Jan 2014 05:51:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:51:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:51:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:51:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:51:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:51:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:51:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:51:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:51:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:51:10 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:51:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 05:51:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:51:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:51:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:51:19 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 05:51:20 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:51:20 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:51:20 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:51:20 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:51:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:51:21 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:51:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:51:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:51:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:51:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:51:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:51:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:51:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:51:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43546682
Sun 19 Jan 2014 05:51:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:51:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43546682
Sun 19 Jan 2014 05:51:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:51:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:51:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:51:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:51:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:51:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:51:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:51:35 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:51:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:51:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:51:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:51:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:51:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:51:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:51:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:51:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:51:37 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:51:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:51:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:51:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:51:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:51:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:51:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:51:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:51:39 - job_xml_thread(): Done retrieving: data size 43572889
Sun 19 Jan 2014 05:51:39 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:51:39 - XML: Start document: iteration 1
Sun 19 Jan 2014 05:51:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572889
Sun 19 Jan 2014 05:51:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:51:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572889
Sun 19 Jan 2014 05:51:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:51:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:51:44 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:51:46 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:51:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 05:51:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:51:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 05:51:46 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:51:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9315 values 146918 bits 18364 bytes 
Sun 19 Jan 2014 05:51:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:51:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:51:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:51:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:51:54 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 05:51:54 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:51:54 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:51:54 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:51:54 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:51:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:51:59 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:51:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:51:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:52:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:52:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:52:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:52:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:52:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:52:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:52:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:52:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:52:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:52:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:52:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:52:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:52:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:52:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:52:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43591517
Sun 19 Jan 2014 05:52:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:52:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43591517
Sun 19 Jan 2014 05:52:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:52:09 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:52:09 - job_xml_thread(): Done retrieving: data size 43591517
Sun 19 Jan 2014 05:52:09 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:52:09 - XML: Start document: iteration 2
Sun 19 Jan 2014 05:52:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:52:13 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:52:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:52:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:52:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:52:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:52:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:52:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:52:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:52:16 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:52:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 05:52:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:52:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:52:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:52:22 - XML: Processed 653349 elements - found 0 jobs
Sun 19 Jan 2014 05:52:22 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:52:22 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:52:22 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:52:22 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:52:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:52:26 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:52:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:52:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:52:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:52:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:52:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:52:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:52:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:52:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558555
Sun 19 Jan 2014 05:52:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:52:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558555
Sun 19 Jan 2014 05:52:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:52:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:52:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:52:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:52:37 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:52:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:52:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:52:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:52:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:52:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558555
Sun 19 Jan 2014 05:52:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:52:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:52:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:52:37 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:52:37 - job_xml_thread(): Done retrieving: data size 43558555
Sun 19 Jan 2014 05:52:37 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:52:37 - XML: Start document: iteration 3
Sun 19 Jan 2014 05:52:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:52:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:52:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:52:45 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:52:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:52:46 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:52:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:52:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 05:52:46 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:52:46 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:52:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 05:52:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6019 values 94963 bits 11870 bytes 
Sun 19 Jan 2014 05:52:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:52:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:52:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:52:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:52:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:52:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:52:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:52:55 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 05:52:55 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:52:55 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:52:55 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:52:55 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:52:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:52:57 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:52:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:52:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:52:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:52:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:52:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:52:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:53:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:53:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43587577
Sun 19 Jan 2014 05:53:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:53:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43587577
Sun 19 Jan 2014 05:53:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:53:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:53:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:53:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:53:10 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:53:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:53:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:53:10 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:53:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:53:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:53:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:53:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:53:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:53:11 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:53:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 05:53:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:53:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:53:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:53:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:53:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:53:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:53:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:53:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:53:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:53:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:53:14 - job_xml_thread(): Done retrieving: data size 43522023
Sun 19 Jan 2014 05:53:14 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:53:14 - XML: Start document: iteration 4
Sun 19 Jan 2014 05:53:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43522023
Sun 19 Jan 2014 05:53:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:53:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43522023
Sun 19 Jan 2014 05:53:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:53:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:53:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:53:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:53:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:53:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:53:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:53:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:53:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:53:33 - XML: Processed 652600 elements - found 0 jobs
Sun 19 Jan 2014 05:53:33 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:53:33 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:53:33 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:53:33 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:53:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:53:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:53:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:53:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:53:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:53:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:53:37 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:53:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:53:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:53:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:53:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:53:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:53:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:53:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:53:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43021577
Sun 19 Jan 2014 05:53:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:53:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43021577
Sun 19 Jan 2014 05:53:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:53:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:53:46 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:53:48 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:53:48 - job_xml_thread(): Done retrieving: data size 43021577
Sun 19 Jan 2014 05:53:48 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:53:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:53:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 05:53:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:53:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 05:53:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:53:48 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:53:48 - XML: Start document: iteration 5
Sun 19 Jan 2014 05:53:48 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:53:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9285 values 146402 bits 18300 bytes 
Sun 19 Jan 2014 05:53:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:53:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:53:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:53:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:53:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:53:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:53:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:53:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:53:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:53:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:53:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:54:01 - XML: Processed 646626 elements - found 0 jobs
Sun 19 Jan 2014 05:54:01 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:54:01 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:54:01 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:54:01 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:54:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:54:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:54:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:54:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:54:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:54:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:54:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:54:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:54:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:54:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42906475
Sun 19 Jan 2014 05:54:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:54:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42906475
Sun 19 Jan 2014 05:54:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:54:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:54:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:54:17 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:54:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:54:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:54:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:54:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:54:18 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:54:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:54:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:54:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:54:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:54:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:54:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:54:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:54:19 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:54:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:54:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:54:19 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:54:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 05:54:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:54:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:54:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:54:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:54:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:54:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:54:21 - job_xml_thread(): Done retrieving: data size 42968787
Sun 19 Jan 2014 05:54:21 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:54:21 - XML: Start document: iteration 6
Sun 19 Jan 2014 05:54:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42968787
Sun 19 Jan 2014 05:54:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:54:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42968787
Sun 19 Jan 2014 05:54:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:54:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:54:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:54:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:54:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:54:39 - XML: Processed 645722 elements - found 0 jobs
Sun 19 Jan 2014 05:54:39 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:54:39 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:54:40 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:54:40 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:54:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:54:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:54:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:54:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:54:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:54:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:54:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:54:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:54:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:54:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:54:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:54:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:54:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:54:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:54:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:54:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:54:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:54:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:54:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43509333
Sun 19 Jan 2014 05:54:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:54:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43509333
Sun 19 Jan 2014 05:54:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:54:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:54:48 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:54:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:54:49 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:54:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 05:54:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 05:54:49 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:54:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9069 values 142946 bits 17868 bytes 
Sun 19 Jan 2014 05:54:55 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:54:55 - job_xml_thread(): Done retrieving: data size 43509333
Sun 19 Jan 2014 05:54:55 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:54:55 - XML: Start document: iteration 7
Sun 19 Jan 2014 05:54:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:54:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:54:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:54:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:54:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:54:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:54:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:54:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:54:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:54:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:54:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:55:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:55:06 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:55:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:55:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:55:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:55:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:55:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:55:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:55:07 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 05:55:08 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:55:08 - XML: Processed 652226 elements - found 0 jobs
Sun 19 Jan 2014 05:55:08 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:55:08 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:55:08 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:55:08 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:55:08 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:55:08 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 05:55:08 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:55:08 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 05:55:08 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 05:55:09 - size of cluster 'LISA Cluster': 624 hosts 79482 metrics 943635 values 14883101 bits 1860387 bytes 
Sun 19 Jan 2014 05:55:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:55:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43542173
Sun 19 Jan 2014 05:55:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:55:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43542173
Sun 19 Jan 2014 05:55:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:55:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:55:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:55:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:55:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:55:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:55:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:55:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:55:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:55:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:55:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:55:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:55:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:55:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:55:23 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:55:26 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:55:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 05:55:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:55:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:55:28 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:55:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:55:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:55:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:55:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:55:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:55:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:55:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:55:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571839
Sun 19 Jan 2014 05:55:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:55:32 - job_xml_thread(): Done retrieving: data size 43571839
Sun 19 Jan 2014 05:55:32 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:55:32 - XML: Start document: iteration 8
Sun 19 Jan 2014 05:55:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571839
Sun 19 Jan 2014 05:55:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:55:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:55:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:55:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:55:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:55:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:55:47 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:55:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:55:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:55:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:55:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:55:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:55:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:55:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:55:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:55:50 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 05:55:50 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:55:50 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:55:50 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:55:50 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:55:50 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:55:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:55:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 05:55:51 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:55:51 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:55:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5828 values 91929 bits 11491 bytes 
Sun 19 Jan 2014 05:55:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 05:55:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:55:55 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:55:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:55:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:55:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:55:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:55:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:55:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:55:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:55:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562205
Sun 19 Jan 2014 05:55:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:56:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562205
Sun 19 Jan 2014 05:56:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:56:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:56:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:56:05 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:56:05 - job_xml_thread(): Done retrieving: data size 43562205
Sun 19 Jan 2014 05:56:05 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:56:05 - XML: Start document: iteration 9
Sun 19 Jan 2014 05:56:08 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:56:09 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 05:56:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:56:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:56:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:56:13 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:56:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:56:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:56:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:56:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:56:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:56:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:56:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:56:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:56:21 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:56:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:56:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:56:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:56:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:56:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:56:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:56:23 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 05:56:23 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:56:23 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:56:23 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:56:23 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:56:24 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:56:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 05:56:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:56:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:56:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554696
Sun 19 Jan 2014 05:56:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:56:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554696
Sun 19 Jan 2014 05:56:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:56:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:56:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:56:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:56:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:56:39 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:56:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:56:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:56:41 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:56:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:56:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:56:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:56:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:56:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:56:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:56:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:56:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:56:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:56:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:56:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:56:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:56:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:56:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:56:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:56:45 - job_xml_thread(): Done retrieving: data size 43593793
Sun 19 Jan 2014 05:56:45 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:56:45 - XML: Start document: iteration 10
Sun 19 Jan 2014 05:56:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43593793
Sun 19 Jan 2014 05:56:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:56:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43593793
Sun 19 Jan 2014 05:56:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:56:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:56:51 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:56:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:56:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 05:56:52 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:56:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9064 values 142954 bits 17869 bytes 
Sun 19 Jan 2014 05:56:52 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:56:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 05:56:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:56:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:56:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:56:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:57:04 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 05:57:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:57:04 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:57:04 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:57:04 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:57:04 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:57:04 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:57:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:57:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:57:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:57:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:57:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:57:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:57:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:57:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:57:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:57:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:57:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:57:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:57:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:57:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:57:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:57:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:57:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576655
Sun 19 Jan 2014 05:57:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:57:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576655
Sun 19 Jan 2014 05:57:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:57:19 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:57:19 - job_xml_thread(): Done retrieving: data size 43576655
Sun 19 Jan 2014 05:57:19 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:57:19 - XML: Start document: iteration 11
Sun 19 Jan 2014 05:57:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:57:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:57:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:57:20 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:57:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:57:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:57:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:57:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:57:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:57:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:57:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576655
Sun 19 Jan 2014 05:57:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:57:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:57:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:57:25 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:57:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 05:57:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:57:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:57:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:57:38 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 05:57:38 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:57:38 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:57:38 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:57:38 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:57:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:57:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:57:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:57:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:57:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:57:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:57:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:57:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:57:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:57:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:57:42 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:57:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:57:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:57:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:57:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:57:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:57:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:57:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:57:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43598878
Sun 19 Jan 2014 05:57:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:57:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43598878
Sun 19 Jan 2014 05:57:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:57:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:57:52 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:57:53 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:57:53 - job_xml_thread(): Done retrieving: data size 43598878
Sun 19 Jan 2014 05:57:53 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:57:53 - XML: Start document: iteration 12
Sun 19 Jan 2014 05:57:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:57:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 05:57:53 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:57:53 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:57:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 05:57:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6259 values 98745 bits 12343 bytes 
Sun 19 Jan 2014 05:57:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:57:54 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:57:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:57:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:57:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:57:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:57:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:57:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:57:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:57:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:57:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:58:07 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 05:58:07 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:58:07 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:58:07 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:58:07 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:58:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:58:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:58:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:58:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:58:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:58:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:58:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:58:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:58:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:58:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:58:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:58:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43549645
Sun 19 Jan 2014 05:58:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:58:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43549645
Sun 19 Jan 2014 05:58:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:58:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:58:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:58:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:58:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:58:22 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:58:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:58:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:58:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:58:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:58:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:58:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:58:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:58:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:58:27 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:58:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:58:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:58:28 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:58:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 05:58:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:58:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:58:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:58:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:58:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:58:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:58:31 - job_xml_thread(): Done retrieving: data size 43579245
Sun 19 Jan 2014 05:58:31 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:58:31 - XML: Start document: iteration 13
Sun 19 Jan 2014 05:58:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579245
Sun 19 Jan 2014 05:58:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:58:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579245
Sun 19 Jan 2014 05:58:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:58:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:58:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:58:43 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 05:58:43 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:58:43 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:58:43 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:58:43 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:58:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:58:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:58:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:58:47 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:58:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:58:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:58:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:58:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:58:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:58:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:58:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:58:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:58:52 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:58:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:58:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:58:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:58:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:58:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:58:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:58:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:58:53 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:58:54 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:58:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:58:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 05:58:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 05:58:54 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:58:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5608 values 88397 bits 11049 bytes 
Sun 19 Jan 2014 05:58:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:58:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568641
Sun 19 Jan 2014 05:58:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:58:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568641
Sun 19 Jan 2014 05:58:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:58:58 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:58:58 - job_xml_thread(): Done retrieving: data size 43568641
Sun 19 Jan 2014 05:58:58 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:58:58 - XML: Start document: iteration 14
Sun 19 Jan 2014 05:59:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:59:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:59:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:59:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:59:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:59:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:59:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:59:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:59:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:59:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:59:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:59:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:59:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:59:16 - XML: Processed 653348 elements - found 0 jobs
Sun 19 Jan 2014 05:59:16 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:59:16 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:59:16 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:59:16 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:59:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:59:19 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:59:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:59:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:59:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:59:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:59:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:59:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:59:22 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:59:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 05:59:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:59:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:59:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43506005
Sun 19 Jan 2014 05:59:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:59:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43506005
Sun 19 Jan 2014 05:59:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:59:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:59:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:59:32 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:59:32 - job_xml_thread(): Done retrieving: data size 43506005
Sun 19 Jan 2014 05:59:32 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 05:59:32 - XML: Start document: iteration 15
Sun 19 Jan 2014 05:59:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 05:59:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:59:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:59:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:59:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:59:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:59:43 - XML: Processed 652600 elements - found 0 jobs
Sun 19 Jan 2014 05:59:43 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 05:59:43 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 05:59:43 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 05:59:43 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 05:59:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:59:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:59:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 05:59:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:59:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 05:59:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 05:59:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 05:59:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 05:59:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:59:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:59:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 05:59:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 05:59:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 05:59:47 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 05:59:47 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 05:59:47 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 05:59:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 05:59:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42969332
Sun 19 Jan 2014 05:59:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 05:59:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42969332
Sun 19 Jan 2014 05:59:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 05:59:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:59:54 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 05:59:54 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:59:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 05:59:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 05:59:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 05:59:55 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 05:59:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7411 values 116868 bits 14608 bytes 
Sun 19 Jan 2014 05:59:58 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 05:59:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 05:59:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 05:59:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 05:59:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 05:59:59 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 05:59:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 05:59:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:00:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:00:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:00:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:00:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:00:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:00:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:00:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:00:04 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:00:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:00:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:00:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:00:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:00:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:00:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:00:06 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:00:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 06:00:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:00:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:00:06 - job_xml_thread(): Done retrieving: data size 42927391
Sun 19 Jan 2014 06:00:06 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:00:06 - XML: Start document: iteration 16
Sun 19 Jan 2014 06:00:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42927391
Sun 19 Jan 2014 06:00:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:00:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42927391
Sun 19 Jan 2014 06:00:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:00:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:00:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:00:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:00:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:00:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:00:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:00:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:00:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:00:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:00:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:00:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:00:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:00:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:00:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:00:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:00:30 - XML: Processed 645158 elements - found 0 jobs
Sun 19 Jan 2014 06:00:30 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:00:30 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:00:30 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:00:30 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:00:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:00:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:00:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:00:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:00:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:00:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:00:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:00:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42976357
Sun 19 Jan 2014 06:00:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:00:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42976357
Sun 19 Jan 2014 06:00:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:00:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:00:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:00:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:00:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:00:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:00:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:00:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:00:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:00:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:00:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:00:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:00:45 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:00:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:00:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:00:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:00:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:00:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:00:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:00:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:00:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43493398
Sun 19 Jan 2014 06:00:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:00:46 - job_xml_thread(): Done retrieving: data size 43493398
Sun 19 Jan 2014 06:00:46 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:00:46 - XML: Start document: iteration 17
Sun 19 Jan 2014 06:00:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43493398
Sun 19 Jan 2014 06:00:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:00:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:00:55 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:00:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:00:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 06:00:56 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:00:56 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:00:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 06:00:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148617 bits 18577 bytes 
Sun 19 Jan 2014 06:00:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:00:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:00:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:00:59 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:00:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:00:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:01:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:01:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:01:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:01:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:01:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:01:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:01:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:01:05 - XML: Processed 652144 elements - found 0 jobs
Sun 19 Jan 2014 06:01:05 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:01:05 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:01:05 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:01:05 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:01:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:01:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:01:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:01:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:01:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:01:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:01:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:01:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:01:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:01:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43550334
Sun 19 Jan 2014 06:01:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:01:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43550334
Sun 19 Jan 2014 06:01:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:01:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:01:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:01:18 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:01:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 06:01:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:01:20 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:01:20 - job_xml_thread(): Done retrieving: data size 43550334
Sun 19 Jan 2014 06:01:20 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:01:20 - XML: Start document: iteration 18
Sun 19 Jan 2014 06:01:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:01:22 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:01:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:01:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:01:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:01:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:01:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:01:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:01:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:01:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:01:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:01:29 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:01:29 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:01:29 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:01:29 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:01:29 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:01:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:01:32 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:01:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:01:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:01:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:01:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:01:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:01:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:01:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:01:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568531
Sun 19 Jan 2014 06:01:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:01:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568531
Sun 19 Jan 2014 06:01:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:01:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:01:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:01:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:01:43 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:01:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:01:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:01:44 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:01:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:01:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:01:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:01:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:01:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:01:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:01:47 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:01:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:01:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:01:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:01:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:01:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:01:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:01:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:01:49 - job_xml_thread(): Done retrieving: data size 43581873
Sun 19 Jan 2014 06:01:49 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:01:49 - XML: Start document: iteration 19
Sun 19 Jan 2014 06:01:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581873
Sun 19 Jan 2014 06:01:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:01:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581873
Sun 19 Jan 2014 06:01:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:01:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:01:57 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:01:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:01:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 06:01:57 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:01:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 06:01:57 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:01:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9375 values 148281 bits 18535 bytes 
Sun 19 Jan 2014 06:02:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:02:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:02:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:02:03 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:02:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:02:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:02:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:02:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:02:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:02:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:02:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:02:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:02:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:02:06 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:02:06 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:02:06 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:02:06 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:02:06 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:02:09 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 06:02:09 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:02:10 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:02:10 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:02:10 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 06:02:10 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 06:02:10 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 06:02:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:02:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:02:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:02:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:02:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:02:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:02:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:02:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:02:11 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 799773 values 12615240 bits 1576905 bytes 
Sun 19 Jan 2014 06:02:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:02:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569947
Sun 19 Jan 2014 06:02:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:02:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569947
Sun 19 Jan 2014 06:02:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:02:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:02:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:02:21 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:02:21 - job_xml_thread(): Done retrieving: data size 43569947
Sun 19 Jan 2014 06:02:21 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:02:21 - XML: Start document: iteration 20
Sun 19 Jan 2014 06:02:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:02:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:02:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:02:28 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:02:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:02:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:02:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:02:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:02:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:02:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:02:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:02:33 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:02:33 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:02:33 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:02:33 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:02:33 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:02:39 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:02:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 06:02:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:02:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:02:39 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:02:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:02:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:02:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:02:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:02:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:02:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:02:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:02:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558281
Sun 19 Jan 2014 06:02:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:02:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558281
Sun 19 Jan 2014 06:02:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:02:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:02:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:02:48 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:02:48 - job_xml_thread(): Done retrieving: data size 43558281
Sun 19 Jan 2014 06:02:48 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:02:48 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 06:02:49 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 06:02:49 - Housekeeping: done.
Sun 19 Jan 2014 06:02:49 - XML: Start document: iteration 0
Sun 19 Jan 2014 06:02:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:02:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:02:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:02:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:02:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:02:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:02:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:02:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:02:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:02:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:02:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:02:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:02:57 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:03:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:03:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 06:03:00 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:03:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5982 values 94696 bits 11837 bytes 
Sun 19 Jan 2014 06:03:00 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:03:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 06:03:04 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:03:04 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:03:04 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:03:04 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:03:04 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:03:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:03:05 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:03:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:03:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:03:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:03:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:03:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:03:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:03:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:03:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43552241
Sun 19 Jan 2014 06:03:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:03:10 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:03:10 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 06:03:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43552241
Sun 19 Jan 2014 06:03:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:03:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:03:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:03:19 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:03:19 - job_xml_thread(): Done retrieving: data size 43552241
Sun 19 Jan 2014 06:03:19 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:03:19 - XML: Start document: iteration 1
Sun 19 Jan 2014 06:03:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:03:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:03:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:03:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:03:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:03:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:03:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:03:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:03:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:03:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:03:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:03:28 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:03:28 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:03:28 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:03:28 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:03:28 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:03:28 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:03:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 06:03:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:03:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:03:32 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:03:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:03:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:03:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:03:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:03:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:03:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:03:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:03:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569181
Sun 19 Jan 2014 06:03:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:03:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569181
Sun 19 Jan 2014 06:03:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:03:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:03:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:03:43 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:03:43 - job_xml_thread(): Done retrieving: data size 43569181
Sun 19 Jan 2014 06:03:43 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:03:43 - XML: Start document: iteration 2
Sun 19 Jan 2014 06:03:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:03:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:03:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:03:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:03:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:03:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:03:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:03:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:03:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:03:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:03:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:03:55 - XML: Processed 653342 elements - found 0 jobs
Sun 19 Jan 2014 06:03:55 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:03:55 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:03:55 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:03:55 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:03:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:03:58 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:03:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:03:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:03:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:03:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:03:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:03:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:04:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:04:00 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:04:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:04:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567054
Sun 19 Jan 2014 06:04:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:04:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:04:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 06:04:01 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:04:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6175 values 97570 bits 12196 bytes 
Sun 19 Jan 2014 06:04:01 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:04:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 06:04:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567054
Sun 19 Jan 2014 06:04:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:04:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:04:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:04:10 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:04:10 - job_xml_thread(): Done retrieving: data size 43567054
Sun 19 Jan 2014 06:04:10 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:04:10 - XML: Start document: iteration 3
Sun 19 Jan 2014 06:04:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:04:13 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:04:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:04:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:04:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:04:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:04:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:04:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:04:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:04:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:04:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:04:22 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:04:22 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:04:22 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:04:22 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:04:22 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:04:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:04:24 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:04:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:04:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:04:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:04:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:04:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:04:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:04:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:04:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554058
Sun 19 Jan 2014 06:04:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:04:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554058
Sun 19 Jan 2014 06:04:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:04:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:04:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:04:37 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:04:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:04:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:04:39 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:04:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:04:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:04:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:04:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:04:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:04:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:04:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:04:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:04:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:04:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:04:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:04:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:04:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:04:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:04:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:04:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:04:44 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:04:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 06:04:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:04:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:04:47 - job_xml_thread(): Done retrieving: data size 43578087
Sun 19 Jan 2014 06:04:47 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:04:47 - XML: Start document: iteration 4
Sun 19 Jan 2014 06:04:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578087
Sun 19 Jan 2014 06:04:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578087
Sun 19 Jan 2014 06:04:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:04:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:04:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:04:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:04:58 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:04:58 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:04:58 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:04:58 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:04:58 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:04:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:05:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:05:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:05:01 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:05:02 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:05:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 06:05:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:05:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 06:05:02 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:05:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5722 values 90228 bits 11278 bytes 
Sun 19 Jan 2014 06:05:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:05:07 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:05:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:05:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:05:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:05:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:05:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:05:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:05:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:05:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:05:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:05:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:05:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:05:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:05:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:05:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:05:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:05:13 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:05:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:05:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43509871
Sun 19 Jan 2014 06:05:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:05:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43509871
Sun 19 Jan 2014 06:05:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:05:14 - job_xml_thread(): Done retrieving: data size 43509871
Sun 19 Jan 2014 06:05:14 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:05:14 - XML: Start document: iteration 5
Sun 19 Jan 2014 06:05:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:05:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:05:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:05:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:05:31 - XML: Processed 652600 elements - found 0 jobs
Sun 19 Jan 2014 06:05:31 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:05:31 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:05:31 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:05:31 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:05:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:05:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:05:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:05:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:05:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:05:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:05:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:05:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:05:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:05:36 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:05:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 06:05:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:05:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:05:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:05:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:05:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:05:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:05:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:05:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:05:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:05:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:05:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43014240
Sun 19 Jan 2014 06:05:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:05:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43014240
Sun 19 Jan 2014 06:05:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:05:46 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:05:46 - job_xml_thread(): Done retrieving: data size 43014240
Sun 19 Jan 2014 06:05:46 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:05:46 - XML: Start document: iteration 6
Sun 19 Jan 2014 06:05:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:05:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:05:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:05:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:05:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:05:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:05:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:05:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:05:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:05:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:05:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:05:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:05:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:05:58 - XML: Processed 646466 elements - found 0 jobs
Sun 19 Jan 2014 06:05:58 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:05:58 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:05:58 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:05:58 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:06:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:06:02 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:06:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:06:03 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:06:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:06:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:06:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:06:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:06:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:06:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:06:03 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:06:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 06:06:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:06:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 06:06:03 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:06:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5871 values 92607 bits 11575 bytes 
Sun 19 Jan 2014 06:06:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:06:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42895440
Sun 19 Jan 2014 06:06:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:06:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42895440
Sun 19 Jan 2014 06:06:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:06:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:06:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:06:13 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:06:13 - job_xml_thread(): Done retrieving: data size 42895440
Sun 19 Jan 2014 06:06:13 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:06:13 - XML: Start document: iteration 7
Sun 19 Jan 2014 06:06:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:06:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:06:23 - XML: Processed 645211 elements - found 0 jobs
Sun 19 Jan 2014 06:06:23 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:06:23 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:06:23 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:06:23 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:06:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:06:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:06:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:06:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:06:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:06:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:06:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:06:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:06:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:06:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:06:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:06:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:06:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:06:31 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:06:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 06:06:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:06:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:06:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:06:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:06:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:06:31 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 06:06:31 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 06:06:31 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:06:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:06:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43005448
Sun 19 Jan 2014 06:06:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:06:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43005448
Sun 19 Jan 2014 06:06:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:06:38 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:06:38 - job_xml_thread(): Done retrieving: data size 43005448
Sun 19 Jan 2014 06:06:39 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:06:39 - XML: Start document: iteration 8
Sun 19 Jan 2014 06:06:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:06:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:06:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:06:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:06:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:06:47 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:06:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:06:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:06:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:06:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:06:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:06:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:06:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:06:51 - XML: Processed 645984 elements - found 0 jobs
Sun 19 Jan 2014 06:06:51 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:06:51 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:06:51 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:06:51 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:06:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:06:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:06:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:06:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:06:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:06:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:06:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:06:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:06:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:06:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43547188
Sun 19 Jan 2014 06:06:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:06:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43547188
Sun 19 Jan 2014 06:06:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:07:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:07:03 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:07:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:07:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:07:05 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:07:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:07:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 06:07:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 06:07:05 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:07:06 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:07:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8618 values 135889 bits 16986 bytes 
Sun 19 Jan 2014 06:07:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:07:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:07:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:07:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:07:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:07:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:07:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:07:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:07:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:07:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:07:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:07:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:07:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:07:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:07:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:07:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:07:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:07:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:07:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:07:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:07:14 - job_xml_thread(): Done retrieving: data size 43570810
Sun 19 Jan 2014 06:07:14 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:07:14 - XML: Start document: iteration 9
Sun 19 Jan 2014 06:07:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570810
Sun 19 Jan 2014 06:07:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:07:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570810
Sun 19 Jan 2014 06:07:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:07:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:07:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:07:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:07:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:07:28 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:07:28 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:07:28 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:07:28 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:07:28 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:07:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:07:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:07:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:07:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:07:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:07:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:07:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:07:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:07:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:07:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:07:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:07:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:07:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:07:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:07:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:07:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:07:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:07:36 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:07:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 06:07:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:07:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:07:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580052
Sun 19 Jan 2014 06:07:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:07:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580052
Sun 19 Jan 2014 06:07:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:07:43 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:07:43 - job_xml_thread(): Done retrieving: data size 43580052
Sun 19 Jan 2014 06:07:43 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:07:44 - XML: Start document: iteration 10
Sun 19 Jan 2014 06:07:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:07:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:07:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:07:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:07:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:07:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:07:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:07:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:07:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:07:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:07:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:07:58 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:07:58 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:07:58 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:07:58 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:07:58 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:07:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:07:59 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:07:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:07:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:08:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:08:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:08:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:08:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:08:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:08:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571835
Sun 19 Jan 2014 06:08:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:08:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571835
Sun 19 Jan 2014 06:08:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:08:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:08:05 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:08:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:08:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:08:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:08:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 06:08:07 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:08:07 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:08:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8746 values 137967 bits 17245 bytes 
Sun 19 Jan 2014 06:08:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 06:08:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:08:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:08:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:08:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:08:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:08:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:08:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:08:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:08:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:08:13 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:08:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:08:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:08:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:08:15 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:08:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:08:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:08:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:08:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:08:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:08:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:08:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:08:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43592960
Sun 19 Jan 2014 06:08:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:08:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43592960
Sun 19 Jan 2014 06:08:18 - job_xml_thread(): Done retrieving: data size 43592960
Sun 19 Jan 2014 06:08:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:08:18 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:08:18 - XML: Start document: iteration 11
Sun 19 Jan 2014 06:08:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:08:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:08:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:08:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:08:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:08:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:08:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:08:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:08:34 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:08:34 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:08:34 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:08:34 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:08:34 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:08:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:08:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:08:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:08:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:08:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:08:37 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:08:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 06:08:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:08:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:08:39 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:08:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:08:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:08:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:08:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:08:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:08:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:08:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:08:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576473
Sun 19 Jan 2014 06:08:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:08:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576473
Sun 19 Jan 2014 06:08:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:08:49 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:08:49 - job_xml_thread(): Done retrieving: data size 43576473
Sun 19 Jan 2014 06:08:49 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:08:49 - XML: Start document: iteration 12
Sun 19 Jan 2014 06:08:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:08:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:08:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:08:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:08:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:08:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:08:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:08:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:08:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:08:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:08:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:08:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:08:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:09:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:09:00 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:09:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:09:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:09:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:09:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:09:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:09:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:09:03 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:09:03 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:09:03 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:09:03 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:09:03 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:09:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:09:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574543
Sun 19 Jan 2014 06:09:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:09:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574543
Sun 19 Jan 2014 06:09:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:09:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:09:07 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:09:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:09:08 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:09:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 06:09:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 06:09:09 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:09:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9114 values 143726 bits 17965 bytes 
Sun 19 Jan 2014 06:09:10 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 06:09:10 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:09:11 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:09:11 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:09:11 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 06:09:11 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 06:09:11 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 06:09:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:09:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:09:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:09:14 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:09:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:09:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:09:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:09:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:09:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:09:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:09:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:09:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:09:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:09:18 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:09:19 - size of cluster 'LISA Cluster': 624 hosts 79482 metrics 827012 values 13036201 bits 1629525 bytes 
Sun 19 Jan 2014 06:09:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:09:21 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:09:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:09:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:09:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:09:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:09:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:09:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:09:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:09:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564445
Sun 19 Jan 2014 06:09:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:09:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564445
Sun 19 Jan 2014 06:09:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:09:25 - job_xml_thread(): Done retrieving: data size 43564445
Sun 19 Jan 2014 06:09:25 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:09:25 - XML: Start document: iteration 13
Sun 19 Jan 2014 06:09:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:09:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:09:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:09:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:09:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:09:37 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:09:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:09:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:09:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:09:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:09:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:09:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:09:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:09:44 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:09:44 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:09:44 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:09:44 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:09:44 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:09:44 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:09:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 06:09:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:09:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:09:47 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:09:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:09:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:09:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:09:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:09:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:09:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:09:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:09:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564114
Sun 19 Jan 2014 06:09:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:09:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564114
Sun 19 Jan 2014 06:09:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:09:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:09:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:09:59 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:09:59 - job_xml_thread(): Done retrieving: data size 43564114
Sun 19 Jan 2014 06:09:59 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:09:59 - XML: Start document: iteration 14
Sun 19 Jan 2014 06:10:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:10:00 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:10:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:10:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:10:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:10:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:10:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:10:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:10:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:10:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:10:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:10:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:10:09 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:10:10 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:10:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:10:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 06:10:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 06:10:10 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:10:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5571 values 87786 bits 10973 bytes 
Sun 19 Jan 2014 06:10:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:10:11 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:10:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:10:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:10:11 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:10:11 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 06:10:12 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:10:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:10:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:10:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:10:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:10:12 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:10:12 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:10:12 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:10:12 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:10:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:10:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556276
Sun 19 Jan 2014 06:10:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:10:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556276
Sun 19 Jan 2014 06:10:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:10:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:10:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:10:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:10:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:10:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:10:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:10:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:10:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:10:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:10:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:10:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:10:27 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:10:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:10:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:10:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:10:32 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:10:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:10:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:10:33 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:10:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 06:10:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:10:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:10:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:10:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:10:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:10:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:10:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43587279
Sun 19 Jan 2014 06:10:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:10:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43587279
Sun 19 Jan 2014 06:10:35 - job_xml_thread(): Done retrieving: data size 43587279
Sun 19 Jan 2014 06:10:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:10:35 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:10:35 - XML: Start document: iteration 15
Sun 19 Jan 2014 06:10:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:10:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:10:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:10:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:10:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:10:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:10:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:10:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:10:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:10:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:10:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:10:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:10:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:10:54 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:10:54 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:10:54 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:10:54 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:10:54 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:10:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:10:59 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:10:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:10:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:10:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:10:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:10:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:10:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:11:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:11:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569362
Sun 19 Jan 2014 06:11:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:11:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569362
Sun 19 Jan 2014 06:11:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:11:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:11:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:11:09 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:11:10 - job_xml_thread(): Done retrieving: data size 43569362
Sun 19 Jan 2014 06:11:10 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:11:10 - XML: Start document: iteration 16
Sun 19 Jan 2014 06:11:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:11:10 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:11:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:11:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 06:11:12 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:11:12 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:11:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 06:11:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8532 values 134491 bits 16811 bytes 
Sun 19 Jan 2014 06:11:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:11:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:11:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:11:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:11:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:11:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:11:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:11:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:11:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:11:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:11:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:11:20 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:11:20 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:11:20 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:11:20 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:11:20 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:11:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:11:26 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:11:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:11:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:11:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:11:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:11:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:11:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:11:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:11:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43490036
Sun 19 Jan 2014 06:11:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:11:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43490036
Sun 19 Jan 2014 06:11:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:11:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:11:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:11:35 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:11:35 - job_xml_thread(): Done retrieving: data size 43490036
Sun 19 Jan 2014 06:11:35 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:11:35 - XML: Start document: iteration 17
Sun 19 Jan 2014 06:11:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:11:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:11:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:11:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:11:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:11:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:11:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:11:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:11:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:11:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:11:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:11:51 - XML: Processed 652600 elements - found 0 jobs
Sun 19 Jan 2014 06:11:51 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:11:51 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:11:51 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:11:51 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:11:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:11:52 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:11:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:11:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:11:52 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:11:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 06:11:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:11:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:11:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:11:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:11:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:11:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:11:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42924272
Sun 19 Jan 2014 06:11:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:11:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42924272
Sun 19 Jan 2014 06:11:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:12:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:12:04 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:12:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:12:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:12:06 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:12:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:12:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:12:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:12:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:12:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:12:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:12:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:12:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:12:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:12:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:12:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:12:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:12:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:12:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:12:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:12:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:12:12 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:12:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:12:12 - job_xml_thread(): Done retrieving: data size 42969172
Sun 19 Jan 2014 06:12:12 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:12:12 - XML: Start document: iteration 18
Sun 19 Jan 2014 06:12:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42969172
Sun 19 Jan 2014 06:12:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:12:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:12:13 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:12:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 06:12:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 06:12:13 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:12:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5740 values 90490 bits 11311 bytes 
Sun 19 Jan 2014 06:12:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42969172
Sun 19 Jan 2014 06:12:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:12:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:12:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:12:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:12:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:12:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:12:29 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:12:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:12:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:12:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:12:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:12:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:12:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:12:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:12:33 - XML: Processed 645826 elements - found 0 jobs
Sun 19 Jan 2014 06:12:33 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:12:33 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:12:33 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:12:33 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:12:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:12:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:12:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:12:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:12:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:12:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:12:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:12:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:12:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:12:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43273994
Sun 19 Jan 2014 06:12:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:12:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43273994
Sun 19 Jan 2014 06:12:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:12:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:12:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:12:48 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:12:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:12:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:12:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:12:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:12:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:12:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:12:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:12:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:12:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:12:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:12:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:12:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:12:55 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:12:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:12:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:12:55 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:12:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 06:12:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:12:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:12:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:12:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:12:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:12:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:12:57 - job_xml_thread(): Done retrieving: data size 43539169
Sun 19 Jan 2014 06:12:57 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:12:57 - XML: Start document: iteration 19
Sun 19 Jan 2014 06:12:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43539169
Sun 19 Jan 2014 06:12:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:12:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43539169
Sun 19 Jan 2014 06:12:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:13:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:13:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:13:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:13:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:13:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:13:13 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:13:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:13:14 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:13:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 06:13:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 06:13:14 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:13:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:13:14 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:13:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6020 values 94943 bits 11867 bytes 
Sun 19 Jan 2014 06:13:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:13:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:13:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:13:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:13:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:13:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:13:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:13:16 - XML: Processed 653228 elements - found 0 jobs
Sun 19 Jan 2014 06:13:16 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:13:16 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:13:16 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:13:16 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:13:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:13:20 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:13:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:13:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:13:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:13:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:13:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:13:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:13:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:13:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554220
Sun 19 Jan 2014 06:13:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:13:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554220
Sun 19 Jan 2014 06:13:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:13:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:13:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:13:31 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:13:31 - job_xml_thread(): Done retrieving: data size 43554220
Sun 19 Jan 2014 06:13:31 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:13:31 - XML: Start document: iteration 20
Sun 19 Jan 2014 06:13:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:13:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:13:38 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:13:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 06:13:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:13:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:13:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:13:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:13:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:13:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:13:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:13:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:13:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:13:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:13:44 - XML: Processed 653349 elements - found 0 jobs
Sun 19 Jan 2014 06:13:44 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:13:44 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:13:44 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:13:44 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:13:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:13:47 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:13:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:13:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:13:47 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 06:13:47 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 06:13:47 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:13:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:13:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:13:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:13:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:13:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:13:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579171
Sun 19 Jan 2014 06:13:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:13:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579171
Sun 19 Jan 2014 06:13:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:13:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:13:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:13:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:13:57 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:13:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:13:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:13:59 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:13:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:13:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:13:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:13:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:13:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:14:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:14:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:14:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:14:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:14:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:14:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:14:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:14:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:14:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:14:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:14:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:14:04 - job_xml_thread(): Done retrieving: data size 43588652
Sun 19 Jan 2014 06:14:04 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:14:04 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 06:14:04 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 06:14:04 - Housekeeping: done.
Sun 19 Jan 2014 06:14:04 - XML: Start document: iteration 0
Sun 19 Jan 2014 06:14:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43588652
Sun 19 Jan 2014 06:14:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43588652
Sun 19 Jan 2014 06:14:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:14:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:14:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:14:14 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:14:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:14:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:14:16 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:14:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:14:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 06:14:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 06:14:16 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:14:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8919 values 140667 bits 17583 bytes 
Sun 19 Jan 2014 06:14:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:14:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:14:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:14:22 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:14:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:14:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:14:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:14:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:14:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:14:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:14:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:14:24 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:14:24 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:14:24 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:14:24 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:14:24 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:14:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:14:28 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:14:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:14:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:14:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:14:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:14:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:14:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:14:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:14:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572816
Sun 19 Jan 2014 06:14:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:14:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572816
Sun 19 Jan 2014 06:14:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:14:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:14:39 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:14:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:14:39 - job_xml_thread(): Done retrieving: data size 43572816
Sun 19 Jan 2014 06:14:39 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:14:39 - XML: Start document: iteration 1
Sun 19 Jan 2014 06:14:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:14:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:14:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:14:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:14:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:14:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:14:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:14:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:14:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:14:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:14:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:14:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:14:52 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:14:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:14:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:14:53 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:14:53 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:14:53 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:14:53 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:14:53 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:14:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:14:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:14:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:14:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:14:53 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:14:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 06:14:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:14:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:14:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556366
Sun 19 Jan 2014 06:14:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:14:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556366
Sun 19 Jan 2014 06:14:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:14:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:14:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:15:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:15:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:15:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:15:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:15:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:15:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:15:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:15:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:15:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:15:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:15:08 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:15:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:15:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:15:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:15:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:15:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:15:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:15:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:15:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:15:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:15:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:15:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567011
Sun 19 Jan 2014 06:15:11 - job_xml_thread(): Done retrieving: data size 43567011
Sun 19 Jan 2014 06:15:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:15:11 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:15:11 - XML: Start document: iteration 2
Sun 19 Jan 2014 06:15:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567011
Sun 19 Jan 2014 06:15:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:15:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:15:16 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:15:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:15:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 06:15:17 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:15:17 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:15:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 06:15:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8767 values 138270 bits 17283 bytes 
Sun 19 Jan 2014 06:15:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:15:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:15:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:15:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:15:30 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:15:30 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:15:30 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:15:30 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:15:30 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:15:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:15:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:15:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:15:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:15:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:15:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:15:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:15:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:15:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:15:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:15:34 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:15:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:15:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:15:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:15:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:15:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:15:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:15:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:15:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43593398
Sun 19 Jan 2014 06:15:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:15:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43593398
Sun 19 Jan 2014 06:15:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:15:45 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:15:45 - job_xml_thread(): Done retrieving: data size 43593398
Sun 19 Jan 2014 06:15:45 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:15:45 - XML: Start document: iteration 3
Sun 19 Jan 2014 06:15:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:15:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:15:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:15:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:15:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:15:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:15:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:15:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:15:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:15:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:15:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:15:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:15:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:15:54 - XML: Processed 653347 elements - found 0 jobs
Sun 19 Jan 2014 06:15:54 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:15:54 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:15:55 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:15:55 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:15:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:15:55 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:15:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:15:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:15:55 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:15:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 06:15:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:15:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:15:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:15:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:15:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:15:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:15:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575302
Sun 19 Jan 2014 06:15:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:15:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575302
Sun 19 Jan 2014 06:15:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:16:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:16:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:16:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:16:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:16:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:16:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:16:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:16:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:16:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:16:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:16:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:16:10 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:16:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:16:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:16:11 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 06:16:11 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:16:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:16:11 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:16:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:16:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:16:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:16:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:16:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:16:12 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:16:12 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:16:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:16:12 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 06:16:12 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 06:16:12 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 06:16:13 - size of cluster 'LISA Cluster': 624 hosts 79486 metrics 857325 values 13511360 bits 1688920 bytes 
Sun 19 Jan 2014 06:16:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:16:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580021
Sun 19 Jan 2014 06:16:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:16:16 - job_xml_thread(): Done retrieving: data size 43580021
Sun 19 Jan 2014 06:16:16 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:16:16 - XML: Start document: iteration 4
Sun 19 Jan 2014 06:16:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580021
Sun 19 Jan 2014 06:16:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:16:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:16:17 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:16:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:16:18 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:16:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 06:16:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 06:16:19 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:16:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9063 values 143069 bits 17883 bytes 
Sun 19 Jan 2014 06:16:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:16:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:16:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:16:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:16:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:16:36 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:16:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:16:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:16:36 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:16:36 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:16:36 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:16:36 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:16:36 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:16:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:16:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:16:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:16:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:16:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:16:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:16:41 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:16:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:16:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:16:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:16:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:16:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:16:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:16:44 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:16:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 06:16:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:16:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:16:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571160
Sun 19 Jan 2014 06:16:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:16:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571160
Sun 19 Jan 2014 06:16:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:16:51 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:16:51 - job_xml_thread(): Done retrieving: data size 43571160
Sun 19 Jan 2014 06:16:51 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:16:51 - XML: Start document: iteration 5
Sun 19 Jan 2014 06:16:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:16:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:16:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:16:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:16:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:16:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:16:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:16:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:16:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:16:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:16:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:16:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:16:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:17:02 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:17:02 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:17:02 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:17:02 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:17:02 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:17:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:17:06 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:17:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:17:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:17:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:17:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:17:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:17:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:17:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:17:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561893
Sun 19 Jan 2014 06:17:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:17:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561893
Sun 19 Jan 2014 06:17:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:17:12 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:17:12 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 06:17:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:17:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:17:17 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:17:17 - job_xml_thread(): Done retrieving: data size 43561893
Sun 19 Jan 2014 06:17:17 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:17:17 - XML: Start document: iteration 6
Sun 19 Jan 2014 06:17:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:17:19 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:17:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:17:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 06:17:20 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:17:20 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:17:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 06:17:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6139 values 97223 bits 12152 bytes 
Sun 19 Jan 2014 06:17:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:17:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:17:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:17:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:17:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:17:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:17:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:17:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:17:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:17:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:17:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:17:28 - XML: Processed 653348 elements - found 0 jobs
Sun 19 Jan 2014 06:17:28 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:17:28 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:17:28 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:17:28 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:17:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:17:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:17:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:17:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:17:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:17:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:17:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:17:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:17:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:17:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43326400
Sun 19 Jan 2014 06:17:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:17:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43326400
Sun 19 Jan 2014 06:17:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:17:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:17:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:17:43 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:17:43 - job_xml_thread(): Done retrieving: data size 43326400
Sun 19 Jan 2014 06:17:43 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:17:43 - XML: Start document: iteration 7
Sun 19 Jan 2014 06:17:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:17:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:17:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:17:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:17:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:17:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:17:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:17:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:17:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:17:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:17:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:17:56 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:17:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 06:17:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:17:57 - XML: Processed 650270 elements - found 0 jobs
Sun 19 Jan 2014 06:17:57 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:17:57 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:17:57 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:17:57 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:18:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:18:01 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:18:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:18:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:18:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:18:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:18:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:18:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:18:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:18:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42920749
Sun 19 Jan 2014 06:18:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:18:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42920749
Sun 19 Jan 2014 06:18:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:18:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:18:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:18:12 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:18:12 - job_xml_thread(): Done retrieving: data size 42920749
Sun 19 Jan 2014 06:18:12 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:18:12 - XML: Start document: iteration 8
Sun 19 Jan 2014 06:18:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:18:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:18:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:18:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:18:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:18:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:18:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:18:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:18:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:18:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:18:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:18:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:18:20 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:18:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:18:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 06:18:21 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:18:21 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:18:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 06:18:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5776 values 91370 bits 11421 bytes 
Sun 19 Jan 2014 06:18:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:18:24 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:18:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:18:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:18:25 - XML: Processed 645318 elements - found 0 jobs
Sun 19 Jan 2014 06:18:25 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:18:25 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:18:25 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:18:25 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:18:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:18:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:18:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:18:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:18:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:18:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42971846
Sun 19 Jan 2014 06:18:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:18:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42971846
Sun 19 Jan 2014 06:18:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:18:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:18:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:18:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:18:39 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:18:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:18:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:18:40 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:18:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:18:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:18:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:18:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:18:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:18:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:18:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:18:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:18:45 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:18:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:18:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:18:45 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:18:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 06:18:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:18:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:18:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:18:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:18:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:18:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:18:48 - job_xml_thread(): Done retrieving: data size 43494329
Sun 19 Jan 2014 06:18:48 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:18:48 - XML: Start document: iteration 9
Sun 19 Jan 2014 06:18:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43494329
Sun 19 Jan 2014 06:18:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:18:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43494329
Sun 19 Jan 2014 06:18:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:18:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:18:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:19:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:19:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:19:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:19:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:19:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:19:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:19:06 - XML: Processed 652216 elements - found 0 jobs
Sun 19 Jan 2014 06:19:06 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:19:06 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:19:06 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:19:06 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:19:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:19:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:19:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:19:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:19:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:19:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:19:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:19:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:19:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:19:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:19:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:19:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:19:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:19:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:19:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573788
Sun 19 Jan 2014 06:19:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:19:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573788
Sun 19 Jan 2014 06:19:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:19:21 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:19:21 - job_xml_thread(): Done retrieving: data size 43573788
Sun 19 Jan 2014 06:19:21 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:19:21 - XML: Start document: iteration 10
Sun 19 Jan 2014 06:19:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:19:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:19:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:19:21 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:19:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:19:22 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:19:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 06:19:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 06:19:23 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:19:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8703 values 137301 bits 17162 bytes 
Sun 19 Jan 2014 06:19:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:19:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:19:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:19:30 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:19:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:19:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:19:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:19:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:19:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:19:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:19:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:19:34 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:19:34 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:19:34 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:19:34 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:19:34 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:19:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:19:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:19:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:19:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:19:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:19:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:19:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:19:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:19:40 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:19:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 06:19:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:19:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:19:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563085
Sun 19 Jan 2014 06:19:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:19:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563085
Sun 19 Jan 2014 06:19:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:19:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:19:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:19:49 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:19:49 - job_xml_thread(): Done retrieving: data size 43563085
Sun 19 Jan 2014 06:19:49 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:19:49 - XML: Start document: iteration 11
Sun 19 Jan 2014 06:19:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:19:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:19:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:19:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:19:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:19:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:19:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:19:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:19:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:19:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:19:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:20:03 - XML: Processed 653347 elements - found 0 jobs
Sun 19 Jan 2014 06:20:03 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:20:03 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:20:03 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:20:03 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:20:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:20:04 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:20:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:20:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:20:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:20:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:20:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:20:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:20:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:20:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:20:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:20:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43539684
Sun 19 Jan 2014 06:20:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:20:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43539684
Sun 19 Jan 2014 06:20:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:20:18 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:20:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:20:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:20:18 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:20:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:20:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:20:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:20:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:20:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:20:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:20:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:20:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:20:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:20:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:20:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:20:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:20:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:20:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:20:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:20:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:20:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:20:23 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:20:23 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:20:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 06:20:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:20:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 06:20:23 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:20:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99070 bits 12383 bytes 
Sun 19 Jan 2014 06:20:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:20:26 - job_xml_thread(): Done retrieving: data size 43567321
Sun 19 Jan 2014 06:20:26 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:20:26 - XML: Start document: iteration 12
Sun 19 Jan 2014 06:20:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567321
Sun 19 Jan 2014 06:20:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:20:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567321
Sun 19 Jan 2014 06:20:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:20:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:20:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:20:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:20:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:20:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:20:46 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:20:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:20:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:20:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:20:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:20:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:20:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:20:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:20:48 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:20:48 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:20:48 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:20:48 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:20:48 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:20:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:20:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:20:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:20:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:20:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:20:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:20:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:20:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:20:51 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:20:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 06:20:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:20:52 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 06:20:52 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 06:20:52 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:20:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:20:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570237
Sun 19 Jan 2014 06:20:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:20:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570237
Sun 19 Jan 2014 06:20:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:21:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:21:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:21:03 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:21:03 - job_xml_thread(): Done retrieving: data size 43570237
Sun 19 Jan 2014 06:21:03 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:21:03 - XML: Start document: iteration 13
Sun 19 Jan 2014 06:21:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:21:06 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:21:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:21:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:21:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:21:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:21:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:21:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:21:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:21:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:21:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:21:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:21:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:21:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:21:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:21:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:21:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:21:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:21:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:21:15 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:21:15 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:21:15 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:21:15 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:21:15 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:21:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:21:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579799
Sun 19 Jan 2014 06:21:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:21:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579799
Sun 19 Jan 2014 06:21:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:21:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:21:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:21:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:21:23 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:21:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:21:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 06:21:24 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:21:24 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:21:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 06:21:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8305 values 130979 bits 16372 bytes 
Sun 19 Jan 2014 06:21:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:21:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:21:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:21:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:21:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:21:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:21:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:21:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:21:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:21:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:21:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:21:30 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:21:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:21:32 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:21:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:21:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:21:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:21:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:21:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:21:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:21:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:21:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43589789
Sun 19 Jan 2014 06:21:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:21:35 - job_xml_thread(): Done retrieving: data size 43589789
Sun 19 Jan 2014 06:21:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43589789
Sun 19 Jan 2014 06:21:35 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:21:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:21:35 - XML: Start document: iteration 14
Sun 19 Jan 2014 06:21:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:21:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:21:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:21:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:21:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:21:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:21:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:21:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:21:52 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:21:52 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:21:52 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:21:52 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:21:52 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:21:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:21:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:21:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:21:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:21:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:21:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:21:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:21:56 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:21:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 06:21:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:21:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:21:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:21:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:21:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:21:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:21:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:21:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:21:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580676
Sun 19 Jan 2014 06:21:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:21:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580676
Sun 19 Jan 2014 06:21:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:22:07 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:22:07 - job_xml_thread(): Done retrieving: data size 43580676
Sun 19 Jan 2014 06:22:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:22:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:22:07 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:22:07 - XML: Start document: iteration 15
Sun 19 Jan 2014 06:22:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:22:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:22:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:22:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:22:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:22:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:22:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:22:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:22:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:22:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:22:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:22:16 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:22:16 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:22:16 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:22:16 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:22:16 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:22:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:22:18 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:22:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:22:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:22:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:22:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:22:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:22:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:22:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:22:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574436
Sun 19 Jan 2014 06:22:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:22:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574436
Sun 19 Jan 2014 06:22:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:22:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:22:25 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:22:25 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:22:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 06:22:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:22:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 06:22:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:22:25 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:22:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:22:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9195 values 145031 bits 18128 bytes 
Sun 19 Jan 2014 06:22:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:22:31 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:22:32 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:22:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:22:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:22:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:22:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:22:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:22:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:22:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:22:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:22:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:22:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:22:35 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:22:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:22:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:22:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:22:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:22:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:22:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:22:36 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:22:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 06:22:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:22:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:22:37 - job_xml_thread(): Done retrieving: data size 43578448
Sun 19 Jan 2014 06:22:37 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:22:37 - XML: Start document: iteration 16
Sun 19 Jan 2014 06:22:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578448
Sun 19 Jan 2014 06:22:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578448
Sun 19 Jan 2014 06:22:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:22:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:22:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:22:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:22:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:22:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:22:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:22:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:22:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:22:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:22:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:22:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:22:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:22:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:22:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:23:00 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:23:00 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:23:00 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:23:00 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:23:00 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:23:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:23:01 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:23:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:23:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:23:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:23:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:23:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:23:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:23:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:23:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582081
Sun 19 Jan 2014 06:23:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:23:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582081
Sun 19 Jan 2014 06:23:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:23:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:23:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:23:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:23:13 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:23:13 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 06:23:13 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:23:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:23:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:23:14 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:23:14 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:23:14 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 06:23:14 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 06:23:14 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 06:23:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:23:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:23:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:23:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:23:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:23:15 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:23:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:23:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:23:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:23:18 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:23:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:23:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:23:18 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 825817 values 13024554 bits 1628069 bytes 
Sun 19 Jan 2014 06:23:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:23:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:23:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:23:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:23:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:23:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43518659
Sun 19 Jan 2014 06:23:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:23:21 - job_xml_thread(): Done retrieving: data size 43518659
Sun 19 Jan 2014 06:23:21 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:23:21 - XML: Start document: iteration 17
Sun 19 Jan 2014 06:23:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43518659
Sun 19 Jan 2014 06:23:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:23:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:23:26 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:23:28 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:23:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 06:23:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:23:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 06:23:28 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:23:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148564 bits 18570 bytes 
Sun 19 Jan 2014 06:23:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:23:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:23:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:23:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:23:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:23:36 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:23:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:23:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:23:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:23:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:23:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:23:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:23:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:23:40 - XML: Processed 652600 elements - found 0 jobs
Sun 19 Jan 2014 06:23:40 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:23:40 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:23:40 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:23:40 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:23:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:23:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:23:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:23:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:23:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:23:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:23:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:23:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:23:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:23:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42975605
Sun 19 Jan 2014 06:23:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:23:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42975605
Sun 19 Jan 2014 06:23:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:23:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:23:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:23:55 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:23:55 - job_xml_thread(): Done retrieving: data size 42975605
Sun 19 Jan 2014 06:23:55 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:23:55 - XML: Start document: iteration 18
Sun 19 Jan 2014 06:23:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:23:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:24:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:24:01 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:24:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:24:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:24:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:24:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:24:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:24:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:24:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:24:09 - XML: Processed 645990 elements - found 0 jobs
Sun 19 Jan 2014 06:24:09 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:24:09 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:24:09 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:24:09 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:24:09 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:24:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 06:24:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:24:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:24:11 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:24:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:24:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:24:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:24:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:24:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:24:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:24:14 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:24:14 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 06:24:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:24:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42953375
Sun 19 Jan 2014 06:24:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:24:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42953375
Sun 19 Jan 2014 06:24:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:24:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:24:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:24:24 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:24:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:24:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:24:25 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:24:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:24:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:24:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:24:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:24:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:24:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:24:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:24:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:24:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:24:28 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:24:29 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:24:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 06:24:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:24:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 06:24:29 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:24:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5877 values 92632 bits 11579 bytes 
Sun 19 Jan 2014 06:24:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:24:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:24:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:24:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:24:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:24:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:24:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:24:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:24:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:24:34 - job_xml_thread(): Done retrieving: data size 43028145
Sun 19 Jan 2014 06:24:34 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:24:34 - XML: Start document: iteration 19
Sun 19 Jan 2014 06:24:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43028145
Sun 19 Jan 2014 06:24:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:24:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43028145
Sun 19 Jan 2014 06:24:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:24:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:24:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:24:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:24:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:24:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:24:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:24:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:24:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:24:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:24:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:24:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:24:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:24:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:24:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:24:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:24:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:24:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:24:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:24:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:24:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:24:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:24:57 - XML: Processed 646432 elements - found 0 jobs
Sun 19 Jan 2014 06:24:57 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:24:57 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:24:57 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:24:57 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:24:57 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:24:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 06:24:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:25:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:25:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562955
Sun 19 Jan 2014 06:25:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:25:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562955
Sun 19 Jan 2014 06:25:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:25:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:25:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:25:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:25:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:25:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:25:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:25:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:25:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:25:12 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:25:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:25:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:25:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:25:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:25:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:25:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:25:14 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:25:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:25:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:25:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:25:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:25:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:25:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:25:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:25:18 - job_xml_thread(): Done retrieving: data size 43589893
Sun 19 Jan 2014 06:25:18 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:25:18 - XML: Start document: iteration 20
Sun 19 Jan 2014 06:25:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43589893
Sun 19 Jan 2014 06:25:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43589893
Sun 19 Jan 2014 06:25:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:25:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:25:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:25:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:25:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:25:29 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:25:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:25:29 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:25:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 06:25:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 06:25:30 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:25:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9085 values 143277 bits 17909 bytes 
Sun 19 Jan 2014 06:25:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:25:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:25:32 - XML: Processed 653349 elements - found 0 jobs
Sun 19 Jan 2014 06:25:32 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:25:32 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:25:32 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:25:32 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:25:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:25:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:25:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:25:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:25:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:25:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:25:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:25:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:25:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:25:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:25:41 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:25:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:25:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:25:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:25:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:25:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:25:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:25:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:25:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584607
Sun 19 Jan 2014 06:25:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:25:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584607
Sun 19 Jan 2014 06:25:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:25:48 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:25:48 - job_xml_thread(): Done retrieving: data size 43584607
Sun 19 Jan 2014 06:25:48 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:25:48 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 06:25:48 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 06:25:48 - Housekeeping: done.
Sun 19 Jan 2014 06:25:48 - XML: Start document: iteration 0
Sun 19 Jan 2014 06:25:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:25:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:25:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:25:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:25:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:25:57 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:25:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:25:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:25:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:25:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:25:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:25:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:25:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:26:04 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:26:04 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:26:04 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:26:04 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:26:04 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:26:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:26:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:26:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:26:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:26:08 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:26:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 06:26:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:26:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:26:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:26:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:26:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:26:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:26:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556477
Sun 19 Jan 2014 06:26:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:26:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556477
Sun 19 Jan 2014 06:26:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:26:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:26:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:26:19 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:26:19 - job_xml_thread(): Done retrieving: data size 43556477
Sun 19 Jan 2014 06:26:20 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:26:20 - XML: Start document: iteration 1
Sun 19 Jan 2014 06:26:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:26:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:26:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:26:28 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:26:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:26:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:26:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:26:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:26:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:26:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:26:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:26:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:26:30 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:26:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:26:30 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:26:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 06:26:30 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:26:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 06:26:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5809 values 91585 bits 11448 bytes 
Sun 19 Jan 2014 06:26:35 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:26:35 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:26:35 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:26:35 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:26:35 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:26:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:26:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:26:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:26:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:26:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:26:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:26:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:26:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:26:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:26:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553406
Sun 19 Jan 2014 06:26:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:26:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553406
Sun 19 Jan 2014 06:26:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:26:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:26:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:26:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:26:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:26:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:26:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:26:50 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:26:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:26:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:26:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:26:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:26:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:26:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:26:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:26:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:26:55 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:26:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:26:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:26:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:26:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:26:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:26:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:26:55 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:26:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 06:26:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:26:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:26:57 - job_xml_thread(): Done retrieving: data size 43571329
Sun 19 Jan 2014 06:26:57 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:26:57 - XML: Start document: iteration 2
Sun 19 Jan 2014 06:26:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571329
Sun 19 Jan 2014 06:26:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:26:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571329
Sun 19 Jan 2014 06:26:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:27:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:27:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:27:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:27:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:27:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:27:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:27:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:27:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:27:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:27:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:27:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:27:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:27:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:27:18 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:27:18 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:27:18 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:27:18 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:27:18 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:27:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:27:21 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:27:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:27:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:27:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:27:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:27:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:27:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:27:22 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 06:27:22 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 06:27:22 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:27:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:27:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553912
Sun 19 Jan 2014 06:27:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:27:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553912
Sun 19 Jan 2014 06:27:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:27:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:27:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:27:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:27:30 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:27:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:27:32 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:27:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 06:27:33 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:27:33 - job_xml_thread(): Done retrieving: data size 43553912
Sun 19 Jan 2014 06:27:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 06:27:33 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:27:33 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:27:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8819 values 139027 bits 17378 bytes 
Sun 19 Jan 2014 06:27:33 - XML: Start document: iteration 3
Sun 19 Jan 2014 06:27:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:27:36 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:27:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:27:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:27:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:27:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:27:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:27:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:27:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:27:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:27:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:27:42 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:27:42 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:27:42 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:27:42 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:27:42 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:27:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:27:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:27:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:27:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:27:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:27:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:27:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:27:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:27:46 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:27:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 06:27:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:27:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:27:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577050
Sun 19 Jan 2014 06:27:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:27:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577050
Sun 19 Jan 2014 06:27:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:27:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:27:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:27:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:27:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:27:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:27:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:27:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:27:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:27:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:27:57 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:27:57 - job_xml_thread(): Done retrieving: data size 43577050
Sun 19 Jan 2014 06:27:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:27:57 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:27:57 - XML: Start document: iteration 4
Sun 19 Jan 2014 06:27:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:28:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:28:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:28:06 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:28:06 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:28:06 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:28:06 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:28:06 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:28:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:28:07 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:28:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:28:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:28:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:28:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:28:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:28:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:28:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:28:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43552483
Sun 19 Jan 2014 06:28:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:28:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43552483
Sun 19 Jan 2014 06:28:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:28:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:28:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:28:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:28:18 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:28:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:28:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:28:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:28:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:28:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:28:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:28:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:28:21 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:28:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:28:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:28:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:28:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:28:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:28:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:28:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:28:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:28:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:28:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:28:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:28:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578923
Sun 19 Jan 2014 06:28:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:28:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578923
Sun 19 Jan 2014 06:28:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:28:26 - job_xml_thread(): Done retrieving: data size 43578923
Sun 19 Jan 2014 06:28:26 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:28:26 - XML: Start document: iteration 5
Sun 19 Jan 2014 06:28:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:28:33 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:28:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:28:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 06:28:34 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:28:34 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:28:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 06:28:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148499 bits 18562 bytes 
Sun 19 Jan 2014 06:28:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:28:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:28:36 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:28:36 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:28:36 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:28:36 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:28:36 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:28:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:28:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:28:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:28:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:28:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:28:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:28:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:28:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:28:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:28:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:28:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:28:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:28:47 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:28:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:28:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:28:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:28:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:28:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:28:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:28:49 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:28:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 06:28:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:28:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:28:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584204
Sun 19 Jan 2014 06:28:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:28:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584204
Sun 19 Jan 2014 06:28:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:28:51 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:28:51 - job_xml_thread(): Done retrieving: data size 43584204
Sun 19 Jan 2014 06:28:51 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:28:51 - XML: Start document: iteration 6
Sun 19 Jan 2014 06:28:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:28:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:29:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:29:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:29:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:29:03 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:29:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:29:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:29:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:29:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:29:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:29:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:29:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:29:06 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:29:06 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:29:06 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:29:06 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:29:06 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:29:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:29:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:29:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:29:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:29:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:29:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:29:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:29:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:29:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:29:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43506029
Sun 19 Jan 2014 06:29:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:29:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43506029
Sun 19 Jan 2014 06:29:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:29:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:29:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:29:21 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:29:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:29:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:29:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:29:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:29:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:29:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:29:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:29:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:29:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:29:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:29:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:29:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:29:26 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:29:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:29:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:29:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:29:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:29:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:29:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:29:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:29:28 - job_xml_thread(): Done retrieving: data size 43504898
Sun 19 Jan 2014 06:29:28 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:29:28 - XML: Start document: iteration 7
Sun 19 Jan 2014 06:29:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43504898
Sun 19 Jan 2014 06:29:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:29:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43504898
Sun 19 Jan 2014 06:29:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:29:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:29:34 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:29:36 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:29:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:29:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 06:29:36 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:29:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148509 bits 18563 bytes 
Sun 19 Jan 2014 06:29:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 06:29:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:29:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:29:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:29:39 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:29:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:29:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:29:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:29:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:29:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:29:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:29:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:29:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:29:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:29:48 - XML: Processed 652600 elements - found 0 jobs
Sun 19 Jan 2014 06:29:48 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:29:48 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:29:48 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:29:48 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:29:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:29:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:29:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:29:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:29:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:29:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:29:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:29:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:29:53 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:29:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 06:29:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:29:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:29:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42948135
Sun 19 Jan 2014 06:29:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:29:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42948135
Sun 19 Jan 2014 06:29:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:29:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:29:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:30:03 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:30:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:30:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:30:04 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:30:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:30:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:30:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:30:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:30:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:30:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:30:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:30:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:30:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:30:06 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:30:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:30:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:30:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:30:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:30:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:30:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:30:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:30:08 - job_xml_thread(): Done retrieving: data size 42969075
Sun 19 Jan 2014 06:30:08 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:30:08 - XML: Start document: iteration 8
Sun 19 Jan 2014 06:30:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42969075
Sun 19 Jan 2014 06:30:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:30:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42969075
Sun 19 Jan 2014 06:30:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:30:15 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 06:30:15 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:30:16 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:30:16 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 06:30:16 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:30:16 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 06:30:16 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 06:30:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:30:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:30:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:30:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:30:29 - XML: Processed 645816 elements - found 0 jobs
Sun 19 Jan 2014 06:30:29 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:30:29 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:30:29 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:30:29 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:30:30 - size of cluster 'LISA Cluster': 624 hosts 79485 metrics 825257 values 13006782 bits 1625847 bytes 
Sun 19 Jan 2014 06:30:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:30:31 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:30:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:30:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:30:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:30:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:30:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:30:32 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:30:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:30:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:30:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:30:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:30:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:30:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:30:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:30:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:30:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:30:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:30:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43081826
Sun 19 Jan 2014 06:30:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:30:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:30:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43081826
Sun 19 Jan 2014 06:30:36 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:30:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:30:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:30:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 06:30:38 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:30:38 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:30:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 06:30:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148554 bits 18569 bytes 
Sun 19 Jan 2014 06:30:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:30:43 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:30:44 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:30:44 - job_xml_thread(): Done retrieving: data size 43081826
Sun 19 Jan 2014 06:30:44 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:30:44 - XML: Start document: iteration 9
Sun 19 Jan 2014 06:30:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:30:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:30:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:30:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:30:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:30:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:30:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:30:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:30:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:30:53 - XML: Processed 646926 elements - found 0 jobs
Sun 19 Jan 2014 06:30:53 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:30:53 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:30:53 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:30:53 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:30:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:30:58 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:30:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:30:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:30:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:30:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:30:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:30:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:31:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:31:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43551560
Sun 19 Jan 2014 06:31:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:31:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43551560
Sun 19 Jan 2014 06:31:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:31:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:31:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:31:09 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:31:09 - job_xml_thread(): Done retrieving: data size 43551560
Sun 19 Jan 2014 06:31:09 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:31:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:31:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:31:09 - XML: Start document: iteration 10
Sun 19 Jan 2014 06:31:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:31:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:31:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:31:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:31:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:31:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43551560
Sun 19 Jan 2014 06:31:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:31:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:31:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:31:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:31:16 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:31:16 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 06:31:23 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:31:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 06:31:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:31:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:31:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:31:27 - XML: Processed 653274 elements - found 0 jobs
Sun 19 Jan 2014 06:31:27 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:31:27 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:31:27 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:31:27 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:31:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:31:27 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:31:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:31:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:31:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:31:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:31:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:31:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:31:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:31:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:31:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:31:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:31:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:31:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:31:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:31:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:31:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:31:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:31:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43591404
Sun 19 Jan 2014 06:31:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:31:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43591404
Sun 19 Jan 2014 06:31:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:31:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:31:38 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:31:38 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:31:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:31:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 06:31:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 06:31:38 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:31:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6160 values 97270 bits 12158 bytes 
Sun 19 Jan 2014 06:31:42 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:31:42 - job_xml_thread(): Done retrieving: data size 43591404
Sun 19 Jan 2014 06:31:42 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:31:42 - XML: Start document: iteration 11
Sun 19 Jan 2014 06:31:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:31:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:31:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:31:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:31:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:31:46 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:31:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:31:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:31:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:31:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:31:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:31:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:31:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:31:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:31:53 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:31:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:31:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:31:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:31:55 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:31:55 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:31:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:31:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:31:55 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:31:55 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:31:55 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:31:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:31:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:31:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561951
Sun 19 Jan 2014 06:31:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561951
Sun 19 Jan 2014 06:31:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:31:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:32:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:32:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:32:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:32:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:32:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:32:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:32:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:32:10 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:32:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:32:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:32:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:32:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:32:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:32:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:32:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:32:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:32:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:32:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:32:13 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:32:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 06:32:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:32:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:32:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:32:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:32:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:32:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:32:17 - job_xml_thread(): Done retrieving: data size 43586590
Sun 19 Jan 2014 06:32:17 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:32:17 - XML: Start document: iteration 12
Sun 19 Jan 2014 06:32:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43586590
Sun 19 Jan 2014 06:32:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43586590
Sun 19 Jan 2014 06:32:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:32:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:32:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:32:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:32:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:32:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:32:32 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:32:33 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:32:33 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:32:33 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:32:33 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:32:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:32:37 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:32:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:32:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:32:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:32:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:32:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:32:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:32:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:32:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:32:39 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:32:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:32:39 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:32:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:32:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:32:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:32:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 06:32:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:32:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:32:39 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:32:39 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:32:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:32:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6001 values 95019 bits 11877 bytes 
Sun 19 Jan 2014 06:32:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:32:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 06:32:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:32:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43588639
Sun 19 Jan 2014 06:32:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:32:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43588639
Sun 19 Jan 2014 06:32:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:32:48 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:32:48 - job_xml_thread(): Done retrieving: data size 43588639
Sun 19 Jan 2014 06:32:48 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:32:48 - XML: Start document: iteration 13
Sun 19 Jan 2014 06:32:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:32:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:32:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:32:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:33:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:33:03 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:33:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:33:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:33:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:33:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:33:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:33:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:33:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:33:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:33:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:33:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:33:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:33:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:33:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:33:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:33:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:33:07 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:33:07 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:33:07 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:33:07 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:33:07 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:33:07 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:33:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 06:33:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:33:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:33:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580855
Sun 19 Jan 2014 06:33:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:33:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580855
Sun 19 Jan 2014 06:33:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:33:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:33:19 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:33:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:33:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:33:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:33:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:33:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:33:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:33:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:33:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:33:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:33:22 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:33:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:33:24 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:33:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:33:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:33:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:33:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:33:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:33:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:33:27 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 06:33:27 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 06:33:27 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:33:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:33:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576591
Sun 19 Jan 2014 06:33:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:33:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576591
Sun 19 Jan 2014 06:33:28 - job_xml_thread(): Done retrieving: data size 43576591
Sun 19 Jan 2014 06:33:28 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:33:28 - XML: Start document: iteration 14
Sun 19 Jan 2014 06:33:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:33:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:33:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:33:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:33:39 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:33:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:33:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:33:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:33:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:33:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:33:39 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:33:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:33:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:33:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:33:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:33:40 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:33:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 06:33:40 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:33:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8858 values 139986 bits 17498 bytes 
Sun 19 Jan 2014 06:33:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:33:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:33:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 06:33:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:33:49 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:33:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:33:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:33:50 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:33:50 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:33:50 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:33:50 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:33:50 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:33:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:33:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:33:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:33:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:33:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:33:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554825
Sun 19 Jan 2014 06:33:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:33:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554825
Sun 19 Jan 2014 06:33:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:33:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:33:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:34:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:34:01 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:34:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:34:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:34:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:34:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:34:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:34:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:34:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:34:05 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:34:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:34:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:34:07 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:34:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 06:34:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:34:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:34:07 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:34:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:34:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:34:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:34:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:34:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:34:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:34:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:34:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570248
Sun 19 Jan 2014 06:34:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:34:09 - job_xml_thread(): Done retrieving: data size 43570248
Sun 19 Jan 2014 06:34:09 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:34:09 - XML: Start document: iteration 15
Sun 19 Jan 2014 06:34:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570248
Sun 19 Jan 2014 06:34:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:34:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:34:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:34:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:34:20 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:34:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:34:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:34:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:34:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:34:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:34:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:34:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:34:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:34:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:34:26 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:34:26 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:34:26 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:34:26 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:34:26 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:34:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:34:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:34:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:34:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:34:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:34:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:34:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:34:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:34:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:34:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573549
Sun 19 Jan 2014 06:34:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:34:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573549
Sun 19 Jan 2014 06:34:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:34:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:34:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:34:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:34:40 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:34:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:34:40 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:34:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 06:34:40 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:34:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 06:34:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9047 values 142752 bits 17844 bytes 
Sun 19 Jan 2014 06:34:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:34:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:34:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:34:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:34:41 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:34:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:34:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:34:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:34:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:34:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:34:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:34:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:34:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:34:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:34:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:34:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:34:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:34:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:34:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:34:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:34:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:34:48 - job_xml_thread(): Done retrieving: data size 43596779
Sun 19 Jan 2014 06:34:48 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:34:48 - XML: Start document: iteration 16
Sun 19 Jan 2014 06:34:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43596779
Sun 19 Jan 2014 06:34:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:34:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43596779
Sun 19 Jan 2014 06:34:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:34:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:34:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:35:02 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:35:02 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:35:02 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:35:02 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:35:02 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:35:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:35:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:35:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:35:07 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:35:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:35:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:35:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:35:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:35:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:35:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:35:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:35:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:35:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:35:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:35:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:35:10 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:35:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 06:35:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:35:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:35:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:35:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:35:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:35:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:35:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43523023
Sun 19 Jan 2014 06:35:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:35:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43523023
Sun 19 Jan 2014 06:35:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:35:18 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:35:18 - job_xml_thread(): Done retrieving: data size 43523023
Sun 19 Jan 2014 06:35:18 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:35:18 - XML: Start document: iteration 17
Sun 19 Jan 2014 06:35:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:35:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:35:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:35:25 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:35:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:35:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:35:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:35:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:35:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:35:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:35:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:35:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:35:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:35:31 - XML: Processed 652600 elements - found 0 jobs
Sun 19 Jan 2014 06:35:31 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:35:31 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:35:31 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:35:31 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:35:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:35:34 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:35:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:35:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:35:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:35:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:35:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:35:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:35:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:35:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43184738
Sun 19 Jan 2014 06:35:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:35:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43184738
Sun 19 Jan 2014 06:35:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:35:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:35:40 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:35:41 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:35:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 06:35:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:35:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 06:35:41 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:35:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:35:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:35:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8835 values 139354 bits 17419 bytes 
Sun 19 Jan 2014 06:35:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:35:44 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:35:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:35:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:35:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:35:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:35:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:35:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:35:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:35:46 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:35:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:35:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:35:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:35:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:35:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:35:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:35:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:35:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:35:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:35:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:35:53 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:35:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 06:35:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:35:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:35:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42923903
Sun 19 Jan 2014 06:35:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:35:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42923903
Sun 19 Jan 2014 06:35:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:35:54 - job_xml_thread(): Done retrieving: data size 42923903
Sun 19 Jan 2014 06:35:54 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:35:54 - XML: Start document: iteration 18
Sun 19 Jan 2014 06:36:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:36:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:36:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:36:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:36:09 - XML: Processed 645428 elements - found 0 jobs
Sun 19 Jan 2014 06:36:09 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:36:09 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:36:09 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:36:10 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:36:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:36:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:36:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:36:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:36:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:36:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:36:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:36:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:36:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:36:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:36:16 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:36:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:36:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:36:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:36:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:36:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:36:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:36:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:36:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42943751
Sun 19 Jan 2014 06:36:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:36:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42943751
Sun 19 Jan 2014 06:36:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:36:25 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:36:25 - job_xml_thread(): Done retrieving: data size 42943751
Sun 19 Jan 2014 06:36:25 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:36:25 - XML: Start document: iteration 19
Sun 19 Jan 2014 06:36:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:36:27 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:36:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:36:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:36:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:36:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:36:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:36:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:36:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:36:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:36:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:36:35 - XML: Processed 645346 elements - found 0 jobs
Sun 19 Jan 2014 06:36:35 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:36:35 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:36:36 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:36:36 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:36:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:36:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:36:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:36:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:36:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:36:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:36:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:36:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:36:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:36:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43444418
Sun 19 Jan 2014 06:36:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:36:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43444418
Sun 19 Jan 2014 06:36:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:36:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:36:41 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:36:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:36:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 06:36:42 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:36:42 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:36:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148598 bits 18574 bytes 
Sun 19 Jan 2014 06:36:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 06:36:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:36:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:36:51 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:36:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:36:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:36:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:36:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:36:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:36:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:36:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:36:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:36:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:36:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:36:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:36:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:36:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:36:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:36:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:36:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:36:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:36:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:36:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:36:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:36:56 - job_xml_thread(): Done retrieving: data size 43563956
Sun 19 Jan 2014 06:36:56 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:36:56 - XML: Start document: iteration 20
Sun 19 Jan 2014 06:36:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563956
Sun 19 Jan 2014 06:36:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:36:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563956
Sun 19 Jan 2014 06:36:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:37:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:37:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:37:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:37:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:37:16 - XML: Processed 653104 elements - found 0 jobs
Sun 19 Jan 2014 06:37:16 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:37:16 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:37:16 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:37:16 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:37:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:37:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:37:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:37:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:37:17 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 06:37:17 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:37:17 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:37:17 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 06:37:17 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:37:17 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 06:37:17 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 06:37:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:37:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:37:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:37:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:37:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:37:21 - size of cluster 'LISA Cluster': 624 hosts 79483 metrics 908893 values 14342083 bits 1792760 bytes 
Sun 19 Jan 2014 06:37:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:37:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:37:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:37:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:37:23 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:37:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 06:37:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:37:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:37:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:37:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:37:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:37:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:37:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569363
Sun 19 Jan 2014 06:37:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:37:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569363
Sun 19 Jan 2014 06:37:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:37:31 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:37:31 - job_xml_thread(): Done retrieving: data size 43569363
Sun 19 Jan 2014 06:37:32 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:37:32 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 06:37:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:37:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:37:35 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 06:37:35 - Housekeeping: done.
Sun 19 Jan 2014 06:37:36 - XML: Start document: iteration 0
Sun 19 Jan 2014 06:37:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:37:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:37:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:37:39 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:37:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:37:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:37:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:37:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:37:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:37:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:37:43 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:37:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:37:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:37:44 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:37:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:37:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 06:37:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 06:37:44 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:37:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5669 values 89367 bits 11170 bytes 
Sun 19 Jan 2014 06:37:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:37:49 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:37:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:37:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:37:49 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:37:49 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:37:49 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:37:49 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:37:49 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:37:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:37:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:37:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:37:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:37:54 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:37:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 06:37:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:37:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:37:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43552308
Sun 19 Jan 2014 06:37:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:37:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43552308
Sun 19 Jan 2014 06:37:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:37:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:37:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:38:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:38:06 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:38:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:38:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:38:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:38:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:38:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:38:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:38:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:38:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:38:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:38:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:38:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:38:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:38:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:38:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:38:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:38:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:38:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:38:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:38:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:38:12 - job_xml_thread(): Done retrieving: data size 43584843
Sun 19 Jan 2014 06:38:12 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:38:12 - XML: Start document: iteration 1
Sun 19 Jan 2014 06:38:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584843
Sun 19 Jan 2014 06:38:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:38:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584843
Sun 19 Jan 2014 06:38:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:38:17 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:38:17 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 06:38:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:38:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:38:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:38:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:38:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:38:36 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:38:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:38:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:38:36 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:38:36 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:38:36 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:38:36 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:38:36 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:38:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:38:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:38:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:38:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:38:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:38:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:38:37 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:38:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:38:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:38:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:38:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:38:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:38:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:38:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:38:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43592759
Sun 19 Jan 2014 06:38:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:38:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43592759
Sun 19 Jan 2014 06:38:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:38:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:38:45 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:38:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:38:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:38:48 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:38:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 06:38:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:38:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 06:38:49 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:38:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148560 bits 18570 bytes 
Sun 19 Jan 2014 06:38:51 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:38:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:38:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:38:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:38:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:38:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:38:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:38:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:38:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:38:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:38:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:38:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:38:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:38:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:38:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:38:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:38:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:38:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:38:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:38:58 - job_xml_thread(): Done retrieving: data size 43578787
Sun 19 Jan 2014 06:38:58 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:38:58 - XML: Start document: iteration 2
Sun 19 Jan 2014 06:38:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578787
Sun 19 Jan 2014 06:38:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:38:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578787
Sun 19 Jan 2014 06:38:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:39:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:39:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:39:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:39:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:39:17 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:39:17 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:39:17 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:39:17 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:39:17 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:39:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:39:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:39:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:39:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:39:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:39:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:39:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:39:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:39:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:39:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:39:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:39:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:39:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:39:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:39:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:39:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:39:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:39:22 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:39:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 06:39:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:39:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:39:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579671
Sun 19 Jan 2014 06:39:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:39:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579671
Sun 19 Jan 2014 06:39:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:39:32 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:39:32 - job_xml_thread(): Done retrieving: data size 43579671
Sun 19 Jan 2014 06:39:32 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:39:32 - XML: Start document: iteration 3
Sun 19 Jan 2014 06:39:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:39:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:39:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:39:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:39:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:39:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:39:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:39:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:39:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:39:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:39:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:39:39 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:39:39 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:39:39 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:39:39 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:39:39 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:39:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:39:45 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:39:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:39:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:39:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:39:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:39:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:39:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:39:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:39:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579716
Sun 19 Jan 2014 06:39:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:39:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:39:49 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:39:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579716
Sun 19 Jan 2014 06:39:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:39:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:39:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 06:39:50 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:39:50 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:39:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9070 values 143054 bits 17881 bytes 
Sun 19 Jan 2014 06:39:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 06:39:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:39:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:39:55 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:39:55 - job_xml_thread(): Done retrieving: data size 43579716
Sun 19 Jan 2014 06:39:55 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:39:55 - XML: Start document: iteration 4
Sun 19 Jan 2014 06:40:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:40:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:40:06 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:40:06 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:40:06 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:40:06 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:40:06 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:40:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:40:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:40:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:40:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:40:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:40:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:40:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:40:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:40:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:40:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:40:11 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:40:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:40:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:40:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:40:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:40:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:40:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:40:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:40:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578307
Sun 19 Jan 2014 06:40:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:40:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578307
Sun 19 Jan 2014 06:40:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:40:21 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:40:21 - job_xml_thread(): Done retrieving: data size 43578307
Sun 19 Jan 2014 06:40:21 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:40:21 - XML: Start document: iteration 5
Sun 19 Jan 2014 06:40:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:40:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:40:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:40:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:40:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:40:28 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:40:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:40:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:40:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:40:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:40:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:40:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:40:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:40:33 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:40:33 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:40:33 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:40:33 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:40:33 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:40:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:40:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:40:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:40:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:40:38 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:40:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 06:40:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:40:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:40:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:40:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:40:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:40:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:40:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554885
Sun 19 Jan 2014 06:40:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:40:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554885
Sun 19 Jan 2014 06:40:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:40:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:40:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:40:48 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:40:48 - job_xml_thread(): Done retrieving: data size 43554885
Sun 19 Jan 2014 06:40:48 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:40:48 - XML: Start document: iteration 6
Sun 19 Jan 2014 06:40:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:40:52 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:40:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:40:53 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:40:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 06:40:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 06:40:53 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:40:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5679 values 89521 bits 11190 bytes 
Sun 19 Jan 2014 06:40:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:40:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:40:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:40:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:40:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:40:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:40:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:40:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:40:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:40:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:40:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:40:58 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:40:58 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:40:58 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:40:58 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:40:58 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:41:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:41:04 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:41:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:41:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:41:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:41:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:41:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:41:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:41:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:41:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578069
Sun 19 Jan 2014 06:41:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:41:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578069
Sun 19 Jan 2014 06:41:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:41:09 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:41:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 06:41:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:41:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:41:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:41:13 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:41:13 - job_xml_thread(): Done retrieving: data size 43578069
Sun 19 Jan 2014 06:41:13 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:41:13 - XML: Start document: iteration 7
Sun 19 Jan 2014 06:41:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:41:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:41:28 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:41:28 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:41:28 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:41:28 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:41:28 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:41:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:41:28 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:41:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:41:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:41:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:41:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:41:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:41:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:41:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:41:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:41:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:41:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:41:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:41:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:41:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:41:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:41:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:41:31 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 06:41:31 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 06:41:31 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:41:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:41:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43094012
Sun 19 Jan 2014 06:41:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:41:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43094012
Sun 19 Jan 2014 06:41:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:41:43 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:41:43 - job_xml_thread(): Done retrieving: data size 43094012
Sun 19 Jan 2014 06:41:43 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:41:43 - XML: Start document: iteration 8
Sun 19 Jan 2014 06:41:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:41:44 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:41:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:41:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:41:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:41:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:41:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:41:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:41:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:41:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:41:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:41:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:41:51 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:41:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:41:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:41:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:41:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:41:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:41:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:41:53 - XML: Processed 647202 elements - found 0 jobs
Sun 19 Jan 2014 06:41:53 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:41:53 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:41:53 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:41:53 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:41:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:41:54 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:41:55 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:41:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 06:41:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:41:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 06:41:55 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:41:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6235 values 98349 bits 12293 bytes 
Sun 19 Jan 2014 06:41:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:41:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42922568
Sun 19 Jan 2014 06:41:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:41:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42922568
Sun 19 Jan 2014 06:41:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:42:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:42:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:42:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:42:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:42:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:42:07 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:42:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:42:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:42:08 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:42:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:42:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:42:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:42:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:42:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:42:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:42:11 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:42:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:42:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:42:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:42:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:42:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:42:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:42:12 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:42:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 06:42:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:42:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:42:13 - job_xml_thread(): Done retrieving: data size 42982411
Sun 19 Jan 2014 06:42:13 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:42:13 - XML: Start document: iteration 9
Sun 19 Jan 2014 06:42:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42982411
Sun 19 Jan 2014 06:42:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:42:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42982411
Sun 19 Jan 2014 06:42:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:42:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:42:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:42:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:42:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:42:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:42:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:42:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:42:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:42:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:42:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:42:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:42:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:42:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:42:36 - XML: Processed 645825 elements - found 0 jobs
Sun 19 Jan 2014 06:42:36 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:42:36 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:42:36 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:42:36 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:42:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:42:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:42:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:42:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:42:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:42:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:42:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:42:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:42:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:42:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43274439
Sun 19 Jan 2014 06:42:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:42:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43274439
Sun 19 Jan 2014 06:42:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:42:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:42:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:42:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:42:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:42:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:42:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:42:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:42:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:42:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:42:51 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:42:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:42:51 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:42:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:42:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:42:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:42:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43538798
Sun 19 Jan 2014 06:42:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:42:53 - job_xml_thread(): Done retrieving: data size 43538798
Sun 19 Jan 2014 06:42:53 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:42:53 - XML: Start document: iteration 10
Sun 19 Jan 2014 06:42:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:42:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:42:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43538798
Sun 19 Jan 2014 06:42:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:42:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:42:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:42:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:42:55 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:42:56 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:42:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:42:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 06:42:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 06:42:57 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:42:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 10517 values 165847 bits 20730 bytes 
Sun 19 Jan 2014 06:43:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:43:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:43:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:43:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:43:12 - XML: Processed 652786 elements - found 0 jobs
Sun 19 Jan 2014 06:43:12 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:43:12 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:43:12 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:43:12 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:43:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:43:13 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:43:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:43:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:43:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:43:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:43:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:43:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:43:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:43:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:43:15 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:43:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:43:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:43:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:43:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:43:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:43:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:43:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:43:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43590093
Sun 19 Jan 2014 06:43:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:43:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43590093
Sun 19 Jan 2014 06:43:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:43:28 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:43:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:43:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:43:28 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:43:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:43:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:43:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:43:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:43:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:43:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:43:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:43:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:43:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:43:31 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:43:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:43:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:43:31 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:43:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 06:43:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:43:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:43:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:43:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:43:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:43:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:43:33 - job_xml_thread(): Done retrieving: data size 43580692
Sun 19 Jan 2014 06:43:33 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:43:33 - XML: Start document: iteration 11
Sun 19 Jan 2014 06:43:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580692
Sun 19 Jan 2014 06:43:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:43:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580692
Sun 19 Jan 2014 06:43:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:43:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:43:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:43:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:43:47 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:43:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:43:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:43:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:43:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:43:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:43:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:43:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:43:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:43:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:43:52 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:43:52 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:43:52 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:43:52 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:43:52 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:43:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:43:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:43:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:43:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:43:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:43:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:43:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:43:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:43:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:43:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573839
Sun 19 Jan 2014 06:43:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:43:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573839
Sun 19 Jan 2014 06:43:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:43:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:43:57 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:44:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:44:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 06:44:00 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:44:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9124 values 143860 bits 17982 bytes 
Sun 19 Jan 2014 06:44:01 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:44:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 06:44:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:44:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:44:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:44:06 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:44:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:44:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:44:07 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:44:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:44:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:44:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:44:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:44:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:44:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:44:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:44:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:44:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:44:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:44:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:44:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:44:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:44:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:44:12 - job_xml_thread(): Done retrieving: data size 43574277
Sun 19 Jan 2014 06:44:12 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:44:12 - XML: Start document: iteration 12
Sun 19 Jan 2014 06:44:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574277
Sun 19 Jan 2014 06:44:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:44:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574277
Sun 19 Jan 2014 06:44:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:44:17 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 06:44:17 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:44:19 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:44:19 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 06:44:19 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:44:19 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 06:44:20 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 06:44:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:44:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:44:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:44:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:44:31 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:44:31 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:44:31 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:44:31 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:44:31 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:44:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:44:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:44:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:44:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:44:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:44:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:44:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:44:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:44:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:44:36 - size of cluster 'LISA Cluster': 624 hosts 79481 metrics 847668 values 13357235 bits 1669654 bytes 
Sun 19 Jan 2014 06:44:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:44:37 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:44:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:44:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:44:37 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:44:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 06:44:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:44:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:44:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:44:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:44:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:44:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:44:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579493
Sun 19 Jan 2014 06:44:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:44:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579493
Sun 19 Jan 2014 06:44:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:44:46 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:44:47 - job_xml_thread(): Done retrieving: data size 43579493
Sun 19 Jan 2014 06:44:47 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:44:47 - XML: Start document: iteration 13
Sun 19 Jan 2014 06:44:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:44:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:44:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:44:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:44:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:44:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:44:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:44:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:44:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:44:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:44:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:44:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:44:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:45:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:45:01 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:45:02 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:45:02 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:45:02 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:45:02 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:45:02 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:45:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:45:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 06:45:02 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:45:02 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:45:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 06:45:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5972 values 94159 bits 11769 bytes 
Sun 19 Jan 2014 06:45:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:45:03 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:45:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:45:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:45:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:45:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:45:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:45:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:45:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:45:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561049
Sun 19 Jan 2014 06:45:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:45:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:45:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:45:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561049
Sun 19 Jan 2014 06:45:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:45:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:45:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:45:17 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:45:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:45:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:45:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:45:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:45:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:45:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:45:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:45:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:45:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:45:19 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:45:19 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 06:45:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:45:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:45:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:45:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:45:22 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:45:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 06:45:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:45:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:45:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:45:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:45:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:45:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:45:24 - job_xml_thread(): Done retrieving: data size 43559965
Sun 19 Jan 2014 06:45:24 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:45:24 - XML: Start document: iteration 14
Sun 19 Jan 2014 06:45:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559965
Sun 19 Jan 2014 06:45:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:45:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559965
Sun 19 Jan 2014 06:45:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:45:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:45:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:45:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:45:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:45:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:45:39 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:45:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:45:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:45:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:45:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:45:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:45:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:45:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:45:43 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:45:43 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:45:43 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:45:43 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:45:43 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:45:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:45:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:45:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:45:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:45:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:45:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:45:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:45:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:45:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:45:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584911
Sun 19 Jan 2014 06:45:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:45:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584911
Sun 19 Jan 2014 06:45:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:45:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:45:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:45:59 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:45:59 - job_xml_thread(): Done retrieving: data size 43584911
Sun 19 Jan 2014 06:45:59 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:45:59 - XML: Start document: iteration 15
Sun 19 Jan 2014 06:46:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:46:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:46:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:46:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:46:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:46:02 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:46:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:46:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:46:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:46:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:46:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:46:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:46:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:46:04 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:46:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:46:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 06:46:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 06:46:04 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:46:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8730 values 137681 bits 17210 bytes 
Sun 19 Jan 2014 06:46:12 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:46:12 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:46:12 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:46:12 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:46:12 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:46:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:46:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:46:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:46:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:46:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:46:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:46:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:46:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:46:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:46:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562221
Sun 19 Jan 2014 06:46:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:46:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562221
Sun 19 Jan 2014 06:46:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:46:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:46:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:46:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:46:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:46:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:46:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:46:27 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:46:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:46:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:46:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:46:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:46:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:46:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:46:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:46:29 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:46:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 06:46:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:46:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:46:31 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:46:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:46:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:46:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:46:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:46:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:46:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:46:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:46:34 - job_xml_thread(): Done retrieving: data size 43588791
Sun 19 Jan 2014 06:46:34 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:46:34 - XML: Start document: iteration 16
Sun 19 Jan 2014 06:46:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43588791
Sun 19 Jan 2014 06:46:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:46:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43588791
Sun 19 Jan 2014 06:46:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:46:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:46:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:46:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:46:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:46:53 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:46:53 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:46:54 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:46:54 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:46:54 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:46:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:46:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:46:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:46:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:46:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:46:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:46:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:46:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:46:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:46:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:46:57 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:46:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:46:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:46:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:46:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:46:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:46:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:47:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:47:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43594557
Sun 19 Jan 2014 06:47:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:47:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43594557
Sun 19 Jan 2014 06:47:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:47:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:47:04 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:47:05 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:47:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:47:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 06:47:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 06:47:05 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:47:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8921 values 141003 bits 17625 bytes 
Sun 19 Jan 2014 06:47:09 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:47:09 - job_xml_thread(): Done retrieving: data size 43594557
Sun 19 Jan 2014 06:47:09 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:47:09 - XML: Start document: iteration 17
Sun 19 Jan 2014 06:47:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:47:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:47:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:47:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:47:18 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:47:18 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:47:18 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:47:18 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:47:18 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:47:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:47:19 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:47:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:47:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:47:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:47:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:47:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:47:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:47:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:47:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:47:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:47:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:47:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:47:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:47:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:47:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:47:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:47:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:47:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43509134
Sun 19 Jan 2014 06:47:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:47:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43509134
Sun 19 Jan 2014 06:47:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:47:33 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:47:33 - job_xml_thread(): Done retrieving: data size 43509134
Sun 19 Jan 2014 06:47:33 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:47:34 - XML: Start document: iteration 18
Sun 19 Jan 2014 06:47:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:47:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:47:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:47:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:47:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:47:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:47:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:47:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:47:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:47:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:47:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:47:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:47:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:47:43 - XML: Processed 652600 elements - found 0 jobs
Sun 19 Jan 2014 06:47:43 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:47:43 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:47:43 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:47:43 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:47:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:47:48 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:47:48 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:47:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 06:47:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:47:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:47:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:47:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:47:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:47:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:47:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:47:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:47:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42951147
Sun 19 Jan 2014 06:47:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:47:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42951147
Sun 19 Jan 2014 06:47:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:47:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:47:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:47:59 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:47:59 - job_xml_thread(): Done retrieving: data size 42951147
Sun 19 Jan 2014 06:47:59 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:47:59 - XML: Start document: iteration 19
Sun 19 Jan 2014 06:48:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:48:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:48:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:48:05 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:48:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:48:07 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:48:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 06:48:07 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:48:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5814 values 92005 bits 11500 bytes 
Sun 19 Jan 2014 06:48:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 06:48:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:48:07 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:48:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:48:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:48:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:48:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:48:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:48:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:48:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:48:14 - XML: Processed 645780 elements - found 0 jobs
Sun 19 Jan 2014 06:48:14 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:48:14 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:48:14 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:48:14 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:48:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:48:15 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:48:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:48:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:48:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:48:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:48:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:48:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:48:19 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 06:48:19 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 06:48:19 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:48:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:48:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42976825
Sun 19 Jan 2014 06:48:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:48:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42976825
Sun 19 Jan 2014 06:48:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:48:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:48:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:48:29 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:48:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:48:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:48:30 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:48:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:48:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:48:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:48:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:48:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:48:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:48:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:48:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:48:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:48:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:48:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:48:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:48:33 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:48:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 06:48:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:48:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:48:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:48:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:48:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:48:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:48:35 - job_xml_thread(): Done retrieving: data size 43116657
Sun 19 Jan 2014 06:48:35 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:48:35 - XML: Start document: iteration 20
Sun 19 Jan 2014 06:48:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43116657
Sun 19 Jan 2014 06:48:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:48:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43116657
Sun 19 Jan 2014 06:48:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:48:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:48:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:48:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:48:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:48:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:48:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:48:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:48:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:48:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:48:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:48:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:48:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:48:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:48:55 - XML: Processed 647516 elements - found 0 jobs
Sun 19 Jan 2014 06:48:55 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:48:55 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:48:55 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:48:55 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:48:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:48:57 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:48:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:48:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:48:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:48:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:48:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:48:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:48:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:48:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555185
Sun 19 Jan 2014 06:48:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:49:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555185
Sun 19 Jan 2014 06:49:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:49:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:49:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:49:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:49:08 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:49:08 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:49:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:49:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 06:49:08 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:49:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 06:49:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9174 values 144873 bits 18109 bytes 
Sun 19 Jan 2014 06:49:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:49:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:49:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:49:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:49:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:49:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:49:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:49:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:49:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:49:10 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:49:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:49:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:49:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:49:14 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:49:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:49:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:49:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:49:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:49:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:49:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:49:16 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:49:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 06:49:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:49:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:49:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579077
Sun 19 Jan 2014 06:49:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:49:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579077
Sun 19 Jan 2014 06:49:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:49:17 - job_xml_thread(): Done retrieving: data size 43579077
Sun 19 Jan 2014 06:49:17 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:49:17 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 06:49:19 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 06:49:19 - Housekeeping: done.
Sun 19 Jan 2014 06:49:19 - XML: Start document: iteration 0
Sun 19 Jan 2014 06:49:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:49:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:49:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:49:29 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:49:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:49:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:49:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:49:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:49:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:49:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:49:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:49:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:49:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:49:36 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:49:36 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:49:36 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:49:36 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:49:36 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:49:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:49:39 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:49:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:49:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:49:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:49:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:49:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:49:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:49:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:49:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556680
Sun 19 Jan 2014 06:49:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:49:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556680
Sun 19 Jan 2014 06:49:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:49:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:49:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:49:51 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:49:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:49:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:49:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:49:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:49:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:49:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:49:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:49:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:49:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:49:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:49:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:49:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:49:55 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:49:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:49:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:49:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:49:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:49:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:49:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:49:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:49:58 - job_xml_thread(): Done retrieving: data size 43575650
Sun 19 Jan 2014 06:49:58 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:49:58 - XML: Start document: iteration 1
Sun 19 Jan 2014 06:49:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575650
Sun 19 Jan 2014 06:49:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575650
Sun 19 Jan 2014 06:49:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:49:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:50:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:50:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:50:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:50:09 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:50:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:50:10 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:50:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 06:50:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 06:50:11 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:50:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:50:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:50:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148654 bits 18581 bytes 
Sun 19 Jan 2014 06:50:13 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:50:13 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:50:13 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:50:13 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:50:13 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:50:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:50:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:50:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:50:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:50:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:50:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:50:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:50:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:50:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:50:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:50:20 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:50:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:50:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:50:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:50:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:50:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:50:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:50:22 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:50:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 06:50:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:50:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:50:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576674
Sun 19 Jan 2014 06:50:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:50:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576674
Sun 19 Jan 2014 06:50:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:50:29 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:50:29 - job_xml_thread(): Done retrieving: data size 43576674
Sun 19 Jan 2014 06:50:29 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:50:29 - XML: Start document: iteration 2
Sun 19 Jan 2014 06:50:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:50:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:50:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:50:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:50:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:50:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:50:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:50:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:50:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:50:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:50:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:50:40 - XML: Processed 653347 elements - found 0 jobs
Sun 19 Jan 2014 06:50:40 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:50:40 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:50:40 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:50:40 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:50:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:50:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:50:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:50:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:50:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:50:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:50:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:50:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:50:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:50:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573754
Sun 19 Jan 2014 06:50:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:50:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573754
Sun 19 Jan 2014 06:50:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:50:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:50:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:50:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:50:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:50:55 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:50:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:50:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:50:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:50:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:50:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:50:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:50:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:50:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:50:58 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:50:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:50:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:51:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:51:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:51:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:51:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:51:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:51:00 - job_xml_thread(): Done retrieving: data size 43586932
Sun 19 Jan 2014 06:51:00 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:51:00 - XML: Start document: iteration 3
Sun 19 Jan 2014 06:51:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43586932
Sun 19 Jan 2014 06:51:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:51:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43586932
Sun 19 Jan 2014 06:51:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:51:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:51:10 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:51:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:51:11 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:51:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 06:51:11 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:51:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 06:51:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:51:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:51:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:51:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:51:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:51:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:51:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148633 bits 18579 bytes 
Sun 19 Jan 2014 06:51:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:51:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:51:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:51:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:51:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:51:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:51:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:51:17 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:51:17 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:51:17 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:51:17 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:51:17 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:51:19 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 06:51:19 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:51:20 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:51:20 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 06:51:20 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:51:20 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 06:51:20 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 06:51:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:51:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:51:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:51:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:51:22 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 846448 values 13373645 bits 1671705 bytes 
Sun 19 Jan 2014 06:51:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:51:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:51:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:51:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:51:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:51:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43550130
Sun 19 Jan 2014 06:51:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:51:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43550130
Sun 19 Jan 2014 06:51:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:51:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:51:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:51:32 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:51:32 - job_xml_thread(): Done retrieving: data size 43550130
Sun 19 Jan 2014 06:51:32 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:51:32 - XML: Start document: iteration 4
Sun 19 Jan 2014 06:51:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:51:37 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:51:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:51:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:51:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:51:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:51:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:51:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:51:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:51:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:51:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:51:47 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:51:47 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:51:47 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:51:47 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:51:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 06:51:47 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:51:47 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:51:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:51:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:51:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:51:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:51:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:51:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:51:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:51:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:51:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:51:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:51:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557633
Sun 19 Jan 2014 06:51:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:51:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557633
Sun 19 Jan 2014 06:51:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:51:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:51:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:52:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:52:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:52:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:52:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:52:02 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:52:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:52:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:52:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:52:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:52:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:52:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:52:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:52:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:52:07 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:52:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:52:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:52:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:52:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:52:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:52:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:52:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:52:10 - job_xml_thread(): Done retrieving: data size 43564288
Sun 19 Jan 2014 06:52:10 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:52:10 - XML: Start document: iteration 5
Sun 19 Jan 2014 06:52:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564288
Sun 19 Jan 2014 06:52:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:52:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564288
Sun 19 Jan 2014 06:52:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:52:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:52:11 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:52:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:52:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 06:52:12 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:52:12 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:52:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 06:52:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5616 values 88529 bits 11066 bytes 
Sun 19 Jan 2014 06:52:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:52:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:52:20 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:52:20 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 06:52:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:52:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:52:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:52:28 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:52:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:52:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:52:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:52:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:52:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:52:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:52:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:52:30 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:52:30 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:52:30 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:52:30 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:52:30 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:52:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:52:34 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:52:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:52:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:52:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:52:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:52:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:52:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:52:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:52:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577029
Sun 19 Jan 2014 06:52:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:52:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577029
Sun 19 Jan 2014 06:52:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:52:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:52:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:52:45 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:52:46 - job_xml_thread(): Done retrieving: data size 43577029
Sun 19 Jan 2014 06:52:46 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:52:46 - XML: Start document: iteration 6
Sun 19 Jan 2014 06:52:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:52:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:52:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:52:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:52:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:52:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:52:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:52:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:52:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:52:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:52:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:53:01 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:53:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:53:01 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:53:01 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:53:01 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:53:01 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:53:01 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:53:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:53:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:53:01 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:53:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 06:53:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:53:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:53:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:53:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:53:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:53:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:53:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577736
Sun 19 Jan 2014 06:53:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:53:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577736
Sun 19 Jan 2014 06:53:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:53:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:53:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:53:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:53:14 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:53:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:53:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:53:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:53:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:53:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:53:15 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:53:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 06:53:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 06:53:15 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:53:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5838 values 92097 bits 11512 bytes 
Sun 19 Jan 2014 06:53:16 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:53:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:53:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:53:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:53:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:53:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:53:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:53:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:53:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:53:19 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:53:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:53:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:53:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:53:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:53:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:53:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:53:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:53:22 - job_xml_thread(): Done retrieving: data size 43523094
Sun 19 Jan 2014 06:53:22 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:53:22 - XML: Start document: iteration 7
Sun 19 Jan 2014 06:53:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43523094
Sun 19 Jan 2014 06:53:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:53:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43523094
Sun 19 Jan 2014 06:53:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:53:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:53:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:53:34 - XML: Processed 652600 elements - found 0 jobs
Sun 19 Jan 2014 06:53:34 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:53:34 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:53:34 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:53:34 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:53:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:53:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:53:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:53:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:53:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:53:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:53:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:53:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:53:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:53:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:53:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:53:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:53:45 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:53:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:53:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:53:45 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:53:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 06:53:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:53:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:53:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:53:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:53:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:53:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:53:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42976123
Sun 19 Jan 2014 06:53:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:53:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42976123
Sun 19 Jan 2014 06:53:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:53:49 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:53:49 - job_xml_thread(): Done retrieving: data size 42976123
Sun 19 Jan 2014 06:53:49 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:53:49 - XML: Start document: iteration 8
Sun 19 Jan 2014 06:53:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:53:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:54:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:54:02 - XML: Processed 645912 elements - found 0 jobs
Sun 19 Jan 2014 06:54:02 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:54:02 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:54:02 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:54:02 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:54:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:54:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:54:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:54:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:54:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:54:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:54:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:54:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:54:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:54:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:54:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:54:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:54:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:54:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:54:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:54:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:54:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:54:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:54:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:54:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42982179
Sun 19 Jan 2014 06:54:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:54:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42982179
Sun 19 Jan 2014 06:54:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:54:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:54:16 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:54:17 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:54:17 - job_xml_thread(): Done retrieving: data size 42982179
Sun 19 Jan 2014 06:54:17 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:54:17 - XML: Start document: iteration 9
Sun 19 Jan 2014 06:54:17 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:54:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 06:54:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:54:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 06:54:17 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:54:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8855 values 139596 bits 17449 bytes 
Sun 19 Jan 2014 06:54:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:54:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:54:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:54:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:54:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:54:31 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:54:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:54:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:54:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:54:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:54:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:54:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:54:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:54:36 - XML: Processed 645826 elements - found 0 jobs
Sun 19 Jan 2014 06:54:36 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:54:36 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:54:36 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:54:36 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:54:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:54:37 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:54:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:54:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:54:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:54:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:54:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:54:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:54:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:54:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43385152
Sun 19 Jan 2014 06:54:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:54:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43385152
Sun 19 Jan 2014 06:54:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:54:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:54:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:54:51 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:54:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:54:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:54:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:54:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:54:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:54:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:54:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:54:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:54:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:54:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:54:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:54:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:54:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:54:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:54:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:54:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:54:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:54:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:54:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:54:56 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:54:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 06:54:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:54:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:54:59 - job_xml_thread(): Done retrieving: data size 43566163
Sun 19 Jan 2014 06:54:59 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:54:59 - XML: Start document: iteration 10
Sun 19 Jan 2014 06:55:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566163
Sun 19 Jan 2014 06:55:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566163
Sun 19 Jan 2014 06:55:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:55:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:55:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:55:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:55:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:55:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:55:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:55:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:55:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:55:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:55:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:55:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:55:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:55:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:55:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:55:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:55:18 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:55:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:55:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 06:55:18 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:55:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5927 values 93499 bits 11687 bytes 
Sun 19 Jan 2014 06:55:18 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:55:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 06:55:19 - XML: Processed 653314 elements - found 0 jobs
Sun 19 Jan 2014 06:55:19 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:55:19 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:55:19 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:55:19 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:55:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:55:21 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:55:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:55:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:55:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:55:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:55:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:55:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:55:23 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 06:55:23 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 06:55:23 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:55:24 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:55:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 06:55:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:55:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:55:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556515
Sun 19 Jan 2014 06:55:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:55:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556515
Sun 19 Jan 2014 06:55:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:55:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:55:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:55:34 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:55:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:55:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:55:36 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:55:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:55:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:55:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:55:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:55:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:55:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:55:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:55:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:55:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:55:39 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:55:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:55:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:55:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:55:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:55:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:55:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:55:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:55:41 - job_xml_thread(): Done retrieving: data size 43563259
Sun 19 Jan 2014 06:55:41 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:55:41 - XML: Start document: iteration 11
Sun 19 Jan 2014 06:55:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563259
Sun 19 Jan 2014 06:55:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:55:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563259
Sun 19 Jan 2014 06:55:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:55:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:55:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:55:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:55:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:55:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:55:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:55:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:55:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:55:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:55:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:55:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:55:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:55:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:55:59 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:55:59 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:55:59 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:55:59 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:55:59 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:56:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:56:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:56:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:56:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:56:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:56:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:56:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:56:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:56:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:56:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574301
Sun 19 Jan 2014 06:56:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:56:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574301
Sun 19 Jan 2014 06:56:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:56:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:56:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:56:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:56:13 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:56:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:56:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:56:14 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:56:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:56:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:56:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:56:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:56:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:56:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:56:17 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:56:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:56:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:56:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:56:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:56:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:56:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:56:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:56:18 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:56:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:56:18 - job_xml_thread(): Done retrieving: data size 43584325
Sun 19 Jan 2014 06:56:18 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:56:18 - XML: Start document: iteration 12
Sun 19 Jan 2014 06:56:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584325
Sun 19 Jan 2014 06:56:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:56:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:56:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 06:56:19 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:56:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 06:56:19 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:56:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584325
Sun 19 Jan 2014 06:56:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148534 bits 18566 bytes 
Sun 19 Jan 2014 06:56:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:56:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:56:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:56:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:56:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:56:35 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:56:35 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:56:35 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:56:35 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:56:35 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:56:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:56:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:56:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:56:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:56:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:56:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:56:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:56:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:56:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:56:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:56:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:56:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:56:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:56:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:56:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:56:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:56:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:56:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:56:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572684
Sun 19 Jan 2014 06:56:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:56:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572684
Sun 19 Jan 2014 06:56:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:56:50 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:56:50 - job_xml_thread(): Done retrieving: data size 43572684
Sun 19 Jan 2014 06:56:50 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:56:50 - XML: Start document: iteration 13
Sun 19 Jan 2014 06:56:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:56:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:56:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:56:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:57:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:57:01 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:57:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:57:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:57:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:57:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:57:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:57:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:57:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:57:03 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:57:03 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:57:03 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:57:03 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:57:03 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:57:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:57:06 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:57:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:57:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:57:06 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:57:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 06:57:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:57:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:57:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:57:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:57:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:57:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:57:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43601034
Sun 19 Jan 2014 06:57:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:57:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43601034
Sun 19 Jan 2014 06:57:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:57:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:57:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:57:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:57:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:57:18 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:57:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:57:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:57:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:57:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:57:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:57:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:57:19 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:57:19 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:57:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 06:57:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:57:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 06:57:19 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:57:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6125 values 96579 bits 12072 bytes 
Sun 19 Jan 2014 06:57:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:57:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:57:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:57:21 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:57:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:57:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:57:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:57:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:57:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:57:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:57:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:57:24 - job_xml_thread(): Done retrieving: data size 43595194
Sun 19 Jan 2014 06:57:24 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:57:24 - XML: Start document: iteration 14
Sun 19 Jan 2014 06:57:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43595194
Sun 19 Jan 2014 06:57:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43595194
Sun 19 Jan 2014 06:57:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:57:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:57:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:57:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:57:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:57:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:57:40 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:57:40 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:57:40 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:57:40 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:57:40 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:57:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:57:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:57:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:57:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:57:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:57:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:57:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:57:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:57:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:57:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:57:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:57:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:57:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:57:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:57:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:57:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:57:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:57:47 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:57:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 06:57:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:57:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:57:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583177
Sun 19 Jan 2014 06:57:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:57:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583177
Sun 19 Jan 2014 06:57:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:57:55 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:57:55 - job_xml_thread(): Done retrieving: data size 43583177
Sun 19 Jan 2014 06:57:55 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:57:55 - XML: Start document: iteration 15
Sun 19 Jan 2014 06:57:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:57:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:57:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:57:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:57:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:57:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:57:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:57:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:57:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:58:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:58:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:58:06 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:58:06 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:58:06 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:58:06 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:58:06 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:58:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:58:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:58:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:58:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:58:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:58:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:58:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:58:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:58:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:58:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554194
Sun 19 Jan 2014 06:58:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:58:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554194
Sun 19 Jan 2014 06:58:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:58:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:58:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:58:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:58:20 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:58:20 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:58:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:58:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 06:58:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 06:58:20 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:58:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8933 values 140871 bits 17608 bytes 
Sun 19 Jan 2014 06:58:21 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 06:58:21 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:58:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:58:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:58:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:58:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:58:21 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:58:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:58:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:58:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:58:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:58:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:58:22 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:58:22 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:58:22 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 06:58:22 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 06:58:22 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 06:58:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:58:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:58:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:58:26 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:58:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:58:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:58:26 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 889893 values 14027995 bits 1753499 bytes 
Sun 19 Jan 2014 06:58:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:58:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:58:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:58:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:58:30 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:58:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 06:58:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:58:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:58:30 - job_xml_thread(): Done retrieving: data size 43565574
Sun 19 Jan 2014 06:58:30 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:58:30 - XML: Start document: iteration 16
Sun 19 Jan 2014 06:58:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565574
Sun 19 Jan 2014 06:58:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:58:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565574
Sun 19 Jan 2014 06:58:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:58:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:58:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:58:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:58:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:58:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:58:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:58:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:58:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:58:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:58:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:58:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:58:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:58:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:58:49 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:58:49 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:58:49 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:58:49 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:58:49 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:58:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:58:51 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:58:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:58:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:58:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:58:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:58:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:58:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:58:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:58:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582381
Sun 19 Jan 2014 06:58:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:58:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582381
Sun 19 Jan 2014 06:58:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:58:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:58:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:59:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:59:03 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:59:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:59:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:59:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:59:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:59:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:59:04 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:59:04 - job_xml_thread(): Done retrieving: data size 43582381
Sun 19 Jan 2014 06:59:04 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:59:04 - XML: Start document: iteration 17
Sun 19 Jan 2014 06:59:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:59:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582381
Sun 19 Jan 2014 06:59:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:59:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:59:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:59:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:59:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:59:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:59:20 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:59:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:59:21 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:59:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 06:59:21 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:59:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 06:59:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:59:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99058 bits 12382 bytes 
Sun 19 Jan 2014 06:59:22 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:59:22 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 06:59:22 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:59:22 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:59:22 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:59:22 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:59:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:59:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:59:22 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:59:22 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 06:59:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:59:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:59:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:59:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:59:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:59:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:59:25 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:59:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:59:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:59:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:59:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:59:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:59:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:59:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:59:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43503415
Sun 19 Jan 2014 06:59:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:59:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43503415
Sun 19 Jan 2014 06:59:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 06:59:37 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 06:59:37 - job_xml_thread(): Done retrieving: data size 43503415
Sun 19 Jan 2014 06:59:37 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 06:59:37 - XML: Start document: iteration 18
Sun 19 Jan 2014 06:59:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:59:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:59:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 06:59:39 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 06:59:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 06:59:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:59:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:59:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 06:59:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 06:59:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 06:59:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 06:59:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 06:59:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:59:47 - XML: Processed 652580 elements - found 0 jobs
Sun 19 Jan 2014 06:59:47 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 06:59:47 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 06:59:47 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 06:59:47 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 06:59:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 06:59:52 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 06:59:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 06:59:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 06:59:52 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 06:59:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 06:59:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 06:59:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:59:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 06:59:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 06:59:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 06:59:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 06:59:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42953257
Sun 19 Jan 2014 06:59:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 06:59:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 06:59:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 06:59:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42953257
Sun 19 Jan 2014 06:59:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:00:02 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:00:02 - job_xml_thread(): Done retrieving: data size 42953257
Sun 19 Jan 2014 07:00:02 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:00:02 - XML: Start document: iteration 19
Sun 19 Jan 2014 07:00:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:00:07 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:00:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:00:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:00:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:00:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:00:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:00:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:00:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:00:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:00:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:00:12 - XML: Processed 645860 elements - found 0 jobs
Sun 19 Jan 2014 07:00:12 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:00:12 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:00:12 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:00:12 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:00:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:00:17 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:00:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:00:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:00:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:00:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:00:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:00:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:00:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:00:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42954038
Sun 19 Jan 2014 07:00:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:00:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42954038
Sun 19 Jan 2014 07:00:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:00:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:00:21 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:00:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:00:22 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:00:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 07:00:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 07:00:22 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:00:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6674 values 105192 bits 13149 bytes 
Sun 19 Jan 2014 07:00:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:00:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:00:27 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:00:28 - job_xml_thread(): Done retrieving: data size 42954038
Sun 19 Jan 2014 07:00:28 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:00:28 - XML: Start document: iteration 20
Sun 19 Jan 2014 07:00:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:00:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:00:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:00:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:00:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:00:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:00:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:00:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:00:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:00:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:00:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:00:39 - XML: Processed 645826 elements - found 0 jobs
Sun 19 Jan 2014 07:00:39 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:00:39 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:00:39 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:00:39 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:00:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:00:41 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:00:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:00:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:00:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:00:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:00:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:00:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:00:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:00:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43465677
Sun 19 Jan 2014 07:00:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:00:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43465677
Sun 19 Jan 2014 07:00:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:00:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:00:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:00:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:00:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:00:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:00:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:00:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:00:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:00:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:00:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:00:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43465677
Sun 19 Jan 2014 07:00:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:00:55 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:00:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:00:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:00:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:01:05 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:01:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 07:01:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:01:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:01:06 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:01:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:01:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:01:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:01:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:01:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:01:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:01:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:01:07 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:01:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:01:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:01:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:01:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:01:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:01:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:01:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:01:11 - job_xml_thread(): Done retrieving: data size 43558437
Sun 19 Jan 2014 07:01:11 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:01:11 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 07:01:11 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 07:01:11 - Housekeeping: done.
Sun 19 Jan 2014 07:01:11 - XML: Start document: iteration 0
Sun 19 Jan 2014 07:01:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558437
Sun 19 Jan 2014 07:01:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558437
Sun 19 Jan 2014 07:01:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:01:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:01:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:01:22 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:01:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:01:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:01:23 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:01:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 07:01:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:01:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 07:01:23 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:01:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6130 values 96784 bits 12098 bytes 
Sun 19 Jan 2014 07:01:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:01:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:01:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:01:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:01:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:01:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:01:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:01:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:01:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:01:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:01:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:01:29 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:01:29 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:01:29 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:01:29 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:01:29 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:01:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:01:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:01:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:01:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:01:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:01:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:01:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:01:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:01:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:01:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564906
Sun 19 Jan 2014 07:01:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:01:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564906
Sun 19 Jan 2014 07:01:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:01:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:01:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:01:44 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:01:44 - job_xml_thread(): Done retrieving: data size 43564906
Sun 19 Jan 2014 07:01:44 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:01:44 - XML: Start document: iteration 1
Sun 19 Jan 2014 07:01:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:01:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:01:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:01:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:01:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:01:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:01:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:01:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:01:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:01:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:01:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:01:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:01:57 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:01:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:01:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:01:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:01:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:01:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:01:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:01:59 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:01:59 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:01:59 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:01:59 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:01:59 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:01:59 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:01:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 07:01:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:02:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:02:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43552110
Sun 19 Jan 2014 07:02:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:02:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43552110
Sun 19 Jan 2014 07:02:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:02:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:02:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:02:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:02:13 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:02:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:02:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:02:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:02:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:02:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:02:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:02:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:02:14 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:02:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:02:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:02:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:02:17 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:02:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:02:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:02:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:02:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:02:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:02:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:02:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:02:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575672
Sun 19 Jan 2014 07:02:20 - job_xml_thread(): Done retrieving: data size 43575672
Sun 19 Jan 2014 07:02:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:02:20 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:02:20 - XML: Start document: iteration 2
Sun 19 Jan 2014 07:02:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575672
Sun 19 Jan 2014 07:02:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:02:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:02:25 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:02:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:02:27 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:02:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 07:02:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:02:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 07:02:28 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:02:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:02:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8755 values 138544 bits 17318 bytes 
Sun 19 Jan 2014 07:02:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:02:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:02:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:02:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:02:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:02:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:02:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:02:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:02:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:02:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:02:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:02:38 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:02:38 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:02:38 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:02:38 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:02:38 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:02:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:02:42 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:02:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:02:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:02:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:02:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:02:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:02:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:02:44 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 07:02:44 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 07:02:44 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:02:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:02:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559584
Sun 19 Jan 2014 07:02:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:02:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559584
Sun 19 Jan 2014 07:02:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:02:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:02:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:02:54 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:02:54 - job_xml_thread(): Done retrieving: data size 43559584
Sun 19 Jan 2014 07:02:54 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:02:55 - XML: Start document: iteration 3
Sun 19 Jan 2014 07:02:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:02:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:03:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:03:03 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:03:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:03:04 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:03:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:03:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:03:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:03:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:03:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:03:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:03:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:03:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:03:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:03:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:03:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:03:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:03:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:03:07 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:03:07 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:03:07 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:03:07 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:03:07 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:03:07 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:03:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 07:03:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:03:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:03:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43599699
Sun 19 Jan 2014 07:03:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:03:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43599699
Sun 19 Jan 2014 07:03:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:03:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:03:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:03:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:03:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:03:22 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:03:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:03:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:03:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:03:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:03:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:03:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:03:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:03:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:03:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:03:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:03:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:03:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:03:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:03:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:03:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:03:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:03:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:03:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:03:24 - job_xml_thread(): Done retrieving: data size 43594487
Sun 19 Jan 2014 07:03:24 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:03:24 - XML: Start document: iteration 4
Sun 19 Jan 2014 07:03:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43594487
Sun 19 Jan 2014 07:03:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43594487
Sun 19 Jan 2014 07:03:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:03:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:03:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:03:29 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:03:32 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:03:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:03:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 07:03:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 07:03:33 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:03:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8636 values 136487 bits 17060 bytes 
Sun 19 Jan 2014 07:03:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:03:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:03:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:03:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:03:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:03:39 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:03:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:03:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:03:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:03:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:03:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:03:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:03:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:03:44 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:03:44 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:03:44 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:03:44 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:03:44 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:03:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:03:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:03:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:03:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:03:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:03:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:03:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:03:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:03:49 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:03:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 07:03:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:03:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:03:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567145
Sun 19 Jan 2014 07:03:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:03:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567145
Sun 19 Jan 2014 07:03:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:03:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:03:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:03:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:03:58 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:03:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:03:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:03:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:03:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:03:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:03:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567145
Sun 19 Jan 2014 07:03:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:03:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:03:59 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:03:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:04:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:04:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:04:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:04:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:04:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:04:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:04:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:04:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:04:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:04:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:04:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:04:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:04:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:04:11 - job_xml_thread(): Done retrieving: data size 43555022
Sun 19 Jan 2014 07:04:11 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:04:11 - XML: Start document: iteration 5
Sun 19 Jan 2014 07:04:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555022
Sun 19 Jan 2014 07:04:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:04:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:04:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:04:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:04:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:04:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:04:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:04:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555022
Sun 19 Jan 2014 07:04:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:04:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:04:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:04:27 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:04:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:04:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:04:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:04:30 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:04:30 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:04:30 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:04:30 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:04:30 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:04:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:04:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:04:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:04:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:04:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:04:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:04:33 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:04:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:04:33 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:04:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 07:04:33 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:04:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 07:04:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99030 bits 12378 bytes 
Sun 19 Jan 2014 07:04:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:04:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:04:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:04:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:04:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:04:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:04:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:04:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:04:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:04:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43591721
Sun 19 Jan 2014 07:04:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:04:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43591721
Sun 19 Jan 2014 07:04:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:04:45 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:04:45 - job_xml_thread(): Done retrieving: data size 43591721
Sun 19 Jan 2014 07:04:45 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:04:45 - XML: Start document: iteration 6
Sun 19 Jan 2014 07:04:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:04:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:04:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:04:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:04:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:04:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:04:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:04:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:04:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:04:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:04:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:04:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:04:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:04:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:04:55 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:04:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:04:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:04:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:04:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:04:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:04:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:04:59 - XML: Processed 653349 elements - found 0 jobs
Sun 19 Jan 2014 07:04:59 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:04:59 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:04:59 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:04:59 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:04:59 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:04:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 07:04:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:05:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:05:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578386
Sun 19 Jan 2014 07:05:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:05:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578386
Sun 19 Jan 2014 07:05:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:05:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:05:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:05:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:05:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:05:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:05:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:05:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:05:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:05:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:05:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:05:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:05:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:05:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:05:14 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:05:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:05:15 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:05:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:05:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:05:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:05:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:05:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:05:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:05:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:05:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43521187
Sun 19 Jan 2014 07:05:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:05:17 - job_xml_thread(): Done retrieving: data size 43521187
Sun 19 Jan 2014 07:05:17 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:05:17 - XML: Start document: iteration 7
Sun 19 Jan 2014 07:05:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43521187
Sun 19 Jan 2014 07:05:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:05:22 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 07:05:22 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:05:24 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:05:24 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 07:05:24 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:05:24 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 07:05:24 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 07:05:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:05:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:05:29 - size of cluster 'LISA Cluster': 624 hosts 79467 metrics 789422 values 12463098 bits 1557887 bytes 
Sun 19 Jan 2014 07:05:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:05:30 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:05:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:05:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:05:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:05:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:05:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:05:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:05:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:05:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:05:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:05:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:05:33 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:05:35 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:05:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:05:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 07:05:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 07:05:35 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:05:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9174 values 144703 bits 18087 bytes 
Sun 19 Jan 2014 07:05:36 - XML: Processed 652600 elements - found 0 jobs
Sun 19 Jan 2014 07:05:36 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:05:36 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:05:36 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:05:36 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:05:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:05:41 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:05:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:05:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:05:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:05:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:05:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:05:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:05:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:05:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42996363
Sun 19 Jan 2014 07:05:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:05:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42996363
Sun 19 Jan 2014 07:05:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:05:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:05:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:05:51 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:05:51 - job_xml_thread(): Done retrieving: data size 42996363
Sun 19 Jan 2014 07:05:52 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:05:52 - XML: Start document: iteration 8
Sun 19 Jan 2014 07:05:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:05:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:05:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:05:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:05:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:05:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:05:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:05:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:05:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:05:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:05:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:06:06 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:06:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 07:06:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:06:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:06:07 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:06:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:06:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:06:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:06:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:06:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:06:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:06:07 - XML: Processed 646456 elements - found 0 jobs
Sun 19 Jan 2014 07:06:07 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:06:07 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:06:07 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:06:07 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:06:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:06:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42936315
Sun 19 Jan 2014 07:06:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:06:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42936315
Sun 19 Jan 2014 07:06:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:06:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:06:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:06:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:06:18 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:06:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:06:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:06:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:06:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:06:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:06:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:06:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42936315
Sun 19 Jan 2014 07:06:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:06:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:06:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:06:23 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:06:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:06:24 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:06:24 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 07:06:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:06:28 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:06:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:06:31 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:06:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:06:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:06:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:06:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:06:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:06:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:06:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:06:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:06:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:06:34 - job_xml_thread(): Done retrieving: data size 42970766
Sun 19 Jan 2014 07:06:34 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:06:34 - XML: Start document: iteration 9
Sun 19 Jan 2014 07:06:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42970766
Sun 19 Jan 2014 07:06:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:06:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:06:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:06:35 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:06:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:06:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42970766
Sun 19 Jan 2014 07:06:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:06:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:06:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:06:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:06:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 07:06:38 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:06:38 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:06:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 07:06:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8886 values 140134 bits 17516 bytes 
Sun 19 Jan 2014 07:06:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:06:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:06:48 - XML: Processed 645900 elements - found 0 jobs
Sun 19 Jan 2014 07:06:48 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:06:48 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:06:48 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:06:48 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:06:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:06:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:06:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:06:54 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:06:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:06:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:06:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:06:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:06:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:06:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:06:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:06:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:06:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:06:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:06:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:06:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:06:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:06:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:06:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:07:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:07:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578711
Sun 19 Jan 2014 07:07:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:07:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578711
Sun 19 Jan 2014 07:07:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:07:03 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:07:03 - job_xml_thread(): Done retrieving: data size 43578711
Sun 19 Jan 2014 07:07:03 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:07:03 - XML: Start document: iteration 10
Sun 19 Jan 2014 07:07:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:07:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:07:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:07:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:07:12 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:07:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 07:07:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:07:18 - XML: Processed 653316 elements - found 0 jobs
Sun 19 Jan 2014 07:07:18 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:07:18 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:07:18 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:07:18 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:07:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:07:19 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:07:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:07:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:07:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:07:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:07:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:07:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:07:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:07:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:07:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:07:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:07:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:07:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:07:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:07:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:07:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:07:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:07:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557268
Sun 19 Jan 2014 07:07:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:07:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557268
Sun 19 Jan 2014 07:07:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:07:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:07:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:07:33 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:07:33 - job_xml_thread(): Done retrieving: data size 43557268
Sun 19 Jan 2014 07:07:33 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:07:33 - XML: Start document: iteration 11
Sun 19 Jan 2014 07:07:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:07:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:07:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:07:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:07:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:07:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:07:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557268
Sun 19 Jan 2014 07:07:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:07:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:07:38 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:07:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:07:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:07:38 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:07:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:07:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 07:07:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 07:07:39 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:07:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6164 values 97342 bits 12167 bytes 
Sun 19 Jan 2014 07:07:44 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:07:44 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:07:44 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:07:44 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:07:45 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:07:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:07:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:07:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:07:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:07:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:07:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:07:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:07:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:07:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:07:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:07:52 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:07:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:07:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:07:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:07:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:07:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:07:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:07:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:07:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573400
Sun 19 Jan 2014 07:07:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:07:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573400
Sun 19 Jan 2014 07:07:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:08:00 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:08:00 - job_xml_thread(): Done retrieving: data size 43573400
Sun 19 Jan 2014 07:08:00 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:08:00 - XML: Start document: iteration 12
Sun 19 Jan 2014 07:08:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:08:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:08:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:08:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:08:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:08:10 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:08:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:08:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:08:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:08:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:08:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:08:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:08:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:08:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:08:19 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:08:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:08:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:08:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:08:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:08:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:08:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:08:20 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:08:20 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:08:20 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:08:20 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:08:20 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:08:20 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:08:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 07:08:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:08:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:08:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565219
Sun 19 Jan 2014 07:08:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:08:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565219
Sun 19 Jan 2014 07:08:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:08:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:08:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:08:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:08:31 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:08:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:08:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:08:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:08:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:08:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:08:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565219
Sun 19 Jan 2014 07:08:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:08:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:08:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:08:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:08:35 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:08:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:08:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:08:39 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:08:39 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:08:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 07:08:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:08:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 07:08:40 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:08:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5722 values 90243 bits 11280 bytes 
Sun 19 Jan 2014 07:08:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:08:43 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:08:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:08:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:08:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:08:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:08:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:08:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:08:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:08:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:08:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:08:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:08:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:08:47 - job_xml_thread(): Done retrieving: data size 43564904
Sun 19 Jan 2014 07:08:47 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:08:47 - XML: Start document: iteration 13
Sun 19 Jan 2014 07:08:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564904
Sun 19 Jan 2014 07:08:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:08:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:08:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:08:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:08:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564904
Sun 19 Jan 2014 07:08:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:08:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:09:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:09:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:09:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:09:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:09:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:09:07 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:09:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:09:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:09:08 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:09:08 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:09:08 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:09:08 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:09:08 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:09:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:09:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:09:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:09:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:09:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:09:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:09:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:09:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:09:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:09:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:09:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:09:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:09:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:09:12 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:09:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 07:09:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:09:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:09:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578096
Sun 19 Jan 2014 07:09:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:09:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578096
Sun 19 Jan 2014 07:09:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:09:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:09:23 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:09:23 - job_xml_thread(): Done retrieving: data size 43578096
Sun 19 Jan 2014 07:09:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:09:24 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:09:24 - XML: Start document: iteration 14
Sun 19 Jan 2014 07:09:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:09:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:09:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:09:30 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:09:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:09:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:09:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:09:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:09:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:09:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:09:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:09:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:09:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:09:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:09:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:09:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:09:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:09:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:09:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:09:38 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:09:38 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:09:38 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:09:38 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:09:38 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:09:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:09:39 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:09:40 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:09:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:09:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 07:09:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 07:09:40 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:09:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5540 values 87302 bits 10912 bytes 
Sun 19 Jan 2014 07:09:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:09:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43552324
Sun 19 Jan 2014 07:09:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:09:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43552324
Sun 19 Jan 2014 07:09:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:09:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:09:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:09:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:09:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:09:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:09:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:09:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:09:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:09:54 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:09:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:09:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:09:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:09:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:09:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:09:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:09:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:09:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:09:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:09:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:09:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:09:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:09:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:10:00 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:10:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 07:10:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:10:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:10:01 - job_xml_thread(): Done retrieving: data size 43583822
Sun 19 Jan 2014 07:10:01 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:10:01 - XML: Start document: iteration 15
Sun 19 Jan 2014 07:10:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583822
Sun 19 Jan 2014 07:10:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:10:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583822
Sun 19 Jan 2014 07:10:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:10:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:10:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:10:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:10:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:10:17 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:10:17 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:10:17 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:10:17 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:10:17 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:10:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:10:18 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:10:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:10:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:10:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:10:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:10:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:10:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:10:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:10:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:10:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:10:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:10:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:10:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:10:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:10:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:10:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:10:24 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 07:10:24 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 07:10:24 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:10:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:10:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570614
Sun 19 Jan 2014 07:10:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:10:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570614
Sun 19 Jan 2014 07:10:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:10:33 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:10:33 - job_xml_thread(): Done retrieving: data size 43570614
Sun 19 Jan 2014 07:10:33 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:10:33 - XML: Start document: iteration 16
Sun 19 Jan 2014 07:10:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:10:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:10:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:10:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:10:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:10:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:10:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:10:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:10:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:10:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:10:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:10:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:10:40 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:10:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:10:42 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:10:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 07:10:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 07:10:42 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:10:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7198 values 113472 bits 14184 bytes 
Sun 19 Jan 2014 07:10:42 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:10:42 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:10:42 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:10:42 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:10:42 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:10:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:10:45 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:10:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:10:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:10:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:10:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:10:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:10:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:10:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:10:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561230
Sun 19 Jan 2014 07:10:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:10:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561230
Sun 19 Jan 2014 07:10:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:10:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:10:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:10:57 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:10:57 - job_xml_thread(): Done retrieving: data size 43561230
Sun 19 Jan 2014 07:10:57 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:10:58 - XML: Start document: iteration 17
Sun 19 Jan 2014 07:11:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:11:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:11:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:11:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:11:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:11:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:11:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:11:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:11:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:11:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:11:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:11:10 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:11:10 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:11:10 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:11:10 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:11:10 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:11:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:11:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:11:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:11:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:11:10 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:11:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 07:11:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:11:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:11:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:11:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:11:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:11:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:11:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43493271
Sun 19 Jan 2014 07:11:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:11:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43493271
Sun 19 Jan 2014 07:11:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:11:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:11:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:11:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:11:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:11:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:11:25 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:11:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:11:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:11:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:11:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:11:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:11:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:11:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:11:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:11:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:11:27 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:11:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:11:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:11:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:11:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:11:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:11:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:11:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:11:30 - job_xml_thread(): Done retrieving: data size 43147580
Sun 19 Jan 2014 07:11:30 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:11:30 - XML: Start document: iteration 18
Sun 19 Jan 2014 07:11:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43147580
Sun 19 Jan 2014 07:11:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:11:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43147580
Sun 19 Jan 2014 07:11:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:11:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:11:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:11:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:11:42 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:11:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:11:43 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:11:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 07:11:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 07:11:43 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:11:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9138 values 144088 bits 18011 bytes 
Sun 19 Jan 2014 07:11:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:11:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:11:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:11:48 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:11:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:11:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:11:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:11:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:11:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:11:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:11:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:11:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:11:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:11:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:11:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:11:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:11:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:11:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:11:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:11:51 - XML: Processed 647984 elements - found 0 jobs
Sun 19 Jan 2014 07:11:51 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:11:51 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:11:51 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:11:51 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:11:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:11:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42927697
Sun 19 Jan 2014 07:11:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:11:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42927697
Sun 19 Jan 2014 07:11:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:12:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:12:03 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:12:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:12:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:12:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:12:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:12:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:12:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:12:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:12:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:12:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:12:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:12:06 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:12:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:12:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:12:06 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:12:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 07:12:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:12:06 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:12:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:12:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:12:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:12:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:12:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:12:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42936911
Sun 19 Jan 2014 07:12:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:12:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42936911
Sun 19 Jan 2014 07:12:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:12:08 - job_xml_thread(): Done retrieving: data size 42936911
Sun 19 Jan 2014 07:12:08 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:12:08 - XML: Start document: iteration 19
Sun 19 Jan 2014 07:12:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:12:20 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:12:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:12:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:12:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:12:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:12:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:12:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:12:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:12:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:12:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:12:25 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 07:12:25 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:12:26 - XML: Processed 645256 elements - found 0 jobs
Sun 19 Jan 2014 07:12:26 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:12:26 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:12:26 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:12:26 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:12:26 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:12:26 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 07:12:26 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:12:26 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 07:12:27 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 07:12:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:12:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:12:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:12:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:12:31 - size of cluster 'LISA Cluster': 624 hosts 79482 metrics 787397 values 12411538 bits 1551442 bytes 
Sun 19 Jan 2014 07:12:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:12:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:12:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:12:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:12:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:12:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42976290
Sun 19 Jan 2014 07:12:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:12:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42976290
Sun 19 Jan 2014 07:12:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:12:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:12:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:12:41 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:12:41 - job_xml_thread(): Done retrieving: data size 42976290
Sun 19 Jan 2014 07:12:41 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:12:41 - XML: Start document: iteration 20
Sun 19 Jan 2014 07:12:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:12:43 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:12:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:12:45 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:12:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 07:12:45 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:12:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 07:12:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9094 values 143439 bits 17929 bytes 
Sun 19 Jan 2014 07:12:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:12:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:12:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:12:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:12:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:12:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:12:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:12:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:12:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:12:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:12:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:12:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:12:57 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:12:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:12:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:12:57 - XML: Processed 646046 elements - found 0 jobs
Sun 19 Jan 2014 07:12:57 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:12:57 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:12:57 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:12:57 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:12:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:12:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:12:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:12:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:13:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:13:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566714
Sun 19 Jan 2014 07:13:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:13:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566714
Sun 19 Jan 2014 07:13:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:13:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:13:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:13:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:13:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:13:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:13:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:13:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:13:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:13:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:13:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:13:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566714
Sun 19 Jan 2014 07:13:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:13:12 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:13:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:13:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:13:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:13:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:13:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:13:22 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:13:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 07:13:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:13:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:13:24 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:13:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:13:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:13:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:13:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:13:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:13:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:13:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:13:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:13:26 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:13:26 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 07:13:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:13:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:13:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:13:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:13:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:13:27 - job_xml_thread(): Done retrieving: data size 43536205
Sun 19 Jan 2014 07:13:27 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:13:27 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 07:13:27 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 07:13:27 - Housekeeping: done.
Sun 19 Jan 2014 07:13:27 - XML: Start document: iteration 0
Sun 19 Jan 2014 07:13:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43536205
Sun 19 Jan 2014 07:13:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43536205
Sun 19 Jan 2014 07:13:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:13:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:13:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:13:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:13:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:13:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:13:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:13:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:13:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:13:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:13:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:13:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:13:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:13:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:13:45 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:13:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:13:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 07:13:47 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:13:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6099 values 96215 bits 12026 bytes 
Sun 19 Jan 2014 07:13:47 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:13:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 07:13:47 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:13:47 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:13:47 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:13:47 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:13:47 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:13:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:13:52 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:13:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:13:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:13:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:13:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:13:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:13:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:13:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:13:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558247
Sun 19 Jan 2014 07:13:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:13:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558247
Sun 19 Jan 2014 07:13:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:13:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:13:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:14:02 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:14:03 - job_xml_thread(): Done retrieving: data size 43558247
Sun 19 Jan 2014 07:14:03 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:14:03 - XML: Start document: iteration 1
Sun 19 Jan 2014 07:14:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:14:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:14:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:14:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:14:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:14:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:14:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:14:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:14:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:14:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:14:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:14:13 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:14:13 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:14:13 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:14:13 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:14:13 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:14:17 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:14:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 07:14:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:14:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:14:18 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:14:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:14:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:14:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:14:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:14:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:14:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:14:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:14:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576668
Sun 19 Jan 2014 07:14:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:14:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576668
Sun 19 Jan 2014 07:14:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:14:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:14:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:14:28 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:14:28 - job_xml_thread(): Done retrieving: data size 43576668
Sun 19 Jan 2014 07:14:28 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:14:28 - XML: Start document: iteration 2
Sun 19 Jan 2014 07:14:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:14:29 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:14:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:14:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:14:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:14:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:14:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:14:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:14:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:14:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:14:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:14:39 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:14:39 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:14:39 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:14:39 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:14:39 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:14:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:14:42 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:14:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:14:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:14:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:14:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:14:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:14:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:14:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:14:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43550045
Sun 19 Jan 2014 07:14:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:14:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43550045
Sun 19 Jan 2014 07:14:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:14:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:14:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:14:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:14:47 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:14:48 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:14:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:14:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 07:14:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 07:14:48 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:14:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8819 values 139053 bits 17381 bytes 
Sun 19 Jan 2014 07:14:54 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:14:54 - job_xml_thread(): Done retrieving: data size 43550045
Sun 19 Jan 2014 07:14:54 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:14:54 - XML: Start document: iteration 3
Sun 19 Jan 2014 07:14:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:14:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:15:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:15:00 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:15:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:15:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:15:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:15:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:15:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:15:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:15:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:15:07 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:15:07 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:15:07 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:15:07 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:15:07 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:15:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:15:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:15:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:15:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:15:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:15:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:15:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:15:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:15:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:15:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43550569
Sun 19 Jan 2014 07:15:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:15:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43550569
Sun 19 Jan 2014 07:15:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:15:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:15:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:15:22 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:15:22 - job_xml_thread(): Done retrieving: data size 43550569
Sun 19 Jan 2014 07:15:22 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:15:22 - XML: Start document: iteration 4
Sun 19 Jan 2014 07:15:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:15:25 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:15:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:15:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:15:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:15:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:15:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:15:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:15:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:15:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:15:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:15:33 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:15:33 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:15:33 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:15:33 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:15:33 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:15:34 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:15:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 07:15:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:15:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:15:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:15:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:15:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:15:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:15:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:15:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:15:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:15:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:15:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566291
Sun 19 Jan 2014 07:15:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:15:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566291
Sun 19 Jan 2014 07:15:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:15:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:15:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:15:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:15:48 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:15:48 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:15:49 - job_xml_thread(): Done retrieving: data size 43566291
Sun 19 Jan 2014 07:15:49 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:15:49 - XML: Start document: iteration 5
Sun 19 Jan 2014 07:15:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:15:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 07:15:50 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:15:50 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:15:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 07:15:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5922 values 93414 bits 11676 bytes 
Sun 19 Jan 2014 07:15:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:15:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:15:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:15:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:15:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:15:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:15:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:15:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:15:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:15:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:15:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:15:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:15:58 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:15:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:15:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:15:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:15:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:15:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:15:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:16:03 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:16:03 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:16:03 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:16:03 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:16:03 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:16:06 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:16:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 07:16:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:16:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:16:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576105
Sun 19 Jan 2014 07:16:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:16:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576105
Sun 19 Jan 2014 07:16:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:16:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:16:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:16:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:16:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:16:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:16:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:16:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:16:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:16:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:16:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:16:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:16:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:16:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576105
Sun 19 Jan 2014 07:16:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:16:18 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:16:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:16:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:16:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:16:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:16:26 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:16:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:16:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:16:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:16:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:16:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:16:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:16:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:16:29 - job_xml_thread(): Done retrieving: data size 43559081
Sun 19 Jan 2014 07:16:29 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:16:29 - XML: Start document: iteration 6
Sun 19 Jan 2014 07:16:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559081
Sun 19 Jan 2014 07:16:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:16:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:16:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:16:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:16:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:16:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:16:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559081
Sun 19 Jan 2014 07:16:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:16:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:16:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:16:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:16:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:16:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:16:50 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:16:50 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:16:50 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:16:50 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:16:50 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:16:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:16:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:16:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:16:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:16:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:16:51 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:16:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:16:52 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:16:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:16:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:16:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:16:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:16:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 07:16:52 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:16:52 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:16:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:16:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:16:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 07:16:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99253 bits 12406 bytes 
Sun 19 Jan 2014 07:16:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:16:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:16:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:16:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:16:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:16:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:16:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:16:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43594096
Sun 19 Jan 2014 07:16:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:16:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43594096
Sun 19 Jan 2014 07:16:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:17:05 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:17:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:17:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:17:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:17:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:17:07 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:17:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:17:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:17:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:17:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:17:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:17:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:17:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:17:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:17:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:17:11 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:17:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:17:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:17:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:17:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:17:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:17:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:17:12 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:17:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 07:17:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:17:14 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 07:17:14 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 07:17:14 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:17:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:17:14 - job_xml_thread(): Done retrieving: data size 43504883
Sun 19 Jan 2014 07:17:14 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:17:14 - XML: Start document: iteration 7
Sun 19 Jan 2014 07:17:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43504883
Sun 19 Jan 2014 07:17:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43504883
Sun 19 Jan 2014 07:17:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:17:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:17:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:17:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:17:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:17:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:17:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:17:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:17:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:17:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:17:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:17:35 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:17:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:17:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:17:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:17:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:17:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:17:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:17:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:17:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:17:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:17:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:17:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:17:37 - XML: Processed 652600 elements - found 0 jobs
Sun 19 Jan 2014 07:17:37 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:17:38 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:17:38 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:17:38 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:17:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:17:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43019649
Sun 19 Jan 2014 07:17:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:17:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43019649
Sun 19 Jan 2014 07:17:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:17:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:17:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:17:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:17:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:17:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:17:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:17:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:17:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:17:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:17:52 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:17:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:17:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:17:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:17:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:17:52 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:17:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:17:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:17:52 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:17:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 07:17:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:17:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 07:17:52 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:17:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8859 values 140151 bits 17518 bytes 
Sun 19 Jan 2014 07:17:53 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:17:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:17:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:17:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:17:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:17:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:17:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42929955
Sun 19 Jan 2014 07:17:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:17:55 - job_xml_thread(): Done retrieving: data size 42929955
Sun 19 Jan 2014 07:17:55 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:17:55 - XML: Start document: iteration 8
Sun 19 Jan 2014 07:17:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42929955
Sun 19 Jan 2014 07:17:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:18:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:18:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:18:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:18:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:18:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:18:13 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:18:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:18:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:18:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:18:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:18:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:18:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:18:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:18:16 - XML: Processed 645226 elements - found 0 jobs
Sun 19 Jan 2014 07:18:16 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:18:16 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:18:16 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:18:16 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:18:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:18:18 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:18:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:18:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:18:19 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:18:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 07:18:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:18:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:18:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:18:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:18:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:18:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:18:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42986417
Sun 19 Jan 2014 07:18:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:18:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42986417
Sun 19 Jan 2014 07:18:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:18:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:18:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:18:31 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:18:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:18:31 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:18:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:18:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:18:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:18:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:18:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:18:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:18:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:18:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:18:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:18:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:18:34 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:18:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:18:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:18:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:18:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:18:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:18:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:18:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:18:36 - job_xml_thread(): Done retrieving: data size 43000500
Sun 19 Jan 2014 07:18:36 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:18:36 - XML: Start document: iteration 9
Sun 19 Jan 2014 07:18:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43000500
Sun 19 Jan 2014 07:18:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:18:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43000500
Sun 19 Jan 2014 07:18:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:18:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:18:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:18:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:18:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:18:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:18:53 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:18:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:18:54 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:18:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 07:18:54 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:18:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 07:18:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8861 values 139994 bits 17499 bytes 
Sun 19 Jan 2014 07:18:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:18:57 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:18:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:18:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:18:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:18:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:18:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:18:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:18:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:18:59 - XML: Processed 645900 elements - found 0 jobs
Sun 19 Jan 2014 07:18:59 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:18:59 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:18:59 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:18:59 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:19:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:19:00 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:19:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:19:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:19:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:19:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:19:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:19:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:19:02 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:19:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 07:19:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:19:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:19:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582350
Sun 19 Jan 2014 07:19:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:19:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582350
Sun 19 Jan 2014 07:19:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:19:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:19:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:19:14 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:19:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:19:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:19:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:19:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:19:16 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:19:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:19:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:19:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:19:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:19:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:19:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:19:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:19:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:19:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:19:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:19:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:19:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:19:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:19:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:19:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:19:19 - job_xml_thread(): Done retrieving: data size 43583206
Sun 19 Jan 2014 07:19:19 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:19:19 - XML: Start document: iteration 10
Sun 19 Jan 2014 07:19:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583206
Sun 19 Jan 2014 07:19:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:19:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583206
Sun 19 Jan 2014 07:19:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:19:27 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 07:19:27 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:19:28 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:19:28 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 07:19:28 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 07:19:29 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:19:29 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 07:19:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:19:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:19:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:19:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:19:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:19:37 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:19:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:19:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:19:38 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:19:38 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:19:38 - job_xml_thread(): No jobs to store.
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sun 19 Jan 2014 07:19:38 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:19:38 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:19:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:19:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:19:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:19:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:19:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:19:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:19:41 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:19:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:19:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:19:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:19:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:19:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:19:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:19:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:19:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571751
Sun 19 Jan 2014 07:19:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:19:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571751
Sun 19 Jan 2014 07:19:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:19:53 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:19:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:19:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:19:54 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:19:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:19:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:19:54 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:19:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:19:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:19:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:19:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:19:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:19:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:19:56 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:19:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 07:19:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 07:19:56 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:19:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9279 values 146410 bits 18301 bytes 
Sun 19 Jan 2014 07:19:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:19:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:19:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:19:58 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:19:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:19:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:19:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:19:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:19:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:19:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:20:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:20:00 - job_xml_thread(): Done retrieving: data size 43569795
Sun 19 Jan 2014 07:20:00 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:20:00 - XML: Start document: iteration 11
Sun 19 Jan 2014 07:20:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569795
Sun 19 Jan 2014 07:20:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:20:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569795
Sun 19 Jan 2014 07:20:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:20:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:20:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:20:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:20:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:20:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:20:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:20:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:20:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:20:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:20:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:20:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:20:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:20:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:20:18 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:20:18 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:20:18 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:20:18 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:20:18 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:20:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:20:21 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:20:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:20:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:20:21 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:20:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 07:20:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:20:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:20:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:20:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:20:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:20:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:20:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564611
Sun 19 Jan 2014 07:20:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:20:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564611
Sun 19 Jan 2014 07:20:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:20:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:20:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:20:29 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:20:29 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:20:29 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:20:30 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:20:30 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 07:20:30 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 07:20:30 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 07:20:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:20:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:20:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:20:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:20:33 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:20:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:20:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:20:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:20:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:20:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:20:36 - size of cluster 'LISA Cluster': 624 hosts 79468 metrics 850420 values 13424459 bits 1678057 bytes 
Sun 19 Jan 2014 07:20:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:20:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:20:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:20:39 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:20:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:20:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:20:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:20:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:20:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:20:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:20:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:20:42 - job_xml_thread(): Done retrieving: data size 43555021
Sun 19 Jan 2014 07:20:42 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:20:42 - XML: Start document: iteration 12
Sun 19 Jan 2014 07:20:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555021
Sun 19 Jan 2014 07:20:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:20:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555021
Sun 19 Jan 2014 07:20:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:20:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:20:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:20:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:20:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:20:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:20:56 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:20:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:20:57 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:20:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 07:20:57 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:20:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 07:20:59 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8693 values 137094 bits 17136 bytes 
Sun 19 Jan 2014 07:21:01 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:21:01 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:21:01 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:21:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:21:01 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:21:01 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:21:01 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:21:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:21:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:21:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:21:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:21:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:21:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:21:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:21:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:21:05 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:21:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:21:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:21:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:21:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:21:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:21:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:21:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:21:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43586135
Sun 19 Jan 2014 07:21:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:21:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43586135
Sun 19 Jan 2014 07:21:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:21:17 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:21:17 - job_xml_thread(): Done retrieving: data size 43586135
Sun 19 Jan 2014 07:21:17 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:21:17 - XML: Start document: iteration 13
Sun 19 Jan 2014 07:21:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:21:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:21:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:21:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:21:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:21:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:21:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:21:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:21:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:21:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:21:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:21:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:21:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:21:27 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:21:27 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:21:27 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:21:27 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:21:27 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:21:28 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:21:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 07:21:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:21:31 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:21:31 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 07:21:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:21:32 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:21:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:21:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:21:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:21:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:21:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:21:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:21:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:21:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572637
Sun 19 Jan 2014 07:21:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:21:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572637
Sun 19 Jan 2014 07:21:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:21:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:21:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:21:42 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:21:42 - job_xml_thread(): Done retrieving: data size 43572637
Sun 19 Jan 2014 07:21:42 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:21:43 - XML: Start document: iteration 14
Sun 19 Jan 2014 07:21:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:21:45 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:21:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:21:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:21:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:21:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:21:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:21:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:21:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:21:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:21:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:21:52 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:21:52 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:21:52 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:21:52 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:21:52 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:21:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:21:57 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:21:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:21:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:21:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:21:57 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:21:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:21:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:21:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:21:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:21:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:21:58 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:21:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 07:21:58 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:21:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 07:21:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6143 values 96902 bits 12112 bytes 
Sun 19 Jan 2014 07:22:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:22:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555190
Sun 19 Jan 2014 07:22:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:22:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555190
Sun 19 Jan 2014 07:22:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:22:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:22:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:22:07 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:22:07 - job_xml_thread(): Done retrieving: data size 43555190
Sun 19 Jan 2014 07:22:07 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:22:07 - XML: Start document: iteration 15
Sun 19 Jan 2014 07:22:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:22:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:22:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:22:19 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:22:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:22:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:22:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:22:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:22:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:22:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:22:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:22:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:22:21 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:22:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:22:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:22:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:22:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:22:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:22:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:22:24 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:22:24 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:22:24 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:22:24 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:22:24 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:22:25 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:22:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 07:22:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:22:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:22:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569459
Sun 19 Jan 2014 07:22:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:22:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569459
Sun 19 Jan 2014 07:22:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:22:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:22:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:22:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:22:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:22:39 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:22:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:22:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:22:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:22:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:22:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:22:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:22:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:22:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:22:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:22:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:22:42 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:22:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:22:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:22:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:22:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:22:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:22:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:22:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:22:46 - job_xml_thread(): Done retrieving: data size 43577734
Sun 19 Jan 2014 07:22:46 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:22:46 - XML: Start document: iteration 16
Sun 19 Jan 2014 07:22:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577734
Sun 19 Jan 2014 07:22:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577734
Sun 19 Jan 2014 07:22:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:22:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:22:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:22:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:22:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:22:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:22:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:22:58 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:22:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:22:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 07:22:58 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:22:58 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:22:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 07:22:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8158 values 128637 bits 16079 bytes 
Sun 19 Jan 2014 07:23:05 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:23:05 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:23:05 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:23:05 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:23:05 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:23:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:23:06 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:23:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:23:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:23:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:23:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:23:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:23:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:23:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:23:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:23:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:23:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:23:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:23:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:23:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:23:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:23:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:23:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:23:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43508238
Sun 19 Jan 2014 07:23:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:23:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43508238
Sun 19 Jan 2014 07:23:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:23:20 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:23:20 - job_xml_thread(): Done retrieving: data size 43508238
Sun 19 Jan 2014 07:23:20 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:23:20 - XML: Start document: iteration 17
Sun 19 Jan 2014 07:23:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:23:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:23:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:23:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:23:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:23:27 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:23:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:23:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:23:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:23:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:23:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:23:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:23:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:23:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:23:31 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:23:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:23:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:23:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:23:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:23:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:23:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:23:35 - XML: Processed 652600 elements - found 0 jobs
Sun 19 Jan 2014 07:23:35 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:23:35 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:23:35 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:23:35 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:23:36 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:23:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 07:23:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:23:36 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 07:23:36 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 07:23:36 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:23:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:23:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43102616
Sun 19 Jan 2014 07:23:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:23:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43102616
Sun 19 Jan 2014 07:23:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:23:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:23:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:23:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:23:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:23:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:23:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:23:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:23:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:23:50 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:23:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:23:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:23:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:23:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:23:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:23:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:23:52 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:23:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:23:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:23:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:23:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:23:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:23:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:23:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:23:54 - job_xml_thread(): Done retrieving: data size 42922290
Sun 19 Jan 2014 07:23:54 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:23:54 - XML: Start document: iteration 18
Sun 19 Jan 2014 07:23:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42922290
Sun 19 Jan 2014 07:23:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:23:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42922290
Sun 19 Jan 2014 07:23:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:23:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:23:59 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:24:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:24:00 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:24:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 07:24:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 07:24:00 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:24:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8388 values 132221 bits 16527 bytes 
Sun 19 Jan 2014 07:24:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:24:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:24:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:24:06 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:24:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:24:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:24:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:24:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:24:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:24:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:24:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:24:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:24:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:24:11 - XML: Processed 645249 elements - found 0 jobs
Sun 19 Jan 2014 07:24:11 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:24:11 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:24:11 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:24:11 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:24:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:24:16 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:24:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:24:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:24:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:24:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:24:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:24:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:24:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:24:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42963724
Sun 19 Jan 2014 07:24:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:24:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42963724
Sun 19 Jan 2014 07:24:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:24:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:24:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:24:27 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:24:27 - job_xml_thread(): Done retrieving: data size 42963724
Sun 19 Jan 2014 07:24:27 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:24:27 - XML: Start document: iteration 19
Sun 19 Jan 2014 07:24:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:24:27 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:24:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:24:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:24:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:24:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:24:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:24:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:24:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:24:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:24:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:24:37 - XML: Processed 645826 elements - found 0 jobs
Sun 19 Jan 2014 07:24:37 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:24:37 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:24:37 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:24:37 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:24:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:24:39 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:24:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:24:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:24:39 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:24:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 07:24:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:24:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:24:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:24:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:24:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:24:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:24:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43453028
Sun 19 Jan 2014 07:24:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:24:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43453028
Sun 19 Jan 2014 07:24:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:24:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:24:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:24:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:24:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:24:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:24:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:24:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:24:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:24:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:24:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:24:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:24:52 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:24:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:24:53 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:24:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:24:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:24:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:24:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:24:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:24:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:24:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:24:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565993
Sun 19 Jan 2014 07:24:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:24:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565993
Sun 19 Jan 2014 07:24:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:24:55 - job_xml_thread(): Done retrieving: data size 43565993
Sun 19 Jan 2014 07:24:56 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:24:56 - XML: Start document: iteration 20
Sun 19 Jan 2014 07:25:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:25:01 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:25:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:25:04 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:25:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 07:25:05 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:25:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 07:25:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:25:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:25:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8821 values 139027 bits 17378 bytes 
Sun 19 Jan 2014 07:25:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:25:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:25:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:25:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:25:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:25:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:25:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:25:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:25:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:25:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:25:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:25:14 - XML: Processed 653208 elements - found 0 jobs
Sun 19 Jan 2014 07:25:14 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:25:14 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:25:14 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:25:14 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:25:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:25:16 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:25:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:25:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:25:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:25:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:25:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:25:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:25:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:25:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43585722
Sun 19 Jan 2014 07:25:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:25:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43585722
Sun 19 Jan 2014 07:25:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:25:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:25:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:25:29 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:25:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:25:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:25:31 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:25:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:25:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:25:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:25:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:25:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:25:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:25:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:25:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:25:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:25:35 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:25:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:25:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:25:35 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:25:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 07:25:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:25:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:25:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:25:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:25:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:25:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:25:36 - job_xml_thread(): Done retrieving: data size 43586502
Sun 19 Jan 2014 07:25:36 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:25:36 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 07:25:36 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 07:25:36 - Housekeeping: done.
Sun 19 Jan 2014 07:25:36 - XML: Start document: iteration 0
Sun 19 Jan 2014 07:25:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43586502
Sun 19 Jan 2014 07:25:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:25:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43586502
Sun 19 Jan 2014 07:25:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:25:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:25:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:25:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:25:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:25:52 - XML: Processed 653347 elements - found 0 jobs
Sun 19 Jan 2014 07:25:52 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:25:52 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:25:52 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:25:52 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:25:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:25:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:25:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:25:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:25:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:25:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:25:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:25:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:25:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:25:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:25:59 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:25:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:25:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:25:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:25:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:25:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:25:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:26:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:26:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576305
Sun 19 Jan 2014 07:26:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:26:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576305
Sun 19 Jan 2014 07:26:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:26:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:26:07 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:26:07 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:26:08 - job_xml_thread(): Done retrieving: data size 43576305
Sun 19 Jan 2014 07:26:08 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:26:08 - XML: Start document: iteration 1
Sun 19 Jan 2014 07:26:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:26:08 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:26:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 07:26:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 07:26:09 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:26:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:26:10 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:26:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8807 values 138861 bits 17357 bytes 
Sun 19 Jan 2014 07:26:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:26:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:26:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:26:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:26:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:26:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:26:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:26:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:26:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:26:20 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:26:20 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:26:20 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:26:20 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:26:20 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:26:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:26:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:26:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:26:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:26:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:26:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:26:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:26:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:26:25 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:26:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 07:26:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:26:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:26:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43547511
Sun 19 Jan 2014 07:26:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:26:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43547511
Sun 19 Jan 2014 07:26:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:26:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:26:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:26:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:26:35 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:26:35 - job_xml_thread(): Done retrieving: data size 43547511
Sun 19 Jan 2014 07:26:35 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:26:35 - XML: Start document: iteration 2
Sun 19 Jan 2014 07:26:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:26:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:26:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:26:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:26:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:26:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:26:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:26:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:26:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:26:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:26:47 - XML: Processed 653349 elements - found 0 jobs
Sun 19 Jan 2014 07:26:47 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:26:47 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:26:47 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:26:47 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:26:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:26:47 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:26:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:26:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:26:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:26:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:26:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:26:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:26:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:26:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566643
Sun 19 Jan 2014 07:26:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:26:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566643
Sun 19 Jan 2014 07:26:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:26:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:26:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:27:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:27:01 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:27:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:27:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:27:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:27:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:27:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:27:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:27:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:27:02 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:27:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:27:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:27:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:27:03 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:27:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:27:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:27:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:27:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:27:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:27:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:27:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:27:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43603808
Sun 19 Jan 2014 07:27:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:27:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43603808
Sun 19 Jan 2014 07:27:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:27:05 - job_xml_thread(): Done retrieving: data size 43603808
Sun 19 Jan 2014 07:27:05 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:27:05 - XML: Start document: iteration 3
Sun 19 Jan 2014 07:27:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:27:08 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:27:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:27:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 07:27:09 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:27:09 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:27:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 07:27:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148557 bits 18569 bytes 
Sun 19 Jan 2014 07:27:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:27:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:27:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:27:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:27:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:27:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:27:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:27:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:27:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:27:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:27:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:27:24 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:27:24 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:27:24 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:27:24 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:27:24 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:27:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:27:29 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:27:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:27:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:27:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:27:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:27:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:27:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:27:31 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 07:27:31 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:27:31 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:27:31 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 07:27:31 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 07:27:31 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:27:31 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 07:27:32 - size of cluster 'LISA Cluster': 624 hosts 79470 metrics 906701 values 14287756 bits 1785969 bytes 
Sun 19 Jan 2014 07:27:32 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:27:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 07:27:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:27:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:27:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554217
Sun 19 Jan 2014 07:27:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:27:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554217
Sun 19 Jan 2014 07:27:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:27:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:27:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:27:40 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:27:40 - job_xml_thread(): Done retrieving: data size 43554217
Sun 19 Jan 2014 07:27:40 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:27:40 - XML: Start document: iteration 4
Sun 19 Jan 2014 07:27:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:27:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:27:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:27:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:27:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:27:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:27:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554217
Sun 19 Jan 2014 07:27:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:27:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:27:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:27:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:27:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:27:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:27:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:27:54 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:27:54 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:27:54 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:27:54 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:27:54 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:27:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:27:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:27:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:27:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:27:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:27:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:27:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:27:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:27:58 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:27:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:27:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:27:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:27:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:27:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:27:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:28:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:28:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43590148
Sun 19 Jan 2014 07:28:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:28:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43590148
Sun 19 Jan 2014 07:28:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:28:09 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:28:09 - job_xml_thread(): Done retrieving: data size 43590148
Sun 19 Jan 2014 07:28:09 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:28:09 - XML: Start document: iteration 5
Sun 19 Jan 2014 07:28:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:28:10 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:28:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:28:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:28:11 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:28:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:28:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 07:28:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 07:28:12 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:28:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99046 bits 12380 bytes 
Sun 19 Jan 2014 07:28:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:28:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:28:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:28:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:28:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:28:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:28:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:28:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:28:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:28:24 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:28:24 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:28:24 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:28:24 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:28:24 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:28:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:28:26 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:28:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:28:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:28:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:28:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:28:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:28:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:28:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:28:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43546722
Sun 19 Jan 2014 07:28:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:28:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43546722
Sun 19 Jan 2014 07:28:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:28:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:28:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:28:31 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:28:31 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 07:28:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:28:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:28:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:28:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:28:39 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:28:39 - job_xml_thread(): Done retrieving: data size 43546722
Sun 19 Jan 2014 07:28:39 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:28:39 - XML: Start document: iteration 6
Sun 19 Jan 2014 07:28:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:28:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:28:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:28:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:28:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:28:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:28:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:28:51 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:28:51 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:28:51 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:28:51 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:28:51 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:28:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:28:52 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:28:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:28:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:28:52 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:28:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 07:28:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:28:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:28:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:28:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:28:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:28:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:28:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:28:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:28:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43546148
Sun 19 Jan 2014 07:28:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:28:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43546148
Sun 19 Jan 2014 07:28:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:29:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:29:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:29:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:29:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:29:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:29:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:29:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:29:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:29:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:29:06 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:29:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:29:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:29:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:29:11 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:29:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:29:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:29:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:29:12 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:29:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:29:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:29:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:29:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:29:12 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:29:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 07:29:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:29:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 07:29:12 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:29:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5538 values 87289 bits 10911 bytes 
Sun 19 Jan 2014 07:29:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:29:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43501423
Sun 19 Jan 2014 07:29:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:29:15 - job_xml_thread(): Done retrieving: data size 43501423
Sun 19 Jan 2014 07:29:15 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:29:15 - XML: Start document: iteration 7
Sun 19 Jan 2014 07:29:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43501423
Sun 19 Jan 2014 07:29:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:29:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:29:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:29:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:29:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:29:28 - XML: Processed 652600 elements - found 0 jobs
Sun 19 Jan 2014 07:29:28 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:29:28 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:29:28 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:29:28 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:29:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:29:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:29:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:29:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:29:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:29:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:29:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:29:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:29:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:29:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:29:39 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:29:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:29:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:29:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:29:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:29:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:29:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:29:40 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:29:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 07:29:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:29:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:29:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43009142
Sun 19 Jan 2014 07:29:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:29:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43009142
Sun 19 Jan 2014 07:29:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:29:43 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:29:43 - job_xml_thread(): Done retrieving: data size 43009142
Sun 19 Jan 2014 07:29:43 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:29:43 - XML: Start document: iteration 8
Sun 19 Jan 2014 07:29:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:29:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:29:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:29:54 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:29:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:29:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:29:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:29:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:29:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:29:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:29:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:29:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:29:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:29:59 - XML: Processed 646460 elements - found 0 jobs
Sun 19 Jan 2014 07:29:59 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:29:59 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:29:59 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:29:59 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:30:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:30:03 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:30:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:30:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:30:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:30:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:30:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:30:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:30:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:30:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42930753
Sun 19 Jan 2014 07:30:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:30:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42930753
Sun 19 Jan 2014 07:30:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:30:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:30:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:30:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:30:13 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:30:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:30:13 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:30:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 07:30:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 07:30:13 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:30:14 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:30:14 - job_xml_thread(): Done retrieving: data size 42930753
Sun 19 Jan 2014 07:30:14 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:30:14 - XML: Start document: iteration 9
Sun 19 Jan 2014 07:30:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7547 values 118937 bits 14867 bytes 
Sun 19 Jan 2014 07:30:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:30:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:30:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:30:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:30:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:30:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:30:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:30:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:30:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:30:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:30:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:30:27 - XML: Processed 645522 elements - found 0 jobs
Sun 19 Jan 2014 07:30:27 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:30:27 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:30:27 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:30:27 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:30:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:30:29 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:30:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:30:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:30:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:30:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:30:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:30:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:30:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:30:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42967685
Sun 19 Jan 2014 07:30:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:30:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42967685
Sun 19 Jan 2014 07:30:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:30:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:30:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:30:42 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:30:42 - job_xml_thread(): Done retrieving: data size 42967685
Sun 19 Jan 2014 07:30:42 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:30:42 - XML: Start document: iteration 10
Sun 19 Jan 2014 07:30:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:30:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:30:48 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:30:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 07:30:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:30:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:30:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:30:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:30:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:30:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:30:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:30:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:30:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:30:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:30:56 - XML: Processed 645900 elements - found 0 jobs
Sun 19 Jan 2014 07:30:56 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:30:56 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:30:56 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:30:56 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:30:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:30:58 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:30:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:30:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:30:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:30:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:30:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:30:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:31:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:31:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43552839
Sun 19 Jan 2014 07:31:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:31:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43552839
Sun 19 Jan 2014 07:31:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:31:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:31:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:31:12 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:31:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:31:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:31:13 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:31:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:31:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:31:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:31:13 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:31:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:31:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:31:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:31:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:31:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:31:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:31:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:31:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 07:31:14 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:31:14 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:31:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 07:31:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5913 values 93304 bits 11663 bytes 
Sun 19 Jan 2014 07:31:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:31:15 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:31:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:31:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:31:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:31:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:31:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:31:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:31:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:31:18 - job_xml_thread(): Done retrieving: data size 43583462
Sun 19 Jan 2014 07:31:18 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:31:18 - XML: Start document: iteration 11
Sun 19 Jan 2014 07:31:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583462
Sun 19 Jan 2014 07:31:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:31:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583462
Sun 19 Jan 2014 07:31:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:31:27 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:31:27 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:31:27 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:31:27 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:31:27 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:31:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:31:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:31:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:31:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:31:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:31:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:31:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:31:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:31:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:31:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:31:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:31:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:31:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:31:37 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:31:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 07:31:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:31:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:31:39 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:31:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:31:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:31:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:31:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:31:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:31:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:31:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:31:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558352
Sun 19 Jan 2014 07:31:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:31:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558352
Sun 19 Jan 2014 07:31:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:31:42 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:31:42 - job_xml_thread(): Done retrieving: data size 43558352
Sun 19 Jan 2014 07:31:42 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:31:42 - XML: Start document: iteration 12
Sun 19 Jan 2014 07:31:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:31:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:31:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:31:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:31:54 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:31:54 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:31:54 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:31:54 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:31:54 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:32:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:32:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:32:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:32:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:32:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:32:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:32:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:32:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:32:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:32:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:32:04 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:32:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:32:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:32:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:32:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:32:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:32:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:32:05 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 07:32:05 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 07:32:05 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:32:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:32:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581152
Sun 19 Jan 2014 07:32:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:32:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581152
Sun 19 Jan 2014 07:32:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:32:09 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:32:09 - job_xml_thread(): Done retrieving: data size 43581152
Sun 19 Jan 2014 07:32:09 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:32:09 - XML: Start document: iteration 13
Sun 19 Jan 2014 07:32:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:32:15 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:32:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:32:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:32:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:32:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 07:32:18 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:32:19 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:32:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 07:32:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8743 values 138135 bits 17266 bytes 
Sun 19 Jan 2014 07:32:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:32:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:32:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:32:22 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:32:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:32:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:32:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:32:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:32:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:32:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:32:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:32:23 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:32:23 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:32:23 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:32:23 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:32:23 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:32:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:32:28 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:32:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:32:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:32:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:32:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:32:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:32:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:32:30 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:32:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 07:32:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:32:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:32:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579992
Sun 19 Jan 2014 07:32:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:32:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579992
Sun 19 Jan 2014 07:32:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:32:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:32:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:32:38 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:32:38 - job_xml_thread(): Done retrieving: data size 43579992
Sun 19 Jan 2014 07:32:38 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:32:38 - XML: Start document: iteration 14
Sun 19 Jan 2014 07:32:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:32:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:32:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:32:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:32:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:32:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:32:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:32:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:32:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:32:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:32:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:32:49 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:32:49 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:32:49 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:32:49 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:32:49 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:32:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:32:52 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:32:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:32:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:32:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:32:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:32:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:32:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:32:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:32:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43548772
Sun 19 Jan 2014 07:32:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:32:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43548772
Sun 19 Jan 2014 07:32:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:32:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:32:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:33:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:33:03 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:33:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:33:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:33:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:33:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:33:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:33:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:33:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:33:04 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:33:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:33:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:33:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:33:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:33:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:33:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:33:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:33:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:33:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:33:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:33:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:33:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582325
Sun 19 Jan 2014 07:33:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:33:09 - job_xml_thread(): Done retrieving: data size 43582325
Sun 19 Jan 2014 07:33:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582325
Sun 19 Jan 2014 07:33:09 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:33:09 - XML: Start document: iteration 15
Sun 19 Jan 2014 07:33:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:33:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:33:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:33:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:33:21 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:33:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:33:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:33:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 07:33:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:33:23 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:33:23 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:33:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:33:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 07:33:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:33:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 149016 bits 18627 bytes 
Sun 19 Jan 2014 07:33:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:33:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:33:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:33:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:33:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:33:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:33:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:33:27 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:33:27 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:33:27 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:33:27 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:33:27 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:33:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:33:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:33:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:33:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:33:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:33:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:33:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:33:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:33:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:33:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563160
Sun 19 Jan 2014 07:33:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:33:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563160
Sun 19 Jan 2014 07:33:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:33:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:33:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:33:42 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:33:42 - job_xml_thread(): Done retrieving: data size 43563160
Sun 19 Jan 2014 07:33:42 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:33:42 - XML: Start document: iteration 16
Sun 19 Jan 2014 07:33:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:33:47 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:33:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:33:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:33:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:33:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:33:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:33:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:33:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:33:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:33:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:33:56 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:33:56 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:33:56 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:33:56 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:33:56 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:33:57 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:33:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 07:33:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:33:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:33:59 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:33:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:33:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:34:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:34:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:34:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:34:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:34:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:34:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564148
Sun 19 Jan 2014 07:34:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:34:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564148
Sun 19 Jan 2014 07:34:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:34:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:34:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:34:11 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:34:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:34:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:34:14 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:34:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:34:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:34:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:34:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:34:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:34:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:34:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:34:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:34:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:34:16 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:34:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:34:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:34:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:34:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:34:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:34:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:34:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:34:18 - job_xml_thread(): Done retrieving: data size 43584305
Sun 19 Jan 2014 07:34:18 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:34:18 - XML: Start document: iteration 17
Sun 19 Jan 2014 07:34:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584305
Sun 19 Jan 2014 07:34:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:34:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584305
Sun 19 Jan 2014 07:34:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:34:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:34:24 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:34:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:34:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 07:34:25 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:34:25 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:34:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 07:34:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9043 values 142713 bits 17839 bytes 
Sun 19 Jan 2014 07:34:30 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:34:30 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:34:30 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:34:30 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:34:30 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:34:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:34:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:34:31 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 07:34:31 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:34:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:34:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:34:32 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:34:32 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 07:34:32 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 07:34:32 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:34:32 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 07:34:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:34:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:34:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:34:42 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:34:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:34:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:34:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:34:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:34:42 - size of cluster 'LISA Cluster': 624 hosts 79482 metrics 832514 values 13141445 bits 1642680 bytes 
Sun 19 Jan 2014 07:34:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:34:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:34:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:34:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:34:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:34:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:34:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:34:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:34:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:34:45 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:34:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:34:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43599951
Sun 19 Jan 2014 07:34:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:34:47 - job_xml_thread(): Done retrieving: data size 43599951
Sun 19 Jan 2014 07:34:47 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:34:47 - XML: Start document: iteration 18
Sun 19 Jan 2014 07:34:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43599951
Sun 19 Jan 2014 07:34:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:34:57 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:34:57 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:34:57 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:34:57 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:34:57 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:34:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:34:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:34:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:34:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:35:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:35:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:35:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:35:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:35:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:35:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:35:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:35:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:35:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:35:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:35:07 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:35:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:35:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:35:07 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:35:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 07:35:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:35:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:35:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:35:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:35:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:35:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:35:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564200
Sun 19 Jan 2014 07:35:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:35:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564200
Sun 19 Jan 2014 07:35:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:35:12 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:35:12 - job_xml_thread(): Done retrieving: data size 43564200
Sun 19 Jan 2014 07:35:13 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:35:13 - XML: Start document: iteration 19
Sun 19 Jan 2014 07:35:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:35:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:35:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:35:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:35:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:35:27 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:35:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:35:28 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:35:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 07:35:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 07:35:28 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:35:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6018 values 94981 bits 11872 bytes 
Sun 19 Jan 2014 07:35:30 - XML: Processed 653150 elements - found 0 jobs
Sun 19 Jan 2014 07:35:30 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:35:30 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:35:30 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:35:30 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:35:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:35:31 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:35:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:35:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:35:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:35:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:35:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:35:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:35:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:35:32 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:35:32 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 07:35:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:35:35 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:35:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:35:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:35:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:35:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:35:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:35:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:35:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:35:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43017225
Sun 19 Jan 2014 07:35:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:35:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43017225
Sun 19 Jan 2014 07:35:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:35:46 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:35:46 - job_xml_thread(): Done retrieving: data size 43017225
Sun 19 Jan 2014 07:35:46 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:35:46 - XML: Start document: iteration 20
Sun 19 Jan 2014 07:35:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:35:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:35:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:35:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:35:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:35:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:35:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:35:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:35:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:35:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:35:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:35:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:35:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:36:03 - XML: Processed 646478 elements - found 0 jobs
Sun 19 Jan 2014 07:36:03 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:36:03 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:36:03 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:36:03 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:36:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:36:03 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:36:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:36:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:36:03 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:36:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 07:36:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:36:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:36:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:36:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:36:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:36:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:36:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42897201
Sun 19 Jan 2014 07:36:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:36:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42897201
Sun 19 Jan 2014 07:36:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:36:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:36:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:36:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:36:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:36:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:36:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:36:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:36:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:36:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:36:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:36:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:36:18 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:36:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:36:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:36:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:36:20 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:36:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:36:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:36:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:36:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:36:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:36:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:36:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:36:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42980940
Sun 19 Jan 2014 07:36:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:36:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42980940
Sun 19 Jan 2014 07:36:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:36:24 - job_xml_thread(): Done retrieving: data size 42980940
Sun 19 Jan 2014 07:36:24 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:36:24 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 07:36:24 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 07:36:24 - Housekeeping: done.
Sun 19 Jan 2014 07:36:24 - XML: Start document: iteration 0
Sun 19 Jan 2014 07:36:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:36:28 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:36:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:36:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 07:36:29 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:36:29 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:36:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 07:36:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8786 values 138597 bits 17324 bytes 
Sun 19 Jan 2014 07:36:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:36:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:36:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:36:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:36:42 - XML: Processed 645900 elements - found 0 jobs
Sun 19 Jan 2014 07:36:42 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:36:42 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:36:42 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:36:42 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:36:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:36:43 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:36:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:36:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:36:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:36:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:36:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:36:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:36:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:36:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:36:48 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:36:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:36:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:36:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:36:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:36:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:36:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:36:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:36:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43537477
Sun 19 Jan 2014 07:36:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:36:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43537477
Sun 19 Jan 2014 07:36:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:36:57 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:36:57 - job_xml_thread(): Done retrieving: data size 43537477
Sun 19 Jan 2014 07:36:57 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:36:57 - XML: Start document: iteration 1
Sun 19 Jan 2014 07:36:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:36:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:37:02 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:37:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 07:37:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:37:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:37:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:37:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:37:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:37:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:37:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:37:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:37:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:37:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:37:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:37:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:37:10 - XML: Processed 652966 elements - found 0 jobs
Sun 19 Jan 2014 07:37:10 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:37:10 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:37:10 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:37:10 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:37:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:37:15 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:37:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:37:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:37:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:37:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:37:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:37:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:37:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:37:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572119
Sun 19 Jan 2014 07:37:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:37:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572119
Sun 19 Jan 2014 07:37:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:37:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:37:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:37:25 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:37:25 - job_xml_thread(): Done retrieving: data size 43572119
Sun 19 Jan 2014 07:37:25 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:37:25 - XML: Start document: iteration 2
Sun 19 Jan 2014 07:37:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:37:29 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:37:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:37:30 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:37:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 07:37:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 07:37:30 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:37:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:37:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:37:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6156 values 97114 bits 12139 bytes 
Sun 19 Jan 2014 07:37:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:37:31 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:37:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:37:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:37:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:37:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:37:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:37:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:37:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:37:38 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:37:38 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:37:38 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:37:38 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:37:38 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:37:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:37:42 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:37:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:37:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:37:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:37:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:37:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:37:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:37:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:37:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566081
Sun 19 Jan 2014 07:37:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:37:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566081
Sun 19 Jan 2014 07:37:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:37:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:37:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:37:53 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:37:53 - job_xml_thread(): Done retrieving: data size 43566081
Sun 19 Jan 2014 07:37:53 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:37:53 - XML: Start document: iteration 3
Sun 19 Jan 2014 07:37:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:37:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:38:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:38:03 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:38:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:38:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:38:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:38:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:38:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:38:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:38:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:38:05 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:38:05 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:38:05 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:38:05 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:38:05 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:38:07 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:38:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 07:38:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:38:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:38:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:38:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:38:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:38:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:38:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:38:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:38:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:38:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:38:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576723
Sun 19 Jan 2014 07:38:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:38:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576723
Sun 19 Jan 2014 07:38:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:38:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:38:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:38:21 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:38:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:38:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:38:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:38:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:38:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:38:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:38:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:38:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:38:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:38:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:38:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:38:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:38:26 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:38:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:38:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:38:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:38:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:38:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:38:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:38:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:38:29 - job_xml_thread(): Done retrieving: data size 43582611
Sun 19 Jan 2014 07:38:29 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:38:29 - XML: Start document: iteration 4
Sun 19 Jan 2014 07:38:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582611
Sun 19 Jan 2014 07:38:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:38:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582611
Sun 19 Jan 2014 07:38:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:38:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:38:30 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:38:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:38:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 07:38:32 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:38:32 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:38:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 07:38:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9049 values 142788 bits 17848 bytes 
Sun 19 Jan 2014 07:38:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:38:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:38:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:38:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:38:49 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:38:49 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:38:49 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:38:49 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:38:49 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:38:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:38:51 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:38:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:38:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:38:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:38:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:38:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:38:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:38:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:38:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:38:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:38:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:38:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:38:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:38:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:38:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:38:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:38:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:38:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43597222
Sun 19 Jan 2014 07:38:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:38:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43597222
Sun 19 Jan 2014 07:38:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:39:04 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:39:04 - job_xml_thread(): Done retrieving: data size 43597222
Sun 19 Jan 2014 07:39:04 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:39:04 - XML: Start document: iteration 5
Sun 19 Jan 2014 07:39:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:39:04 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:39:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:39:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:39:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:39:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:39:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:39:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:39:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:39:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:39:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:39:08 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:39:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 07:39:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:39:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:39:15 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:39:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:39:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:39:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:39:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:39:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:39:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:39:19 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:39:19 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:39:19 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:39:19 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:39:19 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:39:22 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 07:39:22 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 07:39:22 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:39:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:39:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43544772
Sun 19 Jan 2014 07:39:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:39:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43544772
Sun 19 Jan 2014 07:39:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:39:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:39:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:39:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:39:31 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:39:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:39:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:39:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:39:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:39:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:39:32 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:39:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:39:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:39:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:39:33 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:39:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:39:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:39:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 07:39:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:39:33 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:39:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 07:39:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6132 values 96714 bits 12089 bytes 
Sun 19 Jan 2014 07:39:34 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:39:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:39:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:39:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:39:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:39:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:39:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:39:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:39:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:39:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:39:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574123
Sun 19 Jan 2014 07:39:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:39:39 - job_xml_thread(): Done retrieving: data size 43574123
Sun 19 Jan 2014 07:39:39 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:39:39 - XML: Start document: iteration 6
Sun 19 Jan 2014 07:39:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574123
Sun 19 Jan 2014 07:39:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:39:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:39:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:39:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:39:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:39:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:39:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:39:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:39:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:39:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:39:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:39:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:39:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:39:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:39:57 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:39:57 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:39:57 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:39:57 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:39:57 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:40:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:40:01 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:40:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:40:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:40:02 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:40:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 07:40:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:40:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:40:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:40:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:40:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:40:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:40:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578663
Sun 19 Jan 2014 07:40:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:40:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578663
Sun 19 Jan 2014 07:40:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:40:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:40:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:40:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:40:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:40:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:40:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:40:12 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:40:12 - job_xml_thread(): Done retrieving: data size 43578663
Sun 19 Jan 2014 07:40:12 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:40:12 - XML: Start document: iteration 7
Sun 19 Jan 2014 07:40:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:40:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:40:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578663
Sun 19 Jan 2014 07:40:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:40:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:40:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:40:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:40:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:40:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:40:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:40:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:40:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:40:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:40:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:40:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:40:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:40:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:40:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:40:31 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:40:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:40:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:40:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:40:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:40:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:40:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:40:32 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:40:32 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:40:32 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:40:32 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:40:32 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:40:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:40:33 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:40:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:40:33 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:40:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 07:40:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 07:40:33 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:40:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5624 values 88646 bits 11080 bytes 
Sun 19 Jan 2014 07:40:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:40:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581553
Sun 19 Jan 2014 07:40:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:40:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581553
Sun 19 Jan 2014 07:40:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:40:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:40:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:40:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:40:46 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:40:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:40:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:40:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:40:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:40:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:40:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:40:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:40:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:40:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:40:47 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:40:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:40:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:40:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:40:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:40:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:40:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:40:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:40:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:40:51 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:40:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 07:40:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:40:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:40:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575051
Sun 19 Jan 2014 07:40:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:40:52 - job_xml_thread(): Done retrieving: data size 43575051
Sun 19 Jan 2014 07:40:52 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:40:52 - XML: Start document: iteration 8
Sun 19 Jan 2014 07:40:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575051
Sun 19 Jan 2014 07:40:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:41:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:41:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:41:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:41:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:41:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:41:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:41:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:41:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:41:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:41:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:41:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:41:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:41:14 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:41:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:41:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:41:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:41:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:41:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:41:15 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:41:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:41:15 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:41:15 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:41:15 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:41:15 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:41:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:41:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43504842
Sun 19 Jan 2014 07:41:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:41:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43504842
Sun 19 Jan 2014 07:41:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:41:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:41:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:41:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:41:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:41:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:41:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:41:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:41:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:41:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:41:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:41:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:41:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:41:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:41:30 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:41:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:41:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:41:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:41:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:41:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:41:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:41:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:41:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:41:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:41:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43134733
Sun 19 Jan 2014 07:41:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:41:32 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 07:41:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43134733
Sun 19 Jan 2014 07:41:33 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:41:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:41:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:41:33 - job_xml_thread(): Done retrieving: data size 43134733
Sun 19 Jan 2014 07:41:33 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:41:33 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:41:33 - XML: Start document: iteration 9
Sun 19 Jan 2014 07:41:34 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:41:34 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 07:41:34 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:41:34 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 07:41:34 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 07:41:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:41:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 07:41:35 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:41:35 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:41:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 07:41:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8826 values 139235 bits 17404 bytes 
Sun 19 Jan 2014 07:41:36 - size of cluster 'LISA Cluster': 624 hosts 79461 metrics 716840 values 11298356 bits 1412294 bytes 
Sun 19 Jan 2014 07:41:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:41:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:41:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:41:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:41:50 - XML: Processed 647724 elements - found 0 jobs
Sun 19 Jan 2014 07:41:50 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:41:50 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:41:50 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:41:50 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:41:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:41:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:41:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:41:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:41:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:41:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:41:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:41:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:41:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:41:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:41:55 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:41:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:41:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:41:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:41:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:41:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:41:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:41:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:41:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42916085
Sun 19 Jan 2014 07:41:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:41:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42916085
Sun 19 Jan 2014 07:41:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:42:05 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:42:05 - job_xml_thread(): Done retrieving: data size 42916085
Sun 19 Jan 2014 07:42:05 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:42:05 - XML: Start document: iteration 10
Sun 19 Jan 2014 07:42:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:42:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:42:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:42:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:42:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:42:18 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:42:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:42:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:42:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:42:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:42:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:42:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:42:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:42:22 - XML: Processed 645202 elements - found 0 jobs
Sun 19 Jan 2014 07:42:22 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:42:22 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:42:22 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:42:22 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:42:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:42:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:42:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:42:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:42:23 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:42:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 07:42:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:42:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:42:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:42:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:42:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:42:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:42:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42980243
Sun 19 Jan 2014 07:42:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:42:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42980243
Sun 19 Jan 2014 07:42:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:42:34 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:42:34 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 07:42:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:42:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:42:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:42:35 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:42:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:42:35 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:42:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 07:42:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 07:42:35 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:42:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5709 values 90024 bits 11253 bytes 
Sun 19 Jan 2014 07:42:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:42:37 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:42:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:42:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:42:37 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:42:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:42:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:42:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:42:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:42:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:42:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:42:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:42:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:42:40 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:42:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:42:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:42:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:42:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:42:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:42:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:42:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:42:44 - job_xml_thread(): Done retrieving: data size 43489718
Sun 19 Jan 2014 07:42:44 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:42:44 - XML: Start document: iteration 11
Sun 19 Jan 2014 07:42:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43489718
Sun 19 Jan 2014 07:42:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:42:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43489718
Sun 19 Jan 2014 07:42:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:42:48 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:42:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 07:42:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:42:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:42:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:42:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:42:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:42:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:42:59 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:42:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:42:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:43:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:43:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:43:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:43:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:43:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:43:04 - XML: Processed 652252 elements - found 0 jobs
Sun 19 Jan 2014 07:43:04 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:43:04 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:43:04 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:43:04 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:43:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:43:07 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:43:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:43:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:43:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:43:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:43:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:43:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:43:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:43:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561207
Sun 19 Jan 2014 07:43:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:43:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561207
Sun 19 Jan 2014 07:43:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:43:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:43:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:43:19 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:43:19 - job_xml_thread(): Done retrieving: data size 43561207
Sun 19 Jan 2014 07:43:19 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:43:19 - XML: Start document: iteration 12
Sun 19 Jan 2014 07:43:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:43:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:43:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:43:28 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:43:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:43:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:43:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:43:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:43:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:43:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:43:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:43:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:43:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:43:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:43:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:43:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:43:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:43:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:43:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:43:34 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:43:34 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:43:34 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:43:34 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:43:34 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:43:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:43:35 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:43:36 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:43:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 07:43:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:43:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 07:43:36 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:43:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99082 bits 12385 bytes 
Sun 19 Jan 2014 07:43:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:43:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557101
Sun 19 Jan 2014 07:43:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:43:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557101
Sun 19 Jan 2014 07:43:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:43:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:43:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:43:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:43:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:43:49 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:43:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:43:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:43:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:43:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:43:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:43:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:43:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:43:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:43:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:43:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:43:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:43:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:43:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:43:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:43:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:43:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:43:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:43:56 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:43:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 07:43:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:43:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:43:57 - job_xml_thread(): Done retrieving: data size 43570421
Sun 19 Jan 2014 07:43:57 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:43:57 - XML: Start document: iteration 13
Sun 19 Jan 2014 07:43:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570421
Sun 19 Jan 2014 07:43:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:43:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570421
Sun 19 Jan 2014 07:43:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:44:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:44:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:44:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:44:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:44:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:44:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:44:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:44:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:44:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:44:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:44:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:44:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:44:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:44:19 - XML: Processed 653347 elements - found 0 jobs
Sun 19 Jan 2014 07:44:19 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:44:19 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:44:19 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:44:19 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:44:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:44:21 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:44:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:44:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:44:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:44:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:44:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:44:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:44:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:44:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576915
Sun 19 Jan 2014 07:44:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:44:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576915
Sun 19 Jan 2014 07:44:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:44:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:44:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:44:34 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:44:34 - job_xml_thread(): Done retrieving: data size 43576915
Sun 19 Jan 2014 07:44:34 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:44:34 - XML: Start document: iteration 14
Sun 19 Jan 2014 07:44:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:44:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:44:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:44:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:44:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:44:36 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:44:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:44:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:44:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:44:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:44:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:44:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:44:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:44:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:44:37 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:44:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 07:44:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 07:44:37 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:44:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7839 values 123598 bits 15449 bytes 
Sun 19 Jan 2014 07:44:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:44:45 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:44:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:44:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:44:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:44:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:44:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:44:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:44:48 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:44:48 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:44:48 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:44:48 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:44:48 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:44:51 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:44:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 07:44:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:44:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:44:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43551946
Sun 19 Jan 2014 07:44:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:44:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:44:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:44:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43551946
Sun 19 Jan 2014 07:44:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:45:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:45:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:45:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:45:04 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:45:04 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:45:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:45:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:45:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:45:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:45:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:45:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:45:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:45:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:45:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:45:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:45:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:45:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:45:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:45:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:45:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:45:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:45:10 - job_xml_thread(): Done retrieving: data size 43581449
Sun 19 Jan 2014 07:45:10 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:45:10 - XML: Start document: iteration 15
Sun 19 Jan 2014 07:45:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581449
Sun 19 Jan 2014 07:45:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:45:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581449
Sun 19 Jan 2014 07:45:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:45:19 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:45:19 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:45:19 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:45:19 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:45:19 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:45:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:45:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:45:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:45:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:45:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:45:29 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:45:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:45:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:45:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:45:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:45:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:45:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:45:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:45:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:45:31 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:45:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:45:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:45:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:45:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:45:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:45:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:45:32 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 07:45:32 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 07:45:32 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:45:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:45:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43599593
Sun 19 Jan 2014 07:45:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:45:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43599593
Sun 19 Jan 2014 07:45:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:45:34 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:45:34 - job_xml_thread(): Done retrieving: data size 43599593
Sun 19 Jan 2014 07:45:34 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:45:34 - XML: Start document: iteration 16
Sun 19 Jan 2014 07:45:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:45:37 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:45:39 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:45:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 07:45:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:45:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 07:45:39 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:45:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148610 bits 18576 bytes 
Sun 19 Jan 2014 07:45:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:45:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:45:47 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:45:47 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:45:47 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:45:47 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:45:47 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:45:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:45:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:45:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:45:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:45:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:45:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:45:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:45:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:45:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:45:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:45:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:45:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:45:55 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:45:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:45:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:45:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:45:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:45:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:45:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:45:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:45:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579732
Sun 19 Jan 2014 07:45:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:45:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579732
Sun 19 Jan 2014 07:45:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:46:02 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:46:03 - job_xml_thread(): Done retrieving: data size 43579732
Sun 19 Jan 2014 07:46:03 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:46:03 - XML: Start document: iteration 17
Sun 19 Jan 2014 07:46:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:46:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:46:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:46:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:46:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:46:13 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:46:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:46:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:46:14 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:46:14 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:46:14 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:46:14 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:46:14 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:46:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:46:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:46:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:46:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:46:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:46:16 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:46:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 07:46:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:46:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:46:19 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:46:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:46:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:46:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:46:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:46:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:46:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:46:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:46:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571398
Sun 19 Jan 2014 07:46:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:46:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571398
Sun 19 Jan 2014 07:46:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:46:29 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:46:29 - job_xml_thread(): Done retrieving: data size 43571398
Sun 19 Jan 2014 07:46:29 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:46:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:46:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:46:30 - XML: Start document: iteration 18
Sun 19 Jan 2014 07:46:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:46:31 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:46:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:46:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:46:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:46:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:46:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:46:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:46:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:46:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:46:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:46:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:46:40 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:46:40 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:46:40 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:46:40 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:46:40 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:46:40 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:46:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:46:41 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:46:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 07:46:41 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:46:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 07:46:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6022 values 95154 bits 11894 bytes 
Sun 19 Jan 2014 07:46:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:46:42 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:46:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:46:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:46:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:46:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:46:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:46:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:46:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:46:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560208
Sun 19 Jan 2014 07:46:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:46:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560208
Sun 19 Jan 2014 07:46:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:46:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:46:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:46:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:46:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:46:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:46:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:46:56 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:46:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:46:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:46:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:46:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:46:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:46:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:46:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:47:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:47:00 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:47:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:47:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:47:00 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:47:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 07:47:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:47:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:47:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:47:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:47:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:47:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:47:02 - job_xml_thread(): Done retrieving: data size 43593860
Sun 19 Jan 2014 07:47:02 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:47:02 - XML: Start document: iteration 19
Sun 19 Jan 2014 07:47:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43593860
Sun 19 Jan 2014 07:47:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:47:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43593860
Sun 19 Jan 2014 07:47:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:47:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:47:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:47:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:47:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:47:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:47:20 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:47:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:47:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:47:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:47:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:47:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:47:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:47:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:47:23 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:47:23 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:47:23 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:47:23 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:47:23 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:47:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:47:25 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:47:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:47:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:47:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:47:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:47:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:47:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:47:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:47:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43521153
Sun 19 Jan 2014 07:47:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:47:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43521153
Sun 19 Jan 2014 07:47:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:47:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:47:37 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:47:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:47:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:47:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:47:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:47:38 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:47:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:47:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:47:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:47:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:47:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:47:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:47:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:47:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:47:40 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:47:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:47:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:47:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:47:41 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:47:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:47:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:47:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:47:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:47:41 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:47:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 07:47:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:47:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 07:47:41 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:47:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8821 values 139503 bits 17437 bytes 
Sun 19 Jan 2014 07:47:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:47:43 - job_xml_thread(): Done retrieving: data size 42980497
Sun 19 Jan 2014 07:47:43 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:47:43 - XML: Start document: iteration 20
Sun 19 Jan 2014 07:47:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42980497
Sun 19 Jan 2014 07:47:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42980497
Sun 19 Jan 2014 07:47:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:47:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:47:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:47:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:47:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:47:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:48:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:48:05 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:48:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:48:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:48:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:48:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:48:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:48:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:48:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:48:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:48:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:48:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:48:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:48:06 - XML: Processed 645772 elements - found 0 jobs
Sun 19 Jan 2014 07:48:06 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:48:06 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:48:06 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:48:06 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:48:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:48:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:48:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:48:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:48:07 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:48:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 07:48:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:48:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:48:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42951300
Sun 19 Jan 2014 07:48:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:48:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42951300
Sun 19 Jan 2014 07:48:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:48:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:48:18 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:48:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:48:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:48:21 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:48:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:48:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:48:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:48:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:48:21 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:48:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:48:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:48:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:48:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:48:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:48:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:48:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:48:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:48:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:48:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:48:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:48:23 - job_xml_thread(): Done retrieving: data size 42988091
Sun 19 Jan 2014 07:48:23 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:48:23 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 07:48:23 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 07:48:23 - Housekeeping: done.
Sun 19 Jan 2014 07:48:23 - XML: Start document: iteration 0
Sun 19 Jan 2014 07:48:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42988091
Sun 19 Jan 2014 07:48:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:48:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42988091
Sun 19 Jan 2014 07:48:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:48:34 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 07:48:34 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:48:34 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:48:34 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:48:34 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 07:48:35 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 07:48:35 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 07:48:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:48:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:48:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:48:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:48:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:48:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:48:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:48:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:48:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:48:41 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:48:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:48:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:48:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:48:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:48:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:48:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:48:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:48:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:48:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:48:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:48:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 07:48:43 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:48:43 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:48:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 07:48:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7509 values 118628 bits 14828 bytes 
Sun 19 Jan 2014 07:48:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:48:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:48:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:48:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:48:48 - XML: Processed 645900 elements - found 0 jobs
Sun 19 Jan 2014 07:48:48 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:48:48 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:48:48 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:48:48 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 843715 values 13322014 bits 1665251 bytes 
Sun 19 Jan 2014 07:48:48 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:48:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:48:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43513487
Sun 19 Jan 2014 07:48:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:48:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43513487
Sun 19 Jan 2014 07:48:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:48:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:48:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:48:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:48:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:49:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:49:00 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:49:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:49:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:49:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:49:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:49:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:49:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:49:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:49:03 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:49:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:49:06 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:49:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:49:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:49:06 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:49:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 07:49:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:49:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:49:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:49:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:49:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:49:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:49:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570180
Sun 19 Jan 2014 07:49:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:49:10 - job_xml_thread(): Done retrieving: data size 43570180
Sun 19 Jan 2014 07:49:10 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:49:10 - XML: Start document: iteration 1
Sun 19 Jan 2014 07:49:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570180
Sun 19 Jan 2014 07:49:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:49:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:49:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:49:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:49:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:49:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:49:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:49:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:49:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:49:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:49:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:49:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:49:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:49:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:49:30 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:49:30 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:49:30 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:49:30 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:49:30 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:49:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:49:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:49:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:49:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:49:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:49:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:49:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:49:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:49:35 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:49:35 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 07:49:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:49:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563546
Sun 19 Jan 2014 07:49:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:49:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563546
Sun 19 Jan 2014 07:49:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:49:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:49:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:49:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:49:44 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:49:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:49:45 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:49:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 07:49:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 07:49:45 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:49:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:49:45 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:49:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8525 values 134470 bits 16808 bytes 
Sun 19 Jan 2014 07:49:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:49:46 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:49:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:49:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:49:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:49:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:49:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:49:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:49:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:49:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:49:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:49:51 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:49:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:49:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:49:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:49:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:49:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:49:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:49:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:49:54 - job_xml_thread(): Done retrieving: data size 43561202
Sun 19 Jan 2014 07:49:54 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:49:54 - XML: Start document: iteration 2
Sun 19 Jan 2014 07:49:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561202
Sun 19 Jan 2014 07:49:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:49:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561202
Sun 19 Jan 2014 07:49:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:50:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:50:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:50:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:50:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:50:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:50:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:50:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:50:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:50:11 - XML: Processed 653347 elements - found 0 jobs
Sun 19 Jan 2014 07:50:11 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:50:11 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:50:11 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:50:11 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:50:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:50:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:50:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:50:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:50:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:50:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:50:17 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:50:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:50:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:50:18 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:50:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 07:50:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:50:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:50:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:50:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:50:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:50:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:50:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570672
Sun 19 Jan 2014 07:50:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:50:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570672
Sun 19 Jan 2014 07:50:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:50:26 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:50:26 - job_xml_thread(): Done retrieving: data size 43570672
Sun 19 Jan 2014 07:50:26 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:50:26 - XML: Start document: iteration 3
Sun 19 Jan 2014 07:50:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:50:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:50:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:50:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:50:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:50:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:50:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:50:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:50:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:50:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:50:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:50:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:50:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:50:38 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:50:38 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:50:38 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:50:38 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:50:38 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:50:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:50:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:50:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:50:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:50:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:50:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:50:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:50:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:50:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:50:45 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:50:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:50:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 07:50:46 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:50:46 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:50:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 07:50:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5410 values 85281 bits 10660 bytes 
Sun 19 Jan 2014 07:50:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:50:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569335
Sun 19 Jan 2014 07:50:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:50:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569335
Sun 19 Jan 2014 07:50:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:50:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:50:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:50:53 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:50:53 - job_xml_thread(): Done retrieving: data size 43569335
Sun 19 Jan 2014 07:50:53 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:50:53 - XML: Start document: iteration 4
Sun 19 Jan 2014 07:50:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:50:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:51:04 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:51:04 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:51:04 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:51:04 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:51:04 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:51:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:51:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:51:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:51:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:51:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:51:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:51:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:51:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:51:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:51:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:51:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:51:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:51:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:51:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:51:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:51:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:51:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:51:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:51:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43585891
Sun 19 Jan 2014 07:51:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:51:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43585891
Sun 19 Jan 2014 07:51:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:51:19 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:51:19 - job_xml_thread(): Done retrieving: data size 43585891
Sun 19 Jan 2014 07:51:19 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:51:19 - XML: Start document: iteration 5
Sun 19 Jan 2014 07:51:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:51:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:51:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:51:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:51:29 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:51:29 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:51:29 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:51:29 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:51:29 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:51:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:51:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:51:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:51:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:51:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:51:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:51:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:51:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:51:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:51:33 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:51:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 07:51:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:51:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:51:35 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:51:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:51:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:51:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:51:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:51:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:51:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:51:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:51:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572006
Sun 19 Jan 2014 07:51:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:51:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572006
Sun 19 Jan 2014 07:51:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:51:44 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:51:44 - job_xml_thread(): Done retrieving: data size 43572006
Sun 19 Jan 2014 07:51:44 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:51:44 - XML: Start document: iteration 6
Sun 19 Jan 2014 07:51:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:51:46 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:51:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:51:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 07:51:47 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:51:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6160 values 97171 bits 12146 bytes 
Sun 19 Jan 2014 07:51:47 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:51:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 07:51:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:51:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:51:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:51:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:51:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:51:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:51:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:51:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:51:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:51:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:51:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:51:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:51:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:52:00 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:52:00 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:52:00 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:52:00 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:52:00 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:52:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:52:01 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:52:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:52:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:52:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:52:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:52:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:52:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:52:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:52:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572567
Sun 19 Jan 2014 07:52:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:52:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572567
Sun 19 Jan 2014 07:52:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:52:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:52:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:52:15 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:52:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:52:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:52:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:52:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:52:18 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:52:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:52:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:52:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:52:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:52:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:52:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:52:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:52:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:52:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:52:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:52:22 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:52:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 07:52:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:52:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:52:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:52:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:52:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:52:24 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 07:52:24 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 07:52:24 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:52:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:52:25 - job_xml_thread(): Done retrieving: data size 43557252
Sun 19 Jan 2014 07:52:25 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:52:25 - XML: Start document: iteration 7
Sun 19 Jan 2014 07:52:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557252
Sun 19 Jan 2014 07:52:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:52:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557252
Sun 19 Jan 2014 07:52:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:52:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:52:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:52:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:52:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:52:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:52:39 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:52:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:52:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:52:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:52:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:52:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:52:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:52:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:52:43 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:52:43 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:52:43 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:52:43 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:52:43 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:52:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:52:47 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:52:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:52:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:52:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:52:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:52:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:52:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:52:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:52:48 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:52:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:52:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 07:52:48 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:52:48 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:52:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5786 values 91253 bits 11406 bytes 
Sun 19 Jan 2014 07:52:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 07:52:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:52:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573627
Sun 19 Jan 2014 07:52:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:52:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573627
Sun 19 Jan 2014 07:52:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:52:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:52:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:52:59 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:52:59 - job_xml_thread(): Done retrieving: data size 43573627
Sun 19 Jan 2014 07:52:59 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:52:59 - XML: Start document: iteration 8
Sun 19 Jan 2014 07:53:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:53:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:53:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:53:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:53:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:53:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:53:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:53:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:53:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:53:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:53:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:53:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:53:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:53:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:53:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:53:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:53:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:53:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:53:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:53:11 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:53:11 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:53:11 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:53:11 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:53:11 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:53:13 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:53:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 07:53:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:53:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:53:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43527649
Sun 19 Jan 2014 07:53:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:53:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43527649
Sun 19 Jan 2014 07:53:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:53:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:53:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:53:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:53:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:53:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:53:26 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:53:27 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:53:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:53:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:53:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:53:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:53:28 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:53:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:53:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:53:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:53:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:53:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:53:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:53:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:53:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:53:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:53:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:53:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:53:29 - job_xml_thread(): Done retrieving: data size 43175259
Sun 19 Jan 2014 07:53:29 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:53:29 - XML: Start document: iteration 9
Sun 19 Jan 2014 07:53:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43175259
Sun 19 Jan 2014 07:53:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:53:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43175259
Sun 19 Jan 2014 07:53:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:53:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:53:43 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:53:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:53:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:53:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:53:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:53:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:53:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:53:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:53:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:53:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:53:46 - XML: Processed 648100 elements - found 0 jobs
Sun 19 Jan 2014 07:53:46 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:53:46 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:53:46 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:53:46 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:53:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:53:49 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:53:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:53:49 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:53:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:53:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:53:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:53:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 07:53:50 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:53:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6709 values 105826 bits 13228 bytes 
Sun 19 Jan 2014 07:53:50 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:53:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 07:53:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:53:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:53:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:53:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:53:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:53:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42925139
Sun 19 Jan 2014 07:53:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:53:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42925139
Sun 19 Jan 2014 07:53:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:53:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:53:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:54:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:54:00 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:54:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:54:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:54:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:54:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:54:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:54:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:54:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:54:02 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:54:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:54:04 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:54:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:54:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:54:05 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:54:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 07:54:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:54:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:54:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42915537
Sun 19 Jan 2014 07:54:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:54:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:54:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:54:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:54:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:54:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42915537
Sun 19 Jan 2014 07:54:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:54:08 - job_xml_thread(): Done retrieving: data size 42915537
Sun 19 Jan 2014 07:54:08 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:54:08 - XML: Start document: iteration 10
Sun 19 Jan 2014 07:54:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:54:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:54:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:54:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:54:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:54:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:54:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:54:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:54:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:54:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:54:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:54:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:54:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:54:25 - XML: Processed 645242 elements - found 0 jobs
Sun 19 Jan 2014 07:54:25 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:54:25 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:54:25 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:54:25 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:54:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:54:28 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:54:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:54:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:54:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:54:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:54:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:54:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:54:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:54:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42984388
Sun 19 Jan 2014 07:54:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:54:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42984388
Sun 19 Jan 2014 07:54:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:54:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:54:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:54:40 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:54:40 - job_xml_thread(): Done retrieving: data size 42984388
Sun 19 Jan 2014 07:54:40 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:54:40 - XML: Start document: iteration 11
Sun 19 Jan 2014 07:54:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:54:45 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:54:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:54:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:54:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:54:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:54:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:54:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:54:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:54:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:54:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:54:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:54:49 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:54:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:54:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:54:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:54:50 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:54:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:54:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:54:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:54:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:54:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:54:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 07:54:51 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:54:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8059 values 127085 bits 15885 bytes 
Sun 19 Jan 2014 07:54:51 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:54:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 07:54:51 - XML: Processed 645900 elements - found 0 jobs
Sun 19 Jan 2014 07:54:51 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:54:51 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:54:51 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:54:51 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:54:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:54:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43541691
Sun 19 Jan 2014 07:54:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:54:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43541691
Sun 19 Jan 2014 07:54:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:55:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:55:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:55:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:55:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:55:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:55:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:55:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:55:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:55:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:55:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:55:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:55:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:55:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:55:06 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:55:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:55:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:55:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:55:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:55:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:55:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:55:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:55:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:55:08 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:55:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 07:55:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:55:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:55:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571784
Sun 19 Jan 2014 07:55:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:55:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571784
Sun 19 Jan 2014 07:55:11 - job_xml_thread(): Done retrieving: data size 43571784
Sun 19 Jan 2014 07:55:11 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:55:11 - XML: Start document: iteration 12
Sun 19 Jan 2014 07:55:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:55:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:55:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:55:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:55:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:55:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:55:31 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:55:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:55:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:55:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:55:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:55:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:55:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:55:32 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:55:32 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:55:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:55:32 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:55:32 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:55:32 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:55:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:55:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:55:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:55:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:55:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:55:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:55:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:55:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:55:35 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 07:55:35 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:55:35 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:55:35 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 07:55:35 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:55:35 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 07:55:35 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 07:55:36 - size of cluster 'LISA Cluster': 624 hosts 79463 metrics 787655 values 12415048 bits 1551881 bytes 
Sun 19 Jan 2014 07:55:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:55:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575010
Sun 19 Jan 2014 07:55:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:55:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575010
Sun 19 Jan 2014 07:55:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:55:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:55:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:55:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:55:47 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:55:47 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:55:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:55:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:55:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:55:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:55:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:55:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:55:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:55:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:55:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:55:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:55:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:55:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:55:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:55:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:55:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:55:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:55:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:55:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:55:51 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:55:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:55:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 07:55:52 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:55:52 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:55:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 07:55:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9132 values 144067 bits 18008 bytes 
Sun 19 Jan 2014 07:55:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:55:54 - job_xml_thread(): Done retrieving: data size 43561863
Sun 19 Jan 2014 07:55:54 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:55:54 - XML: Start document: iteration 13
Sun 19 Jan 2014 07:55:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561863
Sun 19 Jan 2014 07:55:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561863
Sun 19 Jan 2014 07:55:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:55:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:56:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:56:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:56:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:56:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:56:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:56:10 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:56:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:56:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:56:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:56:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:56:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:56:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:56:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:56:13 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:56:13 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:56:13 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:56:13 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:56:13 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:56:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:56:17 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:56:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:56:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:56:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:56:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:56:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:56:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:56:19 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:56:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 07:56:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:56:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:56:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566135
Sun 19 Jan 2014 07:56:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:56:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566135
Sun 19 Jan 2014 07:56:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:56:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:56:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:56:28 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:56:29 - job_xml_thread(): Done retrieving: data size 43566135
Sun 19 Jan 2014 07:56:29 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:56:29 - XML: Start document: iteration 14
Sun 19 Jan 2014 07:56:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:56:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:56:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:56:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:56:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:56:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:56:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:56:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:56:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:56:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:56:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:56:35 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:56:35 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 07:56:40 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:56:40 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:56:40 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:56:40 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:56:40 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:56:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:56:42 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:56:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:56:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:56:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:56:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:56:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:56:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:56:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:56:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573070
Sun 19 Jan 2014 07:56:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:56:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573070
Sun 19 Jan 2014 07:56:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:56:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:56:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:56:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:56:52 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:56:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:56:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 07:56:53 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:56:53 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:56:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 07:56:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7319 values 115395 bits 14424 bytes 
Sun 19 Jan 2014 07:56:55 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:56:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:56:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:56:57 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:56:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:56:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:56:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:56:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:56:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:56:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:56:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:56:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:57:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:57:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:57:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:57:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:57:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:57:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:57:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:57:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:57:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:57:05 - job_xml_thread(): Done retrieving: data size 43585975
Sun 19 Jan 2014 07:57:05 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:57:05 - XML: Start document: iteration 15
Sun 19 Jan 2014 07:57:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43585975
Sun 19 Jan 2014 07:57:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:57:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43585975
Sun 19 Jan 2014 07:57:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:57:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:57:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:57:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:57:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:57:22 - XML: Processed 653346 elements - found 0 jobs
Sun 19 Jan 2014 07:57:22 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:57:22 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:57:22 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:57:22 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:57:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:57:28 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:57:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:57:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:57:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:57:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:57:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:57:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:57:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:57:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:57:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:57:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:57:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:57:30 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:57:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 07:57:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:57:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:57:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:57:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:57:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:57:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:57:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43597930
Sun 19 Jan 2014 07:57:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:57:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43597930
Sun 19 Jan 2014 07:57:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:57:38 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:57:38 - job_xml_thread(): Done retrieving: data size 43597930
Sun 19 Jan 2014 07:57:38 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:57:38 - XML: Start document: iteration 16
Sun 19 Jan 2014 07:57:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:57:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:57:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:57:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:57:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:57:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:57:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:57:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:57:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:57:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:57:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:57:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:57:53 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:57:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:57:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:57:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:57:53 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:57:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:57:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:57:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:57:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:57:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:57:54 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:57:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 07:57:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 07:57:54 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:57:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5843 values 92148 bits 11518 bytes 
Sun 19 Jan 2014 07:57:55 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:57:55 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:57:55 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:57:55 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:57:55 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:57:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:57:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556741
Sun 19 Jan 2014 07:57:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:57:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556741
Sun 19 Jan 2014 07:57:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:57:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:57:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:58:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:58:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:58:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:58:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:58:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:58:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:58:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:58:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:58:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:58:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:58:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:58:10 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:58:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:58:14 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:58:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:58:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:58:15 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:58:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 07:58:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:58:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:58:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:58:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:58:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:58:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:58:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43587605
Sun 19 Jan 2014 07:58:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:58:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43587605
Sun 19 Jan 2014 07:58:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:58:18 - job_xml_thread(): Done retrieving: data size 43587605
Sun 19 Jan 2014 07:58:18 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:58:18 - XML: Start document: iteration 17
Sun 19 Jan 2014 07:58:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:58:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:58:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:58:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:58:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:58:36 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:58:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:58:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:58:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:58:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:58:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:58:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:58:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:58:38 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:58:38 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:58:38 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:58:38 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:58:38 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:58:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:58:41 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:58:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:58:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:58:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:58:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:58:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:58:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:58:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:58:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43588408
Sun 19 Jan 2014 07:58:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:58:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43588408
Sun 19 Jan 2014 07:58:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:58:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:58:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:58:53 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:58:53 - job_xml_thread(): Done retrieving: data size 43588408
Sun 19 Jan 2014 07:58:53 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:58:53 - XML: Start document: iteration 18
Sun 19 Jan 2014 07:58:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:58:55 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:58:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:58:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 07:58:56 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:58:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 07:58:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:58:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:58:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:58:56 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:58:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:58:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8512 values 134190 bits 16773 bytes 
Sun 19 Jan 2014 07:58:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:58:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:58:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:58:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:58:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:58:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:58:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:59:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:59:06 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:59:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:59:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:59:07 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 07:59:07 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:59:07 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:59:07 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:59:07 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:59:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:59:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:59:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:59:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:59:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:59:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43546116
Sun 19 Jan 2014 07:59:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:59:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43546116
Sun 19 Jan 2014 07:59:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:59:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:59:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:59:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:59:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:59:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:59:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:59:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:59:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:59:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:59:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:59:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:59:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:59:22 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 07:59:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:59:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:59:27 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:59:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:59:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:59:28 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:59:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 07:59:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:59:28 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 07:59:28 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 07:59:28 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:59:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:59:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:59:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:59:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:59:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:59:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43508143
Sun 19 Jan 2014 07:59:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:59:30 - job_xml_thread(): Done retrieving: data size 43508143
Sun 19 Jan 2014 07:59:30 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 07:59:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43508143
Sun 19 Jan 2014 07:59:30 - XML: Start document: iteration 19
Sun 19 Jan 2014 07:59:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:59:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:59:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:59:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 07:59:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 07:59:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 07:59:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:59:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:59:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 07:59:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:59:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 07:59:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 07:59:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 07:59:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:59:49 - XML: Processed 652600 elements - found 0 jobs
Sun 19 Jan 2014 07:59:49 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 07:59:49 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 07:59:49 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 07:59:49 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 07:59:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 07:59:51 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 07:59:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 07:59:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 07:59:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:59:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 07:59:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 07:59:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 07:59:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 07:59:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42930296
Sun 19 Jan 2014 07:59:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 07:59:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42930296
Sun 19 Jan 2014 07:59:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 07:59:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:59:56 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 07:59:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:59:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 07:59:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 07:59:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 07:59:57 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 07:59:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 07:59:57 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 07:59:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8804 values 138780 bits 17347 bytes 
Sun 19 Jan 2014 08:00:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:00:01 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:00:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:00:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:00:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:00:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:00:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:00:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42930296
Sun 19 Jan 2014 08:00:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:00:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:00:04 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:00:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:00:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:00:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:00:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:00:13 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:00:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:00:14 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:00:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:00:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:00:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:00:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:00:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:00:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:00:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:00:17 - job_xml_thread(): Done retrieving: data size 42951906
Sun 19 Jan 2014 08:00:17 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:00:17 - XML: Start document: iteration 20
Sun 19 Jan 2014 08:00:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42951906
Sun 19 Jan 2014 08:00:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:00:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:00:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:00:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:00:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:00:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:00:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:00:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42951906
Sun 19 Jan 2014 08:00:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:00:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:00:30 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:00:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:00:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:00:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:00:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:00:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:00:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:00:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:00:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:00:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:00:36 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:00:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 08:00:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:00:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:00:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:00:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:00:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:00:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:00:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:00:39 - XML: Processed 645826 elements - found 0 jobs
Sun 19 Jan 2014 08:00:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:00:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:00:39 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:00:39 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:00:39 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:00:39 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:00:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:00:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43460276
Sun 19 Jan 2014 08:00:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:00:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43460276
Sun 19 Jan 2014 08:00:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:00:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:00:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:00:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:00:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:00:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:00:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:00:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:00:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:00:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:00:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:00:53 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:00:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:00:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559728
Sun 19 Jan 2014 08:00:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:00:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:00:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:00:54 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:00:54 - job_xml_thread(): Done retrieving: data size 43559728
Sun 19 Jan 2014 08:00:54 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:00:54 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 08:00:55 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 08:00:55 - Housekeeping: done.
Sun 19 Jan 2014 08:00:55 - XML: Start document: iteration 0
Sun 19 Jan 2014 08:00:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:00:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:00:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:00:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:00:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559728
Sun 19 Jan 2014 08:00:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:00:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:00:57 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:00:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:00:59 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:00:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 08:00:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 08:01:00 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:01:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9145 values 144269 bits 18033 bytes 
Sun 19 Jan 2014 08:01:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:01:03 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:01:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:01:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:01:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:01:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:01:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:01:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:01:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:01:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:01:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:01:12 - XML: Processed 653184 elements - found 0 jobs
Sun 19 Jan 2014 08:01:12 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:01:12 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:01:12 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:01:12 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:01:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:01:14 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:01:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:01:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:01:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:01:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:01:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:01:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:01:16 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:01:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 08:01:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:01:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:01:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565110
Sun 19 Jan 2014 08:01:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:01:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565110
Sun 19 Jan 2014 08:01:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:01:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:01:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:01:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:01:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:01:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:01:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:01:27 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:01:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:01:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:01:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:01:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:01:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:01:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:01:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:01:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:01:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:01:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:01:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:01:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:01:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:01:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:01:32 - job_xml_thread(): Done retrieving: data size 43587555
Sun 19 Jan 2014 08:01:32 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:01:32 - XML: Start document: iteration 1
Sun 19 Jan 2014 08:01:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43587555
Sun 19 Jan 2014 08:01:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:01:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43587555
Sun 19 Jan 2014 08:01:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:01:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:01:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:01:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:01:46 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:01:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:01:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:01:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:01:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:01:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:01:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:01:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:01:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:01:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:01:48 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 08:01:48 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:01:48 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:01:48 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:01:48 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:01:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:01:53 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:01:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:01:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:01:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:01:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:01:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:01:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:01:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:01:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557599
Sun 19 Jan 2014 08:01:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:01:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557599
Sun 19 Jan 2014 08:01:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:01:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:01:59 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:01:59 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:01:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 08:01:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:01:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 08:01:59 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:02:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148970 bits 18621 bytes 
Sun 19 Jan 2014 08:02:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:02:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:02:03 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:02:03 - job_xml_thread(): Done retrieving: data size 43557599
Sun 19 Jan 2014 08:02:03 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:02:03 - XML: Start document: iteration 2
Sun 19 Jan 2014 08:02:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:02:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:02:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:02:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:02:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:02:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:02:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:02:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:02:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:02:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:02:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:02:15 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 08:02:15 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:02:15 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:02:15 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:02:15 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:02:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:02:18 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:02:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:02:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:02:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:02:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:02:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:02:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:02:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:02:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570506
Sun 19 Jan 2014 08:02:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:02:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570506
Sun 19 Jan 2014 08:02:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:02:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:02:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:02:30 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:02:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:02:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:02:31 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:02:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:02:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:02:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:02:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:02:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:02:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:02:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:02:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:02:35 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 08:02:35 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:02:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:02:35 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:02:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:02:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:02:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:02:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:02:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:02:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:02:36 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:02:36 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:02:36 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 08:02:36 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 08:02:36 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 08:02:37 - size of cluster 'LISA Cluster': 624 hosts 79487 metrics 866047 values 13665785 bits 1708223 bytes 
Sun 19 Jan 2014 08:02:37 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:02:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 08:02:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:02:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:02:40 - job_xml_thread(): Done retrieving: data size 43569098
Sun 19 Jan 2014 08:02:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569098
Sun 19 Jan 2014 08:02:40 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:02:40 - XML: Start document: iteration 3
Sun 19 Jan 2014 08:02:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:02:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569098
Sun 19 Jan 2014 08:02:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:02:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:02:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:02:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:02:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:02:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:02:57 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:02:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:02:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:02:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:02:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:02:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:02:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:02:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:02:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:03:00 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:03:00 - XML: Processed 653340 elements - found 0 jobs
Sun 19 Jan 2014 08:03:00 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:03:00 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:03:00 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:03:00 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:03:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:03:00 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:03:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 08:03:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 08:03:00 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:03:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5760 values 91123 bits 11390 bytes 
Sun 19 Jan 2014 08:03:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:03:04 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:03:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:03:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:03:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:03:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:03:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:03:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:03:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:03:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584703
Sun 19 Jan 2014 08:03:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:03:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584703
Sun 19 Jan 2014 08:03:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:03:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:03:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:03:15 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:03:15 - job_xml_thread(): Done retrieving: data size 43584703
Sun 19 Jan 2014 08:03:15 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:03:15 - XML: Start document: iteration 4
Sun 19 Jan 2014 08:03:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:03:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:03:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:03:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:03:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:03:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:03:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:03:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:03:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:03:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:03:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:03:28 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 08:03:28 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:03:28 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:03:28 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:03:28 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:03:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:03:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:03:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:03:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:03:30 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:03:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 08:03:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:03:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:03:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:03:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:03:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:03:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:03:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577078
Sun 19 Jan 2014 08:03:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:03:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577078
Sun 19 Jan 2014 08:03:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:03:36 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:03:36 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 08:03:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:03:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:03:43 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:03:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:03:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:03:44 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:03:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:03:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:03:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:03:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:03:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:03:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:03:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:03:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:03:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:03:49 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:03:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:03:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:03:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:03:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:03:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:03:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:03:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:03:51 - job_xml_thread(): Done retrieving: data size 43578723
Sun 19 Jan 2014 08:03:51 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:03:51 - XML: Start document: iteration 5
Sun 19 Jan 2014 08:03:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578723
Sun 19 Jan 2014 08:03:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:03:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578723
Sun 19 Jan 2014 08:03:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:04:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:04:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:04:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:04:00 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:04:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:04:01 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:04:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 08:04:01 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:04:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 08:04:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8878 values 140158 bits 17519 bytes 
Sun 19 Jan 2014 08:04:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:04:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:04:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:04:06 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:04:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:04:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:04:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:04:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:04:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:04:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:04:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:04:13 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 08:04:13 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:04:13 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:04:13 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:04:13 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:04:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:04:16 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:04:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:04:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:04:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:04:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:04:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:04:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:04:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:04:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565597
Sun 19 Jan 2014 08:04:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:04:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565597
Sun 19 Jan 2014 08:04:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:04:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:04:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:04:28 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:04:28 - job_xml_thread(): Done retrieving: data size 43565597
Sun 19 Jan 2014 08:04:28 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:04:28 - XML: Start document: iteration 6
Sun 19 Jan 2014 08:04:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:04:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:04:39 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 08:04:39 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:04:39 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:04:39 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:04:39 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:04:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:04:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:04:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:04:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:04:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:04:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:04:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:04:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:04:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:04:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:04:41 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:04:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:04:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:04:42 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:04:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 08:04:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:04:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:04:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:04:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:04:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:04:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:04:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43588146
Sun 19 Jan 2014 08:04:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:04:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43588146
Sun 19 Jan 2014 08:04:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:04:54 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:04:54 - job_xml_thread(): Done retrieving: data size 43588146
Sun 19 Jan 2014 08:04:54 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:04:54 - XML: Start document: iteration 7
Sun 19 Jan 2014 08:04:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:04:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:04:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:04:57 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:04:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:04:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:04:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:04:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:04:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:04:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:04:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:04:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:04:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:05:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:05:02 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:05:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:05:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 08:05:03 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:05:03 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:05:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5957 values 94005 bits 11750 bytes 
Sun 19 Jan 2014 08:05:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 08:05:07 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 08:05:07 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:05:07 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:05:07 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:05:07 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:05:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:05:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:05:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:05:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:05:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:05:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:05:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:05:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:05:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:05:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553301
Sun 19 Jan 2014 08:05:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:05:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553301
Sun 19 Jan 2014 08:05:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:05:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:05:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:05:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:05:22 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:05:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:05:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:05:22 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:05:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:05:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:05:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:05:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:05:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:05:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:05:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:05:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:05:27 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:05:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:05:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:05:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:05:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:05:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:05:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:05:28 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:05:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 08:05:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:05:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:05:30 - job_xml_thread(): Done retrieving: data size 43500470
Sun 19 Jan 2014 08:05:30 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:05:30 - XML: Start document: iteration 8
Sun 19 Jan 2014 08:05:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43500470
Sun 19 Jan 2014 08:05:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:05:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43500470
Sun 19 Jan 2014 08:05:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:05:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:05:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:05:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:05:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:05:47 - XML: Processed 652600 elements - found 0 jobs
Sun 19 Jan 2014 08:05:47 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:05:47 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:05:47 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:05:47 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:05:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:05:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:05:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:05:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:05:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:05:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:05:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:05:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:05:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:05:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:05:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:05:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:05:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:05:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:05:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:05:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:05:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:05:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:05:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42914493
Sun 19 Jan 2014 08:05:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:05:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42914493
Sun 19 Jan 2014 08:05:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:06:02 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:06:02 - job_xml_thread(): Done retrieving: data size 42914493
Sun 19 Jan 2014 08:06:03 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:06:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:06:03 - XML: Start document: iteration 9
Sun 19 Jan 2014 08:06:03 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:06:04 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:06:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:06:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 08:06:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 08:06:04 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:06:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8636 values 136214 bits 17026 bytes 
Sun 19 Jan 2014 08:06:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:06:07 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:06:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:06:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:06:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:06:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:06:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:06:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:06:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:06:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:06:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:06:16 - XML: Processed 645216 elements - found 0 jobs
Sun 19 Jan 2014 08:06:16 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:06:16 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:06:16 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:06:16 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:06:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:06:19 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:06:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:06:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:06:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:06:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:06:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:06:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:06:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:06:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42969615
Sun 19 Jan 2014 08:06:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:06:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42969615
Sun 19 Jan 2014 08:06:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:06:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:06:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:06:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:06:30 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:06:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:06:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:06:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:06:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:06:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:06:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42969615
Sun 19 Jan 2014 08:06:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:06:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:06:31 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:06:31 - job_xml_thread(): Done retrieving: data size 42969615
Sun 19 Jan 2014 08:06:31 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:06:31 - XML: Start document: iteration 10
Sun 19 Jan 2014 08:06:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:06:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:06:43 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 08:06:43 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 08:06:43 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:06:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:06:45 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:06:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:06:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:06:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:06:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:06:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:06:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:06:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:06:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:06:51 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:06:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:06:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:06:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:06:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:06:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:06:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:06:51 - XML: Processed 645826 elements - found 0 jobs
Sun 19 Jan 2014 08:06:51 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:06:51 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:06:51 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:06:51 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:06:51 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:06:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 08:06:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:06:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:06:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43518502
Sun 19 Jan 2014 08:06:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:06:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43518502
Sun 19 Jan 2014 08:06:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:07:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:07:01 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:07:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:07:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:07:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:07:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:07:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:07:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:07:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43518502
Sun 19 Jan 2014 08:07:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:07:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:07:05 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:07:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:07:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:07:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:07:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 08:07:06 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:07:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 08:07:06 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:07:06 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:07:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:07:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5695 values 89779 bits 11222 bytes 
Sun 19 Jan 2014 08:07:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:07:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:07:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:07:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:07:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:07:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:07:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:07:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:07:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:07:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:07:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:07:16 - job_xml_thread(): Done retrieving: data size 43559115
Sun 19 Jan 2014 08:07:16 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:07:16 - XML: Start document: iteration 11
Sun 19 Jan 2014 08:07:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559115
Sun 19 Jan 2014 08:07:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:07:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:07:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:07:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:07:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:07:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559115
Sun 19 Jan 2014 08:07:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:07:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:07:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:07:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:07:28 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:07:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:07:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:07:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:07:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:07:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:07:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:07:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:07:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:07:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:07:36 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 08:07:36 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:07:36 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:07:36 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:07:36 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:07:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:07:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:07:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:07:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:07:39 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:07:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 08:07:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:07:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:07:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:07:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:07:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:07:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:07:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558359
Sun 19 Jan 2014 08:07:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:07:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558359
Sun 19 Jan 2014 08:07:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:07:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:07:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:07:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:07:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:07:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:07:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:07:51 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:07:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:07:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:07:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:07:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:07:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:07:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:07:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:07:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:07:55 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:07:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:07:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:07:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:07:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:07:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:07:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:07:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:07:56 - job_xml_thread(): Done retrieving: data size 43562813
Sun 19 Jan 2014 08:07:56 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:07:56 - XML: Start document: iteration 12
Sun 19 Jan 2014 08:07:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562813
Sun 19 Jan 2014 08:07:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:07:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562813
Sun 19 Jan 2014 08:07:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:08:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:08:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:08:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:08:07 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:08:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:08:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 08:08:07 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:08:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9157 values 144444 bits 18055 bytes 
Sun 19 Jan 2014 08:08:08 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:08:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 08:08:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:08:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:08:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:08:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:08:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:08:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:08:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:08:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:08:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:08:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:08:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:08:16 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 08:08:16 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:08:16 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:08:16 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:08:16 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:08:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:08:19 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:08:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:08:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:08:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:08:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:08:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:08:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:08:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:08:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577771
Sun 19 Jan 2014 08:08:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:08:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577771
Sun 19 Jan 2014 08:08:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:08:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:08:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:08:31 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:08:31 - job_xml_thread(): Done retrieving: data size 43577771
Sun 19 Jan 2014 08:08:31 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:08:31 - XML: Start document: iteration 13
Sun 19 Jan 2014 08:08:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:08:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:08:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:08:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:08:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:08:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:08:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:08:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:08:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:08:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:08:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:08:38 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:08:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 08:08:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:08:40 - XML: Processed 653348 elements - found 0 jobs
Sun 19 Jan 2014 08:08:40 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:08:40 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:08:40 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:08:40 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:08:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:08:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:08:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:08:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:08:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:08:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:08:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:08:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:08:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:08:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43551532
Sun 19 Jan 2014 08:08:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:08:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43551532
Sun 19 Jan 2014 08:08:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:08:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:08:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:08:55 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:08:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:08:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:08:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:08:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:08:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:08:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:08:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:08:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:08:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:08:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:08:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:08:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:08:59 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:08:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:08:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:08:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:08:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:08:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:08:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:09:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:09:00 - job_xml_thread(): Done retrieving: data size 43578972
Sun 19 Jan 2014 08:09:00 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:09:00 - XML: Start document: iteration 14
Sun 19 Jan 2014 08:09:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578972
Sun 19 Jan 2014 08:09:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:09:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578972
Sun 19 Jan 2014 08:09:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:09:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:09:08 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:09:08 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:09:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 08:09:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:09:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 08:09:08 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:09:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9114 values 143741 bits 17967 bytes 
Sun 19 Jan 2014 08:09:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:09:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:09:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:09:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:09:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:09:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:09:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:09:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:09:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:09:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:09:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:09:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:09:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:09:21 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 08:09:21 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:09:21 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:09:21 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:09:21 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:09:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:09:24 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:09:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:09:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:09:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:09:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:09:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:09:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:09:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:09:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563711
Sun 19 Jan 2014 08:09:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:09:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563711
Sun 19 Jan 2014 08:09:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:09:33 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:09:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 08:09:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:09:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:09:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:09:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:09:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:09:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:09:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:09:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:09:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:09:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:09:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:09:36 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:09:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:09:36 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 08:09:36 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:09:37 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:09:37 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 08:09:37 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 08:09:37 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:09:37 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 08:09:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:09:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:09:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:09:39 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:09:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:09:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:09:40 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 862844 values 13599668 bits 1699958 bytes 
Sun 19 Jan 2014 08:09:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:09:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:09:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:09:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:09:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:09:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563237
Sun 19 Jan 2014 08:09:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:09:44 - job_xml_thread(): Done retrieving: data size 43563237
Sun 19 Jan 2014 08:09:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563237
Sun 19 Jan 2014 08:09:44 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:09:44 - XML: Start document: iteration 15
Sun 19 Jan 2014 08:09:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:09:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:09:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:09:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:09:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:10:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:10:01 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:10:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:10:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:10:02 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 08:10:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:10:02 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:10:02 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:10:02 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:10:02 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:10:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:10:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:10:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:10:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:10:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:10:07 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:10:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:10:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:10:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:10:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:10:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:10:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:10:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:10:08 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:10:09 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:10:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:10:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 08:10:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 08:10:09 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:10:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6038 values 95210 bits 11901 bytes 
Sun 19 Jan 2014 08:10:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:10:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560457
Sun 19 Jan 2014 08:10:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:10:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560457
Sun 19 Jan 2014 08:10:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:10:17 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:10:17 - job_xml_thread(): Done retrieving: data size 43560457
Sun 19 Jan 2014 08:10:17 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:10:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:10:17 - XML: Start document: iteration 16
Sun 19 Jan 2014 08:10:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:10:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:10:19 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:10:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:10:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:10:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:10:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:10:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:10:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:10:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:10:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:10:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:10:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:10:32 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:10:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:10:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:10:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:10:33 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 08:10:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:10:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:10:33 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:10:33 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:10:33 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:10:33 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:10:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:10:36 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:10:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 08:10:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:10:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:10:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:10:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:10:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557814
Sun 19 Jan 2014 08:10:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:10:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557814
Sun 19 Jan 2014 08:10:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:10:37 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:10:37 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 08:10:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:10:44 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:10:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:10:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:10:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:10:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:10:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:10:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:10:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557814
Sun 19 Jan 2014 08:10:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:10:48 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:10:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:10:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:10:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:10:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:10:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:10:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:10:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:10:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:10:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:10:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:10:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:10:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:10:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:10:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:10:59 - job_xml_thread(): Done retrieving: data size 43555730
Sun 19 Jan 2014 08:10:59 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:10:59 - XML: Start document: iteration 17
Sun 19 Jan 2014 08:11:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:11:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:11:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555730
Sun 19 Jan 2014 08:11:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:11:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:11:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:11:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555730
Sun 19 Jan 2014 08:11:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:11:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:11:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:11:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:11:09 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:11:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:11:10 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:11:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 08:11:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 08:11:10 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:11:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7344 values 115819 bits 14477 bytes 
Sun 19 Jan 2014 08:11:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:11:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:11:13 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 08:11:13 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:11:13 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:11:13 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:11:13 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:11:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:11:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:11:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:11:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:11:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:11:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:11:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:11:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:11:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:11:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:11:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:11:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:11:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:11:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:11:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:11:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:11:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:11:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:11:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:11:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:11:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43492679
Sun 19 Jan 2014 08:11:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:11:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43492679
Sun 19 Jan 2014 08:11:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:11:28 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:11:28 - job_xml_thread(): Done retrieving: data size 43492679
Sun 19 Jan 2014 08:11:28 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:11:28 - XML: Start document: iteration 18
Sun 19 Jan 2014 08:11:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:11:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:11:37 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:11:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 08:11:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:11:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:11:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:11:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:11:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:11:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:11:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:11:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:11:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:11:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:11:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:11:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:11:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:11:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:11:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:11:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:11:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:11:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:11:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:11:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:11:47 - XML: Processed 652600 elements - found 0 jobs
Sun 19 Jan 2014 08:11:47 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:11:47 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:11:47 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:11:47 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:11:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:11:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42955139
Sun 19 Jan 2014 08:11:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:11:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42955139
Sun 19 Jan 2014 08:11:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:11:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:11:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:11:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:11:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:12:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:12:01 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:12:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:12:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:12:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:12:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:12:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:12:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:12:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:12:02 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:12:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:12:05 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:12:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:12:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:12:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:12:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:12:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:12:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:12:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:12:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42944410
Sun 19 Jan 2014 08:12:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:12:08 - job_xml_thread(): Done retrieving: data size 42944410
Sun 19 Jan 2014 08:12:08 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:12:08 - XML: Start document: iteration 19
Sun 19 Jan 2014 08:12:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42944410
Sun 19 Jan 2014 08:12:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:12:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:12:10 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:12:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:12:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 08:12:11 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:12:12 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:12:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 08:12:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9155 values 144396 bits 18049 bytes 
Sun 19 Jan 2014 08:12:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:12:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:12:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:12:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:12:24 - XML: Processed 645536 elements - found 0 jobs
Sun 19 Jan 2014 08:12:24 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:12:24 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:12:24 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:12:24 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:12:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:12:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:12:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:12:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:12:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:12:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:12:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:12:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:12:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:12:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:12:32 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:12:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:12:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:12:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:12:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:12:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:12:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:12:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:12:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43059202
Sun 19 Jan 2014 08:12:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:12:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43059202
Sun 19 Jan 2014 08:12:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:12:39 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:12:39 - job_xml_thread(): Done retrieving: data size 43059202
Sun 19 Jan 2014 08:12:39 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:12:39 - XML: Start document: iteration 20
Sun 19 Jan 2014 08:12:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:12:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:12:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:12:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:12:51 - XML: Processed 646710 elements - found 0 jobs
Sun 19 Jan 2014 08:12:51 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:12:51 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:12:51 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:12:51 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:12:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:12:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:12:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:12:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:12:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:12:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:12:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:12:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:12:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:12:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:12:59 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:12:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:12:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:12:59 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:12:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 08:12:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:13:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:13:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:13:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:13:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:13:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:13:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569317
Sun 19 Jan 2014 08:13:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:13:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569317
Sun 19 Jan 2014 08:13:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:13:06 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:13:06 - job_xml_thread(): Done retrieving: data size 43569317
Sun 19 Jan 2014 08:13:06 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:13:06 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 08:13:08 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 08:13:08 - Housekeeping: done.
Sun 19 Jan 2014 08:13:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:13:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:13:09 - XML: Start document: iteration 0
Sun 19 Jan 2014 08:13:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:13:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:13:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:13:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:13:12 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:13:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:13:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:13:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 08:13:13 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:13:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5716 values 90139 bits 11267 bytes 
Sun 19 Jan 2014 08:13:13 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:13:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 08:13:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:13:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:13:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:13:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:13:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:13:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:13:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:13:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:13:24 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:13:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:13:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:13:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:13:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:13:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:13:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:13:25 - XML: Processed 653230 elements - found 0 jobs
Sun 19 Jan 2014 08:13:25 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:13:25 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:13:25 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:13:25 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:13:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:13:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43541962
Sun 19 Jan 2014 08:13:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:13:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43541962
Sun 19 Jan 2014 08:13:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:13:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:13:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:13:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:13:37 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:13:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:13:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:13:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:13:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:13:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:13:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:13:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:13:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:13:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:13:40 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:13:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:13:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:13:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:13:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:13:43 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:13:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 08:13:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:13:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:13:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:13:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:13:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:13:46 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 08:13:46 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 08:13:46 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:13:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:13:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577888
Sun 19 Jan 2014 08:13:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:13:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577888
Sun 19 Jan 2014 08:13:47 - job_xml_thread(): Done retrieving: data size 43577888
Sun 19 Jan 2014 08:13:47 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:13:47 - XML: Start document: iteration 1
Sun 19 Jan 2014 08:13:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:13:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:13:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:13:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:13:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:14:05 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 08:14:05 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:14:05 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:14:06 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:14:06 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:14:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:14:07 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:14:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:14:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:14:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:14:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:14:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:14:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:14:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:14:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:14:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:14:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:14:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:14:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:14:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:14:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:14:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:14:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:14:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575613
Sun 19 Jan 2014 08:14:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:14:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575613
Sun 19 Jan 2014 08:14:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:14:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:14:13 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:14:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:14:15 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:14:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 08:14:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 08:14:15 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:14:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8905 values 140370 bits 17546 bytes 
Sun 19 Jan 2014 08:14:21 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:14:21 - job_xml_thread(): Done retrieving: data size 43575613
Sun 19 Jan 2014 08:14:21 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:14:21 - XML: Start document: iteration 2
Sun 19 Jan 2014 08:14:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:14:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:14:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:14:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:14:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:14:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:14:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:14:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:14:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:14:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:14:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:14:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:14:32 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:14:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:14:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:14:33 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 08:14:33 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:14:33 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:14:33 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:14:33 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:14:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:14:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:14:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:14:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:14:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:14:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576311
Sun 19 Jan 2014 08:14:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:14:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576311
Sun 19 Jan 2014 08:14:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:14:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:14:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:14:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:14:45 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:14:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:14:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:14:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:14:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:14:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:14:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576311
Sun 19 Jan 2014 08:14:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:14:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:14:48 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:14:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:14:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:14:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:14:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:14:54 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:14:56 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:14:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 08:14:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:14:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:14:57 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:14:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:14:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:14:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:14:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:14:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:14:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:14:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:14:59 - job_xml_thread(): Done retrieving: data size 43558975
Sun 19 Jan 2014 08:14:59 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:14:59 - XML: Start document: iteration 3
Sun 19 Jan 2014 08:15:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:15:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558975
Sun 19 Jan 2014 08:15:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:15:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:15:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:15:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:15:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:15:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:15:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558975
Sun 19 Jan 2014 08:15:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:15:13 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 08:15:13 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:15:13 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:15:13 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:15:13 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:15:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:15:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:15:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:15:15 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:15:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:15:16 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:15:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 08:15:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 08:15:16 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:15:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6132 values 96669 bits 12083 bytes 
Sun 19 Jan 2014 08:15:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:15:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:15:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:15:18 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:15:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:15:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:15:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:15:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:15:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:15:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:15:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:15:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:15:21 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:15:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:15:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:15:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:15:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:15:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:15:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:15:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:15:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577651
Sun 19 Jan 2014 08:15:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:15:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577651
Sun 19 Jan 2014 08:15:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:15:28 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:15:28 - job_xml_thread(): Done retrieving: data size 43577651
Sun 19 Jan 2014 08:15:28 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:15:28 - XML: Start document: iteration 4
Sun 19 Jan 2014 08:15:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:15:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:15:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:15:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:15:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:15:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:15:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:15:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:15:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:15:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:15:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:15:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:15:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:15:41 - XML: Processed 653348 elements - found 0 jobs
Sun 19 Jan 2014 08:15:41 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:15:41 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:15:41 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:15:41 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:15:43 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:15:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 08:15:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:15:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:15:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:15:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:15:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:15:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:15:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:15:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:15:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:15:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:15:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567748
Sun 19 Jan 2014 08:15:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:15:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567748
Sun 19 Jan 2014 08:15:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:15:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:15:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:15:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:15:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:15:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:15:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:15:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:15:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:15:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:15:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:15:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567748
Sun 19 Jan 2014 08:15:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:15:56 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:15:56 - job_xml_thread(): Done retrieving: data size 43567748
Sun 19 Jan 2014 08:15:57 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:15:57 - XML: Start document: iteration 5
Sun 19 Jan 2014 08:16:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:16:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:16:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:16:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:16:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:16:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:16:12 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 08:16:12 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:16:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:16:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:16:12 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:16:12 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:16:12 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:16:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:16:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:16:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:16:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:16:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:16:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:16:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:16:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:16:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:16:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:16:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:16:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:16:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:16:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:16:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43597964
Sun 19 Jan 2014 08:16:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:16:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43597964
Sun 19 Jan 2014 08:16:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:16:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:16:16 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:16:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:16:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 08:16:18 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:16:18 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:16:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8882 values 140089 bits 17511 bytes 
Sun 19 Jan 2014 08:16:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 08:16:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:16:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:16:27 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:16:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:16:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:16:27 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:16:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:16:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:16:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:16:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:16:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:16:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:16:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:16:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:16:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:16:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:16:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:16:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:16:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:16:29 - job_xml_thread(): Done retrieving: data size 43592736
Sun 19 Jan 2014 08:16:29 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:16:29 - XML: Start document: iteration 6
Sun 19 Jan 2014 08:16:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43592736
Sun 19 Jan 2014 08:16:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:16:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43592736
Sun 19 Jan 2014 08:16:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:16:38 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 08:16:38 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:16:39 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:16:39 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:16:39 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 08:16:39 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 08:16:39 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 08:16:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:16:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:16:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:16:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:16:45 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 08:16:45 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:16:45 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:16:45 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:16:45 - job_xml_thread(): Sleeping.. (15s)
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sun 19 Jan 2014 08:16:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:16:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:16:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:16:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:16:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:16:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:16:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:16:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:16:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:16:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:16:53 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:16:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:16:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:16:54 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:16:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 08:16:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:16:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:16:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:16:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:16:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:16:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:16:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43585698
Sun 19 Jan 2014 08:16:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:16:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43585698
Sun 19 Jan 2014 08:16:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:17:00 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:17:00 - job_xml_thread(): Done retrieving: data size 43585698
Sun 19 Jan 2014 08:17:00 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:17:00 - XML: Start document: iteration 7
Sun 19 Jan 2014 08:17:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:17:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:17:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:17:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:17:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:17:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:17:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:17:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:17:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:17:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:17:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:17:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:17:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:17:15 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 08:17:15 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:17:15 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:17:15 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:17:15 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:17:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:17:17 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:17:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:17:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:17:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:17:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:17:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:17:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:17:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:17:18 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:17:19 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:17:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:17:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 08:17:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 08:17:19 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:17:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5600 values 88520 bits 11065 bytes 
Sun 19 Jan 2014 08:17:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:17:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43504151
Sun 19 Jan 2014 08:17:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:17:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43504151
Sun 19 Jan 2014 08:17:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:17:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:17:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:17:30 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:17:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:17:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:17:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:17:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:17:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:17:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:17:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:17:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:17:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:17:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:17:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:17:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:17:35 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:17:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:17:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:17:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:17:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:17:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:17:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:17:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:17:37 - job_xml_thread(): Done retrieving: data size 43084540
Sun 19 Jan 2014 08:17:37 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:17:37 - XML: Start document: iteration 8
Sun 19 Jan 2014 08:17:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43084540
Sun 19 Jan 2014 08:17:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:17:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43084540
Sun 19 Jan 2014 08:17:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:17:39 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:17:39 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:17:40 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:17:40 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 08:17:40 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:17:40 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 08:17:40 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 08:17:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:17:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:17:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:17:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:17:54 - size of cluster 'LISA Cluster': 624 hosts 79470 metrics 868933 values 13709839 bits 1713729 bytes 
Sun 19 Jan 2014 08:17:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:17:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:17:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:17:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:17:55 - XML: Processed 647026 elements - found 0 jobs
Sun 19 Jan 2014 08:17:55 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:17:55 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:17:55 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:17:56 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:17:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:17:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:17:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:17:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:17:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:18:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:18:01 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:18:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:18:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:18:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:18:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:18:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:18:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:18:01 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:18:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 08:18:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:18:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:18:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42920391
Sun 19 Jan 2014 08:18:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:18:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42920391
Sun 19 Jan 2014 08:18:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:18:11 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:18:11 - job_xml_thread(): Done retrieving: data size 42920391
Sun 19 Jan 2014 08:18:11 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:18:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:18:11 - XML: Start document: iteration 9
Sun 19 Jan 2014 08:18:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:18:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:18:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:18:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:18:19 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:18:20 - XML: Processed 645150 elements - found 0 jobs
Sun 19 Jan 2014 08:18:20 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:18:20 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:18:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:18:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 08:18:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 08:18:21 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:18:21 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:18:21 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:18:21 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:18:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5990 values 94731 bits 11841 bytes 
Sun 19 Jan 2014 08:18:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:18:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:18:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:18:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:18:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:18:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:18:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:18:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:18:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:18:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:18:26 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:18:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:18:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:18:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:18:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:18:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:18:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:18:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:18:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42999493
Sun 19 Jan 2014 08:18:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:18:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42999493
Sun 19 Jan 2014 08:18:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:18:36 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:18:36 - job_xml_thread(): Done retrieving: data size 42999493
Sun 19 Jan 2014 08:18:36 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:18:36 - XML: Start document: iteration 10
Sun 19 Jan 2014 08:18:40 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:18:40 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 08:18:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:18:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:18:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:18:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:18:47 - XML: Processed 646054 elements - found 0 jobs
Sun 19 Jan 2014 08:18:47 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:18:47 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:18:47 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:18:47 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:18:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:18:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:18:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:18:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:18:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:18:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:18:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:18:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:18:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:18:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:18:52 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:18:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:18:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:18:53 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:18:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 08:18:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:18:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:18:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:18:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:18:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:18:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:18:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43538417
Sun 19 Jan 2014 08:18:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:18:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43538417
Sun 19 Jan 2014 08:18:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:19:02 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:19:02 - job_xml_thread(): Done retrieving: data size 43538417
Sun 19 Jan 2014 08:19:02 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:19:02 - XML: Start document: iteration 11
Sun 19 Jan 2014 08:19:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:19:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:19:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:19:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:19:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:19:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:19:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:19:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:19:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:19:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:19:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:19:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:19:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:19:15 - XML: Processed 652832 elements - found 0 jobs
Sun 19 Jan 2014 08:19:15 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:19:15 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:19:15 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:19:15 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:19:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:19:19 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:19:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:19:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:19:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:19:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:19:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:19:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:19:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:19:21 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:19:21 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:19:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:19:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 08:19:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 08:19:21 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:19:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5760 values 90915 bits 11364 bytes 
Sun 19 Jan 2014 08:19:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:19:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559249
Sun 19 Jan 2014 08:19:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:19:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559249
Sun 19 Jan 2014 08:19:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:19:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:19:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:19:30 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:19:31 - job_xml_thread(): Done retrieving: data size 43559249
Sun 19 Jan 2014 08:19:31 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:19:31 - XML: Start document: iteration 12
Sun 19 Jan 2014 08:19:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:19:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:19:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:19:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:19:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:19:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:19:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:19:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:19:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:19:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:19:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:19:43 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 08:19:43 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:19:43 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:19:43 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:19:43 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:19:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:19:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:19:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:19:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:19:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:19:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:19:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:19:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:19:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:19:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:19:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:19:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43546054
Sun 19 Jan 2014 08:19:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:19:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43546054
Sun 19 Jan 2014 08:19:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:19:56 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:19:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 08:19:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:19:58 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:19:58 - job_xml_thread(): Done retrieving: data size 43546054
Sun 19 Jan 2014 08:19:58 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:19:58 - XML: Start document: iteration 13
Sun 19 Jan 2014 08:20:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:20:01 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:20:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:20:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:20:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:20:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:20:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:20:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:20:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:20:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:20:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:20:11 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 08:20:11 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:20:11 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:20:11 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:20:11 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:20:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:20:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:20:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:20:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:20:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:20:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:20:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:20:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:20:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:20:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43540761
Sun 19 Jan 2014 08:20:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:20:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:20:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:20:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43540761
Sun 19 Jan 2014 08:20:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:20:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:20:21 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:20:23 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:20:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 08:20:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:20:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 08:20:23 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:20:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6276 values 98992 bits 12374 bytes 
Sun 19 Jan 2014 08:20:26 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:20:26 - job_xml_thread(): Done retrieving: data size 43540761
Sun 19 Jan 2014 08:20:26 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:20:26 - XML: Start document: iteration 14
Sun 19 Jan 2014 08:20:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:20:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:20:29 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:20:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:20:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:20:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:20:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:20:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:20:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:20:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:20:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:20:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:20:39 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:20:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:20:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:20:40 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 08:20:40 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:20:40 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:20:40 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:20:40 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:20:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:20:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:20:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:20:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:20:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:20:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43545527
Sun 19 Jan 2014 08:20:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:20:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43545527
Sun 19 Jan 2014 08:20:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:20:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:20:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:20:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:20:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:20:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:20:55 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:20:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:20:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:20:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:20:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:20:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:20:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:20:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:20:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:21:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:21:00 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:21:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:21:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:21:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:21:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:21:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:21:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:21:00 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:21:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 08:21:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:21:03 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 08:21:03 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 08:21:03 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:21:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:21:03 - job_xml_thread(): Done retrieving: data size 43581356
Sun 19 Jan 2014 08:21:03 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:21:03 - XML: Start document: iteration 15
Sun 19 Jan 2014 08:21:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581356
Sun 19 Jan 2014 08:21:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581356
Sun 19 Jan 2014 08:21:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:21:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:21:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:21:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:21:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:21:14 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:21:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:21:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:21:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:21:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:21:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:21:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:21:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:21:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:21:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:21:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:21:23 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:21:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:21:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 08:21:23 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:21:23 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:21:23 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 08:21:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 08:21:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5708 values 90014 bits 11251 bytes 
Sun 19 Jan 2014 08:21:23 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:21:23 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:21:23 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:21:23 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:21:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:21:26 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:21:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:21:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:21:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:21:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:21:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:21:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:21:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:21:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43540916
Sun 19 Jan 2014 08:21:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:21:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43540916
Sun 19 Jan 2014 08:21:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:21:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:21:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:21:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:21:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:21:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:21:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:21:38 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:21:38 - job_xml_thread(): Done retrieving: data size 43540916
Sun 19 Jan 2014 08:21:38 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:21:38 - XML: Start document: iteration 16
Sun 19 Jan 2014 08:21:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:21:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:21:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:21:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:21:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:21:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:21:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:21:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:21:51 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:21:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:21:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:21:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:21:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:21:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:21:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:21:52 - XML: Processed 653347 elements - found 0 jobs
Sun 19 Jan 2014 08:21:52 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:21:52 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:21:52 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:21:52 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:21:52 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:21:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 08:21:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:21:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:21:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:21:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:21:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554437
Sun 19 Jan 2014 08:21:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:21:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554437
Sun 19 Jan 2014 08:21:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:22:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:22:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:22:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:22:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:22:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:22:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:22:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:22:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:22:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554437
Sun 19 Jan 2014 08:22:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:22:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:22:07 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:22:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:22:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:22:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:22:14 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:22:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:22:15 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:22:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:22:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:22:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:22:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:22:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:22:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:22:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:22:17 - job_xml_thread(): Done retrieving: data size 43564973
Sun 19 Jan 2014 08:22:17 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:22:17 - XML: Start document: iteration 17
Sun 19 Jan 2014 08:22:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564973
Sun 19 Jan 2014 08:22:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:22:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:22:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:22:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:22:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:22:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:22:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:22:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564973
Sun 19 Jan 2014 08:22:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:22:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:22:24 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:22:28 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:22:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:22:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 08:22:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 08:22:28 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:22:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8933 values 140867 bits 17608 bytes 
Sun 19 Jan 2014 08:22:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:22:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:22:34 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 08:22:34 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:22:34 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:22:34 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:22:34 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:22:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:22:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:22:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:22:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:22:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:22:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:22:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:22:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:22:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:22:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:22:41 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:22:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:22:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:22:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:22:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:22:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:22:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:22:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:22:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572532
Sun 19 Jan 2014 08:22:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:22:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572532
Sun 19 Jan 2014 08:22:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:22:49 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:22:49 - job_xml_thread(): Done retrieving: data size 43572532
Sun 19 Jan 2014 08:22:49 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:22:49 - XML: Start document: iteration 18
Sun 19 Jan 2014 08:22:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:22:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:22:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:22:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:22:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:22:58 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:22:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:22:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:22:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:22:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:22:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:22:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:22:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:23:01 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 08:23:01 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:23:01 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:23:01 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:23:01 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:23:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:23:07 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:23:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:23:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:23:07 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:23:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 08:23:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:23:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:23:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:23:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:23:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:23:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:23:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579248
Sun 19 Jan 2014 08:23:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:23:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579248
Sun 19 Jan 2014 08:23:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:23:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:23:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:23:16 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:23:16 - job_xml_thread(): Done retrieving: data size 43579248
Sun 19 Jan 2014 08:23:16 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:23:16 - XML: Start document: iteration 19
Sun 19 Jan 2014 08:23:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:23:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:23:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:23:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:23:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:23:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:23:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:23:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:23:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:23:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:23:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:23:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:23:28 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:23:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:23:30 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:23:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 08:23:30 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:23:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5848 values 92237 bits 11529 bytes 
Sun 19 Jan 2014 08:23:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 08:23:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:23:31 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:23:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:23:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:23:32 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 08:23:32 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:23:32 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:23:32 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:23:32 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:23:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:23:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:23:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:23:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:23:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:23:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43142106
Sun 19 Jan 2014 08:23:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:23:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43142106
Sun 19 Jan 2014 08:23:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:23:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:23:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:23:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:23:46 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:23:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:23:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:23:47 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:23:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:23:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:23:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:23:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:23:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:23:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:23:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:23:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:23:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:23:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:23:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:23:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:23:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:23:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:23:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:23:50 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:23:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 08:23:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:23:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:23:52 - job_xml_thread(): Done retrieving: data size 42944776
Sun 19 Jan 2014 08:23:52 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:23:52 - XML: Start document: iteration 20
Sun 19 Jan 2014 08:23:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42944776
Sun 19 Jan 2014 08:23:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:23:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42944776
Sun 19 Jan 2014 08:23:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:24:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:24:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:24:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:24:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:24:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:24:06 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:24:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:24:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:24:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:24:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:24:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:24:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:24:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:24:12 - XML: Processed 645372 elements - found 0 jobs
Sun 19 Jan 2014 08:24:12 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:24:12 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:24:12 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:24:12 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:24:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:24:14 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:24:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:24:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:24:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:24:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:24:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:24:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:24:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:24:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42971067
Sun 19 Jan 2014 08:24:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:24:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42971067
Sun 19 Jan 2014 08:24:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:24:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:24:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:24:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:24:27 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:24:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:24:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:24:27 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:24:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:24:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:24:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:24:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:24:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:24:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:24:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:24:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:24:30 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:24:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:24:30 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:24:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 08:24:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 08:24:30 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:24:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9088 values 143396 bits 17924 bytes 
Sun 19 Jan 2014 08:24:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:24:31 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:24:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:24:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:24:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:24:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:24:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:24:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:24:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:24:33 - job_xml_thread(): Done retrieving: data size 42994236
Sun 19 Jan 2014 08:24:33 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:24:33 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 08:24:34 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 08:24:34 - Housekeeping: done.
Sun 19 Jan 2014 08:24:34 - XML: Start document: iteration 0
Sun 19 Jan 2014 08:24:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42994236
Sun 19 Jan 2014 08:24:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:24:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42994236
Sun 19 Jan 2014 08:24:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:24:40 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 08:24:40 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:24:42 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:24:42 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 08:24:42 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:24:42 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 08:24:42 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 08:24:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:24:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:24:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:24:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:24:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:24:47 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:24:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:24:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:24:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:24:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:24:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:24:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:24:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:24:52 - XML: Processed 645912 elements - found 0 jobs
Sun 19 Jan 2014 08:24:52 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:24:52 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:24:52 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:24:52 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:24:54 - size of cluster 'LISA Cluster': 624 hosts 79469 metrics 850376 values 13409074 bits 1676134 bytes 
Sun 19 Jan 2014 08:24:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:24:57 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:24:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:24:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:24:57 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:24:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 08:24:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:24:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:24:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:24:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:24:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:25:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:25:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43546184
Sun 19 Jan 2014 08:25:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:25:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43546184
Sun 19 Jan 2014 08:25:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:25:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:25:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:25:07 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:25:07 - job_xml_thread(): Done retrieving: data size 43546184
Sun 19 Jan 2014 08:25:07 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:25:07 - XML: Start document: iteration 1
Sun 19 Jan 2014 08:25:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:25:10 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:25:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:25:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:25:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:25:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:25:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:25:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:25:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:25:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:25:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:25:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:25:20 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:25:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:25:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:25:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:25:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:25:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:25:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:25:22 - XML: Processed 653298 elements - found 0 jobs
Sun 19 Jan 2014 08:25:22 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:25:22 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:25:22 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:25:22 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:25:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:25:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557763
Sun 19 Jan 2014 08:25:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:25:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:25:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:25:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557763
Sun 19 Jan 2014 08:25:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:25:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:25:31 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:25:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:25:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 08:25:33 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:25:33 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:25:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 08:25:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9013 values 142143 bits 17767 bytes 
Sun 19 Jan 2014 08:25:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:25:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:25:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:25:37 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:25:37 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:25:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:25:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:25:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:25:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:25:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:25:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:25:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:25:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:25:41 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:25:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:25:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:25:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:25:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:25:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:25:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:25:42 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:25:42 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 08:25:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:25:45 - job_xml_thread(): Done retrieving: data size 43556757
Sun 19 Jan 2014 08:25:45 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:25:45 - XML: Start document: iteration 2
Sun 19 Jan 2014 08:25:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556757
Sun 19 Jan 2014 08:25:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:25:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556757
Sun 19 Jan 2014 08:25:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:25:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:25:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:25:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:25:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:26:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:26:03 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:26:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:26:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:26:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:26:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:26:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:26:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:26:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:26:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:26:07 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:26:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:26:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:26:07 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:26:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 08:26:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:26:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:26:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:26:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:26:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:26:08 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 08:26:08 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:26:08 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:26:08 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:26:08 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:26:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:26:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567773
Sun 19 Jan 2014 08:26:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:26:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567773
Sun 19 Jan 2014 08:26:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:26:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:26:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:26:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:26:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:26:24 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:26:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:26:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:26:25 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:26:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:26:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:26:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:26:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:26:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:26:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:26:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:26:27 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:26:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:26:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:26:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:26:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:26:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:26:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:26:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:26:31 - job_xml_thread(): Done retrieving: data size 43571225
Sun 19 Jan 2014 08:26:31 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:26:31 - XML: Start document: iteration 3
Sun 19 Jan 2014 08:26:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571225
Sun 19 Jan 2014 08:26:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:26:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571225
Sun 19 Jan 2014 08:26:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:26:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:26:34 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:26:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:26:34 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:26:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 08:26:34 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:26:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 08:26:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6091 values 96069 bits 12008 bytes 
Sun 19 Jan 2014 08:26:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:26:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:26:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:26:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:26:52 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 08:26:52 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:26:52 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:26:52 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:26:52 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:26:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:26:53 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:26:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:26:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:26:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:26:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:26:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:26:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:26:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:26:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:26:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:26:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:26:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:26:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:26:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:26:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:26:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:26:59 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:26:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 08:26:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:27:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:27:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574151
Sun 19 Jan 2014 08:27:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:27:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574151
Sun 19 Jan 2014 08:27:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:27:07 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:27:07 - job_xml_thread(): Done retrieving: data size 43574151
Sun 19 Jan 2014 08:27:07 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:27:07 - XML: Start document: iteration 4
Sun 19 Jan 2014 08:27:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:27:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:27:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:27:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:27:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:27:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:27:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:27:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:27:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:27:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:27:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:27:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:27:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:27:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:27:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:27:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:27:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:27:23 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 08:27:23 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:27:23 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:27:23 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:27:23 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:27:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:27:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:27:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:27:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:27:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:27:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564739
Sun 19 Jan 2014 08:27:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:27:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564739
Sun 19 Jan 2014 08:27:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:27:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:27:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:27:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:27:35 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:27:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:27:36 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:27:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:27:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:27:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:27:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:27:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:27:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:27:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:27:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:27:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 08:27:36 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:27:36 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:27:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 08:27:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6305 values 99460 bits 12432 bytes 
Sun 19 Jan 2014 08:27:38 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:27:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:27:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:27:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:27:42 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:27:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:27:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:27:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:27:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:27:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:27:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:27:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:27:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557376
Sun 19 Jan 2014 08:27:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:27:46 - job_xml_thread(): Done retrieving: data size 43557376
Sun 19 Jan 2014 08:27:46 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:27:46 - XML: Start document: iteration 5
Sun 19 Jan 2014 08:27:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557376
Sun 19 Jan 2014 08:27:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:27:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:27:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:27:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:27:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:27:58 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:27:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 08:27:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:28:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:28:00 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:28:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:28:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:28:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:28:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:28:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:28:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:28:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:28:09 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 08:28:09 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:28:09 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:28:09 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:28:09 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:28:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:28:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:28:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:28:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:28:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:28:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:28:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:28:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:28:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:28:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553348
Sun 19 Jan 2014 08:28:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:28:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553348
Sun 19 Jan 2014 08:28:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:28:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:28:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:28:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:28:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:28:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:28:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:28:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:28:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:28:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:28:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:28:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:28:24 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:28:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:28:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:28:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:28:28 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:28:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:28:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:28:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:28:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:28:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:28:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:28:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:28:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563529
Sun 19 Jan 2014 08:28:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:28:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563529
Sun 19 Jan 2014 08:28:31 - job_xml_thread(): Done retrieving: data size 43563529
Sun 19 Jan 2014 08:28:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:28:32 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:28:32 - XML: Start document: iteration 6
Sun 19 Jan 2014 08:28:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:28:37 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:28:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:28:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:28:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:28:38 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:28:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 08:28:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 08:28:38 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:28:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9140 values 144189 bits 18023 bytes 
Sun 19 Jan 2014 08:28:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:28:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:28:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:28:45 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:28:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:28:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:28:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:28:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:28:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:28:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:28:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:28:54 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 08:28:54 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:28:54 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:28:54 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:28:54 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:28:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:28:54 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:28:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:28:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:28:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:28:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:28:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:28:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:28:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:28:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554543
Sun 19 Jan 2014 08:28:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:28:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554543
Sun 19 Jan 2014 08:28:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:29:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:29:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:29:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:29:07 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:29:10 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:29:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:29:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:29:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:29:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:29:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:29:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:29:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:29:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:29:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:29:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:29:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:29:13 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:29:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 08:29:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:29:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:29:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:29:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:29:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:29:14 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 08:29:14 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 08:29:14 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:29:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:29:15 - job_xml_thread(): Done retrieving: data size 43509039
Sun 19 Jan 2014 08:29:15 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:29:15 - XML: Start document: iteration 7
Sun 19 Jan 2014 08:29:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43509039
Sun 19 Jan 2014 08:29:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43509039
Sun 19 Jan 2014 08:29:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:29:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:29:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:29:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:29:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:29:27 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:29:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:29:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:29:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:29:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:29:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:29:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:29:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:29:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:29:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:29:35 - XML: Processed 652600 elements - found 0 jobs
Sun 19 Jan 2014 08:29:35 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:29:35 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:29:35 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:29:35 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:29:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:29:37 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:29:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:29:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:29:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:29:38 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:29:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:29:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:29:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:29:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:29:39 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:29:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:29:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 08:29:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 08:29:39 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:29:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5744 values 90531 bits 11316 bytes 
Sun 19 Jan 2014 08:29:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:29:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43084759
Sun 19 Jan 2014 08:29:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:29:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43084759
Sun 19 Jan 2014 08:29:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:29:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:29:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:29:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:29:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:29:50 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:29:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:29:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:29:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:29:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:29:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:29:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:29:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:29:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:29:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:29:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:29:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:29:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:29:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:29:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:29:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:29:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:29:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:29:55 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:29:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 08:29:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:29:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:29:56 - job_xml_thread(): Done retrieving: data size 42927417
Sun 19 Jan 2014 08:29:56 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:29:56 - XML: Start document: iteration 8
Sun 19 Jan 2014 08:29:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42927417
Sun 19 Jan 2014 08:29:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:29:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42927417
Sun 19 Jan 2014 08:29:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:30:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:30:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:30:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:30:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:30:16 - XML: Processed 645318 elements - found 0 jobs
Sun 19 Jan 2014 08:30:16 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:30:16 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:30:16 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:30:16 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:30:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:30:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:30:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:30:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:30:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:30:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:30:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:30:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:30:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:30:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:30:19 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:30:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:30:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:30:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:30:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:30:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:30:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:30:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:30:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43000731
Sun 19 Jan 2014 08:30:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:30:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43000731
Sun 19 Jan 2014 08:30:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:30:31 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:30:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:30:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:30:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:30:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:30:34 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:30:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:30:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:30:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:30:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:30:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:30:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:30:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:30:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:30:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:30:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:30:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:30:35 - job_xml_thread(): Done retrieving: data size 43328958
Sun 19 Jan 2014 08:30:35 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:30:35 - XML: Start document: iteration 9
Sun 19 Jan 2014 08:30:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:30:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:30:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:30:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43328958
Sun 19 Jan 2014 08:30:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:30:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:30:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43328958
Sun 19 Jan 2014 08:30:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:30:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:30:39 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:30:40 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:30:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 08:30:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:30:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 08:30:40 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:30:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 10089 values 159069 bits 19883 bytes 
Sun 19 Jan 2014 08:30:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:30:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:30:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:30:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:30:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:30:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:30:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:30:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:30:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:30:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:30:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:30:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:30:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:30:56 - XML: Processed 650216 elements - found 0 jobs
Sun 19 Jan 2014 08:30:56 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:30:56 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:30:56 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:30:56 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:30:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:30:59 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:30:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:30:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:30:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:30:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:30:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:30:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:31:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:31:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43542224
Sun 19 Jan 2014 08:31:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:31:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43542224
Sun 19 Jan 2014 08:31:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:31:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:31:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:31:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:31:10 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:31:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:31:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:31:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:31:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:31:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:31:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:31:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43542224
Sun 19 Jan 2014 08:31:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:31:12 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:31:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:31:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:31:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:31:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:31:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:31:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:31:24 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:31:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:31:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:31:24 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:31:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 08:31:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:31:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:31:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:31:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:31:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:31:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:31:26 - job_xml_thread(): Done retrieving: data size 43557605
Sun 19 Jan 2014 08:31:26 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:31:26 - XML: Start document: iteration 10
Sun 19 Jan 2014 08:31:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:31:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:31:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557605
Sun 19 Jan 2014 08:31:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:31:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:31:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:31:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:31:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557605
Sun 19 Jan 2014 08:31:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:31:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:31:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:31:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:31:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:31:40 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:31:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:31:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 08:31:40 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:31:40 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:31:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 08:31:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5812 values 91696 bits 11462 bytes 
Sun 19 Jan 2014 08:31:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:31:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:31:42 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 08:31:42 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:31:43 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:31:43 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 08:31:43 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 08:31:43 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:31:43 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 08:31:44 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 08:31:44 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:31:44 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:31:44 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:31:44 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:31:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:31:47 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:31:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:31:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:31:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:31:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:31:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:31:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:31:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:31:48 - size of cluster 'LISA Cluster': 624 hosts 79476 metrics 768854 values 12117379 bits 1514672 bytes 
Sun 19 Jan 2014 08:31:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:31:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:31:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:31:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:31:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:31:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:31:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:31:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:31:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:31:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580610
Sun 19 Jan 2014 08:31:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:31:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580610
Sun 19 Jan 2014 08:31:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:31:59 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:32:00 - job_xml_thread(): Done retrieving: data size 43580610
Sun 19 Jan 2014 08:32:01 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:32:01 - XML: Start document: iteration 11
Sun 19 Jan 2014 08:32:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:32:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:32:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:32:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:32:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:32:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:32:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:32:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:32:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:32:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:32:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:32:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:32:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:32:11 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:32:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 08:32:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:32:14 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 08:32:14 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:32:14 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:32:14 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:32:15 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:32:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:32:17 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:32:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:32:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:32:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:32:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:32:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:32:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:32:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:32:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558151
Sun 19 Jan 2014 08:32:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:32:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558151
Sun 19 Jan 2014 08:32:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:32:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:32:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:32:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:32:28 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:32:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:32:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:32:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:32:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:32:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:32:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:32:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558151
Sun 19 Jan 2014 08:32:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:32:30 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:32:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:32:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:32:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:32:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:32:39 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:32:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:32:40 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:32:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:32:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 08:32:41 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:32:41 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:32:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 08:32:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6043 values 95708 bits 11963 bytes 
Sun 19 Jan 2014 08:32:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:32:42 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:32:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:32:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:32:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:32:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:32:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:32:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:32:43 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:32:43 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 08:32:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:32:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:32:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:32:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:32:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:32:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:32:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:32:46 - job_xml_thread(): Done retrieving: data size 43544528
Sun 19 Jan 2014 08:32:46 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:32:46 - XML: Start document: iteration 12
Sun 19 Jan 2014 08:32:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43544528
Sun 19 Jan 2014 08:32:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:32:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43544528
Sun 19 Jan 2014 08:32:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:32:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:32:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:32:58 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 08:32:58 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:32:58 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:32:58 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:32:58 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:32:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:32:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:33:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:33:07 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:33:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:33:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:33:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:33:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:33:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:33:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:33:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:33:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:33:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:33:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:33:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:33:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:33:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:33:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:33:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:33:10 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:33:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 08:33:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:33:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:33:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575064
Sun 19 Jan 2014 08:33:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:33:13 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:33:13 - job_xml_thread(): Done retrieving: data size 43575064
Sun 19 Jan 2014 08:33:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575064
Sun 19 Jan 2014 08:33:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:33:13 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:33:13 - XML: Start document: iteration 13
Sun 19 Jan 2014 08:33:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:33:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:33:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:33:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:33:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:33:30 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:33:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:33:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:33:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:33:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:33:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:33:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:33:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:33:33 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 08:33:33 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:33:33 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:33:33 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:33:33 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:33:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:33:35 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:33:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:33:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:33:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:33:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:33:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:33:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:33:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:33:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579651
Sun 19 Jan 2014 08:33:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:33:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579651
Sun 19 Jan 2014 08:33:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:33:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:33:41 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:33:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:33:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 08:33:42 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:33:42 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:33:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8743 values 138063 bits 17257 bytes 
Sun 19 Jan 2014 08:33:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 08:33:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:33:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:33:48 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:33:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:33:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:33:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:33:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:33:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:33:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:33:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:33:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:33:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:33:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:33:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:33:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:33:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:33:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:33:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:33:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:33:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:33:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:33:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:33:58 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:33:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 08:33:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:33:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:33:58 - job_xml_thread(): Done retrieving: data size 43556505
Sun 19 Jan 2014 08:33:58 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:33:58 - XML: Start document: iteration 14
Sun 19 Jan 2014 08:33:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556505
Sun 19 Jan 2014 08:33:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:33:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556505
Sun 19 Jan 2014 08:33:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:34:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:34:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:34:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:34:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:34:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:34:13 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:34:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:34:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:34:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:34:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:34:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:34:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:34:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:34:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:34:21 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:34:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:34:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:34:22 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 08:34:22 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:34:22 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:34:22 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:34:22 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:34:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:34:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:34:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:34:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:34:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:34:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581569
Sun 19 Jan 2014 08:34:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:34:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581569
Sun 19 Jan 2014 08:34:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:34:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:34:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:34:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:34:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:34:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:34:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:34:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:34:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:34:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:34:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:34:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581569
Sun 19 Jan 2014 08:34:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:34:37 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:34:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:34:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:34:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:34:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:34:43 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:34:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:34:43 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:34:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:34:44 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:34:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 08:34:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 08:34:44 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:34:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99042 bits 12380 bytes 
Sun 19 Jan 2014 08:34:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:34:47 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:34:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:34:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:34:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:34:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:34:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:34:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:34:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:34:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:34:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:34:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:34:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:34:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:34:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:34:52 - job_xml_thread(): Done retrieving: data size 43560592
Sun 19 Jan 2014 08:34:52 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:34:52 - XML: Start document: iteration 15
Sun 19 Jan 2014 08:34:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560592
Sun 19 Jan 2014 08:34:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:34:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560592
Sun 19 Jan 2014 08:34:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:35:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:35:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:35:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:35:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:35:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:35:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:35:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:35:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:35:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:35:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:35:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:35:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:35:09 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:35:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 08:35:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:35:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:35:12 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 08:35:12 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:35:12 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:35:12 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:35:12 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:35:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:35:14 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:35:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:35:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:35:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:35:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:35:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:35:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:35:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:35:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43500379
Sun 19 Jan 2014 08:35:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:35:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43500379
Sun 19 Jan 2014 08:35:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:35:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:35:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:35:27 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:35:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:35:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:35:28 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:35:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:35:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:35:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:35:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:35:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:35:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:35:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:35:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:35:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:35:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:35:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:35:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:35:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:35:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:35:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:35:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:35:34 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 08:35:34 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 08:35:34 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:35:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:35:35 - job_xml_thread(): Done retrieving: data size 43126242
Sun 19 Jan 2014 08:35:35 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:35:35 - XML: Start document: iteration 16
Sun 19 Jan 2014 08:35:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43126242
Sun 19 Jan 2014 08:35:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:35:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43126242
Sun 19 Jan 2014 08:35:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:35:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:35:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:35:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:35:44 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:35:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:35:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 08:35:45 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:35:45 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:35:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 08:35:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9199 values 145119 bits 18139 bytes 
Sun 19 Jan 2014 08:35:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:35:46 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:35:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:35:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:35:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:35:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:35:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:35:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:35:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:35:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:35:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:35:56 - XML: Processed 647732 elements - found 0 jobs
Sun 19 Jan 2014 08:35:56 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:35:56 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:35:56 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:35:56 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:35:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:35:57 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:35:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:35:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:35:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:35:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:35:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:35:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:35:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:35:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42896741
Sun 19 Jan 2014 08:35:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:36:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42896741
Sun 19 Jan 2014 08:36:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:36:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:36:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:36:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:36:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:36:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:36:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:36:11 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:36:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:36:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:36:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:36:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:36:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:36:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:36:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:36:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:36:14 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:36:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:36:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:36:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:36:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:36:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:36:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:36:14 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:36:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 08:36:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:36:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:36:16 - job_xml_thread(): Done retrieving: data size 42986086
Sun 19 Jan 2014 08:36:16 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:36:16 - XML: Start document: iteration 17
Sun 19 Jan 2014 08:36:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42986086
Sun 19 Jan 2014 08:36:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:36:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42986086
Sun 19 Jan 2014 08:36:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:36:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:36:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:36:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:36:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:36:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:36:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:36:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:36:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:36:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:36:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:36:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:36:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:36:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:36:37 - XML: Processed 645900 elements - found 0 jobs
Sun 19 Jan 2014 08:36:37 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:36:37 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:36:37 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:36:37 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:36:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:36:40 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:36:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:36:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:36:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:36:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:36:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:36:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:36:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:36:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43433291
Sun 19 Jan 2014 08:36:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:36:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43433291
Sun 19 Jan 2014 08:36:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:36:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:36:45 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:36:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:36:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 08:36:48 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:36:48 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:36:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8966 values 141403 bits 17675 bytes 
Sun 19 Jan 2014 08:36:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:36:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:36:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 08:36:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:36:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:36:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:36:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:36:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:36:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:36:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:36:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:36:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:36:53 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:36:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:36:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:36:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:36:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:36:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:36:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:36:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:36:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:36:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:36:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560042
Sun 19 Jan 2014 08:36:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:36:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560042
Sun 19 Jan 2014 08:36:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:36:58 - job_xml_thread(): Done retrieving: data size 43560042
Sun 19 Jan 2014 08:36:58 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:36:58 - XML: Start document: iteration 18
Sun 19 Jan 2014 08:37:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:37:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:37:08 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:37:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 08:37:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:37:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:37:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:37:16 - XML: Processed 653296 elements - found 0 jobs
Sun 19 Jan 2014 08:37:17 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:37:17 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:37:17 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:37:17 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:37:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:37:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:37:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:37:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:37:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:37:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:37:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:37:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:37:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:37:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:37:20 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:37:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:37:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:37:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:37:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:37:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:37:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:37:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:37:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43593637
Sun 19 Jan 2014 08:37:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:37:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43593637
Sun 19 Jan 2014 08:37:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:37:32 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:37:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:37:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:37:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:37:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:37:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:37:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:37:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:37:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:37:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:37:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:37:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:37:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:37:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:37:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:37:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:37:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:37:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:37:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:37:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:37:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:37:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:37:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:37:39 - job_xml_thread(): Done retrieving: data size 43582889
Sun 19 Jan 2014 08:37:39 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:37:39 - XML: Start document: iteration 19
Sun 19 Jan 2014 08:37:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582889
Sun 19 Jan 2014 08:37:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:37:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582889
Sun 19 Jan 2014 08:37:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:37:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:37:48 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:37:49 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:37:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 08:37:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:37:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 08:37:49 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:37:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:37:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:37:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9202 values 145189 bits 18148 bytes 
Sun 19 Jan 2014 08:37:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:37:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:37:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:37:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:37:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:37:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:37:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:37:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:37:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:37:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:37:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:38:00 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 08:38:00 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:38:00 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:38:00 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:38:00 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:38:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:38:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:38:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:38:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:38:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:38:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:38:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:38:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:38:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:38:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574315
Sun 19 Jan 2014 08:38:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:38:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574315
Sun 19 Jan 2014 08:38:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:38:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:38:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:38:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:38:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:38:15 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:38:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:38:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:38:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:38:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:38:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:38:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:38:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:38:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:38:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:38:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:38:20 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:38:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:38:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:38:21 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:38:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 08:38:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:38:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:38:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:38:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:38:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:38:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:38:22 - job_xml_thread(): Done retrieving: data size 43586791
Sun 19 Jan 2014 08:38:22 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:38:22 - XML: Start document: iteration 20
Sun 19 Jan 2014 08:38:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43586791
Sun 19 Jan 2014 08:38:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:38:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43586791
Sun 19 Jan 2014 08:38:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:38:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:38:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:38:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:38:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:38:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:38:43 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:38:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:38:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:38:43 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 08:38:43 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:38:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:38:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:38:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:38:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:38:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:38:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:38:44 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:38:44 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:38:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:38:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:38:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:38:44 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 08:38:44 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 08:38:44 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 08:38:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:38:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:38:46 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 08:38:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:38:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:38:46 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:38:46 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:38:46 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:38:46 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:38:46 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 837520 values 13205503 bits 1650687 bytes 
Sun 19 Jan 2014 08:38:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:38:49 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:38:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:38:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 08:38:49 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:38:49 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:38:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5594 values 88132 bits 11016 bytes 
Sun 19 Jan 2014 08:38:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 08:38:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:38:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43586165
Sun 19 Jan 2014 08:38:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:38:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43586165
Sun 19 Jan 2014 08:38:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:38:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:38:59 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:38:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:38:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:39:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:39:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:39:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:39:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:39:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43586165
Sun 19 Jan 2014 08:39:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:39:01 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:39:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:39:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:39:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:39:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:39:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:39:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:39:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:39:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:39:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:39:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:39:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:39:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:39:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:39:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:39:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:39:15 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:39:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 08:39:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:39:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:39:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:39:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:39:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:39:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:39:15 - job_xml_thread(): Done retrieving: data size 43544271
Sun 19 Jan 2014 08:39:15 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:39:15 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 08:39:15 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 08:39:15 - Housekeeping: done.
Sun 19 Jan 2014 08:39:15 - XML: Start document: iteration 0
Sun 19 Jan 2014 08:39:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43544271
Sun 19 Jan 2014 08:39:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43544271
Sun 19 Jan 2014 08:39:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:39:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:39:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:39:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:39:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:39:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:39:34 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 08:39:34 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:39:34 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:39:34 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:39:34 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:39:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:39:36 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:39:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:39:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:39:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:39:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:39:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:39:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:39:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:39:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:39:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:39:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:39:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:39:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:39:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:39:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:39:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:39:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:39:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572673
Sun 19 Jan 2014 08:39:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:39:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572673
Sun 19 Jan 2014 08:39:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:39:44 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:39:44 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 08:39:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:39:49 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:39:49 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:39:49 - job_xml_thread(): Done retrieving: data size 43572673
Sun 19 Jan 2014 08:39:49 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:39:49 - XML: Start document: iteration 1
Sun 19 Jan 2014 08:39:51 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:39:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:39:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 08:39:51 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:39:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 08:39:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:39:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:39:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7118 values 112180 bits 14022 bytes 
Sun 19 Jan 2014 08:39:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:39:54 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:39:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:39:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:39:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:39:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:39:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:39:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:39:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:39:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:39:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:40:04 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 08:40:04 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:40:04 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:40:04 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:40:04 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:40:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:40:05 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:40:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:40:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:40:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:40:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:40:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:40:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:40:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:40:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564114
Sun 19 Jan 2014 08:40:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:40:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564114
Sun 19 Jan 2014 08:40:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:40:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:40:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:40:19 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:40:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:40:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:40:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:40:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:40:20 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:40:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:40:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:40:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:40:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:40:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:40:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:40:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:40:26 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:40:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:40:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:40:26 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:40:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 08:40:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:40:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:40:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:40:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:40:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:40:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:40:29 - job_xml_thread(): Done retrieving: data size 43555503
Sun 19 Jan 2014 08:40:29 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:40:29 - XML: Start document: iteration 2
Sun 19 Jan 2014 08:40:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555503
Sun 19 Jan 2014 08:40:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555503
Sun 19 Jan 2014 08:40:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:40:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:40:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:40:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:40:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:40:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:40:43 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 08:40:43 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:40:43 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:40:43 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:40:43 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:40:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:40:47 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:40:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:40:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:40:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:40:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:40:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:40:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:40:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:40:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:40:52 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:40:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:40:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 08:40:52 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:40:52 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:40:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 08:40:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5751 values 90626 bits 11328 bytes 
Sun 19 Jan 2014 08:40:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:40:53 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:40:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:40:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:40:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:40:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:40:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:40:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:40:56 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:40:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 08:40:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:40:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:40:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584274
Sun 19 Jan 2014 08:40:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:40:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584274
Sun 19 Jan 2014 08:40:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:40:58 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:40:58 - job_xml_thread(): Done retrieving: data size 43584274
Sun 19 Jan 2014 08:40:58 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:40:58 - XML: Start document: iteration 3
Sun 19 Jan 2014 08:41:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:41:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:41:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:41:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:41:10 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 08:41:10 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:41:10 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:41:10 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:41:10 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:41:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:41:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:41:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:41:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:41:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:41:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:41:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:41:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:41:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:41:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:41:18 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:41:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:41:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:41:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:41:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:41:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:41:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:41:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:41:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43519875
Sun 19 Jan 2014 08:41:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:41:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43519875
Sun 19 Jan 2014 08:41:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:41:26 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:41:26 - job_xml_thread(): Done retrieving: data size 43519875
Sun 19 Jan 2014 08:41:26 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:41:26 - XML: Start document: iteration 4
Sun 19 Jan 2014 08:41:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:41:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:41:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:41:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:41:36 - XML: Processed 652600 elements - found 0 jobs
Sun 19 Jan 2014 08:41:36 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:41:36 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:41:36 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:41:36 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:41:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:41:39 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:41:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:41:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:41:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:41:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:41:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:41:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:41:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:41:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:41:42 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:41:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:41:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:41:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:41:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:41:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:41:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:41:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:41:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42964047
Sun 19 Jan 2014 08:41:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:41:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42964047
Sun 19 Jan 2014 08:41:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:41:51 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:41:52 - job_xml_thread(): Done retrieving: data size 42964047
Sun 19 Jan 2014 08:41:52 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:41:52 - XML: Start document: iteration 5
Sun 19 Jan 2014 08:41:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:41:53 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:41:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:41:53 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:41:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 08:41:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 08:41:54 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:41:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:41:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:41:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148550 bits 18568 bytes 
Sun 19 Jan 2014 08:41:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:41:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:41:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:41:59 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:41:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:41:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:42:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:42:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:42:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:42:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:42:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:42:04 - XML: Processed 645911 elements - found 0 jobs
Sun 19 Jan 2014 08:42:04 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:42:04 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:42:04 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:42:04 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:42:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:42:07 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:42:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:42:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:42:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:42:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:42:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:42:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:42:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:42:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42925088
Sun 19 Jan 2014 08:42:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:42:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42925088
Sun 19 Jan 2014 08:42:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:42:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:42:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:42:19 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:42:19 - job_xml_thread(): Done retrieving: data size 42925088
Sun 19 Jan 2014 08:42:19 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:42:19 - XML: Start document: iteration 6
Sun 19 Jan 2014 08:42:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:42:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:42:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:42:25 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:42:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:42:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:42:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:42:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:42:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:42:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:42:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:42:31 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:42:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 08:42:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:42:32 - XML: Processed 645342 elements - found 0 jobs
Sun 19 Jan 2014 08:42:32 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:42:32 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:42:32 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:42:32 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:42:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:42:35 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:42:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:42:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:42:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:42:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:42:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:42:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:42:36 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 08:42:36 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 08:42:36 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:42:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:42:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43141033
Sun 19 Jan 2014 08:42:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:42:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43141033
Sun 19 Jan 2014 08:42:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:42:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:42:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:42:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:42:46 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:42:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:42:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:42:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:42:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:42:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:42:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:42:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43141033
Sun 19 Jan 2014 08:42:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:42:47 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:42:47 - job_xml_thread(): Done retrieving: data size 43141033
Sun 19 Jan 2014 08:42:47 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:42:47 - XML: Start document: iteration 7
Sun 19 Jan 2014 08:42:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:42:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:42:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:42:54 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:42:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:42:56 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:42:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 08:42:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 08:42:56 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:42:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5867 values 92501 bits 11562 bytes 
Sun 19 Jan 2014 08:43:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:43:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:43:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:43:04 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:43:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:43:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:43:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:43:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:43:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:43:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:43:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:43:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:43:06 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:43:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:43:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:43:07 - XML: Processed 648020 elements - found 0 jobs
Sun 19 Jan 2014 08:43:07 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:43:07 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:43:07 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:43:07 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:43:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:43:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:43:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:43:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:43:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:43:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43592955
Sun 19 Jan 2014 08:43:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:43:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43592955
Sun 19 Jan 2014 08:43:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:43:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:43:19 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:43:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:43:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:43:22 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:43:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:43:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:43:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:43:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:43:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:43:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:43:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:43:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:43:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:43:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:43:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:43:24 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:43:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 08:43:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:43:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:43:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:43:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:43:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:43:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:43:25 - job_xml_thread(): Done retrieving: data size 43584600
Sun 19 Jan 2014 08:43:25 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:43:25 - XML: Start document: iteration 8
Sun 19 Jan 2014 08:43:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584600
Sun 19 Jan 2014 08:43:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:43:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584600
Sun 19 Jan 2014 08:43:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:43:35 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 08:43:35 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:43:35 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:43:35 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:43:35 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:43:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:43:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:43:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:43:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:43:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:43:43 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:43:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:43:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:43:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:43:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:43:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:43:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:43:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:43:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:43:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:43:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:43:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:43:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:43:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:43:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:43:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:43:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:43:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576936
Sun 19 Jan 2014 08:43:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:43:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576936
Sun 19 Jan 2014 08:43:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:43:50 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:43:50 - job_xml_thread(): Done retrieving: data size 43576936
Sun 19 Jan 2014 08:43:50 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:43:50 - XML: Start document: iteration 9
Sun 19 Jan 2014 08:43:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:43:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:43:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:43:56 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:43:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:43:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 08:43:57 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:43:57 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:43:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 08:43:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8792 values 138650 bits 17331 bytes 
Sun 19 Jan 2014 08:44:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:44:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:44:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:44:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:44:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:44:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:44:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:44:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:44:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:44:05 - XML: Processed 653347 elements - found 0 jobs
Sun 19 Jan 2014 08:44:05 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:44:05 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:44:05 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:44:05 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:44:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:44:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:44:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:44:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:44:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:44:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:44:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:44:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:44:12 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:44:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 08:44:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:44:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:44:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559691
Sun 19 Jan 2014 08:44:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:44:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559691
Sun 19 Jan 2014 08:44:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:44:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:44:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:44:20 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:44:21 - job_xml_thread(): Done retrieving: data size 43559691
Sun 19 Jan 2014 08:44:21 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:44:21 - XML: Start document: iteration 10
Sun 19 Jan 2014 08:44:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:44:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:44:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:44:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:44:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:44:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:44:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:44:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:44:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:44:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:44:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:44:32 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 08:44:32 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:44:32 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:44:32 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:44:32 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:44:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:44:34 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:44:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:44:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:44:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:44:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:44:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:44:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:44:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:44:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565539
Sun 19 Jan 2014 08:44:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:44:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565539
Sun 19 Jan 2014 08:44:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:44:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:44:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:44:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:44:45 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:44:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:44:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:44:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:44:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:44:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:44:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:44:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:44:47 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:44:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:44:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:44:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:44:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:44:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:44:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:44:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:44:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:44:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:44:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43593801
Sun 19 Jan 2014 08:44:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:44:52 - job_xml_thread(): Done retrieving: data size 43593801
Sun 19 Jan 2014 08:44:52 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:44:52 - XML: Start document: iteration 11
Sun 19 Jan 2014 08:44:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43593801
Sun 19 Jan 2014 08:44:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:44:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:44:57 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:44:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:44:59 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:44:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 08:44:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 08:44:59 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:45:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:45:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:45:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148547 bits 18568 bytes 
Sun 19 Jan 2014 08:45:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:45:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:45:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:45:06 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:45:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:45:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:45:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:45:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:45:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:45:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:45:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:45:08 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 08:45:08 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:45:08 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:45:08 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:45:08 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:45:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:45:15 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:45:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:45:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:45:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:45:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:45:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:45:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:45:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:45:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555307
Sun 19 Jan 2014 08:45:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:45:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555307
Sun 19 Jan 2014 08:45:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:45:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:45:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:45:23 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:45:23 - job_xml_thread(): Done retrieving: data size 43555307
Sun 19 Jan 2014 08:45:23 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:45:23 - XML: Start document: iteration 12
Sun 19 Jan 2014 08:45:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:45:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:45:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:45:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:45:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:45:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:45:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:45:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:45:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:45:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:45:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:45:35 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 08:45:35 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:45:35 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:45:35 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:45:35 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:45:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:45:40 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:45:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:45:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:45:41 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:45:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 08:45:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:45:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:45:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:45:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:45:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:45:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:45:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563732
Sun 19 Jan 2014 08:45:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:45:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563732
Sun 19 Jan 2014 08:45:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:45:45 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 08:45:45 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:45:45 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:45:45 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:45:45 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 08:45:45 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 08:45:45 - Entering storeMetrics(): cluster LISA Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sun 19 Jan 2014 08:45:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:45:50 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:45:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:45:50 - job_xml_thread(): Done retrieving: data size 43563732
Sun 19 Jan 2014 08:45:51 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:45:51 - XML: Start document: iteration 13
Sun 19 Jan 2014 08:45:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:45:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:45:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:45:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:45:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:45:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:45:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:45:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:45:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:45:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:45:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:45:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:45:59 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:46:00 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:46:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 08:46:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:46:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 08:46:00 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:46:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5267 values 83031 bits 10378 bytes 
Sun 19 Jan 2014 08:46:02 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 08:46:02 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:46:02 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:46:02 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:46:02 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:46:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:46:05 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:46:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:46:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:46:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:46:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:46:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:46:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:46:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:46:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572802
Sun 19 Jan 2014 08:46:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:46:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572802
Sun 19 Jan 2014 08:46:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:46:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:46:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:46:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:46:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:46:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:46:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:46:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:46:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:46:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:46:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:46:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572802
Sun 19 Jan 2014 08:46:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:46:17 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:46:17 - job_xml_thread(): Done retrieving: data size 43572802
Sun 19 Jan 2014 08:46:17 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:46:17 - XML: Start document: iteration 14
Sun 19 Jan 2014 08:46:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:46:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:46:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:46:28 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:46:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:46:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:46:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:46:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:46:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:46:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:46:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:46:32 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 08:46:32 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:46:32 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:46:32 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:46:32 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:46:34 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:46:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 08:46:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:46:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:46:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:46:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:46:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:46:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:46:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:46:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:46:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:46:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:46:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43593083
Sun 19 Jan 2014 08:46:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:46:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43593083
Sun 19 Jan 2014 08:46:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:46:45 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:46:45 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:46:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:46:46 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:46:47 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:46:47 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 08:46:47 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:46:47 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 08:46:47 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 08:46:47 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:46:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:46:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:46:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:46:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:46:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:46:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:46:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sun 19 Jan 2014 08:46:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:46:51 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:46:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:46:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:46:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:46:52 - job_xml_thread(): Done retrieving: data size 43594131
Sun 19 Jan 2014 08:46:52 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:46:52 - XML: Start document: iteration 15
Sun 19 Jan 2014 08:46:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43594131
Sun 19 Jan 2014 08:46:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:46:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:46:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:46:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:46:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43594131
Sun 19 Jan 2014 08:46:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:46:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:47:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:47:00 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:47:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:47:02 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:47:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 08:47:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 08:47:02 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:47:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8951 values 141504 bits 17688 bytes 
Sun 19 Jan 2014 08:47:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:47:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:47:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:47:04 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:47:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:47:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:47:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:47:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:47:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:47:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:47:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:47:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:47:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:47:12 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 08:47:12 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:47:12 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:47:12 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:47:12 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:47:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:47:14 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:47:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:47:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:47:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:47:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:47:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:47:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:47:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:47:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43484965
Sun 19 Jan 2014 08:47:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:47:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43484965
Sun 19 Jan 2014 08:47:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:47:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:47:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:47:27 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:47:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:47:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:47:28 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:47:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:47:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:47:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:47:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:47:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:47:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:47:29 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:47:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 08:47:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:47:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:47:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:47:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:47:31 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:47:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:47:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:47:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:47:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:47:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:47:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:47:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:47:33 - job_xml_thread(): Done retrieving: data size 43136802
Sun 19 Jan 2014 08:47:33 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:47:33 - XML: Start document: iteration 16
Sun 19 Jan 2014 08:47:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43136802
Sun 19 Jan 2014 08:47:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43136802
Sun 19 Jan 2014 08:47:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:47:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:47:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:47:43 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:47:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:47:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:47:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:47:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:47:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:47:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:47:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:47:47 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:47:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:47:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:47:47 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:47:48 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:47:48 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 08:47:48 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 08:47:49 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:47:49 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 08:47:53 - size of cluster 'LISA Cluster': 624 hosts 79484 metrics 971950 values 15333705 bits 1916713 bytes 
Sun 19 Jan 2014 08:47:54 - XML: Processed 647988 elements - found 0 jobs
Sun 19 Jan 2014 08:47:54 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:47:54 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:47:54 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:47:54 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:47:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:47:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:47:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:47:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:47:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:47:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:47:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:47:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:47:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:47:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:47:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:47:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42900593
Sun 19 Jan 2014 08:47:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:48:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42900593
Sun 19 Jan 2014 08:48:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:48:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:48:02 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:48:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:48:02 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:48:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 08:48:02 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:48:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7594 values 120119 bits 15014 bytes 
Sun 19 Jan 2014 08:48:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 08:48:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:48:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:48:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:48:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:48:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:48:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:48:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:48:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:48:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42900593
Sun 19 Jan 2014 08:48:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:48:09 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:48:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:48:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:48:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:48:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:48:19 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:48:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:48:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:48:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:48:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:48:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:48:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:48:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:48:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:48:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:48:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:48:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:48:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:48:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:48:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:48:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:48:26 - job_xml_thread(): Done retrieving: data size 42988772
Sun 19 Jan 2014 08:48:26 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:48:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42988772
Sun 19 Jan 2014 08:48:26 - XML: Start document: iteration 17
Sun 19 Jan 2014 08:48:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:48:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42988772
Sun 19 Jan 2014 08:48:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:48:33 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:48:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 08:48:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:48:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:48:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:48:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:48:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:48:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:48:45 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:48:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:48:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:48:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:48:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:48:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:48:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:48:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:48:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:48:47 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:48:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:48:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:48:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:48:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:48:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:48:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:48:49 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:48:49 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 08:48:49 - XML: Processed 646285 elements - found 0 jobs
Sun 19 Jan 2014 08:48:49 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:48:49 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:48:49 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:48:49 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:48:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:48:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43523405
Sun 19 Jan 2014 08:48:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:48:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43523405
Sun 19 Jan 2014 08:48:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:49:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:49:01 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:49:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:49:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:49:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:49:02 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:49:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:49:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:49:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:49:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:49:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:49:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:49:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:49:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:49:03 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:49:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 08:49:03 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:49:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 08:49:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6439 values 101713 bits 12714 bytes 
Sun 19 Jan 2014 08:49:04 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:49:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:49:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:49:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:49:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:49:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:49:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:49:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:49:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:49:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:49:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577036
Sun 19 Jan 2014 08:49:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:49:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577036
Sun 19 Jan 2014 08:49:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:49:12 - job_xml_thread(): Done retrieving: data size 43577036
Sun 19 Jan 2014 08:49:12 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:49:12 - XML: Start document: iteration 18
Sun 19 Jan 2014 08:49:14 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:49:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 08:49:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:49:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:49:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:49:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:49:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:49:29 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 08:49:29 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:49:29 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:49:29 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:49:30 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:49:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:49:31 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:49:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:49:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:49:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:49:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:49:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:49:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:49:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:49:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:49:35 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:49:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:49:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:49:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:49:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:49:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:49:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:49:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:49:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43585039
Sun 19 Jan 2014 08:49:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:49:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43585039
Sun 19 Jan 2014 08:49:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:49:45 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:49:45 - job_xml_thread(): Done retrieving: data size 43585039
Sun 19 Jan 2014 08:49:45 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:49:45 - XML: Start document: iteration 19
Sun 19 Jan 2014 08:49:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:49:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:49:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:49:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:49:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:49:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:49:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:49:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:49:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:49:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:49:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:49:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:49:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:49:56 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 08:49:56 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:49:56 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:49:56 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:49:56 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:50:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:50:00 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:50:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:50:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:50:01 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 08:50:01 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 08:50:01 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:50:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:50:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:50:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:50:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:50:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:50:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555953
Sun 19 Jan 2014 08:50:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:50:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555953
Sun 19 Jan 2014 08:50:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:50:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:50:03 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:50:05 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:50:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:50:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 08:50:05 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:50:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 08:50:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:50:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148623 bits 18577 bytes 
Sun 19 Jan 2014 08:50:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:50:11 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:50:11 - job_xml_thread(): Done retrieving: data size 43555953
Sun 19 Jan 2014 08:50:11 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:50:11 - XML: Start document: iteration 20
Sun 19 Jan 2014 08:50:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:50:13 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:50:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:50:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:50:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:50:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:50:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:50:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:50:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:50:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:50:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:50:21 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 08:50:21 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:50:21 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:50:21 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:50:21 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:50:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:50:24 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:50:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:50:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:50:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:50:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:50:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:50:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:50:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:50:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555837
Sun 19 Jan 2014 08:50:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:50:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555837
Sun 19 Jan 2014 08:50:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:50:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:50:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:50:36 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:50:36 - job_xml_thread(): Done retrieving: data size 43555837
Sun 19 Jan 2014 08:50:36 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:50:36 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 08:50:36 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 08:50:36 - Housekeeping: done.
Sun 19 Jan 2014 08:50:36 - XML: Start document: iteration 0
Sun 19 Jan 2014 08:50:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:50:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:50:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:50:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:50:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:50:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:50:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:50:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:50:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:50:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:50:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:50:47 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 08:50:47 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:50:47 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:50:47 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:50:47 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:50:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:50:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:50:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:50:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:50:50 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:50:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 08:50:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:50:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:50:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:50:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:50:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:50:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:50:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579566
Sun 19 Jan 2014 08:50:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:50:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579566
Sun 19 Jan 2014 08:50:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:50:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:50:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:51:02 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:51:02 - job_xml_thread(): Done retrieving: data size 43579566
Sun 19 Jan 2014 08:51:02 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:51:02 - XML: Start document: iteration 1
Sun 19 Jan 2014 08:51:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:51:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:51:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:51:07 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:51:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:51:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 08:51:08 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:51:08 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:51:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 08:51:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5958 values 94011 bits 11751 bytes 
Sun 19 Jan 2014 08:51:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:51:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:51:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:51:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:51:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:51:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:51:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:51:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:51:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:51:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:51:14 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:51:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:51:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:51:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:51:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:51:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:51:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:51:16 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 08:51:16 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:51:16 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:51:16 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:51:16 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:51:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:51:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576413
Sun 19 Jan 2014 08:51:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:51:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576413
Sun 19 Jan 2014 08:51:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:51:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:51:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:51:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:51:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:51:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:51:31 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:51:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:51:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:51:32 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:51:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:51:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:51:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:51:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:51:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:51:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:51:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:51:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:51:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:51:34 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:51:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 08:51:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:51:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:51:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:51:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:51:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:51:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:51:35 - job_xml_thread(): Done retrieving: data size 43603116
Sun 19 Jan 2014 08:51:35 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:51:35 - XML: Start document: iteration 2
Sun 19 Jan 2014 08:51:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43603116
Sun 19 Jan 2014 08:51:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43603116
Sun 19 Jan 2014 08:51:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:51:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:51:46 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 08:51:46 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:51:46 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:51:46 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:51:46 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:51:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:51:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:51:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:51:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:51:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:51:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:51:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:51:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:51:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:51:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:51:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:51:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:51:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:51:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:51:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:51:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:51:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:51:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:51:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:51:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:51:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:51:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:51:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566442
Sun 19 Jan 2014 08:51:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:51:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566442
Sun 19 Jan 2014 08:51:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:52:01 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:52:01 - job_xml_thread(): Done retrieving: data size 43566442
Sun 19 Jan 2014 08:52:01 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:52:01 - XML: Start document: iteration 3
Sun 19 Jan 2014 08:52:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:52:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:52:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:52:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:52:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:52:09 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:52:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:52:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:52:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:52:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:52:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:52:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 08:52:10 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:52:10 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:52:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:52:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:52:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 08:52:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:52:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9205 values 145250 bits 18156 bytes 
Sun 19 Jan 2014 08:52:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:52:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:52:15 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 08:52:15 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:52:15 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:52:15 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:52:15 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:52:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:52:19 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:52:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:52:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:52:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:52:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:52:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:52:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:52:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:52:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568132
Sun 19 Jan 2014 08:52:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:52:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568132
Sun 19 Jan 2014 08:52:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:52:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:52:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:52:30 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:52:30 - job_xml_thread(): Done retrieving: data size 43568132
Sun 19 Jan 2014 08:52:30 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:52:30 - XML: Start document: iteration 4
Sun 19 Jan 2014 08:52:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:52:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:52:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:52:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:52:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:52:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:52:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:52:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:52:43 - XML: Processed 653349 elements - found 0 jobs
Sun 19 Jan 2014 08:52:43 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:52:43 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:52:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:52:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:52:43 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:52:43 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:52:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:52:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:52:45 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:52:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:52:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:52:45 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:52:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 08:52:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:52:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:52:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:52:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:52:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:52:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:52:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583782
Sun 19 Jan 2014 08:52:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:52:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583782
Sun 19 Jan 2014 08:52:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:52:58 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:52:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:52:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:52:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:52:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:52:58 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:52:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:52:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:52:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:52:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:52:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:52:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:53:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:53:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:53:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:53:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:53:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:53:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:53:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:53:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:53:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:53:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:53:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:53:03 - job_xml_thread(): Done retrieving: data size 43581519
Sun 19 Jan 2014 08:53:03 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:53:03 - XML: Start document: iteration 5
Sun 19 Jan 2014 08:53:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581519
Sun 19 Jan 2014 08:53:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:53:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581519
Sun 19 Jan 2014 08:53:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:53:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:53:12 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:53:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:53:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:53:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:53:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 08:53:14 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:53:14 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:53:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9293 values 146606 bits 18325 bytes 
Sun 19 Jan 2014 08:53:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 08:53:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:53:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:53:20 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 08:53:20 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:53:21 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:53:21 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:53:21 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:53:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:53:25 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:53:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:53:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:53:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:53:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:53:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:53:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:53:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:53:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:53:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:53:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:53:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:53:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:53:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:53:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:53:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:53:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:53:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43175563
Sun 19 Jan 2014 08:53:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:53:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43175563
Sun 19 Jan 2014 08:53:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:53:36 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:53:36 - job_xml_thread(): Done retrieving: data size 43175563
Sun 19 Jan 2014 08:53:36 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:53:36 - XML: Start document: iteration 6
Sun 19 Jan 2014 08:53:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:53:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:53:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:53:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:53:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:53:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:53:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:53:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:53:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:53:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:53:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:53:46 - XML: Processed 648403 elements - found 0 jobs
Sun 19 Jan 2014 08:53:46 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:53:46 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:53:46 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:53:46 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:53:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:53:51 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:53:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:53:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:53:51 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:53:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 08:53:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:53:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:53:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:53:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:53:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:53:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:53:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42954710
Sun 19 Jan 2014 08:53:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:53:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42954710
Sun 19 Jan 2014 08:53:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:53:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:53:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:54:01 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:54:01 - job_xml_thread(): Done retrieving: data size 42954710
Sun 19 Jan 2014 08:54:01 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:54:01 - XML: Start document: iteration 7
Sun 19 Jan 2014 08:54:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:54:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:54:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:54:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:54:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:54:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:54:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:54:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:54:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:54:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:54:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:54:11 - XML: Processed 645692 elements - found 0 jobs
Sun 19 Jan 2014 08:54:11 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:54:11 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:54:11 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:54:11 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:54:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:54:14 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:54:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:54:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:54:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:54:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:54:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:54:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:54:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:54:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42975117
Sun 19 Jan 2014 08:54:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:54:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:54:17 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:54:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42975117
Sun 19 Jan 2014 08:54:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:54:19 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:54:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:54:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 08:54:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 08:54:19 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:54:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8757 values 138088 bits 17261 bytes 
Sun 19 Jan 2014 08:54:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:54:25 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:54:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:54:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:54:27 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:54:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:54:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:54:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:54:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:54:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:54:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:54:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:54:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:54:31 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:54:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:54:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:54:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:54:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:54:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:54:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:54:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:54:33 - job_xml_thread(): Done retrieving: data size 42983429
Sun 19 Jan 2014 08:54:33 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:54:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42983429
Sun 19 Jan 2014 08:54:33 - XML: Start document: iteration 8
Sun 19 Jan 2014 08:54:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:54:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42983429
Sun 19 Jan 2014 08:54:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:54:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:54:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:54:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:54:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:54:49 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 08:54:49 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:54:49 - XML: Processed 645912 elements - found 0 jobs
Sun 19 Jan 2014 08:54:49 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:54:49 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:54:49 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:54:50 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:54:50 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:54:50 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 08:54:50 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:54:51 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 08:54:51 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 08:54:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:54:54 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:54:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:54:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:54:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:54:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:54:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:54:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:54:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:54:55 - size of cluster 'LISA Cluster': 624 hosts 79479 metrics 951682 values 15004233 bits 1875529 bytes 
Sun 19 Jan 2014 08:54:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:54:58 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:54:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:54:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:54:58 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:54:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 08:54:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:54:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:54:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:54:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:54:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:55:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:55:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565977
Sun 19 Jan 2014 08:55:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:55:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565977
Sun 19 Jan 2014 08:55:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:55:05 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:55:05 - job_xml_thread(): Done retrieving: data size 43565977
Sun 19 Jan 2014 08:55:05 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:55:05 - XML: Start document: iteration 9
Sun 19 Jan 2014 08:55:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:55:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:55:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:55:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:55:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:55:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:55:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:55:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:55:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:55:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:55:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:55:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:55:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:55:18 - XML: Processed 653326 elements - found 0 jobs
Sun 19 Jan 2014 08:55:18 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:55:18 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:55:18 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:55:18 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:55:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:55:19 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:55:19 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:55:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:55:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 08:55:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 08:55:19 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:55:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5670 values 89344 bits 11168 bytes 
Sun 19 Jan 2014 08:55:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:55:24 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:55:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:55:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:55:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:55:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:55:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:55:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:55:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:55:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43536962
Sun 19 Jan 2014 08:55:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:55:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43536962
Sun 19 Jan 2014 08:55:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:55:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:55:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:55:33 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:55:34 - job_xml_thread(): Done retrieving: data size 43536962
Sun 19 Jan 2014 08:55:34 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:55:34 - XML: Start document: iteration 10
Sun 19 Jan 2014 08:55:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:55:39 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:55:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:55:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:55:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:55:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:55:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:55:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:55:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:55:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:55:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:55:47 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 08:55:47 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:55:47 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:55:47 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:55:47 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:55:48 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:55:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 08:55:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:55:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:55:49 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:55:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:55:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:55:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:55:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:55:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:55:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:55:50 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:55:50 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 08:55:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:55:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559640
Sun 19 Jan 2014 08:55:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:55:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559640
Sun 19 Jan 2014 08:55:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:55:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:55:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:56:03 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:56:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:56:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:56:04 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:56:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:56:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:56:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:56:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:56:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:56:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:56:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:56:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:56:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:56:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:56:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:56:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:56:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:56:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:56:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:56:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:56:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:56:12 - job_xml_thread(): Done retrieving: data size 43576025
Sun 19 Jan 2014 08:56:12 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:56:12 - XML: Start document: iteration 11
Sun 19 Jan 2014 08:56:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576025
Sun 19 Jan 2014 08:56:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576025
Sun 19 Jan 2014 08:56:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:56:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:56:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:56:19 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:56:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:56:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 08:56:20 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:56:20 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:56:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 08:56:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:56:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8678 values 136814 bits 17101 bytes 
Sun 19 Jan 2014 08:56:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:56:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:56:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:56:31 - XML: Processed 653346 elements - found 0 jobs
Sun 19 Jan 2014 08:56:31 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:56:32 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:56:32 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:56:32 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:56:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:56:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:56:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:56:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:56:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:56:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:56:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:56:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:56:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:56:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:56:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:56:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:56:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:56:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:56:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:56:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:56:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:56:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:56:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43600245
Sun 19 Jan 2014 08:56:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:56:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43600245
Sun 19 Jan 2014 08:56:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:56:47 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:56:47 - job_xml_thread(): Done retrieving: data size 43600245
Sun 19 Jan 2014 08:56:47 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:56:47 - XML: Start document: iteration 12
Sun 19 Jan 2014 08:56:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:56:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:56:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:56:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:56:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:56:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:56:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:56:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:56:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:56:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:56:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:56:51 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:56:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 08:56:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:56:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:56:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:57:00 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 08:57:00 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:57:00 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:57:00 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:57:00 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:57:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:57:03 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:57:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:57:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:57:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:57:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:57:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:57:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:57:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:57:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:57:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:57:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555406
Sun 19 Jan 2014 08:57:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:57:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555406
Sun 19 Jan 2014 08:57:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:57:15 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:57:15 - job_xml_thread(): Done retrieving: data size 43555406
Sun 19 Jan 2014 08:57:15 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:57:15 - XML: Start document: iteration 13
Sun 19 Jan 2014 08:57:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:57:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:57:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:57:20 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:57:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:57:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:57:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:57:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:57:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:57:21 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:57:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 08:57:21 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:57:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 08:57:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6104 values 96303 bits 12037 bytes 
Sun 19 Jan 2014 08:57:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:57:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:57:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:57:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:57:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:57:25 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 08:57:25 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:57:25 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:57:25 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:57:25 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:57:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:57:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:57:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:57:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:57:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:57:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:57:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:57:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:57:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:57:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557911
Sun 19 Jan 2014 08:57:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:57:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557911
Sun 19 Jan 2014 08:57:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:57:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:57:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:57:40 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:57:40 - job_xml_thread(): Done retrieving: data size 43557911
Sun 19 Jan 2014 08:57:40 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:57:40 - XML: Start document: iteration 14
Sun 19 Jan 2014 08:57:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:57:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:57:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:57:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:57:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:57:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:57:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:57:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:57:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:57:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:57:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:57:52 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:57:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 08:57:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:57:53 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 08:57:53 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:57:53 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:57:53 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:57:53 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:57:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:57:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:57:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:57:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:57:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:57:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:57:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:57:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:57:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:57:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575405
Sun 19 Jan 2014 08:57:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:58:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575405
Sun 19 Jan 2014 08:58:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:58:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:58:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:58:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:58:07 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:58:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:58:08 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:58:08 - job_xml_thread(): Done retrieving: data size 43575405
Sun 19 Jan 2014 08:58:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:58:08 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:58:08 - XML: Start document: iteration 15
Sun 19 Jan 2014 08:58:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:58:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:58:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:58:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:58:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575405
Sun 19 Jan 2014 08:58:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:58:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:58:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:58:18 - XML: Processed 653348 elements - found 0 jobs
Sun 19 Jan 2014 08:58:18 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:58:18 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:58:18 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:58:18 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:58:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:58:21 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:58:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:58:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 08:58:22 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:58:22 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:58:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 08:58:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5912 values 93244 bits 11655 bytes 
Sun 19 Jan 2014 08:58:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:58:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:58:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:58:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:58:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:58:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:58:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:58:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:58:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:58:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:58:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:58:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:58:29 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:58:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:58:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:58:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:58:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:58:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:58:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:58:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:58:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575958
Sun 19 Jan 2014 08:58:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:58:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575958
Sun 19 Jan 2014 08:58:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:58:34 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:58:34 - job_xml_thread(): Done retrieving: data size 43575958
Sun 19 Jan 2014 08:58:34 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:58:34 - XML: Start document: iteration 16
Sun 19 Jan 2014 08:58:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:58:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:58:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:58:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:58:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:58:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:58:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:58:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:58:51 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:58:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 08:58:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:58:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:58:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:58:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:58:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:58:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:58:53 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 08:58:53 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:58:53 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:58:53 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:58:53 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:58:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:58:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:58:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:58:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:58:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:58:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:58:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:58:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:58:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:58:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575435
Sun 19 Jan 2014 08:58:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:58:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575435
Sun 19 Jan 2014 08:58:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:59:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:59:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:59:08 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:59:08 - job_xml_thread(): Done retrieving: data size 43575435
Sun 19 Jan 2014 08:59:08 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:59:08 - XML: Start document: iteration 17
Sun 19 Jan 2014 08:59:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:59:10 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:59:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:59:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:59:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:59:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:59:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:59:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:59:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:59:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:59:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:59:20 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 08:59:20 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:59:20 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:59:20 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:59:20 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:59:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:59:22 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:59:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:59:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:59:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:59:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:59:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:59:22 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:59:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 08:59:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 08:59:22 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:59:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5718 values 90117 bits 11264 bytes 
Sun 19 Jan 2014 08:59:22 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 08:59:22 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 08:59:22 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:59:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:59:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:59:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:59:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:59:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:59:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43491527
Sun 19 Jan 2014 08:59:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:59:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43491527
Sun 19 Jan 2014 08:59:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:59:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:59:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:59:35 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 08:59:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 08:59:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 08:59:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 08:59:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:59:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:59:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 08:59:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:59:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:59:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 08:59:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 08:59:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 08:59:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 08:59:40 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 08:59:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 08:59:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 08:59:40 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 08:59:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 08:59:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 08:59:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:59:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 08:59:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 08:59:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 08:59:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 08:59:41 - job_xml_thread(): Done retrieving: data size 42999588
Sun 19 Jan 2014 08:59:41 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 08:59:41 - XML: Start document: iteration 18
Sun 19 Jan 2014 08:59:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42999588
Sun 19 Jan 2014 08:59:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42999588
Sun 19 Jan 2014 08:59:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 08:59:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 08:59:52 - XML: Processed 646234 elements - found 0 jobs
Sun 19 Jan 2014 08:59:52 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 08:59:52 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 08:59:52 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 08:59:52 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 08:59:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 08:59:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 08:59:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 08:59:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:00:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:00:00 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:00:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:00:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:00:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:00:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:00:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:00:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:00:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:00:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:00:03 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:00:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:00:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:00:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:00:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:00:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:00:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:00:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:00:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42923722
Sun 19 Jan 2014 09:00:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:00:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42923722
Sun 19 Jan 2014 09:00:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:00:07 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:00:07 - job_xml_thread(): Done retrieving: data size 42923722
Sun 19 Jan 2014 09:00:07 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:00:07 - XML: Start document: iteration 19
Sun 19 Jan 2014 09:00:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:00:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:00:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:00:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:00:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:00:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:00:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:00:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:00:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:00:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:00:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:00:21 - XML: Processed 645147 elements - found 0 jobs
Sun 19 Jan 2014 09:00:21 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:00:21 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:00:21 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:00:21 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:00:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:00:22 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:00:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:00:24 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:00:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 09:00:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 09:00:24 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:00:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8508 values 134121 bits 16765 bytes 
Sun 19 Jan 2014 09:00:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:00:25 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:00:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:00:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:00:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:00:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:00:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:00:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:00:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:00:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43030235
Sun 19 Jan 2014 09:00:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:00:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43030235
Sun 19 Jan 2014 09:00:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:00:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:00:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:00:36 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:00:36 - job_xml_thread(): Done retrieving: data size 43030235
Sun 19 Jan 2014 09:00:36 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:00:36 - XML: Start document: iteration 20
Sun 19 Jan 2014 09:00:37 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:00:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 09:00:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:00:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:00:39 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:00:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:00:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:00:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:00:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:00:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:00:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:00:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:00:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:00:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:00:44 - XML: Processed 646677 elements - found 0 jobs
Sun 19 Jan 2014 09:00:44 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:00:44 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:00:44 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:00:44 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:00:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:00:48 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:00:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:00:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:00:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:00:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:00:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:00:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:00:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:00:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43491840
Sun 19 Jan 2014 09:00:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:00:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43491840
Sun 19 Jan 2014 09:00:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:00:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:00:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:00:59 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:00:59 - job_xml_thread(): Done retrieving: data size 43491840
Sun 19 Jan 2014 09:00:59 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:00:59 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 09:01:00 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 09:01:00 - Housekeeping: done.
Sun 19 Jan 2014 09:01:00 - XML: Start document: iteration 0
Sun 19 Jan 2014 09:01:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:01:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:01:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:01:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:01:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:01:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:01:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:01:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:01:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:01:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:01:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:01:07 - XML: Processed 652520 elements - found 0 jobs
Sun 19 Jan 2014 09:01:07 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:01:07 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:01:07 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:01:07 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:01:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:01:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:01:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:01:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:01:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:01:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:01:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:01:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:01:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:01:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564054
Sun 19 Jan 2014 09:01:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:01:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564054
Sun 19 Jan 2014 09:01:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:01:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:01:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:01:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:01:20 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:01:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:01:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:01:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:01:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:01:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:01:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:01:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:01:22 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:01:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:01:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:01:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:01:24 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:01:25 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:01:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:01:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 09:01:25 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:01:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9372 values 147946 bits 18493 bytes 
Sun 19 Jan 2014 09:01:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 09:01:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:01:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43588987
Sun 19 Jan 2014 09:01:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:01:25 - job_xml_thread(): Done retrieving: data size 43588987
Sun 19 Jan 2014 09:01:26 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:01:26 - XML: Start document: iteration 1
Sun 19 Jan 2014 09:01:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:01:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:01:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:01:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:01:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43588987
Sun 19 Jan 2014 09:01:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:01:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:01:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:01:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:01:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:01:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:01:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:01:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:01:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:01:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:01:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:01:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:01:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:01:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:01:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:01:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:01:43 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:01:43 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:01:43 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:01:43 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:01:43 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:01:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:01:48 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:01:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:01:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:01:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:01:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:01:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:01:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:01:50 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:01:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 09:01:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:01:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:01:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567708
Sun 19 Jan 2014 09:01:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:01:51 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 09:01:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567708
Sun 19 Jan 2014 09:01:51 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:01:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:01:52 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:01:52 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:01:52 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 09:01:52 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 09:01:52 - Entering storeMetrics(): cluster LISA Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sun 19 Jan 2014 09:01:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:01:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:01:58 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:01:58 - job_xml_thread(): Done retrieving: data size 43567708
Sun 19 Jan 2014 09:01:59 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:01:59 - XML: Start document: iteration 2
Sun 19 Jan 2014 09:02:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:02:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:02:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:02:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:02:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:02:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:02:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:02:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:02:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:02:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:02:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:02:11 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:02:11 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:02:11 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:02:11 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:02:11 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:02:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:02:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:02:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:02:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:02:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:02:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:02:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:02:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:02:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:02:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554979
Sun 19 Jan 2014 09:02:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:02:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554979
Sun 19 Jan 2014 09:02:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:02:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:02:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:02:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:02:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:02:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:02:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:02:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:02:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:02:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:02:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:02:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:02:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:02:25 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:02:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:02:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 09:02:25 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:02:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 09:02:25 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:02:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6438 values 101847 bits 12730 bytes 
Sun 19 Jan 2014 09:02:26 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:02:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:02:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:02:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:02:28 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:02:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:02:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:02:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:02:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:02:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:02:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:02:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:02:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566477
Sun 19 Jan 2014 09:02:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:02:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566477
Sun 19 Jan 2014 09:02:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:02:31 - job_xml_thread(): Done retrieving: data size 43566477
Sun 19 Jan 2014 09:02:31 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:02:31 - XML: Start document: iteration 3
Sun 19 Jan 2014 09:02:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:02:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:02:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:02:43 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:02:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:02:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:02:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:02:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:02:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:02:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:02:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:02:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:02:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:02:49 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:02:49 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:02:49 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:02:49 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:02:49 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:02:49 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:02:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 09:02:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:02:52 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:02:52 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:02:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:02:52 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:02:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:02:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:02:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:02:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:02:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:02:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:02:53 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:02:53 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:02:53 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 09:02:53 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 09:02:53 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 09:02:54 - size of cluster 'LISA Cluster': 624 hosts 79480 metrics 861893 values 13599485 bits 1699935 bytes 
Sun 19 Jan 2014 09:02:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:02:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576362
Sun 19 Jan 2014 09:02:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:02:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576362
Sun 19 Jan 2014 09:02:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:02:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:02:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:03:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:03:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:03:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:03:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:03:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:03:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:03:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:03:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:03:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576362
Sun 19 Jan 2014 09:03:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:03:04 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:03:04 - job_xml_thread(): Done retrieving: data size 43576362
Sun 19 Jan 2014 09:03:04 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:03:04 - XML: Start document: iteration 4
Sun 19 Jan 2014 09:03:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:03:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:03:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:03:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:03:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:03:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:03:19 - XML: Processed 653349 elements - found 0 jobs
Sun 19 Jan 2014 09:03:19 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:03:19 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:03:19 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:03:19 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:03:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:03:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:03:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:03:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:03:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:03:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:03:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:03:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:03:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:03:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:03:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:03:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:03:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:03:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:03:26 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:03:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:03:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576447
Sun 19 Jan 2014 09:03:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:03:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576447
Sun 19 Jan 2014 09:03:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:03:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:03:27 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:03:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 09:03:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 09:03:28 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:03:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8928 values 141105 bits 17638 bytes 
Sun 19 Jan 2014 09:03:34 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:03:34 - job_xml_thread(): Done retrieving: data size 43576447
Sun 19 Jan 2014 09:03:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:03:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:03:34 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:03:34 - XML: Start document: iteration 5
Sun 19 Jan 2014 09:03:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:03:36 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:03:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:03:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:03:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:03:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:03:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:03:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:03:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:03:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:03:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:03:43 - XML: Processed 653347 elements - found 0 jobs
Sun 19 Jan 2014 09:03:43 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:03:43 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:03:43 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:03:44 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:03:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:03:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:03:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:03:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:03:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:03:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:03:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:03:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:03:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:03:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:03:53 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:03:53 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 09:03:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:03:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43552568
Sun 19 Jan 2014 09:03:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:03:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43552568
Sun 19 Jan 2014 09:03:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:03:59 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:03:59 - job_xml_thread(): Done retrieving: data size 43552568
Sun 19 Jan 2014 09:03:59 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:03:59 - XML: Start document: iteration 6
Sun 19 Jan 2014 09:04:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:04:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:04:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:04:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:04:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:04:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:04:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:04:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:04:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:04:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:04:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:04:11 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:04:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 09:04:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:04:12 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:04:12 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:04:12 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:04:12 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:04:12 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:04:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:04:16 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:04:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:04:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:04:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:04:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:04:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:04:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:04:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:04:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558378
Sun 19 Jan 2014 09:04:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:04:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558378
Sun 19 Jan 2014 09:04:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:04:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:04:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:04:27 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:04:27 - job_xml_thread(): Done retrieving: data size 43558378
Sun 19 Jan 2014 09:04:27 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:04:27 - XML: Start document: iteration 7
Sun 19 Jan 2014 09:04:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:04:28 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:04:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:04:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 09:04:29 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:04:29 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:04:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 09:04:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:04:31 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:04:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5813 values 91710 bits 11463 bytes 
Sun 19 Jan 2014 09:04:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:04:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:04:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:04:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:04:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:04:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:04:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:04:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:04:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:04:41 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:04:41 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:04:41 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:04:41 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:04:41 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:04:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:04:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:04:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:04:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:04:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:04:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:04:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:04:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:04:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:04:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43545244
Sun 19 Jan 2014 09:04:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:04:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43545244
Sun 19 Jan 2014 09:04:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:04:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:04:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:04:56 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:04:56 - job_xml_thread(): Done retrieving: data size 43545244
Sun 19 Jan 2014 09:04:56 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:04:56 - XML: Start document: iteration 8
Sun 19 Jan 2014 09:04:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:04:58 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:04:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:04:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:04:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:04:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:04:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:04:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:04:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:04:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:04:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:05:05 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:05:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 09:05:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:05:07 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:05:07 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:05:07 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:05:07 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:05:07 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:05:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:05:11 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:05:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:05:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:05:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:05:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:05:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:05:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:05:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:05:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:05:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:05:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43540220
Sun 19 Jan 2014 09:05:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:05:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43540220
Sun 19 Jan 2014 09:05:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:05:23 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:05:23 - job_xml_thread(): Done retrieving: data size 43540220
Sun 19 Jan 2014 09:05:23 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:05:23 - XML: Start document: iteration 9
Sun 19 Jan 2014 09:05:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:05:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:05:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:05:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:05:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:05:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:05:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:05:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:05:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:05:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:05:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:05:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:05:29 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:05:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:05:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 09:05:30 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:05:30 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:05:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 09:05:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5852 values 92290 bits 11536 bytes 
Sun 19 Jan 2014 09:05:36 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:05:36 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:05:36 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:05:36 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:05:36 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:05:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:05:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:05:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:05:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:05:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:05:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:05:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:05:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:05:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:05:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:05:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:05:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43377311
Sun 19 Jan 2014 09:05:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:05:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43377311
Sun 19 Jan 2014 09:05:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:05:51 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:05:51 - job_xml_thread(): Done retrieving: data size 43377311
Sun 19 Jan 2014 09:05:51 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:05:51 - XML: Start document: iteration 10
Sun 19 Jan 2014 09:05:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:05:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:05:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:05:59 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:05:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:05:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:06:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:06:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:06:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:06:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:06:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:06:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:06:05 - XML: Processed 651266 elements - found 0 jobs
Sun 19 Jan 2014 09:06:05 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:06:05 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:06:05 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:06:05 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:06:05 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:06:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:06:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:06:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:06:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:06:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:06:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:06:06 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:06:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 09:06:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:06:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:06:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42915617
Sun 19 Jan 2014 09:06:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:06:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42915617
Sun 19 Jan 2014 09:06:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:06:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:06:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:06:20 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:06:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:06:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:06:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:06:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:06:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:06:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:06:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:06:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:06:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:06:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:06:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:06:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:06:24 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:06:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:06:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:06:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:06:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:06:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:06:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:06:25 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 09:06:25 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 09:06:25 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:06:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:06:26 - job_xml_thread(): Done retrieving: data size 43018574
Sun 19 Jan 2014 09:06:26 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:06:26 - XML: Start document: iteration 11
Sun 19 Jan 2014 09:06:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43018574
Sun 19 Jan 2014 09:06:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:06:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43018574
Sun 19 Jan 2014 09:06:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:06:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:06:31 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:06:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:06:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 09:06:32 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:06:32 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:06:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 09:06:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8764 values 138209 bits 17276 bytes 
Sun 19 Jan 2014 09:06:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:06:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:06:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:06:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:06:47 - XML: Processed 646200 elements - found 0 jobs
Sun 19 Jan 2014 09:06:47 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:06:47 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:06:47 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:06:47 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:06:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:06:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:06:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:06:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:06:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:06:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:06:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:06:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:06:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:06:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:06:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:06:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:06:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:06:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:06:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:06:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:06:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:06:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:06:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43549343
Sun 19 Jan 2014 09:06:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:06:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43549343
Sun 19 Jan 2014 09:06:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:07:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:07:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:07:03 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:07:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:07:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:07:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:07:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:07:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:07:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:07:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:07:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:07:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:07:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:07:06 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:07:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:07:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:07:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:07:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:07:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:07:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:07:07 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:07:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 09:07:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:07:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:07:08 - job_xml_thread(): Done retrieving: data size 43586425
Sun 19 Jan 2014 09:07:08 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:07:08 - XML: Start document: iteration 12
Sun 19 Jan 2014 09:07:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43586425
Sun 19 Jan 2014 09:07:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:07:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43586425
Sun 19 Jan 2014 09:07:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:07:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:07:20 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:07:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:07:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:07:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:07:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:07:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:07:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:07:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:07:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:07:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:07:28 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:07:28 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:07:28 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:07:28 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:07:28 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:07:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:07:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:07:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:07:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:07:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:07:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:07:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:07:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:07:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:07:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43545017
Sun 19 Jan 2014 09:07:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:07:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43545017
Sun 19 Jan 2014 09:07:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:07:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:07:32 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:07:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:07:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 09:07:35 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:07:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 09:07:35 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:07:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8746 values 137944 bits 17243 bytes 
Sun 19 Jan 2014 09:07:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:07:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:07:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:07:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:07:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:07:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:07:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:07:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:07:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:07:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:07:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:07:43 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:07:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:07:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:07:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:07:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:07:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:07:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:07:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:07:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:07:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:07:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:07:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:07:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554012
Sun 19 Jan 2014 09:07:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:07:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554012
Sun 19 Jan 2014 09:07:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:07:49 - job_xml_thread(): Done retrieving: data size 43554012
Sun 19 Jan 2014 09:07:49 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:07:49 - XML: Start document: iteration 13
Sun 19 Jan 2014 09:07:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:07:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:08:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:08:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:08:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:08:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:08:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:08:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:08:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:08:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:08:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:08:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:08:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:08:10 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:08:10 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:08:10 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:08:10 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:08:10 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:08:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:08:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:08:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:08:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:08:13 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:08:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 09:08:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:08:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:08:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:08:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:08:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:08:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:08:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43547949
Sun 19 Jan 2014 09:08:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:08:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43547949
Sun 19 Jan 2014 09:08:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:08:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:08:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:08:25 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:08:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:08:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:08:25 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:08:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:08:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:08:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:08:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:08:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:08:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:08:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:08:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:08:28 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:08:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:08:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:08:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:08:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:08:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:08:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:08:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:08:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:08:30 - job_xml_thread(): Done retrieving: data size 43562646
Sun 19 Jan 2014 09:08:30 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:08:30 - XML: Start document: iteration 14
Sun 19 Jan 2014 09:08:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562646
Sun 19 Jan 2014 09:08:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562646
Sun 19 Jan 2014 09:08:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:08:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:08:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:08:35 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:08:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:08:37 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:08:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 09:08:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 09:08:37 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:08:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8906 values 140462 bits 17557 bytes 
Sun 19 Jan 2014 09:08:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:08:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:08:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:08:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:08:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:08:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:08:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:08:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:08:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:08:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:08:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:08:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:08:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:08:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:08:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:08:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:08:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:08:54 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:08:54 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:08:54 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:08:54 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:08:54 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:08:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:08:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:08:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:08:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:08:56 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:08:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 09:08:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:08:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:08:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43587531
Sun 19 Jan 2014 09:08:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:08:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43587531
Sun 19 Jan 2014 09:08:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:09:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:09:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:09:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:09:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:09:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:09:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:09:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:09:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:09:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:09:09 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:09:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:09:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:09:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:09:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:09:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:09:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:09:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:09:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:09:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:09:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:09:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:09:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43592817
Sun 19 Jan 2014 09:09:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:09:12 - job_xml_thread(): Done retrieving: data size 43592817
Sun 19 Jan 2014 09:09:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43592817
Sun 19 Jan 2014 09:09:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:09:12 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:09:12 - XML: Start document: iteration 15
Sun 19 Jan 2014 09:09:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:09:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:09:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:09:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:09:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:09:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:09:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:09:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:09:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:09:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:09:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:09:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:09:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:09:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:09:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:09:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:09:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:09:34 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:09:34 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:09:34 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:09:34 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:09:34 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:09:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:09:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:09:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:09:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:09:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:09:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560369
Sun 19 Jan 2014 09:09:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:09:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560369
Sun 19 Jan 2014 09:09:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:09:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:09:37 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:09:38 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:09:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 09:09:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:09:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 09:09:38 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:09:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148568 bits 18571 bytes 
Sun 19 Jan 2014 09:09:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:09:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:09:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:09:47 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:09:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:09:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:09:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:09:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:09:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:09:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:09:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:09:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:09:49 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:09:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:09:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:09:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:09:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:09:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:09:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:09:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:09:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:09:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:09:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:09:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43590239
Sun 19 Jan 2014 09:09:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:09:53 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 09:09:53 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:09:53 - job_xml_thread(): Done retrieving: data size 43590239
Sun 19 Jan 2014 09:09:53 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:09:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43590239
Sun 19 Jan 2014 09:09:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:09:53 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:09:53 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:09:53 - XML: Start document: iteration 16
Sun 19 Jan 2014 09:09:53 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 09:09:53 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 09:09:54 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 09:10:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:10:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:10:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:10:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:10:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:10:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:10:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:10:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:10:09 - size of cluster 'LISA Cluster': 624 hosts 79470 metrics 853252 values 13448959 bits 1681119 bytes 
Sun 19 Jan 2014 09:10:10 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:10:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 09:10:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:10:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:10:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:10:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:10:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:10:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:10:13 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:10:13 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:10:13 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:10:13 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:10:13 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:10:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:10:17 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:10:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:10:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:10:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:10:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:10:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:10:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:10:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:10:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560299
Sun 19 Jan 2014 09:10:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:10:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560299
Sun 19 Jan 2014 09:10:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:10:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:10:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:10:29 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:10:29 - job_xml_thread(): Done retrieving: data size 43560299
Sun 19 Jan 2014 09:10:29 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:10:29 - XML: Start document: iteration 17
Sun 19 Jan 2014 09:10:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:10:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:10:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:10:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:10:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:10:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:10:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:10:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:10:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:10:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:10:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:10:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:10:38 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:10:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:10:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 09:10:38 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:10:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 09:10:38 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:10:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6139 values 96802 bits 12100 bytes 
Sun 19 Jan 2014 09:10:41 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:10:41 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:10:41 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:10:41 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:10:41 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:10:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:10:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:10:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:10:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:10:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:10:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:10:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:10:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:10:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:10:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43548705
Sun 19 Jan 2014 09:10:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:10:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43548705
Sun 19 Jan 2014 09:10:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:10:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:10:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:10:54 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:10:54 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 09:10:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:10:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:10:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:10:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:10:56 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:10:56 - job_xml_thread(): Done retrieving: data size 43548705
Sun 19 Jan 2014 09:10:56 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:10:57 - XML: Start document: iteration 18
Sun 19 Jan 2014 09:10:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:10:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:10:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:10:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:10:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43548705
Sun 19 Jan 2014 09:10:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:11:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:11:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:11:09 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:11:09 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:11:09 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:11:09 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:11:09 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:11:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:11:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:11:12 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:11:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 09:11:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:11:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:11:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:11:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:11:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:11:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:11:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:11:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:11:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:11:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:11:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:11:17 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:11:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:11:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:11:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:11:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:11:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:11:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:11:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:11:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43509869
Sun 19 Jan 2014 09:11:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:11:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43509869
Sun 19 Jan 2014 09:11:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:11:24 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:11:25 - job_xml_thread(): Done retrieving: data size 43509869
Sun 19 Jan 2014 09:11:25 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:11:25 - XML: Start document: iteration 19
Sun 19 Jan 2014 09:11:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:11:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:11:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:11:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:11:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:11:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:11:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:11:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:11:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:11:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:11:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:11:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:11:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:11:38 - XML: Processed 652598 elements - found 0 jobs
Sun 19 Jan 2014 09:11:38 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:11:38 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:11:38 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:11:38 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:11:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:11:38 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:11:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:11:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 09:11:38 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:11:38 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:11:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 09:11:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6162 values 97210 bits 12151 bytes 
Sun 19 Jan 2014 09:11:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:11:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:11:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:11:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:11:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:11:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:11:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:11:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:11:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:11:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42978893
Sun 19 Jan 2014 09:11:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:11:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42978893
Sun 19 Jan 2014 09:11:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:11:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:11:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:11:53 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:11:53 - job_xml_thread(): Done retrieving: data size 42978893
Sun 19 Jan 2014 09:11:53 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:11:53 - XML: Start document: iteration 20
Sun 19 Jan 2014 09:11:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:11:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:11:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:11:59 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:11:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:12:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:12:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:12:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:12:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:12:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:12:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:12:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:12:07 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:12:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:12:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:12:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:12:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:12:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:12:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:12:09 - XML: Processed 646374 elements - found 0 jobs
Sun 19 Jan 2014 09:12:09 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:12:09 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:12:09 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:12:09 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:12:09 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:12:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 09:12:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:12:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:12:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42905625
Sun 19 Jan 2014 09:12:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:12:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42905625
Sun 19 Jan 2014 09:12:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:12:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:12:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:12:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:12:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:12:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:12:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:12:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:12:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:12:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:12:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:12:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:12:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:12:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:12:25 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:12:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:12:26 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:12:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:12:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:12:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:12:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:12:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:12:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:12:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:12:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43094339
Sun 19 Jan 2014 09:12:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:12:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43094339
Sun 19 Jan 2014 09:12:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:12:30 - job_xml_thread(): Done retrieving: data size 43094339
Sun 19 Jan 2014 09:12:30 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:12:30 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 09:12:30 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 09:12:30 - Housekeeping: done.
Sun 19 Jan 2014 09:12:30 - XML: Start document: iteration 0
Sun 19 Jan 2014 09:12:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:12:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:12:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:12:39 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:12:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:12:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:12:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:12:41 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:12:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 09:12:41 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:12:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 09:12:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8580 values 135288 bits 16911 bytes 
Sun 19 Jan 2014 09:12:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:12:47 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:12:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:12:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:12:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:12:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:12:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:12:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:12:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:12:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:12:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:12:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:12:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:12:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:12:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:12:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:12:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:12:52 - XML: Processed 647357 elements - found 0 jobs
Sun 19 Jan 2014 09:12:52 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:12:52 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:12:52 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:12:52 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:12:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:12:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43540078
Sun 19 Jan 2014 09:12:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:12:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43540078
Sun 19 Jan 2014 09:12:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:13:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:13:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:13:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:13:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:13:07 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:13:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:13:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:13:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:13:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:13:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:13:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:13:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:13:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:13:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:13:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:13:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:13:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:13:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:13:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:13:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:13:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:13:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:13:13 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:13:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 09:13:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:13:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:13:15 - job_xml_thread(): Done retrieving: data size 43560595
Sun 19 Jan 2014 09:13:15 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:13:15 - XML: Start document: iteration 1
Sun 19 Jan 2014 09:13:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560595
Sun 19 Jan 2014 09:13:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:13:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560595
Sun 19 Jan 2014 09:13:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:13:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:13:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:13:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:13:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:13:32 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:13:32 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:13:32 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:13:32 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:13:32 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:13:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:13:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:13:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:13:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:13:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:13:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:13:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:13:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:13:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:13:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:13:39 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:13:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:13:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:13:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:13:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:13:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:13:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:13:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:13:42 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:13:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:13:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579809
Sun 19 Jan 2014 09:13:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:13:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579809
Sun 19 Jan 2014 09:13:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:13:43 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:13:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 09:13:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:13:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 09:13:44 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:13:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5527 values 87141 bits 10892 bytes 
Sun 19 Jan 2014 09:13:47 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:13:47 - job_xml_thread(): Done retrieving: data size 43579809
Sun 19 Jan 2014 09:13:47 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:13:47 - XML: Start document: iteration 2
Sun 19 Jan 2014 09:13:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:13:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:13:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:13:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:13:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:13:57 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:13:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:13:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:13:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:13:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:13:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:13:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:13:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:14:00 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:14:00 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:14:00 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:14:00 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:14:00 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:14:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:14:05 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:14:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:14:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:14:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:14:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:14:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:14:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:14:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:14:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555863
Sun 19 Jan 2014 09:14:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:14:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555863
Sun 19 Jan 2014 09:14:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:14:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:14:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:14:15 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:14:15 - job_xml_thread(): Done retrieving: data size 43555863
Sun 19 Jan 2014 09:14:15 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:14:15 - XML: Start document: iteration 3
Sun 19 Jan 2014 09:14:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:14:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:14:22 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:14:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 09:14:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:14:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:14:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:14:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:14:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:14:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:14:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:14:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:14:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:14:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:14:31 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:14:31 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:14:31 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:14:31 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:14:31 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:14:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:14:32 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:14:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:14:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:14:32 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 09:14:32 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 09:14:32 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:14:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:14:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:14:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:14:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:14:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:14:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43549586
Sun 19 Jan 2014 09:14:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:14:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43549586
Sun 19 Jan 2014 09:14:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:14:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:14:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:14:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:14:43 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:14:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:14:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:14:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:14:43 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:14:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:14:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:14:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:14:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:14:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:14:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:14:45 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:14:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 09:14:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 09:14:45 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:14:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5998 values 94589 bits 11823 bytes 
Sun 19 Jan 2014 09:14:46 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:14:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:14:47 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:14:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:14:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:14:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:14:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:14:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:14:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:14:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:14:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569497
Sun 19 Jan 2014 09:14:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:14:50 - job_xml_thread(): Done retrieving: data size 43569497
Sun 19 Jan 2014 09:14:50 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:14:50 - XML: Start document: iteration 4
Sun 19 Jan 2014 09:14:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569497
Sun 19 Jan 2014 09:14:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:14:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:14:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:15:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:15:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:15:06 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:15:06 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:15:06 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:15:06 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:15:06 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:15:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:15:10 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:15:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:15:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:15:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:15:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:15:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:15:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:15:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:15:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:15:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:15:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:15:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:15:13 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:15:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 09:15:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:15:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:15:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:15:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:15:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:15:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:15:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577229
Sun 19 Jan 2014 09:15:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:15:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577229
Sun 19 Jan 2014 09:15:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:15:22 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:15:22 - job_xml_thread(): Done retrieving: data size 43577229
Sun 19 Jan 2014 09:15:22 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:15:22 - XML: Start document: iteration 5
Sun 19 Jan 2014 09:15:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:15:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:15:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:15:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:15:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:15:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:15:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:15:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:15:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:15:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:15:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:15:32 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:15:32 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:15:32 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:15:32 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:15:32 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:15:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:15:35 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:15:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:15:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:15:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:15:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:15:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:15:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:15:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:15:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563890
Sun 19 Jan 2014 09:15:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:15:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563890
Sun 19 Jan 2014 09:15:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:15:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:15:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:15:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:15:46 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:15:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:15:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 09:15:47 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:15:47 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:15:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 09:15:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9078 values 143204 bits 17900 bytes 
Sun 19 Jan 2014 09:15:47 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:15:47 - job_xml_thread(): Done retrieving: data size 43563890
Sun 19 Jan 2014 09:15:47 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:15:47 - XML: Start document: iteration 6
Sun 19 Jan 2014 09:15:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:15:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:15:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:15:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:15:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:15:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:15:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:15:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:15:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:15:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:15:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:15:57 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:15:57 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:15:57 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:15:57 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:15:57 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:15:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:15:59 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:16:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:16:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:16:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:16:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:16:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:16:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:16:01 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:16:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 09:16:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:16:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:16:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554460
Sun 19 Jan 2014 09:16:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:16:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554460
Sun 19 Jan 2014 09:16:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:16:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:16:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:16:12 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:16:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:16:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:16:13 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:16:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:16:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:16:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:16:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:16:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:16:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:16:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:16:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:16:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:16:17 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:16:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:16:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:16:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:16:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:16:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:16:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:16:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:16:18 - job_xml_thread(): Done retrieving: data size 43561274
Sun 19 Jan 2014 09:16:18 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:16:18 - XML: Start document: iteration 7
Sun 19 Jan 2014 09:16:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561274
Sun 19 Jan 2014 09:16:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561274
Sun 19 Jan 2014 09:16:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:16:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:16:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:16:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:16:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:16:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:16:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:16:32 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:16:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:16:32 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:16:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:16:32 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:16:32 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:16:32 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:16:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:16:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:16:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:16:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:16:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:16:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:16:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:16:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:16:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:16:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:16:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:16:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:16:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:16:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:16:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:16:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43590431
Sun 19 Jan 2014 09:16:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:16:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43590431
Sun 19 Jan 2014 09:16:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:16:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:16:47 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:16:48 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:16:48 - job_xml_thread(): Done retrieving: data size 43590431
Sun 19 Jan 2014 09:16:48 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:16:48 - XML: Start document: iteration 8
Sun 19 Jan 2014 09:16:48 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:16:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:16:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 09:16:48 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:16:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 09:16:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:16:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:16:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:16:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148886 bits 18610 bytes 
Sun 19 Jan 2014 09:16:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:16:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:16:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:16:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:16:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:16:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:16:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:16:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:16:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:16:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:16:55 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 09:16:55 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:16:56 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:16:56 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 09:16:56 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:16:56 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 09:16:56 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 09:16:59 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:16:59 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:16:59 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:16:59 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:16:59 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:17:01 - size of cluster 'LISA Cluster': 624 hosts 79480 metrics 816967 values 12882880 bits 1610360 bytes 
Sun 19 Jan 2014 09:17:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:17:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:17:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:17:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:17:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:17:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:17:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:17:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:17:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:17:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:17:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:17:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43545609
Sun 19 Jan 2014 09:17:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:17:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43545609
Sun 19 Jan 2014 09:17:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:17:14 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:17:14 - job_xml_thread(): Done retrieving: data size 43545609
Sun 19 Jan 2014 09:17:14 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:17:14 - XML: Start document: iteration 9
Sun 19 Jan 2014 09:17:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:17:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:17:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:17:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:17:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:17:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:17:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:17:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:17:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:17:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:17:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:17:25 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:17:25 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:17:25 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:17:25 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:17:25 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:17:28 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:17:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 09:17:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:17:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:17:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:17:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:17:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:17:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:17:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:17:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:17:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:17:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:17:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43487079
Sun 19 Jan 2014 09:17:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:17:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43487079
Sun 19 Jan 2014 09:17:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:17:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:17:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:17:40 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:17:40 - job_xml_thread(): Done retrieving: data size 43487079
Sun 19 Jan 2014 09:17:40 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:17:40 - XML: Start document: iteration 10
Sun 19 Jan 2014 09:17:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:17:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:17:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:17:47 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:17:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:17:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:17:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:17:48 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:17:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:17:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:17:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:17:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:17:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:17:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 09:17:48 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:17:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:17:48 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:17:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 09:17:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5753 values 90873 bits 11359 bytes 
Sun 19 Jan 2014 09:17:53 - XML: Processed 652588 elements - found 0 jobs
Sun 19 Jan 2014 09:17:53 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:17:53 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:17:53 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:17:53 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:17:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:17:55 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:17:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:17:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:17:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:17:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:17:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:17:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:17:56 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:17:56 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 09:17:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:17:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42919869
Sun 19 Jan 2014 09:17:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:17:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42919869
Sun 19 Jan 2014 09:17:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:18:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:18:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:18:08 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:18:08 - job_xml_thread(): Done retrieving: data size 42919869
Sun 19 Jan 2014 09:18:08 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:18:08 - XML: Start document: iteration 11
Sun 19 Jan 2014 09:18:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:18:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:18:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:18:18 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:18:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:18:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:18:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:18:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:18:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:18:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:18:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:18:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:18:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:18:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:18:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:18:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:18:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:18:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:18:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:18:23 - XML: Processed 645290 elements - found 0 jobs
Sun 19 Jan 2014 09:18:23 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:18:23 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:18:23 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:18:23 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:18:24 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:18:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 09:18:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:18:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:18:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42991183
Sun 19 Jan 2014 09:18:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:18:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42991183
Sun 19 Jan 2014 09:18:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:18:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:18:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:18:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:18:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:18:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:18:37 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:18:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:18:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:18:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:18:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:18:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:18:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:18:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:18:38 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:18:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:18:42 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:18:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:18:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:18:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:18:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:18:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:18:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:18:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:18:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43440906
Sun 19 Jan 2014 09:18:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:18:45 - job_xml_thread(): Done retrieving: data size 43440906
Sun 19 Jan 2014 09:18:45 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:18:45 - XML: Start document: iteration 12
Sun 19 Jan 2014 09:18:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43440906
Sun 19 Jan 2014 09:18:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:18:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:18:48 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:18:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:18:49 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:18:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 09:18:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 09:18:49 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:18:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7808 values 123300 bits 15412 bytes 
Sun 19 Jan 2014 09:18:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:18:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:18:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:18:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:19:04 - XML: Processed 651580 elements - found 0 jobs
Sun 19 Jan 2014 09:19:04 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:19:04 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:19:04 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:19:05 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:19:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:19:06 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:19:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:19:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:19:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:19:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:19:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:19:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:19:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:19:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:19:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:19:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:19:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:19:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:19:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:19:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:19:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:19:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:19:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43591023
Sun 19 Jan 2014 09:19:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:19:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43591023
Sun 19 Jan 2014 09:19:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:19:20 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:19:20 - job_xml_thread(): Done retrieving: data size 43591023
Sun 19 Jan 2014 09:19:20 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:19:20 - XML: Start document: iteration 13
Sun 19 Jan 2014 09:19:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:19:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:19:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:19:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:19:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:19:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:19:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:19:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:19:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:19:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:19:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:19:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:19:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:19:29 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:19:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 09:19:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:19:34 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:19:34 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:19:34 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:19:35 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:19:35 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:19:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:19:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:19:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:19:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:19:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:19:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:19:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:19:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:19:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:19:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43539228
Sun 19 Jan 2014 09:19:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:19:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43539228
Sun 19 Jan 2014 09:19:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:19:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:19:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:19:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:19:46 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:19:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:19:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:19:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:19:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:19:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:19:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:19:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43539228
Sun 19 Jan 2014 09:19:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:19:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:19:49 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:19:50 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:19:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:19:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:19:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 09:19:50 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:19:50 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:19:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 09:19:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5919 values 93392 bits 11674 bytes 
Sun 19 Jan 2014 09:19:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:19:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:20:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:20:00 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:20:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:20:01 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:20:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:20:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:20:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:20:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:20:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:20:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:20:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:20:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:20:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:20:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:20:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:20:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:20:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:20:04 - job_xml_thread(): Done retrieving: data size 43534068
Sun 19 Jan 2014 09:20:04 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:20:04 - XML: Start document: iteration 14
Sun 19 Jan 2014 09:20:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43534068
Sun 19 Jan 2014 09:20:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:20:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43534068
Sun 19 Jan 2014 09:20:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:20:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:20:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:20:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:20:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:20:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:20:19 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:20:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:20:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:20:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:20:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:20:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:20:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:20:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:20:23 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:20:23 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:20:23 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:20:23 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:20:23 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:20:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:20:28 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:20:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:20:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:20:29 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:20:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 09:20:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:20:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:20:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:20:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:20:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:20:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:20:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43540351
Sun 19 Jan 2014 09:20:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:20:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43540351
Sun 19 Jan 2014 09:20:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:20:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:20:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:20:39 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:20:39 - job_xml_thread(): Done retrieving: data size 43540351
Sun 19 Jan 2014 09:20:39 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:20:39 - XML: Start document: iteration 15
Sun 19 Jan 2014 09:20:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:20:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:20:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:20:45 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:20:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:20:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:20:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:20:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:20:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:20:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:20:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:20:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:20:50 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:20:52 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:20:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 09:20:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:20:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 09:20:52 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:20:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5578 values 87927 bits 10990 bytes 
Sun 19 Jan 2014 09:20:55 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:20:55 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:20:55 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:20:55 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:20:55 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:20:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:20:55 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:20:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:20:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:20:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:20:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:20:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:20:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:20:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:20:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560198
Sun 19 Jan 2014 09:20:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:21:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560198
Sun 19 Jan 2014 09:21:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:21:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:21:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:21:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:21:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:21:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:21:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:21:10 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:21:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:21:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:21:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:21:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:21:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:21:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:21:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:21:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:21:15 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:21:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:21:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:21:15 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:21:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 09:21:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:21:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:21:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:21:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:21:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:21:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:21:18 - job_xml_thread(): Done retrieving: data size 43550771
Sun 19 Jan 2014 09:21:18 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:21:18 - XML: Start document: iteration 16
Sun 19 Jan 2014 09:21:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43550771
Sun 19 Jan 2014 09:21:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43550771
Sun 19 Jan 2014 09:21:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:21:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:21:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:21:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:21:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:21:28 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:21:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:21:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:21:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:21:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:21:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:21:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:21:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:21:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:21:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:21:32 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:21:32 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:21:32 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:21:32 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:21:32 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:21:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:21:37 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:21:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:21:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:21:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:21:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:21:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:21:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:21:38 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 09:21:38 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 09:21:38 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:21:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:21:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562400
Sun 19 Jan 2014 09:21:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:21:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562400
Sun 19 Jan 2014 09:21:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:21:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:21:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:21:47 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:21:47 - job_xml_thread(): Done retrieving: data size 43562400
Sun 19 Jan 2014 09:21:47 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:21:47 - XML: Start document: iteration 17
Sun 19 Jan 2014 09:21:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:21:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:21:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:21:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:21:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:21:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:21:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:21:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:21:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:21:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:21:52 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:21:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:21:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 09:21:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:21:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:21:52 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:21:52 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:21:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 09:21:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8933 values 140899 bits 17612 bytes 
Sun 19 Jan 2014 09:21:58 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:21:58 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:21:58 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:21:58 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:21:58 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:22:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:22:01 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:22:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:22:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:22:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:22:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:22:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:22:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:22:04 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:22:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 09:22:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:22:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:22:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43542369
Sun 19 Jan 2014 09:22:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:22:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43542369
Sun 19 Jan 2014 09:22:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:22:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:22:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:22:13 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:22:13 - job_xml_thread(): Done retrieving: data size 43542369
Sun 19 Jan 2014 09:22:13 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:22:13 - XML: Start document: iteration 18
Sun 19 Jan 2014 09:22:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:22:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:22:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:22:25 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:22:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:22:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:22:26 - XML: Processed 653347 elements - found 0 jobs
Sun 19 Jan 2014 09:22:26 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:22:26 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:22:26 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:22:26 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:22:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:22:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:22:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:22:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:22:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:22:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:22:27 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:22:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:22:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:22:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:22:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:22:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:22:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:22:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:22:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43590829
Sun 19 Jan 2014 09:22:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:22:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43590829
Sun 19 Jan 2014 09:22:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:22:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:22:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:22:41 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:22:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:22:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:22:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:22:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:22:42 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:22:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:22:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:22:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:22:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:22:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:22:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:22:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:22:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:22:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:22:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:22:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:22:44 - job_xml_thread(): Done retrieving: data size 43589934
Sun 19 Jan 2014 09:22:44 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:22:44 - XML: Start document: iteration 19
Sun 19 Jan 2014 09:22:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43589934
Sun 19 Jan 2014 09:22:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:22:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43589934
Sun 19 Jan 2014 09:22:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:22:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:22:53 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:22:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:22:53 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:22:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 09:22:53 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:22:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 09:22:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:22:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:22:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148597 bits 18574 bytes 
Sun 19 Jan 2014 09:22:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:22:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:22:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:22:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:23:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:23:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:23:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:23:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:23:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:23:03 - XML: Processed 653349 elements - found 0 jobs
Sun 19 Jan 2014 09:23:03 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:23:03 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:23:03 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:23:03 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:23:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:23:05 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:23:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:23:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:23:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:23:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:23:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:23:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:23:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:23:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572064
Sun 19 Jan 2014 09:23:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:23:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572064
Sun 19 Jan 2014 09:23:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:23:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:23:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:23:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:23:18 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:23:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:23:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:23:19 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:23:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:23:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:23:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:23:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:23:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:23:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:23:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:23:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:23:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:23:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:23:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:23:23 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:23:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 09:23:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:23:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:23:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:23:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:23:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:23:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:23:24 - job_xml_thread(): Done retrieving: data size 43515359
Sun 19 Jan 2014 09:23:24 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:23:24 - XML: Start document: iteration 20
Sun 19 Jan 2014 09:23:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43515359
Sun 19 Jan 2014 09:23:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43515359
Sun 19 Jan 2014 09:23:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:23:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:23:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:23:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:23:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:23:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:23:40 - XML: Processed 652596 elements - found 0 jobs
Sun 19 Jan 2014 09:23:40 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:23:40 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:23:40 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:23:40 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:23:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:23:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:23:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:23:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:23:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:23:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:23:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:23:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:23:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:23:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:23:45 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:23:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:23:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:23:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:23:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:23:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:23:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:23:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:23:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42945864
Sun 19 Jan 2014 09:23:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:23:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42945864
Sun 19 Jan 2014 09:23:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:23:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:23:53 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:23:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:23:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 09:23:55 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:23:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 09:23:55 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:23:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8876 values 140040 bits 17505 bytes 
Sun 19 Jan 2014 09:23:55 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:23:55 - job_xml_thread(): Done retrieving: data size 42945864
Sun 19 Jan 2014 09:23:55 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:23:55 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 09:23:56 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 09:23:56 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:23:57 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 09:23:57 - Housekeeping: done.
Sun 19 Jan 2014 09:23:57 - XML: Start document: iteration 0
Sun 19 Jan 2014 09:23:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:23:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:23:58 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:23:58 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 09:23:58 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 09:23:58 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:23:58 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 09:24:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:24:01 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:24:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:24:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:24:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:24:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:24:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:24:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:24:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:24:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:24:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:24:03 - size of cluster 'LISA Cluster': 624 hosts 79485 metrics 810313 values 12770963 bits 1596370 bytes 
Sun 19 Jan 2014 09:24:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:24:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:24:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:24:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:24:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:24:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:24:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:24:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:24:11 - XML: Processed 645692 elements - found 0 jobs
Sun 19 Jan 2014 09:24:11 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:24:11 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:24:11 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:24:11 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:24:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:24:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42906458
Sun 19 Jan 2014 09:24:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:24:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42906458
Sun 19 Jan 2014 09:24:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:24:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:24:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:24:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:24:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:24:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:24:26 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:24:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:24:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:24:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:24:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:24:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:24:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:24:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:24:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:24:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:24:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:24:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:24:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:24:30 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:24:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 09:24:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:24:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:24:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:24:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:24:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:24:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:24:33 - job_xml_thread(): Done retrieving: data size 43288969
Sun 19 Jan 2014 09:24:33 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:24:33 - XML: Start document: iteration 1
Sun 19 Jan 2014 09:24:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43288969
Sun 19 Jan 2014 09:24:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:24:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43288969
Sun 19 Jan 2014 09:24:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:24:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:24:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:24:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:24:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:24:49 - XML: Processed 650016 elements - found 0 jobs
Sun 19 Jan 2014 09:24:49 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:24:49 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:24:49 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:24:49 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:24:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:24:54 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:24:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:24:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:24:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:24:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:24:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:24:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:24:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:24:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:24:55 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:24:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:24:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 09:24:55 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:24:55 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:24:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5735 values 90410 bits 11301 bytes 
Sun 19 Jan 2014 09:24:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 09:24:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:24:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:24:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:24:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:24:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:24:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:24:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:24:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:24:58 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:24:58 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 09:25:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:25:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559033
Sun 19 Jan 2014 09:25:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:25:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559033
Sun 19 Jan 2014 09:25:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:25:04 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:25:04 - job_xml_thread(): Done retrieving: data size 43559033
Sun 19 Jan 2014 09:25:04 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:25:04 - XML: Start document: iteration 2
Sun 19 Jan 2014 09:25:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:25:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:25:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:25:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:25:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:25:19 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:25:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:25:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:25:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:25:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:25:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:25:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:25:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:25:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:25:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:25:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:25:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:25:22 - XML: Processed 653030 elements - found 0 jobs
Sun 19 Jan 2014 09:25:22 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:25:22 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:25:22 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:25:22 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:25:23 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:25:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 09:25:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:25:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:25:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:25:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:25:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:25:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:25:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581479
Sun 19 Jan 2014 09:25:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:25:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581479
Sun 19 Jan 2014 09:25:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:25:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:25:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:25:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:25:37 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:25:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:25:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:25:37 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:25:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:25:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:25:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:25:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:25:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:25:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:25:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:25:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:25:40 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:25:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:25:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:25:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:25:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:25:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:25:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:25:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:25:43 - job_xml_thread(): Done retrieving: data size 43578462
Sun 19 Jan 2014 09:25:43 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:25:43 - XML: Start document: iteration 3
Sun 19 Jan 2014 09:25:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578462
Sun 19 Jan 2014 09:25:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:25:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578462
Sun 19 Jan 2014 09:25:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:25:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:25:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:25:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:25:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:25:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:25:56 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:25:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:25:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 09:25:56 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:25:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8844 values 139472 bits 17434 bytes 
Sun 19 Jan 2014 09:25:56 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:25:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 09:25:58 - XML: Processed 653346 elements - found 0 jobs
Sun 19 Jan 2014 09:25:58 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:25:58 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:25:58 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:25:58 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:26:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:26:03 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:26:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:26:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:26:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:26:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:26:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:26:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:26:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:26:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:26:06 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:26:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:26:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:26:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:26:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:26:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:26:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:26:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:26:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575424
Sun 19 Jan 2014 09:26:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:26:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575424
Sun 19 Jan 2014 09:26:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:26:14 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:26:14 - job_xml_thread(): Done retrieving: data size 43575424
Sun 19 Jan 2014 09:26:14 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:26:14 - XML: Start document: iteration 4
Sun 19 Jan 2014 09:26:16 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:26:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 09:26:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:26:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:26:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:26:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:26:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:26:25 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:26:25 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:26:25 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:26:25 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:26:25 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:26:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:26:30 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:26:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:26:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:26:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:26:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:26:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:26:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:26:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:26:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:26:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:26:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:26:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:26:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:26:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:26:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:26:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:26:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:26:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573254
Sun 19 Jan 2014 09:26:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:26:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573254
Sun 19 Jan 2014 09:26:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:26:40 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:26:40 - job_xml_thread(): Done retrieving: data size 43573254
Sun 19 Jan 2014 09:26:40 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:26:40 - XML: Start document: iteration 5
Sun 19 Jan 2014 09:26:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:26:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:26:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:26:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:26:52 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:26:52 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:26:52 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:26:52 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:26:52 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:26:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:26:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:26:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:26:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:26:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:26:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:26:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:26:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:26:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:26:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:26:57 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:26:57 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:26:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:26:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 09:26:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 09:26:57 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:26:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6134 values 96736 bits 12092 bytes 
Sun 19 Jan 2014 09:26:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:26:58 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:26:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:26:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:26:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:26:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:26:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:26:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:27:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:27:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570089
Sun 19 Jan 2014 09:27:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:27:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570089
Sun 19 Jan 2014 09:27:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:27:03 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:27:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 09:27:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:27:07 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:27:07 - job_xml_thread(): Done retrieving: data size 43570089
Sun 19 Jan 2014 09:27:07 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:27:07 - XML: Start document: iteration 6
Sun 19 Jan 2014 09:27:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:27:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:27:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:27:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:27:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:27:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:27:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:27:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:27:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:27:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:27:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:27:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:27:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:27:20 - XML: Processed 653347 elements - found 0 jobs
Sun 19 Jan 2014 09:27:20 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:27:20 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:27:20 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:27:20 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:27:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:27:25 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:27:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:27:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:27:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:27:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:27:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:27:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:27:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:27:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568811
Sun 19 Jan 2014 09:27:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:27:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568811
Sun 19 Jan 2014 09:27:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:27:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:27:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:27:35 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:27:35 - job_xml_thread(): Done retrieving: data size 43568811
Sun 19 Jan 2014 09:27:35 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:27:35 - XML: Start document: iteration 7
Sun 19 Jan 2014 09:27:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:27:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:27:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:27:44 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:27:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:27:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:27:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:27:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:27:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:27:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:27:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:27:47 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:27:47 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:27:47 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:27:47 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:27:47 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:27:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:27:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:27:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:27:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:27:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:27:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:27:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:27:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:27:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:27:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565078
Sun 19 Jan 2014 09:27:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:27:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565078
Sun 19 Jan 2014 09:27:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:27:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:27:57 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:27:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:27:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 09:27:58 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:27:58 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:27:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 09:27:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9394 values 148199 bits 18524 bytes 
Sun 19 Jan 2014 09:28:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:28:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:28:02 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:28:02 - job_xml_thread(): Done retrieving: data size 43565078
Sun 19 Jan 2014 09:28:02 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:28:03 - XML: Start document: iteration 8
Sun 19 Jan 2014 09:28:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:28:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:28:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:28:10 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:28:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:28:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:28:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:28:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:28:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:28:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:28:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:28:14 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:28:14 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:28:14 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:28:14 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:28:14 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:28:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:28:18 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:28:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:28:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:28:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:28:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:28:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:28:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:28:19 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 09:28:19 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 09:28:19 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:28:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:28:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559479
Sun 19 Jan 2014 09:28:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:28:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559479
Sun 19 Jan 2014 09:28:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:28:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:28:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:28:29 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:28:29 - job_xml_thread(): Done retrieving: data size 43559479
Sun 19 Jan 2014 09:28:29 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:28:29 - XML: Start document: iteration 9
Sun 19 Jan 2014 09:28:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:28:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:28:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:28:36 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:28:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:28:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:28:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:28:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:28:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:28:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:28:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:28:41 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:28:41 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:28:41 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:28:41 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:28:41 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:28:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:28:42 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:28:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:28:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:28:42 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:28:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 09:28:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:28:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:28:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:28:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:28:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:28:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:28:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580010
Sun 19 Jan 2014 09:28:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:28:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580010
Sun 19 Jan 2014 09:28:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:28:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:28:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:28:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:28:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:28:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:28:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:28:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:28:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:28:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:28:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:28:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:28:56 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:28:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:28:58 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:28:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:28:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:28:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:28:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:28:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:28:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:28:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:28:58 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:28:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:28:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43591594
Sun 19 Jan 2014 09:28:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:28:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43591594
Sun 19 Jan 2014 09:28:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:28:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:28:59 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:28:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 09:28:59 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:28:59 - job_xml_thread(): Done retrieving: data size 43591594
Sun 19 Jan 2014 09:28:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 09:29:00 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:29:00 - XML: Start document: iteration 10
Sun 19 Jan 2014 09:29:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6437 values 101616 bits 12702 bytes 
Sun 19 Jan 2014 09:29:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:29:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:29:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:29:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:29:16 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:29:16 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:29:16 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:29:17 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:29:17 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:29:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:29:18 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:29:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:29:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:29:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:29:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:29:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:29:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:29:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:29:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:29:21 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:29:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:29:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:29:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:29:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:29:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:29:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:29:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:29:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43517325
Sun 19 Jan 2014 09:29:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:29:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43517325
Sun 19 Jan 2014 09:29:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:29:32 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:29:32 - job_xml_thread(): Done retrieving: data size 43517325
Sun 19 Jan 2014 09:29:32 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:29:32 - XML: Start document: iteration 11
Sun 19 Jan 2014 09:29:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:29:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:29:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:29:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:29:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:29:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:29:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:29:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:29:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:29:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:29:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:29:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:29:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:29:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:29:45 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:29:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:29:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:29:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:29:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:29:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:29:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:29:47 - XML: Processed 652600 elements - found 0 jobs
Sun 19 Jan 2014 09:29:47 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:29:47 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:29:47 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:29:47 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:29:47 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:29:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 09:29:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:29:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:29:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42954579
Sun 19 Jan 2014 09:29:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:29:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42954579
Sun 19 Jan 2014 09:29:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:29:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:29:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:29:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:29:57 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:29:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:29:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:29:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:29:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:29:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:29:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:29:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42954579
Sun 19 Jan 2014 09:29:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:30:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:30:00 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:30:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:30:01 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:30:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 09:30:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 09:30:01 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:30:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:30:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:30:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6036 values 95187 bits 11898 bytes 
Sun 19 Jan 2014 09:30:02 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:30:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:30:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:30:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:30:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:30:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:30:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:30:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:30:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:30:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:30:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:30:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:30:11 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:30:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 09:30:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:30:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:30:12 - job_xml_thread(): Done retrieving: data size 42913758
Sun 19 Jan 2014 09:30:12 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:30:12 - XML: Start document: iteration 12
Sun 19 Jan 2014 09:30:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42913758
Sun 19 Jan 2014 09:30:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:30:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:30:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:30:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:30:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:30:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:30:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:30:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42913758
Sun 19 Jan 2014 09:30:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:30:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:30:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:30:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:30:27 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:30:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:30:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:30:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:30:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:30:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:30:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:30:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:30:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:30:34 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:30:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:30:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:30:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:30:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:30:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:30:35 - XML: Processed 645150 elements - found 0 jobs
Sun 19 Jan 2014 09:30:35 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:30:35 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:30:35 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:30:35 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:30:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:30:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:30:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43423320
Sun 19 Jan 2014 09:30:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:30:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43423320
Sun 19 Jan 2014 09:30:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:30:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:30:46 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:30:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:30:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:30:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:30:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:30:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:30:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:30:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:30:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:30:50 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:30:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:30:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:30:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:30:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:30:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:30:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:30:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:30:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:30:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:30:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:30:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43549353
Sun 19 Jan 2014 09:30:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:30:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43549353
Sun 19 Jan 2014 09:30:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:30:53 - job_xml_thread(): Done retrieving: data size 43549353
Sun 19 Jan 2014 09:30:53 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:30:53 - XML: Start document: iteration 13
Sun 19 Jan 2014 09:30:58 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 09:30:59 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:31:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:31:01 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:31:01 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:31:01 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:31:01 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 09:31:01 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 09:31:01 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 09:31:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:31:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 09:31:02 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:31:02 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:31:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 09:31:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:31:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:31:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148635 bits 18579 bytes 
Sun 19 Jan 2014 09:31:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:31:04 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:31:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:31:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:31:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:31:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:31:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:31:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:31:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:31:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:31:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:31:12 - size of cluster 'LISA Cluster': 624 hosts 79487 metrics 829207 values 13068721 bits 1633590 bytes 
Sun 19 Jan 2014 09:31:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:31:14 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:31:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:31:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:31:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:31:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:31:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:31:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:31:15 - XML: Processed 653062 elements - found 0 jobs
Sun 19 Jan 2014 09:31:15 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:31:15 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:31:15 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:31:15 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:31:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:31:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43545904
Sun 19 Jan 2014 09:31:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:31:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43545904
Sun 19 Jan 2014 09:31:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:31:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:31:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:31:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:31:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:31:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:31:29 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:31:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:31:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:31:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:31:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:31:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:31:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:31:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:31:30 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:31:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:31:35 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:31:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:31:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:31:35 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:31:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 09:31:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:31:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:31:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:31:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:31:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:31:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:31:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560352
Sun 19 Jan 2014 09:31:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:31:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560352
Sun 19 Jan 2014 09:31:39 - job_xml_thread(): Done retrieving: data size 43560352
Sun 19 Jan 2014 09:31:39 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:31:39 - XML: Start document: iteration 14
Sun 19 Jan 2014 09:31:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:31:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:31:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:31:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:31:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:31:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:31:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:31:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:31:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:31:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:31:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:31:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:31:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:31:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:31:57 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:31:57 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:31:57 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:31:57 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:31:57 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:32:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:32:01 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:32:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:32:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:32:01 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:32:01 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 09:32:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:32:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:32:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:32:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:32:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:32:03 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:32:03 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:32:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 09:32:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:32:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 09:32:03 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:32:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5557 values 87781 bits 10972 bytes 
Sun 19 Jan 2014 09:32:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:32:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43550350
Sun 19 Jan 2014 09:32:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:32:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43550350
Sun 19 Jan 2014 09:32:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:32:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:32:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:32:12 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:32:12 - job_xml_thread(): Done retrieving: data size 43550350
Sun 19 Jan 2014 09:32:12 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:32:12 - XML: Start document: iteration 15
Sun 19 Jan 2014 09:32:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:32:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:32:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:32:20 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:32:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:32:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:32:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:32:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:32:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:32:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:32:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:32:24 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:32:24 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:32:24 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:32:24 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:32:24 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:32:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:32:28 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:32:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:32:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:32:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:32:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:32:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:32:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:32:31 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:32:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 09:32:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:32:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:32:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572963
Sun 19 Jan 2014 09:32:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:32:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572963
Sun 19 Jan 2014 09:32:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:32:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:32:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:32:39 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:32:39 - job_xml_thread(): Done retrieving: data size 43572963
Sun 19 Jan 2014 09:32:39 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:32:39 - XML: Start document: iteration 16
Sun 19 Jan 2014 09:32:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:32:43 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:32:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:32:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:32:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:32:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:32:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:32:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:32:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:32:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:32:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:32:54 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:32:55 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:32:55 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:32:55 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:32:55 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:32:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:32:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:32:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:32:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:32:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:32:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:32:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:32:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:32:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:32:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:32:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:32:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558351
Sun 19 Jan 2014 09:32:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:33:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558351
Sun 19 Jan 2014 09:33:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:33:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:33:03 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:33:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:33:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 09:33:04 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:33:04 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:33:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 09:33:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6581 values 104048 bits 13006 bytes 
Sun 19 Jan 2014 09:33:10 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:33:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:33:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:33:10 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:33:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:33:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:33:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:33:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:33:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:33:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:33:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:33:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:33:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:33:16 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:33:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:33:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:33:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:33:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:33:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:33:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:33:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:33:20 - job_xml_thread(): Done retrieving: data size 43557887
Sun 19 Jan 2014 09:33:20 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:33:20 - XML: Start document: iteration 17
Sun 19 Jan 2014 09:33:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557887
Sun 19 Jan 2014 09:33:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:33:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557887
Sun 19 Jan 2014 09:33:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:33:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:33:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:33:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:33:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:33:35 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:33:35 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:33:35 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:33:35 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:33:35 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:33:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:33:39 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:33:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:33:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:33:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:33:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:33:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:33:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:33:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:33:41 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:33:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 09:33:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:33:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:33:42 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:33:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:33:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:33:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:33:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:33:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:33:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:33:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:33:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574975
Sun 19 Jan 2014 09:33:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:33:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574975
Sun 19 Jan 2014 09:33:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:33:51 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:33:51 - job_xml_thread(): Done retrieving: data size 43574975
Sun 19 Jan 2014 09:33:51 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:33:51 - XML: Start document: iteration 18
Sun 19 Jan 2014 09:33:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:33:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:33:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:33:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:34:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:34:00 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:34:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:34:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:34:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:34:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:34:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:34:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:34:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:34:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:34:04 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:34:05 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:34:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 09:34:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:34:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 09:34:05 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:34:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6001 values 94814 bits 11851 bytes 
Sun 19 Jan 2014 09:34:08 - XML: Processed 653345 elements - found 0 jobs
Sun 19 Jan 2014 09:34:08 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:34:08 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:34:08 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:34:08 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:34:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:34:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:34:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:34:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:34:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:34:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:34:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:34:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:34:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:34:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564468
Sun 19 Jan 2014 09:34:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:34:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564468
Sun 19 Jan 2014 09:34:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:34:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:34:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:34:23 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:34:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:34:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:34:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:34:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:34:27 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:34:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:34:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:34:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:34:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:34:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:34:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:34:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:34:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:34:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:34:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:34:31 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:34:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 09:34:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:34:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:34:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:34:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:34:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:34:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:34:33 - job_xml_thread(): Done retrieving: data size 43559465
Sun 19 Jan 2014 09:34:33 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:34:33 - XML: Start document: iteration 19
Sun 19 Jan 2014 09:34:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559465
Sun 19 Jan 2014 09:34:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:34:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559465
Sun 19 Jan 2014 09:34:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:34:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:34:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:34:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:34:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:34:49 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:34:49 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:34:49 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:34:49 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:34:49 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:34:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:34:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:34:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:34:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:34:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:34:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:34:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:34:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:34:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:34:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:34:55 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:34:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:34:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:34:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:34:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:34:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:34:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:34:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:34:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43591453
Sun 19 Jan 2014 09:34:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:34:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43591453
Sun 19 Jan 2014 09:34:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:35:04 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:35:04 - job_xml_thread(): Done retrieving: data size 43591453
Sun 19 Jan 2014 09:35:04 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:35:05 - XML: Start document: iteration 20
Sun 19 Jan 2014 09:35:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:35:05 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:35:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:35:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:35:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:35:07 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:35:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 09:35:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 09:35:08 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:35:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8923 values 140781 bits 17597 bytes 
Sun 19 Jan 2014 09:35:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:35:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:35:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:35:14 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:35:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:35:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:35:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:35:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:35:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:35:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:35:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:35:21 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:35:21 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:35:21 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:35:21 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:35:21 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:35:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:35:21 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:35:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:35:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:35:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:35:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:35:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:35:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:35:23 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 09:35:23 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 09:35:23 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:35:24 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:35:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 09:35:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:35:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:35:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43497165
Sun 19 Jan 2014 09:35:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:35:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43497165
Sun 19 Jan 2014 09:35:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:35:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:35:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:35:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:35:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:35:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:35:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:35:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:35:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:35:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:35:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:35:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:35:36 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:35:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:35:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:35:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:35:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:35:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:35:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:35:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:35:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:35:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:35:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:35:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:35:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42998948
Sun 19 Jan 2014 09:35:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:35:40 - job_xml_thread(): Done retrieving: data size 42998948
Sun 19 Jan 2014 09:35:40 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:35:40 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 09:35:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42998948
Sun 19 Jan 2014 09:35:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:35:41 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 09:35:41 - Housekeeping: done.
Sun 19 Jan 2014 09:35:41 - XML: Start document: iteration 0
Sun 19 Jan 2014 09:35:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:35:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:35:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:35:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:35:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:35:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:35:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:35:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:35:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:35:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:35:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:35:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:35:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:36:01 - XML: Processed 646130 elements - found 0 jobs
Sun 19 Jan 2014 09:36:01 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:36:01 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:36:01 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:36:01 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:36:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:36:04 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:36:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:36:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:36:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:36:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42881798
Sun 19 Jan 2014 09:36:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:36:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:36:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:36:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:36:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42881798
Sun 19 Jan 2014 09:36:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:36:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:36:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:36:08 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:36:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:36:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:36:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:36:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 09:36:09 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:36:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148638 bits 18579 bytes 
Sun 19 Jan 2014 09:36:09 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:36:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 09:36:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:36:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:36:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:36:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:36:16 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:36:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:36:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:36:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:36:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:36:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:36:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:36:19 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:36:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:36:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:36:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:36:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:36:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:36:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:36:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:36:21 - job_xml_thread(): Done retrieving: data size 42973759
Sun 19 Jan 2014 09:36:21 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:36:21 - XML: Start document: iteration 1
Sun 19 Jan 2014 09:36:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42973759
Sun 19 Jan 2014 09:36:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:36:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42973759
Sun 19 Jan 2014 09:36:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:36:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:36:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:36:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:36:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:36:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:36:37 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:36:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:36:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:36:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:36:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:36:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:36:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:36:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:36:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:36:42 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:36:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:36:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:36:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:36:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:36:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:36:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:36:45 - XML: Processed 645900 elements - found 0 jobs
Sun 19 Jan 2014 09:36:45 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:36:45 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:36:45 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:36:45 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:36:45 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:36:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 09:36:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:36:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:36:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43479131
Sun 19 Jan 2014 09:36:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:36:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43479131
Sun 19 Jan 2014 09:36:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:36:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:36:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:36:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:36:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:37:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:37:00 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:37:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:37:00 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:37:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:37:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:37:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:37:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:37:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:37:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:37:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:37:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:37:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:37:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:37:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:37:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:37:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:37:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:37:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:37:03 - job_xml_thread(): Done retrieving: data size 43564616
Sun 19 Jan 2014 09:37:03 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:37:03 - XML: Start document: iteration 2
Sun 19 Jan 2014 09:37:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564616
Sun 19 Jan 2014 09:37:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:37:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564616
Sun 19 Jan 2014 09:37:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:37:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:37:09 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:37:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:37:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 09:37:10 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:37:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 09:37:10 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:37:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8954 values 141280 bits 17660 bytes 
Sun 19 Jan 2014 09:37:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:37:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:37:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:37:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:37:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:37:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:37:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:37:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:37:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:37:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:37:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:37:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:37:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:37:24 - XML: Processed 653339 elements - found 0 jobs
Sun 19 Jan 2014 09:37:24 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:37:24 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:37:24 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:37:24 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:37:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:37:27 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:37:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:37:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:37:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:37:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:37:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:37:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:37:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:37:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43585512
Sun 19 Jan 2014 09:37:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:37:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43585512
Sun 19 Jan 2014 09:37:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:37:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:37:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:37:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:37:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:37:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:37:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:37:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:37:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:37:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43585512
Sun 19 Jan 2014 09:37:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:37:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:37:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:37:39 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:37:39 - job_xml_thread(): Done retrieving: data size 43585512
Sun 19 Jan 2014 09:37:39 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:37:39 - XML: Start document: iteration 3
Sun 19 Jan 2014 09:37:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:37:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:37:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:37:45 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:37:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:37:51 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:37:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:37:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:37:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:37:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:37:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:37:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:37:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:37:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:37:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:37:55 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:37:55 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:37:55 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:37:55 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:37:55 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:37:55 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:37:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 09:37:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:37:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:37:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:37:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:37:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:37:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:37:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584666
Sun 19 Jan 2014 09:37:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:37:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584666
Sun 19 Jan 2014 09:37:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:38:01 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 09:38:01 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:38:02 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:38:02 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 09:38:03 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 09:38:03 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:38:03 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 09:38:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:38:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:38:10 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:38:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:38:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:38:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:38:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:38:10 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:38:10 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:38:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:38:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:38:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:38:11 - size of cluster 'LISA Cluster': 624 hosts 79478 metrics 795549 values 12549678 bits 1568709 bytes 
Sun 19 Jan 2014 09:38:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:38:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:38:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:38:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:38:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:38:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 09:38:11 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:38:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 09:38:11 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:38:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5827 values 91885 bits 11485 bytes 
Sun 19 Jan 2014 09:38:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:38:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:38:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:38:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:38:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:38:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:38:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:38:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:38:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:38:16 - job_xml_thread(): Done retrieving: data size 43589387
Sun 19 Jan 2014 09:38:16 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:38:16 - XML: Start document: iteration 4
Sun 19 Jan 2014 09:38:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43589387
Sun 19 Jan 2014 09:38:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:38:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43589387
Sun 19 Jan 2014 09:38:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:38:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:38:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:38:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:38:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:38:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:38:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:38:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:38:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:38:34 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:38:34 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:38:34 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:38:34 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:38:34 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:38:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:38:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:38:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:38:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:38:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:38:37 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:38:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 09:38:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:38:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:38:39 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:38:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:38:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:38:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:38:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:38:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:38:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:38:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:38:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583339
Sun 19 Jan 2014 09:38:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:38:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583339
Sun 19 Jan 2014 09:38:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:38:49 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:38:49 - job_xml_thread(): Done retrieving: data size 43583339
Sun 19 Jan 2014 09:38:49 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:38:49 - XML: Start document: iteration 5
Sun 19 Jan 2014 09:38:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:38:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:38:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:38:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:38:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:38:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:38:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:38:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:38:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:38:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:38:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:38:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:38:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:39:00 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:39:00 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:39:00 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:39:00 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:39:00 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:39:04 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:39:04 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 09:39:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:39:04 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:39:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:39:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:39:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:39:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:39:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:39:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:39:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:39:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43540264
Sun 19 Jan 2014 09:39:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:39:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:39:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:39:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43540264
Sun 19 Jan 2014 09:39:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:39:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:39:11 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:39:12 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:39:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:39:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 09:39:12 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:39:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9002 values 141983 bits 17747 bytes 
Sun 19 Jan 2014 09:39:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 09:39:15 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:39:15 - job_xml_thread(): Done retrieving: data size 43540264
Sun 19 Jan 2014 09:39:15 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:39:15 - XML: Start document: iteration 6
Sun 19 Jan 2014 09:39:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:39:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:39:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:39:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:39:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:39:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:39:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:39:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:39:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:39:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:39:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:39:28 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:39:28 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:39:28 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:39:28 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:39:28 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:39:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:39:31 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:39:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:39:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:39:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:39:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:39:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:39:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:39:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:39:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43545269
Sun 19 Jan 2014 09:39:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:39:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43545269
Sun 19 Jan 2014 09:39:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:39:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:39:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:39:43 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:39:43 - job_xml_thread(): Done retrieving: data size 43545269
Sun 19 Jan 2014 09:39:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:39:43 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:39:44 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:39:44 - XML: Start document: iteration 7
Sun 19 Jan 2014 09:39:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:39:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:39:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:39:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:39:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:39:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:39:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:39:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:39:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:39:48 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:39:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 09:39:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:39:53 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:39:53 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:39:53 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:39:53 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:39:53 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:39:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:39:57 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:39:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:39:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:39:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:39:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:39:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:39:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:40:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:40:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43551197
Sun 19 Jan 2014 09:40:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:40:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:40:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:40:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43551197
Sun 19 Jan 2014 09:40:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:40:08 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:40:08 - job_xml_thread(): Done retrieving: data size 43551197
Sun 19 Jan 2014 09:40:08 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:40:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:40:08 - XML: Start document: iteration 8
Sun 19 Jan 2014 09:40:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:40:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:40:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:40:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:40:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:40:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:40:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:40:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:40:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:40:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:40:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:40:13 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:40:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:40:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 09:40:14 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:40:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 09:40:14 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:40:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5983 values 94374 bits 11796 bytes 
Sun 19 Jan 2014 09:40:20 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:40:20 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:40:20 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:40:20 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:40:20 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:40:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:40:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:40:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:40:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:40:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:40:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:40:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:40:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:40:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:40:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:40:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:40:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43534094
Sun 19 Jan 2014 09:40:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:40:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43534094
Sun 19 Jan 2014 09:40:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:40:35 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:40:35 - job_xml_thread(): Done retrieving: data size 43534094
Sun 19 Jan 2014 09:40:35 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:40:35 - XML: Start document: iteration 9
Sun 19 Jan 2014 09:40:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:40:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:40:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:40:39 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:40:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:40:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:40:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:40:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:40:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:40:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:40:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:40:47 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:40:47 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:40:47 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:40:47 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:40:47 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:40:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:40:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:40:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:40:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:40:50 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:40:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 09:40:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:40:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:40:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:40:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:40:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:40:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:40:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43539243
Sun 19 Jan 2014 09:40:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:40:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43539243
Sun 19 Jan 2014 09:40:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:40:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:40:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:41:02 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:41:02 - job_xml_thread(): Done retrieving: data size 43539243
Sun 19 Jan 2014 09:41:02 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:41:02 - XML: Start document: iteration 10
Sun 19 Jan 2014 09:41:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:41:04 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:41:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:41:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:41:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:41:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:41:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:41:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:41:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:41:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:41:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:41:11 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:41:11 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:41:11 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:41:11 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:41:11 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:41:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:41:14 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:41:15 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:41:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:41:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 09:41:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 09:41:15 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:41:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5836 values 92040 bits 11505 bytes 
Sun 19 Jan 2014 09:41:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:41:15 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:41:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:41:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:41:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:41:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:41:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:41:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:41:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:41:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43490929
Sun 19 Jan 2014 09:41:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:41:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43490929
Sun 19 Jan 2014 09:41:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:41:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:41:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:41:26 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:41:26 - job_xml_thread(): Done retrieving: data size 43490929
Sun 19 Jan 2014 09:41:26 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:41:26 - XML: Start document: iteration 11
Sun 19 Jan 2014 09:41:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:41:31 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:41:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:41:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:41:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:41:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:41:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:41:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:41:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:41:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:41:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:41:38 - XML: Processed 652600 elements - found 0 jobs
Sun 19 Jan 2014 09:41:38 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:41:38 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:41:38 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:41:38 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:41:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:41:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:41:43 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:41:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 09:41:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:41:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:41:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:41:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:41:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:41:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:41:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:41:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:41:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43028560
Sun 19 Jan 2014 09:41:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:41:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:41:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:41:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43028560
Sun 19 Jan 2014 09:41:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:41:53 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:41:53 - job_xml_thread(): Done retrieving: data size 43028560
Sun 19 Jan 2014 09:41:53 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:41:53 - XML: Start document: iteration 12
Sun 19 Jan 2014 09:41:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:41:58 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:41:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:41:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:41:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:41:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:41:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:41:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:41:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:41:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:41:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:42:08 - XML: Processed 646836 elements - found 0 jobs
Sun 19 Jan 2014 09:42:08 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:42:08 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:42:08 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:42:08 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:42:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:42:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:42:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:42:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:42:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:42:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:42:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:42:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:42:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:42:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42890177
Sun 19 Jan 2014 09:42:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:42:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42890177
Sun 19 Jan 2014 09:42:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:42:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:42:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:42:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:42:15 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:42:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:42:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 09:42:16 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:42:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8355 values 131691 bits 16461 bytes 
Sun 19 Jan 2014 09:42:16 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:42:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 09:42:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:42:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:42:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:42:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:42:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:42:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:42:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42890177
Sun 19 Jan 2014 09:42:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:42:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:42:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:42:23 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:42:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:42:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:42:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:42:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:42:34 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:42:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:42:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:42:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:42:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:42:35 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 09:42:35 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 09:42:35 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:42:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:42:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:42:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:42:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:42:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:42:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:42:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:42:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:42:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:42:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:42:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:42:37 - job_xml_thread(): Done retrieving: data size 43411655
Sun 19 Jan 2014 09:42:37 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:42:37 - XML: Start document: iteration 13
Sun 19 Jan 2014 09:42:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43411655
Sun 19 Jan 2014 09:42:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:42:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43411655
Sun 19 Jan 2014 09:42:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:42:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:42:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:42:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:42:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:42:56 - XML: Processed 651842 elements - found 0 jobs
Sun 19 Jan 2014 09:42:56 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:42:56 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:42:56 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:42:56 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:42:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:42:58 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:42:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:42:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:42:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:42:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:42:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:42:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:42:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:43:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:43:01 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:43:01 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:43:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 09:43:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:43:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:43:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:43:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:43:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:43:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:43:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:43:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:43:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554717
Sun 19 Jan 2014 09:43:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:43:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554717
Sun 19 Jan 2014 09:43:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:43:11 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:43:11 - job_xml_thread(): Done retrieving: data size 43554717
Sun 19 Jan 2014 09:43:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:43:12 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:43:12 - XML: Start document: iteration 14
Sun 19 Jan 2014 09:43:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:43:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:43:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:43:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:43:16 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:43:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:43:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:43:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:43:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:43:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:43:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:43:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 09:43:17 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:43:17 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:43:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 09:43:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:43:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6344 values 100035 bits 12504 bytes 
Sun 19 Jan 2014 09:43:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:43:22 - XML: Processed 653178 elements - found 0 jobs
Sun 19 Jan 2014 09:43:22 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:43:23 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:43:23 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:43:23 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:43:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:43:24 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:43:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:43:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:43:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:43:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:43:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:43:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:43:27 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:43:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 09:43:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:43:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:43:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556920
Sun 19 Jan 2014 09:43:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:43:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556920
Sun 19 Jan 2014 09:43:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:43:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:43:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:43:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:43:37 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:43:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:43:38 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:43:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:43:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:43:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:43:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:43:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:43:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:43:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:43:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:43:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:43:41 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:43:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:43:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:43:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:43:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:43:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:43:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:43:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:43:42 - job_xml_thread(): Done retrieving: data size 43590934
Sun 19 Jan 2014 09:43:42 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:43:42 - XML: Start document: iteration 15
Sun 19 Jan 2014 09:43:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43590934
Sun 19 Jan 2014 09:43:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:43:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43590934
Sun 19 Jan 2014 09:43:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:43:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:43:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:43:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:43:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:43:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:43:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:43:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:43:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:43:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:43:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:43:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:43:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:43:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:44:03 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:44:03 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:44:03 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:44:03 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:44:03 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:44:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:44:05 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:44:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:44:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:44:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:44:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:44:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:44:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:44:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:44:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43551345
Sun 19 Jan 2014 09:44:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:44:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43551345
Sun 19 Jan 2014 09:44:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:44:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:44:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:44:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:44:17 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:44:18 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:44:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:44:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:44:18 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:44:18 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:44:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 09:44:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:44:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 09:44:18 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:44:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148555 bits 18569 bytes 
Sun 19 Jan 2014 09:44:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:44:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:44:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:44:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:44:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:44:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:44:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:44:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:44:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:44:21 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:44:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:44:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:44:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:44:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:44:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:44:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:44:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:44:23 - job_xml_thread(): Done retrieving: data size 43575385
Sun 19 Jan 2014 09:44:23 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:44:23 - XML: Start document: iteration 16
Sun 19 Jan 2014 09:44:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575385
Sun 19 Jan 2014 09:44:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:44:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575385
Sun 19 Jan 2014 09:44:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:44:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:44:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:44:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:44:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:44:44 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:44:44 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:44:44 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:44:44 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:44:44 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:44:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:44:45 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:44:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:44:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:44:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:44:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:44:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:44:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:44:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:44:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:44:48 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:44:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:44:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:44:49 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:44:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 09:44:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:44:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:44:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:44:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:44:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:44:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:44:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564252
Sun 19 Jan 2014 09:44:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:44:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564252
Sun 19 Jan 2014 09:44:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:44:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:44:59 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:44:59 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:44:59 - job_xml_thread(): Done retrieving: data size 43564252
Sun 19 Jan 2014 09:44:59 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:44:59 - XML: Start document: iteration 17
Sun 19 Jan 2014 09:45:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:45:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:45:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:45:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:45:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:45:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:45:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:45:04 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 09:45:04 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:45:04 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:45:04 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 09:45:04 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:45:04 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 09:45:04 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 09:45:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:45:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:45:10 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:45:10 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:45:10 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:45:10 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:45:10 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:45:12 - size of cluster 'LISA Cluster': 624 hosts 79483 metrics 821736 values 12949745 bits 1618718 bytes 
Sun 19 Jan 2014 09:45:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:45:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:45:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:45:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:45:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:45:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:45:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:45:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:45:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:45:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555622
Sun 19 Jan 2014 09:45:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:45:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555622
Sun 19 Jan 2014 09:45:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:45:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:45:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:45:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:45:18 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:45:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:45:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 09:45:19 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:45:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8972 values 141487 bits 17685 bytes 
Sun 19 Jan 2014 09:45:20 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:45:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 09:45:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:45:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:45:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:45:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:45:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:45:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:45:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555622
Sun 19 Jan 2014 09:45:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:45:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:45:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:45:25 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:45:25 - job_xml_thread(): Done retrieving: data size 43555622
Sun 19 Jan 2014 09:45:25 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:45:25 - XML: Start document: iteration 18
Sun 19 Jan 2014 09:45:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:45:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:45:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:45:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:45:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:45:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:45:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:45:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:45:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:45:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:45:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:45:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:45:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:45:44 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:45:44 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:45:44 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:45:44 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:45:44 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:45:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:45:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:45:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:45:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:45:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:45:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:45:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:45:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:45:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:45:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557933
Sun 19 Jan 2014 09:45:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:45:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557933
Sun 19 Jan 2014 09:45:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:45:57 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:45:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 09:45:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:45:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:45:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:45:59 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:45:59 - job_xml_thread(): Done retrieving: data size 43557933
Sun 19 Jan 2014 09:45:59 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:45:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:45:59 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:45:59 - XML: Start document: iteration 19
Sun 19 Jan 2014 09:46:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:46:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:46:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:46:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:46:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:46:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:46:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:46:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:46:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:46:04 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:46:04 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 09:46:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:46:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:46:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:46:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:46:09 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:46:09 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:46:09 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:46:09 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:46:09 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:46:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:46:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:46:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:46:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:46:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:46:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570170
Sun 19 Jan 2014 09:46:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570170
Sun 19 Jan 2014 09:46:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:46:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:46:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:46:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:46:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:46:20 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:46:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:46:20 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:46:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 09:46:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 09:46:20 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:46:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6439 values 101634 bits 12704 bytes 
Sun 19 Jan 2014 09:46:24 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:46:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:46:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:46:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:46:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:46:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:46:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:46:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:46:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:46:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:46:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:46:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:46:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:46:29 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:46:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:46:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:46:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:46:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:46:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:46:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:46:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:46:32 - job_xml_thread(): Done retrieving: data size 43559546
Sun 19 Jan 2014 09:46:32 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:46:32 - XML: Start document: iteration 20
Sun 19 Jan 2014 09:46:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559546
Sun 19 Jan 2014 09:46:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:46:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559546
Sun 19 Jan 2014 09:46:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:46:41 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:46:41 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:46:41 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:46:41 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:46:41 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:46:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:46:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:46:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:46:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:46:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:46:54 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:46:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:46:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:46:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:46:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:46:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:46:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:46:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:46:56 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:46:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:46:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:46:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:46:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:46:56 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:46:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 09:46:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:46:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:46:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:46:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:46:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:46:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:46:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43587444
Sun 19 Jan 2014 09:46:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:47:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43587444
Sun 19 Jan 2014 09:47:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:47:00 - job_xml_thread(): Done retrieving: data size 43587444
Sun 19 Jan 2014 09:47:00 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:47:00 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 09:47:00 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 09:47:00 - Housekeeping: done.
Sun 19 Jan 2014 09:47:00 - XML: Start document: iteration 0
Sun 19 Jan 2014 09:47:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:47:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:47:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:47:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:47:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:47:20 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:47:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:47:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:47:20 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:47:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:47:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:47:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:47:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:47:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:47:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:47:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:47:21 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:47:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 09:47:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 09:47:21 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:47:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5766 values 91113 bits 11389 bytes 
Sun 19 Jan 2014 09:47:23 - XML: Processed 653348 elements - found 0 jobs
Sun 19 Jan 2014 09:47:23 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:47:23 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:47:23 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:47:23 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:47:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:47:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:47:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:47:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:47:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:47:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:47:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:47:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:47:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:47:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43531501
Sun 19 Jan 2014 09:47:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:47:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43531501
Sun 19 Jan 2014 09:47:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:47:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:47:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:47:38 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:47:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:47:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:47:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:47:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:47:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:47:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:47:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:47:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:47:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:47:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:47:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:47:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:47:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:47:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:47:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:47:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:47:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:47:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:47:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:47:44 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:47:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 09:47:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:47:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:47:47 - job_xml_thread(): Done retrieving: data size 42957082
Sun 19 Jan 2014 09:47:47 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:47:47 - XML: Start document: iteration 1
Sun 19 Jan 2014 09:47:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42957082
Sun 19 Jan 2014 09:47:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:47:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42957082
Sun 19 Jan 2014 09:47:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:47:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:47:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:47:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:47:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:48:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:48:04 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:48:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:48:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:48:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:48:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:48:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:48:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:48:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:48:08 - XML: Processed 645926 elements - found 0 jobs
Sun 19 Jan 2014 09:48:08 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:48:08 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:48:08 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:48:08 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:48:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:48:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:48:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:48:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:48:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:48:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:48:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:48:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:48:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:48:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42940744
Sun 19 Jan 2014 09:48:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:48:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42940744
Sun 19 Jan 2014 09:48:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:48:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:48:21 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:48:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:48:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:48:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:48:22 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:48:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 09:48:22 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:48:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 09:48:23 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:48:23 - job_xml_thread(): Done retrieving: data size 42940744
Sun 19 Jan 2014 09:48:23 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:48:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8705 values 137563 bits 17195 bytes 
Sun 19 Jan 2014 09:48:23 - XML: Start document: iteration 2
Sun 19 Jan 2014 09:48:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:48:25 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:48:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:48:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:48:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:48:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:48:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:48:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:48:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:48:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:48:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:48:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:48:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:48:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:48:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:48:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:48:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:48:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:48:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:48:35 - XML: Processed 645480 elements - found 0 jobs
Sun 19 Jan 2014 09:48:35 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:48:35 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:48:35 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:48:35 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:48:38 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:48:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 09:48:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:48:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:48:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43314675
Sun 19 Jan 2014 09:48:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:48:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43314675
Sun 19 Jan 2014 09:48:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:48:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:48:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:48:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:48:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:48:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:48:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:48:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:48:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:48:50 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:48:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:48:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:48:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:48:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:48:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:48:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:48:53 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:48:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:48:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:48:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:48:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:48:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:48:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:48:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:48:56 - job_xml_thread(): Done retrieving: data size 43534953
Sun 19 Jan 2014 09:48:56 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:48:56 - XML: Start document: iteration 3
Sun 19 Jan 2014 09:48:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43534953
Sun 19 Jan 2014 09:48:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43534953
Sun 19 Jan 2014 09:48:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:48:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:49:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:49:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:49:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:49:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:49:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:49:10 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:49:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:49:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:49:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:49:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:49:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:49:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:49:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:49:14 - XML: Processed 652736 elements - found 0 jobs
Sun 19 Jan 2014 09:49:14 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:49:14 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:49:14 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:49:14 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:49:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:49:18 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:49:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:49:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:49:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:49:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:49:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:49:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:49:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:49:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43549943
Sun 19 Jan 2014 09:49:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:49:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43549943
Sun 19 Jan 2014 09:49:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:49:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:49:23 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:49:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:49:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 09:49:24 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:49:24 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:49:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 09:49:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148683 bits 18585 bytes 
Sun 19 Jan 2014 09:49:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:49:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:49:29 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:49:29 - job_xml_thread(): Done retrieving: data size 43549943
Sun 19 Jan 2014 09:49:29 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:49:29 - XML: Start document: iteration 4
Sun 19 Jan 2014 09:49:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:49:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:49:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:49:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:49:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:49:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:49:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:49:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:49:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:49:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:49:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:49:41 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:49:41 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:49:41 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:49:41 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:49:41 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:49:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:49:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:49:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:49:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:49:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:49:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:49:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:49:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:49:46 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 09:49:46 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 09:49:46 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:49:47 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:49:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 09:49:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:49:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:49:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43536824
Sun 19 Jan 2014 09:49:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:49:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43536824
Sun 19 Jan 2014 09:49:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:49:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:49:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:49:56 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:49:56 - job_xml_thread(): Done retrieving: data size 43536824
Sun 19 Jan 2014 09:49:56 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:49:56 - XML: Start document: iteration 5
Sun 19 Jan 2014 09:50:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:50:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:50:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:50:06 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:50:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:50:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:50:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:50:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:50:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:50:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:50:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:50:08 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:50:08 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:50:08 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:50:08 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:50:08 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:50:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:50:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:50:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:50:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:50:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:50:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:50:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:50:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:50:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:50:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43586663
Sun 19 Jan 2014 09:50:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:50:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43586663
Sun 19 Jan 2014 09:50:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:50:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:50:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:50:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:50:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:50:23 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:50:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:50:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:50:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:50:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:50:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:50:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:50:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:50:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:50:24 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:50:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:50:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 09:50:25 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:50:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 09:50:25 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:50:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99075 bits 12384 bytes 
Sun 19 Jan 2014 09:50:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:50:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:50:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:50:26 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:50:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:50:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:50:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:50:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:50:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:50:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:50:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:50:28 - job_xml_thread(): Done retrieving: data size 43570861
Sun 19 Jan 2014 09:50:28 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:50:28 - XML: Start document: iteration 6
Sun 19 Jan 2014 09:50:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570861
Sun 19 Jan 2014 09:50:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:50:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570861
Sun 19 Jan 2014 09:50:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:50:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:50:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:50:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:50:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:50:45 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:50:45 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:50:45 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:50:45 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:50:45 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:50:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:50:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:50:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:50:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:50:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:50:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:50:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:50:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:50:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:50:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:50:51 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:50:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:50:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:50:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:50:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:50:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:50:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:50:52 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:50:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 09:50:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:50:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:50:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43592007
Sun 19 Jan 2014 09:50:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:50:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43592007
Sun 19 Jan 2014 09:50:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:51:00 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:51:00 - job_xml_thread(): Done retrieving: data size 43592007
Sun 19 Jan 2014 09:51:00 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:51:00 - XML: Start document: iteration 7
Sun 19 Jan 2014 09:51:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:51:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:51:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:51:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:51:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:51:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:51:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:51:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:51:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:51:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:51:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:51:12 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:51:12 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:51:12 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:51:12 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:51:12 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:51:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:51:14 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:51:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:51:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:51:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:51:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:51:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:51:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:51:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:51:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43547452
Sun 19 Jan 2014 09:51:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:51:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43547452
Sun 19 Jan 2014 09:51:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:51:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:51:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:51:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:51:26 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:51:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:51:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 09:51:27 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:51:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 09:51:27 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:51:27 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:51:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:51:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8711 values 137356 bits 17169 bytes 
Sun 19 Jan 2014 09:51:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:51:28 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:51:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:51:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:51:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:51:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:51:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:51:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:51:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:51:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:51:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:51:31 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:51:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:51:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:51:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:51:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:51:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:51:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:51:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:51:33 - job_xml_thread(): Done retrieving: data size 43561094
Sun 19 Jan 2014 09:51:33 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:51:33 - XML: Start document: iteration 8
Sun 19 Jan 2014 09:51:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561094
Sun 19 Jan 2014 09:51:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:51:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561094
Sun 19 Jan 2014 09:51:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:51:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:51:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:51:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:51:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:51:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:51:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:51:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:51:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:51:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:51:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:51:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:51:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:51:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:51:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:51:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:51:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:51:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:51:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:51:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:51:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:51:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:51:55 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:51:55 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:51:55 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:51:55 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:51:55 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:51:55 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:51:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 09:51:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:51:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:51:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575514
Sun 19 Jan 2014 09:51:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:51:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575514
Sun 19 Jan 2014 09:51:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:52:05 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 09:52:05 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:52:06 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:52:06 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 09:52:06 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:52:06 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 09:52:06 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 09:52:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:52:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:52:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:52:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:52:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:52:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:52:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:52:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:52:10 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:52:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:52:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:52:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:52:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:52:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:52:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:52:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:52:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:52:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:52:13 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 809888 values 12778910 bits 1597363 bytes 
Sun 19 Jan 2014 09:52:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:52:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:52:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:52:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:52:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:52:16 - job_xml_thread(): Done retrieving: data size 43561042
Sun 19 Jan 2014 09:52:16 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:52:16 - XML: Start document: iteration 9
Sun 19 Jan 2014 09:52:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561042
Sun 19 Jan 2014 09:52:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:52:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561042
Sun 19 Jan 2014 09:52:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:52:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:52:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:52:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:52:27 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:52:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:52:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:52:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:52:29 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:52:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:52:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:52:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:52:30 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:52:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 09:52:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 09:52:30 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:52:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8770 values 138298 bits 17287 bytes 
Sun 19 Jan 2014 09:52:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:52:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:52:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:52:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:52:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:52:38 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:52:38 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:52:38 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:52:38 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:52:38 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:52:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:52:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:52:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:52:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:52:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:52:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:52:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:52:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:52:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:52:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561375
Sun 19 Jan 2014 09:52:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:52:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561375
Sun 19 Jan 2014 09:52:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:52:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:52:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:52:53 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:52:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:52:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:52:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:52:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:52:54 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:52:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:52:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:52:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:52:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:52:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:52:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:52:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:52:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:52:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:52:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:52:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:52:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:52:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:52:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:52:57 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:52:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 09:52:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:53:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:53:00 - job_xml_thread(): Done retrieving: data size 43557804
Sun 19 Jan 2014 09:53:00 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:53:00 - XML: Start document: iteration 10
Sun 19 Jan 2014 09:53:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557804
Sun 19 Jan 2014 09:53:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:53:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557804
Sun 19 Jan 2014 09:53:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:53:06 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:53:06 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 09:53:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:53:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:53:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:53:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:53:19 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:53:20 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:53:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:53:20 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:53:20 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:53:20 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:53:20 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:53:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:53:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:53:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:53:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:53:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:53:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:53:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:53:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:53:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:53:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:53:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:53:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:53:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:53:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:53:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:53:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:53:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43506356
Sun 19 Jan 2014 09:53:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:53:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43506356
Sun 19 Jan 2014 09:53:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:53:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:53:30 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:53:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:53:30 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:53:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 09:53:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 09:53:30 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:53:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8716 values 137425 bits 17178 bytes 
Sun 19 Jan 2014 09:53:35 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:53:35 - job_xml_thread(): Done retrieving: data size 43506356
Sun 19 Jan 2014 09:53:35 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:53:36 - XML: Start document: iteration 11
Sun 19 Jan 2014 09:53:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:53:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:53:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:53:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:53:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:53:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:53:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:53:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:53:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:53:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:53:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:53:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:53:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:53:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:53:45 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:53:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:53:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:53:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:53:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:53:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:53:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:53:48 - XML: Processed 652588 elements - found 0 jobs
Sun 19 Jan 2014 09:53:48 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:53:48 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:53:48 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:53:48 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:53:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:53:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42960983
Sun 19 Jan 2014 09:53:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:53:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42960983
Sun 19 Jan 2014 09:53:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:53:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:53:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:54:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:54:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:54:03 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:54:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:54:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:54:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:54:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:54:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:54:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:54:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:54:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:54:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:54:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:54:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:54:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:54:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:54:08 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:54:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 09:54:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:54:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:54:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:54:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:54:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:54:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:54:11 - job_xml_thread(): Done retrieving: data size 42942166
Sun 19 Jan 2014 09:54:11 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:54:11 - XML: Start document: iteration 12
Sun 19 Jan 2014 09:54:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42942166
Sun 19 Jan 2014 09:54:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42942166
Sun 19 Jan 2014 09:54:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:54:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:54:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:54:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:54:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:54:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:54:26 - XML: Processed 645666 elements - found 0 jobs
Sun 19 Jan 2014 09:54:26 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:54:26 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:54:26 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:54:26 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:54:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:54:30 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:54:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:54:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 09:54:32 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:54:32 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:54:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5839 values 92054 bits 11506 bytes 
Sun 19 Jan 2014 09:54:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 09:54:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:54:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:54:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:54:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:54:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:54:34 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:54:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:54:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:54:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:54:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:54:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:54:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:54:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:54:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:54:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:54:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:54:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:54:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:54:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43047104
Sun 19 Jan 2014 09:54:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:54:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43047104
Sun 19 Jan 2014 09:54:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:54:41 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:54:41 - job_xml_thread(): Done retrieving: data size 43047104
Sun 19 Jan 2014 09:54:41 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:54:41 - XML: Start document: iteration 13
Sun 19 Jan 2014 09:54:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:54:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:54:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:54:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:54:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:54:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:54:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:54:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:54:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:54:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:54:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:54:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:54:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:54:56 - XML: Processed 646564 elements - found 0 jobs
Sun 19 Jan 2014 09:54:56 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:54:56 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:54:56 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:54:56 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:55:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:55:00 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:55:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:55:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:55:00 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:55:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 09:55:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:55:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:55:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:55:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:55:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:55:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:55:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43547498
Sun 19 Jan 2014 09:55:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:55:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43547498
Sun 19 Jan 2014 09:55:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:55:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:55:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:55:12 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:55:12 - job_xml_thread(): Done retrieving: data size 43547498
Sun 19 Jan 2014 09:55:12 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:55:12 - XML: Start document: iteration 14
Sun 19 Jan 2014 09:55:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:55:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:55:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:55:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:55:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:55:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:55:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:55:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:55:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:55:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:55:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:55:22 - XML: Processed 653326 elements - found 0 jobs
Sun 19 Jan 2014 09:55:22 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:55:22 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:55:22 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:55:22 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:55:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:55:24 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:55:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:55:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:55:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:55:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:55:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:55:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:55:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:55:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43536525
Sun 19 Jan 2014 09:55:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:55:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43536525
Sun 19 Jan 2014 09:55:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:55:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:55:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:55:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:55:32 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:55:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:55:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 09:55:32 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:55:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8821 values 139042 bits 17380 bytes 
Sun 19 Jan 2014 09:55:32 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:55:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 09:55:37 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:55:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:55:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:55:39 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:55:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:55:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:55:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:55:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:55:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:55:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:55:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:55:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:55:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:55:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:55:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:55:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:55:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:55:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:55:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:55:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:55:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:55:46 - job_xml_thread(): Done retrieving: data size 43546951
Sun 19 Jan 2014 09:55:46 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:55:46 - XML: Start document: iteration 15
Sun 19 Jan 2014 09:55:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43546951
Sun 19 Jan 2014 09:55:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:55:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43546951
Sun 19 Jan 2014 09:55:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:55:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:55:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:55:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:55:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:55:59 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:55:59 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:55:59 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:55:59 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:55:59 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:56:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:56:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:56:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:56:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:56:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:56:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:56:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:56:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:56:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:56:09 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:56:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 09:56:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:56:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:56:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:56:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:56:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:56:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:56:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:56:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:56:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:56:11 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 09:56:11 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 09:56:11 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:56:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:56:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563745
Sun 19 Jan 2014 09:56:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:56:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563745
Sun 19 Jan 2014 09:56:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:56:15 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:56:15 - job_xml_thread(): Done retrieving: data size 43563745
Sun 19 Jan 2014 09:56:15 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:56:15 - XML: Start document: iteration 16
Sun 19 Jan 2014 09:56:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:56:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:56:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:56:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:56:28 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:56:28 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:56:28 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:56:28 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:56:28 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:56:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:56:30 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:56:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:56:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:56:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:56:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:56:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:56:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:56:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:56:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:56:33 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:56:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:56:34 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:56:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:56:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:56:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:56:34 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:56:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 09:56:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 09:56:34 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:56:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5968 values 94101 bits 11762 bytes 
Sun 19 Jan 2014 09:56:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:56:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:56:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:56:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:56:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:56:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43596977
Sun 19 Jan 2014 09:56:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:56:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43596977
Sun 19 Jan 2014 09:56:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:56:43 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:56:43 - job_xml_thread(): Done retrieving: data size 43596977
Sun 19 Jan 2014 09:56:43 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:56:43 - XML: Start document: iteration 17
Sun 19 Jan 2014 09:56:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:56:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:56:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:56:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:56:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:56:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:56:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:56:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:56:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:56:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:56:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:56:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:56:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:56:53 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:56:53 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:56:53 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:56:53 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:56:53 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:56:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:56:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:56:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:56:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:56:56 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:56:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 09:56:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:56:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:56:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:56:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:56:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:56:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:56:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569005
Sun 19 Jan 2014 09:56:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:56:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569005
Sun 19 Jan 2014 09:56:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:57:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:57:06 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:57:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:57:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:57:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:57:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:57:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:57:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:57:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:57:08 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:57:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:57:11 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:57:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:57:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:57:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:57:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:57:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:57:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:57:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:57:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571767
Sun 19 Jan 2014 09:57:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:57:12 - job_xml_thread(): Done retrieving: data size 43571767
Sun 19 Jan 2014 09:57:12 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:57:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571767
Sun 19 Jan 2014 09:57:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:57:13 - XML: Start document: iteration 18
Sun 19 Jan 2014 09:57:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:57:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:57:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:57:25 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:57:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:57:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:57:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:57:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:57:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:57:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:57:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:57:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:57:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:57:31 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:57:31 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:57:31 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:57:31 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:57:31 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:57:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:57:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:57:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:57:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:57:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:57:34 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:57:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:57:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:57:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:57:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:57:34 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:57:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 09:57:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:57:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 09:57:34 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:57:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8499 values 133970 bits 16746 bytes 
Sun 19 Jan 2014 09:57:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:57:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574363
Sun 19 Jan 2014 09:57:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:57:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574363
Sun 19 Jan 2014 09:57:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:57:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:57:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:57:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:57:45 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:57:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:57:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:57:47 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:57:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:57:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:57:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:57:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:57:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:57:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:57:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:57:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:57:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:57:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:57:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:57:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:57:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:57:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:57:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:57:51 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:57:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 09:57:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:57:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:57:52 - job_xml_thread(): Done retrieving: data size 43594496
Sun 19 Jan 2014 09:57:52 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:57:52 - XML: Start document: iteration 19
Sun 19 Jan 2014 09:57:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43594496
Sun 19 Jan 2014 09:57:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43594496
Sun 19 Jan 2014 09:57:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:57:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:58:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:58:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:58:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:58:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:58:12 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:58:12 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:58:12 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:58:12 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:58:13 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:58:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:58:13 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:58:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:58:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:58:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:58:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:58:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:58:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:58:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:58:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:58:15 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:58:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:58:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:58:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:58:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:58:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:58:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:58:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:58:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43592832
Sun 19 Jan 2014 09:58:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:58:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43592832
Sun 19 Jan 2014 09:58:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:58:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:58:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:58:28 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:58:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:58:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:58:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:58:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:58:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:58:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:58:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:58:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:58:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:58:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:58:31 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:58:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:58:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:58:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:58:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:58:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:58:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:58:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:58:33 - job_xml_thread(): Done retrieving: data size 43585417
Sun 19 Jan 2014 09:58:33 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:58:33 - XML: Start document: iteration 20
Sun 19 Jan 2014 09:58:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43585417
Sun 19 Jan 2014 09:58:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:58:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43585417
Sun 19 Jan 2014 09:58:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:58:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:58:34 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:58:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:58:36 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:58:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 09:58:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 09:58:37 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:58:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 10580 values 166844 bits 20855 bytes 
Sun 19 Jan 2014 09:58:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:58:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:58:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:58:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:58:47 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:58:47 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:58:47 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:58:47 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:58:47 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:58:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:58:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:58:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:58:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:58:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:58:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:58:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:58:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:58:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:58:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:58:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:58:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:58:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:58:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:58:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:58:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:58:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:58:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:58:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567757
Sun 19 Jan 2014 09:58:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:58:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567757
Sun 19 Jan 2014 09:58:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:59:03 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:59:03 - job_xml_thread(): Done retrieving: data size 43567757
Sun 19 Jan 2014 09:59:03 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:59:03 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 09:59:03 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 09:59:03 - Housekeeping: done.
Sun 19 Jan 2014 09:59:03 - XML: Start document: iteration 0
Sun 19 Jan 2014 09:59:06 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 09:59:06 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:59:08 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:59:08 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 09:59:08 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 09:59:08 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:59:08 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 09:59:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:59:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:59:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:59:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:59:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:59:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:59:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:59:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:59:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:59:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:59:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:59:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:59:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:59:18 - size of cluster 'LISA Cluster': 624 hosts 79480 metrics 861812 values 13582911 bits 1697863 bytes 
Sun 19 Jan 2014 09:59:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:59:21 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:59:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:59:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:59:21 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 09:59:21 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 09:59:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:59:21 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 09:59:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:59:21 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 09:59:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:59:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:59:21 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 09:59:22 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:59:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 09:59:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:59:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:59:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43489807
Sun 19 Jan 2014 09:59:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:59:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43489807
Sun 19 Jan 2014 09:59:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:59:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:59:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:59:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:59:36 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:59:36 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:59:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 09:59:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:59:37 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 09:59:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 09:59:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:59:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:59:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 09:59:37 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 09:59:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5527 values 87121 bits 10890 bytes 
Sun 19 Jan 2014 09:59:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 09:59:37 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 09:59:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 09:59:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 09:59:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:59:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 09:59:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 09:59:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 09:59:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 09:59:39 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 09:59:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 09:59:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 09:59:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:59:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 09:59:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 09:59:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 09:59:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 09:59:44 - job_xml_thread(): Done retrieving: data size 42966247
Sun 19 Jan 2014 09:59:44 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 09:59:44 - XML: Start document: iteration 1
Sun 19 Jan 2014 09:59:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42966247
Sun 19 Jan 2014 09:59:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42966247
Sun 19 Jan 2014 09:59:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 09:59:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 09:59:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 09:59:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 09:59:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 09:59:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:00:04 - XML: Processed 646116 elements - found 0 jobs
Sun 19 Jan 2014 10:00:04 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:00:05 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:00:05 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:00:05 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:00:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:00:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:00:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:00:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:00:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:00:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:00:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:00:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:00:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:00:08 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:00:08 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 10:00:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:00:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:00:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:00:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:00:09 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:00:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 10:00:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:00:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:00:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:00:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:00:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:00:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:00:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42948257
Sun 19 Jan 2014 10:00:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:00:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42948257
Sun 19 Jan 2014 10:00:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:00:20 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:00:20 - job_xml_thread(): Done retrieving: data size 42948257
Sun 19 Jan 2014 10:00:20 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:00:20 - XML: Start document: iteration 2
Sun 19 Jan 2014 10:00:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:00:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:00:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:00:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:00:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:00:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:00:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:00:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:00:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:00:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:00:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:00:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:00:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:00:32 - XML: Processed 645710 elements - found 0 jobs
Sun 19 Jan 2014 10:00:32 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:00:32 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:00:32 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:00:32 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:00:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:00:34 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:00:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:00:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:00:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:00:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:00:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:00:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:00:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:00:37 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:00:37 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:00:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 10:00:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:00:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 10:00:37 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:00:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5767 values 90928 bits 11366 bytes 
Sun 19 Jan 2014 10:00:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:00:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42979317
Sun 19 Jan 2014 10:00:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:00:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42979317
Sun 19 Jan 2014 10:00:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:00:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:00:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:00:47 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:00:48 - job_xml_thread(): Done retrieving: data size 42979317
Sun 19 Jan 2014 10:00:48 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:00:48 - XML: Start document: iteration 3
Sun 19 Jan 2014 10:00:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:00:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:00:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:00:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:00:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:00:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:00:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:00:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:00:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:00:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:00:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:00:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:01:00 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:01:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:01:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:01:01 - XML: Processed 646144 elements - found 0 jobs
Sun 19 Jan 2014 10:01:01 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:01:01 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:01:01 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:01:01 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:01:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:01:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:01:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:01:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:01:05 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:01:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 10:01:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:01:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:01:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564794
Sun 19 Jan 2014 10:01:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:01:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564794
Sun 19 Jan 2014 10:01:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:01:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:01:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:01:16 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:01:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:01:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:01:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:01:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:01:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:01:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:01:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:01:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:01:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:01:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:01:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:01:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:01:20 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:01:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:01:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:01:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:01:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:01:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:01:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:01:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:01:23 - job_xml_thread(): Done retrieving: data size 43582810
Sun 19 Jan 2014 10:01:23 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:01:23 - XML: Start document: iteration 4
Sun 19 Jan 2014 10:01:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582810
Sun 19 Jan 2014 10:01:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:01:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582810
Sun 19 Jan 2014 10:01:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:01:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:01:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:01:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:01:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:01:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:01:37 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:01:38 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:01:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:01:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 10:01:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:01:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:01:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 10:01:38 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:01:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:01:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:01:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6983 values 110254 bits 13781 bytes 
Sun 19 Jan 2014 10:01:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:01:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:01:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:01:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:01:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:01:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:01:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:01:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:01:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:01:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:01:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:01:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:01:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:01:45 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:01:45 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:01:45 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:01:45 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:01:45 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:01:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:01:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555208
Sun 19 Jan 2014 10:01:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:01:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555208
Sun 19 Jan 2014 10:01:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:01:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:01:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:01:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:01:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:01:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:01:58 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:01:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:01:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:01:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:01:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:01:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:01:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:01:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:02:00 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:02:03 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:02:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 10:02:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:02:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:02:05 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:02:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:02:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:02:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:02:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:02:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:02:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:02:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:02:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577749
Sun 19 Jan 2014 10:02:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:02:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577749
Sun 19 Jan 2014 10:02:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:02:09 - job_xml_thread(): Done retrieving: data size 43577749
Sun 19 Jan 2014 10:02:09 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:02:09 - XML: Start document: iteration 5
Sun 19 Jan 2014 10:02:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:02:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:02:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:02:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:02:25 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:02:25 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:02:25 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:02:25 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:02:25 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:02:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:02:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:02:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:02:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:02:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:02:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:02:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:02:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:02:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:02:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:02:31 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:02:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:02:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:02:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:02:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:02:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:02:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:02:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:02:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570001
Sun 19 Jan 2014 10:02:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:02:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570001
Sun 19 Jan 2014 10:02:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:02:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:02:39 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:02:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:02:39 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:02:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 10:02:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 10:02:39 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:02:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8975 values 142064 bits 17758 bytes 
Sun 19 Jan 2014 10:02:40 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:02:40 - job_xml_thread(): Done retrieving: data size 43570001
Sun 19 Jan 2014 10:02:40 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:02:40 - XML: Start document: iteration 6
Sun 19 Jan 2014 10:02:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:02:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:02:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:02:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:02:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:02:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:02:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:02:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:02:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:02:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:02:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:02:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:02:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:02:54 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:02:54 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:02:54 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:02:54 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:02:54 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:02:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:02:58 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:02:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:02:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:02:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:02:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:02:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:02:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:03:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:03:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558385
Sun 19 Jan 2014 10:03:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:03:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558385
Sun 19 Jan 2014 10:03:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:03:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:03:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:03:09 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:03:09 - job_xml_thread(): Done retrieving: data size 43558385
Sun 19 Jan 2014 10:03:09 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:03:09 - XML: Start document: iteration 7
Sun 19 Jan 2014 10:03:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:03:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:03:15 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 10:03:15 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 10:03:15 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:03:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:03:18 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:03:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:03:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:03:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:03:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:03:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:03:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:03:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:03:23 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:03:23 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:03:23 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:03:23 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:03:23 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:03:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:03:26 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:03:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:03:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:03:27 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:03:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 10:03:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:03:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:03:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:03:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:03:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:03:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:03:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43552901
Sun 19 Jan 2014 10:03:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:03:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43552901
Sun 19 Jan 2014 10:03:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:03:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:03:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:03:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:03:37 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:03:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:03:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:03:38 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:03:38 - job_xml_thread(): Done retrieving: data size 43552901
Sun 19 Jan 2014 10:03:38 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:03:38 - XML: Start document: iteration 8
Sun 19 Jan 2014 10:03:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:03:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:03:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:03:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43552901
Sun 19 Jan 2014 10:03:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:03:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:03:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:03:40 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:03:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:03:41 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:03:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 10:03:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 10:03:41 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:03:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5760 values 90985 bits 11373 bytes 
Sun 19 Jan 2014 10:03:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:03:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:03:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:03:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:03:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:03:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:03:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:03:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:03:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:03:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:03:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:03:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:03:55 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:03:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:03:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:03:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:03:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:03:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:03:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:03:58 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:03:58 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:03:58 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:03:58 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:03:58 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:04:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:04:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560391
Sun 19 Jan 2014 10:04:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:04:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560391
Sun 19 Jan 2014 10:04:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:04:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:04:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:04:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:04:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:04:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:04:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:04:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:04:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:04:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:04:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:04:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:04:11 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:04:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 10:04:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:04:13 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:04:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:04:14 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:04:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:04:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:04:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:04:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:04:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:04:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:04:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:04:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557731
Sun 19 Jan 2014 10:04:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:04:16 - job_xml_thread(): Done retrieving: data size 43557731
Sun 19 Jan 2014 10:04:16 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:04:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557731
Sun 19 Jan 2014 10:04:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:04:16 - XML: Start document: iteration 9
Sun 19 Jan 2014 10:04:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:04:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:04:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:04:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:04:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:04:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:04:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:04:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:04:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:04:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:04:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:04:33 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:04:33 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:04:33 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:04:33 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:04:34 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:04:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:04:37 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:04:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:04:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:04:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:04:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:04:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:04:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:04:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:04:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562379
Sun 19 Jan 2014 10:04:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:04:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562379
Sun 19 Jan 2014 10:04:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:04:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:04:41 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:04:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:04:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:04:43 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:04:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:04:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 10:04:43 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:04:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 10:04:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9290 values 146638 bits 18329 bytes 
Sun 19 Jan 2014 10:04:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:04:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:04:49 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:04:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:04:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:04:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:04:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:04:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:04:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:04:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:04:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:04:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:04:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:04:53 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:04:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:04:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:04:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:04:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:04:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:04:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:04:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:04:55 - job_xml_thread(): Done retrieving: data size 43598077
Sun 19 Jan 2014 10:04:55 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:04:55 - XML: Start document: iteration 10
Sun 19 Jan 2014 10:04:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43598077
Sun 19 Jan 2014 10:04:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:04:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43598077
Sun 19 Jan 2014 10:04:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:05:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:05:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:05:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:05:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:05:14 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:05:14 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:05:14 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:05:14 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:05:14 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:05:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:05:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:05:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:05:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:05:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:05:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:05:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:05:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:05:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:05:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:05:18 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:05:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:05:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:05:18 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:05:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 10:05:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:05:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:05:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:05:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:05:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:05:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:05:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43513143
Sun 19 Jan 2014 10:05:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:05:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43513143
Sun 19 Jan 2014 10:05:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:05:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:05:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:05:30 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:05:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:05:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:05:32 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:05:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:05:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:05:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:05:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:05:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:05:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:05:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:05:33 - job_xml_thread(): Done retrieving: data size 43036534
Sun 19 Jan 2014 10:05:33 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:05:33 - XML: Start document: iteration 11
Sun 19 Jan 2014 10:05:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:05:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:05:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43036534
Sun 19 Jan 2014 10:05:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:05:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:05:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:05:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:05:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:05:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43036534
Sun 19 Jan 2014 10:05:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:05:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:05:44 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:05:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:05:45 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:05:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 10:05:45 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:05:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 10:05:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8797 values 138741 bits 17342 bytes 
Sun 19 Jan 2014 10:05:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:05:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:05:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:05:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:05:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:05:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:05:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:05:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:05:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:05:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:05:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:05:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:05:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:05:52 - XML: Processed 646736 elements - found 0 jobs
Sun 19 Jan 2014 10:05:52 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:05:52 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:05:52 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:05:52 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:05:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:05:57 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:05:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:05:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:05:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:05:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:05:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:05:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:05:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:05:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42908900
Sun 19 Jan 2014 10:05:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:06:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42908900
Sun 19 Jan 2014 10:06:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:06:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:06:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:06:07 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:06:07 - job_xml_thread(): Done retrieving: data size 42908900
Sun 19 Jan 2014 10:06:07 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:06:07 - XML: Start document: iteration 12
Sun 19 Jan 2014 10:06:08 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 10:06:08 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:06:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:06:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:06:08 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:06:08 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:06:08 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 10:06:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:06:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:06:09 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 10:06:09 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 10:06:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:06:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:06:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:06:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:06:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:06:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:06:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:06:18 - XML: Processed 645312 elements - found 0 jobs
Sun 19 Jan 2014 10:06:18 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:06:18 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:06:18 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:06:18 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:06:19 - size of cluster 'LISA Cluster': 624 hosts 79476 metrics 822678 values 12984142 bits 1623017 bytes 
Sun 19 Jan 2014 10:06:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:06:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:06:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:06:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:06:23 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:06:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 10:06:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:06:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:06:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:06:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:06:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:06:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:06:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42949369
Sun 19 Jan 2014 10:06:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:06:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:06:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42949369
Sun 19 Jan 2014 10:06:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:06:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:06:33 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:06:33 - job_xml_thread(): Done retrieving: data size 42949369
Sun 19 Jan 2014 10:06:33 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:06:33 - XML: Start document: iteration 13
Sun 19 Jan 2014 10:06:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:06:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:06:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:06:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:06:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:06:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:06:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:06:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:06:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:06:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:06:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:06:43 - XML: Processed 645900 elements - found 0 jobs
Sun 19 Jan 2014 10:06:43 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:06:43 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:06:43 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:06:43 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:06:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:06:46 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:06:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:06:47 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:06:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 10:06:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 10:06:47 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:06:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5618 values 88578 bits 11072 bytes 
Sun 19 Jan 2014 10:06:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:06:47 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:06:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:06:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:06:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:06:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:06:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:06:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:06:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:06:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:06:51 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:06:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 10:06:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:06:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:06:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43501418
Sun 19 Jan 2014 10:06:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:06:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43501418
Sun 19 Jan 2014 10:06:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:06:58 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:06:59 - job_xml_thread(): Done retrieving: data size 43501418
Sun 19 Jan 2014 10:06:59 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:06:59 - XML: Start document: iteration 14
Sun 19 Jan 2014 10:07:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:07:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:07:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:07:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:07:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:07:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:07:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:07:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:07:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:07:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:07:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:07:09 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:07:09 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 10:07:13 - XML: Processed 652998 elements - found 0 jobs
Sun 19 Jan 2014 10:07:13 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:07:13 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:07:13 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:07:13 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:07:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:07:14 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:07:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:07:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:07:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:07:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:07:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:07:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:07:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:07:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43535337
Sun 19 Jan 2014 10:07:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:07:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43535337
Sun 19 Jan 2014 10:07:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:07:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:07:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:07:28 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:07:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:07:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:07:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:07:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:07:30 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:07:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:07:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:07:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:07:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:07:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:07:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:07:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:07:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:07:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:07:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:07:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:07:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:07:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:07:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:07:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:07:36 - job_xml_thread(): Done retrieving: data size 43559817
Sun 19 Jan 2014 10:07:36 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:07:36 - XML: Start document: iteration 15
Sun 19 Jan 2014 10:07:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559817
Sun 19 Jan 2014 10:07:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:07:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559817
Sun 19 Jan 2014 10:07:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:07:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:07:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:07:46 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:07:46 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:07:46 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:07:46 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:07:46 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:07:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:07:47 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:07:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:07:48 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:07:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 10:07:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 10:07:48 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:07:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148607 bits 18575 bytes 
Sun 19 Jan 2014 10:07:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:07:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:07:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:07:54 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:07:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:07:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:07:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:07:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:07:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:07:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:07:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:07:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:07:59 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:07:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:07:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:08:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:08:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:08:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:08:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:08:01 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:08:02 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:08:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 10:08:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:08:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:08:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553910
Sun 19 Jan 2014 10:08:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:08:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553910
Sun 19 Jan 2014 10:08:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:08:03 - job_xml_thread(): Done retrieving: data size 43553910
Sun 19 Jan 2014 10:08:03 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:08:04 - XML: Start document: iteration 16
Sun 19 Jan 2014 10:08:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:08:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:08:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:08:14 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:08:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:08:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:08:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:08:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:08:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:08:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:08:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:08:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:08:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:08:24 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:08:24 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:08:24 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:08:24 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:08:24 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:08:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:08:27 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:08:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:08:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:08:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:08:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:08:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:08:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:08:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:08:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553511
Sun 19 Jan 2014 10:08:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:08:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:08:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:08:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553511
Sun 19 Jan 2014 10:08:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:08:39 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:08:39 - job_xml_thread(): Done retrieving: data size 43553511
Sun 19 Jan 2014 10:08:39 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:08:39 - XML: Start document: iteration 17
Sun 19 Jan 2014 10:08:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:08:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:08:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:08:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:08:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:08:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:08:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:08:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:08:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:08:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:08:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:08:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:08:48 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:08:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:08:48 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:08:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 10:08:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 10:08:48 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:08:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:08:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99041 bits 12380 bytes 
Sun 19 Jan 2014 10:08:49 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:08:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:08:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:08:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:08:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:08:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:08:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:08:51 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:08:51 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:08:51 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:08:51 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:08:51 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:08:54 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:08:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 10:08:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:08:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:08:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559057
Sun 19 Jan 2014 10:08:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:08:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559057
Sun 19 Jan 2014 10:08:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:08:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:08:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:09:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:09:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:09:06 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:09:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:09:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:09:07 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:09:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:09:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:09:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:09:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:09:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:09:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:09:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:09:11 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:09:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:09:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:09:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:09:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:09:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:09:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:09:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:09:14 - job_xml_thread(): Done retrieving: data size 43580799
Sun 19 Jan 2014 10:09:14 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:09:14 - XML: Start document: iteration 18
Sun 19 Jan 2014 10:09:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580799
Sun 19 Jan 2014 10:09:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:09:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580799
Sun 19 Jan 2014 10:09:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:09:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:09:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:09:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:09:25 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:09:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:09:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:09:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:09:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:09:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:09:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:09:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:09:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:09:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:09:31 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:09:31 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:09:31 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:09:31 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:09:31 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:09:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:09:34 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:09:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:09:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:09:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:09:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:09:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:09:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:09:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:09:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43548416
Sun 19 Jan 2014 10:09:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:09:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43548416
Sun 19 Jan 2014 10:09:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:09:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:09:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:09:46 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:09:46 - job_xml_thread(): Done retrieving: data size 43548416
Sun 19 Jan 2014 10:09:46 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:09:46 - XML: Start document: iteration 19
Sun 19 Jan 2014 10:09:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:09:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:09:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:09:49 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:09:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:09:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:09:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:09:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:09:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 10:09:49 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:09:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:09:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:09:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:09:49 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:09:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 10:09:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148617 bits 18577 bytes 
Sun 19 Jan 2014 10:09:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:09:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:09:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:10:00 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:10:00 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:10:00 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:10:00 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:10:00 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:10:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:10:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:10:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:10:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:10:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:10:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:10:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:10:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:10:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:10:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:10:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:10:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43538577
Sun 19 Jan 2014 10:10:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:10:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43538577
Sun 19 Jan 2014 10:10:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:10:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:10:14 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:10:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:10:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:10:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:10:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:10:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:10:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:10:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43538577
Sun 19 Jan 2014 10:10:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:10:15 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:10:15 - job_xml_thread(): Done retrieving: data size 43538577
Sun 19 Jan 2014 10:10:15 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:10:15 - XML: Start document: iteration 20
Sun 19 Jan 2014 10:10:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:10:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:10:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:10:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:10:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:10:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:10:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:10:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:10:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:10:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:10:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:10:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:10:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:10:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:10:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:10:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:10:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:10:37 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:10:37 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:10:37 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:10:37 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:10:37 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:10:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:10:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:10:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:10:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:10:37 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:10:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 10:10:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:10:39 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 10:10:39 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 10:10:39 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:10:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:10:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43585578
Sun 19 Jan 2014 10:10:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:10:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43585578
Sun 19 Jan 2014 10:10:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:10:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:10:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:10:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:10:49 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:10:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:10:50 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:10:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:10:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:10:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 10:10:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 10:10:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:10:50 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:10:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:10:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5718 values 90172 bits 11271 bytes 
Sun 19 Jan 2014 10:10:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:10:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:10:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:10:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:10:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:10:52 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:10:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:10:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:10:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:10:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:10:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:10:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:10:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:10:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:10:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:10:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:10:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:10:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43586845
Sun 19 Jan 2014 10:10:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:10:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43586845
Sun 19 Jan 2014 10:10:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:10:57 - job_xml_thread(): Done retrieving: data size 43586845
Sun 19 Jan 2014 10:10:57 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:10:57 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 10:10:59 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 10:10:59 - Housekeeping: done.
Sun 19 Jan 2014 10:10:59 - XML: Start document: iteration 0
Sun 19 Jan 2014 10:11:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:11:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:11:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:11:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:11:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:11:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:11:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:11:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:11:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:11:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:11:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:11:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:11:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:11:14 - XML: Processed 653348 elements - found 0 jobs
Sun 19 Jan 2014 10:11:14 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:11:14 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:11:14 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:11:15 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:11:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:11:19 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:11:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:11:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:11:19 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:11:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 10:11:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:11:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:11:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:11:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:11:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:11:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:11:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43483439
Sun 19 Jan 2014 10:11:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:11:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43483439
Sun 19 Jan 2014 10:11:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:11:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:11:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:11:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:11:29 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:11:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:11:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:11:30 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:11:30 - job_xml_thread(): Done retrieving: data size 43483439
Sun 19 Jan 2014 10:11:30 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:11:30 - XML: Start document: iteration 1
Sun 19 Jan 2014 10:11:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:11:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:11:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:11:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:11:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:11:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:11:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:11:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:11:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:11:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:11:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:11:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:11:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:11:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:11:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:11:41 - XML: Processed 652600 elements - found 0 jobs
Sun 19 Jan 2014 10:11:41 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:11:41 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:11:41 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:11:41 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:11:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:11:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43007575
Sun 19 Jan 2014 10:11:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:11:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43007575
Sun 19 Jan 2014 10:11:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:11:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:11:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:11:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:11:50 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:11:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:11:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 10:11:50 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:11:50 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:11:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 10:11:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8974 values 141545 bits 17693 bytes 
Sun 19 Jan 2014 10:11:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:11:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:11:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:11:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:11:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:11:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:11:56 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:11:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:11:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:11:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:11:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:11:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:11:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:11:59 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:11:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:11:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:11:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:11:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:11:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:11:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:12:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:12:01 - job_xml_thread(): Done retrieving: data size 42910339
Sun 19 Jan 2014 10:12:01 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:12:01 - XML: Start document: iteration 2
Sun 19 Jan 2014 10:12:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42910339
Sun 19 Jan 2014 10:12:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:12:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42910339
Sun 19 Jan 2014 10:12:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:12:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:12:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:12:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:12:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:12:19 - XML: Processed 645150 elements - found 0 jobs
Sun 19 Jan 2014 10:12:19 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:12:19 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:12:19 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:12:19 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:12:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:12:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:12:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:12:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:12:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:12:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:12:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:12:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:12:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:12:24 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:12:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:12:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:12:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:12:25 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:12:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 10:12:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:12:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:12:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:12:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:12:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:12:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:12:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43001201
Sun 19 Jan 2014 10:12:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:12:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43001201
Sun 19 Jan 2014 10:12:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:12:34 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:12:34 - job_xml_thread(): Done retrieving: data size 43001201
Sun 19 Jan 2014 10:12:34 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:12:35 - XML: Start document: iteration 3
Sun 19 Jan 2014 10:12:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:12:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:12:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:12:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:12:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:12:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:12:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:12:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:12:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:12:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:12:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:12:44 - XML: Processed 645900 elements - found 0 jobs
Sun 19 Jan 2014 10:12:44 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:12:44 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:12:44 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:12:44 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:12:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:12:47 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:12:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:12:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:12:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:12:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:12:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:12:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:12:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:12:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43510154
Sun 19 Jan 2014 10:12:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:12:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43510154
Sun 19 Jan 2014 10:12:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:12:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:12:51 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:12:52 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:12:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:12:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 10:12:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 10:12:53 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:12:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9025 values 142368 bits 17796 bytes 
Sun 19 Jan 2014 10:12:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:12:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:12:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:12:57 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:12:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:12:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:12:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:12:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:12:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:12:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:12:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43510154
Sun 19 Jan 2014 10:12:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:12:59 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:12:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:13:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:13:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:13:10 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 10:13:10 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:13:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:13:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:13:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:13:10 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:13:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:13:10 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 10:13:10 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:13:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:13:10 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 10:13:10 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:13:10 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 10:13:11 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 842806 values 13283361 bits 1660420 bytes 
Sun 19 Jan 2014 10:13:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:13:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:13:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:13:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:13:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:13:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:13:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:13:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:13:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:13:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:13:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:13:15 - job_xml_thread(): Done retrieving: data size 43545963
Sun 19 Jan 2014 10:13:15 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:13:15 - XML: Start document: iteration 4
Sun 19 Jan 2014 10:13:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43545963
Sun 19 Jan 2014 10:13:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:13:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43545963
Sun 19 Jan 2014 10:13:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:13:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:13:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:13:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:13:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:13:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:13:31 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:13:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:13:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:13:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:13:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:13:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:13:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:13:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:13:34 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:13:34 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:13:34 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:13:34 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:13:34 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:13:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:13:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:13:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:13:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:13:38 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:13:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 10:13:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:13:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:13:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:13:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:13:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:13:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:13:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564039
Sun 19 Jan 2014 10:13:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:13:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564039
Sun 19 Jan 2014 10:13:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:13:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:13:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:13:49 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:13:49 - job_xml_thread(): Done retrieving: data size 43564039
Sun 19 Jan 2014 10:13:49 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:13:49 - XML: Start document: iteration 5
Sun 19 Jan 2014 10:13:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:13:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:13:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:13:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:13:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:13:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:13:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:13:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:13:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:13:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:13:53 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:13:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:13:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:13:54 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:13:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 10:13:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:13:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 10:13:54 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:13:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5811 values 91660 bits 11457 bytes 
Sun 19 Jan 2014 10:14:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:14:00 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:14:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:14:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:14:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:14:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:14:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:14:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:14:03 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:14:03 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:14:03 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:14:03 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:14:03 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:14:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:14:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43536286
Sun 19 Jan 2014 10:14:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:14:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:14:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:14:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43536286
Sun 19 Jan 2014 10:14:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:14:10 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:14:10 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 10:14:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:14:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:14:18 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:14:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:14:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:14:19 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:14:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:14:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:14:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:14:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:14:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:14:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:14:19 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:14:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 10:14:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:14:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:14:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:14:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:14:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:14:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:14:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:14:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:14:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:14:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:14:26 - job_xml_thread(): Done retrieving: data size 43573527
Sun 19 Jan 2014 10:14:26 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:14:26 - XML: Start document: iteration 6
Sun 19 Jan 2014 10:14:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573527
Sun 19 Jan 2014 10:14:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:14:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573527
Sun 19 Jan 2014 10:14:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:14:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:14:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:14:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:14:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:14:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:14:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:14:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:14:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:14:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:14:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:14:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:14:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:14:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:14:47 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:14:47 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:14:47 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:14:48 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:14:48 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:14:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:14:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:14:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:14:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:14:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:14:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:14:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:14:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:14:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:14:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561130
Sun 19 Jan 2014 10:14:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:14:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561130
Sun 19 Jan 2014 10:14:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:14:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:14:54 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:14:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:14:57 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:14:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 10:14:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 10:14:57 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:14:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9064 values 143018 bits 17877 bytes 
Sun 19 Jan 2014 10:14:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:14:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:15:03 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:15:03 - job_xml_thread(): Done retrieving: data size 43561130
Sun 19 Jan 2014 10:15:03 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:15:03 - XML: Start document: iteration 7
Sun 19 Jan 2014 10:15:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:15:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:15:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:15:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:15:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:15:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:15:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:15:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:15:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:15:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:15:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:15:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:15:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:15:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:15:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:15:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:15:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:15:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:15:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:15:13 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:15:13 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:15:13 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:15:13 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:15:13 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:15:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:15:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574129
Sun 19 Jan 2014 10:15:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:15:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574129
Sun 19 Jan 2014 10:15:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:15:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:15:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:15:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:15:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:15:28 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:15:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:15:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:15:28 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:15:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:15:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:15:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:15:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:15:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:15:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:15:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:15:32 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:15:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:15:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:15:32 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:15:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 10:15:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:15:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:15:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:15:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:15:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:15:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:15:35 - job_xml_thread(): Done retrieving: data size 43557098
Sun 19 Jan 2014 10:15:35 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:15:35 - XML: Start document: iteration 8
Sun 19 Jan 2014 10:15:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557098
Sun 19 Jan 2014 10:15:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:15:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557098
Sun 19 Jan 2014 10:15:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:15:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:15:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:15:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:15:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:15:49 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:15:49 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:15:50 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:15:50 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:15:50 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:15:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:15:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:15:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:15:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:15:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:15:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:15:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:15:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:15:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:15:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:15:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:15:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:15:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:15:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:15:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:15:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:15:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:15:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:15:58 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:15:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:15:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 10:15:58 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:15:58 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:15:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 10:15:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5673 values 89473 bits 11184 bytes 
Sun 19 Jan 2014 10:15:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:15:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43586198
Sun 19 Jan 2014 10:15:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:16:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43586198
Sun 19 Jan 2014 10:16:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:16:05 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:16:05 - job_xml_thread(): Done retrieving: data size 43586198
Sun 19 Jan 2014 10:16:05 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:16:05 - XML: Start document: iteration 9
Sun 19 Jan 2014 10:16:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:16:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:16:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:16:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:16:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:16:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:16:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:16:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:16:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:16:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:16:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:16:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:16:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:16:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:16:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:16:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:16:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:16:23 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:16:23 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:16:23 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:16:23 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:16:23 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:16:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:16:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:16:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:16:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:16:26 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:16:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 10:16:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:16:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:16:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577840
Sun 19 Jan 2014 10:16:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:16:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577840
Sun 19 Jan 2014 10:16:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:16:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:16:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:16:38 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:16:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:16:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:16:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:16:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:16:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:16:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:16:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:16:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:16:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:16:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:16:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:16:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:16:42 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:16:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:16:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:16:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:16:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:16:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:16:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:16:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:16:45 - job_xml_thread(): Done retrieving: data size 43586081
Sun 19 Jan 2014 10:16:45 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:16:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43586081
Sun 19 Jan 2014 10:16:45 - XML: Start document: iteration 10
Sun 19 Jan 2014 10:16:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:16:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43586081
Sun 19 Jan 2014 10:16:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:16:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:16:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:16:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:16:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:16:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:16:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:16:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:16:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:16:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:16:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:16:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:16:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:16:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:16:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:16:58 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:16:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:16:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 10:16:59 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:16:59 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:16:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 10:16:59 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7054 values 111577 bits 13947 bytes 
Sun 19 Jan 2014 10:17:05 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:17:05 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:17:05 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:17:05 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:17:05 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:17:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:17:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:17:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:17:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:17:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:17:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:17:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:17:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:17:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:17:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559732
Sun 19 Jan 2014 10:17:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:17:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559732
Sun 19 Jan 2014 10:17:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:17:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:17:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:17:20 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:17:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 10:17:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:17:21 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:17:21 - job_xml_thread(): Done retrieving: data size 43559732
Sun 19 Jan 2014 10:17:21 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:17:21 - XML: Start document: iteration 11
Sun 19 Jan 2014 10:17:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:17:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:17:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:17:25 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:17:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:17:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:17:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:17:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:17:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:17:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:17:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:17:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:17:32 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:17:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:17:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:17:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:17:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:17:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:17:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:17:35 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:17:35 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:17:35 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:17:35 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:17:35 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:17:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:17:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43360506
Sun 19 Jan 2014 10:17:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:17:38 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 10:17:39 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 10:17:39 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:17:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43360506
Sun 19 Jan 2014 10:17:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:17:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:17:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:17:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:17:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:17:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:17:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:17:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:17:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:17:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:17:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:17:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:17:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:17:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:17:50 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:17:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:17:52 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:17:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:17:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:17:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:17:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:17:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:17:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:17:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:17:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42936577
Sun 19 Jan 2014 10:17:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:17:54 - job_xml_thread(): Done retrieving: data size 42936577
Sun 19 Jan 2014 10:17:55 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:17:55 - XML: Start document: iteration 12
Sun 19 Jan 2014 10:17:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42936577
Sun 19 Jan 2014 10:17:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:17:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:17:59 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:18:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:18:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 10:18:00 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:18:00 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:18:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 10:18:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8961 values 141799 bits 17724 bytes 
Sun 19 Jan 2014 10:18:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:18:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:18:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:18:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:18:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:18:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:18:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:18:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:18:12 - XML: Processed 645356 elements - found 0 jobs
Sun 19 Jan 2014 10:18:12 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:18:12 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:18:12 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:18:12 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:18:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:18:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:18:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:18:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:18:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:18:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:18:16 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:18:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:18:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:18:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:18:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:18:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:18:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:18:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:18:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42955564
Sun 19 Jan 2014 10:18:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:18:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42955564
Sun 19 Jan 2014 10:18:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:18:27 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:18:27 - job_xml_thread(): Done retrieving: data size 42955564
Sun 19 Jan 2014 10:18:27 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:18:27 - XML: Start document: iteration 13
Sun 19 Jan 2014 10:18:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:18:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:18:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:18:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:18:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:18:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:18:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:18:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:18:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:18:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:18:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:18:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:18:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:18:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:18:37 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:18:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:18:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:18:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:18:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:18:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:18:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:18:40 - XML: Processed 645858 elements - found 0 jobs
Sun 19 Jan 2014 10:18:40 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:18:40 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:18:40 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:18:40 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:18:40 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:18:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 10:18:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:18:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:18:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43443219
Sun 19 Jan 2014 10:18:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:18:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43443219
Sun 19 Jan 2014 10:18:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:18:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:18:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:18:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:18:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:18:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:18:54 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:18:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:18:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:18:55 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:18:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:18:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:18:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:18:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:18:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:18:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:18:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:18:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:18:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:18:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:18:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:18:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:18:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:18:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:18:58 - job_xml_thread(): Done retrieving: data size 43568010
Sun 19 Jan 2014 10:18:58 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:18:58 - XML: Start document: iteration 14
Sun 19 Jan 2014 10:18:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568010
Sun 19 Jan 2014 10:18:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:18:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568010
Sun 19 Jan 2014 10:18:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:19:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:19:01 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:19:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:19:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 10:19:02 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:19:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 10:19:02 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:19:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8843 values 139591 bits 17448 bytes 
Sun 19 Jan 2014 10:19:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:19:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:19:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:19:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:19:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:19:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:19:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:19:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:19:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:19:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:19:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:19:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:19:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:19:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:19:19 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:19:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:19:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:19:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:19:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:19:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:19:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:19:21 - XML: Processed 653072 elements - found 0 jobs
Sun 19 Jan 2014 10:19:21 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:19:21 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:19:21 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:19:21 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:19:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:19:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561038
Sun 19 Jan 2014 10:19:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:19:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561038
Sun 19 Jan 2014 10:19:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:19:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:19:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:19:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:19:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:19:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:19:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:19:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:19:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:19:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:19:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:19:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:19:36 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:19:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:19:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:19:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:19:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:19:38 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:19:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 10:19:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:19:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:19:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:19:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:19:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:19:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:19:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566536
Sun 19 Jan 2014 10:19:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:19:40 - job_xml_thread(): Done retrieving: data size 43566536
Sun 19 Jan 2014 10:19:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566536
Sun 19 Jan 2014 10:19:40 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:19:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:19:40 - XML: Start document: iteration 15
Sun 19 Jan 2014 10:19:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:19:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:19:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:19:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:19:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:19:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:19:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:19:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:19:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:19:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:19:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:19:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:19:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:19:58 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:19:58 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:19:58 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:19:58 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:19:58 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:20:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:20:01 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:20:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:20:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:20:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:20:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:20:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:20:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:20:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:20:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558640
Sun 19 Jan 2014 10:20:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:20:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558640
Sun 19 Jan 2014 10:20:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:20:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:20:03 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:20:05 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:20:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 10:20:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:20:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 10:20:05 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:20:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8693 values 137085 bits 17135 bytes 
Sun 19 Jan 2014 10:20:11 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 10:20:11 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:20:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:20:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:20:12 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:20:12 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:20:12 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 10:20:12 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 10:20:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:20:12 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 10:20:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:20:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:20:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:20:13 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:20:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:20:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:20:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:20:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:20:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:20:14 - size of cluster 'LISA Cluster': 624 hosts 79481 metrics 825973 values 13039016 bits 1629877 bytes 
Sun 19 Jan 2014 10:20:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:20:16 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:20:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:20:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:20:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:20:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:20:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:20:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:20:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:20:20 - job_xml_thread(): Done retrieving: data size 43556550
Sun 19 Jan 2014 10:20:20 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:20:20 - XML: Start document: iteration 16
Sun 19 Jan 2014 10:20:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556550
Sun 19 Jan 2014 10:20:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:20:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556550
Sun 19 Jan 2014 10:20:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:20:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:20:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:20:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:20:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:20:37 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:20:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 10:20:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:20:38 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:20:38 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:20:38 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:20:38 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:20:38 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:20:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:20:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:20:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:20:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:20:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:20:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:20:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:20:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:20:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:20:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:20:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:20:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:20:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:20:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:20:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:20:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:20:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:20:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:20:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584553
Sun 19 Jan 2014 10:20:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:20:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584553
Sun 19 Jan 2014 10:20:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:20:53 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:20:53 - job_xml_thread(): Done retrieving: data size 43584553
Sun 19 Jan 2014 10:20:53 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:20:53 - XML: Start document: iteration 17
Sun 19 Jan 2014 10:20:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:20:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:20:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:20:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:20:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:20:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:20:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:20:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:20:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:20:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:20:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:21:03 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:21:03 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:21:03 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:21:03 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:21:03 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:21:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:21:05 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:21:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:21:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 10:21:05 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:21:05 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:21:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:21:05 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:21:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 10:21:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5971 values 94243 bits 11780 bytes 
Sun 19 Jan 2014 10:21:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:21:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:21:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:21:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:21:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:21:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:21:09 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:21:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 10:21:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:21:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:21:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43549053
Sun 19 Jan 2014 10:21:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:21:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43549053
Sun 19 Jan 2014 10:21:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:21:12 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:21:12 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 10:21:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:21:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:21:18 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:21:18 - job_xml_thread(): Done retrieving: data size 43549053
Sun 19 Jan 2014 10:21:18 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:21:18 - XML: Start document: iteration 18
Sun 19 Jan 2014 10:21:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:21:20 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:21:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:21:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:21:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:21:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:21:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:21:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:21:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:21:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:21:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:21:32 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:21:32 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:21:32 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:21:32 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:21:32 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:21:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:21:34 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:21:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:21:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:21:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:21:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:21:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:21:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:21:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:21:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:21:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:21:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43538199
Sun 19 Jan 2014 10:21:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:21:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43538199
Sun 19 Jan 2014 10:21:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:21:47 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:21:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:21:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:21:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:21:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:21:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:21:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:21:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:21:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:21:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:21:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:21:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:21:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:21:51 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:21:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:21:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:21:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:21:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:21:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:21:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:21:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:21:54 - job_xml_thread(): Done retrieving: data size 43564473
Sun 19 Jan 2014 10:21:54 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:21:54 - XML: Start document: iteration 19
Sun 19 Jan 2014 10:21:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564473
Sun 19 Jan 2014 10:21:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:21:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564473
Sun 19 Jan 2014 10:21:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:22:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:22:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:22:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:22:05 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:22:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:22:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 10:22:06 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:22:06 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:22:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 10:22:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9279 values 146416 bits 18302 bytes 
Sun 19 Jan 2014 10:22:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:22:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:22:12 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:22:12 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:22:12 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:22:12 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:22:12 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:22:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:22:17 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:22:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:22:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:22:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:22:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:22:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:22:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:22:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:22:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:22:18 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:22:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:22:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:22:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:22:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:22:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:22:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:22:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:22:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573261
Sun 19 Jan 2014 10:22:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:22:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573261
Sun 19 Jan 2014 10:22:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:22:26 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:22:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 10:22:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:22:27 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:22:27 - job_xml_thread(): Done retrieving: data size 43573261
Sun 19 Jan 2014 10:22:27 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:22:27 - XML: Start document: iteration 20
Sun 19 Jan 2014 10:22:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:22:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:22:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:22:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:22:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:22:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:22:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:22:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:22:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:22:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:22:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:22:40 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:22:40 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:22:40 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:22:40 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:22:40 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:22:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:22:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:22:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:22:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:22:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:22:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:22:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:22:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:22:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:22:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566362
Sun 19 Jan 2014 10:22:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:22:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566362
Sun 19 Jan 2014 10:22:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:22:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:22:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:22:55 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:22:56 - job_xml_thread(): Done retrieving: data size 43566362
Sun 19 Jan 2014 10:22:56 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:22:56 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 10:22:57 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 10:22:57 - Housekeeping: done.
Sun 19 Jan 2014 10:22:57 - XML: Start document: iteration 0
Sun 19 Jan 2014 10:23:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:23:00 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:23:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:23:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:23:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:23:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:23:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:23:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:23:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:23:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:23:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:23:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:23:06 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:23:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:23:06 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:23:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 10:23:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 10:23:07 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:23:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6205 values 97921 bits 12240 bytes 
Sun 19 Jan 2014 10:23:09 - XML: Processed 653345 elements - found 0 jobs
Sun 19 Jan 2014 10:23:09 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:23:09 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:23:09 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:23:09 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:23:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:23:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:23:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:23:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:23:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:23:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:23:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:23:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:23:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:23:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556299
Sun 19 Jan 2014 10:23:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:23:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556299
Sun 19 Jan 2014 10:23:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:23:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:23:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:23:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:23:22 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:23:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:23:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:23:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:23:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:23:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:23:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:23:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:23:25 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:23:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:23:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:23:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:23:28 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:23:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:23:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:23:28 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:23:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 10:23:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:23:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:23:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:23:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:23:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:23:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:23:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43509722
Sun 19 Jan 2014 10:23:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:23:31 - job_xml_thread(): Done retrieving: data size 43509722
Sun 19 Jan 2014 10:23:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43509722
Sun 19 Jan 2014 10:23:31 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:23:31 - XML: Start document: iteration 1
Sun 19 Jan 2014 10:23:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:23:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:23:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:23:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:23:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:23:48 - XML: Processed 652588 elements - found 0 jobs
Sun 19 Jan 2014 10:23:48 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:23:48 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:23:48 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:23:48 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:23:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:23:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:23:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:23:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:23:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:23:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:23:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:23:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:23:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:23:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:23:52 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:23:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:23:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:23:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:23:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:23:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:23:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:23:54 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 10:23:54 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 10:23:54 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:23:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:23:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42925133
Sun 19 Jan 2014 10:23:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:23:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42925133
Sun 19 Jan 2014 10:23:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:24:03 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:24:03 - job_xml_thread(): Done retrieving: data size 42925133
Sun 19 Jan 2014 10:24:03 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:24:03 - XML: Start document: iteration 2
Sun 19 Jan 2014 10:24:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:24:06 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:24:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:24:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:24:07 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:24:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:24:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:24:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:24:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:24:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:24:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:24:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:24:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:24:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:24:09 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:24:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 10:24:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 10:24:09 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:24:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8775 values 138392 bits 17299 bytes 
Sun 19 Jan 2014 10:24:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:24:14 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:24:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:24:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:24:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:24:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:24:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:24:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:24:16 - XML: Processed 645206 elements - found 0 jobs
Sun 19 Jan 2014 10:24:16 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:24:16 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:24:16 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:24:16 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:24:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:24:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42933063
Sun 19 Jan 2014 10:24:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:24:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42933063
Sun 19 Jan 2014 10:24:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:24:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:24:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:24:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:24:28 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:24:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:24:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:24:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:24:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:24:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:24:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42933063
Sun 19 Jan 2014 10:24:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:24:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:24:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:24:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:24:31 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:24:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:24:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:24:39 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:24:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:24:40 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:24:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:24:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:24:40 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:24:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 10:24:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:24:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:24:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:24:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:24:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:24:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:24:42 - job_xml_thread(): Done retrieving: data size 43442541
Sun 19 Jan 2014 10:24:42 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:24:42 - XML: Start document: iteration 3
Sun 19 Jan 2014 10:24:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43442541
Sun 19 Jan 2014 10:24:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:24:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:24:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:24:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:24:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:24:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:24:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:24:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43442541
Sun 19 Jan 2014 10:24:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:24:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:24:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:24:59 - XML: Processed 651882 elements - found 0 jobs
Sun 19 Jan 2014 10:24:59 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:24:59 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:24:59 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:24:59 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:25:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:25:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:25:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:25:03 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:25:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:25:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:25:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:25:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:25:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:25:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:25:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:25:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:25:04 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:25:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:25:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:25:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:25:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:25:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:25:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:25:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:25:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576207
Sun 19 Jan 2014 10:25:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:25:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576207
Sun 19 Jan 2014 10:25:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:25:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:25:09 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:25:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:25:10 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:25:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 10:25:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 10:25:11 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:25:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9096 values 143500 bits 17937 bytes 
Sun 19 Jan 2014 10:25:14 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:25:14 - job_xml_thread(): Done retrieving: data size 43576207
Sun 19 Jan 2014 10:25:14 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:25:14 - XML: Start document: iteration 4
Sun 19 Jan 2014 10:25:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:25:18 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:25:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:25:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:25:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:25:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:25:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:25:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:25:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:25:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:25:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:25:24 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:25:24 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:25:24 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:25:24 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:25:24 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:25:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:25:25 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:25:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:25:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:25:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:25:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:25:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:25:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:25:27 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:25:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 10:25:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:25:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:25:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562667
Sun 19 Jan 2014 10:25:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:25:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562667
Sun 19 Jan 2014 10:25:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:25:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:25:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:25:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:25:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:25:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:25:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:25:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:25:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:25:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:25:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:25:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:25:40 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:25:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:25:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:25:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:25:41 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:25:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:25:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:25:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:25:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:25:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:25:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:25:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:25:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572111
Sun 19 Jan 2014 10:25:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:25:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572111
Sun 19 Jan 2014 10:25:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:25:43 - job_xml_thread(): Done retrieving: data size 43572111
Sun 19 Jan 2014 10:25:44 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:25:44 - XML: Start document: iteration 5
Sun 19 Jan 2014 10:25:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:25:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:25:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:25:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:26:01 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:26:01 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:26:01 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:26:01 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:26:01 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:26:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:26:01 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:26:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:26:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:26:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:26:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:26:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:26:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:26:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:26:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:26:05 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:26:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:26:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:26:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:26:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:26:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:26:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:26:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:26:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566523
Sun 19 Jan 2014 10:26:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:26:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566523
Sun 19 Jan 2014 10:26:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:26:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:26:10 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:26:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:26:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 10:26:10 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:26:10 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:26:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9268 values 146185 bits 18273 bytes 
Sun 19 Jan 2014 10:26:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 10:26:16 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:26:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:26:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:26:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:26:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:26:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:26:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:26:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:26:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:26:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:26:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:26:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:26:20 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:26:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:26:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:26:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:26:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:26:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:26:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:26:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:26:23 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:26:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 10:26:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:26:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:26:23 - job_xml_thread(): Done retrieving: data size 43560547
Sun 19 Jan 2014 10:26:23 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:26:23 - XML: Start document: iteration 6
Sun 19 Jan 2014 10:26:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560547
Sun 19 Jan 2014 10:26:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:26:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560547
Sun 19 Jan 2014 10:26:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:26:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:26:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:26:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:26:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:26:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:26:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:26:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:26:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:26:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:26:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:26:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:26:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:26:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:26:40 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:26:40 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:26:40 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:26:40 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:26:40 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:26:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:26:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:26:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:26:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:26:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:26:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:26:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:26:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:26:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:26:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575046
Sun 19 Jan 2014 10:26:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:26:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575046
Sun 19 Jan 2014 10:26:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:26:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:26:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:26:55 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:26:55 - job_xml_thread(): Done retrieving: data size 43575046
Sun 19 Jan 2014 10:26:55 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:26:55 - XML: Start document: iteration 7
Sun 19 Jan 2014 10:27:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:27:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:27:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:27:00 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:27:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:27:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:27:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:27:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:27:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:27:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:27:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:27:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:27:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:27:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:27:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:27:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:27:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:27:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:27:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:27:06 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:27:06 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:27:06 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:27:06 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:27:06 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:27:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:27:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575162
Sun 19 Jan 2014 10:27:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:27:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575162
Sun 19 Jan 2014 10:27:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:27:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:27:11 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:27:12 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 10:27:12 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:27:12 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:27:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 10:27:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:27:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 10:27:13 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:27:13 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:27:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148584 bits 18573 bytes 
Sun 19 Jan 2014 10:27:13 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 10:27:13 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 10:27:13 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:27:13 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 10:27:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:27:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:27:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:27:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:27:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:27:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:27:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:27:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:27:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:27:18 - size of cluster 'LISA Cluster': 624 hosts 79471 metrics 811573 values 12788445 bits 1598555 bytes 
Sun 19 Jan 2014 10:27:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:27:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:27:21 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:27:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:27:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:27:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:27:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:27:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:27:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:27:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:27:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:27:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:27:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568074
Sun 19 Jan 2014 10:27:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:27:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568074
Sun 19 Jan 2014 10:27:26 - job_xml_thread(): Done retrieving: data size 43568074
Sun 19 Jan 2014 10:27:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:27:26 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:27:26 - XML: Start document: iteration 8
Sun 19 Jan 2014 10:27:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:27:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:27:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:27:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:27:45 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:27:45 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:27:45 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:27:45 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:27:45 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:27:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:27:47 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:27:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:27:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:27:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:27:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:27:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:27:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:27:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:27:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:27:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:27:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:27:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:27:50 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:27:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 10:27:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:27:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:27:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:27:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:27:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:27:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:27:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568891
Sun 19 Jan 2014 10:27:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:27:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568891
Sun 19 Jan 2014 10:27:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:28:00 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:28:00 - job_xml_thread(): Done retrieving: data size 43568891
Sun 19 Jan 2014 10:28:00 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:28:00 - XML: Start document: iteration 9
Sun 19 Jan 2014 10:28:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:28:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:28:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:28:04 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:28:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:28:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:28:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:28:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:28:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:28:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:28:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:28:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:28:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:28:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:28:13 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:28:13 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:28:13 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 10:28:13 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:28:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:28:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 10:28:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 10:28:13 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:28:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5666 values 89308 bits 11163 bytes 
Sun 19 Jan 2014 10:28:15 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:28:15 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:28:15 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:28:15 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:28:15 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:28:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:28:16 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:28:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:28:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:28:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:28:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:28:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:28:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:28:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:28:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43549028
Sun 19 Jan 2014 10:28:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:28:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:28:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:28:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43549028
Sun 19 Jan 2014 10:28:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:28:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:28:30 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:28:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:28:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:28:31 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:28:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:28:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:28:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:28:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:28:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:28:32 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:28:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 10:28:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:28:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:28:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:28:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:28:35 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:28:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:28:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:28:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:28:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:28:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:28:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:28:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:28:38 - job_xml_thread(): Done retrieving: data size 43561609
Sun 19 Jan 2014 10:28:38 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:28:38 - XML: Start document: iteration 10
Sun 19 Jan 2014 10:28:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561609
Sun 19 Jan 2014 10:28:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:28:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561609
Sun 19 Jan 2014 10:28:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:28:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:28:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:28:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:28:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:28:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:28:54 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:28:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:28:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:28:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:28:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:28:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:28:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:28:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:28:56 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:28:56 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:28:56 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:28:56 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:28:56 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:28:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:28:59 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:28:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:28:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:29:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:29:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:29:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:29:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:29:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:29:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575453
Sun 19 Jan 2014 10:29:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:29:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575453
Sun 19 Jan 2014 10:29:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:29:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:29:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:29:11 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:29:11 - job_xml_thread(): Done retrieving: data size 43575453
Sun 19 Jan 2014 10:29:11 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:29:11 - XML: Start document: iteration 11
Sun 19 Jan 2014 10:29:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:29:13 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:29:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:29:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 10:29:16 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:29:16 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:29:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:29:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:29:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 10:29:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9119 values 143798 bits 17974 bytes 
Sun 19 Jan 2014 10:29:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:29:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:29:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:29:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:29:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:29:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:29:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:29:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:29:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:29:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:29:26 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:29:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:29:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:29:26 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:29:26 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:29:26 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:29:26 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:29:26 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:29:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:29:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:29:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:29:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:29:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:29:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43485900
Sun 19 Jan 2014 10:29:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:29:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43485900
Sun 19 Jan 2014 10:29:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:29:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:29:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:29:35 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:29:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 10:29:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:29:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:29:39 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:29:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:29:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:29:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:29:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:29:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43485900
Sun 19 Jan 2014 10:29:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:29:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:29:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:29:41 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:29:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:29:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:29:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:29:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:29:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:29:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:29:52 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:29:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:29:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:29:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:29:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:29:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:29:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:29:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:29:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:29:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:29:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:29:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:29:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:29:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:29:55 - job_xml_thread(): Done retrieving: data size 42932372
Sun 19 Jan 2014 10:29:55 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:29:55 - XML: Start document: iteration 12
Sun 19 Jan 2014 10:29:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42932372
Sun 19 Jan 2014 10:29:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:29:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42932372
Sun 19 Jan 2014 10:29:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:30:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:30:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:30:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:30:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:30:14 - XML: Processed 645864 elements - found 0 jobs
Sun 19 Jan 2014 10:30:14 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:30:14 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:30:14 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:30:14 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:30:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:30:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:30:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:30:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:30:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:30:16 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:30:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:30:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:30:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:30:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:30:16 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:30:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:30:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 10:30:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:30:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 10:30:16 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:30:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99047 bits 12380 bytes 
Sun 19 Jan 2014 10:30:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:30:17 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:30:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:30:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:30:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:30:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:30:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:30:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:30:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:30:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42988807
Sun 19 Jan 2014 10:30:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:30:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42988807
Sun 19 Jan 2014 10:30:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:30:30 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:30:30 - job_xml_thread(): Done retrieving: data size 42988807
Sun 19 Jan 2014 10:30:30 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:30:30 - XML: Start document: iteration 13
Sun 19 Jan 2014 10:30:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:30:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:30:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:30:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:30:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:30:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:30:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:30:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:30:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:30:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:30:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:30:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:30:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:30:40 - XML: Processed 645896 elements - found 0 jobs
Sun 19 Jan 2014 10:30:40 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:30:40 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:30:40 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:30:40 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:30:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:30:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:30:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:30:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:30:43 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:30:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 10:30:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:30:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:30:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:30:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:30:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:30:45 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 10:30:45 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 10:30:45 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:30:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:30:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43472769
Sun 19 Jan 2014 10:30:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:30:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43472769
Sun 19 Jan 2014 10:30:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:30:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:30:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:30:55 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:30:55 - job_xml_thread(): Done retrieving: data size 43472769
Sun 19 Jan 2014 10:30:56 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:30:56 - XML: Start document: iteration 14
Sun 19 Jan 2014 10:30:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:30:59 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:30:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:30:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:31:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:31:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:31:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:31:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:31:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:31:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:31:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:31:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:31:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:31:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:31:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:31:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:31:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:31:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:31:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:31:05 - XML: Processed 652353 elements - found 0 jobs
Sun 19 Jan 2014 10:31:05 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:31:05 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:31:05 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:31:05 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:31:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:31:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566512
Sun 19 Jan 2014 10:31:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:31:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566512
Sun 19 Jan 2014 10:31:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:31:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:31:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:31:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:31:16 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:31:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:31:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:31:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:31:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:31:17 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:31:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 10:31:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 10:31:17 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:31:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8835 values 139518 bits 17439 bytes 
Sun 19 Jan 2014 10:31:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:31:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:31:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:31:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:31:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:31:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:31:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:31:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:31:20 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:31:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:31:20 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:31:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:31:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:31:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:31:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:31:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:31:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:31:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:31:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567385
Sun 19 Jan 2014 10:31:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:31:23 - job_xml_thread(): Done retrieving: data size 43567385
Sun 19 Jan 2014 10:31:23 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:31:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567385
Sun 19 Jan 2014 10:31:23 - XML: Start document: iteration 15
Sun 19 Jan 2014 10:31:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:31:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:31:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:31:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:31:36 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:31:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:31:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:31:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:31:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:31:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:31:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:31:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:31:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:31:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:31:43 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:31:43 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:31:43 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:31:43 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:31:43 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:31:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:31:45 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:31:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:31:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:31:45 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:31:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 10:31:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:31:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:31:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:31:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:31:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:31:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:31:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558199
Sun 19 Jan 2014 10:31:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:31:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558199
Sun 19 Jan 2014 10:31:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:31:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:31:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:31:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:31:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:31:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:31:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:31:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:31:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:31:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:31:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558199
Sun 19 Jan 2014 10:31:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:31:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:31:58 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:31:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:32:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:32:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:32:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:32:07 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:32:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:32:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:32:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:32:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:32:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:32:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:32:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:32:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:32:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:32:10 - job_xml_thread(): Done retrieving: data size 43542339
Sun 19 Jan 2014 10:32:10 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:32:10 - XML: Start document: iteration 16
Sun 19 Jan 2014 10:32:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43542339
Sun 19 Jan 2014 10:32:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:32:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:32:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:32:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:32:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:32:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:32:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:32:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43542339
Sun 19 Jan 2014 10:32:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:32:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:32:17 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:32:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:32:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 10:32:18 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:32:18 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:32:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 10:32:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8643 values 136658 bits 17082 bytes 
Sun 19 Jan 2014 10:32:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:32:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:32:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:32:27 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:32:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:32:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:32:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:32:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:32:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:32:29 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:32:29 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:32:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:32:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:32:29 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:32:29 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:32:29 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:32:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:32:32 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:32:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:32:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:32:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:32:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:32:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:32:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:32:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:32:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43592411
Sun 19 Jan 2014 10:32:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:32:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43592411
Sun 19 Jan 2014 10:32:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:32:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:32:44 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:32:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:32:44 - job_xml_thread(): Done retrieving: data size 43592411
Sun 19 Jan 2014 10:32:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:32:44 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:32:45 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:32:45 - XML: Start document: iteration 17
Sun 19 Jan 2014 10:32:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:32:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:32:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:32:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:32:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:32:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:32:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:32:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:32:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:32:54 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:32:54 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:32:54 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:32:54 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:32:54 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:32:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:32:57 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:32:57 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:32:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 10:32:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:32:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:32:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:32:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:32:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:32:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:32:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:32:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:32:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43546781
Sun 19 Jan 2014 10:32:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:32:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43546781
Sun 19 Jan 2014 10:32:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:33:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:33:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:33:09 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:33:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:33:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:33:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:33:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:33:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:33:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:33:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:33:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:33:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:33:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:33:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:33:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:33:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:33:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:33:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:33:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:33:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:33:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:33:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:33:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:33:15 - job_xml_thread(): Done retrieving: data size 43574272
Sun 19 Jan 2014 10:33:15 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:33:15 - XML: Start document: iteration 18
Sun 19 Jan 2014 10:33:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574272
Sun 19 Jan 2014 10:33:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:33:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574272
Sun 19 Jan 2014 10:33:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:33:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:33:19 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:33:20 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:33:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 10:33:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:33:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 10:33:21 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:33:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9037 values 142839 bits 17854 bytes 
Sun 19 Jan 2014 10:33:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:33:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:33:27 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:33:27 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:33:27 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:33:27 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:33:27 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:33:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:33:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:33:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:33:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:33:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:33:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:33:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:33:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:33:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:33:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:33:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:33:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:33:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:33:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:33:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:33:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:33:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:33:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:33:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:33:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:33:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579631
Sun 19 Jan 2014 10:33:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:33:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579631
Sun 19 Jan 2014 10:33:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:33:42 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:33:42 - job_xml_thread(): Done retrieving: data size 43579631
Sun 19 Jan 2014 10:33:42 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:33:42 - XML: Start document: iteration 19
Sun 19 Jan 2014 10:33:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:33:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:33:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:33:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:33:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:33:53 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:33:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:33:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:33:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:33:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:33:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:33:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:33:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:34:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:34:01 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:34:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:34:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:34:02 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:34:02 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:34:02 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:34:02 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:34:02 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:34:02 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:34:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 10:34:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:34:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:34:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:34:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:34:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:34:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:34:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561330
Sun 19 Jan 2014 10:34:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:34:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561330
Sun 19 Jan 2014 10:34:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:34:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:34:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:34:14 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 10:34:14 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:34:15 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:34:15 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 10:34:15 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:34:15 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 10:34:15 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 10:34:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:34:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:34:17 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:34:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:34:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:34:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:34:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:34:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:34:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:34:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:34:20 - size of cluster 'LISA Cluster': 624 hosts 79482 metrics 901930 values 14238172 bits 1779771 bytes 
Sun 19 Jan 2014 10:34:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:34:20 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:34:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:34:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 10:34:20 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:34:20 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:34:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6004 values 94752 bits 11844 bytes 
Sun 19 Jan 2014 10:34:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 10:34:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:34:20 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:34:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:34:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:34:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:34:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:34:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:34:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:34:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:34:24 - job_xml_thread(): Done retrieving: data size 43570623
Sun 19 Jan 2014 10:34:24 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:34:24 - XML: Start document: iteration 20
Sun 19 Jan 2014 10:34:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570623
Sun 19 Jan 2014 10:34:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:34:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570623
Sun 19 Jan 2014 10:34:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:34:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:34:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:34:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:34:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:34:41 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:34:41 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:34:41 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:34:41 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:34:41 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:34:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:34:44 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:34:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:34:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:34:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:34:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:34:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:34:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:34:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:34:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:34:48 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:34:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:34:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:34:48 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:34:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 10:34:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:34:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:34:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:34:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:34:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:34:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:34:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582181
Sun 19 Jan 2014 10:34:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:34:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582181
Sun 19 Jan 2014 10:34:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:34:56 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:34:56 - job_xml_thread(): Done retrieving: data size 43582181
Sun 19 Jan 2014 10:34:56 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:34:56 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 10:34:57 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 10:34:57 - Housekeeping: done.
Sun 19 Jan 2014 10:34:58 - XML: Start document: iteration 0
Sun 19 Jan 2014 10:35:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:35:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:35:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:35:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:35:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:35:04 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:35:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:35:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:35:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:35:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:35:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:35:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:35:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:35:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:35:11 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:35:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:35:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:35:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:35:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:35:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:35:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:35:13 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:35:14 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:35:14 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:35:14 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:35:14 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:35:15 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:35:15 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 10:35:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:35:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43494761
Sun 19 Jan 2014 10:35:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:35:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43494761
Sun 19 Jan 2014 10:35:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:35:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:35:20 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:35:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:35:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:35:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:35:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 10:35:21 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:35:22 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:35:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 10:35:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8873 values 139957 bits 17494 bytes 
Sun 19 Jan 2014 10:35:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:35:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:35:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:35:28 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:35:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:35:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:35:29 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:35:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:35:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:35:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:35:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:35:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:35:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:35:32 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:35:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:35:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:35:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:35:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:35:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:35:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:35:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:35:35 - job_xml_thread(): Done retrieving: data size 43060385
Sun 19 Jan 2014 10:35:35 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:35:35 - XML: Start document: iteration 1
Sun 19 Jan 2014 10:35:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43060385
Sun 19 Jan 2014 10:35:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:35:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43060385
Sun 19 Jan 2014 10:35:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:35:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:35:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:35:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:35:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:35:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:35:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:35:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:35:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:35:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:35:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:35:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:35:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:35:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:35:54 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:35:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 10:35:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:35:55 - XML: Processed 646948 elements - found 0 jobs
Sun 19 Jan 2014 10:35:55 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:35:55 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:35:55 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:35:55 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:35:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:35:58 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:35:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:35:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:35:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:35:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:35:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:35:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:36:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:36:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42912486
Sun 19 Jan 2014 10:36:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:36:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42912486
Sun 19 Jan 2014 10:36:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:36:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:36:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:36:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:36:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:36:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:36:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:36:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:36:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42912486
Sun 19 Jan 2014 10:36:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:36:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:36:10 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:36:10 - job_xml_thread(): Done retrieving: data size 42912486
Sun 19 Jan 2014 10:36:10 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:36:10 - XML: Start document: iteration 2
Sun 19 Jan 2014 10:36:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:36:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:36:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:36:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:36:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:36:22 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:36:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:36:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 10:36:23 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:36:23 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:36:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 10:36:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5967 values 94141 bits 11767 bytes 
Sun 19 Jan 2014 10:36:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:36:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:36:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:36:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:36:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:36:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:36:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:36:28 - XML: Processed 645162 elements - found 0 jobs
Sun 19 Jan 2014 10:36:28 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:36:28 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:36:28 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:36:29 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:36:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:36:29 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:36:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:36:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:36:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:36:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:36:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:36:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:36:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:36:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43000906
Sun 19 Jan 2014 10:36:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:36:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43000906
Sun 19 Jan 2014 10:36:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:36:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:36:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:36:44 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:36:44 - job_xml_thread(): Done retrieving: data size 43000906
Sun 19 Jan 2014 10:36:44 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:36:44 - XML: Start document: iteration 3
Sun 19 Jan 2014 10:36:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:36:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:36:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:36:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:36:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:36:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:36:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:36:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:36:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:36:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:36:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:36:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:36:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:36:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:36:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:36:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:36:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:36:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:36:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:36:58 - XML: Processed 646146 elements - found 0 jobs
Sun 19 Jan 2014 10:36:58 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:36:58 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:36:58 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:36:58 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:36:58 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:36:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 10:36:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:37:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:37:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564710
Sun 19 Jan 2014 10:37:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:37:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564710
Sun 19 Jan 2014 10:37:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:37:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:37:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:37:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:37:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:37:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:37:13 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:37:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:37:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:37:14 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:37:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:37:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:37:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:37:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:37:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:37:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:37:17 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:37:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:37:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:37:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:37:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:37:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:37:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:37:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:37:19 - job_xml_thread(): Done retrieving: data size 43572667
Sun 19 Jan 2014 10:37:19 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:37:19 - XML: Start document: iteration 4
Sun 19 Jan 2014 10:37:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572667
Sun 19 Jan 2014 10:37:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572667
Sun 19 Jan 2014 10:37:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:37:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:37:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:37:23 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:37:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:37:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 10:37:25 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:37:25 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:37:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 10:37:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9173 values 144733 bits 18091 bytes 
Sun 19 Jan 2014 10:37:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:37:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:37:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:37:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:37:34 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:37:34 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:37:34 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:37:34 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:37:34 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:37:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:37:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:37:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:37:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:37:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:37:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:37:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:37:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:37:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:37:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:37:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:37:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:37:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:37:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:37:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:37:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:37:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:37:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:37:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571588
Sun 19 Jan 2014 10:37:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:37:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571588
Sun 19 Jan 2014 10:37:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:37:49 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:37:49 - job_xml_thread(): Done retrieving: data size 43571588
Sun 19 Jan 2014 10:37:49 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:37:49 - XML: Start document: iteration 5
Sun 19 Jan 2014 10:37:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:37:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:37:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:37:58 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:37:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:37:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:37:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:37:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:37:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:37:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:37:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:37:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:37:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:38:07 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:38:07 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:38:07 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:38:07 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:38:07 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:38:09 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:38:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 10:38:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:38:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:38:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:38:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:38:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:38:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:38:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:38:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:38:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:38:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:38:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43547694
Sun 19 Jan 2014 10:38:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:38:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43547694
Sun 19 Jan 2014 10:38:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:38:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:38:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:38:22 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:38:22 - job_xml_thread(): Done retrieving: data size 43547694
Sun 19 Jan 2014 10:38:22 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:38:22 - XML: Start document: iteration 6
Sun 19 Jan 2014 10:38:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:38:22 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:38:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:38:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:38:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:38:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:38:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:38:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:38:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:38:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:38:25 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:38:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:38:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:38:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:38:26 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:38:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 10:38:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 10:38:26 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:38:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5615 values 88554 bits 11069 bytes 
Sun 19 Jan 2014 10:38:35 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:38:35 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:38:35 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:38:35 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:38:35 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:38:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:38:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:38:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:38:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:38:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:38:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:38:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:38:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:38:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:38:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:38:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:38:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43541031
Sun 19 Jan 2014 10:38:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:38:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43541031
Sun 19 Jan 2014 10:38:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:38:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:38:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:38:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:38:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:38:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:38:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:38:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:38:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:38:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:38:50 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:38:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:38:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:38:54 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:38:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 10:38:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:38:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:38:55 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:38:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:38:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:38:56 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 10:38:56 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 10:38:56 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:38:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:38:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:38:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:38:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:38:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:38:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568057
Sun 19 Jan 2014 10:38:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:38:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568057
Sun 19 Jan 2014 10:38:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:38:57 - job_xml_thread(): Done retrieving: data size 43568057
Sun 19 Jan 2014 10:38:58 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:38:58 - XML: Start document: iteration 7
Sun 19 Jan 2014 10:39:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:39:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:39:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:39:10 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:39:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:39:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:39:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:39:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:39:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:39:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:39:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:39:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:39:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:39:14 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:39:14 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:39:14 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:39:14 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:39:14 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:39:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:39:18 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:39:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:39:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:39:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:39:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:39:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:39:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:39:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:39:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565496
Sun 19 Jan 2014 10:39:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:39:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565496
Sun 19 Jan 2014 10:39:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:39:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:39:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:39:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:39:26 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:39:27 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:39:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:39:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 10:39:27 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:39:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 10:39:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8949 values 141066 bits 17633 bytes 
Sun 19 Jan 2014 10:39:29 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:39:29 - job_xml_thread(): Done retrieving: data size 43565496
Sun 19 Jan 2014 10:39:29 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:39:29 - XML: Start document: iteration 8
Sun 19 Jan 2014 10:39:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:39:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:39:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:39:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:39:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:39:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:39:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:39:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:39:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:39:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:39:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:39:39 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:39:39 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:39:39 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:39:39 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:39:39 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:39:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:39:41 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:39:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:39:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:39:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:39:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:39:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:39:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:39:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:39:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43552009
Sun 19 Jan 2014 10:39:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:39:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43552009
Sun 19 Jan 2014 10:39:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:39:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:39:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:39:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:39:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:39:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:39:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:39:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:39:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:39:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:39:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43552009
Sun 19 Jan 2014 10:39:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:39:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:39:54 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:39:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:39:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:39:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:40:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:40:03 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:40:04 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:40:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 10:40:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:40:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:40:05 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:40:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:40:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:40:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:40:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:40:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:40:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:40:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:40:06 - job_xml_thread(): Done retrieving: data size 43555715
Sun 19 Jan 2014 10:40:06 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:40:06 - XML: Start document: iteration 9
Sun 19 Jan 2014 10:40:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555715
Sun 19 Jan 2014 10:40:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:40:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:40:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:40:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:40:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:40:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555715
Sun 19 Jan 2014 10:40:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:40:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:40:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:40:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:40:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:40:22 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:40:22 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:40:22 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:40:22 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:40:22 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:40:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:40:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:40:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:40:28 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:40:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:40:28 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:40:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 10:40:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 10:40:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:40:28 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:40:28 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:40:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:40:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:40:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5963 values 94009 bits 11751 bytes 
Sun 19 Jan 2014 10:40:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:40:29 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:40:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:40:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:40:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:40:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:40:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:40:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:40:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:40:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:40:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:40:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:40:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:40:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:40:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43588444
Sun 19 Jan 2014 10:40:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:40:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43588444
Sun 19 Jan 2014 10:40:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:40:37 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:40:37 - job_xml_thread(): Done retrieving: data size 43588444
Sun 19 Jan 2014 10:40:37 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:40:37 - XML: Start document: iteration 10
Sun 19 Jan 2014 10:40:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:40:44 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:40:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:40:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:40:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:40:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:40:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:40:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:40:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:40:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:40:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:40:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:40:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:40:48 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:40:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 10:40:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:40:49 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:40:49 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:40:49 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:40:49 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:40:49 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:40:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:40:53 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:40:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:40:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:40:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:40:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:40:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:40:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:40:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:40:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553600
Sun 19 Jan 2014 10:40:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:40:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553600
Sun 19 Jan 2014 10:40:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:41:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:41:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:41:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:41:04 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:41:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:41:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:41:04 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:41:04 - job_xml_thread(): Done retrieving: data size 43553600
Sun 19 Jan 2014 10:41:04 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:41:04 - XML: Start document: iteration 11
Sun 19 Jan 2014 10:41:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:41:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:41:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:41:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:41:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:41:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:41:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:41:12 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:41:12 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:41:12 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:41:12 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:41:12 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:41:15 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 10:41:15 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:41:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:41:15 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:41:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:41:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:41:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:41:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:41:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:41:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:41:16 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:41:16 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 10:41:16 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:41:16 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 10:41:16 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 10:41:17 - size of cluster 'LISA Cluster': 624 hosts 79476 metrics 765498 values 12063492 bits 1507936 bytes 
Sun 19 Jan 2014 10:41:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:41:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43497449
Sun 19 Jan 2014 10:41:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:41:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43497449
Sun 19 Jan 2014 10:41:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:41:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:41:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:41:27 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:41:27 - job_xml_thread(): Done retrieving: data size 43497449
Sun 19 Jan 2014 10:41:27 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:41:27 - XML: Start document: iteration 12
Sun 19 Jan 2014 10:41:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:41:29 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:41:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:41:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 10:41:29 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:41:29 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:41:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 10:41:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9240 values 145772 bits 18221 bytes 
Sun 19 Jan 2014 10:41:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:41:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:41:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:41:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:41:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:41:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:41:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:41:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:41:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:41:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:41:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:41:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:41:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:41:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:41:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:41:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:41:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:41:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:41:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:41:41 - XML: Processed 652600 elements - found 0 jobs
Sun 19 Jan 2014 10:41:41 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:41:41 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:41:41 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:41:41 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:41:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:41:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43000739
Sun 19 Jan 2014 10:41:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:41:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43000739
Sun 19 Jan 2014 10:41:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:41:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:41:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:41:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:41:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:41:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:41:54 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:41:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:41:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:41:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:41:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:41:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:41:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:41:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:41:56 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:41:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:41:59 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:41:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:41:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:41:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:41:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:41:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:41:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:41:59 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:41:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 10:41:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:42:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:42:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42913102
Sun 19 Jan 2014 10:42:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:42:02 - job_xml_thread(): Done retrieving: data size 42913102
Sun 19 Jan 2014 10:42:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42913102
Sun 19 Jan 2014 10:42:02 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:42:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:42:02 - XML: Start document: iteration 13
Sun 19 Jan 2014 10:42:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:42:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:42:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:42:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:42:16 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:42:16 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 10:42:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:42:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:42:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:42:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:42:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:42:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:42:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:42:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:42:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:42:21 - XML: Processed 645150 elements - found 0 jobs
Sun 19 Jan 2014 10:42:21 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:42:21 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:42:21 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:42:21 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:42:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:42:24 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:42:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:42:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:42:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:42:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:42:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:42:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:42:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:42:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42958056
Sun 19 Jan 2014 10:42:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:42:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42958056
Sun 19 Jan 2014 10:42:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:42:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:42:29 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:42:30 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:42:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 10:42:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:42:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 10:42:30 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:42:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8431 values 132940 bits 16617 bytes 
Sun 19 Jan 2014 10:42:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:42:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:42:36 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:42:36 - job_xml_thread(): Done retrieving: data size 42958056
Sun 19 Jan 2014 10:42:36 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:42:36 - XML: Start document: iteration 14
Sun 19 Jan 2014 10:42:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:42:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:42:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:42:44 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:42:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:42:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:42:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:42:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:42:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:42:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:42:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:42:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:42:48 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:42:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:42:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:42:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:42:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:42:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:42:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:42:49 - XML: Processed 645900 elements - found 0 jobs
Sun 19 Jan 2014 10:42:49 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:42:49 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:42:49 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:42:49 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:42:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:42:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43539820
Sun 19 Jan 2014 10:42:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:42:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43539820
Sun 19 Jan 2014 10:42:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:42:59 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:42:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 10:42:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:43:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:43:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:43:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:43:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:43:04 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:43:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:43:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:43:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:43:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:43:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:43:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:43:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:43:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:43:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:43:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:43:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:43:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:43:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:43:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:43:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:43:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:43:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:43:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:43:13 - job_xml_thread(): Done retrieving: data size 43571347
Sun 19 Jan 2014 10:43:13 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:43:13 - XML: Start document: iteration 15
Sun 19 Jan 2014 10:43:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571347
Sun 19 Jan 2014 10:43:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:43:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571347
Sun 19 Jan 2014 10:43:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:43:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:43:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:43:24 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:43:24 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:43:24 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:43:24 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:43:24 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:43:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:43:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:43:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:43:29 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:43:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:43:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:43:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:43:30 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:43:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:43:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:43:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:43:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:43:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:43:31 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:43:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 10:43:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:43:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 10:43:31 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:43:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6072 values 95759 bits 11969 bytes 
Sun 19 Jan 2014 10:43:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:43:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:43:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:43:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:43:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:43:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:43:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:43:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:43:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:43:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555915
Sun 19 Jan 2014 10:43:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:43:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555915
Sun 19 Jan 2014 10:43:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:43:39 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:43:39 - job_xml_thread(): Done retrieving: data size 43555915
Sun 19 Jan 2014 10:43:39 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:43:39 - XML: Start document: iteration 16
Sun 19 Jan 2014 10:43:45 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:43:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 10:43:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:43:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:43:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:43:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:43:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:43:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:43:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:43:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:43:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:43:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:43:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:43:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:43:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:43:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:43:58 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:43:58 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:43:58 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:43:58 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:43:58 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:44:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:44:00 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:44:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:44:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:44:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:44:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:44:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:44:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:44:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:44:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574517
Sun 19 Jan 2014 10:44:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:44:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574517
Sun 19 Jan 2014 10:44:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:44:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:44:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:44:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:44:13 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:44:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:44:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:44:13 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:44:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:44:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:44:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:44:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:44:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:44:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:44:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:44:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:44:17 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:44:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:44:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:44:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:44:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:44:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:44:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:44:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:44:19 - job_xml_thread(): Done retrieving: data size 43559016
Sun 19 Jan 2014 10:44:19 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:44:19 - XML: Start document: iteration 17
Sun 19 Jan 2014 10:44:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559016
Sun 19 Jan 2014 10:44:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:44:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559016
Sun 19 Jan 2014 10:44:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:44:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:44:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:44:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:44:32 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:44:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:44:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 10:44:33 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:44:33 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:44:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:44:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 10:44:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9314 values 146878 bits 18359 bytes 
Sun 19 Jan 2014 10:44:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:44:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:44:37 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:44:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:44:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:44:38 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:44:38 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:44:38 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:44:38 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:44:38 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:44:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:44:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:44:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:44:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:44:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:44:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:44:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:44:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:44:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:44:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:44:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:44:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:44:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:44:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:44:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576686
Sun 19 Jan 2014 10:44:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:44:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576686
Sun 19 Jan 2014 10:44:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:44:53 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:44:53 - job_xml_thread(): Done retrieving: data size 43576686
Sun 19 Jan 2014 10:44:53 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:44:53 - XML: Start document: iteration 18
Sun 19 Jan 2014 10:44:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:44:53 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:44:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:44:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 10:44:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:45:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:45:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:45:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:45:03 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:45:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:45:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:45:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:45:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:45:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:45:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:45:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:45:09 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:45:09 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:45:09 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:45:09 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:45:09 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:45:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:45:11 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:45:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:45:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:45:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:45:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:45:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:45:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:45:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:45:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571950
Sun 19 Jan 2014 10:45:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:45:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571950
Sun 19 Jan 2014 10:45:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:45:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:45:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:45:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:45:22 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:45:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:45:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:45:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:45:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:45:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:45:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571950
Sun 19 Jan 2014 10:45:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:45:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:45:25 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:45:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:45:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:45:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:45:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:45:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:45:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:45:33 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:45:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:45:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 10:45:33 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:45:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6236 values 98364 bits 12295 bytes 
Sun 19 Jan 2014 10:45:33 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:45:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 10:45:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:45:37 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:45:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:45:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:45:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:45:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:45:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:45:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:45:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:45:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:45:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:45:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:45:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:45:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:45:39 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 10:45:39 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 10:45:39 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:45:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:45:40 - job_xml_thread(): Done retrieving: data size 43541361
Sun 19 Jan 2014 10:45:40 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:45:40 - XML: Start document: iteration 19
Sun 19 Jan 2014 10:45:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43541361
Sun 19 Jan 2014 10:45:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:45:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43541361
Sun 19 Jan 2014 10:45:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:45:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:45:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:45:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:45:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:46:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:46:03 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:46:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:46:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:46:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:46:03 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:46:03 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:46:03 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:46:03 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:46:03 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:46:03 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:46:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:46:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:46:03 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:46:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 10:46:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:46:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:46:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:46:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:46:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:46:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:46:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:46:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:46:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:46:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:46:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:46:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578376
Sun 19 Jan 2014 10:46:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:46:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578376
Sun 19 Jan 2014 10:46:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:46:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:46:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:46:18 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:46:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:46:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:46:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:46:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:46:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:46:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:46:20 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:46:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:46:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:46:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:46:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:46:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:46:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:46:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:46:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:46:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:46:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:46:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:46:22 - job_xml_thread(): Done retrieving: data size 43575222
Sun 19 Jan 2014 10:46:22 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:46:22 - XML: Start document: iteration 20
Sun 19 Jan 2014 10:46:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575222
Sun 19 Jan 2014 10:46:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:46:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575222
Sun 19 Jan 2014 10:46:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:46:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:46:33 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:46:35 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:46:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:46:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 10:46:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 10:46:35 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:46:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:46:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8831 values 139369 bits 17421 bytes 
Sun 19 Jan 2014 10:46:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:46:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:46:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:46:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:46:36 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:46:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:46:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:46:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:46:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:46:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:46:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:46:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:46:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:46:41 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:46:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:46:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:46:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:46:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:46:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:46:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:46:43 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:46:43 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:46:43 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:46:43 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:46:43 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:46:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:46:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575468
Sun 19 Jan 2014 10:46:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:46:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575468
Sun 19 Jan 2014 10:46:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:46:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:46:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:46:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:46:54 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:46:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:46:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:46:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:46:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:46:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:46:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:46:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:46:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:46:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:46:58 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:47:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:47:00 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:47:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:47:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:47:01 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:47:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 10:47:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:47:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:47:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:47:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:47:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:47:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:47:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582842
Sun 19 Jan 2014 10:47:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:47:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582842
Sun 19 Jan 2014 10:47:02 - job_xml_thread(): Done retrieving: data size 43582842
Sun 19 Jan 2014 10:47:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:47:03 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:47:03 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 10:47:03 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 10:47:03 - Housekeeping: done.
Sun 19 Jan 2014 10:47:03 - XML: Start document: iteration 0
Sun 19 Jan 2014 10:47:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:47:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:47:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:47:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:47:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:47:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:47:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:47:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:47:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:47:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:47:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:47:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:47:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:47:19 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:47:19 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:47:19 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:47:19 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:47:19 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:47:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:47:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:47:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:47:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:47:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:47:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:47:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:47:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:47:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:47:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43494362
Sun 19 Jan 2014 10:47:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:47:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43494362
Sun 19 Jan 2014 10:47:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:47:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:47:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:47:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:47:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:47:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:47:35 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:47:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:47:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:47:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:47:35 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:47:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:47:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:47:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:47:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:47:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:47:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 10:47:37 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:47:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8374 values 132410 bits 16551 bytes 
Sun 19 Jan 2014 10:47:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:47:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:47:38 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:47:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 10:47:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:47:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:47:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:47:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:47:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:47:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:47:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:47:40 - job_xml_thread(): Done retrieving: data size 43003152
Sun 19 Jan 2014 10:47:40 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:47:40 - XML: Start document: iteration 1
Sun 19 Jan 2014 10:47:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43003152
Sun 19 Jan 2014 10:47:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:47:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43003152
Sun 19 Jan 2014 10:47:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:47:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:47:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:47:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:47:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:47:59 - XML: Processed 646276 elements - found 0 jobs
Sun 19 Jan 2014 10:47:59 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:47:59 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:47:59 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:47:59 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:48:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:48:01 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:48:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:48:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:48:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:48:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:48:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:48:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:48:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:48:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:48:03 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:48:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:48:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:48:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:48:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:48:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:48:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:48:03 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:48:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 10:48:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:48:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:48:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42912604
Sun 19 Jan 2014 10:48:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:48:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42912604
Sun 19 Jan 2014 10:48:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:48:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:48:14 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:48:14 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:48:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:48:16 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 10:48:16 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:48:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:48:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:48:17 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:48:17 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 10:48:17 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:48:17 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 10:48:17 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 10:48:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:48:18 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:48:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:48:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:48:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:48:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:48:19 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 857982 values 13547799 bits 1693474 bytes 
Sun 19 Jan 2014 10:48:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:48:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:48:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:48:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:48:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:48:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:48:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:48:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:48:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:48:22 - job_xml_thread(): Done retrieving: data size 42953207
Sun 19 Jan 2014 10:48:22 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:48:22 - XML: Start document: iteration 2
Sun 19 Jan 2014 10:48:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42953207
Sun 19 Jan 2014 10:48:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:48:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42953207
Sun 19 Jan 2014 10:48:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:48:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:48:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:48:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:48:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:48:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:48:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:48:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:48:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:48:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:48:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:48:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:48:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:48:38 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:48:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:48:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 10:48:39 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:48:39 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:48:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9007 values 142337 bits 17792 bytes 
Sun 19 Jan 2014 10:48:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 10:48:42 - XML: Processed 645900 elements - found 0 jobs
Sun 19 Jan 2014 10:48:42 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:48:42 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:48:42 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:48:42 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:48:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:48:45 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:48:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:48:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:48:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:48:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:48:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:48:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:48:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:48:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43458533
Sun 19 Jan 2014 10:48:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:48:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43458533
Sun 19 Jan 2014 10:48:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:48:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:48:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:48:57 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:48:57 - job_xml_thread(): Done retrieving: data size 43458533
Sun 19 Jan 2014 10:48:57 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:48:57 - XML: Start document: iteration 3
Sun 19 Jan 2014 10:49:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:49:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:49:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:49:01 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:49:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:49:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:49:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:49:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:49:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:49:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:49:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:49:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:49:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:49:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:49:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:49:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:49:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:49:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:49:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:49:10 - XML: Processed 652028 elements - found 0 jobs
Sun 19 Jan 2014 10:49:10 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:49:10 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:49:10 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:49:10 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:49:10 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:49:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 10:49:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:49:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:49:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562549
Sun 19 Jan 2014 10:49:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:49:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562549
Sun 19 Jan 2014 10:49:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:49:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:49:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:49:17 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:49:17 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 10:49:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:49:22 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:49:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:49:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:49:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:49:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:49:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:49:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:49:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:49:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:49:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:49:25 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:49:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:49:28 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:49:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:49:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:49:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:49:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:49:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:49:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:49:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:49:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570152
Sun 19 Jan 2014 10:49:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:49:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570152
Sun 19 Jan 2014 10:49:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:49:32 - job_xml_thread(): Done retrieving: data size 43570152
Sun 19 Jan 2014 10:49:32 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:49:32 - XML: Start document: iteration 4
Sun 19 Jan 2014 10:49:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:49:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:49:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:49:40 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:49:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:49:40 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:49:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 10:49:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 10:49:40 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:49:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8601 values 135641 bits 16955 bytes 
Sun 19 Jan 2014 10:49:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:49:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:49:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:49:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:49:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:49:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:49:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:49:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:49:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:49:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:49:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:49:54 - XML: Processed 653343 elements - found 0 jobs
Sun 19 Jan 2014 10:49:54 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:49:54 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:49:54 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:49:54 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:49:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:49:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:49:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:49:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:49:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:49:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:49:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:49:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:50:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:50:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565007
Sun 19 Jan 2014 10:50:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:50:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565007
Sun 19 Jan 2014 10:50:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:50:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:50:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:50:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:50:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:50:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:50:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:50:09 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:50:09 - job_xml_thread(): Done retrieving: data size 43565007
Sun 19 Jan 2014 10:50:09 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:50:09 - XML: Start document: iteration 5
Sun 19 Jan 2014 10:50:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:50:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:50:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:50:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:50:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565007
Sun 19 Jan 2014 10:50:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:50:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:50:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:50:15 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:50:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 10:50:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:50:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:50:20 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:50:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:50:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:50:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:50:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:50:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:50:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:50:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:50:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:50:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:50:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:50:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:50:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:50:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:50:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:50:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:50:26 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:50:26 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:50:26 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:50:26 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:50:26 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:50:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:50:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43591696
Sun 19 Jan 2014 10:50:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:50:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43591696
Sun 19 Jan 2014 10:50:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:50:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:50:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:50:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:50:40 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:50:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:50:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:50:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:50:40 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:50:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 10:50:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 10:50:40 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:50:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6251 values 98598 bits 12324 bytes 
Sun 19 Jan 2014 10:50:41 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:50:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:50:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:50:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:50:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:50:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:50:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:50:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:50:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:50:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:50:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:50:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:50:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:50:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:50:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:50:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:50:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:50:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:50:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:50:49 - job_xml_thread(): Done retrieving: data size 43559710
Sun 19 Jan 2014 10:50:49 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:50:49 - XML: Start document: iteration 6
Sun 19 Jan 2014 10:50:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559710
Sun 19 Jan 2014 10:50:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:50:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559710
Sun 19 Jan 2014 10:50:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:50:52 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:50:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 10:50:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:50:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:50:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:51:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:51:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:51:08 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:51:08 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:51:08 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:51:08 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:51:08 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:51:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:51:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:51:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:51:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:51:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:51:13 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:51:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:51:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:51:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:51:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:51:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:51:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:51:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:51:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:51:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:51:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:51:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:51:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:51:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581410
Sun 19 Jan 2014 10:51:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:51:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581410
Sun 19 Jan 2014 10:51:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:51:23 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:51:23 - job_xml_thread(): Done retrieving: data size 43581410
Sun 19 Jan 2014 10:51:23 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:51:24 - XML: Start document: iteration 7
Sun 19 Jan 2014 10:51:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:51:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:51:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:51:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:51:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:51:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:51:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:51:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:51:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:51:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:51:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:51:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:51:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:51:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:51:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:51:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:51:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:51:40 - XML: Processed 653347 elements - found 0 jobs
Sun 19 Jan 2014 10:51:40 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:51:40 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:51:40 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:51:40 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:51:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:51:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:51:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:51:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:51:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:51:40 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:51:41 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:51:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:51:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 10:51:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 10:51:41 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:51:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6278 values 99037 bits 12379 bytes 
Sun 19 Jan 2014 10:51:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:51:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571477
Sun 19 Jan 2014 10:51:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:51:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571477
Sun 19 Jan 2014 10:51:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:51:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:51:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:51:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:51:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:51:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:51:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:51:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:51:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:51:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571477
Sun 19 Jan 2014 10:51:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:51:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:51:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:51:55 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:51:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:51:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:51:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:52:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:52:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:52:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:52:05 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:52:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:52:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:52:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:52:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:52:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:52:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:52:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:52:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:52:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:52:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:52:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:52:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:52:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:52:09 - job_xml_thread(): Done retrieving: data size 43541627
Sun 19 Jan 2014 10:52:09 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:52:09 - XML: Start document: iteration 8
Sun 19 Jan 2014 10:52:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43541627
Sun 19 Jan 2014 10:52:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:52:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43541627
Sun 19 Jan 2014 10:52:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:52:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:52:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:52:21 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:52:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 10:52:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:52:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:52:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:52:23 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:52:23 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:52:23 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:52:23 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:52:23 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:52:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:52:27 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:52:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:52:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:52:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:52:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:52:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:52:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:52:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:52:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:52:31 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:52:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:52:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:52:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:52:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:52:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:52:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:52:32 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 10:52:32 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 10:52:32 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:52:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:52:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568025
Sun 19 Jan 2014 10:52:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:52:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568025
Sun 19 Jan 2014 10:52:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:52:38 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:52:39 - job_xml_thread(): Done retrieving: data size 43568025
Sun 19 Jan 2014 10:52:39 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:52:39 - XML: Start document: iteration 9
Sun 19 Jan 2014 10:52:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:52:41 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:52:42 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:52:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 10:52:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:52:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 10:52:42 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:52:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6740 values 106285 bits 13285 bytes 
Sun 19 Jan 2014 10:52:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:52:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:52:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:52:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:52:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:52:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:52:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:52:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:52:50 - XML: Processed 653347 elements - found 0 jobs
Sun 19 Jan 2014 10:52:51 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:52:51 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:52:51 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:52:51 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:52:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:52:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:52:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:52:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:52:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:52:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:52:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:52:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:52:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:52:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:52:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:52:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:52:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:52:55 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:52:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 10:52:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:52:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:52:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43589993
Sun 19 Jan 2014 10:52:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:52:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43589993
Sun 19 Jan 2014 10:52:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:53:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:53:04 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:53:06 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:53:06 - job_xml_thread(): Done retrieving: data size 43589993
Sun 19 Jan 2014 10:53:06 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:53:06 - XML: Start document: iteration 10
Sun 19 Jan 2014 10:53:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:53:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:53:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:53:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:53:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:53:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:53:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:53:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:53:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:53:15 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:53:15 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:53:15 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:53:15 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:53:15 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:53:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:53:16 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:53:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:53:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:53:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:53:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:53:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:53:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:53:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:53:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43498623
Sun 19 Jan 2014 10:53:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:53:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43498623
Sun 19 Jan 2014 10:53:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:53:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:53:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:53:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:53:28 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:53:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:53:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:53:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:53:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:53:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:53:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:53:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:53:30 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:53:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:53:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:53:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:53:32 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:53:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:53:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:53:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:53:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:53:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:53:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:53:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:53:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43076412
Sun 19 Jan 2014 10:53:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:53:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43076412
Sun 19 Jan 2014 10:53:34 - job_xml_thread(): Done retrieving: data size 43076412
Sun 19 Jan 2014 10:53:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:53:34 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:53:34 - XML: Start document: iteration 11
Sun 19 Jan 2014 10:53:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:53:44 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:53:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:53:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:53:45 - XML: Processed 647138 elements - found 0 jobs
Sun 19 Jan 2014 10:53:45 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:53:45 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:53:45 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:53:46 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:53:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:53:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 10:53:46 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:53:46 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:53:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 10:53:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148631 bits 18578 bytes 
Sun 19 Jan 2014 10:53:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:53:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:53:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:53:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:53:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:53:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:53:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:53:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:53:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:53:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:53:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:53:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:53:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:53:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:53:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:53:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:53:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:53:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:53:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:53:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:53:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42923528
Sun 19 Jan 2014 10:53:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:53:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42923528
Sun 19 Jan 2014 10:53:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:54:01 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:54:01 - job_xml_thread(): Done retrieving: data size 42923528
Sun 19 Jan 2014 10:54:01 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:54:01 - XML: Start document: iteration 12
Sun 19 Jan 2014 10:54:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:54:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:54:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:54:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:54:12 - XML: Processed 645204 elements - found 0 jobs
Sun 19 Jan 2014 10:54:12 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:54:12 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:54:12 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:54:12 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:54:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:54:13 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:54:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:54:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:54:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:54:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:54:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:54:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:54:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:54:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:54:19 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:54:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:54:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:54:19 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:54:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 10:54:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:54:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:54:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:54:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:54:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:54:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:54:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42954967
Sun 19 Jan 2014 10:54:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:54:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42954967
Sun 19 Jan 2014 10:54:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:54:27 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:54:27 - job_xml_thread(): Done retrieving: data size 42954967
Sun 19 Jan 2014 10:54:27 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:54:27 - XML: Start document: iteration 13
Sun 19 Jan 2014 10:54:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:54:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:54:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:54:31 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:54:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:54:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:54:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:54:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:54:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:54:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:54:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:54:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:54:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:54:36 - XML: Processed 645854 elements - found 0 jobs
Sun 19 Jan 2014 10:54:36 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:54:36 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:54:36 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:54:36 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:54:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:54:40 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:54:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:54:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:54:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:54:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:54:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:54:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:54:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:54:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43462895
Sun 19 Jan 2014 10:54:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:54:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43462895
Sun 19 Jan 2014 10:54:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:54:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:54:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:54:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:54:49 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:54:50 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:54:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:54:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 10:54:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 10:54:50 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:54:51 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:54:51 - job_xml_thread(): Done retrieving: data size 43462895
Sun 19 Jan 2014 10:54:51 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:54:51 - XML: Start document: iteration 14
Sun 19 Jan 2014 10:54:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:54:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:54:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:54:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:54:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:54:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8948 values 141126 bits 17640 bytes 
Sun 19 Jan 2014 10:54:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:54:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:54:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:54:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:54:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:54:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:54:57 - XML: Processed 652178 elements - found 0 jobs
Sun 19 Jan 2014 10:54:57 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:54:57 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:54:57 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:54:57 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:55:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:55:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:55:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:55:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:55:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:55:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:55:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:55:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:55:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:55:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556334
Sun 19 Jan 2014 10:55:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:55:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556334
Sun 19 Jan 2014 10:55:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:55:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:55:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:55:12 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:55:12 - job_xml_thread(): Done retrieving: data size 43556334
Sun 19 Jan 2014 10:55:12 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:55:12 - XML: Start document: iteration 15
Sun 19 Jan 2014 10:55:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:55:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:55:17 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 10:55:17 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:55:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:55:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:55:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:55:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:55:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:55:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:55:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:55:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:55:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:55:19 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:55:19 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 10:55:19 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 10:55:19 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:55:19 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 10:55:23 - XML: Processed 653243 elements - found 0 jobs
Sun 19 Jan 2014 10:55:23 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:55:23 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:55:23 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:55:23 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:55:24 - size of cluster 'LISA Cluster': 624 hosts 79480 metrics 809264 values 12758738 bits 1594842 bytes 
Sun 19 Jan 2014 10:55:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:55:26 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:55:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:55:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:55:26 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:55:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 10:55:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:55:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:55:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:55:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:55:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:55:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:55:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43550472
Sun 19 Jan 2014 10:55:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:55:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43550472
Sun 19 Jan 2014 10:55:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:55:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:55:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:55:38 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:55:39 - job_xml_thread(): Done retrieving: data size 43550472
Sun 19 Jan 2014 10:55:39 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:55:39 - XML: Start document: iteration 16
Sun 19 Jan 2014 10:55:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:55:39 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:55:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:55:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:55:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:55:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:55:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:55:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:55:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:55:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:55:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:55:47 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:55:47 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:55:47 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:55:47 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:55:47 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:55:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:55:49 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:55:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:55:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:55:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:55:50 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:55:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:55:50 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:55:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:55:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 10:55:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 10:55:50 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:55:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:55:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:55:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5689 values 89705 bits 11213 bytes 
Sun 19 Jan 2014 10:55:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:55:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:55:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43533430
Sun 19 Jan 2014 10:55:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:55:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43533430
Sun 19 Jan 2014 10:55:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:55:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:55:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:56:02 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:56:02 - job_xml_thread(): Done retrieving: data size 43533430
Sun 19 Jan 2014 10:56:02 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:56:02 - XML: Start document: iteration 17
Sun 19 Jan 2014 10:56:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:56:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:56:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:56:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:56:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:56:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:56:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:56:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:56:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:56:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:56:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:56:12 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:56:12 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:56:12 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:56:12 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:56:12 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:56:14 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:56:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 10:56:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:56:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:56:18 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:56:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:56:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:56:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:56:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:56:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:56:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:56:19 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:56:19 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 10:56:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:56:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555467
Sun 19 Jan 2014 10:56:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:56:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555467
Sun 19 Jan 2014 10:56:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:56:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:56:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:56:27 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:56:27 - job_xml_thread(): Done retrieving: data size 43555467
Sun 19 Jan 2014 10:56:27 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:56:27 - XML: Start document: iteration 18
Sun 19 Jan 2014 10:56:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:56:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:56:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:56:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:56:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:56:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:56:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:56:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:56:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:56:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:56:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:56:37 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:56:37 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:56:37 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:56:37 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:56:37 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:56:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:56:41 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:56:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:56:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:56:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:56:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:56:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:56:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:56:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:56:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565545
Sun 19 Jan 2014 10:56:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:56:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565545
Sun 19 Jan 2014 10:56:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:56:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:56:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:56:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:56:50 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:56:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:56:51 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:56:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 10:56:51 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:56:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8719 values 137469 bits 17183 bytes 
Sun 19 Jan 2014 10:56:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 10:56:52 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:56:52 - job_xml_thread(): Done retrieving: data size 43565545
Sun 19 Jan 2014 10:56:52 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:56:52 - XML: Start document: iteration 19
Sun 19 Jan 2014 10:56:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:56:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:56:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:56:57 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:56:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:56:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:56:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:56:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:56:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:56:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:56:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:57:03 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:57:03 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:57:03 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:57:03 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:57:03 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:57:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:57:07 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:57:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:57:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:57:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:57:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:57:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:57:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:57:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:57:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43548272
Sun 19 Jan 2014 10:57:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:57:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43548272
Sun 19 Jan 2014 10:57:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:57:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:57:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:57:18 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:57:18 - job_xml_thread(): Done retrieving: data size 43548272
Sun 19 Jan 2014 10:57:18 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:57:18 - XML: Start document: iteration 20
Sun 19 Jan 2014 10:57:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:57:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:57:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:57:27 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:57:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:57:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:57:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:57:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:57:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:57:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:57:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:57:28 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:57:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 10:57:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:57:33 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:57:33 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:57:33 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:57:33 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:57:33 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:57:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:57:35 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:57:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:57:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:57:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:57:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:57:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:57:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:57:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:57:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43548782
Sun 19 Jan 2014 10:57:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:57:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43548782
Sun 19 Jan 2014 10:57:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:57:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:57:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:57:48 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:57:48 - job_xml_thread(): Done retrieving: data size 43548782
Sun 19 Jan 2014 10:57:48 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:57:48 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 10:57:48 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 10:57:49 - Housekeeping: done.
Sun 19 Jan 2014 10:57:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:57:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:57:49 - XML: Start document: iteration 0
Sun 19 Jan 2014 10:57:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:57:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:57:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:57:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:57:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:57:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:57:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:57:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:57:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:57:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:57:52 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:57:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:57:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 10:57:53 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:57:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 10:57:53 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:57:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6080 values 95920 bits 11990 bytes 
Sun 19 Jan 2014 10:57:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:57:58 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:57:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:57:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:57:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:57:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:57:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:57:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:58:01 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:58:01 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:58:01 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:58:01 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:58:01 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:58:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:58:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:58:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:58:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562565
Sun 19 Jan 2014 10:58:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:58:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562565
Sun 19 Jan 2014 10:58:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:58:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:58:14 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:58:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:58:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:58:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:58:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:58:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:58:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:58:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562565
Sun 19 Jan 2014 10:58:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:58:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:58:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:58:16 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:58:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:58:22 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:58:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 10:58:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:58:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:58:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:58:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:58:28 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:58:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:58:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:58:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:58:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:58:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:58:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:58:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:58:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:58:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:58:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:58:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:58:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:58:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:58:31 - job_xml_thread(): Done retrieving: data size 43550963
Sun 19 Jan 2014 10:58:31 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:58:31 - XML: Start document: iteration 1
Sun 19 Jan 2014 10:58:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43550963
Sun 19 Jan 2014 10:58:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43550963
Sun 19 Jan 2014 10:58:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:58:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:58:41 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 10:58:41 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:58:41 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:58:41 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:58:41 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:58:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:58:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:58:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:58:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:58:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:58:45 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:58:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:58:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:58:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:58:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:58:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:58:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:58:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:58:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:58:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:58:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:58:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:58:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:58:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:58:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:58:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:58:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:58:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562278
Sun 19 Jan 2014 10:58:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:58:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:58:53 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:58:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562278
Sun 19 Jan 2014 10:58:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:58:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:58:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 10:58:54 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:58:54 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:58:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 10:58:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6160 values 97199 bits 12149 bytes 
Sun 19 Jan 2014 10:58:56 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:58:56 - job_xml_thread(): Done retrieving: data size 43562278
Sun 19 Jan 2014 10:58:56 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:58:56 - XML: Start document: iteration 2
Sun 19 Jan 2014 10:59:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:59:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:59:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:59:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:59:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:59:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:59:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:59:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:59:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:59:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:59:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:59:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:59:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:59:14 - XML: Processed 653344 elements - found 0 jobs
Sun 19 Jan 2014 10:59:14 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:59:14 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:59:14 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:59:14 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:59:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:59:16 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:59:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:59:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:59:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:59:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:59:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:59:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:59:20 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:59:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 10:59:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:59:20 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 10:59:20 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 10:59:20 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:59:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:59:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43494559
Sun 19 Jan 2014 10:59:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:59:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:59:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43494559
Sun 19 Jan 2014 10:59:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:59:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:59:29 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:59:29 - job_xml_thread(): Done retrieving: data size 43494559
Sun 19 Jan 2014 10:59:29 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 10:59:29 - XML: Start document: iteration 3
Sun 19 Jan 2014 10:59:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:59:31 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:59:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:59:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:59:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:59:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:59:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:59:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:59:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:59:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:59:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:59:43 - XML: Processed 652600 elements - found 0 jobs
Sun 19 Jan 2014 10:59:43 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 10:59:43 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 10:59:43 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 10:59:43 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 10:59:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:59:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:59:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 10:59:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:59:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:59:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:59:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:59:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 10:59:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 10:59:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42991468
Sun 19 Jan 2014 10:59:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 10:59:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42991468
Sun 19 Jan 2014 10:59:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 10:59:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:59:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 10:59:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 10:59:54 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:59:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 10:59:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 10:59:55 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:59:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 10:59:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:59:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 10:59:55 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 10:59:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 10:59:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6300 values 99350 bits 12418 bytes 
Sun 19 Jan 2014 10:59:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 10:59:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:59:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 10:59:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 10:59:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 10:59:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 10:59:58 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 10:59:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 10:59:59 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 10:59:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 10:59:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 10:59:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:59:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 10:59:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 10:59:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:00:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:00:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42921467
Sun 19 Jan 2014 11:00:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:00:01 - job_xml_thread(): Done retrieving: data size 42921467
Sun 19 Jan 2014 11:00:01 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:00:01 - XML: Start document: iteration 4
Sun 19 Jan 2014 11:00:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42921467
Sun 19 Jan 2014 11:00:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:00:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:00:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:00:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:00:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:00:16 - XML: Processed 645150 elements - found 0 jobs
Sun 19 Jan 2014 11:00:16 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:00:16 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:00:16 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:00:16 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:00:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:00:18 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:00:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:00:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:00:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:00:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:00:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:00:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:00:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:00:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:00:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:00:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:00:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:00:22 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:00:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 11:00:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:00:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:00:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:00:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:00:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:00:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:00:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42961837
Sun 19 Jan 2014 11:00:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:00:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42961837
Sun 19 Jan 2014 11:00:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:00:32 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:00:32 - job_xml_thread(): Done retrieving: data size 42961837
Sun 19 Jan 2014 11:00:32 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:00:32 - XML: Start document: iteration 5
Sun 19 Jan 2014 11:00:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:00:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:00:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:00:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:00:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:00:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:00:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:00:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:00:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:00:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:00:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:00:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:00:39 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:00:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:00:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:00:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:00:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:00:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:00:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:00:41 - XML: Processed 645900 elements - found 0 jobs
Sun 19 Jan 2014 11:00:41 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:00:41 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:00:41 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:00:41 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:00:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:00:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43454990
Sun 19 Jan 2014 11:00:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:00:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43454990
Sun 19 Jan 2014 11:00:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:00:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:00:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:00:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:00:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:00:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:00:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:00:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:00:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:00:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:00:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:00:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:00:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:00:55 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:00:55 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:00:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 11:00:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:00:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 11:00:55 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:00:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8575 values 135248 bits 16906 bytes 
Sun 19 Jan 2014 11:00:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:00:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:00:56 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:00:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:00:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:00:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:00:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:00:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:00:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:00:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:00:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:00:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:00:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565120
Sun 19 Jan 2014 11:00:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:00:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565120
Sun 19 Jan 2014 11:00:59 - job_xml_thread(): Done retrieving: data size 43565120
Sun 19 Jan 2014 11:00:59 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:00:59 - XML: Start document: iteration 6
Sun 19 Jan 2014 11:00:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:01:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:01:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:01:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:01:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:01:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:01:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:01:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:01:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:01:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:01:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:01:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:01:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:01:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:01:19 - XML: Processed 653170 elements - found 0 jobs
Sun 19 Jan 2014 11:01:19 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:01:19 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:01:19 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:01:19 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:01:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:01:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:01:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:01:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:01:22 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:01:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 11:01:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:01:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:01:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:01:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:01:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:01:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:01:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43551282
Sun 19 Jan 2014 11:01:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:01:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43551282
Sun 19 Jan 2014 11:01:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:01:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:01:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:01:35 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:01:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:01:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:01:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:01:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:01:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:01:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:01:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:01:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:01:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:01:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:01:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:01:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:01:39 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:01:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:01:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:01:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:01:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:01:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:01:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:01:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:01:41 - job_xml_thread(): Done retrieving: data size 43570510
Sun 19 Jan 2014 11:01:41 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:01:41 - XML: Start document: iteration 7
Sun 19 Jan 2014 11:01:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570510
Sun 19 Jan 2014 11:01:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570510
Sun 19 Jan 2014 11:01:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:01:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:01:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:01:54 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:01:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:01:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:01:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:01:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:01:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:01:55 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:01:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:01:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:01:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:01:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:01:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:01:56 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:01:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 11:01:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:01:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 11:01:56 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:01:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8820 values 139345 bits 17418 bytes 
Sun 19 Jan 2014 11:02:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:02:01 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:02:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:02:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:02:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:02:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:02:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:02:03 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 11:02:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:02:03 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:02:03 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:02:03 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:02:03 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:02:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:02:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554646
Sun 19 Jan 2014 11:02:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:02:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554646
Sun 19 Jan 2014 11:02:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:02:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:02:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:02:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:02:13 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:02:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:02:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:02:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:02:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:02:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:02:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:02:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554646
Sun 19 Jan 2014 11:02:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:02:18 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:02:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:02:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:02:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:02:19 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 11:02:19 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:02:20 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:02:20 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 11:02:20 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 11:02:20 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:02:20 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 11:02:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:02:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:02:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:02:28 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:02:28 - size of cluster 'LISA Cluster': 624 hosts 79479 metrics 848008 values 13378092 bits 1672261 bytes 
Sun 19 Jan 2014 11:02:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:02:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:02:28 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:02:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 11:02:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:02:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:02:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:02:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:02:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:02:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:02:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:02:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:02:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:02:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:02:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:02:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:02:31 - job_xml_thread(): Done retrieving: data size 43564049
Sun 19 Jan 2014 11:02:31 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:02:31 - XML: Start document: iteration 8
Sun 19 Jan 2014 11:02:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564049
Sun 19 Jan 2014 11:02:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:02:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564049
Sun 19 Jan 2014 11:02:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:02:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:02:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:02:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:02:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:02:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:02:45 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:02:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:02:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:02:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:02:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:02:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:02:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:02:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:02:48 - XML: Processed 653347 elements - found 0 jobs
Sun 19 Jan 2014 11:02:48 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:02:48 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:02:48 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:02:48 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:02:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:02:52 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:02:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:02:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:02:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:02:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:02:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:02:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:02:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:02:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560894
Sun 19 Jan 2014 11:02:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:02:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:02:56 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:02:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560894
Sun 19 Jan 2014 11:02:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:02:56 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:02:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:02:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 11:02:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 11:02:57 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:02:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9097 values 143961 bits 17995 bytes 
Sun 19 Jan 2014 11:03:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:03:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:03:03 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:03:03 - job_xml_thread(): Done retrieving: data size 43560894
Sun 19 Jan 2014 11:03:03 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:03:03 - XML: Start document: iteration 9
Sun 19 Jan 2014 11:03:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:03:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:03:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:03:15 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 11:03:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:03:15 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:03:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:03:15 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:03:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:03:15 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:03:15 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:03:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:03:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:03:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:03:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:03:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:03:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:03:17 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:03:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:03:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:03:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:03:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:03:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:03:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:03:20 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:03:20 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 11:03:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:03:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563343
Sun 19 Jan 2014 11:03:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:03:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563343
Sun 19 Jan 2014 11:03:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:03:31 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:03:31 - job_xml_thread(): Done retrieving: data size 43563343
Sun 19 Jan 2014 11:03:31 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:03:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:03:31 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:03:31 - XML: Start document: iteration 10
Sun 19 Jan 2014 11:03:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:03:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:03:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:03:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:03:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:03:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:03:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:03:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:03:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:03:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:03:35 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:03:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:03:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:03:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:03:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:03:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:03:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:03:41 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 11:03:41 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:03:41 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:03:41 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:03:41 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:03:41 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:03:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 11:03:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:03:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:03:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556569
Sun 19 Jan 2014 11:03:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:03:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556569
Sun 19 Jan 2014 11:03:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:03:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:03:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:03:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:03:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:03:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:03:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:03:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:03:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:03:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:03:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:03:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:03:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:03:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556569
Sun 19 Jan 2014 11:03:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:03:56 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:03:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:03:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:03:56 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:03:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:03:57 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:03:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 11:03:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 11:03:57 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:03:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5767 values 91077 bits 11384 bytes 
Sun 19 Jan 2014 11:04:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:04:00 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:04:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:04:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:04:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:04:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:04:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:04:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:04:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:04:04 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:04:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:04:06 - job_xml_thread(): Done retrieving: data size 43554792
Sun 19 Jan 2014 11:04:06 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:04:06 - XML: Start document: iteration 11
Sun 19 Jan 2014 11:04:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554792
Sun 19 Jan 2014 11:04:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:04:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:04:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:04:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:04:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:04:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:04:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:04:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554792
Sun 19 Jan 2014 11:04:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:04:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:04:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:04:24 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 11:04:24 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:04:24 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:04:24 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:04:24 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:04:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:04:25 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:04:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:04:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:04:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:04:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:04:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:04:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:04:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:04:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:04:29 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:04:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:04:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:04:30 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:04:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 11:04:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:04:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:04:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:04:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:04:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:04:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:04:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583288
Sun 19 Jan 2014 11:04:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:04:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583288
Sun 19 Jan 2014 11:04:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:04:39 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:04:39 - job_xml_thread(): Done retrieving: data size 43583288
Sun 19 Jan 2014 11:04:39 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:04:39 - XML: Start document: iteration 12
Sun 19 Jan 2014 11:04:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:04:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:04:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:04:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:04:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:04:46 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:04:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:04:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:04:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:04:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:04:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:04:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:04:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:04:52 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 11:04:52 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:04:52 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:04:52 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:04:52 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:04:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:04:57 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:04:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:04:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:04:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:04:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:04:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:04:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:04:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:04:57 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:04:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:04:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 11:04:57 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:04:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5621 values 88688 bits 11086 bytes 
Sun 19 Jan 2014 11:04:57 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:04:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 11:05:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:05:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554648
Sun 19 Jan 2014 11:05:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:05:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:05:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:05:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554648
Sun 19 Jan 2014 11:05:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:05:07 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:05:07 - job_xml_thread(): Done retrieving: data size 43554648
Sun 19 Jan 2014 11:05:08 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:05:08 - XML: Start document: iteration 13
Sun 19 Jan 2014 11:05:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:05:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:05:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:05:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:05:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:05:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:05:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:05:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:05:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:05:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:05:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:05:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:05:25 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:05:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:05:25 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 11:05:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:05:25 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:05:25 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:05:25 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:05:25 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:05:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:05:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:05:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:05:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:05:26 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:05:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 11:05:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:05:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:05:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:05:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:05:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43472072
Sun 19 Jan 2014 11:05:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:05:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43472072
Sun 19 Jan 2014 11:05:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:05:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:05:36 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:05:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:05:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:05:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:05:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:05:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:05:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:05:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43472072
Sun 19 Jan 2014 11:05:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:05:41 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:05:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:05:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:05:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:05:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:05:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:05:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:05:49 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:05:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:05:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:05:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:05:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:05:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:05:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:05:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:05:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:05:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:05:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:05:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:05:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:05:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:05:53 - job_xml_thread(): Done retrieving: data size 42941870
Sun 19 Jan 2014 11:05:53 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:05:53 - XML: Start document: iteration 14
Sun 19 Jan 2014 11:05:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42941870
Sun 19 Jan 2014 11:05:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:05:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42941870
Sun 19 Jan 2014 11:05:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:05:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:05:58 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:05:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:05:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 11:05:59 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:05:59 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:05:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 11:05:59 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6699 values 105719 bits 13214 bytes 
Sun 19 Jan 2014 11:06:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:06:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:06:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:06:07 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:06:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:06:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:06:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:06:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:06:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:06:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:06:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:06:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:06:14 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:06:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:06:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:06:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:06:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:06:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:06:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:06:16 - XML: Processed 645804 elements - found 0 jobs
Sun 19 Jan 2014 11:06:16 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:06:16 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:06:16 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:06:16 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:06:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:06:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42954623
Sun 19 Jan 2014 11:06:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:06:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42954623
Sun 19 Jan 2014 11:06:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:06:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:06:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:06:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:06:28 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:06:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:06:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:06:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:06:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:06:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42954623
Sun 19 Jan 2014 11:06:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:06:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:06:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:06:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:06:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:06:31 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:06:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:06:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:06:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:06:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:06:40 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:06:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:06:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:06:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:06:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:06:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:06:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:06:41 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:06:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 11:06:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:06:41 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 11:06:41 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 11:06:41 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:06:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:06:42 - job_xml_thread(): Done retrieving: data size 43462632
Sun 19 Jan 2014 11:06:42 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:06:42 - XML: Start document: iteration 15
Sun 19 Jan 2014 11:06:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43462632
Sun 19 Jan 2014 11:06:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:06:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:06:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:06:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:06:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:06:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:06:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43462632
Sun 19 Jan 2014 11:06:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:06:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:06:53 - XML: Processed 652348 elements - found 0 jobs
Sun 19 Jan 2014 11:06:53 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:06:54 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:06:54 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:06:54 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:06:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:06:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:06:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:06:59 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:06:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:06:59 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:07:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:07:00 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:07:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 11:07:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 11:07:00 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:07:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5785 values 91259 bits 11407 bytes 
Sun 19 Jan 2014 11:07:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:07:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:07:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:07:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:07:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:07:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:07:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:07:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:07:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:07:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:07:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:07:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:07:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:07:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:07:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:07:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:07:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572126
Sun 19 Jan 2014 11:07:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:07:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572126
Sun 19 Jan 2014 11:07:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:07:09 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:07:09 - job_xml_thread(): Done retrieving: data size 43572126
Sun 19 Jan 2014 11:07:09 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:07:09 - XML: Start document: iteration 16
Sun 19 Jan 2014 11:07:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:07:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:07:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:07:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:07:22 - XML: Processed 653286 elements - found 0 jobs
Sun 19 Jan 2014 11:07:22 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:07:22 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:07:22 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:07:22 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:07:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:07:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:07:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:07:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:07:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:07:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:07:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:07:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:07:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:07:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:07:28 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:07:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:07:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:07:28 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:07:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 11:07:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:07:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:07:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:07:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:07:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:07:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:07:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43590613
Sun 19 Jan 2014 11:07:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:07:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43590613
Sun 19 Jan 2014 11:07:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:07:37 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:07:37 - job_xml_thread(): Done retrieving: data size 43590613
Sun 19 Jan 2014 11:07:37 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:07:37 - XML: Start document: iteration 17
Sun 19 Jan 2014 11:07:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:07:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:07:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:07:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:07:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:07:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:07:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:07:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:07:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:07:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:07:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:07:46 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 11:07:46 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:07:46 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:07:46 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:07:46 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:07:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:07:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:07:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:07:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:07:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:07:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:07:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:07:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:07:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:07:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43552038
Sun 19 Jan 2014 11:07:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:07:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43552038
Sun 19 Jan 2014 11:07:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:07:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:07:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:08:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:08:00 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:08:01 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:08:01 - job_xml_thread(): Done retrieving: data size 43552038
Sun 19 Jan 2014 11:08:01 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:08:01 - XML: Start document: iteration 18
Sun 19 Jan 2014 11:08:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:08:01 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:08:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 11:08:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 11:08:01 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:08:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9164 values 144605 bits 18075 bytes 
Sun 19 Jan 2014 11:08:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:08:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:08:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:08:06 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:08:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:08:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:08:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:08:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:08:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:08:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:08:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:08:10 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 11:08:10 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:08:10 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:08:10 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:08:10 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:08:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:08:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:08:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:08:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:08:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:08:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:08:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:08:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:08:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:08:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569865
Sun 19 Jan 2014 11:08:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:08:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569865
Sun 19 Jan 2014 11:08:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:08:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:08:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:08:25 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:08:25 - job_xml_thread(): Done retrieving: data size 43569865
Sun 19 Jan 2014 11:08:25 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:08:25 - XML: Start document: iteration 19
Sun 19 Jan 2014 11:08:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:08:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:08:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:08:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:08:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:08:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:08:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:08:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:08:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:08:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:08:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:08:34 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 11:08:34 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:08:34 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:08:34 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:08:34 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:08:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:08:35 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:08:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:08:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:08:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:08:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:08:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:08:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:08:36 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:08:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 11:08:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:08:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:08:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556634
Sun 19 Jan 2014 11:08:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:08:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556634
Sun 19 Jan 2014 11:08:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:08:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:08:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:08:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:08:46 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:08:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:08:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:08:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:08:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:08:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:08:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:08:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:08:49 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:08:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:08:51 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:08:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:08:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:08:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:08:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:08:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:08:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:08:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:08:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567576
Sun 19 Jan 2014 11:08:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:08:53 - job_xml_thread(): Done retrieving: data size 43567576
Sun 19 Jan 2014 11:08:53 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:08:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567576
Sun 19 Jan 2014 11:08:53 - XML: Start document: iteration 20
Sun 19 Jan 2014 11:08:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:09:01 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 11:09:01 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:09:01 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:09:01 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:09:01 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:09:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:09:01 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:09:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:09:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 11:09:02 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:09:02 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:09:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 11:09:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8481 values 133747 bits 16718 bytes 
Sun 19 Jan 2014 11:09:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:09:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:09:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:09:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:09:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:09:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:09:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:09:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:09:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:09:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:09:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:09:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:09:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:09:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:09:11 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:09:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:09:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:09:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:09:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:09:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:09:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:09:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:09:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582787
Sun 19 Jan 2014 11:09:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:09:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582787
Sun 19 Jan 2014 11:09:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:09:16 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:09:16 - job_xml_thread(): Done retrieving: data size 43582787
Sun 19 Jan 2014 11:09:16 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:09:16 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 11:09:17 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 11:09:17 - Housekeeping: done.
Sun 19 Jan 2014 11:09:17 - XML: Start document: iteration 0
Sun 19 Jan 2014 11:09:21 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 11:09:22 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:09:23 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:09:23 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 11:09:23 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:09:23 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 11:09:23 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 11:09:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:09:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:09:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:09:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:09:33 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 11:09:33 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:09:33 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:09:33 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:09:33 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:09:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:09:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:09:34 - size of cluster 'LISA Cluster': 624 hosts 79476 metrics 808478 values 12746353 bits 1593294 bytes 
Sun 19 Jan 2014 11:09:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:09:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:09:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:09:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:09:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:09:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:09:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:09:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:09:37 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:09:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:09:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:09:38 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:09:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 11:09:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:09:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:09:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:09:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:09:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:09:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:09:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568890
Sun 19 Jan 2014 11:09:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:09:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568890
Sun 19 Jan 2014 11:09:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:09:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:09:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:09:48 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:09:49 - job_xml_thread(): Done retrieving: data size 43568890
Sun 19 Jan 2014 11:09:49 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:09:49 - XML: Start document: iteration 1
Sun 19 Jan 2014 11:09:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:09:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:09:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:09:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:09:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:09:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:09:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:09:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:09:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:10:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:10:01 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:10:02 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 11:10:02 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:10:02 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:10:02 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:10:02 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:10:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:10:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:10:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:10:02 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:10:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:10:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:10:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:10:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:10:03 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:10:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:10:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 11:10:03 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:10:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5675 values 89442 bits 11180 bytes 
Sun 19 Jan 2014 11:10:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 11:10:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:10:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564290
Sun 19 Jan 2014 11:10:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:10:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564290
Sun 19 Jan 2014 11:10:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:10:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:10:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:10:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:10:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:10:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:10:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:10:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:10:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:10:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:10:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564290
Sun 19 Jan 2014 11:10:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:10:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:10:17 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:10:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:10:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:10:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:10:23 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:10:23 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 11:10:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:10:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:10:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:10:27 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:10:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:10:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:10:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:10:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:10:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:10:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:10:29 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:10:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 11:10:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:10:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:10:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:10:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:10:30 - job_xml_thread(): Done retrieving: data size 43546799
Sun 19 Jan 2014 11:10:30 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:10:30 - XML: Start document: iteration 2
Sun 19 Jan 2014 11:10:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43546799
Sun 19 Jan 2014 11:10:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:10:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:10:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:10:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:10:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:10:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43546799
Sun 19 Jan 2014 11:10:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:10:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:10:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:10:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:10:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:10:49 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 11:10:49 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:10:49 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:10:49 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:10:49 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:10:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:10:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:10:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:10:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:10:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:10:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:10:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:10:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:10:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:10:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:10:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:10:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:10:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:10:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:10:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:10:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:10:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:10:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:10:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570201
Sun 19 Jan 2014 11:10:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:10:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570201
Sun 19 Jan 2014 11:10:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:11:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:11:03 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:11:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:11:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 11:11:04 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:11:04 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:11:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 11:11:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7718 values 121731 bits 15216 bytes 
Sun 19 Jan 2014 11:11:05 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:11:05 - job_xml_thread(): Done retrieving: data size 43570201
Sun 19 Jan 2014 11:11:05 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:11:05 - XML: Start document: iteration 3
Sun 19 Jan 2014 11:11:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:11:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:11:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:11:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:11:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:11:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:11:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:11:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:11:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:11:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:11:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:11:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:11:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:11:18 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 11:11:18 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:11:18 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:11:18 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:11:18 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:11:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:11:20 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:11:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:11:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:11:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:11:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:11:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:11:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:11:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:11:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43478464
Sun 19 Jan 2014 11:11:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:11:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43478464
Sun 19 Jan 2014 11:11:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:11:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:11:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:11:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:11:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:11:34 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:11:34 - job_xml_thread(): Done retrieving: data size 43478464
Sun 19 Jan 2014 11:11:34 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:11:34 - XML: Start document: iteration 4
Sun 19 Jan 2014 11:11:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:11:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:11:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:11:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:11:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:11:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:11:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:11:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:11:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:11:45 - XML: Processed 652599 elements - found 0 jobs
Sun 19 Jan 2014 11:11:45 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:11:45 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:11:45 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:11:45 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:11:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:11:47 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:11:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:11:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:11:47 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:11:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 11:11:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:11:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:11:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:11:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:11:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:11:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:11:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42961546
Sun 19 Jan 2014 11:11:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:11:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:11:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:11:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42961546
Sun 19 Jan 2014 11:11:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:11:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:11:58 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:11:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:11:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:11:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:11:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:11:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:11:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:11:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42961546
Sun 19 Jan 2014 11:11:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:12:00 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:12:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:12:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:12:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:12:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:12:04 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:12:04 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:12:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 11:12:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:12:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 11:12:04 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:12:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5877 values 92699 bits 11587 bytes 
Sun 19 Jan 2014 11:12:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:12:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:12:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:12:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:12:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:12:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:12:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:12:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:12:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:12:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:12:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:12:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:12:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:12:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:12:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:12:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:12:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:12:15 - job_xml_thread(): Done retrieving: data size 42942440
Sun 19 Jan 2014 11:12:15 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:12:15 - XML: Start document: iteration 5
Sun 19 Jan 2014 11:12:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42942440
Sun 19 Jan 2014 11:12:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:12:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42942440
Sun 19 Jan 2014 11:12:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:12:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:12:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:12:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:12:28 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:12:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:12:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:12:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:12:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:12:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:12:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:12:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:12:36 - XML: Processed 645826 elements - found 0 jobs
Sun 19 Jan 2014 11:12:36 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:12:36 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:12:36 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:12:36 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:12:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:12:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:12:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:12:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:12:39 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:12:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 11:12:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:12:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:12:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:12:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:12:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:12:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:12:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43410894
Sun 19 Jan 2014 11:12:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:12:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43410894
Sun 19 Jan 2014 11:12:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:12:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:12:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:12:51 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:12:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:12:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:12:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:12:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:12:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:12:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:12:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:12:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:12:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:12:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:12:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:12:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:12:57 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:12:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:12:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:12:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:12:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:12:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:12:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:13:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:13:00 - job_xml_thread(): Done retrieving: data size 43549764
Sun 19 Jan 2014 11:13:00 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:13:00 - XML: Start document: iteration 6
Sun 19 Jan 2014 11:13:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43549764
Sun 19 Jan 2014 11:13:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:13:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43549764
Sun 19 Jan 2014 11:13:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:13:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:13:04 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:13:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:13:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 11:13:06 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:13:06 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:13:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 11:13:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8665 values 136687 bits 17085 bytes 
Sun 19 Jan 2014 11:13:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:13:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:13:11 - XML: Processed 653184 elements - found 0 jobs
Sun 19 Jan 2014 11:13:11 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:13:11 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:13:11 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:13:11 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:13:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:13:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:13:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:13:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:13:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:13:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:13:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:13:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:13:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:13:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:13:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:13:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:13:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:13:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:13:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:13:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:13:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:13:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:13:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:13:25 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:13:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 11:13:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:13:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:13:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43545127
Sun 19 Jan 2014 11:13:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:13:26 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:13:26 - job_xml_thread(): Done retrieving: data size 43545127
Sun 19 Jan 2014 11:13:26 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:13:27 - XML: Start document: iteration 7
Sun 19 Jan 2014 11:13:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43545127
Sun 19 Jan 2014 11:13:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:13:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:13:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:13:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:13:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:13:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:13:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:13:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:13:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:13:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:13:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:13:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:13:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:13:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:13:42 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 11:13:42 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:13:42 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:13:42 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:13:42 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:13:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:13:48 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:13:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:13:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:13:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:13:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:13:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:13:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:13:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:13:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571543
Sun 19 Jan 2014 11:13:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:13:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571543
Sun 19 Jan 2014 11:13:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:13:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:13:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:13:57 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:13:57 - job_xml_thread(): Done retrieving: data size 43571543
Sun 19 Jan 2014 11:13:57 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:13:57 - XML: Start document: iteration 8
Sun 19 Jan 2014 11:13:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:13:58 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:13:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:13:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:13:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:13:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:13:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571543
Sun 19 Jan 2014 11:13:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:13:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:13:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:14:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:14:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:14:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:14:06 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:14:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:14:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 11:14:06 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:14:06 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:14:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 11:14:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99046 bits 12380 bytes 
Sun 19 Jan 2014 11:14:13 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 11:14:13 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 11:14:13 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:14:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:14:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:14:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:14:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:14:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:14:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:14:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:14:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:14:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:14:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:14:16 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 11:14:16 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:14:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:14:16 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:14:16 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:14:16 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:14:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:14:20 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:14:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:14:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:14:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:14:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:14:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:14:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:14:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:14:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573128
Sun 19 Jan 2014 11:14:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:14:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573128
Sun 19 Jan 2014 11:14:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:14:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:14:31 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:14:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:14:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:14:31 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:14:31 - job_xml_thread(): Done retrieving: data size 43573128
Sun 19 Jan 2014 11:14:31 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:14:31 - XML: Start document: iteration 9
Sun 19 Jan 2014 11:14:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:14:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:14:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:14:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573128
Sun 19 Jan 2014 11:14:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:14:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:14:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:14:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:14:44 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 11:14:44 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:14:45 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:14:45 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:14:45 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:14:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:14:47 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:14:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:14:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:14:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:14:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:14:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:14:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:14:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:14:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:14:51 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:14:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:14:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:14:51 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:14:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 11:14:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:14:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:14:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:14:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:14:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:14:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:14:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43585620
Sun 19 Jan 2014 11:14:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:14:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43585620
Sun 19 Jan 2014 11:14:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:15:00 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:15:00 - job_xml_thread(): Done retrieving: data size 43585620
Sun 19 Jan 2014 11:15:00 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:15:00 - XML: Start document: iteration 10
Sun 19 Jan 2014 11:15:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:15:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:15:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:15:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:15:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:15:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:15:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:15:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:15:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:15:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:15:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:15:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:15:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:15:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:15:06 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:15:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:15:07 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:15:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 11:15:07 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:15:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 11:15:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5826 values 91874 bits 11484 bytes 
Sun 19 Jan 2014 11:15:10 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 11:15:10 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:15:10 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:15:10 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:15:10 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:15:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:15:14 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:15:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:15:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:15:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:15:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:15:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:15:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:15:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:15:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556992
Sun 19 Jan 2014 11:15:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:15:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556992
Sun 19 Jan 2014 11:15:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:15:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:15:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:15:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:15:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:15:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:15:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:15:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:15:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:15:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:15:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:15:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556992
Sun 19 Jan 2014 11:15:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:15:25 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:15:25 - job_xml_thread(): Done retrieving: data size 43556992
Sun 19 Jan 2014 11:15:26 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:15:26 - XML: Start document: iteration 11
Sun 19 Jan 2014 11:15:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:15:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:15:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:15:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:15:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:15:41 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:15:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:15:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:15:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:15:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:15:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:15:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:15:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:15:44 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 11:15:44 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:15:44 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:15:44 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:15:44 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:15:44 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:15:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 11:15:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:15:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:15:44 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:15:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:15:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:15:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:15:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:15:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:15:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:15:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:15:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43587018
Sun 19 Jan 2014 11:15:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:15:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43587018
Sun 19 Jan 2014 11:15:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:15:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:15:54 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:15:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:15:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:15:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:15:57 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:15:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:15:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:15:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:15:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:15:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:15:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:15:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:15:59 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:15:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:15:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43593195
Sun 19 Jan 2014 11:15:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:16:00 - job_xml_thread(): Done retrieving: data size 43593195
Sun 19 Jan 2014 11:16:00 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:16:00 - XML: Start document: iteration 12
Sun 19 Jan 2014 11:16:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:16:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:16:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:16:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:16:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:16:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:16:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43593195
Sun 19 Jan 2014 11:16:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:16:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:16:07 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:16:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:16:08 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:16:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 11:16:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 11:16:08 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:16:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6071 values 95856 bits 11982 bytes 
Sun 19 Jan 2014 11:16:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:16:10 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:16:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:16:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:16:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:16:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:16:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:16:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:16:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:16:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:16:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:16:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:16:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:16:23 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 11:16:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:16:23 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 11:16:23 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:16:23 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:16:23 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:16:23 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:16:23 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:16:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:16:24 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:16:24 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 11:16:24 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:16:24 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 11:16:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:16:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:16:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:16:24 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 11:16:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:16:24 - size of cluster 'LISA Cluster': 624 hosts 79484 metrics 768366 values 12112016 bits 1514002 bytes 
Sun 19 Jan 2014 11:16:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:16:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43544934
Sun 19 Jan 2014 11:16:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:16:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43544934
Sun 19 Jan 2014 11:16:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:16:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:16:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:16:34 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:16:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 11:16:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:16:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:16:37 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:16:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:16:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:16:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:16:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:16:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:16:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:16:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43544934
Sun 19 Jan 2014 11:16:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:16:38 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:16:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:16:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:16:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:16:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:16:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:16:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:16:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:16:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:16:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:16:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:16:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:16:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:16:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:16:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:16:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:16:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:16:53 - job_xml_thread(): Done retrieving: data size 43558425
Sun 19 Jan 2014 11:16:53 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:16:53 - XML: Start document: iteration 13
Sun 19 Jan 2014 11:16:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558425
Sun 19 Jan 2014 11:16:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:16:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:16:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:16:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:16:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558425
Sun 19 Jan 2014 11:16:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:16:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:17:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:17:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:17:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:17:08 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:17:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:17:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:17:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:17:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 11:17:09 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:17:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99337 bits 12417 bytes 
Sun 19 Jan 2014 11:17:09 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:17:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 11:17:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:17:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:17:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:17:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:17:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:17:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:17:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:17:11 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 11:17:11 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:17:11 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:17:11 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:17:11 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:17:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:17:16 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:17:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:17:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:17:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:17:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:17:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:17:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:17:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:17:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43517355
Sun 19 Jan 2014 11:17:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:17:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43517355
Sun 19 Jan 2014 11:17:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:17:24 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:17:24 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 11:17:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:17:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:17:26 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:17:26 - job_xml_thread(): Done retrieving: data size 43517355
Sun 19 Jan 2014 11:17:26 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:17:26 - XML: Start document: iteration 14
Sun 19 Jan 2014 11:17:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:17:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:17:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:17:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:17:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:17:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:17:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:17:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:17:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:17:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:17:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:17:39 - XML: Processed 652600 elements - found 0 jobs
Sun 19 Jan 2014 11:17:39 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:17:39 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:17:39 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:17:39 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:17:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:17:42 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:17:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:17:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:17:43 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:17:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 11:17:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:17:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:17:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:17:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:17:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:17:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:17:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43003445
Sun 19 Jan 2014 11:17:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:17:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43003445
Sun 19 Jan 2014 11:17:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:17:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:17:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:17:54 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:17:54 - job_xml_thread(): Done retrieving: data size 43003445
Sun 19 Jan 2014 11:17:54 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:17:54 - XML: Start document: iteration 15
Sun 19 Jan 2014 11:17:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:17:54 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:17:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:17:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:17:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:17:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:17:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:17:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:17:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:17:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:17:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:18:05 - XML: Processed 646520 elements - found 0 jobs
Sun 19 Jan 2014 11:18:05 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:18:05 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:18:05 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:18:05 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:18:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:18:07 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:18:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:18:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:18:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:18:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:18:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:18:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:18:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:18:10 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:18:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:18:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42929230
Sun 19 Jan 2014 11:18:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:18:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42929230
Sun 19 Jan 2014 11:18:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:18:11 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:18:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:18:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 11:18:11 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:18:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 11:18:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:18:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7967 values 125925 bits 15740 bytes 
Sun 19 Jan 2014 11:18:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:18:20 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:18:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:18:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:18:22 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:18:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:18:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:18:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:18:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:18:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:18:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:18:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:18:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:18:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:18:26 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:18:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:18:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:18:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:18:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:18:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:18:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:18:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:18:29 - job_xml_thread(): Done retrieving: data size 42963112
Sun 19 Jan 2014 11:18:29 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:18:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42963112
Sun 19 Jan 2014 11:18:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:18:29 - XML: Start document: iteration 16
Sun 19 Jan 2014 11:18:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42963112
Sun 19 Jan 2014 11:18:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:18:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:18:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:18:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:18:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:18:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:18:45 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:18:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:18:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:18:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:18:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:18:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:18:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:18:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:18:48 - XML: Processed 645908 elements - found 0 jobs
Sun 19 Jan 2014 11:18:48 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:18:48 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:18:48 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:18:48 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:18:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:18:53 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:18:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:18:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:18:53 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:18:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 11:18:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:18:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:18:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:18:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:18:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:18:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:18:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43534873
Sun 19 Jan 2014 11:18:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:18:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43534873
Sun 19 Jan 2014 11:18:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:19:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:19:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:19:03 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:19:03 - job_xml_thread(): Done retrieving: data size 43534873
Sun 19 Jan 2014 11:19:03 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:19:03 - XML: Start document: iteration 17
Sun 19 Jan 2014 11:19:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:19:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:19:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:19:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:19:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:19:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:19:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:19:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:19:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:19:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:19:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:19:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:19:11 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:19:12 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:19:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 11:19:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:19:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 11:19:12 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:19:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5759 values 90884 bits 11360 bytes 
Sun 19 Jan 2014 11:19:16 - XML: Processed 653198 elements - found 0 jobs
Sun 19 Jan 2014 11:19:16 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:19:16 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:19:16 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:19:16 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:19:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:19:19 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:19:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:19:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:19:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:19:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:19:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:19:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:19:23 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:19:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 11:19:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:19:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:19:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554865
Sun 19 Jan 2014 11:19:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:19:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554865
Sun 19 Jan 2014 11:19:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:19:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:19:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:19:31 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:19:31 - job_xml_thread(): Done retrieving: data size 43554865
Sun 19 Jan 2014 11:19:31 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:19:31 - XML: Start document: iteration 18
Sun 19 Jan 2014 11:19:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:19:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:19:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:19:36 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:19:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:19:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:19:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:19:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:19:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:19:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:19:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:19:44 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 11:19:44 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:19:44 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:19:44 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:19:44 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:19:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:19:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:19:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:19:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:19:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:19:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:19:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:19:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:19:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:19:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553430
Sun 19 Jan 2014 11:19:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:19:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553430
Sun 19 Jan 2014 11:19:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:19:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:19:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:19:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:19:58 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:19:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:19:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:19:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:19:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:19:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:19:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:19:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:19:59 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:20:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:20:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:20:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:20:03 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:20:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:20:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:20:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:20:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:20:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:20:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:20:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:20:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568615
Sun 19 Jan 2014 11:20:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:20:07 - job_xml_thread(): Done retrieving: data size 43568615
Sun 19 Jan 2014 11:20:07 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:20:07 - XML: Start document: iteration 19
Sun 19 Jan 2014 11:20:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568615
Sun 19 Jan 2014 11:20:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:20:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:20:12 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:20:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:20:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 11:20:13 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:20:13 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:20:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148608 bits 18576 bytes 
Sun 19 Jan 2014 11:20:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 11:20:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:20:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:20:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:20:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:20:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:20:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:20:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:20:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:20:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:20:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:20:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:20:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:20:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:20:27 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 11:20:27 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:20:27 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:20:27 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:20:27 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:20:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:20:29 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:20:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:20:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:20:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:20:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:20:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:20:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:20:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:20:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43542148
Sun 19 Jan 2014 11:20:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:20:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:20:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:20:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43542148
Sun 19 Jan 2014 11:20:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:20:42 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:20:42 - job_xml_thread(): Done retrieving: data size 43542148
Sun 19 Jan 2014 11:20:42 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:20:42 - XML: Start document: iteration 20
Sun 19 Jan 2014 11:20:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:20:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:20:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:20:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:20:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:20:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:20:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:20:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:20:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:20:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:20:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:20:55 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 11:20:55 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:20:56 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:20:56 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:20:56 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:20:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:20:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:20:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:20:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:20:56 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:20:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 11:20:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:20:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:20:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:20:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:20:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:20:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:20:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556244
Sun 19 Jan 2014 11:20:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:20:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556244
Sun 19 Jan 2014 11:20:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:21:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:21:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:21:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:21:06 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:21:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:21:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:21:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:21:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:21:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:21:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556244
Sun 19 Jan 2014 11:21:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:21:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:21:11 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:21:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:21:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:21:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:21:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:21:14 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:21:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:21:15 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:21:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 11:21:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 11:21:15 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:21:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5737 values 90497 bits 11312 bytes 
Sun 19 Jan 2014 11:21:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:21:20 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:21:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:21:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:21:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:21:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:21:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:21:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:21:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:21:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:21:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:21:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:21:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:21:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:21:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:21:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:21:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:21:24 - job_xml_thread(): Done retrieving: data size 43554754
Sun 19 Jan 2014 11:21:24 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:21:24 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 11:21:24 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 11:21:24 - Housekeeping: done.
Sun 19 Jan 2014 11:21:24 - XML: Start document: iteration 0
Sun 19 Jan 2014 11:21:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554754
Sun 19 Jan 2014 11:21:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:21:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554754
Sun 19 Jan 2014 11:21:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:21:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:21:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:21:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:21:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:21:41 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 11:21:41 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:21:41 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:21:41 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:21:41 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:21:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:21:44 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:21:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:21:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:21:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:21:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:21:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:21:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:21:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:21:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:21:47 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:21:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:21:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:21:47 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:21:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 11:21:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:21:47 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 11:21:47 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 11:21:47 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:21:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:21:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:21:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:21:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:21:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:21:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43596648
Sun 19 Jan 2014 11:21:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:21:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43596648
Sun 19 Jan 2014 11:21:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:21:56 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:21:56 - job_xml_thread(): Done retrieving: data size 43596648
Sun 19 Jan 2014 11:21:56 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:21:56 - XML: Start document: iteration 1
Sun 19 Jan 2014 11:22:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:22:00 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:22:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:22:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:22:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:22:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:22:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:22:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:22:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:22:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:22:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:22:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:22:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:22:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:22:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:22:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:22:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:22:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:22:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:22:10 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 11:22:10 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:22:10 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:22:10 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:22:10 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:22:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:22:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556299
Sun 19 Jan 2014 11:22:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:22:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556299
Sun 19 Jan 2014 11:22:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:22:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:22:15 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:22:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:22:16 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:22:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 11:22:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 11:22:17 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:22:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8780 values 138424 bits 17303 bytes 
Sun 19 Jan 2014 11:22:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:22:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:22:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:22:20 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:22:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:22:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:22:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:22:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:22:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:22:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:22:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556299
Sun 19 Jan 2014 11:22:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:22:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:22:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:22:25 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:22:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:22:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:22:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:22:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:22:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:22:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:22:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:22:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:22:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:22:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:22:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:22:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:22:35 - job_xml_thread(): Done retrieving: data size 43566942
Sun 19 Jan 2014 11:22:35 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:22:35 - XML: Start document: iteration 2
Sun 19 Jan 2014 11:22:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566942
Sun 19 Jan 2014 11:22:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:22:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:22:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:22:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:22:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:22:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:22:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:22:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566942
Sun 19 Jan 2014 11:22:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:22:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:22:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:22:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:22:53 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:22:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:22:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:22:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:22:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:22:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:22:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:22:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:22:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:22:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:22:56 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 11:22:56 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:22:56 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:22:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:22:57 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:22:57 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:22:57 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:22:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:22:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:22:57 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:22:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 11:22:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:22:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:22:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:22:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:22:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:22:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:22:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43587496
Sun 19 Jan 2014 11:22:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:22:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43587496
Sun 19 Jan 2014 11:22:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:23:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:23:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:23:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:23:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:23:12 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:23:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:23:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:23:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:23:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:23:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:23:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:23:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:23:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:23:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:23:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:23:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:23:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:23:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:23:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:23:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:23:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:23:14 - job_xml_thread(): Done retrieving: data size 43529409
Sun 19 Jan 2014 11:23:14 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:23:14 - XML: Start document: iteration 3
Sun 19 Jan 2014 11:23:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43529409
Sun 19 Jan 2014 11:23:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:23:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43529409
Sun 19 Jan 2014 11:23:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:23:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:23:16 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:23:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:23:17 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:23:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 11:23:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 11:23:17 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:23:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5823 values 91800 bits 11475 bytes 
Sun 19 Jan 2014 11:23:24 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 11:23:24 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:23:26 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:23:26 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 11:23:26 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 11:23:26 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:23:26 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 11:23:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:23:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:23:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:23:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:23:32 - size of cluster 'LISA Cluster': 624 hosts 79478 metrics 766341 values 12083624 bits 1510453 bytes 
Sun 19 Jan 2014 11:23:32 - XML: Processed 652600 elements - found 0 jobs
Sun 19 Jan 2014 11:23:32 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:23:32 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:23:32 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:23:32 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:23:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:23:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:23:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:23:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:23:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:23:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:23:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:23:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:23:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:23:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:23:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:23:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:23:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:23:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:23:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:23:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:23:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:23:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:23:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42992533
Sun 19 Jan 2014 11:23:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:23:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42992533
Sun 19 Jan 2014 11:23:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:23:47 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:23:47 - job_xml_thread(): Done retrieving: data size 42992533
Sun 19 Jan 2014 11:23:47 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:23:47 - XML: Start document: iteration 4
Sun 19 Jan 2014 11:23:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:23:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:23:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:23:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:23:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:23:54 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:23:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:23:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:23:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:23:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:23:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:23:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:23:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:24:01 - XML: Processed 646256 elements - found 0 jobs
Sun 19 Jan 2014 11:24:01 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:24:01 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:24:01 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:24:01 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:24:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:24:04 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:24:04 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:24:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 11:24:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:24:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:24:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:24:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:24:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:24:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:24:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:24:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:24:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42911608
Sun 19 Jan 2014 11:24:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:24:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42911608
Sun 19 Jan 2014 11:24:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:24:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:24:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:24:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:24:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:24:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:24:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:24:17 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:24:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:24:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:24:17 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:24:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:24:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:24:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 11:24:17 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:24:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:24:17 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:24:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:24:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 11:24:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:24:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6074 values 95822 bits 11977 bytes 
Sun 19 Jan 2014 11:24:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:24:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:24:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:24:21 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:24:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:24:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:24:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:24:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:24:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:24:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:24:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:24:24 - job_xml_thread(): Done retrieving: data size 42958987
Sun 19 Jan 2014 11:24:24 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:24:24 - XML: Start document: iteration 5
Sun 19 Jan 2014 11:24:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42958987
Sun 19 Jan 2014 11:24:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42958987
Sun 19 Jan 2014 11:24:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:24:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:24:26 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:24:26 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 11:24:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:24:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:24:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:24:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:24:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:24:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:24:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:24:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:24:43 - XML: Processed 645900 elements - found 0 jobs
Sun 19 Jan 2014 11:24:43 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:24:43 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:24:43 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:24:43 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:24:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:24:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:24:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:24:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:24:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:24:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:24:48 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:24:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:24:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:24:49 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:24:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 11:24:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:24:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:24:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:24:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:24:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:24:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:24:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43514868
Sun 19 Jan 2014 11:24:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:24:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43514868
Sun 19 Jan 2014 11:24:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:24:58 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:24:58 - job_xml_thread(): Done retrieving: data size 43514868
Sun 19 Jan 2014 11:24:58 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:24:58 - XML: Start document: iteration 6
Sun 19 Jan 2014 11:24:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:24:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:25:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:25:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:25:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:25:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:25:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:25:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:25:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:25:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:25:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:25:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:25:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:25:11 - XML: Processed 652764 elements - found 0 jobs
Sun 19 Jan 2014 11:25:11 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:25:11 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:25:11 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:25:11 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:25:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:25:14 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:25:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:25:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:25:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:25:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:25:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:25:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:25:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:25:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43550332
Sun 19 Jan 2014 11:25:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:25:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:25:17 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:25:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:25:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43550332
Sun 19 Jan 2014 11:25:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:25:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:25:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:25:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 11:25:19 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:25:19 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:25:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 11:25:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8787 values 138551 bits 17318 bytes 
Sun 19 Jan 2014 11:25:26 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:25:26 - job_xml_thread(): Done retrieving: data size 43550332
Sun 19 Jan 2014 11:25:26 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:25:26 - XML: Start document: iteration 7
Sun 19 Jan 2014 11:25:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:25:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:25:30 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:25:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:25:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:25:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:25:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:25:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:25:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:25:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:25:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:25:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:25:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:25:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:25:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:25:38 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 11:25:38 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:25:38 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:25:38 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:25:38 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:25:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:25:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:25:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:25:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:25:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:25:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43546171
Sun 19 Jan 2014 11:25:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:25:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43546171
Sun 19 Jan 2014 11:25:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:25:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:25:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:25:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:25:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:25:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:25:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:25:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:25:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:25:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:25:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:25:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:25:53 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:25:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:25:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:25:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:25:58 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:25:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:25:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:25:58 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:25:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 11:25:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:25:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:25:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:25:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:25:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:26:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:26:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564499
Sun 19 Jan 2014 11:26:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:26:01 - job_xml_thread(): Done retrieving: data size 43564499
Sun 19 Jan 2014 11:26:01 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:26:01 - XML: Start document: iteration 8
Sun 19 Jan 2014 11:26:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564499
Sun 19 Jan 2014 11:26:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:26:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:26:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:26:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:26:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:26:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:26:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:26:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:26:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:26:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:26:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:26:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:26:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:26:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:26:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:26:19 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:26:19 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 11:26:19 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:26:19 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:26:19 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:26:19 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:26:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 11:26:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:26:19 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:26:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 11:26:19 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:26:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5671 values 89391 bits 11173 bytes 
Sun 19 Jan 2014 11:26:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:26:24 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:26:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:26:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:26:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:26:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:26:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:26:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:26:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:26:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43551800
Sun 19 Jan 2014 11:26:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:26:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43551800
Sun 19 Jan 2014 11:26:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:26:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:26:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:26:34 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:26:34 - job_xml_thread(): Done retrieving: data size 43551800
Sun 19 Jan 2014 11:26:34 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:26:34 - XML: Start document: iteration 9
Sun 19 Jan 2014 11:26:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:26:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:26:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:26:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:26:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:26:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:26:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:26:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:26:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:26:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:26:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:26:45 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:26:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 11:26:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:26:48 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 11:26:48 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:26:48 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:26:48 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:26:48 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:26:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:26:51 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:26:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:26:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:26:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:26:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:26:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:26:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:26:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:26:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43547596
Sun 19 Jan 2014 11:26:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:26:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43547596
Sun 19 Jan 2014 11:26:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:26:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:26:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:27:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:27:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:27:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:27:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:27:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:27:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:27:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:27:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43547596
Sun 19 Jan 2014 11:27:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:27:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:27:03 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:27:03 - job_xml_thread(): Done retrieving: data size 43547596
Sun 19 Jan 2014 11:27:03 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:27:03 - XML: Start document: iteration 10
Sun 19 Jan 2014 11:27:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:27:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:27:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:27:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:27:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:27:20 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:27:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:27:21 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:27:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 11:27:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 11:27:21 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:27:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5909 values 93211 bits 11651 bytes 
Sun 19 Jan 2014 11:27:22 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 11:27:22 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:27:22 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:27:22 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:27:22 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:27:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:27:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:27:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:27:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:27:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:27:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:27:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:27:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:27:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:27:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:27:24 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:27:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:27:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:27:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:27:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:27:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:27:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:27:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:27:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574682
Sun 19 Jan 2014 11:27:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:27:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574682
Sun 19 Jan 2014 11:27:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:27:37 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:27:37 - job_xml_thread(): Done retrieving: data size 43574682
Sun 19 Jan 2014 11:27:37 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:27:37 - XML: Start document: iteration 11
Sun 19 Jan 2014 11:27:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:27:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:27:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:27:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:27:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:27:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:27:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:27:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:27:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:27:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:27:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:27:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:27:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:27:50 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 11:27:50 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:27:50 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:27:50 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:27:50 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:27:51 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:27:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 11:27:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:27:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:27:51 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:27:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:27:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:27:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:27:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:27:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:27:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:27:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:27:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:27:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:27:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43537784
Sun 19 Jan 2014 11:27:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:27:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43537784
Sun 19 Jan 2014 11:27:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:28:06 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:28:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:28:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:28:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:28:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:28:07 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:28:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:28:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:28:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:28:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:28:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:28:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:28:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:28:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:28:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:28:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:28:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:28:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:28:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:28:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:28:11 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 11:28:11 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 11:28:11 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:28:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:28:12 - job_xml_thread(): Done retrieving: data size 43567990
Sun 19 Jan 2014 11:28:12 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:28:12 - XML: Start document: iteration 12
Sun 19 Jan 2014 11:28:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567990
Sun 19 Jan 2014 11:28:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:28:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567990
Sun 19 Jan 2014 11:28:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:28:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:28:21 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:28:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:28:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 11:28:22 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:28:22 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:28:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8969 values 141459 bits 17682 bytes 
Sun 19 Jan 2014 11:28:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 11:28:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:28:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:28:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:28:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:28:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:28:25 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:28:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:28:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:28:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:28:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:28:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:28:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:28:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:28:28 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 11:28:28 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:28:28 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:28:28 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:28:28 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:28:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:28:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:28:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:28:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:28:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:28:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:28:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:28:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:28:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:28:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580344
Sun 19 Jan 2014 11:28:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:28:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580344
Sun 19 Jan 2014 11:28:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:28:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:28:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:28:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:28:43 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:28:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:28:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:28:43 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:28:43 - job_xml_thread(): Done retrieving: data size 43580344
Sun 19 Jan 2014 11:28:43 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:28:43 - XML: Start document: iteration 13
Sun 19 Jan 2014 11:28:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:28:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:28:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580344
Sun 19 Jan 2014 11:28:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:28:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:28:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:28:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:28:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:28:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:28:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:29:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:29:01 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:29:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:29:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:29:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:29:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:29:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:29:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:29:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:29:03 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 11:29:03 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:29:03 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:29:03 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:29:03 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:29:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:29:05 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:29:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:29:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:29:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:29:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:29:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:29:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:29:05 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:29:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 11:29:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:29:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:29:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574375
Sun 19 Jan 2014 11:29:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:29:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574375
Sun 19 Jan 2014 11:29:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:29:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:29:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:29:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:29:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:29:18 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:29:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:29:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:29:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:29:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:29:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:29:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:29:19 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:29:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:29:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:29:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:29:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:29:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:29:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:29:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:29:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43506440
Sun 19 Jan 2014 11:29:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:29:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43506440
Sun 19 Jan 2014 11:29:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:29:21 - job_xml_thread(): Done retrieving: data size 43506440
Sun 19 Jan 2014 11:29:21 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:29:21 - XML: Start document: iteration 14
Sun 19 Jan 2014 11:29:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:29:24 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:29:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:29:26 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:29:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 11:29:26 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:29:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 11:29:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9127 values 143899 bits 17987 bytes 
Sun 19 Jan 2014 11:29:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:29:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:29:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:29:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:29:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:29:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:29:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:29:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:29:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:29:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:29:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:29:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:29:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:29:43 - XML: Processed 652600 elements - found 0 jobs
Sun 19 Jan 2014 11:29:43 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:29:43 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:29:43 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:29:43 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:29:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:29:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:29:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:29:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:29:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:29:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:29:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:29:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:29:47 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:29:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 11:29:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:29:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:29:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42984135
Sun 19 Jan 2014 11:29:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:29:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42984135
Sun 19 Jan 2014 11:29:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:29:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:29:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:29:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:29:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:29:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:29:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:29:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:29:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:29:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:29:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:29:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42984135
Sun 19 Jan 2014 11:29:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:29:58 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:29:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:30:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:30:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:30:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:30:06 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:30:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:30:07 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:30:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:30:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:30:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:30:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:30:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:30:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:30:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:30:09 - job_xml_thread(): Done retrieving: data size 42935907
Sun 19 Jan 2014 11:30:09 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:30:09 - XML: Start document: iteration 15
Sun 19 Jan 2014 11:30:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42935907
Sun 19 Jan 2014 11:30:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:30:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:30:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:30:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:30:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:30:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:30:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:30:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42935907
Sun 19 Jan 2014 11:30:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:30:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:30:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:30:26 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 11:30:27 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:30:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:30:27 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:30:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:30:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:30:28 - XML: Processed 645786 elements - found 0 jobs
Sun 19 Jan 2014 11:30:28 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:30:28 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:30:28 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:30:28 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:30:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 11:30:29 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:30:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:30:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 11:30:29 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:30:29 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:30:29 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:30:29 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 11:30:29 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 11:30:29 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 11:30:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99042 bits 12380 bytes 
Sun 19 Jan 2014 11:30:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:30:30 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:30:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:30:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:30:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:30:31 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:30:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:30:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:30:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:30:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:30:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:30:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:30:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:30:31 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 797514 values 12567355 bits 1570919 bytes 
Sun 19 Jan 2014 11:30:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:30:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:30:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:30:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:30:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:30:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43044106
Sun 19 Jan 2014 11:30:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:30:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43044106
Sun 19 Jan 2014 11:30:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:30:44 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:30:44 - job_xml_thread(): Done retrieving: data size 43044106
Sun 19 Jan 2014 11:30:44 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:30:44 - XML: Start document: iteration 16
Sun 19 Jan 2014 11:30:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:30:44 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:30:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:30:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:30:46 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:30:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 11:30:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:30:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:30:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:30:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:30:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:30:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:30:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:30:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:30:56 - XML: Processed 646620 elements - found 0 jobs
Sun 19 Jan 2014 11:30:56 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:30:56 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:30:56 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:30:56 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:30:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:30:58 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:30:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:30:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:30:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:30:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:30:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:30:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:31:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:31:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43535753
Sun 19 Jan 2014 11:31:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:31:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43535753
Sun 19 Jan 2014 11:31:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:31:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:31:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:31:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:31:10 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:31:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:31:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:31:11 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:31:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:31:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:31:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:31:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:31:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:31:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:31:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:31:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:31:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:31:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:31:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:31:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:31:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:31:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:31:16 - job_xml_thread(): Done retrieving: data size 43587509
Sun 19 Jan 2014 11:31:16 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:31:16 - XML: Start document: iteration 17
Sun 19 Jan 2014 11:31:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43587509
Sun 19 Jan 2014 11:31:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43587509
Sun 19 Jan 2014 11:31:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:31:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:31:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:31:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:31:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:31:28 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:31:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:31:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 11:31:29 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:31:29 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:31:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 11:31:29 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:31:29 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 11:31:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9259 values 146284 bits 18285 bytes 
Sun 19 Jan 2014 11:31:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:31:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:31:33 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 11:31:33 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:31:33 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:31:33 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:31:33 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:31:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:31:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:31:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:31:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:31:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:31:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:31:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:31:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:31:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:31:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:31:39 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:31:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:31:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:31:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:31:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:31:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:31:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:31:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:31:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558251
Sun 19 Jan 2014 11:31:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:31:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558251
Sun 19 Jan 2014 11:31:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:31:49 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:31:49 - job_xml_thread(): Done retrieving: data size 43558251
Sun 19 Jan 2014 11:31:49 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:31:49 - XML: Start document: iteration 18
Sun 19 Jan 2014 11:31:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:31:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:31:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:31:54 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:31:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:31:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:31:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:31:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:31:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:31:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:31:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:31:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:31:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:32:00 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:32:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 11:32:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:32:02 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 11:32:02 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:32:02 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:32:02 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:32:02 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:32:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:32:05 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:32:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:32:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:32:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:32:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:32:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:32:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:32:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:32:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43543542
Sun 19 Jan 2014 11:32:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:32:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43543542
Sun 19 Jan 2014 11:32:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:32:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:32:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:32:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:32:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:32:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:32:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:32:17 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:32:17 - job_xml_thread(): Done retrieving: data size 43543542
Sun 19 Jan 2014 11:32:17 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:32:17 - XML: Start document: iteration 19
Sun 19 Jan 2014 11:32:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:32:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:32:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:32:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:32:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:32:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:32:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:32:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:32:29 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:32:29 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 11:32:29 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:32:29 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:32:29 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:32:29 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:32:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:32:30 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:32:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 11:32:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 11:32:30 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:32:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5982 values 94617 bits 11827 bytes 
Sun 19 Jan 2014 11:32:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:32:31 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:32:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:32:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:32:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:32:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:32:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:32:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:32:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:32:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:32:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:32:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554215
Sun 19 Jan 2014 11:32:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:32:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554215
Sun 19 Jan 2014 11:32:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:32:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:32:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:32:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:32:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:32:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:32:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:32:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:32:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:32:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554215
Sun 19 Jan 2014 11:32:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:32:44 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:32:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:32:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:32:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:32:53 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:32:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 11:32:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:32:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:32:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:32:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:32:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:32:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:32:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:32:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:32:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:32:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:32:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:32:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:32:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:32:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:32:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:32:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:32:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:32:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:32:59 - job_xml_thread(): Done retrieving: data size 43539387
Sun 19 Jan 2014 11:32:59 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:32:59 - XML: Start document: iteration 20
Sun 19 Jan 2014 11:33:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43539387
Sun 19 Jan 2014 11:33:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:33:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43539387
Sun 19 Jan 2014 11:33:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:33:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:33:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:33:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:33:14 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:33:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:33:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:33:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:33:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:33:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:33:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:33:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:33:20 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 11:33:20 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:33:20 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:33:20 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:33:20 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:33:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:33:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:33:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:33:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:33:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:33:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:33:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:33:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:33:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:33:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43551794
Sun 19 Jan 2014 11:33:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:33:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43551794
Sun 19 Jan 2014 11:33:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:33:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:33:30 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:33:30 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:33:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 11:33:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:33:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 11:33:31 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:33:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9111 values 144007 bits 18000 bytes 
Sun 19 Jan 2014 11:33:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:33:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:33:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:33:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:33:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:33:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:33:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:33:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:33:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:33:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:33:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43551794
Sun 19 Jan 2014 11:33:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:33:35 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:33:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:33:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:33:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:33:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:33:45 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:33:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:33:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:33:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:33:49 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:33:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:33:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:33:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:33:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:33:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:33:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:33:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:33:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:33:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:33:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:33:53 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:33:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 11:33:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:33:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:33:53 - job_xml_thread(): Done retrieving: data size 43549945
Sun 19 Jan 2014 11:33:53 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:33:53 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 11:33:53 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 11:33:53 - Housekeeping: done.
Sun 19 Jan 2014 11:33:53 - XML: Start document: iteration 0
Sun 19 Jan 2014 11:33:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43549945
Sun 19 Jan 2014 11:33:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43549945
Sun 19 Jan 2014 11:33:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:33:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:34:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:34:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:34:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:34:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:34:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:34:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:34:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:34:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:34:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:34:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:34:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:34:12 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 11:34:12 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:34:12 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:34:12 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:34:12 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:34:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:34:16 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:34:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:34:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:34:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:34:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:34:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:34:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:34:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:34:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562374
Sun 19 Jan 2014 11:34:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:34:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562374
Sun 19 Jan 2014 11:34:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:34:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:34:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:34:27 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:34:27 - job_xml_thread(): Done retrieving: data size 43562374
Sun 19 Jan 2014 11:34:27 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:34:27 - XML: Start document: iteration 1
Sun 19 Jan 2014 11:34:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:34:30 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:34:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:34:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:34:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:34:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 11:34:32 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:34:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 11:34:32 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:34:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6384 values 100764 bits 12595 bytes 
Sun 19 Jan 2014 11:34:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:34:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:34:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:34:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:34:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:34:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:34:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:34:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:34:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:34:40 - XML: Processed 653349 elements - found 0 jobs
Sun 19 Jan 2014 11:34:40 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:34:40 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:34:40 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:34:40 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:34:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:34:41 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:34:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:34:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:34:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:34:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:34:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:34:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:34:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:34:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563299
Sun 19 Jan 2014 11:34:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:34:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563299
Sun 19 Jan 2014 11:34:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:34:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:34:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:34:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:34:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:34:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:34:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:34:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:34:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:34:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:34:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:34:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563299
Sun 19 Jan 2014 11:34:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:34:55 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:34:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:34:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:34:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:35:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:35:06 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:35:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:35:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:35:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:35:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:35:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:35:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:35:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:35:07 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:35:08 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 11:35:08 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 11:35:08 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:35:08 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:35:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 11:35:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:35:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:35:09 - job_xml_thread(): Done retrieving: data size 43548329
Sun 19 Jan 2014 11:35:09 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:35:09 - XML: Start document: iteration 2
Sun 19 Jan 2014 11:35:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:35:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:35:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43548329
Sun 19 Jan 2014 11:35:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:35:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:35:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:35:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:35:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:35:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43548329
Sun 19 Jan 2014 11:35:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:35:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:35:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:35:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:35:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:35:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:35:25 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:35:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:35:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:35:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:35:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:35:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:35:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:35:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:35:28 - XML: Processed 653348 elements - found 0 jobs
Sun 19 Jan 2014 11:35:28 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:35:28 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:35:28 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:35:28 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:35:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:35:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:35:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:35:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:35:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:35:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:35:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:35:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:35:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:35:32 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:35:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:35:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43136851
Sun 19 Jan 2014 11:35:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:35:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:35:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 11:35:33 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:35:33 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:35:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 11:35:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5734 values 90436 bits 11304 bytes 
Sun 19 Jan 2014 11:35:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43136851
Sun 19 Jan 2014 11:35:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:35:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:35:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:35:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:35:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:35:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:35:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:35:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:35:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:35:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:35:43 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:35:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:35:45 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:35:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:35:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:35:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:35:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:35:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:35:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:35:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:35:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42963185
Sun 19 Jan 2014 11:35:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:35:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42963185
Sun 19 Jan 2014 11:35:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:35:47 - job_xml_thread(): Done retrieving: data size 42963185
Sun 19 Jan 2014 11:35:47 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:35:47 - XML: Start document: iteration 3
Sun 19 Jan 2014 11:35:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:35:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:35:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:35:59 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:35:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:35:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:36:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:36:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:36:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:36:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:36:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:36:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:36:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:36:06 - XML: Processed 645658 elements - found 0 jobs
Sun 19 Jan 2014 11:36:06 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:36:06 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:36:06 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:36:06 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:36:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:36:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:36:09 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:36:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 11:36:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:36:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:36:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:36:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:36:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:36:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:36:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:36:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:36:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42944140
Sun 19 Jan 2014 11:36:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:36:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42944140
Sun 19 Jan 2014 11:36:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:36:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:36:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:36:21 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:36:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:36:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:36:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:36:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:36:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:36:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:36:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:36:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:36:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:36:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:36:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:36:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:36:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:36:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:36:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:36:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:36:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:36:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:36:25 - job_xml_thread(): Done retrieving: data size 42972794
Sun 19 Jan 2014 11:36:25 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:36:25 - XML: Start document: iteration 4
Sun 19 Jan 2014 11:36:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42972794
Sun 19 Jan 2014 11:36:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:36:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42972794
Sun 19 Jan 2014 11:36:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:36:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:36:33 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:36:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:36:33 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:36:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 11:36:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 11:36:33 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:36:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8828 values 139270 bits 17408 bytes 
Sun 19 Jan 2014 11:36:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:36:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:36:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:36:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:36:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:36:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:36:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:36:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:36:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:36:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:36:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:36:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:36:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:36:43 - XML: Processed 645904 elements - found 0 jobs
Sun 19 Jan 2014 11:36:43 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:36:43 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:36:43 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:36:43 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:36:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:36:47 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:36:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:36:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:36:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:36:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:36:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:36:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:36:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:36:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43486482
Sun 19 Jan 2014 11:36:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:36:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43486482
Sun 19 Jan 2014 11:36:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:36:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:36:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:36:58 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:36:58 - job_xml_thread(): Done retrieving: data size 43486482
Sun 19 Jan 2014 11:36:58 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:36:58 - XML: Start document: iteration 5
Sun 19 Jan 2014 11:36:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:36:58 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:36:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:36:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:36:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:36:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:36:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:36:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:36:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:37:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:37:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:37:08 - XML: Processed 652146 elements - found 0 jobs
Sun 19 Jan 2014 11:37:08 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:37:08 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:37:08 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:37:08 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:37:10 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:37:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 11:37:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:37:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:37:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:37:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:37:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:37:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:37:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:37:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:37:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:37:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:37:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43538778
Sun 19 Jan 2014 11:37:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:37:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43538778
Sun 19 Jan 2014 11:37:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:37:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:37:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:37:23 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:37:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:37:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:37:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:37:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:37:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:37:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:37:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:37:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:37:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:37:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:37:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:37:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:37:28 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:37:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:37:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:37:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:37:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:37:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:37:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:37:29 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 11:37:29 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:37:30 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:37:30 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:37:30 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 11:37:30 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 11:37:30 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 11:37:30 - size of cluster 'LISA Cluster': 624 hosts 79472 metrics 796185 values 12562635 bits 1570329 bytes 
Sun 19 Jan 2014 11:37:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:37:31 - job_xml_thread(): Done retrieving: data size 43571492
Sun 19 Jan 2014 11:37:31 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:37:31 - XML: Start document: iteration 6
Sun 19 Jan 2014 11:37:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571492
Sun 19 Jan 2014 11:37:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571492
Sun 19 Jan 2014 11:37:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:37:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:37:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:37:33 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:37:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:37:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 11:37:34 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:37:34 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:37:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sun 19 Jan 2014 11:37:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:37:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:37:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:37:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:37:52 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 11:37:52 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:37:52 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:37:52 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:37:52 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:37:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:37:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:37:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:37:54 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:37:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:37:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:37:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:37:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:37:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:37:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:37:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:37:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:37:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:37:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:37:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:37:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:37:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:37:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:37:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571165
Sun 19 Jan 2014 11:37:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:37:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571165
Sun 19 Jan 2014 11:37:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:38:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:38:06 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:38:07 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:38:07 - job_xml_thread(): Done retrieving: data size 43571165
Sun 19 Jan 2014 11:38:07 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:38:07 - XML: Start document: iteration 7
Sun 19 Jan 2014 11:38:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:38:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:38:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:38:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:38:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:38:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:38:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:38:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:38:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:38:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:38:19 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:38:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:38:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:38:20 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 11:38:20 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:38:20 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:38:20 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:38:20 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:38:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:38:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:38:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:38:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:38:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:38:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566027
Sun 19 Jan 2014 11:38:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:38:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566027
Sun 19 Jan 2014 11:38:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:38:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:38:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:38:30 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:38:30 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 11:38:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:38:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:38:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:38:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:38:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:38:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:38:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:38:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:38:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:38:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:38:34 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:38:35 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:38:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:38:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:38:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:38:35 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:38:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 11:38:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 11:38:35 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:38:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 15047 values 237339 bits 29667 bytes 
Sun 19 Jan 2014 11:38:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:38:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:38:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:38:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:38:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:38:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:38:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:38:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:38:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:38:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578510
Sun 19 Jan 2014 11:38:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:38:41 - job_xml_thread(): Done retrieving: data size 43578510
Sun 19 Jan 2014 11:38:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578510
Sun 19 Jan 2014 11:38:41 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:38:41 - XML: Start document: iteration 8
Sun 19 Jan 2014 11:38:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:38:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:38:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:38:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:38:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:38:57 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 11:38:57 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:38:57 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:38:57 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:38:57 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:38:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:38:58 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:38:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:38:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:38:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:38:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:38:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:38:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:38:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:39:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:39:04 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:39:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:39:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:39:04 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:39:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 11:39:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:39:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:39:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:39:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:39:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:39:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:39:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43585319
Sun 19 Jan 2014 11:39:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:39:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43585319
Sun 19 Jan 2014 11:39:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:39:12 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:39:12 - job_xml_thread(): Done retrieving: data size 43585319
Sun 19 Jan 2014 11:39:12 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:39:12 - XML: Start document: iteration 9
Sun 19 Jan 2014 11:39:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:39:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:39:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:39:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:39:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:39:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:39:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:39:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:39:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:39:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:39:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:39:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:39:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:39:27 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 11:39:27 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:39:27 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:39:27 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:39:27 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:39:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:39:29 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:39:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:39:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:39:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:39:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:39:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:39:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:39:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:39:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565075
Sun 19 Jan 2014 11:39:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:39:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565075
Sun 19 Jan 2014 11:39:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:39:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:39:35 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:39:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:39:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 11:39:36 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:39:36 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:39:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 11:39:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8908 values 140481 bits 17560 bytes 
Sun 19 Jan 2014 11:39:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:39:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:39:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:39:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:39:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:39:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:39:42 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:39:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:39:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:39:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:39:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:39:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:39:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:39:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:39:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:39:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:39:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:39:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:39:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:39:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:39:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:39:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:39:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:39:50 - job_xml_thread(): Done retrieving: data size 43574518
Sun 19 Jan 2014 11:39:50 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:39:50 - XML: Start document: iteration 10
Sun 19 Jan 2014 11:39:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574518
Sun 19 Jan 2014 11:39:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:39:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574518
Sun 19 Jan 2014 11:39:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:39:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:39:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:40:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:40:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:40:03 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 11:40:03 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:40:03 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:40:03 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:40:03 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:40:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:40:10 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:40:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:40:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:40:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:40:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:40:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:40:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:40:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:40:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:40:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:40:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:40:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:40:12 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:40:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 11:40:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:40:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:40:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:40:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:40:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:40:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:40:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574483
Sun 19 Jan 2014 11:40:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:40:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574483
Sun 19 Jan 2014 11:40:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:40:18 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:40:19 - job_xml_thread(): Done retrieving: data size 43574483
Sun 19 Jan 2014 11:40:19 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:40:19 - XML: Start document: iteration 11
Sun 19 Jan 2014 11:40:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:40:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:40:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:40:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:40:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:40:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:40:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:40:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:40:35 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 11:40:35 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:40:35 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:40:36 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:40:36 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:40:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:40:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:40:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:40:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:40:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:40:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:40:36 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:40:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:40:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 11:40:37 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:40:37 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:40:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 11:40:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5983 values 94372 bits 11796 bytes 
Sun 19 Jan 2014 11:40:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:40:37 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:40:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:40:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:40:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:40:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:40:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:40:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:40:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:40:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562539
Sun 19 Jan 2014 11:40:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:40:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562539
Sun 19 Jan 2014 11:40:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:40:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:40:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:40:51 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:40:51 - job_xml_thread(): Done retrieving: data size 43562539
Sun 19 Jan 2014 11:40:51 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:40:51 - XML: Start document: iteration 12
Sun 19 Jan 2014 11:40:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:40:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:40:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:40:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:40:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:40:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:40:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:40:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:40:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:40:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:40:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:41:02 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 11:41:02 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:41:02 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:41:02 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:41:02 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:41:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:41:04 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:41:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:41:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:41:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:41:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:41:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:41:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:41:05 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:41:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 11:41:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:41:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:41:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43552928
Sun 19 Jan 2014 11:41:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:41:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43552928
Sun 19 Jan 2014 11:41:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:41:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:41:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:41:17 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:41:17 - job_xml_thread(): Done retrieving: data size 43552928
Sun 19 Jan 2014 11:41:17 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:41:17 - XML: Start document: iteration 13
Sun 19 Jan 2014 11:41:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:41:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:41:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:41:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:41:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:41:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:41:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:41:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:41:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:41:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:41:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:41:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:41:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:41:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:41:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:41:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:41:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:41:32 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 11:41:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:41:32 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:41:32 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:41:32 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:41:32 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:41:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:41:32 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 11:41:32 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 11:41:32 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:41:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:41:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43492443
Sun 19 Jan 2014 11:41:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:41:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43492443
Sun 19 Jan 2014 11:41:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:41:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:41:37 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:41:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:41:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:41:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:41:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 11:41:39 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:41:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 11:41:39 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:41:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8807 values 138831 bits 17353 bytes 
Sun 19 Jan 2014 11:41:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:41:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:41:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:41:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:41:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:41:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:41:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43492443
Sun 19 Jan 2014 11:41:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:41:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:41:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:41:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:41:47 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:41:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:41:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:41:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:41:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:41:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:41:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:41:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:41:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:41:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:41:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:41:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:41:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:41:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:41:56 - job_xml_thread(): Done retrieving: data size 42903123
Sun 19 Jan 2014 11:41:56 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:41:56 - XML: Start document: iteration 14
Sun 19 Jan 2014 11:41:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42903123
Sun 19 Jan 2014 11:41:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:41:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:41:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:41:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:41:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:41:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:41:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:41:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42903123
Sun 19 Jan 2014 11:41:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:42:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:42:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:42:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:42:13 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:42:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:42:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:42:14 - XML: Processed 645404 elements - found 0 jobs
Sun 19 Jan 2014 11:42:14 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:42:14 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:42:14 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:42:14 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:42:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:42:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:42:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:42:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:42:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:42:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:42:19 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:42:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:42:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:42:19 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:42:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 11:42:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:42:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:42:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:42:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:42:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:42:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:42:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42989210
Sun 19 Jan 2014 11:42:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:42:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42989210
Sun 19 Jan 2014 11:42:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:42:29 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:42:29 - job_xml_thread(): Done retrieving: data size 42989210
Sun 19 Jan 2014 11:42:29 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:42:29 - XML: Start document: iteration 15
Sun 19 Jan 2014 11:42:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:42:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:42:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:42:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:42:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:42:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:42:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:42:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:42:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:42:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:42:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:42:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:42:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:42:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:42:39 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:42:40 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:42:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:42:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 11:42:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 11:42:41 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:42:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5963 values 94087 bits 11760 bytes 
Sun 19 Jan 2014 11:42:42 - XML: Processed 645900 elements - found 0 jobs
Sun 19 Jan 2014 11:42:42 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:42:42 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:42:42 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:42:42 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:42:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:42:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:42:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:42:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:42:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:42:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:42:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:42:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:42:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:42:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43468775
Sun 19 Jan 2014 11:42:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:42:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43468775
Sun 19 Jan 2014 11:42:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:42:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:42:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:42:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:42:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:42:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:42:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:42:57 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:42:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:42:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:42:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:42:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:42:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:42:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:42:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:42:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:42:59 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:42:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:42:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:42:59 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:42:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 11:42:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:43:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:43:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:43:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:43:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:43:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:43:01 - job_xml_thread(): Done retrieving: data size 43572557
Sun 19 Jan 2014 11:43:01 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:43:01 - XML: Start document: iteration 16
Sun 19 Jan 2014 11:43:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572557
Sun 19 Jan 2014 11:43:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572557
Sun 19 Jan 2014 11:43:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:43:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:43:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:43:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:43:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:43:14 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:43:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:43:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:43:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:43:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:43:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:43:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:43:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:43:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:43:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:43:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:43:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:43:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:43:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:43:24 - XML: Processed 653248 elements - found 0 jobs
Sun 19 Jan 2014 11:43:24 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:43:24 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:43:24 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:43:24 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:43:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:43:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:43:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:43:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:43:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:43:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43535792
Sun 19 Jan 2014 11:43:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:43:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43535792
Sun 19 Jan 2014 11:43:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:43:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:43:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:43:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:43:39 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:43:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:43:39 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:43:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:43:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:43:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:43:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:43:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:43:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:43:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:43:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:43:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:43:40 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:43:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:43:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:43:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:43:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:43:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:43:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:43:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:43:40 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:43:41 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:43:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 11:43:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:43:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 11:43:41 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:43:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9195 values 145103 bits 18137 bytes 
Sun 19 Jan 2014 11:43:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:43:42 - job_xml_thread(): Done retrieving: data size 43572439
Sun 19 Jan 2014 11:43:42 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:43:42 - XML: Start document: iteration 17
Sun 19 Jan 2014 11:43:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572439
Sun 19 Jan 2014 11:43:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:43:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572439
Sun 19 Jan 2014 11:43:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:43:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:43:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:43:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:43:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:43:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:43:59 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:43:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:43:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:44:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:44:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:44:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:44:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:44:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:44:02 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 11:44:02 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:44:02 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:44:02 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:44:02 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:44:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:44:06 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:44:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:44:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:44:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:44:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:44:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:44:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:44:07 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:44:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 11:44:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:44:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:44:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43552546
Sun 19 Jan 2014 11:44:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:44:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43552546
Sun 19 Jan 2014 11:44:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:44:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:44:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:44:17 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:44:17 - job_xml_thread(): Done retrieving: data size 43552546
Sun 19 Jan 2014 11:44:17 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:44:17 - XML: Start document: iteration 18
Sun 19 Jan 2014 11:44:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:44:18 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:44:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:44:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:44:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:44:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:44:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:44:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:44:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:44:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:44:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:44:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:44:27 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:44:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:44:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:44:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:44:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:44:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:44:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:44:29 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 11:44:29 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:44:29 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:44:29 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:44:29 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:44:30 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 11:44:30 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:44:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:44:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568780
Sun 19 Jan 2014 11:44:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:44:31 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:44:31 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 11:44:31 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 11:44:31 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:44:31 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 11:44:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568780
Sun 19 Jan 2014 11:44:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:44:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:44:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:44:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:44:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:44:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:44:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sun 19 Jan 2014 11:44:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:44:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:44:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:44:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:44:41 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:44:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:44:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:44:42 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:44:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:44:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 11:44:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 11:44:42 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:44:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:44:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:44:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7193 values 113418 bits 14177 bytes 
Sun 19 Jan 2014 11:44:44 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:44:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:44:45 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:44:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:44:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:44:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:44:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:44:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:44:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:44:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:44:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43597236
Sun 19 Jan 2014 11:44:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:44:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43597236
Sun 19 Jan 2014 11:44:48 - job_xml_thread(): Done retrieving: data size 43597236
Sun 19 Jan 2014 11:44:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:44:48 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:44:48 - XML: Start document: iteration 19
Sun 19 Jan 2014 11:44:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:44:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:44:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:44:58 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:44:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:44:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:44:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:44:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:44:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:44:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:44:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:45:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:45:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:45:05 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 11:45:05 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:45:05 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:45:05 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:45:05 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:45:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:45:07 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:45:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:45:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:45:08 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:45:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 11:45:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:45:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:45:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:45:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:45:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:45:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:45:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43548617
Sun 19 Jan 2014 11:45:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:45:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43548617
Sun 19 Jan 2014 11:45:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:45:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:45:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:45:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:45:19 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:45:20 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:45:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:45:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:45:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:45:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:45:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:45:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:45:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:45:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:45:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:45:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:45:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:45:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:45:24 - job_xml_thread(): Done retrieving: data size 43563347
Sun 19 Jan 2014 11:45:24 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:45:24 - XML: Start document: iteration 20
Sun 19 Jan 2014 11:45:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:45:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:45:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563347
Sun 19 Jan 2014 11:45:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:45:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:45:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563347
Sun 19 Jan 2014 11:45:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:45:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:45:31 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:45:31 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:45:32 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:45:32 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:45:32 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 11:45:32 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 11:45:32 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 11:45:35 - size of cluster 'LISA Cluster': 624 hosts 79463 metrics 875633 values 13802972 bits 1725371 bytes 
Sun 19 Jan 2014 11:45:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:45:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:45:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:45:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:45:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:45:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:45:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:45:40 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 11:45:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:45:40 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:45:40 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:45:40 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:45:40 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:45:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:45:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:45:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:45:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:45:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:45:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:45:43 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:45:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:45:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:45:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:45:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:45:43 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:45:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:45:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 11:45:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 11:45:43 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:45:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8633 values 136101 bits 17012 bytes 
Sun 19 Jan 2014 11:45:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:45:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:45:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:45:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:45:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:45:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583537
Sun 19 Jan 2014 11:45:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:45:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583537
Sun 19 Jan 2014 11:45:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:45:55 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:45:55 - job_xml_thread(): Done retrieving: data size 43583537
Sun 19 Jan 2014 11:45:55 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:45:55 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 11:45:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:45:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:45:55 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 11:45:55 - Housekeeping: done.
Sun 19 Jan 2014 11:45:55 - XML: Start document: iteration 0
Sun 19 Jan 2014 11:45:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:45:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:46:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:46:03 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:46:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:46:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:46:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:46:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:46:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:46:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:46:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:46:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:46:06 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:46:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:46:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:46:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:46:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:46:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:46:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:46:10 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 11:46:10 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:46:10 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:46:10 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:46:10 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:46:10 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:46:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 11:46:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:46:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:46:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562418
Sun 19 Jan 2014 11:46:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:46:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562418
Sun 19 Jan 2014 11:46:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:46:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:46:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:46:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:46:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:46:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:46:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:46:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:46:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:46:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:46:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:46:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:46:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:46:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:46:25 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:46:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:46:28 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:46:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:46:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:46:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:46:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:46:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:46:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:46:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:46:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582601
Sun 19 Jan 2014 11:46:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:46:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582601
Sun 19 Jan 2014 11:46:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:46:32 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:46:32 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 11:46:32 - job_xml_thread(): Done retrieving: data size 43582601
Sun 19 Jan 2014 11:46:33 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:46:33 - XML: Start document: iteration 1
Sun 19 Jan 2014 11:46:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:46:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:46:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:46:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:46:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:46:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:46:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:46:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:46:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:46:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:46:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:46:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:46:43 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:46:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:46:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 11:46:44 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:46:44 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:46:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 11:46:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8996 values 142065 bits 17758 bytes 
Sun 19 Jan 2014 11:46:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:46:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:46:51 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 11:46:51 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:46:51 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:46:51 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:46:51 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:46:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:46:55 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:46:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:46:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:46:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:46:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:46:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:46:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:46:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:46:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:46:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:46:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43542956
Sun 19 Jan 2014 11:46:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:46:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43542956
Sun 19 Jan 2014 11:46:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:47:06 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:47:06 - job_xml_thread(): Done retrieving: data size 43542956
Sun 19 Jan 2014 11:47:06 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:47:06 - XML: Start document: iteration 2
Sun 19 Jan 2014 11:47:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:47:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:47:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:47:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:47:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:47:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:47:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:47:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:47:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:47:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:47:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:47:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:47:19 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:47:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:47:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:47:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:47:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:47:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:47:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:47:22 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 11:47:22 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:47:22 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:47:22 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:47:22 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:47:22 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:47:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 11:47:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:47:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:47:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43496231
Sun 19 Jan 2014 11:47:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:47:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43496231
Sun 19 Jan 2014 11:47:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:47:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:47:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:47:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:47:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:47:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:47:36 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:47:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:47:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:47:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:47:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:47:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:47:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:47:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:47:37 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:47:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:47:40 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:47:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:47:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:47:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:47:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:47:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:47:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:47:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:47:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:47:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42980431
Sun 19 Jan 2014 11:47:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:47:44 - job_xml_thread(): Done retrieving: data size 42980431
Sun 19 Jan 2014 11:47:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42980431
Sun 19 Jan 2014 11:47:44 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:47:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:47:44 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:47:44 - XML: Start document: iteration 3
Sun 19 Jan 2014 11:47:46 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:47:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:47:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 11:47:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 11:47:47 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:47:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7661 values 121215 bits 15151 bytes 
Sun 19 Jan 2014 11:47:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:47:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:47:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:47:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:47:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:47:57 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:47:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:47:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:47:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:47:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:47:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:47:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:47:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:48:00 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 11:48:00 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 11:48:00 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:48:03 - XML: Processed 646040 elements - found 0 jobs
Sun 19 Jan 2014 11:48:03 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:48:03 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:48:03 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:48:03 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:48:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:48:07 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:48:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:48:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:48:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:48:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:48:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:48:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:48:09 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:48:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 11:48:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:48:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:48:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42881076
Sun 19 Jan 2014 11:48:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:48:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42881076
Sun 19 Jan 2014 11:48:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:48:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:48:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:48:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:48:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:48:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:48:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:48:18 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:48:19 - job_xml_thread(): Done retrieving: data size 42881076
Sun 19 Jan 2014 11:48:19 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:48:19 - XML: Start document: iteration 4
Sun 19 Jan 2014 11:48:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:48:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:48:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:48:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:48:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:48:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:48:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:48:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:48:28 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:48:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:48:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:48:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:48:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:48:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:48:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:48:30 - XML: Processed 645150 elements - found 0 jobs
Sun 19 Jan 2014 11:48:30 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:48:30 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:48:30 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:48:30 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:48:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:48:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42978934
Sun 19 Jan 2014 11:48:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:48:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42978934
Sun 19 Jan 2014 11:48:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:48:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:48:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:48:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:48:39 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:48:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:48:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:48:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:48:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:48:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42978934
Sun 19 Jan 2014 11:48:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:48:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:48:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:48:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:48:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:48:45 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:48:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:48:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:48:47 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:48:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:48:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 11:48:48 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:48:48 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:48:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 11:48:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99275 bits 12409 bytes 
Sun 19 Jan 2014 11:48:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:48:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:48:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:48:51 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:48:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:48:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:48:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:48:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:48:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:48:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:48:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:48:54 - job_xml_thread(): Done retrieving: data size 43532725
Sun 19 Jan 2014 11:48:54 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:48:54 - XML: Start document: iteration 5
Sun 19 Jan 2014 11:48:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43532725
Sun 19 Jan 2014 11:48:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:48:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:48:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:48:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:48:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:48:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:48:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:48:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43532725
Sun 19 Jan 2014 11:48:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:49:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:49:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:49:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:49:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:49:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:49:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:49:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:49:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:49:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:49:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:49:13 - XML: Processed 653066 elements - found 0 jobs
Sun 19 Jan 2014 11:49:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:49:13 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:49:13 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:49:13 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:49:13 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:49:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:49:16 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:49:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:49:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:49:17 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:49:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 11:49:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:49:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:49:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:49:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:49:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:49:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:49:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568624
Sun 19 Jan 2014 11:49:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:49:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568624
Sun 19 Jan 2014 11:49:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:49:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:49:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:49:28 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:49:28 - job_xml_thread(): Done retrieving: data size 43568624
Sun 19 Jan 2014 11:49:28 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:49:28 - XML: Start document: iteration 6
Sun 19 Jan 2014 11:49:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:49:30 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:49:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:49:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:49:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:49:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:49:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:49:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:49:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:49:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:49:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:49:40 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 11:49:40 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:49:40 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:49:40 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:49:40 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:49:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:49:42 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:49:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:49:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:49:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:49:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:49:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:49:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:49:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:49:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554130
Sun 19 Jan 2014 11:49:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:49:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554130
Sun 19 Jan 2014 11:49:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:49:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:49:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:49:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:49:48 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:49:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:49:49 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:49:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 11:49:49 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:49:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 11:49:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8989 values 141835 bits 17729 bytes 
Sun 19 Jan 2014 11:49:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:49:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:49:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:49:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:49:55 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:49:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:49:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:49:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:49:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:49:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:49:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:49:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:49:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:49:59 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:49:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:49:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:50:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:50:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:50:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:50:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:50:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:50:02 - job_xml_thread(): Done retrieving: data size 43573530
Sun 19 Jan 2014 11:50:02 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:50:02 - XML: Start document: iteration 7
Sun 19 Jan 2014 11:50:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573530
Sun 19 Jan 2014 11:50:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:50:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573530
Sun 19 Jan 2014 11:50:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:50:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:50:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:50:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:50:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:50:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:50:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:50:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:50:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:50:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:50:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:50:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:50:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:50:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:50:20 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 11:50:20 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:50:20 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:50:20 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:50:20 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:50:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:50:24 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:50:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:50:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:50:24 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:50:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 11:50:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:50:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:50:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:50:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:50:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:50:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:50:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559140
Sun 19 Jan 2014 11:50:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:50:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559140
Sun 19 Jan 2014 11:50:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:50:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:50:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:50:35 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:50:35 - job_xml_thread(): Done retrieving: data size 43559140
Sun 19 Jan 2014 11:50:35 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:50:35 - XML: Start document: iteration 8
Sun 19 Jan 2014 11:50:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:50:39 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:50:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:50:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:50:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:50:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:50:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:50:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:50:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:50:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:50:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:50:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:50:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:50:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:50:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:50:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:50:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:50:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:50:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:50:47 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 11:50:47 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:50:47 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:50:47 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:50:47 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:50:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:50:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566719
Sun 19 Jan 2014 11:50:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:50:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566719
Sun 19 Jan 2014 11:50:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:50:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:50:50 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:50:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:50:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 11:50:51 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:50:52 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:50:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 11:50:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8774 values 138385 bits 17298 bytes 
Sun 19 Jan 2014 11:50:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:50:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:51:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:51:00 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:51:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:51:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:51:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:51:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:51:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:51:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:51:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:51:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:51:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:51:02 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:51:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:51:03 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:51:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:51:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:51:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:51:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:51:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:51:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:51:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:51:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569815
Sun 19 Jan 2014 11:51:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:51:06 - job_xml_thread(): Done retrieving: data size 43569815
Sun 19 Jan 2014 11:51:06 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:51:06 - XML: Start document: iteration 9
Sun 19 Jan 2014 11:51:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569815
Sun 19 Jan 2014 11:51:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:51:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:51:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:51:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:51:18 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:51:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:51:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:51:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:51:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:51:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:51:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:51:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:51:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:51:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:51:22 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:51:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 11:51:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:51:25 - XML: Processed 653348 elements - found 0 jobs
Sun 19 Jan 2014 11:51:25 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:51:25 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:51:25 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:51:25 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:51:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:51:28 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:51:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:51:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:51:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:51:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:51:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:51:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:51:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:51:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569022
Sun 19 Jan 2014 11:51:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:51:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569022
Sun 19 Jan 2014 11:51:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:51:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:51:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:51:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:51:39 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:51:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:51:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:51:40 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:51:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:51:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:51:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:51:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:51:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:51:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:51:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:51:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:51:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:51:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:51:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:51:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:51:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:51:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:51:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:51:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:51:46 - job_xml_thread(): Done retrieving: data size 43590512
Sun 19 Jan 2014 11:51:46 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:51:46 - XML: Start document: iteration 10
Sun 19 Jan 2014 11:51:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43590512
Sun 19 Jan 2014 11:51:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43590512
Sun 19 Jan 2014 11:51:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:51:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:51:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:51:52 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:51:53 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:51:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:51:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 11:51:53 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:51:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 11:51:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8746 values 137972 bits 17246 bytes 
Sun 19 Jan 2014 11:51:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:51:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:51:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:51:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:52:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:52:06 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:52:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:52:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:52:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:52:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:52:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:52:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:52:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:52:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:52:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:52:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:52:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:52:10 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 11:52:10 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:52:10 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:52:10 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:52:10 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:52:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:52:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:52:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:52:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:52:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:52:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583863
Sun 19 Jan 2014 11:52:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:52:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583863
Sun 19 Jan 2014 11:52:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:52:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:52:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:52:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:52:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:52:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:52:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:52:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:52:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:52:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:52:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:52:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:52:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:52:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:52:26 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:52:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:52:29 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:52:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:52:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:52:29 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:52:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 11:52:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:52:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:52:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:52:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:52:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:52:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:52:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43592003
Sun 19 Jan 2014 11:52:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:52:32 - job_xml_thread(): Done retrieving: data size 43592003
Sun 19 Jan 2014 11:52:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43592003
Sun 19 Jan 2014 11:52:32 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:52:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:52:32 - XML: Start document: iteration 11
Sun 19 Jan 2014 11:52:32 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 11:52:32 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:52:34 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:52:34 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 11:52:34 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 11:52:34 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:52:34 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sun 19 Jan 2014 11:52:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:52:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:52:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:52:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:52:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:52:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:52:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:52:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:52:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:52:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:52:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:52:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:52:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:52:52 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 11:52:52 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:52:52 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:52:52 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:52:52 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:52:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:52:53 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:52:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:52:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 11:52:53 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:52:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5872 values 92635 bits 11579 bytes 
Sun 19 Jan 2014 11:52:53 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:52:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 11:52:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:52:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:52:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:52:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:52:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:52:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:52:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:52:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:52:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:52:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553776
Sun 19 Jan 2014 11:52:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:52:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553776
Sun 19 Jan 2014 11:52:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:52:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:52:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:53:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:53:04 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:53:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:53:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:53:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:53:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:53:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:53:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:53:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553776
Sun 19 Jan 2014 11:53:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:53:07 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:53:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:53:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:53:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:53:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:53:14 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:53:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:53:16 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:53:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:53:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:53:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:53:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:53:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:53:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:53:17 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:53:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 11:53:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:53:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:53:18 - job_xml_thread(): Done retrieving: data size 43485739
Sun 19 Jan 2014 11:53:18 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:53:18 - XML: Start document: iteration 12
Sun 19 Jan 2014 11:53:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43485739
Sun 19 Jan 2014 11:53:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:53:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:53:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:53:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:53:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:53:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43485739
Sun 19 Jan 2014 11:53:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:53:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:53:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:53:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:53:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:53:32 - XML: Processed 652598 elements - found 0 jobs
Sun 19 Jan 2014 11:53:32 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:53:32 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:53:32 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:53:33 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:53:34 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:53:34 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:53:35 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:53:35 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:53:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:53:35 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 11:53:35 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 11:53:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:53:35 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 11:53:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:53:37 - size of cluster 'LISA Cluster': 624 hosts 79477 metrics 959622 values 15142281 bits 1892785 bytes 
Sun 19 Jan 2014 11:53:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:53:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:53:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:53:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:53:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:53:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:53:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:53:41 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:53:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:53:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:53:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:53:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:53:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:53:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:53:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:53:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42992603
Sun 19 Jan 2014 11:53:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:53:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42992603
Sun 19 Jan 2014 11:53:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:53:48 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:53:48 - job_xml_thread(): Done retrieving: data size 42992603
Sun 19 Jan 2014 11:53:48 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:53:48 - XML: Start document: iteration 13
Sun 19 Jan 2014 11:53:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:53:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:53:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:53:53 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:53:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:53:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 11:53:54 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:53:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8813 values 138990 bits 17373 bytes 
Sun 19 Jan 2014 11:53:54 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:53:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 11:53:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:53:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:54:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:54:00 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:54:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:54:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:54:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:54:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:54:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:54:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:54:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:54:07 - XML: Processed 646046 elements - found 0 jobs
Sun 19 Jan 2014 11:54:07 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:54:07 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:54:07 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:54:07 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:54:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:54:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:54:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:54:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:54:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:54:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:54:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:54:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:54:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:54:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42897458
Sun 19 Jan 2014 11:54:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:54:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42897458
Sun 19 Jan 2014 11:54:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:54:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:54:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:54:22 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:54:22 - job_xml_thread(): Done retrieving: data size 42897458
Sun 19 Jan 2014 11:54:22 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:54:22 - XML: Start document: iteration 14
Sun 19 Jan 2014 11:54:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:54:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:54:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:54:25 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:54:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:54:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:54:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:54:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:54:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:54:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:54:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:54:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:54:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:54:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:54:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:54:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:54:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:54:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:54:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:54:34 - XML: Processed 645150 elements - found 0 jobs
Sun 19 Jan 2014 11:54:34 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:54:34 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:54:34 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:54:34 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:54:35 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:54:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 11:54:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:54:35 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:54:35 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 11:54:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:54:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43422198
Sun 19 Jan 2014 11:54:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:54:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43422198
Sun 19 Jan 2014 11:54:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:54:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:54:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:54:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:54:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:54:49 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:54:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:54:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:54:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:54:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:54:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:54:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:54:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:54:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:54:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:54:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:54:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:54:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:54:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:54:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:54:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:54:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:54:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:54:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:54:55 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:54:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:54:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 11:54:55 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:54:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 11:54:55 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:54:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5932 values 93589 bits 11698 bytes 
Sun 19 Jan 2014 11:54:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:54:58 - job_xml_thread(): Done retrieving: data size 43553859
Sun 19 Jan 2014 11:54:58 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:54:58 - XML: Start document: iteration 15
Sun 19 Jan 2014 11:54:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553859
Sun 19 Jan 2014 11:54:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:54:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553859
Sun 19 Jan 2014 11:54:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:55:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:55:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:55:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:55:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:55:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:55:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:55:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:55:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:55:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:55:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:55:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:55:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:55:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:55:17 - XML: Processed 653164 elements - found 0 jobs
Sun 19 Jan 2014 11:55:17 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:55:17 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:55:17 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:55:17 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:55:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:55:21 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:55:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:55:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:55:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:55:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:55:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:55:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:55:23 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:55:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 11:55:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:55:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:55:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43549176
Sun 19 Jan 2014 11:55:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:55:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43549176
Sun 19 Jan 2014 11:55:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:55:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:55:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:55:32 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:55:32 - job_xml_thread(): Done retrieving: data size 43549176
Sun 19 Jan 2014 11:55:32 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:55:32 - XML: Start document: iteration 16
Sun 19 Jan 2014 11:55:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:55:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:55:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:55:37 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:55:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:55:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:55:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:55:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:55:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:55:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:55:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:55:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:55:45 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:55:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:55:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:55:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:55:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:55:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:55:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:55:47 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 11:55:47 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:55:47 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:55:47 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:55:47 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:55:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:55:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558021
Sun 19 Jan 2014 11:55:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:55:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558021
Sun 19 Jan 2014 11:55:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:55:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:55:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:55:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:55:56 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:55:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:55:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 11:55:56 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:55:56 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:55:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 11:55:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7815 values 123268 bits 15408 bytes 
Sun 19 Jan 2014 11:56:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:56:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:56:02 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:56:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:56:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:56:04 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:56:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:56:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:56:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:56:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:56:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:56:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:56:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:56:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:56:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:56:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:56:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:56:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:56:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:56:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:56:10 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 11:56:10 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 11:56:10 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:56:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:56:12 - job_xml_thread(): Done retrieving: data size 43562961
Sun 19 Jan 2014 11:56:12 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:56:12 - XML: Start document: iteration 17
Sun 19 Jan 2014 11:56:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562961
Sun 19 Jan 2014 11:56:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562961
Sun 19 Jan 2014 11:56:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:56:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:56:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:56:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:56:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:56:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:56:30 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:56:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 11:56:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:56:30 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 11:56:30 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:56:30 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:56:30 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:56:30 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:56:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:56:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:56:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:56:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:56:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:56:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:56:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:56:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:56:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:56:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:56:35 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:56:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:56:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:56:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:56:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:56:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:56:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:56:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:56:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573298
Sun 19 Jan 2014 11:56:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:56:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573298
Sun 19 Jan 2014 11:56:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:56:46 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:56:46 - job_xml_thread(): Done retrieving: data size 43573298
Sun 19 Jan 2014 11:56:46 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:56:46 - XML: Start document: iteration 18
Sun 19 Jan 2014 11:56:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:56:47 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:56:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:56:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:56:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:56:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:56:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:56:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:56:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:56:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:56:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:56:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:56:56 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:56:56 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:56:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:56:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 11:56:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 11:56:56 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:56:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5830 values 91935 bits 11491 bytes 
Sun 19 Jan 2014 11:56:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:56:58 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:56:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:56:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:56:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:56:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:56:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:56:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:57:00 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 11:57:00 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:57:00 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:57:00 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:57:00 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:57:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:57:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574117
Sun 19 Jan 2014 11:57:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:57:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574117
Sun 19 Jan 2014 11:57:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:57:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:57:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:57:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:57:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:57:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:57:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:57:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:57:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:57:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:57:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574117
Sun 19 Jan 2014 11:57:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:57:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:57:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:57:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:57:15 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:57:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:57:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:57:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:57:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:57:25 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:57:25 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:57:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 11:57:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:57:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:57:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:57:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:57:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:57:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:57:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:57:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:57:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:57:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:57:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:57:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:57:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:57:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:57:28 - job_xml_thread(): Done retrieving: data size 43555835
Sun 19 Jan 2014 11:57:28 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:57:28 - XML: Start document: iteration 19
Sun 19 Jan 2014 11:57:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555835
Sun 19 Jan 2014 11:57:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:57:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555835
Sun 19 Jan 2014 11:57:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:57:41 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 11:57:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:57:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:57:41 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:57:41 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:57:41 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:57:41 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:57:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:57:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:57:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:57:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:57:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:57:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:57:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:57:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:57:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:57:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:57:47 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:57:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:57:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:57:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:57:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:57:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:57:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:57:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:57:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582758
Sun 19 Jan 2014 11:57:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:57:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582758
Sun 19 Jan 2014 11:57:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:57:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:57:56 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:57:57 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:57:58 - job_xml_thread(): Done retrieving: data size 43582758
Sun 19 Jan 2014 11:57:58 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:57:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:57:58 - XML: Start document: iteration 20
Sun 19 Jan 2014 11:57:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 11:57:58 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:57:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 11:57:59 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:57:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:57:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:58:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9149 values 144261 bits 18032 bytes 
Sun 19 Jan 2014 11:58:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:58:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:58:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:58:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:58:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:58:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:58:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:58:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:58:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:58:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:58:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:58:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:58:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:58:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:58:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:58:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:58:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:58:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:58:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:58:11 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 11:58:11 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:58:11 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:58:11 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:58:11 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:58:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:58:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569407
Sun 19 Jan 2014 11:58:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:58:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569407
Sun 19 Jan 2014 11:58:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:58:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:58:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:58:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:58:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:58:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:58:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:58:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:58:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:58:26 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:58:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:58:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:58:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:58:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:58:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:58:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:58:29 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:58:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:58:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:58:30 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:58:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 11:58:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:58:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:58:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:58:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:58:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:58:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:58:31 - job_xml_thread(): Done retrieving: data size 43597769
Sun 19 Jan 2014 11:58:31 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:58:31 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 11:58:31 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 11:58:31 - Housekeeping: done.
Sun 19 Jan 2014 11:58:31 - XML: Start document: iteration 0
Sun 19 Jan 2014 11:58:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43597769
Sun 19 Jan 2014 11:58:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:58:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43597769
Sun 19 Jan 2014 11:58:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:58:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:58:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:58:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:58:44 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:58:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:58:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:58:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:58:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:58:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:58:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:58:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:58:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:58:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:58:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:58:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:58:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:58:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:58:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:58:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:58:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:58:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:58:55 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 11:58:55 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:58:55 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:58:55 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:58:55 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:58:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:58:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563517
Sun 19 Jan 2014 11:58:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:58:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563517
Sun 19 Jan 2014 11:58:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:58:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:58:59 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:59:00 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:59:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 11:59:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:59:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 11:59:00 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:59:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8833 values 139291 bits 17411 bytes 
Sun 19 Jan 2014 11:59:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:59:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:59:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:59:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:59:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:59:10 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:59:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:59:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:59:10 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:59:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:59:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:59:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:59:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:59:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:59:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:59:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:59:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:59:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:59:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:59:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:59:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:59:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:59:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:59:15 - job_xml_thread(): Done retrieving: data size 43530396
Sun 19 Jan 2014 11:59:15 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:59:15 - XML: Start document: iteration 1
Sun 19 Jan 2014 11:59:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43530396
Sun 19 Jan 2014 11:59:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:59:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43530396
Sun 19 Jan 2014 11:59:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:59:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:59:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:59:27 - XML: Processed 652600 elements - found 0 jobs
Sun 19 Jan 2014 11:59:27 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:59:27 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:59:27 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:59:27 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 11:59:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:59:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:59:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:59:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:59:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:59:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:59:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:59:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:59:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:59:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:59:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:59:34 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 11:59:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 11:59:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:59:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 11:59:37 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 11:59:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 11:59:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 11:59:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:59:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 11:59:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 11:59:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 11:59:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 11:59:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43000043
Sun 19 Jan 2014 11:59:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 11:59:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43000043
Sun 19 Jan 2014 11:59:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 11:59:42 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 11:59:42 - job_xml_thread(): Done retrieving: data size 43000043
Sun 19 Jan 2014 11:59:42 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 11:59:42 - XML: Start document: iteration 2
Sun 19 Jan 2014 11:59:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 11:59:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:59:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 11:59:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 11:59:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 11:59:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 11:59:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 11:59:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 11:59:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:59:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 11:59:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 11:59:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 11:59:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 11:59:56 - XML: Processed 646412 elements - found 0 jobs
Sun 19 Jan 2014 11:59:56 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 11:59:56 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 11:59:56 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 11:59:56 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:00:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:00:00 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:00:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:00:00 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:00:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:00:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 12:00:00 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:00:00 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:00:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6119 values 96521 bits 12065 bytes 
Sun 19 Jan 2014 12:00:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 12:00:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:00:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:00:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:00:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:00:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:00:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:00:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:00:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42899565
Sun 19 Jan 2014 12:00:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:00:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42899565
Sun 19 Jan 2014 12:00:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:00:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:00:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:00:11 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:00:11 - job_xml_thread(): Done retrieving: data size 42899565
Sun 19 Jan 2014 12:00:11 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:00:11 - XML: Start document: iteration 3
Sun 19 Jan 2014 12:00:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:00:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:00:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:00:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:00:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:00:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:00:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:00:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:00:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:00:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:00:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:00:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:00:19 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:00:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:00:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:00:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:00:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:00:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:00:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:00:22 - XML: Processed 645150 elements - found 0 jobs
Sun 19 Jan 2014 12:00:22 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:00:22 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:00:22 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:00:22 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:00:23 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:00:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 12:00:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:00:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:00:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42962100
Sun 19 Jan 2014 12:00:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:00:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42962100
Sun 19 Jan 2014 12:00:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:00:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:00:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:00:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:00:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:00:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:00:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:00:35 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 12:00:36 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:00:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:00:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:00:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:00:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:00:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:00:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:00:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:00:37 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:00:37 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 12:00:37 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 12:00:37 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:00:37 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 12:00:37 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:00:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:00:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:00:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:00:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:00:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:00:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:00:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:00:39 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 943804 values 14874899 bits 1859362 bytes 
Sun 19 Jan 2014 12:00:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:00:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:00:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43426795
Sun 19 Jan 2014 12:00:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:00:41 - job_xml_thread(): Done retrieving: data size 43426795
Sun 19 Jan 2014 12:00:41 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:00:41 - XML: Start document: iteration 4
Sun 19 Jan 2014 12:00:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43426795
Sun 19 Jan 2014 12:00:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:00:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:00:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:00:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:00:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:00:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:00:57 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:00:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:00:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:00:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:00:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:00:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:00:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:00:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:00:58 - XML: Processed 651542 elements - found 0 jobs
Sun 19 Jan 2014 12:00:59 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:00:59 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:00:59 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:00:59 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:01:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:01:00 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:01:01 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:01:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:01:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 12:01:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 12:01:01 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:01:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8664 values 136628 bits 17078 bytes 
Sun 19 Jan 2014 12:01:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:01:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:01:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:01:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:01:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:01:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:01:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:01:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:01:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:01:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43550013
Sun 19 Jan 2014 12:01:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:01:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43550013
Sun 19 Jan 2014 12:01:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:01:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:01:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:01:14 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:01:14 - job_xml_thread(): Done retrieving: data size 43550013
Sun 19 Jan 2014 12:01:14 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:01:14 - XML: Start document: iteration 5
Sun 19 Jan 2014 12:01:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:01:18 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:01:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:01:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:01:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:01:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:01:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:01:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:01:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:01:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:01:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:01:25 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:01:25 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:01:25 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:01:25 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:01:25 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:01:26 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:01:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 12:01:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:01:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:01:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:01:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:01:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:01:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:01:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:01:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:01:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:01:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:01:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560142
Sun 19 Jan 2014 12:01:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:01:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560142
Sun 19 Jan 2014 12:01:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:01:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:01:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:01:37 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:01:37 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 12:01:41 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:01:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:01:41 - job_xml_thread(): Done retrieving: data size 43560142
Sun 19 Jan 2014 12:01:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:01:41 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:01:41 - XML: Start document: iteration 6
Sun 19 Jan 2014 12:01:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:01:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:01:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:01:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:01:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:01:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:01:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:01:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:01:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:01:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:01:53 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:01:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:01:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:01:54 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:01:54 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:01:54 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:01:54 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:01:54 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:01:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:01:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:01:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:01:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:01:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:01:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:01:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:01:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43550162
Sun 19 Jan 2014 12:01:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:01:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43550162
Sun 19 Jan 2014 12:01:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:02:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:02:01 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:02:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:02:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 12:02:02 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:02:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 12:02:02 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:02:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8819 values 139384 bits 17423 bytes 
Sun 19 Jan 2014 12:02:09 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:02:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:02:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:02:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:02:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:02:13 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:02:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:02:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:02:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:02:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:02:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:02:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:02:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:02:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:02:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:02:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:02:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:02:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:02:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:02:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:02:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:02:17 - job_xml_thread(): Done retrieving: data size 43593523
Sun 19 Jan 2014 12:02:17 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:02:17 - XML: Start document: iteration 7
Sun 19 Jan 2014 12:02:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43593523
Sun 19 Jan 2014 12:02:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:02:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43593523
Sun 19 Jan 2014 12:02:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:02:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:02:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:02:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:02:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:02:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:02:35 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:02:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:02:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:02:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:02:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:02:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:02:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:02:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:02:40 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:02:40 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:02:40 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:02:40 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:02:40 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:02:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:02:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:02:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:02:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:02:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:02:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:02:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:02:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:02:42 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:02:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 12:02:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:02:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:02:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43592585
Sun 19 Jan 2014 12:02:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:02:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43592585
Sun 19 Jan 2014 12:02:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:02:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:02:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:02:55 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:02:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:02:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:02:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:03:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:03:00 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:03:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:03:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:03:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:03:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:03:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:03:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:03:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:03:01 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:03:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:03:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:03:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:03:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:03:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:03:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:03:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:03:02 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:03:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:03:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 12:03:02 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:03:02 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:03:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 12:03:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5615 values 88785 bits 11098 bytes 
Sun 19 Jan 2014 12:03:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:03:04 - job_xml_thread(): Done retrieving: data size 43571089
Sun 19 Jan 2014 12:03:04 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:03:04 - XML: Start document: iteration 8
Sun 19 Jan 2014 12:03:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571089
Sun 19 Jan 2014 12:03:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571089
Sun 19 Jan 2014 12:03:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:03:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:03:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:03:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:03:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:03:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:03:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:03:19 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:03:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:03:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:03:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:03:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:03:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:03:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:03:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:03:23 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:03:23 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:03:23 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:03:24 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:03:24 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:03:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:03:27 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:03:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:03:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:03:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:03:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:03:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:03:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:03:29 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:03:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 12:03:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:03:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:03:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578158
Sun 19 Jan 2014 12:03:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:03:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578158
Sun 19 Jan 2014 12:03:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:03:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:03:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:03:39 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:03:39 - job_xml_thread(): Done retrieving: data size 43578158
Sun 19 Jan 2014 12:03:39 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:03:39 - XML: Start document: iteration 9
Sun 19 Jan 2014 12:03:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:03:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:03:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:03:45 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:03:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:03:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:03:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:03:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:03:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:03:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:03:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:03:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:03:52 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:03:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:03:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:03:54 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:03:54 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:03:54 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:03:54 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:03:54 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:03:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:03:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:03:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:03:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:03:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:03:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558177
Sun 19 Jan 2014 12:03:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:03:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558177
Sun 19 Jan 2014 12:03:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:04:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:04:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:04:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:04:02 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:04:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:04:03 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:04:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 12:04:03 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:04:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 12:04:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7692 values 121407 bits 15175 bytes 
Sun 19 Jan 2014 12:04:09 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:04:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:04:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:04:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:04:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:04:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:04:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:04:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:04:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:04:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:04:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:04:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:04:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:04:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:04:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:04:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:04:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:04:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:04:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:04:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:04:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:04:17 - job_xml_thread(): Done retrieving: data size 43589383
Sun 19 Jan 2014 12:04:17 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:04:17 - XML: Start document: iteration 10
Sun 19 Jan 2014 12:04:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43589383
Sun 19 Jan 2014 12:04:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:04:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43589383
Sun 19 Jan 2014 12:04:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:04:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:04:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:04:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:04:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:04:34 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:04:34 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:04:34 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:04:34 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:04:34 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:04:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:04:37 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:04:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:04:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:04:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:04:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:04:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:04:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:04:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:04:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:04:41 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:04:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:04:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:04:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:04:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:04:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:04:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:04:42 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:04:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 12:04:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:04:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:04:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584033
Sun 19 Jan 2014 12:04:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584033
Sun 19 Jan 2014 12:04:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:04:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:04:49 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:04:49 - job_xml_thread(): Done retrieving: data size 43584033
Sun 19 Jan 2014 12:04:49 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:04:50 - XML: Start document: iteration 11
Sun 19 Jan 2014 12:04:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:04:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:04:56 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 12:04:56 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 12:04:56 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:04:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:04:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:04:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:04:57 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:04:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:04:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:04:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:04:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:04:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:04:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:04:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:05:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:05:03 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:05:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:05:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 12:05:04 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:05:04 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:05:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 12:05:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5400 values 85133 bits 10641 bytes 
Sun 19 Jan 2014 12:05:06 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:05:06 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:05:06 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:05:06 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:05:06 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:05:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:05:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:05:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:05:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:05:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:05:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:05:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:05:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:05:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:05:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43551621
Sun 19 Jan 2014 12:05:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:05:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43551621
Sun 19 Jan 2014 12:05:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:05:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:05:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:05:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:05:19 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:05:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:05:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:05:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:05:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:05:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43551621
Sun 19 Jan 2014 12:05:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:05:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:05:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:05:21 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:05:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:05:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:05:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:05:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:05:29 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:05:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:05:32 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:05:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:05:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:05:32 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:05:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 12:05:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:05:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:05:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:05:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:05:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:05:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:05:33 - job_xml_thread(): Done retrieving: data size 43491434
Sun 19 Jan 2014 12:05:33 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:05:33 - XML: Start document: iteration 12
Sun 19 Jan 2014 12:05:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43491434
Sun 19 Jan 2014 12:05:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:05:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:05:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:05:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:05:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:05:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:05:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43491434
Sun 19 Jan 2014 12:05:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:05:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:05:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:05:44 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:05:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:05:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:05:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:05:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:05:52 - XML: Processed 652586 elements - found 0 jobs
Sun 19 Jan 2014 12:05:52 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:05:52 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:05:52 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:05:52 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:05:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:05:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:05:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:05:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:05:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:05:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:05:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:05:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:05:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:05:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:05:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:05:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:05:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:05:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:05:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42919669
Sun 19 Jan 2014 12:05:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:05:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42919669
Sun 19 Jan 2014 12:05:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:06:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:06:04 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:06:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:06:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 12:06:07 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:06:07 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:06:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8837 values 139391 bits 17423 bytes 
Sun 19 Jan 2014 12:06:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 12:06:07 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:06:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:06:07 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:06:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:06:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:06:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:06:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:06:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:06:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:06:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:06:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:06:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:06:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:06:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:06:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:06:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:06:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:06:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:06:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:06:11 - job_xml_thread(): Done retrieving: data size 42967043
Sun 19 Jan 2014 12:06:11 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:06:11 - XML: Start document: iteration 13
Sun 19 Jan 2014 12:06:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42967043
Sun 19 Jan 2014 12:06:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:06:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42967043
Sun 19 Jan 2014 12:06:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:06:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:06:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:06:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:06:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:06:28 - XML: Processed 645674 elements - found 0 jobs
Sun 19 Jan 2014 12:06:28 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:06:28 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:06:28 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:06:28 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:06:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:06:31 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:06:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:06:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:06:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:06:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:06:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:06:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:06:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:06:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:06:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:06:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:06:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:06:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:06:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:06:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:06:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:06:33 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:06:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 12:06:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:06:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:06:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43258930
Sun 19 Jan 2014 12:06:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:06:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43258930
Sun 19 Jan 2014 12:06:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:06:43 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:06:43 - job_xml_thread(): Done retrieving: data size 43258930
Sun 19 Jan 2014 12:06:43 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:06:43 - XML: Start document: iteration 14
Sun 19 Jan 2014 12:06:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:06:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:06:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:06:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:06:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:06:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:06:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:06:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:06:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:06:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:06:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:06:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:06:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:06:56 - XML: Processed 649446 elements - found 0 jobs
Sun 19 Jan 2014 12:06:56 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:06:56 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:06:56 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:06:56 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:06:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:06:57 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:06:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:06:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:06:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:06:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:06:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:06:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:06:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:06:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563268
Sun 19 Jan 2014 12:06:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:06:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563268
Sun 19 Jan 2014 12:06:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:07:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:07:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:07:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:07:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:07:07 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:07:07 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:07:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:07:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:07:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:07:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 12:07:08 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:07:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8821 values 139126 bits 17390 bytes 
Sun 19 Jan 2014 12:07:08 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:07:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 12:07:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:07:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:07:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:07:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:07:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:07:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:07:11 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:07:11 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:07:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:07:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:07:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:07:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:07:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:07:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:07:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:07:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43590176
Sun 19 Jan 2014 12:07:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:07:14 - job_xml_thread(): Done retrieving: data size 43590176
Sun 19 Jan 2014 12:07:14 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:07:14 - XML: Start document: iteration 15
Sun 19 Jan 2014 12:07:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43590176
Sun 19 Jan 2014 12:07:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:07:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:07:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:07:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:07:27 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:07:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:07:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:07:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:07:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:07:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:07:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:07:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:07:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:07:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:07:33 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:07:33 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:07:33 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:07:33 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:07:33 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:07:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:07:37 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:07:37 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 12:07:37 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:07:37 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:07:37 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 12:07:37 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:07:37 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 12:07:37 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 12:07:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:07:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:07:38 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 886867 values 13994094 bits 1749261 bytes 
Sun 19 Jan 2014 12:07:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:07:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:07:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:07:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:07:38 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:07:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 12:07:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:07:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:07:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43541000
Sun 19 Jan 2014 12:07:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:07:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43541000
Sun 19 Jan 2014 12:07:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:07:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:07:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:07:48 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:07:48 - job_xml_thread(): Done retrieving: data size 43541000
Sun 19 Jan 2014 12:07:48 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:07:48 - XML: Start document: iteration 16
Sun 19 Jan 2014 12:07:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:07:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:07:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:07:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:07:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:07:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:07:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:07:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:07:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:07:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:07:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:08:02 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:08:02 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:08:02 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:08:02 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:08:02 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:08:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:08:03 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:08:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:08:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:08:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:08:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:08:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:08:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:08:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:08:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43540255
Sun 19 Jan 2014 12:08:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:08:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43540255
Sun 19 Jan 2014 12:08:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:08:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:08:09 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:08:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:08:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:08:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:08:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 12:08:10 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:08:10 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:08:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 12:08:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8952 values 141228 bits 17653 bytes 
Sun 19 Jan 2014 12:08:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:08:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:08:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:08:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:08:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:08:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:08:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:08:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:08:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:08:17 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:08:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:08:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:08:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:08:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:08:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:08:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:08:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:08:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:08:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:08:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:08:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:08:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561679
Sun 19 Jan 2014 12:08:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:08:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561679
Sun 19 Jan 2014 12:08:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:08:26 - job_xml_thread(): Done retrieving: data size 43561679
Sun 19 Jan 2014 12:08:27 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:08:27 - XML: Start document: iteration 17
Sun 19 Jan 2014 12:08:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:08:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:08:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:08:37 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:08:38 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 12:08:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:08:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:08:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:08:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:08:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:08:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:08:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:08:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:08:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:08:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:08:46 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:08:46 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:08:46 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:08:46 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:08:46 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:08:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:08:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:08:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:08:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:08:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:08:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:08:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:08:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:08:50 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:08:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 12:08:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:08:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:08:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43546550
Sun 19 Jan 2014 12:08:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:08:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43546550
Sun 19 Jan 2014 12:08:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:08:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:08:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:09:01 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:09:01 - job_xml_thread(): Done retrieving: data size 43546550
Sun 19 Jan 2014 12:09:01 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:09:01 - XML: Start document: iteration 18
Sun 19 Jan 2014 12:09:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:09:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:09:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:09:11 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:09:11 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:09:11 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:09:11 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:09:11 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:09:11 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:09:11 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:09:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 12:09:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:09:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 12:09:13 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:09:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5791 values 91336 bits 11417 bytes 
Sun 19 Jan 2014 12:09:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:09:13 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:09:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:09:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:09:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:09:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:09:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:09:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:09:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:09:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:09:15 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:09:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:09:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:09:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:09:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:09:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:09:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:09:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:09:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572963
Sun 19 Jan 2014 12:09:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:09:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572963
Sun 19 Jan 2014 12:09:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:09:26 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:09:26 - job_xml_thread(): Done retrieving: data size 43572963
Sun 19 Jan 2014 12:09:26 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:09:27 - XML: Start document: iteration 19
Sun 19 Jan 2014 12:09:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:09:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:09:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:09:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:09:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:09:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:09:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:09:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:09:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:09:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:09:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:09:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:09:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:09:41 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:09:41 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:09:41 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:09:41 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:09:41 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:09:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:09:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:09:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:09:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:09:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:09:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:09:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:09:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:09:44 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:09:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 12:09:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:09:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:09:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567780
Sun 19 Jan 2014 12:09:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:09:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567780
Sun 19 Jan 2014 12:09:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:09:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:09:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:09:56 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:09:56 - job_xml_thread(): Done retrieving: data size 43567780
Sun 19 Jan 2014 12:09:56 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:09:56 - XML: Start document: iteration 20
Sun 19 Jan 2014 12:09:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:09:58 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:09:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:09:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:09:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:09:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:09:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:09:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:09:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:09:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:09:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:10:08 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:10:08 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:10:08 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:10:08 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:10:08 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:10:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:10:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:10:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:10:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:10:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:10:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:10:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:10:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:10:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:10:11 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:10:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:10:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553194
Sun 19 Jan 2014 12:10:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:10:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:10:12 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:10:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 12:10:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 12:10:13 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:10:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5686 values 89614 bits 11201 bytes 
Sun 19 Jan 2014 12:10:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553194
Sun 19 Jan 2014 12:10:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:10:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:10:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:10:23 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:10:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:10:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:10:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:10:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:10:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:10:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:10:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:10:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:10:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:10:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:10:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:10:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:10:29 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:10:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:10:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:10:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:10:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:10:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:10:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:10:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:10:33 - job_xml_thread(): Done retrieving: data size 43576907
Sun 19 Jan 2014 12:10:33 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:10:33 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 12:10:33 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 12:10:33 - Housekeeping: done.
Sun 19 Jan 2014 12:10:33 - XML: Start document: iteration 0
Sun 19 Jan 2014 12:10:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576907
Sun 19 Jan 2014 12:10:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:10:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576907
Sun 19 Jan 2014 12:10:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:10:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:10:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:10:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:10:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:10:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:10:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:10:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:10:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:10:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:10:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:10:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:10:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:10:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:10:51 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:10:51 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:10:51 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:10:51 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:10:51 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:10:55 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:10:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 12:10:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:10:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:10:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:10:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:10:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:10:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:10:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:10:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:10:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:10:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:10:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573961
Sun 19 Jan 2014 12:10:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:10:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573961
Sun 19 Jan 2014 12:10:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:11:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:11:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:11:06 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:11:06 - job_xml_thread(): Done retrieving: data size 43573961
Sun 19 Jan 2014 12:11:06 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:11:06 - XML: Start document: iteration 1
Sun 19 Jan 2014 12:11:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:11:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:11:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:11:13 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:11:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:11:13 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:11:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:11:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:11:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:11:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:11:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:11:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:11:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:11:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:11:14 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:11:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 12:11:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 12:11:14 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:11:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6036 values 95224 bits 11903 bytes 
Sun 19 Jan 2014 12:11:21 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:11:21 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:11:21 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:11:21 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:11:21 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:11:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:11:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:11:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:11:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:11:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:11:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:11:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:11:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:11:26 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:11:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 12:11:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:11:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:11:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43480562
Sun 19 Jan 2014 12:11:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:11:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43480562
Sun 19 Jan 2014 12:11:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:11:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:11:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:11:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:11:36 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:11:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:11:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:11:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:11:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:11:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:11:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:11:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43480562
Sun 19 Jan 2014 12:11:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:11:36 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:11:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:11:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:11:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:11:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:11:45 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:11:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:11:49 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:11:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:11:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:11:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:11:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:11:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:11:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:11:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:11:51 - job_xml_thread(): Done retrieving: data size 42945818
Sun 19 Jan 2014 12:11:51 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:11:51 - XML: Start document: iteration 2
Sun 19 Jan 2014 12:11:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42945818
Sun 19 Jan 2014 12:11:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:11:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:11:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:11:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:11:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:11:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:11:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42945818
Sun 19 Jan 2014 12:11:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:11:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:12:03 - XML: Processed 645980 elements - found 0 jobs
Sun 19 Jan 2014 12:12:04 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:12:04 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:12:04 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:12:04 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:12:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:12:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:12:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:12:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:12:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:12:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:12:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:12:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:12:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:12:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:12:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:12:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:12:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:12:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:12:13 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:12:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:12:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:12:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:12:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:12:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:12:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:12:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:12:14 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:12:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:12:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 12:12:14 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:12:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 12:12:14 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:12:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99046 bits 12380 bytes 
Sun 19 Jan 2014 12:12:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:12:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42945380
Sun 19 Jan 2014 12:12:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:12:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42945380
Sun 19 Jan 2014 12:12:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:12:19 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:12:19 - job_xml_thread(): Done retrieving: data size 42945380
Sun 19 Jan 2014 12:12:19 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:12:19 - XML: Start document: iteration 3
Sun 19 Jan 2014 12:12:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:12:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:12:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:12:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:12:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:12:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:12:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:12:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:12:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:12:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:12:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:12:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:12:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:12:37 - XML: Processed 645262 elements - found 0 jobs
Sun 19 Jan 2014 12:12:37 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:12:37 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:12:37 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:12:37 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:12:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:12:41 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:12:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:12:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:12:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:12:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:12:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:12:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:12:42 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:12:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 12:12:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:12:43 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 12:12:43 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 12:12:43 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:12:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:12:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43465122
Sun 19 Jan 2014 12:12:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:12:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43465122
Sun 19 Jan 2014 12:12:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:12:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:12:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:12:53 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:12:53 - job_xml_thread(): Done retrieving: data size 43465122
Sun 19 Jan 2014 12:12:53 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:12:53 - XML: Start document: iteration 4
Sun 19 Jan 2014 12:12:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:12:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:12:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:12:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:12:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:12:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:12:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:12:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:12:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:12:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:12:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:13:02 - XML: Processed 652048 elements - found 0 jobs
Sun 19 Jan 2014 12:13:02 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:13:02 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:13:02 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:13:02 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:13:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:13:05 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:13:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:13:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:13:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:13:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:13:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:13:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:13:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:13:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43551856
Sun 19 Jan 2014 12:13:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:13:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43551856
Sun 19 Jan 2014 12:13:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:13:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:13:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:13:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:13:14 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:13:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:13:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:13:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:13:16 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:13:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 12:13:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 12:13:16 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:13:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:13:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:13:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7903 values 124663 bits 15582 bytes 
Sun 19 Jan 2014 12:13:17 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:13:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:13:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:13:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:13:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:13:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:13:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:13:20 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:13:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:13:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:13:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:13:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:13:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:13:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:13:23 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:13:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 12:13:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:13:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:13:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43552604
Sun 19 Jan 2014 12:13:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:13:23 - job_xml_thread(): Done retrieving: data size 43552604
Sun 19 Jan 2014 12:13:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43552604
Sun 19 Jan 2014 12:13:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:13:24 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:13:24 - XML: Start document: iteration 5
Sun 19 Jan 2014 12:13:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:13:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:13:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:13:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:13:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:13:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:13:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:13:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:13:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:13:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:13:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:13:40 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:13:40 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:13:40 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:13:40 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:13:40 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:13:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:13:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:13:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:13:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:13:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:13:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:13:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:13:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:13:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:13:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557202
Sun 19 Jan 2014 12:13:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:13:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557202
Sun 19 Jan 2014 12:13:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:13:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:13:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:13:55 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:13:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:13:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:13:59 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:13:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:13:59 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:13:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:13:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:13:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:13:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:13:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:13:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:14:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:14:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:14:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:14:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:14:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:14:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:14:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:14:00 - job_xml_thread(): Done retrieving: data size 43584730
Sun 19 Jan 2014 12:14:00 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:14:00 - XML: Start document: iteration 6
Sun 19 Jan 2014 12:14:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584730
Sun 19 Jan 2014 12:14:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:14:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584730
Sun 19 Jan 2014 12:14:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:14:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:14:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:14:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:14:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:14:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:14:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:14:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:14:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:14:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:14:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:14:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:14:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:14:16 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:14:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:14:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 12:14:16 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:14:16 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:14:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6442 values 101597 bits 12699 bytes 
Sun 19 Jan 2014 12:14:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 12:14:21 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:14:21 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:14:21 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:14:21 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:14:21 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:14:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:14:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:14:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:14:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:14:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:14:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:14:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:14:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:14:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:14:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43552574
Sun 19 Jan 2014 12:14:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:14:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43552574
Sun 19 Jan 2014 12:14:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:14:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:14:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:14:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:14:36 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:14:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:14:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:14:36 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:14:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:14:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:14:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:14:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:14:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:14:39 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 12:14:39 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:14:39 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:14:39 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 12:14:39 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:14:39 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 12:14:39 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 12:14:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:14:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:14:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:14:41 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:14:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:14:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:14:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:14:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:14:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:14:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:14:41 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 800730 values 12620426 bits 1577553 bytes 
Sun 19 Jan 2014 12:14:42 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:14:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 12:14:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:14:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:14:45 - job_xml_thread(): Done retrieving: data size 43573752
Sun 19 Jan 2014 12:14:45 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:14:45 - XML: Start document: iteration 7
Sun 19 Jan 2014 12:14:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573752
Sun 19 Jan 2014 12:14:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:14:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573752
Sun 19 Jan 2014 12:14:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:14:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:14:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:14:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:14:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:15:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:15:01 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:15:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:15:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:15:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:15:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:15:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:15:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:15:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:15:04 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:15:04 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:15:04 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:15:04 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:15:04 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:15:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:15:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:15:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:15:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:15:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:15:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:15:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:15:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:15:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:15:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566628
Sun 19 Jan 2014 12:15:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:15:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566628
Sun 19 Jan 2014 12:15:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:15:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:15:17 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:15:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:15:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 12:15:18 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:15:18 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:15:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 12:15:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9141 values 144173 bits 18021 bytes 
Sun 19 Jan 2014 12:15:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:15:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:15:19 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:15:19 - job_xml_thread(): Done retrieving: data size 43566628
Sun 19 Jan 2014 12:15:19 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:15:19 - XML: Start document: iteration 8
Sun 19 Jan 2014 12:15:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:15:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:15:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:15:29 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:15:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:15:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:15:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:15:29 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:15:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:15:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:15:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:15:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:15:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:15:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:15:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:15:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:15:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:15:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:15:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:15:34 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:15:34 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:15:34 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:15:34 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:15:34 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:15:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:15:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559403
Sun 19 Jan 2014 12:15:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:15:38 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:15:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 12:15:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:15:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559403
Sun 19 Jan 2014 12:15:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:15:39 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:15:39 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 12:15:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:15:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:15:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:15:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:15:49 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:15:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:15:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:15:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:15:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:15:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:15:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:15:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:15:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:15:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:15:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:15:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:15:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:15:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:15:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:15:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:15:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:15:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:15:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:15:57 - job_xml_thread(): Done retrieving: data size 43565429
Sun 19 Jan 2014 12:15:57 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:15:57 - XML: Start document: iteration 9
Sun 19 Jan 2014 12:15:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565429
Sun 19 Jan 2014 12:15:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:15:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565429
Sun 19 Jan 2014 12:15:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:16:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:16:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:16:09 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:16:09 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:16:09 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:16:09 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:16:09 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:16:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:16:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:16:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:16:13 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:16:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:16:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:16:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:16:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:16:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:16:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:16:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:16:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:16:18 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:16:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:16:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:16:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:16:18 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:16:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:16:18 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:16:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 12:16:18 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:16:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 12:16:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99125 bits 12390 bytes 
Sun 19 Jan 2014 12:16:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:16:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:16:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:16:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:16:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:16:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571809
Sun 19 Jan 2014 12:16:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:16:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571809
Sun 19 Jan 2014 12:16:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:16:24 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:16:24 - job_xml_thread(): Done retrieving: data size 43571809
Sun 19 Jan 2014 12:16:24 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:16:24 - XML: Start document: iteration 10
Sun 19 Jan 2014 12:16:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:16:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:16:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:16:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:16:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:16:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:16:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:16:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:16:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:16:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:16:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:16:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:16:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:16:44 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:16:44 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:16:44 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:16:44 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:16:44 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:16:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:16:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:16:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:16:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:16:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:16:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:16:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:16:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:16:47 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:16:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 12:16:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:16:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:16:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579241
Sun 19 Jan 2014 12:16:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:16:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579241
Sun 19 Jan 2014 12:16:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:16:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:16:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:16:59 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:16:59 - job_xml_thread(): Done retrieving: data size 43579241
Sun 19 Jan 2014 12:16:59 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:16:59 - XML: Start document: iteration 11
Sun 19 Jan 2014 12:17:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:17:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:17:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:17:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:17:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:17:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:17:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:17:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:17:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:17:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:17:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:17:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:17:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:17:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:17:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:17:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:17:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:17:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:17:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:17:11 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:17:11 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:17:11 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:17:11 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:17:11 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:17:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:17:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43529716
Sun 19 Jan 2014 12:17:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:17:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43529716
Sun 19 Jan 2014 12:17:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:17:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:17:18 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:17:20 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:17:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:17:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 12:17:20 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:17:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 12:17:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8479 values 134184 bits 16773 bytes 
Sun 19 Jan 2014 12:17:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:17:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:17:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:17:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:17:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:17:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:17:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:17:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:17:26 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:17:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:17:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:17:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:17:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:17:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:17:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:17:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:17:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:17:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:17:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:17:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:17:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:17:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:17:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:17:34 - job_xml_thread(): Done retrieving: data size 43157637
Sun 19 Jan 2014 12:17:34 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:17:34 - XML: Start document: iteration 12
Sun 19 Jan 2014 12:17:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43157637
Sun 19 Jan 2014 12:17:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:17:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43157637
Sun 19 Jan 2014 12:17:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:17:38 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:17:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 12:17:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:17:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:17:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:17:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:17:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:17:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:17:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:17:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:17:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:17:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:17:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:17:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:17:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:17:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:17:50 - XML: Processed 648093 elements - found 0 jobs
Sun 19 Jan 2014 12:17:50 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:17:50 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:17:50 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:17:50 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:17:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:17:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:17:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:17:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:17:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:17:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:17:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:17:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:17:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:17:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42924072
Sun 19 Jan 2014 12:17:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:17:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42924072
Sun 19 Jan 2014 12:17:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:18:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:18:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:18:05 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:18:06 - job_xml_thread(): Done retrieving: data size 42924072
Sun 19 Jan 2014 12:18:06 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:18:06 - XML: Start document: iteration 13
Sun 19 Jan 2014 12:18:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:18:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:18:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:18:19 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:18:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:18:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:18:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:18:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:18:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:18:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:18:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:18:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:18:20 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:18:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:18:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 12:18:21 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:18:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 12:18:21 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:18:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6279 values 99366 bits 12420 bytes 
Sun 19 Jan 2014 12:18:23 - XML: Processed 645358 elements - found 0 jobs
Sun 19 Jan 2014 12:18:23 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:18:23 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:18:23 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:18:23 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:18:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:18:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:18:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:18:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:18:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:18:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:18:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:18:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:18:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:18:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42980539
Sun 19 Jan 2014 12:18:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:18:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42980539
Sun 19 Jan 2014 12:18:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:18:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:18:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:18:38 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:18:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:18:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:18:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:18:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:18:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:18:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:18:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:18:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:18:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:18:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:18:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:18:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:18:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:18:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:18:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:18:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:18:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:18:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:18:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:18:43 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:18:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 12:18:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:18:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:18:46 - job_xml_thread(): Done retrieving: data size 43478520
Sun 19 Jan 2014 12:18:46 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:18:46 - XML: Start document: iteration 14
Sun 19 Jan 2014 12:18:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43478520
Sun 19 Jan 2014 12:18:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:18:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43478520
Sun 19 Jan 2014 12:18:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:18:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:18:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:18:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:18:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:19:03 - XML: Processed 652012 elements - found 0 jobs
Sun 19 Jan 2014 12:19:03 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:19:03 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:19:03 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:19:03 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:19:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:19:06 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:19:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:19:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:19:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:19:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:19:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:19:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:19:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:19:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:19:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:19:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:19:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:19:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:19:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:19:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:19:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:19:10 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 12:19:10 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 12:19:10 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:19:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:19:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43585128
Sun 19 Jan 2014 12:19:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:19:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43585128
Sun 19 Jan 2014 12:19:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:19:19 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:19:19 - job_xml_thread(): Done retrieving: data size 43585128
Sun 19 Jan 2014 12:19:19 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:19:19 - XML: Start document: iteration 15
Sun 19 Jan 2014 12:19:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:19:22 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:19:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:19:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 12:19:22 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:19:22 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:19:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 12:19:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:19:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:19:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8868 values 139987 bits 17498 bytes 
Sun 19 Jan 2014 12:19:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:19:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:19:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:19:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:19:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:19:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:19:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:19:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:19:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:19:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:19:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:19:30 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:19:30 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:19:30 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:19:30 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:19:30 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:19:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:19:35 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:19:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:19:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:19:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:19:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:19:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:19:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:19:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:19:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43540600
Sun 19 Jan 2014 12:19:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:19:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43540600
Sun 19 Jan 2014 12:19:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:19:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:19:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:19:45 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:19:45 - job_xml_thread(): Done retrieving: data size 43540600
Sun 19 Jan 2014 12:19:45 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:19:45 - XML: Start document: iteration 16
Sun 19 Jan 2014 12:19:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:19:46 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:19:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:19:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:19:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:19:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:19:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:19:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:19:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:19:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:19:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:19:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:19:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:19:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:19:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:19:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:19:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:19:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:19:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:19:58 - XML: Processed 653349 elements - found 0 jobs
Sun 19 Jan 2014 12:19:58 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:19:58 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:19:58 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:19:58 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:19:58 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:19:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 12:19:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:20:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:20:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43551529
Sun 19 Jan 2014 12:20:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:20:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43551529
Sun 19 Jan 2014 12:20:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:20:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:20:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:20:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:20:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:20:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:20:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:20:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:20:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:20:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:20:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:20:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:20:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:20:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:20:13 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:20:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:20:15 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:20:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:20:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:20:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:20:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:20:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:20:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:20:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:20:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584312
Sun 19 Jan 2014 12:20:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:20:17 - job_xml_thread(): Done retrieving: data size 43584312
Sun 19 Jan 2014 12:20:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584312
Sun 19 Jan 2014 12:20:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:20:17 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:20:18 - XML: Start document: iteration 17
Sun 19 Jan 2014 12:20:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:20:23 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:20:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:20:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 12:20:26 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:20:26 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:20:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 12:20:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8939 values 141003 bits 17625 bytes 
Sun 19 Jan 2014 12:20:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:20:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:20:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:20:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:20:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:20:31 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:20:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:20:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:20:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:20:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:20:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:20:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:20:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:20:35 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:20:35 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:20:35 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:20:35 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:20:36 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:20:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:20:39 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:20:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:20:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:20:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:20:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:20:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:20:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:20:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:20:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560708
Sun 19 Jan 2014 12:20:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:20:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560708
Sun 19 Jan 2014 12:20:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:20:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:20:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:20:51 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:20:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:20:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:20:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:20:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:20:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:20:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:20:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:20:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:20:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:20:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:20:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:20:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:20:57 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:20:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:20:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:20:57 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:20:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 12:20:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:20:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:20:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:20:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:20:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:20:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:20:59 - job_xml_thread(): Done retrieving: data size 43581065
Sun 19 Jan 2014 12:20:59 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:20:59 - XML: Start document: iteration 18
Sun 19 Jan 2014 12:21:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581065
Sun 19 Jan 2014 12:21:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:21:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581065
Sun 19 Jan 2014 12:21:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:21:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:21:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:21:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:21:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:21:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:21:20 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:21:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:21:20 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:21:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:21:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:21:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:21:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:21:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:21:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:21:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:21:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:21:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:21:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:21:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:21:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:21:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:21:21 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:21:21 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:21:21 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:21:21 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:21:21 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:21:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:21:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577151
Sun 19 Jan 2014 12:21:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:21:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577151
Sun 19 Jan 2014 12:21:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:21:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:21:27 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:21:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:21:29 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:21:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 12:21:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 12:21:29 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:21:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8871 values 139939 bits 17492 bytes 
Sun 19 Jan 2014 12:21:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:21:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:21:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:21:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:21:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:21:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:21:36 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:21:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:21:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:21:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:21:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:21:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:21:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:21:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:21:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:21:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:21:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:21:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:21:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:21:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:21:39 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 12:21:39 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:21:40 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:21:40 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:21:40 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 12:21:40 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 12:21:40 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 12:21:41 - size of cluster 'LISA Cluster': 624 hosts 79473 metrics 788950 values 12450519 bits 1556314 bytes 
Sun 19 Jan 2014 12:21:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:21:42 - job_xml_thread(): Done retrieving: data size 43575807
Sun 19 Jan 2014 12:21:42 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:21:42 - XML: Start document: iteration 19
Sun 19 Jan 2014 12:21:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575807
Sun 19 Jan 2014 12:21:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:21:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575807
Sun 19 Jan 2014 12:21:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:21:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:21:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:21:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:21:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:21:54 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:21:54 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:21:54 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:21:54 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:21:54 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:22:01 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:22:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 12:22:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:22:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:22:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:22:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:22:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:22:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:22:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:22:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:22:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:22:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:22:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:22:05 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:22:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:22:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:22:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:22:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:22:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:22:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:22:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:22:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565717
Sun 19 Jan 2014 12:22:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:22:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565717
Sun 19 Jan 2014 12:22:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:22:09 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:22:10 - job_xml_thread(): Done retrieving: data size 43565717
Sun 19 Jan 2014 12:22:10 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:22:10 - XML: Start document: iteration 20
Sun 19 Jan 2014 12:22:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:22:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:22:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:22:18 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:22:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:22:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:22:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:22:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:22:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:22:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:22:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:22:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:22:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:22:29 - XML: Processed 653345 elements - found 0 jobs
Sun 19 Jan 2014 12:22:29 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:22:29 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:22:29 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:22:29 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:22:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:22:29 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:22:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:22:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 12:22:30 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:22:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5935 values 93629 bits 11703 bytes 
Sun 19 Jan 2014 12:22:30 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:22:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 12:22:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:22:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:22:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:22:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:22:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:22:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:22:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:22:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:22:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:22:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:22:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:22:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554593
Sun 19 Jan 2014 12:22:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:22:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554593
Sun 19 Jan 2014 12:22:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:22:40 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:22:40 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 12:22:44 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:22:44 - job_xml_thread(): Done retrieving: data size 43554593
Sun 19 Jan 2014 12:22:44 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:22:44 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 12:22:44 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 12:22:44 - Housekeeping: done.
Sun 19 Jan 2014 12:22:44 - XML: Start document: iteration 0
Sun 19 Jan 2014 12:22:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:22:46 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:22:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:22:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:22:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:22:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:22:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:22:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:22:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:22:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:22:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:22:55 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:22:55 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:22:55 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:22:55 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:22:55 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:22:56 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:22:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 12:22:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:22:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:22:59 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:22:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:22:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:23:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:23:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:23:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:23:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:23:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:23:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:23:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:23:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556248
Sun 19 Jan 2014 12:23:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:23:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556248
Sun 19 Jan 2014 12:23:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:23:10 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:23:10 - job_xml_thread(): Done retrieving: data size 43556248
Sun 19 Jan 2014 12:23:10 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:23:10 - XML: Start document: iteration 1
Sun 19 Jan 2014 12:23:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:23:13 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:23:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:23:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:23:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:23:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:23:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:23:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:23:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:23:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:23:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:23:20 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:23:20 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:23:20 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:23:20 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:23:20 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:23:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:23:24 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:23:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:23:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:23:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:23:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:23:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:23:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:23:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:23:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43477693
Sun 19 Jan 2014 12:23:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:23:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43477693
Sun 19 Jan 2014 12:23:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:23:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:23:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:23:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:23:30 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:23:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:23:30 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:23:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 12:23:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 12:23:30 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:23:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8591 values 135515 bits 16939 bytes 
Sun 19 Jan 2014 12:23:36 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:23:36 - job_xml_thread(): Done retrieving: data size 43477693
Sun 19 Jan 2014 12:23:36 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:23:36 - XML: Start document: iteration 2
Sun 19 Jan 2014 12:23:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:23:37 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:23:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:23:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:23:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:23:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:23:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:23:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:23:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:23:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:23:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:23:51 - XML: Processed 652600 elements - found 0 jobs
Sun 19 Jan 2014 12:23:51 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:23:51 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:23:51 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:23:51 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:23:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:23:52 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:23:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:23:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:23:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:23:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:23:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:23:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:23:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:23:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:23:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:23:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42942015
Sun 19 Jan 2014 12:23:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:23:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42942015
Sun 19 Jan 2014 12:23:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:24:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:24:04 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:24:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:24:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:24:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:24:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:24:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:24:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:24:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42942015
Sun 19 Jan 2014 12:24:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:24:07 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:24:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:24:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:24:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:24:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:24:13 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:24:14 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:24:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 12:24:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:24:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:24:17 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:24:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:24:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:24:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:24:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:24:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:24:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:24:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:24:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:24:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:24:20 - job_xml_thread(): Done retrieving: data size 42929434
Sun 19 Jan 2014 12:24:20 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:24:20 - XML: Start document: iteration 3
Sun 19 Jan 2014 12:24:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42929434
Sun 19 Jan 2014 12:24:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:24:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:24:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:24:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:24:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:24:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42929434
Sun 19 Jan 2014 12:24:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:24:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:24:30 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:24:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:24:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 12:24:32 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:24:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6105 values 96299 bits 12037 bytes 
Sun 19 Jan 2014 12:24:32 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:24:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:24:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 12:24:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:24:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:24:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:24:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:24:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:24:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:24:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:24:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:24:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:24:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:24:40 - XML: Processed 645520 elements - found 0 jobs
Sun 19 Jan 2014 12:24:40 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:24:40 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:24:40 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:24:41 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:24:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:24:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:24:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:24:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:24:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:24:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:24:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:24:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:24:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:24:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43454855
Sun 19 Jan 2014 12:24:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:24:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43454855
Sun 19 Jan 2014 12:24:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:24:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:24:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:24:56 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:24:56 - job_xml_thread(): Done retrieving: data size 43454855
Sun 19 Jan 2014 12:24:56 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:24:56 - XML: Start document: iteration 4
Sun 19 Jan 2014 12:24:56 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:24:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 12:24:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:24:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:24:57 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:24:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:24:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:24:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:24:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:24:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:24:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:24:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:25:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:25:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:25:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:25:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:25:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:25:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:25:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:25:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:25:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:25:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:25:10 - XML: Processed 651903 elements - found 0 jobs
Sun 19 Jan 2014 12:25:10 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:25:10 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:25:10 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:25:10 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:25:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:25:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43547653
Sun 19 Jan 2014 12:25:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:25:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43547653
Sun 19 Jan 2014 12:25:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:25:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:25:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:25:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:25:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:25:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:25:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:25:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:25:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:25:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:25:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:25:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:25:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:25:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:25:25 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:25:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:25:28 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:25:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:25:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:25:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:25:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:25:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:25:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:25:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:25:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576943
Sun 19 Jan 2014 12:25:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:25:31 - job_xml_thread(): Done retrieving: data size 43576943
Sun 19 Jan 2014 12:25:31 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:25:31 - XML: Start document: iteration 5
Sun 19 Jan 2014 12:25:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576943
Sun 19 Jan 2014 12:25:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:25:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:25:32 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:25:33 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:25:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:25:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 12:25:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 12:25:33 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:25:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7298 values 115141 bits 14392 bytes 
Sun 19 Jan 2014 12:25:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:25:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:25:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:25:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:25:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:25:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:25:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:25:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:25:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:25:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:25:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:25:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:25:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:25:53 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:25:54 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:25:54 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:25:54 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:25:54 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:25:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:25:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:25:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:25:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:25:55 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 12:25:55 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 12:25:55 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:25:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:25:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:25:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:25:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:25:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:25:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43546282
Sun 19 Jan 2014 12:25:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:25:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43546282
Sun 19 Jan 2014 12:25:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:25:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:25:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:26:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:26:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:26:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:26:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:26:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:26:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:26:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:26:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:26:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:26:09 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:26:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:26:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:26:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:26:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:26:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:26:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:26:12 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:26:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 12:26:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:26:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:26:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:26:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:26:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:26:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:26:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43589144
Sun 19 Jan 2014 12:26:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:26:14 - job_xml_thread(): Done retrieving: data size 43589144
Sun 19 Jan 2014 12:26:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43589144
Sun 19 Jan 2014 12:26:14 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:26:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:26:14 - XML: Start document: iteration 6
Sun 19 Jan 2014 12:26:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:26:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:26:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:26:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:26:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:26:28 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:26:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:26:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:26:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:26:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:26:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:26:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:26:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:26:31 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:26:31 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:26:31 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:26:31 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:26:31 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:26:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:26:33 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:26:33 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:26:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:26:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 12:26:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 12:26:33 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:26:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6117 values 96503 bits 12062 bytes 
Sun 19 Jan 2014 12:26:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:26:35 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:26:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:26:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:26:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:26:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:26:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:26:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:26:38 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:26:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 12:26:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:26:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:26:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553378
Sun 19 Jan 2014 12:26:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:26:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553378
Sun 19 Jan 2014 12:26:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:26:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:26:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:26:46 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:26:46 - job_xml_thread(): Done retrieving: data size 43553378
Sun 19 Jan 2014 12:26:46 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:26:46 - XML: Start document: iteration 7
Sun 19 Jan 2014 12:26:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:26:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:26:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:26:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:26:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:26:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:26:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:26:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:26:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:26:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:26:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:26:57 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:26:57 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:26:57 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:26:57 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:26:57 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:27:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:27:00 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:27:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:27:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:27:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:27:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:27:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:27:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:27:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:27:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579618
Sun 19 Jan 2014 12:27:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:27:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579618
Sun 19 Jan 2014 12:27:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:27:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:27:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:27:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:27:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:27:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:27:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:27:13 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:27:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:27:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:27:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:27:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:27:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:27:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:27:14 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:27:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:27:15 - job_xml_thread(): Done retrieving: data size 43590700
Sun 19 Jan 2014 12:27:15 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:27:15 - XML: Start document: iteration 8
Sun 19 Jan 2014 12:27:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:27:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:27:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43590700
Sun 19 Jan 2014 12:27:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:27:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:27:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:27:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:27:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:27:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43590700
Sun 19 Jan 2014 12:27:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:27:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:27:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:27:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:27:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:27:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:27:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:27:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:27:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:27:33 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:27:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:27:34 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:27:34 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:27:34 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:27:34 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:27:34 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:27:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:27:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:27:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:27:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:27:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:27:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:27:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 12:27:34 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:27:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 12:27:34 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:27:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9268 values 146157 bits 18269 bytes 
Sun 19 Jan 2014 12:27:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:27:39 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:27:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:27:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:27:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:27:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:27:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:27:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:27:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:27:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572516
Sun 19 Jan 2014 12:27:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:27:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572516
Sun 19 Jan 2014 12:27:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:27:49 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:27:49 - job_xml_thread(): Done retrieving: data size 43572516
Sun 19 Jan 2014 12:27:49 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:27:49 - XML: Start document: iteration 9
Sun 19 Jan 2014 12:27:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:27:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:27:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:27:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:27:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:27:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:27:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:27:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:27:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:27:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:27:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:27:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:27:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:27:59 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:27:59 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:27:59 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:27:59 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:27:59 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:28:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:28:03 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:28:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:28:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:28:03 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:28:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 12:28:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:28:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:28:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:28:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:28:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:28:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:28:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557611
Sun 19 Jan 2014 12:28:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:28:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557611
Sun 19 Jan 2014 12:28:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:28:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:28:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:28:14 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:28:14 - job_xml_thread(): Done retrieving: data size 43557611
Sun 19 Jan 2014 12:28:14 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:28:14 - XML: Start document: iteration 10
Sun 19 Jan 2014 12:28:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:28:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:28:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:28:20 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:28:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:28:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:28:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:28:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:28:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:28:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:28:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:28:24 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:28:24 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:28:24 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:28:24 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:28:24 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:28:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:28:27 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:28:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:28:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:28:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:28:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:28:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:28:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:28:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:28:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43585155
Sun 19 Jan 2014 12:28:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:28:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43585155
Sun 19 Jan 2014 12:28:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:28:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:28:35 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:28:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:28:36 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:28:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 12:28:36 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:28:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 12:28:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8630 values 136043 bits 17005 bytes 
Sun 19 Jan 2014 12:28:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:28:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:28:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:28:39 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:28:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:28:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:28:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:28:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:28:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:28:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:28:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:28:39 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:28:41 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 12:28:41 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:28:41 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:28:41 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 12:28:41 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:28:41 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 12:28:41 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 12:28:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:28:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:28:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:28:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:28:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:28:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:28:44 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 863403 values 13613780 bits 1701722 bytes 
Sun 19 Jan 2014 12:28:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:28:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:28:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:28:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:28:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:28:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580873
Sun 19 Jan 2014 12:28:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:28:48 - job_xml_thread(): Done retrieving: data size 43580873
Sun 19 Jan 2014 12:28:48 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:28:48 - XML: Start document: iteration 11
Sun 19 Jan 2014 12:28:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580873
Sun 19 Jan 2014 12:28:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:28:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:28:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:28:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:28:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:29:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:29:04 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:29:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:29:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:29:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:29:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:29:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:29:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:29:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:29:05 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:29:05 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:29:05 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:29:05 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:29:05 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:29:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:29:11 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:29:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:29:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:29:11 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:29:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 12:29:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:29:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:29:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:29:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:29:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:29:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:29:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43511860
Sun 19 Jan 2014 12:29:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:29:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43511860
Sun 19 Jan 2014 12:29:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:29:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:29:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:29:21 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:29:21 - job_xml_thread(): Done retrieving: data size 43511860
Sun 19 Jan 2014 12:29:21 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:29:21 - XML: Start document: iteration 12
Sun 19 Jan 2014 12:29:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:29:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:29:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:29:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:29:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:29:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:29:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:29:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:29:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43511860
Sun 19 Jan 2014 12:29:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:29:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:29:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:29:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:29:34 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:29:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:29:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:29:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:29:36 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:29:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:29:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:29:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:29:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:29:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:29:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:29:37 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:29:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 12:29:37 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:29:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 12:29:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5738 values 90470 bits 11308 bytes 
Sun 19 Jan 2014 12:29:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:29:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:29:41 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:29:41 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 12:29:42 - XML: Processed 652600 elements - found 0 jobs
Sun 19 Jan 2014 12:29:42 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:29:42 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:29:42 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:29:42 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:29:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:29:43 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:29:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:29:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:29:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:29:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:29:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:29:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:29:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:29:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43004816
Sun 19 Jan 2014 12:29:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:29:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43004816
Sun 19 Jan 2014 12:29:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:29:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:29:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:29:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:29:57 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:29:58 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:29:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:29:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:29:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:29:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:29:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:29:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:29:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:30:03 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:30:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 12:30:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:30:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:30:03 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:30:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:30:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:30:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:30:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:30:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:30:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:30:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:30:05 - job_xml_thread(): Done retrieving: data size 42895409
Sun 19 Jan 2014 12:30:05 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:30:05 - XML: Start document: iteration 13
Sun 19 Jan 2014 12:30:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42895409
Sun 19 Jan 2014 12:30:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:30:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42895409
Sun 19 Jan 2014 12:30:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:30:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:30:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:30:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:30:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:30:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:30:22 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:30:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:30:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:30:22 - XML: Processed 645148 elements - found 0 jobs
Sun 19 Jan 2014 12:30:22 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:30:22 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:30:22 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:30:22 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:30:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:30:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:30:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:30:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:30:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:30:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:30:28 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:30:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:30:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:30:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:30:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:30:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:30:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:30:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:30:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43038615
Sun 19 Jan 2014 12:30:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:30:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43038615
Sun 19 Jan 2014 12:30:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:30:37 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:30:37 - job_xml_thread(): Done retrieving: data size 43038615
Sun 19 Jan 2014 12:30:37 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:30:37 - XML: Start document: iteration 14
Sun 19 Jan 2014 12:30:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:30:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:30:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:30:38 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:30:39 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:30:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 12:30:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:30:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 12:30:39 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:30:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8804 values 138814 bits 17351 bytes 
Sun 19 Jan 2014 12:30:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:30:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:30:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:30:47 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:30:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:30:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:30:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:30:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:30:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:30:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:30:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:30:52 - XML: Processed 646532 elements - found 0 jobs
Sun 19 Jan 2014 12:30:53 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:30:53 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:30:53 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:30:53 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:30:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:30:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:30:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:30:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:30:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:30:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:30:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:30:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:30:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:30:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554131
Sun 19 Jan 2014 12:30:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:30:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554131
Sun 19 Jan 2014 12:30:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:31:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:31:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:31:08 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:31:08 - job_xml_thread(): Done retrieving: data size 43554131
Sun 19 Jan 2014 12:31:08 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:31:08 - XML: Start document: iteration 15
Sun 19 Jan 2014 12:31:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:31:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:31:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:31:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:31:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:31:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:31:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:31:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:31:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:31:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:31:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:31:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:31:18 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:31:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:31:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:31:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:31:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:31:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:31:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:31:21 - XML: Processed 653184 elements - found 0 jobs
Sun 19 Jan 2014 12:31:21 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:31:21 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:31:21 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:31:21 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:31:21 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:31:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 12:31:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:31:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:31:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559268
Sun 19 Jan 2014 12:31:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:31:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559268
Sun 19 Jan 2014 12:31:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:31:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:31:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:31:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:31:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:31:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:31:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:31:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:31:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:31:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:31:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:31:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:31:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:31:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:31:36 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:31:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:31:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:31:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:31:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:31:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:31:39 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:31:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:31:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:31:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:31:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:31:39 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:31:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:31:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 12:31:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 12:31:39 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:31:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5783 values 91347 bits 11418 bytes 
Sun 19 Jan 2014 12:31:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:31:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574347
Sun 19 Jan 2014 12:31:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:31:42 - job_xml_thread(): Done retrieving: data size 43574347
Sun 19 Jan 2014 12:31:42 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:31:42 - XML: Start document: iteration 16
Sun 19 Jan 2014 12:31:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574347
Sun 19 Jan 2014 12:31:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:31:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:31:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:31:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:31:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:32:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:32:00 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:32:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:32:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:32:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:32:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:32:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:32:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:32:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:32:03 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:32:03 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:32:03 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:32:03 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:32:03 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:32:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:32:04 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:32:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:32:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:32:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:32:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:32:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:32:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:32:06 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:32:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 12:32:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:32:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:32:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566322
Sun 19 Jan 2014 12:32:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:32:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566322
Sun 19 Jan 2014 12:32:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:32:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:32:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:32:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:32:18 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:32:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:32:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:32:18 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:32:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:32:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:32:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:32:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:32:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:32:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:32:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:32:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:32:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:32:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:32:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:32:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:32:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:32:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:32:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:32:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:32:25 - job_xml_thread(): Done retrieving: data size 43570972
Sun 19 Jan 2014 12:32:25 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:32:25 - XML: Start document: iteration 17
Sun 19 Jan 2014 12:32:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570972
Sun 19 Jan 2014 12:32:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:32:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570972
Sun 19 Jan 2014 12:32:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:32:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:32:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:32:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:32:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:32:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:32:40 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:32:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:32:42 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:32:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 12:32:42 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:32:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 12:32:43 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:32:43 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:32:43 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:32:44 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:32:44 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:32:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8220 values 130020 bits 16252 bytes 
Sun 19 Jan 2014 12:32:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:32:44 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:32:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:32:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:32:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:32:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:32:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:32:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:32:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:32:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:32:49 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:32:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:32:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:32:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:32:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:32:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:32:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:32:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:32:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562955
Sun 19 Jan 2014 12:32:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:32:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562955
Sun 19 Jan 2014 12:32:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:32:59 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:32:59 - job_xml_thread(): Done retrieving: data size 43562955
Sun 19 Jan 2014 12:32:59 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:32:59 - XML: Start document: iteration 18
Sun 19 Jan 2014 12:33:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:33:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:33:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:33:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:33:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:33:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:33:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:33:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:33:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:33:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:33:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:33:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:33:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:33:13 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:33:13 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:33:13 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:33:13 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:33:13 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:33:13 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:33:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 12:33:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:33:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:33:15 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:33:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:33:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:33:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:33:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:33:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:33:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:33:16 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 12:33:16 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 12:33:16 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:33:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:33:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43594227
Sun 19 Jan 2014 12:33:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:33:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43594227
Sun 19 Jan 2014 12:33:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:33:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:33:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:33:28 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:33:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:33:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:33:30 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:33:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:33:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:33:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:33:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:33:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:33:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:33:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:33:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:33:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:33:32 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:33:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:33:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:33:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:33:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:33:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:33:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:33:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:33:34 - job_xml_thread(): Done retrieving: data size 43566296
Sun 19 Jan 2014 12:33:34 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:33:34 - XML: Start document: iteration 19
Sun 19 Jan 2014 12:33:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566296
Sun 19 Jan 2014 12:33:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566296
Sun 19 Jan 2014 12:33:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:33:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:33:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:33:43 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:33:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:33:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 12:33:46 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:33:46 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:33:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9028 values 142624 bits 17828 bytes 
Sun 19 Jan 2014 12:33:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:33:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 12:33:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:33:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:33:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:33:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:33:53 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:33:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:33:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:33:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:33:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:33:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:33:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:33:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:33:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:33:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:33:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:33:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:33:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:33:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:33:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:33:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:33:56 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:33:56 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:33:56 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:33:56 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:33:56 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:33:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:33:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43599513
Sun 19 Jan 2014 12:33:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:33:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43599513
Sun 19 Jan 2014 12:33:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:34:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:34:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:34:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:34:11 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:34:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:34:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:34:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:34:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:34:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:34:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:34:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:34:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:34:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:34:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:34:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:34:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:34:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:34:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:34:14 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:34:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 12:34:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:34:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:34:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:34:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:34:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:34:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:34:15 - job_xml_thread(): Done retrieving: data size 43598277
Sun 19 Jan 2014 12:34:15 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:34:15 - XML: Start document: iteration 20
Sun 19 Jan 2014 12:34:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43598277
Sun 19 Jan 2014 12:34:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:34:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43598277
Sun 19 Jan 2014 12:34:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:34:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:34:27 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:34:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:34:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:34:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:34:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:34:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:34:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:34:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:34:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:34:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:34:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:34:35 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:34:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:34:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:34:37 - XML: Processed 653349 elements - found 0 jobs
Sun 19 Jan 2014 12:34:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:34:37 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:34:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:34:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:34:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:34:37 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:34:37 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:34:37 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:34:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:34:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555676
Sun 19 Jan 2014 12:34:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:34:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555676
Sun 19 Jan 2014 12:34:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:34:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:34:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:34:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:34:47 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:34:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:34:48 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:34:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 12:34:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 12:34:48 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:34:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9226 values 145559 bits 18194 bytes 
Sun 19 Jan 2014 12:34:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:34:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:34:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:34:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:34:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:34:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:34:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:34:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:34:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:34:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:34:52 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:34:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:34:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:34:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:34:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:34:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:34:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:34:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:34:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:34:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:34:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:34:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43586653
Sun 19 Jan 2014 12:34:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:34:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43586653
Sun 19 Jan 2014 12:34:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:34:57 - job_xml_thread(): Done retrieving: data size 43586653
Sun 19 Jan 2014 12:34:58 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:34:58 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 12:34:58 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 12:34:58 - Housekeeping: done.
Sun 19 Jan 2014 12:34:59 - XML: Start document: iteration 0
Sun 19 Jan 2014 12:35:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:35:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:35:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:35:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:35:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:35:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:35:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:35:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:35:17 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:35:17 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:35:17 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:35:17 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:35:17 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:35:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:35:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:35:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:35:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:35:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:35:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:35:19 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:35:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:35:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:35:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:35:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:35:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:35:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:35:20 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:35:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 12:35:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:35:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:35:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43497824
Sun 19 Jan 2014 12:35:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:35:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43497824
Sun 19 Jan 2014 12:35:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:35:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:35:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:35:32 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:35:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:35:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:35:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:35:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:35:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:35:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:35:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:35:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:35:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:35:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:35:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:35:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:35:37 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:35:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:35:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:35:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:35:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:35:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:35:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:35:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:35:39 - job_xml_thread(): Done retrieving: data size 42993641
Sun 19 Jan 2014 12:35:39 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:35:39 - XML: Start document: iteration 1
Sun 19 Jan 2014 12:35:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42993641
Sun 19 Jan 2014 12:35:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:35:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42993641
Sun 19 Jan 2014 12:35:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:35:41 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 12:35:43 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:35:45 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:35:45 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:35:45 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 12:35:45 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 12:35:45 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 12:35:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:35:48 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:35:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:35:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 12:35:49 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:35:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8830 values 139248 bits 17406 bytes 
Sun 19 Jan 2014 12:35:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:35:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:35:50 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:35:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 12:35:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:35:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:35:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:35:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:35:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:35:56 - size of cluster 'LISA Cluster': 624 hosts 79466 metrics 773096 values 12205192 bits 1525649 bytes 
Sun 19 Jan 2014 12:35:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:35:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:35:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:35:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:35:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:35:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:36:02 - XML: Processed 646296 elements - found 0 jobs
Sun 19 Jan 2014 12:36:02 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:36:02 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:36:02 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:36:02 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:36:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:36:04 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:36:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:36:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:36:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:36:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:36:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:36:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:36:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:36:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42896651
Sun 19 Jan 2014 12:36:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:36:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42896651
Sun 19 Jan 2014 12:36:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:36:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:36:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:36:17 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:36:17 - job_xml_thread(): Done retrieving: data size 42896651
Sun 19 Jan 2014 12:36:17 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:36:17 - XML: Start document: iteration 2
Sun 19 Jan 2014 12:36:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:36:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:36:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:36:20 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:36:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:36:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:36:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:36:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:36:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:36:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:36:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:36:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:36:28 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:36:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:36:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:36:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:36:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:36:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:36:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:36:30 - XML: Processed 645150 elements - found 0 jobs
Sun 19 Jan 2014 12:36:30 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:36:30 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:36:30 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:36:30 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:36:30 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:36:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 12:36:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:36:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:36:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43222290
Sun 19 Jan 2014 12:36:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:36:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43222290
Sun 19 Jan 2014 12:36:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:36:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:36:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:36:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:36:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:36:45 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:36:45 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 12:36:45 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:36:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:36:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:36:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:36:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:36:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:36:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:36:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:36:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:36:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:36:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:36:49 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:36:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:36:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:36:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:36:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:36:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:36:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:36:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:36:50 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:36:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:36:51 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:36:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 12:36:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 12:36:51 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:36:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5593 values 88172 bits 11021 bytes 
Sun 19 Jan 2014 12:36:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:36:52 - job_xml_thread(): Done retrieving: data size 43535318
Sun 19 Jan 2014 12:36:52 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:36:52 - XML: Start document: iteration 3
Sun 19 Jan 2014 12:36:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43535318
Sun 19 Jan 2014 12:36:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:36:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43535318
Sun 19 Jan 2014 12:36:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:37:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:37:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:37:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:37:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:37:07 - XML: Processed 652972 elements - found 0 jobs
Sun 19 Jan 2014 12:37:07 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:37:07 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:37:07 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:37:07 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:37:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:37:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:37:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:37:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:37:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:37:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:37:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:37:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:37:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:37:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:37:17 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:37:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:37:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:37:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:37:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:37:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:37:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:37:20 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:37:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 12:37:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:37:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:37:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568300
Sun 19 Jan 2014 12:37:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:37:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568300
Sun 19 Jan 2014 12:37:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:37:22 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:37:22 - job_xml_thread(): Done retrieving: data size 43568300
Sun 19 Jan 2014 12:37:22 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:37:22 - XML: Start document: iteration 4
Sun 19 Jan 2014 12:37:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:37:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:37:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:37:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:37:37 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:37:37 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:37:37 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:37:37 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:37:37 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:37:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:37:39 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:37:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:37:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:37:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:37:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:37:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:37:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:37:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:37:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:37:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:37:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:37:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:37:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:37:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:37:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:37:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:37:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:37:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578699
Sun 19 Jan 2014 12:37:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:37:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578699
Sun 19 Jan 2014 12:37:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:37:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:37:51 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:37:52 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:37:52 - job_xml_thread(): Done retrieving: data size 43578699
Sun 19 Jan 2014 12:37:52 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:37:52 - XML: Start document: iteration 5
Sun 19 Jan 2014 12:37:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:37:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 12:37:53 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:37:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7042 values 111087 bits 13885 bytes 
Sun 19 Jan 2014 12:37:54 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:37:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 12:37:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:37:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:37:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:37:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:38:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:38:06 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:38:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:38:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:38:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:38:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:38:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:38:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:38:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:38:08 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:38:08 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:38:08 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:38:08 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:38:08 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:38:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:38:11 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:38:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:38:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:38:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:38:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:38:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:38:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:38:15 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:38:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 12:38:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:38:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:38:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584254
Sun 19 Jan 2014 12:38:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:38:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584254
Sun 19 Jan 2014 12:38:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:38:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:38:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:38:23 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:38:23 - job_xml_thread(): Done retrieving: data size 43584254
Sun 19 Jan 2014 12:38:23 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:38:23 - XML: Start document: iteration 6
Sun 19 Jan 2014 12:38:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:38:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:38:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:38:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:38:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:38:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:38:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:38:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:38:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:38:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:38:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:38:34 - XML: Processed 653347 elements - found 0 jobs
Sun 19 Jan 2014 12:38:34 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:38:34 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:38:34 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:38:34 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:38:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:38:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:38:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:38:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:38:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:38:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:38:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:38:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:38:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:38:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554759
Sun 19 Jan 2014 12:38:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:38:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554759
Sun 19 Jan 2014 12:38:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:38:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:38:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:38:49 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:38:49 - job_xml_thread(): Done retrieving: data size 43554759
Sun 19 Jan 2014 12:38:49 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:38:49 - XML: Start document: iteration 7
Sun 19 Jan 2014 12:38:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:38:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:38:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:38:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:38:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:38:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:38:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554759
Sun 19 Jan 2014 12:38:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:38:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:38:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:38:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:38:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:38:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:38:54 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:38:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:38:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 12:38:54 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:38:54 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:38:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 12:38:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99074 bits 12384 bytes 
Sun 19 Jan 2014 12:39:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:39:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:39:09 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:39:09 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:39:09 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:39:09 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:39:09 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:39:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:39:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:39:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:39:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:39:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:39:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:39:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:39:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:39:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:39:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:39:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:39:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:39:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:39:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:39:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:39:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:39:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:39:16 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:39:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 12:39:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:39:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:39:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43597086
Sun 19 Jan 2014 12:39:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:39:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43597086
Sun 19 Jan 2014 12:39:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:39:24 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:39:24 - job_xml_thread(): Done retrieving: data size 43597086
Sun 19 Jan 2014 12:39:24 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:39:24 - XML: Start document: iteration 8
Sun 19 Jan 2014 12:39:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:39:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:39:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:39:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:39:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:39:30 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:39:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:39:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:39:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:39:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:39:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:39:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:39:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:39:34 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:39:34 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:39:34 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:39:34 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:39:34 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:39:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:39:39 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:39:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:39:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:39:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:39:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:39:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:39:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:39:41 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 12:39:41 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 12:39:41 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:39:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:39:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562234
Sun 19 Jan 2014 12:39:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:39:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562234
Sun 19 Jan 2014 12:39:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:39:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:39:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:39:49 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:39:50 - job_xml_thread(): Done retrieving: data size 43562234
Sun 19 Jan 2014 12:39:50 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:39:50 - XML: Start document: iteration 9
Sun 19 Jan 2014 12:39:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:39:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:39:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:39:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:39:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:39:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:39:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562234
Sun 19 Jan 2014 12:39:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:39:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:39:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:39:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:39:54 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:39:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:39:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:39:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:39:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 12:39:56 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:39:56 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:39:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 12:39:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99094 bits 12386 bytes 
Sun 19 Jan 2014 12:40:04 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:40:04 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:40:04 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:40:04 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:40:04 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:40:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:40:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:40:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:40:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:40:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:40:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:40:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:40:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:40:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:40:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:40:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:40:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:40:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:40:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:40:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:40:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:40:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:40:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:40:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:40:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:40:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43592370
Sun 19 Jan 2014 12:40:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:40:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43592370
Sun 19 Jan 2014 12:40:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:40:20 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:40:20 - job_xml_thread(): Done retrieving: data size 43592370
Sun 19 Jan 2014 12:40:20 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:40:20 - XML: Start document: iteration 10
Sun 19 Jan 2014 12:40:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:40:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:40:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:40:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:40:33 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:40:33 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:40:33 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:40:33 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:40:33 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:40:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:40:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:40:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:40:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:40:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:40:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:40:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:40:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:40:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:40:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:40:37 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:40:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:40:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:40:38 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:40:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 12:40:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:40:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:40:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:40:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:40:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:40:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:40:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584147
Sun 19 Jan 2014 12:40:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:40:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584147
Sun 19 Jan 2014 12:40:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:40:49 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:40:49 - job_xml_thread(): Done retrieving: data size 43584147
Sun 19 Jan 2014 12:40:49 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:40:49 - XML: Start document: iteration 11
Sun 19 Jan 2014 12:40:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:40:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:40:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:40:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:40:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:40:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:40:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:40:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:40:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:40:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:40:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:40:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:40:56 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:40:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:40:58 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:40:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 12:40:58 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:40:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 12:40:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5950 values 93847 bits 11730 bytes 
Sun 19 Jan 2014 12:40:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:40:59 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:40:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:40:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:41:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:41:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:41:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:41:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:41:02 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:41:02 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:41:02 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:41:02 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:41:02 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:41:04 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:41:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 12:41:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:41:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:41:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43542756
Sun 19 Jan 2014 12:41:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:41:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43542756
Sun 19 Jan 2014 12:41:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:41:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:41:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:41:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:41:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:41:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:41:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:41:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:41:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:41:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:41:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:41:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:41:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:41:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:41:17 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:41:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:41:19 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:41:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:41:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:41:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:41:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:41:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:41:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:41:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:41:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43499383
Sun 19 Jan 2014 12:41:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:41:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43499383
Sun 19 Jan 2014 12:41:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:41:21 - job_xml_thread(): Done retrieving: data size 43499383
Sun 19 Jan 2014 12:41:21 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:41:21 - XML: Start document: iteration 12
Sun 19 Jan 2014 12:41:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:41:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:41:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:41:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:41:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:41:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:41:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:41:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:41:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:41:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:41:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:41:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:41:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:41:38 - XML: Processed 652600 elements - found 0 jobs
Sun 19 Jan 2014 12:41:38 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:41:38 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:41:38 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:41:38 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:41:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:41:42 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:41:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:41:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:41:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:41:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:41:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:41:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:41:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:41:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43016853
Sun 19 Jan 2014 12:41:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:41:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43016853
Sun 19 Jan 2014 12:41:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:41:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:41:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:41:53 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:41:53 - job_xml_thread(): Done retrieving: data size 43016853
Sun 19 Jan 2014 12:41:53 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:41:53 - XML: Start document: iteration 13
Sun 19 Jan 2014 12:41:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:41:54 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:41:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:41:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:41:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:41:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:41:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:41:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:41:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:41:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:41:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:41:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:41:58 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:41:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:41:59 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:41:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 12:41:59 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:41:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 12:42:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9268 values 146143 bits 18267 bytes 
Sun 19 Jan 2014 12:42:02 - XML: Processed 646532 elements - found 0 jobs
Sun 19 Jan 2014 12:42:02 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:42:02 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:42:02 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:42:02 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:42:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:42:04 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:42:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:42:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:42:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:42:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:42:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:42:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:42:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:42:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42883619
Sun 19 Jan 2014 12:42:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:42:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42883619
Sun 19 Jan 2014 12:42:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:42:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:42:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:42:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:42:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:42:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:42:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:42:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:42:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:42:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:42:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:42:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:42:17 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:42:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:42:19 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:42:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:42:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:42:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:42:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:42:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:42:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:42:20 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:42:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 12:42:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:42:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:42:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42967072
Sun 19 Jan 2014 12:42:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:42:22 - job_xml_thread(): Done retrieving: data size 42967072
Sun 19 Jan 2014 12:42:22 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:42:22 - XML: Start document: iteration 14
Sun 19 Jan 2014 12:42:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42967072
Sun 19 Jan 2014 12:42:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:42:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:42:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:42:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:42:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:42:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:42:39 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:42:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:42:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:42:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:42:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:42:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:42:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:42:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:42:44 - XML: Processed 645896 elements - found 0 jobs
Sun 19 Jan 2014 12:42:44 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:42:44 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:42:45 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:42:45 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:42:45 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 12:42:45 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:42:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:42:45 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:42:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:42:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:42:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:42:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:42:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:42:46 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:42:46 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 12:42:46 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 12:42:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:42:46 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:42:46 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 12:42:47 - size of cluster 'LISA Cluster': 624 hosts 79485 metrics 847346 values 13354486 bits 1669310 bytes 
Sun 19 Jan 2014 12:42:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:42:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43489460
Sun 19 Jan 2014 12:42:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:42:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43489460
Sun 19 Jan 2014 12:42:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:42:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:42:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:42:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:43:00 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:43:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:43:00 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:43:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:43:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 12:43:00 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:43:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 12:43:00 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:43:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7996 values 126124 bits 15765 bytes 
Sun 19 Jan 2014 12:43:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:43:01 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:43:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:43:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:43:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:43:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:43:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:43:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:43:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:43:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:43:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:43:05 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:43:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:43:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:43:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:43:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:43:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:43:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:43:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:43:08 - job_xml_thread(): Done retrieving: data size 43554327
Sun 19 Jan 2014 12:43:08 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:43:08 - XML: Start document: iteration 15
Sun 19 Jan 2014 12:43:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554327
Sun 19 Jan 2014 12:43:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:43:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554327
Sun 19 Jan 2014 12:43:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:43:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:43:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:43:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:43:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:43:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:43:25 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:43:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:43:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:43:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:43:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:43:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:43:26 - XML: Processed 653338 elements - found 0 jobs
Sun 19 Jan 2014 12:43:26 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:43:26 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:43:26 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:43:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:43:26 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:43:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:43:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:43:31 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:43:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:43:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:43:31 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:43:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 12:43:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:43:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:43:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:43:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:43:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:43:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:43:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43550246
Sun 19 Jan 2014 12:43:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:43:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43550246
Sun 19 Jan 2014 12:43:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:43:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:43:41 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:43:41 - job_xml_thread(): Done retrieving: data size 43550246
Sun 19 Jan 2014 12:43:41 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:43:41 - XML: Start document: iteration 16
Sun 19 Jan 2014 12:43:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:43:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:43:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:43:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:43:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:43:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:43:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:43:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:43:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:43:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:43:46 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:43:46 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 12:43:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:43:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:43:51 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:43:51 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:43:51 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:43:51 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:43:51 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:43:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:43:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:43:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:43:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:43:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:43:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:43:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:43:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:43:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:43:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43547251
Sun 19 Jan 2014 12:43:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:43:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43547251
Sun 19 Jan 2014 12:43:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:43:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:43:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:44:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:44:00 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:44:01 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:44:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:44:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 12:44:01 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:44:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8711 values 137338 bits 17167 bytes 
Sun 19 Jan 2014 12:44:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 12:44:06 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:44:06 - job_xml_thread(): Done retrieving: data size 43547251
Sun 19 Jan 2014 12:44:06 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:44:06 - XML: Start document: iteration 17
Sun 19 Jan 2014 12:44:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:44:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:44:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:44:20 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:44:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:44:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:44:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:44:20 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:44:21 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:44:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:44:21 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:44:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:44:21 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:44:21 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:44:21 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:44:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:44:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:44:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:44:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:44:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:44:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:44:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:44:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:44:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:44:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:44:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581343
Sun 19 Jan 2014 12:44:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:44:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581343
Sun 19 Jan 2014 12:44:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:44:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:44:36 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:44:36 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:44:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:44:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:44:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:44:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:44:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:44:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:44:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:44:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:44:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:44:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:44:41 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:44:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:44:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:44:41 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:44:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 12:44:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:44:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:44:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:44:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:44:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:44:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:44:44 - job_xml_thread(): Done retrieving: data size 43576379
Sun 19 Jan 2014 12:44:44 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:44:44 - XML: Start document: iteration 18
Sun 19 Jan 2014 12:44:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576379
Sun 19 Jan 2014 12:44:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576379
Sun 19 Jan 2014 12:44:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:44:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:44:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:44:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:44:57 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:44:57 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:44:57 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:44:57 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:44:57 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:44:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:44:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:45:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:45:01 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:45:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:45:01 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:45:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 12:45:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 12:45:01 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:45:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5902 values 93071 bits 11633 bytes 
Sun 19 Jan 2014 12:45:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:45:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:45:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:45:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:45:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:45:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:45:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:45:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:45:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:45:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:45:07 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:45:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:45:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:45:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:45:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:45:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:45:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:45:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:45:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572330
Sun 19 Jan 2014 12:45:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:45:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572330
Sun 19 Jan 2014 12:45:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:45:12 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:45:12 - job_xml_thread(): Done retrieving: data size 43572330
Sun 19 Jan 2014 12:45:12 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:45:12 - XML: Start document: iteration 19
Sun 19 Jan 2014 12:45:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:45:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:45:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:45:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:45:24 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:45:24 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:45:24 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:45:24 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:45:24 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:45:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:45:29 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:45:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:45:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:45:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:45:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:45:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:45:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:45:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:45:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:45:34 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:45:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:45:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:45:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:45:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:45:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:45:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:45:34 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:45:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 12:45:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:45:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:45:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564989
Sun 19 Jan 2014 12:45:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:45:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564989
Sun 19 Jan 2014 12:45:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:45:39 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:45:39 - job_xml_thread(): Done retrieving: data size 43564989
Sun 19 Jan 2014 12:45:39 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:45:39 - XML: Start document: iteration 20
Sun 19 Jan 2014 12:45:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:45:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:45:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:45:47 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:45:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:45:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:45:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:45:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:45:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:45:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:45:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:45:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:45:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:45:51 - XML: Processed 653347 elements - found 0 jobs
Sun 19 Jan 2014 12:45:51 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:45:51 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:45:51 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:45:51 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:45:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:45:58 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:45:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:45:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:45:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:45:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:45:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:45:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:46:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:46:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564652
Sun 19 Jan 2014 12:46:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:46:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:46:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564652
Sun 19 Jan 2014 12:46:01 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:46:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:46:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:46:02 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:46:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 12:46:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 12:46:02 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:46:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8595 values 135576 bits 16947 bytes 
Sun 19 Jan 2014 12:46:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:46:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:46:06 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:46:06 - job_xml_thread(): Done retrieving: data size 43564652
Sun 19 Jan 2014 12:46:06 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:46:06 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 12:46:06 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 12:46:06 - Housekeeping: done.
Sun 19 Jan 2014 12:46:06 - XML: Start document: iteration 0
Sun 19 Jan 2014 12:46:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:46:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:46:19 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:46:19 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:46:19 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:46:19 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:46:19 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:46:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:46:21 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:46:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:46:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:46:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:46:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:46:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:46:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:46:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:46:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:46:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:46:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:46:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:46:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:46:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:46:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:46:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:46:25 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:46:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 12:46:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:46:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:46:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43586484
Sun 19 Jan 2014 12:46:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:46:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43586484
Sun 19 Jan 2014 12:46:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:46:34 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:46:34 - job_xml_thread(): Done retrieving: data size 43586484
Sun 19 Jan 2014 12:46:34 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:46:34 - XML: Start document: iteration 1
Sun 19 Jan 2014 12:46:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:46:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:46:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:46:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:46:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:46:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:46:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:46:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:46:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:46:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:46:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:46:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:46:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:46:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:46:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:46:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:46:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:46:46 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:46:46 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:46:46 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:46:46 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:46:46 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:46:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:46:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:46:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:46:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:46:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:46:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580147
Sun 19 Jan 2014 12:46:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:46:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580147
Sun 19 Jan 2014 12:46:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:46:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:46:57 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:46:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:46:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:46:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:46:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:46:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:46:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:46:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580147
Sun 19 Jan 2014 12:46:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:47:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:47:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:47:02 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:47:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:47:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:47:02 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:47:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:47:03 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:47:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 12:47:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 12:47:03 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:47:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99330 bits 12416 bytes 
Sun 19 Jan 2014 12:47:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:47:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:47:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:47:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:47:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:47:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:47:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:47:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:47:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:47:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:47:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:47:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:47:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:47:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:47:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:47:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:47:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:47:15 - job_xml_thread(): Done retrieving: data size 43561220
Sun 19 Jan 2014 12:47:15 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:47:15 - XML: Start document: iteration 2
Sun 19 Jan 2014 12:47:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561220
Sun 19 Jan 2014 12:47:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:47:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561220
Sun 19 Jan 2014 12:47:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:47:20 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:47:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 12:47:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:47:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:47:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:47:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:47:25 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:47:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:47:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:47:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:47:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:47:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:47:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:47:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:47:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:47:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:47:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:47:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:47:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:47:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:47:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:47:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:47:35 - XML: Processed 653318 elements - found 0 jobs
Sun 19 Jan 2014 12:47:35 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:47:35 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:47:35 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:47:35 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:47:37 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 12:47:37 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 12:47:37 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:47:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:47:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43012074
Sun 19 Jan 2014 12:47:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:47:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43012074
Sun 19 Jan 2014 12:47:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:47:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:47:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:47:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:47:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:47:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:47:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:47:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:47:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:47:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:47:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:47:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:47:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:47:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:47:50 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:47:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:47:52 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:47:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:47:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:47:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:47:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:47:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:47:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:47:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:47:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42911679
Sun 19 Jan 2014 12:47:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:47:54 - job_xml_thread(): Done retrieving: data size 42911679
Sun 19 Jan 2014 12:47:54 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:47:54 - XML: Start document: iteration 3
Sun 19 Jan 2014 12:47:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42911679
Sun 19 Jan 2014 12:47:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:48:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:48:03 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:48:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:48:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:48:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:48:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 12:48:05 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:48:05 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:48:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 12:48:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9383 values 148430 bits 18553 bytes 
Sun 19 Jan 2014 12:48:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:48:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:48:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:48:14 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:48:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:48:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:48:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:48:15 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:48:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:48:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:48:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:48:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:48:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:48:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:48:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:48:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:48:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:48:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:48:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:48:17 - XML: Processed 645204 elements - found 0 jobs
Sun 19 Jan 2014 12:48:17 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:48:17 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:48:17 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:48:17 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:48:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:48:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42968578
Sun 19 Jan 2014 12:48:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:48:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42968578
Sun 19 Jan 2014 12:48:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:48:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:48:28 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:48:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:48:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:48:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:48:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:48:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:48:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:48:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:48:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:48:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:48:32 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:48:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:48:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:48:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:48:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:48:33 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:48:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 12:48:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:48:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:48:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:48:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:48:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:48:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:48:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43146538
Sun 19 Jan 2014 12:48:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:48:35 - job_xml_thread(): Done retrieving: data size 43146538
Sun 19 Jan 2014 12:48:35 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:48:35 - XML: Start document: iteration 4
Sun 19 Jan 2014 12:48:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43146538
Sun 19 Jan 2014 12:48:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:48:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:48:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:48:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:48:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:48:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:48:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:48:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:48:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:48:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:48:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:48:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:48:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:48:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:48:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:48:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:48:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:48:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:48:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:48:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:48:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:48:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:48:57 - XML: Processed 647928 elements - found 0 jobs
Sun 19 Jan 2014 12:48:57 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:48:57 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:48:57 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:48:57 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:48:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:48:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43545027
Sun 19 Jan 2014 12:48:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:48:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43545027
Sun 19 Jan 2014 12:48:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:49:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:49:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:49:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:49:05 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:49:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:49:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 12:49:06 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:49:06 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:49:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 12:49:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9204 values 145333 bits 18166 bytes 
Sun 19 Jan 2014 12:49:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:49:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:49:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:49:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:49:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:49:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:49:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:49:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:49:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:49:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:49:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:49:12 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:49:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:49:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:49:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:49:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:49:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:49:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:49:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:49:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:49:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:49:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577365
Sun 19 Jan 2014 12:49:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:49:16 - job_xml_thread(): Done retrieving: data size 43577365
Sun 19 Jan 2014 12:49:16 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:49:16 - XML: Start document: iteration 5
Sun 19 Jan 2014 12:49:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577365
Sun 19 Jan 2014 12:49:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:49:22 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:49:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 12:49:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:49:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:49:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:49:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:49:28 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:49:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:49:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:49:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:49:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:49:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:49:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:49:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:49:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:49:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:49:34 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:49:35 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:49:35 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:49:35 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:49:35 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:49:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:49:39 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:49:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:49:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:49:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:49:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:49:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:49:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:49:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:49:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43543311
Sun 19 Jan 2014 12:49:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:49:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43543311
Sun 19 Jan 2014 12:49:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:49:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:49:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:49:46 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 12:49:46 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:49:47 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:49:47 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 12:49:47 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 12:49:47 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:49:47 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 12:49:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:49:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:49:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:49:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:49:50 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:49:50 - job_xml_thread(): Done retrieving: data size 43543311
Sun 19 Jan 2014 12:49:50 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:49:50 - XML: Start document: iteration 6
Sun 19 Jan 2014 12:49:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:49:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:49:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:49:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:49:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:49:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:49:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:50:01 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:50:01 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:50:01 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:50:01 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:50:01 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:50:02 - size of cluster 'LISA Cluster': 624 hosts 79477 metrics 785977 values 12414091 bits 1551761 bytes 
Sun 19 Jan 2014 12:50:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:50:04 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:50:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:50:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:50:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:50:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:50:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:50:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:50:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:50:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43550329
Sun 19 Jan 2014 12:50:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:50:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:50:06 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:50:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43550329
Sun 19 Jan 2014 12:50:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:50:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:50:08 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:50:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 12:50:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 12:50:08 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:50:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9355 values 147605 bits 18450 bytes 
Sun 19 Jan 2014 12:50:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:50:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:50:16 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:50:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:50:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:50:18 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:50:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:50:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:50:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:50:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:50:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:50:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:50:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:50:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:50:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:50:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:50:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:50:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:50:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:50:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:50:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:50:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:50:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:50:25 - job_xml_thread(): Done retrieving: data size 43558192
Sun 19 Jan 2014 12:50:25 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:50:25 - XML: Start document: iteration 7
Sun 19 Jan 2014 12:50:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558192
Sun 19 Jan 2014 12:50:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:50:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558192
Sun 19 Jan 2014 12:50:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:50:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:50:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:50:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:50:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:50:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:50:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:50:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:50:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:50:47 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:50:47 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:50:47 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:50:47 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:50:47 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:50:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:50:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:50:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:50:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:50:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:50:47 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:50:47 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 12:50:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:50:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:50:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:50:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:50:49 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:50:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 12:50:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:50:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:50:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:50:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:50:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:50:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:50:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570651
Sun 19 Jan 2014 12:50:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:50:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570651
Sun 19 Jan 2014 12:50:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:51:02 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:51:02 - job_xml_thread(): Done retrieving: data size 43570651
Sun 19 Jan 2014 12:51:02 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:51:02 - XML: Start document: iteration 8
Sun 19 Jan 2014 12:51:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:51:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:51:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:51:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:51:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:51:08 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:51:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:51:08 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:51:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 12:51:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 12:51:08 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:51:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5893 values 92955 bits 11619 bytes 
Sun 19 Jan 2014 12:51:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:51:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:51:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:51:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:51:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:51:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:51:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:51:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:51:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:51:16 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:51:16 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:51:16 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:51:16 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:51:16 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:51:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:51:16 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:51:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:51:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:51:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:51:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:51:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:51:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:51:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:51:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573669
Sun 19 Jan 2014 12:51:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:51:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573669
Sun 19 Jan 2014 12:51:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:51:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:51:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:51:31 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:51:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:51:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:51:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:51:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:51:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:51:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:51:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:51:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:51:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:51:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:51:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:51:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:51:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:51:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:51:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:51:36 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:51:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 12:51:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:51:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:51:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:51:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:51:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:51:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:51:39 - job_xml_thread(): Done retrieving: data size 43559957
Sun 19 Jan 2014 12:51:39 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:51:39 - XML: Start document: iteration 9
Sun 19 Jan 2014 12:51:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559957
Sun 19 Jan 2014 12:51:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:51:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559957
Sun 19 Jan 2014 12:51:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:51:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:51:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:51:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:51:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:51:57 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:51:57 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:51:57 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:51:57 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:51:57 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:51:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:51:58 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:51:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:51:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:51:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:51:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:51:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:51:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:51:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:52:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:52:01 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:52:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:52:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:52:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:52:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:52:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:52:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:52:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:52:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43591590
Sun 19 Jan 2014 12:52:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:52:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43591590
Sun 19 Jan 2014 12:52:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:52:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:52:08 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:52:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:52:08 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:52:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 12:52:08 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:52:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 12:52:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8993 values 141799 bits 17724 bytes 
Sun 19 Jan 2014 12:52:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:52:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:52:12 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:52:12 - job_xml_thread(): Done retrieving: data size 43591590
Sun 19 Jan 2014 12:52:12 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:52:12 - XML: Start document: iteration 10
Sun 19 Jan 2014 12:52:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:52:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:52:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:52:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:52:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:52:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:52:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:52:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:52:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:52:26 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:52:26 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:52:26 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:52:26 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:52:26 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:52:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:52:28 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:52:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:52:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:52:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:52:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:52:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:52:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:52:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:52:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:52:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:52:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43544940
Sun 19 Jan 2014 12:52:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:52:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43544940
Sun 19 Jan 2014 12:52:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:52:41 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:52:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:52:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:52:43 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:52:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:52:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:52:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:52:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:52:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:52:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:52:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:52:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:52:48 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:52:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 12:52:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:52:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:52:48 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:52:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:52:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:52:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:52:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:52:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:52:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:52:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:52:51 - job_xml_thread(): Done retrieving: data size 43571012
Sun 19 Jan 2014 12:52:51 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:52:51 - XML: Start document: iteration 11
Sun 19 Jan 2014 12:52:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571012
Sun 19 Jan 2014 12:52:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:52:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571012
Sun 19 Jan 2014 12:52:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:52:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:52:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:53:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:53:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:53:07 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:53:07 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:53:07 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:53:07 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:53:07 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:53:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:53:08 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:53:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:53:09 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:53:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 12:53:09 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:53:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 12:53:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5771 values 90999 bits 11374 bytes 
Sun 19 Jan 2014 12:53:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:53:13 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:53:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:53:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:53:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:53:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:53:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:53:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:53:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:53:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:53:15 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:53:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:53:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:53:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:53:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:53:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:53:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:53:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:53:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43521296
Sun 19 Jan 2014 12:53:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:53:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43521296
Sun 19 Jan 2014 12:53:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:53:23 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:53:23 - job_xml_thread(): Done retrieving: data size 43521296
Sun 19 Jan 2014 12:53:23 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:53:23 - XML: Start document: iteration 12
Sun 19 Jan 2014 12:53:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:53:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:53:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:53:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:53:37 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:53:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 12:53:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:53:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:53:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:53:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:53:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:53:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:53:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:53:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:53:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:53:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:53:41 - XML: Processed 652600 elements - found 0 jobs
Sun 19 Jan 2014 12:53:41 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:53:41 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:53:41 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:53:41 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:53:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:53:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:53:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:53:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:53:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:53:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:53:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:53:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:53:46 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 12:53:46 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 12:53:46 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:53:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:53:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42968419
Sun 19 Jan 2014 12:53:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:53:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42968419
Sun 19 Jan 2014 12:53:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:53:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:53:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:53:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:53:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:53:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:53:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:53:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:53:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:53:57 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:53:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:53:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:53:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:53:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:53:59 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:53:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:53:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:54:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:54:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:54:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:54:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:54:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:54:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42916071
Sun 19 Jan 2014 12:54:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42916071
Sun 19 Jan 2014 12:54:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:54:02 - job_xml_thread(): Done retrieving: data size 42916071
Sun 19 Jan 2014 12:54:02 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:54:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:54:02 - XML: Start document: iteration 13
Sun 19 Jan 2014 12:54:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:54:09 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:54:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:54:10 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:54:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 12:54:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 12:54:10 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:54:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9182 values 144762 bits 18095 bytes 
Sun 19 Jan 2014 12:54:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:54:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:54:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:54:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:54:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:54:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:54:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:54:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:54:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:54:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:54:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:54:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:54:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:54:19 - XML: Processed 645150 elements - found 0 jobs
Sun 19 Jan 2014 12:54:19 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:54:19 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:54:19 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:54:19 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:54:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:54:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:54:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:54:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:54:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:54:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:54:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:54:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:54:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:54:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42953692
Sun 19 Jan 2014 12:54:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:54:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42953692
Sun 19 Jan 2014 12:54:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:54:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:54:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:54:34 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:54:34 - job_xml_thread(): Done retrieving: data size 42953692
Sun 19 Jan 2014 12:54:34 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:54:34 - XML: Start document: iteration 14
Sun 19 Jan 2014 12:54:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:54:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:54:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:54:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:54:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:54:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:54:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:54:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:54:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:54:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:54:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:54:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:54:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:54:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:54:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:54:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:54:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:54:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:54:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:54:47 - XML: Processed 645912 elements - found 0 jobs
Sun 19 Jan 2014 12:54:47 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:54:47 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:54:47 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:54:47 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:54:47 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:54:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 12:54:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:54:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:54:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43506356
Sun 19 Jan 2014 12:54:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:54:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43506356
Sun 19 Jan 2014 12:54:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:55:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:55:00 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:55:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:55:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:55:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:55:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:55:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:55:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:55:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:55:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:55:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:55:02 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:55:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:55:03 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:55:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:55:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:55:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:55:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:55:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:55:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:55:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:55:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574834
Sun 19 Jan 2014 12:55:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:55:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574834
Sun 19 Jan 2014 12:55:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:55:05 - job_xml_thread(): Done retrieving: data size 43574834
Sun 19 Jan 2014 12:55:05 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:55:05 - XML: Start document: iteration 15
Sun 19 Jan 2014 12:55:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:55:12 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:55:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:55:14 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:55:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 12:55:15 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:55:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8941 values 140988 bits 17623 bytes 
Sun 19 Jan 2014 12:55:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 12:55:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:55:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:55:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:55:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:55:20 - XML: Processed 653260 elements - found 0 jobs
Sun 19 Jan 2014 12:55:20 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:55:21 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:55:21 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:55:21 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:55:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:55:25 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:55:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:55:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:55:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:55:27 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:55:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:55:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:55:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:55:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:55:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:55:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:55:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:55:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:55:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:55:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:55:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:55:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:55:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583644
Sun 19 Jan 2014 12:55:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:55:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583644
Sun 19 Jan 2014 12:55:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:55:36 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:55:36 - job_xml_thread(): Done retrieving: data size 43583644
Sun 19 Jan 2014 12:55:36 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:55:36 - XML: Start document: iteration 16
Sun 19 Jan 2014 12:55:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:55:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:55:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:55:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:55:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:55:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:55:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:55:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:55:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:55:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:55:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:55:49 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:55:49 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:55:49 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:55:49 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:55:49 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:55:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:55:52 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:55:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:55:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:55:52 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:55:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 12:55:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:55:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:55:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:55:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:55:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:55:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:55:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43547293
Sun 19 Jan 2014 12:55:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:55:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43547293
Sun 19 Jan 2014 12:55:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:55:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:55:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:56:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:56:03 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:56:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:56:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:56:05 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:56:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:56:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:56:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:56:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:56:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:56:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:56:07 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:56:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:56:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:56:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:56:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:56:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:56:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:56:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:56:09 - job_xml_thread(): Done retrieving: data size 43576623
Sun 19 Jan 2014 12:56:09 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:56:09 - XML: Start document: iteration 17
Sun 19 Jan 2014 12:56:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576623
Sun 19 Jan 2014 12:56:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:56:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576623
Sun 19 Jan 2014 12:56:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:56:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:56:15 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:56:16 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:56:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 12:56:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:56:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 12:56:16 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:56:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8615 values 135791 bits 16973 bytes 
Sun 19 Jan 2014 12:56:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:56:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:56:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:56:22 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:56:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:56:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:56:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:56:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:56:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:56:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:56:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:56:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:56:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:56:29 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:56:29 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:56:29 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:56:29 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:56:29 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:56:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:56:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:56:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:56:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:56:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:56:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:56:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:56:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:56:34 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:56:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 12:56:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:56:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:56:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553109
Sun 19 Jan 2014 12:56:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:56:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553109
Sun 19 Jan 2014 12:56:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:56:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:56:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:56:45 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:56:45 - job_xml_thread(): Done retrieving: data size 43553109
Sun 19 Jan 2014 12:56:45 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:56:45 - XML: Start document: iteration 18
Sun 19 Jan 2014 12:56:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:56:47 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:56:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:56:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:56:47 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 12:56:48 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:56:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:56:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:56:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:56:48 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:56:48 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 12:56:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:56:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:56:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:56:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:56:49 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:56:49 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 12:56:49 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sun 19 Jan 2014 12:56:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:56:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:56:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:56:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:56:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:56:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:56:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:56:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:56:58 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:56:58 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:56:58 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:56:58 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:56:58 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:56:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:56:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570027
Sun 19 Jan 2014 12:56:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:57:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570027
Sun 19 Jan 2014 12:57:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:57:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:57:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:57:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:57:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:57:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:57:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:57:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:57:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:57:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:57:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:57:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:57:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:57:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:57:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:57:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:57:13 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:57:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:57:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43594754
Sun 19 Jan 2014 12:57:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:57:14 - job_xml_thread(): Done retrieving: data size 43594754
Sun 19 Jan 2014 12:57:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:57:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:57:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:57:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:57:14 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:57:14 - XML: Start document: iteration 19
Sun 19 Jan 2014 12:57:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43594754
Sun 19 Jan 2014 12:57:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:57:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:57:17 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:57:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:57:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 12:57:18 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:57:18 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:57:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 12:57:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148587 bits 18573 bytes 
Sun 19 Jan 2014 12:57:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:57:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:57:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:57:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:57:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:57:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:57:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:57:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:57:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:57:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:57:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:57:32 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:57:32 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:57:32 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:57:32 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:57:32 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:57:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:57:35 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:57:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:57:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:57:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:57:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:57:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:57:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:57:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:57:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555048
Sun 19 Jan 2014 12:57:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:57:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555048
Sun 19 Jan 2014 12:57:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:57:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:57:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:57:47 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:57:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:57:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:57:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:57:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:57:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:57:49 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:57:49 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:57:49 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:57:49 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:57:49 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 12:57:49 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 12:57:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:57:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:57:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:57:49 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 12:57:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:57:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:57:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:57:54 - size of cluster 'LISA Cluster': 624 hosts 79486 metrics 911129 values 14358950 bits 1794868 bytes 
Sun 19 Jan 2014 12:57:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:57:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:57:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:57:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:57:54 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:57:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 12:57:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:57:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:57:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:57:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:57:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:57:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:57:58 - job_xml_thread(): Done retrieving: data size 43572246
Sun 19 Jan 2014 12:57:58 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:57:58 - XML: Start document: iteration 20
Sun 19 Jan 2014 12:57:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572246
Sun 19 Jan 2014 12:57:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:57:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572246
Sun 19 Jan 2014 12:57:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:58:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:58:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:58:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:58:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:58:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:58:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:58:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:58:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:58:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:58:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:58:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:58:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:58:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:58:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:58:18 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:58:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:58:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 12:58:19 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:58:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 12:58:19 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:58:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5922 values 93398 bits 11674 bytes 
Sun 19 Jan 2014 12:58:20 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:58:20 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:58:21 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:58:21 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:58:21 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:58:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:58:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:58:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:58:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:58:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:58:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:58:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:58:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:58:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:58:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575021
Sun 19 Jan 2014 12:58:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:58:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575021
Sun 19 Jan 2014 12:58:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:58:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:58:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:58:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:58:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:58:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:58:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:58:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:58:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:58:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:58:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:58:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575021
Sun 19 Jan 2014 12:58:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:58:36 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:58:36 - job_xml_thread(): Done retrieving: data size 43575021
Sun 19 Jan 2014 12:58:36 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:58:36 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 12:58:36 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 12:58:36 - Housekeeping: done.
Sun 19 Jan 2014 12:58:36 - XML: Start document: iteration 0
Sun 19 Jan 2014 12:58:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:58:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:58:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:58:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:58:50 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:58:50 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 12:58:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:58:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:58:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:58:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:58:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:58:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:58:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:58:53 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:58:53 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:58:53 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:58:53 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:58:53 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:58:54 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:58:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 12:58:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:58:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:58:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:58:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:58:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:58:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:58:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:58:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:58:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:58:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:58:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583216
Sun 19 Jan 2014 12:58:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:58:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583216
Sun 19 Jan 2014 12:58:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:59:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:59:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:59:08 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:59:08 - job_xml_thread(): Done retrieving: data size 43583216
Sun 19 Jan 2014 12:59:08 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:59:08 - XML: Start document: iteration 1
Sun 19 Jan 2014 12:59:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:59:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:59:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:59:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:59:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:59:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:59:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:59:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:59:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:59:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:59:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:59:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:59:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:59:19 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:59:19 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:59:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:59:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:59:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:59:19 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:59:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 12:59:19 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:59:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 12:59:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6093 values 96058 bits 12007 bytes 
Sun 19 Jan 2014 12:59:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:59:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:59:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:59:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:59:22 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 12:59:22 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 12:59:22 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 12:59:22 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 12:59:22 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 12:59:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:59:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43491782
Sun 19 Jan 2014 12:59:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:59:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43491782
Sun 19 Jan 2014 12:59:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:59:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:59:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:59:32 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 12:59:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 12:59:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:59:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:59:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:59:37 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 12:59:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:59:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:59:39 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:59:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:59:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:59:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:59:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:59:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:59:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:59:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 12:59:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 12:59:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 12:59:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 12:59:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:59:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 12:59:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 12:59:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 12:59:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 12:59:46 - job_xml_thread(): Done retrieving: data size 42970784
Sun 19 Jan 2014 12:59:46 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 12:59:46 - XML: Start document: iteration 2
Sun 19 Jan 2014 12:59:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42970784
Sun 19 Jan 2014 12:59:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 12:59:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42970784
Sun 19 Jan 2014 12:59:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 12:59:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 12:59:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 12:59:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 12:59:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 12:59:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 12:59:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 12:59:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:59:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 12:59:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 12:59:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 12:59:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 12:59:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 12:59:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:00:03 - XML: Processed 645980 elements - found 0 jobs
Sun 19 Jan 2014 13:00:03 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:00:03 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:00:03 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:00:03 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:00:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:00:07 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:00:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:00:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:00:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:00:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:00:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:00:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:00:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:00:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42885191
Sun 19 Jan 2014 13:00:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:00:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42885191
Sun 19 Jan 2014 13:00:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:00:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:00:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:00:19 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:00:19 - job_xml_thread(): Done retrieving: data size 42885191
Sun 19 Jan 2014 13:00:19 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:00:19 - XML: Start document: iteration 3
Sun 19 Jan 2014 13:00:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:00:20 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:00:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:00:20 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:00:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 13:00:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 13:00:20 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:00:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9052 values 142737 bits 17842 bytes 
Sun 19 Jan 2014 13:00:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:00:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:00:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:00:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:00:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:00:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:00:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:00:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:00:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:00:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:00:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:00:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:00:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:00:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:00:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:00:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:00:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:00:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:00:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:00:33 - XML: Processed 645150 elements - found 0 jobs
Sun 19 Jan 2014 13:00:33 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:00:33 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:00:33 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:00:33 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:00:33 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 13:00:33 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 13:00:33 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:00:35 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:00:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 13:00:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:00:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:00:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43391583
Sun 19 Jan 2014 13:00:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:00:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43391583
Sun 19 Jan 2014 13:00:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:00:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:00:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:00:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:00:46 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:00:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:00:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:00:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:00:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:00:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:00:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:00:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:00:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:00:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:00:48 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:00:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:00:49 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:00:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:00:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:00:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:00:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:00:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:00:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:00:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:00:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43543704
Sun 19 Jan 2014 13:00:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:00:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43543704
Sun 19 Jan 2014 13:00:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:00:52 - job_xml_thread(): Done retrieving: data size 43543704
Sun 19 Jan 2014 13:00:52 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:00:52 - XML: Start document: iteration 4
Sun 19 Jan 2014 13:01:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:01:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:01:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:01:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:01:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:01:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:01:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:01:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:01:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:01:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:01:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:01:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:01:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:01:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:01:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:01:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:01:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:01:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:01:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:01:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:01:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:01:11 - XML: Processed 653002 elements - found 0 jobs
Sun 19 Jan 2014 13:01:11 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:01:11 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:01:11 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:01:11 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:01:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:01:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43588781
Sun 19 Jan 2014 13:01:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:01:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43588781
Sun 19 Jan 2014 13:01:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:01:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:01:20 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:01:21 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:01:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 13:01:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:01:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 13:01:21 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:01:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148710 bits 18588 bytes 
Sun 19 Jan 2014 13:01:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:01:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:01:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:01:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:01:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:01:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:01:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:01:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:01:26 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:01:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:01:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:01:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:01:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:01:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:01:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:01:29 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:01:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:01:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:01:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:01:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:01:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:01:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:01:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:01:31 - job_xml_thread(): Done retrieving: data size 43583471
Sun 19 Jan 2014 13:01:31 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:01:31 - XML: Start document: iteration 5
Sun 19 Jan 2014 13:01:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583471
Sun 19 Jan 2014 13:01:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:01:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583471
Sun 19 Jan 2014 13:01:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:01:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:01:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:01:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:01:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:01:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:01:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:01:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:01:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:01:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:01:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:01:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:01:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:01:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:01:50 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 13:01:50 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:01:50 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:01:50 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:01:50 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:01:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:01:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:01:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:01:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:01:54 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:01:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 13:01:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:01:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:01:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:01:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:01:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:01:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:01:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568792
Sun 19 Jan 2014 13:01:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:01:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568792
Sun 19 Jan 2014 13:01:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:02:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:02:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:02:05 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:02:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:02:05 - job_xml_thread(): Done retrieving: data size 43568792
Sun 19 Jan 2014 13:02:05 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:02:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:02:05 - XML: Start document: iteration 6
Sun 19 Jan 2014 13:02:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:02:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:02:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:02:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:02:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:02:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:02:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:02:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:02:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:02:17 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 13:02:17 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:02:17 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:02:17 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:02:17 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:02:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:02:18 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:02:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:02:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:02:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:02:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:02:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:02:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:02:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:02:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43544266
Sun 19 Jan 2014 13:02:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:02:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43544266
Sun 19 Jan 2014 13:02:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:02:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:02:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:02:22 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:02:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:02:22 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:02:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 13:02:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:02:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 13:02:23 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:02:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8850 values 139875 bits 17484 bytes 
Sun 19 Jan 2014 13:02:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:02:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:02:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:02:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:02:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:02:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:02:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:02:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:02:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43544266
Sun 19 Jan 2014 13:02:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:02:33 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:02:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:02:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:02:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:02:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:02:37 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:02:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:02:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:02:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:02:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:02:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:02:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:02:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:02:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:02:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:02:41 - job_xml_thread(): Done retrieving: data size 43581336
Sun 19 Jan 2014 13:02:41 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:02:41 - XML: Start document: iteration 7
Sun 19 Jan 2014 13:02:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581336
Sun 19 Jan 2014 13:02:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:02:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:02:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:02:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:02:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:02:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:02:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:02:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581336
Sun 19 Jan 2014 13:02:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:02:54 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 13:02:54 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:02:54 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:02:54 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:02:54 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:02:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:02:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:02:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:03:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:03:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:03:03 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:03:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:03:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:03:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:03:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:03:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:03:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:03:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:03:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:03:05 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:03:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:03:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:03:05 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:03:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 13:03:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:03:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:03:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:03:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:03:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:03:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:03:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43591588
Sun 19 Jan 2014 13:03:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:03:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43591588
Sun 19 Jan 2014 13:03:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:03:09 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:03:09 - job_xml_thread(): Done retrieving: data size 43591588
Sun 19 Jan 2014 13:03:10 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:03:10 - XML: Start document: iteration 8
Sun 19 Jan 2014 13:03:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:03:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:03:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:03:22 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 13:03:22 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:03:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:03:22 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:03:22 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:03:22 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:03:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:03:23 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:03:24 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:03:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 13:03:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:03:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 13:03:24 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:03:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6005 values 95051 bits 11881 bytes 
Sun 19 Jan 2014 13:03:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:03:27 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:03:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:03:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:03:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:03:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:03:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:03:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:03:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:03:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:03:29 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:03:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:03:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:03:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:03:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:03:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:03:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:03:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:03:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43592414
Sun 19 Jan 2014 13:03:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:03:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43592414
Sun 19 Jan 2014 13:03:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:03:37 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:03:37 - job_xml_thread(): Done retrieving: data size 43592414
Sun 19 Jan 2014 13:03:37 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:03:37 - XML: Start document: iteration 9
Sun 19 Jan 2014 13:03:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:03:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:03:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:03:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:03:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:03:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:03:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:03:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:03:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:03:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:03:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:03:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:03:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:03:53 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 13:03:53 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:03:53 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:03:53 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:03:53 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:03:54 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:03:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 13:03:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:03:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:03:55 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:03:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:03:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:03:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:03:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:03:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:03:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:03:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:03:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571109
Sun 19 Jan 2014 13:03:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:03:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571109
Sun 19 Jan 2014 13:03:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:04:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:04:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:04:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:04:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:04:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:04:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:04:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:04:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:04:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:04:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:04:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571109
Sun 19 Jan 2014 13:04:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:04:08 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:04:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:04:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:04:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:04:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:04:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:04:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:04:17 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:04:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:04:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:04:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:04:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:04:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:04:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:04:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:04:19 - job_xml_thread(): Done retrieving: data size 43554631
Sun 19 Jan 2014 13:04:19 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:04:19 - XML: Start document: iteration 10
Sun 19 Jan 2014 13:04:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554631
Sun 19 Jan 2014 13:04:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:04:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:04:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:04:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:04:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:04:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554631
Sun 19 Jan 2014 13:04:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:04:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:04:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:04:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:04:25 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:04:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:04:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 13:04:27 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:04:27 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:04:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 13:04:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9320 values 147026 bits 18378 bytes 
Sun 19 Jan 2014 13:04:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:04:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:04:34 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 13:04:34 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:04:34 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:04:34 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:04:34 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:04:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:04:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:04:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:04:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:04:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:04:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:04:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:04:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:04:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:04:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:04:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:04:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:04:41 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:04:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:04:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:04:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:04:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:04:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:04:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:04:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:04:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43594697
Sun 19 Jan 2014 13:04:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:04:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43594697
Sun 19 Jan 2014 13:04:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:04:47 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:04:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 13:04:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:04:50 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:04:50 - job_xml_thread(): Done retrieving: data size 43594697
Sun 19 Jan 2014 13:04:50 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:04:50 - XML: Start document: iteration 11
Sun 19 Jan 2014 13:04:50 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 13:04:50 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:04:51 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:04:51 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 13:04:51 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 13:04:51 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:04:51 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sun 19 Jan 2014 13:04:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:04:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:04:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:04:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:04:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:04:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:04:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:04:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:04:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:04:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:04:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:04:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:04:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:05:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:05:01 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:05:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:05:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:05:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:05:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:05:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:05:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:05:04 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 13:05:04 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:05:04 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:05:04 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:05:04 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:05:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:05:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566372
Sun 19 Jan 2014 13:05:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:05:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566372
Sun 19 Jan 2014 13:05:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:05:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:05:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:05:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:05:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:05:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:05:19 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:05:19 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:05:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:05:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:05:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:05:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:05:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:05:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:05:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:05:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:05:21 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:05:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:05:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:05:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:05:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:05:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:05:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:05:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:05:23 - job_xml_thread(): Done retrieving: data size 43504059
Sun 19 Jan 2014 13:05:23 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:05:23 - XML: Start document: iteration 12
Sun 19 Jan 2014 13:05:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43504059
Sun 19 Jan 2014 13:05:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:05:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43504059
Sun 19 Jan 2014 13:05:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:05:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:05:28 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:05:30 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:05:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:05:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 13:05:30 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:05:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 13:05:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7650 values 120657 bits 15082 bytes 
Sun 19 Jan 2014 13:05:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:05:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:05:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:05:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:05:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:05:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:05:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:05:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:05:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:05:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:05:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:05:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:05:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:05:42 - XML: Processed 652600 elements - found 0 jobs
Sun 19 Jan 2014 13:05:42 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:05:42 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:05:42 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:05:42 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:05:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:05:45 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:05:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:05:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:05:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:05:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:05:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:05:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:05:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:05:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42992195
Sun 19 Jan 2014 13:05:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:05:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42992195
Sun 19 Jan 2014 13:05:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:05:51 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:05:51 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:05:53 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:05:53 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:05:53 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 13:05:53 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 13:05:53 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 13:05:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:05:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:05:57 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:05:57 - job_xml_thread(): Done retrieving: data size 42992195
Sun 19 Jan 2014 13:05:57 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:05:57 - XML: Start document: iteration 13
Sun 19 Jan 2014 13:06:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:06:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:06:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:06:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:06:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:06:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:06:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:06:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:06:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:06:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:06:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:06:08 - XML: Processed 646134 elements - found 0 jobs
Sun 19 Jan 2014 13:06:08 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:06:08 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:06:08 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:06:08 - job_xml_thread(): Sleeping.. (15s)
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sun 19 Jan 2014 13:06:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:06:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:06:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:06:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:06:10 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:06:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 13:06:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:06:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:06:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:06:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:06:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:06:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:06:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42902841
Sun 19 Jan 2014 13:06:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:06:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42902841
Sun 19 Jan 2014 13:06:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:06:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:06:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:06:23 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:06:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:06:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:06:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:06:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:06:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:06:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:06:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:06:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:06:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:06:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:06:26 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:06:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:06:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:06:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:06:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:06:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:06:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:06:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:06:28 - job_xml_thread(): Done retrieving: data size 42986887
Sun 19 Jan 2014 13:06:28 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:06:28 - XML: Start document: iteration 14
Sun 19 Jan 2014 13:06:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42986887
Sun 19 Jan 2014 13:06:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:06:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42986887
Sun 19 Jan 2014 13:06:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:06:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:06:31 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:06:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:06:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 13:06:32 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:06:32 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:06:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9134 values 144037 bits 18004 bytes 
Sun 19 Jan 2014 13:06:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 13:06:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:06:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:06:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:06:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:06:46 - XML: Processed 645900 elements - found 0 jobs
Sun 19 Jan 2014 13:06:46 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:06:46 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:06:47 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:06:47 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:06:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:06:47 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:06:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:06:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:06:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:06:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:06:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:06:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:06:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:06:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:06:51 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:06:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:06:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:06:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:06:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:06:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:06:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:06:53 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:06:53 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:06:53 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:06:53 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 13:06:53 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 13:06:53 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:06:53 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 13:06:54 - size of cluster 'LISA Cluster': 624 hosts 79473 metrics 985688 values 15556624 bits 1944578 bytes 
Sun 19 Jan 2014 13:06:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:06:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43548626
Sun 19 Jan 2014 13:06:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:06:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43548626
Sun 19 Jan 2014 13:06:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:07:02 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:07:02 - job_xml_thread(): Done retrieving: data size 43548626
Sun 19 Jan 2014 13:07:02 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:07:02 - XML: Start document: iteration 15
Sun 19 Jan 2014 13:07:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:07:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:07:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:07:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:07:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:07:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:07:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:07:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:07:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:07:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:07:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:07:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:07:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:07:13 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:07:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 13:07:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:07:15 - XML: Processed 653192 elements - found 0 jobs
Sun 19 Jan 2014 13:07:15 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:07:15 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:07:15 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:07:15 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:07:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:07:18 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:07:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:07:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:07:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:07:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:07:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:07:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:07:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:07:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43535183
Sun 19 Jan 2014 13:07:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:07:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:07:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:07:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43535183
Sun 19 Jan 2014 13:07:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:07:30 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:07:30 - job_xml_thread(): Done retrieving: data size 43535183
Sun 19 Jan 2014 13:07:30 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:07:30 - XML: Start document: iteration 16
Sun 19 Jan 2014 13:07:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:07:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:07:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:07:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:07:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:07:32 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:07:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:07:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:07:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:07:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:07:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:07:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 13:07:33 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:07:33 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:07:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5793 values 91327 bits 11415 bytes 
Sun 19 Jan 2014 13:07:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 13:07:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:07:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:07:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:07:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:07:45 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:07:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:07:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:07:46 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 13:07:46 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:07:46 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:07:46 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:07:46 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:07:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:07:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:07:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:07:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:07:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:07:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:07:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:07:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43538326
Sun 19 Jan 2014 13:07:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:07:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43538326
Sun 19 Jan 2014 13:07:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:07:53 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:07:53 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 13:08:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:08:00 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:08:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:08:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:08:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:08:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:08:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:08:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:08:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:08:01 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:08:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:08:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:08:01 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:08:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 13:08:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:08:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:08:05 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:08:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:08:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:08:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:08:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:08:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:08:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:08:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:08:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554829
Sun 19 Jan 2014 13:08:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:08:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554829
Sun 19 Jan 2014 13:08:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:08:10 - job_xml_thread(): Done retrieving: data size 43554829
Sun 19 Jan 2014 13:08:10 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:08:10 - XML: Start document: iteration 17
Sun 19 Jan 2014 13:08:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:08:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:08:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:08:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:08:23 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 13:08:23 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:08:23 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:08:23 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:08:23 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:08:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:08:28 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:08:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:08:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:08:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:08:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:08:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:08:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:08:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:08:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:08:31 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:08:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:08:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:08:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:08:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:08:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:08:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:08:33 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 13:08:33 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 13:08:33 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:08:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:08:33 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:08:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:08:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 13:08:34 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:08:34 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:08:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 13:08:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5917 values 93310 bits 11663 bytes 
Sun 19 Jan 2014 13:08:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:08:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564201
Sun 19 Jan 2014 13:08:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:08:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564201
Sun 19 Jan 2014 13:08:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:08:38 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:08:38 - job_xml_thread(): Done retrieving: data size 43564201
Sun 19 Jan 2014 13:08:38 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:08:38 - XML: Start document: iteration 18
Sun 19 Jan 2014 13:08:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:08:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:08:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:08:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:08:50 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 13:08:50 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:08:50 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:08:50 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:08:50 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:08:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:08:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:08:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:08:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:08:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:08:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:08:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:08:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:08:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:08:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:08:55 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:08:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:08:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:08:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:08:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:08:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:08:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:08:58 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:08:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 13:08:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:08:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:08:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43588660
Sun 19 Jan 2014 13:08:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:08:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43588660
Sun 19 Jan 2014 13:08:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:09:06 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:09:06 - job_xml_thread(): Done retrieving: data size 43588660
Sun 19 Jan 2014 13:09:06 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:09:06 - XML: Start document: iteration 19
Sun 19 Jan 2014 13:09:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:09:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:09:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:09:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:09:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:09:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:09:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:09:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:09:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:09:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:09:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:09:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:09:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:09:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:09:17 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:09:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:09:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:09:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:09:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:09:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:09:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:09:19 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 13:09:19 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:09:19 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:09:19 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:09:19 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:09:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:09:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43548599
Sun 19 Jan 2014 13:09:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:09:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43548599
Sun 19 Jan 2014 13:09:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:09:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:09:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:09:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:09:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:09:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:09:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:09:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:09:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:09:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:09:34 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:09:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:09:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:09:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:09:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:09:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:09:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:09:34 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:09:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 13:09:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 13:09:34 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:09:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6934 values 109273 bits 13659 bytes 
Sun 19 Jan 2014 13:09:34 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:09:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:09:37 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:09:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:09:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:09:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:09:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:09:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:09:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:09:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:09:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571256
Sun 19 Jan 2014 13:09:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:09:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571256
Sun 19 Jan 2014 13:09:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:09:40 - job_xml_thread(): Done retrieving: data size 43571256
Sun 19 Jan 2014 13:09:40 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:09:40 - XML: Start document: iteration 20
Sun 19 Jan 2014 13:09:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:09:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:09:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:09:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:09:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:09:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:09:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:09:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:09:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:09:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:09:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:09:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:09:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:09:58 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:09:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 13:09:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:10:01 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 13:10:01 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:10:01 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:10:01 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:10:01 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:10:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:10:03 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:10:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:10:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:10:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:10:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:10:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:10:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:10:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:10:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556784
Sun 19 Jan 2014 13:10:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:10:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556784
Sun 19 Jan 2014 13:10:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:10:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:10:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:10:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:10:14 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:10:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:10:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:10:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:10:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:10:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:10:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:10:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:10:16 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:10:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:10:18 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:10:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:10:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:10:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:10:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:10:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:10:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:10:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:10:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574870
Sun 19 Jan 2014 13:10:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:10:19 - job_xml_thread(): Done retrieving: data size 43574870
Sun 19 Jan 2014 13:10:20 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:10:20 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 13:10:20 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 13:10:20 - Housekeeping: done.
Sun 19 Jan 2014 13:10:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574870
Sun 19 Jan 2014 13:10:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:10:21 - XML: Start document: iteration 0
Sun 19 Jan 2014 13:10:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:10:29 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:10:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:10:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:10:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:10:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:10:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:10:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:10:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:10:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:10:34 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:10:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:10:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:10:35 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:10:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 13:10:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:10:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 13:10:35 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:10:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9038 values 142527 bits 17815 bytes 
Sun 19 Jan 2014 13:10:38 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 13:10:38 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:10:38 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:10:38 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:10:38 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:10:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:10:40 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:10:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:10:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:10:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:10:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:10:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:10:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:10:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:10:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555696
Sun 19 Jan 2014 13:10:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:10:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555696
Sun 19 Jan 2014 13:10:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:10:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:10:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:10:53 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:10:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:10:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:10:54 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:10:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:10:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:10:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:10:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:10:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:10:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:10:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:10:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:10:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:10:58 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:10:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:10:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:10:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:10:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:10:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:10:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:10:58 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:10:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 13:10:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:11:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:11:00 - job_xml_thread(): Done retrieving: data size 43582795
Sun 19 Jan 2014 13:11:00 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:11:00 - XML: Start document: iteration 1
Sun 19 Jan 2014 13:11:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582795
Sun 19 Jan 2014 13:11:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:11:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582795
Sun 19 Jan 2014 13:11:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:11:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:11:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:11:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:11:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:11:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:11:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:11:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:11:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:11:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:11:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:11:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:11:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:11:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:11:21 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 13:11:21 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:11:21 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:11:21 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:11:21 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:11:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:11:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:11:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:11:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:11:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:11:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:11:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:11:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:11:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:11:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43503749
Sun 19 Jan 2014 13:11:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:11:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43503749
Sun 19 Jan 2014 13:11:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:11:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:11:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:11:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:11:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:11:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:11:36 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:11:36 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:11:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:11:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:11:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:11:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:11:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:11:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:11:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 13:11:37 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:11:37 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:11:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8547 values 134705 bits 16838 bytes 
Sun 19 Jan 2014 13:11:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 13:11:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:11:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:11:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:11:39 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:11:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:11:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:11:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:11:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:11:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:11:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:11:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:11:41 - job_xml_thread(): Done retrieving: data size 42970969
Sun 19 Jan 2014 13:11:41 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:11:41 - XML: Start document: iteration 2
Sun 19 Jan 2014 13:11:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42970969
Sun 19 Jan 2014 13:11:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42970969
Sun 19 Jan 2014 13:11:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:11:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:11:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:11:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:11:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:11:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:12:02 - XML: Processed 645916 elements - found 0 jobs
Sun 19 Jan 2014 13:12:02 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:12:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:12:02 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:12:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:12:02 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:12:02 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:12:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:12:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:12:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:12:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:12:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:12:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:12:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:12:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:12:05 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:12:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:12:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:12:05 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:12:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 13:12:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:12:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:12:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:12:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:12:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:12:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:12:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42906898
Sun 19 Jan 2014 13:12:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:12:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42906898
Sun 19 Jan 2014 13:12:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:12:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:12:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:12:17 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:12:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:12:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:12:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:12:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:12:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:12:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:12:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:12:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:12:20 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:12:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:12:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:12:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:12:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:12:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:12:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:12:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:12:22 - job_xml_thread(): Done retrieving: data size 42969089
Sun 19 Jan 2014 13:12:22 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:12:22 - XML: Start document: iteration 3
Sun 19 Jan 2014 13:12:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42969089
Sun 19 Jan 2014 13:12:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:12:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42969089
Sun 19 Jan 2014 13:12:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:12:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:12:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:12:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:12:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:12:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:12:37 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:12:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:12:39 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:12:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 13:12:39 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:12:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9083 values 143237 bits 17904 bytes 
Sun 19 Jan 2014 13:12:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 13:12:40 - XML: Processed 645900 elements - found 0 jobs
Sun 19 Jan 2014 13:12:40 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:12:40 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:12:40 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:12:40 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:12:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:12:45 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:12:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:12:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:12:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:12:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:12:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:12:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:12:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:12:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:12:46 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:12:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:12:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:12:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:12:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:12:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:12:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:12:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:12:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43504048
Sun 19 Jan 2014 13:12:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:12:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43504048
Sun 19 Jan 2014 13:12:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:12:55 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:12:55 - job_xml_thread(): Done retrieving: data size 43504048
Sun 19 Jan 2014 13:12:55 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:12:55 - XML: Start document: iteration 4
Sun 19 Jan 2014 13:13:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:13:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:13:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:13:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:13:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:13:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:13:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:13:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:13:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:13:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:13:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:13:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:13:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:13:11 - XML: Processed 652370 elements - found 0 jobs
Sun 19 Jan 2014 13:13:11 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:13:12 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:13:12 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:13:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:13:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:13:12 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:13:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:13:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:13:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:13:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:13:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:13:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:13:13 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:13:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 13:13:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:13:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:13:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571137
Sun 19 Jan 2014 13:13:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:13:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571137
Sun 19 Jan 2014 13:13:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:13:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:13:20 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:13:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:13:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:13:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:13:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:13:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:13:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:13:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571137
Sun 19 Jan 2014 13:13:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:13:28 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:13:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:13:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:13:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:13:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:13:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:13:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:13:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:13:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:13:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:13:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:13:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:13:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:13:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:13:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:13:35 - job_xml_thread(): Done retrieving: data size 43569057
Sun 19 Jan 2014 13:13:35 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:13:35 - XML: Start document: iteration 5
Sun 19 Jan 2014 13:13:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569057
Sun 19 Jan 2014 13:13:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:13:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:13:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:13:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:13:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:13:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:13:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:13:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569057
Sun 19 Jan 2014 13:13:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:13:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:13:40 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:13:41 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:13:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 13:13:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:13:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 13:13:41 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:13:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8997 values 141881 bits 17735 bytes 
Sun 19 Jan 2014 13:13:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:13:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:13:53 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 13:13:53 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:13:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:13:54 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 13:13:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:13:54 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:13:54 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:13:54 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 13:13:54 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 13:13:54 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:13:54 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:13:54 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 13:13:54 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:13:54 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:13:56 - size of cluster 'LISA Cluster': 624 hosts 79480 metrics 1017322 values 16040194 bits 2005024 bytes 
Sun 19 Jan 2014 13:13:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:13:59 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:13:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:13:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:14:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:14:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:14:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:14:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:14:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:14:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:14:00 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:14:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:14:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:14:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:14:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:14:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:14:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:14:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:14:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43588023
Sun 19 Jan 2014 13:14:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:14:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43588023
Sun 19 Jan 2014 13:14:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:14:09 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:14:09 - job_xml_thread(): Done retrieving: data size 43588023
Sun 19 Jan 2014 13:14:09 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:14:09 - XML: Start document: iteration 6
Sun 19 Jan 2014 13:14:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:14:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:14:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:14:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:14:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:14:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:14:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:14:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:14:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:14:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:14:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:14:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:14:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:14:24 - XML: Processed 653349 elements - found 0 jobs
Sun 19 Jan 2014 13:14:24 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:14:24 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:14:24 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:14:25 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:14:27 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:14:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 13:14:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:14:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:14:28 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:14:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:14:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:14:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:14:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:14:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:14:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:14:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:14:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555311
Sun 19 Jan 2014 13:14:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:14:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555311
Sun 19 Jan 2014 13:14:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:14:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:14:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:14:40 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:14:40 - job_xml_thread(): Done retrieving: data size 43555311
Sun 19 Jan 2014 13:14:40 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:14:40 - XML: Start document: iteration 7
Sun 19 Jan 2014 13:14:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:14:41 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:14:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:14:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 13:14:42 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:14:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:14:42 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:14:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:14:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 13:14:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5969 values 94087 bits 11760 bytes 
Sun 19 Jan 2014 13:14:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:14:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:14:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:14:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:14:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:14:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:14:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:14:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:14:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:14:54 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:14:54 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 13:14:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:14:55 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:14:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:14:55 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 13:14:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:14:55 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:14:55 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:14:55 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:14:55 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:14:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:14:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:14:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:14:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:14:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:14:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:15:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:15:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43544885
Sun 19 Jan 2014 13:15:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:15:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43544885
Sun 19 Jan 2014 13:15:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:15:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:15:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:15:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:15:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:15:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:15:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:15:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:15:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:15:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:15:10 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:15:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:15:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:15:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:15:15 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:15:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:15:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:15:16 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:15:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 13:15:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:15:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:15:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:15:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:15:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:15:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:15:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576009
Sun 19 Jan 2014 13:15:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:15:20 - job_xml_thread(): Done retrieving: data size 43576009
Sun 19 Jan 2014 13:15:20 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:15:20 - XML: Start document: iteration 8
Sun 19 Jan 2014 13:15:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576009
Sun 19 Jan 2014 13:15:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:15:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:15:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:15:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:15:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:15:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:15:36 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:15:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:15:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:15:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:15:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:15:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:15:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:15:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:15:39 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 13:15:39 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:15:39 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:15:39 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:15:39 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:15:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:15:42 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:15:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:15:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:15:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:15:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:15:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:15:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 13:15:43 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:15:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5976 values 94265 bits 11783 bytes 
Sun 19 Jan 2014 13:15:43 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:15:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 13:15:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:15:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:15:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:15:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:15:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:15:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573530
Sun 19 Jan 2014 13:15:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:15:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573530
Sun 19 Jan 2014 13:15:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:15:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:15:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:15:54 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:15:54 - job_xml_thread(): Done retrieving: data size 43573530
Sun 19 Jan 2014 13:15:54 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:15:54 - XML: Start document: iteration 9
Sun 19 Jan 2014 13:15:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:15:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:16:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:16:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:16:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:16:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:16:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:16:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:16:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:16:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:16:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:16:08 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 13:16:08 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:16:08 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:16:08 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:16:08 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:16:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:16:11 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:16:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:16:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:16:11 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:16:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 13:16:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:16:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:16:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:16:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:16:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:16:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:16:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560655
Sun 19 Jan 2014 13:16:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:16:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560655
Sun 19 Jan 2014 13:16:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:16:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:16:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:16:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:16:22 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:16:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:16:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:16:23 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:16:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:16:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:16:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:16:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:16:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:16:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:16:26 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:16:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:16:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:16:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:16:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:16:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:16:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:16:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:16:29 - job_xml_thread(): Done retrieving: data size 43581230
Sun 19 Jan 2014 13:16:29 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:16:29 - XML: Start document: iteration 10
Sun 19 Jan 2014 13:16:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581230
Sun 19 Jan 2014 13:16:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:16:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581230
Sun 19 Jan 2014 13:16:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:16:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:16:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:16:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:16:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:16:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:16:43 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:16:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:16:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 13:16:45 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:16:45 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:16:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 13:16:45 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 13:16:45 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:16:45 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:16:45 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:16:45 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:16:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8280 values 130688 bits 16336 bytes 
Sun 19 Jan 2014 13:16:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:16:47 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:16:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:16:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:16:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:16:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:16:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:16:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:16:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:16:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:16:51 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:16:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:16:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:16:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:16:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:16:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:16:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:16:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:16:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566177
Sun 19 Jan 2014 13:16:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:16:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566177
Sun 19 Jan 2014 13:16:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:17:00 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:17:00 - job_xml_thread(): Done retrieving: data size 43566177
Sun 19 Jan 2014 13:17:00 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:17:00 - XML: Start document: iteration 11
Sun 19 Jan 2014 13:17:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:17:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:17:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:17:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:17:07 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:17:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 13:17:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:17:13 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 13:17:14 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:17:14 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:17:14 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:17:14 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:17:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:17:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:17:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:17:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:17:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:17:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:17:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:17:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:17:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:17:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:17:18 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:17:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:17:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:17:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:17:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:17:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:17:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:17:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:17:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43515172
Sun 19 Jan 2014 13:17:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:17:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43515172
Sun 19 Jan 2014 13:17:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:17:29 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:17:29 - job_xml_thread(): Done retrieving: data size 43515172
Sun 19 Jan 2014 13:17:29 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:17:29 - XML: Start document: iteration 12
Sun 19 Jan 2014 13:17:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:17:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:17:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:17:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:17:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:17:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:17:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:17:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:17:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:17:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:17:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:17:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:17:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:17:41 - XML: Processed 652600 elements - found 0 jobs
Sun 19 Jan 2014 13:17:41 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:17:41 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:17:41 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:17:41 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:17:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:17:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:17:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:17:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:17:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:17:45 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:17:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:17:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:17:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:17:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:17:45 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:17:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 13:17:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:17:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 13:17:45 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:17:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6159 values 97500 bits 12187 bytes 
Sun 19 Jan 2014 13:17:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:17:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42994352
Sun 19 Jan 2014 13:17:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:17:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42994352
Sun 19 Jan 2014 13:17:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:17:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:17:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:17:56 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:17:56 - job_xml_thread(): Done retrieving: data size 42994352
Sun 19 Jan 2014 13:17:56 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:17:56 - XML: Start document: iteration 13
Sun 19 Jan 2014 13:18:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:18:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:18:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:18:03 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:18:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:18:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:18:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:18:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:18:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:18:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:18:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:18:10 - XML: Processed 646096 elements - found 0 jobs
Sun 19 Jan 2014 13:18:10 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:18:10 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:18:10 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:18:10 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:18:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:18:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:18:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:18:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:18:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:18:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:18:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:18:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:18:14 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 13:18:14 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 13:18:14 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:18:14 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:18:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 13:18:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:18:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:18:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42939165
Sun 19 Jan 2014 13:18:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:18:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42939165
Sun 19 Jan 2014 13:18:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:18:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:18:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:18:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:18:25 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:18:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:18:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:18:25 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:18:25 - job_xml_thread(): Done retrieving: data size 42939165
Sun 19 Jan 2014 13:18:25 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:18:26 - XML: Start document: iteration 14
Sun 19 Jan 2014 13:18:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:18:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:18:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:18:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:18:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:18:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:18:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:18:36 - XML: Processed 645564 elements - found 0 jobs
Sun 19 Jan 2014 13:18:36 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:18:36 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:18:36 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:18:36 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:18:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:18:37 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:18:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:18:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:18:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:18:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:18:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:18:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:18:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:18:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43463323
Sun 19 Jan 2014 13:18:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:18:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43463323
Sun 19 Jan 2014 13:18:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:18:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:18:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:18:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:18:46 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:18:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:18:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 13:18:47 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:18:47 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:18:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 13:18:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8097 values 127824 bits 15978 bytes 
Sun 19 Jan 2014 13:18:51 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:18:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:18:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:18:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:18:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:18:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:18:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:18:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:18:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:18:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:18:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:18:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:18:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:18:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:18:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:18:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:18:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:18:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:18:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:18:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:18:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:18:56 - job_xml_thread(): Done retrieving: data size 43567013
Sun 19 Jan 2014 13:18:56 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:18:56 - XML: Start document: iteration 15
Sun 19 Jan 2014 13:18:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567013
Sun 19 Jan 2014 13:18:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:18:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567013
Sun 19 Jan 2014 13:18:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:19:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:19:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:19:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:19:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:19:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:19:10 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:19:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:19:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:19:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:19:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:19:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:19:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:19:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:19:17 - XML: Processed 653160 elements - found 0 jobs
Sun 19 Jan 2014 13:19:17 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:19:17 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:19:17 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:19:17 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:19:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:19:20 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:19:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:19:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:19:20 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:19:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 13:19:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:19:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:19:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:19:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:19:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:19:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:19:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43539687
Sun 19 Jan 2014 13:19:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:19:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43539687
Sun 19 Jan 2014 13:19:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:19:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:19:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:19:32 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:19:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:19:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:19:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:19:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:19:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:19:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:19:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:19:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:19:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:19:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:19:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:19:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:19:35 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:19:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:19:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:19:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:19:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:19:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:19:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:19:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:19:37 - job_xml_thread(): Done retrieving: data size 43558716
Sun 19 Jan 2014 13:19:37 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:19:37 - XML: Start document: iteration 16
Sun 19 Jan 2014 13:19:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558716
Sun 19 Jan 2014 13:19:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:19:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558716
Sun 19 Jan 2014 13:19:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:19:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:19:47 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:19:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:19:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:19:47 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:19:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 13:19:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:19:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 13:19:48 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:19:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8853 values 139620 bits 17452 bytes 
Sun 19 Jan 2014 13:19:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:19:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:19:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:19:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:19:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:19:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:19:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:19:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:19:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:19:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:19:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:19:57 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 13:19:57 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:19:57 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:19:57 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:19:57 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:20:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:20:00 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:20:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:20:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:20:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:20:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:20:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:20:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:20:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:20:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566114
Sun 19 Jan 2014 13:20:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:20:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566114
Sun 19 Jan 2014 13:20:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:20:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:20:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:20:12 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:20:12 - job_xml_thread(): Done retrieving: data size 43566114
Sun 19 Jan 2014 13:20:12 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:20:12 - XML: Start document: iteration 17
Sun 19 Jan 2014 13:20:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:20:13 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:20:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:20:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:20:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:20:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:20:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:20:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:20:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:20:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:20:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:20:24 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 13:20:24 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:20:24 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:20:24 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:20:24 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:20:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:20:25 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:20:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:20:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:20:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:20:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:20:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:20:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:20:25 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:20:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 13:20:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:20:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:20:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43547502
Sun 19 Jan 2014 13:20:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:20:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43547502
Sun 19 Jan 2014 13:20:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:20:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:20:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:20:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:20:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:20:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:20:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:20:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:20:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:20:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:20:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:20:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:20:39 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:20:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:20:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:20:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:20:41 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:20:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:20:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:20:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:20:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:20:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:20:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:20:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:20:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580854
Sun 19 Jan 2014 13:20:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:20:43 - job_xml_thread(): Done retrieving: data size 43580854
Sun 19 Jan 2014 13:20:44 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:20:44 - XML: Start document: iteration 18
Sun 19 Jan 2014 13:20:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580854
Sun 19 Jan 2014 13:20:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:20:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:20:48 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:20:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:20:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 13:20:51 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:20:51 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:20:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 13:20:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9031 values 142492 bits 17811 bytes 
Sun 19 Jan 2014 13:20:54 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 13:20:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:20:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:20:54 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:20:55 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:20:55 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:20:55 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 13:20:55 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 13:20:55 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 13:20:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:20:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:20:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:20:58 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:20:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:20:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:20:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:20:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:20:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:20:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:20:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:21:01 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 13:21:01 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:21:01 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:21:01 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:21:01 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:21:04 - size of cluster 'LISA Cluster': 624 hosts 79465 metrics 792485 values 12510452 bits 1563806 bytes 
Sun 19 Jan 2014 13:21:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:21:07 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:21:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:21:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:21:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:21:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:21:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:21:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:21:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:21:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556733
Sun 19 Jan 2014 13:21:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:21:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556733
Sun 19 Jan 2014 13:21:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:21:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:21:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:21:16 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:21:16 - job_xml_thread(): Done retrieving: data size 43556733
Sun 19 Jan 2014 13:21:16 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:21:16 - XML: Start document: iteration 19
Sun 19 Jan 2014 13:21:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:21:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:21:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:21:27 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:21:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:21:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:21:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:21:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:21:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:21:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:21:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:21:29 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 13:21:29 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:21:29 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:21:29 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:21:29 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:21:31 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:21:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 13:21:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:21:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:21:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:21:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:21:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:21:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:21:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:21:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:21:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:21:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:21:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561762
Sun 19 Jan 2014 13:21:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:21:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561762
Sun 19 Jan 2014 13:21:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:21:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:21:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:21:45 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:21:45 - job_xml_thread(): Done retrieving: data size 43561762
Sun 19 Jan 2014 13:21:45 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:21:45 - XML: Start document: iteration 20
Sun 19 Jan 2014 13:21:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:21:45 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:21:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:21:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:21:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:21:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:21:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:21:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:21:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:21:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:21:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:21:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:21:52 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:21:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:21:53 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:21:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 13:21:53 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:21:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 13:21:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5524 values 87149 bits 10893 bytes 
Sun 19 Jan 2014 13:21:53 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 13:21:53 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:21:53 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:21:53 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:21:53 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:21:55 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:21:55 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 13:21:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:21:57 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:21:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:21:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:21:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:21:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:21:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:21:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:22:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:22:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:22:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:22:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554182
Sun 19 Jan 2014 13:22:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:22:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554182
Sun 19 Jan 2014 13:22:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:22:09 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:22:09 - job_xml_thread(): Done retrieving: data size 43554182
Sun 19 Jan 2014 13:22:09 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:22:09 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 13:22:09 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 13:22:09 - Housekeeping: done.
Sun 19 Jan 2014 13:22:09 - XML: Start document: iteration 0
Sun 19 Jan 2014 13:22:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:22:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:22:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:22:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:22:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:22:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:22:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:22:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:22:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:22:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:22:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:22:18 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:22:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 13:22:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:22:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:22:25 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:22:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:22:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:22:25 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 13:22:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:22:25 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:22:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:22:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:22:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:22:25 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:22:25 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:22:25 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:22:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:22:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553411
Sun 19 Jan 2014 13:22:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:22:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553411
Sun 19 Jan 2014 13:22:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:22:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:22:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:22:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:22:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:22:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:22:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:22:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:22:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:22:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:22:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:22:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:22:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:22:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:22:40 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:22:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:22:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:22:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:22:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:22:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:22:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:22:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:22:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:22:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:22:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581620
Sun 19 Jan 2014 13:22:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:22:47 - job_xml_thread(): Done retrieving: data size 43581620
Sun 19 Jan 2014 13:22:47 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:22:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581620
Sun 19 Jan 2014 13:22:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:22:47 - XML: Start document: iteration 1
Sun 19 Jan 2014 13:22:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:22:53 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:22:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:22:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:22:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:22:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 13:22:54 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:22:54 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:22:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 13:22:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8918 values 140737 bits 17592 bytes 
Sun 19 Jan 2014 13:22:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:22:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:23:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:23:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:23:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:23:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:23:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:23:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:23:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:23:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:23:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:23:05 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 13:23:05 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:23:05 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:23:05 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:23:05 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:23:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:23:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:23:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:23:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:23:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:23:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:23:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:23:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:23:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:23:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561040
Sun 19 Jan 2014 13:23:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:23:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561040
Sun 19 Jan 2014 13:23:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:23:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:23:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:23:20 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:23:20 - job_xml_thread(): Done retrieving: data size 43561040
Sun 19 Jan 2014 13:23:20 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:23:20 - XML: Start document: iteration 2
Sun 19 Jan 2014 13:23:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:23:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:23:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:23:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:23:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:23:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:23:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:23:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:23:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:23:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:23:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:23:32 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:23:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 13:23:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:23:32 - XML: Processed 653276 elements - found 0 jobs
Sun 19 Jan 2014 13:23:32 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:23:32 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:23:32 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:23:32 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:23:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:23:35 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:23:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:23:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:23:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:23:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:23:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:23:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:23:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:23:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43116074
Sun 19 Jan 2014 13:23:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:23:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43116074
Sun 19 Jan 2014 13:23:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:23:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:23:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:23:47 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:23:47 - job_xml_thread(): Done retrieving: data size 43116074
Sun 19 Jan 2014 13:23:47 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:23:47 - XML: Start document: iteration 3
Sun 19 Jan 2014 13:23:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:23:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:23:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:23:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:23:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:23:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:23:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:23:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:23:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:23:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:23:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:23:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:23:55 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:23:55 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:23:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 13:23:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:23:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 13:23:55 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:23:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5872 values 92634 bits 11579 bytes 
Sun 19 Jan 2014 13:24:00 - XML: Processed 647982 elements - found 0 jobs
Sun 19 Jan 2014 13:24:00 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:24:00 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:24:00 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:24:00 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:24:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:24:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:24:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:24:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:24:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:24:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:24:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:24:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:24:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:24:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42901605
Sun 19 Jan 2014 13:24:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:24:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42901605
Sun 19 Jan 2014 13:24:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:24:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:24:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:24:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:24:14 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:24:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:24:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:24:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:24:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:24:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:24:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:24:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42901605
Sun 19 Jan 2014 13:24:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:24:15 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:24:15 - job_xml_thread(): Done retrieving: data size 42901605
Sun 19 Jan 2014 13:24:15 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:24:15 - XML: Start document: iteration 4
Sun 19 Jan 2014 13:24:15 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:24:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 13:24:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:24:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:24:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:24:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:24:24 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:24:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:24:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:24:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:24:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:24:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:24:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:24:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:24:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:24:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:24:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:24:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:24:34 - XML: Processed 645202 elements - found 0 jobs
Sun 19 Jan 2014 13:24:34 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:24:34 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:24:34 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:24:34 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:24:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:24:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:24:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:24:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:24:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:24:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:24:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:24:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43318318
Sun 19 Jan 2014 13:24:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:24:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43318318
Sun 19 Jan 2014 13:24:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:24:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:24:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:24:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:24:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:24:49 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:24:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:24:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:24:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:24:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:24:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:24:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:24:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:24:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:24:52 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:24:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:24:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:24:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:24:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:24:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:24:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:24:54 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 13:24:54 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 13:24:54 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:24:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:24:54 - job_xml_thread(): Done retrieving: data size 43550758
Sun 19 Jan 2014 13:24:54 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:24:54 - XML: Start document: iteration 5
Sun 19 Jan 2014 13:24:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43550758
Sun 19 Jan 2014 13:24:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:24:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43550758
Sun 19 Jan 2014 13:24:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:24:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:24:55 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:24:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:24:57 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:24:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 13:24:57 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:24:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 13:24:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8295 values 130857 bits 16357 bytes 
Sun 19 Jan 2014 13:25:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:25:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:25:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:25:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:25:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:25:13 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:25:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:25:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:25:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:25:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:25:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:25:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:25:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:25:15 - XML: Processed 653146 elements - found 0 jobs
Sun 19 Jan 2014 13:25:15 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:25:15 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:25:15 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:25:15 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:25:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:25:19 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:25:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:25:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:25:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:25:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:25:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:25:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:25:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:25:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562990
Sun 19 Jan 2014 13:25:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:25:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562990
Sun 19 Jan 2014 13:25:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:25:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:25:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:25:30 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:25:30 - job_xml_thread(): Done retrieving: data size 43562990
Sun 19 Jan 2014 13:25:30 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:25:30 - XML: Start document: iteration 6
Sun 19 Jan 2014 13:25:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:25:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:25:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:25:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:25:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:25:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:25:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:25:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:25:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:25:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:25:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:25:42 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 13:25:42 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:25:42 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:25:42 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:25:42 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:25:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:25:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:25:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:25:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:25:44 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:25:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 13:25:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:25:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:25:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:25:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:25:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:25:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:25:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567816
Sun 19 Jan 2014 13:25:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:25:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567816
Sun 19 Jan 2014 13:25:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:25:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:25:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:25:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:25:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:25:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:25:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:25:58 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:25:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:25:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:25:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:25:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:25:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:25:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:25:58 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:25:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:25:59 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:25:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 13:25:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 13:25:59 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:25:59 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5685 values 89600 bits 11200 bytes 
Sun 19 Jan 2014 13:25:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:25:59 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:26:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:26:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:26:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:26:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:26:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:26:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:26:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:26:02 - job_xml_thread(): Done retrieving: data size 43583780
Sun 19 Jan 2014 13:26:02 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:26:02 - XML: Start document: iteration 7
Sun 19 Jan 2014 13:26:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583780
Sun 19 Jan 2014 13:26:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:26:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583780
Sun 19 Jan 2014 13:26:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:26:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:26:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:26:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:26:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:26:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:26:22 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:26:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:26:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:26:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:26:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:26:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:26:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:26:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:26:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:26:24 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:26:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:26:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:26:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:26:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:26:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:26:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:26:25 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 13:26:25 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:26:25 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:26:25 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:26:25 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:26:25 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:26:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 13:26:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:26:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:26:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584609
Sun 19 Jan 2014 13:26:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:26:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584609
Sun 19 Jan 2014 13:26:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:26:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:26:37 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:26:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:26:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:26:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:26:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:26:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:26:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:26:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:26:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:26:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:26:40 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:26:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:26:41 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:26:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:26:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:26:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:26:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:26:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:26:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:26:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:26:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43592914
Sun 19 Jan 2014 13:26:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:26:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43592914
Sun 19 Jan 2014 13:26:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:26:44 - job_xml_thread(): Done retrieving: data size 43592914
Sun 19 Jan 2014 13:26:44 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:26:44 - XML: Start document: iteration 8
Sun 19 Jan 2014 13:26:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:26:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:26:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:26:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:26:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:26:59 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:27:00 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 13:27:00 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:27:00 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:27:00 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:27:00 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:27:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:27:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 13:27:00 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:27:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9042 values 142574 bits 17821 bytes 
Sun 19 Jan 2014 13:27:00 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:27:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 13:27:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:27:00 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:27:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:27:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:27:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:27:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:27:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:27:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:27:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:27:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:27:04 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:27:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:27:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:27:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:27:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:27:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:27:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:27:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:27:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568387
Sun 19 Jan 2014 13:27:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:27:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568387
Sun 19 Jan 2014 13:27:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:27:15 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:27:15 - job_xml_thread(): Done retrieving: data size 43568387
Sun 19 Jan 2014 13:27:15 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:27:15 - XML: Start document: iteration 9
Sun 19 Jan 2014 13:27:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:27:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:27:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:27:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:27:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:27:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:27:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:27:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:27:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:27:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:27:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:27:26 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 13:27:26 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:27:26 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:27:26 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:27:26 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:27:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:27:28 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:27:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:27:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:27:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:27:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:27:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:27:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:27:29 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:27:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 13:27:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:27:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:27:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557124
Sun 19 Jan 2014 13:27:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:27:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557124
Sun 19 Jan 2014 13:27:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:27:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:27:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:27:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:27:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:27:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:27:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:27:42 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:27:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:27:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:27:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:27:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:27:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:27:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:27:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:27:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:27:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:27:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:27:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:27:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:27:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:27:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:27:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:27:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:27:46 - job_xml_thread(): Done retrieving: data size 43588866
Sun 19 Jan 2014 13:27:46 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:27:46 - XML: Start document: iteration 10
Sun 19 Jan 2014 13:27:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43588866
Sun 19 Jan 2014 13:27:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:27:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43588866
Sun 19 Jan 2014 13:27:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:27:56 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 13:27:56 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:27:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:27:57 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:27:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:27:57 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:27:57 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 13:27:57 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 13:27:57 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 13:27:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:27:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:28:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:28:00 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:28:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:28:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 13:28:03 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:28:03 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:28:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 13:28:03 - size of cluster 'LISA Cluster': 624 hosts 79475 metrics 825847 values 13015775 bits 1626971 bytes 
Sun 19 Jan 2014 13:28:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8556 values 134841 bits 16855 bytes 
Sun 19 Jan 2014 13:28:08 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 13:28:08 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:28:08 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:28:08 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:28:08 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:28:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:28:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:28:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:28:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:28:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:28:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:28:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:28:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:28:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:28:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:28:11 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:28:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:28:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:28:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:28:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:28:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:28:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:28:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:28:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43587163
Sun 19 Jan 2014 13:28:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:28:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43587163
Sun 19 Jan 2014 13:28:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:28:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:28:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:28:23 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:28:23 - job_xml_thread(): Done retrieving: data size 43587163
Sun 19 Jan 2014 13:28:23 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:28:23 - XML: Start document: iteration 11
Sun 19 Jan 2014 13:28:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:28:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:28:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:28:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:28:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:28:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:28:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:28:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:28:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:28:32 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 13:28:32 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:28:32 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:28:32 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:28:32 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:28:35 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:28:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 13:28:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:28:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:28:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:28:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:28:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:28:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:28:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:28:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:28:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:28:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:28:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43543983
Sun 19 Jan 2014 13:28:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:28:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43543983
Sun 19 Jan 2014 13:28:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:28:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:28:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:28:48 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:28:48 - job_xml_thread(): Done retrieving: data size 43543983
Sun 19 Jan 2014 13:28:48 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:28:48 - XML: Start document: iteration 12
Sun 19 Jan 2014 13:28:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:28:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:28:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:28:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:28:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:28:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:28:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:28:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:28:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:28:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:28:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:28:57 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:28:57 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 13:28:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:28:58 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:28:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:28:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:28:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:28:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:28:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:28:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:29:02 - XML: Processed 653348 elements - found 0 jobs
Sun 19 Jan 2014 13:29:02 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:29:02 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:29:02 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:29:02 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:29:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:29:03 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:29:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:29:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 13:29:03 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:29:03 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:29:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 13:29:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5666 values 89363 bits 11170 bytes 
Sun 19 Jan 2014 13:29:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:29:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564185
Sun 19 Jan 2014 13:29:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:29:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564185
Sun 19 Jan 2014 13:29:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:29:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:29:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:29:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:29:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:29:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:29:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:29:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:29:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:29:17 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:29:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:29:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:29:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:29:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:29:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:29:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:29:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:29:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:29:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:29:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:29:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:29:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:29:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:29:24 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:29:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 13:29:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:29:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:29:25 - job_xml_thread(): Done retrieving: data size 43494446
Sun 19 Jan 2014 13:29:25 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:29:25 - XML: Start document: iteration 13
Sun 19 Jan 2014 13:29:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43494446
Sun 19 Jan 2014 13:29:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:29:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43494446
Sun 19 Jan 2014 13:29:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:29:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:29:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:29:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:29:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:29:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:29:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:29:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:29:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:29:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:29:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:29:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:29:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:29:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:29:44 - XML: Processed 652600 elements - found 0 jobs
Sun 19 Jan 2014 13:29:44 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:29:44 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:29:44 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:29:44 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:29:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:29:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:29:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:29:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:29:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:29:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:29:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:29:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:29:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:29:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42953153
Sun 19 Jan 2014 13:29:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:29:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42953153
Sun 19 Jan 2014 13:29:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:29:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:29:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:30:00 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:30:00 - job_xml_thread(): Done retrieving: data size 42953153
Sun 19 Jan 2014 13:30:00 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:30:00 - XML: Start document: iteration 14
Sun 19 Jan 2014 13:30:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:30:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:30:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:30:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:30:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:30:04 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:30:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:30:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:30:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:30:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:30:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 13:30:04 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:30:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:30:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:30:04 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:30:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 13:30:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7998 values 126072 bits 15759 bytes 
Sun 19 Jan 2014 13:30:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:30:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:30:12 - XML: Processed 645894 elements - found 0 jobs
Sun 19 Jan 2014 13:30:12 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:30:12 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:30:12 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:30:12 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:30:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:30:15 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:30:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:30:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:30:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:30:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:30:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:30:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:30:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:30:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42934752
Sun 19 Jan 2014 13:30:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:30:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:30:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:30:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42934752
Sun 19 Jan 2014 13:30:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:30:27 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:30:27 - job_xml_thread(): Done retrieving: data size 42934752
Sun 19 Jan 2014 13:30:27 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:30:27 - XML: Start document: iteration 15
Sun 19 Jan 2014 13:30:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:30:28 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:30:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:30:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:30:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:30:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:30:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:30:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:30:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:30:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:30:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:30:38 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:30:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:30:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:30:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 13:30:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:30:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:30:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:30:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:30:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:30:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:30:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:30:39 - XML: Processed 645595 elements - found 0 jobs
Sun 19 Jan 2014 13:30:39 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:30:39 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:30:39 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:30:39 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:30:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:30:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43449627
Sun 19 Jan 2014 13:30:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:30:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43449627
Sun 19 Jan 2014 13:30:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:30:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:30:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:30:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:30:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:30:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:30:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:30:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:30:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:30:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:30:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:30:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:30:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:30:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:30:54 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:30:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:30:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:30:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:30:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:30:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:30:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:30:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:30:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:31:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:31:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563982
Sun 19 Jan 2014 13:31:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:31:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563982
Sun 19 Jan 2014 13:31:00 - job_xml_thread(): Done retrieving: data size 43563982
Sun 19 Jan 2014 13:31:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:31:00 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:31:00 - XML: Start document: iteration 16
Sun 19 Jan 2014 13:31:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:31:04 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:31:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:31:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 13:31:04 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:31:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8996 values 141923 bits 17740 bytes 
Sun 19 Jan 2014 13:31:04 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:31:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 13:31:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:31:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:31:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:31:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:31:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:31:19 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:31:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:31:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:31:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:31:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:31:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:31:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:31:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:31:21 - XML: Processed 653220 elements - found 0 jobs
Sun 19 Jan 2014 13:31:21 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:31:21 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:31:21 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:31:21 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:31:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:31:24 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:31:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:31:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:31:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:31:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:31:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:31:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:31:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:31:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567539
Sun 19 Jan 2014 13:31:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:31:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567539
Sun 19 Jan 2014 13:31:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:31:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:31:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:31:36 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:31:36 - job_xml_thread(): Done retrieving: data size 43567539
Sun 19 Jan 2014 13:31:36 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:31:36 - XML: Start document: iteration 17
Sun 19 Jan 2014 13:31:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:31:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:31:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:31:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:31:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:31:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:31:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:31:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:31:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:31:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:31:51 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 13:31:51 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:31:51 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:31:51 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:31:51 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:31:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:31:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:31:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:31:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:31:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:31:51 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:31:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 13:31:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:31:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:31:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:31:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:31:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:31:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:31:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579996
Sun 19 Jan 2014 13:31:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:31:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579996
Sun 19 Jan 2014 13:31:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:32:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:32:04 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:32:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:32:04 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:32:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:32:05 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:32:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 13:32:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 13:32:05 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:32:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5988 values 94680 bits 11835 bytes 
Sun 19 Jan 2014 13:32:06 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:32:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:32:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:32:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:32:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:32:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:32:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:32:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:32:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:32:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:32:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:32:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:32:10 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 13:32:10 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 13:32:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:32:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:32:10 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:32:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:32:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:32:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:32:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:32:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:32:12 - job_xml_thread(): Done retrieving: data size 43580135
Sun 19 Jan 2014 13:32:12 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:32:12 - XML: Start document: iteration 18
Sun 19 Jan 2014 13:32:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580135
Sun 19 Jan 2014 13:32:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:32:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580135
Sun 19 Jan 2014 13:32:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:32:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:32:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:32:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:32:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:32:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:32:27 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:32:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:32:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:32:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:32:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:32:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:32:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:32:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:32:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:32:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:32:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:32:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:32:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:32:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:32:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:32:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:32:35 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 13:32:35 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:32:35 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:32:35 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:32:35 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:32:36 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:32:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 13:32:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:32:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:32:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558430
Sun 19 Jan 2014 13:32:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:32:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558430
Sun 19 Jan 2014 13:32:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:32:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:32:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:32:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:32:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:32:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:32:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:32:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:32:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:32:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:32:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:32:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:32:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:32:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:32:51 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:32:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:32:52 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:32:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:32:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:32:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:32:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:32:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:32:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:32:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:32:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583433
Sun 19 Jan 2014 13:32:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:32:54 - job_xml_thread(): Done retrieving: data size 43583433
Sun 19 Jan 2014 13:32:54 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:32:54 - XML: Start document: iteration 19
Sun 19 Jan 2014 13:32:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583433
Sun 19 Jan 2014 13:32:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:33:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:33:03 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:33:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:33:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:33:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:33:05 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:33:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:33:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:33:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:33:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:33:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:33:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:33:06 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:33:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 13:33:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 13:33:06 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:33:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9018 values 142662 bits 17832 bytes 
Sun 19 Jan 2014 13:33:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:33:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:33:14 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 13:33:14 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:33:14 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:33:14 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:33:14 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:33:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:33:16 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:33:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:33:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:33:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:33:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:33:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:33:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:33:18 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:33:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 13:33:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:33:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:33:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568937
Sun 19 Jan 2014 13:33:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:33:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568937
Sun 19 Jan 2014 13:33:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:33:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:33:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:33:29 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:33:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:33:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:33:31 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:33:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:33:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:33:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:33:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:33:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:33:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:33:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:33:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:33:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:33:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:33:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:33:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:33:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:33:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:33:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:33:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:33:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:33:34 - job_xml_thread(): Done retrieving: data size 43571015
Sun 19 Jan 2014 13:33:34 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:33:34 - XML: Start document: iteration 20
Sun 19 Jan 2014 13:33:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571015
Sun 19 Jan 2014 13:33:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:33:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571015
Sun 19 Jan 2014 13:33:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:33:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:33:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:33:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:33:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:33:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:33:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:33:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:33:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:33:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:33:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:33:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:33:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:33:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:33:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:33:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:33:56 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 13:33:56 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:33:56 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:33:56 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:33:56 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:33:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:33:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:33:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:33:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:33:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:33:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:33:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:33:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569759
Sun 19 Jan 2014 13:33:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:33:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569759
Sun 19 Jan 2014 13:33:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:34:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:34:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:34:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:34:06 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:34:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:34:06 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:34:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 13:34:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 13:34:06 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:34:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148737 bits 18592 bytes 
Sun 19 Jan 2014 13:34:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:34:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:34:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:34:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:34:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:34:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:34:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:34:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:34:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:34:11 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:34:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:34:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:34:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:34:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:34:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:34:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:34:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:34:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:34:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:34:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:34:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:34:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43586519
Sun 19 Jan 2014 13:34:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:34:15 - job_xml_thread(): Done retrieving: data size 43586519
Sun 19 Jan 2014 13:34:15 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:34:15 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 13:34:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43586519
Sun 19 Jan 2014 13:34:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:34:15 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 13:34:15 - Housekeeping: done.
Sun 19 Jan 2014 13:34:15 - XML: Start document: iteration 0
Sun 19 Jan 2014 13:34:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:34:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:34:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:34:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:34:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:34:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:34:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:34:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:34:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:34:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:34:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:34:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:34:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:34:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:34:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:34:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:34:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:34:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:34:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:34:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:34:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:34:38 - XML: Processed 653349 elements - found 0 jobs
Sun 19 Jan 2014 13:34:38 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:34:38 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:34:38 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:34:38 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:34:38 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:34:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 13:34:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:34:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:34:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579387
Sun 19 Jan 2014 13:34:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:34:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579387
Sun 19 Jan 2014 13:34:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:34:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:34:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:34:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:34:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:34:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:34:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:34:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:34:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:34:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:34:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:34:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:34:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:34:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:34:53 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:34:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:34:53 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:34:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:34:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:34:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:34:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:34:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:34:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:34:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:34:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43594342
Sun 19 Jan 2014 13:34:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:34:56 - job_xml_thread(): Done retrieving: data size 43594342
Sun 19 Jan 2014 13:34:56 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:34:56 - XML: Start document: iteration 1
Sun 19 Jan 2014 13:34:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43594342
Sun 19 Jan 2014 13:34:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:34:57 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 13:34:57 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:35:00 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:35:00 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 13:35:00 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 13:35:00 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:35:01 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 13:35:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:35:06 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:35:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:35:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:35:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:35:08 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:35:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 13:35:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 13:35:08 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:35:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8902 values 140385 bits 17548 bytes 
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sun 19 Jan 2014 13:35:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:35:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:35:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:35:13 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:35:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:35:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:35:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:35:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:35:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:35:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:35:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:35:17 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 13:35:17 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:35:17 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:35:17 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:35:17 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:35:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:35:18 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:35:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:35:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:35:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:35:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:35:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:35:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:35:20 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:35:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 13:35:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:35:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:35:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43490537
Sun 19 Jan 2014 13:35:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:35:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43490537
Sun 19 Jan 2014 13:35:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:35:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:35:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:35:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:35:31 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:35:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:35:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:35:32 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:35:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:35:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:35:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:35:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:35:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:35:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:35:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:35:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:35:34 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:35:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:35:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:35:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:35:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:35:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:35:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:35:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:35:36 - job_xml_thread(): Done retrieving: data size 42997850
Sun 19 Jan 2014 13:35:36 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:35:36 - XML: Start document: iteration 2
Sun 19 Jan 2014 13:35:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42997850
Sun 19 Jan 2014 13:35:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42997850
Sun 19 Jan 2014 13:35:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:35:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:35:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:35:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:35:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:35:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:35:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:35:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:35:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:35:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:35:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:35:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:35:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:35:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:35:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:35:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:35:58 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:35:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:35:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:35:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:35:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:35:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:35:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:35:59 - XML: Processed 646324 elements - found 0 jobs
Sun 19 Jan 2014 13:35:59 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:35:59 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:35:59 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:35:59 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:36:01 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:36:01 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:36:01 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:36:01 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 13:36:01 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 13:36:01 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:36:01 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 13:36:02 - size of cluster 'LISA Cluster': 624 hosts 79461 metrics 868816 values 13713057 bits 1714132 bytes 
Sun 19 Jan 2014 13:36:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:36:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42910970
Sun 19 Jan 2014 13:36:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:36:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42910970
Sun 19 Jan 2014 13:36:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:36:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:36:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:36:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:36:08 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:36:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:36:09 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:36:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 13:36:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 13:36:09 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:36:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:36:10 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:36:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148611 bits 18576 bytes 
Sun 19 Jan 2014 13:36:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:36:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:36:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:36:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:36:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:36:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:36:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:36:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:36:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:36:14 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:36:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:36:17 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:36:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:36:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:36:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:36:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:36:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:36:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:36:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:36:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42959862
Sun 19 Jan 2014 13:36:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:36:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42959862
Sun 19 Jan 2014 13:36:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:36:21 - job_xml_thread(): Done retrieving: data size 42959862
Sun 19 Jan 2014 13:36:21 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:36:21 - XML: Start document: iteration 3
Sun 19 Jan 2014 13:36:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:36:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:36:32 - XML: Processed 645786 elements - found 0 jobs
Sun 19 Jan 2014 13:36:32 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:36:32 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:36:32 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:36:32 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:36:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:36:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:36:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:36:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:36:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:36:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:36:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:36:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:36:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:36:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:36:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:36:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:36:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:36:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:36:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:36:44 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:36:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 13:36:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:36:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:36:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:36:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:36:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:36:47 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:36:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:36:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43459638
Sun 19 Jan 2014 13:36:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:36:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43459638
Sun 19 Jan 2014 13:36:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:36:48 - job_xml_thread(): Done retrieving: data size 43459638
Sun 19 Jan 2014 13:36:48 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:36:48 - XML: Start document: iteration 4
Sun 19 Jan 2014 13:36:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:36:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:37:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:37:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:37:01 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:37:01 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 13:37:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:37:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:37:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:37:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:37:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:37:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:37:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:37:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:37:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:37:05 - XML: Processed 651910 elements - found 0 jobs
Sun 19 Jan 2014 13:37:05 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:37:05 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:37:05 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:37:05 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:37:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:37:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:37:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:37:10 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:37:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:37:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:37:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:37:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 13:37:10 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:37:10 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:37:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 13:37:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5686 values 89597 bits 11199 bytes 
Sun 19 Jan 2014 13:37:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:37:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:37:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:37:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:37:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:37:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574064
Sun 19 Jan 2014 13:37:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:37:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574064
Sun 19 Jan 2014 13:37:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:37:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:37:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:37:20 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:37:20 - job_xml_thread(): Done retrieving: data size 43574064
Sun 19 Jan 2014 13:37:20 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:37:20 - XML: Start document: iteration 5
Sun 19 Jan 2014 13:37:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:37:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:37:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:37:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:37:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:37:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:37:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:37:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:37:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:37:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:37:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:37:35 - XML: Processed 653347 elements - found 0 jobs
Sun 19 Jan 2014 13:37:35 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:37:35 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:37:35 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:37:35 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:37:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:37:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:37:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:37:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:37:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:37:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:37:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:37:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:37:39 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:37:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 13:37:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:37:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:37:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560745
Sun 19 Jan 2014 13:37:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:37:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560745
Sun 19 Jan 2014 13:37:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:37:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:37:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:37:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:37:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:37:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:37:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:37:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:37:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:37:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:37:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:37:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560745
Sun 19 Jan 2014 13:37:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:37:50 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:37:50 - job_xml_thread(): Done retrieving: data size 43560745
Sun 19 Jan 2014 13:37:50 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:37:50 - XML: Start document: iteration 6
Sun 19 Jan 2014 13:37:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:37:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:38:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:38:00 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:38:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:38:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:38:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:38:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:38:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:38:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:38:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:38:10 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 13:38:10 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:38:10 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:38:10 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:38:10 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:38:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:38:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:38:11 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:38:11 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:38:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:38:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 13:38:11 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:38:11 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:38:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 13:38:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 4993 values 78750 bits 9843 bytes 
Sun 19 Jan 2014 13:38:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:38:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:38:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:38:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:38:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:38:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:38:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:38:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43585682
Sun 19 Jan 2014 13:38:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:38:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43585682
Sun 19 Jan 2014 13:38:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:38:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:38:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:38:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:38:25 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:38:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:38:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:38:25 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:38:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:38:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:38:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:38:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:38:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:38:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:38:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:38:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:38:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:38:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:38:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:38:30 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:38:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 13:38:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:38:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:38:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:38:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:38:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:38:32 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 13:38:32 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 13:38:32 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:38:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:38:33 - job_xml_thread(): Done retrieving: data size 43566957
Sun 19 Jan 2014 13:38:33 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:38:33 - XML: Start document: iteration 7
Sun 19 Jan 2014 13:38:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566957
Sun 19 Jan 2014 13:38:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566957
Sun 19 Jan 2014 13:38:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:38:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:38:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:38:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:38:46 - XML: Processed 653349 elements - found 0 jobs
Sun 19 Jan 2014 13:38:46 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:38:46 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:38:46 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:38:46 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:38:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:38:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:38:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:38:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:38:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:38:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:38:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:38:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:38:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:38:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:38:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:38:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:38:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:38:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:38:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:38:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:38:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:38:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:38:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:38:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:38:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43599574
Sun 19 Jan 2014 13:38:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:38:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43599574
Sun 19 Jan 2014 13:38:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:39:01 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:39:01 - job_xml_thread(): Done retrieving: data size 43599574
Sun 19 Jan 2014 13:39:01 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:39:01 - XML: Start document: iteration 8
Sun 19 Jan 2014 13:39:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:39:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:39:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:39:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:39:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:39:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:39:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:39:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:39:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:39:11 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:39:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:39:11 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:39:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:39:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:39:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:39:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:39:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:39:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 13:39:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 13:39:12 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:39:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8870 values 139866 bits 17483 bytes 
Sun 19 Jan 2014 13:39:14 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 13:39:14 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:39:14 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:39:14 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:39:14 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:39:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:39:18 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:39:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:39:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:39:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:39:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:39:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:39:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:39:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:39:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554566
Sun 19 Jan 2014 13:39:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:39:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554566
Sun 19 Jan 2014 13:39:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:39:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:39:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:39:29 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:39:29 - job_xml_thread(): Done retrieving: data size 43554566
Sun 19 Jan 2014 13:39:29 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:39:29 - XML: Start document: iteration 9
Sun 19 Jan 2014 13:39:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:39:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:39:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:39:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:39:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:39:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:39:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:39:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:39:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:39:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:39:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:39:43 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 13:39:43 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:39:43 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:39:43 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:39:43 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:39:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:39:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:39:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:39:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:39:44 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:39:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 13:39:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:39:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:39:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:39:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:39:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:39:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:39:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570537
Sun 19 Jan 2014 13:39:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:39:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570537
Sun 19 Jan 2014 13:39:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:39:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:39:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:39:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:39:54 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:39:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:39:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:39:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:39:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:39:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:39:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:39:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570537
Sun 19 Jan 2014 13:39:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:39:58 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:39:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:39:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:40:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:40:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:40:06 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:40:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:40:07 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:40:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:40:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:40:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:40:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:40:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:40:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:40:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:40:09 - job_xml_thread(): Done retrieving: data size 43561791
Sun 19 Jan 2014 13:40:09 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:40:09 - XML: Start document: iteration 10
Sun 19 Jan 2014 13:40:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:40:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561791
Sun 19 Jan 2014 13:40:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:40:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:40:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:40:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:40:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:40:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:40:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561791
Sun 19 Jan 2014 13:40:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:40:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:40:12 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:40:13 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:40:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:40:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 13:40:13 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:40:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 13:40:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8703 values 137157 bits 17144 bytes 
Sun 19 Jan 2014 13:40:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:40:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:40:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:40:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:40:24 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 13:40:24 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:40:24 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:40:24 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:40:24 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:40:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:40:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:40:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:40:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:40:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:40:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:40:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:40:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:40:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:40:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:40:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:40:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:40:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:40:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:40:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:40:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:40:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563053
Sun 19 Jan 2014 13:40:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:40:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563053
Sun 19 Jan 2014 13:40:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:40:39 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:40:39 - job_xml_thread(): Done retrieving: data size 43563053
Sun 19 Jan 2014 13:40:39 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:40:39 - XML: Start document: iteration 11
Sun 19 Jan 2014 13:40:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:40:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:40:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:40:43 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:40:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:40:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:40:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:40:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:40:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:40:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:40:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:40:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:40:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:40:52 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 13:40:52 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:40:52 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:40:52 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:40:52 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:40:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:40:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:40:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:40:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:40:56 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:40:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 13:40:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:40:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:40:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:40:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:40:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:40:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:40:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553062
Sun 19 Jan 2014 13:40:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:40:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553062
Sun 19 Jan 2014 13:40:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:41:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:41:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:41:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:41:07 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:41:07 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:41:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:41:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:41:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:41:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:41:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:41:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:41:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:41:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:41:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:41:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:41:11 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:41:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:41:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:41:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:41:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:41:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:41:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:41:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:41:13 - job_xml_thread(): Done retrieving: data size 43511280
Sun 19 Jan 2014 13:41:13 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:41:13 - XML: Start document: iteration 12
Sun 19 Jan 2014 13:41:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:41:14 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:41:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43511280
Sun 19 Jan 2014 13:41:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43511280
Sun 19 Jan 2014 13:41:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:41:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:41:14 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:41:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:41:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 13:41:14 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:41:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5708 values 89991 bits 11248 bytes 
Sun 19 Jan 2014 13:41:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 13:41:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:41:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:41:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:41:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:41:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:41:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:41:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:41:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:41:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:41:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:41:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:41:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:41:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:41:31 - XML: Processed 652600 elements - found 0 jobs
Sun 19 Jan 2014 13:41:31 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:41:32 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:41:32 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:41:32 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:41:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:41:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:41:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:41:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:41:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:41:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:41:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:41:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:41:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:41:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43134095
Sun 19 Jan 2014 13:41:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:41:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43134095
Sun 19 Jan 2014 13:41:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:41:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:41:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:41:47 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:41:47 - job_xml_thread(): Done retrieving: data size 43134095
Sun 19 Jan 2014 13:41:47 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:41:47 - XML: Start document: iteration 13
Sun 19 Jan 2014 13:41:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:41:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:41:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:41:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:41:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:41:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:41:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:41:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:41:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:41:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:41:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:41:54 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:41:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 13:41:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:41:59 - XML: Processed 648154 elements - found 0 jobs
Sun 19 Jan 2014 13:41:59 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:41:59 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:41:59 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:41:59 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:42:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:42:01 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:42:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:42:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:42:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:42:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:42:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:42:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:42:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:42:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42894738
Sun 19 Jan 2014 13:42:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:42:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42894738
Sun 19 Jan 2014 13:42:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:42:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:42:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:42:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:42:13 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:42:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:42:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:42:14 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:42:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:42:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:42:15 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:42:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:42:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:42:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:42:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:42:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:42:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 13:42:16 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:42:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6012 values 94789 bits 11848 bytes 
Sun 19 Jan 2014 13:42:16 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:42:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 13:42:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:42:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:42:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:42:17 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:42:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:42:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:42:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:42:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:42:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:42:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:42:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:42:19 - job_xml_thread(): Done retrieving: data size 42970013
Sun 19 Jan 2014 13:42:19 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:42:19 - XML: Start document: iteration 14
Sun 19 Jan 2014 13:42:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42970013
Sun 19 Jan 2014 13:42:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:42:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42970013
Sun 19 Jan 2014 13:42:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:42:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:42:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:42:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:42:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:42:39 - XML: Processed 645900 elements - found 0 jobs
Sun 19 Jan 2014 13:42:40 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:42:40 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:42:40 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:42:40 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:42:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:42:42 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:42:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:42:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:42:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:42:43 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:42:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:42:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:42:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:42:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:42:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:42:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:42:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:42:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:42:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:42:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:42:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:42:44 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:42:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 13:42:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:42:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:42:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43490431
Sun 19 Jan 2014 13:42:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:42:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43490431
Sun 19 Jan 2014 13:42:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:42:55 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:42:55 - job_xml_thread(): Done retrieving: data size 43490431
Sun 19 Jan 2014 13:42:55 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:42:55 - XML: Start document: iteration 15
Sun 19 Jan 2014 13:42:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:42:58 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:42:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:42:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:42:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:42:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:43:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:43:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:43:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:43:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:43:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:43:01 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 13:43:01 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:43:02 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:43:02 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:43:02 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 13:43:02 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 13:43:02 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 13:43:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:43:11 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:43:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:43:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:43:11 - XML: Processed 652370 elements - found 0 jobs
Sun 19 Jan 2014 13:43:11 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:43:11 - size of cluster 'LISA Cluster': 624 hosts 79487 metrics 936012 values 14759422 bits 1844927 bytes 
Sun 19 Jan 2014 13:43:11 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:43:11 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:43:11 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:43:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:43:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:43:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:43:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:43:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:43:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43551537
Sun 19 Jan 2014 13:43:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:43:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43551537
Sun 19 Jan 2014 13:43:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:43:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:43:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:43:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:43:16 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:43:16 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:43:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:43:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 13:43:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 13:43:16 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:43:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8208 values 129460 bits 16182 bytes 
Sun 19 Jan 2014 13:43:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:43:22 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:43:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:43:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:43:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:43:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:43:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:43:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43551537
Sun 19 Jan 2014 13:43:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:43:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:43:26 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:43:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:43:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:43:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:43:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:43:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:43:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:43:37 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:43:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:43:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:43:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:43:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:43:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:43:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:43:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:43:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:43:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:43:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:43:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:43:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:43:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:43:41 - job_xml_thread(): Done retrieving: data size 43550475
Sun 19 Jan 2014 13:43:41 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:43:41 - XML: Start document: iteration 16
Sun 19 Jan 2014 13:43:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43550475
Sun 19 Jan 2014 13:43:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43550475
Sun 19 Jan 2014 13:43:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:43:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:43:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:43:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:43:52 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:43:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 13:43:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:43:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:43:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:43:58 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 13:43:58 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:43:58 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:43:58 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:43:58 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:44:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:44:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:44:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:44:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:44:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:44:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:44:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:44:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:44:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:44:02 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:44:02 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 13:44:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:44:05 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:44:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:44:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:44:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:44:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:44:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:44:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:44:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:44:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570577
Sun 19 Jan 2014 13:44:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:44:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570577
Sun 19 Jan 2014 13:44:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:44:13 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:44:13 - job_xml_thread(): Done retrieving: data size 43570577
Sun 19 Jan 2014 13:44:13 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:44:13 - XML: Start document: iteration 17
Sun 19 Jan 2014 13:44:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:44:17 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:44:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:44:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:44:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:44:18 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:44:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 13:44:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 13:44:18 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:44:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6298 values 99292 bits 12411 bytes 
Sun 19 Jan 2014 13:44:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:44:20 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:44:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:44:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:44:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:44:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:44:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:44:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:44:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:44:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:44:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:44:29 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 13:44:29 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:44:29 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:44:29 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:44:29 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:44:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:44:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:44:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:44:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:44:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:44:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:44:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:44:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:44:37 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:44:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 13:44:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:44:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:44:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43546526
Sun 19 Jan 2014 13:44:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:44:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43546526
Sun 19 Jan 2014 13:44:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:44:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:44:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:44:44 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:44:44 - job_xml_thread(): Done retrieving: data size 43546526
Sun 19 Jan 2014 13:44:44 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:44:44 - XML: Start document: iteration 18
Sun 19 Jan 2014 13:44:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:44:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:44:55 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 13:44:55 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:44:55 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:44:55 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:44:55 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:44:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:44:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:44:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:44:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:44:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:44:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:44:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:44:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:44:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:45:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:45:00 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:45:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:45:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:45:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:45:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:45:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:45:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:45:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:45:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566950
Sun 19 Jan 2014 13:45:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:45:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566950
Sun 19 Jan 2014 13:45:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:45:10 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:45:10 - job_xml_thread(): Done retrieving: data size 43566950
Sun 19 Jan 2014 13:45:10 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:45:10 - XML: Start document: iteration 19
Sun 19 Jan 2014 13:45:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:45:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:45:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:45:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:45:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:45:18 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:45:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:45:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:45:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 13:45:20 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:45:20 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:45:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 13:45:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:45:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99052 bits 12381 bytes 
Sun 19 Jan 2014 13:45:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:45:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:45:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:45:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:45:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:45:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:45:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:45:22 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 13:45:22 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:45:22 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:45:22 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:45:22 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:45:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:45:25 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:45:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:45:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:45:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:45:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:45:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:45:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:45:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:45:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584850
Sun 19 Jan 2014 13:45:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:45:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584850
Sun 19 Jan 2014 13:45:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:45:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:45:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:45:37 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:45:37 - job_xml_thread(): Done retrieving: data size 43584850
Sun 19 Jan 2014 13:45:37 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:45:37 - XML: Start document: iteration 20
Sun 19 Jan 2014 13:45:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:45:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:45:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:45:43 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:45:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:45:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:45:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:45:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:45:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:45:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:45:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:45:49 - XML: Processed 653348 elements - found 0 jobs
Sun 19 Jan 2014 13:45:49 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:45:49 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:45:49 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:45:49 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:45:50 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:45:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 13:45:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:45:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:45:51 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:45:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:45:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:45:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:45:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:45:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:45:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:45:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:45:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563010
Sun 19 Jan 2014 13:45:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:45:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563010
Sun 19 Jan 2014 13:45:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:45:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:45:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:46:04 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:46:04 - job_xml_thread(): Done retrieving: data size 43563010
Sun 19 Jan 2014 13:46:04 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:46:04 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 13:46:04 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 13:46:04 - Housekeeping: done.
Sun 19 Jan 2014 13:46:04 - XML: Start document: iteration 0
Sun 19 Jan 2014 13:46:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:46:06 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:46:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:46:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:46:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:46:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:46:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:46:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:46:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:46:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:46:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:46:13 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 13:46:13 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:46:13 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:46:13 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:46:13 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:46:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:46:15 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:46:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:46:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:46:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:46:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:46:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:46:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:46:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:46:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43548520
Sun 19 Jan 2014 13:46:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:46:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43548520
Sun 19 Jan 2014 13:46:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:46:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:46:21 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:46:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:46:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 13:46:21 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:46:21 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:46:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8931 values 140996 bits 17624 bytes 
Sun 19 Jan 2014 13:46:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 13:46:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:46:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:46:28 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:46:29 - job_xml_thread(): Done retrieving: data size 43548520
Sun 19 Jan 2014 13:46:29 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:46:29 - XML: Start document: iteration 1
Sun 19 Jan 2014 13:46:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:46:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:46:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:46:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:46:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:46:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:46:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:46:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:46:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:46:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:46:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:46:41 - XML: Processed 653348 elements - found 0 jobs
Sun 19 Jan 2014 13:46:41 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:46:41 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:46:41 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:46:41 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:46:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:46:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:46:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:46:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:46:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:46:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:46:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:46:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:46:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:46:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43551168
Sun 19 Jan 2014 13:46:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:46:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43551168
Sun 19 Jan 2014 13:46:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:46:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:46:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:46:55 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:46:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 13:46:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:46:56 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:46:56 - job_xml_thread(): Done retrieving: data size 43551168
Sun 19 Jan 2014 13:46:56 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:46:56 - XML: Start document: iteration 2
Sun 19 Jan 2014 13:46:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:46:57 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:46:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:46:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:46:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:46:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:46:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:46:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:46:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:46:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:46:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:47:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:47:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:47:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:47:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:47:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:47:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:47:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:47:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:47:11 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 13:47:11 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:47:11 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:47:11 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:47:11 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:47:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:47:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:47:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:47:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561458
Sun 19 Jan 2014 13:47:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:47:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561458
Sun 19 Jan 2014 13:47:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:47:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:47:21 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:47:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:47:21 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:47:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 13:47:21 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:47:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 13:47:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6169 values 97555 bits 12194 bytes 
Sun 19 Jan 2014 13:47:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:47:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:47:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:47:25 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:47:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:47:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:47:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:47:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:47:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:47:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:47:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:47:26 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:47:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:47:29 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:47:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:47:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:47:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:47:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:47:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:47:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:47:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:47:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43150270
Sun 19 Jan 2014 13:47:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:47:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43150270
Sun 19 Jan 2014 13:47:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:47:33 - job_xml_thread(): Done retrieving: data size 43150270
Sun 19 Jan 2014 13:47:33 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:47:33 - XML: Start document: iteration 3
Sun 19 Jan 2014 13:47:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:47:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:47:44 - XML: Processed 648278 elements - found 0 jobs
Sun 19 Jan 2014 13:47:44 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:47:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:47:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:47:45 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:47:45 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:47:45 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:47:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:47:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:47:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:47:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:47:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:47:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:47:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:47:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:47:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:47:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:47:55 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:47:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:47:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:47:55 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:47:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 13:47:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:47:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:47:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:47:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:47:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:47:56 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 13:47:56 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 13:47:56 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:47:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:47:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42938261
Sun 19 Jan 2014 13:47:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:47:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42938261
Sun 19 Jan 2014 13:47:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:48:00 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:48:00 - job_xml_thread(): Done retrieving: data size 42938261
Sun 19 Jan 2014 13:48:00 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:48:00 - XML: Start document: iteration 4
Sun 19 Jan 2014 13:48:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:48:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:48:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:48:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:48:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:48:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:48:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:48:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:48:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:48:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:48:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:48:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:48:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:48:15 - XML: Processed 645230 elements - found 0 jobs
Sun 19 Jan 2014 13:48:15 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:48:15 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:48:15 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:48:15 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:48:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:48:18 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:48:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:48:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:48:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:48:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:48:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:48:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:48:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:48:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42951004
Sun 19 Jan 2014 13:48:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:48:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42951004
Sun 19 Jan 2014 13:48:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:48:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:48:22 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:48:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:48:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 13:48:22 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:48:22 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:48:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 13:48:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9055 values 143105 bits 17888 bytes 
Sun 19 Jan 2014 13:48:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:48:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:48:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:48:30 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:48:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:48:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:48:30 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:48:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:48:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:48:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:48:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:48:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:48:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:48:34 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:48:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:48:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:48:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:48:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:48:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:48:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:48:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:48:36 - job_xml_thread(): Done retrieving: data size 43343116
Sun 19 Jan 2014 13:48:36 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:48:36 - XML: Start document: iteration 5
Sun 19 Jan 2014 13:48:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43343116
Sun 19 Jan 2014 13:48:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:48:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43343116
Sun 19 Jan 2014 13:48:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:48:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:48:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:48:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:48:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:48:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:48:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:48:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:48:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:48:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:48:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:48:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:48:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:48:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:48:58 - XML: Processed 650562 elements - found 0 jobs
Sun 19 Jan 2014 13:48:58 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:48:58 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:48:58 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:48:58 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:48:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:48:59 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:48:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:48:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:48:59 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:48:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 13:48:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:49:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:49:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:49:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:49:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:49:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:49:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554586
Sun 19 Jan 2014 13:49:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:49:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554586
Sun 19 Jan 2014 13:49:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:49:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:49:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:49:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:49:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:49:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:49:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:49:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:49:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:49:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:49:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:49:13 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:49:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:49:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:49:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:49:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:49:15 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:49:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:49:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:49:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:49:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:49:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:49:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:49:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:49:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564397
Sun 19 Jan 2014 13:49:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:49:18 - job_xml_thread(): Done retrieving: data size 43564397
Sun 19 Jan 2014 13:49:18 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:49:18 - XML: Start document: iteration 6
Sun 19 Jan 2014 13:49:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564397
Sun 19 Jan 2014 13:49:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:49:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:49:22 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:49:24 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:49:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 13:49:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:49:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 13:49:24 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:49:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9101 values 143592 bits 17949 bytes 
Sun 19 Jan 2014 13:49:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:49:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:49:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:49:29 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:49:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:49:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:49:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:49:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:49:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:49:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:49:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:49:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:49:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:49:38 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 13:49:39 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:49:39 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:49:39 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:49:39 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:49:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:49:41 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:49:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:49:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:49:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:49:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:49:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:49:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:49:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:49:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561650
Sun 19 Jan 2014 13:49:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:49:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561650
Sun 19 Jan 2014 13:49:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:49:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:49:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:49:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:49:54 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:49:54 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:49:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:49:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:49:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:49:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:49:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:49:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:49:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:49:55 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:49:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 13:49:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:49:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:49:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:49:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:49:59 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:49:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:49:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:49:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:49:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:49:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:49:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:50:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:50:00 - job_xml_thread(): Done retrieving: data size 43574550
Sun 19 Jan 2014 13:50:00 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:50:00 - XML: Start document: iteration 7
Sun 19 Jan 2014 13:50:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574550
Sun 19 Jan 2014 13:50:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:50:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574550
Sun 19 Jan 2014 13:50:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:50:03 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 13:50:03 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:50:06 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:50:06 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 13:50:06 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 13:50:06 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:50:06 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 13:50:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:50:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:50:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:50:14 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:50:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:50:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:50:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:50:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:50:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:50:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:50:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:50:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:50:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:50:18 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 13:50:18 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:50:18 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:50:18 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:50:19 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:50:19 - size of cluster 'LISA Cluster': 624 hosts 79472 metrics 750936 values 11856890 bits 1482111 bytes 
Sun 19 Jan 2014 13:50:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:50:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:50:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:50:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:50:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:50:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:50:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:50:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:50:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:50:24 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:50:25 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:50:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:50:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 13:50:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 13:50:25 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:50:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6128 values 96670 bits 12083 bytes 
Sun 19 Jan 2014 13:50:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:50:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575217
Sun 19 Jan 2014 13:50:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:50:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575217
Sun 19 Jan 2014 13:50:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:50:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:50:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:50:34 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:50:34 - job_xml_thread(): Done retrieving: data size 43575217
Sun 19 Jan 2014 13:50:34 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:50:34 - XML: Start document: iteration 8
Sun 19 Jan 2014 13:50:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:50:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:50:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:50:45 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:50:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:50:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:50:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:50:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:50:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:50:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:50:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:50:47 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 13:50:47 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:50:47 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:50:47 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:50:47 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:50:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:50:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:50:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:50:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:50:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:50:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:50:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:50:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:50:53 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:50:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 13:50:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:50:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:50:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566501
Sun 19 Jan 2014 13:50:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:50:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566501
Sun 19 Jan 2014 13:50:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:51:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:51:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:51:02 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:51:02 - job_xml_thread(): Done retrieving: data size 43566501
Sun 19 Jan 2014 13:51:02 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:51:03 - XML: Start document: iteration 9
Sun 19 Jan 2014 13:51:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:51:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:51:07 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:51:07 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 13:51:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:51:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:51:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:51:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:51:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:51:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:51:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:51:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:51:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:51:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:51:16 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:51:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:51:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:51:17 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 13:51:17 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:51:17 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:51:17 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:51:17 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:51:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:51:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:51:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:51:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:51:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:51:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562238
Sun 19 Jan 2014 13:51:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:51:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562238
Sun 19 Jan 2014 13:51:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:51:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:51:25 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:51:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:51:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:51:26 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:51:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:51:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 13:51:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 13:51:26 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:51:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7500 values 118298 bits 14787 bytes 
Sun 19 Jan 2014 13:51:32 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:51:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:51:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:51:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:51:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:51:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:51:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:51:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:51:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:51:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:51:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:51:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:51:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:51:36 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:51:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:51:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:51:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:51:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:51:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:51:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:51:40 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:51:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 13:51:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:51:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:51:40 - job_xml_thread(): Done retrieving: data size 43565552
Sun 19 Jan 2014 13:51:40 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:51:40 - XML: Start document: iteration 10
Sun 19 Jan 2014 13:51:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565552
Sun 19 Jan 2014 13:51:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:51:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565552
Sun 19 Jan 2014 13:51:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:51:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:51:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:51:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:51:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:51:58 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 13:51:58 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:51:58 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:51:58 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:51:58 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:51:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:51:59 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:51:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:51:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:52:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:52:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:52:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:52:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:52:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:52:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:52:03 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:52:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:52:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:52:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:52:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:52:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:52:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:52:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:52:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563485
Sun 19 Jan 2014 13:52:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:52:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563485
Sun 19 Jan 2014 13:52:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:52:13 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:52:13 - job_xml_thread(): Done retrieving: data size 43563485
Sun 19 Jan 2014 13:52:13 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:52:13 - XML: Start document: iteration 11
Sun 19 Jan 2014 13:52:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:52:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:52:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:52:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:52:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:52:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:52:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:52:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:52:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:52:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:52:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:52:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:52:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:52:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:52:26 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:52:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:52:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 13:52:27 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:52:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99031 bits 12378 bytes 
Sun 19 Jan 2014 13:52:27 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:52:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 13:52:29 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 13:52:29 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:52:29 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:52:29 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:52:29 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:52:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:52:29 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:52:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:52:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:52:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:52:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:52:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:52:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:52:33 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:52:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 13:52:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:52:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:52:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43550060
Sun 19 Jan 2014 13:52:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:52:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:52:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:52:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43550060
Sun 19 Jan 2014 13:52:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:52:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:52:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:52:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:52:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:52:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:52:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:52:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:52:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:52:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43550060
Sun 19 Jan 2014 13:52:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:52:45 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:52:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:52:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:52:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:52:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:52:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:52:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:52:55 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:52:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:52:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:52:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:52:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:52:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:52:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:52:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:52:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:52:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:52:58 - job_xml_thread(): Done retrieving: data size 43562889
Sun 19 Jan 2014 13:52:58 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:52:58 - XML: Start document: iteration 12
Sun 19 Jan 2014 13:52:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562889
Sun 19 Jan 2014 13:52:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:52:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:52:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:52:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562889
Sun 19 Jan 2014 13:52:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:52:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:52:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:53:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:53:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:53:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:53:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:53:15 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 13:53:15 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:53:15 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:53:15 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:53:15 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:53:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:53:19 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:53:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:53:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:53:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:53:21 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:53:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:53:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:53:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:53:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:53:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:53:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:53:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:53:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:53:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:53:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:53:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:53:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:53:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43521423
Sun 19 Jan 2014 13:53:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:53:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43521423
Sun 19 Jan 2014 13:53:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:53:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:53:27 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:53:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:53:28 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:53:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 13:53:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 13:53:28 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:53:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148629 bits 18578 bytes 
Sun 19 Jan 2014 13:53:30 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:53:30 - job_xml_thread(): Done retrieving: data size 43521423
Sun 19 Jan 2014 13:53:30 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:53:30 - XML: Start document: iteration 13
Sun 19 Jan 2014 13:53:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:53:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:53:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:53:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:53:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:53:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:53:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:53:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:53:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:53:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:53:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:53:43 - XML: Processed 652588 elements - found 0 jobs
Sun 19 Jan 2014 13:53:43 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:53:43 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:53:43 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:53:43 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:53:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:53:45 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:53:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:53:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:53:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:53:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:53:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:53:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:53:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:53:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42966576
Sun 19 Jan 2014 13:53:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:53:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42966576
Sun 19 Jan 2014 13:53:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:53:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:53:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:53:58 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:53:58 - job_xml_thread(): Done retrieving: data size 42966576
Sun 19 Jan 2014 13:53:58 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:53:58 - XML: Start document: iteration 14
Sun 19 Jan 2014 13:54:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:54:00 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:54:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:54:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:54:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:54:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:54:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:54:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:54:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:54:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:54:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:54:06 - XML: Processed 646186 elements - found 0 jobs
Sun 19 Jan 2014 13:54:06 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:54:06 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:54:06 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:54:06 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:54:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:54:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:54:09 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:54:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 13:54:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:54:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:54:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:54:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:54:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:54:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:54:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:54:10 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 13:54:10 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 13:54:10 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:54:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:54:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42904342
Sun 19 Jan 2014 13:54:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:54:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42904342
Sun 19 Jan 2014 13:54:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:54:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:54:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:54:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:54:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:54:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:54:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:54:21 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:54:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:54:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:54:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:54:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:54:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:54:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:54:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:54:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:54:25 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:54:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:54:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:54:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:54:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:54:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:54:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:54:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:54:26 - job_xml_thread(): Done retrieving: data size 42991405
Sun 19 Jan 2014 13:54:26 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:54:26 - XML: Start document: iteration 15
Sun 19 Jan 2014 13:54:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42991405
Sun 19 Jan 2014 13:54:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:54:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42991405
Sun 19 Jan 2014 13:54:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:54:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:54:29 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:54:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:54:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 13:54:29 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:54:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5981 values 94349 bits 11793 bytes 
Sun 19 Jan 2014 13:54:29 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:54:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 13:54:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:54:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:54:38 - XML: Processed 645900 elements - found 0 jobs
Sun 19 Jan 2014 13:54:38 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:54:38 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:54:38 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:54:38 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:54:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:54:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:54:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:54:47 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:54:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:54:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:54:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:54:47 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:54:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:54:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:54:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:54:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:54:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:54:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:54:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:54:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:54:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:54:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:54:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:54:49 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:54:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 13:54:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:54:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:54:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43538194
Sun 19 Jan 2014 13:54:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:54:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43538194
Sun 19 Jan 2014 13:54:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:54:53 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:54:53 - job_xml_thread(): Done retrieving: data size 43538194
Sun 19 Jan 2014 13:54:53 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:54:53 - XML: Start document: iteration 16
Sun 19 Jan 2014 13:55:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:55:00 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:55:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:55:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:55:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:55:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:55:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:55:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:55:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:55:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:55:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:55:11 - XML: Processed 652906 elements - found 0 jobs
Sun 19 Jan 2014 13:55:11 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:55:11 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:55:11 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:55:11 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:55:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:55:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:55:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:55:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:55:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:55:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:55:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:55:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:55:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:55:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566636
Sun 19 Jan 2014 13:55:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:55:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566636
Sun 19 Jan 2014 13:55:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:55:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:55:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:55:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:55:25 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:55:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:55:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:55:26 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:55:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:55:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:55:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:55:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:55:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:55:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:55:27 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:55:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:55:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:55:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:55:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:55:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:55:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:55:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:55:29 - job_xml_thread(): Done retrieving: data size 43593410
Sun 19 Jan 2014 13:55:29 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:55:29 - XML: Start document: iteration 17
Sun 19 Jan 2014 13:55:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43593410
Sun 19 Jan 2014 13:55:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:55:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:55:30 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:55:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43593410
Sun 19 Jan 2014 13:55:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:55:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:55:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 13:55:32 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:55:33 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:55:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 13:55:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9364 values 147697 bits 18462 bytes 
Sun 19 Jan 2014 13:55:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:55:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:55:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:55:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:55:44 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 13:55:44 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:55:44 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:55:44 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:55:44 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:55:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:55:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:55:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:55:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:55:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:55:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:55:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:55:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:55:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:55:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:55:52 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:55:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:55:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:55:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:55:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:55:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:55:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:55:54 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:55:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 13:55:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:55:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:55:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572381
Sun 19 Jan 2014 13:55:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:55:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572381
Sun 19 Jan 2014 13:55:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:55:59 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:55:59 - job_xml_thread(): Done retrieving: data size 43572381
Sun 19 Jan 2014 13:55:59 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:55:59 - XML: Start document: iteration 18
Sun 19 Jan 2014 13:56:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:56:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:56:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:56:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:56:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:56:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:56:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:56:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:56:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:56:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:56:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:56:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:56:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:56:12 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 13:56:12 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:56:12 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:56:12 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:56:12 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:56:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:56:16 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:56:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:56:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:56:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:56:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:56:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:56:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:56:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:56:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559235
Sun 19 Jan 2014 13:56:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:56:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559235
Sun 19 Jan 2014 13:56:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:56:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:56:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:56:28 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:56:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:56:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:56:31 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:56:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:56:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:56:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:56:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:56:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:56:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:56:33 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:56:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:56:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:56:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:56:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:56:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 13:56:34 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:56:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:56:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 13:56:34 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:56:34 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:56:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99039 bits 12379 bytes 
Sun 19 Jan 2014 13:56:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:56:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:56:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:56:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:56:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:56:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:56:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:56:36 - job_xml_thread(): Done retrieving: data size 43574839
Sun 19 Jan 2014 13:56:36 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:56:36 - XML: Start document: iteration 19
Sun 19 Jan 2014 13:56:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574839
Sun 19 Jan 2014 13:56:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:56:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574839
Sun 19 Jan 2014 13:56:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:56:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:56:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:56:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:56:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:56:52 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:56:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 13:56:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:56:59 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 13:56:59 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:56:59 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:56:59 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:56:59 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:57:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:57:00 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:57:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:57:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:57:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:57:01 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:57:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:57:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:57:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:57:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:57:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:57:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:57:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:57:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:57:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:57:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:57:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:57:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:57:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576244
Sun 19 Jan 2014 13:57:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:57:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576244
Sun 19 Jan 2014 13:57:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:57:08 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 13:57:08 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:57:09 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:57:09 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 13:57:09 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:57:09 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 13:57:10 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 13:57:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:57:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:57:14 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:57:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:57:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:57:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sun 19 Jan 2014 13:57:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:57:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:57:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:57:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:57:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:57:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:57:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:57:17 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:57:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:57:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:57:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:57:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:57:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:57:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:57:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:57:20 - job_xml_thread(): Done retrieving: data size 43571769
Sun 19 Jan 2014 13:57:20 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:57:20 - XML: Start document: iteration 20
Sun 19 Jan 2014 13:57:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571769
Sun 19 Jan 2014 13:57:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:57:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571769
Sun 19 Jan 2014 13:57:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:57:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:57:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:57:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:57:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:57:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:57:35 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:57:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:57:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:57:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:57:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:57:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:57:35 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:57:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 13:57:35 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:57:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 13:57:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9322 values 147017 bits 18377 bytes 
Sun 19 Jan 2014 13:57:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:57:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:57:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:57:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:57:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:57:41 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 13:57:41 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:57:41 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:57:41 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:57:41 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:57:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:57:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:57:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:57:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:57:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:57:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:57:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:57:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:57:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:57:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569710
Sun 19 Jan 2014 13:57:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:57:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569710
Sun 19 Jan 2014 13:57:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:57:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:57:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:57:56 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:57:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:57:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:57:57 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:57:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:57:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:57:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:57:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:57:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:57:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:57:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:57:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:58:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:58:00 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:58:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:58:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:58:00 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:58:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 13:58:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:58:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:58:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:58:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:58:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:58:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:58:01 - job_xml_thread(): Done retrieving: data size 43577431
Sun 19 Jan 2014 13:58:01 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:58:01 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 13:58:01 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 13:58:01 - Housekeeping: done.
Sun 19 Jan 2014 13:58:01 - XML: Start document: iteration 0
Sun 19 Jan 2014 13:58:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577431
Sun 19 Jan 2014 13:58:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:58:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577431
Sun 19 Jan 2014 13:58:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:58:10 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:58:10 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:58:11 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:58:11 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 13:58:11 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 13:58:11 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:58:12 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 13:58:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:58:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:58:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:58:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:58:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:58:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:58:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:58:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:58:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:58:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:58:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:58:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:58:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:58:21 - XML: Processed 653349 elements - found 0 jobs
Sun 19 Jan 2014 13:58:21 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:58:21 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:58:21 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:58:21 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:58:22 - size of cluster 'LISA Cluster': 624 hosts 79479 metrics 869689 values 13707449 bits 1713431 bytes 
Sun 19 Jan 2014 13:58:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:58:26 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:58:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:58:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:58:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:58:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:58:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:58:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:58:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:58:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577536
Sun 19 Jan 2014 13:58:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:58:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577536
Sun 19 Jan 2014 13:58:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:58:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:58:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:58:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:58:35 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:58:36 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:58:36 - job_xml_thread(): Done retrieving: data size 43577536
Sun 19 Jan 2014 13:58:36 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:58:36 - XML: Start document: iteration 1
Sun 19 Jan 2014 13:58:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:58:37 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:58:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 13:58:37 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:58:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 13:58:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9105 values 143618 bits 17952 bytes 
Sun 19 Jan 2014 13:58:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:58:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:58:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:58:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:58:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:58:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:58:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:58:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:58:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:58:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:58:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:58:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:58:51 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:58:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:58:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:58:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:58:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:58:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:58:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:58:53 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 13:58:53 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:58:53 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:58:53 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:58:53 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:58:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:58:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564573
Sun 19 Jan 2014 13:58:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:58:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:58:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:58:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564573
Sun 19 Jan 2014 13:58:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:59:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:59:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:59:08 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:59:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:59:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:59:10 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:59:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:59:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:59:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:59:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:59:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:59:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:59:12 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:59:12 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 13:59:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:59:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:59:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:59:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:59:13 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:59:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 13:59:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:59:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:59:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:59:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:59:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:59:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:59:16 - job_xml_thread(): Done retrieving: data size 43504148
Sun 19 Jan 2014 13:59:16 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:59:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43504148
Sun 19 Jan 2014 13:59:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:59:16 - XML: Start document: iteration 2
Sun 19 Jan 2014 13:59:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43504148
Sun 19 Jan 2014 13:59:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:59:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:59:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:59:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:59:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:59:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:59:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:59:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:59:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:59:34 - XML: Processed 652600 elements - found 0 jobs
Sun 19 Jan 2014 13:59:34 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 13:59:34 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 13:59:34 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 13:59:34 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 13:59:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:59:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:59:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:59:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:59:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 13:59:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:59:37 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:59:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:59:38 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:59:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 13:59:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 13:59:38 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 13:59:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5842 values 92076 bits 11509 bytes 
Sun 19 Jan 2014 13:59:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 13:59:39 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 13:59:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 13:59:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 13:59:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:59:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 13:59:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 13:59:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 13:59:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 13:59:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42998191
Sun 19 Jan 2014 13:59:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 13:59:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42998191
Sun 19 Jan 2014 13:59:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 13:59:50 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 13:59:50 - job_xml_thread(): Done retrieving: data size 42998191
Sun 19 Jan 2014 13:59:50 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 13:59:50 - XML: Start document: iteration 3
Sun 19 Jan 2014 13:59:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 13:59:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:59:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 13:59:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 13:59:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 13:59:58 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 13:59:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 13:59:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 13:59:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:59:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 13:59:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 13:59:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 13:59:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:00:04 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:00:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 14:00:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:00:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:00:06 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:00:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:00:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:00:07 - XML: Processed 646196 elements - found 0 jobs
Sun 19 Jan 2014 14:00:07 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:00:07 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:00:07 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:00:07 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:00:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:00:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:00:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:00:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:00:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:00:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42893709
Sun 19 Jan 2014 14:00:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:00:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42893709
Sun 19 Jan 2014 14:00:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:00:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:00:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:00:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:00:19 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:00:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:00:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:00:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:00:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:00:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42893709
Sun 19 Jan 2014 14:00:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:00:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:00:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:00:22 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:00:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:00:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:00:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:00:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:00:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:00:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:00:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:00:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:00:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:00:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:00:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:00:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:00:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:00:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:00:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:00:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:00:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:00:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:00:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:00:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:00:36 - job_xml_thread(): Done retrieving: data size 43312565
Sun 19 Jan 2014 14:00:36 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:00:36 - XML: Start document: iteration 4
Sun 19 Jan 2014 14:00:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43312565
Sun 19 Jan 2014 14:00:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:00:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43312565
Sun 19 Jan 2014 14:00:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:00:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:00:38 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:00:40 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:00:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:00:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 14:00:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 14:00:40 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:00:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5940 values 93684 bits 11710 bytes 
Sun 19 Jan 2014 14:00:45 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 14:00:45 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 14:00:45 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:00:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:00:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:00:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:00:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:00:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:00:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:00:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:00:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:00:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:00:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:00:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:00:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:00:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:00:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:00:59 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:00:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:00:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:01:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:01:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:01:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:01:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:01:00 - XML: Processed 650546 elements - found 0 jobs
Sun 19 Jan 2014 14:01:00 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:01:00 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:01:00 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:01:00 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:01:02 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:01:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 14:01:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:01:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:01:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562482
Sun 19 Jan 2014 14:01:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:01:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562482
Sun 19 Jan 2014 14:01:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:01:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:01:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:01:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:01:14 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:01:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:01:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:01:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:01:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:01:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:01:15 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:01:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:01:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:01:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:01:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:01:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:01:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:01:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:01:15 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:01:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:01:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:01:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:01:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:01:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:01:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581665
Sun 19 Jan 2014 14:01:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:01:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581665
Sun 19 Jan 2014 14:01:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:01:18 - job_xml_thread(): Done retrieving: data size 43581665
Sun 19 Jan 2014 14:01:18 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:01:18 - XML: Start document: iteration 5
Sun 19 Jan 2014 14:01:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:01:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:01:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:01:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:01:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:01:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:01:33 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 14:01:33 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:01:33 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:01:33 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:01:33 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:01:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:01:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:01:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:01:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:01:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:01:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:01:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:01:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:01:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:01:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:01:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:01:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:01:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:01:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:01:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:01:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:01:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581804
Sun 19 Jan 2014 14:01:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:01:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:01:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581804
Sun 19 Jan 2014 14:01:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:01:41 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:01:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:01:42 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:01:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 14:01:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 14:01:43 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:01:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9438 values 149059 bits 18632 bytes 
Sun 19 Jan 2014 14:01:49 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:01:49 - job_xml_thread(): Done retrieving: data size 43581804
Sun 19 Jan 2014 14:01:49 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:01:49 - XML: Start document: iteration 6
Sun 19 Jan 2014 14:01:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:01:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:01:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:01:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:01:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:01:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:01:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:01:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:01:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:01:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:01:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:01:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:01:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:01:58 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 14:01:58 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:01:58 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:01:58 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:01:58 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:02:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:02:01 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:02:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:02:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:02:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:02:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:02:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:02:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:02:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:02:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557752
Sun 19 Jan 2014 14:02:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:02:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557752
Sun 19 Jan 2014 14:02:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:02:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:02:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:02:13 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:02:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:02:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:02:14 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:02:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:02:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:02:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:02:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:02:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:02:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:02:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:02:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:02:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:02:17 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:02:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:02:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:02:18 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:02:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 14:02:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:02:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:02:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:02:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:02:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:02:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:02:20 - job_xml_thread(): Done retrieving: data size 43574365
Sun 19 Jan 2014 14:02:20 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:02:20 - XML: Start document: iteration 7
Sun 19 Jan 2014 14:02:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574365
Sun 19 Jan 2014 14:02:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574365
Sun 19 Jan 2014 14:02:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:02:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:02:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:02:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:02:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:02:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:02:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:02:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:02:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:02:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:02:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:02:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:02:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:02:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:02:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:02:42 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 14:02:42 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:02:42 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:02:42 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:02:42 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:02:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:02:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:02:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:02:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:02:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:02:43 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:02:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:02:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:02:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:02:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:02:44 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:02:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 14:02:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:02:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 14:02:44 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:02:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5620 values 88872 bits 11109 bytes 
Sun 19 Jan 2014 14:02:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:02:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573392
Sun 19 Jan 2014 14:02:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:02:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573392
Sun 19 Jan 2014 14:02:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:02:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:02:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:02:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:02:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:02:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:02:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:02:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:02:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:02:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:02:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:02:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:02:58 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:02:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:02:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:03:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:03:00 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:03:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:03:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:03:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:03:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:03:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:03:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:03:02 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:03:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 14:03:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:03:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:03:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566672
Sun 19 Jan 2014 14:03:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:03:03 - job_xml_thread(): Done retrieving: data size 43566672
Sun 19 Jan 2014 14:03:03 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:03:03 - XML: Start document: iteration 8
Sun 19 Jan 2014 14:03:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566672
Sun 19 Jan 2014 14:03:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:03:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:03:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:03:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:03:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:03:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:03:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:03:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:03:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:03:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:03:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:03:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:03:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:03:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:03:25 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 14:03:25 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:03:25 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:03:25 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:03:25 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:03:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:03:27 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:03:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:03:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:03:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:03:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:03:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:03:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:03:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:03:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562639
Sun 19 Jan 2014 14:03:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:03:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562639
Sun 19 Jan 2014 14:03:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:03:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:03:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:03:41 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:03:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:03:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:03:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:03:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:03:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:03:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:03:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:03:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:03:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:03:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:03:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:03:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:03:42 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:03:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:03:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:03:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:03:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:03:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:03:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:03:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:03:44 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:03:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:03:44 - job_xml_thread(): Done retrieving: data size 43578674
Sun 19 Jan 2014 14:03:44 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:03:44 - XML: Start document: iteration 9
Sun 19 Jan 2014 14:03:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578674
Sun 19 Jan 2014 14:03:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:03:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578674
Sun 19 Jan 2014 14:03:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:03:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:03:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 14:03:45 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:03:45 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:03:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7265 values 114787 bits 14348 bytes 
Sun 19 Jan 2014 14:03:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 14:03:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:03:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:03:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:03:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:04:01 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 14:04:01 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:04:01 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:04:01 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:04:01 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:04:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:04:04 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:04:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:04:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:04:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:04:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:04:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:04:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:04:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:04:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:04:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:04:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:04:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:04:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:04:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:04:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:04:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:04:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:04:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43592553
Sun 19 Jan 2014 14:04:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:04:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43592553
Sun 19 Jan 2014 14:04:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:04:16 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:04:16 - job_xml_thread(): Done retrieving: data size 43592553
Sun 19 Jan 2014 14:04:16 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:04:16 - XML: Start document: iteration 10
Sun 19 Jan 2014 14:04:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:04:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:04:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:04:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:04:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:04:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:04:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:04:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:04:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:04:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:04:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:04:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:04:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:04:27 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:04:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 14:04:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:04:32 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 14:04:32 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:04:32 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:04:32 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:04:32 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:04:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:04:34 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:04:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:04:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:04:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:04:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:04:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:04:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:04:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:04:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560229
Sun 19 Jan 2014 14:04:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:04:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560229
Sun 19 Jan 2014 14:04:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:04:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:04:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:04:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:04:44 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:04:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:04:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:04:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:04:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:04:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:04:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:04:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560229
Sun 19 Jan 2014 14:04:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:04:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:04:45 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:04:47 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:04:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:04:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:04:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 14:04:47 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:04:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 14:04:47 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:04:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6142 values 96853 bits 12106 bytes 
Sun 19 Jan 2014 14:04:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:04:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:04:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:04:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:04:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:04:58 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:04:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:04:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:04:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:04:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:04:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:04:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:05:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:05:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:05:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:05:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:05:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:05:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:05:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:05:00 - job_xml_thread(): Done retrieving: data size 43543098
Sun 19 Jan 2014 14:05:00 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:05:00 - XML: Start document: iteration 11
Sun 19 Jan 2014 14:05:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43543098
Sun 19 Jan 2014 14:05:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:05:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43543098
Sun 19 Jan 2014 14:05:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:05:12 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 14:05:12 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:05:12 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:05:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 14:05:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:05:13 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:05:13 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:05:13 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 14:05:13 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 14:05:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:05:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:05:13 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sun 19 Jan 2014 14:05:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:05:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:05:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:05:19 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:05:20 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 14:05:20 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:05:20 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:05:20 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:05:20 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:05:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:05:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:05:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:05:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:05:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:05:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:05:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:05:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:05:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:05:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:05:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:05:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:05:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:05:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:05:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:05:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:05:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43528916
Sun 19 Jan 2014 14:05:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:05:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43528916
Sun 19 Jan 2014 14:05:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:05:35 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:05:35 - job_xml_thread(): Done retrieving: data size 43528916
Sun 19 Jan 2014 14:05:35 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:05:35 - XML: Start document: iteration 12
Sun 19 Jan 2014 14:05:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:05:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:05:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:05:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:05:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:05:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:05:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:05:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:05:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:05:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:05:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:05:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:05:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:05:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:05:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:05:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:05:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:05:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:05:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:05:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:05:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:05:46 - XML: Processed 652585 elements - found 0 jobs
Sun 19 Jan 2014 14:05:46 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:05:46 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:05:46 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:05:46 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:05:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:05:47 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:05:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:05:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42966059
Sun 19 Jan 2014 14:05:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:05:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42966059
Sun 19 Jan 2014 14:05:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:05:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:05:49 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:05:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 14:05:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 14:05:49 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:05:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9307 values 146826 bits 18353 bytes 
Sun 19 Jan 2014 14:05:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:05:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:05:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:05:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:05:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:05:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:05:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:05:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:05:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:05:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:05:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:06:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:06:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:06:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:06:01 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:06:01 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:06:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:06:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:06:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:06:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:06:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:06:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:06:04 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:06:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 14:06:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:06:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:06:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42906104
Sun 19 Jan 2014 14:06:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:06:04 - job_xml_thread(): Done retrieving: data size 42906104
Sun 19 Jan 2014 14:06:04 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:06:04 - XML: Start document: iteration 13
Sun 19 Jan 2014 14:06:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42906104
Sun 19 Jan 2014 14:06:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:06:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:06:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:06:14 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:06:14 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:06:14 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:06:14 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 14:06:14 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 14:06:14 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:06:14 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 14:06:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:06:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:06:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:06:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:06:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:06:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:06:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:06:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:06:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:06:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:06:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:06:21 - XML: Processed 645150 elements - found 0 jobs
Sun 19 Jan 2014 14:06:21 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:06:21 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:06:22 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:06:22 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:06:24 - size of cluster 'LISA Cluster': 624 hosts 79471 metrics 935700 values 14780194 bits 1847524 bytes 
Sun 19 Jan 2014 14:06:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:06:27 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:06:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:06:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:06:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:06:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:06:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:06:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:06:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:06:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43155757
Sun 19 Jan 2014 14:06:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:06:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43155757
Sun 19 Jan 2014 14:06:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:06:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:06:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:06:37 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:06:37 - job_xml_thread(): Done retrieving: data size 43155757
Sun 19 Jan 2014 14:06:37 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:06:37 - XML: Start document: iteration 14
Sun 19 Jan 2014 14:06:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:06:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:06:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:06:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:06:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:06:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:06:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:06:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:06:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:06:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:06:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:06:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:06:49 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:06:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:06:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 14:06:50 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:06:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 14:06:50 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:06:50 - XML: Processed 648596 elements - found 0 jobs
Sun 19 Jan 2014 14:06:50 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:06:50 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:06:50 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:06:50 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:06:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99084 bits 12385 bytes 
Sun 19 Jan 2014 14:06:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:06:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:06:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:06:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:06:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:06:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:06:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:06:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:06:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:06:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43514723
Sun 19 Jan 2014 14:06:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:06:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:06:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:06:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43514723
Sun 19 Jan 2014 14:06:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:07:05 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:07:05 - job_xml_thread(): Done retrieving: data size 43514723
Sun 19 Jan 2014 14:07:05 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:07:05 - XML: Start document: iteration 15
Sun 19 Jan 2014 14:07:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:07:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:07:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:07:10 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:07:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:07:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:07:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:07:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:07:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:07:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:07:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:07:14 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:07:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 14:07:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:07:15 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:07:15 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 14:07:17 - XML: Processed 652842 elements - found 0 jobs
Sun 19 Jan 2014 14:07:17 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:07:17 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:07:17 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:07:17 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:07:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:07:21 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:07:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:07:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:07:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:07:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:07:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:07:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:07:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:07:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556859
Sun 19 Jan 2014 14:07:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:07:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556859
Sun 19 Jan 2014 14:07:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:07:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:07:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:07:32 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:07:32 - job_xml_thread(): Done retrieving: data size 43556859
Sun 19 Jan 2014 14:07:32 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:07:32 - XML: Start document: iteration 16
Sun 19 Jan 2014 14:07:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:07:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:07:44 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 14:07:44 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:07:44 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:07:44 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:07:44 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:07:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:07:44 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:07:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:07:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:07:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:07:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:07:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:07:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:07:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:07:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:07:47 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:07:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:07:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:07:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:07:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:07:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:07:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:07:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:07:50 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:07:50 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:07:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:07:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 14:07:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 14:07:50 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:07:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5651 values 89077 bits 11134 bytes 
Sun 19 Jan 2014 14:07:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:07:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567959
Sun 19 Jan 2014 14:07:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:07:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567959
Sun 19 Jan 2014 14:07:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:07:59 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:07:59 - job_xml_thread(): Done retrieving: data size 43567959
Sun 19 Jan 2014 14:07:59 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:07:59 - XML: Start document: iteration 17
Sun 19 Jan 2014 14:07:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:07:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:08:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:08:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:08:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:08:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:08:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:08:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:08:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:08:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:08:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:08:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:08:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:08:11 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 14:08:11 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:08:11 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:08:11 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:08:11 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:08:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:08:14 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:08:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:08:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:08:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:08:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:08:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:08:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:08:18 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:08:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 14:08:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:08:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:08:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562887
Sun 19 Jan 2014 14:08:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:08:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562887
Sun 19 Jan 2014 14:08:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:08:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:08:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:08:26 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:08:26 - job_xml_thread(): Done retrieving: data size 43562887
Sun 19 Jan 2014 14:08:26 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:08:26 - XML: Start document: iteration 18
Sun 19 Jan 2014 14:08:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:08:29 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:08:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:08:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:08:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:08:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:08:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:08:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:08:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:08:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:08:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:08:39 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 14:08:39 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:08:39 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:08:39 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:08:39 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:08:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:08:41 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:08:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:08:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:08:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:08:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:08:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:08:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:08:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:08:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43545860
Sun 19 Jan 2014 14:08:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:08:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43545860
Sun 19 Jan 2014 14:08:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:08:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:08:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:08:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:08:50 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:08:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:08:51 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:08:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 14:08:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 14:08:51 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:08:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:08:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:08:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6761 values 106625 bits 13328 bytes 
Sun 19 Jan 2014 14:08:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:08:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:08:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:08:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:08:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:08:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:08:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43545860
Sun 19 Jan 2014 14:08:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:08:54 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:08:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:08:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:08:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:09:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:09:04 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:09:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:09:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:09:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:09:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:09:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:09:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:09:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:09:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:09:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:09:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:09:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:09:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:09:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:09:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:09:09 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 14:09:09 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 14:09:09 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:09:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:09:11 - job_xml_thread(): Done retrieving: data size 43552766
Sun 19 Jan 2014 14:09:11 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:09:11 - XML: Start document: iteration 19
Sun 19 Jan 2014 14:09:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43552766
Sun 19 Jan 2014 14:09:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:09:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43552766
Sun 19 Jan 2014 14:09:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:09:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:09:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:09:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:09:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:09:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:09:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:09:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:09:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:09:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:09:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:09:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:09:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:09:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:09:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:09:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:09:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:09:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:09:34 - XML: Processed 653348 elements - found 0 jobs
Sun 19 Jan 2014 14:09:34 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:09:34 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:09:34 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:09:34 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:09:34 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:09:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 14:09:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:09:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:09:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:09:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:09:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:09:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:09:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567254
Sun 19 Jan 2014 14:09:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:09:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567254
Sun 19 Jan 2014 14:09:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:09:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:09:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:09:49 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:09:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:09:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:09:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:09:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:09:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:09:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:09:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:09:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:09:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:09:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:09:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:09:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:09:51 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:09:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:09:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:09:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:09:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:09:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:09:52 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:09:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:09:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:09:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:09:52 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:09:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 14:09:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 14:09:52 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:09:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6114 values 96391 bits 12048 bytes 
Sun 19 Jan 2014 14:09:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:09:54 - job_xml_thread(): Done retrieving: data size 43594106
Sun 19 Jan 2014 14:09:54 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:09:54 - XML: Start document: iteration 20
Sun 19 Jan 2014 14:09:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43594106
Sun 19 Jan 2014 14:09:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:09:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43594106
Sun 19 Jan 2014 14:09:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:10:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:10:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:10:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:10:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:10:10 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 14:10:10 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:10:10 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:10:10 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:10:10 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:10:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:10:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:10:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:10:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:10:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:10:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:10:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:10:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:10:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:10:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:10:18 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:10:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:10:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:10:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:10:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:10:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:10:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:10:19 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:10:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 14:10:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:10:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:10:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567122
Sun 19 Jan 2014 14:10:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:10:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567122
Sun 19 Jan 2014 14:10:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:10:26 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:10:26 - job_xml_thread(): Done retrieving: data size 43567122
Sun 19 Jan 2014 14:10:26 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:10:26 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 14:10:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:10:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:10:27 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 14:10:27 - Housekeeping: done.
Sun 19 Jan 2014 14:10:27 - XML: Start document: iteration 0
Sun 19 Jan 2014 14:10:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:10:30 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:10:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:10:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:10:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:10:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:10:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:10:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:10:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:10:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:10:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:10:40 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 14:10:40 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:10:40 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:10:40 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:10:40 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:10:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:10:42 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:10:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:10:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:10:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:10:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:10:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:10:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:10:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:10:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43548693
Sun 19 Jan 2014 14:10:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:10:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43548693
Sun 19 Jan 2014 14:10:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:10:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:10:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:10:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:10:52 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:10:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:10:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:10:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:10:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:10:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 14:10:53 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:10:53 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:10:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:10:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 14:10:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7883 values 124321 bits 15540 bytes 
Sun 19 Jan 2014 14:10:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:10:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:10:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:10:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:10:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:10:56 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:10:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:10:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:10:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:10:58 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:10:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:10:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:10:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:10:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:10:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:10:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:11:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:11:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564002
Sun 19 Jan 2014 14:11:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:11:01 - job_xml_thread(): Done retrieving: data size 43564002
Sun 19 Jan 2014 14:11:01 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:11:01 - XML: Start document: iteration 1
Sun 19 Jan 2014 14:11:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564002
Sun 19 Jan 2014 14:11:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:11:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:11:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:11:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:11:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:11:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:11:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:11:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:11:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:11:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:11:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:11:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:11:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:11:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:11:17 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 14:11:17 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:11:17 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:11:17 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:11:17 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:11:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:11:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:11:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:11:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:11:23 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:11:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 14:11:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:11:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:11:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:11:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:11:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:11:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:11:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43516958
Sun 19 Jan 2014 14:11:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:11:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43516958
Sun 19 Jan 2014 14:11:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:11:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:11:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:11:33 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:11:33 - job_xml_thread(): Done retrieving: data size 43516958
Sun 19 Jan 2014 14:11:33 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:11:34 - XML: Start document: iteration 2
Sun 19 Jan 2014 14:11:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:11:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:11:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:11:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:11:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:11:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:11:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:11:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:11:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:11:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:11:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:11:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:11:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:11:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:11:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:11:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:11:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:11:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:11:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:11:47 - XML: Processed 652600 elements - found 0 jobs
Sun 19 Jan 2014 14:11:47 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:11:47 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:11:47 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:11:47 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:11:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:11:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42945953
Sun 19 Jan 2014 14:11:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:11:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42945953
Sun 19 Jan 2014 14:11:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:11:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:11:54 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:11:55 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:11:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:11:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 14:11:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 14:11:55 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:11:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9020 values 142221 bits 17777 bytes 
Sun 19 Jan 2014 14:11:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:11:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:12:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:12:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:12:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:12:00 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:12:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:12:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:12:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:12:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:12:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:12:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:12:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:12:03 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:12:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:12:03 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:12:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:12:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:12:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:12:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:12:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:12:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:12:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:12:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42912978
Sun 19 Jan 2014 14:12:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:12:06 - job_xml_thread(): Done retrieving: data size 42912978
Sun 19 Jan 2014 14:12:06 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:12:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42912978
Sun 19 Jan 2014 14:12:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:12:06 - XML: Start document: iteration 3
Sun 19 Jan 2014 14:12:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:12:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:12:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:12:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:12:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:12:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:12:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:12:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:12:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:12:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:12:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:12:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:12:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:12:26 - XML: Processed 645150 elements - found 0 jobs
Sun 19 Jan 2014 14:12:26 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:12:26 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:12:26 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:12:26 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:12:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:12:28 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:12:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:12:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:12:28 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:12:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 14:12:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:12:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:12:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:12:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:12:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:12:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:12:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43211192
Sun 19 Jan 2014 14:12:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:12:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43211192
Sun 19 Jan 2014 14:12:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:12:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:12:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:12:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:12:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:12:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:12:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:12:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:12:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:12:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:12:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:12:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:12:41 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:12:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:12:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:12:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:12:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:12:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:12:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:12:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:12:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:12:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:12:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43503982
Sun 19 Jan 2014 14:12:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:12:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43503982
Sun 19 Jan 2014 14:12:45 - job_xml_thread(): Done retrieving: data size 43503982
Sun 19 Jan 2014 14:12:45 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:12:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:12:45 - XML: Start document: iteration 4
Sun 19 Jan 2014 14:12:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:12:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:12:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:12:55 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:12:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:12:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:12:55 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:12:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 14:12:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:12:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 14:12:55 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:12:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8945 values 141117 bits 17639 bytes 
Sun 19 Jan 2014 14:12:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:12:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:12:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:12:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:12:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:12:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:12:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:13:06 - XML: Processed 652614 elements - found 0 jobs
Sun 19 Jan 2014 14:13:06 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:13:06 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:13:06 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:13:06 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:13:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:13:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:13:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:13:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:13:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:13:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:13:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:13:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:13:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:13:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553141
Sun 19 Jan 2014 14:13:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:13:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553141
Sun 19 Jan 2014 14:13:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:13:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:13:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:13:15 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 14:13:16 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:13:16 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:13:16 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:13:16 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 14:13:16 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 14:13:16 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 14:13:21 - size of cluster 'LISA Cluster': 624 hosts 79470 metrics 901313 values 14216937 bits 1777117 bytes 
Sun 19 Jan 2014 14:13:21 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:13:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:13:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:13:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:13:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:13:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:13:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:13:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:13:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:13:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:13:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:13:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:13:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:13:29 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:13:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:13:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:13:29 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:13:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 14:13:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:13:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:13:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:13:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:13:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:13:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:13:32 - job_xml_thread(): Done retrieving: data size 43542674
Sun 19 Jan 2014 14:13:32 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:13:32 - XML: Start document: iteration 5
Sun 19 Jan 2014 14:13:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43542674
Sun 19 Jan 2014 14:13:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43542674
Sun 19 Jan 2014 14:13:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:13:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:13:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:13:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:13:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:13:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:13:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:13:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:13:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:13:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:13:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:13:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:13:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:13:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:13:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:13:53 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 14:13:53 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:13:53 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:13:53 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:13:53 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:13:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:13:55 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:13:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:13:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:13:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:13:55 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:13:56 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:13:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 14:13:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:13:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 14:13:56 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:13:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:13:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:13:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:13:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5752 values 90688 bits 11336 bytes 
Sun 19 Jan 2014 14:13:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:13:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:13:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43589245
Sun 19 Jan 2014 14:13:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:13:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43589245
Sun 19 Jan 2014 14:13:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:14:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:14:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:14:08 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:14:08 - job_xml_thread(): Done retrieving: data size 43589245
Sun 19 Jan 2014 14:14:08 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:14:08 - XML: Start document: iteration 6
Sun 19 Jan 2014 14:14:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:14:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:14:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:14:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:14:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:14:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:14:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:14:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:14:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:14:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:14:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:14:16 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:14:16 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 14:14:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:14:21 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:14:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:14:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:14:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:14:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:14:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:14:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:14:22 - XML: Processed 653348 elements - found 0 jobs
Sun 19 Jan 2014 14:14:22 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:14:22 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:14:22 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:14:22 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:14:23 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:14:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 14:14:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:14:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:14:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565417
Sun 19 Jan 2014 14:14:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:14:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565417
Sun 19 Jan 2014 14:14:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:14:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:14:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:14:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:14:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:14:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:14:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:14:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:14:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:14:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:14:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565417
Sun 19 Jan 2014 14:14:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:14:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:14:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:14:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:14:38 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:14:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:14:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:14:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:14:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:14:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:14:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:14:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:14:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:14:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:14:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:14:47 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:14:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:14:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:14:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:14:50 - job_xml_thread(): Done retrieving: data size 43551295
Sun 19 Jan 2014 14:14:50 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:14:50 - XML: Start document: iteration 7
Sun 19 Jan 2014 14:14:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43551295
Sun 19 Jan 2014 14:14:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:14:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:14:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:14:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:14:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43551295
Sun 19 Jan 2014 14:14:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:14:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:14:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:14:56 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:14:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:14:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 14:14:57 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:14:57 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:14:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 14:14:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8056 values 127021 bits 15877 bytes 
Sun 19 Jan 2014 14:15:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:15:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:15:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:15:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:15:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:15:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:15:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:15:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:15:10 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 14:15:10 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:15:10 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:15:10 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:15:10 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:15:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:15:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:15:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:15:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:15:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:15:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:15:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:15:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:15:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:15:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:15:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:15:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:15:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:15:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:15:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559672
Sun 19 Jan 2014 14:15:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:15:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559672
Sun 19 Jan 2014 14:15:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:15:25 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:15:25 - job_xml_thread(): Done retrieving: data size 43559672
Sun 19 Jan 2014 14:15:25 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:15:25 - XML: Start document: iteration 8
Sun 19 Jan 2014 14:15:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:15:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:15:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:15:28 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:15:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:15:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:15:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:15:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:15:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:15:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:15:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:15:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:15:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:15:36 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 14:15:36 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:15:36 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:15:36 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:15:36 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:15:37 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:15:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 14:15:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:15:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:15:37 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:15:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:15:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:15:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:15:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:15:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:15:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:15:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:15:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564993
Sun 19 Jan 2014 14:15:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:15:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564993
Sun 19 Jan 2014 14:15:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:15:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:15:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:15:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:15:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:15:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:15:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:15:51 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:15:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:15:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:15:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:15:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:15:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:15:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:15:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:15:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:15:57 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:15:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:15:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:15:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:15:57 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:15:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:15:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:15:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:15:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:15:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:15:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 14:15:58 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:15:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5994 values 94578 bits 11822 bytes 
Sun 19 Jan 2014 14:15:58 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:15:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 14:16:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:16:00 - job_xml_thread(): Done retrieving: data size 43574768
Sun 19 Jan 2014 14:16:00 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:16:00 - XML: Start document: iteration 9
Sun 19 Jan 2014 14:16:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574768
Sun 19 Jan 2014 14:16:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:16:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574768
Sun 19 Jan 2014 14:16:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:16:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:16:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:16:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:16:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:16:15 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 14:16:15 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:16:15 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:16:15 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:16:15 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:16:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:16:19 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:16:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:16:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:16:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:16:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:16:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:16:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:16:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:16:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:16:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:16:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:16:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:16:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:16:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:16:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:16:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:16:25 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:16:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 14:16:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:16:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:16:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43595363
Sun 19 Jan 2014 14:16:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:16:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43595363
Sun 19 Jan 2014 14:16:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:16:30 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:16:30 - job_xml_thread(): Done retrieving: data size 43595363
Sun 19 Jan 2014 14:16:30 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:16:30 - XML: Start document: iteration 10
Sun 19 Jan 2014 14:16:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:16:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:16:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:16:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:16:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:16:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:16:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:16:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:16:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:16:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:16:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:16:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:16:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:16:49 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 14:16:49 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:16:49 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:16:49 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:16:49 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:16:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:16:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:16:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:16:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:16:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:16:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:16:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:16:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:16:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:16:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560462
Sun 19 Jan 2014 14:16:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:16:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560462
Sun 19 Jan 2014 14:16:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:16:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:16:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:16:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:16:58 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:16:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:16:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 14:16:58 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:16:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 14:16:58 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:16:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7603 values 120134 bits 15016 bytes 
Sun 19 Jan 2014 14:17:04 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:17:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:17:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:17:04 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:17:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:17:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:17:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:17:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:17:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:17:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:17:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:17:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:17:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:17:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:17:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:17:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:17:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:17:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:17:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:17:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:17:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:17:14 - job_xml_thread(): Done retrieving: data size 43522355
Sun 19 Jan 2014 14:17:14 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:17:14 - XML: Start document: iteration 11
Sun 19 Jan 2014 14:17:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43522355
Sun 19 Jan 2014 14:17:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:17:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43522355
Sun 19 Jan 2014 14:17:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:17:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:17:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:17:21 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:17:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 14:17:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:17:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:17:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:17:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:17:27 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:17:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:17:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:17:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:17:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:17:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:17:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:17:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:17:33 - XML: Processed 652600 elements - found 0 jobs
Sun 19 Jan 2014 14:17:33 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:17:33 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:17:33 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:17:33 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:17:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:17:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:17:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:17:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:17:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:17:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:17:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:17:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:17:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:17:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43051617
Sun 19 Jan 2014 14:17:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:17:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43051617
Sun 19 Jan 2014 14:17:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:17:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:17:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:17:48 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:17:48 - job_xml_thread(): Done retrieving: data size 43051617
Sun 19 Jan 2014 14:17:48 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:17:48 - XML: Start document: iteration 12
Sun 19 Jan 2014 14:17:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:17:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:17:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:17:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:17:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:17:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:17:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:17:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:17:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:17:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:17:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:17:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:17:58 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:17:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:17:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 14:17:59 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:17:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 14:17:59 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:17:59 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6196 values 98040 bits 12255 bytes 
Sun 19 Jan 2014 14:17:59 - XML: Processed 646900 elements - found 0 jobs
Sun 19 Jan 2014 14:17:59 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:17:59 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:17:59 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:17:59 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:18:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:18:04 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:18:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:18:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:18:04 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 14:18:04 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 14:18:04 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:18:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:18:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:18:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:18:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:18:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:18:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42891162
Sun 19 Jan 2014 14:18:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:18:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42891162
Sun 19 Jan 2014 14:18:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:18:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:18:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:18:14 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:18:14 - job_xml_thread(): Done retrieving: data size 42891162
Sun 19 Jan 2014 14:18:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:18:14 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:18:14 - XML: Start document: iteration 13
Sun 19 Jan 2014 14:18:14 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:18:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:18:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:18:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:18:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:18:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:18:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:18:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42891162
Sun 19 Jan 2014 14:18:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:18:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:18:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:18:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:18:25 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:18:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:18:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:18:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:18:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:18:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:18:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:18:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:18:33 - XML: Processed 645234 elements - found 0 jobs
Sun 19 Jan 2014 14:18:33 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:18:33 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:18:33 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:18:33 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:18:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:18:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:18:36 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:18:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 14:18:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:18:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:18:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:18:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:18:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:18:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:18:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:18:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:18:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43403431
Sun 19 Jan 2014 14:18:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:18:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43403431
Sun 19 Jan 2014 14:18:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:18:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:18:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:18:48 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:18:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:18:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:18:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:18:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:18:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:18:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:18:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:18:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:18:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:18:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:18:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:18:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:18:52 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:18:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:18:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:18:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:18:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:18:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:18:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:18:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:18:54 - job_xml_thread(): Done retrieving: data size 43539721
Sun 19 Jan 2014 14:18:54 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:18:54 - XML: Start document: iteration 14
Sun 19 Jan 2014 14:18:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43539721
Sun 19 Jan 2014 14:18:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:18:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43539721
Sun 19 Jan 2014 14:18:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:18:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:18:59 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:19:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:19:01 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:19:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 14:19:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 14:19:01 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:19:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8862 values 139899 bits 17487 bytes 
Sun 19 Jan 2014 14:19:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:19:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:19:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:19:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:19:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:19:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:19:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:19:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:19:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:19:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:19:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:19:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:19:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:19:15 - XML: Processed 652808 elements - found 0 jobs
Sun 19 Jan 2014 14:19:15 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:19:15 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:19:15 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:19:15 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:19:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:19:16 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:19:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:19:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:19:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:19:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:19:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:19:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:19:19 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:19:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 14:19:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:19:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:19:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43547426
Sun 19 Jan 2014 14:19:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:19:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43547426
Sun 19 Jan 2014 14:19:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:19:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:19:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:19:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:19:28 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:19:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:19:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:19:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:19:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:19:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:19:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:19:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:19:30 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:19:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:19:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:19:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:19:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:19:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:19:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:19:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:19:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:19:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:19:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:19:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:19:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566826
Sun 19 Jan 2014 14:19:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:19:35 - job_xml_thread(): Done retrieving: data size 43566826
Sun 19 Jan 2014 14:19:35 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:19:35 - XML: Start document: iteration 15
Sun 19 Jan 2014 14:19:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566826
Sun 19 Jan 2014 14:19:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:19:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:19:44 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:19:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:19:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:19:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:19:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:19:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:19:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:19:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:19:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:19:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:19:57 - XML: Processed 653348 elements - found 0 jobs
Sun 19 Jan 2014 14:19:57 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:19:57 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:19:57 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:19:57 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:19:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:19:57 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:19:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:19:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:19:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:19:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:19:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:19:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:19:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:19:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43552133
Sun 19 Jan 2014 14:19:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:20:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43552133
Sun 19 Jan 2014 14:20:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:20:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:20:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:20:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:20:02 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:20:03 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:20:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 14:20:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:20:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 14:20:03 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:20:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148583 bits 18572 bytes 
Sun 19 Jan 2014 14:20:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:20:07 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:20:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:20:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:20:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:20:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:20:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:20:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:20:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43552133
Sun 19 Jan 2014 14:20:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:20:12 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:20:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:20:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:20:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:20:16 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 14:20:16 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:20:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:20:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:20:17 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:20:17 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 14:20:17 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 14:20:17 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:20:17 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 14:20:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:20:20 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:20:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:20:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:20:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:20:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:20:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:20:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:20:20 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 820715 values 12966539 bits 1620817 bytes 
Sun 19 Jan 2014 14:20:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:20:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:20:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:20:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:20:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:20:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:20:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:20:24 - job_xml_thread(): Done retrieving: data size 43556956
Sun 19 Jan 2014 14:20:24 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:20:24 - XML: Start document: iteration 16
Sun 19 Jan 2014 14:20:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556956
Sun 19 Jan 2014 14:20:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556956
Sun 19 Jan 2014 14:20:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:20:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:20:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:20:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:20:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:20:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:20:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:20:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:20:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:20:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:20:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:20:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:20:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:20:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:20:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:20:43 - XML: Processed 653348 elements - found 0 jobs
Sun 19 Jan 2014 14:20:43 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:20:43 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:20:43 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:20:43 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:20:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:20:48 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:20:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:20:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:20:49 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:20:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 14:20:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:20:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:20:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:20:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:20:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:20:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:20:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561787
Sun 19 Jan 2014 14:20:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:20:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561787
Sun 19 Jan 2014 14:20:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:20:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:20:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:20:58 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:20:58 - job_xml_thread(): Done retrieving: data size 43561787
Sun 19 Jan 2014 14:20:58 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:20:58 - XML: Start document: iteration 17
Sun 19 Jan 2014 14:21:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:21:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:21:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:21:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:21:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:21:03 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:21:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:21:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:21:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:21:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:21:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:21:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:21:04 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:21:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:21:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:21:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 14:21:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 14:21:05 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:21:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5797 values 91421 bits 11427 bytes 
Sun 19 Jan 2014 14:21:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:21:11 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:21:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:21:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:21:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:21:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:21:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:21:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:21:12 - XML: Processed 653348 elements - found 0 jobs
Sun 19 Jan 2014 14:21:12 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:21:12 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:21:12 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:21:12 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:21:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:21:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564920
Sun 19 Jan 2014 14:21:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:21:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564920
Sun 19 Jan 2014 14:21:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:21:18 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:21:18 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 14:21:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:21:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:21:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:21:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:21:27 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:21:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:21:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:21:29 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:21:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:21:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:21:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:21:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:21:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:21:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:21:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:21:32 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:21:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:21:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:21:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:21:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:21:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:21:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:21:32 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:21:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 14:21:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:21:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:21:35 - job_xml_thread(): Done retrieving: data size 43562683
Sun 19 Jan 2014 14:21:35 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:21:35 - XML: Start document: iteration 18
Sun 19 Jan 2014 14:21:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562683
Sun 19 Jan 2014 14:21:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562683
Sun 19 Jan 2014 14:21:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:21:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:21:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:21:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:21:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:21:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:21:51 - XML: Processed 653348 elements - found 0 jobs
Sun 19 Jan 2014 14:21:51 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:21:51 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:21:51 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:21:51 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:21:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:21:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:21:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:21:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:21:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:21:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:21:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:21:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:21:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:21:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:21:59 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:21:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:21:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:22:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:22:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:22:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:22:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:22:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:22:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574876
Sun 19 Jan 2014 14:22:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:22:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574876
Sun 19 Jan 2014 14:22:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:22:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:22:05 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:22:06 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:22:06 - job_xml_thread(): Done retrieving: data size 43574876
Sun 19 Jan 2014 14:22:06 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:22:06 - XML: Start document: iteration 19
Sun 19 Jan 2014 14:22:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:22:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 14:22:06 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:22:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 14:22:06 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:22:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8933 values 140948 bits 17618 bytes 
Sun 19 Jan 2014 14:22:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:22:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:22:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:22:14 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:22:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:22:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:22:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:22:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:22:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:22:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:22:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:22:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:22:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:22:25 - XML: Processed 653348 elements - found 0 jobs
Sun 19 Jan 2014 14:22:25 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:22:25 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:22:25 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:22:25 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:22:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:22:26 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:22:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:22:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:22:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:22:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:22:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:22:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:22:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:22:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562245
Sun 19 Jan 2014 14:22:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:22:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:22:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:22:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562245
Sun 19 Jan 2014 14:22:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:22:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:22:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:22:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:22:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:22:40 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:22:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:22:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:22:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:22:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:22:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:22:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:22:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:22:43 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:22:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 14:22:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:22:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:22:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:22:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:22:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:22:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:22:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:22:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:22:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:22:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:22:49 - job_xml_thread(): Done retrieving: data size 43561726
Sun 19 Jan 2014 14:22:49 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:22:49 - XML: Start document: iteration 20
Sun 19 Jan 2014 14:22:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561726
Sun 19 Jan 2014 14:22:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:22:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561726
Sun 19 Jan 2014 14:22:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:22:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:22:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:23:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:23:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:23:04 - XML: Processed 653348 elements - found 0 jobs
Sun 19 Jan 2014 14:23:04 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:23:04 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:23:04 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:23:04 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:23:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:23:06 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:23:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:23:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 14:23:07 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:23:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 14:23:07 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:23:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5765 values 90946 bits 11368 bytes 
Sun 19 Jan 2014 14:23:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:23:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:23:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:23:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:23:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:23:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:23:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:23:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:23:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:23:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:23:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:23:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:23:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:23:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:23:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:23:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:23:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:23:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:23:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43495999
Sun 19 Jan 2014 14:23:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:23:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43495999
Sun 19 Jan 2014 14:23:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:23:19 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:23:19 - job_xml_thread(): Done retrieving: data size 43495999
Sun 19 Jan 2014 14:23:19 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:23:20 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 14:23:20 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 14:23:21 - Housekeeping: done.
Sun 19 Jan 2014 14:23:21 - XML: Start document: iteration 0
Sun 19 Jan 2014 14:23:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:23:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:23:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:23:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:23:34 - XML: Processed 652600 elements - found 0 jobs
Sun 19 Jan 2014 14:23:34 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:23:35 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:23:35 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:23:35 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:23:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:23:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:23:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:23:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:23:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:23:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:23:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:23:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:23:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:23:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:23:41 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:23:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:23:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:23:41 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:23:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 14:23:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:23:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:23:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:23:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:23:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:23:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:23:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42972848
Sun 19 Jan 2014 14:23:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:23:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42972848
Sun 19 Jan 2014 14:23:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:23:51 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:23:51 - job_xml_thread(): Done retrieving: data size 42972848
Sun 19 Jan 2014 14:23:52 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:23:52 - XML: Start document: iteration 1
Sun 19 Jan 2014 14:23:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:23:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:23:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:23:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:24:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:24:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:24:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:24:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:24:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:24:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:24:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:24:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:24:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:24:05 - XML: Processed 645884 elements - found 0 jobs
Sun 19 Jan 2014 14:24:05 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:24:05 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:24:05 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:24:05 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:24:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:24:07 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:24:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:24:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:24:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:24:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:24:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:24:08 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:24:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 14:24:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 14:24:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:24:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:24:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:24:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:24:08 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:24:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5867 values 92593 bits 11574 bytes 
Sun 19 Jan 2014 14:24:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:24:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42916614
Sun 19 Jan 2014 14:24:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:24:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42916614
Sun 19 Jan 2014 14:24:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:24:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:24:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:24:20 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:24:20 - job_xml_thread(): Done retrieving: data size 42916614
Sun 19 Jan 2014 14:24:20 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:24:20 - XML: Start document: iteration 2
Sun 19 Jan 2014 14:24:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:24:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:24:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:24:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:24:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:24:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:24:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:24:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:24:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:24:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:24:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:24:30 - XML: Processed 645174 elements - found 0 jobs
Sun 19 Jan 2014 14:24:30 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:24:30 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:24:30 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:24:30 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:24:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:24:34 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:24:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:24:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:24:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:24:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:24:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:24:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:24:35 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:24:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 14:24:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:24:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:24:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43320433
Sun 19 Jan 2014 14:24:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:24:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43320433
Sun 19 Jan 2014 14:24:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:24:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:24:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:24:45 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:24:45 - job_xml_thread(): Done retrieving: data size 43320433
Sun 19 Jan 2014 14:24:45 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:24:45 - XML: Start document: iteration 3
Sun 19 Jan 2014 14:24:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:24:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:24:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:24:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:24:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:24:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:24:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:24:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:24:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:24:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:24:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:24:59 - XML: Processed 650388 elements - found 0 jobs
Sun 19 Jan 2014 14:24:59 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:24:59 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:24:59 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:24:59 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:25:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:25:00 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:25:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:25:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:25:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:25:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:25:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:25:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:25:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:25:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43550275
Sun 19 Jan 2014 14:25:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:25:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43550275
Sun 19 Jan 2014 14:25:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:25:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:25:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:25:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:25:09 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:25:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:25:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 14:25:10 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:25:10 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:25:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8204 values 129393 bits 16174 bytes 
Sun 19 Jan 2014 14:25:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 14:25:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:25:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:25:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:25:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:25:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:25:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:25:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:25:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:25:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43550275
Sun 19 Jan 2014 14:25:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:25:14 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:25:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:25:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:25:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:25:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:25:22 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:25:23 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 14:25:23 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 14:25:23 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:25:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:25:24 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:25:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:25:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:25:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:25:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:25:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:25:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:25:25 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:25:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 14:25:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:25:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:25:26 - job_xml_thread(): Done retrieving: data size 43565783
Sun 19 Jan 2014 14:25:26 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:25:26 - XML: Start document: iteration 4
Sun 19 Jan 2014 14:25:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:25:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:25:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565783
Sun 19 Jan 2014 14:25:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:25:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:25:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:25:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:25:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:25:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565783
Sun 19 Jan 2014 14:25:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:25:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:25:39 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:25:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:25:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:25:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:25:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:25:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:25:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:25:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:25:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:25:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:25:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:25:47 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:25:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:25:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:25:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:25:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:25:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:25:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:25:48 - XML: Processed 653348 elements - found 0 jobs
Sun 19 Jan 2014 14:25:48 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:25:48 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:25:48 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:25:48 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:25:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:25:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565031
Sun 19 Jan 2014 14:25:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:25:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565031
Sun 19 Jan 2014 14:25:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:25:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:25:57 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:26:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:26:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:26:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:26:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:26:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:26:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:26:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:26:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:26:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:26:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:26:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:26:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:26:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:26:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:26:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:26:03 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:26:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:26:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583469
Sun 19 Jan 2014 14:26:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:26:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583469
Sun 19 Jan 2014 14:26:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:26:05 - job_xml_thread(): Done retrieving: data size 43583469
Sun 19 Jan 2014 14:26:05 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:26:05 - XML: Start document: iteration 5
Sun 19 Jan 2014 14:26:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:26:10 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:26:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:26:11 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:26:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 14:26:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 14:26:11 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:26:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6291 values 99280 bits 12410 bytes 
Sun 19 Jan 2014 14:26:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:26:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:26:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:26:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:26:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:26:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:26:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:26:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:26:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:26:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:26:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:26:23 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 14:26:23 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:26:23 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:26:23 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:26:23 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:26:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:26:26 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:26:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:26:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:26:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:26:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:26:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:26:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:26:29 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:26:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 14:26:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:26:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:26:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569434
Sun 19 Jan 2014 14:26:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:26:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569434
Sun 19 Jan 2014 14:26:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:26:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:26:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:26:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:26:37 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:26:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:26:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:26:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:26:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:26:39 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:26:39 - job_xml_thread(): Done retrieving: data size 43569434
Sun 19 Jan 2014 14:26:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:26:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:26:39 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:26:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569434
Sun 19 Jan 2014 14:26:39 - XML: Start document: iteration 6
Sun 19 Jan 2014 14:26:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:26:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:26:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:26:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:26:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:26:54 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 14:26:54 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:26:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:26:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:26:54 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:26:55 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:26:55 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:26:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:26:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:26:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:26:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:26:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:26:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:26:57 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:26:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:26:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:26:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:26:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:26:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:26:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:26:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:26:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43589245
Sun 19 Jan 2014 14:26:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:26:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43589245
Sun 19 Jan 2014 14:26:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:27:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:27:10 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:27:10 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:27:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:27:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:27:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:27:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:27:11 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:27:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:27:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:27:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:27:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:27:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:27:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 14:27:12 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:27:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99062 bits 12382 bytes 
Sun 19 Jan 2014 14:27:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:27:12 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:27:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:27:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 14:27:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:27:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:27:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:27:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:27:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:27:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:27:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:27:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:27:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:27:16 - job_xml_thread(): Done retrieving: data size 43572542
Sun 19 Jan 2014 14:27:16 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:27:16 - XML: Start document: iteration 7
Sun 19 Jan 2014 14:27:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572542
Sun 19 Jan 2014 14:27:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:27:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572542
Sun 19 Jan 2014 14:27:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:27:18 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 14:27:18 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:27:19 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:27:19 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 14:27:19 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 14:27:19 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:27:20 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 14:27:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:27:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:27:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:27:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:27:29 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 14:27:29 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:27:29 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:27:29 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:27:29 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:27:32 - size of cluster 'LISA Cluster': 624 hosts 79469 metrics 740596 values 11678339 bits 1459792 bytes 
Sun 19 Jan 2014 14:27:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:27:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:27:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:27:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:27:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:27:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:27:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:27:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:27:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:27:38 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:27:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 14:27:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:27:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:27:39 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:27:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:27:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:27:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:27:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:27:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:27:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:27:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:27:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580723
Sun 19 Jan 2014 14:27:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:27:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580723
Sun 19 Jan 2014 14:27:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:27:44 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:27:44 - job_xml_thread(): Done retrieving: data size 43580723
Sun 19 Jan 2014 14:27:45 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:27:45 - XML: Start document: iteration 8
Sun 19 Jan 2014 14:27:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:27:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:27:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:27:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:27:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:27:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:27:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:27:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:27:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:27:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:27:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:27:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:27:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:28:00 - XML: Processed 653349 elements - found 0 jobs
Sun 19 Jan 2014 14:28:00 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:28:00 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:28:00 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:28:00 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:28:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:28:04 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:28:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:28:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:28:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:28:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:28:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:28:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:28:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:28:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556096
Sun 19 Jan 2014 14:28:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:28:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:28:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:28:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556096
Sun 19 Jan 2014 14:28:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:28:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:28:12 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:28:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:28:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 14:28:13 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:28:13 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:28:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 14:28:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8881 values 140074 bits 17509 bytes 
Sun 19 Jan 2014 14:28:15 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:28:15 - job_xml_thread(): Done retrieving: data size 43556096
Sun 19 Jan 2014 14:28:15 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:28:15 - XML: Start document: iteration 9
Sun 19 Jan 2014 14:28:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:28:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:28:21 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:28:21 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 14:28:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:28:25 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:28:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:28:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:28:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:28:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:28:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:28:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:28:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:28:29 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 14:28:29 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:28:29 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:28:29 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:28:29 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:28:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:28:32 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:28:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:28:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:28:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:28:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:28:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:28:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:28:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:28:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568674
Sun 19 Jan 2014 14:28:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:28:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568674
Sun 19 Jan 2014 14:28:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:28:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:28:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:28:44 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:28:44 - job_xml_thread(): Done retrieving: data size 43568674
Sun 19 Jan 2014 14:28:44 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:28:44 - XML: Start document: iteration 10
Sun 19 Jan 2014 14:28:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:28:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:28:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:28:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:28:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:28:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:28:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:28:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:28:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:28:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:28:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:28:54 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:28:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 14:28:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:28:58 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 14:28:58 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:28:58 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:28:58 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:28:58 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:28:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:28:58 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:28:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:28:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:28:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:28:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:28:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:28:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:29:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:29:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559738
Sun 19 Jan 2014 14:29:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:29:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559738
Sun 19 Jan 2014 14:29:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:29:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:29:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:29:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:29:10 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:29:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:29:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:29:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:29:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:29:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:29:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:29:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559738
Sun 19 Jan 2014 14:29:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:29:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:29:13 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:29:13 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:29:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:29:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:29:14 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:29:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 14:29:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 14:29:14 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:29:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5896 values 92985 bits 11623 bytes 
Sun 19 Jan 2014 14:29:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:29:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:29:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:29:20 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:29:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:29:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:29:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:29:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:29:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:29:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:29:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:29:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:29:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:29:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:29:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:29:27 - job_xml_thread(): Done retrieving: data size 43501742
Sun 19 Jan 2014 14:29:27 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:29:27 - XML: Start document: iteration 11
Sun 19 Jan 2014 14:29:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:29:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:29:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:29:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:29:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43501742
Sun 19 Jan 2014 14:29:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:29:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43501742
Sun 19 Jan 2014 14:29:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:29:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:29:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:29:39 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:29:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 14:29:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:29:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:29:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:29:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:29:46 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:29:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:29:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:29:46 - XML: Processed 652600 elements - found 0 jobs
Sun 19 Jan 2014 14:29:46 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:29:46 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:29:46 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:29:46 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:29:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:29:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:29:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:29:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:29:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:29:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:29:52 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:29:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:29:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:29:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:29:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:29:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:29:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:29:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:29:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42929438
Sun 19 Jan 2014 14:29:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:29:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42929438
Sun 19 Jan 2014 14:29:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:30:01 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:30:02 - job_xml_thread(): Done retrieving: data size 42929438
Sun 19 Jan 2014 14:30:02 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:30:02 - XML: Start document: iteration 12
Sun 19 Jan 2014 14:30:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:30:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:30:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:30:06 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:30:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:30:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:30:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:30:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:30:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:30:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:30:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:30:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:30:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:30:14 - XML: Processed 645370 elements - found 0 jobs
Sun 19 Jan 2014 14:30:14 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:30:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:30:14 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:30:14 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:30:14 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:30:14 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:30:15 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:30:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 14:30:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:30:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 14:30:15 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:30:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5849 values 92222 bits 11527 bytes 
Sun 19 Jan 2014 14:30:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:30:17 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:30:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:30:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:30:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:30:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:30:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:30:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:30:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:30:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42945809
Sun 19 Jan 2014 14:30:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:30:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42945809
Sun 19 Jan 2014 14:30:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:30:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:30:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:30:29 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:30:29 - job_xml_thread(): Done retrieving: data size 42945809
Sun 19 Jan 2014 14:30:29 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:30:29 - XML: Start document: iteration 13
Sun 19 Jan 2014 14:30:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:30:30 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:30:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:30:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:30:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:30:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:30:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:30:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:30:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:30:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:30:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:30:41 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:30:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 14:30:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:30:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:30:42 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:30:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:30:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:30:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:30:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:30:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:30:42 - XML: Processed 645900 elements - found 0 jobs
Sun 19 Jan 2014 14:30:42 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:30:42 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:30:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:30:42 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:30:42 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:30:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:30:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43435818
Sun 19 Jan 2014 14:30:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:30:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43435818
Sun 19 Jan 2014 14:30:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:30:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:30:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:30:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:30:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:30:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:30:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:30:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:30:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:30:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:30:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:30:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43435818
Sun 19 Jan 2014 14:30:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:30:57 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:30:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:30:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:30:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:31:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:31:03 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:31:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:31:06 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:31:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:31:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:31:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:31:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:31:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:31:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:31:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:31:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:31:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:31:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:31:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:31:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:31:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:31:09 - job_xml_thread(): Done retrieving: data size 43555618
Sun 19 Jan 2014 14:31:09 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:31:09 - XML: Start document: iteration 14
Sun 19 Jan 2014 14:31:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555618
Sun 19 Jan 2014 14:31:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:31:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555618
Sun 19 Jan 2014 14:31:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:31:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:31:17 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:31:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:31:18 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:31:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 14:31:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 14:31:18 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:31:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8812 values 139047 bits 17380 bytes 
Sun 19 Jan 2014 14:31:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:31:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:31:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:31:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:31:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:31:29 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:31:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:31:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:31:30 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 14:31:30 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:31:30 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:31:30 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:31:30 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:31:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:31:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:31:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:31:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:31:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:31:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:31:31 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:31:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:31:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:31:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:31:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:31:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:31:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:31:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:31:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582162
Sun 19 Jan 2014 14:31:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:31:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582162
Sun 19 Jan 2014 14:31:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:31:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:31:44 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:31:45 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:31:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:31:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:31:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:31:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:31:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:31:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:31:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:31:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:31:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:31:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:31:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:31:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:31:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:31:50 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:31:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 14:31:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:31:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:31:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:31:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:31:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:31:51 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 14:31:51 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 14:31:51 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:31:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:31:52 - job_xml_thread(): Done retrieving: data size 43578975
Sun 19 Jan 2014 14:31:52 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:31:52 - XML: Start document: iteration 15
Sun 19 Jan 2014 14:31:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578975
Sun 19 Jan 2014 14:31:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578975
Sun 19 Jan 2014 14:31:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:31:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:32:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:32:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:32:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:32:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:32:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:32:10 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:32:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:32:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:32:10 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 14:32:10 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:32:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:32:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:32:10 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:32:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:32:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:32:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:32:10 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:32:10 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:32:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:32:14 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:32:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:32:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:32:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:32:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:32:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:32:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:32:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:32:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575745
Sun 19 Jan 2014 14:32:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:32:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575745
Sun 19 Jan 2014 14:32:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:32:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:32:18 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:32:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:32:19 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:32:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 14:32:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 14:32:19 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:32:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8645 values 136652 bits 17081 bytes 
Sun 19 Jan 2014 14:32:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:32:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:32:25 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:32:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:32:25 - job_xml_thread(): Done retrieving: data size 43575745
Sun 19 Jan 2014 14:32:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:32:25 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:32:25 - XML: Start document: iteration 16
Sun 19 Jan 2014 14:32:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:32:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:32:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:32:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:32:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:32:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:32:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:32:34 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 14:32:34 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:32:34 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:32:34 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:32:34 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:32:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:32:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:32:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:32:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:32:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:32:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:32:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:32:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:32:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:32:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575835
Sun 19 Jan 2014 14:32:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:32:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575835
Sun 19 Jan 2014 14:32:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:32:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:32:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:32:49 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:32:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:32:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:32:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:32:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:32:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:32:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:32:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:32:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:32:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:32:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:32:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:32:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:32:53 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:32:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:32:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:32:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:32:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:32:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:32:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:32:54 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:32:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 14:32:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:32:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:32:55 - job_xml_thread(): Done retrieving: data size 43587714
Sun 19 Jan 2014 14:32:55 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:32:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43587714
Sun 19 Jan 2014 14:32:55 - XML: Start document: iteration 17
Sun 19 Jan 2014 14:32:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:32:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43587714
Sun 19 Jan 2014 14:32:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:33:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:33:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:33:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:33:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:33:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:33:13 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:33:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:33:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:33:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:33:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:33:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:33:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:33:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:33:15 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 14:33:15 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:33:15 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:33:15 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:33:15 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:33:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:33:17 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:33:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:33:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:33:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:33:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:33:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:33:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:33:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:33:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581021
Sun 19 Jan 2014 14:33:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:33:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581021
Sun 19 Jan 2014 14:33:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:33:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:33:21 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:33:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:33:21 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:33:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 14:33:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 14:33:21 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:33:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8906 values 140790 bits 17598 bytes 
Sun 19 Jan 2014 14:33:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:33:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:33:30 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:33:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:33:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:33:31 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:33:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:33:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:33:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:33:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:33:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:33:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:33:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:33:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:33:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:33:34 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:33:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:33:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:33:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:33:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:33:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:33:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:33:37 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:33:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 14:33:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:33:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:33:37 - job_xml_thread(): Done retrieving: data size 43584553
Sun 19 Jan 2014 14:33:37 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:33:37 - XML: Start document: iteration 18
Sun 19 Jan 2014 14:33:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584553
Sun 19 Jan 2014 14:33:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584553
Sun 19 Jan 2014 14:33:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:33:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:33:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:33:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:33:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:33:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:33:54 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 14:33:54 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:33:54 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:33:54 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:33:54 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:33:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:33:57 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:33:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:33:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:33:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:33:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:33:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:33:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:33:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:33:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:33:59 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:33:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:33:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:34:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:34:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:34:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:34:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:34:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:34:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578880
Sun 19 Jan 2014 14:34:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:34:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578880
Sun 19 Jan 2014 14:34:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:34:10 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:34:10 - job_xml_thread(): Done retrieving: data size 43578880
Sun 19 Jan 2014 14:34:10 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:34:10 - XML: Start document: iteration 19
Sun 19 Jan 2014 14:34:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:34:13 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:34:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:34:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:34:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:34:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:34:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:34:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:34:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:34:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:34:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:34:21 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 14:34:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:34:21 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:34:21 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:34:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:34:21 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:34:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:34:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:34:22 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:34:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 14:34:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:34:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:34:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:34:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:34:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 14:34:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:34:22 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:34:22 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:34:22 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 14:34:22 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 14:34:22 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:34:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6139 values 96865 bits 12108 bytes 
Sun 19 Jan 2014 14:34:22 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 14:34:23 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 824884 values 13030315 bits 1628789 bytes 
Sun 19 Jan 2014 14:34:25 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 14:34:25 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:34:25 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:34:25 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:34:25 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:34:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:34:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566293
Sun 19 Jan 2014 14:34:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:34:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:34:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:34:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566293
Sun 19 Jan 2014 14:34:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:34:36 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:34:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 14:34:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:34:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:34:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:34:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:34:39 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:34:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:34:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:34:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:34:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:34:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:34:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:34:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:34:40 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:34:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:34:45 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:34:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:34:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:34:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:34:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:34:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:34:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:34:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:34:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565755
Sun 19 Jan 2014 14:34:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:34:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565755
Sun 19 Jan 2014 14:34:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:34:49 - job_xml_thread(): Done retrieving: data size 43565755
Sun 19 Jan 2014 14:34:49 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:34:49 - XML: Start document: iteration 20
Sun 19 Jan 2014 14:34:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:34:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:34:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:34:59 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:34:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:34:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:35:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:35:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:35:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:35:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:35:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:35:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:35:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:35:07 - XML: Processed 653349 elements - found 0 jobs
Sun 19 Jan 2014 14:35:07 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:35:07 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:35:07 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:35:07 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:35:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:35:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:35:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:35:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:35:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:35:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:35:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:35:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:35:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:35:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565955
Sun 19 Jan 2014 14:35:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:35:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565955
Sun 19 Jan 2014 14:35:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:35:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:35:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:35:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:35:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:35:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:35:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:35:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:35:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:35:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:35:22 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:35:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:35:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:35:22 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:35:22 - job_xml_thread(): Done retrieving: data size 43565955
Sun 19 Jan 2014 14:35:22 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:35:22 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 14:35:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565955
Sun 19 Jan 2014 14:35:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:35:22 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:35:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:35:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 14:35:22 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:35:22 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:35:22 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 14:35:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 14:35:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9361 values 147664 bits 18458 bytes 
Sun 19 Jan 2014 14:35:23 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 14:35:23 - Housekeeping: done.
Sun 19 Jan 2014 14:35:23 - XML: Start document: iteration 0
Sun 19 Jan 2014 14:35:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:35:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:35:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:35:36 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:35:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:35:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:35:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:35:39 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:35:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:35:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:35:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:35:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:35:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:35:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:35:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:35:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:35:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:35:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:35:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:35:42 - XML: Processed 653348 elements - found 0 jobs
Sun 19 Jan 2014 14:35:42 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:35:42 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:35:42 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:35:42 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:35:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:35:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42970844
Sun 19 Jan 2014 14:35:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:35:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42970844
Sun 19 Jan 2014 14:35:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:35:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:35:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:35:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:35:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:35:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:35:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:35:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:35:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:35:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:35:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:35:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:35:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:35:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:35:57 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:36:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:36:01 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:36:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:36:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:36:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:36:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:36:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:36:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:36:02 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:36:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 14:36:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:36:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:36:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42897299
Sun 19 Jan 2014 14:36:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:36:04 - job_xml_thread(): Done retrieving: data size 42897299
Sun 19 Jan 2014 14:36:04 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:36:04 - XML: Start document: iteration 1
Sun 19 Jan 2014 14:36:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42897299
Sun 19 Jan 2014 14:36:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:36:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:36:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:36:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:36:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:36:19 - XML: Processed 645150 elements - found 0 jobs
Sun 19 Jan 2014 14:36:19 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:36:19 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:36:19 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:36:19 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:36:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:36:23 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:36:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:36:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 14:36:24 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:36:24 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:36:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 14:36:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5443 values 85793 bits 10724 bytes 
Sun 19 Jan 2014 14:36:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:36:25 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:36:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:36:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:36:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:36:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:36:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:36:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:36:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:36:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:36:28 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:36:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:36:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:36:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:36:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:36:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:36:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:36:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:36:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43238715
Sun 19 Jan 2014 14:36:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:36:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43238715
Sun 19 Jan 2014 14:36:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:36:35 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:36:35 - job_xml_thread(): Done retrieving: data size 43238715
Sun 19 Jan 2014 14:36:35 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:36:35 - XML: Start document: iteration 2
Sun 19 Jan 2014 14:36:40 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:36:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 14:36:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:36:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:36:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:36:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:36:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:36:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:36:46 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:36:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:36:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:36:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:36:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:36:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:36:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:36:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:36:53 - XML: Processed 649142 elements - found 0 jobs
Sun 19 Jan 2014 14:36:53 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:36:53 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:36:53 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:36:53 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:36:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:36:55 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:36:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:36:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:36:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:36:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:36:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:36:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:36:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:36:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43528656
Sun 19 Jan 2014 14:36:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:36:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43528656
Sun 19 Jan 2014 14:36:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:37:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:37:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:37:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:37:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:37:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:37:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:37:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:37:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:37:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:37:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:37:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:37:09 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:37:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:37:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:37:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:37:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:37:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:37:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:37:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:37:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:37:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:37:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:37:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:37:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43587332
Sun 19 Jan 2014 14:37:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:37:16 - job_xml_thread(): Done retrieving: data size 43587332
Sun 19 Jan 2014 14:37:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43587332
Sun 19 Jan 2014 14:37:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:37:16 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:37:16 - XML: Start document: iteration 3
Sun 19 Jan 2014 14:37:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:37:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:37:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:37:24 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:37:25 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:37:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:37:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 14:37:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 14:37:25 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:37:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9358 values 147607 bits 18450 bytes 
Sun 19 Jan 2014 14:37:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:37:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:37:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:37:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:37:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:37:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:37:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:37:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:37:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:37:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:37:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:37:35 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 14:37:35 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:37:35 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:37:35 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:37:35 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:37:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:37:39 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:37:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:37:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:37:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:37:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:37:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:37:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:37:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:37:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576204
Sun 19 Jan 2014 14:37:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:37:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576204
Sun 19 Jan 2014 14:37:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:37:50 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:37:50 - job_xml_thread(): Done retrieving: data size 43576204
Sun 19 Jan 2014 14:37:50 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:37:50 - XML: Start document: iteration 4
Sun 19 Jan 2014 14:37:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:37:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:37:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:37:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:37:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:37:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:37:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:37:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:37:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:37:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:37:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:37:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:37:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:38:04 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 14:38:04 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:38:04 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:38:04 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:38:04 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:38:05 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:38:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 14:38:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:38:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:38:07 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:38:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:38:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:38:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:38:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:38:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:38:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:38:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:38:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43552349
Sun 19 Jan 2014 14:38:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:38:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43552349
Sun 19 Jan 2014 14:38:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:38:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:38:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:38:19 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:38:19 - job_xml_thread(): Done retrieving: data size 43552349
Sun 19 Jan 2014 14:38:19 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:38:19 - XML: Start document: iteration 5
Sun 19 Jan 2014 14:38:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:38:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:38:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:38:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:38:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:38:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:38:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:38:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:38:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:38:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:38:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:38:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:38:25 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:38:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:38:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 14:38:25 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:38:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5889 values 92918 bits 11614 bytes 
Sun 19 Jan 2014 14:38:25 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:38:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 14:38:32 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 14:38:32 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:38:32 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:38:32 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:38:32 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:38:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:38:34 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:38:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:38:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:38:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:38:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:38:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:38:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:38:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:38:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43549101
Sun 19 Jan 2014 14:38:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:38:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43549101
Sun 19 Jan 2014 14:38:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:38:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:38:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:38:47 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:38:47 - job_xml_thread(): Done retrieving: data size 43549101
Sun 19 Jan 2014 14:38:47 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:38:47 - XML: Start document: iteration 6
Sun 19 Jan 2014 14:38:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:38:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:38:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:38:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:38:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:38:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:38:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:38:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:38:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:38:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:38:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:38:55 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 14:38:55 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:38:55 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:38:55 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:38:55 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:38:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:38:58 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:38:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:38:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:38:58 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:38:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 14:38:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:38:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:38:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:38:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:38:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:39:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:39:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583038
Sun 19 Jan 2014 14:39:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:39:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583038
Sun 19 Jan 2014 14:39:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:39:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:39:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:39:07 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 14:39:07 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 14:39:07 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:39:10 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:39:10 - job_xml_thread(): Done retrieving: data size 43583038
Sun 19 Jan 2014 14:39:10 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:39:10 - XML: Start document: iteration 7
Sun 19 Jan 2014 14:39:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:39:14 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:39:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:39:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:39:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:39:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:39:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:39:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:39:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:39:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:39:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:39:22 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 14:39:22 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:39:22 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:39:22 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:39:22 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:39:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:39:25 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:39:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:39:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:39:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:39:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:39:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:39:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:39:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:39:25 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:39:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:39:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 14:39:26 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:39:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5705 values 89916 bits 11239 bytes 
Sun 19 Jan 2014 14:39:26 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:39:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 14:39:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:39:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556961
Sun 19 Jan 2014 14:39:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:39:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556961
Sun 19 Jan 2014 14:39:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:39:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:39:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:39:37 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:39:37 - job_xml_thread(): Done retrieving: data size 43556961
Sun 19 Jan 2014 14:39:37 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:39:37 - XML: Start document: iteration 8
Sun 19 Jan 2014 14:39:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:39:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:39:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:39:43 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:39:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:39:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:39:46 - XML: Processed 653348 elements - found 0 jobs
Sun 19 Jan 2014 14:39:46 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:39:46 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:39:46 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:39:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:39:46 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:39:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:39:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:39:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:39:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:39:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:39:49 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:39:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:39:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:39:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:39:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:39:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:39:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:39:50 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:39:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 14:39:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:39:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:39:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564254
Sun 19 Jan 2014 14:39:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:39:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564254
Sun 19 Jan 2014 14:39:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:40:01 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:40:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:40:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:40:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:40:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:40:03 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:40:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:40:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:40:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:40:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:40:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:40:05 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:40:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:40:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:40:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:40:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:40:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:40:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:40:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:40:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:40:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:40:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:40:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:40:06 - job_xml_thread(): Done retrieving: data size 43566719
Sun 19 Jan 2014 14:40:06 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:40:06 - XML: Start document: iteration 9
Sun 19 Jan 2014 14:40:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566719
Sun 19 Jan 2014 14:40:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566719
Sun 19 Jan 2014 14:40:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:40:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:40:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:40:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:40:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:40:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:40:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:40:25 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:40:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:40:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:40:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:40:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:40:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:40:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:40:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:40:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:40:26 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:40:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:40:26 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:40:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 14:40:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 14:40:26 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:40:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7521 values 118584 bits 14823 bytes 
Sun 19 Jan 2014 14:40:28 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 14:40:28 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:40:28 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:40:28 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:40:28 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:40:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:40:29 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:40:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:40:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:40:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:40:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:40:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:40:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:40:32 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:40:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 14:40:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:40:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:40:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584391
Sun 19 Jan 2014 14:40:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:40:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584391
Sun 19 Jan 2014 14:40:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:40:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:40:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:40:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:40:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:40:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:40:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:40:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:40:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:40:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:40:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:40:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:40:43 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:40:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:40:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:40:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:40:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:40:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:40:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:40:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:40:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:40:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:40:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:40:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:40:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580644
Sun 19 Jan 2014 14:40:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:40:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580644
Sun 19 Jan 2014 14:40:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:40:48 - job_xml_thread(): Done retrieving: data size 43580644
Sun 19 Jan 2014 14:40:48 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:40:48 - XML: Start document: iteration 10
Sun 19 Jan 2014 14:40:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:40:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:41:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:41:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:41:05 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 14:41:05 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:41:05 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:41:05 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:41:05 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:41:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:41:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:41:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:41:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:41:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:41:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:41:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:41:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:41:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:41:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:41:11 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:41:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:41:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:41:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:41:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:41:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:41:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:41:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:41:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43537502
Sun 19 Jan 2014 14:41:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:41:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43537502
Sun 19 Jan 2014 14:41:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:41:22 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:41:22 - job_xml_thread(): Done retrieving: data size 43537502
Sun 19 Jan 2014 14:41:23 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:41:23 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 14:41:23 - XML: Start document: iteration 11
Sun 19 Jan 2014 14:41:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:41:23 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:41:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:41:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:41:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:41:25 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:41:25 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:41:25 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 14:41:25 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 14:41:25 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 14:41:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:41:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:41:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:41:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:41:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:41:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:41:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:41:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:41:27 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:41:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:41:27 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:41:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 14:41:27 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:41:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 14:41:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148699 bits 18587 bytes 
Sun 19 Jan 2014 14:41:29 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 819401 values 12918077 bits 1614759 bytes 
Sun 19 Jan 2014 14:41:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:41:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:41:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:41:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:41:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:41:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:41:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:41:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:41:35 - XML: Processed 652600 elements - found 0 jobs
Sun 19 Jan 2014 14:41:35 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:41:35 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:41:35 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:41:35 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:41:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:41:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43118950
Sun 19 Jan 2014 14:41:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:41:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43118950
Sun 19 Jan 2014 14:41:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:41:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:41:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:41:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:41:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:41:50 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:41:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:41:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:41:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:41:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:41:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:41:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:41:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:41:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:41:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:41:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:41:53 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:41:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:41:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:41:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:41:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:41:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:41:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:41:54 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:41:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 14:41:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:41:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:41:56 - job_xml_thread(): Done retrieving: data size 42932744
Sun 19 Jan 2014 14:41:56 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:41:56 - XML: Start document: iteration 12
Sun 19 Jan 2014 14:41:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42932744
Sun 19 Jan 2014 14:41:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:41:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42932744
Sun 19 Jan 2014 14:41:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:42:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:42:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:42:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:42:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:42:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:42:13 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:42:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:42:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:42:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:42:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:42:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:42:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:42:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:42:17 - XML: Processed 645306 elements - found 0 jobs
Sun 19 Jan 2014 14:42:17 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:42:17 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:42:17 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:42:17 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:42:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:42:20 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:42:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:42:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:42:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:42:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:42:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:42:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:42:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:42:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42967479
Sun 19 Jan 2014 14:42:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:42:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42967479
Sun 19 Jan 2014 14:42:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:42:25 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:42:25 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 14:42:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:42:28 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:42:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:42:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 14:42:29 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:42:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 14:42:29 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:42:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8958 values 141280 bits 17660 bytes 
Sun 19 Jan 2014 14:42:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:42:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:42:32 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:42:32 - job_xml_thread(): Done retrieving: data size 42967479
Sun 19 Jan 2014 14:42:32 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:42:32 - XML: Start document: iteration 13
Sun 19 Jan 2014 14:42:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:42:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:42:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:42:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:42:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:42:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:42:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:42:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:42:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:42:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:42:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:42:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:42:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:42:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:42:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:42:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:42:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:42:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:42:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:42:47 - XML: Processed 645900 elements - found 0 jobs
Sun 19 Jan 2014 14:42:47 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:42:47 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:42:47 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:42:47 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:42:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:42:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43522583
Sun 19 Jan 2014 14:42:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:42:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43522583
Sun 19 Jan 2014 14:42:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:42:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:42:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:43:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:43:01 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:43:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:43:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:43:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:43:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:43:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:43:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:43:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:43:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:43:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:43:02 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:43:03 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:43:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 14:43:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:43:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:43:05 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:43:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:43:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:43:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:43:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:43:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:43:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:43:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:43:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571327
Sun 19 Jan 2014 14:43:08 - job_xml_thread(): Done retrieving: data size 43571327
Sun 19 Jan 2014 14:43:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:43:08 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:43:09 - XML: Start document: iteration 14
Sun 19 Jan 2014 14:43:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571327
Sun 19 Jan 2014 14:43:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:43:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:43:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:43:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:43:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:43:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:43:25 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:43:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:43:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:43:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:43:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:43:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:43:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:43:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:43:27 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 14:43:27 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:43:27 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:43:27 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:43:27 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:43:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:43:29 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:43:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:43:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:43:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:43:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:43:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:43:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:43:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:43:29 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:43:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:43:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 14:43:30 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:43:30 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:43:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5971 values 94193 bits 11774 bytes 
Sun 19 Jan 2014 14:43:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 14:43:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:43:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568208
Sun 19 Jan 2014 14:43:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:43:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568208
Sun 19 Jan 2014 14:43:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:43:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:43:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:43:42 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:43:42 - job_xml_thread(): Done retrieving: data size 43568208
Sun 19 Jan 2014 14:43:42 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:43:42 - XML: Start document: iteration 15
Sun 19 Jan 2014 14:43:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:43:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:43:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:43:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:43:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:43:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:43:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:43:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:43:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:43:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:43:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:43:55 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 14:43:55 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:43:55 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:43:55 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:43:55 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:43:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:43:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:43:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:43:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:43:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:43:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:43:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:43:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:43:57 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:43:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 14:43:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:43:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:43:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566491
Sun 19 Jan 2014 14:43:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:44:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566491
Sun 19 Jan 2014 14:44:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:44:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:44:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:44:10 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:44:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:44:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:44:10 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:44:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:44:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:44:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:44:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:44:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:44:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:44:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:44:14 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:44:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:44:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:44:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:44:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:44:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:44:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:44:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:44:17 - job_xml_thread(): Done retrieving: data size 43571589
Sun 19 Jan 2014 14:44:17 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:44:17 - XML: Start document: iteration 16
Sun 19 Jan 2014 14:44:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571589
Sun 19 Jan 2014 14:44:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:44:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571589
Sun 19 Jan 2014 14:44:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:44:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:44:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:44:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:44:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:44:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:44:30 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:44:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:44:31 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:44:31 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:44:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 14:44:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:44:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 14:44:31 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:44:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7890 values 124405 bits 15550 bytes 
Sun 19 Jan 2014 14:44:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:44:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:44:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:44:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:44:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:44:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:44:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:44:38 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 14:44:38 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:44:38 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:44:38 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:44:38 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:44:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:44:41 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:44:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:44:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:44:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:44:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:44:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:44:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:44:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:44:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574511
Sun 19 Jan 2014 14:44:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:44:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574511
Sun 19 Jan 2014 14:44:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:44:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:44:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:44:53 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:44:53 - job_xml_thread(): Done retrieving: data size 43574511
Sun 19 Jan 2014 14:44:53 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:44:53 - XML: Start document: iteration 17
Sun 19 Jan 2014 14:44:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:44:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:44:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:44:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:44:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:44:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:44:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:44:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:44:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:44:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:44:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:44:59 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:44:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 14:44:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:45:06 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 14:45:06 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:45:06 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:45:06 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:45:06 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:45:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:45:07 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:45:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:45:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:45:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:45:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:45:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:45:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:45:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:45:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557812
Sun 19 Jan 2014 14:45:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:45:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557812
Sun 19 Jan 2014 14:45:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:45:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:45:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:45:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:45:20 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:45:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:45:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:45:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:45:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:45:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:45:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:45:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:45:21 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:45:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:45:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:45:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:45:24 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:45:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:45:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:45:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:45:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:45:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:45:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:45:26 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 14:45:26 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 14:45:26 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:45:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:45:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43590377
Sun 19 Jan 2014 14:45:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:45:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43590377
Sun 19 Jan 2014 14:45:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:45:27 - job_xml_thread(): Done retrieving: data size 43590377
Sun 19 Jan 2014 14:45:27 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:45:27 - XML: Start document: iteration 18
Sun 19 Jan 2014 14:45:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:45:31 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:45:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:45:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 14:45:32 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:45:32 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:45:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 14:45:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9026 values 142388 bits 17798 bytes 
Sun 19 Jan 2014 14:45:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:45:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:45:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:45:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:45:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:45:43 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:45:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:45:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:45:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:45:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:45:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:45:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:45:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:45:46 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 14:45:46 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:45:46 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:45:46 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:45:46 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:45:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:45:49 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:45:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:45:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:45:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:45:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:45:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:45:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:45:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:45:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570570
Sun 19 Jan 2014 14:45:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:45:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570570
Sun 19 Jan 2014 14:45:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:46:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:46:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:46:01 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:46:01 - job_xml_thread(): Done retrieving: data size 43570570
Sun 19 Jan 2014 14:46:01 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:46:01 - XML: Start document: iteration 19
Sun 19 Jan 2014 14:46:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:46:04 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:46:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:46:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:46:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:46:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:46:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:46:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:46:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:46:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:46:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:46:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:46:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:46:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:46:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:46:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:46:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:46:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:46:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:46:12 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 14:46:12 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:46:12 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:46:12 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:46:12 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:46:13 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:46:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 14:46:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:46:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:46:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574181
Sun 19 Jan 2014 14:46:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:46:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574181
Sun 19 Jan 2014 14:46:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:46:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:46:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:46:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:46:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:46:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:46:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:46:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:46:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:46:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:46:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:46:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:46:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:46:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:46:28 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:46:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:46:28 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:46:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:46:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:46:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:46:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:46:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:46:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:46:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:46:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43586677
Sun 19 Jan 2014 14:46:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:46:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43586677
Sun 19 Jan 2014 14:46:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:46:31 - job_xml_thread(): Done retrieving: data size 43586677
Sun 19 Jan 2014 14:46:31 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:46:31 - XML: Start document: iteration 20
Sun 19 Jan 2014 14:46:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:46:32 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:46:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:46:33 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:46:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 14:46:33 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:46:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 14:46:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8760 values 138330 bits 17291 bytes 
Sun 19 Jan 2014 14:46:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:46:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:46:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:46:43 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:46:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:46:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:46:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:46:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:46:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:46:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:46:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:46:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:46:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:46:47 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 14:46:47 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:46:47 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:46:47 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:46:47 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:46:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:46:52 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:46:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:46:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:46:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:46:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:46:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:46:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:46:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:46:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570102
Sun 19 Jan 2014 14:46:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:46:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570102
Sun 19 Jan 2014 14:46:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:46:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:46:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:47:02 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:47:02 - job_xml_thread(): Done retrieving: data size 43570102
Sun 19 Jan 2014 14:47:02 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:47:02 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 14:47:02 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 14:47:02 - Housekeeping: done.
Sun 19 Jan 2014 14:47:02 - XML: Start document: iteration 0
Sun 19 Jan 2014 14:47:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:47:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:47:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:47:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:47:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:47:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:47:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:47:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:47:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:47:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:47:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:47:13 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 14:47:13 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:47:13 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:47:13 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:47:13 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:47:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:47:16 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:47:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:47:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:47:16 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:47:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 14:47:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:47:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:47:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:47:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:47:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:47:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:47:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43481682
Sun 19 Jan 2014 14:47:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:47:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43481682
Sun 19 Jan 2014 14:47:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:47:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:47:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:47:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:47:27 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:47:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:47:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:47:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:47:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:47:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:47:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:47:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:47:29 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:47:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:47:31 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:47:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:47:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:47:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:47:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43058109
Sun 19 Jan 2014 14:47:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:47:33 - job_xml_thread(): Done retrieving: data size 43058109
Sun 19 Jan 2014 14:47:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:47:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:47:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43058109
Sun 19 Jan 2014 14:47:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:47:33 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:47:33 - XML: Start document: iteration 1
Sun 19 Jan 2014 14:47:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:47:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:47:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:47:36 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:47:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:47:39 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:47:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 14:47:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 14:47:40 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:47:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9090 values 143890 bits 17986 bytes 
Sun 19 Jan 2014 14:47:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:47:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:47:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:47:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:47:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:47:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:47:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:47:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:47:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:47:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:47:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:47:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:47:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:47:55 - XML: Processed 646980 elements - found 0 jobs
Sun 19 Jan 2014 14:47:55 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:47:55 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:47:55 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:47:55 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:47:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:47:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:47:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:47:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:47:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:47:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:47:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:47:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:47:59 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:47:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 14:47:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:47:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:47:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42920606
Sun 19 Jan 2014 14:47:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:47:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42920606
Sun 19 Jan 2014 14:47:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:48:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:48:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:48:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:48:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:48:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:48:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:48:10 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:48:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:48:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:48:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:48:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:48:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:48:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:48:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:48:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:48:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:48:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:48:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:48:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:48:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:48:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:48:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:48:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:48:14 - job_xml_thread(): Done retrieving: data size 42940830
Sun 19 Jan 2014 14:48:14 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:48:14 - XML: Start document: iteration 2
Sun 19 Jan 2014 14:48:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42940830
Sun 19 Jan 2014 14:48:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:48:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42940830
Sun 19 Jan 2014 14:48:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:48:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:48:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:48:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:48:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:48:26 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 14:48:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:48:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:48:26 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:48:26 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:48:26 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:48:26 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 14:48:26 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 14:48:26 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 14:48:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:48:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:48:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:48:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:48:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:48:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:48:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sun 19 Jan 2014 14:48:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:48:35 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:48:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:48:36 - XML: Processed 645375 elements - found 0 jobs
Sun 19 Jan 2014 14:48:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:48:36 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:48:36 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:48:36 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:48:36 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:48:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:48:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:48:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:48:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:48:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:48:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43386851
Sun 19 Jan 2014 14:48:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:48:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43386851
Sun 19 Jan 2014 14:48:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:48:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:48:39 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:48:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:48:42 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:48:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 14:48:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:48:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:48:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 14:48:44 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:48:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148899 bits 18612 bytes 
Sun 19 Jan 2014 14:48:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:48:47 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:48:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:48:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:48:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:48:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:48:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:48:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:48:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:48:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:48:51 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:48:51 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:48:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:48:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:48:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:48:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:48:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:48:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:48:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:48:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554435
Sun 19 Jan 2014 14:48:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:48:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554435
Sun 19 Jan 2014 14:48:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:48:54 - job_xml_thread(): Done retrieving: data size 43554435
Sun 19 Jan 2014 14:48:54 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:48:54 - XML: Start document: iteration 3
Sun 19 Jan 2014 14:49:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:49:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:49:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:49:06 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:49:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:49:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:49:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:49:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:49:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:49:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:49:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:49:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:49:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:49:12 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:49:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 14:49:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:49:14 - XML: Processed 652836 elements - found 0 jobs
Sun 19 Jan 2014 14:49:14 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:49:14 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:49:14 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:49:14 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:49:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:49:16 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:49:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:49:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:49:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:49:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:49:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:49:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:49:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:49:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43544601
Sun 19 Jan 2014 14:49:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:49:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43544601
Sun 19 Jan 2014 14:49:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:49:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:49:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:49:26 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:49:26 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:49:27 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:49:27 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:49:27 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 14:49:27 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 14:49:27 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 14:49:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:49:29 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:49:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:49:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:49:29 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:49:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:49:29 - size of cluster 'LISA Cluster': 624 hosts 79476 metrics 890144 values 14057194 bits 1757149 bytes 
Sun 19 Jan 2014 14:49:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:49:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:49:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:49:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:49:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:49:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:49:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:49:34 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:49:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:49:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:49:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:49:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:49:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:49:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:49:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:49:37 - job_xml_thread(): Done retrieving: data size 43565860
Sun 19 Jan 2014 14:49:37 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:49:37 - XML: Start document: iteration 4
Sun 19 Jan 2014 14:49:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565860
Sun 19 Jan 2014 14:49:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:49:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565860
Sun 19 Jan 2014 14:49:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:49:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:49:42 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:49:43 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:49:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:49:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 14:49:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 14:49:44 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:49:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9125 values 143925 bits 17990 bytes 
Sun 19 Jan 2014 14:49:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:49:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:49:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:49:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:49:55 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 14:49:55 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:49:55 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:49:55 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:49:55 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:49:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:49:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:49:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:49:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:49:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:49:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:49:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:49:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:49:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:50:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:50:00 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:50:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:50:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:50:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:50:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:50:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:50:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:50:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:50:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560880
Sun 19 Jan 2014 14:50:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:50:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560880
Sun 19 Jan 2014 14:50:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:50:10 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:50:10 - job_xml_thread(): Done retrieving: data size 43560880
Sun 19 Jan 2014 14:50:10 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:50:11 - XML: Start document: iteration 5
Sun 19 Jan 2014 14:50:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:50:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:50:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:50:14 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:50:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:50:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:50:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:50:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:50:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:50:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:50:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:50:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:50:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:50:22 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:50:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 14:50:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:50:24 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 14:50:24 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:50:25 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:50:25 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:50:25 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:50:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:50:27 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:50:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:50:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:50:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:50:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:50:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:50:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:50:27 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:50:27 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 14:50:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:50:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562582
Sun 19 Jan 2014 14:50:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:50:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562582
Sun 19 Jan 2014 14:50:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:50:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:50:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:50:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:50:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:50:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:50:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:50:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:50:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:50:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562582
Sun 19 Jan 2014 14:50:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:50:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:50:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:50:40 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:50:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:50:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:50:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:50:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:50:44 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:50:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:50:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 14:50:44 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:50:44 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:50:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 14:50:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5909 values 93213 bits 11651 bytes 
Sun 19 Jan 2014 14:50:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:50:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:50:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:50:52 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:50:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:50:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:50:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:50:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:50:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:50:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:50:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:50:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:50:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:50:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:50:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:50:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:50:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:50:56 - job_xml_thread(): Done retrieving: data size 43554128
Sun 19 Jan 2014 14:50:56 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:50:56 - XML: Start document: iteration 6
Sun 19 Jan 2014 14:50:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554128
Sun 19 Jan 2014 14:50:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:50:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554128
Sun 19 Jan 2014 14:50:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:51:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:51:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:51:09 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 14:51:09 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:51:09 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:51:09 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:51:09 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:51:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:51:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:51:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:51:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:51:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:51:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:51:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:51:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:51:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:51:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:51:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:51:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:51:19 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:51:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:51:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:51:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:51:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:51:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:51:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:51:19 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:51:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 14:51:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:51:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:51:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572924
Sun 19 Jan 2014 14:51:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:51:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572924
Sun 19 Jan 2014 14:51:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:51:24 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:51:24 - job_xml_thread(): Done retrieving: data size 43572924
Sun 19 Jan 2014 14:51:24 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:51:24 - XML: Start document: iteration 7
Sun 19 Jan 2014 14:51:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:51:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:51:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:51:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:51:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:51:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:51:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:51:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:51:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:51:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:51:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:51:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:51:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:51:42 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 14:51:42 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:51:42 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:51:42 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:51:42 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:51:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:51:44 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:51:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:51:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 14:51:45 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:51:45 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:51:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 14:51:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5702 values 89901 bits 11237 bytes 
Sun 19 Jan 2014 14:51:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:51:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:51:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:51:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:51:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:51:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:51:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:51:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:51:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:51:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564037
Sun 19 Jan 2014 14:51:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:51:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564037
Sun 19 Jan 2014 14:51:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:51:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:51:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:51:58 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:51:58 - job_xml_thread(): Done retrieving: data size 43564037
Sun 19 Jan 2014 14:51:58 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:51:58 - XML: Start document: iteration 8
Sun 19 Jan 2014 14:52:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:52:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:52:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:52:07 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:52:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:52:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:52:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:52:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:52:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:52:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:52:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:52:12 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 14:52:12 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:52:12 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:52:12 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:52:12 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:52:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:52:14 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:52:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:52:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:52:15 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:52:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 14:52:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:52:15 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 14:52:15 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 14:52:15 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:52:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:52:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:52:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:52:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:52:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:52:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558600
Sun 19 Jan 2014 14:52:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:52:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558600
Sun 19 Jan 2014 14:52:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:52:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:52:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:52:27 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:52:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:52:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:52:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:52:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:52:30 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:52:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:52:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:52:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:52:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:52:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:52:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:52:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:52:31 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:52:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:52:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:52:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:52:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:52:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:52:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:52:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:52:33 - job_xml_thread(): Done retrieving: data size 43571315
Sun 19 Jan 2014 14:52:33 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:52:33 - XML: Start document: iteration 9
Sun 19 Jan 2014 14:52:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571315
Sun 19 Jan 2014 14:52:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:52:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571315
Sun 19 Jan 2014 14:52:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:52:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:52:45 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:52:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:52:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 14:52:46 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:52:46 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:52:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 14:52:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:52:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:52:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9004 values 142023 bits 17752 bytes 
Sun 19 Jan 2014 14:52:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:52:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:52:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:52:47 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:52:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:52:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:52:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:52:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:52:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:52:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:52:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:52:53 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 14:52:53 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:52:53 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:52:53 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:52:53 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:52:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:52:57 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:52:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:52:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:52:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:52:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:52:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:52:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:52:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:52:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562806
Sun 19 Jan 2014 14:52:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:53:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562806
Sun 19 Jan 2014 14:53:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:53:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:53:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:53:08 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:53:08 - job_xml_thread(): Done retrieving: data size 43562806
Sun 19 Jan 2014 14:53:08 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:53:08 - XML: Start document: iteration 10
Sun 19 Jan 2014 14:53:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:53:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:53:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:53:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:53:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:53:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:53:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:53:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:53:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:53:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:53:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:53:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:53:21 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:53:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:53:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:53:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:53:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:53:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:53:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:53:23 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 14:53:23 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:53:23 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:53:23 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:53:23 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:53:23 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:53:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 14:53:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:53:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:53:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43509642
Sun 19 Jan 2014 14:53:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:53:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43509642
Sun 19 Jan 2014 14:53:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:53:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:53:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:53:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:53:36 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:53:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:53:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:53:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:53:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:53:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:53:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:53:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:53:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:53:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:53:38 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:53:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:53:39 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:53:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:53:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:53:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:53:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:53:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:53:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:53:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:53:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43009817
Sun 19 Jan 2014 14:53:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:53:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43009817
Sun 19 Jan 2014 14:53:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:53:41 - job_xml_thread(): Done retrieving: data size 43009817
Sun 19 Jan 2014 14:53:42 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:53:42 - XML: Start document: iteration 11
Sun 19 Jan 2014 14:53:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:53:47 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:53:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:53:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 14:53:47 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:53:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9147 values 144304 bits 18038 bytes 
Sun 19 Jan 2014 14:53:48 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:53:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 14:53:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:53:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:53:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:53:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:54:01 - XML: Processed 646192 elements - found 0 jobs
Sun 19 Jan 2014 14:54:01 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:54:01 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:54:01 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:54:01 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:54:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:54:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:54:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:54:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:54:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:54:03 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:54:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:54:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:54:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:54:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:54:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:54:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:54:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:54:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:54:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:54:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:54:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:54:06 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:54:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 14:54:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:54:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:54:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42921687
Sun 19 Jan 2014 14:54:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:54:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42921687
Sun 19 Jan 2014 14:54:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:54:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:54:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:54:17 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:54:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:54:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:54:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:54:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:54:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:54:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:54:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:54:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:54:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:54:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:54:20 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:54:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:54:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:54:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:54:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:54:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:54:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:54:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:54:22 - job_xml_thread(): Done retrieving: data size 42981574
Sun 19 Jan 2014 14:54:22 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:54:22 - XML: Start document: iteration 12
Sun 19 Jan 2014 14:54:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42981574
Sun 19 Jan 2014 14:54:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:54:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42981574
Sun 19 Jan 2014 14:54:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:54:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:54:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:54:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:54:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:54:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:54:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:54:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:54:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:54:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:54:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:54:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:54:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:54:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:54:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:54:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:54:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:54:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:54:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:54:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:54:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:54:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:54:45 - XML: Processed 645900 elements - found 0 jobs
Sun 19 Jan 2014 14:54:45 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:54:45 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:54:45 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:54:45 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:54:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:54:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43489109
Sun 19 Jan 2014 14:54:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:54:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43489109
Sun 19 Jan 2014 14:54:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:54:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:54:49 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:54:50 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:54:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:54:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 14:54:50 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:54:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148499 bits 18562 bytes 
Sun 19 Jan 2014 14:54:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 14:54:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:54:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:54:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:54:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:54:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:54:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:54:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:54:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:54:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:54:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:54:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43489109
Sun 19 Jan 2014 14:54:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:55:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:55:01 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:55:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:55:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:55:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:55:07 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:55:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:55:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:55:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:55:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:55:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:55:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:55:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:55:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:55:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:55:11 - job_xml_thread(): Done retrieving: data size 43577337
Sun 19 Jan 2014 14:55:11 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:55:11 - XML: Start document: iteration 13
Sun 19 Jan 2014 14:55:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:55:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577337
Sun 19 Jan 2014 14:55:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:55:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:55:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:55:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:55:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577337
Sun 19 Jan 2014 14:55:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:55:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:55:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:55:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:55:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:55:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:55:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:55:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:55:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:55:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:55:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:55:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:55:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:55:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:55:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:55:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:55:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:55:35 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 14:55:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:55:35 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:55:35 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:55:35 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:55:35 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:55:35 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:55:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 14:55:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:55:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:55:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:55:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:55:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:55:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:55:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:55:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:55:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570400
Sun 19 Jan 2014 14:55:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:55:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570400
Sun 19 Jan 2014 14:55:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:55:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:55:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:55:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:55:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:55:50 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:55:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:55:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:55:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:55:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:55:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:55:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:55:50 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:55:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:55:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:55:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:55:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 14:55:50 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:55:50 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:55:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 14:55:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:55:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:55:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6058 values 95517 bits 11939 bytes 
Sun 19 Jan 2014 14:55:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:55:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:55:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:55:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:55:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:55:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:55:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:55:53 - job_xml_thread(): Done retrieving: data size 43589212
Sun 19 Jan 2014 14:55:53 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:55:53 - XML: Start document: iteration 14
Sun 19 Jan 2014 14:55:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43589212
Sun 19 Jan 2014 14:55:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:55:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43589212
Sun 19 Jan 2014 14:55:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:56:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:56:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:56:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:56:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:56:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:56:07 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:56:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:56:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:56:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:56:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:56:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:56:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:56:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:56:11 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 14:56:11 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:56:11 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:56:11 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:56:11 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:56:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:56:15 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:56:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:56:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:56:15 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:56:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 14:56:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:56:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:56:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:56:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:56:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:56:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:56:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570719
Sun 19 Jan 2014 14:56:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:56:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570719
Sun 19 Jan 2014 14:56:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:56:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:56:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:56:26 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:56:26 - job_xml_thread(): Done retrieving: data size 43570719
Sun 19 Jan 2014 14:56:26 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:56:26 - XML: Start document: iteration 15
Sun 19 Jan 2014 14:56:28 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 14:56:28 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:56:29 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:56:29 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:56:29 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 14:56:29 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 14:56:29 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 14:56:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:56:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:56:34 - size of cluster 'LISA Cluster': 624 hosts 79476 metrics 902533 values 14229595 bits 1778699 bytes 
Sun 19 Jan 2014 14:56:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:56:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:56:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:56:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:56:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:56:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:56:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:56:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:56:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:56:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:56:37 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:56:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:56:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:56:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:56:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:56:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:56:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:56:39 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 14:56:39 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:56:39 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:56:39 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:56:39 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:56:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:56:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43586161
Sun 19 Jan 2014 14:56:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:56:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43586161
Sun 19 Jan 2014 14:56:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:56:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:56:50 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:56:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:56:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:56:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:56:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 14:56:51 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:56:51 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:56:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 14:56:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8758 values 138102 bits 17262 bytes 
Sun 19 Jan 2014 14:56:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:56:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:56:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:56:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:56:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:56:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:56:55 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:56:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:56:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:56:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:56:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:56:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:56:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:56:58 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:56:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:56:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:56:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:56:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:56:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:56:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:57:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:57:02 - job_xml_thread(): Done retrieving: data size 43587089
Sun 19 Jan 2014 14:57:02 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:57:02 - XML: Start document: iteration 16
Sun 19 Jan 2014 14:57:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43587089
Sun 19 Jan 2014 14:57:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:57:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43587089
Sun 19 Jan 2014 14:57:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:57:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:57:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:57:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:57:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:57:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:57:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:57:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:57:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:57:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:57:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:57:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:57:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:57:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:57:19 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 14:57:19 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:57:19 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:57:19 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:57:19 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:57:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:57:25 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:57:25 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:57:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 14:57:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:57:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:57:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:57:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:57:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:57:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:57:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:57:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:57:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577862
Sun 19 Jan 2014 14:57:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:57:29 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:57:29 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 14:57:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577862
Sun 19 Jan 2014 14:57:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:57:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:57:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:57:34 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:57:34 - job_xml_thread(): Done retrieving: data size 43577862
Sun 19 Jan 2014 14:57:34 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:57:34 - XML: Start document: iteration 17
Sun 19 Jan 2014 14:57:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:57:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:57:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:57:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:57:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:57:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:57:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:57:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:57:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:57:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:57:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:57:46 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 14:57:46 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:57:46 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:57:46 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:57:46 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:57:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:57:51 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:57:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:57:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:57:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:57:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:57:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:57:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:57:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:57:51 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:57:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:57:52 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:57:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 14:57:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 14:57:52 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:57:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5679 values 89544 bits 11193 bytes 
Sun 19 Jan 2014 14:57:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:57:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561270
Sun 19 Jan 2014 14:57:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:57:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561270
Sun 19 Jan 2014 14:57:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:57:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:57:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:58:01 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:58:01 - job_xml_thread(): Done retrieving: data size 43561270
Sun 19 Jan 2014 14:58:01 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:58:01 - XML: Start document: iteration 18
Sun 19 Jan 2014 14:58:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:58:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:58:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:58:10 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:58:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:58:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:58:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:58:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:58:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:58:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:58:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:58:14 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 14:58:14 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:58:14 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:58:14 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:58:14 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:58:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:58:17 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:58:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:58:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:58:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:58:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:58:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:58:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:58:19 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:58:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 14:58:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:58:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:58:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553082
Sun 19 Jan 2014 14:58:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:58:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553082
Sun 19 Jan 2014 14:58:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:58:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:58:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:58:29 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:58:29 - job_xml_thread(): Done retrieving: data size 43553082
Sun 19 Jan 2014 14:58:30 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:58:30 - XML: Start document: iteration 19
Sun 19 Jan 2014 14:58:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:58:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:58:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:58:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:58:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:58:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:58:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:58:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:58:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:58:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:58:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:58:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:58:42 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:58:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:58:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:58:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:58:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:58:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:58:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:58:43 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 14:58:43 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:58:43 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:58:43 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:58:43 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:58:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:58:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581016
Sun 19 Jan 2014 14:58:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:58:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581016
Sun 19 Jan 2014 14:58:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:58:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:58:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:58:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:58:52 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:58:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:58:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 14:58:52 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:58:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 14:58:52 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:58:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7892 values 124449 bits 15556 bytes 
Sun 19 Jan 2014 14:58:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:58:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:58:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:58:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:58:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:58:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:58:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:58:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:58:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:58:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:58:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:58:58 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:59:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:59:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:59:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:59:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:59:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:59:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:59:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:59:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:59:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:59:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558312
Sun 19 Jan 2014 14:59:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:59:06 - job_xml_thread(): Done retrieving: data size 43558312
Sun 19 Jan 2014 14:59:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558312
Sun 19 Jan 2014 14:59:06 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:59:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:59:06 - XML: Start document: iteration 20
Sun 19 Jan 2014 14:59:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:59:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:59:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:59:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:59:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:59:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:59:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:59:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:59:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:59:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:59:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:59:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:59:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:59:25 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:59:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 14:59:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:59:27 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 14:59:28 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:59:28 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:59:28 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:59:28 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 14:59:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:59:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:59:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:59:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:59:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:59:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:59:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:59:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:59:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 14:59:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43475792
Sun 19 Jan 2014 14:59:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 14:59:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43475792
Sun 19 Jan 2014 14:59:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 14:59:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:59:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:59:43 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 14:59:43 - job_xml_thread(): Done retrieving: data size 43475792
Sun 19 Jan 2014 14:59:43 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 14:59:43 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 14:59:44 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 14:59:44 - Housekeeping: done.
Sun 19 Jan 2014 14:59:44 - XML: Start document: iteration 0
Sun 19 Jan 2014 14:59:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 14:59:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 14:59:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 14:59:47 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 14:59:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 14:59:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:59:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:59:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 14:59:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 14:59:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:59:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 14:59:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 14:59:52 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 14:59:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:59:52 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 14:59:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 14:59:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 14:59:53 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 14:59:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5779 values 91080 bits 11385 bytes 
Sun 19 Jan 2014 14:59:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 14:59:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 14:59:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 14:59:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 14:59:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:59:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 14:59:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 14:59:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 14:59:57 - XML: Processed 652417 elements - found 0 jobs
Sun 19 Jan 2014 14:59:57 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 14:59:57 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 14:59:57 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 14:59:57 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:00:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:00:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42907141
Sun 19 Jan 2014 15:00:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:00:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42907141
Sun 19 Jan 2014 15:00:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:00:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:00:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:00:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:00:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:00:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:00:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:00:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:00:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:00:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:00:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:00:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:00:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:00:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:00:13 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:00:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:00:17 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:00:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:00:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:00:17 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:00:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 15:00:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:00:17 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 15:00:17 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 15:00:17 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:00:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:00:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:00:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:00:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:00:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:00:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42957949
Sun 19 Jan 2014 15:00:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:00:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42957949
Sun 19 Jan 2014 15:00:20 - job_xml_thread(): Done retrieving: data size 42957949
Sun 19 Jan 2014 15:00:20 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:00:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:00:20 - XML: Start document: iteration 1
Sun 19 Jan 2014 15:00:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:00:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:00:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:00:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:00:35 - XML: Processed 645896 elements - found 0 jobs
Sun 19 Jan 2014 15:00:35 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:00:35 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:00:35 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:00:35 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:00:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:00:36 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:00:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:00:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:00:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:00:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:00:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:00:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:00:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:00:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:00:40 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:00:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:00:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:00:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:00:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:00:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:00:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:00:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:00:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43437361
Sun 19 Jan 2014 15:00:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:00:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43437361
Sun 19 Jan 2014 15:00:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:00:50 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:00:50 - job_xml_thread(): Done retrieving: data size 43437361
Sun 19 Jan 2014 15:00:50 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:00:50 - XML: Start document: iteration 2
Sun 19 Jan 2014 15:00:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:00:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:00:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:00:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:00:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:00:53 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:00:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:00:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:00:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:00:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:00:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:00:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:00:54 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:00:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 15:00:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 15:00:54 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:00:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8783 values 138527 bits 17315 bytes 
Sun 19 Jan 2014 15:00:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:00:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:00:59 - XML: Processed 651550 elements - found 0 jobs
Sun 19 Jan 2014 15:00:59 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:00:59 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:00:59 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:00:59 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:01:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:01:03 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:01:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:01:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:01:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:01:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:01:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:01:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:01:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:01:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43541103
Sun 19 Jan 2014 15:01:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:01:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43541103
Sun 19 Jan 2014 15:01:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:01:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:01:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:01:14 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:01:14 - job_xml_thread(): Done retrieving: data size 43541103
Sun 19 Jan 2014 15:01:14 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:01:14 - XML: Start document: iteration 3
Sun 19 Jan 2014 15:01:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:01:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:01:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:01:19 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:01:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:01:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:01:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:01:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:01:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:01:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:01:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:01:20 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:01:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 15:01:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:01:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:01:21 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:01:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:01:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:01:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:01:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:01:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:01:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:01:23 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 15:01:23 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:01:23 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:01:23 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:01:23 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:01:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:01:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577915
Sun 19 Jan 2014 15:01:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:01:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577915
Sun 19 Jan 2014 15:01:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:01:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:01:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:01:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:01:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:01:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:01:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:01:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:01:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:01:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:01:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:01:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:01:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:01:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:01:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:01:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:01:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:01:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:01:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:01:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:01:38 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:01:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:01:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43585345
Sun 19 Jan 2014 15:01:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:01:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43585345
Sun 19 Jan 2014 15:01:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:01:40 - job_xml_thread(): Done retrieving: data size 43585345
Sun 19 Jan 2014 15:01:41 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:01:41 - XML: Start document: iteration 4
Sun 19 Jan 2014 15:01:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:01:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:01:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:01:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:01:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:01:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:01:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:01:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:01:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:01:54 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:01:54 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:01:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:01:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 15:01:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:01:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 15:01:54 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:01:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:01:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:01:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:01:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:01:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9182 values 145169 bits 18146 bytes 
Sun 19 Jan 2014 15:01:56 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 15:01:56 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:01:56 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:01:56 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:01:56 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:02:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:02:00 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:02:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:02:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:02:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:02:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:02:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:02:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:02:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:02:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568303
Sun 19 Jan 2014 15:02:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:02:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568303
Sun 19 Jan 2014 15:02:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:02:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:02:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:02:11 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:02:11 - job_xml_thread(): Done retrieving: data size 43568303
Sun 19 Jan 2014 15:02:11 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:02:11 - XML: Start document: iteration 5
Sun 19 Jan 2014 15:02:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:02:13 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:02:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:02:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:02:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:02:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:02:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:02:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:02:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:02:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:02:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:02:21 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 15:02:21 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:02:21 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:02:21 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:02:21 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:02:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:02:24 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:02:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:02:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:02:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:02:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:02:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:02:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:02:25 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:02:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 15:02:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:02:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:02:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565561
Sun 19 Jan 2014 15:02:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:02:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565561
Sun 19 Jan 2014 15:02:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:02:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:02:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:02:36 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:02:36 - job_xml_thread(): Done retrieving: data size 43565561
Sun 19 Jan 2014 15:02:36 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:02:36 - XML: Start document: iteration 6
Sun 19 Jan 2014 15:02:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:02:36 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:02:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:02:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:02:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:02:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:02:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:02:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:02:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:02:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:02:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:02:45 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 15:02:45 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:02:45 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:02:45 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:02:45 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:02:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:02:48 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:02:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:02:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:02:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:02:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:02:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:02:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:02:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:02:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43547794
Sun 19 Jan 2014 15:02:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:02:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43547794
Sun 19 Jan 2014 15:02:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:02:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:02:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:02:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:02:54 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:02:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:02:55 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:02:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 15:02:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 15:02:55 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:02:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8492 values 134264 bits 16783 bytes 
Sun 19 Jan 2014 15:03:00 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:03:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:03:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:03:01 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:03:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:03:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:03:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:03:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:03:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:03:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:03:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:03:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:03:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:03:04 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:03:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:03:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:03:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:03:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:03:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:03:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:03:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:03:07 - job_xml_thread(): Done retrieving: data size 43572333
Sun 19 Jan 2014 15:03:07 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:03:07 - XML: Start document: iteration 7
Sun 19 Jan 2014 15:03:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572333
Sun 19 Jan 2014 15:03:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:03:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572333
Sun 19 Jan 2014 15:03:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:03:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:03:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:03:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:03:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:03:21 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 15:03:21 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:03:21 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:03:21 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:03:22 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:03:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:03:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:03:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:03:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:03:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:03:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:03:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:03:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:03:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:03:25 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:03:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 15:03:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:03:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:03:27 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:03:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:03:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:03:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:03:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:03:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:03:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:03:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:03:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43593025
Sun 19 Jan 2014 15:03:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:03:29 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 15:03:30 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:03:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43593025
Sun 19 Jan 2014 15:03:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:03:33 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:03:33 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 15:03:33 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:03:34 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 15:03:34 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 15:03:37 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:03:37 - job_xml_thread(): Done retrieving: data size 43593025
Sun 19 Jan 2014 15:03:38 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:03:38 - XML: Start document: iteration 8
Sun 19 Jan 2014 15:03:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:03:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:03:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:03:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:03:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:03:48 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:03:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:03:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:03:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:03:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:03:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:03:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:03:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:03:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:03:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:03:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:03:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:03:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:03:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:03:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:03:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:03:52 - XML: Processed 653347 elements - found 0 jobs
Sun 19 Jan 2014 15:03:52 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:03:52 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:03:52 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:03:52 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:03:52 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 895511 values 14144929 bits 1768116 bytes 
Sun 19 Jan 2014 15:03:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:03:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43586903
Sun 19 Jan 2014 15:03:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:03:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:03:56 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:03:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43586903
Sun 19 Jan 2014 15:03:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:03:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:03:58 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:03:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 15:03:58 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:03:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 15:03:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6439 values 101881 bits 12735 bytes 
Sun 19 Jan 2014 15:04:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:04:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:04:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:04:06 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:04:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:04:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:04:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:04:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:04:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:04:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:04:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:04:07 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:04:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:04:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:04:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:04:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:04:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:04:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:04:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:04:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:04:13 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:04:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 15:04:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:04:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:04:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43585496
Sun 19 Jan 2014 15:04:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:04:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43585496
Sun 19 Jan 2014 15:04:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:04:14 - job_xml_thread(): Done retrieving: data size 43585496
Sun 19 Jan 2014 15:04:14 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:04:14 - XML: Start document: iteration 9
Sun 19 Jan 2014 15:04:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:04:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:04:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:04:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:04:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:04:28 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:04:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:04:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:04:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:04:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:04:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:04:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:04:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:04:33 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:04:33 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 15:04:33 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 15:04:33 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:04:33 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:04:33 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:04:33 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:04:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:04:37 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:04:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:04:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:04:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:04:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:04:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:04:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:04:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:04:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567812
Sun 19 Jan 2014 15:04:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:04:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567812
Sun 19 Jan 2014 15:04:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:04:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:04:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:04:48 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:04:49 - job_xml_thread(): Done retrieving: data size 43567812
Sun 19 Jan 2014 15:04:49 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:04:49 - XML: Start document: iteration 10
Sun 19 Jan 2014 15:04:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:04:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:04:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:04:58 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:04:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:04:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 15:04:59 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:04:59 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:04:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 15:04:59 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 15:05:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99061 bits 12382 bytes 
Sun 19 Jan 2014 15:05:00 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:05:00 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:05:00 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:05:00 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:05:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:05:04 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:05:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:05:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:05:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:05:04 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:05:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:05:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:05:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:05:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:05:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:05:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:05:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:05:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:05:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:05:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:05:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:05:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:05:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43519850
Sun 19 Jan 2014 15:05:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:05:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43519850
Sun 19 Jan 2014 15:05:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:05:15 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:05:15 - job_xml_thread(): Done retrieving: data size 43519850
Sun 19 Jan 2014 15:05:15 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:05:15 - XML: Start document: iteration 11
Sun 19 Jan 2014 15:05:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:05:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:05:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:05:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:05:26 - XML: Processed 652600 elements - found 0 jobs
Sun 19 Jan 2014 15:05:26 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:05:26 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:05:26 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:05:26 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:05:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:05:29 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:05:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:05:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:05:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:05:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:05:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:05:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:05:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:05:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:05:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:05:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:05:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:05:30 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:05:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 15:05:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:05:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:05:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:05:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:05:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:05:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:05:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43052960
Sun 19 Jan 2014 15:05:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:05:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43052960
Sun 19 Jan 2014 15:05:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:05:41 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:05:41 - job_xml_thread(): Done retrieving: data size 43052960
Sun 19 Jan 2014 15:05:41 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:05:41 - XML: Start document: iteration 12
Sun 19 Jan 2014 15:05:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:05:43 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:05:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:05:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:05:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:05:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:05:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:05:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:05:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:05:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:05:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:05:52 - XML: Processed 646842 elements - found 0 jobs
Sun 19 Jan 2014 15:05:52 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:05:52 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:05:52 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:05:52 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:05:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:05:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:05:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:05:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:05:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:05:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:05:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:05:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:05:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:05:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42931810
Sun 19 Jan 2014 15:05:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:05:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42931810
Sun 19 Jan 2014 15:05:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:06:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:06:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:06:01 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:06:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:06:01 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:06:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 15:06:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:06:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 15:06:02 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:06:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9203 values 145200 bits 18150 bytes 
Sun 19 Jan 2014 15:06:07 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:06:07 - job_xml_thread(): Done retrieving: data size 42931810
Sun 19 Jan 2014 15:06:07 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:06:07 - XML: Start document: iteration 13
Sun 19 Jan 2014 15:06:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:06:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:06:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:06:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:06:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:06:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:06:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:06:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:06:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:06:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:06:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:06:16 - XML: Processed 645480 elements - found 0 jobs
Sun 19 Jan 2014 15:06:16 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:06:16 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:06:16 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:06:16 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:06:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:06:21 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:06:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:06:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:06:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:06:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:06:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:06:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:06:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:06:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42954066
Sun 19 Jan 2014 15:06:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:06:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:06:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:06:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42954066
Sun 19 Jan 2014 15:06:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:06:31 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:06:31 - job_xml_thread(): Done retrieving: data size 42954066
Sun 19 Jan 2014 15:06:31 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:06:31 - XML: Start document: iteration 14
Sun 19 Jan 2014 15:06:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:06:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:06:38 - XML: Processed 645838 elements - found 0 jobs
Sun 19 Jan 2014 15:06:38 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:06:38 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:06:38 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:06:38 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:06:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:06:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:06:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:06:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:06:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:06:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:06:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:06:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:06:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:06:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:06:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:06:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:06:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:06:46 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:06:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 15:06:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:06:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:06:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:06:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:06:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:06:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:06:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43534107
Sun 19 Jan 2014 15:06:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:06:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43534107
Sun 19 Jan 2014 15:06:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:06:53 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:06:53 - job_xml_thread(): Done retrieving: data size 43534107
Sun 19 Jan 2014 15:06:53 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:06:53 - XML: Start document: iteration 15
Sun 19 Jan 2014 15:06:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:06:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:07:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:07:01 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:07:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:07:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:07:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:07:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:07:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:07:01 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:07:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:07:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:07:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:07:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:07:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:07:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:07:02 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:07:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 15:07:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 15:07:02 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:07:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6024 values 95050 bits 11881 bytes 
Sun 19 Jan 2014 15:07:09 - XML: Processed 652964 elements - found 0 jobs
Sun 19 Jan 2014 15:07:09 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:07:09 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:07:09 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:07:09 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:07:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:07:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:07:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:07:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:07:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:07:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:07:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:07:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:07:15 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 15:07:15 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 15:07:15 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:07:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:07:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568329
Sun 19 Jan 2014 15:07:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:07:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568329
Sun 19 Jan 2014 15:07:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:07:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:07:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:07:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:07:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:07:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:07:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:07:24 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:07:24 - job_xml_thread(): Done retrieving: data size 43568329
Sun 19 Jan 2014 15:07:24 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:07:24 - XML: Start document: iteration 16
Sun 19 Jan 2014 15:07:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:07:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:07:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:07:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:07:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:07:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:07:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:07:34 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:07:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 15:07:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:07:36 - XML: Processed 653349 elements - found 0 jobs
Sun 19 Jan 2014 15:07:36 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:07:36 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:07:36 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:07:36 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:07:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:07:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:07:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:07:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:07:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:07:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:07:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:07:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:07:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:07:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:07:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:07:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43542863
Sun 19 Jan 2014 15:07:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:07:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43542863
Sun 19 Jan 2014 15:07:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:07:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:07:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:07:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:07:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:07:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:07:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:07:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:07:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43542863
Sun 19 Jan 2014 15:07:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:07:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:07:51 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:07:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:07:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:07:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:07:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:07:59 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:08:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:08:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:08:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:08:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:08:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:08:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:08:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:08:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:08:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:08:02 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:08:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:08:03 - job_xml_thread(): Done retrieving: data size 43539238
Sun 19 Jan 2014 15:08:03 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:08:03 - XML: Start document: iteration 17
Sun 19 Jan 2014 15:08:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:08:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 15:08:03 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:08:03 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:08:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 15:08:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43539238
Sun 19 Jan 2014 15:08:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5998 values 94602 bits 11825 bytes 
Sun 19 Jan 2014 15:08:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:08:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:08:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:08:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:08:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:08:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:08:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43539238
Sun 19 Jan 2014 15:08:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:08:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:08:16 - XML: Processed 653349 elements - found 0 jobs
Sun 19 Jan 2014 15:08:16 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:08:16 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:08:16 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:08:16 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:08:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:08:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:08:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:08:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:08:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:08:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:08:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:08:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:08:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:08:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:08:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:08:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:08:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:08:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:08:24 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:08:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:08:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:08:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:08:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:08:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:08:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:08:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:08:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43592404
Sun 19 Jan 2014 15:08:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:08:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43592404
Sun 19 Jan 2014 15:08:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:08:31 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:08:31 - job_xml_thread(): Done retrieving: data size 43592404
Sun 19 Jan 2014 15:08:31 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:08:31 - XML: Start document: iteration 18
Sun 19 Jan 2014 15:08:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:08:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:08:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:08:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:08:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:08:45 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:08:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:08:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:08:45 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:08:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 15:08:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:08:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:08:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:08:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:08:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:08:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:08:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:08:48 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:08:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:08:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:08:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:08:49 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 15:08:49 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:08:49 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:08:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:08:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:08:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:08:49 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:08:49 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:08:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:08:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43589782
Sun 19 Jan 2014 15:08:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:08:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43589782
Sun 19 Jan 2014 15:08:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:09:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:09:00 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:09:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:09:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:09:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:09:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:09:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:09:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:09:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:09:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:09:03 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:09:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:09:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:09:04 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:09:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:09:04 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:09:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:09:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 15:09:04 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:09:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:09:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 15:09:04 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:09:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:09:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6079 values 95873 bits 11984 bytes 
Sun 19 Jan 2014 15:09:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:09:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:09:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:09:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:09:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:09:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43592477
Sun 19 Jan 2014 15:09:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:09:07 - job_xml_thread(): Done retrieving: data size 43592477
Sun 19 Jan 2014 15:09:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43592477
Sun 19 Jan 2014 15:09:07 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:09:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:09:07 - XML: Start document: iteration 19
Sun 19 Jan 2014 15:09:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:09:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:09:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:09:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:09:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:09:25 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:09:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:09:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:09:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:09:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:09:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:09:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:09:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:09:27 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 15:09:27 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:09:27 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:09:27 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:09:27 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:09:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:09:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:09:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:09:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:09:30 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:09:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 15:09:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:09:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:09:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:09:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:09:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:09:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:09:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568233
Sun 19 Jan 2014 15:09:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:09:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568233
Sun 19 Jan 2014 15:09:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:09:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:09:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:09:42 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:09:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:09:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:09:43 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:09:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:09:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:09:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:09:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:09:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:09:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:09:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:09:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:09:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:09:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:09:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:09:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:09:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:09:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:09:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:09:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:09:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:09:47 - job_xml_thread(): Done retrieving: data size 43567095
Sun 19 Jan 2014 15:09:47 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:09:47 - XML: Start document: iteration 20
Sun 19 Jan 2014 15:09:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567095
Sun 19 Jan 2014 15:09:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:09:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567095
Sun 19 Jan 2014 15:09:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:09:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:09:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:10:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:10:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:10:02 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 15:10:02 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:10:03 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:10:04 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:10:04 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:10:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:10:05 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:10:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:10:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 15:10:06 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:10:06 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:10:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8849 values 139467 bits 17433 bytes 
Sun 19 Jan 2014 15:10:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 15:10:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:10:07 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:10:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:10:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:10:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:10:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:10:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:10:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:10:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:10:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:10:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:10:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:10:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:10:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:10:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:10:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:10:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:10:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:10:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43592654
Sun 19 Jan 2014 15:10:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:10:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43592654
Sun 19 Jan 2014 15:10:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:10:19 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:10:19 - job_xml_thread(): Done retrieving: data size 43592654
Sun 19 Jan 2014 15:10:19 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:10:19 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 15:10:20 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 15:10:20 - Housekeeping: done.
Sun 19 Jan 2014 15:10:20 - XML: Start document: iteration 0
Sun 19 Jan 2014 15:10:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:10:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:10:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:10:25 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:10:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:10:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:10:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:10:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:10:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:10:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:10:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:10:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:10:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:10:33 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 15:10:33 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:10:33 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:10:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 15:10:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:10:34 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:10:34 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 15:10:34 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:10:34 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 15:10:34 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 15:10:34 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 15:10:34 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:10:34 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:10:34 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:10:34 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:10:36 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 853991 values 13462304 bits 1682788 bytes 
Sun 19 Jan 2014 15:10:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:10:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:10:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:10:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:10:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:10:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:10:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:10:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:10:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:10:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559878
Sun 19 Jan 2014 15:10:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:10:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559878
Sun 19 Jan 2014 15:10:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:10:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:10:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:10:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:10:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:10:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:10:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:10:49 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:10:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:10:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:10:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:10:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:10:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:10:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:10:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:10:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:10:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:10:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:10:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:10:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:10:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:10:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:10:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:10:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:10:57 - job_xml_thread(): Done retrieving: data size 43588442
Sun 19 Jan 2014 15:10:57 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:10:57 - XML: Start document: iteration 1
Sun 19 Jan 2014 15:10:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43588442
Sun 19 Jan 2014 15:10:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43588442
Sun 19 Jan 2014 15:10:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:10:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:11:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:11:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:11:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:11:07 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:11:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:11:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 15:11:07 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:11:07 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:11:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 15:11:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8900 values 140330 bits 17541 bytes 
Sun 19 Jan 2014 15:11:09 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 15:11:09 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:11:09 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:11:09 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:11:09 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:11:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:11:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:11:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:11:20 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:11:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:11:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:11:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:11:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:11:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:11:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:11:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:11:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:11:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:11:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:11:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:11:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:11:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:11:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:11:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:11:24 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:11:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:11:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43535079
Sun 19 Jan 2014 15:11:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:11:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43535079
Sun 19 Jan 2014 15:11:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:11:26 - job_xml_thread(): Done retrieving: data size 43535079
Sun 19 Jan 2014 15:11:26 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:11:26 - XML: Start document: iteration 2
Sun 19 Jan 2014 15:11:34 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:11:34 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 15:11:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:11:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:11:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:11:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:11:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:11:43 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:11:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:11:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:11:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:11:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:11:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:11:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:11:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:11:45 - XML: Processed 652588 elements - found 0 jobs
Sun 19 Jan 2014 15:11:45 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:11:45 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:11:45 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:11:45 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:11:46 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:11:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 15:11:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:11:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:11:47 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:11:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:11:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:11:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:11:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:11:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:11:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:11:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:11:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42937032
Sun 19 Jan 2014 15:11:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:11:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42937032
Sun 19 Jan 2014 15:11:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:11:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:11:59 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:11:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:11:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:11:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:11:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:12:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:12:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:12:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:12:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:12:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:12:00 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:12:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:12:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:12:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:12:05 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:12:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:12:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:12:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:12:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:12:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:12:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:12:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:12:08 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:12:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:12:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42910379
Sun 19 Jan 2014 15:12:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:12:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42910379
Sun 19 Jan 2014 15:12:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:12:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:12:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 15:12:08 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:12:08 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:12:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 15:12:08 - job_xml_thread(): Done retrieving: data size 42910379
Sun 19 Jan 2014 15:12:08 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:12:08 - XML: Start document: iteration 3
Sun 19 Jan 2014 15:12:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6077 values 95803 bits 11975 bytes 
Sun 19 Jan 2014 15:12:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:12:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:12:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:12:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:12:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:12:27 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:12:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:12:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:12:27 - XML: Processed 645150 elements - found 0 jobs
Sun 19 Jan 2014 15:12:27 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:12:27 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:12:27 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:12:27 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:12:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:12:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:12:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:12:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:12:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:12:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:12:31 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:12:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:12:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:12:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:12:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:12:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:12:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:12:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:12:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43384452
Sun 19 Jan 2014 15:12:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:12:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43384452
Sun 19 Jan 2014 15:12:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:12:37 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:12:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 15:12:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:12:42 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:12:42 - job_xml_thread(): Done retrieving: data size 43384452
Sun 19 Jan 2014 15:12:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:12:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:12:42 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:12:43 - XML: Start document: iteration 4
Sun 19 Jan 2014 15:12:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:12:45 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:12:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:12:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:12:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:12:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:12:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:12:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:12:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:12:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:12:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:12:54 - XML: Processed 651232 elements - found 0 jobs
Sun 19 Jan 2014 15:12:54 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:12:54 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:12:54 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:12:54 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:12:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:12:57 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:12:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:12:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:12:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:12:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:12:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:12:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:13:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:13:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43525737
Sun 19 Jan 2014 15:13:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:13:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43525737
Sun 19 Jan 2014 15:13:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:13:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:13:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:13:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:13:08 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:13:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:13:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:13:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:13:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 15:13:09 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:13:09 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:13:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 15:13:09 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:13:09 - job_xml_thread(): Done retrieving: data size 43525737
Sun 19 Jan 2014 15:13:09 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:13:09 - XML: Start document: iteration 5
Sun 19 Jan 2014 15:13:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:13:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:13:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6295 values 99316 bits 12414 bytes 
Sun 19 Jan 2014 15:13:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:13:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:13:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:13:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:13:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:13:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:13:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:13:19 - XML: Processed 652946 elements - found 0 jobs
Sun 19 Jan 2014 15:13:19 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:13:19 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:13:19 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:13:19 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:13:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:13:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:13:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:13:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:13:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:13:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:13:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:13:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:13:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:13:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:13:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:13:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43548425
Sun 19 Jan 2014 15:13:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:13:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43548425
Sun 19 Jan 2014 15:13:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:13:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:13:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:13:34 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:13:34 - job_xml_thread(): Done retrieving: data size 43548425
Sun 19 Jan 2014 15:13:34 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:13:34 - XML: Start document: iteration 6
Sun 19 Jan 2014 15:13:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:13:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:13:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:13:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:13:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43548425
Sun 19 Jan 2014 15:13:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:13:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:13:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:13:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:13:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:13:45 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:13:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 15:13:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:13:49 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 15:13:49 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:13:49 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:13:49 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:13:49 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:13:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:13:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:13:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:13:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:13:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:13:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:13:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:13:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:13:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:13:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:13:55 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:13:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:13:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:13:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:13:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:13:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:13:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:13:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:13:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43587330
Sun 19 Jan 2014 15:13:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:13:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43587330
Sun 19 Jan 2014 15:13:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:14:04 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:14:04 - job_xml_thread(): Done retrieving: data size 43587330
Sun 19 Jan 2014 15:14:04 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:14:04 - XML: Start document: iteration 7
Sun 19 Jan 2014 15:14:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:14:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:14:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:14:09 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:14:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:14:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:14:10 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:14:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 15:14:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 15:14:10 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:14:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:14:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6081 values 95913 bits 11989 bytes 
Sun 19 Jan 2014 15:14:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:14:14 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:14:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:14:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:14:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:14:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:14:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:14:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:14:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:14:21 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 15:14:21 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:14:21 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:14:21 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:14:21 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:14:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:14:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:14:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:14:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:14:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:14:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:14:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:14:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:14:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:14:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574253
Sun 19 Jan 2014 15:14:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:14:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574253
Sun 19 Jan 2014 15:14:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:14:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:14:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:14:35 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:14:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 15:14:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:14:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:14:36 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:14:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:14:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:14:36 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:14:36 - job_xml_thread(): Done retrieving: data size 43574253
Sun 19 Jan 2014 15:14:36 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:14:36 - XML: Start document: iteration 8
Sun 19 Jan 2014 15:14:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:14:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:14:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:14:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:14:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:14:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:14:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:14:49 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 15:14:49 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:14:49 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:14:49 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:14:49 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:14:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:14:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:14:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:14:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:14:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:14:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:14:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:14:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:14:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:14:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:14:52 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 15:14:52 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 15:14:52 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:14:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:14:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43549017
Sun 19 Jan 2014 15:14:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:14:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43549017
Sun 19 Jan 2014 15:14:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:15:04 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:15:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:15:04 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:15:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:15:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:15:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:15:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:15:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:15:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:15:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:15:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:15:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:15:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:15:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:15:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:15:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:15:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:15:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:15:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:15:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:15:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:15:09 - job_xml_thread(): Done retrieving: data size 43592971
Sun 19 Jan 2014 15:15:09 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:15:09 - XML: Start document: iteration 9
Sun 19 Jan 2014 15:15:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43592971
Sun 19 Jan 2014 15:15:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43592971
Sun 19 Jan 2014 15:15:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:15:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:15:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:15:11 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:15:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:15:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 15:15:12 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:15:12 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:15:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 15:15:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9269 values 146116 bits 18264 bytes 
Sun 19 Jan 2014 15:15:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:15:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:15:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:15:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:15:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:15:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:15:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:15:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:15:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:15:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:15:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:15:29 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 15:15:29 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:15:29 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:15:29 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:15:29 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:15:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:15:31 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:15:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:15:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:15:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:15:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:15:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:15:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:15:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:15:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43551667
Sun 19 Jan 2014 15:15:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:15:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43551667
Sun 19 Jan 2014 15:15:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:15:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:15:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:15:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:15:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:15:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:15:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:15:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:15:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:15:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43551667
Sun 19 Jan 2014 15:15:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:15:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:15:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:15:44 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:15:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:15:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:15:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:15:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:15:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:15:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:15:53 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:15:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:15:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:15:54 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:15:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 15:15:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:15:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:15:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:15:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:15:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:15:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:15:55 - job_xml_thread(): Done retrieving: data size 43571753
Sun 19 Jan 2014 15:15:55 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:15:55 - XML: Start document: iteration 10
Sun 19 Jan 2014 15:15:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571753
Sun 19 Jan 2014 15:15:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:15:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:15:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:15:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:15:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:15:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:15:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:15:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571753
Sun 19 Jan 2014 15:15:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:16:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:16:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:16:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:16:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:16:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:16:12 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:16:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:16:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 15:16:13 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:16:13 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:16:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 15:16:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5866 values 92592 bits 11574 bytes 
Sun 19 Jan 2014 15:16:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:16:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:16:14 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 15:16:14 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:16:14 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:16:14 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:16:14 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:16:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:16:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:16:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:16:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:16:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:16:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:16:16 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:16:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:16:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:16:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:16:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:16:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:16:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:16:18 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:16:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 15:16:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:16:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:16:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579062
Sun 19 Jan 2014 15:16:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:16:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579062
Sun 19 Jan 2014 15:16:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:16:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:16:29 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:16:29 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:16:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:16:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:16:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:16:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:16:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:16:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:16:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:16:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:16:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:16:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:16:32 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:16:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:16:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:16:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:16:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:16:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:16:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:16:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:16:34 - job_xml_thread(): Done retrieving: data size 43579457
Sun 19 Jan 2014 15:16:34 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:16:34 - XML: Start document: iteration 11
Sun 19 Jan 2014 15:16:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579457
Sun 19 Jan 2014 15:16:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579457
Sun 19 Jan 2014 15:16:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:16:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:16:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:16:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:16:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:16:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:16:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:16:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:16:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:16:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:16:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:16:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:16:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:16:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:16:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:16:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:16:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:16:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:16:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:16:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:16:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:16:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:16:57 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 15:16:57 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:16:57 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:16:57 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:16:57 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:16:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:16:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:16:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43595611
Sun 19 Jan 2014 15:16:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:16:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43595611
Sun 19 Jan 2014 15:16:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:17:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:17:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:17:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:17:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:17:12 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:17:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:17:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:17:14 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:17:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:17:14 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:17:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:17:14 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:17:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:17:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 15:17:14 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:17:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:17:14 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:17:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:17:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 15:17:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148944 bits 18618 bytes 
Sun 19 Jan 2014 15:17:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:17:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:17:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:17:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:17:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:17:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:17:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:17:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:17:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:17:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:17:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:17:16 - job_xml_thread(): Done retrieving: data size 43518312
Sun 19 Jan 2014 15:17:16 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:17:16 - XML: Start document: iteration 12
Sun 19 Jan 2014 15:17:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43518312
Sun 19 Jan 2014 15:17:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:17:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43518312
Sun 19 Jan 2014 15:17:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:17:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:17:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:17:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:17:31 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:17:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:17:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:17:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:17:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:17:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:17:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:17:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:17:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:17:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:17:34 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 15:17:34 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:17:35 - XML: Processed 652600 elements - found 0 jobs
Sun 19 Jan 2014 15:17:35 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:17:35 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:17:35 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:17:35 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:17:35 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:17:35 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 15:17:35 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 15:17:35 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:17:35 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 15:17:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:17:40 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:17:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:17:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:17:40 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 804897 values 12704473 bits 1588059 bytes 
Sun 19 Jan 2014 15:17:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:17:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:17:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:17:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:17:41 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:17:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 15:17:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:17:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:17:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43024961
Sun 19 Jan 2014 15:17:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:17:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43024961
Sun 19 Jan 2014 15:17:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:17:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:17:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:17:50 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:17:50 - job_xml_thread(): Done retrieving: data size 43024961
Sun 19 Jan 2014 15:17:50 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:17:50 - XML: Start document: iteration 13
Sun 19 Jan 2014 15:17:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:17:54 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:17:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:17:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:17:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:17:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:17:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:17:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:17:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:17:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:17:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:18:02 - XML: Processed 646516 elements - found 0 jobs
Sun 19 Jan 2014 15:18:02 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:18:02 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:18:02 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:18:02 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:18:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:18:06 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:18:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:18:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:18:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:18:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:18:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:18:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:18:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:18:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42894210
Sun 19 Jan 2014 15:18:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:18:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42894210
Sun 19 Jan 2014 15:18:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:18:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:18:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:18:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:18:15 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:18:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:18:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 15:18:16 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:18:16 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:18:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 15:18:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8624 values 136307 bits 17038 bytes 
Sun 19 Jan 2014 15:18:17 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:18:17 - job_xml_thread(): Done retrieving: data size 42894210
Sun 19 Jan 2014 15:18:17 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:18:17 - XML: Start document: iteration 14
Sun 19 Jan 2014 15:18:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:18:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:18:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:18:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:18:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:18:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:18:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:18:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:18:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:18:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:18:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:18:27 - XML: Processed 645150 elements - found 0 jobs
Sun 19 Jan 2014 15:18:27 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:18:27 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:18:27 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:18:27 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:18:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:18:31 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:18:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:18:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:18:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:18:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:18:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:18:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:18:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:18:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43363110
Sun 19 Jan 2014 15:18:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:18:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43363110
Sun 19 Jan 2014 15:18:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:18:36 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:18:36 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 15:18:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:18:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:18:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:18:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:18:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:18:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:18:42 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:18:42 - job_xml_thread(): Done retrieving: data size 43363110
Sun 19 Jan 2014 15:18:42 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:18:42 - XML: Start document: iteration 15
Sun 19 Jan 2014 15:18:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:18:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:18:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:18:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:18:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43363110
Sun 19 Jan 2014 15:18:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:18:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:18:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:18:55 - XML: Processed 650993 elements - found 0 jobs
Sun 19 Jan 2014 15:18:55 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:18:55 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:18:55 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:18:55 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:18:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:18:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:19:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:19:00 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:19:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:19:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:19:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:19:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:19:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:19:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:19:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:19:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:19:05 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:19:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:19:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:19:05 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:19:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 15:19:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:19:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:19:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:19:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:19:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:19:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:19:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569559
Sun 19 Jan 2014 15:19:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:19:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569559
Sun 19 Jan 2014 15:19:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:19:10 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:19:10 - job_xml_thread(): Done retrieving: data size 43569559
Sun 19 Jan 2014 15:19:10 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:19:10 - XML: Start document: iteration 16
Sun 19 Jan 2014 15:19:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:19:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:19:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:19:16 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:19:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:19:18 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:19:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 15:19:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 15:19:18 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:19:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5804 values 91584 bits 11448 bytes 
Sun 19 Jan 2014 15:19:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:19:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:19:26 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 15:19:26 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:19:26 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:19:26 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:19:26 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:19:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:19:29 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:19:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:19:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:19:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:19:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:19:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:19:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:19:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:19:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:19:31 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:19:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:19:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:19:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:19:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:19:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:19:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:19:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:19:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562888
Sun 19 Jan 2014 15:19:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:19:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562888
Sun 19 Jan 2014 15:19:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:19:41 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:19:41 - job_xml_thread(): Done retrieving: data size 43562888
Sun 19 Jan 2014 15:19:41 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:19:41 - XML: Start document: iteration 17
Sun 19 Jan 2014 15:19:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:19:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:19:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:19:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:19:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:19:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:19:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:19:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:19:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:19:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:19:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:19:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:19:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:19:51 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:19:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 15:19:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:19:56 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 15:19:56 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:19:56 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:19:56 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:19:56 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:19:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:19:59 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:19:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:19:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:19:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:19:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:19:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:19:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:20:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:20:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555508
Sun 19 Jan 2014 15:20:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:20:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555508
Sun 19 Jan 2014 15:20:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:20:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:20:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:20:11 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:20:11 - job_xml_thread(): Done retrieving: data size 43555508
Sun 19 Jan 2014 15:20:11 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:20:11 - XML: Start document: iteration 18
Sun 19 Jan 2014 15:20:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:20:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:20:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:20:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:20:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:20:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:20:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:20:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:20:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:20:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:20:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:20:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:20:18 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:20:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:20:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 15:20:19 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:20:19 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:20:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 15:20:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6124 values 96608 bits 12076 bytes 
Sun 19 Jan 2014 15:20:22 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 15:20:22 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:20:22 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:20:22 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:20:22 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:20:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:20:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:20:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:20:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:20:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:20:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:20:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:20:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:20:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:20:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555540
Sun 19 Jan 2014 15:20:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:20:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555540
Sun 19 Jan 2014 15:20:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:20:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:20:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:20:37 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:20:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:20:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:20:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:20:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:20:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:20:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:20:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:20:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:20:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:20:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:20:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:20:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:20:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:20:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:20:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:20:44 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:20:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 15:20:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:20:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:20:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:20:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:20:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:20:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:20:46 - job_xml_thread(): Done retrieving: data size 43572395
Sun 19 Jan 2014 15:20:46 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:20:46 - XML: Start document: iteration 19
Sun 19 Jan 2014 15:20:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572395
Sun 19 Jan 2014 15:20:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572395
Sun 19 Jan 2014 15:20:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:20:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:20:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:20:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:20:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:20:59 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:21:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:21:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:21:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:21:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:21:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:21:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:21:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:21:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:21:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:21:03 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 15:21:03 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:21:03 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:21:03 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:21:03 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:21:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:21:07 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:21:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:21:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:21:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:21:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:21:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:21:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:21:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:21:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570744
Sun 19 Jan 2014 15:21:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:21:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570744
Sun 19 Jan 2014 15:21:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:21:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:21:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:21:19 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:21:19 - job_xml_thread(): Done retrieving: data size 43570744
Sun 19 Jan 2014 15:21:19 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:21:19 - XML: Start document: iteration 20
Sun 19 Jan 2014 15:21:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:21:19 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:21:20 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:21:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:21:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 15:21:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 15:21:20 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:21:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8927 values 140824 bits 17603 bytes 
Sun 19 Jan 2014 15:21:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:21:22 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:21:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:21:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:21:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:21:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:21:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:21:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:21:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:21:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:21:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:21:33 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 15:21:33 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:21:33 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:21:33 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:21:33 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:21:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:21:34 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:21:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:21:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:21:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:21:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:21:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:21:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:21:35 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 15:21:35 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 15:21:35 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:21:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:21:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43547210
Sun 19 Jan 2014 15:21:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:21:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43547210
Sun 19 Jan 2014 15:21:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:21:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:21:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:21:48 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:21:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:21:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:21:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:21:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:21:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:21:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:21:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:21:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:21:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:21:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:21:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:21:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:21:51 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:21:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:21:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:21:51 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:21:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 15:21:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:21:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:21:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:21:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:21:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:21:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:21:52 - job_xml_thread(): Done retrieving: data size 43582475
Sun 19 Jan 2014 15:21:52 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:21:52 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 15:21:52 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 15:21:52 - Housekeeping: done.
Sun 19 Jan 2014 15:21:52 - XML: Start document: iteration 0
Sun 19 Jan 2014 15:21:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582475
Sun 19 Jan 2014 15:21:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:21:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582475
Sun 19 Jan 2014 15:21:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:22:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:22:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:22:04 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:22:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:22:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:22:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:22:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:22:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:22:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:22:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:22:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:22:10 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 15:22:10 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:22:10 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:22:10 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:22:10 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:22:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:22:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:22:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:22:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:22:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:22:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:22:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:22:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:22:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:22:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582509
Sun 19 Jan 2014 15:22:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:22:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582509
Sun 19 Jan 2014 15:22:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:22:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:22:20 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:22:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:22:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:22:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:22:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 15:22:22 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:22:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 15:22:22 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:22:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8808 values 138888 bits 17361 bytes 
Sun 19 Jan 2014 15:22:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:22:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:22:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:22:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:22:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:22:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:22:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:22:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:22:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:22:25 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:22:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:22:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:22:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:22:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:22:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:22:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:22:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:22:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:22:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:22:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:22:32 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:22:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 15:22:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:22:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:22:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567867
Sun 19 Jan 2014 15:22:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:22:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567867
Sun 19 Jan 2014 15:22:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:22:33 - job_xml_thread(): Done retrieving: data size 43567867
Sun 19 Jan 2014 15:22:33 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:22:33 - XML: Start document: iteration 1
Sun 19 Jan 2014 15:22:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:22:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:22:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:22:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:22:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:22:47 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:22:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:22:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:22:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:22:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:22:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:22:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:22:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:22:52 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 15:22:52 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:22:52 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:22:52 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:22:53 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:22:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:22:55 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:22:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:22:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:22:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:22:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:22:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:22:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:22:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:22:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580853
Sun 19 Jan 2014 15:22:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:22:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580853
Sun 19 Jan 2014 15:22:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:23:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:23:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:23:08 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:23:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:23:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:23:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:23:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:23:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:23:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:23:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:23:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:23:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:23:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:23:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:23:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:23:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:23:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:23:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:23:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:23:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:23:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:23:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:23:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:23:14 - job_xml_thread(): Done retrieving: data size 43515473
Sun 19 Jan 2014 15:23:14 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:23:14 - XML: Start document: iteration 2
Sun 19 Jan 2014 15:23:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43515473
Sun 19 Jan 2014 15:23:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:23:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43515473
Sun 19 Jan 2014 15:23:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:23:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:23:22 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:23:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:23:23 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:23:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 15:23:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 15:23:23 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:23:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148641 bits 18580 bytes 
Sun 19 Jan 2014 15:23:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:23:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:23:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:23:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:23:29 - XML: Processed 652600 elements - found 0 jobs
Sun 19 Jan 2014 15:23:29 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:23:29 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:23:29 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:23:29 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:23:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:23:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:23:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:23:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:23:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:23:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:23:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:23:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:23:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:23:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:23:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:23:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:23:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:23:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:23:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:23:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:23:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:23:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:23:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43016932
Sun 19 Jan 2014 15:23:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:23:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43016932
Sun 19 Jan 2014 15:23:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:23:44 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:23:44 - job_xml_thread(): Done retrieving: data size 43016932
Sun 19 Jan 2014 15:23:44 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:23:44 - XML: Start document: iteration 3
Sun 19 Jan 2014 15:23:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:23:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:23:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:23:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:23:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:23:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:23:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:23:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:23:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:23:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:23:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:23:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:23:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:23:55 - XML: Processed 646320 elements - found 0 jobs
Sun 19 Jan 2014 15:23:55 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:23:55 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:23:55 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:23:55 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:24:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:24:00 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:24:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:24:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:24:00 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:24:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 15:24:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:24:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:24:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:24:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:24:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:24:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:24:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42904754
Sun 19 Jan 2014 15:24:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:24:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42904754
Sun 19 Jan 2014 15:24:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:24:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:24:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:24:10 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:24:10 - job_xml_thread(): Done retrieving: data size 42904754
Sun 19 Jan 2014 15:24:10 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:24:10 - XML: Start document: iteration 4
Sun 19 Jan 2014 15:24:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:24:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:24:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:24:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:24:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:24:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:24:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:24:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:24:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:24:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:24:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:24:20 - XML: Processed 645246 elements - found 0 jobs
Sun 19 Jan 2014 15:24:20 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:24:20 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:24:20 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:24:20 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:24:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:24:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:24:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:24:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:24:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:24:23 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:24:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:24:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:24:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:24:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:24:23 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:24:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 15:24:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:24:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 15:24:23 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:24:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5843 values 92130 bits 11516 bytes 
Sun 19 Jan 2014 15:24:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:24:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42977136
Sun 19 Jan 2014 15:24:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:24:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42977136
Sun 19 Jan 2014 15:24:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:24:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:24:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:24:35 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:24:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:24:36 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 15:24:36 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:24:37 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:24:37 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 15:24:37 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:24:37 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 15:24:37 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 15:24:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:24:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:24:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:24:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:24:38 - size of cluster 'LISA Cluster': 624 hosts 79472 metrics 792857 values 12499237 bits 1562404 bytes 
Sun 19 Jan 2014 15:24:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:24:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:24:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:24:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:24:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:24:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:24:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:24:42 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:24:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:24:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:24:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:24:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:24:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:24:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:24:43 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:24:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 15:24:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:24:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:24:45 - job_xml_thread(): Done retrieving: data size 43442394
Sun 19 Jan 2014 15:24:45 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:24:45 - XML: Start document: iteration 5
Sun 19 Jan 2014 15:24:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43442394
Sun 19 Jan 2014 15:24:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:24:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43442394
Sun 19 Jan 2014 15:24:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:24:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:24:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:24:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:24:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:25:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:25:04 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:25:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:25:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:25:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:25:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:25:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:25:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:25:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:25:08 - XML: Processed 651674 elements - found 0 jobs
Sun 19 Jan 2014 15:25:08 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:25:08 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:25:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:25:08 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:25:08 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:25:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:25:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:25:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:25:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:25:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:25:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:25:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:25:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:25:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43586436
Sun 19 Jan 2014 15:25:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:25:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43586436
Sun 19 Jan 2014 15:25:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:25:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:25:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:25:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:25:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:25:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:25:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:25:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:25:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:25:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:25:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:25:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:25:23 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:25:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:25:24 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:25:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:25:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:25:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:25:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:25:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 15:25:25 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:25:25 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:25:25 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:25:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 15:25:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7699 values 121380 bits 15172 bytes 
Sun 19 Jan 2014 15:25:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:25:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:25:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:25:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:25:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:25:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:25:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:25:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573569
Sun 19 Jan 2014 15:25:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:25:29 - job_xml_thread(): Done retrieving: data size 43573569
Sun 19 Jan 2014 15:25:29 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:25:29 - XML: Start document: iteration 6
Sun 19 Jan 2014 15:25:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573569
Sun 19 Jan 2014 15:25:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:25:37 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:25:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:25:38 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 15:25:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:25:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:25:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:25:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:25:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:25:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:25:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:25:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:25:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:25:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:25:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:25:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:25:44 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 15:25:44 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:25:44 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:25:44 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:25:44 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:25:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:25:48 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:25:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:25:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:25:48 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:25:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 15:25:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:25:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:25:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:25:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:25:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:25:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:25:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43550900
Sun 19 Jan 2014 15:25:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:25:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43550900
Sun 19 Jan 2014 15:25:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:25:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:25:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:25:59 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:25:59 - job_xml_thread(): Done retrieving: data size 43550900
Sun 19 Jan 2014 15:25:59 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:25:59 - XML: Start document: iteration 7
Sun 19 Jan 2014 15:26:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:26:01 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:26:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:26:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:26:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:26:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:26:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:26:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:26:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:26:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:26:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:26:13 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 15:26:13 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:26:13 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:26:13 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:26:13 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:26:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:26:14 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:26:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:26:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:26:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:26:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:26:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:26:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:26:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:26:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553508
Sun 19 Jan 2014 15:26:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:26:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:26:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:26:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553508
Sun 19 Jan 2014 15:26:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:26:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:26:26 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:26:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:26:27 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:26:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:26:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:26:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:26:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 15:26:27 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:26:27 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:26:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 15:26:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8810 values 138915 bits 17364 bytes 
Sun 19 Jan 2014 15:26:28 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:26:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:26:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:26:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:26:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:26:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:26:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:26:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:26:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:26:32 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:26:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:26:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:26:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:26:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:26:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:26:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:26:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:26:35 - job_xml_thread(): Done retrieving: data size 43562020
Sun 19 Jan 2014 15:26:35 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:26:35 - XML: Start document: iteration 8
Sun 19 Jan 2014 15:26:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562020
Sun 19 Jan 2014 15:26:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562020
Sun 19 Jan 2014 15:26:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:26:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:26:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:26:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:26:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:26:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:26:51 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 15:26:51 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:26:51 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:26:51 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:26:51 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:26:56 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:26:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 15:26:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:26:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:26:57 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:26:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:26:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:26:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:26:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:26:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:26:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:26:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:26:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:26:58 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:26:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:26:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:26:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:26:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:26:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:26:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:27:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:27:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43593070
Sun 19 Jan 2014 15:27:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:27:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43593070
Sun 19 Jan 2014 15:27:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:27:06 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:27:06 - job_xml_thread(): Done retrieving: data size 43593070
Sun 19 Jan 2014 15:27:06 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:27:06 - XML: Start document: iteration 9
Sun 19 Jan 2014 15:27:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:27:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:27:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:27:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:27:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:27:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:27:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:27:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:27:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:27:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:27:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:27:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:27:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:27:23 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 15:27:23 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:27:23 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:27:23 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:27:23 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:27:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:27:24 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:27:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:27:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:27:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:27:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:27:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:27:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:27:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:27:27 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:27:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:27:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564988
Sun 19 Jan 2014 15:27:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:27:28 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:27:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564988
Sun 19 Jan 2014 15:27:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 15:27:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:27:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 15:27:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:27:28 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:27:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8975 values 141561 bits 17695 bytes 
Sun 19 Jan 2014 15:27:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:27:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:27:38 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:27:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:27:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:27:39 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:27:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:27:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:27:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:27:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:27:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:27:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:27:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:27:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:27:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:27:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:27:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:27:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:27:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:27:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:27:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:27:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:27:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:27:46 - job_xml_thread(): Done retrieving: data size 43578383
Sun 19 Jan 2014 15:27:46 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:27:46 - XML: Start document: iteration 10
Sun 19 Jan 2014 15:27:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578383
Sun 19 Jan 2014 15:27:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:27:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578383
Sun 19 Jan 2014 15:27:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:27:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:27:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:27:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:27:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:28:04 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 15:28:04 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:28:04 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:28:04 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:28:04 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:28:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:28:06 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:28:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:28:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:28:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:28:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:28:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:28:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:28:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:28:09 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:28:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 15:28:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:28:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:28:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:28:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:28:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:28:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:28:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:28:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:28:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:28:11 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 15:28:12 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 15:28:12 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:28:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:28:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583639
Sun 19 Jan 2014 15:28:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:28:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583639
Sun 19 Jan 2014 15:28:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:28:19 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:28:20 - job_xml_thread(): Done retrieving: data size 43583639
Sun 19 Jan 2014 15:28:20 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:28:20 - XML: Start document: iteration 11
Sun 19 Jan 2014 15:28:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:28:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:28:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:28:25 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:28:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:28:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:28:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:28:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:28:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:28:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:28:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:28:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:28:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:28:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:28:28 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:28:28 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 15:28:28 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:28:28 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:28:28 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:28:28 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:28:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:28:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 15:28:29 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:28:29 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:28:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 15:28:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5979 values 94299 bits 11787 bytes 
Sun 19 Jan 2014 15:28:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:28:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:28:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:28:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:28:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:28:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:28:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:28:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:28:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:28:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554713
Sun 19 Jan 2014 15:28:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:28:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554713
Sun 19 Jan 2014 15:28:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:28:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:28:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:28:43 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:28:43 - job_xml_thread(): Done retrieving: data size 43554713
Sun 19 Jan 2014 15:28:43 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:28:43 - XML: Start document: iteration 12
Sun 19 Jan 2014 15:28:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:28:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:28:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:28:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:28:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:28:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:28:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:28:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:28:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:28:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:28:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:28:58 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 15:28:58 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:28:58 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:28:58 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:28:58 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:28:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:28:58 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:28:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:28:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:28:58 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:28:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 15:28:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:28:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:28:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:28:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:28:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:29:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:29:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576164
Sun 19 Jan 2014 15:29:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:29:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576164
Sun 19 Jan 2014 15:29:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:29:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:29:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:29:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:29:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:29:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:29:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:29:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:29:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:29:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576164
Sun 19 Jan 2014 15:29:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:29:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:29:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:29:13 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:29:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:29:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:29:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:29:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:29:19 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:29:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:29:20 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:29:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:29:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:29:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:29:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:29:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:29:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:29:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:29:22 - job_xml_thread(): Done retrieving: data size 43490463
Sun 19 Jan 2014 15:29:22 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:29:22 - XML: Start document: iteration 13
Sun 19 Jan 2014 15:29:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43490463
Sun 19 Jan 2014 15:29:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:29:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:29:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:29:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:29:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:29:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:29:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:29:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43490463
Sun 19 Jan 2014 15:29:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:29:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:29:29 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:29:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:29:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 15:29:30 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:29:30 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:29:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 15:29:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8792 values 138628 bits 17328 bytes 
Sun 19 Jan 2014 15:29:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:29:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:29:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:29:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:29:40 - XML: Processed 652600 elements - found 0 jobs
Sun 19 Jan 2014 15:29:40 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:29:40 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:29:40 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:29:40 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:29:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:29:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:29:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:29:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:29:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:29:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:29:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:29:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:29:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:29:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:29:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:29:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:29:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:29:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:29:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:29:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:29:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42969065
Sun 19 Jan 2014 15:29:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:29:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42969065
Sun 19 Jan 2014 15:29:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:29:55 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:29:55 - job_xml_thread(): Done retrieving: data size 42969065
Sun 19 Jan 2014 15:29:55 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:29:55 - XML: Start document: iteration 14
Sun 19 Jan 2014 15:29:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:29:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:29:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:29:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:30:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:30:00 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:30:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:30:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:30:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:30:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:30:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:30:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:30:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:30:07 - XML: Processed 645816 elements - found 0 jobs
Sun 19 Jan 2014 15:30:07 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:30:07 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:30:07 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:30:07 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:30:08 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:30:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 15:30:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:30:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:30:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:30:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:30:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:30:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:30:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:30:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:30:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:30:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:30:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42905248
Sun 19 Jan 2014 15:30:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:30:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42905248
Sun 19 Jan 2014 15:30:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:30:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:30:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:30:22 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:30:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:30:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:30:22 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:30:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:30:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:30:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:30:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:30:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:30:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:30:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:30:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:30:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:30:25 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:30:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:30:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:30:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:30:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:30:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:30:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:30:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:30:27 - job_xml_thread(): Done retrieving: data size 42994038
Sun 19 Jan 2014 15:30:27 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:30:27 - XML: Start document: iteration 15
Sun 19 Jan 2014 15:30:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42994038
Sun 19 Jan 2014 15:30:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42994038
Sun 19 Jan 2014 15:30:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:30:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:30:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:30:31 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:30:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:30:32 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:30:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 15:30:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 15:30:32 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:30:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9248 values 145843 bits 18230 bytes 
Sun 19 Jan 2014 15:30:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:30:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:30:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:30:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:30:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:30:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:30:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:30:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:30:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:30:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:30:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:30:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:30:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:30:46 - XML: Processed 645900 elements - found 0 jobs
Sun 19 Jan 2014 15:30:46 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:30:46 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:30:46 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:30:46 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:30:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:30:49 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:30:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:30:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:30:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:30:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:30:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:30:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:30:52 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:30:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 15:30:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:30:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:30:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43530683
Sun 19 Jan 2014 15:30:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:30:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43530683
Sun 19 Jan 2014 15:30:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:30:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:30:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:31:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:31:01 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:31:01 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:31:01 - job_xml_thread(): Done retrieving: data size 43530683
Sun 19 Jan 2014 15:31:01 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:31:01 - XML: Start document: iteration 16
Sun 19 Jan 2014 15:31:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:31:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:31:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:31:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:31:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:31:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:31:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:31:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:31:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:31:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:31:11 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:31:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:31:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:31:11 - XML: Processed 653132 elements - found 0 jobs
Sun 19 Jan 2014 15:31:11 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:31:11 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:31:11 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:31:11 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:31:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:31:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:31:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:31:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:31:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:31:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576377
Sun 19 Jan 2014 15:31:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:31:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576377
Sun 19 Jan 2014 15:31:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:31:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:31:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:31:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:31:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:31:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:31:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:31:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:31:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:31:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:31:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:31:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:31:26 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:31:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:31:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:31:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:31:28 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:31:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:31:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:31:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:31:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:31:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:31:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:31:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:31:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43588913
Sun 19 Jan 2014 15:31:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:31:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43588913
Sun 19 Jan 2014 15:31:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:31:30 - job_xml_thread(): Done retrieving: data size 43588913
Sun 19 Jan 2014 15:31:30 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:31:30 - XML: Start document: iteration 17
Sun 19 Jan 2014 15:31:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:31:32 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:31:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:31:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 15:31:33 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:31:33 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:31:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 15:31:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8570 values 135415 bits 16926 bytes 
Sun 19 Jan 2014 15:31:38 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 15:31:38 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:31:39 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:31:39 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 15:31:39 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 15:31:39 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:31:39 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 15:31:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:31:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:31:43 - size of cluster 'LISA Cluster': 624 hosts 79477 metrics 831398 values 13106896 bits 1638362 bytes 
Sun 19 Jan 2014 15:31:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:31:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:31:51 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 15:31:51 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:31:51 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:31:51 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:31:51 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:31:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:31:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:31:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:31:53 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:31:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:31:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:31:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:31:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:31:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:31:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:31:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:31:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:31:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:31:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:31:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:31:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:31:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:31:56 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:31:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 15:31:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:31:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:31:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43597994
Sun 19 Jan 2014 15:31:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:31:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43597994
Sun 19 Jan 2014 15:31:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:32:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:32:06 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:32:07 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:32:07 - job_xml_thread(): Done retrieving: data size 43597994
Sun 19 Jan 2014 15:32:07 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:32:07 - XML: Start document: iteration 18
Sun 19 Jan 2014 15:32:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:32:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:32:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:32:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:32:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:32:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:32:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:32:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:32:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:32:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:32:16 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:32:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:32:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:32:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:32:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:32:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:32:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:32:17 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 15:32:17 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:32:17 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:32:17 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:32:17 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:32:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:32:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555504
Sun 19 Jan 2014 15:32:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:32:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555504
Sun 19 Jan 2014 15:32:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:32:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:32:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:32:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:32:31 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:32:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:32:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:32:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:32:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:32:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:32:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:32:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:32:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:32:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:32:32 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:32:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:32:34 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:32:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:32:34 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:32:34 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:32:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 15:32:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:32:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 15:32:34 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:32:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6128 values 96915 bits 12114 bytes 
Sun 19 Jan 2014 15:32:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:32:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:32:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:32:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:32:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:32:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:32:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:32:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583115
Sun 19 Jan 2014 15:32:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:32:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583115
Sun 19 Jan 2014 15:32:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:32:39 - job_xml_thread(): Done retrieving: data size 43583115
Sun 19 Jan 2014 15:32:39 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:32:39 - XML: Start document: iteration 19
Sun 19 Jan 2014 15:32:39 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:32:39 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 15:32:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:32:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:32:49 - XML: Processed 653346 elements - found 0 jobs
Sun 19 Jan 2014 15:32:49 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:32:49 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:32:49 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:32:49 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:32:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:32:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:32:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:32:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:32:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:32:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:32:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:32:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:32:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:32:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:32:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:33:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:33:01 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:33:01 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:33:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 15:33:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:33:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:33:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:33:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:33:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:33:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:33:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:33:04 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:33:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:33:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566616
Sun 19 Jan 2014 15:33:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:33:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566616
Sun 19 Jan 2014 15:33:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:33:05 - job_xml_thread(): Done retrieving: data size 43566616
Sun 19 Jan 2014 15:33:05 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:33:05 - XML: Start document: iteration 20
Sun 19 Jan 2014 15:33:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:33:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:33:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:33:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:33:21 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 15:33:21 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:33:21 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:33:21 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:33:21 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:33:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:33:22 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:33:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:33:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:33:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:33:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:33:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:33:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:33:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:33:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:33:26 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:33:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:33:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:33:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:33:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:33:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:33:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:33:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:33:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43597963
Sun 19 Jan 2014 15:33:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:33:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43597963
Sun 19 Jan 2014 15:33:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:33:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:33:35 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:33:36 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:33:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 15:33:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:33:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 15:33:36 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:33:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9156 values 144799 bits 18099 bytes 
Sun 19 Jan 2014 15:33:36 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:33:36 - job_xml_thread(): Done retrieving: data size 43597963
Sun 19 Jan 2014 15:33:36 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:33:36 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 15:33:36 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 15:33:36 - Housekeeping: done.
Sun 19 Jan 2014 15:33:36 - XML: Start document: iteration 0
Sun 19 Jan 2014 15:33:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:33:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:33:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:33:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:33:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:33:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:33:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:33:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:33:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:33:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:33:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:33:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:33:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:33:47 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 15:33:47 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:33:47 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:33:47 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:33:47 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:33:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:33:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:33:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:33:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:33:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:33:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:33:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:33:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:33:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:33:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556875
Sun 19 Jan 2014 15:33:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:33:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556875
Sun 19 Jan 2014 15:33:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:33:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:33:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:34:02 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:34:02 - job_xml_thread(): Done retrieving: data size 43556875
Sun 19 Jan 2014 15:34:02 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:34:02 - XML: Start document: iteration 1
Sun 19 Jan 2014 15:34:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:34:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:34:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:34:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:34:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:34:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:34:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:34:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:34:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:34:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:34:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:34:10 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:34:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 15:34:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:34:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:34:16 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:34:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:34:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:34:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:34:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:34:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:34:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:34:18 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 15:34:18 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:34:18 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:34:18 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:34:18 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:34:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:34:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43550935
Sun 19 Jan 2014 15:34:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:34:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43550935
Sun 19 Jan 2014 15:34:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:34:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:34:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:34:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:34:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:34:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:34:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:34:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:34:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:34:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:34:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:34:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:34:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:34:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:34:33 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:34:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:34:36 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:34:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:34:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 15:34:36 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:34:36 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:34:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 15:34:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5916 values 93286 bits 11660 bytes 
Sun 19 Jan 2014 15:34:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:34:37 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:34:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:34:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:34:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:34:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:34:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:34:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:34:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:34:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584740
Sun 19 Jan 2014 15:34:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:34:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584740
Sun 19 Jan 2014 15:34:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:34:41 - job_xml_thread(): Done retrieving: data size 43584740
Sun 19 Jan 2014 15:34:41 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:34:41 - XML: Start document: iteration 2
Sun 19 Jan 2014 15:34:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:34:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:34:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:34:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:34:53 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 15:34:53 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:34:53 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:34:53 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:34:53 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:35:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:35:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:35:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:35:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:35:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:35:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:35:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:35:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:35:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:35:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:35:04 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:35:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:35:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:35:05 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:35:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 15:35:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:35:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:35:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:35:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:35:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:35:07 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 15:35:07 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 15:35:07 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:35:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:35:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581969
Sun 19 Jan 2014 15:35:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:35:08 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:35:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581969
Sun 19 Jan 2014 15:35:08 - job_xml_thread(): Done retrieving: data size 43581969
Sun 19 Jan 2014 15:35:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:35:08 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:35:08 - XML: Start document: iteration 3
Sun 19 Jan 2014 15:35:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:35:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:35:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:35:18 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:35:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:35:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:35:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:35:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:35:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:35:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:35:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:35:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:35:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:35:21 - XML: Processed 653312 elements - found 0 jobs
Sun 19 Jan 2014 15:35:21 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:35:21 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:35:21 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:35:21 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:35:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:35:25 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:35:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:35:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:35:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:35:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:35:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:35:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:35:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:35:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43524138
Sun 19 Jan 2014 15:35:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:35:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43524138
Sun 19 Jan 2014 15:35:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:35:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:35:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:35:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:35:36 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:35:36 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:35:36 - job_xml_thread(): Done retrieving: data size 43524138
Sun 19 Jan 2014 15:35:36 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:35:36 - XML: Start document: iteration 4
Sun 19 Jan 2014 15:35:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:35:37 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:35:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 15:35:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 15:35:37 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:35:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8454 values 133310 bits 16663 bytes 
Sun 19 Jan 2014 15:35:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:35:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:35:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:35:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:35:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:35:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:35:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:35:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:35:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:35:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:35:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:35:49 - XML: Processed 652588 elements - found 0 jobs
Sun 19 Jan 2014 15:35:49 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:35:49 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:35:49 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:35:49 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:35:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:35:51 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:35:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:35:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:35:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:35:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:35:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:35:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:35:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:35:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42940593
Sun 19 Jan 2014 15:35:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:35:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42940593
Sun 19 Jan 2014 15:35:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:35:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:35:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:36:04 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:36:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:36:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:36:05 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:36:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:36:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:36:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:36:07 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:36:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:36:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:36:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:36:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:36:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:36:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:36:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:36:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:36:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:36:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:36:07 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:36:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 15:36:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:36:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:36:09 - job_xml_thread(): Done retrieving: data size 42928897
Sun 19 Jan 2014 15:36:09 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:36:09 - XML: Start document: iteration 5
Sun 19 Jan 2014 15:36:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42928897
Sun 19 Jan 2014 15:36:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:36:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42928897
Sun 19 Jan 2014 15:36:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:36:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:36:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:36:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:36:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:36:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:36:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:36:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:36:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:36:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:36:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:36:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:36:30 - XML: Processed 645150 elements - found 0 jobs
Sun 19 Jan 2014 15:36:30 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:36:30 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:36:30 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:36:31 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:36:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:36:32 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:36:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:36:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:36:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:36:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:36:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:36:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:36:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:36:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43357739
Sun 19 Jan 2014 15:36:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:36:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43357739
Sun 19 Jan 2014 15:36:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:36:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:36:38 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:36:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:36:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:36:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:36:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 15:36:41 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:36:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 15:36:41 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:36:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8876 values 139989 bits 17498 bytes 
Sun 19 Jan 2014 15:36:46 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:36:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:36:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:36:46 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:36:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:36:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:36:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:36:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:36:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:36:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:36:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:36:48 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:36:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:36:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:36:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:36:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:36:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:36:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:36:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:36:50 - job_xml_thread(): Done retrieving: data size 43544655
Sun 19 Jan 2014 15:36:50 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:36:50 - XML: Start document: iteration 6
Sun 19 Jan 2014 15:36:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43544655
Sun 19 Jan 2014 15:36:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:36:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43544655
Sun 19 Jan 2014 15:36:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:37:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:37:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:37:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:37:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:37:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:37:04 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:37:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:37:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:37:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:37:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:37:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:37:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:37:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:37:10 - XML: Processed 652942 elements - found 0 jobs
Sun 19 Jan 2014 15:37:10 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:37:10 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:37:10 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:37:10 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:37:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:37:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:37:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:37:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:37:13 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:37:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 15:37:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:37:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:37:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:37:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:37:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:37:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:37:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561745
Sun 19 Jan 2014 15:37:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:37:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561745
Sun 19 Jan 2014 15:37:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:37:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:37:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:37:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:37:25 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:37:25 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:37:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:37:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:37:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:37:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:37:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:37:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:37:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:37:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:37:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:37:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:37:29 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:37:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:37:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:37:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:37:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:37:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:37:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:37:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:37:31 - job_xml_thread(): Done retrieving: data size 43573413
Sun 19 Jan 2014 15:37:31 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:37:31 - XML: Start document: iteration 7
Sun 19 Jan 2014 15:37:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573413
Sun 19 Jan 2014 15:37:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:37:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573413
Sun 19 Jan 2014 15:37:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:37:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:37:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:37:41 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:37:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:37:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 15:37:41 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:37:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:37:41 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:37:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 15:37:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9017 values 142206 bits 17775 bytes 
Sun 19 Jan 2014 15:37:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:37:43 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:37:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:37:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:37:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:37:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:37:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:37:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:37:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:37:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:37:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:37:48 - XML: Processed 653348 elements - found 0 jobs
Sun 19 Jan 2014 15:37:48 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:37:48 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:37:48 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:37:48 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:37:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:37:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:37:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:37:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:37:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:37:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:37:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:37:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:37:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:37:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564467
Sun 19 Jan 2014 15:37:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:37:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564467
Sun 19 Jan 2014 15:37:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:37:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:37:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:38:03 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:38:03 - job_xml_thread(): Done retrieving: data size 43564467
Sun 19 Jan 2014 15:38:03 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:38:03 - XML: Start document: iteration 8
Sun 19 Jan 2014 15:38:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:38:04 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:38:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:38:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:38:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:38:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:38:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:38:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:38:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564467
Sun 19 Jan 2014 15:38:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:38:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:38:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:38:18 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 15:38:18 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:38:18 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:38:18 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:38:18 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:38:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:38:20 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:38:20 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:38:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 15:38:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:38:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:38:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:38:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:38:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:38:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:38:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:38:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:38:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:38:25 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:38:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:38:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:38:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:38:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:38:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:38:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:38:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:38:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43595241
Sun 19 Jan 2014 15:38:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:38:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43595241
Sun 19 Jan 2014 15:38:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:38:33 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:38:33 - job_xml_thread(): Done retrieving: data size 43595241
Sun 19 Jan 2014 15:38:33 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:38:33 - XML: Start document: iteration 9
Sun 19 Jan 2014 15:38:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:38:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:38:39 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 15:38:39 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:38:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:38:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:38:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:38:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:38:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:38:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:38:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:38:42 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:38:42 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:38:42 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:38:42 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 15:38:42 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 15:38:42 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 15:38:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:38:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:38:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:38:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:38:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:38:43 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 15:38:43 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:38:43 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:38:43 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:38:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:38:43 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:38:43 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:38:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 15:38:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 15:38:43 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:38:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5993 values 94544 bits 11818 bytes 
Sun 19 Jan 2014 15:38:48 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 889611 values 14032111 bits 1754013 bytes 
Sun 19 Jan 2014 15:38:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:38:48 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:38:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:38:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:38:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:38:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:38:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:38:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:38:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:38:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569047
Sun 19 Jan 2014 15:38:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:38:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569047
Sun 19 Jan 2014 15:38:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:38:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:38:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:38:58 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:38:58 - job_xml_thread(): Done retrieving: data size 43569047
Sun 19 Jan 2014 15:38:58 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:38:58 - XML: Start document: iteration 10
Sun 19 Jan 2014 15:39:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:39:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:39:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:39:10 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:39:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:39:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:39:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:39:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:39:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:39:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:39:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:39:13 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 15:39:13 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:39:13 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:39:13 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:39:13 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:39:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:39:16 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:39:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:39:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:39:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:39:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:39:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:39:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:39:17 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:39:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 15:39:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:39:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:39:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560017
Sun 19 Jan 2014 15:39:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:39:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560017
Sun 19 Jan 2014 15:39:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:39:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:39:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:39:28 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:39:28 - job_xml_thread(): Done retrieving: data size 43560017
Sun 19 Jan 2014 15:39:28 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:39:28 - XML: Start document: iteration 11
Sun 19 Jan 2014 15:39:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:39:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:39:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:39:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:39:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:39:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:39:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:39:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:39:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:39:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:39:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:39:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:39:40 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:39:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:39:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:39:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:39:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:39:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:39:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:39:42 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:39:42 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 15:39:42 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 15:39:42 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:39:42 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:39:42 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:39:42 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:39:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:39:43 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:39:43 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:39:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 15:39:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:39:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 15:39:43 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:39:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5639 values 88864 bits 11108 bytes 
Sun 19 Jan 2014 15:39:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:39:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572267
Sun 19 Jan 2014 15:39:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:39:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572267
Sun 19 Jan 2014 15:39:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:39:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:39:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:39:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:39:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:39:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:39:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:39:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:39:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:39:57 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:39:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:39:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:39:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:39:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:39:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:40:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:40:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:40:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:40:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:40:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:40:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:40:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:40:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:40:04 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:40:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 15:40:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:40:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:40:06 - job_xml_thread(): Done retrieving: data size 43555907
Sun 19 Jan 2014 15:40:06 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:40:06 - XML: Start document: iteration 12
Sun 19 Jan 2014 15:40:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555907
Sun 19 Jan 2014 15:40:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555907
Sun 19 Jan 2014 15:40:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:40:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:40:11 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 15:40:11 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:40:11 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:40:11 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:40:11 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:40:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:40:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:40:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:40:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:40:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:40:25 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:40:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:40:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:40:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:40:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:40:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:40:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:40:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:40:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:40:26 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:40:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:40:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:40:26 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:40:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:40:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:40:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:40:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:40:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:40:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43599091
Sun 19 Jan 2014 15:40:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:40:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43599091
Sun 19 Jan 2014 15:40:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:40:30 - job_xml_thread(): Done retrieving: data size 43599091
Sun 19 Jan 2014 15:40:31 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:40:31 - XML: Start document: iteration 13
Sun 19 Jan 2014 15:40:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:40:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:40:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:40:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:40:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:40:43 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:40:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:40:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 15:40:44 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:40:44 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:40:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 15:40:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8060 values 127082 bits 15885 bytes 
Sun 19 Jan 2014 15:40:50 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 15:40:50 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:40:50 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:40:50 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:40:50 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:40:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:40:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:40:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:40:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:40:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:40:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:40:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:40:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:40:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:40:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:40:53 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:40:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:40:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:40:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:40:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:40:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:40:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:40:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:40:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43592728
Sun 19 Jan 2014 15:40:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:40:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43592728
Sun 19 Jan 2014 15:40:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:41:05 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:41:06 - job_xml_thread(): Done retrieving: data size 43592728
Sun 19 Jan 2014 15:41:06 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:41:06 - XML: Start document: iteration 14
Sun 19 Jan 2014 15:41:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:41:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:41:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:41:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:41:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:41:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:41:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:41:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:41:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:41:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:41:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:41:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:41:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:41:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:41:19 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:41:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:41:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:41:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:41:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:41:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:41:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:41:22 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 15:41:22 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:41:22 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:41:22 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:41:22 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:41:22 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:41:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 15:41:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:41:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:41:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43493117
Sun 19 Jan 2014 15:41:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:41:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43493117
Sun 19 Jan 2014 15:41:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:41:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:41:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:41:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:41:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:41:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:41:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:41:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:41:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:41:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:41:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:41:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:41:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:41:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:41:37 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:41:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:41:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:41:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:41:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:41:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:41:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:41:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:41:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:41:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:41:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43002128
Sun 19 Jan 2014 15:41:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:41:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43002128
Sun 19 Jan 2014 15:41:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:41:42 - job_xml_thread(): Done retrieving: data size 43002128
Sun 19 Jan 2014 15:41:42 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:41:42 - XML: Start document: iteration 15
Sun 19 Jan 2014 15:41:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:41:44 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:41:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:41:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 15:41:46 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:41:46 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:41:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9024 values 142304 bits 17788 bytes 
Sun 19 Jan 2014 15:41:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 15:41:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:41:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:41:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:41:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:41:58 - XML: Processed 646144 elements - found 0 jobs
Sun 19 Jan 2014 15:41:58 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:41:58 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:41:58 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:41:58 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:42:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:42:00 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:42:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:42:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:42:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:42:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:42:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:42:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:42:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:42:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:42:03 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:42:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:42:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:42:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:42:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:42:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:42:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:42:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:42:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42913731
Sun 19 Jan 2014 15:42:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:42:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42913731
Sun 19 Jan 2014 15:42:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:42:13 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:42:13 - job_xml_thread(): Done retrieving: data size 42913731
Sun 19 Jan 2014 15:42:13 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:42:13 - XML: Start document: iteration 16
Sun 19 Jan 2014 15:42:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:42:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:42:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:42:18 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:42:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:42:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:42:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:42:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:42:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:42:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:42:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:42:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:42:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:42:21 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:42:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 15:42:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:42:28 - XML: Processed 645150 elements - found 0 jobs
Sun 19 Jan 2014 15:42:28 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:42:28 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:42:28 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:42:28 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:42:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:42:32 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:42:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:42:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:42:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:42:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:42:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:42:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:42:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:42:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:42:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:42:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43312762
Sun 19 Jan 2014 15:42:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:42:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43312762
Sun 19 Jan 2014 15:42:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:42:43 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:42:43 - job_xml_thread(): Done retrieving: data size 43312762
Sun 19 Jan 2014 15:42:43 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:42:43 - XML: Start document: iteration 17
Sun 19 Jan 2014 15:42:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:42:47 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:42:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:42:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:42:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:42:49 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:42:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 15:42:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 15:42:49 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:42:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6184 values 97529 bits 12191 bytes 
Sun 19 Jan 2014 15:42:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:42:57 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:42:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:42:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:42:58 - XML: Processed 650530 elements - found 0 jobs
Sun 19 Jan 2014 15:42:58 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:42:58 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:42:58 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:42:58 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:42:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:42:59 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:42:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:42:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:42:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:42:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:42:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:42:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:42:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:42:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:42:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:42:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:42:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:42:59 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 15:42:59 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 15:42:59 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:43:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:43:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571518
Sun 19 Jan 2014 15:43:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:43:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571518
Sun 19 Jan 2014 15:43:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:43:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:43:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:43:13 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:43:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:43:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:43:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:43:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:43:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:43:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:43:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:43:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:43:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:43:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:43:16 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:43:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:43:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:43:16 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:43:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 15:43:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:43:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:43:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:43:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:43:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:43:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:43:18 - job_xml_thread(): Done retrieving: data size 43564572
Sun 19 Jan 2014 15:43:18 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:43:18 - XML: Start document: iteration 18
Sun 19 Jan 2014 15:43:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564572
Sun 19 Jan 2014 15:43:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:43:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564572
Sun 19 Jan 2014 15:43:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:43:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:43:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:43:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:43:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:43:37 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 15:43:37 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:43:37 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:43:37 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:43:37 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:43:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:43:40 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:43:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:43:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:43:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:43:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:43:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:43:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:43:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:43:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:43:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:43:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:43:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:43:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:43:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:43:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:43:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:43:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:43:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43596593
Sun 19 Jan 2014 15:43:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:43:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43596593
Sun 19 Jan 2014 15:43:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:43:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:43:49 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:43:51 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:43:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:43:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 15:43:51 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:43:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 15:43:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9290 values 146569 bits 18321 bytes 
Sun 19 Jan 2014 15:43:52 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:43:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:43:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:43:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:43:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:43:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:43:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:43:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:43:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:43:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:43:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:43:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:43:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:43:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:43:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:43:57 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:43:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:43:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:43:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:43:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:43:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:43:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:44:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:44:00 - job_xml_thread(): Done retrieving: data size 43577815
Sun 19 Jan 2014 15:44:00 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:44:00 - XML: Start document: iteration 19
Sun 19 Jan 2014 15:44:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577815
Sun 19 Jan 2014 15:44:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:44:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577815
Sun 19 Jan 2014 15:44:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:44:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:44:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:44:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:44:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:44:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:44:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:44:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:44:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:44:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:44:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:44:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:44:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:44:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:44:20 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 15:44:20 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:44:20 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:44:20 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:44:20 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:44:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:44:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:44:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:44:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:44:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:44:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:44:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:44:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:44:23 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:44:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 15:44:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:44:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:44:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581176
Sun 19 Jan 2014 15:44:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:44:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581176
Sun 19 Jan 2014 15:44:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:44:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:44:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:44:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:44:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:44:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:44:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:44:35 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:44:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:44:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:44:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:44:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:44:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:44:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:44:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:44:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:44:39 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:44:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:44:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:44:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:44:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:44:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:44:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:44:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:44:41 - job_xml_thread(): Done retrieving: data size 43589460
Sun 19 Jan 2014 15:44:41 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:44:41 - XML: Start document: iteration 20
Sun 19 Jan 2014 15:44:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43589460
Sun 19 Jan 2014 15:44:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43589460
Sun 19 Jan 2014 15:44:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:44:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:44:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:44:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:44:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:44:52 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:44:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:44:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 15:44:53 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:44:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 15:44:53 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:44:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8958 values 141208 bits 17651 bytes 
Sun 19 Jan 2014 15:44:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:44:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:45:00 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 15:45:00 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:45:00 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:45:00 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:45:00 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:45:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:45:01 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:45:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:45:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:45:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:45:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:45:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:45:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:45:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:45:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:45:05 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:45:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:45:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:45:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:45:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:45:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:45:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:45:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:45:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580448
Sun 19 Jan 2014 15:45:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:45:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580448
Sun 19 Jan 2014 15:45:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:45:15 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:45:15 - job_xml_thread(): Done retrieving: data size 43580448
Sun 19 Jan 2014 15:45:15 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:45:15 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 15:45:15 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 15:45:15 - Housekeeping: done.
Sun 19 Jan 2014 15:45:16 - XML: Start document: iteration 0
Sun 19 Jan 2014 15:45:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:45:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:45:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:45:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:45:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:45:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:45:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:45:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:45:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:45:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:45:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:45:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:45:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:45:28 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 15:45:28 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:45:28 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:45:28 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:45:28 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:45:29 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:45:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 15:45:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:45:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:45:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:45:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:45:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:45:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:45:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:45:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:45:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:45:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:45:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43548085
Sun 19 Jan 2014 15:45:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:45:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43548085
Sun 19 Jan 2014 15:45:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:45:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:45:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:45:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:45:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:45:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:45:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:45:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:45:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:45:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:45:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:45:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:45:42 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 15:45:42 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:45:43 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:45:43 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 15:45:43 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:45:43 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 15:45:43 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 15:45:43 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:45:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:45:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:45:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:45:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:45:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:45:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:45:46 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 850064 values 13397862 bits 1674732 bytes 
Sun 19 Jan 2014 15:45:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:45:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:45:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:45:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:45:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:45:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571873
Sun 19 Jan 2014 15:45:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:45:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571873
Sun 19 Jan 2014 15:45:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:45:51 - job_xml_thread(): Done retrieving: data size 43571873
Sun 19 Jan 2014 15:45:51 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:45:51 - XML: Start document: iteration 1
Sun 19 Jan 2014 15:45:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:45:53 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:45:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:45:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 15:45:54 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:45:54 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:45:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9163 values 144534 bits 18066 bytes 
Sun 19 Jan 2014 15:45:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 15:45:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:45:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:46:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:46:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:46:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:46:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:46:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:46:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:46:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:46:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:46:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:46:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:46:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:46:11 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 15:46:11 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:46:11 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:46:11 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:46:11 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:46:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:46:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:46:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:46:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:46:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:46:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:46:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:46:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:46:15 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:46:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 15:46:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:46:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:46:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554933
Sun 19 Jan 2014 15:46:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:46:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554933
Sun 19 Jan 2014 15:46:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:46:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:46:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:46:26 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:46:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:46:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:46:26 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:46:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:46:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:46:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:46:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:46:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:46:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:46:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:46:29 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:46:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:46:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:46:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:46:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:46:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:46:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:46:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:46:32 - job_xml_thread(): Done retrieving: data size 43569172
Sun 19 Jan 2014 15:46:32 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:46:32 - XML: Start document: iteration 2
Sun 19 Jan 2014 15:46:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569172
Sun 19 Jan 2014 15:46:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:46:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569172
Sun 19 Jan 2014 15:46:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:46:44 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:46:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:46:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:46:44 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 15:46:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:46:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:46:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:46:47 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:46:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:46:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:46:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:46:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:46:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:46:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:46:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:46:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:46:54 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:46:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:46:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 15:46:54 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:46:54 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:46:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 15:46:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99211 bits 12401 bytes 
Sun 19 Jan 2014 15:46:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:46:55 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:46:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:46:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:46:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:46:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:46:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:46:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:46:55 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 15:46:55 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:46:55 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:46:55 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:46:55 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:46:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:46:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563710
Sun 19 Jan 2014 15:46:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:47:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563710
Sun 19 Jan 2014 15:47:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:47:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:47:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:47:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:47:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:47:10 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:47:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:47:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:47:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:47:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:47:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:47:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:47:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:47:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:47:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:47:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:47:16 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:47:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:47:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:47:17 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:47:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 15:47:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:47:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:47:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:47:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:47:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:47:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:47:20 - job_xml_thread(): Done retrieving: data size 43507077
Sun 19 Jan 2014 15:47:20 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:47:20 - XML: Start document: iteration 3
Sun 19 Jan 2014 15:47:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43507077
Sun 19 Jan 2014 15:47:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:47:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43507077
Sun 19 Jan 2014 15:47:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:47:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:47:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:47:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:47:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:47:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:47:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:47:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:47:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:47:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:47:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:47:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:47:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:47:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:47:38 - XML: Processed 652600 elements - found 0 jobs
Sun 19 Jan 2014 15:47:38 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:47:38 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:47:38 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:47:38 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:47:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:47:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:47:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:47:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:47:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:47:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:47:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:47:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:47:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:47:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42975175
Sun 19 Jan 2014 15:47:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:47:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42975175
Sun 19 Jan 2014 15:47:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:47:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:47:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:47:53 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:47:53 - job_xml_thread(): Done retrieving: data size 42975175
Sun 19 Jan 2014 15:47:53 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:47:53 - XML: Start document: iteration 4
Sun 19 Jan 2014 15:47:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:47:55 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:47:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:47:56 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:47:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 15:47:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 15:47:56 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:47:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8888 values 140550 bits 17568 bytes 
Sun 19 Jan 2014 15:47:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:47:58 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:47:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:47:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:47:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:47:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:47:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:47:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:47:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:48:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:48:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:48:07 - XML: Processed 646208 elements - found 0 jobs
Sun 19 Jan 2014 15:48:07 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:48:07 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:48:07 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:48:07 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:48:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:48:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:48:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:48:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:48:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:48:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:48:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:48:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:48:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:48:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42925653
Sun 19 Jan 2014 15:48:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:48:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:48:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42925653
Sun 19 Jan 2014 15:48:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:48:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:48:22 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:48:22 - job_xml_thread(): Done retrieving: data size 42925653
Sun 19 Jan 2014 15:48:22 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:48:22 - XML: Start document: iteration 5
Sun 19 Jan 2014 15:48:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:48:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:48:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:48:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:48:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:48:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:48:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:48:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:48:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:48:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:48:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:48:33 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:48:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 15:48:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:48:34 - XML: Processed 645552 elements - found 0 jobs
Sun 19 Jan 2014 15:48:34 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:48:34 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:48:34 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:48:34 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:48:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:48:37 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:48:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:48:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:48:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:48:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:48:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:48:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:48:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:48:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:48:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:48:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43082714
Sun 19 Jan 2014 15:48:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:48:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43082714
Sun 19 Jan 2014 15:48:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:48:49 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:48:50 - job_xml_thread(): Done retrieving: data size 43082714
Sun 19 Jan 2014 15:48:50 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:48:50 - XML: Start document: iteration 6
Sun 19 Jan 2014 15:48:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:48:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:48:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:48:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:48:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:48:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:48:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:48:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:48:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:48:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:48:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:48:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:48:56 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:48:57 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:48:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:48:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 15:48:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 15:48:57 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:48:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5813 values 91767 bits 11470 bytes 
Sun 19 Jan 2014 15:48:59 - XML: Processed 647386 elements - found 0 jobs
Sun 19 Jan 2014 15:48:59 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:48:59 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:48:59 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:48:59 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:49:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:49:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:49:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:49:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:49:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:49:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:49:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:49:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:49:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:49:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558630
Sun 19 Jan 2014 15:49:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:49:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558630
Sun 19 Jan 2014 15:49:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:49:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:49:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:49:14 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:49:14 - job_xml_thread(): Done retrieving: data size 43558630
Sun 19 Jan 2014 15:49:14 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:49:14 - XML: Start document: iteration 7
Sun 19 Jan 2014 15:49:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:49:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:49:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:49:19 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:49:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:49:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:49:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:49:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:49:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:49:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:49:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:49:27 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:49:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 15:49:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:49:28 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 15:49:28 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:49:28 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:49:28 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:49:28 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:49:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:49:31 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:49:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:49:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:49:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:49:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:49:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:49:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:49:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:49:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43551723
Sun 19 Jan 2014 15:49:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:49:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43551723
Sun 19 Jan 2014 15:49:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:49:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:49:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:49:43 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:49:43 - job_xml_thread(): Done retrieving: data size 43551723
Sun 19 Jan 2014 15:49:43 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:49:43 - XML: Start document: iteration 8
Sun 19 Jan 2014 15:49:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:49:43 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:49:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:49:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:49:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:49:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:49:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43551723
Sun 19 Jan 2014 15:49:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:49:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:49:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:49:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:49:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:49:53 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 15:49:53 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:49:53 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:49:53 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:49:53 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:49:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:49:58 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:49:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:49:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:50:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:50:01 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:50:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 15:50:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 15:50:01 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:50:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5782 values 91124 bits 11390 bytes 
Sun 19 Jan 2014 15:50:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:50:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:50:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:50:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:50:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:50:03 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:50:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:50:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:50:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:50:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:50:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:50:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:50:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:50:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:50:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:50:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:50:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:50:04 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 15:50:04 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 15:50:04 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:50:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:50:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43593494
Sun 19 Jan 2014 15:50:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:50:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43593494
Sun 19 Jan 2014 15:50:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:50:08 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:50:08 - job_xml_thread(): Done retrieving: data size 43593494
Sun 19 Jan 2014 15:50:08 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:50:08 - XML: Start document: iteration 9
Sun 19 Jan 2014 15:50:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:50:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:50:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:50:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:50:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:50:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:50:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:50:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:50:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:50:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:50:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:50:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:50:24 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:50:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:50:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:50:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:50:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:50:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:50:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:50:27 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 15:50:27 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:50:27 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:50:27 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:50:27 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:50:27 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:50:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 15:50:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:50:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:50:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560820
Sun 19 Jan 2014 15:50:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:50:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560820
Sun 19 Jan 2014 15:50:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:50:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:50:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:50:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:50:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:50:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:50:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:50:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:50:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:50:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:50:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:50:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:50:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:50:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:50:42 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:50:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:50:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:50:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:50:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:50:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:50:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:50:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:50:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:50:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:50:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43588000
Sun 19 Jan 2014 15:50:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:50:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43588000
Sun 19 Jan 2014 15:50:45 - job_xml_thread(): Done retrieving: data size 43588000
Sun 19 Jan 2014 15:50:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:50:46 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:50:46 - XML: Start document: iteration 10
Sun 19 Jan 2014 15:50:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:50:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:50:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:50:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:50:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:50:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:50:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:50:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:50:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:50:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:50:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:50:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:50:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:51:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:51:02 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:51:03 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:51:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 15:51:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:51:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 15:51:03 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:51:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9089 values 143356 bits 17919 bytes 
Sun 19 Jan 2014 15:51:05 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 15:51:05 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:51:05 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:51:05 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:51:05 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:51:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:51:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:51:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:51:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:51:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:51:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:51:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:51:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:51:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:51:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557443
Sun 19 Jan 2014 15:51:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:51:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557443
Sun 19 Jan 2014 15:51:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:51:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:51:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:51:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:51:19 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:51:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:51:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:51:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:51:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:51:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:51:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557443
Sun 19 Jan 2014 15:51:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:51:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:51:20 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:51:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:51:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:51:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:51:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:51:29 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:51:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:51:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:51:33 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:51:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 15:51:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:51:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:51:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:51:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:51:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:51:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:51:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:51:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:51:34 - job_xml_thread(): Done retrieving: data size 43554594
Sun 19 Jan 2014 15:51:34 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:51:34 - XML: Start document: iteration 11
Sun 19 Jan 2014 15:51:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554594
Sun 19 Jan 2014 15:51:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:51:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:51:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:51:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:51:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:51:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554594
Sun 19 Jan 2014 15:51:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:51:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:51:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:51:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:51:47 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:51:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:51:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:51:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:51:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:51:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:51:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:51:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:51:53 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 15:51:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:51:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:51:53 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:51:53 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:51:53 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:51:53 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:51:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:51:55 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:51:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:51:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:51:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:51:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:51:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:51:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:51:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:51:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574926
Sun 19 Jan 2014 15:51:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:51:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574926
Sun 19 Jan 2014 15:51:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:52:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:52:04 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:52:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:52:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 15:52:05 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:52:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8954 values 141168 bits 17646 bytes 
Sun 19 Jan 2014 15:52:05 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:52:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 15:52:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:52:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:52:08 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:52:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:52:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:52:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:52:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:52:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:52:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:52:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:52:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:52:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:52:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:52:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:52:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:52:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:52:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:52:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:52:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:52:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:52:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:52:15 - job_xml_thread(): Done retrieving: data size 43573779
Sun 19 Jan 2014 15:52:15 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:52:15 - XML: Start document: iteration 12
Sun 19 Jan 2014 15:52:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573779
Sun 19 Jan 2014 15:52:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:52:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573779
Sun 19 Jan 2014 15:52:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:52:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:52:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:52:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:52:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:52:32 - XML: Processed 653349 elements - found 0 jobs
Sun 19 Jan 2014 15:52:32 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:52:32 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:52:32 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:52:32 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:52:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:52:36 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:52:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:52:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:52:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:52:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:52:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:52:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:52:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:52:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:52:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:52:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:52:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:52:38 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:52:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 15:52:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:52:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:52:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:52:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:52:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:52:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:52:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584590
Sun 19 Jan 2014 15:52:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:52:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584590
Sun 19 Jan 2014 15:52:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:52:45 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 15:52:45 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:52:46 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:52:46 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:52:46 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 15:52:46 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 15:52:46 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 15:52:47 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:52:47 - job_xml_thread(): Done retrieving: data size 43584590
Sun 19 Jan 2014 15:52:47 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:52:47 - XML: Start document: iteration 13
Sun 19 Jan 2014 15:52:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:52:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:52:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:52:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:52:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:52:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:52:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:52:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:52:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:52:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:52:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:52:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:52:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:52:57 - size of cluster 'LISA Cluster': 624 hosts 79469 metrics 798828 values 12605443 bits 1575680 bytes 
Sun 19 Jan 2014 15:52:59 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 15:52:59 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:52:59 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:52:59 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:53:00 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:53:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:53:01 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:53:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:53:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:53:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:53:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:53:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:53:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:53:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:53:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571215
Sun 19 Jan 2014 15:53:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:53:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571215
Sun 19 Jan 2014 15:53:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:53:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:53:05 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:53:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:53:07 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:53:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 15:53:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 15:53:07 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:53:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8837 values 139393 bits 17424 bytes 
Sun 19 Jan 2014 15:53:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:53:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:53:15 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:53:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:53:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:53:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:53:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:53:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:53:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:53:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:53:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:53:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:53:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:53:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:53:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:53:21 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:53:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:53:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:53:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:53:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:53:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:53:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:53:24 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:53:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 15:53:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:53:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:53:24 - job_xml_thread(): Done retrieving: data size 43510372
Sun 19 Jan 2014 15:53:24 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:53:24 - XML: Start document: iteration 14
Sun 19 Jan 2014 15:53:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43510372
Sun 19 Jan 2014 15:53:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:53:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43510372
Sun 19 Jan 2014 15:53:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:53:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:53:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:53:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:53:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:53:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:53:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:53:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:53:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:53:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:53:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:53:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:53:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:53:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:53:46 - XML: Processed 652600 elements - found 0 jobs
Sun 19 Jan 2014 15:53:46 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:53:46 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:53:46 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:53:46 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:53:46 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:53:46 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 15:53:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:53:48 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:53:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:53:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:53:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:53:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:53:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:53:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:53:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:53:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42957286
Sun 19 Jan 2014 15:53:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:53:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42957286
Sun 19 Jan 2014 15:53:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:53:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:53:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:53:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:53:59 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:53:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:53:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:54:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:54:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:54:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42957286
Sun 19 Jan 2014 15:54:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:54:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:54:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:54:01 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:54:01 - job_xml_thread(): Done retrieving: data size 42957286
Sun 19 Jan 2014 15:54:01 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:54:01 - XML: Start document: iteration 15
Sun 19 Jan 2014 15:54:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:54:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:54:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:54:07 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:54:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:54:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 15:54:09 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:54:09 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:54:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 15:54:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99076 bits 12384 bytes 
Sun 19 Jan 2014 15:54:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:54:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:54:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:54:18 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:54:18 - XML: Processed 645674 elements - found 0 jobs
Sun 19 Jan 2014 15:54:18 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:54:18 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:54:18 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:54:18 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:54:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:54:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:54:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:54:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:54:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:54:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:54:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:54:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:54:20 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:54:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:54:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:54:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:54:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:54:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:54:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:54:24 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:54:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 15:54:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:54:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:54:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42991039
Sun 19 Jan 2014 15:54:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:54:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42991039
Sun 19 Jan 2014 15:54:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:54:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:54:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:54:33 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:54:33 - job_xml_thread(): Done retrieving: data size 42991039
Sun 19 Jan 2014 15:54:33 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:54:33 - XML: Start document: iteration 16
Sun 19 Jan 2014 15:54:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:54:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:54:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:54:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:54:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42991039
Sun 19 Jan 2014 15:54:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:54:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:54:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:54:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:54:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:54:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:54:43 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:54:49 - XML: Processed 645897 elements - found 0 jobs
Sun 19 Jan 2014 15:54:49 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:54:49 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:54:49 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:54:49 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:54:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:54:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:54:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:54:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:54:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:54:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:54:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:54:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:54:51 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:54:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:54:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:54:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:54:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:54:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:54:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:54:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:54:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43532524
Sun 19 Jan 2014 15:54:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:54:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43532524
Sun 19 Jan 2014 15:54:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:55:04 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:55:04 - job_xml_thread(): Done retrieving: data size 43532524
Sun 19 Jan 2014 15:55:04 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:55:04 - XML: Start document: iteration 17
Sun 19 Jan 2014 15:55:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:55:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:55:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:55:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:55:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:55:09 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:55:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:55:10 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:55:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 15:55:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 15:55:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:55:10 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:55:10 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:55:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:55:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:55:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99078 bits 12384 bytes 
Sun 19 Jan 2014 15:55:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:55:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:55:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:55:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:55:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:55:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:55:15 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:55:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:55:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:55:16 - XML: Processed 652678 elements - found 0 jobs
Sun 19 Jan 2014 15:55:16 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:55:16 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:55:16 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:55:16 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:55:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:55:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:55:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:55:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:55:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:55:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568242
Sun 19 Jan 2014 15:55:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:55:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568242
Sun 19 Jan 2014 15:55:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:55:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:55:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:55:31 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:55:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:55:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:55:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:55:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:55:31 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:55:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:55:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:55:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:55:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:55:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:55:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:55:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:55:37 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:55:37 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:55:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 15:55:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:55:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:55:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:55:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:55:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:55:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:55:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:55:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:55:39 - job_xml_thread(): Done retrieving: data size 43567176
Sun 19 Jan 2014 15:55:39 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:55:39 - XML: Start document: iteration 18
Sun 19 Jan 2014 15:55:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567176
Sun 19 Jan 2014 15:55:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:55:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567176
Sun 19 Jan 2014 15:55:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:55:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:55:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:55:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:55:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:55:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:55:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:55:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:55:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:55:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:55:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:55:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:55:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:55:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:55:55 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 15:55:55 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:55:55 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:55:55 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:55:55 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:56:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:56:01 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:56:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:56:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:56:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:56:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:56:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:56:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:56:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:56:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561901
Sun 19 Jan 2014 15:56:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:56:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561901
Sun 19 Jan 2014 15:56:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:56:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:56:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:56:10 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:56:10 - job_xml_thread(): Done retrieving: data size 43561901
Sun 19 Jan 2014 15:56:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:56:11 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:56:11 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:56:11 - XML: Start document: iteration 19
Sun 19 Jan 2014 15:56:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:56:11 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:56:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 15:56:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 15:56:11 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:56:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8781 values 138463 bits 17307 bytes 
Sun 19 Jan 2014 15:56:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:56:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:56:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:56:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:56:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:56:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:56:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:56:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:56:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:56:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:56:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:56:27 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 15:56:27 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:56:27 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:56:27 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:56:27 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:56:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:56:29 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:56:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:56:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:56:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:56:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:56:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:56:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:56:32 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:56:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 15:56:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:56:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:56:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555406
Sun 19 Jan 2014 15:56:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:56:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555406
Sun 19 Jan 2014 15:56:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:56:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:56:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:56:42 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:56:42 - job_xml_thread(): Done retrieving: data size 43555406
Sun 19 Jan 2014 15:56:42 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:56:42 - XML: Start document: iteration 20
Sun 19 Jan 2014 15:56:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:56:44 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:56:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:56:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:56:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:56:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:56:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:56:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:56:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:56:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:56:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:56:54 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 15:56:54 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:56:54 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:56:54 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:56:54 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:56:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:56:55 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:56:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:56:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:56:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:56:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:56:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:56:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:56:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:56:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43552352
Sun 19 Jan 2014 15:56:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:56:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43552352
Sun 19 Jan 2014 15:56:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:57:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:57:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:57:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:57:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:57:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:57:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:57:09 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:57:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:57:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:57:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:57:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:57:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:57:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:57:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:57:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:57:12 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:57:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:57:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 15:57:12 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:57:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99057 bits 12382 bytes 
Sun 19 Jan 2014 15:57:12 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:57:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 15:57:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:57:14 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:57:14 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 15:57:14 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 15:57:14 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:57:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:57:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:57:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:57:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:57:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:57:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:57:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:57:16 - job_xml_thread(): Done retrieving: data size 43573234
Sun 19 Jan 2014 15:57:16 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:57:16 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 15:57:16 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 15:57:16 - Housekeeping: done.
Sun 19 Jan 2014 15:57:16 - XML: Start document: iteration 0
Sun 19 Jan 2014 15:57:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573234
Sun 19 Jan 2014 15:57:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:57:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573234
Sun 19 Jan 2014 15:57:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:57:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:57:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:57:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:57:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:57:35 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 15:57:36 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:57:36 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:57:36 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:57:36 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:57:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:57:39 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:57:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:57:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:57:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:57:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:57:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:57:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:57:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:57:40 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:57:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:57:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:57:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:57:40 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:57:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 15:57:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:57:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:57:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:57:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:57:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:57:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:57:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43586931
Sun 19 Jan 2014 15:57:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:57:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43586931
Sun 19 Jan 2014 15:57:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:57:51 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:57:51 - job_xml_thread(): Done retrieving: data size 43586931
Sun 19 Jan 2014 15:57:52 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:57:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:57:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:57:52 - XML: Start document: iteration 1
Sun 19 Jan 2014 15:57:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:57:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:57:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:57:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:57:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:57:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:57:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:57:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:57:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:58:02 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 15:58:02 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:58:02 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:58:02 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:58:02 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:58:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:58:03 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:58:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:58:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:58:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:58:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:58:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:58:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:58:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:58:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577714
Sun 19 Jan 2014 15:58:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:58:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577714
Sun 19 Jan 2014 15:58:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:58:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:58:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:58:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:58:13 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:58:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:58:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 15:58:14 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:58:14 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:58:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8691 values 137045 bits 17130 bytes 
Sun 19 Jan 2014 15:58:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 15:58:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:58:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:58:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:58:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:58:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:58:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:58:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:58:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:58:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:58:17 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:58:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:58:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:58:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:58:20 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:58:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:58:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:58:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:58:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:58:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:58:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:58:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:58:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43592402
Sun 19 Jan 2014 15:58:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:58:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43592402
Sun 19 Jan 2014 15:58:23 - job_xml_thread(): Done retrieving: data size 43592402
Sun 19 Jan 2014 15:58:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:58:23 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:58:23 - XML: Start document: iteration 2
Sun 19 Jan 2014 15:58:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:58:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:58:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:58:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:58:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:58:37 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:58:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:58:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:58:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:58:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:58:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:58:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:58:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:58:40 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 15:58:40 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:58:40 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:58:40 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:58:41 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:58:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:58:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:58:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:58:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:58:43 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:58:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 15:58:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:58:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:58:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:58:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:58:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:58:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:58:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569836
Sun 19 Jan 2014 15:58:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:58:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569836
Sun 19 Jan 2014 15:58:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:58:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:58:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:58:56 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:58:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:58:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:58:57 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:58:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:58:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:58:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:58:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:58:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:58:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:58:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:58:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:59:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:59:00 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:59:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:59:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:59:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:59:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:59:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:59:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:59:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:59:02 - job_xml_thread(): Done retrieving: data size 43574701
Sun 19 Jan 2014 15:59:02 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:59:02 - XML: Start document: iteration 3
Sun 19 Jan 2014 15:59:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574701
Sun 19 Jan 2014 15:59:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:59:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574701
Sun 19 Jan 2014 15:59:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:59:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:59:13 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:59:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:59:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:59:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:59:15 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:59:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:59:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:59:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:59:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:59:16 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:59:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:59:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:59:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:59:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:59:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 15:59:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 15:59:16 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:59:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9093 values 143449 bits 17931 bytes 
Sun 19 Jan 2014 15:59:21 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 15:59:21 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:59:21 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:59:21 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:59:22 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:59:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:59:24 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:59:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:59:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:59:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:59:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:59:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:59:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:59:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:59:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43486805
Sun 19 Jan 2014 15:59:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:59:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43486805
Sun 19 Jan 2014 15:59:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 15:59:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:59:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:59:37 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 15:59:37 - job_xml_thread(): Done retrieving: data size 43486805
Sun 19 Jan 2014 15:59:37 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 15:59:37 - XML: Start document: iteration 4
Sun 19 Jan 2014 15:59:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 15:59:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 15:59:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 15:59:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:59:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:59:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 15:59:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 15:59:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 15:59:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 15:59:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 15:59:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:59:46 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 15:59:46 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:59:47 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:59:47 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:59:47 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 15:59:47 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 15:59:47 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 15:59:50 - XML: Processed 652600 elements - found 0 jobs
Sun 19 Jan 2014 15:59:50 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 15:59:50 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 15:59:50 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 15:59:50 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 15:59:52 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 882101 values 13903392 bits 1737924 bytes 
Sun 19 Jan 2014 15:59:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 15:59:53 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 15:59:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 15:59:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 15:59:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:59:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 15:59:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 15:59:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 15:59:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 15:59:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 15:59:55 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 15:59:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 15:59:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 15:59:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 15:59:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42928296
Sun 19 Jan 2014 15:59:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 15:59:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42928296
Sun 19 Jan 2014 15:59:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:00:06 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:00:06 - job_xml_thread(): Done retrieving: data size 42928296
Sun 19 Jan 2014 16:00:06 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:00:06 - XML: Start document: iteration 5
Sun 19 Jan 2014 16:00:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:00:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:00:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:00:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:00:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:00:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:00:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:00:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:00:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:00:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:00:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:00:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:00:16 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:00:17 - XML: Processed 645696 elements - found 0 jobs
Sun 19 Jan 2014 16:00:17 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:00:17 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:00:17 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:00:17 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:00:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:00:17 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:00:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 16:00:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 16:00:17 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:00:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5082 values 80099 bits 10012 bytes 
Sun 19 Jan 2014 16:00:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:00:19 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:00:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:00:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:00:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:00:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:00:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:00:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:00:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:00:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42957477
Sun 19 Jan 2014 16:00:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:00:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42957477
Sun 19 Jan 2014 16:00:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:00:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:00:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:00:32 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:00:32 - job_xml_thread(): Done retrieving: data size 42957477
Sun 19 Jan 2014 16:00:32 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:00:32 - XML: Start document: iteration 6
Sun 19 Jan 2014 16:00:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:00:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:00:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:00:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:00:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:00:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:00:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:00:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:00:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:00:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:00:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:00:40 - XML: Processed 645838 elements - found 0 jobs
Sun 19 Jan 2014 16:00:40 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:00:40 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:00:40 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:00:40 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:00:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:00:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:00:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:00:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:00:44 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:00:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 16:00:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:00:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:00:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:00:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:00:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:00:47 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:00:47 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 16:00:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:00:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43484372
Sun 19 Jan 2014 16:00:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:00:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43484372
Sun 19 Jan 2014 16:00:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:00:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:00:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:00:56 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:00:56 - job_xml_thread(): Done retrieving: data size 43484372
Sun 19 Jan 2014 16:00:56 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:00:56 - XML: Start document: iteration 7
Sun 19 Jan 2014 16:01:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:01:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:01:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:01:00 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:01:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:01:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:01:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:01:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:01:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:01:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:01:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:01:07 - XML: Processed 652542 elements - found 0 jobs
Sun 19 Jan 2014 16:01:07 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:01:07 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:01:07 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:01:07 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:01:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:01:11 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:01:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:01:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:01:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:01:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:01:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:01:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:01:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:01:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43544459
Sun 19 Jan 2014 16:01:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:01:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43544459
Sun 19 Jan 2014 16:01:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:01:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:01:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:01:17 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:01:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:01:18 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:01:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 16:01:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:01:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 16:01:18 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:01:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8621 values 136005 bits 17000 bytes 
Sun 19 Jan 2014 16:01:22 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:01:22 - job_xml_thread(): Done retrieving: data size 43544459
Sun 19 Jan 2014 16:01:22 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:01:22 - XML: Start document: iteration 8
Sun 19 Jan 2014 16:01:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:01:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:01:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:01:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:01:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:01:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:01:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:01:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:01:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:01:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:01:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:01:32 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 16:01:32 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:01:32 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:01:32 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:01:32 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:01:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:01:37 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:01:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:01:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:01:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:01:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:01:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:01:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:01:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:01:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:01:40 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:01:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 16:01:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:01:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:01:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43552123
Sun 19 Jan 2014 16:01:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:01:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43552123
Sun 19 Jan 2014 16:01:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:01:48 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:01:48 - job_xml_thread(): Done retrieving: data size 43552123
Sun 19 Jan 2014 16:01:48 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:01:48 - XML: Start document: iteration 9
Sun 19 Jan 2014 16:01:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:01:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:01:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:01:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:01:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:01:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:01:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:01:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:01:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:01:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:01:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:01:58 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 16:01:58 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:01:58 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:01:58 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:01:58 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:02:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:02:01 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:02:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:02:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:02:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:02:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:02:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:02:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:02:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:02:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556217
Sun 19 Jan 2014 16:02:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:02:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556217
Sun 19 Jan 2014 16:02:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:02:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:02:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:02:13 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:02:13 - job_xml_thread(): Done retrieving: data size 43556217
Sun 19 Jan 2014 16:02:13 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:02:13 - XML: Start document: iteration 10
Sun 19 Jan 2014 16:02:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:02:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:02:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:02:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:02:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:02:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:02:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:02:18 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:02:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:02:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:02:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:02:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:02:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:02:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:02:19 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:02:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 16:02:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 16:02:19 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:02:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6139 values 97121 bits 12140 bytes 
Sun 19 Jan 2014 16:02:24 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 16:02:24 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:02:24 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:02:24 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:02:24 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:02:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:02:27 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:02:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:02:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:02:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:02:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:02:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:02:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:02:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:02:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555738
Sun 19 Jan 2014 16:02:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:02:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555738
Sun 19 Jan 2014 16:02:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:02:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:02:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:02:39 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:02:39 - job_xml_thread(): Done retrieving: data size 43555738
Sun 19 Jan 2014 16:02:39 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:02:39 - XML: Start document: iteration 11
Sun 19 Jan 2014 16:02:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:02:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:02:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:02:44 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:02:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:02:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:02:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:02:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:02:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:02:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:02:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:02:52 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:02:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 16:02:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:02:54 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 16:02:54 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:02:54 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:02:54 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:02:54 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:02:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:02:57 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:02:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:02:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:02:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:02:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:02:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:02:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:03:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:03:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43548987
Sun 19 Jan 2014 16:03:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:03:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:03:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:03:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43548987
Sun 19 Jan 2014 16:03:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:03:09 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:03:09 - job_xml_thread(): Done retrieving: data size 43548987
Sun 19 Jan 2014 16:03:09 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:03:09 - XML: Start document: iteration 12
Sun 19 Jan 2014 16:03:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:03:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:03:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:03:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:03:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:03:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:03:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:03:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:03:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:03:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:03:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:03:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:03:19 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:03:19 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:03:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 16:03:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:03:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 16:03:19 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:03:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5829 values 92199 bits 11524 bytes 
Sun 19 Jan 2014 16:03:23 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 16:03:23 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:03:23 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:03:23 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:03:23 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:03:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:03:25 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:03:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:03:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:03:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:03:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:03:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:03:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:03:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:03:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:03:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:03:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43546911
Sun 19 Jan 2014 16:03:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:03:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43546911
Sun 19 Jan 2014 16:03:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:03:39 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:03:39 - job_xml_thread(): Done retrieving: data size 43546911
Sun 19 Jan 2014 16:03:39 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:03:39 - XML: Start document: iteration 13
Sun 19 Jan 2014 16:03:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:03:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:03:41 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:03:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 16:03:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:03:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:03:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:03:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:03:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:03:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:03:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:03:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:03:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:03:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:03:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:03:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:03:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:03:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:03:54 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 16:03:54 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:03:54 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:03:54 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:03:54 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:03:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:03:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:03:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:03:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:03:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:03:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559950
Sun 19 Jan 2014 16:03:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:03:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:03:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:04:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559950
Sun 19 Jan 2014 16:04:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:04:10 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:04:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:04:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:04:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:04:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:04:10 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:04:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:04:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:04:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:04:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:04:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:04:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:04:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:04:14 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:04:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:04:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:04:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:04:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:04:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:04:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:04:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:04:18 - job_xml_thread(): Done retrieving: data size 43566336
Sun 19 Jan 2014 16:04:18 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:04:18 - XML: Start document: iteration 14
Sun 19 Jan 2014 16:04:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566336
Sun 19 Jan 2014 16:04:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:04:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566336
Sun 19 Jan 2014 16:04:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:04:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:04:20 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:04:22 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:04:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 16:04:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:04:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 16:04:22 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:04:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9138 values 144184 bits 18023 bytes 
Sun 19 Jan 2014 16:04:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:04:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:04:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:04:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:04:37 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 16:04:37 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:04:37 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:04:37 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:04:37 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:04:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:04:37 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:04:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:04:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:04:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:04:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:04:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:04:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:04:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:04:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:04:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:04:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:04:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:04:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:04:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:04:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:04:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:04:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:04:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570432
Sun 19 Jan 2014 16:04:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:04:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570432
Sun 19 Jan 2014 16:04:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:04:52 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:04:52 - job_xml_thread(): Done retrieving: data size 43570432
Sun 19 Jan 2014 16:04:52 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:04:52 - XML: Start document: iteration 15
Sun 19 Jan 2014 16:04:52 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:04:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 16:04:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:04:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:04:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:04:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:04:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:05:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:05:06 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:05:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:05:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:05:07 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 16:05:07 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:05:07 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:05:07 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:05:07 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:05:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:05:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:05:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:05:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:05:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:05:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:05:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:05:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:05:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:05:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:05:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:05:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:05:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:05:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:05:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43523666
Sun 19 Jan 2014 16:05:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:05:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43523666
Sun 19 Jan 2014 16:05:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:05:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:05:23 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:05:23 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:05:23 - job_xml_thread(): Done retrieving: data size 43523666
Sun 19 Jan 2014 16:05:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:05:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:05:23 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:05:23 - XML: Start document: iteration 16
Sun 19 Jan 2014 16:05:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:05:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:05:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 16:05:23 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:05:24 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:05:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 16:05:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6224 values 98167 bits 12270 bytes 
Sun 19 Jan 2014 16:05:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:05:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:05:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:05:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:05:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:05:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:05:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:05:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:05:32 - XML: Processed 652588 elements - found 0 jobs
Sun 19 Jan 2014 16:05:32 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:05:32 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:05:32 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:05:32 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:05:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:05:35 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:05:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:05:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:05:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:05:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:05:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:05:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:05:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:05:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43368585
Sun 19 Jan 2014 16:05:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:05:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:05:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:05:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43368585
Sun 19 Jan 2014 16:05:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:05:49 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:05:49 - job_xml_thread(): Done retrieving: data size 43368585
Sun 19 Jan 2014 16:05:49 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:05:49 - XML: Start document: iteration 17
Sun 19 Jan 2014 16:05:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:05:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:06:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:06:00 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:06:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:06:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:06:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:06:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:06:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:06:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:06:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:06:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:06:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:06:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:06:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:06:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:06:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:06:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:06:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:06:04 - XML: Processed 651088 elements - found 0 jobs
Sun 19 Jan 2014 16:06:04 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:06:04 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:06:04 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:06:04 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:06:04 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:06:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 16:06:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:06:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:06:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42914904
Sun 19 Jan 2014 16:06:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:06:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42914904
Sun 19 Jan 2014 16:06:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:06:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:06:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:06:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:06:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:06:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:06:19 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:06:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:06:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:06:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:06:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:06:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:06:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:06:19 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:06:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:06:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:06:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:06:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:06:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:06:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:06:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:06:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:06:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:06:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:06:24 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:06:24 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:06:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:06:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 16:06:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 16:06:24 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:06:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5900 values 93066 bits 11633 bytes 
Sun 19 Jan 2014 16:06:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:06:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42995058
Sun 19 Jan 2014 16:06:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:06:26 - job_xml_thread(): Done retrieving: data size 42995058
Sun 19 Jan 2014 16:06:26 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:06:26 - XML: Start document: iteration 18
Sun 19 Jan 2014 16:06:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42995058
Sun 19 Jan 2014 16:06:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:06:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:06:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:06:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:06:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:06:39 - XML: Processed 645948 elements - found 0 jobs
Sun 19 Jan 2014 16:06:39 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:06:39 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:06:39 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:06:39 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:06:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:06:45 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:06:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:06:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:06:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:06:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:06:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:06:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:06:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:06:47 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 16:06:47 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:06:48 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:06:48 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:06:48 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 16:06:48 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 16:06:48 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 16:06:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:06:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:06:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:06:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:06:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:06:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:06:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:06:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:06:51 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 1145419 values 18079534 bits 2259941 bytes 
Sun 19 Jan 2014 16:06:54 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:06:57 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:06:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 16:06:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:06:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:06:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43540250
Sun 19 Jan 2014 16:06:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:06:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43540250
Sun 19 Jan 2014 16:06:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:07:00 - job_xml_thread(): Done retrieving: data size 43540250
Sun 19 Jan 2014 16:07:00 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:07:00 - XML: Start document: iteration 19
Sun 19 Jan 2014 16:07:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:07:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:07:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:07:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:07:10 - XML: Processed 652970 elements - found 0 jobs
Sun 19 Jan 2014 16:07:10 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:07:10 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:07:10 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:07:10 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:07:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:07:19 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:07:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:07:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:07:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:07:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:07:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:07:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:07:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:07:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:07:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:07:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:07:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:07:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:07:25 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:07:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:07:25 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:07:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 16:07:25 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:07:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:07:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 16:07:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:07:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:07:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:07:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 4300 values 67756 bits 8469 bytes 
Sun 19 Jan 2014 16:07:25 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:07:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:07:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561583
Sun 19 Jan 2014 16:07:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:07:33 - job_xml_thread(): Done retrieving: data size 43561583
Sun 19 Jan 2014 16:07:33 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:07:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561583
Sun 19 Jan 2014 16:07:33 - XML: Start document: iteration 20
Sun 19 Jan 2014 16:07:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:07:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:07:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:07:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:07:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:07:43 - XML: Processed 653349 elements - found 0 jobs
Sun 19 Jan 2014 16:07:43 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:07:43 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:07:43 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:07:43 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:07:48 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:07:48 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 16:07:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:07:55 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:07:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:07:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:07:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:07:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:07:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:07:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:07:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:07:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:07:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:07:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:07:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:07:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:07:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:07:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:07:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:07:57 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:07:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 16:07:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:07:58 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:08:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:08:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564618
Sun 19 Jan 2014 16:08:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:08:07 - job_xml_thread(): Done retrieving: data size 43564618
Sun 19 Jan 2014 16:08:07 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:08:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564618
Sun 19 Jan 2014 16:08:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:08:07 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 16:08:07 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 16:08:07 - Housekeeping: done.
Sun 19 Jan 2014 16:08:07 - XML: Start document: iteration 0
Sun 19 Jan 2014 16:08:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:08:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:08:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:08:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:08:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:08:25 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:08:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:08:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 16:08:27 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:08:27 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:08:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5510 values 86866 bits 10858 bytes 
Sun 19 Jan 2014 16:08:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 16:08:27 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 16:08:27 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:08:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:08:27 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:08:27 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:08:27 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:08:27 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:08:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:08:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:08:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:08:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:08:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:08:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:08:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:08:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:08:31 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:08:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:08:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:08:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:08:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:08:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:08:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:08:42 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:08:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:08:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567469
Sun 19 Jan 2014 16:08:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:08:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:08:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:08:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567469
Sun 19 Jan 2014 16:08:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:08:44 - job_xml_thread(): Done retrieving: data size 43567469
Sun 19 Jan 2014 16:08:44 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:08:44 - XML: Start document: iteration 1
Sun 19 Jan 2014 16:08:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:08:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:08:59 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 16:08:59 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:08:59 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:08:59 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:08:59 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:08:59 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:08:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 16:08:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:09:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:09:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:09:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:09:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:09:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:09:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:09:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:09:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:09:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:09:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:09:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:09:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:09:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:09:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:09:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:09:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:09:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:09:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:09:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43585654
Sun 19 Jan 2014 16:09:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:09:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43585654
Sun 19 Jan 2014 16:09:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:09:14 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:09:14 - job_xml_thread(): Done retrieving: data size 43585654
Sun 19 Jan 2014 16:09:14 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:09:14 - XML: Start document: iteration 2
Sun 19 Jan 2014 16:09:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:09:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:09:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:09:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:09:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:09:27 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:09:27 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:09:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 16:09:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:09:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 16:09:27 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:09:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5885 values 92772 bits 11596 bytes 
Sun 19 Jan 2014 16:09:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:09:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:09:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:09:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:09:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:09:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:09:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:09:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:09:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:09:34 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 16:09:34 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:09:34 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:09:34 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:09:34 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:09:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:09:39 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:09:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:09:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:09:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:09:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:09:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:09:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:09:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:09:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:09:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:09:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563150
Sun 19 Jan 2014 16:09:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:09:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563150
Sun 19 Jan 2014 16:09:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:09:49 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:09:49 - job_xml_thread(): Done retrieving: data size 43563150
Sun 19 Jan 2014 16:09:49 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:09:49 - XML: Start document: iteration 3
Sun 19 Jan 2014 16:09:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:09:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:10:05 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 16:10:05 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:10:06 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:10:06 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:10:06 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:10:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:10:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:10:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:10:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:10:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:10:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:10:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:10:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:10:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:10:13 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:10:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 16:10:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:10:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:10:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:10:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:10:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:10:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:10:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:10:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:10:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:10:22 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:10:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:10:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:10:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:10:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561619
Sun 19 Jan 2014 16:10:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:10:25 - job_xml_thread(): Done retrieving: data size 43561619
Sun 19 Jan 2014 16:10:25 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:10:25 - XML: Start document: iteration 4
Sun 19 Jan 2014 16:10:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561619
Sun 19 Jan 2014 16:10:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:10:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:10:27 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:10:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:10:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:10:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:10:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 16:10:28 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:10:28 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:10:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 16:10:28 - size of cluster 'Render Cluster': 20 hosts 3138 metrics 4847 values 76441 bits 9555 bytes 
Sun 19 Jan 2014 16:10:46 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 16:10:46 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:10:46 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:10:46 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:10:46 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:10:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:10:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:10:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:10:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:10:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:10:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:10:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:10:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:10:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:10:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:10:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:10:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:10:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:10:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:10:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:10:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:10:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:10:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:10:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43594313
Sun 19 Jan 2014 16:10:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:10:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43594313
Sun 19 Jan 2014 16:10:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:11:01 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:11:01 - job_xml_thread(): Done retrieving: data size 43594313
Sun 19 Jan 2014 16:11:01 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:11:01 - XML: Start document: iteration 5
Sun 19 Jan 2014 16:11:05 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:11:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 16:11:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:11:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:11:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:11:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:11:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:11:16 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 16:11:16 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:11:16 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:11:16 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:11:16 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:11:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:11:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:11:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:11:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:11:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:11:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:11:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:11:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:11:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:11:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:11:21 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:11:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:11:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:11:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:11:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:11:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:11:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:11:23 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 16:11:23 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 16:11:23 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:11:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:11:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43521499
Sun 19 Jan 2014 16:11:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:11:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43521499
Sun 19 Jan 2014 16:11:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:11:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:11:29 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:11:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:11:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 16:11:29 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:11:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 16:11:29 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:11:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6171 values 97304 bits 12163 bytes 
Sun 19 Jan 2014 16:11:31 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:11:31 - job_xml_thread(): Done retrieving: data size 43521499
Sun 19 Jan 2014 16:11:31 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:11:31 - XML: Start document: iteration 6
Sun 19 Jan 2014 16:11:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:11:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:11:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:11:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:11:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:11:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:11:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:11:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:11:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:11:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:11:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:11:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:11:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:11:46 - XML: Processed 652600 elements - found 0 jobs
Sun 19 Jan 2014 16:11:46 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:11:46 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:11:46 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:11:46 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:11:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:11:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:11:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:11:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:11:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:11:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:11:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:11:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:11:53 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:11:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 16:11:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:11:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:11:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42935772
Sun 19 Jan 2014 16:11:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:11:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42935772
Sun 19 Jan 2014 16:11:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:11:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:11:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:12:02 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:12:02 - job_xml_thread(): Done retrieving: data size 42935772
Sun 19 Jan 2014 16:12:02 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:12:02 - XML: Start document: iteration 7
Sun 19 Jan 2014 16:12:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:12:03 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:12:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:12:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:12:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:12:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:12:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:12:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:12:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:12:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:12:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:12:14 - XML: Processed 645580 elements - found 0 jobs
Sun 19 Jan 2014 16:12:14 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:12:14 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:12:14 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:12:14 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:12:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:12:17 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:12:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:12:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:12:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:12:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:12:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:12:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:12:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:12:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42941806
Sun 19 Jan 2014 16:12:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:12:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:12:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:12:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42941806
Sun 19 Jan 2014 16:12:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:12:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:12:29 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:12:29 - job_xml_thread(): Done retrieving: data size 42941806
Sun 19 Jan 2014 16:12:29 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:12:29 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:12:29 - XML: Start document: iteration 8
Sun 19 Jan 2014 16:12:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:12:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 16:12:30 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:12:30 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:12:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99043 bits 12380 bytes 
Sun 19 Jan 2014 16:12:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 16:12:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:12:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:12:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:12:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:12:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:12:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:12:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:12:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:12:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:12:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:12:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:12:40 - XML: Processed 645826 elements - found 0 jobs
Sun 19 Jan 2014 16:12:40 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:12:40 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:12:40 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:12:40 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:12:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:12:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:12:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:12:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:12:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:12:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:12:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:12:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:12:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:12:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43479102
Sun 19 Jan 2014 16:12:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:12:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43479102
Sun 19 Jan 2014 16:12:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:12:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:12:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:12:56 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:12:56 - job_xml_thread(): Done retrieving: data size 43479102
Sun 19 Jan 2014 16:12:56 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:12:56 - XML: Start document: iteration 9
Sun 19 Jan 2014 16:12:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:12:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:13:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:13:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:13:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:13:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:13:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:13:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:13:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:13:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:13:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:13:13 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:13:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 16:13:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:13:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:13:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:13:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:13:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:13:14 - XML: Processed 652550 elements - found 0 jobs
Sun 19 Jan 2014 16:13:14 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:13:14 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:13:14 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:13:14 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:13:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:13:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:13:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:13:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:13:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:13:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:13:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:13:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43539955
Sun 19 Jan 2014 16:13:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:13:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43539955
Sun 19 Jan 2014 16:13:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:13:29 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:13:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:13:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:13:29 - job_xml_thread(): Done retrieving: data size 43539955
Sun 19 Jan 2014 16:13:29 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:13:29 - XML: Start document: iteration 10
Sun 19 Jan 2014 16:13:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:13:30 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:13:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:13:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:13:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:13:31 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:13:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:13:31 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:13:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 16:13:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:13:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:13:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 16:13:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:13:31 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:13:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5872 values 92588 bits 11573 bytes 
Sun 19 Jan 2014 16:13:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:13:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:13:40 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 16:13:40 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:13:40 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:13:40 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:13:40 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:13:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:13:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:13:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:13:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:13:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:13:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:13:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:13:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:13:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:13:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:13:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:13:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43539332
Sun 19 Jan 2014 16:13:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:13:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43539332
Sun 19 Jan 2014 16:13:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:13:48 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 16:13:48 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:13:49 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:13:49 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:13:49 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 16:13:49 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 16:13:49 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 16:13:54 - size of cluster 'LISA Cluster': 624 hosts 79447 metrics 846932 values 13355918 bits 1669489 bytes 
Sun 19 Jan 2014 16:13:55 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:13:55 - job_xml_thread(): Done retrieving: data size 43539332
Sun 19 Jan 2014 16:13:55 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:13:55 - XML: Start document: iteration 11
Sun 19 Jan 2014 16:13:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:13:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:14:06 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:14:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 16:14:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:14:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:14:06 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:14:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:14:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:14:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:14:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:14:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:14:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:14:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:14:10 - XML: Processed 653349 elements - found 0 jobs
Sun 19 Jan 2014 16:14:10 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:14:10 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:14:10 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:14:10 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:14:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:14:14 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:14:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:14:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:14:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:14:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:14:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:14:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:14:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:14:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557678
Sun 19 Jan 2014 16:14:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:14:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557678
Sun 19 Jan 2014 16:14:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:14:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:14:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:14:25 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:14:25 - job_xml_thread(): Done retrieving: data size 43557678
Sun 19 Jan 2014 16:14:25 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:14:25 - XML: Start document: iteration 12
Sun 19 Jan 2014 16:14:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:14:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:14:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:14:31 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:14:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:14:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:14:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:14:31 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:14:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:14:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:14:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:14:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:14:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:14:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:14:32 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:14:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 16:14:32 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:14:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 16:14:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5843 values 92094 bits 11511 bytes 
Sun 19 Jan 2014 16:14:41 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 16:14:41 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:14:41 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:14:41 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:14:41 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:14:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:14:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:14:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:14:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:14:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:14:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:14:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:14:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:14:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:14:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:14:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:14:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43550361
Sun 19 Jan 2014 16:14:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:14:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43550361
Sun 19 Jan 2014 16:14:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:14:49 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:14:49 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 16:14:56 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:14:56 - job_xml_thread(): Done retrieving: data size 43550361
Sun 19 Jan 2014 16:14:56 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:14:56 - XML: Start document: iteration 13
Sun 19 Jan 2014 16:15:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:15:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:15:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:15:06 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:15:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:15:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:15:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:15:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:15:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:15:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:15:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:15:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:15:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:15:12 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:15:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 16:15:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:15:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:15:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:15:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:15:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:15:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:15:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:15:13 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 16:15:13 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:15:13 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:15:13 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:15:13 - job_xml_thread(): Sleeping.. (15s)
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 2019, in storeMetrics
    del self.myMetrics[ hostname ][ metricname ]
KeyError: u'boottime'

Sun 19 Jan 2014 16:15:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:15:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567958
Sun 19 Jan 2014 16:15:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:15:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567958
Sun 19 Jan 2014 16:15:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:15:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:15:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:15:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:15:25 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:15:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:15:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:15:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:15:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:15:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:15:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:15:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567958
Sun 19 Jan 2014 16:15:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:15:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:15:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:15:28 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:15:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:15:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:15:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:15:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:15:33 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:15:33 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:15:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 16:15:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:15:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 16:15:34 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:15:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5851 values 92234 bits 11529 bytes 
Sun 19 Jan 2014 16:15:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:15:35 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:15:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:15:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:15:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:15:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:15:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:15:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:15:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:15:40 - job_xml_thread(): Done retrieving: data size 43561390
Sun 19 Jan 2014 16:15:40 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:15:40 - XML: Start document: iteration 14
Sun 19 Jan 2014 16:15:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561390
Sun 19 Jan 2014 16:15:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:15:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:15:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:15:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:15:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:15:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:15:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:15:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561390
Sun 19 Jan 2014 16:15:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:15:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:15:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:15:55 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 16:15:55 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:15:55 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:15:55 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:15:55 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:15:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:15:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:15:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:15:58 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:15:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:15:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:15:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:15:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:15:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:15:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:15:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:16:01 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:16:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 16:16:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:16:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:16:03 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:16:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:16:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:16:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:16:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:16:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:16:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:16:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:16:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567981
Sun 19 Jan 2014 16:16:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:16:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567981
Sun 19 Jan 2014 16:16:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:16:10 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:16:10 - job_xml_thread(): Done retrieving: data size 43567981
Sun 19 Jan 2014 16:16:11 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:16:11 - XML: Start document: iteration 15
Sun 19 Jan 2014 16:16:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:16:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:16:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:16:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:16:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:16:29 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:16:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:16:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:16:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:16:30 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:16:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:16:31 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 16:16:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:16:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:16:31 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:16:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:16:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:16:31 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:16:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:16:31 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:16:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:16:31 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:16:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:16:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:16:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:16:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:16:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:16:33 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:16:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:16:34 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:16:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 16:16:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 16:16:34 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:16:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6015 values 94954 bits 11869 bytes 
Sun 19 Jan 2014 16:16:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:16:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578205
Sun 19 Jan 2014 16:16:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:16:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578205
Sun 19 Jan 2014 16:16:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:16:47 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:16:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:16:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:16:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:16:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:16:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:16:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:16:47 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:16:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:16:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:16:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:16:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:16:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:16:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:16:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:16:51 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:16:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:16:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:16:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:16:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:16:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:16:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:16:56 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:16:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 16:16:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:16:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:16:57 - job_xml_thread(): Done retrieving: data size 43583615
Sun 19 Jan 2014 16:16:57 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:16:57 - XML: Start document: iteration 16
Sun 19 Jan 2014 16:16:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583615
Sun 19 Jan 2014 16:16:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:16:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583615
Sun 19 Jan 2014 16:16:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:17:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:17:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:17:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:17:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:17:09 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 16:17:09 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:17:09 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:17:09 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:17:09 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:17:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:17:13 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:17:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:17:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:17:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:17:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:17:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:17:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:17:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:17:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:17:18 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:17:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:17:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:17:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:17:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:17:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:17:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:17:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:17:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43501366
Sun 19 Jan 2014 16:17:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:17:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43501366
Sun 19 Jan 2014 16:17:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:17:24 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:17:24 - job_xml_thread(): Done retrieving: data size 43501366
Sun 19 Jan 2014 16:17:24 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:17:24 - XML: Start document: iteration 17
Sun 19 Jan 2014 16:17:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:17:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:17:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:17:34 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:17:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:17:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:17:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:17:36 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:17:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 16:17:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 16:17:36 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:17:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:17:37 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:17:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:17:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:17:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7013 values 111004 bits 13875 bytes 
Sun 19 Jan 2014 16:17:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:17:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:17:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:17:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:17:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:17:39 - XML: Processed 652600 elements - found 0 jobs
Sun 19 Jan 2014 16:17:39 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:17:39 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:17:39 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:17:39 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:17:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:17:45 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:17:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:17:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:17:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:17:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:17:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:17:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:17:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:17:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42990980
Sun 19 Jan 2014 16:17:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:17:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42990980
Sun 19 Jan 2014 16:17:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:17:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:17:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:17:54 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:17:54 - job_xml_thread(): Done retrieving: data size 42990980
Sun 19 Jan 2014 16:17:54 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:17:54 - XML: Start document: iteration 18
Sun 19 Jan 2014 16:18:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:18:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:18:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:18:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:18:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:18:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:18:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:18:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:18:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:18:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:18:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:18:10 - XML: Processed 646208 elements - found 0 jobs
Sun 19 Jan 2014 16:18:10 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:18:10 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:18:10 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:18:10 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:18:11 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:18:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 16:18:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:18:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:18:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:18:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:18:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:18:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:18:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:18:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:18:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:18:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:18:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42915040
Sun 19 Jan 2014 16:18:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:18:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42915040
Sun 19 Jan 2014 16:18:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:18:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:18:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:18:25 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:18:25 - job_xml_thread(): Done retrieving: data size 42915040
Sun 19 Jan 2014 16:18:25 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:18:25 - XML: Start document: iteration 19
Sun 19 Jan 2014 16:18:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:18:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:18:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:18:29 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:18:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:18:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:18:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:18:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:18:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:18:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:18:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:18:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:18:36 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:18:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:18:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:18:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:18:36 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:18:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 16:18:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:18:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:18:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 16:18:37 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:18:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5634 values 89009 bits 11126 bytes 
Sun 19 Jan 2014 16:18:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:18:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:18:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:18:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:18:39 - XML: Processed 645164 elements - found 0 jobs
Sun 19 Jan 2014 16:18:39 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:18:39 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:18:39 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:18:39 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:18:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:18:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43456657
Sun 19 Jan 2014 16:18:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:18:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43456657
Sun 19 Jan 2014 16:18:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:18:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:18:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:18:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:18:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:18:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:18:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:18:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:18:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:18:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:18:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:18:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:18:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:18:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43456657
Sun 19 Jan 2014 16:18:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:18:54 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:18:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:19:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:19:04 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:19:06 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:19:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 16:19:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:19:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:19:07 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:19:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:19:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:19:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:19:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:19:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:19:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:19:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:19:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:19:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:19:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:19:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:19:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:19:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:19:10 - job_xml_thread(): Done retrieving: data size 43539678
Sun 19 Jan 2014 16:19:10 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:19:10 - XML: Start document: iteration 20
Sun 19 Jan 2014 16:19:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43539678
Sun 19 Jan 2014 16:19:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:19:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43539678
Sun 19 Jan 2014 16:19:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:19:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:19:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:19:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:19:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:19:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:19:32 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:19:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:19:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:19:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:19:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:19:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:19:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:19:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:19:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:19:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:19:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:19:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:19:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:19:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:19:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:19:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:19:34 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 16:19:34 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:19:34 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:19:34 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:19:34 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:19:35 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 16:19:35 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 16:19:35 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:19:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:19:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569909
Sun 19 Jan 2014 16:19:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:19:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569909
Sun 19 Jan 2014 16:19:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:19:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:19:37 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:19:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:19:38 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:19:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 16:19:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 16:19:39 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:19:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9024 values 142326 bits 17790 bytes 
Sun 19 Jan 2014 16:19:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:19:46 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:19:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:19:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:19:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:19:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:19:49 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:19:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:19:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:19:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:19:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:19:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:19:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:19:51 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:19:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:19:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:19:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:19:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:19:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:19:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:19:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:19:54 - job_xml_thread(): Done retrieving: data size 43574419
Sun 19 Jan 2014 16:19:54 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:19:54 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 16:19:54 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 16:19:54 - Housekeeping: done.
Sun 19 Jan 2014 16:19:54 - XML: Start document: iteration 0
Sun 19 Jan 2014 16:19:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574419
Sun 19 Jan 2014 16:19:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574419
Sun 19 Jan 2014 16:19:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:19:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:20:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:20:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:20:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:20:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:20:12 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 16:20:12 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:20:12 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:20:12 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:20:12 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:20:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:20:13 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:20:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:20:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:20:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:20:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:20:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:20:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:20:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:20:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:20:17 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:20:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:20:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:20:17 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:20:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 16:20:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:20:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:20:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:20:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:20:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:20:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:20:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568996
Sun 19 Jan 2014 16:20:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:20:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568996
Sun 19 Jan 2014 16:20:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:20:27 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:20:27 - job_xml_thread(): Done retrieving: data size 43568996
Sun 19 Jan 2014 16:20:27 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:20:27 - XML: Start document: iteration 1
Sun 19 Jan 2014 16:20:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:20:28 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:20:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:20:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:20:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:20:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:20:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:20:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:20:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:20:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:20:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:20:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:20:38 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:20:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:20:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 16:20:39 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:20:39 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:20:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 16:20:39 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 16:20:39 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:20:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5780 values 91150 bits 11393 bytes 
Sun 19 Jan 2014 16:20:39 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:20:39 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:20:39 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:20:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:20:42 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:20:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:20:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:20:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:20:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:20:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:20:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:20:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:20:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558914
Sun 19 Jan 2014 16:20:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:20:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:20:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:20:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558914
Sun 19 Jan 2014 16:20:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:20:49 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 16:20:50 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:20:51 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:20:51 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 16:20:51 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 16:20:51 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:20:51 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 16:20:55 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:20:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:20:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:20:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sun 19 Jan 2014 16:21:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:21:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:21:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:21:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:21:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:21:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:21:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:21:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:21:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:21:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:21:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:21:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:21:02 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:21:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 16:21:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:21:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:21:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:21:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:21:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:21:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:21:04 - job_xml_thread(): Done retrieving: data size 43560556
Sun 19 Jan 2014 16:21:04 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:21:04 - XML: Start document: iteration 2
Sun 19 Jan 2014 16:21:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560556
Sun 19 Jan 2014 16:21:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:21:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560556
Sun 19 Jan 2014 16:21:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:21:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:21:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:21:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:21:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:21:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:21:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:21:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:21:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:21:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:21:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:21:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:21:24 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 16:21:24 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:21:24 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:21:24 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:21:24 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:21:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:21:26 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:21:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:21:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:21:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:21:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:21:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:21:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:21:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:21:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584717
Sun 19 Jan 2014 16:21:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:21:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584717
Sun 19 Jan 2014 16:21:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:21:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:21:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:21:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:21:39 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:21:39 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:21:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:21:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:21:39 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:21:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:21:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:21:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:21:41 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:21:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:21:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:21:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 16:21:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 16:21:41 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:21:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:21:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8788 values 138546 bits 17318 bytes 
Sun 19 Jan 2014 16:21:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:21:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:21:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:21:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:21:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:21:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:21:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:21:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:21:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:21:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:21:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:21:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:21:45 - job_xml_thread(): Done retrieving: data size 43588857
Sun 19 Jan 2014 16:21:45 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:21:45 - XML: Start document: iteration 3
Sun 19 Jan 2014 16:21:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43588857
Sun 19 Jan 2014 16:21:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:21:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43588857
Sun 19 Jan 2014 16:21:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:21:51 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:21:51 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:21:52 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:21:52 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 16:21:52 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:21:52 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 16:21:52 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 16:21:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:21:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:21:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:21:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:22:01 - size of cluster 'LISA Cluster': 624 hosts 79476 metrics 749084 values 11822556 bits 1477819 bytes 
Sun 19 Jan 2014 16:22:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:22:03 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:22:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:22:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:22:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:22:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:22:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:22:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:22:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:22:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:22:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:22:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:22:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:22:09 - XML: Processed 653349 elements - found 0 jobs
Sun 19 Jan 2014 16:22:09 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:22:09 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:22:09 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:22:09 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:22:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:22:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:22:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:22:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:22:10 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:22:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 16:22:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:22:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:22:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582698
Sun 19 Jan 2014 16:22:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:22:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582698
Sun 19 Jan 2014 16:22:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:22:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:22:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:22:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:22:24 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:22:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:22:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:22:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:22:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:22:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:22:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:22:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:22:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:22:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:22:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:22:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:22:29 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:22:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:22:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:22:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:22:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:22:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:22:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:22:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:22:32 - job_xml_thread(): Done retrieving: data size 43566474
Sun 19 Jan 2014 16:22:32 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:22:32 - XML: Start document: iteration 4
Sun 19 Jan 2014 16:22:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566474
Sun 19 Jan 2014 16:22:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566474
Sun 19 Jan 2014 16:22:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:22:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:22:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:22:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:22:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:22:41 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:22:42 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:22:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:22:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 16:22:42 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:22:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 16:22:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8812 values 138950 bits 17368 bytes 
Sun 19 Jan 2014 16:22:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:22:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:22:47 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 16:22:47 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:22:47 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:22:47 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:22:47 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:22:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:22:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:22:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:22:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:22:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:22:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:22:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:22:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:22:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:22:53 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:22:53 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 16:22:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:22:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:22:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:22:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:22:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:22:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:22:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:22:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:23:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:23:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580759
Sun 19 Jan 2014 16:23:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:23:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580759
Sun 19 Jan 2014 16:23:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:23:02 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:23:02 - job_xml_thread(): Done retrieving: data size 43580759
Sun 19 Jan 2014 16:23:02 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:23:02 - XML: Start document: iteration 5
Sun 19 Jan 2014 16:23:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:23:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:23:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:23:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:23:19 - XML: Processed 653349 elements - found 0 jobs
Sun 19 Jan 2014 16:23:19 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:23:19 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:23:19 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:23:19 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:23:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:23:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:23:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:23:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:23:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:23:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:23:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:23:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:23:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:23:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:23:26 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:23:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:23:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:23:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:23:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:23:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:23:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:23:26 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:23:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 16:23:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:23:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:23:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43514209
Sun 19 Jan 2014 16:23:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:23:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43514209
Sun 19 Jan 2014 16:23:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:23:34 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:23:34 - job_xml_thread(): Done retrieving: data size 43514209
Sun 19 Jan 2014 16:23:34 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:23:34 - XML: Start document: iteration 6
Sun 19 Jan 2014 16:23:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:23:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:23:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:23:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:23:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:23:42 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:23:44 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:23:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:23:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 16:23:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 16:23:44 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:23:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5974 values 94221 bits 11777 bytes 
Sun 19 Jan 2014 16:23:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:23:46 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:23:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:23:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:23:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:23:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:23:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:23:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:23:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:23:49 - XML: Processed 652449 elements - found 0 jobs
Sun 19 Jan 2014 16:23:49 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:23:49 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:23:49 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:23:49 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:23:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:23:53 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:23:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:23:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:23:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:23:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:23:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:23:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:23:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:23:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42928959
Sun 19 Jan 2014 16:23:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:23:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42928959
Sun 19 Jan 2014 16:23:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:24:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:24:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:24:04 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:24:04 - job_xml_thread(): Done retrieving: data size 42928959
Sun 19 Jan 2014 16:24:04 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:24:05 - XML: Start document: iteration 7
Sun 19 Jan 2014 16:24:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:24:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:24:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:24:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:24:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:24:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:24:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:24:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:24:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:24:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:24:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:24:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:24:21 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:24:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:24:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:24:21 - XML: Processed 645276 elements - found 0 jobs
Sun 19 Jan 2014 16:24:21 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:24:21 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:24:21 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:24:21 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:24:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:24:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:24:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:24:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:24:21 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:24:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 16:24:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:24:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:24:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42974834
Sun 19 Jan 2014 16:24:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:24:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42974834
Sun 19 Jan 2014 16:24:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:24:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:24:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:24:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:24:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:24:36 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:24:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:24:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:24:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:24:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:24:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:24:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:24:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:24:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:24:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:24:40 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:24:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:24:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:24:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:24:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:24:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:24:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:24:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:24:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:24:43 - job_xml_thread(): Done retrieving: data size 43454884
Sun 19 Jan 2014 16:24:43 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:24:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43454884
Sun 19 Jan 2014 16:24:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:24:43 - XML: Start document: iteration 8
Sun 19 Jan 2014 16:24:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43454884
Sun 19 Jan 2014 16:24:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:24:45 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:24:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:24:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:24:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 16:24:47 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:24:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 16:24:47 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:24:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5957 values 93921 bits 11740 bytes 
Sun 19 Jan 2014 16:24:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:24:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:24:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:24:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:25:02 - XML: Processed 651646 elements - found 0 jobs
Sun 19 Jan 2014 16:25:02 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:25:02 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:25:02 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:25:02 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:25:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:25:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:25:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:25:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:25:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:25:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:25:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:25:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:25:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:25:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:25:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:25:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:25:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:25:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:25:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:25:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:25:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:25:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:25:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581488
Sun 19 Jan 2014 16:25:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:25:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581488
Sun 19 Jan 2014 16:25:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:25:17 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:25:17 - job_xml_thread(): Done retrieving: data size 43581488
Sun 19 Jan 2014 16:25:17 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:25:17 - XML: Start document: iteration 9
Sun 19 Jan 2014 16:25:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:25:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:25:23 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:25:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 16:25:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:25:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:25:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:25:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:25:29 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:25:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:25:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:25:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:25:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:25:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:25:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:25:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:25:31 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 16:25:31 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:25:32 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:25:32 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:25:32 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:25:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:25:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:25:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:25:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:25:36 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 16:25:36 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 16:25:36 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:25:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:25:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:25:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:25:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:25:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:25:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556889
Sun 19 Jan 2014 16:25:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:25:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556889
Sun 19 Jan 2014 16:25:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:25:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:25:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:25:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:25:47 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:25:47 - job_xml_thread(): Done retrieving: data size 43556889
Sun 19 Jan 2014 16:25:47 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:25:47 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:25:47 - XML: Start document: iteration 10
Sun 19 Jan 2014 16:25:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:25:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:25:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:25:48 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:25:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 16:25:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 16:25:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:25:48 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:25:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:25:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6142 values 96835 bits 12104 bytes 
Sun 19 Jan 2014 16:25:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:25:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:25:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:25:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:25:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:25:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:25:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:26:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:26:01 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:26:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:26:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:26:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:26:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:26:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:26:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:26:02 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 16:26:02 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:26:02 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:26:02 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:26:02 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:26:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:26:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43546579
Sun 19 Jan 2014 16:26:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:26:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:26:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:26:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43546579
Sun 19 Jan 2014 16:26:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:26:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:26:14 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:26:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:26:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:26:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:26:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:26:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43546579
Sun 19 Jan 2014 16:26:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:26:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:26:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:26:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:26:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:26:17 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:26:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:26:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:26:25 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:26:26 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:26:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 16:26:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:26:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:26:26 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:26:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:26:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:26:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:26:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:26:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:26:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:26:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:26:28 - job_xml_thread(): Done retrieving: data size 43568638
Sun 19 Jan 2014 16:26:28 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:26:28 - XML: Start document: iteration 11
Sun 19 Jan 2014 16:26:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568638
Sun 19 Jan 2014 16:26:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:26:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:26:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:26:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:26:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:26:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568638
Sun 19 Jan 2014 16:26:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:26:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:26:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:26:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:26:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:26:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:26:45 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:26:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:26:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:26:45 - XML: Processed 653347 elements - found 0 jobs
Sun 19 Jan 2014 16:26:45 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:26:46 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:26:46 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:26:46 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:26:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:26:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:26:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:26:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:26:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:26:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:26:48 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:26:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:26:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 16:26:48 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:26:48 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:26:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5999 values 94561 bits 11820 bytes 
Sun 19 Jan 2014 16:26:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 16:26:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:26:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:26:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:26:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:26:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:26:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:26:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:26:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:26:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:26:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571398
Sun 19 Jan 2014 16:26:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:26:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571398
Sun 19 Jan 2014 16:26:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:27:01 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:27:01 - job_xml_thread(): Done retrieving: data size 43571398
Sun 19 Jan 2014 16:27:01 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:27:01 - XML: Start document: iteration 12
Sun 19 Jan 2014 16:27:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:27:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:27:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:27:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:27:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:27:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:27:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:27:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:27:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:27:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:27:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:27:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:27:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:27:15 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 16:27:15 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:27:15 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:27:15 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:27:15 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:27:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:27:16 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:27:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:27:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:27:16 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:27:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 16:27:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:27:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:27:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:27:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:27:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:27:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:27:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563644
Sun 19 Jan 2014 16:27:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:27:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563644
Sun 19 Jan 2014 16:27:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:27:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:27:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:27:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:27:30 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:27:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:27:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:27:31 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:27:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:27:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:27:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:27:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:27:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:27:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:27:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:27:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:27:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:27:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:27:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:27:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:27:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:27:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:27:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:27:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:27:34 - job_xml_thread(): Done retrieving: data size 43570388
Sun 19 Jan 2014 16:27:34 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:27:34 - XML: Start document: iteration 13
Sun 19 Jan 2014 16:27:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570388
Sun 19 Jan 2014 16:27:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:27:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570388
Sun 19 Jan 2014 16:27:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:27:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:27:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:27:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:27:48 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:27:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:27:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:27:50 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 16:27:50 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:27:50 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:27:50 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:27:50 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:27:50 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:27:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 16:27:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:27:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 16:27:50 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:27:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8937 values 140951 bits 17618 bytes 
Sun 19 Jan 2014 16:27:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:27:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:27:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:27:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:27:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:27:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:27:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:27:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:27:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:27:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:27:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:27:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:27:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:27:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:27:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:27:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:27:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:27:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:27:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43601048
Sun 19 Jan 2014 16:27:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:27:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43601048
Sun 19 Jan 2014 16:28:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:28:05 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:28:05 - job_xml_thread(): Done retrieving: data size 43601048
Sun 19 Jan 2014 16:28:05 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:28:05 - XML: Start document: iteration 14
Sun 19 Jan 2014 16:28:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:28:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:28:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:28:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:28:18 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 16:28:18 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:28:18 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:28:18 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:28:18 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:28:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:28:19 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:28:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:28:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:28:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:28:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:28:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:28:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:28:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:28:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:28:24 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:28:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:28:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:28:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:28:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:28:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:28:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:28:24 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:28:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 16:28:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:28:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:28:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580845
Sun 19 Jan 2014 16:28:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:28:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580845
Sun 19 Jan 2014 16:28:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:28:33 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:28:33 - job_xml_thread(): Done retrieving: data size 43580845
Sun 19 Jan 2014 16:28:33 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:28:33 - XML: Start document: iteration 15
Sun 19 Jan 2014 16:28:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:28:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:28:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:28:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:28:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:28:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:28:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:28:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580845
Sun 19 Jan 2014 16:28:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:28:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:28:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:28:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:28:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:28:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:28:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:28:51 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:28:51 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 16:28:51 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:28:51 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:28:51 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:28:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:28:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:28:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:28:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 16:28:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 16:28:51 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:28:51 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:28:51 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:28:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5714 values 90062 bits 11257 bytes 
Sun 19 Jan 2014 16:28:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:28:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:28:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:28:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:28:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:28:53 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 16:28:53 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:28:53 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:28:53 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:28:53 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 16:28:53 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 16:28:53 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 16:28:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:28:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:28:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:28:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:28:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:28:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:28:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:28:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:28:57 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 888499 values 14003854 bits 1750481 bytes 
Sun 19 Jan 2014 16:29:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:29:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43587021
Sun 19 Jan 2014 16:29:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:29:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43587021
Sun 19 Jan 2014 16:29:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:29:06 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:29:06 - job_xml_thread(): Done retrieving: data size 43587021
Sun 19 Jan 2014 16:29:06 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:29:06 - XML: Start document: iteration 16
Sun 19 Jan 2014 16:29:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:29:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:29:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:29:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:29:22 - XML: Processed 653347 elements - found 0 jobs
Sun 19 Jan 2014 16:29:22 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:29:22 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:29:22 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:29:22 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:29:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:29:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:29:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:29:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:29:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:29:25 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:29:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:29:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:29:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:29:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:29:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:29:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:29:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:29:25 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:29:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 16:29:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:29:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:29:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:29:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:29:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:29:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:29:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43416111
Sun 19 Jan 2014 16:29:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:29:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43416111
Sun 19 Jan 2014 16:29:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:29:38 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:29:38 - job_xml_thread(): Done retrieving: data size 43416111
Sun 19 Jan 2014 16:29:38 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:29:38 - XML: Start document: iteration 17
Sun 19 Jan 2014 16:29:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:29:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:29:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:29:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:29:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:29:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:29:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:29:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:29:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:29:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:29:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:29:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:29:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:29:50 - XML: Processed 651114 elements - found 0 jobs
Sun 19 Jan 2014 16:29:50 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:29:50 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:29:50 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:29:50 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:29:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:29:51 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:29:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:29:52 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:29:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:29:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:29:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:29:52 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:29:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 16:29:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 16:29:52 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:29:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5891 values 92853 bits 11606 bytes 
Sun 19 Jan 2014 16:29:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:29:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:29:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:29:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:29:53 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:29:53 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 16:29:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:29:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42943073
Sun 19 Jan 2014 16:29:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:29:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:29:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:29:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42943073
Sun 19 Jan 2014 16:29:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:30:05 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:30:05 - job_xml_thread(): Done retrieving: data size 42943073
Sun 19 Jan 2014 16:30:05 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:30:05 - XML: Start document: iteration 18
Sun 19 Jan 2014 16:30:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:30:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:30:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:30:10 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:30:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:30:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:30:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:30:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:30:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:30:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:30:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:30:17 - XML: Processed 645820 elements - found 0 jobs
Sun 19 Jan 2014 16:30:17 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:30:17 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:30:17 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:30:17 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:30:19 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:30:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 16:30:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:30:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:30:20 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:30:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:30:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:30:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:30:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:30:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:30:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:30:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:30:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42947414
Sun 19 Jan 2014 16:30:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:30:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42947414
Sun 19 Jan 2014 16:30:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:30:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:30:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:30:32 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:30:32 - job_xml_thread(): Done retrieving: data size 42947414
Sun 19 Jan 2014 16:30:32 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:30:33 - XML: Start document: iteration 19
Sun 19 Jan 2014 16:30:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:30:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:30:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:30:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:30:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:30:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:30:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:30:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:30:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:30:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:30:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:30:44 - XML: Processed 645900 elements - found 0 jobs
Sun 19 Jan 2014 16:30:44 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:30:44 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:30:44 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:30:44 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:30:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:30:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:30:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:30:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:30:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:30:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:30:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:30:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:30:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:30:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:30:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:30:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43506314
Sun 19 Jan 2014 16:30:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:30:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43506314
Sun 19 Jan 2014 16:30:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:30:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:30:52 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:30:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:30:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 16:30:54 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:30:54 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:30:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 16:30:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8951 values 141117 bits 17639 bytes 
Sun 19 Jan 2014 16:30:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:30:58 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:30:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:30:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:30:59 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:30:59 - job_xml_thread(): Done retrieving: data size 43506314
Sun 19 Jan 2014 16:30:59 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:30:59 - XML: Start document: iteration 20
Sun 19 Jan 2014 16:30:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:30:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:30:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:30:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:30:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43506314
Sun 19 Jan 2014 16:30:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:31:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:31:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:31:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:31:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:31:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:31:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:31:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:31:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:31:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:31:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:31:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:31:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:31:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:31:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:31:16 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:31:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:31:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:31:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:31:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:31:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:31:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:31:18 - XML: Processed 652865 elements - found 0 jobs
Sun 19 Jan 2014 16:31:18 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:31:18 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:31:18 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:31:18 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:31:23 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:31:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 16:31:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:31:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:31:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565263
Sun 19 Jan 2014 16:31:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:31:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565263
Sun 19 Jan 2014 16:31:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:31:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:31:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:31:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:31:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:31:33 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:31:33 - job_xml_thread(): Done retrieving: data size 43565263
Sun 19 Jan 2014 16:31:33 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:31:33 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 16:31:33 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 16:31:33 - Housekeeping: done.
Sun 19 Jan 2014 16:31:33 - XML: Start document: iteration 0
Sun 19 Jan 2014 16:31:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:31:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:31:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:31:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:31:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:31:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:31:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:31:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:31:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:31:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:31:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:31:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:31:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:31:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:31:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:31:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:31:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:31:47 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 16:31:47 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:31:47 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:31:47 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:31:47 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:31:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:31:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:31:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:31:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43549621
Sun 19 Jan 2014 16:31:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:31:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43549621
Sun 19 Jan 2014 16:31:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:31:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:31:55 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:31:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:31:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 16:31:55 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:31:55 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:31:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6474 values 102313 bits 12789 bytes 
Sun 19 Jan 2014 16:31:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 16:32:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:32:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:32:02 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:32:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:32:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:32:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:32:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:32:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:32:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:32:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:32:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:32:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:32:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:32:07 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:32:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:32:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:32:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:32:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:32:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:32:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:32:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:32:11 - job_xml_thread(): Done retrieving: data size 43568259
Sun 19 Jan 2014 16:32:11 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:32:11 - XML: Start document: iteration 1
Sun 19 Jan 2014 16:32:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568259
Sun 19 Jan 2014 16:32:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:32:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568259
Sun 19 Jan 2014 16:32:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:32:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:32:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:32:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:32:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:32:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:32:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:32:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:32:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:32:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:32:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:32:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:32:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:32:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:32:29 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:32:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 16:32:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:32:30 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 16:32:30 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:32:30 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:32:30 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:32:30 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:32:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:32:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:32:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:32:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:32:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:32:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:32:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:32:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:32:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:32:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563322
Sun 19 Jan 2014 16:32:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:32:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563322
Sun 19 Jan 2014 16:32:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:32:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:32:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:32:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:32:45 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:32:45 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:32:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:32:45 - job_xml_thread(): Done retrieving: data size 43563322
Sun 19 Jan 2014 16:32:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:32:45 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:32:45 - XML: Start document: iteration 2
Sun 19 Jan 2014 16:32:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:32:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:32:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:32:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563322
Sun 19 Jan 2014 16:32:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:32:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:32:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:32:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:32:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:32:56 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:32:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:32:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 16:32:57 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:32:57 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:32:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 16:32:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6019 values 95308 bits 11913 bytes 
Sun 19 Jan 2014 16:33:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:33:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:33:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:33:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:33:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:33:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:33:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:33:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:33:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:33:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:33:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:33:04 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 16:33:04 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:33:04 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:33:04 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:33:04 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:33:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:33:05 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:33:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:33:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:33:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:33:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:33:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:33:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:33:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:33:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583037
Sun 19 Jan 2014 16:33:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:33:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583037
Sun 19 Jan 2014 16:33:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:33:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:33:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:33:19 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:33:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:33:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:33:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:33:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:33:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:33:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:33:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:33:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:33:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:33:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:33:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:33:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:33:26 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:33:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:33:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:33:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:33:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:33:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:33:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:33:27 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:33:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 16:33:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:33:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:33:31 - job_xml_thread(): Done retrieving: data size 43573428
Sun 19 Jan 2014 16:33:31 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:33:31 - XML: Start document: iteration 3
Sun 19 Jan 2014 16:33:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573428
Sun 19 Jan 2014 16:33:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573428
Sun 19 Jan 2014 16:33:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:33:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:33:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:33:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:33:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:33:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:33:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:33:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:33:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:33:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:33:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:33:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:33:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:33:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:33:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:33:52 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 16:33:52 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:33:52 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:33:52 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:33:52 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:33:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:33:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:33:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:33:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:33:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:33:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:33:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:33:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:33:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:33:57 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:33:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:33:57 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:33:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 16:33:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 16:33:57 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:33:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5826 values 92016 bits 11502 bytes 
Sun 19 Jan 2014 16:33:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:33:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578470
Sun 19 Jan 2014 16:33:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:33:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578470
Sun 19 Jan 2014 16:33:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:34:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:34:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:34:07 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:34:07 - job_xml_thread(): Done retrieving: data size 43578470
Sun 19 Jan 2014 16:34:07 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:34:07 - XML: Start document: iteration 4
Sun 19 Jan 2014 16:34:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:34:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:34:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:34:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:34:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:34:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:34:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:34:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:34:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:34:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:34:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:34:20 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 16:34:20 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:34:20 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:34:20 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:34:20 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:34:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:34:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:34:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:34:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:34:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:34:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:34:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:34:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:34:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:34:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:34:25 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:34:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 16:34:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:34:26 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 16:34:26 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 16:34:26 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:34:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:34:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43548502
Sun 19 Jan 2014 16:34:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:34:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43548502
Sun 19 Jan 2014 16:34:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:34:35 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:34:35 - job_xml_thread(): Done retrieving: data size 43548502
Sun 19 Jan 2014 16:34:35 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:34:35 - XML: Start document: iteration 5
Sun 19 Jan 2014 16:34:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:34:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:34:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:34:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:34:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:34:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:34:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:34:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:34:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:34:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:34:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:34:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:34:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:34:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:34:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:34:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:34:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:34:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:34:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:34:48 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 16:34:48 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:34:48 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:34:48 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:34:48 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:34:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:34:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563391
Sun 19 Jan 2014 16:34:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:34:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563391
Sun 19 Jan 2014 16:34:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:34:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:34:57 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:34:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:34:57 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:34:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 16:34:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 16:34:58 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:34:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7204 values 113581 bits 14197 bytes 
Sun 19 Jan 2014 16:34:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:34:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:34:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:34:59 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:34:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:34:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:35:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:35:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:35:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:35:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:35:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:35:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:35:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:35:03 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:35:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:35:05 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:35:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:35:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:35:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:35:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:35:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:35:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:35:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:35:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579523
Sun 19 Jan 2014 16:35:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:35:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579523
Sun 19 Jan 2014 16:35:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:35:08 - job_xml_thread(): Done retrieving: data size 43579523
Sun 19 Jan 2014 16:35:08 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:35:08 - XML: Start document: iteration 6
Sun 19 Jan 2014 16:35:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:35:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:35:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:35:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:35:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:35:25 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:35:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:35:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:35:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:35:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:35:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:35:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:35:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:35:28 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 16:35:28 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:35:28 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:35:28 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:35:28 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:35:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:35:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:35:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:35:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:35:30 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:35:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 16:35:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:35:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:35:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:35:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:35:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:35:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:35:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43175792
Sun 19 Jan 2014 16:35:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:35:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43175792
Sun 19 Jan 2014 16:35:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:35:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:35:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:35:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:35:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:35:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:35:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:35:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:35:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:35:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:35:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:35:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:35:43 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:35:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:35:45 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:35:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:35:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:35:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:35:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:35:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:35:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:35:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:35:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42938576
Sun 19 Jan 2014 16:35:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:35:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42938576
Sun 19 Jan 2014 16:35:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:35:48 - job_xml_thread(): Done retrieving: data size 42938576
Sun 19 Jan 2014 16:35:49 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:35:49 - XML: Start document: iteration 7
Sun 19 Jan 2014 16:35:53 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 16:35:53 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:35:54 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:35:54 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 16:35:54 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 16:35:54 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:35:54 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 16:35:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:35:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:35:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:35:58 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:36:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:36:01 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:36:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 16:36:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 16:36:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:36:02 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:36:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:36:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8819 values 139102 bits 17387 bytes 
Sun 19 Jan 2014 16:36:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:36:04 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:36:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:36:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:36:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:36:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:36:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:36:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:36:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:36:07 - size of cluster 'LISA Cluster': 624 hosts 79485 metrics 710795 values 11221456 bits 1402682 bytes 
Sun 19 Jan 2014 16:36:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:36:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:36:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:36:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:36:10 - XML: Processed 645504 elements - found 0 jobs
Sun 19 Jan 2014 16:36:10 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:36:10 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:36:10 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:36:10 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:36:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:36:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:36:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:36:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:36:15 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:36:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 16:36:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:36:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:36:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42935158
Sun 19 Jan 2014 16:36:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:36:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42935158
Sun 19 Jan 2014 16:36:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:36:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:36:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:36:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:36:25 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:36:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:36:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:36:25 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:36:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:36:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:36:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:36:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:36:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:36:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:36:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:36:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:36:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:36:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:36:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:36:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:36:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:36:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:36:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:36:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:36:33 - job_xml_thread(): Done retrieving: data size 43311567
Sun 19 Jan 2014 16:36:33 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:36:33 - XML: Start document: iteration 8
Sun 19 Jan 2014 16:36:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43311567
Sun 19 Jan 2014 16:36:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:36:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43311567
Sun 19 Jan 2014 16:36:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:36:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:36:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:36:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:36:44 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:36:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:36:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:36:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:36:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:36:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:36:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:36:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:36:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:36:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:36:50 - XML: Processed 650212 elements - found 0 jobs
Sun 19 Jan 2014 16:36:50 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:36:50 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:36:50 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:36:50 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:36:54 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:36:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:36:54 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 16:36:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:36:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:36:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:36:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:36:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:36:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:36:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:36:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:36:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43538648
Sun 19 Jan 2014 16:36:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:36:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43538648
Sun 19 Jan 2014 16:36:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:37:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:37:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:37:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:37:01 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:37:01 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:37:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:37:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 16:37:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 16:37:01 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:37:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148585 bits 18573 bytes 
Sun 19 Jan 2014 16:37:05 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:37:05 - job_xml_thread(): Done retrieving: data size 43538648
Sun 19 Jan 2014 16:37:05 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:37:05 - XML: Start document: iteration 9
Sun 19 Jan 2014 16:37:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:37:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:37:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:37:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:37:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:37:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:37:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:37:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:37:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:37:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:37:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:37:16 - XML: Processed 652928 elements - found 0 jobs
Sun 19 Jan 2014 16:37:16 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:37:16 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:37:16 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:37:16 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:37:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:37:20 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:37:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:37:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:37:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:37:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:37:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:37:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:37:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:37:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:37:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:37:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43550577
Sun 19 Jan 2014 16:37:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:37:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43550577
Sun 19 Jan 2014 16:37:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:37:31 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:37:31 - job_xml_thread(): Done retrieving: data size 43550577
Sun 19 Jan 2014 16:37:31 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:37:31 - XML: Start document: iteration 10
Sun 19 Jan 2014 16:37:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:37:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:37:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:37:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:37:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:37:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:37:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:37:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:37:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:37:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:37:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:37:44 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 16:37:44 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:37:44 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:37:44 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:37:44 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:37:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:37:47 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:37:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:37:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:37:47 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:37:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 16:37:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:37:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:37:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:37:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:37:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:37:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:37:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561019
Sun 19 Jan 2014 16:37:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:37:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561019
Sun 19 Jan 2014 16:37:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:37:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:37:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:37:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:37:59 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:37:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:37:59 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:37:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:37:59 - job_xml_thread(): Done retrieving: data size 43561019
Sun 19 Jan 2014 16:37:59 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:37:59 - XML: Start document: iteration 11
Sun 19 Jan 2014 16:38:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:38:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:38:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561019
Sun 19 Jan 2014 16:38:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:38:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:38:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:38:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:38:01 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:38:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:38:03 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:38:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 16:38:03 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:38:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 16:38:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:38:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:38:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5813 values 91675 bits 11459 bytes 
Sun 19 Jan 2014 16:38:10 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 16:38:10 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:38:10 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:38:10 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:38:10 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:38:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:38:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:38:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:38:20 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:38:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:38:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:38:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:38:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:38:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:38:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:38:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:38:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:38:21 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:38:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:38:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:38:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:38:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:38:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:38:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:38:26 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:38:27 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:38:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 16:38:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:38:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:38:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43595260
Sun 19 Jan 2014 16:38:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:38:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43595260
Sun 19 Jan 2014 16:38:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:38:28 - job_xml_thread(): Done retrieving: data size 43595260
Sun 19 Jan 2014 16:38:28 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:38:28 - XML: Start document: iteration 12
Sun 19 Jan 2014 16:38:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:38:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:38:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:38:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:38:46 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 16:38:46 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:38:46 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:38:46 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:38:46 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:38:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:38:46 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:38:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:38:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:38:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:38:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:38:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:38:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:38:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:38:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:38:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:38:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:38:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:38:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:38:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:38:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:38:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:38:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:38:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583303
Sun 19 Jan 2014 16:38:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:38:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583303
Sun 19 Jan 2014 16:38:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:39:02 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:39:02 - job_xml_thread(): Done retrieving: data size 43583303
Sun 19 Jan 2014 16:39:02 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:39:02 - XML: Start document: iteration 13
Sun 19 Jan 2014 16:39:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:39:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:39:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:39:04 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:39:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:39:05 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:39:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 16:39:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 16:39:05 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:39:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:39:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:39:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99068 bits 12383 bytes 
Sun 19 Jan 2014 16:39:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:39:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:39:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:39:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:39:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:39:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:39:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:39:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:39:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:39:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:39:15 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:39:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:39:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:39:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:39:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:39:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:39:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:39:16 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 16:39:16 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:39:16 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:39:16 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:39:16 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:39:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:39:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43543302
Sun 19 Jan 2014 16:39:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:39:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43543302
Sun 19 Jan 2014 16:39:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:39:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:39:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:39:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:39:30 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:39:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:39:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:39:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:39:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:39:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:39:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:39:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:39:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:39:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:39:31 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:39:35 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:39:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 16:39:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:39:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:39:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:39:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:39:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:39:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:39:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:39:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:39:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:39:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:39:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575638
Sun 19 Jan 2014 16:39:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:39:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575638
Sun 19 Jan 2014 16:39:39 - job_xml_thread(): Done retrieving: data size 43575638
Sun 19 Jan 2014 16:39:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:39:40 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:39:40 - XML: Start document: iteration 14
Sun 19 Jan 2014 16:39:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:39:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:39:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:39:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:39:59 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 16:39:59 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:39:59 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:39:59 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:39:59 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:40:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:40:01 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:40:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:40:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:40:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:40:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:40:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:40:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:40:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:40:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:40:03 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:40:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:40:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:40:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:40:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:40:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:40:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:40:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:40:05 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:40:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:40:06 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:40:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 16:40:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 16:40:06 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:40:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5738 values 90426 bits 11303 bytes 
Sun 19 Jan 2014 16:40:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:40:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576654
Sun 19 Jan 2014 16:40:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:40:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576654
Sun 19 Jan 2014 16:40:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:40:14 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:40:14 - job_xml_thread(): Done retrieving: data size 43576654
Sun 19 Jan 2014 16:40:14 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:40:14 - XML: Start document: iteration 15
Sun 19 Jan 2014 16:40:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:40:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:40:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:40:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:40:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:40:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:40:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:40:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:40:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:40:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:40:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:40:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:40:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:40:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:40:29 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:40:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:40:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:40:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:40:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:40:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:40:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:40:31 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 16:40:31 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:40:31 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:40:31 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:40:31 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:40:33 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 16:40:33 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 16:40:33 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:40:33 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:40:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 16:40:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:40:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:40:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561327
Sun 19 Jan 2014 16:40:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:40:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561327
Sun 19 Jan 2014 16:40:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:40:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:40:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:40:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:40:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:40:47 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:40:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:40:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:40:47 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:40:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:40:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:40:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:40:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:40:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:40:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:40:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:40:49 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:40:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:40:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:40:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:40:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:40:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:40:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:40:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:40:51 - job_xml_thread(): Done retrieving: data size 43579224
Sun 19 Jan 2014 16:40:51 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:40:51 - XML: Start document: iteration 16
Sun 19 Jan 2014 16:40:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579224
Sun 19 Jan 2014 16:40:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:40:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579224
Sun 19 Jan 2014 16:40:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:41:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:41:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:41:04 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 16:41:05 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:41:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:41:05 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:41:05 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:41:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:41:05 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:41:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:41:06 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:41:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:41:07 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:41:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 16:41:07 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:41:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 16:41:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7383 values 116415 bits 14551 bytes 
Sun 19 Jan 2014 16:41:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:41:10 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:41:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:41:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:41:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:41:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:41:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:41:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:41:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:41:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:41:14 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:41:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:41:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:41:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:41:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:41:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:41:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:41:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:41:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43512031
Sun 19 Jan 2014 16:41:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:41:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43512031
Sun 19 Jan 2014 16:41:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:41:21 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:41:21 - job_xml_thread(): Done retrieving: data size 43512031
Sun 19 Jan 2014 16:41:21 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:41:21 - XML: Start document: iteration 17
Sun 19 Jan 2014 16:41:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:41:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:41:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:41:28 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:41:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:41:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:41:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:41:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:41:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:41:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:41:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:41:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:41:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:41:37 - XML: Processed 652599 elements - found 0 jobs
Sun 19 Jan 2014 16:41:37 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:41:37 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:41:37 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:41:37 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:41:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:41:39 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:41:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:41:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:41:39 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:41:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 16:41:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:41:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:41:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:41:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:41:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:41:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:41:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43040367
Sun 19 Jan 2014 16:41:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:41:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43040367
Sun 19 Jan 2014 16:41:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:41:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:41:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:41:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:41:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:41:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:41:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:41:54 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:41:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:41:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:41:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:41:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:41:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:41:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:41:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:41:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:41:57 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:41:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:41:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:41:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:41:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:41:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:41:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:41:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:41:58 - job_xml_thread(): Done retrieving: data size 42917112
Sun 19 Jan 2014 16:41:58 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:41:58 - XML: Start document: iteration 18
Sun 19 Jan 2014 16:41:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42917112
Sun 19 Jan 2014 16:41:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:41:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42917112
Sun 19 Jan 2014 16:41:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:42:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:42:08 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:42:09 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:42:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 16:42:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:42:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 16:42:09 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:42:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:42:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:42:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8920 values 140653 bits 17581 bytes 
Sun 19 Jan 2014 16:42:12 - XML: Processed 645156 elements - found 0 jobs
Sun 19 Jan 2014 16:42:12 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:42:12 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:42:12 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:42:12 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:42:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:42:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:42:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:42:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:42:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:42:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:42:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:42:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:42:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:42:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:42:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:42:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:42:21 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:42:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:42:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:42:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:42:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:42:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:42:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:42:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:42:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42986564
Sun 19 Jan 2014 16:42:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:42:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42986564
Sun 19 Jan 2014 16:42:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:42:27 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:42:27 - job_xml_thread(): Done retrieving: data size 42986564
Sun 19 Jan 2014 16:42:27 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:42:27 - XML: Start document: iteration 19
Sun 19 Jan 2014 16:42:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:42:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:42:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:42:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:42:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:42:37 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:42:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:42:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:42:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:42:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:42:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:42:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:42:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:42:43 - XML: Processed 645899 elements - found 0 jobs
Sun 19 Jan 2014 16:42:43 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:42:43 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:42:43 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:42:43 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:42:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:42:45 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:42:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:42:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:42:46 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:42:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 16:42:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:42:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:42:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:42:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:42:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:42:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:42:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43528533
Sun 19 Jan 2014 16:42:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:42:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43528533
Sun 19 Jan 2014 16:42:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:42:54 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 16:42:54 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:42:55 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:42:55 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:42:55 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 16:42:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:42:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:42:57 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 16:42:57 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 16:42:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:42:57 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:42:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:42:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:42:58 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:42:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:42:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:42:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:42:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:42:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:43:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:43:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:43:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:43:03 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:43:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:43:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:43:03 - size of cluster 'LISA Cluster': 624 hosts 79486 metrics 815828 values 12859106 bits 1607388 bytes 
Sun 19 Jan 2014 16:43:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:43:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:43:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:43:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:43:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:43:07 - job_xml_thread(): Done retrieving: data size 43565182
Sun 19 Jan 2014 16:43:07 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:43:07 - XML: Start document: iteration 20
Sun 19 Jan 2014 16:43:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565182
Sun 19 Jan 2014 16:43:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:43:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565182
Sun 19 Jan 2014 16:43:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:43:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:43:09 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:43:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:43:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 16:43:11 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:43:11 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:43:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 16:43:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8794 values 138676 bits 17334 bytes 
Sun 19 Jan 2014 16:43:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:43:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:43:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:43:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:43:22 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 16:43:22 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:43:22 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:43:22 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:43:22 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:43:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:43:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:43:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:43:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:43:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:43:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:43:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:43:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:43:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:43:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:43:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:43:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:43:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:43:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:43:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:43:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:43:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:43:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:43:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567883
Sun 19 Jan 2014 16:43:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:43:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567883
Sun 19 Jan 2014 16:43:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:43:38 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:43:38 - job_xml_thread(): Done retrieving: data size 43567883
Sun 19 Jan 2014 16:43:38 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:43:38 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 16:43:38 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 16:43:38 - Housekeeping: done.
Sun 19 Jan 2014 16:43:39 - XML: Start document: iteration 0
Sun 19 Jan 2014 16:43:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:43:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:43:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:43:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:43:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:43:46 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:43:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:43:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:43:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:43:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:43:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:43:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:43:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:43:55 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:43:55 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 16:43:55 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 16:43:55 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:43:55 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:43:55 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:43:55 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:43:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:43:57 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:43:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:43:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:43:58 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:43:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 16:43:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:43:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:43:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:43:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:43:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:44:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:44:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43552185
Sun 19 Jan 2014 16:44:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:44:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43552185
Sun 19 Jan 2014 16:44:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:44:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:44:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:44:10 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:44:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:44:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:44:11 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:44:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:44:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:44:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:44:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:44:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:44:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:44:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:44:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:44:12 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:44:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 16:44:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 16:44:12 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:44:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:44:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5840 values 92074 bits 11509 bytes 
Sun 19 Jan 2014 16:44:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:44:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:44:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:44:16 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:44:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:44:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:44:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:44:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:44:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:44:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:44:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:44:21 - job_xml_thread(): Done retrieving: data size 43563173
Sun 19 Jan 2014 16:44:21 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:44:21 - XML: Start document: iteration 1
Sun 19 Jan 2014 16:44:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563173
Sun 19 Jan 2014 16:44:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:44:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563173
Sun 19 Jan 2014 16:44:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:44:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:44:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:44:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:44:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:44:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:44:36 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:44:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:44:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:44:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:44:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:44:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:44:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:44:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:44:43 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 16:44:43 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:44:43 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:44:43 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:44:43 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:44:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:44:45 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:44:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:44:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:44:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:44:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:44:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:44:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:44:45 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:44:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 16:44:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:44:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:44:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558839
Sun 19 Jan 2014 16:44:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:44:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558839
Sun 19 Jan 2014 16:44:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:44:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:44:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:44:58 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:44:58 - job_xml_thread(): Done retrieving: data size 43558839
Sun 19 Jan 2014 16:44:58 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:44:58 - XML: Start document: iteration 2
Sun 19 Jan 2014 16:44:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:44:59 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:45:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:45:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:45:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:45:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:45:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:45:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:45:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:45:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:45:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:45:10 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 16:45:10 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:45:10 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:45:10 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:45:10 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:45:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:45:11 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:45:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:45:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:45:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:45:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:45:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:45:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:45:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:45:12 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:45:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:45:13 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:45:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 16:45:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 16:45:13 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:45:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5760 values 90786 bits 11348 bytes 
Sun 19 Jan 2014 16:45:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:45:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43546446
Sun 19 Jan 2014 16:45:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:45:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:45:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43546446
Sun 19 Jan 2014 16:45:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:45:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:45:25 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:45:25 - job_xml_thread(): Done retrieving: data size 43546446
Sun 19 Jan 2014 16:45:25 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:45:25 - XML: Start document: iteration 3
Sun 19 Jan 2014 16:45:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:45:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:45:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:45:28 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:45:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:45:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:45:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:45:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:45:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:45:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:45:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:45:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:45:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:45:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:45:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:45:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:45:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:45:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:45:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:45:35 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 16:45:35 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:45:35 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:45:35 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:45:35 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:45:38 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:45:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 16:45:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:45:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:45:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567854
Sun 19 Jan 2014 16:45:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:45:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567854
Sun 19 Jan 2014 16:45:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:45:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:45:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:45:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:45:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:45:50 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:45:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:45:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:45:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:45:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:45:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:45:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:45:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:45:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:45:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:45:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:45:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:45:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:45:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:45:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:45:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:45:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:45:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:45:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:45:59 - job_xml_thread(): Done retrieving: data size 43568993
Sun 19 Jan 2014 16:45:59 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:45:59 - XML: Start document: iteration 4
Sun 19 Jan 2014 16:46:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568993
Sun 19 Jan 2014 16:46:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568993
Sun 19 Jan 2014 16:46:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:46:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:46:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:46:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:46:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:46:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:46:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:46:13 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:46:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:46:14 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:46:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 16:46:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 16:46:14 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:46:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7464 values 117722 bits 14715 bytes 
Sun 19 Jan 2014 16:46:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:46:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:46:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:46:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:46:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:46:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:46:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:46:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:46:18 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 16:46:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:46:18 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:46:18 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:46:18 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:46:18 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:46:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:46:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:46:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:46:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:46:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:46:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:46:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:46:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:46:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:46:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583885
Sun 19 Jan 2014 16:46:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:46:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583885
Sun 19 Jan 2014 16:46:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:46:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:46:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:46:33 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:46:33 - job_xml_thread(): Done retrieving: data size 43583885
Sun 19 Jan 2014 16:46:33 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:46:33 - XML: Start document: iteration 5
Sun 19 Jan 2014 16:46:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:46:36 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:46:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:46:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:46:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:46:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:46:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:46:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:46:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:46:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:46:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:46:49 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 16:46:49 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:46:49 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:46:49 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:46:49 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:46:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:46:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:46:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:46:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:46:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:46:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:46:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:46:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:46:50 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:46:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 16:46:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:46:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:46:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:46:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:46:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553554
Sun 19 Jan 2014 16:46:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:46:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553554
Sun 19 Jan 2014 16:46:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:47:04 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:47:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:47:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:47:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:47:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:47:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:47:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:47:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:47:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:47:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:47:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:47:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:47:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:47:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:47:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:47:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:47:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:47:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:47:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:47:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:47:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:47:11 - job_xml_thread(): Done retrieving: data size 43526343
Sun 19 Jan 2014 16:47:11 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:47:11 - XML: Start document: iteration 6
Sun 19 Jan 2014 16:47:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43526343
Sun 19 Jan 2014 16:47:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43526343
Sun 19 Jan 2014 16:47:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:47:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:47:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:47:16 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:47:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:47:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 16:47:17 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:47:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8915 values 140889 bits 17611 bytes 
Sun 19 Jan 2014 16:47:17 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:47:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 16:47:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:47:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:47:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:47:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:47:28 - XML: Processed 652600 elements - found 0 jobs
Sun 19 Jan 2014 16:47:28 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:47:28 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:47:28 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:47:28 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:47:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:47:31 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:47:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:47:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:47:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:47:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:47:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:47:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:47:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:47:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:47:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:47:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:47:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:47:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:47:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:47:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:47:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:47:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:47:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43011723
Sun 19 Jan 2014 16:47:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:47:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43011723
Sun 19 Jan 2014 16:47:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:47:43 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:47:44 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:47:44 - job_xml_thread(): Done retrieving: data size 43011723
Sun 19 Jan 2014 16:47:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 16:47:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:47:45 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:47:45 - XML: Start document: iteration 7
Sun 19 Jan 2014 16:47:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:47:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:47:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:47:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:47:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:47:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:47:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:47:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:47:55 - XML: Processed 646382 elements - found 0 jobs
Sun 19 Jan 2014 16:47:55 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:47:55 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:47:55 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:47:55 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:47:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:47:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:47:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:47:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:47:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:47:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:47:59 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:48:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:48:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:48:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:48:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:48:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:48:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:48:00 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 16:48:00 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 16:48:00 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:48:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:48:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42907409
Sun 19 Jan 2014 16:48:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:48:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42907409
Sun 19 Jan 2014 16:48:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:48:10 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:48:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:48:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:48:11 - job_xml_thread(): Done retrieving: data size 42907409
Sun 19 Jan 2014 16:48:11 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:48:11 - XML: Start document: iteration 8
Sun 19 Jan 2014 16:48:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:48:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:48:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:48:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:48:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:48:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:48:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:48:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:48:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:48:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:48:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:48:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:48:18 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:48:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:48:18 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:48:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:48:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:48:19 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:48:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 16:48:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:48:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 16:48:19 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:48:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6243 values 98720 bits 12340 bytes 
Sun 19 Jan 2014 16:48:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:48:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:48:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:48:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:48:23 - XML: Processed 645150 elements - found 0 jobs
Sun 19 Jan 2014 16:48:23 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:48:23 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:48:23 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:48:23 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:48:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:48:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42984954
Sun 19 Jan 2014 16:48:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:48:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42984954
Sun 19 Jan 2014 16:48:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:48:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:48:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:48:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:48:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:48:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:48:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:48:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:48:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:48:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:48:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:48:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:48:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:48:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42984954
Sun 19 Jan 2014 16:48:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:48:38 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:48:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:48:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:48:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:48:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:48:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:48:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:48:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:48:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:48:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:48:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:48:47 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:48:47 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:48:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 16:48:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:48:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:48:49 - job_xml_thread(): Done retrieving: data size 43514788
Sun 19 Jan 2014 16:48:49 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:48:49 - XML: Start document: iteration 9
Sun 19 Jan 2014 16:48:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43514788
Sun 19 Jan 2014 16:48:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:48:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:48:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:48:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:48:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:48:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:48:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:48:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43514788
Sun 19 Jan 2014 16:48:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:49:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:49:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:49:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:49:06 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:49:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:49:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:49:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:49:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:49:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:49:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:49:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:49:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:49:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:49:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:49:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:49:11 - XML: Processed 652780 elements - found 0 jobs
Sun 19 Jan 2014 16:49:11 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:49:11 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:49:11 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:49:11 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:49:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:49:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:49:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:49:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:49:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:49:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584333
Sun 19 Jan 2014 16:49:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:49:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584333
Sun 19 Jan 2014 16:49:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:49:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:49:20 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:49:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:49:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:49:22 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:49:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 16:49:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:49:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 16:49:23 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:49:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9135 values 144223 bits 18027 bytes 
Sun 19 Jan 2014 16:49:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:49:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:49:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:49:26 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:49:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:49:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:49:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:49:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:49:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:49:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:49:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:49:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:49:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:49:28 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:49:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:49:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:49:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:49:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:49:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:49:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:49:30 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:49:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 16:49:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:49:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:49:31 - job_xml_thread(): Done retrieving: data size 43570773
Sun 19 Jan 2014 16:49:31 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:49:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570773
Sun 19 Jan 2014 16:49:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:49:31 - XML: Start document: iteration 10
Sun 19 Jan 2014 16:49:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570773
Sun 19 Jan 2014 16:49:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:49:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:49:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:49:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:49:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:49:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:49:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:49:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:49:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:49:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:49:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:49:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:49:52 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 16:49:52 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:49:52 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:49:52 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:49:52 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:49:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:49:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:49:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:49:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:49:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:49:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:49:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:49:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:49:55 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 16:49:55 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:49:55 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:49:55 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 16:49:55 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:49:55 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 16:49:55 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 16:49:56 - size of cluster 'LISA Cluster': 624 hosts 79470 metrics 737697 values 11649448 bits 1456181 bytes 
Sun 19 Jan 2014 16:49:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:49:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561739
Sun 19 Jan 2014 16:49:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:49:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:49:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561739
Sun 19 Jan 2014 16:49:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:49:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:50:07 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:50:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:50:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:50:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:50:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:50:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:50:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:50:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:50:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:50:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:50:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:50:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:50:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:50:14 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:50:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:50:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:50:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:50:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:50:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:50:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:50:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:50:19 - job_xml_thread(): Done retrieving: data size 43553889
Sun 19 Jan 2014 16:50:19 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:50:19 - XML: Start document: iteration 11
Sun 19 Jan 2014 16:50:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553889
Sun 19 Jan 2014 16:50:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:50:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553889
Sun 19 Jan 2014 16:50:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:50:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:50:23 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:50:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:50:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 16:50:26 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:50:26 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:50:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 16:50:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8183 values 129084 bits 16135 bytes 
Sun 19 Jan 2014 16:50:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:50:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:50:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:50:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:50:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:50:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:50:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:50:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:50:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:50:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:50:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:50:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:50:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:50:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:50:37 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:50:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:50:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:50:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:50:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:50:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:50:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:50:40 - XML: Processed 653348 elements - found 0 jobs
Sun 19 Jan 2014 16:50:40 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:50:40 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:50:40 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:50:40 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:50:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:50:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43593673
Sun 19 Jan 2014 16:50:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:50:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43593673
Sun 19 Jan 2014 16:50:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:50:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:50:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:50:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:50:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:50:55 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:50:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:50:55 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:50:55 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 16:50:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:50:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:50:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:50:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:50:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:50:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:50:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:50:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:50:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:50:59 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:50:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:50:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:50:59 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:50:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 16:50:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:50:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:50:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:50:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:50:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:51:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:51:04 - job_xml_thread(): Done retrieving: data size 43560410
Sun 19 Jan 2014 16:51:04 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:51:04 - XML: Start document: iteration 12
Sun 19 Jan 2014 16:51:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560410
Sun 19 Jan 2014 16:51:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:51:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560410
Sun 19 Jan 2014 16:51:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:51:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:51:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:51:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:51:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:51:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:51:19 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:51:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:51:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:51:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:51:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:51:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:51:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:51:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:51:22 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 16:51:22 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:51:22 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:51:22 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:51:22 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:51:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:51:26 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:51:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:51:27 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:51:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 16:51:27 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:51:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 16:51:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5812 values 91662 bits 11457 bytes 
Sun 19 Jan 2014 16:51:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:51:28 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:51:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:51:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:51:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:51:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:51:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:51:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:51:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:51:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43551977
Sun 19 Jan 2014 16:51:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:51:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43551977
Sun 19 Jan 2014 16:51:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:51:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:51:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:51:37 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:51:37 - job_xml_thread(): Done retrieving: data size 43551977
Sun 19 Jan 2014 16:51:37 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:51:37 - XML: Start document: iteration 13
Sun 19 Jan 2014 16:51:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:51:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:51:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:51:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:51:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:51:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:51:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:51:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:51:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:51:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:51:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:51:51 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:51:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 16:51:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:51:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:51:52 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:51:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:51:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:51:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:51:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:51:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:51:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:51:55 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 16:51:55 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:51:55 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:51:55 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:51:55 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:51:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:51:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43590626
Sun 19 Jan 2014 16:51:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:51:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43590626
Sun 19 Jan 2014 16:52:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:52:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:52:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:52:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:52:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:52:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:52:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:52:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:52:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:52:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:52:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:52:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:52:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:52:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:52:10 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:52:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:52:15 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:52:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:52:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:52:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:52:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:52:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:52:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:52:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:52:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561551
Sun 19 Jan 2014 16:52:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:52:19 - job_xml_thread(): Done retrieving: data size 43561551
Sun 19 Jan 2014 16:52:19 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:52:19 - XML: Start document: iteration 14
Sun 19 Jan 2014 16:52:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561551
Sun 19 Jan 2014 16:52:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:52:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:52:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:52:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:52:27 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:52:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:52:29 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:52:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 16:52:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 16:52:29 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:52:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9059 values 142913 bits 17864 bytes 
Sun 19 Jan 2014 16:52:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:52:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:52:39 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 16:52:39 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:52:39 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:52:39 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:52:39 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:52:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:52:39 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:52:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:52:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:52:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:52:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:52:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:52:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:52:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:52:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:52:42 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:52:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:52:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:52:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:52:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:52:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:52:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:52:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:52:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576759
Sun 19 Jan 2014 16:52:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:52:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576759
Sun 19 Jan 2014 16:52:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:52:54 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:52:54 - job_xml_thread(): Done retrieving: data size 43576759
Sun 19 Jan 2014 16:52:54 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:52:54 - XML: Start document: iteration 15
Sun 19 Jan 2014 16:52:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:52:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:52:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:52:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:53:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:53:01 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:53:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:53:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:53:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:53:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:53:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:53:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:53:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:53:05 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 16:53:05 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:53:05 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:53:05 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:53:05 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:53:06 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:53:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 16:53:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:53:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:53:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:53:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:53:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:53:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:53:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:53:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:53:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:53:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:53:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577712
Sun 19 Jan 2014 16:53:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:53:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577712
Sun 19 Jan 2014 16:53:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:53:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:53:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:53:20 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:53:20 - job_xml_thread(): Done retrieving: data size 43577712
Sun 19 Jan 2014 16:53:20 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:53:20 - XML: Start document: iteration 16
Sun 19 Jan 2014 16:53:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:53:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:53:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:53:29 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:53:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:53:30 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:53:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 16:53:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 16:53:30 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:53:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5977 values 94312 bits 11789 bytes 
Sun 19 Jan 2014 16:53:32 - XML: Processed 653322 elements - found 0 jobs
Sun 19 Jan 2014 16:53:32 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:53:32 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:53:32 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:53:32 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:53:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:53:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:53:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:53:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:53:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:53:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:53:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:53:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:53:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:53:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:53:37 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:53:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:53:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:53:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:53:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:53:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:53:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:53:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:53:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43010677
Sun 19 Jan 2014 16:53:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:53:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43010677
Sun 19 Jan 2014 16:53:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:53:47 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:53:47 - job_xml_thread(): Done retrieving: data size 43010677
Sun 19 Jan 2014 16:53:47 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:53:47 - XML: Start document: iteration 17
Sun 19 Jan 2014 16:53:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:53:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:53:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:53:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:53:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:53:58 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:53:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:53:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:53:59 - XML: Processed 646188 elements - found 0 jobs
Sun 19 Jan 2014 16:53:59 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:53:59 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:53:59 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:53:59 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:53:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:53:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:53:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:53:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:53:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:54:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:54:04 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:54:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:54:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:54:04 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:54:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 16:54:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:54:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:54:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:54:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:54:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:54:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:54:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42904606
Sun 19 Jan 2014 16:54:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:54:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42904606
Sun 19 Jan 2014 16:54:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:54:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:54:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:54:15 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:54:15 - job_xml_thread(): Done retrieving: data size 42904606
Sun 19 Jan 2014 16:54:15 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:54:15 - XML: Start document: iteration 18
Sun 19 Jan 2014 16:54:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:54:18 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:54:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:54:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:54:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:54:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:54:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:54:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:54:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:54:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:54:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:54:30 - XML: Processed 645150 elements - found 0 jobs
Sun 19 Jan 2014 16:54:30 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:54:30 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:54:30 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:54:30 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:54:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:54:31 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:54:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:54:31 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:54:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:54:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:54:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:54:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 16:54:31 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:54:31 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:54:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5839 values 92060 bits 11507 bytes 
Sun 19 Jan 2014 16:54:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 16:54:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:54:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:54:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:54:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:54:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:54:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:54:34 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 16:54:34 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 16:54:34 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:54:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:54:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43355917
Sun 19 Jan 2014 16:54:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:54:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43355917
Sun 19 Jan 2014 16:54:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:54:45 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:54:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:54:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:54:45 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:54:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:54:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:54:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:54:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:54:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:54:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:54:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:54:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:54:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:54:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:54:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:54:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:54:51 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:54:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 16:54:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:54:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:54:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:54:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:54:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:54:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:54:52 - job_xml_thread(): Done retrieving: data size 43534438
Sun 19 Jan 2014 16:54:52 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:54:52 - XML: Start document: iteration 19
Sun 19 Jan 2014 16:54:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43534438
Sun 19 Jan 2014 16:54:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43534438
Sun 19 Jan 2014 16:54:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:54:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:55:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:55:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:55:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:55:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:55:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:55:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:55:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:55:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:55:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:55:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:55:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:55:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:55:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:55:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:55:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:55:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:55:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:55:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:55:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:55:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:55:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:55:13 - XML: Processed 652914 elements - found 0 jobs
Sun 19 Jan 2014 16:55:13 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:55:13 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:55:13 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:55:13 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:55:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:55:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572734
Sun 19 Jan 2014 16:55:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:55:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572734
Sun 19 Jan 2014 16:55:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:55:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:55:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:55:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:55:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:55:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:55:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:55:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:55:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:55:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:55:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:55:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:55:28 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:55:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:55:29 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:55:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:55:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:55:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:55:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:55:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:55:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:55:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:55:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572138
Sun 19 Jan 2014 16:55:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:55:30 - job_xml_thread(): Done retrieving: data size 43572138
Sun 19 Jan 2014 16:55:30 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:55:30 - XML: Start document: iteration 20
Sun 19 Jan 2014 16:55:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572138
Sun 19 Jan 2014 16:55:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:55:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:55:32 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:55:33 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:55:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 16:55:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:55:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 16:55:33 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:55:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 10390 values 163847 bits 20480 bytes 
Sun 19 Jan 2014 16:55:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:55:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:55:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:55:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:55:48 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 16:55:48 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:55:48 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:55:48 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:55:49 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:55:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:55:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:55:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:55:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:55:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:55:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:55:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:55:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:55:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:55:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:55:53 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:55:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:55:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:55:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:55:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:55:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:55:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:55:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:55:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43599636
Sun 19 Jan 2014 16:55:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:55:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43599636
Sun 19 Jan 2014 16:55:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:56:04 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:56:04 - job_xml_thread(): Done retrieving: data size 43599636
Sun 19 Jan 2014 16:56:05 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:56:05 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 16:56:05 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 16:56:06 - Housekeeping: done.
Sun 19 Jan 2014 16:56:06 - XML: Start document: iteration 0
Sun 19 Jan 2014 16:56:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:56:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:56:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:56:07 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:56:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:56:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:56:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:56:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:56:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:56:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:56:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:56:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:56:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:56:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:56:18 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:56:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:56:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:56:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:56:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:56:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:56:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:56:19 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 16:56:19 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:56:19 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:56:19 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:56:19 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:56:20 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:56:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 16:56:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:56:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:56:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43548228
Sun 19 Jan 2014 16:56:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:56:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43548228
Sun 19 Jan 2014 16:56:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:56:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:56:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:56:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:56:33 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:56:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:56:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:56:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:56:35 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:56:35 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:56:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 16:56:35 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:56:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:56:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 16:56:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5832 values 91981 bits 11497 bytes 
Sun 19 Jan 2014 16:56:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:56:37 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:56:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:56:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:56:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:56:37 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:56:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:56:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:56:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:56:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:56:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:56:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:56:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:56:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:56:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:56:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:56:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:56:40 - job_xml_thread(): Done retrieving: data size 43601027
Sun 19 Jan 2014 16:56:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43601027
Sun 19 Jan 2014 16:56:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:56:40 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:56:40 - XML: Start document: iteration 1
Sun 19 Jan 2014 16:56:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43601027
Sun 19 Jan 2014 16:56:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:56:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:56:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:56:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:56:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:56:56 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 16:56:56 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:56:57 - XML: Processed 653348 elements - found 0 jobs
Sun 19 Jan 2014 16:56:57 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:56:57 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:56:57 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:56:57 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:56:58 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:56:58 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:56:58 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 16:56:58 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 16:56:58 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 16:57:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:57:00 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:57:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:57:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:57:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:57:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:57:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:57:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:57:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:57:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:57:04 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:57:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:57:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:57:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:57:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:57:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:57:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:57:05 - size of cluster 'LISA Cluster': 624 hosts 79483 metrics 779243 values 12284680 bits 1535585 bytes 
Sun 19 Jan 2014 16:57:05 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:57:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 16:57:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:57:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:57:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580228
Sun 19 Jan 2014 16:57:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:57:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580228
Sun 19 Jan 2014 16:57:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:57:12 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:57:12 - job_xml_thread(): Done retrieving: data size 43580228
Sun 19 Jan 2014 16:57:12 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:57:12 - XML: Start document: iteration 2
Sun 19 Jan 2014 16:57:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:57:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:57:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:57:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:57:29 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 16:57:29 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:57:29 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:57:29 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:57:29 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:57:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:57:29 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:57:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:57:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:57:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:57:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:57:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:57:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:57:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:57:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:57:32 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:57:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:57:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:57:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:57:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:57:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:57:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:57:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:57:35 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:57:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:57:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577405
Sun 19 Jan 2014 16:57:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:57:36 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:57:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:57:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 16:57:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 16:57:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577405
Sun 19 Jan 2014 16:57:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:57:37 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:57:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9045 values 142679 bits 17834 bytes 
Sun 19 Jan 2014 16:57:44 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:57:44 - job_xml_thread(): Done retrieving: data size 43577405
Sun 19 Jan 2014 16:57:44 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:57:44 - XML: Start document: iteration 3
Sun 19 Jan 2014 16:57:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:57:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:57:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:57:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:57:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:57:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:57:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:57:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:57:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:57:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:57:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:57:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:57:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:57:57 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 16:57:57 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:57:57 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:57:57 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:57:57 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:57:58 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:57:58 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 16:57:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:57:59 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:57:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:57:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:58:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:58:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:58:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:58:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:58:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:58:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555764
Sun 19 Jan 2014 16:58:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:58:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555764
Sun 19 Jan 2014 16:58:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:58:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:58:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:58:12 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:58:12 - job_xml_thread(): Done retrieving: data size 43555764
Sun 19 Jan 2014 16:58:12 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:58:12 - XML: Start document: iteration 4
Sun 19 Jan 2014 16:58:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:58:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:58:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:58:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:58:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:58:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:58:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:58:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:58:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:58:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:58:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:58:26 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 16:58:26 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:58:26 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:58:26 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:58:26 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:58:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:58:27 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:58:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:58:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:58:27 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:58:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 16:58:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:58:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:58:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:58:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:58:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:58:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:58:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565545
Sun 19 Jan 2014 16:58:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:58:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565545
Sun 19 Jan 2014 16:58:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:58:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:58:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:58:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:58:37 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:58:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:58:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 16:58:38 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:58:38 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:58:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 16:58:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5690 values 89711 bits 11213 bytes 
Sun 19 Jan 2014 16:58:41 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:58:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:58:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:58:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:58:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:58:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:58:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:58:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:58:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:58:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:58:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:58:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:58:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:58:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:58:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:58:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:58:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:58:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:58:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:58:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:58:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:58:50 - job_xml_thread(): Done retrieving: data size 43572219
Sun 19 Jan 2014 16:58:50 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:58:50 - XML: Start document: iteration 5
Sun 19 Jan 2014 16:58:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572219
Sun 19 Jan 2014 16:58:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:58:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572219
Sun 19 Jan 2014 16:58:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:58:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:58:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:59:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:59:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:59:11 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 16:59:11 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:59:11 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:59:11 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:59:11 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:59:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:59:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:59:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:59:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:59:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:59:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:59:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:59:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:59:13 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:59:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 16:59:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:59:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:59:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:59:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:59:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:59:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:59:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:59:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:59:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:59:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:59:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:59:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43497471
Sun 19 Jan 2014 16:59:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:59:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43497471
Sun 19 Jan 2014 16:59:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:59:27 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:59:27 - job_xml_thread(): Done retrieving: data size 43497471
Sun 19 Jan 2014 16:59:27 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:59:27 - XML: Start document: iteration 6
Sun 19 Jan 2014 16:59:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:59:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:59:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:59:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:59:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:59:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:59:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:59:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:59:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:59:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 16:59:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:59:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 16:59:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 16:59:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:59:38 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:59:39 - XML: Processed 652600 elements - found 0 jobs
Sun 19 Jan 2014 16:59:39 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 16:59:39 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 16:59:39 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:59:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 16:59:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 16:59:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 16:59:39 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:59:39 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 16:59:39 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 16:59:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5917 values 93296 bits 11662 bytes 
Sun 19 Jan 2014 16:59:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 16:59:41 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 16:59:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 16:59:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 16:59:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:59:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 16:59:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 16:59:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 16:59:46 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 16:59:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 16:59:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 16:59:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 16:59:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42962643
Sun 19 Jan 2014 16:59:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 16:59:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42962643
Sun 19 Jan 2014 16:59:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 16:59:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 16:59:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:59:54 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 16:59:55 - job_xml_thread(): Done retrieving: data size 42962643
Sun 19 Jan 2014 16:59:55 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 16:59:55 - XML: Start document: iteration 7
Sun 19 Jan 2014 16:59:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 16:59:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 16:59:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 16:59:59 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 16:59:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 16:59:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:00:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:00:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:00:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:00:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:00:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:00:08 - XML: Processed 645968 elements - found 0 jobs
Sun 19 Jan 2014 17:00:08 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:00:08 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:00:08 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:00:08 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:00:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:00:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:00:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:00:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:00:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:00:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:00:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:00:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:00:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:00:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42910306
Sun 19 Jan 2014 17:00:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:00:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42910306
Sun 19 Jan 2014 17:00:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:00:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:00:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:00:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:00:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:00:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:00:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:00:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:00:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:00:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:00:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42910306
Sun 19 Jan 2014 17:00:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:00:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:00:23 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:00:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:00:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:00:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:00:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:00:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:00:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:00:34 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:00:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:00:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:00:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:00:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:00:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:00:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:00:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:00:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:00:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:00:37 - job_xml_thread(): Done retrieving: data size 43245963
Sun 19 Jan 2014 17:00:37 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:00:37 - XML: Start document: iteration 8
Sun 19 Jan 2014 17:00:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43245963
Sun 19 Jan 2014 17:00:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:00:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:00:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:00:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:00:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:00:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43245963
Sun 19 Jan 2014 17:00:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:00:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:00:39 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:00:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:00:41 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:00:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 17:00:41 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:00:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sun 19 Jan 2014 17:00:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:00:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:00:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:00:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:00:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:00:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:00:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:00:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:00:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:00:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:00:54 - XML: Processed 649592 elements - found 0 jobs
Sun 19 Jan 2014 17:00:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:00:54 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:00:55 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:00:55 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:00:55 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:00:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:00:57 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:00:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:00:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:00:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:00:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:00:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:00:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:01:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:01:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557527
Sun 19 Jan 2014 17:01:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:01:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557527
Sun 19 Jan 2014 17:01:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:01:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:01:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:01:10 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:01:10 - job_xml_thread(): Done retrieving: data size 43557527
Sun 19 Jan 2014 17:01:10 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:01:10 - XML: Start document: iteration 9
Sun 19 Jan 2014 17:01:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:01:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:01:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:01:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:01:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:01:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:01:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:01:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:01:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:01:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:01:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:01:23 - XML: Processed 653337 elements - found 0 jobs
Sun 19 Jan 2014 17:01:23 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:01:23 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:01:23 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:01:23 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:01:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:01:24 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:01:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:01:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:01:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:01:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:01:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:01:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:01:28 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 17:01:28 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 17:01:28 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:01:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:01:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43544625
Sun 19 Jan 2014 17:01:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:01:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43544625
Sun 19 Jan 2014 17:01:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:01:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:01:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:01:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:01:36 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:01:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:01:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:01:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:01:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:01:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:01:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:01:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43544625
Sun 19 Jan 2014 17:01:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:01:38 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:01:38 - job_xml_thread(): Done retrieving: data size 43544625
Sun 19 Jan 2014 17:01:38 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:01:38 - XML: Start document: iteration 10
Sun 19 Jan 2014 17:01:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:01:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:01:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:01:41 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:01:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:01:43 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:01:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 17:01:44 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:01:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 17:01:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 15700 values 247828 bits 30978 bytes 
Sun 19 Jan 2014 17:01:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:01:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:01:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:01:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:01:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:01:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:01:56 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:01:56 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:01:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:01:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:01:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:01:56 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:01:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:01:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:01:56 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:01:56 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:01:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:01:57 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:01:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:01:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:01:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:01:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:01:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:01:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:01:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:01:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584829
Sun 19 Jan 2014 17:01:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:02:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584829
Sun 19 Jan 2014 17:02:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:02:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:02:11 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:02:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:02:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:02:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:02:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:02:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:02:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:02:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:02:14 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:02:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:02:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:02:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:02:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:02:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:02:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:02:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:02:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:02:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:02:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:02:14 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:02:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 17:02:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:02:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:02:16 - job_xml_thread(): Done retrieving: data size 43570680
Sun 19 Jan 2014 17:02:16 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:02:16 - XML: Start document: iteration 11
Sun 19 Jan 2014 17:02:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570680
Sun 19 Jan 2014 17:02:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:02:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570680
Sun 19 Jan 2014 17:02:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:02:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:02:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:02:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:02:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:02:32 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:02:32 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:02:32 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:02:32 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:02:32 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:02:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:02:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:02:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:02:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:02:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:02:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:02:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:02:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:02:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:02:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:02:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:02:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:02:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:02:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:02:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:02:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:02:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:02:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:02:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43597178
Sun 19 Jan 2014 17:02:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:02:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43597178
Sun 19 Jan 2014 17:02:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:02:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:02:45 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:02:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:02:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 17:02:47 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:02:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8706 values 137651 bits 17206 bytes 
Sun 19 Jan 2014 17:02:47 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:02:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 17:02:47 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:02:47 - job_xml_thread(): Done retrieving: data size 43597178
Sun 19 Jan 2014 17:02:47 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:02:47 - XML: Start document: iteration 12
Sun 19 Jan 2014 17:02:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:02:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:02:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:02:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:02:56 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:02:56 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:02:56 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:02:56 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:02:56 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:02:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:02:57 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:02:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:02:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:02:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:02:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:02:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:02:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:02:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:03:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:03:00 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:03:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:03:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:03:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:03:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:03:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:03:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:03:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:03:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572420
Sun 19 Jan 2014 17:03:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:03:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572420
Sun 19 Jan 2014 17:03:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:03:11 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:03:12 - job_xml_thread(): Done retrieving: data size 43572420
Sun 19 Jan 2014 17:03:12 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:03:12 - XML: Start document: iteration 13
Sun 19 Jan 2014 17:03:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:03:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:03:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:03:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:03:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:03:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:03:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:03:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:03:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:03:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:03:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:03:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:03:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:03:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:03:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:03:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:03:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:03:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:03:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:03:25 - XML: Processed 653347 elements - found 0 jobs
Sun 19 Jan 2014 17:03:25 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:03:25 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:03:25 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:03:25 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:03:25 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:03:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 17:03:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:03:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:03:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564315
Sun 19 Jan 2014 17:03:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:03:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564315
Sun 19 Jan 2014 17:03:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:03:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:03:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:03:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:03:37 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:03:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:03:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:03:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:03:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:03:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:03:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:03:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:03:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:03:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:03:40 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:03:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:03:40 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:03:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:03:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:03:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:03:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:03:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:03:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:03:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:03:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583456
Sun 19 Jan 2014 17:03:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:03:43 - job_xml_thread(): Done retrieving: data size 43583456
Sun 19 Jan 2014 17:03:43 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:03:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583456
Sun 19 Jan 2014 17:03:43 - XML: Start document: iteration 14
Sun 19 Jan 2014 17:03:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:03:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:03:48 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:03:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:03:49 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:03:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 17:03:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 17:03:49 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:03:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8964 values 141608 bits 17701 bytes 
Sun 19 Jan 2014 17:03:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:03:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:03:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:03:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:03:58 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 17:03:58 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:03:59 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:03:59 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 17:03:59 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 17:03:59 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:03:59 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 17:04:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:04:03 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:04:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:04:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:04:04 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:04:04 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:04:04 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:04:04 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:04:04 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:04:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:04:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:04:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:04:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:04:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:04:06 - size of cluster 'LISA Cluster': 624 hosts 79474 metrics 778636 values 12299411 bits 1537426 bytes 
Sun 19 Jan 2014 17:04:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:04:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:04:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:04:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:04:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:04:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:04:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:04:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:04:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:04:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43594915
Sun 19 Jan 2014 17:04:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:04:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43594915
Sun 19 Jan 2014 17:04:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:04:19 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:04:19 - job_xml_thread(): Done retrieving: data size 43594915
Sun 19 Jan 2014 17:04:19 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:04:19 - XML: Start document: iteration 15
Sun 19 Jan 2014 17:04:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:04:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:04:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:04:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:04:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:04:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:04:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:04:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:04:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:04:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:04:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:04:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:04:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:04:33 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:04:33 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:04:33 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:04:33 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:04:33 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:04:33 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:04:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 17:04:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:04:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:04:35 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:04:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:04:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:04:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:04:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:04:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:04:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:04:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:04:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562974
Sun 19 Jan 2014 17:04:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:04:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562974
Sun 19 Jan 2014 17:04:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:04:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:04:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:04:48 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:04:48 - job_xml_thread(): Done retrieving: data size 43562974
Sun 19 Jan 2014 17:04:48 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:04:48 - XML: Start document: iteration 16
Sun 19 Jan 2014 17:04:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:04:49 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:04:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:04:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 17:04:50 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:04:50 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:04:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 17:04:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5903 values 93096 bits 11637 bytes 
Sun 19 Jan 2014 17:04:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:04:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:04:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:04:54 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:04:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:04:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:04:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:04:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:04:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:04:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:04:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:04:59 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:05:00 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 17:05:00 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:05:00 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:05:00 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:05:00 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:05:00 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:05:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:05:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:05:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:05:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:05:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:05:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:05:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:05:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:05:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:05:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565180
Sun 19 Jan 2014 17:05:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:05:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565180
Sun 19 Jan 2014 17:05:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:05:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:05:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:05:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:05:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:05:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:05:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:05:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:05:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:05:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565180
Sun 19 Jan 2014 17:05:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:05:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:05:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:05:15 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:05:15 - job_xml_thread(): Done retrieving: data size 43565180
Sun 19 Jan 2014 17:05:15 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:05:15 - XML: Start document: iteration 17
Sun 19 Jan 2014 17:05:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:05:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:05:17 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:05:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 17:05:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:05:29 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:05:29 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:05:29 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:05:29 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:05:29 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:05:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:05:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:05:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:05:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:05:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:05:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:05:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:05:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:05:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:05:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:05:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:05:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:05:35 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:05:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:05:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:05:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:05:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:05:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:05:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:05:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:05:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43033194
Sun 19 Jan 2014 17:05:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:05:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43033194
Sun 19 Jan 2014 17:05:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:05:44 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:05:44 - job_xml_thread(): Done retrieving: data size 43033194
Sun 19 Jan 2014 17:05:45 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:05:45 - XML: Start document: iteration 18
Sun 19 Jan 2014 17:05:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:05:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:05:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:05:50 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:05:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:05:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:05:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:05:51 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:05:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 17:05:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 17:05:51 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:05:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6270 values 98904 bits 12363 bytes 
Sun 19 Jan 2014 17:05:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:05:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:05:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:05:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:05:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:05:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:05:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:05:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:05:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:05:59 - XML: Processed 646589 elements - found 0 jobs
Sun 19 Jan 2014 17:05:59 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:05:59 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:05:59 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:05:59 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:06:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:06:01 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:06:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:06:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:06:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:06:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:06:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:06:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:06:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:06:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:06:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:06:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42889572
Sun 19 Jan 2014 17:06:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:06:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42889572
Sun 19 Jan 2014 17:06:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:06:14 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:06:15 - job_xml_thread(): Done retrieving: data size 42889572
Sun 19 Jan 2014 17:06:15 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:06:15 - XML: Start document: iteration 19
Sun 19 Jan 2014 17:06:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:06:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:06:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:06:27 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:06:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:06:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:06:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:06:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:06:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:06:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:06:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:06:29 - XML: Processed 645162 elements - found 0 jobs
Sun 19 Jan 2014 17:06:29 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:06:29 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:06:29 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:06:29 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:06:31 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:06:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 17:06:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:06:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:06:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:06:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:06:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:06:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:06:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:06:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:06:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:06:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:06:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43365414
Sun 19 Jan 2014 17:06:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:06:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43365414
Sun 19 Jan 2014 17:06:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:06:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:06:44 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:06:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:06:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:06:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:06:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:06:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:06:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:06:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43365414
Sun 19 Jan 2014 17:06:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:06:45 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:06:45 - job_xml_thread(): Done retrieving: data size 43365414
Sun 19 Jan 2014 17:06:45 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:06:45 - XML: Start document: iteration 20
Sun 19 Jan 2014 17:06:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:06:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:06:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:06:51 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:06:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:06:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 17:06:53 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:06:53 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:06:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 17:06:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:06:54 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:06:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5985 values 94422 bits 11802 bytes 
Sun 19 Jan 2014 17:06:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:06:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:07:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:07:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:07:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:07:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:07:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:07:05 - XML: Processed 650870 elements - found 0 jobs
Sun 19 Jan 2014 17:07:05 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:07:05 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:07:05 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:07:05 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:07:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:07:06 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:07:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:07:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:07:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:07:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:07:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:07:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:07:10 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:07:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 17:07:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:07:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:07:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565859
Sun 19 Jan 2014 17:07:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:07:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565859
Sun 19 Jan 2014 17:07:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:07:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:07:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:07:20 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:07:20 - job_xml_thread(): Done retrieving: data size 43565859
Sun 19 Jan 2014 17:07:20 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:07:20 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 17:07:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:07:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:07:21 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 17:07:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:07:21 - Housekeeping: done.
Sun 19 Jan 2014 17:07:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:07:21 - XML: Start document: iteration 0
Sun 19 Jan 2014 17:07:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:07:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:07:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:07:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:07:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:07:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:07:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:07:32 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:07:32 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:07:32 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:07:32 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:07:32 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:07:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:07:34 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:07:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:07:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:07:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:07:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:07:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:07:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:07:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:07:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:07:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:07:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43538652
Sun 19 Jan 2014 17:07:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:07:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43538652
Sun 19 Jan 2014 17:07:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:07:47 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:07:47 - job_xml_thread(): Done retrieving: data size 43538652
Sun 19 Jan 2014 17:07:47 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:07:47 - XML: Start document: iteration 1
Sun 19 Jan 2014 17:07:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:07:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:07:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:07:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:07:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:07:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:07:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:07:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:07:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:07:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:07:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:07:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:07:53 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:07:54 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:07:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 17:07:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:07:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 17:07:54 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:07:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99099 bits 12387 bytes 
Sun 19 Jan 2014 17:07:57 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:07:57 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:07:57 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:07:57 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:07:57 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:07:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:07:59 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:07:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:07:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:08:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:08:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:08:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:08:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:08:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:08:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43545647
Sun 19 Jan 2014 17:08:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:08:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43545647
Sun 19 Jan 2014 17:08:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:08:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:08:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:08:12 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:08:12 - job_xml_thread(): Done retrieving: data size 43545647
Sun 19 Jan 2014 17:08:12 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:08:12 - XML: Start document: iteration 2
Sun 19 Jan 2014 17:08:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:08:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:08:25 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:08:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 17:08:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:08:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:08:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:08:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:08:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:08:26 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:08:26 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:08:26 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:08:26 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:08:26 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:08:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:08:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:08:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:08:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:08:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:08:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:08:29 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:08:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:08:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:08:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:08:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:08:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:08:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:08:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:08:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569072
Sun 19 Jan 2014 17:08:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:08:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569072
Sun 19 Jan 2014 17:08:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:08:41 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:08:41 - job_xml_thread(): Done retrieving: data size 43569072
Sun 19 Jan 2014 17:08:41 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:08:41 - XML: Start document: iteration 3
Sun 19 Jan 2014 17:08:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:08:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:08:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:08:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:08:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:08:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:08:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:08:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:08:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:08:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:08:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:08:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:08:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:08:50 - XML: Processed 653346 elements - found 0 jobs
Sun 19 Jan 2014 17:08:50 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:08:50 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:08:50 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:08:50 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:08:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:08:53 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:08:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:08:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:08:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:08:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:08:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:08:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:08:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:08:54 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:08:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:08:55 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:08:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 17:08:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 17:08:55 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:08:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6091 values 96072 bits 12009 bytes 
Sun 19 Jan 2014 17:08:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:08:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567104
Sun 19 Jan 2014 17:08:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:08:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567104
Sun 19 Jan 2014 17:08:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:08:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:08:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:09:05 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:09:05 - job_xml_thread(): Done retrieving: data size 43567104
Sun 19 Jan 2014 17:09:05 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:09:05 - XML: Start document: iteration 4
Sun 19 Jan 2014 17:09:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:09:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:09:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:09:14 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:09:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:09:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:09:15 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:09:15 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:09:15 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:09:15 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:09:15 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:09:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:09:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:09:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:09:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:09:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:09:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:09:20 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:09:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:09:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:09:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:09:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:09:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:09:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:09:22 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:09:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 17:09:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:09:23 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 17:09:23 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 17:09:23 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:09:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:09:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571600
Sun 19 Jan 2014 17:09:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:09:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571600
Sun 19 Jan 2014 17:09:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:09:30 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:09:30 - job_xml_thread(): Done retrieving: data size 43571600
Sun 19 Jan 2014 17:09:30 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:09:30 - XML: Start document: iteration 5
Sun 19 Jan 2014 17:09:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:09:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:09:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:09:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:09:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:09:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:09:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:09:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:09:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:09:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:09:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:09:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:09:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:09:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:09:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:09:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:09:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:09:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:09:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:09:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:09:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:09:45 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:09:45 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:09:45 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:09:45 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:09:45 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:09:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:09:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579135
Sun 19 Jan 2014 17:09:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:09:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579135
Sun 19 Jan 2014 17:09:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:09:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:09:55 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:09:56 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:09:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:09:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 17:09:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 17:09:56 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:09:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7834 values 123494 bits 15436 bytes 
Sun 19 Jan 2014 17:09:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:09:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:09:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:09:59 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:09:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:09:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:09:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:09:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:09:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:09:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:09:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:09:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:09:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:10:00 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:10:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:10:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:10:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:10:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:10:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:10:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:10:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:10:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:10:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:10:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574756
Sun 19 Jan 2014 17:10:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:10:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574756
Sun 19 Jan 2014 17:10:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:10:05 - job_xml_thread(): Done retrieving: data size 43574756
Sun 19 Jan 2014 17:10:05 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:10:05 - XML: Start document: iteration 6
Sun 19 Jan 2014 17:10:13 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:10:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 17:10:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:10:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:10:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:10:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:10:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:10:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:10:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:10:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:10:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:10:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:10:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:10:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:10:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:10:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:10:24 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:10:24 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:10:24 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:10:24 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:10:24 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:10:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:10:26 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:10:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:10:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:10:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:10:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:10:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:10:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:10:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:10:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568443
Sun 19 Jan 2014 17:10:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:10:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568443
Sun 19 Jan 2014 17:10:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:10:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:10:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:10:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:10:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:10:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:10:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:10:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:10:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:10:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:10:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568443
Sun 19 Jan 2014 17:10:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:10:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:10:39 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:10:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:10:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:10:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:10:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:10:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:10:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:10:49 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:10:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:10:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:10:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:10:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:10:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:10:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:10:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:10:51 - job_xml_thread(): Done retrieving: data size 43546175
Sun 19 Jan 2014 17:10:51 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:10:51 - XML: Start document: iteration 7
Sun 19 Jan 2014 17:10:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43546175
Sun 19 Jan 2014 17:10:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:10:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:10:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:10:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:10:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:10:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:10:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:10:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43546175
Sun 19 Jan 2014 17:10:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:10:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:10:56 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:10:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:10:57 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:10:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 17:10:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 17:10:57 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:10:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9386 values 148068 bits 18508 bytes 
Sun 19 Jan 2014 17:11:00 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 17:11:00 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:11:03 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:11:03 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 17:11:03 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 17:11:03 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:11:03 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 17:11:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:11:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:11:05 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:11:05 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:11:05 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:11:05 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:11:05 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:11:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:11:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:11:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:11:11 - ganglia_parse_thread(): finished: Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sun 19 Jan 2014 17:11:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:11:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:11:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:11:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:11:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:11:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:11:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:11:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:11:14 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:11:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:11:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:11:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:11:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:11:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:11:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:11:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:11:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43517521
Sun 19 Jan 2014 17:11:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:11:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43517521
Sun 19 Jan 2014 17:11:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:11:20 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:11:21 - job_xml_thread(): Done retrieving: data size 43517521
Sun 19 Jan 2014 17:11:21 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:11:21 - XML: Start document: iteration 8
Sun 19 Jan 2014 17:11:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:11:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:11:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:11:29 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:11:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:11:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:11:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:11:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:11:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:11:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:11:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:11:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:11:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:11:36 - XML: Processed 652600 elements - found 0 jobs
Sun 19 Jan 2014 17:11:36 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:11:36 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:11:36 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:11:36 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:11:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:11:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:11:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:11:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:11:38 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:11:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 17:11:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:11:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:11:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:11:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:11:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:11:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:11:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43026639
Sun 19 Jan 2014 17:11:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:11:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43026639
Sun 19 Jan 2014 17:11:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:11:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:11:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:11:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:11:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:11:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:11:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:11:51 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:11:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:11:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:11:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:11:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:11:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:11:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:11:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:11:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:11:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:11:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:11:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:11:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:11:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:11:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:11:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:11:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:11:55 - job_xml_thread(): Done retrieving: data size 42936784
Sun 19 Jan 2014 17:11:55 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:11:55 - XML: Start document: iteration 9
Sun 19 Jan 2014 17:11:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42936784
Sun 19 Jan 2014 17:11:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42936784
Sun 19 Jan 2014 17:11:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:11:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:11:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:11:58 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:11:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:11:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 17:11:58 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:11:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 17:11:59 - Entering storeMetrics(): cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sun 19 Jan 2014 17:12:03 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:12:04 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:12:06 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:12:06 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 17:12:06 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 17:12:06 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:12:06 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 17:12:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:12:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:12:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:12:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:12:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:12:13 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:12:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:12:14 - XML: Processed 645192 elements - found 0 jobs
Sun 19 Jan 2014 17:12:14 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:12:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:12:14 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:12:15 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:12:15 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:12:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:12:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:12:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:12:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:12:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:12:16 - size of cluster 'LISA Cluster': 624 hosts 79470 metrics 784494 values 12362932 bits 1545366 bytes 
Sun 19 Jan 2014 17:12:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:12:19 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:12:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:12:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:12:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:12:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:12:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:12:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:12:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:12:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42973903
Sun 19 Jan 2014 17:12:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:12:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42973903
Sun 19 Jan 2014 17:12:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:12:30 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:12:30 - job_xml_thread(): Done retrieving: data size 42973903
Sun 19 Jan 2014 17:12:30 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:12:30 - XML: Start document: iteration 10
Sun 19 Jan 2014 17:12:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:12:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:12:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:12:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:12:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:12:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:12:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:12:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:12:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:12:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:12:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:12:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:12:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:12:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:12:42 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:12:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:12:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:12:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:12:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:12:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:12:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:12:45 - XML: Processed 645900 elements - found 0 jobs
Sun 19 Jan 2014 17:12:45 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:12:45 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:12:45 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:12:45 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:12:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:12:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43492114
Sun 19 Jan 2014 17:12:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:12:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43492114
Sun 19 Jan 2014 17:12:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:12:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:12:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:12:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:12:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:13:00 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:13:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:13:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:13:00 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:13:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:13:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:13:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 17:13:01 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:13:01 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:13:01 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:13:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 17:13:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:13:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:13:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 15055 values 237370 bits 29671 bytes 
Sun 19 Jan 2014 17:13:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:13:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:13:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:13:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:13:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:13:04 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:13:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:13:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:13:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:13:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:13:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:13:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:13:06 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:13:06 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 17:13:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:13:10 - job_xml_thread(): Done retrieving: data size 43564161
Sun 19 Jan 2014 17:13:10 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:13:10 - XML: Start document: iteration 11
Sun 19 Jan 2014 17:13:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564161
Sun 19 Jan 2014 17:13:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:13:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564161
Sun 19 Jan 2014 17:13:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:13:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:13:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:13:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:13:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:13:28 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:13:28 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:13:28 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:13:28 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:13:28 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:13:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:13:29 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:13:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:13:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:13:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:13:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:13:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:13:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:13:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:13:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:13:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:13:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:13:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:13:33 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:13:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 17:13:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:13:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:13:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:13:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:13:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:13:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:13:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569110
Sun 19 Jan 2014 17:13:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:13:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569110
Sun 19 Jan 2014 17:13:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:13:44 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:13:44 - job_xml_thread(): Done retrieving: data size 43569110
Sun 19 Jan 2014 17:13:44 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:13:44 - XML: Start document: iteration 12
Sun 19 Jan 2014 17:13:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:13:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:13:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:13:46 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:13:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:13:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:13:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:13:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:13:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:13:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:13:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:13:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:13:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:13:58 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:13:58 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:13:58 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:13:58 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:13:58 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:14:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:14:00 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:14:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:14:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:14:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:14:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:14:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:14:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:14:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:14:01 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:14:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:14:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 17:14:01 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:14:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5957 values 93966 bits 11745 bytes 
Sun 19 Jan 2014 17:14:02 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:14:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 17:14:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:14:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43547914
Sun 19 Jan 2014 17:14:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:14:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43547914
Sun 19 Jan 2014 17:14:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:14:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:14:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:14:13 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:14:13 - job_xml_thread(): Done retrieving: data size 43547914
Sun 19 Jan 2014 17:14:13 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:14:13 - XML: Start document: iteration 13
Sun 19 Jan 2014 17:14:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:14:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:14:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:14:18 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:14:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:14:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:14:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:14:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:14:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:14:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:14:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:14:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:14:26 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:14:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:14:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:14:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:14:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:14:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:14:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:14:28 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:14:28 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:14:28 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:14:28 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:14:28 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:14:31 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:14:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 17:14:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:14:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:14:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569360
Sun 19 Jan 2014 17:14:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:14:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569360
Sun 19 Jan 2014 17:14:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:14:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:14:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:14:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:14:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:14:43 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:14:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:14:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:14:45 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:14:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:14:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:14:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:14:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:14:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:14:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:14:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:14:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:14:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:14:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:14:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:14:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:14:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:14:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:14:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:14:50 - job_xml_thread(): Done retrieving: data size 43567836
Sun 19 Jan 2014 17:14:50 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:14:50 - XML: Start document: iteration 14
Sun 19 Jan 2014 17:14:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567836
Sun 19 Jan 2014 17:14:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567836
Sun 19 Jan 2014 17:14:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:14:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:15:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:15:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:15:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:15:02 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:15:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:15:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:15:03 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:15:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:15:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 17:15:03 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:15:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 17:15:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7394 values 116593 bits 14574 bytes 
Sun 19 Jan 2014 17:15:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:15:10 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:15:10 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:15:10 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:15:10 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:15:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:15:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:15:10 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:15:10 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:15:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:15:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:15:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:15:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:15:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:15:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:15:14 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:15:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:15:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:15:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:15:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:15:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:15:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:15:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:15:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574590
Sun 19 Jan 2014 17:15:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:15:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574590
Sun 19 Jan 2014 17:15:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:15:25 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:15:25 - job_xml_thread(): Done retrieving: data size 43574590
Sun 19 Jan 2014 17:15:25 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:15:25 - XML: Start document: iteration 15
Sun 19 Jan 2014 17:15:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:15:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:15:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:15:28 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:15:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:15:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:15:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:15:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:15:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:15:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:15:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:15:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:15:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:15:30 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:15:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 17:15:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:15:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:15:40 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:15:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:15:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:15:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:15:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:15:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:15:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:15:41 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:15:41 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:15:41 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:15:41 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:15:41 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:15:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:15:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:15:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:15:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557381
Sun 19 Jan 2014 17:15:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:15:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557381
Sun 19 Jan 2014 17:15:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:15:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:15:54 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:15:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:15:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:15:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:15:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:15:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:15:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:15:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:15:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:15:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:15:57 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:16:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:16:00 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:16:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:16:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:16:00 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 17:16:00 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 17:16:00 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:16:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:16:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:16:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:16:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:16:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:16:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43585468
Sun 19 Jan 2014 17:16:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:16:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43585468
Sun 19 Jan 2014 17:16:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:16:02 - job_xml_thread(): Done retrieving: data size 43585468
Sun 19 Jan 2014 17:16:02 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:16:02 - XML: Start document: iteration 16
Sun 19 Jan 2014 17:16:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:16:03 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:16:06 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:16:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 17:16:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:16:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 17:16:06 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:16:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9296 values 146682 bits 18335 bytes 
Sun 19 Jan 2014 17:16:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:16:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:16:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:16:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:16:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:16:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:16:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:16:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:16:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:16:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:16:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:16:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:16:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:16:19 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:16:19 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:16:19 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:16:19 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:16:19 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:16:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:16:20 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:16:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:16:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:16:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:16:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:16:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:16:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:16:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:16:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560000
Sun 19 Jan 2014 17:16:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:16:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560000
Sun 19 Jan 2014 17:16:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:16:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:16:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:16:34 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:16:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:16:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:16:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:16:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:16:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:16:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:16:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:16:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:16:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:16:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:16:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:16:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:16:39 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:16:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:16:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:16:39 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:16:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 17:16:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:16:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:16:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:16:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:16:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:16:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:16:41 - job_xml_thread(): Done retrieving: data size 43584446
Sun 19 Jan 2014 17:16:41 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:16:41 - XML: Start document: iteration 17
Sun 19 Jan 2014 17:16:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584446
Sun 19 Jan 2014 17:16:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584446
Sun 19 Jan 2014 17:16:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:16:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:16:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:16:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:16:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:16:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:16:55 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:16:55 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:16:55 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:16:55 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:16:55 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:16:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:16:58 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:16:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:16:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:16:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:16:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:16:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:16:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:16:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:17:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:17:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:17:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:17:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:17:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:17:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:17:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:17:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:17:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:17:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578203
Sun 19 Jan 2014 17:17:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:17:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578203
Sun 19 Jan 2014 17:17:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:17:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:17:06 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:17:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:17:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 17:17:06 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:17:06 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:17:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 17:17:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8714 values 137792 bits 17224 bytes 
Sun 19 Jan 2014 17:17:10 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:17:10 - job_xml_thread(): Done retrieving: data size 43578203
Sun 19 Jan 2014 17:17:10 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:17:10 - XML: Start document: iteration 18
Sun 19 Jan 2014 17:17:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:17:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:17:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:17:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:17:21 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:17:21 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:17:21 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:17:21 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:17:21 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:17:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:17:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:17:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:17:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:17:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:17:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:17:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:17:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:17:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:17:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:17:27 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:17:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:17:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:17:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:17:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:17:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:17:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:17:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:17:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43319107
Sun 19 Jan 2014 17:17:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:17:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43319107
Sun 19 Jan 2014 17:17:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:17:36 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:17:36 - job_xml_thread(): Done retrieving: data size 43319107
Sun 19 Jan 2014 17:17:36 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:17:36 - XML: Start document: iteration 19
Sun 19 Jan 2014 17:17:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:17:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:17:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:17:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:17:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:17:43 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:17:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:17:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:17:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:17:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:17:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:17:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:17:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:17:48 - XML: Processed 649926 elements - found 0 jobs
Sun 19 Jan 2014 17:17:48 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:17:48 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:17:48 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:17:48 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:17:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:17:51 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:17:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:17:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:17:51 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:17:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 17:17:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:17:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:17:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:17:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:17:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:17:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:17:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42935988
Sun 19 Jan 2014 17:17:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:17:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42935988
Sun 19 Jan 2014 17:17:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:18:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:18:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:18:03 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:18:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:18:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:18:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:18:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:18:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:18:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:18:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:18:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:18:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:18:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:18:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:18:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:18:07 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:18:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:18:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 17:18:07 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:18:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 17:18:07 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:18:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5676 values 89704 bits 11213 bytes 
Sun 19 Jan 2014 17:18:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:18:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:18:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:18:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:18:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:18:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:18:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:18:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:18:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:18:11 - job_xml_thread(): Done retrieving: data size 42916520
Sun 19 Jan 2014 17:18:11 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:18:11 - XML: Start document: iteration 20
Sun 19 Jan 2014 17:18:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42916520
Sun 19 Jan 2014 17:18:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42916520
Sun 19 Jan 2014 17:18:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:18:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:18:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:18:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:18:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:18:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:18:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:18:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:18:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:18:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:18:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:18:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:18:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:18:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:18:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:18:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:18:34 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:18:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:18:34 - XML: Processed 645150 elements - found 0 jobs
Sun 19 Jan 2014 17:18:34 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:18:34 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:18:34 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:18:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:18:34 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:18:34 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:18:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 17:18:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:18:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:18:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:18:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:18:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:18:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:18:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43457223
Sun 19 Jan 2014 17:18:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:18:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43457223
Sun 19 Jan 2014 17:18:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:18:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:18:44 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:18:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:18:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:18:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:18:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:18:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:18:49 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:18:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:18:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:18:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:18:49 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:18:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:18:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:18:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:18:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567625
Sun 19 Jan 2014 17:18:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:18:52 - job_xml_thread(): Done retrieving: data size 43567625
Sun 19 Jan 2014 17:18:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:18:52 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:18:52 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 17:18:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:18:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:18:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:18:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567625
Sun 19 Jan 2014 17:18:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:18:54 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 17:18:54 - Housekeeping: done.
Sun 19 Jan 2014 17:18:54 - XML: Start document: iteration 0
Sun 19 Jan 2014 17:19:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:19:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:19:06 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 17:19:06 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:19:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:19:06 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:19:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:19:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:19:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:19:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:19:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:19:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:19:07 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:19:07 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 17:19:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:19:07 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 17:19:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:19:07 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:19:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:19:07 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 17:19:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:19:08 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:19:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:19:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 17:19:09 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:19:09 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:19:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9134 values 144274 bits 18034 bytes 
Sun 19 Jan 2014 17:19:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 17:19:11 - size of cluster 'LISA Cluster': 624 hosts 79477 metrics 853478 values 13478679 bits 1684834 bytes 
Sun 19 Jan 2014 17:19:15 - XML: Processed 653182 elements - found 0 jobs
Sun 19 Jan 2014 17:19:15 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:19:15 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:19:15 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:19:15 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:19:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:19:16 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:19:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:19:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:19:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:19:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:19:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:19:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:19:20 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:19:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 17:19:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:19:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:19:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553646
Sun 19 Jan 2014 17:19:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:19:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553646
Sun 19 Jan 2014 17:19:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:19:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:19:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:19:30 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:19:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:19:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:19:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:19:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:19:31 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:19:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:19:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:19:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:19:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:19:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:19:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:19:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:19:35 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:19:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:19:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:19:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:19:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:19:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:19:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:19:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:19:38 - job_xml_thread(): Done retrieving: data size 43561638
Sun 19 Jan 2014 17:19:38 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:19:38 - XML: Start document: iteration 1
Sun 19 Jan 2014 17:19:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561638
Sun 19 Jan 2014 17:19:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:19:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561638
Sun 19 Jan 2014 17:19:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:19:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:19:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:19:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:19:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:19:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:19:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:19:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:19:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:19:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:19:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:19:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:19:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:19:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:19:59 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:19:59 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:19:59 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:19:59 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:19:59 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:20:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:20:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:20:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:20:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:20:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:20:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:20:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:20:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:20:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:20:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560112
Sun 19 Jan 2014 17:20:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:20:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560112
Sun 19 Jan 2014 17:20:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:20:07 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:20:08 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 17:20:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:20:09 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:20:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:20:10 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:20:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 17:20:10 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:20:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148641 bits 18580 bytes 
Sun 19 Jan 2014 17:20:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 17:20:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:20:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:20:14 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:20:14 - job_xml_thread(): Done retrieving: data size 43560112
Sun 19 Jan 2014 17:20:14 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:20:14 - XML: Start document: iteration 2
Sun 19 Jan 2014 17:20:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:20:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:20:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:20:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:20:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:20:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:20:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:20:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:20:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:20:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:20:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:20:26 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:20:26 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:20:26 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:20:26 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:20:26 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:20:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:20:28 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:20:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:20:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:20:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:20:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:20:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:20:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:20:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:20:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:20:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:20:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556043
Sun 19 Jan 2014 17:20:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:20:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556043
Sun 19 Jan 2014 17:20:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:20:41 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:20:41 - job_xml_thread(): Done retrieving: data size 43556043
Sun 19 Jan 2014 17:20:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:20:41 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:20:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:20:41 - XML: Start document: iteration 3
Sun 19 Jan 2014 17:20:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:20:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:20:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:20:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:20:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556043
Sun 19 Jan 2014 17:20:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:20:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:20:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:20:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:20:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:20:56 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:20:56 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:20:56 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:20:56 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:20:56 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:20:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:20:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:20:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:20:57 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:20:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:20:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:20:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:20:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:20:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:20:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:20:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:21:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:21:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:21:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:21:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:21:02 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:21:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 17:21:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:21:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:21:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:21:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:21:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:21:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:21:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569012
Sun 19 Jan 2014 17:21:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:21:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569012
Sun 19 Jan 2014 17:21:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:21:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:21:11 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:21:11 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:21:11 - job_xml_thread(): Done retrieving: data size 43569012
Sun 19 Jan 2014 17:21:11 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:21:11 - XML: Start document: iteration 4
Sun 19 Jan 2014 17:21:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:21:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 17:21:12 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:21:12 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:21:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 17:21:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:21:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:21:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5946 values 93833 bits 11729 bytes 
Sun 19 Jan 2014 17:21:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:21:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:21:24 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:21:24 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:21:24 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:21:24 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:21:24 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:21:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:21:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:21:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:21:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:21:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:21:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:21:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:21:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:21:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:21:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:21:29 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:21:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:21:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:21:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:21:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:21:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:21:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:21:34 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:21:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 17:21:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:21:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:21:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582737
Sun 19 Jan 2014 17:21:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:21:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582737
Sun 19 Jan 2014 17:21:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:21:39 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:21:39 - job_xml_thread(): Done retrieving: data size 43582737
Sun 19 Jan 2014 17:21:39 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:21:39 - XML: Start document: iteration 5
Sun 19 Jan 2014 17:21:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:21:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:21:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:21:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:21:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:21:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:21:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:21:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:21:52 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:21:52 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:21:52 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:21:52 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:21:52 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:21:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:21:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:21:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:21:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:21:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:21:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:21:55 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:21:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:21:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:21:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:21:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:21:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:21:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:21:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:21:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584241
Sun 19 Jan 2014 17:21:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:22:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584241
Sun 19 Jan 2014 17:22:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:22:07 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:22:07 - job_xml_thread(): Done retrieving: data size 43584241
Sun 19 Jan 2014 17:22:07 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:22:07 - XML: Start document: iteration 6
Sun 19 Jan 2014 17:22:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:22:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:22:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:22:10 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:22:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:22:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:22:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:22:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:22:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:22:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:22:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:22:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:22:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:22:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:22:12 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:22:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:22:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 17:22:13 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:22:13 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:22:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 17:22:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99103 bits 12387 bytes 
Sun 19 Jan 2014 17:22:18 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:22:18 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:22:18 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:22:18 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:22:18 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:22:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:22:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:22:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:22:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:22:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:22:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:22:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:22:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:22:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:22:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43550123
Sun 19 Jan 2014 17:22:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:22:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:22:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:22:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43550123
Sun 19 Jan 2014 17:22:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:22:33 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:22:33 - job_xml_thread(): Done retrieving: data size 43550123
Sun 19 Jan 2014 17:22:33 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:22:33 - XML: Start document: iteration 7
Sun 19 Jan 2014 17:22:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:22:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:22:44 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:22:44 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:22:44 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:22:44 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:22:44 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:22:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:22:45 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:22:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:22:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:22:45 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:22:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 17:22:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:22:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:22:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:22:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:22:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:22:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:22:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:22:49 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:22:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:22:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:22:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:22:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:22:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:22:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:22:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:22:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570699
Sun 19 Jan 2014 17:22:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:22:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570699
Sun 19 Jan 2014 17:22:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:22:59 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:22:59 - job_xml_thread(): Done retrieving: data size 43570699
Sun 19 Jan 2014 17:22:59 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:22:59 - XML: Start document: iteration 8
Sun 19 Jan 2014 17:23:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:23:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:23:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:23:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:23:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:23:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:23:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:23:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:23:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:23:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:23:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:23:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:23:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:23:13 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:23:13 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:23:13 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:23:13 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:23:13 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:23:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:23:13 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:23:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:23:13 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:23:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 17:23:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 17:23:14 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:23:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5997 values 94620 bits 11827 bytes 
Sun 19 Jan 2014 17:23:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:23:17 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:23:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:23:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:23:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:23:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:23:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:23:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:23:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:23:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43488463
Sun 19 Jan 2014 17:23:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:23:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43488463
Sun 19 Jan 2014 17:23:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:23:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:23:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:23:28 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:23:28 - job_xml_thread(): Done retrieving: data size 43488463
Sun 19 Jan 2014 17:23:28 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:23:28 - XML: Start document: iteration 9
Sun 19 Jan 2014 17:23:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:23:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:23:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:23:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:23:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:23:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:23:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:23:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:23:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:23:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:23:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:23:39 - XML: Processed 652600 elements - found 0 jobs
Sun 19 Jan 2014 17:23:39 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:23:39 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:23:39 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:23:39 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:23:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:23:41 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:23:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:23:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:23:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:23:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:23:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:23:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:23:42 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:23:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 17:23:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:23:43 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 17:23:43 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 17:23:43 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:23:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:23:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42983027
Sun 19 Jan 2014 17:23:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:23:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42983027
Sun 19 Jan 2014 17:23:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:23:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:23:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:23:54 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:23:54 - job_xml_thread(): Done retrieving: data size 42983027
Sun 19 Jan 2014 17:23:54 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:23:54 - XML: Start document: iteration 10
Sun 19 Jan 2014 17:23:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:23:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:23:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:23:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:23:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:23:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:23:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:23:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:23:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:23:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:23:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:24:03 - XML: Processed 646100 elements - found 0 jobs
Sun 19 Jan 2014 17:24:03 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:24:03 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:24:03 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:24:03 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:24:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:24:06 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:24:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:24:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:24:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:24:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:24:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:24:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:24:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:24:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42899859
Sun 19 Jan 2014 17:24:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:24:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42899859
Sun 19 Jan 2014 17:24:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:24:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:24:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:24:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:24:14 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:24:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:24:15 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:24:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 17:24:15 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:24:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 17:24:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8666 values 136640 bits 17080 bytes 
Sun 19 Jan 2014 17:24:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:24:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:24:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:24:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:24:19 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:24:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:24:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:24:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:24:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:24:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:24:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:24:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:24:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:24:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:24:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:24:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:24:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:24:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:24:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:24:24 - job_xml_thread(): Done retrieving: data size 42981372
Sun 19 Jan 2014 17:24:24 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:24:24 - XML: Start document: iteration 11
Sun 19 Jan 2014 17:24:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42981372
Sun 19 Jan 2014 17:24:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:24:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42981372
Sun 19 Jan 2014 17:24:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:24:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:24:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:24:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:24:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:24:42 - XML: Processed 645900 elements - found 0 jobs
Sun 19 Jan 2014 17:24:42 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:24:42 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:24:42 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:24:42 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:24:45 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:24:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 17:24:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:24:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:24:46 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:24:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:24:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:24:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:24:48 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:24:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:24:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:24:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:24:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:24:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:24:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:24:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:24:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:24:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:24:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:24:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:24:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:24:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43506478
Sun 19 Jan 2014 17:24:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:24:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43506478
Sun 19 Jan 2014 17:24:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:24:58 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:24:58 - job_xml_thread(): Done retrieving: data size 43506478
Sun 19 Jan 2014 17:24:58 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:24:58 - XML: Start document: iteration 12
Sun 19 Jan 2014 17:25:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:25:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:25:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:25:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:25:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:25:06 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:25:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:25:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:25:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:25:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:25:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:25:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:25:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:25:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:25:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:25:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:25:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:25:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:25:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:25:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:25:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:25:13 - XML: Processed 652368 elements - found 0 jobs
Sun 19 Jan 2014 17:25:13 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:25:13 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:25:13 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:25:13 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:25:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:25:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578228
Sun 19 Jan 2014 17:25:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:25:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578228
Sun 19 Jan 2014 17:25:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:25:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:25:16 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:25:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:25:18 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:25:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 17:25:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 17:25:19 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:25:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9275 values 146263 bits 18282 bytes 
Sun 19 Jan 2014 17:25:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:25:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:25:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:25:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:25:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:25:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:25:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:25:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:25:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:25:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:25:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:25:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:25:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:25:28 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:25:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:25:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:25:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:25:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:25:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:25:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:25:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:25:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:25:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:25:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582715
Sun 19 Jan 2014 17:25:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:25:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582715
Sun 19 Jan 2014 17:25:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:25:33 - job_xml_thread(): Done retrieving: data size 43582715
Sun 19 Jan 2014 17:25:33 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:25:33 - XML: Start document: iteration 13
Sun 19 Jan 2014 17:25:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:25:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:25:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:25:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:25:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:25:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:25:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:25:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:25:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:25:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:25:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:25:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:25:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:25:53 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:25:53 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:25:53 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:25:53 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:25:53 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:25:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:25:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:25:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:25:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:25:56 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:25:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 17:25:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:25:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:25:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:25:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:25:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:25:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:25:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573103
Sun 19 Jan 2014 17:25:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:25:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573103
Sun 19 Jan 2014 17:25:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:26:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:26:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:26:08 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 17:26:08 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:26:08 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:26:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:26:09 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:26:09 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 17:26:09 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 17:26:09 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:26:09 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 17:26:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:26:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:26:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:26:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sun 19 Jan 2014 17:26:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:26:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:26:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:26:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:26:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:26:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:26:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:26:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:26:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:26:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:26:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:26:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:26:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:26:14 - job_xml_thread(): Done retrieving: data size 43581001
Sun 19 Jan 2014 17:26:14 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:26:14 - XML: Start document: iteration 14
Sun 19 Jan 2014 17:26:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581001
Sun 19 Jan 2014 17:26:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:26:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581001
Sun 19 Jan 2014 17:26:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:26:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:26:18 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:26:20 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:26:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:26:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 17:26:21 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:26:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 17:26:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8815 values 138996 bits 17374 bytes 
Sun 19 Jan 2014 17:26:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:26:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:26:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:26:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:26:30 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:26:30 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:26:31 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:26:31 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:26:31 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:26:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:26:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:26:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:26:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:26:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:26:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:26:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:26:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:26:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:26:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:26:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:26:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:26:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:26:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:26:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:26:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:26:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:26:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:26:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575519
Sun 19 Jan 2014 17:26:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:26:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575519
Sun 19 Jan 2014 17:26:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:26:46 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:26:46 - job_xml_thread(): Done retrieving: data size 43575519
Sun 19 Jan 2014 17:26:46 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:26:46 - XML: Start document: iteration 15
Sun 19 Jan 2014 17:26:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:26:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:26:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:26:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:26:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:26:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:26:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:26:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:26:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:26:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:26:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:26:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:26:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:27:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:27:00 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:27:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:27:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:27:01 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:27:01 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:27:01 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:27:01 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:27:01 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:27:01 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:27:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 17:27:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:27:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:27:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:27:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:27:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:27:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:27:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566898
Sun 19 Jan 2014 17:27:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:27:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566898
Sun 19 Jan 2014 17:27:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:27:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:27:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:27:09 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:27:09 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:27:11 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:27:11 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:27:11 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 17:27:11 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 17:27:11 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 17:27:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:27:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:27:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:27:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:27:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:27:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:27:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:27:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566898
Sun 19 Jan 2014 17:27:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:27:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:27:16 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:27:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:27:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:27:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:27:20 - size of cluster 'LISA Cluster': 624 hosts 79472 metrics 814634 values 12837156 bits 1604644 bytes 
Sun 19 Jan 2014 17:27:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:27:21 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:27:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:27:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 17:27:21 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:27:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5740 values 90495 bits 11311 bytes 
Sun 19 Jan 2014 17:27:21 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:27:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 17:27:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:27:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:27:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:27:27 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:27:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:27:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:27:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:27:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:27:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:27:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:27:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:27:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:27:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:27:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:27:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:27:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:27:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:27:31 - job_xml_thread(): Done retrieving: data size 43560244
Sun 19 Jan 2014 17:27:31 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:27:31 - XML: Start document: iteration 16
Sun 19 Jan 2014 17:27:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560244
Sun 19 Jan 2014 17:27:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:27:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560244
Sun 19 Jan 2014 17:27:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:27:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:27:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:27:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:27:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:27:44 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:27:44 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:27:44 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:27:44 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:27:44 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:27:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:27:52 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:27:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:27:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:27:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:27:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:27:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:27:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:27:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:27:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:27:54 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:27:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:27:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:27:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:27:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:27:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:27:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:27:54 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:27:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 17:27:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:27:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:27:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580102
Sun 19 Jan 2014 17:27:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:27:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580102
Sun 19 Jan 2014 17:27:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:27:59 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:27:59 - job_xml_thread(): Done retrieving: data size 43580102
Sun 19 Jan 2014 17:27:59 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:27:59 - XML: Start document: iteration 17
Sun 19 Jan 2014 17:28:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:28:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:28:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:28:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:28:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:28:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:28:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:28:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:28:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:28:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:28:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:28:12 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:28:12 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 17:28:13 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:28:13 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:28:13 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:28:13 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:28:13 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:28:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:28:19 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:28:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:28:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:28:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:28:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:28:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:28:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:28:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:28:21 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:28:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:28:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43546904
Sun 19 Jan 2014 17:28:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:28:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:28:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 17:28:22 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:28:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6034 values 95215 bits 11901 bytes 
Sun 19 Jan 2014 17:28:22 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:28:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 17:28:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43546904
Sun 19 Jan 2014 17:28:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:28:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:28:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:28:28 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:28:29 - job_xml_thread(): Done retrieving: data size 43546904
Sun 19 Jan 2014 17:28:29 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:28:29 - XML: Start document: iteration 18
Sun 19 Jan 2014 17:28:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:28:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:28:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:28:36 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:28:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:28:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:28:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:28:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:28:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:28:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:28:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:28:44 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:28:44 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:28:44 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:28:44 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:28:44 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:28:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:28:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:28:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:28:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:28:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:28:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:28:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:28:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:28:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:28:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559246
Sun 19 Jan 2014 17:28:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:28:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559246
Sun 19 Jan 2014 17:28:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:28:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:28:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:28:59 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:29:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:29:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:29:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:29:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:29:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:29:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:29:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:29:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:29:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:29:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:29:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:29:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:29:05 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:29:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:29:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:29:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:29:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:29:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:29:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:29:05 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:29:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 17:29:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:29:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:29:09 - job_xml_thread(): Done retrieving: data size 43562500
Sun 19 Jan 2014 17:29:09 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:29:09 - XML: Start document: iteration 19
Sun 19 Jan 2014 17:29:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562500
Sun 19 Jan 2014 17:29:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:29:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562500
Sun 19 Jan 2014 17:29:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:29:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:29:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:29:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:29:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:29:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:29:23 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:29:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:29:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 17:29:23 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:29:23 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:29:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 17:29:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5907 values 93175 bits 11646 bytes 
Sun 19 Jan 2014 17:29:25 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:29:25 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:29:25 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:29:25 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:29:25 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:29:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:29:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:29:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:29:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:29:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:29:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:29:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:29:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:29:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:29:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:29:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:29:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:29:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:29:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:29:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:29:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:29:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:29:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:29:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43125251
Sun 19 Jan 2014 17:29:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:29:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43125251
Sun 19 Jan 2014 17:29:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:29:40 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:29:40 - job_xml_thread(): Done retrieving: data size 43125251
Sun 19 Jan 2014 17:29:40 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:29:40 - XML: Start document: iteration 20
Sun 19 Jan 2014 17:29:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:29:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:29:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:29:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:29:57 - XML: Processed 648026 elements - found 0 jobs
Sun 19 Jan 2014 17:29:57 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:29:57 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:29:57 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:29:57 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:29:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:29:58 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:29:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:29:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:29:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:29:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:29:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:29:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:29:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:29:59 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:29:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 17:29:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:30:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:30:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:30:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:30:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:30:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:30:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:30:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:30:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:30:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:30:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42938972
Sun 19 Jan 2014 17:30:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:30:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42938972
Sun 19 Jan 2014 17:30:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:30:12 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:30:13 - job_xml_thread(): Done retrieving: data size 42938972
Sun 19 Jan 2014 17:30:13 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:30:13 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 17:30:14 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 17:30:14 - Housekeeping: done.
Sun 19 Jan 2014 17:30:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:30:14 - XML: Start document: iteration 0
Sun 19 Jan 2014 17:30:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:30:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:30:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:30:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:30:20 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:30:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:30:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:30:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:30:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:30:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:30:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:30:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:30:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:30:23 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:30:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:30:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 17:30:23 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:30:23 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:30:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5975 values 94208 bits 11776 bytes 
Sun 19 Jan 2014 17:30:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 17:30:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:30:27 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:30:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:30:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:30:28 - XML: Processed 645354 elements - found 0 jobs
Sun 19 Jan 2014 17:30:28 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:30:28 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:30:28 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:30:28 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:30:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:30:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:30:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:30:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:30:30 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 17:30:30 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 17:30:30 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:30:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:30:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42971623
Sun 19 Jan 2014 17:30:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:30:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42971623
Sun 19 Jan 2014 17:30:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:30:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:30:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:30:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:30:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:30:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:30:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:30:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:30:43 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:30:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:30:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:30:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:30:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:30:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:30:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:30:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:30:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:30:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:30:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:30:46 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:30:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 17:30:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:30:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:30:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:30:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:30:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:30:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:30:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43508148
Sun 19 Jan 2014 17:30:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:30:48 - job_xml_thread(): Done retrieving: data size 43508148
Sun 19 Jan 2014 17:30:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43508148
Sun 19 Jan 2014 17:30:49 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:30:49 - XML: Start document: iteration 1
Sun 19 Jan 2014 17:30:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:30:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:30:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:31:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:31:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:31:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:31:04 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:31:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:31:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:31:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:31:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:31:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:31:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:31:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:31:09 - XML: Processed 652308 elements - found 0 jobs
Sun 19 Jan 2014 17:31:09 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:31:09 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:31:09 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:31:09 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:31:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:31:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:31:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:31:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:31:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:31:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:31:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:31:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:31:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:31:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566122
Sun 19 Jan 2014 17:31:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:31:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566122
Sun 19 Jan 2014 17:31:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:31:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:31:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:31:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:31:24 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:31:24 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:31:24 - job_xml_thread(): Done retrieving: data size 43566122
Sun 19 Jan 2014 17:31:24 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:31:24 - XML: Start document: iteration 2
Sun 19 Jan 2014 17:31:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:31:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 17:31:25 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:31:25 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:31:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8795 values 138728 bits 17341 bytes 
Sun 19 Jan 2014 17:31:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 17:31:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:31:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:31:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:31:28 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:31:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:31:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:31:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:31:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:31:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:31:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:31:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:31:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:31:31 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:31:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:31:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:31:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:31:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:31:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:31:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:31:35 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:31:35 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:31:35 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:31:35 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:31:35 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:31:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:31:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559495
Sun 19 Jan 2014 17:31:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:31:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559495
Sun 19 Jan 2014 17:31:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:31:42 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:31:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 17:31:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:31:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:31:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:31:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:31:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:31:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:31:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:31:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:31:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:31:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:31:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:31:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:31:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:31:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:31:50 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:31:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:31:53 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:31:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:31:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:31:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:31:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:31:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:31:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:31:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:31:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582952
Sun 19 Jan 2014 17:31:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:31:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582952
Sun 19 Jan 2014 17:31:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:31:55 - job_xml_thread(): Done retrieving: data size 43582952
Sun 19 Jan 2014 17:31:57 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:31:57 - XML: Start document: iteration 3
Sun 19 Jan 2014 17:32:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:32:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:32:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:32:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:32:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:32:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:32:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:32:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:32:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:32:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:32:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:32:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:32:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:32:14 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:32:15 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:32:15 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:32:15 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:32:15 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:32:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:32:17 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:32:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:32:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:32:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:32:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:32:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:32:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:32:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:32:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564731
Sun 19 Jan 2014 17:32:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:32:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564731
Sun 19 Jan 2014 17:32:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:32:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:32:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:32:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:32:25 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:32:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:32:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 17:32:26 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:32:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 17:32:26 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:32:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9398 values 148653 bits 18581 bytes 
Sun 19 Jan 2014 17:32:30 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:32:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:32:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:32:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:32:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:32:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:32:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:32:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:32:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:32:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:32:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:32:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:32:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:32:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:32:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:32:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:32:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:32:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:32:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:32:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:32:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:32:39 - job_xml_thread(): Done retrieving: data size 43570675
Sun 19 Jan 2014 17:32:39 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:32:39 - XML: Start document: iteration 4
Sun 19 Jan 2014 17:32:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570675
Sun 19 Jan 2014 17:32:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:32:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570675
Sun 19 Jan 2014 17:32:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:32:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:32:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:32:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:32:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:33:01 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:33:01 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:33:01 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:33:01 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:33:01 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:33:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:33:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:33:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:33:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:33:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:33:03 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:33:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:33:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:33:03 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:33:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 17:33:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:33:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:33:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:33:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:33:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:33:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:33:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:33:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:33:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:33:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:33:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:33:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43587949
Sun 19 Jan 2014 17:33:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:33:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43587949
Sun 19 Jan 2014 17:33:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:33:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:33:14 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:33:17 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:33:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:33:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:33:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:33:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:33:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:33:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:33:19 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:33:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:33:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:33:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:33:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:33:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:33:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:33:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:33:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:33:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:33:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:33:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:33:21 - job_xml_thread(): Done retrieving: data size 43572275
Sun 19 Jan 2014 17:33:21 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:33:21 - XML: Start document: iteration 5
Sun 19 Jan 2014 17:33:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572275
Sun 19 Jan 2014 17:33:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:33:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572275
Sun 19 Jan 2014 17:33:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:33:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:33:26 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:33:28 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:33:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:33:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 17:33:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 17:33:28 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:33:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9062 values 143315 bits 17914 bytes 
Sun 19 Jan 2014 17:33:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:33:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:33:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:33:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:33:38 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:33:38 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:33:38 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:33:38 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:33:38 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:33:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:33:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:33:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:33:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:33:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:33:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:33:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:33:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:33:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:33:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:33:45 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:33:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:33:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:33:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:33:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:33:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:33:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:33:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:33:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43592387
Sun 19 Jan 2014 17:33:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:33:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43592387
Sun 19 Jan 2014 17:33:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:33:53 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:33:53 - job_xml_thread(): Done retrieving: data size 43592387
Sun 19 Jan 2014 17:33:53 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:33:53 - XML: Start document: iteration 6
Sun 19 Jan 2014 17:33:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:33:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:34:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:34:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:34:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:34:06 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:34:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:34:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:34:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:34:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:34:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:34:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:34:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:34:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:34:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:34:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:34:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:34:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:34:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:34:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:34:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:34:11 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:34:11 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:34:11 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:34:11 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:34:11 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:34:12 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:34:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 17:34:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:34:12 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 17:34:12 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:34:12 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:34:12 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:34:12 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 17:34:12 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 17:34:12 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 17:34:13 - size of cluster 'LISA Cluster': 624 hosts 79484 metrics 879968 values 13894346 bits 1736793 bytes 
Sun 19 Jan 2014 17:34:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:34:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576447
Sun 19 Jan 2014 17:34:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:34:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576447
Sun 19 Jan 2014 17:34:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:34:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:34:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:34:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:34:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:34:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:34:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:34:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:34:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:34:26 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:34:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:34:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:34:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:34:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:34:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:34:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:34:29 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:34:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:34:30 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:34:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 17:34:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 17:34:30 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:34:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5948 values 93878 bits 11734 bytes 
Sun 19 Jan 2014 17:34:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:34:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:34:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:34:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:34:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:34:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:34:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:34:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:34:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:34:35 - job_xml_thread(): Done retrieving: data size 43590242
Sun 19 Jan 2014 17:34:35 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:34:35 - XML: Start document: iteration 7
Sun 19 Jan 2014 17:34:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43590242
Sun 19 Jan 2014 17:34:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43590242
Sun 19 Jan 2014 17:34:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:34:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:34:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:34:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:34:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:34:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:34:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:34:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:34:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:34:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:34:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:34:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:34:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:34:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:34:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:34:53 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:34:53 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:34:53 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:34:53 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:34:53 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:34:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:34:58 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:34:58 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:34:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 17:34:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:34:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:34:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:34:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:34:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:34:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:34:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:35:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:35:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578540
Sun 19 Jan 2014 17:35:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:35:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578540
Sun 19 Jan 2014 17:35:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:35:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:35:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:35:08 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:35:08 - job_xml_thread(): Done retrieving: data size 43578540
Sun 19 Jan 2014 17:35:08 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:35:08 - XML: Start document: iteration 8
Sun 19 Jan 2014 17:35:12 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:35:13 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 17:35:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:35:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:35:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:35:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:35:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:35:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:35:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:35:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:35:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:35:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:35:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:35:21 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:35:21 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:35:21 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:35:21 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:35:21 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:35:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:35:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:35:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:35:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:35:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:35:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:35:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:35:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:35:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:35:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43493700
Sun 19 Jan 2014 17:35:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:35:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:35:30 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:35:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43493700
Sun 19 Jan 2014 17:35:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:35:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:35:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 17:35:31 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:35:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5877 values 92649 bits 11581 bytes 
Sun 19 Jan 2014 17:35:31 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:35:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 17:35:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:35:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:35:36 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:35:36 - job_xml_thread(): Done retrieving: data size 43493700
Sun 19 Jan 2014 17:35:36 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:35:36 - XML: Start document: iteration 9
Sun 19 Jan 2014 17:35:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:35:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:35:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:35:43 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:35:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:35:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:35:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:35:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:35:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:35:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:35:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:35:49 - XML: Processed 652596 elements - found 0 jobs
Sun 19 Jan 2014 17:35:49 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:35:49 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:35:49 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:35:49 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:35:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:35:52 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:35:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:35:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:35:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:35:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:35:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:35:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:35:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:35:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42917876
Sun 19 Jan 2014 17:35:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:35:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42917876
Sun 19 Jan 2014 17:35:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:36:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:36:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:36:05 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:36:05 - job_xml_thread(): Done retrieving: data size 42917876
Sun 19 Jan 2014 17:36:05 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:36:05 - XML: Start document: iteration 10
Sun 19 Jan 2014 17:36:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:36:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:36:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:36:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:36:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:36:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:36:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:36:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:36:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:36:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:36:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:36:14 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:36:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 17:36:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:36:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:36:19 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:36:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:36:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:36:20 - XML: Processed 645513 elements - found 0 jobs
Sun 19 Jan 2014 17:36:20 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:36:20 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:36:20 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:36:20 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:36:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:36:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:36:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:36:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:36:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:36:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42956583
Sun 19 Jan 2014 17:36:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:36:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42956583
Sun 19 Jan 2014 17:36:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:36:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:36:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:36:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:36:32 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:36:33 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:36:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 17:36:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:36:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 17:36:33 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:36:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5812 values 91654 bits 11456 bytes 
Sun 19 Jan 2014 17:36:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:36:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:36:35 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:36:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:36:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:36:37 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:36:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:36:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:36:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:36:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:36:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:36:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:36:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:36:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:36:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:36:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:36:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:36:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:36:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:36:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:36:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:36:42 - job_xml_thread(): Done retrieving: data size 43476605
Sun 19 Jan 2014 17:36:42 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:36:42 - XML: Start document: iteration 11
Sun 19 Jan 2014 17:36:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43476605
Sun 19 Jan 2014 17:36:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:36:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43476605
Sun 19 Jan 2014 17:36:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:36:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:36:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:36:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:36:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:36:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:36:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:36:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:36:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:36:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:36:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:36:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:36:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:36:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:37:02 - XML: Processed 652222 elements - found 0 jobs
Sun 19 Jan 2014 17:37:02 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:37:02 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:37:02 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:37:02 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:37:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:37:05 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:37:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:37:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:37:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:37:05 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:37:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:37:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:37:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 17:37:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:37:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:37:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:37:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554722
Sun 19 Jan 2014 17:37:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:37:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554722
Sun 19 Jan 2014 17:37:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:37:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:37:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:37:18 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:37:18 - job_xml_thread(): Done retrieving: data size 43554722
Sun 19 Jan 2014 17:37:18 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:37:18 - XML: Start document: iteration 12
Sun 19 Jan 2014 17:37:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:37:20 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:37:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:37:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:37:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:37:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:37:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:37:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:37:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:37:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:37:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:37:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:37:25 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:37:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:37:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:37:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:37:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:37:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:37:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:37:29 - XML: Processed 653324 elements - found 0 jobs
Sun 19 Jan 2014 17:37:29 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:37:29 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:37:29 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:37:29 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:37:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:37:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566491
Sun 19 Jan 2014 17:37:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:37:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:37:33 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:37:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:37:33 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:37:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 17:37:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 17:37:33 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:37:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6659 values 104997 bits 13124 bytes 
Sun 19 Jan 2014 17:37:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566491
Sun 19 Jan 2014 17:37:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:37:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:37:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:37:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:37:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:37:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:37:43 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:37:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:37:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:37:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:37:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:37:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:37:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:37:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:37:44 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:37:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:37:48 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:37:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:37:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:37:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:37:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:37:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:37:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:37:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:37:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583340
Sun 19 Jan 2014 17:37:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:37:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583340
Sun 19 Jan 2014 17:37:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:37:53 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:37:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 17:37:53 - job_xml_thread(): Done retrieving: data size 43583340
Sun 19 Jan 2014 17:37:53 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:37:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:37:54 - XML: Start document: iteration 13
Sun 19 Jan 2014 17:37:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:37:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:38:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:38:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:38:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:38:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:38:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:38:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:38:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:38:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:38:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:38:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:38:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:38:14 - XML: Processed 653347 elements - found 0 jobs
Sun 19 Jan 2014 17:38:14 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:38:14 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:38:14 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:38:14 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:38:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:38:17 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:38:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:38:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:38:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:38:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:38:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:38:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:38:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:38:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43589791
Sun 19 Jan 2014 17:38:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:38:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43589791
Sun 19 Jan 2014 17:38:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:38:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:38:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:38:30 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:38:30 - job_xml_thread(): Done retrieving: data size 43589791
Sun 19 Jan 2014 17:38:30 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:38:30 - XML: Start document: iteration 14
Sun 19 Jan 2014 17:38:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:38:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:38:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:38:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:38:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:38:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:38:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:38:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:38:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:38:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:38:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:38:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:38:33 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:38:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:38:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 17:38:34 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:38:35 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:38:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 17:38:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99030 bits 12378 bytes 
Sun 19 Jan 2014 17:38:41 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:38:41 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:38:41 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:38:41 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:38:41 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:38:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:38:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:38:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:38:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:38:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:38:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:38:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:38:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:38:46 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 17:38:46 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 17:38:46 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:38:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:38:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561285
Sun 19 Jan 2014 17:38:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:38:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:38:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:38:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561285
Sun 19 Jan 2014 17:38:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:38:56 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:38:56 - job_xml_thread(): Done retrieving: data size 43561285
Sun 19 Jan 2014 17:38:56 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:38:56 - XML: Start document: iteration 15
Sun 19 Jan 2014 17:38:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:38:58 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:38:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:38:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:38:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:38:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:38:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:38:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:38:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:39:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:39:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:39:07 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:39:07 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:39:07 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:39:07 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:39:07 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:39:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:39:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:39:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:39:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:39:09 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:39:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 17:39:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:39:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:39:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:39:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:39:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:39:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:39:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43544481
Sun 19 Jan 2014 17:39:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:39:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43544481
Sun 19 Jan 2014 17:39:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:39:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:39:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:39:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:39:22 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:39:22 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:39:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:39:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:39:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:39:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:39:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:39:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:39:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:39:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:39:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:39:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:39:25 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:39:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:39:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:39:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:39:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:39:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:39:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:39:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:39:27 - job_xml_thread(): Done retrieving: data size 43571333
Sun 19 Jan 2014 17:39:27 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:39:27 - XML: Start document: iteration 16
Sun 19 Jan 2014 17:39:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571333
Sun 19 Jan 2014 17:39:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:39:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571333
Sun 19 Jan 2014 17:39:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:39:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:39:35 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:39:36 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:39:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:39:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 17:39:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 17:39:36 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:39:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8978 values 141486 bits 17685 bytes 
Sun 19 Jan 2014 17:39:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:39:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:39:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:39:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:39:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:39:44 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:39:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:39:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:39:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:39:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:39:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:39:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:39:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:39:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:39:49 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:39:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:39:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:39:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:39:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:39:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:39:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:39:51 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:39:51 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:39:51 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:39:51 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:39:51 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:39:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:39:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571147
Sun 19 Jan 2014 17:39:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:39:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571147
Sun 19 Jan 2014 17:39:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:40:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:40:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:40:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:40:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:40:06 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:40:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:40:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:40:06 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:40:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:40:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:40:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:40:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:40:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:40:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:40:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:40:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:40:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:40:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:40:09 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:40:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 17:40:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:40:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:40:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:40:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:40:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:40:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:40:10 - job_xml_thread(): Done retrieving: data size 43562993
Sun 19 Jan 2014 17:40:10 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:40:10 - XML: Start document: iteration 17
Sun 19 Jan 2014 17:40:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562993
Sun 19 Jan 2014 17:40:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:40:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562993
Sun 19 Jan 2014 17:40:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:40:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:40:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:40:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:40:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:40:31 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:40:31 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:40:31 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:40:31 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:40:31 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:40:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:40:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:40:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:40:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:40:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:40:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:40:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:40:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:40:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:40:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:40:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:40:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:40:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:40:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:40:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:40:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:40:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:40:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:40:36 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:40:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:40:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43597716
Sun 19 Jan 2014 17:40:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:40:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43597716
Sun 19 Jan 2014 17:40:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:40:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:40:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 17:40:38 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:40:38 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:40:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 17:40:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9165 values 144538 bits 18067 bytes 
Sun 19 Jan 2014 17:40:46 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:40:46 - job_xml_thread(): Done retrieving: data size 43597716
Sun 19 Jan 2014 17:40:46 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:40:46 - XML: Start document: iteration 18
Sun 19 Jan 2014 17:40:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:40:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:40:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:40:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:40:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:40:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:40:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:40:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:40:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:40:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:40:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:40:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:40:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:40:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:40:55 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:40:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:40:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:40:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:40:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:40:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:40:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:40:59 - XML: Processed 653347 elements - found 0 jobs
Sun 19 Jan 2014 17:40:59 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:40:59 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:40:59 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:40:59 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:41:02 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:41:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 17:41:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:41:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:41:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567360
Sun 19 Jan 2014 17:41:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:41:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567360
Sun 19 Jan 2014 17:41:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:41:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:41:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:41:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:41:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:41:13 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 17:41:13 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:41:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:41:13 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:41:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:41:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:41:14 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:41:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:41:14 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:41:14 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:41:14 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 17:41:14 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 17:41:14 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 17:41:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:41:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:41:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:41:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:41:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:41:18 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:41:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:41:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:41:18 - size of cluster 'LISA Cluster': 624 hosts 79485 metrics 809369 values 12756730 bits 1594591 bytes 
Sun 19 Jan 2014 17:41:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:41:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:41:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:41:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:41:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:41:21 - job_xml_thread(): Done retrieving: data size 43523718
Sun 19 Jan 2014 17:41:21 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:41:21 - XML: Start document: iteration 19
Sun 19 Jan 2014 17:41:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43523718
Sun 19 Jan 2014 17:41:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:41:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43523718
Sun 19 Jan 2014 17:41:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:41:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:41:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:41:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:41:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:41:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:41:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:41:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:41:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:41:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:41:38 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:41:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:41:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:41:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:41:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:41:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:41:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:41:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 17:41:40 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:41:40 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:41:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 17:41:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99024 bits 12378 bytes 
Sun 19 Jan 2014 17:41:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:41:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:41:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:41:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:41:44 - XML: Processed 652600 elements - found 0 jobs
Sun 19 Jan 2014 17:41:44 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:41:44 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:41:44 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:41:44 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:41:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:41:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:41:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:41:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:41:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:41:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42962913
Sun 19 Jan 2014 17:41:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:41:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42962913
Sun 19 Jan 2014 17:41:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:41:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:41:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:41:59 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:41:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:42:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:42:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:42:00 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:42:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:42:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:42:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:42:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:42:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:42:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:42:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:42:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:42:03 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:42:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:42:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:42:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:42:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:42:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:42:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:42:04 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:42:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 17:42:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:42:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:42:07 - job_xml_thread(): Done retrieving: data size 42925174
Sun 19 Jan 2014 17:42:07 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:42:07 - XML: Start document: iteration 20
Sun 19 Jan 2014 17:42:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42925174
Sun 19 Jan 2014 17:42:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:42:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42925174
Sun 19 Jan 2014 17:42:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:42:14 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:42:14 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 17:42:17 - XML: Processed 645150 elements - found 0 jobs
Sun 19 Jan 2014 17:42:17 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:42:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:42:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:42:17 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:42:17 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:42:17 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:42:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:42:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:42:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:42:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:42:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:42:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:42:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:42:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:42:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:42:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:42:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:42:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:42:29 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:42:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:42:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:42:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:42:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:42:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:42:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:42:32 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:42:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:42:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43031004
Sun 19 Jan 2014 17:42:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:42:33 - job_xml_thread(): Done retrieving: data size 43031004
Sun 19 Jan 2014 17:42:33 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:42:33 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 17:42:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43031004
Sun 19 Jan 2014 17:42:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:42:34 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 17:42:34 - Housekeeping: done.
Sun 19 Jan 2014 17:42:34 - XML: Start document: iteration 0
Sun 19 Jan 2014 17:42:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:42:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:42:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:42:41 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:42:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:42:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 17:42:42 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:42:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8678 values 136805 bits 17100 bytes 
Sun 19 Jan 2014 17:42:42 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:42:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 17:42:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:42:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:42:47 - XML: Processed 646656 elements - found 0 jobs
Sun 19 Jan 2014 17:42:47 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:42:47 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:42:47 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:42:47 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:42:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:42:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:42:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:42:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:42:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:42:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:42:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:42:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:42:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:42:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:42:55 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:42:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:42:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:42:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:42:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:42:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:42:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:42:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:42:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43547510
Sun 19 Jan 2014 17:42:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:42:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43547510
Sun 19 Jan 2014 17:42:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:43:02 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:43:02 - job_xml_thread(): Done retrieving: data size 43547510
Sun 19 Jan 2014 17:43:02 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:43:02 - XML: Start document: iteration 1
Sun 19 Jan 2014 17:43:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:43:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:43:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:43:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:43:17 - XML: Processed 653204 elements - found 0 jobs
Sun 19 Jan 2014 17:43:17 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:43:17 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:43:17 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:43:17 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:43:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:43:19 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:43:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:43:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:43:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:43:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:43:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:43:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:43:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:43:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:43:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:43:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:43:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:43:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:43:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:43:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:43:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:43:23 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:43:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 17:43:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:43:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:43:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571231
Sun 19 Jan 2014 17:43:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:43:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571231
Sun 19 Jan 2014 17:43:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:43:32 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:43:32 - job_xml_thread(): Done retrieving: data size 43571231
Sun 19 Jan 2014 17:43:32 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:43:32 - XML: Start document: iteration 2
Sun 19 Jan 2014 17:43:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:43:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:43:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:43:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:43:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:43:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:43:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:43:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:43:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:43:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:43:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:43:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:43:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:43:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:43:43 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:43:44 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:43:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 17:43:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:43:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:43:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 17:43:44 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:43:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5852 values 92279 bits 11534 bytes 
Sun 19 Jan 2014 17:43:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:43:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:43:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:43:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:43:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:43:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:43:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:43:47 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:43:47 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:43:47 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:43:47 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:43:47 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:43:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:43:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571607
Sun 19 Jan 2014 17:43:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:43:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571607
Sun 19 Jan 2014 17:43:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:43:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:43:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:44:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:44:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:44:02 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:44:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:44:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:44:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:44:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:44:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:44:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:44:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:44:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:44:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:44:10 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:44:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 17:44:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:44:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:44:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:44:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:44:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:44:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:44:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:44:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:44:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:44:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:44:12 - job_xml_thread(): Done retrieving: data size 43558988
Sun 19 Jan 2014 17:44:12 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:44:12 - XML: Start document: iteration 3
Sun 19 Jan 2014 17:44:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558988
Sun 19 Jan 2014 17:44:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558988
Sun 19 Jan 2014 17:44:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:44:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:44:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:44:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:44:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:44:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:44:31 - XML: Processed 653347 elements - found 0 jobs
Sun 19 Jan 2014 17:44:31 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:44:31 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:44:31 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:44:31 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:44:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:44:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:44:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:44:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:44:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:44:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:44:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:44:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:44:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:44:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:44:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:44:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:44:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:44:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:44:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:44:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:44:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:44:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:44:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43593331
Sun 19 Jan 2014 17:44:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:44:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43593331
Sun 19 Jan 2014 17:44:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:44:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:44:44 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:44:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:44:45 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:44:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 17:44:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 17:44:45 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:44:46 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:44:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8703 values 137147 bits 17143 bytes 
Sun 19 Jan 2014 17:44:46 - job_xml_thread(): Done retrieving: data size 43593331
Sun 19 Jan 2014 17:44:46 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:44:46 - XML: Start document: iteration 4
Sun 19 Jan 2014 17:44:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:44:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:44:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:44:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:44:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:44:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:44:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:44:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:44:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:44:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:44:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:44:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:44:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:45:01 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:45:01 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:45:01 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:45:01 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:45:01 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:45:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:45:03 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:45:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:45:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:45:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:45:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:45:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:45:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:45:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:45:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572360
Sun 19 Jan 2014 17:45:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:45:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572360
Sun 19 Jan 2014 17:45:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:45:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:45:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:45:15 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:45:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 17:45:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:45:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:45:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:45:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:45:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:45:17 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:45:17 - job_xml_thread(): Done retrieving: data size 43572360
Sun 19 Jan 2014 17:45:17 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:45:17 - XML: Start document: iteration 5
Sun 19 Jan 2014 17:45:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:45:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:45:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:45:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:45:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:45:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:45:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:45:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:45:28 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:45:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:45:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:45:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:45:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:45:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:45:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:45:30 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:45:30 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:45:30 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:45:30 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:45:30 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:45:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:45:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:45:32 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 17:45:32 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 17:45:32 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:45:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:45:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43543259
Sun 19 Jan 2014 17:45:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:45:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43543259
Sun 19 Jan 2014 17:45:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:45:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:45:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:45:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:45:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:45:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:45:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:45:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:45:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:45:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:45:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:45:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:45:45 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:45:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:45:45 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:45:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:45:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:45:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:45:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:45:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:45:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 17:45:46 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:45:46 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:45:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 17:45:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5922 values 93396 bits 11674 bytes 
Sun 19 Jan 2014 17:45:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:45:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:45:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:45:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:45:48 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:45:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 17:45:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:45:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:45:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43589558
Sun 19 Jan 2014 17:45:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:45:50 - job_xml_thread(): Done retrieving: data size 43589558
Sun 19 Jan 2014 17:45:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43589558
Sun 19 Jan 2014 17:45:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:45:50 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:45:50 - XML: Start document: iteration 6
Sun 19 Jan 2014 17:45:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:45:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:46:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:46:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:46:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:46:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:46:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:46:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:46:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:46:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:46:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:46:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:46:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:46:08 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:46:08 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:46:08 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:46:08 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:46:08 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:46:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:46:11 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:46:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:46:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:46:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:46:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:46:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:46:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:46:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:46:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566995
Sun 19 Jan 2014 17:46:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:46:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566995
Sun 19 Jan 2014 17:46:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:46:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:46:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:46:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:46:22 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:46:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:46:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:46:24 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:46:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:46:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:46:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:46:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:46:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:46:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:46:26 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:46:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:46:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:46:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:46:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:46:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:46:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:46:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:46:28 - job_xml_thread(): Done retrieving: data size 43581500
Sun 19 Jan 2014 17:46:28 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:46:28 - XML: Start document: iteration 7
Sun 19 Jan 2014 17:46:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581500
Sun 19 Jan 2014 17:46:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581500
Sun 19 Jan 2014 17:46:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:46:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:46:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:46:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:46:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:46:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:46:46 - XML: Processed 653348 elements - found 0 jobs
Sun 19 Jan 2014 17:46:46 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:46:46 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:46:46 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:46:47 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:46:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:46:47 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:46:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:46:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 17:46:48 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:46:48 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:46:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 17:46:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148819 bits 18602 bytes 
Sun 19 Jan 2014 17:46:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:46:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:46:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:46:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:46:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:46:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:46:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:46:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:46:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:46:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:46:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:46:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:46:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:46:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:46:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:46:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:46:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:46:53 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:46:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 17:46:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:46:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:46:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43598544
Sun 19 Jan 2014 17:46:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:46:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43598544
Sun 19 Jan 2014 17:46:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:47:02 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:47:02 - job_xml_thread(): Done retrieving: data size 43598544
Sun 19 Jan 2014 17:47:02 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:47:03 - XML: Start document: iteration 8
Sun 19 Jan 2014 17:47:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:47:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:47:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:47:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:47:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:47:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:47:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:47:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:47:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:47:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:47:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:47:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:47:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:47:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:47:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:47:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:47:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:47:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:47:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:47:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:47:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:47:15 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:47:15 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:47:15 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:47:15 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:47:15 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:47:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:47:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43504071
Sun 19 Jan 2014 17:47:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:47:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43504071
Sun 19 Jan 2014 17:47:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:47:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:47:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:47:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:47:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:47:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:47:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:47:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:47:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:47:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:47:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:47:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:47:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:47:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:47:30 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:47:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:47:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:47:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:47:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:47:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:47:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:47:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:47:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:47:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:47:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43072406
Sun 19 Jan 2014 17:47:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:47:32 - job_xml_thread(): Done retrieving: data size 43072406
Sun 19 Jan 2014 17:47:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43072406
Sun 19 Jan 2014 17:47:32 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:47:32 - XML: Start document: iteration 9
Sun 19 Jan 2014 17:47:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:47:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:47:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:47:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:47:45 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:47:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:47:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:47:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:47:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:47:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:47:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:47:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:47:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:47:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:47:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:47:49 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:47:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:47:49 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:47:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 17:47:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 17:47:49 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:47:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148975 bits 18621 bytes 
Sun 19 Jan 2014 17:47:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:47:55 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:47:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:47:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:47:56 - XML: Processed 647090 elements - found 0 jobs
Sun 19 Jan 2014 17:47:56 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:47:56 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:47:56 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:47:56 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:47:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:47:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:47:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:47:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:47:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:47:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42919870
Sun 19 Jan 2014 17:47:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:47:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42919870
Sun 19 Jan 2014 17:47:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:48:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:48:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:48:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:48:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:48:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:48:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:48:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:48:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:48:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:48:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:48:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:48:11 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:48:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:48:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:48:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:48:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:48:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:48:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:48:14 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:48:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 17:48:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:48:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:48:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:48:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:48:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:48:14 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 17:48:14 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:48:15 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:48:15 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 17:48:15 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 17:48:15 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:48:15 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 17:48:16 - size of cluster 'LISA Cluster': 624 hosts 79477 metrics 793096 values 12522639 bits 1565329 bytes 
Sun 19 Jan 2014 17:48:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:48:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42960517
Sun 19 Jan 2014 17:48:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:48:17 - job_xml_thread(): Done retrieving: data size 42960517
Sun 19 Jan 2014 17:48:17 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:48:17 - XML: Start document: iteration 10
Sun 19 Jan 2014 17:48:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42960517
Sun 19 Jan 2014 17:48:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:48:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:48:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:48:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:48:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:48:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:48:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:48:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:48:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:48:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:48:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:48:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:48:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:48:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:48:34 - XML: Processed 645808 elements - found 0 jobs
Sun 19 Jan 2014 17:48:34 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:48:34 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:48:34 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:48:34 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:48:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:48:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:48:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:48:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:48:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:48:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:48:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:48:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:48:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:48:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43352486
Sun 19 Jan 2014 17:48:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:48:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43352486
Sun 19 Jan 2014 17:48:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:48:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:48:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:48:50 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:48:50 - job_xml_thread(): Done retrieving: data size 43352486
Sun 19 Jan 2014 17:48:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:48:50 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:48:50 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:48:50 - XML: Start document: iteration 11
Sun 19 Jan 2014 17:48:51 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:48:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:48:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 17:48:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 17:48:51 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:48:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8715 values 137592 bits 17199 bytes 
Sun 19 Jan 2014 17:48:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:48:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:48:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:48:59 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:48:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:48:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:49:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:49:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:49:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:49:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:49:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:49:05 - XML: Processed 650500 elements - found 0 jobs
Sun 19 Jan 2014 17:49:05 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:49:05 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:49:05 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:49:05 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:49:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:49:05 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:49:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:49:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:49:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:49:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:49:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:49:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:49:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:49:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570705
Sun 19 Jan 2014 17:49:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:49:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570705
Sun 19 Jan 2014 17:49:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:49:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:49:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:49:15 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:49:15 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 17:49:20 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:49:20 - job_xml_thread(): Done retrieving: data size 43570705
Sun 19 Jan 2014 17:49:20 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:49:20 - XML: Start document: iteration 12
Sun 19 Jan 2014 17:49:20 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:49:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 17:49:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:49:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:49:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:49:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:49:27 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:49:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:49:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:49:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:49:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:49:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:49:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:49:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:49:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:49:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:49:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:49:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:49:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:49:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:49:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:49:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:49:33 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:49:33 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:49:33 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:49:33 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:49:33 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:49:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:49:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571340
Sun 19 Jan 2014 17:49:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:49:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571340
Sun 19 Jan 2014 17:49:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:49:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:49:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:49:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:49:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:49:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:49:47 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:49:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:49:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:49:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:49:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:49:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:49:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:49:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:49:48 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:49:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:49:51 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:49:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:49:52 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:49:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:49:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:49:52 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:49:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 17:49:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:49:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 17:49:52 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:49:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6117 values 96487 bits 12060 bytes 
Sun 19 Jan 2014 17:49:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:49:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:49:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:49:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:49:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:49:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580581
Sun 19 Jan 2014 17:49:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:49:57 - job_xml_thread(): Done retrieving: data size 43580581
Sun 19 Jan 2014 17:49:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580581
Sun 19 Jan 2014 17:49:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:49:57 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:49:57 - XML: Start document: iteration 13
Sun 19 Jan 2014 17:50:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:50:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:50:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:50:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:50:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:50:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:50:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:50:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:50:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:50:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:50:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:50:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:50:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:50:15 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:50:15 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:50:15 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:50:15 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:50:15 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:50:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:50:17 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:50:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:50:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:50:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:50:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:50:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:50:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:50:18 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:50:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 17:50:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:50:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:50:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561323
Sun 19 Jan 2014 17:50:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:50:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561323
Sun 19 Jan 2014 17:50:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:50:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:50:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:50:31 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:50:31 - job_xml_thread(): Done retrieving: data size 43561323
Sun 19 Jan 2014 17:50:31 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:50:31 - XML: Start document: iteration 14
Sun 19 Jan 2014 17:50:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:50:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:50:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:50:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:50:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:50:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:50:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:50:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:50:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:50:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:50:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:50:43 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:50:43 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:50:43 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:50:43 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:50:43 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:50:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:50:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:50:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:50:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:50:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:50:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:50:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:50:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:50:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:50:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578166
Sun 19 Jan 2014 17:50:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:50:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578166
Sun 19 Jan 2014 17:50:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:50:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:50:52 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:50:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:50:53 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:50:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 17:50:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 17:50:54 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:50:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8675 values 136777 bits 17097 bytes 
Sun 19 Jan 2014 17:50:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:50:57 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:50:58 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:50:58 - job_xml_thread(): Done retrieving: data size 43578166
Sun 19 Jan 2014 17:50:58 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:50:58 - XML: Start document: iteration 15
Sun 19 Jan 2014 17:50:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:50:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:50:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:50:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:50:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:50:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:50:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:51:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:51:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:51:07 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:51:07 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:51:07 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:51:07 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:51:07 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:51:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:51:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:51:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:51:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:51:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:51:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:51:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:51:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:51:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:51:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:51:15 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:51:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 17:51:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:51:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:51:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553961
Sun 19 Jan 2014 17:51:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:51:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553961
Sun 19 Jan 2014 17:51:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:51:22 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:51:22 - job_xml_thread(): Done retrieving: data size 43553961
Sun 19 Jan 2014 17:51:22 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:51:22 - XML: Start document: iteration 16
Sun 19 Jan 2014 17:51:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:51:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:51:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:51:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:51:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:51:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:51:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:51:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:51:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:51:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:51:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:51:36 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:51:36 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:51:36 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:51:36 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:51:36 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:51:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:51:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:51:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:51:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:51:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:51:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:51:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:51:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:51:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:51:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583644
Sun 19 Jan 2014 17:51:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:51:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583644
Sun 19 Jan 2014 17:51:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:51:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:51:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:51:51 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:51:51 - job_xml_thread(): Done retrieving: data size 43583644
Sun 19 Jan 2014 17:51:51 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:51:51 - XML: Start document: iteration 17
Sun 19 Jan 2014 17:51:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:51:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:51:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:51:54 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:51:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:51:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 17:51:55 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:51:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99072 bits 12384 bytes 
Sun 19 Jan 2014 17:51:55 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:51:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 17:51:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:51:59 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:51:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:51:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:52:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:52:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:52:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:52:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:52:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:52:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:52:04 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:52:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:52:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:52:04 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:52:04 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:52:04 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:52:04 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:52:04 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:52:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:52:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:52:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:52:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:52:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:52:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584462
Sun 19 Jan 2014 17:52:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:52:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584462
Sun 19 Jan 2014 17:52:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:52:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:52:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:52:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:52:19 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:52:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:52:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:52:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:52:19 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:52:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:52:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:52:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:52:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:52:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:52:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:52:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:52:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:52:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:52:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:52:24 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:52:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 17:52:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:52:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:52:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:52:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:52:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:52:25 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 17:52:25 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 17:52:25 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:52:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:52:26 - job_xml_thread(): Done retrieving: data size 43583061
Sun 19 Jan 2014 17:52:26 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:52:26 - XML: Start document: iteration 18
Sun 19 Jan 2014 17:52:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583061
Sun 19 Jan 2014 17:52:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583061
Sun 19 Jan 2014 17:52:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:52:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:52:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:52:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:52:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:52:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:52:42 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:52:42 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:52:42 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:52:42 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:52:42 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:52:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:52:43 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:52:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:52:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:52:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:52:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:52:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:52:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:52:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:52:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:52:47 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:52:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:52:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:52:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:52:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:52:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:52:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:52:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:52:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43585980
Sun 19 Jan 2014 17:52:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:52:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43585980
Sun 19 Jan 2014 17:52:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:52:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:52:56 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:52:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:52:58 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:52:58 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:52:58 - job_xml_thread(): Done retrieving: data size 43585980
Sun 19 Jan 2014 17:52:58 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:52:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:52:58 - XML: Start document: iteration 19
Sun 19 Jan 2014 17:52:58 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:52:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 17:52:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 17:52:58 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:52:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9041 values 142616 bits 17827 bytes 
Sun 19 Jan 2014 17:53:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:53:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:53:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:53:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:53:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:53:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:53:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:53:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:53:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:53:06 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:53:06 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:53:06 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:53:06 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:53:06 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:53:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:53:11 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:53:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:53:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:53:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:53:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:53:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:53:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:53:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:53:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43535349
Sun 19 Jan 2014 17:53:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:53:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43535349
Sun 19 Jan 2014 17:53:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:53:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:53:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:53:21 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:53:22 - job_xml_thread(): Done retrieving: data size 43535349
Sun 19 Jan 2014 17:53:22 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:53:22 - XML: Start document: iteration 20
Sun 19 Jan 2014 17:53:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:53:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:53:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:53:31 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:53:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:53:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:53:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:53:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:53:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:53:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:53:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:53:35 - XML: Processed 653023 elements - found 0 jobs
Sun 19 Jan 2014 17:53:35 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:53:35 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:53:35 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:53:35 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:53:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:53:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:53:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:53:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:53:37 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:53:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 17:53:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:53:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:53:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:53:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:53:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:53:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:53:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43047070
Sun 19 Jan 2014 17:53:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:53:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43047070
Sun 19 Jan 2014 17:53:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:53:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:53:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:53:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:53:47 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:53:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:53:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:53:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:53:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:53:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:53:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43047070
Sun 19 Jan 2014 17:53:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:53:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:53:50 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:53:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:53:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:53:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:53:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:53:58 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:53:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:53:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 17:53:58 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:53:58 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:53:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 17:53:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5345 values 84250 bits 10531 bytes 
Sun 19 Jan 2014 17:54:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:54:00 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:54:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:54:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:54:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:54:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:54:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:54:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:54:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:54:01 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:54:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:54:03 - job_xml_thread(): Done retrieving: data size 42891081
Sun 19 Jan 2014 17:54:03 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:54:03 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 17:54:03 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 17:54:03 - Housekeeping: done.
Sun 19 Jan 2014 17:54:03 - XML: Start document: iteration 0
Sun 19 Jan 2014 17:54:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:54:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:54:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42891081
Sun 19 Jan 2014 17:54:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:54:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:54:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:54:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42891081
Sun 19 Jan 2014 17:54:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:54:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:54:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:54:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:54:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:54:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:54:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:54:21 - XML: Processed 645298 elements - found 0 jobs
Sun 19 Jan 2014 17:54:21 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:54:22 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:54:22 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:54:22 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:54:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:54:25 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:54:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:54:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:54:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:54:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:54:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:54:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:54:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:54:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:54:27 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:54:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:54:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:54:27 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:54:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 17:54:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:54:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:54:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:54:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:54:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:54:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:54:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43121258
Sun 19 Jan 2014 17:54:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:54:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43121258
Sun 19 Jan 2014 17:54:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:54:38 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:54:38 - job_xml_thread(): Done retrieving: data size 43121258
Sun 19 Jan 2014 17:54:38 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:54:38 - XML: Start document: iteration 1
Sun 19 Jan 2014 17:54:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:54:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:54:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:54:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:54:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:54:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:54:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:54:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:54:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:54:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:54:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:54:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:54:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:54:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:54:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:54:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:54:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:54:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:54:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:54:49 - XML: Processed 647628 elements - found 0 jobs
Sun 19 Jan 2014 17:54:49 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:54:49 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:54:49 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:54:49 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:54:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:54:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43517510
Sun 19 Jan 2014 17:54:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:54:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43517510
Sun 19 Jan 2014 17:54:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:54:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:54:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:54:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:54:59 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:55:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:55:00 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:55:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 17:55:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 17:55:00 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:55:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8879 values 139969 bits 17496 bytes 
Sun 19 Jan 2014 17:55:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:55:01 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:55:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:55:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:55:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:55:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:55:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:55:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:55:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:55:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:55:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:55:04 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:55:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:55:06 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:55:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:55:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:55:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:55:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:55:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:55:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:55:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:55:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582731
Sun 19 Jan 2014 17:55:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:55:08 - job_xml_thread(): Done retrieving: data size 43582731
Sun 19 Jan 2014 17:55:08 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:55:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582731
Sun 19 Jan 2014 17:55:08 - XML: Start document: iteration 2
Sun 19 Jan 2014 17:55:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:55:16 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 17:55:16 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:55:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:55:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:55:19 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:55:19 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 17:55:19 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 17:55:19 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:55:19 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 17:55:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:55:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:55:25 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:55:25 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:55:25 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:55:25 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:55:25 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:55:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:55:27 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:55:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:55:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:55:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:55:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:55:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:55:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:55:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:55:29 - size of cluster 'LISA Cluster': 624 hosts 79482 metrics 825481 values 13014187 bits 1626773 bytes 
Sun 19 Jan 2014 17:55:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:55:31 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:55:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:55:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:55:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:55:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:55:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:55:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:55:31 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:55:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 17:55:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:55:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:55:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563432
Sun 19 Jan 2014 17:55:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:55:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563432
Sun 19 Jan 2014 17:55:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:55:40 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:55:40 - job_xml_thread(): Done retrieving: data size 43563432
Sun 19 Jan 2014 17:55:40 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:55:40 - XML: Start document: iteration 3
Sun 19 Jan 2014 17:55:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:55:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:55:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:55:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:55:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:55:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:55:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:55:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:55:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:55:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:55:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:55:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:55:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:55:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:55:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:55:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:55:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:55:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:55:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:55:56 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:55:56 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:55:56 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:55:56 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:55:56 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:55:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:55:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561426
Sun 19 Jan 2014 17:55:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:56:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561426
Sun 19 Jan 2014 17:56:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:56:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:56:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:56:01 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:56:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:56:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:56:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 17:56:01 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:56:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 17:56:01 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:56:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8934 values 140902 bits 17612 bytes 
Sun 19 Jan 2014 17:56:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:56:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:56:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:56:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:56:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:56:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:56:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561426
Sun 19 Jan 2014 17:56:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:56:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:56:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:56:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:56:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:56:11 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:56:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:56:19 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:56:19 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 17:56:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:56:21 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:56:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:56:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:56:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:56:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:56:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:56:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:56:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:56:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:56:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:56:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:56:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:56:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:56:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:56:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:56:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:56:27 - job_xml_thread(): Done retrieving: data size 43561587
Sun 19 Jan 2014 17:56:27 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:56:27 - XML: Start document: iteration 4
Sun 19 Jan 2014 17:56:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561587
Sun 19 Jan 2014 17:56:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:56:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561587
Sun 19 Jan 2014 17:56:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:56:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:56:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:56:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:56:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:56:41 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:56:41 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:56:41 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:56:41 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:56:41 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:56:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:56:47 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:56:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:56:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:56:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:56:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:56:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:56:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:56:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:56:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:56:52 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:56:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:56:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:56:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:56:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:56:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:56:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:56:52 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:56:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 17:56:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:56:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:56:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43601529
Sun 19 Jan 2014 17:56:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:56:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43601529
Sun 19 Jan 2014 17:56:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:56:57 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:56:57 - job_xml_thread(): Done retrieving: data size 43601529
Sun 19 Jan 2014 17:56:57 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:56:57 - XML: Start document: iteration 5
Sun 19 Jan 2014 17:57:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:57:01 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:57:03 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:57:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 17:57:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:57:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 17:57:03 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:57:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5738 values 90441 bits 11305 bytes 
Sun 19 Jan 2014 17:57:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:57:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:57:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:57:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:57:08 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:57:08 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:57:08 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:57:08 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:57:08 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:57:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:57:14 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:57:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:57:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:57:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:57:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:57:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:57:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:57:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:57:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:57:19 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:57:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:57:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:57:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:57:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:57:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:57:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:57:23 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:57:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:57:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581164
Sun 19 Jan 2014 17:57:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:57:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581164
Sun 19 Jan 2014 17:57:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:57:24 - job_xml_thread(): Done retrieving: data size 43581164
Sun 19 Jan 2014 17:57:24 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:57:24 - XML: Start document: iteration 6
Sun 19 Jan 2014 17:57:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:57:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:57:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:57:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:57:43 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:57:43 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:57:43 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:57:43 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:57:43 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:57:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:57:44 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:57:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:57:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:57:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:57:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:57:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:57:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:57:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:57:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:57:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:57:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:57:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:57:46 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:57:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 17:57:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:57:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:57:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:57:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:57:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:57:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:57:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581569
Sun 19 Jan 2014 17:57:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:57:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581569
Sun 19 Jan 2014 17:57:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:57:59 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:57:59 - job_xml_thread(): Done retrieving: data size 43581569
Sun 19 Jan 2014 17:57:59 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:57:59 - XML: Start document: iteration 7
Sun 19 Jan 2014 17:58:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:58:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:58:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:58:01 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:58:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:58:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:58:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:58:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:58:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:58:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:58:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:58:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:58:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:58:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:58:04 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:58:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:58:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 17:58:04 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:58:05 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:58:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 17:58:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5878 values 92694 bits 11586 bytes 
Sun 19 Jan 2014 17:58:10 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:58:10 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:58:10 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:58:10 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:58:10 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:58:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:58:14 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:58:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:58:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:58:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:58:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:58:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:58:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:58:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:58:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:58:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:58:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43549812
Sun 19 Jan 2014 17:58:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:58:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43549812
Sun 19 Jan 2014 17:58:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:58:25 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:58:25 - job_xml_thread(): Done retrieving: data size 43549812
Sun 19 Jan 2014 17:58:25 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:58:25 - XML: Start document: iteration 8
Sun 19 Jan 2014 17:58:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:58:30 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:58:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:58:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:58:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:58:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:58:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:58:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:58:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:58:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:58:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:58:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:58:37 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:58:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:58:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:58:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:58:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:58:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:58:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:58:41 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:58:41 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:58:41 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:58:41 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:58:41 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:58:41 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:58:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 17:58:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:58:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:58:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565783
Sun 19 Jan 2014 17:58:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:58:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565783
Sun 19 Jan 2014 17:58:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:58:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:58:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:58:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:58:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:58:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:58:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:58:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:58:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:58:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:58:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:58:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:58:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565783
Sun 19 Jan 2014 17:58:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:58:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:58:56 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:58:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:59:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:59:04 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:59:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:59:06 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:59:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:59:06 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:59:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 17:59:06 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:59:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 17:59:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5803 values 91508 bits 11438 bytes 
Sun 19 Jan 2014 17:59:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:59:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:59:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:59:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:59:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:59:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:59:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:59:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:59:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:59:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:59:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:59:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:59:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:59:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:59:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:59:12 - job_xml_thread(): Done retrieving: data size 43567552
Sun 19 Jan 2014 17:59:12 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:59:12 - XML: Start document: iteration 9
Sun 19 Jan 2014 17:59:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567552
Sun 19 Jan 2014 17:59:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:59:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567552
Sun 19 Jan 2014 17:59:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:59:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:59:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:59:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:59:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:59:27 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 17:59:27 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:59:27 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:59:27 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:59:27 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 17:59:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:59:31 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:59:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:59:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:59:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:59:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:59:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:59:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:59:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:59:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 17:59:35 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 17:59:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 17:59:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 17:59:35 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 17:59:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 17:59:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:59:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:59:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 17:59:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 17:59:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 17:59:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 17:59:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43041893
Sun 19 Jan 2014 17:59:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 17:59:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43041893
Sun 19 Jan 2014 17:59:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 17:59:42 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 17:59:42 - job_xml_thread(): Done retrieving: data size 43041893
Sun 19 Jan 2014 17:59:43 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 17:59:43 - XML: Start document: iteration 10
Sun 19 Jan 2014 17:59:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 17:59:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:59:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 17:59:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 17:59:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 17:59:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 17:59:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 17:59:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 17:59:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:59:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 17:59:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 17:59:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 17:59:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 17:59:55 - XML: Processed 646630 elements - found 0 jobs
Sun 19 Jan 2014 17:59:55 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 17:59:55 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 17:59:55 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 17:59:56 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:00:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:00:01 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:00:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:00:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:00:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:00:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:00:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:00:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:00:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:00:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42896661
Sun 19 Jan 2014 18:00:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:00:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42896661
Sun 19 Jan 2014 18:00:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:00:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:00:06 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:00:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:00:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 18:00:07 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:00:07 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:00:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9011 values 142068 bits 17758 bytes 
Sun 19 Jan 2014 18:00:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 18:00:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:00:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:00:11 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:00:11 - job_xml_thread(): Done retrieving: data size 42896661
Sun 19 Jan 2014 18:00:11 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:00:11 - XML: Start document: iteration 11
Sun 19 Jan 2014 18:00:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:00:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:00:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:00:18 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:00:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:00:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:00:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:00:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:00:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:00:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:00:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:00:27 - XML: Processed 645150 elements - found 0 jobs
Sun 19 Jan 2014 18:00:27 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:00:27 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:00:27 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:00:27 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:00:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:00:28 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:00:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:00:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:00:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:00:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:00:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:00:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:00:31 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 18:00:31 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 18:00:31 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:00:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:00:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43032599
Sun 19 Jan 2014 18:00:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:00:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43032599
Sun 19 Jan 2014 18:00:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:00:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:00:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:00:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:00:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:00:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:00:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:00:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:00:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:00:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:00:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:00:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:00:42 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:00:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:00:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:00:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:00:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:00:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:00:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:00:46 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:00:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 18:00:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:00:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:00:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:00:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:00:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:00:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:00:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43505284
Sun 19 Jan 2014 18:00:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:00:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43505284
Sun 19 Jan 2014 18:00:49 - job_xml_thread(): Done retrieving: data size 43505284
Sun 19 Jan 2014 18:00:49 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:00:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:00:49 - XML: Start document: iteration 12
Sun 19 Jan 2014 18:00:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:00:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:01:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:01:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:01:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:01:04 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:01:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:01:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:01:05 - XML: Processed 652540 elements - found 0 jobs
Sun 19 Jan 2014 18:01:06 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:01:06 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:01:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:01:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:01:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:01:06 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:01:06 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:01:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:01:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:01:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:01:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:01:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:01:08 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:01:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:01:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:01:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:01:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 18:01:08 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:01:08 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:01:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5803 values 91541 bits 11442 bytes 
Sun 19 Jan 2014 18:01:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 18:01:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:01:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:01:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:01:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:01:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:01:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43591019
Sun 19 Jan 2014 18:01:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:01:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43591019
Sun 19 Jan 2014 18:01:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:01:21 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:01:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:01:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:01:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:01:22 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:01:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 18:01:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:01:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:01:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:01:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:01:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:01:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:01:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:01:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:01:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:01:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:01:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:01:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:01:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:01:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:01:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:01:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:01:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:01:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:01:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:01:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:01:26 - job_xml_thread(): Done retrieving: data size 43580466
Sun 19 Jan 2014 18:01:26 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:01:26 - XML: Start document: iteration 13
Sun 19 Jan 2014 18:01:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580466
Sun 19 Jan 2014 18:01:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:01:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580466
Sun 19 Jan 2014 18:01:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:01:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:01:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:01:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:01:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:01:43 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 18:01:43 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:01:43 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:01:43 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:01:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:01:43 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:01:43 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:01:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:01:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:01:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:01:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:01:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:01:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:01:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:01:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:01:47 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:01:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:01:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:01:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:01:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:01:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:01:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:01:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:01:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579971
Sun 19 Jan 2014 18:01:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:01:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579971
Sun 19 Jan 2014 18:01:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:01:58 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:01:58 - job_xml_thread(): Done retrieving: data size 43579971
Sun 19 Jan 2014 18:01:58 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:01:58 - XML: Start document: iteration 14
Sun 19 Jan 2014 18:01:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:01:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:02:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:02:00 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:02:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:02:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:02:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:02:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:02:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:02:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:02:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:02:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:02:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:02:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:02:08 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:02:09 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:02:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 18:02:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:02:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 18:02:09 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:02:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9222 values 145808 bits 18226 bytes 
Sun 19 Jan 2014 18:02:10 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:02:10 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:02:10 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:02:10 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:02:10 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:02:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:02:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:02:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:02:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:02:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:02:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:02:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:02:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:02:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:02:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43543899
Sun 19 Jan 2014 18:02:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:02:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43543899
Sun 19 Jan 2014 18:02:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:02:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:02:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:02:20 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 18:02:20 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:02:21 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:02:21 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:02:21 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 18:02:21 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 18:02:21 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 18:02:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:02:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:02:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:02:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:02:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:02:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:02:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:02:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:02:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:02:25 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:02:25 - size of cluster 'LISA Cluster': 624 hosts 79473 metrics 719515 values 11352914 bits 1419114 bytes 
Sun 19 Jan 2014 18:02:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:02:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:02:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:02:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:02:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:02:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:02:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:02:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:02:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:02:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:02:31 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:02:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 18:02:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:02:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:02:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563481
Sun 19 Jan 2014 18:02:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:02:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563481
Sun 19 Jan 2014 18:02:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:02:34 - job_xml_thread(): Done retrieving: data size 43563481
Sun 19 Jan 2014 18:02:34 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:02:34 - XML: Start document: iteration 15
Sun 19 Jan 2014 18:02:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:02:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:02:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:02:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:02:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:02:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:02:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:02:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:02:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:02:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:02:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:02:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:02:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:02:50 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:02:50 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:02:50 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:02:50 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:02:50 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:02:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:02:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:02:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:02:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:02:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:02:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:02:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:02:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:03:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:03:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567328
Sun 19 Jan 2014 18:03:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:03:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567328
Sun 19 Jan 2014 18:03:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:03:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:03:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:03:05 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:03:05 - job_xml_thread(): Done retrieving: data size 43567328
Sun 19 Jan 2014 18:03:05 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:03:05 - XML: Start document: iteration 16
Sun 19 Jan 2014 18:03:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:03:09 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:03:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:03:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 18:03:12 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:03:12 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:03:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 18:03:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8638 values 136687 bits 17085 bytes 
Sun 19 Jan 2014 18:03:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:03:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:03:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:03:19 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:03:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:03:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:03:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:03:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:03:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:03:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:03:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:03:21 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:03:21 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 18:03:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:03:24 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:03:24 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:03:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:03:24 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:03:24 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:03:24 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:03:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:03:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:03:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:03:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:03:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:03:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:03:29 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:03:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 18:03:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:03:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:03:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563382
Sun 19 Jan 2014 18:03:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:03:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563382
Sun 19 Jan 2014 18:03:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:03:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:03:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:03:39 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:03:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:03:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:03:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:03:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:03:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:03:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:03:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:03:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:03:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:03:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:03:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:03:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:03:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:03:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:03:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:03:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:03:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:03:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:03:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:03:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:03:47 - job_xml_thread(): Done retrieving: data size 43568209
Sun 19 Jan 2014 18:03:47 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:03:47 - XML: Start document: iteration 17
Sun 19 Jan 2014 18:03:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568209
Sun 19 Jan 2014 18:03:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:03:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568209
Sun 19 Jan 2014 18:03:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:03:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:03:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:03:58 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:03:58 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:03:58 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:03:58 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:03:58 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:03:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:04:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:04:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:04:07 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:04:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:04:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:04:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:04:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:04:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:04:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:04:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:04:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:04:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:04:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:04:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:04:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:04:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:04:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:04:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:04:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:04:12 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:04:12 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:04:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:04:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 18:04:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 18:04:12 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:04:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99192 bits 12399 bytes 
Sun 19 Jan 2014 18:04:13 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:04:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:04:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569077
Sun 19 Jan 2014 18:04:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:04:17 - job_xml_thread(): Done retrieving: data size 43569077
Sun 19 Jan 2014 18:04:17 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:04:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569077
Sun 19 Jan 2014 18:04:17 - XML: Start document: iteration 18
Sun 19 Jan 2014 18:04:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:04:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:04:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:04:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:04:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:04:31 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:04:31 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:04:31 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:04:31 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:04:31 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:04:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:04:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:04:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:04:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:04:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:04:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:04:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:04:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:04:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:04:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:04:39 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:04:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:04:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:04:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:04:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:04:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:04:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:04:40 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:04:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 18:04:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:04:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:04:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584276
Sun 19 Jan 2014 18:04:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:04:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584276
Sun 19 Jan 2014 18:04:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:04:47 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:04:48 - job_xml_thread(): Done retrieving: data size 43584276
Sun 19 Jan 2014 18:04:48 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:04:48 - XML: Start document: iteration 19
Sun 19 Jan 2014 18:04:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:04:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:04:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:04:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:04:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:04:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:04:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:04:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:04:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:04:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584276
Sun 19 Jan 2014 18:04:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:04:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:04:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:04:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:05:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:05:07 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:05:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:05:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:05:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:05:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:05:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:05:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:05:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:05:12 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:05:12 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:05:12 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:05:12 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:05:12 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:05:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:05:12 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:05:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:05:13 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:05:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 18:05:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 18:05:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:05:13 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:05:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:05:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5146 values 81144 bits 10143 bytes 
Sun 19 Jan 2014 18:05:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:05:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:05:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:05:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:05:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:05:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:05:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:05:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43496600
Sun 19 Jan 2014 18:05:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:05:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43496600
Sun 19 Jan 2014 18:05:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:05:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:05:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:05:27 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:05:27 - job_xml_thread(): Done retrieving: data size 43496600
Sun 19 Jan 2014 18:05:27 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:05:27 - XML: Start document: iteration 20
Sun 19 Jan 2014 18:05:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:05:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:05:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:05:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:05:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:05:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:05:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:05:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:05:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:05:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:05:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:05:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:05:41 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:05:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:05:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:05:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:05:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:05:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:05:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:05:41 - XML: Processed 652602 elements - found 0 jobs
Sun 19 Jan 2014 18:05:41 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:05:41 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:05:41 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:05:41 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:05:41 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:05:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 18:05:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:05:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:05:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42987709
Sun 19 Jan 2014 18:05:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:05:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42987709
Sun 19 Jan 2014 18:05:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:05:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:05:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:05:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:05:54 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:05:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:05:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:05:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:05:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:05:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:05:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:05:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:05:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:05:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:05:56 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:05:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:05:59 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:05:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:05:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:06:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:06:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:06:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:06:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:06:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:06:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42904319
Sun 19 Jan 2014 18:06:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:06:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42904319
Sun 19 Jan 2014 18:06:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:06:04 - job_xml_thread(): Done retrieving: data size 42904319
Sun 19 Jan 2014 18:06:04 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:06:04 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 18:06:04 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 18:06:04 - Housekeeping: done.
Sun 19 Jan 2014 18:06:04 - XML: Start document: iteration 0
Sun 19 Jan 2014 18:06:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:06:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:06:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:06:13 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:06:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:06:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 18:06:14 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:06:14 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:06:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 18:06:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:06:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:06:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:06:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:06:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:06:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:06:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9046 values 142773 bits 17846 bytes 
Sun 19 Jan 2014 18:06:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:06:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:06:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:06:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:06:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:06:24 - XML: Processed 645152 elements - found 0 jobs
Sun 19 Jan 2014 18:06:24 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:06:24 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:06:24 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:06:24 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:06:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:06:25 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:06:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:06:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:06:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:06:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:06:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:06:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:06:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:06:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43026431
Sun 19 Jan 2014 18:06:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:06:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43026431
Sun 19 Jan 2014 18:06:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:06:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:06:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:06:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:06:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:06:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:06:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:06:39 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:06:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:06:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:06:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:06:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:06:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:06:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:06:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:06:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:06:45 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:06:45 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:06:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 18:06:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:06:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:06:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:06:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:06:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:06:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:06:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:06:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:06:48 - job_xml_thread(): Done retrieving: data size 43500224
Sun 19 Jan 2014 18:06:48 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:06:48 - XML: Start document: iteration 1
Sun 19 Jan 2014 18:06:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43500224
Sun 19 Jan 2014 18:06:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:06:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43500224
Sun 19 Jan 2014 18:06:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:06:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:06:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:07:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:07:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:07:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:07:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:07:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:07:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:07:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:07:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:07:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:07:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:07:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:07:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:07:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:07:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:07:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:07:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:07:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:07:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:07:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:07:11 - XML: Processed 652624 elements - found 0 jobs
Sun 19 Jan 2014 18:07:11 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:07:11 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:07:11 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:07:11 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:07:13 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 18:07:13 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 18:07:13 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:07:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:07:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570262
Sun 19 Jan 2014 18:07:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:07:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:07:14 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:07:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570262
Sun 19 Jan 2014 18:07:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:07:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:07:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 18:07:15 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:07:15 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:07:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9092 values 143480 bits 17935 bytes 
Sun 19 Jan 2014 18:07:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 18:07:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:07:22 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:07:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:07:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:07:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:07:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:07:26 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:07:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:07:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:07:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:07:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:07:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:07:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:07:27 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:07:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:07:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:07:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:07:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:07:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:07:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:07:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:07:29 - job_xml_thread(): Done retrieving: data size 43569007
Sun 19 Jan 2014 18:07:29 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:07:29 - XML: Start document: iteration 2
Sun 19 Jan 2014 18:07:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569007
Sun 19 Jan 2014 18:07:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:07:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569007
Sun 19 Jan 2014 18:07:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:07:41 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:07:41 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:07:41 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:07:41 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:07:41 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:07:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:07:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:07:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:07:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:07:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:07:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:07:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:07:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:07:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:07:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:07:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:07:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:07:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:07:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:07:52 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:07:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:07:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:07:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:07:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:07:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:07:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:07:52 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:07:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 18:07:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:07:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:07:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43596552
Sun 19 Jan 2014 18:07:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:07:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43596552
Sun 19 Jan 2014 18:07:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:07:57 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:07:57 - job_xml_thread(): Done retrieving: data size 43596552
Sun 19 Jan 2014 18:07:57 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:07:57 - XML: Start document: iteration 3
Sun 19 Jan 2014 18:08:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:08:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:08:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:08:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:08:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:08:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:08:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:08:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:08:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:08:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:08:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:08:10 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:08:10 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:08:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:08:10 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:08:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:08:10 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:08:10 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:08:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:08:14 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:08:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:08:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:08:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:08:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:08:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:08:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:08:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:08:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564150
Sun 19 Jan 2014 18:08:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:08:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:08:16 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:08:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564150
Sun 19 Jan 2014 18:08:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:08:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:08:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 18:08:17 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:08:17 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:08:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 18:08:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9067 values 143071 bits 17883 bytes 
Sun 19 Jan 2014 18:08:25 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:08:25 - job_xml_thread(): Done retrieving: data size 43564150
Sun 19 Jan 2014 18:08:25 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:08:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:08:25 - XML: Start document: iteration 4
Sun 19 Jan 2014 18:08:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:08:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:08:25 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:08:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:08:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:08:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:08:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:08:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:08:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:08:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:08:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:08:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:08:36 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:08:36 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:08:36 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:08:36 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:08:36 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:08:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:08:37 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:08:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:08:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:08:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:08:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:08:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:08:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:08:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:08:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570918
Sun 19 Jan 2014 18:08:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570918
Sun 19 Jan 2014 18:08:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:08:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:08:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:08:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:08:51 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:08:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:08:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:08:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:08:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:08:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:08:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:08:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:08:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:08:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:08:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:08:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:08:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:08:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:08:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:08:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:08:55 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:08:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 18:08:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:08:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:08:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:08:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:08:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:08:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:08:56 - job_xml_thread(): Done retrieving: data size 43598661
Sun 19 Jan 2014 18:08:56 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:08:56 - XML: Start document: iteration 5
Sun 19 Jan 2014 18:08:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43598661
Sun 19 Jan 2014 18:08:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:08:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43598661
Sun 19 Jan 2014 18:08:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:09:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:09:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:09:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:09:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:09:11 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:09:11 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:09:11 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:09:11 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:09:11 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:09:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:09:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:09:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:09:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:09:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:09:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:09:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:09:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:09:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:09:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:09:17 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:09:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:09:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:09:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:09:17 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:09:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:09:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:09:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:09:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:09:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:09:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 18:09:18 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:09:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5750 values 90635 bits 11329 bytes 
Sun 19 Jan 2014 18:09:18 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:09:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 18:09:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:09:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579417
Sun 19 Jan 2014 18:09:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:09:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579417
Sun 19 Jan 2014 18:09:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:09:22 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 18:09:22 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:09:23 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:09:23 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:09:23 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 18:09:23 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 18:09:23 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 18:09:26 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:09:26 - job_xml_thread(): Done retrieving: data size 43579417
Sun 19 Jan 2014 18:09:26 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:09:27 - XML: Start document: iteration 6
Sun 19 Jan 2014 18:09:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:09:28 - ganglia_parse_thread(): finished: Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sun 19 Jan 2014 18:09:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:09:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:09:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:09:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:09:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:09:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:09:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:09:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:09:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:09:37 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:09:37 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:09:37 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:09:37 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:09:37 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:09:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:09:40 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:09:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:09:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:09:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:09:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:09:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:09:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:09:42 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:09:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 18:09:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:09:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:09:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567045
Sun 19 Jan 2014 18:09:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:09:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567045
Sun 19 Jan 2014 18:09:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:09:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:09:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:09:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:09:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:09:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:09:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:09:52 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:09:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:09:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:09:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:09:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:09:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:09:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:09:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:09:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:09:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:09:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:09:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:09:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:09:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:09:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:09:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:09:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:09:58 - job_xml_thread(): Done retrieving: data size 43577551
Sun 19 Jan 2014 18:09:58 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:09:58 - XML: Start document: iteration 7
Sun 19 Jan 2014 18:09:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577551
Sun 19 Jan 2014 18:10:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577551
Sun 19 Jan 2014 18:10:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:10:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:10:08 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:10:08 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:10:09 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:10:09 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:10:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:10:09 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:10:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:10:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:10:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:10:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:10:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:10:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:10:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:10:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:10:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:10:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:10:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:10:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:10:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:10:18 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:10:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:10:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 18:10:18 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:10:18 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:10:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 18:10:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7205 values 113567 bits 14195 bytes 
Sun 19 Jan 2014 18:10:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:10:19 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:10:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:10:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:10:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:10:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:10:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:10:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:10:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:10:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43590301
Sun 19 Jan 2014 18:10:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:10:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43590301
Sun 19 Jan 2014 18:10:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:10:23 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:10:23 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:10:25 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:10:25 - job_xml_thread(): Done retrieving: data size 43590301
Sun 19 Jan 2014 18:10:25 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:10:25 - XML: Start document: iteration 8
Sun 19 Jan 2014 18:10:25 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:10:25 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 18:10:25 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:10:25 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 18:10:25 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 18:10:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:10:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:10:33 - size of cluster 'LISA Cluster': 624 hosts 79469 metrics 850029 values 13400782 bits 1675097 bytes 
Sun 19 Jan 2014 18:10:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:10:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:10:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:10:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:10:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:10:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:10:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:10:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:10:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:10:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:10:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:10:44 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:10:44 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:10:44 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:10:44 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:10:44 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:10:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:10:47 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:10:47 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:10:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 18:10:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:10:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:10:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:10:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:10:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:10:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:10:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:10:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:10:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564870
Sun 19 Jan 2014 18:10:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:10:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564870
Sun 19 Jan 2014 18:10:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:10:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:10:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:10:59 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:10:59 - job_xml_thread(): Done retrieving: data size 43564870
Sun 19 Jan 2014 18:10:59 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:11:00 - XML: Start document: iteration 9
Sun 19 Jan 2014 18:11:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:11:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:11:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:11:04 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:11:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:11:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:11:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:11:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:11:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:11:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:11:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:11:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:11:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:11:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:11:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:11:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:11:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:11:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:11:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:11:12 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:11:12 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:11:12 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:11:12 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:11:12 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:11:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:11:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43494571
Sun 19 Jan 2014 18:11:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:11:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43494571
Sun 19 Jan 2014 18:11:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:11:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:11:19 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:11:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:11:20 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:11:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 18:11:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 18:11:20 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:11:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8736 values 137752 bits 17219 bytes 
Sun 19 Jan 2014 18:11:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:11:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:11:25 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:11:25 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 18:11:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:11:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:11:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:11:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:11:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:11:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:11:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:11:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:11:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:11:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:11:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:11:27 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:11:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:11:31 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:11:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:11:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:11:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:11:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:11:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:11:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:11:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:11:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43141175
Sun 19 Jan 2014 18:11:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:11:36 - job_xml_thread(): Done retrieving: data size 43141175
Sun 19 Jan 2014 18:11:37 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:11:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43141175
Sun 19 Jan 2014 18:11:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:11:37 - XML: Start document: iteration 10
Sun 19 Jan 2014 18:11:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:11:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:11:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:11:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:11:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:11:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:11:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:11:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:11:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:11:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:11:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:11:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:11:57 - XML: Processed 648034 elements - found 0 jobs
Sun 19 Jan 2014 18:11:57 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:11:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:11:57 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:11:57 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:11:57 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:12:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:12:00 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:12:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:12:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:12:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:12:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:12:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:12:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:12:01 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:12:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 18:12:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:12:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:12:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42908981
Sun 19 Jan 2014 18:12:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:12:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42908981
Sun 19 Jan 2014 18:12:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:12:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:12:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:12:12 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:12:12 - job_xml_thread(): Done retrieving: data size 42908981
Sun 19 Jan 2014 18:12:12 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:12:12 - XML: Start document: iteration 11
Sun 19 Jan 2014 18:12:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:12:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:12:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:12:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:12:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:12:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:12:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:12:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:12:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:12:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:12:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:12:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:12:21 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:12:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:12:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 18:12:22 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:12:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5566 values 87702 bits 10962 bytes 
Sun 19 Jan 2014 18:12:22 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:12:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 18:12:27 - XML: Processed 645152 elements - found 0 jobs
Sun 19 Jan 2014 18:12:27 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:12:27 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:12:27 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:12:27 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:12:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:12:28 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:12:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:12:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:12:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:12:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:12:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:12:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:12:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:12:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43028362
Sun 19 Jan 2014 18:12:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:12:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43028362
Sun 19 Jan 2014 18:12:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:12:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:12:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:12:36 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:12:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 18:12:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:12:43 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:12:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:12:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:12:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:12:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:12:45 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:12:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:12:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:12:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:12:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:12:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:12:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:12:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:12:49 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:12:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:12:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:12:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:12:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:12:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:12:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:12:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:12:52 - job_xml_thread(): Done retrieving: data size 43501188
Sun 19 Jan 2014 18:12:52 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:12:52 - XML: Start document: iteration 12
Sun 19 Jan 2014 18:12:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43501188
Sun 19 Jan 2014 18:12:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:12:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43501188
Sun 19 Jan 2014 18:12:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:13:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:13:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:13:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:13:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:13:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:13:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:13:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:13:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:13:10 - XML: Processed 652464 elements - found 0 jobs
Sun 19 Jan 2014 18:13:10 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:13:10 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:13:10 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:13:10 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:13:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:13:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:13:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:13:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:13:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:13:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:13:16 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:13:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:13:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:13:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:13:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:13:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:13:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:13:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:13:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564239
Sun 19 Jan 2014 18:13:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:13:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564239
Sun 19 Jan 2014 18:13:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:13:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:13:23 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:13:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:13:23 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:13:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 18:13:23 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:13:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 18:13:25 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:13:25 - job_xml_thread(): Done retrieving: data size 43564239
Sun 19 Jan 2014 18:13:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:13:25 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:13:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:13:25 - XML: Start document: iteration 13
Sun 19 Jan 2014 18:13:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9391 values 148144 bits 18518 bytes 
Sun 19 Jan 2014 18:13:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:13:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:13:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:13:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:13:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:13:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:13:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:13:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:13:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:13:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:13:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:13:38 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:13:38 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:13:38 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:13:38 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:13:38 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:13:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:13:42 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:13:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:13:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:13:42 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 18:13:42 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 18:13:42 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:13:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:13:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:13:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:13:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:13:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:13:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43552840
Sun 19 Jan 2014 18:13:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:13:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43552840
Sun 19 Jan 2014 18:13:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:13:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:13:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:13:53 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:13:53 - job_xml_thread(): Done retrieving: data size 43552840
Sun 19 Jan 2014 18:13:53 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:13:53 - XML: Start document: iteration 14
Sun 19 Jan 2014 18:13:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:13:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:14:05 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:14:05 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:14:05 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:14:05 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:14:05 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:14:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:14:06 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:14:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:14:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:14:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:14:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:14:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:14:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:14:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:14:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:14:11 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:14:11 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:14:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 18:14:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:14:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:14:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:14:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:14:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:14:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:14:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:14:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:14:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565701
Sun 19 Jan 2014 18:14:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:14:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565701
Sun 19 Jan 2014 18:14:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:14:21 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:14:21 - job_xml_thread(): Done retrieving: data size 43565701
Sun 19 Jan 2014 18:14:21 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:14:21 - XML: Start document: iteration 15
Sun 19 Jan 2014 18:14:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:14:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:14:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:14:23 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:14:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:14:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 18:14:24 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:14:24 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:14:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6063 values 95654 bits 11956 bytes 
Sun 19 Jan 2014 18:14:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 18:14:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:14:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:14:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:14:28 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:14:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:14:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:14:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:14:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:14:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:14:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:14:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:14:36 - XML: Processed 653347 elements - found 0 jobs
Sun 19 Jan 2014 18:14:36 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:14:36 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:14:36 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:14:36 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:14:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:14:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:14:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:14:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:14:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:14:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:14:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:14:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:14:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:14:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574252
Sun 19 Jan 2014 18:14:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:14:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574252
Sun 19 Jan 2014 18:14:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:14:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:14:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:14:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:14:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:14:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:14:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:14:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:14:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:14:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:14:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:14:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:14:51 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:14:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:14:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:14:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:14:55 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:14:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:14:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:14:55 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:14:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 18:14:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:14:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:14:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:14:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:14:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:14:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:14:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43588976
Sun 19 Jan 2014 18:14:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:14:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43588976
Sun 19 Jan 2014 18:14:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:14:57 - job_xml_thread(): Done retrieving: data size 43588976
Sun 19 Jan 2014 18:14:57 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:14:57 - XML: Start document: iteration 16
Sun 19 Jan 2014 18:15:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:15:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:15:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:15:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:15:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:15:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:15:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:15:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:15:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:15:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:15:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:15:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:15:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:15:19 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:15:19 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:15:19 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:15:19 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:15:19 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:15:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:15:20 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:15:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:15:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:15:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:15:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:15:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:15:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:15:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:15:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43590356
Sun 19 Jan 2014 18:15:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:15:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43590356
Sun 19 Jan 2014 18:15:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:15:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:15:25 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:15:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:15:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 18:15:26 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:15:26 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:15:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9189 values 144936 bits 18117 bytes 
Sun 19 Jan 2014 18:15:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 18:15:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:15:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:15:34 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:15:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:15:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:15:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:15:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:15:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:15:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:15:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:15:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:15:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:15:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:15:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:15:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:15:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:15:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:15:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:15:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:15:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:15:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:15:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:15:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:15:39 - job_xml_thread(): Done retrieving: data size 43598014
Sun 19 Jan 2014 18:15:39 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:15:39 - XML: Start document: iteration 17
Sun 19 Jan 2014 18:15:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43598014
Sun 19 Jan 2014 18:15:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:15:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43598014
Sun 19 Jan 2014 18:15:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:15:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:15:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:15:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:15:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:16:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:16:01 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:16:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:16:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:16:02 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:16:02 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:16:02 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:16:02 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:16:02 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:16:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:16:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:16:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:16:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:16:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:16:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:16:03 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:16:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:16:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:16:04 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:16:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 18:16:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:16:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:16:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:16:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:16:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:16:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:16:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43603075
Sun 19 Jan 2014 18:16:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:16:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43603075
Sun 19 Jan 2014 18:16:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:16:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:16:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:16:17 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:16:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:16:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:16:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:16:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:16:19 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:16:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:16:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:16:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:16:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:16:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:16:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:16:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:16:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:16:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:16:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:16:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:16:21 - job_xml_thread(): Done retrieving: data size 43594081
Sun 19 Jan 2014 18:16:21 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:16:21 - XML: Start document: iteration 18
Sun 19 Jan 2014 18:16:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43594081
Sun 19 Jan 2014 18:16:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:16:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43594081
Sun 19 Jan 2014 18:16:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:16:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:16:26 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:16:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:16:27 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:16:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 18:16:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 18:16:28 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:16:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8922 values 140855 bits 17606 bytes 
Sun 19 Jan 2014 18:16:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:16:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:16:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:16:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:16:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:16:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:16:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:16:35 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:16:35 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:16:35 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:16:35 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:16:35 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:16:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:16:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:16:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:16:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:16:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:16:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:16:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:16:41 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:16:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:16:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:16:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:16:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:16:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:16:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:16:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:16:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570790
Sun 19 Jan 2014 18:16:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:16:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570790
Sun 19 Jan 2014 18:16:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:16:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:16:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:16:50 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:16:50 - job_xml_thread(): Done retrieving: data size 43570790
Sun 19 Jan 2014 18:16:50 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:16:51 - XML: Start document: iteration 19
Sun 19 Jan 2014 18:16:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:16:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:16:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:16:59 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:16:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:16:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:17:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:17:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:17:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:17:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:17:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:17:04 - XML: Processed 653349 elements - found 0 jobs
Sun 19 Jan 2014 18:17:04 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:17:04 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:17:04 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:17:04 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:17:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:17:06 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:17:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:17:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:17:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:17:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:17:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:17:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:17:07 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:17:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 18:17:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:17:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:17:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43588248
Sun 19 Jan 2014 18:17:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:17:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43588248
Sun 19 Jan 2014 18:17:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:17:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:17:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:17:20 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:17:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:17:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:17:20 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:17:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:17:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:17:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:17:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:17:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:17:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:17:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:17:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:17:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:17:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:17:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:17:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:17:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:17:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:17:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:17:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:17:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:17:24 - job_xml_thread(): Done retrieving: data size 43538074
Sun 19 Jan 2014 18:17:24 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:17:24 - XML: Start document: iteration 20
Sun 19 Jan 2014 18:17:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43538074
Sun 19 Jan 2014 18:17:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:17:25 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 18:17:26 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:17:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43538074
Sun 19 Jan 2014 18:17:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:17:27 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:17:27 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:17:27 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 18:17:27 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 18:17:27 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 18:17:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:17:28 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:17:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:17:29 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:17:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 18:17:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 18:17:29 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:17:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5796 values 91736 bits 11467 bytes 
Sun 19 Jan 2014 18:17:34 - XML: Processed 652598 elements - found 0 jobs
Sun 19 Jan 2014 18:17:34 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:17:34 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:17:34 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:17:34 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:17:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:17:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:17:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:17:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:17:43 - size of cluster 'LISA Cluster': 624 hosts 79465 metrics 875700 values 13814917 bits 1726864 bytes 
Sun 19 Jan 2014 18:17:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:17:44 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:17:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:17:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:17:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:17:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:17:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:17:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:17:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:17:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:17:48 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:17:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:17:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:17:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:17:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:17:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:17:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:17:49 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:17:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:17:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42964037
Sun 19 Jan 2014 18:17:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:17:54 - job_xml_thread(): Done retrieving: data size 42964037
Sun 19 Jan 2014 18:17:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42964037
Sun 19 Jan 2014 18:17:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:17:54 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:17:54 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 18:17:56 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 18:17:56 - Housekeeping: done.
Sun 19 Jan 2014 18:17:56 - XML: Start document: iteration 0
Sun 19 Jan 2014 18:18:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:18:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:18:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:18:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:18:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:18:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:18:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:18:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:18:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:18:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:18:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:18:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:18:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:18:13 - XML: Processed 645628 elements - found 0 jobs
Sun 19 Jan 2014 18:18:13 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:18:13 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:18:13 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:18:13 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:18:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:18:17 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:18:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:18:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:18:17 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:18:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 18:18:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:18:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:18:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:18:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:18:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:18:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:18:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42970441
Sun 19 Jan 2014 18:18:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:18:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42970441
Sun 19 Jan 2014 18:18:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:18:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:18:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:18:27 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:18:27 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 18:18:28 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:18:28 - job_xml_thread(): Done retrieving: data size 42970441
Sun 19 Jan 2014 18:18:28 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:18:28 - XML: Start document: iteration 1
Sun 19 Jan 2014 18:18:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:18:29 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:18:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:18:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:18:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:18:30 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:18:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:18:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:18:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:18:31 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:18:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:18:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 18:18:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:18:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 18:18:31 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:18:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5580 values 88178 bits 11022 bytes 
Sun 19 Jan 2014 18:18:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:18:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:18:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:18:36 - XML: Processed 645828 elements - found 0 jobs
Sun 19 Jan 2014 18:18:36 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:18:36 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:18:36 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:18:36 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:18:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:18:42 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:18:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:18:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:18:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:18:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:18:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:18:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:18:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:18:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43488916
Sun 19 Jan 2014 18:18:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:18:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43488916
Sun 19 Jan 2014 18:18:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:18:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:18:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:18:51 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:18:51 - job_xml_thread(): Done retrieving: data size 43488916
Sun 19 Jan 2014 18:18:51 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:18:51 - XML: Start document: iteration 2
Sun 19 Jan 2014 18:18:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:18:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:18:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:18:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:18:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:18:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:18:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:18:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:18:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:18:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:18:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:19:05 - XML: Processed 652712 elements - found 0 jobs
Sun 19 Jan 2014 18:19:05 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:19:05 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:19:05 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:19:05 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:19:08 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:19:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 18:19:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:19:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:19:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:19:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:19:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:19:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:19:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:19:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:19:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:19:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:19:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43542626
Sun 19 Jan 2014 18:19:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:19:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:19:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:19:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43542626
Sun 19 Jan 2014 18:19:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:19:20 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:19:20 - job_xml_thread(): Done retrieving: data size 43542626
Sun 19 Jan 2014 18:19:20 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:19:20 - XML: Start document: iteration 3
Sun 19 Jan 2014 18:19:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:19:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:19:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:19:28 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:19:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:19:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:19:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:19:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:19:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:19:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:19:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:19:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:19:31 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:19:32 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:19:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 18:19:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:19:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 18:19:32 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:19:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5957 values 94033 bits 11754 bytes 
Sun 19 Jan 2014 18:19:35 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:19:35 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:19:35 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:19:35 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:19:35 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:19:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:19:37 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:19:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:19:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:19:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:19:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:19:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:19:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:19:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:19:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554059
Sun 19 Jan 2014 18:19:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:19:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554059
Sun 19 Jan 2014 18:19:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:19:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:19:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:19:50 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:19:50 - job_xml_thread(): Done retrieving: data size 43554059
Sun 19 Jan 2014 18:19:50 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:19:50 - XML: Start document: iteration 4
Sun 19 Jan 2014 18:19:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:19:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:19:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:19:57 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:19:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:19:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:19:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:19:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:19:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:19:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:19:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:20:03 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:20:03 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:20:03 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:20:03 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:20:03 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:20:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:20:05 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:20:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:20:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:20:06 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:20:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 18:20:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:20:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:20:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:20:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:20:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:20:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:20:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566063
Sun 19 Jan 2014 18:20:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:20:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566063
Sun 19 Jan 2014 18:20:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:20:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:20:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:20:18 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:20:18 - job_xml_thread(): Done retrieving: data size 43566063
Sun 19 Jan 2014 18:20:18 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:20:18 - XML: Start document: iteration 5
Sun 19 Jan 2014 18:20:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:20:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:20:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:20:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:20:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:20:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:20:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:20:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:20:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:20:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:20:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:20:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:20:29 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:20:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:20:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:20:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:20:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:20:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:20:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:20:31 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:20:31 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:20:31 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:20:31 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:20:31 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:20:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:20:32 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:20:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:20:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 18:20:32 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:20:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 18:20:32 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:20:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5670 values 89399 bits 11174 bytes 
Sun 19 Jan 2014 18:20:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:20:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557761
Sun 19 Jan 2014 18:20:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:20:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557761
Sun 19 Jan 2014 18:20:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:20:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:20:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:20:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:20:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:20:46 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:20:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:20:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:20:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:20:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:20:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:20:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:20:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:20:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:20:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:20:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:20:51 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:20:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:20:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:20:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:20:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:20:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:20:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:20:54 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:20:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 18:20:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:20:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:20:55 - job_xml_thread(): Done retrieving: data size 43568229
Sun 19 Jan 2014 18:20:55 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:20:55 - XML: Start document: iteration 6
Sun 19 Jan 2014 18:20:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568229
Sun 19 Jan 2014 18:20:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:20:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568229
Sun 19 Jan 2014 18:20:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:21:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:21:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:21:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:21:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:21:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:21:18 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:21:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:21:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:21:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:21:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:21:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:21:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:21:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:21:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:21:19 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:21:19 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:21:19 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:21:19 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:21:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:21:19 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:21:19 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:21:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:21:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:21:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:21:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:21:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:21:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:21:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43596511
Sun 19 Jan 2014 18:21:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:21:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43596511
Sun 19 Jan 2014 18:21:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:21:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:21:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:21:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:21:33 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:21:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:21:34 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:21:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 18:21:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 18:21:34 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:21:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7660 values 120859 bits 15107 bytes 
Sun 19 Jan 2014 18:21:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:21:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:21:34 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:21:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:21:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:21:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:21:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:21:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:21:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:21:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:21:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:21:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:21:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:21:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:21:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:21:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:21:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:21:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:21:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:21:43 - job_xml_thread(): Done retrieving: data size 43561925
Sun 19 Jan 2014 18:21:43 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:21:43 - XML: Start document: iteration 7
Sun 19 Jan 2014 18:21:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561925
Sun 19 Jan 2014 18:21:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561925
Sun 19 Jan 2014 18:21:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:21:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:21:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:21:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:21:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:21:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:21:56 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:21:56 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:21:56 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:21:56 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:21:56 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:22:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:22:03 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:22:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:22:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:22:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:22:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:22:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:22:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:22:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:22:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:22:05 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:22:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:22:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:22:06 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:22:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 18:22:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:22:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:22:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:22:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:22:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:22:08 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 18:22:08 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 18:22:08 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:22:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:22:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43596313
Sun 19 Jan 2014 18:22:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:22:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43596313
Sun 19 Jan 2014 18:22:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:22:11 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:22:11 - job_xml_thread(): Done retrieving: data size 43596313
Sun 19 Jan 2014 18:22:11 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:22:11 - XML: Start document: iteration 8
Sun 19 Jan 2014 18:22:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:22:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:22:20 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:22:20 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:22:20 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:22:20 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:22:20 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:22:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:22:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:22:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:22:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:22:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:22:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:22:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:22:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:22:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:22:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:22:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:22:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:22:29 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:22:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:22:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:22:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:22:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:22:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:22:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:22:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:22:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576538
Sun 19 Jan 2014 18:22:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:22:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576538
Sun 19 Jan 2014 18:22:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:22:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:22:34 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:22:35 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:22:35 - job_xml_thread(): Done retrieving: data size 43576538
Sun 19 Jan 2014 18:22:35 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:22:35 - XML: Start document: iteration 9
Sun 19 Jan 2014 18:22:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:22:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 18:22:35 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:22:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 18:22:36 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:22:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8862 values 139794 bits 17474 bytes 
Sun 19 Jan 2014 18:22:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:22:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:22:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:22:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:22:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:22:47 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:22:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:22:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:22:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:22:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:22:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:22:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:22:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:22:51 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:22:51 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:22:51 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:22:51 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:22:51 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:22:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:22:55 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:22:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:22:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:22:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:22:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:22:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:22:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:22:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:22:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565080
Sun 19 Jan 2014 18:22:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:22:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565080
Sun 19 Jan 2014 18:22:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:23:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:23:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:23:06 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:23:06 - job_xml_thread(): Done retrieving: data size 43565080
Sun 19 Jan 2014 18:23:06 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:23:06 - XML: Start document: iteration 10
Sun 19 Jan 2014 18:23:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:23:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:23:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:23:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:23:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:23:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:23:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:23:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:23:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:23:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:23:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:23:16 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:23:16 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:23:16 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:23:16 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:23:16 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:23:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:23:20 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:23:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:23:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:23:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:23:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:23:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:23:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:23:20 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:23:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 18:23:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:23:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:23:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43504056
Sun 19 Jan 2014 18:23:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:23:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43504056
Sun 19 Jan 2014 18:23:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:23:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:23:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:23:31 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:23:31 - job_xml_thread(): Done retrieving: data size 43504056
Sun 19 Jan 2014 18:23:31 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:23:31 - XML: Start document: iteration 11
Sun 19 Jan 2014 18:23:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:23:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:23:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:23:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:23:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:23:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:23:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:23:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:23:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:23:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:23:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:23:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:23:36 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:23:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:23:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 18:23:36 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:23:36 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:23:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 18:23:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5908 values 93187 bits 11648 bytes 
Sun 19 Jan 2014 18:23:41 - XML: Processed 652602 elements - found 0 jobs
Sun 19 Jan 2014 18:23:41 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:23:41 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:23:41 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:23:41 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:23:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:23:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:23:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:23:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:23:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:23:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:23:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:23:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:23:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:23:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42983839
Sun 19 Jan 2014 18:23:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:23:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42983839
Sun 19 Jan 2014 18:23:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:23:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:23:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:23:56 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:23:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:23:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:23:58 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:23:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:23:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:23:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:23:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:23:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:23:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:24:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:24:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:24:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:24:00 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:24:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:24:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:24:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:24:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:24:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:24:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:24:01 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:24:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 18:24:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:24:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:24:03 - job_xml_thread(): Done retrieving: data size 42914191
Sun 19 Jan 2014 18:24:03 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:24:03 - XML: Start document: iteration 12
Sun 19 Jan 2014 18:24:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42914191
Sun 19 Jan 2014 18:24:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:24:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42914191
Sun 19 Jan 2014 18:24:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:24:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:24:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:24:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:24:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:24:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:24:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:24:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:24:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:24:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:24:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:24:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:24:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:24:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:24:24 - XML: Processed 645152 elements - found 0 jobs
Sun 19 Jan 2014 18:24:24 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:24:24 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:24:24 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:24:24 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:24:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:24:26 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:24:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:24:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:24:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:24:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:24:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:24:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:24:27 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 18:24:27 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:24:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:24:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42990970
Sun 19 Jan 2014 18:24:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:24:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42990970
Sun 19 Jan 2014 18:24:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:24:29 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:24:29 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 18:24:30 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:24:30 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 18:24:30 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 18:24:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:24:36 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:24:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:24:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 18:24:37 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:24:37 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:24:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 18:24:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9062 values 142900 bits 17862 bytes 
Sun 19 Jan 2014 18:24:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:24:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:24:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:24:39 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:24:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:24:39 - size of cluster 'LISA Cluster': 624 hosts 79469 metrics 756491 values 11929479 bits 1491184 bytes 
Sun 19 Jan 2014 18:24:39 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:24:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:24:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:24:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:24:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:24:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:24:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:24:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:24:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:24:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:24:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:24:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:24:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:24:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:24:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:24:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:24:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:24:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:24:48 - job_xml_thread(): Done retrieving: data size 43487806
Sun 19 Jan 2014 18:24:48 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:24:48 - XML: Start document: iteration 13
Sun 19 Jan 2014 18:24:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43487806
Sun 19 Jan 2014 18:24:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43487806
Sun 19 Jan 2014 18:24:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:24:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:24:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:24:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:25:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:25:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:25:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:25:06 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:25:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:25:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:25:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:25:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:25:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:25:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:25:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:25:09 - XML: Processed 652268 elements - found 0 jobs
Sun 19 Jan 2014 18:25:09 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:25:09 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:25:09 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:25:09 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:25:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:25:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:25:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:25:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:25:12 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:25:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 18:25:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:25:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:25:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:25:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:25:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:25:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:25:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578250
Sun 19 Jan 2014 18:25:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:25:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578250
Sun 19 Jan 2014 18:25:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:25:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:25:24 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:25:24 - job_xml_thread(): Done retrieving: data size 43578250
Sun 19 Jan 2014 18:25:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:25:24 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:25:24 - XML: Start document: iteration 14
Sun 19 Jan 2014 18:25:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:25:27 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:25:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:25:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:25:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:25:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:25:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:25:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:25:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:25:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:25:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:25:30 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:25:30 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 18:25:37 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:25:37 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:25:37 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:25:37 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:25:37 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:25:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:25:38 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:25:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:25:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:25:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:25:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:25:39 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:25:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 18:25:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:25:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 18:25:39 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:25:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5710 values 90009 bits 11251 bytes 
Sun 19 Jan 2014 18:25:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:25:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:25:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:25:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:25:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:25:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43539569
Sun 19 Jan 2014 18:25:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:25:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43539569
Sun 19 Jan 2014 18:25:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:25:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:25:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:25:53 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:25:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:25:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:25:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:25:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:25:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:25:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:25:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:25:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:25:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:25:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:25:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:25:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:25:58 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:25:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:25:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:26:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:26:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:26:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:26:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:26:01 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:26:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 18:26:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:26:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:26:03 - job_xml_thread(): Done retrieving: data size 43565703
Sun 19 Jan 2014 18:26:03 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:26:03 - XML: Start document: iteration 15
Sun 19 Jan 2014 18:26:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565703
Sun 19 Jan 2014 18:26:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:26:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565703
Sun 19 Jan 2014 18:26:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:26:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:26:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:26:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:26:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:26:19 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:26:19 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:26:19 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:26:19 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:26:19 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:26:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:26:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:26:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:26:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:26:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:26:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:26:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:26:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:26:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:26:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:26:25 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:26:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:26:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:26:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:26:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:26:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:26:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:26:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:26:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582057
Sun 19 Jan 2014 18:26:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:26:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582057
Sun 19 Jan 2014 18:26:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:26:34 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:26:34 - job_xml_thread(): Done retrieving: data size 43582057
Sun 19 Jan 2014 18:26:34 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:26:34 - XML: Start document: iteration 16
Sun 19 Jan 2014 18:26:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:26:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:26:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:26:40 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:26:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:26:41 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:26:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 18:26:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 18:26:41 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:26:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8147 values 128465 bits 16058 bytes 
Sun 19 Jan 2014 18:26:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:26:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:26:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:26:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:26:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:26:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:26:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:26:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:26:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:26:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:26:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:26:50 - XML: Processed 653349 elements - found 0 jobs
Sun 19 Jan 2014 18:26:50 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:26:50 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:26:50 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:26:50 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:26:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:26:52 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:26:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:26:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:26:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:26:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:26:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:26:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:26:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:26:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43548784
Sun 19 Jan 2014 18:26:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:26:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43548784
Sun 19 Jan 2014 18:26:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:26:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:26:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:27:05 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:27:05 - job_xml_thread(): Done retrieving: data size 43548784
Sun 19 Jan 2014 18:27:05 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:27:05 - XML: Start document: iteration 17
Sun 19 Jan 2014 18:27:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:27:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:27:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:27:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:27:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:27:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:27:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:27:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:27:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:27:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:27:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:27:16 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:27:16 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:27:16 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:27:16 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:27:16 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:27:19 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:27:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 18:27:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:27:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:27:20 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:27:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:27:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:27:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:27:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:27:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:27:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:27:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:27:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559086
Sun 19 Jan 2014 18:27:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:27:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559086
Sun 19 Jan 2014 18:27:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:27:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:27:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:27:31 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:27:31 - job_xml_thread(): Done retrieving: data size 43559086
Sun 19 Jan 2014 18:27:31 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:27:31 - XML: Start document: iteration 18
Sun 19 Jan 2014 18:27:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:27:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:27:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:27:37 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:27:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:27:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:27:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:27:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:27:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:27:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:27:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:27:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:27:41 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:27:41 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:27:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 18:27:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:27:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 18:27:41 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:27:41 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:27:41 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:27:41 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:27:41 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:27:41 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:27:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5884 values 92827 bits 11603 bytes 
Sun 19 Jan 2014 18:27:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:27:47 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:27:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:27:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:27:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:27:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:27:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:27:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:27:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:27:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570437
Sun 19 Jan 2014 18:27:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:27:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570437
Sun 19 Jan 2014 18:27:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:27:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:27:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:27:56 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:27:56 - job_xml_thread(): Done retrieving: data size 43570437
Sun 19 Jan 2014 18:27:56 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:27:56 - XML: Start document: iteration 19
Sun 19 Jan 2014 18:28:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:28:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:28:11 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:28:11 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:28:11 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:28:11 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:28:11 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:28:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:28:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:28:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:28:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:28:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:28:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:28:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:28:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:28:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:28:13 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:28:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 18:28:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:28:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:28:14 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:28:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:28:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:28:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:28:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:28:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:28:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:28:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:28:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580374
Sun 19 Jan 2014 18:28:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:28:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580374
Sun 19 Jan 2014 18:28:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:28:26 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:28:26 - job_xml_thread(): Done retrieving: data size 43580374
Sun 19 Jan 2014 18:28:26 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:28:26 - XML: Start document: iteration 20
Sun 19 Jan 2014 18:28:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:28:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:28:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:28:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:28:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:28:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:28:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:28:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:28:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:28:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:28:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:28:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:28:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:28:36 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:28:36 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:28:36 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:28:36 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:28:36 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:28:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:28:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:28:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:28:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:28:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:28:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:28:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:28:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:28:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:28:41 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:28:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:28:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 18:28:41 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:28:41 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:28:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 18:28:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5989 values 94471 bits 11808 bytes 
Sun 19 Jan 2014 18:28:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:28:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564732
Sun 19 Jan 2014 18:28:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:28:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564732
Sun 19 Jan 2014 18:28:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:28:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:28:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:28:51 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:28:51 - job_xml_thread(): Done retrieving: data size 43564732
Sun 19 Jan 2014 18:28:51 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:28:51 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 18:28:52 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 18:28:52 - Housekeeping: done.
Sun 19 Jan 2014 18:28:52 - XML: Start document: iteration 0
Sun 19 Jan 2014 18:28:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:28:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:29:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:29:01 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:29:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:29:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:29:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:29:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:29:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:29:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:29:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:29:05 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:29:05 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:29:05 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:29:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:29:05 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:29:05 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:29:05 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:29:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:29:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:29:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:29:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:29:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:29:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:29:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:29:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43523184
Sun 19 Jan 2014 18:29:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:29:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43523184
Sun 19 Jan 2014 18:29:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:29:18 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:29:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 18:29:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:29:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:29:18 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:29:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:29:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:29:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:29:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:29:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:29:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:29:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:29:21 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:29:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:29:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:29:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:29:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:29:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:29:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:29:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:29:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:29:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:29:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:29:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:29:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43505021
Sun 19 Jan 2014 18:29:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:29:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43505021
Sun 19 Jan 2014 18:29:27 - job_xml_thread(): Done retrieving: data size 43505021
Sun 19 Jan 2014 18:29:27 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:29:27 - XML: Start document: iteration 1
Sun 19 Jan 2014 18:29:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:29:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:29:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:29:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:29:37 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:29:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:29:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:29:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:29:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:29:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:29:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:29:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:29:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:29:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:29:41 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 18:29:41 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 18:29:41 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:29:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:29:42 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:29:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:29:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 18:29:43 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:29:43 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:29:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 18:29:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6575 values 103680 bits 12960 bytes 
Sun 19 Jan 2014 18:29:47 - XML: Processed 652602 elements - found 0 jobs
Sun 19 Jan 2014 18:29:47 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:29:47 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:29:47 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:29:47 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:29:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:29:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:29:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:29:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:29:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:29:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:29:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:29:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:29:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:29:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42976759
Sun 19 Jan 2014 18:29:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:29:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:29:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:29:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42976759
Sun 19 Jan 2014 18:29:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:30:02 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:30:02 - job_xml_thread(): Done retrieving: data size 42976759
Sun 19 Jan 2014 18:30:02 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:30:02 - XML: Start document: iteration 2
Sun 19 Jan 2014 18:30:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:30:04 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:30:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:30:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:30:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:30:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:30:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:30:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:30:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:30:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:30:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:30:13 - XML: Processed 646184 elements - found 0 jobs
Sun 19 Jan 2014 18:30:13 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:30:13 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:30:13 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:30:13 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:30:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:30:15 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:30:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:30:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:30:16 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:30:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 18:30:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:30:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:30:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:30:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:30:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:30:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:30:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42956668
Sun 19 Jan 2014 18:30:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:30:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42956668
Sun 19 Jan 2014 18:30:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:30:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:30:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:30:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:30:27 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:30:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:30:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:30:28 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:30:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:30:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:30:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:30:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:30:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:30:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:30:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:30:31 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:30:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:30:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:30:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:30:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:30:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:30:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:30:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:30:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:30:32 - job_xml_thread(): Done retrieving: data size 42990694
Sun 19 Jan 2014 18:30:32 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:30:32 - XML: Start document: iteration 3
Sun 19 Jan 2014 18:30:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42990694
Sun 19 Jan 2014 18:30:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:30:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42990694
Sun 19 Jan 2014 18:30:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:30:40 - XML: Processed 645906 elements - found 0 jobs
Sun 19 Jan 2014 18:30:40 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:30:41 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:30:41 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:30:41 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:30:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:30:43 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:30:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:30:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:30:45 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:30:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:30:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 18:30:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 18:30:45 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:30:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8715 values 137431 bits 17178 bytes 
Sun 19 Jan 2014 18:30:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:30:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:30:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:30:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:30:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:30:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:30:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:30:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:30:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:30:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:30:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:30:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:30:52 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:30:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:30:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:30:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:30:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:30:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:30:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:30:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:30:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559147
Sun 19 Jan 2014 18:30:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:30:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559147
Sun 19 Jan 2014 18:30:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:30:56 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:30:56 - job_xml_thread(): Done retrieving: data size 43559147
Sun 19 Jan 2014 18:30:56 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:30:56 - XML: Start document: iteration 4
Sun 19 Jan 2014 18:31:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:31:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:31:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:31:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:31:09 - XML: Processed 653290 elements - found 0 jobs
Sun 19 Jan 2014 18:31:09 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:31:09 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:31:09 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:31:09 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:31:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:31:14 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:31:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:31:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:31:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:31:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:31:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:31:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:31:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:31:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:31:17 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:31:17 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:31:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 18:31:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:31:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:31:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:31:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:31:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:31:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:31:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:31:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:31:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43590754
Sun 19 Jan 2014 18:31:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:31:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43590754
Sun 19 Jan 2014 18:31:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:31:24 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:31:24 - job_xml_thread(): Done retrieving: data size 43590754
Sun 19 Jan 2014 18:31:24 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:31:24 - XML: Start document: iteration 5
Sun 19 Jan 2014 18:31:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:31:28 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:31:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:31:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:31:30 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 18:31:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:31:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:31:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:31:30 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:31:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:31:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:31:32 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:31:32 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 18:31:32 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:31:32 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 18:31:32 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 18:31:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:31:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:31:35 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:31:35 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:31:35 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:31:35 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:31:35 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:31:40 - size of cluster 'LISA Cluster': 624 hosts 79481 metrics 748733 values 11803272 bits 1475409 bytes 
Sun 19 Jan 2014 18:31:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:31:41 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:31:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:31:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:31:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:31:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:31:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:31:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:31:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:31:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43546262
Sun 19 Jan 2014 18:31:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:31:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43546262
Sun 19 Jan 2014 18:31:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:31:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:31:45 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:31:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:31:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:31:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:31:45 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:31:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 18:31:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 18:31:45 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:31:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8856 values 140053 bits 17506 bytes 
Sun 19 Jan 2014 18:31:50 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:31:50 - job_xml_thread(): Done retrieving: data size 43546262
Sun 19 Jan 2014 18:31:50 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:31:50 - XML: Start document: iteration 6
Sun 19 Jan 2014 18:31:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:31:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:32:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:32:01 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:32:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:32:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:32:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:32:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:32:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:32:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:32:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:32:03 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:32:03 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:32:03 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:32:03 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:32:03 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:32:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:32:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:32:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:32:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:32:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:32:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:32:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:32:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:32:12 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:32:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 18:32:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:32:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:32:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555735
Sun 19 Jan 2014 18:32:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:32:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555735
Sun 19 Jan 2014 18:32:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:32:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:32:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:32:18 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:32:18 - job_xml_thread(): Done retrieving: data size 43555735
Sun 19 Jan 2014 18:32:19 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:32:19 - XML: Start document: iteration 7
Sun 19 Jan 2014 18:32:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:32:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:32:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:32:27 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:32:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:32:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:32:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:32:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:32:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:32:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:32:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:32:32 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:32:32 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 18:32:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:32:35 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:32:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:32:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:32:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:32:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:32:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:32:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:32:37 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:32:37 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:32:37 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:32:37 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:32:37 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:32:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:32:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558418
Sun 19 Jan 2014 18:32:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:32:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558418
Sun 19 Jan 2014 18:32:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:32:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:32:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:32:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:32:46 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:32:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:32:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 18:32:46 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:32:46 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:32:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 18:32:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99386 bits 12423 bytes 
Sun 19 Jan 2014 18:32:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:32:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:32:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:32:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:32:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:32:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:32:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:32:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:32:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:32:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:32:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:32:52 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:32:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:32:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:32:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:32:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:32:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:32:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:32:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:32:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:33:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:33:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574630
Sun 19 Jan 2014 18:33:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:33:01 - job_xml_thread(): Done retrieving: data size 43574630
Sun 19 Jan 2014 18:33:01 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:33:01 - XML: Start document: iteration 8
Sun 19 Jan 2014 18:33:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574630
Sun 19 Jan 2014 18:33:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:33:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:33:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:33:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:33:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:33:12 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:33:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 18:33:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:33:13 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:33:13 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:33:13 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:33:13 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:33:13 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:33:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:33:20 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:33:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:33:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:33:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:33:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:33:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:33:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:33:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:33:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:33:24 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:33:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:33:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:33:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:33:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:33:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:33:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:33:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:33:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576546
Sun 19 Jan 2014 18:33:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:33:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576546
Sun 19 Jan 2014 18:33:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:33:28 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:33:28 - job_xml_thread(): Done retrieving: data size 43576546
Sun 19 Jan 2014 18:33:28 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:33:28 - XML: Start document: iteration 9
Sun 19 Jan 2014 18:33:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:33:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:33:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:33:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:33:44 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:33:44 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:33:44 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:33:44 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:33:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:33:44 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:33:44 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:33:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:33:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:33:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:33:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:33:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:33:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:33:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:33:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:33:46 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:33:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:33:46 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:33:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 18:33:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 18:33:46 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:33:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5978 values 94513 bits 11814 bytes 
Sun 19 Jan 2014 18:33:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:33:51 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:33:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:33:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:33:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:33:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:33:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:33:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:33:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:33:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553921
Sun 19 Jan 2014 18:33:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:33:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553921
Sun 19 Jan 2014 18:33:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:33:59 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:33:59 - job_xml_thread(): Done retrieving: data size 43553921
Sun 19 Jan 2014 18:33:59 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:33:59 - XML: Start document: iteration 10
Sun 19 Jan 2014 18:34:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:34:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:34:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:34:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:34:11 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:34:11 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:34:11 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:34:11 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:34:11 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:34:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:34:13 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:34:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:34:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:34:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:34:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:34:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:34:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:34:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:34:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:34:19 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:34:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:34:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:34:19 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:34:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 18:34:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:34:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:34:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:34:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:34:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:34:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:34:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569040
Sun 19 Jan 2014 18:34:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:34:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569040
Sun 19 Jan 2014 18:34:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:34:26 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:34:26 - job_xml_thread(): Done retrieving: data size 43569040
Sun 19 Jan 2014 18:34:26 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:34:26 - XML: Start document: iteration 11
Sun 19 Jan 2014 18:34:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:34:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:34:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:34:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:34:40 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:34:40 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:34:40 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:34:40 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:34:40 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:34:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:34:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:34:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:34:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:34:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:34:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:34:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:34:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:34:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:34:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:34:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:34:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:34:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:34:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:34:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:34:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:34:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:34:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:34:46 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:34:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:34:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 18:34:47 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:34:47 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:34:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5642 values 88958 bits 11119 bytes 
Sun 19 Jan 2014 18:34:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 18:34:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:34:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43592543
Sun 19 Jan 2014 18:34:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:34:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43592543
Sun 19 Jan 2014 18:34:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:34:55 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:34:55 - job_xml_thread(): Done retrieving: data size 43592543
Sun 19 Jan 2014 18:34:55 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:34:55 - XML: Start document: iteration 12
Sun 19 Jan 2014 18:34:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:34:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:35:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:35:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:35:06 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:35:06 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:35:06 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:35:06 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:35:06 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:35:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:35:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:35:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:35:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:35:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:35:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:35:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:35:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:35:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:35:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:35:11 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:35:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:35:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:35:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:35:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:35:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:35:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:35:14 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:35:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 18:35:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:35:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:35:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43526890
Sun 19 Jan 2014 18:35:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:35:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43526890
Sun 19 Jan 2014 18:35:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:35:21 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:35:22 - job_xml_thread(): Done retrieving: data size 43526890
Sun 19 Jan 2014 18:35:22 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:35:22 - XML: Start document: iteration 13
Sun 19 Jan 2014 18:35:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:35:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:35:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:35:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:35:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:35:30 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:35:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:35:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:35:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:35:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:35:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:35:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:35:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:35:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:35:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:35:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:35:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:35:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:35:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:35:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:35:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:35:38 - XML: Processed 652602 elements - found 0 jobs
Sun 19 Jan 2014 18:35:38 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:35:38 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:35:38 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:35:38 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:35:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:35:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42985661
Sun 19 Jan 2014 18:35:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:35:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42985661
Sun 19 Jan 2014 18:35:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:35:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:35:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:35:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:35:47 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:35:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:35:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 18:35:48 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:35:48 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:35:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 18:35:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6673 values 105261 bits 13157 bytes 
Sun 19 Jan 2014 18:35:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:35:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:35:54 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:35:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:35:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:35:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:35:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:35:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:35:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:35:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:35:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:35:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:35:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:35:58 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:35:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:35:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:35:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:35:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:35:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:35:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:36:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:36:02 - job_xml_thread(): Done retrieving: data size 42925385
Sun 19 Jan 2014 18:36:02 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:36:02 - XML: Start document: iteration 14
Sun 19 Jan 2014 18:36:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42925385
Sun 19 Jan 2014 18:36:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:36:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42925385
Sun 19 Jan 2014 18:36:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:36:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:36:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:36:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:36:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:36:21 - XML: Processed 645158 elements - found 0 jobs
Sun 19 Jan 2014 18:36:21 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:36:21 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:36:21 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:36:21 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:36:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:36:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:36:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:36:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:36:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:36:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:36:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:36:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:36:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:36:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:36:25 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:36:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:36:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:36:25 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:36:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 18:36:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:36:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:36:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:36:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:36:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:36:27 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 18:36:27 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 18:36:27 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:36:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:36:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42992708
Sun 19 Jan 2014 18:36:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:36:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42992708
Sun 19 Jan 2014 18:36:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:36:36 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:36:36 - job_xml_thread(): Done retrieving: data size 42992708
Sun 19 Jan 2014 18:36:36 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:36:36 - XML: Start document: iteration 15
Sun 19 Jan 2014 18:36:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:36:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:36:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:36:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:36:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:36:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:36:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:36:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:36:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:36:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:36:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:36:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:36:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:36:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:36:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:36:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:36:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:36:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:36:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:36:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:36:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:36:48 - XML: Processed 645902 elements - found 0 jobs
Sun 19 Jan 2014 18:36:48 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:36:48 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:36:48 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:36:48 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:36:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:36:49 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:36:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:36:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 18:36:49 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:36:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5742 values 90546 bits 11318 bytes 
Sun 19 Jan 2014 18:36:49 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:36:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 18:36:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:36:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43491186
Sun 19 Jan 2014 18:36:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:36:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43491186
Sun 19 Jan 2014 18:36:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:36:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:36:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:37:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:37:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:37:03 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:37:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:37:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:37:05 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:37:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:37:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:37:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:37:06 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:37:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:37:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:37:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:37:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:37:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:37:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:37:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:37:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:37:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:37:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:37:07 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:37:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 18:37:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:37:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:37:08 - job_xml_thread(): Done retrieving: data size 43566660
Sun 19 Jan 2014 18:37:08 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:37:08 - XML: Start document: iteration 16
Sun 19 Jan 2014 18:37:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566660
Sun 19 Jan 2014 18:37:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:37:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566660
Sun 19 Jan 2014 18:37:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:37:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:37:18 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:37:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:37:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:37:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:37:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:37:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:37:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:37:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:37:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:37:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:37:28 - XML: Processed 653286 elements - found 0 jobs
Sun 19 Jan 2014 18:37:28 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:37:28 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:37:28 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:37:28 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:37:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:37:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:37:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:37:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:37:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:37:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:37:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:37:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:37:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:37:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573113
Sun 19 Jan 2014 18:37:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:37:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573113
Sun 19 Jan 2014 18:37:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:37:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:37:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:37:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:37:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:37:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:37:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:37:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:37:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:37:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:37:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:37:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:37:43 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:37:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:37:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:37:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:37:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:37:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:37:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43592962
Sun 19 Jan 2014 18:37:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:37:47 - job_xml_thread(): Done retrieving: data size 43592962
Sun 19 Jan 2014 18:37:47 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:37:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:37:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:37:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43592962
Sun 19 Jan 2014 18:37:47 - XML: Start document: iteration 17
Sun 19 Jan 2014 18:37:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:37:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:37:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:37:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:37:49 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:37:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:37:50 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:37:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 18:37:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 18:37:52 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:37:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:37:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:37:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 10393 values 163988 bits 20498 bytes 
Sun 19 Jan 2014 18:38:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:38:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:38:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:38:06 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:38:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:38:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:38:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:38:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:38:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:38:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:38:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:38:07 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:38:07 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:38:07 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:38:07 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:38:07 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:38:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:38:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:38:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:38:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:38:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:38:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:38:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:38:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:38:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:38:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579442
Sun 19 Jan 2014 18:38:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:38:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579442
Sun 19 Jan 2014 18:38:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:38:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:38:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:38:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:38:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:38:22 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:38:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:38:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:38:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:38:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:38:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:38:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:38:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:38:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:38:26 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:38:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:38:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:38:27 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:38:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 18:38:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:38:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:38:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:38:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:38:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:38:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:38:28 - job_xml_thread(): Done retrieving: data size 43581058
Sun 19 Jan 2014 18:38:28 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:38:28 - XML: Start document: iteration 18
Sun 19 Jan 2014 18:38:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581058
Sun 19 Jan 2014 18:38:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:38:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581058
Sun 19 Jan 2014 18:38:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:38:32 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 18:38:34 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:38:35 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:38:35 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:38:35 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 18:38:35 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 18:38:35 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 18:38:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:38:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:38:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:38:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:38:44 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:38:44 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:38:44 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:38:44 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:38:44 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:38:47 - size of cluster 'LISA Cluster': 624 hosts 79476 metrics 784447 values 12371310 bits 1546413 bytes 
Sun 19 Jan 2014 18:38:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:38:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:38:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:38:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:38:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:38:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:38:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:38:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:38:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:38:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:38:51 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:38:51 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:38:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:38:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 18:38:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 18:38:51 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:38:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5640 values 88926 bits 11115 bytes 
Sun 19 Jan 2014 18:38:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:38:51 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:38:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:38:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:38:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:38:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:38:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:38:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:38:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:38:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583095
Sun 19 Jan 2014 18:38:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:38:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583095
Sun 19 Jan 2014 18:38:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:38:59 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:38:59 - job_xml_thread(): Done retrieving: data size 43583095
Sun 19 Jan 2014 18:38:59 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:38:59 - XML: Start document: iteration 19
Sun 19 Jan 2014 18:39:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:39:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:39:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:39:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:39:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:39:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:39:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:39:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:39:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:39:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:39:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:39:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:39:16 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:39:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:39:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:39:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:39:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:39:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:39:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:39:18 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:39:18 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:39:18 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:39:18 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:39:18 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:39:18 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:39:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 18:39:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:39:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:39:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563188
Sun 19 Jan 2014 18:39:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:39:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563188
Sun 19 Jan 2014 18:39:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:39:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:39:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:39:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:39:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:39:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:39:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:39:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:39:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:39:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:39:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:39:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:39:33 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:39:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:39:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:39:35 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:39:35 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 18:39:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:39:35 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:39:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:39:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:39:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:39:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:39:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:39:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:39:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:39:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564884
Sun 19 Jan 2014 18:39:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:39:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564884
Sun 19 Jan 2014 18:39:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:39:40 - job_xml_thread(): Done retrieving: data size 43564884
Sun 19 Jan 2014 18:39:40 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:39:40 - XML: Start document: iteration 20
Sun 19 Jan 2014 18:39:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:39:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:39:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:39:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:39:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:39:51 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:39:52 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:39:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 18:39:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:39:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 18:39:52 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:39:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8961 values 141286 bits 17660 bytes 
Sun 19 Jan 2014 18:39:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:39:59 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:39:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:39:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:40:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:40:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:40:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:40:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:40:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:40:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:40:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:40:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:40:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:40:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:40:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:40:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:40:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:40:03 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:40:03 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:40:03 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:40:03 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:40:03 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:40:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:40:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565058
Sun 19 Jan 2014 18:40:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:40:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565058
Sun 19 Jan 2014 18:40:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:40:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:40:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:40:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:40:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:40:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:40:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:40:18 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:40:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:40:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:40:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:40:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:40:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:40:22 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:40:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 18:40:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:40:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:40:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:40:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:40:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:40:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:40:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:40:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:40:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:40:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:40:26 - job_xml_thread(): Done retrieving: data size 43562626
Sun 19 Jan 2014 18:40:26 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:40:26 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 18:40:26 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 18:40:26 - Housekeeping: done.
Sun 19 Jan 2014 18:40:26 - XML: Start document: iteration 0
Sun 19 Jan 2014 18:40:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562626
Sun 19 Jan 2014 18:40:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562626
Sun 19 Jan 2014 18:40:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:40:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:40:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:40:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:40:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:40:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:40:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:40:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:40:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:40:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:40:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:40:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:40:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:40:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:40:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:40:44 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:40:44 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:40:44 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:40:44 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:40:44 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:40:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:40:49 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:40:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:40:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:40:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:40:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:40:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:40:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:40:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:40:52 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:40:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:40:52 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:40:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 18:40:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 18:40:52 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:40:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5830 values 91942 bits 11492 bytes 
Sun 19 Jan 2014 18:40:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:40:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557476
Sun 19 Jan 2014 18:40:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:40:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557476
Sun 19 Jan 2014 18:40:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:40:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:40:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:40:59 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:40:59 - job_xml_thread(): Done retrieving: data size 43557476
Sun 19 Jan 2014 18:40:59 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:41:00 - XML: Start document: iteration 1
Sun 19 Jan 2014 18:41:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:41:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:41:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:41:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:41:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:41:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:41:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:41:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:41:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:41:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:41:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:41:13 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:41:13 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:41:13 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:41:13 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:41:13 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:41:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:41:15 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:41:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:41:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:41:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:41:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:41:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:41:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:41:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:41:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43506071
Sun 19 Jan 2014 18:41:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:41:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43506071
Sun 19 Jan 2014 18:41:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:41:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:41:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:41:28 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:41:28 - job_xml_thread(): Done retrieving: data size 43506071
Sun 19 Jan 2014 18:41:28 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:41:28 - XML: Start document: iteration 2
Sun 19 Jan 2014 18:41:29 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:41:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 18:41:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:41:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:41:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:41:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:41:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:41:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:41:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:41:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:41:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:41:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:41:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:41:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:41:41 - XML: Processed 652602 elements - found 0 jobs
Sun 19 Jan 2014 18:41:41 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:41:41 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:41:41 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:41:41 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:41:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:41:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:41:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:41:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:41:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:41:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:41:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:41:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:41:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:41:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42995096
Sun 19 Jan 2014 18:41:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:41:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42995096
Sun 19 Jan 2014 18:41:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:41:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:41:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:41:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:41:52 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:41:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:41:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 18:41:52 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:41:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 18:41:52 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:41:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6301 values 99388 bits 12423 bytes 
Sun 19 Jan 2014 18:41:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:41:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:41:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:41:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:41:56 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:41:56 - job_xml_thread(): Done retrieving: data size 42995096
Sun 19 Jan 2014 18:41:56 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:41:56 - XML: Start document: iteration 3
Sun 19 Jan 2014 18:41:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:41:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:41:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:41:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:41:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42995096
Sun 19 Jan 2014 18:41:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:42:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:42:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:42:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:42:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:42:12 - XML: Processed 646344 elements - found 0 jobs
Sun 19 Jan 2014 18:42:12 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:42:12 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:42:13 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:42:13 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:42:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:42:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:42:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:42:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:42:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:42:17 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:42:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:42:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:42:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:42:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:42:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:42:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:42:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:42:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:42:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:42:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:42:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:42:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:42:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42992129
Sun 19 Jan 2014 18:42:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:42:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42992129
Sun 19 Jan 2014 18:42:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:42:28 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:42:28 - job_xml_thread(): Done retrieving: data size 42992129
Sun 19 Jan 2014 18:42:28 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:42:28 - XML: Start document: iteration 4
Sun 19 Jan 2014 18:42:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:42:30 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:42:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:42:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:42:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:42:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:42:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:42:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:42:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:42:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:42:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:42:36 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:42:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 18:42:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:42:41 - XML: Processed 645893 elements - found 0 jobs
Sun 19 Jan 2014 18:42:41 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:42:41 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:42:41 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:42:41 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:42:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:42:45 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:42:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:42:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:42:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:42:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:42:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:42:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:42:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:42:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:42:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:42:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43477359
Sun 19 Jan 2014 18:42:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:42:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43477359
Sun 19 Jan 2014 18:42:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:42:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:42:52 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:42:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:42:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 18:42:53 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:42:54 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:42:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 18:42:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5979 values 94337 bits 11792 bytes 
Sun 19 Jan 2014 18:42:56 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:42:56 - job_xml_thread(): Done retrieving: data size 43477359
Sun 19 Jan 2014 18:42:56 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:42:56 - XML: Start document: iteration 5
Sun 19 Jan 2014 18:42:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:42:59 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:42:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:42:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:43:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:43:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:43:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:43:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:43:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:43:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:43:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:43:09 - XML: Processed 652428 elements - found 0 jobs
Sun 19 Jan 2014 18:43:09 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:43:09 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:43:09 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:43:09 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:43:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:43:11 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:43:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:43:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:43:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:43:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:43:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:43:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:43:14 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 18:43:14 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 18:43:14 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:43:14 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:43:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 18:43:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:43:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:43:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43543911
Sun 19 Jan 2014 18:43:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:43:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:43:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:43:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43543911
Sun 19 Jan 2014 18:43:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:43:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:43:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:43:25 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:43:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:43:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:43:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:43:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:43:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:43:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:43:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:43:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:43:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:43:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:43:28 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:43:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:43:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:43:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:43:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:43:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:43:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:43:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:43:30 - job_xml_thread(): Done retrieving: data size 43584763
Sun 19 Jan 2014 18:43:30 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:43:30 - XML: Start document: iteration 6
Sun 19 Jan 2014 18:43:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584763
Sun 19 Jan 2014 18:43:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:43:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584763
Sun 19 Jan 2014 18:43:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:43:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:43:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:43:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:43:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:43:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:43:45 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:43:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:43:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:43:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:43:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:43:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:43:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:43:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:43:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:43:52 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:43:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:43:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:43:52 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:43:52 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:43:52 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:43:52 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:43:52 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:43:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:43:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:43:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:43:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:43:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:43:54 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:43:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:43:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 18:43:54 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:43:54 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:43:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 18:43:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6128 values 96653 bits 12081 bytes 
Sun 19 Jan 2014 18:43:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:43:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43546178
Sun 19 Jan 2014 18:43:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:43:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43546178
Sun 19 Jan 2014 18:43:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:44:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:44:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:44:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:44:07 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:44:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:44:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:44:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:44:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:44:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:44:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:44:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:44:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:44:08 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:44:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:44:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:44:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:44:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:44:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:44:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:44:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:44:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:44:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:44:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:44:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579738
Sun 19 Jan 2014 18:44:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:44:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579738
Sun 19 Jan 2014 18:44:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:44:13 - job_xml_thread(): Done retrieving: data size 43579738
Sun 19 Jan 2014 18:44:13 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:44:13 - XML: Start document: iteration 7
Sun 19 Jan 2014 18:44:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:44:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:44:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:44:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:44:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:44:29 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:44:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:44:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:44:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:44:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:44:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:44:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:44:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:44:32 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:44:32 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:44:32 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:44:32 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:44:32 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:44:36 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:44:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 18:44:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:44:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:44:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:44:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:44:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:44:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:44:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:44:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:44:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:44:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:44:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560386
Sun 19 Jan 2014 18:44:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:44:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560386
Sun 19 Jan 2014 18:44:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:44:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:44:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:44:47 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:44:47 - job_xml_thread(): Done retrieving: data size 43560386
Sun 19 Jan 2014 18:44:47 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:44:47 - XML: Start document: iteration 8
Sun 19 Jan 2014 18:44:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:44:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:44:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:44:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:44:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:44:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:44:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:44:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:44:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:44:54 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:44:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:44:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:44:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:44:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:44:54 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:44:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 18:44:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 18:44:55 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:44:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6291 values 99175 bits 12396 bytes 
Sun 19 Jan 2014 18:45:00 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:45:00 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:45:00 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:45:00 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:45:00 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:45:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:45:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:45:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:45:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:45:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:45:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:45:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:45:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:45:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:45:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581674
Sun 19 Jan 2014 18:45:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:45:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581674
Sun 19 Jan 2014 18:45:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:45:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:45:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:45:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:45:13 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:45:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:45:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:45:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:45:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:45:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:45:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581674
Sun 19 Jan 2014 18:45:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:45:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:45:15 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:45:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:45:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:45:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:45:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:45:22 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:45:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:45:25 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:45:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:45:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:45:25 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:45:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 18:45:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:45:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:45:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:45:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:45:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:45:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:45:27 - job_xml_thread(): Done retrieving: data size 43549231
Sun 19 Jan 2014 18:45:27 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:45:27 - XML: Start document: iteration 9
Sun 19 Jan 2014 18:45:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43549231
Sun 19 Jan 2014 18:45:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:45:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:45:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:45:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:45:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:45:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43549231
Sun 19 Jan 2014 18:45:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:45:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:45:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:45:35 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 18:45:35 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:45:37 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:45:37 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 18:45:37 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 18:45:37 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:45:37 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 18:45:41 - size of cluster 'LISA Cluster': 624 hosts 79473 metrics 780344 values 12299712 bits 1537464 bytes 
Sun 19 Jan 2014 18:45:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:45:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:45:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:45:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:45:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:45:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:45:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:45:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:45:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:45:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:45:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:45:49 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:45:49 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:45:49 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:45:49 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:45:49 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:45:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:45:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:45:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:45:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:45:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:45:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:45:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:45:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:45:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:45:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571123
Sun 19 Jan 2014 18:45:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:45:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571123
Sun 19 Jan 2014 18:45:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:45:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:45:55 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:45:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:45:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 18:45:57 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:45:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8940 values 141076 bits 17634 bytes 
Sun 19 Jan 2014 18:45:57 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:45:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 18:46:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:46:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:46:04 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:46:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:46:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:46:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:46:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:46:07 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:46:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:46:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:46:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:46:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:46:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:46:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:46:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:46:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:46:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:46:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:46:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:46:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:46:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:46:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:46:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:46:14 - job_xml_thread(): Done retrieving: data size 43563865
Sun 19 Jan 2014 18:46:14 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:46:14 - XML: Start document: iteration 10
Sun 19 Jan 2014 18:46:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563865
Sun 19 Jan 2014 18:46:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563865
Sun 19 Jan 2014 18:46:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:46:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:46:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:46:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:46:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:46:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:46:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:46:28 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:46:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:46:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:46:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:46:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:46:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:46:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:46:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:46:31 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:46:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 18:46:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:46:33 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:46:33 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:46:33 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:46:33 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:46:33 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:46:37 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:46:37 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 18:46:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:46:37 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:46:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:46:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:46:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:46:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:46:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:46:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:46:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:46:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553206
Sun 19 Jan 2014 18:46:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:46:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553206
Sun 19 Jan 2014 18:46:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:46:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:46:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:46:48 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:46:48 - job_xml_thread(): Done retrieving: data size 43553206
Sun 19 Jan 2014 18:46:48 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:46:48 - XML: Start document: iteration 11
Sun 19 Jan 2014 18:46:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:46:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:46:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:46:57 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:46:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:46:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:46:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:46:58 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:46:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:46:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 18:46:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:46:58 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:46:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:46:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:46:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:46:58 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:46:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:46:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 18:46:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6003 values 94890 bits 11861 bytes 
Sun 19 Jan 2014 18:47:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:47:00 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:47:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:47:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:47:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:47:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:47:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:47:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:47:04 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:47:04 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:47:04 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:47:04 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:47:04 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:47:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:47:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575634
Sun 19 Jan 2014 18:47:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:47:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575634
Sun 19 Jan 2014 18:47:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:47:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:47:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:47:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:47:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:47:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:47:19 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:47:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:47:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:47:19 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:47:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:47:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:47:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:47:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:47:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:47:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:47:24 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:47:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:47:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:47:24 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:47:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 18:47:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:47:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:47:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:47:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:47:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:47:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:47:27 - job_xml_thread(): Done retrieving: data size 43498726
Sun 19 Jan 2014 18:47:27 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:47:27 - XML: Start document: iteration 12
Sun 19 Jan 2014 18:47:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43498726
Sun 19 Jan 2014 18:47:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:47:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43498726
Sun 19 Jan 2014 18:47:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:47:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:47:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:47:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:47:39 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:47:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:47:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:47:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:47:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:47:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:47:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:47:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:47:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:47:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:47:46 - XML: Processed 652602 elements - found 0 jobs
Sun 19 Jan 2014 18:47:46 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:47:46 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:47:46 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:47:46 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:47:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:47:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:47:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:47:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:47:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:47:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:47:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:47:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:47:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:47:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42942008
Sun 19 Jan 2014 18:47:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:47:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42942008
Sun 19 Jan 2014 18:47:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:47:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:47:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:47:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:47:58 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:48:00 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:48:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 18:48:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:48:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 18:48:00 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:48:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8882 values 140506 bits 17563 bytes 
Sun 19 Jan 2014 18:48:01 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:48:02 - job_xml_thread(): Done retrieving: data size 42942008
Sun 19 Jan 2014 18:48:02 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:48:02 - XML: Start document: iteration 13
Sun 19 Jan 2014 18:48:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:48:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:48:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:48:10 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:48:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:48:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:48:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:48:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:48:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:48:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:48:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:48:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:48:14 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:48:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:48:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:48:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:48:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:48:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:48:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:48:16 - XML: Processed 645678 elements - found 0 jobs
Sun 19 Jan 2014 18:48:16 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:48:16 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:48:16 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:48:16 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:48:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:48:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42979227
Sun 19 Jan 2014 18:48:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:48:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42979227
Sun 19 Jan 2014 18:48:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:48:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:48:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:48:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:48:30 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:48:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:48:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:48:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:48:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:48:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:48:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:48:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:48:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:48:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:48:31 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:48:35 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:48:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 18:48:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:48:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:48:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:48:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:48:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:48:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:48:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:48:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:48:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:48:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:48:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43387219
Sun 19 Jan 2014 18:48:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:48:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43387219
Sun 19 Jan 2014 18:48:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:48:41 - job_xml_thread(): Done retrieving: data size 43387219
Sun 19 Jan 2014 18:48:41 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:48:41 - XML: Start document: iteration 14
Sun 19 Jan 2014 18:48:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:48:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:48:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:48:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:48:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:48:54 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:48:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:48:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:48:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:48:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:48:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:48:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:48:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:49:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:49:00 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:49:01 - XML: Processed 651278 elements - found 0 jobs
Sun 19 Jan 2014 18:49:01 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:49:01 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:49:01 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:49:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:49:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 18:49:01 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:49:01 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:49:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 18:49:01 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:49:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5827 values 92001 bits 11500 bytes 
Sun 19 Jan 2014 18:49:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:49:05 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:49:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:49:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:49:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:49:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:49:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:49:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:49:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:49:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43539901
Sun 19 Jan 2014 18:49:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:49:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43539901
Sun 19 Jan 2014 18:49:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:49:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:49:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:49:16 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:49:16 - job_xml_thread(): Done retrieving: data size 43539901
Sun 19 Jan 2014 18:49:17 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:49:18 - XML: Start document: iteration 15
Sun 19 Jan 2014 18:49:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:49:19 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:49:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:49:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:49:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:49:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:49:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:49:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:49:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:49:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:49:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:49:29 - XML: Processed 653328 elements - found 0 jobs
Sun 19 Jan 2014 18:49:29 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:49:29 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:49:29 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:49:29 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:49:31 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:49:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 18:49:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:49:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:49:32 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:49:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:49:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:49:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:49:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:49:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:49:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:49:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:49:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554553
Sun 19 Jan 2014 18:49:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:49:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554553
Sun 19 Jan 2014 18:49:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:49:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:49:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:49:44 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:49:44 - job_xml_thread(): Done retrieving: data size 43554553
Sun 19 Jan 2014 18:49:44 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:49:44 - XML: Start document: iteration 16
Sun 19 Jan 2014 18:49:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:49:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:49:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:49:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:49:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:49:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:49:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:49:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:49:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:49:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:49:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:49:57 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:49:57 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:49:57 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:49:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:49:58 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:49:58 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:49:58 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:49:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:49:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:49:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:49:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:49:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:49:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:50:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:50:01 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:50:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:50:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43594749
Sun 19 Jan 2014 18:50:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:50:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43594749
Sun 19 Jan 2014 18:50:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:50:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:50:02 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:50:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 18:50:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 18:50:02 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:50:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6367 values 100479 bits 12559 bytes 
Sun 19 Jan 2014 18:50:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:50:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:50:13 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:50:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:50:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:50:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:50:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:50:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:50:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:50:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:50:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:50:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:50:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:50:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:50:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:50:18 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:50:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:50:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:50:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:50:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:50:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:50:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:50:22 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:50:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 18:50:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:50:22 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 18:50:22 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 18:50:22 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:50:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:50:22 - job_xml_thread(): Done retrieving: data size 43570945
Sun 19 Jan 2014 18:50:22 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:50:22 - XML: Start document: iteration 17
Sun 19 Jan 2014 18:50:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570945
Sun 19 Jan 2014 18:50:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:50:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570945
Sun 19 Jan 2014 18:50:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:50:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:50:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:50:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:50:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:50:37 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 18:50:37 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:50:37 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:50:37 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:50:37 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:50:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:50:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:50:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:50:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:50:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:50:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:50:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:50:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:50:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:50:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:50:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:50:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:50:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:50:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:50:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:50:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:50:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:50:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:50:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43594245
Sun 19 Jan 2014 18:50:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:50:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43594245
Sun 19 Jan 2014 18:50:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:50:52 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:50:52 - job_xml_thread(): Done retrieving: data size 43594245
Sun 19 Jan 2014 18:50:52 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:50:52 - XML: Start document: iteration 18
Sun 19 Jan 2014 18:50:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:50:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:50:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:50:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:50:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:50:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:50:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:50:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:50:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:50:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:50:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:51:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:51:02 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:51:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:51:02 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:51:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 18:51:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 18:51:02 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:51:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6283 values 99120 bits 12390 bytes 
Sun 19 Jan 2014 18:51:05 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:51:05 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:51:05 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:51:05 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:51:05 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:51:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:51:07 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:51:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:51:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:51:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:51:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:51:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:51:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:51:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:51:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43547750
Sun 19 Jan 2014 18:51:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:51:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43547750
Sun 19 Jan 2014 18:51:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:51:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:51:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:51:20 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:51:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:51:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:51:20 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:51:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:51:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:51:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:51:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:51:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:51:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:51:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:51:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:51:24 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:51:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 18:51:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:51:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:51:25 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:51:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:51:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:51:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:51:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:51:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:51:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:51:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:51:26 - job_xml_thread(): Done retrieving: data size 43568140
Sun 19 Jan 2014 18:51:26 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:51:26 - XML: Start document: iteration 19
Sun 19 Jan 2014 18:51:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568140
Sun 19 Jan 2014 18:51:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:51:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568140
Sun 19 Jan 2014 18:51:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:51:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:51:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:51:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:51:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:51:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:51:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:51:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:51:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:51:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:51:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:51:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:51:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:51:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:51:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:51:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:51:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:51:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:51:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:51:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:51:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:51:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:51:49 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:51:49 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:51:49 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:51:49 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:51:49 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:51:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:51:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576119
Sun 19 Jan 2014 18:51:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:51:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576119
Sun 19 Jan 2014 18:51:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:51:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:51:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:52:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:52:00 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:52:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:52:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:52:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:52:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:52:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:52:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:52:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576119
Sun 19 Jan 2014 18:52:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:52:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:52:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:52:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:52:03 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:52:04 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:52:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:52:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 18:52:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 18:52:04 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:52:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9161 values 144551 bits 18068 bytes 
Sun 19 Jan 2014 18:52:04 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:52:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:52:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:52:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:52:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:52:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:52:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:52:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:52:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:52:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:52:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:52:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:52:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:52:14 - job_xml_thread(): Done retrieving: data size 43559615
Sun 19 Jan 2014 18:52:14 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:52:14 - XML: Start document: iteration 20
Sun 19 Jan 2014 18:52:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559615
Sun 19 Jan 2014 18:52:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:52:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:52:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:52:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:52:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:52:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559615
Sun 19 Jan 2014 18:52:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:52:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:52:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:52:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:52:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:52:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:52:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:52:33 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:52:33 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:52:33 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:52:33 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:52:33 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:52:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:52:36 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:52:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:52:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:52:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:52:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:52:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:52:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:52:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:52:37 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 18:52:37 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:52:38 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:52:38 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 18:52:38 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 18:52:38 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:52:38 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 18:52:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:52:39 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:52:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:52:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:52:39 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 781048 values 12321954 bits 1540244 bytes 
Sun 19 Jan 2014 18:52:40 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:52:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 18:52:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:52:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:52:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:52:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:52:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:52:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:52:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573701
Sun 19 Jan 2014 18:52:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:52:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573701
Sun 19 Jan 2014 18:52:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:52:48 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:52:48 - job_xml_thread(): Done retrieving: data size 43573701
Sun 19 Jan 2014 18:52:48 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:52:48 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 18:52:49 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 18:52:49 - Housekeeping: done.
Sun 19 Jan 2014 18:52:49 - XML: Start document: iteration 0
Sun 19 Jan 2014 18:52:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:52:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:52:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:52:54 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:52:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:52:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:52:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:52:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:52:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:52:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:52:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:52:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:52:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:53:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:53:04 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:53:05 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:53:05 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:53:05 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:53:05 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:53:05 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:53:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:53:05 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:53:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 18:53:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 18:53:05 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:53:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5820 values 91778 bits 11472 bytes 
Sun 19 Jan 2014 18:53:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:53:06 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:53:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:53:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:53:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:53:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:53:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:53:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:53:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:53:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560529
Sun 19 Jan 2014 18:53:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:53:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:53:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:53:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560529
Sun 19 Jan 2014 18:53:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:53:20 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:53:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:53:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:53:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:53:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:53:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:53:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:53:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:53:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:53:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:53:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:53:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:53:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:53:26 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:53:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:53:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:53:27 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:53:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 18:53:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:53:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:53:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:53:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:53:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:53:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:53:30 - job_xml_thread(): Done retrieving: data size 43494798
Sun 19 Jan 2014 18:53:30 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:53:30 - XML: Start document: iteration 1
Sun 19 Jan 2014 18:53:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43494798
Sun 19 Jan 2014 18:53:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:53:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43494798
Sun 19 Jan 2014 18:53:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:53:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:53:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:53:38 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:53:38 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 18:53:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:53:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:53:52 - XML: Processed 652602 elements - found 0 jobs
Sun 19 Jan 2014 18:53:52 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:53:52 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:53:52 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:53:52 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:53:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:53:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:53:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:53:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:53:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:53:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:53:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:53:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:53:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:53:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:53:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:53:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:53:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:53:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:53:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:53:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:53:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:53:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:53:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42925374
Sun 19 Jan 2014 18:53:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:53:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42925374
Sun 19 Jan 2014 18:53:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:54:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:54:05 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:54:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:54:05 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:54:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 18:54:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 18:54:06 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:54:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:54:06 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:54:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8745 values 137881 bits 17235 bytes 
Sun 19 Jan 2014 18:54:07 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:54:07 - job_xml_thread(): Done retrieving: data size 42925374
Sun 19 Jan 2014 18:54:07 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:54:07 - XML: Start document: iteration 2
Sun 19 Jan 2014 18:54:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:54:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:54:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:54:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:54:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:54:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:54:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:54:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:54:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:54:15 - XML: Processed 645194 elements - found 0 jobs
Sun 19 Jan 2014 18:54:15 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:54:15 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:54:15 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:54:15 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:54:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:54:18 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:54:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:54:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:54:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:54:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:54:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:54:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:54:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:54:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42965838
Sun 19 Jan 2014 18:54:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:54:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42965838
Sun 19 Jan 2014 18:54:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:54:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:54:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:54:30 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:54:30 - job_xml_thread(): Done retrieving: data size 42965838
Sun 19 Jan 2014 18:54:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:54:30 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:54:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:54:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:54:30 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:54:30 - XML: Start document: iteration 3
Sun 19 Jan 2014 18:54:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:54:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:54:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:54:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:54:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42965838
Sun 19 Jan 2014 18:54:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:54:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:54:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:54:43 - XML: Processed 645846 elements - found 0 jobs
Sun 19 Jan 2014 18:54:43 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:54:43 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:54:43 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:54:43 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:54:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:54:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:54:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:54:51 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:54:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:54:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:54:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:54:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:54:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:54:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:54:52 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:54:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 18:54:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:54:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:54:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:54:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:54:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:54:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:54:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:54:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:54:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:54:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:54:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:54:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43551945
Sun 19 Jan 2014 18:54:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:54:58 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:54:58 - job_xml_thread(): Done retrieving: data size 43551945
Sun 19 Jan 2014 18:54:58 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:54:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43551945
Sun 19 Jan 2014 18:54:58 - XML: Start document: iteration 4
Sun 19 Jan 2014 18:54:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:55:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:55:05 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:55:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:55:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 18:55:06 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:55:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 18:55:06 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:55:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5826 values 91873 bits 11484 bytes 
Sun 19 Jan 2014 18:55:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:55:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:55:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:55:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:55:13 - XML: Processed 652944 elements - found 0 jobs
Sun 19 Jan 2014 18:55:13 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:55:13 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:55:13 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:55:13 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:55:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:55:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:55:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:55:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:55:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:55:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:55:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:55:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:55:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:55:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:55:21 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:55:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:55:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:55:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:55:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:55:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:55:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:55:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:55:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564039
Sun 19 Jan 2014 18:55:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:55:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564039
Sun 19 Jan 2014 18:55:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:55:28 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:55:28 - job_xml_thread(): Done retrieving: data size 43564039
Sun 19 Jan 2014 18:55:28 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:55:28 - XML: Start document: iteration 5
Sun 19 Jan 2014 18:55:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:55:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:55:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:55:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:55:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:55:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:55:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:55:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:55:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:55:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:55:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:55:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:55:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:55:42 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:55:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 18:55:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:55:44 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:55:44 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:55:44 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:55:44 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:55:44 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:55:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:55:49 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:55:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:55:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:55:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:55:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:55:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:55:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:55:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:55:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574754
Sun 19 Jan 2014 18:55:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:55:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574754
Sun 19 Jan 2014 18:55:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:55:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:55:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:55:59 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:55:59 - job_xml_thread(): Done retrieving: data size 43574754
Sun 19 Jan 2014 18:55:59 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:55:59 - XML: Start document: iteration 6
Sun 19 Jan 2014 18:56:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:56:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:56:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:56:07 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:56:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:56:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 18:56:07 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:56:07 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:56:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 18:56:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5918 values 93381 bits 11672 bytes 
Sun 19 Jan 2014 18:56:14 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:56:14 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:56:14 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:56:14 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:56:15 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:56:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:56:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:56:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:56:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:56:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:56:15 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:56:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:56:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:56:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:56:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:56:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:56:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:56:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:56:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:56:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:56:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:56:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:56:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:56:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43598101
Sun 19 Jan 2014 18:56:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:56:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43598101
Sun 19 Jan 2014 18:56:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:56:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:56:29 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:56:30 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:56:30 - job_xml_thread(): Done retrieving: data size 43598101
Sun 19 Jan 2014 18:56:30 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:56:30 - XML: Start document: iteration 7
Sun 19 Jan 2014 18:56:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:56:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:56:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:56:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:56:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:56:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:56:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:56:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:56:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:56:36 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:56:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 18:56:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:56:40 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:56:40 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:56:40 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:56:40 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:56:40 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:56:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:56:42 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:56:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:56:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:56:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:56:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:56:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:56:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:56:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:56:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:56:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:56:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557420
Sun 19 Jan 2014 18:56:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:56:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557420
Sun 19 Jan 2014 18:56:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:56:55 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:56:55 - job_xml_thread(): Done retrieving: data size 43557420
Sun 19 Jan 2014 18:56:56 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:56:56 - XML: Start document: iteration 8
Sun 19 Jan 2014 18:56:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:56:57 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:56:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:56:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:56:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:56:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:56:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:56:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:56:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:56:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:56:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:57:06 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:57:06 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:57:06 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:57:06 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:57:06 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:57:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:57:07 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:57:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:57:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:57:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:57:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:57:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:57:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:57:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:57:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:57:08 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:57:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:57:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 18:57:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 18:57:08 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:57:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5972 values 94182 bits 11772 bytes 
Sun 19 Jan 2014 18:57:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:57:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43551766
Sun 19 Jan 2014 18:57:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:57:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43551766
Sun 19 Jan 2014 18:57:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:57:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:57:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:57:21 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:57:21 - job_xml_thread(): Done retrieving: data size 43551766
Sun 19 Jan 2014 18:57:21 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:57:21 - XML: Start document: iteration 9
Sun 19 Jan 2014 18:57:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:57:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:57:32 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:57:32 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:57:32 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:57:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:57:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:57:33 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:57:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:57:33 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:57:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:57:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:57:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:57:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:57:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:57:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:57:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:57:35 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:57:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:57:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:57:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:57:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:57:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:57:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:57:36 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 18:57:36 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 18:57:36 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:57:36 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:57:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 18:57:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:57:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:57:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582028
Sun 19 Jan 2014 18:57:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:57:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582028
Sun 19 Jan 2014 18:57:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:57:48 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:57:48 - job_xml_thread(): Done retrieving: data size 43582028
Sun 19 Jan 2014 18:57:48 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:57:48 - XML: Start document: iteration 10
Sun 19 Jan 2014 18:57:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:57:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:57:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:57:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:57:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:57:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:57:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:57:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:57:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:57:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:57:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:57:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:57:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:57:57 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:57:57 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:57:57 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:57:57 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:57:57 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:57:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:57:59 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:57:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:57:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:58:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:58:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:58:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:58:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:58:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:58:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576661
Sun 19 Jan 2014 18:58:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:58:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576661
Sun 19 Jan 2014 18:58:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:58:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:58:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:58:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:58:08 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:58:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:58:10 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:58:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 18:58:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 18:58:10 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:58:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8174 values 128930 bits 16116 bytes 
Sun 19 Jan 2014 18:58:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:58:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:58:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:58:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:58:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:58:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:58:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:58:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:58:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:58:12 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:58:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:58:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:58:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:58:16 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:58:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:58:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:58:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:58:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:58:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:58:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:58:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:58:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43587860
Sun 19 Jan 2014 18:58:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:58:19 - job_xml_thread(): Done retrieving: data size 43587860
Sun 19 Jan 2014 18:58:19 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:58:19 - XML: Start document: iteration 11
Sun 19 Jan 2014 18:58:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43587860
Sun 19 Jan 2014 18:58:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:58:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:58:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:58:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:58:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:58:37 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:58:37 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:58:37 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:58:37 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:58:37 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:58:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:58:37 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:58:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:58:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:58:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:58:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:58:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:58:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:58:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:58:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:58:42 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:58:42 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:58:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 18:58:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:58:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:58:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:58:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:58:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:58:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:58:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:58:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:58:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43589979
Sun 19 Jan 2014 18:58:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:58:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43589979
Sun 19 Jan 2014 18:58:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:58:52 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:58:52 - job_xml_thread(): Done retrieving: data size 43589979
Sun 19 Jan 2014 18:58:52 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:58:52 - XML: Start document: iteration 12
Sun 19 Jan 2014 18:58:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:58:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:58:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:58:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:58:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:58:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:58:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:58:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:58:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:58:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:58:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:59:01 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:59:01 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:59:01 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:59:01 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:59:01 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:59:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:59:04 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:59:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:59:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:59:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:59:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:59:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:59:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:59:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:59:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576693
Sun 19 Jan 2014 18:59:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:59:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576693
Sun 19 Jan 2014 18:59:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:59:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:59:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:59:10 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:59:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:59:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:59:10 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:59:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 18:59:11 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:59:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 18:59:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8819 values 139040 bits 17380 bytes 
Sun 19 Jan 2014 18:59:16 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:59:16 - job_xml_thread(): Done retrieving: data size 43576693
Sun 19 Jan 2014 18:59:16 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:59:16 - XML: Start document: iteration 13
Sun 19 Jan 2014 18:59:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:59:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:59:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:59:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:59:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:59:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:59:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:59:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:59:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:59:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 18:59:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:59:27 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 18:59:27 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 18:59:27 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 18:59:27 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 18:59:27 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 18:59:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:59:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:59:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:59:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:59:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:59:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:59:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:59:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:59:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:59:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43462085
Sun 19 Jan 2014 18:59:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:59:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43462085
Sun 19 Jan 2014 18:59:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:59:38 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 18:59:38 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:59:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:59:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:59:39 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:59:39 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:59:39 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 18:59:39 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 18:59:39 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 18:59:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:59:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:59:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 18:59:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:59:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:59:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:59:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43462085
Sun 19 Jan 2014 18:59:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 18:59:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:59:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:59:43 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 18:59:43 - XMLGatherer.retrieveData(): actually retrieving data..
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sun 19 Jan 2014 18:59:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 18:59:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 18:59:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 18:59:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 18:59:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 18:59:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 18:59:54 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 18:59:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 18:59:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:59:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 18:59:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 18:59:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:59:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 18:59:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 18:59:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 18:59:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 18:59:55 - job_xml_thread(): Done retrieving: data size 42918777
Sun 19 Jan 2014 18:59:55 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 18:59:55 - XML: Start document: iteration 14
Sun 19 Jan 2014 18:59:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42918777
Sun 19 Jan 2014 18:59:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 18:59:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 18:59:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 18:59:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:59:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 18:59:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 18:59:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 18:59:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42918777
Sun 19 Jan 2014 18:59:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:00:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:00:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:00:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:00:10 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:00:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:00:11 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:00:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:00:12 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:00:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 19:00:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 19:00:12 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:00:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6082 values 95923 bits 11990 bytes 
Sun 19 Jan 2014 19:00:12 - XML: Processed 645662 elements - found 0 jobs
Sun 19 Jan 2014 19:00:12 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:00:12 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:00:12 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:00:13 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:00:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:00:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:00:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:00:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:00:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:00:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:00:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:00:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:00:16 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:00:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:00:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:00:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:00:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:00:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:00:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:00:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:00:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42983955
Sun 19 Jan 2014 19:00:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:00:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42983955
Sun 19 Jan 2014 19:00:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:00:28 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:00:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:00:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:00:29 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:00:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:00:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:00:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:00:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:00:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:00:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:00:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:00:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:00:32 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:00:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 19:00:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:00:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:00:34 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:00:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:00:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:00:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:00:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:00:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:00:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:00:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:00:36 - job_xml_thread(): Done retrieving: data size 42992808
Sun 19 Jan 2014 19:00:36 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:00:36 - XML: Start document: iteration 15
Sun 19 Jan 2014 19:00:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42992808
Sun 19 Jan 2014 19:00:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:00:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42992808
Sun 19 Jan 2014 19:00:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:00:40 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:00:41 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:00:43 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:00:43 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:00:44 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 19:00:44 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 19:00:44 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 19:00:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:00:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:00:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:00:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:00:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:00:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:00:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:00:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:00:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:00:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:00:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:00:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:00:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:00:55 - size of cluster 'LISA Cluster': 624 hosts 79478 metrics 827582 values 13045230 bits 1630653 bytes 
Sun 19 Jan 2014 19:00:58 - XML: Processed 645986 elements - found 0 jobs
Sun 19 Jan 2014 19:00:58 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:00:58 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:00:58 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:00:58 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:00:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:00:59 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:00:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:00:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:01:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:01:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:01:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:01:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:01:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:01:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564957
Sun 19 Jan 2014 19:01:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:01:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564957
Sun 19 Jan 2014 19:01:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:01:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:01:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:01:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:01:12 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:01:13 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:01:13 - job_xml_thread(): Done retrieving: data size 43564957
Sun 19 Jan 2014 19:01:13 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:01:13 - XML: Start document: iteration 16
Sun 19 Jan 2014 19:01:13 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:01:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 19:01:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:01:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 19:01:13 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:01:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9149 values 144445 bits 18055 bytes 
Sun 19 Jan 2014 19:01:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:01:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:01:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:01:20 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:01:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:01:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:01:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:01:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:01:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:01:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:01:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:01:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:01:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:01:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:01:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:01:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:01:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:01:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:01:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:01:26 - XML: Processed 653274 elements - found 0 jobs
Sun 19 Jan 2014 19:01:26 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:01:26 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:01:26 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:01:26 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:01:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:01:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567051
Sun 19 Jan 2014 19:01:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:01:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567051
Sun 19 Jan 2014 19:01:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:01:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:01:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:01:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:01:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:01:41 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:01:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:01:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:01:44 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:01:44 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:01:44 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 19:01:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:01:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:01:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:01:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:01:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:01:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:01:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:01:48 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:01:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:01:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:01:49 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:01:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 19:01:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:01:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:01:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:01:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:01:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:01:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:01:52 - job_xml_thread(): Done retrieving: data size 43575795
Sun 19 Jan 2014 19:01:52 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:01:52 - XML: Start document: iteration 17
Sun 19 Jan 2014 19:01:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575795
Sun 19 Jan 2014 19:01:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575795
Sun 19 Jan 2014 19:01:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:01:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:02:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:02:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:02:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:02:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:02:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:02:06 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:02:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:02:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:02:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:02:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:02:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:02:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:02:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:02:13 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:02:13 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:02:13 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:02:13 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:02:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:02:13 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:02:13 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:02:13 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:02:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:02:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 19:02:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 19:02:13 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:02:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5679 values 89745 bits 11218 bytes 
Sun 19 Jan 2014 19:02:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:02:16 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:02:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:02:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:02:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:02:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:02:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:02:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:02:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:02:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568476
Sun 19 Jan 2014 19:02:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:02:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568476
Sun 19 Jan 2014 19:02:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:02:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:02:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:02:28 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:02:28 - job_xml_thread(): Done retrieving: data size 43568476
Sun 19 Jan 2014 19:02:28 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:02:28 - XML: Start document: iteration 18
Sun 19 Jan 2014 19:02:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:02:29 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:02:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:02:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:02:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:02:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:02:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:02:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568476
Sun 19 Jan 2014 19:02:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:02:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:02:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:02:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:02:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:02:43 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:02:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:02:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:02:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:02:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:02:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:02:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:02:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:02:48 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:02:48 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:02:48 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:02:48 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:02:48 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:02:48 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:02:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 19:02:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:02:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:02:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:02:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:02:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:02:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:02:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:02:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:02:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:02:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:02:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43586798
Sun 19 Jan 2014 19:02:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:02:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43586798
Sun 19 Jan 2014 19:02:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:03:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:03:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:03:03 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:03:03 - job_xml_thread(): Done retrieving: data size 43586798
Sun 19 Jan 2014 19:03:03 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:03:03 - XML: Start document: iteration 19
Sun 19 Jan 2014 19:03:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:03:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:03:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:03:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:03:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:03:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:03:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:03:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:03:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:03:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:03:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:03:11 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:03:11 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:03:11 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:03:11 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:03:11 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:03:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:03:13 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:03:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:03:14 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:03:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 19:03:14 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:03:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5901 values 93387 bits 11673 bytes 
Sun 19 Jan 2014 19:03:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 19:03:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:03:15 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:03:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:03:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:03:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:03:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:03:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:03:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:03:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:03:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563214
Sun 19 Jan 2014 19:03:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:03:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563214
Sun 19 Jan 2014 19:03:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:03:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:03:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:03:26 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:03:26 - job_xml_thread(): Done retrieving: data size 43563214
Sun 19 Jan 2014 19:03:26 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:03:26 - XML: Start document: iteration 20
Sun 19 Jan 2014 19:03:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:03:30 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:03:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:03:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:03:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:03:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:03:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:03:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:03:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:03:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:03:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:03:40 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:03:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 19:03:40 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:03:40 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:03:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:03:40 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:03:40 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:03:40 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:03:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:03:42 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:03:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:03:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:03:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:03:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:03:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:03:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:03:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:03:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43545713
Sun 19 Jan 2014 19:03:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:03:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43545713
Sun 19 Jan 2014 19:03:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:03:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:03:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:03:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:03:54 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:03:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:03:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:03:55 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:03:55 - job_xml_thread(): Done retrieving: data size 43545713
Sun 19 Jan 2014 19:03:55 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:03:55 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 19:03:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:03:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:03:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:03:55 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 19:03:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:03:55 - Housekeeping: done.
Sun 19 Jan 2014 19:03:55 - XML: Start document: iteration 0
Sun 19 Jan 2014 19:03:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43545713
Sun 19 Jan 2014 19:03:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:03:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:03:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:04:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:04:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:04:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:04:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:04:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:04:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:04:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:04:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:04:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:04:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:04:14 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:04:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:04:14 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:04:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 19:04:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 19:04:14 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:04:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5590 values 88238 bits 11029 bytes 
Sun 19 Jan 2014 19:04:14 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:04:14 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:04:14 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:04:14 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:04:14 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:04:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:04:16 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:04:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:04:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:04:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:04:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:04:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:04:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:04:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:04:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571427
Sun 19 Jan 2014 19:04:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:04:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571427
Sun 19 Jan 2014 19:04:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:04:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:04:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:04:29 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:04:29 - job_xml_thread(): Done retrieving: data size 43571427
Sun 19 Jan 2014 19:04:29 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:04:29 - XML: Start document: iteration 1
Sun 19 Jan 2014 19:04:32 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 19:04:32 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 19:04:32 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:04:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:04:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:04:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:04:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:04:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:04:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:04:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:04:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:04:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:04:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:04:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:04:41 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:04:41 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:04:41 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:04:41 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:04:41 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:04:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:04:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:04:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:04:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:04:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:04:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:04:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:04:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:04:44 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:04:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 19:04:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:04:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:04:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563032
Sun 19 Jan 2014 19:04:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:04:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563032
Sun 19 Jan 2014 19:04:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:04:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:04:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:04:56 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:04:56 - job_xml_thread(): Done retrieving: data size 43563032
Sun 19 Jan 2014 19:04:56 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:04:56 - XML: Start document: iteration 2
Sun 19 Jan 2014 19:04:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:04:59 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:04:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:04:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:04:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:04:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:05:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:05:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:05:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:05:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:05:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:05:09 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:05:09 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:05:09 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:05:09 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:05:09 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:05:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:05:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:05:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:05:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:05:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:05:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:05:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:05:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:05:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:05:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43549211
Sun 19 Jan 2014 19:05:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:05:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43549211
Sun 19 Jan 2014 19:05:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:05:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:05:15 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:05:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:05:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:05:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:05:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 19:05:16 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:05:16 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:05:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 19:05:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8758 values 138130 bits 17266 bytes 
Sun 19 Jan 2014 19:05:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:05:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:05:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:05:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:05:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:05:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:05:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:05:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:05:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43549211
Sun 19 Jan 2014 19:05:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:05:24 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:05:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:05:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:05:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:05:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:05:31 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:05:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:05:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:05:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:05:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:05:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:05:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:05:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:05:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:05:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:05:36 - job_xml_thread(): Done retrieving: data size 43451479
Sun 19 Jan 2014 19:05:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43451479
Sun 19 Jan 2014 19:05:36 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:05:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:05:36 - XML: Start document: iteration 3
Sun 19 Jan 2014 19:05:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:05:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:05:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:05:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:05:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:05:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:05:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43451479
Sun 19 Jan 2014 19:05:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:05:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:05:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:05:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:05:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:05:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:05:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:05:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:05:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:05:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:05:54 - XML: Processed 652060 elements - found 0 jobs
Sun 19 Jan 2014 19:05:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:05:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:05:54 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:05:54 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:05:54 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:05:54 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:05:56 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:05:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 19:05:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:05:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:05:58 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:05:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:05:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:05:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:05:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:05:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:05:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:06:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:06:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42902792
Sun 19 Jan 2014 19:06:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:06:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42902792
Sun 19 Jan 2014 19:06:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:06:09 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:06:09 - job_xml_thread(): Done retrieving: data size 42902792
Sun 19 Jan 2014 19:06:09 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:06:09 - XML: Start document: iteration 4
Sun 19 Jan 2014 19:06:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:06:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:06:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:06:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:06:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:06:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:06:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:06:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:06:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:06:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:06:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:06:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:06:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:06:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:06:16 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:06:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:06:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 19:06:17 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:06:17 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:06:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 19:06:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6091 values 96081 bits 12010 bytes 
Sun 19 Jan 2014 19:06:19 - XML: Processed 645158 elements - found 0 jobs
Sun 19 Jan 2014 19:06:19 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:06:19 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:06:19 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:06:19 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:06:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:06:20 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:06:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:06:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:06:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:06:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:06:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:06:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:06:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:06:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42982572
Sun 19 Jan 2014 19:06:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:06:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42982572
Sun 19 Jan 2014 19:06:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:06:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:06:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:06:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:06:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:06:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:06:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:06:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:06:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:06:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:06:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:06:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:06:34 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:06:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:06:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:06:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:06:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:06:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:06:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:06:38 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:06:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 19:06:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:06:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:06:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:06:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:06:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:06:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:06:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43125214
Sun 19 Jan 2014 19:06:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:06:41 - job_xml_thread(): Done retrieving: data size 43125214
Sun 19 Jan 2014 19:06:41 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:06:41 - XML: Start document: iteration 5
Sun 19 Jan 2014 19:06:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43125214
Sun 19 Jan 2014 19:06:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:06:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:06:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:06:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:06:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:06:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:06:54 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:06:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:06:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:06:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:06:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:06:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:06:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:06:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:07:00 - XML: Processed 647500 elements - found 0 jobs
Sun 19 Jan 2014 19:07:00 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:07:00 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:07:00 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:07:00 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:07:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:07:03 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:07:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:07:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:07:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:07:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:07:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:07:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:07:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:07:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562829
Sun 19 Jan 2014 19:07:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:07:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562829
Sun 19 Jan 2014 19:07:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:07:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:07:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:07:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:07:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:07:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:07:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:07:15 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:07:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:07:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:07:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:07:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:07:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:07:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:07:17 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:07:18 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:07:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 19:07:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:07:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 19:07:18 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:07:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8804 values 138828 bits 17353 bytes 
Sun 19 Jan 2014 19:07:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:07:18 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:07:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:07:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:07:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:07:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:07:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:07:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:07:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:07:21 - job_xml_thread(): Done retrieving: data size 43580440
Sun 19 Jan 2014 19:07:21 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:07:21 - XML: Start document: iteration 6
Sun 19 Jan 2014 19:07:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580440
Sun 19 Jan 2014 19:07:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:07:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580440
Sun 19 Jan 2014 19:07:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:07:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:07:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:07:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:07:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:07:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:07:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:07:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:07:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:07:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:07:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:07:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:07:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:07:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:07:41 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:07:41 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:07:41 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:07:41 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:07:41 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:07:44 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 19:07:44 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:07:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:07:45 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:07:45 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:07:45 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 19:07:45 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:07:45 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 19:07:45 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 19:07:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:07:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:07:46 - size of cluster 'LISA Cluster': 624 hosts 79487 metrics 888867 values 14025077 bits 1753134 bytes 
Sun 19 Jan 2014 19:07:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:07:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:07:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:07:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:07:46 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:07:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 19:07:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:07:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:07:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555924
Sun 19 Jan 2014 19:07:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:07:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555924
Sun 19 Jan 2014 19:07:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:07:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:07:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:07:56 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:07:56 - job_xml_thread(): Done retrieving: data size 43555924
Sun 19 Jan 2014 19:07:57 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:07:57 - XML: Start document: iteration 7
Sun 19 Jan 2014 19:08:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:08:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:08:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:08:04 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:08:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:08:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:08:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:08:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:08:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:08:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:08:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:08:12 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:08:13 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:08:13 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:08:13 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:08:13 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:08:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:08:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:08:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:08:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:08:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:08:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:08:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:08:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:08:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:08:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43548799
Sun 19 Jan 2014 19:08:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:08:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43548799
Sun 19 Jan 2014 19:08:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:08:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:08:18 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:08:19 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:08:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:08:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 19:08:19 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:08:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 19:08:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8730 values 137671 bits 17208 bytes 
Sun 19 Jan 2014 19:08:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:08:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:08:28 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:08:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:08:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:08:29 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:08:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:08:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:08:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:08:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:08:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:08:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:08:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:08:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:08:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:08:32 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:08:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:08:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:08:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:08:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:08:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:08:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:08:36 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:08:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 19:08:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:08:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:08:37 - job_xml_thread(): Done retrieving: data size 43573662
Sun 19 Jan 2014 19:08:37 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:08:37 - XML: Start document: iteration 8
Sun 19 Jan 2014 19:08:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573662
Sun 19 Jan 2014 19:08:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573662
Sun 19 Jan 2014 19:08:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:08:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:08:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:08:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:08:45 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:08:45 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 19:08:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:08:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:08:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:08:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:08:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:08:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:08:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:08:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:08:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:08:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:08:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:08:56 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:08:56 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:08:56 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:08:56 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:08:57 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:08:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:08:59 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:08:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:08:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:09:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:09:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:09:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:09:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:09:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:09:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43551269
Sun 19 Jan 2014 19:09:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:09:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43551269
Sun 19 Jan 2014 19:09:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:09:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:09:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:09:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:09:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:09:12 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:09:12 - job_xml_thread(): Done retrieving: data size 43551269
Sun 19 Jan 2014 19:09:12 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:09:12 - XML: Start document: iteration 9
Sun 19 Jan 2014 19:09:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:09:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:09:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:09:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:09:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:09:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:09:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:09:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:09:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:09:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:09:20 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:09:21 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:09:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 19:09:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:09:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 19:09:21 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:09:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99031 bits 12378 bytes 
Sun 19 Jan 2014 19:09:24 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:09:24 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:09:24 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:09:24 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:09:24 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:09:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:09:26 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:09:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:09:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:09:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:09:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:09:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:09:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:09:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:09:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:09:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:09:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43542751
Sun 19 Jan 2014 19:09:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:09:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43542751
Sun 19 Jan 2014 19:09:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:09:39 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:09:39 - job_xml_thread(): Done retrieving: data size 43542751
Sun 19 Jan 2014 19:09:39 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:09:39 - XML: Start document: iteration 10
Sun 19 Jan 2014 19:09:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:09:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:09:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:09:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:09:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:09:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:09:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:09:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:09:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:09:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:09:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:09:46 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:09:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 19:09:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:09:53 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:09:53 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:09:53 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:09:53 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:09:53 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:09:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:09:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:09:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:09:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:09:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:09:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:09:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:09:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:09:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:09:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556783
Sun 19 Jan 2014 19:09:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:09:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556783
Sun 19 Jan 2014 19:09:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:09:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:09:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:10:08 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:10:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:10:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:10:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:10:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:10:10 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:10:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:10:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:10:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:10:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:10:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:10:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:10:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:10:14 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:10:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:10:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:10:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:10:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:10:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:10:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:10:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:10:16 - job_xml_thread(): Done retrieving: data size 43562827
Sun 19 Jan 2014 19:10:16 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:10:16 - XML: Start document: iteration 11
Sun 19 Jan 2014 19:10:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562827
Sun 19 Jan 2014 19:10:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:10:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562827
Sun 19 Jan 2014 19:10:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:10:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:10:21 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:10:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:10:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 19:10:22 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:10:22 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:10:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 19:10:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9189 values 144928 bits 18116 bytes 
Sun 19 Jan 2014 19:10:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:10:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:10:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:10:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:10:32 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:10:32 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:10:32 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:10:32 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:10:32 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:10:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:10:39 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:10:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:10:39 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:10:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:10:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:10:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:10:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:10:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:10:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:10:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:10:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:10:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:10:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:10:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:10:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:10:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:10:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:10:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43588028
Sun 19 Jan 2014 19:10:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:10:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43588028
Sun 19 Jan 2014 19:10:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:10:48 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:10:48 - job_xml_thread(): Done retrieving: data size 43588028
Sun 19 Jan 2014 19:10:48 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:10:48 - XML: Start document: iteration 12
Sun 19 Jan 2014 19:10:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:10:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:10:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:10:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:11:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:11:01 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:11:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:11:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:11:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:11:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:11:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:11:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:11:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:11:06 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:11:07 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:11:07 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:11:07 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:11:07 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:11:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:11:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:11:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:11:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:11:09 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:11:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 19:11:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:11:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:11:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:11:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:11:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:11:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:11:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578390
Sun 19 Jan 2014 19:11:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:11:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578390
Sun 19 Jan 2014 19:11:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:11:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:11:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:11:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:11:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:11:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:11:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:11:22 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:11:22 - job_xml_thread(): Done retrieving: data size 43578390
Sun 19 Jan 2014 19:11:22 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:11:22 - XML: Start document: iteration 13
Sun 19 Jan 2014 19:11:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:11:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:11:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:11:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:11:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:11:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:11:23 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:11:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:11:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 19:11:24 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:11:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5908 values 93192 bits 11649 bytes 
Sun 19 Jan 2014 19:11:24 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:11:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 19:11:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:11:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:11:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:11:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:11:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:11:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:11:34 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:11:34 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:11:34 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:11:34 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:11:34 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:11:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:11:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:11:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:11:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:11:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:11:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:11:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:11:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43487408
Sun 19 Jan 2014 19:11:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:11:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43487408
Sun 19 Jan 2014 19:11:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:11:49 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:11:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:11:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:11:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:11:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:11:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:11:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:11:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:11:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:11:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:11:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:11:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:11:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:11:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:11:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:11:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:11:54 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:11:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 19:11:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:11:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:11:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:11:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:11:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:11:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:11:57 - job_xml_thread(): Done retrieving: data size 42931991
Sun 19 Jan 2014 19:11:57 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:11:57 - XML: Start document: iteration 14
Sun 19 Jan 2014 19:11:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42931991
Sun 19 Jan 2014 19:11:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:11:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42931991
Sun 19 Jan 2014 19:11:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:12:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:12:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:12:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:12:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:12:13 - XML: Processed 645248 elements - found 0 jobs
Sun 19 Jan 2014 19:12:13 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:12:13 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:12:13 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:12:13 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:12:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:12:14 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:12:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:12:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:12:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:12:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:12:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:12:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:12:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:12:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:12:18 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:12:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:12:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:12:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:12:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:12:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:12:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:12:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:12:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42982671
Sun 19 Jan 2014 19:12:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:12:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42982671
Sun 19 Jan 2014 19:12:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:12:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:12:25 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:12:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:12:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 19:12:25 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:12:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 19:12:25 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:12:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9042 values 142644 bits 17830 bytes 
Sun 19 Jan 2014 19:12:28 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:12:29 - job_xml_thread(): Done retrieving: data size 42982671
Sun 19 Jan 2014 19:12:29 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:12:29 - XML: Start document: iteration 15
Sun 19 Jan 2014 19:12:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:12:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:12:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:12:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:12:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:12:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:12:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:12:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:12:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:12:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:12:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:12:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:12:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:12:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:12:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:12:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:12:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:12:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:12:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:12:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:12:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:12:46 - XML: Processed 645902 elements - found 0 jobs
Sun 19 Jan 2014 19:12:46 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:12:46 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:12:46 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:12:46 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:12:49 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 19:12:49 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 19:12:49 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:12:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:12:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43511389
Sun 19 Jan 2014 19:12:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:12:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43511389
Sun 19 Jan 2014 19:12:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:12:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:12:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:12:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:12:58 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:12:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:12:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:12:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:13:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:13:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:13:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:13:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:13:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:13:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:13:01 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:13:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:13:03 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:13:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:13:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:13:03 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:13:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 19:13:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:13:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:13:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:13:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:13:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:13:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:13:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571351
Sun 19 Jan 2014 19:13:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:13:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571351
Sun 19 Jan 2014 19:13:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:13:05 - job_xml_thread(): Done retrieving: data size 43571351
Sun 19 Jan 2014 19:13:05 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:13:05 - XML: Start document: iteration 16
Sun 19 Jan 2014 19:13:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:13:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:13:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:13:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:13:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:13:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:13:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:13:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:13:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:13:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:13:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:13:21 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:13:21 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:13:21 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:13:21 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:13:21 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:13:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:13:25 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:13:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:13:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 19:13:26 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:13:26 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:13:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 19:13:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5786 values 91300 bits 11412 bytes 
Sun 19 Jan 2014 19:13:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:13:27 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:13:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:13:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:13:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:13:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:13:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:13:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:13:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:13:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43543238
Sun 19 Jan 2014 19:13:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:13:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43543238
Sun 19 Jan 2014 19:13:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:13:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:13:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:13:37 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:13:37 - job_xml_thread(): Done retrieving: data size 43543238
Sun 19 Jan 2014 19:13:37 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:13:37 - XML: Start document: iteration 17
Sun 19 Jan 2014 19:13:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:13:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:13:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:13:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:13:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:13:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:13:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:13:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:13:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:13:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:13:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:13:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:13:49 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:13:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:13:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:13:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:13:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:13:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:13:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:13:51 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:13:51 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:13:51 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:13:51 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:13:51 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:13:51 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:13:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 19:13:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:13:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:13:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567458
Sun 19 Jan 2014 19:13:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:13:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567458
Sun 19 Jan 2014 19:13:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:13:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:13:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:14:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:14:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:14:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:14:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:14:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:14:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:14:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:14:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:14:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:14:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:14:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:14:06 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:14:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:14:06 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:14:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:14:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:14:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:14:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:14:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:14:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:14:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:14:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43593916
Sun 19 Jan 2014 19:14:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:14:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43593916
Sun 19 Jan 2014 19:14:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:14:09 - job_xml_thread(): Done retrieving: data size 43593916
Sun 19 Jan 2014 19:14:09 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:14:09 - XML: Start document: iteration 18
Sun 19 Jan 2014 19:14:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:14:19 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:14:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:14:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:14:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:14:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:14:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:14:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:14:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:14:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:14:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:14:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:14:27 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:14:27 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:14:27 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:14:27 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:14:27 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:14:27 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:14:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:14:29 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:14:29 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:14:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 19:14:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:14:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 19:14:29 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:14:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8776 values 138396 bits 17299 bytes 
Sun 19 Jan 2014 19:14:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:14:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:14:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:14:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:14:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:14:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:14:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:14:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560977
Sun 19 Jan 2014 19:14:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:14:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560977
Sun 19 Jan 2014 19:14:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:14:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:14:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:14:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:14:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:14:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:14:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:14:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:14:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:14:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:14:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:14:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:14:42 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:14:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:14:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:14:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:14:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:14:45 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:14:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 19:14:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:14:45 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 19:14:45 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:14:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:14:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:14:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:14:45 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:14:45 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 19:14:45 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 19:14:45 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:14:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:14:45 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 19:14:46 - size of cluster 'LISA Cluster': 624 hosts 79479 metrics 772943 values 12185731 bits 1523216 bytes 
Sun 19 Jan 2014 19:14:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:14:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567015
Sun 19 Jan 2014 19:14:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:14:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567015
Sun 19 Jan 2014 19:14:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:14:49 - job_xml_thread(): Done retrieving: data size 43567015
Sun 19 Jan 2014 19:14:49 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:14:49 - XML: Start document: iteration 19
Sun 19 Jan 2014 19:14:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:14:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:15:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:15:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:15:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:15:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:15:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:15:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:15:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:15:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:15:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:15:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:15:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:15:08 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:15:08 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:15:08 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:15:08 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:15:08 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:15:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:15:11 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:15:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:15:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:15:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:15:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:15:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:15:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:15:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:15:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571213
Sun 19 Jan 2014 19:15:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:15:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571213
Sun 19 Jan 2014 19:15:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:15:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:15:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:15:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:15:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:15:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:15:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:15:24 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:15:24 - job_xml_thread(): Done retrieving: data size 43571213
Sun 19 Jan 2014 19:15:24 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:15:24 - XML: Start document: iteration 20
Sun 19 Jan 2014 19:15:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:15:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:15:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:15:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:15:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:15:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:15:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:15:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:15:29 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:15:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:15:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 19:15:30 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:15:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8460 values 133369 bits 16671 bytes 
Sun 19 Jan 2014 19:15:30 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:15:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 19:15:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:15:31 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:15:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:15:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:15:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:15:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:15:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:15:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:15:34 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:15:34 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:15:34 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:15:34 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:15:34 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:15:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:15:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:15:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:15:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560283
Sun 19 Jan 2014 19:15:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:15:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560283
Sun 19 Jan 2014 19:15:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:15:46 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:15:46 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 19:15:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:15:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:15:49 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:15:49 - job_xml_thread(): Done retrieving: data size 43560283
Sun 19 Jan 2014 19:15:49 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:15:49 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 19:15:49 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 19:15:49 - Housekeeping: done.
Sun 19 Jan 2014 19:15:49 - XML: Start document: iteration 0
Sun 19 Jan 2014 19:15:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:15:59 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:15:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:15:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:16:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:16:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:16:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:16:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:16:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:16:01 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:16:01 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:16:01 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:16:01 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:16:01 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:16:03 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:16:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 19:16:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:16:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:16:04 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:16:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:16:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:16:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:16:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:16:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:16:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:16:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:16:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584336
Sun 19 Jan 2014 19:16:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:16:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584336
Sun 19 Jan 2014 19:16:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:16:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:16:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:16:16 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:16:16 - job_xml_thread(): Done retrieving: data size 43584336
Sun 19 Jan 2014 19:16:16 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:16:16 - XML: Start document: iteration 1
Sun 19 Jan 2014 19:16:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:16:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:16:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:16:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:16:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:16:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:16:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:16:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:16:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:16:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:16:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:16:25 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:16:25 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:16:25 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:16:25 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:16:25 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:16:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:16:29 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:16:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:16:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:16:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:16:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:16:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:16:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:16:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:16:30 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:16:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:16:31 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:16:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 19:16:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 19:16:31 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:16:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6025 values 95083 bits 11885 bytes 
Sun 19 Jan 2014 19:16:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:16:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553482
Sun 19 Jan 2014 19:16:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:16:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553482
Sun 19 Jan 2014 19:16:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:16:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:16:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:16:41 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:16:41 - job_xml_thread(): Done retrieving: data size 43553482
Sun 19 Jan 2014 19:16:41 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:16:41 - XML: Start document: iteration 2
Sun 19 Jan 2014 19:16:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:16:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:16:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:16:45 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:16:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:16:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:16:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:16:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:16:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:16:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:16:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:16:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:16:55 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:16:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:16:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:16:56 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:16:56 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:16:56 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:16:56 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:16:56 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:16:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:16:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:16:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:16:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:16:59 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:16:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 19:16:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:17:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:17:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558016
Sun 19 Jan 2014 19:17:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:17:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558016
Sun 19 Jan 2014 19:17:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:17:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:17:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:17:11 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:17:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:17:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:17:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:17:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:17:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:17:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:17:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:17:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:17:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:17:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:17:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:17:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:17:15 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:17:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:17:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:17:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:17:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:17:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:17:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:17:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:17:19 - job_xml_thread(): Done retrieving: data size 43512629
Sun 19 Jan 2014 19:17:19 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:17:19 - XML: Start document: iteration 3
Sun 19 Jan 2014 19:17:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43512629
Sun 19 Jan 2014 19:17:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43512629
Sun 19 Jan 2014 19:17:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:17:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:17:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:17:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:17:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:17:32 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:17:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:17:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:17:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:17:33 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:17:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 19:17:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 19:17:33 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:17:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7021 values 111141 bits 13892 bytes 
Sun 19 Jan 2014 19:17:33 - XML: Processed 652602 elements - found 0 jobs
Sun 19 Jan 2014 19:17:33 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:17:33 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:17:33 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:17:33 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:17:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:17:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:17:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:17:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:17:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:17:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:17:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:17:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:17:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:17:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:17:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:17:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:17:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:17:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:17:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:17:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:17:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:17:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:17:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42964752
Sun 19 Jan 2014 19:17:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:17:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42964752
Sun 19 Jan 2014 19:17:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:17:48 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:17:48 - job_xml_thread(): Done retrieving: data size 42964752
Sun 19 Jan 2014 19:17:48 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:17:48 - XML: Start document: iteration 4
Sun 19 Jan 2014 19:17:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:17:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:17:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:17:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:18:00 - XML: Processed 645736 elements - found 0 jobs
Sun 19 Jan 2014 19:18:00 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:18:00 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:18:00 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:18:00 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:18:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:18:03 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:18:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:18:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:18:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:18:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:18:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:18:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:18:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:18:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:18:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:18:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:18:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:18:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:18:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:18:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:18:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:18:10 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:18:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 19:18:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:18:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:18:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42951605
Sun 19 Jan 2014 19:18:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:18:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42951605
Sun 19 Jan 2014 19:18:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:18:15 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:18:15 - job_xml_thread(): Done retrieving: data size 42951605
Sun 19 Jan 2014 19:18:15 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:18:15 - XML: Start document: iteration 5
Sun 19 Jan 2014 19:18:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:18:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:18:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:18:22 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:18:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:18:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:18:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:18:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:18:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:18:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:18:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:18:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:18:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:18:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:18:33 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:18:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:18:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 19:18:34 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:18:34 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:18:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 19:18:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5538 values 87444 bits 10930 bytes 
Sun 19 Jan 2014 19:18:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:18:35 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:18:36 - XML: Processed 645508 elements - found 0 jobs
Sun 19 Jan 2014 19:18:36 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:18:36 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:18:36 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:18:36 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:18:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:18:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:18:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:18:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:18:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:18:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:18:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:18:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:18:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:18:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43306480
Sun 19 Jan 2014 19:18:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:18:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43306480
Sun 19 Jan 2014 19:18:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:18:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:18:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:18:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:18:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:18:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:18:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:18:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43306480
Sun 19 Jan 2014 19:18:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:18:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:18:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:18:51 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:18:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:18:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:18:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:18:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:18:59 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:19:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:19:01 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:19:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:19:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:19:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:19:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:19:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:19:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:19:02 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:19:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 19:19:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:19:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:19:05 - job_xml_thread(): Done retrieving: data size 43547825
Sun 19 Jan 2014 19:19:05 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:19:05 - XML: Start document: iteration 6
Sun 19 Jan 2014 19:19:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43547825
Sun 19 Jan 2014 19:19:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:19:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:19:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:19:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:19:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:19:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:19:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:19:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43547825
Sun 19 Jan 2014 19:19:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:19:13 - XML: Processed 653349 elements - found 0 jobs
Sun 19 Jan 2014 19:19:13 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:19:13 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:19:13 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:19:13 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:19:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:19:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:19:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:19:20 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:19:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:19:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:19:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:19:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:19:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:19:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:19:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:19:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:19:25 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:19:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:19:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:19:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:19:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:19:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:19:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:19:26 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 19:19:26 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 19:19:26 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:19:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:19:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43586331
Sun 19 Jan 2014 19:19:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:19:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43586331
Sun 19 Jan 2014 19:19:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:19:28 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:19:29 - job_xml_thread(): Done retrieving: data size 43586331
Sun 19 Jan 2014 19:19:29 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:19:29 - XML: Start document: iteration 7
Sun 19 Jan 2014 19:19:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:19:34 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:19:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:19:35 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:19:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 19:19:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 19:19:36 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:19:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:19:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:19:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8744 values 137984 bits 17248 bytes 
Sun 19 Jan 2014 19:19:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:19:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:19:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:19:43 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:19:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:19:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:19:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:19:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:19:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:19:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:19:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:19:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:19:48 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:19:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:19:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:19:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:19:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:19:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:19:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:19:50 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 19:19:50 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:19:50 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:19:50 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:19:50 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:19:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:19:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567310
Sun 19 Jan 2014 19:19:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:19:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567310
Sun 19 Jan 2014 19:19:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:19:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:19:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:20:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:20:01 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:20:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:20:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:20:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:20:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:20:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:20:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:20:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567310
Sun 19 Jan 2014 19:20:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:20:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:20:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:20:05 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:20:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:20:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:20:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:20:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:20:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:20:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:20:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:20:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:20:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:20:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:20:13 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:20:14 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:20:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 19:20:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:20:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:20:17 - job_xml_thread(): Done retrieving: data size 43545589
Sun 19 Jan 2014 19:20:17 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:20:17 - XML: Start document: iteration 8
Sun 19 Jan 2014 19:20:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:20:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:20:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43545589
Sun 19 Jan 2014 19:20:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:20:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:20:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:20:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43545589
Sun 19 Jan 2014 19:20:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:20:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:20:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:20:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:20:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:20:31 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:20:31 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:20:31 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:20:31 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:20:31 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:20:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:20:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:20:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:20:36 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:20:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:20:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:20:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:20:36 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:20:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:20:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:20:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:20:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:20:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:20:37 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:20:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:20:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 19:20:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 19:20:37 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:20:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5699 values 89859 bits 11232 bytes 
Sun 19 Jan 2014 19:20:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:20:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:20:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:20:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:20:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:20:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:20:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:20:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:20:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:20:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43595378
Sun 19 Jan 2014 19:20:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:20:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43595378
Sun 19 Jan 2014 19:20:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:20:46 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:20:46 - job_xml_thread(): Done retrieving: data size 43595378
Sun 19 Jan 2014 19:20:46 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:20:46 - XML: Start document: iteration 9
Sun 19 Jan 2014 19:20:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:20:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:20:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:20:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:20:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:20:59 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:20:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:20:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:21:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:21:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:21:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:21:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:21:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:21:02 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:21:02 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:21:02 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:21:02 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:21:02 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:21:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:21:04 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:21:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:21:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:21:05 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:21:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 19:21:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:21:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:21:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:21:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:21:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:21:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:21:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582762
Sun 19 Jan 2014 19:21:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:21:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582762
Sun 19 Jan 2014 19:21:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:21:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:21:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:21:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:21:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:21:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:21:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:21:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:21:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:21:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:21:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:21:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:21:17 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:21:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:21:20 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:21:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:21:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:21:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:21:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:21:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:21:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:21:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:21:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43589880
Sun 19 Jan 2014 19:21:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:21:22 - job_xml_thread(): Done retrieving: data size 43589880
Sun 19 Jan 2014 19:21:22 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:21:23 - XML: Start document: iteration 10
Sun 19 Jan 2014 19:21:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43589880
Sun 19 Jan 2014 19:21:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:21:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:21:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:21:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:21:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:21:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:21:37 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:21:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:21:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 19:21:39 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:21:39 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:21:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 19:21:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8761 values 138138 bits 17267 bytes 
Sun 19 Jan 2014 19:21:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:21:39 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:21:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:21:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:21:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:21:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:21:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:21:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:21:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:21:42 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:21:42 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:21:42 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:21:42 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:21:42 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:21:46 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 19:21:46 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:21:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:21:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:21:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:21:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:21:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:21:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:21:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:21:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:21:46 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:21:46 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:21:46 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 19:21:46 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 19:21:46 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 19:21:47 - size of cluster 'LISA Cluster': 624 hosts 79486 metrics 824437 values 13015704 bits 1626963 bytes 
Sun 19 Jan 2014 19:21:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:21:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565982
Sun 19 Jan 2014 19:21:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:21:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565982
Sun 19 Jan 2014 19:21:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:21:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:21:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:21:57 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:21:57 - job_xml_thread(): Done retrieving: data size 43565982
Sun 19 Jan 2014 19:21:57 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:21:57 - XML: Start document: iteration 11
Sun 19 Jan 2014 19:22:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:22:00 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:22:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:22:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:22:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:22:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:22:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:22:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:22:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:22:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:22:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:22:07 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:22:07 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:22:07 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:22:07 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:22:07 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:22:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:22:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:22:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:22:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:22:12 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:22:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 19:22:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:22:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:22:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:22:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:22:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:22:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:22:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43548064
Sun 19 Jan 2014 19:22:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:22:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:22:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:22:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43548064
Sun 19 Jan 2014 19:22:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:22:22 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:22:22 - job_xml_thread(): Done retrieving: data size 43548064
Sun 19 Jan 2014 19:22:22 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:22:22 - XML: Start document: iteration 12
Sun 19 Jan 2014 19:22:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:22:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:22:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:22:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:22:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:22:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:22:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:22:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:22:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:22:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:22:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:22:36 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:22:36 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:22:37 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:22:37 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:22:37 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:22:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:22:39 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:22:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:22:39 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:22:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:22:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:22:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:22:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:22:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:22:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:22:39 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:22:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:22:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 19:22:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 19:22:39 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:22:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5814 values 91658 bits 11457 bytes 
Sun 19 Jan 2014 19:22:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:22:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:22:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:22:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43550669
Sun 19 Jan 2014 19:22:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:22:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43550669
Sun 19 Jan 2014 19:22:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:22:46 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:22:46 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 19:22:52 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:22:52 - job_xml_thread(): Done retrieving: data size 43550669
Sun 19 Jan 2014 19:22:52 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:22:52 - XML: Start document: iteration 13
Sun 19 Jan 2014 19:22:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:22:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:23:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:23:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:23:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:23:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:23:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:23:03 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:23:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:23:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:23:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:23:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:23:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:23:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:23:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:23:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:23:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:23:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:23:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:23:06 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:23:06 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:23:06 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:23:06 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:23:06 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:23:06 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:23:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 19:23:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:23:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:23:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43535252
Sun 19 Jan 2014 19:23:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:23:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43535252
Sun 19 Jan 2014 19:23:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:23:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:23:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:23:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:23:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:23:21 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:23:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:23:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:23:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:23:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:23:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:23:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:23:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:23:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:23:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:23:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:23:24 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:23:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:23:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:23:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:23:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:23:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:23:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:23:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:23:28 - job_xml_thread(): Done retrieving: data size 43495813
Sun 19 Jan 2014 19:23:28 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:23:28 - XML: Start document: iteration 14
Sun 19 Jan 2014 19:23:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43495813
Sun 19 Jan 2014 19:23:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43495813
Sun 19 Jan 2014 19:23:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:23:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:23:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:23:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:23:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:23:39 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:23:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:23:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:23:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:23:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 19:23:40 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:23:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8595 values 135568 bits 16946 bytes 
Sun 19 Jan 2014 19:23:40 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:23:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 19:23:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:23:44 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:23:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:23:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:23:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:23:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:23:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:23:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:23:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:23:51 - XML: Processed 652598 elements - found 0 jobs
Sun 19 Jan 2014 19:23:51 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:23:51 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:23:51 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:23:51 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:23:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:23:52 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:23:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:23:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:23:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:23:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:23:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:23:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:23:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:23:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42926357
Sun 19 Jan 2014 19:23:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:23:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42926357
Sun 19 Jan 2014 19:23:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:24:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:24:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:24:06 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:24:06 - job_xml_thread(): Done retrieving: data size 42926357
Sun 19 Jan 2014 19:24:06 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:24:06 - XML: Start document: iteration 15
Sun 19 Jan 2014 19:24:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:24:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:24:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:24:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:24:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:24:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:24:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:24:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:24:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:24:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:24:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:24:17 - XML: Processed 645350 elements - found 0 jobs
Sun 19 Jan 2014 19:24:18 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:24:18 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:24:18 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:24:18 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:24:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:24:20 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:24:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:24:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:24:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:24:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:24:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:24:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:24:20 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:24:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 19:24:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:24:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:24:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42973472
Sun 19 Jan 2014 19:24:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:24:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42973472
Sun 19 Jan 2014 19:24:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:24:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:24:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:24:33 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:24:33 - job_xml_thread(): Done retrieving: data size 42973472
Sun 19 Jan 2014 19:24:33 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:24:33 - XML: Start document: iteration 16
Sun 19 Jan 2014 19:24:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:24:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:24:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:24:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:24:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:24:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:24:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:24:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:24:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:24:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:24:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:24:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:24:40 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:24:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:24:41 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:24:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 19:24:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 19:24:41 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:24:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5699 values 89847 bits 11230 bytes 
Sun 19 Jan 2014 19:24:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:24:45 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:24:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:24:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:24:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:24:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:24:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:24:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:24:47 - XML: Processed 645902 elements - found 0 jobs
Sun 19 Jan 2014 19:24:47 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:24:47 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:24:47 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:24:47 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:24:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:24:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:24:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:24:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43479962
Sun 19 Jan 2014 19:24:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:24:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43479962
Sun 19 Jan 2014 19:24:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:25:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:25:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:25:02 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:25:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:25:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:25:03 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:25:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:25:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:25:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:25:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:25:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:25:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:25:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:25:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:25:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:25:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:25:08 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:25:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 19:25:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:25:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:25:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:25:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:25:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:25:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:25:11 - job_xml_thread(): Done retrieving: data size 43570715
Sun 19 Jan 2014 19:25:11 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:25:11 - XML: Start document: iteration 17
Sun 19 Jan 2014 19:25:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570715
Sun 19 Jan 2014 19:25:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570715
Sun 19 Jan 2014 19:25:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:25:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:25:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:25:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:25:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:25:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:25:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:25:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:25:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:25:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:25:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:25:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:25:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:25:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:25:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:25:31 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:25:31 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:25:31 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:25:31 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:25:31 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:25:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:25:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:25:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:25:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:25:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:25:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:25:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:25:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:25:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:25:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561434
Sun 19 Jan 2014 19:25:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:25:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561434
Sun 19 Jan 2014 19:25:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:25:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:25:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:25:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:25:41 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:25:42 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:25:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 19:25:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:25:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 19:25:43 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:25:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8914 values 140606 bits 17575 bytes 
Sun 19 Jan 2014 19:25:46 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:25:46 - job_xml_thread(): Done retrieving: data size 43561434
Sun 19 Jan 2014 19:25:46 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:25:46 - XML: Start document: iteration 18
Sun 19 Jan 2014 19:25:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:25:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:25:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:25:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:25:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:25:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:25:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:25:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:25:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:25:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:25:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:26:00 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:26:00 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:26:00 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:26:00 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:26:00 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:26:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:26:03 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:26:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:26:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:26:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:26:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:26:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:26:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:26:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:26:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570917
Sun 19 Jan 2014 19:26:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:26:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570917
Sun 19 Jan 2014 19:26:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:26:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:26:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:26:15 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:26:15 - job_xml_thread(): Done retrieving: data size 43570917
Sun 19 Jan 2014 19:26:15 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:26:15 - XML: Start document: iteration 19
Sun 19 Jan 2014 19:26:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:26:18 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:26:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:26:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:26:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:26:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:26:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:26:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:26:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:26:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:26:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:26:25 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:26:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 19:26:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:26:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:26:31 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:26:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:26:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:26:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:26:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:26:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:26:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:26:32 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:26:32 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:26:32 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:26:32 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:26:32 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:26:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:26:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:26:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:26:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553340
Sun 19 Jan 2014 19:26:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:26:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553340
Sun 19 Jan 2014 19:26:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:26:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:26:43 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:26:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:26:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 19:26:44 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:26:44 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:26:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5949 values 93849 bits 11731 bytes 
Sun 19 Jan 2014 19:26:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 19:26:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:26:46 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:26:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:26:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:26:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:26:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:26:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:26:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:26:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:26:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:26:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:26:47 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:26:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:26:52 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:26:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:26:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:26:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:26:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:26:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:26:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:26:54 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 19:26:54 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 19:26:54 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:26:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:26:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43588226
Sun 19 Jan 2014 19:26:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:26:55 - job_xml_thread(): Done retrieving: data size 43588226
Sun 19 Jan 2014 19:26:55 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:26:55 - XML: Start document: iteration 20
Sun 19 Jan 2014 19:26:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43588226
Sun 19 Jan 2014 19:26:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:27:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:27:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:27:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:27:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:27:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:27:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:27:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:27:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:27:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:27:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:27:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:27:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:27:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:27:11 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:27:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 19:27:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:27:16 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:27:16 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:27:16 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:27:16 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:27:16 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:27:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:27:18 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:27:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:27:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:27:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:27:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:27:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:27:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:27:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:27:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564057
Sun 19 Jan 2014 19:27:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:27:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564057
Sun 19 Jan 2014 19:27:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:27:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:27:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:27:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:27:31 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:27:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:27:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:27:31 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:27:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:27:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:27:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:27:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:27:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:27:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:27:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:27:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:27:34 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:27:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:27:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:27:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:27:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:27:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:27:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:27:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:27:36 - job_xml_thread(): Done retrieving: data size 43590533
Sun 19 Jan 2014 19:27:36 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:27:36 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 19:27:36 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 19:27:36 - Housekeeping: done.
Sun 19 Jan 2014 19:27:36 - XML: Start document: iteration 0
Sun 19 Jan 2014 19:27:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43590533
Sun 19 Jan 2014 19:27:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:27:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43590533
Sun 19 Jan 2014 19:27:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:27:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:27:44 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:27:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:27:46 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:27:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 19:27:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 19:27:46 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:27:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:27:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9145 values 144306 bits 18038 bytes 
Sun 19 Jan 2014 19:27:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:27:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:27:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:27:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:27:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:27:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:27:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:27:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:27:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:27:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:27:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:27:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:27:54 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:27:54 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:27:54 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:27:54 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:27:54 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:28:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:28:00 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:28:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:28:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:28:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:28:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:28:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:28:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:28:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:28:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558051
Sun 19 Jan 2014 19:28:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:28:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558051
Sun 19 Jan 2014 19:28:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:28:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:28:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:28:09 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:28:09 - job_xml_thread(): Done retrieving: data size 43558051
Sun 19 Jan 2014 19:28:09 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:28:09 - XML: Start document: iteration 1
Sun 19 Jan 2014 19:28:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:28:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:28:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:28:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:28:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:28:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:28:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:28:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:28:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:28:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:28:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:28:25 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:28:25 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:28:25 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:28:25 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:28:25 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:28:26 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:28:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 19:28:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:28:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:28:27 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:28:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:28:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:28:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:28:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:28:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:28:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:28:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:28:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43549377
Sun 19 Jan 2014 19:28:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:28:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43549377
Sun 19 Jan 2014 19:28:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:28:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:28:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:28:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:28:37 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:28:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:28:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:28:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:28:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:28:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:28:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:28:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:28:40 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:28:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:28:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:28:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:28:42 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:28:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:28:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:28:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:28:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:28:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:28:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:28:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:28:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570988
Sun 19 Jan 2014 19:28:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:28:45 - job_xml_thread(): Done retrieving: data size 43570988
Sun 19 Jan 2014 19:28:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570988
Sun 19 Jan 2014 19:28:45 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:28:45 - XML: Start document: iteration 2
Sun 19 Jan 2014 19:28:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:28:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:28:46 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:28:47 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 19:28:47 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:28:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:28:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 19:28:48 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:28:48 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:28:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 19:28:49 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:28:49 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 19:28:49 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 19:28:49 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:28:49 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 19:28:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8873 values 139957 bits 17494 bytes 
Sun 19 Jan 2014 19:28:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:28:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:28:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:28:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:29:01 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:29:01 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:29:01 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:29:01 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:29:01 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:29:07 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 773511 values 12191815 bits 1523976 bytes 
Sun 19 Jan 2014 19:29:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:29:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:29:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:29:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:29:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:29:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:29:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:29:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:29:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:29:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:29:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:29:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:29:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:29:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:29:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:29:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:29:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:29:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:29:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43522116
Sun 19 Jan 2014 19:29:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:29:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43522116
Sun 19 Jan 2014 19:29:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:29:16 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:29:16 - job_xml_thread(): Done retrieving: data size 43522116
Sun 19 Jan 2014 19:29:17 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:29:17 - XML: Start document: iteration 3
Sun 19 Jan 2014 19:29:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:29:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:29:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:29:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:29:34 - XML: Processed 652602 elements - found 0 jobs
Sun 19 Jan 2014 19:29:34 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:29:34 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:29:34 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:29:34 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:29:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:29:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:29:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:29:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:29:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:29:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:29:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:29:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:29:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:29:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:29:37 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:29:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:29:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:29:37 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:29:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 19:29:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:29:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:29:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:29:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:29:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:29:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:29:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43018801
Sun 19 Jan 2014 19:29:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:29:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43018801
Sun 19 Jan 2014 19:29:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:29:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:29:48 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:29:49 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:29:49 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:29:49 - job_xml_thread(): Done retrieving: data size 43018801
Sun 19 Jan 2014 19:29:49 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:29:49 - XML: Start document: iteration 4
Sun 19 Jan 2014 19:29:49 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 19:29:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:29:49 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:29:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 19:29:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 19:29:49 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:29:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5831 values 91926 bits 11490 bytes 
Sun 19 Jan 2014 19:29:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:29:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:29:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:29:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:29:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:29:57 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:29:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:29:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:29:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:29:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:29:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:29:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:29:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:30:05 - XML: Processed 646376 elements - found 0 jobs
Sun 19 Jan 2014 19:30:05 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:30:05 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:30:05 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:30:05 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:30:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:30:05 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:30:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:30:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:30:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:30:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:30:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:30:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:30:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:30:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42917548
Sun 19 Jan 2014 19:30:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:30:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42917548
Sun 19 Jan 2014 19:30:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:30:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:30:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:30:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:30:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:30:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:30:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:30:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:30:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:30:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:30:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:30:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42917548
Sun 19 Jan 2014 19:30:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:30:20 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:30:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:30:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:30:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:30:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:30:31 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:30:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:30:32 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:30:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:30:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:30:32 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:30:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 19:30:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:30:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:30:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:30:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:30:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:30:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:30:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:30:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:30:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:30:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:30:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:30:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:30:36 - job_xml_thread(): Done retrieving: data size 43123642
Sun 19 Jan 2014 19:30:36 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:30:36 - XML: Start document: iteration 5
Sun 19 Jan 2014 19:30:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43123642
Sun 19 Jan 2014 19:30:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43123642
Sun 19 Jan 2014 19:30:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:30:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:30:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:30:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:30:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:30:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:30:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:30:49 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:30:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:30:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:30:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:30:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:30:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 19:30:51 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:30:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:30:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:30:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:30:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:30:51 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:30:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 19:30:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5949 values 93831 bits 11728 bytes 
Sun 19 Jan 2014 19:30:51 - XML: Processed 648114 elements - found 0 jobs
Sun 19 Jan 2014 19:30:51 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:30:52 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:30:52 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:30:52 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:30:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:30:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:30:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:30:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:30:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:30:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:30:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:30:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:31:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:31:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554119
Sun 19 Jan 2014 19:31:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:31:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554119
Sun 19 Jan 2014 19:31:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:31:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:31:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:31:07 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:31:07 - job_xml_thread(): Done retrieving: data size 43554119
Sun 19 Jan 2014 19:31:07 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:31:07 - XML: Start document: iteration 6
Sun 19 Jan 2014 19:31:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:31:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:31:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:31:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:31:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:31:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:31:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:31:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:31:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:31:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:31:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:31:18 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:31:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 19:31:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:31:20 - XML: Processed 653340 elements - found 0 jobs
Sun 19 Jan 2014 19:31:20 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:31:20 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:31:20 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:31:20 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:31:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:31:24 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:31:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:31:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:31:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:31:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:31:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:31:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:31:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:31:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557707
Sun 19 Jan 2014 19:31:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:31:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557707
Sun 19 Jan 2014 19:31:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:31:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:31:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:31:35 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:31:35 - job_xml_thread(): Done retrieving: data size 43557707
Sun 19 Jan 2014 19:31:36 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:31:36 - XML: Start document: iteration 7
Sun 19 Jan 2014 19:31:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:31:37 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:31:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:31:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:31:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:31:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:31:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:31:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:31:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:31:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:31:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:31:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:31:42 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:31:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:31:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:31:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:31:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:31:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:31:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:31:47 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:31:47 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:31:47 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:31:47 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:31:47 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:31:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:31:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566282
Sun 19 Jan 2014 19:31:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:31:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:31:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566282
Sun 19 Jan 2014 19:31:51 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:31:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:31:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:31:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 19:31:52 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:31:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 19:31:52 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:31:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8967 values 141597 bits 17699 bytes 
Sun 19 Jan 2014 19:31:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:31:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:31:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:31:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:32:02 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:32:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:32:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:32:03 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:32:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:32:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:32:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:32:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:32:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:32:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:32:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:32:06 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:32:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:32:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:32:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:32:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:32:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:32:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:32:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:32:09 - job_xml_thread(): Done retrieving: data size 43592239
Sun 19 Jan 2014 19:32:09 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:32:09 - XML: Start document: iteration 8
Sun 19 Jan 2014 19:32:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43592239
Sun 19 Jan 2014 19:32:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:32:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43592239
Sun 19 Jan 2014 19:32:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:32:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:32:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:32:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:32:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:32:28 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:32:28 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:32:28 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:32:28 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:32:28 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:32:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:32:31 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:32:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:32:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:32:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:32:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:32:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:32:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:32:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:32:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:32:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:32:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:32:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:32:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:32:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:32:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:32:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:32:33 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:32:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 19:32:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:32:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:32:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43600231
Sun 19 Jan 2014 19:32:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:32:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43600231
Sun 19 Jan 2014 19:32:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:32:43 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:32:43 - job_xml_thread(): Done retrieving: data size 43600231
Sun 19 Jan 2014 19:32:43 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:32:43 - XML: Start document: iteration 9
Sun 19 Jan 2014 19:32:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:32:46 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:32:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:32:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:32:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:32:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:32:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:32:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:32:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:32:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:32:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:32:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:32:52 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:32:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:32:53 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:32:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 19:32:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 19:32:53 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:32:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5740 values 90773 bits 11346 bytes 
Sun 19 Jan 2014 19:33:00 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:33:00 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:33:01 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:33:01 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:33:01 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:33:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:33:01 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:33:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:33:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:33:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:33:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:33:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:33:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:33:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:33:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:33:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:33:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43547435
Sun 19 Jan 2014 19:33:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:33:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43547435
Sun 19 Jan 2014 19:33:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:33:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:33:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:33:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:33:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:33:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:33:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:33:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:33:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:33:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:33:16 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:33:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:33:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:33:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:33:20 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:33:20 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:33:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 19:33:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:33:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:33:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:33:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:33:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:33:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:33:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:33:23 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 19:33:23 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 19:33:23 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:33:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:33:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43588706
Sun 19 Jan 2014 19:33:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:33:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43588706
Sun 19 Jan 2014 19:33:26 - job_xml_thread(): Done retrieving: data size 43588706
Sun 19 Jan 2014 19:33:26 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:33:26 - XML: Start document: iteration 10
Sun 19 Jan 2014 19:33:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:33:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:33:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:33:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:33:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:33:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:33:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:33:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:33:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:33:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:33:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:33:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:33:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:33:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:33:40 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:33:40 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:33:40 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:33:40 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:33:40 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:33:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:33:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:33:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:33:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:33:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:33:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:33:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:33:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:33:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:33:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562836
Sun 19 Jan 2014 19:33:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:33:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562836
Sun 19 Jan 2014 19:33:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:33:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:33:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:33:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:33:53 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:33:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:33:54 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:33:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 19:33:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 19:33:54 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:33:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8897 values 140539 bits 17567 bytes 
Sun 19 Jan 2014 19:33:55 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:33:55 - job_xml_thread(): Done retrieving: data size 43562836
Sun 19 Jan 2014 19:33:55 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:33:55 - XML: Start document: iteration 11
Sun 19 Jan 2014 19:33:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:33:59 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:33:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:33:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:34:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:34:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:34:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:34:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:34:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:34:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:34:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:34:08 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:34:08 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:34:08 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:34:08 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:34:08 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:34:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:34:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:34:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:34:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:34:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:34:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:34:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:34:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:34:11 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:34:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 19:34:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:34:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:34:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561472
Sun 19 Jan 2014 19:34:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:34:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561472
Sun 19 Jan 2014 19:34:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:34:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:34:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:34:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:34:20 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:34:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:34:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:34:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:34:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:34:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:34:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:34:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:34:24 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:34:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:34:25 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:34:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:34:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:34:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:34:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:34:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:34:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:34:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:34:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577702
Sun 19 Jan 2014 19:34:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:34:27 - job_xml_thread(): Done retrieving: data size 43577702
Sun 19 Jan 2014 19:34:27 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:34:27 - XML: Start document: iteration 12
Sun 19 Jan 2014 19:34:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577702
Sun 19 Jan 2014 19:34:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:34:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:34:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:34:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:34:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:34:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:34:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:34:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:34:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:34:42 - XML: Processed 653348 elements - found 0 jobs
Sun 19 Jan 2014 19:34:42 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:34:42 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:34:42 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:34:42 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:34:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:34:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:34:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:34:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:34:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:34:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:34:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:34:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:34:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:34:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:34:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:34:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:34:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:34:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:34:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576156
Sun 19 Jan 2014 19:34:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:34:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576156
Sun 19 Jan 2014 19:34:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:34:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:34:54 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:34:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:34:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 19:34:55 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:34:56 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:34:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 19:34:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148642 bits 18580 bytes 
Sun 19 Jan 2014 19:34:57 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:34:57 - job_xml_thread(): Done retrieving: data size 43576156
Sun 19 Jan 2014 19:34:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:34:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:34:57 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:34:57 - XML: Start document: iteration 13
Sun 19 Jan 2014 19:34:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:34:57 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:34:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:34:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:34:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:34:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:34:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576156
Sun 19 Jan 2014 19:34:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:34:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:34:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:35:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:35:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:35:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:35:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:35:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:35:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:35:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:35:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:35:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:35:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:35:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:35:16 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:35:16 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:35:16 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:35:16 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:35:16 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:35:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:35:18 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:35:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:35:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:35:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:35:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:35:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:35:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:35:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:35:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43516546
Sun 19 Jan 2014 19:35:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:35:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43516546
Sun 19 Jan 2014 19:35:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:35:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:35:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:35:31 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:35:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:35:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:35:31 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:35:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:35:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:35:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:35:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:35:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:35:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:35:33 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:35:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 19:35:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:35:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:35:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:35:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:35:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:35:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:35:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:35:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:35:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:35:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:35:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:35:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:35:38 - job_xml_thread(): Done retrieving: data size 43032341
Sun 19 Jan 2014 19:35:38 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:35:38 - XML: Start document: iteration 14
Sun 19 Jan 2014 19:35:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43032341
Sun 19 Jan 2014 19:35:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:35:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43032341
Sun 19 Jan 2014 19:35:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:35:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:35:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:35:50 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 19:35:50 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:35:51 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:35:51 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 19:35:51 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 19:35:52 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:35:52 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 19:35:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:35:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:35:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:35:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:35:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:35:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:35:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:35:56 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:35:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:35:57 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:35:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 19:35:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 19:35:57 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:35:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:35:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:35:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:35:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:35:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:35:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6060 values 95587 bits 11948 bytes 
Sun 19 Jan 2014 19:35:58 - size of cluster 'LISA Cluster': 624 hosts 79483 metrics 772750 values 12203866 bits 1525483 bytes 
Sun 19 Jan 2014 19:36:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:36:01 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:36:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:36:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:36:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:36:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:36:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:36:02 - XML: Processed 646416 elements - found 0 jobs
Sun 19 Jan 2014 19:36:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:36:02 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:36:02 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:36:02 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:36:02 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:36:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:36:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42915448
Sun 19 Jan 2014 19:36:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:36:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42915448
Sun 19 Jan 2014 19:36:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:36:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:36:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:36:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:36:17 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:36:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:36:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:36:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:36:19 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:36:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:36:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:36:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:36:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:36:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:36:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:36:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:36:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:36:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:36:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:36:22 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:36:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 19:36:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:36:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:36:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:36:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:36:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:36:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:36:25 - job_xml_thread(): Done retrieving: data size 42993870
Sun 19 Jan 2014 19:36:25 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:36:25 - XML: Start document: iteration 15
Sun 19 Jan 2014 19:36:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42993870
Sun 19 Jan 2014 19:36:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:36:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42993870
Sun 19 Jan 2014 19:36:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:36:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:36:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:36:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:36:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:36:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:36:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:36:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:36:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:36:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:36:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:36:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:36:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:36:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:36:43 - XML: Processed 645970 elements - found 0 jobs
Sun 19 Jan 2014 19:36:43 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:36:43 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:36:43 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:36:43 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:36:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:36:48 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:36:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:36:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:36:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:36:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:36:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:36:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:36:52 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:36:52 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 19:36:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:36:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43506584
Sun 19 Jan 2014 19:36:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:36:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43506584
Sun 19 Jan 2014 19:36:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:36:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:36:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:36:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:36:57 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:36:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:36:58 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:36:58 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:36:58 - job_xml_thread(): Done retrieving: data size 43506584
Sun 19 Jan 2014 19:36:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 19:36:58 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:36:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 19:36:58 - XML: Start document: iteration 16
Sun 19 Jan 2014 19:36:58 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:36:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9184 values 144905 bits 18113 bytes 
Sun 19 Jan 2014 19:37:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:37:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:37:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:37:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:37:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:37:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:37:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:37:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:37:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:37:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:37:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:37:15 - XML: Processed 652446 elements - found 0 jobs
Sun 19 Jan 2014 19:37:15 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:37:15 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:37:15 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:37:15 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:37:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:37:16 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:37:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:37:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:37:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:37:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:37:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:37:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:37:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:37:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575950
Sun 19 Jan 2014 19:37:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:37:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575950
Sun 19 Jan 2014 19:37:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:37:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:37:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:37:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:37:29 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:37:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:37:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:37:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:37:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:37:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:37:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:37:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575950
Sun 19 Jan 2014 19:37:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:37:30 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:37:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:37:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:37:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:37:40 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:37:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 19:37:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:37:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:37:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:37:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:37:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:37:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:37:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:37:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:37:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:37:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:37:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:37:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:37:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:37:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:37:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:37:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:37:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:37:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:37:46 - job_xml_thread(): Done retrieving: data size 43543543
Sun 19 Jan 2014 19:37:46 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:37:46 - XML: Start document: iteration 17
Sun 19 Jan 2014 19:37:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43543543
Sun 19 Jan 2014 19:37:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43543543
Sun 19 Jan 2014 19:37:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:37:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:37:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:37:58 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:37:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:37:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 19:37:59 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:37:59 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:37:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 19:37:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:37:59 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6091 values 96133 bits 12016 bytes 
Sun 19 Jan 2014 19:37:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:38:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:38:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:38:01 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:38:01 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:38:01 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:38:01 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:38:01 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:38:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:38:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:38:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:38:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:38:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:38:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:38:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:38:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:38:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:38:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:38:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:38:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:38:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:38:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:38:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:38:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:38:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:38:11 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:38:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 19:38:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:38:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:38:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575490
Sun 19 Jan 2014 19:38:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:38:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575490
Sun 19 Jan 2014 19:38:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:38:16 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:38:16 - job_xml_thread(): Done retrieving: data size 43575490
Sun 19 Jan 2014 19:38:16 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:38:16 - XML: Start document: iteration 18
Sun 19 Jan 2014 19:38:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:38:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:38:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:38:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:38:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:38:29 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:38:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:38:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:38:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:38:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:38:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:38:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:38:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:38:35 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:38:35 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:38:35 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:38:35 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:38:35 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:38:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:38:37 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:38:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:38:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:38:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:38:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:38:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:38:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:38:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:38:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582012
Sun 19 Jan 2014 19:38:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:38:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582012
Sun 19 Jan 2014 19:38:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:38:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:38:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:38:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:38:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:38:50 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:38:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:38:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:38:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:38:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:38:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:38:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:38:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:38:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:38:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:38:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:38:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:38:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:38:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:38:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:38:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:38:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:38:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:38:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:38:59 - job_xml_thread(): Done retrieving: data size 43572617
Sun 19 Jan 2014 19:38:59 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:38:59 - XML: Start document: iteration 19
Sun 19 Jan 2014 19:38:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572617
Sun 19 Jan 2014 19:38:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:38:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572617
Sun 19 Jan 2014 19:38:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:38:59 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:38:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:39:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:39:01 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:39:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 19:39:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 19:39:01 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:39:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6402 values 101056 bits 12632 bytes 
Sun 19 Jan 2014 19:39:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:39:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:39:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:39:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:39:11 - XML: Processed 653349 elements - found 0 jobs
Sun 19 Jan 2014 19:39:11 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:39:11 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:39:11 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:39:11 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:39:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:39:22 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:39:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:39:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:39:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:39:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:39:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:39:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:39:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:39:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:39:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:39:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:39:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:39:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:39:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:39:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:39:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:39:26 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:39:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:39:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578499
Sun 19 Jan 2014 19:39:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:39:27 - job_xml_thread(): Done retrieving: data size 43578499
Sun 19 Jan 2014 19:39:27 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:39:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578499
Sun 19 Jan 2014 19:39:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:39:27 - XML: Start document: iteration 20
Sun 19 Jan 2014 19:39:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:39:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:39:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:39:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:39:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:39:44 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:39:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:39:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:39:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:39:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:39:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:39:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:39:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:39:48 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:39:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 19:39:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:39:49 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:39:49 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:39:49 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:39:49 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:39:49 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:39:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:39:53 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:39:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:39:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:39:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:39:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:39:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:39:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:39:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:39:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562557
Sun 19 Jan 2014 19:39:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:39:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562557
Sun 19 Jan 2014 19:39:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:40:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:40:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:40:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:40:01 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:40:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:40:02 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:40:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 19:40:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 19:40:02 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:40:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6012 values 94830 bits 11853 bytes 
Sun 19 Jan 2014 19:40:04 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:40:04 - job_xml_thread(): Done retrieving: data size 43562557
Sun 19 Jan 2014 19:40:04 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:40:04 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 19:40:04 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 19:40:04 - Housekeeping: done.
Sun 19 Jan 2014 19:40:04 - XML: Start document: iteration 0
Sun 19 Jan 2014 19:40:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:40:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:40:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:40:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:40:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:40:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:40:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:40:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:40:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:40:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:40:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:40:15 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:40:15 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:40:15 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:40:15 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:40:15 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:40:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:40:18 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:40:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:40:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:40:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:40:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:40:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:40:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:40:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:40:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563537
Sun 19 Jan 2014 19:40:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:40:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563537
Sun 19 Jan 2014 19:40:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:40:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:40:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:40:30 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:40:30 - job_xml_thread(): Done retrieving: data size 43563537
Sun 19 Jan 2014 19:40:30 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:40:30 - XML: Start document: iteration 1
Sun 19 Jan 2014 19:40:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:40:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:40:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:40:37 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:40:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:40:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:40:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:40:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:40:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:40:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:40:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:40:42 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:40:42 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:40:42 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:40:42 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:40:42 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:40:43 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:40:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 19:40:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:40:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:40:45 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:40:45 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 19:40:45 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 19:40:45 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:40:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:40:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:40:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:40:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:40:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:40:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:40:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:40:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566922
Sun 19 Jan 2014 19:40:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:40:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566922
Sun 19 Jan 2014 19:40:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:40:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:40:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:40:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:40:57 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:40:57 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:40:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:40:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:40:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:40:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:40:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:40:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:40:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:41:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:41:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:41:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:41:01 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:41:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:41:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:41:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:41:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:41:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:41:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:41:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:41:02 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:41:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:41:03 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:41:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 19:41:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 19:41:03 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:41:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5950 values 93895 bits 11736 bytes 
Sun 19 Jan 2014 19:41:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:41:03 - job_xml_thread(): Done retrieving: data size 43586131
Sun 19 Jan 2014 19:41:03 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:41:03 - XML: Start document: iteration 2
Sun 19 Jan 2014 19:41:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43586131
Sun 19 Jan 2014 19:41:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:41:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43586131
Sun 19 Jan 2014 19:41:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:41:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:41:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:41:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:41:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:41:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:41:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:41:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:41:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:41:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:41:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:41:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:41:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:41:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:41:24 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:41:24 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:41:24 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:41:24 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:41:24 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:41:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:41:27 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:41:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:41:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:41:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:41:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:41:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:41:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:41:29 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:41:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 19:41:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:41:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:41:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43481671
Sun 19 Jan 2014 19:41:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:41:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43481671
Sun 19 Jan 2014 19:41:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:41:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:41:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:41:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:41:39 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:41:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:41:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:41:39 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:41:39 - job_xml_thread(): Done retrieving: data size 43481671
Sun 19 Jan 2014 19:41:39 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:41:39 - XML: Start document: iteration 3
Sun 19 Jan 2014 19:41:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:41:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:41:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:41:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43481671
Sun 19 Jan 2014 19:41:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:41:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:41:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:41:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:41:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:41:52 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:41:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:41:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:41:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:41:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:41:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:41:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:41:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:41:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:41:54 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:41:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:41:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:41:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:41:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:41:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:41:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:41:57 - XML: Processed 652598 elements - found 0 jobs
Sun 19 Jan 2014 19:41:57 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:41:57 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:41:57 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:41:57 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:41:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:41:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42911377
Sun 19 Jan 2014 19:41:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:42:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42911377
Sun 19 Jan 2014 19:42:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:42:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:42:03 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:42:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:42:04 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:42:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 19:42:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 19:42:04 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:42:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6884 values 108592 bits 13574 bytes 
Sun 19 Jan 2014 19:42:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:42:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:42:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:42:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:42:12 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:42:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:42:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:42:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:42:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:42:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:42:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:42:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:42:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:42:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:42:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:42:15 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:42:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:42:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:42:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:42:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:42:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:42:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:42:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:42:17 - job_xml_thread(): Done retrieving: data size 42991025
Sun 19 Jan 2014 19:42:17 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:42:17 - XML: Start document: iteration 4
Sun 19 Jan 2014 19:42:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42991025
Sun 19 Jan 2014 19:42:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:42:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42991025
Sun 19 Jan 2014 19:42:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:42:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:42:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:42:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:42:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:42:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:42:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:42:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:42:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:42:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:42:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:42:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:42:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:42:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:42:35 - XML: Processed 645902 elements - found 0 jobs
Sun 19 Jan 2014 19:42:35 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:42:35 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:42:35 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:42:35 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:42:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:42:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:42:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:42:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:42:39 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:42:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 19:42:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:42:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:42:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:42:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:42:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:42:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:42:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43347715
Sun 19 Jan 2014 19:42:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:42:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43347715
Sun 19 Jan 2014 19:42:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:42:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:42:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:42:50 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:42:50 - job_xml_thread(): Done retrieving: data size 43347715
Sun 19 Jan 2014 19:42:50 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:42:50 - XML: Start document: iteration 5
Sun 19 Jan 2014 19:42:53 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 19:42:53 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:42:54 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:42:54 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 19:42:54 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 19:42:54 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:42:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:42:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:42:54 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 19:43:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:43:00 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:43:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:43:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:43:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:43:01 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:43:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:43:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:43:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:43:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:43:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:43:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:43:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:43:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:43:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:43:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:43:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:43:04 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 782453 values 12336212 bits 1542026 bytes 
Sun 19 Jan 2014 19:43:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:43:05 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:43:05 - XML: Processed 650646 elements - found 0 jobs
Sun 19 Jan 2014 19:43:05 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:43:05 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:43:05 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:43:05 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:43:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:43:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 19:43:06 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:43:06 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:43:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 19:43:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5998 values 94666 bits 11833 bytes 
Sun 19 Jan 2014 19:43:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:43:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583543
Sun 19 Jan 2014 19:43:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:43:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583543
Sun 19 Jan 2014 19:43:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:43:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:43:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:43:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:43:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:43:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:43:18 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:43:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:43:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:43:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:43:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:43:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:43:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:43:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:43:20 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:43:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:43:25 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:43:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:43:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:43:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:43:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:43:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:43:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:43:25 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:43:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 19:43:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:43:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:43:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559188
Sun 19 Jan 2014 19:43:28 - job_xml_thread(): Done retrieving: data size 43559188
Sun 19 Jan 2014 19:43:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:43:28 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:43:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559188
Sun 19 Jan 2014 19:43:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:43:28 - XML: Start document: iteration 6
Sun 19 Jan 2014 19:43:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:43:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:43:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:43:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:43:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:43:43 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:43:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:43:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:43:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:43:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:43:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:43:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:43:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:43:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:43:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:43:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:43:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:43:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:43:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:43:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:43:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:43:53 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:43:53 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:43:53 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:43:53 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:43:53 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:43:55 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:43:55 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 19:43:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:43:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568370
Sun 19 Jan 2014 19:43:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:43:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568370
Sun 19 Jan 2014 19:43:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:44:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:44:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:44:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:44:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:44:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:44:06 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:44:08 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:44:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:44:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:44:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 19:44:08 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:44:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8491 values 133925 bits 16740 bytes 
Sun 19 Jan 2014 19:44:08 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:44:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 19:44:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:44:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:44:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:44:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:44:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:44:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:44:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:44:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:44:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:44:11 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:44:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:44:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:44:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:44:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:44:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:44:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:44:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:44:16 - job_xml_thread(): Done retrieving: data size 43566008
Sun 19 Jan 2014 19:44:16 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:44:16 - XML: Start document: iteration 7
Sun 19 Jan 2014 19:44:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566008
Sun 19 Jan 2014 19:44:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:44:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566008
Sun 19 Jan 2014 19:44:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:44:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:44:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:44:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:44:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:44:35 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:44:35 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:44:35 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:44:35 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:44:35 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:44:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:44:36 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:44:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:44:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:44:36 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:44:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 19:44:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:44:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:44:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:44:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:44:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:44:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:44:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:44:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:44:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:44:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:44:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:44:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:44:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:44:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:44:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:44:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43585177
Sun 19 Jan 2014 19:44:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:44:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43585177
Sun 19 Jan 2014 19:44:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:44:50 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:44:50 - job_xml_thread(): Done retrieving: data size 43585177
Sun 19 Jan 2014 19:44:50 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:44:50 - XML: Start document: iteration 8
Sun 19 Jan 2014 19:44:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:44:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:44:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:44:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:44:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:44:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:44:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:44:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:44:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:44:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:44:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:45:00 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:45:00 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:45:00 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:45:00 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:45:00 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:45:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:45:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:45:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:45:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:45:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:45:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:45:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:45:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:45:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:45:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562339
Sun 19 Jan 2014 19:45:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:45:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562339
Sun 19 Jan 2014 19:45:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:45:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:45:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:45:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:45:08 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:45:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:45:08 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:45:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 19:45:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 19:45:08 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:45:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8859 values 139811 bits 17476 bytes 
Sun 19 Jan 2014 19:45:15 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:45:15 - job_xml_thread(): Done retrieving: data size 43562339
Sun 19 Jan 2014 19:45:15 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:45:15 - XML: Start document: iteration 9
Sun 19 Jan 2014 19:45:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:45:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:45:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:45:22 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:45:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:45:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:45:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:45:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:45:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:45:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:45:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:45:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:45:28 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:45:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:45:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:45:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:45:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:45:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:45:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:45:30 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:45:30 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:45:30 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:45:30 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:45:30 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:45:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:45:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561210
Sun 19 Jan 2014 19:45:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:45:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561210
Sun 19 Jan 2014 19:45:34 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:45:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:45:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 19:45:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:45:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:45:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:45:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:45:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:45:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:45:45 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:45:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:45:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:45:45 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:45:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:45:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:45:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:45:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:45:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:45:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:45:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:45:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:45:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:45:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:45:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:45:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:45:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:45:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:45:53 - job_xml_thread(): Done retrieving: data size 43580844
Sun 19 Jan 2014 19:45:53 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:45:53 - XML: Start document: iteration 10
Sun 19 Jan 2014 19:45:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580844
Sun 19 Jan 2014 19:45:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:45:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580844
Sun 19 Jan 2014 19:45:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:46:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:46:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:46:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:46:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:46:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:46:09 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:46:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:46:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 19:46:12 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:46:12 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:46:12 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:46:12 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:46:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99176 bits 12397 bytes 
Sun 19 Jan 2014 19:46:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 19:46:12 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:46:12 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:46:12 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:46:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:46:14 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:46:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:46:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:46:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:46:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:46:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:46:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:46:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:46:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:46:15 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:46:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:46:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:46:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:46:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:46:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:46:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:46:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:46:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43591448
Sun 19 Jan 2014 19:46:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:46:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43591448
Sun 19 Jan 2014 19:46:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:46:27 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:46:27 - job_xml_thread(): Done retrieving: data size 43591448
Sun 19 Jan 2014 19:46:27 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:46:27 - XML: Start document: iteration 11
Sun 19 Jan 2014 19:46:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:46:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:46:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:46:31 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:46:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:46:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:46:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:46:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:46:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:46:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:46:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:46:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:46:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:46:41 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:46:41 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:46:41 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:46:41 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:46:41 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:46:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:46:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:46:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:46:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:46:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:46:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:46:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:46:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:46:44 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:46:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 19:46:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:46:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:46:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43550705
Sun 19 Jan 2014 19:46:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:46:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43550705
Sun 19 Jan 2014 19:46:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:46:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:46:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:46:56 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:46:56 - job_xml_thread(): Done retrieving: data size 43550705
Sun 19 Jan 2014 19:46:56 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:46:56 - XML: Start document: iteration 12
Sun 19 Jan 2014 19:46:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:46:57 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:46:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:46:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:46:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:46:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:46:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:46:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:46:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:46:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:46:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:47:06 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:47:06 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:47:06 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:47:06 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:47:06 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:47:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:47:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:47:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:47:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:47:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:47:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:47:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:47:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:47:10 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 19:47:10 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 19:47:10 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:47:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:47:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563400
Sun 19 Jan 2014 19:47:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:47:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563400
Sun 19 Jan 2014 19:47:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:47:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:47:12 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:47:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:47:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:47:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:47:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 19:47:13 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:47:13 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:47:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8626 values 136408 bits 17051 bytes 
Sun 19 Jan 2014 19:47:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 19:47:21 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:47:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:47:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:47:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:47:25 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:47:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:47:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:47:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:47:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:47:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:47:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:47:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:47:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:47:27 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:47:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:47:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:47:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:47:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:47:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:47:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:47:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:47:30 - job_xml_thread(): Done retrieving: data size 43493716
Sun 19 Jan 2014 19:47:30 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:47:30 - XML: Start document: iteration 13
Sun 19 Jan 2014 19:47:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43493716
Sun 19 Jan 2014 19:47:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43493716
Sun 19 Jan 2014 19:47:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:47:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:47:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:47:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:47:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:47:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:47:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:47:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:47:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:47:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:47:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:47:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:47:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:47:46 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:47:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 19:47:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:47:48 - XML: Processed 652590 elements - found 0 jobs
Sun 19 Jan 2014 19:47:48 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:47:48 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:47:48 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:47:48 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:47:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:47:52 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:47:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:47:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:47:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:47:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:47:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:47:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:47:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:47:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42933826
Sun 19 Jan 2014 19:47:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:47:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42933826
Sun 19 Jan 2014 19:47:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:47:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:47:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:48:03 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:48:03 - job_xml_thread(): Done retrieving: data size 42933826
Sun 19 Jan 2014 19:48:03 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:48:03 - XML: Start document: iteration 14
Sun 19 Jan 2014 19:48:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:48:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:48:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:48:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:48:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:48:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:48:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:48:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:48:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:48:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:48:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:48:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:48:14 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:48:14 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:48:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 19:48:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:48:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 19:48:14 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:48:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6231 values 98568 bits 12321 bytes 
Sun 19 Jan 2014 19:48:16 - XML: Processed 645439 elements - found 0 jobs
Sun 19 Jan 2014 19:48:16 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:48:16 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:48:16 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:48:16 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:48:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:48:17 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:48:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:48:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:48:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:48:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:48:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:48:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:48:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:48:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42969788
Sun 19 Jan 2014 19:48:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:48:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42969788
Sun 19 Jan 2014 19:48:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:48:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:48:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:48:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:48:30 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:48:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:48:31 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:48:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:48:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:48:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:48:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:48:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:48:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:48:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:48:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:48:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:48:34 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:48:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:48:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:48:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:48:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:48:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:48:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:48:34 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:48:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 19:48:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:48:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:48:35 - job_xml_thread(): Done retrieving: data size 43155683
Sun 19 Jan 2014 19:48:35 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:48:35 - XML: Start document: iteration 15
Sun 19 Jan 2014 19:48:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43155683
Sun 19 Jan 2014 19:48:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:48:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43155683
Sun 19 Jan 2014 19:48:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:48:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:48:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:48:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:48:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:48:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:48:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:48:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:48:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:48:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:48:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:48:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:48:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:48:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:48:55 - XML: Processed 647886 elements - found 0 jobs
Sun 19 Jan 2014 19:48:55 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:48:55 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:48:55 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:48:55 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:48:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:48:57 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:48:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:48:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:48:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:48:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:48:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:48:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:48:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:48:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43546150
Sun 19 Jan 2014 19:48:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:48:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43546150
Sun 19 Jan 2014 19:48:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:49:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:49:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:49:10 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:49:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:49:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:49:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:49:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:49:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:49:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:49:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:49:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:49:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:49:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:49:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:49:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:49:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:49:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:49:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:49:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:49:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:49:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:49:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:49:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:49:14 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:49:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:49:15 - job_xml_thread(): Done retrieving: data size 43569465
Sun 19 Jan 2014 19:49:15 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:49:15 - XML: Start document: iteration 16
Sun 19 Jan 2014 19:49:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569465
Sun 19 Jan 2014 19:49:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:49:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:49:16 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:49:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 19:49:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 19:49:16 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:49:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569465
Sun 19 Jan 2014 19:49:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8882 values 140268 bits 17533 bytes 
Sun 19 Jan 2014 19:49:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:49:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:49:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:49:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:49:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:49:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:49:29 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:49:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:49:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:49:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:49:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:49:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:49:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:49:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:49:33 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:49:33 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:49:33 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:49:33 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:49:33 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:49:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:49:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:49:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:49:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:49:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:49:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:49:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:49:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:49:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:49:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568491
Sun 19 Jan 2014 19:49:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:49:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568491
Sun 19 Jan 2014 19:49:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:49:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:49:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:49:49 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:49:49 - job_xml_thread(): Done retrieving: data size 43568491
Sun 19 Jan 2014 19:49:49 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:49:49 - XML: Start document: iteration 17
Sun 19 Jan 2014 19:49:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:49:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:49:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:49:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:49:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:49:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:49:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:49:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:49:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:49:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:49:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:49:55 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 19:49:55 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:49:55 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:49:55 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 19:49:55 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:49:55 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 19:49:56 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 19:50:02 - size of cluster 'LISA Cluster': 624 hosts 79477 metrics 800478 values 12644978 bits 1580622 bytes 
Sun 19 Jan 2014 19:50:05 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:50:05 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:50:05 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:50:05 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:50:05 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:50:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:50:06 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:50:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:50:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:50:06 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:50:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 19:50:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:50:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:50:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:50:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:50:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:50:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:50:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554158
Sun 19 Jan 2014 19:50:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:50:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:50:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:50:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554158
Sun 19 Jan 2014 19:50:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:50:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:50:16 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:50:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:50:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 19:50:16 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:50:16 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:50:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 19:50:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5880 values 92767 bits 11595 bytes 
Sun 19 Jan 2014 19:50:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:50:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:50:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:50:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:50:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:50:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:50:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:50:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554158
Sun 19 Jan 2014 19:50:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:50:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:50:20 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:50:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:50:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:50:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:50:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:50:28 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:50:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:50:31 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:50:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:50:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:50:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:50:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:50:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:50:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:50:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:50:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:50:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:50:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:50:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:50:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:50:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:50:35 - job_xml_thread(): Done retrieving: data size 43547607
Sun 19 Jan 2014 19:50:35 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:50:35 - XML: Start document: iteration 18
Sun 19 Jan 2014 19:50:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43547607
Sun 19 Jan 2014 19:50:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:50:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43547607
Sun 19 Jan 2014 19:50:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:50:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:50:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:50:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:50:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:50:54 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:50:54 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:50:54 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:50:54 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:50:54 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:50:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:50:54 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:50:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:50:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:50:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:50:55 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:50:55 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 19:50:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:50:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:50:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:50:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:50:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:50:58 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:50:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:50:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:50:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:50:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:50:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:50:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:51:00 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:51:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 19:51:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:51:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:51:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566338
Sun 19 Jan 2014 19:51:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:51:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566338
Sun 19 Jan 2014 19:51:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:51:09 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:51:09 - job_xml_thread(): Done retrieving: data size 43566338
Sun 19 Jan 2014 19:51:09 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:51:09 - XML: Start document: iteration 19
Sun 19 Jan 2014 19:51:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:51:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:51:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:51:14 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:51:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:51:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:51:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:51:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:51:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:51:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:51:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:51:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:51:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:51:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:51:16 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:51:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:51:17 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:51:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 19:51:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 19:51:17 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:51:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5638 values 88892 bits 11111 bytes 
Sun 19 Jan 2014 19:51:22 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:51:22 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:51:22 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:51:22 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:51:22 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:51:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:51:26 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:51:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:51:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:51:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:51:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:51:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:51:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:51:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:51:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:51:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:51:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43545978
Sun 19 Jan 2014 19:51:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:51:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43545978
Sun 19 Jan 2014 19:51:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:51:37 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:51:37 - job_xml_thread(): Done retrieving: data size 43545978
Sun 19 Jan 2014 19:51:37 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:51:37 - XML: Start document: iteration 20
Sun 19 Jan 2014 19:51:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:51:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:51:47 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:51:47 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:51:47 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:51:47 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:51:47 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:51:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:51:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:51:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:51:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:51:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:51:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:51:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:51:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:51:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:51:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:51:52 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:51:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:51:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:51:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:51:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:51:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:51:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:51:53 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:51:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 19:51:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:51:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:51:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43593307
Sun 19 Jan 2014 19:51:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:51:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43593307
Sun 19 Jan 2014 19:51:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:52:02 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:52:02 - job_xml_thread(): Done retrieving: data size 43593307
Sun 19 Jan 2014 19:52:02 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:52:02 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 19:52:03 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 19:52:03 - Housekeeping: done.
Sun 19 Jan 2014 19:52:03 - XML: Start document: iteration 0
Sun 19 Jan 2014 19:52:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:52:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:52:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:52:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:52:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:52:07 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:52:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:52:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:52:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:52:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:52:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:52:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:52:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:52:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:52:17 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:52:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:52:18 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:52:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:52:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:52:18 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:52:18 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:52:18 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:52:18 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:52:18 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:52:18 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:52:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 19:52:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:52:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 19:52:18 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:52:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5663 values 89263 bits 11157 bytes 
Sun 19 Jan 2014 19:52:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:52:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:52:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:52:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:52:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:52:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553052
Sun 19 Jan 2014 19:52:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:52:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553052
Sun 19 Jan 2014 19:52:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:52:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:52:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:52:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:52:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:52:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:52:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:52:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:52:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:52:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:52:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:52:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553052
Sun 19 Jan 2014 19:52:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:52:33 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:52:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:52:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:52:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:52:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:52:46 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:52:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:52:47 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:52:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:52:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:52:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:52:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:52:47 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:52:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 19:52:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:52:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:52:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:52:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:52:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:52:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:52:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:52:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:52:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:52:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:52:50 - job_xml_thread(): Done retrieving: data size 43546780
Sun 19 Jan 2014 19:52:50 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:52:50 - XML: Start document: iteration 1
Sun 19 Jan 2014 19:52:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43546780
Sun 19 Jan 2014 19:52:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43546780
Sun 19 Jan 2014 19:52:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:52:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:53:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:53:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:53:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:53:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:53:08 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:53:08 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:53:08 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:53:08 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:53:08 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:53:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:53:14 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:53:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:53:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:53:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:53:15 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:53:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:53:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:53:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:53:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:53:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:53:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:53:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:53:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:53:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:53:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:53:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:53:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:53:18 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:53:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:53:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43520744
Sun 19 Jan 2014 19:53:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:53:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:53:19 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:53:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 19:53:19 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:53:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 19:53:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5666 values 89357 bits 11169 bytes 
Sun 19 Jan 2014 19:53:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43520744
Sun 19 Jan 2014 19:53:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:53:23 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:53:23 - job_xml_thread(): Done retrieving: data size 43520744
Sun 19 Jan 2014 19:53:23 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:53:23 - XML: Start document: iteration 2
Sun 19 Jan 2014 19:53:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:53:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:53:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:53:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:53:31 - XML: Processed 652602 elements - found 0 jobs
Sun 19 Jan 2014 19:53:31 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:53:31 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:53:31 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:53:31 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:53:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:53:39 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:53:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:53:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:53:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:53:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:53:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:53:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:53:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:53:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:53:40 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:53:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:53:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:53:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:53:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:53:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:53:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:53:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:53:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42979323
Sun 19 Jan 2014 19:53:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:53:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42979323
Sun 19 Jan 2014 19:53:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:53:46 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:53:46 - job_xml_thread(): Done retrieving: data size 42979323
Sun 19 Jan 2014 19:53:46 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:53:46 - XML: Start document: iteration 3
Sun 19 Jan 2014 19:53:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:53:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:53:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:53:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:53:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:53:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:53:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:53:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:53:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:53:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:53:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:54:06 - XML: Processed 645908 elements - found 0 jobs
Sun 19 Jan 2014 19:54:06 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:54:06 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:54:06 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:54:06 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:54:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:54:07 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:54:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:54:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:54:08 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:54:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 19:54:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:54:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:54:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:54:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:54:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:54:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:54:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42897454
Sun 19 Jan 2014 19:54:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:54:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42897454
Sun 19 Jan 2014 19:54:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:54:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:54:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:54:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:54:19 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:54:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:54:20 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:54:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 19:54:20 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:54:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5739 values 90504 bits 11313 bytes 
Sun 19 Jan 2014 19:54:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 19:54:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:54:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:54:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:54:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:54:21 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:54:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:54:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:54:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:54:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:54:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:54:22 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 19:54:22 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 19:54:22 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:54:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:54:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:54:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:54:26 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:54:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:54:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:54:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:54:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:54:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:54:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:54:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:54:29 - job_xml_thread(): Done retrieving: data size 43061291
Sun 19 Jan 2014 19:54:29 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:54:29 - XML: Start document: iteration 4
Sun 19 Jan 2014 19:54:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43061291
Sun 19 Jan 2014 19:54:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:54:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43061291
Sun 19 Jan 2014 19:54:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:54:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:54:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:54:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:54:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:54:44 - XML: Processed 646834 elements - found 0 jobs
Sun 19 Jan 2014 19:54:44 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:54:44 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:54:44 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:54:44 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:54:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:54:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:54:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:54:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:54:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:54:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:54:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:54:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:54:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:54:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:54:51 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:54:51 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:54:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 19:54:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:54:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:54:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:54:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:54:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:54:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:54:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:54:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:54:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558264
Sun 19 Jan 2014 19:54:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:54:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558264
Sun 19 Jan 2014 19:54:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:54:59 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:54:59 - job_xml_thread(): Done retrieving: data size 43558264
Sun 19 Jan 2014 19:54:59 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:54:59 - XML: Start document: iteration 5
Sun 19 Jan 2014 19:55:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:55:03 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:55:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:55:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:55:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:55:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:55:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:55:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:55:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:55:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:55:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:55:10 - XML: Processed 652952 elements - found 0 jobs
Sun 19 Jan 2014 19:55:10 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:55:10 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:55:10 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:55:10 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:55:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:55:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:55:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:55:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:55:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:55:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:55:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:55:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:55:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:55:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571816
Sun 19 Jan 2014 19:55:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:55:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571816
Sun 19 Jan 2014 19:55:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:55:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:55:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:55:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:55:20 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:55:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:55:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 19:55:21 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:55:21 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:55:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 19:55:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9130 values 144063 bits 18007 bytes 
Sun 19 Jan 2014 19:55:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:55:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:55:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:55:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:55:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:55:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:55:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:55:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571816
Sun 19 Jan 2014 19:55:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:55:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:55:26 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:55:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:55:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:55:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:55:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:55:37 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:55:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:55:37 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:55:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:55:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:55:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:55:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:55:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:55:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:55:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:55:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:55:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:55:39 - job_xml_thread(): Done retrieving: data size 43547071
Sun 19 Jan 2014 19:55:39 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:55:39 - XML: Start document: iteration 6
Sun 19 Jan 2014 19:55:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43547071
Sun 19 Jan 2014 19:55:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:55:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:55:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:55:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:55:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:55:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43547071
Sun 19 Jan 2014 19:55:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:55:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:55:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:55:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:55:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:55:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:55:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:55:55 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:55:55 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:55:55 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:55:55 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:55:56 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:55:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:55:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:55:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:55:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:55:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:55:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:55:59 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:56:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:56:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:56:00 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:56:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 19:56:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:56:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:56:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:56:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:56:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:56:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:56:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566180
Sun 19 Jan 2014 19:56:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:56:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566180
Sun 19 Jan 2014 19:56:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:56:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:56:10 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:56:11 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:56:11 - job_xml_thread(): Done retrieving: data size 43566180
Sun 19 Jan 2014 19:56:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:56:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:56:11 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:56:11 - XML: Start document: iteration 7
Sun 19 Jan 2014 19:56:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:56:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:56:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:56:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:56:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:56:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:56:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:56:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:56:17 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:56:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:56:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:56:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:56:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:56:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:56:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:56:20 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:56:20 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:56:20 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:56:20 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:56:20 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:56:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:56:22 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:56:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:56:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571969
Sun 19 Jan 2014 19:56:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:56:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571969
Sun 19 Jan 2014 19:56:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:56:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:56:23 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:56:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 19:56:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 19:56:23 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:56:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5887 values 92824 bits 11603 bytes 
Sun 19 Jan 2014 19:56:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:56:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:56:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:56:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:56:35 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:56:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:56:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:56:37 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:56:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:56:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:56:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:56:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:56:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:56:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:56:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:56:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:56:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:56:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:56:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:56:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:56:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:56:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:56:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:56:41 - job_xml_thread(): Done retrieving: data size 43592435
Sun 19 Jan 2014 19:56:41 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:56:41 - XML: Start document: iteration 8
Sun 19 Jan 2014 19:56:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43592435
Sun 19 Jan 2014 19:56:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43592435
Sun 19 Jan 2014 19:56:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:56:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:56:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:56:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:56:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:56:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:56:55 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 19:56:55 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:56:56 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:56:56 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:56:56 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 19:56:56 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 19:56:56 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 19:56:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:56:58 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:56:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:56:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:56:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:56:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:56:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:56:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:56:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:56:59 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:56:59 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:56:59 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:56:59 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:56:59 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:57:03 - size of cluster 'LISA Cluster': 624 hosts 79480 metrics 808874 values 12760143 bits 1595017 bytes 
Sun 19 Jan 2014 19:57:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:57:05 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:57:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:57:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:57:05 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:57:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 19:57:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:57:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:57:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:57:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:57:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:57:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:57:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580773
Sun 19 Jan 2014 19:57:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:57:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580773
Sun 19 Jan 2014 19:57:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:57:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:57:14 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:57:14 - job_xml_thread(): Done retrieving: data size 43580773
Sun 19 Jan 2014 19:57:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:57:14 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:57:14 - XML: Start document: iteration 9
Sun 19 Jan 2014 19:57:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:57:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:57:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:57:23 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:57:24 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:57:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:57:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 19:57:25 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:57:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 19:57:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5783 values 91167 bits 11395 bytes 
Sun 19 Jan 2014 19:57:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:57:27 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:57:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:57:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:57:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:57:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:57:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:57:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:57:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:57:29 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:57:29 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:57:29 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:57:29 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:57:29 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:57:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:57:31 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:57:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:57:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:57:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:57:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:57:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:57:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:57:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:57:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578974
Sun 19 Jan 2014 19:57:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:57:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578974
Sun 19 Jan 2014 19:57:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:57:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:57:44 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:57:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:57:44 - job_xml_thread(): Done retrieving: data size 43578974
Sun 19 Jan 2014 19:57:44 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:57:44 - XML: Start document: iteration 10
Sun 19 Jan 2014 19:57:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:57:44 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:57:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:57:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:57:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:57:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:57:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:57:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:57:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:57:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:57:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:57:55 - XML: Processed 653349 elements - found 0 jobs
Sun 19 Jan 2014 19:57:55 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:57:55 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:57:55 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:57:55 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:57:56 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:57:56 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 19:57:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:57:58 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:57:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:57:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:57:58 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:57:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 19:57:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:57:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:57:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:57:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:57:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:58:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:58:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:58:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:58:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555437
Sun 19 Jan 2014 19:58:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:58:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555437
Sun 19 Jan 2014 19:58:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:58:10 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:58:10 - job_xml_thread(): Done retrieving: data size 43555437
Sun 19 Jan 2014 19:58:10 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:58:10 - XML: Start document: iteration 11
Sun 19 Jan 2014 19:58:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:58:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:58:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:58:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:58:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:58:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:58:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:58:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:58:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:58:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:58:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:58:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:58:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:58:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:58:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:58:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:58:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:58:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:58:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:58:24 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:58:24 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:58:24 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:58:24 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:58:24 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:58:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:58:25 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:58:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:58:25 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:58:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 19:58:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 19:58:25 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:58:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5679 values 89534 bits 11191 bytes 
Sun 19 Jan 2014 19:58:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:58:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568113
Sun 19 Jan 2014 19:58:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:58:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:58:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568113
Sun 19 Jan 2014 19:58:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:58:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:58:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:58:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:58:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:58:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:58:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:58:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:58:39 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:58:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:58:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:58:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:58:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:58:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:58:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:58:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:58:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:58:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:58:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:58:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:58:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:58:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:58:45 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:58:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 19:58:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:58:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:58:48 - job_xml_thread(): Done retrieving: data size 43563274
Sun 19 Jan 2014 19:58:48 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:58:48 - XML: Start document: iteration 12
Sun 19 Jan 2014 19:58:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563274
Sun 19 Jan 2014 19:58:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:58:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563274
Sun 19 Jan 2014 19:58:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:58:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:58:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:59:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:59:00 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:59:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:59:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:59:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:59:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:59:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:59:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:59:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:59:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:59:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:59:09 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:59:09 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:59:09 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:59:09 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:59:09 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:59:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:59:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:59:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:59:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:59:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:59:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:59:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:59:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:59:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:59:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:59:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:59:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43542469
Sun 19 Jan 2014 19:59:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:59:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43542469
Sun 19 Jan 2014 19:59:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:59:25 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:59:25 - job_xml_thread(): Done retrieving: data size 43542469
Sun 19 Jan 2014 19:59:25 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:59:25 - XML: Start document: iteration 13
Sun 19 Jan 2014 19:59:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:59:25 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:59:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:59:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:59:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:59:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 19:59:26 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 19:59:26 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:59:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:59:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:59:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8257 values 130166 bits 16270 bytes 
Sun 19 Jan 2014 19:59:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 19:59:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:59:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:59:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:59:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:59:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 19:59:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:59:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:59:34 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 19:59:34 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 19:59:34 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 19:59:34 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 19:59:34 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 19:59:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 19:59:40 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 19:59:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 19:59:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 19:59:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:59:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 19:59:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 19:59:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 19:59:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 19:59:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:59:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 19:59:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43104118
Sun 19 Jan 2014 19:59:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 19:59:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43104118
Sun 19 Jan 2014 19:59:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 19:59:49 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 19:59:49 - job_xml_thread(): Done retrieving: data size 43104118
Sun 19 Jan 2014 19:59:50 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 19:59:50 - XML: Start document: iteration 14
Sun 19 Jan 2014 19:59:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 19:59:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 19:59:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 19:59:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 19:59:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 19:59:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 19:59:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:59:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 19:59:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 19:59:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 19:59:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:00:02 - XML: Processed 647884 elements - found 0 jobs
Sun 19 Jan 2014 20:00:02 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:00:02 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:00:02 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:00:02 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:00:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:00:06 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:00:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:00:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:00:06 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:00:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 20:00:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:00:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:00:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:00:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:00:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:00:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:00:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42903817
Sun 19 Jan 2014 20:00:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:00:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42903817
Sun 19 Jan 2014 20:00:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:00:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:00:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:00:17 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:00:17 - job_xml_thread(): Done retrieving: data size 42903817
Sun 19 Jan 2014 20:00:17 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:00:17 - XML: Start document: iteration 15
Sun 19 Jan 2014 20:00:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:00:19 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:00:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:00:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:00:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:00:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:00:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:00:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:00:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:00:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:00:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:00:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:00:27 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:00:27 - XML: Processed 645152 elements - found 0 jobs
Sun 19 Jan 2014 20:00:27 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:00:27 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:00:27 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:00:27 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:00:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:00:28 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:00:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 20:00:28 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:00:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 20:00:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5744 values 90523 bits 11315 bytes 
Sun 19 Jan 2014 20:00:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:00:31 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:00:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:00:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:00:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:00:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:00:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:00:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:00:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:00:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43164390
Sun 19 Jan 2014 20:00:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:00:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:00:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43164390
Sun 19 Jan 2014 20:00:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:00:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:00:42 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:00:42 - job_xml_thread(): Done retrieving: data size 43164390
Sun 19 Jan 2014 20:00:42 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:00:42 - XML: Start document: iteration 16
Sun 19 Jan 2014 20:00:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:00:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:00:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:00:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:00:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:00:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:00:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:00:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:00:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:00:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:00:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:00:49 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:00:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 20:00:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:00:56 - XML: Processed 648574 elements - found 0 jobs
Sun 19 Jan 2014 20:00:56 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:00:56 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:00:57 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:00:57 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:00:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:00:58 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:00:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:00:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:00:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:00:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:00:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:00:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:01:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:01:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43542603
Sun 19 Jan 2014 20:01:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:01:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43542603
Sun 19 Jan 2014 20:01:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:01:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:01:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:01:12 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:01:12 - job_xml_thread(): Done retrieving: data size 43542603
Sun 19 Jan 2014 20:01:12 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:01:12 - XML: Start document: iteration 17
Sun 19 Jan 2014 20:01:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:01:13 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:01:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:01:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:01:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:01:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:01:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:01:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:01:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:01:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:01:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:01:24 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:01:24 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:01:24 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:01:24 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:01:24 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:01:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:01:26 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:01:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:01:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:01:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:01:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:01:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:01:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:01:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:01:28 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:01:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:01:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 20:01:28 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:01:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6025 values 95058 bits 11882 bytes 
Sun 19 Jan 2014 20:01:28 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:01:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 20:01:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:01:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43537451
Sun 19 Jan 2014 20:01:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:01:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:01:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:01:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43537451
Sun 19 Jan 2014 20:01:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:01:39 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:01:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:01:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:01:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:01:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:01:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:01:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:01:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:01:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:01:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:01:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:01:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:01:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:01:47 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:01:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:01:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:01:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:01:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:01:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:01:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:01:49 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 20:01:49 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 20:01:49 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:01:50 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:01:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 20:01:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:01:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:01:50 - job_xml_thread(): Done retrieving: data size 43561719
Sun 19 Jan 2014 20:01:50 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:01:50 - XML: Start document: iteration 18
Sun 19 Jan 2014 20:01:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561719
Sun 19 Jan 2014 20:01:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561719
Sun 19 Jan 2014 20:01:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:01:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:01:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:01:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:02:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:02:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:02:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:02:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:02:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:02:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:02:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:02:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:02:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:02:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:02:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:02:09 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:02:09 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:02:09 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:02:09 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:02:09 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:02:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:02:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:02:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:02:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:02:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:02:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:02:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:02:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:02:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:02:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565522
Sun 19 Jan 2014 20:02:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:02:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565522
Sun 19 Jan 2014 20:02:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:02:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:02:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:02:25 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:02:25 - job_xml_thread(): Done retrieving: data size 43565522
Sun 19 Jan 2014 20:02:25 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:02:25 - XML: Start document: iteration 19
Sun 19 Jan 2014 20:02:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:02:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:02:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:02:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:02:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:02:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:02:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:02:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:02:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:02:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:02:28 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:02:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:02:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:02:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:02:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 20:02:30 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:02:30 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:02:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 20:02:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6915 values 109460 bits 13682 bytes 
Sun 19 Jan 2014 20:02:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:02:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:02:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:02:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:02:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:02:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:02:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:02:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:02:38 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:02:38 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:02:38 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:02:38 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:02:38 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:02:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:02:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572519
Sun 19 Jan 2014 20:02:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:02:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572519
Sun 19 Jan 2014 20:02:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:02:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:02:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:02:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:02:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:02:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:02:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:02:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:02:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:02:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:02:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:02:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:02:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:02:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:02:53 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:02:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:02:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:02:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:02:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:02:56 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:02:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 20:02:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:02:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:02:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:02:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:02:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:02:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:02:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578637
Sun 19 Jan 2014 20:02:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:02:58 - job_xml_thread(): Done retrieving: data size 43578637
Sun 19 Jan 2014 20:02:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578637
Sun 19 Jan 2014 20:02:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:02:58 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:02:58 - XML: Start document: iteration 20
Sun 19 Jan 2014 20:03:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:03:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:03:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:03:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:03:16 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:03:16 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:03:16 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:03:16 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:03:16 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:03:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:03:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:03:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:03:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:03:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:03:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:03:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:03:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:03:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:03:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:03:20 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:03:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:03:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:03:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:03:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:03:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:03:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:03:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:03:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43595719
Sun 19 Jan 2014 20:03:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:03:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43595719
Sun 19 Jan 2014 20:03:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:03:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:03:30 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:03:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:03:30 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:03:31 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:03:31 - job_xml_thread(): Done retrieving: data size 43595719
Sun 19 Jan 2014 20:03:31 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:03:31 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 20:03:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:03:31 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:03:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 20:03:31 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:03:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 20:03:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9190 values 145261 bits 18157 bytes 
Sun 19 Jan 2014 20:03:31 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 20:03:31 - Housekeeping: done.
Sun 19 Jan 2014 20:03:31 - XML: Start document: iteration 0
Sun 19 Jan 2014 20:03:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:03:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:03:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:03:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:03:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:03:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:03:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:03:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:03:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:03:44 - XML: Processed 653349 elements - found 0 jobs
Sun 19 Jan 2014 20:03:44 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:03:44 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:03:44 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:03:44 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:03:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:03:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:03:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:03:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:03:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:03:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:03:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:03:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:03:47 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:03:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 20:03:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:03:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:03:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43549941
Sun 19 Jan 2014 20:03:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:03:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43549941
Sun 19 Jan 2014 20:03:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:03:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:03:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:03:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:03:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:03:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:03:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:03:57 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 20:03:57 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:03:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:03:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:03:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:03:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:03:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:03:58 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:03:58 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:03:58 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 20:03:58 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 20:03:59 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 20:03:59 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:03:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:03:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:04:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:04:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:04:02 - size of cluster 'LISA Cluster': 624 hosts 79487 metrics 775915 values 12260586 bits 1532573 bytes 
Sun 19 Jan 2014 20:04:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:04:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:04:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:04:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:04:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:04:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:04:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:04:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578261
Sun 19 Jan 2014 20:04:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:04:08 - job_xml_thread(): Done retrieving: data size 43578261
Sun 19 Jan 2014 20:04:08 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:04:08 - XML: Start document: iteration 1
Sun 19 Jan 2014 20:04:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578261
Sun 19 Jan 2014 20:04:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:04:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:04:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:04:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:04:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:04:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:04:26 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:04:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:04:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:04:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:04:27 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:04:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:04:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:04:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:04:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:04:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:04:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:04:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:04:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:04:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:04:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:04:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:04:30 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:04:30 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:04:30 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:04:30 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:04:30 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:04:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:04:31 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:04:31 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:04:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:04:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 20:04:31 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:04:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 20:04:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99145 bits 12393 bytes 
Sun 19 Jan 2014 20:04:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:04:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578191
Sun 19 Jan 2014 20:04:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:04:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578191
Sun 19 Jan 2014 20:04:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:04:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:04:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:04:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:04:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:04:45 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:04:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:04:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:04:45 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:04:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:04:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:04:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:04:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:04:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:04:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:04:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:04:49 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:04:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:04:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:04:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:04:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:04:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:04:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:04:52 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:04:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 20:04:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:04:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:04:53 - job_xml_thread(): Done retrieving: data size 43587078
Sun 19 Jan 2014 20:04:53 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:04:53 - XML: Start document: iteration 2
Sun 19 Jan 2014 20:04:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43587078
Sun 19 Jan 2014 20:04:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43587078
Sun 19 Jan 2014 20:04:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:04:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:04:58 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:04:58 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 20:05:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:05:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:05:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:05:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:05:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:05:07 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:05:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:05:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:05:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:05:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:05:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:05:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:05:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:05:10 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:05:10 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:05:10 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:05:10 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:05:10 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:05:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:05:18 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:05:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:05:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:05:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:05:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:05:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:05:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:05:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:05:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43490480
Sun 19 Jan 2014 20:05:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:05:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43490480
Sun 19 Jan 2014 20:05:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:05:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:05:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:05:25 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:05:25 - job_xml_thread(): Done retrieving: data size 43490480
Sun 19 Jan 2014 20:05:26 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:05:26 - XML: Start document: iteration 3
Sun 19 Jan 2014 20:05:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:05:32 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:05:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:05:33 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:05:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 20:05:33 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:05:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 20:05:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7197 values 113509 bits 14188 bytes 
Sun 19 Jan 2014 20:05:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:05:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:05:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:05:39 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:05:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:05:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:05:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:05:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:05:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:05:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:05:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:05:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:05:41 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:05:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:05:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:05:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:05:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:05:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:05:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:05:43 - XML: Processed 652602 elements - found 0 jobs
Sun 19 Jan 2014 20:05:43 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:05:43 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:05:43 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:05:43 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:05:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:05:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42957005
Sun 19 Jan 2014 20:05:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:05:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42957005
Sun 19 Jan 2014 20:05:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:05:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:05:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:05:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:05:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:05:58 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:05:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:06:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:06:01 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:06:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:06:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:06:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:06:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:06:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:06:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:06:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:06:04 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:06:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:06:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:06:05 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:06:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 20:06:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:06:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:06:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:06:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:06:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:06:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:06:08 - job_xml_thread(): Done retrieving: data size 42915482
Sun 19 Jan 2014 20:06:08 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:06:08 - XML: Start document: iteration 4
Sun 19 Jan 2014 20:06:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42915482
Sun 19 Jan 2014 20:06:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:06:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42915482
Sun 19 Jan 2014 20:06:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:06:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:06:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:06:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:06:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:06:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:06:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:06:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:06:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:06:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:06:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:06:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:06:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:06:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:06:28 - XML: Processed 645152 elements - found 0 jobs
Sun 19 Jan 2014 20:06:28 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:06:28 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:06:28 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:06:28 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:06:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:06:30 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:06:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:06:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:06:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:06:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:06:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:06:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:06:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:06:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43309554
Sun 19 Jan 2014 20:06:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:06:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:06:34 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:06:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43309554
Sun 19 Jan 2014 20:06:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:06:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:06:35 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:06:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 20:06:35 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:06:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 20:06:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7453 values 117583 bits 14697 bytes 
Sun 19 Jan 2014 20:06:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:06:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:06:43 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:06:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:06:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:06:45 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:06:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:06:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:06:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:06:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:06:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:06:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:06:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:06:49 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:06:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:06:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:06:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:06:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:06:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:06:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:06:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:06:53 - job_xml_thread(): Done retrieving: data size 43535884
Sun 19 Jan 2014 20:06:53 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:06:53 - XML: Start document: iteration 5
Sun 19 Jan 2014 20:06:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43535884
Sun 19 Jan 2014 20:06:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:06:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43535884
Sun 19 Jan 2014 20:06:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:07:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:07:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:07:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:07:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:07:10 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:07:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 20:07:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:07:12 - XML: Processed 652900 elements - found 0 jobs
Sun 19 Jan 2014 20:07:12 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:07:12 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:07:12 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:07:12 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:07:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:07:13 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:07:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:07:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:07:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:07:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:07:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:07:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:07:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:07:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:07:16 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:07:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:07:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:07:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:07:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:07:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:07:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:07:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:07:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570672
Sun 19 Jan 2014 20:07:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:07:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570672
Sun 19 Jan 2014 20:07:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:07:27 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:07:27 - job_xml_thread(): Done retrieving: data size 43570672
Sun 19 Jan 2014 20:07:27 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:07:27 - XML: Start document: iteration 6
Sun 19 Jan 2014 20:07:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:07:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:07:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:07:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:07:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:07:35 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:07:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:07:36 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:07:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:07:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:07:37 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:07:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:07:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:07:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:07:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:07:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 20:07:37 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:07:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5814 values 91674 bits 11459 bytes 
Sun 19 Jan 2014 20:07:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 20:07:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:07:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:07:40 - XML: Processed 653349 elements - found 0 jobs
Sun 19 Jan 2014 20:07:40 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:07:40 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:07:40 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:07:40 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:07:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:07:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:07:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:07:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:07:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:07:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:07:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:07:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:07:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:07:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43549314
Sun 19 Jan 2014 20:07:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:07:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43549314
Sun 19 Jan 2014 20:07:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:07:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:07:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:07:55 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:07:55 - job_xml_thread(): Done retrieving: data size 43549314
Sun 19 Jan 2014 20:07:55 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:07:55 - XML: Start document: iteration 7
Sun 19 Jan 2014 20:08:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:08:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:08:05 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:08:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 20:08:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:08:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:08:06 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:08:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:08:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:08:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:08:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:08:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:08:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:08:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:08:11 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:08:11 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:08:11 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:08:11 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:08:11 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:08:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:08:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:08:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:08:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:08:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:08:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:08:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:08:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:08:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:08:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561579
Sun 19 Jan 2014 20:08:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:08:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561579
Sun 19 Jan 2014 20:08:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:08:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:08:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:08:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:08:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:08:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:08:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:08:26 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:08:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:08:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:08:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:08:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:08:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:08:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:08:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:08:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:08:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:08:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:08:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:08:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:08:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:08:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:08:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:08:31 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 20:08:31 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 20:08:31 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:08:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:08:32 - job_xml_thread(): Done retrieving: data size 43570859
Sun 19 Jan 2014 20:08:32 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:08:32 - XML: Start document: iteration 8
Sun 19 Jan 2014 20:08:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570859
Sun 19 Jan 2014 20:08:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:08:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570859
Sun 19 Jan 2014 20:08:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:08:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:08:37 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:08:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:08:38 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:08:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 20:08:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 20:08:38 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:08:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9105 values 143592 bits 17949 bytes 
Sun 19 Jan 2014 20:08:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:08:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:08:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:08:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:08:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:08:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:08:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:08:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:08:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:08:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:08:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:08:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:08:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:08:50 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:08:50 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:08:50 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:08:50 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:08:50 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:08:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:08:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:08:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:08:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:08:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:08:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:08:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:08:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:08:56 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:08:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 20:08:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:08:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:08:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579297
Sun 19 Jan 2014 20:08:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:08:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579297
Sun 19 Jan 2014 20:08:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:09:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:09:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:09:05 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:09:05 - job_xml_thread(): Done retrieving: data size 43579297
Sun 19 Jan 2014 20:09:06 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:09:06 - XML: Start document: iteration 9
Sun 19 Jan 2014 20:09:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:09:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:09:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:09:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:09:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:09:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:09:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:09:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:09:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:09:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:09:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:09:17 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:09:17 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:09:17 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:09:17 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:09:17 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:09:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:09:17 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:09:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:09:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:09:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:09:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:09:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:09:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:09:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:09:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565278
Sun 19 Jan 2014 20:09:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:09:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565278
Sun 19 Jan 2014 20:09:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:09:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:09:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:09:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:09:31 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:09:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:09:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:09:32 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:09:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:09:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:09:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:09:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:09:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:09:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:09:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:09:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:09:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:09:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:09:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:09:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:09:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:09:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:09:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:09:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:09:35 - job_xml_thread(): Done retrieving: data size 43598584
Sun 19 Jan 2014 20:09:35 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:09:35 - XML: Start document: iteration 10
Sun 19 Jan 2014 20:09:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43598584
Sun 19 Jan 2014 20:09:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43598584
Sun 19 Jan 2014 20:09:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:09:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:09:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:09:38 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:09:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:09:38 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:09:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 20:09:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 20:09:39 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:09:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9004 values 141976 bits 17747 bytes 
Sun 19 Jan 2014 20:09:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:09:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:09:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:09:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:09:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:09:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:09:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:09:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:09:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:09:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:09:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:09:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:09:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:09:55 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:09:55 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:09:55 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:09:55 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:09:55 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:09:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:09:59 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:09:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:09:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:09:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:09:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:09:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:09:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:10:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:10:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556783
Sun 19 Jan 2014 20:10:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:10:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556783
Sun 19 Jan 2014 20:10:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:10:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:10:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:10:10 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:10:10 - job_xml_thread(): Done retrieving: data size 43556783
Sun 19 Jan 2014 20:10:10 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:10:10 - XML: Start document: iteration 11
Sun 19 Jan 2014 20:10:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:10:13 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:10:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:10:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:10:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:10:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:10:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:10:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:10:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:10:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:10:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:10:23 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:10:23 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:10:23 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:10:23 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:10:23 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:10:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:10:24 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:10:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:10:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:10:24 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:10:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 20:10:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:10:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:10:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:10:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:10:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:10:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:10:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43549243
Sun 19 Jan 2014 20:10:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:10:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:10:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43549243
Sun 19 Jan 2014 20:10:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:10:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:10:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:10:36 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:10:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:10:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:10:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:10:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:10:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:10:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43549243
Sun 19 Jan 2014 20:10:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:10:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:10:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:10:39 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:10:39 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:10:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:10:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:10:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 20:10:39 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:10:39 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:10:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 20:10:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5911 values 93220 bits 11652 bytes 
Sun 19 Jan 2014 20:10:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:10:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:10:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:10:47 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:10:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:10:49 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:10:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:10:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:10:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:10:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:10:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:10:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:10:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:10:51 - job_xml_thread(): Done retrieving: data size 43565405
Sun 19 Jan 2014 20:10:51 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:10:51 - XML: Start document: iteration 12
Sun 19 Jan 2014 20:10:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565405
Sun 19 Jan 2014 20:10:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:10:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:10:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:10:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:10:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:10:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:10:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565405
Sun 19 Jan 2014 20:10:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:10:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:10:58 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 20:10:58 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:10:58 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:10:58 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:10:58 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 20:10:58 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 20:10:58 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 20:11:04 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:11:04 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:11:04 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:11:04 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:11:04 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:11:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:11:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:11:05 - size of cluster 'LISA Cluster': 624 hosts 79471 metrics 743545 values 11724369 bits 1465546 bytes 
Sun 19 Jan 2014 20:11:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:11:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:11:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:11:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:11:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:11:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:11:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:11:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:11:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:11:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:11:14 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:11:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:11:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:11:14 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:11:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 20:11:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:11:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:11:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:11:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:11:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:11:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:11:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43505232
Sun 19 Jan 2014 20:11:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:11:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43505232
Sun 19 Jan 2014 20:11:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:11:19 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:11:19 - job_xml_thread(): Done retrieving: data size 43505232
Sun 19 Jan 2014 20:11:19 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:11:19 - XML: Start document: iteration 13
Sun 19 Jan 2014 20:11:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:11:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:11:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:11:28 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:11:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:11:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:11:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:11:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:11:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:11:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:11:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:11:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:11:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:11:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:11:39 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:11:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:11:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 20:11:39 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:11:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5875 values 92681 bits 11585 bytes 
Sun 19 Jan 2014 20:11:39 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:11:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 20:11:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:11:40 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:11:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:11:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:11:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:11:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:11:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:11:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:11:41 - XML: Processed 652602 elements - found 0 jobs
Sun 19 Jan 2014 20:11:41 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:11:41 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:11:41 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:11:41 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:11:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:11:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42982033
Sun 19 Jan 2014 20:11:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:11:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42982033
Sun 19 Jan 2014 20:11:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:11:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:11:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:11:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:11:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:11:56 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:11:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:11:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:11:58 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:11:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:11:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:11:59 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:11:59 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 20:11:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:11:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:11:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:11:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:12:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:12:00 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:12:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:12:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:12:00 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:12:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 20:12:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:12:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:12:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:12:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:12:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:12:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:12:03 - job_xml_thread(): Done retrieving: data size 42907086
Sun 19 Jan 2014 20:12:03 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:12:03 - XML: Start document: iteration 14
Sun 19 Jan 2014 20:12:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42907086
Sun 19 Jan 2014 20:12:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42907086
Sun 19 Jan 2014 20:12:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:12:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:12:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:12:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:12:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:12:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:12:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:12:19 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:12:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:12:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:12:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:12:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:12:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:12:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:12:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:12:21 - XML: Processed 645152 elements - found 0 jobs
Sun 19 Jan 2014 20:12:21 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:12:21 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:12:21 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:12:21 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:12:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:12:27 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:12:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:12:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:12:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:12:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:12:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:12:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:12:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:12:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43195841
Sun 19 Jan 2014 20:12:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:12:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43195841
Sun 19 Jan 2014 20:12:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:12:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:12:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:12:37 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:12:37 - job_xml_thread(): Done retrieving: data size 43195841
Sun 19 Jan 2014 20:12:37 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:12:37 - XML: Start document: iteration 15
Sun 19 Jan 2014 20:12:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:12:40 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:12:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:12:40 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:12:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 20:12:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 20:12:40 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:12:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8937 values 140978 bits 17622 bytes 
Sun 19 Jan 2014 20:12:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:12:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:12:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:12:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:12:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:12:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:12:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:12:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:12:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:12:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:12:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:12:53 - XML: Processed 648884 elements - found 0 jobs
Sun 19 Jan 2014 20:12:53 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:12:53 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:12:53 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:12:53 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:12:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:12:53 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:12:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:12:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:12:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:12:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:12:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:12:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:12:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:12:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43523929
Sun 19 Jan 2014 20:12:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:12:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43523929
Sun 19 Jan 2014 20:12:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:13:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:13:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:13:08 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:13:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:13:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:13:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:13:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:13:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:13:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:13:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:13:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:13:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:13:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:13:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:13:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:13:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:13:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:13:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:13:13 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:13:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 20:13:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:13:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:13:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:13:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:13:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:13:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:13:15 - job_xml_thread(): Done retrieving: data size 43563696
Sun 19 Jan 2014 20:13:15 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:13:15 - XML: Start document: iteration 16
Sun 19 Jan 2014 20:13:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563696
Sun 19 Jan 2014 20:13:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:13:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563696
Sun 19 Jan 2014 20:13:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:13:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:13:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:13:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:13:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:13:31 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:13:32 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:13:32 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:13:32 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:13:32 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:13:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:13:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:13:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:13:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:13:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:13:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:13:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:13:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:13:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:13:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:13:37 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:13:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:13:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:13:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:13:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:13:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:13:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:13:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:13:40 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:13:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:13:40 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:13:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 20:13:40 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:13:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 20:13:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5870 values 92581 bits 11572 bytes 
Sun 19 Jan 2014 20:13:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:13:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578698
Sun 19 Jan 2014 20:13:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:13:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578698
Sun 19 Jan 2014 20:13:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:13:47 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:13:47 - job_xml_thread(): Done retrieving: data size 43578698
Sun 19 Jan 2014 20:13:47 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:13:47 - XML: Start document: iteration 17
Sun 19 Jan 2014 20:13:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:13:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:13:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:13:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:13:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:13:59 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:13:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:13:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:14:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:14:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:14:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:14:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:14:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:14:02 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:14:02 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:14:02 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:14:02 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:14:02 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:14:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:14:05 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:14:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:14:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:14:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:14:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:14:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:14:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:14:09 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:14:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 20:14:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:14:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:14:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564260
Sun 19 Jan 2014 20:14:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:14:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564260
Sun 19 Jan 2014 20:14:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:14:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:14:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:14:17 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:14:17 - job_xml_thread(): Done retrieving: data size 43564260
Sun 19 Jan 2014 20:14:17 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:14:17 - XML: Start document: iteration 18
Sun 19 Jan 2014 20:14:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:14:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:14:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:14:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:14:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:14:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:14:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:14:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:14:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:14:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:14:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:14:31 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:14:31 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:14:31 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:14:31 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:14:31 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:14:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:14:32 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:14:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:14:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:14:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:14:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:14:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:14:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:14:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:14:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556905
Sun 19 Jan 2014 20:14:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:14:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556905
Sun 19 Jan 2014 20:14:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:14:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:14:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:14:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:14:40 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:14:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:14:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 20:14:41 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:14:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 20:14:41 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:14:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7030 values 110850 bits 13856 bytes 
Sun 19 Jan 2014 20:14:46 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:14:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:14:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:14:46 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:14:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:14:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:14:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:14:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:14:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:14:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:14:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:14:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:14:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:14:52 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:14:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:14:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:14:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:14:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:14:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:14:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:14:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:14:55 - job_xml_thread(): Done retrieving: data size 43579768
Sun 19 Jan 2014 20:14:55 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:14:55 - XML: Start document: iteration 19
Sun 19 Jan 2014 20:14:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579768
Sun 19 Jan 2014 20:14:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:14:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579768
Sun 19 Jan 2014 20:14:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:15:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:15:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:15:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:15:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:15:14 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:15:14 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:15:14 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:15:14 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:15:14 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:15:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:15:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:15:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:15:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:15:15 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:15:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 20:15:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:15:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:15:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:15:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:15:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:15:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:15:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:15:19 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:15:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:15:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:15:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:15:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:15:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:15:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:15:20 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 20:15:20 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 20:15:20 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:15:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:15:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583346
Sun 19 Jan 2014 20:15:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:15:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583346
Sun 19 Jan 2014 20:15:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:15:29 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:15:29 - job_xml_thread(): Done retrieving: data size 43583346
Sun 19 Jan 2014 20:15:29 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:15:29 - XML: Start document: iteration 20
Sun 19 Jan 2014 20:15:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:15:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:15:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:15:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:15:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:15:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:15:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:15:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:15:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:15:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:15:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:15:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:15:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:15:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:15:42 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:15:43 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:15:43 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:15:43 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:15:43 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:15:43 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:15:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:15:43 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:15:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 20:15:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 20:15:43 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:15:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:15:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6017 values 94923 bits 11865 bytes 
Sun 19 Jan 2014 20:15:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:15:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:15:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:15:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:15:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:15:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:15:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:15:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:15:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558163
Sun 19 Jan 2014 20:15:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:15:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558163
Sun 19 Jan 2014 20:15:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:15:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:15:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:15:58 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:15:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:15:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:15:59 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:15:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:15:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:15:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:15:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:15:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:15:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:15:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:15:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:16:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:16:00 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:16:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:16:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:16:00 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:16:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 20:16:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:16:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:16:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:16:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:16:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:16:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:16:01 - job_xml_thread(): Done retrieving: data size 43580109
Sun 19 Jan 2014 20:16:01 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:16:01 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 20:16:01 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 20:16:01 - Housekeeping: done.
Sun 19 Jan 2014 20:16:01 - XML: Start document: iteration 0
Sun 19 Jan 2014 20:16:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580109
Sun 19 Jan 2014 20:16:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:16:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580109
Sun 19 Jan 2014 20:16:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:16:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:16:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:16:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:16:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:16:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:16:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:16:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:16:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:16:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:16:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:16:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:16:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:16:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:16:21 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:16:21 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:16:21 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:16:21 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:16:21 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:16:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:16:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:16:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:16:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:16:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:16:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:16:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:16:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:16:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:16:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583141
Sun 19 Jan 2014 20:16:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:16:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583141
Sun 19 Jan 2014 20:16:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:16:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:16:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:16:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:16:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:16:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:16:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:16:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:16:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:16:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583141
Sun 19 Jan 2014 20:16:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:16:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:16:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:16:37 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:16:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:16:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:16:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:16:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:16:44 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:16:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:16:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 20:16:44 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:16:44 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:16:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 20:16:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8909 values 140779 bits 17597 bytes 
Sun 19 Jan 2014 20:16:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:16:46 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:16:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:16:47 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:16:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:16:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:16:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:16:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:16:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:16:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:16:49 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:16:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 20:16:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:16:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:16:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:16:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:16:50 - job_xml_thread(): Done retrieving: data size 43563018
Sun 19 Jan 2014 20:16:50 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:16:50 - XML: Start document: iteration 1
Sun 19 Jan 2014 20:16:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563018
Sun 19 Jan 2014 20:16:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:16:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:16:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:16:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:16:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:16:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563018
Sun 19 Jan 2014 20:16:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:17:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:17:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:17:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:17:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:17:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:17:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:17:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:17:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:17:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:17:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:17:12 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:17:12 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:17:12 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:17:12 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:17:12 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:17:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:17:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:17:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:17:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:17:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:17:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:17:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:17:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:17:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:17:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:17:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:17:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:17:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43527183
Sun 19 Jan 2014 20:17:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:17:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43527183
Sun 19 Jan 2014 20:17:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:17:27 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:17:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:17:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:17:28 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:17:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:17:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:17:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:17:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:17:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:17:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:17:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:17:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:17:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:17:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:17:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:17:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:17:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:17:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:17:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:17:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:17:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:17:32 - job_xml_thread(): Done retrieving: data size 43131815
Sun 19 Jan 2014 20:17:32 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:17:32 - XML: Start document: iteration 2
Sun 19 Jan 2014 20:17:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43131815
Sun 19 Jan 2014 20:17:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:17:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43131815
Sun 19 Jan 2014 20:17:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:17:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:17:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:17:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:17:45 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:17:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:17:45 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:17:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:17:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:17:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:17:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:17:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:17:46 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:17:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:17:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 20:17:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 20:17:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:17:46 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:17:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:17:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:17:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 149002 bits 18625 bytes 
Sun 19 Jan 2014 20:17:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:17:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:17:52 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:17:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:17:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:17:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:17:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:17:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:17:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:17:55 - XML: Processed 647850 elements - found 0 jobs
Sun 19 Jan 2014 20:17:55 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:17:55 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:17:55 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:17:55 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:17:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:17:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42940998
Sun 19 Jan 2014 20:17:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:17:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42940998
Sun 19 Jan 2014 20:17:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:17:59 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 20:18:00 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:18:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:18:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:18:02 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:18:02 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 20:18:02 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:18:02 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 20:18:02 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 20:18:08 - size of cluster 'LISA Cluster': 624 hosts 79469 metrics 731461 values 11553790 bits 1444223 bytes 
Sun 19 Jan 2014 20:18:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:18:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:18:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:18:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:18:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:18:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:18:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:18:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:18:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:18:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:18:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:18:10 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:18:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:18:14 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:18:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:18:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:18:14 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:18:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 20:18:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:18:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:18:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:18:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:18:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:18:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:18:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42961570
Sun 19 Jan 2014 20:18:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:18:17 - job_xml_thread(): Done retrieving: data size 42961570
Sun 19 Jan 2014 20:18:17 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:18:17 - XML: Start document: iteration 3
Sun 19 Jan 2014 20:18:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42961570
Sun 19 Jan 2014 20:18:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:18:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:18:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:18:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:18:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:18:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:18:36 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:18:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:18:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:18:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:18:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:18:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:18:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:18:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:18:39 - XML: Processed 645804 elements - found 0 jobs
Sun 19 Jan 2014 20:18:39 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:18:39 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:18:39 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:18:39 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:18:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:18:40 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:18:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:18:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:18:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:18:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:18:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:18:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:18:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:18:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43426435
Sun 19 Jan 2014 20:18:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:18:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43426435
Sun 19 Jan 2014 20:18:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:18:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:18:47 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:18:48 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:18:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:18:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 20:18:48 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:18:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 20:18:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8970 values 141747 bits 17718 bytes 
Sun 19 Jan 2014 20:18:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:18:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:18:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:18:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:18:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:18:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:18:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:18:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:18:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:18:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:18:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43426435
Sun 19 Jan 2014 20:18:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:18:54 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:18:54 - job_xml_thread(): Done retrieving: data size 43426435
Sun 19 Jan 2014 20:18:54 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:18:54 - XML: Start document: iteration 4
Sun 19 Jan 2014 20:18:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:18:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:19:03 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:19:03 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 20:19:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:19:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:19:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:19:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:19:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:19:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:19:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:19:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:19:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:19:13 - XML: Processed 651318 elements - found 0 jobs
Sun 19 Jan 2014 20:19:13 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:19:13 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:19:13 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:19:13 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:19:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:19:14 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:19:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:19:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:19:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:19:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:19:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:19:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:19:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:19:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558867
Sun 19 Jan 2014 20:19:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:19:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558867
Sun 19 Jan 2014 20:19:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:19:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:19:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:19:28 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:19:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:19:28 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:19:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 20:19:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:19:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:19:29 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:19:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:19:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:19:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:19:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:19:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:19:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:19:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:19:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:19:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:19:32 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:19:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:19:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:19:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:19:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:19:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:19:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:19:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:19:36 - job_xml_thread(): Done retrieving: data size 43565962
Sun 19 Jan 2014 20:19:36 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:19:36 - XML: Start document: iteration 5
Sun 19 Jan 2014 20:19:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565962
Sun 19 Jan 2014 20:19:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565962
Sun 19 Jan 2014 20:19:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:19:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:19:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:19:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:19:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:19:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:19:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:19:48 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:19:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:19:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 20:19:48 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:19:48 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:19:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 20:19:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6110 values 96416 bits 12052 bytes 
Sun 19 Jan 2014 20:19:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:19:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:19:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:19:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:19:57 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:19:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:19:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:19:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:19:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:19:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:19:57 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:19:57 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:19:57 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:19:57 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:20:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:20:00 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:20:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:20:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:20:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:20:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:20:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:20:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:20:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:20:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565236
Sun 19 Jan 2014 20:20:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:20:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565236
Sun 19 Jan 2014 20:20:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:20:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:20:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:20:12 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:20:12 - job_xml_thread(): Done retrieving: data size 43565236
Sun 19 Jan 2014 20:20:12 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:20:12 - XML: Start document: iteration 6
Sun 19 Jan 2014 20:20:13 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:20:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 20:20:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:20:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:20:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:20:23 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:20:23 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:20:23 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:20:23 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:20:23 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:20:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:20:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:20:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:20:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:20:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:20:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:20:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:20:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:20:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:20:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:20:28 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:20:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:20:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:20:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:20:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:20:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:20:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:20:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:20:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559883
Sun 19 Jan 2014 20:20:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:20:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559883
Sun 19 Jan 2014 20:20:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:20:38 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:20:38 - job_xml_thread(): Done retrieving: data size 43559883
Sun 19 Jan 2014 20:20:38 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:20:38 - XML: Start document: iteration 7
Sun 19 Jan 2014 20:20:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:20:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:20:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:20:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:20:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:20:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:20:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:20:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:20:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:20:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:20:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:20:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:20:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:20:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:20:48 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:20:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:20:49 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:20:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 20:20:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 20:20:49 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:20:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6161 values 97215 bits 12151 bytes 
Sun 19 Jan 2014 20:20:52 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:20:52 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:20:52 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:20:52 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:20:52 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:20:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:20:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:20:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:20:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:20:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:20:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:20:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:20:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:20:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:20:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:20:58 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:20:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 20:20:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:20:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:20:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560338
Sun 19 Jan 2014 20:20:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:20:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560338
Sun 19 Jan 2014 20:20:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:21:07 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:21:07 - job_xml_thread(): Done retrieving: data size 43560338
Sun 19 Jan 2014 20:21:07 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:21:07 - XML: Start document: iteration 8
Sun 19 Jan 2014 20:21:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:21:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:21:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:21:10 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:21:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:21:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:21:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:21:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:21:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:21:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:21:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:21:16 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:21:16 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:21:16 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:21:16 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:21:16 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:21:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:21:20 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:21:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:21:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:21:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:21:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:21:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:21:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:21:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:21:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564157
Sun 19 Jan 2014 20:21:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:21:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564157
Sun 19 Jan 2014 20:21:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:21:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:21:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:21:31 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:21:31 - job_xml_thread(): Done retrieving: data size 43564157
Sun 19 Jan 2014 20:21:31 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:21:31 - XML: Start document: iteration 9
Sun 19 Jan 2014 20:21:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:21:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:21:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:21:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:21:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:21:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:21:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:21:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:21:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:21:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:21:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:21:45 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:21:45 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:21:45 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:21:45 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:21:45 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:21:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:21:45 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:21:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:21:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:21:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:21:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:21:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:21:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:21:48 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 20:21:48 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 20:21:48 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:21:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:21:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43551195
Sun 19 Jan 2014 20:21:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:21:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43551195
Sun 19 Jan 2014 20:21:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:21:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:21:50 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:21:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:21:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:21:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:21:52 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:21:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 20:21:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 20:21:52 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:21:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9258 values 146084 bits 18260 bytes 
Sun 19 Jan 2014 20:21:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:21:58 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:21:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:21:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:21:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:21:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:21:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43551195
Sun 19 Jan 2014 20:21:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:21:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:21:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:22:00 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:22:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:22:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:22:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:22:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:22:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:22:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:22:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:22:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:22:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:22:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:22:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:22:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:22:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:22:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:22:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:22:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:22:14 - job_xml_thread(): Done retrieving: data size 43567418
Sun 19 Jan 2014 20:22:14 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:22:14 - XML: Start document: iteration 10
Sun 19 Jan 2014 20:22:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567418
Sun 19 Jan 2014 20:22:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:22:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:22:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:22:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567418
Sun 19 Jan 2014 20:22:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:22:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:22:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:22:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:22:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:22:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:22:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:22:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:22:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:22:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:22:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:22:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:22:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:22:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:22:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:22:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:22:36 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:22:36 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:22:36 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:22:36 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:22:36 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:22:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:22:37 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:22:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:22:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:22:38 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:22:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 20:22:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:22:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:22:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:22:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:22:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:22:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:22:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43601093
Sun 19 Jan 2014 20:22:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:22:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43601093
Sun 19 Jan 2014 20:22:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:22:51 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:22:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:22:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:22:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:22:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:22:52 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:22:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:22:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:22:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:22:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:22:53 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:22:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:22:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 20:22:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 20:22:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:22:53 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:22:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:22:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5880 values 92722 bits 11590 bytes 
Sun 19 Jan 2014 20:22:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:22:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:22:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:22:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:22:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:22:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:22:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:22:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:22:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:22:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:22:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:22:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:22:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:22:56 - job_xml_thread(): Done retrieving: data size 43598960
Sun 19 Jan 2014 20:22:56 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:22:56 - XML: Start document: iteration 11
Sun 19 Jan 2014 20:22:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43598960
Sun 19 Jan 2014 20:22:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:22:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43598960
Sun 19 Jan 2014 20:22:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:23:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:23:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:23:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:23:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:23:10 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:23:10 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:23:10 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:23:10 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:23:10 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:23:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:23:14 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:23:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:23:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:23:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:23:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:23:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:23:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:23:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:23:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:23:18 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:23:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:23:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:23:19 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:23:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 20:23:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:23:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:23:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:23:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:23:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:23:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:23:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43507334
Sun 19 Jan 2014 20:23:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:23:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43507334
Sun 19 Jan 2014 20:23:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:23:26 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:23:26 - job_xml_thread(): Done retrieving: data size 43507334
Sun 19 Jan 2014 20:23:26 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:23:26 - XML: Start document: iteration 12
Sun 19 Jan 2014 20:23:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:23:29 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:23:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:23:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:23:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:23:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:23:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:23:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:23:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:23:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:23:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:23:39 - XML: Processed 652602 elements - found 0 jobs
Sun 19 Jan 2014 20:23:39 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:23:39 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:23:39 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:23:39 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:23:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:23:41 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:23:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:23:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:23:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:23:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:23:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:23:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:23:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:23:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42981788
Sun 19 Jan 2014 20:23:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:23:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42981788
Sun 19 Jan 2014 20:23:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:23:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:23:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:23:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:23:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:23:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:23:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:23:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:23:53 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:23:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:23:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:23:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:23:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:23:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:23:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:23:54 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:23:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 20:23:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 20:23:54 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:23:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8726 values 137577 bits 17197 bytes 
Sun 19 Jan 2014 20:23:55 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:23:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:23:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:23:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:23:57 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:23:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:23:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:23:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:23:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:23:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:23:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:24:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:24:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42912443
Sun 19 Jan 2014 20:24:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:24:00 - job_xml_thread(): Done retrieving: data size 42912443
Sun 19 Jan 2014 20:24:00 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:24:00 - XML: Start document: iteration 13
Sun 19 Jan 2014 20:24:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42912443
Sun 19 Jan 2014 20:24:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:24:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:24:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:24:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:24:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:24:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:24:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:24:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:24:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:24:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:24:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:24:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:24:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:24:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:24:20 - XML: Processed 645158 elements - found 0 jobs
Sun 19 Jan 2014 20:24:20 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:24:20 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:24:20 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:24:20 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:24:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:24:21 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:24:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:24:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:24:22 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:24:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 20:24:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:24:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:24:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:24:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:24:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:24:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:24:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42985586
Sun 19 Jan 2014 20:24:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:24:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42985586
Sun 19 Jan 2014 20:24:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:24:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:24:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:24:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:24:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:24:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:24:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:24:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:24:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:24:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:24:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:24:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:24:35 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:24:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:24:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:24:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:24:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:24:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:24:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:24:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:24:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:24:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:24:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:24:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:24:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43383788
Sun 19 Jan 2014 20:24:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:24:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43383788
Sun 19 Jan 2014 20:24:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:24:41 - job_xml_thread(): Done retrieving: data size 43383788
Sun 19 Jan 2014 20:24:41 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:24:41 - XML: Start document: iteration 14
Sun 19 Jan 2014 20:24:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:24:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:24:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:24:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:24:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:24:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:24:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:24:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:24:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:24:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:24:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:24:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:24:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:24:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:24:54 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:24:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:24:55 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:24:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 20:24:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 20:24:55 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:24:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8851 values 139569 bits 17446 bytes 
Sun 19 Jan 2014 20:25:00 - XML: Processed 650650 elements - found 0 jobs
Sun 19 Jan 2014 20:25:00 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:25:00 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:25:00 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:25:00 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:25:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:25:01 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:25:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:25:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:25:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:25:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:25:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:25:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:25:03 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 20:25:03 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:25:04 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:25:04 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:25:04 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 20:25:04 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 20:25:04 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 20:25:05 - size of cluster 'LISA Cluster': 624 hosts 79471 metrics 844247 values 13311937 bits 1663992 bytes 
Sun 19 Jan 2014 20:25:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:25:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43550232
Sun 19 Jan 2014 20:25:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:25:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43550232
Sun 19 Jan 2014 20:25:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:25:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:25:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:25:15 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:25:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:25:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:25:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:25:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:25:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:25:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:25:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:25:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:25:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:25:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:25:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:25:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:25:21 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:25:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:25:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:25:21 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:25:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 20:25:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:25:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:25:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:25:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:25:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:25:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:25:25 - job_xml_thread(): Done retrieving: data size 43576854
Sun 19 Jan 2014 20:25:25 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:25:25 - XML: Start document: iteration 15
Sun 19 Jan 2014 20:25:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576854
Sun 19 Jan 2014 20:25:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:25:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576854
Sun 19 Jan 2014 20:25:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:25:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:25:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:25:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:25:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:25:37 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:25:37 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:25:38 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:25:38 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:25:38 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:25:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:25:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:25:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:25:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:25:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:25:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:25:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:25:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:25:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:25:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:25:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:25:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:25:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:25:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:25:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:25:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:25:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:25:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:25:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564580
Sun 19 Jan 2014 20:25:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:25:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564580
Sun 19 Jan 2014 20:25:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:25:54 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:25:54 - job_xml_thread(): Done retrieving: data size 43564580
Sun 19 Jan 2014 20:25:54 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:25:54 - XML: Start document: iteration 16
Sun 19 Jan 2014 20:25:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:25:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:25:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:25:55 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:25:56 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:25:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 20:25:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:25:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 20:25:56 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:25:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8822 values 139136 bits 17392 bytes 
Sun 19 Jan 2014 20:26:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:26:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:26:04 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:26:04 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 20:26:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:26:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:26:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:26:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:26:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:26:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:26:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:26:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:26:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:26:07 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:26:07 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:26:07 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:26:07 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:26:07 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:26:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:26:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:26:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:26:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:26:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:26:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:26:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:26:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:26:16 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:26:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 20:26:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:26:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:26:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558661
Sun 19 Jan 2014 20:26:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:26:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558661
Sun 19 Jan 2014 20:26:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:26:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:26:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:26:22 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:26:22 - job_xml_thread(): Done retrieving: data size 43558661
Sun 19 Jan 2014 20:26:22 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:26:22 - XML: Start document: iteration 17
Sun 19 Jan 2014 20:26:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:26:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:26:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:26:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:26:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:26:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:26:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:26:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:26:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:26:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:26:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:26:37 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:26:37 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:26:37 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:26:37 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:26:37 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:26:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:26:40 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:26:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:26:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:26:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:26:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:26:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:26:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:26:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:26:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553656
Sun 19 Jan 2014 20:26:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:26:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553656
Sun 19 Jan 2014 20:26:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:26:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:26:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:26:52 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:26:52 - job_xml_thread(): Done retrieving: data size 43553656
Sun 19 Jan 2014 20:26:52 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:26:52 - XML: Start document: iteration 18
Sun 19 Jan 2014 20:26:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:26:54 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:26:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:26:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:26:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:26:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:26:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:26:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:26:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:26:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:26:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:26:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:26:57 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:26:57 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:26:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:26:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 20:26:57 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:26:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 20:26:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99064 bits 12383 bytes 
Sun 19 Jan 2014 20:27:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:27:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:27:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:27:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:27:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:27:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:27:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:27:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:27:05 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:27:05 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:27:05 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:27:05 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:27:05 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:27:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:27:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569946
Sun 19 Jan 2014 20:27:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:27:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569946
Sun 19 Jan 2014 20:27:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:27:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:27:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:27:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:27:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:27:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:27:18 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:27:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:27:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:27:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:27:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:27:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:27:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:27:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:27:20 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:27:22 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:27:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 20:27:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:27:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:27:25 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:27:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:27:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:27:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:27:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:27:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:27:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:27:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:27:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557725
Sun 19 Jan 2014 20:27:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:27:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557725
Sun 19 Jan 2014 20:27:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:27:29 - job_xml_thread(): Done retrieving: data size 43557725
Sun 19 Jan 2014 20:27:29 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:27:29 - XML: Start document: iteration 19
Sun 19 Jan 2014 20:27:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:27:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:27:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:27:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:27:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:27:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:27:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:27:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:27:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:27:51 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:27:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:27:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:27:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:27:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:27:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:27:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:27:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:27:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:27:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:27:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:27:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:27:54 - XML: Processed 653349 elements - found 0 jobs
Sun 19 Jan 2014 20:27:54 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:27:54 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:27:54 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:27:54 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:27:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:27:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43590010
Sun 19 Jan 2014 20:27:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:27:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:27:57 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:27:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43590010
Sun 19 Jan 2014 20:27:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:27:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:27:59 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:27:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 20:27:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 20:27:59 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:27:59 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5837 values 92074 bits 11509 bytes 
Sun 19 Jan 2014 20:28:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:28:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:28:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:28:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:28:09 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:28:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:28:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:28:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:28:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:28:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:28:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:28:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:28:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:28:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:28:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:28:14 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:28:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:28:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:28:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:28:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:28:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:28:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:28:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:28:17 - job_xml_thread(): Done retrieving: data size 43567032
Sun 19 Jan 2014 20:28:17 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:28:17 - XML: Start document: iteration 20
Sun 19 Jan 2014 20:28:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567032
Sun 19 Jan 2014 20:28:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:28:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567032
Sun 19 Jan 2014 20:28:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:28:19 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:28:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 20:28:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:28:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:28:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:28:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:28:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:28:32 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:28:32 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:28:32 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:28:32 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:28:32 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:28:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:28:39 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:28:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:28:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:28:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:28:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:28:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:28:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:28:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:28:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:28:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:28:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:28:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:28:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:28:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:28:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:28:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:28:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:28:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572096
Sun 19 Jan 2014 20:28:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:28:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572096
Sun 19 Jan 2014 20:28:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:28:47 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:28:47 - job_xml_thread(): Done retrieving: data size 43572096
Sun 19 Jan 2014 20:28:47 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:28:47 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 20:28:47 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 20:28:47 - Housekeeping: done.
Sun 19 Jan 2014 20:28:47 - XML: Start document: iteration 0
Sun 19 Jan 2014 20:28:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:28:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:28:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:28:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:28:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:28:59 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:29:00 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:29:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 20:29:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:29:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 20:29:00 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:29:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6281 values 99146 bits 12393 bytes 
Sun 19 Jan 2014 20:29:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:29:04 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:29:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:29:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:29:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:29:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:29:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:29:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:29:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:29:06 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:29:06 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:29:06 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:29:06 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:29:06 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:29:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:29:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:29:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:29:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:29:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:29:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:29:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:29:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:29:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:29:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43491916
Sun 19 Jan 2014 20:29:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:29:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43491916
Sun 19 Jan 2014 20:29:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:29:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:29:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:29:21 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:29:21 - job_xml_thread(): Done retrieving: data size 43491916
Sun 19 Jan 2014 20:29:21 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:29:21 - XML: Start document: iteration 1
Sun 19 Jan 2014 20:29:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:29:25 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:29:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:29:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:29:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:29:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:29:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:29:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:29:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:29:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:29:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:29:34 - XML: Processed 652602 elements - found 0 jobs
Sun 19 Jan 2014 20:29:34 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:29:34 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:29:34 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:29:34 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:29:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:29:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:29:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:29:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:29:36 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:29:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 20:29:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:29:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:29:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:29:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:29:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:29:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:29:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43127054
Sun 19 Jan 2014 20:29:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:29:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43127054
Sun 19 Jan 2014 20:29:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:29:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:29:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:29:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:29:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:29:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:29:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:29:49 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:29:49 - job_xml_thread(): Done retrieving: data size 43127054
Sun 19 Jan 2014 20:29:49 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:29:49 - XML: Start document: iteration 2
Sun 19 Jan 2014 20:29:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:29:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:29:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:29:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:29:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:29:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:29:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:30:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:30:00 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:30:00 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:30:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 20:30:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:30:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 20:30:01 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:30:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5882 values 92778 bits 11597 bytes 
Sun 19 Jan 2014 20:30:02 - XML: Processed 647901 elements - found 0 jobs
Sun 19 Jan 2014 20:30:02 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:30:02 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:30:02 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:30:02 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:30:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:30:03 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:30:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:30:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:30:03 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 20:30:03 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 20:30:03 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:30:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:30:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:30:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:30:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:30:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:30:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:30:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:30:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42904168
Sun 19 Jan 2014 20:30:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:30:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42904168
Sun 19 Jan 2014 20:30:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:30:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:30:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:30:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:30:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:30:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:30:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:30:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:30:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:30:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:30:17 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:30:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:30:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:30:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:30:18 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:30:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:30:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:30:19 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:30:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 20:30:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:30:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:30:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:30:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:30:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:30:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:30:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42998788
Sun 19 Jan 2014 20:30:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:30:22 - job_xml_thread(): Done retrieving: data size 42998788
Sun 19 Jan 2014 20:30:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42998788
Sun 19 Jan 2014 20:30:22 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:30:22 - XML: Start document: iteration 3
Sun 19 Jan 2014 20:30:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:30:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:30:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:30:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:30:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:30:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:30:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:30:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:30:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:30:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:30:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:30:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:30:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:30:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:30:40 - XML: Processed 645902 elements - found 0 jobs
Sun 19 Jan 2014 20:30:40 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:30:40 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:30:40 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:30:40 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:30:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:30:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:30:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:30:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:30:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:30:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:30:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:30:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:30:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:30:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43508344
Sun 19 Jan 2014 20:30:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:30:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43508344
Sun 19 Jan 2014 20:30:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:30:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:30:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:30:55 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:30:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:30:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:30:57 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:30:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:30:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:30:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:30:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:30:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:30:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:30:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:30:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:30:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:30:59 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:30:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:30:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:30:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:30:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:30:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:30:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:31:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:31:00 - job_xml_thread(): Done retrieving: data size 43565388
Sun 19 Jan 2014 20:31:00 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:31:00 - XML: Start document: iteration 4
Sun 19 Jan 2014 20:31:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565388
Sun 19 Jan 2014 20:31:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:31:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:31:01 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:31:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565388
Sun 19 Jan 2014 20:31:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:31:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 20:31:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:31:02 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:31:02 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:31:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 20:31:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9725 values 153488 bits 19186 bytes 
Sun 19 Jan 2014 20:31:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:31:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:31:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:31:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:31:19 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:31:19 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:31:19 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:31:19 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:31:19 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:31:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:31:22 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:31:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:31:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:31:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:31:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:31:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:31:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:31:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:31:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:31:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:31:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:31:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:31:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:31:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:31:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:31:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:31:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:31:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43591945
Sun 19 Jan 2014 20:31:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:31:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43591945
Sun 19 Jan 2014 20:31:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:31:35 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:31:35 - job_xml_thread(): Done retrieving: data size 43591945
Sun 19 Jan 2014 20:31:35 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:31:35 - XML: Start document: iteration 5
Sun 19 Jan 2014 20:31:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:31:36 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:31:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:31:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:31:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:31:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:31:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:31:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:31:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:31:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:31:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:31:41 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:31:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 20:31:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:31:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:31:45 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:31:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:31:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:31:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:31:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:31:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:31:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:31:48 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:31:48 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:31:48 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:31:48 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:31:48 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:31:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:31:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560421
Sun 19 Jan 2014 20:31:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:31:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560421
Sun 19 Jan 2014 20:31:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:31:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:31:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:31:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:31:58 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:31:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:31:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:32:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:32:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:32:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:32:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:32:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560421
Sun 19 Jan 2014 20:32:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:32:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:32:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:32:02 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:32:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:32:03 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:32:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 20:32:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:32:04 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:32:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 20:32:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:32:04 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 20:32:04 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:32:04 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:32:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6116 values 96657 bits 12082 bytes 
Sun 19 Jan 2014 20:32:05 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:32:05 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:32:05 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 20:32:05 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 20:32:05 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 20:32:10 - size of cluster 'LISA Cluster': 624 hosts 79486 metrics 811255 values 12798522 bits 1599815 bytes 
Sun 19 Jan 2014 20:32:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:32:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:32:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:32:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:32:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:32:13 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:32:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:32:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:32:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:32:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:32:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:32:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:32:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:32:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:32:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:32:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:32:18 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:32:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 20:32:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:32:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:32:18 - job_xml_thread(): Done retrieving: data size 43551627
Sun 19 Jan 2014 20:32:18 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:32:18 - XML: Start document: iteration 6
Sun 19 Jan 2014 20:32:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43551627
Sun 19 Jan 2014 20:32:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:32:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43551627
Sun 19 Jan 2014 20:32:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:32:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:32:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:32:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:32:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:32:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:32:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:32:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:32:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:32:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:32:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:32:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:32:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:32:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:32:39 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:32:39 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:32:39 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:32:39 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:32:39 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:32:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:32:41 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:32:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:32:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:32:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:32:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:32:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:32:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:32:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:32:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566692
Sun 19 Jan 2014 20:32:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:32:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566692
Sun 19 Jan 2014 20:32:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:32:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:32:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:32:54 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:32:54 - job_xml_thread(): Done retrieving: data size 43566692
Sun 19 Jan 2014 20:32:54 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:32:54 - XML: Start document: iteration 7
Sun 19 Jan 2014 20:32:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:32:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:32:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:32:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:32:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:32:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:32:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:32:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:32:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:32:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:32:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:33:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:33:04 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:33:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:33:05 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:33:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 20:33:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 20:33:05 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:33:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99345 bits 12418 bytes 
Sun 19 Jan 2014 20:33:05 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:33:05 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 20:33:06 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:33:06 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:33:06 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:33:06 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:33:06 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:33:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:33:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:33:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:33:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:33:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:33:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:33:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:33:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:33:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:33:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:33:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:33:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558492
Sun 19 Jan 2014 20:33:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:33:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558492
Sun 19 Jan 2014 20:33:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:33:21 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:33:21 - job_xml_thread(): Done retrieving: data size 43558492
Sun 19 Jan 2014 20:33:21 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:33:21 - XML: Start document: iteration 8
Sun 19 Jan 2014 20:33:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:33:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:33:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:33:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:33:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:33:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:33:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:33:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:33:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:33:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:33:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:33:34 - XML: Processed 653349 elements - found 0 jobs
Sun 19 Jan 2014 20:33:34 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:33:34 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:33:34 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:33:34 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:33:34 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:33:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 20:33:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:33:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:33:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:33:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:33:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:33:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:33:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:33:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:33:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:33:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:33:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565837
Sun 19 Jan 2014 20:33:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:33:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565837
Sun 19 Jan 2014 20:33:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:33:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:33:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:33:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:33:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:33:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:33:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:33:49 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:33:49 - job_xml_thread(): Done retrieving: data size 43565837
Sun 19 Jan 2014 20:33:49 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:33:49 - XML: Start document: iteration 9
Sun 19 Jan 2014 20:33:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:33:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:33:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:33:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:33:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:33:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:33:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:33:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:33:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:33:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:33:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:33:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:33:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:33:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:33:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:33:58 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:33:58 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:33:58 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:33:58 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:33:58 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:34:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:34:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43549133
Sun 19 Jan 2014 20:34:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:34:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43549133
Sun 19 Jan 2014 20:34:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:34:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:34:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:34:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:34:05 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:34:07 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:34:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 20:34:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:34:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 20:34:07 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:34:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8916 values 140899 bits 17612 bytes 
Sun 19 Jan 2014 20:34:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:34:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:34:13 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:34:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:34:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:34:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:34:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:34:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:34:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:34:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:34:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:34:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:34:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:34:18 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:34:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:34:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:34:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:34:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:34:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:34:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:34:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:34:23 - job_xml_thread(): Done retrieving: data size 43579401
Sun 19 Jan 2014 20:34:23 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:34:23 - XML: Start document: iteration 10
Sun 19 Jan 2014 20:34:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579401
Sun 19 Jan 2014 20:34:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:34:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579401
Sun 19 Jan 2014 20:34:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:34:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:34:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:34:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:34:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:34:39 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:34:39 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:34:39 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:34:39 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:34:39 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:34:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:34:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:34:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:34:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:34:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:34:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:34:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:34:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:34:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:34:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:34:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:34:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:34:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:34:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:34:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:34:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:34:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:34:47 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:34:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 20:34:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:34:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:34:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582636
Sun 19 Jan 2014 20:34:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:34:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582636
Sun 19 Jan 2014 20:34:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:34:54 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:34:54 - job_xml_thread(): Done retrieving: data size 43582636
Sun 19 Jan 2014 20:34:54 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:34:54 - XML: Start document: iteration 11
Sun 19 Jan 2014 20:34:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:34:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:35:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:35:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:35:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:35:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:35:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:35:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:35:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:35:07 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:35:07 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:35:07 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:35:07 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:35:07 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:35:07 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:35:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:35:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:35:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:35:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:35:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:35:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:35:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 20:35:08 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:35:08 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:35:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 20:35:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5602 values 88351 bits 11043 bytes 
Sun 19 Jan 2014 20:35:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:35:11 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:35:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:35:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:35:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:35:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:35:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:35:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:35:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:35:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43502335
Sun 19 Jan 2014 20:35:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:35:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43502335
Sun 19 Jan 2014 20:35:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:35:22 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:35:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:35:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:35:23 - job_xml_thread(): Done retrieving: data size 43502335
Sun 19 Jan 2014 20:35:23 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:35:23 - XML: Start document: iteration 12
Sun 19 Jan 2014 20:35:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:35:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:35:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:35:28 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:35:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:35:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:35:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:35:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:35:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:35:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:35:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:35:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:35:35 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:35:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:35:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:35:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:35:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:35:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:35:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:35:37 - XML: Processed 652602 elements - found 0 jobs
Sun 19 Jan 2014 20:35:37 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:35:37 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:35:37 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:35:37 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:35:37 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:35:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 20:35:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:35:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:35:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43040986
Sun 19 Jan 2014 20:35:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:35:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43040986
Sun 19 Jan 2014 20:35:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:35:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:35:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:35:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:35:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:35:52 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:35:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:35:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:35:55 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:35:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:35:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:35:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:35:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:35:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:35:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:35:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:35:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:35:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:35:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:35:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:35:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:35:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:35:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:35:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:35:59 - job_xml_thread(): Done retrieving: data size 42910418
Sun 19 Jan 2014 20:35:59 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:35:59 - XML: Start document: iteration 13
Sun 19 Jan 2014 20:36:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42910418
Sun 19 Jan 2014 20:36:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42910418
Sun 19 Jan 2014 20:36:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:36:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:36:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:36:08 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:36:09 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:36:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:36:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 20:36:09 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:36:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 20:36:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8971 values 141564 bits 17695 bytes 
Sun 19 Jan 2014 20:36:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:36:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:36:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:36:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:36:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:36:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:36:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:36:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:36:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:36:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:36:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:36:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:36:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:36:19 - XML: Processed 645173 elements - found 0 jobs
Sun 19 Jan 2014 20:36:19 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:36:19 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:36:19 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:36:19 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:36:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:36:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:36:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:36:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:36:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:36:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:36:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:36:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:36:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:36:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43001590
Sun 19 Jan 2014 20:36:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:36:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43001590
Sun 19 Jan 2014 20:36:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:36:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:36:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:36:35 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:36:35 - job_xml_thread(): Done retrieving: data size 43001590
Sun 19 Jan 2014 20:36:35 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:36:35 - XML: Start document: iteration 14
Sun 19 Jan 2014 20:36:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:36:36 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:36:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:36:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:36:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:36:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:36:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:36:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:36:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:36:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:36:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:36:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:36:49 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:36:49 - XML: Processed 646004 elements - found 0 jobs
Sun 19 Jan 2014 20:36:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:36:49 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:36:49 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:36:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:36:49 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:36:49 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:36:49 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:36:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 20:36:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:36:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:36:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:36:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:36:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:36:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:36:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43499727
Sun 19 Jan 2014 20:36:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:36:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43499727
Sun 19 Jan 2014 20:36:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:36:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:36:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:37:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:37:03 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:37:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:37:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:37:04 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:37:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:37:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:37:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:37:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:37:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:37:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:37:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:37:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:37:07 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:37:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:37:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:37:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:37:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:37:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:37:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:37:07 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 20:37:07 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 20:37:07 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:37:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:37:08 - job_xml_thread(): Done retrieving: data size 43602258
Sun 19 Jan 2014 20:37:08 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:37:08 - XML: Start document: iteration 15
Sun 19 Jan 2014 20:37:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43602258
Sun 19 Jan 2014 20:37:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43602258
Sun 19 Jan 2014 20:37:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:37:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:37:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:37:10 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:37:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:37:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 20:37:12 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:37:12 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:37:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 20:37:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5684 values 89620 bits 11202 bytes 
Sun 19 Jan 2014 20:37:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:37:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:37:22 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:37:22 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:37:22 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:37:22 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:37:22 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:37:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:37:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:37:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:37:25 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:37:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:37:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:37:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:37:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:37:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:37:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:37:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:37:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:37:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:37:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:37:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:37:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:37:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:37:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:37:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:37:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:37:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571293
Sun 19 Jan 2014 20:37:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:37:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571293
Sun 19 Jan 2014 20:37:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:37:37 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:37:37 - job_xml_thread(): Done retrieving: data size 43571293
Sun 19 Jan 2014 20:37:37 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:37:37 - XML: Start document: iteration 16
Sun 19 Jan 2014 20:37:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:37:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:37:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:37:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:37:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:37:46 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:37:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:37:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:37:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:37:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:37:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:37:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:37:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:37:51 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:37:51 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:37:51 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:37:51 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:37:51 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:37:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:37:55 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:37:55 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:37:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 20:37:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:37:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:37:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:37:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:37:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:37:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:37:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:37:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:37:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557989
Sun 19 Jan 2014 20:37:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:37:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557989
Sun 19 Jan 2014 20:37:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:38:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:38:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:38:06 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:38:06 - job_xml_thread(): Done retrieving: data size 43557989
Sun 19 Jan 2014 20:38:06 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:38:06 - XML: Start document: iteration 17
Sun 19 Jan 2014 20:38:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:38:06 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:38:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:38:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:38:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:38:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:38:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:38:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:38:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:38:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:38:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:38:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:38:13 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:38:13 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:38:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:38:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 20:38:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 20:38:14 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:38:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5762 values 90912 bits 11364 bytes 
Sun 19 Jan 2014 20:38:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:38:16 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:38:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:38:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:38:17 - XML: Processed 653351 elements - found 0 jobs
Sun 19 Jan 2014 20:38:17 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:38:17 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:38:17 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:38:17 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:38:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:38:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:38:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:38:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:38:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:38:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566324
Sun 19 Jan 2014 20:38:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:38:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566324
Sun 19 Jan 2014 20:38:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:38:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:38:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:38:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:38:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:38:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:38:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:38:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:38:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:38:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:38:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:38:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:38:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:38:32 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:38:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:38:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:38:34 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:38:34 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:38:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 20:38:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:38:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:38:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:38:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:38:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:38:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:38:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:38:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:38:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43603011
Sun 19 Jan 2014 20:38:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:38:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43603011
Sun 19 Jan 2014 20:38:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:38:37 - job_xml_thread(): Done retrieving: data size 43603011
Sun 19 Jan 2014 20:38:37 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:38:37 - XML: Start document: iteration 18
Sun 19 Jan 2014 20:38:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:38:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:38:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:38:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:38:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:38:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:38:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:38:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:38:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:38:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:38:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:38:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:38:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:38:52 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:38:52 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:38:52 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:38:52 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:38:52 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:38:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:38:57 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:38:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:38:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:38:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:38:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:38:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:38:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:38:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:38:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567352
Sun 19 Jan 2014 20:38:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:38:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567352
Sun 19 Jan 2014 20:38:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:39:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:39:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:39:06 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 20:39:06 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:39:07 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:39:07 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:39:07 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 20:39:07 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 20:39:07 - job_xml_thread(): Done retrieving: data size 43567352
Sun 19 Jan 2014 20:39:07 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:39:07 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:39:07 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 20:39:07 - XML: Start document: iteration 19
Sun 19 Jan 2014 20:39:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:39:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:39:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:39:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:39:12 - size of cluster 'LISA Cluster': 624 hosts 79465 metrics 771398 values 12168666 bits 1521083 bytes 
Sun 19 Jan 2014 20:39:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:39:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:39:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:39:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:39:13 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:39:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:39:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:39:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:39:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:39:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:39:14 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:39:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 20:39:14 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:39:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 20:39:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9172 values 144725 bits 18090 bytes 
Sun 19 Jan 2014 20:39:18 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:39:18 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:39:18 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:39:18 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:39:18 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:39:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:39:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:39:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:39:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:39:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:39:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:39:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:39:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:39:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:39:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564595
Sun 19 Jan 2014 20:39:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:39:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564595
Sun 19 Jan 2014 20:39:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:39:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:39:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:39:33 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:39:33 - job_xml_thread(): Done retrieving: data size 43564595
Sun 19 Jan 2014 20:39:33 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:39:33 - XML: Start document: iteration 20
Sun 19 Jan 2014 20:39:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:39:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:39:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:39:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:39:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:39:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:39:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:39:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:39:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:39:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:39:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:39:44 - XML: Processed 653351 elements - found 0 jobs
Sun 19 Jan 2014 20:39:44 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:39:44 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:39:44 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:39:44 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:39:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:39:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:39:50 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:39:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 20:39:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:39:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:39:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:39:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:39:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:39:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:39:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:39:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:39:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558733
Sun 19 Jan 2014 20:39:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:39:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:39:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558733
Sun 19 Jan 2014 20:39:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:39:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:39:59 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:39:59 - job_xml_thread(): Done retrieving: data size 43558733
Sun 19 Jan 2014 20:39:59 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:39:59 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 20:39:59 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 20:39:59 - Housekeeping: done.
Sun 19 Jan 2014 20:39:59 - XML: Start document: iteration 0
Sun 19 Jan 2014 20:40:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:40:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:40:07 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:40:08 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 20:40:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:40:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:40:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:40:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:40:11 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:40:11 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:40:11 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:40:11 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:40:11 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:40:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:40:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:40:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:40:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:40:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:40:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:40:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:40:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:40:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:40:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:40:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:40:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:40:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:40:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:40:14 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:40:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:40:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 20:40:15 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:40:15 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:40:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5751 values 90687 bits 11335 bytes 
Sun 19 Jan 2014 20:40:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 20:40:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:40:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576171
Sun 19 Jan 2014 20:40:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:40:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576171
Sun 19 Jan 2014 20:40:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:40:26 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:40:26 - job_xml_thread(): Done retrieving: data size 43576171
Sun 19 Jan 2014 20:40:26 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:40:27 - XML: Start document: iteration 1
Sun 19 Jan 2014 20:40:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:40:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:40:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:40:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:40:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:40:37 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:40:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:40:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:40:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:40:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:40:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:40:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:40:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:40:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:40:39 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:40:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:40:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:40:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:40:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:40:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:40:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:40:40 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:40:40 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:40:40 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:40:40 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:40:40 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:40:43 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:40:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 20:40:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:40:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:40:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564823
Sun 19 Jan 2014 20:40:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:40:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564823
Sun 19 Jan 2014 20:40:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:40:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:40:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:40:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:40:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:40:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:40:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:40:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:40:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:40:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:40:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:40:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:40:55 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:40:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:40:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:40:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:40:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:40:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:40:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:40:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:40:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:41:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:41:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569203
Sun 19 Jan 2014 20:41:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:41:00 - job_xml_thread(): Done retrieving: data size 43569203
Sun 19 Jan 2014 20:41:00 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:41:00 - XML: Start document: iteration 2
Sun 19 Jan 2014 20:41:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569203
Sun 19 Jan 2014 20:41:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:41:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:41:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:41:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:41:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:41:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:41:15 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:41:16 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:41:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 20:41:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:41:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 20:41:16 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:41:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:41:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7427 values 117157 bits 14644 bytes 
Sun 19 Jan 2014 20:41:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:41:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:41:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:41:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:41:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:41:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:41:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:41:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:41:20 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:41:20 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:41:20 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:41:20 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:41:20 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:41:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:41:25 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:41:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:41:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:41:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:41:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:41:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:41:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:41:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:41:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43487567
Sun 19 Jan 2014 20:41:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:41:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43487567
Sun 19 Jan 2014 20:41:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:41:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:41:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:41:35 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:41:35 - job_xml_thread(): Done retrieving: data size 43487567
Sun 19 Jan 2014 20:41:35 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:41:35 - XML: Start document: iteration 3
Sun 19 Jan 2014 20:41:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:41:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:41:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:41:43 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:41:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:41:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:41:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:41:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:41:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:41:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:41:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:41:51 - XML: Processed 652602 elements - found 0 jobs
Sun 19 Jan 2014 20:41:51 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:41:51 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:41:51 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:41:51 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:41:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:41:53 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:41:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:41:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:41:53 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:41:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 20:41:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:41:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:41:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:41:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:41:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:41:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:41:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42946570
Sun 19 Jan 2014 20:41:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:41:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42946570
Sun 19 Jan 2014 20:41:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:41:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:41:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:42:06 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:42:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:42:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:42:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:42:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:42:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:42:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:42:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:42:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:42:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:42:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:42:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:42:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:42:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:42:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:42:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:42:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:42:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:42:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:42:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:42:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:42:13 - job_xml_thread(): Done retrieving: data size 42963483
Sun 19 Jan 2014 20:42:13 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:42:13 - XML: Start document: iteration 4
Sun 19 Jan 2014 20:42:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42963483
Sun 19 Jan 2014 20:42:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:42:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42963483
Sun 19 Jan 2014 20:42:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:42:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:42:17 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:42:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:42:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 20:42:18 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:42:18 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:42:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 20:42:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5834 values 92011 bits 11501 bytes 
Sun 19 Jan 2014 20:42:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:42:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:42:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:42:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:42:30 - XML: Processed 645752 elements - found 0 jobs
Sun 19 Jan 2014 20:42:30 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:42:30 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:42:30 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:42:30 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:42:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:42:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:42:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:42:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:42:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:42:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:42:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:42:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:42:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:42:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:42:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:42:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:42:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:42:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:42:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:42:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:42:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:42:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:42:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43377466
Sun 19 Jan 2014 20:42:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:42:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43377466
Sun 19 Jan 2014 20:42:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:42:45 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:42:45 - job_xml_thread(): Done retrieving: data size 43377466
Sun 19 Jan 2014 20:42:45 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:42:45 - XML: Start document: iteration 5
Sun 19 Jan 2014 20:42:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:42:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:42:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:42:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:42:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:42:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:42:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:42:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:42:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:42:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:42:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:42:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:42:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:43:04 - XML: Processed 651132 elements - found 0 jobs
Sun 19 Jan 2014 20:43:04 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:43:04 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:43:04 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:43:04 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:43:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:43:07 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:43:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:43:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:43:07 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:43:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 20:43:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:43:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:43:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:43:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:43:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:43:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:43:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558388
Sun 19 Jan 2014 20:43:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:43:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558388
Sun 19 Jan 2014 20:43:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:43:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:43:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:43:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:43:19 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:43:19 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:43:19 - job_xml_thread(): Done retrieving: data size 43558388
Sun 19 Jan 2014 20:43:19 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:43:19 - XML: Start document: iteration 6
Sun 19 Jan 2014 20:43:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:43:19 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:43:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 20:43:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 20:43:19 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:43:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5813 values 91693 bits 11461 bytes 
Sun 19 Jan 2014 20:43:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:43:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:43:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:43:25 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:43:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:43:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:43:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:43:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:43:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:43:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:43:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:43:28 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:43:28 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:43:28 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:43:28 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:43:28 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:43:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:43:31 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:43:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:43:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:43:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:43:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:43:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:43:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:43:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:43:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567961
Sun 19 Jan 2014 20:43:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:43:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567961
Sun 19 Jan 2014 20:43:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:43:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:43:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:43:43 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:43:43 - job_xml_thread(): Done retrieving: data size 43567961
Sun 19 Jan 2014 20:43:43 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:43:43 - XML: Start document: iteration 7
Sun 19 Jan 2014 20:43:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:43:46 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:43:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:43:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:43:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:43:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:43:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:43:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:43:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:43:47 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:43:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 20:43:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:43:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:43:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:43:52 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:43:52 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:43:52 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:43:52 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:43:52 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:43:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:43:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:43:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:43:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:43:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:43:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:43:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:43:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:44:00 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 20:44:00 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 20:44:00 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:44:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:44:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43543102
Sun 19 Jan 2014 20:44:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:44:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43543102
Sun 19 Jan 2014 20:44:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:44:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:44:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:44:07 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:44:07 - job_xml_thread(): Done retrieving: data size 43543102
Sun 19 Jan 2014 20:44:08 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:44:08 - XML: Start document: iteration 8
Sun 19 Jan 2014 20:44:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:44:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:44:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:44:15 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:44:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:44:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:44:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:44:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:44:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:44:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:44:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:44:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:44:19 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:44:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:44:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 20:44:20 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:44:20 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:44:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6127 values 96668 bits 12083 bytes 
Sun 19 Jan 2014 20:44:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 20:44:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:44:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:44:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:44:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:44:22 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:44:22 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:44:22 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:44:22 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:44:22 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:44:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:44:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:44:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:44:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:44:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:44:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581654
Sun 19 Jan 2014 20:44:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:44:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581654
Sun 19 Jan 2014 20:44:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:44:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:44:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:44:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:44:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:44:37 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:44:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:44:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:44:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:44:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:44:37 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:44:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:44:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:44:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:44:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:44:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:44:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:44:38 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:44:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 20:44:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:44:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:44:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:44:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:44:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:44:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:44:39 - job_xml_thread(): Done retrieving: data size 43590519
Sun 19 Jan 2014 20:44:39 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:44:39 - XML: Start document: iteration 9
Sun 19 Jan 2014 20:44:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43590519
Sun 19 Jan 2014 20:44:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:44:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43590519
Sun 19 Jan 2014 20:44:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:44:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:44:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:44:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:44:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:44:55 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:44:55 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:44:55 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:44:55 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:44:55 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:44:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:44:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:44:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:44:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:44:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:44:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:44:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:44:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:44:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:45:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:45:00 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:45:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:45:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:45:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:45:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:45:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:45:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:45:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:45:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43588770
Sun 19 Jan 2014 20:45:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:45:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43588770
Sun 19 Jan 2014 20:45:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:45:10 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:45:10 - job_xml_thread(): Done retrieving: data size 43588770
Sun 19 Jan 2014 20:45:10 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:45:10 - XML: Start document: iteration 10
Sun 19 Jan 2014 20:45:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:45:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:45:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:45:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:45:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:45:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:45:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:45:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:45:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:45:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:45:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:45:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:45:20 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:45:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:45:20 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:45:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:45:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:45:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:45:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 20:45:21 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:45:21 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:45:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 20:45:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8717 values 137434 bits 17179 bytes 
Sun 19 Jan 2014 20:45:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:45:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:45:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:45:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:45:24 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:45:24 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:45:24 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:45:24 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:45:24 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:45:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:45:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43548308
Sun 19 Jan 2014 20:45:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:45:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43548308
Sun 19 Jan 2014 20:45:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:45:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:45:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:45:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:45:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:45:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:45:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:45:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:45:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:45:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:45:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:45:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:45:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:45:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:45:39 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:45:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:45:40 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:45:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:45:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:45:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:45:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:45:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:45:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:45:40 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:45:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 20:45:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:45:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:45:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571257
Sun 19 Jan 2014 20:45:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:45:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571257
Sun 19 Jan 2014 20:45:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:45:42 - job_xml_thread(): Done retrieving: data size 43571257
Sun 19 Jan 2014 20:45:42 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:45:42 - XML: Start document: iteration 11
Sun 19 Jan 2014 20:45:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:45:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:45:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:45:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:45:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:45:58 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:45:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:45:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:46:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:46:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:46:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:46:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:46:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:46:04 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:46:04 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:46:04 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:46:04 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:46:04 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:46:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:46:05 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:46:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:46:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:46:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:46:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:46:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:46:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:46:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:46:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43594489
Sun 19 Jan 2014 20:46:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:46:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43594489
Sun 19 Jan 2014 20:46:08 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 20:46:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:46:08 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:46:09 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:46:09 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 20:46:09 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 20:46:10 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:46:10 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 20:46:16 - size of cluster 'LISA Cluster': 624 hosts 79462 metrics 756513 values 11930881 bits 1491360 bytes 
Sun 19 Jan 2014 20:46:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:46:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:46:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:46:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:46:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:46:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:46:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:46:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:46:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:46:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:46:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:46:19 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:46:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:46:20 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:46:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:46:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:46:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:46:21 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:46:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:46:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:46:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:46:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:46:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:46:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 20:46:21 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:46:21 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:46:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 20:46:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8796 values 138828 bits 17353 bytes 
Sun 19 Jan 2014 20:46:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:46:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43593140
Sun 19 Jan 2014 20:46:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:46:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43593140
Sun 19 Jan 2014 20:46:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:46:24 - job_xml_thread(): Done retrieving: data size 43593140
Sun 19 Jan 2014 20:46:24 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:46:24 - XML: Start document: iteration 12
Sun 19 Jan 2014 20:46:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:46:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:46:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:46:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:46:37 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:46:37 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:46:37 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:46:37 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:46:37 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:46:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:46:39 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:46:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:46:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:46:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:46:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:46:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:46:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:46:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:46:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:46:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:46:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:46:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:46:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:46:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:46:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:46:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:46:46 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:46:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 20:46:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:46:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:46:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577225
Sun 19 Jan 2014 20:46:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:46:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577225
Sun 19 Jan 2014 20:46:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:46:52 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:46:52 - job_xml_thread(): Done retrieving: data size 43577225
Sun 19 Jan 2014 20:46:53 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:46:54 - XML: Start document: iteration 13
Sun 19 Jan 2014 20:46:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:46:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:47:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:47:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:47:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:47:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:47:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:47:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:47:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:47:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:47:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:47:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:47:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:47:08 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:47:08 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:47:08 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:47:08 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:47:08 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:47:10 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:47:10 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 20:47:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:47:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:47:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:47:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:47:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:47:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:47:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:47:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:47:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:47:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43494845
Sun 19 Jan 2014 20:47:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:47:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43494845
Sun 19 Jan 2014 20:47:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:47:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:47:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:47:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:47:21 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:47:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:47:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 20:47:22 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:47:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8004 values 126561 bits 15820 bytes 
Sun 19 Jan 2014 20:47:22 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:47:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 20:47:23 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:47:23 - job_xml_thread(): Done retrieving: data size 43494845
Sun 19 Jan 2014 20:47:23 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:47:23 - XML: Start document: iteration 14
Sun 19 Jan 2014 20:47:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:47:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:47:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:47:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:47:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:47:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:47:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:47:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:47:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:47:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:47:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:47:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:47:35 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:47:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:47:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:47:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:47:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:47:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:47:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:47:36 - XML: Processed 652602 elements - found 0 jobs
Sun 19 Jan 2014 20:47:36 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:47:36 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:47:36 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:47:36 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:47:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:47:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42993733
Sun 19 Jan 2014 20:47:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:47:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42993733
Sun 19 Jan 2014 20:47:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:47:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:47:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:47:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:47:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:47:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:47:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:47:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:47:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:47:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42993733
Sun 19 Jan 2014 20:47:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:47:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:47:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:47:52 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:47:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:48:01 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:48:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 20:48:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:48:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:48:01 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:48:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:48:03 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:48:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:48:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:48:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:48:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:48:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:48:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:48:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:48:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:48:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:48:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:48:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:48:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:48:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:48:06 - job_xml_thread(): Done retrieving: data size 42900160
Sun 19 Jan 2014 20:48:06 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:48:06 - XML: Start document: iteration 15
Sun 19 Jan 2014 20:48:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42900160
Sun 19 Jan 2014 20:48:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:48:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42900160
Sun 19 Jan 2014 20:48:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:48:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:48:20 - XML: Processed 645162 elements - found 0 jobs
Sun 19 Jan 2014 20:48:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:48:20 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:48:20 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:48:20 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:48:20 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:48:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:48:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:48:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:48:22 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:48:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:48:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:48:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:48:22 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:48:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:48:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:48:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:48:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:48:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:48:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:48:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 20:48:23 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:48:23 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:48:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 20:48:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5952 values 94192 bits 11774 bytes 
Sun 19 Jan 2014 20:48:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:48:27 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:48:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:48:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:48:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:48:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:48:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:48:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:48:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:48:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42970744
Sun 19 Jan 2014 20:48:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:48:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42970744
Sun 19 Jan 2014 20:48:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:48:35 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:48:35 - job_xml_thread(): Done retrieving: data size 42970744
Sun 19 Jan 2014 20:48:35 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:48:35 - XML: Start document: iteration 16
Sun 19 Jan 2014 20:48:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:48:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:48:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:48:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:48:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:48:47 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:48:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:48:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:48:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:48:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:48:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:48:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:48:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:48:51 - XML: Processed 645914 elements - found 0 jobs
Sun 19 Jan 2014 20:48:51 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:48:51 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:48:51 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:48:51 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:48:53 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:48:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 20:48:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:48:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:48:55 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:48:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:48:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:48:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:48:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:48:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:48:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:48:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:48:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43542450
Sun 19 Jan 2014 20:48:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:49:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43542450
Sun 19 Jan 2014 20:49:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:49:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:49:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:49:07 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:49:07 - job_xml_thread(): Done retrieving: data size 43542450
Sun 19 Jan 2014 20:49:07 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:49:07 - XML: Start document: iteration 17
Sun 19 Jan 2014 20:49:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:49:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:49:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:49:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:49:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:49:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:49:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:49:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:49:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:49:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:49:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:49:19 - XML: Processed 653294 elements - found 0 jobs
Sun 19 Jan 2014 20:49:19 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:49:19 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:49:19 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:49:19 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:49:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:49:21 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:49:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:49:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:49:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:49:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:49:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:49:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:49:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:49:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556580
Sun 19 Jan 2014 20:49:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:49:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556580
Sun 19 Jan 2014 20:49:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:49:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:49:24 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:49:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:49:24 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:49:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 20:49:24 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:49:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 20:49:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9035 values 142587 bits 17823 bytes 
Sun 19 Jan 2014 20:49:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:49:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:49:34 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:49:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:49:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:49:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:49:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:49:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:49:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:49:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:49:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:49:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:49:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:49:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:49:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:49:40 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:49:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:49:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:49:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:49:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:49:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:49:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:49:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:49:44 - job_xml_thread(): Done retrieving: data size 43556021
Sun 19 Jan 2014 20:49:44 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:49:44 - XML: Start document: iteration 18
Sun 19 Jan 2014 20:49:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556021
Sun 19 Jan 2014 20:49:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556021
Sun 19 Jan 2014 20:49:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:49:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:49:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:49:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:49:55 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:49:55 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:49:55 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:49:55 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:49:55 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:49:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:49:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:50:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:50:06 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:50:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:50:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:50:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:50:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:50:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:50:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:50:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:50:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:50:07 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:50:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:50:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:50:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:50:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:50:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:50:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:50:08 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:50:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 20:50:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:50:10 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:50:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:50:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576272
Sun 19 Jan 2014 20:50:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:50:11 - job_xml_thread(): Done retrieving: data size 43576272
Sun 19 Jan 2014 20:50:11 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:50:11 - XML: Start document: iteration 19
Sun 19 Jan 2014 20:50:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576272
Sun 19 Jan 2014 20:50:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:50:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:50:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:50:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:50:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:50:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:50:25 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:50:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:50:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 20:50:25 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:50:25 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:50:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 20:50:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5644 values 88984 bits 11123 bytes 
Sun 19 Jan 2014 20:50:26 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:50:26 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:50:26 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:50:26 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:50:26 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:50:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:50:30 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:50:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:50:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:50:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:50:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:50:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:50:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:50:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:50:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:50:32 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:50:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:50:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:50:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:50:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:50:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:50:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:50:35 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 20:50:35 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 20:50:35 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:50:37 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:50:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 20:50:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:50:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:50:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43595362
Sun 19 Jan 2014 20:50:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:50:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43595362
Sun 19 Jan 2014 20:50:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:50:41 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:50:41 - job_xml_thread(): Done retrieving: data size 43595362
Sun 19 Jan 2014 20:50:41 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:50:41 - XML: Start document: iteration 20
Sun 19 Jan 2014 20:50:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:50:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:50:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:50:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:50:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:50:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:50:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:50:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:50:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:50:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:50:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:50:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:50:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:50:59 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:50:59 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:50:59 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:50:59 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:50:59 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:51:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:51:00 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:51:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:51:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:51:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:51:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:51:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:51:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:51:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:51:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571567
Sun 19 Jan 2014 20:51:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:51:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571567
Sun 19 Jan 2014 20:51:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:51:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:51:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:51:14 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:51:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:51:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:51:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:51:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:51:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:51:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:51:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:51:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:51:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:51:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:51:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:51:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:51:17 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:51:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:51:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:51:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:51:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:51:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:51:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:51:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:51:19 - job_xml_thread(): Done retrieving: data size 43598850
Sun 19 Jan 2014 20:51:19 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:51:19 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 20:51:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43598850
Sun 19 Jan 2014 20:51:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:51:20 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 20:51:20 - Housekeeping: done.
Sun 19 Jan 2014 20:51:20 - XML: Start document: iteration 0
Sun 19 Jan 2014 20:51:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43598850
Sun 19 Jan 2014 20:51:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:51:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:51:26 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:51:26 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:51:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 20:51:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:51:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 20:51:27 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:51:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148641 bits 18580 bytes 
Sun 19 Jan 2014 20:51:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:51:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:51:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:51:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:51:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:51:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:51:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:51:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:51:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:51:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:51:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:51:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:51:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:51:40 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:51:40 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:51:40 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:51:40 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:51:40 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:51:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:51:42 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:51:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:51:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:51:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:51:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:51:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:51:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:51:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:51:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563434
Sun 19 Jan 2014 20:51:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:51:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563434
Sun 19 Jan 2014 20:51:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:51:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:51:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:51:50 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:51:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 20:51:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:51:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:51:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:51:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:51:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:51:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:51:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:51:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:51:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563434
Sun 19 Jan 2014 20:51:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:51:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:51:56 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:51:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:51:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:51:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:52:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:52:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:52:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:52:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:52:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:52:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:52:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:52:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:52:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:52:04 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:52:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:52:06 - job_xml_thread(): Done retrieving: data size 43564667
Sun 19 Jan 2014 20:52:06 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:52:06 - XML: Start document: iteration 1
Sun 19 Jan 2014 20:52:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564667
Sun 19 Jan 2014 20:52:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:52:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:52:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:52:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:52:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:52:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:52:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:52:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564667
Sun 19 Jan 2014 20:52:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:52:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:52:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:52:21 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:52:21 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:52:21 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:52:21 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:52:21 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:52:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:52:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:52:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:52:27 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:52:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:52:27 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:52:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:52:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:52:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:52:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:52:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:52:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:52:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:52:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 20:52:28 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:52:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 20:52:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:52:28 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:52:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99057 bits 12382 bytes 
Sun 19 Jan 2014 20:52:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:52:29 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:52:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:52:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:52:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:52:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:52:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:52:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:52:31 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:52:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 20:52:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:52:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:52:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43596512
Sun 19 Jan 2014 20:52:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:52:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43596512
Sun 19 Jan 2014 20:52:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:52:36 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:52:36 - job_xml_thread(): Done retrieving: data size 43596512
Sun 19 Jan 2014 20:52:36 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:52:36 - XML: Start document: iteration 2
Sun 19 Jan 2014 20:52:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:52:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:52:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:52:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:52:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:52:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:52:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:52:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:52:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:52:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:52:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:52:52 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:52:52 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:52:52 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:52:52 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:52:52 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:52:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:52:53 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:52:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:52:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:52:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:52:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:52:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:52:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:52:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:52:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43547596
Sun 19 Jan 2014 20:52:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:52:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43547596
Sun 19 Jan 2014 20:52:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:52:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:52:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:53:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:53:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:53:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:53:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:53:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:53:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:53:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:53:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:53:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:53:07 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:53:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:53:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:53:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:53:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:53:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:53:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:53:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:53:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:53:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:53:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:53:10 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 20:53:10 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:53:10 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:53:10 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:53:10 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 20:53:10 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 20:53:10 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 20:53:11 - size of cluster 'LISA Cluster': 624 hosts 79472 metrics 780525 values 12316001 bits 1539500 bytes 
Sun 19 Jan 2014 20:53:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:53:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43506007
Sun 19 Jan 2014 20:53:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:53:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43506007
Sun 19 Jan 2014 20:53:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:53:12 - job_xml_thread(): Done retrieving: data size 43506007
Sun 19 Jan 2014 20:53:12 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:53:12 - XML: Start document: iteration 3
Sun 19 Jan 2014 20:53:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:53:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:53:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:53:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:53:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:53:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:53:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:53:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:53:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:53:28 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:53:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:53:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:53:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:53:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:53:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:53:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:53:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 20:53:30 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:53:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 20:53:30 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:53:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148612 bits 18576 bytes 
Sun 19 Jan 2014 20:53:33 - XML: Processed 652602 elements - found 0 jobs
Sun 19 Jan 2014 20:53:33 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:53:33 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:53:33 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:53:33 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:53:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:53:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:53:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:53:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:53:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:53:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:53:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:53:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:53:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:53:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43051284
Sun 19 Jan 2014 20:53:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:53:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43051284
Sun 19 Jan 2014 20:53:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:53:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:53:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:53:48 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:53:48 - job_xml_thread(): Done retrieving: data size 43051284
Sun 19 Jan 2014 20:53:48 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:53:48 - XML: Start document: iteration 4
Sun 19 Jan 2014 20:53:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:53:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:53:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:53:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:53:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:53:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:53:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:53:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:53:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:53:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:53:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:54:03 - XML: Processed 647108 elements - found 0 jobs
Sun 19 Jan 2014 20:54:03 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:54:03 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:54:03 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:54:03 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:54:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:54:04 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:54:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:54:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:54:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:54:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:54:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:54:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:54:05 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:54:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 20:54:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:54:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:54:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42920502
Sun 19 Jan 2014 20:54:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:54:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42920502
Sun 19 Jan 2014 20:54:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:54:10 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:54:10 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 20:54:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:54:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:54:18 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:54:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:54:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:54:18 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:54:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:54:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:54:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:54:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:54:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:54:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:54:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:54:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:54:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:54:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:54:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:54:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:54:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:54:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:54:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:54:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:54:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:54:25 - job_xml_thread(): Done retrieving: data size 42966717
Sun 19 Jan 2014 20:54:25 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:54:25 - XML: Start document: iteration 5
Sun 19 Jan 2014 20:54:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42966717
Sun 19 Jan 2014 20:54:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:54:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42966717
Sun 19 Jan 2014 20:54:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:54:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:54:30 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:54:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:54:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 20:54:31 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:54:31 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:54:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 20:54:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8632 values 136088 bits 17011 bytes 
Sun 19 Jan 2014 20:54:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:54:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:54:36 - XML: Processed 645914 elements - found 0 jobs
Sun 19 Jan 2014 20:54:36 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:54:36 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:54:36 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:54:36 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:54:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:54:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:54:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:54:45 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:54:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:54:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:54:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:54:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:54:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:54:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:54:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:54:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:54:47 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:54:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:54:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:54:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:54:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:54:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:54:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:54:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:54:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43525908
Sun 19 Jan 2014 20:54:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:54:51 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:54:51 - job_xml_thread(): Done retrieving: data size 43525908
Sun 19 Jan 2014 20:54:51 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:54:51 - XML: Start document: iteration 6
Sun 19 Jan 2014 20:54:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43525908
Sun 19 Jan 2014 20:54:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:55:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:55:01 - XML: Processed 652490 elements - found 0 jobs
Sun 19 Jan 2014 20:55:01 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:55:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:55:01 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:55:01 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:55:01 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:55:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:55:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:55:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:55:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:55:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:55:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:55:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:55:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:55:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:55:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:55:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:55:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:55:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:55:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:55:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:55:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:55:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:55:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:55:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:55:11 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:55:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 20:55:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:55:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:55:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570531
Sun 19 Jan 2014 20:55:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:55:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570531
Sun 19 Jan 2014 20:55:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:55:16 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:55:16 - job_xml_thread(): Done retrieving: data size 43570531
Sun 19 Jan 2014 20:55:16 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:55:16 - XML: Start document: iteration 7
Sun 19 Jan 2014 20:55:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:55:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:55:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:55:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:55:30 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:55:30 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:55:30 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:55:30 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:55:30 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:55:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:55:31 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:55:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:55:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 20:55:32 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:55:32 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:55:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 20:55:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5818 values 91736 bits 11467 bytes 
Sun 19 Jan 2014 20:55:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:55:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:55:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:55:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:55:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:55:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:55:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:55:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:55:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:55:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:55:39 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:55:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:55:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:55:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:55:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:55:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:55:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:55:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:55:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555829
Sun 19 Jan 2014 20:55:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:55:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555829
Sun 19 Jan 2014 20:55:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:55:45 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:55:45 - job_xml_thread(): Done retrieving: data size 43555829
Sun 19 Jan 2014 20:55:45 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:55:45 - XML: Start document: iteration 8
Sun 19 Jan 2014 20:55:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:55:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:55:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:55:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:55:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:55:59 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:55:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:55:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:56:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:56:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:56:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:56:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:56:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:56:01 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:56:01 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:56:01 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:56:01 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:56:01 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:56:03 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:56:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 20:56:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:56:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:56:06 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:56:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:56:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:56:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:56:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:56:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:56:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:56:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:56:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572380
Sun 19 Jan 2014 20:56:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:56:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572380
Sun 19 Jan 2014 20:56:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:56:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:56:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:56:16 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:56:16 - job_xml_thread(): Done retrieving: data size 43572380
Sun 19 Jan 2014 20:56:16 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:56:16 - XML: Start document: iteration 9
Sun 19 Jan 2014 20:56:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:56:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:56:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:56:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:56:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:56:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:56:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:56:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:56:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:56:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:56:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:56:30 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:56:30 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:56:30 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:56:30 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:56:30 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:56:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:56:32 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:56:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:56:32 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:56:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:56:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:56:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:56:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:56:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:56:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:56:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:56:32 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:56:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 20:56:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 20:56:32 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:56:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5882 values 92762 bits 11595 bytes 
Sun 19 Jan 2014 20:56:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:56:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570580
Sun 19 Jan 2014 20:56:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:56:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570580
Sun 19 Jan 2014 20:56:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:56:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:56:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:56:46 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:56:46 - job_xml_thread(): Done retrieving: data size 43570580
Sun 19 Jan 2014 20:56:46 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:56:46 - XML: Start document: iteration 10
Sun 19 Jan 2014 20:56:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:56:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:56:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:56:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:56:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:56:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:56:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:56:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:56:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:56:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:56:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:56:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:56:57 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:56:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:56:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:56:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:56:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:56:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:56:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:57:00 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:57:00 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:57:00 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:57:00 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:57:00 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:57:00 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:57:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 20:57:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:57:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:57:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577178
Sun 19 Jan 2014 20:57:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:57:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577178
Sun 19 Jan 2014 20:57:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:57:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:57:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:57:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:57:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:57:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:57:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:57:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:57:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:57:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:57:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:57:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:57:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:57:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:57:15 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:57:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:57:17 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:57:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:57:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:57:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:57:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:57:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:57:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:57:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:57:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43593113
Sun 19 Jan 2014 20:57:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:57:21 - job_xml_thread(): Done retrieving: data size 43593113
Sun 19 Jan 2014 20:57:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43593113
Sun 19 Jan 2014 20:57:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:57:22 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:57:22 - XML: Start document: iteration 11
Sun 19 Jan 2014 20:57:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:57:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:57:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:57:33 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:57:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:57:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:57:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:57:33 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:57:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 20:57:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 20:57:33 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:57:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:57:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:57:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8552 values 134850 bits 16856 bytes 
Sun 19 Jan 2014 20:57:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:57:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:57:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:57:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:57:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:57:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:57:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:57:40 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:57:40 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:57:40 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:57:40 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:57:40 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:57:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:57:42 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:57:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:57:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:57:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:57:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:57:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:57:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:57:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:57:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567974
Sun 19 Jan 2014 20:57:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:57:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567974
Sun 19 Jan 2014 20:57:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:57:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:57:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:57:56 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:57:56 - job_xml_thread(): Done retrieving: data size 43567974
Sun 19 Jan 2014 20:57:56 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:57:56 - XML: Start document: iteration 12
Sun 19 Jan 2014 20:57:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:57:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:58:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:58:00 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:58:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:58:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:58:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:58:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:58:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:58:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:58:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:58:07 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 20:58:07 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 20:58:07 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:58:09 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:58:09 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:58:09 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:58:09 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:58:09 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:58:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:58:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:58:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:58:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:58:10 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:58:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 20:58:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:58:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:58:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:58:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:58:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:58:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:58:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563900
Sun 19 Jan 2014 20:58:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:58:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563900
Sun 19 Jan 2014 20:58:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:58:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:58:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:58:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:58:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:58:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:58:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:58:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:58:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:58:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:58:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:58:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:58:24 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:58:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:58:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:58:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:58:26 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:58:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:58:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:58:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:58:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:58:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:58:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:58:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:58:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43586180
Sun 19 Jan 2014 20:58:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:58:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43586180
Sun 19 Jan 2014 20:58:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:58:28 - job_xml_thread(): Done retrieving: data size 43586180
Sun 19 Jan 2014 20:58:28 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:58:28 - XML: Start document: iteration 13
Sun 19 Jan 2014 20:58:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:58:33 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:58:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:58:34 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:58:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 20:58:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 20:58:35 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:58:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:58:36 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:58:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8745 values 137895 bits 17236 bytes 
Sun 19 Jan 2014 20:58:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:58:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:58:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:58:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:58:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:58:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:58:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:58:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:58:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:58:48 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 20:58:48 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:58:48 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:58:48 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:58:48 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:58:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:58:49 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:58:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:58:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:58:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:58:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:58:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:58:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:58:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:58:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573696
Sun 19 Jan 2014 20:58:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:58:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573696
Sun 19 Jan 2014 20:58:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:58:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:58:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:59:03 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:59:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:59:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:59:03 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:59:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:59:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:59:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:59:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:59:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:59:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:59:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:59:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:59:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:59:06 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:59:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:59:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:59:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:59:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:59:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:59:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:59:08 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:59:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 20:59:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:59:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:59:09 - job_xml_thread(): Done retrieving: data size 43565914
Sun 19 Jan 2014 20:59:09 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:59:09 - XML: Start document: iteration 14
Sun 19 Jan 2014 20:59:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565914
Sun 19 Jan 2014 20:59:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:59:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565914
Sun 19 Jan 2014 20:59:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:59:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:59:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:59:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:59:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 20:59:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:59:30 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:59:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 20:59:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:59:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:59:32 - XML: Processed 653244 elements - found 0 jobs
Sun 19 Jan 2014 20:59:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:59:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:59:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:59:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:59:33 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 20:59:33 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 20:59:33 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 20:59:33 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 20:59:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:59:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:59:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 20:59:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:59:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:59:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:59:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:59:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:59:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:59:34 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:59:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:59:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43016220
Sun 19 Jan 2014 20:59:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 20:59:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:59:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 20:59:35 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 20:59:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5101 values 80399 bits 10049 bytes 
Sun 19 Jan 2014 20:59:36 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:59:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 20:59:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43016220
Sun 19 Jan 2014 20:59:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:59:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 20:59:45 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 20:59:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 20:59:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 20:59:48 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 20:59:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 20:59:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 20:59:48 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 20:59:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 20:59:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 20:59:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:59:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 20:59:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 20:59:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 20:59:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:59:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 20:59:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 20:59:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 20:59:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 20:59:51 - job_xml_thread(): Done retrieving: data size 42932899
Sun 19 Jan 2014 20:59:51 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 20:59:51 - XML: Start document: iteration 15
Sun 19 Jan 2014 20:59:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42932899
Sun 19 Jan 2014 20:59:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 20:59:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42932899
Sun 19 Jan 2014 20:59:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:00:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:00:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:00:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:00:06 - XML: Processed 645286 elements - found 0 jobs
Sun 19 Jan 2014 21:00:06 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:00:06 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:00:06 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:00:06 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:00:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:00:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:00:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:00:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:00:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:00:10 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 21:00:10 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:00:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:00:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:00:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:00:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:00:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:00:11 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:00:11 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 21:00:11 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:00:11 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 21:00:11 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 21:00:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:00:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:00:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:00:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:00:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:00:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:00:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:00:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:00:14 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 845132 values 13327619 bits 1665952 bytes 
Sun 19 Jan 2014 21:00:16 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:00:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 21:00:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:00:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:00:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42976883
Sun 19 Jan 2014 21:00:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:00:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42976883
Sun 19 Jan 2014 21:00:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:00:21 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:00:21 - job_xml_thread(): Done retrieving: data size 42976883
Sun 19 Jan 2014 21:00:22 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:00:22 - XML: Start document: iteration 16
Sun 19 Jan 2014 21:00:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:00:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:00:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:00:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:00:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:00:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:00:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:00:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:00:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:00:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:00:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:00:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:00:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:00:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:00:36 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:00:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:00:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 21:00:36 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:00:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 21:00:36 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:00:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5582 values 87972 bits 10996 bytes 
Sun 19 Jan 2014 21:00:39 - XML: Processed 645902 elements - found 0 jobs
Sun 19 Jan 2014 21:00:39 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:00:39 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:00:39 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:00:39 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:00:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:00:41 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:00:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:00:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:00:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:00:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:00:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:00:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:00:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:00:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43475325
Sun 19 Jan 2014 21:00:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:00:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43475325
Sun 19 Jan 2014 21:00:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:00:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:00:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:00:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:00:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:00:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:00:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:00:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:00:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:00:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:00:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:00:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43475325
Sun 19 Jan 2014 21:00:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:00:54 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:00:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:00:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:00:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:01:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:01:01 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:01:02 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:01:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 21:01:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:01:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:01:06 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:01:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:01:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:01:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:01:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:01:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:01:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:01:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:01:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:01:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:01:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:01:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:01:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:01:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:01:10 - job_xml_thread(): Done retrieving: data size 43541588
Sun 19 Jan 2014 21:01:10 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:01:10 - XML: Start document: iteration 17
Sun 19 Jan 2014 21:01:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43541588
Sun 19 Jan 2014 21:01:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:01:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43541588
Sun 19 Jan 2014 21:01:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:01:12 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:01:12 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 21:01:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:01:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:01:22 - XML: Processed 653280 elements - found 0 jobs
Sun 19 Jan 2014 21:01:22 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:01:22 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:01:23 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:01:23 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:01:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:01:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:01:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:01:29 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:01:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:01:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:01:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:01:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:01:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:01:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:01:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:01:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:01:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:01:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:01:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:01:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:01:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:01:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:01:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:01:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:01:36 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:01:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:01:36 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:01:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 21:01:36 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:01:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6077 values 95870 bits 11983 bytes 
Sun 19 Jan 2014 21:01:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 21:01:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:01:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582891
Sun 19 Jan 2014 21:01:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:01:38 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:01:38 - job_xml_thread(): Done retrieving: data size 43582891
Sun 19 Jan 2014 21:01:38 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:01:38 - XML: Start document: iteration 18
Sun 19 Jan 2014 21:01:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582891
Sun 19 Jan 2014 21:01:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:01:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:01:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:01:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:01:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:01:52 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 21:01:52 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:01:52 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:01:52 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:01:52 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:01:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:01:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:01:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:01:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:01:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:01:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:01:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:01:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:01:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:02:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:02:00 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:02:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:02:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:02:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:02:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:02:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:02:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:02:05 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:02:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 21:02:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:02:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:02:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43588201
Sun 19 Jan 2014 21:02:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:02:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43588201
Sun 19 Jan 2014 21:02:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:02:07 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:02:07 - job_xml_thread(): Done retrieving: data size 43588201
Sun 19 Jan 2014 21:02:07 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:02:08 - XML: Start document: iteration 19
Sun 19 Jan 2014 21:02:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:02:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:02:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:02:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:02:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:02:19 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:02:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:02:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:02:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:02:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:02:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:02:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:02:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:02:24 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 21:02:24 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:02:24 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:02:24 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:02:24 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:02:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:02:29 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:02:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:02:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:02:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:02:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:02:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:02:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:02:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:02:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564159
Sun 19 Jan 2014 21:02:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:02:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564159
Sun 19 Jan 2014 21:02:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:02:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:02:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:02:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:02:36 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:02:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:02:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 21:02:38 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:02:38 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:02:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7081 values 112024 bits 14003 bytes 
Sun 19 Jan 2014 21:02:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 21:02:39 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:02:39 - job_xml_thread(): Done retrieving: data size 43564159
Sun 19 Jan 2014 21:02:39 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:02:39 - XML: Start document: iteration 20
Sun 19 Jan 2014 21:02:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:02:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:02:51 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 21:02:51 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:02:51 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:02:51 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:02:51 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:02:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:02:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:02:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:02:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:02:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:02:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:02:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:02:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:02:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:02:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:02:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:02:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:02:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:02:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:02:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:02:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:02:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:02:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:02:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574130
Sun 19 Jan 2014 21:02:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:03:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574130
Sun 19 Jan 2014 21:03:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:03:06 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:03:06 - job_xml_thread(): Done retrieving: data size 43574130
Sun 19 Jan 2014 21:03:06 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:03:06 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 21:03:06 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 21:03:06 - Housekeeping: done.
Sun 19 Jan 2014 21:03:06 - XML: Start document: iteration 0
Sun 19 Jan 2014 21:03:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:03:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:03:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:03:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:03:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:03:20 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:03:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:03:20 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:03:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:03:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:03:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:03:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:03:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:03:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:03:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:03:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:03:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:03:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:03:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:03:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:03:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:03:23 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 21:03:23 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:03:23 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:03:23 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:03:23 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:03:24 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:03:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 21:03:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:03:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:03:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566201
Sun 19 Jan 2014 21:03:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:03:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566201
Sun 19 Jan 2014 21:03:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:03:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:03:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:03:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:03:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:03:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:03:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:03:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:03:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:03:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:03:38 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:03:38 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:03:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:03:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:03:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 21:03:40 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:03:40 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:03:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5886 values 93030 bits 11628 bytes 
Sun 19 Jan 2014 21:03:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 21:03:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:03:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:03:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:03:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:03:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:03:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:03:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:03:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:03:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:03:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:03:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:03:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:03:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:03:46 - job_xml_thread(): Done retrieving: data size 43579620
Sun 19 Jan 2014 21:03:46 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:03:46 - XML: Start document: iteration 1
Sun 19 Jan 2014 21:03:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579620
Sun 19 Jan 2014 21:03:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579620
Sun 19 Jan 2014 21:03:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:03:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:03:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:03:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:03:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:03:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:03:57 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 21:03:57 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:03:57 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:03:57 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:03:57 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:04:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:04:07 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:04:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:04:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:04:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:04:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:04:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:04:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:04:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:04:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:04:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:04:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:04:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:04:09 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:04:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 21:04:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:04:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:04:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:04:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:04:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:04:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:04:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575933
Sun 19 Jan 2014 21:04:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:04:12 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:04:13 - job_xml_thread(): Done retrieving: data size 43575933
Sun 19 Jan 2014 21:04:13 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:04:13 - XML: Start document: iteration 2
Sun 19 Jan 2014 21:04:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575933
Sun 19 Jan 2014 21:04:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:04:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:04:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:04:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:04:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:04:31 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 21:04:31 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:04:31 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:04:31 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:04:31 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:04:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:04:31 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:04:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:04:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:04:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:04:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:04:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:04:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:04:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:04:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:04:35 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:04:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:04:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:04:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:04:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:04:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:04:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:04:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:04:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584241
Sun 19 Jan 2014 21:04:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:04:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584241
Sun 19 Jan 2014 21:04:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:04:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:04:40 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:04:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:04:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 21:04:41 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:04:41 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:04:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8718 values 137522 bits 17190 bytes 
Sun 19 Jan 2014 21:04:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 21:04:46 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:04:46 - job_xml_thread(): Done retrieving: data size 43584241
Sun 19 Jan 2014 21:04:46 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:04:46 - XML: Start document: iteration 3
Sun 19 Jan 2014 21:04:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:04:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:04:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:04:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:04:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:04:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:04:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:04:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:04:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:04:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:04:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:04:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:04:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:05:01 - XML: Processed 653351 elements - found 0 jobs
Sun 19 Jan 2014 21:05:01 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:05:01 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:05:01 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:05:01 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:05:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:05:03 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:05:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:05:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:05:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:05:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:05:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:05:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:05:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:05:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:05:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:05:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562018
Sun 19 Jan 2014 21:05:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:05:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562018
Sun 19 Jan 2014 21:05:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:05:13 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:05:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 21:05:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:05:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:05:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:05:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:05:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:05:16 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:05:16 - job_xml_thread(): Done retrieving: data size 43562018
Sun 19 Jan 2014 21:05:16 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:05:16 - XML: Start document: iteration 4
Sun 19 Jan 2014 21:05:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:05:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:05:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:05:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:05:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:05:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:05:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:05:26 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 21:05:26 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:05:26 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:05:26 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:05:26 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:05:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:05:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:05:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:05:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:05:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:05:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:05:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:05:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:05:31 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 21:05:31 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 21:05:31 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:05:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:05:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43487513
Sun 19 Jan 2014 21:05:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:05:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:05:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:05:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43487513
Sun 19 Jan 2014 21:05:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:05:41 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:05:41 - job_xml_thread(): Done retrieving: data size 43487513
Sun 19 Jan 2014 21:05:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:05:41 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:05:41 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:05:41 - XML: Start document: iteration 5
Sun 19 Jan 2014 21:05:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:05:42 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:05:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 21:05:42 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:05:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6231 values 98331 bits 12291 bytes 
Sun 19 Jan 2014 21:05:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 21:05:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:05:44 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:05:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:05:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:05:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:05:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:05:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:05:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:05:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:05:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:05:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:05:52 - XML: Processed 652602 elements - found 0 jobs
Sun 19 Jan 2014 21:05:52 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:05:52 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:05:52 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:05:52 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:05:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:05:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:05:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:05:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:05:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:05:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:05:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:05:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:05:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:05:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42912267
Sun 19 Jan 2014 21:05:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:05:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42912267
Sun 19 Jan 2014 21:05:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:06:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:06:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:06:07 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:06:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:06:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:06:07 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:06:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:06:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:06:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:06:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:06:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:06:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:06:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:06:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:06:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:06:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:06:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:06:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:06:10 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:06:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 21:06:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:06:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:06:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:06:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:06:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:06:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:06:12 - job_xml_thread(): Done retrieving: data size 42969153
Sun 19 Jan 2014 21:06:12 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:06:12 - XML: Start document: iteration 6
Sun 19 Jan 2014 21:06:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42969153
Sun 19 Jan 2014 21:06:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:06:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42969153
Sun 19 Jan 2014 21:06:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:06:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:06:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:06:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:06:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:06:28 - XML: Processed 645902 elements - found 0 jobs
Sun 19 Jan 2014 21:06:28 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:06:28 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:06:28 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:06:28 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:06:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:06:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:06:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:06:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:06:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:06:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:06:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:06:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:06:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:06:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:06:34 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:06:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:06:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:06:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:06:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:06:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:06:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:06:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:06:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43024067
Sun 19 Jan 2014 21:06:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:06:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43024067
Sun 19 Jan 2014 21:06:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:06:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:06:42 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:06:43 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:06:43 - job_xml_thread(): Done retrieving: data size 43024067
Sun 19 Jan 2014 21:06:43 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:06:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:06:43 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:06:43 - XML: Start document: iteration 7
Sun 19 Jan 2014 21:06:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 21:06:43 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:06:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 21:06:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9267 values 146337 bits 18292 bytes 
Sun 19 Jan 2014 21:06:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:06:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:06:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:06:47 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:06:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:06:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:06:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:06:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:06:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:06:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:06:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:06:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:06:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:06:55 - XML: Processed 646186 elements - found 0 jobs
Sun 19 Jan 2014 21:06:55 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:06:55 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:06:55 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:06:55 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:06:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:06:57 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:06:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:06:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:06:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:06:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:06:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:06:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:06:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:06:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43547304
Sun 19 Jan 2014 21:06:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:07:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43547304
Sun 19 Jan 2014 21:07:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:07:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:07:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:07:10 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:07:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:07:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:07:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:07:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:07:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:07:13 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 21:07:13 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:07:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:07:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:07:14 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:07:14 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 21:07:14 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:07:14 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 21:07:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:07:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:07:14 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 21:07:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:07:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:07:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:07:15 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:07:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:07:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:07:16 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 772824 values 12200629 bits 1525078 bytes 
Sun 19 Jan 2014 21:07:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:07:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:07:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:07:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:07:16 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:07:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 21:07:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:07:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:07:19 - job_xml_thread(): Done retrieving: data size 43574932
Sun 19 Jan 2014 21:07:19 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:07:19 - XML: Start document: iteration 8
Sun 19 Jan 2014 21:07:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574932
Sun 19 Jan 2014 21:07:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574932
Sun 19 Jan 2014 21:07:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:07:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:07:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:07:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:07:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:07:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:07:34 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 21:07:34 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:07:34 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:07:34 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:07:34 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:07:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:07:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:07:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:07:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:07:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:07:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:07:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:07:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:07:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:07:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:07:41 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:07:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:07:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:07:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:07:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:07:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:07:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:07:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:07:43 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:07:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:07:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 21:07:44 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:07:44 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:07:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 21:07:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6057 values 95688 bits 11961 bytes 
Sun 19 Jan 2014 21:07:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:07:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561189
Sun 19 Jan 2014 21:07:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:07:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561189
Sun 19 Jan 2014 21:07:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:07:49 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:07:49 - job_xml_thread(): Done retrieving: data size 43561189
Sun 19 Jan 2014 21:07:49 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:07:49 - XML: Start document: iteration 9
Sun 19 Jan 2014 21:07:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:07:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:07:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:07:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:08:03 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 21:08:03 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:08:03 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:08:03 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:08:03 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:08:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:08:03 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:08:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:08:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:08:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:08:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:08:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:08:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:08:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:08:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:08:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:08:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:08:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:08:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:08:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:08:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:08:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:08:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:08:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556612
Sun 19 Jan 2014 21:08:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:08:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556612
Sun 19 Jan 2014 21:08:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:08:14 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:08:14 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 21:08:18 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:08:18 - job_xml_thread(): Done retrieving: data size 43556612
Sun 19 Jan 2014 21:08:18 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:08:18 - XML: Start document: iteration 10
Sun 19 Jan 2014 21:08:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:08:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:08:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:08:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:08:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:08:28 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:08:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:08:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:08:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:08:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:08:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:08:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:08:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:08:34 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 21:08:34 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:08:34 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:08:34 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:08:34 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:08:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:08:35 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:08:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:08:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:08:35 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:08:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 21:08:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:08:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:08:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:08:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:08:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:08:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:08:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567270
Sun 19 Jan 2014 21:08:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:08:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567270
Sun 19 Jan 2014 21:08:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:08:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:08:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:08:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:08:44 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:08:45 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:08:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:08:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 21:08:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 21:08:45 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:08:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6206 values 98041 bits 12255 bytes 
Sun 19 Jan 2014 21:08:49 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:08:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:08:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:08:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:08:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:08:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:08:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:08:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:08:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:08:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:08:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:08:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:08:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:08:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:08:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:08:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:08:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:08:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:08:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:08:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:08:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:08:59 - job_xml_thread(): Done retrieving: data size 43559022
Sun 19 Jan 2014 21:08:59 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:08:59 - XML: Start document: iteration 11
Sun 19 Jan 2014 21:08:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559022
Sun 19 Jan 2014 21:08:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:08:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559022
Sun 19 Jan 2014 21:08:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:09:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:09:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:09:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:09:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:09:17 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 21:09:17 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:09:17 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:09:17 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:09:17 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:09:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:09:22 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:09:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:09:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:09:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:09:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:09:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:09:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:09:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:09:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:09:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:09:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:09:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:09:23 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:09:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 21:09:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:09:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:09:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:09:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:09:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:09:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:09:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584464
Sun 19 Jan 2014 21:09:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:09:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584464
Sun 19 Jan 2014 21:09:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:09:32 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:09:32 - job_xml_thread(): Done retrieving: data size 43584464
Sun 19 Jan 2014 21:09:32 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:09:32 - XML: Start document: iteration 12
Sun 19 Jan 2014 21:09:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:09:36 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:09:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:09:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:09:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:09:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:09:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:09:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:09:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:09:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:09:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:09:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:09:45 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:09:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:09:47 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:09:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 21:09:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 21:09:47 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:09:47 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 21:09:47 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:09:47 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:09:47 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:09:47 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:09:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5754 values 90817 bits 11352 bytes 
Sun 19 Jan 2014 21:09:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:09:49 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:09:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:09:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:09:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:09:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:09:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:09:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:09:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:09:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:09:53 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:09:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 21:09:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:09:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:09:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562948
Sun 19 Jan 2014 21:09:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:09:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562948
Sun 19 Jan 2014 21:09:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:10:02 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:10:02 - job_xml_thread(): Done retrieving: data size 43562948
Sun 19 Jan 2014 21:10:03 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:10:03 - XML: Start document: iteration 13
Sun 19 Jan 2014 21:10:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:10:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:10:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:10:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:10:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:10:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:10:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:10:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:10:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:10:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:10:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:10:15 - XML: Processed 653351 elements - found 0 jobs
Sun 19 Jan 2014 21:10:15 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:10:15 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:10:15 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:10:15 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:10:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:10:17 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:10:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:10:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:10:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:10:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:10:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:10:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:10:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:10:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558130
Sun 19 Jan 2014 21:10:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:10:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558130
Sun 19 Jan 2014 21:10:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:10:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:10:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:10:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:10:30 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:10:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:10:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:10:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:10:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:10:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:10:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:10:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558130
Sun 19 Jan 2014 21:10:30 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:10:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:10:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:10:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:10:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:10:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:10:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:10:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:10:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:10:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:10:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:10:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:10:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:10:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:10:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:10:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:10:44 - job_xml_thread(): Done retrieving: data size 43549088
Sun 19 Jan 2014 21:10:44 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:10:44 - XML: Start document: iteration 14
Sun 19 Jan 2014 21:10:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43549088
Sun 19 Jan 2014 21:10:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:10:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:10:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:10:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:10:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:10:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43549088
Sun 19 Jan 2014 21:10:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:10:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:10:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:10:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:10:47 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:10:48 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:10:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 21:10:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:10:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 21:10:49 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:10:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9314 values 147100 bits 18387 bytes 
Sun 19 Jan 2014 21:10:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:10:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:10:57 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 21:10:57 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:10:57 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:10:57 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:10:57 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:11:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:11:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:11:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:11:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:11:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:11:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:11:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:11:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:11:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:11:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:11:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:11:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:11:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:11:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:11:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:11:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:11:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:11:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:11:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:11:12 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:11:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:11:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43503367
Sun 19 Jan 2014 21:11:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:11:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43503367
Sun 19 Jan 2014 21:11:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:11:13 - job_xml_thread(): Done retrieving: data size 43503367
Sun 19 Jan 2014 21:11:13 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:11:13 - XML: Start document: iteration 15
Sun 19 Jan 2014 21:11:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:11:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:11:22 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:11:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 21:11:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:11:23 - XML: Processed 652602 elements - found 0 jobs
Sun 19 Jan 2014 21:11:23 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:11:23 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:11:23 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:11:23 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:11:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:11:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:11:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:11:31 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:11:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:11:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:11:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:11:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:11:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:11:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:11:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:11:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:11:34 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:11:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:11:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:11:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:11:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:11:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:11:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:11:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:11:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43011547
Sun 19 Jan 2014 21:11:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:11:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43011547
Sun 19 Jan 2014 21:11:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:11:38 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:11:38 - job_xml_thread(): Done retrieving: data size 43011547
Sun 19 Jan 2014 21:11:39 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:11:39 - XML: Start document: iteration 16
Sun 19 Jan 2014 21:11:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:11:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:11:48 - XML: Processed 646174 elements - found 0 jobs
Sun 19 Jan 2014 21:11:48 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:11:48 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:11:48 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:11:48 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:11:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:11:49 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:11:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:11:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:11:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:11:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 21:11:50 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:11:50 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:11:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 21:11:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6207 values 98031 bits 12253 bytes 
Sun 19 Jan 2014 21:11:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:11:54 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:11:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:11:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:11:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:11:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:11:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:11:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:11:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:12:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:12:00 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:12:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:12:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:12:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:12:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:12:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:12:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:12:02 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 21:12:02 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 21:12:02 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:12:03 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:12:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:12:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42906341
Sun 19 Jan 2014 21:12:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:12:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42906341
Sun 19 Jan 2014 21:12:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:12:04 - job_xml_thread(): Done retrieving: data size 42906341
Sun 19 Jan 2014 21:12:04 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:12:04 - XML: Start document: iteration 17
Sun 19 Jan 2014 21:12:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:12:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:12:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:12:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:12:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:12:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:12:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:12:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:12:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:12:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:12:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:12:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:12:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:12:23 - XML: Processed 645170 elements - found 0 jobs
Sun 19 Jan 2014 21:12:23 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:12:23 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:12:23 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:12:23 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:12:24 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:12:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 21:12:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:12:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:12:25 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:12:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:12:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:12:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:12:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:12:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:12:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:12:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:12:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42956645
Sun 19 Jan 2014 21:12:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:12:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42956645
Sun 19 Jan 2014 21:12:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:12:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:12:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:12:38 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:12:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:12:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:12:39 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:12:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:12:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:12:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:12:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:12:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:12:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:12:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:12:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:12:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:12:41 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:12:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:12:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:12:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:12:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:12:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:12:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:12:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:12:43 - job_xml_thread(): Done retrieving: data size 43495840
Sun 19 Jan 2014 21:12:43 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:12:43 - XML: Start document: iteration 18
Sun 19 Jan 2014 21:12:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43495840
Sun 19 Jan 2014 21:12:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:12:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43495840
Sun 19 Jan 2014 21:12:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:12:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:12:51 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:12:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:12:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 21:12:52 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:12:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9045 values 142882 bits 17860 bytes 
Sun 19 Jan 2014 21:12:52 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:12:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 21:12:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:12:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:12:56 - XML: Processed 652334 elements - found 0 jobs
Sun 19 Jan 2014 21:12:56 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:12:56 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:12:56 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:12:56 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:12:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:12:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:13:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:13:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:13:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:13:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:13:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:13:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:13:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:13:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:13:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:13:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:13:07 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:13:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:13:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:13:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:13:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:13:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:13:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:13:09 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:13:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 21:13:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:13:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:13:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580352
Sun 19 Jan 2014 21:13:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:13:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580352
Sun 19 Jan 2014 21:13:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:13:12 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:13:12 - job_xml_thread(): Done retrieving: data size 43580352
Sun 19 Jan 2014 21:13:12 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:13:12 - XML: Start document: iteration 19
Sun 19 Jan 2014 21:13:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:13:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:13:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:13:20 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:13:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:13:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:13:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:13:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:13:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:13:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:13:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:13:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:13:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:13:31 - XML: Processed 653328 elements - found 0 jobs
Sun 19 Jan 2014 21:13:31 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:13:31 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:13:31 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:13:31 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:13:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:13:32 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:13:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:13:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:13:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:13:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:13:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:13:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:13:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:13:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43552789
Sun 19 Jan 2014 21:13:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:13:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43552789
Sun 19 Jan 2014 21:13:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:13:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:13:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:13:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:13:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:13:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:13:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:13:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:13:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:13:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:13:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:13:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:13:46 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:13:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:13:47 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:13:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:13:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:13:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:13:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:13:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:13:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:13:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:13:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43585602
Sun 19 Jan 2014 21:13:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:13:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43585602
Sun 19 Jan 2014 21:13:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:13:50 - job_xml_thread(): Done retrieving: data size 43585602
Sun 19 Jan 2014 21:13:51 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:13:51 - XML: Start document: iteration 20
Sun 19 Jan 2014 21:13:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:13:53 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:13:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:13:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 21:13:56 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:13:57 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:13:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sun 19 Jan 2014 21:14:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:14:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:14:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:14:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:14:06 - XML: Processed 653349 elements - found 0 jobs
Sun 19 Jan 2014 21:14:06 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:14:06 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:14:06 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:14:06 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:14:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:14:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:14:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:14:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:14:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:14:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:14:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:14:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:14:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:14:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:14:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:14:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:14:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:14:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:14:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:14:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:14:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:14:14 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 21:14:14 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:14:15 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:14:15 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:14:15 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 21:14:15 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 21:14:15 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 21:14:16 - size of cluster 'LISA Cluster': 624 hosts 79469 metrics 727930 values 11477847 bits 1434730 bytes 
Sun 19 Jan 2014 21:14:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:14:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571882
Sun 19 Jan 2014 21:14:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:14:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571882
Sun 19 Jan 2014 21:14:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:14:21 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:14:21 - job_xml_thread(): Done retrieving: data size 43571882
Sun 19 Jan 2014 21:14:21 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:14:21 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 21:14:24 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 21:14:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:14:25 - Housekeeping: done.
Sun 19 Jan 2014 21:14:25 - XML: Start document: iteration 0
Sun 19 Jan 2014 21:14:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:14:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:14:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:14:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:14:29 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:14:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:14:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:14:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:14:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:14:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:14:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:14:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:14:40 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 21:14:40 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:14:40 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:14:40 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:14:40 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:14:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:14:41 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:14:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:14:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:14:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:14:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:14:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:14:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:14:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:14:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:14:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:14:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43546466
Sun 19 Jan 2014 21:14:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:14:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43546466
Sun 19 Jan 2014 21:14:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:14:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:14:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:14:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:14:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:14:55 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:14:55 - job_xml_thread(): Done retrieving: data size 43546466
Sun 19 Jan 2014 21:14:55 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:14:55 - XML: Start document: iteration 1
Sun 19 Jan 2014 21:14:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:14:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:14:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:14:58 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:14:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:14:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:14:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:14:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:14:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:14:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:14:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 21:14:59 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:14:59 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:14:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 21:15:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 15559 values 245768 bits 30721 bytes 
Sun 19 Jan 2014 21:15:02 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 21:15:02 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:15:02 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:15:02 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:15:02 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:15:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:15:06 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:15:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:15:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:15:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:15:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:15:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:15:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:15:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:15:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580475
Sun 19 Jan 2014 21:15:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:15:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580475
Sun 19 Jan 2014 21:15:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:15:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:15:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:15:15 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:15:15 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 21:15:17 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:15:17 - job_xml_thread(): Done retrieving: data size 43580475
Sun 19 Jan 2014 21:15:17 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:15:17 - XML: Start document: iteration 2
Sun 19 Jan 2014 21:15:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:15:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:15:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:15:31 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:15:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:15:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:15:32 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 21:15:32 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:15:32 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:15:32 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:15:32 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:15:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:15:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:15:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:15:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:15:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:15:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:15:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:15:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:15:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:15:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:15:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:15:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:15:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:15:34 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:15:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 21:15:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:15:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:15:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43599694
Sun 19 Jan 2014 21:15:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:15:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43599694
Sun 19 Jan 2014 21:15:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:15:47 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:15:47 - job_xml_thread(): Done retrieving: data size 43599694
Sun 19 Jan 2014 21:15:47 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:15:47 - XML: Start document: iteration 3
Sun 19 Jan 2014 21:15:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:15:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:15:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:15:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:15:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:15:51 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:15:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:15:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:15:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:15:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:15:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:15:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:15:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:15:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:15:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:15:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:15:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:15:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:15:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:15:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:15:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:15:56 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 21:15:56 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:15:56 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:15:56 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:15:56 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:16:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:16:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562489
Sun 19 Jan 2014 21:16:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:16:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:16:00 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:16:00 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:16:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562489
Sun 19 Jan 2014 21:16:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 21:16:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:16:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 21:16:00 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:16:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:16:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5679 values 89602 bits 11200 bytes 
Sun 19 Jan 2014 21:16:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:16:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:16:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:16:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:16:11 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:16:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:16:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:16:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:16:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:16:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:16:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:16:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:16:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:16:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:16:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:16:16 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:16:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:16:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:16:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:16:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:16:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:16:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:16:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:16:19 - job_xml_thread(): Done retrieving: data size 43573187
Sun 19 Jan 2014 21:16:19 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:16:19 - XML: Start document: iteration 4
Sun 19 Jan 2014 21:16:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573187
Sun 19 Jan 2014 21:16:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:16:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573187
Sun 19 Jan 2014 21:16:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:16:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:16:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:16:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:16:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:16:38 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 21:16:38 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:16:38 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:16:38 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:16:38 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:16:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:16:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:16:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:16:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:16:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:16:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:16:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:16:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:16:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:16:41 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:16:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 21:16:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:16:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:16:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:16:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:16:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:16:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:16:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:16:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:16:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:16:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:16:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570533
Sun 19 Jan 2014 21:16:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:16:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570533
Sun 19 Jan 2014 21:16:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:16:53 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:16:53 - job_xml_thread(): Done retrieving: data size 43570533
Sun 19 Jan 2014 21:16:53 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:16:54 - XML: Start document: iteration 5
Sun 19 Jan 2014 21:16:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:16:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:16:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:16:58 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:16:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:16:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:16:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:16:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:16:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:16:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:16:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:16:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:16:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:17:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:17:01 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:17:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:17:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 21:17:02 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:17:02 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:17:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 21:17:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5917 values 93633 bits 11704 bytes 
Sun 19 Jan 2014 21:17:07 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 21:17:07 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:17:07 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:17:07 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:17:07 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:17:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:17:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:17:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:17:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:17:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:17:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:17:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:17:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:17:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:17:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573325
Sun 19 Jan 2014 21:17:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:17:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573325
Sun 19 Jan 2014 21:17:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:17:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:17:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:17:22 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:17:22 - job_xml_thread(): Done retrieving: data size 43573325
Sun 19 Jan 2014 21:17:22 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:17:22 - XML: Start document: iteration 6
Sun 19 Jan 2014 21:17:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:17:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:17:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:17:30 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:17:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:17:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:17:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:17:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:17:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:17:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:17:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:17:34 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 21:17:34 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:17:34 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:17:34 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:17:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 21:17:34 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:17:34 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:17:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:17:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:17:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:17:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:17:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:17:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:17:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:17:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:17:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:17:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:17:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43055019
Sun 19 Jan 2014 21:17:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:17:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43055019
Sun 19 Jan 2014 21:17:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:17:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:17:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:17:49 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:17:49 - job_xml_thread(): Done retrieving: data size 43055019
Sun 19 Jan 2014 21:17:49 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:17:49 - XML: Start document: iteration 7
Sun 19 Jan 2014 21:17:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:17:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:17:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:17:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:17:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:17:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:17:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:17:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:17:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:17:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:17:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:18:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:18:02 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:18:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:18:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 21:18:02 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:18:02 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:18:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 21:18:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5793 values 91791 bits 11473 bytes 
Sun 19 Jan 2014 21:18:04 - XML: Processed 646756 elements - found 0 jobs
Sun 19 Jan 2014 21:18:04 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:18:04 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:18:04 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:18:04 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:18:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:18:05 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:18:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:18:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:18:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:18:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:18:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:18:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:18:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:18:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:18:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:18:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42897270
Sun 19 Jan 2014 21:18:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:18:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42897270
Sun 19 Jan 2014 21:18:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:18:19 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:18:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:18:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:18:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:18:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:18:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:18:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:18:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:18:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:18:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:18:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:18:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:18:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:18:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:18:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:18:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:18:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:18:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:18:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:18:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:18:26 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:18:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 21:18:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:18:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:18:28 - job_xml_thread(): Done retrieving: data size 43102468
Sun 19 Jan 2014 21:18:28 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:18:28 - XML: Start document: iteration 8
Sun 19 Jan 2014 21:18:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43102468
Sun 19 Jan 2014 21:18:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:18:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43102468
Sun 19 Jan 2014 21:18:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:18:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:18:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:18:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:18:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:18:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:18:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:18:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:18:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:18:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:18:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:18:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:18:47 - XML: Processed 647384 elements - found 0 jobs
Sun 19 Jan 2014 21:18:47 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:18:47 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:18:47 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:18:47 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:18:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:18:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:18:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:18:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:18:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:18:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:18:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:18:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:18:51 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 21:18:51 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 21:18:51 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:18:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:18:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43534553
Sun 19 Jan 2014 21:18:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:18:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43534553
Sun 19 Jan 2014 21:18:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:18:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:18:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:19:02 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:19:02 - job_xml_thread(): Done retrieving: data size 43534553
Sun 19 Jan 2014 21:19:02 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:19:02 - XML: Start document: iteration 9
Sun 19 Jan 2014 21:19:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:19:03 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:19:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:19:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 21:19:05 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:19:05 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:19:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8490 values 134197 bits 16774 bytes 
Sun 19 Jan 2014 21:19:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 21:19:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:19:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:19:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:19:14 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:19:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:19:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:19:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:19:15 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:19:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:19:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:19:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:19:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:19:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:19:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:19:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:19:16 - XML: Processed 652920 elements - found 0 jobs
Sun 19 Jan 2014 21:19:16 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:19:16 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:19:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:19:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:19:16 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:19:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:19:16 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:19:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:19:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:19:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568227
Sun 19 Jan 2014 21:19:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:19:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568227
Sun 19 Jan 2014 21:19:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:19:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:19:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:19:31 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:19:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:19:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:19:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:19:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:19:31 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:19:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:19:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:19:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:19:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:19:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:19:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:19:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:19:34 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:19:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:19:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:19:35 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:19:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 21:19:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:19:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:19:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:19:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:19:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:19:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:19:37 - job_xml_thread(): Done retrieving: data size 43574016
Sun 19 Jan 2014 21:19:37 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:19:37 - XML: Start document: iteration 10
Sun 19 Jan 2014 21:19:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574016
Sun 19 Jan 2014 21:19:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:19:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574016
Sun 19 Jan 2014 21:19:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:19:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:19:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:19:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:19:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:19:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:19:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:19:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:19:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:19:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:19:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:19:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:19:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:19:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:19:57 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 21:19:57 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:19:57 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:19:57 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:19:57 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:19:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:19:59 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:19:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:19:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:20:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:20:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:20:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:20:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:20:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:20:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559068
Sun 19 Jan 2014 21:20:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:20:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559068
Sun 19 Jan 2014 21:20:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:20:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:20:06 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:20:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:20:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:20:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:20:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 21:20:09 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:20:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8891 values 140317 bits 17539 bytes 
Sun 19 Jan 2014 21:20:10 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:20:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 21:20:12 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:20:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:20:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:20:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:20:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:20:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:20:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:20:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:20:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:20:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:20:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:20:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:20:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:20:17 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:20:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:20:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:20:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:20:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:20:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:20:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:20:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:20:19 - job_xml_thread(): Done retrieving: data size 43567080
Sun 19 Jan 2014 21:20:19 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:20:19 - XML: Start document: iteration 11
Sun 19 Jan 2014 21:20:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567080
Sun 19 Jan 2014 21:20:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567080
Sun 19 Jan 2014 21:20:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:20:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:20:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:20:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:20:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:20:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:20:33 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:20:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 21:20:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:20:38 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 21:20:39 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:20:39 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:20:39 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:20:39 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:20:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:20:39 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:20:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:20:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:20:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:20:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:20:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:20:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:20:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:20:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:20:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:20:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:20:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:20:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:20:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:20:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:20:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:20:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:20:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569955
Sun 19 Jan 2014 21:20:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:20:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569955
Sun 19 Jan 2014 21:20:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:20:54 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:20:54 - job_xml_thread(): Done retrieving: data size 43569955
Sun 19 Jan 2014 21:20:54 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:20:54 - XML: Start document: iteration 12
Sun 19 Jan 2014 21:20:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:20:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:20:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:20:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:20:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:20:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:20:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:20:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:20:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:20:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:20:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:20:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:20:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:21:04 - XML: Processed 653351 elements - found 0 jobs
Sun 19 Jan 2014 21:21:04 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:21:04 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:21:04 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:21:04 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:21:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:21:07 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:21:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:21:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:21:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:21:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:21:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:21:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:21:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:21:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564750
Sun 19 Jan 2014 21:21:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:21:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564750
Sun 19 Jan 2014 21:21:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:21:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:21:11 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:21:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:21:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 21:21:12 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:21:12 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:21:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:21:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9204 values 145419 bits 18177 bytes 
Sun 19 Jan 2014 21:21:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 21:21:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:21:15 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 21:21:15 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:21:16 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:21:16 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 21:21:16 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 21:21:16 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:21:17 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 21:21:19 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:21:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:21:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:21:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:21:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:21:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:21:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:21:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:21:24 - size of cluster 'LISA Cluster': 624 hosts 79472 metrics 752534 values 11884296 bits 1485537 bytes 
Sun 19 Jan 2014 21:21:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:21:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:21:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:21:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:21:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:21:26 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:21:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:21:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:21:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:21:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:21:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:21:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:21:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:21:30 - job_xml_thread(): Done retrieving: data size 43573246
Sun 19 Jan 2014 21:21:30 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:21:30 - XML: Start document: iteration 13
Sun 19 Jan 2014 21:21:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573246
Sun 19 Jan 2014 21:21:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:21:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573246
Sun 19 Jan 2014 21:21:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:21:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:21:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:21:41 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 21:21:41 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:21:41 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:21:41 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:21:41 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:21:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:21:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:21:44 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:21:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 21:21:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:21:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:21:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:21:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:21:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:21:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:21:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:21:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:21:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:21:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:21:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:21:51 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:21:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:21:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:21:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:21:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:21:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:21:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:21:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:21:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43588274
Sun 19 Jan 2014 21:21:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:21:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43588274
Sun 19 Jan 2014 21:21:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:21:56 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:21:56 - job_xml_thread(): Done retrieving: data size 43588274
Sun 19 Jan 2014 21:21:56 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:21:56 - XML: Start document: iteration 14
Sun 19 Jan 2014 21:22:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:22:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:22:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:22:04 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:22:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:22:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:22:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:22:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:22:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:22:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:22:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:22:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:22:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:22:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:22:12 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:22:13 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:22:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 21:22:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:22:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 21:22:13 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:22:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5997 values 94708 bits 11838 bytes 
Sun 19 Jan 2014 21:22:16 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 21:22:16 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:22:16 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:22:16 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:22:16 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:22:17 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:22:17 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 21:22:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:22:17 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:22:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:22:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:22:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:22:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:22:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:22:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:22:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:22:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:22:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:22:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43548492
Sun 19 Jan 2014 21:22:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:22:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43548492
Sun 19 Jan 2014 21:22:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:22:31 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:22:31 - job_xml_thread(): Done retrieving: data size 43548492
Sun 19 Jan 2014 21:22:31 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:22:31 - XML: Start document: iteration 15
Sun 19 Jan 2014 21:22:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:22:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:22:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:22:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:22:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:22:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:22:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:22:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:22:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:22:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:22:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:22:43 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:22:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 21:22:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:22:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:22:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:22:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:22:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:22:46 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 21:22:46 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:22:46 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:22:46 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:22:46 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:22:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:22:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:22:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:22:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:22:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:22:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43548594
Sun 19 Jan 2014 21:22:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:22:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43548594
Sun 19 Jan 2014 21:22:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:22:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:22:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:23:01 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:23:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:23:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:23:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:23:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:23:03 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:23:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:23:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:23:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:23:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:23:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:23:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:23:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:23:06 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:23:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:23:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:23:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:23:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:23:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:23:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:23:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:23:11 - job_xml_thread(): Done retrieving: data size 43586451
Sun 19 Jan 2014 21:23:11 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:23:11 - XML: Start document: iteration 16
Sun 19 Jan 2014 21:23:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43586451
Sun 19 Jan 2014 21:23:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:23:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43586451
Sun 19 Jan 2014 21:23:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:23:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:23:14 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:23:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:23:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 21:23:17 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:23:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6124 values 96781 bits 12097 bytes 
Sun 19 Jan 2014 21:23:17 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:23:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 21:23:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:23:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:23:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:23:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:23:25 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 21:23:25 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:23:25 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:23:25 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:23:25 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:23:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:23:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:23:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:23:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:23:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:23:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:23:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:23:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:23:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:23:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:23:35 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:23:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:23:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:23:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:23:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:23:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:23:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:23:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:23:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43009483
Sun 19 Jan 2014 21:23:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:23:40 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:23:40 - job_xml_thread(): Done retrieving: data size 43009483
Sun 19 Jan 2014 21:23:40 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:23:40 - XML: Start document: iteration 17
Sun 19 Jan 2014 21:23:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43009483
Sun 19 Jan 2014 21:23:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:23:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:23:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:23:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:23:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:23:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:23:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:23:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:23:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:23:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:23:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:23:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:23:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:23:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:24:00 - XML: Processed 646232 elements - found 0 jobs
Sun 19 Jan 2014 21:24:00 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:24:00 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:24:00 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:24:00 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:24:00 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:24:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 21:24:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:24:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:24:03 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:24:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:24:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:24:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:24:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:24:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:24:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:24:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:24:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42887778
Sun 19 Jan 2014 21:24:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:24:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42887778
Sun 19 Jan 2014 21:24:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:24:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:24:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:24:15 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:24:15 - job_xml_thread(): Done retrieving: data size 42887778
Sun 19 Jan 2014 21:24:16 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:24:16 - XML: Start document: iteration 18
Sun 19 Jan 2014 21:24:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:24:17 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:24:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:24:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:24:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:24:19 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:24:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 21:24:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 21:24:20 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:24:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6072 values 95887 bits 11985 bytes 
Sun 19 Jan 2014 21:24:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:24:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:24:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:24:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:24:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:24:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:24:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:24:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:24:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:24:28 - XML: Processed 645152 elements - found 0 jobs
Sun 19 Jan 2014 21:24:28 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:24:28 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:24:28 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:24:28 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:24:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:24:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:24:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:24:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:24:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:24:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:24:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:24:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:24:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:24:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43338721
Sun 19 Jan 2014 21:24:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:24:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43338721
Sun 19 Jan 2014 21:24:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:24:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:24:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:24:39 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:24:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 21:24:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:24:43 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:24:43 - job_xml_thread(): Done retrieving: data size 43338721
Sun 19 Jan 2014 21:24:43 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:24:43 - XML: Start document: iteration 19
Sun 19 Jan 2014 21:24:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:24:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:24:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:24:47 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:24:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:24:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:24:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:24:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:24:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:24:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:24:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:24:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:24:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:24:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:24:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:24:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:24:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:24:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:24:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:24:58 - XML: Processed 650746 elements - found 0 jobs
Sun 19 Jan 2014 21:24:58 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:24:58 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:24:58 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:24:58 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:25:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:25:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43539542
Sun 19 Jan 2014 21:25:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:25:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43539542
Sun 19 Jan 2014 21:25:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:25:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:25:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:25:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:25:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:25:14 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:25:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:25:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:25:14 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:25:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:25:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:25:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:25:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:25:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:25:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:25:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:25:17 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:25:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:25:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:25:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:25:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:25:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:25:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:25:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:25:20 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:25:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:25:21 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:25:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 21:25:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 21:25:21 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:25:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6231 values 98365 bits 12295 bytes 
Sun 19 Jan 2014 21:25:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:25:21 - job_xml_thread(): Done retrieving: data size 43565700
Sun 19 Jan 2014 21:25:21 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:25:21 - XML: Start document: iteration 20
Sun 19 Jan 2014 21:25:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565700
Sun 19 Jan 2014 21:25:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565700
Sun 19 Jan 2014 21:25:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:25:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:25:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:25:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:25:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:25:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:25:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:25:37 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:25:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:25:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:25:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:25:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:25:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:25:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:25:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:25:41 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 21:25:41 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:25:41 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:25:41 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:25:42 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:25:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:25:45 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:25:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:25:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:25:46 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 21:25:46 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 21:25:46 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:25:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:25:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:25:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:25:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:25:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:25:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563062
Sun 19 Jan 2014 21:25:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:25:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563062
Sun 19 Jan 2014 21:25:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:25:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:25:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:25:55 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:25:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 21:25:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:25:57 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:25:57 - job_xml_thread(): Done retrieving: data size 43563062
Sun 19 Jan 2014 21:25:57 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:25:57 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 21:25:58 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 21:25:58 - Housekeeping: done.
Sun 19 Jan 2014 21:25:58 - XML: Start document: iteration 0
Sun 19 Jan 2014 21:26:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:26:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:26:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:26:03 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:26:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:26:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:26:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:26:05 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:26:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:26:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:26:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:26:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:26:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:26:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:26:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:26:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:26:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:26:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:26:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:26:09 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 21:26:09 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:26:09 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:26:09 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:26:09 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:26:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:26:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43586280
Sun 19 Jan 2014 21:26:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:26:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43586280
Sun 19 Jan 2014 21:26:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:26:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:26:19 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:26:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:26:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:26:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:26:21 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:26:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:26:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:26:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:26:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:26:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:26:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:26:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:26:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:26:22 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:26:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 21:26:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 21:26:22 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:26:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6438 values 101666 bits 12708 bytes 
Sun 19 Jan 2014 21:26:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:26:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:26:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:26:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:26:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:26:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:26:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:26:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:26:24 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:26:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:26:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43593582
Sun 19 Jan 2014 21:26:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:26:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43593582
Sun 19 Jan 2014 21:26:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:26:26 - job_xml_thread(): Done retrieving: data size 43593582
Sun 19 Jan 2014 21:26:26 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:26:26 - XML: Start document: iteration 1
Sun 19 Jan 2014 21:26:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:26:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:26:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:26:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:26:43 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 21:26:43 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:26:43 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:26:43 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:26:43 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:26:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:26:45 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:26:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:26:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:26:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:26:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:26:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:26:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:26:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:26:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:26:48 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:26:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:26:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:26:48 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:26:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 21:26:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:26:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:26:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:26:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:26:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:26:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:26:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572813
Sun 19 Jan 2014 21:26:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:26:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572813
Sun 19 Jan 2014 21:26:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:26:58 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:26:58 - job_xml_thread(): Done retrieving: data size 43572813
Sun 19 Jan 2014 21:26:58 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:26:59 - XML: Start document: iteration 2
Sun 19 Jan 2014 21:27:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:27:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:27:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:27:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:27:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:27:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:27:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:27:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:27:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:27:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:27:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:27:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:27:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:27:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:27:11 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:27:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:27:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:27:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:27:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:27:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:27:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:27:13 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 21:27:13 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:27:13 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:27:13 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:27:13 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:27:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:27:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567142
Sun 19 Jan 2014 21:27:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:27:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567142
Sun 19 Jan 2014 21:27:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:27:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:27:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:27:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:27:22 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:27:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:27:23 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:27:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:27:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 21:27:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 21:27:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:27:24 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:27:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8928 values 140900 bits 17612 bytes 
Sun 19 Jan 2014 21:27:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:27:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:27:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:27:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:27:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:27:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:27:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:27:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:27:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:27:28 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:27:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:27:28 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:27:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:27:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:27:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:27:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:27:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:27:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:27:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:27:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43594456
Sun 19 Jan 2014 21:27:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:27:31 - job_xml_thread(): Done retrieving: data size 43594456
Sun 19 Jan 2014 21:27:31 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:27:31 - XML: Start document: iteration 3
Sun 19 Jan 2014 21:27:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43594456
Sun 19 Jan 2014 21:27:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:27:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:27:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:27:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:27:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:27:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:27:47 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:27:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:27:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:27:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:27:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:27:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:27:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:27:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:27:51 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 21:27:51 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:27:51 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:27:51 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:27:51 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:27:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:27:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:27:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:27:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:27:54 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:27:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 21:27:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:27:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:27:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:27:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:27:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:27:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:27:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577112
Sun 19 Jan 2014 21:27:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:27:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577112
Sun 19 Jan 2014 21:27:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:28:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:28:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:28:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:28:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:28:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:28:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:28:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:28:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:28:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:28:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:28:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577112
Sun 19 Jan 2014 21:28:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:28:06 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:28:06 - job_xml_thread(): Done retrieving: data size 43577112
Sun 19 Jan 2014 21:28:06 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:28:06 - XML: Start document: iteration 4
Sun 19 Jan 2014 21:28:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:28:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:28:17 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 21:28:17 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:28:18 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:28:18 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 21:28:18 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 21:28:19 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:28:19 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 21:28:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:28:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:28:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:28:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:28:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:28:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:28:23 - ganglia_parse_thread(): started: cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sun 19 Jan 2014 21:28:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:28:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:28:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:28:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:28:24 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 21:28:24 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:28:24 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:28:24 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:28:24 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:28:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:28:24 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:28:25 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:28:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:28:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 21:28:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 21:28:25 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:28:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5685 values 89665 bits 11208 bytes 
Sun 19 Jan 2014 21:28:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:28:26 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:28:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:28:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:28:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:28:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:28:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:28:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:28:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:28:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584176
Sun 19 Jan 2014 21:28:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:28:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584176
Sun 19 Jan 2014 21:28:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:28:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:28:39 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:28:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:28:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:28:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:28:39 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:28:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:28:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:28:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:28:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:28:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:28:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:28:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:28:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:28:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:28:42 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:28:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:28:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:28:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:28:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:28:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:28:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:28:43 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:28:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 21:28:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:28:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:28:45 - job_xml_thread(): Done retrieving: data size 43589323
Sun 19 Jan 2014 21:28:45 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:28:45 - XML: Start document: iteration 5
Sun 19 Jan 2014 21:28:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43589323
Sun 19 Jan 2014 21:28:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:28:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43589323
Sun 19 Jan 2014 21:28:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:28:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:28:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:28:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:28:57 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:28:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:28:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:28:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:28:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:29:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:29:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:29:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:29:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:29:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:29:05 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 21:29:05 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:29:05 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:29:05 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:29:05 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:29:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:29:07 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:29:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:29:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:29:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:29:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:29:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:29:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:29:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:29:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563114
Sun 19 Jan 2014 21:29:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:29:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563114
Sun 19 Jan 2014 21:29:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:29:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:29:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:29:19 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:29:19 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:29:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:29:20 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:29:20 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:29:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:29:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:29:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:29:20 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:29:20 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:29:20 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 21:29:20 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 21:29:20 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 21:29:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:29:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:29:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:29:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sun 19 Jan 2014 21:29:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:29:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:29:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:29:24 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:29:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:29:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:29:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:29:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:29:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:29:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:29:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:29:25 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:29:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:29:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 21:29:26 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:29:26 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:29:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8316 values 131241 bits 16405 bytes 
Sun 19 Jan 2014 21:29:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 21:29:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:29:26 - job_xml_thread(): Done retrieving: data size 43512232
Sun 19 Jan 2014 21:29:26 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:29:26 - XML: Start document: iteration 6
Sun 19 Jan 2014 21:29:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43512232
Sun 19 Jan 2014 21:29:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43512232
Sun 19 Jan 2014 21:29:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:29:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:29:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:29:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:29:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:29:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:29:41 - XML: Processed 652590 elements - found 0 jobs
Sun 19 Jan 2014 21:29:41 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:29:41 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:29:41 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:29:41 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:29:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:29:43 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:29:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:29:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:29:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:29:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:29:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:29:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:29:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:29:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:29:47 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:29:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:29:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:29:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:29:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:29:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:29:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:29:50 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:29:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 21:29:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:29:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:29:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42954030
Sun 19 Jan 2014 21:29:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:29:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42954030
Sun 19 Jan 2014 21:29:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:29:57 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:29:58 - job_xml_thread(): Done retrieving: data size 42954030
Sun 19 Jan 2014 21:29:59 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:29:59 - XML: Start document: iteration 7
Sun 19 Jan 2014 21:30:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:30:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:30:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:30:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:30:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:30:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:30:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:30:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:30:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:30:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:30:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:30:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:30:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:30:09 - XML: Processed 645516 elements - found 0 jobs
Sun 19 Jan 2014 21:30:09 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:30:09 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:30:09 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:30:09 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:30:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:30:11 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:30:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:30:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:30:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:30:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:30:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:30:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:30:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:30:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42965951
Sun 19 Jan 2014 21:30:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:30:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42965951
Sun 19 Jan 2014 21:30:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:30:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:30:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:30:20 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:30:20 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:30:22 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:30:22 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:30:22 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 21:30:23 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 21:30:24 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 21:30:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:30:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:30:24 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:30:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:30:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:30:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:30:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:30:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sun 19 Jan 2014 21:30:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:30:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:30:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:30:26 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:30:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:30:27 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:30:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:30:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 21:30:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:30:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 21:30:27 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:30:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:30:27 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:30:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6448 values 101805 bits 12725 bytes 
Sun 19 Jan 2014 21:30:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:30:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:30:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:30:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:30:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:30:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:30:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:30:29 - job_xml_thread(): Done retrieving: data size 42981899
Sun 19 Jan 2014 21:30:29 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:30:29 - XML: Start document: iteration 8
Sun 19 Jan 2014 21:30:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42981899
Sun 19 Jan 2014 21:30:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42981899
Sun 19 Jan 2014 21:30:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:30:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:30:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:30:41 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:30:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:30:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:30:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:30:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:30:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:30:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:30:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:30:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:30:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:30:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:30:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:30:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:30:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:30:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:30:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:30:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:30:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:30:50 - XML: Processed 645914 elements - found 0 jobs
Sun 19 Jan 2014 21:30:50 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:30:50 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:30:50 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:30:50 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:30:50 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:30:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 21:30:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:30:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:30:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43517192
Sun 19 Jan 2014 21:30:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:30:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43517192
Sun 19 Jan 2014 21:30:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:31:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:31:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:31:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:31:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:31:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:31:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:31:05 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:31:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:31:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:31:05 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:31:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:31:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:31:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:31:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:31:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:31:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:31:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:31:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:31:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:31:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:31:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:31:07 - job_xml_thread(): Done retrieving: data size 43580593
Sun 19 Jan 2014 21:31:07 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:31:07 - XML: Start document: iteration 9
Sun 19 Jan 2014 21:31:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580593
Sun 19 Jan 2014 21:31:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:31:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580593
Sun 19 Jan 2014 21:31:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:31:20 - XML: Processed 653328 elements - found 0 jobs
Sun 19 Jan 2014 21:31:20 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:31:20 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:31:20 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:31:20 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:31:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:31:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:31:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:31:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:31:23 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:31:24 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:31:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:31:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:31:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:31:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:31:25 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:31:25 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 21:31:25 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:31:25 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 21:31:25 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 21:31:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:31:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:31:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:31:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:31:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:31:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:31:27 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:31:27 - size of cluster 'LISA Cluster': 624 hosts 79483 metrics 1061031 values 16728565 bits 2091070 bytes 
Sun 19 Jan 2014 21:31:28 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:31:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:31:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 21:31:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 21:31:28 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:31:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8878 values 140277 bits 17534 bytes 
Sun 19 Jan 2014 21:31:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:31:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:31:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:31:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:31:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:31:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:31:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:31:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:31:35 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:31:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:31:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575501
Sun 19 Jan 2014 21:31:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:31:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575501
Sun 19 Jan 2014 21:31:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:31:36 - job_xml_thread(): Done retrieving: data size 43575501
Sun 19 Jan 2014 21:31:36 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:31:36 - XML: Start document: iteration 10
Sun 19 Jan 2014 21:31:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:31:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:31:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:31:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:31:48 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:31:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 21:31:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:31:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:31:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:31:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:31:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:31:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:31:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:31:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:31:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:31:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:31:54 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 21:31:54 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:31:54 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:31:54 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:31:54 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:31:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:31:58 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:31:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:31:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:31:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:31:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:31:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:31:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:32:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:32:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568453
Sun 19 Jan 2014 21:32:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:32:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568453
Sun 19 Jan 2014 21:32:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:32:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:32:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:32:09 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:32:09 - job_xml_thread(): Done retrieving: data size 43568453
Sun 19 Jan 2014 21:32:09 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:32:09 - XML: Start document: iteration 11
Sun 19 Jan 2014 21:32:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:32:13 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:32:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:32:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:32:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:32:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:32:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:32:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:32:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:32:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:32:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:32:24 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 21:32:24 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:32:24 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:32:24 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:32:24 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:32:25 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:32:26 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 21:32:26 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 21:32:26 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 21:32:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:32:26 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:32:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:32:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:32:26 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:32:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:32:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:32:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:32:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:32:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:32:28 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:32:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:32:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555301
Sun 19 Jan 2014 21:32:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:32:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555301
Sun 19 Jan 2014 21:32:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:32:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:32:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 21:32:29 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:32:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:32:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:32:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 21:32:30 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:32:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9184 values 145475 bits 18184 bytes 
Sun 19 Jan 2014 21:32:39 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:32:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:32:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:32:39 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:32:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:32:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:32:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:32:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:32:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:32:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:32:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:32:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:32:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:32:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:32:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:32:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:32:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:32:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:32:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:32:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:32:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:32:48 - job_xml_thread(): Done retrieving: data size 43583527
Sun 19 Jan 2014 21:32:48 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:32:48 - XML: Start document: iteration 12
Sun 19 Jan 2014 21:32:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583527
Sun 19 Jan 2014 21:32:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583527
Sun 19 Jan 2014 21:32:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:32:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:32:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:32:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:32:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:32:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:33:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:33:01 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:33:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:33:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:33:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:33:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:33:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:33:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:33:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:33:06 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 21:33:06 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:33:06 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:33:06 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:33:06 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:33:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:33:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:33:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:33:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:33:09 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:33:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 21:33:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:33:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:33:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:33:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:33:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:33:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:33:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561574
Sun 19 Jan 2014 21:33:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:33:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561574
Sun 19 Jan 2014 21:33:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:33:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:33:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:33:21 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:33:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:33:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:33:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:33:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:33:25 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:33:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:33:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:33:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:33:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:33:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:33:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:33:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:33:27 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:33:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:33:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:33:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:33:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:33:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:33:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:33:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:33:29 - job_xml_thread(): Done retrieving: data size 43566536
Sun 19 Jan 2014 21:33:29 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:33:29 - XML: Start document: iteration 13
Sun 19 Jan 2014 21:33:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566536
Sun 19 Jan 2014 21:33:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:33:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:33:30 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:33:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566536
Sun 19 Jan 2014 21:33:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:33:31 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:33:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 21:33:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:33:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 21:33:31 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:33:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8598 values 135983 bits 16997 bytes 
Sun 19 Jan 2014 21:33:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:33:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:33:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:33:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:33:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:33:43 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:33:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:33:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:33:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:33:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:33:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:33:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:33:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:33:46 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 21:33:46 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:33:46 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:33:46 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:33:46 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:33:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:33:51 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:33:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:33:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:33:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:33:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:33:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:33:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:33:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:33:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553213
Sun 19 Jan 2014 21:33:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:33:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553213
Sun 19 Jan 2014 21:33:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:34:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:34:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:34:01 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:34:01 - job_xml_thread(): Done retrieving: data size 43553213
Sun 19 Jan 2014 21:34:01 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:34:01 - XML: Start document: iteration 14
Sun 19 Jan 2014 21:34:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:34:07 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:34:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:34:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:34:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:34:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:34:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:34:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:34:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:34:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:34:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:34:14 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 21:34:14 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:34:14 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:34:14 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:34:14 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:34:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:34:17 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:34:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:34:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:34:17 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:34:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 21:34:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:34:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:34:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:34:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:34:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:34:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:34:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578317
Sun 19 Jan 2014 21:34:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:34:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578317
Sun 19 Jan 2014 21:34:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:34:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:34:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:34:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:34:27 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:34:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:34:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:34:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:34:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:34:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578317
Sun 19 Jan 2014 21:34:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:34:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:34:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:34:29 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:34:29 - job_xml_thread(): Done retrieving: data size 43578317
Sun 19 Jan 2014 21:34:29 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:34:29 - XML: Start document: iteration 15
Sun 19 Jan 2014 21:34:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:34:32 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:34:32 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:34:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 21:34:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:34:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 21:34:33 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:34:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:34:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:34:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5553 values 87620 bits 10952 bytes 
Sun 19 Jan 2014 21:34:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:34:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:34:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:34:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:34:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:34:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:34:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:34:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:34:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:34:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:34:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:34:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:34:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:34:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:34:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:34:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:34:47 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 21:34:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:34:47 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:34:47 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:34:47 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:34:47 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:34:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:34:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43591248
Sun 19 Jan 2014 21:34:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:34:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43591248
Sun 19 Jan 2014 21:34:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:34:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:34:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:34:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:34:59 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:34:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:34:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:34:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:34:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:34:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:34:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:34:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43591248
Sun 19 Jan 2014 21:34:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:35:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:35:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:35:02 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:35:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:35:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:35:11 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:35:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:35:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:35:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:35:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:35:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:35:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:35:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:35:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:35:12 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:35:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 21:35:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:35:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:35:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:35:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:35:15 - job_xml_thread(): Done retrieving: data size 43560482
Sun 19 Jan 2014 21:35:15 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:35:15 - XML: Start document: iteration 16
Sun 19 Jan 2014 21:35:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560482
Sun 19 Jan 2014 21:35:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:35:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:35:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:35:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560482
Sun 19 Jan 2014 21:35:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:35:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:35:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:35:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:35:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:35:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:35:30 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:35:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:35:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:35:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:35:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:35:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:35:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:35:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:35:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:35:33 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:35:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:35:34 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:35:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 21:35:34 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:35:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5860 values 92556 bits 11569 bytes 
Sun 19 Jan 2014 21:35:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 21:35:36 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 21:35:36 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:35:36 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:35:36 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:35:36 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:35:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:35:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:35:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:35:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:35:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:35:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:35:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:35:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:35:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:35:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42995550
Sun 19 Jan 2014 21:35:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:35:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42995550
Sun 19 Jan 2014 21:35:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:35:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:35:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:35:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:35:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:35:51 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:35:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:35:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:35:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:35:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:35:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:35:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:35:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:35:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:35:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:35:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:35:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:35:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:35:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:35:54 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:35:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 21:35:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:35:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:35:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:35:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:35:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:35:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:35:57 - job_xml_thread(): Done retrieving: data size 42921552
Sun 19 Jan 2014 21:35:57 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:35:57 - XML: Start document: iteration 17
Sun 19 Jan 2014 21:35:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42921552
Sun 19 Jan 2014 21:35:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:35:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42921552
Sun 19 Jan 2014 21:35:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:36:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:36:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:36:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:36:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:36:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:36:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:36:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:36:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:36:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:36:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:36:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:36:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:36:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:36:20 - XML: Processed 645182 elements - found 0 jobs
Sun 19 Jan 2014 21:36:20 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:36:20 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:36:20 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:36:20 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:36:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:36:20 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:36:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:36:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:36:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:36:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:36:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:36:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:36:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:36:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42962991
Sun 19 Jan 2014 21:36:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:36:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42962991
Sun 19 Jan 2014 21:36:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:36:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:36:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:36:31 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:36:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:36:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:36:36 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:36:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:36:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:36:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:36:36 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:36:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:36:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:36:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:36:36 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:36:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:36:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:36:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 21:36:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 21:36:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:36:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:36:36 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:36:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9235 values 145935 bits 18241 bytes 
Sun 19 Jan 2014 21:36:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:36:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:36:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:36:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:36:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:36:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:36:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:36:39 - job_xml_thread(): Done retrieving: data size 43426800
Sun 19 Jan 2014 21:36:39 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:36:39 - XML: Start document: iteration 18
Sun 19 Jan 2014 21:36:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43426800
Sun 19 Jan 2014 21:36:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:36:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43426800
Sun 19 Jan 2014 21:36:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:36:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:36:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:36:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:36:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:36:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:36:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:36:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:36:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:36:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:36:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:36:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:36:56 - XML: Processed 651435 elements - found 0 jobs
Sun 19 Jan 2014 21:36:56 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:36:56 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:36:56 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:36:56 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:36:56 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:36:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 21:36:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:37:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:37:01 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:37:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:37:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:37:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:37:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:37:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:37:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:37:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:37:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563914
Sun 19 Jan 2014 21:37:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:37:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563914
Sun 19 Jan 2014 21:37:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:37:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:37:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:37:11 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:37:11 - job_xml_thread(): Done retrieving: data size 43563914
Sun 19 Jan 2014 21:37:11 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:37:12 - XML: Start document: iteration 19
Sun 19 Jan 2014 21:37:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:37:13 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:37:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:37:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:37:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:37:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:37:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:37:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:37:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:37:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:37:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:37:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:37:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:37:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:37:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:37:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:37:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:37:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:37:26 - XML: Processed 653196 elements - found 0 jobs
Sun 19 Jan 2014 21:37:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:37:26 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:37:26 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:37:26 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:37:26 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:37:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:37:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43549957
Sun 19 Jan 2014 21:37:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:37:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43549957
Sun 19 Jan 2014 21:37:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:37:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:37:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:37:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:37:36 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:37:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:37:37 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:37:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 21:37:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 21:37:37 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:37:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9347 values 147596 bits 18449 bytes 
Sun 19 Jan 2014 21:37:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:37:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:37:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:37:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:37:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:37:41 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:37:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:37:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:37:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:37:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:37:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:37:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:37:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:37:45 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:37:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:37:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:37:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:37:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:37:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:37:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:37:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:37:48 - job_xml_thread(): Done retrieving: data size 43580836
Sun 19 Jan 2014 21:37:48 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:37:48 - XML: Start document: iteration 20
Sun 19 Jan 2014 21:37:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580836
Sun 19 Jan 2014 21:37:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:37:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580836
Sun 19 Jan 2014 21:37:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:37:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:37:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:38:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:38:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:38:04 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 21:38:04 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:38:04 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:38:04 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:38:04 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:38:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:38:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:38:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:38:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:38:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:38:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:38:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:38:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:38:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:38:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:38:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:38:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:38:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:38:10 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:38:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 21:38:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:38:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:38:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:38:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:38:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:38:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:38:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575503
Sun 19 Jan 2014 21:38:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:38:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575503
Sun 19 Jan 2014 21:38:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:38:19 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:38:19 - job_xml_thread(): Done retrieving: data size 43575503
Sun 19 Jan 2014 21:38:19 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:38:19 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 21:38:19 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 21:38:21 - Housekeeping: done.
Sun 19 Jan 2014 21:38:21 - XML: Start document: iteration 0
Sun 19 Jan 2014 21:38:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:38:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:38:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:38:26 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 21:38:26 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:38:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:38:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:38:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:38:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:38:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:38:27 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:38:27 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:38:27 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 21:38:27 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 21:38:27 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 21:38:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:38:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:38:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:38:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:38:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sun 19 Jan 2014 21:38:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:38:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:38:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:38:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:38:35 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 21:38:35 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:38:35 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:38:35 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:38:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:38:35 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:38:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:38:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:38:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:38:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:38:38 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:38:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:38:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561438
Sun 19 Jan 2014 21:38:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:38:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561438
Sun 19 Jan 2014 21:38:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:38:38 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:38:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:38:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 21:38:38 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:38:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5745 values 90609 bits 11326 bytes 
Sun 19 Jan 2014 21:38:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 21:38:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:38:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:38:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:38:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:38:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:38:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:38:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:38:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:38:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:38:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:38:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561438
Sun 19 Jan 2014 21:38:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:38:50 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:38:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:38:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:38:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:38:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:38:58 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:39:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:39:00 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:39:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:39:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:39:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:39:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:39:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:39:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:39:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:39:03 - job_xml_thread(): Done retrieving: data size 43574465
Sun 19 Jan 2014 21:39:03 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:39:03 - XML: Start document: iteration 1
Sun 19 Jan 2014 21:39:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:39:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:39:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574465
Sun 19 Jan 2014 21:39:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:39:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:39:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:39:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:39:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:39:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574465
Sun 19 Jan 2014 21:39:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:39:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:39:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:39:20 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 21:39:20 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:39:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:39:20 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:39:20 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:39:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:39:20 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:39:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:39:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:39:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:39:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:39:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:39:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:39:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:39:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:39:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:39:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:39:25 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:39:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:39:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:39:25 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:39:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 21:39:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:39:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:39:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:39:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:39:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:39:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:39:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582080
Sun 19 Jan 2014 21:39:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:39:27 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:39:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582080
Sun 19 Jan 2014 21:39:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:39:28 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:39:31 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:39:31 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:39:31 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 21:39:31 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 21:39:31 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 21:39:36 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:39:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:39:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:39:39 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:39:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:39:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:39:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:39:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:39:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:39:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sun 19 Jan 2014 21:39:40 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:39:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:39:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 21:39:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 21:39:40 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:39:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5925 values 93446 bits 11680 bytes 
Sun 19 Jan 2014 21:39:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:39:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:39:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:39:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:39:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:39:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:39:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:39:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:39:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:39:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:39:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:39:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:39:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:39:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:39:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:39:47 - job_xml_thread(): Done retrieving: data size 43567353
Sun 19 Jan 2014 21:39:47 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:39:47 - XML: Start document: iteration 2
Sun 19 Jan 2014 21:39:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567353
Sun 19 Jan 2014 21:39:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:39:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567353
Sun 19 Jan 2014 21:39:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:39:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:39:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:39:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:39:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:40:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:40:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:40:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:40:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:40:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:40:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:40:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:40:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:40:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:40:07 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 21:40:07 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:40:07 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:40:07 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:40:07 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:40:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:40:11 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:40:11 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:40:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 21:40:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:40:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:40:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:40:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:40:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:40:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:40:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:40:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:40:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566970
Sun 19 Jan 2014 21:40:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:40:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566970
Sun 19 Jan 2014 21:40:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:40:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:40:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:40:22 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:40:22 - job_xml_thread(): Done retrieving: data size 43566970
Sun 19 Jan 2014 21:40:22 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:40:23 - XML: Start document: iteration 3
Sun 19 Jan 2014 21:40:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:40:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:40:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:40:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:40:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:40:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:40:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:40:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:40:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:40:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:40:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:40:32 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:40:32 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:40:33 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:40:33 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 21:40:33 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:40:33 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 21:40:33 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 21:40:34 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 21:40:34 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:40:34 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:40:34 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:40:34 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:40:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:40:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:40:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:40:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:40:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:40:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:40:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:40:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:40:36 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 1062430 values 16759687 bits 2094960 bytes 
Sun 19 Jan 2014 21:40:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:40:40 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:40:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:40:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43547922
Sun 19 Jan 2014 21:40:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:40:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:40:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43547922
Sun 19 Jan 2014 21:40:41 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:40:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 21:40:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:40:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 21:40:41 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:40:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7676 values 121177 bits 15147 bytes 
Sun 19 Jan 2014 21:40:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:40:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:40:49 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:40:49 - job_xml_thread(): Done retrieving: data size 43547922
Sun 19 Jan 2014 21:40:49 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:40:49 - XML: Start document: iteration 4
Sun 19 Jan 2014 21:40:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:40:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:40:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:40:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:40:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:40:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:40:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:40:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:40:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:40:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:40:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:41:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:41:01 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:41:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:41:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:41:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:41:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:41:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:41:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:41:05 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 21:41:05 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:41:05 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:41:05 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:41:05 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:41:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:41:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567761
Sun 19 Jan 2014 21:41:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:41:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567761
Sun 19 Jan 2014 21:41:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:41:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:41:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:41:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:41:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:41:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:41:18 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:41:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:41:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:41:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:41:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:41:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:41:20 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:41:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:41:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:41:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:41:25 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:41:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:41:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:41:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:41:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:41:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:41:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:41:26 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:41:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 21:41:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:41:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:41:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43496895
Sun 19 Jan 2014 21:41:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:41:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43496895
Sun 19 Jan 2014 21:41:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:41:31 - job_xml_thread(): Done retrieving: data size 43496895
Sun 19 Jan 2014 21:41:31 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:41:31 - XML: Start document: iteration 5
Sun 19 Jan 2014 21:41:33 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:41:33 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 21:41:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:41:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:41:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:41:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:41:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:41:41 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:41:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:41:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 21:41:44 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:41:44 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:41:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 21:41:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5720 values 90180 bits 11272 bytes 
Sun 19 Jan 2014 21:41:48 - XML: Processed 652590 elements - found 0 jobs
Sun 19 Jan 2014 21:41:48 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:41:48 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:41:48 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:41:48 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:41:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:41:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:41:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:41:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:41:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:41:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:41:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:41:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:41:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:41:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:41:52 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:41:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:41:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:41:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:41:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:41:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:41:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:41:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:41:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42911281
Sun 19 Jan 2014 21:41:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:41:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42911281
Sun 19 Jan 2014 21:41:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:42:03 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:42:03 - job_xml_thread(): Done retrieving: data size 42911281
Sun 19 Jan 2014 21:42:03 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:42:03 - XML: Start document: iteration 6
Sun 19 Jan 2014 21:42:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:42:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:42:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:42:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:42:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:42:13 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:42:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:42:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:42:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:42:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:42:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:42:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:42:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:42:16 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:42:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 21:42:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:42:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:42:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:42:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:42:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:42:23 - XML: Processed 645308 elements - found 0 jobs
Sun 19 Jan 2014 21:42:23 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:42:23 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:42:23 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:42:23 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:42:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:42:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:42:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:42:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:42:24 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 21:42:24 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 21:42:24 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:42:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:42:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42956879
Sun 19 Jan 2014 21:42:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:42:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42956879
Sun 19 Jan 2014 21:42:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:42:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:42:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:42:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:42:36 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:42:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:42:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:42:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:42:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:42:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:42:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:42:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:42:38 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:42:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:42:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:42:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:42:40 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:42:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:42:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:42:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:42:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:42:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:42:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:42:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:42:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43515009
Sun 19 Jan 2014 21:42:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:42:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43515009
Sun 19 Jan 2014 21:42:44 - job_xml_thread(): Done retrieving: data size 43515009
Sun 19 Jan 2014 21:42:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:42:44 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:42:44 - XML: Start document: iteration 7
Sun 19 Jan 2014 21:42:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:42:45 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:42:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:42:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 21:42:46 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:42:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 21:42:46 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:42:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9280 values 146458 bits 18307 bytes 
Sun 19 Jan 2014 21:42:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:42:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:42:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:42:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:43:00 - XML: Processed 652674 elements - found 0 jobs
Sun 19 Jan 2014 21:43:00 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:43:00 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:43:00 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:43:00 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:43:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:43:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:43:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:43:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:43:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:43:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:43:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:43:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:43:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:43:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:43:04 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:43:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:43:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:43:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:43:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:43:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:43:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:43:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:43:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584784
Sun 19 Jan 2014 21:43:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:43:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584784
Sun 19 Jan 2014 21:43:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:43:15 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:43:15 - job_xml_thread(): Done retrieving: data size 43584784
Sun 19 Jan 2014 21:43:15 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:43:15 - XML: Start document: iteration 8
Sun 19 Jan 2014 21:43:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:43:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:43:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:43:20 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:43:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:43:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:43:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:43:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:43:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:43:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:43:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:43:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:43:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:43:28 - XML: Processed 653322 elements - found 0 jobs
Sun 19 Jan 2014 21:43:28 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:43:28 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:43:28 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:43:28 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:43:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:43:31 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:43:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:43:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:43:31 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:43:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 21:43:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:43:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:43:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:43:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:43:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:43:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:43:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557271
Sun 19 Jan 2014 21:43:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:43:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557271
Sun 19 Jan 2014 21:43:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:43:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:43:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:43:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:43:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:43:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:43:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:43:43 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:43:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:43:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:43:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:43:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:43:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:43:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:43:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:43:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:43:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:43:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:43:46 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:43:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:43:47 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:43:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 21:43:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 21:43:47 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:43:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5835 values 92027 bits 11503 bytes 
Sun 19 Jan 2014 21:43:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:43:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:43:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:43:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:43:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:43:48 - job_xml_thread(): Done retrieving: data size 43576507
Sun 19 Jan 2014 21:43:48 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:43:48 - XML: Start document: iteration 9
Sun 19 Jan 2014 21:43:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576507
Sun 19 Jan 2014 21:43:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:43:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576507
Sun 19 Jan 2014 21:43:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:43:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:43:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:44:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:44:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:44:06 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 21:44:06 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:44:06 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:44:06 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:44:07 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:44:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:44:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:44:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:44:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:44:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:44:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:44:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:44:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:44:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:44:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:44:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:44:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:44:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:44:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:44:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:44:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:44:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:44:13 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:44:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 21:44:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:44:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:44:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577227
Sun 19 Jan 2014 21:44:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:44:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577227
Sun 19 Jan 2014 21:44:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:44:22 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:44:22 - job_xml_thread(): Done retrieving: data size 43577227
Sun 19 Jan 2014 21:44:22 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:44:22 - XML: Start document: iteration 10
Sun 19 Jan 2014 21:44:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:44:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:44:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:44:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:44:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:44:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:44:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:44:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:44:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:44:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:44:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:44:34 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 21:44:34 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:44:34 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:44:34 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:44:34 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:44:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:44:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:44:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:44:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:44:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:44:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:44:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:44:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:44:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:44:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576598
Sun 19 Jan 2014 21:44:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:44:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576598
Sun 19 Jan 2014 21:44:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:44:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:44:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:44:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:44:46 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:44:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:44:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:44:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:44:47 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:44:47 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:44:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:44:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:44:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:44:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:44:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:44:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 21:44:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576598
Sun 19 Jan 2014 21:44:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:44:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 21:44:48 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:44:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7050 values 111103 bits 13887 bytes 
Sun 19 Jan 2014 21:44:49 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:44:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:44:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:44:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:44:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:44:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:44:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:44:58 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:44:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:44:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:44:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:44:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:44:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:44:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:45:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:45:01 - job_xml_thread(): Done retrieving: data size 43556272
Sun 19 Jan 2014 21:45:01 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:45:01 - XML: Start document: iteration 11
Sun 19 Jan 2014 21:45:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556272
Sun 19 Jan 2014 21:45:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:45:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:45:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:45:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:45:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:45:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:45:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556272
Sun 19 Jan 2014 21:45:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:45:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:45:13 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:45:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 21:45:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:45:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:45:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:45:17 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 21:45:17 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:45:17 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:45:17 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:45:17 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:45:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:45:18 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:45:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:45:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:45:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:45:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:45:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:45:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:45:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:45:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:45:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:45:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:45:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:45:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:45:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:45:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:45:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:45:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:45:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43594046
Sun 19 Jan 2014 21:45:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:45:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43594046
Sun 19 Jan 2014 21:45:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:45:32 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:45:32 - job_xml_thread(): Done retrieving: data size 43594046
Sun 19 Jan 2014 21:45:32 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:45:32 - XML: Start document: iteration 12
Sun 19 Jan 2014 21:45:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:45:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:45:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:45:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:45:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:45:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:45:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:45:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:45:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:45:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:45:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:45:40 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 21:45:40 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:45:40 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:45:40 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:45:40 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:45:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:45:41 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:45:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:45:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:45:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:45:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:45:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:45:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:45:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:45:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567945
Sun 19 Jan 2014 21:45:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:45:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567945
Sun 19 Jan 2014 21:45:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:45:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:45:47 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:45:49 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:45:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:45:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 21:45:49 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:45:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 21:45:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9254 values 146069 bits 18258 bytes 
Sun 19 Jan 2014 21:45:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:45:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:45:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:45:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:45:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:45:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:45:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:45:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:45:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:45:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:45:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:45:55 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:45:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:45:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:45:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:45:57 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:45:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:45:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:45:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:45:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:45:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:45:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:46:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:46:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572057
Sun 19 Jan 2014 21:46:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:46:01 - job_xml_thread(): Done retrieving: data size 43572057
Sun 19 Jan 2014 21:46:01 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:46:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572057
Sun 19 Jan 2014 21:46:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:46:02 - XML: Start document: iteration 13
Sun 19 Jan 2014 21:46:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:46:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:46:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:46:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:46:19 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 21:46:19 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:46:19 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:46:19 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:46:19 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:46:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:46:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:46:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:46:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:46:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:46:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:46:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:46:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:46:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:46:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:46:25 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:46:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:46:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:46:25 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:46:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 21:46:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:46:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:46:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:46:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:46:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:46:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:46:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579478
Sun 19 Jan 2014 21:46:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:46:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579478
Sun 19 Jan 2014 21:46:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:46:34 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:46:35 - job_xml_thread(): Done retrieving: data size 43579478
Sun 19 Jan 2014 21:46:35 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:46:35 - XML: Start document: iteration 14
Sun 19 Jan 2014 21:46:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:46:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:46:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:46:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:46:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:46:43 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:46:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:46:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:46:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:46:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:46:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:46:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:46:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:46:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:46:48 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:46:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:46:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:46:49 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 21:46:49 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:46:49 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:46:49 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:46:49 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:46:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:46:49 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:46:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:46:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:46:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:46:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:46:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:46:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 21:46:49 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:46:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 21:46:49 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:46:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5793 values 91444 bits 11430 bytes 
Sun 19 Jan 2014 21:46:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:46:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43588248
Sun 19 Jan 2014 21:46:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:46:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43588248
Sun 19 Jan 2014 21:46:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:46:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:46:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:47:04 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:47:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:47:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:47:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:47:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:47:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:47:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:47:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:47:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:47:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:47:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:47:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:47:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:47:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:47:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:47:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:47:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:47:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:47:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:47:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:47:09 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:47:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 21:47:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:47:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:47:10 - job_xml_thread(): Done retrieving: data size 43529595
Sun 19 Jan 2014 21:47:10 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:47:10 - XML: Start document: iteration 15
Sun 19 Jan 2014 21:47:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43529595
Sun 19 Jan 2014 21:47:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43529595
Sun 19 Jan 2014 21:47:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:47:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:47:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:47:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:47:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:47:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:47:23 - XML: Processed 652602 elements - found 0 jobs
Sun 19 Jan 2014 21:47:23 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:47:23 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:47:23 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:47:23 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:47:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:47:28 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:47:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:47:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:47:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:47:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:47:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:47:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:47:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:47:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:47:31 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:47:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:47:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:47:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:47:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:47:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:47:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:47:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:47:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43103578
Sun 19 Jan 2014 21:47:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:47:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43103578
Sun 19 Jan 2014 21:47:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:47:34 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 21:47:34 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:47:35 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:47:35 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:47:35 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 21:47:35 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 21:47:35 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 21:47:38 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:47:39 - job_xml_thread(): Done retrieving: data size 43103578
Sun 19 Jan 2014 21:47:39 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:47:39 - XML: Start document: iteration 16
Sun 19 Jan 2014 21:47:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:47:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:47:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:47:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:47:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:47:50 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:47:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:47:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:47:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:47:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:47:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:47:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:47:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sun 19 Jan 2014 21:47:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:47:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:47:51 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:47:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:47:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 21:47:51 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:47:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 21:47:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8306 values 131451 bits 16431 bytes 
Sun 19 Jan 2014 21:47:54 - XML: Processed 647570 elements - found 0 jobs
Sun 19 Jan 2014 21:47:54 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:47:54 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:47:54 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:47:54 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:47:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:47:57 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:47:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:47:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:47:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:47:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:47:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:47:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:48:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:48:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42897846
Sun 19 Jan 2014 21:48:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:48:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42897846
Sun 19 Jan 2014 21:48:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:48:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:48:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:48:09 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:48:09 - job_xml_thread(): Done retrieving: data size 42897846
Sun 19 Jan 2014 21:48:09 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:48:09 - XML: Start document: iteration 17
Sun 19 Jan 2014 21:48:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:48:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:48:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:48:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:48:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:48:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:48:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:48:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:48:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:48:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:48:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:48:16 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:48:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 21:48:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:48:24 - XML: Processed 645218 elements - found 0 jobs
Sun 19 Jan 2014 21:48:24 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:48:24 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:48:24 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:48:24 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:48:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:48:25 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:48:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:48:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:48:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:48:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:48:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:48:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:48:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:48:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43010828
Sun 19 Jan 2014 21:48:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:48:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43010828
Sun 19 Jan 2014 21:48:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:48:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:48:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:48:36 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:48:36 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:48:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:48:36 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:48:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:48:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:48:37 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:48:37 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 21:48:37 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 21:48:37 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:48:37 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 21:48:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:48:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:48:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:48:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:48:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:48:39 - job_xml_thread(): Retrieving XML data..
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sun 19 Jan 2014 21:48:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:48:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:48:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:48:41 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:48:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:48:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:48:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:48:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:48:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:48:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:48:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:48:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43499528
Sun 19 Jan 2014 21:48:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:48:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43499528
Sun 19 Jan 2014 21:48:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:48:45 - job_xml_thread(): Done retrieving: data size 43499528
Sun 19 Jan 2014 21:48:45 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:48:45 - XML: Start document: iteration 18
Sun 19 Jan 2014 21:48:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:48:51 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:48:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:48:51 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:48:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 21:48:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 21:48:52 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:48:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:48:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:48:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8982 values 142039 bits 17754 bytes 
Sun 19 Jan 2014 21:48:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:48:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:49:00 - XML: Processed 652522 elements - found 0 jobs
Sun 19 Jan 2014 21:49:00 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:49:00 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:49:00 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:49:00 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:49:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:49:06 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:49:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:49:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:49:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:49:07 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:49:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:49:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:49:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:49:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:49:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:49:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:49:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:49:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:49:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:49:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:49:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:49:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:49:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43587731
Sun 19 Jan 2014 21:49:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:49:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43587731
Sun 19 Jan 2014 21:49:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:49:15 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:49:15 - job_xml_thread(): Done retrieving: data size 43587731
Sun 19 Jan 2014 21:49:15 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:49:15 - XML: Start document: iteration 19
Sun 19 Jan 2014 21:49:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:49:20 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:49:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:49:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:49:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:49:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:49:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:49:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:49:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:49:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:49:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:49:29 - XML: Processed 653346 elements - found 0 jobs
Sun 19 Jan 2014 21:49:29 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:49:29 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:49:29 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:49:29 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:49:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:49:32 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:49:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:49:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:49:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:49:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:49:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:49:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:49:32 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:49:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 21:49:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:49:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:49:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557892
Sun 19 Jan 2014 21:49:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:49:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557892
Sun 19 Jan 2014 21:49:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:49:37 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:49:37 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:49:39 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:49:39 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:49:39 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 21:49:39 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 21:49:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:49:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:49:39 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 21:49:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:49:43 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:49:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:49:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:49:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:49:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:49:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:49:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:49:44 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:49:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557892
Sun 19 Jan 2014 21:49:44 - job_xml_thread(): Done retrieving: data size 43557892
Sun 19 Jan 2014 21:49:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:49:44 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:49:44 - XML: Start document: iteration 20
Sun 19 Jan 2014 21:49:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:49:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:49:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:49:51 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:49:52 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:49:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:49:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 21:49:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 21:49:53 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:49:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5712 values 90110 bits 11263 bytes 
Sun 19 Jan 2014 21:49:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:49:56 - ganglia_parse_thread(): finished: Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sun 19 Jan 2014 21:49:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:49:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:49:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:49:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:49:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:49:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:49:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:50:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:50:03 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:50:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:50:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:50:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:50:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:50:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:50:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:50:05 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 21:50:05 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:50:05 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:50:05 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:50:05 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:50:07 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:50:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 21:50:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:50:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:50:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578849
Sun 19 Jan 2014 21:50:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:50:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578849
Sun 19 Jan 2014 21:50:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:50:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:50:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:50:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:50:18 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:50:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:50:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:50:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:50:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:50:20 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:50:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:50:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:50:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:50:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:50:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:50:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:50:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:50:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:50:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:50:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:50:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:50:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:50:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:50:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:50:24 - job_xml_thread(): Done retrieving: data size 43581761
Sun 19 Jan 2014 21:50:24 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:50:24 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 21:50:24 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 21:50:24 - Housekeeping: done.
Sun 19 Jan 2014 21:50:24 - XML: Start document: iteration 0
Sun 19 Jan 2014 21:50:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581761
Sun 19 Jan 2014 21:50:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581761
Sun 19 Jan 2014 21:50:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:50:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:50:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:50:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:50:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:50:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:50:38 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 21:50:38 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:50:38 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:50:38 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:50:38 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:50:39 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:50:39 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:50:40 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:50:40 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:50:41 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 21:50:41 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 21:50:41 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 21:50:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:50:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:50:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:50:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:50:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:50:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:50:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:50:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:50:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:50:44 - size of cluster 'LISA Cluster': 624 hosts 79480 metrics 1052278 values 16609566 bits 2076195 bytes 
Sun 19 Jan 2014 21:50:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:50:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:50:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:50:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:50:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:50:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:50:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:50:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:50:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:50:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43588174
Sun 19 Jan 2014 21:50:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:50:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43588174
Sun 19 Jan 2014 21:50:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:50:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:50:53 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:50:53 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:50:53 - job_xml_thread(): Done retrieving: data size 43588174
Sun 19 Jan 2014 21:50:53 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:50:53 - XML: Start document: iteration 1
Sun 19 Jan 2014 21:50:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:50:54 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:50:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 21:50:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 21:50:54 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:50:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148707 bits 18588 bytes 
Sun 19 Jan 2014 21:50:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:50:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:51:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:51:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:51:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:51:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:51:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:51:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:51:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:51:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:51:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:51:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:51:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:51:10 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 21:51:10 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:51:10 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:51:10 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:51:10 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:51:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:51:16 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:51:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:51:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:51:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:51:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:51:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:51:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:51:18 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 21:51:18 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 21:51:18 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:51:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:51:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578510
Sun 19 Jan 2014 21:51:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:51:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578510
Sun 19 Jan 2014 21:51:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:51:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:51:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:51:25 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:51:26 - job_xml_thread(): Done retrieving: data size 43578510
Sun 19 Jan 2014 21:51:26 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:51:26 - XML: Start document: iteration 2
Sun 19 Jan 2014 21:51:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:51:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:51:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:51:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:51:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:51:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:51:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:51:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:51:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:51:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:51:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:51:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:51:40 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:51:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:51:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:51:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:51:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:51:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:51:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:51:42 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:51:42 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 21:51:42 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 21:51:42 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:51:42 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:51:42 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:51:42 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:51:42 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:51:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 21:51:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:51:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:51:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566101
Sun 19 Jan 2014 21:51:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:51:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566101
Sun 19 Jan 2014 21:51:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:51:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:51:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:51:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:51:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:51:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:51:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:51:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:51:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:51:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:51:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:51:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566101
Sun 19 Jan 2014 21:51:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:51:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:51:54 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:51:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:51:55 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:51:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 21:51:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 21:51:55 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:51:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:51:57 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:51:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:51:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5958 values 94097 bits 11762 bytes 
Sun 19 Jan 2014 21:51:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:52:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:52:06 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:52:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:52:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:52:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:52:07 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:52:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:52:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:52:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:52:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:52:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:52:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:52:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:52:09 - job_xml_thread(): Done retrieving: data size 43557299
Sun 19 Jan 2014 21:52:09 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:52:09 - XML: Start document: iteration 3
Sun 19 Jan 2014 21:52:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557299
Sun 19 Jan 2014 21:52:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:52:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:52:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:52:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:52:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557299
Sun 19 Jan 2014 21:52:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:52:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:52:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:52:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:52:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:52:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:52:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:52:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:52:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:52:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:52:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:52:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:52:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:52:29 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:52:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 21:52:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:52:29 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 21:52:29 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:52:29 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:52:29 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:52:29 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:52:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:52:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:52:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:52:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:52:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:52:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:52:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:52:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:52:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:52:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579072
Sun 19 Jan 2014 21:52:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:52:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579072
Sun 19 Jan 2014 21:52:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:52:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:52:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:52:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:52:43 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:52:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:52:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:52:44 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:52:44 - job_xml_thread(): Done retrieving: data size 43579072
Sun 19 Jan 2014 21:52:44 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:52:44 - XML: Start document: iteration 4
Sun 19 Jan 2014 21:52:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:52:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:52:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:52:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:52:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:52:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:52:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:52:53 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 21:52:53 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:52:53 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:52:53 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:52:53 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:52:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:52:55 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:52:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:52:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:52:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:52:55 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:52:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:52:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:52:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:52:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:52:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:52:56 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:52:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 21:52:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 21:52:56 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:52:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5872 values 92669 bits 11583 bytes 
Sun 19 Jan 2014 21:52:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:52:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43551625
Sun 19 Jan 2014 21:52:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:52:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43551625
Sun 19 Jan 2014 21:52:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:53:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:53:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:53:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:53:07 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:53:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:53:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:53:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:53:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:53:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:53:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:53:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:53:08 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:53:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:53:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:53:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:53:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:53:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:53:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:53:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:53:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:53:12 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:53:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 21:53:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:53:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:53:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43510308
Sun 19 Jan 2014 21:53:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:53:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43510308
Sun 19 Jan 2014 21:53:14 - job_xml_thread(): Done retrieving: data size 43510308
Sun 19 Jan 2014 21:53:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:53:14 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:53:14 - XML: Start document: iteration 5
Sun 19 Jan 2014 21:53:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:53:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:53:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:53:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:53:33 - XML: Processed 652602 elements - found 0 jobs
Sun 19 Jan 2014 21:53:33 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:53:34 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:53:34 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:53:34 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:53:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:53:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:53:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:53:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:53:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:53:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:53:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:53:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:53:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:53:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:53:37 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:53:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:53:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:53:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:53:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:53:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:53:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:53:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:53:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42996734
Sun 19 Jan 2014 21:53:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:53:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42996734
Sun 19 Jan 2014 21:53:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:53:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:53:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:53:49 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:53:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:53:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:53:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:53:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:53:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:53:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:53:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:53:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:53:53 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:53:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:53:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:53:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:53:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:53:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:53:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:53:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:53:54 - job_xml_thread(): Done retrieving: data size 42918825
Sun 19 Jan 2014 21:53:54 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:53:54 - XML: Start document: iteration 6
Sun 19 Jan 2014 21:53:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42918825
Sun 19 Jan 2014 21:53:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:53:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42918825
Sun 19 Jan 2014 21:53:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:53:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:53:56 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:53:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:53:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 21:53:57 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:53:58 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:53:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sun 19 Jan 2014 21:54:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:54:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:54:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:54:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:54:13 - XML: Processed 645278 elements - found 0 jobs
Sun 19 Jan 2014 21:54:13 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:54:13 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:54:13 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:54:13 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:54:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:54:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:54:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:54:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:54:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:54:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:54:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:54:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:54:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:54:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:54:18 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:54:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:54:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:54:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:54:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:54:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:54:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:54:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:54:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42993294
Sun 19 Jan 2014 21:54:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:54:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42993294
Sun 19 Jan 2014 21:54:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:54:28 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:54:28 - job_xml_thread(): Done retrieving: data size 42993294
Sun 19 Jan 2014 21:54:28 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:54:28 - XML: Start document: iteration 7
Sun 19 Jan 2014 21:54:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:54:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:54:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:54:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:54:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:54:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:54:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:54:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:54:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:54:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:54:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:54:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:54:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:54:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:54:39 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:54:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:54:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:54:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:54:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:54:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:54:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:54:42 - XML: Processed 645856 elements - found 0 jobs
Sun 19 Jan 2014 21:54:42 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:54:42 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:54:42 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:54:42 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:54:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:54:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43508802
Sun 19 Jan 2014 21:54:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:54:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43508802
Sun 19 Jan 2014 21:54:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:54:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:54:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:54:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:54:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:54:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:54:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:54:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:54:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:54:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:54:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:54:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:54:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:54:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:54:57 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:54:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:54:58 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:54:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:54:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:54:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:54:59 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:54:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:54:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:54:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:54:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:54:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:54:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 21:54:59 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:54:59 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:54:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 21:54:59 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 16932 values 267243 bits 33405 bytes 
Sun 19 Jan 2014 21:55:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:55:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569128
Sun 19 Jan 2014 21:55:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:55:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569128
Sun 19 Jan 2014 21:55:03 - job_xml_thread(): Done retrieving: data size 43569128
Sun 19 Jan 2014 21:55:03 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:55:03 - XML: Start document: iteration 8
Sun 19 Jan 2014 21:55:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:55:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:55:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:55:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:55:14 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:55:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:55:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:55:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:55:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:55:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:55:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:55:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:55:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:55:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:55:19 - XML: Processed 653302 elements - found 0 jobs
Sun 19 Jan 2014 21:55:19 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:55:19 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:55:19 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:55:19 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:55:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:55:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:55:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:55:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:55:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:55:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:55:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:55:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:55:24 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:55:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 21:55:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:55:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:55:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43545547
Sun 19 Jan 2014 21:55:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:55:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43545547
Sun 19 Jan 2014 21:55:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:55:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:55:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:55:34 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:55:34 - job_xml_thread(): Done retrieving: data size 43545547
Sun 19 Jan 2014 21:55:34 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:55:34 - XML: Start document: iteration 9
Sun 19 Jan 2014 21:55:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:55:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:55:39 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:55:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:55:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:55:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:55:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:55:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:55:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:55:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:55:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:55:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:55:47 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:55:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:55:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:55:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:55:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:55:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:55:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:55:49 - XML: Processed 653347 elements - found 0 jobs
Sun 19 Jan 2014 21:55:49 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:55:49 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:55:49 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:55:49 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:55:51 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:55:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566102
Sun 19 Jan 2014 21:55:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:55:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566102
Sun 19 Jan 2014 21:55:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:55:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:55:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:55:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:55:59 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:56:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:56:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 21:56:02 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:56:02 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:56:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:56:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:56:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 21:56:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7882 values 124411 bits 15551 bytes 
Sun 19 Jan 2014 21:56:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:56:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:56:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:56:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:56:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:56:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:56:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:56:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:56:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:56:04 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:56:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:56:07 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:56:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:56:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:56:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:56:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:56:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:56:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:56:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:56:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566347
Sun 19 Jan 2014 21:56:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:56:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566347
Sun 19 Jan 2014 21:56:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:56:10 - job_xml_thread(): Done retrieving: data size 43566347
Sun 19 Jan 2014 21:56:10 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:56:10 - XML: Start document: iteration 10
Sun 19 Jan 2014 21:56:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:56:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:56:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:56:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:56:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:56:27 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:56:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:56:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:56:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:56:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:56:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:56:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:56:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:56:31 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 21:56:31 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:56:31 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:56:31 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:56:31 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:56:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:56:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:56:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:56:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:56:33 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:56:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 21:56:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:56:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:56:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:56:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:56:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:56:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:56:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43591736
Sun 19 Jan 2014 21:56:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:56:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43591736
Sun 19 Jan 2014 21:56:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:56:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:56:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:56:46 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:56:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:56:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:56:47 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:56:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:56:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:56:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:56:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:56:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:56:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:56:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:56:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:56:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:56:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:56:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:56:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:56:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:56:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:56:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:56:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:56:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:56:52 - job_xml_thread(): Done retrieving: data size 43579527
Sun 19 Jan 2014 21:56:52 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:56:52 - XML: Start document: iteration 11
Sun 19 Jan 2014 21:56:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579527
Sun 19 Jan 2014 21:56:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579527
Sun 19 Jan 2014 21:56:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:56:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:57:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:57:02 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:57:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:57:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:57:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:57:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 21:57:03 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:57:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9173 values 144843 bits 18105 bytes 
Sun 19 Jan 2014 21:57:04 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:57:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 21:57:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:57:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:57:08 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 21:57:08 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:57:08 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:57:08 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:57:08 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:57:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:57:10 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:57:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:57:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:57:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:57:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:57:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:57:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:57:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:57:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:57:15 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:57:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:57:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:57:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:57:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:57:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:57:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:57:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:57:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43601224
Sun 19 Jan 2014 21:57:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:57:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43601224
Sun 19 Jan 2014 21:57:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:57:23 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:57:23 - job_xml_thread(): Done retrieving: data size 43601224
Sun 19 Jan 2014 21:57:23 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:57:23 - XML: Start document: iteration 12
Sun 19 Jan 2014 21:57:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:57:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:57:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:57:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:57:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:57:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:57:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:57:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:57:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:57:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:57:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:57:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:57:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:57:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:57:39 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:57:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:57:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:57:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:57:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:57:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:57:40 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 21:57:40 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:57:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:57:40 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:57:40 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:57:40 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:57:41 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:57:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 21:57:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:57:42 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 21:57:42 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:57:42 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:57:42 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:57:42 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 21:57:42 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 21:57:42 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 21:57:43 - size of cluster 'LISA Cluster': 624 hosts 79479 metrics 1073024 values 16923981 bits 2115497 bytes 
Sun 19 Jan 2014 21:57:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:57:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569981
Sun 19 Jan 2014 21:57:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:57:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569981
Sun 19 Jan 2014 21:57:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:57:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:57:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:57:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:57:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:57:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:57:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:57:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:57:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:57:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:57:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:57:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569981
Sun 19 Jan 2014 21:57:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:57:55 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:57:55 - job_xml_thread(): Done retrieving: data size 43569981
Sun 19 Jan 2014 21:57:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:57:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:57:55 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:57:55 - XML: Start document: iteration 13
Sun 19 Jan 2014 21:58:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:58:04 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:58:05 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:58:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 21:58:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:58:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 21:58:06 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:58:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5564 values 87746 bits 10968 bytes 
Sun 19 Jan 2014 21:58:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:58:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:58:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:58:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:58:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:58:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:58:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:58:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:58:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:58:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:58:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:58:15 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 21:58:15 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:58:15 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:58:15 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:58:15 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:58:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:58:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:58:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:58:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:58:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:58:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:58:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:58:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:58:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:58:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43585389
Sun 19 Jan 2014 21:58:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:58:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43585389
Sun 19 Jan 2014 21:58:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:58:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:58:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:58:30 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:58:30 - job_xml_thread(): Done retrieving: data size 43585389
Sun 19 Jan 2014 21:58:30 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:58:30 - XML: Start document: iteration 14
Sun 19 Jan 2014 21:58:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:58:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:58:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:58:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:58:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:58:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:58:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:58:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:58:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:58:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:58:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:58:40 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 21:58:40 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:58:40 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:58:40 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:58:40 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:58:42 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:58:42 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 21:58:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:58:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:58:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:58:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:58:44 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:58:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 21:58:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:58:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:58:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:58:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:58:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:58:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:58:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562171
Sun 19 Jan 2014 21:58:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:58:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562171
Sun 19 Jan 2014 21:58:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:58:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:58:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:58:55 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:58:55 - job_xml_thread(): Done retrieving: data size 43562171
Sun 19 Jan 2014 21:58:55 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:58:55 - XML: Start document: iteration 15
Sun 19 Jan 2014 21:58:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:58:58 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:58:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:58:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:58:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:58:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:58:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:58:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:58:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:58:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:58:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:59:05 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 21:59:05 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:59:05 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:59:05 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:59:06 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:59:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:59:06 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:59:06 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:59:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:59:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 21:59:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 21:59:06 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:59:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5824 values 91894 bits 11486 bytes 
Sun 19 Jan 2014 21:59:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:59:11 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:59:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:59:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:59:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:59:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:59:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:59:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:59:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:59:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:59:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:59:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43545301
Sun 19 Jan 2014 21:59:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:59:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43545301
Sun 19 Jan 2014 21:59:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:59:21 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:59:21 - job_xml_thread(): Done retrieving: data size 43545301
Sun 19 Jan 2014 21:59:21 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 21:59:21 - XML: Start document: iteration 16
Sun 19 Jan 2014 21:59:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:59:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:59:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:59:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:59:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:59:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:59:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:59:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:59:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:59:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:59:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:59:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:59:37 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:59:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:59:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:59:38 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 21:59:38 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 21:59:38 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 21:59:38 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 21:59:38 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 21:59:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:59:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:59:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:59:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 21:59:38 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 21:59:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 21:59:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:59:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 21:59:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42974374
Sun 19 Jan 2014 21:59:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 21:59:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42974374
Sun 19 Jan 2014 21:59:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 21:59:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 21:59:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:59:53 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 21:59:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 21:59:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 21:59:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 21:59:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 21:59:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 21:59:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 21:59:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 21:59:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:59:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 21:59:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 21:59:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 21:59:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 21:59:57 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 21:59:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 21:59:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 21:59:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:59:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 21:59:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 21:59:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:00:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:00:01 - job_xml_thread(): Done retrieving: data size 42911927
Sun 19 Jan 2014 22:00:01 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:00:01 - XML: Start document: iteration 17
Sun 19 Jan 2014 22:00:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42911927
Sun 19 Jan 2014 22:00:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:00:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42911927
Sun 19 Jan 2014 22:00:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:00:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:00:07 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:00:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:00:08 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:00:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 22:00:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 22:00:08 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:00:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8954 values 141251 bits 17656 bytes 
Sun 19 Jan 2014 22:00:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:00:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:00:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:00:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:00:16 - XML: Processed 645182 elements - found 0 jobs
Sun 19 Jan 2014 22:00:16 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:00:16 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:00:16 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:00:16 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:00:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:00:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:00:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:00:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:00:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:00:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:00:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:00:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:00:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:00:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:00:25 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:00:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:00:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:00:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:00:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:00:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:00:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:00:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:00:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42971041
Sun 19 Jan 2014 22:00:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:00:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42971041
Sun 19 Jan 2014 22:00:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:00:31 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:00:31 - job_xml_thread(): Done retrieving: data size 42971041
Sun 19 Jan 2014 22:00:31 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:00:31 - XML: Start document: iteration 18
Sun 19 Jan 2014 22:00:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:00:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:00:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:00:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:00:47 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:00:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 22:00:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:00:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:00:47 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:00:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:00:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:00:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:00:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:00:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:00:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:00:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:00:51 - XML: Processed 645914 elements - found 0 jobs
Sun 19 Jan 2014 22:00:51 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:00:51 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:00:51 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:00:51 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:00:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:00:53 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:00:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:00:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:00:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:00:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:00:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:00:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:00:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:00:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43546170
Sun 19 Jan 2014 22:00:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:00:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43546170
Sun 19 Jan 2014 22:00:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:01:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:01:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:01:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:01:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:01:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:01:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:01:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:01:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:01:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:01:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:01:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:01:06 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:01:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:01:08 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:01:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:01:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:01:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:01:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 22:01:08 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:01:08 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:01:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 22:01:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5971 values 94272 bits 11784 bytes 
Sun 19 Jan 2014 22:01:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:01:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:01:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:01:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:01:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:01:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:01:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:01:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:01:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:01:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563409
Sun 19 Jan 2014 22:01:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:01:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563409
Sun 19 Jan 2014 22:01:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:01:15 - job_xml_thread(): Done retrieving: data size 43563409
Sun 19 Jan 2014 22:01:15 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:01:15 - XML: Start document: iteration 19
Sun 19 Jan 2014 22:01:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:01:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:01:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:01:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:01:33 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 22:01:33 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:01:33 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:01:33 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:01:33 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:01:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:01:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:01:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:01:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:01:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:01:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:01:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:01:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:01:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:01:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:01:37 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:01:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:01:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:01:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:01:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:01:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:01:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:01:38 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:01:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 22:01:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:01:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:01:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565142
Sun 19 Jan 2014 22:01:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:01:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565142
Sun 19 Jan 2014 22:01:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:01:48 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:01:48 - job_xml_thread(): Done retrieving: data size 43565142
Sun 19 Jan 2014 22:01:48 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:01:48 - XML: Start document: iteration 20
Sun 19 Jan 2014 22:01:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:01:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:01:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:01:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:02:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:02:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:02:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:02:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:02:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:02:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:02:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:02:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:02:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:02:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:02:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:02:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:02:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:02:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:02:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:02:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:02:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:02:06 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 22:02:06 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:02:06 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:02:06 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:02:06 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:02:08 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 22:02:08 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 22:02:08 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:02:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:02:08 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:02:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:02:09 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:02:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 22:02:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 22:02:09 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:02:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5601 values 88461 bits 11057 bytes 
Sun 19 Jan 2014 22:02:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:02:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577305
Sun 19 Jan 2014 22:02:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:02:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577305
Sun 19 Jan 2014 22:02:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:02:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:02:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:02:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:02:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:02:21 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:02:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:02:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:02:22 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:02:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:02:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:02:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:02:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:02:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:02:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:02:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:02:25 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:02:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:02:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:02:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:02:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:02:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:02:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:02:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:02:27 - job_xml_thread(): Done retrieving: data size 43568867
Sun 19 Jan 2014 22:02:27 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:02:27 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 22:02:27 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 22:02:27 - Housekeeping: done.
Sun 19 Jan 2014 22:02:27 - XML: Start document: iteration 0
Sun 19 Jan 2014 22:02:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568867
Sun 19 Jan 2014 22:02:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:02:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568867
Sun 19 Jan 2014 22:02:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:02:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:02:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:02:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:02:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:02:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:02:49 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:02:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:02:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:02:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:02:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:02:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:02:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:02:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:02:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:02:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:02:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:02:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:02:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:02:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:02:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:02:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:02:52 - XML: Processed 653346 elements - found 0 jobs
Sun 19 Jan 2014 22:02:52 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:02:52 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:02:52 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:02:52 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:02:52 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:02:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 22:02:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:02:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:02:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43590564
Sun 19 Jan 2014 22:02:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:02:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43590564
Sun 19 Jan 2014 22:02:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:03:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:03:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:03:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:03:06 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:03:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:03:07 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:03:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:03:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:03:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:03:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:03:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:03:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:03:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:03:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:03:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:03:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:03:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:03:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:03:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:03:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:03:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:03:09 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:03:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:03:10 - job_xml_thread(): Done retrieving: data size 43582353
Sun 19 Jan 2014 22:03:10 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:03:10 - XML: Start document: iteration 1
Sun 19 Jan 2014 22:03:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582353
Sun 19 Jan 2014 22:03:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:03:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582353
Sun 19 Jan 2014 22:03:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:03:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:03:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 22:03:11 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:03:11 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:03:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6416 values 101552 bits 12694 bytes 
Sun 19 Jan 2014 22:03:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 22:03:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:03:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:03:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:03:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:03:29 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 22:03:29 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:03:29 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:03:29 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:03:29 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:03:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:03:31 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:03:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:03:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:03:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:03:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:03:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:03:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:03:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:03:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:03:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:03:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:03:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:03:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:03:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:03:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:03:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:03:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:03:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43604717
Sun 19 Jan 2014 22:03:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:03:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43604717
Sun 19 Jan 2014 22:03:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:03:44 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:03:44 - job_xml_thread(): Done retrieving: data size 43604717
Sun 19 Jan 2014 22:03:44 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:03:44 - XML: Start document: iteration 2
Sun 19 Jan 2014 22:03:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:03:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:03:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:03:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:03:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:03:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:03:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:03:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:03:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:03:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:03:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:03:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:03:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:03:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:03:57 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:03:57 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 22:03:57 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:03:57 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:03:57 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:03:57 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:03:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:03:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:03:58 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:03:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 22:03:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:03:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:03:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:03:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:03:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:03:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:03:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564179
Sun 19 Jan 2014 22:03:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:04:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564179
Sun 19 Jan 2014 22:04:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:04:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:04:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:04:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:04:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:04:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:04:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:04:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:04:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:04:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:04:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:04:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:04:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:04:12 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:04:12 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:04:13 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:04:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:04:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 22:04:13 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:04:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 22:04:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5887 values 92898 bits 11612 bytes 
Sun 19 Jan 2014 22:04:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:04:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:04:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:04:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:04:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:04:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:04:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:04:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:04:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:04:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576994
Sun 19 Jan 2014 22:04:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:04:17 - job_xml_thread(): Done retrieving: data size 43576994
Sun 19 Jan 2014 22:04:17 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:04:18 - XML: Start document: iteration 3
Sun 19 Jan 2014 22:04:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576994
Sun 19 Jan 2014 22:04:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:04:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:04:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:04:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:04:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:04:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:04:36 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:04:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:04:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:04:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:04:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:04:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:04:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:04:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:04:38 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 22:04:38 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:04:38 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:04:38 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:04:38 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:04:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:04:41 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:04:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:04:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:04:41 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:04:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 22:04:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:04:42 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 22:04:42 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:04:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:04:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:04:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:04:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:04:42 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:04:42 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:04:42 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 22:04:42 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 22:04:42 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 22:04:43 - size of cluster 'LISA Cluster': 624 hosts 79478 metrics 819579 values 12946684 bits 1618335 bytes 
Sun 19 Jan 2014 22:04:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:04:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570953
Sun 19 Jan 2014 22:04:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:04:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570953
Sun 19 Jan 2014 22:04:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:04:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:04:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:04:53 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:04:53 - job_xml_thread(): Done retrieving: data size 43570953
Sun 19 Jan 2014 22:04:53 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:04:53 - XML: Start document: iteration 4
Sun 19 Jan 2014 22:04:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:04:54 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:04:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:04:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:04:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:04:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:04:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:04:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:04:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:04:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:04:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:05:06 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 22:05:06 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:05:06 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:05:06 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:05:06 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:05:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:05:07 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:05:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:05:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:05:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:05:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:05:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:05:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:05:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:05:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43546595
Sun 19 Jan 2014 22:05:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:05:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43546595
Sun 19 Jan 2014 22:05:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:05:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:05:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:05:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:05:13 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:05:14 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:05:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 22:05:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:05:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 22:05:14 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:05:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8933 values 140939 bits 17617 bytes 
Sun 19 Jan 2014 22:05:22 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:05:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:05:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:05:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:05:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:05:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:05:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:05:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:05:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:05:26 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:05:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:05:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:05:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:05:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:05:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:05:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:05:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:05:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:05:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:05:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:05:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:05:30 - job_xml_thread(): Done retrieving: data size 43502305
Sun 19 Jan 2014 22:05:30 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:05:30 - XML: Start document: iteration 5
Sun 19 Jan 2014 22:05:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43502305
Sun 19 Jan 2014 22:05:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:05:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43502305
Sun 19 Jan 2014 22:05:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:05:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:05:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:05:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:05:42 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:05:42 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 22:05:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:05:45 - XML: Processed 652590 elements - found 0 jobs
Sun 19 Jan 2014 22:05:45 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:05:45 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:05:45 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:05:45 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:05:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:05:54 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:05:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:05:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:05:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:05:55 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:05:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:05:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:05:55 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:05:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 22:05:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:05:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:05:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:05:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:05:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:05:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:05:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:05:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:05:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:05:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:06:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:06:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42913740
Sun 19 Jan 2014 22:06:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:06:00 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:06:00 - job_xml_thread(): Done retrieving: data size 42913740
Sun 19 Jan 2014 22:06:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42913740
Sun 19 Jan 2014 22:06:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:06:00 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:06:00 - XML: Start document: iteration 6
Sun 19 Jan 2014 22:06:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:06:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:06:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:06:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:06:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:06:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:06:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:06:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:06:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:06:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:06:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:06:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:06:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:06:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:06:14 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:06:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:06:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 22:06:16 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:06:16 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:06:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 22:06:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5861 values 92498 bits 11562 bytes 
Sun 19 Jan 2014 22:06:18 - XML: Processed 645152 elements - found 0 jobs
Sun 19 Jan 2014 22:06:18 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:06:18 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:06:18 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:06:18 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:06:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:06:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:06:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:06:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:06:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:06:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:06:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:06:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:06:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:06:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42962911
Sun 19 Jan 2014 22:06:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:06:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42962911
Sun 19 Jan 2014 22:06:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:06:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:06:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:06:33 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:06:33 - job_xml_thread(): Done retrieving: data size 42962911
Sun 19 Jan 2014 22:06:33 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:06:33 - XML: Start document: iteration 7
Sun 19 Jan 2014 22:06:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:06:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:06:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:06:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:06:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:06:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:06:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:06:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:06:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:06:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:06:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:06:46 - XML: Processed 645919 elements - found 0 jobs
Sun 19 Jan 2014 22:06:46 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:06:46 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:06:46 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:06:46 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:06:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:06:49 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:06:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:06:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:06:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:06:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:06:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:06:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:06:49 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:06:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 22:06:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:06:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:06:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43513933
Sun 19 Jan 2014 22:06:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:06:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43513933
Sun 19 Jan 2014 22:06:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:06:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:06:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:07:01 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:07:01 - job_xml_thread(): Done retrieving: data size 43513933
Sun 19 Jan 2014 22:07:01 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:07:01 - XML: Start document: iteration 8
Sun 19 Jan 2014 22:07:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:07:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:07:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:07:06 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:07:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:07:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:07:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:07:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:07:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:07:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:07:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:07:16 - XML: Processed 652656 elements - found 0 jobs
Sun 19 Jan 2014 22:07:16 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:07:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:07:16 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:07:16 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:07:16 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:07:16 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:07:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:07:16 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:07:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 22:07:16 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:07:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5741 values 90560 bits 11320 bytes 
Sun 19 Jan 2014 22:07:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 22:07:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:07:17 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:07:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:07:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:07:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:07:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:07:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:07:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:07:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:07:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561496
Sun 19 Jan 2014 22:07:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:07:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561496
Sun 19 Jan 2014 22:07:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:07:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:07:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:07:31 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:07:31 - job_xml_thread(): Done retrieving: data size 43561496
Sun 19 Jan 2014 22:07:31 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:07:31 - XML: Start document: iteration 9
Sun 19 Jan 2014 22:07:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:07:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:07:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:07:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:07:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:07:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:07:33 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:07:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:07:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:07:33 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:07:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:07:39 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:07:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 22:07:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:07:42 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 22:07:42 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:07:42 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:07:42 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:07:42 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:07:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:07:45 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:07:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:07:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:07:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:07:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:07:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:07:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:07:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:07:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43547637
Sun 19 Jan 2014 22:07:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:07:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43547637
Sun 19 Jan 2014 22:07:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:07:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:07:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:07:57 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:07:57 - job_xml_thread(): Done retrieving: data size 43547637
Sun 19 Jan 2014 22:07:57 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:07:57 - XML: Start document: iteration 10
Sun 19 Jan 2014 22:08:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:08:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:08:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:08:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:08:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:08:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:08:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:08:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:08:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:08:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:08:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:08:07 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 22:08:07 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:08:07 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:08:07 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:08:07 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:08:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:08:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:08:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:08:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:08:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:08:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:08:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:08:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:08:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:08:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555471
Sun 19 Jan 2014 22:08:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:08:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555471
Sun 19 Jan 2014 22:08:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:08:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:08:16 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:08:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:08:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 22:08:17 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:08:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 22:08:17 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:08:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8689 values 137088 bits 17136 bytes 
Sun 19 Jan 2014 22:08:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:08:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:08:22 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:08:22 - job_xml_thread(): Done retrieving: data size 43555471
Sun 19 Jan 2014 22:08:22 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:08:22 - XML: Start document: iteration 11
Sun 19 Jan 2014 22:08:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:08:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:08:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:08:30 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:08:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:08:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:08:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:08:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:08:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:08:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:08:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:08:31 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 22:08:31 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:08:31 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:08:31 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:08:31 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:08:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:08:34 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:08:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:08:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:08:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:08:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:08:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:08:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:08:38 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:08:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 22:08:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:08:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:08:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579685
Sun 19 Jan 2014 22:08:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:08:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579685
Sun 19 Jan 2014 22:08:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:08:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:08:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:08:46 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:08:46 - job_xml_thread(): Done retrieving: data size 43579685
Sun 19 Jan 2014 22:08:46 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:08:46 - XML: Start document: iteration 12
Sun 19 Jan 2014 22:08:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:08:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:08:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:08:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:08:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:08:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:08:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:08:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:08:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:08:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:08:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:08:56 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 22:08:56 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:08:56 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:08:56 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:08:56 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:09:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:09:00 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:09:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:09:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:09:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:09:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:09:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:09:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:09:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:09:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583759
Sun 19 Jan 2014 22:09:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:09:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583759
Sun 19 Jan 2014 22:09:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:09:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:09:11 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:09:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:09:11 - job_xml_thread(): Done retrieving: data size 43583759
Sun 19 Jan 2014 22:09:11 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:09:11 - XML: Start document: iteration 13
Sun 19 Jan 2014 22:09:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:09:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:09:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:09:17 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:09:19 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:09:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 22:09:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:09:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 22:09:19 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:09:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99118 bits 12389 bytes 
Sun 19 Jan 2014 22:09:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:09:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:09:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:09:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:09:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:09:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:09:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:09:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:09:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:09:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:09:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:09:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:09:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:09:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:09:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:09:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:09:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:09:26 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 22:09:26 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:09:26 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:09:26 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:09:26 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:09:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:09:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564779
Sun 19 Jan 2014 22:09:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:09:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564779
Sun 19 Jan 2014 22:09:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:09:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:09:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:09:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:09:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:09:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:09:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:09:41 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:09:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:09:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:09:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:09:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:09:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:09:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:09:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:09:46 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:09:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 22:09:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:09:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:09:47 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:09:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:09:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:09:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:09:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:09:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:09:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:09:48 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 22:09:48 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 22:09:48 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:09:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:09:49 - job_xml_thread(): Done retrieving: data size 43584058
Sun 19 Jan 2014 22:09:49 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:09:49 - XML: Start document: iteration 14
Sun 19 Jan 2014 22:09:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584058
Sun 19 Jan 2014 22:09:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:09:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584058
Sun 19 Jan 2014 22:09:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:09:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:09:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:10:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:10:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:10:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:10:04 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:10:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:10:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:10:06 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:10:06 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:10:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:10:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:10:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:10:09 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 22:10:09 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:10:09 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:10:09 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:10:09 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:10:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:10:11 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:10:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:10:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:10:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:10:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:10:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:10:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:10:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:10:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564607
Sun 19 Jan 2014 22:10:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:10:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564607
Sun 19 Jan 2014 22:10:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:10:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:10:19 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:10:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:10:19 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:10:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 22:10:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 22:10:19 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:10:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8953 values 141315 bits 17664 bytes 
Sun 19 Jan 2014 22:10:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:10:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:10:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:10:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:10:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:10:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:10:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:10:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:10:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564607
Sun 19 Jan 2014 22:10:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:10:24 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:10:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:10:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:10:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:10:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:10:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:10:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:10:35 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:10:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:10:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:10:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:10:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:10:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:10:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:10:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:10:37 - job_xml_thread(): Done retrieving: data size 43569616
Sun 19 Jan 2014 22:10:37 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:10:37 - XML: Start document: iteration 15
Sun 19 Jan 2014 22:10:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:10:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:10:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569616
Sun 19 Jan 2014 22:10:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:10:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:10:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:10:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569616
Sun 19 Jan 2014 22:10:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:10:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:10:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:10:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:10:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:10:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:10:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:10:59 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 22:10:59 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:10:59 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:10:59 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:10:59 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:10:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:10:59 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:10:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:10:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:11:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:11:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:11:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:11:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:11:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:11:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:11:00 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:11:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:11:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:11:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:11:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:11:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:11:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:11:01 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:11:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 22:11:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:11:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:11:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43599171
Sun 19 Jan 2014 22:11:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:11:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43599171
Sun 19 Jan 2014 22:11:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:11:14 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:11:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:11:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:11:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:11:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:11:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:11:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:11:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:11:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:11:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:11:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:11:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:11:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:11:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:11:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:11:17 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:11:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:11:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:11:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:11:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:11:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:11:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:11:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:11:19 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:11:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:11:20 - job_xml_thread(): Done retrieving: data size 43531229
Sun 19 Jan 2014 22:11:20 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:11:20 - XML: Start document: iteration 16
Sun 19 Jan 2014 22:11:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43531229
Sun 19 Jan 2014 22:11:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:11:20 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:11:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 22:11:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 22:11:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:11:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43531229
Sun 19 Jan 2014 22:11:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:11:21 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:11:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5410 values 85301 bits 10662 bytes 
Sun 19 Jan 2014 22:11:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:11:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:11:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:11:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:11:34 - XML: Processed 652602 elements - found 0 jobs
Sun 19 Jan 2014 22:11:34 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:11:34 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:11:34 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:11:34 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:11:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:11:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:11:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:11:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:11:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:11:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:11:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:11:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:11:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:11:42 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 22:11:42 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:11:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:11:42 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:11:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:11:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:11:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:11:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:11:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:11:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:11:43 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:11:43 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:11:43 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 22:11:43 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 22:11:43 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 22:11:44 - size of cluster 'LISA Cluster': 624 hosts 79485 metrics 730760 values 11533274 bits 1441659 bytes 
Sun 19 Jan 2014 22:11:47 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:11:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 22:11:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:11:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:11:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42959151
Sun 19 Jan 2014 22:11:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:11:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42959151
Sun 19 Jan 2014 22:11:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:11:49 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:11:49 - job_xml_thread(): Done retrieving: data size 42959151
Sun 19 Jan 2014 22:11:49 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:11:49 - XML: Start document: iteration 17
Sun 19 Jan 2014 22:11:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:11:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:11:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:11:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:11:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:11:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:11:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:11:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:11:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:11:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:11:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:11:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:11:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:12:08 - XML: Processed 645760 elements - found 0 jobs
Sun 19 Jan 2014 22:12:08 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:12:08 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:12:08 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:12:08 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:12:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:12:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:12:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:12:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:12:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:12:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:12:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:12:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:12:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:12:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:12:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:12:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42940867
Sun 19 Jan 2014 22:12:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:12:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42940867
Sun 19 Jan 2014 22:12:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:12:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:12:20 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:12:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:12:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 22:12:21 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:12:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:12:22 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:12:22 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:12:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 22:12:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:12:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:12:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6286 values 99226 bits 12403 bytes 
Sun 19 Jan 2014 22:12:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:12:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:12:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:12:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:12:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42940867
Sun 19 Jan 2014 22:12:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:12:23 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:12:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:12:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:12:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:12:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:12:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:12:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:12:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:12:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:12:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:12:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:12:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:12:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:12:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:12:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:12:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:12:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:12:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:12:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:12:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:12:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:12:39 - job_xml_thread(): Done retrieving: data size 43041012
Sun 19 Jan 2014 22:12:39 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:12:39 - XML: Start document: iteration 18
Sun 19 Jan 2014 22:12:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43041012
Sun 19 Jan 2014 22:12:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43041012
Sun 19 Jan 2014 22:12:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:12:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:12:44 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:12:44 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 22:12:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:12:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:12:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:12:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:12:57 - XML: Processed 646898 elements - found 0 jobs
Sun 19 Jan 2014 22:12:57 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:12:57 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:12:57 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:12:57 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:13:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:13:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:13:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:13:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:13:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:13:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:13:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:13:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:13:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:13:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:13:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:13:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:13:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:13:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:13:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:13:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:13:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:13:03 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:13:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 22:13:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:13:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:13:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43601711
Sun 19 Jan 2014 22:13:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:13:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43601711
Sun 19 Jan 2014 22:13:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:13:12 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:13:12 - job_xml_thread(): Done retrieving: data size 43601711
Sun 19 Jan 2014 22:13:13 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:13:13 - XML: Start document: iteration 19
Sun 19 Jan 2014 22:13:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:13:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:13:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:13:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:13:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:13:22 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:13:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:13:23 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:13:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 22:13:23 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:13:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 22:13:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5537 values 87301 bits 10912 bytes 
Sun 19 Jan 2014 22:13:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:13:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:13:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:13:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:13:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:13:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:13:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:13:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:13:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:13:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:13:28 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:13:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:13:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:13:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:13:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:13:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:13:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:13:29 - XML: Processed 653334 elements - found 0 jobs
Sun 19 Jan 2014 22:13:29 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:13:29 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:13:29 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:13:29 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:13:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:13:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569006
Sun 19 Jan 2014 22:13:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:13:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569006
Sun 19 Jan 2014 22:13:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:13:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:13:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:13:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:13:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:13:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:13:44 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:13:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:13:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:13:44 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:13:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:13:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:13:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:13:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:13:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:13:49 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:13:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 22:13:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:13:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:13:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:13:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:13:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:13:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:13:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:13:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:13:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:13:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:13:53 - job_xml_thread(): Done retrieving: data size 43584655
Sun 19 Jan 2014 22:13:53 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:13:53 - XML: Start document: iteration 20
Sun 19 Jan 2014 22:13:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584655
Sun 19 Jan 2014 22:13:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:13:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584655
Sun 19 Jan 2014 22:13:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:14:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:14:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:14:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:14:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:14:12 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 22:14:12 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:14:12 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:14:12 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:14:12 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:14:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:14:14 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:14:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:14:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:14:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:14:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:14:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:14:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:14:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:14:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:14:15 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:14:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:14:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:14:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:14:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:14:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:14:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:14:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:14:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43597635
Sun 19 Jan 2014 22:14:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:14:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43597635
Sun 19 Jan 2014 22:14:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:14:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:14:23 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:14:23 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:14:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 22:14:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:14:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 22:14:23 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:14:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8740 values 137838 bits 17229 bytes 
Sun 19 Jan 2014 22:14:28 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:14:28 - job_xml_thread(): Done retrieving: data size 43597635
Sun 19 Jan 2014 22:14:28 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:14:28 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 22:14:28 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 22:14:29 - Housekeeping: done.
Sun 19 Jan 2014 22:14:29 - XML: Start document: iteration 0
Sun 19 Jan 2014 22:14:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:14:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:14:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:14:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:14:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:14:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:14:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:14:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:14:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:14:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:14:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:14:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:14:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:14:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:14:39 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:14:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:14:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:14:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:14:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:14:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:14:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:14:42 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 22:14:42 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:14:42 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:14:42 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:14:42 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:14:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:14:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560938
Sun 19 Jan 2014 22:14:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:14:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560938
Sun 19 Jan 2014 22:14:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:14:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:14:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:14:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:14:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:14:57 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:14:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:15:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:15:01 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:15:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:15:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:15:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:15:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:15:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:15:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:15:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:15:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:15:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:15:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:15:02 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:15:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 22:15:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:15:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:15:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:15:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:15:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:15:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:15:06 - job_xml_thread(): Done retrieving: data size 43584284
Sun 19 Jan 2014 22:15:06 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:15:06 - XML: Start document: iteration 1
Sun 19 Jan 2014 22:15:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584284
Sun 19 Jan 2014 22:15:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:15:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584284
Sun 19 Jan 2014 22:15:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:15:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:15:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:15:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:15:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:15:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:15:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:15:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:15:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:15:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:15:23 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:15:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:15:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:15:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:15:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:15:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:15:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:15:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 22:15:25 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:15:25 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:15:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 22:15:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5831 values 92001 bits 11500 bytes 
Sun 19 Jan 2014 22:15:28 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 22:15:28 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:15:28 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:15:28 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:15:28 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:15:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:15:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:15:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:15:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:15:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:15:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:15:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:15:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:15:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:15:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569499
Sun 19 Jan 2014 22:15:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:15:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569499
Sun 19 Jan 2014 22:15:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:15:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:15:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:15:44 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:15:44 - job_xml_thread(): Done retrieving: data size 43569499
Sun 19 Jan 2014 22:15:44 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:15:44 - XML: Start document: iteration 2
Sun 19 Jan 2014 22:15:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:15:45 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:15:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:15:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:15:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:15:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:15:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:15:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:15:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:15:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:15:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:15:52 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:15:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 22:15:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:15:57 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 22:15:57 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:15:57 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:15:57 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:15:57 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:15:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:15:58 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:15:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:15:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:15:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:15:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:15:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:15:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:16:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:16:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:16:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:16:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43550772
Sun 19 Jan 2014 22:16:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:16:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43550772
Sun 19 Jan 2014 22:16:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:16:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:16:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:16:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:16:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:16:12 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:16:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:16:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:16:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:16:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:16:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:16:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:16:14 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:16:14 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 22:16:14 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 22:16:14 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:16:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:16:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:16:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:16:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:16:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:16:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:16:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:16:15 - job_xml_thread(): Done retrieving: data size 43593534
Sun 19 Jan 2014 22:16:15 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:16:15 - XML: Start document: iteration 3
Sun 19 Jan 2014 22:16:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43593534
Sun 19 Jan 2014 22:16:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:16:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43593534
Sun 19 Jan 2014 22:16:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:16:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:16:25 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:16:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:16:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 22:16:26 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:16:26 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:16:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 22:16:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9112 values 143904 bits 17988 bytes 
Sun 19 Jan 2014 22:16:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:16:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:16:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:16:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:16:32 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 22:16:32 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:16:32 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:16:32 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:16:32 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:16:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:16:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:16:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:16:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:16:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:16:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:16:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:16:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:16:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:16:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:16:40 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:16:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:16:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:16:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:16:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:16:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:16:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:16:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:16:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570950
Sun 19 Jan 2014 22:16:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:16:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570950
Sun 19 Jan 2014 22:16:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:16:47 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:16:47 - job_xml_thread(): Done retrieving: data size 43570950
Sun 19 Jan 2014 22:16:47 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:16:47 - XML: Start document: iteration 4
Sun 19 Jan 2014 22:16:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:16:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:16:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:16:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:16:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:16:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:16:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:16:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:16:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:16:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:16:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:16:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:16:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:17:01 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:17:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 22:17:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:17:01 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 22:17:01 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:17:01 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:17:01 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:17:01 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:17:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:17:04 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:17:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:17:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:17:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:17:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:17:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:17:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:17:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:17:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43588817
Sun 19 Jan 2014 22:17:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:17:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43588817
Sun 19 Jan 2014 22:17:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:17:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:17:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:17:16 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:17:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:17:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:17:18 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:17:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:17:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:17:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:17:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:17:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:17:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:17:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:17:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:17:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:17:21 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:17:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:17:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:17:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:17:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:17:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:17:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:17:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:17:23 - job_xml_thread(): Done retrieving: data size 43518461
Sun 19 Jan 2014 22:17:23 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:17:23 - XML: Start document: iteration 5
Sun 19 Jan 2014 22:17:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43518461
Sun 19 Jan 2014 22:17:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:17:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43518461
Sun 19 Jan 2014 22:17:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:17:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:17:27 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:17:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:17:28 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:17:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 22:17:29 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:17:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 22:17:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8890 values 140640 bits 17580 bytes 
Sun 19 Jan 2014 22:17:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:17:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:17:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:17:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:17:44 - XML: Processed 652602 elements - found 0 jobs
Sun 19 Jan 2014 22:17:44 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:17:44 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:17:44 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:17:44 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:17:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:17:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:17:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:17:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:17:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:17:47 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:17:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:17:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:17:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:17:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:17:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:17:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:17:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:17:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:17:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:17:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:17:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:17:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:17:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42962498
Sun 19 Jan 2014 22:17:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:17:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42962498
Sun 19 Jan 2014 22:17:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:17:59 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:17:59 - job_xml_thread(): Done retrieving: data size 42962498
Sun 19 Jan 2014 22:17:59 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:17:59 - XML: Start document: iteration 6
Sun 19 Jan 2014 22:18:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:18:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:18:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:18:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:18:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:18:03 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:18:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:18:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:18:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:18:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:18:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:18:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:18:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:18:12 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:18:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 22:18:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:18:12 - XML: Processed 645348 elements - found 0 jobs
Sun 19 Jan 2014 22:18:12 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:18:12 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:18:12 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:18:12 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:18:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:18:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:18:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:18:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:18:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:18:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:18:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:18:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:18:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:18:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42963032
Sun 19 Jan 2014 22:18:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:18:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42963032
Sun 19 Jan 2014 22:18:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:18:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:18:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:18:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:18:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:18:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:18:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:18:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:18:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:18:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:18:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:18:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42963032
Sun 19 Jan 2014 22:18:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:18:27 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:18:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:18:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:18:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:18:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:18:29 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:18:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:18:30 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:18:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 22:18:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 22:18:30 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:18:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5799 values 91741 bits 11467 bytes 
Sun 19 Jan 2014 22:18:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:18:34 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:18:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:18:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:18:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:18:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:18:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:18:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:18:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:18:36 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:18:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:18:38 - job_xml_thread(): Done retrieving: data size 43312519
Sun 19 Jan 2014 22:18:38 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:18:38 - XML: Start document: iteration 7
Sun 19 Jan 2014 22:18:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43312519
Sun 19 Jan 2014 22:18:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:18:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:18:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:18:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:18:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:18:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:18:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43312519
Sun 19 Jan 2014 22:18:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:18:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:18:44 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 22:18:45 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:18:46 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:18:46 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 22:18:46 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:18:46 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 22:18:46 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 22:18:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:18:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:18:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:18:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:18:57 - size of cluster 'LISA Cluster': 624 hosts 79469 metrics 781472 values 12356293 bits 1544536 bytes 
Sun 19 Jan 2014 22:18:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:18:57 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:18:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:18:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:18:58 - XML: Processed 650287 elements - found 0 jobs
Sun 19 Jan 2014 22:18:58 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:18:58 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:18:58 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:18:58 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:18:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:18:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:18:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:18:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:18:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:19:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:19:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:19:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:19:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:19:02 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:19:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 22:19:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:19:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:19:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:19:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:19:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:19:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:19:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43589219
Sun 19 Jan 2014 22:19:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:19:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43589219
Sun 19 Jan 2014 22:19:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:19:13 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:19:13 - job_xml_thread(): Done retrieving: data size 43589219
Sun 19 Jan 2014 22:19:13 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:19:13 - XML: Start document: iteration 8
Sun 19 Jan 2014 22:19:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:19:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:19:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:19:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:19:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:19:18 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:19:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:19:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:19:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:19:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:19:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:19:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:19:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:19:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:19:24 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:19:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:19:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:19:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:19:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:19:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:19:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:19:26 - XML: Processed 653240 elements - found 0 jobs
Sun 19 Jan 2014 22:19:26 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:19:26 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:19:26 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:19:26 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:19:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:19:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554243
Sun 19 Jan 2014 22:19:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:19:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554243
Sun 19 Jan 2014 22:19:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:19:30 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:19:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:19:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:19:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 22:19:31 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:19:31 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:19:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 22:19:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9023 values 142377 bits 17797 bytes 
Sun 19 Jan 2014 22:19:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:19:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:19:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:19:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:19:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:19:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:19:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:19:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:19:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:19:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:19:41 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:19:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:19:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:19:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:19:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:19:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:19:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:19:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:19:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:19:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:19:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:19:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:19:46 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:19:46 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 22:19:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:19:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43585400
Sun 19 Jan 2014 22:19:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:19:49 - job_xml_thread(): Done retrieving: data size 43585400
Sun 19 Jan 2014 22:19:49 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:19:49 - XML: Start document: iteration 9
Sun 19 Jan 2014 22:19:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43585400
Sun 19 Jan 2014 22:19:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:19:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:19:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:19:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:19:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:20:06 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 22:20:06 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:20:06 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:20:06 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:20:06 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:20:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:20:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:20:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:20:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:20:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:20:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:20:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:20:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:20:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:20:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:20:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:20:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:20:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:20:13 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:20:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 22:20:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:20:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:20:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:20:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:20:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:20:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:20:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43588407
Sun 19 Jan 2014 22:20:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:20:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43588407
Sun 19 Jan 2014 22:20:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:20:21 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:20:21 - job_xml_thread(): Done retrieving: data size 43588407
Sun 19 Jan 2014 22:20:21 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:20:21 - XML: Start document: iteration 10
Sun 19 Jan 2014 22:20:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:20:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:20:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:20:27 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:20:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:20:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:20:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:20:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:20:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:20:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:20:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:20:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:20:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:20:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:20:31 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:20:32 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:20:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:20:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 22:20:32 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:20:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5883 values 92806 bits 11600 bytes 
Sun 19 Jan 2014 22:20:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 22:20:38 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 22:20:38 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:20:38 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:20:38 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:20:38 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:20:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:20:42 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:20:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:20:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:20:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:20:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:20:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:20:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:20:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:20:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:20:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:20:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43544917
Sun 19 Jan 2014 22:20:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:20:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43544917
Sun 19 Jan 2014 22:20:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:20:53 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:20:53 - job_xml_thread(): Done retrieving: data size 43544917
Sun 19 Jan 2014 22:20:53 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:20:53 - XML: Start document: iteration 11
Sun 19 Jan 2014 22:20:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:20:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:21:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:21:01 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:21:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:21:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:21:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:21:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:21:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:21:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:21:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:21:07 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 22:21:07 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:21:07 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:21:07 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:21:07 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:21:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:21:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:21:10 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:21:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 22:21:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:21:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:21:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:21:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:21:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:21:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:21:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:21:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:21:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557237
Sun 19 Jan 2014 22:21:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:21:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557237
Sun 19 Jan 2014 22:21:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:21:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:21:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:21:23 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:21:23 - job_xml_thread(): Done retrieving: data size 43557237
Sun 19 Jan 2014 22:21:23 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:21:23 - XML: Start document: iteration 12
Sun 19 Jan 2014 22:21:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:21:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:21:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:21:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:21:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:21:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:21:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:21:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:21:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:21:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:21:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:21:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:21:32 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:21:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:21:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 22:21:33 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:21:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 22:21:33 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:21:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5834 values 92029 bits 11503 bytes 
Sun 19 Jan 2014 22:21:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:21:35 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:21:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:21:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:21:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:21:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:21:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:21:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:21:37 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 22:21:37 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:21:37 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:21:37 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:21:37 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:21:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:21:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559851
Sun 19 Jan 2014 22:21:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:21:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559851
Sun 19 Jan 2014 22:21:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:21:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:21:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:21:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:21:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:21:52 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:21:52 - job_xml_thread(): Done retrieving: data size 43559851
Sun 19 Jan 2014 22:21:52 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:21:52 - XML: Start document: iteration 13
Sun 19 Jan 2014 22:21:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:21:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:21:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:21:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:21:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:21:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:21:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:21:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:21:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:22:05 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 22:22:05 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:22:05 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:22:05 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:22:05 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:22:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:22:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:22:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:22:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:22:08 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:22:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 22:22:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:22:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:22:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:22:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:22:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:22:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:22:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43549203
Sun 19 Jan 2014 22:22:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:22:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43549203
Sun 19 Jan 2014 22:22:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:22:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:22:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:22:20 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:22:21 - job_xml_thread(): Done retrieving: data size 43549203
Sun 19 Jan 2014 22:22:21 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:22:21 - XML: Start document: iteration 14
Sun 19 Jan 2014 22:22:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:22:22 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:22:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:22:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:22:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:22:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:22:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:22:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:22:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:22:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:22:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:22:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:22:34 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:22:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:22:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 22:22:34 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:22:34 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:22:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 22:22:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5512 values 86934 bits 10866 bytes 
Sun 19 Jan 2014 22:22:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:22:35 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:22:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:22:35 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 22:22:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:22:35 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:22:35 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:22:35 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:22:35 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:22:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:22:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:22:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:22:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:22:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:22:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:22:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:22:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43544258
Sun 19 Jan 2014 22:22:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:22:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43544258
Sun 19 Jan 2014 22:22:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:22:50 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:22:50 - job_xml_thread(): Done retrieving: data size 43544258
Sun 19 Jan 2014 22:22:50 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:22:50 - XML: Start document: iteration 15
Sun 19 Jan 2014 22:22:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:22:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:22:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:22:59 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:22:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:22:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:23:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:23:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:23:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:23:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:23:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:23:06 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 22:23:06 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:23:06 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:23:06 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:23:06 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:23:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:23:07 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:23:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:23:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:23:08 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:23:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 22:23:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:23:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:23:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:23:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:23:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:23:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:23:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573731
Sun 19 Jan 2014 22:23:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:23:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573731
Sun 19 Jan 2014 22:23:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:23:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:23:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:23:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:23:19 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:23:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:23:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:23:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:23:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:23:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:23:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573731
Sun 19 Jan 2014 22:23:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:23:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:23:21 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:23:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:23:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:23:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:23:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:23:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:23:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:23:34 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:23:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:23:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:23:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:23:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:23:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:23:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:23:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:23:35 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:23:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:23:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 22:23:35 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:23:35 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:23:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 22:23:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5725 values 90335 bits 11291 bytes 
Sun 19 Jan 2014 22:23:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:23:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:23:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:23:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:23:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:23:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:23:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:23:37 - job_xml_thread(): Done retrieving: data size 43495721
Sun 19 Jan 2014 22:23:37 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:23:37 - XML: Start document: iteration 16
Sun 19 Jan 2014 22:23:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43495721
Sun 19 Jan 2014 22:23:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:23:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43495721
Sun 19 Jan 2014 22:23:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:23:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:23:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:23:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:23:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:23:55 - XML: Processed 652590 elements - found 0 jobs
Sun 19 Jan 2014 22:23:55 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:23:55 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:23:55 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:23:55 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:23:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:23:57 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:23:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:23:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:23:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:23:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:23:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:23:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:23:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:24:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:24:01 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:24:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:24:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:24:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:24:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:24:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:24:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:24:03 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 22:24:03 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 22:24:03 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:24:03 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:24:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 22:24:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:24:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:24:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42926311
Sun 19 Jan 2014 22:24:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:24:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42926311
Sun 19 Jan 2014 22:24:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:24:10 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:24:11 - job_xml_thread(): Done retrieving: data size 42926311
Sun 19 Jan 2014 22:24:11 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:24:11 - XML: Start document: iteration 17
Sun 19 Jan 2014 22:24:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:24:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:24:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:24:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:24:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:24:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:24:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:24:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:24:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:24:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:24:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:24:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:24:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:24:24 - XML: Processed 645152 elements - found 0 jobs
Sun 19 Jan 2014 22:24:24 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:24:24 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:24:24 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:24:24 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:24:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:24:26 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:24:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:24:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:24:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:24:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:24:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:24:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:24:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:24:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42991577
Sun 19 Jan 2014 22:24:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:24:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42991577
Sun 19 Jan 2014 22:24:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:24:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:24:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:24:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:24:35 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:24:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:24:36 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:24:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:24:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:24:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:24:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 22:24:37 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:24:37 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:24:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 22:24:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:24:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:24:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:24:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:24:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42991577
Sun 19 Jan 2014 22:24:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:24:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7491 values 118196 bits 14774 bytes 
Sun 19 Jan 2014 22:24:39 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:24:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:24:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:24:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:24:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:24:48 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:24:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:24:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:24:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:24:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:24:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:24:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:24:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:24:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:24:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:24:52 - job_xml_thread(): Done retrieving: data size 43500600
Sun 19 Jan 2014 22:24:52 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:24:52 - XML: Start document: iteration 18
Sun 19 Jan 2014 22:24:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:24:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:24:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43500600
Sun 19 Jan 2014 22:24:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:24:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:24:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:24:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:24:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:24:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43500600
Sun 19 Jan 2014 22:24:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:25:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:25:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:25:08 - XML: Processed 652570 elements - found 0 jobs
Sun 19 Jan 2014 22:25:08 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:25:08 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:25:08 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:25:08 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:25:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:25:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:25:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:25:10 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:25:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:25:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:25:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:25:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:25:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:25:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:25:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:25:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:25:14 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:25:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:25:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:25:14 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:25:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 22:25:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:25:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:25:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:25:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:25:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:25:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:25:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576212
Sun 19 Jan 2014 22:25:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:25:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576212
Sun 19 Jan 2014 22:25:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:25:23 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:25:24 - job_xml_thread(): Done retrieving: data size 43576212
Sun 19 Jan 2014 22:25:24 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:25:24 - XML: Start document: iteration 19
Sun 19 Jan 2014 22:25:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:25:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:25:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:25:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:25:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:25:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:25:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:25:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:25:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:25:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:25:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:25:34 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 22:25:34 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:25:34 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:25:34 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:25:34 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:25:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:25:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:25:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:25:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:25:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:25:37 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:25:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:25:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:25:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:25:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 22:25:38 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:25:38 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:25:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 22:25:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:25:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:25:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5765 values 90960 bits 11370 bytes 
Sun 19 Jan 2014 22:25:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:25:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577862
Sun 19 Jan 2014 22:25:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:25:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577862
Sun 19 Jan 2014 22:25:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:25:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:25:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:25:46 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 22:25:46 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:25:47 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:25:47 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 22:25:47 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 22:25:47 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:25:47 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 22:25:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:25:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:25:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:25:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:25:49 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:25:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:25:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:25:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:25:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:25:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:25:51 - size of cluster 'LISA Cluster': 624 hosts 79477 metrics 752053 values 11871753 bits 1483969 bytes 
Sun 19 Jan 2014 22:25:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:25:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:25:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:25:55 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:25:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:25:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:25:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:25:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:25:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:25:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:25:57 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:25:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 22:25:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:25:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:25:58 - job_xml_thread(): Done retrieving: data size 43556204
Sun 19 Jan 2014 22:25:58 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:25:58 - XML: Start document: iteration 20
Sun 19 Jan 2014 22:25:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556204
Sun 19 Jan 2014 22:25:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556204
Sun 19 Jan 2014 22:25:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:25:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:26:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:26:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:26:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:26:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:26:11 - XML: Processed 653349 elements - found 0 jobs
Sun 19 Jan 2014 22:26:11 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:26:11 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:26:11 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:26:11 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:26:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:26:19 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:26:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:26:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:26:19 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:26:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:26:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:26:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:26:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:26:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:26:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:26:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:26:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:26:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:26:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:26:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:26:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:26:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:26:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43601653
Sun 19 Jan 2014 22:26:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:26:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43601653
Sun 19 Jan 2014 22:26:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:26:26 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:26:26 - job_xml_thread(): Done retrieving: data size 43601653
Sun 19 Jan 2014 22:26:26 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:26:26 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 22:26:28 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 22:26:28 - Housekeeping: done.
Sun 19 Jan 2014 22:26:28 - XML: Start document: iteration 0
Sun 19 Jan 2014 22:26:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:26:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:26:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:26:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:26:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:26:38 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:26:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:26:40 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:26:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:26:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:26:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 22:26:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 22:26:41 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:26:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7704 values 121543 bits 15192 bytes 
Sun 19 Jan 2014 22:26:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:26:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:26:42 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 22:26:42 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:26:42 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:26:42 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:26:42 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:26:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:26:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:26:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:26:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:26:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:26:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:26:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:26:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:26:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:26:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:26:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:26:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:26:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:26:48 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:26:48 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 22:26:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:26:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43586553
Sun 19 Jan 2014 22:26:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:26:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43586553
Sun 19 Jan 2014 22:26:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:26:57 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:26:57 - job_xml_thread(): Done retrieving: data size 43586553
Sun 19 Jan 2014 22:26:57 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:26:57 - XML: Start document: iteration 1
Sun 19 Jan 2014 22:26:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:26:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:27:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:27:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:27:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:27:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:27:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:27:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:27:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:27:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:27:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:27:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:27:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:27:11 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 22:27:11 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:27:11 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:27:11 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:27:11 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:27:12 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:27:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 22:27:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:27:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:27:14 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:27:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:27:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:27:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:27:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:27:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:27:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:27:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:27:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574148
Sun 19 Jan 2014 22:27:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:27:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574148
Sun 19 Jan 2014 22:27:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:27:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:27:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:27:26 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:27:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:27:27 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:27:27 - job_xml_thread(): Done retrieving: data size 43574148
Sun 19 Jan 2014 22:27:27 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:27:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:27:28 - XML: Start document: iteration 2
Sun 19 Jan 2014 22:27:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:27:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:27:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:27:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:27:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:27:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:27:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:27:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:27:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:27:37 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:27:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:27:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:27:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:27:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:27:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:27:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:27:40 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 22:27:40 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:27:40 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:27:40 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:27:40 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:27:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:27:41 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:27:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:27:42 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:27:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 22:27:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 22:27:42 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:27:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6054 values 95535 bits 11941 bytes 
Sun 19 Jan 2014 22:27:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:27:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43547689
Sun 19 Jan 2014 22:27:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:27:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:27:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:27:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43547689
Sun 19 Jan 2014 22:27:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:27:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:27:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:27:54 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:27:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:27:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:27:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:27:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:27:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:27:55 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:27:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:27:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:27:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:27:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:27:59 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:27:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:27:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:28:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:28:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:28:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:28:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:28:03 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:28:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 22:28:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:28:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:28:03 - job_xml_thread(): Done retrieving: data size 43570280
Sun 19 Jan 2014 22:28:03 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:28:03 - XML: Start document: iteration 3
Sun 19 Jan 2014 22:28:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570280
Sun 19 Jan 2014 22:28:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:28:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570280
Sun 19 Jan 2014 22:28:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:28:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:28:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:28:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:28:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:28:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:28:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:28:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:28:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:28:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:28:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:28:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:28:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:28:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:28:18 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 22:28:18 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:28:18 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:28:18 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:28:18 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:28:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:28:24 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:28:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:28:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:28:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:28:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:28:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:28:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:28:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:28:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564705
Sun 19 Jan 2014 22:28:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:28:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564705
Sun 19 Jan 2014 22:28:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:28:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:28:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:28:33 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:28:34 - job_xml_thread(): Done retrieving: data size 43564705
Sun 19 Jan 2014 22:28:34 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:28:34 - XML: Start document: iteration 4
Sun 19 Jan 2014 22:28:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:28:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:28:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:28:42 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:28:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:28:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 22:28:43 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:28:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 22:28:43 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:28:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7154 values 112856 bits 14107 bytes 
Sun 19 Jan 2014 22:28:51 - XML: Processed 653349 elements - found 0 jobs
Sun 19 Jan 2014 22:28:51 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:28:51 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:28:51 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:28:51 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:28:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:28:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:28:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:28:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:28:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:28:52 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:28:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:28:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:28:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:28:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:28:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:28:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:28:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:28:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:28:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:28:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:28:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:28:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:28:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43592604
Sun 19 Jan 2014 22:28:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:28:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43592604
Sun 19 Jan 2014 22:28:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:29:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:29:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:29:06 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:29:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:29:07 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:29:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 22:29:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:29:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:29:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:29:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:29:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:29:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:29:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:29:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:29:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:29:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:29:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:29:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:29:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:29:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:29:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:29:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:29:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:29:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:29:14 - job_xml_thread(): Done retrieving: data size 43496160
Sun 19 Jan 2014 22:29:14 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:29:14 - XML: Start document: iteration 5
Sun 19 Jan 2014 22:29:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43496160
Sun 19 Jan 2014 22:29:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:29:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43496160
Sun 19 Jan 2014 22:29:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:29:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:29:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:29:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:29:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:29:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:29:30 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:29:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:29:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:29:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:29:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:29:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:29:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:29:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:29:36 - XML: Processed 652602 elements - found 0 jobs
Sun 19 Jan 2014 22:29:36 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:29:36 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:29:36 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:29:36 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:29:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:29:37 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:29:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:29:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:29:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:29:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:29:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:29:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:29:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:29:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43019579
Sun 19 Jan 2014 22:29:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:29:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43019579
Sun 19 Jan 2014 22:29:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:29:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:29:43 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:29:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:29:44 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:29:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 22:29:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 22:29:44 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:29:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9305 values 146777 bits 18347 bytes 
Sun 19 Jan 2014 22:29:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:29:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:29:51 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:29:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:29:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:29:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:29:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:29:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:29:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:29:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:29:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:29:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:29:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:29:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:29:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:29:57 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:29:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:29:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:29:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:29:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:29:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:29:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:30:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:30:01 - job_xml_thread(): Done retrieving: data size 42907549
Sun 19 Jan 2014 22:30:01 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:30:01 - XML: Start document: iteration 6
Sun 19 Jan 2014 22:30:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42907549
Sun 19 Jan 2014 22:30:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:30:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42907549
Sun 19 Jan 2014 22:30:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:30:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:30:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:30:13 - XML: Processed 645274 elements - found 0 jobs
Sun 19 Jan 2014 22:30:13 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:30:13 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:30:13 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:30:13 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:30:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:30:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:30:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:30:20 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:30:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:30:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:30:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:30:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:30:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:30:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:30:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:30:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:30:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:30:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:30:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:30:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:30:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:30:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:30:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:30:23 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:30:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 22:30:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:30:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:30:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42987327
Sun 19 Jan 2014 22:30:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:30:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42987327
Sun 19 Jan 2014 22:30:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:30:28 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:30:28 - job_xml_thread(): Done retrieving: data size 42987327
Sun 19 Jan 2014 22:30:28 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:30:28 - XML: Start document: iteration 7
Sun 19 Jan 2014 22:30:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:30:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:30:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:30:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:30:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:30:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:30:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:30:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:30:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:30:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:30:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:30:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:30:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:30:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:30:44 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:30:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:30:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 22:30:45 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:30:45 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:30:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 22:30:46 - XML: Processed 645914 elements - found 0 jobs
Sun 19 Jan 2014 22:30:46 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:30:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5678 values 89532 bits 11191 bytes 
Sun 19 Jan 2014 22:30:46 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:30:46 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:30:46 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:30:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:30:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:30:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:30:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:30:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:30:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:30:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:30:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:30:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:30:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43517814
Sun 19 Jan 2014 22:30:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:30:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43517814
Sun 19 Jan 2014 22:30:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:30:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:30:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:31:01 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:31:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:31:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:31:02 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:31:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:31:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:31:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:31:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:31:03 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:31:03 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:31:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:31:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:31:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:31:07 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:31:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:31:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:31:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:31:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:31:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:31:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:31:07 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:31:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 22:31:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:31:08 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 22:31:08 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 22:31:08 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:31:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:31:10 - job_xml_thread(): Done retrieving: data size 43584643
Sun 19 Jan 2014 22:31:10 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:31:10 - XML: Start document: iteration 8
Sun 19 Jan 2014 22:31:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584643
Sun 19 Jan 2014 22:31:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:31:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584643
Sun 19 Jan 2014 22:31:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:31:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:31:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:31:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:31:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:31:26 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 22:31:26 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:31:26 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:31:26 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:31:26 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:31:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:31:27 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:31:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:31:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:31:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:31:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:31:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:31:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:31:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:31:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:31:31 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:31:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:31:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:31:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:31:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:31:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:31:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:31:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:31:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578960
Sun 19 Jan 2014 22:31:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:31:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578960
Sun 19 Jan 2014 22:31:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:31:41 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:31:41 - job_xml_thread(): Done retrieving: data size 43578960
Sun 19 Jan 2014 22:31:41 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:31:41 - XML: Start document: iteration 9
Sun 19 Jan 2014 22:31:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:31:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:31:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:31:44 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:31:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:31:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:31:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:31:46 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:31:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:31:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:31:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:31:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:31:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:31:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:31:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 22:31:46 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:31:46 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:31:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 22:31:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:31:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:31:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8810 values 139220 bits 17402 bytes 
Sun 19 Jan 2014 22:31:51 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 22:31:51 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:31:51 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:31:51 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:31:51 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:31:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:31:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:31:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:31:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:31:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:31:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:31:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:31:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:31:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:31:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560194
Sun 19 Jan 2014 22:31:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:31:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560194
Sun 19 Jan 2014 22:31:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:32:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:32:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:32:06 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:32:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:32:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:32:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:32:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:32:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:32:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:32:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:32:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:32:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:32:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:32:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:32:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:32:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:32:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:32:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:32:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:32:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:32:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:32:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:32:12 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:32:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 22:32:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:32:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:32:14 - job_xml_thread(): Done retrieving: data size 43567974
Sun 19 Jan 2014 22:32:14 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:32:14 - XML: Start document: iteration 10
Sun 19 Jan 2014 22:32:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567974
Sun 19 Jan 2014 22:32:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567974
Sun 19 Jan 2014 22:32:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:32:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:32:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:32:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:32:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:32:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:32:31 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 22:32:32 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:32:32 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:32:32 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:32:32 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:32:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:32:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:32:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:32:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:32:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:32:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:32:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:32:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:32:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:32:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:32:37 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:32:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:32:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:32:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:32:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:32:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:32:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:32:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:32:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43609136
Sun 19 Jan 2014 22:32:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:32:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43609136
Sun 19 Jan 2014 22:32:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:32:47 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:32:47 - job_xml_thread(): Done retrieving: data size 43609136
Sun 19 Jan 2014 22:32:47 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:32:47 - XML: Start document: iteration 11
Sun 19 Jan 2014 22:32:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:32:47 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:32:48 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 22:32:48 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:32:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:32:49 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:32:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 22:32:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 22:32:49 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:32:49 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:32:49 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:32:49 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 22:32:49 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 22:32:50 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 22:32:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:32:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:32:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8746 values 138384 bits 17298 bytes 
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sun 19 Jan 2014 22:32:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:32:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:32:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:32:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:32:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:32:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:32:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:32:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:32:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:32:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:32:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:32:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:32:59 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:32:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:32:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:33:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:33:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:33:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:33:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:33:01 - XML: Processed 653349 elements - found 0 jobs
Sun 19 Jan 2014 22:33:01 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:33:01 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:33:01 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:33:01 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:33:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:33:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570701
Sun 19 Jan 2014 22:33:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:33:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570701
Sun 19 Jan 2014 22:33:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:33:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:33:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:33:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:33:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:33:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:33:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:33:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:33:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:33:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:33:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570701
Sun 19 Jan 2014 22:33:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:33:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:33:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:33:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:33:17 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:33:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:33:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:33:25 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:33:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:33:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:33:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:33:25 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:33:26 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:33:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 22:33:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:33:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:33:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:33:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:33:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:33:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:33:28 - job_xml_thread(): Done retrieving: data size 43548128
Sun 19 Jan 2014 22:33:28 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:33:28 - XML: Start document: iteration 12
Sun 19 Jan 2014 22:33:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:33:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:33:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43548128
Sun 19 Jan 2014 22:33:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:33:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:33:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:33:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:33:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:33:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43548128
Sun 19 Jan 2014 22:33:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:33:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:33:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:33:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:33:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:33:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:33:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:33:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:33:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:33:49 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 22:33:49 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:33:49 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:33:49 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:33:49 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:33:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:33:49 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:33:49 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:33:49 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:33:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:33:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:33:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:33:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:33:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:33:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:33:49 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:33:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 22:33:49 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:33:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5834 values 92181 bits 11522 bytes 
Sun 19 Jan 2014 22:33:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 22:33:50 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:33:50 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:33:50 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 22:33:50 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 22:33:50 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 22:33:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:33:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:33:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:33:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:33:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:33:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:33:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:33:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:33:51 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 815691 values 12895109 bits 1611888 bytes 
Sun 19 Jan 2014 22:33:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:33:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583698
Sun 19 Jan 2014 22:33:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:33:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583698
Sun 19 Jan 2014 22:33:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:34:04 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:34:04 - job_xml_thread(): Done retrieving: data size 43583698
Sun 19 Jan 2014 22:34:04 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:34:04 - XML: Start document: iteration 13
Sun 19 Jan 2014 22:34:05 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:34:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 22:34:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:34:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:34:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:34:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:34:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:34:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:34:06 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:34:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:34:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:34:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:34:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:34:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:34:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:34:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:34:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:34:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:34:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:34:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:34:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:34:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:34:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:34:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:34:17 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 22:34:17 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:34:17 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:34:17 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:34:17 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:34:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:34:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566326
Sun 19 Jan 2014 22:34:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:34:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566326
Sun 19 Jan 2014 22:34:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:34:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:34:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:34:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:34:28 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:34:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:34:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:34:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:34:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:34:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:34:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:34:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566326
Sun 19 Jan 2014 22:34:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:34:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:34:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:34:32 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:34:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:34:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:34:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:34:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:34:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:34:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:34:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:34:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:34:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:34:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:34:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:34:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:34:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:34:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:34:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:34:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:34:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:34:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:34:46 - job_xml_thread(): Done retrieving: data size 43548314
Sun 19 Jan 2014 22:34:46 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:34:46 - XML: Start document: iteration 14
Sun 19 Jan 2014 22:34:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43548314
Sun 19 Jan 2014 22:34:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43548314
Sun 19 Jan 2014 22:34:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:34:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:34:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:34:50 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:34:51 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:34:51 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 22:34:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:34:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 22:34:51 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:34:51 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:34:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 22:34:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9346 values 147526 bits 18440 bytes 
Sun 19 Jan 2014 22:34:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:34:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:34:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:34:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:35:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:35:07 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:35:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:35:07 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 22:35:07 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:35:07 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:35:07 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:35:07 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:35:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:35:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:35:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:35:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:35:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:35:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:35:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:35:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:35:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:35:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:35:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:35:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:35:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:35:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:35:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:35:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43512187
Sun 19 Jan 2014 22:35:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:35:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43512187
Sun 19 Jan 2014 22:35:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:35:22 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:35:22 - job_xml_thread(): Done retrieving: data size 43512187
Sun 19 Jan 2014 22:35:22 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:35:22 - XML: Start document: iteration 15
Sun 19 Jan 2014 22:35:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:35:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:35:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:35:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:35:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:35:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:35:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:35:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:35:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:35:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:35:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:35:33 - XML: Processed 652602 elements - found 0 jobs
Sun 19 Jan 2014 22:35:33 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:35:33 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:35:33 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:35:33 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:35:34 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:35:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 22:35:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:35:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:35:35 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:35:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:35:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:35:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:35:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:35:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:35:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:35:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:35:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43476459
Sun 19 Jan 2014 22:35:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:35:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:35:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:35:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43476459
Sun 19 Jan 2014 22:35:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:35:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:35:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:35:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:35:49 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:35:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:35:49 - job_xml_thread(): Done retrieving: data size 43476459
Sun 19 Jan 2014 22:35:49 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:35:49 - XML: Start document: iteration 16
Sun 19 Jan 2014 22:35:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:35:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:35:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:35:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:35:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:35:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:35:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:35:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:35:52 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:35:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:35:52 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:35:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 22:35:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 22:35:53 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:35:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5999 values 94667 bits 11833 bytes 
Sun 19 Jan 2014 22:35:58 - XML: Processed 652392 elements - found 0 jobs
Sun 19 Jan 2014 22:35:58 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:35:58 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:35:58 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:35:58 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:36:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:36:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:36:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:36:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:36:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:36:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:36:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:36:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:36:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:36:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:36:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:36:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42894002
Sun 19 Jan 2014 22:36:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:36:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42894002
Sun 19 Jan 2014 22:36:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:36:13 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:36:13 - job_xml_thread(): Done retrieving: data size 42894002
Sun 19 Jan 2014 22:36:13 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:36:13 - XML: Start document: iteration 17
Sun 19 Jan 2014 22:36:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:36:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:36:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:36:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:36:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:36:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:36:27 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:36:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 22:36:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:36:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:36:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:36:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:36:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:36:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:36:28 - XML: Processed 645200 elements - found 0 jobs
Sun 19 Jan 2014 22:36:28 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:36:28 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:36:28 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:36:28 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:36:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:36:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:36:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:36:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:36:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:36:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:36:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:36:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:36:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:36:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42988661
Sun 19 Jan 2014 22:36:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:36:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42988661
Sun 19 Jan 2014 22:36:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:36:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:36:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:36:43 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:36:43 - job_xml_thread(): Done retrieving: data size 42988661
Sun 19 Jan 2014 22:36:43 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:36:43 - XML: Start document: iteration 18
Sun 19 Jan 2014 22:36:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:36:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:36:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:36:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:36:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:36:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:36:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:36:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:36:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:36:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:36:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:36:51 - XML: Processed 645914 elements - found 0 jobs
Sun 19 Jan 2014 22:36:51 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:36:51 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:36:51 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:36:51 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:36:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:36:53 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:36:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:36:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 22:36:53 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:36:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5897 values 93037 bits 11629 bytes 
Sun 19 Jan 2014 22:36:53 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:36:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 22:36:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:36:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:36:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:36:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:36:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:36:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:36:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:36:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:36:56 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 22:36:56 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 22:36:56 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:36:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:36:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43552795
Sun 19 Jan 2014 22:36:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:36:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43552795
Sun 19 Jan 2014 22:36:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:37:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:37:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:37:06 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:37:06 - job_xml_thread(): Done retrieving: data size 43552795
Sun 19 Jan 2014 22:37:06 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:37:06 - XML: Start document: iteration 19
Sun 19 Jan 2014 22:37:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:37:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:37:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:37:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:37:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:37:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:37:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:37:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:37:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:37:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:37:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:37:16 - XML: Processed 653208 elements - found 0 jobs
Sun 19 Jan 2014 22:37:16 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:37:16 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:37:16 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:37:16 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:37:18 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:37:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 22:37:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:37:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:37:20 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:37:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:37:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:37:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:37:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:37:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:37:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:37:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:37:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576715
Sun 19 Jan 2014 22:37:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:37:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576715
Sun 19 Jan 2014 22:37:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:37:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:37:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:37:31 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:37:31 - job_xml_thread(): Done retrieving: data size 43576715
Sun 19 Jan 2014 22:37:31 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:37:31 - XML: Start document: iteration 20
Sun 19 Jan 2014 22:37:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:37:31 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:37:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:37:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:37:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:37:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:37:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:37:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:37:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:37:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:37:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:37:41 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 22:37:41 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:37:41 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:37:41 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:37:41 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:37:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:37:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:37:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:37:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:37:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:37:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:37:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:37:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:37:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:37:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43546476
Sun 19 Jan 2014 22:37:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:37:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43546476
Sun 19 Jan 2014 22:37:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:37:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:37:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:37:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:37:54 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:37:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:37:54 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:37:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:37:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:37:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:37:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:37:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:37:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:37:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43546476
Sun 19 Jan 2014 22:37:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:37:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:37:55 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:37:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 22:37:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 22:37:56 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:37:56 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:37:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:37:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8997 values 141946 bits 17743 bytes 
Sun 19 Jan 2014 22:37:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:37:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:38:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:38:03 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:38:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:38:07 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:38:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:38:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:38:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:38:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:38:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:38:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:38:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:38:09 - job_xml_thread(): Done retrieving: data size 43562630
Sun 19 Jan 2014 22:38:09 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:38:09 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 22:38:09 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 22:38:09 - Housekeeping: done.
Sun 19 Jan 2014 22:38:09 - XML: Start document: iteration 0
Sun 19 Jan 2014 22:38:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:38:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:38:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562630
Sun 19 Jan 2014 22:38:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:38:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:38:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:38:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:38:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562630
Sun 19 Jan 2014 22:38:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:38:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:38:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:38:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:38:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:38:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:38:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:38:27 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:38:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:38:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:38:28 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 22:38:28 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:38:28 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:38:28 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:38:28 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:38:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:38:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:38:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:38:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:38:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:38:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:38:31 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:38:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:38:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:38:32 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:38:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 22:38:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:38:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:38:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:38:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:38:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:38:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:38:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43592002
Sun 19 Jan 2014 22:38:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:38:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43592002
Sun 19 Jan 2014 22:38:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:38:43 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:38:43 - job_xml_thread(): Done retrieving: data size 43592002
Sun 19 Jan 2014 22:38:43 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:38:44 - XML: Start document: iteration 1
Sun 19 Jan 2014 22:38:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:38:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:38:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:38:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:38:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:38:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:38:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:38:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:38:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:38:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:38:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:38:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:38:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:38:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:38:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:38:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:38:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:38:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:38:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:38:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:38:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:38:55 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 22:38:55 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:38:55 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:38:55 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:38:55 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:38:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:38:56 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:38:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:38:56 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:38:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 22:38:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 22:38:56 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:38:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5488 values 86523 bits 10815 bytes 
Sun 19 Jan 2014 22:38:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:38:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573904
Sun 19 Jan 2014 22:38:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:38:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573904
Sun 19 Jan 2014 22:38:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:39:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:39:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:39:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:39:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:39:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:39:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:39:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:39:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:39:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:39:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:39:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:39:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:39:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:39:10 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:39:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:39:11 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:39:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:39:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:39:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:39:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:39:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:39:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:39:13 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:39:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 22:39:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:39:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:39:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574405
Sun 19 Jan 2014 22:39:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:39:14 - job_xml_thread(): Done retrieving: data size 43574405
Sun 19 Jan 2014 22:39:14 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:39:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574405
Sun 19 Jan 2014 22:39:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:39:14 - XML: Start document: iteration 2
Sun 19 Jan 2014 22:39:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:39:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:39:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:39:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:39:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:39:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:39:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:39:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:39:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:39:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:39:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:39:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:39:34 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:39:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:39:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:39:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:39:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:39:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:39:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:39:35 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 22:39:35 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:39:35 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:39:35 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:39:35 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:39:37 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:39:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565749
Sun 19 Jan 2014 22:39:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:39:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565749
Sun 19 Jan 2014 22:39:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:39:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:39:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:39:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:39:46 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:39:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:39:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:39:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:39:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:39:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:39:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:39:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:39:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:39:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:39:51 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:39:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:39:51 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:39:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:39:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:39:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:39:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:39:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:39:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:39:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:39:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43600295
Sun 19 Jan 2014 22:39:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:39:53 - job_xml_thread(): Done retrieving: data size 43600295
Sun 19 Jan 2014 22:39:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43600295
Sun 19 Jan 2014 22:39:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:39:53 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:39:53 - XML: Start document: iteration 3
Sun 19 Jan 2014 22:39:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:39:57 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:39:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:39:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 22:39:58 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:39:58 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:39:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 22:40:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 10359 values 163387 bits 20423 bytes 
Sun 19 Jan 2014 22:40:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:40:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:40:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:40:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:40:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:40:07 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:40:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:40:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:40:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:40:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:40:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:40:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:40:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:40:09 - XML: Processed 653348 elements - found 0 jobs
Sun 19 Jan 2014 22:40:09 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:40:09 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:40:09 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:40:09 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:40:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:40:14 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:40:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:40:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:40:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:40:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:40:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:40:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:40:17 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:40:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 22:40:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:40:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:40:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562752
Sun 19 Jan 2014 22:40:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:40:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562752
Sun 19 Jan 2014 22:40:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:40:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:40:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:40:25 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:40:25 - job_xml_thread(): Done retrieving: data size 43562752
Sun 19 Jan 2014 22:40:25 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:40:25 - XML: Start document: iteration 4
Sun 19 Jan 2014 22:40:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:40:27 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:40:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:40:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:40:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:40:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:40:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:40:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:40:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:40:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:40:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:40:37 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 22:40:37 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:40:37 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:40:37 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:40:37 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:40:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:40:39 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:40:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:40:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:40:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:40:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:40:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:40:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:40:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:40:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43552228
Sun 19 Jan 2014 22:40:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:40:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43552228
Sun 19 Jan 2014 22:40:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:40:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:40:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:40:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:40:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:40:52 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 22:40:52 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:40:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:40:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:40:52 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:40:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:40:53 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:40:53 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:40:53 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 22:40:53 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 22:40:53 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 22:40:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:40:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:40:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:40:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sun 19 Jan 2014 22:40:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:40:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:40:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:40:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:40:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:40:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:40:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:40:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:40:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:40:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:40:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:40:58 - job_xml_thread(): Done retrieving: data size 43566736
Sun 19 Jan 2014 22:40:58 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:40:58 - XML: Start document: iteration 5
Sun 19 Jan 2014 22:40:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566736
Sun 19 Jan 2014 22:40:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:40:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566736
Sun 19 Jan 2014 22:40:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:40:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:41:00 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:41:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:41:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 22:41:02 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:41:02 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:41:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 22:41:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148689 bits 18586 bytes 
Sun 19 Jan 2014 22:41:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:41:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:41:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:41:10 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:41:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:41:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:41:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:41:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:41:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:41:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:41:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:41:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:41:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:41:16 - XML: Processed 653351 elements - found 0 jobs
Sun 19 Jan 2014 22:41:16 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:41:16 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:41:16 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:41:16 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:41:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:41:19 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:41:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:41:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:41:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:41:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:41:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:41:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:41:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:41:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43514005
Sun 19 Jan 2014 22:41:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:41:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43514005
Sun 19 Jan 2014 22:41:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:41:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:41:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:41:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:41:30 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:41:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:41:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:41:31 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:41:31 - job_xml_thread(): Done retrieving: data size 43514005
Sun 19 Jan 2014 22:41:31 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:41:31 - XML: Start document: iteration 6
Sun 19 Jan 2014 22:41:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:41:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:41:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:41:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:41:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:41:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:41:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:41:42 - XML: Processed 652602 elements - found 0 jobs
Sun 19 Jan 2014 22:41:42 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:41:42 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:41:42 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:41:42 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:41:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:41:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:41:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:41:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:41:44 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:41:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 22:41:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:41:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:41:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:41:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:41:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:41:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:41:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42998181
Sun 19 Jan 2014 22:41:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:41:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42998181
Sun 19 Jan 2014 22:41:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:41:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:41:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:41:53 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:41:53 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:41:55 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:41:55 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:41:55 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 22:41:55 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 22:41:55 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 22:41:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:41:57 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:41:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:41:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:41:57 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:41:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:41:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:41:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:41:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:41:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:41:59 - size of cluster 'LISA Cluster': 624 hosts 79484 metrics 988163 values 15586239 bits 1948279 bytes 
Sun 19 Jan 2014 22:42:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:42:00 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:42:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:42:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:42:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:42:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:42:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:42:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:42:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:42:02 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:42:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:42:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 22:42:03 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:42:03 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:42:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5783 values 91187 bits 11398 bytes 
Sun 19 Jan 2014 22:42:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 22:42:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:42:06 - job_xml_thread(): Done retrieving: data size 42922422
Sun 19 Jan 2014 22:42:06 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:42:06 - XML: Start document: iteration 7
Sun 19 Jan 2014 22:42:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42922422
Sun 19 Jan 2014 22:42:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:42:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42922422
Sun 19 Jan 2014 22:42:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:42:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:42:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:42:14 - XML: Processed 645152 elements - found 0 jobs
Sun 19 Jan 2014 22:42:14 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:42:14 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:42:14 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:42:14 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:42:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:42:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:42:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:42:27 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:42:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:42:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:42:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:42:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:42:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:42:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:42:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:42:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:42:29 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:42:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:42:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:42:29 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:42:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:42:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:42:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:42:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:42:33 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:42:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 22:42:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:42:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:42:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42996757
Sun 19 Jan 2014 22:42:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:42:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42996757
Sun 19 Jan 2014 22:42:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:42:34 - job_xml_thread(): Done retrieving: data size 42996757
Sun 19 Jan 2014 22:42:34 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:42:34 - XML: Start document: iteration 8
Sun 19 Jan 2014 22:42:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:42:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:42:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:42:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:42:50 - XML: Processed 645914 elements - found 0 jobs
Sun 19 Jan 2014 22:42:50 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:42:50 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:42:50 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:42:50 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:42:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:42:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:42:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:42:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:42:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:42:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:42:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:42:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:42:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:42:56 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:42:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:42:56 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 22:42:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:42:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:42:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:42:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:42:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:42:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:42:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:43:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:43:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573949
Sun 19 Jan 2014 22:43:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:43:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573949
Sun 19 Jan 2014 22:43:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:43:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:43:03 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:43:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:43:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 22:43:04 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:43:04 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:43:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 22:43:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7286 values 114969 bits 14371 bytes 
Sun 19 Jan 2014 22:43:05 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:43:05 - job_xml_thread(): Done retrieving: data size 43573949
Sun 19 Jan 2014 22:43:05 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:43:05 - XML: Start document: iteration 9
Sun 19 Jan 2014 22:43:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:43:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:43:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:43:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:43:19 - XML: Processed 653268 elements - found 0 jobs
Sun 19 Jan 2014 22:43:19 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:43:19 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:43:19 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:43:19 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:43:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:43:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:43:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:43:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:43:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:43:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:43:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:43:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:43:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:43:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:43:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:43:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:43:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:43:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:43:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:43:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:43:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:43:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:43:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574160
Sun 19 Jan 2014 22:43:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:43:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574160
Sun 19 Jan 2014 22:43:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:43:34 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:43:34 - job_xml_thread(): Done retrieving: data size 43574160
Sun 19 Jan 2014 22:43:34 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:43:34 - XML: Start document: iteration 10
Sun 19 Jan 2014 22:43:36 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:43:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 22:43:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:43:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:43:36 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:43:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:43:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:43:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:43:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:43:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:43:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:43:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:43:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:43:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:43:50 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 22:43:50 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:43:50 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:43:50 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:43:50 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:43:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:43:51 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:43:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:43:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:43:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:43:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:43:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:43:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:43:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:43:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:43:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:43:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43543374
Sun 19 Jan 2014 22:43:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:43:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43543374
Sun 19 Jan 2014 22:43:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:44:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:44:04 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:44:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:44:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 22:44:06 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:44:06 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:44:06 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:44:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:44:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 22:44:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6208 values 97942 bits 12242 bytes 
Sun 19 Jan 2014 22:44:06 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:44:06 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:44:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:44:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:44:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:44:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:44:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:44:08 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:44:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:44:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:44:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:44:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:44:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:44:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:44:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:44:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:44:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:44:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:44:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:44:16 - job_xml_thread(): Done retrieving: data size 43572426
Sun 19 Jan 2014 22:44:16 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:44:16 - XML: Start document: iteration 11
Sun 19 Jan 2014 22:44:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572426
Sun 19 Jan 2014 22:44:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:44:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572426
Sun 19 Jan 2014 22:44:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:44:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:44:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:44:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:44:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:44:29 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:44:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 22:44:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:44:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:44:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:44:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:44:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:44:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:44:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:44:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:44:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:44:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:44:36 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 22:44:36 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:44:36 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:44:36 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:44:36 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:44:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:44:39 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:44:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:44:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:44:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:44:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:44:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:44:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:44:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:44:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564414
Sun 19 Jan 2014 22:44:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:44:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564414
Sun 19 Jan 2014 22:44:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:44:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:44:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:44:51 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:44:51 - job_xml_thread(): Done retrieving: data size 43564414
Sun 19 Jan 2014 22:44:51 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:44:51 - XML: Start document: iteration 12
Sun 19 Jan 2014 22:44:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:44:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:44:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:44:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:44:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:44:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:44:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:44:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:44:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:44:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:44:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:45:01 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 22:45:01 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:45:02 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:45:02 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:45:02 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:45:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:45:05 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:45:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:45:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:45:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:45:06 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:45:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:45:06 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:45:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 22:45:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 22:45:06 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:45:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6204 values 97897 bits 12237 bytes 
Sun 19 Jan 2014 22:45:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:45:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:45:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:45:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:45:08 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 22:45:08 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 22:45:08 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:45:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:45:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567243
Sun 19 Jan 2014 22:45:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:45:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567243
Sun 19 Jan 2014 22:45:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:45:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:45:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:45:17 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:45:17 - job_xml_thread(): Done retrieving: data size 43567243
Sun 19 Jan 2014 22:45:17 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:45:17 - XML: Start document: iteration 13
Sun 19 Jan 2014 22:45:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:45:20 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:45:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:45:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:45:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:45:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:45:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:45:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:45:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:45:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:45:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:45:26 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 22:45:26 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:45:26 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:45:26 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:45:26 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:45:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:45:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:45:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:45:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:45:31 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:45:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 22:45:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:45:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:45:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:45:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:45:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:45:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:45:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556226
Sun 19 Jan 2014 22:45:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:45:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556226
Sun 19 Jan 2014 22:45:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:45:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:45:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:45:41 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:45:42 - job_xml_thread(): Done retrieving: data size 43556226
Sun 19 Jan 2014 22:45:42 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:45:42 - XML: Start document: iteration 14
Sun 19 Jan 2014 22:45:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:45:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:45:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:45:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:45:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:45:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:45:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:45:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:45:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:45:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:45:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:45:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:45:49 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:45:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:45:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:45:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:45:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:45:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:45:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:45:52 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 22:45:52 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:45:52 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:45:52 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:45:52 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:45:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:45:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43549845
Sun 19 Jan 2014 22:45:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:45:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43549845
Sun 19 Jan 2014 22:45:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:45:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:45:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:46:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:46:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:46:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:46:06 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:46:07 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:46:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:46:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:46:07 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:46:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:46:07 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:46:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 22:46:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 22:46:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:46:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:46:07 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:46:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8668 values 136737 bits 17092 bytes 
Sun 19 Jan 2014 22:46:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:46:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:46:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:46:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:46:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:46:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:46:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:46:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:46:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:46:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:46:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:46:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:46:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:46:13 - job_xml_thread(): Done retrieving: data size 43568197
Sun 19 Jan 2014 22:46:13 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:46:13 - XML: Start document: iteration 15
Sun 19 Jan 2014 22:46:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568197
Sun 19 Jan 2014 22:46:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:46:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568197
Sun 19 Jan 2014 22:46:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:46:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:46:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:46:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:46:25 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:46:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:46:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:46:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:46:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:46:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:46:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:46:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:46:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:46:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:46:33 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 22:46:33 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:46:33 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:46:33 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:46:33 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:46:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:46:37 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:46:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:46:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:46:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:46:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:46:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:46:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:46:37 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:46:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 22:46:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:46:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:46:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559435
Sun 19 Jan 2014 22:46:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:46:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559435
Sun 19 Jan 2014 22:46:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:46:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:46:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:46:49 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:46:49 - job_xml_thread(): Done retrieving: data size 43559435
Sun 19 Jan 2014 22:46:49 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:46:49 - XML: Start document: iteration 16
Sun 19 Jan 2014 22:46:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:46:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:46:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:46:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:46:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:46:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:46:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:46:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:46:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:46:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:46:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:47:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:47:01 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:47:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:47:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:47:02 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 22:47:02 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:47:02 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:47:02 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:47:02 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:47:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:47:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:47:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:47:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:47:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:47:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578646
Sun 19 Jan 2014 22:47:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:47:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578646
Sun 19 Jan 2014 22:47:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:47:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:47:07 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:47:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:47:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:47:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:47:09 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:47:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 22:47:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 22:47:09 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:47:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8977 values 141958 bits 17744 bytes 
Sun 19 Jan 2014 22:47:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:47:14 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:47:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:47:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:47:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:47:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:47:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:47:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:47:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:47:17 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:47:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:47:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:47:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:47:19 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:47:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:47:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:47:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:47:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:47:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:47:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:47:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:47:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43524253
Sun 19 Jan 2014 22:47:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:47:22 - job_xml_thread(): Done retrieving: data size 43524253
Sun 19 Jan 2014 22:47:22 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:47:23 - XML: Start document: iteration 17
Sun 19 Jan 2014 22:47:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43524253
Sun 19 Jan 2014 22:47:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:47:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:47:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:47:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:47:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:47:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:47:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:47:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:47:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:47:39 - XML: Processed 652599 elements - found 0 jobs
Sun 19 Jan 2014 22:47:39 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:47:39 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:47:39 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:47:39 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:47:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:47:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:47:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:47:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:47:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:47:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:47:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:47:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:47:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:47:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:47:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:47:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:47:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:47:44 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:47:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 22:47:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:47:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:47:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42955289
Sun 19 Jan 2014 22:47:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:47:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42955289
Sun 19 Jan 2014 22:47:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:47:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:47:54 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:47:54 - job_xml_thread(): Done retrieving: data size 42955289
Sun 19 Jan 2014 22:47:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:47:54 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:47:54 - XML: Start document: iteration 18
Sun 19 Jan 2014 22:47:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:47:58 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:47:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:47:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:47:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:47:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:48:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:48:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:48:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:48:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:48:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:48:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:48:03 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:48:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:48:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:48:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:48:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:48:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:48:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:48:06 - XML: Processed 645706 elements - found 0 jobs
Sun 19 Jan 2014 22:48:06 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:48:06 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:48:06 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:48:06 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:48:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:48:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42922327
Sun 19 Jan 2014 22:48:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:48:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42922327
Sun 19 Jan 2014 22:48:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:48:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:48:09 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:48:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:48:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 22:48:11 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:48:11 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:48:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 22:48:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8744 values 138301 bits 17287 bytes 
Sun 19 Jan 2014 22:48:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:48:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:48:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:48:18 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:48:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:48:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:48:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:48:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:48:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:48:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:48:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:48:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:48:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:48:21 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:48:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:48:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:48:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:48:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:48:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:48:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:48:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:48:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:48:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:48:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42976005
Sun 19 Jan 2014 22:48:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:48:25 - job_xml_thread(): Done retrieving: data size 42976005
Sun 19 Jan 2014 22:48:25 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:48:25 - XML: Start document: iteration 19
Sun 19 Jan 2014 22:48:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42976005
Sun 19 Jan 2014 22:48:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:48:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:48:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:48:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:48:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:48:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:48:39 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:48:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:48:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:48:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:48:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:48:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:48:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:48:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:48:44 - XML: Processed 645913 elements - found 0 jobs
Sun 19 Jan 2014 22:48:44 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:48:44 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:48:44 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:48:44 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:48:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:48:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:48:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:48:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:48:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:48:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:48:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:48:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:48:46 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:48:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 22:48:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:48:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:48:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43500135
Sun 19 Jan 2014 22:48:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:48:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43500135
Sun 19 Jan 2014 22:48:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:48:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:48:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:48:56 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 22:48:56 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:48:57 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:48:57 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 22:48:57 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 22:48:57 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:48:57 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 22:48:59 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:48:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:49:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:49:00 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:49:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:49:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:49:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:49:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:49:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:49:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:49:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:49:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:49:03 - size of cluster 'LISA Cluster': 624 hosts 79487 metrics 903272 values 14268985 bits 1783623 bytes 
Sun 19 Jan 2014 22:49:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:49:03 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:49:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:49:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:49:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:49:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:49:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:49:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:49:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:49:08 - job_xml_thread(): Done retrieving: data size 43583577
Sun 19 Jan 2014 22:49:08 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:49:08 - XML: Start document: iteration 20
Sun 19 Jan 2014 22:49:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583577
Sun 19 Jan 2014 22:49:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:49:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583577
Sun 19 Jan 2014 22:49:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:49:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:49:11 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:49:13 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:49:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:49:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 22:49:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 22:49:14 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:49:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8854 values 139766 bits 17470 bytes 
Sun 19 Jan 2014 22:49:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:49:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:49:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:49:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:49:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:49:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:49:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:49:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:49:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:49:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:49:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:49:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:49:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:49:31 - XML: Processed 653328 elements - found 0 jobs
Sun 19 Jan 2014 22:49:31 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:49:31 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:49:31 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:49:31 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:49:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:49:31 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:49:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:49:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:49:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:49:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:49:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:49:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:49:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:49:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574763
Sun 19 Jan 2014 22:49:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:49:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574763
Sun 19 Jan 2014 22:49:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:49:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:49:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:49:46 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:49:46 - job_xml_thread(): Done retrieving: data size 43574763
Sun 19 Jan 2014 22:49:46 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:49:46 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 22:49:46 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 22:49:46 - Housekeeping: done.
Sun 19 Jan 2014 22:49:46 - XML: Start document: iteration 0
Sun 19 Jan 2014 22:49:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:49:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:49:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:49:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:49:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:49:54 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:49:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:49:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:49:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:49:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:49:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:49:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:49:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:49:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:49:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:49:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:49:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:49:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:49:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:49:58 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:49:58 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 22:49:58 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 22:49:58 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:49:58 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:49:58 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:49:58 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:49:58 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:49:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 22:49:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:50:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:50:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574003
Sun 19 Jan 2014 22:50:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:50:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574003
Sun 19 Jan 2014 22:50:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:50:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:50:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:50:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:50:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:50:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:50:13 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:50:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:50:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:50:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:50:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:50:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:50:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:50:13 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:50:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:50:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:50:13 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:50:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:50:14 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:50:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 22:50:14 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:50:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 22:50:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6002 values 94722 bits 11840 bytes 
Sun 19 Jan 2014 22:50:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:50:17 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:50:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:50:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:50:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:50:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:50:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:50:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:50:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:50:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583981
Sun 19 Jan 2014 22:50:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:50:23 - job_xml_thread(): Done retrieving: data size 43583981
Sun 19 Jan 2014 22:50:23 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:50:23 - XML: Start document: iteration 1
Sun 19 Jan 2014 22:50:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583981
Sun 19 Jan 2014 22:50:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:50:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:50:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:50:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:50:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:50:34 - XML: Processed 653351 elements - found 0 jobs
Sun 19 Jan 2014 22:50:34 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:50:34 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:50:34 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:50:34 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:50:40 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:50:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 22:50:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:50:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:50:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:50:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:50:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:50:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:50:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:50:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:50:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:50:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:50:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:50:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:50:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:50:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:50:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:50:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:50:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:50:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:50:49 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:50:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:50:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583490
Sun 19 Jan 2014 22:50:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:50:51 - job_xml_thread(): Done retrieving: data size 43583490
Sun 19 Jan 2014 22:50:51 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:50:51 - XML: Start document: iteration 2
Sun 19 Jan 2014 22:50:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583490
Sun 19 Jan 2014 22:50:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:50:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:50:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:51:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:51:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:51:05 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 22:51:05 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:51:05 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:51:05 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:51:05 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:51:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:51:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:51:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:51:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:51:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:51:14 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:51:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:51:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:51:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:51:14 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:51:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:51:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:51:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:51:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:51:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:51:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:51:15 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:51:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:51:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:51:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:51:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 22:51:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:51:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 22:51:15 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:51:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6050 values 95498 bits 11937 bytes 
Sun 19 Jan 2014 22:51:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:51:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43593691
Sun 19 Jan 2014 22:51:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:51:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43593691
Sun 19 Jan 2014 22:51:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:51:20 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:51:20 - job_xml_thread(): Done retrieving: data size 43593691
Sun 19 Jan 2014 22:51:20 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:51:20 - XML: Start document: iteration 3
Sun 19 Jan 2014 22:51:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:51:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:51:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:51:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:51:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:51:39 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:51:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:51:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:51:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:51:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:51:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:51:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:51:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:51:41 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 22:51:41 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:51:41 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:51:41 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:51:41 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:51:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:51:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:51:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:51:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:51:44 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:51:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 22:51:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:51:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:51:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:51:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:51:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:51:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:51:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575548
Sun 19 Jan 2014 22:51:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:51:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575548
Sun 19 Jan 2014 22:51:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:51:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:51:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:51:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:51:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:51:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:51:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:51:56 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:51:56 - job_xml_thread(): Done retrieving: data size 43575548
Sun 19 Jan 2014 22:51:56 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:51:56 - XML: Start document: iteration 4
Sun 19 Jan 2014 22:51:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:51:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:51:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:51:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575548
Sun 19 Jan 2014 22:51:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:51:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:52:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:52:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:52:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:52:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:52:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:52:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:52:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:52:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:52:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:52:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:52:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:52:14 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 22:52:14 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:52:14 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:52:14 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:52:14 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:52:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:52:15 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:52:15 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:52:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:52:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 22:52:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 22:52:15 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:52:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5579 values 87974 bits 10996 bytes 
Sun 19 Jan 2014 22:52:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:52:17 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:52:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:52:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:52:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:52:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:52:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:52:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:52:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:52:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583166
Sun 19 Jan 2014 22:52:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:52:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583166
Sun 19 Jan 2014 22:52:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:52:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:52:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:52:29 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:52:29 - job_xml_thread(): Done retrieving: data size 43583166
Sun 19 Jan 2014 22:52:29 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:52:29 - XML: Start document: iteration 5
Sun 19 Jan 2014 22:52:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:52:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:52:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:52:36 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:52:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:52:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:52:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:52:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:52:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:52:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:52:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:52:42 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 22:52:42 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:52:42 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:52:42 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:52:42 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:52:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:52:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:52:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:52:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:52:46 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:52:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 22:52:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:52:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:52:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:52:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:52:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:52:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:52:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562021
Sun 19 Jan 2014 22:52:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:52:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562021
Sun 19 Jan 2014 22:52:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:52:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:52:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:52:57 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:52:57 - job_xml_thread(): Done retrieving: data size 43562021
Sun 19 Jan 2014 22:52:57 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:52:57 - XML: Start document: iteration 6
Sun 19 Jan 2014 22:53:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:53:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:53:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:53:03 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:53:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:53:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:53:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:53:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:53:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:53:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:53:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:53:10 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 22:53:10 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:53:10 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:53:10 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:53:10 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:53:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:53:11 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:53:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:53:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:53:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:53:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:53:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:53:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:53:15 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 22:53:15 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 22:53:15 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:53:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:53:15 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:53:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:53:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43486674
Sun 19 Jan 2014 22:53:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:53:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43486674
Sun 19 Jan 2014 22:53:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:53:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:53:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 22:53:16 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:53:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 22:53:16 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:53:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8781 values 138565 bits 17320 bytes 
Sun 19 Jan 2014 22:53:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:53:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:53:25 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:53:25 - job_xml_thread(): Done retrieving: data size 43486674
Sun 19 Jan 2014 22:53:25 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:53:25 - XML: Start document: iteration 7
Sun 19 Jan 2014 22:53:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:53:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:53:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:53:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:53:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:53:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:53:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:53:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:53:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:53:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:53:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:53:34 - XML: Processed 652602 elements - found 0 jobs
Sun 19 Jan 2014 22:53:34 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:53:34 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:53:34 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:53:34 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:53:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:53:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:53:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:53:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:53:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:53:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:53:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:53:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:53:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:53:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43145791
Sun 19 Jan 2014 22:53:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:53:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43145791
Sun 19 Jan 2014 22:53:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:53:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:53:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:53:49 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:53:49 - job_xml_thread(): Done retrieving: data size 43145791
Sun 19 Jan 2014 22:53:49 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:53:49 - XML: Start document: iteration 8
Sun 19 Jan 2014 22:53:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:53:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:53:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:53:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:53:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:53:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:53:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:53:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:53:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:53:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:53:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:53:55 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:53:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 22:53:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:53:59 - XML: Processed 648155 elements - found 0 jobs
Sun 19 Jan 2014 22:53:59 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:53:59 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:53:59 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:53:59 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:54:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:54:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:54:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:54:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:54:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:54:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:54:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:54:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:54:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:54:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42892036
Sun 19 Jan 2014 22:54:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:54:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42892036
Sun 19 Jan 2014 22:54:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:54:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:54:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:54:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:54:13 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:54:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:54:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:54:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:54:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:54:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42892036
Sun 19 Jan 2014 22:54:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:54:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:54:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:54:14 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:54:14 - job_xml_thread(): Done retrieving: data size 42892036
Sun 19 Jan 2014 22:54:14 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:54:14 - XML: Start document: iteration 9
Sun 19 Jan 2014 22:54:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:54:16 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:54:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:54:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 22:54:17 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:54:18 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:54:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 22:54:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:54:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:54:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6062 values 95703 bits 11962 bytes 
Sun 19 Jan 2014 22:54:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:54:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:54:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:54:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:54:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:54:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:54:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:54:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:54:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:54:31 - XML: Processed 645214 elements - found 0 jobs
Sun 19 Jan 2014 22:54:31 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:54:31 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:54:31 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:54:31 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:54:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:54:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:54:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:54:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:54:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:54:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:54:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:54:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:54:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:54:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43165085
Sun 19 Jan 2014 22:54:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:54:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43165085
Sun 19 Jan 2014 22:54:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:54:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:54:44 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:54:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:54:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:54:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:54:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:54:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:54:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:54:46 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:54:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:54:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:54:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:54:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:54:49 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:54:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:54:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:54:49 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:54:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 22:54:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:54:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:54:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:54:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:54:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:54:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:54:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43539059
Sun 19 Jan 2014 22:54:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:54:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43539059
Sun 19 Jan 2014 22:54:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:54:52 - job_xml_thread(): Done retrieving: data size 43539059
Sun 19 Jan 2014 22:54:52 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:54:53 - XML: Start document: iteration 10
Sun 19 Jan 2014 22:55:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:55:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:55:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:55:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:55:07 - XML: Processed 652770 elements - found 0 jobs
Sun 19 Jan 2014 22:55:07 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:55:07 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:55:07 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:55:07 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:55:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:55:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:55:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:55:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:55:13 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:55:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:55:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:55:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:55:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:55:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:55:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:55:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:55:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:55:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:55:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:55:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:55:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:55:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:55:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577204
Sun 19 Jan 2014 22:55:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:55:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577204
Sun 19 Jan 2014 22:55:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:55:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:55:18 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:55:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:55:20 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:55:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 22:55:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 22:55:20 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:55:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9115 values 143854 bits 17981 bytes 
Sun 19 Jan 2014 22:55:22 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:55:22 - job_xml_thread(): Done retrieving: data size 43577204
Sun 19 Jan 2014 22:55:22 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:55:22 - XML: Start document: iteration 11
Sun 19 Jan 2014 22:55:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:55:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:55:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:55:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:55:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:55:29 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:55:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:55:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:55:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:55:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:55:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:55:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:55:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:55:34 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 22:55:34 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:55:34 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:55:34 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:55:34 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:55:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:55:39 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:55:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:55:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:55:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:55:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:55:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:55:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:55:41 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:55:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 22:55:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:55:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:55:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571492
Sun 19 Jan 2014 22:55:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:55:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571492
Sun 19 Jan 2014 22:55:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:55:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:55:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:55:49 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:55:49 - job_xml_thread(): Done retrieving: data size 43571492
Sun 19 Jan 2014 22:55:49 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:55:49 - XML: Start document: iteration 12
Sun 19 Jan 2014 22:55:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:55:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:55:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:55:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:55:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:55:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:55:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:55:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:55:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:55:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:55:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:55:58 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 22:55:58 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:55:59 - XML: Processed 653349 elements - found 0 jobs
Sun 19 Jan 2014 22:55:59 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:55:59 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:55:59 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:55:59 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:55:59 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:55:59 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 22:55:59 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:55:59 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 22:55:59 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 22:56:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:56:04 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:56:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:56:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:56:04 - size of cluster 'LISA Cluster': 624 hosts 79482 metrics 769819 values 12143504 bits 1517938 bytes 
Sun 19 Jan 2014 22:56:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:56:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:56:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:56:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:56:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:56:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558004
Sun 19 Jan 2014 22:56:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:56:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558004
Sun 19 Jan 2014 22:56:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:56:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:56:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:56:14 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:56:14 - job_xml_thread(): Done retrieving: data size 43558004
Sun 19 Jan 2014 22:56:14 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:56:14 - XML: Start document: iteration 13
Sun 19 Jan 2014 22:56:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:56:20 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:56:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:56:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:56:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:56:21 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:56:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 22:56:21 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:56:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 22:56:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99119 bits 12389 bytes 
Sun 19 Jan 2014 22:56:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:56:22 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:56:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:56:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:56:23 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:56:23 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:56:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:56:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:56:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:56:28 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 22:56:28 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:56:28 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:56:28 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:56:28 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:56:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:56:32 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:56:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:56:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:56:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:56:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:56:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:56:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:56:36 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:56:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558542
Sun 19 Jan 2014 22:56:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:56:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558542
Sun 19 Jan 2014 22:56:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:56:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:56:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:56:43 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:56:43 - job_xml_thread(): Done retrieving: data size 43558542
Sun 19 Jan 2014 22:56:43 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:56:43 - XML: Start document: iteration 14
Sun 19 Jan 2014 22:56:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:56:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:56:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:56:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:56:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:56:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:56:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:56:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:56:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:56:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:56:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:56:54 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:56:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 22:56:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:56:56 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 22:56:56 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:56:56 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:56:56 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:56:56 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:56:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:56:59 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:56:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:56:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:56:59 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:56:59 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 22:57:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:57:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:57:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:57:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:57:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:57:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555900
Sun 19 Jan 2014 22:57:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:57:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555900
Sun 19 Jan 2014 22:57:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:57:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:57:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:57:11 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:57:11 - job_xml_thread(): Done retrieving: data size 43555900
Sun 19 Jan 2014 22:57:11 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:57:11 - XML: Start document: iteration 15
Sun 19 Jan 2014 22:57:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:57:15 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:57:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:57:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:57:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:57:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:57:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:57:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:57:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:57:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:57:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:57:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:57:21 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:57:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:57:22 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:57:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 22:57:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 22:57:22 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:57:22 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 22:57:22 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:57:22 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:57:22 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:57:22 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:57:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5698 values 89875 bits 11234 bytes 
Sun 19 Jan 2014 22:57:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:57:25 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:57:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:57:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:57:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:57:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:57:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:57:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:57:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:57:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570216
Sun 19 Jan 2014 22:57:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:57:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570216
Sun 19 Jan 2014 22:57:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:57:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:57:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:57:37 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:57:37 - job_xml_thread(): Done retrieving: data size 43570216
Sun 19 Jan 2014 22:57:37 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:57:37 - XML: Start document: iteration 16
Sun 19 Jan 2014 22:57:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:57:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:57:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:57:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:57:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:57:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:57:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:57:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:57:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:57:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:57:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:57:46 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:57:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 22:57:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:57:46 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 22:57:46 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:57:46 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:57:46 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:57:46 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:57:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:57:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:57:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:57:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:57:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:57:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:57:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:57:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:57:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:57:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562633
Sun 19 Jan 2014 22:57:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:57:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562633
Sun 19 Jan 2014 22:57:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:57:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:57:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:58:01 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:58:01 - job_xml_thread(): Done retrieving: data size 43562633
Sun 19 Jan 2014 22:58:01 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:58:01 - XML: Start document: iteration 17
Sun 19 Jan 2014 22:58:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:58:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:58:14 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 22:58:14 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:58:14 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:58:14 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:58:14 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:58:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:58:15 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:58:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:58:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:58:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:58:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:58:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:58:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:58:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:58:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:58:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:58:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:58:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:58:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:58:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:58:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:58:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:58:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:58:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43593604
Sun 19 Jan 2014 22:58:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:58:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43593604
Sun 19 Jan 2014 22:58:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:58:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:58:22 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:58:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:58:23 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:58:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 22:58:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 22:58:23 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:58:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7165 values 113190 bits 14148 bytes 
Sun 19 Jan 2014 22:58:29 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:58:29 - job_xml_thread(): Done retrieving: data size 43593604
Sun 19 Jan 2014 22:58:29 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:58:29 - XML: Start document: iteration 18
Sun 19 Jan 2014 22:58:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:58:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:58:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:58:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:58:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:58:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:58:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:58:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:58:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:58:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:58:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:58:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:58:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:58:41 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 22:58:41 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:58:41 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:58:41 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:58:41 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:58:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:58:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:58:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:58:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:58:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:58:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:58:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:58:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:58:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:58:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566474
Sun 19 Jan 2014 22:58:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:58:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566474
Sun 19 Jan 2014 22:58:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:58:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:58:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:58:56 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:58:56 - job_xml_thread(): Done retrieving: data size 43566474
Sun 19 Jan 2014 22:58:56 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:58:56 - XML: Start document: iteration 19
Sun 19 Jan 2014 22:58:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:58:57 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:58:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:58:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:58:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:58:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:58:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:58:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:58:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:58:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:58:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:59:06 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 22:59:06 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:59:06 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:59:06 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:59:06 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:59:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:59:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:59:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:59:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:59:10 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:59:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 22:59:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:59:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:59:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:59:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:59:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:59:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:59:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560389
Sun 19 Jan 2014 22:59:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:59:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560389
Sun 19 Jan 2014 22:59:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:59:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:59:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:59:21 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:59:21 - job_xml_thread(): Done retrieving: data size 43560389
Sun 19 Jan 2014 22:59:21 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:59:21 - XML: Start document: iteration 20
Sun 19 Jan 2014 22:59:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:59:24 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:59:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:59:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 22:59:24 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:59:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 22:59:25 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:59:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5737 values 90451 bits 11306 bytes 
Sun 19 Jan 2014 22:59:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:59:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:59:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:59:25 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:59:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:59:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:59:27 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:59:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:59:27 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:59:27 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:59:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:59:33 - XML: Processed 653349 elements - found 0 jobs
Sun 19 Jan 2014 22:59:33 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:59:33 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:59:33 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:59:33 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 22:59:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 22:59:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 22:59:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 22:59:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 22:59:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:59:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 22:59:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 22:59:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 22:59:41 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 22:59:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 22:59:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:59:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 22:59:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43113941
Sun 19 Jan 2014 22:59:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 22:59:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43113941
Sun 19 Jan 2014 22:59:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 22:59:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:59:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 22:59:49 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 22:59:49 - job_xml_thread(): Done retrieving: data size 43113941
Sun 19 Jan 2014 22:59:49 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 22:59:49 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 22:59:49 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 22:59:49 - Housekeeping: done.
Sun 19 Jan 2014 22:59:49 - XML: Start document: iteration 0
Sun 19 Jan 2014 22:59:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 22:59:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 22:59:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 22:59:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 22:59:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 22:59:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 22:59:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:59:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 22:59:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 22:59:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 22:59:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 22:59:59 - XML: Processed 647876 elements - found 0 jobs
Sun 19 Jan 2014 22:59:59 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 22:59:59 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 22:59:59 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 22:59:59 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:00:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:00:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:00:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:00:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:00:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:00:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:00:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:00:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:00:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:00:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42905467
Sun 19 Jan 2014 23:00:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:00:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42905467
Sun 19 Jan 2014 23:00:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:00:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:00:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:00:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:00:14 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:00:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:00:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:00:14 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:00:14 - job_xml_thread(): Done retrieving: data size 42905467
Sun 19 Jan 2014 23:00:15 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:00:15 - XML: Start document: iteration 1
Sun 19 Jan 2014 23:00:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:00:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:00:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:00:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:00:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:00:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:00:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:00:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:00:25 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:00:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:00:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:00:26 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:00:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:00:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:00:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 23:00:26 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:00:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6128 values 96615 bits 12076 bytes 
Sun 19 Jan 2014 23:00:26 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:00:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 23:00:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:00:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:00:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:00:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:00:27 - XML: Processed 645152 elements - found 0 jobs
Sun 19 Jan 2014 23:00:27 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:00:27 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:00:27 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:00:27 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:00:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:00:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43070604
Sun 19 Jan 2014 23:00:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:00:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:00:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:00:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43070604
Sun 19 Jan 2014 23:00:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:00:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:00:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:00:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:00:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:00:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:00:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:00:42 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:00:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:00:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:00:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:00:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:00:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:00:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:00:45 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:00:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:00:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:00:46 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:00:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 23:00:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:00:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:00:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:00:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:00:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:00:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:00:48 - job_xml_thread(): Done retrieving: data size 43503268
Sun 19 Jan 2014 23:00:48 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:00:48 - XML: Start document: iteration 2
Sun 19 Jan 2014 23:00:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43503268
Sun 19 Jan 2014 23:00:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:00:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43503268
Sun 19 Jan 2014 23:00:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:00:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:00:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:01:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:01:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:01:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:01:04 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:01:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:01:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:01:05 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:01:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:01:05 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:01:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:01:05 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:01:07 - XML: Processed 652554 elements - found 0 jobs
Sun 19 Jan 2014 23:01:07 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:01:07 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:01:07 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:01:07 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:01:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:01:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:01:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:01:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:01:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:01:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:01:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:01:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:01:10 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 23:01:10 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 23:01:10 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:01:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:01:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568729
Sun 19 Jan 2014 23:01:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:01:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568729
Sun 19 Jan 2014 23:01:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:01:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:01:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:01:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:01:22 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:01:23 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:01:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:01:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:01:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:01:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:01:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:01:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:01:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:01:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:01:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:01:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:01:25 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:01:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:01:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:01:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:01:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:01:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:01:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:01:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:01:26 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:01:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:01:27 - job_xml_thread(): Done retrieving: data size 43573774
Sun 19 Jan 2014 23:01:27 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:01:27 - XML: Start document: iteration 3
Sun 19 Jan 2014 23:01:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:01:27 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:01:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 23:01:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 23:01:27 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:01:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573774
Sun 19 Jan 2014 23:01:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:01:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8921 values 140854 bits 17606 bytes 
Sun 19 Jan 2014 23:01:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573774
Sun 19 Jan 2014 23:01:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:01:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:01:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:01:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:01:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:01:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:01:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:01:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:01:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:01:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:01:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:01:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:01:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:01:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:01:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:01:51 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:01:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:01:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:01:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:01:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:01:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:01:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:01:51 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:01:51 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:01:51 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:01:51 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:01:51 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:01:53 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:01:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572618
Sun 19 Jan 2014 23:01:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:01:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572618
Sun 19 Jan 2014 23:01:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:01:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:01:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:02:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:02:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:02:07 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:02:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:02:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:02:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:02:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:02:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:02:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:02:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:02:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:02:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:02:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:02:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:02:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:02:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:02:09 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:02:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 23:02:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:02:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:02:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:02:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:02:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:02:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:02:10 - job_xml_thread(): Done retrieving: data size 43586101
Sun 19 Jan 2014 23:02:10 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:02:10 - XML: Start document: iteration 4
Sun 19 Jan 2014 23:02:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43586101
Sun 19 Jan 2014 23:02:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:02:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43586101
Sun 19 Jan 2014 23:02:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:02:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:02:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:02:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:02:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:02:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:02:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:02:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:02:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:02:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:02:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:02:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:02:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:02:27 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:02:28 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:02:28 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:02:28 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:02:28 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:02:28 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:02:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:02:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 23:02:28 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:02:28 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:02:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5985 values 94743 bits 11842 bytes 
Sun 19 Jan 2014 23:02:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 23:02:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:02:32 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:02:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:02:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:02:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:02:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:02:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:02:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:02:35 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:02:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 23:02:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:02:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:02:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573548
Sun 19 Jan 2014 23:02:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:02:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573548
Sun 19 Jan 2014 23:02:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:02:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:02:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:02:43 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:02:44 - job_xml_thread(): Done retrieving: data size 43573548
Sun 19 Jan 2014 23:02:45 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:02:46 - XML: Start document: iteration 5
Sun 19 Jan 2014 23:02:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:02:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:02:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:02:52 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:02:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:02:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:02:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:02:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:02:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:02:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:02:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:02:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:02:54 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:02:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:02:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:02:56 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:02:56 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:02:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:02:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:02:57 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:02:57 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:02:57 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:02:57 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:02:57 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:02:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:02:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571416
Sun 19 Jan 2014 23:02:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:02:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571416
Sun 19 Jan 2014 23:02:59 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 23:02:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:02:59 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:03:01 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:03:01 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 23:03:01 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:03:02 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 23:03:02 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 23:03:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:03:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:03:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:03:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:03:12 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:03:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:03:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:03:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:03:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:03:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:03:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:03:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:03:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:03:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Sun 19 Jan 2014 23:03:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:03:15 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:03:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:03:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:03:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:03:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:03:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:03:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:03:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:03:17 - job_xml_thread(): Done retrieving: data size 43578926
Sun 19 Jan 2014 23:03:17 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:03:17 - XML: Start document: iteration 6
Sun 19 Jan 2014 23:03:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578926
Sun 19 Jan 2014 23:03:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578926
Sun 19 Jan 2014 23:03:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:03:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:03:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:03:28 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:03:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:03:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:03:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 23:03:29 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:03:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:03:29 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:03:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 23:03:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9279 values 146910 bits 18363 bytes 
Sun 19 Jan 2014 23:03:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:03:30 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:03:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:03:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:03:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:03:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:03:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:03:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:03:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:03:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:03:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:03:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:03:40 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:03:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:03:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:03:40 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:03:40 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:03:40 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:03:40 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:03:40 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:03:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:03:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:03:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:03:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:03:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:03:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43547158
Sun 19 Jan 2014 23:03:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:03:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43547158
Sun 19 Jan 2014 23:03:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:03:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:03:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:03:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:03:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:03:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:03:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:03:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:03:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:03:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:03:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43547158
Sun 19 Jan 2014 23:03:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:03:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:03:55 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:03:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:03:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:03:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:04:01 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:04:02 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:04:03 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:04:03 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 23:04:03 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:04:03 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 23:04:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:04:04 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 23:04:04 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:04:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:04:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:04:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:04:05 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:04:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:04:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:04:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:04:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:04:06 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 882507 values 13941917 bits 1742739 bytes 
Sun 19 Jan 2014 23:04:06 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:04:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 23:04:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:04:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:04:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:04:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:04:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:04:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:04:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:04:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:04:09 - job_xml_thread(): Done retrieving: data size 43564991
Sun 19 Jan 2014 23:04:09 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:04:09 - XML: Start document: iteration 7
Sun 19 Jan 2014 23:04:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564991
Sun 19 Jan 2014 23:04:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:04:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564991
Sun 19 Jan 2014 23:04:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:04:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:04:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:04:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:04:22 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:04:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:04:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:04:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:04:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:04:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:04:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:04:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:04:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:04:29 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:04:30 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:04:30 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:04:30 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:04:30 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:04:30 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:04:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:04:30 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:04:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 23:04:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 23:04:30 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:04:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5659 values 89291 bits 11161 bytes 
Sun 19 Jan 2014 23:04:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:04:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:04:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:04:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:04:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:04:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:04:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:04:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:04:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:04:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569110
Sun 19 Jan 2014 23:04:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:04:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569110
Sun 19 Jan 2014 23:04:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:04:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:04:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:04:41 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:04:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 23:04:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:04:45 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:04:45 - job_xml_thread(): Done retrieving: data size 43569110
Sun 19 Jan 2014 23:04:45 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:04:45 - XML: Start document: iteration 8
Sun 19 Jan 2014 23:04:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:04:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:04:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:04:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:04:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:04:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:04:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:04:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:04:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:04:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:04:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:04:56 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:04:56 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:04:56 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:04:56 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:04:56 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:05:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:05:00 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:05:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:05:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:05:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:05:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:05:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:05:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:05:03 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:05:03 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 23:05:04 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:05:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570131
Sun 19 Jan 2014 23:05:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:05:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570131
Sun 19 Jan 2014 23:05:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:05:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:05:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:05:12 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:05:12 - job_xml_thread(): Done retrieving: data size 43570131
Sun 19 Jan 2014 23:05:12 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:05:12 - XML: Start document: iteration 9
Sun 19 Jan 2014 23:05:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:05:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:05:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:05:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:05:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:05:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:05:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:05:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:05:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:05:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:05:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:05:26 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:05:26 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:05:26 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:05:26 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:05:26 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:05:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:05:28 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:05:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:05:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:05:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:05:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:05:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:05:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:05:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:05:30 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:05:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:05:31 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:05:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 23:05:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 23:05:31 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:05:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6245 values 98618 bits 12327 bytes 
Sun 19 Jan 2014 23:05:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:05:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:05:33 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:05:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43480385
Sun 19 Jan 2014 23:05:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:05:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43480385
Sun 19 Jan 2014 23:05:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:05:41 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:05:41 - job_xml_thread(): Done retrieving: data size 43480385
Sun 19 Jan 2014 23:05:41 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:05:41 - XML: Start document: iteration 10
Sun 19 Jan 2014 23:05:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:05:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:05:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:05:47 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:05:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:05:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:05:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:05:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:05:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:05:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:05:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:05:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:05:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:05:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:05:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:05:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:05:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:05:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:05:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:05:56 - XML: Processed 652598 elements - found 0 jobs
Sun 19 Jan 2014 23:05:56 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:05:56 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:05:56 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:05:56 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:05:58 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:05:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 23:05:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:06:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:06:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42909958
Sun 19 Jan 2014 23:06:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:06:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42909958
Sun 19 Jan 2014 23:06:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:06:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:06:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:06:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:06:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:06:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:06:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:06:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:06:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:06:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:06:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:06:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:06:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:06:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:06:11 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:06:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:06:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:06:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:06:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:06:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:06:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:06:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:06:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:06:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:06:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42974041
Sun 19 Jan 2014 23:06:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:06:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42974041
Sun 19 Jan 2014 23:06:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:06:17 - job_xml_thread(): Done retrieving: data size 42974041
Sun 19 Jan 2014 23:06:17 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:06:17 - XML: Start document: iteration 11
Sun 19 Jan 2014 23:06:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:06:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:06:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:06:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:06:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:06:32 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:06:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:06:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 23:06:32 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:06:32 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:06:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 23:06:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7308 values 115324 bits 14415 bytes 
Sun 19 Jan 2014 23:06:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:06:37 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:06:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:06:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:06:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:06:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:06:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:06:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:06:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:06:38 - XML: Processed 645854 elements - found 0 jobs
Sun 19 Jan 2014 23:06:38 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:06:38 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:06:38 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:06:38 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:06:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:06:40 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:06:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:06:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:06:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:06:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:06:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:06:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:06:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:06:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43508953
Sun 19 Jan 2014 23:06:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:06:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43508953
Sun 19 Jan 2014 23:06:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:06:53 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:06:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:06:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:06:54 - job_xml_thread(): Done retrieving: data size 43508953
Sun 19 Jan 2014 23:06:54 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:06:54 - XML: Start document: iteration 12
Sun 19 Jan 2014 23:06:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:06:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:07:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:07:06 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:07:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:07:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:07:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:07:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:07:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:07:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:07:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:07:07 - XML: Processed 652632 elements - found 0 jobs
Sun 19 Jan 2014 23:07:07 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:07:07 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:07:07 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:07:07 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:07:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:07:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:07:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:07:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:07:09 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:07:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 23:07:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:07:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:07:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:07:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:07:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:07:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:07:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567306
Sun 19 Jan 2014 23:07:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:07:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567306
Sun 19 Jan 2014 23:07:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:07:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:07:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:07:23 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:07:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:07:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:07:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:07:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:07:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:07:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:07:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:07:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:07:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:07:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:07:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:07:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:07:27 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:07:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:07:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:07:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:07:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:07:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:07:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:07:31 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 23:07:31 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 23:07:31 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:07:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:07:31 - job_xml_thread(): Done retrieving: data size 43560479
Sun 19 Jan 2014 23:07:31 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:07:31 - XML: Start document: iteration 13
Sun 19 Jan 2014 23:07:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560479
Sun 19 Jan 2014 23:07:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:07:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560479
Sun 19 Jan 2014 23:07:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:07:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:07:33 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:07:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:07:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 23:07:35 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:07:35 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:07:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 23:07:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9215 values 145459 bits 18182 bytes 
Sun 19 Jan 2014 23:07:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:07:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:07:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:07:43 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:07:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:07:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:07:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:07:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:07:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:07:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:07:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:07:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:07:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:07:51 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:07:51 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:07:51 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:07:51 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:07:51 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:07:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:07:55 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:07:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:07:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:07:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:07:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:07:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:07:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:07:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:07:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43540371
Sun 19 Jan 2014 23:07:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:07:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43540371
Sun 19 Jan 2014 23:07:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:08:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:08:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:08:06 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:08:06 - job_xml_thread(): Done retrieving: data size 43540371
Sun 19 Jan 2014 23:08:06 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:08:06 - XML: Start document: iteration 14
Sun 19 Jan 2014 23:08:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:08:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:08:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:08:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:08:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:08:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:08:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:08:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:08:16 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:08:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:08:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:08:23 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:08:23 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:08:23 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:08:23 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:08:23 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:08:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:08:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:08:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:08:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:08:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:08:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:08:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:08:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:08:23 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:08:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 23:08:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:08:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:08:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559564
Sun 19 Jan 2014 23:08:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:08:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559564
Sun 19 Jan 2014 23:08:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:08:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:08:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:08:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:08:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:08:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:08:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:08:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:08:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:08:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:08:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:08:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559564
Sun 19 Jan 2014 23:08:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:08:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:08:35 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:08:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:08:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 23:08:36 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:08:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6036 values 95360 bits 11920 bytes 
Sun 19 Jan 2014 23:08:36 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:08:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 23:08:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:08:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:08:38 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:08:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:08:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:08:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:08:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:08:45 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:08:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:08:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:08:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:08:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:08:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:08:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:08:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:08:47 - job_xml_thread(): Done retrieving: data size 43577910
Sun 19 Jan 2014 23:08:47 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:08:47 - XML: Start document: iteration 15
Sun 19 Jan 2014 23:08:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577910
Sun 19 Jan 2014 23:08:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:08:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:08:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:08:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:08:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:08:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:08:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:08:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577910
Sun 19 Jan 2014 23:08:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:09:00 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:09:00 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:09:00 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:09:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:09:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:09:00 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:09:00 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:09:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:09:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:09:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:09:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:09:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:09:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:09:10 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:09:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:09:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:09:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:09:10 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:09:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 23:09:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:09:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:09:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:09:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:09:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:09:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:09:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:09:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:09:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:09:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:09:12 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:09:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43590508
Sun 19 Jan 2014 23:09:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:09:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43590508
Sun 19 Jan 2014 23:09:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:09:16 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:09:16 - job_xml_thread(): Done retrieving: data size 43590508
Sun 19 Jan 2014 23:09:16 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:09:16 - XML: Start document: iteration 16
Sun 19 Jan 2014 23:09:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:09:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:09:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:09:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:09:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:09:27 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:09:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:09:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:09:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:09:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:09:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:09:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:09:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:09:29 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:09:29 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:09:29 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:09:29 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:09:29 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:09:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:09:33 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:09:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:09:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:09:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:09:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:09:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:09:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:09:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:09:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43586955
Sun 19 Jan 2014 23:09:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:09:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43586955
Sun 19 Jan 2014 23:09:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:09:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:09:38 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:09:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:09:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 23:09:39 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:09:39 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:09:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 23:09:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8963 values 141415 bits 17676 bytes 
Sun 19 Jan 2014 23:09:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:09:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:09:44 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:09:44 - job_xml_thread(): Done retrieving: data size 43586955
Sun 19 Jan 2014 23:09:44 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:09:44 - XML: Start document: iteration 17
Sun 19 Jan 2014 23:09:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:09:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:09:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:09:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:09:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:09:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:09:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:09:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:09:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:09:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:09:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:09:56 - XML: Processed 653349 elements - found 0 jobs
Sun 19 Jan 2014 23:09:56 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:09:56 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:09:56 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:09:56 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:09:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:09:57 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:09:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:09:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:09:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:09:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:09:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:09:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:09:59 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:09:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 23:09:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:09:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:09:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563253
Sun 19 Jan 2014 23:09:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:10:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563253
Sun 19 Jan 2014 23:10:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:10:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:10:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:10:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:10:10 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:10:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:10:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:10:11 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:10:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:10:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:10:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:10:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:10:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:10:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:10:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:10:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:10:14 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:10:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:10:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:10:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:10:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:10:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:10:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:10:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:10:17 - job_xml_thread(): Done retrieving: data size 43578817
Sun 19 Jan 2014 23:10:17 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:10:17 - XML: Start document: iteration 18
Sun 19 Jan 2014 23:10:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578817
Sun 19 Jan 2014 23:10:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:10:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578817
Sun 19 Jan 2014 23:10:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:10:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:10:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:10:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:10:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:10:35 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:10:35 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:10:35 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:10:35 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:10:35 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:10:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:10:36 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:10:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:10:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:10:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:10:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:10:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:10:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:10:37 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:10:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:10:39 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:10:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:10:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 23:10:40 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:10:40 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:10:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99119 bits 12389 bytes 
Sun 19 Jan 2014 23:10:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:10:40 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:10:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 23:10:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:10:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:10:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:10:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:10:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:10:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:10:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:10:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577042
Sun 19 Jan 2014 23:10:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577042
Sun 19 Jan 2014 23:10:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:10:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:10:51 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:10:51 - job_xml_thread(): Done retrieving: data size 43577042
Sun 19 Jan 2014 23:10:51 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:10:51 - XML: Start document: iteration 19
Sun 19 Jan 2014 23:10:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:10:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:10:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:10:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:10:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:10:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:10:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:10:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:10:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:10:55 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:10:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:10:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:10:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:11:03 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 23:11:03 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:11:05 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:11:05 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 23:11:05 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 23:11:05 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:11:05 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 23:11:07 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:11:07 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:11:07 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:11:07 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:11:07 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:11:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:11:07 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:11:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:11:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:11:08 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 877969 values 13843623 bits 1730452 bytes 
Sun 19 Jan 2014 23:11:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:11:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:11:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:11:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:11:08 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:11:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 23:11:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:11:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:11:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:11:11 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:11:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43545118
Sun 19 Jan 2014 23:11:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:11:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43545118
Sun 19 Jan 2014 23:11:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:11:22 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:11:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:11:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:11:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:11:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:11:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:11:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:11:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:11:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:11:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:11:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:11:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:11:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:11:27 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:11:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:11:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:11:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:11:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:11:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:11:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:11:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:11:30 - job_xml_thread(): Done retrieving: data size 43494264
Sun 19 Jan 2014 23:11:30 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:11:30 - XML: Start document: iteration 20
Sun 19 Jan 2014 23:11:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43494264
Sun 19 Jan 2014 23:11:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:11:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43494264
Sun 19 Jan 2014 23:11:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:11:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:11:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:11:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:11:41 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:11:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:11:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:11:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:11:43 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:11:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 23:11:44 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:11:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 23:11:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8950 values 141176 bits 17647 bytes 
Sun 19 Jan 2014 23:11:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:11:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:11:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:11:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:11:50 - XML: Processed 652590 elements - found 0 jobs
Sun 19 Jan 2014 23:11:51 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:11:51 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:11:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:11:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:11:51 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:11:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:11:51 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:11:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:11:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:11:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:11:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:11:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:11:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:11:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:11:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:11:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:11:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:11:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:11:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42909190
Sun 19 Jan 2014 23:11:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:11:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42909190
Sun 19 Jan 2014 23:11:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:12:05 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:12:05 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 23:12:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:12:06 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:12:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:12:06 - job_xml_thread(): Done retrieving: data size 42909190
Sun 19 Jan 2014 23:12:06 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:12:06 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 23:12:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:12:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:12:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:12:09 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 23:12:09 - Housekeeping: done.
Sun 19 Jan 2014 23:12:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:12:10 - XML: Start document: iteration 0
Sun 19 Jan 2014 23:12:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:12:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:12:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:12:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:12:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:12:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:12:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:12:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:12:17 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:12:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:12:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:12:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:12:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:12:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:12:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:12:20 - XML: Processed 645233 elements - found 0 jobs
Sun 19 Jan 2014 23:12:20 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:12:20 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:12:20 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:12:20 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:12:21 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:12:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 23:12:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:12:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:12:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42987268
Sun 19 Jan 2014 23:12:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:12:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42987268
Sun 19 Jan 2014 23:12:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:12:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:12:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:12:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:12:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:12:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:12:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:12:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:12:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:12:35 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:12:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:12:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:12:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:12:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:12:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:12:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:12:37 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:12:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:12:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:12:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:12:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:12:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:12:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:12:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:12:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43253747
Sun 19 Jan 2014 23:12:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:12:40 - job_xml_thread(): Done retrieving: data size 43253747
Sun 19 Jan 2014 23:12:40 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:12:40 - XML: Start document: iteration 1
Sun 19 Jan 2014 23:12:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43253747
Sun 19 Jan 2014 23:12:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:12:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:12:45 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:12:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:12:46 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:12:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 23:12:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 23:12:46 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:12:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8708 values 137352 bits 17169 bytes 
Sun 19 Jan 2014 23:12:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:12:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:12:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:12:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:12:54 - XML: Processed 649243 elements - found 0 jobs
Sun 19 Jan 2014 23:12:54 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:12:54 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:12:54 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:12:54 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:12:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:12:58 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:12:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:12:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:13:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:13:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:13:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:13:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:13:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:13:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:13:03 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:13:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:13:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:13:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:13:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:13:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:13:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:13:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:13:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578461
Sun 19 Jan 2014 23:13:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:13:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578461
Sun 19 Jan 2014 23:13:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:13:09 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:13:10 - job_xml_thread(): Done retrieving: data size 43578461
Sun 19 Jan 2014 23:13:10 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:13:10 - XML: Start document: iteration 2
Sun 19 Jan 2014 23:13:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:13:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:13:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:13:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:13:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:13:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:13:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:13:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:13:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:13:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:13:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:13:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:13:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:13:27 - XML: Processed 653267 elements - found 0 jobs
Sun 19 Jan 2014 23:13:27 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:13:27 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:13:27 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:13:27 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:13:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:13:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:13:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:13:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:13:31 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:13:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 23:13:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:13:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:13:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:13:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:13:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:13:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:13:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570553
Sun 19 Jan 2014 23:13:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:13:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570553
Sun 19 Jan 2014 23:13:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:13:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:13:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:13:42 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:13:42 - job_xml_thread(): Done retrieving: data size 43570553
Sun 19 Jan 2014 23:13:42 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:13:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:13:43 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:13:43 - XML: Start document: iteration 3
Sun 19 Jan 2014 23:13:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:13:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:13:46 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:13:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:13:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:13:46 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:13:46 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:13:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:13:46 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:13:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:13:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:13:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:13:47 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:13:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 23:13:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 23:13:47 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:13:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5964 values 94152 bits 11769 bytes 
Sun 19 Jan 2014 23:13:52 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:13:52 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:13:52 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:13:52 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:13:52 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:13:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:13:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:13:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:13:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:13:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:13:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:13:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:13:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:14:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:14:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43542922
Sun 19 Jan 2014 23:14:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:14:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:14:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:14:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43542922
Sun 19 Jan 2014 23:14:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:14:08 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:14:08 - job_xml_thread(): Done retrieving: data size 43542922
Sun 19 Jan 2014 23:14:08 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:14:08 - XML: Start document: iteration 4
Sun 19 Jan 2014 23:14:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:14:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:14:18 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:14:18 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:14:18 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:14:18 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:14:18 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:14:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:14:20 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:14:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:14:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:14:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:14:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:14:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:14:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:14:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:14:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:14:25 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:14:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:14:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:14:25 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:14:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 23:14:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:14:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:14:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:14:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:14:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:14:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:14:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560334
Sun 19 Jan 2014 23:14:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:14:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560334
Sun 19 Jan 2014 23:14:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:14:33 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:14:33 - job_xml_thread(): Done retrieving: data size 43560334
Sun 19 Jan 2014 23:14:33 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:14:33 - XML: Start document: iteration 5
Sun 19 Jan 2014 23:14:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:14:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:14:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:14:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:14:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:14:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:14:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:14:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:14:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:14:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:14:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:14:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:14:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:14:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:14:47 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:14:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:14:48 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:14:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 23:14:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 23:14:48 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:14:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5843 values 92158 bits 11519 bytes 
Sun 19 Jan 2014 23:14:50 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:14:50 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:14:50 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:14:50 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:14:50 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:14:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:14:51 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:14:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:14:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:14:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:14:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:14:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:14:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:14:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:14:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579150
Sun 19 Jan 2014 23:14:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:14:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579150
Sun 19 Jan 2014 23:14:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:14:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:14:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:15:05 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:15:05 - job_xml_thread(): Done retrieving: data size 43579150
Sun 19 Jan 2014 23:15:05 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:15:05 - XML: Start document: iteration 6
Sun 19 Jan 2014 23:15:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:15:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:15:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:15:10 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:15:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:15:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:15:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:15:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:15:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:15:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:15:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:15:14 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:15:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 23:15:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:15:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:15:17 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:15:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:15:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:15:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:15:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:15:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:15:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:15:19 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:15:19 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:15:19 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:15:19 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:15:19 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:15:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:15:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565817
Sun 19 Jan 2014 23:15:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:15:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565817
Sun 19 Jan 2014 23:15:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:15:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:15:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:15:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:15:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:15:34 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:15:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:15:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:15:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:15:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:15:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:15:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:15:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:15:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:15:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:15:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:15:39 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:15:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:15:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:15:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:15:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:15:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:15:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:15:43 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:15:43 - job_xml_thread(): Done retrieving: data size 43583128
Sun 19 Jan 2014 23:15:43 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:15:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583128
Sun 19 Jan 2014 23:15:43 - XML: Start document: iteration 7
Sun 19 Jan 2014 23:15:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:15:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583128
Sun 19 Jan 2014 23:15:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:15:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:15:48 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:15:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:15:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 23:15:49 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:15:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9120 values 143969 bits 17996 bytes 
Sun 19 Jan 2014 23:15:50 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:15:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 23:15:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:15:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:15:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:15:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:15:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:15:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:15:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:15:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:15:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:15:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:15:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:15:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:15:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:16:02 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:16:02 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:16:02 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:16:02 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:16:02 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:16:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:16:07 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:16:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:16:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:16:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:16:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:16:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:16:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:16:08 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 23:16:08 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 23:16:08 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:16:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:16:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577815
Sun 19 Jan 2014 23:16:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:16:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577815
Sun 19 Jan 2014 23:16:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:16:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:16:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:16:17 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:16:17 - job_xml_thread(): Done retrieving: data size 43577815
Sun 19 Jan 2014 23:16:17 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:16:17 - XML: Start document: iteration 8
Sun 19 Jan 2014 23:16:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:16:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:16:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:16:28 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:16:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:16:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:16:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:16:29 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:16:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:16:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:16:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:16:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:16:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:16:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:16:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:16:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:16:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:16:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:16:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:16:31 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:16:31 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:16:31 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:16:31 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:16:31 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:16:31 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:16:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 23:16:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:16:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:16:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43585560
Sun 19 Jan 2014 23:16:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:16:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43585560
Sun 19 Jan 2014 23:16:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:16:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:16:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:16:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:16:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:16:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:16:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:16:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:16:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:16:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:16:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:16:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:16:46 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:16:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:16:47 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:16:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:16:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:16:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:16:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:16:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:16:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:16:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:16:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43592819
Sun 19 Jan 2014 23:16:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:16:48 - job_xml_thread(): Done retrieving: data size 43592819
Sun 19 Jan 2014 23:16:49 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:16:49 - XML: Start document: iteration 9
Sun 19 Jan 2014 23:16:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:16:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43592819
Sun 19 Jan 2014 23:16:51 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:16:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:16:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:16:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 23:16:53 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:16:53 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:16:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 23:16:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8916 values 140922 bits 17615 bytes 
Sun 19 Jan 2014 23:17:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:17:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:17:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:17:01 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:17:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:17:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:17:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:17:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:17:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:17:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:17:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:17:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:17:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:17:06 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:17:06 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:17:06 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:17:06 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:17:06 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:17:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:17:11 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:17:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:17:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:17:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:17:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:17:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:17:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:17:13 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:17:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 23:17:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:17:14 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:17:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570541
Sun 19 Jan 2014 23:17:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:17:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570541
Sun 19 Jan 2014 23:17:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:17:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:17:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:17:21 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:17:21 - job_xml_thread(): Done retrieving: data size 43570541
Sun 19 Jan 2014 23:17:21 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:17:21 - XML: Start document: iteration 10
Sun 19 Jan 2014 23:17:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:17:25 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:17:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:17:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:17:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:17:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:17:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:17:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:17:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:17:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:17:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:17:36 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:17:36 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:17:36 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:17:36 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:17:36 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:17:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:17:37 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:17:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:17:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:17:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:17:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:17:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:17:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:17:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:17:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43165886
Sun 19 Jan 2014 23:17:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:17:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43165886
Sun 19 Jan 2014 23:17:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:17:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:17:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:17:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:17:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:17:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:17:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:17:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:17:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:17:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:17:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:17:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:17:51 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:17:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:17:52 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:17:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:17:53 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:17:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:17:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:17:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:17:53 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:17:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 23:17:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 23:17:53 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:17:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99457 bits 12432 bytes 
Sun 19 Jan 2014 23:17:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:17:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:17:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:17:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:17:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:17:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42943698
Sun 19 Jan 2014 23:17:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:17:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42943698
Sun 19 Jan 2014 23:17:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:17:55 - job_xml_thread(): Done retrieving: data size 42943698
Sun 19 Jan 2014 23:17:55 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:17:56 - XML: Start document: iteration 11
Sun 19 Jan 2014 23:18:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:18:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:18:06 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 23:18:06 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:18:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:18:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:18:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:18:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:18:09 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:18:09 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 23:18:09 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 23:18:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:18:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:18:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:18:10 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:18:10 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 23:18:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:18:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:18:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:18:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:18:13 - XML: Processed 645368 elements - found 0 jobs
Sun 19 Jan 2014 23:18:13 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:18:13 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:18:13 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:18:14 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:18:18 - size of cluster 'LISA Cluster': 624 hosts 79472 metrics 762197 values 12039044 bits 1504880 bytes 
Sun 19 Jan 2014 23:18:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:18:19 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:18:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:18:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:18:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:18:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:18:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:18:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:18:22 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:18:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 23:18:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:18:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:18:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42967037
Sun 19 Jan 2014 23:18:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:18:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42967037
Sun 19 Jan 2014 23:18:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:18:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:18:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:18:29 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:18:29 - job_xml_thread(): Done retrieving: data size 42967037
Sun 19 Jan 2014 23:18:29 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:18:29 - XML: Start document: iteration 12
Sun 19 Jan 2014 23:18:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:18:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:18:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:18:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:18:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:18:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:18:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:18:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:18:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:18:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:18:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:18:45 - XML: Processed 645902 elements - found 0 jobs
Sun 19 Jan 2014 23:18:45 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:18:45 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:18:45 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:18:45 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:18:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:18:47 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:18:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:18:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:18:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:18:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:18:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:18:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:18:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:18:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43514416
Sun 19 Jan 2014 23:18:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:18:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43514416
Sun 19 Jan 2014 23:18:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:18:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:18:53 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:18:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:18:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:18:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:18:55 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:18:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 23:18:55 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:18:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 23:18:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7703 values 121809 bits 15226 bytes 
Sun 19 Jan 2014 23:19:00 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:19:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:19:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:19:00 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:19:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:19:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:19:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:19:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:19:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:19:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:19:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:19:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:19:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:19:05 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:19:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:19:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:19:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:19:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:19:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:19:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:19:08 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:19:08 - job_xml_thread(): Done retrieving: data size 43577662
Sun 19 Jan 2014 23:19:08 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:19:08 - XML: Start document: iteration 13
Sun 19 Jan 2014 23:19:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577662
Sun 19 Jan 2014 23:19:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:19:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577662
Sun 19 Jan 2014 23:19:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:19:10 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:19:10 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 23:19:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:19:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:19:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:19:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:19:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:19:28 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:19:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:19:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:19:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:19:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:19:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:19:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:19:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:19:30 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:19:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 23:19:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:19:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:19:31 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:19:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:19:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:19:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:19:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:19:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:19:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:19:33 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:19:33 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:19:33 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:19:33 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:19:33 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:19:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:19:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563785
Sun 19 Jan 2014 23:19:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:19:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563785
Sun 19 Jan 2014 23:19:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:19:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:19:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:19:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:19:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:19:49 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:19:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:19:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:19:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:19:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:19:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:19:55 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:19:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:19:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:19:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:19:55 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:19:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:19:55 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:19:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:19:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:19:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:19:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:19:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:19:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:19:56 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:19:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:19:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 23:19:57 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:19:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 23:19:57 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:19:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5846 values 92259 bits 11532 bytes 
Sun 19 Jan 2014 23:20:00 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:20:00 - job_xml_thread(): Done retrieving: data size 43572860
Sun 19 Jan 2014 23:20:00 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:20:00 - XML: Start document: iteration 14
Sun 19 Jan 2014 23:20:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572860
Sun 19 Jan 2014 23:20:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572860
Sun 19 Jan 2014 23:20:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:20:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:20:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:20:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:20:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:20:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:20:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:20:14 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:20:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:20:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:20:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:20:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:20:16 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:20:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:20:16 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:20:17 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:20:17 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:20:17 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:20:17 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:20:17 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:20:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:20:23 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:20:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:20:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:20:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:20:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:20:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:20:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:20:26 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:20:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 23:20:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:20:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:20:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568767
Sun 19 Jan 2014 23:20:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:20:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568767
Sun 19 Jan 2014 23:20:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:20:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:20:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:20:33 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:20:33 - job_xml_thread(): Done retrieving: data size 43568767
Sun 19 Jan 2014 23:20:33 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:20:33 - XML: Start document: iteration 15
Sun 19 Jan 2014 23:20:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:20:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:20:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:20:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:20:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:20:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:20:39 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:20:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:20:39 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:20:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:20:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:20:47 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:20:47 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:20:47 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:20:47 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:20:47 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:20:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:20:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:20:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:20:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:20:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:20:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:20:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:20:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:20:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:20:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:20:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:20:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43546788
Sun 19 Jan 2014 23:20:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:20:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43546788
Sun 19 Jan 2014 23:20:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:20:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:20:57 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:20:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:20:59 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:20:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 23:20:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 23:21:00 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:21:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7399 values 116794 bits 14599 bytes 
Sun 19 Jan 2014 23:21:02 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:21:02 - job_xml_thread(): Done retrieving: data size 43546788
Sun 19 Jan 2014 23:21:02 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:21:02 - XML: Start document: iteration 16
Sun 19 Jan 2014 23:21:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:21:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:21:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:21:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:21:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:21:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:21:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:21:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:21:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:21:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:21:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:21:17 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:21:17 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:21:17 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:21:17 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:21:17 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:21:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:21:19 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:21:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:21:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:21:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:21:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:21:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:21:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:21:23 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:21:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 23:21:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:21:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:21:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569995
Sun 19 Jan 2014 23:21:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:21:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569995
Sun 19 Jan 2014 23:21:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:21:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:21:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:21:32 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:21:33 - job_xml_thread(): Done retrieving: data size 43569995
Sun 19 Jan 2014 23:21:33 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:21:33 - XML: Start document: iteration 17
Sun 19 Jan 2014 23:21:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:21:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:21:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:21:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:21:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:21:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:21:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:21:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:21:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:21:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:21:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:21:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:21:43 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:21:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:21:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:21:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:21:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:21:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:21:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:21:46 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:21:46 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:21:46 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:21:46 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:21:46 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:21:49 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:21:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554225
Sun 19 Jan 2014 23:21:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:21:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554225
Sun 19 Jan 2014 23:21:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:21:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:21:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:21:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:21:57 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:21:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:21:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:21:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:21:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:21:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554225
Sun 19 Jan 2014 23:21:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:21:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:21:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:21:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:21:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:22:01 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:22:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:22:01 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:22:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:22:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:22:03 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:22:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 23:22:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 23:22:03 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:22:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99127 bits 12390 bytes 
Sun 19 Jan 2014 23:22:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:22:10 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:22:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:22:11 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:22:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:22:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:22:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:22:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:22:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:22:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:22:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:22:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:22:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:22:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:22:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:22:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:22:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:22:17 - job_xml_thread(): Done retrieving: data size 43567259
Sun 19 Jan 2014 23:22:17 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:22:17 - XML: Start document: iteration 18
Sun 19 Jan 2014 23:22:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567259
Sun 19 Jan 2014 23:22:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:22:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567259
Sun 19 Jan 2014 23:22:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:22:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:22:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:22:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:22:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:22:30 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:22:30 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:22:30 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:22:30 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:22:30 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:22:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:22:33 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:22:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:22:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:22:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:22:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:22:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:22:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:22:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:22:36 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:22:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 23:22:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:22:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:22:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:22:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:22:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:22:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:22:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:22:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:22:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:22:41 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 23:22:41 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 23:22:41 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:22:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:22:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579492
Sun 19 Jan 2014 23:22:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:22:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579492
Sun 19 Jan 2014 23:22:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:22:46 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:22:46 - job_xml_thread(): Done retrieving: data size 43579492
Sun 19 Jan 2014 23:22:47 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:22:47 - XML: Start document: iteration 19
Sun 19 Jan 2014 23:22:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:22:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:22:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:22:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:22:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:22:57 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:22:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:22:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:22:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:22:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:22:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:22:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:22:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:23:03 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:23:03 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:23:03 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:23:03 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:23:03 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:23:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:23:04 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:23:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:23:04 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:23:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:23:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:23:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:23:05 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:23:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 23:23:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 23:23:05 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:23:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:23:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:23:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:23:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:23:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6055 values 95606 bits 11950 bytes 
Sun 19 Jan 2014 23:23:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:23:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567762
Sun 19 Jan 2014 23:23:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:23:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567762
Sun 19 Jan 2014 23:23:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:23:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:23:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:23:18 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:23:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:23:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:23:19 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:23:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:23:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:23:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:23:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:23:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:23:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:23:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:23:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:23:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:23:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:23:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:23:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:23:23 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:23:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 23:23:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:23:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:23:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:23:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:23:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:23:24 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:23:24 - job_xml_thread(): Done retrieving: data size 43511845
Sun 19 Jan 2014 23:23:24 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:23:24 - XML: Start document: iteration 20
Sun 19 Jan 2014 23:23:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43511845
Sun 19 Jan 2014 23:23:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:23:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43511845
Sun 19 Jan 2014 23:23:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:23:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:23:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:23:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:23:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:23:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:23:47 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:23:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:23:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:23:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:23:48 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:23:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:23:48 - XML: Processed 652594 elements - found 0 jobs
Sun 19 Jan 2014 23:23:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:23:48 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:23:48 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:23:48 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:23:48 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:23:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:23:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:23:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:23:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:23:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:23:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:23:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:23:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:23:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:23:50 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:23:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42934412
Sun 19 Jan 2014 23:23:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:23:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42934412
Sun 19 Jan 2014 23:23:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:24:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:24:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:24:03 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:24:03 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:24:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:24:04 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:24:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:24:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:24:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:24:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:24:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:24:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:24:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:24:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:24:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:24:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:24:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:24:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:24:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:24:05 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:24:05 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:24:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 23:24:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:24:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 23:24:05 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:24:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8772 values 138398 bits 17299 bytes 
Sun 19 Jan 2014 23:24:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:24:06 - job_xml_thread(): Done retrieving: data size 42923295
Sun 19 Jan 2014 23:24:06 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:24:06 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 23:24:06 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 23:24:06 - Housekeeping: done.
Sun 19 Jan 2014 23:24:06 - XML: Start document: iteration 0
Sun 19 Jan 2014 23:24:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42923295
Sun 19 Jan 2014 23:24:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:24:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42923295
Sun 19 Jan 2014 23:24:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:24:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:24:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:24:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:24:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:24:22 - XML: Processed 645152 elements - found 0 jobs
Sun 19 Jan 2014 23:24:22 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:24:22 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:24:22 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:24:22 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:24:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:24:24 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:24:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:24:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:24:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:24:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:24:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:24:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:24:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:24:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:24:28 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:24:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:24:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:24:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:24:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:24:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:24:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:24:32 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:24:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 23:24:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:24:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:24:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43071869
Sun 19 Jan 2014 23:24:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:24:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43071869
Sun 19 Jan 2014 23:24:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:24:37 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:24:37 - job_xml_thread(): Done retrieving: data size 43071869
Sun 19 Jan 2014 23:24:38 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:24:39 - XML: Start document: iteration 1
Sun 19 Jan 2014 23:24:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:24:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:24:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:24:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:24:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:24:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:24:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:24:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:24:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:24:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:24:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:24:49 - XML: Processed 646892 elements - found 0 jobs
Sun 19 Jan 2014 23:24:49 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:24:49 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:24:49 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:24:49 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:24:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:24:53 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:24:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:24:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:24:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:24:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:24:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:24:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:24:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:24:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43524541
Sun 19 Jan 2014 23:24:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:24:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43524541
Sun 19 Jan 2014 23:24:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:24:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:24:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:25:04 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:25:04 - job_xml_thread(): Done retrieving: data size 43524541
Sun 19 Jan 2014 23:25:04 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:25:04 - XML: Start document: iteration 2
Sun 19 Jan 2014 23:25:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:25:06 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:25:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:25:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 23:25:07 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:25:07 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:25:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 23:25:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6846 values 108024 bits 13503 bytes 
Sun 19 Jan 2014 23:25:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:25:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:25:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:25:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:25:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:25:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:25:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:25:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:25:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:25:10 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 23:25:10 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:25:10 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:25:10 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:25:10 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 23:25:10 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 23:25:10 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 23:25:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:25:13 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:25:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:25:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:25:15 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:25:15 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:25:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:25:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:25:17 - XML: Processed 652974 elements - found 0 jobs
Sun 19 Jan 2014 23:25:17 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:25:17 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:25:17 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:25:17 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:25:17 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 808266 values 12747674 bits 1593459 bytes 
Sun 19 Jan 2014 23:25:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:25:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43550023
Sun 19 Jan 2014 23:25:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:25:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43550023
Sun 19 Jan 2014 23:25:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:25:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:25:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:25:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:25:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:25:32 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:25:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:25:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:25:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:25:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:25:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:25:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:25:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:25:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:25:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:25:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:25:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:25:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:25:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:25:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:25:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:25:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:25:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:25:38 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:25:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 23:25:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:25:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:25:41 - job_xml_thread(): Done retrieving: data size 43564462
Sun 19 Jan 2014 23:25:41 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:25:41 - XML: Start document: iteration 3
Sun 19 Jan 2014 23:25:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564462
Sun 19 Jan 2014 23:25:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:25:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564462
Sun 19 Jan 2014 23:25:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:25:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:25:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:25:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:25:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:25:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:25:57 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:25:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:25:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:25:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:25:59 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:25:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:25:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:25:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:26:00 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:26:00 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:26:00 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:26:00 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:26:00 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:26:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:26:03 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:26:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:26:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:26:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:26:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:26:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:26:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:26:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:26:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559744
Sun 19 Jan 2014 23:26:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:26:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:26:07 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:26:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559744
Sun 19 Jan 2014 23:26:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:26:08 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:26:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:26:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 23:26:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 23:26:08 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:26:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5714 values 90131 bits 11266 bytes 
Sun 19 Jan 2014 23:26:10 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:26:11 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 23:26:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:26:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:26:15 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:26:15 - job_xml_thread(): Done retrieving: data size 43559744
Sun 19 Jan 2014 23:26:15 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:26:15 - XML: Start document: iteration 4
Sun 19 Jan 2014 23:26:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:26:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:26:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:26:20 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:26:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:26:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:26:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:26:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:26:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:26:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:26:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:26:29 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:26:29 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:26:29 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:26:29 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:26:29 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:26:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:26:31 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:26:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:26:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:26:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:26:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:26:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:26:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:26:34 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:26:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 23:26:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:26:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:26:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561785
Sun 19 Jan 2014 23:26:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:26:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561785
Sun 19 Jan 2014 23:26:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:26:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:26:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:26:44 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:26:44 - job_xml_thread(): Done retrieving: data size 43561785
Sun 19 Jan 2014 23:26:44 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:26:44 - XML: Start document: iteration 5
Sun 19 Jan 2014 23:26:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:26:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:26:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:26:52 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:26:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:26:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:26:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:26:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:26:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:26:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:26:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:26:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:26:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:26:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:26:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:26:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:26:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:26:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:26:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:26:58 - XML: Processed 653351 elements - found 0 jobs
Sun 19 Jan 2014 23:26:58 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:26:58 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:26:58 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:26:58 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:27:02 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:27:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584202
Sun 19 Jan 2014 23:27:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:27:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584202
Sun 19 Jan 2014 23:27:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:27:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:27:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:27:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:27:08 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:27:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:27:09 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:27:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 23:27:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 23:27:09 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:27:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6282 values 99147 bits 12393 bytes 
Sun 19 Jan 2014 23:27:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:27:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:27:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:27:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:27:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:27:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:27:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:27:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:27:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:27:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584202
Sun 19 Jan 2014 23:27:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:27:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:27:14 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:27:15 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:27:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:27:18 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:27:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:27:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:27:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:27:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:27:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:27:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:27:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:27:22 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:27:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:27:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:27:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:27:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:27:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:27:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:27:27 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:27:27 - job_xml_thread(): Done retrieving: data size 43566038
Sun 19 Jan 2014 23:27:27 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:27:27 - XML: Start document: iteration 6
Sun 19 Jan 2014 23:27:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566038
Sun 19 Jan 2014 23:27:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566038
Sun 19 Jan 2014 23:27:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:27:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:27:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:27:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:27:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:27:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:27:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:27:44 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:27:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:27:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:27:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:27:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:27:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:27:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:27:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:27:46 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:27:46 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:27:46 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:27:46 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:27:46 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:27:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:27:51 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:27:51 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:27:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 23:27:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:27:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:27:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:27:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:27:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:27:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:27:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:27:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:27:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565580
Sun 19 Jan 2014 23:27:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:27:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565580
Sun 19 Jan 2014 23:27:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:28:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:28:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:28:02 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:28:02 - job_xml_thread(): Done retrieving: data size 43565580
Sun 19 Jan 2014 23:28:02 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:28:02 - XML: Start document: iteration 7
Sun 19 Jan 2014 23:28:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:28:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:28:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:28:09 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:28:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:28:10 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:28:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 23:28:10 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:28:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 23:28:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6005 values 94771 bits 11846 bytes 
Sun 19 Jan 2014 23:28:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:28:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:28:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:28:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:28:12 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:28:12 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:28:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:28:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:28:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:28:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:28:15 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:28:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:28:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:28:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:28:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:28:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:28:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:28:18 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:28:18 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:28:18 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:28:18 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:28:18 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:28:23 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:28:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561749
Sun 19 Jan 2014 23:28:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:28:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561749
Sun 19 Jan 2014 23:28:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:28:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:28:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:28:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:28:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:28:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:28:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:28:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:28:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:28:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:28:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:28:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561749
Sun 19 Jan 2014 23:28:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:28:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:28:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:28:33 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:28:33 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:28:39 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:28:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 23:28:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:28:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:28:43 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:28:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:28:45 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:28:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:28:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:28:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:28:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:28:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:28:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:28:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:28:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:28:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:28:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:28:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:28:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:28:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:28:48 - job_xml_thread(): Done retrieving: data size 43547330
Sun 19 Jan 2014 23:28:48 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:28:48 - XML: Start document: iteration 8
Sun 19 Jan 2014 23:28:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43547330
Sun 19 Jan 2014 23:28:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43547330
Sun 19 Jan 2014 23:28:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:28:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:29:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:29:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:29:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:29:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:29:05 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:29:05 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:29:05 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:29:05 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:29:05 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:29:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:29:06 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:29:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:29:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:29:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:29:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:29:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:29:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:29:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:29:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:29:10 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:29:11 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:29:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 23:29:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:29:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 23:29:11 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:29:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6199 values 97836 bits 12229 bytes 
Sun 19 Jan 2014 23:29:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:29:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:29:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:29:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:29:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:29:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:29:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:29:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:29:16 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:29:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43516710
Sun 19 Jan 2014 23:29:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:29:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43516710
Sun 19 Jan 2014 23:29:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:29:20 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:29:21 - job_xml_thread(): Done retrieving: data size 43516710
Sun 19 Jan 2014 23:29:21 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:29:21 - XML: Start document: iteration 9
Sun 19 Jan 2014 23:29:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:29:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:29:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:29:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:29:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:29:34 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:29:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:29:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:29:35 - XML: Processed 652599 elements - found 0 jobs
Sun 19 Jan 2014 23:29:35 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:29:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:29:35 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:29:35 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:29:35 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:29:35 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:29:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:29:35 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:29:35 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:29:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:29:39 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:29:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:29:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:29:39 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:29:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 23:29:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:29:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:29:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:29:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:29:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:29:42 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:29:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43013532
Sun 19 Jan 2014 23:29:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:29:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43013532
Sun 19 Jan 2014 23:29:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:29:50 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:29:50 - job_xml_thread(): Done retrieving: data size 43013532
Sun 19 Jan 2014 23:29:50 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:29:50 - XML: Start document: iteration 10
Sun 19 Jan 2014 23:29:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:29:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:29:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:29:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:29:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:29:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:29:52 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:29:52 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:29:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:29:52 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:29:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:29:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:29:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:29:57 - XML: Processed 646346 elements - found 0 jobs
Sun 19 Jan 2014 23:29:57 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:29:57 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:29:57 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:29:57 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:30:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:30:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:30:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:30:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:30:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:30:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:30:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:30:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:30:05 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 23:30:05 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 23:30:05 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:30:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:30:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42893331
Sun 19 Jan 2014 23:30:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:30:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42893331
Sun 19 Jan 2014 23:30:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:30:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:30:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:30:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:30:11 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:30:12 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:30:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:30:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 23:30:13 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:30:13 - job_xml_thread(): Done retrieving: data size 42893331
Sun 19 Jan 2014 23:30:13 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:30:13 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:30:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8819 values 139032 bits 17379 bytes 
Sun 19 Jan 2014 23:30:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 23:30:13 - XML: Start document: iteration 11
Sun 19 Jan 2014 23:30:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:30:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:30:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:30:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:30:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:30:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:30:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:30:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:30:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:30:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:30:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:30:24 - XML: Processed 645288 elements - found 0 jobs
Sun 19 Jan 2014 23:30:24 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:30:24 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:30:24 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:30:25 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:30:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:30:27 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:30:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:30:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:30:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:30:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:30:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:30:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:30:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:30:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43047348
Sun 19 Jan 2014 23:30:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43047348
Sun 19 Jan 2014 23:30:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:30:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:30:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:30:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:30:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:30:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:30:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:30:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:30:40 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:30:40 - job_xml_thread(): Done retrieving: data size 43047348
Sun 19 Jan 2014 23:30:40 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:30:40 - XML: Start document: iteration 12
Sun 19 Jan 2014 23:30:40 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:30:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:30:40 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:30:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:30:40 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:30:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:30:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:30:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:30:46 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:30:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:30:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:30:47 - XML: Processed 646728 elements - found 0 jobs
Sun 19 Jan 2014 23:30:47 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:30:47 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:30:47 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:30:47 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:30:47 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:30:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 23:30:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:30:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:30:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:30:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:30:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:30:48 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:30:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43528702
Sun 19 Jan 2014 23:30:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:30:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43528702
Sun 19 Jan 2014 23:30:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:30:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:30:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:30:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:30:59 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:30:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:30:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:31:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:31:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:31:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:31:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:31:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:31:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:31:01 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:31:02 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:31:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:31:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:31:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:31:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:31:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:31:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:31:03 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:31:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581842
Sun 19 Jan 2014 23:31:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:31:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581842
Sun 19 Jan 2014 23:31:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:31:04 - job_xml_thread(): Done retrieving: data size 43581842
Sun 19 Jan 2014 23:31:04 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:31:04 - XML: Start document: iteration 13
Sun 19 Jan 2014 23:31:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:31:14 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:31:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:31:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:31:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:31:15 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:31:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 23:31:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 23:31:16 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:31:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8955 values 141365 bits 17670 bytes 
Sun 19 Jan 2014 23:31:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:31:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:31:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:31:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:31:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:31:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:31:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:31:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:31:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:31:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:31:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:31:25 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:31:25 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:31:25 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:31:25 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:31:25 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:31:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:31:26 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:31:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:31:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:31:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:31:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:31:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:31:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:31:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:31:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578159
Sun 19 Jan 2014 23:31:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:31:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578159
Sun 19 Jan 2014 23:31:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:31:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:31:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:31:41 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:31:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:31:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:31:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:31:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:31:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:31:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:31:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:31:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:31:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:31:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:31:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:31:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:31:44 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:31:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:31:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:31:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:31:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:31:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:31:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:31:45 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:31:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 23:31:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:31:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:31:46 - job_xml_thread(): Done retrieving: data size 43575939
Sun 19 Jan 2014 23:31:46 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:31:46 - XML: Start document: iteration 14
Sun 19 Jan 2014 23:31:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575939
Sun 19 Jan 2014 23:31:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:31:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575939
Sun 19 Jan 2014 23:31:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:31:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:31:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:32:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:32:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:32:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:32:00 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:32:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:32:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:32:01 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:32:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:32:01 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:32:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:32:01 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:32:03 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:32:03 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:32:03 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:32:03 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:32:03 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:32:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:32:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:32:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:32:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:32:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:32:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:32:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:32:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:32:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:32:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569280
Sun 19 Jan 2014 23:32:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:32:11 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 23:32:11 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:32:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569280
Sun 19 Jan 2014 23:32:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:32:12 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:32:12 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 23:32:12 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 23:32:12 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:32:12 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 23:32:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:32:16 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:32:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:32:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:32:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:32:18 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:32:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 23:32:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 23:32:18 - size of cluster 'LISA Cluster': 624 hosts 79464 metrics 746838 values 11783363 bits 1472920 bytes 
Sun 19 Jan 2014 23:32:18 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:32:19 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:32:19 - job_xml_thread(): Done retrieving: data size 43569280
Sun 19 Jan 2014 23:32:19 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:32:19 - XML: Start document: iteration 15
Sun 19 Jan 2014 23:32:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8902 values 140789 bits 17598 bytes 
Sun 19 Jan 2014 23:32:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:32:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:32:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:32:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:32:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:32:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:32:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:32:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:32:25 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:32:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:32:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:32:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:32:31 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:32:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:32:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:32:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:32:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:32:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:32:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:32:34 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:32:34 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:32:34 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:32:34 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:32:34 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:32:38 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:32:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559090
Sun 19 Jan 2014 23:32:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:32:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559090
Sun 19 Jan 2014 23:32:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:32:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:32:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:32:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:32:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:32:49 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:32:49 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:32:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:32:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:32:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:32:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:32:49 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:32:49 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:32:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:32:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:32:52 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:32:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 23:32:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:32:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:32:53 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:32:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:32:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:32:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:32:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:32:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:32:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:32:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:32:58 - job_xml_thread(): Done retrieving: data size 43583930
Sun 19 Jan 2014 23:32:58 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:32:58 - XML: Start document: iteration 16
Sun 19 Jan 2014 23:32:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583930
Sun 19 Jan 2014 23:32:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583930
Sun 19 Jan 2014 23:32:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:32:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:33:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:33:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:33:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:33:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:33:13 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:33:13 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 23:33:17 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 23:33:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:33:18 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:33:18 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:33:18 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:33:18 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:33:18 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:33:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:33:18 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:33:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:33:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:33:19 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:33:19 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:33:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:33:19 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:33:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:33:19 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:33:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:33:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 23:33:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 23:33:19 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:33:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6096 values 96482 bits 12060 bytes 
Sun 19 Jan 2014 23:33:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:33:21 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:33:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:33:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:33:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:33:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:33:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:33:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:33:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:33:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43586402
Sun 19 Jan 2014 23:33:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:33:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43586402
Sun 19 Jan 2014 23:33:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:33:33 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:33:33 - job_xml_thread(): Done retrieving: data size 43586402
Sun 19 Jan 2014 23:33:33 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:33:33 - XML: Start document: iteration 17
Sun 19 Jan 2014 23:33:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:33:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:33:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:33:35 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:33:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:33:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:33:36 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:33:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:33:36 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:33:36 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:33:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:33:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:33:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:33:39 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:33:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 23:33:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:33:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:33:47 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:33:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:33:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:33:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:33:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:33:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:33:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:33:49 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:33:49 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:33:49 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:33:49 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:33:49 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:33:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:33:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:33:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:33:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43549197
Sun 19 Jan 2014 23:33:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:33:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43549197
Sun 19 Jan 2014 23:33:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:34:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:34:01 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:34:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:34:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:34:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:34:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:34:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:34:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:34:02 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:34:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:34:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:34:04 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:34:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:34:06 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:34:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:34:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:34:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:34:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:34:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:34:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:34:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:34:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577298
Sun 19 Jan 2014 23:34:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:34:11 - job_xml_thread(): Done retrieving: data size 43577298
Sun 19 Jan 2014 23:34:11 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:34:11 - XML: Start document: iteration 18
Sun 19 Jan 2014 23:34:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577298
Sun 19 Jan 2014 23:34:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:34:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:34:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:34:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:34:19 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:34:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:34:20 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:34:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 23:34:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 23:34:20 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:34:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:34:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9184 values 145089 bits 18136 bytes 
Sun 19 Jan 2014 23:34:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:34:23 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:34:23 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:34:23 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:34:23 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:34:23 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:34:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:34:30 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:34:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:34:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:34:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:34:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:34:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:34:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:34:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:34:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:34:35 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:34:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:34:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:34:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:34:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:34:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:34:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:34:38 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:34:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:34:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577466
Sun 19 Jan 2014 23:34:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:34:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577466
Sun 19 Jan 2014 23:34:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:34:40 - job_xml_thread(): Done retrieving: data size 43577466
Sun 19 Jan 2014 23:34:40 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:34:40 - XML: Start document: iteration 19
Sun 19 Jan 2014 23:34:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:34:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:34:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:34:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:34:56 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:34:56 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:34:56 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:34:56 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:34:56 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:34:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:34:59 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:34:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:34:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:35:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:35:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:35:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:35:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:35:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:35:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:35:03 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:35:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:35:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:35:03 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:35:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 23:35:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:35:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:35:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:35:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:35:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:35:06 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:35:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584677
Sun 19 Jan 2014 23:35:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:35:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584677
Sun 19 Jan 2014 23:35:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:35:11 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:35:11 - job_xml_thread(): Done retrieving: data size 43584677
Sun 19 Jan 2014 23:35:11 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:35:11 - XML: Start document: iteration 20
Sun 19 Jan 2014 23:35:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:35:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:35:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:35:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:35:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:35:21 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:35:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:35:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:35:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:35:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:35:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:35:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:35:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:35:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:35:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:35:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:35:22 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:35:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 23:35:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 23:35:22 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:35:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5773 values 91078 bits 11384 bytes 
Sun 19 Jan 2014 23:35:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:35:25 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:35:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:35:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:35:25 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:35:25 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:35:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:35:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:35:27 - XML: Processed 653351 elements - found 0 jobs
Sun 19 Jan 2014 23:35:27 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:35:27 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:35:27 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:35:27 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:35:31 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:35:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43498477
Sun 19 Jan 2014 23:35:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:35:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43498477
Sun 19 Jan 2014 23:35:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:35:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:35:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:35:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:35:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:35:43 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:35:43 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:35:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:35:43 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:35:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:35:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:35:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:35:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:35:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:35:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:35:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:35:47 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:35:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:35:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:35:47 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:35:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 23:35:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:35:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:35:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:35:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:35:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:35:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:35:52 - job_xml_thread(): Done retrieving: data size 42941157
Sun 19 Jan 2014 23:35:52 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:35:52 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 23:35:52 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 23:35:52 - Housekeeping: done.
Sun 19 Jan 2014 23:35:52 - XML: Start document: iteration 0
Sun 19 Jan 2014 23:35:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42941157
Sun 19 Jan 2014 23:35:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42941157
Sun 19 Jan 2014 23:35:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:35:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:35:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:35:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:36:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:36:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:36:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:36:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:36:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:36:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:36:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:36:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:36:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:36:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:36:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:36:13 - XML: Processed 645508 elements - found 0 jobs
Sun 19 Jan 2014 23:36:13 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:36:13 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:36:13 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:36:13 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:36:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:36:16 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:36:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:36:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:36:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:36:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:36:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:36:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:36:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:36:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42967109
Sun 19 Jan 2014 23:36:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:36:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42967109
Sun 19 Jan 2014 23:36:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:36:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:36:23 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:36:23 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:36:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:36:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 23:36:23 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:36:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 23:36:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8893 values 140299 bits 17537 bytes 
Sun 19 Jan 2014 23:36:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:36:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:36:28 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:36:28 - job_xml_thread(): Done retrieving: data size 42967109
Sun 19 Jan 2014 23:36:28 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:36:28 - XML: Start document: iteration 1
Sun 19 Jan 2014 23:36:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:36:29 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:36:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:36:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:36:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:36:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:36:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:36:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:36:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:36:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:36:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:36:39 - XML: Processed 645820 elements - found 0 jobs
Sun 19 Jan 2014 23:36:39 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:36:39 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:36:39 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:36:39 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:36:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:36:41 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:36:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:36:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:36:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:36:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:36:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:36:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:36:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:36:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:36:45 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:36:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43409389
Sun 19 Jan 2014 23:36:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:36:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43409389
Sun 19 Jan 2014 23:36:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:36:54 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:36:54 - job_xml_thread(): Done retrieving: data size 43409389
Sun 19 Jan 2014 23:36:54 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:36:54 - XML: Start document: iteration 2
Sun 19 Jan 2014 23:36:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:36:57 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:36:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:36:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:36:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:36:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:36:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:36:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:36:58 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:36:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:36:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:37:08 - XML: Processed 651486 elements - found 0 jobs
Sun 19 Jan 2014 23:37:08 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:37:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:37:08 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:37:08 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:37:08 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:37:08 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:37:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:37:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:37:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:37:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:37:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:37:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:37:08 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:37:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 23:37:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:37:08 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 23:37:08 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 23:37:08 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:37:10 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:37:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559638
Sun 19 Jan 2014 23:37:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:37:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559638
Sun 19 Jan 2014 23:37:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:37:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:37:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:37:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:37:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:37:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:37:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:37:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:37:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:37:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:37:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:37:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559638
Sun 19 Jan 2014 23:37:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:37:23 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:37:23 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:37:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:37:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:37:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:37:23 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:37:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:37:24 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:37:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:37:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 23:37:24 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:37:24 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:37:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 23:37:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:37:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:37:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5689 values 89714 bits 11214 bytes 
Sun 19 Jan 2014 23:37:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:37:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:37:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:37:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:37:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:37:27 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:37:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:37:30 - job_xml_thread(): Done retrieving: data size 43592328
Sun 19 Jan 2014 23:37:30 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:37:30 - XML: Start document: iteration 3
Sun 19 Jan 2014 23:37:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43592328
Sun 19 Jan 2014 23:37:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:37:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:37:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:37:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:37:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:37:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:37:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:37:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43592328
Sun 19 Jan 2014 23:37:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:37:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:37:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:37:46 - XML: Processed 653349 elements - found 0 jobs
Sun 19 Jan 2014 23:37:47 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:37:47 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:37:47 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:37:47 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:37:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:37:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:37:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:37:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:37:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:37:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:37:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:37:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:37:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:37:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:37:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:37:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:37:53 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:37:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:37:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:37:53 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:37:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 23:37:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:37:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:37:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:37:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:37:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:37:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:37:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582684
Sun 19 Jan 2014 23:37:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:37:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582684
Sun 19 Jan 2014 23:37:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:38:03 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:38:03 - job_xml_thread(): Done retrieving: data size 43582684
Sun 19 Jan 2014 23:38:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:38:04 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:38:04 - XML: Start document: iteration 4
Sun 19 Jan 2014 23:38:04 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:38:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:38:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:38:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:38:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:38:07 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:38:07 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:38:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:38:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:38:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:38:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:38:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:38:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:38:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:38:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:38:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:38:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:38:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:38:15 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:38:15 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:38:15 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:38:15 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:38:15 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:38:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:38:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564904
Sun 19 Jan 2014 23:38:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:38:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564904
Sun 19 Jan 2014 23:38:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:38:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:38:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:38:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:38:24 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:38:26 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:38:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 23:38:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:38:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 23:38:27 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:38:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9041 values 142727 bits 17840 bytes 
Sun 19 Jan 2014 23:38:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:38:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:38:29 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:38:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:38:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:38:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:38:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:38:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:38:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:38:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:38:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:38:30 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:38:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:38:32 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:38:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:38:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:38:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:38:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:38:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:38:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:38:35 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:38:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582278
Sun 19 Jan 2014 23:38:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:38:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582278
Sun 19 Jan 2014 23:38:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:38:36 - job_xml_thread(): Done retrieving: data size 43582278
Sun 19 Jan 2014 23:38:37 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:38:37 - XML: Start document: iteration 5
Sun 19 Jan 2014 23:38:41 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:38:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 23:38:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:38:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:38:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:38:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:38:46 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:38:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:38:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:38:48 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:38:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:38:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:38:48 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:38:48 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:38:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:38:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:38:57 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:38:57 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:38:57 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:38:57 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:38:57 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:38:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:38:58 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:38:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:38:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:38:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:38:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:38:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:38:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:38:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:38:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577479
Sun 19 Jan 2014 23:38:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:39:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577479
Sun 19 Jan 2014 23:39:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:39:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:39:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:39:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:39:10 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:39:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:39:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:39:12 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:39:12 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:39:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:39:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:39:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:39:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:39:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:39:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:39:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:39:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:39:13 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 23:39:13 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:39:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:39:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:39:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:39:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:39:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:39:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:39:14 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:39:14 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:39:14 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 23:39:14 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 23:39:14 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 23:39:15 - size of cluster 'LISA Cluster': 624 hosts 79482 metrics 803668 values 12675604 bits 1584450 bytes 
Sun 19 Jan 2014 23:39:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:39:17 - job_xml_thread(): Done retrieving: data size 43591272
Sun 19 Jan 2014 23:39:17 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:39:17 - XML: Start document: iteration 6
Sun 19 Jan 2014 23:39:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43591272
Sun 19 Jan 2014 23:39:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43591272
Sun 19 Jan 2014 23:39:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:39:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:39:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:39:27 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:39:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:39:28 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:39:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 23:39:28 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:39:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9394 values 148252 bits 18531 bytes 
Sun 19 Jan 2014 23:39:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 23:39:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:39:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:39:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:39:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:39:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:39:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:39:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:39:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:39:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:39:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:39:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:39:39 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:39:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:39:41 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:39:41 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:39:41 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:39:41 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:39:41 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:39:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:39:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:39:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:39:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:39:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:39:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:39:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:39:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:39:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:39:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43589627
Sun 19 Jan 2014 23:39:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:39:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43589627
Sun 19 Jan 2014 23:39:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:39:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:39:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:39:56 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:39:56 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:39:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:39:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:39:57 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:39:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 23:39:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:39:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:39:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:39:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:39:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:39:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:39:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:40:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:40:01 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:40:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:40:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:40:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:40:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:40:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:40:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:40:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:40:05 - job_xml_thread(): Done retrieving: data size 43559142
Sun 19 Jan 2014 23:40:05 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:40:05 - XML: Start document: iteration 7
Sun 19 Jan 2014 23:40:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559142
Sun 19 Jan 2014 23:40:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559142
Sun 19 Jan 2014 23:40:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:40:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:40:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:40:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:40:14 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:40:14 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 23:40:16 - XML: Processed 653350 elements - found 0 jobs
Sun 19 Jan 2014 23:40:16 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:40:16 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:40:16 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:40:16 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:40:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:40:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:40:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:40:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:40:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:40:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:40:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:40:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:40:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:40:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:40:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:40:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:40:27 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:40:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:40:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:40:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:40:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:40:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:40:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:40:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:40:28 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:40:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:40:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 23:40:29 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:40:29 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:40:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 23:40:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5957 values 94031 bits 11753 bytes 
Sun 19 Jan 2014 23:40:29 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:40:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43589736
Sun 19 Jan 2014 23:40:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:40:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43589736
Sun 19 Jan 2014 23:40:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:40:31 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:40:31 - job_xml_thread(): Done retrieving: data size 43589736
Sun 19 Jan 2014 23:40:31 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:40:31 - XML: Start document: iteration 8
Sun 19 Jan 2014 23:40:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:40:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:40:42 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:40:42 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:40:42 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:40:42 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:40:42 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:40:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:40:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:40:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:40:49 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:40:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:40:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:40:50 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:40:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:40:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:40:50 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:40:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:40:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:40:53 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:40:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:40:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:40:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:40:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:40:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:40:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:40:57 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:40:57 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:40:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 23:40:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:40:57 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:40:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582438
Sun 19 Jan 2014 23:40:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:40:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582438
Sun 19 Jan 2014 23:40:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:40:58 - job_xml_thread(): Done retrieving: data size 43582438
Sun 19 Jan 2014 23:40:58 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:40:58 - XML: Start document: iteration 9
Sun 19 Jan 2014 23:41:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:41:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:41:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:41:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:41:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:41:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:41:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:41:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:41:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:41:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:41:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:41:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:41:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:41:19 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:41:19 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:41:19 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:41:19 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:41:19 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:41:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:41:21 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:41:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:41:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:41:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:41:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:41:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:41:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:41:25 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:41:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43502415
Sun 19 Jan 2014 23:41:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:41:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43502415
Sun 19 Jan 2014 23:41:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:41:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:41:30 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:41:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:41:30 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:41:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 23:41:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 23:41:30 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:41:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6596 values 104110 bits 13013 bytes 
Sun 19 Jan 2014 23:41:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:41:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:41:34 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:41:34 - job_xml_thread(): Done retrieving: data size 43502415
Sun 19 Jan 2014 23:41:34 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:41:34 - XML: Start document: iteration 10
Sun 19 Jan 2014 23:41:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:41:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:41:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:41:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:41:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:41:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:41:43 - XML: Processed 652602 elements - found 0 jobs
Sun 19 Jan 2014 23:41:44 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:41:44 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:41:44 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:41:44 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:41:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:41:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:41:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:41:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:41:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:41:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:41:48 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:41:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:41:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:41:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:41:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:41:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:41:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:41:51 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:41:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 23:41:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:41:52 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:41:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42943912
Sun 19 Jan 2014 23:41:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:41:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42943912
Sun 19 Jan 2014 23:41:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:41:59 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:41:59 - job_xml_thread(): Done retrieving: data size 42943912
Sun 19 Jan 2014 23:41:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:41:59 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:41:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:41:59 - XML: Start document: iteration 11
Sun 19 Jan 2014 23:42:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:42:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:42:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:42:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:42:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:42:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:42:09 - XML: Processed 645584 elements - found 0 jobs
Sun 19 Jan 2014 23:42:09 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:42:09 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:42:09 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:42:09 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:42:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:42:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:42:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:42:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:42:09 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:42:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:42:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:42:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:42:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:42:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:42:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:42:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:42:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:42:15 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:42:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42934884
Sun 19 Jan 2014 23:42:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:42:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42934884
Sun 19 Jan 2014 23:42:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:42:24 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:42:24 - job_xml_thread(): Done retrieving: data size 42934884
Sun 19 Jan 2014 23:42:24 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:42:24 - XML: Start document: iteration 12
Sun 19 Jan 2014 23:42:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:42:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:42:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:42:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:42:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:42:28 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:42:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:42:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:42:29 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:42:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:42:29 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:42:29 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:42:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:42:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:42:30 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:42:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:42:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 23:42:32 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:42:32 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:42:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 23:42:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99124 bits 12390 bytes 
Sun 19 Jan 2014 23:42:33 - XML: Processed 645152 elements - found 0 jobs
Sun 19 Jan 2014 23:42:33 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:42:33 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:42:33 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:42:33 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:42:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:42:37 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:42:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:42:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:42:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:42:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:42:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:42:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:42:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:42:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43455260
Sun 19 Jan 2014 23:42:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:42:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43455260
Sun 19 Jan 2014 23:42:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:42:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:42:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:42:48 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:42:48 - job_xml_thread(): Done retrieving: data size 43455260
Sun 19 Jan 2014 23:42:48 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:42:48 - XML: Start document: iteration 13
Sun 19 Jan 2014 23:42:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:42:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:42:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:42:58 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:42:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:42:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:43:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:43:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:43:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:43:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:43:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:43:03 - XML: Processed 652152 elements - found 0 jobs
Sun 19 Jan 2014 23:43:03 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:43:03 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:43:03 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:43:03 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:43:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:43:05 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:43:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:43:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:43:06 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:43:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 23:43:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:43:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:43:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:43:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:43:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:43:09 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:43:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556472
Sun 19 Jan 2014 23:43:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:43:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556472
Sun 19 Jan 2014 23:43:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:43:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:43:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:43:18 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:43:18 - job_xml_thread(): Done retrieving: data size 43556472
Sun 19 Jan 2014 23:43:18 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:43:18 - XML: Start document: iteration 14
Sun 19 Jan 2014 23:43:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:43:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:43:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:43:22 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:43:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:43:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:43:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:43:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:43:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:43:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:43:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:43:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:43:26 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:43:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:43:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:43:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:43:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:43:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:43:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:43:30 - XML: Processed 653349 elements - found 0 jobs
Sun 19 Jan 2014 23:43:30 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:43:30 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:43:30 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:43:30 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:43:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:43:32 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:43:32 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:43:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:43:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 23:43:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 23:43:32 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:43:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5679 values 89571 bits 11196 bytes 
Sun 19 Jan 2014 23:43:34 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:43:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553775
Sun 19 Jan 2014 23:43:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:43:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553775
Sun 19 Jan 2014 23:43:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:43:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:43:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:43:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:43:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:43:45 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:43:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:43:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:43:47 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:43:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:43:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:43:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:43:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:43:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:43:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:43:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:43:51 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:43:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:43:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:43:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:43:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:43:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:43:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:43:54 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:43:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 23:43:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:43:54 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 23:43:54 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 23:43:54 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:43:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:43:54 - job_xml_thread(): Done retrieving: data size 43563782
Sun 19 Jan 2014 23:43:54 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:43:54 - XML: Start document: iteration 15
Sun 19 Jan 2014 23:43:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563782
Sun 19 Jan 2014 23:43:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563782
Sun 19 Jan 2014 23:43:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:43:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:44:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:44:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:44:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:44:06 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:44:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:44:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:44:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:44:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:44:07 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:44:08 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:44:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:44:08 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:44:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:44:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:44:12 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:44:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:44:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:44:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:44:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:44:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:44:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:44:15 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:44:15 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:44:15 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:44:15 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:44:15 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:44:17 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:44:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573421
Sun 19 Jan 2014 23:44:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:44:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573421
Sun 19 Jan 2014 23:44:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:44:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:44:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:44:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:44:27 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:44:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:44:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:44:28 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:44:28 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:44:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:44:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:44:28 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:44:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:44:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:44:30 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:44:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:44:31 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:44:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:44:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:44:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:44:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:44:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:44:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:44:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:44:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583258
Sun 19 Jan 2014 23:44:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:44:33 - job_xml_thread(): Done retrieving: data size 43583258
Sun 19 Jan 2014 23:44:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:44:33 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:44:33 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:44:33 - XML: Start document: iteration 16
Sun 19 Jan 2014 23:44:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583258
Sun 19 Jan 2014 23:44:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:44:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:44:34 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:44:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 23:44:35 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:44:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7466 values 117854 bits 14731 bytes 
Sun 19 Jan 2014 23:44:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 23:44:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:44:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:44:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:44:46 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:44:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:44:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:44:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:44:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:44:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:44:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:44:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:44:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:44:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:44:53 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:44:53 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:44:53 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:44:53 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:44:53 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:44:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:44:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:44:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:44:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:44:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:44:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:44:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:44:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:44:58 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:44:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574586
Sun 19 Jan 2014 23:44:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:44:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574586
Sun 19 Jan 2014 23:44:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:45:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:45:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:45:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:45:08 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:45:08 - job_xml_thread(): Done retrieving: data size 43574586
Sun 19 Jan 2014 23:45:08 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:45:08 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:45:08 - XML: Start document: iteration 17
Sun 19 Jan 2014 23:45:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:45:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:45:09 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:45:09 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:45:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:45:10 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:45:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:45:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:45:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:45:12 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:45:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 23:45:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:45:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:45:19 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:45:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:45:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:45:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:45:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:45:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:45:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:45:20 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:45:20 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:45:20 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:45:20 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:45:20 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:45:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:45:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43551486
Sun 19 Jan 2014 23:45:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:45:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43551486
Sun 19 Jan 2014 23:45:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:45:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:45:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:45:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:45:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:45:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:45:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:45:34 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:45:34 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:45:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:45:34 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:45:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:45:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:45:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:45:35 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:45:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:45:35 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:45:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:45:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:45:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:45:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:45:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:45:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 23:45:36 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:45:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:45:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:45:36 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:45:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:45:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:45:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 23:45:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6076 values 95943 bits 11992 bytes 
Sun 19 Jan 2014 23:45:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:45:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575808
Sun 19 Jan 2014 23:45:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:45:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575808
Sun 19 Jan 2014 23:45:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:45:39 - job_xml_thread(): Done retrieving: data size 43575808
Sun 19 Jan 2014 23:45:39 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:45:39 - XML: Start document: iteration 18
Sun 19 Jan 2014 23:45:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:45:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:45:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:45:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:45:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:45:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:45:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:45:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:45:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:45:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:45:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:45:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:45:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:45:56 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:45:56 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:45:56 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:45:56 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:45:56 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:46:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:46:00 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:46:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:46:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:46:00 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:46:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 23:46:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:46:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:46:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:46:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:46:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:46:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:46:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572023
Sun 19 Jan 2014 23:46:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:46:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572023
Sun 19 Jan 2014 23:46:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:46:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:46:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:46:11 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:46:11 - job_xml_thread(): Done retrieving: data size 43572023
Sun 19 Jan 2014 23:46:11 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:46:11 - XML: Start document: iteration 19
Sun 19 Jan 2014 23:46:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:46:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:46:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:46:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:46:13 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:46:13 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:46:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:46:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:46:13 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:46:15 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 23:46:15 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:46:16 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:46:16 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 23:46:16 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 23:46:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:46:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:46:16 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:46:18 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 23:46:22 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:46:22 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:46:22 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:46:22 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:46:22 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:46:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:46:24 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:46:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:46:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:46:25 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 824153 values 12997279 bits 1624659 bytes 
Sun 19 Jan 2014 23:46:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:46:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:46:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:46:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:46:28 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:46:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:46:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565027
Sun 19 Jan 2014 23:46:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:46:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:46:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565027
Sun 19 Jan 2014 23:46:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:46:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:46:36 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:46:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:46:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:46:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:46:36 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:46:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:46:37 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:46:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 23:46:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 23:46:37 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:46:37 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:46:37 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:46:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:46:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:46:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8735 values 137957 bits 17244 bytes 
Sun 19 Jan 2014 23:46:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565027
Sun 19 Jan 2014 23:46:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:46:37 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:46:37 - job_xml_thread(): Done retrieving: data size 43565027
Sun 19 Jan 2014 23:46:37 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:46:37 - XML: Start document: iteration 20
Sun 19 Jan 2014 23:46:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:46:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:46:50 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:46:50 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:46:50 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:46:50 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:46:50 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:46:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:46:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:46:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:46:53 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:46:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:46:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:46:54 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:46:54 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:46:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:46:54 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:46:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:46:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:46:55 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:46:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:46:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:46:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:46:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:46:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:46:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:46:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:46:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43604899
Sun 19 Jan 2014 23:46:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:46:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43604899
Sun 19 Jan 2014 23:46:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:47:05 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:47:05 - job_xml_thread(): Done retrieving: data size 43604899
Sun 19 Jan 2014 23:47:05 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:47:05 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 23:47:05 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 23:47:05 - Housekeeping: done.
Sun 19 Jan 2014 23:47:05 - XML: Start document: iteration 0
Sun 19 Jan 2014 23:47:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:47:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:47:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:47:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:47:14 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:47:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 23:47:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:47:18 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:47:18 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:47:18 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:47:18 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:47:18 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:47:18 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 23:47:18 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:47:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:47:19 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:47:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:47:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:47:20 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:47:20 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:47:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:47:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:47:20 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:47:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:47:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:47:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:47:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:47:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:47:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:47:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:47:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:47:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:47:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43519779
Sun 19 Jan 2014 23:47:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:47:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43519779
Sun 19 Jan 2014 23:47:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:47:33 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:47:33 - job_xml_thread(): Done retrieving: data size 43519779
Sun 19 Jan 2014 23:47:34 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:47:34 - XML: Start document: iteration 1
Sun 19 Jan 2014 23:47:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:47:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:47:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:47:37 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:47:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:47:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:47:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:47:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 23:47:39 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:47:39 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:47:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 23:47:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5944 values 94099 bits 11762 bytes 
Sun 19 Jan 2014 23:47:45 - XML: Processed 652602 elements - found 0 jobs
Sun 19 Jan 2014 23:47:45 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:47:45 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:47:45 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:47:45 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:47:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:47:46 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:47:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:47:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:47:47 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:47:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:47:47 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:47:47 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:47:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:47:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:47:50 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:47:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:47:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:47:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:47:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:47:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:47:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:47:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:47:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42932084
Sun 19 Jan 2014 23:47:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:47:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42932084
Sun 19 Jan 2014 23:47:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:48:00 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:48:00 - job_xml_thread(): Done retrieving: data size 42932084
Sun 19 Jan 2014 23:48:00 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:48:00 - XML: Start document: iteration 2
Sun 19 Jan 2014 23:48:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:48:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:48:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:48:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:48:14 - XML: Processed 645424 elements - found 0 jobs
Sun 19 Jan 2014 23:48:14 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:48:14 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:48:14 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:48:14 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:48:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:48:17 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:48:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:48:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:48:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:48:18 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:48:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:48:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:48:18 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:48:18 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:48:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:48:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:48:18 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:48:18 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:48:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 23:48:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:48:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:48:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:48:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:48:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:48:22 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:48:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42983286
Sun 19 Jan 2014 23:48:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:48:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42983286
Sun 19 Jan 2014 23:48:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:48:29 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:48:29 - job_xml_thread(): Done retrieving: data size 42983286
Sun 19 Jan 2014 23:48:29 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:48:29 - XML: Start document: iteration 3
Sun 19 Jan 2014 23:48:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:48:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:48:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:48:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:48:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:48:39 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:48:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:48:40 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:48:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 23:48:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 23:48:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:48:41 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:48:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:48:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:48:41 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:48:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:48:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5693 values 89982 bits 11247 bytes 
Sun 19 Jan 2014 23:48:42 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:48:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:48:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:48:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:48:42 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:48:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:48:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:48:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:48:43 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:48:43 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:48:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:48:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:48:43 - XML: Processed 645900 elements - found 0 jobs
Sun 19 Jan 2014 23:48:43 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:48:43 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:48:43 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:48:43 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:48:47 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:48:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43510876
Sun 19 Jan 2014 23:48:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:48:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43510876
Sun 19 Jan 2014 23:48:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:48:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:48:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:48:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:48:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:48:58 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:48:59 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:49:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:49:01 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:49:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:49:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:49:02 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:49:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:49:02 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:49:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:49:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:49:02 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:49:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:49:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:49:03 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:49:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 23:49:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:49:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:49:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:49:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:49:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:49:05 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:49:05 - job_xml_thread(): Done retrieving: data size 43563314
Sun 19 Jan 2014 23:49:05 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:49:05 - XML: Start document: iteration 4
Sun 19 Jan 2014 23:49:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563314
Sun 19 Jan 2014 23:49:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:49:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563314
Sun 19 Jan 2014 23:49:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:49:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:49:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:49:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:49:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:49:22 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:49:23 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:49:23 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:49:23 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:49:23 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:49:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:49:25 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:49:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:49:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:49:26 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:49:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:49:26 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:49:26 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:49:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:49:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:49:29 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:49:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:49:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:49:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:49:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:49:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:49:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:49:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:49:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570962
Sun 19 Jan 2014 23:49:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:49:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570962
Sun 19 Jan 2014 23:49:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:49:38 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:49:38 - job_xml_thread(): Done retrieving: data size 43570962
Sun 19 Jan 2014 23:49:38 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:49:38 - XML: Start document: iteration 5
Sun 19 Jan 2014 23:49:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:49:40 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:49:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:49:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:49:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:49:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 23:49:42 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:49:42 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:49:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 23:49:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8836 values 139423 bits 17427 bytes 
Sun 19 Jan 2014 23:49:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:49:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:49:48 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:49:48 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:49:48 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:49:48 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:49:49 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:49:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:49:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:49:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:49:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:49:53 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:49:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:49:53 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:49:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:49:53 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:49:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:49:56 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:49:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:49:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:49:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:49:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:49:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:49:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:49:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:49:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581879
Sun 19 Jan 2014 23:49:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:50:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581879
Sun 19 Jan 2014 23:50:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:50:04 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:50:04 - job_xml_thread(): Done retrieving: data size 43581879
Sun 19 Jan 2014 23:50:04 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:50:04 - XML: Start document: iteration 6
Sun 19 Jan 2014 23:50:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:50:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:50:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:50:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:50:15 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:50:15 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:50:15 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:50:15 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:50:15 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:50:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:50:16 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:50:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:50:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:50:17 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:50:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:50:17 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:50:17 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:50:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:50:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:50:22 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:50:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:50:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:50:23 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:50:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 23:50:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:50:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:50:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:50:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:50:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:50:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:50:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579142
Sun 19 Jan 2014 23:50:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:50:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579142
Sun 19 Jan 2014 23:50:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:50:30 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:50:31 - job_xml_thread(): Done retrieving: data size 43579142
Sun 19 Jan 2014 23:50:31 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:50:31 - XML: Start document: iteration 7
Sun 19 Jan 2014 23:50:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:50:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:50:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:50:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:50:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:50:42 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:50:44 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:50:44 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:50:44 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:50:44 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:50:44 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:50:44 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:50:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:50:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 23:50:44 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:50:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5764 values 90935 bits 11366 bytes 
Sun 19 Jan 2014 23:50:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 23:50:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:50:44 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:50:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:50:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:50:45 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:50:45 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:50:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:50:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:50:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:50:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:50:49 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:50:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:50:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:50:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:50:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:50:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:50:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:50:54 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:50:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581881
Sun 19 Jan 2014 23:50:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:50:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581881
Sun 19 Jan 2014 23:50:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:50:59 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:50:59 - job_xml_thread(): Done retrieving: data size 43581881
Sun 19 Jan 2014 23:50:59 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:50:59 - XML: Start document: iteration 8
Sun 19 Jan 2014 23:51:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:51:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:51:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:51:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:51:10 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:51:10 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:51:10 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:51:10 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:51:10 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:51:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:51:13 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:51:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:51:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:51:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:51:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:51:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:51:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:51:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:51:15 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:51:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 23:51:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:51:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:51:16 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:51:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:51:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:51:16 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 23:51:16 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 23:51:16 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:51:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:51:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:51:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:51:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:51:18 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:51:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43593073
Sun 19 Jan 2014 23:51:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:51:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43593073
Sun 19 Jan 2014 23:51:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:51:25 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:51:25 - job_xml_thread(): Done retrieving: data size 43593073
Sun 19 Jan 2014 23:51:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:51:26 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:51:26 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:51:26 - XML: Start document: iteration 9
Sun 19 Jan 2014 23:51:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:51:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:51:30 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:51:30 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:51:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:51:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:51:30 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:51:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:51:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:51:35 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:51:35 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:51:35 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:51:35 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:51:35 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:51:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:51:38 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:51:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:51:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:51:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:51:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:51:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:51:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:51:40 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:51:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578238
Sun 19 Jan 2014 23:51:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:51:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578238
Sun 19 Jan 2014 23:51:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:51:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:51:44 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:51:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:51:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 23:51:45 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:51:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9108 values 143797 bits 17974 bytes 
Sun 19 Jan 2014 23:51:45 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:51:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 23:51:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:51:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:51:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:51:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:51:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:51:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:51:50 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:51:50 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:51:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:51:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:51:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:51:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:51:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:51:53 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:51:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:51:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:51:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:51:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:51:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:51:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:51:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:51:56 - job_xml_thread(): Done retrieving: data size 43586500
Sun 19 Jan 2014 23:51:56 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:51:56 - XML: Start document: iteration 10
Sun 19 Jan 2014 23:51:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43586500
Sun 19 Jan 2014 23:51:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:51:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43586500
Sun 19 Jan 2014 23:51:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:52:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:52:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:52:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:52:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:52:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:52:11 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:52:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:52:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:52:11 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:52:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:52:11 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:52:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:52:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:52:13 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:52:13 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:52:13 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:52:13 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:52:13 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:52:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:52:18 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:52:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:52:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:52:19 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:52:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 23:52:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:52:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:52:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:52:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:52:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:52:20 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:52:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572184
Sun 19 Jan 2014 23:52:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:52:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572184
Sun 19 Jan 2014 23:52:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:52:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:52:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:52:29 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:52:29 - job_xml_thread(): Done retrieving: data size 43572184
Sun 19 Jan 2014 23:52:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:52:30 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:52:30 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:52:30 - XML: Start document: iteration 11
Sun 19 Jan 2014 23:52:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:52:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:52:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:52:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:52:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:52:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:52:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:52:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:52:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:52:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:52:42 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:52:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:52:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:52:42 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:52:42 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:52:42 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:52:42 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:52:42 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:52:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:52:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:52:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:52:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:52:44 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:52:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43549430
Sun 19 Jan 2014 23:52:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:52:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43549430
Sun 19 Jan 2014 23:52:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:52:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:52:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:52:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:52:46 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:52:47 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:52:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 23:52:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:52:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 23:52:48 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:52:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8846 values 139583 bits 17447 bytes 
Sun 19 Jan 2014 23:52:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:52:56 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:52:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:52:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:52:57 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:52:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:52:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:52:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:52:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:52:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:52:59 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:52:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:52:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:52:59 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:52:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:52:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:52:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:52:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:52:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:52:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:53:01 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:53:01 - job_xml_thread(): Done retrieving: data size 43587438
Sun 19 Jan 2014 23:53:01 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:53:01 - XML: Start document: iteration 12
Sun 19 Jan 2014 23:53:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43587438
Sun 19 Jan 2014 23:53:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:53:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43587438
Sun 19 Jan 2014 23:53:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:53:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:53:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:53:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:53:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:53:15 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:53:15 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:53:15 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:53:15 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:53:15 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:53:18 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Sun 19 Jan 2014 23:53:18 - ganglia_store_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:53:19 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:53:19 - ganglia_store_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:53:19 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Sun 19 Jan 2014 23:53:19 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Sun 19 Jan 2014 23:53:19 - Entering storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 23:53:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:53:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:53:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:53:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:53:22 - size of cluster 'LISA Cluster': 624 hosts 79479 metrics 761414 values 12013374 bits 1501671 bytes 
Sun 19 Jan 2014 23:53:22 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:53:22 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:53:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:53:22 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:53:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:53:25 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:53:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 23:53:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:53:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:53:27 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:53:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:53:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:53:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:53:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:53:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:53:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:53:30 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:53:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43498840
Sun 19 Jan 2014 23:53:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:53:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43498840
Sun 19 Jan 2014 23:53:31 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:53:31 - job_xml_thread(): Done retrieving: data size 43498840
Sun 19 Jan 2014 23:53:31 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:53:31 - XML: Start document: iteration 13
Sun 19 Jan 2014 23:53:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:53:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:53:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:53:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:53:40 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:53:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:53:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:53:41 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:53:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:53:41 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:53:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:53:41 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:53:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:53:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:53:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:53:48 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:53:49 - XML: Processed 652598 elements - found 0 jobs
Sun 19 Jan 2014 23:53:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:53:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 23:53:49 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:53:49 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:53:49 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:53:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5811 values 91689 bits 11461 bytes 
Sun 19 Jan 2014 23:53:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 23:53:49 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:53:49 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:53:49 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:53:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:53:52 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:53:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:53:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:53:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:53:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:53:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:53:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:53:55 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:53:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42949015
Sun 19 Jan 2014 23:53:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:53:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42949015
Sun 19 Jan 2014 23:53:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:53:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:53:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:54:04 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:54:05 - job_xml_thread(): Done retrieving: data size 42949015
Sun 19 Jan 2014 23:54:06 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:54:06 - XML: Start document: iteration 14
Sun 19 Jan 2014 23:54:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:54:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:54:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:54:09 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:54:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:54:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:54:10 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:54:10 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:54:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:54:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:54:11 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:54:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:54:13 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:54:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:54:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:54:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:54:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:54:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:54:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:54:18 - XML: Processed 645714 elements - found 0 jobs
Sun 19 Jan 2014 23:54:18 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:54:18 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:54:18 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:54:18 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:54:18 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:54:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 23:54:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:54:19 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:54:19 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Sun 19 Jan 2014 23:54:21 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:54:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42963841
Sun 19 Jan 2014 23:54:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:54:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42963841
Sun 19 Jan 2014 23:54:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:54:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:54:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:54:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:54:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:54:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:54:32 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:54:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:54:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:54:32 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:54:32 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:54:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:54:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:54:32 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:54:33 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:54:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:54:37 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:54:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:54:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:54:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:54:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:54:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:54:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:54:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:54:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43232368
Sun 19 Jan 2014 23:54:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:54:41 - job_xml_thread(): Done retrieving: data size 43232368
Sun 19 Jan 2014 23:54:41 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:54:41 - XML: Start document: iteration 15
Sun 19 Jan 2014 23:54:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43232368
Sun 19 Jan 2014 23:54:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:54:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:54:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:54:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:54:49 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:54:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:54:50 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:54:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 23:54:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 23:54:50 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:54:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8895 values 140298 bits 17537 bytes 
Sun 19 Jan 2014 23:54:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:54:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:54:58 - XML: Processed 649117 elements - found 0 jobs
Sun 19 Jan 2014 23:54:59 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:54:59 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:54:59 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:54:59 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:54:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:54:59 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:54:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:54:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:55:00 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:55:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:55:00 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:55:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:55:00 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:55:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:55:04 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:55:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:55:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:55:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:55:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:55:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:55:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:55:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:55:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582564
Sun 19 Jan 2014 23:55:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:55:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582564
Sun 19 Jan 2014 23:55:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:55:14 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:55:14 - job_xml_thread(): Done retrieving: data size 43582564
Sun 19 Jan 2014 23:55:14 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:55:14 - XML: Start document: iteration 16
Sun 19 Jan 2014 23:55:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:55:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:55:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:55:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:55:21 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:55:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 23:55:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:55:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:55:23 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:55:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:55:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:55:24 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:55:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:55:24 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:55:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:55:24 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:55:26 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:55:26 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:55:26 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:55:26 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:55:26 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:55:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:55:28 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:55:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:55:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:55:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:55:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:55:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:55:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:55:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:55:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564421
Sun 19 Jan 2014 23:55:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:55:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564421
Sun 19 Jan 2014 23:55:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:55:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:55:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:55:41 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:55:41 - job_xml_thread(): Done retrieving: data size 43564421
Sun 19 Jan 2014 23:55:41 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:55:41 - XML: Start document: iteration 17
Sun 19 Jan 2014 23:55:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:55:43 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:55:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:55:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:55:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:55:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:55:44 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:55:44 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:55:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:55:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:55:44 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:55:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:55:51 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:55:51 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:55:51 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:55:51 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:55:51 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:55:51 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:55:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:55:51 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:55:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 23:55:51 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:55:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 23:55:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5851 values 92309 bits 11538 bytes 
Sun 19 Jan 2014 23:55:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:55:55 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:55:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:55:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:55:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:55:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:55:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:55:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:55:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:55:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:55:59 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:55:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43545470
Sun 19 Jan 2014 23:55:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:55:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43545470
Sun 19 Jan 2014 23:55:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:56:06 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:56:06 - job_xml_thread(): Done retrieving: data size 43545470
Sun 19 Jan 2014 23:56:06 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:56:06 - XML: Start document: iteration 18
Sun 19 Jan 2014 23:56:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:56:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:56:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:56:19 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:56:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:56:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:56:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:56:20 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:56:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:56:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:56:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:56:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:56:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:56:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:56:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:56:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:56:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:56:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:56:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:56:23 - XML: Processed 653345 elements - found 0 jobs
Sun 19 Jan 2014 23:56:23 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:56:23 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:56:23 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:56:23 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:56:23 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:56:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 23:56:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:56:26 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:56:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43595638
Sun 19 Jan 2014 23:56:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:56:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43595638
Sun 19 Jan 2014 23:56:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:56:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:56:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:56:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:56:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:56:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:56:38 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:56:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:56:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:56:38 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:56:38 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:56:38 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:56:38 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:56:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:56:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:56:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:56:41 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:56:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:56:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:56:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:56:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:56:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:56:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:56:46 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:56:46 - job_xml_thread(): Done retrieving: data size 43579657
Sun 19 Jan 2014 23:56:46 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:56:46 - XML: Start document: iteration 19
Sun 19 Jan 2014 23:56:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579657
Sun 19 Jan 2014 23:56:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579657
Sun 19 Jan 2014 23:56:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:56:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:56:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:56:51 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:56:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:56:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 23:56:52 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:56:52 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:56:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 23:56:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:56:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:56:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8824 values 139171 bits 17396 bytes 
Sun 19 Jan 2014 23:56:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:56:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:57:01 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:57:01 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:57:01 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:57:01 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:57:01 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:57:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:57:03 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:57:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:57:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:57:04 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:57:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:57:04 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:57:04 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:57:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:57:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:57:09 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:57:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:57:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:57:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:57:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:57:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:57:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:57:13 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:57:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43585606
Sun 19 Jan 2014 23:57:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:57:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43585606
Sun 19 Jan 2014 23:57:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:57:16 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:57:16 - job_xml_thread(): Done retrieving: data size 43585606
Sun 19 Jan 2014 23:57:16 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:57:16 - XML: Start document: iteration 20
Sun 19 Jan 2014 23:57:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:57:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:57:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:57:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:57:30 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:57:30 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:57:30 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:57:30 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:57:30 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:57:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:57:30 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:57:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:57:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:57:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:57:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:57:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:57:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:57:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:57:32 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:57:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 23:57:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:57:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:57:36 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:57:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:57:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:57:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:57:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:57:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:57:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:57:39 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:57:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43587367
Sun 19 Jan 2014 23:57:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:57:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43587367
Sun 19 Jan 2014 23:57:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:57:45 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:57:45 - job_xml_thread(): Done retrieving: data size 43587367
Sun 19 Jan 2014 23:57:45 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:57:45 - Housekeeping: checking database for timed out jobs..
Sun 19 Jan 2014 23:57:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:57:46 - Housekeeping: Found 0 timed out jobs in database: closing entries
Sun 19 Jan 2014 23:57:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:57:46 - Housekeeping: done.
Sun 19 Jan 2014 23:57:46 - XML: Start document: iteration 0
Sun 19 Jan 2014 23:57:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:57:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:57:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:57:52 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:57:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:57:52 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:57:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 23:57:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 23:57:52 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:57:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5955 values 94007 bits 11750 bytes 
Sun 19 Jan 2014 23:57:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:57:55 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:57:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:57:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:57:57 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:57:57 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:57:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:57:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:57:57 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:58:00 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:58:00 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:58:00 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:58:00 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:58:00 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:58:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:58:01 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:58:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:58:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:58:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:58:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:58:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:58:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:58:07 - Leaving storeMetrics(): cluster LISA Cluster
Sun 19 Jan 2014 23:58:07 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Sun 19 Jan 2014 23:58:07 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:58:07 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:58:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574366
Sun 19 Jan 2014 23:58:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:58:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574366
Sun 19 Jan 2014 23:58:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:58:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:58:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:58:15 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:58:15 - job_xml_thread(): Done retrieving: data size 43574366
Sun 19 Jan 2014 23:58:15 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:58:15 - XML: Start document: iteration 1
Sun 19 Jan 2014 23:58:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:58:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:58:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:58:21 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:58:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:58:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:58:21 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:58:21 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:58:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:58:21 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:58:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:58:30 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:58:30 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:58:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:58:30 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:58:30 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:58:30 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:58:30 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:58:30 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:58:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 23:58:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:58:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:58:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:58:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:58:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:58:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:58:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:58:32 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:58:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561789
Sun 19 Jan 2014 23:58:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:58:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561789
Sun 19 Jan 2014 23:58:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:58:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:58:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:58:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:58:41 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:58:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:58:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:58:42 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:58:42 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:58:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:58:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:58:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561789
Sun 19 Jan 2014 23:58:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:58:45 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:58:45 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:58:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:58:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:58:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:58:51 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:58:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:58:52 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:58:53 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:58:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 23:58:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:58:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 23:58:53 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:58:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5964 values 94155 bits 11769 bytes 
Sun 19 Jan 2014 23:58:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:58:53 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:58:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:58:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:58:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:58:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:58:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:58:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:58:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:58:56 - job_xml_thread(): Done retrieving: data size 43571740
Sun 19 Jan 2014 23:58:56 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:58:56 - XML: Start document: iteration 2
Sun 19 Jan 2014 23:58:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571740
Sun 19 Jan 2014 23:58:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:58:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:58:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:58:58 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:58:58 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:58:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:58:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571740
Sun 19 Jan 2014 23:58:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:58:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:59:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:59:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:59:10 - XML: Processed 653352 elements - found 0 jobs
Sun 19 Jan 2014 23:59:10 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:59:10 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:59:10 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:59:10 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:59:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:59:12 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:59:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:59:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:59:14 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:59:14 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:59:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:59:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:59:14 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:59:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:59:17 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:59:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:59:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:59:17 - Leaving storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:59:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Sun 19 Jan 2014 23:59:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:59:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:59:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:59:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:59:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:59:19 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:59:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43517966
Sun 19 Jan 2014 23:59:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:59:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43517966
Sun 19 Jan 2014 23:59:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:59:25 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:59:25 - job_xml_thread(): Done retrieving: data size 43517966
Sun 19 Jan 2014 23:59:25 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:59:25 - XML: Start document: iteration 3
Sun 19 Jan 2014 23:59:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:59:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:59:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:59:29 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:59:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:59:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:59:31 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:59:31 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:59:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:59:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:59:31 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:59:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:59:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:59:37 - XML: Processed 652602 elements - found 0 jobs
Sun 19 Jan 2014 23:59:37 - job_xml_thread(): Found 0 updated jobs.
Sun 19 Jan 2014 23:59:37 - job_xml_thread(): No jobs to store.
Sun 19 Jan 2014 23:59:37 - job_xml_thread(): Done parsing.
Sun 19 Jan 2014 23:59:38 - job_xml_thread(): Sleeping.. (15s)
Sun 19 Jan 2014 23:59:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:59:39 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:59:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Sun 19 Jan 2014 23:59:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:59:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:59:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:59:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:59:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:59:41 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:59:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43008426
Sun 19 Jan 2014 23:59:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:59:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43008426
Sun 19 Jan 2014 23:59:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:59:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:59:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Sun 19 Jan 2014 23:59:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Sun 19 Jan 2014 23:59:50 - ganglia_parse_thread(): finished: Render Cluster
Sun 19 Jan 2014 23:59:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Sun 19 Jan 2014 23:59:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:59:51 - ganglia_xml_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:59:51 - ganglia_parse_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:59:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Sun 19 Jan 2014 23:59:51 - XMLGatherer.retrieveData(): actually retrieving data..
Sun 19 Jan 2014 23:59:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Sun 19 Jan 2014 23:59:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Sun 19 Jan 2014 23:59:53 - job_xml_thread(): Retrieving XML data..
Sun 19 Jan 2014 23:59:53 - ganglia_store_thread(): finished: cluster Render Cluster
Sun 19 Jan 2014 23:59:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:59:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Sun 19 Jan 2014 23:59:54 - ganglia_store_thread(): started: cluster Render Cluster
Sun 19 Jan 2014 23:59:54 - Entering storeMetrics(): cluster Render Cluster
Sun 19 Jan 2014 23:59:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Sun 19 Jan 2014 23:59:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8819 values 139096 bits 17387 bytes 
Sun 19 Jan 2014 23:59:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Sun 19 Jan 2014 23:59:54 - ganglia_parse_thread(): finished: LISA Cluster
Sun 19 Jan 2014 23:59:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Sun 19 Jan 2014 23:59:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Sun 19 Jan 2014 23:59:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:59:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Sun 19 Jan 2014 23:59:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Sun 19 Jan 2014 23:59:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Sun 19 Jan 2014 23:59:56 - XMLGatherer.retrieveData(): Done retrieving data.
Sun 19 Jan 2014 23:59:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42922247
Sun 19 Jan 2014 23:59:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Sun 19 Jan 2014 23:59:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42922247
Sun 19 Jan 2014 23:59:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Sun 19 Jan 2014 23:59:57 - job_xml_thread(): Done retrieving: data size 42922247
Sun 19 Jan 2014 23:59:57 - job_xml_thread(): Parsing XML..
Sun 19 Jan 2014 23:59:57 - XML: Start document: iteration 4
Mon 20 Jan 2014 00:00:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:00:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:00:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:00:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:00:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:00:14 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:00:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:00:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:00:15 - XML: Processed 645199 elements - found 0 jobs
Mon 20 Jan 2014 00:00:15 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:00:15 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:00:15 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:00:15 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:00:15 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:00:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:00:15 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:00:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:00:15 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:00:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:00:19 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:00:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:00:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:00:19 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 00:00:19 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:00:19 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:00:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 00:00:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:00:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:00:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:00:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:00:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:00:20 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:00:20 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 00:00:20 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:00:20 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 00:00:20 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 00:00:20 - size of cluster 'LISA Cluster': 624 hosts 79480 metrics 729772 values 11509452 bits 1438681 bytes 
Mon 20 Jan 2014 00:00:23 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:00:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42973341
Mon 20 Jan 2014 00:00:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:00:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42973341
Mon 20 Jan 2014 00:00:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:00:30 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:00:30 - job_xml_thread(): Done retrieving: data size 42973341
Mon 20 Jan 2014 00:00:30 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:00:30 - XML: Start document: iteration 5
Mon 20 Jan 2014 00:00:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:00:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:00:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:00:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:00:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:00:35 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:00:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:00:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:00:36 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:00:36 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:00:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:00:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:00:36 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:00:43 - XML: Processed 645828 elements - found 0 jobs
Mon 20 Jan 2014 00:00:43 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:00:43 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:00:43 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:00:43 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:00:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:00:46 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:00:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:00:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:00:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:00:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:00:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:00:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:00:49 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:00:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43475364
Mon 20 Jan 2014 00:00:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:00:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43475364
Mon 20 Jan 2014 00:00:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:00:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:00:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:00:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:00:54 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:00:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:00:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 00:00:55 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:00:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8603 values 135762 bits 16970 bytes 
Mon 20 Jan 2014 00:00:55 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:00:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 00:00:58 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:00:58 - job_xml_thread(): Done retrieving: data size 43475364
Mon 20 Jan 2014 00:00:58 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:00:58 - XML: Start document: iteration 6
Mon 20 Jan 2014 00:00:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:00:59 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:00:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:00:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:01:00 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:01:00 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:01:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:01:00 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:01:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:01:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:01:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:01:10 - XML: Processed 652418 elements - found 0 jobs
Mon 20 Jan 2014 00:01:10 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:01:10 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:01:10 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:01:10 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:01:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:01:12 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:01:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:01:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:01:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:01:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:01:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:01:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:01:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:01:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:01:15 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:01:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43536798
Mon 20 Jan 2014 00:01:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:01:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43536798
Mon 20 Jan 2014 00:01:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:01:20 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:01:20 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 00:01:25 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:01:25 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:01:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:01:26 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:01:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:01:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:01:27 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:01:27 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:01:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:01:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:01:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:01:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:01:29 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:01:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 00:01:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:01:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:01:30 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:01:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:01:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:01:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:01:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:01:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:01:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:01:33 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:01:33 - job_xml_thread(): Done retrieving: data size 43570415
Mon 20 Jan 2014 00:01:33 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:01:33 - XML: Start document: iteration 7
Mon 20 Jan 2014 00:01:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570415
Mon 20 Jan 2014 00:01:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:01:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570415
Mon 20 Jan 2014 00:01:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:01:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:01:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:01:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:01:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:01:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:01:52 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:01:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:01:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:01:53 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:01:53 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:01:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:01:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:01:53 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:01:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:01:55 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:01:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:01:55 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:01:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 00:01:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 00:01:55 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:01:56 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:01:56 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:01:56 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:01:56 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:01:56 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:01:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6022 values 95279 bits 11909 bytes 
Mon 20 Jan 2014 00:01:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:01:57 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:01:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:01:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:01:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:01:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:01:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:01:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:02:03 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:02:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561674
Mon 20 Jan 2014 00:02:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:02:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561674
Mon 20 Jan 2014 00:02:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:02:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:02:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:02:12 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:02:12 - job_xml_thread(): Done retrieving: data size 43561674
Mon 20 Jan 2014 00:02:12 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:02:12 - XML: Start document: iteration 8
Mon 20 Jan 2014 00:02:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:02:12 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:02:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:02:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:02:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:02:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:02:14 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:02:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:02:14 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:02:14 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:02:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:02:25 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:02:25 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:02:25 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:02:25 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:02:25 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:02:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:02:27 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:02:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:02:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:02:27 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:02:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 00:02:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:02:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:02:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:02:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:02:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:02:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:02:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:02:30 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:02:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43549583
Mon 20 Jan 2014 00:02:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:02:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43549583
Mon 20 Jan 2014 00:02:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:02:40 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:02:40 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:02:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:02:41 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:02:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:02:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:02:42 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:02:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:02:42 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:02:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:02:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:02:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:02:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:02:49 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:02:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:02:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:02:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:02:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:02:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:02:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:02:53 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:02:53 - job_xml_thread(): Done retrieving: data size 43565911
Mon 20 Jan 2014 00:02:53 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:02:53 - XML: Start document: iteration 9
Mon 20 Jan 2014 00:02:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565911
Mon 20 Jan 2014 00:02:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:02:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565911
Mon 20 Jan 2014 00:02:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:02:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:02:56 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:02:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:02:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:02:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:02:57 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:02:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 00:02:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 00:02:57 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:02:59 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8877 values 140659 bits 17582 bytes 
Mon 20 Jan 2014 00:03:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:03:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:03:06 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:03:06 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:03:06 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:03:06 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:03:06 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:03:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:03:15 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:03:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:03:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:03:16 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:03:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:03:16 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:03:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:03:16 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:03:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:03:17 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:03:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:03:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:03:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:03:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:03:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:03:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:03:21 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:03:24 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:03:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43585602
Mon 20 Jan 2014 00:03:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:03:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43585602
Mon 20 Jan 2014 00:03:25 - job_xml_thread(): Done retrieving: data size 43585602
Mon 20 Jan 2014 00:03:25 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:03:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:03:25 - XML: Start document: iteration 10
Mon 20 Jan 2014 00:03:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:03:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:03:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:03:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:03:43 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:03:43 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:03:43 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:03:43 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:03:43 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:03:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:03:45 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:03:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:03:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:03:45 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:03:45 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:03:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:03:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:03:45 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:03:48 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:03:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 00:03:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:03:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:03:49 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:03:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:03:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:03:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:03:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:03:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:03:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:03:55 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:03:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577837
Mon 20 Jan 2014 00:03:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:03:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577837
Mon 20 Jan 2014 00:03:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:03:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:03:57 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:03:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:03:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 00:03:58 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:03:58 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:03:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 00:03:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5917 values 93473 bits 11684 bytes 
Mon 20 Jan 2014 00:03:58 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:03:58 - job_xml_thread(): Done retrieving: data size 43577837
Mon 20 Jan 2014 00:03:58 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:03:58 - XML: Start document: iteration 11
Mon 20 Jan 2014 00:04:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:04:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:04:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:04:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:04:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:04:11 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:04:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:04:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:04:12 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:04:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:04:12 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:04:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:04:12 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:04:16 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:04:16 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:04:16 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:04:16 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:04:16 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:04:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:04:20 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:04:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:04:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:04:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:04:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:04:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:04:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:04:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:04:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:04:28 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:04:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 00:04:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:04:28 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:04:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562422
Mon 20 Jan 2014 00:04:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:04:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562422
Mon 20 Jan 2014 00:04:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:04:31 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:04:31 - job_xml_thread(): Done retrieving: data size 43562422
Mon 20 Jan 2014 00:04:31 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:04:31 - XML: Start document: iteration 12
Mon 20 Jan 2014 00:04:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:04:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:04:47 - XML: Processed 653349 elements - found 0 jobs
Mon 20 Jan 2014 00:04:47 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:04:47 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:04:47 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:04:47 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:04:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:04:51 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:04:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:04:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:04:52 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:04:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:04:52 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:04:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:04:52 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:04:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:04:53 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:04:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:04:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:04:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:04:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:04:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:04:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:04:56 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 00:04:56 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 00:04:56 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:04:57 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:04:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43595472
Mon 20 Jan 2014 00:04:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:04:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43595472
Mon 20 Jan 2014 00:04:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:04:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:04:58 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:05:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:05:00 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:05:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 00:05:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 00:05:00 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:05:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99123 bits 12390 bytes 
Mon 20 Jan 2014 00:05:02 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:05:03 - job_xml_thread(): Done retrieving: data size 43595472
Mon 20 Jan 2014 00:05:03 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:05:03 - XML: Start document: iteration 13
Mon 20 Jan 2014 00:05:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:05:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:05:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:05:08 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:05:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:05:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:05:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:05:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:05:10 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:05:10 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:05:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:05:10 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:05:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:05:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:05:21 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:05:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:05:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:05:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:05:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:05:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:05:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:05:25 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:05:25 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:05:25 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:05:25 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:05:25 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:05:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:05:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:05:29 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:05:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43486358
Mon 20 Jan 2014 00:05:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:05:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43486358
Mon 20 Jan 2014 00:05:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:05:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:05:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:05:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:05:37 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:05:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:05:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:05:38 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:05:38 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:05:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:05:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:05:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43486358
Mon 20 Jan 2014 00:05:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:05:40 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:05:40 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:05:49 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:05:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 00:05:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:05:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:05:50 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:05:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:05:52 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:05:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:05:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:05:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:05:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:05:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:05:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:05:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:05:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:05:54 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:05:54 - job_xml_thread(): Done retrieving: data size 42975725
Mon 20 Jan 2014 00:05:54 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:05:54 - XML: Start document: iteration 14
Mon 20 Jan 2014 00:05:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42975725
Mon 20 Jan 2014 00:05:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:05:55 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:05:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:05:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42975725
Mon 20 Jan 2014 00:05:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:05:55 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:05:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:06:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:06:01 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:06:01 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:06:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 00:06:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:06:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 00:06:01 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:06:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6157 values 97219 bits 12152 bytes 
Mon 20 Jan 2014 00:06:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:06:05 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:06:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:06:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:06:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:06:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:06:11 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:06:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:06:11 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:06:11 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:06:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:06:11 - XML: Processed 646162 elements - found 0 jobs
Mon 20 Jan 2014 00:06:11 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:06:11 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:06:11 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:06:11 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:06:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:06:15 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:06:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:06:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:06:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:06:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:06:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:06:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:06:17 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:06:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42970850
Mon 20 Jan 2014 00:06:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:06:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42970850
Mon 20 Jan 2014 00:06:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:06:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:06:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:06:26 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:06:26 - job_xml_thread(): Done retrieving: data size 42970850
Mon 20 Jan 2014 00:06:26 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:06:26 - XML: Start document: iteration 15
Mon 20 Jan 2014 00:06:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:06:28 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:06:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:06:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:06:29 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:06:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:06:29 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:06:29 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:06:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:06:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:06:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:06:36 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:06:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 00:06:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:06:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:06:40 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:06:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:06:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:06:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:06:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:06:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:06:41 - XML: Processed 645828 elements - found 0 jobs
Mon 20 Jan 2014 00:06:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:06:41 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:06:41 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:06:41 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:06:41 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:06:43 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:06:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43443771
Mon 20 Jan 2014 00:06:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:06:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:06:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:06:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43443771
Mon 20 Jan 2014 00:06:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:06:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:06:53 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:06:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:06:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:06:53 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:06:53 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:06:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:06:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:06:53 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:06:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:06:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:06:56 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:06:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:06:57 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:06:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:06:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:06:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:06:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:06:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:06:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:06:59 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:06:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568289
Mon 20 Jan 2014 00:06:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:06:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568289
Mon 20 Jan 2014 00:06:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:06:59 - job_xml_thread(): Done retrieving: data size 43568289
Mon 20 Jan 2014 00:07:00 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:07:00 - XML: Start document: iteration 16
Mon 20 Jan 2014 00:07:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:07:01 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:07:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:07:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 00:07:02 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:07:02 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:07:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9024 values 142428 bits 17803 bytes 
Mon 20 Jan 2014 00:07:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 00:07:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:07:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:07:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:07:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:07:15 - XML: Processed 653254 elements - found 0 jobs
Mon 20 Jan 2014 00:07:15 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:07:15 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:07:15 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:07:16 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:07:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:07:19 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:07:20 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 00:07:20 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:07:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:07:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:07:20 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:07:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:07:20 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:07:20 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:07:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:07:20 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:07:20 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:07:20 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 00:07:20 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 00:07:20 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 00:07:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:07:22 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:07:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:07:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:07:22 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 787116 values 12428957 bits 1553619 bytes 
Mon 20 Jan 2014 00:07:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:07:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:07:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:07:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:07:26 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:07:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43586141
Mon 20 Jan 2014 00:07:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:07:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43586141
Mon 20 Jan 2014 00:07:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:07:31 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:07:31 - job_xml_thread(): Done retrieving: data size 43586141
Mon 20 Jan 2014 00:07:31 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:07:31 - XML: Start document: iteration 17
Mon 20 Jan 2014 00:07:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:07:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:07:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:07:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:07:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:07:38 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:07:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:07:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:07:39 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:07:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:07:39 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:07:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:07:39 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:07:46 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:07:46 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:07:46 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:07:46 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:07:46 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:07:47 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:07:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 00:07:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:07:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:07:51 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:07:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:07:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:07:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:07:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:07:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:07:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:07:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:07:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:07:54 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:07:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555654
Mon 20 Jan 2014 00:07:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:07:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555654
Mon 20 Jan 2014 00:07:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:08:01 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:08:01 - job_xml_thread(): Done retrieving: data size 43555654
Mon 20 Jan 2014 00:08:01 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:08:01 - XML: Start document: iteration 18
Mon 20 Jan 2014 00:08:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:08:02 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:08:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:08:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:08:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:08:02 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:08:02 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:08:02 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:08:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:08:02 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:08:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:08:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 00:08:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:08:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 00:08:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555654
Mon 20 Jan 2014 00:08:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:08:02 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:08:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5794 values 91417 bits 11427 bytes 
Mon 20 Jan 2014 00:08:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:08:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:08:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:08:15 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:08:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:08:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:08:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:08:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:08:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:08:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:08:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:08:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:08:18 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:08:20 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:08:20 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 00:08:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:08:21 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:08:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:08:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:08:22 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:08:22 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:08:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:08:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:08:23 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:08:23 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:08:23 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:08:23 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:08:23 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:08:28 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:08:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564262
Mon 20 Jan 2014 00:08:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:08:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564262
Mon 20 Jan 2014 00:08:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:08:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:08:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:08:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:08:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:08:39 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:08:39 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:08:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:08:40 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:08:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:08:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:08:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:08:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:08:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:08:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:08:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:08:43 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:08:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:08:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:08:44 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:08:44 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:08:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:08:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:08:44 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:08:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 00:08:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:08:47 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:08:47 - job_xml_thread(): Done retrieving: data size 43576613
Mon 20 Jan 2014 00:08:47 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:08:47 - XML: Start document: iteration 19
Mon 20 Jan 2014 00:08:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576613
Mon 20 Jan 2014 00:08:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:08:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576613
Mon 20 Jan 2014 00:08:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:08:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:08:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:08:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:08:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:09:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:09:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:09:03 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:09:03 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:09:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:09:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:09:05 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:09:05 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:09:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:09:05 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:09:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 00:09:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:09:05 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:09:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:09:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 00:09:05 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:09:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5727 values 90290 bits 11286 bytes 
Mon 20 Jan 2014 00:09:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:09:06 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:09:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:09:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:09:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:09:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:09:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:09:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:09:09 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:09:09 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:09:09 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:09:09 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:09:09 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:09:16 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:09:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 00:09:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:09:16 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:09:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562324
Mon 20 Jan 2014 00:09:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:09:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562324
Mon 20 Jan 2014 00:09:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:09:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:09:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:09:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:09:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:09:24 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:09:24 - job_xml_thread(): Done retrieving: data size 43562324
Mon 20 Jan 2014 00:09:24 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:09:25 - XML: Start document: iteration 20
Mon 20 Jan 2014 00:09:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:09:28 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:09:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:09:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:09:28 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:09:28 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:09:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:09:28 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:09:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:09:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:09:39 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:09:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:09:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:09:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:09:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:09:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:09:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:09:40 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:09:40 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:09:40 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:09:40 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:09:40 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:09:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:09:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:09:44 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:09:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43542437
Mon 20 Jan 2014 00:09:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:09:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43542437
Mon 20 Jan 2014 00:09:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:09:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:09:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:09:55 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:09:56 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:09:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:09:56 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:09:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:09:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:09:57 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:09:57 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:09:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:09:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:10:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:10:00 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:10:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:10:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:10:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:10:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:10:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:10:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:10:04 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:10:04 - job_xml_thread(): Done retrieving: data size 43578028
Mon 20 Jan 2014 00:10:04 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:10:04 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 00:10:04 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 00:10:04 - Housekeeping: done.
Mon 20 Jan 2014 00:10:04 - XML: Start document: iteration 0
Mon 20 Jan 2014 00:10:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578028
Mon 20 Jan 2014 00:10:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578028
Mon 20 Jan 2014 00:10:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:10:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:10:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:10:06 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:10:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:10:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 00:10:07 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:10:07 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:10:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 00:10:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148592 bits 18574 bytes 
Mon 20 Jan 2014 00:10:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:10:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:10:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:10:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:10:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:10:17 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:10:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:10:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:10:18 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:10:18 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:10:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:10:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:10:18 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:10:21 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:10:21 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:10:21 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:10:21 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:10:21 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:10:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:10:27 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:10:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:10:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:10:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:10:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:10:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:10:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:10:30 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:10:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554245
Mon 20 Jan 2014 00:10:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:10:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554245
Mon 20 Jan 2014 00:10:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:10:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:10:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:10:36 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:10:36 - job_xml_thread(): Done retrieving: data size 43554245
Mon 20 Jan 2014 00:10:36 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:10:36 - XML: Start document: iteration 1
Mon 20 Jan 2014 00:10:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:10:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:10:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:10:50 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:10:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:10:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:10:52 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:10:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:10:52 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:10:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:10:52 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:10:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:10:53 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:10:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:10:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:10:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:10:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:10:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:10:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:10:54 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:10:54 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:10:54 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:10:54 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:10:54 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:10:55 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:10:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 00:10:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:10:58 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:10:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574904
Mon 20 Jan 2014 00:10:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:10:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574904
Mon 20 Jan 2014 00:10:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:11:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:11:07 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:11:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:11:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:11:07 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:11:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:11:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 00:11:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 00:11:07 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:11:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5804 values 91546 bits 11443 bytes 
Mon 20 Jan 2014 00:11:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:11:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:11:10 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:11:10 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:11:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:11:10 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:11:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:11:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:11:11 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:11:11 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:11:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:11:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:11:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:11:13 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:11:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:11:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:11:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:11:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:11:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:11:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:11:19 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:11:19 - job_xml_thread(): Done retrieving: data size 43511654
Mon 20 Jan 2014 00:11:19 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:11:19 - XML: Start document: iteration 2
Mon 20 Jan 2014 00:11:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43511654
Mon 20 Jan 2014 00:11:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43511654
Mon 20 Jan 2014 00:11:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:11:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:11:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:11:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:11:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:11:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:11:35 - XML: Processed 652602 elements - found 0 jobs
Mon 20 Jan 2014 00:11:35 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:11:35 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:11:35 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:11:35 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:11:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:11:38 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:11:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:11:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:11:39 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:11:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:11:39 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:11:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:11:39 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:11:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:11:42 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:11:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:11:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:11:42 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:11:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 00:11:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:11:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:11:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:11:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:11:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:11:46 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:11:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42973712
Mon 20 Jan 2014 00:11:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:11:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42973712
Mon 20 Jan 2014 00:11:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:11:50 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:11:50 - job_xml_thread(): Done retrieving: data size 42973712
Mon 20 Jan 2014 00:11:50 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:11:50 - XML: Start document: iteration 3
Mon 20 Jan 2014 00:11:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:11:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:11:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:11:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:12:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:12:01 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:12:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:12:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:12:02 - XML: Processed 645842 elements - found 0 jobs
Mon 20 Jan 2014 00:12:02 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:12:02 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:12:02 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:12:02 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:12:03 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:12:03 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:12:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:12:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:12:03 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:12:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:12:07 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:12:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:12:08 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:12:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:12:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:12:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:12:08 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:12:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 00:12:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 00:12:08 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:12:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5780 values 91144 bits 11393 bytes 
Mon 20 Jan 2014 00:12:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:12:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:12:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:12:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:12:12 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:12:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42965255
Mon 20 Jan 2014 00:12:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:12:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42965255
Mon 20 Jan 2014 00:12:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:12:17 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:12:17 - job_xml_thread(): Done retrieving: data size 42965255
Mon 20 Jan 2014 00:12:17 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:12:17 - XML: Start document: iteration 4
Mon 20 Jan 2014 00:12:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:12:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:12:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:12:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:12:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:12:27 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:12:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:12:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:12:27 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:12:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:12:27 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:12:27 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:12:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:12:33 - XML: Processed 645846 elements - found 0 jobs
Mon 20 Jan 2014 00:12:33 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:12:33 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:12:33 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:12:33 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:12:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:12:35 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:12:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:12:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:12:35 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:12:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 00:12:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:12:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:12:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:12:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:12:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:12:38 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 00:12:38 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 00:12:38 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:12:38 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:12:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43192051
Mon 20 Jan 2014 00:12:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:12:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43192051
Mon 20 Jan 2014 00:12:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:12:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:12:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:12:48 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:12:48 - job_xml_thread(): Done retrieving: data size 43192051
Mon 20 Jan 2014 00:12:48 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:12:48 - XML: Start document: iteration 5
Mon 20 Jan 2014 00:12:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:12:49 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:12:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:12:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:12:49 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:12:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:12:49 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:12:49 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:12:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:12:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:12:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:12:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:12:55 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:12:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:12:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:12:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:12:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:12:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:12:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:12:58 - XML: Processed 648748 elements - found 0 jobs
Mon 20 Jan 2014 00:12:58 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:12:58 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:12:58 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:12:58 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:13:00 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:13:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43549935
Mon 20 Jan 2014 00:13:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:13:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43549935
Mon 20 Jan 2014 00:13:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:13:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:13:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:13:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:13:08 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:13:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:13:09 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:13:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 00:13:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:13:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 00:13:10 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:13:10 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:13:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8646 values 136353 bits 17044 bytes 
Mon 20 Jan 2014 00:13:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:13:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:13:11 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:13:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:13:11 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:13:11 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:13:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:13:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:13:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:13:13 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:13:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:13:14 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:13:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:13:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:13:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:13:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:13:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:13:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:13:16 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:13:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577131
Mon 20 Jan 2014 00:13:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:13:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577131
Mon 20 Jan 2014 00:13:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:13:17 - job_xml_thread(): Done retrieving: data size 43577131
Mon 20 Jan 2014 00:13:17 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:13:17 - XML: Start document: iteration 6
Mon 20 Jan 2014 00:13:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:13:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:13:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:13:28 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:13:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:13:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:13:29 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:13:29 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:13:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:13:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:13:29 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:13:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:13:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:13:34 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:13:34 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:13:34 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:13:34 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:13:34 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:13:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:13:38 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:13:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:13:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:13:38 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:13:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 00:13:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:13:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:13:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:13:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:13:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:13:39 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:13:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43543257
Mon 20 Jan 2014 00:13:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:13:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43543257
Mon 20 Jan 2014 00:13:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:13:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:13:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:13:49 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:13:50 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:13:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:13:53 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:13:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:13:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:13:53 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:13:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:13:54 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:13:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:13:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:13:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:13:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:13:54 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:13:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:13:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:13:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:13:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:13:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:13:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:13:57 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:13:57 - job_xml_thread(): Done retrieving: data size 43560852
Mon 20 Jan 2014 00:13:57 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:13:57 - XML: Start document: iteration 7
Mon 20 Jan 2014 00:13:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560852
Mon 20 Jan 2014 00:13:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:13:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560852
Mon 20 Jan 2014 00:13:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:14:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:14:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:14:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:14:09 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:14:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:14:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 00:14:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:14:10 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:14:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:14:11 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:14:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 00:14:12 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:14:12 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:14:12 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:14:12 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:14:12 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:14:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8846 values 139552 bits 17444 bytes 
Mon 20 Jan 2014 00:14:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:14:17 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:14:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:14:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:14:18 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:14:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:14:18 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:14:18 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:14:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:14:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:14:19 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:14:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:14:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:14:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:14:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:14:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:14:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:14:20 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 00:14:21 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:14:21 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:14:21 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 00:14:21 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:14:21 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 00:14:21 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 00:14:22 - size of cluster 'LISA Cluster': 624 hosts 79477 metrics 734373 values 11575439 bits 1446929 bytes 
Mon 20 Jan 2014 00:14:23 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:14:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43587484
Mon 20 Jan 2014 00:14:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:14:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43587484
Mon 20 Jan 2014 00:14:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:14:27 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:14:27 - job_xml_thread(): Done retrieving: data size 43587484
Mon 20 Jan 2014 00:14:28 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:14:28 - XML: Start document: iteration 8
Mon 20 Jan 2014 00:14:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:14:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:14:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:14:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:14:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:14:37 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:14:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:14:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:14:40 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:14:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:14:40 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:14:40 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:14:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:14:44 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:14:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 00:14:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:14:46 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:14:46 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:14:46 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:14:46 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:14:46 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:14:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:14:47 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:14:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:14:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:14:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:14:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:14:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:14:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:14:50 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:14:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577262
Mon 20 Jan 2014 00:14:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:14:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577262
Mon 20 Jan 2014 00:14:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:14:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:14:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:15:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:15:00 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:15:01 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:15:01 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:15:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:15:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:15:02 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:15:02 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:15:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:15:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:15:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:15:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:15:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:15:05 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:15:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:15:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:15:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:15:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:15:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:15:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:15:07 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:15:07 - job_xml_thread(): Done retrieving: data size 43580937
Mon 20 Jan 2014 00:15:07 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:15:07 - XML: Start document: iteration 9
Mon 20 Jan 2014 00:15:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580937
Mon 20 Jan 2014 00:15:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:15:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580937
Mon 20 Jan 2014 00:15:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:15:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:15:11 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:15:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:15:13 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:15:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 00:15:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 00:15:13 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:15:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8921 values 140683 bits 17585 bytes 
Mon 20 Jan 2014 00:15:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:15:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:15:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:15:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:15:21 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:15:21 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 00:15:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:15:22 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:15:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:15:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:15:24 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:15:24 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:15:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:15:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:15:24 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:15:26 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:15:26 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:15:26 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:15:26 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:15:26 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:15:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:15:29 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:15:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:15:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:15:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:15:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:15:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:15:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:15:33 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:15:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 00:15:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:15:34 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:15:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575863
Mon 20 Jan 2014 00:15:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:15:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575863
Mon 20 Jan 2014 00:15:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:15:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:15:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:15:41 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:15:41 - job_xml_thread(): Done retrieving: data size 43575863
Mon 20 Jan 2014 00:15:41 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:15:41 - XML: Start document: iteration 10
Mon 20 Jan 2014 00:15:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:15:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:15:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:15:48 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:15:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:15:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:15:49 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:15:49 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:15:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:15:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:15:49 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:15:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:15:54 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:15:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:15:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:15:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:15:55 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:15:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:15:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:15:55 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:15:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:15:55 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:15:55 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:15:55 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:15:59 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:15:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564039
Mon 20 Jan 2014 00:15:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:15:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564039
Mon 20 Jan 2014 00:15:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:16:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:16:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:16:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:16:07 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:16:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:16:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:16:09 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:16:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:16:09 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:16:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564039
Mon 20 Jan 2014 00:16:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:16:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:16:10 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:16:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:16:10 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:16:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:16:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:16:13 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:16:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:16:14 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:16:14 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:16:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 00:16:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:16:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 00:16:14 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:16:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99175 bits 12396 bytes 
Mon 20 Jan 2014 00:16:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:16:19 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:16:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:16:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:16:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:16:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:16:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:16:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:16:24 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:16:24 - job_xml_thread(): Done retrieving: data size 43565395
Mon 20 Jan 2014 00:16:24 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:16:24 - XML: Start document: iteration 11
Mon 20 Jan 2014 00:16:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:16:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:16:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565395
Mon 20 Jan 2014 00:16:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:16:25 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:16:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:16:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565395
Mon 20 Jan 2014 00:16:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:16:25 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:16:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:16:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:16:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:16:35 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:16:35 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:16:35 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:16:35 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:16:35 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:16:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:16:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:16:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:16:43 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:16:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:16:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:16:45 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:16:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:16:45 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:16:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:16:45 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:16:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:16:47 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:16:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:16:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:16:48 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:16:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 00:16:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:16:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:16:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:16:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:16:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:16:50 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:16:50 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:16:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43602059
Mon 20 Jan 2014 00:16:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:16:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43602059
Mon 20 Jan 2014 00:16:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:16:52 - job_xml_thread(): Done retrieving: data size 43602059
Mon 20 Jan 2014 00:16:52 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:16:52 - XML: Start document: iteration 12
Mon 20 Jan 2014 00:17:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:17:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:17:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:17:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:17:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:17:07 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:17:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:17:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:17:09 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:17:09 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:17:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:17:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:17:09 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:17:12 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:17:12 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:17:12 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:17:12 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:17:12 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:17:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:17:13 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:17:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:17:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:17:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:17:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:17:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:17:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:17:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:17:14 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:17:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:17:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 00:17:15 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:17:15 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:17:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 00:17:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5687 values 89819 bits 11227 bytes 
Mon 20 Jan 2014 00:17:18 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:17:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43518195
Mon 20 Jan 2014 00:17:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:17:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43518195
Mon 20 Jan 2014 00:17:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:17:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:17:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:17:27 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:17:27 - job_xml_thread(): Done retrieving: data size 43518195
Mon 20 Jan 2014 00:17:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:17:27 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:17:27 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:17:27 - XML: Start document: iteration 13
Mon 20 Jan 2014 00:17:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:17:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:17:28 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:17:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:17:29 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:17:29 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:17:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:17:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:17:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:17:38 - XML: Processed 652602 elements - found 0 jobs
Mon 20 Jan 2014 00:17:38 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:17:38 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:17:38 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:17:38 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:17:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:17:41 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:17:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:17:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:17:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:17:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:17:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:17:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:17:43 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:17:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 00:17:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:17:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:17:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:17:44 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:17:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43038416
Mon 20 Jan 2014 00:17:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:17:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43038416
Mon 20 Jan 2014 00:17:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:17:53 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:17:53 - job_xml_thread(): Done retrieving: data size 43038416
Mon 20 Jan 2014 00:17:53 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:17:53 - XML: Start document: iteration 14
Mon 20 Jan 2014 00:17:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:17:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:18:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:18:04 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:18:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:18:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:18:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:18:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:18:05 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:18:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:18:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:18:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:18:07 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:18:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:18:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:18:08 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:18:08 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:18:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:18:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:18:08 - XML: Processed 647036 elements - found 0 jobs
Mon 20 Jan 2014 00:18:08 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:18:08 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:18:08 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:18:08 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:18:12 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:18:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42965431
Mon 20 Jan 2014 00:18:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:18:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42965431
Mon 20 Jan 2014 00:18:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:18:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:18:16 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:18:17 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:18:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:18:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 00:18:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 00:18:17 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:18:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7433 values 117530 bits 14691 bytes 
Mon 20 Jan 2014 00:18:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:18:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:18:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:18:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:18:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:18:23 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:18:23 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:18:23 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:18:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:18:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:18:24 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:18:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:18:24 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:18:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:18:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:18:28 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:18:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:18:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:18:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:18:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:18:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:18:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:18:32 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:18:32 - job_xml_thread(): Done retrieving: data size 42983279
Mon 20 Jan 2014 00:18:32 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:18:32 - XML: Start document: iteration 15
Mon 20 Jan 2014 00:18:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42983279
Mon 20 Jan 2014 00:18:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:18:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42983279
Mon 20 Jan 2014 00:18:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:18:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:18:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:18:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:18:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:18:48 - XML: Processed 645902 elements - found 0 jobs
Mon 20 Jan 2014 00:18:48 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:18:48 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:18:48 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:18:48 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:18:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:18:51 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:18:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:18:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:18:52 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:18:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:18:52 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:18:52 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:18:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:18:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:18:55 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:18:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:18:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:18:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:18:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:18:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:18:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:18:55 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:18:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 00:18:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:18:58 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:18:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570283
Mon 20 Jan 2014 00:18:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:18:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570283
Mon 20 Jan 2014 00:18:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:19:03 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:19:03 - job_xml_thread(): Done retrieving: data size 43570283
Mon 20 Jan 2014 00:19:03 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:19:03 - XML: Start document: iteration 16
Mon 20 Jan 2014 00:19:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:19:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:19:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:19:08 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:19:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:19:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:19:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:19:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:19:11 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:19:11 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:19:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:19:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:19:11 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:19:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:19:17 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:19:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:19:17 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:19:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 00:19:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 00:19:17 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:19:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5756 values 90866 bits 11358 bytes 
Mon 20 Jan 2014 00:19:19 - XML: Processed 653246 elements - found 0 jobs
Mon 20 Jan 2014 00:19:19 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:19:19 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:19:19 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:19:19 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:19:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:19:21 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:19:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:19:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:19:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:19:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:19:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:19:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:19:22 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 00:19:22 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 00:19:22 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:19:23 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:19:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43545095
Mon 20 Jan 2014 00:19:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:19:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43545095
Mon 20 Jan 2014 00:19:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:19:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:19:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:19:34 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:19:34 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:19:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:19:35 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:19:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:19:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:19:35 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:19:35 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:19:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:19:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:19:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:19:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:19:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:19:39 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:19:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:19:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:19:39 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:19:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 00:19:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:19:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:19:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:19:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:19:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:19:41 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:19:41 - job_xml_thread(): Done retrieving: data size 43557167
Mon 20 Jan 2014 00:19:41 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:19:41 - XML: Start document: iteration 17
Mon 20 Jan 2014 00:19:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557167
Mon 20 Jan 2014 00:19:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557167
Mon 20 Jan 2014 00:19:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:19:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:19:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:19:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:19:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:19:54 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:19:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:19:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:19:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:19:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:19:56 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:19:56 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:19:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:19:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:19:56 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:20:02 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:20:02 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:20:02 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:20:02 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:20:02 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:20:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:20:04 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:20:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:20:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:20:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:20:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:20:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:20:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:20:06 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:20:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564176
Mon 20 Jan 2014 00:20:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:20:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564176
Mon 20 Jan 2014 00:20:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:20:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:20:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:20:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:20:17 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:20:18 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:20:18 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:20:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:20:19 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:20:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:20:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:20:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:20:19 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:20:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 00:20:19 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:20:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 00:20:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8769 values 138324 bits 17290 bytes 
Mon 20 Jan 2014 00:20:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:20:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:20:20 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:20:20 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:20:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:20:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:20:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:20:21 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:20:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:20:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:20:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:20:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:20:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:20:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:20:23 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:20:23 - job_xml_thread(): Done retrieving: data size 43568772
Mon 20 Jan 2014 00:20:23 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:20:23 - XML: Start document: iteration 18
Mon 20 Jan 2014 00:20:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568772
Mon 20 Jan 2014 00:20:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:20:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568772
Mon 20 Jan 2014 00:20:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:20:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:20:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:20:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:20:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:20:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:20:40 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:20:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:20:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:20:41 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:20:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:20:41 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:20:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:20:41 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:20:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:20:46 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:20:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:20:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:20:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:20:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:20:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:20:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:20:47 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:20:47 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:20:47 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:20:47 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:20:47 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:20:47 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:20:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 00:20:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:20:49 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:20:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580651
Mon 20 Jan 2014 00:20:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:20:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580651
Mon 20 Jan 2014 00:20:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:20:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:20:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:20:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:20:57 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:20:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:20:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:20:58 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:20:58 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:20:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:20:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:21:00 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:21:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:21:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:21:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:21:02 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:21:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:21:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:21:02 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:21:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:21:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:21:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:21:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:21:04 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:21:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43596128
Mon 20 Jan 2014 00:21:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:21:04 - job_xml_thread(): Done retrieving: data size 43596128
Mon 20 Jan 2014 00:21:04 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:21:04 - XML: Start document: iteration 19
Mon 20 Jan 2014 00:21:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43596128
Mon 20 Jan 2014 00:21:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:21:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:21:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:21:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:21:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:21:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:21:19 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:21:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:21:20 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:21:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:21:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:21:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:21:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 00:21:20 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:21:20 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:21:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 00:21:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8887 values 140241 bits 17530 bytes 
Mon 20 Jan 2014 00:21:21 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 00:21:21 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:21:22 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:21:22 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:21:22 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:21:22 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:21:22 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:21:22 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:21:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:21:22 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:21:22 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:21:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:21:22 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:21:22 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:21:22 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 00:21:22 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 00:21:22 - Entering storeMetrics(): cluster LISA Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Mon 20 Jan 2014 00:21:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:21:26 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:21:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:21:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:21:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:21:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:21:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:21:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:21:29 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:21:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578703
Mon 20 Jan 2014 00:21:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:21:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578703
Mon 20 Jan 2014 00:21:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:21:37 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:21:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:21:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:21:37 - job_xml_thread(): Done retrieving: data size 43578703
Mon 20 Jan 2014 00:21:37 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:21:37 - XML: Start document: iteration 20
Mon 20 Jan 2014 00:21:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:21:42 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:21:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:21:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:21:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:21:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:21:43 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:21:43 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:21:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:21:43 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:21:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:21:48 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:21:48 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:21:48 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:21:48 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:21:48 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:21:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:21:52 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:21:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:21:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:21:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:21:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:21:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:21:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:21:52 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:21:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 00:21:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:21:53 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:21:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43552355
Mon 20 Jan 2014 00:21:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:21:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43552355
Mon 20 Jan 2014 00:21:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:21:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:21:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:22:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:22:02 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:22:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:22:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:22:03 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:22:03 - job_xml_thread(): Done retrieving: data size 43552355
Mon 20 Jan 2014 00:22:03 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:22:03 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 00:22:03 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:22:03 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:22:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:22:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:22:04 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:22:04 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 00:22:04 - Housekeeping: done.
Mon 20 Jan 2014 00:22:04 - XML: Start document: iteration 0
Mon 20 Jan 2014 00:22:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:22:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:22:14 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:22:14 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:22:14 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:22:14 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:22:14 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:22:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:22:16 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:22:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:22:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:22:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:22:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:22:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:22:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:22:17 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:22:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563620
Mon 20 Jan 2014 00:22:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:22:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563620
Mon 20 Jan 2014 00:22:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:22:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:22:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:22:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:22:21 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:22:22 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:22:22 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:22:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:22:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 00:22:22 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:22:22 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:22:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 00:22:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8525 values 134472 bits 16809 bytes 
Mon 20 Jan 2014 00:22:23 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:22:23 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 00:22:23 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:22:23 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 00:22:23 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 00:22:29 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:22:29 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:22:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:22:30 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:22:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:22:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:22:30 - size of cluster 'LISA Cluster': 624 hosts 79470 metrics 852780 values 13459017 bits 1682377 bytes 
Mon 20 Jan 2014 00:22:30 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:22:30 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:22:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:22:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:22:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:22:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:22:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:22:33 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:22:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:22:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:22:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:22:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:22:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:22:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:22:37 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:22:37 - job_xml_thread(): Done retrieving: data size 43573039
Mon 20 Jan 2014 00:22:37 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:22:37 - XML: Start document: iteration 1
Mon 20 Jan 2014 00:22:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573039
Mon 20 Jan 2014 00:22:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:22:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573039
Mon 20 Jan 2014 00:22:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:22:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:22:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:22:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:22:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:22:56 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:22:56 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:22:56 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:22:56 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:22:56 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:22:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:22:56 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:22:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:22:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:22:57 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:22:57 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:22:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:22:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:22:57 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:23:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:23:00 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:23:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:23:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:23:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:23:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:23:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:23:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:23:01 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:23:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 00:23:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:23:04 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:23:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43593286
Mon 20 Jan 2014 00:23:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:23:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43593286
Mon 20 Jan 2014 00:23:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:23:11 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:23:11 - job_xml_thread(): Done retrieving: data size 43593286
Mon 20 Jan 2014 00:23:11 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:23:11 - XML: Start document: iteration 2
Mon 20 Jan 2014 00:23:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:23:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:23:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:23:14 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:23:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:23:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:23:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:23:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:23:16 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:23:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:23:16 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:23:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:23:16 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:23:20 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:23:20 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:23:20 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:23:20 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:23:20 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:23:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:23:23 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:23:23 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:23:23 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 00:23:24 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:23:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:23:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 00:23:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 00:23:24 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:23:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5630 values 88773 bits 11096 bytes 
Mon 20 Jan 2014 00:23:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:23:25 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:23:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:23:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:23:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:23:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:23:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:23:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:23:29 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:23:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43493096
Mon 20 Jan 2014 00:23:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:23:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43493096
Mon 20 Jan 2014 00:23:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:23:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:23:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:23:35 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:23:35 - job_xml_thread(): Done retrieving: data size 43493096
Mon 20 Jan 2014 00:23:35 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:23:35 - XML: Start document: iteration 3
Mon 20 Jan 2014 00:23:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:23:40 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:23:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:23:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:23:41 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:23:41 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:23:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:23:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:23:41 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:23:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:23:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:23:50 - XML: Processed 652602 elements - found 0 jobs
Mon 20 Jan 2014 00:23:50 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:23:50 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:23:50 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:23:50 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:23:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:23:52 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:23:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:23:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:23:52 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:23:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 00:23:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:23:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:23:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:23:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:23:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:23:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:23:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:23:56 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:23:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42926913
Mon 20 Jan 2014 00:23:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:23:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42926913
Mon 20 Jan 2014 00:23:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:24:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:24:04 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:24:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:24:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:24:04 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:24:04 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:24:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:24:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:24:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42926913
Mon 20 Jan 2014 00:24:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:24:06 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:24:06 - job_xml_thread(): Done retrieving: data size 42926913
Mon 20 Jan 2014 00:24:06 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:24:06 - XML: Start document: iteration 4
Mon 20 Jan 2014 00:24:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:24:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:24:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:24:17 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:24:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:24:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:24:21 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:24:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:24:21 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:24:21 - XML: Processed 645696 elements - found 0 jobs
Mon 20 Jan 2014 00:24:21 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:24:21 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:24:21 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:24:21 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:24:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:24:21 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:24:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:24:24 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:24:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:24:24 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:24:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:24:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:24:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:24:24 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:24:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 00:24:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 00:24:24 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:24:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5610 values 88404 bits 11050 bytes 
Mon 20 Jan 2014 00:24:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:24:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:24:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:24:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:24:28 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:24:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42984392
Mon 20 Jan 2014 00:24:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:24:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42984392
Mon 20 Jan 2014 00:24:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:24:36 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:24:36 - job_xml_thread(): Done retrieving: data size 42984392
Mon 20 Jan 2014 00:24:36 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:24:36 - XML: Start document: iteration 5
Mon 20 Jan 2014 00:24:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:24:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:24:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:24:39 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:24:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:24:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:24:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:24:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:24:40 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:24:40 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:24:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:24:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:24:40 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:24:46 - XML: Processed 645906 elements - found 0 jobs
Mon 20 Jan 2014 00:24:46 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:24:46 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:24:46 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:24:46 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:24:50 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:24:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 00:24:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:24:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:24:51 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:24:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:24:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:24:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:24:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:24:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:24:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:24:54 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:24:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43525461
Mon 20 Jan 2014 00:24:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:24:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:24:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43525461
Mon 20 Jan 2014 00:24:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:24:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:25:01 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:25:01 - job_xml_thread(): Done retrieving: data size 43525461
Mon 20 Jan 2014 00:25:01 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:25:01 - XML: Start document: iteration 6
Mon 20 Jan 2014 00:25:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:25:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:25:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:25:11 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:25:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:25:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:25:12 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:25:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:25:12 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:25:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:25:12 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:25:15 - XML: Processed 653132 elements - found 0 jobs
Mon 20 Jan 2014 00:25:15 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:25:15 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:25:15 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:25:15 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:25:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:25:17 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:25:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:25:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:25:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:25:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:25:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:25:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:25:23 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:25:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561606
Mon 20 Jan 2014 00:25:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:25:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561606
Mon 20 Jan 2014 00:25:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:25:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:25:24 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:25:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:25:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 00:25:25 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:25:25 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:25:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 00:25:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8556 values 134882 bits 16860 bytes 
Mon 20 Jan 2014 00:25:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:25:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:25:30 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:25:30 - job_xml_thread(): Done retrieving: data size 43561606
Mon 20 Jan 2014 00:25:30 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:25:30 - XML: Start document: iteration 7
Mon 20 Jan 2014 00:25:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:25:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:25:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:25:35 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:25:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:25:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:25:35 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:25:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:25:35 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:25:35 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:25:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:25:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:25:46 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:25:46 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:25:46 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:25:46 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:25:46 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:25:46 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:25:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:25:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:25:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:25:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:25:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:25:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:25:50 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:25:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 00:25:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:25:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:25:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:25:50 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:25:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43552405
Mon 20 Jan 2014 00:25:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:25:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43552405
Mon 20 Jan 2014 00:25:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:26:01 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:26:01 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:26:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:26:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:26:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:26:05 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:26:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:26:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:26:06 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:26:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:26:06 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:26:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:26:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:26:07 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:26:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:26:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:26:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:26:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:26:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:26:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:26:08 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 00:26:08 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 00:26:08 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:26:09 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:26:09 - job_xml_thread(): Done retrieving: data size 43561344
Mon 20 Jan 2014 00:26:09 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:26:09 - XML: Start document: iteration 8
Mon 20 Jan 2014 00:26:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561344
Mon 20 Jan 2014 00:26:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:26:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561344
Mon 20 Jan 2014 00:26:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:26:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:26:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:26:22 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:26:22 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:26:22 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:26:22 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:26:22 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:26:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:26:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:26:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:26:25 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:26:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:26:26 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:26:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:26:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:26:26 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:26:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:26:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 00:26:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 00:26:26 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:26:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99127 bits 12390 bytes 
Mon 20 Jan 2014 00:26:28 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:26:28 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:26:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:26:28 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:26:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:26:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:26:28 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:26:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:26:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:26:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:26:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:26:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:26:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:26:34 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:26:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43591098
Mon 20 Jan 2014 00:26:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:26:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43591098
Mon 20 Jan 2014 00:26:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:26:37 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:26:38 - job_xml_thread(): Done retrieving: data size 43591098
Mon 20 Jan 2014 00:26:38 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:26:38 - XML: Start document: iteration 9
Mon 20 Jan 2014 00:26:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:26:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:26:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:26:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:26:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:26:49 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:26:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:26:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:26:50 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:26:50 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:26:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:26:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:26:50 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:26:52 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:26:52 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:26:52 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:26:52 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:26:52 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:26:55 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:26:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 00:26:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:26:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:26:55 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:26:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:26:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:26:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:26:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:26:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:26:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:26:57 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:26:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583764
Mon 20 Jan 2014 00:26:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:26:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583764
Mon 20 Jan 2014 00:26:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:27:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:27:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:27:07 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:27:07 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:27:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:27:08 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:27:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:27:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:27:10 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:27:10 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:27:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:27:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:27:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:27:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:27:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:27:11 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:27:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:27:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:27:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:27:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:27:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:27:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:27:14 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:27:14 - job_xml_thread(): Done retrieving: data size 43582846
Mon 20 Jan 2014 00:27:14 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:27:14 - XML: Start document: iteration 10
Mon 20 Jan 2014 00:27:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582846
Mon 20 Jan 2014 00:27:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:27:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582846
Mon 20 Jan 2014 00:27:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:27:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:27:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:27:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:27:26 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:27:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:27:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:27:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:27:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 00:27:28 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:27:28 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:27:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 00:27:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9009 values 142182 bits 17772 bytes 
Mon 20 Jan 2014 00:27:28 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:27:28 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:27:28 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:27:28 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:27:28 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:27:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:27:35 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:27:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:27:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:27:35 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:27:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:27:35 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:27:35 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:27:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:27:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:27:37 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:27:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:27:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:27:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:27:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:27:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:27:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:27:40 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:27:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582961
Mon 20 Jan 2014 00:27:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:27:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582961
Mon 20 Jan 2014 00:27:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:27:43 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:27:43 - job_xml_thread(): Done retrieving: data size 43582961
Mon 20 Jan 2014 00:27:43 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:27:43 - XML: Start document: iteration 11
Mon 20 Jan 2014 00:27:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:27:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:27:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:27:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:27:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:27:56 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:27:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:27:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:27:58 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:27:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:27:58 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:27:58 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:27:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:27:59 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:27:59 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:27:59 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:27:59 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:27:59 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:28:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:28:03 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:28:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:28:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:28:03 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:28:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 00:28:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:28:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:28:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:28:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:28:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:28:05 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:28:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572915
Mon 20 Jan 2014 00:28:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:28:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572915
Mon 20 Jan 2014 00:28:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:28:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:28:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:28:14 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:28:14 - job_xml_thread(): Done retrieving: data size 43572915
Mon 20 Jan 2014 00:28:14 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:28:14 - XML: Start document: iteration 12
Mon 20 Jan 2014 00:28:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:28:16 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:28:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:28:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:28:17 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:28:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:28:18 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:28:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:28:18 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:28:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:28:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:28:25 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:28:25 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:28:25 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:28:25 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:28:25 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:28:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:28:26 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:28:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:28:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:28:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:28:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:28:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:28:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:28:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:28:28 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:28:28 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:28:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 00:28:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:28:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 00:28:28 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:28:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5825 values 91933 bits 11491 bytes 
Mon 20 Jan 2014 00:28:28 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:28:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562692
Mon 20 Jan 2014 00:28:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:28:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562692
Mon 20 Jan 2014 00:28:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:28:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:28:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:28:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:28:38 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:28:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:28:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:28:38 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:28:38 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:28:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:28:38 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:28:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:28:40 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:28:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:28:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:28:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:28:42 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:28:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:28:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:28:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:28:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:28:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:28:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:28:45 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:28:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 00:28:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:28:45 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:28:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583159
Mon 20 Jan 2014 00:28:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:28:45 - job_xml_thread(): Done retrieving: data size 43583159
Mon 20 Jan 2014 00:28:45 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:28:45 - XML: Start document: iteration 13
Mon 20 Jan 2014 00:28:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583159
Mon 20 Jan 2014 00:28:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:28:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:28:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:28:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:28:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:29:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:29:03 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:29:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:29:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:29:05 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:29:05 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:29:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:29:05 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:29:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:29:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:29:08 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:29:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:29:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:29:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:29:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:29:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:29:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:29:09 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:29:09 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:29:09 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:29:09 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:29:09 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:29:11 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:29:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43515698
Mon 20 Jan 2014 00:29:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:29:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43515698
Mon 20 Jan 2014 00:29:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:29:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:29:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:29:20 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:29:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:29:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:29:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:29:22 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:29:22 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:29:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:29:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:29:22 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:29:23 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 00:29:23 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:29:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:29:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:29:24 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:29:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:29:25 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:29:25 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:29:25 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:29:25 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 00:29:25 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 00:29:25 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 00:29:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:29:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:29:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:29:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:29:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:29:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:29:26 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 898523 values 14163217 bits 1770402 bytes 
Mon 20 Jan 2014 00:29:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:29:28 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:29:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:29:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 00:29:29 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:29:29 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:29:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 00:29:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6719 values 106022 bits 13252 bytes 
Mon 20 Jan 2014 00:29:30 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:29:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43513327
Mon 20 Jan 2014 00:29:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:29:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43513327
Mon 20 Jan 2014 00:29:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:29:31 - job_xml_thread(): Done retrieving: data size 43513327
Mon 20 Jan 2014 00:29:31 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:29:31 - XML: Start document: iteration 14
Mon 20 Jan 2014 00:29:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:29:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:29:40 - XML: Processed 652590 elements - found 0 jobs
Mon 20 Jan 2014 00:29:40 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:29:40 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:29:40 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:29:40 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:29:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:29:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:29:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:29:50 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:29:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:29:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:29:50 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:29:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:29:50 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:29:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:29:50 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:29:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:29:53 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:29:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:29:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:29:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:29:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:29:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:29:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:29:55 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:29:57 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:29:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 00:29:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:29:57 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:29:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42928979
Mon 20 Jan 2014 00:29:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:29:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42928979
Mon 20 Jan 2014 00:29:58 - job_xml_thread(): Done retrieving: data size 42928979
Mon 20 Jan 2014 00:29:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:29:58 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:29:58 - XML: Start document: iteration 15
Mon 20 Jan 2014 00:30:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:30:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:30:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:30:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:30:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:30:13 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:30:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:30:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:30:15 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:30:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:30:15 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:30:15 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:30:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:30:16 - XML: Processed 645320 elements - found 0 jobs
Mon 20 Jan 2014 00:30:16 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:30:16 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:30:16 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:30:16 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:30:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:30:19 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:30:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:30:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:30:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:30:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:30:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:30:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:30:23 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:30:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42963339
Mon 20 Jan 2014 00:30:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:30:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42963339
Mon 20 Jan 2014 00:30:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:30:25 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:30:25 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 00:30:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:30:29 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:30:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:30:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:30:31 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:30:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:30:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 00:30:31 - job_xml_thread(): Done retrieving: data size 42963339
Mon 20 Jan 2014 00:30:31 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:30:31 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:30:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 00:30:31 - XML: Start document: iteration 16
Mon 20 Jan 2014 00:30:31 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:30:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6937 values 109405 bits 13675 bytes 
Mon 20 Jan 2014 00:30:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:30:33 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:30:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:30:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:30:33 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:30:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:30:33 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:30:33 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:30:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:30:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:30:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:30:45 - XML: Processed 645882 elements - found 0 jobs
Mon 20 Jan 2014 00:30:45 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:30:45 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:30:45 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:30:45 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:30:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:30:45 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:30:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:30:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:30:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:30:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:30:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:30:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:30:48 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:30:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43482417
Mon 20 Jan 2014 00:30:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:30:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43482417
Mon 20 Jan 2014 00:30:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:30:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:30:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:30:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:30:58 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:30:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:30:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:30:58 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:30:58 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:30:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:30:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:30:58 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:31:01 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:31:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:31:01 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:31:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:31:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:31:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:31:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:31:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:31:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:31:02 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:31:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 00:31:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:31:05 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:31:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571529
Mon 20 Jan 2014 00:31:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:31:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571529
Mon 20 Jan 2014 00:31:06 - job_xml_thread(): Done retrieving: data size 43571529
Mon 20 Jan 2014 00:31:06 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:31:06 - XML: Start document: iteration 17
Mon 20 Jan 2014 00:31:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:31:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:31:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:31:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:31:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:31:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:31:20 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:31:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:31:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:31:21 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:31:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:31:21 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:31:21 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:31:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:31:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:31:24 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:31:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:31:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:31:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:31:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:31:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:31:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:31:28 - XML: Processed 653300 elements - found 0 jobs
Mon 20 Jan 2014 00:31:28 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:31:28 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:31:28 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:31:28 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:31:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:31:31 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:31:31 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:31:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573587
Mon 20 Jan 2014 00:31:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:31:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:31:32 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:31:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 00:31:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 00:31:32 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:31:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7387 values 116716 bits 14589 bytes 
Mon 20 Jan 2014 00:31:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573587
Mon 20 Jan 2014 00:31:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:31:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:31:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:31:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:31:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:31:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:31:42 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:31:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:31:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:31:42 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:31:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:31:42 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:31:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:31:42 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:31:43 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:31:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:31:48 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:31:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:31:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:31:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:31:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:31:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:31:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:31:52 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:31:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553550
Mon 20 Jan 2014 00:31:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:31:52 - job_xml_thread(): Done retrieving: data size 43553550
Mon 20 Jan 2014 00:31:52 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:31:52 - XML: Start document: iteration 18
Mon 20 Jan 2014 00:31:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553550
Mon 20 Jan 2014 00:31:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:31:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:31:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:32:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:32:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:32:09 - XML: Processed 653350 elements - found 0 jobs
Mon 20 Jan 2014 00:32:09 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:32:09 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:32:09 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:32:09 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:32:10 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:32:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 00:32:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:32:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:32:10 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:32:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:32:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:32:11 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:32:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:32:11 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:32:11 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:32:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:32:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:32:14 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:32:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:32:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:32:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:32:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:32:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:32:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:32:18 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:32:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43591550
Mon 20 Jan 2014 00:32:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:32:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43591550
Mon 20 Jan 2014 00:32:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:32:24 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:32:24 - job_xml_thread(): Done retrieving: data size 43591550
Mon 20 Jan 2014 00:32:24 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:32:25 - XML: Start document: iteration 19
Mon 20 Jan 2014 00:32:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:32:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:32:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:32:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:32:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:32:31 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:32:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:32:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:32:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:32:32 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:32:32 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:32:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:32:32 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:32:32 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:32:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:32:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:32:33 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:32:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 00:32:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 00:32:33 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:32:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6035 values 95507 bits 11938 bytes 
Mon 20 Jan 2014 00:32:38 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:32:38 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:32:38 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:32:38 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:32:38 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:32:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:32:41 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:32:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:32:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:32:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:32:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:32:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:32:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:32:46 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:32:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566567
Mon 20 Jan 2014 00:32:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:32:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566567
Mon 20 Jan 2014 00:32:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:32:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:32:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:32:54 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:32:54 - job_xml_thread(): Done retrieving: data size 43566567
Mon 20 Jan 2014 00:32:54 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:32:54 - XML: Start document: iteration 20
Mon 20 Jan 2014 00:32:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:32:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:33:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:33:01 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:33:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:33:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:33:02 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:33:02 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:33:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:33:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:33:02 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:33:05 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:33:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 00:33:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:33:06 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:33:06 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:33:06 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:33:06 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:33:06 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:33:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:33:10 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:33:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:33:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:33:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:33:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:33:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:33:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:33:14 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:33:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561885
Mon 20 Jan 2014 00:33:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:33:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561885
Mon 20 Jan 2014 00:33:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:33:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:33:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:33:22 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:33:22 - job_xml_thread(): Done retrieving: data size 43561885
Mon 20 Jan 2014 00:33:22 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:33:22 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 00:33:22 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 00:33:22 - Housekeeping: done.
Mon 20 Jan 2014 00:33:22 - XML: Start document: iteration 0
Mon 20 Jan 2014 00:33:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:33:25 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:33:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:33:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:33:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:33:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:33:27 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:33:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:33:27 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:33:27 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:33:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:33:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:33:33 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:33:34 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:33:34 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:33:34 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:33:34 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:33:34 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:33:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:33:34 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:33:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 00:33:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 00:33:34 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:33:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6033 values 95465 bits 11933 bytes 
Mon 20 Jan 2014 00:33:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:33:38 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:33:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:33:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:33:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:33:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:33:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:33:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:33:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:33:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:33:42 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:33:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43545526
Mon 20 Jan 2014 00:33:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:33:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43545526
Mon 20 Jan 2014 00:33:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:33:49 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:33:49 - job_xml_thread(): Done retrieving: data size 43545526
Mon 20 Jan 2014 00:33:49 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:33:49 - XML: Start document: iteration 1
Mon 20 Jan 2014 00:33:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:33:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:33:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:33:54 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:33:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:33:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:33:55 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:33:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:33:55 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:33:55 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:33:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:33:57 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:33:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 00:33:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:34:02 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:34:02 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:34:02 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:34:02 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:34:02 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:34:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:34:05 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:34:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:34:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:34:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:34:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:34:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:34:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:34:07 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 00:34:07 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 00:34:07 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:34:08 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:34:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557886
Mon 20 Jan 2014 00:34:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:34:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557886
Mon 20 Jan 2014 00:34:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:34:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:34:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:34:17 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:34:17 - job_xml_thread(): Done retrieving: data size 43557886
Mon 20 Jan 2014 00:34:17 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:34:17 - XML: Start document: iteration 2
Mon 20 Jan 2014 00:34:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:34:19 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:34:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:34:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:34:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:34:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:34:21 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:34:21 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:34:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:34:21 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:34:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:34:29 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:34:29 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:34:29 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:34:29 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:34:29 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:34:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:34:30 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:34:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:34:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:34:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:34:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:34:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:34:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:34:32 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:34:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567371
Mon 20 Jan 2014 00:34:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:34:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567371
Mon 20 Jan 2014 00:34:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:34:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:34:34 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:34:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:34:36 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:34:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:34:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 00:34:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 00:34:36 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:34:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:34:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8974 values 141596 bits 17699 bytes 
Mon 20 Jan 2014 00:34:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:34:41 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:34:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:34:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:34:42 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:34:42 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:34:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:34:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:34:42 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:34:44 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:34:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:34:45 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:34:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:34:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:34:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:34:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:34:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:34:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:34:47 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:34:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43593315
Mon 20 Jan 2014 00:34:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:34:47 - job_xml_thread(): Done retrieving: data size 43593315
Mon 20 Jan 2014 00:34:48 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:34:48 - XML: Start document: iteration 3
Mon 20 Jan 2014 00:34:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43593315
Mon 20 Jan 2014 00:34:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:34:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:34:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:35:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:35:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:35:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:35:05 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:35:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:35:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:35:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:35:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:35:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:35:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:35:06 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:35:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:35:09 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:35:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:35:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:35:09 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:35:09 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:35:09 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:35:09 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:35:09 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:35:09 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:35:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 00:35:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:35:09 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:35:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:35:09 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:35:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:35:10 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:35:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43505708
Mon 20 Jan 2014 00:35:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:35:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43505708
Mon 20 Jan 2014 00:35:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:35:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:35:19 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:35:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:35:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:35:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:35:23 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:35:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:35:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:35:24 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:35:24 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:35:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:35:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:35:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:35:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:35:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:35:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:35:25 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:35:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:35:25 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:35:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:35:26 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:35:26 - job_xml_thread(): Done retrieving: data size 43491868
Mon 20 Jan 2014 00:35:26 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:35:26 - XML: Start document: iteration 4
Mon 20 Jan 2014 00:35:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43491868
Mon 20 Jan 2014 00:35:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:35:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43491868
Mon 20 Jan 2014 00:35:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:35:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:35:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:35:36 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:35:36 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:35:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:35:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 00:35:37 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:35:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8933 values 140933 bits 17616 bytes 
Mon 20 Jan 2014 00:35:37 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:35:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 00:35:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:35:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:35:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:35:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:35:40 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:35:40 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:35:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:35:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:35:40 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:35:44 - XML: Processed 652324 elements - found 0 jobs
Mon 20 Jan 2014 00:35:44 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:35:44 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:35:44 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:35:44 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:35:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:35:48 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:35:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:35:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:35:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:35:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:35:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:35:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:35:50 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:35:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42946572
Mon 20 Jan 2014 00:35:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:35:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42946572
Mon 20 Jan 2014 00:35:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:35:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:35:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:35:59 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:35:59 - job_xml_thread(): Done retrieving: data size 42946572
Mon 20 Jan 2014 00:35:59 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:36:00 - XML: Start document: iteration 5
Mon 20 Jan 2014 00:36:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:36:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:36:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:36:10 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:36:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:36:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:36:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:36:11 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:36:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:36:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:36:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:36:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:36:11 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:36:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:36:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:36:12 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:36:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:36:12 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:36:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:36:12 - XML: Processed 645605 elements - found 0 jobs
Mon 20 Jan 2014 00:36:12 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:36:12 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:36:12 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:36:12 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:36:12 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:36:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 00:36:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:36:14 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:36:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42995203
Mon 20 Jan 2014 00:36:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:36:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42995203
Mon 20 Jan 2014 00:36:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:36:25 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 00:36:25 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:36:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:36:26 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:36:26 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:36:26 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 00:36:26 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:36:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:36:26 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 00:36:26 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 00:36:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:36:27 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:36:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:36:27 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:36:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:36:27 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:36:27 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:36:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:36:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:36:28 - size of cluster 'LISA Cluster': 624 hosts 79477 metrics 756057 values 11934255 bits 1491781 bytes 
Mon 20 Jan 2014 00:36:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:36:30 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:36:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:36:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:36:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:36:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:36:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:36:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:36:33 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:36:33 - job_xml_thread(): Done retrieving: data size 43016839
Mon 20 Jan 2014 00:36:33 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:36:33 - XML: Start document: iteration 6
Mon 20 Jan 2014 00:36:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43016839
Mon 20 Jan 2014 00:36:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:36:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43016839
Mon 20 Jan 2014 00:36:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:36:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:36:39 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:36:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:36:40 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:36:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 00:36:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 00:36:40 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:36:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8847 values 139582 bits 17447 bytes 
Mon 20 Jan 2014 00:36:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:36:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:36:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:36:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:36:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:36:47 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:36:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:36:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:36:48 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:36:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:36:49 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:36:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:36:49 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:36:50 - XML: Processed 646130 elements - found 0 jobs
Mon 20 Jan 2014 00:36:50 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:36:50 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:36:50 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:36:50 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:36:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:36:54 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:36:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:36:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:36:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:36:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:36:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:36:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:36:58 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:36:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43549845
Mon 20 Jan 2014 00:36:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:36:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43549845
Mon 20 Jan 2014 00:36:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:37:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:37:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:37:05 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:37:05 - job_xml_thread(): Done retrieving: data size 43549845
Mon 20 Jan 2014 00:37:05 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:37:05 - XML: Start document: iteration 7
Mon 20 Jan 2014 00:37:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:37:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:37:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:37:17 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:37:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:37:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:37:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:37:18 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:37:18 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:37:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:37:18 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:37:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:37:18 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:37:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:37:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:37:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:37:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:37:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:37:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:37:22 - XML: Processed 653072 elements - found 0 jobs
Mon 20 Jan 2014 00:37:22 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:37:22 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:37:22 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:37:22 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:37:22 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:37:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 00:37:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:37:25 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:37:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575331
Mon 20 Jan 2014 00:37:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:37:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575331
Mon 20 Jan 2014 00:37:26 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:37:26 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 00:37:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:37:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:37:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:37:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:37:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:37:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:37:36 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:37:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:37:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:37:36 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:37:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:37:36 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:37:36 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:37:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:37:37 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:37:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:37:40 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:37:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:37:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:37:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:37:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:37:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:37:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:37:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:37:40 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:37:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:37:41 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:37:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 00:37:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 00:37:41 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:37:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5804 values 91530 bits 11441 bytes 
Mon 20 Jan 2014 00:37:43 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:37:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577980
Mon 20 Jan 2014 00:37:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:37:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577980
Mon 20 Jan 2014 00:37:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:37:44 - job_xml_thread(): Done retrieving: data size 43577980
Mon 20 Jan 2014 00:37:44 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:37:44 - XML: Start document: iteration 8
Mon 20 Jan 2014 00:37:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:37:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:37:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:37:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:38:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:38:00 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:38:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:38:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:38:01 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:38:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:38:01 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:38:01 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:38:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:38:05 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:38:05 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:38:05 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:38:05 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:38:05 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:38:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:38:08 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:38:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:38:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:38:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:38:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:38:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:38:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:38:10 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:38:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 00:38:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:38:12 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:38:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569207
Mon 20 Jan 2014 00:38:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:38:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569207
Mon 20 Jan 2014 00:38:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:38:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:38:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:38:20 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:38:20 - job_xml_thread(): Done retrieving: data size 43569207
Mon 20 Jan 2014 00:38:20 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:38:20 - XML: Start document: iteration 9
Mon 20 Jan 2014 00:38:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:38:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:38:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:38:33 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:38:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:38:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:38:33 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:38:33 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:38:33 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:38:33 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:38:33 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:38:34 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:38:34 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:38:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:38:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:38:34 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:38:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:38:35 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:38:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:38:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:38:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:38:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:38:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:38:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:38:38 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:38:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43590165
Mon 20 Jan 2014 00:38:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:38:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43590165
Mon 20 Jan 2014 00:38:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:38:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:38:42 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:38:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:38:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 00:38:43 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:38:43 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:38:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 00:38:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7626 values 120268 bits 15033 bytes 
Mon 20 Jan 2014 00:38:48 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:38:48 - job_xml_thread(): Done retrieving: data size 43590165
Mon 20 Jan 2014 00:38:48 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:38:48 - XML: Start document: iteration 10
Mon 20 Jan 2014 00:38:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:38:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:38:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:38:49 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:38:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:38:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:38:50 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:38:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:38:50 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:38:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:38:50 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:38:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:38:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:38:59 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:38:59 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:38:59 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:38:59 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:38:59 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:39:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:39:02 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:39:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:39:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:39:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:39:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:39:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:39:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:39:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:39:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:39:05 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:39:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43546499
Mon 20 Jan 2014 00:39:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:39:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43546499
Mon 20 Jan 2014 00:39:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:39:14 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:39:14 - job_xml_thread(): Done retrieving: data size 43546499
Mon 20 Jan 2014 00:39:14 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:39:14 - XML: Start document: iteration 11
Mon 20 Jan 2014 00:39:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:39:16 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:39:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:39:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:39:17 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:39:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:39:17 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:39:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:39:17 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:39:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:39:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:39:19 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:39:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 00:39:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:39:26 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:39:26 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:39:26 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:39:26 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:39:26 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:39:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:39:29 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:39:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:39:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:39:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:39:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:39:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:39:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:39:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:39:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:39:32 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:39:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554313
Mon 20 Jan 2014 00:39:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:39:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554313
Mon 20 Jan 2014 00:39:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:39:41 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:39:41 - job_xml_thread(): Done retrieving: data size 43554313
Mon 20 Jan 2014 00:39:41 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:39:41 - XML: Start document: iteration 12
Mon 20 Jan 2014 00:39:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:39:43 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:39:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:39:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:39:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:39:45 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:39:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:39:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:39:45 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:39:45 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:39:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:39:45 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:39:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 00:39:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:39:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:39:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 00:39:45 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:39:45 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:39:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5793 values 91342 bits 11417 bytes 
Mon 20 Jan 2014 00:39:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:39:51 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:39:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:39:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:39:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:39:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:39:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:39:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:39:53 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:39:53 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:39:53 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:39:53 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:39:53 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:39:58 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:39:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 00:39:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:39:58 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:39:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562193
Mon 20 Jan 2014 00:39:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:39:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562193
Mon 20 Jan 2014 00:39:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:40:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:40:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:40:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:40:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:40:08 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:40:09 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:40:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:40:11 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:40:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:40:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:40:11 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:40:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:40:11 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:40:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:40:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:40:15 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:40:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:40:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:40:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:40:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:40:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:40:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:40:17 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 00:40:17 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 00:40:17 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:40:18 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:40:18 - job_xml_thread(): Done retrieving: data size 43555661
Mon 20 Jan 2014 00:40:18 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:40:18 - XML: Start document: iteration 13
Mon 20 Jan 2014 00:40:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555661
Mon 20 Jan 2014 00:40:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:40:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555661
Mon 20 Jan 2014 00:40:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:40:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:40:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:40:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:40:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:40:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:40:34 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:40:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:40:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:40:34 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:40:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:40:34 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:40:34 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:40:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:40:39 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:40:39 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:40:39 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:40:39 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:40:39 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:40:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:40:41 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:40:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:40:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:40:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:40:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:40:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:40:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:40:45 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:40:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572314
Mon 20 Jan 2014 00:40:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:40:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:40:46 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:40:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572314
Mon 20 Jan 2014 00:40:46 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:40:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:40:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:40:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 00:40:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 00:40:47 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:40:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9279 values 146420 bits 18302 bytes 
Mon 20 Jan 2014 00:40:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:40:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:40:54 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:40:54 - job_xml_thread(): Done retrieving: data size 43572314
Mon 20 Jan 2014 00:40:54 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:40:55 - XML: Start document: iteration 14
Mon 20 Jan 2014 00:40:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:40:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:40:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:40:58 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:40:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:40:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:40:59 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:40:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:40:59 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:40:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:40:59 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:41:06 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:41:06 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:41:06 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:41:06 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:41:06 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:41:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:41:08 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:41:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:41:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:41:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:41:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:41:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:41:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:41:10 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:41:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560542
Mon 20 Jan 2014 00:41:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:41:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560542
Mon 20 Jan 2014 00:41:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:41:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:41:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:41:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:41:19 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:41:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:41:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:41:19 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:41:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:41:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560542
Mon 20 Jan 2014 00:41:19 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:41:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:41:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:41:21 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:41:21 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:41:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:41:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:41:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:41:28 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:41:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:41:33 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:41:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:41:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:41:33 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:41:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 00:41:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:41:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:41:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:41:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:41:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:41:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:41:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:41:34 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:41:34 - job_xml_thread(): Done retrieving: data size 43474168
Mon 20 Jan 2014 00:41:34 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:41:34 - XML: Start document: iteration 15
Mon 20 Jan 2014 00:41:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43474168
Mon 20 Jan 2014 00:41:35 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:41:35 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:41:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:41:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:41:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:41:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43474168
Mon 20 Jan 2014 00:41:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:41:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:41:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:41:47 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:41:47 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:41:49 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:41:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:41:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 00:41:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:41:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 00:41:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:41:49 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:41:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:41:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:41:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5750 values 90670 bits 11333 bytes 
Mon 20 Jan 2014 00:41:51 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:41:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:41:51 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:41:51 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:41:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:41:51 - XML: Processed 652590 elements - found 0 jobs
Mon 20 Jan 2014 00:41:51 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:41:51 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:41:51 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:41:51 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:41:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:41:54 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:41:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:41:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:41:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:41:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:41:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:41:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:41:57 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:41:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42942450
Mon 20 Jan 2014 00:41:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:41:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42942450
Mon 20 Jan 2014 00:41:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:42:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:42:05 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:42:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:42:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:42:06 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:42:06 - job_xml_thread(): Done retrieving: data size 42942450
Mon 20 Jan 2014 00:42:06 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:42:06 - XML: Start document: iteration 16
Mon 20 Jan 2014 00:42:06 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:42:06 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:42:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:42:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:42:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42942450
Mon 20 Jan 2014 00:42:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:42:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:42:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:42:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:42:18 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:42:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:42:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:42:22 - XML: Processed 645306 elements - found 0 jobs
Mon 20 Jan 2014 00:42:22 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:42:22 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:42:22 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:42:22 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:42:22 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:42:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:42:22 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:42:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:42:22 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:42:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:42:24 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:42:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:42:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:42:24 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:42:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 00:42:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:42:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:42:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:42:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:42:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:42:26 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:42:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43001256
Mon 20 Jan 2014 00:42:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:42:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43001256
Mon 20 Jan 2014 00:42:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:42:37 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:42:38 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:42:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:42:38 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:42:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:42:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:42:39 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:42:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:42:39 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:42:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:42:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:42:39 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:42:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:42:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:42:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:42:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:42:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:42:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:42:42 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:42:42 - job_xml_thread(): Done retrieving: data size 43480835
Mon 20 Jan 2014 00:42:42 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:42:42 - XML: Start document: iteration 17
Mon 20 Jan 2014 00:42:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43480835
Mon 20 Jan 2014 00:42:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:42:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43480835
Mon 20 Jan 2014 00:42:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:42:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:42:49 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:42:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:42:50 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:42:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 00:42:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 00:42:50 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:42:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9175 values 144802 bits 18100 bytes 
Mon 20 Jan 2014 00:42:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:42:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:42:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:42:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:42:59 - XML: Processed 651840 elements - found 0 jobs
Mon 20 Jan 2014 00:42:59 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:42:59 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:42:59 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:43:00 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:43:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:43:03 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:43:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:43:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:43:04 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:43:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:43:04 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:43:04 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:43:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:43:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:43:05 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:43:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:43:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:43:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:43:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:43:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:43:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:43:07 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:43:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580904
Mon 20 Jan 2014 00:43:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:43:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580904
Mon 20 Jan 2014 00:43:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:43:15 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:43:15 - job_xml_thread(): Done retrieving: data size 43580904
Mon 20 Jan 2014 00:43:15 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:43:15 - XML: Start document: iteration 18
Mon 20 Jan 2014 00:43:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:43:15 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:43:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:43:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:43:20 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:43:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 00:43:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:43:20 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:43:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:43:20 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:43:20 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:43:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:43:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:43:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:43:27 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 00:43:27 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:43:27 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:43:27 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:43:27 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:43:27 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:43:27 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:43:27 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:43:27 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:43:28 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 00:43:28 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 00:43:28 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 00:43:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:43:29 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:43:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:43:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:43:29 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 848564 values 13380437 bits 1672554 bytes 
Mon 20 Jan 2014 00:43:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:43:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:43:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:43:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:43:33 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:43:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43541289
Mon 20 Jan 2014 00:43:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:43:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43541289
Mon 20 Jan 2014 00:43:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:43:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:43:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:43:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:43:42 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:43:42 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:43:42 - job_xml_thread(): Done retrieving: data size 43541289
Mon 20 Jan 2014 00:43:42 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:43:42 - XML: Start document: iteration 19
Mon 20 Jan 2014 00:43:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:43:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:43:43 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:43:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:43:43 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:43:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:43:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43541289
Mon 20 Jan 2014 00:43:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:43:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:43:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:43:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:43:50 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:43:51 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:43:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:43:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 00:43:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 00:43:51 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:43:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6240 values 98513 bits 12314 bytes 
Mon 20 Jan 2014 00:43:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:43:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:43:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:44:00 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:44:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:44:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:44:01 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:44:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:44:01 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:44:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:44:01 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:44:01 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:44:01 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:44:01 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:44:01 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:44:01 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:44:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:44:02 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:44:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:44:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:44:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:44:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:44:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:44:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:44:06 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:44:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571634
Mon 20 Jan 2014 00:44:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:44:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571634
Mon 20 Jan 2014 00:44:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:44:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:44:15 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:44:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:44:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:44:17 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:44:17 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:44:17 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:44:17 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:44:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:44:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:44:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:44:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:44:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:44:24 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:44:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:44:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:44:24 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:44:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 00:44:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:44:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:44:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:44:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:44:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:44:28 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:44:28 - job_xml_thread(): Done retrieving: data size 43578114
Mon 20 Jan 2014 00:44:28 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:44:28 - XML: Start document: iteration 20
Mon 20 Jan 2014 00:44:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578114
Mon 20 Jan 2014 00:44:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578114
Mon 20 Jan 2014 00:44:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:44:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:44:28 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:44:28 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 00:44:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:44:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:44:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:44:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:44:45 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:44:45 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:44:45 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:44:45 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:44:45 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:44:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:44:50 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:44:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:44:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:44:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:44:51 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:44:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:44:52 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:44:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:44:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:44:52 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:44:52 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:44:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:44:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:44:52 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:44:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:44:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 00:44:52 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:44:52 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:44:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 00:44:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5913 values 93287 bits 11660 bytes 
Mon 20 Jan 2014 00:44:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:44:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:44:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:44:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:44:57 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:44:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43605010
Mon 20 Jan 2014 00:44:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:44:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43605010
Mon 20 Jan 2014 00:44:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:45:00 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:45:00 - job_xml_thread(): Done retrieving: data size 43605010
Mon 20 Jan 2014 00:45:00 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:45:00 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 00:45:00 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 00:45:00 - Housekeeping: done.
Mon 20 Jan 2014 00:45:00 - XML: Start document: iteration 0
Mon 20 Jan 2014 00:45:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:45:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:45:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:45:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:45:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:45:15 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:45:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:45:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:45:17 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:45:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:45:17 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:45:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:45:17 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:45:18 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:45:18 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:45:18 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:45:18 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:45:18 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:45:18 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:45:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 00:45:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:45:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:45:20 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:45:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:45:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:45:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:45:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:45:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:45:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:45:23 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:45:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582411
Mon 20 Jan 2014 00:45:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:45:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582411
Mon 20 Jan 2014 00:45:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:45:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:45:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:45:33 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:45:33 - job_xml_thread(): Done retrieving: data size 43582411
Mon 20 Jan 2014 00:45:33 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:45:33 - XML: Start document: iteration 1
Mon 20 Jan 2014 00:45:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:45:35 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:45:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:45:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:45:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:45:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:45:36 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:45:36 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:45:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:45:36 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:45:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:45:46 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:45:46 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:45:46 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:45:46 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:45:46 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:45:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:45:47 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:45:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:45:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:45:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:45:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:45:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:45:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:45:50 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:45:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43551371
Mon 20 Jan 2014 00:45:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:45:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43551371
Mon 20 Jan 2014 00:45:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:45:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:45:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:45:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:45:52 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:45:53 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:45:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:45:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 00:45:53 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:45:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 00:45:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8979 values 141714 bits 17714 bytes 
Mon 20 Jan 2014 00:46:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:46:00 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:46:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:46:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:46:00 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:46:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:46:00 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:46:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:46:00 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:46:01 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:46:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:46:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:46:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:46:07 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:46:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:46:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:46:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:46:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:46:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:46:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:46:11 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:46:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568733
Mon 20 Jan 2014 00:46:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:46:11 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:46:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 00:46:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:46:11 - job_xml_thread(): Done retrieving: data size 43568733
Mon 20 Jan 2014 00:46:11 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:46:11 - XML: Start document: iteration 2
Mon 20 Jan 2014 00:46:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568733
Mon 20 Jan 2014 00:46:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:46:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:46:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:46:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:46:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:46:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:46:27 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:46:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:46:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:46:28 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:46:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:46:28 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:46:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:46:28 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:46:30 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:46:30 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:46:30 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:46:30 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:46:30 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:46:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:46:32 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:46:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:46:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:46:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:46:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:46:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:46:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:46:37 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:46:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566130
Mon 20 Jan 2014 00:46:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:46:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566130
Mon 20 Jan 2014 00:46:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:46:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:46:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:46:46 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:46:46 - job_xml_thread(): Done retrieving: data size 43566130
Mon 20 Jan 2014 00:46:47 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:46:47 - XML: Start document: iteration 3
Mon 20 Jan 2014 00:46:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:46:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:46:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:46:53 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:46:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:46:53 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:46:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:46:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:46:54 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:46:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:46:54 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:46:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:46:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:46:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 00:46:54 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:46:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99308 bits 12413 bytes 
Mon 20 Jan 2014 00:46:54 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:46:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 00:46:55 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:46:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:46:56 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:46:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:46:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:46:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:46:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:46:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:46:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:47:00 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:47:00 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:47:00 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:47:00 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:47:00 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:47:04 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:47:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564596
Mon 20 Jan 2014 00:47:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:47:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564596
Mon 20 Jan 2014 00:47:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:47:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:47:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:47:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:47:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:47:15 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:47:15 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:47:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:47:16 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:47:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:47:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:47:16 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:47:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:47:16 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:47:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:47:17 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:47:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 00:47:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:47:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:47:20 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:47:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:47:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:47:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:47:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:47:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:47:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:47:24 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:47:24 - job_xml_thread(): Done retrieving: data size 43515282
Mon 20 Jan 2014 00:47:24 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:47:24 - XML: Start document: iteration 4
Mon 20 Jan 2014 00:47:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43515282
Mon 20 Jan 2014 00:47:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:47:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43515282
Mon 20 Jan 2014 00:47:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:47:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:47:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:47:35 - XML: Processed 652602 elements - found 0 jobs
Mon 20 Jan 2014 00:47:35 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:47:35 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:47:35 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:47:35 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:47:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:47:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:47:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:47:41 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:47:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:47:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:47:42 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:47:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:47:42 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:47:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:47:42 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:47:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:47:46 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:47:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:47:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:47:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:47:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:47:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:47:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:47:49 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:47:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42935474
Mon 20 Jan 2014 00:47:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:47:50 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:47:50 - job_xml_thread(): Done retrieving: data size 42935474
Mon 20 Jan 2014 00:47:50 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:47:50 - XML: Start document: iteration 5
Mon 20 Jan 2014 00:47:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42935474
Mon 20 Jan 2014 00:47:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:47:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:47:55 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:47:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:47:57 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:47:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 00:47:57 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:47:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:47:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:47:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 00:47:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9023 values 142887 bits 17860 bytes 
Mon 20 Jan 2014 00:48:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:48:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:48:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:48:05 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:48:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:48:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:48:06 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:48:06 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:48:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:48:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:48:06 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:48:09 - XML: Processed 645532 elements - found 0 jobs
Mon 20 Jan 2014 00:48:09 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:48:09 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:48:09 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:48:09 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:48:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:48:13 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:48:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:48:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:48:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:48:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:48:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:48:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:48:16 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 00:48:16 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 00:48:16 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:48:17 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:48:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42949409
Mon 20 Jan 2014 00:48:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:48:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42949409
Mon 20 Jan 2014 00:48:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:48:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:48:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:48:24 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:48:24 - job_xml_thread(): Done retrieving: data size 42949409
Mon 20 Jan 2014 00:48:24 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:48:24 - XML: Start document: iteration 6
Mon 20 Jan 2014 00:48:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:48:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:48:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:48:33 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:48:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:48:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:48:33 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:48:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:48:33 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:48:33 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:48:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:48:36 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:48:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 00:48:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:48:37 - XML: Processed 645826 elements - found 0 jobs
Mon 20 Jan 2014 00:48:37 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:48:37 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:48:37 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:48:37 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:48:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:48:40 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:48:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:48:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:48:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:48:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:48:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:48:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:48:42 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:48:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43367835
Mon 20 Jan 2014 00:48:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:48:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43367835
Mon 20 Jan 2014 00:48:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:48:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:48:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:48:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:48:50 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:48:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:48:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:48:52 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:48:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:48:52 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:48:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:48:52 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:48:52 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:48:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:48:54 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:48:55 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:48:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43550107
Mon 20 Jan 2014 00:48:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:48:56 - job_xml_thread(): Done retrieving: data size 43550107
Mon 20 Jan 2014 00:48:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:48:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:48:56 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:48:56 - XML: Start document: iteration 7
Mon 20 Jan 2014 00:48:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:48:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:48:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:48:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:48:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43550107
Mon 20 Jan 2014 00:48:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:48:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:48:58 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:48:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:48:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 00:48:59 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:48:59 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9205 values 145431 bits 18178 bytes 
Mon 20 Jan 2014 00:49:00 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:49:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 00:49:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:49:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:49:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:49:09 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:49:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:49:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:49:11 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:49:11 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:49:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:49:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:49:11 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:49:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:49:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:49:17 - XML: Processed 652706 elements - found 0 jobs
Mon 20 Jan 2014 00:49:17 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:49:17 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:49:18 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:49:18 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:49:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:49:19 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:49:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:49:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:49:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:49:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:49:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:49:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:49:21 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:49:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563273
Mon 20 Jan 2014 00:49:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:49:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563273
Mon 20 Jan 2014 00:49:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:49:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:49:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:49:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:49:31 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:49:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:49:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:49:31 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:49:31 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:49:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:49:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:49:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563273
Mon 20 Jan 2014 00:49:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:49:33 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:49:33 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:49:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:49:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:49:39 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:49:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 00:49:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:49:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:49:43 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:49:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:49:44 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:49:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:49:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:49:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:49:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:49:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:49:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:49:46 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:49:46 - job_xml_thread(): Done retrieving: data size 43539556
Mon 20 Jan 2014 00:49:46 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:49:46 - XML: Start document: iteration 8
Mon 20 Jan 2014 00:49:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43539556
Mon 20 Jan 2014 00:49:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:49:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:49:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:49:49 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:49:49 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:49:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:49:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43539556
Mon 20 Jan 2014 00:49:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:49:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:49:55 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:49:55 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:49:55 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:49:55 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:49:55 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:50:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:50:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:50:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:50:00 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:50:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:50:00 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:50:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 00:50:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 00:50:00 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:50:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6164 values 97275 bits 12159 bytes 
Mon 20 Jan 2014 00:50:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:50:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:50:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:50:07 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:50:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:50:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:50:08 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:50:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:50:08 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:50:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:50:08 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:50:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:50:08 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:50:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:50:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:50:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:50:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:50:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:50:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:50:10 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:50:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43598347
Mon 20 Jan 2014 00:50:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:50:10 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:50:10 - job_xml_thread(): Done retrieving: data size 43598347
Mon 20 Jan 2014 00:50:10 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:50:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43598347
Mon 20 Jan 2014 00:50:10 - XML: Start document: iteration 9
Mon 20 Jan 2014 00:50:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:50:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:50:22 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:50:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:50:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:50:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:50:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:50:24 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:50:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:50:24 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:50:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:50:24 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:50:28 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 00:50:28 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:50:28 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:50:28 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:50:28 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:50:28 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:50:28 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:50:29 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:50:29 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 00:50:29 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:50:29 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 00:50:29 - Entering storeMetrics(): cluster LISA Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Mon 20 Jan 2014 00:50:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:50:34 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:50:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:50:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:50:34 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:50:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 00:50:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:50:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:50:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:50:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:50:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:50:36 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:50:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564404
Mon 20 Jan 2014 00:50:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:50:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564404
Mon 20 Jan 2014 00:50:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:50:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:50:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:50:43 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:50:43 - job_xml_thread(): Done retrieving: data size 43564404
Mon 20 Jan 2014 00:50:43 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:50:44 - XML: Start document: iteration 10
Mon 20 Jan 2014 00:50:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:50:48 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:50:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:50:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:50:49 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:50:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:50:49 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:50:49 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:50:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:50:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:50:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:50:55 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:50:55 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:50:55 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:50:55 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:50:55 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:50:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:50:57 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:50:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:50:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:50:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:50:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:50:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:50:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:50:59 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:50:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568068
Mon 20 Jan 2014 00:50:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:51:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568068
Mon 20 Jan 2014 00:51:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:51:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:51:02 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:51:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:51:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:51:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:51:05 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:51:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 00:51:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 00:51:05 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:51:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8614 values 135910 bits 16988 bytes 
Mon 20 Jan 2014 00:51:10 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:51:10 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:51:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:51:10 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:51:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:51:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:51:12 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:51:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:51:12 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:51:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:51:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:51:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:51:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:51:14 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:51:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:51:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:51:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:51:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:51:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:51:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:51:17 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:51:17 - job_xml_thread(): Done retrieving: data size 43565569
Mon 20 Jan 2014 00:51:17 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:51:17 - XML: Start document: iteration 11
Mon 20 Jan 2014 00:51:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565569
Mon 20 Jan 2014 00:51:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:51:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565569
Mon 20 Jan 2014 00:51:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:51:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:51:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:51:29 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:51:29 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:51:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:51:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:51:31 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:51:31 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 00:51:31 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 00:51:31 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:51:31 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 00:51:34 - size of cluster 'LISA Cluster': 624 hosts 79475 metrics 814071 values 12851955 bits 1606494 bytes 
Mon 20 Jan 2014 00:51:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:51:35 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:51:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:51:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:51:36 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:51:36 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:51:36 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:51:36 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:51:36 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:51:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:51:36 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:51:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:51:36 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:51:36 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:51:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:51:42 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:51:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:51:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:51:42 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:51:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 00:51:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:51:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:51:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:51:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:51:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:51:45 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:51:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563481
Mon 20 Jan 2014 00:51:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:51:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563481
Mon 20 Jan 2014 00:51:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:51:51 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:51:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:51:52 - job_xml_thread(): Done retrieving: data size 43563481
Mon 20 Jan 2014 00:51:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:51:52 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:51:52 - XML: Start document: iteration 12
Mon 20 Jan 2014 00:51:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:51:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:52:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:52:03 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:52:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:52:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:52:04 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:52:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:52:04 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:52:04 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:52:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:52:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:52:05 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:52:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:52:06 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:52:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:52:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:52:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:52:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 00:52:06 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:52:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5557 values 87632 bits 10954 bytes 
Mon 20 Jan 2014 00:52:06 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:52:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 00:52:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:52:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:52:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:52:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:52:09 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:52:09 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:52:09 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:52:09 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:52:09 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:52:13 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:52:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 00:52:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:52:14 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:52:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572549
Mon 20 Jan 2014 00:52:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:52:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572549
Mon 20 Jan 2014 00:52:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:52:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:52:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:52:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:52:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:52:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:52:22 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:52:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:52:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:52:22 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:52:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:52:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572549
Mon 20 Jan 2014 00:52:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:52:22 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:52:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:52:24 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:52:25 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:52:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:52:29 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:52:31 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:52:31 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 00:52:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:52:35 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:52:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:52:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:52:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:52:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:52:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:52:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:52:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:52:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:52:38 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:52:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:52:38 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:52:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:52:38 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:52:38 - job_xml_thread(): Done retrieving: data size 43563638
Mon 20 Jan 2014 00:52:38 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:52:38 - XML: Start document: iteration 13
Mon 20 Jan 2014 00:52:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563638
Mon 20 Jan 2014 00:52:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:52:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563638
Mon 20 Jan 2014 00:52:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:52:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:52:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:52:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:52:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:52:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:52:54 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:52:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:52:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:52:55 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:52:55 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:52:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:52:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:52:55 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:52:56 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:52:56 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:52:56 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:52:56 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:52:56 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:53:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:53:02 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:53:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:53:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:53:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:53:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:53:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:53:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:53:05 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:53:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564793
Mon 20 Jan 2014 00:53:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:53:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564793
Mon 20 Jan 2014 00:53:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:53:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:53:06 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:53:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:53:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 00:53:07 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:53:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 00:53:07 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:53:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148713 bits 18589 bytes 
Mon 20 Jan 2014 00:53:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:53:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:53:11 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:53:11 - job_xml_thread(): Done retrieving: data size 43564793
Mon 20 Jan 2014 00:53:11 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:53:11 - XML: Start document: iteration 14
Mon 20 Jan 2014 00:53:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:53:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:53:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:53:24 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:53:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:53:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:53:25 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:53:25 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:53:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:53:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:53:25 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:53:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:53:26 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:53:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:53:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:53:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:53:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:53:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:53:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:53:29 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:53:29 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:53:29 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:53:29 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:53:29 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:53:32 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:53:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43339272
Mon 20 Jan 2014 00:53:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:53:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43339272
Mon 20 Jan 2014 00:53:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:53:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:53:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:53:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:53:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:53:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:53:43 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:53:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:53:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:53:43 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:53:43 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:53:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:53:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:53:43 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:53:44 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:53:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:53:47 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:53:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:53:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:53:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:53:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:53:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:53:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:53:48 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:53:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 00:53:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:53:50 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:53:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42952551
Mon 20 Jan 2014 00:53:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:53:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42952551
Mon 20 Jan 2014 00:53:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:53:50 - job_xml_thread(): Done retrieving: data size 42952551
Mon 20 Jan 2014 00:53:50 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:53:50 - XML: Start document: iteration 15
Mon 20 Jan 2014 00:53:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:53:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:54:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:54:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:54:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:54:03 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:54:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:54:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:54:04 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:54:04 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:54:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:54:04 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:54:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:54:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:54:07 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:54:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:54:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 00:54:08 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:54:08 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:54:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 00:54:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5408 values 85273 bits 10659 bytes 
Mon 20 Jan 2014 00:54:11 - XML: Processed 645664 elements - found 0 jobs
Mon 20 Jan 2014 00:54:11 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:54:11 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:54:11 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:54:11 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:54:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:54:14 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:54:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:54:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:54:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:54:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:54:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:54:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:54:18 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:54:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42943569
Mon 20 Jan 2014 00:54:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:54:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42943569
Mon 20 Jan 2014 00:54:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:54:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:54:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:54:26 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:54:26 - job_xml_thread(): Done retrieving: data size 42943569
Mon 20 Jan 2014 00:54:26 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:54:26 - XML: Start document: iteration 16
Mon 20 Jan 2014 00:54:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:54:29 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:54:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:54:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:54:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:54:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:54:31 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:54:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:54:31 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:54:31 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:54:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:54:37 - XML: Processed 645828 elements - found 0 jobs
Mon 20 Jan 2014 00:54:37 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:54:37 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:54:37 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:54:37 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:54:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:54:41 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:54:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:54:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:54:42 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:54:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 00:54:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:54:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:54:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:54:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:54:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:54:45 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:54:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43477755
Mon 20 Jan 2014 00:54:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:54:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43477755
Mon 20 Jan 2014 00:54:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:54:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:54:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:54:52 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:54:52 - job_xml_thread(): Done retrieving: data size 43477755
Mon 20 Jan 2014 00:54:52 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:54:52 - XML: Start document: iteration 17
Mon 20 Jan 2014 00:54:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:54:57 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:54:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:54:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:54:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:54:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:54:58 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:54:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:54:58 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:54:58 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:54:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:55:08 - XML: Processed 652622 elements - found 0 jobs
Mon 20 Jan 2014 00:55:08 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:55:08 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:55:08 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:55:08 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:55:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:55:09 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:55:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:55:09 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:55:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:55:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 00:55:09 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:55:09 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:55:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 00:55:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5601 values 88305 bits 11038 bytes 
Mon 20 Jan 2014 00:55:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:55:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:55:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:55:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:55:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:55:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:55:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:55:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:55:13 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:55:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 00:55:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:55:13 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:55:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43533275
Mon 20 Jan 2014 00:55:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:55:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43533275
Mon 20 Jan 2014 00:55:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:55:23 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:55:23 - job_xml_thread(): Done retrieving: data size 43533275
Mon 20 Jan 2014 00:55:23 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:55:23 - XML: Start document: iteration 18
Mon 20 Jan 2014 00:55:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:55:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:55:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:55:26 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:55:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:55:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:55:28 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:55:28 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:55:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:55:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:55:28 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:55:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:55:32 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:55:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:55:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:55:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:55:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:55:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:55:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:55:35 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:55:35 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:55:35 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:55:35 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:55:35 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:55:35 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 00:55:35 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 00:55:35 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:55:37 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:55:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571024
Mon 20 Jan 2014 00:55:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:55:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571024
Mon 20 Jan 2014 00:55:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:55:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:55:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:55:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:55:49 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:55:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:55:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:55:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:55:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:55:50 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:55:50 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:55:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:55:51 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:55:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:55:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:55:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:55:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:55:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:55:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:55:51 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:55:51 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:55:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:55:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:55:52 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:55:52 - job_xml_thread(): Done retrieving: data size 43596084
Mon 20 Jan 2014 00:55:52 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:55:52 - XML: Start document: iteration 19
Mon 20 Jan 2014 00:55:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43596084
Mon 20 Jan 2014 00:55:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:55:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43596084
Mon 20 Jan 2014 00:55:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:56:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:56:06 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:56:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:56:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:56:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:56:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:56:07 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:56:07 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:56:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:56:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:56:07 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:56:09 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:56:09 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:56:09 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:56:09 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:56:09 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:56:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:56:09 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:56:11 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:56:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 00:56:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:56:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 00:56:11 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:56:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148676 bits 18584 bytes 
Mon 20 Jan 2014 00:56:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:56:13 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:56:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:56:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:56:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:56:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:56:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:56:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:56:17 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:56:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569266
Mon 20 Jan 2014 00:56:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:56:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569266
Mon 20 Jan 2014 00:56:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:56:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:56:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:56:24 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:56:24 - job_xml_thread(): Done retrieving: data size 43569266
Mon 20 Jan 2014 00:56:24 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:56:24 - XML: Start document: iteration 20
Mon 20 Jan 2014 00:56:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:56:29 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:56:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:56:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:56:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:56:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:56:29 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:56:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:56:29 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:56:29 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:56:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:56:37 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:56:37 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:56:37 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:56:37 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:56:37 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:56:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:56:40 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:56:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:56:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:56:40 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:56:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 00:56:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:56:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:56:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:56:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:56:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:56:42 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:56:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43548805
Mon 20 Jan 2014 00:56:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:56:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43548805
Mon 20 Jan 2014 00:56:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:56:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:56:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:56:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:56:52 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:56:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:56:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:56:52 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:56:52 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:56:52 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:56:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:56:52 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:56:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:56:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:56:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:56:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:56:56 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:56:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:56:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:56:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:56:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:56:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:56:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:56:58 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:56:58 - job_xml_thread(): Done retrieving: data size 43578343
Mon 20 Jan 2014 00:56:58 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:56:58 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 00:56:58 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 00:56:58 - Housekeeping: done.
Mon 20 Jan 2014 00:56:58 - XML: Start document: iteration 0
Mon 20 Jan 2014 00:56:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578343
Mon 20 Jan 2014 00:56:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:56:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578343
Mon 20 Jan 2014 00:56:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:57:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:57:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:57:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:57:12 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:57:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:57:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:57:12 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:57:12 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:57:12 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:57:12 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:57:12 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:57:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:57:13 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:57:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 00:57:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 00:57:13 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:57:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8912 values 140572 bits 17571 bytes 
Mon 20 Jan 2014 00:57:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:57:15 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:57:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:57:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:57:16 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:57:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:57:16 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:57:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:57:16 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:57:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:57:19 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:57:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:57:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:57:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:57:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:57:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:57:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:57:22 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:57:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43600209
Mon 20 Jan 2014 00:57:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:57:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43600209
Mon 20 Jan 2014 00:57:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:57:27 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:57:28 - job_xml_thread(): Done retrieving: data size 43600209
Mon 20 Jan 2014 00:57:28 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:57:28 - XML: Start document: iteration 1
Mon 20 Jan 2014 00:57:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:57:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:57:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:57:33 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:57:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:57:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:57:34 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:57:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:57:34 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:57:34 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:57:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:57:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:57:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:57:41 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:57:41 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:57:41 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:57:41 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:57:41 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:57:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:57:45 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:57:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:57:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:57:45 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:57:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 00:57:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:57:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:57:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:57:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:57:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:57:46 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:57:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557438
Mon 20 Jan 2014 00:57:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:57:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557438
Mon 20 Jan 2014 00:57:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:57:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:57:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:57:57 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:57:57 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:57:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:57:57 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:57:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:57:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:57:58 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:57:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:57:58 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:57:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:58:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:58:00 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:58:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:58:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:58:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:58:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:58:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:58:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:58:02 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:58:02 - job_xml_thread(): Done retrieving: data size 43587977
Mon 20 Jan 2014 00:58:02 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:58:02 - XML: Start document: iteration 2
Mon 20 Jan 2014 00:58:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43587977
Mon 20 Jan 2014 00:58:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:58:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43587977
Mon 20 Jan 2014 00:58:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:58:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:58:13 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:58:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:58:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:58:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:58:15 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:58:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 00:58:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 00:58:15 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:58:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8666 values 136731 bits 17091 bytes 
Mon 20 Jan 2014 00:58:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:58:15 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:58:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:58:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:58:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:58:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:58:16 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:58:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:58:16 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:58:16 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:58:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:58:21 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:58:21 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:58:21 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:58:21 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:58:21 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:58:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:58:23 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:58:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:58:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:58:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:58:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:58:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:58:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:58:25 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:58:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574614
Mon 20 Jan 2014 00:58:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:58:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574614
Mon 20 Jan 2014 00:58:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:58:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:58:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:58:31 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 00:58:31 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:58:32 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:58:32 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:58:32 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 00:58:33 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 00:58:33 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 00:58:36 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:58:36 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:58:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:58:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:58:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:58:39 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:58:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:58:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:58:40 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:58:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:58:40 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:58:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:58:40 - size of cluster 'LISA Cluster': 624 hosts 79481 metrics 917419 values 14465228 bits 1808153 bytes 
Mon 20 Jan 2014 00:58:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:58:42 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:58:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:58:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:58:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:58:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:58:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:58:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:58:43 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:58:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 00:58:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:58:46 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:58:46 - job_xml_thread(): Done retrieving: data size 43562905
Mon 20 Jan 2014 00:58:46 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:58:46 - XML: Start document: iteration 3
Mon 20 Jan 2014 00:58:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562905
Mon 20 Jan 2014 00:58:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:58:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562905
Mon 20 Jan 2014 00:58:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:58:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:58:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:58:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:58:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:59:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:59:09 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:59:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:59:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:59:10 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 00:59:10 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:59:10 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:59:10 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:59:10 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:59:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:59:11 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:59:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:59:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:59:11 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:59:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:59:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:59:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:59:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:59:12 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:59:12 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:59:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:59:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:59:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:59:15 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:59:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:59:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 00:59:15 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:59:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5526 values 87139 bits 10892 bytes 
Mon 20 Jan 2014 00:59:15 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:59:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 00:59:15 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:59:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43518067
Mon 20 Jan 2014 00:59:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:59:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43518067
Mon 20 Jan 2014 00:59:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:59:25 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:59:25 - job_xml_thread(): Done retrieving: data size 43518067
Mon 20 Jan 2014 00:59:25 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 00:59:26 - XML: Start document: iteration 4
Mon 20 Jan 2014 00:59:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:59:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:59:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:59:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:59:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:59:28 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:59:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:59:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:59:29 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:59:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:59:29 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:59:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:59:29 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:59:33 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:59:33 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 00:59:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:59:35 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:59:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:59:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:59:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:59:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:59:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 00:59:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:59:38 - XML: Processed 652602 elements - found 0 jobs
Mon 20 Jan 2014 00:59:38 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 00:59:38 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 00:59:38 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 00:59:38 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 00:59:42 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 00:59:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 00:59:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:59:42 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 00:59:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43033665
Mon 20 Jan 2014 00:59:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 00:59:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43033665
Mon 20 Jan 2014 00:59:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 00:59:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 00:59:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:59:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 00:59:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 00:59:53 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 00:59:53 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 00:59:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 00:59:57 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 00:59:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 00:59:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 00:59:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 00:59:58 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 00:59:58 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:59:58 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 00:59:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 00:59:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 00:59:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 00:59:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 00:59:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:59:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 00:59:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 00:59:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:00:02 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:00:02 - job_xml_thread(): Done retrieving: data size 42907834
Mon 20 Jan 2014 01:00:02 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:00:02 - XML: Start document: iteration 5
Mon 20 Jan 2014 01:00:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42907834
Mon 20 Jan 2014 01:00:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42907834
Mon 20 Jan 2014 01:00:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:00:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:00:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:00:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:00:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:00:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:00:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:00:15 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:00:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:00:16 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:00:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 01:00:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 01:00:16 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:00:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6752 values 106530 bits 13316 bytes 
Mon 20 Jan 2014 01:00:21 - XML: Processed 645182 elements - found 0 jobs
Mon 20 Jan 2014 01:00:21 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:00:21 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:00:21 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:00:21 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:00:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:00:22 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:00:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:00:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:00:22 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:00:22 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:00:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:00:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:00:22 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:00:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:00:24 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:00:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:00:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:00:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:00:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:00:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:00:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:00:28 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:00:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42975340
Mon 20 Jan 2014 01:00:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:00:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42975340
Mon 20 Jan 2014 01:00:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:00:36 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:00:36 - job_xml_thread(): Done retrieving: data size 42975340
Mon 20 Jan 2014 01:00:36 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:00:36 - XML: Start document: iteration 6
Mon 20 Jan 2014 01:00:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:00:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:00:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:00:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:00:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:00:39 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:00:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:00:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:00:40 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:00:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:00:40 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:00:40 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:00:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:00:41 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:00:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 01:00:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:00:46 - XML: Processed 645914 elements - found 0 jobs
Mon 20 Jan 2014 01:00:46 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:00:46 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:00:46 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:00:46 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:00:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:00:49 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:00:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:00:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:00:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:00:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:00:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:00:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:00:52 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:00:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43486035
Mon 20 Jan 2014 01:00:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:00:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43486035
Mon 20 Jan 2014 01:00:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:00:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:00:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:01:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:01:00 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:01:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:01:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:01:01 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:01:01 - job_xml_thread(): Done retrieving: data size 43486035
Mon 20 Jan 2014 01:01:01 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:01:01 - XML: Start document: iteration 7
Mon 20 Jan 2014 01:01:01 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:01:01 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:01:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:01:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:01:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43486035
Mon 20 Jan 2014 01:01:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:01:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:01:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:01:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:01:16 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:01:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:01:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:01:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:01:17 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:01:17 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:01:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:01:17 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:01:17 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:01:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:01:17 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:01:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 01:01:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:01:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 01:01:17 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:01:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6153 values 97150 bits 12143 bytes 
Mon 20 Jan 2014 01:01:20 - XML: Processed 652458 elements - found 0 jobs
Mon 20 Jan 2014 01:01:20 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:01:20 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:01:20 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:01:20 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:01:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:01:23 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:01:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:01:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:01:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:01:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:01:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:01:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:01:27 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:01:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43551680
Mon 20 Jan 2014 01:01:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:01:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43551680
Mon 20 Jan 2014 01:01:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:01:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:01:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:01:35 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:01:35 - job_xml_thread(): Done retrieving: data size 43551680
Mon 20 Jan 2014 01:01:35 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:01:35 - XML: Start document: iteration 8
Mon 20 Jan 2014 01:01:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:01:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:01:49 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 01:01:49 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:01:49 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:01:49 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:01:49 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:01:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:01:50 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:01:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:01:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:01:51 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:01:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:01:51 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:01:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:01:51 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:01:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:01:52 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:01:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:01:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:01:52 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:01:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 01:01:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:01:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:01:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:01:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:01:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:01:55 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:01:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582715
Mon 20 Jan 2014 01:01:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:01:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582715
Mon 20 Jan 2014 01:01:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:02:04 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:02:04 - job_xml_thread(): Done retrieving: data size 43582715
Mon 20 Jan 2014 01:02:04 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:02:04 - XML: Start document: iteration 9
Mon 20 Jan 2014 01:02:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:02:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:02:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:02:07 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:02:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:02:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:02:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:02:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:02:08 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:02:08 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:02:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:02:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:02:08 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:02:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:02:17 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:02:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:02:17 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:02:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:02:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:02:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:02:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:02:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:02:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:02:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:02:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 01:02:18 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:02:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 01:02:19 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:02:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5622 values 88853 bits 11106 bytes 
Mon 20 Jan 2014 01:02:19 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 01:02:19 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:02:19 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:02:19 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:02:19 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:02:23 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:02:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572423
Mon 20 Jan 2014 01:02:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:02:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572423
Mon 20 Jan 2014 01:02:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:02:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:02:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:02:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:02:33 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:02:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:02:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:02:33 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:02:33 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:02:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:02:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:02:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572423
Mon 20 Jan 2014 01:02:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:02:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:02:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:02:34 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:02:34 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:02:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:02:44 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:02:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:02:46 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:02:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:02:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:02:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:02:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:02:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:02:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:02:47 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:02:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 01:02:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:02:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:02:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:02:48 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:02:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:02:48 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:02:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:02:50 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:02:50 - job_xml_thread(): Done retrieving: data size 43598494
Mon 20 Jan 2014 01:02:50 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:02:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43598494
Mon 20 Jan 2014 01:02:50 - XML: Start document: iteration 10
Mon 20 Jan 2014 01:02:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:02:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43598494
Mon 20 Jan 2014 01:02:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:03:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:03:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:03:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:03:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:03:05 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 01:03:05 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:03:05 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:03:05 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:03:05 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:03:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:03:10 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:03:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:03:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:03:11 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:03:11 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:03:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:03:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:03:11 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:03:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:03:13 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:03:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:03:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:03:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:03:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:03:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:03:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:03:17 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:03:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43619846
Mon 20 Jan 2014 01:03:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:03:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43619846
Mon 20 Jan 2014 01:03:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:03:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:03:19 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:03:19 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:03:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 01:03:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:03:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 01:03:20 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:03:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8761 values 138568 bits 17321 bytes 
Mon 20 Jan 2014 01:03:20 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:03:20 - job_xml_thread(): Done retrieving: data size 43619846
Mon 20 Jan 2014 01:03:20 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:03:20 - XML: Start document: iteration 11
Mon 20 Jan 2014 01:03:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:03:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:03:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:03:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:03:33 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 01:03:33 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:03:33 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:03:33 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:03:33 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:03:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:03:37 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:03:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:03:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:03:37 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:03:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:03:37 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:03:37 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:03:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:03:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:03:40 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:03:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:03:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:03:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:03:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:03:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:03:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:03:43 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 01:03:43 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 01:03:43 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:03:44 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:03:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43644232
Mon 20 Jan 2014 01:03:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:03:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43644232
Mon 20 Jan 2014 01:03:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:03:44 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:03:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 01:03:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:03:48 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:03:48 - job_xml_thread(): Done retrieving: data size 43644232
Mon 20 Jan 2014 01:03:48 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:03:48 - XML: Start document: iteration 12
Mon 20 Jan 2014 01:03:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:03:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:03:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:03:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:03:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:03:56 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:03:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:03:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:03:57 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:03:57 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:03:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:03:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:03:57 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:04:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:04:02 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:04:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:04:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:04:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:04:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:04:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:04:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:04:06 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 01:04:06 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:04:06 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:04:06 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:04:06 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:04:07 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:04:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43664428
Mon 20 Jan 2014 01:04:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:04:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43664428
Mon 20 Jan 2014 01:04:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:04:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:04:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:04:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:04:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:04:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:04:19 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:04:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:04:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:04:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:04:20 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:04:20 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:04:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:04:21 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:04:21 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:04:21 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:04:21 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:04:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:04:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 01:04:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:04:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 01:04:21 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:04:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99097 bits 12387 bytes 
Mon 20 Jan 2014 01:04:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:04:22 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:04:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:04:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:04:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:04:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:04:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:04:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:04:25 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:04:25 - job_xml_thread(): Done retrieving: data size 43673885
Mon 20 Jan 2014 01:04:25 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:04:25 - XML: Start document: iteration 13
Mon 20 Jan 2014 01:04:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43673885
Mon 20 Jan 2014 01:04:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43673885
Mon 20 Jan 2014 01:04:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:04:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:04:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:04:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:04:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:04:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:04:41 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:04:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 01:04:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:04:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:04:43 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:04:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:04:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:04:44 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 01:04:44 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:04:44 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:04:44 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:04:44 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:04:45 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:04:45 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:04:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:04:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:04:45 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:04:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:04:47 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:04:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:04:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:04:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:04:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:04:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:04:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:04:49 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:04:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43666718
Mon 20 Jan 2014 01:04:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:04:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43666718
Mon 20 Jan 2014 01:04:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:04:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:04:58 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:04:59 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:04:59 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:05:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:05:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:05:00 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:05:00 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:05:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:05:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:05:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:05:01 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:05:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:05:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:05:03 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:05:03 - job_xml_thread(): Done retrieving: data size 43667071
Mon 20 Jan 2014 01:05:03 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:05:03 - XML: Start document: iteration 14
Mon 20 Jan 2014 01:05:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43667071
Mon 20 Jan 2014 01:05:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:05:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:05:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:05:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:05:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:05:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43667071
Mon 20 Jan 2014 01:05:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:05:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:05:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:05:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:05:16 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:05:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:05:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:05:17 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:05:17 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:05:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:05:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:05:18 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:05:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:05:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:05:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:05:21 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:05:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:05:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 01:05:22 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:05:22 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:05:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 01:05:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9306 values 146773 bits 18346 bytes 
Mon 20 Jan 2014 01:05:23 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 01:05:23 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:05:23 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:05:23 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:05:23 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:05:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:05:25 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:05:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:05:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:05:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:05:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:05:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:05:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:05:27 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:05:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43597478
Mon 20 Jan 2014 01:05:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:05:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43597478
Mon 20 Jan 2014 01:05:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:05:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:05:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:05:33 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 01:05:34 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:05:34 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:05:34 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 01:05:34 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:05:34 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 01:05:35 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 01:05:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:05:38 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:05:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:05:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:05:39 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:05:39 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:05:39 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:05:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:05:39 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:05:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:05:40 - size of cluster 'LISA Cluster': 624 hosts 79474 metrics 279448 values 4416907 bits 552113 bytes 
Mon 20 Jan 2014 01:05:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:05:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:05:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:05:44 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:05:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:05:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:05:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:05:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:05:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:05:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:05:44 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:05:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 01:05:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:05:46 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:05:46 - job_xml_thread(): Done retrieving: data size 43075652
Mon 20 Jan 2014 01:05:46 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:05:46 - XML: Start document: iteration 15
Mon 20 Jan 2014 01:05:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43075652
Mon 20 Jan 2014 01:05:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43075652
Mon 20 Jan 2014 01:05:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:05:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:05:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:05:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:05:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:05:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:06:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:06:07 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:06:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:06:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:06:07 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:06:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:06:07 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:06:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:06:07 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:06:09 - XML: Processed 646012 elements - found 0 jobs
Mon 20 Jan 2014 01:06:09 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:06:09 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:06:09 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:06:09 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:06:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:06:09 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:06:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:06:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:06:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:06:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:06:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:06:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:06:12 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:06:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43002376
Mon 20 Jan 2014 01:06:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:06:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43002376
Mon 20 Jan 2014 01:06:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:06:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:06:22 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:06:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:06:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:06:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:06:23 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:06:23 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:06:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:06:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 01:06:23 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:06:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8704 values 137302 bits 17162 bytes 
Mon 20 Jan 2014 01:06:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 01:06:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:06:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:06:24 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:06:24 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:06:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:06:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:06:24 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:06:24 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:06:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:06:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:06:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:06:27 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:06:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:06:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:06:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:06:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:06:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:06:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:06:30 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:06:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43012715
Mon 20 Jan 2014 01:06:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:06:30 - job_xml_thread(): Done retrieving: data size 43012715
Mon 20 Jan 2014 01:06:30 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:06:30 - XML: Start document: iteration 16
Mon 20 Jan 2014 01:06:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43012715
Mon 20 Jan 2014 01:06:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:06:35 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:06:35 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 01:06:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:06:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:06:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:06:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:06:50 - XML: Processed 645226 elements - found 0 jobs
Mon 20 Jan 2014 01:06:50 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:06:50 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:06:50 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:06:50 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:06:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:06:51 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:06:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:06:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:06:51 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:06:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:06:51 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:06:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:06:51 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:06:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:06:52 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:06:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:06:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:06:53 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:06:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 01:06:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:06:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:06:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:06:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:06:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:06:54 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:06:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43013285
Mon 20 Jan 2014 01:06:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:06:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43013285
Mon 20 Jan 2014 01:06:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:07:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:07:06 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:07:06 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:07:06 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:07:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:07:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:07:07 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:07:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:07:07 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:07:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:07:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:07:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:07:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:07:09 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:07:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:07:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:07:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:07:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:07:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:07:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:07:11 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:07:11 - job_xml_thread(): Done retrieving: data size 43007867
Mon 20 Jan 2014 01:07:11 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:07:11 - XML: Start document: iteration 17
Mon 20 Jan 2014 01:07:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43007867
Mon 20 Jan 2014 01:07:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:07:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43007867
Mon 20 Jan 2014 01:07:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:07:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:07:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:07:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:07:23 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:07:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:07:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 01:07:23 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:07:23 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:07:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 01:07:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8744 values 137862 bits 17232 bytes 
Mon 20 Jan 2014 01:07:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:07:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:07:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:07:29 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:07:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:07:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:07:29 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:07:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:07:29 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:07:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:07:29 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:07:35 - XML: Processed 645226 elements - found 0 jobs
Mon 20 Jan 2014 01:07:35 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:07:35 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:07:35 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:07:35 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:07:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:07:35 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:07:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:07:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:07:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:07:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:07:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:07:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:07:37 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:07:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43003675
Mon 20 Jan 2014 01:07:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:07:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43003675
Mon 20 Jan 2014 01:07:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:07:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:07:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:07:50 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:07:50 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:07:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:07:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:07:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:07:53 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:07:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:07:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:07:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:07:54 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:07:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:07:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:07:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:07:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:07:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:07:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:07:54 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:07:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:07:54 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:07:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:07:54 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:07:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 01:07:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:07:55 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:07:55 - job_xml_thread(): Done retrieving: data size 43007663
Mon 20 Jan 2014 01:07:55 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:07:55 - XML: Start document: iteration 18
Mon 20 Jan 2014 01:07:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43007663
Mon 20 Jan 2014 01:07:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43007663
Mon 20 Jan 2014 01:07:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:07:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:08:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:08:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:08:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:08:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:08:14 - XML: Processed 645222 elements - found 0 jobs
Mon 20 Jan 2014 01:08:14 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:08:14 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:08:14 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:08:14 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:08:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:08:19 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:08:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:08:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:08:19 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:08:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:08:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:08:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:08:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:08:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:08:19 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:08:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:08:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:08:19 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:08:19 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:08:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:08:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:08:21 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:08:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43009350
Mon 20 Jan 2014 01:08:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:08:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43009350
Mon 20 Jan 2014 01:08:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:08:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:08:23 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:08:24 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:08:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:08:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 01:08:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 01:08:24 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:08:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9115 values 143793 bits 17974 bytes 
Mon 20 Jan 2014 01:08:29 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:08:29 - job_xml_thread(): Done retrieving: data size 43009350
Mon 20 Jan 2014 01:08:29 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:08:29 - XML: Start document: iteration 19
Mon 20 Jan 2014 01:08:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:08:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:08:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:08:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:08:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:08:37 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:08:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:08:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:08:37 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:08:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:08:37 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:08:37 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:08:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:08:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:08:39 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:08:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:08:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:08:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:08:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:08:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:08:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:08:42 - XML: Processed 645226 elements - found 0 jobs
Mon 20 Jan 2014 01:08:42 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:08:42 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:08:42 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:08:42 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:08:44 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:08:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43009634
Mon 20 Jan 2014 01:08:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:08:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43009634
Mon 20 Jan 2014 01:08:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:08:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:08:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:08:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:08:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:08:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:08:56 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:08:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:08:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:08:56 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:08:56 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:08:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:08:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:08:57 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:08:57 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:08:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:08:59 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:08:59 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:08:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 01:08:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:08:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:08:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:08:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:08:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:08:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:08:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:09:00 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:09:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43019037
Mon 20 Jan 2014 01:09:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:09:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43019037
Mon 20 Jan 2014 01:09:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:09:00 - job_xml_thread(): Done retrieving: data size 43019037
Mon 20 Jan 2014 01:09:00 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:09:00 - XML: Start document: iteration 20
Mon 20 Jan 2014 01:09:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:09:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:09:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:09:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:09:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:09:19 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:09:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:09:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:09:19 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:09:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:09:19 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:09:19 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:09:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:09:19 - XML: Processed 645226 elements - found 0 jobs
Mon 20 Jan 2014 01:09:19 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:09:19 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:09:19 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:09:19 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:09:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:09:23 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:09:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:09:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:09:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:09:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:09:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:09:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:09:24 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 01:09:24 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 01:09:24 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:09:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:09:24 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:09:24 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:09:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43010972
Mon 20 Jan 2014 01:09:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:09:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43010972
Mon 20 Jan 2014 01:09:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:09:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:09:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 01:09:25 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:09:25 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:09:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 01:09:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8826 values 139218 bits 17402 bytes 
Mon 20 Jan 2014 01:09:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:09:33 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:09:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:09:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:09:34 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:09:34 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:09:35 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:09:35 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:09:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:09:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:09:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:09:37 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:09:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:09:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:09:38 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:09:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 01:09:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:09:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:09:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:09:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:09:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:09:38 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:09:38 - job_xml_thread(): Done retrieving: data size 43007613
Mon 20 Jan 2014 01:09:38 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:09:38 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 01:09:38 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 01:09:38 - Housekeeping: done.
Mon 20 Jan 2014 01:09:38 - XML: Start document: iteration 0
Mon 20 Jan 2014 01:09:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43007613
Mon 20 Jan 2014 01:09:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:09:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43007613
Mon 20 Jan 2014 01:09:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:09:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:09:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:09:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:09:51 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:09:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:09:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:09:52 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:09:52 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:09:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:09:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:09:52 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:09:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:09:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:09:57 - XML: Processed 645226 elements - found 0 jobs
Mon 20 Jan 2014 01:09:57 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:09:57 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:09:57 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:09:57 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:10:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:10:00 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:10:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:10:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:10:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:10:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:10:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:10:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:10:03 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:10:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43005077
Mon 20 Jan 2014 01:10:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:10:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43005077
Mon 20 Jan 2014 01:10:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:10:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:10:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:10:12 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:10:12 - job_xml_thread(): Done retrieving: data size 43005077
Mon 20 Jan 2014 01:10:12 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:10:13 - XML: Start document: iteration 1
Mon 20 Jan 2014 01:10:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:10:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:10:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:10:17 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:10:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:10:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:10:18 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:10:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:10:18 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:10:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:10:18 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:10:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:10:19 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:10:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:10:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:10:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:10:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:10:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:10:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:10:23 - XML: Processed 645226 elements - found 0 jobs
Mon 20 Jan 2014 01:10:23 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:10:23 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:10:23 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:10:23 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:10:23 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 01:10:23 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 01:10:23 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:10:23 - ganglia_store_thread(): Done waiting: storemetricthread() has finished: cluster LISA Cluster
Mon 20 Jan 2014 01:10:23 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:10:24 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:10:24 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 01:10:24 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:10:24 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 01:10:24 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 01:10:24 - size of cluster 'LISA Cluster': 624 hosts 79463 metrics 75096 values 1189761 bits 148720 bytes 
Mon 20 Jan 2014 01:10:25 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:10:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43004974
Mon 20 Jan 2014 01:10:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:10:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:10:26 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:10:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43004974
Mon 20 Jan 2014 01:10:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:10:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:10:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 01:10:27 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:10:27 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:10:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 01:10:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148572 bits 18571 bytes 
Mon 20 Jan 2014 01:10:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:10:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:10:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:10:35 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:10:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:10:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:10:36 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:10:36 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:10:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:10:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:10:36 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:10:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:10:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:10:38 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:10:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:10:39 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:10:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:10:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:10:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:10:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:10:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:10:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:10:40 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:10:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43008942
Mon 20 Jan 2014 01:10:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:10:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43008942
Mon 20 Jan 2014 01:10:41 - job_xml_thread(): Done retrieving: data size 43008942
Mon 20 Jan 2014 01:10:41 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:10:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:10:41 - XML: Start document: iteration 2
Mon 20 Jan 2014 01:10:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:10:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:10:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:10:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:10:55 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:10:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:10:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:10:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:10:56 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:10:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:10:56 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:10:56 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:10:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:10:58 - XML: Processed 645226 elements - found 0 jobs
Mon 20 Jan 2014 01:10:58 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:10:58 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:10:58 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:10:58 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:11:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:11:01 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:11:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:11:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:11:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:11:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:11:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:11:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:11:01 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:11:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 01:11:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:11:03 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:11:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43004632
Mon 20 Jan 2014 01:11:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:11:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43004632
Mon 20 Jan 2014 01:11:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:11:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:11:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:11:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:11:13 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:11:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:11:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:11:13 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:11:13 - job_xml_thread(): Done retrieving: data size 43004632
Mon 20 Jan 2014 01:11:13 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:11:13 - XML: Start document: iteration 3
Mon 20 Jan 2014 01:11:15 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:11:15 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:11:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:11:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:11:15 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:11:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:11:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:11:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:11:22 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:11:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:11:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:11:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:11:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:11:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:11:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:11:24 - XML: Processed 645226 elements - found 0 jobs
Mon 20 Jan 2014 01:11:24 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:11:24 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:11:24 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:11:24 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:11:24 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:11:24 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 01:11:26 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:11:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42997910
Mon 20 Jan 2014 01:11:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:11:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42997910
Mon 20 Jan 2014 01:11:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:11:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:11:28 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:11:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:11:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:11:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:11:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 01:11:31 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:11:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 01:11:31 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:11:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8744 values 137894 bits 17236 bytes 
Mon 20 Jan 2014 01:11:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:11:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:11:39 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:11:39 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:11:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:11:39 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:11:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:11:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:11:39 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:11:39 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:11:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:11:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:11:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:11:42 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:11:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:11:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:11:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:11:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:11:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:11:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:11:43 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:11:43 - job_xml_thread(): Done retrieving: data size 43007648
Mon 20 Jan 2014 01:11:43 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:11:43 - XML: Start document: iteration 4
Mon 20 Jan 2014 01:11:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43007648
Mon 20 Jan 2014 01:11:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:11:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43007648
Mon 20 Jan 2014 01:11:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:11:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:11:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:11:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:11:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:12:00 - XML: Processed 645152 elements - found 0 jobs
Mon 20 Jan 2014 01:12:00 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:12:00 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:12:00 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:12:00 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:12:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:12:05 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:12:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:12:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:12:05 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:12:05 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:12:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:12:05 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:12:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:12:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:12:06 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:12:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:12:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:12:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:12:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:12:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:12:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:12:06 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:12:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 01:12:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:12:08 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 01:12:08 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 01:12:08 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:12:08 - ganglia_store_thread(): Done waiting: storemetricthread() has finished: cluster LISA Cluster
Mon 20 Jan 2014 01:12:08 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:12:08 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:12:08 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:12:08 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 01:12:08 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 01:12:08 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 01:12:08 - size of cluster 'LISA Cluster': 624 hosts 79363 metrics 62512 values 990285 bits 123785 bytes 
Mon 20 Jan 2014 01:12:08 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:12:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43006913
Mon 20 Jan 2014 01:12:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:12:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43006913
Mon 20 Jan 2014 01:12:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:12:15 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:12:15 - job_xml_thread(): Done retrieving: data size 43006913
Mon 20 Jan 2014 01:12:15 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:12:15 - XML: Start document: iteration 5
Mon 20 Jan 2014 01:12:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:12:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:12:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:12:21 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:12:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:12:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:12:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:12:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:12:22 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:12:22 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:12:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:12:22 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:12:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:12:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:12:26 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:12:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:12:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:12:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:12:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:12:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:12:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:12:29 - XML: Processed 645152 elements - found 0 jobs
Mon 20 Jan 2014 01:12:29 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:12:29 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:12:29 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:12:29 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:12:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:12:31 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:12:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:12:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 01:12:31 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:12:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 01:12:31 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:12:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5571 values 87790 bits 10973 bytes 
Mon 20 Jan 2014 01:12:31 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:12:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43005365
Mon 20 Jan 2014 01:12:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:12:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43005365
Mon 20 Jan 2014 01:12:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:12:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:12:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:12:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:12:42 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:12:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:12:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:12:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:12:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:12:43 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:12:43 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:12:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:12:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:12:43 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:12:44 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:12:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:12:45 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:12:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:12:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:12:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:12:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:12:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:12:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:12:46 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:12:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43017156
Mon 20 Jan 2014 01:12:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:12:47 - job_xml_thread(): Done retrieving: data size 43017156
Mon 20 Jan 2014 01:12:47 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:12:47 - XML: Start document: iteration 6
Mon 20 Jan 2014 01:12:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43017156
Mon 20 Jan 2014 01:12:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:12:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:12:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:13:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:13:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:13:03 - XML: Processed 645226 elements - found 0 jobs
Mon 20 Jan 2014 01:13:03 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:13:03 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:13:03 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:13:03 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:13:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:13:04 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:13:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 01:13:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:13:04 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:13:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:13:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:13:06 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:13:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:13:06 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:13:06 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:13:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:13:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:13:08 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:13:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:13:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:13:08 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:13:08 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 01:13:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:13:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:13:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:13:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:13:10 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:13:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43012105
Mon 20 Jan 2014 01:13:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:13:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43012105
Mon 20 Jan 2014 01:13:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:13:18 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:13:19 - job_xml_thread(): Done retrieving: data size 43012105
Mon 20 Jan 2014 01:13:19 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:13:19 - XML: Start document: iteration 7
Mon 20 Jan 2014 01:13:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:13:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:13:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:13:21 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:13:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:13:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:13:22 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:13:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:13:22 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:13:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:13:22 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:13:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:13:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:13:29 - XML: Processed 645226 elements - found 0 jobs
Mon 20 Jan 2014 01:13:29 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:13:29 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:13:29 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:13:29 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:13:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:13:31 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:13:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:13:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:13:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:13:31 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:13:31 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 01:13:31 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 01:13:31 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:13:32 - ganglia_store_thread(): Done waiting: storemetricthread() has finished: cluster LISA Cluster
Mon 20 Jan 2014 01:13:32 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:13:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:13:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:13:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:13:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:13:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:13:32 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:13:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 01:13:32 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:13:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 01:13:32 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:13:32 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:13:32 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 01:13:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6358 values 100306 bits 12538 bytes 
Mon 20 Jan 2014 01:13:32 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 01:13:32 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 01:13:32 - size of cluster 'LISA Cluster': 624 hosts 79473 metrics 76243 values 1207912 bits 150989 bytes 
Mon 20 Jan 2014 01:13:33 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:13:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43004739
Mon 20 Jan 2014 01:13:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:13:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43004739
Mon 20 Jan 2014 01:13:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:13:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:13:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:13:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:13:43 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:13:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:13:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:13:44 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:13:44 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:13:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:13:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:13:44 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:13:44 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:13:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:13:46 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:13:46 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:13:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 01:13:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:13:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:13:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:13:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:13:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:13:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:13:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:13:48 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:13:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43008465
Mon 20 Jan 2014 01:13:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:13:48 - job_xml_thread(): Done retrieving: data size 43008465
Mon 20 Jan 2014 01:13:48 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:13:49 - XML: Start document: iteration 8
Mon 20 Jan 2014 01:13:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43008465
Mon 20 Jan 2014 01:13:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:13:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:13:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:14:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:14:01 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:14:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:14:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:14:03 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:14:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:14:03 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:14:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:14:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:14:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:14:03 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:14:07 - XML: Processed 645226 elements - found 0 jobs
Mon 20 Jan 2014 01:14:07 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:14:07 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:14:07 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:14:07 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:14:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:14:10 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:14:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:14:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:14:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:14:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:14:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:14:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:14:12 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:14:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43008632
Mon 20 Jan 2014 01:14:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:14:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43008632
Mon 20 Jan 2014 01:14:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:14:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:14:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:14:22 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:14:22 - job_xml_thread(): Done retrieving: data size 43008632
Mon 20 Jan 2014 01:14:22 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:14:22 - XML: Start document: iteration 9
Mon 20 Jan 2014 01:14:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:14:22 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:14:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:14:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:14:23 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:14:24 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:14:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:14:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:14:24 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:14:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:14:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:14:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:14:32 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:14:32 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:14:32 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 01:14:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:14:33 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:14:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:14:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:14:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:14:33 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:14:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 01:14:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 01:14:34 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:14:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8067 values 127186 bits 15898 bytes 
Mon 20 Jan 2014 01:14:34 - XML: Processed 645226 elements - found 0 jobs
Mon 20 Jan 2014 01:14:34 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:14:34 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:14:34 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:14:34 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:14:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:14:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:14:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:14:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:14:35 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:14:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43005905
Mon 20 Jan 2014 01:14:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:14:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43005905
Mon 20 Jan 2014 01:14:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:14:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:14:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:14:44 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:14:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 01:14:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:14:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:14:47 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:14:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:14:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:14:49 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:14:49 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:14:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:14:49 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:14:49 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:14:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:14:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:14:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:14:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:14:50 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:14:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:14:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:14:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:14:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:14:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:14:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:14:52 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:14:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43014460
Mon 20 Jan 2014 01:14:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:14:52 - job_xml_thread(): Done retrieving: data size 43014460
Mon 20 Jan 2014 01:14:52 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:14:52 - XML: Start document: iteration 10
Mon 20 Jan 2014 01:14:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43014460
Mon 20 Jan 2014 01:14:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:15:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:15:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:15:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:15:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:15:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:15:12 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:15:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:15:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:15:13 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:15:13 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:15:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:15:13 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:15:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:15:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:15:14 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:15:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:15:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:15:15 - XML: Processed 645226 elements - found 0 jobs
Mon 20 Jan 2014 01:15:15 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:15:15 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:15:15 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:15:15 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:15:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:15:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:15:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:15:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:15:16 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 01:15:16 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 01:15:16 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:15:16 - ganglia_store_thread(): Done waiting: storemetricthread() has finished: cluster LISA Cluster
Mon 20 Jan 2014 01:15:16 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:15:17 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:15:17 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 01:15:17 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:15:17 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 01:15:17 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 01:15:17 - size of cluster 'LISA Cluster': 624 hosts 79326 metrics 57806 values 915687 bits 114460 bytes 
Mon 20 Jan 2014 01:15:17 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:15:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43013131
Mon 20 Jan 2014 01:15:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:15:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43013131
Mon 20 Jan 2014 01:15:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:15:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:15:28 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:15:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:15:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:15:30 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:15:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:15:30 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:15:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:15:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:15:30 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:15:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:15:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:15:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:15:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:15:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:15:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:15:30 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:15:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:15:30 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:15:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:15:33 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:15:33 - job_xml_thread(): Done retrieving: data size 43007660
Mon 20 Jan 2014 01:15:33 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:15:33 - XML: Start document: iteration 11
Mon 20 Jan 2014 01:15:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43007660
Mon 20 Jan 2014 01:15:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:15:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43007660
Mon 20 Jan 2014 01:15:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:15:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:15:34 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:15:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:15:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 01:15:36 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:15:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 01:15:36 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:15:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 12422 values 195878 bits 24484 bytes 
Mon 20 Jan 2014 01:15:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:15:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:15:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:15:45 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:15:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:15:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:15:47 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:15:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:15:47 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:15:48 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:15:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:15:51 - XML: Processed 645226 elements - found 0 jobs
Mon 20 Jan 2014 01:15:51 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:15:51 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:15:51 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:15:51 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:15:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:15:53 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:15:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:15:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:15:53 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:15:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 01:15:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:15:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:15:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:15:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:15:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:15:55 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:15:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43010795
Mon 20 Jan 2014 01:15:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:15:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43010795
Mon 20 Jan 2014 01:15:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:16:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:16:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:16:06 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:16:06 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:16:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:16:06 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:16:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:16:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:16:08 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:16:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:16:08 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:16:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:16:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:16:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:16:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:16:09 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:16:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:16:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:16:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:16:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:16:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:16:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:16:10 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 01:16:10 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 01:16:10 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:16:13 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:16:13 - job_xml_thread(): Done retrieving: data size 42992563
Mon 20 Jan 2014 01:16:13 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:16:13 - XML: Start document: iteration 12
Mon 20 Jan 2014 01:16:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42992563
Mon 20 Jan 2014 01:16:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42992563
Mon 20 Jan 2014 01:16:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:16:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:16:17 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:16:17 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:16:18 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:16:18 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 01:16:18 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:16:18 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 01:16:18 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 01:16:20 - size of cluster 'LISA Cluster': 624 hosts 79432 metrics 94440 values 1495906 bits 186988 bytes 
Mon 20 Jan 2014 01:16:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:16:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:16:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:16:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:16:31 - XML: Processed 645226 elements - found 0 jobs
Mon 20 Jan 2014 01:16:31 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:16:32 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:16:32 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:16:32 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:16:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:16:35 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:16:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:16:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:16:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:16:35 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:16:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:16:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:16:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:16:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:16:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:16:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:16:35 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:16:36 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:16:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:16:36 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:16:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:16:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:16:36 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:16:36 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:16:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42953915
Mon 20 Jan 2014 01:16:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:16:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42953915
Mon 20 Jan 2014 01:16:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:16:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:16:37 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:16:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 01:16:37 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:16:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 01:16:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99131 bits 12391 bytes 
Mon 20 Jan 2014 01:16:47 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:16:47 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:16:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:16:47 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:16:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:16:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:16:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:16:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:16:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:16:51 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:16:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:16:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:16:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:16:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:16:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:16:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:16:51 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:16:51 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:16:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:16:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:16:52 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:16:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 01:16:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:16:53 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:16:53 - job_xml_thread(): Done retrieving: data size 42941149
Mon 20 Jan 2014 01:16:53 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:16:53 - XML: Start document: iteration 13
Mon 20 Jan 2014 01:16:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42941149
Mon 20 Jan 2014 01:16:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:16:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42941149
Mon 20 Jan 2014 01:16:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:17:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:17:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:17:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:17:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:17:07 - XML: Processed 645226 elements - found 0 jobs
Mon 20 Jan 2014 01:17:07 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:17:07 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:17:08 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:17:08 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:17:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:17:13 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:17:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:17:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:17:14 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:17:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:17:15 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:17:15 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:17:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:17:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:17:15 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:17:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:17:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:17:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:17:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:17:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:17:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:17:16 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:17:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42935969
Mon 20 Jan 2014 01:17:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:17:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42935969
Mon 20 Jan 2014 01:17:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:17:18 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:17:18 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 01:17:23 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:17:23 - job_xml_thread(): Done retrieving: data size 42935969
Mon 20 Jan 2014 01:17:23 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:17:23 - XML: Start document: iteration 14
Mon 20 Jan 2014 01:17:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:17:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:17:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:17:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:17:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:17:35 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:17:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:17:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:17:36 - XML: Processed 645152 elements - found 0 jobs
Mon 20 Jan 2014 01:17:36 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:17:36 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:17:36 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:17:36 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:17:37 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:17:37 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:17:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:17:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:17:37 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:17:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:17:37 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:17:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:17:38 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:17:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:17:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:17:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:17:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:17:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:17:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:17:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:17:38 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:17:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 01:17:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 01:17:38 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:17:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6281 values 99349 bits 12418 bytes 
Mon 20 Jan 2014 01:17:40 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:17:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42939464
Mon 20 Jan 2014 01:17:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:17:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42939464
Mon 20 Jan 2014 01:17:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:17:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:17:51 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:17:51 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:17:51 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:17:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:17:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:17:52 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:17:52 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:17:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:17:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:17:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:17:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:17:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:17:54 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:17:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:17:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:17:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:17:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:17:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:17:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:17:55 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:17:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 01:17:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:17:58 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:17:58 - job_xml_thread(): Done retrieving: data size 42933995
Mon 20 Jan 2014 01:17:58 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:17:58 - XML: Start document: iteration 15
Mon 20 Jan 2014 01:17:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42933995
Mon 20 Jan 2014 01:17:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42933995
Mon 20 Jan 2014 01:17:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:17:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:18:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:18:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:18:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:18:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:18:12 - XML: Processed 645152 elements - found 0 jobs
Mon 20 Jan 2014 01:18:12 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:18:12 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:18:12 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:18:12 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:18:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:18:15 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:18:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:18:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:18:15 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:18:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:18:15 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:18:15 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:18:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:18:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:18:18 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:18:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:18:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:18:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:18:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:18:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:18:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:18:19 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:18:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42989439
Mon 20 Jan 2014 01:18:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:18:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42989439
Mon 20 Jan 2014 01:18:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:18:27 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:18:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:18:27 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:18:27 - job_xml_thread(): Done retrieving: data size 42989439
Mon 20 Jan 2014 01:18:27 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:18:27 - XML: Start document: iteration 16
Mon 20 Jan 2014 01:18:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:18:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:18:32 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:18:32 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:18:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:18:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:18:32 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:18:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:18:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:18:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:18:38 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:18:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:18:39 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:18:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:18:40 - XML: Processed 645897 elements - found 0 jobs
Mon 20 Jan 2014 01:18:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:18:40 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:18:40 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:18:40 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:18:40 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:18:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:18:40 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:18:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 01:18:40 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:18:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 01:18:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8347 values 131846 bits 16480 bytes 
Mon 20 Jan 2014 01:18:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:18:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:18:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:18:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:18:42 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:18:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43443145
Mon 20 Jan 2014 01:18:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:18:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43443145
Mon 20 Jan 2014 01:18:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:18:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:18:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:18:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:18:54 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:18:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:18:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:18:55 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:18:55 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:18:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:18:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:18:55 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:18:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:18:55 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:18:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:18:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:18:57 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:18:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:18:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:18:58 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:18:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 01:18:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:18:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:18:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:18:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:18:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:18:58 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:18:58 - job_xml_thread(): Done retrieving: data size 43583719
Mon 20 Jan 2014 01:18:58 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:18:58 - XML: Start document: iteration 17
Mon 20 Jan 2014 01:18:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583719
Mon 20 Jan 2014 01:18:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:18:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583719
Mon 20 Jan 2014 01:18:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:19:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:19:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:19:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:19:11 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:19:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:19:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:19:12 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:19:12 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:19:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:19:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:19:12 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:19:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:19:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:19:15 - XML: Processed 653110 elements - found 0 jobs
Mon 20 Jan 2014 01:19:15 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:19:15 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:19:15 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:19:15 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:19:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:19:18 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:19:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:19:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:19:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:19:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:19:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:19:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:19:21 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:19:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43548948
Mon 20 Jan 2014 01:19:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:19:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43548948
Mon 20 Jan 2014 01:19:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:19:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:19:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:19:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:19:30 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:19:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:19:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:19:30 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:19:30 - job_xml_thread(): Done retrieving: data size 43548948
Mon 20 Jan 2014 01:19:30 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:19:30 - XML: Start document: iteration 18
Mon 20 Jan 2014 01:19:31 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:19:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:19:31 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:19:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:19:31 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:19:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:19:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:19:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:19:40 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:19:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:19:40 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:19:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:19:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:19:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:19:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 01:19:41 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:19:41 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:19:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 01:19:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:19:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:19:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8286 values 130710 bits 16338 bytes 
Mon 20 Jan 2014 01:19:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:19:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:19:42 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 01:19:42 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:19:42 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:19:42 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:19:42 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:19:44 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:19:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564722
Mon 20 Jan 2014 01:19:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:19:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564722
Mon 20 Jan 2014 01:19:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:19:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:19:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:19:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:19:56 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:19:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:19:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:19:56 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:19:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:19:56 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:19:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:19:56 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:19:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:19:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:19:57 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:20:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:20:00 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:20:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:20:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:20:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:20:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:20:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:20:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:20:00 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:20:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 01:20:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:20:02 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:20:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575710
Mon 20 Jan 2014 01:20:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:20:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575710
Mon 20 Jan 2014 01:20:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:20:02 - job_xml_thread(): Done retrieving: data size 43575710
Mon 20 Jan 2014 01:20:02 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:20:03 - XML: Start document: iteration 19
Mon 20 Jan 2014 01:20:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:20:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:20:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:20:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:20:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:20:17 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:20:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:20:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:20:18 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:20:18 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:20:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:20:18 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:20:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:20:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:20:20 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:20:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:20:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:20:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:20:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:20:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:20:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:20:22 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 01:20:22 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:20:22 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:20:22 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:20:22 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:20:23 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:20:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571719
Mon 20 Jan 2014 01:20:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:20:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571719
Mon 20 Jan 2014 01:20:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:20:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:20:33 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:20:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:20:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:20:35 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:20:35 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:20:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:20:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:20:36 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:20:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:20:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:20:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:20:37 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:20:37 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:20:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:20:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:20:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:20:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:20:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:20:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:20:40 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:20:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581448
Mon 20 Jan 2014 01:20:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:20:40 - job_xml_thread(): Done retrieving: data size 43581448
Mon 20 Jan 2014 01:20:41 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:20:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581448
Mon 20 Jan 2014 01:20:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:20:41 - XML: Start document: iteration 20
Mon 20 Jan 2014 01:20:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:20:41 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:20:43 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:20:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:20:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 01:20:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 01:20:43 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:20:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 11988 values 189083 bits 23635 bytes 
Mon 20 Jan 2014 01:20:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:20:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:20:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:20:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:20:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:20:56 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:20:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:20:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:20:57 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 01:20:57 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:20:57 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:20:57 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:20:57 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:20:58 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:20:58 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:20:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:20:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:20:58 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:21:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:21:03 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:21:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:21:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:21:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:21:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:21:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:21:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:21:05 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:21:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575282
Mon 20 Jan 2014 01:21:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:21:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575282
Mon 20 Jan 2014 01:21:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:21:12 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:21:13 - job_xml_thread(): Done retrieving: data size 43575282
Mon 20 Jan 2014 01:21:13 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:21:13 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 01:21:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:21:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:21:14 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 01:21:14 - Housekeeping: done.
Mon 20 Jan 2014 01:21:14 - XML: Start document: iteration 0
Mon 20 Jan 2014 01:21:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:21:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:21:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:21:22 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:21:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:21:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:21:23 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:21:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:21:23 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:21:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:21:23 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:21:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:21:28 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:21:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:21:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:21:29 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 01:21:29 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:21:29 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:21:29 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:21:29 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:21:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:21:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:21:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:21:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:21:30 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:21:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 01:21:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:21:31 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:21:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43587475
Mon 20 Jan 2014 01:21:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:21:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43587475
Mon 20 Jan 2014 01:21:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:21:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:21:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:21:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:21:40 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:21:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:21:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:21:40 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:21:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:21:40 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:21:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:21:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43587475
Mon 20 Jan 2014 01:21:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:21:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:21:43 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:21:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:21:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:21:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:21:45 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:21:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 01:21:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 01:21:45 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:21:45 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:21:45 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:21:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5691 values 89724 bits 11215 bytes 
Mon 20 Jan 2014 01:21:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:21:53 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:21:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:21:54 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:21:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:21:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:21:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:21:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:21:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:21:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:21:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:21:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:21:56 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:21:56 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:21:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:21:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:21:57 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:21:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 01:21:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:21:58 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:21:58 - job_xml_thread(): Done retrieving: data size 43564075
Mon 20 Jan 2014 01:21:58 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:21:58 - XML: Start document: iteration 1
Mon 20 Jan 2014 01:21:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564075
Mon 20 Jan 2014 01:21:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564075
Mon 20 Jan 2014 01:21:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:21:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:22:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:22:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:22:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:22:10 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:22:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:22:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:22:13 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:22:13 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:22:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:22:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:22:14 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:22:15 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 01:22:15 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:22:15 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:22:15 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:22:15 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:22:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:22:19 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:22:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:22:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:22:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:22:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:22:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:22:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:22:22 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:22:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560192
Mon 20 Jan 2014 01:22:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:22:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560192
Mon 20 Jan 2014 01:22:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:22:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:22:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:22:30 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:22:30 - job_xml_thread(): Done retrieving: data size 43560192
Mon 20 Jan 2014 01:22:30 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:22:30 - XML: Start document: iteration 2
Mon 20 Jan 2014 01:22:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:22:34 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:22:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:22:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:22:35 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:22:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:22:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:22:35 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:22:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:22:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:22:35 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:22:41 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 01:22:41 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:22:41 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:22:41 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:22:41 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:22:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:22:44 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:22:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:22:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:22:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:22:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:22:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:22:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:22:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:22:45 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:22:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:22:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 01:22:45 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:22:45 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:22:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 01:22:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99075 bits 12384 bytes 
Mon 20 Jan 2014 01:22:46 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:22:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571624
Mon 20 Jan 2014 01:22:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:22:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571624
Mon 20 Jan 2014 01:22:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:22:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:22:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:22:56 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:22:56 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:22:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:22:57 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:22:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:22:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:22:59 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:22:59 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:22:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:22:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:23:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:23:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:23:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:23:01 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:23:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:23:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:23:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:23:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:23:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:23:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:23:04 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:23:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 01:23:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:23:04 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:23:04 - job_xml_thread(): Done retrieving: data size 43559470
Mon 20 Jan 2014 01:23:04 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:23:04 - XML: Start document: iteration 3
Mon 20 Jan 2014 01:23:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559470
Mon 20 Jan 2014 01:23:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:23:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559470
Mon 20 Jan 2014 01:23:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:23:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:23:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:23:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:23:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:23:19 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 01:23:20 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:23:21 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:23:21 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 01:23:21 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:23:22 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 01:23:22 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 01:23:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:23:23 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:23:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:23:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:23:25 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:23:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:23:25 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:23:25 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:23:25 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 01:23:25 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:23:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:23:25 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:23:25 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:23:25 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:23:26 - size of cluster 'LISA Cluster': 624 hosts 79481 metrics 984334 values 15536690 bits 1942086 bytes 
Mon 20 Jan 2014 01:23:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:23:29 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:23:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:23:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:23:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:23:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:23:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:23:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:23:33 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:23:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43416998
Mon 20 Jan 2014 01:23:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:23:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43416998
Mon 20 Jan 2014 01:23:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:23:40 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:23:40 - job_xml_thread(): Done retrieving: data size 43416998
Mon 20 Jan 2014 01:23:40 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:23:40 - XML: Start document: iteration 4
Mon 20 Jan 2014 01:23:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:23:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:23:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:23:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:23:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:23:46 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:23:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:23:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 01:23:48 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:23:48 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:23:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6894 values 108749 bits 13593 bytes 
Mon 20 Jan 2014 01:23:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 01:23:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:23:51 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:23:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:23:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:23:51 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:23:51 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:23:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:23:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:23:51 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:23:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:23:55 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:23:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:23:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:23:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:23:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:23:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:23:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:23:57 - XML: Processed 651396 elements - found 0 jobs
Mon 20 Jan 2014 01:23:57 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:23:57 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:23:57 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:23:57 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:24:05 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:24:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42899613
Mon 20 Jan 2014 01:24:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:24:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42899613
Mon 20 Jan 2014 01:24:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:24:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:24:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:24:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:24:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:24:12 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:24:12 - job_xml_thread(): Done retrieving: data size 42899613
Mon 20 Jan 2014 01:24:12 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:24:12 - XML: Start document: iteration 5
Mon 20 Jan 2014 01:24:22 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:24:22 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 01:24:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:24:22 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:24:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:24:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:24:23 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:24:23 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:24:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:24:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:24:23 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:24:24 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:24:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 01:24:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:24:28 - XML: Processed 645204 elements - found 0 jobs
Mon 20 Jan 2014 01:24:28 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:24:28 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:24:28 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:24:28 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:24:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:24:28 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:24:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:24:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:24:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:24:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:24:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:24:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:24:32 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:24:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43147906
Mon 20 Jan 2014 01:24:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:24:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43147906
Mon 20 Jan 2014 01:24:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:24:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:24:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:24:43 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:24:43 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:24:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:24:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:24:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:24:45 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:24:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:24:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:24:46 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:24:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:24:46 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:24:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:24:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:24:47 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:24:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:24:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:24:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:24:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:24:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:24:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:24:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:24:48 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:24:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:24:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 01:24:48 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:24:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5730 values 90292 bits 11286 bytes 
Mon 20 Jan 2014 01:24:48 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:24:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 01:24:50 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:24:50 - job_xml_thread(): Done retrieving: data size 43537546
Mon 20 Jan 2014 01:24:50 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:24:50 - XML: Start document: iteration 6
Mon 20 Jan 2014 01:24:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43537546
Mon 20 Jan 2014 01:24:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:24:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43537546
Mon 20 Jan 2014 01:24:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:25:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:25:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:25:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:25:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:25:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:25:07 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:25:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:25:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:25:08 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:25:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:25:08 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:25:08 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:25:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:25:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:25:12 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:25:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:25:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:25:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:25:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:25:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:25:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:25:13 - XML: Processed 653028 elements - found 0 jobs
Mon 20 Jan 2014 01:25:13 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:25:13 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:25:13 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:25:13 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:25:17 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:25:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 01:25:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:25:19 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:25:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562784
Mon 20 Jan 2014 01:25:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:25:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562784
Mon 20 Jan 2014 01:25:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:25:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:25:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:25:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:25:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:25:28 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:25:28 - job_xml_thread(): Done retrieving: data size 43562784
Mon 20 Jan 2014 01:25:28 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:25:28 - XML: Start document: iteration 7
Mon 20 Jan 2014 01:25:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:25:36 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:25:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:25:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:25:37 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:25:37 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:25:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:25:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:25:37 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:25:41 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 01:25:41 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:25:41 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:25:41 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:25:41 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:25:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:25:44 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:25:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:25:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:25:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:25:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:25:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:25:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:25:48 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:25:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571095
Mon 20 Jan 2014 01:25:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:25:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:25:48 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:25:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571095
Mon 20 Jan 2014 01:25:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:25:50 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:25:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 01:25:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:25:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 01:25:50 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:25:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7983 values 125831 bits 15728 bytes 
Mon 20 Jan 2014 01:25:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:25:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:25:56 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:25:56 - job_xml_thread(): Done retrieving: data size 43571095
Mon 20 Jan 2014 01:25:56 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:25:56 - XML: Start document: iteration 8
Mon 20 Jan 2014 01:26:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:26:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:26:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:26:01 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:26:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:26:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:26:01 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:26:01 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:26:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:26:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:26:01 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:26:05 - XML: Processed 653350 elements - found 0 jobs
Mon 20 Jan 2014 01:26:05 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:26:05 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:26:05 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:26:05 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:26:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:26:12 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:26:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:26:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:26:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:26:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:26:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:26:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:26:16 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:26:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559233
Mon 20 Jan 2014 01:26:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:26:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:26:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:26:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559233
Mon 20 Jan 2014 01:26:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:26:20 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:26:20 - job_xml_thread(): Done retrieving: data size 43559233
Mon 20 Jan 2014 01:26:20 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:26:21 - XML: Start document: iteration 9
Mon 20 Jan 2014 01:26:22 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:26:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 01:26:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:26:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:26:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:26:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:26:38 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:26:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:26:38 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 01:26:38 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:26:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:26:38 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:26:38 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:26:39 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:26:39 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:26:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:26:39 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:26:39 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:26:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:26:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:26:39 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:26:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:26:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:26:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:26:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:26:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:26:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:26:43 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:26:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43599529
Mon 20 Jan 2014 01:26:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:26:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43599529
Mon 20 Jan 2014 01:26:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:26:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:26:50 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:26:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:26:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 01:26:50 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:26:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 01:26:50 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:26:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6225 values 98162 bits 12270 bytes 
Mon 20 Jan 2014 01:26:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:26:53 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:26:54 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:26:54 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:26:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:26:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:26:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:26:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:26:54 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:26:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:26:54 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:26:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:26:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:26:59 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:26:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:26:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:27:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:27:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:27:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:27:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:27:00 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 01:27:00 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 01:27:00 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:27:02 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:27:02 - job_xml_thread(): Done retrieving: data size 43583745
Mon 20 Jan 2014 01:27:02 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:27:02 - XML: Start document: iteration 10
Mon 20 Jan 2014 01:27:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583745
Mon 20 Jan 2014 01:27:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:27:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583745
Mon 20 Jan 2014 01:27:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:27:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:27:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:27:15 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 01:27:15 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:27:15 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:27:15 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:27:15 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:27:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:27:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:27:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:27:22 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:27:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:27:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:27:23 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:27:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:27:23 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:27:23 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:27:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:27:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:27:24 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:27:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:27:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:27:25 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:27:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 01:27:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:27:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:27:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:27:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:27:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:27:27 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:27:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43596279
Mon 20 Jan 2014 01:27:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:27:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43596279
Mon 20 Jan 2014 01:27:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:27:30 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:27:30 - job_xml_thread(): Done retrieving: data size 43596279
Mon 20 Jan 2014 01:27:30 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:27:30 - XML: Start document: iteration 11
Mon 20 Jan 2014 01:27:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:27:38 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:27:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:27:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:27:40 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:27:40 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:27:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:27:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:27:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:27:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:27:41 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:27:45 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 01:27:45 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:27:45 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:27:45 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:27:45 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:27:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:27:48 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:27:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:27:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:27:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:27:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:27:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:27:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:27:50 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:27:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558776
Mon 20 Jan 2014 01:27:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:27:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558776
Mon 20 Jan 2014 01:27:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:27:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:27:50 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:27:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:27:53 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:27:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 01:27:53 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:27:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 01:27:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:27:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:27:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8731 values 137690 bits 17211 bytes 
Mon 20 Jan 2014 01:27:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:27:59 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:27:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:27:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:28:00 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:28:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:28:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558776
Mon 20 Jan 2014 01:28:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:28:00 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:28:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:28:00 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:28:00 - job_xml_thread(): Done retrieving: data size 43558776
Mon 20 Jan 2014 01:28:00 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:28:00 - XML: Start document: iteration 12
Mon 20 Jan 2014 01:28:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:28:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:28:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:28:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:28:16 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 01:28:16 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:28:16 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:28:16 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:28:16 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:28:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:28:18 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:28:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:28:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:28:19 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:28:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:28:19 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:28:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:28:19 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:28:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:28:20 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:28:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:28:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:28:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:28:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:28:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:28:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:28:22 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:28:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43590325
Mon 20 Jan 2014 01:28:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:28:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43590325
Mon 20 Jan 2014 01:28:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:28:31 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:28:31 - job_xml_thread(): Done retrieving: data size 43590325
Mon 20 Jan 2014 01:28:31 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:28:31 - XML: Start document: iteration 13
Mon 20 Jan 2014 01:28:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:28:33 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:28:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:28:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:28:36 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:28:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:28:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:28:36 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:28:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:28:36 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:28:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:28:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:28:40 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:28:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:28:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:28:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:28:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:28:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:28:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:28:43 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 01:28:43 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:28:43 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:28:43 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:28:43 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:28:44 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:28:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 01:28:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:28:46 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:28:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577444
Mon 20 Jan 2014 01:28:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:28:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577444
Mon 20 Jan 2014 01:28:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:28:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:28:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:28:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:28:54 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:28:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:28:55 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:28:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 01:28:55 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:28:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5908 values 93163 bits 11645 bytes 
Mon 20 Jan 2014 01:28:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 01:28:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:28:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:28:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:28:56 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:28:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:28:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:28:58 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:28:58 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:28:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:28:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:28:58 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:28:58 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:29:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:29:00 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:29:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:29:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:29:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:29:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:29:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:29:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:29:03 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:29:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575892
Mon 20 Jan 2014 01:29:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:29:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575892
Mon 20 Jan 2014 01:29:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:29:04 - job_xml_thread(): Done retrieving: data size 43575892
Mon 20 Jan 2014 01:29:04 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:29:04 - XML: Start document: iteration 14
Mon 20 Jan 2014 01:29:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:29:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:29:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:29:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:29:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:29:22 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:29:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:29:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:29:22 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:29:22 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:29:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:29:22 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:29:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:29:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:29:26 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:29:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:29:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:29:27 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 01:29:27 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:29:27 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:29:27 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:29:27 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:29:27 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:29:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 01:29:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:29:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:29:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:29:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:29:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:29:29 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:29:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43522173
Mon 20 Jan 2014 01:29:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:29:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43522173
Mon 20 Jan 2014 01:29:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:29:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:29:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:29:42 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:29:42 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:29:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:29:43 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:29:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:29:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:29:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:29:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:29:43 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:29:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:29:43 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:29:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:29:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:29:44 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:29:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:29:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:29:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:29:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:29:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:29:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:29:46 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:29:46 - job_xml_thread(): Done retrieving: data size 42961088
Mon 20 Jan 2014 01:29:46 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:29:46 - XML: Start document: iteration 15
Mon 20 Jan 2014 01:29:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42961088
Mon 20 Jan 2014 01:29:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:29:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42961088
Mon 20 Jan 2014 01:29:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:29:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:29:55 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:29:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:29:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 01:29:56 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:29:56 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:29:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 01:29:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9021 values 142232 bits 17779 bytes 
Mon 20 Jan 2014 01:29:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:29:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:30:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:30:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:30:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:30:07 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:30:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:30:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:30:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:30:08 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:30:09 - XML: Processed 645698 elements - found 0 jobs
Mon 20 Jan 2014 01:30:09 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:30:09 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:30:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:30:09 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:30:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:30:09 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:30:09 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:30:09 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:30:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:30:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:30:09 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:30:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:30:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:30:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:30:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:30:11 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:30:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42932066
Mon 20 Jan 2014 01:30:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:30:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42932066
Mon 20 Jan 2014 01:30:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:30:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:30:22 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:30:22 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 01:30:22 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:30:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:30:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:30:24 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:30:24 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:30:24 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:30:24 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:30:24 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 01:30:24 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 01:30:24 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 01:30:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:30:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:30:25 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:30:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:30:25 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:30:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:30:26 - size of cluster 'LISA Cluster': 624 hosts 79486 metrics 912254 values 14381171 bits 1797646 bytes 
Mon 20 Jan 2014 01:30:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:30:27 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:30:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:30:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:30:27 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:30:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 01:30:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:30:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:30:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:30:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:30:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:30:31 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:30:31 - job_xml_thread(): Done retrieving: data size 43076571
Mon 20 Jan 2014 01:30:31 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:30:31 - XML: Start document: iteration 16
Mon 20 Jan 2014 01:30:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43076571
Mon 20 Jan 2014 01:30:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43076571
Mon 20 Jan 2014 01:30:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:30:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:30:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:30:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:30:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:30:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:30:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:30:50 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:30:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:30:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:30:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:30:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:30:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:30:52 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:30:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:30:54 - XML: Processed 647006 elements - found 0 jobs
Mon 20 Jan 2014 01:30:54 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:30:54 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:30:54 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:30:54 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:30:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:30:54 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:30:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:30:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:30:54 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:30:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:30:54 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:30:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:30:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:30:56 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:30:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:30:56 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:30:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 01:30:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 01:30:56 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:30:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5874 values 92628 bits 11578 bytes 
Mon 20 Jan 2014 01:30:57 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:30:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568864
Mon 20 Jan 2014 01:30:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:30:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568864
Mon 20 Jan 2014 01:30:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:31:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:31:05 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:31:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:31:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:31:09 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:31:09 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:31:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:31:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:31:09 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:31:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:31:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:31:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:31:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:31:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:31:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:31:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:31:10 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:31:10 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:31:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:31:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:31:15 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:31:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 01:31:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:31:15 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:31:15 - job_xml_thread(): Done retrieving: data size 43591269
Mon 20 Jan 2014 01:31:15 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:31:15 - XML: Start document: iteration 17
Mon 20 Jan 2014 01:31:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43591269
Mon 20 Jan 2014 01:31:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43591269
Mon 20 Jan 2014 01:31:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:31:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:31:24 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:31:24 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 01:31:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:31:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:31:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:31:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:31:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:31:36 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:31:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:31:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:31:38 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:31:38 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:31:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:31:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:31:38 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:31:38 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 01:31:38 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:31:38 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:31:38 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:31:38 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:31:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:31:40 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:31:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:31:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:31:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:31:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:31:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:31:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:31:44 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:31:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43586131
Mon 20 Jan 2014 01:31:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:31:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43586131
Mon 20 Jan 2014 01:31:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:31:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:31:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:31:53 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:31:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:31:54 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:31:54 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:31:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:31:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:31:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:31:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:31:55 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:31:55 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:31:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:31:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:31:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:31:57 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:31:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:31:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 01:31:58 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:31:58 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:31:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 01:31:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6888 values 108827 bits 13603 bytes 
Mon 20 Jan 2014 01:31:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:31:58 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:31:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:31:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:31:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:31:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:31:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:31:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:32:04 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:32:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 01:32:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:32:05 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:32:05 - job_xml_thread(): Done retrieving: data size 43571012
Mon 20 Jan 2014 01:32:05 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:32:05 - XML: Start document: iteration 18
Mon 20 Jan 2014 01:32:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571012
Mon 20 Jan 2014 01:32:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571012
Mon 20 Jan 2014 01:32:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:32:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:32:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:32:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:32:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:32:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:32:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:32:14 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:32:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:32:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:32:16 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:32:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:32:16 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:32:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:32:16 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:32:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:32:26 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:32:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:32:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:32:26 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 01:32:26 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:32:26 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:32:26 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:32:26 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:32:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:32:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:32:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:32:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:32:31 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:32:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571768
Mon 20 Jan 2014 01:32:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:32:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:32:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:32:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571768
Mon 20 Jan 2014 01:32:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:32:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:32:40 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:32:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:32:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:32:40 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:32:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:32:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571768
Mon 20 Jan 2014 01:32:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:32:40 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:32:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:32:41 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:32:41 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:32:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:32:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:32:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:32:51 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:32:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:32:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:32:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:32:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:32:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:32:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:32:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:32:53 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:32:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:32:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:32:55 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:32:55 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:32:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:32:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:32:57 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:32:57 - job_xml_thread(): Done retrieving: data size 43554804
Mon 20 Jan 2014 01:32:57 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:32:57 - XML: Start document: iteration 19
Mon 20 Jan 2014 01:32:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554804
Mon 20 Jan 2014 01:32:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:32:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554804
Mon 20 Jan 2014 01:32:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:32:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:32:58 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:32:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:32:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 01:33:00 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:33:00 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:33:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 01:33:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99356 bits 12419 bytes 
Mon 20 Jan 2014 01:33:07 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 01:33:07 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:33:07 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:33:07 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:33:07 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:33:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:33:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:33:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:33:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:33:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:33:20 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:33:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:33:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:33:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:33:21 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:33:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:33:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:33:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:33:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:33:21 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:33:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:33:21 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:33:21 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:33:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:33:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:33:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:33:22 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:33:26 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:33:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43595020
Mon 20 Jan 2014 01:33:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:33:26 - job_xml_thread(): Done retrieving: data size 43595020
Mon 20 Jan 2014 01:33:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43595020
Mon 20 Jan 2014 01:33:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:33:26 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:33:26 - XML: Start document: iteration 20
Mon 20 Jan 2014 01:33:30 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:33:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 01:33:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:33:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:33:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:33:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:33:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:33:40 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 01:33:40 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:33:40 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:33:40 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:33:40 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:33:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:33:45 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:33:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:33:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:33:46 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:33:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:33:46 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:33:46 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:33:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:33:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:33:49 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:33:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:33:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:33:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:33:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:33:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:33:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:33:52 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:33:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578529
Mon 20 Jan 2014 01:33:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:33:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578529
Mon 20 Jan 2014 01:33:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:33:55 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:33:55 - job_xml_thread(): Done retrieving: data size 43578529
Mon 20 Jan 2014 01:33:55 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:33:55 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 01:33:56 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 01:33:56 - Housekeeping: done.
Mon 20 Jan 2014 01:33:56 - XML: Start document: iteration 0
Mon 20 Jan 2014 01:34:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:34:01 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:34:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:34:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:34:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:34:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 01:34:02 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:34:02 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:34:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 01:34:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6341 values 100112 bits 12514 bytes 
Mon 20 Jan 2014 01:34:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:34:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:34:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:34:07 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:34:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:34:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:34:07 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:34:07 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:34:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:34:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:34:07 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:34:12 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 01:34:12 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:34:12 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:34:13 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:34:13 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:34:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:34:13 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:34:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:34:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:34:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:34:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:34:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:34:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:34:19 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:34:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557924
Mon 20 Jan 2014 01:34:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:34:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557924
Mon 20 Jan 2014 01:34:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:34:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:34:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:34:28 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:34:28 - job_xml_thread(): Done retrieving: data size 43557924
Mon 20 Jan 2014 01:34:28 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:34:28 - XML: Start document: iteration 1
Mon 20 Jan 2014 01:34:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:34:28 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:34:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:34:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:34:29 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:34:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:34:29 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:34:29 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:34:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:34:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:34:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:34:40 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 01:34:40 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:34:40 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:34:40 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:34:40 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:34:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:34:41 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:34:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:34:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:34:41 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:34:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 01:34:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:34:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:34:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:34:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:34:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:34:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:34:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:34:45 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:34:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561927
Mon 20 Jan 2014 01:34:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:34:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561927
Mon 20 Jan 2014 01:34:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:34:55 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:34:55 - job_xml_thread(): Done retrieving: data size 43561927
Mon 20 Jan 2014 01:34:55 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:34:55 - XML: Start document: iteration 2
Mon 20 Jan 2014 01:34:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:34:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:35:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:35:01 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:35:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:35:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:35:02 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:35:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:35:02 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:35:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:35:02 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:35:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:35:02 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:35:03 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:35:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 01:35:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:35:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 01:35:03 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:35:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5822 values 91847 bits 11480 bytes 
Mon 20 Jan 2014 01:35:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:35:08 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:35:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:35:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:35:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:35:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:35:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:35:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:35:09 - XML: Processed 653350 elements - found 0 jobs
Mon 20 Jan 2014 01:35:09 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:35:09 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:35:09 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:35:09 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:35:13 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:35:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571989
Mon 20 Jan 2014 01:35:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:35:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571989
Mon 20 Jan 2014 01:35:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:35:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:35:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:35:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:35:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:35:24 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:35:25 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:35:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:35:25 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:35:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:35:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:35:27 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:35:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:35:27 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:35:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:35:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:35:29 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:35:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:35:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:35:29 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:35:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 01:35:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:35:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:35:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:35:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:35:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:35:30 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 01:35:30 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 01:35:30 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:35:32 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:35:32 - job_xml_thread(): Done retrieving: data size 43339469
Mon 20 Jan 2014 01:35:32 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:35:32 - XML: Start document: iteration 3
Mon 20 Jan 2014 01:35:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43339469
Mon 20 Jan 2014 01:35:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:35:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43339469
Mon 20 Jan 2014 01:35:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:35:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:35:42 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:35:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:35:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:35:43 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:35:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:35:43 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:35:43 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:35:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:35:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:35:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:35:49 - XML: Processed 650540 elements - found 0 jobs
Mon 20 Jan 2014 01:35:49 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:35:49 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:35:49 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:35:49 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:35:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:35:52 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:35:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:35:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:35:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:35:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:35:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:35:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:35:55 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:35:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42937965
Mon 20 Jan 2014 01:35:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:35:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42937965
Mon 20 Jan 2014 01:35:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:35:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:35:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:36:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:36:04 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:36:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:36:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 01:36:04 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:36:04 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:36:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9034 values 142470 bits 17808 bytes 
Mon 20 Jan 2014 01:36:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 01:36:04 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:36:04 - job_xml_thread(): Done retrieving: data size 42937965
Mon 20 Jan 2014 01:36:04 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:36:04 - XML: Start document: iteration 4
Mon 20 Jan 2014 01:36:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:36:05 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:36:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:36:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:36:06 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:36:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:36:06 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:36:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:36:06 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:36:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:36:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:36:16 - XML: Processed 645534 elements - found 0 jobs
Mon 20 Jan 2014 01:36:16 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:36:16 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:36:16 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:36:16 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:36:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:36:18 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:36:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:36:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:36:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:36:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:36:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:36:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:36:20 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:36:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42949807
Mon 20 Jan 2014 01:36:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:36:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42949807
Mon 20 Jan 2014 01:36:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:36:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:36:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:36:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:36:29 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:36:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:36:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:36:29 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:36:29 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:36:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:36:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:36:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42949807
Mon 20 Jan 2014 01:36:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:36:31 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:36:31 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:36:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:36:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:36:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:36:39 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:36:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:36:41 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:36:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:36:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:36:42 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:36:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 01:36:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:36:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:36:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:36:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:36:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:36:43 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:36:43 - job_xml_thread(): Done retrieving: data size 43419580
Mon 20 Jan 2014 01:36:43 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:36:43 - XML: Start document: iteration 5
Mon 20 Jan 2014 01:36:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43419580
Mon 20 Jan 2014 01:36:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:36:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:36:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:36:45 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:36:45 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:36:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:36:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:36:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43419580
Mon 20 Jan 2014 01:36:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:36:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:36:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:36:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:36:58 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:37:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:37:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:37:01 - XML: Processed 651614 elements - found 0 jobs
Mon 20 Jan 2014 01:37:01 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:37:01 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:37:01 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:37:01 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:37:01 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:37:01 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:37:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:37:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:37:02 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:37:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:37:04 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:37:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:37:04 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:37:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:37:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:37:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:37:05 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:37:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 01:37:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 01:37:05 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:37:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5983 values 94356 bits 11794 bytes 
Mon 20 Jan 2014 01:37:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:37:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:37:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:37:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:37:06 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:37:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43587503
Mon 20 Jan 2014 01:37:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:37:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43587503
Mon 20 Jan 2014 01:37:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:37:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:37:16 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:37:16 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:37:16 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:37:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:37:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:37:17 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:37:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:37:17 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:37:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:37:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:37:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:37:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:37:21 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:37:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:37:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:37:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:37:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:37:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:37:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:37:22 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:37:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 01:37:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:37:23 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:37:23 - job_xml_thread(): Done retrieving: data size 43584852
Mon 20 Jan 2014 01:37:23 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:37:23 - XML: Start document: iteration 6
Mon 20 Jan 2014 01:37:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584852
Mon 20 Jan 2014 01:37:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:37:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584852
Mon 20 Jan 2014 01:37:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:37:25 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 01:37:25 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:37:26 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:37:26 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:37:26 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 01:37:26 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 01:37:26 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 01:37:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:37:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Mon 20 Jan 2014 01:37:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:37:36 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:37:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:37:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:37:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:37:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:37:36 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:37:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:37:36 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:37:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:37:36 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:37:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:37:45 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:37:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:37:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:37:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:37:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:37:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:37:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:37:46 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 01:37:46 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:37:46 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:37:46 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:37:46 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:37:48 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:37:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43548760
Mon 20 Jan 2014 01:37:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:37:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43548760
Mon 20 Jan 2014 01:37:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:37:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:37:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:38:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:38:00 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:38:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:38:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:38:01 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:38:02 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:38:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:38:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:38:02 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:38:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:38:02 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:38:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:38:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:38:03 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:38:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:38:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:38:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:38:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:38:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:38:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:38:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:38:05 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:38:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:38:05 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:38:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 01:38:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 01:38:05 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:38:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8239 values 129918 bits 16239 bytes 
Mon 20 Jan 2014 01:38:05 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:38:05 - job_xml_thread(): Done retrieving: data size 43583703
Mon 20 Jan 2014 01:38:05 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:38:05 - XML: Start document: iteration 7
Mon 20 Jan 2014 01:38:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583703
Mon 20 Jan 2014 01:38:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:38:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583703
Mon 20 Jan 2014 01:38:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:38:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:38:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:38:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:38:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:38:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:38:24 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:38:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:38:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:38:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:38:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:38:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:38:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:38:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:38:26 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:38:26 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:38:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:38:27 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:38:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:38:27 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:38:27 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 01:38:27 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:38:27 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:38:27 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:38:27 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:38:27 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:38:27 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:38:27 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:38:27 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:38:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:38:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:38:27 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 01:38:27 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 01:38:27 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 01:38:28 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 846693 values 13356769 bits 1669596 bytes 
Mon 20 Jan 2014 01:38:33 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:38:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571973
Mon 20 Jan 2014 01:38:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:38:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571973
Mon 20 Jan 2014 01:38:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:38:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:38:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:38:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:38:42 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:38:42 - job_xml_thread(): Done retrieving: data size 43571973
Mon 20 Jan 2014 01:38:42 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:38:42 - XML: Start document: iteration 8
Mon 20 Jan 2014 01:38:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:38:45 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:38:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 01:38:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:38:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:38:49 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:38:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:38:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:38:49 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:38:49 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:38:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:38:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:38:49 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:38:54 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 01:38:54 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:38:54 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:38:54 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:38:54 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:38:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:38:56 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:38:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:38:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:38:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:38:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:38:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:38:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:38:59 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:38:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578664
Mon 20 Jan 2014 01:38:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:38:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578664
Mon 20 Jan 2014 01:38:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:39:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:39:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:39:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:39:06 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:39:06 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:39:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:39:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 01:39:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 01:39:06 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:39:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6386 values 100707 bits 12588 bytes 
Mon 20 Jan 2014 01:39:09 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:39:09 - job_xml_thread(): Done retrieving: data size 43578664
Mon 20 Jan 2014 01:39:09 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:39:09 - XML: Start document: iteration 9
Mon 20 Jan 2014 01:39:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:39:10 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:39:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:39:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:39:10 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:39:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:39:10 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:39:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:39:10 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:39:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:39:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:39:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:39:16 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:39:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:39:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:39:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:39:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:39:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:39:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:39:21 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 01:39:21 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:39:21 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:39:21 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:39:21 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:39:25 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:39:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557867
Mon 20 Jan 2014 01:39:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:39:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557867
Mon 20 Jan 2014 01:39:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:39:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:39:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:39:27 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:39:27 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 01:39:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:39:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:39:36 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:39:36 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:39:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:39:37 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:39:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:39:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:39:38 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:39:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:39:38 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:39:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:39:40 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:39:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 01:39:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:39:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:39:42 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:39:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:39:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:39:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:39:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:39:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:39:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:39:45 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:39:45 - job_xml_thread(): Done retrieving: data size 43568896
Mon 20 Jan 2014 01:39:45 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:39:45 - XML: Start document: iteration 10
Mon 20 Jan 2014 01:39:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568896
Mon 20 Jan 2014 01:39:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:39:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568896
Mon 20 Jan 2014 01:39:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:39:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:39:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:39:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:39:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:40:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:40:00 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:40:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:40:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:40:01 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:40:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:40:01 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:40:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:40:01 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:40:03 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 01:40:03 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:40:03 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:40:03 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:40:03 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:40:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:40:07 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:40:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:40:07 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:40:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 01:40:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 01:40:07 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:40:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5885 values 92769 bits 11596 bytes 
Mon 20 Jan 2014 01:40:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:40:08 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:40:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:40:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:40:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:40:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:40:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:40:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:40:14 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:40:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564999
Mon 20 Jan 2014 01:40:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:40:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564999
Mon 20 Jan 2014 01:40:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:40:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:40:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:40:18 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:40:18 - job_xml_thread(): Done retrieving: data size 43564999
Mon 20 Jan 2014 01:40:18 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:40:18 - XML: Start document: iteration 11
Mon 20 Jan 2014 01:40:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:40:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:40:27 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:40:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 01:40:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:40:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:40:27 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:40:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:40:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:40:28 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:40:28 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:40:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:40:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:40:28 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:40:33 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 01:40:33 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:40:33 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:40:33 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:40:33 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:40:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:40:38 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:40:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:40:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:40:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:40:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:40:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:40:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:40:42 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:40:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563926
Mon 20 Jan 2014 01:40:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:40:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563926
Mon 20 Jan 2014 01:40:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:40:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:40:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:40:49 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:40:49 - job_xml_thread(): Done retrieving: data size 43563926
Mon 20 Jan 2014 01:40:49 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:40:49 - XML: Start document: iteration 12
Mon 20 Jan 2014 01:40:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:40:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:41:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:41:00 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:41:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:41:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:41:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:41:02 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:41:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:41:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:41:03 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:41:03 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:41:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:41:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:41:03 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:41:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:41:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:41:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:41:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:41:05 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 01:41:05 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:41:05 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:41:05 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:41:05 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:41:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:41:07 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:41:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:41:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 01:41:07 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:41:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6097 values 96148 bits 12018 bytes 
Mon 20 Jan 2014 01:41:07 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:41:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 01:41:09 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:41:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582857
Mon 20 Jan 2014 01:41:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:41:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582857
Mon 20 Jan 2014 01:41:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:41:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:41:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:41:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:41:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:41:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:41:18 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:41:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:41:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:41:19 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:41:19 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:41:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:41:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:41:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582857
Mon 20 Jan 2014 01:41:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:41:20 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:41:20 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:41:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:41:32 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:41:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:41:33 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:41:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:41:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:41:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:41:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:41:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:41:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:41:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:41:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:41:34 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:41:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:41:34 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:41:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:41:36 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:41:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 01:41:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:41:37 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 01:41:37 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 01:41:37 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:41:37 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:41:37 - job_xml_thread(): Done retrieving: data size 43478413
Mon 20 Jan 2014 01:41:37 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:41:37 - XML: Start document: iteration 13
Mon 20 Jan 2014 01:41:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43478413
Mon 20 Jan 2014 01:41:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43478413
Mon 20 Jan 2014 01:41:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:41:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:41:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:41:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:41:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:41:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:41:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:41:52 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:41:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:41:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:41:52 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:41:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:41:52 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:41:52 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:41:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:41:53 - XML: Processed 652598 elements - found 0 jobs
Mon 20 Jan 2014 01:41:53 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:41:53 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:41:53 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:41:53 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:41:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:41:58 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:41:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:41:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:41:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:41:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:41:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:41:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:42:00 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:42:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42909282
Mon 20 Jan 2014 01:42:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:42:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42909282
Mon 20 Jan 2014 01:42:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:42:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:42:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:42:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:42:08 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:42:08 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:42:08 - job_xml_thread(): Done retrieving: data size 42909282
Mon 20 Jan 2014 01:42:08 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:42:08 - XML: Start document: iteration 14
Mon 20 Jan 2014 01:42:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:42:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 01:42:09 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:42:09 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:42:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 01:42:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7242 values 114210 bits 14276 bytes 
Mon 20 Jan 2014 01:42:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:42:13 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:42:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:42:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:42:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:42:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:42:14 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:42:14 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:42:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:42:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:42:14 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:42:22 - XML: Processed 645234 elements - found 0 jobs
Mon 20 Jan 2014 01:42:22 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:42:22 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:42:22 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:42:22 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:42:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:42:24 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:42:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:42:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:42:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:42:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:42:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:42:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:42:26 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:42:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42972669
Mon 20 Jan 2014 01:42:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:42:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42972669
Mon 20 Jan 2014 01:42:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:42:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:42:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:42:37 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:42:37 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:42:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:42:38 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:42:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:42:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:42:39 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:42:39 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:42:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:42:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:42:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:42:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:42:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:42:42 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:42:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:42:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:42:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:42:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:42:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:42:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:42:42 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:42:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 01:42:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:42:44 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:42:44 - job_xml_thread(): Done retrieving: data size 43430033
Mon 20 Jan 2014 01:42:44 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:42:44 - XML: Start document: iteration 15
Mon 20 Jan 2014 01:42:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43430033
Mon 20 Jan 2014 01:42:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:42:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43430033
Mon 20 Jan 2014 01:42:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:42:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:42:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:42:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:42:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:43:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:43:02 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:43:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:43:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:43:03 - XML: Processed 651572 elements - found 0 jobs
Mon 20 Jan 2014 01:43:03 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:43:03 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:43:03 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:43:03 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:43:03 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:43:03 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:43:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:43:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:43:03 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:43:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:43:06 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:43:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:43:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:43:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:43:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:43:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:43:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:43:08 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:43:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43586405
Mon 20 Jan 2014 01:43:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:43:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43586405
Mon 20 Jan 2014 01:43:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:43:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:43:09 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:43:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:43:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 01:43:10 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:43:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 01:43:10 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:43:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8913 values 140560 bits 17570 bytes 
Mon 20 Jan 2014 01:43:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:43:16 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:43:18 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:43:18 - job_xml_thread(): Done retrieving: data size 43586405
Mon 20 Jan 2014 01:43:18 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:43:18 - XML: Start document: iteration 16
Mon 20 Jan 2014 01:43:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:43:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:43:18 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:43:18 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:43:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:43:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:43:18 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:43:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:43:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:43:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:43:27 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:43:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:43:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:43:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:43:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:43:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:43:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:43:30 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 01:43:30 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:43:30 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:43:30 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:43:30 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:43:32 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:43:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43539875
Mon 20 Jan 2014 01:43:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:43:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43539875
Mon 20 Jan 2014 01:43:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:43:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:43:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:43:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:43:42 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:43:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:43:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:43:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:43:43 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:43:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:43:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:43:43 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:43:43 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:43:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:43:43 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:43:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 01:43:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:43:45 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:43:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:43:46 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:43:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:43:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:43:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:43:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:43:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:43:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:43:48 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:43:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568364
Mon 20 Jan 2014 01:43:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:43:49 - job_xml_thread(): Done retrieving: data size 43568364
Mon 20 Jan 2014 01:43:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568364
Mon 20 Jan 2014 01:43:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:43:49 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:43:49 - XML: Start document: iteration 17
Mon 20 Jan 2014 01:43:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:43:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:44:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:44:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:44:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:44:05 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:44:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:44:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:44:07 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:44:07 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:44:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:44:07 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:44:07 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 01:44:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:44:07 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:44:07 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:44:07 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:44:07 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:44:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:44:10 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:44:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:44:10 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:44:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:44:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:44:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:44:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:44:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:44:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:44:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:44:11 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:44:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 01:44:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 01:44:11 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:44:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6122 values 96535 bits 12066 bytes 
Mon 20 Jan 2014 01:44:13 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:44:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584817
Mon 20 Jan 2014 01:44:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:44:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584817
Mon 20 Jan 2014 01:44:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:44:22 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:44:22 - job_xml_thread(): Done retrieving: data size 43584817
Mon 20 Jan 2014 01:44:22 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:44:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:44:22 - XML: Start document: iteration 18
Mon 20 Jan 2014 01:44:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:44:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:44:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:44:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:44:27 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:44:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:44:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:44:28 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:44:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:44:28 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:44:28 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:44:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:44:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:44:35 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:44:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:44:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:44:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:44:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:44:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:44:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:44:36 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 01:44:36 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:44:36 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:44:36 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:44:36 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:44:37 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:44:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 01:44:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:44:38 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:44:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568596
Mon 20 Jan 2014 01:44:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:44:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568596
Mon 20 Jan 2014 01:44:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:44:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:44:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:44:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:44:48 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:44:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:44:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:44:50 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:44:50 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:44:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:44:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:44:51 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:44:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:44:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:44:51 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:44:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:44:53 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:44:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:44:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:44:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:44:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:44:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:44:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:44:55 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:44:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43596397
Mon 20 Jan 2014 01:44:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:44:56 - job_xml_thread(): Done retrieving: data size 43596397
Mon 20 Jan 2014 01:44:56 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:44:56 - XML: Start document: iteration 19
Mon 20 Jan 2014 01:44:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43596397
Mon 20 Jan 2014 01:44:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:45:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:45:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:45:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:45:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:45:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:45:08 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:45:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:45:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:45:09 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:45:09 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:45:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:45:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:45:09 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:45:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:45:11 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:45:12 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:45:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:45:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 01:45:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 01:45:12 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:45:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8308 values 130930 bits 16366 bytes 
Mon 20 Jan 2014 01:45:16 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 01:45:16 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:45:16 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:45:16 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:45:16 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:45:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:45:19 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:45:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:45:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:45:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:45:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:45:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:45:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:45:22 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:45:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559150
Mon 20 Jan 2014 01:45:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:45:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559150
Mon 20 Jan 2014 01:45:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:45:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:45:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:45:28 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 01:45:28 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:45:29 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:45:29 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:45:29 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 01:45:29 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 01:45:29 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 01:45:31 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:45:31 - job_xml_thread(): Done retrieving: data size 43559150
Mon 20 Jan 2014 01:45:31 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:45:31 - XML: Start document: iteration 20
Mon 20 Jan 2014 01:45:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:45:34 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:45:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:45:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:45:34 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:45:34 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:45:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:45:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:45:34 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:45:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:45:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:45:35 - size of cluster 'LISA Cluster': 624 hosts 79472 metrics 868847 values 13698760 bits 1712345 bytes 
Mon 20 Jan 2014 01:45:41 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 01:45:41 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:45:41 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:45:41 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:45:41 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:45:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:45:45 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:45:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:45:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:45:46 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:45:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 01:45:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:45:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:45:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:45:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:45:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:45:49 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:45:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43548482
Mon 20 Jan 2014 01:45:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:45:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43548482
Mon 20 Jan 2014 01:45:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:45:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:45:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:45:56 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:45:56 - job_xml_thread(): Done retrieving: data size 43548482
Mon 20 Jan 2014 01:45:56 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:45:56 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 01:45:56 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 01:45:56 - Housekeeping: done.
Mon 20 Jan 2014 01:45:56 - XML: Start document: iteration 0
Mon 20 Jan 2014 01:46:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:46:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:46:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:46:02 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:46:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:46:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:46:04 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:46:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:46:04 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:46:04 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:46:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:46:09 - XML: Processed 653349 elements - found 0 jobs
Mon 20 Jan 2014 01:46:09 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:46:09 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:46:09 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:46:09 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:46:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:46:12 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:46:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:46:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:46:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:46:12 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:46:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:46:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:46:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:46:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:46:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:46:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 01:46:13 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:46:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 01:46:13 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:46:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5649 values 89046 bits 11130 bytes 
Mon 20 Jan 2014 01:46:15 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:46:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555043
Mon 20 Jan 2014 01:46:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:46:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555043
Mon 20 Jan 2014 01:46:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:46:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:46:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:46:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:46:22 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:46:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:46:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:46:24 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:46:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:46:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555043
Mon 20 Jan 2014 01:46:24 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:46:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:46:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:46:25 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:46:25 - job_xml_thread(): Done retrieving: data size 43555043
Mon 20 Jan 2014 01:46:25 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:46:25 - XML: Start document: iteration 1
Mon 20 Jan 2014 01:46:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:46:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:46:29 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:46:29 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 01:46:36 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 01:46:36 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:46:36 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:46:36 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:46:36 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:46:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:46:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:46:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:46:41 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:46:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:46:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:46:42 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:46:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:46:42 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:46:42 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:46:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:46:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:46:43 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:46:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:46:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:46:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:46:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:46:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:46:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:46:44 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:46:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 01:46:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:46:47 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:46:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582103
Mon 20 Jan 2014 01:46:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:46:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582103
Mon 20 Jan 2014 01:46:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:46:51 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:46:51 - job_xml_thread(): Done retrieving: data size 43582103
Mon 20 Jan 2014 01:46:51 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:46:52 - XML: Start document: iteration 2
Mon 20 Jan 2014 01:46:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:46:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:46:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:46:57 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:46:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:46:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:46:58 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:46:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:46:58 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:46:58 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:46:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:46:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:46:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:47:07 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 01:47:07 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:47:07 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:47:07 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:47:07 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:47:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:47:09 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:47:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:47:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:47:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:47:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:47:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:47:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:47:12 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:47:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559926
Mon 20 Jan 2014 01:47:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:47:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:47:13 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:47:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:47:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:47:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:47:13 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:47:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 01:47:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 01:47:13 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:47:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559926
Mon 20 Jan 2014 01:47:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7261 values 114788 bits 14348 bytes 
Mon 20 Jan 2014 01:47:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:47:22 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:47:22 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:47:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:47:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:47:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:47:25 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:47:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:47:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:47:25 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:47:25 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:47:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:47:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:47:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:47:30 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:47:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:47:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:47:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:47:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:47:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:47:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:47:35 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:47:35 - job_xml_thread(): Done retrieving: data size 43486469
Mon 20 Jan 2014 01:47:35 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:47:35 - XML: Start document: iteration 3
Mon 20 Jan 2014 01:47:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43486469
Mon 20 Jan 2014 01:47:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:47:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43486469
Mon 20 Jan 2014 01:47:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:47:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:47:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:47:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:47:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:47:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:47:50 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:47:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:47:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:47:51 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:47:51 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:47:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:47:51 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:47:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:47:53 - XML: Processed 652590 elements - found 0 jobs
Mon 20 Jan 2014 01:47:53 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:47:53 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:47:53 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:47:53 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:47:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:47:59 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:47:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:47:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:47:59 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:47:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 01:47:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:47:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:47:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:47:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:47:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:48:02 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:48:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42895612
Mon 20 Jan 2014 01:48:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:48:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42895612
Mon 20 Jan 2014 01:48:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:48:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:48:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:48:08 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:48:08 - job_xml_thread(): Done retrieving: data size 42895612
Mon 20 Jan 2014 01:48:08 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:48:08 - XML: Start document: iteration 4
Mon 20 Jan 2014 01:48:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:48:12 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:48:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:48:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:48:13 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:48:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:48:13 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:48:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:48:13 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:48:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:48:13 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:48:14 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:48:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 01:48:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:48:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 01:48:14 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:48:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5701 values 90066 bits 11258 bytes 
Mon 20 Jan 2014 01:48:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:48:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:48:22 - XML: Processed 645188 elements - found 0 jobs
Mon 20 Jan 2014 01:48:22 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:48:23 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:48:23 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:48:23 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:48:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:48:26 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:48:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:48:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:48:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:48:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:48:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:48:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:48:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:48:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:48:29 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:48:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43099429
Mon 20 Jan 2014 01:48:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:48:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43099429
Mon 20 Jan 2014 01:48:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:48:38 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:48:38 - job_xml_thread(): Done retrieving: data size 43099429
Mon 20 Jan 2014 01:48:38 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:48:38 - XML: Start document: iteration 5
Mon 20 Jan 2014 01:48:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:48:40 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:48:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:48:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:48:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:48:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:48:42 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:48:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:48:42 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:48:42 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:48:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:48:46 - XML: Processed 647668 elements - found 0 jobs
Mon 20 Jan 2014 01:48:46 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:48:46 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:48:46 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:48:46 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:48:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:48:51 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:48:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:48:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:48:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:48:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:48:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:48:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:48:51 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:48:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 01:48:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:48:54 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:48:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43519512
Mon 20 Jan 2014 01:48:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:48:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43519512
Mon 20 Jan 2014 01:48:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:48:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:48:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:49:01 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:49:01 - job_xml_thread(): Done retrieving: data size 43519512
Mon 20 Jan 2014 01:49:01 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:49:01 - XML: Start document: iteration 6
Mon 20 Jan 2014 01:49:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:49:06 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:49:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:49:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:49:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:49:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:49:07 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:49:07 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:49:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:49:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:49:07 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:49:12 - XML: Processed 652822 elements - found 0 jobs
Mon 20 Jan 2014 01:49:12 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:49:12 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:49:12 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:49:12 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:49:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:49:14 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:49:14 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:49:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:49:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 01:49:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 01:49:14 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:49:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5646 values 89051 bits 11131 bytes 
Mon 20 Jan 2014 01:49:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:49:17 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:49:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:49:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:49:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:49:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:49:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:49:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:49:21 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:49:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43547645
Mon 20 Jan 2014 01:49:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:49:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43547645
Mon 20 Jan 2014 01:49:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:49:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:49:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:49:28 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:49:28 - job_xml_thread(): Done retrieving: data size 43547645
Mon 20 Jan 2014 01:49:28 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:49:28 - XML: Start document: iteration 7
Mon 20 Jan 2014 01:49:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:49:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:49:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:49:35 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:49:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:49:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:49:35 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:49:35 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:49:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:49:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:49:35 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:49:40 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:49:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 01:49:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:49:42 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 01:49:42 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:49:42 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:49:42 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:49:42 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:49:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:49:45 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:49:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:49:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:49:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:49:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:49:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:49:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:49:48 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:49:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43544314
Mon 20 Jan 2014 01:49:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:49:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43544314
Mon 20 Jan 2014 01:49:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:49:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:49:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:49:57 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:49:57 - job_xml_thread(): Done retrieving: data size 43544314
Mon 20 Jan 2014 01:49:57 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:49:57 - XML: Start document: iteration 8
Mon 20 Jan 2014 01:50:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:50:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:50:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:50:06 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:50:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:50:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:50:08 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:50:08 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:50:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:50:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:50:08 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:50:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:50:09 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:50:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:50:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:50:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:50:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:50:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:50:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:50:11 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 01:50:11 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:50:11 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:50:11 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:50:11 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:50:14 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:50:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575268
Mon 20 Jan 2014 01:50:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:50:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575268
Mon 20 Jan 2014 01:50:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:50:14 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:50:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:50:14 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:50:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:50:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 01:50:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 01:50:14 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:50:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6175 values 97372 bits 12171 bytes 
Mon 20 Jan 2014 01:50:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:50:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:50:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:50:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:50:26 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:50:26 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:50:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:50:28 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:50:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:50:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:50:29 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:50:29 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:50:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:50:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:50:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:50:31 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:50:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:50:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:50:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:50:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:50:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:50:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:50:33 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 01:50:33 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 01:50:33 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:50:34 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:50:34 - job_xml_thread(): Done retrieving: data size 43571162
Mon 20 Jan 2014 01:50:34 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:50:34 - XML: Start document: iteration 9
Mon 20 Jan 2014 01:50:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571162
Mon 20 Jan 2014 01:50:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:50:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571162
Mon 20 Jan 2014 01:50:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:50:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:50:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:50:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:50:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:50:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:50:50 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:50:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:50:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:50:51 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:50:51 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:50:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:50:51 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:50:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:50:52 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 01:50:52 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:50:52 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:50:52 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:50:52 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:50:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:50:57 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:50:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:50:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:50:57 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:50:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 01:50:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:50:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:50:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:50:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:50:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:50:59 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:50:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560382
Mon 20 Jan 2014 01:50:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:51:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560382
Mon 20 Jan 2014 01:51:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:51:07 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:51:07 - job_xml_thread(): Done retrieving: data size 43560382
Mon 20 Jan 2014 01:51:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:51:07 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:51:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:51:07 - XML: Start document: iteration 10
Mon 20 Jan 2014 01:51:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:51:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:51:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:51:14 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:51:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:51:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:51:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:51:15 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:51:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:51:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 01:51:15 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:51:15 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:51:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 01:51:15 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:51:15 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:51:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:51:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:51:15 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:51:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5665 values 89317 bits 11164 bytes 
Mon 20 Jan 2014 01:51:19 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 01:51:19 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:51:19 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:51:19 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:51:19 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:51:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:51:23 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:51:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:51:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:51:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:51:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:51:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:51:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:51:25 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:51:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577515
Mon 20 Jan 2014 01:51:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:51:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577515
Mon 20 Jan 2014 01:51:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:51:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:51:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:51:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:51:34 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:51:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:51:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:51:35 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:51:35 - job_xml_thread(): Done retrieving: data size 43577515
Mon 20 Jan 2014 01:51:35 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:51:35 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:51:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:51:35 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:51:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577515
Mon 20 Jan 2014 01:51:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:51:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:51:35 - XML: Start document: iteration 11
Mon 20 Jan 2014 01:51:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:51:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:51:47 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 01:51:47 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:51:47 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:51:47 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:51:47 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:51:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:51:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:51:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:51:53 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:51:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:51:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:51:54 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:51:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:51:54 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:51:54 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:51:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:51:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:51:55 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:51:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:51:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:51:55 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:51:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 01:51:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:51:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:51:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:51:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:51:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:51:57 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:51:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583722
Mon 20 Jan 2014 01:51:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:51:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583722
Mon 20 Jan 2014 01:51:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:52:02 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:52:02 - job_xml_thread(): Done retrieving: data size 43583722
Mon 20 Jan 2014 01:52:02 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:52:02 - XML: Start document: iteration 12
Mon 20 Jan 2014 01:52:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:52:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:52:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:52:10 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:52:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:52:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:52:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:52:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:52:12 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:52:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:52:12 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:52:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:52:12 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:52:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:52:15 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:52:16 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 01:52:16 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:52:16 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:52:16 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:52:16 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:52:16 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:52:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 01:52:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:52:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 01:52:16 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:52:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6009 values 94794 bits 11849 bytes 
Mon 20 Jan 2014 01:52:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:52:19 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:52:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:52:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:52:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:52:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:52:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:52:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:52:22 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:52:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570277
Mon 20 Jan 2014 01:52:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:52:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570277
Mon 20 Jan 2014 01:52:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:52:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:52:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:52:29 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 01:52:29 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:52:30 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:52:30 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:52:30 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 01:52:30 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 01:52:30 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 01:52:31 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:52:31 - job_xml_thread(): Done retrieving: data size 43570277
Mon 20 Jan 2014 01:52:31 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:52:31 - XML: Start document: iteration 13
Mon 20 Jan 2014 01:52:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:52:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:52:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:52:38 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:52:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:52:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:52:39 - size of cluster 'LISA Cluster': 624 hosts 79478 metrics 743619 values 11737225 bits 1467153 bytes 
Mon 20 Jan 2014 01:52:40 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:52:40 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:52:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:52:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:52:40 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:52:46 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 01:52:46 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:52:47 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:52:47 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:52:47 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:52:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:52:47 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:52:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:52:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:52:47 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:52:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 01:52:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:52:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:52:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:52:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:52:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:52:50 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:52:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566380
Mon 20 Jan 2014 01:52:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:52:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566380
Mon 20 Jan 2014 01:52:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:52:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:52:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:53:02 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:53:03 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:53:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:53:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:53:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:53:05 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:53:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:53:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:53:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:53:05 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:53:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:53:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:53:06 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:53:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:53:06 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:53:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:53:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:53:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:53:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:53:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:53:09 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:53:09 - job_xml_thread(): Done retrieving: data size 43583344
Mon 20 Jan 2014 01:53:09 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:53:09 - XML: Start document: iteration 14
Mon 20 Jan 2014 01:53:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583344
Mon 20 Jan 2014 01:53:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583344
Mon 20 Jan 2014 01:53:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:53:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:53:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:53:17 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:53:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:53:17 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:53:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:53:17 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:53:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 01:53:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 01:53:18 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:53:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8828 values 139207 bits 17400 bytes 
Mon 20 Jan 2014 01:53:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:53:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:53:21 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:53:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:53:21 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:53:21 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:53:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:53:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:53:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:53:28 - XML: Processed 653190 elements - found 0 jobs
Mon 20 Jan 2014 01:53:28 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:53:28 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:53:28 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:53:28 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:53:30 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:53:30 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 01:53:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:53:32 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:53:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:53:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:53:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:53:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:53:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:53:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:53:34 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:53:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43481848
Mon 20 Jan 2014 01:53:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:53:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43481848
Mon 20 Jan 2014 01:53:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:53:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:53:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:53:43 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:53:43 - job_xml_thread(): Done retrieving: data size 43481848
Mon 20 Jan 2014 01:53:43 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:53:43 - XML: Start document: iteration 15
Mon 20 Jan 2014 01:53:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:53:47 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:53:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:53:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:53:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:53:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:53:48 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:53:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:53:48 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:53:48 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:53:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:53:55 - XML: Processed 652598 elements - found 0 jobs
Mon 20 Jan 2014 01:53:55 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:53:55 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:53:55 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:53:55 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:53:57 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:53:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 01:53:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:53:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:53:58 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:53:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:53:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:53:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:53:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:53:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:53:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:54:01 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:54:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42900632
Mon 20 Jan 2014 01:54:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:54:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42900632
Mon 20 Jan 2014 01:54:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:54:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:54:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:54:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:54:10 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:54:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:54:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:54:10 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:54:10 - job_xml_thread(): Done retrieving: data size 42900632
Mon 20 Jan 2014 01:54:10 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:54:10 - XML: Start document: iteration 16
Mon 20 Jan 2014 01:54:11 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:54:11 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:54:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:54:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:54:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42900632
Mon 20 Jan 2014 01:54:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:54:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:54:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:54:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:54:18 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:54:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:54:18 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:54:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 01:54:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 01:54:18 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:54:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5605 values 88340 bits 11042 bytes 
Mon 20 Jan 2014 01:54:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:54:26 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:54:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:54:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:54:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:54:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:54:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:54:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:54:27 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:54:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:54:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:54:30 - XML: Processed 645302 elements - found 0 jobs
Mon 20 Jan 2014 01:54:30 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:54:30 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:54:30 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:54:30 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:54:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:54:31 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:54:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:54:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:54:31 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:54:31 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:54:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:54:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:54:35 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:54:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43224166
Mon 20 Jan 2014 01:54:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:54:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43224166
Mon 20 Jan 2014 01:54:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:54:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:54:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:54:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:54:44 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:54:45 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:54:45 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:54:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:54:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:54:47 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:54:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:54:47 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:54:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:54:47 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:54:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 01:54:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:54:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:54:51 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:54:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:54:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:54:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:54:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:54:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:54:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:54:55 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:54:55 - job_xml_thread(): Done retrieving: data size 43533745
Mon 20 Jan 2014 01:54:55 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:54:55 - XML: Start document: iteration 17
Mon 20 Jan 2014 01:54:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43533745
Mon 20 Jan 2014 01:54:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:54:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43533745
Mon 20 Jan 2014 01:54:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:55:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:55:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:55:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:55:07 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:55:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:55:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:55:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:55:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:55:08 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:55:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:55:08 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:55:08 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:55:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:55:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:55:16 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:55:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:55:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:55:17 - XML: Processed 652786 elements - found 0 jobs
Mon 20 Jan 2014 01:55:17 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:55:17 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:55:17 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:55:17 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:55:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:55:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:55:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:55:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:55:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:55:19 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:55:19 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:55:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:55:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 01:55:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 01:55:20 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:55:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5988 values 94465 bits 11808 bytes 
Mon 20 Jan 2014 01:55:20 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:55:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43548253
Mon 20 Jan 2014 01:55:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:55:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43548253
Mon 20 Jan 2014 01:55:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:55:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:55:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:55:32 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:55:32 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:55:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:55:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:55:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:55:32 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:55:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:55:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:55:33 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:55:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:55:33 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:55:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:55:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:55:37 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:55:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:55:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:55:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:55:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:55:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:55:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:55:41 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:55:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 01:55:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:55:41 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:55:41 - job_xml_thread(): Done retrieving: data size 43576630
Mon 20 Jan 2014 01:55:41 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:55:41 - XML: Start document: iteration 18
Mon 20 Jan 2014 01:55:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576630
Mon 20 Jan 2014 01:55:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:55:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576630
Mon 20 Jan 2014 01:55:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:55:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:55:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:55:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:55:53 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:55:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:55:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:55:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:55:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:55:54 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:55:55 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:55:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:55:55 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:55:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:55:59 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 01:55:59 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:55:59 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:55:59 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:55:59 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:56:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:56:04 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:56:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:56:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:56:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:56:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:56:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:56:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:56:07 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:56:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562760
Mon 20 Jan 2014 01:56:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:56:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562760
Mon 20 Jan 2014 01:56:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:56:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:56:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:56:14 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:56:14 - job_xml_thread(): Done retrieving: data size 43562760
Mon 20 Jan 2014 01:56:15 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:56:15 - XML: Start document: iteration 19
Mon 20 Jan 2014 01:56:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:56:19 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:56:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:56:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:56:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:56:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:56:20 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:56:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:56:21 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:56:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:56:21 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:56:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:56:21 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:56:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:56:21 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:56:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 01:56:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 01:56:21 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:56:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6739 values 106296 bits 13287 bytes 
Mon 20 Jan 2014 01:56:29 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 01:56:29 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:56:29 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:56:29 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:56:29 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:56:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:56:29 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:56:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:56:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:56:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:56:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:56:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:56:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:56:33 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:56:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553899
Mon 20 Jan 2014 01:56:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:56:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553899
Mon 20 Jan 2014 01:56:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:56:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:56:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:56:38 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:56:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 01:56:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:56:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:56:44 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:56:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:56:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:56:44 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:56:44 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:56:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:56:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:56:45 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:56:45 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:56:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:56:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:56:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:56:47 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:56:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:56:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:56:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:56:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:56:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:56:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:56:50 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:56:50 - job_xml_thread(): Done retrieving: data size 43590153
Mon 20 Jan 2014 01:56:50 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:56:50 - XML: Start document: iteration 20
Mon 20 Jan 2014 01:56:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43590153
Mon 20 Jan 2014 01:56:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:56:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43590153
Mon 20 Jan 2014 01:56:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:57:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:57:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:57:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:57:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:57:04 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 01:57:04 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:57:04 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:57:04 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:57:04 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:57:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:57:09 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:57:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:57:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:57:10 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:57:10 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:57:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:57:10 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:57:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:57:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:57:13 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:57:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:57:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:57:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:57:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:57:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:57:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:57:17 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:57:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572611
Mon 20 Jan 2014 01:57:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:57:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572611
Mon 20 Jan 2014 01:57:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:57:19 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:57:19 - job_xml_thread(): Done retrieving: data size 43572611
Mon 20 Jan 2014 01:57:19 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:57:19 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 01:57:20 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 01:57:20 - Housekeeping: done.
Mon 20 Jan 2014 01:57:20 - XML: Start document: iteration 0
Mon 20 Jan 2014 01:57:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:57:22 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:57:24 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:57:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 01:57:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:57:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 01:57:25 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:57:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9392 values 148142 bits 18517 bytes 
Mon 20 Jan 2014 01:57:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:57:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:57:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:57:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:57:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:57:36 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:57:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:57:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:57:37 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:57:37 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:57:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:57:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:57:37 - XML: Processed 653349 elements - found 0 jobs
Mon 20 Jan 2014 01:57:37 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:57:37 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:57:37 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:57:37 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:57:37 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:57:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:57:41 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:57:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:57:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:57:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:57:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:57:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:57:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:57:45 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:57:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581699
Mon 20 Jan 2014 01:57:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:57:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581699
Mon 20 Jan 2014 01:57:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:57:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:57:52 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:57:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:57:52 - job_xml_thread(): Done retrieving: data size 43581699
Mon 20 Jan 2014 01:57:52 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:57:52 - XML: Start document: iteration 1
Mon 20 Jan 2014 01:57:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:57:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:58:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:58:04 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:58:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:58:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:58:05 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:58:05 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:58:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:58:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:58:05 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:58:05 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:58:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 01:58:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:58:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:58:05 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:58:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:58:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:58:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:58:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:58:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:58:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:58:08 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 01:58:08 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:58:08 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:58:08 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:58:08 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:58:10 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 01:58:10 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 01:58:10 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:58:11 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:58:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43591922
Mon 20 Jan 2014 01:58:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:58:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43591922
Mon 20 Jan 2014 01:58:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:58:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:58:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:58:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:58:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:58:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:58:22 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:58:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:58:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:58:23 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:58:23 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:58:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:58:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:58:23 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:58:23 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:58:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:58:24 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:58:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:58:24 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:58:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:58:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:58:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:58:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 01:58:25 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:58:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 01:58:25 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:58:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5976 values 94268 bits 11783 bytes 
Mon 20 Jan 2014 01:58:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:58:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:58:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:58:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:58:26 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:58:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43595782
Mon 20 Jan 2014 01:58:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:58:26 - job_xml_thread(): Done retrieving: data size 43595782
Mon 20 Jan 2014 01:58:27 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:58:27 - XML: Start document: iteration 2
Mon 20 Jan 2014 01:58:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43595782
Mon 20 Jan 2014 01:58:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:58:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:58:37 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:58:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:58:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:58:39 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:58:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:58:39 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:58:39 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:58:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:58:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:58:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:58:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:58:49 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:58:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:58:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:58:50 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 01:58:50 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:58:50 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:58:50 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:58:50 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:58:50 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:58:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 01:58:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:58:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:58:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:58:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:58:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:58:51 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:58:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562851
Mon 20 Jan 2014 01:58:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:58:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562851
Mon 20 Jan 2014 01:58:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:58:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:58:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:59:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:59:02 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:59:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:59:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:59:03 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:59:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:59:03 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:59:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:59:04 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:59:05 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:59:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:59:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:59:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:59:06 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:59:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:59:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:59:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:59:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:59:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:59:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:59:07 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:59:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43541852
Mon 20 Jan 2014 01:59:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:59:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43541852
Mon 20 Jan 2014 01:59:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:59:08 - job_xml_thread(): Done retrieving: data size 43541852
Mon 20 Jan 2014 01:59:08 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:59:08 - XML: Start document: iteration 3
Mon 20 Jan 2014 01:59:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:59:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:59:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:59:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:59:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:59:21 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:59:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:59:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:59:22 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:59:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:59:22 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:59:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:59:22 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:59:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:59:25 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:59:26 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:59:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 01:59:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:59:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 01:59:26 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:59:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8338 values 131577 bits 16447 bytes 
Mon 20 Jan 2014 01:59:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:59:30 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:59:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:59:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:59:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:59:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:59:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:59:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:59:30 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 01:59:30 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:59:31 - XML: Processed 652602 elements - found 0 jobs
Mon 20 Jan 2014 01:59:31 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 01:59:31 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 01:59:31 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 01:59:31 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 01:59:31 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:59:31 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:59:31 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 01:59:31 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 01:59:31 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 01:59:32 - size of cluster 'LISA Cluster': 624 hosts 79486 metrics 749358 values 11817875 bits 1477234 bytes 
Mon 20 Jan 2014 01:59:35 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:59:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43485179
Mon 20 Jan 2014 01:59:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:59:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43485179
Mon 20 Jan 2014 01:59:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 01:59:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 01:59:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:59:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 01:59:45 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 01:59:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 01:59:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:59:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 01:59:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 01:59:45 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:59:45 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 01:59:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 01:59:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 01:59:45 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 01:59:46 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 01:59:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 01:59:51 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 01:59:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 01:59:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 01:59:51 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 01:59:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 01:59:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 01:59:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:59:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 01:59:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 01:59:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 01:59:54 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 01:59:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42935287
Mon 20 Jan 2014 01:59:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 01:59:54 - job_xml_thread(): Done retrieving: data size 42935287
Mon 20 Jan 2014 01:59:54 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 01:59:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42935287
Mon 20 Jan 2014 01:59:54 - XML: Start document: iteration 4
Mon 20 Jan 2014 01:59:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:00:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:00:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:00:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:00:06 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:00:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:00:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:00:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:00:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:00:07 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:00:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:00:07 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:00:07 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:00:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:00:12 - XML: Processed 645444 elements - found 0 jobs
Mon 20 Jan 2014 02:00:12 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:00:12 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:00:12 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:00:12 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:00:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:00:15 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:00:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:00:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:00:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:00:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:00:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:00:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:00:18 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:00:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42950424
Mon 20 Jan 2014 02:00:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:00:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42950424
Mon 20 Jan 2014 02:00:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:00:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:00:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:00:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:00:26 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:00:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:00:26 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:00:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 02:00:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 02:00:26 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:00:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8658 values 136520 bits 17065 bytes 
Mon 20 Jan 2014 02:00:27 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:00:27 - job_xml_thread(): Done retrieving: data size 42950424
Mon 20 Jan 2014 02:00:27 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:00:27 - XML: Start document: iteration 5
Mon 20 Jan 2014 02:00:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:00:28 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:00:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:00:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:00:29 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:00:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:00:29 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:00:29 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:00:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:00:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:00:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:00:31 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:00:31 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 02:00:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:00:38 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:00:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:00:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:00:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:00:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:00:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:00:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:00:42 - XML: Processed 645902 elements - found 0 jobs
Mon 20 Jan 2014 02:00:42 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:00:42 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:00:42 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:00:42 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:00:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:00:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:00:44 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:00:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43365618
Mon 20 Jan 2014 02:00:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:00:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43365618
Mon 20 Jan 2014 02:00:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:00:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:00:54 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:00:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:00:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:00:54 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:00:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:00:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43365618
Mon 20 Jan 2014 02:00:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:00:54 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:00:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:00:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:00:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:00:57 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:00:57 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:01:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:01:06 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:01:06 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:01:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 02:01:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:01:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:01:07 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:01:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:01:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:01:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:01:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:01:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:01:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:01:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:01:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:01:10 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:01:10 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:01:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:01:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:01:10 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:01:10 - job_xml_thread(): Done retrieving: data size 43564723
Mon 20 Jan 2014 02:01:10 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:01:10 - XML: Start document: iteration 6
Mon 20 Jan 2014 02:01:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564723
Mon 20 Jan 2014 02:01:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:01:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564723
Mon 20 Jan 2014 02:01:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:01:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:01:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:01:24 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:01:24 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:01:24 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:01:24 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:01:24 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:01:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:01:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:01:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:01:27 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:01:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:01:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 02:01:28 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:01:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 02:01:28 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:01:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6059 values 95611 bits 11951 bytes 
Mon 20 Jan 2014 02:01:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:01:28 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:01:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:01:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:01:28 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:01:28 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:01:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:01:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:01:28 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:01:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:01:34 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:01:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:01:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:01:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:01:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:01:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:01:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:01:38 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:01:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574420
Mon 20 Jan 2014 02:01:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:01:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574420
Mon 20 Jan 2014 02:01:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:01:39 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:01:40 - job_xml_thread(): Done retrieving: data size 43574420
Mon 20 Jan 2014 02:01:40 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:01:40 - XML: Start document: iteration 7
Mon 20 Jan 2014 02:01:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:01:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:01:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:01:49 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:01:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:01:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:01:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:01:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:01:51 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:01:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:01:51 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:01:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:01:51 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:01:58 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:01:58 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:01:58 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:01:58 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:01:58 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:02:00 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:02:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 02:02:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:02:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:02:01 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:02:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:02:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:02:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:02:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:02:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:02:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:02:04 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:02:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553846
Mon 20 Jan 2014 02:02:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:02:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553846
Mon 20 Jan 2014 02:02:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:02:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:02:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:02:13 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:02:13 - job_xml_thread(): Done retrieving: data size 43553846
Mon 20 Jan 2014 02:02:13 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:02:13 - XML: Start document: iteration 8
Mon 20 Jan 2014 02:02:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:02:16 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:02:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:02:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:02:16 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:02:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:02:16 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:02:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:02:16 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:02:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:02:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:02:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:02:25 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:02:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:02:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:02:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:02:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:02:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:02:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:02:27 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:02:27 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:02:27 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:02:27 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:02:27 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:02:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:02:28 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:02:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:02:28 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:02:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 02:02:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 02:02:28 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:02:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5821 values 92049 bits 11506 bytes 
Mon 20 Jan 2014 02:02:31 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:02:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43545674
Mon 20 Jan 2014 02:02:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:02:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:02:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:02:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43545674
Mon 20 Jan 2014 02:02:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:02:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:02:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:02:42 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:02:42 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:02:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:02:45 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:02:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:02:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:02:45 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:02:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:02:45 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:02:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:02:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:02:48 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:02:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:02:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:02:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:02:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:02:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:02:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:02:49 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:02:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 02:02:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:02:51 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:02:51 - job_xml_thread(): Done retrieving: data size 43577456
Mon 20 Jan 2014 02:02:51 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:02:51 - XML: Start document: iteration 9
Mon 20 Jan 2014 02:02:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577456
Mon 20 Jan 2014 02:02:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:02:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577456
Mon 20 Jan 2014 02:02:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:03:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:03:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:03:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:03:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:03:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:03:05 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:03:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:03:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:03:05 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:03:05 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:03:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:03:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:03:06 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:03:09 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:03:09 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:03:09 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:03:09 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:03:09 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:03:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:03:13 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:03:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:03:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:03:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:03:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:03:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:03:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:03:16 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:03:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555228
Mon 20 Jan 2014 02:03:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:03:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555228
Mon 20 Jan 2014 02:03:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:03:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:03:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:03:25 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:03:25 - job_xml_thread(): Done retrieving: data size 43555228
Mon 20 Jan 2014 02:03:25 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:03:25 - XML: Start document: iteration 10
Mon 20 Jan 2014 02:03:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:03:28 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:03:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:03:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:03:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:03:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 02:03:30 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:03:30 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:03:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 02:03:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8423 values 133150 bits 16643 bytes 
Mon 20 Jan 2014 02:03:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:03:32 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:03:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:03:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:03:33 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:03:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:03:33 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:03:33 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:03:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:03:39 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:03:39 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:03:39 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:03:39 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:03:39 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:03:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:03:41 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:03:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:03:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:03:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:03:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:03:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:03:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:03:45 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:03:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558472
Mon 20 Jan 2014 02:03:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:03:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558472
Mon 20 Jan 2014 02:03:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:03:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:03:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:03:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:03:53 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:03:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:03:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:03:54 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:03:54 - job_xml_thread(): Done retrieving: data size 43558472
Mon 20 Jan 2014 02:03:54 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:03:54 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:03:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:03:54 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:03:54 - XML: Start document: iteration 11
Mon 20 Jan 2014 02:03:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:03:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558472
Mon 20 Jan 2014 02:03:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:03:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:03:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:04:00 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:04:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 02:04:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:04:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:04:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:04:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:04:10 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:04:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:04:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:04:11 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:04:11 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:04:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:04:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:04:11 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:04:13 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:04:13 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:04:13 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:04:13 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:04:13 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:04:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:04:15 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:04:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:04:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:04:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:04:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:04:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:04:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:04:17 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:04:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568324
Mon 20 Jan 2014 02:04:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:04:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568324
Mon 20 Jan 2014 02:04:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:04:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:04:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:04:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:04:27 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:04:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:04:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:04:27 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:04:27 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:04:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:04:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:04:27 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:04:28 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:04:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:04:30 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:04:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:04:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 02:04:30 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:04:30 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:04:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6240 values 98445 bits 12305 bytes 
Mon 20 Jan 2014 02:04:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 02:04:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:04:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:04:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:04:31 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:04:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:04:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:04:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:04:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:04:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:04:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:04:32 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 02:04:32 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 02:04:32 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:04:34 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:04:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576124
Mon 20 Jan 2014 02:04:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:04:34 - job_xml_thread(): Done retrieving: data size 43576124
Mon 20 Jan 2014 02:04:34 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:04:34 - XML: Start document: iteration 12
Mon 20 Jan 2014 02:04:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576124
Mon 20 Jan 2014 02:04:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:04:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:04:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:04:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:04:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:04:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:04:48 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:04:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:04:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:04:49 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:04:49 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:04:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:04:49 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:04:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:04:55 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:04:55 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:04:55 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:04:55 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:04:55 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:04:57 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:04:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 02:04:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:04:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:04:58 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:04:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:04:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:04:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:04:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:04:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:04:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:04:59 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:04:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554004
Mon 20 Jan 2014 02:04:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:05:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554004
Mon 20 Jan 2014 02:05:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:05:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:05:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:05:10 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:05:10 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:05:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:05:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:05:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:05:13 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:05:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:05:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:05:14 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:05:14 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:05:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:05:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:05:14 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:05:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:05:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:05:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:05:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:05:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:05:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:05:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:05:15 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:05:15 - job_xml_thread(): Done retrieving: data size 43502419
Mon 20 Jan 2014 02:05:15 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:05:15 - XML: Start document: iteration 13
Mon 20 Jan 2014 02:05:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43502419
Mon 20 Jan 2014 02:05:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:05:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43502419
Mon 20 Jan 2014 02:05:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:05:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:05:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:05:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:05:30 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:05:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:05:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:05:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:05:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:05:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:05:30 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:05:31 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:05:31 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:05:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:05:31 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:05:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:05:31 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:05:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:05:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 02:05:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 02:05:31 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:05:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8983 values 141702 bits 17712 bytes 
Mon 20 Jan 2014 02:05:36 - XML: Processed 652602 elements - found 0 jobs
Mon 20 Jan 2014 02:05:36 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:05:36 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:05:36 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:05:36 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:05:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:05:39 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:05:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:05:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:05:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:05:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:05:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:05:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:05:41 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:05:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43050631
Mon 20 Jan 2014 02:05:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:05:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43050631
Mon 20 Jan 2014 02:05:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:05:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:05:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:05:51 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:05:51 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:05:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:05:52 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:05:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:05:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:05:53 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:05:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:05:53 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:05:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:05:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:05:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:05:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:05:55 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:05:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:05:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:05:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:05:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:05:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:05:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:05:56 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:05:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 02:05:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:05:57 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:05:57 - job_xml_thread(): Done retrieving: data size 42920262
Mon 20 Jan 2014 02:05:57 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:05:57 - XML: Start document: iteration 14
Mon 20 Jan 2014 02:05:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42920262
Mon 20 Jan 2014 02:05:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42920262
Mon 20 Jan 2014 02:05:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:05:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:06:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:06:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:06:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:06:09 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:06:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:06:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:06:10 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:06:10 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:06:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:06:10 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:06:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:06:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:06:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:06:18 - XML: Processed 645280 elements - found 0 jobs
Mon 20 Jan 2014 02:06:18 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:06:18 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:06:18 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:06:18 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:06:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:06:19 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:06:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:06:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:06:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:06:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:06:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:06:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:06:20 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:06:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42955371
Mon 20 Jan 2014 02:06:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:06:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42955371
Mon 20 Jan 2014 02:06:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:06:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:06:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:06:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:06:30 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:06:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:06:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:06:31 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 02:06:31 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:06:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:06:31 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:06:31 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:06:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:06:31 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:06:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:06:31 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:06:32 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:06:32 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:06:32 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 02:06:32 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 02:06:33 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 02:06:33 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:06:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:06:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 02:06:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 02:06:33 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:06:33 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:06:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8709 values 137394 bits 17174 bytes 
Mon 20 Jan 2014 02:06:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:06:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:06:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:06:36 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:06:36 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 799053 values 12617303 bits 1577162 bytes 
Mon 20 Jan 2014 02:06:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:06:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:06:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:06:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:06:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:06:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:06:40 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:06:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43267428
Mon 20 Jan 2014 02:06:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:06:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43267428
Mon 20 Jan 2014 02:06:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:06:41 - job_xml_thread(): Done retrieving: data size 43267428
Mon 20 Jan 2014 02:06:41 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:06:42 - XML: Start document: iteration 15
Mon 20 Jan 2014 02:06:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:06:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:06:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:06:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:06:57 - XML: Processed 649459 elements - found 0 jobs
Mon 20 Jan 2014 02:06:57 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:06:57 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:06:57 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:06:57 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:07:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:07:00 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:07:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:07:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:07:00 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:07:00 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:07:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:07:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:07:00 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:07:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:07:03 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:07:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:07:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:07:03 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:07:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 02:07:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:07:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:07:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:07:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:07:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:07:06 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:07:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581799
Mon 20 Jan 2014 02:07:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:07:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581799
Mon 20 Jan 2014 02:07:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:07:12 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:07:12 - job_xml_thread(): Done retrieving: data size 43581799
Mon 20 Jan 2014 02:07:12 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:07:12 - XML: Start document: iteration 16
Mon 20 Jan 2014 02:07:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:07:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:07:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:07:18 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:07:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:07:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:07:18 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:07:18 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:07:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:07:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:07:18 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:07:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:07:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:07:30 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:07:30 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:07:30 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:07:30 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:07:30 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:07:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:07:30 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:07:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:07:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:07:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:07:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:07:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:07:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:07:33 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:07:33 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 02:07:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:07:33 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:07:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:07:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:07:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:07:33 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:07:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 02:07:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 02:07:33 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:07:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5713 values 90067 bits 11258 bytes 
Mon 20 Jan 2014 02:07:33 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:07:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43539609
Mon 20 Jan 2014 02:07:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:07:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43539609
Mon 20 Jan 2014 02:07:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:07:45 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:07:45 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:07:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:07:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:07:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:07:46 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:07:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:07:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:07:47 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:07:47 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:07:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:07:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:07:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:07:49 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:07:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:07:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:07:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:07:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:07:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:07:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:07:53 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:07:53 - job_xml_thread(): Done retrieving: data size 43582778
Mon 20 Jan 2014 02:07:53 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:07:53 - XML: Start document: iteration 17
Mon 20 Jan 2014 02:07:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582778
Mon 20 Jan 2014 02:07:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582778
Mon 20 Jan 2014 02:07:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:07:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:08:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:08:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:08:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:08:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:08:08 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:08:08 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:08:08 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:08:08 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:08:08 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:08:12 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:08:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 02:08:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:08:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:08:13 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:08:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:08:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:08:14 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:08:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:08:14 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:08:14 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:08:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:08:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:08:16 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:08:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:08:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:08:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:08:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:08:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:08:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:08:20 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:08:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43585027
Mon 20 Jan 2014 02:08:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:08:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43585027
Mon 20 Jan 2014 02:08:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:08:23 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:08:23 - job_xml_thread(): Done retrieving: data size 43585027
Mon 20 Jan 2014 02:08:23 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:08:23 - XML: Start document: iteration 18
Mon 20 Jan 2014 02:08:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:08:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:08:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:08:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:08:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:08:34 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:08:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:08:34 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:08:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 02:08:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 02:08:34 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:08:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6123 values 96561 bits 12070 bytes 
Mon 20 Jan 2014 02:08:38 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:08:38 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:08:38 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:08:38 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:08:38 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:08:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:08:42 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:08:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:08:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:08:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:08:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:08:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:08:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:08:42 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:08:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:08:44 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:08:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:08:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:08:44 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:08:44 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:08:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:08:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:08:47 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:08:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43587678
Mon 20 Jan 2014 02:08:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:08:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43587678
Mon 20 Jan 2014 02:08:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:08:54 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:08:54 - job_xml_thread(): Done retrieving: data size 43587678
Mon 20 Jan 2014 02:08:54 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:08:55 - XML: Start document: iteration 19
Mon 20 Jan 2014 02:08:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:08:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:08:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:08:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:09:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:09:07 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:09:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:09:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:09:09 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:09:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:09:09 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:09:09 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:09:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:09:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:09:09 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:09:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:09:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:09:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:09:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:09:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:09:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:09:12 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:09:12 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:09:12 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:09:12 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:09:12 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:09:12 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:09:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 02:09:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:09:15 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:09:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575953
Mon 20 Jan 2014 02:09:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:09:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575953
Mon 20 Jan 2014 02:09:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:09:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:09:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:09:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:09:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:09:27 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:09:27 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:09:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:09:27 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:09:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:09:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:09:27 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:09:27 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:09:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:09:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:09:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:09:31 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:09:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:09:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:09:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:09:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:09:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:09:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:09:33 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:09:33 - job_xml_thread(): Done retrieving: data size 43585371
Mon 20 Jan 2014 02:09:33 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:09:33 - XML: Start document: iteration 20
Mon 20 Jan 2014 02:09:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:09:34 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:09:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43585371
Mon 20 Jan 2014 02:09:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43585371
Mon 20 Jan 2014 02:09:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:09:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:09:35 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:09:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 02:09:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:09:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 02:09:37 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:09:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6831 values 107744 bits 13468 bytes 
Mon 20 Jan 2014 02:09:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:09:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:09:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:09:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:09:52 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:09:52 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:09:52 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:09:52 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:09:52 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:09:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:09:56 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:09:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:09:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:09:56 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:09:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:09:56 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:09:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:09:56 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:09:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:09:58 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:09:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:09:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:09:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:09:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:09:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:09:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:10:01 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:10:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583442
Mon 20 Jan 2014 02:10:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:10:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583442
Mon 20 Jan 2014 02:10:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:10:07 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:10:07 - job_xml_thread(): Done retrieving: data size 43583442
Mon 20 Jan 2014 02:10:07 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:10:07 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 02:10:07 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 02:10:07 - Housekeeping: done.
Mon 20 Jan 2014 02:10:07 - XML: Start document: iteration 0
Mon 20 Jan 2014 02:10:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:10:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:10:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:10:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:10:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:10:14 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:10:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:10:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:10:14 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:10:14 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:10:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:10:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:10:14 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:10:20 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:10:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 02:10:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:10:22 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:10:22 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:10:22 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:10:22 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:10:22 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:10:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:10:23 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:10:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:10:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:10:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:10:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:10:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:10:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:10:27 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:10:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43546184
Mon 20 Jan 2014 02:10:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:10:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43546184
Mon 20 Jan 2014 02:10:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:10:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:10:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:10:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:10:36 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:10:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:10:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 02:10:37 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:10:37 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:10:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 02:10:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5823 values 91835 bits 11479 bytes 
Mon 20 Jan 2014 02:10:37 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:10:38 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:10:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:10:38 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:10:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:10:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:10:39 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:10:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:10:39 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:10:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:10:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:10:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:10:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:10:43 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:10:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:10:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:10:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:10:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:10:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:10:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:10:48 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 02:10:48 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 02:10:48 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:10:48 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:10:48 - job_xml_thread(): Done retrieving: data size 43572638
Mon 20 Jan 2014 02:10:48 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:10:48 - XML: Start document: iteration 1
Mon 20 Jan 2014 02:10:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572638
Mon 20 Jan 2014 02:10:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:10:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572638
Mon 20 Jan 2014 02:10:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:10:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:10:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:10:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:10:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:11:03 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:11:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 02:11:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:11:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:11:03 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:11:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:11:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:11:04 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:11:04 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:11:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:11:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:11:04 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:11:09 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:11:09 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:11:09 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:11:09 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:11:09 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:11:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:11:10 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:11:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:11:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:11:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:11:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:11:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:11:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:11:12 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:11:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43494380
Mon 20 Jan 2014 02:11:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:11:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43494380
Mon 20 Jan 2014 02:11:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:11:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:11:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:11:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:11:21 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:11:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:11:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:11:21 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:11:21 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:11:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:11:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:11:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43494380
Mon 20 Jan 2014 02:11:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:11:24 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:11:24 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:11:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:11:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:11:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:11:31 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:11:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:11:32 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:11:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:11:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:11:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:11:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:11:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:11:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:11:34 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:11:34 - job_xml_thread(): Done retrieving: data size 43449050
Mon 20 Jan 2014 02:11:34 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:11:34 - XML: Start document: iteration 2
Mon 20 Jan 2014 02:11:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43449050
Mon 20 Jan 2014 02:11:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:11:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:11:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:11:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:11:37 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:11:37 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:11:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:11:37 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:11:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:11:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43449050
Mon 20 Jan 2014 02:11:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:11:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:11:39 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:11:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 02:11:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 02:11:39 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:11:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6092 values 96065 bits 12008 bytes 
Mon 20 Jan 2014 02:11:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:11:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:11:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:11:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:11:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:11:54 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:11:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:11:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:11:55 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:11:55 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:11:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:11:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:11:55 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:11:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:11:56 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:11:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:11:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:11:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:11:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:11:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:11:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:11:57 - XML: Processed 651920 elements - found 0 jobs
Mon 20 Jan 2014 02:11:57 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:11:57 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:11:57 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:11:57 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:11:59 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:11:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42916164
Mon 20 Jan 2014 02:11:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:12:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42916164
Mon 20 Jan 2014 02:12:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:12:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:12:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:12:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:12:11 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:12:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:12:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:12:11 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:12:11 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:12:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:12:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:12:11 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:12:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:12:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:12:12 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:12:14 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:12:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 02:12:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:12:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:12:15 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:12:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:12:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:12:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:12:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:12:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:12:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:12:17 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:12:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42978097
Mon 20 Jan 2014 02:12:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:12:17 - job_xml_thread(): Done retrieving: data size 42978097
Mon 20 Jan 2014 02:12:17 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:12:17 - XML: Start document: iteration 3
Mon 20 Jan 2014 02:12:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42978097
Mon 20 Jan 2014 02:12:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:12:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:12:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:12:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:12:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:12:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:12:36 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:12:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:12:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:12:36 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:12:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:12:36 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:12:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:12:37 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:12:37 - XML: Processed 645828 elements - found 0 jobs
Mon 20 Jan 2014 02:12:37 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:12:37 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:12:37 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:12:37 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:12:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:12:38 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:12:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:12:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:12:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:12:39 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:12:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:12:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:12:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:12:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:12:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:12:40 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:12:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 02:12:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 02:12:40 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:12:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6013 values 94842 bits 11855 bytes 
Mon 20 Jan 2014 02:12:40 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:12:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43394157
Mon 20 Jan 2014 02:12:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:12:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43394157
Mon 20 Jan 2014 02:12:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:12:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:12:51 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:12:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:12:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:12:52 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:12:52 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:12:52 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:12:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:12:52 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:12:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:12:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:12:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:12:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:12:55 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:12:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:12:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:12:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:12:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:12:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:12:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:12:57 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:12:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 02:12:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:12:57 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:12:57 - job_xml_thread(): Done retrieving: data size 43558923
Mon 20 Jan 2014 02:12:57 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:12:57 - XML: Start document: iteration 4
Mon 20 Jan 2014 02:12:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558923
Mon 20 Jan 2014 02:12:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:12:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558923
Mon 20 Jan 2014 02:12:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:13:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:13:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:13:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:13:10 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:13:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:13:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:13:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:13:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:13:12 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:13:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:13:12 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:13:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:13:12 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:13:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:13:20 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:13:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:13:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:13:20 - XML: Processed 653248 elements - found 0 jobs
Mon 20 Jan 2014 02:13:20 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:13:20 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:13:20 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:13:20 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:13:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:13:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:13:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:13:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:13:22 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:13:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564470
Mon 20 Jan 2014 02:13:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:13:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564470
Mon 20 Jan 2014 02:13:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:13:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:13:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:13:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:13:31 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:13:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:13:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:13:32 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:13:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:13:32 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:13:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:13:33 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:13:33 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 02:13:33 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:13:34 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:13:34 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:13:34 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 02:13:34 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 02:13:34 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 02:13:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:13:35 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:13:35 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:13:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:13:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:13:36 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 792706 values 12497260 bits 1562157 bytes 
Mon 20 Jan 2014 02:13:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:13:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:13:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:13:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:13:39 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:13:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571999
Mon 20 Jan 2014 02:13:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:13:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571999
Mon 20 Jan 2014 02:13:40 - job_xml_thread(): Done retrieving: data size 43571999
Mon 20 Jan 2014 02:13:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:13:40 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:13:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:13:40 - XML: Start document: iteration 5
Mon 20 Jan 2014 02:13:41 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:13:41 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:13:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 02:13:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:13:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 02:13:42 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:13:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 10051 values 158504 bits 19813 bytes 
Mon 20 Jan 2014 02:13:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:13:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:13:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:13:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:13:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:13:52 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:13:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:13:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:13:53 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:13:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:13:53 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:13:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:13:53 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:14:00 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:14:00 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:14:00 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:14:00 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:14:00 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:14:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:14:04 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:14:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:14:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:14:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:14:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:14:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:14:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:14:07 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:14:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562277
Mon 20 Jan 2014 02:14:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:14:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562277
Mon 20 Jan 2014 02:14:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:14:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:14:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:14:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:14:15 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:14:15 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:14:15 - job_xml_thread(): Done retrieving: data size 43562277
Mon 20 Jan 2014 02:14:15 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:14:15 - XML: Start document: iteration 6
Mon 20 Jan 2014 02:14:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:14:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:14:17 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:14:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:14:17 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:14:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:14:17 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:14:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:14:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:14:26 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:14:26 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:14:26 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:14:26 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:14:26 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:14:27 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:14:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 02:14:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:14:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:14:29 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:14:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:14:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:14:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:14:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:14:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:14:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:14:32 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:14:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553827
Mon 20 Jan 2014 02:14:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:14:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:14:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:14:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553827
Mon 20 Jan 2014 02:14:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:14:34 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:14:34 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 02:14:41 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:14:41 - job_xml_thread(): Done retrieving: data size 43553827
Mon 20 Jan 2014 02:14:41 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:14:41 - XML: Start document: iteration 7
Mon 20 Jan 2014 02:14:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:14:42 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:14:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:14:43 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:14:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 02:14:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 02:14:43 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:14:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6050 values 95410 bits 11926 bytes 
Mon 20 Jan 2014 02:14:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:14:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:14:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:14:53 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:14:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:14:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:14:54 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:14:54 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:14:54 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:14:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:14:54 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:14:54 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:14:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:14:54 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:14:54 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:14:54 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:14:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:14:56 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:14:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:14:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:14:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:14:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:14:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:14:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:15:00 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:15:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580930
Mon 20 Jan 2014 02:15:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:15:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580930
Mon 20 Jan 2014 02:15:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:15:09 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:15:09 - job_xml_thread(): Done retrieving: data size 43580930
Mon 20 Jan 2014 02:15:09 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:15:09 - XML: Start document: iteration 8
Mon 20 Jan 2014 02:15:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:15:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:15:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:15:11 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:15:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:15:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:15:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:15:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:15:12 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:15:12 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:15:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:15:12 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:15:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:15:20 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:15:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 02:15:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:15:23 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:15:23 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:15:23 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:15:23 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:15:23 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:15:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:15:24 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:15:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:15:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:15:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:15:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:15:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:15:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:15:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:15:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:15:27 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:15:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43542515
Mon 20 Jan 2014 02:15:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:15:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43542515
Mon 20 Jan 2014 02:15:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:15:38 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:15:38 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:15:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:15:39 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:15:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:15:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:15:39 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:15:39 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:15:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:15:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:15:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:15:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:15:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:15:42 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:15:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:15:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:15:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:15:43 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:15:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:15:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:15:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:15:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:15:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:15:43 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:15:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 02:15:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 02:15:43 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:15:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5809 values 91571 bits 11446 bytes 
Mon 20 Jan 2014 02:15:46 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:15:46 - job_xml_thread(): Done retrieving: data size 43576025
Mon 20 Jan 2014 02:15:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576025
Mon 20 Jan 2014 02:15:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:15:46 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:15:46 - XML: Start document: iteration 9
Mon 20 Jan 2014 02:15:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576025
Mon 20 Jan 2014 02:15:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:15:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:15:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:15:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:15:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:16:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:16:05 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:16:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:16:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:16:06 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:16:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:16:06 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:16:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:16:06 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:16:07 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:16:07 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:16:07 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:16:07 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:16:07 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:16:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:16:09 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:16:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:16:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:16:10 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:16:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 02:16:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:16:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:16:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:16:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:16:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:16:13 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:16:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569331
Mon 20 Jan 2014 02:16:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:16:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569331
Mon 20 Jan 2014 02:16:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:16:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:16:22 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:16:22 - job_xml_thread(): Done retrieving: data size 43569331
Mon 20 Jan 2014 02:16:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:16:23 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:16:23 - XML: Start document: iteration 10
Mon 20 Jan 2014 02:16:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:16:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:16:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:16:29 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:16:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:16:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:16:31 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:16:31 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:16:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:16:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:16:32 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:16:36 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:16:36 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:16:36 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:16:36 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:16:36 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:16:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:16:36 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:16:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:16:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:16:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:16:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:16:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:16:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:16:40 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:16:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576444
Mon 20 Jan 2014 02:16:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:16:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576444
Mon 20 Jan 2014 02:16:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:16:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:16:43 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:16:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:16:44 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:16:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 02:16:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 02:16:45 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:16:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8208 values 129676 bits 16209 bytes 
Mon 20 Jan 2014 02:16:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:16:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:16:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:16:49 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:16:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:16:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:16:50 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:16:50 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:16:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:16:50 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:16:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:16:51 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:16:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:16:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:16:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:16:54 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:16:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:16:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:16:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:16:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:16:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:16:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:16:58 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:16:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571537
Mon 20 Jan 2014 02:16:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:16:58 - job_xml_thread(): Done retrieving: data size 43571537
Mon 20 Jan 2014 02:16:58 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:16:58 - XML: Start document: iteration 11
Mon 20 Jan 2014 02:16:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571537
Mon 20 Jan 2014 02:16:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:17:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:17:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:17:05 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:17:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 02:17:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:17:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:17:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:17:15 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:17:15 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:17:15 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:17:15 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:17:15 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:17:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:17:18 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:17:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:17:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:17:19 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:17:19 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:17:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:17:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:17:19 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:17:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:17:22 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:17:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:17:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:17:22 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 02:17:22 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 02:17:22 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:17:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:17:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:17:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:17:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:17:24 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:17:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43524044
Mon 20 Jan 2014 02:17:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:17:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43524044
Mon 20 Jan 2014 02:17:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:17:30 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:17:30 - job_xml_thread(): Done retrieving: data size 43524044
Mon 20 Jan 2014 02:17:30 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:17:30 - XML: Start document: iteration 12
Mon 20 Jan 2014 02:17:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:17:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:17:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:17:36 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:17:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:17:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:17:36 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:17:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:17:36 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:17:36 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:17:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:17:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:17:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:17:43 - XML: Processed 652601 elements - found 0 jobs
Mon 20 Jan 2014 02:17:43 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:17:43 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:17:43 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:17:43 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:17:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:17:45 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:17:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:17:45 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:17:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:17:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:17:45 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:17:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 02:17:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:17:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 02:17:45 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:17:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6188 values 97855 bits 12231 bytes 
Mon 20 Jan 2014 02:17:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:17:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:17:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:17:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:17:47 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:17:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42996517
Mon 20 Jan 2014 02:17:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:17:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42996517
Mon 20 Jan 2014 02:17:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:17:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:17:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:17:58 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:17:58 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:18:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:18:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:18:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:18:02 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:18:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:18:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:18:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:18:03 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:18:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:18:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:18:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:18:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:18:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:18:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:18:03 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:18:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:18:03 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:18:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:18:03 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:18:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 02:18:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:18:05 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:18:05 - job_xml_thread(): Done retrieving: data size 42929745
Mon 20 Jan 2014 02:18:05 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:18:05 - XML: Start document: iteration 13
Mon 20 Jan 2014 02:18:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42929745
Mon 20 Jan 2014 02:18:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:18:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42929745
Mon 20 Jan 2014 02:18:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:18:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:18:17 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:18:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:18:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:18:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:18:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:18:19 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:18:19 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:18:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:18:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:18:19 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:18:22 - XML: Processed 645164 elements - found 0 jobs
Mon 20 Jan 2014 02:18:22 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:18:22 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:18:22 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:18:22 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:18:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:18:27 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:18:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:18:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:18:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:18:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:18:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:18:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:18:28 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:18:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42962494
Mon 20 Jan 2014 02:18:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:18:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42962494
Mon 20 Jan 2014 02:18:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:18:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:18:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:18:37 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:18:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:18:37 - job_xml_thread(): Done retrieving: data size 42962494
Mon 20 Jan 2014 02:18:38 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:18:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:18:38 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:18:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:18:39 - XML: Start document: iteration 14
Mon 20 Jan 2014 02:18:39 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:18:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:18:39 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:18:39 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:18:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:18:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:18:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:18:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:18:46 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:18:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:18:47 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:18:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 02:18:47 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:18:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 02:18:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8519 values 134641 bits 16830 bytes 
Mon 20 Jan 2014 02:18:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:18:49 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:18:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:18:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:18:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:18:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:18:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:18:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:18:50 - XML: Processed 645910 elements - found 0 jobs
Mon 20 Jan 2014 02:18:50 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:18:50 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:18:50 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:18:50 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:18:53 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:18:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43516943
Mon 20 Jan 2014 02:18:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:18:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43516943
Mon 20 Jan 2014 02:18:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:18:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:18:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:19:03 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:19:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 02:19:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:19:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:19:03 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:19:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:19:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:19:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:19:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:19:05 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:19:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:19:05 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:19:05 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:19:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:19:06 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:19:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:19:07 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:19:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:19:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:19:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:19:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:19:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:19:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:19:09 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:19:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570930
Mon 20 Jan 2014 02:19:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:19:09 - job_xml_thread(): Done retrieving: data size 43570930
Mon 20 Jan 2014 02:19:09 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:19:09 - XML: Start document: iteration 15
Mon 20 Jan 2014 02:19:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570930
Mon 20 Jan 2014 02:19:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:19:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:19:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:19:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:19:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:19:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:19:27 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:19:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:19:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:19:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:19:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:19:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:19:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:19:30 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:19:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:19:30 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:19:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:19:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:19:31 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:19:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:19:31 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:19:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:19:32 - XML: Processed 653326 elements - found 0 jobs
Mon 20 Jan 2014 02:19:32 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:19:32 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:19:32 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:19:32 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:19:34 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:19:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43594468
Mon 20 Jan 2014 02:19:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:19:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43594468
Mon 20 Jan 2014 02:19:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:19:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:19:45 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:19:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:19:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:19:47 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:19:47 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:19:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:19:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:19:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:19:47 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:19:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:19:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:19:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:19:47 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:19:47 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:19:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:19:47 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:19:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:19:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:19:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 02:19:47 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:19:47 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:19:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 02:19:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9344 values 147430 bits 18428 bytes 
Mon 20 Jan 2014 02:19:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:19:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:19:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:19:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:19:50 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:19:50 - job_xml_thread(): Done retrieving: data size 43595204
Mon 20 Jan 2014 02:19:50 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:19:50 - XML: Start document: iteration 16
Mon 20 Jan 2014 02:19:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43595204
Mon 20 Jan 2014 02:19:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:19:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43595204
Mon 20 Jan 2014 02:19:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:20:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:20:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:20:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:20:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:20:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:20:09 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:20:09 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:20:09 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:20:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:20:09 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:20:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:20:09 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:20:09 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:20:09 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:20:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:20:09 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:20:09 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:20:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:20:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:20:11 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:20:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:20:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:20:12 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:20:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 02:20:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:20:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:20:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:20:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:20:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:20:13 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:20:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574185
Mon 20 Jan 2014 02:20:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:20:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574185
Mon 20 Jan 2014 02:20:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:20:24 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:20:24 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:20:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:20:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:20:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:20:25 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:20:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:20:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:20:25 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:20:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:20:25 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:20:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:20:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:20:27 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:20:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:20:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:20:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:20:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:20:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:20:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:20:29 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:20:29 - job_xml_thread(): Done retrieving: data size 43573887
Mon 20 Jan 2014 02:20:29 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:20:29 - XML: Start document: iteration 17
Mon 20 Jan 2014 02:20:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573887
Mon 20 Jan 2014 02:20:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:20:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573887
Mon 20 Jan 2014 02:20:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:20:35 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 02:20:35 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:20:37 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:20:37 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:20:37 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 02:20:37 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 02:20:37 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 02:20:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:20:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:20:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:20:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:20:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:20:46 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:20:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:20:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:20:47 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:20:47 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:20:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:20:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:20:47 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:20:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:20:48 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:20:48 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:20:48 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:20:48 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:20:48 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:20:48 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:20:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:20:48 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:20:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 02:20:48 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:20:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 02:20:48 - size of cluster 'LISA Cluster': 624 hosts 79465 metrics 842274 values 13304038 bits 1663004 bytes 
Mon 20 Jan 2014 02:20:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8620 values 135985 bits 16998 bytes 
Mon 20 Jan 2014 02:20:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:20:54 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:20:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:20:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:20:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:20:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:20:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:20:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:20:58 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:20:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 02:20:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:20:58 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:20:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559036
Mon 20 Jan 2014 02:20:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:20:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559036
Mon 20 Jan 2014 02:20:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:21:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:21:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:21:03 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:21:03 - job_xml_thread(): Done retrieving: data size 43559036
Mon 20 Jan 2014 02:21:03 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:21:03 - XML: Start document: iteration 18
Mon 20 Jan 2014 02:21:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:21:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:21:15 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:21:15 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:21:15 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:21:15 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:21:15 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:21:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:21:16 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:21:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:21:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:21:16 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:21:16 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:21:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:21:16 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:21:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:21:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:21:19 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:21:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:21:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:21:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:21:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:21:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:21:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:21:23 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:21:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43592267
Mon 20 Jan 2014 02:21:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:21:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43592267
Mon 20 Jan 2014 02:21:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:21:30 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:21:30 - job_xml_thread(): Done retrieving: data size 43592267
Mon 20 Jan 2014 02:21:30 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:21:30 - XML: Start document: iteration 19
Mon 20 Jan 2014 02:21:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:21:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:21:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:21:32 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:21:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:21:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:21:33 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:21:33 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:21:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:21:33 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:21:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:21:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:21:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:21:38 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:21:38 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 02:21:42 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:21:42 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:21:42 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:21:42 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:21:42 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:21:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:21:44 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:21:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:21:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:21:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:21:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:21:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:21:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:21:47 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:21:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43551955
Mon 20 Jan 2014 02:21:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:21:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:21:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43551955
Mon 20 Jan 2014 02:21:48 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:21:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:21:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:21:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:21:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:21:49 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:21:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 02:21:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 02:21:49 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:21:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9279 values 146411 bits 18301 bytes 
Mon 20 Jan 2014 02:21:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:21:57 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:21:57 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:21:57 - job_xml_thread(): Done retrieving: data size 43551955
Mon 20 Jan 2014 02:21:57 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:21:57 - XML: Start document: iteration 20
Mon 20 Jan 2014 02:21:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:21:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:21:58 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:21:58 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:21:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:21:58 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:21:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:22:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:22:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:22:08 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:22:08 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:22:08 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:22:08 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:22:08 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:22:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:22:10 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:22:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:22:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:22:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:22:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:22:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:22:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:22:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:22:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:22:13 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:22:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43543470
Mon 20 Jan 2014 02:22:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:22:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43543470
Mon 20 Jan 2014 02:22:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:22:23 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:22:23 - job_xml_thread(): Done retrieving: data size 43543470
Mon 20 Jan 2014 02:22:23 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:22:23 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 02:22:24 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 02:22:24 - Housekeeping: done.
Mon 20 Jan 2014 02:22:24 - XML: Start document: iteration 0
Mon 20 Jan 2014 02:22:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:22:24 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:22:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:22:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:22:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:22:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:22:26 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:22:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:22:26 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:22:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:22:26 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:22:32 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:22:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 02:22:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:22:36 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:22:36 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:22:36 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:22:36 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:22:36 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:22:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:22:38 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:22:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:22:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:22:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:22:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:22:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:22:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:22:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:22:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:22:41 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:22:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559939
Mon 20 Jan 2014 02:22:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:22:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559939
Mon 20 Jan 2014 02:22:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:22:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:22:49 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:22:50 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:22:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 02:22:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:22:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 02:22:50 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:22:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5954 values 93932 bits 11741 bytes 
Mon 20 Jan 2014 02:22:51 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:22:51 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:22:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:22:54 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:22:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:22:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:22:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:22:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:22:54 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:22:54 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:22:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:22:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:22:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:22:58 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:22:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:22:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:22:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:22:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:22:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:22:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:23:01 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:23:01 - job_xml_thread(): Done retrieving: data size 43561494
Mon 20 Jan 2014 02:23:01 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:23:01 - XML: Start document: iteration 1
Mon 20 Jan 2014 02:23:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561494
Mon 20 Jan 2014 02:23:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:23:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561494
Mon 20 Jan 2014 02:23:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:23:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:23:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:23:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:23:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:23:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:23:19 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:23:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:23:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:23:20 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:23:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:23:20 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:23:20 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:23:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:23:23 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:23:23 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:23:23 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:23:23 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:23:23 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:23:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:23:26 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:23:26 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:23:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 02:23:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:23:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:23:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:23:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:23:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:23:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:23:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:23:29 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:23:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43497529
Mon 20 Jan 2014 02:23:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:23:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43497529
Mon 20 Jan 2014 02:23:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:23:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:23:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:23:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:23:37 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:23:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:23:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:23:38 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:23:38 - job_xml_thread(): Done retrieving: data size 43497529
Mon 20 Jan 2014 02:23:38 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:23:38 - XML: Start document: iteration 2
Mon 20 Jan 2014 02:23:38 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:23:38 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:23:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:23:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:23:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43497529
Mon 20 Jan 2014 02:23:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:23:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:23:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:23:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:23:50 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:23:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:23:50 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:23:51 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:23:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 02:23:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:23:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 02:23:51 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:23:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5844 values 92185 bits 11523 bytes 
Mon 20 Jan 2014 02:23:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:23:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:23:54 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:23:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:23:54 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:23:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:23:55 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:23:57 - XML: Processed 652601 elements - found 0 jobs
Mon 20 Jan 2014 02:23:57 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:23:57 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:23:57 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:23:57 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:23:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:23:59 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:23:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:24:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:24:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:24:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:24:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:24:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:24:03 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:24:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42900511
Mon 20 Jan 2014 02:24:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:24:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42900511
Mon 20 Jan 2014 02:24:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:24:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:24:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:24:12 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:24:12 - job_xml_thread(): Done retrieving: data size 42900511
Mon 20 Jan 2014 02:24:13 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:24:13 - XML: Start document: iteration 3
Mon 20 Jan 2014 02:24:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:24:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:24:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:24:17 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:24:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:24:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:24:18 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:24:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:24:18 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:24:18 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:24:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:24:25 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:24:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 02:24:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:24:26 - XML: Processed 645158 elements - found 0 jobs
Mon 20 Jan 2014 02:24:26 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:24:26 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:24:26 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:24:26 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:24:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:24:27 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:24:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:24:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:24:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:24:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:24:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:24:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:24:31 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:24:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43065507
Mon 20 Jan 2014 02:24:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:24:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43065507
Mon 20 Jan 2014 02:24:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:24:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:24:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:24:41 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:24:41 - job_xml_thread(): Done retrieving: data size 43065507
Mon 20 Jan 2014 02:24:41 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:24:41 - XML: Start document: iteration 4
Mon 20 Jan 2014 02:24:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:24:42 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:24:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:24:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:24:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:24:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:24:44 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:24:44 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:24:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:24:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:24:44 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:24:49 - XML: Processed 647362 elements - found 0 jobs
Mon 20 Jan 2014 02:24:49 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:24:49 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:24:49 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:24:49 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:24:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:24:51 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:24:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:24:51 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:24:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 02:24:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 02:24:51 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:24:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5834 values 91981 bits 11497 bytes 
Mon 20 Jan 2014 02:24:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:24:52 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:24:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:24:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:24:53 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 02:24:53 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 02:24:53 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:24:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:24:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:24:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:24:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:24:55 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:24:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43500563
Mon 20 Jan 2014 02:24:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:24:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43500563
Mon 20 Jan 2014 02:24:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:24:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:24:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:25:05 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:25:05 - job_xml_thread(): Done retrieving: data size 43500563
Mon 20 Jan 2014 02:25:05 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:25:05 - XML: Start document: iteration 5
Mon 20 Jan 2014 02:25:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:25:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:25:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:25:10 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:25:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:25:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:25:12 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:25:12 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:25:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:25:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:25:12 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:25:13 - XML: Processed 652416 elements - found 0 jobs
Mon 20 Jan 2014 02:25:13 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:25:13 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:25:13 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:25:13 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:25:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:25:15 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:25:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:25:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:25:15 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:25:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 02:25:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:25:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:25:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:25:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:25:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:25:17 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:25:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571448
Mon 20 Jan 2014 02:25:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:25:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571448
Mon 20 Jan 2014 02:25:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:25:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:25:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:25:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:25:28 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:25:28 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:25:28 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:25:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:25:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:25:29 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:25:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:25:29 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:25:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:25:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:25:31 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:25:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:25:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:25:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:25:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:25:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:25:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:25:33 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:25:33 - job_xml_thread(): Done retrieving: data size 43574558
Mon 20 Jan 2014 02:25:33 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:25:33 - XML: Start document: iteration 6
Mon 20 Jan 2014 02:25:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574558
Mon 20 Jan 2014 02:25:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:25:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574558
Mon 20 Jan 2014 02:25:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:25:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:25:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:25:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:25:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:25:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:25:49 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:25:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:25:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:25:50 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:25:51 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:25:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:25:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:25:51 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:25:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:25:52 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:25:52 - XML: Processed 653350 elements - found 0 jobs
Mon 20 Jan 2014 02:25:52 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:25:52 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:25:52 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:25:52 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:25:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:25:53 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:25:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 02:25:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 02:25:53 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:25:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8728 values 137619 bits 17202 bytes 
Mon 20 Jan 2014 02:25:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:25:56 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:25:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:25:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:25:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:25:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:25:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:25:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:25:58 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:25:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558798
Mon 20 Jan 2014 02:25:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:25:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558798
Mon 20 Jan 2014 02:25:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:26:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:26:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:26:07 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:26:07 - job_xml_thread(): Done retrieving: data size 43558798
Mon 20 Jan 2014 02:26:07 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:26:07 - XML: Start document: iteration 7
Mon 20 Jan 2014 02:26:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:26:08 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:26:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:26:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:26:09 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:26:09 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:26:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:26:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:26:09 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:26:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:26:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:26:17 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:26:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 02:26:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:26:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:26:20 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:26:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:26:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:26:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:26:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:26:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:26:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:26:21 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:26:21 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:26:21 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:26:21 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:26:21 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:26:23 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:26:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564855
Mon 20 Jan 2014 02:26:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:26:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564855
Mon 20 Jan 2014 02:26:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:26:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:26:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:26:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:26:34 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:26:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:26:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:26:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:26:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:26:36 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:26:36 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:26:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:26:36 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:26:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:26:36 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:26:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:26:37 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:26:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:26:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:26:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:26:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:26:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:26:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:26:39 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:26:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43592093
Mon 20 Jan 2014 02:26:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:26:40 - job_xml_thread(): Done retrieving: data size 43592093
Mon 20 Jan 2014 02:26:40 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:26:40 - XML: Start document: iteration 8
Mon 20 Jan 2014 02:26:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43592093
Mon 20 Jan 2014 02:26:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:26:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:26:51 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:26:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:26:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:26:52 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:26:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:26:52 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:26:52 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:26:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:26:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:26:53 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:26:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:26:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:26:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:26:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 02:26:53 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:26:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 02:26:53 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:26:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8935 values 140926 bits 17615 bytes 
Mon 20 Jan 2014 02:26:56 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:26:56 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:26:56 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:26:56 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:26:56 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:27:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:27:00 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:27:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:27:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:27:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:27:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:27:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:27:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:27:03 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:27:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561947
Mon 20 Jan 2014 02:27:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:27:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561947
Mon 20 Jan 2014 02:27:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:27:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:27:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:27:12 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:27:12 - job_xml_thread(): Done retrieving: data size 43561947
Mon 20 Jan 2014 02:27:12 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:27:12 - XML: Start document: iteration 9
Mon 20 Jan 2014 02:27:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:27:13 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:27:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:27:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:27:14 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:27:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:27:14 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:27:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:27:14 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:27:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:27:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:27:23 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:27:23 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:27:23 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:27:23 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:27:23 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:27:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:27:26 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:27:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:27:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:27:26 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:27:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 02:27:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:27:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:27:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:27:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:27:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:27:28 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:27:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43545424
Mon 20 Jan 2014 02:27:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:27:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43545424
Mon 20 Jan 2014 02:27:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:27:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:27:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:27:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:27:37 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:27:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:27:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:27:38 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 02:27:38 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:27:38 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:27:38 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:27:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:27:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:27:38 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:27:38 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:27:39 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:27:39 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:27:39 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 02:27:40 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 02:27:40 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 02:27:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:27:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:27:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:27:42 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:27:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:27:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:27:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:27:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:27:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:27:43 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 867162 values 13674094 bits 1709261 bytes 
Mon 20 Jan 2014 02:27:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:27:46 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:27:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569125
Mon 20 Jan 2014 02:27:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:27:47 - job_xml_thread(): Done retrieving: data size 43569125
Mon 20 Jan 2014 02:27:47 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:27:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569125
Mon 20 Jan 2014 02:27:47 - XML: Start document: iteration 10
Mon 20 Jan 2014 02:27:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:27:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:27:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:27:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:27:53 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:27:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:27:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 02:27:54 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:27:54 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:27:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 02:27:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8753 values 138018 bits 17252 bytes 
Mon 20 Jan 2014 02:27:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:27:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:28:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:28:04 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:28:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:28:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:28:04 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:28:04 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:28:04 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:28:05 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:28:05 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:28:05 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:28:05 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:28:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:28:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:28:05 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:28:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:28:09 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:28:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:28:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:28:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:28:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:28:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:28:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:28:13 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:28:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559436
Mon 20 Jan 2014 02:28:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:28:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559436
Mon 20 Jan 2014 02:28:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:28:20 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:28:20 - job_xml_thread(): Done retrieving: data size 43559436
Mon 20 Jan 2014 02:28:20 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:28:20 - XML: Start document: iteration 11
Mon 20 Jan 2014 02:28:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:28:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:28:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:28:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:28:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:28:27 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:28:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:28:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:28:29 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:28:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:28:29 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:28:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:28:29 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:28:34 - XML: Processed 653346 elements - found 0 jobs
Mon 20 Jan 2014 02:28:34 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:28:34 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:28:34 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:28:34 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:28:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:28:37 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:28:37 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:28:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 02:28:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:28:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:28:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:28:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:28:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:28:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:28:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:28:40 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:28:40 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 02:28:40 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:28:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577150
Mon 20 Jan 2014 02:28:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:28:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577150
Mon 20 Jan 2014 02:28:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:28:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:28:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:28:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:28:49 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:28:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:28:49 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:28:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:28:49 - job_xml_thread(): Done retrieving: data size 43577150
Mon 20 Jan 2014 02:28:49 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:28:49 - XML: Start document: iteration 12
Mon 20 Jan 2014 02:28:49 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:28:49 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:28:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:28:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:28:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577150
Mon 20 Jan 2014 02:28:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:28:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:28:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:28:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:28:55 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:28:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:28:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 02:28:56 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:28:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 02:28:56 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:28:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5728 values 90295 bits 11286 bytes 
Mon 20 Jan 2014 02:29:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:29:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:29:08 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:29:08 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:29:08 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:29:09 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:29:09 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:29:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:29:09 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:29:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:29:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:29:10 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:29:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:29:10 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:29:10 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:29:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:29:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:29:11 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:29:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:29:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:29:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:29:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:29:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:29:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:29:14 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:29:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43512018
Mon 20 Jan 2014 02:29:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:29:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43512018
Mon 20 Jan 2014 02:29:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:29:24 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:29:24 - job_xml_thread(): Done retrieving: data size 43512018
Mon 20 Jan 2014 02:29:24 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:29:24 - XML: Start document: iteration 13
Mon 20 Jan 2014 02:29:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:29:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:29:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:29:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:29:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:29:28 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:29:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:29:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:29:29 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:29:29 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:29:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:29:29 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:29:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:29:38 - XML: Processed 652602 elements - found 0 jobs
Mon 20 Jan 2014 02:29:38 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:29:38 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:29:38 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:29:38 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:29:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:29:39 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:29:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:29:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:29:39 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:29:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 02:29:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:29:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:29:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:29:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:29:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:29:42 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:29:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43053515
Mon 20 Jan 2014 02:29:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:29:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43053515
Mon 20 Jan 2014 02:29:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:29:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:29:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:29:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:29:52 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:29:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:29:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:29:52 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:29:52 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:29:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:29:52 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:29:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:29:53 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:29:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:29:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:29:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:29:56 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:29:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:29:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 02:29:56 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:29:56 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:29:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 02:29:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5783 values 91142 bits 11392 bytes 
Mon 20 Jan 2014 02:29:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:29:58 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:29:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:29:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:29:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:29:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:29:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:29:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:30:01 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:30:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42896289
Mon 20 Jan 2014 02:30:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:30:02 - job_xml_thread(): Done retrieving: data size 42896289
Mon 20 Jan 2014 02:30:02 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:30:02 - XML: Start document: iteration 14
Mon 20 Jan 2014 02:30:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42896289
Mon 20 Jan 2014 02:30:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:30:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:30:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:30:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:30:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:30:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:30:21 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:30:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:30:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:30:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:30:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:30:23 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:30:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:30:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:30:25 - XML: Processed 645198 elements - found 0 jobs
Mon 20 Jan 2014 02:30:25 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:30:25 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:30:25 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:30:25 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:30:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:30:25 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:30:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:30:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:30:26 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:30:26 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:30:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:30:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:30:26 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:30:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 02:30:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:30:29 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:30:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43112796
Mon 20 Jan 2014 02:30:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:30:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43112796
Mon 20 Jan 2014 02:30:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:30:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:30:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:30:40 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:30:40 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:30:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:30:41 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:30:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:30:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:30:43 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:30:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:30:43 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:30:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:30:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:30:43 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:30:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:30:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:30:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:30:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:30:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:30:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:30:46 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:30:46 - job_xml_thread(): Done retrieving: data size 43516312
Mon 20 Jan 2014 02:30:46 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:30:46 - XML: Start document: iteration 15
Mon 20 Jan 2014 02:30:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43516312
Mon 20 Jan 2014 02:30:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:30:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43516312
Mon 20 Jan 2014 02:30:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:30:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:30:57 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:30:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:30:57 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:30:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:30:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:30:58 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:30:58 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:30:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:30:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:30:58 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:30:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:30:58 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:30:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 02:30:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 02:30:58 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:30:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8565 values 135050 bits 16881 bytes 
Mon 20 Jan 2014 02:30:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:30:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:31:05 - XML: Processed 652726 elements - found 0 jobs
Mon 20 Jan 2014 02:31:05 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:31:05 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:31:05 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:31:05 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:31:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:31:09 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:31:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:31:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:31:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:31:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:31:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:31:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:31:12 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:31:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563044
Mon 20 Jan 2014 02:31:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:31:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563044
Mon 20 Jan 2014 02:31:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:31:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:31:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:31:20 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:31:20 - job_xml_thread(): Done retrieving: data size 43563044
Mon 20 Jan 2014 02:31:20 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:31:20 - XML: Start document: iteration 16
Mon 20 Jan 2014 02:31:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:31:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:31:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:31:31 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:31:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:31:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:31:32 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:31:32 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:31:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:31:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:31:32 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:31:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:31:32 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:31:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:31:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:31:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:31:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:31:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:31:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:31:35 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:31:35 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:31:35 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:31:35 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:31:35 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:31:35 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:31:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 02:31:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:31:38 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:31:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582552
Mon 20 Jan 2014 02:31:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:31:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582552
Mon 20 Jan 2014 02:31:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:31:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:31:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:31:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:31:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:31:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:31:49 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:31:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:31:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:31:50 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:31:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:31:50 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:31:50 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:31:50 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:31:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:31:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:31:52 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:31:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:31:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:31:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:31:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:31:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:31:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:31:55 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:31:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43592121
Mon 20 Jan 2014 02:31:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:31:56 - job_xml_thread(): Done retrieving: data size 43592121
Mon 20 Jan 2014 02:31:56 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:31:56 - XML: Start document: iteration 17
Mon 20 Jan 2014 02:31:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43592121
Mon 20 Jan 2014 02:31:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:31:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:31:58 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:32:01 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:32:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:32:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 02:32:01 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:32:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8861 values 140005 bits 17500 bytes 
Mon 20 Jan 2014 02:32:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 02:32:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:32:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:32:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:32:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:32:19 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:32:19 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:32:19 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:32:19 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:32:19 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:32:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:32:19 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:32:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:32:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:32:20 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:32:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:32:20 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:32:20 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:32:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:32:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:32:20 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:32:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:32:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:32:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:32:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:32:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:32:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:32:24 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 02:32:24 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 02:32:24 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:32:24 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:32:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43602734
Mon 20 Jan 2014 02:32:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:32:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43602734
Mon 20 Jan 2014 02:32:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:32:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:32:33 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:32:34 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:32:34 - job_xml_thread(): Done retrieving: data size 43602734
Mon 20 Jan 2014 02:32:35 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:32:35 - XML: Start document: iteration 18
Mon 20 Jan 2014 02:32:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:32:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:32:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:32:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:32:36 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:32:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:32:36 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:32:36 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:32:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:32:44 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:32:44 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:32:44 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:32:44 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:32:44 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:32:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:32:46 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:32:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:32:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:32:46 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:32:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 02:32:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:32:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:32:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:32:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:32:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:32:47 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:32:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553930
Mon 20 Jan 2014 02:32:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:32:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553930
Mon 20 Jan 2014 02:32:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:32:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:32:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:32:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:32:56 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:32:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:32:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:32:57 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:32:57 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:32:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:32:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:32:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553930
Mon 20 Jan 2014 02:32:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:32:59 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:32:59 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:33:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:33:01 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:33:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:33:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:33:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:33:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 02:33:01 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:33:01 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:33:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 02:33:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6002 values 94959 bits 11869 bytes 
Mon 20 Jan 2014 02:33:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:33:07 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:33:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:33:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:33:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:33:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:33:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:33:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:33:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:33:09 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:33:11 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:33:11 - job_xml_thread(): Done retrieving: data size 43573701
Mon 20 Jan 2014 02:33:11 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:33:11 - XML: Start document: iteration 19
Mon 20 Jan 2014 02:33:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573701
Mon 20 Jan 2014 02:33:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:33:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:33:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:33:15 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:33:15 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:33:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:33:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:33:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573701
Mon 20 Jan 2014 02:33:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:33:23 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:33:23 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:33:23 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:33:23 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:33:23 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:33:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:33:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:33:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:33:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:33:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:33:31 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:33:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:33:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:33:32 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:33:32 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:33:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:33:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:33:32 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:33:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:33:33 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:33:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:33:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:33:33 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:33:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 02:33:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:33:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:33:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:33:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:33:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:33:35 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:33:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43587687
Mon 20 Jan 2014 02:33:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:33:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43587687
Mon 20 Jan 2014 02:33:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:33:38 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:33:38 - job_xml_thread(): Done retrieving: data size 43587687
Mon 20 Jan 2014 02:33:38 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:33:38 - XML: Start document: iteration 20
Mon 20 Jan 2014 02:33:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:33:45 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:33:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:33:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:33:49 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:33:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:33:49 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:33:49 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:33:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:33:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:33:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:33:55 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:33:55 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:33:55 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:33:55 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:33:55 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:33:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:33:57 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:33:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:33:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:33:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:33:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:33:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:33:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:33:58 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:33:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572248
Mon 20 Jan 2014 02:33:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:33:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572248
Mon 20 Jan 2014 02:33:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:34:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:34:02 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:34:03 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:34:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 02:34:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:34:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 02:34:03 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:34:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8818 values 139193 bits 17399 bytes 
Mon 20 Jan 2014 02:34:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:34:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:34:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:34:08 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:34:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:34:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:34:09 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:34:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:34:09 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:34:09 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:34:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:34:10 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:34:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:34:12 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:34:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:34:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:34:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:34:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:34:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:34:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:34:14 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:34:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578683
Mon 20 Jan 2014 02:34:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:34:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578683
Mon 20 Jan 2014 02:34:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:34:14 - job_xml_thread(): Done retrieving: data size 43578683
Mon 20 Jan 2014 02:34:14 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:34:14 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 02:34:16 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 02:34:16 - Housekeeping: done.
Mon 20 Jan 2014 02:34:16 - XML: Start document: iteration 0
Mon 20 Jan 2014 02:34:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:34:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:34:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:34:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:34:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:34:31 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:34:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:34:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:34:32 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:34:32 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:34:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:34:32 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:34:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:34:33 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:34:33 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:34:33 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:34:33 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:34:33 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:34:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:34:36 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:34:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:34:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:34:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:34:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:34:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:34:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:34:37 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:34:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 02:34:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:34:38 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:34:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43585463
Mon 20 Jan 2014 02:34:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:34:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43585463
Mon 20 Jan 2014 02:34:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:34:40 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 02:34:40 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:34:43 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:34:43 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 02:34:43 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 02:34:43 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:34:43 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 02:34:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:34:48 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:34:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:34:48 - job_xml_thread(): Done retrieving: data size 43585463
Mon 20 Jan 2014 02:34:48 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:34:48 - XML: Start document: iteration 1
Mon 20 Jan 2014 02:34:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:34:51 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:34:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:34:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:34:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:34:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:34:52 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:34:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:34:52 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:34:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:34:52 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:34:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:34:59 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:35:00 - size of cluster 'LISA Cluster': 624 hosts 79483 metrics 795025 values 12556471 bits 1569558 bytes 
Mon 20 Jan 2014 02:35:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:35:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:35:00 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:35:00 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:35:00 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:35:00 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:35:00 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:35:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:35:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:35:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:35:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:35:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:35:03 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:35:04 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:35:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43551529
Mon 20 Jan 2014 02:35:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:35:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43551529
Mon 20 Jan 2014 02:35:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:35:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:35:04 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:35:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 02:35:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 02:35:05 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:35:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5321 values 83860 bits 10482 bytes 
Mon 20 Jan 2014 02:35:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:35:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:35:15 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:35:15 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:35:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:35:16 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:35:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:35:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:35:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:35:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:35:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:35:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:35:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:35:19 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:35:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:35:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:35:20 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:35:20 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:35:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:35:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:35:22 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:35:22 - job_xml_thread(): Done retrieving: data size 43508325
Mon 20 Jan 2014 02:35:22 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:35:22 - XML: Start document: iteration 2
Mon 20 Jan 2014 02:35:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43508325
Mon 20 Jan 2014 02:35:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:35:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43508325
Mon 20 Jan 2014 02:35:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:35:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:35:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:35:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:35:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:35:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:35:38 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:35:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:35:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:35:39 - XML: Processed 652602 elements - found 0 jobs
Mon 20 Jan 2014 02:35:39 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:35:39 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:35:39 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:35:39 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:35:40 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:35:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:35:40 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:35:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:35:40 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:35:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:35:42 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:35:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:35:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:35:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:35:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:35:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:35:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:35:43 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:35:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 02:35:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:35:43 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:35:43 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 02:35:46 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:35:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42961653
Mon 20 Jan 2014 02:35:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:35:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42961653
Mon 20 Jan 2014 02:35:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:35:54 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:35:54 - job_xml_thread(): Done retrieving: data size 42961653
Mon 20 Jan 2014 02:35:54 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:35:54 - XML: Start document: iteration 3
Mon 20 Jan 2014 02:35:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:35:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:35:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:35:57 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:35:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:35:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:35:57 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:35:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:35:57 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:35:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:35:57 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:35:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:35:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:36:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:36:04 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:36:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:36:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 02:36:05 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:36:05 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:36:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 02:36:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5680 values 89539 bits 11192 bytes 
Mon 20 Jan 2014 02:36:08 - XML: Processed 645658 elements - found 0 jobs
Mon 20 Jan 2014 02:36:08 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:36:08 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:36:08 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:36:08 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:36:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:36:09 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:36:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:36:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:36:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:36:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:36:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:36:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:36:12 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:36:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42893953
Mon 20 Jan 2014 02:36:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:36:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:36:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:36:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42893953
Mon 20 Jan 2014 02:36:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:36:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:36:23 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:36:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:36:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:36:24 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:36:24 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:36:24 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:36:24 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:36:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:36:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:36:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:36:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:36:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:36:28 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:36:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:36:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:36:28 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:36:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 02:36:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:36:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:36:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:36:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:36:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:36:31 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:36:31 - job_xml_thread(): Done retrieving: data size 43139045
Mon 20 Jan 2014 02:36:31 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:36:31 - XML: Start document: iteration 4
Mon 20 Jan 2014 02:36:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43139045
Mon 20 Jan 2014 02:36:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43139045
Mon 20 Jan 2014 02:36:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:36:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:36:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:36:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:36:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:36:42 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:36:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:36:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:36:43 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:36:43 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:36:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:36:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:36:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:36:44 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:36:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:36:50 - XML: Processed 647862 elements - found 0 jobs
Mon 20 Jan 2014 02:36:50 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:36:50 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:36:50 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:36:50 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:36:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:36:52 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:36:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:36:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:36:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:36:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:36:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:36:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:36:56 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:36:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43533405
Mon 20 Jan 2014 02:36:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:36:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43533405
Mon 20 Jan 2014 02:36:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:37:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:37:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:37:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:37:05 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:37:05 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:37:05 - job_xml_thread(): Done retrieving: data size 43533405
Mon 20 Jan 2014 02:37:05 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:37:05 - XML: Start document: iteration 5
Mon 20 Jan 2014 02:37:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:37:06 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:37:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:37:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 02:37:07 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:37:07 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:37:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:37:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8639 values 136228 bits 17028 bytes 
Mon 20 Jan 2014 02:37:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 02:37:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:37:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:37:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:37:08 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:37:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:37:08 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:37:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:37:08 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:37:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:37:16 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:37:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:37:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:37:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:37:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:37:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:37:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:37:20 - XML: Processed 652934 elements - found 0 jobs
Mon 20 Jan 2014 02:37:20 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:37:20 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:37:20 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:37:20 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:37:23 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:37:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43548236
Mon 20 Jan 2014 02:37:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:37:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43548236
Mon 20 Jan 2014 02:37:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:37:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:37:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:37:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:37:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:37:35 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:37:35 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:37:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:37:40 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:37:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:37:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:37:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:37:40 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:37:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:37:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:37:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:37:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:37:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:37:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:37:41 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:37:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 02:37:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:37:41 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:37:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:37:41 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:37:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:37:44 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:37:44 - job_xml_thread(): Done retrieving: data size 43582459
Mon 20 Jan 2014 02:37:44 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:37:44 - XML: Start document: iteration 6
Mon 20 Jan 2014 02:37:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582459
Mon 20 Jan 2014 02:37:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:37:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582459
Mon 20 Jan 2014 02:37:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:37:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:37:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:37:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:37:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:38:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:38:01 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:38:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:38:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:38:02 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:38:02 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:38:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:38:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:38:02 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:38:02 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:38:02 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:38:02 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:38:02 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:38:02 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:38:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:38:07 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:38:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:38:08 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:38:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:38:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:38:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:38:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 02:38:08 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:38:08 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:38:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 02:38:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5724 values 90269 bits 11283 bytes 
Mon 20 Jan 2014 02:38:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:38:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:38:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:38:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:38:11 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:38:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573136
Mon 20 Jan 2014 02:38:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:38:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573136
Mon 20 Jan 2014 02:38:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:38:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:38:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:38:17 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:38:18 - job_xml_thread(): Done retrieving: data size 43573136
Mon 20 Jan 2014 02:38:18 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:38:18 - XML: Start document: iteration 7
Mon 20 Jan 2014 02:38:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:38:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:38:27 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:38:27 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:38:27 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:38:27 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:38:27 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:38:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:38:29 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:38:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:38:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:38:29 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:38:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:38:29 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:38:29 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:38:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:38:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:38:34 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:38:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:38:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:38:34 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:38:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 02:38:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:38:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:38:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:38:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:38:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:38:36 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:38:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581753
Mon 20 Jan 2014 02:38:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:38:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581753
Mon 20 Jan 2014 02:38:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:38:42 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:38:42 - job_xml_thread(): Done retrieving: data size 43581753
Mon 20 Jan 2014 02:38:42 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:38:42 - XML: Start document: iteration 8
Mon 20 Jan 2014 02:38:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:38:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:38:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:38:50 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:38:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:38:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:38:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:38:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:38:50 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:38:50 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:38:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:38:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:38:50 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:38:57 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:38:57 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:38:57 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:38:57 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:38:57 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:39:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:39:00 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:39:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:39:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:39:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:39:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:39:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:39:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:39:03 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:39:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43550104
Mon 20 Jan 2014 02:39:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:39:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43550104
Mon 20 Jan 2014 02:39:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:39:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:39:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:39:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:39:08 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:39:09 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:39:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:39:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 02:39:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 02:39:09 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:39:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8471 values 133622 bits 16702 bytes 
Mon 20 Jan 2014 02:39:12 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:39:12 - job_xml_thread(): Done retrieving: data size 43550104
Mon 20 Jan 2014 02:39:12 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:39:12 - XML: Start document: iteration 9
Mon 20 Jan 2014 02:39:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:39:15 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:39:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:39:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:39:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:39:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:39:16 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:39:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:39:17 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:39:17 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:39:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:39:21 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:39:21 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:39:21 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:39:21 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:39:21 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:39:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:39:26 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:39:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:39:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:39:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:39:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:39:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:39:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:39:27 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 02:39:27 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 02:39:27 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:39:29 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:39:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562557
Mon 20 Jan 2014 02:39:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:39:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562557
Mon 20 Jan 2014 02:39:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:39:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:39:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:39:36 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:39:36 - job_xml_thread(): Done retrieving: data size 43562557
Mon 20 Jan 2014 02:39:36 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:39:37 - XML: Start document: iteration 10
Mon 20 Jan 2014 02:39:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:39:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:39:44 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:39:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 02:39:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:39:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:39:47 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:39:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:39:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:39:48 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:39:48 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:39:48 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:39:48 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:39:48 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:39:49 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:39:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:39:49 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:39:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:39:49 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:39:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:39:52 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:39:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:39:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:39:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:39:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:39:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:39:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:39:53 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:39:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43587989
Mon 20 Jan 2014 02:39:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:39:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43587989
Mon 20 Jan 2014 02:39:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:40:04 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:40:04 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:40:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:40:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:40:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:40:05 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:40:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:40:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:40:06 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:40:06 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:40:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:40:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:40:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:40:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:40:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:40:07 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:40:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:40:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:40:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:40:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:40:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:40:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:40:09 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:40:09 - job_xml_thread(): Done retrieving: data size 43576243
Mon 20 Jan 2014 02:40:09 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:40:09 - XML: Start document: iteration 11
Mon 20 Jan 2014 02:40:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:40:09 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:40:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576243
Mon 20 Jan 2014 02:40:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576243
Mon 20 Jan 2014 02:40:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:40:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:40:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:40:10 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:40:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 02:40:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 02:40:11 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:40:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6117 values 96493 bits 12061 bytes 
Mon 20 Jan 2014 02:40:17 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:40:17 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:40:17 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:40:17 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:40:17 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:40:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:40:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:40:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:40:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:40:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:40:27 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:40:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:40:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:40:28 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:40:28 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:40:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:40:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:40:28 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:40:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:40:31 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:40:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:40:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:40:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:40:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:40:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:40:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:40:32 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:40:33 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:40:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565897
Mon 20 Jan 2014 02:40:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:40:33 - job_xml_thread(): Done retrieving: data size 43565897
Mon 20 Jan 2014 02:40:33 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:40:33 - XML: Start document: iteration 12
Mon 20 Jan 2014 02:40:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565897
Mon 20 Jan 2014 02:40:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:40:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:40:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:40:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:40:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:40:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:40:52 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:40:52 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:40:52 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:40:52 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:40:52 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:40:52 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:40:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:40:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:40:53 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:40:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:40:53 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:40:53 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:40:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:40:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:40:55 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:40:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:40:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:40:56 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:40:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 02:40:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:40:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:40:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:40:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:40:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:40:57 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:40:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43593825
Mon 20 Jan 2014 02:40:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:40:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43593825
Mon 20 Jan 2014 02:40:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:41:07 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:41:07 - job_xml_thread(): Done retrieving: data size 43593825
Mon 20 Jan 2014 02:41:07 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:41:07 - XML: Start document: iteration 13
Mon 20 Jan 2014 02:41:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:41:08 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:41:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:41:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:41:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:41:11 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:41:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:41:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:41:12 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:41:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:41:12 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:41:12 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:41:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:41:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:41:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 02:41:12 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:41:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 02:41:12 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:41:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5728 values 90293 bits 11286 bytes 
Mon 20 Jan 2014 02:41:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:41:17 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:41:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:41:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:41:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:41:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:41:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:41:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:41:19 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:41:19 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:41:19 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:41:19 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:41:19 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:41:22 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:41:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43496732
Mon 20 Jan 2014 02:41:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:41:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43496732
Mon 20 Jan 2014 02:41:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:41:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:41:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:41:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:41:32 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:41:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:41:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:41:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:41:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:41:33 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:41:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:41:33 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:41:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:41:33 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:41:34 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:41:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:41:35 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:41:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:41:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:41:35 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:41:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 02:41:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:41:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:41:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:41:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:41:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:41:37 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:41:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43028858
Mon 20 Jan 2014 02:41:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:41:38 - job_xml_thread(): Done retrieving: data size 43028858
Mon 20 Jan 2014 02:41:38 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:41:38 - XML: Start document: iteration 14
Mon 20 Jan 2014 02:41:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43028858
Mon 20 Jan 2014 02:41:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:41:43 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 02:41:43 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:41:47 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:41:47 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:41:47 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 02:41:47 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 02:41:47 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 02:41:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:41:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Mon 20 Jan 2014 02:41:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:41:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:41:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:41:53 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:41:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:41:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:41:54 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:41:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:41:54 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:41:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:41:54 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:41:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:41:59 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:41:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:41:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:42:00 - XML: Processed 646528 elements - found 0 jobs
Mon 20 Jan 2014 02:42:00 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:42:00 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:42:00 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:42:00 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:42:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:42:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:42:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:42:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:42:01 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:42:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42901424
Mon 20 Jan 2014 02:42:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:42:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42901424
Mon 20 Jan 2014 02:42:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:42:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:42:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:42:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:42:12 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:42:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:42:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:42:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:42:13 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:42:13 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:42:13 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:42:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:42:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:42:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:42:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 02:42:14 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:42:14 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:42:14 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:42:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8921 values 140646 bits 17580 bytes 
Mon 20 Jan 2014 02:42:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 02:42:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:42:14 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:42:15 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:42:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:42:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:42:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:42:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:42:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:42:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:42:16 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:42:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 02:42:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:42:17 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:42:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42977374
Mon 20 Jan 2014 02:42:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:42:17 - job_xml_thread(): Done retrieving: data size 42977374
Mon 20 Jan 2014 02:42:17 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:42:17 - XML: Start document: iteration 15
Mon 20 Jan 2014 02:42:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42977374
Mon 20 Jan 2014 02:42:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:42:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:42:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:42:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:42:30 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:42:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:42:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:42:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:42:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:42:31 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:42:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:42:31 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:42:31 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:42:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:42:35 - XML: Processed 645840 elements - found 0 jobs
Mon 20 Jan 2014 02:42:35 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:42:35 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:42:35 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:42:35 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:42:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:42:39 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:42:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:42:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:42:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:42:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:42:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:42:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:42:40 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:42:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43385385
Mon 20 Jan 2014 02:42:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:42:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43385385
Mon 20 Jan 2014 02:42:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:42:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:42:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:42:47 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:42:47 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:42:49 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:42:49 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:42:49 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 02:42:49 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 02:42:49 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 02:42:50 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:42:50 - job_xml_thread(): Done retrieving: data size 43385385
Mon 20 Jan 2014 02:42:50 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:42:50 - XML: Start document: iteration 16
Mon 20 Jan 2014 02:42:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:42:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:42:54 - size of cluster 'LISA Cluster': 624 hosts 79475 metrics 870812 values 13728285 bits 1716035 bytes 
Mon 20 Jan 2014 02:42:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:42:54 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:42:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:42:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:42:55 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:42:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:42:55 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:42:55 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:42:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:43:01 - XML: Processed 651108 elements - found 0 jobs
Mon 20 Jan 2014 02:43:01 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:43:01 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:43:01 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:43:01 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:43:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:43:03 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:43:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:43:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:43:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:43:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:43:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:43:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:43:07 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:43:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554095
Mon 20 Jan 2014 02:43:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:43:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554095
Mon 20 Jan 2014 02:43:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:43:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:43:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:43:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:43:14 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:43:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:43:15 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:43:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 02:43:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 02:43:15 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:43:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148599 bits 18574 bytes 
Mon 20 Jan 2014 02:43:16 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:43:16 - job_xml_thread(): Done retrieving: data size 43554095
Mon 20 Jan 2014 02:43:16 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:43:16 - XML: Start document: iteration 17
Mon 20 Jan 2014 02:43:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:43:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:43:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:43:24 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:43:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:43:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:43:25 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:43:25 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:43:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:43:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:43:25 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:43:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:43:26 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:43:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:43:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:43:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:43:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:43:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:43:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:43:30 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:43:30 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:43:30 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:43:30 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:43:30 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:43:34 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:43:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 02:43:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:43:34 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:43:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556164
Mon 20 Jan 2014 02:43:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:43:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556164
Mon 20 Jan 2014 02:43:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:43:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:43:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:43:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:43:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:43:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:43:43 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:43:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:43:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:43:45 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:43:45 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:43:45 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:43:45 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:43:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:43:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:43:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:43:48 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:43:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:43:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:43:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:43:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:43:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:43:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:43:49 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:43:49 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 02:43:51 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:43:51 - job_xml_thread(): Done retrieving: data size 43576476
Mon 20 Jan 2014 02:43:51 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:43:51 - XML: Start document: iteration 18
Mon 20 Jan 2014 02:43:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576476
Mon 20 Jan 2014 02:43:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576476
Mon 20 Jan 2014 02:43:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:43:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:44:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:44:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:44:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:44:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:44:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:44:07 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:44:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:44:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:44:08 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:44:08 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:44:08 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:44:08 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:44:08 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:44:08 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:44:08 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:44:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:44:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:44:08 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:44:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:44:13 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:44:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:44:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:44:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:44:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:44:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:44:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:44:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:44:15 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:44:16 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:44:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:44:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 02:44:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 02:44:16 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:44:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99059 bits 12382 bytes 
Mon 20 Jan 2014 02:44:16 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:44:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580149
Mon 20 Jan 2014 02:44:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:44:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580149
Mon 20 Jan 2014 02:44:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:44:23 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:44:23 - job_xml_thread(): Done retrieving: data size 43580149
Mon 20 Jan 2014 02:44:23 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:44:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:44:23 - XML: Start document: iteration 19
Mon 20 Jan 2014 02:44:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:44:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:44:28 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:44:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:44:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:44:28 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:44:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:44:28 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:44:28 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:44:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:44:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:44:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:44:32 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:44:32 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:44:32 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:44:32 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:44:32 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:44:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:44:37 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:44:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:44:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:44:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:44:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:44:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:44:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:44:41 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:44:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562812
Mon 20 Jan 2014 02:44:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:44:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562812
Mon 20 Jan 2014 02:44:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:44:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:44:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:44:47 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:44:47 - job_xml_thread(): Done retrieving: data size 43562812
Mon 20 Jan 2014 02:44:47 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:44:47 - XML: Start document: iteration 20
Mon 20 Jan 2014 02:44:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:44:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:44:57 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:44:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 02:44:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:45:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:45:01 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:45:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:45:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:45:01 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:45:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:45:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:45:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:45:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:45:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:45:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:45:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:45:02 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:45:03 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:45:03 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:45:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:45:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:45:04 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:45:04 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:45:04 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:45:04 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:45:04 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:45:07 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:45:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43590433
Mon 20 Jan 2014 02:45:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:45:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43590433
Mon 20 Jan 2014 02:45:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:45:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:45:16 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:45:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:45:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:45:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:45:18 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:45:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 02:45:18 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:45:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 02:45:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:45:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:45:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6350 values 100111 bits 12513 bytes 
Mon 20 Jan 2014 02:45:19 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:45:19 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:45:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:45:19 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:45:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:45:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:45:21 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:45:21 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:45:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:45:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:45:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:45:22 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:45:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:45:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:45:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:45:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:45:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:45:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:45:26 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:45:26 - job_xml_thread(): Done retrieving: data size 43581080
Mon 20 Jan 2014 02:45:26 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:45:26 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 02:45:26 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 02:45:26 - Housekeeping: done.
Mon 20 Jan 2014 02:45:26 - XML: Start document: iteration 0
Mon 20 Jan 2014 02:45:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581080
Mon 20 Jan 2014 02:45:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:45:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581080
Mon 20 Jan 2014 02:45:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:45:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:45:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:45:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:45:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:45:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:45:42 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:45:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:45:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:45:43 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:45:43 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:45:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:45:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:45:43 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:45:44 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:45:44 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:45:44 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:45:44 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:45:44 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:45:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:45:48 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:45:48 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:45:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:45:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 02:45:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:45:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:45:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:45:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:45:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:45:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:45:50 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 02:45:50 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 02:45:50 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:45:51 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:45:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569817
Mon 20 Jan 2014 02:45:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:45:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569817
Mon 20 Jan 2014 02:45:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:45:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:45:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:45:59 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:45:59 - job_xml_thread(): Done retrieving: data size 43569817
Mon 20 Jan 2014 02:45:59 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:45:59 - XML: Start document: iteration 1
Mon 20 Jan 2014 02:46:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:46:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:46:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:46:06 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:46:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:46:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:46:06 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:46:06 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:46:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:46:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:46:07 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:46:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:46:12 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:46:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:46:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:46:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:46:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:46:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:46:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:46:14 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:46:14 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:46:14 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:46:14 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:46:14 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:46:16 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:46:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582213
Mon 20 Jan 2014 02:46:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:46:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582213
Mon 20 Jan 2014 02:46:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:46:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:46:19 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:46:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:46:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 02:46:20 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:46:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 02:46:20 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:46:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8892 values 140243 bits 17530 bytes 
Mon 20 Jan 2014 02:46:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:46:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:46:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:46:24 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:46:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:46:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:46:25 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:46:25 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:46:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:46:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582213
Mon 20 Jan 2014 02:46:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:46:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:46:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:46:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:46:29 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:46:29 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:46:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:46:36 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:46:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:46:38 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:46:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:46:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:46:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:46:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:46:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:46:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:46:40 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:46:40 - job_xml_thread(): Done retrieving: data size 43562233
Mon 20 Jan 2014 02:46:40 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:46:40 - XML: Start document: iteration 2
Mon 20 Jan 2014 02:46:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:46:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:46:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562233
Mon 20 Jan 2014 02:46:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:46:41 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:46:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:46:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562233
Mon 20 Jan 2014 02:46:42 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:46:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:46:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:46:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:46:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:46:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:46:55 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:46:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:46:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:46:57 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:46:57 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:46:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:46:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:46:58 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:46:59 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:46:59 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:46:59 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:46:59 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:46:59 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:47:02 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:47:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 02:47:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:47:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:47:03 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:47:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:47:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:47:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:47:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:47:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:47:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:47:05 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:47:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569424
Mon 20 Jan 2014 02:47:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:47:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569424
Mon 20 Jan 2014 02:47:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:47:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:47:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:47:15 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:47:15 - job_xml_thread(): Done retrieving: data size 43569424
Mon 20 Jan 2014 02:47:15 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:47:15 - XML: Start document: iteration 3
Mon 20 Jan 2014 02:47:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:47:18 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:47:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:47:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:47:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:47:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:47:20 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:47:20 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:47:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:47:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:47:20 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:47:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:47:20 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:47:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:47:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 02:47:21 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:47:22 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:47:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 02:47:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5955 values 94148 bits 11768 bytes 
Mon 20 Jan 2014 02:47:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:47:24 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:47:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:47:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:47:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:47:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:47:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:47:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:47:26 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:47:26 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:47:26 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:47:26 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:47:26 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:47:29 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:47:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43514105
Mon 20 Jan 2014 02:47:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:47:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43514105
Mon 20 Jan 2014 02:47:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:47:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:47:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:47:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:47:39 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:47:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:47:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:47:39 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:47:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:47:39 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:47:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:47:39 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:47:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:47:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:47:42 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:47:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:47:44 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:47:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:47:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:47:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:47:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:47:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:47:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:47:44 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:47:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 02:47:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:47:46 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:47:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42979979
Mon 20 Jan 2014 02:47:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:47:46 - job_xml_thread(): Done retrieving: data size 42979979
Mon 20 Jan 2014 02:47:46 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:47:46 - XML: Start document: iteration 4
Mon 20 Jan 2014 02:47:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42979979
Mon 20 Jan 2014 02:47:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:47:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:47:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:47:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:47:58 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:47:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:47:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:47:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:47:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:47:59 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:47:59 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:48:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:48:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:48:00 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:48:04 - XML: Processed 645810 elements - found 0 jobs
Mon 20 Jan 2014 02:48:04 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:48:04 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:48:04 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:48:04 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:48:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:48:08 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:48:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:48:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:48:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:48:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:48:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:48:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:48:10 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:48:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42899583
Mon 20 Jan 2014 02:48:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:48:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42899583
Mon 20 Jan 2014 02:48:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:48:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:48:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:48:19 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:48:20 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:48:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:48:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:48:22 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:48:22 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:48:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:48:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:48:23 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:48:23 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:48:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:48:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:48:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:48:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 02:48:23 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:48:23 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:48:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 02:48:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8684 values 137220 bits 17152 bytes 
Mon 20 Jan 2014 02:48:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:48:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:48:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:48:26 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:48:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:48:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:48:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:48:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:48:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:48:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:48:28 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:48:28 - job_xml_thread(): Done retrieving: data size 42984442
Mon 20 Jan 2014 02:48:28 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:48:28 - XML: Start document: iteration 5
Mon 20 Jan 2014 02:48:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42984442
Mon 20 Jan 2014 02:48:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42984442
Mon 20 Jan 2014 02:48:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:48:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:48:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:48:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:48:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:48:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:48:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:48:47 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:48:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:48:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:48:48 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:48:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:48:48 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:48:48 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:48:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:48:48 - XML: Processed 645902 elements - found 0 jobs
Mon 20 Jan 2014 02:48:48 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:48:48 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:48:48 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:48:48 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:48:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:48:51 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:48:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:48:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:48:51 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:48:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 02:48:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:48:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:48:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:48:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:48:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:48:53 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:48:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43546436
Mon 20 Jan 2014 02:48:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:48:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43546436
Mon 20 Jan 2014 02:48:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:49:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:49:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:49:03 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:49:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:49:03 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:49:03 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:49:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:49:04 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:49:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:49:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:49:05 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:49:05 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:49:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:49:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:49:06 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:49:06 - job_xml_thread(): Done retrieving: data size 43579855
Mon 20 Jan 2014 02:49:06 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:49:06 - XML: Start document: iteration 6
Mon 20 Jan 2014 02:49:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:49:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:49:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579855
Mon 20 Jan 2014 02:49:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:49:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:49:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:49:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:49:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579855
Mon 20 Jan 2014 02:49:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:49:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:49:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:49:19 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:49:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:49:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:49:21 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:49:22 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:49:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:49:22 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:49:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:49:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:49:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:49:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:49:23 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:49:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:49:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 02:49:24 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:49:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 02:49:24 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:49:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8801 values 138898 bits 17362 bytes 
Mon 20 Jan 2014 02:49:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:49:28 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:49:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:49:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:49:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:49:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:49:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:49:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:49:29 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:49:29 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:49:29 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:49:29 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:49:29 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:49:32 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:49:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561375
Mon 20 Jan 2014 02:49:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:49:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561375
Mon 20 Jan 2014 02:49:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:49:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:49:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:49:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:49:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:49:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:49:44 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:49:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:49:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:49:45 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:49:45 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:49:45 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:49:45 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:49:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:49:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:49:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:49:48 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:49:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:49:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:49:48 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:49:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 02:49:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:49:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:49:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:49:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:49:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:49:49 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 02:49:49 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:49:49 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:49:49 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:49:49 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 02:49:49 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 02:49:49 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 02:49:50 - size of cluster 'LISA Cluster': 624 hosts 79473 metrics 893897 values 14117339 bits 1764667 bytes 
Mon 20 Jan 2014 02:49:51 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:49:51 - job_xml_thread(): Done retrieving: data size 43572461
Mon 20 Jan 2014 02:49:51 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:49:51 - XML: Start document: iteration 7
Mon 20 Jan 2014 02:49:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572461
Mon 20 Jan 2014 02:49:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572461
Mon 20 Jan 2014 02:49:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:49:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:50:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:50:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:50:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:50:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:50:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:50:09 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:50:09 - XML: Processed 653348 elements - found 0 jobs
Mon 20 Jan 2014 02:50:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:50:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:50:09 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:50:09 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:50:09 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:50:09 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:50:10 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:50:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:50:10 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:50:10 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:50:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:50:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:50:13 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:50:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:50:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:50:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:50:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:50:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:50:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:50:17 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:50:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574935
Mon 20 Jan 2014 02:50:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:50:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574935
Mon 20 Jan 2014 02:50:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:50:24 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:50:24 - job_xml_thread(): Done retrieving: data size 43574935
Mon 20 Jan 2014 02:50:24 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:50:24 - XML: Start document: iteration 8
Mon 20 Jan 2014 02:50:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:50:25 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:50:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:50:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:50:26 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:50:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:50:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 02:50:26 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:50:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 02:50:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8757 values 138054 bits 17256 bytes 
Mon 20 Jan 2014 02:50:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:50:27 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:50:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:50:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:50:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:50:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:50:30 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:50:30 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:50:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:50:30 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:50:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:50:35 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:50:35 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:50:35 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:50:35 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:50:35 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:50:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:50:40 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:50:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:50:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:50:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:50:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:50:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:50:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:50:43 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:50:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566054
Mon 20 Jan 2014 02:50:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:50:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566054
Mon 20 Jan 2014 02:50:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:50:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:50:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:50:50 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:50:50 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 02:50:50 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:50:50 - job_xml_thread(): Done retrieving: data size 43566054
Mon 20 Jan 2014 02:50:50 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:50:50 - XML: Start document: iteration 9
Mon 20 Jan 2014 02:50:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:50:55 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:50:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:50:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:50:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:50:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:50:57 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:50:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:50:57 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:50:57 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:50:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:51:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:51:03 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:51:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:51:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:51:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:51:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:51:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:51:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:51:06 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:51:06 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:51:06 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:51:06 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:51:06 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:51:07 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:51:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 02:51:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:51:10 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:51:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556498
Mon 20 Jan 2014 02:51:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:51:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556498
Mon 20 Jan 2014 02:51:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:51:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:51:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:51:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:51:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:51:21 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:51:21 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:51:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:51:21 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:51:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:51:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:51:22 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:51:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:51:22 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:51:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:51:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:51:25 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:51:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:51:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:51:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:51:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:51:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:51:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:51:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:51:26 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:51:26 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:51:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 02:51:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:51:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 02:51:26 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:51:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5813 values 91691 bits 11461 bytes 
Mon 20 Jan 2014 02:51:28 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:51:28 - job_xml_thread(): Done retrieving: data size 43583973
Mon 20 Jan 2014 02:51:28 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:51:28 - XML: Start document: iteration 10
Mon 20 Jan 2014 02:51:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583973
Mon 20 Jan 2014 02:51:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:51:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583973
Mon 20 Jan 2014 02:51:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:51:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:51:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:51:38 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:51:38 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:51:38 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:51:38 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:51:38 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:51:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:51:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:51:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:51:48 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:51:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:51:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:51:49 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:51:49 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:51:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:51:49 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:51:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:51:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:51:50 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:51:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:51:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:51:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:51:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:51:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:51:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:51:53 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:51:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 02:51:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:51:53 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:51:54 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:51:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579907
Mon 20 Jan 2014 02:51:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:51:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579907
Mon 20 Jan 2014 02:51:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:51:55 - job_xml_thread(): Done retrieving: data size 43579907
Mon 20 Jan 2014 02:51:55 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:51:55 - XML: Start document: iteration 11
Mon 20 Jan 2014 02:52:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:52:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:52:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:52:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:52:12 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:52:12 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:52:12 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:52:12 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:52:12 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:52:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:52:13 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:52:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:52:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:52:14 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:52:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:52:14 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:52:14 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:52:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:52:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:52:16 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:52:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:52:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:52:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:52:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:52:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:52:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:52:20 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:52:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574046
Mon 20 Jan 2014 02:52:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:52:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574046
Mon 20 Jan 2014 02:52:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:52:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:52:26 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:52:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:52:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 02:52:27 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:52:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7712 values 121591 bits 15198 bytes 
Mon 20 Jan 2014 02:52:27 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:52:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 02:52:28 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:52:28 - job_xml_thread(): Done retrieving: data size 43574046
Mon 20 Jan 2014 02:52:28 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:52:28 - XML: Start document: iteration 12
Mon 20 Jan 2014 02:52:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:52:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:52:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:52:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:52:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:52:33 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:52:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:52:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:52:34 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:52:34 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:52:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:52:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:52:34 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:52:42 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:52:42 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:52:42 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:52:42 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:52:42 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:52:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:52:45 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:52:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:52:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:52:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:52:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:52:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:52:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:52:48 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:52:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553114
Mon 20 Jan 2014 02:52:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:52:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553114
Mon 20 Jan 2014 02:52:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:52:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:52:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:52:57 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:52:57 - job_xml_thread(): Done retrieving: data size 43553114
Mon 20 Jan 2014 02:52:57 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:52:57 - XML: Start document: iteration 13
Mon 20 Jan 2014 02:53:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:53:00 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:53:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:53:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:53:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:53:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:53:01 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:53:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:53:01 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:53:01 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:53:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:53:10 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:53:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 02:53:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:53:11 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:53:11 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:53:11 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:53:11 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:53:11 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:53:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:53:12 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:53:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:53:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:53:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:53:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:53:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:53:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:53:15 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:53:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566645
Mon 20 Jan 2014 02:53:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:53:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566645
Mon 20 Jan 2014 02:53:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:53:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:53:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:53:26 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:53:26 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:53:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:53:27 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:53:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:53:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 02:53:27 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:53:28 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:53:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 02:53:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5747 values 90614 bits 11326 bytes 
Mon 20 Jan 2014 02:53:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:53:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:53:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:53:29 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:53:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:53:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:53:30 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:53:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:53:30 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:53:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:53:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:53:31 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:53:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:53:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:53:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:53:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:53:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:53:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:53:33 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:53:33 - job_xml_thread(): Done retrieving: data size 43215194
Mon 20 Jan 2014 02:53:33 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:53:33 - XML: Start document: iteration 14
Mon 20 Jan 2014 02:53:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43215194
Mon 20 Jan 2014 02:53:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:53:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43215194
Mon 20 Jan 2014 02:53:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:53:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:53:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:53:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:53:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:53:52 - XML: Processed 649076 elements - found 0 jobs
Mon 20 Jan 2014 02:53:52 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:53:52 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:53:52 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:53:52 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:53:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:53:54 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:53:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:53:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:53:55 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:53:55 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:53:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:53:55 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:53:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:53:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:53:58 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:53:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:53:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:53:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:53:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:53:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:53:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:53:58 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:53:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 02:53:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:54:01 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 02:54:01 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 02:54:01 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:54:01 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:54:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42917408
Mon 20 Jan 2014 02:54:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:54:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42917408
Mon 20 Jan 2014 02:54:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:54:08 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:54:08 - job_xml_thread(): Done retrieving: data size 42917408
Mon 20 Jan 2014 02:54:08 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:54:08 - XML: Start document: iteration 15
Mon 20 Jan 2014 02:54:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:54:09 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:54:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:54:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:54:10 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:54:10 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:54:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:54:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42917408
Mon 20 Jan 2014 02:54:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:54:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:54:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:54:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:54:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:54:25 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:54:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:54:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:54:26 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:54:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:54:26 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:54:26 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:54:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:54:27 - XML: Processed 645152 elements - found 0 jobs
Mon 20 Jan 2014 02:54:27 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:54:27 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:54:27 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:54:27 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:54:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:54:28 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:54:28 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:54:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:54:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 02:54:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 02:54:29 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:54:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5463 values 86100 bits 10762 bytes 
Mon 20 Jan 2014 02:54:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:54:29 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:54:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:54:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:54:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:54:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:54:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:54:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:54:32 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:54:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43135084
Mon 20 Jan 2014 02:54:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:54:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43135084
Mon 20 Jan 2014 02:54:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:54:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:54:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:54:42 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:54:43 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:54:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:54:44 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:54:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:54:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:54:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:54:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:54:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:54:45 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:54:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:54:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:54:46 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:54:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 02:54:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:54:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:54:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:54:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:54:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:54:46 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:54:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:54:46 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:54:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:54:47 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:54:47 - job_xml_thread(): Done retrieving: data size 43507007
Mon 20 Jan 2014 02:54:47 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:54:47 - XML: Start document: iteration 16
Mon 20 Jan 2014 02:54:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43507007
Mon 20 Jan 2014 02:54:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:54:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43507007
Mon 20 Jan 2014 02:54:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:54:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:54:59 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:55:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:55:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:55:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:55:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:55:01 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:55:01 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:55:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:55:01 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:55:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:55:07 - XML: Processed 652318 elements - found 0 jobs
Mon 20 Jan 2014 02:55:07 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:55:07 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:55:07 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:55:07 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:55:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:55:09 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:55:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:55:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:55:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:55:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:55:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:55:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:55:11 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:55:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559555
Mon 20 Jan 2014 02:55:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:55:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559555
Mon 20 Jan 2014 02:55:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:55:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:55:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:55:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:55:20 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:55:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:55:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:55:21 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:55:21 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:55:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:55:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:55:21 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:55:22 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:55:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:55:24 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:55:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:55:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:55:25 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:55:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43585195
Mon 20 Jan 2014 02:55:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:55:26 - job_xml_thread(): Done retrieving: data size 43585195
Mon 20 Jan 2014 02:55:26 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:55:26 - XML: Start document: iteration 17
Mon 20 Jan 2014 02:55:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:55:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:55:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43585195
Mon 20 Jan 2014 02:55:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:55:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:55:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:55:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:55:29 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:55:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:55:31 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:55:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 02:55:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 02:55:31 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:55:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 11974 values 188783 bits 23597 bytes 
Mon 20 Jan 2014 02:55:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:55:34 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:55:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:55:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:55:36 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:55:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:55:36 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:55:36 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:55:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:55:42 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:55:42 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:55:42 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:55:42 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:55:42 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:55:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:55:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:55:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:55:46 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:55:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:55:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:55:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:55:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:55:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:55:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:55:48 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:55:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553685
Mon 20 Jan 2014 02:55:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:55:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553685
Mon 20 Jan 2014 02:55:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:55:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:55:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:55:57 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:55:57 - job_xml_thread(): Done retrieving: data size 43553685
Mon 20 Jan 2014 02:55:57 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:55:57 - XML: Start document: iteration 18
Mon 20 Jan 2014 02:55:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:55:58 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:55:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:55:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:56:01 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:56:01 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:56:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:56:01 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:56:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:56:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:56:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:56:07 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:56:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 02:56:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:56:11 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:56:11 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:56:11 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:56:11 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:56:11 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:56:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:56:12 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:56:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:56:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:56:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:56:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:56:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:56:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:56:14 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:56:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562977
Mon 20 Jan 2014 02:56:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:56:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562977
Mon 20 Jan 2014 02:56:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:56:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:56:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:56:27 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:56:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:56:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:56:27 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:56:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:56:29 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:56:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:56:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:56:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:56:30 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:56:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:56:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:56:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:56:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:56:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:56:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:56:30 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:56:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:56:30 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:56:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:56:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:56:31 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:56:32 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:56:32 - job_xml_thread(): Done retrieving: data size 43596970
Mon 20 Jan 2014 02:56:32 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:56:32 - XML: Start document: iteration 19
Mon 20 Jan 2014 02:56:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43596970
Mon 20 Jan 2014 02:56:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:56:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43596970
Mon 20 Jan 2014 02:56:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:56:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:56:33 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:56:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 02:56:34 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:56:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 02:56:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6510 values 102711 bits 12838 bytes 
Mon 20 Jan 2014 02:56:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:56:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:56:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:56:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:56:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:56:45 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:56:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:56:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:56:46 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:56:46 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:56:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:56:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:56:46 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:56:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:56:48 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:56:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:56:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:56:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:56:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:56:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:56:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:56:50 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 02:56:50 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:56:51 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:56:51 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 02:56:51 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:56:51 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 02:56:51 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 02:56:53 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:56:53 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:56:53 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:56:53 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:56:53 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:56:54 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 860027 values 13561335 bits 1695166 bytes 
Mon 20 Jan 2014 02:56:58 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:56:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572767
Mon 20 Jan 2014 02:56:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:56:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572767
Mon 20 Jan 2014 02:56:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:57:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:57:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:57:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:57:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:57:08 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:57:08 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:57:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:57:10 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:57:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:57:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:57:10 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:57:10 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:57:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:57:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:57:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:57:14 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:57:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:57:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:57:14 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:57:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 02:57:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:57:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:57:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:57:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:57:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:57:17 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:57:17 - job_xml_thread(): Done retrieving: data size 43578919
Mon 20 Jan 2014 02:57:17 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:57:17 - XML: Start document: iteration 20
Mon 20 Jan 2014 02:57:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578919
Mon 20 Jan 2014 02:57:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:57:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578919
Mon 20 Jan 2014 02:57:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:57:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:57:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:57:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:57:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:57:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:57:31 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:57:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:57:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:57:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:57:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:57:32 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:57:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:57:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:57:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:57:34 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:57:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:57:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 02:57:34 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:57:34 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:57:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5873 values 92638 bits 11579 bytes 
Mon 20 Jan 2014 02:57:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 02:57:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:57:38 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:57:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:57:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:57:39 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:57:39 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:57:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:57:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:57:40 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:57:40 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:57:40 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:57:40 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:57:40 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:57:44 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:57:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575366
Mon 20 Jan 2014 02:57:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:57:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575366
Mon 20 Jan 2014 02:57:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:57:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:57:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:57:51 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:57:51 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 02:57:52 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:57:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 02:57:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:57:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:57:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:57:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:57:54 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:57:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:57:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:57:55 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:57:55 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:57:55 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:57:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:57:55 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:57:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:57:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:57:58 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:57:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:57:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:57:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:57:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:57:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:57:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:58:01 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:58:01 - job_xml_thread(): Done retrieving: data size 43598877
Mon 20 Jan 2014 02:58:01 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:58:01 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 02:58:01 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 02:58:01 - Housekeeping: done.
Mon 20 Jan 2014 02:58:01 - XML: Start document: iteration 0
Mon 20 Jan 2014 02:58:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43598877
Mon 20 Jan 2014 02:58:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43598877
Mon 20 Jan 2014 02:58:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:58:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:58:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:58:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:58:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:58:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:58:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:58:18 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:58:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:58:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:58:18 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:58:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:58:18 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:58:19 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:58:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:58:19 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:58:19 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:58:19 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:58:19 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:58:19 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:58:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:58:22 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:58:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:58:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:58:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:58:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:58:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:58:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:58:25 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:58:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43587763
Mon 20 Jan 2014 02:58:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:58:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43587763
Mon 20 Jan 2014 02:58:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:58:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:58:32 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:58:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:58:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:58:34 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:58:34 - job_xml_thread(): Done retrieving: data size 43587763
Mon 20 Jan 2014 02:58:34 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:58:34 - XML: Start document: iteration 1
Mon 20 Jan 2014 02:58:34 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:58:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:58:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43587763
Mon 20 Jan 2014 02:58:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:58:35 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:58:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:58:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:58:35 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:58:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:58:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 02:58:36 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:58:36 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:58:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 02:58:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9167 values 144640 bits 18080 bytes 
Mon 20 Jan 2014 02:58:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:58:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:58:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:58:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:58:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:58:51 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:58:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:58:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:58:52 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:58:52 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:58:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:58:52 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:58:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:58:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:58:53 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:58:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:58:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:58:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:58:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:58:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:58:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:58:54 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 02:58:54 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:58:54 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:58:54 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:58:54 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:58:57 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:58:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43597858
Mon 20 Jan 2014 02:58:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:58:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43597858
Mon 20 Jan 2014 02:58:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:59:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:59:05 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:59:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:59:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:59:07 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:59:07 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:59:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:59:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:59:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43597858
Mon 20 Jan 2014 02:59:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:59:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:59:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:59:09 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 02:59:09 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:59:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:59:17 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:59:17 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:59:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 02:59:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:59:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:59:20 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:59:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:59:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:59:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:59:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:59:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:59:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:59:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:59:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:59:23 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:59:23 - job_xml_thread(): Done retrieving: data size 43476459
Mon 20 Jan 2014 02:59:23 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 02:59:23 - XML: Start document: iteration 2
Mon 20 Jan 2014 02:59:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43476459
Mon 20 Jan 2014 02:59:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:59:24 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:59:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:59:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43476459
Mon 20 Jan 2014 02:59:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:59:24 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:59:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:59:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:59:35 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:59:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 02:59:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:59:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:59:36 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:59:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:59:38 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:59:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 02:59:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 02:59:38 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 02:59:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5952 values 93874 bits 11734 bytes 
Mon 20 Jan 2014 02:59:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:59:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:59:40 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:59:40 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:59:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:59:40 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:59:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:59:44 - XML: Processed 652602 elements - found 0 jobs
Mon 20 Jan 2014 02:59:44 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 02:59:44 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 02:59:44 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 02:59:44 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 02:59:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 02:59:44 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 02:59:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 02:59:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 02:59:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:59:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 02:59:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 02:59:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 02:59:47 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 02:59:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42964466
Mon 20 Jan 2014 02:59:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 02:59:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42964466
Mon 20 Jan 2014 02:59:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 02:59:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 02:59:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 02:59:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 02:59:58 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 02:59:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 02:59:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 02:59:59 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:59:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 02:59:59 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 02:59:59 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 02:59:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 02:59:59 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:00:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:00:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:00:01 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:00:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 03:00:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:00:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:00:04 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:00:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:00:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:00:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:00:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:00:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:00:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:00:06 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:00:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42896057
Mon 20 Jan 2014 03:00:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:00:06 - job_xml_thread(): Done retrieving: data size 42896057
Mon 20 Jan 2014 03:00:06 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:00:07 - XML: Start document: iteration 3
Mon 20 Jan 2014 03:00:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42896057
Mon 20 Jan 2014 03:00:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:00:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:00:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:00:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:00:17 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:00:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:00:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:00:18 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:00:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:00:18 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:00:18 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:00:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:00:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:00:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:00:23 - XML: Processed 645152 elements - found 0 jobs
Mon 20 Jan 2014 03:00:23 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:00:23 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:00:23 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:00:23 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:00:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:00:27 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:00:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:00:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:00:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:00:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:00:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:00:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:00:30 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:00:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43002152
Mon 20 Jan 2014 03:00:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:00:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43002152
Mon 20 Jan 2014 03:00:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:00:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:00:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:00:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:00:38 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:00:38 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:00:39 - job_xml_thread(): Done retrieving: data size 43002152
Mon 20 Jan 2014 03:00:39 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:00:39 - XML: Start document: iteration 4
Mon 20 Jan 2014 03:00:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:00:40 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:00:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 03:00:40 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:00:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 03:00:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9120 values 143832 bits 17979 bytes 
Mon 20 Jan 2014 03:00:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:00:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:00:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:00:46 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:00:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:00:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:00:46 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:00:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:00:46 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:00:46 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:00:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:00:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:00:50 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:00:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:00:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:00:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:00:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:00:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:00:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:00:52 - XML: Processed 646298 elements - found 0 jobs
Mon 20 Jan 2014 03:00:52 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:00:52 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:00:52 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:00:52 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:00:56 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:00:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43532884
Mon 20 Jan 2014 03:00:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:00:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43532884
Mon 20 Jan 2014 03:00:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:01:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:01:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:01:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:01:05 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:01:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:01:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:01:05 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:01:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:01:05 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:01:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:01:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43532884
Mon 20 Jan 2014 03:01:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:01:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:01:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:01:07 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:01:07 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:01:08 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:01:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 03:01:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:01:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:01:15 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:01:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:01:17 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:01:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:01:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:01:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:01:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:01:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:01:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:01:19 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 03:01:19 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 03:01:19 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:01:19 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:01:19 - job_xml_thread(): Done retrieving: data size 43541055
Mon 20 Jan 2014 03:01:19 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:01:19 - XML: Start document: iteration 5
Mon 20 Jan 2014 03:01:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43541055
Mon 20 Jan 2014 03:01:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:01:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:01:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:01:22 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:01:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:01:23 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:01:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:01:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43541055
Mon 20 Jan 2014 03:01:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:01:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:01:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:01:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:01:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:01:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:01:38 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:01:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:01:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:01:39 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:01:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:01:39 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:01:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:01:39 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:01:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:01:40 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:01:41 - XML: Processed 653349 elements - found 0 jobs
Mon 20 Jan 2014 03:01:41 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:01:41 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:01:41 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:01:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 03:01:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:01:42 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:01:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 03:01:42 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:01:42 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:01:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6123 values 96744 bits 12093 bytes 
Mon 20 Jan 2014 03:01:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:01:43 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:01:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:01:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:01:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:01:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:01:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:01:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:01:45 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:01:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 03:01:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:01:45 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:01:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43586822
Mon 20 Jan 2014 03:01:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:01:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43586822
Mon 20 Jan 2014 03:01:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:01:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:01:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:01:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:01:56 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:01:57 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:01:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:01:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:01:57 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:01:58 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:01:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:01:58 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:01:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:01:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:01:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:01:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:01:59 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:01:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:01:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:02:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:02:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:02:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:02:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:02:00 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:02:00 - job_xml_thread(): Done retrieving: data size 43584844
Mon 20 Jan 2014 03:02:00 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:02:00 - XML: Start document: iteration 6
Mon 20 Jan 2014 03:02:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584844
Mon 20 Jan 2014 03:02:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:02:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584844
Mon 20 Jan 2014 03:02:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:02:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:02:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:02:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:02:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:02:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:02:17 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:02:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:02:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:02:18 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:02:18 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:02:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:02:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:02:18 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:02:20 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:02:20 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:02:20 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:02:20 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:02:20 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:02:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:02:23 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:02:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:02:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:02:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:02:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:02:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:02:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:02:25 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:02:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43587804
Mon 20 Jan 2014 03:02:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:02:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43587804
Mon 20 Jan 2014 03:02:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:02:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:02:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:02:35 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:02:35 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:02:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:02:37 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:02:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:02:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:02:37 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:02:37 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:02:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:02:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:02:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:02:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:02:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:02:38 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:02:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:02:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:02:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:02:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:02:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:02:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:02:40 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:02:40 - job_xml_thread(): Done retrieving: data size 43602896
Mon 20 Jan 2014 03:02:40 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:02:40 - XML: Start document: iteration 7
Mon 20 Jan 2014 03:02:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43602896
Mon 20 Jan 2014 03:02:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:02:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43602896
Mon 20 Jan 2014 03:02:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:02:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:02:42 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:02:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:02:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 03:02:44 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:02:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 12419 values 196457 bits 24557 bytes 
Mon 20 Jan 2014 03:02:44 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:02:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 03:02:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:02:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:02:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:02:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:02:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:02:54 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:02:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:02:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:02:55 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:02:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:02:55 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:02:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:02:55 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:02:58 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:02:58 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:02:58 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:02:58 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:02:58 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:03:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:03:02 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:03:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:03:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:03:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:03:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:03:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:03:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:03:05 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:03:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559406
Mon 20 Jan 2014 03:03:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:03:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559406
Mon 20 Jan 2014 03:03:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:03:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:03:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:03:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:03:13 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:03:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:03:13 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:03:13 - job_xml_thread(): Done retrieving: data size 43559406
Mon 20 Jan 2014 03:03:13 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:03:13 - XML: Start document: iteration 8
Mon 20 Jan 2014 03:03:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:03:15 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:03:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:03:15 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:03:15 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:03:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:03:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:03:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:03:21 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:03:21 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:03:21 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:03:21 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:03:21 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:03:24 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:03:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 03:03:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:03:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:03:26 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:03:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:03:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:03:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:03:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:03:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:03:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:03:27 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:03:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573146
Mon 20 Jan 2014 03:03:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:03:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573146
Mon 20 Jan 2014 03:03:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:03:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:03:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:03:36 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:03:36 - job_xml_thread(): Done retrieving: data size 43573146
Mon 20 Jan 2014 03:03:36 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:03:36 - XML: Start document: iteration 9
Mon 20 Jan 2014 03:03:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:03:40 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:03:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:03:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:03:41 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:03:41 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:03:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:03:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:03:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:03:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:03:41 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:03:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:03:44 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:03:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:03:45 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:03:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 03:03:45 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:03:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 03:03:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5882 values 92897 bits 11612 bytes 
Mon 20 Jan 2014 03:03:46 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:03:46 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:03:46 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:03:46 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:03:46 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:03:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:03:49 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:03:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:03:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:03:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:03:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:03:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:03:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:03:51 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:03:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 03:03:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:03:51 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:03:51 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 03:03:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559397
Mon 20 Jan 2014 03:03:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:03:51 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:03:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559397
Mon 20 Jan 2014 03:03:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:03:55 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:03:55 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 03:03:55 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 03:03:55 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:03:55 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 03:03:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:03:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:04:01 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:04:01 - job_xml_thread(): Done retrieving: data size 43559397
Mon 20 Jan 2014 03:04:01 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:04:01 - XML: Start document: iteration 10
Mon 20 Jan 2014 03:04:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:04:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:04:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:04:08 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:04:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:04:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:04:10 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:04:10 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:04:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:04:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:04:10 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:04:12 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:04:12 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:04:12 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:04:12 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:04:12 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:04:15 - size of cluster 'LISA Cluster': 624 hosts 79475 metrics 809711 values 12792563 bits 1599070 bytes 
Mon 20 Jan 2014 03:04:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:04:16 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:04:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:04:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:04:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:04:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:04:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:04:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:04:19 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:04:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560981
Mon 20 Jan 2014 03:04:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:04:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560981
Mon 20 Jan 2014 03:04:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:04:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:04:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:04:27 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:04:27 - job_xml_thread(): Done retrieving: data size 43560981
Mon 20 Jan 2014 03:04:27 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:04:27 - XML: Start document: iteration 11
Mon 20 Jan 2014 03:04:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:04:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:04:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:04:32 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:04:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:04:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:04:33 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:04:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:04:33 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:04:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:04:34 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:04:38 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:04:38 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:04:38 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:04:38 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:04:38 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:04:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:04:41 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:04:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:04:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:04:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:04:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:04:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:04:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:04:44 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:04:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579980
Mon 20 Jan 2014 03:04:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:04:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579980
Mon 20 Jan 2014 03:04:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:04:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:04:45 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:04:47 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:04:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 03:04:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:04:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 03:04:47 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:04:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148654 bits 18581 bytes 
Mon 20 Jan 2014 03:04:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:04:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:04:53 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:04:53 - job_xml_thread(): Done retrieving: data size 43579980
Mon 20 Jan 2014 03:04:53 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:04:53 - XML: Start document: iteration 12
Mon 20 Jan 2014 03:04:55 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:04:55 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 03:04:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:04:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:05:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:05:04 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:05:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:05:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:05:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:05:04 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:05:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:05:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:05:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:05:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:05:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:05:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:05:05 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:05:06 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:05:06 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:05:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:05:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:05:08 - XML: Processed 653347 elements - found 0 jobs
Mon 20 Jan 2014 03:05:08 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:05:08 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:05:08 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:05:08 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:05:11 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:05:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43523412
Mon 20 Jan 2014 03:05:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:05:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43523412
Mon 20 Jan 2014 03:05:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:05:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:05:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:05:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:05:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:05:23 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:05:23 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:05:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:05:24 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:05:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:05:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:05:25 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:05:25 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:05:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:05:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:05:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:05:28 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:05:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:05:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:05:29 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:05:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 03:05:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:05:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:05:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:05:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:05:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:05:31 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:05:31 - job_xml_thread(): Done retrieving: data size 43496502
Mon 20 Jan 2014 03:05:31 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:05:31 - XML: Start document: iteration 13
Mon 20 Jan 2014 03:05:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43496502
Mon 20 Jan 2014 03:05:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:05:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43496502
Mon 20 Jan 2014 03:05:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:05:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:05:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:05:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:05:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:05:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:05:47 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:05:47 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:05:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:05:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 03:05:47 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:05:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 03:05:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5800 values 91503 bits 11437 bytes 
Mon 20 Jan 2014 03:05:48 - XML: Processed 652590 elements - found 0 jobs
Mon 20 Jan 2014 03:05:48 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:05:48 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:05:48 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:05:48 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:05:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:05:50 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:05:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:05:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:05:52 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:05:52 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:05:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:05:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:05:52 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:05:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:05:54 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:05:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:05:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:05:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:05:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:05:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:05:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:05:58 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:05:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42935765
Mon 20 Jan 2014 03:05:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:06:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42935765
Mon 20 Jan 2014 03:06:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:06:03 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:06:03 - job_xml_thread(): Done retrieving: data size 42935765
Mon 20 Jan 2014 03:06:03 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:06:03 - XML: Start document: iteration 14
Mon 20 Jan 2014 03:06:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:06:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:06:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:06:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:06:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:06:14 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:06:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:06:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:06:14 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:06:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:06:14 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:06:14 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:06:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:06:16 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:06:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 03:06:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:06:21 - XML: Processed 645191 elements - found 0 jobs
Mon 20 Jan 2014 03:06:21 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:06:21 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:06:21 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:06:21 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:06:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:06:22 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:06:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:06:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:06:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:06:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:06:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:06:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:06:25 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:06:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42970779
Mon 20 Jan 2014 03:06:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:06:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42970779
Mon 20 Jan 2014 03:06:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:06:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:06:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:06:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:06:35 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:06:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:06:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:06:36 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:06:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:06:36 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:06:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:06:36 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:06:36 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:06:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:06:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:06:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:06:39 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:06:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:06:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:06:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:06:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:06:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:06:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:06:42 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:06:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43385933
Mon 20 Jan 2014 03:06:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:06:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43385933
Mon 20 Jan 2014 03:06:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:06:43 - job_xml_thread(): Done retrieving: data size 43385933
Mon 20 Jan 2014 03:06:43 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:06:43 - XML: Start document: iteration 15
Mon 20 Jan 2014 03:06:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:06:48 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:06:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:06:49 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:06:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 03:06:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 03:06:49 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:06:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:06:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:06:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9049 values 142782 bits 17847 bytes 
Mon 20 Jan 2014 03:06:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:06:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:06:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:06:58 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:06:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:06:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:07:00 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:07:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:07:00 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:07:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:07:00 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:07:04 - XML: Processed 650750 elements - found 0 jobs
Mon 20 Jan 2014 03:07:04 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:07:04 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:07:04 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:07:04 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:07:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:07:06 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:07:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:07:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:07:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:07:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:07:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:07:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:07:10 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:07:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570603
Mon 20 Jan 2014 03:07:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:07:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570603
Mon 20 Jan 2014 03:07:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:07:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:07:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:07:19 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:07:19 - job_xml_thread(): Done retrieving: data size 43570603
Mon 20 Jan 2014 03:07:19 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:07:19 - XML: Start document: iteration 16
Mon 20 Jan 2014 03:07:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:07:20 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:07:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:07:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:07:21 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:07:21 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:07:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:07:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:07:21 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:07:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:07:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:07:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:07:29 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:07:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:07:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:07:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:07:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:07:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:07:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:07:33 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:07:33 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:07:33 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:07:33 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:07:33 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:07:33 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:07:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 03:07:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:07:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:07:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:07:37 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:07:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43541572
Mon 20 Jan 2014 03:07:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:07:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43541572
Mon 20 Jan 2014 03:07:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:07:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:07:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:07:48 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:07:48 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:07:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:07:49 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:07:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:07:49 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:07:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:07:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:07:50 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:07:50 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:07:50 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:07:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:07:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 03:07:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:07:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:07:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 03:07:50 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:07:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5762 values 90856 bits 11357 bytes 
Mon 20 Jan 2014 03:07:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:07:53 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:07:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:07:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:07:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:07:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:07:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:07:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:07:56 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:07:56 - job_xml_thread(): Done retrieving: data size 43583261
Mon 20 Jan 2014 03:07:56 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:07:56 - XML: Start document: iteration 17
Mon 20 Jan 2014 03:07:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583261
Mon 20 Jan 2014 03:07:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:07:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583261
Mon 20 Jan 2014 03:07:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:08:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:08:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:08:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:08:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:08:09 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 03:08:09 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 03:08:09 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:08:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:08:10 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:08:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:08:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:08:11 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:08:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:08:11 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:08:11 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:08:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:08:17 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:08:17 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:08:17 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:08:17 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:08:17 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:08:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:08:20 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:08:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:08:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:08:20 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:08:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 03:08:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:08:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:08:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:08:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:08:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:08:22 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:08:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558638
Mon 20 Jan 2014 03:08:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:08:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558638
Mon 20 Jan 2014 03:08:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:08:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:08:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:08:32 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:08:32 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:08:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:08:35 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:08:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:08:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:08:36 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:08:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:08:36 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:08:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:08:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:08:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:08:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:08:36 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:08:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:08:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:08:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:08:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:08:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:08:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:08:38 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:08:38 - job_xml_thread(): Done retrieving: data size 43587694
Mon 20 Jan 2014 03:08:38 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:08:38 - XML: Start document: iteration 18
Mon 20 Jan 2014 03:08:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43587694
Mon 20 Jan 2014 03:08:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:08:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43587694
Mon 20 Jan 2014 03:08:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:08:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:08:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:08:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:08:51 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:08:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:08:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:08:52 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:08:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 03:08:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:08:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 03:08:52 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:08:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:08:52 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:08:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:08:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:08:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8701 values 137187 bits 17148 bytes 
Mon 20 Jan 2014 03:08:53 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:08:53 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:08:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:08:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:08:53 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:08:55 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:08:55 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:08:55 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:08:55 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:08:55 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:09:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:09:00 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:09:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:09:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:09:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:09:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:09:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:09:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:09:03 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:09:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555745
Mon 20 Jan 2014 03:09:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:09:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555745
Mon 20 Jan 2014 03:09:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:09:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:09:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:09:10 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:09:10 - job_xml_thread(): Done retrieving: data size 43555745
Mon 20 Jan 2014 03:09:10 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:09:10 - XML: Start document: iteration 19
Mon 20 Jan 2014 03:09:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:09:15 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:09:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:09:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:09:16 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:09:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:09:16 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:09:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:09:16 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:09:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:09:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:09:21 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:09:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 03:09:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:09:26 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:09:26 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:09:26 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:09:26 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:09:26 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:09:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:09:27 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:09:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:09:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:09:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:09:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:09:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:09:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:09:29 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:09:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555792
Mon 20 Jan 2014 03:09:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:09:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555792
Mon 20 Jan 2014 03:09:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:09:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:09:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:09:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:09:37 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:09:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:09:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:09:38 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:09:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:09:38 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:09:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:09:39 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:09:41 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:09:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:09:42 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:09:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:09:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:09:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:09:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:09:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:09:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:09:44 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:09:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576327
Mon 20 Jan 2014 03:09:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:09:44 - job_xml_thread(): Done retrieving: data size 43576327
Mon 20 Jan 2014 03:09:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576327
Mon 20 Jan 2014 03:09:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:09:45 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:09:45 - XML: Start document: iteration 20
Mon 20 Jan 2014 03:09:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:09:52 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:09:53 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:09:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:09:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 03:09:53 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:09:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 03:09:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:09:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:09:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9079 values 143189 bits 17898 bytes 
Mon 20 Jan 2014 03:09:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:09:56 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:09:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:09:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:09:57 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:09:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:09:57 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:09:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:09:57 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:09:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:09:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:10:02 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:10:02 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:10:02 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:10:02 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:10:02 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:10:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:10:05 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:10:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:10:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:10:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:10:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:10:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:10:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:10:07 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:10:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568781
Mon 20 Jan 2014 03:10:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:10:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568781
Mon 20 Jan 2014 03:10:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:10:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:10:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:10:17 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:10:17 - job_xml_thread(): Done retrieving: data size 43568781
Mon 20 Jan 2014 03:10:17 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:10:17 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 03:10:17 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 03:10:17 - Housekeeping: done.
Mon 20 Jan 2014 03:10:17 - XML: Start document: iteration 0
Mon 20 Jan 2014 03:10:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:10:18 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:10:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:10:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:10:19 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:10:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:10:19 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:10:19 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:10:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:10:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:10:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:10:28 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:10:28 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:10:28 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:10:28 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:10:28 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:10:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:10:31 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:10:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:10:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:10:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:10:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:10:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:10:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:10:31 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:10:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 03:10:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:10:33 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:10:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43546833
Mon 20 Jan 2014 03:10:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:10:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43546833
Mon 20 Jan 2014 03:10:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:10:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:10:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:10:43 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:10:43 - job_xml_thread(): Done retrieving: data size 43546833
Mon 20 Jan 2014 03:10:43 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:10:43 - XML: Start document: iteration 1
Mon 20 Jan 2014 03:10:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:10:44 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:10:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:10:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:10:45 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:10:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:10:46 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:10:46 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:10:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:10:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:10:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:10:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:10:53 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:10:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:10:53 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:10:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:10:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:10:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:10:54 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:10:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 03:10:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 03:10:54 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:10:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5299 values 83536 bits 10442 bytes 
Mon 20 Jan 2014 03:10:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:10:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:10:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:10:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:10:55 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 03:10:55 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:10:56 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:10:56 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:10:56 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 03:10:56 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:10:56 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:10:56 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:10:56 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:10:56 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:10:56 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 03:10:56 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 03:10:56 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 841117 values 13260852 bits 1657606 bytes 
Mon 20 Jan 2014 03:11:01 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:11:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:11:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43547665
Mon 20 Jan 2014 03:11:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:11:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:11:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43547665
Mon 20 Jan 2014 03:11:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:11:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:11:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:11:11 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:11:11 - job_xml_thread(): Done retrieving: data size 43547665
Mon 20 Jan 2014 03:11:11 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:11:11 - XML: Start document: iteration 2
Mon 20 Jan 2014 03:11:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:11:19 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:11:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:11:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:11:20 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:11:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:11:21 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:11:21 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:11:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:11:24 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:11:24 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:11:24 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:11:24 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:11:24 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:11:24 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:11:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 03:11:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:11:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:11:25 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:11:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:11:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:11:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:11:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:11:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:11:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:11:28 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:11:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43508885
Mon 20 Jan 2014 03:11:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:11:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43508885
Mon 20 Jan 2014 03:11:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:11:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:11:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:11:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:11:38 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:11:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:11:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:11:39 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:11:39 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:11:39 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:11:39 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:11:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:11:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:11:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:11:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:11:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:11:42 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:11:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:11:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:11:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:11:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:11:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:11:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:11:45 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:11:45 - job_xml_thread(): Done retrieving: data size 42954232
Mon 20 Jan 2014 03:11:45 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:11:45 - XML: Start document: iteration 3
Mon 20 Jan 2014 03:11:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42954232
Mon 20 Jan 2014 03:11:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42954232
Mon 20 Jan 2014 03:11:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:11:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:11:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:11:54 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:11:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:11:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:11:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:11:54 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:11:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 03:11:54 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:11:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 03:11:56 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:11:56 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 03:11:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9157 values 144422 bits 18052 bytes 
Mon 20 Jan 2014 03:11:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:11:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:12:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:12:03 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:12:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:12:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:12:03 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:12:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:12:03 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:12:03 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:12:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:12:06 - XML: Processed 645850 elements - found 0 jobs
Mon 20 Jan 2014 03:12:06 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:12:06 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:12:06 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:12:06 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:12:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:12:09 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:12:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:12:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:12:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:12:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:12:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:12:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:12:12 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:12:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42937130
Mon 20 Jan 2014 03:12:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:12:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42937130
Mon 20 Jan 2014 03:12:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:12:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:12:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:12:21 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:12:21 - job_xml_thread(): Done retrieving: data size 42937130
Mon 20 Jan 2014 03:12:21 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:12:21 - XML: Start document: iteration 4
Mon 20 Jan 2014 03:12:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:12:24 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:12:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:12:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:12:24 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:12:24 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:12:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:12:24 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:12:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:12:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:12:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:12:30 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:12:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 03:12:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:12:33 - XML: Processed 645380 elements - found 0 jobs
Mon 20 Jan 2014 03:12:33 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:12:33 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:12:33 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:12:33 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:12:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:12:36 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:12:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:12:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:12:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:12:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:12:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:12:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:12:39 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:12:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43282069
Mon 20 Jan 2014 03:12:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:12:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:12:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:12:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43282069
Mon 20 Jan 2014 03:12:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:12:48 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:12:48 - job_xml_thread(): Done retrieving: data size 43282069
Mon 20 Jan 2014 03:12:48 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:12:48 - XML: Start document: iteration 5
Mon 20 Jan 2014 03:12:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:12:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:12:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:12:53 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:12:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:12:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:12:54 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:12:54 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:12:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:12:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:12:54 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:12:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:12:55 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:12:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:12:56 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:12:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:12:56 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:12:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 03:12:56 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:12:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:12:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:12:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 03:12:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6003 values 94678 bits 11834 bytes 
Mon 20 Jan 2014 03:12:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:12:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:12:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:12:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:13:01 - XML: Processed 650000 elements - found 0 jobs
Mon 20 Jan 2014 03:13:01 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:13:01 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:13:01 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:13:01 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:13:04 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:13:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555872
Mon 20 Jan 2014 03:13:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:13:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555872
Mon 20 Jan 2014 03:13:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:13:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:13:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:13:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:13:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:13:16 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:13:16 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:13:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:13:19 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:13:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:13:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:13:20 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:13:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:13:20 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:13:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:13:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:13:21 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:13:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:13:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:13:21 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:13:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 03:13:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:13:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:13:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:13:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:13:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:13:25 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:13:25 - job_xml_thread(): Done retrieving: data size 43575198
Mon 20 Jan 2014 03:13:25 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:13:25 - XML: Start document: iteration 6
Mon 20 Jan 2014 03:13:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575198
Mon 20 Jan 2014 03:13:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575198
Mon 20 Jan 2014 03:13:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:13:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:13:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:13:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:13:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:13:35 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:13:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:13:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:13:35 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:13:35 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:13:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:13:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:13:35 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:13:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:13:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:13:42 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:13:42 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:13:42 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:13:42 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:13:42 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:13:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:13:44 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:13:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:13:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:13:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:13:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:13:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:13:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:13:47 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:13:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43544082
Mon 20 Jan 2014 03:13:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:13:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43544082
Mon 20 Jan 2014 03:13:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:13:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:13:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:13:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:13:56 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:13:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:13:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:13:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:13:56 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:13:57 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:13:57 - job_xml_thread(): Done retrieving: data size 43544082
Mon 20 Jan 2014 03:13:57 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:13:57 - XML: Start document: iteration 7
Mon 20 Jan 2014 03:13:57 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:13:57 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:13:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:13:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:13:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43544082
Mon 20 Jan 2014 03:13:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:13:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:13:57 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:13:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 03:13:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 03:13:57 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:13:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8751 values 138007 bits 17250 bytes 
Mon 20 Jan 2014 03:13:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:13:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:14:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:14:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:14:16 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:14:16 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:14:16 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:14:16 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:14:16 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:14:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:14:17 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:14:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:14:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:14:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:14:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:14:18 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:14:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:14:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:14:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:14:18 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:14:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:14:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:14:19 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:14:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:14:19 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:14:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:14:22 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:14:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43593179
Mon 20 Jan 2014 03:14:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:14:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43593179
Mon 20 Jan 2014 03:14:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:14:31 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:14:31 - job_xml_thread(): Done retrieving: data size 43593179
Mon 20 Jan 2014 03:14:31 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:14:31 - XML: Start document: iteration 8
Mon 20 Jan 2014 03:14:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:14:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:14:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:14:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:14:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:14:35 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:14:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:14:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:14:36 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:14:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:14:36 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:14:36 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:14:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:14:44 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:14:44 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:14:44 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:14:44 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:14:44 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:14:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:14:45 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:14:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:14:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:14:46 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:14:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 03:14:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:14:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:14:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:14:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:14:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:14:49 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:14:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555705
Mon 20 Jan 2014 03:14:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:14:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555705
Mon 20 Jan 2014 03:14:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:14:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:14:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:14:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:14:58 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:14:59 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:14:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 03:14:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:14:59 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:14:59 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:14:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 03:14:59 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:15:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5980 values 94299 bits 11787 bytes 
Mon 20 Jan 2014 03:15:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:15:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:15:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:15:02 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:15:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:15:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:15:03 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:15:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:15:03 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:15:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:15:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:15:04 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:15:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:15:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:15:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:15:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:15:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:15:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:15:08 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:15:08 - job_xml_thread(): Done retrieving: data size 43583377
Mon 20 Jan 2014 03:15:08 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:15:08 - XML: Start document: iteration 9
Mon 20 Jan 2014 03:15:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583377
Mon 20 Jan 2014 03:15:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:15:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583377
Mon 20 Jan 2014 03:15:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:15:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:15:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:15:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:15:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:15:27 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:15:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 03:15:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:15:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:15:28 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:15:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:15:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:15:29 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:15:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:15:29 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:15:29 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:15:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:15:31 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:15:31 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:15:31 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:15:31 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:15:31 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:15:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:15:32 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:15:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:15:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:15:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:15:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:15:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:15:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:15:33 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 03:15:33 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 03:15:33 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:15:34 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:15:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583771
Mon 20 Jan 2014 03:15:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:15:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583771
Mon 20 Jan 2014 03:15:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:15:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:15:41 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:15:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:15:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:15:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:15:45 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:15:45 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:15:45 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:15:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:15:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:15:45 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:15:46 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:15:47 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:15:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43585922
Mon 20 Jan 2014 03:15:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:15:48 - job_xml_thread(): Done retrieving: data size 43585922
Mon 20 Jan 2014 03:15:48 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:15:48 - XML: Start document: iteration 10
Mon 20 Jan 2014 03:15:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:15:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:15:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:15:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:15:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:15:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:15:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43585922
Mon 20 Jan 2014 03:15:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:15:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:16:00 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:16:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:16:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:16:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:16:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 03:16:03 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:16:03 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:16:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 03:16:03 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:16:03 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:16:03 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:16:03 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:16:03 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:16:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9139 values 144173 bits 18021 bytes 
Mon 20 Jan 2014 03:16:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:16:04 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:16:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:16:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:16:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:16:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:16:05 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:16:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:16:05 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:16:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:16:05 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:16:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:16:09 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:16:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:16:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:16:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:16:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:16:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:16:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:16:11 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:16:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43588104
Mon 20 Jan 2014 03:16:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:16:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43588104
Mon 20 Jan 2014 03:16:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:16:14 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:16:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 03:16:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:16:18 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:16:18 - job_xml_thread(): Done retrieving: data size 43588104
Mon 20 Jan 2014 03:16:18 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:16:18 - XML: Start document: iteration 11
Mon 20 Jan 2014 03:16:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:16:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:16:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:16:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:16:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:16:25 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:16:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:16:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:16:26 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:16:26 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:16:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:16:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:16:26 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:16:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:16:27 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:16:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:16:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:16:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:16:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:16:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:16:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:16:28 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:16:28 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:16:28 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:16:28 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:16:28 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:16:30 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:16:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580538
Mon 20 Jan 2014 03:16:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:16:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580538
Mon 20 Jan 2014 03:16:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:16:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:16:40 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:16:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:16:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:16:43 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:16:43 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:16:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:16:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:16:43 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:16:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:16:43 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:16:43 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:16:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:16:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:16:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:16:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:16:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:16:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:16:45 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:16:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43588693
Mon 20 Jan 2014 03:16:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:16:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43588693
Mon 20 Jan 2014 03:16:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:16:46 - job_xml_thread(): Done retrieving: data size 43588693
Mon 20 Jan 2014 03:16:46 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:16:46 - XML: Start document: iteration 12
Mon 20 Jan 2014 03:16:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:16:55 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:16:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:16:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:16:59 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:16:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:16:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:16:59 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:16:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:16:59 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:16:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:17:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:17:03 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:17:04 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:17:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 03:17:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:17:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 03:17:04 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:17:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9242 values 146101 bits 18262 bytes 
Mon 20 Jan 2014 03:17:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:17:06 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:17:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:17:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:17:06 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:17:06 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:17:06 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:17:06 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:17:06 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:17:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:17:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:17:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:17:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:17:08 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:17:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43590644
Mon 20 Jan 2014 03:17:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:17:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43590644
Mon 20 Jan 2014 03:17:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:17:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:17:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:17:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:17:20 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:17:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:17:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:17:21 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:17:21 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:17:21 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:17:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:17:21 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:17:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:17:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:17:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:17:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:17:23 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:17:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:17:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:17:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:17:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:17:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:17:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:17:23 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:17:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 03:17:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:17:25 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:17:25 - job_xml_thread(): Done retrieving: data size 43539983
Mon 20 Jan 2014 03:17:25 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:17:25 - XML: Start document: iteration 13
Mon 20 Jan 2014 03:17:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43539983
Mon 20 Jan 2014 03:17:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43539983
Mon 20 Jan 2014 03:17:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:17:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:17:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:17:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:17:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:17:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:17:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:17:40 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:17:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:17:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:17:41 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:17:41 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:17:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:17:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:17:41 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:17:47 - XML: Processed 652590 elements - found 0 jobs
Mon 20 Jan 2014 03:17:47 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:17:47 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:17:47 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:17:47 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:17:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:17:48 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:17:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:17:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:17:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:17:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:17:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:17:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:17:49 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:17:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42968973
Mon 20 Jan 2014 03:17:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:17:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42968973
Mon 20 Jan 2014 03:17:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:17:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:17:56 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 03:17:56 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:17:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:17:59 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:17:59 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:17:59 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 03:17:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:17:59 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 03:17:59 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:17:59 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 03:18:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:18:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:18:01 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:18:01 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:18:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:18:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:18:01 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:18:02 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:18:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:18:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:18:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:18:04 - ganglia_store_thread(): finished: cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Mon 20 Jan 2014 03:18:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:18:05 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:18:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:18:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 03:18:05 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:18:05 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:18:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 03:18:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8782 values 138811 bits 17351 bytes 
Mon 20 Jan 2014 03:18:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:18:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:18:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:18:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:18:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:18:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:18:07 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:18:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42928916
Mon 20 Jan 2014 03:18:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:18:08 - job_xml_thread(): Done retrieving: data size 42928916
Mon 20 Jan 2014 03:18:08 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:18:08 - XML: Start document: iteration 14
Mon 20 Jan 2014 03:18:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42928916
Mon 20 Jan 2014 03:18:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:18:14 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:18:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 03:18:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:18:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:18:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:18:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:18:20 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:18:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:18:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:18:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:18:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:18:21 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:18:21 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:18:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:18:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:18:21 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:18:27 - XML: Processed 645152 elements - found 0 jobs
Mon 20 Jan 2014 03:18:27 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:18:27 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:18:27 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:18:27 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:18:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:18:29 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:18:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:18:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:18:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:18:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:18:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:18:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:18:30 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:18:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43275359
Mon 20 Jan 2014 03:18:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:18:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43275359
Mon 20 Jan 2014 03:18:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:18:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:18:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:18:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:18:40 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:18:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:18:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:18:41 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:18:41 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:18:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:18:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:18:41 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:18:42 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:18:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:18:43 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:18:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:18:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:18:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:18:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:18:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:18:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:18:45 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:18:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43505546
Mon 20 Jan 2014 03:18:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:18:45 - job_xml_thread(): Done retrieving: data size 43505546
Mon 20 Jan 2014 03:18:45 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:18:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43505546
Mon 20 Jan 2014 03:18:45 - XML: Start document: iteration 15
Mon 20 Jan 2014 03:18:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:18:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:18:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:18:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:18:59 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:18:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:18:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:18:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:18:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:18:59 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:18:59 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:19:00 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:19:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:19:00 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:19:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:19:00 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:19:00 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:19:00 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 03:19:00 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 03:19:00 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:19:00 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 03:19:01 - XML: Processed 652466 elements - found 0 jobs
Mon 20 Jan 2014 03:19:01 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:19:01 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:19:01 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:19:01 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:19:02 - size of cluster 'LISA Cluster': 624 hosts 79466 metrics 856025 values 13520926 bits 1690115 bytes 
Mon 20 Jan 2014 03:19:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:19:05 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:19:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:19:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 03:19:05 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:19:05 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:19:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 03:19:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9393 values 148419 bits 18552 bytes 
Mon 20 Jan 2014 03:19:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:19:07 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:19:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:19:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:19:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:19:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:19:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:19:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:19:10 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:19:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582442
Mon 20 Jan 2014 03:19:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:19:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582442
Mon 20 Jan 2014 03:19:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:19:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:19:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:19:16 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:19:16 - job_xml_thread(): Done retrieving: data size 43582442
Mon 20 Jan 2014 03:19:16 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:19:16 - XML: Start document: iteration 16
Mon 20 Jan 2014 03:19:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:19:22 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:19:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:19:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:19:22 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:19:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:19:22 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:19:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:19:22 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:19:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:19:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:19:30 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:19:30 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:19:30 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:19:30 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:19:30 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:19:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:19:33 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:19:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:19:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:19:33 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:19:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 03:19:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:19:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:19:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:19:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:19:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:19:37 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:19:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43545424
Mon 20 Jan 2014 03:19:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:19:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43545424
Mon 20 Jan 2014 03:19:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:19:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:19:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:19:45 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:19:45 - job_xml_thread(): Done retrieving: data size 43545424
Mon 20 Jan 2014 03:19:45 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:19:45 - XML: Start document: iteration 17
Mon 20 Jan 2014 03:19:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:19:46 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:19:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:19:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:19:48 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:19:48 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:19:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:19:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:19:48 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:19:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:19:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:19:54 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:19:54 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:19:54 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:19:54 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:19:54 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:19:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:19:57 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:19:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:19:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:19:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:19:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:19:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:19:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:20:01 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:20:01 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 03:20:01 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:20:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43541859
Mon 20 Jan 2014 03:20:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:20:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43541859
Mon 20 Jan 2014 03:20:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:20:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:20:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:20:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:20:05 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:20:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:20:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 03:20:06 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:20:06 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:20:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 03:20:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8802 values 138834 bits 17354 bytes 
Mon 20 Jan 2014 03:20:09 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:20:09 - job_xml_thread(): Done retrieving: data size 43541859
Mon 20 Jan 2014 03:20:09 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:20:09 - XML: Start document: iteration 18
Mon 20 Jan 2014 03:20:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:20:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:20:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:20:15 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:20:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:20:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:20:18 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:20:18 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:20:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:20:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:20:18 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:20:20 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:20:20 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:20:20 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:20:20 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:20:20 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:20:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:20:26 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:20:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:20:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:20:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:20:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:20:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:20:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:20:29 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:20:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43550234
Mon 20 Jan 2014 03:20:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:20:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43550234
Mon 20 Jan 2014 03:20:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:20:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:20:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:20:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:20:35 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:20:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:20:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:20:35 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:20:35 - job_xml_thread(): Done retrieving: data size 43550234
Mon 20 Jan 2014 03:20:35 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:20:35 - XML: Start document: iteration 19
Mon 20 Jan 2014 03:20:37 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:20:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:20:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43550234
Mon 20 Jan 2014 03:20:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:20:37 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:20:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:20:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:20:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:20:45 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:20:45 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:20:45 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:20:45 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:20:45 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:20:45 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:20:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 03:20:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:20:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:20:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:20:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:20:55 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:20:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:20:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:20:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:20:56 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:20:56 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:20:56 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:20:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:20:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:20:56 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:20:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:20:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:20:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:20:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:20:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:20:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:20:59 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 03:20:59 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 03:20:59 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:20:59 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:20:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574255
Mon 20 Jan 2014 03:20:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:21:00 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:21:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574255
Mon 20 Jan 2014 03:21:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:21:01 - job_xml_thread(): Done retrieving: data size 43574255
Mon 20 Jan 2014 03:21:01 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:21:01 - XML: Start document: iteration 20
Mon 20 Jan 2014 03:21:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:21:06 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:21:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:21:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 03:21:08 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:21:08 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:21:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 03:21:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6217 values 98068 bits 12258 bytes 
Mon 20 Jan 2014 03:21:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:21:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:21:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:21:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:21:12 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:21:12 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:21:12 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:21:12 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:21:12 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:21:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:21:17 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:21:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:21:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:21:19 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:21:19 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:21:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:21:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:21:19 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:21:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:21:20 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:21:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:21:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:21:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:21:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:21:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:21:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:21:23 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:21:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43603702
Mon 20 Jan 2014 03:21:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:21:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43603702
Mon 20 Jan 2014 03:21:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:21:27 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:21:27 - job_xml_thread(): Done retrieving: data size 43603702
Mon 20 Jan 2014 03:21:27 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:21:27 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 03:21:28 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 03:21:28 - Housekeeping: done.
Mon 20 Jan 2014 03:21:28 - XML: Start document: iteration 0
Mon 20 Jan 2014 03:21:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:21:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:21:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:21:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:21:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:21:36 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:21:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:21:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:21:37 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:21:37 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:21:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:21:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:21:37 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:21:41 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:21:42 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:21:42 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:21:42 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:21:42 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:21:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:21:45 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:21:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:21:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:21:45 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:21:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 03:21:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:21:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:21:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:21:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:21:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:21:47 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:21:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557595
Mon 20 Jan 2014 03:21:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:21:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557595
Mon 20 Jan 2014 03:21:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:21:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:21:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:21:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:21:55 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:21:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:21:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:21:56 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:21:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:21:56 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:21:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:21:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557595
Mon 20 Jan 2014 03:21:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:21:57 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:21:57 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:22:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:22:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:22:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:22:07 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:22:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:22:08 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:22:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:22:08 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:22:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:22:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:22:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:22:08 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:22:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 03:22:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 03:22:08 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:22:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5830 values 91959 bits 11494 bytes 
Mon 20 Jan 2014 03:22:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:22:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:22:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:22:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:22:11 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:22:11 - job_xml_thread(): Done retrieving: data size 43565882
Mon 20 Jan 2014 03:22:11 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:22:11 - XML: Start document: iteration 1
Mon 20 Jan 2014 03:22:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:22:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:22:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565882
Mon 20 Jan 2014 03:22:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:22:12 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:22:12 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:22:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:22:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:22:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565882
Mon 20 Jan 2014 03:22:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:22:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:22:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:22:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:22:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:22:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:22:32 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:22:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:22:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:22:33 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:22:33 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:22:33 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:22:33 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:22:33 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:22:33 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:22:33 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:22:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:22:33 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:22:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:22:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:22:35 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:22:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:22:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:22:36 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:22:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 03:22:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:22:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:22:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:22:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:22:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:22:37 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:22:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43600786
Mon 20 Jan 2014 03:22:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:22:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43600786
Mon 20 Jan 2014 03:22:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:22:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:22:48 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:22:48 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:22:48 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:22:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:22:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:22:49 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:22:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:22:49 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:22:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:22:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:22:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:22:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:22:51 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:22:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:22:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:22:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:22:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:22:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:22:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:22:54 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:22:54 - job_xml_thread(): Done retrieving: data size 43602012
Mon 20 Jan 2014 03:22:54 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:22:54 - XML: Start document: iteration 2
Mon 20 Jan 2014 03:22:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43602012
Mon 20 Jan 2014 03:22:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:22:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43602012
Mon 20 Jan 2014 03:22:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:23:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:23:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:23:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:23:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:23:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:23:09 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:23:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:23:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 03:23:10 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:23:10 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:23:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 03:23:10 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:23:10 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:23:10 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:23:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8605 values 135709 bits 16963 bytes 
Mon 20 Jan 2014 03:23:10 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:23:10 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:23:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:23:11 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:23:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:23:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:23:13 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:23:13 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:23:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:23:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:23:13 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:23:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:23:15 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:23:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:23:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:23:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:23:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:23:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:23:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:23:17 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:23:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43508542
Mon 20 Jan 2014 03:23:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:23:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43508542
Mon 20 Jan 2014 03:23:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:23:25 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:23:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:23:26 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:23:26 - job_xml_thread(): Done retrieving: data size 43508542
Mon 20 Jan 2014 03:23:26 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:23:26 - XML: Start document: iteration 3
Mon 20 Jan 2014 03:23:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:23:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:23:29 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:23:29 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:23:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:23:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:23:30 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:23:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:23:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:23:37 - XML: Processed 652602 elements - found 0 jobs
Mon 20 Jan 2014 03:23:37 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:23:37 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:23:37 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:23:37 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:23:38 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:23:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 03:23:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:23:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:23:39 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:23:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:23:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:23:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:23:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:23:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:23:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:23:41 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:23:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43041509
Mon 20 Jan 2014 03:23:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:23:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43041509
Mon 20 Jan 2014 03:23:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:23:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:23:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:23:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:23:51 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:23:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:23:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:23:52 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:23:52 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:23:53 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:23:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:23:53 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:23:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:23:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:23:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:23:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:23:55 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:23:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:23:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:23:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:23:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:23:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:23:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:23:56 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:23:56 - job_xml_thread(): Done retrieving: data size 42921661
Mon 20 Jan 2014 03:23:56 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:23:56 - XML: Start document: iteration 4
Mon 20 Jan 2014 03:23:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42921661
Mon 20 Jan 2014 03:23:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:23:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42921661
Mon 20 Jan 2014 03:23:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:24:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:24:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:24:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:24:08 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:24:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:24:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:24:09 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:24:09 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:24:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:24:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:24:09 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:24:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:24:10 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:24:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:24:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:24:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:24:11 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:24:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 03:24:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 03:24:11 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:24:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9114 values 143846 bits 17980 bytes 
Mon 20 Jan 2014 03:24:14 - XML: Processed 645200 elements - found 0 jobs
Mon 20 Jan 2014 03:24:14 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:24:14 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:24:14 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:24:14 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:24:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:24:19 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:24:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:24:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:24:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:24:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:24:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:24:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:24:21 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:24:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42959171
Mon 20 Jan 2014 03:24:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:24:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42959171
Mon 20 Jan 2014 03:24:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:24:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:24:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:24:29 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:24:29 - job_xml_thread(): Done retrieving: data size 42959171
Mon 20 Jan 2014 03:24:29 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:24:29 - XML: Start document: iteration 5
Mon 20 Jan 2014 03:24:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:24:32 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:24:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:24:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:24:33 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:24:33 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:24:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:24:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:24:33 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:24:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:24:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:24:40 - XML: Processed 645828 elements - found 0 jobs
Mon 20 Jan 2014 03:24:40 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:24:40 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:24:40 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:24:40 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:24:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:24:43 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:24:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:24:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:24:43 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:24:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 03:24:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:24:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:24:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:24:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:24:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:24:45 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:24:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43470456
Mon 20 Jan 2014 03:24:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:24:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43470456
Mon 20 Jan 2014 03:24:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:24:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:24:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:24:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:24:55 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:24:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:24:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:24:55 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:24:55 - job_xml_thread(): Done retrieving: data size 43470456
Mon 20 Jan 2014 03:24:55 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:24:55 - XML: Start document: iteration 6
Mon 20 Jan 2014 03:24:55 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:24:55 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:24:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:24:55 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:24:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:24:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:24:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:25:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:25:06 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:25:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:25:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:25:07 - XML: Processed 652508 elements - found 0 jobs
Mon 20 Jan 2014 03:25:07 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:25:07 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:25:07 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:25:07 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:25:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:25:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:25:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:25:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:25:09 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:25:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563183
Mon 20 Jan 2014 03:25:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:25:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563183
Mon 20 Jan 2014 03:25:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:25:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:25:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:25:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:25:11 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:25:12 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:25:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:25:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 03:25:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 03:25:12 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:25:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8838 values 139374 bits 17421 bytes 
Mon 20 Jan 2014 03:25:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:25:17 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:25:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:25:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:25:18 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:25:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:25:18 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:25:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:25:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563183
Mon 20 Jan 2014 03:25:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:25:23 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:25:23 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:25:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:25:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:25:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:25:24 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:25:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:25:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:25:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:25:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:25:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:25:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:25:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:25:28 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:25:30 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:25:30 - job_xml_thread(): Done retrieving: data size 43552714
Mon 20 Jan 2014 03:25:30 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:25:30 - XML: Start document: iteration 7
Mon 20 Jan 2014 03:25:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43552714
Mon 20 Jan 2014 03:25:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:25:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:25:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:25:34 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:25:34 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:25:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:25:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:25:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43552714
Mon 20 Jan 2014 03:25:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:25:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:25:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:25:47 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:25:47 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:25:47 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:25:47 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:25:47 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:25:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:25:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:25:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:25:51 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:25:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:25:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:25:53 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:25:53 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:25:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:25:53 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:25:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:25:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:25:53 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:25:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:25:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:25:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:25:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:25:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:25:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:25:53 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:25:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 03:25:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:25:55 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:25:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43596715
Mon 20 Jan 2014 03:25:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:25:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43596715
Mon 20 Jan 2014 03:25:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:26:01 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 03:26:01 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:26:02 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:26:02 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 03:26:02 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:26:02 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 03:26:02 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 03:26:03 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:26:03 - job_xml_thread(): Done retrieving: data size 43596715
Mon 20 Jan 2014 03:26:04 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:26:04 - XML: Start document: iteration 8
Mon 20 Jan 2014 03:26:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:26:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:26:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:26:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:26:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:26:11 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:26:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:26:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:26:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:26:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:26:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:26:13 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:26:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:26:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:26:13 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:26:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:26:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 03:26:14 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:26:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6033 values 95144 bits 11893 bytes 
Mon 20 Jan 2014 03:26:14 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:26:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 03:26:15 - size of cluster 'LISA Cluster': 624 hosts 79473 metrics 958309 values 15108607 bits 1888575 bytes 
Mon 20 Jan 2014 03:26:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:26:16 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:26:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:26:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:26:16 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:26:16 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:26:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:26:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:26:19 - XML: Processed 653347 elements - found 0 jobs
Mon 20 Jan 2014 03:26:19 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:26:19 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:26:19 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:26:19 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:26:23 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:26:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572771
Mon 20 Jan 2014 03:26:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:26:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572771
Mon 20 Jan 2014 03:26:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:26:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:26:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:26:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:26:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:26:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:26:32 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:26:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:26:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:26:33 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:26:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:26:33 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:26:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:26:33 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:26:34 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:26:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:26:37 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:26:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:26:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:26:38 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:26:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 03:26:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:26:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:26:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:26:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:26:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:26:41 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:26:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43590027
Mon 20 Jan 2014 03:26:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:26:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43590027
Mon 20 Jan 2014 03:26:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:26:41 - job_xml_thread(): Done retrieving: data size 43590027
Mon 20 Jan 2014 03:26:41 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:26:41 - XML: Start document: iteration 9
Mon 20 Jan 2014 03:26:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:26:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:26:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:26:52 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:26:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:26:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:26:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:26:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:26:53 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:26:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:26:53 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:26:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:26:53 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:26:55 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:26:55 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:26:56 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:26:56 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:26:56 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:27:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:27:00 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:27:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:27:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:27:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:27:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:27:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:27:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:27:02 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:27:02 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 03:27:03 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:27:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567442
Mon 20 Jan 2014 03:27:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:27:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567442
Mon 20 Jan 2014 03:27:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:27:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:27:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:27:11 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:27:11 - job_xml_thread(): Done retrieving: data size 43567442
Mon 20 Jan 2014 03:27:11 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:27:11 - XML: Start document: iteration 10
Mon 20 Jan 2014 03:27:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:27:15 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:27:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:27:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:27:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:27:16 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:27:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 03:27:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 03:27:16 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:27:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8621 values 135906 bits 16988 bytes 
Mon 20 Jan 2014 03:27:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:27:20 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:27:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:27:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:27:21 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:27:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:27:21 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:27:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:27:22 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:27:25 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:27:25 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:27:25 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:27:25 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:27:25 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:27:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:27:26 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:27:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:27:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:27:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:27:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:27:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:27:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:27:29 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:27:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559584
Mon 20 Jan 2014 03:27:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:27:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559584
Mon 20 Jan 2014 03:27:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:27:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:27:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:27:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:27:39 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:27:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:27:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:27:40 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:27:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:27:40 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:27:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:27:40 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:27:40 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:27:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:27:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:27:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:27:44 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:27:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:27:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:27:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:27:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:27:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:27:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:27:45 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:27:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 03:27:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:27:48 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:27:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566554
Mon 20 Jan 2014 03:27:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:27:49 - job_xml_thread(): Done retrieving: data size 43566554
Mon 20 Jan 2014 03:27:49 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:27:49 - XML: Start document: iteration 11
Mon 20 Jan 2014 03:27:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566554
Mon 20 Jan 2014 03:27:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:27:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:27:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:28:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:28:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:28:04 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:28:04 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:28:04 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:28:04 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:28:04 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:28:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:28:08 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:28:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:28:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:28:09 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:28:09 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:28:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:28:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:28:09 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:28:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:28:11 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:28:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:28:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:28:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:28:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:28:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:28:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:28:15 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:28:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566634
Mon 20 Jan 2014 03:28:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:28:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566634
Mon 20 Jan 2014 03:28:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:28:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:28:16 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:28:17 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:28:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:28:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 03:28:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 03:28:18 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:28:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8775 values 138377 bits 17297 bytes 
Mon 20 Jan 2014 03:28:19 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:28:19 - job_xml_thread(): Done retrieving: data size 43566634
Mon 20 Jan 2014 03:28:19 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:28:19 - XML: Start document: iteration 12
Mon 20 Jan 2014 03:28:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:28:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:28:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:28:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:28:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:28:31 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:28:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:28:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:28:32 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:28:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:28:32 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:28:32 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:28:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:28:37 - XML: Processed 653349 elements - found 0 jobs
Mon 20 Jan 2014 03:28:37 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:28:37 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:28:37 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:28:37 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:28:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:28:38 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:28:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:28:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:28:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:28:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:28:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:28:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:28:42 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:28:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575112
Mon 20 Jan 2014 03:28:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:28:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575112
Mon 20 Jan 2014 03:28:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:28:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:28:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:28:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:28:52 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:28:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:28:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:28:52 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:28:52 - job_xml_thread(): Done retrieving: data size 43575112
Mon 20 Jan 2014 03:28:52 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:28:52 - XML: Start document: iteration 13
Mon 20 Jan 2014 03:28:53 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:28:53 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:28:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:28:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:28:53 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:28:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:28:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:29:00 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:29:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 03:29:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:29:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:29:02 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:29:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:29:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:29:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:29:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:29:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:29:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:29:04 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:29:04 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:29:04 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:29:04 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:29:04 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:29:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:29:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:29:08 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:29:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562045
Mon 20 Jan 2014 03:29:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:29:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562045
Mon 20 Jan 2014 03:29:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:29:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:29:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:29:18 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:29:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:29:19 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:29:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 03:29:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:29:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 03:29:19 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:29:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5858 values 92410 bits 11551 bytes 
Mon 20 Jan 2014 03:29:19 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:29:19 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:29:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:29:20 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:29:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:29:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:29:21 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:29:21 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:29:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:29:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:29:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:29:25 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:29:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:29:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:29:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:29:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:29:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:29:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:29:28 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:29:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 03:29:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:29:28 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:29:28 - job_xml_thread(): Done retrieving: data size 43510121
Mon 20 Jan 2014 03:29:28 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:29:28 - XML: Start document: iteration 14
Mon 20 Jan 2014 03:29:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43510121
Mon 20 Jan 2014 03:29:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:29:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43510121
Mon 20 Jan 2014 03:29:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:29:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:29:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:29:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:29:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:29:43 - XML: Processed 652602 elements - found 0 jobs
Mon 20 Jan 2014 03:29:43 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:29:43 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:29:43 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:29:43 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:29:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:29:46 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:29:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:29:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:29:46 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:29:46 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:29:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:29:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:29:46 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:29:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:29:50 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:29:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:29:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:29:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:29:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:29:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:29:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:29:54 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:29:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42950667
Mon 20 Jan 2014 03:29:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:29:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42950667
Mon 20 Jan 2014 03:29:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:29:58 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:29:58 - job_xml_thread(): Done retrieving: data size 42950667
Mon 20 Jan 2014 03:29:58 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:29:58 - XML: Start document: iteration 15
Mon 20 Jan 2014 03:30:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:30:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:30:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:30:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:30:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:30:12 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:30:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:30:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:30:13 - XML: Processed 645558 elements - found 0 jobs
Mon 20 Jan 2014 03:30:13 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:30:13 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:30:13 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:30:13 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:30:13 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:30:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:30:13 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:30:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:30:13 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:30:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:30:15 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:30:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:30:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:30:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:30:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:30:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:30:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:30:16 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 03:30:16 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 03:30:16 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:30:17 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:30:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42977409
Mon 20 Jan 2014 03:30:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:30:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42977409
Mon 20 Jan 2014 03:30:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:30:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:30:20 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:30:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:30:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 03:30:21 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:30:21 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:30:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 03:30:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9016 values 142283 bits 17785 bytes 
Mon 20 Jan 2014 03:30:28 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:30:28 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:30:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:30:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:30:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:30:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:30:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:30:31 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:30:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:30:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:30:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:30:31 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:30:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:30:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:30:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:30:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:30:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:30:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:30:32 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:30:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:30:32 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:30:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:30:33 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:30:33 - job_xml_thread(): Done retrieving: data size 43356213
Mon 20 Jan 2014 03:30:33 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:30:33 - XML: Start document: iteration 16
Mon 20 Jan 2014 03:30:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43356213
Mon 20 Jan 2014 03:30:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43356213
Mon 20 Jan 2014 03:30:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:30:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:30:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:30:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:30:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:30:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:30:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:30:52 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:30:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:30:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:30:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:30:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:30:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:30:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:30:53 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:30:54 - XML: Processed 650732 elements - found 0 jobs
Mon 20 Jan 2014 03:30:54 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:30:54 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:30:54 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:30:54 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:30:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:30:55 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:30:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:30:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:30:55 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:30:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 03:30:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:30:55 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:30:55 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:30:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:30:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:30:56 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:30:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564162
Mon 20 Jan 2014 03:30:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:30:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564162
Mon 20 Jan 2014 03:30:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:31:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:31:08 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:31:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:31:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:31:09 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:31:09 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:31:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:31:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:31:11 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:31:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:31:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:31:11 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:31:11 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:31:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:31:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:31:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:31:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:31:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:31:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:31:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:31:13 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:31:13 - job_xml_thread(): Done retrieving: data size 43591643
Mon 20 Jan 2014 03:31:13 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:31:13 - XML: Start document: iteration 17
Mon 20 Jan 2014 03:31:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43591643
Mon 20 Jan 2014 03:31:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43591643
Mon 20 Jan 2014 03:31:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:31:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:31:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:31:21 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:31:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:31:22 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:31:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 03:31:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 03:31:22 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:31:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8911 values 140639 bits 17579 bytes 
Mon 20 Jan 2014 03:31:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:31:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:31:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:31:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:31:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:31:32 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:31:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:31:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:31:33 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:31:33 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:31:33 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:31:33 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:31:33 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:31:33 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:31:33 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:31:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:31:33 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:31:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:31:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:31:36 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:31:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:31:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:31:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:31:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:31:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:31:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:31:38 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:31:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 03:31:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:31:38 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:31:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43587598
Mon 20 Jan 2014 03:31:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:31:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43587598
Mon 20 Jan 2014 03:31:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:31:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:31:48 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:31:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:31:48 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:31:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:31:51 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:31:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:31:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:31:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:31:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:31:51 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:31:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:31:51 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:31:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:31:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:31:52 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:31:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:31:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:31:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:31:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:31:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:31:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:31:53 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:31:53 - job_xml_thread(): Done retrieving: data size 43593644
Mon 20 Jan 2014 03:31:53 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:31:53 - XML: Start document: iteration 18
Mon 20 Jan 2014 03:31:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43593644
Mon 20 Jan 2014 03:31:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:31:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43593644
Mon 20 Jan 2014 03:31:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:32:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:32:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:32:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:32:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:32:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:32:08 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:32:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:32:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:32:09 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:32:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:32:09 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:32:09 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:32:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:32:12 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:32:12 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:32:12 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:32:12 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:32:12 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:32:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:32:15 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:32:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:32:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:32:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:32:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:32:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:32:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:32:17 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:32:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558855
Mon 20 Jan 2014 03:32:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:32:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558855
Mon 20 Jan 2014 03:32:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:32:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:32:23 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:32:23 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:32:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 03:32:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:32:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 03:32:24 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:32:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 149077 bits 18634 bytes 
Mon 20 Jan 2014 03:32:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:32:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:32:27 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:32:27 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:32:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:32:28 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:32:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:32:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:32:29 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:32:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:32:29 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:32:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:32:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:32:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:32:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:32:32 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:32:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:32:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:32:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:32:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:32:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:32:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:32:34 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:32:34 - job_xml_thread(): Done retrieving: data size 43573322
Mon 20 Jan 2014 03:32:34 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:32:34 - XML: Start document: iteration 19
Mon 20 Jan 2014 03:32:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573322
Mon 20 Jan 2014 03:32:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573322
Mon 20 Jan 2014 03:32:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:32:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:32:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:32:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:32:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:32:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:32:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:32:55 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:32:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:32:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:32:55 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:32:55 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:32:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:32:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:32:56 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:32:57 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:32:57 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:32:57 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:32:57 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:32:57 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:32:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:32:58 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:32:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:32:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:32:58 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:32:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 03:32:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:32:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:32:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:32:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:32:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:33:00 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:33:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579679
Mon 20 Jan 2014 03:33:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:33:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579679
Mon 20 Jan 2014 03:33:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:33:03 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 03:33:03 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:33:04 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:33:04 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:33:05 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 03:33:05 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 03:33:05 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 03:33:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:33:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:33:11 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:33:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:33:12 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:33:12 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:33:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:33:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:33:12 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:33:12 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:33:14 - size of cluster 'LISA Cluster': 624 hosts 79464 metrics 808286 values 12763136 bits 1595392 bytes 
Mon 20 Jan 2014 03:33:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:33:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:33:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:33:17 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:33:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:33:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:33:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:33:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:33:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:33:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:33:20 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:33:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568909
Mon 20 Jan 2014 03:33:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:33:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568909
Mon 20 Jan 2014 03:33:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:33:21 - job_xml_thread(): Done retrieving: data size 43568909
Mon 20 Jan 2014 03:33:21 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:33:21 - XML: Start document: iteration 20
Mon 20 Jan 2014 03:33:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:33:24 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:33:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:33:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 03:33:25 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:33:25 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:33:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 03:33:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8879 values 140234 bits 17529 bytes 
Mon 20 Jan 2014 03:33:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:33:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:33:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:33:30 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:33:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:33:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:33:31 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:33:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:33:31 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:33:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:33:31 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:33:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:33:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:33:39 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:33:39 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:33:39 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:33:39 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:33:39 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:33:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:33:42 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:33:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:33:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:33:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:33:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:33:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:33:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:33:45 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:33:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561188
Mon 20 Jan 2014 03:33:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:33:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561188
Mon 20 Jan 2014 03:33:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:33:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:33:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:33:54 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:33:54 - job_xml_thread(): Done retrieving: data size 43561188
Mon 20 Jan 2014 03:33:54 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:33:54 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 03:33:54 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 03:33:54 - Housekeeping: done.
Mon 20 Jan 2014 03:33:54 - XML: Start document: iteration 0
Mon 20 Jan 2014 03:33:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:33:55 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:33:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:33:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:33:56 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:33:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:33:56 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:33:56 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:33:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:33:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:33:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:34:04 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:34:04 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:34:04 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:34:04 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:34:04 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:34:05 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:34:05 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 03:34:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:34:08 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:34:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:34:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:34:08 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:34:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 03:34:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:34:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:34:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:34:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:34:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:34:11 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:34:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559490
Mon 20 Jan 2014 03:34:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:34:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559490
Mon 20 Jan 2014 03:34:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:34:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:34:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:34:19 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:34:19 - job_xml_thread(): Done retrieving: data size 43559490
Mon 20 Jan 2014 03:34:19 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:34:19 - XML: Start document: iteration 1
Mon 20 Jan 2014 03:34:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:34:21 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:34:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:34:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:34:21 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:34:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:34:21 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:34:21 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:34:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:34:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:34:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:34:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:34:25 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:34:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:34:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 03:34:26 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:34:26 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:34:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 03:34:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5602 values 88359 bits 11044 bytes 
Mon 20 Jan 2014 03:34:31 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:34:31 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:34:31 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:34:31 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:34:31 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:34:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:34:34 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:34:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:34:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:34:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:34:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:34:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:34:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:34:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:34:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:34:38 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:34:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43547347
Mon 20 Jan 2014 03:34:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:34:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43547347
Mon 20 Jan 2014 03:34:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:34:46 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:34:46 - job_xml_thread(): Done retrieving: data size 43547347
Mon 20 Jan 2014 03:34:46 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:34:46 - XML: Start document: iteration 2
Mon 20 Jan 2014 03:34:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:34:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:34:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:34:51 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:34:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:34:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:34:53 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:34:53 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:34:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:34:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:34:53 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:34:55 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:34:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 03:34:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:34:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:34:57 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:34:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:34:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:34:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:34:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:34:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:34:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:34:59 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:34:59 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:34:59 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:34:59 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:34:59 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:35:02 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:35:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555772
Mon 20 Jan 2014 03:35:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:35:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555772
Mon 20 Jan 2014 03:35:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:35:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:35:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:35:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:35:13 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:35:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:35:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:35:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:35:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:35:14 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:35:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:35:14 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:35:14 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:35:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:35:14 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:35:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:35:18 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:35:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:35:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:35:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:35:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:35:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:35:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:35:21 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:35:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43505150
Mon 20 Jan 2014 03:35:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:35:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43505150
Mon 20 Jan 2014 03:35:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:35:21 - job_xml_thread(): Done retrieving: data size 43505150
Mon 20 Jan 2014 03:35:22 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:35:22 - XML: Start document: iteration 3
Mon 20 Jan 2014 03:35:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:35:26 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:35:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:35:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 03:35:27 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:35:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 03:35:27 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:35:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8929 values 140795 bits 17599 bytes 
Mon 20 Jan 2014 03:35:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:35:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:35:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:35:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:35:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:35:36 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:35:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:35:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:35:38 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:35:38 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:35:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:35:38 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:35:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:35:41 - XML: Processed 652602 elements - found 0 jobs
Mon 20 Jan 2014 03:35:41 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:35:41 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:35:41 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:35:41 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:35:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:35:44 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:35:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:35:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:35:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:35:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:35:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:35:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:35:47 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:35:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42940776
Mon 20 Jan 2014 03:35:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:35:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42940776
Mon 20 Jan 2014 03:35:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:35:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:35:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:35:56 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:35:56 - job_xml_thread(): Done retrieving: data size 42940776
Mon 20 Jan 2014 03:35:56 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:35:56 - XML: Start document: iteration 4
Mon 20 Jan 2014 03:36:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:36:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:36:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:36:03 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:36:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:36:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:36:04 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:36:04 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:36:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:36:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:36:04 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:36:10 - XML: Processed 645720 elements - found 0 jobs
Mon 20 Jan 2014 03:36:10 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:36:10 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:36:10 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:36:10 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:36:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:36:11 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:36:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:36:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:36:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:36:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:36:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:36:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:36:12 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:36:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 03:36:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:36:14 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:36:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42935239
Mon 20 Jan 2014 03:36:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:36:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42935239
Mon 20 Jan 2014 03:36:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:36:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:36:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:36:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:36:23 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:36:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:36:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:36:24 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:36:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:36:24 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:36:24 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:36:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:36:25 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:36:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:36:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:36:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:36:27 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:36:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:36:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:36:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:36:27 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:36:27 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:36:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:36:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:36:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:36:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:36:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 03:36:27 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:36:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 03:36:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:36:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5459 values 86080 bits 10760 bytes 
Mon 20 Jan 2014 03:36:31 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:36:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43195590
Mon 20 Jan 2014 03:36:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:36:31 - job_xml_thread(): Done retrieving: data size 43195590
Mon 20 Jan 2014 03:36:31 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:36:31 - XML: Start document: iteration 5
Mon 20 Jan 2014 03:36:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43195590
Mon 20 Jan 2014 03:36:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:36:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:36:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:36:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:36:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:36:47 - XML: Processed 648654 elements - found 0 jobs
Mon 20 Jan 2014 03:36:47 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:36:47 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:36:47 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:36:47 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:36:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:36:50 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:36:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:36:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:36:51 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:36:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:36:51 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:36:51 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:36:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:36:53 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:36:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 03:36:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:36:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:36:56 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:36:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:36:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:36:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:36:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:36:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:36:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:36:58 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 03:36:58 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 03:36:58 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:36:59 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:36:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43539104
Mon 20 Jan 2014 03:36:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:37:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43539104
Mon 20 Jan 2014 03:37:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:37:03 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:37:03 - job_xml_thread(): Done retrieving: data size 43539104
Mon 20 Jan 2014 03:37:03 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:37:03 - XML: Start document: iteration 6
Mon 20 Jan 2014 03:37:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:37:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:37:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:37:09 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:37:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:37:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:37:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:37:12 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:37:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:37:12 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:37:12 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:37:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:37:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:37:15 - XML: Processed 652742 elements - found 0 jobs
Mon 20 Jan 2014 03:37:15 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:37:15 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:37:15 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:37:15 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:37:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:37:19 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:37:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:37:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:37:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:37:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:37:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:37:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:37:21 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:37:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562648
Mon 20 Jan 2014 03:37:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:37:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562648
Mon 20 Jan 2014 03:37:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:37:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:37:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:37:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:37:27 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:37:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:37:28 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:37:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 03:37:28 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:37:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 03:37:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8942 values 141041 bits 17630 bytes 
Mon 20 Jan 2014 03:37:30 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:37:30 - job_xml_thread(): Done retrieving: data size 43562648
Mon 20 Jan 2014 03:37:30 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:37:30 - XML: Start document: iteration 7
Mon 20 Jan 2014 03:37:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:37:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:37:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:37:37 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:37:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:37:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:37:38 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:37:38 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:37:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:37:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:37:38 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:37:42 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:37:42 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:37:42 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:37:42 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:37:42 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:37:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:37:43 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:37:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:37:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:37:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:37:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:37:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:37:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:37:45 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:37:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 03:37:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:37:46 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:37:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556859
Mon 20 Jan 2014 03:37:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:37:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556859
Mon 20 Jan 2014 03:37:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:37:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:37:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:37:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:37:56 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:37:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:37:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:37:57 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:37:57 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:37:57 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:37:57 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:37:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:37:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:37:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:37:57 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:37:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:37:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:37:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:37:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:37:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:37:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:38:00 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:38:00 - job_xml_thread(): Done retrieving: data size 43575903
Mon 20 Jan 2014 03:38:00 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:38:00 - XML: Start document: iteration 8
Mon 20 Jan 2014 03:38:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575903
Mon 20 Jan 2014 03:38:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:38:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575903
Mon 20 Jan 2014 03:38:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:38:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:38:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:38:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:38:14 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:38:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:38:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:38:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:38:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:38:15 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:38:15 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:38:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:38:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:38:15 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:38:21 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:38:21 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:38:21 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:38:21 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:38:21 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:38:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:38:22 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:38:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:38:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:38:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:38:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:38:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:38:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:38:24 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:38:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577595
Mon 20 Jan 2014 03:38:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:38:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577595
Mon 20 Jan 2014 03:38:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:38:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:38:29 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:38:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:38:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:38:30 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:38:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:38:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 03:38:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 03:38:30 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:38:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148569 bits 18571 bytes 
Mon 20 Jan 2014 03:38:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:38:32 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:38:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:38:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:38:33 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:38:33 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:38:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:38:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:38:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577595
Mon 20 Jan 2014 03:38:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:38:36 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:38:36 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:38:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:38:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:38:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:38:44 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:38:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:38:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:38:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:38:44 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:38:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:38:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:38:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:38:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:38:46 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:38:46 - job_xml_thread(): Done retrieving: data size 43570547
Mon 20 Jan 2014 03:38:46 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:38:46 - XML: Start document: iteration 9
Mon 20 Jan 2014 03:38:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570547
Mon 20 Jan 2014 03:38:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:38:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:38:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:38:48 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:38:48 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:38:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:38:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570547
Mon 20 Jan 2014 03:38:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:38:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:39:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:39:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:39:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:39:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:39:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:39:05 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:39:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:39:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:39:05 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:39:05 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:39:05 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:39:05 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:39:05 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:39:06 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:39:06 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:39:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:39:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:39:06 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:39:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:39:09 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:39:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:39:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:39:09 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:39:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 03:39:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:39:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:39:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:39:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:39:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:39:11 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:39:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43608181
Mon 20 Jan 2014 03:39:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:39:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43608181
Mon 20 Jan 2014 03:39:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:39:20 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:39:20 - job_xml_thread(): Done retrieving: data size 43608181
Mon 20 Jan 2014 03:39:21 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:39:21 - XML: Start document: iteration 10
Mon 20 Jan 2014 03:39:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:39:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:39:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:39:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:39:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:39:26 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:39:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:39:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:39:26 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:39:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:39:26 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:39:26 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:39:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:39:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:39:28 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:39:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:39:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:39:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:39:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:39:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:39:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:39:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:39:30 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:39:31 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:39:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 03:39:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:39:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 03:39:31 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:39:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5718 values 90191 bits 11273 bytes 
Mon 20 Jan 2014 03:39:33 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:39:33 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:39:33 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:39:33 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:39:33 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:39:35 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:39:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557466
Mon 20 Jan 2014 03:39:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:39:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557466
Mon 20 Jan 2014 03:39:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:39:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:39:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:39:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:39:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:39:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:39:44 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:39:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:39:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:39:45 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:39:45 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:39:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:39:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:39:45 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:39:48 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:39:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:39:50 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:39:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:39:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:39:50 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:39:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 03:39:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:39:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:39:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:39:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:39:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:39:52 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:39:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568482
Mon 20 Jan 2014 03:39:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:39:52 - job_xml_thread(): Done retrieving: data size 43568482
Mon 20 Jan 2014 03:39:52 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:39:52 - XML: Start document: iteration 11
Mon 20 Jan 2014 03:39:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568482
Mon 20 Jan 2014 03:39:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:40:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:40:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:40:05 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 03:40:05 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:40:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:40:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:40:08 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:40:08 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 03:40:08 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:40:08 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 03:40:08 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 03:40:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:40:08 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:40:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:40:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:40:09 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:40:09 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:40:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:40:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:40:09 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:40:10 - size of cluster 'LISA Cluster': 624 hosts 79476 metrics 813953 values 12832886 bits 1604110 bytes 
Mon 20 Jan 2014 03:40:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:40:16 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:40:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:40:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:40:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:40:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:40:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:40:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:40:17 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:40:17 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:40:17 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:40:17 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:40:17 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:40:20 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:40:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43548827
Mon 20 Jan 2014 03:40:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:40:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43548827
Mon 20 Jan 2014 03:40:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:40:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:40:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:40:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:40:31 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:40:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:40:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:40:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:40:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:40:32 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:40:32 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:40:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 03:40:32 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:40:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 03:40:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8896 values 140262 bits 17532 bytes 
Mon 20 Jan 2014 03:40:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:40:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:40:32 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:40:32 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:40:33 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:40:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:40:33 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:40:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:40:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:40:36 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:40:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:40:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:40:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:40:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:40:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:40:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:40:40 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:40:40 - job_xml_thread(): Done retrieving: data size 43574236
Mon 20 Jan 2014 03:40:40 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:40:40 - XML: Start document: iteration 12
Mon 20 Jan 2014 03:40:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574236
Mon 20 Jan 2014 03:40:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:40:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574236
Mon 20 Jan 2014 03:40:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:40:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:40:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:40:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:40:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:40:54 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:40:54 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:40:54 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:40:54 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:40:54 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:40:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:40:57 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:40:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:40:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:40:58 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:40:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:40:58 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:40:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:40:58 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:40:59 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:40:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 03:40:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:41:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:41:02 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:41:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:41:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:41:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:41:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:41:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:41:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:41:05 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:41:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559380
Mon 20 Jan 2014 03:41:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:41:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559380
Mon 20 Jan 2014 03:41:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:41:08 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:41:08 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 03:41:09 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:41:09 - job_xml_thread(): Done retrieving: data size 43559380
Mon 20 Jan 2014 03:41:09 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:41:09 - XML: Start document: iteration 13
Mon 20 Jan 2014 03:41:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:41:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:41:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:41:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:41:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:41:19 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:41:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:41:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:41:20 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:41:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:41:20 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:41:20 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:41:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:41:24 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:41:24 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:41:24 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:41:24 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:41:24 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:41:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:41:29 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:41:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:41:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:41:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:41:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:41:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:41:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:41:32 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:41:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43499816
Mon 20 Jan 2014 03:41:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:41:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:41:32 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:41:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43499816
Mon 20 Jan 2014 03:41:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:41:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:41:33 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:41:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 03:41:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 03:41:33 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:41:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8839 values 139422 bits 17427 bytes 
Mon 20 Jan 2014 03:41:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:41:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:41:39 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:41:39 - job_xml_thread(): Done retrieving: data size 43499816
Mon 20 Jan 2014 03:41:39 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:41:39 - XML: Start document: iteration 14
Mon 20 Jan 2014 03:41:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:41:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:41:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:41:45 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:41:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:41:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:41:46 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:41:46 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:41:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:41:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:41:46 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:41:51 - XML: Processed 652590 elements - found 0 jobs
Mon 20 Jan 2014 03:41:51 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:41:51 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:41:51 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:41:51 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:41:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:41:57 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:41:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:41:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:41:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:41:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:41:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:41:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:42:00 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:42:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42928958
Mon 20 Jan 2014 03:42:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:42:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42928958
Mon 20 Jan 2014 03:42:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:42:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:42:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:42:06 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:42:06 - job_xml_thread(): Done retrieving: data size 42928958
Mon 20 Jan 2014 03:42:06 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:42:06 - XML: Start document: iteration 15
Mon 20 Jan 2014 03:42:08 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:42:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 03:42:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:42:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:42:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:42:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:42:13 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:42:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:42:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:42:14 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:42:14 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:42:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:42:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:42:14 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:42:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:42:22 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:42:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:42:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:42:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:42:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:42:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:42:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:42:24 - XML: Processed 645461 elements - found 0 jobs
Mon 20 Jan 2014 03:42:24 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:42:24 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:42:24 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:42:24 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:42:27 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:42:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42969603
Mon 20 Jan 2014 03:42:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:42:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42969603
Mon 20 Jan 2014 03:42:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:42:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:42:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:42:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:42:33 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:42:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:42:34 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:42:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 03:42:34 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:42:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 03:42:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6086 values 96031 bits 12003 bytes 
Mon 20 Jan 2014 03:42:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:42:35 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:42:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:42:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:42:35 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:42:35 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:42:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:42:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:42:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42969603
Mon 20 Jan 2014 03:42:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:42:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:42:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:42:39 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:42:39 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:42:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:42:46 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:42:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:42:49 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:42:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:42:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:42:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:42:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:42:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:42:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:42:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:42:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:42:51 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:42:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:42:51 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:42:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:42:52 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:42:52 - job_xml_thread(): Done retrieving: data size 43517934
Mon 20 Jan 2014 03:42:52 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:42:52 - XML: Start document: iteration 16
Mon 20 Jan 2014 03:42:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43517934
Mon 20 Jan 2014 03:42:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:42:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43517934
Mon 20 Jan 2014 03:42:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:43:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:43:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:43:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:43:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:43:12 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:43:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 03:43:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:43:14 - XML: Processed 652976 elements - found 0 jobs
Mon 20 Jan 2014 03:43:14 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:43:15 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:43:15 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:43:15 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:43:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:43:15 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:43:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:43:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:43:17 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:43:17 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:43:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:43:17 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:43:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:43:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:43:17 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:43:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:43:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:43:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:43:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:43:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:43:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:43:20 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:43:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577855
Mon 20 Jan 2014 03:43:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:43:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577855
Mon 20 Jan 2014 03:43:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:43:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:43:28 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:43:30 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:43:30 - job_xml_thread(): Done retrieving: data size 43577855
Mon 20 Jan 2014 03:43:30 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:43:30 - XML: Start document: iteration 17
Mon 20 Jan 2014 03:43:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:43:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:43:32 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:43:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:43:32 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:43:32 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:43:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:43:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:43:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:43:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:43:34 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:43:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:43:34 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:43:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 03:43:34 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:43:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 03:43:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6077 values 95843 bits 11980 bytes 
Mon 20 Jan 2014 03:43:40 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:43:40 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:43:40 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:43:40 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:43:40 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:43:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:43:43 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:43:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:43:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:43:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:43:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:43:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:43:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:43:46 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:43:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559430
Mon 20 Jan 2014 03:43:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:43:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559430
Mon 20 Jan 2014 03:43:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:43:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:43:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:43:55 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:43:55 - job_xml_thread(): Done retrieving: data size 43559430
Mon 20 Jan 2014 03:43:55 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:43:55 - XML: Start document: iteration 18
Mon 20 Jan 2014 03:43:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:43:56 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:43:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:43:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:43:57 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:43:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:43:57 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:43:57 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:43:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:43:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:43:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:44:06 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:44:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 03:44:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:44:09 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:44:09 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:44:09 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:44:09 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:44:09 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:44:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:44:10 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:44:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:44:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:44:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:44:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:44:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:44:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:44:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:44:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:44:13 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:44:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560002
Mon 20 Jan 2014 03:44:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:44:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560002
Mon 20 Jan 2014 03:44:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:44:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:44:24 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:44:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:44:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:44:24 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:44:24 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:44:24 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:44:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:44:24 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:44:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:44:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:44:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:44:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:44:28 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:44:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:44:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:44:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:44:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:44:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:44:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:44:29 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 03:44:29 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 03:44:29 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:44:30 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:44:30 - job_xml_thread(): Done retrieving: data size 43588073
Mon 20 Jan 2014 03:44:30 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:44:30 - XML: Start document: iteration 19
Mon 20 Jan 2014 03:44:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43588073
Mon 20 Jan 2014 03:44:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:44:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43588073
Mon 20 Jan 2014 03:44:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:44:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:44:35 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:44:38 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:44:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 03:44:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:44:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 03:44:39 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:44:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:44:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:44:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8609 values 135757 bits 16969 bytes 
Mon 20 Jan 2014 03:44:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:44:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:44:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:44:45 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:44:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:44:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:44:46 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:44:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:44:46 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:44:46 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:44:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:44:49 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:44:49 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:44:49 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:44:49 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:44:49 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:44:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:44:53 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:44:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:44:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:44:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:44:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:44:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:44:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:44:56 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:44:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576770
Mon 20 Jan 2014 03:44:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:44:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576770
Mon 20 Jan 2014 03:44:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:45:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:45:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:45:04 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:45:04 - job_xml_thread(): Done retrieving: data size 43576770
Mon 20 Jan 2014 03:45:04 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:45:05 - XML: Start document: iteration 20
Mon 20 Jan 2014 03:45:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:45:08 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:45:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:45:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:45:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:45:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:45:09 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:45:09 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:45:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:45:09 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:45:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:45:17 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:45:17 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:45:17 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:45:17 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:45:17 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:45:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:45:20 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:45:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:45:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:45:20 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:45:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 03:45:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:45:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:45:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:45:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:45:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:45:23 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:45:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43552646
Mon 20 Jan 2014 03:45:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:45:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43552646
Mon 20 Jan 2014 03:45:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:45:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:45:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:45:32 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:45:33 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:45:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:45:34 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:45:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:45:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:45:35 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:45:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:45:35 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:45:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:45:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:45:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:45:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:45:38 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:45:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:45:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 03:45:38 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:45:38 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:45:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 03:45:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5840 values 92103 bits 11512 bytes 
Mon 20 Jan 2014 03:45:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:45:39 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:45:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:45:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:45:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:45:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:45:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:45:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:45:41 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:45:41 - job_xml_thread(): Done retrieving: data size 43578017
Mon 20 Jan 2014 03:45:41 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:45:41 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 03:45:41 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 03:45:41 - Housekeeping: done.
Mon 20 Jan 2014 03:45:41 - XML: Start document: iteration 0
Mon 20 Jan 2014 03:45:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578017
Mon 20 Jan 2014 03:45:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:45:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578017
Mon 20 Jan 2014 03:45:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:45:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:45:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:45:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:45:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:45:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:45:55 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:45:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:45:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:45:56 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:45:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:45:56 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:45:56 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:45:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:45:58 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:45:58 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:45:58 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:45:58 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:45:58 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:46:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:46:02 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:46:02 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:46:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 03:46:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:46:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:46:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:46:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:46:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:46:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:46:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:46:04 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:46:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560292
Mon 20 Jan 2014 03:46:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:46:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560292
Mon 20 Jan 2014 03:46:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:46:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:46:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:46:13 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:46:13 - job_xml_thread(): Done retrieving: data size 43560292
Mon 20 Jan 2014 03:46:13 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:46:13 - XML: Start document: iteration 1
Mon 20 Jan 2014 03:46:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:46:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:46:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:46:20 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:46:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:46:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:46:22 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:46:22 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:46:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:46:22 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:46:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:46:23 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:46:23 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:46:23 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:46:23 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:46:23 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:46:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:46:26 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:46:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:46:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:46:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:46:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:46:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:46:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:46:28 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:46:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43602382
Mon 20 Jan 2014 03:46:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:46:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43602382
Mon 20 Jan 2014 03:46:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:46:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:46:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:46:38 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:46:38 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:46:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:46:38 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:46:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:46:38 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:46:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:46:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:46:39 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:46:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:46:39 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:46:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:46:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:46:39 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:46:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 03:46:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 03:46:39 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:46:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8977 values 141700 bits 17712 bytes 
Mon 20 Jan 2014 03:46:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:46:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:46:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:46:42 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:46:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:46:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:46:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:46:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:46:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:46:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:46:44 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:46:44 - job_xml_thread(): Done retrieving: data size 43594190
Mon 20 Jan 2014 03:46:44 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:46:44 - XML: Start document: iteration 2
Mon 20 Jan 2014 03:46:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43594190
Mon 20 Jan 2014 03:46:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:46:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43594190
Mon 20 Jan 2014 03:46:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:46:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:46:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:46:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:46:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:46:59 - XML: Processed 653350 elements - found 0 jobs
Mon 20 Jan 2014 03:46:59 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:46:59 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:46:59 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:46:59 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:47:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:47:04 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:47:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:47:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:47:05 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:47:05 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:47:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:47:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:47:05 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:47:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:47:08 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:47:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:47:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:47:08 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:47:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 03:47:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:47:09 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 03:47:09 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:47:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:47:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:47:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:47:09 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:47:09 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 03:47:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:47:09 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:47:09 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 03:47:09 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 03:47:10 - size of cluster 'LISA Cluster': 624 hosts 79478 metrics 805087 values 12698613 bits 1587326 bytes 
Mon 20 Jan 2014 03:47:11 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:47:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43523138
Mon 20 Jan 2014 03:47:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:47:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43523138
Mon 20 Jan 2014 03:47:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:47:15 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:47:15 - job_xml_thread(): Done retrieving: data size 43523138
Mon 20 Jan 2014 03:47:15 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:47:15 - XML: Start document: iteration 3
Mon 20 Jan 2014 03:47:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:47:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:47:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:47:22 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:47:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:47:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:47:22 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:47:22 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:47:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:47:22 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:47:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:47:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:47:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:47:32 - XML: Processed 652602 elements - found 0 jobs
Mon 20 Jan 2014 03:47:32 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:47:32 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:47:32 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:47:32 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:47:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:47:34 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:47:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:47:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:47:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:47:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:47:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:47:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:47:37 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:47:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43478088
Mon 20 Jan 2014 03:47:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:47:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43478088
Mon 20 Jan 2014 03:47:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:47:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:47:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:47:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:47:40 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:47:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:47:41 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:47:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 03:47:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 03:47:41 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:47:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8762 values 138556 bits 17319 bytes 
Mon 20 Jan 2014 03:47:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:47:47 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:47:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:47:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:47:47 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:47:47 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:47:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:47:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43478088
Mon 20 Jan 2014 03:47:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:47:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:47:47 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:47:48 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:47:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:47:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:47:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:47:55 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:47:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:47:59 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:47:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:47:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:47:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:47:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:47:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:47:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:48:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:48:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:48:02 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:48:02 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:48:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:48:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:48:02 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:48:02 - job_xml_thread(): Done retrieving: data size 42901859
Mon 20 Jan 2014 03:48:02 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:48:02 - XML: Start document: iteration 4
Mon 20 Jan 2014 03:48:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42901859
Mon 20 Jan 2014 03:48:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42901859
Mon 20 Jan 2014 03:48:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:48:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:48:09 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:48:09 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 03:48:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:48:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:48:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:48:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:48:22 - XML: Processed 645282 elements - found 0 jobs
Mon 20 Jan 2014 03:48:22 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:48:22 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:48:22 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:48:22 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:48:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:48:25 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:48:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:48:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:48:26 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:48:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:48:26 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:48:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:48:26 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:48:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:48:27 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:48:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:48:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:48:27 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:48:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 03:48:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:48:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:48:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:48:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:48:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:48:29 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:48:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43008740
Mon 20 Jan 2014 03:48:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:48:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43008740
Mon 20 Jan 2014 03:48:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:48:37 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:48:37 - job_xml_thread(): Done retrieving: data size 43008740
Mon 20 Jan 2014 03:48:37 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:48:37 - XML: Start document: iteration 5
Mon 20 Jan 2014 03:48:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:48:40 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:48:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:48:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:48:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:48:41 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:48:41 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:48:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:48:41 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:48:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:48:42 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:48:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:48:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:48:43 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:48:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 03:48:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:48:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 03:48:43 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:48:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5834 values 92171 bits 11521 bytes 
Mon 20 Jan 2014 03:48:51 - XML: Processed 645914 elements - found 0 jobs
Mon 20 Jan 2014 03:48:51 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:48:51 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:48:51 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:48:51 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:48:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:48:52 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:48:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:48:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:48:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:48:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:48:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:48:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:48:55 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:48:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43527791
Mon 20 Jan 2014 03:48:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:48:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43527791
Mon 20 Jan 2014 03:48:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:48:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:48:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:49:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:49:04 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:49:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:49:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:49:04 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:49:04 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:49:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:49:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:49:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43527791
Mon 20 Jan 2014 03:49:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:49:06 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:49:06 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:49:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:49:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:49:11 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:49:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 03:49:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:49:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:49:14 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:49:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:49:17 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:49:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:49:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:49:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:49:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:49:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:49:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:49:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:49:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:49:20 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:49:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:49:20 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:49:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:49:20 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:49:20 - job_xml_thread(): Done retrieving: data size 43539646
Mon 20 Jan 2014 03:49:20 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:49:20 - XML: Start document: iteration 6
Mon 20 Jan 2014 03:49:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43539646
Mon 20 Jan 2014 03:49:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:49:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43539646
Mon 20 Jan 2014 03:49:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:49:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:49:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:49:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:49:35 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:49:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:49:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:49:36 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:49:36 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:49:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:49:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:49:36 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:49:38 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:49:38 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:49:38 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:49:38 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:49:38 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:49:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:49:43 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:49:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:49:43 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:49:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 03:49:43 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:49:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 03:49:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6153 values 97066 bits 12133 bytes 
Mon 20 Jan 2014 03:49:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:49:45 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:49:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:49:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:49:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:49:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:49:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:49:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:49:49 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:49:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43550540
Mon 20 Jan 2014 03:49:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:49:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43550540
Mon 20 Jan 2014 03:49:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:49:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:49:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:49:53 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:49:53 - job_xml_thread(): Done retrieving: data size 43550540
Mon 20 Jan 2014 03:49:53 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:49:53 - XML: Start document: iteration 7
Mon 20 Jan 2014 03:50:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:50:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:50:06 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:50:06 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:50:06 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:50:06 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:50:06 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:50:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:50:07 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:50:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:50:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:50:08 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:50:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:50:08 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:50:08 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:50:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:50:10 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:50:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 03:50:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:50:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:50:11 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:50:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:50:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:50:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:50:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:50:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:50:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:50:15 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:50:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43587091
Mon 20 Jan 2014 03:50:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:50:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43587091
Mon 20 Jan 2014 03:50:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:50:22 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:50:22 - job_xml_thread(): Done retrieving: data size 43587091
Mon 20 Jan 2014 03:50:22 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:50:22 - XML: Start document: iteration 8
Mon 20 Jan 2014 03:50:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:50:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:50:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:50:26 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:50:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:50:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:50:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:50:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:50:28 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:50:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:50:28 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:50:28 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:50:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:50:34 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:50:34 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:50:34 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:50:34 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:50:34 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:50:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:50:37 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:50:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:50:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:50:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:50:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:50:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:50:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:50:40 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:50:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560658
Mon 20 Jan 2014 03:50:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:50:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560658
Mon 20 Jan 2014 03:50:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:50:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:50:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:50:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:50:44 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:50:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:50:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 03:50:44 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:50:44 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:50:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 03:50:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8987 values 141778 bits 17722 bytes 
Mon 20 Jan 2014 03:50:49 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:50:49 - job_xml_thread(): Done retrieving: data size 43560658
Mon 20 Jan 2014 03:50:49 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:50:49 - XML: Start document: iteration 9
Mon 20 Jan 2014 03:50:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:50:51 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:50:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:50:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:50:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:50:52 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:50:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:50:52 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:50:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:50:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:50:53 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:50:59 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:50:59 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:50:59 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:50:59 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:50:59 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:51:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:51:03 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:51:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:51:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:51:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:51:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:51:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:51:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:51:07 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:51:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43548966
Mon 20 Jan 2014 03:51:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:51:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:51:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:51:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43548966
Mon 20 Jan 2014 03:51:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:51:14 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:51:14 - job_xml_thread(): Done retrieving: data size 43548966
Mon 20 Jan 2014 03:51:14 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:51:14 - XML: Start document: iteration 10
Mon 20 Jan 2014 03:51:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:51:18 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:51:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:51:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:51:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:51:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:51:19 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:51:19 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:51:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:51:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:51:19 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:51:27 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:51:27 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:51:27 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:51:27 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:51:27 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:51:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:51:30 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:51:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:51:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:51:30 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:51:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 03:51:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:51:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:51:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:51:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:51:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:51:33 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:51:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556349
Mon 20 Jan 2014 03:51:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:51:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:51:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:51:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556349
Mon 20 Jan 2014 03:51:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:51:42 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:51:42 - job_xml_thread(): Done retrieving: data size 43556349
Mon 20 Jan 2014 03:51:42 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:51:42 - XML: Start document: iteration 11
Mon 20 Jan 2014 03:51:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:51:44 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:51:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:51:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 03:51:45 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:51:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5870 values 92634 bits 11579 bytes 
Mon 20 Jan 2014 03:51:45 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:51:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 03:51:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:51:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:51:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:51:47 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:51:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:51:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:51:47 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:51:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:51:47 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:51:47 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:51:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:51:56 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:51:56 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:51:56 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:51:56 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:51:56 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:51:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:51:58 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:51:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:51:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:51:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:51:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:51:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:51:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:52:01 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 03:52:01 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 03:52:01 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:52:01 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:52:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570761
Mon 20 Jan 2014 03:52:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:52:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570761
Mon 20 Jan 2014 03:52:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:52:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:52:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:52:11 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:52:11 - job_xml_thread(): Done retrieving: data size 43570761
Mon 20 Jan 2014 03:52:11 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:52:11 - XML: Start document: iteration 12
Mon 20 Jan 2014 03:52:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:52:13 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:52:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:52:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:52:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:52:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:52:14 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:52:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:52:14 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:52:14 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:52:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:52:20 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:52:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 03:52:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:52:22 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:52:22 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:52:22 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:52:22 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:52:22 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:52:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:52:24 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:52:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:52:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:52:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:52:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:52:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:52:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:52:26 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:52:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557736
Mon 20 Jan 2014 03:52:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:52:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557736
Mon 20 Jan 2014 03:52:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:52:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:52:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:52:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:52:37 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:52:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:52:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:52:37 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:52:37 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:52:38 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:52:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:52:38 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:52:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:52:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:52:40 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:52:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:52:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:52:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:52:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:52:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:52:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:52:42 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:52:42 - job_xml_thread(): Done retrieving: data size 43591448
Mon 20 Jan 2014 03:52:42 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:52:42 - XML: Start document: iteration 13
Mon 20 Jan 2014 03:52:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43591448
Mon 20 Jan 2014 03:52:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:52:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43591448
Mon 20 Jan 2014 03:52:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:52:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:52:45 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:52:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:52:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 03:52:47 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:52:47 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:52:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 03:52:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8047 values 126956 bits 15869 bytes 
Mon 20 Jan 2014 03:52:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:52:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:52:54 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:52:54 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:52:54 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:52:54 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:52:54 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:52:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:52:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:53:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:53:05 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:53:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:53:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:53:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:53:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:53:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:53:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:53:06 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:53:06 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:53:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:53:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:53:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:53:07 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:53:07 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:53:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:53:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:53:08 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:53:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43516749
Mon 20 Jan 2014 03:53:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:53:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43516749
Mon 20 Jan 2014 03:53:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:53:09 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:53:09 - job_xml_thread(): Done retrieving: data size 43516749
Mon 20 Jan 2014 03:53:09 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:53:09 - XML: Start document: iteration 14
Mon 20 Jan 2014 03:53:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:53:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:53:21 - XML: Processed 652602 elements - found 0 jobs
Mon 20 Jan 2014 03:53:21 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:53:21 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:53:21 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:53:21 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:53:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:53:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:53:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:53:26 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:53:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:53:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:53:27 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:53:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:53:27 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:53:27 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:53:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:53:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:53:31 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:53:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:53:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:53:32 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:53:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 03:53:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:53:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:53:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:53:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:53:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:53:33 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:53:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43159285
Mon 20 Jan 2014 03:53:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:53:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43159285
Mon 20 Jan 2014 03:53:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:53:36 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:53:36 - job_xml_thread(): Done retrieving: data size 43159285
Mon 20 Jan 2014 03:53:36 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:53:36 - XML: Start document: iteration 15
Mon 20 Jan 2014 03:53:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:53:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:53:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:53:45 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:53:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:53:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:53:46 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:53:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:53:46 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:53:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:53:46 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:53:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:53:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:53:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:53:47 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:53:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:53:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 03:53:48 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:53:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 03:53:48 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:53:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5693 values 89747 bits 11218 bytes 
Mon 20 Jan 2014 03:53:52 - XML: Processed 648106 elements - found 0 jobs
Mon 20 Jan 2014 03:53:52 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:53:52 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:53:52 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:53:52 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:53:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:53:56 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:53:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:53:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:53:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:53:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:53:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:53:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:53:58 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:53:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42923890
Mon 20 Jan 2014 03:53:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:53:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42923890
Mon 20 Jan 2014 03:53:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:54:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:54:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:54:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:54:06 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:54:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:54:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:54:07 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:54:07 - job_xml_thread(): Done retrieving: data size 42923890
Mon 20 Jan 2014 03:54:07 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:54:07 - XML: Start document: iteration 16
Mon 20 Jan 2014 03:54:08 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:54:08 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:54:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:54:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:54:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42923890
Mon 20 Jan 2014 03:54:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:54:09 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 03:54:09 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:54:10 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:54:10 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:54:10 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 03:54:10 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 03:54:10 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 03:54:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:54:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:54:23 - XML: Processed 645500 elements - found 0 jobs
Mon 20 Jan 2014 03:54:23 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:54:23 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:54:23 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:54:23 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:54:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:54:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:54:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:54:24 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:54:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:54:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:54:26 - size of cluster 'LISA Cluster': 624 hosts 79480 metrics 777342 values 12258981 bits 1532372 bytes 
Mon 20 Jan 2014 03:54:26 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:54:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:54:26 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:54:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:54:27 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:54:27 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:54:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:54:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:54:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:54:27 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:54:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 03:54:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:54:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:54:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:54:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:54:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:54:30 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:54:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43006363
Mon 20 Jan 2014 03:54:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:54:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43006363
Mon 20 Jan 2014 03:54:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:54:38 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:54:38 - job_xml_thread(): Done retrieving: data size 43006363
Mon 20 Jan 2014 03:54:38 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:54:38 - XML: Start document: iteration 17
Mon 20 Jan 2014 03:54:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:54:38 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:54:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:54:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:54:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:54:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:54:43 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:54:43 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:54:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:54:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:54:43 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:54:47 - XML: Processed 645902 elements - found 0 jobs
Mon 20 Jan 2014 03:54:48 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:54:48 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:54:48 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:54:48 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:54:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:54:48 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:54:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:54:49 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:54:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 03:54:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 03:54:49 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:54:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5762 values 90801 bits 11350 bytes 
Mon 20 Jan 2014 03:54:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:54:51 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:54:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:54:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:54:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:54:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:54:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:54:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:54:54 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:54:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43539650
Mon 20 Jan 2014 03:54:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:54:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43539650
Mon 20 Jan 2014 03:54:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:54:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:54:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:55:03 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:55:03 - job_xml_thread(): Done retrieving: data size 43539650
Mon 20 Jan 2014 03:55:03 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:55:03 - XML: Start document: iteration 18
Mon 20 Jan 2014 03:55:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:55:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:55:10 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:55:10 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 03:55:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:55:17 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:55:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:55:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:55:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:55:17 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:55:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:55:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:55:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:55:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:55:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:55:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:55:17 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:55:17 - XML: Processed 653208 elements - found 0 jobs
Mon 20 Jan 2014 03:55:17 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:55:17 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:55:17 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:55:17 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:55:17 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:55:17 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:55:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:55:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:55:18 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:55:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 03:55:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:55:20 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:55:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567187
Mon 20 Jan 2014 03:55:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:55:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567187
Mon 20 Jan 2014 03:55:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:55:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:55:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:55:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:55:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:55:33 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:55:33 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:55:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:55:34 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:55:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:55:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:55:35 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:55:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:55:35 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:55:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:55:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:55:36 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:55:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:55:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:55:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:55:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:55:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:55:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:55:40 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:55:40 - job_xml_thread(): Done retrieving: data size 43567273
Mon 20 Jan 2014 03:55:40 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:55:40 - XML: Start document: iteration 19
Mon 20 Jan 2014 03:55:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567273
Mon 20 Jan 2014 03:55:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:55:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567273
Mon 20 Jan 2014 03:55:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:55:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:55:49 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:55:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:55:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 03:55:51 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:55:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8929 values 140795 bits 17599 bytes 
Mon 20 Jan 2014 03:55:51 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:55:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:55:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 03:55:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:55:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:55:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:56:01 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:56:01 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:56:01 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:56:01 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:56:01 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:56:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:56:01 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:56:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:56:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:56:01 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:56:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:56:01 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:56:01 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:56:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:56:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:56:04 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:56:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:56:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:56:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:56:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:56:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:56:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:56:08 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:56:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565060
Mon 20 Jan 2014 03:56:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:56:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565060
Mon 20 Jan 2014 03:56:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:56:16 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:56:16 - job_xml_thread(): Done retrieving: data size 43565060
Mon 20 Jan 2014 03:56:16 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:56:16 - XML: Start document: iteration 20
Mon 20 Jan 2014 03:56:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:56:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:56:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:56:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:56:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:56:21 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:56:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:56:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:56:22 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:56:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:56:22 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:56:22 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:56:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:56:29 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:56:29 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:56:29 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:56:29 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:56:29 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:56:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:56:32 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:56:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:56:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:56:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:56:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:56:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:56:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:56:32 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:56:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 03:56:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:56:35 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:56:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553021
Mon 20 Jan 2014 03:56:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:56:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553021
Mon 20 Jan 2014 03:56:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:56:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:56:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:56:44 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:56:44 - job_xml_thread(): Done retrieving: data size 43553021
Mon 20 Jan 2014 03:56:44 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:56:44 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 03:56:44 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 03:56:44 - Housekeeping: done.
Mon 20 Jan 2014 03:56:44 - XML: Start document: iteration 0
Mon 20 Jan 2014 03:56:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:56:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:56:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:56:50 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:56:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:56:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:56:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:56:51 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:56:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:56:51 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:56:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 03:56:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 03:56:51 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:56:51 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:56:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5623 values 88617 bits 11077 bytes 
Mon 20 Jan 2014 03:56:52 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:56:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:56:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:56:52 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:56:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:56:55 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:56:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:56:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:56:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:56:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:56:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:56:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:56:57 - XML: Processed 653349 elements - found 0 jobs
Mon 20 Jan 2014 03:56:57 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:56:57 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:56:57 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:56:57 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:57:01 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:57:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43589586
Mon 20 Jan 2014 03:57:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:57:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43589586
Mon 20 Jan 2014 03:57:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:57:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:57:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:57:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:57:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:57:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:57:12 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:57:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:57:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:57:12 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:57:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:57:12 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:57:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:57:12 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:57:12 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:57:15 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:57:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 03:57:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:57:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:57:17 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:57:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:57:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:57:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:57:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:57:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:57:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:57:20 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:57:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571197
Mon 20 Jan 2014 03:57:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:57:21 - job_xml_thread(): Done retrieving: data size 43571197
Mon 20 Jan 2014 03:57:21 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:57:21 - XML: Start document: iteration 1
Mon 20 Jan 2014 03:57:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571197
Mon 20 Jan 2014 03:57:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:57:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:57:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:57:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:57:33 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:57:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:57:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:57:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:57:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:57:34 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:57:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:57:34 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:57:34 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:57:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:57:37 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:57:37 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:57:37 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:57:37 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:57:37 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:57:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:57:41 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:57:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:57:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:57:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:57:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:57:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:57:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:57:44 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:57:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583070
Mon 20 Jan 2014 03:57:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:57:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583070
Mon 20 Jan 2014 03:57:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:57:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:57:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:57:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:57:52 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:57:52 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:57:52 - job_xml_thread(): Done retrieving: data size 43583070
Mon 20 Jan 2014 03:57:52 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:57:52 - XML: Start document: iteration 2
Mon 20 Jan 2014 03:57:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:57:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 03:57:53 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:57:53 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:57:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 03:57:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:57:53 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:57:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:57:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8903 values 140350 bits 17543 bytes 
Mon 20 Jan 2014 03:57:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:57:55 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:57:55 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:57:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:57:55 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:57:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:57:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:57:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:58:02 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:58:02 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:58:02 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:58:02 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:58:02 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:58:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:58:07 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:58:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:58:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:58:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:58:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:58:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:58:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:58:10 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:58:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558516
Mon 20 Jan 2014 03:58:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:58:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558516
Mon 20 Jan 2014 03:58:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:58:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:58:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:58:17 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:58:17 - job_xml_thread(): Done retrieving: data size 43558516
Mon 20 Jan 2014 03:58:18 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:58:18 - XML: Start document: iteration 3
Mon 20 Jan 2014 03:58:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:58:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:58:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:58:26 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:58:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:58:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:58:27 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:58:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:58:27 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:58:27 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:58:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:58:29 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:58:29 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:58:29 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:58:29 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:58:29 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:58:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:58:32 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:58:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:58:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:58:32 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:58:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 03:58:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:58:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:58:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:58:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:58:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:58:35 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:58:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568597
Mon 20 Jan 2014 03:58:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:58:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568597
Mon 20 Jan 2014 03:58:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:58:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:58:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:58:44 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:58:44 - job_xml_thread(): Done retrieving: data size 43568597
Mon 20 Jan 2014 03:58:44 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:58:44 - XML: Start document: iteration 4
Mon 20 Jan 2014 03:58:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:58:45 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:58:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:58:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:58:47 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:58:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:58:47 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:58:47 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:58:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:58:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:58:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:58:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:58:53 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:58:53 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:58:53 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:58:53 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:58:53 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:58:53 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:58:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:58:54 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:58:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 03:58:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 03:58:54 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:58:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5971 values 94170 bits 11771 bytes 
Mon 20 Jan 2014 03:58:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:58:58 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:58:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:58:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:58:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:58:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:58:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:58:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:59:01 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:59:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567796
Mon 20 Jan 2014 03:59:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:59:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:59:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:59:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567796
Mon 20 Jan 2014 03:59:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:59:08 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:59:09 - job_xml_thread(): Done retrieving: data size 43567796
Mon 20 Jan 2014 03:59:09 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:59:09 - XML: Start document: iteration 5
Mon 20 Jan 2014 03:59:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:59:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:59:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:59:14 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:59:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:59:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:59:14 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:59:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:59:14 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:59:14 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:59:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:59:22 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 03:59:22 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:59:22 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:59:22 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:59:22 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:59:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:59:25 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:59:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:59:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:59:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:59:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:59:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:59:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:59:25 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:59:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 03:59:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:59:28 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:59:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43490646
Mon 20 Jan 2014 03:59:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:59:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43490646
Mon 20 Jan 2014 03:59:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:59:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:59:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:59:37 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 03:59:37 - job_xml_thread(): Done retrieving: data size 43490646
Mon 20 Jan 2014 03:59:37 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 03:59:37 - XML: Start document: iteration 6
Mon 20 Jan 2014 03:59:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 03:59:39 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 03:59:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 03:59:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:59:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 03:59:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 03:59:41 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:59:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 03:59:41 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:59:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 03:59:41 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 03:59:49 - XML: Processed 652602 elements - found 0 jobs
Mon 20 Jan 2014 03:59:49 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 03:59:49 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 03:59:49 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 03:59:49 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 03:59:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 03:59:51 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 03:59:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 03:59:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:59:52 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 03:59:52 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 03:59:52 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 03:59:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:59:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 03:59:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 03:59:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 03:59:53 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 03:59:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42927666
Mon 20 Jan 2014 03:59:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 03:59:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42927666
Mon 20 Jan 2014 03:59:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:59:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 03:59:54 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 03:59:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:59:56 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 03:59:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 03:59:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 03:59:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 03:59:56 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 03:59:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8797 values 138677 bits 17334 bytes 
Mon 20 Jan 2014 03:59:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:00:04 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:00:04 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:00:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:00:05 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:00:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:00:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:00:06 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:00:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:00:06 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:00:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:00:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:00:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:00:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:00:08 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:00:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:00:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:00:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:00:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:00:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:00:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:00:11 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:00:11 - job_xml_thread(): Done retrieving: data size 42913601
Mon 20 Jan 2014 04:00:11 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:00:11 - XML: Start document: iteration 7
Mon 20 Jan 2014 04:00:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42913601
Mon 20 Jan 2014 04:00:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42913601
Mon 20 Jan 2014 04:00:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:00:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:00:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:00:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:00:23 - XML: Processed 645164 elements - found 0 jobs
Mon 20 Jan 2014 04:00:23 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:00:23 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:00:23 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:00:23 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:00:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:00:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:00:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:00:29 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:00:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:00:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:00:30 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:00:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:00:30 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:00:30 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:00:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:00:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:00:33 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:00:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:00:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:00:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:00:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:00:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:00:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:00:33 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:00:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 04:00:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:00:34 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:00:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43358275
Mon 20 Jan 2014 04:00:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:00:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43358275
Mon 20 Jan 2014 04:00:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:00:38 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:00:38 - job_xml_thread(): Done retrieving: data size 43358275
Mon 20 Jan 2014 04:00:38 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:00:38 - XML: Start document: iteration 8
Mon 20 Jan 2014 04:00:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:00:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:00:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:00:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:00:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:00:52 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:00:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:00:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:00:52 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:00:52 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:00:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:00:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:00:52 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:00:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:00:54 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:00:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:00:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:00:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:00:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:00:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:00:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:00:56 - XML: Processed 650656 elements - found 0 jobs
Mon 20 Jan 2014 04:00:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:00:56 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:00:56 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:00:56 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:00:56 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:00:56 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:00:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:00:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 04:00:56 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:00:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5531 values 87178 bits 10897 bytes 
Mon 20 Jan 2014 04:00:56 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:00:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 04:00:58 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:00:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43547316
Mon 20 Jan 2014 04:00:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:01:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43547316
Mon 20 Jan 2014 04:01:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:01:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:01:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:01:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:01:09 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:01:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:01:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:01:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:01:10 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 04:01:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:01:10 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:01:10 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:01:11 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 04:01:11 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 04:01:11 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:01:11 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:01:11 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:01:11 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 04:01:11 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:01:11 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:01:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:01:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:01:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:01:12 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:01:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:01:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:01:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:01:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:01:13 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 882523 values 13914945 bits 1739368 bytes 
Mon 20 Jan 2014 04:01:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:01:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:01:14 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:01:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 04:01:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:01:16 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:01:16 - job_xml_thread(): Done retrieving: data size 43573674
Mon 20 Jan 2014 04:01:16 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:01:16 - XML: Start document: iteration 9
Mon 20 Jan 2014 04:01:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573674
Mon 20 Jan 2014 04:01:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:01:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573674
Mon 20 Jan 2014 04:01:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:01:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:01:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:01:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:01:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:01:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:01:33 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:01:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:01:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:01:34 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:01:34 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:01:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:01:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:01:35 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:01:37 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 04:01:37 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:01:38 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:01:38 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:01:38 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:01:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:01:40 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:01:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:01:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:01:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:01:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:01:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:01:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:01:44 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:01:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579660
Mon 20 Jan 2014 04:01:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:01:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579660
Mon 20 Jan 2014 04:01:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:01:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:01:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:01:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:01:50 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:01:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:01:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:01:53 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:01:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:01:53 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:01:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579660
Mon 20 Jan 2014 04:01:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:01:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:01:53 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:01:53 - job_xml_thread(): Done retrieving: data size 43579660
Mon 20 Jan 2014 04:01:53 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:01:53 - XML: Start document: iteration 10
Mon 20 Jan 2014 04:01:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:01:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:01:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:01:57 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:02:00 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:02:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:02:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 04:02:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 04:02:00 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:02:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8178 values 129293 bits 16161 bytes 
Mon 20 Jan 2014 04:02:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:02:08 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:02:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:02:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:02:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:02:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:02:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:02:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:02:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:02:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:02:10 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:02:12 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:02:12 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 04:02:12 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 04:02:12 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:02:12 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:02:12 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:02:12 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:02:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:02:14 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:02:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:02:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:02:15 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:02:15 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:02:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:02:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:02:18 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:02:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569722
Mon 20 Jan 2014 04:02:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:02:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569722
Mon 20 Jan 2014 04:02:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:02:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:02:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:02:27 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:02:27 - job_xml_thread(): Done retrieving: data size 43569722
Mon 20 Jan 2014 04:02:27 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:02:27 - XML: Start document: iteration 11
Mon 20 Jan 2014 04:02:27 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:02:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 04:02:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:02:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:02:28 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:02:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:02:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:02:31 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:02:31 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:02:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:02:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:02:31 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:02:35 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 04:02:35 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:02:35 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:02:35 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:02:35 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:02:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:02:39 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:02:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:02:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:02:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:02:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:02:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:02:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:02:42 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:02:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577520
Mon 20 Jan 2014 04:02:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:02:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577520
Mon 20 Jan 2014 04:02:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:02:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:02:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:02:50 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:02:50 - job_xml_thread(): Done retrieving: data size 43577520
Mon 20 Jan 2014 04:02:50 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:02:51 - XML: Start document: iteration 12
Mon 20 Jan 2014 04:02:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:02:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:03:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:03:00 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:03:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:03:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 04:03:01 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:03:01 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:03:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6113 values 96662 bits 12082 bytes 
Mon 20 Jan 2014 04:03:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 04:03:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:03:04 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:03:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:03:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:03:05 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:03:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:03:05 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:03:05 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:03:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:03:07 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 04:03:07 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:03:07 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:03:07 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:03:07 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:03:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:03:08 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:03:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:03:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:03:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:03:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:03:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:03:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:03:11 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:03:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43592207
Mon 20 Jan 2014 04:03:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:03:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43592207
Mon 20 Jan 2014 04:03:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:03:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:03:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:03:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:03:21 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:03:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:03:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:03:22 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:03:22 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:03:22 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:03:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:03:22 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:03:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:03:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:03:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:03:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:03:26 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:03:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:03:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:03:27 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:03:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 04:03:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:03:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:03:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:03:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:03:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:03:29 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:03:29 - job_xml_thread(): Done retrieving: data size 43590348
Mon 20 Jan 2014 04:03:29 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:03:29 - XML: Start document: iteration 13
Mon 20 Jan 2014 04:03:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43590348
Mon 20 Jan 2014 04:03:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:03:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43590348
Mon 20 Jan 2014 04:03:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:03:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:03:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:03:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:03:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:03:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:03:45 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:03:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:03:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:03:45 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:03:45 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:03:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:03:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:03:45 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:03:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:03:53 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:03:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:03:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:03:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:03:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:03:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:03:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:03:55 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 04:03:55 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:03:55 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:03:55 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:03:55 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:03:58 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:03:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567003
Mon 20 Jan 2014 04:03:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:03:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567003
Mon 20 Jan 2014 04:03:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:04:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:04:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:04:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:04:02 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:04:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:04:03 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:04:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 04:04:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 04:04:03 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:04:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8869 values 140024 bits 17503 bytes 
Mon 20 Jan 2014 04:04:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:04:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:04:10 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:04:10 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:04:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:04:11 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:04:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:04:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:04:12 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:04:12 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:04:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:04:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:04:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:04:15 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:04:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:04:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:04:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:04:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:04:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:04:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:04:18 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:04:18 - job_xml_thread(): Done retrieving: data size 43565081
Mon 20 Jan 2014 04:04:18 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:04:18 - XML: Start document: iteration 14
Mon 20 Jan 2014 04:04:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565081
Mon 20 Jan 2014 04:04:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:04:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565081
Mon 20 Jan 2014 04:04:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:04:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:04:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:04:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:04:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:04:35 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 04:04:35 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:04:35 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:04:35 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:04:35 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:04:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:04:39 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:04:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:04:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:04:40 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:04:40 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:04:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:04:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:04:40 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:04:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:04:42 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:04:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:04:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:04:42 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:04:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:04:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:04:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:04:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 04:04:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:04:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:04:45 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:04:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43594984
Mon 20 Jan 2014 04:04:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:04:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43594984
Mon 20 Jan 2014 04:04:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:04:50 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:04:50 - job_xml_thread(): Done retrieving: data size 43594984
Mon 20 Jan 2014 04:04:50 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:04:50 - XML: Start document: iteration 15
Mon 20 Jan 2014 04:04:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:04:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:04:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:04:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:04:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:04:58 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:04:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:04:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:04:59 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:04:59 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:04:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:04:59 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:04:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:05:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:05:03 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:05:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:05:05 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:05:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 04:05:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 04:05:05 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:05:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5737 values 90473 bits 11309 bytes 
Mon 20 Jan 2014 04:05:05 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 04:05:05 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:05:05 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:05:05 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:05:05 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:05:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:05:07 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:05:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:05:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:05:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:05:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:05:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:05:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:05:11 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:05:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561984
Mon 20 Jan 2014 04:05:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:05:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561984
Mon 20 Jan 2014 04:05:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:05:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:05:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:05:20 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:05:20 - job_xml_thread(): Done retrieving: data size 43561984
Mon 20 Jan 2014 04:05:20 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:05:20 - XML: Start document: iteration 16
Mon 20 Jan 2014 04:05:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:05:22 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:05:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:05:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:05:22 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:05:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:05:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:05:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:05:22 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:05:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:05:22 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:05:32 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 04:05:32 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:05:32 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:05:32 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:05:32 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:05:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:05:35 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:05:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:05:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:05:36 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:05:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 04:05:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:05:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:05:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:05:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:05:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:05:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:05:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:05:38 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:05:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43475068
Mon 20 Jan 2014 04:05:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:05:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43475068
Mon 20 Jan 2014 04:05:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:05:47 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:05:47 - job_xml_thread(): Done retrieving: data size 43475068
Mon 20 Jan 2014 04:05:47 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:05:47 - XML: Start document: iteration 17
Mon 20 Jan 2014 04:05:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:05:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:05:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:05:53 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:05:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:05:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:05:55 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:05:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:05:55 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:05:55 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:05:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:06:01 - XML: Processed 652590 elements - found 0 jobs
Mon 20 Jan 2014 04:06:01 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:06:01 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:06:01 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:06:01 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:06:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:06:03 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:06:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:06:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:06:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:06:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:06:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:06:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:06:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:06:05 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:06:05 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:06:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:06:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 04:06:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 04:06:05 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:06:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5442 values 85787 bits 10723 bytes 
Mon 20 Jan 2014 04:06:07 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:06:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42882967
Mon 20 Jan 2014 04:06:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:06:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42882967
Mon 20 Jan 2014 04:06:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:06:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:06:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:06:16 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:06:16 - job_xml_thread(): Done retrieving: data size 42882967
Mon 20 Jan 2014 04:06:16 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:06:16 - XML: Start document: iteration 18
Mon 20 Jan 2014 04:06:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:06:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:06:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:06:22 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:06:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:06:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:06:23 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:06:23 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:06:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:06:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:06:23 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:06:31 - XML: Processed 645152 elements - found 0 jobs
Mon 20 Jan 2014 04:06:31 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:06:31 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:06:31 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:06:31 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:06:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:06:33 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:06:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:06:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:06:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:06:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:06:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:06:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:06:36 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:06:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 04:06:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:06:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:06:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:06:39 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:06:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43412147
Mon 20 Jan 2014 04:06:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:06:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43412147
Mon 20 Jan 2014 04:06:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:06:46 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:06:46 - job_xml_thread(): Done retrieving: data size 43412147
Mon 20 Jan 2014 04:06:46 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:06:46 - XML: Start document: iteration 19
Mon 20 Jan 2014 04:06:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:06:48 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:06:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:06:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:06:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:06:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:06:49 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:06:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:06:49 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:06:49 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:06:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:06:57 - XML: Processed 651756 elements - found 0 jobs
Mon 20 Jan 2014 04:06:57 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:06:57 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:06:57 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:06:57 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:07:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:07:01 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:07:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:07:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:07:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:07:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:07:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:07:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:07:04 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:07:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43537871
Mon 20 Jan 2014 04:07:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:07:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:07:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:07:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43537871
Mon 20 Jan 2014 04:07:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:07:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:07:06 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:07:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:07:06 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:07:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 04:07:06 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:07:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7118 values 112185 bits 14023 bytes 
Mon 20 Jan 2014 04:07:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 04:07:13 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:07:13 - job_xml_thread(): Done retrieving: data size 43537871
Mon 20 Jan 2014 04:07:13 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:07:13 - XML: Start document: iteration 20
Mon 20 Jan 2014 04:07:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:07:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:07:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:07:22 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:07:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:07:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:07:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:07:23 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:07:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:07:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:07:24 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:07:24 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:07:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:07:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:07:24 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:07:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:07:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:07:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:07:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:07:27 - XML: Processed 653234 elements - found 0 jobs
Mon 20 Jan 2014 04:07:27 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:07:27 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:07:27 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:07:27 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:07:31 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:07:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583696
Mon 20 Jan 2014 04:07:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:07:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583696
Mon 20 Jan 2014 04:07:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:07:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:07:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:07:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:07:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:07:42 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:07:42 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:07:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:07:45 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:07:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:07:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:07:45 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:07:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:07:45 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:07:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:07:50 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:07:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 04:07:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:07:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:07:51 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:07:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:07:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:07:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:07:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:07:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:07:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:07:54 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:07:54 - job_xml_thread(): Done retrieving: data size 43550333
Mon 20 Jan 2014 04:07:54 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:07:54 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 04:07:54 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 04:07:54 - Housekeeping: done.
Mon 20 Jan 2014 04:07:54 - XML: Start document: iteration 0
Mon 20 Jan 2014 04:07:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43550333
Mon 20 Jan 2014 04:07:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:07:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43550333
Mon 20 Jan 2014 04:07:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:08:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:08:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:08:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:08:06 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:08:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:08:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:08:08 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:08:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:08:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 04:08:08 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:08:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5853 values 92287 bits 11535 bytes 
Mon 20 Jan 2014 04:08:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 04:08:10 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 04:08:10 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:08:10 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:08:10 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:08:10 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:08:12 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 04:08:12 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:08:14 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:08:14 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 04:08:14 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:08:14 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 04:08:14 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 04:08:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:08:15 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:08:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:08:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:08:16 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:08:16 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:08:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:08:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:08:16 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:08:16 - size of cluster 'LISA Cluster': 624 hosts 79476 metrics 1149016 values 18137045 bits 2267130 bytes 
Mon 20 Jan 2014 04:08:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:08:22 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:08:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:08:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:08:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:08:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:08:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:08:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:08:26 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:08:28 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:08:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569048
Mon 20 Jan 2014 04:08:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:08:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569048
Mon 20 Jan 2014 04:08:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:08:29 - job_xml_thread(): Done retrieving: data size 43569048
Mon 20 Jan 2014 04:08:29 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:08:29 - XML: Start document: iteration 1
Mon 20 Jan 2014 04:08:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:08:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:08:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:08:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:08:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:08:43 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:08:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:08:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:08:44 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:08:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:08:44 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:08:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:08:44 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:08:46 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:08:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 04:08:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:08:49 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 04:08:49 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:08:49 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:08:49 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:08:49 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:08:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:08:51 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:08:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:08:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:08:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:08:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:08:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:08:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:08:58 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:08:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565784
Mon 20 Jan 2014 04:08:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:08:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:08:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:08:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565784
Mon 20 Jan 2014 04:08:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:09:04 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:09:04 - job_xml_thread(): Done retrieving: data size 43565784
Mon 20 Jan 2014 04:09:04 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:09:04 - XML: Start document: iteration 2
Mon 20 Jan 2014 04:09:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:09:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:09:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:09:09 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:09:09 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:09:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 04:09:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:09:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 04:09:10 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:09:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5929 values 93522 bits 11690 bytes 
Mon 20 Jan 2014 04:09:14 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:09:14 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 04:09:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:09:15 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:09:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:09:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:09:16 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:09:16 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:09:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:09:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:09:16 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:09:19 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 04:09:19 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:09:19 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:09:19 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:09:19 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:09:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:09:22 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:09:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:09:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:09:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:09:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:09:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:09:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:09:30 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:09:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569360
Mon 20 Jan 2014 04:09:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:09:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569360
Mon 20 Jan 2014 04:09:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:09:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:09:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:09:34 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:09:34 - job_xml_thread(): Done retrieving: data size 43569360
Mon 20 Jan 2014 04:09:34 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:09:34 - XML: Start document: iteration 3
Mon 20 Jan 2014 04:09:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:09:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:09:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:09:48 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:09:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:09:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:09:49 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:09:49 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:09:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:09:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:09:50 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:09:50 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 04:09:50 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:09:50 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:09:50 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:09:50 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:09:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:09:53 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:09:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:09:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:09:53 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:09:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 04:09:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:09:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:09:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:09:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:09:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:09:59 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:09:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581598
Mon 20 Jan 2014 04:09:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:10:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581598
Mon 20 Jan 2014 04:10:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:10:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:10:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:10:05 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:10:05 - job_xml_thread(): Done retrieving: data size 43581598
Mon 20 Jan 2014 04:10:05 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:10:05 - XML: Start document: iteration 4
Mon 20 Jan 2014 04:10:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:10:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:10:10 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:10:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:10:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:10:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 04:10:11 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:10:11 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:10:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5834 values 91966 bits 11495 bytes 
Mon 20 Jan 2014 04:10:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 04:10:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:10:21 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:10:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:10:21 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 04:10:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:10:21 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:10:21 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:10:21 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:10:21 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:10:22 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:10:22 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:10:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:10:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:10:22 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:10:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:10:26 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:10:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:10:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:10:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:10:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:10:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:10:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:10:36 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:10:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:10:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:10:37 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:10:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569135
Mon 20 Jan 2014 04:10:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:10:37 - job_xml_thread(): Done retrieving: data size 43569135
Mon 20 Jan 2014 04:10:37 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:10:37 - XML: Start document: iteration 5
Mon 20 Jan 2014 04:10:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569135
Mon 20 Jan 2014 04:10:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:10:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:10:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:10:49 - XML: Processed 653349 elements - found 0 jobs
Mon 20 Jan 2014 04:10:49 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:10:49 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:10:49 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:10:49 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:10:51 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:10:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 04:10:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:10:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:10:55 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:10:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:10:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:10:56 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:10:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:10:56 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:10:56 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:10:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:10:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:10:59 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:10:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:10:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:11:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:11:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:11:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:11:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:11:04 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:11:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:11:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:11:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:11:11 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:11:12 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:11:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565042
Mon 20 Jan 2014 04:11:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:11:12 - job_xml_thread(): Done retrieving: data size 43565042
Mon 20 Jan 2014 04:11:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565042
Mon 20 Jan 2014 04:11:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:11:12 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:11:12 - XML: Start document: iteration 6
Mon 20 Jan 2014 04:11:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:11:12 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:11:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 04:11:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 04:11:13 - Entering storeMetrics(): cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Mon 20 Jan 2014 04:11:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:11:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:11:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:11:33 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:11:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:11:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:11:35 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:11:35 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:11:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:11:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:11:35 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:11:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:11:37 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:11:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:11:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:11:37 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 04:11:37 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:11:37 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:11:37 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:11:37 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:11:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:11:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:11:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:11:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:11:44 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:11:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42991632
Mon 20 Jan 2014 04:11:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:11:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42991632
Mon 20 Jan 2014 04:11:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:11:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:11:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:11:52 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:11:52 - job_xml_thread(): Done retrieving: data size 42991632
Mon 20 Jan 2014 04:11:52 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:11:52 - XML: Start document: iteration 7
Mon 20 Jan 2014 04:11:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:11:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:12:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:12:03 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:12:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:12:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:12:03 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:12:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:12:03 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:12:03 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:12:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:12:05 - XML: Processed 646140 elements - found 0 jobs
Mon 20 Jan 2014 04:12:05 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:12:05 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:12:05 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:12:05 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:12:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:12:07 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:12:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:12:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:12:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:12:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:12:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:12:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:12:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:12:12 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:12:13 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:12:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42905072
Mon 20 Jan 2014 04:12:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:12:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:12:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 04:12:14 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:12:14 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:12:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 04:12:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 11741 values 185220 bits 23152 bytes 
Mon 20 Jan 2014 04:12:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42905072
Mon 20 Jan 2014 04:12:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:12:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:12:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:12:20 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:12:20 - job_xml_thread(): Done retrieving: data size 42905072
Mon 20 Jan 2014 04:12:20 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:12:20 - XML: Start document: iteration 8
Mon 20 Jan 2014 04:12:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:12:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:12:29 - XML: Processed 645152 elements - found 0 jobs
Mon 20 Jan 2014 04:12:29 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:12:29 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:12:29 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:12:29 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:12:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:12:32 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:12:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:12:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:12:32 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:12:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:12:32 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:12:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:12:32 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:12:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:12:38 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:12:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:12:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:12:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:12:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:12:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:12:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:12:44 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:12:47 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:12:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43432936
Mon 20 Jan 2014 04:12:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:12:47 - job_xml_thread(): Done retrieving: data size 43432936
Mon 20 Jan 2014 04:12:47 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:12:47 - XML: Start document: iteration 9
Mon 20 Jan 2014 04:12:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43432936
Mon 20 Jan 2014 04:12:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:12:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:12:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:12:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:12:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:12:55 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:12:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 04:12:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:13:04 - XML: Processed 651710 elements - found 0 jobs
Mon 20 Jan 2014 04:13:04 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:13:04 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:13:04 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:13:04 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:13:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:13:10 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:13:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:13:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:13:11 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:13:11 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:13:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:13:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:13:11 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:13:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:13:11 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:13:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:13:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:13:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:13:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:13:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:13:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:13:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:13:14 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:13:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:13:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 04:13:14 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:13:14 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:13:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 04:13:14 - size of cluster 'Render Cluster': 20 hosts 3139 metrics 2967 values 46812 bits 5851 bytes 
Mon 20 Jan 2014 04:13:19 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:13:21 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:13:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569441
Mon 20 Jan 2014 04:13:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:13:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569441
Mon 20 Jan 2014 04:13:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:13:21 - job_xml_thread(): Done retrieving: data size 43569441
Mon 20 Jan 2014 04:13:21 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:13:21 - XML: Start document: iteration 10
Mon 20 Jan 2014 04:13:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:13:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:13:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:13:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:13:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:13:42 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:13:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:13:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:13:42 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 04:13:42 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:13:42 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:13:42 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:13:42 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:13:42 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:13:42 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:13:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:13:42 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:13:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:13:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:13:47 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:13:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:13:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:13:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:13:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:13:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:13:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:13:50 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:13:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 04:13:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:13:54 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:13:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558289
Mon 20 Jan 2014 04:13:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:13:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558289
Mon 20 Jan 2014 04:13:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:13:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:13:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:13:58 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:13:58 - job_xml_thread(): Done retrieving: data size 43558289
Mon 20 Jan 2014 04:13:58 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:13:58 - XML: Start document: iteration 11
Mon 20 Jan 2014 04:14:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:14:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:14:13 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 04:14:13 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:14:13 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:14:13 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:14:13 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:14:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:14:15 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:14:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:14:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 04:14:15 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:14:15 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:14:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5083 values 80132 bits 10016 bytes 
Mon 20 Jan 2014 04:14:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 04:14:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:14:16 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:14:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:14:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:14:16 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:14:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:14:16 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:14:16 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:14:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:14:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:14:21 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:14:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:14:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:14:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:14:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:14:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:14:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:14:28 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:14:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:14:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:14:32 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:14:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569186
Mon 20 Jan 2014 04:14:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:14:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569186
Mon 20 Jan 2014 04:14:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:14:33 - job_xml_thread(): Done retrieving: data size 43569186
Mon 20 Jan 2014 04:14:33 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:14:33 - XML: Start document: iteration 12
Mon 20 Jan 2014 04:14:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:14:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:14:45 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 04:14:45 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:14:45 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:14:45 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:14:45 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:14:49 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:14:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 04:14:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:14:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:14:50 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:14:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:14:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:14:51 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:14:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:14:51 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:14:51 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:14:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:14:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:14:56 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:14:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:14:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:14:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:14:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:14:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:14:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:14:58 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 04:14:58 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 04:14:58 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:15:00 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:15:00 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:15:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584034
Mon 20 Jan 2014 04:15:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:15:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584034
Mon 20 Jan 2014 04:15:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:15:01 - job_xml_thread(): Done retrieving: data size 43584034
Mon 20 Jan 2014 04:15:01 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:15:01 - XML: Start document: iteration 13
Mon 20 Jan 2014 04:15:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:15:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:15:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:15:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:15:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:15:14 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:15:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:15:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:15:14 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 04:15:14 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:15:14 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:15:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:15:14 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:15:14 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:15:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:15:15 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:15:15 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:15:15 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 04:15:15 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 04:15:15 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 04:15:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:15:16 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:15:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:15:16 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:15:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 04:15:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 04:15:16 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:15:17 - XML: Processed 653351 elements - found 0 jobs
Mon 20 Jan 2014 04:15:17 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:15:17 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:15:17 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:15:17 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:15:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5821 values 91796 bits 11474 bytes 
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Mon 20 Jan 2014 04:15:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:15:24 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:15:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:15:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:15:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:15:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:15:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:15:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:15:27 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:15:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559609
Mon 20 Jan 2014 04:15:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:15:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559609
Mon 20 Jan 2014 04:15:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:15:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:15:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:15:32 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:15:32 - job_xml_thread(): Done retrieving: data size 43559609
Mon 20 Jan 2014 04:15:32 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:15:32 - XML: Start document: iteration 14
Mon 20 Jan 2014 04:15:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:15:40 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:15:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:15:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:15:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:15:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:15:41 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:15:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:15:41 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:15:41 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:15:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:15:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:15:51 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:15:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:15:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:15:51 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 04:15:51 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:15:51 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:15:51 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:15:51 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:15:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:15:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:15:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:15:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:15:52 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:15:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 04:15:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:15:54 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:15:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554565
Mon 20 Jan 2014 04:15:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:15:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554565
Mon 20 Jan 2014 04:15:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:15:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:15:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:16:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:16:03 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:16:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:16:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:16:04 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:16:04 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:16:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:16:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:16:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554565
Mon 20 Jan 2014 04:16:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:16:06 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:16:07 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:16:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:16:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:16:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:16:15 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:16:15 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:16:15 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:16:16 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:16:16 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:16:16 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 04:16:16 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 04:16:16 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 04:16:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:16:16 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:16:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:16:17 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:16:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:16:17 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:16:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 04:16:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 04:16:17 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:16:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5631 values 88805 bits 11100 bytes 
Mon 20 Jan 2014 04:16:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:16:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:16:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:16:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:16:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:16:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:16:18 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 645032 values 10171963 bits 1271495 bytes 
Mon 20 Jan 2014 04:16:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:16:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:16:19 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:16:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:16:19 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:16:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:16:22 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:16:22 - job_xml_thread(): Done retrieving: data size 43556809
Mon 20 Jan 2014 04:16:22 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:16:22 - XML: Start document: iteration 15
Mon 20 Jan 2014 04:16:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556809
Mon 20 Jan 2014 04:16:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:16:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556809
Mon 20 Jan 2014 04:16:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:16:29 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:16:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 04:16:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:16:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:16:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:16:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:16:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:16:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:16:37 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:16:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:16:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:16:38 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:16:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:16:38 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:16:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:16:38 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:16:42 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 04:16:42 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:16:42 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:16:42 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:16:42 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:16:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:16:46 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:16:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:16:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:16:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:16:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:16:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:16:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:16:50 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:16:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573744
Mon 20 Jan 2014 04:16:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:16:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573744
Mon 20 Jan 2014 04:16:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:16:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:16:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:16:57 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:16:57 - job_xml_thread(): Done retrieving: data size 43573744
Mon 20 Jan 2014 04:16:57 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:16:58 - XML: Start document: iteration 16
Mon 20 Jan 2014 04:17:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:17:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:17:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:17:08 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:17:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:17:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:17:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:17:11 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:17:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:17:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:17:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:17:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:17:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:17:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:17:12 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:17:12 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:17:12 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:17:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:17:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:17:13 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 04:17:13 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:17:13 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:17:13 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:17:13 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:17:17 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:17:17 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 04:17:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:17:17 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:17:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:17:18 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:17:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 04:17:18 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:17:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 04:17:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5966 values 94303 bits 11787 bytes 
Mon 20 Jan 2014 04:17:19 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:17:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43534638
Mon 20 Jan 2014 04:17:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:17:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43534638
Mon 20 Jan 2014 04:17:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:17:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:17:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:17:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:17:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:17:28 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:17:28 - job_xml_thread(): Done retrieving: data size 43534638
Mon 20 Jan 2014 04:17:28 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:17:28 - XML: Start document: iteration 17
Mon 20 Jan 2014 04:17:40 - XML: Processed 652602 elements - found 0 jobs
Mon 20 Jan 2014 04:17:41 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:17:41 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:17:41 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:17:41 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:17:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:17:42 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:17:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:17:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:17:42 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:17:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:17:42 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:17:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:17:42 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:17:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:17:44 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:17:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:17:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:17:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:17:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:17:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:17:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:17:48 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:17:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 04:17:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:17:49 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:17:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42988298
Mon 20 Jan 2014 04:17:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:17:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42988298
Mon 20 Jan 2014 04:17:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:17:56 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:17:56 - job_xml_thread(): Done retrieving: data size 42988298
Mon 20 Jan 2014 04:17:56 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:17:56 - XML: Start document: iteration 18
Mon 20 Jan 2014 04:17:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:17:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:17:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:17:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:18:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:18:03 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:18:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:18:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:18:05 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:18:05 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:18:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:18:05 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:18:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:18:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:18:10 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:18:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:18:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:18:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:18:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:18:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:18:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:18:12 - XML: Processed 645758 elements - found 0 jobs
Mon 20 Jan 2014 04:18:12 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:18:12 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:18:12 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:18:12 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:18:16 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:18:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42936998
Mon 20 Jan 2014 04:18:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:18:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42936998
Mon 20 Jan 2014 04:18:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:18:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:18:18 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:18:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:18:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:18:20 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:18:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 04:18:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:18:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 04:18:20 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:18:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6970 values 110129 bits 13766 bytes 
Mon 20 Jan 2014 04:18:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:18:25 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:18:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:18:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:18:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:18:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:18:26 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:18:26 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:18:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:18:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:18:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42936998
Mon 20 Jan 2014 04:18:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:18:27 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:18:27 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:18:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:18:38 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:18:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:18:40 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:18:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:18:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:18:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:18:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:18:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:18:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:18:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:18:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:18:42 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:18:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:18:42 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:18:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:18:44 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:18:44 - job_xml_thread(): Done retrieving: data size 43456144
Mon 20 Jan 2014 04:18:44 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:18:44 - XML: Start document: iteration 19
Mon 20 Jan 2014 04:18:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43456144
Mon 20 Jan 2014 04:18:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:18:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43456144
Mon 20 Jan 2014 04:18:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:18:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:18:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:18:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:18:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:19:03 - XML: Processed 652246 elements - found 0 jobs
Mon 20 Jan 2014 04:19:03 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:19:03 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:19:03 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:19:03 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:19:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:19:08 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:19:08 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:19:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 04:19:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:19:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:19:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:19:09 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:19:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:19:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:19:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:19:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:19:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:19:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:19:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:19:09 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:19:09 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:19:09 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:19:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:19:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:19:14 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:19:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43585429
Mon 20 Jan 2014 04:19:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:19:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43585429
Mon 20 Jan 2014 04:19:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:19:19 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:19:19 - job_xml_thread(): Done retrieving: data size 43585429
Mon 20 Jan 2014 04:19:19 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:19:19 - XML: Start document: iteration 20
Mon 20 Jan 2014 04:19:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:19:20 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:19:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:19:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 04:19:22 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:19:22 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:19:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6199 values 97824 bits 12228 bytes 
Mon 20 Jan 2014 04:19:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 04:19:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:19:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:19:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:19:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:19:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:19:36 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:19:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:19:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:19:37 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:19:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:19:37 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:19:37 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:19:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:19:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:19:37 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:19:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:19:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:19:38 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 04:19:38 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:19:38 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:19:38 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:19:38 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:19:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:19:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:19:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:19:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:19:42 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:19:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569231
Mon 20 Jan 2014 04:19:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:19:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569231
Mon 20 Jan 2014 04:19:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:19:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:19:50 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:19:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:19:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:19:53 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:19:53 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:19:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:19:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:19:53 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:19:53 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:19:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:19:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:19:56 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:19:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 04:19:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:19:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:19:57 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:19:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:19:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:19:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:19:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:19:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:19:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:20:00 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 04:20:00 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 04:20:00 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:20:00 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:20:00 - job_xml_thread(): Done retrieving: data size 43578639
Mon 20 Jan 2014 04:20:00 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:20:00 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 04:20:00 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 04:20:00 - Housekeeping: done.
Mon 20 Jan 2014 04:20:00 - XML: Start document: iteration 0
Mon 20 Jan 2014 04:20:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578639
Mon 20 Jan 2014 04:20:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:20:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578639
Mon 20 Jan 2014 04:20:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:20:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:20:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:20:13 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 04:20:13 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:20:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:20:13 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:20:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:20:13 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:20:13 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:20:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:20:22 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:20:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:20:22 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:20:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:20:22 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:20:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:20:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:20:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:20:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:20:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:20:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:20:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:20:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:20:23 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:20:23 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:20:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:20:23 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:20:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:20:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:20:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 04:20:23 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:20:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 04:20:23 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:20:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6000 values 94617 bits 11827 bytes 
Mon 20 Jan 2014 04:20:26 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:20:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43585410
Mon 20 Jan 2014 04:20:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:20:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43585410
Mon 20 Jan 2014 04:20:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:20:28 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:20:28 - job_xml_thread(): Done retrieving: data size 43585410
Mon 20 Jan 2014 04:20:28 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:20:28 - XML: Start document: iteration 1
Mon 20 Jan 2014 04:20:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:20:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:20:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:20:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:20:40 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 04:20:40 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:20:40 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:20:40 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:20:40 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:20:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:20:47 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:20:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:20:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:20:48 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:20:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:20:48 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:20:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:20:48 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:20:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:20:50 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:20:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:20:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:20:50 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:20:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 04:20:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:20:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:20:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:20:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:20:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:20:53 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:20:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580665
Mon 20 Jan 2014 04:20:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:20:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580665
Mon 20 Jan 2014 04:20:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:20:55 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:20:55 - job_xml_thread(): Done retrieving: data size 43580665
Mon 20 Jan 2014 04:20:55 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:20:55 - XML: Start document: iteration 2
Mon 20 Jan 2014 04:21:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:21:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:21:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:21:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:21:10 - XML: Processed 653349 elements - found 0 jobs
Mon 20 Jan 2014 04:21:10 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:21:11 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:21:11 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:21:11 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:21:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:21:16 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:21:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:21:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:21:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:21:17 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:21:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:21:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:21:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:21:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:21:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:21:17 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:21:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:21:17 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:21:17 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:21:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:21:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:21:19 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 04:21:19 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 04:21:19 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:21:20 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:21:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43589255
Mon 20 Jan 2014 04:21:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:21:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43589255
Mon 20 Jan 2014 04:21:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:21:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:21:23 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:21:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:21:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 04:21:25 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:21:25 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:21:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 04:21:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8654 values 136506 bits 17063 bytes 
Mon 20 Jan 2014 04:21:26 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:21:26 - job_xml_thread(): Done retrieving: data size 43589255
Mon 20 Jan 2014 04:21:26 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:21:26 - XML: Start document: iteration 3
Mon 20 Jan 2014 04:21:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:21:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:21:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:21:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:21:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:21:33 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:21:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:21:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:21:36 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:21:36 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:21:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:21:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:21:36 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:21:40 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 04:21:40 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:21:40 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:21:40 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:21:40 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:21:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:21:43 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:21:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:21:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:21:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:21:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:21:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:21:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:21:45 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:21:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583024
Mon 20 Jan 2014 04:21:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:21:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583024
Mon 20 Jan 2014 04:21:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:21:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:21:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:21:55 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:21:55 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:21:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:21:56 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:21:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:21:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:21:56 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:21:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:21:57 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:21:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:21:57 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:21:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 04:21:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:21:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:21:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:22:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:22:00 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:22:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:22:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:22:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:22:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:22:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:22:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:22:01 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:22:01 - job_xml_thread(): Done retrieving: data size 43599424
Mon 20 Jan 2014 04:22:01 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:22:01 - XML: Start document: iteration 4
Mon 20 Jan 2014 04:22:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43599424
Mon 20 Jan 2014 04:22:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:22:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43599424
Mon 20 Jan 2014 04:22:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:22:10 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 04:22:10 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:22:10 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:22:10 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:22:10 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:22:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:22:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:22:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:22:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:22:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:22:20 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:22:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:22:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:22:21 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:22:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:22:21 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:22:21 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:22:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:22:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:22:21 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:22:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:22:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:22:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:22:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:22:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:22:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:22:23 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:22:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581075
Mon 20 Jan 2014 04:22:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:22:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581075
Mon 20 Jan 2014 04:22:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:22:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:22:25 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:22:25 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:22:25 - job_xml_thread(): Done retrieving: data size 43581075
Mon 20 Jan 2014 04:22:25 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:22:25 - XML: Start document: iteration 5
Mon 20 Jan 2014 04:22:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:22:26 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:22:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 04:22:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 04:22:26 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:22:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9211 values 145295 bits 18161 bytes 
Mon 20 Jan 2014 04:22:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:22:35 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:22:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:22:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:22:36 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:22:36 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:22:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:22:37 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:22:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:22:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:22:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:22:44 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 04:22:44 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:22:44 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:22:44 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:22:44 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:22:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:22:46 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:22:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:22:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:22:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:22:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:22:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:22:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:22:47 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:22:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 04:22:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:22:48 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:22:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566483
Mon 20 Jan 2014 04:22:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:22:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566483
Mon 20 Jan 2014 04:22:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:22:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:22:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:22:59 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:22:59 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:23:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:23:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:23:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:23:03 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:23:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:23:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:23:04 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:23:04 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:23:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:23:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:23:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:23:04 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:23:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:23:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:23:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:23:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:23:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:23:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:23:05 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:23:05 - job_xml_thread(): Done retrieving: data size 43564932
Mon 20 Jan 2014 04:23:05 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:23:05 - XML: Start document: iteration 6
Mon 20 Jan 2014 04:23:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564932
Mon 20 Jan 2014 04:23:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564932
Mon 20 Jan 2014 04:23:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:23:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:23:17 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 04:23:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:23:18 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:23:18 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:23:18 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:23:18 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 04:23:18 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:23:18 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 04:23:19 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 04:23:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:23:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:23:19 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:23:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:23:19 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:23:19 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:23:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:23:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:23:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:23:20 - size of cluster 'LISA Cluster': 624 hosts 79473 metrics 688722 values 10863957 bits 1357994 bytes 
Mon 20 Jan 2014 04:23:26 - XML: Processed 653349 elements - found 0 jobs
Mon 20 Jan 2014 04:23:26 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:23:26 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:23:26 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:23:26 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:23:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:23:26 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:23:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:23:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 04:23:27 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:23:27 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:23:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 04:23:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99055 bits 12381 bytes 
Mon 20 Jan 2014 04:23:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:23:28 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:23:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:23:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:23:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:23:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:23:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:23:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:23:32 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:23:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43499655
Mon 20 Jan 2014 04:23:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:23:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43499655
Mon 20 Jan 2014 04:23:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:23:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:23:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:23:41 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:23:41 - job_xml_thread(): Done retrieving: data size 43499655
Mon 20 Jan 2014 04:23:41 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:23:41 - XML: Start document: iteration 7
Mon 20 Jan 2014 04:23:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:23:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:23:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:23:47 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:23:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:23:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:23:48 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:23:48 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:23:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:23:48 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:23:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:23:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:23:51 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:23:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:23:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:23:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:23:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:23:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:23:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:23:54 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:23:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 04:23:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:23:55 - XML: Processed 652590 elements - found 0 jobs
Mon 20 Jan 2014 04:23:55 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:23:55 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:23:55 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:23:55 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:23:58 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:23:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42917900
Mon 20 Jan 2014 04:23:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:23:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42917900
Mon 20 Jan 2014 04:23:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:24:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:24:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:24:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:24:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:24:11 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:24:11 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:24:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:24:13 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:24:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:24:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:24:14 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:24:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:24:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:24:14 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:24:14 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:24:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:24:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:24:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:24:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:24:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:24:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:24:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:24:17 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:24:17 - job_xml_thread(): Done retrieving: data size 42962083
Mon 20 Jan 2014 04:24:17 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:24:17 - XML: Start document: iteration 8
Mon 20 Jan 2014 04:24:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42962083
Mon 20 Jan 2014 04:24:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42962083
Mon 20 Jan 2014 04:24:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:24:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:24:19 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:24:19 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 04:24:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:24:27 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:24:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:24:28 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:24:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 04:24:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 04:24:28 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:24:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8796 values 138610 bits 17326 bytes 
Mon 20 Jan 2014 04:24:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:24:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:24:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:24:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:24:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:24:38 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:24:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:24:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:24:39 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:24:39 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:24:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:24:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:24:39 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:24:41 - XML: Processed 645590 elements - found 0 jobs
Mon 20 Jan 2014 04:24:41 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:24:41 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:24:41 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:24:41 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:24:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:24:42 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:24:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:24:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:24:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:24:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:24:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:24:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:24:46 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:24:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43468423
Mon 20 Jan 2014 04:24:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:24:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43468423
Mon 20 Jan 2014 04:24:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:24:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:24:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:24:56 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:24:57 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:24:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:24:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:24:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:24:59 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:24:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:24:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:24:59 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:24:59 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:24:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:24:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:25:01 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:25:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 04:25:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:25:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:25:02 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:25:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:25:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:25:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:25:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:25:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:25:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:25:04 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:25:04 - job_xml_thread(): Done retrieving: data size 43561816
Mon 20 Jan 2014 04:25:04 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:25:04 - XML: Start document: iteration 9
Mon 20 Jan 2014 04:25:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561816
Mon 20 Jan 2014 04:25:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:25:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561816
Mon 20 Jan 2014 04:25:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:25:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:25:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:25:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:25:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:25:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:25:22 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:25:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:25:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:25:23 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:25:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:25:23 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:25:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:25:23 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:25:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:25:28 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:25:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:25:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:25:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:25:28 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:25:28 - XML: Processed 653160 elements - found 0 jobs
Mon 20 Jan 2014 04:25:28 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:25:28 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:25:28 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:25:28 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:25:29 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:25:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:25:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 04:25:29 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:25:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 04:25:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5912 values 93230 bits 11653 bytes 
Mon 20 Jan 2014 04:25:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:25:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:25:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:25:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:25:32 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:25:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577251
Mon 20 Jan 2014 04:25:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:25:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577251
Mon 20 Jan 2014 04:25:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:25:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:25:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:25:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:25:41 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:25:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:25:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:25:42 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:25:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:25:42 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:25:42 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:25:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:25:43 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:25:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:25:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:25:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:25:48 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:25:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:25:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:25:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:25:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:25:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:25:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:25:49 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:25:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 04:25:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:25:51 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:25:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575650
Mon 20 Jan 2014 04:25:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:25:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575650
Mon 20 Jan 2014 04:25:51 - job_xml_thread(): Done retrieving: data size 43575650
Mon 20 Jan 2014 04:25:51 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:25:51 - XML: Start document: iteration 10
Mon 20 Jan 2014 04:25:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:25:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:25:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:26:03 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 04:26:03 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:26:03 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:26:03 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:26:03 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:26:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:26:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:26:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:26:09 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:26:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:26:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:26:10 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:26:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:26:10 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:26:10 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:26:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:26:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:26:13 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:26:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:26:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:26:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:26:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:26:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:26:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:26:16 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:26:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43585252
Mon 20 Jan 2014 04:26:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:26:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43585252
Mon 20 Jan 2014 04:26:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:26:18 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:26:18 - job_xml_thread(): Done retrieving: data size 43585252
Mon 20 Jan 2014 04:26:18 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:26:18 - XML: Start document: iteration 11
Mon 20 Jan 2014 04:26:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:26:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:26:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:26:29 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:26:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:26:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:26:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:26:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:26:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:26:29 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:26:29 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:26:30 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:26:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:26:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:26:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 04:26:30 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:26:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 04:26:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:26:30 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:26:30 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:26:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8493 values 133891 bits 16736 bytes 
Mon 20 Jan 2014 04:26:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:26:39 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:26:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:26:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:26:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:26:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:26:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:26:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:26:41 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 04:26:41 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:26:41 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:26:41 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:26:41 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:26:44 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:26:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554882
Mon 20 Jan 2014 04:26:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:26:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:26:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:26:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554882
Mon 20 Jan 2014 04:26:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:26:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:26:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:26:56 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:26:56 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:26:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:26:56 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:26:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:26:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:26:57 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:26:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:26:57 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:26:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:27:00 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:27:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 04:27:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:27:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:27:00 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:27:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:27:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:27:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:27:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:27:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:27:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:27:04 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:27:04 - job_xml_thread(): Done retrieving: data size 43585510
Mon 20 Jan 2014 04:27:04 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:27:04 - XML: Start document: iteration 12
Mon 20 Jan 2014 04:27:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43585510
Mon 20 Jan 2014 04:27:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:27:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43585510
Mon 20 Jan 2014 04:27:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:27:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:27:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:27:14 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 04:27:14 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:27:14 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:27:14 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:27:14 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:27:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:27:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:27:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:27:24 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:27:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:27:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:27:25 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:27:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:27:26 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:27:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:27:26 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:27:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:27:27 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:27:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:27:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:27:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:27:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:27:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:27:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:27:28 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 04:27:28 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 04:27:28 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:27:29 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:27:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43597045
Mon 20 Jan 2014 04:27:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:27:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43597045
Mon 20 Jan 2014 04:27:30 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:27:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:27:30 - job_xml_thread(): Done retrieving: data size 43597045
Mon 20 Jan 2014 04:27:30 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:27:30 - XML: Start document: iteration 13
Mon 20 Jan 2014 04:27:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:27:31 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:27:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:27:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 04:27:33 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:27:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7266 values 114535 bits 14316 bytes 
Mon 20 Jan 2014 04:27:34 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:27:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 04:27:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:27:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:27:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:27:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:27:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:27:47 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:27:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:27:47 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 04:27:47 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:27:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:27:47 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:27:47 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:27:47 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:27:48 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:27:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:27:48 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:27:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:27:48 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:27:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:27:50 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:27:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:27:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:27:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:27:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:27:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:27:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:27:52 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:27:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43585855
Mon 20 Jan 2014 04:27:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:27:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43585855
Mon 20 Jan 2014 04:27:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:28:02 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:28:02 - job_xml_thread(): Done retrieving: data size 43585855
Mon 20 Jan 2014 04:28:02 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:28:02 - XML: Start document: iteration 14
Mon 20 Jan 2014 04:28:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:28:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:28:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:28:04 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:28:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:28:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:28:05 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:28:05 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:28:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:28:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:28:05 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:28:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:28:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:28:14 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 04:28:14 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:28:14 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:28:14 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:28:14 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:28:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:28:16 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:28:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:28:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:28:16 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:28:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 04:28:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:28:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:28:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:28:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:28:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:28:18 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:28:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557427
Mon 20 Jan 2014 04:28:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:28:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557427
Mon 20 Jan 2014 04:28:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:28:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:28:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:28:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:28:28 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:28:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:28:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:28:28 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:28:28 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:28:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:28:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:28:28 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:28:29 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:28:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:28:30 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:28:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:28:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:28:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:28:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:28:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:28:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:28:32 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:28:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43590761
Mon 20 Jan 2014 04:28:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:28:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43590761
Mon 20 Jan 2014 04:28:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:28:33 - job_xml_thread(): Done retrieving: data size 43590761
Mon 20 Jan 2014 04:28:33 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:28:33 - XML: Start document: iteration 15
Mon 20 Jan 2014 04:28:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:28:34 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:28:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:28:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 04:28:37 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:28:37 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:28:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 04:28:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5758 values 90759 bits 11344 bytes 
Mon 20 Jan 2014 04:28:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:28:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:28:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:28:45 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:28:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:28:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:28:46 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:28:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:28:46 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:28:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:28:46 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:28:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:28:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:28:51 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 04:28:51 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:28:51 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:28:51 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:28:51 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:28:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:28:55 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:28:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:28:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:28:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:28:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:28:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:28:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:28:57 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:28:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43549858
Mon 20 Jan 2014 04:28:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:28:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43549858
Mon 20 Jan 2014 04:28:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:29:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:29:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:29:06 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:29:06 - job_xml_thread(): Done retrieving: data size 43549858
Mon 20 Jan 2014 04:29:06 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:29:06 - XML: Start document: iteration 16
Mon 20 Jan 2014 04:29:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:29:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:29:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:29:16 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:29:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:29:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:29:17 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 04:29:17 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:29:18 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:29:18 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:29:18 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:29:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:29:18 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:29:18 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:29:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:29:18 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:29:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:29:20 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:29:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:29:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:29:20 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:29:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 04:29:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:29:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:29:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:29:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:29:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:29:22 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:29:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43518854
Mon 20 Jan 2014 04:29:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:29:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43518854
Mon 20 Jan 2014 04:29:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:29:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:29:29 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:29:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:29:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:29:33 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:29:33 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:29:33 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:29:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:29:33 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:29:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:29:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:29:34 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:29:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:29:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:29:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:29:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:29:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:29:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:29:36 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:29:36 - job_xml_thread(): Done retrieving: data size 43054299
Mon 20 Jan 2014 04:29:36 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:29:36 - XML: Start document: iteration 17
Mon 20 Jan 2014 04:29:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43054299
Mon 20 Jan 2014 04:29:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:29:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:29:37 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:29:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43054299
Mon 20 Jan 2014 04:29:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:29:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:29:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 04:29:38 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:29:38 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:29:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6013 values 94779 bits 11847 bytes 
Mon 20 Jan 2014 04:29:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 04:29:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:29:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:29:50 - XML: Processed 646720 elements - found 0 jobs
Mon 20 Jan 2014 04:29:50 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:29:51 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:29:51 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:29:51 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:29:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:29:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:29:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:29:58 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:29:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:29:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:29:59 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:29:59 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:29:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:29:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:29:59 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:29:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:29:59 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:29:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:29:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:30:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:30:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:30:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:30:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:30:02 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:30:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42924981
Mon 20 Jan 2014 04:30:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:30:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42924981
Mon 20 Jan 2014 04:30:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:30:06 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:30:06 - job_xml_thread(): Done retrieving: data size 42924981
Mon 20 Jan 2014 04:30:06 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:30:07 - XML: Start document: iteration 18
Mon 20 Jan 2014 04:30:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:30:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:30:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:30:15 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:30:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:30:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:30:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:30:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:30:16 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:30:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:30:16 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:30:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:30:16 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:30:19 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 04:30:19 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:30:20 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:30:20 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:30:20 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 04:30:20 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 04:30:20 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 04:30:23 - XML: Processed 645152 elements - found 0 jobs
Mon 20 Jan 2014 04:30:23 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:30:23 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:30:23 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:30:23 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:30:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:30:25 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:30:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:30:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:30:25 - size of cluster 'LISA Cluster': 624 hosts 79486 metrics 818502 values 12902265 bits 1612783 bytes 
Mon 20 Jan 2014 04:30:25 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:30:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 04:30:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:30:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:30:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:30:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:30:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:30:28 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:30:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42951054
Mon 20 Jan 2014 04:30:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:30:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42951054
Mon 20 Jan 2014 04:30:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:30:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:30:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:30:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:30:39 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:30:39 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:30:39 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:30:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:30:40 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:30:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 04:30:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 04:30:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:30:40 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:30:40 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:30:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5895 values 92947 bits 11618 bytes 
Mon 20 Jan 2014 04:30:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:30:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:30:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:30:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:30:41 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:30:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:30:41 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:30:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:30:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:30:43 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:30:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:30:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:30:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:30:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:30:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:30:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:30:47 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:30:47 - job_xml_thread(): Done retrieving: data size 43504141
Mon 20 Jan 2014 04:30:47 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:30:47 - XML: Start document: iteration 19
Mon 20 Jan 2014 04:30:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43504141
Mon 20 Jan 2014 04:30:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:30:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43504141
Mon 20 Jan 2014 04:30:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:30:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:30:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:30:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:30:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:31:02 - XML: Processed 652494 elements - found 0 jobs
Mon 20 Jan 2014 04:31:02 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:31:02 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:31:02 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:31:02 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:31:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:31:06 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:31:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:31:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:31:07 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:31:07 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:31:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:31:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:31:07 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:31:08 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:31:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 04:31:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:31:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:31:10 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:31:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:31:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:31:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:31:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:31:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:31:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:31:14 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:31:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572884
Mon 20 Jan 2014 04:31:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:31:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572884
Mon 20 Jan 2014 04:31:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:31:17 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:31:17 - job_xml_thread(): Done retrieving: data size 43572884
Mon 20 Jan 2014 04:31:17 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:31:17 - XML: Start document: iteration 20
Mon 20 Jan 2014 04:31:20 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:31:20 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 04:31:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:31:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:31:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:31:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:31:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:31:25 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:31:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:31:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:31:27 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:31:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:31:27 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:31:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:31:27 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:31:34 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 04:31:34 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:31:34 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:31:34 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:31:34 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:31:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:31:37 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:31:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:31:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:31:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:31:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:31:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:31:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:31:40 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:31:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556418
Mon 20 Jan 2014 04:31:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:31:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556418
Mon 20 Jan 2014 04:31:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:31:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:31:41 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:31:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:31:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 04:31:42 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:31:42 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:31:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 04:31:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:31:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:31:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9242 values 146004 bits 18250 bytes 
Mon 20 Jan 2014 04:31:49 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:31:49 - job_xml_thread(): Done retrieving: data size 43556418
Mon 20 Jan 2014 04:31:49 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:31:49 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 04:31:50 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 04:31:50 - Housekeeping: done.
Mon 20 Jan 2014 04:31:50 - XML: Start document: iteration 0
Mon 20 Jan 2014 04:31:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:31:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:31:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:31:53 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:31:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:31:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:31:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:31:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:31:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:31:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:31:55 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:31:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:31:59 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:31:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:31:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:32:00 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:32:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:32:00 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:32:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:32:02 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 04:32:02 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:32:02 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:32:02 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:32:02 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:32:07 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:32:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570892
Mon 20 Jan 2014 04:32:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:32:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570892
Mon 20 Jan 2014 04:32:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:32:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:32:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:32:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:32:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:32:18 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:32:18 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:32:19 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:32:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 04:32:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:32:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:32:19 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:32:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:32:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:32:20 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:32:20 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:32:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:32:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:32:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:32:23 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:32:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:32:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:32:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:32:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:32:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:32:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:32:26 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:32:26 - job_xml_thread(): Done retrieving: data size 43568727
Mon 20 Jan 2014 04:32:26 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:32:26 - XML: Start document: iteration 1
Mon 20 Jan 2014 04:32:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568727
Mon 20 Jan 2014 04:32:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:32:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568727
Mon 20 Jan 2014 04:32:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:32:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:32:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:32:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:32:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:32:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:32:42 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:32:43 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:32:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 04:32:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:32:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 04:32:43 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:32:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6108 values 96596 bits 12074 bytes 
Mon 20 Jan 2014 04:32:45 - XML: Processed 653350 elements - found 0 jobs
Mon 20 Jan 2014 04:32:45 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:32:45 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:32:45 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:32:45 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:32:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:32:49 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:32:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:32:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:32:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:32:51 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:32:51 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:32:51 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:32:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:32:51 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:32:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:32:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:32:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:32:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:32:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:32:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:32:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:32:54 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:32:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43593936
Mon 20 Jan 2014 04:32:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:32:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43593936
Mon 20 Jan 2014 04:32:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:33:00 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:33:01 - job_xml_thread(): Done retrieving: data size 43593936
Mon 20 Jan 2014 04:33:01 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:33:01 - XML: Start document: iteration 2
Mon 20 Jan 2014 04:33:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:33:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:33:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:33:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:33:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:33:10 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:33:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:33:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:33:11 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:33:11 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:33:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:33:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:33:11 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:33:17 - XML: Processed 653349 elements - found 0 jobs
Mon 20 Jan 2014 04:33:17 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:33:17 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:33:17 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:33:17 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:33:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:33:19 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:33:19 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:33:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 04:33:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:33:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:33:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:33:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:33:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:33:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:33:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:33:22 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:33:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573578
Mon 20 Jan 2014 04:33:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:33:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573578
Mon 20 Jan 2014 04:33:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:33:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:33:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:33:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:33:31 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:33:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:33:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:33:32 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:33:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:33:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573578
Mon 20 Jan 2014 04:33:32 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:33:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:33:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:33:32 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:33:32 - job_xml_thread(): Done retrieving: data size 43573578
Mon 20 Jan 2014 04:33:32 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:33:33 - XML: Start document: iteration 3
Mon 20 Jan 2014 04:33:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:33:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:33:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:33:44 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:33:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:33:44 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:33:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 04:33:44 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:33:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 04:33:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5809 values 91795 bits 11474 bytes 
Mon 20 Jan 2014 04:33:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:33:47 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:33:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:33:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:33:48 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:33:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:33:48 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:33:48 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:33:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:33:50 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 04:33:50 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:33:50 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:33:50 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:33:50 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:33:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:33:53 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:33:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:33:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:33:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:33:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:33:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:33:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:33:57 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:33:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566731
Mon 20 Jan 2014 04:33:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:33:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566731
Mon 20 Jan 2014 04:33:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:34:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:34:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:34:05 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:34:05 - job_xml_thread(): Done retrieving: data size 43566731
Mon 20 Jan 2014 04:34:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:34:05 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:34:05 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:34:05 - XML: Start document: iteration 4
Mon 20 Jan 2014 04:34:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:34:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:34:07 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:34:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:34:07 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:34:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:34:07 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:34:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:34:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:34:14 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 04:34:14 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:34:14 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:34:14 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:34:14 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:34:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:34:18 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:34:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:34:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:34:18 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:34:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 04:34:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:34:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:34:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:34:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:34:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:34:21 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:34:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568086
Mon 20 Jan 2014 04:34:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:34:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568086
Mon 20 Jan 2014 04:34:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:34:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:34:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:34:29 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:34:29 - job_xml_thread(): Done retrieving: data size 43568086
Mon 20 Jan 2014 04:34:29 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:34:29 - XML: Start document: iteration 5
Mon 20 Jan 2014 04:34:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:34:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:34:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:34:34 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:34:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:34:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:34:35 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:34:35 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:34:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:34:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:34:35 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:34:39 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 04:34:39 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:34:39 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:34:39 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:34:39 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:34:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:34:43 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:34:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:34:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:34:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:34:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:34:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:34:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:34:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:34:45 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:34:45 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 04:34:45 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 04:34:45 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:34:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:34:45 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:34:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 04:34:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 04:34:45 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:34:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5671 values 89400 bits 11175 bytes 
Mon 20 Jan 2014 04:34:46 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:34:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568616
Mon 20 Jan 2014 04:34:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:34:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568616
Mon 20 Jan 2014 04:34:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:34:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:34:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:34:54 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:34:54 - job_xml_thread(): Done retrieving: data size 43568616
Mon 20 Jan 2014 04:34:54 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:34:54 - XML: Start document: iteration 6
Mon 20 Jan 2014 04:34:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:34:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:34:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:34:59 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:35:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:35:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:35:00 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:35:00 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:35:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:35:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:35:00 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:35:08 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 04:35:08 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:35:08 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:35:08 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:35:08 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:35:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:35:09 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:35:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:35:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:35:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:35:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:35:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:35:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:35:11 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:35:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 04:35:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:35:12 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:35:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43551329
Mon 20 Jan 2014 04:35:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:35:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43551329
Mon 20 Jan 2014 04:35:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:35:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:35:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:35:23 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:35:24 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:35:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:35:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:35:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:35:26 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:35:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:35:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:35:26 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:35:26 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:35:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:35:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:35:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:35:27 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:35:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:35:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:35:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:35:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:35:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:35:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:35:29 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:35:29 - job_xml_thread(): Done retrieving: data size 43436632
Mon 20 Jan 2014 04:35:29 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:35:29 - XML: Start document: iteration 7
Mon 20 Jan 2014 04:35:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43436632
Mon 20 Jan 2014 04:35:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43436632
Mon 20 Jan 2014 04:35:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:35:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:35:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:35:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:35:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:35:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:35:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:35:45 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:35:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:35:46 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:35:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:35:46 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:35:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 04:35:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 04:35:46 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:35:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:35:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:35:47 - XML: Processed 651526 elements - found 0 jobs
Mon 20 Jan 2014 04:35:47 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:35:47 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:35:47 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:35:47 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:35:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6589 values 103910 bits 12988 bytes 
Mon 20 Jan 2014 04:35:47 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:35:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:35:47 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:35:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:35:47 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:35:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:35:51 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:35:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:35:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:35:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:35:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:35:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:35:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:35:53 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:35:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 04:35:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:35:54 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:35:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42919948
Mon 20 Jan 2014 04:35:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:35:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42919948
Mon 20 Jan 2014 04:35:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:36:02 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:36:02 - job_xml_thread(): Done retrieving: data size 42919948
Mon 20 Jan 2014 04:36:02 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:36:02 - XML: Start document: iteration 8
Mon 20 Jan 2014 04:36:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:36:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:36:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:36:04 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:36:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:36:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:36:07 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:36:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:36:07 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:36:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:36:07 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:36:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:36:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:36:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:36:13 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:36:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:36:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:36:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:36:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:36:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:36:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:36:16 - XML: Processed 645323 elements - found 0 jobs
Mon 20 Jan 2014 04:36:16 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:36:16 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:36:16 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:36:16 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:36:18 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:36:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42969866
Mon 20 Jan 2014 04:36:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:36:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42969866
Mon 20 Jan 2014 04:36:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:36:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:36:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:36:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:36:27 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:36:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:36:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:36:28 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:36:28 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:36:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:36:28 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:36:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:36:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:36:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:36:31 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:36:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:36:32 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:36:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:36:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:36:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:36:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:36:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:36:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:36:33 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:36:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42997925
Mon 20 Jan 2014 04:36:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:36:34 - job_xml_thread(): Done retrieving: data size 42997925
Mon 20 Jan 2014 04:36:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42997925
Mon 20 Jan 2014 04:36:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:36:35 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:36:35 - XML: Start document: iteration 9
Mon 20 Jan 2014 04:36:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:36:42 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:36:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:36:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:36:44 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:36:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:36:44 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:36:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:36:44 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:36:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:36:46 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:36:47 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:36:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:36:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 04:36:47 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:36:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9268 values 146171 bits 18271 bytes 
Mon 20 Jan 2014 04:36:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 04:36:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:36:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:36:50 - XML: Processed 645902 elements - found 0 jobs
Mon 20 Jan 2014 04:36:50 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:36:50 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:36:50 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:36:50 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:36:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:36:53 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:36:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:36:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:36:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:36:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:36:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:36:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:36:56 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:36:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43528567
Mon 20 Jan 2014 04:36:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:36:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43528567
Mon 20 Jan 2014 04:36:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:36:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:36:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:37:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:37:04 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:37:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:37:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:37:05 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:37:05 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:37:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:37:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:37:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43528567
Mon 20 Jan 2014 04:37:05 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:37:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:37:05 - job_xml_thread(): Done retrieving: data size 43528567
Mon 20 Jan 2014 04:37:06 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:37:06 - XML: Start document: iteration 10
Mon 20 Jan 2014 04:37:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:37:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:37:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:37:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:37:21 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 04:37:21 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:37:21 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:37:21 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 04:37:21 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 04:37:22 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:37:22 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 04:37:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:37:22 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:37:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:37:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:37:23 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:37:23 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:37:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:37:23 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:37:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:37:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:37:24 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:37:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:37:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:37:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:37:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:37:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:37:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:37:26 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 802762 values 12670389 bits 1583798 bytes 
Mon 20 Jan 2014 04:37:27 - XML: Processed 653112 elements - found 0 jobs
Mon 20 Jan 2014 04:37:27 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:37:27 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:37:27 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:37:27 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:37:27 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:37:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 04:37:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:37:31 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:37:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577657
Mon 20 Jan 2014 04:37:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:37:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577657
Mon 20 Jan 2014 04:37:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:37:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:37:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:37:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:37:40 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:37:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:37:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:37:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:37:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:37:41 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:37:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:37:41 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:37:41 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:37:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:37:42 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:37:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:37:44 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:37:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:37:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:37:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:37:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:37:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:37:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:37:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:37:47 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:37:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:37:47 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:37:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 04:37:47 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:37:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5767 values 90947 bits 11368 bytes 
Mon 20 Jan 2014 04:37:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 04:37:48 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:37:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43586638
Mon 20 Jan 2014 04:37:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:37:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43586638
Mon 20 Jan 2014 04:37:48 - job_xml_thread(): Done retrieving: data size 43586638
Mon 20 Jan 2014 04:37:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:37:48 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:37:48 - XML: Start document: iteration 11
Mon 20 Jan 2014 04:37:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:37:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:37:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:37:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:38:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:38:02 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:38:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:38:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:38:03 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:38:03 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:38:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:38:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:38:03 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:38:06 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 04:38:06 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:38:06 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:38:06 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:38:06 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:38:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:38:11 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:38:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:38:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:38:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:38:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:38:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:38:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:38:15 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:38:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 04:38:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:38:15 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:38:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563387
Mon 20 Jan 2014 04:38:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:38:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563387
Mon 20 Jan 2014 04:38:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:38:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:38:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:38:22 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:38:22 - job_xml_thread(): Done retrieving: data size 43563387
Mon 20 Jan 2014 04:38:22 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:38:22 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 04:38:22 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:38:22 - XML: Start document: iteration 12
Mon 20 Jan 2014 04:38:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:38:25 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:38:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:38:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:38:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:38:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:38:27 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:38:27 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:38:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:38:27 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:38:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:38:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:38:38 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:38:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:38:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:38:38 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 04:38:38 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:38:38 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:38:38 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:38:38 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:38:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:38:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:38:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:38:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:38:42 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:38:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43550595
Mon 20 Jan 2014 04:38:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:38:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43550595
Mon 20 Jan 2014 04:38:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:38:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:38:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:38:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:38:47 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:38:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:38:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 04:38:49 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:38:49 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:38:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6622 values 104451 bits 13056 bytes 
Mon 20 Jan 2014 04:38:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 04:38:53 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:38:53 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:38:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:38:53 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:38:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:38:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:38:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:38:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:38:54 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:38:54 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:38:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:38:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:38:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:38:59 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:38:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:38:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:38:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:38:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:38:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:38:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:39:04 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:39:04 - job_xml_thread(): Done retrieving: data size 43583005
Mon 20 Jan 2014 04:39:04 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:39:04 - XML: Start document: iteration 13
Mon 20 Jan 2014 04:39:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583005
Mon 20 Jan 2014 04:39:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:39:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583005
Mon 20 Jan 2014 04:39:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:39:07 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:39:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 04:39:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:39:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:39:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:39:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:39:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:39:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:39:21 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:39:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:39:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:39:22 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:39:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:39:22 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:39:22 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:39:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:39:24 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 04:39:24 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:39:24 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:39:24 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:39:24 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:39:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:39:28 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:39:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:39:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:39:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:39:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:39:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:39:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:39:30 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:39:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571037
Mon 20 Jan 2014 04:39:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:39:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571037
Mon 20 Jan 2014 04:39:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:39:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:39:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:39:39 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:39:39 - job_xml_thread(): Done retrieving: data size 43571037
Mon 20 Jan 2014 04:39:39 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:39:39 - XML: Start document: iteration 14
Mon 20 Jan 2014 04:39:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:39:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:39:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:39:45 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:39:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:39:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:39:48 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:39:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:39:48 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:39:48 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:39:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:39:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:39:49 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:39:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:39:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 04:39:50 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:39:50 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:39:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 04:39:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99063 bits 12382 bytes 
Mon 20 Jan 2014 04:39:52 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 04:39:52 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:39:52 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:39:52 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:39:52 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:39:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:39:53 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:39:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:39:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:39:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:39:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:39:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:39:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:39:57 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:39:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564568
Mon 20 Jan 2014 04:39:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:39:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564568
Mon 20 Jan 2014 04:39:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:40:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:40:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:40:07 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:40:08 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:40:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:40:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:40:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:40:10 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:40:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:40:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:40:11 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:40:11 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:40:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:40:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:40:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:40:13 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:40:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:40:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:40:14 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:40:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 04:40:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:40:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:40:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:40:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:40:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:40:16 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:40:16 - job_xml_thread(): Done retrieving: data size 43565858
Mon 20 Jan 2014 04:40:16 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:40:16 - XML: Start document: iteration 15
Mon 20 Jan 2014 04:40:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565858
Mon 20 Jan 2014 04:40:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:40:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565858
Mon 20 Jan 2014 04:40:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:40:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:40:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:40:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:40:29 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:40:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:40:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:40:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:40:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:40:30 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:40:30 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:40:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:40:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:40:30 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:40:37 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 04:40:37 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:40:38 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:40:38 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:40:38 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:40:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:40:41 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:40:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:40:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:40:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:40:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:40:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:40:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:40:45 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:40:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43548283
Mon 20 Jan 2014 04:40:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:40:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:40:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:40:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43548283
Mon 20 Jan 2014 04:40:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:40:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:40:50 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:40:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:40:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 04:40:51 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:40:51 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:40:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 04:40:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8975 values 141561 bits 17695 bytes 
Mon 20 Jan 2014 04:40:53 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:40:53 - job_xml_thread(): Done retrieving: data size 43548283
Mon 20 Jan 2014 04:40:53 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:40:53 - XML: Start document: iteration 16
Mon 20 Jan 2014 04:40:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:40:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:41:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:41:02 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:41:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:41:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:41:04 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:41:04 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:41:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:41:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:41:04 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:41:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:41:08 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:41:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:41:08 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 04:41:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:41:08 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:41:08 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:41:08 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:41:08 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:41:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:41:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:41:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:41:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:41:12 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:41:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43509220
Mon 20 Jan 2014 04:41:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:41:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43509220
Mon 20 Jan 2014 04:41:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:41:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:41:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:41:23 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:41:23 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:41:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:41:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:41:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:41:24 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:41:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:41:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:41:25 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:41:25 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:41:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:41:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:41:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:41:28 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:41:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:41:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:41:28 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:41:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 04:41:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:41:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:41:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:41:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:41:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:41:31 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:41:31 - job_xml_thread(): Done retrieving: data size 43504054
Mon 20 Jan 2014 04:41:31 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:41:31 - XML: Start document: iteration 17
Mon 20 Jan 2014 04:41:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43504054
Mon 20 Jan 2014 04:41:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:41:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43504054
Mon 20 Jan 2014 04:41:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:41:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:41:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:41:41 - XML: Processed 652590 elements - found 0 jobs
Mon 20 Jan 2014 04:41:41 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:41:41 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:41:41 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:41:41 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:41:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:41:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:41:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:41:51 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:41:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:41:52 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:41:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:41:53 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:41:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 04:41:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 04:41:53 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:41:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:41:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:41:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5766 values 90951 bits 11368 bytes 
Mon 20 Jan 2014 04:41:54 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:41:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:41:54 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:41:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:41:54 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:41:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:41:54 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:41:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:41:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:41:54 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 04:41:54 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 04:41:54 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:41:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:41:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:41:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:41:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:41:56 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:41:57 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:41:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42923894
Mon 20 Jan 2014 04:41:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:41:57 - job_xml_thread(): Done retrieving: data size 42923894
Mon 20 Jan 2014 04:41:57 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:41:57 - XML: Start document: iteration 18
Mon 20 Jan 2014 04:41:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42923894
Mon 20 Jan 2014 04:41:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:42:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:42:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:42:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:42:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:42:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:42:11 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:42:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:42:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:42:11 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:42:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:42:11 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:42:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:42:11 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:42:15 - XML: Processed 645176 elements - found 0 jobs
Mon 20 Jan 2014 04:42:15 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:42:15 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:42:15 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:42:15 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:42:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:42:20 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:42:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:42:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:42:20 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:42:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 04:42:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:42:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:42:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:42:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:42:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:42:22 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:42:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42977530
Mon 20 Jan 2014 04:42:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:42:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42977530
Mon 20 Jan 2014 04:42:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:42:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:42:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:42:30 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:42:30 - job_xml_thread(): Done retrieving: data size 42977530
Mon 20 Jan 2014 04:42:30 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:42:30 - XML: Start document: iteration 19
Mon 20 Jan 2014 04:42:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:42:34 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:42:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:42:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:42:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:42:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:42:36 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:42:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:42:36 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:42:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:42:36 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:42:43 - XML: Processed 645900 elements - found 0 jobs
Mon 20 Jan 2014 04:42:43 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:42:43 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:42:43 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:42:43 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:42:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:42:44 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:42:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:42:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:42:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:42:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:42:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:42:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:42:46 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:42:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43488260
Mon 20 Jan 2014 04:42:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:42:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43488260
Mon 20 Jan 2014 04:42:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:42:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:42:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:42:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:42:53 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:42:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:42:54 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:42:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 04:42:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 04:42:54 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:42:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8848 values 139477 bits 17434 bytes 
Mon 20 Jan 2014 04:42:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:42:55 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:42:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:42:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:42:56 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:42:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:42:56 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:42:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:42:56 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:42:58 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:42:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:42:59 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:43:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:43:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:43:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:43:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:43:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:43:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:43:01 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:43:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571456
Mon 20 Jan 2014 04:43:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:43:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571456
Mon 20 Jan 2014 04:43:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:43:02 - job_xml_thread(): Done retrieving: data size 43571456
Mon 20 Jan 2014 04:43:02 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:43:02 - XML: Start document: iteration 20
Mon 20 Jan 2014 04:43:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:43:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:43:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:43:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:43:16 - XML: Processed 653346 elements - found 0 jobs
Mon 20 Jan 2014 04:43:16 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:43:16 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:43:16 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:43:16 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:43:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:43:21 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:43:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:43:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:43:21 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:43:21 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:43:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:43:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:43:21 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:43:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:43:23 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:43:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:43:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:43:23 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:43:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 04:43:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:43:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:43:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:43:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:43:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:43:25 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:43:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572134
Mon 20 Jan 2014 04:43:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:43:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572134
Mon 20 Jan 2014 04:43:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:43:31 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:43:31 - job_xml_thread(): Done retrieving: data size 43572134
Mon 20 Jan 2014 04:43:31 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:43:31 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 04:43:32 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 04:43:32 - Housekeeping: done.
Mon 20 Jan 2014 04:43:32 - XML: Start document: iteration 0
Mon 20 Jan 2014 04:43:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:43:36 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:43:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:43:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:43:38 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:43:38 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:43:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:43:38 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:43:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:43:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:43:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:43:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:43:44 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:43:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:43:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:43:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:43:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:43:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:43:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:43:46 - XML: Processed 653350 elements - found 0 jobs
Mon 20 Jan 2014 04:43:46 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:43:46 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:43:46 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:43:46 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:43:48 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:43:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557805
Mon 20 Jan 2014 04:43:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:43:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557805
Mon 20 Jan 2014 04:43:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:43:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:43:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:43:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:43:54 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:43:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:43:56 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:43:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 04:43:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 04:43:56 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:43:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9142 values 144254 bits 18031 bytes 
Mon 20 Jan 2014 04:44:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:44:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:44:01 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:44:02 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:44:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:44:02 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:44:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:44:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:44:03 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:44:03 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:44:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:44:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:44:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:44:05 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:44:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:44:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:44:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:44:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:44:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:44:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:44:08 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:44:08 - job_xml_thread(): Done retrieving: data size 43590482
Mon 20 Jan 2014 04:44:08 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:44:08 - XML: Start document: iteration 1
Mon 20 Jan 2014 04:44:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43590482
Mon 20 Jan 2014 04:44:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:44:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43590482
Mon 20 Jan 2014 04:44:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:44:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:44:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:44:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:44:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:44:22 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 04:44:22 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:44:22 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 04:44:22 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:44:22 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:44:23 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:44:23 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:44:23 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:44:23 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 04:44:23 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:44:23 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 04:44:23 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 04:44:24 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:44:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 04:44:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:44:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:44:28 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:44:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:44:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:44:29 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:44:29 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:44:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:44:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:44:29 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:44:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:44:30 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:44:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:44:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:44:30 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 826727 values 13028564 bits 1628570 bytes 
Mon 20 Jan 2014 04:44:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:44:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:44:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:44:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:44:34 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:44:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583107
Mon 20 Jan 2014 04:44:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:44:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583107
Mon 20 Jan 2014 04:44:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:44:38 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:44:38 - job_xml_thread(): Done retrieving: data size 43583107
Mon 20 Jan 2014 04:44:38 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:44:38 - XML: Start document: iteration 2
Mon 20 Jan 2014 04:44:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:44:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:44:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:44:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:44:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:44:50 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:44:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:44:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:44:50 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:44:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:44:50 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:44:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:44:51 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:44:52 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 04:44:52 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:44:52 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:44:52 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:44:52 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:44:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:44:56 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:44:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:44:57 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:44:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 04:44:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 04:44:57 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:44:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6052 values 95434 bits 11929 bytes 
Mon 20 Jan 2014 04:44:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:44:57 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:44:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:44:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:44:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:44:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:44:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:44:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:45:01 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:45:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559373
Mon 20 Jan 2014 04:45:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:45:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559373
Mon 20 Jan 2014 04:45:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:45:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:45:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:45:07 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:45:07 - job_xml_thread(): Done retrieving: data size 43559373
Mon 20 Jan 2014 04:45:07 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:45:07 - XML: Start document: iteration 3
Mon 20 Jan 2014 04:45:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:45:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:45:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:45:16 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:45:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:45:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:45:16 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:45:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:45:16 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:45:16 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:45:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:45:22 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 04:45:22 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:45:23 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:45:23 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:45:23 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:45:23 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:45:23 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 04:45:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:45:26 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:45:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:45:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:45:26 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:45:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 04:45:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:45:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:45:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:45:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:45:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:45:29 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:45:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43547105
Mon 20 Jan 2014 04:45:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:45:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43547105
Mon 20 Jan 2014 04:45:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:45:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:45:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:45:38 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:45:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:45:38 - job_xml_thread(): Done retrieving: data size 43547105
Mon 20 Jan 2014 04:45:38 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:45:38 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:45:38 - XML: Start document: iteration 4
Mon 20 Jan 2014 04:45:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:45:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:45:38 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:45:38 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:45:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:45:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:45:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43547105
Mon 20 Jan 2014 04:45:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:45:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:45:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:45:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:45:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:45:55 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 04:45:55 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:45:55 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:45:55 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:45:55 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:45:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:45:55 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:45:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:45:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:45:56 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:45:56 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:45:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:45:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:45:56 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:45:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:45:57 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:45:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:45:57 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:45:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:45:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:45:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:45:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:45:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:45:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:45:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:45:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 04:45:58 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:45:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 04:45:58 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:45:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5487 values 86490 bits 10811 bytes 
Mon 20 Jan 2014 04:46:01 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:46:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572249
Mon 20 Jan 2014 04:46:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:46:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572249
Mon 20 Jan 2014 04:46:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:46:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:46:08 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:46:10 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:46:10 - job_xml_thread(): Done retrieving: data size 43572249
Mon 20 Jan 2014 04:46:10 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:46:10 - XML: Start document: iteration 5
Mon 20 Jan 2014 04:46:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:46:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:46:12 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:46:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:46:12 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:46:12 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:46:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:46:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:46:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:46:18 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 04:46:18 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:46:18 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:46:18 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:46:18 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:46:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:46:21 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:46:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:46:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:46:21 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:46:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 04:46:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:46:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:46:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:46:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:46:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:46:24 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:46:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571242
Mon 20 Jan 2014 04:46:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:46:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571242
Mon 20 Jan 2014 04:46:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:46:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:46:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:46:33 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:46:34 - job_xml_thread(): Done retrieving: data size 43571242
Mon 20 Jan 2014 04:46:34 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:46:34 - XML: Start document: iteration 6
Mon 20 Jan 2014 04:46:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:46:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:46:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:46:42 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:46:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:46:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:46:42 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:46:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:46:42 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:46:42 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:46:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:46:48 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 04:46:48 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:46:48 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:46:48 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:46:48 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:46:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:46:48 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:46:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:46:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:46:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:46:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:46:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:46:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:46:51 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:46:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575255
Mon 20 Jan 2014 04:46:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:46:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575255
Mon 20 Jan 2014 04:46:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:46:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:46:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:46:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:46:58 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:46:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:46:59 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:46:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 04:46:59 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:46:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 04:47:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8751 values 138318 bits 17289 bytes 
Mon 20 Jan 2014 04:47:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:47:01 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:47:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:47:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:47:02 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:47:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:47:02 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:47:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:47:02 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:47:03 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:47:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:47:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:47:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:47:07 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:47:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:47:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:47:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:47:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:47:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:47:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:47:11 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:47:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553138
Mon 20 Jan 2014 04:47:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:47:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553138
Mon 20 Jan 2014 04:47:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:47:11 - job_xml_thread(): Done retrieving: data size 43553138
Mon 20 Jan 2014 04:47:11 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:47:11 - XML: Start document: iteration 7
Mon 20 Jan 2014 04:47:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:47:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:47:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:47:23 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:47:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:47:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:47:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:47:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:47:24 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:47:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:47:24 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:47:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:47:24 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:47:31 - XML: Processed 653000 elements - found 0 jobs
Mon 20 Jan 2014 04:47:31 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:47:31 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:47:31 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:47:31 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:47:31 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:47:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 04:47:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:47:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:47:35 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:47:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:47:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:47:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:47:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:47:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:47:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:47:38 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:47:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43486913
Mon 20 Jan 2014 04:47:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:47:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43486913
Mon 20 Jan 2014 04:47:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:47:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:47:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:47:46 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:47:46 - job_xml_thread(): Done retrieving: data size 43486913
Mon 20 Jan 2014 04:47:46 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:47:46 - XML: Start document: iteration 8
Mon 20 Jan 2014 04:47:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:47:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:47:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:47:53 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:47:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:47:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:47:56 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:47:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:47:56 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:47:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:47:56 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:47:57 - XML: Processed 652424 elements - found 0 jobs
Mon 20 Jan 2014 04:47:57 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:47:57 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:47:57 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:47:57 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:47:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:47:59 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:48:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:48:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 04:48:00 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:48:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 04:48:00 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:48:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:48:00 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:48:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:48:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:48:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5773 values 91284 bits 11410 bytes 
Mon 20 Jan 2014 04:48:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:48:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:48:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:48:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:48:04 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:48:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42906386
Mon 20 Jan 2014 04:48:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:48:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42906386
Mon 20 Jan 2014 04:48:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:48:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:48:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:48:12 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:48:12 - job_xml_thread(): Done retrieving: data size 42906386
Mon 20 Jan 2014 04:48:12 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:48:12 - XML: Start document: iteration 9
Mon 20 Jan 2014 04:48:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:48:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:48:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:48:20 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:48:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:48:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:48:22 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:48:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:48:22 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:48:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:48:22 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:48:28 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:48:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 04:48:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:48:28 - XML: Processed 645152 elements - found 0 jobs
Mon 20 Jan 2014 04:48:28 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:48:28 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:48:28 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:48:28 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:48:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:48:28 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:48:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:48:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:48:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:48:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:48:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:48:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:48:31 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:48:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42992259
Mon 20 Jan 2014 04:48:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:48:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42992259
Mon 20 Jan 2014 04:48:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:48:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:48:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:48:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:48:43 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:48:43 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:48:43 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:48:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:48:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:48:43 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:48:43 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:48:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:48:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:48:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:48:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:48:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:48:48 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:48:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:48:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:48:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:48:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:48:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:48:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:48:50 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 04:48:50 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 04:48:50 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:48:50 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:48:50 - job_xml_thread(): Done retrieving: data size 43507474
Mon 20 Jan 2014 04:48:50 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:48:50 - XML: Start document: iteration 10
Mon 20 Jan 2014 04:48:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43507474
Mon 20 Jan 2014 04:48:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43507474
Mon 20 Jan 2014 04:48:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:48:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:48:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:48:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:49:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:49:01 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:49:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:49:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 04:49:03 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:49:03 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:49:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 04:49:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:49:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:49:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8794 values 138890 bits 17361 bytes 
Mon 20 Jan 2014 04:49:08 - XML: Processed 652494 elements - found 0 jobs
Mon 20 Jan 2014 04:49:08 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:49:08 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:49:08 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:49:08 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:49:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:49:12 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:49:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:49:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:49:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:49:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:49:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:49:13 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:49:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:49:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:49:14 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:49:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:49:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:49:15 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:49:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:49:15 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:49:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:49:16 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:49:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 04:49:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:49:17 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:49:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576591
Mon 20 Jan 2014 04:49:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:49:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576591
Mon 20 Jan 2014 04:49:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:49:23 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:49:23 - job_xml_thread(): Done retrieving: data size 43576591
Mon 20 Jan 2014 04:49:23 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:49:23 - XML: Start document: iteration 11
Mon 20 Jan 2014 04:49:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:49:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:49:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:49:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:49:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:49:36 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:49:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:49:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:49:39 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 04:49:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:49:39 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:49:39 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:49:39 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:49:39 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:49:39 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:49:39 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:49:39 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:49:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:49:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:49:39 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:49:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:49:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:49:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:49:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:49:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:49:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:49:41 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:49:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582619
Mon 20 Jan 2014 04:49:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:49:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582619
Mon 20 Jan 2014 04:49:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:49:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:49:49 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:49:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:49:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:49:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:49:54 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:49:54 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:49:54 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:49:54 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:49:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:49:54 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:49:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:49:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:49:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:49:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:49:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:49:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:49:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:49:57 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:49:57 - job_xml_thread(): Done retrieving: data size 43576603
Mon 20 Jan 2014 04:49:57 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:49:57 - XML: Start document: iteration 12
Mon 20 Jan 2014 04:49:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576603
Mon 20 Jan 2014 04:49:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576603
Mon 20 Jan 2014 04:49:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:49:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:50:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:50:03 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:50:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:50:03 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:50:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 04:50:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 04:50:04 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:50:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148576 bits 18572 bytes 
Mon 20 Jan 2014 04:50:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:50:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:50:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:50:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:50:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:50:12 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:50:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:50:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:50:13 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:50:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:50:13 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:50:13 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:50:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:50:16 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 04:50:16 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:50:16 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:50:16 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:50:16 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:50:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:50:20 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:50:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:50:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:50:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:50:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:50:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:50:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:50:22 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:50:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575046
Mon 20 Jan 2014 04:50:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:50:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575046
Mon 20 Jan 2014 04:50:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:50:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:50:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:50:31 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:50:31 - job_xml_thread(): Done retrieving: data size 43575046
Mon 20 Jan 2014 04:50:31 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:50:31 - XML: Start document: iteration 13
Mon 20 Jan 2014 04:50:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:50:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:50:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:50:43 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:50:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:50:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:50:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:50:45 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:50:45 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:50:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:50:45 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:50:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:50:45 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:50:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:50:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:50:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:50:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:50:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:50:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:50:47 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 04:50:47 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:50:47 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:50:47 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:50:47 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:50:47 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:50:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 04:50:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:50:49 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:50:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43591130
Mon 20 Jan 2014 04:50:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:50:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43591130
Mon 20 Jan 2014 04:50:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:51:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:51:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:51:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:51:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:51:02 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:51:02 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:51:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:51:03 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:51:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:51:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:51:03 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:51:03 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:51:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:51:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:51:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:51:03 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:51:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:51:04 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:51:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 04:51:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 04:51:04 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:51:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5786 values 91286 bits 11410 bytes 
Mon 20 Jan 2014 04:51:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:51:05 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:51:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:51:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:51:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:51:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:51:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:51:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:51:08 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:51:08 - job_xml_thread(): Done retrieving: data size 43599239
Mon 20 Jan 2014 04:51:08 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:51:08 - XML: Start document: iteration 14
Mon 20 Jan 2014 04:51:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43599239
Mon 20 Jan 2014 04:51:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43599239
Mon 20 Jan 2014 04:51:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:51:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:51:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:51:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:51:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:51:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:51:23 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 04:51:24 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:51:25 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:51:25 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 04:51:25 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 04:51:25 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:51:26 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 04:51:29 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 04:51:29 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:51:29 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:51:29 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:51:29 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:51:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:51:30 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:51:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:51:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:51:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:51:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:51:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:51:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:51:31 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:51:32 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 795740 values 12561822 bits 1570227 bytes 
Mon 20 Jan 2014 04:51:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:51:33 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:51:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:51:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:51:33 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:51:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 04:51:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:51:34 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:51:34 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:51:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:51:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:51:36 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:51:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43598268
Mon 20 Jan 2014 04:51:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:51:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43598268
Mon 20 Jan 2014 04:51:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:51:44 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:51:44 - job_xml_thread(): Done retrieving: data size 43598268
Mon 20 Jan 2014 04:51:44 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:51:45 - XML: Start document: iteration 15
Mon 20 Jan 2014 04:51:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:51:45 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:51:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:51:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:51:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:51:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:51:50 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:51:50 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:51:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:51:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:51:50 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:51:56 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 04:51:56 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:51:56 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:51:56 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:51:56 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:51:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:51:56 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:51:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:51:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:51:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:51:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:51:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:51:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:52:00 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:52:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560811
Mon 20 Jan 2014 04:52:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:52:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560811
Mon 20 Jan 2014 04:52:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:52:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:52:04 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:52:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:52:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:52:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:52:05 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:52:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 04:52:05 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:52:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 04:52:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8946 values 141078 bits 17634 bytes 
Mon 20 Jan 2014 04:52:11 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:52:11 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:52:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:52:12 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:52:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:52:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:52:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:52:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:52:13 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:52:13 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:52:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:52:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:52:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:52:15 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:52:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:52:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:52:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:52:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:52:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:52:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:52:19 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:52:19 - job_xml_thread(): Done retrieving: data size 43573537
Mon 20 Jan 2014 04:52:19 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:52:19 - XML: Start document: iteration 16
Mon 20 Jan 2014 04:52:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573537
Mon 20 Jan 2014 04:52:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573537
Mon 20 Jan 2014 04:52:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:52:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:52:26 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:52:27 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 04:52:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:52:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:52:29 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 04:52:30 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:52:30 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:52:30 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:52:30 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:52:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:52:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:52:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:52:35 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:52:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:52:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:52:36 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:52:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:52:36 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:52:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:52:36 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:52:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:52:41 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:52:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:52:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:52:41 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:52:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 04:52:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:52:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:52:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:52:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:52:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:52:44 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:52:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566559
Mon 20 Jan 2014 04:52:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:52:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566559
Mon 20 Jan 2014 04:52:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:52:45 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:52:45 - job_xml_thread(): Done retrieving: data size 43566559
Mon 20 Jan 2014 04:52:45 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:52:46 - XML: Start document: iteration 17
Mon 20 Jan 2014 04:52:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:52:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:52:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:52:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:53:01 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 04:53:01 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:53:02 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:53:02 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:53:02 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:53:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:53:05 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:53:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:53:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:53:05 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:53:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:53:06 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:53:06 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:53:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:53:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:53:06 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:53:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:53:06 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:53:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 04:53:06 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:53:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 04:53:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5733 values 90425 bits 11303 bytes 
Mon 20 Jan 2014 04:53:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:53:08 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:53:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:53:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:53:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:53:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:53:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:53:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:53:13 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:53:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43502236
Mon 20 Jan 2014 04:53:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:53:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43502236
Mon 20 Jan 2014 04:53:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:53:14 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:53:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 04:53:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:53:17 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:53:17 - job_xml_thread(): Done retrieving: data size 43502236
Mon 20 Jan 2014 04:53:17 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:53:17 - XML: Start document: iteration 18
Mon 20 Jan 2014 04:53:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:53:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:53:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:53:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:53:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:53:30 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:53:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:53:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:53:31 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:53:31 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:53:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:53:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:53:31 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:53:33 - XML: Processed 652602 elements - found 0 jobs
Mon 20 Jan 2014 04:53:33 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:53:33 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:53:33 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:53:33 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:53:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:53:36 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:53:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:53:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:53:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:53:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:53:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:53:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:53:38 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:53:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43030490
Mon 20 Jan 2014 04:53:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:53:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43030490
Mon 20 Jan 2014 04:53:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:53:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:53:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:53:48 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:53:48 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:53:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:53:49 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:53:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:53:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:53:49 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:53:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:53:49 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:53:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:53:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:53:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:53:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:53:54 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:53:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:53:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:53:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:53:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:53:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:53:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:53:57 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:53:57 - job_xml_thread(): Done retrieving: data size 42914395
Mon 20 Jan 2014 04:53:57 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:53:57 - XML: Start document: iteration 19
Mon 20 Jan 2014 04:53:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42914395
Mon 20 Jan 2014 04:53:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:53:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42914395
Mon 20 Jan 2014 04:53:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:54:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:54:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:54:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:54:06 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:54:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:54:07 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:54:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 04:54:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 04:54:07 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:54:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148547 bits 18568 bytes 
Mon 20 Jan 2014 04:54:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:54:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:54:15 - XML: Processed 645314 elements - found 0 jobs
Mon 20 Jan 2014 04:54:15 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:54:15 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:54:15 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:54:15 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:54:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:54:19 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:54:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:54:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:54:20 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:54:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:54:20 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:54:20 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:54:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:54:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:54:21 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:54:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:54:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:54:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:54:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:54:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:54:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:54:24 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:54:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42981975
Mon 20 Jan 2014 04:54:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:54:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42981975
Mon 20 Jan 2014 04:54:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:54:30 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:54:30 - job_xml_thread(): Done retrieving: data size 42981975
Mon 20 Jan 2014 04:54:30 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:54:30 - XML: Start document: iteration 20
Mon 20 Jan 2014 04:54:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:54:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:54:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:54:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:54:43 - XML: Processed 645910 elements - found 0 jobs
Mon 20 Jan 2014 04:54:43 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:54:43 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:54:43 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:54:44 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:54:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:54:45 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:54:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:54:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:54:45 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:54:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:54:45 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:54:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:54:45 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:54:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:54:48 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:54:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:54:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:54:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:54:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:54:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:54:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:54:48 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:54:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 04:54:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:54:51 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:54:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43518299
Mon 20 Jan 2014 04:54:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:54:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43518299
Mon 20 Jan 2014 04:54:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:54:59 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:54:59 - job_xml_thread(): Done retrieving: data size 43518299
Mon 20 Jan 2014 04:54:59 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:54:59 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 04:54:59 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 04:54:59 - Housekeeping: done.
Mon 20 Jan 2014 04:55:00 - XML: Start document: iteration 0
Mon 20 Jan 2014 04:55:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:55:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:55:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:55:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:55:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:55:05 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:55:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:55:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:55:06 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:55:06 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:55:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:55:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:55:06 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:55:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:55:08 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:55:09 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:55:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:55:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 04:55:09 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:55:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 04:55:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5608 values 88384 bits 11048 bytes 
Mon 20 Jan 2014 04:55:12 - XML: Processed 652562 elements - found 0 jobs
Mon 20 Jan 2014 04:55:12 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:55:12 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:55:12 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:55:12 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:55:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:55:13 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:55:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:55:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:55:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:55:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:55:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:55:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:55:17 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:55:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562629
Mon 20 Jan 2014 04:55:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:55:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562629
Mon 20 Jan 2014 04:55:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:55:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:55:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:55:27 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:55:27 - job_xml_thread(): Done retrieving: data size 43562629
Mon 20 Jan 2014 04:55:27 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:55:27 - XML: Start document: iteration 1
Mon 20 Jan 2014 04:55:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:55:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:55:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:55:33 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:55:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:55:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:55:34 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:55:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 04:55:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:55:34 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:55:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:55:34 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:55:34 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:55:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:55:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:55:38 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:55:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:55:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:55:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:55:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:55:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:55:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:55:40 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 04:55:40 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:55:40 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:55:40 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:55:40 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:55:43 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 04:55:43 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 04:55:43 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:55:44 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:55:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555605
Mon 20 Jan 2014 04:55:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:55:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555605
Mon 20 Jan 2014 04:55:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:55:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:55:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:55:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:55:52 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:55:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:55:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:55:53 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:55:53 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:55:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:55:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:55:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555605
Mon 20 Jan 2014 04:55:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:55:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:55:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:55:56 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:55:56 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:56:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:56:01 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:56:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:56:04 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:56:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:56:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:56:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:56:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:56:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:56:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:56:06 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:56:06 - job_xml_thread(): Done retrieving: data size 43568202
Mon 20 Jan 2014 04:56:06 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:56:06 - XML: Start document: iteration 2
Mon 20 Jan 2014 04:56:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568202
Mon 20 Jan 2014 04:56:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:56:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:56:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:56:08 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:56:08 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:56:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:56:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568202
Mon 20 Jan 2014 04:56:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:56:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:56:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:56:09 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:56:10 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:56:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 04:56:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:56:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 04:56:11 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:56:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8454 values 133321 bits 16665 bytes 
Mon 20 Jan 2014 04:56:15 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 04:56:15 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:56:15 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:56:15 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:56:15 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:56:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:56:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:56:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:56:22 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:56:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:56:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:56:25 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:56:25 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:56:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:56:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:56:25 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:56:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:56:26 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:56:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:56:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:56:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:56:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:56:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:56:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:56:28 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:56:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43588469
Mon 20 Jan 2014 04:56:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:56:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43588469
Mon 20 Jan 2014 04:56:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:56:30 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:56:30 - job_xml_thread(): Done retrieving: data size 43588469
Mon 20 Jan 2014 04:56:30 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:56:30 - XML: Start document: iteration 3
Mon 20 Jan 2014 04:56:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:56:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:56:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:56:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:56:46 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 04:56:46 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:56:46 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:56:46 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:56:46 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:56:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:56:47 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:56:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:56:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:56:48 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:56:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:56:48 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:56:48 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:56:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:56:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:56:50 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:56:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:56:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:56:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:56:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:56:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:56:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:56:51 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:56:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 04:56:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:56:52 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:56:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43590904
Mon 20 Jan 2014 04:56:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:56:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43590904
Mon 20 Jan 2014 04:56:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:57:01 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:57:01 - job_xml_thread(): Done retrieving: data size 43590904
Mon 20 Jan 2014 04:57:01 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:57:01 - XML: Start document: iteration 4
Mon 20 Jan 2014 04:57:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:57:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:57:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:57:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:57:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:57:07 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:57:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:57:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:57:08 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:57:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:57:08 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:57:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:57:08 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:57:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:57:10 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:57:12 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 04:57:12 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:57:12 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:57:12 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:57:12 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:57:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:57:12 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:57:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 04:57:12 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:57:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5613 values 88463 bits 11057 bytes 
Mon 20 Jan 2014 04:57:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 04:57:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:57:14 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:57:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:57:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:57:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:57:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:57:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:57:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:57:17 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:57:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579282
Mon 20 Jan 2014 04:57:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:57:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579282
Mon 20 Jan 2014 04:57:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:57:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:57:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:57:27 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:57:27 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:57:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:57:27 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:57:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:57:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:57:28 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:57:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:57:28 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:57:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:57:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:57:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:57:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:57:32 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:57:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:57:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:57:32 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:57:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 04:57:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:57:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:57:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:57:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:57:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:57:34 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:57:34 - job_xml_thread(): Done retrieving: data size 43590986
Mon 20 Jan 2014 04:57:34 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:57:34 - XML: Start document: iteration 5
Mon 20 Jan 2014 04:57:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43590986
Mon 20 Jan 2014 04:57:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:57:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43590986
Mon 20 Jan 2014 04:57:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:57:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:57:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:57:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:57:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:57:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:57:52 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:57:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:57:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:57:53 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:57:53 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 04:57:53 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:57:53 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:57:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:57:53 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:57:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:57:54 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:57:54 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:57:54 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:57:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:57:57 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:57:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:57:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:57:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:57:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:57:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:57:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:57:59 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:57:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580756
Mon 20 Jan 2014 04:57:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:57:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580756
Mon 20 Jan 2014 04:57:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:58:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:58:09 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:58:09 - job_xml_thread(): Done retrieving: data size 43580756
Mon 20 Jan 2014 04:58:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:58:09 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:58:09 - XML: Start document: iteration 6
Mon 20 Jan 2014 04:58:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:58:11 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:58:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:58:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:58:12 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:58:12 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:58:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:58:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:58:12 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:58:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:58:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:58:12 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:58:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:58:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:58:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 04:58:13 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:58:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9056 values 142863 bits 17857 bytes 
Mon 20 Jan 2014 04:58:13 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:58:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 04:58:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:58:22 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:58:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:58:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:58:23 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 04:58:23 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:58:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:58:23 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:58:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:58:23 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:58:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:58:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:58:23 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:58:26 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:58:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43547864
Mon 20 Jan 2014 04:58:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:58:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43547864
Mon 20 Jan 2014 04:58:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:58:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:58:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:58:27 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 04:58:27 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:58:28 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:58:28 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:58:28 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 04:58:28 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 04:58:28 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Mon 20 Jan 2014 04:58:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:58:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:58:39 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:58:39 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:58:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:58:40 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:58:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:58:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:58:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:58:41 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:58:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:58:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:58:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:58:41 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:58:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:58:41 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:58:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:58:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:58:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:58:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:58:41 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:58:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 04:58:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:58:43 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:58:43 - job_xml_thread(): Done retrieving: data size 43581636
Mon 20 Jan 2014 04:58:43 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:58:43 - XML: Start document: iteration 7
Mon 20 Jan 2014 04:58:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581636
Mon 20 Jan 2014 04:58:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:58:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581636
Mon 20 Jan 2014 04:58:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:58:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:58:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:58:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:58:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:59:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:59:00 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:59:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:59:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:59:02 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:59:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:59:02 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:59:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:59:02 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:59:03 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 04:59:03 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:59:03 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:59:03 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:59:03 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:59:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:59:06 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:59:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:59:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:59:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:59:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:59:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:59:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:59:07 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:59:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43545004
Mon 20 Jan 2014 04:59:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:59:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43545004
Mon 20 Jan 2014 04:59:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:59:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:59:13 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:59:14 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:59:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:59:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 04:59:14 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:59:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 04:59:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:59:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:59:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:59:17 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:59:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:59:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:59:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8723 values 137546 bits 17193 bytes 
Mon 20 Jan 2014 04:59:18 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 04:59:18 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:59:18 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:59:18 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:59:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:59:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:59:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:59:21 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:59:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:59:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:59:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:59:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:59:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:59:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:59:24 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:59:24 - job_xml_thread(): Done retrieving: data size 43497697
Mon 20 Jan 2014 04:59:24 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 04:59:24 - XML: Start document: iteration 8
Mon 20 Jan 2014 04:59:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43497697
Mon 20 Jan 2014 04:59:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43497697
Mon 20 Jan 2014 04:59:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:59:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:59:28 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:59:28 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:59:29 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:59:29 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 04:59:29 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 04:59:30 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:59:30 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Mon 20 Jan 2014 04:59:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:59:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:59:36 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 04:59:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 04:59:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:59:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 04:59:36 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 04:59:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 04:59:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 04:59:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 04:59:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 04:59:38 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:59:38 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 04:59:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 04:59:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 04:59:38 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 04:59:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 04:59:48 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 04:59:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 04:59:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 04:59:48 - XML: Processed 652602 elements - found 0 jobs
Mon 20 Jan 2014 04:59:48 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 04:59:48 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 04:59:48 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 04:59:48 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 04:59:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:59:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 04:59:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 04:59:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 04:59:51 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 04:59:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42949789
Mon 20 Jan 2014 04:59:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 04:59:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42949789
Mon 20 Jan 2014 04:59:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 04:59:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 04:59:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:00:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:00:02 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:00:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:00:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:00:03 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:00:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:00:03 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:00:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:00:03 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:00:03 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:00:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:00:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:00:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:00:06 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:00:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:00:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:00:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:00:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:00:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:00:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:00:07 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:00:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42948477
Mon 20 Jan 2014 05:00:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:00:08 - job_xml_thread(): Done retrieving: data size 42948477
Mon 20 Jan 2014 05:00:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42948477
Mon 20 Jan 2014 05:00:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:00:08 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:00:09 - XML: Start document: iteration 9
Mon 20 Jan 2014 05:00:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:00:17 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:00:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:00:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:00:20 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:00:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 05:00:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:00:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 05:00:20 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:00:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9325 values 147117 bits 18389 bytes 
Mon 20 Jan 2014 05:00:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:00:21 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:00:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:00:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:00:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:00:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:00:22 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:00:22 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:00:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:00:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:00:23 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:00:30 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:00:30 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:00:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:00:30 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:00:30 - XML: Processed 645508 elements - found 0 jobs
Mon 20 Jan 2014 05:00:30 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:00:30 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:00:30 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:00:30 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:00:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:00:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:00:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:00:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:00:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:00:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:00:31 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:00:31 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 05:00:31 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:00:31 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 05:00:31 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 05:00:32 - size of cluster 'LISA Cluster': 624 hosts 79485 metrics 952477 values 15015424 bits 1876928 bytes 
Mon 20 Jan 2014 05:00:36 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:00:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42970518
Mon 20 Jan 2014 05:00:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:00:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42970518
Mon 20 Jan 2014 05:00:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:00:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:00:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:00:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:00:45 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:00:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:00:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:00:45 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:00:45 - job_xml_thread(): Done retrieving: data size 42970518
Mon 20 Jan 2014 05:00:45 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:00:45 - XML: Start document: iteration 10
Mon 20 Jan 2014 05:00:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:00:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:00:46 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:00:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:00:46 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:00:46 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:00:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:00:57 - XML: Processed 645914 elements - found 0 jobs
Mon 20 Jan 2014 05:00:57 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:00:57 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:00:57 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:00:57 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:00:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:00:59 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:00:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:00:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:00:59 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:00:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 05:00:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:00:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:00:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:00:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:00:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:01:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:01:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:01:02 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:01:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43535901
Mon 20 Jan 2014 05:01:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:01:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43535901
Mon 20 Jan 2014 05:01:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:01:12 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:01:12 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:01:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:01:13 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:01:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:01:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:01:14 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:01:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:01:14 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:01:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:01:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:01:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:01:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:01:16 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:01:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:01:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:01:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:01:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:01:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:01:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:01:19 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:01:19 - job_xml_thread(): Done retrieving: data size 43581276
Mon 20 Jan 2014 05:01:19 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:01:19 - XML: Start document: iteration 11
Mon 20 Jan 2014 05:01:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581276
Mon 20 Jan 2014 05:01:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:01:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581276
Mon 20 Jan 2014 05:01:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:01:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:01:21 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:01:22 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:01:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:01:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 05:01:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 05:01:22 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:01:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5532 values 87230 bits 10903 bytes 
Mon 20 Jan 2014 05:01:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:01:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:01:31 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:01:31 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 05:01:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:01:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:01:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:01:35 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:01:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:01:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:01:35 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:01:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:01:35 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:01:35 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:01:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:01:38 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 05:01:38 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:01:38 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:01:38 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:01:38 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:01:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:01:44 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:01:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:01:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:01:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:01:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:01:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:01:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:01:47 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:01:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 05:01:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:01:48 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:01:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553034
Mon 20 Jan 2014 05:01:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:01:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553034
Mon 20 Jan 2014 05:01:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:01:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:01:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:01:53 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:01:53 - job_xml_thread(): Done retrieving: data size 43553034
Mon 20 Jan 2014 05:01:54 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:01:54 - XML: Start document: iteration 12
Mon 20 Jan 2014 05:02:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:02:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:02:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:02:01 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:02:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:02:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:02:02 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:02:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:02:02 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:02:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:02:02 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:02:09 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 05:02:09 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:02:09 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:02:09 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:02:09 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:02:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:02:11 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:02:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:02:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:02:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:02:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:02:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:02:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:02:14 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 05:02:14 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 05:02:14 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:02:15 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:02:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43546890
Mon 20 Jan 2014 05:02:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:02:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43546890
Mon 20 Jan 2014 05:02:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:02:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:02:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:02:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:02:22 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:02:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:02:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 05:02:23 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:02:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 05:02:23 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:02:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6423 values 101621 bits 12702 bytes 
Mon 20 Jan 2014 05:02:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:02:24 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:02:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:02:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:02:24 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:02:24 - job_xml_thread(): Done retrieving: data size 43546890
Mon 20 Jan 2014 05:02:24 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:02:24 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:02:24 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:02:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:02:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:02:24 - XML: Start document: iteration 13
Mon 20 Jan 2014 05:02:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43546890
Mon 20 Jan 2014 05:02:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:02:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:02:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:02:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:02:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:02:40 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 05:02:40 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:02:40 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:02:40 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:02:40 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:02:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:02:41 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:02:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:02:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:02:43 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:02:43 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:02:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:02:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:02:43 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:02:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:02:44 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:02:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:02:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:02:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:02:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:02:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:02:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:02:47 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:02:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43591310
Mon 20 Jan 2014 05:02:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:02:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43591310
Mon 20 Jan 2014 05:02:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:02:55 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:02:55 - job_xml_thread(): Done retrieving: data size 43591310
Mon 20 Jan 2014 05:02:55 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:02:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:02:55 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:02:55 - XML: Start document: iteration 14
Mon 20 Jan 2014 05:02:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:02:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:03:00 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:03:00 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:03:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:03:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:03:00 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:03:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:03:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:03:04 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 05:03:04 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:03:04 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:03:04 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:03:04 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:03:06 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:03:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 05:03:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:03:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:03:08 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:03:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:03:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:03:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:03:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:03:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:03:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:03:10 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:03:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574101
Mon 20 Jan 2014 05:03:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:03:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574101
Mon 20 Jan 2014 05:03:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:03:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:03:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:03:19 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:03:19 - job_xml_thread(): Done retrieving: data size 43574101
Mon 20 Jan 2014 05:03:20 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:03:20 - XML: Start document: iteration 15
Mon 20 Jan 2014 05:03:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:03:23 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:03:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:03:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:03:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:03:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 05:03:24 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:03:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6153 values 97395 bits 12174 bytes 
Mon 20 Jan 2014 05:03:24 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:03:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 05:03:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:03:25 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:03:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:03:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:03:28 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:03:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:03:28 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:03:28 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:03:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:03:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:03:30 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:03:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:03:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:03:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:03:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:03:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:03:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:03:32 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 05:03:32 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:03:32 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:03:32 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:03:32 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:03:35 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:03:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582671
Mon 20 Jan 2014 05:03:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:03:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582671
Mon 20 Jan 2014 05:03:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:03:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:03:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:03:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:03:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:03:47 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:03:47 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:03:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:03:48 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:03:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:03:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:03:48 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:03:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:03:48 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:03:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:03:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:03:51 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:03:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:03:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:03:51 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:03:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 05:03:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:03:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:03:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:03:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:03:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:03:53 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:03:53 - job_xml_thread(): Done retrieving: data size 43593470
Mon 20 Jan 2014 05:03:53 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:03:53 - XML: Start document: iteration 16
Mon 20 Jan 2014 05:03:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43593470
Mon 20 Jan 2014 05:03:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:03:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43593470
Mon 20 Jan 2014 05:03:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:04:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:04:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:04:05 - XML: Processed 653351 elements - found 0 jobs
Mon 20 Jan 2014 05:04:05 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:04:05 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:04:05 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:04:05 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:04:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:04:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:04:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:04:10 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:04:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:04:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:04:10 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:04:10 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:04:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:04:10 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:04:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:04:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:04:14 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:04:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:04:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:04:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:04:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:04:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:04:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:04:17 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:04:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568936
Mon 20 Jan 2014 05:04:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:04:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568936
Mon 20 Jan 2014 05:04:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:04:20 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:04:20 - job_xml_thread(): Done retrieving: data size 43568936
Mon 20 Jan 2014 05:04:20 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:04:20 - XML: Start document: iteration 17
Mon 20 Jan 2014 05:04:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:04:24 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:04:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:04:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:04:25 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:04:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:04:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 05:04:25 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:04:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 05:04:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8971 values 141549 bits 17693 bytes 
Mon 20 Jan 2014 05:04:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:04:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:04:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:04:32 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:04:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:04:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:04:33 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:04:33 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:04:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:04:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:04:33 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:04:36 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 05:04:36 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:04:36 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:04:36 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:04:36 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:04:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:04:40 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:04:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:04:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:04:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:04:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:04:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:04:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:04:42 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:04:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563733
Mon 20 Jan 2014 05:04:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:04:42 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:04:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 05:04:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:04:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563733
Mon 20 Jan 2014 05:04:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:04:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:04:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:04:51 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:04:51 - job_xml_thread(): Done retrieving: data size 43563733
Mon 20 Jan 2014 05:04:51 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:04:51 - XML: Start document: iteration 18
Mon 20 Jan 2014 05:04:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:04:52 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:04:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:04:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:04:53 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:04:53 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:04:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:04:53 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:04:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:04:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:04:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:04:59 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 05:04:59 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:04:59 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:04:59 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:04:59 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:05:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:05:03 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:05:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:05:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:05:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:05:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:05:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:05:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:05:05 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:05:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561276
Mon 20 Jan 2014 05:05:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:05:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561276
Mon 20 Jan 2014 05:05:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:05:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:05:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:05:14 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:05:14 - job_xml_thread(): Done retrieving: data size 43561276
Mon 20 Jan 2014 05:05:14 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:05:14 - XML: Start document: iteration 19
Mon 20 Jan 2014 05:05:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:05:18 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:05:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:05:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:05:19 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:05:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:05:19 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:05:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:05:19 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:05:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:05:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:05:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:05:25 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:05:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:05:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:05:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:05:26 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:05:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:05:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:05:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:05:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:05:26 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:05:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 05:05:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:05:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 05:05:26 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:05:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99065 bits 12383 bytes 
Mon 20 Jan 2014 05:05:27 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 05:05:27 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:05:27 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:05:27 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:05:27 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:05:30 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:05:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43480202
Mon 20 Jan 2014 05:05:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:05:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43480202
Mon 20 Jan 2014 05:05:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:05:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:05:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:05:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:05:41 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:05:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:05:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:05:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:05:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:05:41 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:05:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:05:41 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:05:41 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:05:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:05:42 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:05:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:05:44 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:05:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:05:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:05:45 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:05:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 05:05:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:05:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:05:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:05:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:05:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:05:47 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:05:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42959927
Mon 20 Jan 2014 05:05:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:05:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42959927
Mon 20 Jan 2014 05:05:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:05:48 - job_xml_thread(): Done retrieving: data size 42959927
Mon 20 Jan 2014 05:05:48 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:05:48 - XML: Start document: iteration 20
Mon 20 Jan 2014 05:05:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:05:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:06:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:06:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:06:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:06:05 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:06:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:06:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:06:06 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:06:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:06:06 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:06:06 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:06:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:06:07 - XML: Processed 645808 elements - found 0 jobs
Mon 20 Jan 2014 05:06:07 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:06:07 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:06:07 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:06:07 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:06:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:06:10 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:06:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:06:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:06:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:06:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:06:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:06:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:06:11 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:06:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42937789
Mon 20 Jan 2014 05:06:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:06:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42937789
Mon 20 Jan 2014 05:06:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:06:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:06:21 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:06:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:06:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:06:22 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:06:22 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:06:24 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:06:24 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:06:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:06:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:06:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:06:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:06:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:06:25 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:06:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:06:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:06:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:06:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:06:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:06:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:06:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:06:26 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:06:27 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:06:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 05:06:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:06:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 05:06:27 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:06:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9030 values 142451 bits 17806 bytes 
Mon 20 Jan 2014 05:06:27 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:06:27 - job_xml_thread(): Done retrieving: data size 43090762
Mon 20 Jan 2014 05:06:27 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:06:27 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 05:06:27 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 05:06:27 - Housekeeping: done.
Mon 20 Jan 2014 05:06:27 - XML: Start document: iteration 0
Mon 20 Jan 2014 05:06:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43090762
Mon 20 Jan 2014 05:06:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:06:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43090762
Mon 20 Jan 2014 05:06:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:06:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:06:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:06:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:06:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:06:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:06:45 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:06:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:06:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:06:46 - XML: Processed 647224 elements - found 0 jobs
Mon 20 Jan 2014 05:06:46 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:06:46 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:06:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:06:46 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:06:46 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:06:46 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:06:46 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:06:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:06:46 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:06:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:06:50 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:06:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:06:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:06:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:06:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:06:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:06:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:06:53 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:06:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 05:06:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:06:53 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:06:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43544031
Mon 20 Jan 2014 05:06:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:06:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43544031
Mon 20 Jan 2014 05:06:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:07:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:07:01 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:07:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:07:01 - job_xml_thread(): Done retrieving: data size 43544031
Mon 20 Jan 2014 05:07:01 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:07:02 - XML: Start document: iteration 1
Mon 20 Jan 2014 05:07:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:07:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:07:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:07:06 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:07:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:07:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:07:08 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:07:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:07:08 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:07:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:07:08 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:07:12 - XML: Processed 652822 elements - found 0 jobs
Mon 20 Jan 2014 05:07:12 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:07:12 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:07:12 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:07:12 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:07:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:07:15 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:07:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:07:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:07:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:07:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:07:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:07:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:07:18 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:07:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43547405
Mon 20 Jan 2014 05:07:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:07:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43547405
Mon 20 Jan 2014 05:07:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:07:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:07:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:07:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:07:27 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:07:27 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:07:27 - job_xml_thread(): Done retrieving: data size 43547405
Mon 20 Jan 2014 05:07:27 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:07:27 - XML: Start document: iteration 2
Mon 20 Jan 2014 05:07:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:07:30 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:07:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:07:30 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:07:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 05:07:30 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:07:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 05:07:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:07:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:07:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7185 values 113317 bits 14164 bytes 
Mon 20 Jan 2014 05:07:31 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 05:07:31 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:07:31 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:07:31 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:07:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:07:31 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:07:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:07:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:07:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:07:32 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:07:32 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:07:32 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 05:07:32 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 05:07:32 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 05:07:37 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 05:07:37 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:07:37 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:07:37 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:07:37 - job_xml_thread(): Sleeping.. (15s)
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Mon 20 Jan 2014 05:07:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:07:41 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:07:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:07:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:07:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:07:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:07:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:07:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:07:44 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:07:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557274
Mon 20 Jan 2014 05:07:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:07:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557274
Mon 20 Jan 2014 05:07:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:07:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:07:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:07:52 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:07:52 - job_xml_thread(): Done retrieving: data size 43557274
Mon 20 Jan 2014 05:07:52 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:07:52 - XML: Start document: iteration 3
Mon 20 Jan 2014 05:07:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:07:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:07:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:07:57 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:07:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:07:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:07:58 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:07:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:07:58 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:07:58 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:07:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:08:02 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 05:08:02 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:08:02 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:08:02 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:08:02 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:08:04 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:08:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 05:08:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:08:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:08:06 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:08:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:08:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:08:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:08:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:08:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:08:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:08:08 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:08:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566179
Mon 20 Jan 2014 05:08:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:08:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566179
Mon 20 Jan 2014 05:08:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:08:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:08:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:08:17 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:08:17 - job_xml_thread(): Done retrieving: data size 43566179
Mon 20 Jan 2014 05:08:17 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:08:17 - XML: Start document: iteration 4
Mon 20 Jan 2014 05:08:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:08:22 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:08:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:08:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:08:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:08:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:08:23 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:08:23 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:08:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:08:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:08:23 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:08:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:08:29 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:08:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:08:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:08:30 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 05:08:30 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:08:30 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:08:30 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:08:30 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:08:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:08:31 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:08:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:08:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:08:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:08:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:08:31 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:08:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 05:08:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:08:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 05:08:31 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:08:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6040 values 95284 bits 11910 bytes 
Mon 20 Jan 2014 05:08:32 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:08:32 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:08:32 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:08:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43549860
Mon 20 Jan 2014 05:08:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:08:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43549860
Mon 20 Jan 2014 05:08:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:08:33 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:08:33 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 05:08:33 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 05:08:33 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:08:33 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 05:08:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:08:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:08:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:08:44 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:08:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:08:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:08:45 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:08:45 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:08:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:08:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:08:45 - XMLGatherer.retrieveData(): actually retrieving data..
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Mon 20 Jan 2014 05:08:45 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:08:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:08:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:08:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:08:48 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:08:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:08:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:08:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:08:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:08:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:08:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:08:50 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:08:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 05:08:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:08:51 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:08:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575911
Mon 20 Jan 2014 05:08:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:08:51 - job_xml_thread(): Done retrieving: data size 43575911
Mon 20 Jan 2014 05:08:51 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:08:51 - XML: Start document: iteration 5
Mon 20 Jan 2014 05:08:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575911
Mon 20 Jan 2014 05:08:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:09:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:09:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:09:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:09:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:09:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:09:03 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:09:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:09:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:09:05 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:09:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:09:05 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:09:05 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:09:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:09:10 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 05:09:10 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:09:10 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:09:10 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:09:10 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:09:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:09:13 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:09:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:09:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:09:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:09:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:09:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:09:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:09:16 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:09:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43552004
Mon 20 Jan 2014 05:09:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:09:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43552004
Mon 20 Jan 2014 05:09:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:09:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:09:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:09:25 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:09:25 - job_xml_thread(): Done retrieving: data size 43552004
Mon 20 Jan 2014 05:09:25 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:09:25 - XML: Start document: iteration 6
Mon 20 Jan 2014 05:09:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:09:28 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:09:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:09:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:09:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:09:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:09:31 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:09:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:09:31 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:09:31 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:09:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:09:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:09:31 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:09:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:09:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 05:09:32 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:09:32 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:09:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7132 values 112435 bits 14054 bytes 
Mon 20 Jan 2014 05:09:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 05:09:34 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:09:34 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:09:35 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:09:35 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 05:09:35 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 05:09:35 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:09:35 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 05:09:39 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 05:09:39 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:09:39 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:09:39 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:09:39 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:09:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:09:40 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:09:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:09:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:09:41 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 998152 values 15745966 bits 1968245 bytes 
Mon 20 Jan 2014 05:09:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:09:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:09:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:09:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:09:45 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:09:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558697
Mon 20 Jan 2014 05:09:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:09:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558697
Mon 20 Jan 2014 05:09:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:09:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:09:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:09:54 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:09:54 - job_xml_thread(): Done retrieving: data size 43558697
Mon 20 Jan 2014 05:09:54 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:09:54 - XML: Start document: iteration 7
Mon 20 Jan 2014 05:09:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:09:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:09:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:09:58 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:09:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:09:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:09:59 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:09:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:09:59 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:09:59 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:09:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:10:05 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:10:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 05:10:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:10:06 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 05:10:06 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:10:06 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:10:06 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:10:06 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:10:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:10:09 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:10:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:10:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:10:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:10:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:10:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:10:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:10:12 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:10:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556108
Mon 20 Jan 2014 05:10:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:10:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556108
Mon 20 Jan 2014 05:10:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:10:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:10:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:10:21 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:10:21 - job_xml_thread(): Done retrieving: data size 43556108
Mon 20 Jan 2014 05:10:21 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:10:21 - XML: Start document: iteration 8
Mon 20 Jan 2014 05:10:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:10:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:10:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:10:29 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:10:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:10:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:10:30 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:10:30 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:10:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:10:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:10:30 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:10:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:10:33 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:10:33 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:10:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 05:10:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:10:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 05:10:33 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:10:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6010 values 94788 bits 11848 bytes 
Mon 20 Jan 2014 05:10:34 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 05:10:34 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:10:34 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:10:34 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:10:34 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:10:35 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:10:35 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 05:10:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:10:35 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:10:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:10:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:10:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:10:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:10:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:10:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:10:40 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:10:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566617
Mon 20 Jan 2014 05:10:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:10:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566617
Mon 20 Jan 2014 05:10:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:10:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:10:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:10:49 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:10:49 - job_xml_thread(): Done retrieving: data size 43566617
Mon 20 Jan 2014 05:10:49 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:10:49 - XML: Start document: iteration 9
Mon 20 Jan 2014 05:10:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:10:50 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:10:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:10:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:10:51 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:10:51 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:10:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:10:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:10:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:10:51 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:10:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:11:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:11:02 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:11:03 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 05:11:03 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:11:03 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:11:03 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:11:03 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:11:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:11:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:11:04 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:11:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 05:11:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:11:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:11:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:11:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:11:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:11:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:11:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:11:07 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:11:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43537713
Mon 20 Jan 2014 05:11:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:11:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43537713
Mon 20 Jan 2014 05:11:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:11:18 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:11:18 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:11:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:11:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:11:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:11:20 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:11:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:11:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:11:21 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:11:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:11:21 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:11:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:11:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:11:24 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:11:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:11:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:11:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:11:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:11:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:11:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:11:25 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 05:11:25 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 05:11:25 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:11:26 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:11:26 - job_xml_thread(): Done retrieving: data size 43505218
Mon 20 Jan 2014 05:11:26 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:11:26 - XML: Start document: iteration 10
Mon 20 Jan 2014 05:11:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43505218
Mon 20 Jan 2014 05:11:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:11:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43505218
Mon 20 Jan 2014 05:11:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:11:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:11:33 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:11:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:11:34 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:11:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 05:11:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 05:11:35 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:11:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8873 values 139957 bits 17494 bytes 
Mon 20 Jan 2014 05:11:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:11:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:11:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:11:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:11:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:11:46 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:11:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:11:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:11:48 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:11:48 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:11:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:11:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:11:48 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:11:49 - XML: Processed 652599 elements - found 0 jobs
Mon 20 Jan 2014 05:11:49 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:11:49 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:11:49 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:11:49 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:11:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:11:49 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:11:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:11:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:11:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:11:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:11:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:11:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:11:51 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:11:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 05:11:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:11:52 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:11:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42929199
Mon 20 Jan 2014 05:11:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:11:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42929199
Mon 20 Jan 2014 05:11:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:12:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:12:02 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:12:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:12:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:12:04 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:12:04 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:12:04 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:12:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:12:04 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:12:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:12:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:12:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:12:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:12:06 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:12:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:12:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:12:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:12:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:12:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:12:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:12:09 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:12:09 - job_xml_thread(): Done retrieving: data size 42927444
Mon 20 Jan 2014 05:12:09 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:12:09 - XML: Start document: iteration 11
Mon 20 Jan 2014 05:12:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42927444
Mon 20 Jan 2014 05:12:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:12:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42927444
Mon 20 Jan 2014 05:12:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:12:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:12:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:12:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:12:20 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:12:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:12:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:12:21 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:12:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:12:21 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:12:21 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:12:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:12:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:12:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:12:28 - XML: Processed 645152 elements - found 0 jobs
Mon 20 Jan 2014 05:12:28 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:12:28 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:12:28 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:12:28 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:12:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:12:31 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:12:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:12:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:12:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:12:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:12:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:12:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:12:33 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:12:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43329502
Mon 20 Jan 2014 05:12:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:12:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43329502
Mon 20 Jan 2014 05:12:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:12:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:12:35 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:12:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:12:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 05:12:36 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:12:36 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:12:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9279 values 146360 bits 18295 bytes 
Mon 20 Jan 2014 05:12:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 05:12:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:12:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:12:44 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:12:44 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:12:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:12:45 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:12:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:12:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:12:45 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:12:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:12:45 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:12:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:12:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:12:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:12:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:12:48 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:12:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:12:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:12:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:12:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:12:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:12:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:12:51 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:12:51 - job_xml_thread(): Done retrieving: data size 43519452
Mon 20 Jan 2014 05:12:51 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:12:51 - XML: Start document: iteration 12
Mon 20 Jan 2014 05:12:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43519452
Mon 20 Jan 2014 05:12:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:12:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43519452
Mon 20 Jan 2014 05:12:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:13:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:13:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:13:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:13:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:13:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:13:12 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:13:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:13:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:13:12 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:13:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:13:12 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:13:12 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:13:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:13:13 - XML: Processed 652834 elements - found 0 jobs
Mon 20 Jan 2014 05:13:13 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:13:13 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:13:13 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:13:13 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:13:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:13:14 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:13:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:13:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:13:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:13:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:13:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:13:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:13:15 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:13:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 05:13:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:13:16 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:13:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564797
Mon 20 Jan 2014 05:13:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:13:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564797
Mon 20 Jan 2014 05:13:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:13:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:13:24 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:13:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:13:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:13:28 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:13:28 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:13:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:13:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:13:28 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:13:28 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:13:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:13:29 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:13:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:13:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:13:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:13:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:13:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:13:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:13:31 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:13:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565447
Mon 20 Jan 2014 05:13:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:13:31 - job_xml_thread(): Done retrieving: data size 43565447
Mon 20 Jan 2014 05:13:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565447
Mon 20 Jan 2014 05:13:31 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:13:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:13:32 - XML: Start document: iteration 13
Mon 20 Jan 2014 05:13:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:13:37 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:13:37 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:13:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 05:13:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:13:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 05:13:38 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:13:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8630 values 136079 bits 17009 bytes 
Mon 20 Jan 2014 05:13:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:13:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:13:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:13:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:13:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:13:46 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:13:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:13:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:13:49 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:13:49 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 05:13:49 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:13:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:13:49 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:13:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:13:49 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:13:49 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:13:49 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:13:49 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:13:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:13:54 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:13:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:13:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:13:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:13:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:13:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:13:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:13:56 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:13:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570912
Mon 20 Jan 2014 05:13:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:13:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570912
Mon 20 Jan 2014 05:13:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:14:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:14:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:14:04 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:14:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:14:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:14:04 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:14:04 - job_xml_thread(): Done retrieving: data size 43570912
Mon 20 Jan 2014 05:14:04 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:14:04 - XML: Start document: iteration 14
Mon 20 Jan 2014 05:14:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:14:05 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:14:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:14:05 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:14:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:14:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570912
Mon 20 Jan 2014 05:14:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:14:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:14:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:14:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:14:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:14:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:14:22 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:14:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:14:22 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:14:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 05:14:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:14:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:14:23 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:14:23 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:14:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:14:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:14:23 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:14:25 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 05:14:25 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:14:25 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:14:25 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:14:25 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:14:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:14:27 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:14:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:14:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:14:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:14:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:14:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:14:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:14:28 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:14:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580874
Mon 20 Jan 2014 05:14:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:14:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580874
Mon 20 Jan 2014 05:14:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:14:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:14:37 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:14:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:14:38 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:14:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:14:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:14:38 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:14:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 05:14:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 05:14:38 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:14:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:14:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6076 values 95830 bits 11978 bytes 
Mon 20 Jan 2014 05:14:39 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:14:39 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:14:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:14:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:14:40 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:14:40 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:14:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:14:42 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:14:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:14:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:14:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:14:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:14:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:14:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:14:44 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:14:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581192
Mon 20 Jan 2014 05:14:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:14:46 - job_xml_thread(): Done retrieving: data size 43581192
Mon 20 Jan 2014 05:14:46 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:14:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581192
Mon 20 Jan 2014 05:14:46 - XML: Start document: iteration 15
Mon 20 Jan 2014 05:14:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:14:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:14:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:14:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:14:58 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:14:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:14:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:14:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:14:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:15:01 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:15:01 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:15:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:15:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:15:01 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:15:03 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 05:15:04 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:15:04 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:15:04 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:15:04 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:15:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:15:07 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:15:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:15:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:15:07 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:15:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 05:15:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:15:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:15:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:15:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:15:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:15:08 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:15:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573018
Mon 20 Jan 2014 05:15:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:15:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573018
Mon 20 Jan 2014 05:15:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:15:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:15:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:15:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:15:17 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:15:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:15:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:15:18 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:15:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:15:18 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:15:19 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:15:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:15:19 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:15:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:15:21 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:15:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:15:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:15:23 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:15:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43585788
Mon 20 Jan 2014 05:15:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:15:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:15:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:15:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:15:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:15:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43585788
Mon 20 Jan 2014 05:15:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:15:24 - job_xml_thread(): Done retrieving: data size 43585788
Mon 20 Jan 2014 05:15:24 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:15:25 - XML: Start document: iteration 16
Mon 20 Jan 2014 05:15:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:15:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:15:36 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 05:15:36 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:15:36 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:15:36 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:15:36 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:15:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:15:39 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:15:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:15:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:15:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:15:40 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:15:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 05:15:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 05:15:40 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:15:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8997 values 141849 bits 17731 bytes 
Mon 20 Jan 2014 05:15:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:15:40 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:15:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:15:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:15:41 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:15:41 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:15:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:15:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:15:41 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:15:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:15:44 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:15:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:15:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:15:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:15:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:15:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:15:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:15:47 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:15:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559885
Mon 20 Jan 2014 05:15:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:15:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559885
Mon 20 Jan 2014 05:15:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:15:51 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:15:51 - job_xml_thread(): Done retrieving: data size 43559885
Mon 20 Jan 2014 05:15:51 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:15:51 - XML: Start document: iteration 17
Mon 20 Jan 2014 05:15:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:15:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:16:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:16:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:16:06 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 05:16:06 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:16:06 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:16:06 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:16:06 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:16:08 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:16:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 05:16:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:16:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:16:08 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:16:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:16:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:16:08 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:16:08 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:16:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:16:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:16:08 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:16:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:16:10 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:16:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:16:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:16:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:16:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:16:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:16:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:16:13 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:16:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583932
Mon 20 Jan 2014 05:16:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:16:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583932
Mon 20 Jan 2014 05:16:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:16:22 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:16:22 - job_xml_thread(): Done retrieving: data size 43583932
Mon 20 Jan 2014 05:16:22 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:16:22 - XML: Start document: iteration 18
Mon 20 Jan 2014 05:16:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:16:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:16:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:16:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:16:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:16:28 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:16:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:16:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:16:28 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:16:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:16:28 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:16:28 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:16:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:16:34 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 05:16:34 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:16:34 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:16:34 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:16:34 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:16:35 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 05:16:35 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:16:35 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:16:35 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:16:35 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 05:16:35 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 05:16:35 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 05:16:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:16:36 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:16:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:16:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:16:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:16:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:16:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:16:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:16:37 - size of cluster 'LISA Cluster': 624 hosts 79487 metrics 978400 values 15426572 bits 1928321 bytes 
Mon 20 Jan 2014 05:16:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:16:40 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:16:40 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:16:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 05:16:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:16:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 05:16:40 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:16:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5946 values 93891 bits 11736 bytes 
Mon 20 Jan 2014 05:16:41 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:16:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571006
Mon 20 Jan 2014 05:16:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:16:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571006
Mon 20 Jan 2014 05:16:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:16:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:16:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:16:49 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:16:49 - job_xml_thread(): Done retrieving: data size 43571006
Mon 20 Jan 2014 05:16:49 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:16:49 - XML: Start document: iteration 19
Mon 20 Jan 2014 05:16:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:16:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:16:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:16:59 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:16:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:16:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:16:59 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:16:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:16:59 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:16:59 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:16:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:17:03 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 05:17:03 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:17:03 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:17:03 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:17:03 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:17:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:17:04 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:17:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:17:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:17:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:17:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:17:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:17:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:17:08 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:17:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 05:17:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:17:09 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:17:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575846
Mon 20 Jan 2014 05:17:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:17:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575846
Mon 20 Jan 2014 05:17:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:17:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:17:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:17:18 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:17:18 - job_xml_thread(): Done retrieving: data size 43575846
Mon 20 Jan 2014 05:17:18 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:17:18 - XML: Start document: iteration 20
Mon 20 Jan 2014 05:17:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:17:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:17:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:17:21 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:17:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:17:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:17:23 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:17:23 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:17:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:17:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:17:23 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:17:32 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 05:17:32 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:17:32 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:17:32 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:17:32 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:17:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:17:32 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:17:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:17:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:17:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:17:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:17:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:17:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:17:35 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:17:35 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 05:17:36 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:17:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43482096
Mon 20 Jan 2014 05:17:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:17:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43482096
Mon 20 Jan 2014 05:17:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:17:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:17:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:17:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:17:40 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:17:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:17:42 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:17:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 05:17:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 05:17:42 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:17:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6530 values 103341 bits 12917 bytes 
Mon 20 Jan 2014 05:17:47 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:17:47 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:17:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:17:47 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:17:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:17:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:17:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:17:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:17:47 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:17:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:17:47 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:17:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:17:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:17:51 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:17:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:17:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:17:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:17:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:17:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:17:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:17:56 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:17:56 - job_xml_thread(): Done retrieving: data size 42936789
Mon 20 Jan 2014 05:17:56 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:17:56 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 05:17:56 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 05:17:56 - Housekeeping: done.
Mon 20 Jan 2014 05:17:56 - XML: Start document: iteration 0
Mon 20 Jan 2014 05:17:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42936789
Mon 20 Jan 2014 05:17:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:17:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42936789
Mon 20 Jan 2014 05:17:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:18:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:18:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:18:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:18:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:18:12 - XML: Processed 645394 elements - found 0 jobs
Mon 20 Jan 2014 05:18:12 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:18:12 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:18:12 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:18:12 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:18:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:18:15 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:18:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:18:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:18:16 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:18:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:18:16 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:18:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:18:16 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:18:17 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:18:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 05:18:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:18:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:18:19 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:18:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:18:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:18:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:18:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:18:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:18:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:18:23 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:18:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42980147
Mon 20 Jan 2014 05:18:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:18:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42980147
Mon 20 Jan 2014 05:18:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:18:28 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:18:28 - job_xml_thread(): Done retrieving: data size 42980147
Mon 20 Jan 2014 05:18:28 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:18:28 - XML: Start document: iteration 1
Mon 20 Jan 2014 05:18:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:18:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:18:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:18:33 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:18:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:18:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:18:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:18:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:18:35 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:18:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:18:35 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:18:36 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:18:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:18:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:18:42 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:18:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:18:43 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:18:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 05:18:43 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:18:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 05:18:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6133 values 96994 bits 12124 bytes 
Mon 20 Jan 2014 05:18:44 - XML: Processed 645902 elements - found 0 jobs
Mon 20 Jan 2014 05:18:44 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:18:44 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:18:44 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:18:44 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:18:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:18:46 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:18:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:18:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:18:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:18:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:18:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:18:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:18:51 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:18:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43507275
Mon 20 Jan 2014 05:18:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:18:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:18:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:18:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43507275
Mon 20 Jan 2014 05:18:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:18:59 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:18:59 - job_xml_thread(): Done retrieving: data size 43507275
Mon 20 Jan 2014 05:18:59 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:18:59 - XML: Start document: iteration 2
Mon 20 Jan 2014 05:19:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:19:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:19:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:19:08 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:19:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:19:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:19:08 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:19:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 05:19:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:19:09 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:19:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:19:09 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:19:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:19:09 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:19:12 - XML: Processed 652966 elements - found 0 jobs
Mon 20 Jan 2014 05:19:12 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:19:12 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:19:12 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:19:12 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:19:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:19:15 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:19:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:19:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:19:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:19:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:19:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:19:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:19:18 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:19:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43546850
Mon 20 Jan 2014 05:19:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:19:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43546850
Mon 20 Jan 2014 05:19:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:19:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:19:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:19:27 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:19:28 - job_xml_thread(): Done retrieving: data size 43546850
Mon 20 Jan 2014 05:19:28 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:19:28 - XML: Start document: iteration 3
Mon 20 Jan 2014 05:19:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:19:29 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:19:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:19:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:19:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:19:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:19:32 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:19:32 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:19:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:19:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:19:32 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:19:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:19:37 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:19:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:19:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:19:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:19:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:19:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:19:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:19:39 - XML: Processed 653347 elements - found 0 jobs
Mon 20 Jan 2014 05:19:39 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:19:39 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:19:39 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:19:39 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:19:43 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:19:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559894
Mon 20 Jan 2014 05:19:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:19:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:19:43 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:19:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559894
Mon 20 Jan 2014 05:19:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:19:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:19:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 05:19:44 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:19:44 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:19:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 05:19:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9314 values 146956 bits 18369 bytes 
Mon 20 Jan 2014 05:19:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:19:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:19:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:19:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:19:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:19:54 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:19:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:19:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:19:54 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:19:55 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:19:55 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:19:55 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:19:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:19:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:19:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:19:59 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:19:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:19:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:20:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:20:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:20:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:20:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:20:03 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:20:03 - job_xml_thread(): Done retrieving: data size 43546051
Mon 20 Jan 2014 05:20:03 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:20:03 - XML: Start document: iteration 4
Mon 20 Jan 2014 05:20:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43546051
Mon 20 Jan 2014 05:20:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:20:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43546051
Mon 20 Jan 2014 05:20:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:20:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:20:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:20:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:20:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:20:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:20:18 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:20:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:20:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:20:18 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:20:18 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:20:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:20:18 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:20:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:20:22 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 05:20:22 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:20:22 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:20:22 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:20:22 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:20:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:20:28 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:20:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:20:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:20:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:20:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:20:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:20:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:20:28 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:20:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 05:20:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:20:29 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 05:20:29 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 05:20:29 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:20:30 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:20:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556686
Mon 20 Jan 2014 05:20:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:20:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556686
Mon 20 Jan 2014 05:20:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:20:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:20:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:20:37 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:20:37 - job_xml_thread(): Done retrieving: data size 43556686
Mon 20 Jan 2014 05:20:37 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:20:37 - XML: Start document: iteration 5
Mon 20 Jan 2014 05:20:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:20:42 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:20:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:20:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:20:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:20:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:20:43 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:20:43 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:20:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:20:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:20:43 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:20:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:20:44 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:20:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:20:46 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:20:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 05:20:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 05:20:46 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:20:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5707 values 90038 bits 11254 bytes 
Mon 20 Jan 2014 05:20:51 - XML: Processed 653351 elements - found 0 jobs
Mon 20 Jan 2014 05:20:51 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:20:51 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:20:51 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:20:51 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:20:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:20:54 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:20:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:20:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:20:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:20:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:20:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:20:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:20:57 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:20:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558466
Mon 20 Jan 2014 05:20:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:20:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558466
Mon 20 Jan 2014 05:20:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:20:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:20:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:21:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:21:06 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:21:06 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:21:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:21:06 - job_xml_thread(): Done retrieving: data size 43558466
Mon 20 Jan 2014 05:21:06 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:21:06 - XML: Start document: iteration 6
Mon 20 Jan 2014 05:21:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:21:07 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:21:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:21:07 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:21:07 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:21:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:21:08 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:21:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 05:21:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:21:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:21:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:21:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:21:15 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:21:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:21:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:21:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:21:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:21:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:21:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:21:18 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 05:21:18 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:21:18 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:21:18 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:21:18 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:21:20 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:21:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43541667
Mon 20 Jan 2014 05:21:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:21:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43541667
Mon 20 Jan 2014 05:21:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:21:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:21:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:21:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:21:29 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:21:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:21:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:21:29 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:21:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:21:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43541667
Mon 20 Jan 2014 05:21:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:21:29 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:21:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:21:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:21:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:21:33 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:21:33 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:21:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:21:38 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:21:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:21:40 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:21:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:21:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:21:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:21:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:21:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:21:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:21:42 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:21:42 - job_xml_thread(): Done retrieving: data size 43581055
Mon 20 Jan 2014 05:21:42 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:21:42 - XML: Start document: iteration 7
Mon 20 Jan 2014 05:21:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581055
Mon 20 Jan 2014 05:21:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:21:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:21:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:21:45 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:21:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:21:45 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:21:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:21:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581055
Mon 20 Jan 2014 05:21:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:21:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:21:46 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:21:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:21:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 05:21:47 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:21:47 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:21:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 05:21:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6652 values 105038 bits 13129 bytes 
Mon 20 Jan 2014 05:21:56 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 05:21:56 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:21:56 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:21:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:21:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:21:56 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:21:56 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:21:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:21:58 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:22:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:22:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:22:02 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:22:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:22:02 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:22:02 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:22:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:22:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:22:02 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:22:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:22:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:22:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:22:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:22:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:22:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:22:05 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:22:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 05:22:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:22:05 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:22:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579340
Mon 20 Jan 2014 05:22:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:22:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579340
Mon 20 Jan 2014 05:22:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:22:11 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:22:11 - job_xml_thread(): Done retrieving: data size 43579340
Mon 20 Jan 2014 05:22:11 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:22:11 - XML: Start document: iteration 8
Mon 20 Jan 2014 05:22:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:22:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:22:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:22:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:22:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:22:19 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:22:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:22:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:22:20 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:22:20 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:22:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:22:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:22:20 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:22:22 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 05:22:22 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:22:22 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:22:22 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:22:22 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:22:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:22:26 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:22:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:22:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:22:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:22:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:22:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:22:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:22:28 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:22:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574549
Mon 20 Jan 2014 05:22:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:22:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574549
Mon 20 Jan 2014 05:22:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:22:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:22:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:22:37 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:22:37 - job_xml_thread(): Done retrieving: data size 43574549
Mon 20 Jan 2014 05:22:38 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:22:38 - XML: Start document: iteration 9
Mon 20 Jan 2014 05:22:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:22:41 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:22:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:22:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:22:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:22:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:22:42 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:22:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:22:42 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:22:42 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:22:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:22:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:22:47 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:22:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:22:47 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:22:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 05:22:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 05:22:48 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:22:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6286 values 99165 bits 12395 bytes 
Mon 20 Jan 2014 05:22:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:22:50 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:22:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:22:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:22:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:22:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:22:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:22:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:22:52 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 05:22:52 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:22:52 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:22:52 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:22:52 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:22:54 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:22:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560548
Mon 20 Jan 2014 05:22:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:22:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560548
Mon 20 Jan 2014 05:22:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:22:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:22:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:23:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:23:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:23:07 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:23:07 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:23:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:23:07 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:23:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:23:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:23:08 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:23:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:23:08 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:23:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:23:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:23:10 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:23:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:23:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:23:10 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:23:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 05:23:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:23:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:23:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:23:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:23:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:23:12 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:23:12 - job_xml_thread(): Done retrieving: data size 43526544
Mon 20 Jan 2014 05:23:12 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:23:12 - XML: Start document: iteration 10
Mon 20 Jan 2014 05:23:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43526544
Mon 20 Jan 2014 05:23:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43526544
Mon 20 Jan 2014 05:23:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:23:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:23:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:23:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:23:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:23:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:23:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:23:27 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:23:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:23:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:23:28 - XML: Processed 652602 elements - found 0 jobs
Mon 20 Jan 2014 05:23:29 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:23:29 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:23:29 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:23:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:23:29 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:23:29 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:23:29 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:23:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:23:29 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:23:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:23:31 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:23:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:23:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:23:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:23:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:23:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:23:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:23:33 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:23:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43060091
Mon 20 Jan 2014 05:23:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:23:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43060091
Mon 20 Jan 2014 05:23:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:23:36 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 05:23:36 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:23:38 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:23:38 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 05:23:38 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 05:23:39 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:23:39 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 05:23:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:23:44 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:23:44 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:23:44 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:23:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:23:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:23:45 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:23:45 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:23:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:23:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:23:47 - size of cluster 'LISA Cluster': 624 hosts 79468 metrics 823760 values 12994182 bits 1624272 bytes 
Mon 20 Jan 2014 05:23:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:23:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:23:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:23:48 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:23:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:23:49 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:23:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 05:23:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 05:23:49 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:23:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9055 values 142858 bits 17857 bytes 
Mon 20 Jan 2014 05:23:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:23:49 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:23:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:23:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:23:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:23:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:23:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:23:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:23:54 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:23:54 - job_xml_thread(): Done retrieving: data size 42932133
Mon 20 Jan 2014 05:23:54 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:23:54 - XML: Start document: iteration 11
Mon 20 Jan 2014 05:23:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42932133
Mon 20 Jan 2014 05:23:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:23:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42932133
Mon 20 Jan 2014 05:23:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:24:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:24:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:24:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:24:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:24:06 - XML: Processed 645510 elements - found 0 jobs
Mon 20 Jan 2014 05:24:06 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:24:06 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:24:06 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:24:06 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:24:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:24:14 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:24:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:24:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:24:15 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:24:15 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:24:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:24:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:24:16 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:24:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:24:17 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:24:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:24:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:24:18 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:24:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 05:24:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:24:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:24:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:24:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:24:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:24:21 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:24:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42981801
Mon 20 Jan 2014 05:24:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:24:21 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:24:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42981801
Mon 20 Jan 2014 05:24:21 - job_xml_thread(): Done retrieving: data size 42981801
Mon 20 Jan 2014 05:24:21 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:24:21 - XML: Start document: iteration 12
Mon 20 Jan 2014 05:24:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:24:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:24:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:24:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:24:33 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:24:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:24:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:24:33 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:24:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:24:33 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:24:33 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:24:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:24:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:24:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:24:40 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:24:40 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 05:24:41 - XML: Processed 645908 elements - found 0 jobs
Mon 20 Jan 2014 05:24:41 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:24:41 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:24:41 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:24:41 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:24:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:24:43 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:24:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:24:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:24:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:24:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:24:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:24:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:24:46 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:24:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43465938
Mon 20 Jan 2014 05:24:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:24:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43465938
Mon 20 Jan 2014 05:24:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:24:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:24:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:24:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:24:49 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:24:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:24:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 05:24:49 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:24:49 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:24:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 05:24:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8667 values 136575 bits 17071 bytes 
Mon 20 Jan 2014 05:24:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:24:55 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:24:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:24:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:24:56 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:24:56 - job_xml_thread(): Done retrieving: data size 43465938
Mon 20 Jan 2014 05:24:56 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:24:56 - XML: Start document: iteration 13
Mon 20 Jan 2014 05:24:57 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:24:57 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:24:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:24:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:24:57 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:24:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:24:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:25:06 - XML: Processed 652526 elements - found 0 jobs
Mon 20 Jan 2014 05:25:06 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:25:06 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:25:06 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:25:06 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:25:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:25:10 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:25:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:25:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:25:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:25:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:25:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:25:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:25:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:25:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:25:13 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:25:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43544449
Mon 20 Jan 2014 05:25:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:25:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43544449
Mon 20 Jan 2014 05:25:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:25:21 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:25:21 - job_xml_thread(): Done retrieving: data size 43544449
Mon 20 Jan 2014 05:25:21 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:25:21 - XML: Start document: iteration 14
Mon 20 Jan 2014 05:25:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:25:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:25:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:25:28 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:25:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:25:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:25:29 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:25:29 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:25:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:25:29 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:25:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:25:33 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:25:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 05:25:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:25:37 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 05:25:37 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:25:37 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:25:37 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:25:37 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:25:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:25:39 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:25:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:25:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:25:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:25:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:25:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:25:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:25:42 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:25:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560582
Mon 20 Jan 2014 05:25:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:25:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560582
Mon 20 Jan 2014 05:25:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:25:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:25:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:25:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:25:50 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:25:51 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:25:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 05:25:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:25:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 05:25:51 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:25:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5754 values 90731 bits 11341 bytes 
Mon 20 Jan 2014 05:25:52 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:25:52 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:25:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:25:53 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:25:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:25:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:25:53 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:25:53 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:25:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:25:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:25:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:25:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:25:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:25:59 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:25:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:25:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:26:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:26:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:26:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:26:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:26:03 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:26:03 - job_xml_thread(): Done retrieving: data size 43549537
Mon 20 Jan 2014 05:26:03 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:26:03 - XML: Start document: iteration 15
Mon 20 Jan 2014 05:26:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43549537
Mon 20 Jan 2014 05:26:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:26:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43549537
Mon 20 Jan 2014 05:26:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:26:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:26:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:26:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:26:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:26:17 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 05:26:17 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:26:17 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:26:17 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:26:17 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:26:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:26:21 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:26:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:26:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:26:21 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:26:21 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:26:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:26:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:26:21 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:26:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:26:23 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:26:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:26:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:26:23 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:26:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 05:26:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:26:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:26:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:26:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:26:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:26:26 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:26:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43593956
Mon 20 Jan 2014 05:26:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:26:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43593956
Mon 20 Jan 2014 05:26:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:26:32 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:26:33 - job_xml_thread(): Done retrieving: data size 43593956
Mon 20 Jan 2014 05:26:33 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:26:33 - XML: Start document: iteration 16
Mon 20 Jan 2014 05:26:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:26:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:26:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:26:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:26:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:26:42 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:26:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:26:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:26:43 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:26:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:26:43 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:26:43 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:26:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:26:48 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 05:26:48 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:26:48 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:26:48 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:26:48 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:26:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:26:49 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:26:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:26:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:26:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:26:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:26:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:26:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:26:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:26:51 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:26:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:26:52 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:26:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 05:26:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 05:26:52 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:26:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6022 values 95008 bits 11876 bytes 
Mon 20 Jan 2014 05:26:53 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:26:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568442
Mon 20 Jan 2014 05:26:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:26:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568442
Mon 20 Jan 2014 05:26:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:26:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:26:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:27:04 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:27:04 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:27:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:27:04 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:27:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:27:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:27:05 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:27:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:27:05 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:27:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:27:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:27:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:27:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:27:09 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:27:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:27:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:27:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:27:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:27:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:27:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:27:12 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:27:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 05:27:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:27:13 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:27:13 - job_xml_thread(): Done retrieving: data size 43587580
Mon 20 Jan 2014 05:27:13 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:27:13 - XML: Start document: iteration 17
Mon 20 Jan 2014 05:27:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43587580
Mon 20 Jan 2014 05:27:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43587580
Mon 20 Jan 2014 05:27:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:27:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:27:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:27:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:27:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:27:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:27:27 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 05:27:27 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:27:27 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:27:27 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:27:27 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:27:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:27:31 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:27:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:27:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:27:32 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:27:32 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:27:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:27:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:27:32 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:27:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:27:36 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:27:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:27:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:27:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:27:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:27:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:27:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:27:39 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:27:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581531
Mon 20 Jan 2014 05:27:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:27:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581531
Mon 20 Jan 2014 05:27:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:27:42 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:27:42 - job_xml_thread(): Done retrieving: data size 43581531
Mon 20 Jan 2014 05:27:42 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:27:42 - XML: Start document: iteration 18
Mon 20 Jan 2014 05:27:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:27:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:27:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:27:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:27:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:27:51 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:27:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:27:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:27:52 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:27:52 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:27:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:27:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:27:52 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:27:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:27:52 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:27:53 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:27:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:27:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 05:27:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 05:27:53 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:27:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6826 values 107634 bits 13454 bytes 
Mon 20 Jan 2014 05:27:57 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 05:27:57 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:27:57 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:27:57 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:27:57 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:28:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:28:03 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:28:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:28:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:28:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:28:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:28:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:28:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:28:04 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 05:28:04 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 05:28:04 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:28:06 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:28:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43546208
Mon 20 Jan 2014 05:28:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:28:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43546208
Mon 20 Jan 2014 05:28:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:28:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:28:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:28:12 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:28:12 - job_xml_thread(): Done retrieving: data size 43546208
Mon 20 Jan 2014 05:28:13 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:28:13 - XML: Start document: iteration 19
Mon 20 Jan 2014 05:28:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:28:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:28:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:28:21 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:28:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:28:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:28:22 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:28:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:28:22 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:28:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:28:22 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:28:23 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 05:28:23 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:28:23 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:28:23 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:28:23 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:28:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:28:28 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:28:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:28:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:28:28 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:28:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 05:28:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:28:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:28:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:28:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:28:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:28:29 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:28:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567237
Mon 20 Jan 2014 05:28:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:28:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567237
Mon 20 Jan 2014 05:28:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:28:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:28:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:28:38 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:28:38 - job_xml_thread(): Done retrieving: data size 43567237
Mon 20 Jan 2014 05:28:38 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:28:38 - XML: Start document: iteration 20
Mon 20 Jan 2014 05:28:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:28:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:28:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:28:46 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:28:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:28:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:28:47 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:28:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:28:47 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:28:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:28:47 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:28:52 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 05:28:52 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:28:52 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:28:52 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:28:52 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:28:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:28:53 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:28:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:28:53 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:28:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:28:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:28:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:28:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 05:28:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:28:54 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:28:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 05:28:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:28:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:28:54 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:28:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:28:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5881 values 92752 bits 11594 bytes 
Mon 20 Jan 2014 05:28:56 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:28:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584185
Mon 20 Jan 2014 05:28:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:28:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584185
Mon 20 Jan 2014 05:28:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:29:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:29:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:29:07 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:29:07 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:29:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:29:09 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:29:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:29:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:29:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:29:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:29:09 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:29:09 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:29:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:29:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:29:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:29:12 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:29:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:29:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:29:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:29:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:29:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:29:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:29:12 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:29:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 05:29:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:29:13 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:29:13 - job_xml_thread(): Done retrieving: data size 43511001
Mon 20 Jan 2014 05:29:13 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:29:13 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 05:29:13 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 05:29:13 - Housekeeping: done.
Mon 20 Jan 2014 05:29:13 - XML: Start document: iteration 0
Mon 20 Jan 2014 05:29:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43511001
Mon 20 Jan 2014 05:29:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:29:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43511001
Mon 20 Jan 2014 05:29:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:29:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:29:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:29:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:29:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:29:36 - XML: Processed 652608 elements - found 0 jobs
Mon 20 Jan 2014 05:29:36 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:29:36 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:29:36 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:29:36 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:29:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:29:36 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:29:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:29:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:29:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:29:37 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:29:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:29:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:29:37 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:29:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:29:37 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:29:37 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:29:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:29:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:29:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:29:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:29:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:29:39 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:29:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43019040
Mon 20 Jan 2014 05:29:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:29:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43019040
Mon 20 Jan 2014 05:29:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:29:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:29:49 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:29:52 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:29:52 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:29:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:29:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:29:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:29:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:29:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:29:52 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:29:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:29:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:29:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:29:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:29:53 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:29:53 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:29:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:29:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:29:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:29:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:29:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:29:54 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:29:54 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:29:54 - job_xml_thread(): Done retrieving: data size 42945025
Mon 20 Jan 2014 05:29:54 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:29:54 - XML: Start document: iteration 1
Mon 20 Jan 2014 05:29:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42945025
Mon 20 Jan 2014 05:29:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:29:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42945025
Mon 20 Jan 2014 05:29:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:29:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:29:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 05:29:55 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:29:55 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:29:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 05:29:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8837 values 139306 bits 17413 bytes 
Mon 20 Jan 2014 05:30:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:30:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:30:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:30:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:30:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:30:13 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:30:13 - XML: Processed 645278 elements - found 0 jobs
Mon 20 Jan 2014 05:30:13 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:30:13 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:30:13 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:30:13 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:30:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:30:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:30:14 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:30:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:30:14 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:30:14 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:30:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:30:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:30:18 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:30:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:30:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:30:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:30:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:30:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:30:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:30:20 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:30:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42968956
Mon 20 Jan 2014 05:30:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42968956
Mon 20 Jan 2014 05:30:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:30:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:30:28 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:30:28 - job_xml_thread(): Done retrieving: data size 42968956
Mon 20 Jan 2014 05:30:28 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:30:28 - XML: Start document: iteration 2
Mon 20 Jan 2014 05:30:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:30:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:30:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:30:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:30:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:30:35 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:30:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:30:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:30:36 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:30:36 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:30:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:30:36 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:30:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:30:40 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 05:30:40 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:30:40 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:30:40 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:30:40 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 05:30:40 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 05:30:40 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 05:30:42 - XML: Processed 645908 elements - found 0 jobs
Mon 20 Jan 2014 05:30:42 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:30:42 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:30:42 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:30:42 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:30:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:30:44 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 824753 values 13003651 bits 1625456 bytes 
Mon 20 Jan 2014 05:30:44 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:30:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:30:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:30:44 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:30:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 05:30:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:30:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:30:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:30:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:30:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:30:47 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:30:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43485025
Mon 20 Jan 2014 05:30:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:30:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43485025
Mon 20 Jan 2014 05:30:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:30:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:30:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:30:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:30:55 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:30:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:30:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 05:30:55 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:30:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 05:30:55 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:30:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5882 values 92823 bits 11602 bytes 
Mon 20 Jan 2014 05:30:58 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:30:58 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:30:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:30:58 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:30:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:30:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:30:59 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:30:59 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:30:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:30:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:31:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:31:00 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:31:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:31:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:31:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:31:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:31:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:31:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:31:04 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:31:04 - job_xml_thread(): Done retrieving: data size 43561346
Mon 20 Jan 2014 05:31:04 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:31:04 - XML: Start document: iteration 3
Mon 20 Jan 2014 05:31:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561346
Mon 20 Jan 2014 05:31:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:31:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561346
Mon 20 Jan 2014 05:31:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:31:11 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:31:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 05:31:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:31:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:31:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:31:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:31:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:31:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:31:18 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:31:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:31:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:31:19 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:31:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:31:19 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:31:19 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:31:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:31:23 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 05:31:23 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:31:23 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:31:23 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:31:23 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:31:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:31:27 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:31:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:31:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:31:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:31:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:31:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:31:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:31:31 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:31:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554785
Mon 20 Jan 2014 05:31:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:31:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554785
Mon 20 Jan 2014 05:31:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:31:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:31:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:31:38 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:31:38 - job_xml_thread(): Done retrieving: data size 43554785
Mon 20 Jan 2014 05:31:38 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:31:38 - XML: Start document: iteration 4
Mon 20 Jan 2014 05:31:40 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:31:40 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 05:31:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:31:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:31:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:31:45 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:31:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:31:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:31:46 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:31:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:31:46 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:31:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:31:46 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:31:52 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 05:31:52 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:31:52 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:31:52 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:31:52 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:31:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:31:53 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:31:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:31:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:31:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:31:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:31:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:31:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:31:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:31:55 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:31:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:31:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 05:31:56 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:31:56 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:31:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 05:31:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6236 values 98559 bits 12319 bytes 
Mon 20 Jan 2014 05:31:57 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:31:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575592
Mon 20 Jan 2014 05:31:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:31:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575592
Mon 20 Jan 2014 05:31:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:32:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:32:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:32:07 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:32:07 - job_xml_thread(): Done retrieving: data size 43575592
Mon 20 Jan 2014 05:32:07 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:32:07 - XML: Start document: iteration 5
Mon 20 Jan 2014 05:32:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:32:08 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:32:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:32:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:32:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:32:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:32:09 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:32:09 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:32:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:32:09 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:32:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:32:18 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 05:32:18 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:32:18 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:32:19 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:32:19 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:32:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:32:21 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:32:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:32:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:32:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:32:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:32:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:32:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:32:23 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:32:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 05:32:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:32:24 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:32:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554314
Mon 20 Jan 2014 05:32:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:32:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:32:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:32:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554314
Mon 20 Jan 2014 05:32:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:32:34 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:32:34 - job_xml_thread(): Done retrieving: data size 43554314
Mon 20 Jan 2014 05:32:34 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:32:34 - XML: Start document: iteration 6
Mon 20 Jan 2014 05:32:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:32:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:32:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:32:37 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:32:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:32:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:32:39 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:32:39 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:32:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:32:39 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:32:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:32:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:32:45 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:32:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:32:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:32:46 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 05:32:46 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:32:46 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:32:46 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:32:46 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:32:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:32:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:32:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:32:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:32:49 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:32:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559792
Mon 20 Jan 2014 05:32:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559792
Mon 20 Jan 2014 05:32:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:32:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:32:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:32:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:32:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:32:56 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:32:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:32:56 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:32:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 05:32:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 05:32:57 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:32:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6847 values 108317 bits 13539 bytes 
Mon 20 Jan 2014 05:33:01 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:33:01 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:33:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:33:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:33:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:33:04 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:33:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:33:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:33:04 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:33:04 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:33:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:33:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:33:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:33:05 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:33:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:33:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:33:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:33:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:33:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:33:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:33:09 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:33:09 - job_xml_thread(): Done retrieving: data size 43582031
Mon 20 Jan 2014 05:33:09 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:33:09 - XML: Start document: iteration 7
Mon 20 Jan 2014 05:33:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582031
Mon 20 Jan 2014 05:33:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:33:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582031
Mon 20 Jan 2014 05:33:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:33:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:33:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:33:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:33:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:33:23 - XML: Processed 653356 elements - found 0 jobs
Mon 20 Jan 2014 05:33:23 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:33:23 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:33:23 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:33:23 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:33:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:33:28 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:33:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:33:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:33:29 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:33:29 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:33:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:33:29 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:33:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:33:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:33:31 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:33:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:33:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:33:31 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:33:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 05:33:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:33:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:33:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:33:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:33:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:33:34 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:33:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574322
Mon 20 Jan 2014 05:33:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:33:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574322
Mon 20 Jan 2014 05:33:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:33:38 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:33:38 - job_xml_thread(): Done retrieving: data size 43574322
Mon 20 Jan 2014 05:33:38 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:33:38 - XML: Start document: iteration 8
Mon 20 Jan 2014 05:33:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:33:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:33:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:33:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:33:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:33:51 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:33:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:33:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:33:51 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:33:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:33:51 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:33:51 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:33:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:33:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:33:53 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:33:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:33:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:33:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:33:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:33:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:33:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:33:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:33:57 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:33:57 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 05:33:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:33:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 05:33:57 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:33:57 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:33:57 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:33:57 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:33:57 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:33:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5767 values 91061 bits 11382 bytes 
Mon 20 Jan 2014 05:33:57 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:33:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 05:34:01 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:34:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559706
Mon 20 Jan 2014 05:34:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:34:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559706
Mon 20 Jan 2014 05:34:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:34:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:34:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:34:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:34:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:34:12 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:34:12 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:34:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:34:13 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:34:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:34:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:34:13 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:34:13 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:34:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:34:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:34:16 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:34:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 05:34:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:34:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:34:18 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:34:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:34:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:34:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:34:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:34:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:34:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:34:21 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:34:21 - job_xml_thread(): Done retrieving: data size 43569061
Mon 20 Jan 2014 05:34:21 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:34:21 - XML: Start document: iteration 9
Mon 20 Jan 2014 05:34:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569061
Mon 20 Jan 2014 05:34:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:34:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569061
Mon 20 Jan 2014 05:34:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:34:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:34:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:34:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:34:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:34:37 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 05:34:37 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:34:37 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:34:37 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:34:37 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:34:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:34:41 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:34:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:34:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:34:41 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:34:41 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:34:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:34:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:34:41 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:34:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:34:44 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:34:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:34:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:34:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:34:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:34:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:34:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:34:47 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:34:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564060
Mon 20 Jan 2014 05:34:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:34:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564060
Mon 20 Jan 2014 05:34:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:34:52 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:34:52 - job_xml_thread(): Done retrieving: data size 43564060
Mon 20 Jan 2014 05:34:52 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:34:52 - XML: Start document: iteration 10
Mon 20 Jan 2014 05:34:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:34:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:34:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:34:57 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:34:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:34:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 05:34:58 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:34:58 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:34:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 05:34:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9008 values 142135 bits 17766 bytes 
Mon 20 Jan 2014 05:35:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:35:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:35:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:35:05 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:35:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:35:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:35:07 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:35:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:35:07 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:35:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:35:07 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:35:09 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 05:35:09 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:35:09 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:35:09 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:35:09 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:35:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:35:10 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:35:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:35:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:35:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:35:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:35:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:35:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:35:13 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 05:35:13 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 05:35:13 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:35:13 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:35:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43515096
Mon 20 Jan 2014 05:35:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:35:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43515096
Mon 20 Jan 2014 05:35:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:35:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:35:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:35:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:35:23 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:35:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:35:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:35:23 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:35:23 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:35:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:35:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:35:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43515096
Mon 20 Jan 2014 05:35:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:35:24 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:35:24 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:35:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:35:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:35:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:35:35 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:35:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:35:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:35:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:35:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:35:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:35:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:35:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:35:37 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:35:37 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:35:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 05:35:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:35:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:35:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:35:38 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:35:38 - job_xml_thread(): Done retrieving: data size 43484271
Mon 20 Jan 2014 05:35:38 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:35:38 - XML: Start document: iteration 11
Mon 20 Jan 2014 05:35:39 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:35:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:35:39 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:35:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:35:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43484271
Mon 20 Jan 2014 05:35:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:35:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43484271
Mon 20 Jan 2014 05:35:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:35:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:35:50 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:35:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:35:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:35:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:35:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:35:55 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:35:55 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:35:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:35:55 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:35:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:35:55 - XML: Processed 652592 elements - found 0 jobs
Mon 20 Jan 2014 05:35:55 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:35:55 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:35:55 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:35:55 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:35:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:35:58 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:35:58 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:35:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 05:35:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:35:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 05:35:59 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:35:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:35:59 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:35:59 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5826 values 91906 bits 11488 bytes 
Mon 20 Jan 2014 05:35:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:35:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:35:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:35:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:35:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:35:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:36:01 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:36:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42901520
Mon 20 Jan 2014 05:36:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:36:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42901520
Mon 20 Jan 2014 05:36:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:36:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:36:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:36:10 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:36:10 - job_xml_thread(): Done retrieving: data size 42901520
Mon 20 Jan 2014 05:36:10 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:36:10 - XML: Start document: iteration 12
Mon 20 Jan 2014 05:36:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:36:12 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:36:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:36:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:36:13 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:36:13 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:36:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:36:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:36:13 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:36:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:36:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:36:20 - XML: Processed 645155 elements - found 0 jobs
Mon 20 Jan 2014 05:36:20 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:36:20 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:36:20 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:36:20 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:36:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:36:24 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:36:24 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:36:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 05:36:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:36:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:36:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:36:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:36:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:36:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:36:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:36:26 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:36:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42961964
Mon 20 Jan 2014 05:36:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:36:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42961964
Mon 20 Jan 2014 05:36:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:36:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:36:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:36:35 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:36:35 - job_xml_thread(): Done retrieving: data size 42961964
Mon 20 Jan 2014 05:36:35 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:36:35 - XML: Start document: iteration 13
Mon 20 Jan 2014 05:36:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:36:36 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:36:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:36:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:36:38 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:36:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:36:38 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:36:38 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:36:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:36:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:36:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:36:46 - XML: Processed 645834 elements - found 0 jobs
Mon 20 Jan 2014 05:36:46 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:36:46 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:36:46 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:36:46 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:36:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:36:47 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:36:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:36:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:36:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:36:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:36:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:36:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:36:49 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:36:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43500549
Mon 20 Jan 2014 05:36:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:36:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43500549
Mon 20 Jan 2014 05:36:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:36:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:36:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:36:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:36:58 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:36:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:36:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:36:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:36:59 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:36:59 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:36:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:36:59 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:36:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:36:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43500549
Mon 20 Jan 2014 05:36:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:36:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:36:59 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:36:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 05:36:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 05:36:59 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:36:59 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8882 values 140132 bits 17516 bytes 
Mon 20 Jan 2014 05:37:01 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:37:01 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:37:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:37:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:37:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:37:11 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:37:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:37:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:37:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:37:12 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:37:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:37:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:37:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:37:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:37:13 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:37:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 05:37:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:37:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:37:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:37:14 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:37:14 - job_xml_thread(): Done retrieving: data size 43545975
Mon 20 Jan 2014 05:37:14 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:37:14 - XML: Start document: iteration 14
Mon 20 Jan 2014 05:37:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43545975
Mon 20 Jan 2014 05:37:15 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:37:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:37:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43545975
Mon 20 Jan 2014 05:37:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:37:15 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:37:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:37:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:37:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:37:27 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:37:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:37:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:37:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:37:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:37:32 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:37:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:37:32 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:37:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:37:33 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:37:34 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 05:37:34 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:37:34 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:37:34 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:37:34 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:37:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:37:36 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:37:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:37:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:37:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:37:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:37:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:37:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:37:38 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:37:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43587752
Mon 20 Jan 2014 05:37:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:37:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43587752
Mon 20 Jan 2014 05:37:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:37:41 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 05:37:41 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:37:42 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:37:42 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:37:42 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 05:37:42 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 05:37:42 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 05:37:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:37:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:37:50 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:37:50 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:37:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:37:51 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:37:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:37:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:37:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:37:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:37:52 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:37:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:37:52 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:37:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:37:52 - size of cluster 'LISA Cluster': 624 hosts 79473 metrics 772196 values 12185195 bits 1523149 bytes 
Mon 20 Jan 2014 05:37:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:37:56 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:37:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:37:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:37:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:37:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:37:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:37:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:37:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:37:59 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:37:59 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:37:59 - job_xml_thread(): Done retrieving: data size 43571133
Mon 20 Jan 2014 05:37:59 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:37:59 - XML: Start document: iteration 15
Mon 20 Jan 2014 05:38:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571133
Mon 20 Jan 2014 05:38:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571133
Mon 20 Jan 2014 05:38:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:38:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:38:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:38:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 05:38:02 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:38:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 05:38:02 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:38:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6302 values 99419 bits 12427 bytes 
Mon 20 Jan 2014 05:38:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:38:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:38:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:38:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:38:13 - XML: Processed 653353 elements - found 0 jobs
Mon 20 Jan 2014 05:38:13 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:38:13 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:38:13 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:38:13 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:38:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:38:20 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:38:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:38:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:38:21 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:38:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:38:21 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:38:21 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:38:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:38:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:38:23 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:38:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:38:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:38:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:38:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:38:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:38:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:38:26 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:38:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43603871
Mon 20 Jan 2014 05:38:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:38:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43603871
Mon 20 Jan 2014 05:38:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:38:28 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:38:28 - job_xml_thread(): Done retrieving: data size 43603871
Mon 20 Jan 2014 05:38:28 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:38:28 - XML: Start document: iteration 16
Mon 20 Jan 2014 05:38:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:38:35 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:38:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:38:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:38:38 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:38:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:38:38 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:38:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:38:38 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:38:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:38:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:38:42 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:38:42 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 05:38:43 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 05:38:43 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:38:43 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:38:43 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:38:43 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:38:46 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:38:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 05:38:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:38:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:38:48 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:38:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:38:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:38:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:38:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:38:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:38:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:38:51 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:38:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557746
Mon 20 Jan 2014 05:38:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:38:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557746
Mon 20 Jan 2014 05:38:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:38:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:38:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:38:58 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:38:58 - job_xml_thread(): Done retrieving: data size 43557746
Mon 20 Jan 2014 05:38:58 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:38:58 - XML: Start document: iteration 17
Mon 20 Jan 2014 05:39:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:39:02 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:39:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:39:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 05:39:04 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:39:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:39:04 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:39:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5969 values 94151 bits 11768 bytes 
Mon 20 Jan 2014 05:39:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 05:39:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:39:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:39:08 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:39:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:39:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:39:09 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:39:09 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:39:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:39:09 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:39:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:39:11 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 05:39:11 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:39:11 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:39:11 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:39:11 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:39:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:39:14 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:39:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:39:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:39:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:39:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:39:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:39:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:39:19 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:39:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554189
Mon 20 Jan 2014 05:39:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:39:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554189
Mon 20 Jan 2014 05:39:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:39:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:39:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:39:27 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:39:27 - job_xml_thread(): Done retrieving: data size 43554189
Mon 20 Jan 2014 05:39:27 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:39:27 - XML: Start document: iteration 18
Mon 20 Jan 2014 05:39:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:39:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:39:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:39:39 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:39:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:39:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:39:41 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:39:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:39:41 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:39:41 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:39:41 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 05:39:41 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:39:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:39:41 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:39:41 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:39:41 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:39:41 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:39:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 05:39:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:39:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:39:44 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:39:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:39:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:39:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:39:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:39:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:39:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:39:47 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:39:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564708
Mon 20 Jan 2014 05:39:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:39:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564708
Mon 20 Jan 2014 05:39:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:39:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:39:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:39:57 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:39:57 - job_xml_thread(): Done retrieving: data size 43564708
Mon 20 Jan 2014 05:39:58 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:39:58 - XML: Start document: iteration 19
Mon 20 Jan 2014 05:39:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:39:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:39:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:40:00 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:40:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:40:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:40:02 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:40:02 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:40:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:40:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:40:02 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:40:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:40:05 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:40:06 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:40:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 05:40:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:40:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 05:40:06 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:40:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5966 values 94083 bits 11760 bytes 
Mon 20 Jan 2014 05:40:08 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 05:40:08 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:40:08 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:40:08 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:40:09 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:40:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:40:10 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:40:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:40:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:40:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:40:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:40:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:40:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:40:14 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:40:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561430
Mon 20 Jan 2014 05:40:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:40:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561430
Mon 20 Jan 2014 05:40:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:40:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:40:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:40:24 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:40:24 - job_xml_thread(): Done retrieving: data size 43561430
Mon 20 Jan 2014 05:40:24 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:40:24 - XML: Start document: iteration 20
Mon 20 Jan 2014 05:40:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:40:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:40:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:40:26 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:40:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:40:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:40:27 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:40:27 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:40:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:40:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:40:27 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:40:29 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:40:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 05:40:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:40:34 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 05:40:34 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:40:34 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:40:34 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:40:34 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:40:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:40:39 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:40:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:40:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:40:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:40:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:40:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:40:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:40:42 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:40:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557126
Mon 20 Jan 2014 05:40:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:40:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:40:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:40:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557126
Mon 20 Jan 2014 05:40:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:40:49 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:40:49 - job_xml_thread(): Done retrieving: data size 43557126
Mon 20 Jan 2014 05:40:49 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:40:49 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 05:40:50 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 05:40:50 - Housekeeping: done.
Mon 20 Jan 2014 05:40:50 - XML: Start document: iteration 0
Mon 20 Jan 2014 05:40:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:40:52 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:40:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:40:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:40:54 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:40:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:40:54 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:40:54 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:40:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:40:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:40:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:41:03 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 05:41:03 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:41:03 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:41:03 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:41:03 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:41:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:41:05 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:41:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:41:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:41:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:41:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:41:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:41:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:41:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:41:06 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:41:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:41:07 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:41:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 05:41:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 05:41:07 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:41:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5835 values 92026 bits 11503 bytes 
Mon 20 Jan 2014 05:41:09 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:41:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43551901
Mon 20 Jan 2014 05:41:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:41:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:41:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:41:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43551901
Mon 20 Jan 2014 05:41:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:41:18 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:41:18 - job_xml_thread(): Done retrieving: data size 43551901
Mon 20 Jan 2014 05:41:18 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:41:18 - XML: Start document: iteration 1
Mon 20 Jan 2014 05:41:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:41:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:41:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:41:21 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:41:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:41:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:41:21 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:41:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:41:21 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:41:21 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:41:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:41:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:41:30 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:41:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:41:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:41:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:41:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:41:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:41:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:41:33 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 05:41:33 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:41:33 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:41:33 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:41:33 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:41:35 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:41:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 05:41:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:41:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:41:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:41:36 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:41:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43479079
Mon 20 Jan 2014 05:41:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:41:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43479079
Mon 20 Jan 2014 05:41:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:41:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:41:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:41:48 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:41:48 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:41:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:41:49 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:41:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:41:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:41:49 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:41:49 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:41:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:41:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:41:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:41:52 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:41:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:41:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:41:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:41:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:41:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:41:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:41:56 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:41:56 - job_xml_thread(): Done retrieving: data size 42939639
Mon 20 Jan 2014 05:41:56 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:41:56 - XML: Start document: iteration 2
Mon 20 Jan 2014 05:41:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42939639
Mon 20 Jan 2014 05:41:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:41:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42939639
Mon 20 Jan 2014 05:41:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:42:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:42:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:42:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:42:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:42:08 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:42:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:42:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:42:09 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:42:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 05:42:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 05:42:09 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:42:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7507 values 118375 bits 14796 bytes 
Mon 20 Jan 2014 05:42:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:42:12 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:42:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:42:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:42:13 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:42:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:42:13 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:42:13 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:42:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:42:13 - XML: Processed 645382 elements - found 0 jobs
Mon 20 Jan 2014 05:42:14 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:42:14 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:42:14 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:42:14 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:42:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:42:19 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:42:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:42:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:42:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:42:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:42:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:42:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:42:21 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 05:42:21 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 05:42:21 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:42:22 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:42:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42977715
Mon 20 Jan 2014 05:42:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:42:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42977715
Mon 20 Jan 2014 05:42:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:42:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:42:29 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:42:29 - job_xml_thread(): Done retrieving: data size 42977715
Mon 20 Jan 2014 05:42:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:42:29 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:42:29 - XML: Start document: iteration 3
Mon 20 Jan 2014 05:42:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:42:33 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:42:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:42:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:42:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:42:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:42:35 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:42:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:42:36 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:42:36 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:42:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:42:44 - XML: Processed 645908 elements - found 0 jobs
Mon 20 Jan 2014 05:42:44 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:42:44 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:42:44 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:42:44 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:42:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:42:45 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:42:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:42:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:42:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:42:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:42:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:42:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:42:46 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:42:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 05:42:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:42:47 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:42:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43492849
Mon 20 Jan 2014 05:42:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:42:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43492849
Mon 20 Jan 2014 05:42:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:42:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:42:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:42:59 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:42:59 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:43:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:43:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:43:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:43:01 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:43:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:43:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:43:02 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:43:02 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:43:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:43:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:43:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:43:03 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:43:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:43:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:43:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:43:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:43:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:43:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:43:06 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:43:06 - job_xml_thread(): Done retrieving: data size 43575837
Mon 20 Jan 2014 05:43:06 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:43:06 - XML: Start document: iteration 4
Mon 20 Jan 2014 05:43:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575837
Mon 20 Jan 2014 05:43:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:43:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575837
Mon 20 Jan 2014 05:43:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:43:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:43:10 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:43:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:43:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 05:43:13 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:43:13 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:43:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8551 values 134844 bits 16855 bytes 
Mon 20 Jan 2014 05:43:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 05:43:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:43:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:43:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:43:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:43:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:43:24 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:43:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:43:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:43:25 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:43:25 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:43:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:43:25 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:43:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:43:26 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 05:43:26 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:43:26 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:43:26 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:43:26 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:43:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:43:28 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:43:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:43:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:43:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:43:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:43:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:43:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:43:31 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:43:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559114
Mon 20 Jan 2014 05:43:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:43:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559114
Mon 20 Jan 2014 05:43:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:43:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:43:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:43:41 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:43:41 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:43:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:43:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:43:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:43:45 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:43:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:43:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:43:45 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:43:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:43:45 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:43:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:43:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:43:48 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:43:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:43:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:43:48 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:43:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 05:43:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:43:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:43:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:43:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:43:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:43:49 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:43:49 - job_xml_thread(): Done retrieving: data size 43558772
Mon 20 Jan 2014 05:43:49 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:43:49 - XML: Start document: iteration 5
Mon 20 Jan 2014 05:43:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558772
Mon 20 Jan 2014 05:43:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:43:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558772
Mon 20 Jan 2014 05:43:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:44:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:44:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:44:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:44:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:44:08 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 05:44:08 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:44:08 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:44:09 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:44:09 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:44:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:44:09 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:44:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:44:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:44:10 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:44:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:44:10 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:44:10 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:44:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:44:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:44:12 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:44:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:44:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:44:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:44:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:44:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:44:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:44:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:44:13 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:44:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:44:14 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:44:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 05:44:14 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:44:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5818 values 91756 bits 11469 bytes 
Mon 20 Jan 2014 05:44:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 05:44:14 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:44:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568060
Mon 20 Jan 2014 05:44:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:44:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568060
Mon 20 Jan 2014 05:44:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:44:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:44:23 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:44:24 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:44:24 - job_xml_thread(): Done retrieving: data size 43568060
Mon 20 Jan 2014 05:44:24 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:44:24 - XML: Start document: iteration 6
Mon 20 Jan 2014 05:44:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:44:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:44:25 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:44:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:44:25 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:44:25 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:44:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:44:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:44:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:44:35 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 05:44:35 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:44:35 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:44:35 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:44:35 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:44:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:44:37 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:44:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:44:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:44:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:44:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:44:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:44:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:44:39 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:44:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 05:44:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:44:40 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:44:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563202
Mon 20 Jan 2014 05:44:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:44:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563202
Mon 20 Jan 2014 05:44:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:44:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:44:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:44:42 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 05:44:43 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:44:44 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:44:44 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 05:44:44 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 05:44:45 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:44:45 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 05:44:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:44:50 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:44:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:44:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:44:50 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:44:50 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:44:51 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:44:51 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:44:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:44:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:44:52 - size of cluster 'LISA Cluster': 624 hosts 79474 metrics 772881 values 12185182 bits 1523147 bytes 
Mon 20 Jan 2014 05:44:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:44:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:44:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:44:57 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:44:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:44:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:44:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:44:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:44:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:44:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:45:00 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:45:00 - job_xml_thread(): Done retrieving: data size 43559697
Mon 20 Jan 2014 05:45:00 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:45:00 - XML: Start document: iteration 7
Mon 20 Jan 2014 05:45:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559697
Mon 20 Jan 2014 05:45:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:45:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559697
Mon 20 Jan 2014 05:45:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:45:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:45:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:45:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:45:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:45:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:45:13 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:45:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:45:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:45:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:45:14 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:45:15 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:45:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:45:15 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:45:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:45:15 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:45:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:45:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 05:45:15 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:45:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6993 values 110279 bits 13784 bytes 
Mon 20 Jan 2014 05:45:15 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:45:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 05:45:21 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 05:45:21 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:45:21 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:45:21 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:45:21 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:45:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:45:24 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:45:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:45:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:45:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:45:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:45:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:45:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:45:28 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:45:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564157
Mon 20 Jan 2014 05:45:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:45:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564157
Mon 20 Jan 2014 05:45:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:45:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:45:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:45:36 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:45:36 - job_xml_thread(): Done retrieving: data size 43564157
Mon 20 Jan 2014 05:45:36 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:45:36 - XML: Start document: iteration 8
Mon 20 Jan 2014 05:45:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:45:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:45:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:45:41 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:45:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:45:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:45:42 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:45:42 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:45:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:45:42 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:45:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:45:45 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:45:45 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 05:45:48 - XML: Processed 653356 elements - found 0 jobs
Mon 20 Jan 2014 05:45:48 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:45:48 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:45:48 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:45:48 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:45:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:45:49 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:45:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:45:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:45:49 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:45:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 05:45:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:45:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:45:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:45:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:45:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:45:53 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:45:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573455
Mon 20 Jan 2014 05:45:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:45:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573455
Mon 20 Jan 2014 05:45:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:45:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:45:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:46:03 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:46:03 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:46:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:46:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:46:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:46:06 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:46:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:46:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:46:07 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:46:07 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:46:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:46:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:46:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:46:09 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:46:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:46:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:46:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:46:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:46:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:46:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:46:12 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:46:12 - job_xml_thread(): Done retrieving: data size 43576466
Mon 20 Jan 2014 05:46:12 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:46:12 - XML: Start document: iteration 9
Mon 20 Jan 2014 05:46:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576466
Mon 20 Jan 2014 05:46:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576466
Mon 20 Jan 2014 05:46:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:46:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:46:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:46:15 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:46:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:46:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 05:46:16 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:46:16 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:46:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 05:46:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9201 values 145354 bits 18169 bytes 
Mon 20 Jan 2014 05:46:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:46:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:46:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:46:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:46:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:46:28 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:46:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:46:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:46:28 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:46:28 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:46:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:46:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:46:28 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:46:30 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 05:46:30 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:46:30 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:46:30 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:46:30 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:46:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:46:36 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:46:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:46:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:46:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:46:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:46:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:46:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:46:39 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:46:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576418
Mon 20 Jan 2014 05:46:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:46:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576418
Mon 20 Jan 2014 05:46:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:46:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:46:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:46:45 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:46:45 - job_xml_thread(): Done retrieving: data size 43576418
Mon 20 Jan 2014 05:46:45 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:46:45 - XML: Start document: iteration 10
Mon 20 Jan 2014 05:46:45 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:46:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 05:46:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:46:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:46:49 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:46:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:46:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:46:51 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:46:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:46:51 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:46:51 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:46:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:46:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:46:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:46:59 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 05:46:59 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:46:59 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:46:59 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:46:59 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:47:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:47:01 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:47:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:47:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:47:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:47:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:47:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:47:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:47:05 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:47:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554479
Mon 20 Jan 2014 05:47:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:47:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:47:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:47:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554479
Mon 20 Jan 2014 05:47:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:47:14 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:47:14 - job_xml_thread(): Done retrieving: data size 43554479
Mon 20 Jan 2014 05:47:14 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:47:14 - XML: Start document: iteration 11
Mon 20 Jan 2014 05:47:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:47:17 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:47:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:47:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:47:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:47:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 05:47:19 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:47:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 05:47:20 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:47:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6120 values 96821 bits 12102 bytes 
Mon 20 Jan 2014 05:47:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:47:21 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:47:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:47:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:47:22 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:47:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:47:22 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:47:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:47:22 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:47:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:47:26 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:47:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:47:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:47:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:47:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:47:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:47:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:47:28 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 05:47:28 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:47:28 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:47:28 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:47:28 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:47:32 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:47:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43489178
Mon 20 Jan 2014 05:47:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:47:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43489178
Mon 20 Jan 2014 05:47:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:47:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:47:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:47:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:47:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:47:44 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:47:44 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:47:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:47:46 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:47:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:47:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:47:47 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:47:47 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:47:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:47:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:47:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:47:49 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:47:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:47:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:47:49 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:47:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 05:47:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:47:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:47:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:47:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:47:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:47:52 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:47:52 - job_xml_thread(): Done retrieving: data size 42946926
Mon 20 Jan 2014 05:47:52 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:47:52 - XML: Start document: iteration 12
Mon 20 Jan 2014 05:47:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42946926
Mon 20 Jan 2014 05:47:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:47:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42946926
Mon 20 Jan 2014 05:47:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:48:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:48:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:48:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:48:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:48:12 - XML: Processed 645598 elements - found 0 jobs
Mon 20 Jan 2014 05:48:12 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:48:12 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:48:12 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:48:12 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:48:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:48:15 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:48:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:48:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:48:15 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:48:15 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:48:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:48:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:48:15 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:48:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:48:16 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:48:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:48:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:48:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:48:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:48:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:48:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:48:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:48:20 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:48:20 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:48:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42984412
Mon 20 Jan 2014 05:48:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:48:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42984412
Mon 20 Jan 2014 05:48:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:48:21 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:48:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 05:48:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:48:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 05:48:22 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:48:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5656 values 89519 bits 11189 bytes 
Mon 20 Jan 2014 05:48:27 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:48:28 - job_xml_thread(): Done retrieving: data size 42984412
Mon 20 Jan 2014 05:48:28 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:48:28 - XML: Start document: iteration 13
Mon 20 Jan 2014 05:48:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:48:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:48:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:48:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:48:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:48:39 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:48:39 - XML: Processed 645908 elements - found 0 jobs
Mon 20 Jan 2014 05:48:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:48:39 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:48:39 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:48:39 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:48:39 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:48:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:48:40 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:48:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:48:40 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:48:40 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:48:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:48:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:48:42 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:48:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:48:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:48:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:48:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:48:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:48:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:48:45 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:48:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 05:48:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:48:45 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:48:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43435229
Mon 20 Jan 2014 05:48:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:48:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43435229
Mon 20 Jan 2014 05:48:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:48:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:48:53 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:48:54 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:48:54 - job_xml_thread(): Done retrieving: data size 43435229
Mon 20 Jan 2014 05:48:54 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:48:54 - XML: Start document: iteration 14
Mon 20 Jan 2014 05:48:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:48:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:48:56 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:48:56 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:48:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:48:56 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:48:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:48:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:48:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:49:03 - XML: Processed 651618 elements - found 0 jobs
Mon 20 Jan 2014 05:49:03 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:49:03 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:49:03 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:49:03 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:49:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:49:07 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:49:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:49:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:49:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:49:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:49:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:49:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:49:10 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:49:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553659
Mon 20 Jan 2014 05:49:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:49:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553659
Mon 20 Jan 2014 05:49:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:49:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:49:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:49:18 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:49:18 - job_xml_thread(): Done retrieving: data size 43553659
Mon 20 Jan 2014 05:49:18 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:49:18 - XML: Start document: iteration 15
Mon 20 Jan 2014 05:49:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:49:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:49:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:49:23 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:49:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:49:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 05:49:24 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:49:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 05:49:24 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:49:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6284 values 99169 bits 12396 bytes 
Mon 20 Jan 2014 05:49:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:49:25 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:49:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:49:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:49:25 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:49:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:49:25 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:49:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:49:25 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:49:31 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 05:49:31 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:49:31 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:49:31 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:49:31 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:49:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:49:33 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:49:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:49:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:49:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:49:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:49:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:49:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:49:37 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 05:49:37 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 05:49:37 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:49:37 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:49:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554860
Mon 20 Jan 2014 05:49:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:49:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554860
Mon 20 Jan 2014 05:49:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:49:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:49:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:49:46 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:49:47 - job_xml_thread(): Done retrieving: data size 43554860
Mon 20 Jan 2014 05:49:47 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:49:47 - XML: Start document: iteration 16
Mon 20 Jan 2014 05:49:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:49:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:49:49 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:49:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:49:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:49:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:49:50 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:49:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:49:50 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:49:50 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:49:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:49:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:49:57 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:49:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:49:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:49:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:49:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:49:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:49:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:50:00 - XML: Processed 653355 elements - found 0 jobs
Mon 20 Jan 2014 05:50:00 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:50:00 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:50:00 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:50:00 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:50:00 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:50:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 05:50:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:50:02 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:50:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43545159
Mon 20 Jan 2014 05:50:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:50:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43545159
Mon 20 Jan 2014 05:50:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:50:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:50:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:50:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:50:13 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:50:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:50:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:50:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:50:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:50:15 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:50:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:50:15 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:50:15 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:50:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:50:15 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:50:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:50:16 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:50:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:50:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:50:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:50:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:50:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:50:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:50:18 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:50:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581447
Mon 20 Jan 2014 05:50:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:50:18 - job_xml_thread(): Done retrieving: data size 43581447
Mon 20 Jan 2014 05:50:18 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:50:18 - XML: Start document: iteration 17
Mon 20 Jan 2014 05:50:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581447
Mon 20 Jan 2014 05:50:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:50:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:50:24 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:50:27 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:50:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 05:50:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:50:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 05:50:27 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:50:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9346 values 147443 bits 18430 bytes 
Mon 20 Jan 2014 05:50:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:50:30 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:50:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:50:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:50:31 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:50:31 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:50:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:50:31 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:50:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:50:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:50:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:50:37 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 05:50:37 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:50:37 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:50:37 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:50:37 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:50:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:50:40 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:50:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:50:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:50:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:50:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:50:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:50:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:50:43 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:50:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 05:50:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:50:43 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:50:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562790
Mon 20 Jan 2014 05:50:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:50:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562790
Mon 20 Jan 2014 05:50:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:50:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:50:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:50:52 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:50:52 - job_xml_thread(): Done retrieving: data size 43562790
Mon 20 Jan 2014 05:50:52 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:50:52 - XML: Start document: iteration 18
Mon 20 Jan 2014 05:50:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:50:53 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:50:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:50:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:50:55 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:50:55 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:50:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:50:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:50:55 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:50:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:50:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:51:05 - XML: Processed 653356 elements - found 0 jobs
Mon 20 Jan 2014 05:51:05 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:51:05 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:51:05 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:51:05 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:51:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:51:06 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:51:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:51:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:51:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:51:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:51:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:51:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:51:08 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:51:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559055
Mon 20 Jan 2014 05:51:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:51:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559055
Mon 20 Jan 2014 05:51:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:51:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:51:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:51:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:51:18 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:51:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:51:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:51:19 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:51:19 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:51:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:51:19 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:51:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:51:20 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:51:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:51:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:51:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:51:22 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:51:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:51:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:51:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:51:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:51:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:51:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:51:23 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:51:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43588313
Mon 20 Jan 2014 05:51:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:51:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43588313
Mon 20 Jan 2014 05:51:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:51:24 - job_xml_thread(): Done retrieving: data size 43588313
Mon 20 Jan 2014 05:51:24 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:51:24 - XML: Start document: iteration 19
Mon 20 Jan 2014 05:51:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:51:27 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:51:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:51:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 05:51:29 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:51:29 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:51:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 05:51:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9268 values 146211 bits 18276 bytes 
Mon 20 Jan 2014 05:51:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:51:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:51:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:51:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:51:42 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 05:51:43 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:51:43 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:51:43 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:51:43 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:51:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:51:44 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:51:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:51:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:51:46 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:51:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:51:46 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:51:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:51:46 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 05:51:46 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:51:46 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:51:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:51:46 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:51:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:51:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:51:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:51:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:51:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:51:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:51:47 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:51:47 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:51:47 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 05:51:47 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 05:51:47 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 05:51:48 - size of cluster 'LISA Cluster': 624 hosts 79486 metrics 788238 values 12441213 bits 1555151 bytes 
Mon 20 Jan 2014 05:51:52 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:51:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581173
Mon 20 Jan 2014 05:51:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:51:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581173
Mon 20 Jan 2014 05:51:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:51:57 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:51:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 05:51:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:51:58 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:51:58 - job_xml_thread(): Done retrieving: data size 43581173
Mon 20 Jan 2014 05:51:59 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:51:59 - XML: Start document: iteration 20
Mon 20 Jan 2014 05:52:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:52:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:52:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:52:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:52:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:52:04 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:52:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:52:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:52:05 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:52:05 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:52:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:52:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:52:05 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:52:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:52:12 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:52:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:52:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:52:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:52:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:52:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:52:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:52:13 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 05:52:13 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:52:13 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:52:13 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:52:13 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:52:16 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:52:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553217
Mon 20 Jan 2014 05:52:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:52:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553217
Mon 20 Jan 2014 05:52:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:52:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:52:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:52:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:52:27 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:52:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:52:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:52:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:52:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:52:28 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:52:28 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:52:28 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:52:28 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:52:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:52:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:52:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:52:29 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:52:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:52:29 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:52:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 05:52:29 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:52:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 05:52:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6216 values 98020 bits 12252 bytes 
Mon 20 Jan 2014 05:52:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:52:31 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:52:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:52:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:52:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:52:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:52:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:52:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:52:35 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:52:35 - job_xml_thread(): Done retrieving: data size 43569744
Mon 20 Jan 2014 05:52:35 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:52:35 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 05:52:35 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 05:52:35 - Housekeeping: done.
Mon 20 Jan 2014 05:52:35 - XML: Start document: iteration 0
Mon 20 Jan 2014 05:52:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569744
Mon 20 Jan 2014 05:52:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:52:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569744
Mon 20 Jan 2014 05:52:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:52:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:52:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:52:47 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:52:47 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 05:52:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:52:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:52:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:52:54 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:52:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:52:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:52:56 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:52:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:52:56 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:52:56 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:52:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:52:58 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:52:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 05:52:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:52:58 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 05:52:58 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:52:58 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:52:58 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:52:58 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:52:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:52:59 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:52:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:52:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:53:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:53:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:53:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:53:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:53:02 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:53:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571067
Mon 20 Jan 2014 05:53:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:53:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571067
Mon 20 Jan 2014 05:53:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:53:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:53:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:53:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:53:11 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:53:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:53:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:53:12 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:53:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:53:13 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:53:13 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:53:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:53:13 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:53:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:53:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:53:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:53:16 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:53:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:53:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:53:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:53:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:53:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:53:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:53:20 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:53:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43499557
Mon 20 Jan 2014 05:53:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:53:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43499557
Mon 20 Jan 2014 05:53:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:53:21 - job_xml_thread(): Done retrieving: data size 43499557
Mon 20 Jan 2014 05:53:21 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:53:21 - XML: Start document: iteration 1
Mon 20 Jan 2014 05:53:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:53:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:53:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:53:30 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:53:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:53:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 05:53:32 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:53:32 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:53:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 05:53:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:53:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:53:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9028 values 142385 bits 17798 bytes 
Mon 20 Jan 2014 05:53:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:53:34 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:53:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:53:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:53:35 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:53:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:53:35 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:53:35 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:53:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:53:39 - XML: Processed 652608 elements - found 0 jobs
Mon 20 Jan 2014 05:53:39 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:53:39 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:53:39 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:53:39 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:53:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:53:43 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:53:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:53:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:53:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:53:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:53:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:53:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:53:47 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:53:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42978723
Mon 20 Jan 2014 05:53:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:53:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42978723
Mon 20 Jan 2014 05:53:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:53:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:53:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:53:54 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:53:54 - job_xml_thread(): Done retrieving: data size 42978723
Mon 20 Jan 2014 05:53:54 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:53:54 - XML: Start document: iteration 2
Mon 20 Jan 2014 05:53:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:53:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:53:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:53:59 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:53:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:53:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:54:00 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:54:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:54:00 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:54:00 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:54:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:54:07 - XML: Processed 646328 elements - found 0 jobs
Mon 20 Jan 2014 05:54:07 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:54:07 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:54:07 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:54:07 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:54:07 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:54:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 05:54:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:54:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:54:11 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:54:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:54:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:54:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:54:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:54:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:54:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:54:14 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:54:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42919666
Mon 20 Jan 2014 05:54:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:54:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:54:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:54:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42919666
Mon 20 Jan 2014 05:54:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:54:23 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:54:23 - job_xml_thread(): Done retrieving: data size 42919666
Mon 20 Jan 2014 05:54:23 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:54:23 - XML: Start document: iteration 3
Mon 20 Jan 2014 05:54:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:54:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:54:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:54:28 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:54:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:54:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:54:30 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:54:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:54:30 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:54:30 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:54:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:54:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:54:32 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:54:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:54:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:54:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:54:33 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:54:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:54:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:54:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:54:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:54:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:54:33 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:54:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 05:54:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 05:54:33 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:54:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5901 values 93064 bits 11633 bytes 
Mon 20 Jan 2014 05:54:35 - XML: Processed 645458 elements - found 0 jobs
Mon 20 Jan 2014 05:54:35 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:54:35 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:54:35 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:54:35 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:54:39 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:54:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43357192
Mon 20 Jan 2014 05:54:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:54:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43357192
Mon 20 Jan 2014 05:54:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:54:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:54:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:54:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:54:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:54:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:54:50 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:54:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:54:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:54:50 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:54:50 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:54:51 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:54:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:54:51 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:54:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:54:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:54:54 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:54:54 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:54:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 05:54:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:54:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:54:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:54:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:54:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:54:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:54:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:54:58 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:54:58 - job_xml_thread(): Done retrieving: data size 43550420
Mon 20 Jan 2014 05:54:58 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:54:58 - XML: Start document: iteration 4
Mon 20 Jan 2014 05:54:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43550420
Mon 20 Jan 2014 05:54:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:54:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43550420
Mon 20 Jan 2014 05:54:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:55:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:55:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:55:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:55:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:55:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:55:14 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:55:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:55:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:55:15 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:55:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:55:15 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:55:15 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:55:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:55:17 - XML: Processed 652952 elements - found 0 jobs
Mon 20 Jan 2014 05:55:17 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:55:17 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:55:17 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:55:17 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:55:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:55:22 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:55:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:55:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:55:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:55:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:55:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:55:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:55:25 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:55:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564246
Mon 20 Jan 2014 05:55:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:55:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564246
Mon 20 Jan 2014 05:55:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:55:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:55:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:55:32 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:55:32 - job_xml_thread(): Done retrieving: data size 43564246
Mon 20 Jan 2014 05:55:32 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:55:32 - XML: Start document: iteration 5
Mon 20 Jan 2014 05:55:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:55:33 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:55:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:55:34 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:55:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 05:55:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 05:55:34 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:55:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9240 values 145763 bits 18220 bytes 
Mon 20 Jan 2014 05:55:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:55:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:55:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:55:39 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:55:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:55:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:55:40 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:55:40 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:55:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:55:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:55:40 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:55:46 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 05:55:46 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:55:46 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:55:46 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:55:46 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:55:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:55:50 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:55:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:55:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:55:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:55:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:55:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:55:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:55:53 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:55:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555706
Mon 20 Jan 2014 05:55:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:55:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555706
Mon 20 Jan 2014 05:55:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:55:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:55:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:56:01 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:56:01 - job_xml_thread(): Done retrieving: data size 43555706
Mon 20 Jan 2014 05:56:01 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:56:01 - XML: Start document: iteration 6
Mon 20 Jan 2014 05:56:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:56:03 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:56:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:56:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:56:03 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:56:04 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:56:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:56:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:56:04 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:56:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:56:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:56:15 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 05:56:15 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:56:15 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:56:15 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:56:15 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:56:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:56:16 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:56:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:56:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:56:17 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:56:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 05:56:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:56:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:56:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:56:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:56:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:56:18 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 05:56:18 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 05:56:18 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:56:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:56:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:56:19 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:56:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43541978
Mon 20 Jan 2014 05:56:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:56:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43541978
Mon 20 Jan 2014 05:56:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:56:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:56:28 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:56:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:56:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:56:29 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:56:29 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:56:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:56:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:56:29 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:56:30 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:56:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:56:31 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:56:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:56:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:56:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:56:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:56:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:56:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:56:33 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:56:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43586766
Mon 20 Jan 2014 05:56:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:56:33 - job_xml_thread(): Done retrieving: data size 43586766
Mon 20 Jan 2014 05:56:33 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:56:33 - XML: Start document: iteration 7
Mon 20 Jan 2014 05:56:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43586766
Mon 20 Jan 2014 05:56:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:56:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:56:34 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:56:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:56:36 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:56:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 05:56:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 05:56:36 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:56:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8990 values 141743 bits 17717 bytes 
Mon 20 Jan 2014 05:56:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:56:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:56:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:56:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:56:50 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 05:56:50 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:56:50 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:56:50 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:56:50 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:56:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:56:52 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:56:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:56:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:56:53 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:56:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:56:53 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:56:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:56:53 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:56:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:56:55 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:56:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:56:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:56:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:56:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:56:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:56:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:56:58 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:56:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43598195
Mon 20 Jan 2014 05:56:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:56:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43598195
Mon 20 Jan 2014 05:56:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:57:05 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:57:05 - job_xml_thread(): Done retrieving: data size 43598195
Mon 20 Jan 2014 05:57:05 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:57:05 - XML: Start document: iteration 8
Mon 20 Jan 2014 05:57:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:57:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:57:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:57:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:57:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:57:14 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:57:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:57:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:57:17 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 05:57:17 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:57:17 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:57:17 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:57:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:57:17 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:57:17 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:57:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:57:17 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:57:17 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:57:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:57:20 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:57:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:57:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:57:20 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:57:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 05:57:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:57:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:57:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:57:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:57:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:57:22 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:57:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43588080
Mon 20 Jan 2014 05:57:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:57:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43588080
Mon 20 Jan 2014 05:57:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:57:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:57:33 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:57:33 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:57:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:57:33 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:57:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:57:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:57:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:57:35 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:57:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:57:35 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:57:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:57:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:57:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:57:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:57:37 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:57:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:57:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 05:57:37 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:57:37 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:57:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 05:57:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:57:37 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:57:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6034 values 95173 bits 11896 bytes 
Mon 20 Jan 2014 05:57:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:57:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:57:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:57:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:57:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:57:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:57:40 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:57:40 - job_xml_thread(): Done retrieving: data size 43587895
Mon 20 Jan 2014 05:57:40 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:57:40 - XML: Start document: iteration 9
Mon 20 Jan 2014 05:57:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43587895
Mon 20 Jan 2014 05:57:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:57:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43587895
Mon 20 Jan 2014 05:57:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:57:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:57:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:57:52 - XML: Processed 653355 elements - found 0 jobs
Mon 20 Jan 2014 05:57:53 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:57:53 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:57:53 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:57:53 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:57:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:57:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:57:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:57:58 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:57:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:57:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:57:59 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:57:59 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:57:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:57:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:57:59 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:58:00 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:58:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 05:58:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:58:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:58:03 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:58:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:58:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:58:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:58:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:58:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:58:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:58:05 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:58:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574686
Mon 20 Jan 2014 05:58:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:58:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574686
Mon 20 Jan 2014 05:58:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:58:08 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:58:08 - job_xml_thread(): Done retrieving: data size 43574686
Mon 20 Jan 2014 05:58:08 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:58:08 - XML: Start document: iteration 10
Mon 20 Jan 2014 05:58:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:58:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:58:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:58:17 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:58:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:58:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:58:18 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:58:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:58:18 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:58:18 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:58:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:58:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:58:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:58:21 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 05:58:21 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:58:21 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:58:21 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:58:21 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:58:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:58:26 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:58:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:58:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:58:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:58:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:58:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:58:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:58:28 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:58:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568585
Mon 20 Jan 2014 05:58:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:58:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568585
Mon 20 Jan 2014 05:58:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:58:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:58:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:58:36 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:58:36 - job_xml_thread(): Done retrieving: data size 43568585
Mon 20 Jan 2014 05:58:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:58:36 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:58:36 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:58:36 - XML: Start document: iteration 11
Mon 20 Jan 2014 05:58:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:58:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:58:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:58:37 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:58:37 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:58:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:58:37 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:58:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568585
Mon 20 Jan 2014 05:58:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:58:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:58:37 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:58:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 05:58:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:58:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 05:58:37 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:58:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9245 values 145816 bits 18227 bytes 
Mon 20 Jan 2014 05:58:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:58:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:58:47 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 05:58:47 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:58:47 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:58:47 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:58:47 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 05:58:47 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 05:58:47 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 05:58:52 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 05:58:52 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:58:52 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:58:52 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:58:52 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:58:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:58:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Mon 20 Jan 2014 05:58:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:58:53 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:58:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:58:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:58:54 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:58:54 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:58:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:58:54 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:58:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:58:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:58:56 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:58:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:58:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:58:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:58:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:58:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:58:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:58:58 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:58:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 05:58:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:58:59 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:58:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43586916
Mon 20 Jan 2014 05:58:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:59:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43586916
Mon 20 Jan 2014 05:59:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:59:07 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:59:07 - job_xml_thread(): Done retrieving: data size 43586916
Mon 20 Jan 2014 05:59:07 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:59:07 - XML: Start document: iteration 12
Mon 20 Jan 2014 05:59:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:59:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:59:11 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:59:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:59:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:59:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:59:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:59:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:59:12 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:59:12 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:59:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:59:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:59:13 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:59:17 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 05:59:17 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:59:17 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:59:17 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:59:17 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:59:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:59:20 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:59:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 05:59:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:59:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:59:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:59:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:59:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:59:21 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:59:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43496114
Mon 20 Jan 2014 05:59:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:59:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43496114
Mon 20 Jan 2014 05:59:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:59:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:59:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:59:32 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 05:59:32 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 05:59:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 05:59:33 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 05:59:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 05:59:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:59:33 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:59:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 05:59:33 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:59:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 05:59:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 05:59:36 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 05:59:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:59:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:59:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:59:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:59:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 05:59:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 05:59:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:59:37 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 05:59:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:59:38 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 05:59:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 05:59:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 05:59:38 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 05:59:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6282 values 99077 bits 12384 bytes 
Mon 20 Jan 2014 05:59:38 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 05:59:38 - job_xml_thread(): Done retrieving: data size 43015408
Mon 20 Jan 2014 05:59:38 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 05:59:38 - XML: Start document: iteration 13
Mon 20 Jan 2014 05:59:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43015408
Mon 20 Jan 2014 05:59:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 05:59:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43015408
Mon 20 Jan 2014 05:59:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 05:59:47 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:59:47 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 05:59:48 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:59:48 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 05:59:48 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 05:59:48 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 05:59:48 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 05:59:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 05:59:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 05:59:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 05:59:52 - XML: Processed 646456 elements - found 0 jobs
Mon 20 Jan 2014 05:59:52 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 05:59:52 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 05:59:52 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 05:59:52 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 05:59:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:00:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:00:01 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:00:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:00:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:00:01 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:00:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:00:01 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:00:01 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:00:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:00:02 - size of cluster 'LISA Cluster': 624 hosts 79485 metrics 848128 values 13369060 bits 1671132 bytes 
Mon 20 Jan 2014 06:00:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:00:03 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:00:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:00:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:00:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:00:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:00:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:00:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:00:06 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:00:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42912501
Mon 20 Jan 2014 06:00:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:00:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42912501
Mon 20 Jan 2014 06:00:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:00:07 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:00:07 - job_xml_thread(): Done retrieving: data size 42912501
Mon 20 Jan 2014 06:00:07 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:00:07 - XML: Start document: iteration 14
Mon 20 Jan 2014 06:00:12 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:00:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 06:00:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:00:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:00:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:00:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:00:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:00:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:00:23 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:00:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:00:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:00:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:00:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:00:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:00:25 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:00:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:00:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:00:28 - XML: Processed 645158 elements - found 0 jobs
Mon 20 Jan 2014 06:00:28 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:00:28 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:00:28 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:00:28 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:00:28 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:00:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:00:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:00:29 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:00:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:00:29 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:00:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:00:31 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:00:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43299572
Mon 20 Jan 2014 06:00:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:00:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43299572
Mon 20 Jan 2014 06:00:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:00:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:00:38 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:00:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:00:38 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:00:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 06:00:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 06:00:38 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:00:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:00:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:00:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6524 values 102826 bits 12853 bytes 
Mon 20 Jan 2014 06:00:43 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:00:44 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:00:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:00:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:00:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:00:45 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:00:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:00:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:00:45 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:00:45 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:00:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:00:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:00:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:00:46 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:00:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:00:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:00:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:00:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:00:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:00:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:00:48 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:00:48 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 06:00:50 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:00:50 - job_xml_thread(): Done retrieving: data size 43513989
Mon 20 Jan 2014 06:00:50 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:00:50 - XML: Start document: iteration 15
Mon 20 Jan 2014 06:00:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43513989
Mon 20 Jan 2014 06:00:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:00:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43513989
Mon 20 Jan 2014 06:00:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:01:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:01:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:01:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:01:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:01:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:01:05 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:01:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:01:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:01:05 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:01:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:01:05 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:01:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:01:05 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:01:10 - XML: Processed 652762 elements - found 0 jobs
Mon 20 Jan 2014 06:01:10 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:01:10 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:01:10 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:01:10 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:01:13 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:01:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 06:01:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:01:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:01:14 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:01:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:01:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:01:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:01:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:01:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:01:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:01:17 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:01:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43541635
Mon 20 Jan 2014 06:01:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:01:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43541635
Mon 20 Jan 2014 06:01:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:01:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:01:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:01:25 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:01:25 - job_xml_thread(): Done retrieving: data size 43541635
Mon 20 Jan 2014 06:01:25 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:01:25 - XML: Start document: iteration 16
Mon 20 Jan 2014 06:01:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:01:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:01:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:01:30 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:01:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:01:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:01:31 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:01:31 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:01:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:01:31 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:01:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:01:36 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 06:01:36 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:01:36 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:01:36 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:01:36 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:01:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:01:38 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:01:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:01:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 06:01:39 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:01:39 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:01:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 06:01:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6048 values 95550 bits 11943 bytes 
Mon 20 Jan 2014 06:01:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:01:40 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:01:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:01:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:01:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:01:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:01:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:01:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:01:43 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:01:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553387
Mon 20 Jan 2014 06:01:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:01:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553387
Mon 20 Jan 2014 06:01:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:01:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:01:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:01:51 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:01:51 - job_xml_thread(): Done retrieving: data size 43553387
Mon 20 Jan 2014 06:01:51 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:01:51 - XML: Start document: iteration 17
Mon 20 Jan 2014 06:01:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:01:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:01:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:01:59 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:01:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:01:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:02:00 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:02:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:02:00 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:02:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:02:00 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:02:05 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 06:02:05 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:02:05 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:02:05 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:02:05 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:02:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:02:08 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:02:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:02:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:02:09 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:02:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 06:02:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:02:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:02:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:02:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:02:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:02:12 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:02:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574532
Mon 20 Jan 2014 06:02:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:02:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574532
Mon 20 Jan 2014 06:02:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:02:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:02:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:02:17 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 06:02:18 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 06:02:18 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:02:20 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:02:20 - job_xml_thread(): Done retrieving: data size 43574532
Mon 20 Jan 2014 06:02:20 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:02:20 - XML: Start document: iteration 18
Mon 20 Jan 2014 06:02:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:02:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:02:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:02:27 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:02:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:02:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:02:28 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:02:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:02:28 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:02:28 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:02:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:02:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:02:34 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:02:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:02:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:02:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:02:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:02:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:02:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:02:35 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 06:02:35 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:02:35 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:02:35 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:02:35 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:02:37 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:02:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568116
Mon 20 Jan 2014 06:02:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:02:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568116
Mon 20 Jan 2014 06:02:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:02:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:02:39 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:02:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:02:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 06:02:40 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:02:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 06:02:40 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:02:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8267 values 130681 bits 16335 bytes 
Mon 20 Jan 2014 06:02:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:02:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:02:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:02:47 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:02:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:02:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:02:48 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:02:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:02:48 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:02:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:02:48 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:02:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:02:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:02:51 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:02:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:02:52 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:02:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:02:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:02:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:02:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:02:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:02:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:02:54 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:02:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43588359
Mon 20 Jan 2014 06:02:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:02:55 - job_xml_thread(): Done retrieving: data size 43588359
Mon 20 Jan 2014 06:02:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43588359
Mon 20 Jan 2014 06:02:55 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:02:55 - XML: Start document: iteration 19
Mon 20 Jan 2014 06:02:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:03:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:03:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:03:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:03:04 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:03:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:03:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:03:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:03:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:03:08 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:03:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:03:08 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:03:08 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:03:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:03:13 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 06:03:13 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:03:13 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:03:13 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:03:13 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:03:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:03:17 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:03:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:03:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:03:18 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:03:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 06:03:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:03:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:03:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:03:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:03:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:03:19 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:03:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43549766
Mon 20 Jan 2014 06:03:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:03:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43549766
Mon 20 Jan 2014 06:03:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:03:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:03:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:03:28 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:03:29 - job_xml_thread(): Done retrieving: data size 43549766
Mon 20 Jan 2014 06:03:29 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:03:29 - XML: Start document: iteration 20
Mon 20 Jan 2014 06:03:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:03:30 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:03:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:03:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:03:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:03:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:03:34 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:03:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:03:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:03:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:03:39 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:03:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:03:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:03:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:03:40 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:03:41 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 06:03:41 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:03:41 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:03:41 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:03:41 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:03:41 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:03:41 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:03:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:03:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:03:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:03:41 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:03:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 06:03:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 06:03:41 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:03:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5572 values 87969 bits 10996 bytes 
Mon 20 Jan 2014 06:03:43 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:03:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572055
Mon 20 Jan 2014 06:03:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:03:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572055
Mon 20 Jan 2014 06:03:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:03:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:03:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:03:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:03:51 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:03:56 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:03:56 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:03:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:03:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:03:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:03:56 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:03:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:03:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:03:57 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:03:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 06:03:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:03:57 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:03:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:03:57 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:03:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:03:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:03:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:03:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:03:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:03:59 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:03:59 - job_xml_thread(): Done retrieving: data size 43588902
Mon 20 Jan 2014 06:03:59 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:03:59 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 06:03:59 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 06:03:59 - Housekeeping: done.
Mon 20 Jan 2014 06:03:59 - XML: Start document: iteration 0
Mon 20 Jan 2014 06:03:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43588902
Mon 20 Jan 2014 06:03:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43588902
Mon 20 Jan 2014 06:03:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:03:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:04:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:04:12 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:04:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:04:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:04:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:04:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:04:14 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:04:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:04:14 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:04:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:04:14 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:04:17 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 06:04:17 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:04:17 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:04:17 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:04:17 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:04:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:04:21 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:04:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:04:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:04:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:04:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:04:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:04:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:04:22 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:04:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574216
Mon 20 Jan 2014 06:04:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:04:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574216
Mon 20 Jan 2014 06:04:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:04:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:04:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:04:32 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:04:32 - job_xml_thread(): Done retrieving: data size 43574216
Mon 20 Jan 2014 06:04:32 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:04:32 - XML: Start document: iteration 1
Mon 20 Jan 2014 06:04:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:04:32 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:04:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:04:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:04:33 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:04:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:04:33 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:04:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:04:33 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:04:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:04:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:04:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:04:41 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:04:41 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 06:04:41 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:04:41 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:04:41 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:04:41 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:04:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:04:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 06:04:42 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:04:42 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:04:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 06:04:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8626 values 135971 bits 16996 bytes 
Mon 20 Jan 2014 06:04:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:04:44 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:04:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:04:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:04:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:04:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:04:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:04:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:04:47 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:04:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43544850
Mon 20 Jan 2014 06:04:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:04:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43544850
Mon 20 Jan 2014 06:04:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:04:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:04:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:04:57 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:04:57 - job_xml_thread(): Done retrieving: data size 43544850
Mon 20 Jan 2014 06:04:57 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:04:57 - XML: Start document: iteration 2
Mon 20 Jan 2014 06:04:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:04:58 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:04:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:04:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:05:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:05:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:05:00 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:05:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:05:00 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:05:00 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:05:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:05:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:05:07 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:05:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:05:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:05:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:05:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:05:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:05:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:05:07 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:05:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 06:05:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:05:09 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 06:05:09 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:05:09 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:05:09 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:05:09 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:05:11 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:05:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578775
Mon 20 Jan 2014 06:05:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:05:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578775
Mon 20 Jan 2014 06:05:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:05:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:05:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:05:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:05:18 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:05:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:05:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:05:20 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:05:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:05:20 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:05:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:05:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578775
Mon 20 Jan 2014 06:05:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:05:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:05:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:05:24 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:05:24 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:05:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:05:31 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:05:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:05:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:05:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:05:32 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:05:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:05:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:05:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:05:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:05:34 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:05:34 - job_xml_thread(): Done retrieving: data size 43395445
Mon 20 Jan 2014 06:05:34 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:05:34 - XML: Start document: iteration 3
Mon 20 Jan 2014 06:05:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43395445
Mon 20 Jan 2014 06:05:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:05:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:05:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:05:37 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:05:37 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:05:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:05:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43395445
Mon 20 Jan 2014 06:05:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:05:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:05:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:05:43 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:05:43 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:05:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 06:05:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:05:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 06:05:45 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:05:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9170 values 144610 bits 18076 bytes 
Mon 20 Jan 2014 06:05:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:05:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:05:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:05:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:05:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:05:55 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:05:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:05:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:05:57 - XML: Processed 651460 elements - found 0 jobs
Mon 20 Jan 2014 06:05:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:05:57 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:05:57 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:05:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:05:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:05:57 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:05:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:05:57 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:05:57 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:05:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:05:57 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:05:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:05:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:05:58 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:05:58 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:05:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:05:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:06:00 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:06:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42918906
Mon 20 Jan 2014 06:06:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:06:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42918906
Mon 20 Jan 2014 06:06:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:06:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:06:12 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:06:12 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:06:12 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:06:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:06:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:06:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:06:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:06:13 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:06:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:06:13 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:06:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:06:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:06:16 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:06:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:06:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:06:16 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:06:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 06:06:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:06:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:06:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:06:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:06:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:06:18 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:06:18 - job_xml_thread(): Done retrieving: data size 42961421
Mon 20 Jan 2014 06:06:18 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:06:18 - XML: Start document: iteration 4
Mon 20 Jan 2014 06:06:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42961421
Mon 20 Jan 2014 06:06:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:06:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42961421
Mon 20 Jan 2014 06:06:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:06:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:06:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:06:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:06:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:06:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:06:35 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:06:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:06:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:06:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:06:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:06:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:06:36 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:06:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:06:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:06:39 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:06:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:06:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:06:41 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:06:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:06:41 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:06:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:06:41 - XML: Processed 645890 elements - found 0 jobs
Mon 20 Jan 2014 06:06:41 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:06:41 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:06:41 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:06:41 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:06:43 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:06:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43391305
Mon 20 Jan 2014 06:06:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:06:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:06:44 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:06:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43391305
Mon 20 Jan 2014 06:06:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:06:44 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:06:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:06:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 06:06:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 06:06:45 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:06:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5393 values 84965 bits 10620 bytes 
Mon 20 Jan 2014 06:06:48 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 06:06:48 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:06:49 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:06:49 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 06:06:49 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:06:49 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 06:06:49 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 06:06:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:06:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:06:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:06:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:06:56 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:06:57 - XMLGatherer.retrieveData(): actually retrieving data..
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Mon 20 Jan 2014 06:06:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:06:58 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:06:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:06:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:07:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:07:00 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:07:00 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:07:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:07:00 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:07:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:07:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:07:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:07:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:07:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:07:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:07:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:07:02 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:07:02 - job_xml_thread(): Done retrieving: data size 43559734
Mon 20 Jan 2014 06:07:02 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:07:02 - XML: Start document: iteration 5
Mon 20 Jan 2014 06:07:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559734
Mon 20 Jan 2014 06:07:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:07:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559734
Mon 20 Jan 2014 06:07:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:07:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:07:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:07:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:07:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:07:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:07:17 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:07:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:07:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:07:20 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:07:20 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:07:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:07:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:07:20 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:07:25 - XML: Processed 653334 elements - found 0 jobs
Mon 20 Jan 2014 06:07:25 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:07:25 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:07:25 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:07:25 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:07:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:07:26 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:07:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:07:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:07:26 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:07:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 06:07:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:07:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:07:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:07:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:07:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:07:28 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:07:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576029
Mon 20 Jan 2014 06:07:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:07:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576029
Mon 20 Jan 2014 06:07:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:07:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:07:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:07:40 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:07:40 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:07:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:07:41 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:07:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:07:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:07:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:07:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:07:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:07:42 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:07:42 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:07:42 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:07:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:07:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:07:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:07:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:07:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:07:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:07:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:07:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:07:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:07:45 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:07:45 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:07:45 - job_xml_thread(): Done retrieving: data size 43580541
Mon 20 Jan 2014 06:07:45 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:07:45 - XML: Start document: iteration 6
Mon 20 Jan 2014 06:07:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580541
Mon 20 Jan 2014 06:07:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580541
Mon 20 Jan 2014 06:07:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:07:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:07:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:07:47 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:07:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 06:07:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 06:07:47 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:07:49 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:07:50 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:07:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9112 values 143697 bits 17962 bytes 
Mon 20 Jan 2014 06:07:50 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:07:50 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:07:50 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 06:07:50 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 06:07:50 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 06:07:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Mon 20 Jan 2014 06:07:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:07:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:07:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:08:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:08:01 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:08:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:08:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:08:03 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 06:08:03 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:08:03 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:08:03 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:08:03 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:08:03 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:08:03 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:08:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:08:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:08:03 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:08:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:08:06 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:08:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:08:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:08:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:08:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:08:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:08:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:08:09 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:08:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 06:08:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:08:09 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:08:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578961
Mon 20 Jan 2014 06:08:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:08:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578961
Mon 20 Jan 2014 06:08:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:08:18 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:08:18 - job_xml_thread(): Done retrieving: data size 43578961
Mon 20 Jan 2014 06:08:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:08:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:08:19 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:08:19 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:08:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:08:19 - XML: Start document: iteration 7
Mon 20 Jan 2014 06:08:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:08:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:08:20 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:08:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:08:20 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:08:20 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:08:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:08:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:08:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:08:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:08:27 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:08:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:08:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:08:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:08:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:08:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:08:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:08:30 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 06:08:30 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:08:30 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:08:30 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:08:30 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:08:31 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:08:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43543979
Mon 20 Jan 2014 06:08:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:08:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43543979
Mon 20 Jan 2014 06:08:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:08:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:08:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:08:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:08:40 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:08:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:08:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:08:42 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:08:42 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:08:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:08:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:08:42 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:08:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:08:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:08:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:08:45 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:08:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:08:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:08:45 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:08:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:08:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:08:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:08:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:08:47 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:08:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568248
Mon 20 Jan 2014 06:08:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:08:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568248
Mon 20 Jan 2014 06:08:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:08:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:08:47 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:08:48 - job_xml_thread(): Done retrieving: data size 43568248
Mon 20 Jan 2014 06:08:48 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:08:48 - XML: Start document: iteration 8
Mon 20 Jan 2014 06:08:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:08:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 06:08:49 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:08:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8822 values 139123 bits 17390 bytes 
Mon 20 Jan 2014 06:08:49 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:08:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 06:08:50 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:08:50 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:08:51 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:08:51 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 06:08:51 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:08:51 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 06:08:51 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 06:08:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:08:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:09:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:09:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:09:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:09:01 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:09:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:09:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:09:03 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:09:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:09:03 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:09:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:09:03 - XMLGatherer.retrieveData(): actually retrieving data..
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Mon 20 Jan 2014 06:09:09 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 06:09:09 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:09:09 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:09:09 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:09:09 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:09:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:09:11 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:09:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:09:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:09:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:09:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:09:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:09:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:09:14 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:09:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567304
Mon 20 Jan 2014 06:09:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:09:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567304
Mon 20 Jan 2014 06:09:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:09:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:09:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:09:24 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:09:24 - job_xml_thread(): Done retrieving: data size 43567304
Mon 20 Jan 2014 06:09:24 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:09:24 - XML: Start document: iteration 9
Mon 20 Jan 2014 06:09:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:09:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:09:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:09:30 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:09:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:09:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:09:31 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:09:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:09:31 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:09:31 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:09:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:09:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:09:32 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:09:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:09:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:09:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:09:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:09:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:09:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:09:36 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:09:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 06:09:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:09:37 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 06:09:37 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:09:37 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:09:37 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:09:37 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:09:39 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:09:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579148
Mon 20 Jan 2014 06:09:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:09:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579148
Mon 20 Jan 2014 06:09:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:09:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:09:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:09:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:09:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:09:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:09:49 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:09:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:09:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:09:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:09:50 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:09:51 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:09:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:09:51 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:09:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:09:51 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:09:51 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:09:51 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:09:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:09:52 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:09:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 06:09:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 06:09:52 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:09:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5937 values 93585 bits 11698 bytes 
Mon 20 Jan 2014 06:09:52 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:09:52 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:09:52 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 06:09:52 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 06:09:52 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:09:52 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 06:09:54 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 1098170 values 17321161 bits 2165145 bytes 
Mon 20 Jan 2014 06:09:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:09:55 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:09:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:09:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:09:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:09:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:09:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:09:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:09:59 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:09:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578509
Mon 20 Jan 2014 06:09:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:09:59 - job_xml_thread(): Done retrieving: data size 43578509
Mon 20 Jan 2014 06:09:59 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:09:59 - XML: Start document: iteration 10
Mon 20 Jan 2014 06:09:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578509
Mon 20 Jan 2014 06:10:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:10:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:10:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:10:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:10:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:10:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:10:15 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:10:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:10:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:10:15 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:10:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:10:15 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:10:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:10:15 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:10:18 - XML: Processed 653356 elements - found 0 jobs
Mon 20 Jan 2014 06:10:18 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:10:18 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:10:18 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:10:18 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:10:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:10:21 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:10:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:10:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:10:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:10:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:10:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:10:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:10:22 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:10:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 06:10:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:10:25 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:10:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571986
Mon 20 Jan 2014 06:10:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:10:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571986
Mon 20 Jan 2014 06:10:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:10:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:10:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:10:33 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:10:33 - job_xml_thread(): Done retrieving: data size 43571986
Mon 20 Jan 2014 06:10:33 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:10:33 - XML: Start document: iteration 11
Mon 20 Jan 2014 06:10:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:10:36 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:10:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:10:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:10:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:10:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:10:38 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:10:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:10:38 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:10:38 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:10:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:10:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:10:48 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:10:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:10:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:10:48 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 06:10:48 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:10:48 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:10:48 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:10:48 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:10:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:10:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:10:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:10:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:10:49 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 06:10:49 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 06:10:49 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:10:51 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:10:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554853
Mon 20 Jan 2014 06:10:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:10:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:10:52 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:10:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554853
Mon 20 Jan 2014 06:10:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:10:52 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:10:52 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 06:10:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:10:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 06:10:53 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:10:53 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:10:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 06:10:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8716 values 137394 bits 17174 bytes 
Mon 20 Jan 2014 06:10:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:10:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:11:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:11:02 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:11:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:11:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:11:03 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:11:03 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:11:03 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:11:03 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:11:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:11:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:11:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:11:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:11:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:11:07 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:11:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:11:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:11:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:11:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:11:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:11:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:11:10 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:11:10 - job_xml_thread(): Done retrieving: data size 43566034
Mon 20 Jan 2014 06:11:10 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:11:10 - XML: Start document: iteration 12
Mon 20 Jan 2014 06:11:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566034
Mon 20 Jan 2014 06:11:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566034
Mon 20 Jan 2014 06:11:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:11:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:11:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:11:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:11:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:11:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:11:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:11:25 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:11:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:11:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:11:27 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:11:27 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:11:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:11:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:11:27 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:11:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:11:34 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:11:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:11:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:11:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:11:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:11:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:11:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:11:35 - XML: Processed 653076 elements - found 0 jobs
Mon 20 Jan 2014 06:11:35 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:11:35 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:11:35 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:11:35 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:11:36 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:11:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 06:11:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:11:38 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:11:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43135893
Mon 20 Jan 2014 06:11:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:11:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43135893
Mon 20 Jan 2014 06:11:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:11:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:11:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:11:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:11:48 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:11:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:11:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:11:50 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:11:50 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:11:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:11:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:11:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:11:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:11:50 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:11:50 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:11:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:11:52 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:11:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:11:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:11:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:11:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:11:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:11:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:11:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:11:53 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:11:54 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:11:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42945669
Mon 20 Jan 2014 06:11:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:11:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42945669
Mon 20 Jan 2014 06:11:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:11:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 06:11:54 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:11:54 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:11:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:11:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 06:11:55 - job_xml_thread(): Done retrieving: data size 42945669
Mon 20 Jan 2014 06:11:55 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:11:55 - XML: Start document: iteration 13
Mon 20 Jan 2014 06:11:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6306 values 99484 bits 12435 bytes 
Mon 20 Jan 2014 06:12:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:12:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:12:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:12:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:12:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:12:08 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:12:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:12:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:12:09 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:12:09 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:12:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:12:09 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:12:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:12:15 - XML: Processed 645302 elements - found 0 jobs
Mon 20 Jan 2014 06:12:15 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:12:15 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:12:15 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:12:15 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:12:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:12:17 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:12:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:12:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:12:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:12:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:12:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:12:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:12:20 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:12:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42959984
Mon 20 Jan 2014 06:12:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:12:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42959984
Mon 20 Jan 2014 06:12:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:12:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:12:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:12:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:12:30 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:12:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:12:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:12:30 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:12:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:12:30 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:12:30 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:12:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:12:30 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:12:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:12:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:12:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:12:35 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:12:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:12:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:12:35 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:12:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 06:12:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:12:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:12:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:12:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:12:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:12:37 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:12:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43285603
Mon 20 Jan 2014 06:12:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:12:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43285603
Mon 20 Jan 2014 06:12:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:12:38 - job_xml_thread(): Done retrieving: data size 43285603
Mon 20 Jan 2014 06:12:38 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:12:38 - XML: Start document: iteration 14
Mon 20 Jan 2014 06:12:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:12:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:12:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:12:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:12:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:12:52 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:12:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:12:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:12:54 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:12:54 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:12:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:12:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:12:54 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:12:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:12:55 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:12:55 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:12:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 06:12:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:12:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 06:12:55 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:12:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5713 values 90080 bits 11260 bytes 
Mon 20 Jan 2014 06:12:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:12:59 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:12:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:12:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:12:59 - XML: Processed 649760 elements - found 0 jobs
Mon 20 Jan 2014 06:12:59 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:12:59 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:12:59 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:12:59 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:12:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:12:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:12:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:12:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:13:02 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:13:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557454
Mon 20 Jan 2014 06:13:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:13:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557454
Mon 20 Jan 2014 06:13:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:13:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:13:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:13:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:13:14 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:13:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:13:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:13:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:13:14 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:13:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:13:14 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:13:14 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:13:14 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:13:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:13:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:13:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:13:17 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:13:17 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:13:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 06:13:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:13:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:13:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:13:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:13:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:13:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:13:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:13:19 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:13:19 - job_xml_thread(): Done retrieving: data size 43571701
Mon 20 Jan 2014 06:13:19 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:13:19 - XML: Start document: iteration 15
Mon 20 Jan 2014 06:13:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571701
Mon 20 Jan 2014 06:13:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:13:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571701
Mon 20 Jan 2014 06:13:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:13:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:13:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:13:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:13:31 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:13:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:13:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:13:32 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:13:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:13:32 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:13:32 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:13:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:13:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:13:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:13:39 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 06:13:39 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:13:40 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:13:40 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:13:40 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:13:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:13:41 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:13:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:13:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:13:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:13:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:13:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:13:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:13:44 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:13:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43543217
Mon 20 Jan 2014 06:13:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:13:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43543217
Mon 20 Jan 2014 06:13:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:13:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:13:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:13:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:13:54 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:13:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:13:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:13:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:13:55 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:13:55 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:13:55 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:13:56 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:13:56 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:13:56 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:13:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:13:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 06:13:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:13:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 06:13:56 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:13:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9138 values 144133 bits 18016 bytes 
Mon 20 Jan 2014 06:13:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:13:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:13:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:13:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:13:57 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:13:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:13:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:13:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:13:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:13:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:13:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:14:01 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:14:01 - job_xml_thread(): Done retrieving: data size 43564961
Mon 20 Jan 2014 06:14:01 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:14:01 - XML: Start document: iteration 16
Mon 20 Jan 2014 06:14:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564961
Mon 20 Jan 2014 06:14:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:14:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564961
Mon 20 Jan 2014 06:14:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:14:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:14:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:14:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:14:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:14:15 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 06:14:15 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:14:15 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:14:15 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:14:15 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:14:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:14:22 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:14:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:14:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:14:24 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:14:24 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:14:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:14:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:14:24 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:14:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:14:25 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:14:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:14:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:14:25 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:14:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 06:14:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:14:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:14:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:14:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:14:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:14:27 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:14:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582248
Mon 20 Jan 2014 06:14:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:14:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582248
Mon 20 Jan 2014 06:14:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:14:30 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:14:30 - job_xml_thread(): Done retrieving: data size 43582248
Mon 20 Jan 2014 06:14:30 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:14:30 - XML: Start document: iteration 17
Mon 20 Jan 2014 06:14:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:14:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:14:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:14:40 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:14:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:14:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:14:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:14:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:14:41 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:14:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:14:41 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:14:41 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:14:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:14:47 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 06:14:47 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:14:47 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:14:47 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:14:47 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:14:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:14:50 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:14:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:14:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:14:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:14:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:14:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:14:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:14:53 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:14:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571690
Mon 20 Jan 2014 06:14:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:14:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571690
Mon 20 Jan 2014 06:14:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:14:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:14:56 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:14:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:14:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:14:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:14:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 06:14:57 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:14:57 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:14:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 06:14:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8827 values 139132 bits 17391 bytes 
Mon 20 Jan 2014 06:15:03 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:15:03 - job_xml_thread(): Done retrieving: data size 43571690
Mon 20 Jan 2014 06:15:03 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:15:03 - XML: Start document: iteration 18
Mon 20 Jan 2014 06:15:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:15:04 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:15:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:15:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:15:05 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:15:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:15:05 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:15:05 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:15:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:15:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:15:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:15:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:15:10 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:15:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:15:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:15:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:15:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:15:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:15:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:15:13 - XML: Processed 653355 elements - found 0 jobs
Mon 20 Jan 2014 06:15:13 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:15:13 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:15:13 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:15:13 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:15:16 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:15:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560168
Mon 20 Jan 2014 06:15:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:15:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560168
Mon 20 Jan 2014 06:15:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:15:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:15:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:15:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:15:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:15:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:15:27 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:15:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:15:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:15:28 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:15:28 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:15:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:15:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:15:28 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:15:28 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:15:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:15:31 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:15:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:15:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:15:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:15:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:15:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:15:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:15:33 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:15:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 06:15:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:15:35 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:15:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583410
Mon 20 Jan 2014 06:15:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:15:36 - job_xml_thread(): Done retrieving: data size 43583410
Mon 20 Jan 2014 06:15:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583410
Mon 20 Jan 2014 06:15:36 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:15:36 - XML: Start document: iteration 19
Mon 20 Jan 2014 06:15:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:15:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:15:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:15:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:15:47 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:15:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:15:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:15:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:15:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:15:47 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:15:47 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:15:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:15:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:15:47 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:15:52 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 06:15:52 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:15:52 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:15:52 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:15:52 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:15:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:15:54 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:15:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:15:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:15:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:15:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:15:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:15:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:15:56 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:15:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560551
Mon 20 Jan 2014 06:15:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:15:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560551
Mon 20 Jan 2014 06:15:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:15:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:15:57 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:15:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:15:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 06:15:59 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:15:59 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:15:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 06:15:59 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8678 values 136875 bits 17109 bytes 
Mon 20 Jan 2014 06:16:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:16:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:16:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:16:06 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:16:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:16:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:16:07 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:16:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:16:07 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:16:07 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:16:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:16:07 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:16:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:16:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:16:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:16:11 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:16:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:16:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:16:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:16:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:16:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:16:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:16:14 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:16:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567819
Mon 20 Jan 2014 06:16:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:16:14 - job_xml_thread(): Done retrieving: data size 43567819
Mon 20 Jan 2014 06:16:15 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:16:15 - XML: Start document: iteration 20
Mon 20 Jan 2014 06:16:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567819
Mon 20 Jan 2014 06:16:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:16:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:16:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:16:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:16:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:16:33 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 06:16:33 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:16:33 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:16:33 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:16:33 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:16:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:16:35 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:16:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:16:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:16:35 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:16:35 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:16:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:16:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:16:35 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:16:36 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:16:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 06:16:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:16:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:16:38 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:16:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:16:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:16:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:16:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:16:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:16:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:16:40 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:16:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43586022
Mon 20 Jan 2014 06:16:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:16:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43586022
Mon 20 Jan 2014 06:16:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:16:49 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:16:49 - job_xml_thread(): Done retrieving: data size 43586022
Mon 20 Jan 2014 06:16:49 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:16:49 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 06:16:50 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 06:16:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:16:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:16:50 - Housekeeping: done.
Mon 20 Jan 2014 06:16:51 - XML: Start document: iteration 0
Mon 20 Jan 2014 06:16:53 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 06:16:53 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:16:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:16:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:16:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:16:54 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:16:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:16:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:16:55 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:16:55 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:16:55 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 06:16:55 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 06:16:55 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 06:16:55 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:16:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:16:55 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:16:55 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:16:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Mon 20 Jan 2014 06:16:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:16:59 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:16:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:16:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:16:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:16:59 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:17:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:17:00 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:17:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:17:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 06:17:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:17:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 06:17:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:17:00 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:17:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:17:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6091 values 96279 bits 12034 bytes 
Mon 20 Jan 2014 06:17:02 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 06:17:02 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:17:02 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:17:02 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:17:02 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:17:05 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:17:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553019
Mon 20 Jan 2014 06:17:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:17:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553019
Mon 20 Jan 2014 06:17:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:17:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:17:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:17:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:17:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:17:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:17:16 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:17:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:17:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:17:16 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:17:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:17:16 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:17:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:17:16 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:17:17 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:17:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:17:21 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:17:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:17:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:17:22 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:17:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 06:17:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:17:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:17:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:17:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:17:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:17:24 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:17:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43520998
Mon 20 Jan 2014 06:17:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:17:24 - job_xml_thread(): Done retrieving: data size 43520998
Mon 20 Jan 2014 06:17:24 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:17:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43520998
Mon 20 Jan 2014 06:17:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:17:25 - XML: Start document: iteration 1
Mon 20 Jan 2014 06:17:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:17:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:17:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:17:36 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:17:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:17:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:17:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:17:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:17:38 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:17:38 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:17:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:17:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:17:38 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:17:43 - XML: Processed 652608 elements - found 0 jobs
Mon 20 Jan 2014 06:17:43 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:17:43 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:17:43 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:17:43 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:17:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:17:46 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:17:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:17:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:17:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:17:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:17:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:17:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:17:48 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:17:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42990711
Mon 20 Jan 2014 06:17:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:17:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42990711
Mon 20 Jan 2014 06:17:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:17:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:17:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:17:55 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:17:55 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:17:55 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:17:55 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 06:17:55 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:17:55 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 06:17:56 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 06:17:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:17:56 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:17:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:17:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:17:57 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:17:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:17:57 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:17:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:17:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42990711
Mon 20 Jan 2014 06:17:58 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:17:58 - job_xml_thread(): Done retrieving: data size 42990711
Mon 20 Jan 2014 06:17:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:17:58 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:17:58 - XML: Start document: iteration 2
Mon 20 Jan 2014 06:18:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:18:00 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:18:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:18:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 06:18:01 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:18:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 06:18:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:18:01 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:18:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:18:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8678 values 137206 bits 17150 bytes 
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Mon 20 Jan 2014 06:18:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:18:09 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:18:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:18:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:18:13 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:18:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:18:13 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:18:13 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:18:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:18:16 - XML: Processed 646210 elements - found 0 jobs
Mon 20 Jan 2014 06:18:16 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:18:16 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:18:16 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:18:16 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:18:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:18:17 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:18:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:18:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:18:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:18:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:18:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:18:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:18:20 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:18:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42991818
Mon 20 Jan 2014 06:18:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:18:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42991818
Mon 20 Jan 2014 06:18:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:18:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:18:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:18:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:18:30 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:18:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:18:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:18:31 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:18:31 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:18:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:18:31 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:18:31 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:18:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:18:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:18:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:18:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:18:34 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:18:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:18:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:18:34 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:18:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 06:18:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:18:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:18:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:18:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:18:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:18:36 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:18:36 - job_xml_thread(): Done retrieving: data size 43004538
Mon 20 Jan 2014 06:18:36 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:18:36 - XML: Start document: iteration 3
Mon 20 Jan 2014 06:18:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43004538
Mon 20 Jan 2014 06:18:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:18:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43004538
Mon 20 Jan 2014 06:18:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:18:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:18:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:18:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:18:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:18:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:18:51 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:18:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:18:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:18:53 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:18:53 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:18:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:18:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:18:53 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:18:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:18:56 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:18:56 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:18:56 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:18:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:18:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:18:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:18:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:18:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:18:57 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:18:57 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 06:18:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:18:57 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:18:57 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 06:18:57 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 06:18:58 - XML: Processed 645932 elements - found 0 jobs
Mon 20 Jan 2014 06:18:58 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:18:58 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:18:58 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:18:58 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:18:59 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 1118532 values 17659002 bits 2207375 bytes 
Mon 20 Jan 2014 06:19:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:19:01 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:19:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:19:02 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:19:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 06:19:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 06:19:02 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:19:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5830 values 92031 bits 11503 bytes 
Mon 20 Jan 2014 06:19:03 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:19:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567342
Mon 20 Jan 2014 06:19:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:19:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567342
Mon 20 Jan 2014 06:19:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:19:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:19:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:19:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:19:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:19:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:19:13 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:19:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:19:13 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:19:13 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:19:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:19:13 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:19:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:19:13 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:19:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:19:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:19:19 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:19:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:19:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:19:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:19:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:19:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:19:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:19:23 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:19:23 - job_xml_thread(): Done retrieving: data size 43577635
Mon 20 Jan 2014 06:19:23 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:19:23 - XML: Start document: iteration 4
Mon 20 Jan 2014 06:19:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577635
Mon 20 Jan 2014 06:19:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:19:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577635
Mon 20 Jan 2014 06:19:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:19:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:19:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:19:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:19:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:19:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:19:35 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:19:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:19:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:19:36 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:19:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:19:36 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:19:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:19:36 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:19:41 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:19:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 06:19:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:19:45 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 06:19:45 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:19:45 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:19:45 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:19:45 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:19:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:19:46 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:19:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:19:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:19:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:19:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:19:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:19:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:19:50 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:19:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43551258
Mon 20 Jan 2014 06:19:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:19:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43551258
Mon 20 Jan 2014 06:19:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:19:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:19:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:19:57 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:19:57 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 06:20:00 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:20:01 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:20:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:20:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:20:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:20:03 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:20:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:20:03 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:20:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 06:20:03 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:20:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 06:20:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6479 values 102194 bits 12774 bytes 
Mon 20 Jan 2014 06:20:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:20:05 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:20:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:20:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:20:05 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:20:05 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:20:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:20:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:20:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:20:06 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:20:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:20:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:20:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:20:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:20:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:20:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:20:10 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:20:10 - job_xml_thread(): Done retrieving: data size 43562436
Mon 20 Jan 2014 06:20:10 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:20:10 - XML: Start document: iteration 5
Mon 20 Jan 2014 06:20:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562436
Mon 20 Jan 2014 06:20:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:20:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562436
Mon 20 Jan 2014 06:20:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:20:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:20:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:20:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:20:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:20:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:20:27 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:20:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:20:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:20:28 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:20:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:20:28 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:20:28 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:20:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:20:32 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 06:20:32 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:20:32 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:20:32 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:20:32 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:20:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:20:34 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:20:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:20:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:20:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:20:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:20:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:20:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:20:35 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:20:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 06:20:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:20:37 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 06:20:37 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 06:20:37 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:20:38 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:20:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570842
Mon 20 Jan 2014 06:20:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:20:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570842
Mon 20 Jan 2014 06:20:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:20:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:20:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:20:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:20:47 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:20:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:20:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:20:47 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:20:47 - job_xml_thread(): Done retrieving: data size 43570842
Mon 20 Jan 2014 06:20:47 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:20:47 - XML: Start document: iteration 6
Mon 20 Jan 2014 06:20:48 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:20:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:20:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570842
Mon 20 Jan 2014 06:20:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:20:48 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:20:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:20:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:20:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:20:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:20:59 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:21:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:21:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:21:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:21:04 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:21:04 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:21:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:21:04 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:21:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:21:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:21:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 06:21:04 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:21:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5484 values 86458 bits 10807 bytes 
Mon 20 Jan 2014 06:21:04 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:21:04 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:21:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 06:21:06 - XML: Processed 653355 elements - found 0 jobs
Mon 20 Jan 2014 06:21:06 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:21:06 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:21:06 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:21:06 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:21:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:21:08 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:21:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:21:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:21:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:21:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:21:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:21:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:21:11 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:21:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568938
Mon 20 Jan 2014 06:21:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:21:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568938
Mon 20 Jan 2014 06:21:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:21:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:21:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:21:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:21:20 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:21:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:21:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:21:20 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:21:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:21:20 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:21:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568938
Mon 20 Jan 2014 06:21:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:21:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:21:21 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:21:22 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:21:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:21:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:21:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:21:29 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:21:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:21:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:21:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:21:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:21:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:21:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:21:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:21:32 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:21:32 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:21:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 06:21:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:21:34 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:21:34 - job_xml_thread(): Done retrieving: data size 43567999
Mon 20 Jan 2014 06:21:34 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:21:34 - XML: Start document: iteration 7
Mon 20 Jan 2014 06:21:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567999
Mon 20 Jan 2014 06:21:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:21:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:21:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:21:36 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:21:36 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:21:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:21:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:21:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567999
Mon 20 Jan 2014 06:21:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:21:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:21:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:21:48 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 06:21:48 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:21:48 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:21:48 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:21:48 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:21:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:21:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:21:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:21:52 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:21:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:21:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:21:52 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:21:52 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:21:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:21:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:21:52 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:21:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:21:55 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:21:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:21:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:21:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:21:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:21:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:21:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:21:57 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:21:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572536
Mon 20 Jan 2014 06:21:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:21:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572536
Mon 20 Jan 2014 06:21:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:22:03 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:22:03 - job_xml_thread(): Done retrieving: data size 43572536
Mon 20 Jan 2014 06:22:03 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:22:03 - XML: Start document: iteration 8
Mon 20 Jan 2014 06:22:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:22:04 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:22:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:22:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 06:22:05 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:22:05 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:22:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 06:22:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9034 values 142495 bits 17811 bytes 
Mon 20 Jan 2014 06:22:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:22:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:22:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:22:08 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:22:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:22:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:22:09 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:22:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:22:09 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:22:09 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:22:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:22:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:22:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:22:16 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 06:22:16 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:22:16 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:22:16 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:22:16 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:22:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:22:19 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:22:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:22:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:22:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:22:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:22:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:22:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:22:21 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:22:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570301
Mon 20 Jan 2014 06:22:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:22:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570301
Mon 20 Jan 2014 06:22:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:22:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:22:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:22:31 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:22:31 - job_xml_thread(): Done retrieving: data size 43570301
Mon 20 Jan 2014 06:22:31 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:22:31 - XML: Start document: iteration 9
Mon 20 Jan 2014 06:22:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:22:33 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:22:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:22:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:22:34 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:22:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:22:34 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:22:34 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:22:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:22:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:22:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:22:41 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 06:22:41 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:22:41 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:22:41 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:22:41 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:22:43 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:22:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 06:22:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:22:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:22:45 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:22:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:22:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:22:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:22:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:22:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:22:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:22:47 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:22:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557419
Mon 20 Jan 2014 06:22:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:22:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557419
Mon 20 Jan 2014 06:22:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:22:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:22:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:22:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:22:56 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:22:56 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:22:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:22:56 - job_xml_thread(): Done retrieving: data size 43557419
Mon 20 Jan 2014 06:22:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:22:57 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:22:57 - XML: Start document: iteration 10
Mon 20 Jan 2014 06:22:57 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:22:57 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:22:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:22:57 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:22:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:23:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:23:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:23:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:23:05 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:23:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:23:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 06:23:06 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:23:06 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:23:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 06:23:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5969 values 94135 bits 11766 bytes 
Mon 20 Jan 2014 06:23:07 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 06:23:07 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:23:07 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:23:07 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:23:07 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:23:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:23:09 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:23:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:23:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:23:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:23:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:23:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:23:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:23:12 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:23:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43527736
Mon 20 Jan 2014 06:23:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:23:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:23:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:23:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43527736
Mon 20 Jan 2014 06:23:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:23:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:23:22 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:23:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:23:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:23:22 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:23:23 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:23:23 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:23:23 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:23:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:23:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:23:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:23:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:23:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:23:27 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:23:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:23:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:23:27 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:23:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 06:23:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:23:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:23:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:23:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:23:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:23:29 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:23:29 - job_xml_thread(): Done retrieving: data size 43502799
Mon 20 Jan 2014 06:23:29 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:23:29 - XML: Start document: iteration 11
Mon 20 Jan 2014 06:23:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43502799
Mon 20 Jan 2014 06:23:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:23:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43502799
Mon 20 Jan 2014 06:23:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:23:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:23:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:23:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:23:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:23:47 - XML: Processed 652596 elements - found 0 jobs
Mon 20 Jan 2014 06:23:47 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:23:47 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:23:47 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:23:47 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:23:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:23:48 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:23:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:23:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:23:49 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:23:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:23:49 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:23:49 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:23:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:23:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:23:51 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:23:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:23:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:23:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:23:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:23:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:23:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:23:54 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:23:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42934709
Mon 20 Jan 2014 06:23:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:23:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42934709
Mon 20 Jan 2014 06:23:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:24:02 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:24:02 - job_xml_thread(): Done retrieving: data size 42934709
Mon 20 Jan 2014 06:24:02 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:24:02 - XML: Start document: iteration 12
Mon 20 Jan 2014 06:24:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:24:03 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:24:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:24:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:24:05 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:24:05 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:24:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:24:05 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:24:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:24:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:24:06 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:24:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:24:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 06:24:06 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:24:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8805 values 138854 bits 17356 bytes 
Mon 20 Jan 2014 06:24:06 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:24:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 06:24:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:24:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:24:12 - XML: Processed 645308 elements - found 0 jobs
Mon 20 Jan 2014 06:24:12 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:24:12 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:24:12 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:24:12 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:24:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:24:17 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:24:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:24:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:24:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:24:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:24:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:24:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:24:20 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:24:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 06:24:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:24:20 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:24:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42961416
Mon 20 Jan 2014 06:24:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:24:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42961416
Mon 20 Jan 2014 06:24:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:24:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:24:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:24:27 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:24:27 - job_xml_thread(): Done retrieving: data size 42961416
Mon 20 Jan 2014 06:24:27 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:24:27 - XML: Start document: iteration 13
Mon 20 Jan 2014 06:24:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:24:31 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:24:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:24:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:24:32 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:24:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:24:32 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:24:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:24:32 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:24:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:24:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:24:40 - XML: Processed 645908 elements - found 0 jobs
Mon 20 Jan 2014 06:24:40 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:24:40 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:24:40 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:24:40 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:24:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:24:41 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:24:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:24:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:24:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:24:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:24:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:24:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:24:43 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:24:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43439096
Mon 20 Jan 2014 06:24:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:24:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43439096
Mon 20 Jan 2014 06:24:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:24:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:24:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:24:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:24:53 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:24:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:24:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:24:55 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:24:55 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:24:55 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:24:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:24:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:24:55 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:24:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:24:57 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:24:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:24:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:24:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:24:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:24:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:24:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:24:59 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:24:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562786
Mon 20 Jan 2014 06:24:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:24:59 - job_xml_thread(): Done retrieving: data size 43562786
Mon 20 Jan 2014 06:24:59 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:24:59 - XML: Start document: iteration 14
Mon 20 Jan 2014 06:24:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562786
Mon 20 Jan 2014 06:24:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:25:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:25:07 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:25:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:25:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 06:25:08 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:25:08 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:25:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 06:25:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148574 bits 18571 bytes 
Mon 20 Jan 2014 06:25:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:25:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:25:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:25:12 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:25:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:25:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:25:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:25:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:25:13 - XML: Processed 653124 elements - found 0 jobs
Mon 20 Jan 2014 06:25:13 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:25:13 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:25:13 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:25:13 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:25:13 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:25:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:25:13 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:25:13 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:25:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:25:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:25:19 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:25:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:25:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:25:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:25:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:25:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:25:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:25:22 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:25:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 06:25:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:25:22 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:25:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570673
Mon 20 Jan 2014 06:25:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:25:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570673
Mon 20 Jan 2014 06:25:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:25:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:25:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:25:28 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:25:28 - job_xml_thread(): Done retrieving: data size 43570673
Mon 20 Jan 2014 06:25:28 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:25:28 - XML: Start document: iteration 15
Mon 20 Jan 2014 06:25:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:25:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:25:39 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 06:25:39 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:25:39 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:25:39 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:25:39 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:25:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:25:41 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:25:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:25:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:25:42 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:25:42 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:25:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:25:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:25:43 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:25:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:25:44 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:25:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:25:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:25:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:25:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:25:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:25:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:25:47 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:25:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43596689
Mon 20 Jan 2014 06:25:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:25:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43596689
Mon 20 Jan 2014 06:25:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:25:54 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:25:54 - job_xml_thread(): Done retrieving: data size 43596689
Mon 20 Jan 2014 06:25:54 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:25:54 - XML: Start document: iteration 16
Mon 20 Jan 2014 06:25:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:25:56 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:25:57 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 06:25:57 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:25:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:25:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:25:58 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:25:58 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:25:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:25:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:25:58 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:25:59 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:25:59 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 06:25:59 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 06:25:59 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:25:59 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 06:26:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:26:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:26:06 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 06:26:06 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:26:06 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:26:06 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:26:06 - job_xml_thread(): Sleeping.. (15s)
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Mon 20 Jan 2014 06:26:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:26:09 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:26:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:26:10 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:26:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 06:26:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 06:26:10 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:26:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99060 bits 12382 bytes 
Mon 20 Jan 2014 06:26:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:26:10 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:26:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:26:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:26:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:26:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:26:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:26:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:26:13 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:26:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43539827
Mon 20 Jan 2014 06:26:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:26:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:26:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:26:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43539827
Mon 20 Jan 2014 06:26:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:26:21 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:26:21 - job_xml_thread(): Done retrieving: data size 43539827
Mon 20 Jan 2014 06:26:21 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:26:21 - XML: Start document: iteration 17
Mon 20 Jan 2014 06:26:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:26:24 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:26:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:26:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:26:24 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:26:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:26:24 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:26:24 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:26:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:26:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:26:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:26:33 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 06:26:33 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:26:33 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:26:33 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:26:33 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:26:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:26:36 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:26:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:26:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:26:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:26:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:26:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:26:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:26:37 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:26:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 06:26:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:26:39 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:26:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43542892
Mon 20 Jan 2014 06:26:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:26:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43542892
Mon 20 Jan 2014 06:26:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:26:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:26:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:26:48 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:26:48 - job_xml_thread(): Done retrieving: data size 43542892
Mon 20 Jan 2014 06:26:48 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:26:48 - XML: Start document: iteration 18
Mon 20 Jan 2014 06:26:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:26:49 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:26:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:26:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:26:49 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:26:49 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:26:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:26:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:26:49 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:26:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:26:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:26:59 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:26:59 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:26:59 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:26:59 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 06:26:59 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:26:59 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 06:26:59 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 06:26:59 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 06:26:59 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:26:59 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:26:59 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:26:59 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:27:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:27:01 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:27:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:27:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:27:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:27:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:27:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:27:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:27:02 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 1068526 values 16852546 bits 2106568 bytes 
Mon 20 Jan 2014 06:27:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:27:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:27:06 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:27:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558707
Mon 20 Jan 2014 06:27:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:27:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558707
Mon 20 Jan 2014 06:27:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:27:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:27:10 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:27:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:27:10 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:27:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 06:27:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 06:27:10 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:27:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8554 values 134868 bits 16858 bytes 
Mon 20 Jan 2014 06:27:14 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:27:14 - job_xml_thread(): Done retrieving: data size 43558707
Mon 20 Jan 2014 06:27:14 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:27:14 - XML: Start document: iteration 19
Mon 20 Jan 2014 06:27:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:27:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:27:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:27:16 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:27:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:27:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:27:18 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:27:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:27:18 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:27:18 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:27:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:27:23 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 06:27:23 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:27:23 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:27:23 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:27:23 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:27:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:27:27 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:27:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:27:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:27:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:27:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:27:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:27:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:27:32 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:27:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555391
Mon 20 Jan 2014 06:27:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:27:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555391
Mon 20 Jan 2014 06:27:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:27:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:27:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:27:38 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:27:38 - job_xml_thread(): Done retrieving: data size 43555391
Mon 20 Jan 2014 06:27:38 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:27:38 - XML: Start document: iteration 20
Mon 20 Jan 2014 06:27:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:27:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:27:48 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:27:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 06:27:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:27:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:27:49 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:27:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:27:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:27:50 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:27:50 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:27:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:27:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:27:51 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:27:54 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 06:27:54 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:27:54 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:27:54 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:27:54 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:27:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:27:55 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:27:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:27:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:27:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:27:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:27:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:27:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:27:59 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:27:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570504
Mon 20 Jan 2014 06:27:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:27:59 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:28:00 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 06:28:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570504
Mon 20 Jan 2014 06:28:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:28:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:28:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:28:09 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:28:09 - job_xml_thread(): Done retrieving: data size 43570504
Mon 20 Jan 2014 06:28:09 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:28:09 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 06:28:09 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 06:28:09 - Housekeeping: done.
Mon 20 Jan 2014 06:28:09 - XML: Start document: iteration 0
Mon 20 Jan 2014 06:28:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:28:10 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:28:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:28:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:28:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:28:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:28:11 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:28:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:28:12 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:28:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:28:12 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:28:12 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:28:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:28:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:28:12 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:28:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 06:28:12 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:28:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 06:28:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6019 values 94980 bits 11872 bytes 
Mon 20 Jan 2014 06:28:19 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 06:28:19 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:28:19 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:28:19 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:28:19 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:28:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:28:23 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:28:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:28:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:28:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:28:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:28:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:28:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:28:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:28:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:28:27 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:28:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43552930
Mon 20 Jan 2014 06:28:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:28:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43552930
Mon 20 Jan 2014 06:28:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:28:34 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:28:34 - job_xml_thread(): Done retrieving: data size 43552930
Mon 20 Jan 2014 06:28:34 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:28:35 - XML: Start document: iteration 1
Mon 20 Jan 2014 06:28:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:28:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:28:45 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 06:28:45 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:28:45 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:28:45 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:28:45 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:28:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:28:47 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:28:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:28:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:28:48 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:28:48 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:28:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:28:48 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:28:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:28:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:28:50 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:28:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:28:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:28:51 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:28:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 06:28:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:28:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:28:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:28:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:28:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:28:54 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:28:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576602
Mon 20 Jan 2014 06:28:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:28:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576602
Mon 20 Jan 2014 06:28:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:29:00 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:29:00 - job_xml_thread(): Done retrieving: data size 43576602
Mon 20 Jan 2014 06:29:00 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:29:00 - XML: Start document: iteration 2
Mon 20 Jan 2014 06:29:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:29:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:29:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:29:05 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:29:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:29:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:29:06 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:29:06 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:29:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:29:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:29:06 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:29:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:29:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:29:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:29:12 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:29:13 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 06:29:13 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:29:13 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:29:13 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:29:13 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:29:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:29:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 06:29:13 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:29:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 06:29:13 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:29:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5896 values 92994 bits 11624 bytes 
Mon 20 Jan 2014 06:29:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:29:19 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:29:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:29:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:29:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:29:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:29:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:29:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:29:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:29:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:29:23 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:29:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43491933
Mon 20 Jan 2014 06:29:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:29:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43491933
Mon 20 Jan 2014 06:29:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:29:28 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:29:28 - job_xml_thread(): Done retrieving: data size 43491933
Mon 20 Jan 2014 06:29:28 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:29:28 - XML: Start document: iteration 3
Mon 20 Jan 2014 06:29:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:29:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:29:39 - XML: Processed 652608 elements - found 0 jobs
Mon 20 Jan 2014 06:29:39 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:29:39 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:29:39 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:29:39 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:29:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:29:43 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:29:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:29:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:29:44 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:29:44 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:29:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:29:44 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:29:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:29:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:29:47 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:29:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:29:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:29:48 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:29:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 06:29:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:29:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:29:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:29:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:29:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:29:51 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:29:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42994405
Mon 20 Jan 2014 06:29:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:29:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42994405
Mon 20 Jan 2014 06:29:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:29:55 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:29:55 - job_xml_thread(): Done retrieving: data size 42994405
Mon 20 Jan 2014 06:29:55 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:29:55 - XML: Start document: iteration 4
Mon 20 Jan 2014 06:29:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:29:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:30:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:30:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:30:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:30:07 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:30:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:30:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:30:08 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:30:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:30:08 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:30:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:30:08 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:30:10 - XML: Processed 645934 elements - found 0 jobs
Mon 20 Jan 2014 06:30:10 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:30:10 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:30:10 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:30:10 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:30:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:30:13 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:30:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:30:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:30:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:30:13 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:30:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:30:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 06:30:14 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:30:14 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:30:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5755 values 90724 bits 11340 bytes 
Mon 20 Jan 2014 06:30:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 06:30:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:30:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:30:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:30:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:30:17 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:30:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42974176
Mon 20 Jan 2014 06:30:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:30:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42974176
Mon 20 Jan 2014 06:30:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:30:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:30:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:30:25 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:30:25 - job_xml_thread(): Done retrieving: data size 42974176
Mon 20 Jan 2014 06:30:25 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:30:25 - XML: Start document: iteration 5
Mon 20 Jan 2014 06:30:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:30:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:30:37 - XML: Processed 645908 elements - found 0 jobs
Mon 20 Jan 2014 06:30:37 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:30:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:30:37 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:30:37 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:30:37 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:30:37 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:30:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:30:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:30:38 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:30:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:30:38 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:30:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:30:38 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:30:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:30:39 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:30:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:30:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:30:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:30:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:30:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:30:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:30:42 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:30:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 06:30:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:30:43 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:30:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43506180
Mon 20 Jan 2014 06:30:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:30:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43506180
Mon 20 Jan 2014 06:30:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:30:52 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:30:52 - job_xml_thread(): Done retrieving: data size 43506180
Mon 20 Jan 2014 06:30:52 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:30:52 - XML: Start document: iteration 6
Mon 20 Jan 2014 06:30:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:30:52 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:30:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:30:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:30:53 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:30:53 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:30:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:30:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:30:54 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:30:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:30:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:31:00 - XML: Processed 652544 elements - found 0 jobs
Mon 20 Jan 2014 06:31:00 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:31:00 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:31:00 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:31:00 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:31:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:31:04 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:31:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:31:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:31:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:31:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:31:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:31:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:31:05 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 06:31:05 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 06:31:05 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:31:06 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:31:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43551598
Mon 20 Jan 2014 06:31:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:31:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43551598
Mon 20 Jan 2014 06:31:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:31:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:31:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:31:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:31:14 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:31:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:31:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 06:31:15 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:31:15 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:31:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 06:31:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7993 values 126084 bits 15760 bytes 
Mon 20 Jan 2014 06:31:15 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:31:15 - job_xml_thread(): Done retrieving: data size 43551598
Mon 20 Jan 2014 06:31:15 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:31:15 - XML: Start document: iteration 7
Mon 20 Jan 2014 06:31:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:31:18 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:31:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:31:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:31:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:31:20 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:31:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:31:20 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:31:20 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:31:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:31:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:31:26 - XML: Processed 653282 elements - found 0 jobs
Mon 20 Jan 2014 06:31:26 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:31:26 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:31:26 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:31:26 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:31:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:31:27 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:31:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:31:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:31:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:31:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:31:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:31:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:31:30 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:31:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 06:31:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:31:30 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:31:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556508
Mon 20 Jan 2014 06:31:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:31:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556508
Mon 20 Jan 2014 06:31:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:31:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:31:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:31:41 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:31:41 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:31:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:31:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:31:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:31:44 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:31:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:31:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:31:44 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:31:44 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:31:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:31:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:31:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:31:46 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:31:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:31:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:31:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:31:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:31:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:31:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:31:48 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:31:48 - job_xml_thread(): Done retrieving: data size 43576497
Mon 20 Jan 2014 06:31:48 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:31:48 - XML: Start document: iteration 8
Mon 20 Jan 2014 06:31:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576497
Mon 20 Jan 2014 06:31:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:31:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576497
Mon 20 Jan 2014 06:31:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:32:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:32:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:32:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:32:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:32:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:32:05 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:32:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:32:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:32:06 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:32:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:32:06 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:32:06 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:32:06 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 06:32:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:32:06 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:32:06 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:32:06 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:32:06 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:32:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:32:11 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:32:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:32:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:32:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:32:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:32:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:32:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:32:12 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:32:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562184
Mon 20 Jan 2014 06:32:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:32:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562184
Mon 20 Jan 2014 06:32:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:32:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:32:15 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:32:16 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:32:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:32:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 06:32:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 06:32:17 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:32:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148997 bits 18624 bytes 
Mon 20 Jan 2014 06:32:21 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:32:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:32:21 - job_xml_thread(): Done retrieving: data size 43562184
Mon 20 Jan 2014 06:32:21 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:32:21 - XML: Start document: iteration 9
Mon 20 Jan 2014 06:32:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:32:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:32:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:32:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:32:29 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:32:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:32:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:32:30 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:32:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:32:30 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:32:30 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:32:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:32:32 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 06:32:32 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:32:32 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:32:32 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:32:32 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:32:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:32:36 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:32:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:32:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:32:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:32:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:32:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:32:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:32:38 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:32:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43585222
Mon 20 Jan 2014 06:32:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:32:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43585222
Mon 20 Jan 2014 06:32:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:32:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:32:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:32:47 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:32:47 - job_xml_thread(): Done retrieving: data size 43585222
Mon 20 Jan 2014 06:32:47 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:32:47 - XML: Start document: iteration 10
Mon 20 Jan 2014 06:32:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:32:49 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:32:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:32:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:32:50 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:32:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:32:50 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:32:50 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:32:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:32:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:32:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:32:56 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 06:32:56 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:32:56 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:32:56 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:32:56 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:33:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:33:01 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:33:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:33:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:33:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:33:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:33:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:33:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:33:01 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:33:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 06:33:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:33:03 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:33:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560010
Mon 20 Jan 2014 06:33:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:33:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560010
Mon 20 Jan 2014 06:33:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:33:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:33:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:33:12 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:33:12 - job_xml_thread(): Done retrieving: data size 43560010
Mon 20 Jan 2014 06:33:12 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:33:12 - XML: Start document: iteration 11
Mon 20 Jan 2014 06:33:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:33:15 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:33:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:33:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:33:15 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:33:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:33:15 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:33:16 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:33:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:33:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:33:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:33:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:33:17 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:33:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:33:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 06:33:17 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:33:17 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:33:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 06:33:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5826 values 92125 bits 11515 bytes 
Mon 20 Jan 2014 06:33:21 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 06:33:21 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:33:21 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:33:21 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:33:21 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:33:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:33:25 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:33:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:33:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:33:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:33:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:33:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:33:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:33:27 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:33:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43548374
Mon 20 Jan 2014 06:33:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:33:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43548374
Mon 20 Jan 2014 06:33:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:33:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:33:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:33:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:33:36 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:33:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:33:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:33:36 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:33:36 - job_xml_thread(): Done retrieving: data size 43548374
Mon 20 Jan 2014 06:33:36 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:33:36 - XML: Start document: iteration 12
Mon 20 Jan 2014 06:33:37 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:33:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:33:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43548374
Mon 20 Jan 2014 06:33:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:33:37 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:33:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:33:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:33:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:33:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:33:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:33:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:33:53 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:33:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:33:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:33:54 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:33:54 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:33:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:33:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:33:54 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:33:55 - XML: Processed 653356 elements - found 0 jobs
Mon 20 Jan 2014 06:33:55 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:33:55 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:33:55 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:33:55 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:33:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:33:57 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:33:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:33:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:33:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:33:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:33:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:33:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:33:58 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:33:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 06:33:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:33:59 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:33:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570112
Mon 20 Jan 2014 06:33:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:34:00 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 06:34:00 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:34:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570112
Mon 20 Jan 2014 06:34:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:34:01 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:34:01 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:34:01 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 06:34:01 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 06:34:02 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 06:34:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:34:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:34:10 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:34:10 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:34:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:34:11 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:34:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:34:12 - size of cluster 'LISA Cluster': 624 hosts 79467 metrics 780153 values 12323438 bits 1540429 bytes 
Mon 20 Jan 2014 06:34:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:34:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:34:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:34:13 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:34:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:34:13 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:34:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:34:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:34:15 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:34:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:34:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:34:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:34:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:34:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:34:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:34:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:34:18 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:34:18 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:34:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:34:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 06:34:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 06:34:18 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:34:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5539 values 87406 bits 10925 bytes 
Mon 20 Jan 2014 06:34:19 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:34:19 - job_xml_thread(): Done retrieving: data size 43583840
Mon 20 Jan 2014 06:34:19 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:34:19 - XML: Start document: iteration 13
Mon 20 Jan 2014 06:34:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583840
Mon 20 Jan 2014 06:34:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:34:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583840
Mon 20 Jan 2014 06:34:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:34:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:34:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:34:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:34:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:34:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:34:40 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:34:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:34:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:34:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:34:41 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:34:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:34:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:34:41 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:34:41 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:34:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:34:41 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 06:34:41 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:34:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:34:41 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:34:41 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:34:41 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:34:41 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:34:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:34:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:34:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:34:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:34:45 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:34:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584263
Mon 20 Jan 2014 06:34:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:34:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584263
Mon 20 Jan 2014 06:34:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:34:56 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:34:56 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:34:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:34:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:34:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:34:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:34:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:34:58 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:34:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:34:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:34:59 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:34:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:34:59 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:34:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:35:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:35:01 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:35:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:35:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:35:01 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:35:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 06:35:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:35:01 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:35:01 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 06:35:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:35:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:35:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:35:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:35:04 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:35:04 - job_xml_thread(): Done retrieving: data size 43572093
Mon 20 Jan 2014 06:35:04 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:35:04 - XML: Start document: iteration 14
Mon 20 Jan 2014 06:35:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572093
Mon 20 Jan 2014 06:35:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:35:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572093
Mon 20 Jan 2014 06:35:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:35:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:35:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:35:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:35:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:35:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:35:18 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:35:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:35:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 06:35:20 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:35:20 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:35:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 06:35:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6565 values 103600 bits 12950 bytes 
Mon 20 Jan 2014 06:35:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:35:24 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:35:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:35:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:35:24 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:35:24 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:35:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:35:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:35:24 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:35:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:35:25 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:35:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:35:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:35:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:35:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:35:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:35:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:35:27 - XML: Processed 653226 elements - found 0 jobs
Mon 20 Jan 2014 06:35:27 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:35:27 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:35:27 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:35:27 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:35:31 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:35:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43390058
Mon 20 Jan 2014 06:35:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:35:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43390058
Mon 20 Jan 2014 06:35:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:35:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:35:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:35:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:35:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:35:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:35:41 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:35:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:35:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:35:41 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:35:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:35:41 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:35:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:35:41 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:35:42 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:35:46 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:35:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 06:35:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:35:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:35:47 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:35:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:35:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:35:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:35:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:35:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:35:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:35:50 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:35:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42953452
Mon 20 Jan 2014 06:35:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:35:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42953452
Mon 20 Jan 2014 06:35:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:35:51 - job_xml_thread(): Done retrieving: data size 42953452
Mon 20 Jan 2014 06:35:51 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:35:51 - XML: Start document: iteration 15
Mon 20 Jan 2014 06:35:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:35:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:36:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:36:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:36:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:36:05 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:36:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:36:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:36:05 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:36:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:36:05 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:36:05 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:36:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:36:10 - XML: Processed 645684 elements - found 0 jobs
Mon 20 Jan 2014 06:36:10 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:36:10 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:36:10 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:36:10 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:36:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:36:13 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:36:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:36:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:36:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:36:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:36:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:36:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:36:17 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:36:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42951660
Mon 20 Jan 2014 06:36:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:36:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42951660
Mon 20 Jan 2014 06:36:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:36:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:36:20 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:36:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:36:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:36:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:36:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 06:36:21 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:36:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 06:36:21 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:36:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8933 values 140949 bits 17618 bytes 
Mon 20 Jan 2014 06:36:26 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:36:26 - job_xml_thread(): Done retrieving: data size 42951660
Mon 20 Jan 2014 06:36:26 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:36:26 - XML: Start document: iteration 16
Mon 20 Jan 2014 06:36:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:36:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:36:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:36:35 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:36:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:36:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:36:36 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:36:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:36:36 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:36:36 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:36:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:36:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:36:37 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:36:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:36:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:36:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:36:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:36:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:36:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:36:40 - XML: Processed 645846 elements - found 0 jobs
Mon 20 Jan 2014 06:36:40 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:36:40 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:36:40 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:36:40 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:36:44 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:36:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43463761
Mon 20 Jan 2014 06:36:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:36:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43463761
Mon 20 Jan 2014 06:36:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:36:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:36:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:36:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:36:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:36:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:36:55 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:36:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:36:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:36:55 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:36:55 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:36:55 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:36:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:36:55 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:36:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:37:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:37:00 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:37:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:37:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:37:00 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:37:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 06:37:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:37:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:37:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:37:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:37:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:37:04 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:37:04 - job_xml_thread(): Done retrieving: data size 43569570
Mon 20 Jan 2014 06:37:04 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:37:04 - XML: Start document: iteration 17
Mon 20 Jan 2014 06:37:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569570
Mon 20 Jan 2014 06:37:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569570
Mon 20 Jan 2014 06:37:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:37:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:37:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:37:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:37:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:37:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:37:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:37:18 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:37:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:37:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:37:19 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:37:19 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:37:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:37:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:37:19 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:37:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:37:21 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:37:22 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 06:37:22 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:37:22 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:37:22 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:37:22 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:37:22 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:37:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 06:37:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:37:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 06:37:22 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:37:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5787 values 91300 bits 11412 bytes 
Mon 20 Jan 2014 06:37:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:37:27 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:37:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:37:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:37:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:37:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:37:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:37:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:37:31 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:37:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43547283
Mon 20 Jan 2014 06:37:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:37:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43547283
Mon 20 Jan 2014 06:37:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:37:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:37:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:37:37 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:37:37 - job_xml_thread(): Done retrieving: data size 43547283
Mon 20 Jan 2014 06:37:37 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:37:37 - XML: Start document: iteration 18
Mon 20 Jan 2014 06:37:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:37:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:37:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:37:52 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:37:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:37:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:37:52 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:37:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 06:37:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:37:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:37:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:37:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:37:54 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:37:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:37:54 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 06:37:54 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:37:54 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:37:54 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:37:54 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:37:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:37:55 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:37:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:37:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:37:55 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:37:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:37:55 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:37:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:37:58 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:37:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571666
Mon 20 Jan 2014 06:37:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:37:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571666
Mon 20 Jan 2014 06:37:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:38:09 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:38:09 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:38:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:38:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:38:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:38:10 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:38:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:38:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:38:12 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:38:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:38:12 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:38:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:38:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:38:13 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:38:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:38:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:38:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:38:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:38:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:38:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:38:16 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 06:38:16 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 06:38:16 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:38:17 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:38:17 - job_xml_thread(): Done retrieving: data size 43571502
Mon 20 Jan 2014 06:38:17 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:38:17 - XML: Start document: iteration 19
Mon 20 Jan 2014 06:38:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571502
Mon 20 Jan 2014 06:38:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:38:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571502
Mon 20 Jan 2014 06:38:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:38:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:38:22 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:38:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:38:23 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:38:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 06:38:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 06:38:23 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:38:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8831 values 139245 bits 17405 bytes 
Mon 20 Jan 2014 06:38:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:38:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:38:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:38:27 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:38:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:38:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:38:27 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:38:27 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:38:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:38:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:38:27 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:38:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:38:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:38:32 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 06:38:32 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:38:32 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:38:32 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:38:32 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:38:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:38:37 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:38:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:38:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:38:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:38:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:38:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:38:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:38:39 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:38:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567966
Mon 20 Jan 2014 06:38:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:38:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567966
Mon 20 Jan 2014 06:38:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:38:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:38:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:38:48 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:38:48 - job_xml_thread(): Done retrieving: data size 43567966
Mon 20 Jan 2014 06:38:48 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:38:48 - XML: Start document: iteration 20
Mon 20 Jan 2014 06:38:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:38:50 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:38:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:38:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:38:50 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:38:50 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:38:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:38:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:38:50 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:38:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:38:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:38:59 - XML: Processed 653357 elements - found 0 jobs
Mon 20 Jan 2014 06:38:59 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:38:59 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:38:59 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:38:59 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:39:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:39:02 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:39:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:39:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:39:03 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:39:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 06:39:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:39:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:39:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:39:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:39:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:39:04 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:39:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563960
Mon 20 Jan 2014 06:39:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:39:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563960
Mon 20 Jan 2014 06:39:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:39:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:39:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:39:14 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:39:14 - job_xml_thread(): Done retrieving: data size 43563960
Mon 20 Jan 2014 06:39:14 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:39:14 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 06:39:15 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 06:39:15 - Housekeeping: done.
Mon 20 Jan 2014 06:39:15 - XML: Start document: iteration 0
Mon 20 Jan 2014 06:39:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:39:16 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:39:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:39:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:39:17 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:39:17 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:39:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:39:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:39:17 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:39:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:39:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:39:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:39:23 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:39:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:39:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 06:39:23 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:39:23 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:39:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 06:39:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5578 values 87885 bits 10985 bytes 
Mon 20 Jan 2014 06:39:27 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 06:39:27 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:39:27 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:39:27 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:39:27 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:39:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:39:28 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:39:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:39:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:39:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:39:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:39:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:39:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:39:30 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:39:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43543190
Mon 20 Jan 2014 06:39:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:39:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43543190
Mon 20 Jan 2014 06:39:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:39:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:39:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:39:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:39:41 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:39:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:39:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:39:41 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:39:41 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:39:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:39:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:39:41 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:39:42 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:39:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:39:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:39:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:39:46 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:39:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:39:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:39:46 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:39:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 06:39:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:39:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:39:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:39:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:39:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:39:47 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:39:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575386
Mon 20 Jan 2014 06:39:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:39:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575386
Mon 20 Jan 2014 06:39:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:39:48 - job_xml_thread(): Done retrieving: data size 43575386
Mon 20 Jan 2014 06:39:48 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:39:48 - XML: Start document: iteration 1
Mon 20 Jan 2014 06:39:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:39:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:39:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:39:58 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:39:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:39:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:39:59 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:39:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:39:59 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:39:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:39:59 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:40:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:40:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:40:08 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 06:40:08 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:40:09 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:40:09 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:40:09 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:40:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:40:09 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:40:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:40:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:40:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:40:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:40:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:40:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:40:11 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:40:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43551572
Mon 20 Jan 2014 06:40:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:40:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43551572
Mon 20 Jan 2014 06:40:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:40:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:40:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:40:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:40:21 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:40:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:40:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:40:21 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:40:21 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:40:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:40:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:40:21 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:40:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:40:23 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:40:24 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:40:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:40:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 06:40:24 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:40:24 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:40:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 06:40:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8769 values 138231 bits 17278 bytes 
Mon 20 Jan 2014 06:40:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:40:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:40:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:40:26 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:40:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:40:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:40:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:40:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:40:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:40:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:40:28 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:40:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 06:40:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:40:28 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:40:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554714
Mon 20 Jan 2014 06:40:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:40:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554714
Mon 20 Jan 2014 06:40:28 - job_xml_thread(): Done retrieving: data size 43554714
Mon 20 Jan 2014 06:40:28 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:40:28 - XML: Start document: iteration 2
Mon 20 Jan 2014 06:40:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:40:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:40:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:40:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:40:40 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:40:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:40:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:40:41 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:40:41 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:40:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:40:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:40:41 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:40:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:40:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:40:46 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 06:40:46 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:40:46 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:40:46 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:40:46 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:40:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:40:50 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:40:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:40:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:40:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:40:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:40:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:40:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:40:52 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:40:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573770
Mon 20 Jan 2014 06:40:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:40:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573770
Mon 20 Jan 2014 06:40:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:40:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:40:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:41:01 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:41:01 - job_xml_thread(): Done retrieving: data size 43573770
Mon 20 Jan 2014 06:41:01 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:41:01 - XML: Start document: iteration 3
Mon 20 Jan 2014 06:41:02 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 06:41:02 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:41:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:41:02 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:41:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:41:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:41:03 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:41:03 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 06:41:03 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:41:03 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 06:41:03 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 06:41:04 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:41:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:41:04 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:41:04 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:41:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:41:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:41:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:41:11 - size of cluster 'LISA Cluster': 624 hosts 79468 metrics 775214 values 12221591 bits 1527698 bytes 
Mon 20 Jan 2014 06:41:15 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 06:41:15 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:41:15 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:41:15 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:41:15 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:41:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:41:17 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:41:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:41:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:41:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:41:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:41:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:41:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:41:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:41:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:41:20 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:41:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43483629
Mon 20 Jan 2014 06:41:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:41:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43483629
Mon 20 Jan 2014 06:41:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:41:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:41:24 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:41:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:41:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 06:41:25 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:41:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9268 values 146175 bits 18271 bytes 
Mon 20 Jan 2014 06:41:25 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:41:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 06:41:30 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:41:30 - job_xml_thread(): Done retrieving: data size 43483629
Mon 20 Jan 2014 06:41:30 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:41:30 - XML: Start document: iteration 4
Mon 20 Jan 2014 06:41:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:41:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:41:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:41:32 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:41:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:41:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:41:33 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:41:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:41:33 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:41:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:41:33 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:41:43 - XML: Processed 652608 elements - found 0 jobs
Mon 20 Jan 2014 06:41:43 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:41:43 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:41:43 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:41:43 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:41:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:41:45 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:41:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:41:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:41:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:41:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:41:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:41:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:41:48 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:41:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43004974
Mon 20 Jan 2014 06:41:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:41:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43004974
Mon 20 Jan 2014 06:41:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:41:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:41:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:41:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:41:55 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:41:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:41:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:41:56 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:41:56 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:41:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:41:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:41:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43004974
Mon 20 Jan 2014 06:41:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:41:58 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:41:58 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:42:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:42:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:42:03 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:42:03 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 06:42:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:42:06 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:42:07 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:42:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 06:42:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:42:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:42:08 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:42:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:42:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:42:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:42:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:42:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:42:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:42:11 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:42:11 - job_xml_thread(): Done retrieving: data size 42937123
Mon 20 Jan 2014 06:42:11 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:42:11 - XML: Start document: iteration 5
Mon 20 Jan 2014 06:42:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:42:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:42:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42937123
Mon 20 Jan 2014 06:42:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:42:12 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:42:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:42:12 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:42:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:42:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42937123
Mon 20 Jan 2014 06:42:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:42:21 - XML: Processed 645742 elements - found 0 jobs
Mon 20 Jan 2014 06:42:22 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:42:22 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:42:22 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:42:22 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:42:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:42:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:42:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:42:26 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:42:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:42:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 06:42:27 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:42:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 06:42:27 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:42:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6116 values 96471 bits 12058 bytes 
Mon 20 Jan 2014 06:42:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:42:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:42:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:42:31 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:42:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:42:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:42:32 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:42:32 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:42:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:42:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:42:32 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:42:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:42:34 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:42:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:42:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:42:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:42:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:42:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:42:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:42:37 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:42:38 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:42:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43077015
Mon 20 Jan 2014 06:42:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:42:39 - job_xml_thread(): Done retrieving: data size 43077015
Mon 20 Jan 2014 06:42:39 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:42:39 - XML: Start document: iteration 6
Mon 20 Jan 2014 06:42:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43077015
Mon 20 Jan 2014 06:42:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:42:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:42:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:42:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:42:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:42:52 - XML: Processed 646980 elements - found 0 jobs
Mon 20 Jan 2014 06:42:52 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:42:52 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:42:52 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:42:52 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:42:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:42:57 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:42:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:42:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:42:57 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:42:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:42:57 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:42:58 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:42:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:42:59 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:42:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 06:42:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:43:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:43:02 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:43:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:43:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:43:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:43:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:43:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:43:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:43:05 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:43:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583831
Mon 20 Jan 2014 06:43:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:43:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583831
Mon 20 Jan 2014 06:43:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:43:08 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:43:08 - job_xml_thread(): Done retrieving: data size 43583831
Mon 20 Jan 2014 06:43:08 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:43:08 - XML: Start document: iteration 7
Mon 20 Jan 2014 06:43:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:43:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:43:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:43:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:43:19 - XML: Processed 653318 elements - found 0 jobs
Mon 20 Jan 2014 06:43:19 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:43:19 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:43:19 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:43:19 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:43:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:43:25 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:43:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:43:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:43:26 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:43:26 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:43:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:43:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:43:26 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:43:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:43:27 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:43:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:43:28 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:43:28 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:43:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 06:43:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:43:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 06:43:28 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:43:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5866 values 92506 bits 11563 bytes 
Mon 20 Jan 2014 06:43:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:43:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:43:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:43:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:43:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:43:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:43:31 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:43:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574954
Mon 20 Jan 2014 06:43:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:43:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574954
Mon 20 Jan 2014 06:43:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:43:34 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:43:34 - job_xml_thread(): Done retrieving: data size 43574954
Mon 20 Jan 2014 06:43:34 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:43:34 - XML: Start document: iteration 8
Mon 20 Jan 2014 06:43:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:43:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:43:43 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:43:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 06:43:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:43:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:43:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:43:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:43:49 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:43:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:43:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:43:50 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:43:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:43:50 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:43:50 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:43:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:43:54 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 06:43:54 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:43:54 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:43:54 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:43:54 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:43:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:43:55 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:43:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:43:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:43:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:43:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:43:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:43:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:43:59 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:43:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557332
Mon 20 Jan 2014 06:43:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:43:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557332
Mon 20 Jan 2014 06:43:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:44:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:44:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:44:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:44:09 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:44:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:44:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:44:09 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:44:09 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:44:10 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:44:10 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:44:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:44:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:44:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:44:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:44:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:44:14 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:44:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:44:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:44:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:44:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:44:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:44:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:44:18 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:44:18 - job_xml_thread(): Done retrieving: data size 43574382
Mon 20 Jan 2014 06:44:18 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:44:18 - XML: Start document: iteration 9
Mon 20 Jan 2014 06:44:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574382
Mon 20 Jan 2014 06:44:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:44:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574382
Mon 20 Jan 2014 06:44:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:44:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:44:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:44:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:44:28 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:44:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:44:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:44:29 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:44:29 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:44:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 06:44:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 06:44:29 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:44:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9284 values 146392 bits 18299 bytes 
Mon 20 Jan 2014 06:44:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:44:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:44:30 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:44:30 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:44:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:44:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:44:30 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:44:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:44:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:44:37 - XML: Processed 653355 elements - found 0 jobs
Mon 20 Jan 2014 06:44:37 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:44:37 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:44:37 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:44:37 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:44:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:44:42 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:44:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:44:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:44:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:44:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:44:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:44:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:44:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:44:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:44:46 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:44:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43548126
Mon 20 Jan 2014 06:44:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:44:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43548126
Mon 20 Jan 2014 06:44:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:44:52 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:44:52 - job_xml_thread(): Done retrieving: data size 43548126
Mon 20 Jan 2014 06:44:52 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:44:52 - XML: Start document: iteration 10
Mon 20 Jan 2014 06:44:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:44:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:44:59 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:44:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 06:44:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:45:04 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 06:45:04 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:45:04 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:45:04 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:45:04 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:45:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:45:04 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:45:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:45:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:45:04 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:45:04 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:45:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:45:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:45:04 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:45:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:45:07 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:45:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:45:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:45:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:45:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:45:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:45:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:45:11 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 06:45:11 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 06:45:11 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:45:11 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:45:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561974
Mon 20 Jan 2014 06:45:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:45:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561974
Mon 20 Jan 2014 06:45:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:45:19 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:45:19 - job_xml_thread(): Done retrieving: data size 43561974
Mon 20 Jan 2014 06:45:19 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:45:19 - XML: Start document: iteration 11
Mon 20 Jan 2014 06:45:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:45:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:45:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:45:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:45:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:45:28 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:45:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:45:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:45:29 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:45:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:45:29 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:45:29 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:45:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:45:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:45:29 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:45:30 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:45:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 06:45:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:45:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 06:45:30 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:45:31 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 06:45:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6164 values 97183 bits 12147 bytes 
Mon 20 Jan 2014 06:45:31 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:45:31 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:45:31 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:45:31 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:45:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:45:34 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:45:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:45:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:45:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:45:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:45:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:45:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:45:36 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:45:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 06:45:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:45:37 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:45:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579562
Mon 20 Jan 2014 06:45:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:45:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579562
Mon 20 Jan 2014 06:45:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:45:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:45:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:45:46 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:45:46 - job_xml_thread(): Done retrieving: data size 43579562
Mon 20 Jan 2014 06:45:46 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:45:46 - XML: Start document: iteration 12
Mon 20 Jan 2014 06:45:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:45:49 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:45:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:45:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:45:50 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:45:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:45:50 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:45:50 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:45:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:45:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:45:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:45:58 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 06:45:58 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:45:58 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:45:58 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:45:58 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:46:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:46:00 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:46:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:46:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:46:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:46:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:46:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:46:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:46:01 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:46:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563409
Mon 20 Jan 2014 06:46:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:46:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563409
Mon 20 Jan 2014 06:46:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:46:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:46:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:46:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:46:12 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:46:13 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:46:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:46:13 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:46:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:46:13 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:46:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:46:13 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:46:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:46:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:46:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:46:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:46:16 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:46:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:46:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:46:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:46:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:46:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:46:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:46:18 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:46:18 - job_xml_thread(): Done retrieving: data size 43594868
Mon 20 Jan 2014 06:46:18 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:46:18 - XML: Start document: iteration 13
Mon 20 Jan 2014 06:46:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43594868
Mon 20 Jan 2014 06:46:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43594868
Mon 20 Jan 2014 06:46:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:46:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:46:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:46:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:46:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:46:30 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:46:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:46:31 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:46:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:46:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:46:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:46:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:46:32 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:46:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:46:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 06:46:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 06:46:32 - XML: Processed 653355 elements - found 0 jobs
Mon 20 Jan 2014 06:46:32 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:46:32 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:46:32 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:46:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148712 bits 18589 bytes 
Mon 20 Jan 2014 06:46:32 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:46:32 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:46:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:46:32 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:46:32 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:46:32 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:46:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:46:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:46:37 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:46:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:46:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:46:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:46:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:46:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:46:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:46:39 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:46:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559347
Mon 20 Jan 2014 06:46:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:46:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559347
Mon 20 Jan 2014 06:46:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:46:47 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:46:47 - job_xml_thread(): Done retrieving: data size 43559347
Mon 20 Jan 2014 06:46:47 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:46:47 - XML: Start document: iteration 14
Mon 20 Jan 2014 06:46:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:46:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:46:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:46:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:46:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:46:55 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:46:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:46:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:46:55 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:46:55 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:46:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:46:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:46:55 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:47:00 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 06:47:00 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:47:00 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:47:00 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:47:00 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:47:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:47:02 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:47:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:47:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:47:02 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:47:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 06:47:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:47:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:47:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:47:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:47:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:47:04 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:47:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43592301
Mon 20 Jan 2014 06:47:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:47:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43592301
Mon 20 Jan 2014 06:47:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:47:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:47:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:47:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:47:14 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:47:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:47:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:47:15 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:47:15 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:47:15 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:47:15 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:47:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:47:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:47:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:47:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:47:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:47:19 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:47:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:47:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:47:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:47:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:47:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:47:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:47:20 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:47:20 - job_xml_thread(): Done retrieving: data size 43534955
Mon 20 Jan 2014 06:47:20 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:47:20 - XML: Start document: iteration 15
Mon 20 Jan 2014 06:47:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43534955
Mon 20 Jan 2014 06:47:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:47:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43534955
Mon 20 Jan 2014 06:47:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:47:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:47:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:47:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:47:33 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:47:34 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:47:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 06:47:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:47:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 06:47:34 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:47:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:47:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:47:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9016 values 142657 bits 17832 bytes 
Mon 20 Jan 2014 06:47:37 - XML: Processed 652607 elements - found 0 jobs
Mon 20 Jan 2014 06:47:37 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:47:37 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:47:37 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:47:37 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:47:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:47:39 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:47:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:47:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:47:40 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:47:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:47:40 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:47:40 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:47:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:47:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:47:43 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:47:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:47:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:47:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:47:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:47:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:47:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:47:45 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:47:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42974019
Mon 20 Jan 2014 06:47:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:47:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42974019
Mon 20 Jan 2014 06:47:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:47:53 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:47:53 - job_xml_thread(): Done retrieving: data size 42974019
Mon 20 Jan 2014 06:47:53 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:47:53 - XML: Start document: iteration 16
Mon 20 Jan 2014 06:47:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:47:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:47:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:47:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:48:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:48:01 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:48:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:48:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:48:02 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:48:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:48:02 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:48:02 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:48:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:48:03 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 06:48:03 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:48:05 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:48:05 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 06:48:05 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 06:48:05 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:48:05 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 06:48:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:48:05 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:48:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:48:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:48:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:48:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:48:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:48:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:48:07 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:48:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 06:48:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:48:09 - XML: Processed 645864 elements - found 0 jobs
Mon 20 Jan 2014 06:48:09 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:48:09 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:48:09 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:48:09 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:48:09 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 825068 values 13025151 bits 1628143 bytes 
Mon 20 Jan 2014 06:48:12 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:48:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42948641
Mon 20 Jan 2014 06:48:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:48:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42948641
Mon 20 Jan 2014 06:48:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:48:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:48:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:48:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:48:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:48:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:48:22 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:48:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:48:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:48:23 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:48:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:48:23 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:48:23 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:48:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:48:24 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:48:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:48:26 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:48:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:48:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:48:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:48:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:48:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:48:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:48:29 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:48:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42976954
Mon 20 Jan 2014 06:48:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:48:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42976954
Mon 20 Jan 2014 06:48:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:48:30 - job_xml_thread(): Done retrieving: data size 42976954
Mon 20 Jan 2014 06:48:30 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:48:30 - XML: Start document: iteration 17
Mon 20 Jan 2014 06:48:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:48:35 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:48:36 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:48:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:48:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 06:48:36 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:48:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 06:48:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8977 values 141837 bits 17729 bytes 
Mon 20 Jan 2014 06:48:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:48:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:48:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:48:41 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:48:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:48:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:48:41 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:48:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:48:41 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:48:41 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:48:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:48:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:48:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:48:48 - XML: Processed 645916 elements - found 0 jobs
Mon 20 Jan 2014 06:48:48 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:48:48 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:48:48 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:48:48 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:48:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:48:52 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:48:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:48:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:48:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:48:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:48:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:48:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:48:55 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:48:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43523713
Mon 20 Jan 2014 06:48:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:48:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43523713
Mon 20 Jan 2014 06:48:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:48:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:48:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:49:03 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:49:03 - job_xml_thread(): Done retrieving: data size 43523713
Mon 20 Jan 2014 06:49:03 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:49:03 - XML: Start document: iteration 18
Mon 20 Jan 2014 06:49:05 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:49:05 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 06:49:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:49:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:49:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:49:09 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:49:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:49:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:49:11 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:49:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:49:11 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:49:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:49:11 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:49:18 - XML: Processed 653052 elements - found 0 jobs
Mon 20 Jan 2014 06:49:18 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:49:18 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:49:18 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:49:18 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:49:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:49:20 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:49:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:49:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:49:20 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:49:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 06:49:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:49:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:49:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:49:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:49:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:49:22 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:49:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564003
Mon 20 Jan 2014 06:49:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:49:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564003
Mon 20 Jan 2014 06:49:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:49:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:49:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:49:34 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:49:34 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:49:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:49:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:49:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:49:36 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:49:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:49:36 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:49:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:49:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:49:37 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:49:37 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:49:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:49:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:49:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:49:38 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:49:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 06:49:38 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:49:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5782 values 91217 bits 11402 bytes 
Mon 20 Jan 2014 06:49:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 06:49:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:49:38 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:49:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:49:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:49:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:49:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:49:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:49:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:49:41 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:49:41 - job_xml_thread(): Done retrieving: data size 43557879
Mon 20 Jan 2014 06:49:41 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:49:41 - XML: Start document: iteration 19
Mon 20 Jan 2014 06:49:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557879
Mon 20 Jan 2014 06:49:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:49:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557879
Mon 20 Jan 2014 06:49:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:49:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:49:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:49:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:49:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:49:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:49:55 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:49:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:49:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:49:57 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:49:57 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:49:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:49:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:49:57 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:50:03 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 06:50:03 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:50:03 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:50:03 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:50:03 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:50:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:50:06 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:50:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:50:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:50:06 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:50:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 06:50:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:50:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:50:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:50:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:50:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:50:08 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:50:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556366
Mon 20 Jan 2014 06:50:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:50:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556366
Mon 20 Jan 2014 06:50:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:50:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:50:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:50:18 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:50:18 - job_xml_thread(): Done retrieving: data size 43556366
Mon 20 Jan 2014 06:50:19 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:50:19 - XML: Start document: iteration 20
Mon 20 Jan 2014 06:50:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:50:20 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:50:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:50:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:50:22 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:50:22 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:50:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:50:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:50:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:50:22 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:50:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:50:31 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 06:50:31 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:50:32 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:50:32 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:50:32 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:50:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:50:33 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:50:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:50:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:50:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:50:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:50:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:50:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:50:36 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:50:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568719
Mon 20 Jan 2014 06:50:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:50:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568719
Mon 20 Jan 2014 06:50:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:50:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:50:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:50:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:50:38 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:50:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:50:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 06:50:39 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:50:39 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:50:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 06:50:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8741 values 137831 bits 17228 bytes 
Mon 20 Jan 2014 06:50:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:50:44 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:50:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:50:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:50:45 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:50:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:50:45 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:50:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568719
Mon 20 Jan 2014 06:50:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:50:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:50:47 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:50:47 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:50:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:50:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:50:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:50:54 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:50:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:50:58 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:50:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:50:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:50:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:50:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:50:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:50:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:51:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:51:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:51:01 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:51:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:51:01 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:51:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:51:01 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:51:01 - job_xml_thread(): Done retrieving: data size 43550775
Mon 20 Jan 2014 06:51:01 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:51:01 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 06:51:01 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 06:51:01 - Housekeeping: done.
Mon 20 Jan 2014 06:51:01 - XML: Start document: iteration 0
Mon 20 Jan 2014 06:51:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43550775
Mon 20 Jan 2014 06:51:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:51:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43550775
Mon 20 Jan 2014 06:51:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:51:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:51:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:51:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:51:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:51:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:51:22 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:51:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:51:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:51:23 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 06:51:23 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:51:23 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:51:23 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:51:23 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:51:23 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:51:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:51:24 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:51:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:51:24 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:51:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:51:25 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:51:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:51:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:51:26 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:51:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 06:51:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:51:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:51:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:51:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:51:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:51:29 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:51:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575021
Mon 20 Jan 2014 06:51:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:51:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575021
Mon 20 Jan 2014 06:51:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:51:38 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:51:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:51:39 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:51:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:51:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:51:40 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:51:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:51:41 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:51:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:51:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:51:41 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:51:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 06:51:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:51:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 06:51:41 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:51:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5853 values 92315 bits 11539 bytes 
Mon 20 Jan 2014 06:51:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:51:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:51:43 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:51:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:51:43 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:51:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:51:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:51:44 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:51:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:51:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:51:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:51:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:51:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:51:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:51:48 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:51:48 - job_xml_thread(): Done retrieving: data size 43578973
Mon 20 Jan 2014 06:51:48 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:51:48 - XML: Start document: iteration 1
Mon 20 Jan 2014 06:51:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578973
Mon 20 Jan 2014 06:51:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:51:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578973
Mon 20 Jan 2014 06:51:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:51:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:51:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:51:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:51:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:52:03 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 06:52:03 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:52:04 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:52:04 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:52:04 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:52:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:52:10 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:52:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:52:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:52:10 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:52:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:52:10 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:52:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:52:10 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:52:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:52:11 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:52:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:52:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:52:12 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:52:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 06:52:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:52:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:52:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:52:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:52:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:52:15 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:52:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581260
Mon 20 Jan 2014 06:52:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:52:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581260
Mon 20 Jan 2014 06:52:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:52:19 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:52:19 - job_xml_thread(): Done retrieving: data size 43581260
Mon 20 Jan 2014 06:52:20 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:52:20 - XML: Start document: iteration 2
Mon 20 Jan 2014 06:52:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:52:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:52:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:52:26 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:52:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:52:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:52:27 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:52:27 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:52:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:52:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:52:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:52:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:52:27 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:52:35 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 06:52:35 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:52:35 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:52:35 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:52:35 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:52:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:52:38 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:52:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:52:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:52:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:52:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:52:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:52:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:52:40 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 06:52:40 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 06:52:40 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:52:40 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:52:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553501
Mon 20 Jan 2014 06:52:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:52:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553501
Mon 20 Jan 2014 06:52:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:52:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:52:42 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:52:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:52:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 06:52:42 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:52:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 06:52:42 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:52:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5885 values 92832 bits 11604 bytes 
Mon 20 Jan 2014 06:52:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:52:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:52:51 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:52:51 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:52:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:52:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:52:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:52:56 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:52:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:52:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:52:56 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:52:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:52:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:52:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:52:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:52:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:52:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:52:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:52:57 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:52:57 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:52:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:52:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:52:59 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:52:59 - job_xml_thread(): Done retrieving: data size 43569191
Mon 20 Jan 2014 06:52:59 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:52:59 - XML: Start document: iteration 3
Mon 20 Jan 2014 06:52:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569191
Mon 20 Jan 2014 06:52:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:53:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569191
Mon 20 Jan 2014 06:53:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:53:11 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 06:53:11 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:53:11 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:53:11 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:53:11 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:53:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:53:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:53:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:53:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:53:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:53:16 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:53:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:53:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:53:17 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:53:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:53:17 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:53:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:53:17 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:53:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:53:21 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:53:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:53:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:53:22 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:53:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 06:53:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:53:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:53:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:53:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:53:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:53:24 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:53:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43506594
Mon 20 Jan 2014 06:53:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:53:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43506594
Mon 20 Jan 2014 06:53:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:53:26 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:53:26 - job_xml_thread(): Done retrieving: data size 43506594
Mon 20 Jan 2014 06:53:26 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:53:26 - XML: Start document: iteration 4
Mon 20 Jan 2014 06:53:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:53:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:53:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:53:33 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:53:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:53:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:53:34 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:53:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:53:34 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:53:34 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:53:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:53:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:53:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:53:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:53:42 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:53:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:53:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 06:53:42 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:53:42 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:53:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 06:53:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5719 values 90201 bits 11275 bytes 
Mon 20 Jan 2014 06:53:43 - XML: Processed 652608 elements - found 0 jobs
Mon 20 Jan 2014 06:53:43 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:53:43 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:53:43 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:53:43 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:53:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:53:45 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:53:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:53:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:53:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:53:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:53:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:53:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:53:47 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:53:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42994634
Mon 20 Jan 2014 06:53:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:53:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42994634
Mon 20 Jan 2014 06:53:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:53:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:53:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:53:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:53:57 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:53:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:53:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:53:58 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:53:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 06:53:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:53:58 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:53:58 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:53:58 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:53:58 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:53:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:53:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:54:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:54:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:54:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:54:01 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:54:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:54:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:54:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:54:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:54:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:54:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:54:04 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:54:04 - job_xml_thread(): Done retrieving: data size 42932640
Mon 20 Jan 2014 06:54:04 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:54:04 - XML: Start document: iteration 5
Mon 20 Jan 2014 06:54:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42932640
Mon 20 Jan 2014 06:54:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:54:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42932640
Mon 20 Jan 2014 06:54:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:54:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:54:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:54:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:54:15 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:54:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:54:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:54:16 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:54:16 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:54:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:54:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:54:16 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:54:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:54:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:54:23 - XML: Processed 645158 elements - found 0 jobs
Mon 20 Jan 2014 06:54:23 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:54:23 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:54:23 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:54:23 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:54:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:54:25 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:54:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:54:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:54:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:54:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:54:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:54:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:54:27 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:54:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42950402
Mon 20 Jan 2014 06:54:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:54:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42950402
Mon 20 Jan 2014 06:54:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:54:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:54:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:54:38 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:54:38 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:54:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:54:39 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:54:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:54:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:54:40 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:54:40 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:54:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:54:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:54:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:54:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:54:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:54:42 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:54:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:54:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:54:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:54:42 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:54:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:54:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:54:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:54:43 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:54:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 06:54:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:54:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:54:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 06:54:43 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:54:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9305 values 146748 bits 18343 bytes 
Mon 20 Jan 2014 06:54:44 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:54:44 - job_xml_thread(): Done retrieving: data size 43497098
Mon 20 Jan 2014 06:54:44 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:54:44 - XML: Start document: iteration 6
Mon 20 Jan 2014 06:54:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43497098
Mon 20 Jan 2014 06:54:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43497098
Mon 20 Jan 2014 06:54:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:54:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:54:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:54:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:54:57 - XML: Processed 652464 elements - found 0 jobs
Mon 20 Jan 2014 06:54:57 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:54:57 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:54:57 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:54:57 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:54:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:54:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:55:06 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 06:55:06 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:55:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:55:07 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:55:07 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:55:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:55:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:55:07 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:55:07 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 06:55:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:55:07 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 06:55:07 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 06:55:07 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:55:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:55:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:55:08 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 818555 values 12906512 bits 1613314 bytes 
Mon 20 Jan 2014 06:55:08 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:55:08 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:55:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:55:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:55:08 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:55:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:55:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:55:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:55:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:55:11 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:55:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 06:55:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:55:12 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:55:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568651
Mon 20 Jan 2014 06:55:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:55:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568651
Mon 20 Jan 2014 06:55:12 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:55:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:55:13 - job_xml_thread(): Done retrieving: data size 43568651
Mon 20 Jan 2014 06:55:13 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:55:13 - XML: Start document: iteration 7
Mon 20 Jan 2014 06:55:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:55:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:55:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:55:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:55:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:55:25 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:55:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:55:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:55:26 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:55:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:55:26 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:55:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:55:26 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:55:29 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 06:55:29 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:55:29 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:55:29 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:55:29 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:55:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:55:36 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:55:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:55:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:55:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:55:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:55:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:55:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:55:38 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:55:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555913
Mon 20 Jan 2014 06:55:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:55:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555913
Mon 20 Jan 2014 06:55:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:55:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:55:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:55:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:55:43 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:55:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:55:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 06:55:44 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:55:44 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:55:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 06:55:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7323 values 115479 bits 14434 bytes 
Mon 20 Jan 2014 06:55:44 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:55:44 - job_xml_thread(): Done retrieving: data size 43555913
Mon 20 Jan 2014 06:55:44 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:55:44 - XML: Start document: iteration 8
Mon 20 Jan 2014 06:55:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:55:48 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:55:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:55:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:55:49 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:55:49 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:55:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:55:49 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:55:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:55:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:55:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:55:56 - XML: Processed 653354 elements - found 0 jobs
Mon 20 Jan 2014 06:55:56 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:55:56 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:55:56 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:55:56 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:56:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:56:02 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:56:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:56:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:56:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:56:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:56:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:56:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:56:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:56:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:56:05 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:56:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555080
Mon 20 Jan 2014 06:56:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:56:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555080
Mon 20 Jan 2014 06:56:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:56:07 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:56:07 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 06:56:12 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:56:12 - job_xml_thread(): Done retrieving: data size 43555080
Mon 20 Jan 2014 06:56:12 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:56:12 - XML: Start document: iteration 9
Mon 20 Jan 2014 06:56:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:56:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:56:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:56:20 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:56:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:56:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:56:21 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:56:21 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:56:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:56:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:56:21 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:56:23 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:56:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 06:56:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:56:26 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 06:56:26 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:56:26 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:56:26 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:56:26 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:56:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:56:29 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:56:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:56:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:56:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:56:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:56:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:56:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:56:32 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:56:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568814
Mon 20 Jan 2014 06:56:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:56:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568814
Mon 20 Jan 2014 06:56:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:56:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:56:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:56:41 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:56:41 - job_xml_thread(): Done retrieving: data size 43568814
Mon 20 Jan 2014 06:56:41 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:56:41 - XML: Start document: iteration 10
Mon 20 Jan 2014 06:56:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:56:44 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:56:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:56:44 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:56:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:56:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:56:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:56:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:56:46 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:56:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:56:46 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:56:46 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:56:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:56:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:56:46 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:56:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 06:56:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 06:56:46 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:56:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5786 values 91253 bits 11406 bytes 
Mon 20 Jan 2014 06:56:53 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 06:56:53 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:56:53 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:56:53 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:56:53 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:56:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:56:56 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:56:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:56:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:56:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:56:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:56:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:56:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:57:00 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:57:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558536
Mon 20 Jan 2014 06:57:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:57:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:57:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:57:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558536
Mon 20 Jan 2014 06:57:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:57:08 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:57:08 - job_xml_thread(): Done retrieving: data size 43558536
Mon 20 Jan 2014 06:57:08 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:57:08 - XML: Start document: iteration 11
Mon 20 Jan 2014 06:57:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:57:11 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:57:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:57:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:57:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:57:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:57:13 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:57:13 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:57:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:57:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:57:13 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:57:15 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:57:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 06:57:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:57:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:57:23 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:57:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:57:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:57:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:57:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:57:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:57:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:57:25 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 06:57:25 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:57:25 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:57:25 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:57:25 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:57:27 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:57:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43551035
Mon 20 Jan 2014 06:57:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:57:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43551035
Mon 20 Jan 2014 06:57:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:57:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:57:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:57:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:57:37 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:57:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:57:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:57:38 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:57:38 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:57:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:57:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:57:38 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:57:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:57:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:57:40 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:57:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:57:41 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:57:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:57:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:57:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:57:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:57:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:57:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:57:44 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:57:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581739
Mon 20 Jan 2014 06:57:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:57:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581739
Mon 20 Jan 2014 06:57:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:57:45 - job_xml_thread(): Done retrieving: data size 43581739
Mon 20 Jan 2014 06:57:45 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:57:45 - XML: Start document: iteration 12
Mon 20 Jan 2014 06:57:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:57:46 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:57:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:57:46 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:57:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 06:57:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 06:57:46 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:57:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8991 values 141782 bits 17722 bytes 
Mon 20 Jan 2014 06:57:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:57:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:57:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:57:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:57:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:57:57 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:57:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:57:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:57:59 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:57:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:57:59 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:57:59 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:57:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:58:05 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 06:58:05 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:58:05 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:58:05 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:58:05 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:58:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:58:08 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:58:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:58:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:58:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:58:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:58:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:58:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:58:12 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:58:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43551836
Mon 20 Jan 2014 06:58:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:58:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43551836
Mon 20 Jan 2014 06:58:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:58:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:58:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:58:21 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:58:21 - job_xml_thread(): Done retrieving: data size 43551836
Mon 20 Jan 2014 06:58:21 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:58:21 - XML: Start document: iteration 13
Mon 20 Jan 2014 06:58:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:58:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:58:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:58:26 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:58:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:58:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:58:27 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:58:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:58:27 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:58:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:58:27 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:58:34 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 06:58:34 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:58:34 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:58:34 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:58:34 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:58:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:58:36 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:58:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:58:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:58:36 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:58:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 06:58:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:58:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:58:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:58:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:58:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:58:39 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:58:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43550145
Mon 20 Jan 2014 06:58:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:58:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43550145
Mon 20 Jan 2014 06:58:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:58:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:58:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:58:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:58:46 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:58:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:58:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 06:58:47 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:58:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 06:58:47 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:58:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5869 values 92580 bits 11572 bytes 
Mon 20 Jan 2014 06:58:49 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:58:49 - job_xml_thread(): Done retrieving: data size 43550145
Mon 20 Jan 2014 06:58:49 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:58:49 - XML: Start document: iteration 14
Mon 20 Jan 2014 06:58:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:58:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:58:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:58:57 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:58:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:58:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:58:58 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:58:58 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:58:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:58:58 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:58:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:59:02 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 06:59:02 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:59:02 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:59:02 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:59:02 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:59:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:59:03 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:59:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:59:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:59:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:59:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:59:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:59:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:59:07 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:59:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 06:59:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:59:07 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:59:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43522742
Mon 20 Jan 2014 06:59:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:59:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43522742
Mon 20 Jan 2014 06:59:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:59:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:59:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:59:17 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:59:17 - job_xml_thread(): Done retrieving: data size 43522742
Mon 20 Jan 2014 06:59:17 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:59:17 - XML: Start document: iteration 15
Mon 20 Jan 2014 06:59:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:59:17 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:59:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:59:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:59:18 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:59:18 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:59:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:59:18 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:59:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:59:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:59:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:59:28 - XML: Processed 652802 elements - found 0 jobs
Mon 20 Jan 2014 06:59:28 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 06:59:28 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 06:59:28 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 06:59:28 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 06:59:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:59:30 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:59:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:59:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:59:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:59:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:59:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:59:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:59:33 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:59:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43484882
Mon 20 Jan 2014 06:59:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 06:59:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43484882
Mon 20 Jan 2014 06:59:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:59:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:59:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:59:44 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 06:59:44 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 06:59:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 06:59:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 06:59:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 06:59:46 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 06:59:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 06:59:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:59:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 06:59:47 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:59:47 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:59:47 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:59:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 06:59:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 06:59:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:59:48 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 06:59:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 06:59:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 06:59:48 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:59:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99045 bits 12380 bytes 
Mon 20 Jan 2014 06:59:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 06:59:49 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 06:59:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 06:59:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:59:49 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 06:59:50 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 06:59:50 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 06:59:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:59:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 06:59:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 06:59:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 06:59:52 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 06:59:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 06:59:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 06:59:52 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 06:59:52 - job_xml_thread(): Done retrieving: data size 42941371
Mon 20 Jan 2014 06:59:52 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 06:59:52 - XML: Start document: iteration 16
Mon 20 Jan 2014 06:59:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42941371
Mon 20 Jan 2014 06:59:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 06:59:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42941371
Mon 20 Jan 2014 06:59:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:00:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:00:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:00:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:00:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:00:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:00:10 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:00:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:00:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:00:10 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:00:10 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:00:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:00:10 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:00:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:00:11 - XML: Processed 645546 elements - found 0 jobs
Mon 20 Jan 2014 07:00:11 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:00:11 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:00:11 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:00:11 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:00:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:00:13 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:00:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:00:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:00:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:00:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:00:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:00:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:00:14 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:00:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42975998
Mon 20 Jan 2014 07:00:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:00:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42975998
Mon 20 Jan 2014 07:00:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:00:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:00:22 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:00:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:00:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:00:26 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:00:27 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:00:27 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:00:27 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:00:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:00:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:00:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:00:27 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:00:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:00:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:00:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:00:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:00:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:00:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:00:29 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:00:29 - job_xml_thread(): Done retrieving: data size 42985317
Mon 20 Jan 2014 07:00:29 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:00:29 - XML: Start document: iteration 17
Mon 20 Jan 2014 07:00:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42985317
Mon 20 Jan 2014 07:00:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:00:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42985317
Mon 20 Jan 2014 07:00:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:00:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:00:41 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:00:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:00:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:00:43 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:00:43 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:00:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:00:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:00:43 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:00:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:00:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:00:45 - XML: Processed 645912 elements - found 0 jobs
Mon 20 Jan 2014 07:00:45 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:00:45 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:00:45 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:00:45 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:00:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:00:48 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:00:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:00:49 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:00:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:00:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:00:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:00:49 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:00:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 07:00:49 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:00:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 07:00:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148563 bits 18570 bytes 
Mon 20 Jan 2014 07:00:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:00:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:00:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:00:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:00:51 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:00:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43490818
Mon 20 Jan 2014 07:00:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:00:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43490818
Mon 20 Jan 2014 07:00:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:00:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:00:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:01:00 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:01:00 - job_xml_thread(): Done retrieving: data size 43490818
Mon 20 Jan 2014 07:01:00 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:01:00 - XML: Start document: iteration 18
Mon 20 Jan 2014 07:01:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:01:04 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:01:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:01:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:01:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:01:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:01:05 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:01:05 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:01:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:01:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:01:05 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:01:09 - XML: Processed 652191 elements - found 0 jobs
Mon 20 Jan 2014 07:01:09 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:01:09 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:01:09 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:01:09 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:01:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:01:13 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:01:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:01:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:01:14 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:01:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 07:01:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:01:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:01:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:01:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:01:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:01:15 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:01:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560427
Mon 20 Jan 2014 07:01:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:01:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560427
Mon 20 Jan 2014 07:01:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:01:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:01:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:01:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:01:24 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:01:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:01:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:01:25 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:01:25 - job_xml_thread(): Done retrieving: data size 43560427
Mon 20 Jan 2014 07:01:25 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:01:25 - XML: Start document: iteration 19
Mon 20 Jan 2014 07:01:25 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:01:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:01:25 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:01:25 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:01:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:01:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:01:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:01:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:01:34 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:01:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:01:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:01:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:01:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:01:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:01:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:01:36 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 07:01:36 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:01:36 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:01:36 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:01:36 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:01:38 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:01:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43541285
Mon 20 Jan 2014 07:01:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:01:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43541285
Mon 20 Jan 2014 07:01:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:01:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:01:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:01:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:01:49 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:01:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:01:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:01:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:01:50 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:01:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 07:01:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:01:50 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:01:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 07:01:50 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:01:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8134 values 128444 bits 16055 bytes 
Mon 20 Jan 2014 07:01:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:01:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:01:51 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:01:52 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:01:52 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:01:52 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:01:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:01:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:01:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:01:53 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:01:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:01:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:01:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:01:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:01:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:01:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:01:56 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:01:56 - job_xml_thread(): Done retrieving: data size 43576474
Mon 20 Jan 2014 07:01:56 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:01:56 - XML: Start document: iteration 20
Mon 20 Jan 2014 07:01:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576474
Mon 20 Jan 2014 07:01:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:01:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576474
Mon 20 Jan 2014 07:01:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:02:07 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 07:02:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:02:08 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:02:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:02:09 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:02:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:02:09 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 07:02:09 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:02:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:02:09 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 07:02:09 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 07:02:13 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 07:02:13 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:02:13 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:02:13 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:02:13 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:02:17 - size of cluster 'LISA Cluster': 624 hosts 79473 metrics 786699 values 12413102 bits 1551637 bytes 
Mon 20 Jan 2014 07:02:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:02:17 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:02:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:02:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:02:18 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:02:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:02:18 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:02:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:02:18 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:02:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:02:20 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:02:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:02:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:02:20 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:02:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 07:02:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:02:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:02:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:02:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:02:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:02:24 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:02:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578762
Mon 20 Jan 2014 07:02:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:02:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578762
Mon 20 Jan 2014 07:02:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:02:28 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:02:28 - job_xml_thread(): Done retrieving: data size 43578762
Mon 20 Jan 2014 07:02:28 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:02:29 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 07:02:30 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 07:02:30 - Housekeeping: done.
Mon 20 Jan 2014 07:02:30 - XML: Start document: iteration 0
Mon 20 Jan 2014 07:02:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:02:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:02:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:02:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:02:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:02:38 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:02:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:02:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:02:42 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:02:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:02:42 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:02:42 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:02:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:02:45 - XML: Processed 653355 elements - found 0 jobs
Mon 20 Jan 2014 07:02:45 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:02:45 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:02:45 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:02:45 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:02:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:02:47 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:02:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:02:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:02:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:02:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:02:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:02:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:02:50 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:02:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43589467
Mon 20 Jan 2014 07:02:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:02:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:02:50 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:02:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43589467
Mon 20 Jan 2014 07:02:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:02:51 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:02:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 07:02:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:02:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 07:02:53 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:02:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9148 values 144750 bits 18093 bytes 
Mon 20 Jan 2014 07:02:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:02:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:03:00 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:03:01 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:03:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:03:01 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:03:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:03:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:03:01 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:03:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:03:01 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:03:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:03:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:03:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:03:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:03:06 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:03:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:03:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:03:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:03:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:03:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:03:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:03:10 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:03:10 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 07:03:10 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:03:10 - job_xml_thread(): Done retrieving: data size 43567339
Mon 20 Jan 2014 07:03:10 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:03:10 - XML: Start document: iteration 1
Mon 20 Jan 2014 07:03:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567339
Mon 20 Jan 2014 07:03:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:03:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567339
Mon 20 Jan 2014 07:03:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:03:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:03:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:03:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:03:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:03:30 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 07:03:30 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:03:30 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:03:30 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:03:30 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:03:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:03:31 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:03:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:03:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:03:32 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:03:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:03:32 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:03:32 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:03:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:03:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:03:34 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:03:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:03:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:03:34 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:03:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 07:03:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:03:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:03:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:03:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:03:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:03:37 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:03:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43586526
Mon 20 Jan 2014 07:03:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:03:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43586526
Mon 20 Jan 2014 07:03:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:03:45 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:03:45 - job_xml_thread(): Done retrieving: data size 43586526
Mon 20 Jan 2014 07:03:45 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:03:45 - XML: Start document: iteration 2
Mon 20 Jan 2014 07:03:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:03:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:03:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:03:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:03:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:03:51 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:03:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:03:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:03:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:03:52 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:03:53 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:03:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:03:53 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:03:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:03:53 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:03:53 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:03:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 07:03:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:03:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 07:03:53 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:03:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5826 values 92053 bits 11506 bytes 
Mon 20 Jan 2014 07:03:58 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 07:03:59 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:03:59 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:04:00 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:04:00 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:04:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:04:01 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:04:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:04:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:04:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:04:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:04:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:04:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:04:05 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:04:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571119
Mon 20 Jan 2014 07:04:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:04:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571119
Mon 20 Jan 2014 07:04:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:04:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:04:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:04:15 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:04:15 - job_xml_thread(): Done retrieving: data size 43571119
Mon 20 Jan 2014 07:04:15 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:04:15 - XML: Start document: iteration 3
Mon 20 Jan 2014 07:04:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:04:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:04:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:04:22 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:04:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:04:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:04:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:04:22 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:04:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:04:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:04:22 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:04:22 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:04:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:04:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:04:22 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:04:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:04:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:04:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:04:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:04:25 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:04:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 07:04:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:04:27 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 07:04:27 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:04:27 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:04:27 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:04:27 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:04:30 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:04:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574468
Mon 20 Jan 2014 07:04:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:04:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574468
Mon 20 Jan 2014 07:04:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:04:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:04:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:04:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:04:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:04:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:04:38 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:04:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:04:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:04:38 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:04:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:04:38 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:04:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574468
Mon 20 Jan 2014 07:04:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:04:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:04:42 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:04:42 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:04:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:04:49 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:04:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:04:52 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:04:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:04:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:04:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:04:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:04:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:04:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:04:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:04:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:04:53 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:04:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:04:53 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:04:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:04:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:04:53 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:04:54 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:04:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 07:04:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:04:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 07:04:54 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:04:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5876 values 92721 bits 11590 bytes 
Mon 20 Jan 2014 07:04:56 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:04:56 - job_xml_thread(): Done retrieving: data size 43548379
Mon 20 Jan 2014 07:04:56 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:04:56 - XML: Start document: iteration 4
Mon 20 Jan 2014 07:04:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43548379
Mon 20 Jan 2014 07:04:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:04:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43548379
Mon 20 Jan 2014 07:04:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:05:07 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 07:05:07 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:05:07 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:05:07 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:05:07 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:05:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:05:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:05:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:05:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:05:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:05:12 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:05:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:05:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:05:12 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:05:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:05:12 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:05:12 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:05:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:05:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:05:17 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:05:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:05:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:05:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:05:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:05:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:05:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:05:20 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:05:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 07:05:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:05:21 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:05:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43512830
Mon 20 Jan 2014 07:05:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:05:22 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:05:22 - job_xml_thread(): Done retrieving: data size 43512830
Mon 20 Jan 2014 07:05:22 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:05:22 - XML: Start document: iteration 5
Mon 20 Jan 2014 07:05:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43512830
Mon 20 Jan 2014 07:05:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:05:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:05:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:05:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:05:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:05:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:05:38 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:05:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:05:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:05:38 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:05:38 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:05:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:05:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:05:38 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:05:42 - XML: Processed 652608 elements - found 0 jobs
Mon 20 Jan 2014 07:05:42 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:05:42 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:05:42 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:05:42 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:05:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:05:46 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:05:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:05:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:05:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:05:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:05:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:05:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:05:49 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:05:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42989160
Mon 20 Jan 2014 07:05:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:05:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42989160
Mon 20 Jan 2014 07:05:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:05:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:05:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:05:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:05:54 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:05:55 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:05:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 07:05:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:05:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 07:05:55 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:05:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7307 values 115301 bits 14412 bytes 
Mon 20 Jan 2014 07:05:57 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:05:57 - job_xml_thread(): Done retrieving: data size 42989160
Mon 20 Jan 2014 07:05:57 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:05:57 - XML: Start document: iteration 6
Mon 20 Jan 2014 07:05:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:05:58 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:05:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:05:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:05:59 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:05:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:05:59 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:05:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:05:59 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:06:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:06:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:06:09 - XML: Processed 646120 elements - found 0 jobs
Mon 20 Jan 2014 07:06:09 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:06:09 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:06:09 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:06:09 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:06:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:06:11 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:06:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:06:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:06:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:06:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:06:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:06:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:06:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:06:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:06:15 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:06:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42943218
Mon 20 Jan 2014 07:06:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:06:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42943218
Mon 20 Jan 2014 07:06:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:06:24 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:06:24 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:06:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 07:06:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:06:24 - job_xml_thread(): Done retrieving: data size 42943218
Mon 20 Jan 2014 07:06:24 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:06:24 - XML: Start document: iteration 7
Mon 20 Jan 2014 07:06:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:06:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:06:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:06:29 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:06:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:06:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:06:30 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:06:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:06:31 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:06:31 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:06:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:06:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:06:31 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:06:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:06:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:06:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:06:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:06:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:06:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:06:35 - XML: Processed 645834 elements - found 0 jobs
Mon 20 Jan 2014 07:06:35 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:06:35 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:06:35 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:06:35 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:06:37 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 07:06:37 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 07:06:37 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:06:38 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:06:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43406014
Mon 20 Jan 2014 07:06:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:06:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43406014
Mon 20 Jan 2014 07:06:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:06:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:06:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:06:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:06:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:06:50 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:06:50 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:06:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:06:52 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:06:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:06:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:06:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:06:53 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:06:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:06:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:06:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:06:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:06:53 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:06:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:06:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:06:53 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:06:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:06:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:06:55 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:06:55 - job_xml_thread(): Done retrieving: data size 43566781
Mon 20 Jan 2014 07:06:55 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:06:55 - XML: Start document: iteration 8
Mon 20 Jan 2014 07:06:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:06:55 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:06:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566781
Mon 20 Jan 2014 07:06:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566781
Mon 20 Jan 2014 07:06:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:06:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:06:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:06:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 07:06:58 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:06:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 07:06:58 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:07:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6106 values 96391 bits 12048 bytes 
Mon 20 Jan 2014 07:07:05 - XML: Processed 653256 elements - found 0 jobs
Mon 20 Jan 2014 07:07:05 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:07:05 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:07:05 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:07:05 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:07:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:07:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:07:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:07:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:07:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:07:13 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:07:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:07:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:07:13 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:07:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:07:13 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:07:13 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:07:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:07:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:07:17 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:07:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:07:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:07:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:07:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:07:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:07:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:07:20 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:07:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580406
Mon 20 Jan 2014 07:07:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:07:20 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:07:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580406
Mon 20 Jan 2014 07:07:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:07:21 - job_xml_thread(): Done retrieving: data size 43580406
Mon 20 Jan 2014 07:07:21 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:07:21 - XML: Start document: iteration 9
Mon 20 Jan 2014 07:07:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:07:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:07:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:07:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:07:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:07:38 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:07:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:07:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:07:39 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:07:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:07:39 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:07:39 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:07:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:07:41 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 07:07:41 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:07:41 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:07:41 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:07:41 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:07:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:07:44 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:07:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:07:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:07:44 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:07:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 07:07:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:07:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:07:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:07:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:07:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:07:46 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:07:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574406
Mon 20 Jan 2014 07:07:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:07:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574406
Mon 20 Jan 2014 07:07:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:07:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:07:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:07:56 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:07:56 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:07:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:07:56 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:07:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:07:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:07:58 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:07:58 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:07:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:07:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:07:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:07:59 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:08:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:08:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:08:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:08:00 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:08:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 07:08:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 07:08:00 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:08:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5526 values 87127 bits 10890 bytes 
Mon 20 Jan 2014 07:08:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:08:01 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:08:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:08:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:08:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:08:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:08:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:08:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:08:03 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:08:03 - job_xml_thread(): Done retrieving: data size 43580306
Mon 20 Jan 2014 07:08:03 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:08:03 - XML: Start document: iteration 10
Mon 20 Jan 2014 07:08:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580306
Mon 20 Jan 2014 07:08:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580306
Mon 20 Jan 2014 07:08:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:08:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:08:08 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:08:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 07:08:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:08:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:08:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:08:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:08:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:08:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:08:17 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:08:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:08:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:08:18 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:08:18 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:08:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:08:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:08:19 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:08:19 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 07:08:20 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:08:20 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:08:20 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:08:20 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:08:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:08:25 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:08:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:08:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:08:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:08:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:08:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:08:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:08:27 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:08:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561752
Mon 20 Jan 2014 07:08:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:08:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561752
Mon 20 Jan 2014 07:08:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:08:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:08:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:08:35 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:08:35 - job_xml_thread(): Done retrieving: data size 43561752
Mon 20 Jan 2014 07:08:35 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:08:35 - XML: Start document: iteration 11
Mon 20 Jan 2014 07:08:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:08:40 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:08:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:08:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:08:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:08:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:08:41 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:08:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:08:41 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:08:41 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:08:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:08:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:08:46 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:08:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:08:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:08:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:08:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:08:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:08:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:08:49 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 07:08:49 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:08:49 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:08:49 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:08:49 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:08:51 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:08:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567302
Mon 20 Jan 2014 07:08:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:08:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567302
Mon 20 Jan 2014 07:08:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:08:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:08:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:09:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:09:00 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:09:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:09:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:09:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:09:01 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:09:01 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:09:01 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:09:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:09:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:09:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567302
Mon 20 Jan 2014 07:09:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:09:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:09:01 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:09:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 07:09:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 07:09:01 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:09:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9264 values 146153 bits 18269 bytes 
Mon 20 Jan 2014 07:09:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:09:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:09:04 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:09:04 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:09:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:09:09 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:09:10 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 07:09:10 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:09:11 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:09:11 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:09:11 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 07:09:11 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 07:09:11 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Mon 20 Jan 2014 07:09:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:09:13 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:09:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:09:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:09:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:09:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:09:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:09:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:09:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:09:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:09:16 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:09:16 - job_xml_thread(): Done retrieving: data size 43563209
Mon 20 Jan 2014 07:09:16 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:09:16 - XML: Start document: iteration 12
Mon 20 Jan 2014 07:09:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563209
Mon 20 Jan 2014 07:09:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:09:17 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:09:17 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:09:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:09:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:09:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563209
Mon 20 Jan 2014 07:09:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:09:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:09:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:09:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:09:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:09:35 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 07:09:35 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:09:35 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:09:35 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:09:35 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:09:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:09:36 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:09:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:09:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:09:37 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:09:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:09:37 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:09:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:09:37 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:09:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:09:38 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:09:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:09:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:09:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:09:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:09:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:09:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:09:39 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:09:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 07:09:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:09:41 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:09:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582089
Mon 20 Jan 2014 07:09:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:09:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582089
Mon 20 Jan 2014 07:09:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:09:51 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:09:51 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:09:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:09:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:09:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:09:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:09:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:09:54 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:09:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:09:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:09:55 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:09:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:09:55 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:09:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:09:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:09:56 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:09:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:09:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:09:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:09:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:09:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:09:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:09:58 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:09:58 - job_xml_thread(): Done retrieving: data size 43569840
Mon 20 Jan 2014 07:09:58 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:09:58 - XML: Start document: iteration 13
Mon 20 Jan 2014 07:09:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569840
Mon 20 Jan 2014 07:09:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:09:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569840
Mon 20 Jan 2014 07:09:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:10:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:10:01 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:10:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:10:04 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:10:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 07:10:04 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:10:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 07:10:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8828 values 139193 bits 17399 bytes 
Mon 20 Jan 2014 07:10:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:10:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:10:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:10:11 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:10:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:10:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:10:11 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:10:12 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:10:12 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:10:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:10:12 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:10:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:10:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:10:13 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:10:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:10:13 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:10:13 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 07:10:13 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 07:10:13 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:10:13 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 07:10:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:10:18 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:10:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:10:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:10:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:10:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:10:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:10:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:10:21 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 07:10:21 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:10:21 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:10:21 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 862696 values 13604202 bits 1700525 bytes 
Mon 20 Jan 2014 07:10:21 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:10:21 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:10:26 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:10:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43549857
Mon 20 Jan 2014 07:10:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:10:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43549857
Mon 20 Jan 2014 07:10:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:10:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:10:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:10:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:10:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:10:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:10:34 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:10:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:10:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:10:35 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:10:35 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:10:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:10:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:10:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43549857
Mon 20 Jan 2014 07:10:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:10:36 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:10:36 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:10:46 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:10:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 07:10:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:10:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:10:49 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:10:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:10:49 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:10:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:10:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:10:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:10:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:10:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:10:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:10:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:10:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:10:51 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:10:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:10:51 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:10:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:10:52 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:10:52 - job_xml_thread(): Done retrieving: data size 43542997
Mon 20 Jan 2014 07:10:52 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:10:52 - XML: Start document: iteration 14
Mon 20 Jan 2014 07:10:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43542997
Mon 20 Jan 2014 07:10:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:10:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43542997
Mon 20 Jan 2014 07:10:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:11:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:11:04 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:11:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:11:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:11:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:11:05 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:11:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 07:11:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 07:11:05 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:11:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6093 values 96116 bits 12014 bytes 
Mon 20 Jan 2014 07:11:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:11:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:11:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:11:06 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:11:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:11:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:11:07 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:11:07 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:11:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:11:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:11:07 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:11:12 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 07:11:12 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:11:12 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:11:12 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:11:12 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:11:13 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:11:13 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 07:11:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:11:17 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:11:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:11:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:11:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:11:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:11:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:11:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:11:20 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:11:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 07:11:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:11:20 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:11:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43499194
Mon 20 Jan 2014 07:11:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:11:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43499194
Mon 20 Jan 2014 07:11:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:11:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:11:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:11:28 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:11:29 - job_xml_thread(): Done retrieving: data size 43499194
Mon 20 Jan 2014 07:11:29 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:11:29 - XML: Start document: iteration 15
Mon 20 Jan 2014 07:11:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:11:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:11:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:11:36 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:11:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:11:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:11:37 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:11:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:11:37 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:11:37 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:11:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:11:39 - XML: Processed 652605 elements - found 0 jobs
Mon 20 Jan 2014 07:11:39 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:11:39 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:11:39 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:11:39 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:11:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:11:42 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:11:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:11:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:11:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:11:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:11:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:11:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:11:45 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:11:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42981404
Mon 20 Jan 2014 07:11:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:11:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42981404
Mon 20 Jan 2014 07:11:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:11:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:11:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:11:54 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:11:54 - job_xml_thread(): Done retrieving: data size 42981404
Mon 20 Jan 2014 07:11:54 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:11:54 - XML: Start document: iteration 16
Mon 20 Jan 2014 07:11:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:11:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:12:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:12:01 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:12:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:12:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:12:03 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:12:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:12:03 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:12:03 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:12:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:12:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:12:05 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:12:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:12:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 07:12:06 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:12:06 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:12:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 07:12:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99080 bits 12385 bytes 
Mon 20 Jan 2014 07:12:06 - XML: Processed 646104 elements - found 0 jobs
Mon 20 Jan 2014 07:12:06 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:12:06 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:12:06 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:12:06 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:12:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:12:08 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:12:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:12:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:12:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:12:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:12:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:12:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:12:12 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:12:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42945329
Mon 20 Jan 2014 07:12:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:12:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42945329
Mon 20 Jan 2014 07:12:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:12:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:12:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:12:21 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:12:21 - job_xml_thread(): Done retrieving: data size 42945329
Mon 20 Jan 2014 07:12:21 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:12:21 - XML: Start document: iteration 17
Mon 20 Jan 2014 07:12:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:12:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:12:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:12:25 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:12:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:12:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:12:25 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:12:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:12:25 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:12:25 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:12:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:12:34 - XML: Processed 645694 elements - found 0 jobs
Mon 20 Jan 2014 07:12:34 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:12:34 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:12:34 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:12:34 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:12:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:12:35 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:12:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:12:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:12:36 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:12:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 07:12:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:12:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:12:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:12:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:12:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:12:38 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:12:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43408844
Mon 20 Jan 2014 07:12:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:12:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43408844
Mon 20 Jan 2014 07:12:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:12:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:12:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:12:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:12:49 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:12:49 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:12:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:12:50 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:12:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:12:50 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:12:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:12:50 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:12:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:12:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:12:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:12:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:12:54 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:12:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:12:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:12:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:12:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:12:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:12:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:12:57 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:12:57 - job_xml_thread(): Done retrieving: data size 43552582
Mon 20 Jan 2014 07:12:57 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:12:57 - XML: Start document: iteration 18
Mon 20 Jan 2014 07:12:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43552582
Mon 20 Jan 2014 07:12:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:12:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43552582
Mon 20 Jan 2014 07:12:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:13:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:13:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:13:06 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:13:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:13:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:13:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:13:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:13:06 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:13:06 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:13:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:13:06 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:13:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:13:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43552582
Mon 20 Jan 2014 07:13:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:13:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:13:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 07:13:07 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:13:07 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:13:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 07:13:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:13:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:13:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8830 values 139227 bits 17403 bytes 
Mon 20 Jan 2014 07:13:18 - XML: Processed 653196 elements - found 0 jobs
Mon 20 Jan 2014 07:13:18 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:13:18 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:13:18 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:13:18 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:13:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:13:20 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:13:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:13:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:13:22 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:13:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:13:22 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:13:22 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:13:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:13:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:13:25 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:13:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:13:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:13:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:13:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:13:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:13:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:13:27 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 07:13:27 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 07:13:27 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:13:28 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:13:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570215
Mon 20 Jan 2014 07:13:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:13:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570215
Mon 20 Jan 2014 07:13:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:13:33 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:13:33 - job_xml_thread(): Done retrieving: data size 43570215
Mon 20 Jan 2014 07:13:33 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:13:33 - XML: Start document: iteration 19
Mon 20 Jan 2014 07:13:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:13:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:13:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:13:40 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:13:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:13:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:13:40 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:13:40 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:13:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:13:40 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:13:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:13:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:13:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:13:47 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 07:13:47 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:13:47 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:13:47 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:13:47 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:13:49 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:13:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 07:13:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:13:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:13:51 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:13:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:13:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:13:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:13:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:13:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:13:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:13:53 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:13:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43540206
Mon 20 Jan 2014 07:13:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:13:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43540206
Mon 20 Jan 2014 07:13:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:13:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:13:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:14:02 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:14:02 - job_xml_thread(): Done retrieving: data size 43540206
Mon 20 Jan 2014 07:14:02 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:14:02 - XML: Start document: iteration 20
Mon 20 Jan 2014 07:14:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:14:06 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:14:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:14:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:14:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:14:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:14:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:14:07 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:14:07 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:14:07 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:14:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:14:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:14:07 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:14:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:14:08 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:14:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 07:14:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 07:14:08 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:14:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5819 values 91759 bits 11469 bytes 
Mon 20 Jan 2014 07:14:16 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 07:14:16 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:14:16 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:14:16 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:14:16 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:14:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:14:17 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:14:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:14:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:14:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:14:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:14:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:14:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:14:19 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:14:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563934
Mon 20 Jan 2014 07:14:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:14:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563934
Mon 20 Jan 2014 07:14:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:14:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:14:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:14:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:14:29 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:14:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:14:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:14:30 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:14:30 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:14:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:14:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:14:30 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:14:31 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:14:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:14:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:14:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:14:33 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:14:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:14:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:14:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:14:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:14:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:14:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:14:33 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:14:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 07:14:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:14:35 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:14:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43586098
Mon 20 Jan 2014 07:14:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:14:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43586098
Mon 20 Jan 2014 07:14:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:14:36 - job_xml_thread(): Done retrieving: data size 43586098
Mon 20 Jan 2014 07:14:36 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:14:36 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 07:14:36 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 07:14:36 - Housekeeping: done.
Mon 20 Jan 2014 07:14:36 - XML: Start document: iteration 0
Mon 20 Jan 2014 07:14:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:14:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:14:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:14:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:14:50 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 07:14:51 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:14:51 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:14:51 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:14:51 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:14:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:14:55 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:14:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:14:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:14:56 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:14:56 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:14:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:14:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:14:56 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:14:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:14:57 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:14:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:14:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:14:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:14:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:14:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:14:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:14:59 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:14:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43588956
Mon 20 Jan 2014 07:14:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:15:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43588956
Mon 20 Jan 2014 07:15:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:15:06 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:15:06 - job_xml_thread(): Done retrieving: data size 43588956
Mon 20 Jan 2014 07:15:06 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:15:06 - XML: Start document: iteration 1
Mon 20 Jan 2014 07:15:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:15:10 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:15:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:15:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:15:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:15:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 07:15:12 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:15:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9100 values 143487 bits 17935 bytes 
Mon 20 Jan 2014 07:15:13 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:15:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 07:15:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:15:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:15:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:15:18 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:15:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:15:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:15:19 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:15:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:15:19 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:15:19 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:15:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:15:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:15:22 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:15:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:15:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:15:23 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 07:15:23 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:15:23 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:15:23 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:15:23 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:15:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:15:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:15:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:15:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:15:25 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:15:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 07:15:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:15:26 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:15:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570551
Mon 20 Jan 2014 07:15:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:15:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570551
Mon 20 Jan 2014 07:15:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:15:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:15:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:15:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:15:36 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:15:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:15:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:15:38 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:15:38 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:15:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:15:38 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:15:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:15:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:15:38 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:15:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:15:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:15:39 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:15:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:15:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:15:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:15:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:15:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:15:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:15:41 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:15:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43585273
Mon 20 Jan 2014 07:15:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:15:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43585273
Mon 20 Jan 2014 07:15:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:15:42 - job_xml_thread(): Done retrieving: data size 43585273
Mon 20 Jan 2014 07:15:43 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:15:43 - XML: Start document: iteration 2
Mon 20 Jan 2014 07:15:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:15:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:15:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:15:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:15:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:15:58 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:15:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:15:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:15:59 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:15:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:15:59 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:15:59 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:16:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:16:01 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 07:16:01 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:16:01 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:16:01 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:16:01 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:16:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:16:03 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:16:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:16:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:16:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:16:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:16:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:16:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:16:05 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:16:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43595588
Mon 20 Jan 2014 07:16:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:16:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43595588
Mon 20 Jan 2014 07:16:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:16:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:16:13 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:16:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:16:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:16:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:16:15 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:16:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:16:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:16:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:16:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 07:16:15 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:16:15 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:16:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148657 bits 18582 bytes 
Mon 20 Jan 2014 07:16:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 07:16:16 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:16:16 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:16:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:16:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:16:16 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:16:17 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:16:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:16:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:16:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:16:18 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:16:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:16:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:16:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:16:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:16:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:16:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:16:21 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:16:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43586068
Mon 20 Jan 2014 07:16:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:16:22 - job_xml_thread(): Done retrieving: data size 43586068
Mon 20 Jan 2014 07:16:22 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:16:22 - XML: Start document: iteration 3
Mon 20 Jan 2014 07:16:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43586068
Mon 20 Jan 2014 07:16:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:16:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:16:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:16:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:16:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:16:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:16:38 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:16:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:16:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:16:38 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:16:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:16:39 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:16:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:16:39 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:16:39 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 07:16:39 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:16:39 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:16:39 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:16:39 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:16:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:16:44 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:16:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:16:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:16:44 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:16:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 07:16:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:16:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:16:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:16:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:16:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:16:45 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:16:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583191
Mon 20 Jan 2014 07:16:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:16:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583191
Mon 20 Jan 2014 07:16:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:16:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:16:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:16:54 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:16:54 - job_xml_thread(): Done retrieving: data size 43583191
Mon 20 Jan 2014 07:16:54 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:16:54 - XML: Start document: iteration 4
Mon 20 Jan 2014 07:16:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:16:56 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:16:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:16:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:16:57 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:16:57 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:16:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:16:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:16:57 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:16:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:16:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:17:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:17:02 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:17:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:17:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:17:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:17:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:17:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:17:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:17:05 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 07:17:05 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:17:05 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:17:05 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:17:05 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:17:07 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:17:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43513947
Mon 20 Jan 2014 07:17:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:17:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43513947
Mon 20 Jan 2014 07:17:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:17:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:17:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:17:13 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 07:17:14 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:17:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:17:15 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:17:16 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:17:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:17:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 07:17:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 07:17:16 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:17:16 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 07:17:16 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:17:16 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 07:17:16 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:17:16 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 07:17:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:17:18 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:17:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:17:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:17:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:17:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:17:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9074 values 143616 bits 17952 bytes 
Mon 20 Jan 2014 07:17:19 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:17:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:17:19 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:17:19 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:17:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:17:20 - job_xml_thread(): Retrieving XML data..
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Mon 20 Jan 2014 07:17:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:17:24 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:17:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:17:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:17:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:17:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:17:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:17:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:17:27 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:17:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43503948
Mon 20 Jan 2014 07:17:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:17:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43503948
Mon 20 Jan 2014 07:17:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:17:27 - job_xml_thread(): Done retrieving: data size 43503948
Mon 20 Jan 2014 07:17:27 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:17:27 - XML: Start document: iteration 5
Mon 20 Jan 2014 07:17:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:17:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:17:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:17:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:17:42 - XML: Processed 652608 elements - found 0 jobs
Mon 20 Jan 2014 07:17:42 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:17:42 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:17:42 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:17:42 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:17:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:17:44 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:17:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:17:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:17:44 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:17:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:17:44 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:17:44 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:17:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:17:44 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:17:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 07:17:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:17:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:17:49 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:17:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:17:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:17:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:17:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:17:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:17:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:17:51 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:17:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42951506
Mon 20 Jan 2014 07:17:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:17:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42951506
Mon 20 Jan 2014 07:17:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:17:57 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:17:57 - job_xml_thread(): Done retrieving: data size 42951506
Mon 20 Jan 2014 07:17:57 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:17:58 - XML: Start document: iteration 6
Mon 20 Jan 2014 07:17:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:18:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:18:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:18:01 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:18:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:18:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:18:02 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:18:02 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:18:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:18:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:18:02 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:18:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:18:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:18:11 - XML: Processed 645608 elements - found 0 jobs
Mon 20 Jan 2014 07:18:11 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:18:11 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:18:11 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:18:11 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:18:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:18:12 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:18:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:18:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:18:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:18:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:18:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:18:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:18:14 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:18:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42959193
Mon 20 Jan 2014 07:18:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:18:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42959193
Mon 20 Jan 2014 07:18:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:18:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:18:16 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:18:16 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:18:16 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:18:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:18:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:18:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:18:18 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:18:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 07:18:18 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:18:18 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:18:18 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 07:18:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 07:18:18 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 07:18:18 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:18:18 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 07:18:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9299 values 146933 bits 18366 bytes 
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Mon 20 Jan 2014 07:18:27 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:18:27 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:18:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:18:27 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:18:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:18:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:18:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:18:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:18:28 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:18:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:18:28 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:18:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:18:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:18:31 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:18:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:18:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:18:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:18:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:18:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:18:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:18:33 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:18:33 - job_xml_thread(): Done retrieving: data size 42994170
Mon 20 Jan 2014 07:18:33 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:18:33 - XML: Start document: iteration 7
Mon 20 Jan 2014 07:18:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42994170
Mon 20 Jan 2014 07:18:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:18:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42994170
Mon 20 Jan 2014 07:18:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:18:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:18:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:18:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:18:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:18:50 - XML: Processed 645908 elements - found 0 jobs
Mon 20 Jan 2014 07:18:50 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:18:50 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:18:50 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:18:50 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:18:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:18:52 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:18:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:18:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:18:53 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:18:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:18:53 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:18:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:18:53 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:18:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:18:55 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:18:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:18:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:18:55 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:18:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 07:18:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:18:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:18:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:18:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:18:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:18:57 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:18:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569355
Mon 20 Jan 2014 07:18:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:18:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569355
Mon 20 Jan 2014 07:18:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:19:06 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:19:06 - job_xml_thread(): Done retrieving: data size 43569355
Mon 20 Jan 2014 07:19:06 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:19:06 - XML: Start document: iteration 8
Mon 20 Jan 2014 07:19:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:19:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:19:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:19:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:19:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:19:11 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:19:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:19:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:19:11 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:19:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:19:12 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:19:12 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:19:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:19:17 - XML: Processed 653322 elements - found 0 jobs
Mon 20 Jan 2014 07:19:17 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:19:17 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:19:17 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:19:17 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:19:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:19:18 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:19:18 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:19:18 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:19:19 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:19:19 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:19:19 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 07:19:19 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 07:19:19 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 07:19:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:19:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 07:19:19 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:19:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:19:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5606 values 88425 bits 11053 bytes 
Mon 20 Jan 2014 07:19:19 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:19:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 07:19:19 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:19:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:19:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:19:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:19:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:19:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:19:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:19:20 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 1056756 values 16685864 bits 2085733 bytes 
Mon 20 Jan 2014 07:19:26 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:19:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43528627
Mon 20 Jan 2014 07:19:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:19:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43528627
Mon 20 Jan 2014 07:19:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:19:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:19:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:19:33 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:19:33 - job_xml_thread(): Done retrieving: data size 43528627
Mon 20 Jan 2014 07:19:33 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:19:33 - XML: Start document: iteration 9
Mon 20 Jan 2014 07:19:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:19:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:19:44 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 07:19:44 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:19:44 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:19:44 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:19:44 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:19:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:19:48 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:19:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:19:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:19:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:19:48 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:19:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:19:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:19:48 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:19:48 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:19:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:19:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:19:48 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:19:48 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:19:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 07:19:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:19:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:19:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:19:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:19:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:19:52 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:19:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566814
Mon 20 Jan 2014 07:19:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:19:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566814
Mon 20 Jan 2014 07:19:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:20:00 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:20:00 - job_xml_thread(): Done retrieving: data size 43566814
Mon 20 Jan 2014 07:20:00 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:20:00 - XML: Start document: iteration 10
Mon 20 Jan 2014 07:20:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:20:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:20:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:20:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:20:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:20:08 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:20:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:20:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:20:08 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:20:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:20:08 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:20:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:20:08 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:20:12 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 07:20:12 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:20:12 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:20:12 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:20:12 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:20:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:20:14 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:20:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:20:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:20:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:20:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:20:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:20:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:20:18 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:20:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559996
Mon 20 Jan 2014 07:20:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:20:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559996
Mon 20 Jan 2014 07:20:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:20:19 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:20:19 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 07:20:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:20:20 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:20:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:20:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 07:20:21 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:20:21 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:20:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8834 values 139293 bits 17411 bytes 
Mon 20 Jan 2014 07:20:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 07:20:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:20:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:20:27 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:20:27 - job_xml_thread(): Done retrieving: data size 43559996
Mon 20 Jan 2014 07:20:27 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:20:27 - XML: Start document: iteration 11
Mon 20 Jan 2014 07:20:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:20:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:20:36 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 07:20:36 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:20:36 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:20:36 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:20:36 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:20:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:20:38 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:20:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:20:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:20:39 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:20:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:20:39 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:20:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:20:39 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:20:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:20:41 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:20:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:20:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:20:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:20:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:20:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:20:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:20:46 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:20:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569746
Mon 20 Jan 2014 07:20:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:20:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569746
Mon 20 Jan 2014 07:20:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:20:51 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:20:51 - job_xml_thread(): Done retrieving: data size 43569746
Mon 20 Jan 2014 07:20:51 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:20:51 - XML: Start document: iteration 12
Mon 20 Jan 2014 07:20:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:20:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:20:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:20:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:21:03 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:21:03 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 07:21:03 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:21:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 07:21:03 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:21:03 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:21:03 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:21:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:21:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:21:05 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:21:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:21:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:21:06 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:21:06 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:21:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:21:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:21:06 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:21:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:21:08 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:21:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:21:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:21:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:21:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:21:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:21:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:21:12 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:21:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560102
Mon 20 Jan 2014 07:21:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:21:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560102
Mon 20 Jan 2014 07:21:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:21:18 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:21:18 - job_xml_thread(): Done retrieving: data size 43560102
Mon 20 Jan 2014 07:21:19 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:21:19 - XML: Start document: iteration 13
Mon 20 Jan 2014 07:21:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:21:21 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:21:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:21:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:21:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:21:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 07:21:22 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:21:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 07:21:22 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:21:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5989 values 94482 bits 11810 bytes 
Mon 20 Jan 2014 07:21:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:21:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:21:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:21:33 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:21:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:21:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:21:35 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:21:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:21:35 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:21:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:21:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:21:35 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:21:35 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:21:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:21:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:21:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:21:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:21:36 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 07:21:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:21:36 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:21:36 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:21:36 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:21:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:21:36 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:21:38 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 07:21:38 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 07:21:38 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:21:40 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:21:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 07:21:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:21:40 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:21:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568299
Mon 20 Jan 2014 07:21:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:21:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568299
Mon 20 Jan 2014 07:21:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:21:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:21:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:21:52 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:21:52 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:21:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:21:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:21:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:21:54 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:21:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:21:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:21:55 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:21:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:21:55 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:21:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:21:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:21:55 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:21:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:21:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:21:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:21:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:21:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:21:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:21:57 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:21:57 - job_xml_thread(): Done retrieving: data size 43564479
Mon 20 Jan 2014 07:21:57 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:21:57 - XML: Start document: iteration 14
Mon 20 Jan 2014 07:21:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564479
Mon 20 Jan 2014 07:21:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:21:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564479
Mon 20 Jan 2014 07:21:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:22:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:22:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:22:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:22:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:22:15 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 07:22:15 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:22:15 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:22:15 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:22:15 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:22:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:22:16 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:22:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:22:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:22:18 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:22:18 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:22:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:22:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:22:18 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:22:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:22:18 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:22:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:22:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:22:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:22:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:22:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:22:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:22:21 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:22:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581602
Mon 20 Jan 2014 07:22:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:22:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581602
Mon 20 Jan 2014 07:22:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:22:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:22:23 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:22:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:22:24 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:22:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 07:22:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 07:22:24 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:22:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148648 bits 18581 bytes 
Mon 20 Jan 2014 07:22:31 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:22:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:22:31 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:22:31 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:22:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:22:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:22:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:22:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:22:34 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:22:34 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:22:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:22:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:22:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:22:36 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:22:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:22:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:22:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:22:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:22:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:22:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:22:38 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:22:38 - job_xml_thread(): Done retrieving: data size 43565709
Mon 20 Jan 2014 07:22:38 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:22:38 - XML: Start document: iteration 15
Mon 20 Jan 2014 07:22:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565709
Mon 20 Jan 2014 07:22:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:22:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565709
Mon 20 Jan 2014 07:22:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:22:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:22:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:22:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:22:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:22:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:22:55 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:22:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:22:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:22:56 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:22:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:22:56 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:22:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:22:56 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:22:59 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:22:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 07:22:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:22:59 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 07:22:59 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:22:59 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:22:59 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:22:59 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:23:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:23:01 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:23:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:23:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:23:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:23:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:23:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:23:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:23:03 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:23:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579215
Mon 20 Jan 2014 07:23:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:23:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579215
Mon 20 Jan 2014 07:23:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:23:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:23:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:23:14 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:23:14 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:23:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:23:15 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:23:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:23:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:23:16 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:23:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:23:16 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:23:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:23:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:23:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:23:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:23:18 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:23:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:23:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:23:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:23:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:23:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:23:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:23:20 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:23:20 - job_xml_thread(): Done retrieving: data size 43510484
Mon 20 Jan 2014 07:23:20 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:23:20 - XML: Start document: iteration 16
Mon 20 Jan 2014 07:23:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43510484
Mon 20 Jan 2014 07:23:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43510484
Mon 20 Jan 2014 07:23:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:23:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:23:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:23:24 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:23:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:23:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 07:23:26 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:23:26 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:23:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 07:23:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8070 values 127348 bits 15918 bytes 
Mon 20 Jan 2014 07:23:30 - XML: Processed 652607 elements - found 0 jobs
Mon 20 Jan 2014 07:23:30 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:23:30 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:23:30 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:23:30 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:23:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:23:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:23:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:23:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:23:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:23:40 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:23:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:23:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:23:41 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:23:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:23:41 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:23:41 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:23:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:23:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:23:42 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:23:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:23:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:23:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:23:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:23:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:23:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:23:45 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:23:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42952761
Mon 20 Jan 2014 07:23:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:23:45 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:23:45 - job_xml_thread(): Done retrieving: data size 42952761
Mon 20 Jan 2014 07:23:45 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:23:45 - XML: Start document: iteration 17
Mon 20 Jan 2014 07:23:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42952761
Mon 20 Jan 2014 07:23:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:23:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:23:55 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:23:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:23:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:23:57 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:23:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:23:57 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:23:57 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:23:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:23:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:23:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:24:05 - XML: Processed 645622 elements - found 0 jobs
Mon 20 Jan 2014 07:24:05 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:24:05 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:24:05 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:24:05 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:24:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:24:08 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:24:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:24:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:24:08 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:24:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 07:24:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:24:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:24:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:24:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:24:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:24:10 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:24:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42932805
Mon 20 Jan 2014 07:24:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:24:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42932805
Mon 20 Jan 2014 07:24:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:24:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:24:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:24:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:24:20 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:24:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:24:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:24:20 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:24:20 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:24:21 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:24:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:24:21 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:24:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:24:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:24:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:24:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:24:24 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:24:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:24:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:24:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:24:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:24:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:24:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:24:26 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:24:26 - job_xml_thread(): Done retrieving: data size 42961352
Mon 20 Jan 2014 07:24:26 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:24:26 - XML: Start document: iteration 18
Mon 20 Jan 2014 07:24:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42961352
Mon 20 Jan 2014 07:24:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:24:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:24:27 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:24:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42961352
Mon 20 Jan 2014 07:24:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:24:28 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:24:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:24:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 07:24:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 07:24:29 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:24:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5813 values 91640 bits 11455 bytes 
Mon 20 Jan 2014 07:24:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:24:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:24:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:24:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:24:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:24:42 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:24:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:24:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:24:43 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:24:43 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:24:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:24:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:24:43 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:24:45 - XML: Processed 645912 elements - found 0 jobs
Mon 20 Jan 2014 07:24:45 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:24:45 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:24:45 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:24:45 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:24:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:24:50 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:24:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:24:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:24:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:24:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:24:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:24:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:24:52 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:24:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43490310
Mon 20 Jan 2014 07:24:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:24:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43490310
Mon 20 Jan 2014 07:24:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:24:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:24:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:25:00 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:25:00 - job_xml_thread(): Done retrieving: data size 43490310
Mon 20 Jan 2014 07:25:00 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:25:00 - XML: Start document: iteration 19
Mon 20 Jan 2014 07:25:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:25:04 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:25:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:25:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:25:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:25:05 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:25:05 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:25:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:25:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:25:05 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:25:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:25:10 - XML: Processed 652420 elements - found 0 jobs
Mon 20 Jan 2014 07:25:10 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:25:10 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:25:10 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:25:10 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:25:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:25:12 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:25:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:25:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:25:12 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:25:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 07:25:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:25:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:25:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:25:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:25:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:25:14 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:25:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43552795
Mon 20 Jan 2014 07:25:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:25:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43552795
Mon 20 Jan 2014 07:25:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:25:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:25:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:25:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:25:25 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:25:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:25:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:25:25 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:25:25 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:25:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:25:25 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:25:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:25:25 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:25:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:25:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:25:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:25:29 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:25:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:25:29 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:25:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:25:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:25:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:25:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:25:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:25:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:25:29 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:25:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:25:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 07:25:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 07:25:29 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:25:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5823 values 91812 bits 11476 bytes 
Mon 20 Jan 2014 07:25:32 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:25:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569068
Mon 20 Jan 2014 07:25:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:25:32 - job_xml_thread(): Done retrieving: data size 43569068
Mon 20 Jan 2014 07:25:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569068
Mon 20 Jan 2014 07:25:32 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:25:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:25:32 - XML: Start document: iteration 20
Mon 20 Jan 2014 07:25:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:25:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:25:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:25:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:25:46 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 07:25:46 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:25:46 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:25:46 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:25:46 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:25:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:25:51 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:25:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:25:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:25:52 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:25:52 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:25:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:25:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:25:52 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:25:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:25:55 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:25:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:25:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:25:56 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:25:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 07:25:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:25:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:25:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:25:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:25:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:25:58 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:25:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559010
Mon 20 Jan 2014 07:25:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:25:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559010
Mon 20 Jan 2014 07:25:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:26:01 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:26:01 - job_xml_thread(): Done retrieving: data size 43559010
Mon 20 Jan 2014 07:26:01 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:26:02 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 07:26:02 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 07:26:02 - Housekeeping: done.
Mon 20 Jan 2014 07:26:02 - XML: Start document: iteration 0
Mon 20 Jan 2014 07:26:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:26:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:26:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:26:10 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:26:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:26:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:26:10 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:26:10 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:26:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:26:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:26:10 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:26:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:26:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:26:16 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 07:26:16 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:26:16 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:26:16 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:26:17 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:26:19 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 07:26:19 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:26:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:26:20 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:26:20 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:26:20 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 07:26:20 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 07:26:20 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:26:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:26:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:26:20 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 07:26:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:26:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:26:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:26:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:26:21 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 942450 values 14859057 bits 1857382 bytes 
Mon 20 Jan 2014 07:26:24 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:26:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43539653
Mon 20 Jan 2014 07:26:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:26:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43539653
Mon 20 Jan 2014 07:26:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:26:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:26:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:26:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:26:31 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:26:32 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:26:32 - job_xml_thread(): Done retrieving: data size 43539653
Mon 20 Jan 2014 07:26:32 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:26:32 - XML: Start document: iteration 1
Mon 20 Jan 2014 07:26:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:26:32 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:26:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:26:33 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:26:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 07:26:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 07:26:33 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:26:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:26:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:26:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8690 values 136972 bits 17121 bytes 
Mon 20 Jan 2014 07:26:34 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:26:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:26:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43539653
Mon 20 Jan 2014 07:26:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:26:34 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:26:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:26:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:26:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:26:47 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 07:26:47 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:26:47 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:26:47 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:26:47 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:26:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:26:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:26:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:26:50 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:26:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:26:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:26:50 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:26:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:26:50 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:26:50 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:26:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:26:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:26:54 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:26:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:26:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:26:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:26:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:26:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:26:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:26:58 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:26:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563181
Mon 20 Jan 2014 07:26:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:26:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563181
Mon 20 Jan 2014 07:26:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:27:02 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:27:02 - job_xml_thread(): Done retrieving: data size 43563181
Mon 20 Jan 2014 07:27:02 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:27:02 - XML: Start document: iteration 2
Mon 20 Jan 2014 07:27:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:27:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:27:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:27:10 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:27:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:27:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:27:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:27:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:27:11 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:27:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:27:11 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:27:11 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:27:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:27:18 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 07:27:18 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:27:18 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:27:18 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:27:18 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:27:20 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:27:20 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 07:27:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:27:22 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:27:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:27:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:27:22 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:27:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 07:27:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:27:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:27:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:27:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:27:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:27:25 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:27:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43541655
Mon 20 Jan 2014 07:27:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:27:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43541655
Mon 20 Jan 2014 07:27:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:27:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:27:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:27:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:27:33 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:27:33 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:27:33 - job_xml_thread(): Done retrieving: data size 43541655
Mon 20 Jan 2014 07:27:33 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:27:33 - XML: Start document: iteration 3
Mon 20 Jan 2014 07:27:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:27:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 07:27:34 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:27:34 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:27:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 07:27:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6051 values 95430 bits 11928 bytes 
Mon 20 Jan 2014 07:27:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:27:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:27:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:27:39 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:27:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:27:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:27:40 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:27:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:27:40 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:27:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:27:40 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:27:44 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 07:27:44 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:27:44 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:27:44 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:27:44 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:27:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:27:49 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:27:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:27:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:27:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:27:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:27:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:27:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:27:52 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:27:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568656
Mon 20 Jan 2014 07:27:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:27:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568656
Mon 20 Jan 2014 07:27:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:27:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:27:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:27:56 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:27:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 07:27:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:27:59 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:27:59 - job_xml_thread(): Done retrieving: data size 43568656
Mon 20 Jan 2014 07:27:59 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:27:59 - XML: Start document: iteration 4
Mon 20 Jan 2014 07:28:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:28:01 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:28:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:28:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:28:01 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:28:01 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:28:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:28:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:28:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568656
Mon 20 Jan 2014 07:28:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:28:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:28:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:28:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:28:13 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:28:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:28:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:28:17 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:28:17 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:28:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:28:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:28:17 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:28:18 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 07:28:18 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:28:18 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:28:18 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:28:18 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:28:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:28:22 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:28:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:28:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:28:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:28:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:28:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:28:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:28:25 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:28:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559459
Mon 20 Jan 2014 07:28:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:28:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559459
Mon 20 Jan 2014 07:28:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:28:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:28:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:28:33 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:28:33 - job_xml_thread(): Done retrieving: data size 43559459
Mon 20 Jan 2014 07:28:33 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:28:33 - XML: Start document: iteration 5
Mon 20 Jan 2014 07:28:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:28:34 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:28:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:28:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 07:28:34 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:28:34 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:28:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 07:28:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99056 bits 12382 bytes 
Mon 20 Jan 2014 07:28:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:28:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:28:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:28:39 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:28:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:28:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:28:40 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:28:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:28:40 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:28:40 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:28:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:28:47 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 07:28:47 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:28:47 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:28:47 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:28:47 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:28:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:28:50 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:28:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:28:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:28:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:28:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:28:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:28:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:28:53 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:28:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556052
Mon 20 Jan 2014 07:28:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:28:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556052
Mon 20 Jan 2014 07:28:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:28:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:28:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:29:02 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:29:02 - job_xml_thread(): Done retrieving: data size 43556052
Mon 20 Jan 2014 07:29:02 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:29:02 - XML: Start document: iteration 6
Mon 20 Jan 2014 07:29:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:29:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:29:09 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:29:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 07:29:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:29:13 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 07:29:13 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:29:13 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:29:13 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:29:13 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:29:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:29:13 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:29:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:29:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:29:14 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:29:14 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:29:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:29:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:29:14 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:29:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:29:17 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:29:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:29:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:29:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:29:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:29:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:29:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:29:22 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:29:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43522770
Mon 20 Jan 2014 07:29:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:29:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43522770
Mon 20 Jan 2014 07:29:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:29:28 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:29:28 - job_xml_thread(): Done retrieving: data size 43522770
Mon 20 Jan 2014 07:29:28 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:29:28 - XML: Start document: iteration 7
Mon 20 Jan 2014 07:29:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:29:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:29:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:29:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:29:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:29:33 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:29:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:29:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:29:34 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:29:34 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:29:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:29:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:29:34 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:29:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:29:34 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:29:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:29:35 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:29:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 07:29:35 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:29:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 07:29:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6108 values 96354 bits 12044 bytes 
Mon 20 Jan 2014 07:29:39 - XML: Processed 652608 elements - found 0 jobs
Mon 20 Jan 2014 07:29:39 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:29:39 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:29:39 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:29:39 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:29:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:29:45 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:29:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:29:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:29:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:29:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:29:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:29:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:29:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:29:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:29:50 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:29:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43006198
Mon 20 Jan 2014 07:29:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:29:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43006198
Mon 20 Jan 2014 07:29:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:29:54 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:29:54 - job_xml_thread(): Done retrieving: data size 43006198
Mon 20 Jan 2014 07:29:54 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:29:54 - XML: Start document: iteration 8
Mon 20 Jan 2014 07:29:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:30:00 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:30:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:30:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:30:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:30:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:30:02 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:30:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:30:02 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:30:02 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:30:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:30:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:30:10 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:30:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:30:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:30:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:30:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:30:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:30:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:30:12 - XML: Processed 646616 elements - found 0 jobs
Mon 20 Jan 2014 07:30:12 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:30:12 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:30:12 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:30:12 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:30:12 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:30:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 07:30:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:30:15 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 07:30:15 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 07:30:15 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:30:15 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:30:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42943928
Mon 20 Jan 2014 07:30:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:30:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42943928
Mon 20 Jan 2014 07:30:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:30:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:30:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:30:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:30:25 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:30:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:30:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:30:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:30:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:30:26 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:30:26 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:30:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:30:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:30:26 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:30:27 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:30:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:30:29 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:30:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:30:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:30:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:30:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:30:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:30:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:30:31 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:30:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42982121
Mon 20 Jan 2014 07:30:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:30:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42982121
Mon 20 Jan 2014 07:30:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:30:31 - job_xml_thread(): Done retrieving: data size 42982121
Mon 20 Jan 2014 07:30:32 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:30:32 - XML: Start document: iteration 9
Mon 20 Jan 2014 07:30:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:30:35 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:30:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:30:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 07:30:37 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:30:37 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:30:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 07:30:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9235 values 145648 bits 18206 bytes 
Mon 20 Jan 2014 07:30:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:30:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:30:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:30:43 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:30:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:30:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:30:44 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:30:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:30:44 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:30:44 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:30:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:30:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:30:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:30:52 - XML: Processed 645912 elements - found 0 jobs
Mon 20 Jan 2014 07:30:52 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:30:52 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:30:52 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:30:52 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:30:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:30:54 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:30:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:30:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:30:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:30:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:30:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:30:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:30:55 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:30:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43534703
Mon 20 Jan 2014 07:30:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:30:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43534703
Mon 20 Jan 2014 07:30:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:30:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:30:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:31:07 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:31:07 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:31:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:31:07 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:31:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:31:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:31:08 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:31:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:31:08 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:31:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:31:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:31:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:31:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:31:10 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:31:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:31:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:31:11 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:31:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 07:31:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:31:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:31:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:31:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:31:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:31:12 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:31:12 - job_xml_thread(): Done retrieving: data size 43554166
Mon 20 Jan 2014 07:31:12 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:31:12 - XML: Start document: iteration 10
Mon 20 Jan 2014 07:31:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554166
Mon 20 Jan 2014 07:31:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554166
Mon 20 Jan 2014 07:31:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:31:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:31:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:31:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:31:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:31:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:31:29 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 07:31:29 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:31:29 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:31:29 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:31:29 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:31:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:31:29 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:31:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:31:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:31:31 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:31:31 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:31:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:31:31 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:31:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:31:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:31:31 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:31:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:31:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:31:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:31:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:31:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:31:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:31:33 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:31:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43590626
Mon 20 Jan 2014 07:31:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:31:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43590626
Mon 20 Jan 2014 07:31:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:31:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:31:37 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:31:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:31:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 07:31:40 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:31:40 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:31:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 07:31:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8919 values 140847 bits 17605 bytes 
Mon 20 Jan 2014 07:31:44 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:31:44 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:31:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:31:45 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:31:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:31:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:31:46 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:31:46 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:31:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:31:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:31:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:31:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:31:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:31:48 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:31:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:31:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:31:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:31:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:31:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:31:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:31:50 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:31:50 - job_xml_thread(): Done retrieving: data size 43583469
Mon 20 Jan 2014 07:31:50 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:31:50 - XML: Start document: iteration 11
Mon 20 Jan 2014 07:31:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583469
Mon 20 Jan 2014 07:31:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583469
Mon 20 Jan 2014 07:31:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:31:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:32:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:32:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:32:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:32:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:32:10 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 07:32:10 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:32:10 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:32:10 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:32:10 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:32:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:32:12 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:32:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:32:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:32:12 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:32:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:32:12 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:32:12 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:32:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:32:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:32:14 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:32:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:32:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:32:14 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:32:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 07:32:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:32:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:32:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:32:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:32:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:32:16 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:32:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43586259
Mon 20 Jan 2014 07:32:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:32:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43586259
Mon 20 Jan 2014 07:32:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:32:25 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:32:25 - job_xml_thread(): Done retrieving: data size 43586259
Mon 20 Jan 2014 07:32:25 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:32:25 - XML: Start document: iteration 12
Mon 20 Jan 2014 07:32:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:32:26 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:32:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:32:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:32:29 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:32:29 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:32:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:32:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:32:29 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:32:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:32:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:32:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:32:32 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:32:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:32:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:32:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:32:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:32:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:32:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:32:36 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 07:32:36 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:32:36 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:32:36 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:32:36 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:32:38 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:32:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568369
Mon 20 Jan 2014 07:32:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:32:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568369
Mon 20 Jan 2014 07:32:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:32:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:32:41 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:32:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:32:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 07:32:42 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:32:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 07:32:42 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:32:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9022 values 142757 bits 17844 bytes 
Mon 20 Jan 2014 07:32:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:32:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:32:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:32:48 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:32:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:32:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:32:48 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:32:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:32:48 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:32:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:32:49 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:32:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:32:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:32:52 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:32:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:32:53 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:32:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:32:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:32:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:32:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:32:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:32:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:32:55 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:32:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560943
Mon 20 Jan 2014 07:32:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:32:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560943
Mon 20 Jan 2014 07:32:56 - job_xml_thread(): Done retrieving: data size 43560943
Mon 20 Jan 2014 07:32:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:32:56 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:32:56 - XML: Start document: iteration 13
Mon 20 Jan 2014 07:33:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:33:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:33:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:33:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:33:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:33:11 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:33:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:33:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:33:12 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:33:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 07:33:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:33:13 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:33:13 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:33:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:33:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:33:13 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:33:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:33:16 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:33:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:33:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:33:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:33:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:33:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:33:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:33:18 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 07:33:18 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:33:18 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:33:18 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:33:18 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:33:19 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:33:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583901
Mon 20 Jan 2014 07:33:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:33:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583901
Mon 20 Jan 2014 07:33:20 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 07:33:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:33:20 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:33:22 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:33:22 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:33:22 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 07:33:23 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 07:33:23 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 07:33:26 - size of cluster 'LISA Cluster': 624 hosts 79468 metrics 827789 values 13072137 bits 1634017 bytes 
Mon 20 Jan 2014 07:33:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:33:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:33:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:33:31 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:33:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:33:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:33:32 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:33:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:33:32 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:33:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:33:32 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:33:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:33:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:33:33 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:33:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:33:34 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:33:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:33:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:33:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:33:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:33:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:33:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:33:38 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:33:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43591316
Mon 20 Jan 2014 07:33:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:33:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43591316
Mon 20 Jan 2014 07:33:38 - job_xml_thread(): Done retrieving: data size 43591316
Mon 20 Jan 2014 07:33:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:33:38 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:33:39 - XML: Start document: iteration 14
Mon 20 Jan 2014 07:33:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:33:43 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:33:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:33:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 07:33:44 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:33:44 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:33:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 07:33:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9099 values 143817 bits 17977 bytes 
Mon 20 Jan 2014 07:33:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:33:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:33:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:33:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:33:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:33:53 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:33:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:33:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:33:54 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:33:54 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:33:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:33:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:33:55 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:33:56 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 07:33:56 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:33:56 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:33:56 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:33:56 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:34:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:34:02 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:34:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:34:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:34:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:34:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:34:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:34:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:34:06 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:34:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565012
Mon 20 Jan 2014 07:34:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:34:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565012
Mon 20 Jan 2014 07:34:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:34:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:34:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:34:11 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:34:11 - job_xml_thread(): Done retrieving: data size 43565012
Mon 20 Jan 2014 07:34:11 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:34:11 - XML: Start document: iteration 15
Mon 20 Jan 2014 07:34:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:34:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:34:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:34:21 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:34:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:34:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:34:22 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:34:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:34:22 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:34:22 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:34:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:34:24 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:34:24 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 07:34:28 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 07:34:28 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:34:28 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:34:28 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:34:28 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:34:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:34:29 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:34:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:34:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:34:29 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:34:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 07:34:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:34:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:34:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:34:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:34:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:34:32 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:34:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555929
Mon 20 Jan 2014 07:34:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:34:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555929
Mon 20 Jan 2014 07:34:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:34:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:34:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:34:43 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:34:43 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:34:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:34:44 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:34:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:34:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:34:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:34:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 07:34:45 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:34:45 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:34:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 07:34:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:34:45 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:34:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5924 values 93445 bits 11680 bytes 
Mon 20 Jan 2014 07:34:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:34:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:34:46 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:34:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:34:46 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:34:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:34:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:34:49 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:34:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:34:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:34:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:34:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:34:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:34:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:34:53 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:34:53 - job_xml_thread(): Done retrieving: data size 43576688
Mon 20 Jan 2014 07:34:53 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:34:53 - XML: Start document: iteration 16
Mon 20 Jan 2014 07:34:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576688
Mon 20 Jan 2014 07:34:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:34:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576688
Mon 20 Jan 2014 07:34:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:35:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:35:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:35:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:35:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:35:11 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 07:35:11 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:35:11 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:35:11 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:35:11 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:35:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:35:12 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:35:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:35:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:35:12 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:35:12 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:35:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:35:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:35:12 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:35:13 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:35:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 07:35:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:35:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:35:16 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:35:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:35:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:35:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:35:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:35:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:35:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:35:20 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:35:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43508563
Mon 20 Jan 2014 07:35:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:35:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43508563
Mon 20 Jan 2014 07:35:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:35:26 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:35:26 - job_xml_thread(): Done retrieving: data size 43508563
Mon 20 Jan 2014 07:35:26 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:35:26 - XML: Start document: iteration 17
Mon 20 Jan 2014 07:35:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:35:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:35:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:35:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:35:35 - XML: Processed 652608 elements - found 0 jobs
Mon 20 Jan 2014 07:35:35 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:35:35 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:35:35 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:35:35 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:35:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:35:39 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:35:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:35:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:35:40 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:35:40 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:35:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:35:40 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:35:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:35:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:35:42 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:35:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:35:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:35:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:35:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:35:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:35:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:35:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:35:45 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:35:46 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:35:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42955570
Mon 20 Jan 2014 07:35:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:35:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:35:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 07:35:46 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:35:46 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:35:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 07:35:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42955570
Mon 20 Jan 2014 07:35:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:35:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6594 values 104060 bits 13007 bytes 
Mon 20 Jan 2014 07:35:50 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:35:50 - job_xml_thread(): Done retrieving: data size 42955570
Mon 20 Jan 2014 07:35:50 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:35:50 - XML: Start document: iteration 18
Mon 20 Jan 2014 07:35:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:35:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:35:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:35:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:36:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:36:02 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:36:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:36:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:36:03 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:36:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:36:03 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:36:03 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:36:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:36:05 - XML: Processed 645782 elements - found 0 jobs
Mon 20 Jan 2014 07:36:05 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:36:05 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:36:05 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:36:05 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:36:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:36:10 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:36:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:36:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:36:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:36:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:36:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:36:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:36:14 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:36:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42940534
Mon 20 Jan 2014 07:36:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:36:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42940534
Mon 20 Jan 2014 07:36:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:36:15 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:36:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 07:36:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:36:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:36:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:36:20 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:36:20 - job_xml_thread(): Done retrieving: data size 42940534
Mon 20 Jan 2014 07:36:20 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:36:20 - XML: Start document: iteration 19
Mon 20 Jan 2014 07:36:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:36:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:36:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:36:26 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:36:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:36:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:36:28 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:36:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:36:28 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:36:28 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:36:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:36:34 - XML: Processed 645803 elements - found 0 jobs
Mon 20 Jan 2014 07:36:34 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:36:34 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:36:34 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:36:34 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:36:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:36:36 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:36:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:36:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:36:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:36:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:36:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:36:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:36:40 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:36:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43131854
Mon 20 Jan 2014 07:36:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:36:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43131854
Mon 20 Jan 2014 07:36:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:36:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:36:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:36:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:36:47 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:36:47 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:36:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:36:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 07:36:47 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:36:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6264 values 98828 bits 12353 bytes 
Mon 20 Jan 2014 07:36:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 07:36:49 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:36:49 - job_xml_thread(): Done retrieving: data size 43131854
Mon 20 Jan 2014 07:36:49 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:36:49 - XML: Start document: iteration 20
Mon 20 Jan 2014 07:36:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:36:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:36:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:36:55 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:36:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:36:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:36:57 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:36:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:36:57 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:36:57 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:36:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:37:02 - XML: Processed 648026 elements - found 0 jobs
Mon 20 Jan 2014 07:37:02 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:37:02 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:37:02 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:37:02 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:37:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:37:03 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:37:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:37:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:37:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:37:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:37:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:37:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:37:07 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:37:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569855
Mon 20 Jan 2014 07:37:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:37:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569855
Mon 20 Jan 2014 07:37:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:37:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:37:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:37:17 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:37:17 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:37:17 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:37:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 07:37:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:37:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:37:18 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:37:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:37:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:37:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:37:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:37:19 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:37:19 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:37:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:37:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:37:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:37:23 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:37:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:37:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:37:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:37:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:37:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:37:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:37:26 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:37:26 - job_xml_thread(): Done retrieving: data size 43568790
Mon 20 Jan 2014 07:37:26 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:37:26 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 07:37:26 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 07:37:26 - Housekeeping: done.
Mon 20 Jan 2014 07:37:26 - XML: Start document: iteration 0
Mon 20 Jan 2014 07:37:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568790
Mon 20 Jan 2014 07:37:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568790
Mon 20 Jan 2014 07:37:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:37:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:37:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:37:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:37:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:37:38 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:37:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:37:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:37:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:37:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:37:39 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:37:39 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:37:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:37:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:37:39 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:37:46 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 07:37:46 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:37:46 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:37:46 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:37:47 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:37:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:37:47 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:37:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:37:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 07:37:47 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:37:48 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:37:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 07:37:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5987 values 94467 bits 11808 bytes 
Mon 20 Jan 2014 07:37:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:37:49 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:37:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:37:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:37:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:37:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:37:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:37:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:37:51 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 07:37:51 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 07:37:51 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:37:52 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:37:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562182
Mon 20 Jan 2014 07:37:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:37:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562182
Mon 20 Jan 2014 07:37:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:37:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:37:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:38:02 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:38:02 - job_xml_thread(): Done retrieving: data size 43562182
Mon 20 Jan 2014 07:38:02 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:38:02 - XML: Start document: iteration 1
Mon 20 Jan 2014 07:38:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:38:03 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:38:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:38:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:38:04 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:38:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:38:04 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:38:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:38:04 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:38:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:38:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:38:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:38:12 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:38:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:38:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:38:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:38:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:38:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:38:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:38:14 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 07:38:14 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:38:14 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:38:14 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:38:14 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:38:15 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:38:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 07:38:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:38:16 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:38:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43543737
Mon 20 Jan 2014 07:38:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:38:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43543737
Mon 20 Jan 2014 07:38:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:38:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:38:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:38:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:38:25 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:38:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:38:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:38:26 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:38:26 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:38:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:38:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:38:26 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:38:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:38:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:38:29 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:38:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:38:30 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:38:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:38:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:38:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:38:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:38:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:38:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:38:33 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:38:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579910
Mon 20 Jan 2014 07:38:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:38:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579910
Mon 20 Jan 2014 07:38:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:38:35 - job_xml_thread(): Done retrieving: data size 43579910
Mon 20 Jan 2014 07:38:35 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:38:35 - XML: Start document: iteration 2
Mon 20 Jan 2014 07:38:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:38:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:38:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:38:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:38:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:38:47 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:38:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:38:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:38:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:38:48 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:38:48 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:38:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:38:48 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:38:48 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:38:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:38:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:38:49 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:38:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 07:38:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 07:38:49 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:38:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8790 values 138661 bits 17332 bytes 
Mon 20 Jan 2014 07:38:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:38:55 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:38:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:38:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:38:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:38:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:38:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:38:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:38:56 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 07:38:56 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:38:56 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:38:56 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:38:56 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:38:59 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:38:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 07:38:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:38:59 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:38:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554319
Mon 20 Jan 2014 07:38:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:39:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554319
Mon 20 Jan 2014 07:39:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:39:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:39:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:39:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:39:10 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:39:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:39:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:39:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:39:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:39:12 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:39:12 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:39:12 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:39:12 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:39:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:39:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:39:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:39:14 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:39:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:39:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:39:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:39:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:39:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:39:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:39:15 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:39:15 - job_xml_thread(): Done retrieving: data size 43578223
Mon 20 Jan 2014 07:39:15 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:39:15 - XML: Start document: iteration 3
Mon 20 Jan 2014 07:39:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578223
Mon 20 Jan 2014 07:39:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:39:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578223
Mon 20 Jan 2014 07:39:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:39:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:39:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:39:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:39:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:39:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:39:31 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:39:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:39:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:39:32 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:39:32 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:39:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:39:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:39:33 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:39:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:39:39 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:39:39 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 07:39:39 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:39:39 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:39:39 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:39:39 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:39:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:39:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:39:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:39:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:39:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:39:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:39:41 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:39:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558903
Mon 20 Jan 2014 07:39:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:39:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558903
Mon 20 Jan 2014 07:39:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:39:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:39:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:39:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:39:49 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:39:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:39:51 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:39:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 07:39:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 07:39:51 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:39:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148606 bits 18575 bytes 
Mon 20 Jan 2014 07:39:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:39:51 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:39:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:39:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:39:51 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:39:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:39:52 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:39:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:39:52 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:39:54 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:39:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:39:54 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:39:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:39:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:39:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:39:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:39:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:39:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:39:57 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:39:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 07:39:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:39:57 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:39:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559577
Mon 20 Jan 2014 07:39:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:39:57 - job_xml_thread(): Done retrieving: data size 43559577
Mon 20 Jan 2014 07:39:57 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:39:57 - XML: Start document: iteration 4
Mon 20 Jan 2014 07:39:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559577
Mon 20 Jan 2014 07:39:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:40:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:40:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:40:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:40:10 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:40:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:40:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:40:11 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:40:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:40:11 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:40:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:40:11 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:40:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:40:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:40:17 - XML: Processed 653353 elements - found 0 jobs
Mon 20 Jan 2014 07:40:17 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:40:17 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:40:17 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:40:17 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:40:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:40:19 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:40:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:40:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:40:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:40:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:40:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:40:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:40:21 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:40:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561743
Mon 20 Jan 2014 07:40:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:40:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561743
Mon 20 Jan 2014 07:40:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:40:24 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 07:40:24 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:40:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:40:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:40:26 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:40:26 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 07:40:26 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 07:40:26 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:40:26 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 07:40:28 - size of cluster 'LISA Cluster': 624 hosts 79469 metrics 766560 values 12084826 bits 1510603 bytes 
Mon 20 Jan 2014 07:40:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:40:30 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:40:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:40:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:40:31 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:40:31 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:40:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:40:31 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:40:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:40:32 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:40:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:40:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:40:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:40:36 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:40:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:40:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:40:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:40:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:40:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:40:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:40:39 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:40:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571086
Mon 20 Jan 2014 07:40:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:40:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571086
Mon 20 Jan 2014 07:40:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:40:40 - job_xml_thread(): Done retrieving: data size 43571086
Mon 20 Jan 2014 07:40:40 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:40:40 - XML: Start document: iteration 5
Mon 20 Jan 2014 07:40:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:40:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:40:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:40:51 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:40:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:40:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 07:40:51 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:40:51 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:40:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 07:40:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:40:52 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:40:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:40:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148580 bits 18572 bytes 
Mon 20 Jan 2014 07:40:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:40:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:40:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:40:52 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:40:52 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:40:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:40:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:40:52 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:40:58 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 07:40:58 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:40:58 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:40:58 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:40:58 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:41:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:41:04 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:41:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:41:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:41:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:41:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:41:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:41:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:41:07 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:41:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554272
Mon 20 Jan 2014 07:41:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:41:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554272
Mon 20 Jan 2014 07:41:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:41:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:41:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:41:13 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:41:13 - job_xml_thread(): Done retrieving: data size 43554272
Mon 20 Jan 2014 07:41:13 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:41:13 - XML: Start document: iteration 6
Mon 20 Jan 2014 07:41:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:41:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:41:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:41:20 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:41:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:41:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:41:22 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:41:22 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:41:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:41:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:41:22 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:41:26 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:41:26 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 07:41:28 - XML: Processed 653302 elements - found 0 jobs
Mon 20 Jan 2014 07:41:28 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:41:28 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:41:28 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:41:28 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:41:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:41:30 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:41:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:41:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:41:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:41:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:41:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:41:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:41:31 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:41:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 07:41:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:41:34 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:41:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43490656
Mon 20 Jan 2014 07:41:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:41:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43490656
Mon 20 Jan 2014 07:41:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:41:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:41:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:41:43 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:41:43 - job_xml_thread(): Done retrieving: data size 43490656
Mon 20 Jan 2014 07:41:43 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:41:43 - XML: Start document: iteration 7
Mon 20 Jan 2014 07:41:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:41:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:41:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:41:49 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:41:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:41:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:41:50 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:41:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:41:50 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:41:50 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:41:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:41:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:41:51 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:41:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:41:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:41:52 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:41:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:41:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:41:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 07:41:52 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:41:52 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:41:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:41:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:41:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 07:41:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:41:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5604 values 88374 bits 11046 bytes 
Mon 20 Jan 2014 07:41:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:41:55 - XML: Processed 652596 elements - found 0 jobs
Mon 20 Jan 2014 07:41:55 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:41:55 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:41:55 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:41:55 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:41:59 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:41:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42908651
Mon 20 Jan 2014 07:41:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:42:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42908651
Mon 20 Jan 2014 07:42:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:42:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:42:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:42:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:42:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:42:10 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:42:10 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:42:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:42:12 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:42:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:42:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:42:12 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:42:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:42:12 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:42:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:42:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:42:15 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:42:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:42:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:42:15 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:42:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 07:42:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:42:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:42:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:42:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:42:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:42:18 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:42:18 - job_xml_thread(): Done retrieving: data size 42970736
Mon 20 Jan 2014 07:42:18 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:42:18 - XML: Start document: iteration 8
Mon 20 Jan 2014 07:42:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42970736
Mon 20 Jan 2014 07:42:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:42:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42970736
Mon 20 Jan 2014 07:42:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:42:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:42:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:42:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:42:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:42:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:42:33 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:42:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:42:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:42:34 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:42:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:42:34 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:42:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:42:34 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:42:35 - XML: Processed 645864 elements - found 0 jobs
Mon 20 Jan 2014 07:42:35 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:42:35 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:42:35 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:42:35 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:42:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:42:40 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:42:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:42:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:42:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:42:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:42:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:42:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:42:43 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:42:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43464350
Mon 20 Jan 2014 07:42:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:42:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43464350
Mon 20 Jan 2014 07:42:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:42:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:42:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:42:50 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:42:50 - job_xml_thread(): Done retrieving: data size 43464350
Mon 20 Jan 2014 07:42:50 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:42:50 - XML: Start document: iteration 9
Mon 20 Jan 2014 07:42:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:42:52 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:42:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:42:53 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:42:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:42:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:42:54 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:42:54 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:42:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:42:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:42:54 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:42:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:42:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 07:42:54 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:42:54 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:42:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 07:42:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8885 values 140133 bits 17516 bytes 
Mon 20 Jan 2014 07:42:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:42:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:43:01 - XML: Processed 652334 elements - found 0 jobs
Mon 20 Jan 2014 07:43:01 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:43:01 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:43:01 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:43:01 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:43:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:43:07 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:43:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:43:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:43:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:43:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:43:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:43:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:43:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:43:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:43:09 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:43:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43545914
Mon 20 Jan 2014 07:43:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:43:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43545914
Mon 20 Jan 2014 07:43:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:43:16 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:43:16 - job_xml_thread(): Done retrieving: data size 43545914
Mon 20 Jan 2014 07:43:16 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:43:16 - XML: Start document: iteration 10
Mon 20 Jan 2014 07:43:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:43:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:43:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:43:28 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:43:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:43:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:43:29 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:43:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:43:29 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:43:29 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:43:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:43:29 - XML: Processed 653334 elements - found 0 jobs
Mon 20 Jan 2014 07:43:29 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:43:29 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:43:29 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:43:29 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:43:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:43:31 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:43:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:43:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:43:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:43:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:43:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:43:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:43:32 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:43:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 07:43:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:43:35 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:43:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582196
Mon 20 Jan 2014 07:43:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:43:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582196
Mon 20 Jan 2014 07:43:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:43:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:43:43 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:43:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:43:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:43:44 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:43:44 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:43:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:43:44 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:43:44 - job_xml_thread(): Done retrieving: data size 43582196
Mon 20 Jan 2014 07:43:44 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:43:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:43:44 - XML: Start document: iteration 11
Mon 20 Jan 2014 07:43:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582196
Mon 20 Jan 2014 07:43:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:43:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:43:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:43:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:43:54 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:43:55 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:43:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 07:43:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:43:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 07:43:55 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:43:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5477 values 86343 bits 10792 bytes 
Mon 20 Jan 2014 07:43:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:43:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:44:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:44:02 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:44:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:44:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:44:02 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:44:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:44:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:44:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:44:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:44:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:44:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:44:03 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:44:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:44:04 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:44:04 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:44:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:44:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:44:06 - XML: Processed 653353 elements - found 0 jobs
Mon 20 Jan 2014 07:44:06 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:44:06 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:44:06 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:44:06 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:44:10 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:44:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559981
Mon 20 Jan 2014 07:44:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:44:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559981
Mon 20 Jan 2014 07:44:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:44:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:44:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:44:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:44:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:44:21 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:44:21 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:44:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:44:24 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:44:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:44:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:44:25 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:44:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:44:25 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:44:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:44:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:44:26 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:44:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 07:44:26 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:44:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:44:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:44:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:44:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:44:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:44:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:44:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:44:29 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:44:29 - job_xml_thread(): Done retrieving: data size 43559562
Mon 20 Jan 2014 07:44:29 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:44:29 - XML: Start document: iteration 12
Mon 20 Jan 2014 07:44:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559562
Mon 20 Jan 2014 07:44:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:44:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559562
Mon 20 Jan 2014 07:44:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:44:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:44:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:44:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:44:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:44:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:44:43 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:44:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:44:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:44:43 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:44:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:44:43 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:44:43 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:44:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:44:47 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 07:44:47 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:44:47 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:44:47 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:44:47 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:44:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:44:53 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:44:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:44:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:44:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:44:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:44:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:44:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:44:54 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 07:44:54 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 07:44:54 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:44:55 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:44:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43547963
Mon 20 Jan 2014 07:44:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:44:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:44:55 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:44:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43547963
Mon 20 Jan 2014 07:44:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:44:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:44:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 07:44:56 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:44:56 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:44:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8864 values 139767 bits 17470 bytes 
Mon 20 Jan 2014 07:44:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 07:44:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:44:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:45:02 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:45:02 - job_xml_thread(): Done retrieving: data size 43547963
Mon 20 Jan 2014 07:45:02 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:45:02 - XML: Start document: iteration 13
Mon 20 Jan 2014 07:45:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:45:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:45:14 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 07:45:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:45:14 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:45:14 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:45:14 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:45:14 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:45:14 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:45:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:45:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:45:15 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:45:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:45:15 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:45:15 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:45:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:45:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:45:18 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:45:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:45:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:45:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:45:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:45:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:45:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:45:20 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:45:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43591911
Mon 20 Jan 2014 07:45:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:45:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43591911
Mon 20 Jan 2014 07:45:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:45:29 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:45:29 - job_xml_thread(): Done retrieving: data size 43591911
Mon 20 Jan 2014 07:45:29 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:45:29 - XML: Start document: iteration 14
Mon 20 Jan 2014 07:45:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:45:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:45:31 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:45:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 07:45:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:45:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:45:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:45:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:45:38 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:45:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:45:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:45:39 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 07:45:39 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:45:39 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:45:39 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:45:39 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:45:39 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:45:40 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:45:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:45:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:45:40 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:45:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:45:40 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:45:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:45:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:45:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:45:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:45:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:45:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:45:42 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:45:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569967
Mon 20 Jan 2014 07:45:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:45:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569967
Mon 20 Jan 2014 07:45:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:45:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:45:53 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:45:54 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:45:54 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:45:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:45:54 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:45:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:45:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:45:55 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:45:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:45:55 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:45:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:45:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:45:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:45:56 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:45:56 - job_xml_thread(): Done retrieving: data size 43567309
Mon 20 Jan 2014 07:45:56 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:45:56 - XML: Start document: iteration 15
Mon 20 Jan 2014 07:45:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567309
Mon 20 Jan 2014 07:45:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:45:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:45:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:45:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567309
Mon 20 Jan 2014 07:45:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:45:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:45:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:45:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:45:57 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:45:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:45:58 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:45:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 07:45:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 07:45:59 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:46:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6193 values 97706 bits 12213 bytes 
Mon 20 Jan 2014 07:46:07 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 07:46:07 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:46:07 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:46:07 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:46:08 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:46:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:46:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:46:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:46:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:46:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:46:18 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:46:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:46:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:46:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:46:18 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:46:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:46:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:46:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:46:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:46:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:46:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:46:19 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:46:19 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:46:19 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:46:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:46:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:46:21 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:46:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43599896
Mon 20 Jan 2014 07:46:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:46:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43599896
Mon 20 Jan 2014 07:46:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:46:23 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:46:23 - job_xml_thread(): Done retrieving: data size 43599896
Mon 20 Jan 2014 07:46:23 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:46:23 - XML: Start document: iteration 16
Mon 20 Jan 2014 07:46:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:46:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:46:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:46:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:46:35 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 07:46:35 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:46:35 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:46:35 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:46:35 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:46:42 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:46:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 07:46:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:46:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:46:43 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:46:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:46:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:46:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:46:44 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:46:44 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:46:44 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:46:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:46:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:46:44 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:46:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:46:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:46:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:46:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:46:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:46:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:46:46 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:46:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43588631
Mon 20 Jan 2014 07:46:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:46:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43588631
Mon 20 Jan 2014 07:46:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:46:50 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:46:51 - job_xml_thread(): Done retrieving: data size 43588631
Mon 20 Jan 2014 07:46:51 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:46:51 - XML: Start document: iteration 17
Mon 20 Jan 2014 07:46:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:46:58 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:46:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:46:59 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:46:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:47:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:47:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:47:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:47:01 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:47:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:47:01 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:47:01 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:47:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:47:01 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:47:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 07:47:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:47:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 07:47:01 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:47:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6194 values 97935 bits 12241 bytes 
Mon 20 Jan 2014 07:47:05 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 07:47:05 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:47:05 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:47:05 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:47:05 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:47:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:47:09 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:47:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:47:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:47:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:47:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:47:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:47:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:47:11 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:47:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43509444
Mon 20 Jan 2014 07:47:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:47:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43509444
Mon 20 Jan 2014 07:47:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:47:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:47:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:47:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:47:20 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:47:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:47:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:47:20 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:47:20 - job_xml_thread(): Done retrieving: data size 43509444
Mon 20 Jan 2014 07:47:20 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:47:20 - XML: Start document: iteration 18
Mon 20 Jan 2014 07:47:21 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:47:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:47:21 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:47:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:47:21 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:47:24 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:47:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 07:47:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:47:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:47:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:47:26 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 07:47:26 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:47:26 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:47:26 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 07:47:26 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:47:26 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 07:47:26 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 07:47:31 - XML: Processed 652682 elements - found 0 jobs
Mon 20 Jan 2014 07:47:31 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:47:31 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:47:31 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:47:31 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:47:32 - size of cluster 'LISA Cluster': 624 hosts 79479 metrics 810745 values 12793611 bits 1599201 bytes 
Mon 20 Jan 2014 07:47:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:47:34 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:47:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:47:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:47:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:47:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:47:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:47:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:47:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:47:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:47:37 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:47:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43481748
Mon 20 Jan 2014 07:47:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:47:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43481748
Mon 20 Jan 2014 07:47:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:47:46 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:47:47 - job_xml_thread(): Done retrieving: data size 43481748
Mon 20 Jan 2014 07:47:47 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:47:47 - XML: Start document: iteration 19
Mon 20 Jan 2014 07:47:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:47:49 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:47:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:47:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:47:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:47:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:47:51 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:47:51 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:47:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:47:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:47:51 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:48:00 - XML: Processed 652604 elements - found 0 jobs
Mon 20 Jan 2014 07:48:00 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:48:00 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:48:00 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:48:00 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:48:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:48:00 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:48:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:48:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:48:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:48:01 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:48:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:48:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:48:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:48:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:48:01 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:48:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 07:48:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:48:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 07:48:01 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:48:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6133 values 97024 bits 12128 bytes 
Mon 20 Jan 2014 07:48:04 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:48:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42891016
Mon 20 Jan 2014 07:48:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:48:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42891016
Mon 20 Jan 2014 07:48:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:48:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:48:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:48:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:48:13 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:48:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:48:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:48:14 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:48:14 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:48:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:48:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:48:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42891016
Mon 20 Jan 2014 07:48:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:48:15 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:48:15 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:48:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:48:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:48:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:48:26 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:48:27 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:48:27 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 07:48:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:48:28 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:48:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:48:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:48:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:48:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:48:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:48:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:48:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:48:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:48:29 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:48:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 07:48:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:48:29 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:48:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:48:29 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:48:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:48:31 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:48:31 - job_xml_thread(): Done retrieving: data size 43035853
Mon 20 Jan 2014 07:48:31 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:48:31 - XML: Start document: iteration 20
Mon 20 Jan 2014 07:48:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43035853
Mon 20 Jan 2014 07:48:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:48:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43035853
Mon 20 Jan 2014 07:48:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:48:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:48:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:48:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:48:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:48:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:48:48 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:48:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:48:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:48:49 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:48:49 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:48:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:48:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:48:49 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:48:49 - XML: Processed 647146 elements - found 0 jobs
Mon 20 Jan 2014 07:48:49 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:48:49 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:48:49 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:48:49 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:48:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:48:54 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:48:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:48:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:48:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:48:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:48:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:48:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:48:58 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:48:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43540003
Mon 20 Jan 2014 07:48:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:48:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43540003
Mon 20 Jan 2014 07:48:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:49:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:49:01 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:49:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:49:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 07:49:03 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:49:03 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:49:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 07:49:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7961 values 125649 bits 15706 bytes 
Mon 20 Jan 2014 07:49:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:49:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:49:04 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:49:04 - job_xml_thread(): Done retrieving: data size 43540003
Mon 20 Jan 2014 07:49:04 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:49:04 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 07:49:04 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 07:49:04 - Housekeeping: done.
Mon 20 Jan 2014 07:49:04 - XML: Start document: iteration 0
Mon 20 Jan 2014 07:49:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:49:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:49:15 - XML: Processed 653228 elements - found 0 jobs
Mon 20 Jan 2014 07:49:15 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:49:15 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:49:15 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:49:15 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:49:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:49:16 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:49:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:49:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:49:17 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:49:17 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:49:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:49:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:49:17 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:49:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:49:22 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:49:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:49:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:49:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:49:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:49:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:49:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:49:26 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:49:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565328
Mon 20 Jan 2014 07:49:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:49:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565328
Mon 20 Jan 2014 07:49:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:49:30 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:49:30 - job_xml_thread(): Done retrieving: data size 43565328
Mon 20 Jan 2014 07:49:30 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:49:30 - XML: Start document: iteration 1
Mon 20 Jan 2014 07:49:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:49:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:49:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:49:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:49:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:49:43 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:49:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:49:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:49:44 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:49:44 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:49:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:49:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:49:44 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:49:45 - XML: Processed 653357 elements - found 0 jobs
Mon 20 Jan 2014 07:49:45 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:49:45 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:49:45 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:49:45 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:49:46 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:49:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 07:49:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:49:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:49:50 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:49:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:49:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:49:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:49:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:49:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:49:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:49:53 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:49:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572613
Mon 20 Jan 2014 07:49:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:49:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572613
Mon 20 Jan 2014 07:49:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:50:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:50:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:50:00 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:50:00 - job_xml_thread(): Done retrieving: data size 43572613
Mon 20 Jan 2014 07:50:00 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:50:00 - XML: Start document: iteration 2
Mon 20 Jan 2014 07:50:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:50:04 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:50:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:50:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 07:50:05 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:50:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 07:50:05 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:50:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6108 values 96337 bits 12042 bytes 
Mon 20 Jan 2014 07:50:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:50:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:50:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:50:06 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:50:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:50:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:50:07 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:50:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:50:07 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:50:07 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:50:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:50:16 - XML: Processed 653356 elements - found 0 jobs
Mon 20 Jan 2014 07:50:16 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:50:16 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:50:16 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:50:16 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:50:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:50:17 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:50:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:50:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:50:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:50:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:50:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:50:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:50:21 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:50:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 07:50:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:50:21 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:50:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43552207
Mon 20 Jan 2014 07:50:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:50:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43552207
Mon 20 Jan 2014 07:50:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:50:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:50:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:50:31 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:50:31 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:50:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:50:32 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:50:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:50:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:50:32 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:50:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:50:32 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:50:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:50:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:50:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:50:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:50:37 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:50:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:50:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:50:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:50:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:50:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:50:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:50:40 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:50:40 - job_xml_thread(): Done retrieving: data size 43582068
Mon 20 Jan 2014 07:50:40 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:50:40 - XML: Start document: iteration 3
Mon 20 Jan 2014 07:50:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582068
Mon 20 Jan 2014 07:50:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:50:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582068
Mon 20 Jan 2014 07:50:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:50:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:50:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:50:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:50:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:50:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:50:54 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:50:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:50:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:50:55 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:50:55 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:50:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:50:55 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:50:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:51:00 - XML: Processed 653355 elements - found 0 jobs
Mon 20 Jan 2014 07:51:00 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:51:00 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:51:00 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:51:00 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:51:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:51:05 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:51:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:51:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:51:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:51:05 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:51:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:51:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:51:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:51:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:51:05 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:51:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:51:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 07:51:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 07:51:05 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:51:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99048 bits 12381 bytes 
Mon 20 Jan 2014 07:51:08 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:51:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564576
Mon 20 Jan 2014 07:51:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:51:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564576
Mon 20 Jan 2014 07:51:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:51:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:51:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:51:15 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:51:15 - job_xml_thread(): Done retrieving: data size 43564576
Mon 20 Jan 2014 07:51:15 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:51:15 - XML: Start document: iteration 4
Mon 20 Jan 2014 07:51:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:51:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:51:30 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 07:51:30 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:51:30 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:51:30 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:51:30 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:51:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:51:30 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:51:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:51:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:51:31 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:51:31 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:51:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:51:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:51:31 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:51:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:51:32 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:51:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:51:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:51:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:51:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:51:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:51:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:51:33 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:51:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 07:51:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:51:35 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:51:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43585283
Mon 20 Jan 2014 07:51:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:51:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43585283
Mon 20 Jan 2014 07:51:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:51:45 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:51:45 - job_xml_thread(): Done retrieving: data size 43585283
Mon 20 Jan 2014 07:51:45 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:51:45 - XML: Start document: iteration 5
Mon 20 Jan 2014 07:51:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:51:46 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:51:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:51:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:51:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:51:48 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:51:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:51:48 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:51:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:51:48 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:51:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:51:57 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 07:51:57 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:51:57 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:51:57 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:51:57 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:51:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:51:58 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:51:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:51:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:51:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:51:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:51:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:51:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:52:01 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:52:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43547361
Mon 20 Jan 2014 07:52:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:52:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43547361
Mon 20 Jan 2014 07:52:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:52:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:52:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:52:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:52:06 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:52:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:52:08 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:52:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 07:52:08 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:52:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 07:52:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8074 values 127314 bits 15914 bytes 
Mon 20 Jan 2014 07:52:12 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:52:12 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:52:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:52:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:52:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:52:16 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:52:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:52:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:52:17 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:52:17 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:52:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:52:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:52:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:52:18 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:52:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:52:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:52:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:52:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:52:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:52:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:52:22 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:52:22 - job_xml_thread(): Done retrieving: data size 43565009
Mon 20 Jan 2014 07:52:22 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:52:22 - XML: Start document: iteration 6
Mon 20 Jan 2014 07:52:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565009
Mon 20 Jan 2014 07:52:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565009
Mon 20 Jan 2014 07:52:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:52:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:52:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:52:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:52:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:52:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:52:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:52:40 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:52:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:52:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:52:41 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 07:52:41 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:52:41 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:52:41 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:52:41 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:52:41 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:52:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:52:41 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:52:41 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:52:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:52:43 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:52:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 07:52:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:52:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:52:45 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:52:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:52:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:52:45 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 07:52:45 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 07:52:45 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:52:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:52:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:52:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:52:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:52:47 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:52:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563926
Mon 20 Jan 2014 07:52:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:52:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563926
Mon 20 Jan 2014 07:52:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:52:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:52:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:52:57 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:52:57 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:52:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:52:57 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:52:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:52:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:52:59 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:53:00 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:53:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:53:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:53:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:53:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:53:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:53:01 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:53:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:53:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:53:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:53:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:53:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:53:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:53:02 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:53:02 - job_xml_thread(): Done retrieving: data size 43567211
Mon 20 Jan 2014 07:53:02 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:53:02 - XML: Start document: iteration 7
Mon 20 Jan 2014 07:53:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567211
Mon 20 Jan 2014 07:53:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567211
Mon 20 Jan 2014 07:53:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:53:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:53:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:53:08 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:53:09 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:53:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:53:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 07:53:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 07:53:09 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:53:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9190 values 144939 bits 18117 bytes 
Mon 20 Jan 2014 07:53:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:53:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:53:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:53:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:53:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:53:17 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:53:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:53:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:53:18 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:53:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:53:18 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:53:18 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:53:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:53:23 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 07:53:23 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:53:23 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:53:23 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:53:23 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:53:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:53:26 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:53:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:53:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:53:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:53:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:53:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:53:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:53:28 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:53:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43483660
Mon 20 Jan 2014 07:53:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:53:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43483660
Mon 20 Jan 2014 07:53:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:53:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:53:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:53:38 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:53:38 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:53:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:53:41 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:53:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:53:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:53:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:53:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:53:42 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:53:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:53:42 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:53:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:53:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:53:45 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:53:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:53:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:53:45 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:53:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 07:53:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:53:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:53:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:53:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:53:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:53:47 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:53:47 - job_xml_thread(): Done retrieving: data size 42964549
Mon 20 Jan 2014 07:53:47 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:53:47 - XML: Start document: iteration 8
Mon 20 Jan 2014 07:53:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42964549
Mon 20 Jan 2014 07:53:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:53:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42964549
Mon 20 Jan 2014 07:53:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:53:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:53:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:54:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:54:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:54:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:54:07 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:54:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:54:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:54:08 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:54:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:54:08 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:54:08 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:54:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:54:09 - XML: Processed 646120 elements - found 0 jobs
Mon 20 Jan 2014 07:54:09 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:54:09 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:54:09 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:54:09 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:54:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:54:09 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:54:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:54:10 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:54:10 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:54:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:54:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 07:54:10 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:54:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 07:54:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5821 values 91755 bits 11469 bytes 
Mon 20 Jan 2014 07:54:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:54:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:54:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:54:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:54:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:54:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:54:12 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:54:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42949555
Mon 20 Jan 2014 07:54:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:54:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42949555
Mon 20 Jan 2014 07:54:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:54:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:54:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:54:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:54:24 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:54:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:54:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:54:24 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:54:24 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:54:25 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:54:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:54:25 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:54:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:54:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:54:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:54:27 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 07:54:27 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:54:28 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:54:28 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:54:28 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 07:54:28 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 07:54:28 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 07:54:28 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:54:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 07:54:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:54:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:54:28 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:54:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:54:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:54:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:54:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:54:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:54:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:54:29 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 773696 values 12201779 bits 1525222 bytes 
Mon 20 Jan 2014 07:54:32 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:54:32 - job_xml_thread(): Done retrieving: data size 43086007
Mon 20 Jan 2014 07:54:32 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:54:32 - XML: Start document: iteration 9
Mon 20 Jan 2014 07:54:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43086007
Mon 20 Jan 2014 07:54:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:54:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43086007
Mon 20 Jan 2014 07:54:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:54:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:54:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:54:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:54:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:54:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:54:46 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:54:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:54:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:54:47 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:54:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:54:47 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:54:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:54:47 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:54:52 - XML: Processed 647474 elements - found 0 jobs
Mon 20 Jan 2014 07:54:52 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:54:52 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:54:52 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:54:52 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:54:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:54:55 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:54:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:54:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:54:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:54:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:54:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:54:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:54:58 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:54:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43526444
Mon 20 Jan 2014 07:54:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:54:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43526444
Mon 20 Jan 2014 07:54:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:55:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:55:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:55:08 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:55:08 - job_xml_thread(): Done retrieving: data size 43526444
Mon 20 Jan 2014 07:55:08 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:55:08 - XML: Start document: iteration 10
Mon 20 Jan 2014 07:55:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:55:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:55:10 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:55:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:55:10 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:55:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:55:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:55:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:55:11 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:55:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:55:11 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:55:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:55:11 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:55:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:55:11 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:55:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 07:55:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 07:55:11 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:55:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9347 values 147420 bits 18427 bytes 
Mon 20 Jan 2014 07:55:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:55:17 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:55:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:55:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:55:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:55:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:55:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:55:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:55:21 - XML: Processed 653032 elements - found 0 jobs
Mon 20 Jan 2014 07:55:21 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:55:21 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:55:21 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:55:21 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:55:25 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:55:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554138
Mon 20 Jan 2014 07:55:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:55:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554138
Mon 20 Jan 2014 07:55:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:55:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:55:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:55:28 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:55:28 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 07:55:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:55:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:55:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:55:35 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:55:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:55:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:55:36 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:55:36 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:55:36 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:55:36 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:55:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:55:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:55:37 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:55:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 07:55:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:55:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:55:41 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:55:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:55:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:55:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:55:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:55:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:55:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:55:45 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:55:45 - job_xml_thread(): Done retrieving: data size 43547172
Mon 20 Jan 2014 07:55:45 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:55:45 - XML: Start document: iteration 11
Mon 20 Jan 2014 07:55:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43547172
Mon 20 Jan 2014 07:55:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:55:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43547172
Mon 20 Jan 2014 07:55:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:55:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:55:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:55:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:55:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:56:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:56:00 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:56:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:56:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:56:00 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:56:00 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:56:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:56:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:56:00 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:56:02 - XML: Processed 653353 elements - found 0 jobs
Mon 20 Jan 2014 07:56:02 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:56:02 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:56:02 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:56:02 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:56:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:56:08 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:56:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:56:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:56:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:56:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:56:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:56:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:56:10 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:56:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569443
Mon 20 Jan 2014 07:56:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:56:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569443
Mon 20 Jan 2014 07:56:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:56:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:56:11 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:56:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:56:12 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:56:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 07:56:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 07:56:12 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:56:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7056 values 111340 bits 13917 bytes 
Mon 20 Jan 2014 07:56:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:56:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:56:17 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:56:17 - job_xml_thread(): Done retrieving: data size 43569443
Mon 20 Jan 2014 07:56:17 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:56:17 - XML: Start document: iteration 12
Mon 20 Jan 2014 07:56:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:56:23 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:56:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:56:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:56:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:56:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:56:24 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:56:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:56:24 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:56:25 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:56:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:56:32 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 07:56:33 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:56:33 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:56:33 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:56:33 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:56:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:56:35 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:56:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:56:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:56:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:56:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:56:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:56:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:56:39 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:56:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561059
Mon 20 Jan 2014 07:56:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:56:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561059
Mon 20 Jan 2014 07:56:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:56:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:56:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:56:48 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:56:48 - job_xml_thread(): Done retrieving: data size 43561059
Mon 20 Jan 2014 07:56:48 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:56:48 - XML: Start document: iteration 13
Mon 20 Jan 2014 07:56:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:56:48 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:56:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:56:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:56:49 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:56:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:56:49 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:56:49 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:56:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:56:49 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:56:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 07:56:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:56:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:56:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:56:57 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 07:56:57 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:56:57 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:56:57 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:56:57 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:56:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:56:59 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:56:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:56:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:57:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:57:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:57:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:57:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:57:02 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:57:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43549551
Mon 20 Jan 2014 07:57:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:57:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43549551
Mon 20 Jan 2014 07:57:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:57:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:57:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:57:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:57:12 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:57:12 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:57:12 - job_xml_thread(): Done retrieving: data size 43549551
Mon 20 Jan 2014 07:57:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:57:12 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:57:12 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:57:12 - XML: Start document: iteration 14
Mon 20 Jan 2014 07:57:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:57:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:57:13 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:57:13 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:57:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:57:13 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:57:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:57:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:57:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 07:57:13 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:57:13 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:57:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6075 values 95823 bits 11977 bytes 
Mon 20 Jan 2014 07:57:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 07:57:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:57:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:57:25 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 07:57:25 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:57:25 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:57:25 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:57:25 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:57:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:57:27 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:57:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:57:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:57:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:57:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:57:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:57:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:57:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:57:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:57:31 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:57:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43538148
Mon 20 Jan 2014 07:57:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:57:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43538148
Mon 20 Jan 2014 07:57:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:57:37 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:57:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 07:57:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:57:41 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:57:41 - job_xml_thread(): Done retrieving: data size 43538148
Mon 20 Jan 2014 07:57:41 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:57:41 - XML: Start document: iteration 15
Mon 20 Jan 2014 07:57:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:57:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:57:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:57:43 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:57:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:57:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:57:45 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:57:45 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:57:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:57:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:57:45 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:57:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:57:52 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:57:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:57:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:57:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:57:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:57:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:57:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:57:54 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 07:57:54 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:57:54 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:57:54 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:57:54 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:57:57 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:57:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43544284
Mon 20 Jan 2014 07:57:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:57:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43544284
Mon 20 Jan 2014 07:57:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:58:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:58:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:58:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:58:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:58:09 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:58:09 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:58:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:58:11 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:58:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:58:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:58:11 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:58:11 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:58:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:58:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:58:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:58:14 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:58:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:58:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:58:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:58:14 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:58:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:58:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:58:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:58:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:58:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:58:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 07:58:14 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:58:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 07:58:14 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:58:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5987 values 94420 bits 11802 bytes 
Mon 20 Jan 2014 07:58:17 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:58:17 - job_xml_thread(): Done retrieving: data size 43566064
Mon 20 Jan 2014 07:58:17 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:58:17 - XML: Start document: iteration 16
Mon 20 Jan 2014 07:58:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566064
Mon 20 Jan 2014 07:58:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:58:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566064
Mon 20 Jan 2014 07:58:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:58:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:58:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:58:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:58:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:58:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:58:32 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:58:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:58:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:58:33 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:58:33 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:58:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:58:33 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:58:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:58:36 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 07:58:36 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:58:36 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:58:36 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:58:36 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:58:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:58:41 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:58:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:58:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:58:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:58:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:58:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:58:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:58:42 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:58:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 07:58:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:58:44 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:58:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43551142
Mon 20 Jan 2014 07:58:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:58:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43551142
Mon 20 Jan 2014 07:58:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:58:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:58:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:58:51 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:58:51 - job_xml_thread(): Done retrieving: data size 43551142
Mon 20 Jan 2014 07:58:51 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:58:51 - XML: Start document: iteration 17
Mon 20 Jan 2014 07:58:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:58:56 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:58:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:58:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:58:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:58:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:58:57 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:58:57 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:58:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:58:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:58:57 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:59:05 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 07:59:05 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:59:05 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:59:05 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:59:05 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:59:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:59:07 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:59:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:59:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:59:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:59:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:59:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:59:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:59:08 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 07:59:08 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 07:59:08 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:59:09 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:59:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43508898
Mon 20 Jan 2014 07:59:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:59:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43508898
Mon 20 Jan 2014 07:59:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:59:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:59:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:59:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:59:15 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:59:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:59:15 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:59:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 07:59:15 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:59:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 07:59:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8171 values 128831 bits 16103 bytes 
Mon 20 Jan 2014 07:59:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:59:17 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:59:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:59:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:59:18 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:59:18 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:59:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:59:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:59:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43508898
Mon 20 Jan 2014 07:59:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:59:20 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 07:59:21 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:59:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:59:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:59:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:59:29 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:59:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:59:31 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:59:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:59:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:59:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:59:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:59:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:59:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:59:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:59:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:59:34 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:59:34 - job_xml_thread(): Done retrieving: data size 43472227
Mon 20 Jan 2014 07:59:34 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 07:59:34 - XML: Start document: iteration 18
Mon 20 Jan 2014 07:59:34 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:59:34 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:59:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:59:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:59:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43472227
Mon 20 Jan 2014 07:59:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:59:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43472227
Mon 20 Jan 2014 07:59:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 07:59:46 - XML: Processed 652596 elements - found 0 jobs
Mon 20 Jan 2014 07:59:46 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 07:59:46 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 07:59:46 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 07:59:46 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 07:59:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 07:59:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:59:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 07:59:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 07:59:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 07:59:52 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 07:59:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 07:59:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:59:53 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:59:53 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 07:59:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 07:59:53 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 07:59:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 07:59:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 07:59:55 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 07:59:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 07:59:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 07:59:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:59:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 07:59:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 07:59:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 07:59:55 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 07:59:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 07:59:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 07:59:57 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 07:59:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42909263
Mon 20 Jan 2014 07:59:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 07:59:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42909263
Mon 20 Jan 2014 07:59:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:00:01 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:00:01 - job_xml_thread(): Done retrieving: data size 42909263
Mon 20 Jan 2014 08:00:01 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:00:01 - XML: Start document: iteration 19
Mon 20 Jan 2014 08:00:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:00:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:00:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:00:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:00:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:00:14 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:00:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:00:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:00:15 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:00:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:00:15 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:00:15 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:00:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:00:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:00:15 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:00:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:00:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 08:00:16 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:00:16 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:00:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 08:00:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5819 values 91735 bits 11466 bytes 
Mon 20 Jan 2014 08:00:18 - XML: Processed 645158 elements - found 0 jobs
Mon 20 Jan 2014 08:00:18 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:00:18 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:00:18 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:00:18 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:00:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:00:20 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:00:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:00:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:00:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:00:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:00:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:00:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:00:22 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:00:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42963608
Mon 20 Jan 2014 08:00:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:00:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42963608
Mon 20 Jan 2014 08:00:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:00:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:00:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:00:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:00:31 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:00:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:00:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:00:32 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:00:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:00:32 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:00:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:00:33 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:00:34 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:00:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:00:36 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:00:36 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:00:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 08:00:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:00:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:00:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:00:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:00:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:00:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:00:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:00:38 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:00:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43326132
Mon 20 Jan 2014 08:00:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:00:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43326132
Mon 20 Jan 2014 08:00:38 - job_xml_thread(): Done retrieving: data size 43326132
Mon 20 Jan 2014 08:00:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:00:38 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:00:39 - XML: Start document: iteration 20
Mon 20 Jan 2014 08:00:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:00:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:00:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:00:51 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:00:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:00:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:00:52 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:00:52 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:00:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:00:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:00:52 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:00:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:00:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:00:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:00:57 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:00:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:00:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:00:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:00:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:00:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:00:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:00:59 - XML: Processed 650236 elements - found 0 jobs
Mon 20 Jan 2014 08:00:59 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:00:59 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:00:59 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:00:59 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:01:00 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:01:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43540880
Mon 20 Jan 2014 08:01:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:01:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43540880
Mon 20 Jan 2014 08:01:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:01:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:01:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:01:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:01:09 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:01:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:01:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:01:10 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:01:10 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:01:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:01:10 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:01:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:01:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:01:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:01:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:01:13 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:01:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:01:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:01:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:01:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:01:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:01:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:01:14 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:01:15 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:01:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43550692
Mon 20 Jan 2014 08:01:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:01:16 - job_xml_thread(): Done retrieving: data size 43550692
Mon 20 Jan 2014 08:01:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43550692
Mon 20 Jan 2014 08:01:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:01:16 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:01:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:01:17 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 08:01:17 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:01:17 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 08:01:17 - Housekeeping: done.
Mon 20 Jan 2014 08:01:17 - XML: Start document: iteration 0
Mon 20 Jan 2014 08:01:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:01:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 08:01:18 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:01:18 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:01:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 08:01:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 12095 values 190948 bits 23868 bytes 
Mon 20 Jan 2014 08:01:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:01:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:01:28 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 08:01:28 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:01:28 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:01:28 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 08:01:28 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 08:01:29 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:01:29 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 08:01:29 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 08:01:29 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:01:29 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:01:29 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:01:29 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:01:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:01:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:01:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:01:34 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:01:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:01:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:01:34 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:01:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:01:34 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:01:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:01:34 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:01:35 - size of cluster 'LISA Cluster': 624 hosts 79461 metrics 746307 values 11766080 bits 1470760 bytes 
Mon 20 Jan 2014 08:01:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:01:40 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:01:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:01:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:01:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:01:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:01:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:01:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:01:44 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:01:44 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:01:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562592
Mon 20 Jan 2014 08:01:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:01:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562592
Mon 20 Jan 2014 08:01:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:01:45 - job_xml_thread(): Done retrieving: data size 43562592
Mon 20 Jan 2014 08:01:45 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:01:45 - XML: Start document: iteration 1
Mon 20 Jan 2014 08:01:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:01:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:01:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:01:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:02:00 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:02:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 08:02:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:02:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:02:01 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:02:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:02:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:02:03 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:02:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:02:03 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:02:03 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:02:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:02:06 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 08:02:06 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:02:06 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:02:06 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:02:06 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:02:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:02:08 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:02:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:02:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:02:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:02:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:02:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:02:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:02:11 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:02:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583486
Mon 20 Jan 2014 08:02:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:02:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583486
Mon 20 Jan 2014 08:02:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:02:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:02:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:02:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:02:19 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:02:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:02:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 08:02:20 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:02:20 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:02:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:02:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 08:02:20 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:02:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6053 values 95783 bits 11972 bytes 
Mon 20 Jan 2014 08:02:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:02:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:02:21 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:02:21 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:02:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:02:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:02:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583486
Mon 20 Jan 2014 08:02:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:02:21 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:02:21 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:02:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:02:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:02:29 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:02:29 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 08:02:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:02:34 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:02:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:02:35 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:02:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:02:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:02:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:02:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:02:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:02:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:02:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:02:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:02:37 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:02:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:02:37 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:02:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:02:38 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:02:38 - job_xml_thread(): Done retrieving: data size 43544020
Mon 20 Jan 2014 08:02:38 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:02:38 - XML: Start document: iteration 2
Mon 20 Jan 2014 08:02:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43544020
Mon 20 Jan 2014 08:02:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43544020
Mon 20 Jan 2014 08:02:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:02:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:02:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:02:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:02:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:02:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:02:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:02:58 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:02:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:02:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:02:59 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:02:59 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:02:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:02:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:02:59 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:03:00 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 08:03:00 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:03:00 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:03:00 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:03:00 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:03:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:03:03 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:03:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:03:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:03:03 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:03:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 08:03:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:03:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:03:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:03:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:03:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:03:06 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:03:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573672
Mon 20 Jan 2014 08:03:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:03:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573672
Mon 20 Jan 2014 08:03:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:03:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:03:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:03:16 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:03:16 - job_xml_thread(): Done retrieving: data size 43573672
Mon 20 Jan 2014 08:03:16 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:03:16 - XML: Start document: iteration 3
Mon 20 Jan 2014 08:03:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:03:18 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:03:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:03:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:03:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:03:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:03:20 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:03:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:03:20 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:03:20 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:03:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:03:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:03:20 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:03:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:03:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 08:03:22 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:03:22 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:03:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 08:03:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5806 values 91705 bits 11463 bytes 
Mon 20 Jan 2014 08:03:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:03:28 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:03:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:03:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:03:28 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 08:03:28 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:03:28 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:03:28 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:03:28 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:03:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:03:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:03:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:03:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:03:32 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:03:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43544543
Mon 20 Jan 2014 08:03:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:03:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43544543
Mon 20 Jan 2014 08:03:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:03:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:03:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:03:43 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:03:43 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:03:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:03:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:03:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:03:44 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:03:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:03:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:03:44 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:03:44 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:03:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:03:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:03:46 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:03:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 08:03:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:03:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:03:48 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:03:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:03:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:03:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:03:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:03:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:03:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:03:51 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:03:51 - job_xml_thread(): Done retrieving: data size 43567276
Mon 20 Jan 2014 08:03:51 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:03:51 - XML: Start document: iteration 4
Mon 20 Jan 2014 08:03:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567276
Mon 20 Jan 2014 08:03:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:03:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567276
Mon 20 Jan 2014 08:03:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:04:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:04:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:04:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:04:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:04:09 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 08:04:09 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:04:10 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:04:10 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:04:10 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:04:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:04:13 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:04:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:04:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:04:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:04:14 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:04:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:04:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:04:14 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:04:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:04:14 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:04:14 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:04:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:04:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:04:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:04:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:04:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:04:16 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:04:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573636
Mon 20 Jan 2014 08:04:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:04:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573636
Mon 20 Jan 2014 08:04:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:04:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:04:22 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:04:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:04:23 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:04:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 08:04:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 08:04:23 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:04:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9085 values 143357 bits 17919 bytes 
Mon 20 Jan 2014 08:04:25 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:04:25 - job_xml_thread(): Done retrieving: data size 43573636
Mon 20 Jan 2014 08:04:25 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:04:25 - XML: Start document: iteration 5
Mon 20 Jan 2014 08:04:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:04:26 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:04:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:04:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:04:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:04:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:04:30 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:04:30 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:04:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:04:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:04:30 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:04:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:04:34 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:04:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:04:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:04:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:04:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:04:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:04:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:04:39 - XML: Processed 653357 elements - found 0 jobs
Mon 20 Jan 2014 08:04:39 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:04:39 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:04:39 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:04:39 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:04:42 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:04:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565008
Mon 20 Jan 2014 08:04:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:04:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565008
Mon 20 Jan 2014 08:04:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:04:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:04:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:04:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:04:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:04:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:04:53 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:04:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:04:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:04:53 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:04:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:04:53 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:04:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:04:53 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:04:54 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:04:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:04:59 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:04:59 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:04:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 08:04:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:04:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:04:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:04:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:04:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:04:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:04:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:05:02 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:05:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556245
Mon 20 Jan 2014 08:05:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:05:02 - job_xml_thread(): Done retrieving: data size 43556245
Mon 20 Jan 2014 08:05:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556245
Mon 20 Jan 2014 08:05:02 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:05:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:05:02 - XML: Start document: iteration 6
Mon 20 Jan 2014 08:05:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:05:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:05:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:05:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:05:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:05:18 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:05:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:05:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:05:20 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:05:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:05:20 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:05:20 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:05:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:05:23 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 08:05:23 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:05:23 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:05:23 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:05:23 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:05:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:05:23 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:05:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:05:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 08:05:24 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:05:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 08:05:24 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:05:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5735 values 90418 bits 11302 bytes 
Mon 20 Jan 2014 08:05:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:05:26 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:05:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:05:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:05:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:05:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:05:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:05:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:05:30 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:05:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43490019
Mon 20 Jan 2014 08:05:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:05:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43490019
Mon 20 Jan 2014 08:05:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:05:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:05:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:05:38 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:05:38 - job_xml_thread(): Done retrieving: data size 43490019
Mon 20 Jan 2014 08:05:38 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:05:38 - XML: Start document: iteration 7
Mon 20 Jan 2014 08:05:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:05:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:05:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:05:43 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:05:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:05:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:05:43 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:05:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:05:43 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:05:43 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:05:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:05:54 - XML: Processed 652591 elements - found 0 jobs
Mon 20 Jan 2014 08:05:54 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:05:54 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:05:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:05:54 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:05:54 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:05:54 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:05:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:05:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:05:54 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 08:05:54 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 08:05:54 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:05:54 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:05:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 08:05:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:05:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:05:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:05:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:05:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:05:56 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:05:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42942518
Mon 20 Jan 2014 08:05:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:05:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42942518
Mon 20 Jan 2014 08:05:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:05:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:05:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:06:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:06:06 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:06:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:06:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:06:08 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:06:08 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:06:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:06:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:06:08 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:06:09 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:06:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:06:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:06:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:06:10 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:06:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:06:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:06:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:06:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:06:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:06:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:06:12 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:06:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42935222
Mon 20 Jan 2014 08:06:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:06:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42935222
Mon 20 Jan 2014 08:06:13 - job_xml_thread(): Done retrieving: data size 42935222
Mon 20 Jan 2014 08:06:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:06:13 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:06:13 - XML: Start document: iteration 8
Mon 20 Jan 2014 08:06:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:06:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:06:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:06:24 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:06:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:06:25 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:06:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 08:06:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 08:06:25 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:06:26 - XML: Processed 645386 elements - found 0 jobs
Mon 20 Jan 2014 08:06:27 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:06:27 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:06:27 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:06:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:06:27 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:06:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:06:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8850 values 139530 bits 17441 bytes 
Mon 20 Jan 2014 08:06:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:06:30 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:06:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:06:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:06:31 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:06:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:06:31 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:06:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:06:32 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:06:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:06:33 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:06:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:06:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:06:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:06:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:06:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:06:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:06:36 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:06:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43348352
Mon 20 Jan 2014 08:06:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:06:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43348352
Mon 20 Jan 2014 08:06:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:06:42 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:06:42 - job_xml_thread(): Done retrieving: data size 43348352
Mon 20 Jan 2014 08:06:42 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:06:42 - XML: Start document: iteration 9
Mon 20 Jan 2014 08:06:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:06:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:06:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:06:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:06:52 - XML: Processed 650496 elements - found 0 jobs
Mon 20 Jan 2014 08:06:52 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:06:52 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:06:52 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:06:52 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:06:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:06:54 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:06:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:06:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:06:55 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:06:55 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:06:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:06:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:06:55 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:06:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:06:58 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:06:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:06:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:06:58 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:06:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 08:06:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:06:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:06:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:06:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:06:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:07:00 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:07:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43552552
Mon 20 Jan 2014 08:07:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:07:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43552552
Mon 20 Jan 2014 08:07:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:07:07 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:07:07 - job_xml_thread(): Done retrieving: data size 43552552
Mon 20 Jan 2014 08:07:07 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:07:07 - XML: Start document: iteration 10
Mon 20 Jan 2014 08:07:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:07:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:07:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:07:10 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:07:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:07:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:07:11 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:07:11 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:07:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:07:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:07:11 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:07:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:07:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:07:21 - XML: Processed 653346 elements - found 0 jobs
Mon 20 Jan 2014 08:07:21 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:07:21 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:07:21 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:07:21 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:07:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:07:22 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:07:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:07:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:07:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:07:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:07:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:07:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:07:24 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:07:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43550761
Mon 20 Jan 2014 08:07:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:07:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43550761
Mon 20 Jan 2014 08:07:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:07:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:07:26 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:07:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:07:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:07:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:07:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 08:07:27 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:07:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 08:07:28 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:07:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9015 values 142201 bits 17775 bytes 
Mon 20 Jan 2014 08:07:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:07:33 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:07:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:07:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:07:34 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:07:34 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:07:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:07:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:07:34 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:07:36 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:07:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:07:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:07:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:07:37 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:07:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:07:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:07:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:07:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:07:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:07:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:07:40 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:07:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579766
Mon 20 Jan 2014 08:07:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:07:41 - job_xml_thread(): Done retrieving: data size 43579766
Mon 20 Jan 2014 08:07:41 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:07:41 - XML: Start document: iteration 11
Mon 20 Jan 2014 08:07:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579766
Mon 20 Jan 2014 08:07:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:07:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:07:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:07:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:07:52 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:07:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:07:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:07:53 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:07:53 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:07:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:07:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:07:53 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:07:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:07:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:08:00 - XML: Processed 653357 elements - found 0 jobs
Mon 20 Jan 2014 08:08:01 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:08:01 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:08:01 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:08:01 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:08:03 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:08:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 08:08:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:08:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:08:04 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:08:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:08:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:08:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:08:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:08:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:08:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:08:05 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:08:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43540000
Mon 20 Jan 2014 08:08:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:08:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43540000
Mon 20 Jan 2014 08:08:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:08:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:08:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:08:16 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:08:16 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:08:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:08:18 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:08:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:08:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:08:19 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:08:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:08:19 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:08:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:08:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:08:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:08:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:08:20 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:08:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:08:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:08:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:08:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:08:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:08:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:08:23 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:08:23 - job_xml_thread(): Done retrieving: data size 43573439
Mon 20 Jan 2014 08:08:23 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:08:23 - XML: Start document: iteration 12
Mon 20 Jan 2014 08:08:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573439
Mon 20 Jan 2014 08:08:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:08:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573439
Mon 20 Jan 2014 08:08:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:08:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:08:27 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:08:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:08:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 08:08:28 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:08:28 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:08:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9174 values 144731 bits 18091 bytes 
Mon 20 Jan 2014 08:08:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 08:08:29 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 08:08:29 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:08:29 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:08:29 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 08:08:29 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 08:08:29 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:08:29 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 08:08:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:08:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:08:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:08:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:08:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:08:42 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:08:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:08:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:08:43 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 08:08:43 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:08:43 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:08:43 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:08:43 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:08:43 - size of cluster 'LISA Cluster': 624 hosts 79470 metrics 815236 values 12860342 bits 1607542 bytes 
Mon 20 Jan 2014 08:08:43 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:08:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:08:43 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:08:43 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:08:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:08:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:08:48 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:08:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:08:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:08:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:08:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:08:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:08:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:08:52 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:08:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567947
Mon 20 Jan 2014 08:08:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:08:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567947
Mon 20 Jan 2014 08:08:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:08:58 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:08:58 - job_xml_thread(): Done retrieving: data size 43567947
Mon 20 Jan 2014 08:08:58 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:08:58 - XML: Start document: iteration 13
Mon 20 Jan 2014 08:08:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:08:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:09:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:09:01 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:09:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:09:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:09:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:09:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:09:04 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:09:04 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:09:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:09:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:09:04 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:09:10 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 08:09:10 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:09:10 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:09:10 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:09:10 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:09:12 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:09:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 08:09:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:09:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:09:15 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:09:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:09:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:09:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:09:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:09:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:09:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:09:18 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:09:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43538830
Mon 20 Jan 2014 08:09:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:09:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:09:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:09:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43538830
Mon 20 Jan 2014 08:09:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:09:25 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:09:25 - job_xml_thread(): Done retrieving: data size 43538830
Mon 20 Jan 2014 08:09:25 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:09:25 - XML: Start document: iteration 14
Mon 20 Jan 2014 08:09:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:09:28 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:09:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:09:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:09:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:09:29 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:09:29 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:09:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:09:29 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:09:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:09:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:09:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 08:09:29 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:09:29 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:09:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 08:09:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5884 values 92784 bits 11598 bytes 
Mon 20 Jan 2014 08:09:29 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:09:29 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:09:29 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 08:09:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:09:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:09:38 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 08:09:38 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:09:38 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:09:38 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:09:38 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:09:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:09:41 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:09:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:09:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:09:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:09:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:09:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:09:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:09:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:09:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:09:46 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:09:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43549762
Mon 20 Jan 2014 08:09:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:09:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43549762
Mon 20 Jan 2014 08:09:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:09:53 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:09:53 - job_xml_thread(): Done retrieving: data size 43549762
Mon 20 Jan 2014 08:09:53 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:09:53 - XML: Start document: iteration 15
Mon 20 Jan 2014 08:09:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:09:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:10:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:10:04 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:10:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:10:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:10:05 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:10:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:10:05 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:10:05 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:10:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:10:08 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:10:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 08:10:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:10:08 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 08:10:08 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:10:08 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:10:08 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:10:08 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:10:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:10:09 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:10:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:10:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:10:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:10:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:10:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:10:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:10:12 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:10:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567512
Mon 20 Jan 2014 08:10:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:10:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567512
Mon 20 Jan 2014 08:10:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:10:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:10:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:10:23 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:10:23 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:10:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:10:23 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:10:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:10:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:10:24 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:10:24 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:10:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:10:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:10:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:10:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:10:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:10:28 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:10:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:10:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:10:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:10:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:10:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:10:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:10:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:10:29 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:10:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:10:29 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:10:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 08:10:29 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:10:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 08:10:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5925 values 93432 bits 11679 bytes 
Mon 20 Jan 2014 08:10:30 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:10:30 - job_xml_thread(): Done retrieving: data size 43548997
Mon 20 Jan 2014 08:10:30 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:10:30 - XML: Start document: iteration 16
Mon 20 Jan 2014 08:10:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43548997
Mon 20 Jan 2014 08:10:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:10:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43548997
Mon 20 Jan 2014 08:10:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:10:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:10:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:10:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:10:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:10:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:10:49 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:10:49 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 08:10:49 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:10:49 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:10:49 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:10:49 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:10:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:10:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:10:50 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:10:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:10:50 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:10:50 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:10:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:10:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:10:55 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:10:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:10:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:10:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:10:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:10:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:10:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:10:58 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:10:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 08:10:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:10:59 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:10:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560694
Mon 20 Jan 2014 08:10:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:10:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560694
Mon 20 Jan 2014 08:10:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:11:04 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:11:04 - job_xml_thread(): Done retrieving: data size 43560694
Mon 20 Jan 2014 08:11:04 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:11:04 - XML: Start document: iteration 17
Mon 20 Jan 2014 08:11:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:11:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:11:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:11:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:11:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:11:14 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:11:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:11:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:11:15 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:11:15 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:11:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:11:15 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:11:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:11:19 - XML: Processed 653356 elements - found 0 jobs
Mon 20 Jan 2014 08:11:19 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:11:19 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:11:19 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:11:19 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:11:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:11:23 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:11:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:11:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:11:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:11:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:11:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:11:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:11:25 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:11:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43499312
Mon 20 Jan 2014 08:11:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:11:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43499312
Mon 20 Jan 2014 08:11:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:11:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:11:29 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:11:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:11:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 08:11:30 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:11:30 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:11:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 08:11:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:11:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7076 values 111582 bits 13947 bytes 
Mon 20 Jan 2014 08:11:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:11:34 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:11:34 - job_xml_thread(): Done retrieving: data size 43499312
Mon 20 Jan 2014 08:11:34 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:11:34 - XML: Start document: iteration 18
Mon 20 Jan 2014 08:11:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:11:36 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:11:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:11:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:11:37 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:11:37 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:11:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:11:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:11:38 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:11:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:11:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:11:47 - XML: Processed 652608 elements - found 0 jobs
Mon 20 Jan 2014 08:11:47 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:11:47 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:11:47 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:11:47 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:11:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:11:48 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:11:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:11:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:11:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:11:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:11:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:11:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:11:52 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:11:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42954202
Mon 20 Jan 2014 08:11:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:11:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42954202
Mon 20 Jan 2014 08:11:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:11:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:11:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:12:02 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:12:02 - job_xml_thread(): Done retrieving: data size 42954202
Mon 20 Jan 2014 08:12:02 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:12:02 - XML: Start document: iteration 19
Mon 20 Jan 2014 08:12:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:12:02 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:12:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:12:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:12:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:12:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:12:04 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:12:04 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:12:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:12:04 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:12:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:12:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:12:13 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:12:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:12:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:12:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:12:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:12:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:12:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:12:16 - XML: Processed 646042 elements - found 0 jobs
Mon 20 Jan 2014 08:12:16 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:12:16 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:12:16 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:12:16 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:12:16 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:12:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 08:12:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:12:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:12:19 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:12:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42934557
Mon 20 Jan 2014 08:12:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:12:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:12:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42934557
Mon 20 Jan 2014 08:12:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:12:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:12:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:12:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:12:30 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:12:31 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:12:31 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:12:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:12:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 08:12:31 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:12:31 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:12:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 08:12:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5736 values 90417 bits 11302 bytes 
Mon 20 Jan 2014 08:12:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:12:32 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:12:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:12:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:12:32 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:12:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:12:32 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:12:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:12:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:12:36 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:12:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:12:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:12:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:12:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:12:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:12:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:12:38 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:12:38 - job_xml_thread(): Done retrieving: data size 43042985
Mon 20 Jan 2014 08:12:38 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:12:38 - XML: Start document: iteration 20
Mon 20 Jan 2014 08:12:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43042985
Mon 20 Jan 2014 08:12:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:12:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43042985
Mon 20 Jan 2014 08:12:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:12:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:12:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:12:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:12:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:12:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:12:52 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:12:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:12:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:12:53 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:12:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:12:53 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:12:53 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:12:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:12:59 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:12:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 08:12:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:13:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:13:01 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:13:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:13:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:13:02 - XML: Processed 646662 elements - found 0 jobs
Mon 20 Jan 2014 08:13:02 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:13:02 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:13:02 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:13:02 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:13:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:13:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:13:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:13:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:13:05 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 08:13:05 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 08:13:05 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:13:05 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:13:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43550153
Mon 20 Jan 2014 08:13:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:13:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43550153
Mon 20 Jan 2014 08:13:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:13:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:13:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:13:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:13:14 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:13:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:13:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:13:16 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:13:16 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:13:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:13:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:13:17 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:13:17 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:13:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:13:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:13:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:13:19 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:13:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:13:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:13:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:13:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:13:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:13:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:13:21 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:13:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582555
Mon 20 Jan 2014 08:13:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:13:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582555
Mon 20 Jan 2014 08:13:21 - job_xml_thread(): Done retrieving: data size 43582555
Mon 20 Jan 2014 08:13:21 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:13:21 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 08:13:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:13:22 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 08:13:22 - Housekeeping: done.
Mon 20 Jan 2014 08:13:22 - XML: Start document: iteration 0
Mon 20 Jan 2014 08:13:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:13:31 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:13:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:13:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:13:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:13:33 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:13:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 08:13:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 08:13:33 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:13:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8764 values 138145 bits 17268 bytes 
Mon 20 Jan 2014 08:13:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:13:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:13:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:13:40 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:13:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:13:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:13:42 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:13:42 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:13:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:13:42 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:13:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:13:42 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 08:13:42 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:13:42 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:13:42 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:13:42 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:13:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:13:44 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:13:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:13:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:13:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:13:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:13:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:13:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:13:47 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:13:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562454
Mon 20 Jan 2014 08:13:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:13:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562454
Mon 20 Jan 2014 08:13:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:13:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:13:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:13:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:13:57 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:13:57 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:13:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:13:57 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:13:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:13:58 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:13:58 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:13:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:13:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:14:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:14:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:14:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:14:01 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:14:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:14:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:14:01 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:14:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 08:14:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:14:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:14:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:14:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:14:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:14:03 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:14:03 - job_xml_thread(): Done retrieving: data size 43566498
Mon 20 Jan 2014 08:14:03 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:14:03 - XML: Start document: iteration 1
Mon 20 Jan 2014 08:14:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566498
Mon 20 Jan 2014 08:14:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566498
Mon 20 Jan 2014 08:14:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:14:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:14:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:14:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:14:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:14:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:14:19 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 08:14:19 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:14:19 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:14:19 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:14:19 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:14:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:14:25 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:14:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:14:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:14:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:14:26 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:14:26 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:14:26 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:14:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:14:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:14:26 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:14:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:14:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:14:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:14:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:14:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:14:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:14:28 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:14:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581451
Mon 20 Jan 2014 08:14:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:14:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581451
Mon 20 Jan 2014 08:14:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:14:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:14:33 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:14:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:14:34 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:14:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 08:14:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 08:14:34 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:14:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9201 values 145096 bits 18137 bytes 
Mon 20 Jan 2014 08:14:34 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:14:34 - job_xml_thread(): Done retrieving: data size 43581451
Mon 20 Jan 2014 08:14:34 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:14:34 - XML: Start document: iteration 2
Mon 20 Jan 2014 08:14:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:14:39 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:14:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:14:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:14:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:14:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:14:42 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:14:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:14:42 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:14:42 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:14:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:14:49 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 08:14:49 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:14:49 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:14:49 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:14:49 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:14:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:14:50 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:14:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:14:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:14:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:14:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:14:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:14:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:14:52 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:14:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571254
Mon 20 Jan 2014 08:14:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:14:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571254
Mon 20 Jan 2014 08:14:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:14:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:14:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:15:04 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:15:04 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:15:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:15:04 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:15:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:15:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:15:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:15:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:15:05 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:15:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:15:05 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:15:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:15:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:15:07 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:15:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:15:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:15:07 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:15:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 08:15:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:15:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:15:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:15:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:15:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:15:09 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:15:09 - job_xml_thread(): Done retrieving: data size 43589506
Mon 20 Jan 2014 08:15:09 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:15:09 - XML: Start document: iteration 3
Mon 20 Jan 2014 08:15:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43589506
Mon 20 Jan 2014 08:15:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43589506
Mon 20 Jan 2014 08:15:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:15:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:15:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:15:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:15:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:15:22 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:15:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:15:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:15:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:15:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:15:23 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:15:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:15:23 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:15:23 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:15:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:15:26 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 08:15:26 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:15:26 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:15:26 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:15:26 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:15:29 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 08:15:29 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:15:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:15:30 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:15:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:15:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:15:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:15:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:15:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:15:30 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:15:30 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 08:15:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:15:30 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 08:15:30 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:15:30 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 08:15:31 - size of cluster 'LISA Cluster': 624 hosts 79486 metrics 825230 values 13009777 bits 1626222 bytes 
Mon 20 Jan 2014 08:15:34 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:15:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555173
Mon 20 Jan 2014 08:15:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:15:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:15:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555173
Mon 20 Jan 2014 08:15:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:15:34 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:15:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:15:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 08:15:36 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:15:36 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:15:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 08:15:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8982 values 141635 bits 17704 bytes 
Mon 20 Jan 2014 08:15:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:15:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:15:42 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:15:42 - job_xml_thread(): Done retrieving: data size 43555173
Mon 20 Jan 2014 08:15:42 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:15:42 - XML: Start document: iteration 4
Mon 20 Jan 2014 08:15:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:15:45 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:15:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:15:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:15:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:15:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:15:46 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:15:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:15:46 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:15:46 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:15:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:15:55 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 08:15:55 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:15:55 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:15:55 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:15:55 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:15:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:15:57 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:15:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:15:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:15:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:15:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:15:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:15:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:16:01 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:16:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43539966
Mon 20 Jan 2014 08:16:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:16:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:16:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43539966
Mon 20 Jan 2014 08:16:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:16:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:16:07 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:16:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 08:16:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:16:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:16:10 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:16:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:16:11 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:16:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:16:11 - job_xml_thread(): Done retrieving: data size 43539966
Mon 20 Jan 2014 08:16:11 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:16:11 - XML: Start document: iteration 5
Mon 20 Jan 2014 08:16:12 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:16:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:16:12 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:16:12 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:16:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:16:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:16:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:16:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:16:22 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:16:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:16:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:16:22 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 08:16:22 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:16:22 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:16:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:16:22 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:16:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:16:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:16:22 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:16:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:16:25 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:16:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557206
Mon 20 Jan 2014 08:16:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:16:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557206
Mon 20 Jan 2014 08:16:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:16:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:16:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:16:30 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:16:30 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 08:16:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:16:36 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:16:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:16:37 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:16:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:16:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:16:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:16:37 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:16:37 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:16:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:16:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:16:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 08:16:38 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:16:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 08:16:38 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:16:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6204 values 97929 bits 12241 bytes 
Mon 20 Jan 2014 08:16:39 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:16:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:16:39 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:16:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:16:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:16:41 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:16:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:16:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:16:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:16:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:16:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:16:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:16:45 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:16:45 - job_xml_thread(): Done retrieving: data size 43562057
Mon 20 Jan 2014 08:16:45 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:16:45 - XML: Start document: iteration 6
Mon 20 Jan 2014 08:16:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562057
Mon 20 Jan 2014 08:16:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:16:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562057
Mon 20 Jan 2014 08:16:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:16:52 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:16:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 08:16:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:16:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:16:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:16:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:16:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:17:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:17:02 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:17:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:17:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:17:02 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 08:17:02 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:17:02 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:17:02 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:17:02 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:17:02 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:17:02 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:17:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:17:02 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:17:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:17:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:17:08 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:17:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:17:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:17:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:17:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:17:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:17:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:17:13 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:17:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43497758
Mon 20 Jan 2014 08:17:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:17:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43497758
Mon 20 Jan 2014 08:17:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:17:17 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:17:17 - job_xml_thread(): Done retrieving: data size 43497758
Mon 20 Jan 2014 08:17:17 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:17:17 - XML: Start document: iteration 7
Mon 20 Jan 2014 08:17:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:17:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:17:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:17:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:17:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:17:30 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:17:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:17:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:17:30 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:17:30 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:17:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:17:30 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:17:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:17:31 - XML: Processed 652682 elements - found 0 jobs
Mon 20 Jan 2014 08:17:31 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:17:31 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:17:31 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:17:31 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:17:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:17:37 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:17:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:17:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:17:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:17:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:17:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:17:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:17:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:17:38 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:17:38 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:17:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 08:17:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:17:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 08:17:38 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:17:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6165 values 97514 bits 12189 bytes 
Mon 20 Jan 2014 08:17:40 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:17:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43049672
Mon 20 Jan 2014 08:17:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:17:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43049672
Mon 20 Jan 2014 08:17:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:17:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:17:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:17:46 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:17:46 - job_xml_thread(): Done retrieving: data size 43049672
Mon 20 Jan 2014 08:17:46 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:17:46 - XML: Start document: iteration 8
Mon 20 Jan 2014 08:17:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:17:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:17:56 - XML: Processed 646880 elements - found 0 jobs
Mon 20 Jan 2014 08:17:56 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:17:56 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:17:56 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:17:56 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:17:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:17:59 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:17:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:17:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:18:00 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:18:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:18:00 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:18:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:18:00 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:18:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:18:04 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:18:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:18:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:18:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:18:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:18:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:18:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:18:07 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:18:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 08:18:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:18:08 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:18:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42921878
Mon 20 Jan 2014 08:18:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:18:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42921878
Mon 20 Jan 2014 08:18:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:18:11 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:18:11 - job_xml_thread(): Done retrieving: data size 42921878
Mon 20 Jan 2014 08:18:11 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:18:11 - XML: Start document: iteration 9
Mon 20 Jan 2014 08:18:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:18:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:18:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:18:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:18:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:18:24 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:18:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:18:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:18:25 - XML: Processed 645158 elements - found 0 jobs
Mon 20 Jan 2014 08:18:25 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:18:25 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:18:25 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:18:25 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:18:25 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:18:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:18:25 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:18:25 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:18:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:18:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:18:31 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:18:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:18:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:18:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:18:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:18:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:18:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:18:34 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:18:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43063735
Mon 20 Jan 2014 08:18:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:18:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43063735
Mon 20 Jan 2014 08:18:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:18:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:18:38 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:18:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:18:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 08:18:40 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:18:40 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:18:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 08:18:40 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:18:40 - job_xml_thread(): Done retrieving: data size 43063735
Mon 20 Jan 2014 08:18:40 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:18:40 - XML: Start document: iteration 10
Mon 20 Jan 2014 08:18:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7535 values 119044 bits 14880 bytes 
Mon 20 Jan 2014 08:18:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:18:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:18:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:18:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:18:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:18:51 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:18:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:18:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:18:52 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:18:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:18:52 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:18:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:18:52 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:18:54 - XML: Processed 647142 elements - found 0 jobs
Mon 20 Jan 2014 08:18:54 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:18:54 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:18:54 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:18:54 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:18:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:18:58 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:18:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:18:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:18:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:18:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:18:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:18:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:19:02 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:19:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43549553
Mon 20 Jan 2014 08:19:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:19:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43549553
Mon 20 Jan 2014 08:19:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:19:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:19:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:19:09 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:19:09 - job_xml_thread(): Done retrieving: data size 43549553
Mon 20 Jan 2014 08:19:09 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:19:09 - XML: Start document: iteration 11
Mon 20 Jan 2014 08:19:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:19:12 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:19:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:19:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:19:13 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:19:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:19:13 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:19:13 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:19:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:19:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:19:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:19:15 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:19:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 08:19:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:19:20 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 08:19:20 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:19:20 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:19:20 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:19:20 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:19:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:19:24 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:19:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:19:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:19:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:19:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:19:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:19:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:19:27 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:19:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43536559
Mon 20 Jan 2014 08:19:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:19:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43536559
Mon 20 Jan 2014 08:19:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:19:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:19:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:19:35 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:19:35 - job_xml_thread(): Done retrieving: data size 43536559
Mon 20 Jan 2014 08:19:35 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:19:35 - XML: Start document: iteration 12
Mon 20 Jan 2014 08:19:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:19:40 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:19:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:19:40 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:19:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 08:19:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 08:19:40 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:19:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6152 values 97014 bits 12126 bytes 
Mon 20 Jan 2014 08:19:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:19:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:19:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:19:42 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:19:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:19:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:19:43 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:19:43 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:19:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:19:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:19:43 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:19:49 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 08:19:49 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:19:49 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:19:49 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:19:49 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:19:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:19:51 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:19:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:19:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:19:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:19:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:19:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:19:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:19:54 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:19:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 08:19:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:19:55 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:19:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555636
Mon 20 Jan 2014 08:19:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:19:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555636
Mon 20 Jan 2014 08:19:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:19:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:19:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:20:04 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:20:04 - job_xml_thread(): Done retrieving: data size 43555636
Mon 20 Jan 2014 08:20:04 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:20:04 - XML: Start document: iteration 13
Mon 20 Jan 2014 08:20:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:20:05 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:20:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:20:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:20:06 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:20:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:20:06 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:20:06 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:20:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:20:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:20:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:20:17 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 08:20:17 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:20:17 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:20:17 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:20:17 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:20:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:20:18 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:20:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:20:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:20:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:20:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:20:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:20:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:20:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:20:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:20:21 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 08:20:21 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 08:20:21 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:20:21 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:20:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43541755
Mon 20 Jan 2014 08:20:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:20:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43541755
Mon 20 Jan 2014 08:20:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:20:32 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:20:32 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:20:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:20:33 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:20:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:20:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:20:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:20:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:20:35 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:20:35 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:20:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:20:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:20:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:20:37 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:20:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:20:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:20:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:20:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:20:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:20:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:20:39 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:20:39 - job_xml_thread(): Done retrieving: data size 43580321
Mon 20 Jan 2014 08:20:39 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:20:39 - XML: Start document: iteration 14
Mon 20 Jan 2014 08:20:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580321
Mon 20 Jan 2014 08:20:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:20:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:20:40 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:20:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580321
Mon 20 Jan 2014 08:20:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:20:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:20:41 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:20:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 08:20:41 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:20:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 08:20:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6128 values 96675 bits 12084 bytes 
Mon 20 Jan 2014 08:20:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:20:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:20:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:20:52 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:20:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:20:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:20:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:20:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:20:54 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:20:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:20:54 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:20:54 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:20:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:20:56 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 08:20:56 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:20:56 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:20:56 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:20:56 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:21:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:21:01 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:21:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:21:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:21:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:21:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:21:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:21:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:21:03 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:21:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563490
Mon 20 Jan 2014 08:21:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:21:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563490
Mon 20 Jan 2014 08:21:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:21:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:21:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:21:11 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:21:11 - job_xml_thread(): Done retrieving: data size 43563490
Mon 20 Jan 2014 08:21:11 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:21:11 - XML: Start document: iteration 15
Mon 20 Jan 2014 08:21:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:21:15 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:21:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:21:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:21:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:21:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:21:16 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:21:16 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:21:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:21:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:21:17 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:21:22 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 08:21:22 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:21:22 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:21:22 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:21:22 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:21:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:21:26 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:21:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:21:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:21:26 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:21:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 08:21:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:21:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:21:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:21:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:21:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:21:27 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:21:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43545362
Mon 20 Jan 2014 08:21:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:21:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43545362
Mon 20 Jan 2014 08:21:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:21:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:21:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:21:37 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:21:37 - job_xml_thread(): Done retrieving: data size 43545362
Mon 20 Jan 2014 08:21:37 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:21:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:21:37 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:21:37 - XML: Start document: iteration 16
Mon 20 Jan 2014 08:21:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:21:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:21:38 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:21:38 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:21:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:21:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:21:38 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:21:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:21:41 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:21:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:21:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:21:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:21:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 08:21:41 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:21:41 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:21:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 08:21:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5844 values 92172 bits 11521 bytes 
Mon 20 Jan 2014 08:21:46 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 08:21:46 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:21:46 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:21:46 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:21:46 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:21:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:21:48 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:21:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:21:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:21:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:21:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:21:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:21:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:21:51 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:21:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553873
Mon 20 Jan 2014 08:21:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:21:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553873
Mon 20 Jan 2014 08:21:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:21:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:21:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:21:53 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:21:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 08:21:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:22:01 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:22:01 - job_xml_thread(): Done retrieving: data size 43553873
Mon 20 Jan 2014 08:22:01 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:22:01 - XML: Start document: iteration 17
Mon 20 Jan 2014 08:22:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:22:03 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:22:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:22:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:22:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:22:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:22:04 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:22:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:22:04 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:22:04 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:22:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:22:12 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 08:22:12 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:22:12 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:22:12 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:22:12 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:22:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:22:14 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:22:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:22:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:22:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:22:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:22:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:22:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:22:16 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:22:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43542222
Mon 20 Jan 2014 08:22:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:22:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43542222
Mon 20 Jan 2014 08:22:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:22:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:22:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:22:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:22:26 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:22:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:22:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:22:27 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:22:28 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:22:28 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:22:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:22:28 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:22:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:22:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:22:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:22:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:22:30 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:22:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:22:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:22:31 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 08:22:31 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:22:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:22:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:22:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:22:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:22:31 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:22:31 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:22:31 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 08:22:31 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 08:22:31 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 08:22:32 - size of cluster 'LISA Cluster': 624 hosts 79479 metrics 768673 values 12130604 bits 1516325 bytes 
Mon 20 Jan 2014 08:22:34 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:22:34 - job_xml_thread(): Done retrieving: data size 43568661
Mon 20 Jan 2014 08:22:34 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:22:34 - XML: Start document: iteration 18
Mon 20 Jan 2014 08:22:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568661
Mon 20 Jan 2014 08:22:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:22:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568661
Mon 20 Jan 2014 08:22:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:22:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:22:42 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:22:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:22:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 08:22:42 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:22:42 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:22:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7725 values 121847 bits 15230 bytes 
Mon 20 Jan 2014 08:22:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 08:22:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:22:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:22:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:22:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:22:54 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 08:22:54 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:22:54 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:22:54 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:22:54 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:22:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:22:57 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:22:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:22:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:22:58 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:22:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:22:58 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:22:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:22:58 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:22:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:22:59 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:22:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:22:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:22:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:22:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:22:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:22:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:23:03 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:23:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576091
Mon 20 Jan 2014 08:23:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:23:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576091
Mon 20 Jan 2014 08:23:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:23:10 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:23:10 - job_xml_thread(): Done retrieving: data size 43576091
Mon 20 Jan 2014 08:23:10 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:23:10 - XML: Start document: iteration 19
Mon 20 Jan 2014 08:23:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:23:11 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:23:12 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:23:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 08:23:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:23:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:23:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:23:14 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:23:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:23:14 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:23:14 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:23:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:23:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:23:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:23:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:23:23 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:23:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:23:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:23:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:23:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:23:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:23:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:23:25 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 08:23:25 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:23:25 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:23:25 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:23:25 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:23:28 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:23:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43476615
Mon 20 Jan 2014 08:23:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:23:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:23:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43476615
Mon 20 Jan 2014 08:23:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:23:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:23:31 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:23:31 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 08:23:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:23:39 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:23:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:23:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:23:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:23:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:23:39 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:23:39 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:23:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:23:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:23:39 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:23:40 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:23:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:23:42 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:23:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:23:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 08:23:42 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:23:42 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:23:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 08:23:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6189 values 97612 bits 12201 bytes 
Mon 20 Jan 2014 08:23:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:23:43 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:23:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:23:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:23:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:23:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:23:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:23:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:23:47 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:23:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42937381
Mon 20 Jan 2014 08:23:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:23:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42937381
Mon 20 Jan 2014 08:23:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:23:47 - job_xml_thread(): Done retrieving: data size 42937381
Mon 20 Jan 2014 08:23:47 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:23:47 - XML: Start document: iteration 20
Mon 20 Jan 2014 08:23:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:23:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:23:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:23:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:24:02 - XML: Processed 645686 elements - found 0 jobs
Mon 20 Jan 2014 08:24:02 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:24:02 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:24:02 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:24:02 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:24:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:24:07 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:24:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:24:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:24:08 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:24:08 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:24:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:24:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:24:08 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:24:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:24:10 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:24:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:24:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:24:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:24:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:24:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:24:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:24:11 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:24:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 08:24:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:24:14 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:24:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42949212
Mon 20 Jan 2014 08:24:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:24:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42949212
Mon 20 Jan 2014 08:24:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:24:17 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:24:17 - job_xml_thread(): Done retrieving: data size 42949212
Mon 20 Jan 2014 08:24:17 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:24:17 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 08:24:18 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 08:24:19 - Housekeeping: done.
Mon 20 Jan 2014 08:24:19 - XML: Start document: iteration 0
Mon 20 Jan 2014 08:24:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:24:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:24:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:24:26 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:24:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:24:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:24:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:24:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:24:27 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:24:27 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:24:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:24:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:24:27 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:24:33 - XML: Processed 645583 elements - found 0 jobs
Mon 20 Jan 2014 08:24:33 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:24:33 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:24:33 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:24:33 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:24:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:24:37 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:24:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:24:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:24:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:24:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:24:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:24:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:24:40 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:24:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43299826
Mon 20 Jan 2014 08:24:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:24:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43299826
Mon 20 Jan 2014 08:24:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:24:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:24:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:24:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:24:43 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:24:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:24:44 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:24:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 08:24:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 08:24:44 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:24:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8701 values 137101 bits 17137 bytes 
Mon 20 Jan 2014 08:24:48 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:24:48 - job_xml_thread(): Done retrieving: data size 43299826
Mon 20 Jan 2014 08:24:48 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:24:48 - XML: Start document: iteration 1
Mon 20 Jan 2014 08:24:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:24:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:24:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:24:54 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:24:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:24:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:24:55 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:24:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:24:55 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:24:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:24:55 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:25:00 - XML: Processed 650184 elements - found 0 jobs
Mon 20 Jan 2014 08:25:00 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:25:00 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:25:00 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:25:00 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:25:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:25:03 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:25:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:25:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:25:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:25:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:25:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:25:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:25:06 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:25:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 08:25:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:25:06 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:25:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43551603
Mon 20 Jan 2014 08:25:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:25:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43551603
Mon 20 Jan 2014 08:25:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:25:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:25:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:25:15 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:25:15 - job_xml_thread(): Done retrieving: data size 43551603
Mon 20 Jan 2014 08:25:15 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:25:15 - XML: Start document: iteration 2
Mon 20 Jan 2014 08:25:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:25:19 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:25:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:25:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:25:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:25:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:25:20 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:25:20 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:25:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:25:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:25:20 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:25:27 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 08:25:27 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:25:27 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:25:27 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:25:27 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:25:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:25:29 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:25:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:25:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:25:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:25:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:25:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:25:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:25:32 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:25:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43531658
Mon 20 Jan 2014 08:25:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:25:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43531658
Mon 20 Jan 2014 08:25:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:25:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:25:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:25:42 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:25:42 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:25:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:25:43 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:25:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:25:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:25:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:25:44 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:25:44 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:25:45 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:25:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:25:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:25:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:25:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 08:25:45 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:25:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 08:25:45 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:25:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99050 bits 12381 bytes 
Mon 20 Jan 2014 08:25:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:25:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:25:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:25:48 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:25:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:25:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:25:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:25:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:25:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:25:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:25:53 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:25:53 - job_xml_thread(): Done retrieving: data size 43547723
Mon 20 Jan 2014 08:25:53 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:25:53 - XML: Start document: iteration 3
Mon 20 Jan 2014 08:25:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43547723
Mon 20 Jan 2014 08:25:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43547723
Mon 20 Jan 2014 08:25:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:25:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:26:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:26:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:26:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:26:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:26:08 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:26:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 08:26:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:26:09 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 08:26:09 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:26:09 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:26:09 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:26:09 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:26:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:26:13 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:26:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:26:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:26:15 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:26:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:26:15 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:26:15 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:26:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:26:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:26:16 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:26:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:26:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:26:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:26:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:26:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:26:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:26:20 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:26:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560678
Mon 20 Jan 2014 08:26:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:26:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560678
Mon 20 Jan 2014 08:26:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:26:24 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:26:24 - job_xml_thread(): Done retrieving: data size 43560678
Mon 20 Jan 2014 08:26:24 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:26:24 - XML: Start document: iteration 4
Mon 20 Jan 2014 08:26:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:26:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:26:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:26:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:26:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:26:38 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:26:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:26:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:26:39 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:26:39 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:26:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:26:39 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:26:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:26:40 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 08:26:40 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:26:40 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:26:40 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:26:40 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:26:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:26:42 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:26:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:26:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:26:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:26:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:26:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:26:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:26:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:26:45 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:26:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:26:45 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:26:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 08:26:45 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:26:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6063 values 95631 bits 11953 bytes 
Mon 20 Jan 2014 08:26:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 08:26:46 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:26:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576444
Mon 20 Jan 2014 08:26:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:26:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576444
Mon 20 Jan 2014 08:26:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:26:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:26:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:26:55 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:26:55 - job_xml_thread(): Done retrieving: data size 43576444
Mon 20 Jan 2014 08:26:55 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:26:55 - XML: Start document: iteration 5
Mon 20 Jan 2014 08:26:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:26:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:27:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:27:02 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:27:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:27:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:27:02 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:27:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:27:02 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:27:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:27:02 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:27:05 - XML: Processed 653356 elements - found 0 jobs
Mon 20 Jan 2014 08:27:05 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:27:05 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:27:05 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:27:05 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:27:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:27:09 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:27:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:27:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:27:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:27:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:27:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:27:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:27:12 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 08:27:12 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 08:27:12 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:27:12 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:27:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570231
Mon 20 Jan 2014 08:27:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:27:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570231
Mon 20 Jan 2014 08:27:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:27:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:27:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:27:20 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:27:20 - job_xml_thread(): Done retrieving: data size 43570231
Mon 20 Jan 2014 08:27:20 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:27:20 - XML: Start document: iteration 6
Mon 20 Jan 2014 08:27:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:27:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:27:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:27:30 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:27:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:27:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:27:32 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:27:32 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:27:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:27:32 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:27:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:27:32 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 08:27:32 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:27:32 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:27:32 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:27:32 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:27:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:27:35 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:27:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:27:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:27:35 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:27:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 08:27:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:27:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:27:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:27:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:27:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:27:37 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:27:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573149
Mon 20 Jan 2014 08:27:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:27:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573149
Mon 20 Jan 2014 08:27:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:27:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:27:46 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:27:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:27:46 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:27:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:27:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:27:47 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:27:47 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:27:47 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:27:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:27:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:27:47 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:27:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:27:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 08:27:48 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:27:48 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:27:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 08:27:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6029 values 95087 bits 11885 bytes 
Mon 20 Jan 2014 08:27:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:27:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:27:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:27:51 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:27:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:27:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:27:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:27:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:27:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:27:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:27:54 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:27:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577540
Mon 20 Jan 2014 08:27:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:27:54 - job_xml_thread(): Done retrieving: data size 43577540
Mon 20 Jan 2014 08:27:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577540
Mon 20 Jan 2014 08:27:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:27:55 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:27:55 - XML: Start document: iteration 7
Mon 20 Jan 2014 08:28:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:28:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:28:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:28:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:28:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:28:12 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:28:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:28:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:28:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:28:13 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:28:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:28:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:28:13 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:28:13 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:28:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:28:14 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:28:14 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 08:28:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:28:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:28:14 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:28:14 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:28:14 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:28:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:28:14 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:28:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:28:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:28:14 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:28:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 08:28:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:28:16 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:28:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576865
Mon 20 Jan 2014 08:28:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:28:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576865
Mon 20 Jan 2014 08:28:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:28:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:28:27 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:28:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:28:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:28:29 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:28:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:28:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:28:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:28:29 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:28:29 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:28:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:28:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:28:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:28:30 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:28:30 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:28:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:28:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:28:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:28:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:28:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:28:31 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:28:31 - job_xml_thread(): Done retrieving: data size 43575225
Mon 20 Jan 2014 08:28:31 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:28:31 - XML: Start document: iteration 8
Mon 20 Jan 2014 08:28:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575225
Mon 20 Jan 2014 08:28:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:28:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575225
Mon 20 Jan 2014 08:28:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:28:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:28:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:28:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:28:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:28:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:28:48 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:28:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:28:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 08:28:49 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:28:49 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:28:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 08:28:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9127 values 143967 bits 17995 bytes 
Mon 20 Jan 2014 08:28:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:28:50 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:28:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:28:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:28:51 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:28:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:28:51 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:28:51 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:28:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:28:53 - XML: Processed 653356 elements - found 0 jobs
Mon 20 Jan 2014 08:28:53 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:28:53 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:28:53 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:28:53 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:28:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:28:55 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:28:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:28:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:28:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:28:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:28:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:28:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:28:57 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:28:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 08:28:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:28:57 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:28:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43586132
Mon 20 Jan 2014 08:28:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:28:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43586132
Mon 20 Jan 2014 08:28:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:29:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:29:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:29:08 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:29:08 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:29:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:29:08 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:29:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:29:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:29:09 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:29:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:29:09 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:29:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:29:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:29:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:29:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:29:11 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:29:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:29:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:29:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:29:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:29:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:29:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:29:14 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:29:14 - job_xml_thread(): Done retrieving: data size 43507725
Mon 20 Jan 2014 08:29:14 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:29:14 - XML: Start document: iteration 9
Mon 20 Jan 2014 08:29:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43507725
Mon 20 Jan 2014 08:29:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:29:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43507725
Mon 20 Jan 2014 08:29:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:29:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:29:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:29:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:29:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:29:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:29:29 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:29:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:29:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:29:30 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:29:30 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:29:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:29:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:29:30 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:29:31 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 08:29:31 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:29:32 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:29:32 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:29:32 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 08:29:32 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 08:29:32 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 08:29:35 - XML: Processed 652608 elements - found 0 jobs
Mon 20 Jan 2014 08:29:35 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:29:35 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:29:35 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:29:35 - job_xml_thread(): Sleeping.. (15s)
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Mon 20 Jan 2014 08:29:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:29:38 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:29:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:29:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:29:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:29:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:29:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:29:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:29:39 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:29:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43050653
Mon 20 Jan 2014 08:29:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:29:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43050653
Mon 20 Jan 2014 08:29:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:29:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:29:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:29:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:29:48 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:29:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:29:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:29:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:29:49 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:29:50 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:29:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:29:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:29:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 08:29:50 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:29:50 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:29:50 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:29:50 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:29:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:29:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 08:29:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148578 bits 18572 bytes 
Mon 20 Jan 2014 08:29:50 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:29:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:29:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:29:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:29:53 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:29:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:29:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:29:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:29:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:29:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:29:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:29:55 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:29:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42939226
Mon 20 Jan 2014 08:29:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:29:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42939226
Mon 20 Jan 2014 08:29:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:29:57 - job_xml_thread(): Done retrieving: data size 42939226
Mon 20 Jan 2014 08:29:57 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:29:57 - XML: Start document: iteration 10
Mon 20 Jan 2014 08:30:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:30:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:30:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:30:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:30:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:30:09 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:30:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:30:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:30:10 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:30:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:30:10 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:30:10 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:30:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:30:17 - XML: Processed 645432 elements - found 0 jobs
Mon 20 Jan 2014 08:30:17 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:30:17 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:30:17 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:30:17 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:30:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:30:18 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:30:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:30:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:30:18 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:30:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 08:30:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:30:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:30:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:30:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:30:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:30:20 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:30:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42946924
Mon 20 Jan 2014 08:30:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:30:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42946924
Mon 20 Jan 2014 08:30:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:30:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:30:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:30:32 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:30:32 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:30:32 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:30:33 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:30:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:30:33 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:30:33 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:30:33 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 08:30:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:30:33 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 08:30:33 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:30:33 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 08:30:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:30:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:30:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:30:34 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:30:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:30:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:30:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:30:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:30:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:30:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:30:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:30:35 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 862947 values 13601001 bits 1700125 bytes 
Mon 20 Jan 2014 08:30:35 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:30:35 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:30:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:30:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:30:38 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:30:38 - job_xml_thread(): Done retrieving: data size 43345611
Mon 20 Jan 2014 08:30:38 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:30:38 - XML: Start document: iteration 11
Mon 20 Jan 2014 08:30:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43345611
Mon 20 Jan 2014 08:30:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:30:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43345611
Mon 20 Jan 2014 08:30:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:30:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:30:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:30:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:30:50 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:30:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:30:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:30:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:30:51 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:30:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 08:30:52 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:30:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 08:30:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8756 values 138055 bits 17256 bytes 
Mon 20 Jan 2014 08:30:54 - XML: Processed 650588 elements - found 0 jobs
Mon 20 Jan 2014 08:30:54 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:30:54 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:30:54 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:30:54 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:31:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:31:01 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:31:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:31:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:31:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:31:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:31:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:31:02 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:31:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:31:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:31:02 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:31:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:31:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:31:04 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:31:04 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:31:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:31:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:31:08 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:31:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570958
Mon 20 Jan 2014 08:31:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:31:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570958
Mon 20 Jan 2014 08:31:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:31:09 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:31:09 - job_xml_thread(): Done retrieving: data size 43570958
Mon 20 Jan 2014 08:31:09 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:31:09 - XML: Start document: iteration 12
Mon 20 Jan 2014 08:31:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:31:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:31:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:31:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:31:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:31:24 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:31:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:31:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:31:25 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:31:25 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:31:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:31:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:31:25 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:31:31 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 08:31:31 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:31:31 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:31:31 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:31:31 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:31:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:31:32 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:31:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:31:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:31:32 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:31:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 08:31:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:31:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:31:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:31:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:31:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:31:34 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:31:34 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 08:31:35 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:31:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43548926
Mon 20 Jan 2014 08:31:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:31:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43548926
Mon 20 Jan 2014 08:31:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:31:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:31:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:31:46 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:31:46 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:31:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:31:46 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:31:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:31:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:31:47 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:31:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:31:47 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:31:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:31:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:31:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:31:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:31:50 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:31:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:31:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:31:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:31:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:31:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:31:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:31:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:31:52 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:31:52 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:31:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:31:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 08:31:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 08:31:52 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:31:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5824 values 91983 bits 11497 bytes 
Mon 20 Jan 2014 08:31:54 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:31:54 - job_xml_thread(): Done retrieving: data size 43571068
Mon 20 Jan 2014 08:31:54 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:31:54 - XML: Start document: iteration 13
Mon 20 Jan 2014 08:31:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571068
Mon 20 Jan 2014 08:31:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571068
Mon 20 Jan 2014 08:31:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:31:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:32:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:32:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:32:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:32:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:32:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:32:11 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:32:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:32:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:32:12 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:32:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:32:12 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:32:12 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:32:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:32:16 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 08:32:16 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:32:16 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:32:16 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:32:16 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:32:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:32:18 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:32:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:32:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:32:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:32:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:32:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:32:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:32:21 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:32:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 08:32:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:32:22 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:32:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561591
Mon 20 Jan 2014 08:32:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:32:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561591
Mon 20 Jan 2014 08:32:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:32:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:32:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:32:31 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:32:31 - job_xml_thread(): Done retrieving: data size 43561591
Mon 20 Jan 2014 08:32:31 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:32:31 - XML: Start document: iteration 14
Mon 20 Jan 2014 08:32:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:32:33 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:32:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:32:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:32:34 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:32:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:32:34 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:32:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:32:34 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:32:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:32:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:32:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:32:44 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:32:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:32:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:32:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:32:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:32:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:32:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:32:45 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 08:32:45 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:32:45 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:32:45 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:32:45 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:32:48 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:32:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43543292
Mon 20 Jan 2014 08:32:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:32:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:32:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43543292
Mon 20 Jan 2014 08:32:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:32:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:32:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:32:53 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:32:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:32:55 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:32:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 08:32:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 08:32:55 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:32:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7614 values 120434 bits 15054 bytes 
Mon 20 Jan 2014 08:33:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:33:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:33:00 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:33:00 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:33:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:33:00 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:33:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:33:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:33:01 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:33:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:33:01 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:33:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:33:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:33:04 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:33:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:33:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:33:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:33:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:33:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:33:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:33:06 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 08:33:06 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 08:33:06 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:33:07 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:33:07 - job_xml_thread(): Done retrieving: data size 43574974
Mon 20 Jan 2014 08:33:07 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:33:07 - XML: Start document: iteration 15
Mon 20 Jan 2014 08:33:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574974
Mon 20 Jan 2014 08:33:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:33:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574974
Mon 20 Jan 2014 08:33:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:33:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:33:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:33:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:33:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:33:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:33:26 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:33:26 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 08:33:26 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:33:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:33:26 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:33:26 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:33:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:33:26 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:33:27 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:33:27 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:33:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:33:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:33:28 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:33:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:33:29 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:33:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:33:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:33:30 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:33:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 08:33:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:33:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:33:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:33:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:33:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:33:31 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:33:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566995
Mon 20 Jan 2014 08:33:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:33:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566995
Mon 20 Jan 2014 08:33:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:33:41 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:33:41 - job_xml_thread(): Done retrieving: data size 43566995
Mon 20 Jan 2014 08:33:41 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:33:41 - XML: Start document: iteration 16
Mon 20 Jan 2014 08:33:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:33:42 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:33:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:33:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:33:44 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:33:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:33:44 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:33:45 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:33:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:33:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:33:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:33:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:33:54 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:33:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:33:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:33:54 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 08:33:54 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:33:54 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:33:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:33:54 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:33:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:33:54 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:33:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:33:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:33:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:33:55 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:33:56 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:33:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:33:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 08:33:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 08:33:56 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:33:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6022 values 95256 bits 11907 bytes 
Mon 20 Jan 2014 08:33:56 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:33:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560729
Mon 20 Jan 2014 08:33:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:33:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560729
Mon 20 Jan 2014 08:33:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:34:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:34:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:34:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:34:05 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:34:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:34:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:34:06 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:34:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:34:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560729
Mon 20 Jan 2014 08:34:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:34:06 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:34:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:34:09 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:34:09 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:34:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:34:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:34:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:34:18 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:34:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:34:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:34:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:34:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:34:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:34:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:34:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:34:19 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:34:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:34:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:34:22 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:34:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:34:22 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:34:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:34:22 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:34:22 - job_xml_thread(): Done retrieving: data size 43551254
Mon 20 Jan 2014 08:34:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43551254
Mon 20 Jan 2014 08:34:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:34:22 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:34:22 - XML: Start document: iteration 17
Mon 20 Jan 2014 08:34:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43551254
Mon 20 Jan 2014 08:34:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:34:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:34:33 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:34:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:34:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:34:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:34:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:34:37 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:34:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:34:37 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:34:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:34:37 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:34:42 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 08:34:42 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:34:42 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:34:42 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:34:42 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:34:43 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:34:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 08:34:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:34:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:34:45 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:34:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:34:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:34:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:34:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:34:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:34:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:34:47 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:34:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43547413
Mon 20 Jan 2014 08:34:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:34:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43547413
Mon 20 Jan 2014 08:34:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:34:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:34:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:34:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:34:56 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:34:57 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:34:57 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:34:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:34:57 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:34:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:34:57 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:34:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 08:34:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 08:34:57 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:34:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6289 values 99165 bits 12395 bytes 
Mon 20 Jan 2014 08:34:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:34:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:34:59 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:34:59 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:34:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:34:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:35:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:35:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:35:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:35:02 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:35:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:35:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:35:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:35:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:35:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:35:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:35:04 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:35:04 - job_xml_thread(): Done retrieving: data size 43560665
Mon 20 Jan 2014 08:35:04 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:35:04 - XML: Start document: iteration 18
Mon 20 Jan 2014 08:35:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560665
Mon 20 Jan 2014 08:35:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:35:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560665
Mon 20 Jan 2014 08:35:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:35:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:35:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:35:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:35:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:35:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:35:19 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:35:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:35:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:35:21 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:35:21 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:35:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:35:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:35:21 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:35:27 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 08:35:27 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:35:27 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:35:27 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:35:27 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:35:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:35:28 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:35:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:35:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:35:28 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:35:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 08:35:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:35:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:35:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:35:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:35:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:35:30 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:35:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43498908
Mon 20 Jan 2014 08:35:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:35:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43498908
Mon 20 Jan 2014 08:35:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:35:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:35:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:35:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:35:39 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:35:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:35:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:35:39 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:35:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:35:39 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:35:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:35:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43498908
Mon 20 Jan 2014 08:35:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:35:43 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:35:43 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:35:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:35:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:35:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:35:48 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:35:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:35:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:35:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:35:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:35:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:35:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:35:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:35:51 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:35:53 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:35:53 - job_xml_thread(): Done retrieving: data size 42925768
Mon 20 Jan 2014 08:35:53 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:35:53 - XML: Start document: iteration 19
Mon 20 Jan 2014 08:35:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42925768
Mon 20 Jan 2014 08:35:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:35:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:35:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:35:57 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:35:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:35:57 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:35:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:35:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42925768
Mon 20 Jan 2014 08:35:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:35:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:35:58 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:35:58 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:35:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:35:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 08:35:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 08:35:58 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:36:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8912 values 140564 bits 17570 bytes 
Mon 20 Jan 2014 08:36:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:36:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:36:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:36:08 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:36:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:36:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:36:13 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:36:13 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:36:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:36:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:36:14 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:36:14 - XML: Processed 645586 elements - found 0 jobs
Mon 20 Jan 2014 08:36:14 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:36:14 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:36:14 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:36:14 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:36:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:36:16 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:36:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:36:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:36:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:36:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:36:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:36:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:36:19 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:36:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42963492
Mon 20 Jan 2014 08:36:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42963492
Mon 20 Jan 2014 08:36:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:36:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:36:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:36:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:36:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:36:29 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:36:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:36:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:36:29 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:36:29 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:36:29 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:36:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:36:29 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:36:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:36:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:36:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:36:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:36:35 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:36:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:36:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:36:35 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:36:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 08:36:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:36:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:36:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:36:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:36:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:36:37 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:36:37 - job_xml_thread(): Done retrieving: data size 43377315
Mon 20 Jan 2014 08:36:37 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:36:37 - XML: Start document: iteration 20
Mon 20 Jan 2014 08:36:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43377315
Mon 20 Jan 2014 08:36:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:36:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43377315
Mon 20 Jan 2014 08:36:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:36:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:36:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:36:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:36:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:36:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:36:55 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:36:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:36:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:36:56 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:36:56 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:36:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:36:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:36:56 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:36:57 - XML: Processed 651132 elements - found 0 jobs
Mon 20 Jan 2014 08:36:57 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:36:57 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:36:57 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:36:57 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:36:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:36:59 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:36:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:36:59 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:37:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 08:37:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 08:37:00 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:37:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5510 values 86870 bits 10858 bytes 
Mon 20 Jan 2014 08:37:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:37:00 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:37:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:37:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:37:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:37:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:37:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:37:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:37:02 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:37:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43544497
Mon 20 Jan 2014 08:37:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:37:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43544497
Mon 20 Jan 2014 08:37:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:37:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:37:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:37:13 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:37:13 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:37:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:37:13 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:37:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:37:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:37:13 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:37:13 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:37:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:37:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:37:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:37:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:37:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:37:16 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:37:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:37:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:37:16 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:37:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 08:37:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:37:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:37:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:37:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:37:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:37:17 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:37:17 - job_xml_thread(): Done retrieving: data size 43558668
Mon 20 Jan 2014 08:37:17 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:37:17 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 08:37:17 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 08:37:17 - Housekeeping: done.
Mon 20 Jan 2014 08:37:17 - XML: Start document: iteration 0
Mon 20 Jan 2014 08:37:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558668
Mon 20 Jan 2014 08:37:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:37:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558668
Mon 20 Jan 2014 08:37:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:37:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:37:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:37:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:37:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:37:34 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 08:37:34 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:37:36 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:37:36 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:37:36 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 08:37:36 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 08:37:36 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 08:37:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:37:37 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:37:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:37:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:37:39 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:37:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:37:39 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:37:39 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:37:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:37:39 - XML: Processed 653357 elements - found 0 jobs
Mon 20 Jan 2014 08:37:39 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:37:39 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:37:39 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:37:39 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:37:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:37:43 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:37:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:37:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:37:43 - size of cluster 'LISA Cluster': 624 hosts 79487 metrics 934212 values 14746612 bits 1843326 bytes 
Mon 20 Jan 2014 08:37:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:37:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:37:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:37:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:37:46 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:37:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554125
Mon 20 Jan 2014 08:37:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:37:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554125
Mon 20 Jan 2014 08:37:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:37:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:37:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:37:54 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:37:54 - job_xml_thread(): Done retrieving: data size 43554125
Mon 20 Jan 2014 08:37:54 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:37:54 - XML: Start document: iteration 1
Mon 20 Jan 2014 08:37:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:37:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:38:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:38:00 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:38:00 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:38:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 08:38:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:38:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 08:38:01 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:38:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:38:01 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:38:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8697 values 137152 bits 17144 bytes 
Mon 20 Jan 2014 08:38:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:38:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:38:02 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:38:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:38:02 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:38:02 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:38:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:38:09 - XML: Processed 653355 elements - found 0 jobs
Mon 20 Jan 2014 08:38:09 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:38:09 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:38:09 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:38:10 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:38:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:38:10 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:38:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:38:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:38:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:38:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:38:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:38:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:38:13 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:38:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558698
Mon 20 Jan 2014 08:38:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:38:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558698
Mon 20 Jan 2014 08:38:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:38:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:38:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:38:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:38:24 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:38:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:38:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:38:25 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:38:25 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:38:26 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:38:26 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:38:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:38:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:38:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:38:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:38:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:38:29 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:38:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:38:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:38:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:38:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:38:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:38:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:38:30 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:38:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 08:38:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:38:33 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:38:33 - job_xml_thread(): Done retrieving: data size 43558929
Mon 20 Jan 2014 08:38:33 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:38:33 - XML: Start document: iteration 2
Mon 20 Jan 2014 08:38:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558929
Mon 20 Jan 2014 08:38:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:38:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558929
Mon 20 Jan 2014 08:38:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:38:36 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:38:36 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 08:38:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:38:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:38:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:38:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:38:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:38:52 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:38:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:38:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:38:53 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:38:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:38:53 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:38:53 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:38:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:38:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:38:57 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:38:57 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 08:38:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:38:57 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:38:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:38:57 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:38:57 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:38:57 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:38:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:38:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:38:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:38:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:39:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:39:00 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:39:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:39:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 08:39:01 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:39:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 08:39:01 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:39:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5379 values 84800 bits 10600 bytes 
Mon 20 Jan 2014 08:39:02 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:39:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557718
Mon 20 Jan 2014 08:39:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:39:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557718
Mon 20 Jan 2014 08:39:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:39:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:39:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:39:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:39:11 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:39:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:39:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:39:12 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:39:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:39:12 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:39:12 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:39:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:39:12 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:39:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:39:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:39:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:39:18 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:39:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:39:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:39:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:39:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:39:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:39:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:39:21 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:39:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 08:39:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:39:22 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:39:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560985
Mon 20 Jan 2014 08:39:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:39:23 - job_xml_thread(): Done retrieving: data size 43560985
Mon 20 Jan 2014 08:39:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560985
Mon 20 Jan 2014 08:39:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:39:23 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:39:23 - XML: Start document: iteration 3
Mon 20 Jan 2014 08:39:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:39:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:39:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:39:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:39:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:39:37 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:39:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:39:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:39:38 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:39:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:39:38 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:39:38 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:39:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:39:44 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 08:39:44 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:39:44 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:39:44 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:39:44 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:39:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:39:46 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:39:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:39:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:39:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:39:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:39:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:39:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:39:51 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:39:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43546739
Mon 20 Jan 2014 08:39:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:39:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43546739
Mon 20 Jan 2014 08:39:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:39:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:39:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:39:59 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:39:59 - job_xml_thread(): Done retrieving: data size 43546739
Mon 20 Jan 2014 08:39:59 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:39:59 - XML: Start document: iteration 4
Mon 20 Jan 2014 08:40:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:40:01 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:40:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:40:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:40:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:40:01 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:40:01 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:40:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 08:40:01 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:40:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:40:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:40:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 08:40:02 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:40:01 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:40:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:40:02 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:40:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6739 values 106237 bits 13279 bytes 
Mon 20 Jan 2014 08:40:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:40:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:40:11 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 08:40:11 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:40:11 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:40:11 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:40:11 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:40:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:40:13 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:40:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:40:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:40:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:40:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:40:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:40:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:40:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:40:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:40:17 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:40:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43529509
Mon 20 Jan 2014 08:40:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:40:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43529509
Mon 20 Jan 2014 08:40:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:40:26 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:40:26 - job_xml_thread(): Done retrieving: data size 43529509
Mon 20 Jan 2014 08:40:26 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:40:26 - XML: Start document: iteration 5
Mon 20 Jan 2014 08:40:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:40:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:40:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:40:30 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:40:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:40:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:40:31 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:40:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:40:31 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:40:31 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:40:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:40:32 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:40:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 08:40:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:40:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:40:40 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:40:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:40:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:40:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:40:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:40:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:40:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:40:41 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 08:40:41 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:40:41 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:40:41 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:40:41 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:40:45 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:40:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43538388
Mon 20 Jan 2014 08:40:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:40:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43538388
Mon 20 Jan 2014 08:40:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:40:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:40:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:40:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:40:54 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:40:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:40:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:40:54 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:40:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:40:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43538388
Mon 20 Jan 2014 08:40:54 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:40:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:40:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:40:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:40:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:40:57 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:40:57 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:41:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:41:02 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:41:02 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:41:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:41:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 08:41:02 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:41:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 08:41:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:41:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6028 values 95099 bits 11887 bytes 
Mon 20 Jan 2014 08:41:02 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:41:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:41:05 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:41:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:41:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:41:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:41:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:41:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:41:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:41:10 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:41:10 - job_xml_thread(): Done retrieving: data size 43558364
Mon 20 Jan 2014 08:41:10 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:41:10 - XML: Start document: iteration 6
Mon 20 Jan 2014 08:41:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558364
Mon 20 Jan 2014 08:41:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:41:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:41:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:41:11 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:41:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:41:11 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:41:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558364
Mon 20 Jan 2014 08:41:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:41:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:41:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:41:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:41:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:41:26 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:41:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:41:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:41:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:41:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:41:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:41:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:41:28 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:41:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:41:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:41:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:41:32 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:41:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:41:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:41:34 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:41:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:41:34 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:41:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:41:34 - XML: Processed 653348 elements - found 0 jobs
Mon 20 Jan 2014 08:41:34 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:41:34 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:41:34 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:41:34 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:41:34 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:41:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 08:41:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:41:37 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:41:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43052538
Mon 20 Jan 2014 08:41:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:41:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43052538
Mon 20 Jan 2014 08:41:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:41:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:41:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:41:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:41:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:41:49 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:41:49 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:41:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:41:49 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:41:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:41:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:41:50 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:41:50 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:41:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:41:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:41:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:41:52 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:41:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:41:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:41:53 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 08:41:53 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 08:41:53 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:41:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:41:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:41:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:41:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:41:54 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:41:54 - job_xml_thread(): Done retrieving: data size 42942229
Mon 20 Jan 2014 08:41:54 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:41:54 - XML: Start document: iteration 7
Mon 20 Jan 2014 08:41:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42942229
Mon 20 Jan 2014 08:41:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:41:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42942229
Mon 20 Jan 2014 08:41:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:42:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:42:03 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:42:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:42:04 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:42:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 08:42:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 08:42:04 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:42:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:42:05 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:42:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8829 values 139220 bits 17402 bytes 
Mon 20 Jan 2014 08:42:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:42:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:42:06 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:42:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:42:06 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:42:06 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:42:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:42:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:42:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:42:12 - XML: Processed 645480 elements - found 0 jobs
Mon 20 Jan 2014 08:42:12 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:42:12 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:42:12 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:42:12 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:42:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:42:16 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:42:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:42:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:42:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:42:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:42:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:42:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:42:18 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:42:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42941923
Mon 20 Jan 2014 08:42:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:42:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42941923
Mon 20 Jan 2014 08:42:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:42:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:42:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:42:28 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:42:28 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:42:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:42:28 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:42:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:42:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:42:29 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:42:29 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:42:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:42:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:42:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:42:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:42:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:42:34 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:42:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:42:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:42:34 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:42:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 08:42:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:42:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:42:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:42:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:42:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:42:35 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:42:35 - job_xml_thread(): Done retrieving: data size 43173024
Mon 20 Jan 2014 08:42:35 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:42:35 - XML: Start document: iteration 8
Mon 20 Jan 2014 08:42:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43173024
Mon 20 Jan 2014 08:42:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:42:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43173024
Mon 20 Jan 2014 08:42:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:42:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:42:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:42:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:42:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:42:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:42:50 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:42:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:42:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:42:50 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:42:50 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:42:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:42:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:42:50 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:42:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:42:58 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:42:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:42:58 - XML: Processed 648536 elements - found 0 jobs
Mon 20 Jan 2014 08:42:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:42:58 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:42:58 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:42:58 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:42:58 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:42:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:42:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:42:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:42:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:43:00 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:43:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43539686
Mon 20 Jan 2014 08:43:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:43:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43539686
Mon 20 Jan 2014 08:43:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:43:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:43:04 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:43:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:43:05 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:43:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 08:43:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 08:43:05 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:43:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8809 values 138875 bits 17359 bytes 
Mon 20 Jan 2014 08:43:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:43:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:43:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:43:11 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:43:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:43:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:43:13 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:43:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:43:13 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:43:13 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:43:14 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:43:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:43:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:43:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:43:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:43:15 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:43:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:43:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:43:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:43:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:43:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:43:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:43:18 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:43:18 - job_xml_thread(): Done retrieving: data size 43560717
Mon 20 Jan 2014 08:43:18 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:43:18 - XML: Start document: iteration 9
Mon 20 Jan 2014 08:43:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560717
Mon 20 Jan 2014 08:43:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560717
Mon 20 Jan 2014 08:43:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:43:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:43:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:43:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:43:30 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 08:43:30 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:43:30 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:43:30 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:43:30 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:43:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:43:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:43:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:43:36 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:43:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:43:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:43:37 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:43:37 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:43:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:43:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:43:37 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:43:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:43:41 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:43:41 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:43:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 08:43:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:43:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:43:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:43:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:43:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:43:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:43:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:43:42 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:43:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563067
Mon 20 Jan 2014 08:43:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:43:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563067
Mon 20 Jan 2014 08:43:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:43:46 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:43:46 - job_xml_thread(): Done retrieving: data size 43563067
Mon 20 Jan 2014 08:43:47 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:43:47 - XML: Start document: iteration 10
Mon 20 Jan 2014 08:43:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:43:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:43:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:43:52 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:43:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:43:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:43:53 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:43:53 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:43:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:43:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:43:54 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:43:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:43:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:44:02 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 08:44:03 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:44:03 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:44:03 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:44:03 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:44:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:44:04 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:44:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:44:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:44:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:44:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:44:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:44:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:44:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:44:05 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:44:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:44:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 08:44:05 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:44:05 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:44:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 08:44:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5835 values 91972 bits 11496 bytes 
Mon 20 Jan 2014 08:44:06 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:44:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43546086
Mon 20 Jan 2014 08:44:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:44:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43546086
Mon 20 Jan 2014 08:44:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:44:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:44:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:44:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:44:18 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:44:18 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:44:18 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:44:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:44:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:44:19 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:44:19 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:44:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:44:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:44:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:44:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:44:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:44:21 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:44:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:44:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:44:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:44:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:44:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:44:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:44:23 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:44:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 08:44:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:44:24 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:44:24 - job_xml_thread(): Done retrieving: data size 43577313
Mon 20 Jan 2014 08:44:24 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:44:24 - XML: Start document: iteration 11
Mon 20 Jan 2014 08:44:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577313
Mon 20 Jan 2014 08:44:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:44:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577313
Mon 20 Jan 2014 08:44:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:44:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:44:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:44:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:44:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:44:37 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 08:44:37 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:44:38 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:44:38 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 08:44:38 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:44:38 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 08:44:39 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 08:44:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:44:40 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:44:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:44:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Mon 20 Jan 2014 08:44:41 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:44:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:44:42 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:44:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:44:42 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:44:43 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 08:44:43 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:44:43 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:44:43 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:44:43 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:44:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:44:46 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:44:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:44:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:44:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:44:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:44:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:44:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:44:48 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:44:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558878
Mon 20 Jan 2014 08:44:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:44:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558878
Mon 20 Jan 2014 08:44:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:44:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:44:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:44:58 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:44:59 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:45:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:45:00 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:45:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:45:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:45:01 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:45:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:45:01 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:45:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:45:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:45:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:45:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:45:03 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:45:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:45:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:45:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:45:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:45:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:45:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:45:05 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:45:05 - job_xml_thread(): Done retrieving: data size 43565530
Mon 20 Jan 2014 08:45:05 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:45:05 - XML: Start document: iteration 12
Mon 20 Jan 2014 08:45:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:45:05 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:45:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565530
Mon 20 Jan 2014 08:45:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565530
Mon 20 Jan 2014 08:45:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:45:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:45:07 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:45:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:45:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 08:45:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 08:45:08 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:45:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 10652 values 167932 bits 20991 bytes 
Mon 20 Jan 2014 08:45:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:45:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:45:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:45:18 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:45:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:45:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:45:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:45:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:45:20 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:45:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:45:20 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:45:20 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:45:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:45:23 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 08:45:23 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:45:23 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:45:23 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:45:23 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:45:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:45:25 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:45:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:45:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:45:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:45:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:45:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:45:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:45:28 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:45:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568958
Mon 20 Jan 2014 08:45:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:45:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568958
Mon 20 Jan 2014 08:45:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:45:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:45:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:45:38 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:45:38 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:45:39 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:45:39 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:45:41 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:45:41 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:45:41 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 08:45:41 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 08:45:41 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 08:45:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:45:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:45:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:45:42 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:45:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:45:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:45:43 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:45:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:45:43 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:45:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Mon 20 Jan 2014 08:45:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:45:44 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:45:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:45:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:45:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:45:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:45:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:45:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:45:44 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:45:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 08:45:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:45:45 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:45:46 - job_xml_thread(): Done retrieving: data size 43554936
Mon 20 Jan 2014 08:45:46 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:45:46 - XML: Start document: iteration 13
Mon 20 Jan 2014 08:45:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554936
Mon 20 Jan 2014 08:45:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:45:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554936
Mon 20 Jan 2014 08:45:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:45:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:45:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:45:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:46:00 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 08:46:00 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:46:00 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:46:00 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:46:00 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:46:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:46:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:46:02 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:46:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:46:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:46:03 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:46:03 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:46:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:46:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:46:03 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:46:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:46:05 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:46:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:46:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:46:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:46:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:46:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:46:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:46:06 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:46:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578877
Mon 20 Jan 2014 08:46:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:46:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578877
Mon 20 Jan 2014 08:46:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:46:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:46:08 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:46:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:46:08 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:46:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 08:46:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 08:46:08 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:46:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9140 values 144185 bits 18023 bytes 
Mon 20 Jan 2014 08:46:15 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:46:15 - job_xml_thread(): Done retrieving: data size 43578877
Mon 20 Jan 2014 08:46:15 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:46:15 - XML: Start document: iteration 14
Mon 20 Jan 2014 08:46:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:46:15 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:46:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:46:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:46:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:46:20 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:46:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:46:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:46:20 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:46:20 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:46:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:46:21 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:46:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:46:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:46:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:46:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:46:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:46:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:46:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:46:24 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 08:46:24 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:46:24 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:46:24 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:46:24 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:46:27 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:46:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579105
Mon 20 Jan 2014 08:46:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:46:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579105
Mon 20 Jan 2014 08:46:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:46:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:46:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:46:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:46:36 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:46:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:46:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:46:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:46:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:46:37 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:46:37 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:46:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:46:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:46:37 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:46:39 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:46:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:46:41 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:46:41 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:46:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 08:46:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:46:41 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:46:41 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:46:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:46:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:46:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:46:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:46:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:46:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:46:41 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:46:41 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 08:46:41 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:46:41 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 08:46:41 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 08:46:42 - size of cluster 'LISA Cluster': 624 hosts 79482 metrics 994945 values 15687258 bits 1960907 bytes 
Mon 20 Jan 2014 08:46:45 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:46:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557440
Mon 20 Jan 2014 08:46:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:46:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557440
Mon 20 Jan 2014 08:46:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:46:46 - job_xml_thread(): Done retrieving: data size 43557440
Mon 20 Jan 2014 08:46:46 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:46:46 - XML: Start document: iteration 15
Mon 20 Jan 2014 08:46:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:46:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:46:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:46:55 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:46:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:46:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:46:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:46:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:46:57 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:46:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:46:57 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:46:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:46:57 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:47:02 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 08:47:02 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:47:02 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:47:02 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:47:02 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:47:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:47:06 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:47:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:47:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:47:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:47:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:47:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:47:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:47:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:47:08 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:47:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:47:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 08:47:08 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:47:08 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:47:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 08:47:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6197 values 97986 bits 12248 bytes 
Mon 20 Jan 2014 08:47:10 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:47:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558883
Mon 20 Jan 2014 08:47:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:47:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558883
Mon 20 Jan 2014 08:47:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:47:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:47:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:47:18 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:47:18 - job_xml_thread(): Done retrieving: data size 43558883
Mon 20 Jan 2014 08:47:18 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:47:18 - XML: Start document: iteration 16
Mon 20 Jan 2014 08:47:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:47:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:47:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:47:24 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:47:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:47:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:47:24 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:47:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:47:24 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:47:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:47:24 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:47:31 - XML: Processed 653304 elements - found 0 jobs
Mon 20 Jan 2014 08:47:31 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:47:31 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:47:31 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:47:31 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:47:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:47:33 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:47:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:47:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:47:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:47:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:47:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:47:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:47:36 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:47:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 08:47:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:47:37 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:47:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43398826
Mon 20 Jan 2014 08:47:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:47:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43398826
Mon 20 Jan 2014 08:47:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:47:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:47:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:47:41 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:47:41 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 08:47:46 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:47:46 - job_xml_thread(): Done retrieving: data size 43398826
Mon 20 Jan 2014 08:47:46 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:47:46 - XML: Start document: iteration 17
Mon 20 Jan 2014 08:47:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:47:46 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:47:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:47:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:47:48 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:47:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:47:48 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:47:48 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:47:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:47:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:47:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:47:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:47:55 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:47:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:47:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:47:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:47:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:47:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:47:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:47:58 - XML: Processed 651574 elements - found 0 jobs
Mon 20 Jan 2014 08:47:58 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:47:58 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:47:58 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:47:58 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:48:01 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 08:48:01 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 08:48:01 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:48:01 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:48:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42882209
Mon 20 Jan 2014 08:48:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:48:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42882209
Mon 20 Jan 2014 08:48:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:48:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:48:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:48:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:48:09 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:48:10 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:48:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:48:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 08:48:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 08:48:10 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:48:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7488 values 118427 bits 14803 bytes 
Mon 20 Jan 2014 08:48:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:48:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:48:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:48:11 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:48:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:48:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:48:13 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:48:13 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:48:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:48:13 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:48:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:48:14 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:48:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:48:16 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:48:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:48:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:48:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:48:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:48:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:48:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:48:19 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:48:19 - job_xml_thread(): Done retrieving: data size 42972073
Mon 20 Jan 2014 08:48:19 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:48:19 - XML: Start document: iteration 18
Mon 20 Jan 2014 08:48:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42972073
Mon 20 Jan 2014 08:48:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:48:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42972073
Mon 20 Jan 2014 08:48:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:48:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:48:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:48:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:48:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:48:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:48:37 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:48:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:48:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:48:37 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:48:37 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:48:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:48:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:48:38 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:48:42 - XML: Processed 645848 elements - found 0 jobs
Mon 20 Jan 2014 08:48:42 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:48:42 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:48:42 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:48:42 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:48:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:48:42 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:48:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:48:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:48:42 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:48:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 08:48:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:48:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:48:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:48:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:48:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:48:45 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:48:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43433259
Mon 20 Jan 2014 08:48:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:48:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43433259
Mon 20 Jan 2014 08:48:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:48:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:48:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:48:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:48:53 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:48:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:48:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:48:54 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:48:54 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:48:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:48:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:48:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43433259
Mon 20 Jan 2014 08:48:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:48:57 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:48:57 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:48:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:48:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:49:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:49:06 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:49:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:49:06 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:49:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:49:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:49:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:49:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:49:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:49:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:49:09 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:49:09 - job_xml_thread(): Done retrieving: data size 43555177
Mon 20 Jan 2014 08:49:09 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:49:09 - XML: Start document: iteration 19
Mon 20 Jan 2014 08:49:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:49:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555177
Mon 20 Jan 2014 08:49:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:49:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:49:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:49:10 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:49:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:49:10 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:49:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 08:49:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 08:49:10 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:49:10 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:49:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:49:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555177
Mon 20 Jan 2014 08:49:11 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:49:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:49:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:49:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5795 values 91457 bits 11432 bytes 
Mon 20 Jan 2014 08:49:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:49:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:49:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:49:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:49:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:49:29 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:49:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:49:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:49:30 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 08:49:30 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:49:30 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:49:30 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:49:30 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:49:30 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:49:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:49:30 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:49:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:49:30 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:49:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:49:32 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:49:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:49:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:49:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:49:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:49:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:49:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:49:35 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:49:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566396
Mon 20 Jan 2014 08:49:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:49:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566396
Mon 20 Jan 2014 08:49:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:49:41 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:49:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 08:49:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:49:45 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:49:45 - job_xml_thread(): Done retrieving: data size 43566396
Mon 20 Jan 2014 08:49:45 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:49:45 - XML: Start document: iteration 20
Mon 20 Jan 2014 08:49:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:49:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:49:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:49:47 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:49:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:49:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:49:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:49:48 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:49:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:49:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:49:48 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:49:48 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:49:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:49:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:49:55 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:49:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:49:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:49:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:49:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:49:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:49:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:49:58 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 08:49:58 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:49:58 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:49:58 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:49:58 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:50:00 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:50:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43539484
Mon 20 Jan 2014 08:50:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:50:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43539484
Mon 20 Jan 2014 08:50:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:50:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:50:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:50:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:50:11 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:50:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:50:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:50:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:50:11 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:50:12 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:50:12 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:50:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:50:12 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:50:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:50:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 08:50:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 08:50:12 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:50:12 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:50:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:50:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6295 values 99253 bits 12406 bytes 
Mon 20 Jan 2014 08:50:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:50:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:50:13 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:50:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:50:14 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:50:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:50:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:50:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:50:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:50:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:50:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:50:17 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:50:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567333
Mon 20 Jan 2014 08:50:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:50:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567333
Mon 20 Jan 2014 08:50:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:50:18 - job_xml_thread(): Done retrieving: data size 43567333
Mon 20 Jan 2014 08:50:18 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:50:18 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 08:50:19 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 08:50:19 - Housekeeping: done.
Mon 20 Jan 2014 08:50:19 - XML: Start document: iteration 0
Mon 20 Jan 2014 08:50:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:50:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:50:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:50:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:50:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:50:39 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:50:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:50:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:50:40 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:50:40 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:50:40 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 08:50:40 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:50:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:50:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:50:40 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:50:40 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:50:40 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:50:40 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:50:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:50:41 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:50:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:50:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:50:42 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:50:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 08:50:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:50:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:50:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:50:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:50:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:50:44 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:50:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578914
Mon 20 Jan 2014 08:50:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:50:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578914
Mon 20 Jan 2014 08:50:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:50:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:50:54 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:50:55 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:50:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:50:55 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:50:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:50:56 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:50:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:50:56 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:50:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:50:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:50:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:50:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:50:57 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:50:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:50:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:50:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:50:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:50:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:50:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:51:00 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:51:00 - job_xml_thread(): Done retrieving: data size 43572047
Mon 20 Jan 2014 08:51:00 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:51:00 - XML: Start document: iteration 1
Mon 20 Jan 2014 08:51:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572047
Mon 20 Jan 2014 08:51:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:51:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572047
Mon 20 Jan 2014 08:51:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:51:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:51:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:51:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:51:12 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:51:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:51:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:51:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:51:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 08:51:13 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:51:14 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:51:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 08:51:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8962 values 141299 bits 17662 bytes 
Mon 20 Jan 2014 08:51:17 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 08:51:17 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:51:17 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:51:17 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:51:17 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:51:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:51:18 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:51:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:51:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:51:20 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:51:20 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:51:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:51:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:51:20 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:51:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:51:22 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:51:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:51:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:51:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:51:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:51:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:51:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:51:25 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:51:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43588053
Mon 20 Jan 2014 08:51:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:51:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43588053
Mon 20 Jan 2014 08:51:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:51:32 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:51:32 - job_xml_thread(): Done retrieving: data size 43588053
Mon 20 Jan 2014 08:51:32 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:51:33 - XML: Start document: iteration 2
Mon 20 Jan 2014 08:51:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:51:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:51:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:51:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:51:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:51:42 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:51:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:51:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:51:44 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:51:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:51:44 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:51:44 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 08:51:44 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:51:44 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:51:44 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:51:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:51:44 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:51:44 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:51:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:51:49 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:51:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:51:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:51:49 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:51:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 08:51:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:51:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:51:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:51:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:51:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:51:51 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:51:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563223
Mon 20 Jan 2014 08:51:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:51:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563223
Mon 20 Jan 2014 08:51:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:52:00 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:52:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:52:00 - job_xml_thread(): Done retrieving: data size 43563223
Mon 20 Jan 2014 08:52:00 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:52:00 - XML: Start document: iteration 3
Mon 20 Jan 2014 08:52:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:52:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:52:03 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:52:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:52:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:52:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:52:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:52:05 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:52:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:52:05 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:52:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:52:05 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:52:11 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 08:52:11 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:52:11 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:52:11 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:52:11 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:52:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:52:13 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:52:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:52:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:52:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:52:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:52:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:52:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:52:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:52:14 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:52:14 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:52:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 08:52:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:52:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 08:52:14 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:52:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5701 values 89875 bits 11234 bytes 
Mon 20 Jan 2014 08:52:15 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:52:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43544831
Mon 20 Jan 2014 08:52:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:52:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43544831
Mon 20 Jan 2014 08:52:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:52:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:52:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:52:26 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:52:26 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:52:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:52:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:52:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:52:29 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:52:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:52:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:52:30 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:52:30 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:52:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:52:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:52:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:52:30 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:52:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:52:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:52:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:52:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:52:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:52:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:52:32 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:52:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 08:52:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:52:33 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:52:33 - job_xml_thread(): Done retrieving: data size 43566513
Mon 20 Jan 2014 08:52:33 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:52:33 - XML: Start document: iteration 4
Mon 20 Jan 2014 08:52:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566513
Mon 20 Jan 2014 08:52:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:52:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566513
Mon 20 Jan 2014 08:52:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:52:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:52:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:52:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:52:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:52:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:52:49 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:52:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:52:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:52:50 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:52:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:52:50 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:52:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:52:50 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:52:53 - XML: Processed 653356 elements - found 0 jobs
Mon 20 Jan 2014 08:52:53 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:52:53 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:52:53 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:52:53 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:52:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:52:56 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:52:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:52:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:52:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:52:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:52:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:52:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:52:58 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:52:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570271
Mon 20 Jan 2014 08:52:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:52:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570271
Mon 20 Jan 2014 08:52:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:53:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:53:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:53:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:53:06 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:53:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:53:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:53:07 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:53:08 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:53:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:53:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:53:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570271
Mon 20 Jan 2014 08:53:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:53:08 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:53:08 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:53:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:53:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:53:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:53:14 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:53:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:53:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 08:53:15 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:53:15 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:53:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 08:53:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7142 values 112624 bits 14078 bytes 
Mon 20 Jan 2014 08:53:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:53:16 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:53:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:53:18 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:53:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:53:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:53:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:53:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:53:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:53:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:53:21 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:53:21 - job_xml_thread(): Done retrieving: data size 43480611
Mon 20 Jan 2014 08:53:21 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:53:21 - XML: Start document: iteration 5
Mon 20 Jan 2014 08:53:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43480611
Mon 20 Jan 2014 08:53:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:53:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:53:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:53:24 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:53:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:53:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43480611
Mon 20 Jan 2014 08:53:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:53:24 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:53:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:53:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:53:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:53:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:53:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:53:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:53:39 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:53:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:53:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:53:40 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:53:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:53:40 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:53:40 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:53:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:53:42 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 08:53:42 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:53:42 - XML: Processed 652608 elements - found 0 jobs
Mon 20 Jan 2014 08:53:42 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:53:42 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:53:42 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:53:42 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:53:42 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 08:53:42 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 08:53:42 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:53:42 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:53:42 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 08:53:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:53:44 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:53:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:53:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:53:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:53:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:53:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:53:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:53:45 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 1056885 values 16680625 bits 2085078 bytes 
Mon 20 Jan 2014 08:53:46 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:53:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 08:53:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:53:49 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:53:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42961827
Mon 20 Jan 2014 08:53:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:53:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42961827
Mon 20 Jan 2014 08:53:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:53:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:53:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:53:57 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:53:57 - job_xml_thread(): Done retrieving: data size 42961827
Mon 20 Jan 2014 08:53:57 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:53:58 - XML: Start document: iteration 6
Mon 20 Jan 2014 08:53:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:53:58 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:53:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:53:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:54:00 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:54:00 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:54:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:54:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:54:00 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:54:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:54:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:54:09 - XML: Processed 645988 elements - found 0 jobs
Mon 20 Jan 2014 08:54:09 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:54:09 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:54:10 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:54:10 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:54:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:54:10 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:54:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:54:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:54:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:54:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:54:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:54:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:54:14 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:54:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42907596
Mon 20 Jan 2014 08:54:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:54:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42907596
Mon 20 Jan 2014 08:54:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:54:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:54:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:54:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:54:16 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:54:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:54:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 08:54:17 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:54:17 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:54:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9115 values 143695 bits 17961 bytes 
Mon 20 Jan 2014 08:54:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 08:54:25 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:54:25 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:54:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:54:26 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:54:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:54:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:54:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:54:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:54:27 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:54:27 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:54:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:54:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:54:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:54:29 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:54:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:54:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:54:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:54:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:54:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:54:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:54:34 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:54:34 - job_xml_thread(): Done retrieving: data size 43353362
Mon 20 Jan 2014 08:54:34 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:54:34 - XML: Start document: iteration 7
Mon 20 Jan 2014 08:54:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43353362
Mon 20 Jan 2014 08:54:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43353362
Mon 20 Jan 2014 08:54:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:54:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:54:42 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:54:43 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 08:54:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:54:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:54:45 - XML: Processed 650840 elements - found 0 jobs
Mon 20 Jan 2014 08:54:45 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:54:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:54:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:54:45 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:54:45 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:54:45 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:54:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:54:55 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:54:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:54:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:54:55 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:54:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:54:55 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:54:55 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:54:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:54:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:54:57 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:54:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:54:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:54:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:54:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:54:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:54:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:54:58 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:54:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 08:54:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:55:00 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:55:01 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:55:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43547869
Mon 20 Jan 2014 08:55:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:55:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43547869
Mon 20 Jan 2014 08:55:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:55:02 - job_xml_thread(): Done retrieving: data size 43547869
Mon 20 Jan 2014 08:55:02 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:55:02 - XML: Start document: iteration 8
Mon 20 Jan 2014 08:55:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:55:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:55:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:55:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:55:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:55:17 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:55:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:55:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 08:55:18 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:55:18 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:55:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 08:55:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5659 values 89167 bits 11145 bytes 
Mon 20 Jan 2014 08:55:19 - XML: Processed 653178 elements - found 0 jobs
Mon 20 Jan 2014 08:55:19 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:55:19 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:55:19 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:55:19 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:55:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:55:24 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:55:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:55:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:55:24 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:55:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:55:24 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:55:24 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:55:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:55:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:55:26 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:55:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:55:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:55:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:55:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:55:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:55:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:55:30 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:55:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573252
Mon 20 Jan 2014 08:55:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:55:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573252
Mon 20 Jan 2014 08:55:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:55:34 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:55:34 - job_xml_thread(): Done retrieving: data size 43573252
Mon 20 Jan 2014 08:55:34 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:55:34 - XML: Start document: iteration 9
Mon 20 Jan 2014 08:55:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:55:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:55:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:55:40 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:55:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:55:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:55:40 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:55:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:55:40 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:55:40 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:55:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:55:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:55:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:55:51 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 08:55:51 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:55:51 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:55:51 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:55:51 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:55:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:55:53 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:55:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:55:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:55:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:55:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:55:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:55:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:55:54 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:55:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 08:55:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:55:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:55:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:55:57 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:55:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43540244
Mon 20 Jan 2014 08:55:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:55:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43540244
Mon 20 Jan 2014 08:55:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:56:06 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:56:07 - job_xml_thread(): Done retrieving: data size 43540244
Mon 20 Jan 2014 08:56:07 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:56:07 - XML: Start document: iteration 10
Mon 20 Jan 2014 08:56:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:56:09 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:56:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:56:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:56:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:56:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:56:11 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:56:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:56:11 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:56:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:56:11 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:56:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:56:16 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:56:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:56:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:56:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:56:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:56:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:56:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:56:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:56:19 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:56:19 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 08:56:19 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:56:19 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:56:19 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:56:19 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:56:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:56:19 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:56:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 08:56:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 08:56:19 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:56:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5727 values 90281 bits 11285 bytes 
Mon 20 Jan 2014 08:56:22 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:56:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553250
Mon 20 Jan 2014 08:56:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:56:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553250
Mon 20 Jan 2014 08:56:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:56:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:56:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:56:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:56:31 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:56:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:56:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:56:32 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:56:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:56:32 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:56:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:56:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553250
Mon 20 Jan 2014 08:56:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:56:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:56:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:56:34 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:56:34 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:56:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:56:42 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:56:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:56:45 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:56:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:56:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:56:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:56:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:56:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:56:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:56:45 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:56:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 08:56:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:56:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:56:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:56:48 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:56:48 - job_xml_thread(): Done retrieving: data size 43541448
Mon 20 Jan 2014 08:56:48 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:56:48 - XML: Start document: iteration 11
Mon 20 Jan 2014 08:56:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43541448
Mon 20 Jan 2014 08:56:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:56:49 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:56:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:56:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43541448
Mon 20 Jan 2014 08:56:49 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:56:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:56:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:57:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:57:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:57:00 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 08:57:00 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:57:00 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:57:00 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:57:00 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:57:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:57:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:57:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:57:06 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:57:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:57:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:57:07 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:57:07 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:57:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:57:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:57:07 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:57:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:57:09 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:57:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:57:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:57:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:57:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:57:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:57:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:57:13 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:57:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43592883
Mon 20 Jan 2014 08:57:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:57:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43592883
Mon 20 Jan 2014 08:57:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:57:15 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:57:15 - job_xml_thread(): Done retrieving: data size 43592883
Mon 20 Jan 2014 08:57:15 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:57:16 - XML: Start document: iteration 12
Mon 20 Jan 2014 08:57:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:57:19 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:57:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:57:20 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:57:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 08:57:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 08:57:20 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:57:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8869 values 139818 bits 17477 bytes 
Mon 20 Jan 2014 08:57:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:57:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:57:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:57:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:57:29 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 08:57:29 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:57:29 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:57:29 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:57:29 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:57:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:57:33 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:57:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:57:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:57:34 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:57:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:57:34 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:57:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:57:34 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:57:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:57:36 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:57:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:57:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:57:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:57:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:57:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:57:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:57:40 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:57:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577868
Mon 20 Jan 2014 08:57:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:57:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577868
Mon 20 Jan 2014 08:57:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:57:44 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:57:44 - job_xml_thread(): Done retrieving: data size 43577868
Mon 20 Jan 2014 08:57:44 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:57:44 - XML: Start document: iteration 13
Mon 20 Jan 2014 08:57:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:57:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:57:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:57:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:57:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:57:58 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:57:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:57:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:57:59 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:57:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:58:00 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:58:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:58:00 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:58:02 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 08:58:02 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:58:02 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:58:02 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:58:02 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:58:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:58:04 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:58:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:58:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:58:04 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:58:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 08:58:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:58:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:58:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:58:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:58:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:58:08 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:58:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568371
Mon 20 Jan 2014 08:58:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:58:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568371
Mon 20 Jan 2014 08:58:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:58:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:58:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:58:17 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:58:17 - job_xml_thread(): Done retrieving: data size 43568371
Mon 20 Jan 2014 08:58:17 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:58:17 - XML: Start document: iteration 14
Mon 20 Jan 2014 08:58:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:58:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:58:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:58:21 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:58:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:58:21 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:58:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:58:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:58:21 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:58:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:58:21 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:58:21 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:58:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:58:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:58:22 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:58:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 08:58:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 08:58:22 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:58:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6070 values 95730 bits 11966 bytes 
Mon 20 Jan 2014 08:58:26 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 08:58:26 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:58:26 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:58:26 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:58:26 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:58:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:58:30 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:58:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:58:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:58:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:58:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:58:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:58:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:58:31 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 08:58:31 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 08:58:31 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:58:33 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:58:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43549902
Mon 20 Jan 2014 08:58:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:58:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43549902
Mon 20 Jan 2014 08:58:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:58:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:58:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:58:41 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:58:41 - job_xml_thread(): Done retrieving: data size 43549902
Mon 20 Jan 2014 08:58:41 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:58:41 - XML: Start document: iteration 15
Mon 20 Jan 2014 08:58:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:58:45 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:58:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:58:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:58:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:58:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:58:46 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:58:46 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:58:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:58:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:58:46 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:58:54 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 08:58:54 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:58:54 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:58:54 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:58:54 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:58:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:58:55 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:58:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:58:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:58:56 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:58:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 08:58:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:58:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:58:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:58:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:58:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:58:57 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:58:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568849
Mon 20 Jan 2014 08:58:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:58:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568849
Mon 20 Jan 2014 08:58:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:59:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:59:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:59:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:59:08 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:59:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:59:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:59:09 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:59:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:59:09 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:59:09 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:59:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:59:09 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:59:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:59:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:59:11 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:59:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:59:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:59:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:59:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:59:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:59:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:59:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:59:14 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:59:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43506753
Mon 20 Jan 2014 08:59:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:59:15 - job_xml_thread(): Done retrieving: data size 43506753
Mon 20 Jan 2014 08:59:15 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:59:15 - XML: Start document: iteration 16
Mon 20 Jan 2014 08:59:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43506753
Mon 20 Jan 2014 08:59:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:59:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:59:23 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:59:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:59:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:59:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:59:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 08:59:26 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 08:59:26 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:59:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 08:59:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8919 values 140612 bits 17576 bytes 
Mon 20 Jan 2014 08:59:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:59:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:59:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:59:28 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:59:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:59:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:59:29 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:59:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:59:29 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 08:59:29 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:59:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:59:33 - XML: Processed 652608 elements - found 0 jobs
Mon 20 Jan 2014 08:59:33 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 08:59:33 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 08:59:33 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 08:59:33 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 08:59:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 08:59:37 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 08:59:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 08:59:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 08:59:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:59:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 08:59:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 08:59:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 08:59:40 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 08:59:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43019125
Mon 20 Jan 2014 08:59:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 08:59:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43019125
Mon 20 Jan 2014 08:59:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 08:59:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 08:59:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:59:49 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 08:59:49 - job_xml_thread(): Done retrieving: data size 43019125
Mon 20 Jan 2014 08:59:49 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 08:59:49 - XML: Start document: iteration 17
Mon 20 Jan 2014 08:59:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 08:59:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 08:59:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 08:59:54 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 08:59:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 08:59:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 08:59:55 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:59:55 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 08:59:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 08:59:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 08:59:55 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:00:02 - XML: Processed 646702 elements - found 0 jobs
Mon 20 Jan 2014 09:00:02 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:00:02 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:00:02 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:00:03 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:00:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:00:03 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:00:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:00:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:00:03 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:00:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 09:00:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:00:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:00:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:00:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:00:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:00:05 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:00:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42885624
Mon 20 Jan 2014 09:00:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:00:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42885624
Mon 20 Jan 2014 09:00:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:00:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:00:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:00:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:00:16 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:00:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:00:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:00:18 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:00:18 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:00:18 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:00:18 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:00:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:00:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:00:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:00:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:00:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:00:19 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:00:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:00:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:00:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:00:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:00:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:00:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:00:22 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:00:22 - job_xml_thread(): Done retrieving: data size 42969359
Mon 20 Jan 2014 09:00:22 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:00:22 - XML: Start document: iteration 18
Mon 20 Jan 2014 09:00:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42969359
Mon 20 Jan 2014 09:00:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:00:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42969359
Mon 20 Jan 2014 09:00:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:00:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:00:26 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:00:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:00:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 09:00:27 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:00:27 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:00:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9197 values 145009 bits 18126 bytes 
Mon 20 Jan 2014 09:00:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 09:00:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:00:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:00:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:00:33 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:00:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:00:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:00:34 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:00:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:00:34 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:00:34 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:00:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:00:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:00:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:00:38 - XML: Processed 645908 elements - found 0 jobs
Mon 20 Jan 2014 09:00:38 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:00:38 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:00:38 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:00:38 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:00:43 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 09:00:43 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:00:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:00:44 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:00:44 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:00:44 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:00:44 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 09:00:44 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 09:00:44 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 09:00:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:00:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:00:45 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 773150 values 12188492 bits 1523561 bytes 
Mon 20 Jan 2014 09:00:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:00:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:00:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:00:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:00:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:00:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:00:49 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:00:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43475564
Mon 20 Jan 2014 09:00:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:00:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43475564
Mon 20 Jan 2014 09:00:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:00:53 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:00:53 - job_xml_thread(): Done retrieving: data size 43475564
Mon 20 Jan 2014 09:00:53 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:00:53 - XML: Start document: iteration 19
Mon 20 Jan 2014 09:01:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:01:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:01:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:01:01 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:01:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:01:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:01:02 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:01:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:01:02 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:01:02 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:01:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:01:03 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:01:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 09:01:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:01:07 - XML: Processed 652744 elements - found 0 jobs
Mon 20 Jan 2014 09:01:07 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:01:07 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:01:07 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:01:07 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:01:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:01:10 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:01:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:01:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:01:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:01:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:01:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:01:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:01:13 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:01:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561237
Mon 20 Jan 2014 09:01:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:01:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561237
Mon 20 Jan 2014 09:01:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:01:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:01:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:01:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:01:21 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:01:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:01:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:01:21 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:01:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:01:22 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:01:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:01:22 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:01:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561237
Mon 20 Jan 2014 09:01:22 - job_xml_thread(): Done retrieving: data size 43561237
Mon 20 Jan 2014 09:01:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:01:22 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:01:23 - XML: Start document: iteration 20
Mon 20 Jan 2014 09:01:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:01:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:01:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:01:28 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:01:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:01:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 09:01:30 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:01:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 09:01:30 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:01:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6067 values 95759 bits 11969 bytes 
Mon 20 Jan 2014 09:01:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:01:35 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:01:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:01:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:01:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:01:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:01:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:01:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:01:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:01:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:01:36 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:01:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:01:39 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:01:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:01:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:01:40 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:01:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:01:40 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:01:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:01:41 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:01:41 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:01:41 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:01:41 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:01:41 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:01:44 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:01:44 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 09:01:45 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:01:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 09:01:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:01:45 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:01:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570102
Mon 20 Jan 2014 09:01:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:01:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570102
Mon 20 Jan 2014 09:01:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:01:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:01:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:01:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:01:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:01:56 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:01:56 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:01:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:01:58 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:01:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:01:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:01:58 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:01:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:01:58 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:01:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:02:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:02:01 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:02:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:02:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:02:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:02:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:02:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:02:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:02:04 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:02:04 - job_xml_thread(): Done retrieving: data size 43553824
Mon 20 Jan 2014 09:02:04 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:02:04 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 09:02:04 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 09:02:04 - Housekeeping: done.
Mon 20 Jan 2014 09:02:04 - XML: Start document: iteration 0
Mon 20 Jan 2014 09:02:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553824
Mon 20 Jan 2014 09:02:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:02:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553824
Mon 20 Jan 2014 09:02:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:02:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:02:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:02:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:02:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:02:23 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:02:23 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:02:23 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:02:23 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:02:23 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:02:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:02:25 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:02:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:02:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:02:25 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:02:25 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:02:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:02:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:02:25 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:02:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:02:29 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:02:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:02:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:02:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:02:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:02:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:02:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:02:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:02:30 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:02:30 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:02:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:02:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 09:02:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 09:02:30 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:02:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99384 bits 12423 bytes 
Mon 20 Jan 2014 09:02:32 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:02:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570303
Mon 20 Jan 2014 09:02:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:02:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570303
Mon 20 Jan 2014 09:02:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:02:38 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:02:38 - job_xml_thread(): Done retrieving: data size 43570303
Mon 20 Jan 2014 09:02:38 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:02:38 - XML: Start document: iteration 1
Mon 20 Jan 2014 09:02:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:02:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:02:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:02:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:02:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:02:47 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:02:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:02:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:02:48 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:02:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:02:48 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:02:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:02:48 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:02:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:02:56 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:02:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:02:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:02:57 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:02:57 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:02:57 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:02:57 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:02:57 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:02:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:02:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:02:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:02:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:02:59 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:02:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 09:02:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:03:01 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:03:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559651
Mon 20 Jan 2014 09:03:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:03:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559651
Mon 20 Jan 2014 09:03:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:03:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:03:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:03:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:03:11 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:03:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:03:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:03:12 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:03:12 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:03:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:03:12 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:03:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:03:12 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:03:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:03:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:03:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:03:16 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:03:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:03:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:03:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:03:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:03:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:03:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:03:19 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:03:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558798
Mon 20 Jan 2014 09:03:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:03:20 - job_xml_thread(): Done retrieving: data size 43558798
Mon 20 Jan 2014 09:03:20 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:03:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558798
Mon 20 Jan 2014 09:03:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:03:21 - XML: Start document: iteration 2
Mon 20 Jan 2014 09:03:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:03:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:03:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:03:31 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:03:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:03:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:03:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:03:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 09:03:32 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:03:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 09:03:32 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:03:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7820 values 123581 bits 15447 bytes 
Mon 20 Jan 2014 09:03:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:03:40 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:03:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:03:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:03:41 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:03:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:03:41 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:03:41 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:03:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:03:42 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:03:42 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:03:42 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:03:42 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:03:42 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:03:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:03:44 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:03:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:03:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:03:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:03:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:03:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:03:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:03:47 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:03:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572292
Mon 20 Jan 2014 09:03:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:03:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572292
Mon 20 Jan 2014 09:03:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:03:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:03:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:03:57 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:03:57 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:03:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:03:59 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:03:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:03:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:04:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:04:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:04:00 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:04:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:04:00 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:04:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:04:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:04:03 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:04:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:04:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:04:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:04:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:04:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:04:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:04:04 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:04:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 09:04:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:04:07 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:04:07 - job_xml_thread(): Done retrieving: data size 43555692
Mon 20 Jan 2014 09:04:07 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:04:07 - XML: Start document: iteration 3
Mon 20 Jan 2014 09:04:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555692
Mon 20 Jan 2014 09:04:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:04:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555692
Mon 20 Jan 2014 09:04:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:04:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:04:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:04:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:04:18 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:04:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:04:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:04:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:04:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:04:20 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:04:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:04:20 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:04:20 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:04:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:04:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:04:28 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:04:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:04:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:04:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:04:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:04:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:04:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:04:30 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:04:30 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:04:30 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:04:30 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:04:30 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:04:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:04:32 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:04:33 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:04:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43550004
Mon 20 Jan 2014 09:04:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:04:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:04:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 09:04:33 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:04:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5869 values 92570 bits 11571 bytes 
Mon 20 Jan 2014 09:04:33 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:04:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 09:04:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43550004
Mon 20 Jan 2014 09:04:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:04:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:04:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:04:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:04:43 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:04:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:04:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:04:43 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:04:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:04:43 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:04:43 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:04:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:04:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:04:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:04:45 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:04:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:04:49 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:04:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:04:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:04:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:04:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:04:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:04:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:04:51 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 09:04:51 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 09:04:51 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:04:52 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:04:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566283
Mon 20 Jan 2014 09:04:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:04:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566283
Mon 20 Jan 2014 09:04:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:04:52 - job_xml_thread(): Done retrieving: data size 43566283
Mon 20 Jan 2014 09:04:52 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:04:53 - XML: Start document: iteration 4
Mon 20 Jan 2014 09:04:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:04:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:05:05 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:05:05 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:05:05 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:05:05 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:05:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:05:05 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:05:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:05:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:05:10 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:05:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:05:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:05:11 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:05:11 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:05:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:05:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:05:11 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:05:13 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:05:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 09:05:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:05:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:05:14 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:05:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:05:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:05:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:05:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:05:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:05:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:05:16 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:05:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43513997
Mon 20 Jan 2014 09:05:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:05:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43513997
Mon 20 Jan 2014 09:05:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:05:21 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:05:21 - job_xml_thread(): Done retrieving: data size 43513997
Mon 20 Jan 2014 09:05:21 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:05:21 - XML: Start document: iteration 5
Mon 20 Jan 2014 09:05:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:05:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:05:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:05:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:05:30 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:05:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:05:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:05:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:05:32 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:05:32 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:05:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:05:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:05:32 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:05:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:05:34 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:05:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:05:35 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:05:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 09:05:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 09:05:35 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:05:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6087 values 96052 bits 12006 bytes 
Mon 20 Jan 2014 09:05:38 - XML: Processed 652607 elements - found 0 jobs
Mon 20 Jan 2014 09:05:38 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:05:38 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:05:38 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:05:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:05:38 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:05:38 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:05:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:05:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:05:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:05:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:05:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:05:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:05:40 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:05:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43025762
Mon 20 Jan 2014 09:05:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:05:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43025762
Mon 20 Jan 2014 09:05:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:05:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:05:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:05:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:05:50 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:05:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:05:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:05:50 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:05:50 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:05:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:05:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:05:50 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:05:53 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:05:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:05:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:05:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:05:54 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:05:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:05:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:05:54 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:05:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 09:05:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:05:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:05:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:05:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:05:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:05:56 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:05:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42920100
Mon 20 Jan 2014 09:05:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:05:56 - job_xml_thread(): Done retrieving: data size 42920100
Mon 20 Jan 2014 09:05:56 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:05:56 - XML: Start document: iteration 6
Mon 20 Jan 2014 09:05:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42920100
Mon 20 Jan 2014 09:05:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:06:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:06:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:06:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:06:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:06:12 - XML: Processed 645286 elements - found 0 jobs
Mon 20 Jan 2014 09:06:12 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:06:12 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:06:12 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:06:12 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:06:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:06:13 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:06:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:06:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:06:14 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:06:14 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:06:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:06:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:06:15 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:06:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:06:17 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:06:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:06:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:06:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:06:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:06:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:06:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:06:19 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:06:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42968647
Mon 20 Jan 2014 09:06:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:06:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42968647
Mon 20 Jan 2014 09:06:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:06:27 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:06:27 - job_xml_thread(): Done retrieving: data size 42968647
Mon 20 Jan 2014 09:06:28 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:06:28 - XML: Start document: iteration 7
Mon 20 Jan 2014 09:06:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:06:29 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:06:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:06:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:06:31 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:06:31 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:06:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:06:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:06:31 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:06:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:06:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:06:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:06:35 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:06:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:06:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 09:06:37 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:06:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8746 values 137944 bits 17243 bytes 
Mon 20 Jan 2014 09:06:37 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:06:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 09:06:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:06:39 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:06:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:06:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:06:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:06:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:06:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:06:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:06:41 - XML: Processed 645906 elements - found 0 jobs
Mon 20 Jan 2014 09:06:41 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:06:41 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:06:41 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:06:41 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:06:42 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:06:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 09:06:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:06:44 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:06:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43434739
Mon 20 Jan 2014 09:06:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:06:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43434739
Mon 20 Jan 2014 09:06:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:06:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:06:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:06:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:06:53 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:06:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:06:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:06:54 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:06:54 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:06:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:06:54 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:06:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:06:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:06:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:06:56 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:06:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:06:57 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:06:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:06:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:06:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:06:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:06:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:06:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:06:59 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:06:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558686
Mon 20 Jan 2014 09:06:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:06:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558686
Mon 20 Jan 2014 09:06:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:07:00 - job_xml_thread(): Done retrieving: data size 43558686
Mon 20 Jan 2014 09:07:00 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:07:01 - XML: Start document: iteration 8
Mon 20 Jan 2014 09:07:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:07:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:07:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:07:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:07:14 - XML: Processed 653042 elements - found 0 jobs
Mon 20 Jan 2014 09:07:14 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:07:14 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:07:14 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:07:14 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:07:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:07:18 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:07:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:07:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:07:19 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:07:19 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:07:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:07:19 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:07:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:07:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:07:21 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:07:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:07:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:07:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:07:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:07:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:07:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:07:23 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:07:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564693
Mon 20 Jan 2014 09:07:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:07:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564693
Mon 20 Jan 2014 09:07:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:07:29 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:07:29 - job_xml_thread(): Done retrieving: data size 43564693
Mon 20 Jan 2014 09:07:29 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:07:29 - XML: Start document: iteration 9
Mon 20 Jan 2014 09:07:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:07:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:07:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:07:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:07:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:07:37 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:07:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:07:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 09:07:37 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:07:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 09:07:37 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:07:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148612 bits 18576 bytes 
Mon 20 Jan 2014 09:07:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:07:41 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:07:41 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:07:41 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:07:41 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:07:41 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:07:41 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:07:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:07:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:07:42 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:07:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:07:42 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:07:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:07:42 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:07:44 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 09:07:44 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:07:45 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:07:45 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:07:45 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 09:07:45 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 09:07:45 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 09:07:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:07:47 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:07:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:07:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:07:48 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 828880 values 13079171 bits 1634896 bytes 
Mon 20 Jan 2014 09:07:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:07:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:07:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:07:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:07:51 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:07:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43551026
Mon 20 Jan 2014 09:07:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:07:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43551026
Mon 20 Jan 2014 09:07:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:07:56 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:07:56 - job_xml_thread(): Done retrieving: data size 43551026
Mon 20 Jan 2014 09:07:56 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:07:56 - XML: Start document: iteration 10
Mon 20 Jan 2014 09:07:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:07:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:08:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:08:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:08:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:08:04 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:08:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:08:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:08:05 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:08:05 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:08:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:08:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:08:05 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:08:10 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:08:10 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:08:10 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:08:10 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:08:10 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:08:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:08:15 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:08:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:08:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:08:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:08:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:08:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:08:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:08:15 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:08:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 09:08:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:08:18 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:08:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553021
Mon 20 Jan 2014 09:08:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:08:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553021
Mon 20 Jan 2014 09:08:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:08:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:08:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:08:25 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:08:25 - job_xml_thread(): Done retrieving: data size 43553021
Mon 20 Jan 2014 09:08:25 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:08:25 - XML: Start document: iteration 11
Mon 20 Jan 2014 09:08:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:08:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:08:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:08:33 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:08:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:08:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:08:34 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:08:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:08:34 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:08:34 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:08:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:08:36 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:08:36 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:08:36 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:08:36 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:08:36 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:08:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:08:38 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:08:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:08:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 09:08:38 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:08:38 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:08:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 09:08:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5467 values 86221 bits 10777 bytes 
Mon 20 Jan 2014 09:08:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:08:41 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:08:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:08:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:08:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:08:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:08:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:08:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:08:44 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:08:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565664
Mon 20 Jan 2014 09:08:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:08:45 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:08:45 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 09:08:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565664
Mon 20 Jan 2014 09:08:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:08:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:08:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:08:51 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:08:51 - job_xml_thread(): Done retrieving: data size 43565664
Mon 20 Jan 2014 09:08:51 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:08:51 - XML: Start document: iteration 12
Mon 20 Jan 2014 09:08:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:08:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:08:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:08:58 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:08:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:08:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:08:58 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:08:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:08:58 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:08:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:08:58 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:09:01 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:09:01 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:09:01 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:09:01 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:09:01 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:09:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:09:08 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:09:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:09:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:09:08 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:09:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 09:09:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:09:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:09:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:09:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:09:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:09:10 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:09:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43547375
Mon 20 Jan 2014 09:09:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:09:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43547375
Mon 20 Jan 2014 09:09:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:09:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:09:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:09:16 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:09:16 - job_xml_thread(): Done retrieving: data size 43547375
Mon 20 Jan 2014 09:09:17 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:09:17 - XML: Start document: iteration 13
Mon 20 Jan 2014 09:09:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:09:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:09:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:09:27 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:09:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:09:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:09:28 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:09:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:09:28 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:09:28 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:09:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:09:34 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:09:34 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:09:34 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:09:34 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:09:34 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:09:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:09:35 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:09:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:09:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:09:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:09:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:09:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:09:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:09:37 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:09:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43549736
Mon 20 Jan 2014 09:09:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:09:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43549736
Mon 20 Jan 2014 09:09:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:09:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:09:38 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:09:40 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:09:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 09:09:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:09:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 09:09:41 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:09:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8747 values 137923 bits 17240 bytes 
Mon 20 Jan 2014 09:09:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:09:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:09:49 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:09:49 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:09:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:09:50 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:09:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:09:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:09:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:09:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:09:52 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:09:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:09:52 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:09:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:09:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:09:54 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:09:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:09:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:09:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:09:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:09:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:09:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:09:58 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:09:58 - job_xml_thread(): Done retrieving: data size 43567978
Mon 20 Jan 2014 09:09:58 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:09:58 - XML: Start document: iteration 14
Mon 20 Jan 2014 09:09:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567978
Mon 20 Jan 2014 09:09:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:09:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567978
Mon 20 Jan 2014 09:09:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:10:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:10:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:10:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:10:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:10:14 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:10:14 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:10:14 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:10:14 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:10:14 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:10:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:10:16 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:10:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:10:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:10:16 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:10:16 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:10:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:10:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:10:16 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:10:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:10:21 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:10:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:10:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:10:22 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:10:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 09:10:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:10:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:10:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:10:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:10:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:10:24 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:10:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556648
Mon 20 Jan 2014 09:10:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:10:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556648
Mon 20 Jan 2014 09:10:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:10:30 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:10:30 - job_xml_thread(): Done retrieving: data size 43556648
Mon 20 Jan 2014 09:10:30 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:10:30 - XML: Start document: iteration 15
Mon 20 Jan 2014 09:10:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:10:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:10:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:10:35 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:10:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:10:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:10:36 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:10:36 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:10:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:10:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:10:36 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:10:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:10:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:10:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:10:40 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:10:41 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:10:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 09:10:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:10:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 09:10:41 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:10:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5484 values 86420 bits 10802 bytes 
Mon 20 Jan 2014 09:10:45 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:10:45 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:10:45 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:10:45 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:10:45 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:10:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:10:47 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:10:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:10:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:10:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:10:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:10:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:10:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:10:50 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:10:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43539038
Mon 20 Jan 2014 09:10:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:10:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43539038
Mon 20 Jan 2014 09:10:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:10:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:10:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:11:00 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:11:00 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:11:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:11:01 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:11:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:11:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:11:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:11:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:11:02 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:11:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:11:02 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:11:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:11:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:11:07 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:11:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:11:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:11:07 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:11:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 09:11:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:11:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:11:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:11:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:11:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:11:10 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:11:10 - job_xml_thread(): Done retrieving: data size 43557105
Mon 20 Jan 2014 09:11:10 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:11:10 - XML: Start document: iteration 16
Mon 20 Jan 2014 09:11:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557105
Mon 20 Jan 2014 09:11:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:11:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557105
Mon 20 Jan 2014 09:11:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:11:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:11:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:11:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:11:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:11:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:11:25 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:11:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:11:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:11:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:11:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:11:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:11:27 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:11:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:11:33 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:11:33 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:11:33 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:11:33 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:11:33 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:11:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:11:34 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:11:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:11:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:11:35 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:11:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:11:35 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:11:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:11:38 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:11:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43083406
Mon 20 Jan 2014 09:11:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:11:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43083406
Mon 20 Jan 2014 09:11:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:11:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:11:41 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:11:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:11:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 09:11:42 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:11:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 09:11:42 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:11:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8664 values 136599 bits 17074 bytes 
Mon 20 Jan 2014 09:11:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:11:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:11:48 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:11:48 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:11:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:11:49 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:11:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:11:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:11:52 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:11:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:11:52 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:11:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:11:52 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:11:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:11:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:11:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:11:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:11:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:11:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:11:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:11:54 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 09:11:54 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 09:11:54 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:11:54 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:11:54 - job_xml_thread(): Done retrieving: data size 42923122
Mon 20 Jan 2014 09:11:54 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:11:54 - XML: Start document: iteration 17
Mon 20 Jan 2014 09:11:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42923122
Mon 20 Jan 2014 09:11:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:11:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42923122
Mon 20 Jan 2014 09:11:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:12:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:12:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:12:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:12:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:12:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:12:10 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:12:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:12:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:12:11 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:12:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:12:11 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:12:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:12:11 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:12:13 - XML: Processed 645372 elements - found 0 jobs
Mon 20 Jan 2014 09:12:13 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:12:13 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:12:13 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:12:13 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:12:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:12:15 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:12:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:12:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:12:16 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:12:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 09:12:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:12:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:12:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:12:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:12:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:12:18 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:12:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42952065
Mon 20 Jan 2014 09:12:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:12:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42952065
Mon 20 Jan 2014 09:12:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:12:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:12:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:12:28 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:12:28 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:12:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:12:30 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:12:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:12:31 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:12:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:12:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:12:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:12:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:12:32 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:12:32 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:12:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:12:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:12:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:12:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:12:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:12:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:12:34 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:12:34 - job_xml_thread(): Done retrieving: data size 43400052
Mon 20 Jan 2014 09:12:34 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:12:34 - XML: Start document: iteration 18
Mon 20 Jan 2014 09:12:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43400052
Mon 20 Jan 2014 09:12:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:12:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43400052
Mon 20 Jan 2014 09:12:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:12:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:12:42 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:12:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:12:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 09:12:43 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:12:43 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:12:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 09:12:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8425 values 132850 bits 16606 bytes 
Mon 20 Jan 2014 09:12:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:12:46 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:12:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:12:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:12:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:12:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:12:47 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:12:47 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:12:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:12:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:12:47 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:12:54 - XML: Processed 651315 elements - found 0 jobs
Mon 20 Jan 2014 09:12:54 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:12:54 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:12:54 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:12:54 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:12:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:12:57 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:12:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:12:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:12:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:12:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:12:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:12:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:12:59 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:12:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43515261
Mon 20 Jan 2014 09:12:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:13:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43515261
Mon 20 Jan 2014 09:13:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:13:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:13:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:13:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:13:09 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:13:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:13:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:13:09 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:13:09 - job_xml_thread(): Done retrieving: data size 43515261
Mon 20 Jan 2014 09:13:09 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:13:09 - XML: Start document: iteration 19
Mon 20 Jan 2014 09:13:11 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:13:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:13:11 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:13:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:13:11 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:13:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:13:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:13:16 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:13:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 09:13:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:13:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:13:19 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:13:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:13:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:13:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:13:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:13:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:13:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:13:21 - XML: Processed 652756 elements - found 0 jobs
Mon 20 Jan 2014 09:13:21 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:13:21 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:13:21 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:13:21 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:13:23 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:13:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43546832
Mon 20 Jan 2014 09:13:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:13:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43546832
Mon 20 Jan 2014 09:13:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:13:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:13:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:13:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:13:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:13:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:13:36 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:13:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:13:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:13:36 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:13:36 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:13:36 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:13:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:13:36 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:13:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:13:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:13:38 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:13:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:13:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:13:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:13:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:13:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:13:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:13:40 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:13:40 - job_xml_thread(): Done retrieving: data size 43573012
Mon 20 Jan 2014 09:13:40 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:13:40 - XML: Start document: iteration 20
Mon 20 Jan 2014 09:13:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573012
Mon 20 Jan 2014 09:13:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573012
Mon 20 Jan 2014 09:13:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:13:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:13:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:13:44 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:13:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:13:45 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:13:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 09:13:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 09:13:45 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:13:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6567 values 103666 bits 12958 bytes 
Mon 20 Jan 2014 09:13:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:13:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:13:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:13:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:13:57 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:13:57 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:13:57 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:13:57 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:13:57 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:14:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:14:03 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:14:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:14:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:14:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:14:04 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:14:04 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:14:04 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:14:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:14:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:14:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:14:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:14:04 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:14:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:14:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:14:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:14:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:14:07 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:14:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580829
Mon 20 Jan 2014 09:14:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:14:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580829
Mon 20 Jan 2014 09:14:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:14:12 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:14:12 - job_xml_thread(): Done retrieving: data size 43580829
Mon 20 Jan 2014 09:14:12 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:14:12 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 09:14:14 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 09:14:14 - Housekeeping: done.
Mon 20 Jan 2014 09:14:14 - XML: Start document: iteration 0
Mon 20 Jan 2014 09:14:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:14:18 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:14:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:14:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:14:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:14:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:14:21 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:14:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:14:21 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:14:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:14:22 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:14:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:14:30 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:14:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:14:30 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:14:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:14:30 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:14:30 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:14:30 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:14:30 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:14:30 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:14:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 09:14:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:14:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:14:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:14:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:14:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:14:32 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:14:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559054
Mon 20 Jan 2014 09:14:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:14:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559054
Mon 20 Jan 2014 09:14:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:14:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:14:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:14:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:14:45 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 09:14:46 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:14:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:14:46 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:14:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:14:46 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:14:46 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:14:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:14:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:14:47 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:14:47 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:14:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:14:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:14:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:14:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:14:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:14:48 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:14:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:14:48 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 09:14:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:14:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:14:48 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:14:48 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 09:14:48 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 09:14:48 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:14:48 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:14:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:14:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:14:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:14:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 09:14:48 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:14:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 09:14:48 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:14:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5897 values 92993 bits 11624 bytes 
Mon 20 Jan 2014 09:14:49 - size of cluster 'LISA Cluster': 624 hosts 79479 metrics 805156 values 12693814 bits 1586726 bytes 
Mon 20 Jan 2014 09:14:51 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:14:51 - job_xml_thread(): Done retrieving: data size 43581724
Mon 20 Jan 2014 09:14:51 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:14:51 - XML: Start document: iteration 1
Mon 20 Jan 2014 09:14:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581724
Mon 20 Jan 2014 09:14:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581724
Mon 20 Jan 2014 09:14:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:14:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:15:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:15:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:15:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:15:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:15:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:15:06 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:15:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:15:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:15:07 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:15:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:15:07 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:15:07 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:15:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:15:08 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:15:08 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:15:08 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:15:08 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:15:08 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:15:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:15:13 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:15:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:15:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:15:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:15:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:15:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:15:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:15:15 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:15:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 09:15:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:15:17 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:15:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565444
Mon 20 Jan 2014 09:15:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:15:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565444
Mon 20 Jan 2014 09:15:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:15:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:15:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:15:23 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:15:23 - job_xml_thread(): Done retrieving: data size 43565444
Mon 20 Jan 2014 09:15:23 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:15:23 - XML: Start document: iteration 2
Mon 20 Jan 2014 09:15:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:15:29 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:15:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:15:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:15:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:15:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:15:29 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:15:30 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:15:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:15:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:15:30 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:15:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:15:32 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:15:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:15:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:15:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:15:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:15:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:15:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:15:35 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:15:35 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:15:35 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:15:35 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:15:35 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:15:39 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:15:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559244
Mon 20 Jan 2014 09:15:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:15:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559244
Mon 20 Jan 2014 09:15:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:15:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:15:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:15:48 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:15:48 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 09:15:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:15:48 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:15:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:15:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:15:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:15:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 09:15:49 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:15:49 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:15:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 09:15:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7757 values 122361 bits 15295 bytes 
Mon 20 Jan 2014 09:15:50 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:15:50 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:15:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:15:51 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:15:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:15:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:15:52 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:15:52 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:15:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:15:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:15:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:15:55 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:15:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:15:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:15:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:15:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:15:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:15:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:15:59 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:15:59 - job_xml_thread(): Done retrieving: data size 43576484
Mon 20 Jan 2014 09:15:59 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:15:59 - XML: Start document: iteration 3
Mon 20 Jan 2014 09:15:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576484
Mon 20 Jan 2014 09:15:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:16:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576484
Mon 20 Jan 2014 09:16:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:16:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:16:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:16:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:16:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:16:11 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:16:11 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:16:11 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:16:11 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:16:11 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:16:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:16:18 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:16:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:16:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:16:20 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:16:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:16:20 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:16:20 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:16:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:16:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:16:22 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:16:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:16:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:16:22 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:16:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 09:16:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:16:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:16:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:16:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:16:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:16:26 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:16:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584364
Mon 20 Jan 2014 09:16:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:16:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584364
Mon 20 Jan 2014 09:16:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:16:27 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:16:27 - job_xml_thread(): Done retrieving: data size 43584364
Mon 20 Jan 2014 09:16:27 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:16:28 - XML: Start document: iteration 4
Mon 20 Jan 2014 09:16:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:16:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:16:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:16:37 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:16:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:16:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:16:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:16:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:16:39 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:16:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:16:39 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:16:39 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:16:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:16:45 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:16:45 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:16:45 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:16:45 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:16:45 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:16:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:16:48 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:16:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:16:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:16:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:16:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:16:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:16:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:16:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:16:49 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:16:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:16:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 09:16:50 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:16:50 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:16:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 09:16:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5964 values 94125 bits 11765 bytes 
Mon 20 Jan 2014 09:16:51 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:16:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43552225
Mon 20 Jan 2014 09:16:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:16:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43552225
Mon 20 Jan 2014 09:16:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:16:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:16:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:17:00 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:17:00 - job_xml_thread(): Done retrieving: data size 43552225
Mon 20 Jan 2014 09:17:01 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:17:01 - XML: Start document: iteration 5
Mon 20 Jan 2014 09:17:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:17:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:17:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:17:08 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:17:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:17:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:17:09 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:17:09 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:17:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:17:09 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:17:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:17:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:17:15 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:17:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:17:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:17:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:17:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:17:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:17:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:17:16 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:17:16 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:17:16 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:17:16 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:17:16 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:17:19 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:17:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 09:17:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:17:20 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:17:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43491482
Mon 20 Jan 2014 09:17:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:17:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43491482
Mon 20 Jan 2014 09:17:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:17:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:17:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:17:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:17:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:17:31 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:17:31 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:17:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:17:34 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:17:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:17:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:17:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:17:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:17:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:17:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:17:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:17:36 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:17:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:17:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:17:36 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:17:36 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:17:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:17:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:17:39 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:17:39 - job_xml_thread(): Done retrieving: data size 43048496
Mon 20 Jan 2014 09:17:39 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:17:39 - XML: Start document: iteration 6
Mon 20 Jan 2014 09:17:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43048496
Mon 20 Jan 2014 09:17:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:17:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43048496
Mon 20 Jan 2014 09:17:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:17:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:17:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:17:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:17:50 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:17:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:17:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:17:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:17:51 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:17:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 09:17:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 09:17:51 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:17:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:17:52 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:17:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:17:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:17:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7180 values 113648 bits 14206 bytes 
Mon 20 Jan 2014 09:17:53 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:17:53 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:17:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:17:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:17:53 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:17:58 - XML: Processed 646852 elements - found 0 jobs
Mon 20 Jan 2014 09:17:58 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:17:58 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:17:58 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:17:58 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:18:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:18:00 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:18:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:18:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:18:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:18:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:18:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:18:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:18:03 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:18:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42907342
Mon 20 Jan 2014 09:18:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:18:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42907342
Mon 20 Jan 2014 09:18:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:18:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:18:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:18:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:18:13 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:18:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:18:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:18:13 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:18:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:18:13 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:18:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:18:13 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:18:13 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:18:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:18:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:18:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:18:19 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:18:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:18:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:18:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:18:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:18:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:18:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:18:19 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:18:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 09:18:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:18:22 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:18:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42963691
Mon 20 Jan 2014 09:18:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:18:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42963691
Mon 20 Jan 2014 09:18:23 - job_xml_thread(): Done retrieving: data size 42963691
Mon 20 Jan 2014 09:18:23 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:18:23 - XML: Start document: iteration 7
Mon 20 Jan 2014 09:18:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:18:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:18:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:18:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:18:32 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:18:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:18:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:18:33 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:18:33 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:18:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:18:33 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:18:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:18:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:18:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:18:39 - XML: Processed 645908 elements - found 0 jobs
Mon 20 Jan 2014 09:18:39 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:18:39 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:18:39 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:18:39 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:18:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:18:42 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:18:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:18:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:18:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:18:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:18:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:18:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:18:43 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 09:18:43 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 09:18:43 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:18:44 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:18:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43440616
Mon 20 Jan 2014 09:18:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:18:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43440616
Mon 20 Jan 2014 09:18:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:18:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:18:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:18:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:18:52 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:18:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:18:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 09:18:54 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:18:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8951 values 141391 bits 17673 bytes 
Mon 20 Jan 2014 09:18:54 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:18:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 09:18:54 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:18:54 - job_xml_thread(): Done retrieving: data size 43440616
Mon 20 Jan 2014 09:18:54 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:18:54 - XML: Start document: iteration 8
Mon 20 Jan 2014 09:18:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:18:57 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:18:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:18:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:18:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:18:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:18:58 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:18:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:18:58 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:18:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:18:58 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:19:04 - XML: Processed 651782 elements - found 0 jobs
Mon 20 Jan 2014 09:19:04 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:19:04 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:19:04 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:19:04 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:19:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:19:04 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:19:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:19:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:19:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:19:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:19:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:19:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:19:07 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:19:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43550832
Mon 20 Jan 2014 09:19:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:19:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43550832
Mon 20 Jan 2014 09:19:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:19:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:19:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:19:19 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:19:19 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:19:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:19:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:19:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:19:20 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:19:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:19:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:19:21 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:19:21 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:19:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:19:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:19:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:19:23 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:19:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:19:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:19:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:19:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:19:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:19:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:19:23 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:19:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 09:19:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:19:24 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:19:24 - job_xml_thread(): Done retrieving: data size 43573556
Mon 20 Jan 2014 09:19:24 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:19:24 - XML: Start document: iteration 9
Mon 20 Jan 2014 09:19:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573556
Mon 20 Jan 2014 09:19:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573556
Mon 20 Jan 2014 09:19:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:19:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:19:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:19:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:19:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:19:37 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:19:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:19:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:19:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:19:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:19:39 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:19:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:19:39 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:19:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:19:39 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:19:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:19:47 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:19:47 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:19:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:19:47 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:19:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:19:47 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:19:47 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:19:47 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:19:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:19:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:19:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:19:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:19:49 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:19:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43541470
Mon 20 Jan 2014 09:19:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:19:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43541470
Mon 20 Jan 2014 09:19:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:19:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:19:55 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:19:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:19:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:19:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:19:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 09:19:55 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:19:55 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:19:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 09:19:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8697 values 137126 bits 17140 bytes 
Mon 20 Jan 2014 09:19:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:19:57 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:19:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:19:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:19:57 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:19:57 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:19:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:19:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:19:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43541470
Mon 20 Jan 2014 09:19:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:20:02 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:20:02 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:20:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:20:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:20:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:20:08 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:20:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:20:10 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:20:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:20:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:20:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:20:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:20:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:20:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:20:12 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:20:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 09:20:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:20:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:20:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:20:12 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:20:12 - job_xml_thread(): Done retrieving: data size 43561704
Mon 20 Jan 2014 09:20:12 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:20:12 - XML: Start document: iteration 10
Mon 20 Jan 2014 09:20:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561704
Mon 20 Jan 2014 09:20:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:20:13 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:20:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:20:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561704
Mon 20 Jan 2014 09:20:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:20:13 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:20:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:20:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:20:25 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:20:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:20:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:20:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:20:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:20:29 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:20:29 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:20:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:20:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:20:29 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:20:31 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:20:31 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:20:31 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:20:31 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:20:31 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:20:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:20:34 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:20:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:20:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:20:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:20:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:20:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:20:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:20:37 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:20:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557204
Mon 20 Jan 2014 09:20:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:20:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557204
Mon 20 Jan 2014 09:20:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:20:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:20:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:20:46 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:20:46 - job_xml_thread(): Done retrieving: data size 43557204
Mon 20 Jan 2014 09:20:46 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:20:46 - XML: Start document: iteration 11
Mon 20 Jan 2014 09:20:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:20:47 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:20:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:20:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:20:48 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:20:48 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:20:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:20:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:20:48 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:20:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:20:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:20:54 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:20:54 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:20:54 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:20:54 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:20:54 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:20:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:20:56 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:20:56 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:20:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:20:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 09:20:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 09:20:56 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:20:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6313 values 99570 bits 12446 bytes 
Mon 20 Jan 2014 09:20:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:20:59 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:20:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:20:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:21:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:21:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:21:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:21:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:21:02 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:21:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557803
Mon 20 Jan 2014 09:21:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:21:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557803
Mon 20 Jan 2014 09:21:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:21:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:21:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:21:09 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:21:09 - job_xml_thread(): Done retrieving: data size 43557803
Mon 20 Jan 2014 09:21:09 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:21:09 - XML: Start document: iteration 12
Mon 20 Jan 2014 09:21:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:21:11 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:21:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:21:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:21:11 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:21:11 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:21:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:21:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:21:12 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:21:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:21:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:21:21 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:21:21 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:21:21 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:21:21 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:21:21 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:21:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:21:23 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:21:23 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:21:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 09:21:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:21:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:21:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:21:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:21:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:21:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:21:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:21:25 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:21:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557113
Mon 20 Jan 2014 09:21:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:21:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557113
Mon 20 Jan 2014 09:21:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:21:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:21:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:21:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:21:35 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:21:36 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:21:36 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:21:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:21:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:21:36 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:21:36 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:21:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:21:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:21:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:21:39 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:21:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:21:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:21:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:21:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:21:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:21:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:21:40 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:21:40 - job_xml_thread(): Done retrieving: data size 43582004
Mon 20 Jan 2014 09:21:40 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:21:40 - XML: Start document: iteration 13
Mon 20 Jan 2014 09:21:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582004
Mon 20 Jan 2014 09:21:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:21:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582004
Mon 20 Jan 2014 09:21:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:21:48 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 09:21:48 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:21:50 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:21:50 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 09:21:50 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 09:21:50 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:21:50 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 09:21:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:21:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:21:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:21:52 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:21:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:21:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:21:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:21:55 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:21:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:21:55 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:21:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:21:55 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:21:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Mon 20 Jan 2014 09:21:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:21:57 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:21:57 - XML: Processed 653357 elements - found 0 jobs
Mon 20 Jan 2014 09:21:57 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:21:57 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:21:57 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:21:57 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:21:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:21:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 09:21:57 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:21:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 09:21:57 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:21:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8977 values 141605 bits 17700 bytes 
Mon 20 Jan 2014 09:22:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:22:01 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:22:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:22:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:22:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:22:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:22:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:22:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:22:03 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:22:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 09:22:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:22:03 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:22:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43552576
Mon 20 Jan 2014 09:22:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:22:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43552576
Mon 20 Jan 2014 09:22:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:22:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:22:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:22:12 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:22:12 - job_xml_thread(): Done retrieving: data size 43552576
Mon 20 Jan 2014 09:22:12 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:22:12 - XML: Start document: iteration 14
Mon 20 Jan 2014 09:22:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:22:16 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:22:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:22:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:22:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:22:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:22:18 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:22:18 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:22:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:22:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:22:18 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:22:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:22:22 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:22:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:22:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:22:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:22:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:22:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:22:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:22:24 - XML: Processed 653354 elements - found 0 jobs
Mon 20 Jan 2014 09:22:24 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:22:24 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:22:24 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:22:24 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:22:27 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:22:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571519
Mon 20 Jan 2014 09:22:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:22:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571519
Mon 20 Jan 2014 09:22:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:22:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:22:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:22:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:22:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:22:39 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:22:40 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:22:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:22:40 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:22:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:22:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:22:40 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:22:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:22:40 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:22:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:22:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:22:42 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:22:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:22:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:22:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:22:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:22:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:22:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:22:43 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:22:43 - job_xml_thread(): Done retrieving: data size 43587685
Mon 20 Jan 2014 09:22:43 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:22:43 - XML: Start document: iteration 15
Mon 20 Jan 2014 09:22:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43587685
Mon 20 Jan 2014 09:22:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:22:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43587685
Mon 20 Jan 2014 09:22:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:22:50 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:22:50 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:22:53 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:22:53 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:22:53 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 09:22:53 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 09:22:53 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 09:22:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:22:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:22:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:22:58 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:22:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:22:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:22:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:22:58 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:22:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:22:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:22:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:22:59 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:22:59 - size of cluster 'LISA Cluster': 624 hosts 79471 metrics 909161 values 14351138 bits 1793892 bytes 
Mon 20 Jan 2014 09:22:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 09:22:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 09:22:59 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:23:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148653 bits 18581 bytes 
Mon 20 Jan 2014 09:23:00 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:23:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:23:00 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:23:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:23:00 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:23:04 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:23:04 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:23:04 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:23:04 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:23:04 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:23:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:23:08 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:23:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:23:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:23:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:23:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:23:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:23:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:23:11 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:23:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563777
Mon 20 Jan 2014 09:23:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:23:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563777
Mon 20 Jan 2014 09:23:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:23:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:23:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:23:19 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:23:19 - job_xml_thread(): Done retrieving: data size 43563777
Mon 20 Jan 2014 09:23:19 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:23:19 - XML: Start document: iteration 16
Mon 20 Jan 2014 09:23:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:23:22 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:23:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:23:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:23:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:23:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:23:25 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:23:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:23:25 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:23:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:23:25 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:23:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:23:29 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:23:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:23:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:23:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:23:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:23:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:23:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:23:32 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:23:32 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:23:32 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:23:32 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:23:32 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:23:34 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:23:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 09:23:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:23:36 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:23:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43340735
Mon 20 Jan 2014 09:23:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:23:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43340735
Mon 20 Jan 2014 09:23:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:23:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:23:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:23:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:23:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:23:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:23:48 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:23:48 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:23:48 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:23:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:23:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:23:48 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:23:48 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:23:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:23:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:23:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:23:50 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:23:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:23:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:23:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:23:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:23:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:23:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:23:53 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:23:53 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 09:23:54 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:23:54 - job_xml_thread(): Done retrieving: data size 42931840
Mon 20 Jan 2014 09:23:54 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:23:54 - XML: Start document: iteration 17
Mon 20 Jan 2014 09:23:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42931840
Mon 20 Jan 2014 09:23:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:23:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42931840
Mon 20 Jan 2014 09:23:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:23:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:23:59 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:24:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:24:00 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:24:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 09:24:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 09:24:00 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:24:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8596 values 135547 bits 16943 bytes 
Mon 20 Jan 2014 09:24:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:24:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:24:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:24:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:24:15 - XML: Processed 645312 elements - found 0 jobs
Mon 20 Jan 2014 09:24:15 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:24:15 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:24:15 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:24:15 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:24:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:24:16 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:24:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:24:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:24:17 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:24:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:24:17 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:24:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:24:17 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:24:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:24:18 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:24:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:24:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:24:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:24:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:24:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:24:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:24:22 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:24:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 09:24:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:24:22 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:24:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42982681
Mon 20 Jan 2014 09:24:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:24:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42982681
Mon 20 Jan 2014 09:24:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:24:30 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:24:30 - job_xml_thread(): Done retrieving: data size 42982681
Mon 20 Jan 2014 09:24:31 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:24:31 - XML: Start document: iteration 18
Mon 20 Jan 2014 09:24:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:24:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:24:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:24:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:24:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:24:35 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:24:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:24:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:24:36 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:24:36 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:24:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:24:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:24:36 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:24:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:24:44 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:24:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:24:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:24:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:24:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:24:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:24:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:24:46 - XML: Processed 645908 elements - found 0 jobs
Mon 20 Jan 2014 09:24:46 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:24:46 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:24:46 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:24:46 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:24:50 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:24:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43473106
Mon 20 Jan 2014 09:24:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:24:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43473106
Mon 20 Jan 2014 09:24:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:24:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:24:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:25:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:25:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:25:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:25:01 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:25:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:25:01 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:25:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:25:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:25:01 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:25:01 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:25:01 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:25:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:25:01 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:25:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:25:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:25:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 09:25:02 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:25:02 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:25:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 09:25:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99056 bits 12382 bytes 
Mon 20 Jan 2014 09:25:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:25:05 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:25:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:25:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:25:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:25:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:25:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:25:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:25:08 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:25:08 - job_xml_thread(): Done retrieving: data size 43571529
Mon 20 Jan 2014 09:25:08 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:25:08 - XML: Start document: iteration 19
Mon 20 Jan 2014 09:25:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571529
Mon 20 Jan 2014 09:25:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:25:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571529
Mon 20 Jan 2014 09:25:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:25:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:25:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:25:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:25:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:25:23 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:25:23 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:25:23 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:25:23 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:25:23 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:25:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:25:29 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:25:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:25:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:25:29 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:25:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:25:29 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:25:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:25:29 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:25:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:25:31 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:25:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:25:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:25:31 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:25:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 09:25:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:25:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:25:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:25:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:25:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:25:35 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 09:25:35 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 09:25:35 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:25:35 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:25:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565139
Mon 20 Jan 2014 09:25:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:25:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565139
Mon 20 Jan 2014 09:25:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:25:38 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:25:38 - job_xml_thread(): Done retrieving: data size 43565139
Mon 20 Jan 2014 09:25:38 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:25:38 - XML: Start document: iteration 20
Mon 20 Jan 2014 09:25:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:25:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:25:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:25:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:25:52 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:25:52 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:25:52 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:25:52 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:25:52 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:25:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:25:53 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:25:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:25:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:25:54 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:25:54 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:25:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:25:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:25:54 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:25:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:25:56 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:25:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:25:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:25:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:25:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:25:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:25:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:25:58 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:25:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573096
Mon 20 Jan 2014 09:25:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:25:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573096
Mon 20 Jan 2014 09:25:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:26:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:26:02 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:26:02 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:26:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 09:26:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:26:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 09:26:03 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:26:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8744 values 137876 bits 17234 bytes 
Mon 20 Jan 2014 09:26:07 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:26:07 - job_xml_thread(): Done retrieving: data size 43573096
Mon 20 Jan 2014 09:26:07 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:26:07 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 09:26:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:26:09 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 09:26:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:26:09 - Housekeeping: done.
Mon 20 Jan 2014 09:26:09 - XML: Start document: iteration 0
Mon 20 Jan 2014 09:26:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:26:09 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:26:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:26:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:26:11 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:26:11 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:26:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:26:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:26:11 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:26:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:26:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:26:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:26:20 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:26:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:26:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:26:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:26:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:26:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:26:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:26:21 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:26:21 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:26:21 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:26:21 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:26:21 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:26:24 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:26:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 09:26:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:26:24 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:26:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559184
Mon 20 Jan 2014 09:26:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:26:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559184
Mon 20 Jan 2014 09:26:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:26:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:26:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:26:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:26:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:26:36 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:26:36 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:26:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:26:36 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:26:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:26:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:26:38 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:26:38 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:26:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:26:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:26:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:26:40 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:26:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:26:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:26:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:26:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:26:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:26:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:26:42 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:26:42 - job_xml_thread(): Done retrieving: data size 43585613
Mon 20 Jan 2014 09:26:42 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:26:42 - XML: Start document: iteration 1
Mon 20 Jan 2014 09:26:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43585613
Mon 20 Jan 2014 09:26:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:26:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43585613
Mon 20 Jan 2014 09:26:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:26:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:26:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:26:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:26:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:26:55 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:26:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:26:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:26:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:26:57 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:26:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:26:57 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:26:57 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:26:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:27:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:27:02 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:27:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:27:03 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:27:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 09:27:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 09:27:03 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:27:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99059 bits 12382 bytes 
Mon 20 Jan 2014 09:27:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:27:04 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:27:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:27:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:27:05 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:27:05 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:27:05 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:27:05 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:27:05 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:27:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:27:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:27:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:27:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:27:08 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:27:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560566
Mon 20 Jan 2014 09:27:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:27:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560566
Mon 20 Jan 2014 09:27:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:27:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:27:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:27:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:27:18 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:27:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:27:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:27:19 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:27:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:27:19 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:27:19 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:27:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:27:20 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:27:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:27:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:27:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:27:22 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:27:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:27:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:27:22 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:27:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 09:27:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:27:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:27:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:27:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:27:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:27:25 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:27:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43590134
Mon 20 Jan 2014 09:27:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:27:25 - job_xml_thread(): Done retrieving: data size 43590134
Mon 20 Jan 2014 09:27:25 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:27:25 - XML: Start document: iteration 2
Mon 20 Jan 2014 09:27:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43590134
Mon 20 Jan 2014 09:27:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:27:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:27:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:27:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:27:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:27:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:27:40 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:27:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:27:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:27:41 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:27:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:27:41 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:27:41 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:27:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:27:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:27:46 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:27:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:27:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:27:47 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:27:47 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:27:47 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:27:47 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:27:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:27:47 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:27:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:27:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:27:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:27:49 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:27:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557390
Mon 20 Jan 2014 09:27:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:27:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557390
Mon 20 Jan 2014 09:27:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:27:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:27:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:27:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:27:59 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:28:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:28:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:28:01 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:28:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:28:01 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:28:01 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:28:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:28:02 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:28:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:28:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:28:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:28:03 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:28:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:28:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:28:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:28:03 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:28:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:28:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:28:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:28:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:28:04 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:28:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 09:28:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:28:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 09:28:04 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:28:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9128 values 143990 bits 17998 bytes 
Mon 20 Jan 2014 09:28:06 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:28:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581573
Mon 20 Jan 2014 09:28:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:28:06 - job_xml_thread(): Done retrieving: data size 43581573
Mon 20 Jan 2014 09:28:06 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:28:06 - XML: Start document: iteration 3
Mon 20 Jan 2014 09:28:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581573
Mon 20 Jan 2014 09:28:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:28:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:28:16 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:28:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:28:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:28:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:28:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:28:20 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:28:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:28:20 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:28:20 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:28:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:28:24 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:28:24 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:28:24 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:28:24 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:28:24 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:28:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:28:28 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:28:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:28:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:28:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:28:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:28:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:28:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:28:29 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:28:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 09:28:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:28:30 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:28:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43551987
Mon 20 Jan 2014 09:28:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:28:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43551987
Mon 20 Jan 2014 09:28:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:28:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:28:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:28:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:28:38 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:28:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:28:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:28:39 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:28:39 - job_xml_thread(): Done retrieving: data size 43551987
Mon 20 Jan 2014 09:28:39 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:28:39 - XML: Start document: iteration 4
Mon 20 Jan 2014 09:28:40 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:28:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:28:40 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:28:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:28:40 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:28:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:28:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:28:51 - XML: Processed 653356 elements - found 0 jobs
Mon 20 Jan 2014 09:28:51 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:28:51 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:28:51 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:28:51 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:28:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:28:52 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:28:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:28:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:28:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:28:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:28:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:28:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:28:54 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:28:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558409
Mon 20 Jan 2014 09:28:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:28:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558409
Mon 20 Jan 2014 09:28:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:28:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:28:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:29:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:29:02 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:29:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:29:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:29:04 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:29:04 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:29:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:29:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:29:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:29:04 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:29:04 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:29:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:29:05 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:29:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 09:29:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 09:29:05 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:29:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7312 values 115276 bits 14409 bytes 
Mon 20 Jan 2014 09:29:06 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:29:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:29:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:29:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:29:07 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:29:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:29:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:29:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:29:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:29:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:29:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:29:09 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:29:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43534012
Mon 20 Jan 2014 09:29:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:29:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43534012
Mon 20 Jan 2014 09:29:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:29:10 - job_xml_thread(): Done retrieving: data size 43534012
Mon 20 Jan 2014 09:29:10 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:29:10 - XML: Start document: iteration 5
Mon 20 Jan 2014 09:29:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:29:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:29:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:29:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:29:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:29:24 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:29:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:29:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:29:24 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:29:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:29:25 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:29:25 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:29:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:29:28 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:29:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 09:29:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:29:30 - XML: Processed 652608 elements - found 0 jobs
Mon 20 Jan 2014 09:29:30 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:29:30 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:29:30 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:29:30 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:29:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:29:33 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:29:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:29:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:29:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:29:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:29:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:29:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:29:35 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:29:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43365842
Mon 20 Jan 2014 09:29:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:29:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43365842
Mon 20 Jan 2014 09:29:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:29:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:29:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:29:45 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:29:45 - job_xml_thread(): Done retrieving: data size 43365842
Mon 20 Jan 2014 09:29:45 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:29:45 - XML: Start document: iteration 6
Mon 20 Jan 2014 09:29:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:29:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:29:49 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:29:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:29:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:29:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:29:50 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:29:50 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:29:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:29:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:29:51 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:29:53 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 09:29:53 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:29:54 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:29:54 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 09:29:54 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:29:54 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 09:29:54 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 09:29:56 - size of cluster 'LISA Cluster': 624 hosts 79487 metrics 943251 values 14875104 bits 1859388 bytes 
Mon 20 Jan 2014 09:29:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:29:58 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:29:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:29:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:29:59 - XML: Processed 651084 elements - found 0 jobs
Mon 20 Jan 2014 09:29:59 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:29:59 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:29:59 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:29:59 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:29:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:29:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:29:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:29:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:30:02 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:30:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42895708
Mon 20 Jan 2014 09:30:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:30:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42895708
Mon 20 Jan 2014 09:30:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:30:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:30:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:30:05 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:30:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:30:07 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:30:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 09:30:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:30:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 09:30:07 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:30:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9273 values 146228 bits 18278 bytes 
Mon 20 Jan 2014 09:30:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:30:12 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:30:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:30:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:30:13 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:30:13 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:30:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:30:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:30:13 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:30:14 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:30:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:30:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:30:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:30:16 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:30:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:30:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:30:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:30:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:30:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:30:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:30:20 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:30:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42959898
Mon 20 Jan 2014 09:30:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:30:20 - job_xml_thread(): Done retrieving: data size 42959898
Mon 20 Jan 2014 09:30:20 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:30:20 - XML: Start document: iteration 7
Mon 20 Jan 2014 09:30:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42959898
Mon 20 Jan 2014 09:30:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:30:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:30:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:30:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:30:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:30:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:30:37 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:30:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:30:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:30:38 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:30:38 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:30:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:30:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:30:38 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:30:38 - XML: Processed 645834 elements - found 0 jobs
Mon 20 Jan 2014 09:30:38 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:30:38 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:30:39 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:30:39 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:30:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:30:41 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:30:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:30:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:30:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:30:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:30:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:30:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:30:42 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:30:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 09:30:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:30:44 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:30:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43428470
Mon 20 Jan 2014 09:30:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:30:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43428470
Mon 20 Jan 2014 09:30:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:30:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:30:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:30:54 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:30:54 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 09:30:54 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:30:54 - job_xml_thread(): Done retrieving: data size 43428470
Mon 20 Jan 2014 09:30:54 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:30:54 - XML: Start document: iteration 8
Mon 20 Jan 2014 09:30:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:30:56 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:30:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:30:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:30:56 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:30:56 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:30:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:30:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:30:56 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:30:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:30:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:31:04 - XML: Processed 651684 elements - found 0 jobs
Mon 20 Jan 2014 09:31:04 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:31:04 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:31:04 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:31:04 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:31:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:31:05 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:31:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:31:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:31:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:31:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:31:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:31:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:31:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:31:07 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:31:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:31:08 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:31:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 09:31:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 09:31:08 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:31:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5376 values 84766 bits 10595 bytes 
Mon 20 Jan 2014 09:31:09 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:31:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554088
Mon 20 Jan 2014 09:31:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:31:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554088
Mon 20 Jan 2014 09:31:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:31:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:31:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:31:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:31:19 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:31:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:31:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:31:19 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:31:19 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:31:20 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:31:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:31:20 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:31:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:31:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:31:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:31:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:31:24 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:31:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:31:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:31:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:31:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:31:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:31:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:31:27 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:31:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 09:31:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:31:27 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:31:27 - job_xml_thread(): Done retrieving: data size 43573713
Mon 20 Jan 2014 09:31:27 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:31:27 - XML: Start document: iteration 9
Mon 20 Jan 2014 09:31:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573713
Mon 20 Jan 2014 09:31:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:31:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573713
Mon 20 Jan 2014 09:31:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:31:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:31:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:31:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:31:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:31:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:31:43 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:31:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:31:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:31:44 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:31:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:31:44 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:31:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:31:44 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:31:47 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:31:47 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:31:47 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:31:47 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:31:47 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:31:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:31:50 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:31:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:31:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:31:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:31:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:31:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:31:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:31:53 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:31:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567114
Mon 20 Jan 2014 09:31:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:31:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567114
Mon 20 Jan 2014 09:31:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:31:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:31:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:32:02 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:32:02 - job_xml_thread(): Done retrieving: data size 43567114
Mon 20 Jan 2014 09:32:02 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:32:02 - XML: Start document: iteration 10
Mon 20 Jan 2014 09:32:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:32:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:32:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:32:08 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:32:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:32:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 09:32:09 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:32:09 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:32:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 09:32:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6936 values 109659 bits 13707 bytes 
Mon 20 Jan 2014 09:32:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:32:09 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:32:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:32:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:32:10 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:32:10 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:32:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:32:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:32:10 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:32:14 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:32:14 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:32:14 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:32:14 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:32:14 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:32:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:32:15 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:32:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:32:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:32:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:32:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:32:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:32:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:32:19 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:32:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561636
Mon 20 Jan 2014 09:32:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:32:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561636
Mon 20 Jan 2014 09:32:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:32:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:32:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:32:29 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:32:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:32:29 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:32:29 - job_xml_thread(): Done retrieving: data size 43561636
Mon 20 Jan 2014 09:32:29 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:32:29 - XML: Start document: iteration 11
Mon 20 Jan 2014 09:32:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:32:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:32:30 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:32:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 09:32:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:32:30 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:32:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:32:30 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:32:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:32:30 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:32:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:32:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:32:40 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:32:40 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:32:40 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:32:40 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:32:40 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:32:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:32:42 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:32:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:32:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:32:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:32:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:32:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:32:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:32:45 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:32:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43551803
Mon 20 Jan 2014 09:32:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:32:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:32:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:32:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43551803
Mon 20 Jan 2014 09:32:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:32:55 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:32:55 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:32:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:32:55 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:32:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:32:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:32:56 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:32:56 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:32:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:32:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:32:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:32:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:33:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:33:01 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:33:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:33:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:33:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:33:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:33:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:33:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:33:05 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:33:05 - job_xml_thread(): Done retrieving: data size 43557499
Mon 20 Jan 2014 09:33:05 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:33:05 - XML: Start document: iteration 12
Mon 20 Jan 2014 09:33:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557499
Mon 20 Jan 2014 09:33:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:33:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557499
Mon 20 Jan 2014 09:33:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:33:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:33:09 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:33:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:33:11 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:33:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 09:33:11 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:33:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6049 values 95733 bits 11966 bytes 
Mon 20 Jan 2014 09:33:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:33:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:33:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 09:33:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:33:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:33:20 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:33:20 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:33:20 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:33:20 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:33:20 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:33:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:33:26 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:33:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:33:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:33:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:33:26 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:33:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:33:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:33:26 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:33:26 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:33:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:33:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:33:26 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:33:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:33:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:33:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:33:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:33:30 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:33:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572964
Mon 20 Jan 2014 09:33:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:33:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572964
Mon 20 Jan 2014 09:33:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:33:35 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:33:35 - job_xml_thread(): Done retrieving: data size 43572964
Mon 20 Jan 2014 09:33:36 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:33:36 - XML: Start document: iteration 13
Mon 20 Jan 2014 09:33:36 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:33:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 09:33:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:33:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:33:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:33:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:33:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:33:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:33:45 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:33:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:33:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:33:46 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:33:46 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:33:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:33:46 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:33:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:33:50 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:33:50 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:33:50 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:33:50 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:33:50 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:33:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:33:53 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:33:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:33:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:33:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:33:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:33:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:33:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:33:57 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:33:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566358
Mon 20 Jan 2014 09:33:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:33:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566358
Mon 20 Jan 2014 09:33:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:34:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:34:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:34:06 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:34:06 - job_xml_thread(): Done retrieving: data size 43566358
Mon 20 Jan 2014 09:34:06 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:34:07 - XML: Start document: iteration 14
Mon 20 Jan 2014 09:34:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:34:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:34:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:34:09 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:34:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:34:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:34:11 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:34:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:34:11 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:34:11 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:34:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:34:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:34:13 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:34:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:34:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 09:34:13 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:34:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6266 values 98968 bits 12371 bytes 
Mon 20 Jan 2014 09:34:13 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:34:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 09:34:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:34:16 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:34:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:34:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:34:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:34:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:34:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:34:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:34:20 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:34:20 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:34:20 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:34:20 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:34:20 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:34:20 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 09:34:20 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 09:34:20 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:34:22 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:34:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561896
Mon 20 Jan 2014 09:34:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:34:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561896
Mon 20 Jan 2014 09:34:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:34:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:34:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:34:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:34:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:34:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:34:32 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:34:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:34:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:34:33 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:34:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:34:33 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:34:33 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:34:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:34:35 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:34:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:34:36 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:34:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:34:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:34:37 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:34:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 09:34:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:34:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:34:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:34:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:34:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:34:38 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:34:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43587964
Mon 20 Jan 2014 09:34:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:34:39 - job_xml_thread(): Done retrieving: data size 43587964
Mon 20 Jan 2014 09:34:39 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:34:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43587964
Mon 20 Jan 2014 09:34:40 - XML: Start document: iteration 15
Mon 20 Jan 2014 09:34:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:34:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:34:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:34:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:34:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:34:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:34:55 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:34:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:34:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:34:56 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:34:56 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:34:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:34:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:34:57 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:35:00 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:35:00 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:35:00 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:35:00 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:35:00 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:35:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:35:01 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:35:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:35:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:35:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:35:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:35:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:35:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:35:04 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:35:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564386
Mon 20 Jan 2014 09:35:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:35:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564386
Mon 20 Jan 2014 09:35:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:35:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:35:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:35:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:35:12 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:35:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:35:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:35:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:35:13 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:35:14 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:35:14 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:35:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:35:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:35:14 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:35:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:35:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 09:35:14 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:35:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 09:35:15 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:35:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8809 values 138897 bits 17362 bytes 
Mon 20 Jan 2014 09:35:15 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:35:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:35:16 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:35:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:35:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:35:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:35:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:35:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:35:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:35:19 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:35:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43502305
Mon 20 Jan 2014 09:35:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:35:19 - job_xml_thread(): Done retrieving: data size 43502305
Mon 20 Jan 2014 09:35:19 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:35:19 - XML: Start document: iteration 16
Mon 20 Jan 2014 09:35:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43502305
Mon 20 Jan 2014 09:35:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:35:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:35:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:35:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:35:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:35:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:35:33 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:35:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:35:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:35:34 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:35:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:35:34 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:35:34 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:35:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:35:36 - XML: Processed 652608 elements - found 0 jobs
Mon 20 Jan 2014 09:35:36 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:35:36 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:35:36 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:35:36 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:35:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:35:41 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:35:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:35:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:35:41 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:35:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 09:35:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:35:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:35:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:35:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:35:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:35:42 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:35:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43000893
Mon 20 Jan 2014 09:35:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:35:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43000893
Mon 20 Jan 2014 09:35:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:35:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:35:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:35:51 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:35:51 - job_xml_thread(): Done retrieving: data size 43000893
Mon 20 Jan 2014 09:35:51 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:35:52 - XML: Start document: iteration 17
Mon 20 Jan 2014 09:35:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:35:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:36:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:36:00 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:36:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:36:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:36:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:36:01 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:36:01 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:36:01 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:36:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:36:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:36:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:36:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:36:01 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:36:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:36:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:36:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:36:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:36:05 - XML: Processed 646296 elements - found 0 jobs
Mon 20 Jan 2014 09:36:05 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:36:05 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:36:05 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:36:05 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:36:07 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:36:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42919367
Mon 20 Jan 2014 09:36:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:36:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42919367
Mon 20 Jan 2014 09:36:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:36:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:36:15 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:36:15 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:36:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:36:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 09:36:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 09:36:15 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:36:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8795 values 138662 bits 17332 bytes 
Mon 20 Jan 2014 09:36:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:36:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:36:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:36:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:36:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:36:18 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:36:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:36:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:36:19 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:36:19 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:36:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:36:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:36:19 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:36:20 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:36:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:36:20 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:36:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:36:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:36:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:36:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:36:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:36:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:36:23 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:36:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42992430
Mon 20 Jan 2014 09:36:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:36:23 - job_xml_thread(): Done retrieving: data size 42992430
Mon 20 Jan 2014 09:36:23 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:36:23 - XML: Start document: iteration 18
Mon 20 Jan 2014 09:36:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42992430
Mon 20 Jan 2014 09:36:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:36:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:36:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:36:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:36:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:36:40 - XML: Processed 645908 elements - found 0 jobs
Mon 20 Jan 2014 09:36:40 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:36:40 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:36:40 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:36:40 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:36:42 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:36:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 09:36:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:36:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:36:43 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:36:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:36:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:36:44 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:36:44 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:36:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:36:44 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:36:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:36:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:36:45 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:36:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:36:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:36:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:36:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:36:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:36:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:36:47 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:36:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43524387
Mon 20 Jan 2014 09:36:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:36:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43524387
Mon 20 Jan 2014 09:36:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:36:55 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 09:36:55 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:36:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:36:55 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:36:55 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:36:55 - job_xml_thread(): Done retrieving: data size 43524387
Mon 20 Jan 2014 09:36:55 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:36:55 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:36:55 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:36:55 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 09:36:55 - XML: Start document: iteration 19
Mon 20 Jan 2014 09:36:55 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 09:36:55 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 09:36:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:37:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:37:00 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:37:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:37:00 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:37:00 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:37:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:37:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:37:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:37:03 - XML: Processed 652808 elements - found 0 jobs
Mon 20 Jan 2014 09:37:03 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:37:03 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:37:03 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:37:03 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:37:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:37:04 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:37:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:37:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:37:05 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 822018 values 12977277 bits 1622159 bytes 
Mon 20 Jan 2014 09:37:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:37:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:37:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:37:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:37:08 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:37:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572667
Mon 20 Jan 2014 09:37:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:37:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572667
Mon 20 Jan 2014 09:37:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:37:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:37:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:37:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:37:15 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:37:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:37:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 09:37:17 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:37:17 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:37:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 09:37:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9210 values 145231 bits 18153 bytes 
Mon 20 Jan 2014 09:37:18 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:37:18 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:37:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:37:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:37:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:37:21 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:37:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:37:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:37:21 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:37:21 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:37:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:37:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:37:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:37:23 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:37:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:37:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:37:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:37:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:37:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:37:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:37:27 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:37:27 - job_xml_thread(): Done retrieving: data size 43578956
Mon 20 Jan 2014 09:37:27 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:37:27 - XML: Start document: iteration 20
Mon 20 Jan 2014 09:37:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578956
Mon 20 Jan 2014 09:37:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578956
Mon 20 Jan 2014 09:37:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:37:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:37:34 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:37:34 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:37:34 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:37:34 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:37:34 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:37:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:37:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:37:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:37:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:37:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:37:45 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:37:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:37:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:37:46 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:37:46 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:37:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:37:46 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:37:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:37:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:37:47 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:37:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:37:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:37:48 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:37:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 09:37:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:37:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:37:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:37:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:37:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:37:49 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:37:51 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:37:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580140
Mon 20 Jan 2014 09:37:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:37:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580140
Mon 20 Jan 2014 09:37:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:37:52 - job_xml_thread(): Done retrieving: data size 43580140
Mon 20 Jan 2014 09:37:52 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:37:52 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 09:37:53 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 09:37:53 - Housekeeping: done.
Mon 20 Jan 2014 09:37:53 - XML: Start document: iteration 0
Mon 20 Jan 2014 09:37:55 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:37:56 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 09:38:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:38:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:38:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:38:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:38:07 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:38:07 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:38:07 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:38:07 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:38:07 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:38:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:38:10 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:38:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:38:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:38:12 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:38:12 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:38:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:38:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:38:12 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:38:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:38:14 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:38:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:38:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:38:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:38:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:38:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:38:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:38:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:38:17 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:38:17 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:38:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564001
Mon 20 Jan 2014 09:38:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:38:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:38:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 09:38:17 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:38:17 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:38:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 09:38:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5623 values 88609 bits 11076 bytes 
Mon 20 Jan 2014 09:38:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564001
Mon 20 Jan 2014 09:38:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:38:22 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:38:22 - job_xml_thread(): Done retrieving: data size 43564001
Mon 20 Jan 2014 09:38:22 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:38:22 - XML: Start document: iteration 1
Mon 20 Jan 2014 09:38:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:38:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:38:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:38:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:38:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:38:32 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:38:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:38:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:38:33 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:38:33 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:38:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:38:33 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:38:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:38:35 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:38:35 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:38:35 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:38:35 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:38:35 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:38:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:38:39 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:38:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:38:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:38:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:38:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:38:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:38:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:38:42 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:38:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 09:38:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:38:42 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:38:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582112
Mon 20 Jan 2014 09:38:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:38:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582112
Mon 20 Jan 2014 09:38:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:38:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:38:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:38:51 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:38:51 - job_xml_thread(): Done retrieving: data size 43582112
Mon 20 Jan 2014 09:38:51 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:38:51 - XML: Start document: iteration 2
Mon 20 Jan 2014 09:38:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:38:54 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:38:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:38:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:38:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:38:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:38:55 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:38:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:38:55 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:38:55 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:38:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:39:05 - XML: Processed 653357 elements - found 0 jobs
Mon 20 Jan 2014 09:39:05 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:39:05 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:39:05 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:39:05 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:39:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:39:07 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:39:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:39:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:39:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:39:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:39:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:39:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:39:10 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:39:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556190
Mon 20 Jan 2014 09:39:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:39:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:39:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:39:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556190
Mon 20 Jan 2014 09:39:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:39:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:39:17 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:39:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:39:19 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:39:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 09:39:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 09:39:20 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:39:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6285 values 99128 bits 12391 bytes 
Mon 20 Jan 2014 09:39:20 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:39:20 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:39:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:39:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:39:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:39:23 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:39:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:39:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:39:24 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:39:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:39:24 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:39:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:39:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:39:27 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:39:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:39:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:39:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:39:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:39:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:39:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:39:30 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:39:30 - job_xml_thread(): Done retrieving: data size 43563602
Mon 20 Jan 2014 09:39:30 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:39:30 - XML: Start document: iteration 3
Mon 20 Jan 2014 09:39:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563602
Mon 20 Jan 2014 09:39:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:39:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563602
Mon 20 Jan 2014 09:39:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:39:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:39:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:39:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:39:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:39:47 - XML: Processed 653356 elements - found 0 jobs
Mon 20 Jan 2014 09:39:47 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:39:47 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:39:47 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:39:47 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:39:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:39:51 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:39:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:39:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:39:51 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:39:51 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:39:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:39:51 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:39:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:39:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:39:53 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:39:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:39:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:39:54 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:39:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 09:39:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:39:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:39:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:39:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:39:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:39:57 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:39:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583001
Mon 20 Jan 2014 09:39:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:39:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583001
Mon 20 Jan 2014 09:39:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:40:02 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:40:02 - job_xml_thread(): Done retrieving: data size 43583001
Mon 20 Jan 2014 09:40:02 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:40:02 - XML: Start document: iteration 4
Mon 20 Jan 2014 09:40:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:40:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:40:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:40:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:40:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:40:17 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:40:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:40:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:40:17 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:40:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:40:17 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:40:17 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:40:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:40:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:40:18 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:40:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:40:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:40:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:40:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:40:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:40:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:40:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:40:20 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:40:20 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:40:20 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:40:20 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:40:20 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:40:20 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:40:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:40:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 09:40:20 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:40:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5673 values 89384 bits 11173 bytes 
Mon 20 Jan 2014 09:40:20 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:40:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 09:40:22 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 09:40:22 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 09:40:22 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:40:23 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:40:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567686
Mon 20 Jan 2014 09:40:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:40:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567686
Mon 20 Jan 2014 09:40:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:40:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:40:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:40:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:40:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:40:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:40:34 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:40:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:40:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:40:35 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:40:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:40:35 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:40:35 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:40:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:40:35 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:40:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:40:38 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:40:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:40:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:40:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:40:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:40:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:40:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:40:39 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:40:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 09:40:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:40:40 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:40:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582693
Mon 20 Jan 2014 09:40:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:40:40 - job_xml_thread(): Done retrieving: data size 43582693
Mon 20 Jan 2014 09:40:40 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:40:40 - XML: Start document: iteration 5
Mon 20 Jan 2014 09:40:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582693
Mon 20 Jan 2014 09:40:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:40:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:40:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:40:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:40:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:40:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:40:57 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:40:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:40:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:40:58 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:40:58 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:40:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:40:58 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:40:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:41:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:41:02 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:41:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:41:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:41:02 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:41:02 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:41:02 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:41:02 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:41:02 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:41:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:41:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:41:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:41:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:41:04 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:41:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559972
Mon 20 Jan 2014 09:41:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:41:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559972
Mon 20 Jan 2014 09:41:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:41:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:41:12 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:41:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:41:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:41:14 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:41:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:41:14 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:41:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:41:14 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:41:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:41:17 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:41:17 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:41:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:41:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:41:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:41:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:41:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:41:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:41:19 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:41:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43497954
Mon 20 Jan 2014 09:41:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:41:19 - job_xml_thread(): Done retrieving: data size 43497954
Mon 20 Jan 2014 09:41:19 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:41:19 - XML: Start document: iteration 6
Mon 20 Jan 2014 09:41:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43497954
Mon 20 Jan 2014 09:41:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:41:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:41:20 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:41:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:41:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 09:41:21 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:41:21 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:41:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Mon 20 Jan 2014 09:41:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:41:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:41:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:41:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:41:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:41:36 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:41:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:41:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:41:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:41:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:41:38 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:41:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:41:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:41:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:41:41 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:41:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:41:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:41:42 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:41:42 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:41:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:41:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:41:43 - XML: Processed 652607 elements - found 0 jobs
Mon 20 Jan 2014 09:41:43 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:41:43 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:41:43 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:41:43 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:41:45 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:41:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42976052
Mon 20 Jan 2014 09:41:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:41:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42976052
Mon 20 Jan 2014 09:41:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:41:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:41:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:41:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:41:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:41:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:41:57 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:41:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:41:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:41:58 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:41:58 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:41:58 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:41:58 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:41:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:41:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:41:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:41:59 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:41:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:41:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:42:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:42:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:42:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:42:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:42:02 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:42:02 - job_xml_thread(): Done retrieving: data size 42920483
Mon 20 Jan 2014 09:42:02 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:42:02 - XML: Start document: iteration 7
Mon 20 Jan 2014 09:42:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42920483
Mon 20 Jan 2014 09:42:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42920483
Mon 20 Jan 2014 09:42:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:42:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:42:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:42:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:42:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:42:15 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:42:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:42:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:42:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:42:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:42:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:42:17 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:42:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:42:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:42:21 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:42:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:42:22 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:42:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 09:42:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 09:42:22 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:42:22 - XML: Processed 645158 elements - found 0 jobs
Mon 20 Jan 2014 09:42:22 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:42:22 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:42:22 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:42:22 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:42:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 17540 values 276534 bits 34566 bytes 
Mon 20 Jan 2014 09:42:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:42:23 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:42:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:42:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:42:24 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:42:24 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:42:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:42:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:42:26 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:42:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42966243
Mon 20 Jan 2014 09:42:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:42:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42966243
Mon 20 Jan 2014 09:42:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:42:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:42:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:42:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:42:36 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:42:37 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:42:37 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:42:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:42:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:42:39 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:42:39 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:42:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:42:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:42:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:42:39 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:42:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:42:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:42:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:42:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:42:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:42:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:42:40 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:42:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 09:42:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:42:42 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:42:42 - job_xml_thread(): Done retrieving: data size 43463639
Mon 20 Jan 2014 09:42:42 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:42:42 - XML: Start document: iteration 8
Mon 20 Jan 2014 09:42:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43463639
Mon 20 Jan 2014 09:42:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:42:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43463639
Mon 20 Jan 2014 09:42:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:42:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:42:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:42:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:42:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:42:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:42:57 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:42:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:42:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:42:58 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:42:58 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:42:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:42:58 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:42:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:43:00 - XML: Processed 651958 elements - found 0 jobs
Mon 20 Jan 2014 09:43:00 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:43:00 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:43:00 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:43:00 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:43:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:43:04 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:43:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:43:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:43:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:43:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:43:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:43:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:43:06 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:43:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43552050
Mon 20 Jan 2014 09:43:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:43:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43552050
Mon 20 Jan 2014 09:43:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:43:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:43:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:43:15 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:43:15 - job_xml_thread(): Done retrieving: data size 43552050
Mon 20 Jan 2014 09:43:15 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:43:15 - XML: Start document: iteration 9
Mon 20 Jan 2014 09:43:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:43:19 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:43:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:43:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:43:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:43:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:43:20 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:43:20 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:43:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:43:20 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:43:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:43:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:43:22 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:43:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:43:22 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:43:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 09:43:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 09:43:22 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:43:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8700 values 137137 bits 17142 bytes 
Mon 20 Jan 2014 09:43:25 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:43:25 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:43:25 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:43:25 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:43:25 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:43:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:43:27 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:43:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:43:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:43:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:43:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:43:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:43:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:43:30 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:43:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566034
Mon 20 Jan 2014 09:43:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:43:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566034
Mon 20 Jan 2014 09:43:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:43:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:43:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:43:40 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:43:40 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:43:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:43:40 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:43:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:43:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:43:41 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:43:41 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:43:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:43:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:43:43 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:43:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 09:43:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:43:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:43:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:43:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:43:46 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:43:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:43:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:43:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:43:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:43:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:43:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:43:48 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:43:48 - job_xml_thread(): Done retrieving: data size 43559617
Mon 20 Jan 2014 09:43:48 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:43:48 - XML: Start document: iteration 10
Mon 20 Jan 2014 09:43:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559617
Mon 20 Jan 2014 09:43:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:43:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559617
Mon 20 Jan 2014 09:43:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:43:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:43:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:43:57 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 09:43:59 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:44:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:44:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:44:01 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:44:01 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:44:01 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 09:44:01 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 09:44:01 - Entering storeMetrics(): cluster LISA Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Mon 20 Jan 2014 09:44:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:44:06 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:44:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:44:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:44:07 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:44:07 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:44:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:44:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:44:07 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:44:08 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:44:08 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:44:08 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:44:08 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:44:08 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:44:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:44:09 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:44:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:44:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:44:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:44:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:44:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:44:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:44:11 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:44:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578719
Mon 20 Jan 2014 09:44:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:44:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578719
Mon 20 Jan 2014 09:44:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:44:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:44:22 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:44:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:44:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:44:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:44:23 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:44:23 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:44:23 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:44:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:44:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:44:23 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:44:24 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:44:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:44:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 09:44:24 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:44:24 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:44:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 09:44:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9193 values 144963 bits 18120 bytes 
Mon 20 Jan 2014 09:44:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:44:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:44:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:44:25 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:44:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:44:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:44:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:44:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:44:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:44:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:44:28 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:44:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43588414
Mon 20 Jan 2014 09:44:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:44:28 - job_xml_thread(): Done retrieving: data size 43588414
Mon 20 Jan 2014 09:44:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43588414
Mon 20 Jan 2014 09:44:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:44:29 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:44:29 - XML: Start document: iteration 11
Mon 20 Jan 2014 09:44:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:44:39 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:44:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:44:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:44:40 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:44:40 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:44:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:44:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:44:40 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:44:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:44:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:44:48 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:44:48 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:44:48 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:44:48 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:44:48 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:44:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:44:51 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:44:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:44:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:44:51 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:44:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 09:44:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:44:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:44:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:44:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:44:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:44:53 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:44:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555013
Mon 20 Jan 2014 09:44:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:44:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555013
Mon 20 Jan 2014 09:44:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:44:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:44:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:45:01 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:45:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:45:01 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:45:01 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:45:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:45:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:45:03 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:45:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:45:03 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:45:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555013
Mon 20 Jan 2014 09:45:03 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:45:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:45:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:45:03 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:45:03 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 09:45:03 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 09:45:03 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 09:45:04 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:45:04 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:45:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:45:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:45:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:45:10 - ganglia_parse_thread(): finished: Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Mon 20 Jan 2014 09:45:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:45:14 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:45:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:45:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:45:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:45:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:45:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:45:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:45:15 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:45:15 - job_xml_thread(): Done retrieving: data size 43563973
Mon 20 Jan 2014 09:45:15 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:45:15 - XML: Start document: iteration 12
Mon 20 Jan 2014 09:45:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563973
Mon 20 Jan 2014 09:45:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:45:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:45:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:45:18 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:45:18 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:45:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:45:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:45:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563973
Mon 20 Jan 2014 09:45:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:45:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:45:24 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:45:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:45:26 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:45:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 09:45:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 09:45:26 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:45:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8777 values 138334 bits 17291 bytes 
Mon 20 Jan 2014 09:45:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:45:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:45:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:45:31 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:45:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:45:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:45:35 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:45:35 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:45:35 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:45:35 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:45:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:45:35 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:45:35 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:45:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:45:35 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:45:35 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:45:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:45:38 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:45:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:45:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:45:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:45:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:45:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:45:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:45:40 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:45:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572843
Mon 20 Jan 2014 09:45:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:45:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572843
Mon 20 Jan 2014 09:45:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:45:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:45:49 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:45:50 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:45:50 - job_xml_thread(): Done retrieving: data size 43572843
Mon 20 Jan 2014 09:45:50 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:45:50 - XML: Start document: iteration 13
Mon 20 Jan 2014 09:45:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:45:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:45:51 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:45:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:45:51 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:45:51 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:45:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:45:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:45:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:45:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:45:58 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:45:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:45:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:45:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:45:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:45:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:45:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:46:00 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:46:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 09:46:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:46:00 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:46:00 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:46:00 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:46:00 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:46:00 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:46:02 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:46:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557076
Mon 20 Jan 2014 09:46:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:46:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557076
Mon 20 Jan 2014 09:46:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:46:03 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:46:03 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:46:04 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:46:04 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:46:04 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 09:46:04 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 09:46:04 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 09:46:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:46:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Mon 20 Jan 2014 09:46:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:46:11 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:46:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:46:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:46:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:46:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:46:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:46:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:46:14 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:46:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:46:15 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:46:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:46:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:46:15 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:46:16 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:46:16 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:46:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:46:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:46:17 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:46:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574571
Mon 20 Jan 2014 09:46:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:46:18 - job_xml_thread(): Done retrieving: data size 43574571
Mon 20 Jan 2014 09:46:18 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:46:18 - XML: Start document: iteration 14
Mon 20 Jan 2014 09:46:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574571
Mon 20 Jan 2014 09:46:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:46:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:46:26 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:46:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:46:28 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:46:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 09:46:28 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:46:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 09:46:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9003 values 142042 bits 17755 bytes 
Mon 20 Jan 2014 09:46:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:46:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:46:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:46:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:46:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:46:31 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:46:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:46:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:46:33 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:46:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:46:33 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:46:33 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:46:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:46:37 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:46:37 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:46:37 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:46:37 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:46:37 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:46:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:46:39 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:46:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:46:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:46:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:46:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:46:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:46:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:46:42 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:46:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567096
Mon 20 Jan 2014 09:46:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:46:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567096
Mon 20 Jan 2014 09:46:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:46:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:46:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:46:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:46:51 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:46:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:46:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:46:52 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:46:52 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:46:53 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:46:53 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:46:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:46:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:46:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:46:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:46:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:46:55 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:46:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:46:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:46:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:46:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:46:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:46:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:46:56 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:46:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 09:46:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:46:57 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 09:46:57 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 09:46:57 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:46:59 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:46:59 - job_xml_thread(): Done retrieving: data size 43592182
Mon 20 Jan 2014 09:46:59 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:46:59 - XML: Start document: iteration 15
Mon 20 Jan 2014 09:46:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43592182
Mon 20 Jan 2014 09:46:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:47:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43592182
Mon 20 Jan 2014 09:47:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:47:05 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:47:05 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:47:06 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:47:07 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:47:07 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 09:47:07 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 09:47:07 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 09:47:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:47:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:47:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:47:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:47:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:47:12 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:47:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:47:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:47:13 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:47:13 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:47:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:47:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:47:13 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:47:15 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:47:15 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:47:15 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:47:16 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:47:16 - job_xml_thread(): Sleeping.. (15s)
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Mon 20 Jan 2014 09:47:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:47:20 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:47:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:47:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:47:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:47:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:47:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:47:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:47:24 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:47:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43486676
Mon 20 Jan 2014 09:47:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:47:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43486676
Mon 20 Jan 2014 09:47:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:47:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:47:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:47:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:47:29 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:47:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:47:29 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:47:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 09:47:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 09:47:29 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:47:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8649 values 136782 bits 17097 bytes 
Mon 20 Jan 2014 09:47:31 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:47:31 - job_xml_thread(): Done retrieving: data size 43486676
Mon 20 Jan 2014 09:47:31 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:47:31 - XML: Start document: iteration 16
Mon 20 Jan 2014 09:47:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:47:33 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:47:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:47:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:47:34 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:47:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:47:34 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:47:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43486676
Mon 20 Jan 2014 09:47:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:47:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:47:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:47:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:47:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:47:44 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:47:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:47:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:47:50 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:47:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:47:50 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:47:50 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:47:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:47:51 - XML: Processed 652608 elements - found 0 jobs
Mon 20 Jan 2014 09:47:51 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:47:51 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:47:51 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:47:51 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:47:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:47:53 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:47:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:47:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:47:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:47:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:47:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:47:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:47:53 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:47:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 09:47:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:47:56 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:47:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42919776
Mon 20 Jan 2014 09:47:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:47:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42919776
Mon 20 Jan 2014 09:47:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:48:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:48:03 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:48:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:48:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:48:06 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:48:06 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:48:07 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:48:07 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:48:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:48:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:48:07 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:48:07 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:48:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:48:08 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:48:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:48:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:48:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:48:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:48:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:48:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:48:08 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:48:08 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 09:48:08 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:48:08 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 09:48:08 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 09:48:10 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 1284222 values 20270994 bits 2533874 bytes 
Mon 20 Jan 2014 09:48:12 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:48:12 - job_xml_thread(): Done retrieving: data size 42915674
Mon 20 Jan 2014 09:48:12 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:48:12 - XML: Start document: iteration 17
Mon 20 Jan 2014 09:48:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42915674
Mon 20 Jan 2014 09:48:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:48:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42915674
Mon 20 Jan 2014 09:48:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:48:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:48:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:48:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:48:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:48:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:48:28 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:48:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:48:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:48:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:48:29 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:48:30 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:48:30 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:48:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:48:30 - XML: Processed 645158 elements - found 0 jobs
Mon 20 Jan 2014 09:48:30 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:48:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:48:30 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:48:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:48:30 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:48:30 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:48:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 09:48:30 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:48:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 09:48:30 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:48:30 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:48:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6339 values 100172 bits 12521 bytes 
Mon 20 Jan 2014 09:48:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:48:34 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:48:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:48:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:48:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:48:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:48:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:48:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:48:37 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:48:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43405845
Mon 20 Jan 2014 09:48:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:48:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43405845
Mon 20 Jan 2014 09:48:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:48:45 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:48:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:48:45 - job_xml_thread(): Done retrieving: data size 43405845
Mon 20 Jan 2014 09:48:45 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:48:45 - XML: Start document: iteration 18
Mon 20 Jan 2014 09:48:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:48:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:48:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:48:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:48:52 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:48:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:48:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:48:52 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:48:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:48:52 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:48:52 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:48:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:48:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:48:59 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:48:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:48:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:48:59 - XML: Processed 651388 elements - found 0 jobs
Mon 20 Jan 2014 09:48:59 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:48:59 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:48:59 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:48:59 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:49:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:49:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:49:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:49:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:49:00 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:49:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 09:49:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:49:02 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:49:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43541333
Mon 20 Jan 2014 09:49:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:49:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43541333
Mon 20 Jan 2014 09:49:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:49:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:49:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:49:08 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:49:08 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 09:49:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:49:14 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:49:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:49:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:49:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:49:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:49:15 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:49:15 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:49:16 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:49:17 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:49:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:49:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:49:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:49:17 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:49:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:49:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:49:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:49:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:49:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:49:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:49:19 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:49:19 - job_xml_thread(): Done retrieving: data size 43573951
Mon 20 Jan 2014 09:49:19 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:49:19 - XML: Start document: iteration 19
Mon 20 Jan 2014 09:49:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573951
Mon 20 Jan 2014 09:49:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:49:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573951
Mon 20 Jan 2014 09:49:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:49:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:49:30 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:49:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:49:32 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:49:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 09:49:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:49:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:49:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 09:49:32 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:49:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:49:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:49:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8938 values 140998 bits 17624 bytes 
Mon 20 Jan 2014 09:49:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:49:37 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:49:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:49:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:49:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:49:40 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:49:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:49:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:49:40 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:49:40 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:49:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:49:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:49:40 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:49:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:49:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:49:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:49:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:49:42 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:49:42 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:49:42 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:49:42 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:49:42 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:49:44 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:49:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 09:49:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:49:45 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:49:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570161
Mon 20 Jan 2014 09:49:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:49:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570161
Mon 20 Jan 2014 09:49:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:49:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:49:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:49:57 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:49:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:49:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:49:57 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:49:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:49:57 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:49:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:49:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:49:58 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:49:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:49:58 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:49:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:50:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:50:00 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:50:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:50:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:50:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:50:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:50:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:50:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:50:02 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:50:02 - job_xml_thread(): Done retrieving: data size 43562457
Mon 20 Jan 2014 09:50:02 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:50:02 - XML: Start document: iteration 20
Mon 20 Jan 2014 09:50:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562457
Mon 20 Jan 2014 09:50:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:50:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562457
Mon 20 Jan 2014 09:50:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:50:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:50:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:50:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:50:15 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:50:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:50:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:50:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:50:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:50:16 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:50:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:50:16 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:50:16 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:50:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:50:21 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:50:21 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:50:21 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:50:21 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:50:21 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:50:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:50:24 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:50:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:50:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:50:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:50:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:50:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:50:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:50:26 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:50:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565754
Mon 20 Jan 2014 09:50:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:50:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565754
Mon 20 Jan 2014 09:50:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:50:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:50:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:50:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:50:33 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:50:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:50:34 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:50:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:50:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:50:34 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:50:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:50:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565754
Mon 20 Jan 2014 09:50:34 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:50:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:50:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:50:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:50:35 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:50:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 09:50:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 09:50:35 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:50:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148550 bits 18568 bytes 
Mon 20 Jan 2014 09:50:36 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:50:37 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:50:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:50:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:50:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:50:46 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:50:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:50:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:50:46 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:50:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:50:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:50:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:50:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:50:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:50:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:50:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:50:50 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:50:50 - job_xml_thread(): Done retrieving: data size 43543440
Mon 20 Jan 2014 09:50:50 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:50:50 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 09:50:50 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 09:50:50 - Housekeeping: done.
Mon 20 Jan 2014 09:50:50 - XML: Start document: iteration 0
Mon 20 Jan 2014 09:50:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43543440
Mon 20 Jan 2014 09:50:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:50:51 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:50:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:50:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43543440
Mon 20 Jan 2014 09:50:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:50:51 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:50:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:51:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:51:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:51:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:51:05 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:51:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:51:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:51:06 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:51:06 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:51:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:51:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:51:06 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:51:08 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:51:08 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:51:08 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:51:08 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:51:08 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:51:09 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:51:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 09:51:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:51:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:51:11 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:51:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:51:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:51:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:51:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:51:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:51:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:51:14 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:51:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574774
Mon 20 Jan 2014 09:51:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:51:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574774
Mon 20 Jan 2014 09:51:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:51:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:51:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:51:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:51:22 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:51:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:51:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:51:23 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:51:23 - job_xml_thread(): Done retrieving: data size 43574774
Mon 20 Jan 2014 09:51:23 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:51:23 - XML: Start document: iteration 1
Mon 20 Jan 2014 09:51:24 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:51:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:51:24 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:51:24 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:51:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:51:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:51:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:51:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:51:35 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:51:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:51:36 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:51:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:51:36 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:51:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 09:51:36 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:51:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:51:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6082 values 95958 bits 11994 bytes 
Mon 20 Jan 2014 09:51:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:51:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 09:51:37 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:51:37 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:51:37 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:51:37 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:51:37 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:51:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:51:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:51:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:51:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:51:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:51:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:51:40 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:51:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43546372
Mon 20 Jan 2014 09:51:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:51:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43546372
Mon 20 Jan 2014 09:51:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:51:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:51:51 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:51:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:51:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:51:52 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:51:52 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:51:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:51:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:51:53 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:51:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:51:53 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:51:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:51:54 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:51:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 09:51:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:51:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:51:55 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:51:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:51:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:51:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:51:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:51:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:51:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:51:58 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:51:58 - job_xml_thread(): Done retrieving: data size 43587174
Mon 20 Jan 2014 09:51:58 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:51:58 - XML: Start document: iteration 2
Mon 20 Jan 2014 09:51:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43587174
Mon 20 Jan 2014 09:51:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43587174
Mon 20 Jan 2014 09:51:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:51:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:52:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:52:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:52:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:52:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:52:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:52:13 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:52:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:52:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:52:13 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:52:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:52:13 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:52:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:52:13 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:52:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:52:18 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:52:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:52:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:52:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:52:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:52:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:52:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:52:20 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:52:20 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:52:20 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:52:20 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:52:20 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:52:22 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:52:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560246
Mon 20 Jan 2014 09:52:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:52:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560246
Mon 20 Jan 2014 09:52:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:52:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:52:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:52:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:52:31 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:52:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:52:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:52:33 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:52:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:52:33 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:52:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:52:33 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:52:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:52:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:52:35 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:52:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:52:36 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:52:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:52:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:52:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:52:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:52:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:52:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:52:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:52:36 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:52:36 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:52:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 09:52:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:52:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 09:52:36 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:52:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9339 values 147366 bits 18420 bytes 
Mon 20 Jan 2014 09:52:38 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:52:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577398
Mon 20 Jan 2014 09:52:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:52:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577398
Mon 20 Jan 2014 09:52:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:52:39 - job_xml_thread(): Done retrieving: data size 43577398
Mon 20 Jan 2014 09:52:39 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:52:39 - XML: Start document: iteration 3
Mon 20 Jan 2014 09:52:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:52:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:52:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:52:50 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:52:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:52:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:52:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:52:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:52:52 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:52:52 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:52:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:52:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:52:52 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:52:57 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:52:57 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:52:57 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:52:57 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:52:57 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:53:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:53:01 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:53:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:53:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:53:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:53:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:53:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:53:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:53:02 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:53:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 09:53:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:53:04 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:53:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43541433
Mon 20 Jan 2014 09:53:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:53:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43541433
Mon 20 Jan 2014 09:53:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:53:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:53:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:53:13 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:53:13 - job_xml_thread(): Done retrieving: data size 43541433
Mon 20 Jan 2014 09:53:13 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:53:13 - XML: Start document: iteration 4
Mon 20 Jan 2014 09:53:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:53:15 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:53:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:53:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:53:16 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:53:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:53:16 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:53:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:53:16 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:53:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:53:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:53:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:53:26 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:53:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:53:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:53:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:53:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:53:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:53:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:53:27 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:53:27 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:53:27 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:53:27 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:53:27 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:53:30 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:53:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43493905
Mon 20 Jan 2014 09:53:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:53:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43493905
Mon 20 Jan 2014 09:53:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:53:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:53:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:53:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:53:36 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:53:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:53:37 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:53:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 09:53:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 09:53:37 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:53:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7754 values 122281 bits 15285 bytes 
Mon 20 Jan 2014 09:53:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:53:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:53:42 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:53:42 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:53:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:53:44 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:53:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:53:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:53:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:53:45 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:53:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:53:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:53:45 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:53:45 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:53:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:53:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:53:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:53:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:53:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:53:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:53:48 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:53:48 - job_xml_thread(): Done retrieving: data size 42960331
Mon 20 Jan 2014 09:53:48 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:53:48 - XML: Start document: iteration 5
Mon 20 Jan 2014 09:53:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42960331
Mon 20 Jan 2014 09:53:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:53:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42960331
Mon 20 Jan 2014 09:53:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:53:53 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:53:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 09:53:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:54:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:54:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:54:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:54:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:54:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:54:07 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:54:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:54:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:54:08 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:54:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:54:08 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:54:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:54:08 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:54:09 - XML: Processed 645798 elements - found 0 jobs
Mon 20 Jan 2014 09:54:09 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:54:09 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:54:09 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:54:09 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:54:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:54:11 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:54:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:54:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:54:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:54:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:54:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:54:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:54:14 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:54:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42922012
Mon 20 Jan 2014 09:54:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:54:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42922012
Mon 20 Jan 2014 09:54:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:54:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:54:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:54:24 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:54:24 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:54:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:54:25 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:54:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:54:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:54:26 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:54:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:54:26 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:54:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:54:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:54:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:54:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:54:28 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:54:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:54:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:54:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:54:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:54:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:54:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:54:31 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:54:31 - job_xml_thread(): Done retrieving: data size 43147982
Mon 20 Jan 2014 09:54:31 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:54:31 - XML: Start document: iteration 6
Mon 20 Jan 2014 09:54:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43147982
Mon 20 Jan 2014 09:54:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:54:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43147982
Mon 20 Jan 2014 09:54:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:54:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:54:37 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:54:38 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:54:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 09:54:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:54:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 09:54:38 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:54:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9393 values 148157 bits 18519 bytes 
Mon 20 Jan 2014 09:54:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:54:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:54:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:54:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:54:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:54:46 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:54:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:54:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:54:46 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:54:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:54:46 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:54:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:54:46 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:54:51 - XML: Processed 648054 elements - found 0 jobs
Mon 20 Jan 2014 09:54:51 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:54:51 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:54:51 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:54:51 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:54:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:54:53 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:54:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:54:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:54:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:54:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:54:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:54:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:54:56 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:54:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43531594
Mon 20 Jan 2014 09:54:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:54:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43531594
Mon 20 Jan 2014 09:54:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:55:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:55:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:55:06 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:55:06 - job_xml_thread(): Done retrieving: data size 43531594
Mon 20 Jan 2014 09:55:06 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:55:06 - XML: Start document: iteration 7
Mon 20 Jan 2014 09:55:09 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 09:55:09 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:55:09 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:55:09 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 09:55:09 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 09:55:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:55:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:55:10 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:55:10 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 09:55:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:55:12 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:55:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:55:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:55:13 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:55:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:55:13 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:55:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:55:13 - XMLGatherer.retrieveData(): actually retrieving data..
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Mon 20 Jan 2014 09:55:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:55:18 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:55:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:55:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:55:19 - XML: Processed 653038 elements - found 0 jobs
Mon 20 Jan 2014 09:55:19 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:55:19 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:55:19 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:55:19 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:55:19 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:55:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 09:55:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:55:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:55:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:55:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:55:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:55:22 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:55:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556815
Mon 20 Jan 2014 09:55:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:55:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556815
Mon 20 Jan 2014 09:55:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:55:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:55:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:55:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:55:29 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:55:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:55:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:55:31 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:55:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:55:31 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:55:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:55:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556815
Mon 20 Jan 2014 09:55:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:55:34 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:55:34 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:55:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:55:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:55:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:55:38 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:55:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:55:39 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:55:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 09:55:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 09:55:39 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:55:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5881 values 92715 bits 11589 bytes 
Mon 20 Jan 2014 09:55:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:55:41 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:55:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:55:42 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:55:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:55:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:55:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:55:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:55:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:55:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:55:44 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:55:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 09:55:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:55:45 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:55:45 - job_xml_thread(): Done retrieving: data size 43558811
Mon 20 Jan 2014 09:55:45 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:55:45 - XML: Start document: iteration 8
Mon 20 Jan 2014 09:55:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558811
Mon 20 Jan 2014 09:55:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:55:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:55:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:55:48 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:55:48 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:55:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:55:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:55:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558811
Mon 20 Jan 2014 09:55:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:55:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:55:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:55:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:55:58 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:56:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:56:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:56:05 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:56:05 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:56:05 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:56:05 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:56:05 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:56:05 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:56:05 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:56:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:56:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:56:05 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:56:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:56:08 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:56:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:56:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:56:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:56:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:56:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:56:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:56:10 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:56:10 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:56:11 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:56:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43588150
Mon 20 Jan 2014 09:56:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:56:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43588150
Mon 20 Jan 2014 09:56:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:56:12 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:56:12 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:56:12 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 09:56:12 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 09:56:12 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 09:56:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:56:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:56:20 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:56:20 - job_xml_thread(): Done retrieving: data size 43588150
Mon 20 Jan 2014 09:56:20 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:56:20 - XML: Start document: iteration 9
Mon 20 Jan 2014 09:56:21 - size of cluster 'LISA Cluster': 624 hosts 79476 metrics 1093073 values 17252993 bits 2156624 bytes 
Mon 20 Jan 2014 09:56:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:56:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:56:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:56:27 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:56:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:56:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:56:28 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:56:28 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:56:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:56:28 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:56:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:56:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:56:34 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:56:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:56:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:56:35 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:56:35 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:56:35 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:56:35 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:56:35 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:56:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:56:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:56:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:56:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:56:39 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:56:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563027
Mon 20 Jan 2014 09:56:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:56:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:56:40 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:56:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563027
Mon 20 Jan 2014 09:56:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:56:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:56:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 09:56:41 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:56:41 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:56:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 09:56:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148579 bits 18572 bytes 
Mon 20 Jan 2014 09:56:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:56:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:56:50 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:56:50 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:56:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:56:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:56:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:56:51 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:56:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:56:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:56:51 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:56:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:56:51 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:56:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:56:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:56:56 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:56:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:56:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:56:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:56:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:56:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:56:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:57:00 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:57:00 - job_xml_thread(): Done retrieving: data size 43578358
Mon 20 Jan 2014 09:57:00 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:57:00 - XML: Start document: iteration 10
Mon 20 Jan 2014 09:57:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578358
Mon 20 Jan 2014 09:57:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:57:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578358
Mon 20 Jan 2014 09:57:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:57:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:57:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:57:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:57:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:57:12 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:57:12 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 09:57:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:57:19 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:57:19 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:57:19 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:57:19 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:57:19 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:57:19 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:57:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:57:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:57:20 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:57:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:57:20 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:57:20 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:57:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:57:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:57:24 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:57:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:57:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:57:24 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:57:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 09:57:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:57:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:57:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:57:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:57:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:57:28 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:57:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579872
Mon 20 Jan 2014 09:57:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:57:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579872
Mon 20 Jan 2014 09:57:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:57:34 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:57:35 - job_xml_thread(): Done retrieving: data size 43579872
Mon 20 Jan 2014 09:57:35 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:57:35 - XML: Start document: iteration 11
Mon 20 Jan 2014 09:57:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:57:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:57:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:57:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:57:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:57:41 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:57:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:57:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 09:57:42 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:57:42 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:57:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 09:57:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5705 values 89918 bits 11239 bytes 
Mon 20 Jan 2014 09:57:43 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:57:43 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:57:43 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:57:43 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:57:43 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:57:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:57:46 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:57:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:57:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:57:46 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:57:46 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:57:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:57:46 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:57:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:57:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:57:49 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:57:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:57:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:57:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:57:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:57:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:57:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:57:54 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:57:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573818
Mon 20 Jan 2014 09:57:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:57:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573818
Mon 20 Jan 2014 09:57:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:57:58 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:57:58 - job_xml_thread(): Done retrieving: data size 43573818
Mon 20 Jan 2014 09:57:58 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:57:58 - XML: Start document: iteration 12
Mon 20 Jan 2014 09:58:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:58:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:58:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:58:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:58:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:58:09 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:58:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:58:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:58:09 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:58:09 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:58:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:58:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:58:10 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:58:13 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:58:13 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:58:13 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:58:13 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:58:13 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:58:13 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:58:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 09:58:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:58:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:58:16 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:58:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:58:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:58:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:58:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:58:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:58:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:58:20 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:58:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553116
Mon 20 Jan 2014 09:58:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:58:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553116
Mon 20 Jan 2014 09:58:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:58:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:58:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:58:28 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:58:28 - job_xml_thread(): Done retrieving: data size 43553116
Mon 20 Jan 2014 09:58:28 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:58:28 - XML: Start document: iteration 13
Mon 20 Jan 2014 09:58:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:58:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:58:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:58:35 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:58:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:58:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:58:37 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:58:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:58:37 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:58:37 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:58:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:58:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:58:40 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:58:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:58:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:58:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:58:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:58:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:58:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:58:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:58:42 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:58:43 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:58:43 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:58:43 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:58:43 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:58:43 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:58:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:58:43 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:58:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 09:58:43 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:58:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6042 values 95272 bits 11909 bytes 
Mon 20 Jan 2014 09:58:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 09:58:46 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 09:58:46 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 09:58:46 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:58:47 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:58:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 09:58:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:58:47 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:58:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564306
Mon 20 Jan 2014 09:58:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:58:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564306
Mon 20 Jan 2014 09:58:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:58:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:58:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:58:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:58:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:58:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:58:57 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:58:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:58:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:58:58 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:58:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:58:58 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:58:58 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:58:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:58:58 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:59:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:59:01 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:59:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:59:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:59:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:59:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:59:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:59:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:59:03 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:59:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565269
Mon 20 Jan 2014 09:59:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:59:04 - job_xml_thread(): Done retrieving: data size 43565269
Mon 20 Jan 2014 09:59:04 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:59:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565269
Mon 20 Jan 2014 09:59:04 - XML: Start document: iteration 14
Mon 20 Jan 2014 09:59:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:59:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:59:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:59:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:59:14 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:59:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:59:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:59:16 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:59:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:59:16 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:59:16 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:59:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:59:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:59:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:59:21 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 09:59:21 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:59:22 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:59:22 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:59:22 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 09:59:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:59:23 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:59:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:59:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:59:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:59:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:59:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:59:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:59:25 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:59:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43500051
Mon 20 Jan 2014 09:59:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:59:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43500051
Mon 20 Jan 2014 09:59:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:59:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:59:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:59:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:59:34 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:59:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 09:59:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:59:35 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:59:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:59:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43500051
Mon 20 Jan 2014 09:59:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:59:35 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:59:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:59:37 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 09:59:37 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 09:59:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 09:59:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 09:59:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:59:43 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:59:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:59:44 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:59:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 09:59:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 09:59:44 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 09:59:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148527 bits 18565 bytes 
Mon 20 Jan 2014 09:59:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 09:59:46 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 09:59:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 09:59:47 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 09:59:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 09:59:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 09:59:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:59:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 09:59:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 09:59:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 09:59:50 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 09:59:50 - job_xml_thread(): Done retrieving: data size 42939270
Mon 20 Jan 2014 09:59:50 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 09:59:50 - XML: Start document: iteration 15
Mon 20 Jan 2014 09:59:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42939270
Mon 20 Jan 2014 09:59:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 09:59:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 09:59:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 09:59:51 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:59:52 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 09:59:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 09:59:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42939270
Mon 20 Jan 2014 09:59:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 09:59:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 09:59:59 - XML: Processed 645962 elements - found 0 jobs
Mon 20 Jan 2014 09:59:59 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 09:59:59 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 09:59:59 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 09:59:59 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:00:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:00:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:00:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:00:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:00:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:00:08 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:00:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:00:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:00:08 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:00:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:00:08 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:00:08 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:00:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:00:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:00:11 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:00:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:00:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:00:11 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:00:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 10:00:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:00:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:00:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:00:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:00:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:00:13 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:00:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42915331
Mon 20 Jan 2014 10:00:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:00:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42915331
Mon 20 Jan 2014 10:00:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:00:14 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:00:14 - job_xml_thread(): Done retrieving: data size 42915331
Mon 20 Jan 2014 10:00:14 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:00:14 - XML: Start document: iteration 16
Mon 20 Jan 2014 10:00:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:00:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:00:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:00:24 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:00:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:00:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:00:25 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:00:25 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:00:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:00:25 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:00:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:00:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:00:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:00:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:00:33 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:00:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:00:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:00:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:00:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:00:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:00:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:00:35 - XML: Processed 645170 elements - found 0 jobs
Mon 20 Jan 2014 10:00:35 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:00:35 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:00:35 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:00:35 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:00:37 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:00:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43368246
Mon 20 Jan 2014 10:00:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:00:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43368246
Mon 20 Jan 2014 10:00:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:00:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:00:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:00:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:00:44 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:00:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:00:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 10:00:45 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:00:45 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:00:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 10:00:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8740 values 137802 bits 17225 bytes 
Mon 20 Jan 2014 10:00:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:00:47 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:00:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:00:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:00:48 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:00:48 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:00:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:00:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:00:48 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:00:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:00:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:00:50 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:00:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:00:52 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:00:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:00:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:00:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:00:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:00:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:00:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:00:54 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:00:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43534813
Mon 20 Jan 2014 10:00:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:00:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43534813
Mon 20 Jan 2014 10:00:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:00:55 - job_xml_thread(): Done retrieving: data size 43534813
Mon 20 Jan 2014 10:00:55 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:00:55 - XML: Start document: iteration 17
Mon 20 Jan 2014 10:01:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:01:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:01:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:01:06 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:01:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:01:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:01:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:01:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:01:07 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:01:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:01:07 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:01:07 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:01:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:01:11 - XML: Processed 652860 elements - found 0 jobs
Mon 20 Jan 2014 10:01:11 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:01:11 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:01:11 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:01:11 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:01:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:01:16 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:01:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:01:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:01:16 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:01:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 10:01:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:01:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:01:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:01:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:01:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:01:18 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:01:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43537160
Mon 20 Jan 2014 10:01:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:01:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43537160
Mon 20 Jan 2014 10:01:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:01:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:01:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:01:26 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:01:27 - job_xml_thread(): Done retrieving: data size 43537160
Mon 20 Jan 2014 10:01:27 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:01:27 - XML: Start document: iteration 18
Mon 20 Jan 2014 10:01:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:01:28 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:01:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:01:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:01:29 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:01:29 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:01:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:01:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:01:29 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:01:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:01:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:01:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:01:37 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:01:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:01:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:01:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:01:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:01:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:01:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:01:40 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 10:01:40 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:01:40 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:01:40 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:01:40 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:01:42 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:01:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558565
Mon 20 Jan 2014 10:01:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:01:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558565
Mon 20 Jan 2014 10:01:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:01:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:01:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:01:45 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:01:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:01:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:01:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 10:01:46 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:01:46 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:01:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 10:01:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8894 values 140514 bits 17564 bytes 
Mon 20 Jan 2014 10:01:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:01:50 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:01:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:01:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:01:51 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:01:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:01:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558565
Mon 20 Jan 2014 10:01:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:01:51 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:01:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:01:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:01:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:01:55 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:01:55 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:01:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:01:58 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:02:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:02:02 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:02:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:02:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:02:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:02:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:02:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:02:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:02:05 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:02:05 - job_xml_thread(): Done retrieving: data size 43554258
Mon 20 Jan 2014 10:02:05 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:02:05 - XML: Start document: iteration 19
Mon 20 Jan 2014 10:02:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554258
Mon 20 Jan 2014 10:02:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:02:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:02:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:02:07 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:02:07 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:02:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:02:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:02:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554258
Mon 20 Jan 2014 10:02:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:02:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:02:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:02:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:02:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:02:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:02:23 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:02:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:02:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:02:23 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:02:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:02:23 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:02:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:02:23 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:02:25 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 10:02:25 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:02:25 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:02:25 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:02:25 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:02:26 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:02:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 10:02:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:02:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:02:28 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:02:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:02:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:02:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:02:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:02:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:02:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:02:30 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:02:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567477
Mon 20 Jan 2014 10:02:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:02:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567477
Mon 20 Jan 2014 10:02:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:02:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:02:38 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:02:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:02:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:02:39 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:02:39 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:02:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:02:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567477
Mon 20 Jan 2014 10:02:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:02:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:02:40 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:02:40 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:02:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:02:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:02:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:02:46 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:02:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:02:47 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:02:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 10:02:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 10:02:47 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:02:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5925 values 93737 bits 11717 bytes 
Mon 20 Jan 2014 10:02:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:02:50 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:02:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:02:52 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:02:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:02:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:02:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:02:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:02:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:02:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:02:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:02:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:02:54 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:02:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:02:54 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:02:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:02:54 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:02:54 - job_xml_thread(): Done retrieving: data size 43559199
Mon 20 Jan 2014 10:02:54 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:02:54 - XML: Start document: iteration 20
Mon 20 Jan 2014 10:02:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559199
Mon 20 Jan 2014 10:02:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559199
Mon 20 Jan 2014 10:02:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:02:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:03:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:03:04 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:03:06 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:03:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 10:03:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:03:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:03:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:03:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:03:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:03:11 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:03:11 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:03:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:03:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:03:11 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:03:12 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 10:03:12 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 10:03:12 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:03:12 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:03:12 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:03:12 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:03:12 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:03:14 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:03:14 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:03:14 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 10:03:14 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 10:03:14 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 10:03:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:03:16 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:03:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:03:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:03:17 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 940772 values 14863283 bits 1857910 bytes 
Mon 20 Jan 2014 10:03:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:03:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:03:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:03:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:03:21 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:03:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556264
Mon 20 Jan 2014 10:03:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:03:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556264
Mon 20 Jan 2014 10:03:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:03:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:03:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:03:27 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:03:27 - job_xml_thread(): Done retrieving: data size 43556264
Mon 20 Jan 2014 10:03:27 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:03:27 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 10:03:27 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 10:03:27 - Housekeeping: done.
Mon 20 Jan 2014 10:03:27 - XML: Start document: iteration 0
Mon 20 Jan 2014 10:03:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:03:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:03:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:03:34 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:03:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:03:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:03:35 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:03:35 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:03:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:03:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:03:36 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:03:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:03:43 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:03:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:03:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:03:43 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 10:03:43 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:03:43 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:03:43 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:03:43 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:03:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:03:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:03:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:03:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:03:46 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:03:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565997
Mon 20 Jan 2014 10:03:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:03:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565997
Mon 20 Jan 2014 10:03:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:03:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:03:49 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:03:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:03:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 10:03:50 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:03:50 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:03:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 10:03:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9065 values 143275 bits 17909 bytes 
Mon 20 Jan 2014 10:03:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:03:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:03:58 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:03:58 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:03:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:03:58 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:03:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:03:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:03:58 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:03:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:03:58 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:03:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:03:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:03:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:04:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:04:02 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:04:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:04:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:04:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:04:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:04:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:04:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:04:06 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:04:06 - job_xml_thread(): Done retrieving: data size 43565455
Mon 20 Jan 2014 10:04:06 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:04:06 - XML: Start document: iteration 1
Mon 20 Jan 2014 10:04:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565455
Mon 20 Jan 2014 10:04:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:04:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565455
Mon 20 Jan 2014 10:04:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:04:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:04:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:04:14 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:04:14 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 10:04:18 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 10:04:18 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:04:18 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:04:18 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:04:18 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:04:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:04:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:04:20 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:04:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 10:04:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:04:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:04:24 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:04:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:04:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:04:25 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:04:25 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:04:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:04:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:04:25 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:04:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:04:29 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:04:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:04:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:04:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:04:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:04:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:04:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:04:32 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:04:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563599
Mon 20 Jan 2014 10:04:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:04:33 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:04:33 - job_xml_thread(): Done retrieving: data size 43563599
Mon 20 Jan 2014 10:04:33 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:04:33 - XML: Start document: iteration 2
Mon 20 Jan 2014 10:04:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563599
Mon 20 Jan 2014 10:04:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:04:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:04:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:04:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:04:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:04:44 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 10:04:44 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:04:44 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:04:44 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:04:44 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:04:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:04:50 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:04:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:04:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 10:04:51 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:04:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5993 values 94559 bits 11819 bytes 
Mon 20 Jan 2014 10:04:52 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:04:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 10:04:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:04:53 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:04:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:04:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:04:53 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:04:53 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:04:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:04:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:04:53 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:04:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:04:56 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:04:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:04:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:04:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:04:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:04:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:04:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:04:59 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:05:00 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:05:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577313
Mon 20 Jan 2014 10:05:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:05:00 - job_xml_thread(): Done retrieving: data size 43577313
Mon 20 Jan 2014 10:05:01 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:05:01 - XML: Start document: iteration 3
Mon 20 Jan 2014 10:05:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577313
Mon 20 Jan 2014 10:05:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:05:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:05:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:05:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:05:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:05:17 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 10:05:18 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:05:18 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:05:18 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:05:18 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:05:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:05:22 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:05:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:05:22 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:05:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:05:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:05:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:05:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:05:22 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:05:22 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:05:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:05:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:05:22 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:05:22 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:05:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 10:05:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:05:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:05:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:05:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:05:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:05:26 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:05:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43519889
Mon 20 Jan 2014 10:05:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:05:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43519889
Mon 20 Jan 2014 10:05:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:05:33 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:05:33 - job_xml_thread(): Done retrieving: data size 43519889
Mon 20 Jan 2014 10:05:34 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:05:34 - XML: Start document: iteration 4
Mon 20 Jan 2014 10:05:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:05:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:05:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:05:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:05:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:05:40 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:05:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:05:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:05:41 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:05:41 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:05:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:05:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:05:41 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:05:49 - XML: Processed 652596 elements - found 0 jobs
Mon 20 Jan 2014 10:05:49 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:05:49 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:05:49 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:05:49 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:05:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:05:50 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:05:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:05:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:05:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:05:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:05:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:05:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:05:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:05:52 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:05:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:05:52 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:05:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 10:05:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 10:05:52 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:05:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5814 values 91707 bits 11463 bytes 
Mon 20 Jan 2014 10:05:52 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:05:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42945485
Mon 20 Jan 2014 10:05:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:05:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42945485
Mon 20 Jan 2014 10:05:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:05:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:05:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:05:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:05:59 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:05:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:05:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:06:00 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:06:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:06:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42945485
Mon 20 Jan 2014 10:06:00 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:06:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:06:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:06:04 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:06:04 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:06:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:06:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:06:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:06:10 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:06:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:06:13 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:06:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:06:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:06:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:06:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:06:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:06:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:06:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:06:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:06:15 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:06:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:06:15 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:06:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:06:17 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:06:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 10:06:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:06:17 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:06:17 - job_xml_thread(): Done retrieving: data size 42934361
Mon 20 Jan 2014 10:06:17 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:06:17 - XML: Start document: iteration 5
Mon 20 Jan 2014 10:06:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42934361
Mon 20 Jan 2014 10:06:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:06:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42934361
Mon 20 Jan 2014 10:06:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:06:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:06:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:06:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:06:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:06:31 - XML: Processed 645754 elements - found 0 jobs
Mon 20 Jan 2014 10:06:31 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:06:31 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:06:31 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:06:31 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:06:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:06:36 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:06:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:06:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:06:37 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:06:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:06:37 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:06:37 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:06:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:06:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:06:40 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:06:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:06:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:06:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:06:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:06:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:06:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:06:44 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:06:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43395110
Mon 20 Jan 2014 10:06:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:06:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43395110
Mon 20 Jan 2014 10:06:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:06:46 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:06:47 - job_xml_thread(): Done retrieving: data size 43395110
Mon 20 Jan 2014 10:06:47 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:06:48 - XML: Start document: iteration 6
Mon 20 Jan 2014 10:06:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:06:52 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:06:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:06:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:06:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:06:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 10:06:54 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:06:54 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:06:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 10:06:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6664 values 105149 bits 13143 bytes 
Mon 20 Jan 2014 10:06:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:06:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:06:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:06:59 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:06:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:06:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:07:00 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:07:00 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:07:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:07:00 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:07:00 - XML: Processed 651172 elements - found 0 jobs
Mon 20 Jan 2014 10:07:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:07:00 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:07:00 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:07:00 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:07:00 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:07:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:07:07 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:07:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:07:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:07:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:07:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:07:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:07:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:07:11 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:07:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566101
Mon 20 Jan 2014 10:07:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:07:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566101
Mon 20 Jan 2014 10:07:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:07:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:07:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:07:16 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:07:16 - job_xml_thread(): Done retrieving: data size 43566101
Mon 20 Jan 2014 10:07:16 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:07:16 - XML: Start document: iteration 7
Mon 20 Jan 2014 10:07:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:07:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:07:29 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 10:07:29 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:07:29 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:07:29 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:07:29 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:07:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:07:29 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:07:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:07:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:07:30 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:07:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:07:30 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:07:30 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:07:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:07:31 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:07:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 10:07:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:07:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:07:34 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:07:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:07:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:07:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:07:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:07:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:07:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:07:38 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 10:07:38 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 10:07:38 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:07:38 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:07:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567126
Mon 20 Jan 2014 10:07:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:07:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567126
Mon 20 Jan 2014 10:07:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:07:44 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:07:45 - job_xml_thread(): Done retrieving: data size 43567126
Mon 20 Jan 2014 10:07:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:07:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:07:46 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:07:46 - XML: Start document: iteration 8
Mon 20 Jan 2014 10:07:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:07:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:07:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:07:52 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:07:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:07:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:07:52 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:07:52 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:07:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:07:52 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:07:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:07:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:07:55 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:07:56 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:07:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:07:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 10:07:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 10:07:56 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:07:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5955 values 93962 bits 11745 bytes 
Mon 20 Jan 2014 10:07:59 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 10:07:59 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:07:59 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:07:59 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:07:59 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:08:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:08:00 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:08:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:08:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:08:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:08:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:08:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:08:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:08:03 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:08:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43544079
Mon 20 Jan 2014 10:08:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:08:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43544079
Mon 20 Jan 2014 10:08:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:08:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:08:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:08:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:08:14 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:08:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:08:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:08:15 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:08:15 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:08:15 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:08:15 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:08:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:08:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:08:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:08:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:08:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:08:17 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:08:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:08:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:08:17 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:08:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 10:08:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:08:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:08:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:08:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:08:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:08:18 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:08:18 - job_xml_thread(): Done retrieving: data size 43576424
Mon 20 Jan 2014 10:08:18 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:08:18 - XML: Start document: iteration 9
Mon 20 Jan 2014 10:08:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576424
Mon 20 Jan 2014 10:08:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576424
Mon 20 Jan 2014 10:08:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:08:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:08:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:08:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:08:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:08:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:08:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:08:34 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:08:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:08:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:08:35 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:08:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:08:35 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:08:35 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:08:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:08:38 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 10:08:38 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:08:38 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:08:38 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:08:38 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:08:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:08:40 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:08:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:08:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:08:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:08:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:08:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:08:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:08:42 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:08:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43585464
Mon 20 Jan 2014 10:08:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:08:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43585464
Mon 20 Jan 2014 10:08:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:08:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:08:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:08:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:08:52 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:08:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:08:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:08:53 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:08:53 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:08:54 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:08:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:08:54 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:08:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:08:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:08:54 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:08:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:08:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:08:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:08:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:08:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:08:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:08:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:08:56 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:08:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:08:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 10:08:56 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:08:56 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:08:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 10:08:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9172 values 144762 bits 18095 bytes 
Mon 20 Jan 2014 10:08:56 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:08:56 - job_xml_thread(): Done retrieving: data size 43598827
Mon 20 Jan 2014 10:08:56 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:08:56 - XML: Start document: iteration 10
Mon 20 Jan 2014 10:08:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43598827
Mon 20 Jan 2014 10:08:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43598827
Mon 20 Jan 2014 10:08:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:08:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:09:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:09:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:09:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:09:10 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:09:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:09:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:09:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:09:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:09:12 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:09:12 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:09:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:09:12 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:09:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:09:14 - XML: Processed 653357 elements - found 0 jobs
Mon 20 Jan 2014 10:09:14 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:09:14 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:09:14 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:09:14 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:09:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:09:18 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:09:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:09:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:09:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:09:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:09:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:09:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:09:21 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:09:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 10:09:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:09:21 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:09:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561396
Mon 20 Jan 2014 10:09:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:09:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561396
Mon 20 Jan 2014 10:09:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:09:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:09:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:09:29 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:09:29 - job_xml_thread(): Done retrieving: data size 43561396
Mon 20 Jan 2014 10:09:29 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:09:29 - XML: Start document: iteration 11
Mon 20 Jan 2014 10:09:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:09:33 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:09:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:09:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:09:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:09:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:09:35 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:09:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:09:35 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:09:35 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:09:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:09:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:09:44 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:09:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:09:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:09:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:09:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:09:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:09:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:09:45 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 10:09:45 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:09:45 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:09:45 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:09:45 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:09:47 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:09:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43542832
Mon 20 Jan 2014 10:09:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:09:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43542832
Mon 20 Jan 2014 10:09:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:09:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:09:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:09:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:09:56 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:09:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:09:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 10:09:57 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:09:57 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:09:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 10:09:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6636 values 104633 bits 13079 bytes 
Mon 20 Jan 2014 10:09:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:09:58 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:09:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:09:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:09:59 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:09:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:09:59 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:09:59 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:09:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:10:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:10:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:10:00 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:10:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:10:02 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:10:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:10:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:10:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:10:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:10:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:10:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:10:03 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:10:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 10:10:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:10:04 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:10:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567927
Mon 20 Jan 2014 10:10:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:10:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567927
Mon 20 Jan 2014 10:10:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:10:05 - job_xml_thread(): Done retrieving: data size 43567927
Mon 20 Jan 2014 10:10:05 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:10:05 - XML: Start document: iteration 12
Mon 20 Jan 2014 10:10:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:10:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:10:14 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 10:10:15 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:10:16 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:10:16 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:10:16 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 10:10:17 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 10:10:17 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 10:10:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:10:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Mon 20 Jan 2014 10:10:24 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 10:10:24 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:10:24 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:10:24 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:10:24 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:10:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:10:24 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:10:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:10:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:10:25 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:10:25 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:10:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:10:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:10:25 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:10:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:10:27 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:10:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:10:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:10:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:10:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:10:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:10:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:10:28 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:10:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579455
Mon 20 Jan 2014 10:10:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:10:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579455
Mon 20 Jan 2014 10:10:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:10:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:10:35 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:10:39 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:10:39 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:10:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:10:40 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:10:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:10:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:10:41 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:10:41 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:10:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:10:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:10:42 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:10:42 - job_xml_thread(): Done retrieving: data size 43584301
Mon 20 Jan 2014 10:10:42 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:10:42 - XML: Start document: iteration 13
Mon 20 Jan 2014 10:10:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584301
Mon 20 Jan 2014 10:10:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:10:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:10:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:10:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:10:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:10:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:10:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:10:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584301
Mon 20 Jan 2014 10:10:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:10:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:10:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:10:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:10:57 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:10:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:10:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 10:10:59 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:10:59 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:10:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 10:11:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:11:00 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:11:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148576 bits 18572 bytes 
Mon 20 Jan 2014 10:11:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:11:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:11:01 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 10:11:01 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:11:01 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:11:01 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:11:01 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:11:01 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:11:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:11:01 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:11:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:11:01 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:11:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:11:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:11:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:11:04 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:11:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:11:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:11:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:11:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:11:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:11:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:11:06 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:11:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583208
Mon 20 Jan 2014 10:11:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:11:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583208
Mon 20 Jan 2014 10:11:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:11:16 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:11:16 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:11:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:11:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:11:18 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:11:18 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:11:18 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:11:18 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:11:18 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 10:11:18 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 10:11:18 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 10:11:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:11:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:11:19 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:11:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:11:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:11:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:11:20 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:11:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:11:20 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:11:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:11:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:11:21 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:11:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:11:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:11:22 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 885215 values 13965414 bits 1745676 bytes 
Mon 20 Jan 2014 10:11:22 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:11:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 10:11:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:11:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:11:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:11:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:11:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:11:25 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:11:25 - job_xml_thread(): Done retrieving: data size 43520136
Mon 20 Jan 2014 10:11:25 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:11:25 - XML: Start document: iteration 14
Mon 20 Jan 2014 10:11:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43520136
Mon 20 Jan 2014 10:11:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43520136
Mon 20 Jan 2014 10:11:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:11:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:11:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:11:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:11:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:11:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:11:40 - XML: Processed 652608 elements - found 0 jobs
Mon 20 Jan 2014 10:11:40 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:11:41 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:11:41 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:11:41 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:11:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:11:42 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:11:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:11:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:11:43 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:11:43 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:11:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:11:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:11:43 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:11:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:11:47 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:11:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:11:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:11:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:11:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:11:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:11:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:11:50 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:11:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42957992
Mon 20 Jan 2014 10:11:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:11:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42957992
Mon 20 Jan 2014 10:11:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:11:56 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:11:56 - job_xml_thread(): Done retrieving: data size 42957992
Mon 20 Jan 2014 10:11:56 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:11:56 - XML: Start document: iteration 15
Mon 20 Jan 2014 10:11:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:11:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:11:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:11:59 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:12:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:12:01 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:12:01 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:12:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:12:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 10:12:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 10:12:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:12:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:12:01 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:12:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9184 values 144897 bits 18112 bytes 
Mon 20 Jan 2014 10:12:03 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:12:03 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:12:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:12:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:12:03 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:12:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:12:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:12:09 - XML: Processed 645780 elements - found 0 jobs
Mon 20 Jan 2014 10:12:09 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:12:09 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:12:09 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:12:09 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:12:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:12:12 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:12:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:12:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:12:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:12:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:12:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:12:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:12:17 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:12:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 10:12:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:12:17 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:12:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42939067
Mon 20 Jan 2014 10:12:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:12:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42939067
Mon 20 Jan 2014 10:12:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:12:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:12:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:12:19 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:12:19 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 10:12:25 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:12:25 - job_xml_thread(): Done retrieving: data size 42939067
Mon 20 Jan 2014 10:12:25 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:12:25 - XML: Start document: iteration 16
Mon 20 Jan 2014 10:12:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:12:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:12:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:12:35 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:12:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:12:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:12:36 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:12:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:12:36 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:12:36 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:12:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:12:38 - XML: Processed 645834 elements - found 0 jobs
Mon 20 Jan 2014 10:12:38 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:12:38 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:12:38 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:12:38 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:12:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:12:41 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:12:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:12:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:12:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:12:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:12:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:12:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:12:44 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:12:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43350605
Mon 20 Jan 2014 10:12:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:12:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43350605
Mon 20 Jan 2014 10:12:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:12:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:12:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:12:53 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:12:53 - job_xml_thread(): Done retrieving: data size 43350605
Mon 20 Jan 2014 10:12:53 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:12:53 - XML: Start document: iteration 17
Mon 20 Jan 2014 10:12:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:12:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:13:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:13:01 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:13:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:13:02 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:13:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:13:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:13:02 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:13:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:13:02 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:13:02 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:13:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:13:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:13:02 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:13:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 10:13:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 10:13:03 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:13:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99060 bits 12382 bytes 
Mon 20 Jan 2014 10:13:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:13:07 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:13:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:13:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:13:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:13:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:13:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:13:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:13:08 - XML: Processed 650776 elements - found 0 jobs
Mon 20 Jan 2014 10:13:08 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:13:08 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:13:08 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:13:08 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:13:12 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:13:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562548
Mon 20 Jan 2014 10:13:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:13:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562548
Mon 20 Jan 2014 10:13:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:13:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:13:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:13:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:13:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:13:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:13:23 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:13:23 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:13:23 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:13:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:13:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:13:24 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:13:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:13:24 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:13:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:13:27 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:13:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 10:13:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:13:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:13:28 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:13:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:13:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:13:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:13:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:13:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:13:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:13:32 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:13:32 - job_xml_thread(): Done retrieving: data size 43552122
Mon 20 Jan 2014 10:13:32 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:13:32 - XML: Start document: iteration 18
Mon 20 Jan 2014 10:13:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43552122
Mon 20 Jan 2014 10:13:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:13:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43552122
Mon 20 Jan 2014 10:13:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:13:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:13:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:13:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:13:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:13:49 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 10:13:49 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:13:49 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:13:49 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:13:49 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:13:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:13:50 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:13:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:13:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:13:51 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:13:51 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:13:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:13:51 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:13:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:13:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:13:56 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:13:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:13:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:13:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:13:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:13:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:13:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:13:56 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 10:13:56 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 10:13:56 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:13:58 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:13:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559735
Mon 20 Jan 2014 10:13:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:13:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559735
Mon 20 Jan 2014 10:13:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:14:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:14:02 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:14:04 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:14:04 - job_xml_thread(): Done retrieving: data size 43559735
Mon 20 Jan 2014 10:14:04 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:14:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:14:04 - XML: Start document: iteration 19
Mon 20 Jan 2014 10:14:05 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:14:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 10:14:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 10:14:05 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:14:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8956 values 141202 bits 17650 bytes 
Mon 20 Jan 2014 10:14:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:14:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:14:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:14:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:14:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:14:14 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:14:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:14:14 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:14:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:14:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:14:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:14:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:14:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:14:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:14:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:14:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:14:15 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:14:15 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:14:15 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:14:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:14:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:14:18 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 10:14:18 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:14:18 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:14:18 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:14:18 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:14:20 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:14:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 10:14:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:14:21 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:14:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582485
Mon 20 Jan 2014 10:14:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:14:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582485
Mon 20 Jan 2014 10:14:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:14:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:14:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:14:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:14:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:14:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:14:33 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:14:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:14:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:14:33 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:14:34 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:14:34 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:14:34 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:14:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:14:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:14:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:14:36 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:14:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:14:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:14:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:14:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:14:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:14:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:14:39 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:14:39 - job_xml_thread(): Done retrieving: data size 43600935
Mon 20 Jan 2014 10:14:39 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:14:39 - XML: Start document: iteration 20
Mon 20 Jan 2014 10:14:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43600935
Mon 20 Jan 2014 10:14:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:14:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43600935
Mon 20 Jan 2014 10:14:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:14:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:14:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:14:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:14:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:14:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:14:59 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:14:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:14:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:14:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:14:59 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:14:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:15:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:15:01 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:15:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:15:01 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:15:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:15:01 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:15:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:15:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:15:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:15:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:15:01 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 10:15:01 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:15:01 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:15:01 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:15:01 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:15:03 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:15:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43590984
Mon 20 Jan 2014 10:15:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:15:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43590984
Mon 20 Jan 2014 10:15:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:15:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:15:05 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:15:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:15:06 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:15:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 10:15:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 10:15:06 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:15:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148539 bits 18567 bytes 
Mon 20 Jan 2014 10:15:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:15:13 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:15:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:15:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:15:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:15:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:15:16 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:15:16 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:15:16 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:15:16 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:15:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:15:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:15:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:15:18 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:15:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:15:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:15:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:15:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:15:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:15:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:15:20 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:15:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 10:15:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:15:20 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:15:20 - job_xml_thread(): Done retrieving: data size 43587939
Mon 20 Jan 2014 10:15:20 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:15:20 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 10:15:20 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 10:15:20 - Housekeeping: done.
Mon 20 Jan 2014 10:15:20 - XML: Start document: iteration 0
Mon 20 Jan 2014 10:15:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43587939
Mon 20 Jan 2014 10:15:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43587939
Mon 20 Jan 2014 10:15:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:15:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:15:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:15:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:15:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:15:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:15:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:15:36 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:15:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:15:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:15:37 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:15:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:15:37 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:15:37 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:15:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:15:38 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 10:15:38 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:15:38 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:15:38 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:15:38 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:15:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:15:41 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:15:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:15:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:15:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:15:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:15:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:15:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:15:42 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:15:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561269
Mon 20 Jan 2014 10:15:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:15:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561269
Mon 20 Jan 2014 10:15:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:15:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:15:51 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:15:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:15:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:15:54 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:15:54 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:15:54 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:15:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:15:54 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:15:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:15:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:15:55 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:15:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:15:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:15:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:15:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:15:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:15:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:15:57 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:15:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573307
Mon 20 Jan 2014 10:15:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:15:58 - job_xml_thread(): Done retrieving: data size 43573307
Mon 20 Jan 2014 10:15:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573307
Mon 20 Jan 2014 10:15:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:15:58 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:15:58 - XML: Start document: iteration 1
Mon 20 Jan 2014 10:16:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:16:06 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:16:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:16:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:16:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:16:09 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:16:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 10:16:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 10:16:09 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:16:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148632 bits 18579 bytes 
Mon 20 Jan 2014 10:16:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:16:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:16:14 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 10:16:14 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:16:14 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:16:14 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:16:14 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:16:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:16:15 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:16:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:16:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:16:16 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:16:16 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:16:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:16:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:16:16 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:16:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:16:20 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:16:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:16:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:16:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:16:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:16:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:16:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:16:23 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:16:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43588674
Mon 20 Jan 2014 10:16:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:16:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43588674
Mon 20 Jan 2014 10:16:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:16:29 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:16:29 - job_xml_thread(): Done retrieving: data size 43588674
Mon 20 Jan 2014 10:16:29 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:16:29 - XML: Start document: iteration 2
Mon 20 Jan 2014 10:16:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:16:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:16:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:16:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:16:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:16:39 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:16:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:16:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:16:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:16:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:16:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:16:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:16:40 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:16:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:16:42 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:16:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:16:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:16:43 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 10:16:43 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:16:43 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:16:43 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:16:43 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:16:43 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:16:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:16:43 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:16:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:16:43 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:16:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 10:16:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:16:46 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:16:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570714
Mon 20 Jan 2014 10:16:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:16:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570714
Mon 20 Jan 2014 10:16:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:16:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:16:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:16:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:16:56 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:16:58 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:16:58 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:16:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:16:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:16:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:16:58 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:16:58 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:16:58 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:16:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:16:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:16:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:16:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:16:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:16:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:16:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:16:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:17:01 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:17:01 - job_xml_thread(): Done retrieving: data size 43585798
Mon 20 Jan 2014 10:17:01 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:17:01 - XML: Start document: iteration 3
Mon 20 Jan 2014 10:17:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43585798
Mon 20 Jan 2014 10:17:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:17:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43585798
Mon 20 Jan 2014 10:17:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:17:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:17:10 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:17:11 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:17:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 10:17:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:17:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 10:17:12 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:17:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8991 values 142227 bits 17778 bytes 
Mon 20 Jan 2014 10:17:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:17:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:17:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:17:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:17:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:17:17 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:17:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:17:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:17:20 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:17:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:17:20 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:17:20 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:17:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:17:22 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 10:17:22 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:17:22 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:17:22 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:17:22 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:17:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:17:25 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:17:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:17:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:17:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:17:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:17:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:17:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:17:28 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:17:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43509213
Mon 20 Jan 2014 10:17:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:17:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43509213
Mon 20 Jan 2014 10:17:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:17:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:17:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:17:37 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:17:37 - job_xml_thread(): Done retrieving: data size 43509213
Mon 20 Jan 2014 10:17:37 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:17:37 - XML: Start document: iteration 4
Mon 20 Jan 2014 10:17:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:17:40 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:17:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:17:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:17:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:17:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:17:42 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:17:42 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:17:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:17:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:17:42 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:17:50 - XML: Processed 652603 elements - found 0 jobs
Mon 20 Jan 2014 10:17:50 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:17:50 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:17:50 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:17:50 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:17:51 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:17:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 10:17:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:17:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:17:51 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:17:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:17:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:17:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:17:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:17:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:17:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:17:53 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:17:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42969208
Mon 20 Jan 2014 10:17:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:17:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42969208
Mon 20 Jan 2014 10:17:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:17:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:17:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:18:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:18:03 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:18:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:18:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:18:03 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:18:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:18:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42969208
Mon 20 Jan 2014 10:18:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:18:03 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:18:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:18:05 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:18:05 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:18:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:18:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:18:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:18:12 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:18:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:18:13 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:18:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 10:18:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 10:18:13 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:18:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6060 values 95838 bits 11979 bytes 
Mon 20 Jan 2014 10:18:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:18:13 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:18:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:18:15 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:18:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:18:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:18:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:18:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:18:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:18:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:18:17 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:18:17 - job_xml_thread(): Done retrieving: data size 42949821
Mon 20 Jan 2014 10:18:17 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:18:17 - XML: Start document: iteration 5
Mon 20 Jan 2014 10:18:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42949821
Mon 20 Jan 2014 10:18:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:18:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:18:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:18:19 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 10:18:19 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:18:19 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:18:19 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:18:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:18:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42949821
Mon 20 Jan 2014 10:18:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:18:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:18:20 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:18:20 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 10:18:20 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:18:20 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 10:18:20 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 10:18:23 - size of cluster 'LISA Cluster': 624 hosts 79467 metrics 824371 values 13028097 bits 1628512 bytes 
Mon 20 Jan 2014 10:18:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:18:30 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:18:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:18:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:18:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:18:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:18:36 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:18:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:18:36 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:18:36 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:18:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:18:40 - XML: Processed 645834 elements - found 0 jobs
Mon 20 Jan 2014 10:18:40 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:18:40 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:18:40 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:18:40 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:18:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:18:41 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:18:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:18:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:18:42 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:18:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 10:18:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:18:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:18:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:18:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:18:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:18:45 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:18:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43421969
Mon 20 Jan 2014 10:18:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:18:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43421969
Mon 20 Jan 2014 10:18:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:18:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:18:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:18:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:18:53 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:18:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:18:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:18:54 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:18:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:18:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43421969
Mon 20 Jan 2014 10:18:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:18:54 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:18:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:18:55 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:18:55 - job_xml_thread(): Done retrieving: data size 43421969
Mon 20 Jan 2014 10:18:55 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:18:55 - XML: Start document: iteration 6
Mon 20 Jan 2014 10:18:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:18:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:19:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:19:08 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:19:10 - XML: Processed 651684 elements - found 0 jobs
Mon 20 Jan 2014 10:19:10 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:19:10 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:19:10 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:19:10 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:19:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:19:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:19:11 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:19:11 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:19:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:19:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:19:11 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:19:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:19:12 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:19:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:19:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:19:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:19:13 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:19:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:19:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:19:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:19:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:19:13 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:19:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:19:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 10:19:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 10:19:13 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:19:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5873 values 92778 bits 11597 bytes 
Mon 20 Jan 2014 10:19:17 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:19:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560984
Mon 20 Jan 2014 10:19:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:19:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560984
Mon 20 Jan 2014 10:19:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:19:21 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:19:21 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 10:19:25 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:19:25 - job_xml_thread(): Done retrieving: data size 43560984
Mon 20 Jan 2014 10:19:25 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:19:25 - XML: Start document: iteration 7
Mon 20 Jan 2014 10:19:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:19:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:19:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:19:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:19:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:19:34 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:19:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:19:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:19:37 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:19:37 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:19:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:19:37 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:19:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:19:41 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 10:19:41 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:19:41 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:19:41 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:19:41 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:19:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:19:41 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:19:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:19:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:19:42 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:19:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 10:19:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:19:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:19:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:19:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:19:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:19:44 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:19:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43550810
Mon 20 Jan 2014 10:19:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:19:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43550810
Mon 20 Jan 2014 10:19:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:19:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:19:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:19:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:19:54 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:19:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:19:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:19:55 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:19:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:19:55 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:19:55 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:19:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:19:56 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:19:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:19:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:19:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:19:58 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:19:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:19:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:19:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:19:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:19:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:19:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:20:02 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:20:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554599
Mon 20 Jan 2014 10:20:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:20:03 - job_xml_thread(): Done retrieving: data size 43554599
Mon 20 Jan 2014 10:20:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554599
Mon 20 Jan 2014 10:20:03 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:20:03 - XML: Start document: iteration 8
Mon 20 Jan 2014 10:20:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:20:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:20:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:20:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:20:13 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:20:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:20:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:20:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:20:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 10:20:15 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:20:15 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:20:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 10:20:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8499 values 134056 bits 16757 bytes 
Mon 20 Jan 2014 10:20:20 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 10:20:20 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:20:20 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:20:20 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:20:20 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:20:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:20:22 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:20:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:20:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:20:23 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:20:23 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:20:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:20:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:20:23 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:20:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:20:26 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:20:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:20:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:20:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:20:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:20:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:20:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:20:30 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:20:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566635
Mon 20 Jan 2014 10:20:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:20:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566635
Mon 20 Jan 2014 10:20:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:20:35 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:20:35 - job_xml_thread(): Done retrieving: data size 43566635
Mon 20 Jan 2014 10:20:35 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:20:35 - XML: Start document: iteration 9
Mon 20 Jan 2014 10:20:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:20:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:20:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:20:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:20:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:20:43 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:20:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:20:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:20:43 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:20:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 10:20:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:20:44 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:20:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:20:44 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:20:44 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:20:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:20:50 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 10:20:50 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:20:50 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:20:50 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:20:50 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:20:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:20:54 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:20:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:20:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:20:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:20:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:20:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:20:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:20:58 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:20:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559641
Mon 20 Jan 2014 10:20:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:20:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559641
Mon 20 Jan 2014 10:20:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:20:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:20:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:21:05 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:21:05 - job_xml_thread(): Done retrieving: data size 43559641
Mon 20 Jan 2014 10:21:05 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:21:05 - XML: Start document: iteration 10
Mon 20 Jan 2014 10:21:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:21:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:21:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:21:12 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:21:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:21:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:21:13 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:21:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:21:13 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:21:13 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:21:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:21:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:21:15 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:21:17 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:21:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 10:21:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:21:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 10:21:17 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:21:17 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 10:21:17 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:21:17 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:21:17 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:21:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5974 values 94227 bits 11778 bytes 
Mon 20 Jan 2014 10:21:17 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:21:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:21:21 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:21:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:21:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:21:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:21:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:21:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:21:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:21:25 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 10:21:25 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 10:21:25 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:21:25 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:21:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559622
Mon 20 Jan 2014 10:21:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:21:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559622
Mon 20 Jan 2014 10:21:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:21:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:21:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:21:33 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:21:33 - job_xml_thread(): Done retrieving: data size 43559622
Mon 20 Jan 2014 10:21:33 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:21:33 - XML: Start document: iteration 11
Mon 20 Jan 2014 10:21:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:21:34 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:21:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:21:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:21:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:21:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:21:37 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:21:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:21:37 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:21:37 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:21:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:21:45 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 10:21:45 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:21:45 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:21:45 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:21:45 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:21:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:21:47 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:21:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:21:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:21:47 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:21:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 10:21:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:21:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:21:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:21:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:21:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:21:48 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:21:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43542249
Mon 20 Jan 2014 10:21:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:21:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43542249
Mon 20 Jan 2014 10:21:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:21:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:21:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:22:00 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:22:01 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:22:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:22:01 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:22:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:22:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:22:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:22:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:22:02 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:22:02 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:22:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:22:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:22:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:22:03 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:22:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:22:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:22:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:22:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:22:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:22:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:22:05 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:22:05 - job_xml_thread(): Done retrieving: data size 43576354
Mon 20 Jan 2014 10:22:05 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:22:05 - XML: Start document: iteration 12
Mon 20 Jan 2014 10:22:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576354
Mon 20 Jan 2014 10:22:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:22:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576354
Mon 20 Jan 2014 10:22:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:22:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:22:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:22:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:22:17 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:22:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:22:19 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:22:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 10:22:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 10:22:19 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:22:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8856 values 139676 bits 17459 bytes 
Mon 20 Jan 2014 10:22:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:22:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:22:22 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 10:22:22 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:22:22 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:22:22 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:22:22 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:22:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:22:26 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:22:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:22:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:22:27 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:22:27 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:22:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:22:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:22:27 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:22:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:22:28 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:22:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:22:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:22:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:22:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:22:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:22:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:22:31 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:22:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567242
Mon 20 Jan 2014 10:22:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:22:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567242
Mon 20 Jan 2014 10:22:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:22:37 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:22:37 - job_xml_thread(): Done retrieving: data size 43567242
Mon 20 Jan 2014 10:22:38 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:22:38 - XML: Start document: iteration 13
Mon 20 Jan 2014 10:22:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:22:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:22:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:22:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:22:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:22:45 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:22:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:22:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:22:46 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:22:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:22:46 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:22:46 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:22:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:22:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:22:53 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:22:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:22:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:22:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:22:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:22:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:22:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:22:54 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 10:22:54 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:22:54 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:22:54 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:22:54 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:22:54 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:22:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 10:22:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:22:56 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:22:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575910
Mon 20 Jan 2014 10:22:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:22:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575910
Mon 20 Jan 2014 10:22:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:23:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:23:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:23:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:23:06 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:23:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:23:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:23:07 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:23:07 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:23:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:23:07 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:23:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:23:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:23:09 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:23:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:23:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:23:11 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:23:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:23:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:23:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:23:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:23:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:23:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:23:13 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:23:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43512757
Mon 20 Jan 2014 10:23:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:23:13 - job_xml_thread(): Done retrieving: data size 43512757
Mon 20 Jan 2014 10:23:13 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:23:13 - XML: Start document: iteration 14
Mon 20 Jan 2014 10:23:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43512757
Mon 20 Jan 2014 10:23:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:23:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:23:19 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:23:21 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:23:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 10:23:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:23:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 10:23:21 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:23:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9273 values 146227 bits 18278 bytes 
Mon 20 Jan 2014 10:23:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:23:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:23:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:23:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:23:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:23:29 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:23:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:23:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:23:29 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:23:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:23:29 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:23:29 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:23:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:23:34 - XML: Processed 652608 elements - found 0 jobs
Mon 20 Jan 2014 10:23:34 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:23:34 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:23:34 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:23:34 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:23:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:23:35 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:23:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:23:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:23:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:23:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:23:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:23:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:23:38 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:23:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43036662
Mon 20 Jan 2014 10:23:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:23:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43036662
Mon 20 Jan 2014 10:23:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:23:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:23:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:23:49 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:23:49 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:23:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:23:49 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:23:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:23:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:23:49 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:23:49 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:23:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:23:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:23:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:23:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:23:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:23:53 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:23:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:23:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:23:53 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:23:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 10:23:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:23:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:23:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:23:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:23:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:23:55 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:23:55 - job_xml_thread(): Done retrieving: data size 42936320
Mon 20 Jan 2014 10:23:55 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:23:55 - XML: Start document: iteration 15
Mon 20 Jan 2014 10:23:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42936320
Mon 20 Jan 2014 10:23:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42936320
Mon 20 Jan 2014 10:23:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:23:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:24:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:24:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:24:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:24:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:24:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:24:11 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:24:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:24:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:24:11 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:24:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:24:11 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:24:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:24:11 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:24:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:24:17 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:24:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:24:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:24:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:24:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:24:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:24:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:24:18 - XML: Processed 645304 elements - found 0 jobs
Mon 20 Jan 2014 10:24:18 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:24:18 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:24:18 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:24:18 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:24:20 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:24:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42958959
Mon 20 Jan 2014 10:24:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:24:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42958959
Mon 20 Jan 2014 10:24:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:24:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:24:21 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:24:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:24:22 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:24:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 10:24:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 10:24:22 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:24:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8927 values 140806 bits 17600 bytes 
Mon 20 Jan 2014 10:24:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:24:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:24:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:24:28 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:24:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:24:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:24:29 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:24:29 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:24:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:24:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42958959
Mon 20 Jan 2014 10:24:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:24:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:24:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:24:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:24:33 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:24:33 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:24:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:24:40 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:24:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:24:43 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:24:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:24:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:24:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:24:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:24:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:24:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:24:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:24:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:24:45 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:24:45 - job_xml_thread(): Done retrieving: data size 43441951
Mon 20 Jan 2014 10:24:45 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:24:45 - XML: Start document: iteration 16
Mon 20 Jan 2014 10:24:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43441951
Mon 20 Jan 2014 10:24:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:24:45 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:24:45 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:24:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:24:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:24:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43441951
Mon 20 Jan 2014 10:24:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:24:49 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:24:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 10:24:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:24:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:24:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:25:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:25:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:25:04 - XML: Processed 652120 elements - found 0 jobs
Mon 20 Jan 2014 10:25:04 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:25:04 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:25:04 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:25:04 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:25:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:25:06 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:25:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:25:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:25:07 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:25:07 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:25:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:25:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:25:07 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:25:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:25:08 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:25:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:25:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:25:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:25:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:25:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:25:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:25:12 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:25:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580215
Mon 20 Jan 2014 10:25:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:25:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580215
Mon 20 Jan 2014 10:25:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:25:19 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:25:19 - job_xml_thread(): Done retrieving: data size 43580215
Mon 20 Jan 2014 10:25:19 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:25:19 - XML: Start document: iteration 17
Mon 20 Jan 2014 10:25:21 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 10:25:21 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:25:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:25:22 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:25:22 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:25:22 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 10:25:22 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 10:25:22 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:25:22 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 10:25:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:25:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:25:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:25:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 10:25:23 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:25:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6380 values 100583 bits 12572 bytes 
Mon 20 Jan 2014 10:25:23 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:25:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 10:25:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:25:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:25:28 - size of cluster 'LISA Cluster': 624 hosts 79468 metrics 862691 values 13615659 bits 1701957 bytes 
Mon 20 Jan 2014 10:25:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:25:30 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:25:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:25:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:25:31 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:25:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:25:31 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:25:31 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:25:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:25:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:25:34 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:25:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:25:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:25:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:25:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:25:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:25:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:25:36 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 10:25:36 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:25:36 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:25:36 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:25:36 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:25:41 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:25:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569278
Mon 20 Jan 2014 10:25:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:25:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569278
Mon 20 Jan 2014 10:25:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:25:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:25:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:25:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:25:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:25:51 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:25:51 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:25:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:25:53 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:25:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:25:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:25:54 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:25:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:25:54 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:25:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:25:57 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:25:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 10:25:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:25:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:25:58 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:25:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:25:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:25:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:25:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:25:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:25:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:26:02 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:26:02 - job_xml_thread(): Done retrieving: data size 43548034
Mon 20 Jan 2014 10:26:02 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:26:02 - XML: Start document: iteration 18
Mon 20 Jan 2014 10:26:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43548034
Mon 20 Jan 2014 10:26:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:26:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43548034
Mon 20 Jan 2014 10:26:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:26:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:26:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:26:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:26:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:26:22 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:26:22 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 10:26:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:26:23 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:26:24 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:26:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 10:26:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:26:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 10:26:24 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:26:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5997 values 94574 bits 11821 bytes 
Mon 20 Jan 2014 10:26:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:26:25 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:26:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:26:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:26:25 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:26:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:26:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:26:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:26:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:26:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:26:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:26:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:26:26 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:26:26 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:26:26 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:26:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:26:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:26:26 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 10:26:26 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:26:26 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:26:26 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:26:26 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:26:30 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:26:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 10:26:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:26:31 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:26:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570532
Mon 20 Jan 2014 10:26:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:26:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570532
Mon 20 Jan 2014 10:26:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:26:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:26:39 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:26:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:26:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:26:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:26:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:26:41 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:26:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:26:41 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:26:41 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:26:41 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:26:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:26:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:26:44 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:26:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:26:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:26:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:26:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:26:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:26:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:26:48 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:26:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564464
Mon 20 Jan 2014 10:26:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:26:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564464
Mon 20 Jan 2014 10:26:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:26:49 - job_xml_thread(): Done retrieving: data size 43564464
Mon 20 Jan 2014 10:26:49 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:26:49 - XML: Start document: iteration 19
Mon 20 Jan 2014 10:26:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:26:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:27:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:27:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:27:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:27:05 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:27:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:27:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:27:06 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:27:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:27:06 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:27:06 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:27:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:27:08 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 10:27:08 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:27:08 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:27:08 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:27:08 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:27:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:27:11 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:27:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:27:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:27:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:27:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:27:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:27:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:27:14 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:27:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553761
Mon 20 Jan 2014 10:27:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:27:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553761
Mon 20 Jan 2014 10:27:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:27:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:27:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:27:23 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:27:23 - job_xml_thread(): Done retrieving: data size 43553761
Mon 20 Jan 2014 10:27:23 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:27:23 - XML: Start document: iteration 20
Mon 20 Jan 2014 10:27:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:27:23 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:27:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:27:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:27:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:27:24 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:27:24 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:27:24 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:27:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:27:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:27:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 10:27:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:27:24 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:27:24 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:27:24 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:27:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148571 bits 18571 bytes 
Mon 20 Jan 2014 10:27:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 10:27:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:27:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:27:31 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 10:27:31 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:27:31 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:27:31 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:27:31 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:27:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:27:36 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:27:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:27:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:27:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:27:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:27:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:27:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:27:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:27:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:27:40 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:27:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553662
Mon 20 Jan 2014 10:27:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:27:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553662
Mon 20 Jan 2014 10:27:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:27:46 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:27:46 - job_xml_thread(): Done retrieving: data size 43553662
Mon 20 Jan 2014 10:27:46 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:27:46 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 10:27:46 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 10:27:46 - Housekeeping: done.
Mon 20 Jan 2014 10:27:46 - XML: Start document: iteration 0
Mon 20 Jan 2014 10:27:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:27:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:27:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:27:53 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:27:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:27:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:27:54 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:27:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:27:54 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:27:54 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:27:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:27:58 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 10:27:58 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:27:58 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:27:58 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:27:58 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:28:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:28:04 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:28:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:28:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:28:04 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:28:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 10:28:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:28:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:28:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:28:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:28:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:28:07 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:28:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43551315
Mon 20 Jan 2014 10:28:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:28:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43551315
Mon 20 Jan 2014 10:28:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:28:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:28:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:28:14 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:28:14 - job_xml_thread(): Done retrieving: data size 43551315
Mon 20 Jan 2014 10:28:14 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:28:14 - XML: Start document: iteration 1
Mon 20 Jan 2014 10:28:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:28:19 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:28:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:28:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:28:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:28:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:28:20 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:28:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:28:20 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:28:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:28:21 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:28:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:28:25 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:28:26 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 10:28:26 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:28:26 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:28:26 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:28:26 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:28:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:28:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 10:28:26 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:28:26 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:28:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 10:28:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5793 values 91362 bits 11420 bytes 
Mon 20 Jan 2014 10:28:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:28:29 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:28:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:28:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:28:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:28:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:28:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:28:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:28:33 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:28:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43545826
Mon 20 Jan 2014 10:28:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:28:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43545826
Mon 20 Jan 2014 10:28:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:28:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:28:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:28:41 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:28:41 - job_xml_thread(): Done retrieving: data size 43545826
Mon 20 Jan 2014 10:28:41 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:28:41 - XML: Start document: iteration 2
Mon 20 Jan 2014 10:28:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:28:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:28:50 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:28:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 10:28:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:28:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:28:52 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:28:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:28:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:28:53 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:28:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:28:53 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:28:53 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:28:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:28:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:28:56 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:28:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:28:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:28:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:28:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:28:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:28:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:28:58 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 10:28:58 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:28:58 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:28:58 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:28:58 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:29:01 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:29:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563131
Mon 20 Jan 2014 10:29:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:29:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563131
Mon 20 Jan 2014 10:29:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:29:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:29:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:29:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:29:11 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:29:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:29:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:29:12 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:29:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:29:12 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:29:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:29:12 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:29:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:29:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:29:13 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:29:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:29:16 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:29:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:29:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:29:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:29:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:29:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:29:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:29:20 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:29:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43503956
Mon 20 Jan 2014 10:29:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:29:20 - job_xml_thread(): Done retrieving: data size 43503956
Mon 20 Jan 2014 10:29:20 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:29:20 - XML: Start document: iteration 3
Mon 20 Jan 2014 10:29:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43503956
Mon 20 Jan 2014 10:29:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:29:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:29:27 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:29:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:29:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:29:27 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:29:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 10:29:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:29:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 10:29:27 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:29:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9241 values 145738 bits 18217 bytes 
Mon 20 Jan 2014 10:29:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:29:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:29:37 - XML: Processed 652608 elements - found 0 jobs
Mon 20 Jan 2014 10:29:37 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:29:37 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:29:37 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:29:37 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:29:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:29:40 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:29:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:29:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:29:41 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:29:41 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:29:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:29:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:29:41 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:29:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:29:43 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:29:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:29:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:29:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:29:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:29:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:29:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:29:44 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 10:29:44 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 10:29:44 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:29:46 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:29:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42964443
Mon 20 Jan 2014 10:29:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:29:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42964443
Mon 20 Jan 2014 10:29:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:29:52 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:29:52 - job_xml_thread(): Done retrieving: data size 42964443
Mon 20 Jan 2014 10:29:52 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:29:54 - XML: Start document: iteration 4
Mon 20 Jan 2014 10:29:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:29:54 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:29:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:29:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:29:57 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:29:57 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:29:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:29:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:29:57 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:29:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:29:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:30:04 - XML: Processed 645888 elements - found 0 jobs
Mon 20 Jan 2014 10:30:04 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:30:04 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:30:04 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:30:04 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:30:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:30:06 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:30:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:30:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:30:06 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:30:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 10:30:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:30:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:30:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:30:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:30:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:30:08 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:30:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42908766
Mon 20 Jan 2014 10:30:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:30:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42908766
Mon 20 Jan 2014 10:30:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:30:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:30:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:30:19 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:30:19 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:30:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:30:21 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:30:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:30:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:30:22 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:30:22 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:30:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:30:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:30:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:30:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:30:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:30:23 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:30:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:30:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:30:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:30:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:30:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:30:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:30:25 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:30:25 - job_xml_thread(): Done retrieving: data size 42993548
Mon 20 Jan 2014 10:30:25 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:30:25 - XML: Start document: iteration 5
Mon 20 Jan 2014 10:30:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42993548
Mon 20 Jan 2014 10:30:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:30:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42993548
Mon 20 Jan 2014 10:30:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:30:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:30:27 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:30:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:30:28 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:30:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 10:30:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 10:30:28 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:30:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8916 values 140562 bits 17570 bytes 
Mon 20 Jan 2014 10:30:37 - XML: Processed 646082 elements - found 0 jobs
Mon 20 Jan 2014 10:30:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:30:37 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:30:37 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:30:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:30:37 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:30:37 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:30:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:30:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:30:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:30:42 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:30:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:30:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:30:43 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:30:43 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:30:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:30:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:30:44 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:30:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:30:46 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:30:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:30:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:30:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:30:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:30:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:30:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:30:48 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:30:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43524659
Mon 20 Jan 2014 10:30:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:30:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43524659
Mon 20 Jan 2014 10:30:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:30:52 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:30:52 - job_xml_thread(): Done retrieving: data size 43524659
Mon 20 Jan 2014 10:30:52 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:30:52 - XML: Start document: iteration 6
Mon 20 Jan 2014 10:30:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:30:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:31:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:31:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:31:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:31:02 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:31:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:31:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:31:04 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:31:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:31:04 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:31:04 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:31:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:31:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:31:08 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:31:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:31:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:31:09 - XML: Processed 652726 elements - found 0 jobs
Mon 20 Jan 2014 10:31:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:31:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:31:09 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:31:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:31:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:31:09 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:31:09 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:31:09 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:31:09 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:31:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 10:31:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:31:10 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:31:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43591339
Mon 20 Jan 2014 10:31:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:31:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43591339
Mon 20 Jan 2014 10:31:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:31:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:31:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:31:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:31:22 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:31:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:31:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:31:22 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:31:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:31:22 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:31:22 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:31:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:31:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:31:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:31:24 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:31:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:31:26 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:31:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:31:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:31:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:31:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:31:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:31:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:31:28 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:31:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567138
Mon 20 Jan 2014 10:31:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:31:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567138
Mon 20 Jan 2014 10:31:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:31:28 - job_xml_thread(): Done retrieving: data size 43567138
Mon 20 Jan 2014 10:31:28 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:31:28 - XML: Start document: iteration 7
Mon 20 Jan 2014 10:31:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:31:28 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:31:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:31:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 10:31:29 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:31:29 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:31:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 10:31:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6659 values 105253 bits 13156 bytes 
Mon 20 Jan 2014 10:31:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:31:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:31:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:31:40 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:31:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:31:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:31:41 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:31:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:31:41 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:31:41 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:31:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:31:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:31:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:31:48 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 10:31:48 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:31:48 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:31:49 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:31:49 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:31:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:31:51 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:31:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:31:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:31:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:31:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:31:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:31:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:31:54 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:31:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558049
Mon 20 Jan 2014 10:31:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:31:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558049
Mon 20 Jan 2014 10:31:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:31:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:31:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:32:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:32:04 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:32:04 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:32:04 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:32:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:32:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:32:05 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:32:05 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:32:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:32:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:32:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:32:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:32:09 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:32:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 10:32:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:32:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:32:09 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:32:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:32:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:32:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:32:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:32:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:32:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:32:11 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:32:11 - job_xml_thread(): Done retrieving: data size 43576860
Mon 20 Jan 2014 10:32:11 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:32:11 - XML: Start document: iteration 8
Mon 20 Jan 2014 10:32:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576860
Mon 20 Jan 2014 10:32:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:32:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576860
Mon 20 Jan 2014 10:32:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:32:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:32:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:32:22 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 10:32:22 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:32:24 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:32:24 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 10:32:24 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:32:24 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 10:32:24 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 10:32:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:32:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:32:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:32:28 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:32:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:32:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:32:28 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 10:32:29 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:32:29 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:32:29 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:32:29 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:32:29 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:32:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:32:29 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:32:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:32:29 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:32:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:32:29 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:32:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:32:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 10:32:30 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:32:30 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:32:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 10:32:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5893 values 93211 bits 11651 bytes 
Mon 20 Jan 2014 10:32:30 - size of cluster 'LISA Cluster': 624 hosts 79480 metrics 810019 values 12792066 bits 1599008 bytes 
Mon 20 Jan 2014 10:32:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:32:33 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:32:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:32:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:32:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:32:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:32:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:32:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:32:37 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:32:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578971
Mon 20 Jan 2014 10:32:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:32:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578971
Mon 20 Jan 2014 10:32:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:32:44 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:32:44 - job_xml_thread(): Done retrieving: data size 43578971
Mon 20 Jan 2014 10:32:44 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:32:44 - XML: Start document: iteration 9
Mon 20 Jan 2014 10:32:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:32:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:32:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:32:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:32:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:32:50 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:32:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:32:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:32:51 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:32:51 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:32:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:32:51 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:32:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:32:57 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:32:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 10:32:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:33:00 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 10:33:00 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:33:00 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:33:00 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:33:00 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:33:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:33:00 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:33:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:33:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:33:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:33:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:33:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:33:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:33:04 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:33:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553352
Mon 20 Jan 2014 10:33:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:33:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553352
Mon 20 Jan 2014 10:33:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:33:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:33:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:33:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:33:14 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:33:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:33:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:33:15 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:33:15 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:33:15 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:33:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:33:15 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:33:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:33:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:33:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:33:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:33:19 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:33:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:33:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:33:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:33:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:33:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:33:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:33:23 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:33:23 - job_xml_thread(): Done retrieving: data size 43580144
Mon 20 Jan 2014 10:33:23 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:33:23 - XML: Start document: iteration 10
Mon 20 Jan 2014 10:33:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580144
Mon 20 Jan 2014 10:33:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:33:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580144
Mon 20 Jan 2014 10:33:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:33:24 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:33:24 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 10:33:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:33:30 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:33:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:33:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:33:31 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:33:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 10:33:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:33:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 10:33:31 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:33:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9118 values 144144 bits 18018 bytes 
Mon 20 Jan 2014 10:33:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:33:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:33:42 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 10:33:42 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:33:42 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:33:42 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:33:42 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:33:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:33:44 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:33:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:33:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:33:44 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:33:44 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:33:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:33:44 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:33:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:33:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:33:46 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:33:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:33:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:33:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:33:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:33:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:33:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:33:50 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:33:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575060
Mon 20 Jan 2014 10:33:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:33:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575060
Mon 20 Jan 2014 10:33:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:33:58 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:33:58 - job_xml_thread(): Done retrieving: data size 43575060
Mon 20 Jan 2014 10:33:58 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:33:58 - XML: Start document: iteration 11
Mon 20 Jan 2014 10:33:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:33:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:34:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:34:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:34:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:34:05 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:34:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:34:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:34:06 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:34:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:34:06 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:34:06 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:34:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:34:13 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 10:34:13 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:34:13 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:34:13 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:34:13 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:34:15 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:34:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 10:34:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:34:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:34:15 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:34:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:34:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:34:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:34:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:34:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:34:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:34:18 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:34:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43546945
Mon 20 Jan 2014 10:34:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:34:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43546945
Mon 20 Jan 2014 10:34:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:34:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:34:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:34:28 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:34:28 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:34:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:34:31 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:34:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:34:31 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:34:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:34:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:34:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:34:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:34:32 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:34:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:34:32 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:34:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:34:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:34:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 10:34:32 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:34:32 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:34:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 10:34:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5940 values 93781 bits 11722 bytes 
Mon 20 Jan 2014 10:34:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:34:35 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:34:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:34:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:34:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:34:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:34:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:34:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:34:38 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:34:38 - job_xml_thread(): Done retrieving: data size 43572558
Mon 20 Jan 2014 10:34:38 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:34:38 - XML: Start document: iteration 12
Mon 20 Jan 2014 10:34:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572558
Mon 20 Jan 2014 10:34:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:34:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572558
Mon 20 Jan 2014 10:34:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:34:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:34:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:34:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:34:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:34:53 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 10:34:53 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:34:53 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:34:53 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:34:53 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:34:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:34:57 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:34:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:34:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:34:58 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:34:58 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:34:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:34:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:34:58 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:35:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:35:01 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:35:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:35:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:35:02 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:35:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 10:35:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:35:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:35:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:35:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:35:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:35:05 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:35:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572542
Mon 20 Jan 2014 10:35:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:35:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572542
Mon 20 Jan 2014 10:35:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:35:08 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:35:08 - job_xml_thread(): Done retrieving: data size 43572542
Mon 20 Jan 2014 10:35:08 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:35:08 - XML: Start document: iteration 13
Mon 20 Jan 2014 10:35:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:35:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:35:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:35:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:35:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:35:21 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:35:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:35:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:35:23 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:35:23 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:35:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:35:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:35:23 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:35:23 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 10:35:23 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:35:23 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:35:23 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:35:23 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:35:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:35:27 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:35:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:35:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:35:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:35:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:35:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:35:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:35:31 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:35:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43500320
Mon 20 Jan 2014 10:35:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:35:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43500320
Mon 20 Jan 2014 10:35:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:35:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:35:32 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:35:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:35:32 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:35:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 10:35:32 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:35:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 10:35:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8999 values 141948 bits 17743 bytes 
Mon 20 Jan 2014 10:35:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:35:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:35:38 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:35:38 - job_xml_thread(): Done retrieving: data size 43500320
Mon 20 Jan 2014 10:35:38 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:35:38 - XML: Start document: iteration 14
Mon 20 Jan 2014 10:35:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:35:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:35:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:35:44 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:35:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:35:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:35:45 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:35:45 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:35:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:35:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:35:45 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:35:50 - XML: Processed 652596 elements - found 0 jobs
Mon 20 Jan 2014 10:35:50 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:35:50 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:35:50 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:35:50 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:35:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:35:55 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:35:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:35:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:35:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:35:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:35:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:35:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:35:58 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:35:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 10:35:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:35:59 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:35:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42908156
Mon 20 Jan 2014 10:35:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:35:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42908156
Mon 20 Jan 2014 10:35:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:36:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:36:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:36:05 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:36:05 - job_xml_thread(): Done retrieving: data size 42908156
Mon 20 Jan 2014 10:36:05 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:36:05 - XML: Start document: iteration 15
Mon 20 Jan 2014 10:36:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:36:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:36:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:36:18 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:36:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:36:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:36:19 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:36:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:36:19 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:36:19 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:36:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:36:21 - XML: Processed 645468 elements - found 0 jobs
Mon 20 Jan 2014 10:36:21 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:36:21 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:36:21 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:36:21 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:36:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:36:23 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:36:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:36:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:36:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:36:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:36:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:36:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:36:25 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 10:36:25 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 10:36:25 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:36:25 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:36:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43014032
Mon 20 Jan 2014 10:36:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:36:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43014032
Mon 20 Jan 2014 10:36:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:36:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:36:32 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:36:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:36:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 10:36:34 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:36:34 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:36:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 10:36:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:36:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:36:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99104 bits 12388 bytes 
Mon 20 Jan 2014 10:36:36 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:36:36 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:36:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:36:38 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:36:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:36:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:36:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:36:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:36:39 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:36:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:36:39 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:36:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:36:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:36:41 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:36:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:36:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:36:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:36:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:36:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:36:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:36:44 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:36:44 - job_xml_thread(): Done retrieving: data size 43469150
Mon 20 Jan 2014 10:36:44 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:36:44 - XML: Start document: iteration 16
Mon 20 Jan 2014 10:36:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43469150
Mon 20 Jan 2014 10:36:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43469150
Mon 20 Jan 2014 10:36:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:36:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:36:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:36:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:36:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:36:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:37:00 - XML: Processed 652268 elements - found 0 jobs
Mon 20 Jan 2014 10:37:00 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:37:00 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:37:00 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:37:00 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:37:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:37:03 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:37:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:37:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:37:04 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:37:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:37:04 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:37:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:37:04 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:37:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:37:07 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:37:07 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:37:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 10:37:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:37:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:37:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:37:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:37:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:37:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:37:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:37:09 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:37:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43593463
Mon 20 Jan 2014 10:37:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:37:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43593463
Mon 20 Jan 2014 10:37:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:37:15 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:37:15 - job_xml_thread(): Done retrieving: data size 43593463
Mon 20 Jan 2014 10:37:15 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:37:15 - XML: Start document: iteration 17
Mon 20 Jan 2014 10:37:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:37:19 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:37:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:37:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:37:20 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:37:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:37:20 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:37:20 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:37:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:37:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:37:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:37:30 - XML: Processed 653356 elements - found 0 jobs
Mon 20 Jan 2014 10:37:30 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:37:30 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:37:30 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:37:30 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:37:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:37:31 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:37:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:37:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:37:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:37:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:37:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:37:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:37:33 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:37:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43546565
Mon 20 Jan 2014 10:37:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:37:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:37:34 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:37:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43546565
Mon 20 Jan 2014 10:37:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:37:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:37:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 10:37:35 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:37:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8993 values 141857 bits 17732 bytes 
Mon 20 Jan 2014 10:37:35 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:37:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 10:37:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:37:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:37:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:37:42 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:37:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:37:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:37:43 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:37:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:37:43 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:37:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:37:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43546565
Mon 20 Jan 2014 10:37:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:37:45 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:37:45 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:37:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:37:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:37:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:37:51 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:37:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:37:55 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:37:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:37:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:37:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:37:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:37:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:37:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:37:58 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:37:58 - job_xml_thread(): Done retrieving: data size 43551144
Mon 20 Jan 2014 10:37:58 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:37:58 - XML: Start document: iteration 18
Mon 20 Jan 2014 10:37:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:37:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:37:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43551144
Mon 20 Jan 2014 10:37:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:37:59 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:37:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:37:59 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:37:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:37:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43551144
Mon 20 Jan 2014 10:37:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:38:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:38:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:38:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:38:13 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:38:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:38:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:38:16 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:38:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:38:16 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:38:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:38:16 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:38:16 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 10:38:16 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:38:16 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:38:16 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:38:16 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:38:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:38:20 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:38:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:38:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:38:20 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:38:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 10:38:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:38:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:38:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:38:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:38:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:38:22 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:38:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580955
Mon 20 Jan 2014 10:38:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580955
Mon 20 Jan 2014 10:38:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:38:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:38:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:38:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:38:31 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:38:31 - job_xml_thread(): Done retrieving: data size 43580955
Mon 20 Jan 2014 10:38:31 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:38:31 - XML: Start document: iteration 19
Mon 20 Jan 2014 10:38:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:38:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:38:35 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:38:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:38:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:38:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 10:38:35 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:38:35 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:38:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 10:38:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5963 values 94048 bits 11756 bytes 
Mon 20 Jan 2014 10:38:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:38:40 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:38:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:38:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:38:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:38:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:38:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:38:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:38:41 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:38:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:38:43 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:38:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:38:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:38:44 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:38:44 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:38:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:38:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:38:44 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 10:38:44 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:38:44 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:38:44 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:38:44 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:38:46 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:38:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570232
Mon 20 Jan 2014 10:38:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:38:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570232
Mon 20 Jan 2014 10:38:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:38:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:38:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:38:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:38:58 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:38:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:38:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:38:59 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:38:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:38:59 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:38:59 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:38:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:38:59 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:39:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:39:02 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:39:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:39:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:39:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:39:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:39:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:39:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:39:03 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:39:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 10:39:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:39:04 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:39:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578094
Mon 20 Jan 2014 10:39:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:39:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578094
Mon 20 Jan 2014 10:39:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:39:05 - job_xml_thread(): Done retrieving: data size 43578094
Mon 20 Jan 2014 10:39:05 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:39:05 - XML: Start document: iteration 20
Mon 20 Jan 2014 10:39:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:39:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:39:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:39:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:39:20 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 10:39:20 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:39:20 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:39:20 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:39:20 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:39:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:39:22 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:39:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:39:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:39:23 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:39:23 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:39:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:39:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:39:23 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:39:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:39:23 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:39:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:39:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:39:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:39:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:39:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:39:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:39:24 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 10:39:24 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:39:25 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:39:25 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:39:25 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 10:39:25 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 10:39:25 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 10:39:26 - size of cluster 'LISA Cluster': 624 hosts 79470 metrics 797119 values 12580447 bits 1572555 bytes 
Mon 20 Jan 2014 10:39:27 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:39:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43597625
Mon 20 Jan 2014 10:39:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:39:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43597625
Mon 20 Jan 2014 10:39:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:39:35 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:39:35 - job_xml_thread(): Done retrieving: data size 43597625
Mon 20 Jan 2014 10:39:35 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:39:35 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 10:39:35 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 10:39:35 - Housekeeping: done.
Mon 20 Jan 2014 10:39:35 - XML: Start document: iteration 0
Mon 20 Jan 2014 10:39:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:39:36 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:39:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:39:37 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:39:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 10:39:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 10:39:37 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:39:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:39:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:39:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:39:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:39:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8418 values 132698 bits 16587 bytes 
Mon 20 Jan 2014 10:39:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:39:41 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:39:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:39:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:39:41 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:39:41 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:39:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:39:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:39:42 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:39:45 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 10:39:45 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:39:45 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:39:45 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:39:45 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:39:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:39:51 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:39:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:39:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:39:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:39:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:39:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:39:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:39:54 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:39:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562844
Mon 20 Jan 2014 10:39:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:39:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562844
Mon 20 Jan 2014 10:39:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:39:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:39:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:40:00 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:40:00 - job_xml_thread(): Done retrieving: data size 43562844
Mon 20 Jan 2014 10:40:00 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:40:00 - XML: Start document: iteration 1
Mon 20 Jan 2014 10:40:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:40:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:40:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:40:10 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:40:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:40:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:40:11 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:40:11 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:40:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:40:11 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:40:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:40:17 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 10:40:17 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:40:17 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:40:17 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:40:17 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:40:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:40:18 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:40:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:40:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:40:18 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:40:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 10:40:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:40:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:40:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:40:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:40:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:40:21 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:40:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555013
Mon 20 Jan 2014 10:40:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:40:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555013
Mon 20 Jan 2014 10:40:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:40:25 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:40:25 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 10:40:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:40:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:40:32 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:40:32 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:40:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:40:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:40:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:40:33 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:40:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:40:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:40:34 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:40:34 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:40:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:40:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:40:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:40:36 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:40:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:40:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:40:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:40:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:40:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:40:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:40:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:40:39 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:40:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:40:39 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:40:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 10:40:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 10:40:39 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:40:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5745 values 90552 bits 11319 bytes 
Mon 20 Jan 2014 10:40:40 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:40:40 - job_xml_thread(): Done retrieving: data size 43580164
Mon 20 Jan 2014 10:40:40 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:40:40 - XML: Start document: iteration 2
Mon 20 Jan 2014 10:40:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580164
Mon 20 Jan 2014 10:40:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:40:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580164
Mon 20 Jan 2014 10:40:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:40:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:40:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:40:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:40:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:40:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:40:59 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:40:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:40:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:41:00 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:41:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:41:00 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:41:00 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:41:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:41:02 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 10:41:02 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:41:02 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:41:02 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:41:02 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:41:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:41:05 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:41:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:41:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:41:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:41:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:41:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:41:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:41:07 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:41:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 10:41:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:41:07 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:41:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576019
Mon 20 Jan 2014 10:41:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:41:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576019
Mon 20 Jan 2014 10:41:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:41:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:41:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:41:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:41:15 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:41:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:41:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:41:16 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:41:16 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:41:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:41:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:41:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576019
Mon 20 Jan 2014 10:41:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:41:17 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:41:17 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:41:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:41:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:41:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:41:29 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:41:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:41:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:41:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:41:29 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:41:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:41:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:41:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:41:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:41:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:41:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:41:31 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:41:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:41:31 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:41:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:41:33 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:41:33 - job_xml_thread(): Done retrieving: data size 43470376
Mon 20 Jan 2014 10:41:33 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:41:33 - XML: Start document: iteration 3
Mon 20 Jan 2014 10:41:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43470376
Mon 20 Jan 2014 10:41:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:41:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43470376
Mon 20 Jan 2014 10:41:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:41:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:41:39 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:41:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:41:40 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:41:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 10:41:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 10:41:40 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:41:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7143 values 112672 bits 14084 bytes 
Mon 20 Jan 2014 10:41:45 - XML: Processed 652608 elements - found 0 jobs
Mon 20 Jan 2014 10:41:45 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:41:45 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:41:45 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:41:45 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:41:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:41:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:41:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:41:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:41:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:41:51 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:41:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:41:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:41:52 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:41:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:41:52 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:41:52 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:41:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:41:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:41:56 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:41:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:41:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:41:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:41:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:41:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:41:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:42:00 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:42:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42898784
Mon 20 Jan 2014 10:42:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:42:00 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:42:00 - job_xml_thread(): Done retrieving: data size 42898784
Mon 20 Jan 2014 10:42:00 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:42:00 - XML: Start document: iteration 4
Mon 20 Jan 2014 10:42:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42898784
Mon 20 Jan 2014 10:42:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:42:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:42:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:42:12 - XML: Processed 645221 elements - found 0 jobs
Mon 20 Jan 2014 10:42:12 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:42:12 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:42:12 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:42:12 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:42:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:42:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:42:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:42:20 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:42:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:42:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:42:20 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:42:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:42:20 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:42:20 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:42:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:42:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:42:22 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:42:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:42:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:42:22 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:42:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 10:42:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:42:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:42:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:42:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:42:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:42:25 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:42:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43006428
Mon 20 Jan 2014 10:42:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:42:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43006428
Mon 20 Jan 2014 10:42:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:42:27 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:42:27 - job_xml_thread(): Done retrieving: data size 43006428
Mon 20 Jan 2014 10:42:27 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:42:27 - XML: Start document: iteration 5
Mon 20 Jan 2014 10:42:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:42:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:42:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:42:37 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:42:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:42:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:42:38 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:42:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:42:38 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:42:38 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:42:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:42:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:42:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:42:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:42:40 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:42:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:42:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 10:42:41 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:42:41 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:42:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 10:42:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5792 values 91324 bits 11415 bytes 
Mon 20 Jan 2014 10:42:43 - XML: Processed 646042 elements - found 0 jobs
Mon 20 Jan 2014 10:42:43 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:42:43 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:42:43 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:42:43 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:42:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:42:49 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:42:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:42:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:42:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:42:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:42:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:42:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:42:53 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:42:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43504677
Mon 20 Jan 2014 10:42:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:42:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:42:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:42:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43504677
Mon 20 Jan 2014 10:42:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:42:55 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:42:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 10:42:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:42:58 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:42:58 - job_xml_thread(): Done retrieving: data size 43504677
Mon 20 Jan 2014 10:42:58 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:42:58 - XML: Start document: iteration 6
Mon 20 Jan 2014 10:43:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:43:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:43:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:43:12 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:43:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:43:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:43:13 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:43:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:43:13 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:43:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:43:13 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:43:15 - XML: Processed 652770 elements - found 0 jobs
Mon 20 Jan 2014 10:43:15 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:43:15 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:43:15 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:43:15 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:43:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:43:16 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:43:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:43:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:43:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:43:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:43:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:43:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:43:19 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:43:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568297
Mon 20 Jan 2014 10:43:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:43:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568297
Mon 20 Jan 2014 10:43:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:43:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:43:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:43:31 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:43:31 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:43:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:43:31 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:43:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:43:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:43:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:43:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:43:31 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:43:31 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:43:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:43:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:43:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:43:35 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:43:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:43:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:43:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:43:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:43:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:43:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:43:38 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:43:38 - job_xml_thread(): Done retrieving: data size 43575141
Mon 20 Jan 2014 10:43:38 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:43:38 - XML: Start document: iteration 7
Mon 20 Jan 2014 10:43:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575141
Mon 20 Jan 2014 10:43:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:43:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575141
Mon 20 Jan 2014 10:43:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:43:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:43:42 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:43:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:43:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 10:43:43 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:43:43 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:43:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9418 values 148545 bits 18568 bytes 
Mon 20 Jan 2014 10:43:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 10:43:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:43:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:43:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:43:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:43:54 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 10:43:54 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:43:54 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:43:54 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:43:55 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:44:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:44:00 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:44:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:44:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:44:00 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:44:00 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:44:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:44:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:44:00 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:44:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:44:03 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:44:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:44:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:44:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:44:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:44:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:44:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:44:03 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 10:44:03 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 10:44:03 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:44:06 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:44:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575525
Mon 20 Jan 2014 10:44:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:44:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575525
Mon 20 Jan 2014 10:44:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:44:10 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:44:10 - job_xml_thread(): Done retrieving: data size 43575525
Mon 20 Jan 2014 10:44:10 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:44:10 - XML: Start document: iteration 8
Mon 20 Jan 2014 10:44:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:44:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:44:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:44:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:44:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:44:24 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:44:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:44:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:44:25 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:44:25 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:44:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:44:25 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:44:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:44:28 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:44:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 10:44:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:44:28 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 10:44:29 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:44:29 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:44:29 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:44:29 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:44:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:44:29 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:44:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:44:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:44:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:44:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:44:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:44:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:44:32 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:44:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560127
Mon 20 Jan 2014 10:44:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:44:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560127
Mon 20 Jan 2014 10:44:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:44:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:44:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:44:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:44:43 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:44:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:44:43 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:44:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:44:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:44:44 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:44:44 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:44:44 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:44:44 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:44:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:44:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:44:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:44:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 10:44:44 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:44:44 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:44:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 10:44:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6129 values 96614 bits 12076 bytes 
Mon 20 Jan 2014 10:44:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:44:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:44:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:44:47 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:44:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:44:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:44:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:44:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:44:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:44:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:44:49 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:44:49 - job_xml_thread(): Done retrieving: data size 43572795
Mon 20 Jan 2014 10:44:49 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:44:49 - XML: Start document: iteration 9
Mon 20 Jan 2014 10:44:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572795
Mon 20 Jan 2014 10:44:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:44:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572795
Mon 20 Jan 2014 10:44:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:44:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:44:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:45:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:45:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:45:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:45:06 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:45:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:45:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:45:07 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:45:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:45:07 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:45:07 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:45:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:45:07 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 10:45:07 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:45:07 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:45:07 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:45:07 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:45:09 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:45:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 10:45:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:45:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:45:11 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:45:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:45:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:45:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:45:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:45:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:45:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:45:13 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:45:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584284
Mon 20 Jan 2014 10:45:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:45:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584284
Mon 20 Jan 2014 10:45:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:45:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:45:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:45:22 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:45:22 - job_xml_thread(): Done retrieving: data size 43584284
Mon 20 Jan 2014 10:45:22 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:45:22 - XML: Start document: iteration 10
Mon 20 Jan 2014 10:45:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:45:25 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:45:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:45:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:45:26 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:45:26 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:45:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:45:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:45:26 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:45:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:45:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:45:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:45:33 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:45:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:45:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:45:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:45:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:45:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:45:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:45:35 - XML: Processed 653357 elements - found 0 jobs
Mon 20 Jan 2014 10:45:35 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:45:35 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:45:35 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:45:35 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:45:37 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:45:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561506
Mon 20 Jan 2014 10:45:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:45:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561506
Mon 20 Jan 2014 10:45:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:45:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:45:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:45:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:45:44 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:45:45 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:45:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 10:45:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:45:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 10:45:46 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:45:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9210 values 145261 bits 18157 bytes 
Mon 20 Jan 2014 10:45:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:45:46 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:45:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:45:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:45:47 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:45:47 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:45:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:45:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:45:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561506
Mon 20 Jan 2014 10:45:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:45:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:45:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:45:50 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:45:50 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:45:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:45:59 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:46:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:46:01 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:46:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:46:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:46:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:46:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:46:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:46:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:46:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:46:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:46:02 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:46:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:46:02 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:46:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:46:03 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:46:03 - job_xml_thread(): Done retrieving: data size 43541854
Mon 20 Jan 2014 10:46:03 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:46:03 - XML: Start document: iteration 11
Mon 20 Jan 2014 10:46:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43541854
Mon 20 Jan 2014 10:46:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:46:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43541854
Mon 20 Jan 2014 10:46:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:46:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:46:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:46:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:46:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:46:17 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 10:46:17 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:46:17 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:46:17 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:46:17 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:46:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:46:17 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:46:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:46:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:46:18 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:46:18 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:46:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:46:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:46:18 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:46:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:46:22 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:46:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:46:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:46:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:46:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:46:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:46:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:46:22 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:46:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 10:46:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:46:24 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:46:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43585149
Mon 20 Jan 2014 10:46:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:46:25 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 10:46:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43585149
Mon 20 Jan 2014 10:46:26 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:46:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:46:28 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:46:28 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:46:28 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 10:46:28 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 10:46:29 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 10:46:32 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:46:33 - job_xml_thread(): Done retrieving: data size 43585149
Mon 20 Jan 2014 10:46:33 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:46:33 - XML: Start document: iteration 12
Mon 20 Jan 2014 10:46:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:46:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:46:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:46:36 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:46:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:46:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:46:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:46:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:46:38 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:46:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:46:38 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:46:38 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:46:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Mon 20 Jan 2014 10:46:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:46:45 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:46:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:46:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:46:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:46:45 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:46:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:46:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:46:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:46:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:46:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:46:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 10:46:47 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:46:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5576 values 88017 bits 11002 bytes 
Mon 20 Jan 2014 10:46:47 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:46:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 10:46:47 - XML: Processed 653355 elements - found 0 jobs
Mon 20 Jan 2014 10:46:47 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:46:47 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:46:47 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:46:47 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:46:49 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:46:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43552533
Mon 20 Jan 2014 10:46:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:46:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43552533
Mon 20 Jan 2014 10:46:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:46:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:46:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:46:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:46:58 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:46:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:46:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:46:59 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:46:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:46:59 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:46:59 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:46:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:47:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:47:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:47:02 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:47:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:47:03 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:47:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:47:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:47:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:47:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:47:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:47:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:47:03 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:47:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 10:47:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:47:05 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:47:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582614
Mon 20 Jan 2014 10:47:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:47:05 - job_xml_thread(): Done retrieving: data size 43582614
Mon 20 Jan 2014 10:47:05 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:47:05 - XML: Start document: iteration 13
Mon 20 Jan 2014 10:47:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582614
Mon 20 Jan 2014 10:47:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:47:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:47:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:47:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:47:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:47:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:47:19 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:47:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:47:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:47:20 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:47:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:47:20 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:47:20 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:47:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:47:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:47:26 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:47:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:47:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:47:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:47:27 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 10:47:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:47:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:47:27 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:47:27 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:47:27 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:47:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:47:27 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:47:28 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:47:28 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:47:28 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:47:28 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:47:28 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 10:47:28 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 10:47:28 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 10:47:29 - size of cluster 'LISA Cluster': 624 hosts 79473 metrics 818888 values 12931483 bits 1616435 bytes 
Mon 20 Jan 2014 10:47:30 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:47:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43499293
Mon 20 Jan 2014 10:47:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:47:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43499293
Mon 20 Jan 2014 10:47:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:47:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:47:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:47:42 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:47:42 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:47:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:47:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:47:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:47:43 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:47:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:47:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:47:44 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:47:44 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:47:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:47:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:47:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:47:46 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:47:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:47:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:47:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:47:47 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:47:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:47:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:47:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:47:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:47:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:47:47 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:47:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 10:47:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 10:47:47 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:47:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8541 values 135012 bits 16876 bytes 
Mon 20 Jan 2014 10:47:50 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:47:50 - job_xml_thread(): Done retrieving: data size 42936099
Mon 20 Jan 2014 10:47:50 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:47:50 - XML: Start document: iteration 14
Mon 20 Jan 2014 10:47:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42936099
Mon 20 Jan 2014 10:47:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:47:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42936099
Mon 20 Jan 2014 10:47:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:47:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:47:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:48:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:48:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:48:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:48:10 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:48:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:48:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:48:11 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:48:11 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:48:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:48:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:48:11 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:48:11 - XML: Processed 645540 elements - found 0 jobs
Mon 20 Jan 2014 10:48:11 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:48:11 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:48:11 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:48:11 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:48:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:48:15 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:48:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:48:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:48:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:48:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:48:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:48:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:48:16 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:48:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 10:48:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:48:18 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:48:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42955064
Mon 20 Jan 2014 10:48:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:48:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42955064
Mon 20 Jan 2014 10:48:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:48:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:48:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:48:26 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:48:26 - job_xml_thread(): Done retrieving: data size 42955064
Mon 20 Jan 2014 10:48:26 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:48:26 - XML: Start document: iteration 15
Mon 20 Jan 2014 10:48:29 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:48:29 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 10:48:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:48:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:48:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:48:30 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:48:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:48:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:48:32 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:48:32 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:48:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:48:32 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:48:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:48:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:48:39 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:48:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:48:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:48:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:48:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:48:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:48:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:48:41 - XML: Processed 645820 elements - found 0 jobs
Mon 20 Jan 2014 10:48:41 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:48:41 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:48:41 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:48:41 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:48:44 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:48:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43388229
Mon 20 Jan 2014 10:48:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:48:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43388229
Mon 20 Jan 2014 10:48:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:48:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:48:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:48:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:48:47 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:48:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:48:48 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:48:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 10:48:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 10:48:48 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:48:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7936 values 125361 bits 15670 bytes 
Mon 20 Jan 2014 10:48:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:48:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:48:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:48:56 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:48:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:48:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:48:56 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:48:56 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:48:57 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:48:57 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:48:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:48:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:49:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:49:00 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:49:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:49:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:49:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:49:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:49:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:49:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:49:05 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:49:05 - job_xml_thread(): Done retrieving: data size 43559631
Mon 20 Jan 2014 10:49:05 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:49:05 - XML: Start document: iteration 16
Mon 20 Jan 2014 10:49:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559631
Mon 20 Jan 2014 10:49:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:49:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559631
Mon 20 Jan 2014 10:49:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:49:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:49:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:49:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:49:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:49:17 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:49:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 10:49:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:49:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:49:21 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:49:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:49:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:49:21 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:49:21 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:49:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:49:21 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:49:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:49:23 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 10:49:23 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:49:23 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:49:23 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:49:23 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:49:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:49:29 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:49:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:49:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:49:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:49:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:49:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:49:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:49:32 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:49:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43540642
Mon 20 Jan 2014 10:49:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:49:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43540642
Mon 20 Jan 2014 10:49:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:49:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:49:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:49:38 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:49:38 - job_xml_thread(): Done retrieving: data size 43540642
Mon 20 Jan 2014 10:49:38 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:49:38 - XML: Start document: iteration 17
Mon 20 Jan 2014 10:49:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:49:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:49:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:49:47 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:49:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:49:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:49:48 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:49:48 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:49:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:49:48 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:49:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:49:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:49:48 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:49:49 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:49:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 10:49:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:49:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 10:49:49 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:49:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6101 values 96216 bits 12027 bytes 
Mon 20 Jan 2014 10:49:54 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 10:49:54 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:49:54 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:49:54 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:49:54 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:49:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:49:57 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:49:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:49:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:49:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:49:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:49:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:49:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:50:01 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:50:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43543737
Mon 20 Jan 2014 10:50:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:50:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43543737
Mon 20 Jan 2014 10:50:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:50:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:50:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:50:06 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:50:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 10:50:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:50:09 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:50:09 - job_xml_thread(): Done retrieving: data size 43543737
Mon 20 Jan 2014 10:50:09 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:50:10 - XML: Start document: iteration 18
Mon 20 Jan 2014 10:50:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:50:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:50:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:50:13 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:50:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:50:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:50:15 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:50:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:50:15 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:50:15 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:50:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:50:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:50:24 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:50:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:50:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:50:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:50:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:50:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:50:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:50:25 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 10:50:25 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:50:25 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:50:25 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:50:25 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:50:28 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:50:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555382
Mon 20 Jan 2014 10:50:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:50:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555382
Mon 20 Jan 2014 10:50:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:50:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:50:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:50:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:50:39 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:50:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:50:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:50:40 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:50:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:50:40 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:50:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:50:40 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:50:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:50:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:50:40 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:50:41 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 10:50:41 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 10:50:41 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:50:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:50:43 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:50:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:50:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:50:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:50:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:50:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:50:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:50:45 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:50:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566773
Mon 20 Jan 2014 10:50:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:50:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566773
Mon 20 Jan 2014 10:50:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:50:45 - job_xml_thread(): Done retrieving: data size 43566773
Mon 20 Jan 2014 10:50:46 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:50:46 - XML: Start document: iteration 19
Mon 20 Jan 2014 10:50:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:50:50 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:50:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:50:52 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:50:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 10:50:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 10:50:52 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:50:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9374 values 147901 bits 18487 bytes 
Mon 20 Jan 2014 10:50:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:50:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:50:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:50:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:50:59 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:50:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:50:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:50:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:51:01 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:51:01 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:51:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:51:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:51:01 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:51:04 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 10:51:04 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:51:04 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:51:04 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:51:04 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:51:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:51:07 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:51:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:51:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:51:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:51:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:51:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:51:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:51:10 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:51:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 10:51:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:51:10 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:51:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576971
Mon 20 Jan 2014 10:51:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:51:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576971
Mon 20 Jan 2014 10:51:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:51:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:51:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:51:19 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:51:19 - job_xml_thread(): Done retrieving: data size 43576971
Mon 20 Jan 2014 10:51:19 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:51:20 - XML: Start document: iteration 20
Mon 20 Jan 2014 10:51:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:51:21 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:51:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:51:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:51:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:51:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:51:23 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:51:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:51:23 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:51:23 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:51:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:51:32 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 10:51:32 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:51:32 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:51:32 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:51:32 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:51:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:51:33 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:51:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:51:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:51:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:51:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:51:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:51:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:51:35 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:51:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557347
Mon 20 Jan 2014 10:51:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:51:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557347
Mon 20 Jan 2014 10:51:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:51:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:51:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:51:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:51:44 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:51:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:51:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:51:47 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:51:47 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:51:47 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:51:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:51:47 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:51:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:51:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:51:48 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:51:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:51:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:51:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:51:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:51:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:51:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:51:50 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:51:50 - job_xml_thread(): Done retrieving: data size 43591153
Mon 20 Jan 2014 10:51:50 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:51:50 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 10:51:50 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 10:51:50 - Housekeeping: done.
Mon 20 Jan 2014 10:51:50 - XML: Start document: iteration 0
Mon 20 Jan 2014 10:51:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43591153
Mon 20 Jan 2014 10:51:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43591153
Mon 20 Jan 2014 10:51:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:51:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:51:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:51:52 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:51:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:51:54 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:51:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 10:51:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 10:51:54 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:51:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148640 bits 18580 bytes 
Mon 20 Jan 2014 10:52:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:52:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:52:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:52:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:52:05 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 10:52:05 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:52:05 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:52:05 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:52:05 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:52:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:52:12 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:52:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:52:12 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:52:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:52:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:52:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:52:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:52:12 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:52:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:52:12 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:52:12 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:52:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:52:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:52:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:52:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:52:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:52:15 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:52:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 10:52:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:52:15 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:52:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571862
Mon 20 Jan 2014 10:52:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:52:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571862
Mon 20 Jan 2014 10:52:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:52:20 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:52:20 - job_xml_thread(): Done retrieving: data size 43571862
Mon 20 Jan 2014 10:52:20 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:52:20 - XML: Start document: iteration 1
Mon 20 Jan 2014 10:52:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:52:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:52:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:52:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:52:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:52:28 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:52:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:52:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:52:29 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:52:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:52:29 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:52:29 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:52:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:52:34 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 10:52:34 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:52:34 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:52:34 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:52:34 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:52:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:52:38 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:52:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:52:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:52:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:52:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:52:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:52:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:52:40 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:52:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565568
Mon 20 Jan 2014 10:52:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:52:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565568
Mon 20 Jan 2014 10:52:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:52:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:52:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:52:50 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:52:50 - job_xml_thread(): Done retrieving: data size 43565568
Mon 20 Jan 2014 10:52:50 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:52:50 - XML: Start document: iteration 2
Mon 20 Jan 2014 10:52:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:52:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:52:54 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:52:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:52:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:52:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:52:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:52:54 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:52:55 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:52:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:52:55 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:52:55 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:52:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:52:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:52:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 10:52:55 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:52:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 10:52:55 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:52:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99059 bits 12382 bytes 
Mon 20 Jan 2014 10:53:00 - XML: Processed 653356 elements - found 0 jobs
Mon 20 Jan 2014 10:53:00 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:53:00 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:53:00 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:53:00 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:53:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:53:02 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:53:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:53:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:53:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:53:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:53:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:53:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:53:05 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:53:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559195
Mon 20 Jan 2014 10:53:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:53:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559195
Mon 20 Jan 2014 10:53:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:53:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:53:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:53:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:53:14 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:53:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:53:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:53:15 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:53:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 10:53:15 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:53:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:53:15 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:53:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:53:15 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:53:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:53:15 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:53:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:53:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:53:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:53:18 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:53:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:53:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:53:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:53:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:53:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:53:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:53:20 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:53:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43512280
Mon 20 Jan 2014 10:53:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:53:21 - job_xml_thread(): Done retrieving: data size 43512280
Mon 20 Jan 2014 10:53:21 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:53:21 - XML: Start document: iteration 3
Mon 20 Jan 2014 10:53:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43512280
Mon 20 Jan 2014 10:53:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:53:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:53:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:53:32 - XML: Processed 652608 elements - found 0 jobs
Mon 20 Jan 2014 10:53:32 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:53:33 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:53:33 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:53:33 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:53:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:53:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:53:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:53:37 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:53:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:53:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:53:38 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:53:38 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:53:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:53:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:53:38 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:53:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:53:41 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:53:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:53:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:53:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:53:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:53:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:53:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:53:42 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:53:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42999360
Mon 20 Jan 2014 10:53:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:53:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42999360
Mon 20 Jan 2014 10:53:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:53:48 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:53:48 - job_xml_thread(): Done retrieving: data size 42999360
Mon 20 Jan 2014 10:53:48 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:53:48 - XML: Start document: iteration 4
Mon 20 Jan 2014 10:53:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:53:50 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:53:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:53:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:53:54 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:53:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:53:54 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:53:54 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:53:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:53:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:53:55 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:53:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:53:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:53:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:53:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 10:53:56 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:53:56 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:53:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 10:53:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9365 values 147691 bits 18461 bytes 
Mon 20 Jan 2014 10:53:59 - XML: Processed 646284 elements - found 0 jobs
Mon 20 Jan 2014 10:53:59 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:53:59 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:53:59 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:53:59 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:54:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:54:01 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:54:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:54:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:54:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:54:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:54:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:54:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:54:04 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:54:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42892648
Mon 20 Jan 2014 10:54:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:54:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42892648
Mon 20 Jan 2014 10:54:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:54:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:54:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:54:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:54:12 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:54:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:54:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:54:13 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:54:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:54:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42892648
Mon 20 Jan 2014 10:54:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:54:13 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:54:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:54:14 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:54:14 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:54:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:54:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:54:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:54:24 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:54:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:54:25 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:54:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:54:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:54:25 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:54:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 10:54:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:54:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:54:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:54:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:54:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:54:27 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:54:27 - job_xml_thread(): Done retrieving: data size 43066276
Mon 20 Jan 2014 10:54:27 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:54:27 - XML: Start document: iteration 5
Mon 20 Jan 2014 10:54:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43066276
Mon 20 Jan 2014 10:54:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:54:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:54:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:54:29 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 10:54:29 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:54:30 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:54:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:54:30 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:54:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:54:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43066276
Mon 20 Jan 2014 10:54:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:54:30 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:54:30 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:54:30 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 10:54:30 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 10:54:30 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 10:54:36 - XML: Processed 647271 elements - found 0 jobs
Mon 20 Jan 2014 10:54:36 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:54:36 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:54:36 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:54:36 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:54:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:54:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:54:42 - size of cluster 'LISA Cluster': 624 hosts 79472 metrics 859284 values 13561823 bits 1695227 bytes 
Mon 20 Jan 2014 10:54:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:54:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:54:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:54:48 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:54:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:54:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:54:49 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:54:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:54:49 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:54:49 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:54:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:54:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:54:50 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:54:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:54:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:54:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:54:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:54:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:54:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:54:51 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:54:54 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:54:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43549703
Mon 20 Jan 2014 10:54:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:54:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43549703
Mon 20 Jan 2014 10:54:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:54:55 - job_xml_thread(): Done retrieving: data size 43549703
Mon 20 Jan 2014 10:54:55 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:54:55 - XML: Start document: iteration 6
Mon 20 Jan 2014 10:54:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:54:57 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:54:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:54:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 10:54:58 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:54:58 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:54:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8955 values 141146 bits 17643 bytes 
Mon 20 Jan 2014 10:54:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 10:55:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:55:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:55:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:55:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:55:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:55:07 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:55:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:55:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:55:08 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:55:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:55:08 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:55:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:55:08 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:55:13 - XML: Processed 652832 elements - found 0 jobs
Mon 20 Jan 2014 10:55:13 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:55:13 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:55:13 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:55:13 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:55:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:55:16 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:55:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:55:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:55:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:55:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:55:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:55:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:55:20 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:55:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43540431
Mon 20 Jan 2014 10:55:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:55:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43540431
Mon 20 Jan 2014 10:55:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:55:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:55:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:55:28 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:55:28 - job_xml_thread(): Done retrieving: data size 43540431
Mon 20 Jan 2014 10:55:28 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:55:28 - XML: Start document: iteration 7
Mon 20 Jan 2014 10:55:32 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:55:32 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 10:55:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:55:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:55:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:55:36 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:55:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:55:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:55:36 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:55:36 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:55:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:55:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:55:37 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:55:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:55:43 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:55:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:55:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:55:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:55:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:55:45 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 10:55:45 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:55:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:55:45 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:55:45 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:55:45 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:55:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:55:45 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:55:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 10:55:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:55:47 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:55:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43539939
Mon 20 Jan 2014 10:55:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:55:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43539939
Mon 20 Jan 2014 10:55:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:55:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:55:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:55:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:55:57 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:55:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:55:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:55:58 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:55:58 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:55:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:55:58 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:55:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:55:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:55:59 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:55:59 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:55:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:55:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 10:55:59 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:55:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 10:55:59 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5717 values 90134 bits 11266 bytes 
Mon 20 Jan 2014 10:56:00 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:56:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:56:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:56:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:56:01 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:56:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:56:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:56:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:56:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:56:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:56:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:56:05 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:56:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570383
Mon 20 Jan 2014 10:56:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:56:06 - job_xml_thread(): Done retrieving: data size 43570383
Mon 20 Jan 2014 10:56:06 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:56:06 - XML: Start document: iteration 8
Mon 20 Jan 2014 10:56:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570383
Mon 20 Jan 2014 10:56:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:56:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:56:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:56:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:56:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:56:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:56:27 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:56:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:56:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:56:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:56:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:56:28 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:56:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:56:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:56:29 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 10:56:29 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:56:29 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:56:29 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:56:29 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:56:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:56:29 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:56:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:56:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:56:30 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:56:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 10:56:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:56:30 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:56:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:56:30 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:56:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:56:33 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:56:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573045
Mon 20 Jan 2014 10:56:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:56:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573045
Mon 20 Jan 2014 10:56:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:56:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:56:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:56:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:56:44 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:56:44 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:56:44 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:56:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:56:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:56:46 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:56:46 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:56:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:56:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:56:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:56:48 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:56:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:56:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:56:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:56:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:56:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:56:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:56:51 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:56:51 - job_xml_thread(): Done retrieving: data size 43578360
Mon 20 Jan 2014 10:56:51 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:56:51 - XML: Start document: iteration 9
Mon 20 Jan 2014 10:56:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578360
Mon 20 Jan 2014 10:56:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:56:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578360
Mon 20 Jan 2014 10:56:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:56:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:57:00 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:57:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:57:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 10:57:00 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:57:00 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:57:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 10:57:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:57:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:57:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8911 values 140531 bits 17566 bytes 
Mon 20 Jan 2014 10:57:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:57:04 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 10:57:04 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:57:04 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:57:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:57:04 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:57:04 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:57:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:57:10 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:57:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:57:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:57:11 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:57:11 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:57:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:57:11 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:57:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:57:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:57:14 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:57:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:57:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:57:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:57:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:57:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:57:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:57:18 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:57:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574034
Mon 20 Jan 2014 10:57:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:57:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574034
Mon 20 Jan 2014 10:57:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:57:19 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:57:19 - job_xml_thread(): Done retrieving: data size 43574034
Mon 20 Jan 2014 10:57:19 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:57:19 - XML: Start document: iteration 10
Mon 20 Jan 2014 10:57:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:57:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:57:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:57:30 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 10:57:30 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:57:30 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:57:30 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:57:30 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:57:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:57:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:57:37 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:57:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:57:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:57:37 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:57:37 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:57:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:57:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:57:37 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:57:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:57:41 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:57:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:57:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:57:42 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:57:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 10:57:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:57:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:57:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:57:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:57:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:57:44 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:57:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569673
Mon 20 Jan 2014 10:57:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:57:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569673
Mon 20 Jan 2014 10:57:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:57:45 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:57:45 - job_xml_thread(): Done retrieving: data size 43569673
Mon 20 Jan 2014 10:57:45 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:57:45 - XML: Start document: iteration 11
Mon 20 Jan 2014 10:57:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:57:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:57:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:57:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:58:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:58:00 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:58:01 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:58:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:58:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 10:58:01 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:58:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5767 values 90939 bits 11367 bytes 
Mon 20 Jan 2014 10:58:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 10:58:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:58:03 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:58:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:58:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:58:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:58:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:58:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:58:03 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:58:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:58:08 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 10:58:08 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:58:08 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:58:08 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:58:08 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:58:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:58:08 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:58:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:58:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:58:09 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:58:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:58:09 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:58:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:58:12 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:58:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573104
Mon 20 Jan 2014 10:58:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:58:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573104
Mon 20 Jan 2014 10:58:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:58:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:58:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:58:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:58:22 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:58:23 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:58:23 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:58:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:58:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:58:24 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:58:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:58:24 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:58:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:58:25 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:58:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 10:58:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:58:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:58:28 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:58:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:58:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:58:28 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 10:58:28 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 10:58:28 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:58:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:58:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:58:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:58:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:58:29 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:58:29 - job_xml_thread(): Done retrieving: data size 43558610
Mon 20 Jan 2014 10:58:29 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:58:29 - XML: Start document: iteration 12
Mon 20 Jan 2014 10:58:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558610
Mon 20 Jan 2014 10:58:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:58:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558610
Mon 20 Jan 2014 10:58:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:58:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:58:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:58:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:58:43 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:58:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:58:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:58:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:58:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:58:44 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:58:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:58:44 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:58:44 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:58:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:58:48 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 10:58:48 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:58:48 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:58:48 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:58:48 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:58:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:58:51 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:58:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:58:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:58:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:58:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:58:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:58:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:58:52 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:58:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573876
Mon 20 Jan 2014 10:58:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:58:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573876
Mon 20 Jan 2014 10:58:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:58:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:58:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:59:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:59:00 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:59:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:59:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:59:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:59:01 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:59:02 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:59:02 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:59:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:59:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573876
Mon 20 Jan 2014 10:59:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:59:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:59:02 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:59:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 10:59:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:59:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 10:59:02 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:59:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9230 values 145590 bits 18198 bytes 
Mon 20 Jan 2014 10:59:03 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:59:03 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:59:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:59:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:59:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:59:11 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:59:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:59:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:59:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:59:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:59:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:59:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:59:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:59:13 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:59:15 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:59:15 - job_xml_thread(): Done retrieving: data size 43494264
Mon 20 Jan 2014 10:59:15 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:59:15 - XML: Start document: iteration 13
Mon 20 Jan 2014 10:59:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43494264
Mon 20 Jan 2014 10:59:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:59:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:59:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:59:17 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:59:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:59:17 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:59:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:59:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43494264
Mon 20 Jan 2014 10:59:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:59:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:59:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:59:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:59:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:59:33 - XML: Processed 652878 elements - found 0 jobs
Mon 20 Jan 2014 10:59:33 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 10:59:33 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 10:59:33 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 10:59:34 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 10:59:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:59:38 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:59:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 10:59:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:59:39 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:59:39 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:59:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:59:39 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:59:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 10:59:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 10:59:39 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 10:59:39 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 10:59:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 10:59:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:59:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 10:59:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 10:59:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:59:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 10:59:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 10:59:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 10:59:42 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 10:59:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42970092
Mon 20 Jan 2014 10:59:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 10:59:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42970092
Mon 20 Jan 2014 10:59:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 10:59:49 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 10:59:49 - job_xml_thread(): Done retrieving: data size 42970092
Mon 20 Jan 2014 10:59:49 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 10:59:49 - XML: Start document: iteration 14
Mon 20 Jan 2014 10:59:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 10:59:53 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 10:59:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 10:59:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 10:59:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 10:59:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 10:59:55 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:59:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 10:59:55 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 10:59:55 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 10:59:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:00:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:00:02 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:00:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:00:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 11:00:03 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:00:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 11:00:03 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:00:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6056 values 95469 bits 11933 bytes 
Mon 20 Jan 2014 11:00:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:00:03 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:00:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:00:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:00:04 - XML: Processed 645846 elements - found 0 jobs
Mon 20 Jan 2014 11:00:04 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:00:04 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:00:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:00:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:00:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:00:04 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:00:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:00:04 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:00:06 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:00:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42892305
Mon 20 Jan 2014 11:00:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:00:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42892305
Mon 20 Jan 2014 11:00:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:00:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:00:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:00:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:00:15 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:00:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:00:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:00:16 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:00:16 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:00:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:00:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:00:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42892305
Mon 20 Jan 2014 11:00:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:00:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:00:19 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:00:19 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:00:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:00:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:00:27 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:00:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:00:28 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:00:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:00:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:00:28 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:00:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 11:00:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:00:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:00:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:00:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:00:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:00:29 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:00:29 - job_xml_thread(): Done retrieving: data size 43283300
Mon 20 Jan 2014 11:00:29 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:00:29 - XML: Start document: iteration 15
Mon 20 Jan 2014 11:00:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43283300
Mon 20 Jan 2014 11:00:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:00:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:00:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:00:32 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:00:32 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:00:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:00:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43283300
Mon 20 Jan 2014 11:00:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:00:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:00:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:00:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:00:46 - XML: Processed 650196 elements - found 0 jobs
Mon 20 Jan 2014 11:00:46 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:00:46 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:00:46 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:00:46 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:00:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:00:47 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:00:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:00:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:00:48 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:00:48 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:00:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:00:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:00:48 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:00:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:00:51 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:00:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:00:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:00:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:00:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:00:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:00:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:00:53 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:00:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43532041
Mon 20 Jan 2014 11:00:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:00:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43532041
Mon 20 Jan 2014 11:00:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:01:01 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:01:01 - job_xml_thread(): Done retrieving: data size 43532041
Mon 20 Jan 2014 11:01:01 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:01:01 - XML: Start document: iteration 16
Mon 20 Jan 2014 11:01:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:01:03 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:01:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:01:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:01:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:01:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 11:01:04 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:01:04 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:01:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 11:01:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8923 values 140686 bits 17585 bytes 
Mon 20 Jan 2014 11:01:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:01:06 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:01:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:01:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:01:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:01:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:01:06 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:01:06 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:01:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:01:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:01:06 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:01:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:01:12 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:01:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:01:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:01:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:01:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:01:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:01:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:01:16 - XML: Processed 652742 elements - found 0 jobs
Mon 20 Jan 2014 11:01:16 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:01:16 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:01:16 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:01:16 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:01:18 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:01:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 11:01:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:01:18 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:01:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43546277
Mon 20 Jan 2014 11:01:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:01:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43546277
Mon 20 Jan 2014 11:01:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:01:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:01:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:01:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:01:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:01:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:01:28 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:01:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:01:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:01:29 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:01:29 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:01:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:01:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:01:29 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:01:31 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:01:32 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 11:01:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:01:32 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:01:32 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:01:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:01:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:01:32 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:01:32 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:01:32 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 11:01:32 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 11:01:32 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 11:01:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:01:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:01:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:01:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:01:33 - size of cluster 'LISA Cluster': 624 hosts 79486 metrics 865395 values 13658720 bits 1707340 bytes 
Mon 20 Jan 2014 11:01:36 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:01:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575004
Mon 20 Jan 2014 11:01:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:01:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575004
Mon 20 Jan 2014 11:01:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:01:37 - job_xml_thread(): Done retrieving: data size 43575004
Mon 20 Jan 2014 11:01:37 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:01:37 - XML: Start document: iteration 17
Mon 20 Jan 2014 11:01:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:01:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:01:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:01:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:01:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:01:53 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:01:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:01:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:01:54 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:01:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:01:54 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:01:54 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:01:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:01:57 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 11:01:57 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:01:57 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:01:57 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:01:57 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:01:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:01:59 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:01:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:01:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:01:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:01:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:01:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:01:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:02:02 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:02:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560268
Mon 20 Jan 2014 11:02:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:02:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560268
Mon 20 Jan 2014 11:02:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:02:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:02:04 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:02:05 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:02:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 11:02:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:02:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 11:02:05 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:02:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148903 bits 18612 bytes 
Mon 20 Jan 2014 11:02:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:02:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:02:12 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:02:12 - job_xml_thread(): Done retrieving: data size 43560268
Mon 20 Jan 2014 11:02:12 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:02:12 - XML: Start document: iteration 18
Mon 20 Jan 2014 11:02:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:02:14 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:02:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:02:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:02:14 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:02:14 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:02:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:02:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:02:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:02:14 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:02:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:02:26 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 11:02:26 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:02:26 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:02:26 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:02:26 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:02:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:02:27 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:02:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:02:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:02:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:02:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:02:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:02:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:02:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:02:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:02:31 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:02:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43538738
Mon 20 Jan 2014 11:02:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:02:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43538738
Mon 20 Jan 2014 11:02:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:02:33 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:02:33 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 11:02:41 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:02:41 - job_xml_thread(): Done retrieving: data size 43538738
Mon 20 Jan 2014 11:02:41 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:02:41 - XML: Start document: iteration 19
Mon 20 Jan 2014 11:02:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:02:42 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:02:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:02:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:02:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:02:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:02:43 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:02:43 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:02:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:02:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:02:43 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:02:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:02:54 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:02:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:02:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:02:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:02:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:02:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:02:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:02:56 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 11:02:56 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:02:56 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:02:56 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:02:56 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:02:56 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:02:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 11:02:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:02:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:02:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:02:59 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:02:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43549833
Mon 20 Jan 2014 11:02:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:02:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43549833
Mon 20 Jan 2014 11:02:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:03:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:03:05 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:03:06 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:03:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 11:03:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:03:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 11:03:06 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:03:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5826 values 92203 bits 11525 bytes 
Mon 20 Jan 2014 11:03:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:03:09 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:03:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:03:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:03:10 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:03:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:03:10 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:03:10 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:03:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:03:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:03:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:03:11 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:03:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:03:15 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:03:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:03:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:03:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:03:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:03:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:03:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:03:20 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:03:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562961
Mon 20 Jan 2014 11:03:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:03:21 - job_xml_thread(): Done retrieving: data size 43562961
Mon 20 Jan 2014 11:03:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562961
Mon 20 Jan 2014 11:03:21 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:03:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:03:21 - XML: Start document: iteration 20
Mon 20 Jan 2014 11:03:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:03:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:03:27 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:03:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 11:03:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:03:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:03:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:03:36 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 11:03:36 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:03:36 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:03:36 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:03:36 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:03:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:03:40 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:03:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:03:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:03:41 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:03:41 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:03:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:03:41 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:03:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:03:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:03:43 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:03:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:03:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:03:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:03:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:03:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:03:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:03:47 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:03:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568483
Mon 20 Jan 2014 11:03:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:03:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568483
Mon 20 Jan 2014 11:03:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:03:51 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:03:51 - job_xml_thread(): Done retrieving: data size 43568483
Mon 20 Jan 2014 11:03:51 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:03:51 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 11:03:52 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 11:03:52 - Housekeeping: done.
Mon 20 Jan 2014 11:03:52 - XML: Start document: iteration 0
Mon 20 Jan 2014 11:03:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:03:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:03:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:03:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:04:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:04:00 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:04:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:04:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:04:02 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:04:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:04:02 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:04:02 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:04:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:04:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:04:06 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:04:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:04:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 11:04:07 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:04:07 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:04:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 11:04:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6194 values 97903 bits 12237 bytes 
Mon 20 Jan 2014 11:04:08 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 11:04:08 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:04:08 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:04:08 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:04:08 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:04:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:04:10 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:04:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:04:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:04:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:04:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:04:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:04:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:04:14 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:04:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 11:04:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:04:15 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:04:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555164
Mon 20 Jan 2014 11:04:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:04:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555164
Mon 20 Jan 2014 11:04:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:04:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:04:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:04:25 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:04:25 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:04:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:04:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:04:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:04:27 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:04:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:04:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:04:27 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:04:27 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:04:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:04:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:04:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:04:30 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:04:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:04:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:04:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:04:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:04:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:04:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:04:33 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:04:33 - job_xml_thread(): Done retrieving: data size 43562083
Mon 20 Jan 2014 11:04:33 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:04:33 - XML: Start document: iteration 1
Mon 20 Jan 2014 11:04:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562083
Mon 20 Jan 2014 11:04:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:04:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562083
Mon 20 Jan 2014 11:04:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:04:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:04:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:04:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:04:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:04:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:04:52 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:04:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:04:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:04:52 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:04:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:04:52 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:04:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:04:52 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:04:55 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 11:04:55 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:04:55 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:04:55 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:04:55 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:04:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:04:57 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:04:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:04:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:04:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:04:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:04:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:04:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:05:00 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:05:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560652
Mon 20 Jan 2014 11:05:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:05:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560652
Mon 20 Jan 2014 11:05:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:05:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:05:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:05:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:05:07 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:05:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:05:08 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:05:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 11:05:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 11:05:08 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:05:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148711 bits 18588 bytes 
Mon 20 Jan 2014 11:05:10 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:05:10 - job_xml_thread(): Done retrieving: data size 43560652
Mon 20 Jan 2014 11:05:10 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:05:10 - XML: Start document: iteration 2
Mon 20 Jan 2014 11:05:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:05:12 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:05:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:05:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:05:12 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:05:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:05:12 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:05:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:05:12 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:05:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:05:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:05:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:05:18 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:05:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:05:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:05:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:05:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:05:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:05:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:05:22 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 11:05:22 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:05:22 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:05:22 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:05:22 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:05:26 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:05:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43489083
Mon 20 Jan 2014 11:05:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:05:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43489083
Mon 20 Jan 2014 11:05:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:05:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:05:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:05:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:05:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:05:38 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:05:38 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:05:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:05:39 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:05:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:05:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:05:39 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:05:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:05:39 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:05:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:05:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:05:43 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:05:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:05:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:05:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:05:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:05:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:05:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:05:43 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:05:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 11:05:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:05:46 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:05:46 - job_xml_thread(): Done retrieving: data size 42956849
Mon 20 Jan 2014 11:05:46 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:05:46 - XML: Start document: iteration 3
Mon 20 Jan 2014 11:05:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42956849
Mon 20 Jan 2014 11:05:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:05:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42956849
Mon 20 Jan 2014 11:05:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:05:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:05:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:05:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:05:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:06:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:06:08 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:06:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:06:08 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:06:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:06:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:06:09 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:06:09 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:06:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:06:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:06:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 11:06:09 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:06:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5848 values 92284 bits 11535 bytes 
Mon 20 Jan 2014 11:06:09 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:06:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:06:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:06:09 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:06:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 11:06:09 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:06:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:06:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:06:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:06:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:06:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:06:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:06:10 - XML: Processed 646010 elements - found 0 jobs
Mon 20 Jan 2014 11:06:10 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:06:10 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:06:10 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:06:10 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:06:14 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:06:14 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 11:06:14 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:06:15 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:06:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42941886
Mon 20 Jan 2014 11:06:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:06:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42941886
Mon 20 Jan 2014 11:06:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:06:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:06:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:06:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:06:24 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:06:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:06:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:06:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:06:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:06:25 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:06:25 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:06:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:06:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:06:25 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:06:25 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:06:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:06:29 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:06:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:06:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:06:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:06:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:06:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:06:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:06:29 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 11:06:29 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 11:06:29 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:06:31 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:06:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43355044
Mon 20 Jan 2014 11:06:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:06:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43355044
Mon 20 Jan 2014 11:06:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:06:32 - job_xml_thread(): Done retrieving: data size 43355044
Mon 20 Jan 2014 11:06:32 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:06:32 - XML: Start document: iteration 4
Mon 20 Jan 2014 11:06:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:06:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:06:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:06:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:06:46 - XML: Processed 650910 elements - found 0 jobs
Mon 20 Jan 2014 11:06:46 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:06:46 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:06:46 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:06:46 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:06:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:06:51 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:06:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:06:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:06:52 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:06:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:06:52 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:06:52 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:06:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:06:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:06:53 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:06:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:06:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:06:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:06:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:06:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:06:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:06:55 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:06:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43543606
Mon 20 Jan 2014 11:06:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:06:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43543606
Mon 20 Jan 2014 11:06:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:07:01 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:07:01 - job_xml_thread(): Done retrieving: data size 43543606
Mon 20 Jan 2014 11:07:01 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:07:01 - XML: Start document: iteration 5
Mon 20 Jan 2014 11:07:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:07:04 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:07:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:07:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:07:08 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:07:08 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:07:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:07:08 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:07:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:07:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:07:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:07:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:07:09 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:07:11 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:07:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:07:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 11:07:11 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:07:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 11:07:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148677 bits 18584 bytes 
Mon 20 Jan 2014 11:07:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:07:15 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:07:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:07:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:07:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:07:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:07:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:07:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:07:16 - XML: Processed 652702 elements - found 0 jobs
Mon 20 Jan 2014 11:07:16 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:07:16 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:07:16 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:07:16 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:07:19 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:07:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43546005
Mon 20 Jan 2014 11:07:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:07:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43546005
Mon 20 Jan 2014 11:07:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:07:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:07:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:07:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:07:29 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:07:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:07:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:07:30 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:07:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:07:30 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:07:30 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:07:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:07:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:07:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:07:31 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:07:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:07:34 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:07:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:07:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:07:34 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:07:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 11:07:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:07:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:07:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:07:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:07:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:07:36 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:07:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576162
Mon 20 Jan 2014 11:07:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:07:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576162
Mon 20 Jan 2014 11:07:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:07:37 - job_xml_thread(): Done retrieving: data size 43576162
Mon 20 Jan 2014 11:07:37 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:07:37 - XML: Start document: iteration 6
Mon 20 Jan 2014 11:07:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:07:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:07:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:07:48 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:07:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:07:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:07:49 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:07:49 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:07:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:07:49 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:07:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:07:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:07:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:07:57 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 11:07:57 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:07:57 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:07:57 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:07:57 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:07:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:07:59 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:07:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:07:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:07:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:07:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:07:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:07:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:08:00 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:08:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43538989
Mon 20 Jan 2014 11:08:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:08:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43538989
Mon 20 Jan 2014 11:08:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:08:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:08:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:08:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:08:10 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:08:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:08:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:08:11 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:08:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:08:11 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:08:11 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:08:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:08:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:08:11 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:08:12 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:08:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 11:08:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:08:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 11:08:12 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:08:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8914 values 140588 bits 17573 bytes 
Mon 20 Jan 2014 11:08:12 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:08:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:08:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:08:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:08:14 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:08:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:08:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:08:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:08:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:08:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:08:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:08:17 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:08:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568899
Mon 20 Jan 2014 11:08:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:08:17 - job_xml_thread(): Done retrieving: data size 43568899
Mon 20 Jan 2014 11:08:17 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:08:17 - XML: Start document: iteration 7
Mon 20 Jan 2014 11:08:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568899
Mon 20 Jan 2014 11:08:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:08:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:08:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:08:27 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:08:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 11:08:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:08:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:08:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:08:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:08:32 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:08:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:08:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:08:33 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:08:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:08:33 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:08:33 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:08:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:08:33 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 11:08:33 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:08:34 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:08:34 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 11:08:34 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:08:34 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 11:08:34 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Mon 20 Jan 2014 11:08:40 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 11:08:40 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:08:40 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:08:40 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:08:40 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:08:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:08:42 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:08:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:08:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:08:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:08:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:08:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:08:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:08:43 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:08:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558897
Mon 20 Jan 2014 11:08:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:08:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558897
Mon 20 Jan 2014 11:08:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:08:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:08:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:08:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:08:54 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:08:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:08:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:08:55 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:08:55 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:08:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:08:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:08:55 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:08:56 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:08:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:08:57 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:08:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:08:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:08:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:08:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:08:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:08:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:08:58 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:08:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575756
Mon 20 Jan 2014 11:08:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:08:59 - job_xml_thread(): Done retrieving: data size 43575756
Mon 20 Jan 2014 11:08:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575756
Mon 20 Jan 2014 11:08:59 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:08:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:09:00 - XML: Start document: iteration 8
Mon 20 Jan 2014 11:09:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:09:09 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:09:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:09:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:09:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:09:12 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:09:12 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:09:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:09:12 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:09:13 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:09:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:09:13 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:09:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:09:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:09:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 11:09:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:09:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 11:09:13 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:09:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9267 values 146191 bits 18273 bytes 
Mon 20 Jan 2014 11:09:17 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 11:09:17 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:09:17 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:09:17 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:09:17 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:09:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:09:19 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:09:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:09:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:09:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:09:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:09:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:09:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:09:22 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:09:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 11:09:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:09:22 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:09:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575745
Mon 20 Jan 2014 11:09:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:09:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575745
Mon 20 Jan 2014 11:09:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:09:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:09:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:09:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:09:32 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:09:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:09:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:09:32 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:09:32 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:09:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:09:32 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:09:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:09:32 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:09:34 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:09:34 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:09:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:09:36 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:09:36 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:09:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:09:36 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 11:09:36 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 11:09:36 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 11:09:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:09:37 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:09:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:09:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:09:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:09:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:09:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:09:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:09:38 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 890278 values 14053462 bits 1756682 bytes 
Mon 20 Jan 2014 11:09:42 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:09:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571882
Mon 20 Jan 2014 11:09:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:09:42 - job_xml_thread(): Done retrieving: data size 43571882
Mon 20 Jan 2014 11:09:42 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:09:42 - XML: Start document: iteration 9
Mon 20 Jan 2014 11:09:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571882
Mon 20 Jan 2014 11:09:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:09:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:09:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:09:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:09:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:09:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:09:54 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:09:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:09:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:09:55 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:09:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:09:55 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:09:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:09:55 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:10:04 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 11:10:04 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:10:04 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:10:04 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:10:04 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:10:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:10:05 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:10:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:10:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:10:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:10:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:10:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:10:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:10:09 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:10:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566456
Mon 20 Jan 2014 11:10:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:10:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566456
Mon 20 Jan 2014 11:10:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:10:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:10:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:10:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:10:13 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:10:14 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:10:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 11:10:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:10:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 11:10:14 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:10:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148582 bits 18572 bytes 
Mon 20 Jan 2014 11:10:19 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:10:19 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:10:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:10:20 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:10:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:10:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:10:20 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:10:20 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:10:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:10:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:10:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:10:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:10:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:10:24 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:10:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:10:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:10:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:10:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:10:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:10:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:10:28 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:10:28 - job_xml_thread(): Done retrieving: data size 43565611
Mon 20 Jan 2014 11:10:28 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:10:28 - XML: Start document: iteration 10
Mon 20 Jan 2014 11:10:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565611
Mon 20 Jan 2014 11:10:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:10:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565611
Mon 20 Jan 2014 11:10:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:10:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:10:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:10:36 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:10:36 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 11:10:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:10:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:10:50 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 11:10:50 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:10:50 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:10:50 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:10:50 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:10:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:10:50 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:10:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:10:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:10:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:10:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:10:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:10:51 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:10:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:10:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:10:52 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:10:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:10:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:10:52 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:10:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 11:10:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:10:53 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:10:53 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:10:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:10:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:10:55 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:10:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43586511
Mon 20 Jan 2014 11:10:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:10:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43586511
Mon 20 Jan 2014 11:10:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:11:05 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:11:05 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:11:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:11:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:11:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:11:08 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:11:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:11:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:11:09 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:11:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:11:09 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:11:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:11:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:11:11 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:11:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:11:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:11:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:11:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:11:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:11:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:11:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:11:14 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:11:14 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:11:14 - job_xml_thread(): Done retrieving: data size 43487924
Mon 20 Jan 2014 11:11:14 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:11:14 - XML: Start document: iteration 11
Mon 20 Jan 2014 11:11:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43487924
Mon 20 Jan 2014 11:11:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:11:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43487924
Mon 20 Jan 2014 11:11:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:11:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:11:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 11:11:17 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:11:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 11:11:17 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:11:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9029 values 142434 bits 17804 bytes 
Mon 20 Jan 2014 11:11:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:11:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:11:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:11:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:11:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:11:30 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:11:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:11:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:11:32 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:11:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:11:32 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:11:32 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:11:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:11:38 - XML: Processed 652608 elements - found 0 jobs
Mon 20 Jan 2014 11:11:38 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:11:38 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:11:38 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:11:38 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:11:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:11:39 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:11:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:11:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:11:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:11:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:11:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:11:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:11:43 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:11:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 11:11:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:11:44 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:11:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42981362
Mon 20 Jan 2014 11:11:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:11:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42981362
Mon 20 Jan 2014 11:11:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:11:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:11:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:11:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:11:51 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:11:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:11:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:11:52 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:11:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:11:53 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:11:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:11:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42981362
Mon 20 Jan 2014 11:11:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:11:54 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:11:54 - job_xml_thread(): Done retrieving: data size 42981362
Mon 20 Jan 2014 11:11:54 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:11:54 - XML: Start document: iteration 12
Mon 20 Jan 2014 11:11:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:11:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:12:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:12:02 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:12:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:12:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:12:08 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:12:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:12:08 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:12:08 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:12:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:12:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:12:11 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:12:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:12:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:12:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:12:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:12:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:12:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:12:13 - XML: Processed 646364 elements - found 0 jobs
Mon 20 Jan 2014 11:12:13 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:12:13 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:12:13 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:12:13 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:12:15 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 11:12:15 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 11:12:15 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:12:16 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:12:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42961826
Mon 20 Jan 2014 11:12:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:12:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42961826
Mon 20 Jan 2014 11:12:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:12:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:12:17 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:12:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:12:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 11:12:18 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:12:18 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:12:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 11:12:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99056 bits 12382 bytes 
Mon 20 Jan 2014 11:12:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:12:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:12:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:12:24 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:12:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:12:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:12:25 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:12:25 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:12:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:12:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:12:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42961826
Mon 20 Jan 2014 11:12:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:12:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:12:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:12:29 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:12:29 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:12:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:12:32 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:12:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:12:35 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:12:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:12:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:12:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:12:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:12:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:12:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:12:37 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:12:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 11:12:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:12:38 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:12:38 - job_xml_thread(): Done retrieving: data size 43035880
Mon 20 Jan 2014 11:12:38 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:12:38 - XML: Start document: iteration 13
Mon 20 Jan 2014 11:12:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43035880
Mon 20 Jan 2014 11:12:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:12:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:12:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:12:42 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:12:42 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:12:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:12:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:12:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43035880
Mon 20 Jan 2014 11:12:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:12:47 - XML: Processed 646574 elements - found 0 jobs
Mon 20 Jan 2014 11:12:47 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:12:47 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:12:47 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:12:47 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:12:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:12:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:12:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:12:56 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:12:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:12:57 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:12:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:12:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:12:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:12:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:12:58 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:12:58 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:12:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:12:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:12:58 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:12:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:12:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:12:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:12:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:13:00 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:13:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575989
Mon 20 Jan 2014 11:13:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:13:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575989
Mon 20 Jan 2014 11:13:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:13:03 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:13:03 - job_xml_thread(): Done retrieving: data size 43575989
Mon 20 Jan 2014 11:13:03 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:13:03 - XML: Start document: iteration 14
Mon 20 Jan 2014 11:13:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:13:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:13:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:13:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:13:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:13:18 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:13:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:13:19 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:13:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:13:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:13:19 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:13:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:13:19 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:13:19 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:13:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:13:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:13:19 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:13:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 11:13:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 11:13:19 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:13:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6330 values 99820 bits 12477 bytes 
Mon 20 Jan 2014 11:13:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:13:22 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:13:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:13:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:13:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:13:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:13:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:13:24 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 11:13:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:13:24 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:13:24 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:13:24 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:13:24 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:13:26 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:13:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567064
Mon 20 Jan 2014 11:13:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:13:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567064
Mon 20 Jan 2014 11:13:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:13:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:13:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:13:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:13:34 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:13:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:13:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:13:35 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:13:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:13:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567064
Mon 20 Jan 2014 11:13:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:13:36 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:13:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:13:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:13:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:13:39 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:13:39 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:13:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:13:44 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:13:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:13:46 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:13:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:13:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:13:46 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:13:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 11:13:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:13:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:13:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:13:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:13:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:13:49 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:13:49 - job_xml_thread(): Done retrieving: data size 43558681
Mon 20 Jan 2014 11:13:49 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:13:49 - XML: Start document: iteration 15
Mon 20 Jan 2014 11:13:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558681
Mon 20 Jan 2014 11:13:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:13:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:13:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:13:53 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:13:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:13:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558681
Mon 20 Jan 2014 11:13:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:13:53 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:13:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:14:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:14:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:14:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:14:04 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:14:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:14:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:14:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:14:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:14:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:14:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:14:05 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:14:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:14:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:14:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:14:09 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:14:10 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 11:14:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:14:10 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:14:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:14:10 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:14:10 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:14:10 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:14:10 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:14:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:14:10 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:14:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:14:12 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:14:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573762
Mon 20 Jan 2014 11:14:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:14:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573762
Mon 20 Jan 2014 11:14:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:14:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:14:19 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:14:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:14:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:14:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:14:20 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:14:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 11:14:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 11:14:20 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:14:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8958 values 141244 bits 17655 bytes 
Mon 20 Jan 2014 11:14:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:14:25 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:14:25 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:14:25 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:14:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:14:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:14:26 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:14:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:14:26 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:14:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:14:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:14:28 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:14:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:14:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:14:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:14:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:14:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:14:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:14:31 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:14:31 - job_xml_thread(): Done retrieving: data size 43569235
Mon 20 Jan 2014 11:14:31 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:14:31 - XML: Start document: iteration 16
Mon 20 Jan 2014 11:14:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569235
Mon 20 Jan 2014 11:14:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:14:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569235
Mon 20 Jan 2014 11:14:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:14:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:14:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:14:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:14:43 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:14:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:14:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:14:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:14:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:14:44 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:14:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:14:44 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:14:44 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:14:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:14:45 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:14:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 11:14:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:14:48 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 11:14:48 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:14:48 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:14:48 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:14:48 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:14:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:14:52 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:14:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:14:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:14:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:14:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:14:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:14:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:14:54 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:14:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581102
Mon 20 Jan 2014 11:14:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:14:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581102
Mon 20 Jan 2014 11:14:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:15:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:15:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:15:03 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:15:03 - job_xml_thread(): Done retrieving: data size 43581102
Mon 20 Jan 2014 11:15:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:15:03 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:15:03 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:15:03 - XML: Start document: iteration 17
Mon 20 Jan 2014 11:15:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:15:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:15:06 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:15:06 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:15:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:15:06 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:15:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:15:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:15:08 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:15:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:15:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:15:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:15:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:15:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:15:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:15:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:15:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:15:12 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 11:15:12 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:15:12 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:15:12 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:15:12 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:15:15 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:15:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43550995
Mon 20 Jan 2014 11:15:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:15:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43550995
Mon 20 Jan 2014 11:15:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:15:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:15:21 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:15:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:15:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:15:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:15:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 11:15:22 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:15:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 11:15:22 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:15:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9330 values 147138 bits 18392 bytes 
Mon 20 Jan 2014 11:15:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:15:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:15:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:15:25 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:15:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:15:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:15:26 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:15:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:15:26 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:15:26 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:15:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:15:28 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:15:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:15:29 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:15:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:15:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:15:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:15:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:15:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:15:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:15:32 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:15:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567848
Mon 20 Jan 2014 11:15:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:15:32 - job_xml_thread(): Done retrieving: data size 43567848
Mon 20 Jan 2014 11:15:32 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:15:32 - XML: Start document: iteration 18
Mon 20 Jan 2014 11:15:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567848
Mon 20 Jan 2014 11:15:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:15:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:15:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:15:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:15:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:15:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:15:50 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:15:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:15:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:15:51 - XML: Processed 653354 elements - found 0 jobs
Mon 20 Jan 2014 11:15:51 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:15:51 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:15:51 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:15:51 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:15:51 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:15:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:15:51 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:15:51 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:15:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:15:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:15:53 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:15:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:15:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:15:53 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:15:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 11:15:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:15:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:15:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:15:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:15:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:15:55 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:15:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43587578
Mon 20 Jan 2014 11:15:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:15:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43587578
Mon 20 Jan 2014 11:15:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:16:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:16:05 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:16:06 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:16:06 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:16:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:16:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:16:08 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:16:08 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:16:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:16:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:16:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:16:09 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:16:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:16:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:16:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:16:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:16:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:16:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:16:10 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:16:10 - job_xml_thread(): Done retrieving: data size 43590195
Mon 20 Jan 2014 11:16:10 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:16:10 - XML: Start document: iteration 19
Mon 20 Jan 2014 11:16:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43590195
Mon 20 Jan 2014 11:16:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:16:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43590195
Mon 20 Jan 2014 11:16:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:16:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:16:23 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:16:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:16:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:16:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:16:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 11:16:24 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:16:24 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:16:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 11:16:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:16:24 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:16:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8703 values 137380 bits 17172 bytes 
Mon 20 Jan 2014 11:16:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:16:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:16:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:16:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:16:25 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:16:25 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:16:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:16:25 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:16:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:16:30 - XML: Processed 653355 elements - found 0 jobs
Mon 20 Jan 2014 11:16:30 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:16:30 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:16:30 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:16:30 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:16:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:16:32 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:16:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:16:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:16:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:16:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:16:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:16:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:16:35 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:16:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569912
Mon 20 Jan 2014 11:16:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:16:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569912
Mon 20 Jan 2014 11:16:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:16:36 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 11:16:36 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:16:38 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:16:38 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 11:16:38 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:16:38 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 11:16:38 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 11:16:40 - size of cluster 'LISA Cluster': 624 hosts 79469 metrics 888702 values 14022839 bits 1752854 bytes 
Mon 20 Jan 2014 11:16:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:16:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:16:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:16:45 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:16:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:16:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:16:45 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:16:45 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:16:46 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:16:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:16:46 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:16:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:16:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:16:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:16:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:16:51 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:16:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:16:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:16:51 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:16:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 11:16:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:16:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:16:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:16:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:16:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:16:54 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:16:54 - job_xml_thread(): Done retrieving: data size 43590802
Mon 20 Jan 2014 11:16:54 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:16:54 - XML: Start document: iteration 20
Mon 20 Jan 2014 11:16:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43590802
Mon 20 Jan 2014 11:16:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:16:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43590802
Mon 20 Jan 2014 11:16:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:17:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:17:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:17:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:17:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:17:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:17:08 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:17:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:17:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:17:08 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:17:08 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:17:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:17:08 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:17:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:17:17 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 11:17:17 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:17:17 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:17:17 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:17:17 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:17:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:17:19 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:17:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:17:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:17:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:17:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:17:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:17:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:17:22 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:17:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43496429
Mon 20 Jan 2014 11:17:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:17:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43496429
Mon 20 Jan 2014 11:17:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:17:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:17:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:17:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:17:24 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:17:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:17:26 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:17:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 11:17:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 11:17:26 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:17:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8819 values 139334 bits 17416 bytes 
Mon 20 Jan 2014 11:17:32 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:17:32 - job_xml_thread(): Done retrieving: data size 43496429
Mon 20 Jan 2014 11:17:32 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:17:32 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 11:17:32 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 11:17:32 - Housekeeping: done.
Mon 20 Jan 2014 11:17:32 - XML: Start document: iteration 0
Mon 20 Jan 2014 11:17:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:17:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:17:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:17:37 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:17:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:17:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:17:38 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:17:38 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 11:17:39 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:17:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:17:39 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:17:39 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:17:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:17:44 - XML: Processed 652608 elements - found 0 jobs
Mon 20 Jan 2014 11:17:44 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:17:44 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:17:44 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:17:44 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:17:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:17:46 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:17:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:17:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:17:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:17:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:17:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:17:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:17:51 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:17:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42966748
Mon 20 Jan 2014 11:17:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:17:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42966748
Mon 20 Jan 2014 11:17:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:17:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:17:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:17:59 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:17:59 - job_xml_thread(): Done retrieving: data size 42966748
Mon 20 Jan 2014 11:18:00 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:18:00 - XML: Start document: iteration 1
Mon 20 Jan 2014 11:18:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:18:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:18:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:18:10 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:18:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:18:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:18:11 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:18:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:18:11 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:18:11 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:18:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:18:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:18:13 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:18:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:18:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:18:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:18:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:18:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:18:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:18:14 - XML: Processed 645972 elements - found 0 jobs
Mon 20 Jan 2014 11:18:14 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:18:14 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:18:14 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:18:14 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:18:15 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:18:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 11:18:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:18:18 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:18:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42970186
Mon 20 Jan 2014 11:18:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:18:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42970186
Mon 20 Jan 2014 11:18:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:18:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:18:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:18:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:18:26 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:18:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:18:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 11:18:28 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:18:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5788 values 91446 bits 11430 bytes 
Mon 20 Jan 2014 11:18:28 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:18:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 11:18:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:18:28 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:18:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:18:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:18:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:18:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:18:30 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:18:30 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:18:30 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:18:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:18:30 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:18:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:18:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:18:33 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:18:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:18:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:18:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:18:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:18:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:18:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:18:37 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:18:37 - job_xml_thread(): Done retrieving: data size 43344184
Mon 20 Jan 2014 11:18:37 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:18:37 - XML: Start document: iteration 2
Mon 20 Jan 2014 11:18:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43344184
Mon 20 Jan 2014 11:18:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:18:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43344184
Mon 20 Jan 2014 11:18:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:18:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:18:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:18:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:18:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:18:56 - XML: Processed 650440 elements - found 0 jobs
Mon 20 Jan 2014 11:18:56 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:18:56 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:18:56 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:18:56 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:18:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:18:57 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:18:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:18:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:18:58 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:18:58 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:18:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:18:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:18:59 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:19:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:19:01 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:19:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:19:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:19:01 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:19:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 11:19:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:19:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:19:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:19:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:19:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:19:05 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:19:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575548
Mon 20 Jan 2014 11:19:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:19:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575548
Mon 20 Jan 2014 11:19:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:19:12 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:19:12 - job_xml_thread(): Done retrieving: data size 43575548
Mon 20 Jan 2014 11:19:12 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:19:12 - XML: Start document: iteration 3
Mon 20 Jan 2014 11:19:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:19:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:19:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:19:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:19:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:19:18 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:19:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:19:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:19:19 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:19:19 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:19:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:19:19 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:19:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:19:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:19:28 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:19:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:19:28 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:19:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 11:19:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 11:19:28 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:19:28 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 11:19:28 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:19:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5891 values 92932 bits 11616 bytes 
Mon 20 Jan 2014 11:19:28 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:19:28 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:19:28 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:19:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:19:30 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:19:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:19:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:19:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:19:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:19:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:19:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:19:33 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:19:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43537097
Mon 20 Jan 2014 11:19:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:19:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43537097
Mon 20 Jan 2014 11:19:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:19:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:19:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:19:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:19:43 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:19:44 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:19:44 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:19:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:19:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:19:44 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:19:44 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:19:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:19:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:19:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:19:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:19:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:19:50 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:19:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:19:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:19:51 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:19:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 11:19:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:19:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:19:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:19:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:19:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:19:53 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:19:53 - job_xml_thread(): Done retrieving: data size 43569976
Mon 20 Jan 2014 11:19:53 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:19:53 - XML: Start document: iteration 4
Mon 20 Jan 2014 11:19:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569976
Mon 20 Jan 2014 11:19:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:19:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569976
Mon 20 Jan 2014 11:19:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:19:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:19:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:20:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:20:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:20:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:20:13 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:20:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:20:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:20:14 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:20:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:20:14 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:20:14 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:20:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:20:14 - XML: Processed 653357 elements - found 0 jobs
Mon 20 Jan 2014 11:20:14 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:20:14 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:20:14 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:20:14 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:20:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:20:17 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:20:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:20:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:20:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:20:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:20:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:20:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:20:21 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:20:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570052
Mon 20 Jan 2014 11:20:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:20:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570052
Mon 20 Jan 2014 11:20:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:20:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:20:28 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:20:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:20:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:20:29 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:20:29 - job_xml_thread(): Done retrieving: data size 43570052
Mon 20 Jan 2014 11:20:29 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:20:29 - XML: Start document: iteration 5
Mon 20 Jan 2014 11:20:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:20:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 11:20:29 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:20:30 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:20:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8509 values 134117 bits 16764 bytes 
Mon 20 Jan 2014 11:20:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 11:20:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:20:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:20:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:20:42 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:20:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:20:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:20:42 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:20:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:20:42 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:20:42 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:20:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:20:44 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 11:20:44 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:20:44 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:20:44 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:20:44 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:20:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:20:45 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:20:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:20:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:20:45 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 11:20:45 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 11:20:45 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:20:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:20:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:20:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:20:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:20:47 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:20:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 11:20:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:20:48 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:20:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566089
Mon 20 Jan 2014 11:20:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:20:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566089
Mon 20 Jan 2014 11:20:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:20:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:20:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:20:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:20:58 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:20:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:20:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:20:58 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:20:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:20:58 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:20:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:20:58 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:20:59 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:21:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:21:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:21:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:21:01 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:21:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:21:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:21:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:21:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:21:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:21:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:21:03 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:21:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571191
Mon 20 Jan 2014 11:21:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:21:04 - job_xml_thread(): Done retrieving: data size 43571191
Mon 20 Jan 2014 11:21:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571191
Mon 20 Jan 2014 11:21:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:21:04 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:21:04 - XML: Start document: iteration 6
Mon 20 Jan 2014 11:21:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:21:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:21:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:21:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:21:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:21:22 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:21:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:21:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:21:23 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 11:21:23 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:21:23 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:21:23 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:21:23 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:21:23 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:21:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:21:23 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:21:23 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:21:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:21:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:21:26 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:21:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:21:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:21:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:21:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:21:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:21:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:21:27 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:21:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43587904
Mon 20 Jan 2014 11:21:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:21:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43587904
Mon 20 Jan 2014 11:21:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:21:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:21:30 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:21:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:21:31 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:21:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 11:21:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 11:21:31 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:21:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148593 bits 18574 bytes 
Mon 20 Jan 2014 11:21:38 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:21:38 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:21:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:21:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:21:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:21:38 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:21:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:21:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:21:39 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:21:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:21:39 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:21:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:21:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:21:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:21:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:21:42 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:21:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:21:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:21:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:21:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:21:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:21:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:21:45 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:21:45 - job_xml_thread(): Done retrieving: data size 43577965
Mon 20 Jan 2014 11:21:45 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:21:45 - XML: Start document: iteration 7
Mon 20 Jan 2014 11:21:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577965
Mon 20 Jan 2014 11:21:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:21:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577965
Mon 20 Jan 2014 11:21:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:21:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:21:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:21:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:21:56 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:21:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:21:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:21:57 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:21:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:21:57 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:21:57 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:21:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:21:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:21:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:22:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:22:06 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:22:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:22:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:22:07 - XML: Processed 653356 elements - found 0 jobs
Mon 20 Jan 2014 11:22:07 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:22:07 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:22:07 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:22:07 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:22:07 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:22:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 11:22:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:22:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:22:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:22:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:22:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:22:09 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:22:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570046
Mon 20 Jan 2014 11:22:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:22:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570046
Mon 20 Jan 2014 11:22:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:22:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:22:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:22:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:22:19 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:22:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:22:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:22:22 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:22:22 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:22:22 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:22:22 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:22:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:22:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:22:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:22:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:22:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:22:24 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:22:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:22:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:22:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:22:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:22:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:22:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:22:26 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:22:26 - job_xml_thread(): Done retrieving: data size 43598268
Mon 20 Jan 2014 11:22:26 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:22:26 - XML: Start document: iteration 8
Mon 20 Jan 2014 11:22:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43598268
Mon 20 Jan 2014 11:22:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:22:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43598268
Mon 20 Jan 2014 11:22:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:22:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:22:33 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:22:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:22:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 11:22:35 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:22:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9077 values 143125 bits 17890 bytes 
Mon 20 Jan 2014 11:22:35 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:22:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 11:22:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:22:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:22:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:22:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:22:40 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 11:22:40 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:22:40 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:22:40 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:22:40 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:22:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:22:42 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:22:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:22:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:22:43 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:22:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:22:43 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:22:43 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:22:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:22:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:22:48 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:22:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:22:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:22:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:22:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:22:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:22:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:22:51 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:22:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574170
Mon 20 Jan 2014 11:22:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:22:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574170
Mon 20 Jan 2014 11:22:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:22:55 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:22:55 - job_xml_thread(): Done retrieving: data size 43574170
Mon 20 Jan 2014 11:22:55 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:22:55 - XML: Start document: iteration 9
Mon 20 Jan 2014 11:22:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:22:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:23:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:23:02 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:23:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:23:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:23:03 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:23:03 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:23:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:23:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:23:03 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:23:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:23:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:23:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:23:12 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:23:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:23:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:23:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:23:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:23:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:23:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:23:13 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 11:23:13 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:23:13 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:23:13 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:23:13 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:23:13 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:23:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 11:23:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:23:15 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:23:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43515494
Mon 20 Jan 2014 11:23:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:23:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43515494
Mon 20 Jan 2014 11:23:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:23:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:23:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:23:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:23:26 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:23:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:23:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:23:28 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:23:28 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:23:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:23:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:23:28 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:23:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:23:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:23:28 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:23:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:23:28 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:23:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:23:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:23:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:23:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:23:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:23:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:23:30 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:23:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43082779
Mon 20 Jan 2014 11:23:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:23:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43082779
Mon 20 Jan 2014 11:23:31 - job_xml_thread(): Done retrieving: data size 43082779
Mon 20 Jan 2014 11:23:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:23:31 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:23:31 - XML: Start document: iteration 10
Mon 20 Jan 2014 11:23:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:23:36 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:23:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:23:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 11:23:37 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:23:38 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:23:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 11:23:39 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 11:23:39 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:23:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8921 values 140663 bits 17582 bytes 
Mon 20 Jan 2014 11:23:42 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:23:42 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 11:23:42 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:23:42 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 11:23:42 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 11:23:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:23:42 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:23:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:23:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:23:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:23:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:23:44 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:23:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:23:45 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:23:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:23:45 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:23:50 - size of cluster 'LISA Cluster': 624 hosts 79479 metrics 861105 values 13592825 bits 1699103 bytes 
Mon 20 Jan 2014 11:23:52 - XML: Processed 647156 elements - found 0 jobs
Mon 20 Jan 2014 11:23:52 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:23:52 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:23:52 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:23:52 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:23:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:23:54 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:23:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:23:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:23:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:23:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:23:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:23:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:23:58 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:23:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42923870
Mon 20 Jan 2014 11:23:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:23:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42923870
Mon 20 Jan 2014 11:23:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:24:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:24:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:24:07 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:24:07 - job_xml_thread(): Done retrieving: data size 42923870
Mon 20 Jan 2014 11:24:07 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:24:07 - XML: Start document: iteration 11
Mon 20 Jan 2014 11:24:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:24:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:24:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:24:10 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:24:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:24:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:24:11 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:24:11 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:24:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:24:11 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:24:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:24:18 - XML: Processed 645358 elements - found 0 jobs
Mon 20 Jan 2014 11:24:18 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:24:18 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:24:18 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:24:18 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:24:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:24:21 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:24:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:24:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:24:21 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:24:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 11:24:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:24:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:24:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:24:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:24:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:24:24 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:24:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42966186
Mon 20 Jan 2014 11:24:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:24:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42966186
Mon 20 Jan 2014 11:24:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:24:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:24:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:24:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:24:33 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:24:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:24:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:24:33 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:24:33 - job_xml_thread(): Done retrieving: data size 42966186
Mon 20 Jan 2014 11:24:33 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:24:33 - XML: Start document: iteration 12
Mon 20 Jan 2014 11:24:34 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:24:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:24:34 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:24:34 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:24:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:24:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:24:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:24:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:24:38 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:24:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:24:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 11:24:38 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:24:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 11:24:39 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:24:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5573 values 87779 bits 10972 bytes 
Mon 20 Jan 2014 11:24:42 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:24:42 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 11:24:43 - XML: Processed 645908 elements - found 0 jobs
Mon 20 Jan 2014 11:24:43 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:24:43 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:24:43 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:24:43 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:24:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:24:47 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:24:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:24:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:24:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:24:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:24:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:24:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:24:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:24:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:24:51 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:24:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43491459
Mon 20 Jan 2014 11:24:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:24:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43491459
Mon 20 Jan 2014 11:24:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:24:58 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:24:58 - job_xml_thread(): Done retrieving: data size 43491459
Mon 20 Jan 2014 11:24:58 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:24:58 - XML: Start document: iteration 13
Mon 20 Jan 2014 11:25:00 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:25:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 11:25:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:25:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:25:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:25:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:25:04 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:25:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:25:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:25:06 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:25:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:25:06 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:25:06 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:25:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:25:09 - XML: Processed 652738 elements - found 0 jobs
Mon 20 Jan 2014 11:25:09 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:25:09 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:25:09 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:25:09 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:25:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:25:14 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:25:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:25:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:25:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:25:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:25:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:25:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:25:17 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:25:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43551923
Mon 20 Jan 2014 11:25:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:25:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43551923
Mon 20 Jan 2014 11:25:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:25:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:25:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:25:24 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:25:24 - job_xml_thread(): Done retrieving: data size 43551923
Mon 20 Jan 2014 11:25:25 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:25:25 - XML: Start document: iteration 14
Mon 20 Jan 2014 11:25:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:25:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:25:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:25:32 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:25:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:25:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:25:32 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 11:25:32 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:25:32 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:25:32 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:25:32 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:25:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:25:32 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:25:32 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:25:32 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:25:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:25:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:25:37 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:25:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:25:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:25:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:25:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:25:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:25:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:25:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:25:39 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:25:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:25:39 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:25:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 11:25:39 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:25:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 11:25:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6169 values 97238 bits 12154 bytes 
Mon 20 Jan 2014 11:25:41 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:25:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582984
Mon 20 Jan 2014 11:25:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:25:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582984
Mon 20 Jan 2014 11:25:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:25:48 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:25:48 - job_xml_thread(): Done retrieving: data size 43582984
Mon 20 Jan 2014 11:25:48 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:25:48 - XML: Start document: iteration 15
Mon 20 Jan 2014 11:25:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:25:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:25:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:25:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:25:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:25:55 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:25:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:25:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:25:56 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:25:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:25:56 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:25:56 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:25:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:26:01 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 11:26:01 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:26:01 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:26:01 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:26:01 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:26:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:26:05 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:26:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:26:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:26:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:26:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:26:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:26:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:26:07 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:26:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 11:26:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:26:09 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:26:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560056
Mon 20 Jan 2014 11:26:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:26:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560056
Mon 20 Jan 2014 11:26:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:26:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:26:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:26:16 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:26:16 - job_xml_thread(): Done retrieving: data size 43560056
Mon 20 Jan 2014 11:26:16 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:26:16 - XML: Start document: iteration 16
Mon 20 Jan 2014 11:26:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:26:18 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:26:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:26:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:26:20 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:26:20 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:26:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:26:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:26:20 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:26:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:26:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:26:31 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 11:26:31 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:26:31 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:26:31 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:26:31 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:26:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:26:32 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:26:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:26:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:26:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:26:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:26:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:26:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:26:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:26:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:26:35 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:26:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43548212
Mon 20 Jan 2014 11:26:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:26:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43548212
Mon 20 Jan 2014 11:26:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:26:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:26:39 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:26:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:26:40 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:26:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 11:26:40 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:26:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 11:26:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7462 values 117634 bits 14704 bytes 
Mon 20 Jan 2014 11:26:46 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:26:46 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:26:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:26:47 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:26:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:26:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:26:47 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:26:47 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:26:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:26:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:26:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:26:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:26:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:26:50 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:26:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:26:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:26:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:26:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:26:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:26:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:26:54 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:26:54 - job_xml_thread(): Done retrieving: data size 43585292
Mon 20 Jan 2014 11:26:54 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:26:54 - XML: Start document: iteration 17
Mon 20 Jan 2014 11:26:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43585292
Mon 20 Jan 2014 11:26:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43585292
Mon 20 Jan 2014 11:26:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:26:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:27:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:27:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:27:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:27:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:27:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:27:14 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:27:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:27:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:27:15 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:27:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:27:15 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:27:15 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:27:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:27:15 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 11:27:15 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:27:15 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:27:15 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:27:15 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:27:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:27:18 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:27:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:27:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:27:18 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:27:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 11:27:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:27:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:27:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:27:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:27:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:27:21 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:27:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583280
Mon 20 Jan 2014 11:27:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:27:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583280
Mon 20 Jan 2014 11:27:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:27:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:27:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:27:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:27:30 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:27:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:27:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:27:30 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:27:30 - job_xml_thread(): Done retrieving: data size 43583280
Mon 20 Jan 2014 11:27:30 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:27:30 - XML: Start document: iteration 18
Mon 20 Jan 2014 11:27:31 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:27:31 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:27:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:27:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:27:31 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:27:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:27:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:27:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:27:41 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:27:41 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:27:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 11:27:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:27:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 11:27:41 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:27:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:27:41 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:27:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5747 values 90566 bits 11320 bytes 
Mon 20 Jan 2014 11:27:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:27:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:27:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:27:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:27:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:27:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:27:44 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 11:27:44 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:27:44 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:27:44 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:27:44 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:27:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:27:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:27:48 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:27:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43546944
Mon 20 Jan 2014 11:27:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:27:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43546944
Mon 20 Jan 2014 11:27:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:27:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:27:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:27:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:27:58 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:27:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:27:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:27:58 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:27:58 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:27:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:27:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:27:58 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:27:59 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:28:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:28:03 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:28:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:28:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:28:04 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:28:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 11:28:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:28:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:28:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:28:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:28:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:28:05 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 11:28:05 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 11:28:05 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:28:06 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:28:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575754
Mon 20 Jan 2014 11:28:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:28:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575754
Mon 20 Jan 2014 11:28:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:28:06 - job_xml_thread(): Done retrieving: data size 43575754
Mon 20 Jan 2014 11:28:06 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:28:06 - XML: Start document: iteration 19
Mon 20 Jan 2014 11:28:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:28:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:28:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:28:18 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:28:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:28:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:28:19 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:28:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:28:19 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:28:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:28:19 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:28:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:28:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:28:24 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 11:28:24 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:28:24 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:28:24 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:28:24 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:28:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:28:28 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:28:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:28:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:28:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:28:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:28:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:28:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:28:29 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:28:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556522
Mon 20 Jan 2014 11:28:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:28:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556522
Mon 20 Jan 2014 11:28:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:28:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:28:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:28:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:28:39 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:28:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:28:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:28:39 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:28:39 - job_xml_thread(): Done retrieving: data size 43556522
Mon 20 Jan 2014 11:28:39 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:28:39 - XML: Start document: iteration 20
Mon 20 Jan 2014 11:28:39 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:28:39 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:28:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:28:39 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:28:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:28:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:28:41 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:28:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:28:42 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:28:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 11:28:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 11:28:43 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:28:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8701 values 137169 bits 17146 bytes 
Mon 20 Jan 2014 11:28:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:28:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:28:47 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 11:28:47 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:28:47 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:28:47 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:28:47 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:28:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:28:50 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:28:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:28:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:28:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:28:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:28:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:28:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:28:52 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:28:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562965
Mon 20 Jan 2014 11:28:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:28:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562965
Mon 20 Jan 2014 11:28:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:28:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:28:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:29:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:29:00 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:29:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:29:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:29:02 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:29:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:29:02 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:29:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:29:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562965
Mon 20 Jan 2014 11:29:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:29:02 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:29:02 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:29:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:29:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:29:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:29:11 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:29:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:29:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:29:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:29:12 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:29:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:29:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:29:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:29:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:29:12 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:29:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 11:29:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:29:14 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:29:14 - job_xml_thread(): Done retrieving: data size 43520132
Mon 20 Jan 2014 11:29:14 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:29:14 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 11:29:14 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 11:29:14 - Housekeeping: done.
Mon 20 Jan 2014 11:29:14 - XML: Start document: iteration 0
Mon 20 Jan 2014 11:29:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43520132
Mon 20 Jan 2014 11:29:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:29:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:29:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:29:18 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:29:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:29:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43520132
Mon 20 Jan 2014 11:29:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:29:18 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:29:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:29:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:29:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:29:31 - XML: Processed 653006 elements - found 0 jobs
Mon 20 Jan 2014 11:29:31 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:29:32 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:29:32 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:29:32 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:29:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:29:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:29:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:29:35 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:29:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:29:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:29:36 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:29:36 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:29:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:29:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:29:36 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:29:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:29:37 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:29:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:29:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:29:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:29:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:29:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:29:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:29:38 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:29:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43011508
Mon 20 Jan 2014 11:29:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:29:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43011508
Mon 20 Jan 2014 11:29:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:29:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:29:43 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:29:43 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:29:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 11:29:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:29:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 11:29:43 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:29:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8853 values 139521 bits 17440 bytes 
Mon 20 Jan 2014 11:29:47 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:29:47 - job_xml_thread(): Done retrieving: data size 43011508
Mon 20 Jan 2014 11:29:47 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:29:47 - XML: Start document: iteration 1
Mon 20 Jan 2014 11:29:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:29:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:29:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:29:52 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:29:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:29:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:29:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:29:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:29:52 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:29:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:29:52 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:29:52 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:29:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:30:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:30:00 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:30:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:30:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:30:01 - XML: Processed 646098 elements - found 0 jobs
Mon 20 Jan 2014 11:30:01 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:30:01 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:30:01 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:30:01 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:30:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:30:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:30:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:30:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:30:03 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:30:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42897666
Mon 20 Jan 2014 11:30:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:30:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42897666
Mon 20 Jan 2014 11:30:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:30:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:30:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:30:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:30:14 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:30:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:30:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:30:14 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:30:14 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:30:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:30:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:30:14 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:30:16 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:30:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:30:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:30:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:30:17 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:30:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:30:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:30:17 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:30:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 11:30:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:30:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:30:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:30:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:30:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:30:19 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:30:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42981797
Mon 20 Jan 2014 11:30:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:30:19 - job_xml_thread(): Done retrieving: data size 42981797
Mon 20 Jan 2014 11:30:19 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:30:19 - XML: Start document: iteration 2
Mon 20 Jan 2014 11:30:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42981797
Mon 20 Jan 2014 11:30:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:30:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:30:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:30:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:30:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:30:35 - XML: Processed 645908 elements - found 0 jobs
Mon 20 Jan 2014 11:30:35 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:30:35 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:30:35 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:30:35 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:30:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:30:37 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:30:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:30:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:30:39 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:30:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:30:39 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:30:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:30:39 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:30:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:30:41 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:30:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:30:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:30:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:30:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:30:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:30:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:30:42 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:30:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43437738
Mon 20 Jan 2014 11:30:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:30:42 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 11:30:43 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:30:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43437738
Mon 20 Jan 2014 11:30:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:30:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:30:44 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:30:44 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:30:44 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 11:30:44 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:30:44 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 11:30:44 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 11:30:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:30:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 11:30:45 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:30:45 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:30:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 11:30:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8911 values 140509 bits 17563 bytes 
Mon 20 Jan 2014 11:30:51 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:30:51 - job_xml_thread(): Done retrieving: data size 43437738
Mon 20 Jan 2014 11:30:51 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:30:51 - XML: Start document: iteration 3
Mon 20 Jan 2014 11:30:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:30:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:30:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:30:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:31:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:31:00 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:31:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:31:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:31:02 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:31:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:31:02 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:31:02 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:31:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:31:02 - size of cluster 'LISA Cluster': 624 hosts 79479 metrics 832313 values 13132613 bits 1641576 bytes 
Mon 20 Jan 2014 11:31:06 - XML: Processed 651589 elements - found 0 jobs
Mon 20 Jan 2014 11:31:06 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:31:06 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:31:06 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:31:06 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:31:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:31:06 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:31:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:31:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:31:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:31:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:31:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:31:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:31:10 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:31:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584440
Mon 20 Jan 2014 11:31:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:31:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584440
Mon 20 Jan 2014 11:31:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:31:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:31:17 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:31:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:31:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:31:18 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:31:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:31:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584440
Mon 20 Jan 2014 11:31:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:31:18 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:31:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:31:21 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:31:21 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:31:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:31:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:31:25 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:31:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 11:31:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:31:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:31:27 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:31:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:31:30 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:31:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:31:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:31:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:31:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:31:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:31:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:31:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:31:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:31:33 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:31:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:31:33 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:31:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:31:33 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:31:33 - job_xml_thread(): Done retrieving: data size 43551076
Mon 20 Jan 2014 11:31:33 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:31:33 - XML: Start document: iteration 4
Mon 20 Jan 2014 11:31:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43551076
Mon 20 Jan 2014 11:31:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43551076
Mon 20 Jan 2014 11:31:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:31:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:31:44 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:31:44 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 11:31:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:31:46 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:31:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:31:46 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:31:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:31:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:31:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:31:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 11:31:47 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:31:47 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:31:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 11:31:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6128 values 96828 bits 12103 bytes 
Mon 20 Jan 2014 11:31:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:31:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:31:49 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:31:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:31:49 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:31:49 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:31:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:31:50 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 11:31:50 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:31:50 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:31:50 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:31:50 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:31:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:31:55 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:31:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:31:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:31:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:31:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:31:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:31:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:31:59 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:31:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571143
Mon 20 Jan 2014 11:31:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:31:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571143
Mon 20 Jan 2014 11:31:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:32:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:32:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:32:05 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:32:05 - job_xml_thread(): Done retrieving: data size 43571143
Mon 20 Jan 2014 11:32:05 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:32:05 - XML: Start document: iteration 5
Mon 20 Jan 2014 11:32:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:32:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:32:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:32:18 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:32:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:32:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:32:19 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:32:19 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:32:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:32:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:32:19 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:32:20 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 11:32:20 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:32:20 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:32:20 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:32:20 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:32:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:32:23 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:32:23 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:32:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 11:32:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:32:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:32:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:32:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:32:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:32:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:32:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:32:26 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:32:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43592549
Mon 20 Jan 2014 11:32:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:32:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43592549
Mon 20 Jan 2014 11:32:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:32:35 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:32:35 - job_xml_thread(): Done retrieving: data size 43592549
Mon 20 Jan 2014 11:32:35 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:32:35 - XML: Start document: iteration 6
Mon 20 Jan 2014 11:32:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:32:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:32:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:32:37 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:32:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:32:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:32:39 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:32:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:32:39 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:32:39 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:32:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:32:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:32:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:32:44 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 11:32:44 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:32:44 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:32:44 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:32:44 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:32:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:32:47 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:32:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:32:48 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:32:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 11:32:48 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:32:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 11:32:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5727 values 90560 bits 11320 bytes 
Mon 20 Jan 2014 11:32:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:32:48 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:32:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:32:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:32:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:32:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:32:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:32:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:32:52 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:32:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569015
Mon 20 Jan 2014 11:32:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:32:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569015
Mon 20 Jan 2014 11:32:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:32:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:32:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:33:00 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:33:00 - job_xml_thread(): Done retrieving: data size 43569015
Mon 20 Jan 2014 11:33:00 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:33:00 - XML: Start document: iteration 7
Mon 20 Jan 2014 11:33:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:33:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:33:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:33:11 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:33:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:33:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:33:12 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:33:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 11:33:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:33:12 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:33:12 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 11:33:12 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:33:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:33:12 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:33:12 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:33:12 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:33:12 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:33:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:33:12 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:33:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:33:16 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:33:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:33:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:33:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:33:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:33:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:33:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:33:19 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:33:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576396
Mon 20 Jan 2014 11:33:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:33:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576396
Mon 20 Jan 2014 11:33:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:33:27 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:33:27 - job_xml_thread(): Done retrieving: data size 43576396
Mon 20 Jan 2014 11:33:27 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:33:27 - XML: Start document: iteration 8
Mon 20 Jan 2014 11:33:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:33:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:33:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:33:28 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:33:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:33:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:33:29 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:33:29 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:33:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:33:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576396
Mon 20 Jan 2014 11:33:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:33:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:33:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:33:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:33:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:33:43 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:33:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:33:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:33:45 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:33:45 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:33:45 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 11:33:45 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:33:45 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:33:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:33:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:33:45 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:33:45 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:33:45 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:33:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:33:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:33:48 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:33:48 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:33:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:33:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:33:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:33:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:33:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:33:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:33:49 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:33:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:33:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 11:33:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 11:33:49 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:33:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5831 values 92124 bits 11515 bytes 
Mon 20 Jan 2014 11:33:52 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:33:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43590891
Mon 20 Jan 2014 11:33:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:33:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43590891
Mon 20 Jan 2014 11:33:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:34:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:34:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:34:01 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:34:01 - job_xml_thread(): Done retrieving: data size 43590891
Mon 20 Jan 2014 11:34:01 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:34:01 - XML: Start document: iteration 9
Mon 20 Jan 2014 11:34:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:34:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:34:04 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:34:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:34:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:34:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:34:06 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:34:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:34:06 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:34:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:34:06 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:34:14 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 11:34:14 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:34:14 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:34:14 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:34:14 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:34:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:34:15 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:34:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:34:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:34:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:34:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:34:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:34:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:34:17 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:34:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 11:34:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:34:19 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:34:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559646
Mon 20 Jan 2014 11:34:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:34:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559646
Mon 20 Jan 2014 11:34:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:34:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:34:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:34:29 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:34:29 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:34:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:34:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:34:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:34:31 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:34:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:34:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:34:31 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:34:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:34:31 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:34:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:34:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:34:35 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:34:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:34:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:34:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:34:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:34:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:34:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:34:42 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:34:42 - job_xml_thread(): Done retrieving: data size 43572599
Mon 20 Jan 2014 11:34:42 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:34:42 - XML: Start document: iteration 10
Mon 20 Jan 2014 11:34:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572599
Mon 20 Jan 2014 11:34:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:34:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572599
Mon 20 Jan 2014 11:34:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:34:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:34:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:34:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:34:49 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:34:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:34:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 11:34:50 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:34:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8366 values 131945 bits 16493 bytes 
Mon 20 Jan 2014 11:34:50 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:34:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 11:34:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:34:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:34:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:34:56 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:34:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:34:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:34:57 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:34:57 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:34:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:34:57 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:34:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:35:04 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 11:35:04 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:35:04 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:35:04 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:35:05 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:35:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:35:05 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:35:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:35:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:35:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:35:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:35:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:35:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:35:09 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:35:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584564
Mon 20 Jan 2014 11:35:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:35:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584564
Mon 20 Jan 2014 11:35:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:35:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:35:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:35:20 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:35:20 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:35:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:35:20 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:35:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:35:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:35:20 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:35:20 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:35:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:35:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:35:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:35:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:35:23 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:35:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 11:35:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:35:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:35:25 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:35:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:35:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:35:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:35:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:35:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:35:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:35:28 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:35:28 - job_xml_thread(): Done retrieving: data size 43509468
Mon 20 Jan 2014 11:35:28 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:35:28 - XML: Start document: iteration 11
Mon 20 Jan 2014 11:35:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43509468
Mon 20 Jan 2014 11:35:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:35:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43509468
Mon 20 Jan 2014 11:35:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:35:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:35:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:35:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:35:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:35:45 - XML: Processed 652592 elements - found 0 jobs
Mon 20 Jan 2014 11:35:45 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:35:45 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:35:45 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:35:45 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:35:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:35:49 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:35:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:35:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:35:49 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:35:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:35:49 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:35:49 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:35:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:35:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:35:50 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:35:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:35:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 11:35:51 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:35:51 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:35:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5797 values 91471 bits 11433 bytes 
Mon 20 Jan 2014 11:35:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 11:35:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:35:53 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:35:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:35:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:35:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:35:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:35:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:35:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:35:54 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 11:35:54 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 11:35:54 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:35:56 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:35:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 11:35:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:35:56 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:35:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42939037
Mon 20 Jan 2014 11:35:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:35:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42939037
Mon 20 Jan 2014 11:35:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:36:00 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:36:01 - job_xml_thread(): Done retrieving: data size 42939037
Mon 20 Jan 2014 11:36:01 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:36:01 - XML: Start document: iteration 12
Mon 20 Jan 2014 11:36:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:36:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:36:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:36:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:36:09 - XML: Processed 645212 elements - found 0 jobs
Mon 20 Jan 2014 11:36:09 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:36:09 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:36:09 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:36:09 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:36:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:36:14 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:36:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:36:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:36:14 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:36:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:36:14 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:36:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:36:14 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:36:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:36:16 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:36:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:36:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:36:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:36:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:36:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:36:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:36:18 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:36:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42998619
Mon 20 Jan 2014 11:36:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:36:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42998619
Mon 20 Jan 2014 11:36:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:36:24 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:36:24 - job_xml_thread(): Done retrieving: data size 42998619
Mon 20 Jan 2014 11:36:24 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:36:24 - XML: Start document: iteration 13
Mon 20 Jan 2014 11:36:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:36:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:36:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:36:31 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:36:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:36:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:36:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:36:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:36:33 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:36:33 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:36:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:36:33 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:36:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:36:36 - XML: Processed 645908 elements - found 0 jobs
Mon 20 Jan 2014 11:36:36 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:36:36 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:36:36 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:36:36 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:36:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:36:39 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:36:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:36:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:36:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:36:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:36:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:36:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:36:42 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:36:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43377302
Mon 20 Jan 2014 11:36:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:36:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43377302
Mon 20 Jan 2014 11:36:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:36:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:36:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:36:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:36:51 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:36:51 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:36:51 - job_xml_thread(): Done retrieving: data size 43377302
Mon 20 Jan 2014 11:36:51 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:36:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:36:51 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:36:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 11:36:51 - XML: Start document: iteration 14
Mon 20 Jan 2014 11:36:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 11:36:51 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:36:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148609 bits 18576 bytes 
Mon 20 Jan 2014 11:36:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:36:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:36:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:36:55 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:36:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:36:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:36:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:36:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:36:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:36:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:36:58 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:36:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:36:59 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:36:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:36:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:37:00 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:37:00 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:37:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:37:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:37:02 - XML: Processed 650744 elements - found 0 jobs
Mon 20 Jan 2014 11:37:02 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:37:02 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:37:02 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:37:02 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:37:04 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:37:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579472
Mon 20 Jan 2014 11:37:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:37:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579472
Mon 20 Jan 2014 11:37:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:37:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:37:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:37:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:37:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:37:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:37:17 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:37:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:37:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:37:17 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:37:17 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:37:17 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:37:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:37:17 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:37:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:37:20 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:37:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 11:37:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:37:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:37:21 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:37:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:37:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:37:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:37:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:37:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:37:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:37:22 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:37:22 - job_xml_thread(): Done retrieving: data size 43586471
Mon 20 Jan 2014 11:37:22 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:37:22 - XML: Start document: iteration 15
Mon 20 Jan 2014 11:37:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43586471
Mon 20 Jan 2014 11:37:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:37:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43586471
Mon 20 Jan 2014 11:37:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:37:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:37:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:37:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:37:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:37:39 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 11:37:39 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:37:39 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:37:39 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:37:40 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:37:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:37:40 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:37:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:37:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:37:41 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:37:41 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:37:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:37:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:37:41 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:37:44 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 11:37:44 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:37:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:37:45 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:37:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:37:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:37:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:37:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:37:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:37:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:37:45 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:37:45 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:37:45 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 11:37:45 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 11:37:45 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 11:37:46 - size of cluster 'LISA Cluster': 624 hosts 79486 metrics 773402 values 12214220 bits 1526777 bytes 
Mon 20 Jan 2014 11:37:49 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:37:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572386
Mon 20 Jan 2014 11:37:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:37:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572386
Mon 20 Jan 2014 11:37:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:37:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:37:52 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:37:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:37:55 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:37:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 11:37:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 11:37:55 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:37:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9043 values 142650 bits 17831 bytes 
Mon 20 Jan 2014 11:37:55 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:37:55 - job_xml_thread(): Done retrieving: data size 43572386
Mon 20 Jan 2014 11:37:55 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:37:55 - XML: Start document: iteration 16
Mon 20 Jan 2014 11:37:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:37:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:38:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:38:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:38:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:38:06 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:38:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:38:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:38:07 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:38:07 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:38:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:38:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:38:07 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:38:10 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 11:38:11 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:38:11 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:38:11 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:38:11 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:38:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:38:13 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:38:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:38:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:38:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:38:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:38:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:38:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:38:17 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:38:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568038
Mon 20 Jan 2014 11:38:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:38:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568038
Mon 20 Jan 2014 11:38:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:38:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:38:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:38:26 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:38:26 - job_xml_thread(): Done retrieving: data size 43568038
Mon 20 Jan 2014 11:38:26 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:38:26 - XML: Start document: iteration 17
Mon 20 Jan 2014 11:38:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:38:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:38:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:38:31 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:38:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:38:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:38:32 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:38:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:38:32 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:38:32 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:38:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:38:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:38:38 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:38:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:38:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:38:39 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 11:38:39 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:38:39 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:38:39 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:38:39 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:38:39 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:38:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 11:38:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:38:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:38:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:38:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:38:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:38:43 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:38:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578294
Mon 20 Jan 2014 11:38:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:38:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578294
Mon 20 Jan 2014 11:38:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:38:45 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:38:45 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 11:38:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:38:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:38:54 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:38:54 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:38:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:38:55 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:38:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:38:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:38:56 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:38:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 11:38:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:38:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 11:38:56 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:38:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5807 values 91550 bits 11443 bytes 
Mon 20 Jan 2014 11:38:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:38:56 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:38:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:38:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:38:57 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:38:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:38:57 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:38:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:38:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:38:58 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:38:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:38:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:38:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:38:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:38:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:38:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:39:02 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:39:02 - job_xml_thread(): Done retrieving: data size 43583595
Mon 20 Jan 2014 11:39:02 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:39:02 - XML: Start document: iteration 18
Mon 20 Jan 2014 11:39:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583595
Mon 20 Jan 2014 11:39:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:39:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583595
Mon 20 Jan 2014 11:39:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:39:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:39:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:39:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:39:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:39:17 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 11:39:17 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:39:17 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:39:17 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:39:17 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:39:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:39:20 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:39:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:39:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:39:21 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:39:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:39:21 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:39:21 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:39:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:39:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:39:27 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:39:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:39:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:39:27 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:39:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 11:39:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:39:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:39:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:39:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:39:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:39:30 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:39:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566296
Mon 20 Jan 2014 11:39:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:39:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566296
Mon 20 Jan 2014 11:39:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:39:32 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:39:33 - job_xml_thread(): Done retrieving: data size 43566296
Mon 20 Jan 2014 11:39:33 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:39:33 - XML: Start document: iteration 19
Mon 20 Jan 2014 11:39:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:39:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:39:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:39:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:39:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:39:45 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:39:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:39:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:39:46 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:39:46 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:39:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:39:46 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:39:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:39:52 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 11:39:52 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:39:52 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:39:52 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:39:52 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:39:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:39:54 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:39:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:39:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:39:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:39:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:39:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:39:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:39:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:39:56 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:39:56 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:39:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567829
Mon 20 Jan 2014 11:39:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:39:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:39:56 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:39:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 11:39:57 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:39:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567829
Mon 20 Jan 2014 11:39:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:39:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 11:39:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5687 values 89606 bits 11200 bytes 
Mon 20 Jan 2014 11:40:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:40:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:40:07 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:40:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:40:07 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:40:07 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:40:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:40:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:40:08 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:40:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:40:08 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:40:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:40:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:40:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:40:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:40:13 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:40:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:40:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:40:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:40:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:40:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:40:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:40:17 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:40:17 - job_xml_thread(): Done retrieving: data size 43561132
Mon 20 Jan 2014 11:40:17 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:40:17 - XML: Start document: iteration 20
Mon 20 Jan 2014 11:40:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561132
Mon 20 Jan 2014 11:40:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:40:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561132
Mon 20 Jan 2014 11:40:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:40:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:40:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:40:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:40:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:40:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:40:33 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:40:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:40:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:40:34 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:40:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:40:34 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:40:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:40:34 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:40:37 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 11:40:37 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:40:37 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:40:37 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:40:37 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:40:38 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:40:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 11:40:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:40:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:40:41 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:40:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:40:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:40:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:40:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:40:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:40:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:40:44 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:40:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558529
Mon 20 Jan 2014 11:40:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:40:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558529
Mon 20 Jan 2014 11:40:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:40:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:40:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:40:52 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:40:52 - job_xml_thread(): Done retrieving: data size 43558529
Mon 20 Jan 2014 11:40:52 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:40:52 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 11:40:53 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 11:40:53 - Housekeeping: done.
Mon 20 Jan 2014 11:40:53 - XML: Start document: iteration 0
Mon 20 Jan 2014 11:40:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:40:53 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:40:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:40:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:40:54 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:40:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:40:54 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:40:55 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:40:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:40:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:40:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:40:57 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:40:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:40:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:40:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 11:40:57 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:40:57 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:40:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 11:40:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5845 values 92172 bits 11521 bytes 
Mon 20 Jan 2014 11:41:06 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 11:41:06 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:41:06 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:41:06 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:41:06 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:41:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:41:08 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:41:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:41:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:41:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:41:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:41:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:41:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:41:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:41:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:41:11 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:41:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570766
Mon 20 Jan 2014 11:41:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:41:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570766
Mon 20 Jan 2014 11:41:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:41:21 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:41:21 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:41:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:41:22 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:41:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:41:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:41:22 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:41:22 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:41:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:41:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:41:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:41:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:41:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:41:28 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:41:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:41:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:41:28 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:41:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 11:41:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:41:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:41:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:41:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:41:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:41:30 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:41:30 - job_xml_thread(): Done retrieving: data size 43499028
Mon 20 Jan 2014 11:41:30 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:41:30 - XML: Start document: iteration 1
Mon 20 Jan 2014 11:41:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43499028
Mon 20 Jan 2014 11:41:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43499028
Mon 20 Jan 2014 11:41:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:41:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:41:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:41:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:41:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:41:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:41:46 - XML: Processed 652596 elements - found 0 jobs
Mon 20 Jan 2014 11:41:46 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:41:46 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:41:46 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:41:46 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:41:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:41:51 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:41:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:41:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:41:52 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:41:52 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:41:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:41:52 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:41:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:41:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:41:53 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:41:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:41:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:41:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:41:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:41:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:41:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:41:56 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:41:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42948338
Mon 20 Jan 2014 11:41:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:41:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42948338
Mon 20 Jan 2014 11:41:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:41:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:41:59 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:41:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:41:59 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:41:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 11:41:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 11:41:59 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:41:59 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8943 values 140979 bits 17622 bytes 
Mon 20 Jan 2014 11:42:01 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:42:01 - job_xml_thread(): Done retrieving: data size 42948338
Mon 20 Jan 2014 11:42:02 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:42:02 - XML: Start document: iteration 2
Mon 20 Jan 2014 11:42:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:42:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:42:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:42:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:42:13 - XML: Processed 645210 elements - found 0 jobs
Mon 20 Jan 2014 11:42:13 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:42:13 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:42:13 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:42:13 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:42:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:42:15 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:42:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:42:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:42:16 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:42:16 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:42:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:42:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:42:16 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:42:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:42:19 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:42:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:42:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:42:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:42:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:42:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:42:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:42:23 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:42:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42989535
Mon 20 Jan 2014 11:42:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:42:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42989535
Mon 20 Jan 2014 11:42:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:42:28 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:42:28 - job_xml_thread(): Done retrieving: data size 42989535
Mon 20 Jan 2014 11:42:28 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:42:28 - XML: Start document: iteration 3
Mon 20 Jan 2014 11:42:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:42:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:42:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:42:32 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:42:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:42:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:42:33 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:42:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:42:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42989535
Mon 20 Jan 2014 11:42:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:42:33 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:42:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:42:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:42:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:42:42 - XML: Processed 645908 elements - found 0 jobs
Mon 20 Jan 2014 11:42:42 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:42:43 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:42:43 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:42:43 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:42:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:42:46 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:42:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:42:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:42:50 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:42:50 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:42:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:42:50 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:42:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:42:51 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:42:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 11:42:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:42:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:42:52 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:42:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:42:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:42:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:42:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:42:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:42:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:42:54 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 11:42:54 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 11:42:54 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:42:54 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:42:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561011
Mon 20 Jan 2014 11:42:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:42:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561011
Mon 20 Jan 2014 11:42:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:42:58 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:42:58 - job_xml_thread(): Done retrieving: data size 43561011
Mon 20 Jan 2014 11:42:58 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:42:58 - XML: Start document: iteration 4
Mon 20 Jan 2014 11:42:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:42:59 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:42:59 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:42:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:42:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 11:42:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 11:42:59 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:43:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5835 values 92039 bits 11504 bytes 
Mon 20 Jan 2014 11:43:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:43:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:43:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:43:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:43:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:43:12 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:43:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:43:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:43:13 - XML: Processed 652840 elements - found 0 jobs
Mon 20 Jan 2014 11:43:13 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:43:13 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:43:13 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:43:13 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:43:13 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:43:13 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:43:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:43:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:43:13 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:43:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:43:18 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:43:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:43:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:43:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:43:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:43:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:43:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:43:21 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:43:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573453
Mon 20 Jan 2014 11:43:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:43:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573453
Mon 20 Jan 2014 11:43:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:43:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:43:28 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:43:29 - job_xml_thread(): Done retrieving: data size 43573453
Mon 20 Jan 2014 11:43:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:43:29 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:43:29 - XML: Start document: iteration 5
Mon 20 Jan 2014 11:43:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:43:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:43:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:43:39 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:43:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:43:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:43:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:43:40 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:43:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:43:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:43:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:43:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:43:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:43:41 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:43:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:43:42 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:43:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:43:42 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:43:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:43:43 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 11:43:43 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:43:43 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:43:43 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:43:43 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:43:43 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:43:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 11:43:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:43:45 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:43:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580865
Mon 20 Jan 2014 11:43:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:43:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580865
Mon 20 Jan 2014 11:43:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:43:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:43:53 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:43:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:43:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:43:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:43:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:43:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:43:58 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:43:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:43:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:43:58 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:43:58 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:43:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:43:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:43:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:43:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:43:58 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:43:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:43:58 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:43:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:43:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:43:59 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:44:00 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:44:00 - job_xml_thread(): Done retrieving: data size 43589578
Mon 20 Jan 2014 11:44:00 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:44:00 - XML: Start document: iteration 6
Mon 20 Jan 2014 11:44:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43589578
Mon 20 Jan 2014 11:44:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:44:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43589578
Mon 20 Jan 2014 11:44:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:44:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:44:00 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:44:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 11:44:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 11:44:01 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:44:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5851 values 92250 bits 11531 bytes 
Mon 20 Jan 2014 11:44:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:44:13 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:44:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:44:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:44:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:44:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:44:15 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:44:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:44:15 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:44:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:44:15 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:44:16 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 11:44:16 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:44:16 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:44:16 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:44:16 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:44:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:44:22 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:44:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:44:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:44:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:44:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:44:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:44:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:44:24 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:44:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582779
Mon 20 Jan 2014 11:44:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:44:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582779
Mon 20 Jan 2014 11:44:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:44:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:44:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:44:31 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:44:31 - job_xml_thread(): Done retrieving: data size 43582779
Mon 20 Jan 2014 11:44:31 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:44:31 - XML: Start document: iteration 7
Mon 20 Jan 2014 11:44:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:44:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:44:43 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 11:44:43 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:44:43 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:44:43 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:44:43 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:44:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:44:45 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 11:44:45 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:44:45 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:44:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:44:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:44:46 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:44:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:44:46 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:44:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:44:46 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:44:46 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:44:46 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 11:44:46 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:44:46 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 11:44:46 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 11:44:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:44:48 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:44:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:44:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:44:49 - size of cluster 'LISA Cluster': 624 hosts 79487 metrics 752299 values 11873347 bits 1484168 bytes 
Mon 20 Jan 2014 11:44:49 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:44:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 11:44:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:44:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:44:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:44:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:44:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:44:52 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:44:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43588872
Mon 20 Jan 2014 11:44:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:44:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43588872
Mon 20 Jan 2014 11:44:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:44:58 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:44:58 - job_xml_thread(): Done retrieving: data size 43588872
Mon 20 Jan 2014 11:44:58 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:44:58 - XML: Start document: iteration 8
Mon 20 Jan 2014 11:45:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:45:01 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:45:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:45:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:45:03 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:45:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 11:45:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:45:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 11:45:03 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:45:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5954 values 93917 bits 11739 bytes 
Mon 20 Jan 2014 11:45:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:45:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:45:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:45:07 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:45:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:45:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:45:09 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:45:09 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:45:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:45:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:45:10 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:45:10 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 11:45:10 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:45:10 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:45:10 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:45:10 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:45:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:45:14 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:45:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:45:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:45:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:45:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:45:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:45:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:45:18 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:45:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577685
Mon 20 Jan 2014 11:45:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:45:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577685
Mon 20 Jan 2014 11:45:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:45:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:45:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:45:24 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:45:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 11:45:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:45:25 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:45:25 - job_xml_thread(): Done retrieving: data size 43577685
Mon 20 Jan 2014 11:45:25 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:45:25 - XML: Start document: iteration 9
Mon 20 Jan 2014 11:45:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:45:27 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:45:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:45:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:45:29 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:45:29 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:45:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:45:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:45:29 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:45:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:45:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:45:37 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 11:45:37 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:45:37 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:45:37 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:45:37 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:45:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:45:39 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:45:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:45:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:45:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:45:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:45:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:45:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:45:42 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:45:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568613
Mon 20 Jan 2014 11:45:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:45:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568613
Mon 20 Jan 2014 11:45:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:45:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:45:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:45:47 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:45:47 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 11:45:52 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:45:52 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:45:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:45:54 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:45:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:45:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:45:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:45:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:45:55 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:45:55 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:45:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:45:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:45:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:45:58 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:45:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:45:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:46:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:46:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:46:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:46:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:46:02 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:46:02 - job_xml_thread(): Done retrieving: data size 43567857
Mon 20 Jan 2014 11:46:02 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:46:02 - XML: Start document: iteration 10
Mon 20 Jan 2014 11:46:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567857
Mon 20 Jan 2014 11:46:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:46:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567857
Mon 20 Jan 2014 11:46:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:46:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:46:03 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:46:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:46:04 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:46:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 11:46:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 11:46:04 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:46:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6828 values 107786 bits 13473 bytes 
Mon 20 Jan 2014 11:46:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:46:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:46:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:46:14 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:46:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:46:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:46:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:46:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:46:16 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:46:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:46:16 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:46:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:46:16 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:46:19 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 11:46:19 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:46:19 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:46:19 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:46:19 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:46:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:46:23 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:46:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:46:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:46:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:46:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:46:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:46:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:46:27 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:46:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565752
Mon 20 Jan 2014 11:46:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:46:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565752
Mon 20 Jan 2014 11:46:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:46:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:46:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:46:34 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:46:34 - job_xml_thread(): Done retrieving: data size 43565752
Mon 20 Jan 2014 11:46:34 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:46:34 - XML: Start document: iteration 11
Mon 20 Jan 2014 11:46:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:46:36 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:46:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:46:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:46:38 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:46:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:46:38 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:46:38 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:46:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:46:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:46:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:46:46 - XML: Processed 653351 elements - found 0 jobs
Mon 20 Jan 2014 11:46:46 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:46:46 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:46:46 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:46:46 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:46:48 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:46:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 11:46:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:46:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:46:50 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:46:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:46:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:46:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:46:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:46:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:46:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:46:53 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:46:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566735
Mon 20 Jan 2014 11:46:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:46:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:46:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:46:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566735
Mon 20 Jan 2014 11:46:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:47:01 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:47:02 - job_xml_thread(): Done retrieving: data size 43566735
Mon 20 Jan 2014 11:47:02 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:47:02 - XML: Start document: iteration 12
Mon 20 Jan 2014 11:47:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:47:04 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:47:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:47:05 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:47:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 11:47:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 11:47:06 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:47:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:47:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:47:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:47:09 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:47:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:47:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:47:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5907 values 93378 bits 11672 bytes 
Mon 20 Jan 2014 11:47:10 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:47:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:47:10 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:47:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:47:10 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:47:13 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 11:47:13 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:47:13 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:47:13 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:47:13 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:47:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:47:17 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:47:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:47:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:47:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:47:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:47:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:47:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:47:21 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:47:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43505575
Mon 20 Jan 2014 11:47:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:47:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43505575
Mon 20 Jan 2014 11:47:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:47:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:47:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:47:28 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:47:28 - job_xml_thread(): Done retrieving: data size 43505575
Mon 20 Jan 2014 11:47:28 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:47:28 - XML: Start document: iteration 13
Mon 20 Jan 2014 11:47:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:47:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:47:37 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:47:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 11:47:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:47:39 - XML: Processed 652608 elements - found 0 jobs
Mon 20 Jan 2014 11:47:39 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:47:39 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:47:39 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:47:39 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:47:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:47:40 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:47:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:47:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:47:41 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:47:41 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:47:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:47:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:47:42 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:47:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:47:44 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:47:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:47:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:47:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:47:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:47:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:47:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:47:47 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:47:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42963193
Mon 20 Jan 2014 11:47:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:47:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42963193
Mon 20 Jan 2014 11:47:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:47:55 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:47:55 - job_xml_thread(): Done retrieving: data size 42963193
Mon 20 Jan 2014 11:47:55 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:47:55 - XML: Start document: iteration 14
Mon 20 Jan 2014 11:47:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:47:55 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:47:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:47:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:47:57 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:47:57 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:47:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:47:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:47:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42963193
Mon 20 Jan 2014 11:47:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:48:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:48:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:48:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:48:05 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:48:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:48:06 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:48:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 11:48:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 11:48:06 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:48:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6142 values 97165 bits 12145 bytes 
Mon 20 Jan 2014 11:48:12 - XML: Processed 645668 elements - found 0 jobs
Mon 20 Jan 2014 11:48:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:48:12 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:48:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:48:13 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:48:13 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:48:13 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:48:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:48:14 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:48:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:48:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:48:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:48:15 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:48:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:48:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:48:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:48:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:48:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:48:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:48:15 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:48:15 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:48:15 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:48:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:48:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:48:18 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:48:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43000543
Mon 20 Jan 2014 11:48:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:48:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43000543
Mon 20 Jan 2014 11:48:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:48:28 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:48:28 - job_xml_thread(): Done retrieving: data size 43000543
Mon 20 Jan 2014 11:48:28 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:48:28 - XML: Start document: iteration 15
Mon 20 Jan 2014 11:48:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:48:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:48:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:48:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:48:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:48:32 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:48:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:48:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:48:34 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:48:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:48:34 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:48:34 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:48:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:48:39 - XML: Processed 645908 elements - found 0 jobs
Mon 20 Jan 2014 11:48:39 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:48:39 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:48:39 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:48:39 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:48:40 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:48:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 11:48:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:48:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:48:41 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:48:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:48:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:48:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:48:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:48:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:48:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:48:45 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:48:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43468496
Mon 20 Jan 2014 11:48:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:48:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43468496
Mon 20 Jan 2014 11:48:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:48:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:48:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:48:54 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:48:54 - job_xml_thread(): Done retrieving: data size 43468496
Mon 20 Jan 2014 11:48:54 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:48:54 - XML: Start document: iteration 16
Mon 20 Jan 2014 11:48:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:48:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:48:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:48:58 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:48:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:48:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:48:59 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:48:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:48:59 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:48:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:48:59 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:49:06 - XML: Processed 652428 elements - found 0 jobs
Mon 20 Jan 2014 11:49:06 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:49:06 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:49:06 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:49:06 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:49:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:49:06 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:49:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:49:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 11:49:07 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:49:07 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:49:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6006 values 94812 bits 11851 bytes 
Mon 20 Jan 2014 11:49:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 11:49:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:49:08 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:49:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:49:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:49:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:49:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:49:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:49:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:49:11 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:49:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43548576
Mon 20 Jan 2014 11:49:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:49:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43548576
Mon 20 Jan 2014 11:49:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:49:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:49:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:49:21 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:49:21 - job_xml_thread(): Done retrieving: data size 43548576
Mon 20 Jan 2014 11:49:21 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:49:21 - XML: Start document: iteration 17
Mon 20 Jan 2014 11:49:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:49:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:49:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:49:30 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:49:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:49:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:49:31 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:49:31 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:49:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:49:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:49:31 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:49:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:49:35 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:49:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:49:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:49:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:49:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:49:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:49:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:49:37 - XML: Processed 653340 elements - found 0 jobs
Mon 20 Jan 2014 11:49:37 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:49:37 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:49:37 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:49:37 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:49:37 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:49:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 11:49:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:49:38 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 11:49:38 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 11:49:38 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:49:39 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:49:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574108
Mon 20 Jan 2014 11:49:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:49:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574108
Mon 20 Jan 2014 11:49:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:49:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:49:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:49:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:49:49 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:49:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:49:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:49:50 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:49:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:49:50 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:49:50 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:49:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:49:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:49:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:49:52 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:49:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:49:53 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:49:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:49:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:49:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:49:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:49:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:49:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:49:54 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:49:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576293
Mon 20 Jan 2014 11:49:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:49:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576293
Mon 20 Jan 2014 11:49:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:49:56 - job_xml_thread(): Done retrieving: data size 43576293
Mon 20 Jan 2014 11:49:56 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:49:56 - XML: Start document: iteration 18
Mon 20 Jan 2014 11:50:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:50:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:50:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:50:06 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:50:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:50:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:50:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:50:07 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:50:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:50:08 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:50:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 11:50:08 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:50:08 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:50:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8949 values 141139 bits 17642 bytes 
Mon 20 Jan 2014 11:50:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 11:50:09 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:50:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:50:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:50:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:50:09 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:50:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:50:15 - XML: Processed 653351 elements - found 0 jobs
Mon 20 Jan 2014 11:50:15 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:50:15 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:50:15 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:50:15 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:50:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:50:17 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:50:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:50:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:50:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:50:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:50:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:50:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:50:19 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:50:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569463
Mon 20 Jan 2014 11:50:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:50:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569463
Mon 20 Jan 2014 11:50:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:50:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:50:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:50:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:50:29 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:50:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:50:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:50:30 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:50:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:50:30 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:50:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:50:30 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:50:31 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:50:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:50:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:50:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:50:34 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:50:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:50:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:50:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:50:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:50:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:50:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:50:34 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:50:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 11:50:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:50:35 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:50:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43594251
Mon 20 Jan 2014 11:50:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:50:36 - job_xml_thread(): Done retrieving: data size 43594251
Mon 20 Jan 2014 11:50:36 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:50:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43594251
Mon 20 Jan 2014 11:50:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:50:36 - XML: Start document: iteration 19
Mon 20 Jan 2014 11:50:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:50:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:50:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:50:48 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:50:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:50:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:50:48 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:50:48 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:50:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:50:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:50:48 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:50:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:50:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:50:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:50:56 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:50:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:50:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:50:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:50:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:50:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:50:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:50:58 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 11:50:58 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:50:58 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:50:58 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:50:58 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:51:00 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:51:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556179
Mon 20 Jan 2014 11:51:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:51:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556179
Mon 20 Jan 2014 11:51:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:51:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:51:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:51:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:51:09 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:51:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:51:10 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:51:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 11:51:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 11:51:10 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:51:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8833 values 139292 bits 17411 bytes 
Mon 20 Jan 2014 11:51:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:51:11 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:51:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:51:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:51:12 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:51:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:51:12 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:51:12 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:51:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:51:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:51:13 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:51:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:51:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:51:16 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:51:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:51:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:51:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:51:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:51:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:51:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:51:18 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:51:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43587990
Mon 20 Jan 2014 11:51:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:51:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43587990
Mon 20 Jan 2014 11:51:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:51:19 - job_xml_thread(): Done retrieving: data size 43587990
Mon 20 Jan 2014 11:51:19 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:51:20 - XML: Start document: iteration 20
Mon 20 Jan 2014 11:51:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:51:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:51:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:51:27 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:51:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:51:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:51:28 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:51:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:51:29 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:51:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:51:29 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:51:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:51:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:51:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:51:40 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:51:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:51:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:51:41 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 11:51:41 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:51:41 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:51:41 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:51:41 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:51:41 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:51:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 11:51:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:51:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:51:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:51:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:51:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:51:43 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:51:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43540838
Mon 20 Jan 2014 11:51:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:51:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:51:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43540838
Mon 20 Jan 2014 11:51:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:51:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:51:47 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 11:51:47 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:51:48 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:51:48 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:51:48 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 11:51:48 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 11:51:48 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 11:51:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:51:53 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:51:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:51:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:51:55 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:51:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:51:55 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:51:55 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:51:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Mon 20 Jan 2014 11:51:56 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:51:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:51:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:51:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:51:57 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:51:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:51:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:51:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:51:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:51:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:51:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:51:59 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:51:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578280
Mon 20 Jan 2014 11:51:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:51:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578280
Mon 20 Jan 2014 11:51:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:52:00 - job_xml_thread(): Done retrieving: data size 43578280
Mon 20 Jan 2014 11:52:00 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:52:01 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 11:52:02 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 11:52:02 - Housekeeping: done.
Mon 20 Jan 2014 11:52:02 - XML: Start document: iteration 0
Mon 20 Jan 2014 11:52:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:52:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:52:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:52:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:52:10 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:52:10 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:52:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:52:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:52:12 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:52:12 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:52:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:52:12 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:52:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:52:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:52:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 11:52:12 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:52:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8976 values 141584 bits 17698 bytes 
Mon 20 Jan 2014 11:52:13 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:52:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 11:52:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:52:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:52:20 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 11:52:20 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:52:20 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:52:20 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:52:20 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:52:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:52:22 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:52:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:52:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:52:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:52:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:52:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:52:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:52:24 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:52:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 11:52:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:52:24 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:52:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559822
Mon 20 Jan 2014 11:52:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:52:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559822
Mon 20 Jan 2014 11:52:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:52:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:52:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:52:35 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:52:35 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:52:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:52:36 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:52:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:52:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:52:37 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:52:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:52:37 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:52:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:52:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:52:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:52:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:52:39 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:52:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:52:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:52:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:52:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:52:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:52:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:52:41 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:52:41 - job_xml_thread(): Done retrieving: data size 43564210
Mon 20 Jan 2014 11:52:41 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:52:41 - XML: Start document: iteration 1
Mon 20 Jan 2014 11:52:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564210
Mon 20 Jan 2014 11:52:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:52:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564210
Mon 20 Jan 2014 11:52:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:52:49 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:52:49 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:52:49 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:52:49 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 11:52:49 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:52:49 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 11:52:50 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 11:52:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:52:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:52:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:52:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:53:00 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 11:53:00 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:53:01 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:53:01 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:53:01 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:53:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:53:02 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:53:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:53:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:53:03 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:53:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:53:03 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:53:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:53:03 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:53:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:53:06 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:53:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:53:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:53:06 - size of cluster 'LISA Cluster': 624 hosts 79487 metrics 869078 values 13722110 bits 1715263 bytes 
Mon 20 Jan 2014 11:53:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:53:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:53:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:53:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:53:09 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:53:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43517352
Mon 20 Jan 2014 11:53:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:53:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43517352
Mon 20 Jan 2014 11:53:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:53:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:53:13 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:53:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:53:15 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:53:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 11:53:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 11:53:15 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:53:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148614 bits 18576 bytes 
Mon 20 Jan 2014 11:53:16 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:53:16 - job_xml_thread(): Done retrieving: data size 43517352
Mon 20 Jan 2014 11:53:16 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:53:16 - XML: Start document: iteration 2
Mon 20 Jan 2014 11:53:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:53:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:53:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:53:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:53:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:53:25 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:53:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:53:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:53:27 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:53:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:53:27 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:53:27 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:53:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:53:28 - XML: Processed 652617 elements - found 0 jobs
Mon 20 Jan 2014 11:53:28 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:53:28 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:53:28 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:53:28 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:53:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:53:31 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:53:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:53:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:53:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:53:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:53:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:53:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:53:35 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:53:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43112445
Mon 20 Jan 2014 11:53:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:53:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43112445
Mon 20 Jan 2014 11:53:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:53:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:53:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:53:43 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:53:43 - job_xml_thread(): Done retrieving: data size 43112445
Mon 20 Jan 2014 11:53:43 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:53:43 - XML: Start document: iteration 3
Mon 20 Jan 2014 11:53:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:53:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:53:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:53:47 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:53:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:53:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:53:47 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:53:47 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:53:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:53:48 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:53:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:53:50 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:53:50 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 11:53:56 - XML: Processed 647530 elements - found 0 jobs
Mon 20 Jan 2014 11:53:56 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:53:56 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:53:56 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:53:56 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:53:59 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:53:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 11:53:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:53:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:53:59 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:53:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:53:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:53:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:53:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:53:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:53:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:54:02 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:54:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42894511
Mon 20 Jan 2014 11:54:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:54:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42894511
Mon 20 Jan 2014 11:54:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:54:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:54:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:54:11 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:54:11 - job_xml_thread(): Done retrieving: data size 42894511
Mon 20 Jan 2014 11:54:11 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:54:11 - XML: Start document: iteration 4
Mon 20 Jan 2014 11:54:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:54:13 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:54:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:54:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:54:14 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:54:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:54:14 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:54:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:54:14 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:54:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:54:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:54:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:54:15 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:54:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:54:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 11:54:16 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:54:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5952 values 93870 bits 11733 bytes 
Mon 20 Jan 2014 11:54:16 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:54:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 11:54:26 - XML: Processed 645302 elements - found 0 jobs
Mon 20 Jan 2014 11:54:26 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:54:26 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:54:26 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:54:26 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:54:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:54:26 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:54:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:54:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:54:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:54:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:54:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:54:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:54:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:54:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:54:30 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:54:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42956338
Mon 20 Jan 2014 11:54:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:54:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42956338
Mon 20 Jan 2014 11:54:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:54:41 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:54:41 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:54:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:54:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:54:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:54:44 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:54:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:54:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:54:45 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:54:45 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:54:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:54:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:54:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:54:47 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:54:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:54:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:54:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:54:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:54:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:54:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:54:47 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:54:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 11:54:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:54:51 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:54:51 - job_xml_thread(): Done retrieving: data size 43523162
Mon 20 Jan 2014 11:54:51 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:54:51 - XML: Start document: iteration 5
Mon 20 Jan 2014 11:54:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43523162
Mon 20 Jan 2014 11:54:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43523162
Mon 20 Jan 2014 11:54:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:54:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:55:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:55:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:55:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:55:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:55:09 - XML: Processed 652678 elements - found 0 jobs
Mon 20 Jan 2014 11:55:09 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:55:09 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:55:09 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:55:09 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:55:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:55:14 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:55:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:55:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:55:15 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:55:15 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:55:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:55:15 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:55:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:55:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:55:15 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:55:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:55:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:55:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:55:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:55:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:55:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:55:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:55:16 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:55:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:55:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 11:55:17 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:55:17 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:55:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 11:55:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5839 values 92036 bits 11504 bytes 
Mon 20 Jan 2014 11:55:19 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:55:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43591390
Mon 20 Jan 2014 11:55:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:55:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43591390
Mon 20 Jan 2014 11:55:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:55:24 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:55:24 - job_xml_thread(): Done retrieving: data size 43591390
Mon 20 Jan 2014 11:55:24 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:55:24 - XML: Start document: iteration 6
Mon 20 Jan 2014 11:55:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:55:30 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:55:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:55:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:55:30 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:55:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:55:30 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:55:30 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:55:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:55:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:55:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:55:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:55:41 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:55:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:55:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:55:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:55:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:55:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:55:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:55:43 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 11:55:43 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:55:43 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:55:43 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:55:43 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:55:44 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:55:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 11:55:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:55:44 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 11:55:44 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 11:55:44 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:55:45 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:55:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43536553
Mon 20 Jan 2014 11:55:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:55:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43536553
Mon 20 Jan 2014 11:55:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:55:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:55:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:55:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:55:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:55:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:55:57 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:55:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:55:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:55:58 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:55:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:55:58 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:55:58 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:55:58 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:55:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:55:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:55:59 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:56:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:56:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:56:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:56:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:56:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:56:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:56:02 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:56:02 - job_xml_thread(): Done retrieving: data size 43578653
Mon 20 Jan 2014 11:56:02 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:56:02 - XML: Start document: iteration 7
Mon 20 Jan 2014 11:56:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578653
Mon 20 Jan 2014 11:56:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:56:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578653
Mon 20 Jan 2014 11:56:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:56:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:56:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:56:15 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 11:56:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:56:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:56:16 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:56:16 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:56:16 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:56:17 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:56:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:56:17 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:56:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:56:19 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:56:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 11:56:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 11:56:19 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:56:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7832 values 123506 bits 15438 bytes 
Mon 20 Jan 2014 11:56:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:56:23 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:56:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:56:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:56:23 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:56:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:56:24 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:56:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:56:25 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:56:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:56:25 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:56:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:56:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:56:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:56:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:56:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:56:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:56:28 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:56:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577994
Mon 20 Jan 2014 11:56:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:56:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577994
Mon 20 Jan 2014 11:56:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:56:32 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:56:32 - job_xml_thread(): Done retrieving: data size 43577994
Mon 20 Jan 2014 11:56:33 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:56:33 - XML: Start document: iteration 8
Mon 20 Jan 2014 11:56:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:56:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:56:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:56:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:56:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:56:46 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:56:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:56:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:56:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:56:48 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:56:48 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:56:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:56:48 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:56:48 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:56:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:56:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:56:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:56:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:56:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:56:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:56:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:56:50 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 11:56:50 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:56:50 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:56:50 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:56:50 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:56:50 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:56:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 11:56:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:56:53 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:56:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43597011
Mon 20 Jan 2014 11:56:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:56:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43597011
Mon 20 Jan 2014 11:56:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:57:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:57:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:57:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:57:05 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:57:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:57:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:57:05 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:57:05 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:57:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:57:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:57:06 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:57:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:57:06 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:57:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:57:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:57:07 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:57:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:57:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:57:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:57:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:57:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:57:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:57:10 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:57:10 - job_xml_thread(): Done retrieving: data size 43588979
Mon 20 Jan 2014 11:57:10 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:57:10 - XML: Start document: iteration 9
Mon 20 Jan 2014 11:57:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43588979
Mon 20 Jan 2014 11:57:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43588979
Mon 20 Jan 2014 11:57:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:57:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:57:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:57:20 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:57:21 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:57:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 11:57:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:57:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 11:57:22 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:57:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:57:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:57:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9270 values 146210 bits 18276 bytes 
Mon 20 Jan 2014 11:57:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:57:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:57:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:57:24 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:57:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:57:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:57:25 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:57:26 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:57:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:57:26 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:57:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:57:31 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 11:57:31 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:57:31 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:57:31 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:57:31 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:57:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:57:34 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:57:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:57:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:57:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:57:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:57:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:57:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:57:36 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:57:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 11:57:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:57:37 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:57:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574991
Mon 20 Jan 2014 11:57:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:57:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574991
Mon 20 Jan 2014 11:57:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:57:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:57:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:57:46 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:57:46 - job_xml_thread(): Done retrieving: data size 43574991
Mon 20 Jan 2014 11:57:46 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:57:46 - XML: Start document: iteration 10
Mon 20 Jan 2014 11:57:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:57:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:57:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:57:51 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:57:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:57:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:57:52 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:57:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:57:52 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:57:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:57:52 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:57:58 - XML: Processed 653355 elements - found 0 jobs
Mon 20 Jan 2014 11:57:58 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:57:58 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:57:58 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:57:58 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:58:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:58:00 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:58:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:58:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:58:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:58:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:58:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:58:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:58:02 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:58:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562785
Mon 20 Jan 2014 11:58:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:58:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562785
Mon 20 Jan 2014 11:58:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:58:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:58:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:58:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:58:11 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:58:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:58:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:58:12 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:58:12 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:58:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:58:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:58:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562785
Mon 20 Jan 2014 11:58:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:58:13 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:58:13 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:58:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:58:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:58:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:58:21 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:58:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:58:22 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:58:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:58:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 11:58:22 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:58:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 11:58:22 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:58:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99050 bits 12381 bytes 
Mon 20 Jan 2014 11:58:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:58:24 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:58:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:58:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:58:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:58:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:58:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:58:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:58:26 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:58:26 - job_xml_thread(): Done retrieving: data size 43560749
Mon 20 Jan 2014 11:58:26 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:58:26 - XML: Start document: iteration 11
Mon 20 Jan 2014 11:58:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560749
Mon 20 Jan 2014 11:58:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:58:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:58:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:58:28 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:58:28 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:58:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:58:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:58:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560749
Mon 20 Jan 2014 11:58:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:58:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:58:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:58:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:58:42 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:58:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:58:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:58:44 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:58:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:58:44 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:58:44 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:58:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:58:46 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 11:58:46 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:58:46 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:58:46 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:58:46 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:58:47 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:58:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 11:58:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:58:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:58:48 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:58:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:58:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:58:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:58:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:58:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:58:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:58:51 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:58:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43592483
Mon 20 Jan 2014 11:58:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:58:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43592483
Mon 20 Jan 2014 11:58:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:58:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:58:59 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:58:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:58:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:59:01 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:59:01 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:59:01 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:59:01 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:59:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:59:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:59:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:59:04 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:59:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:59:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:59:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:59:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:59:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:59:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:59:06 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:59:06 - job_xml_thread(): Done retrieving: data size 43598323
Mon 20 Jan 2014 11:59:06 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:59:06 - XML: Start document: iteration 12
Mon 20 Jan 2014 11:59:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43598323
Mon 20 Jan 2014 11:59:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:59:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43598323
Mon 20 Jan 2014 11:59:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:59:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:59:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:59:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:59:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:59:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:59:22 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:59:23 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 11:59:23 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:59:23 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:59:23 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:59:23 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:59:23 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:59:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:59:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 11:59:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 11:59:23 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:59:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9257 values 145993 bits 18249 bytes 
Mon 20 Jan 2014 11:59:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:59:25 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:59:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:59:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:59:25 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:59:25 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:59:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:59:25 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:59:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:59:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:59:29 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:59:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:59:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:59:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:59:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:59:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:59:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:59:31 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:59:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43190449
Mon 20 Jan 2014 11:59:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:59:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43190449
Mon 20 Jan 2014 11:59:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:59:38 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 11:59:38 - job_xml_thread(): Done retrieving: data size 43190449
Mon 20 Jan 2014 11:59:38 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 11:59:38 - XML: Start document: iteration 13
Mon 20 Jan 2014 11:59:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:59:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:59:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 11:59:43 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 11:59:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 11:59:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:59:44 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:59:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 11:59:44 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 11:59:44 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 11:59:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 11:59:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 11:59:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 11:59:50 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 11:59:50 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:59:50 - XML: Processed 648764 elements - found 0 jobs
Mon 20 Jan 2014 11:59:50 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 11:59:50 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 11:59:50 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 11:59:50 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 11:59:51 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:59:51 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:59:51 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 11:59:51 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 11:59:51 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 11:59:54 - size of cluster 'LISA Cluster': 624 hosts 79482 metrics 853235 values 13463400 bits 1682925 bytes 
Mon 20 Jan 2014 11:59:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 11:59:56 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 11:59:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 11:59:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 11:59:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:59:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 11:59:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 11:59:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 11:59:56 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 11:59:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 11:59:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 11:59:59 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 11:59:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 11:59:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42907460
Mon 20 Jan 2014 11:59:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 11:59:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42907460
Mon 20 Jan 2014 11:59:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 11:59:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:00:05 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:00:05 - job_xml_thread(): Done retrieving: data size 42907460
Mon 20 Jan 2014 12:00:05 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:00:05 - XML: Start document: iteration 14
Mon 20 Jan 2014 12:00:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:00:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:00:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:00:13 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:00:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:00:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:00:14 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:00:14 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:00:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:00:14 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:00:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:00:17 - XML: Processed 645490 elements - found 0 jobs
Mon 20 Jan 2014 12:00:17 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:00:17 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:00:17 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:00:17 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:00:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:00:21 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:00:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:00:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:00:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:00:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:00:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:00:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:00:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:00:23 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:00:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:00:24 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:00:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 12:00:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 12:00:24 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:00:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5672 values 89352 bits 11169 bytes 
Mon 20 Jan 2014 12:00:25 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:00:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42972270
Mon 20 Jan 2014 12:00:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:00:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42972270
Mon 20 Jan 2014 12:00:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:00:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:00:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:00:32 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:00:32 - job_xml_thread(): Done retrieving: data size 42972270
Mon 20 Jan 2014 12:00:32 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:00:32 - XML: Start document: iteration 15
Mon 20 Jan 2014 12:00:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:00:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:00:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:00:39 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:00:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:00:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:00:39 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:00:39 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:00:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:00:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:00:39 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:00:44 - XML: Processed 645912 elements - found 0 jobs
Mon 20 Jan 2014 12:00:44 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:00:44 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:00:44 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:00:44 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:00:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:00:48 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:00:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:00:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:00:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:00:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:00:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:00:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:00:50 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:00:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 12:00:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:00:51 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:00:51 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 12:00:51 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:00:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43495398
Mon 20 Jan 2014 12:00:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:00:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43495398
Mon 20 Jan 2014 12:00:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:00:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:00:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:00:59 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:00:59 - job_xml_thread(): Done retrieving: data size 43495398
Mon 20 Jan 2014 12:00:59 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:00:59 - XML: Start document: iteration 16
Mon 20 Jan 2014 12:01:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:01:00 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:01:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:01:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:01:01 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:01:01 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:01:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:01:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43495398
Mon 20 Jan 2014 12:01:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:01:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:01:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:01:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:01:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:01:12 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:01:15 - XML: Processed 652578 elements - found 0 jobs
Mon 20 Jan 2014 12:01:15 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:01:15 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:01:15 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:01:15 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:01:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:01:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:01:16 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:01:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:01:16 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:01:16 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:01:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:01:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:01:21 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:01:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:01:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:01:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:01:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:01:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:01:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:01:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:01:24 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:01:25 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:01:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:01:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 12:01:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 12:01:25 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:01:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 3779 values 59566 bits 7445 bytes 
Mon 20 Jan 2014 12:01:27 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:01:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569207
Mon 20 Jan 2014 12:01:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:01:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569207
Mon 20 Jan 2014 12:01:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:01:30 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:01:30 - job_xml_thread(): Done retrieving: data size 43569207
Mon 20 Jan 2014 12:01:30 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:01:30 - XML: Start document: iteration 17
Mon 20 Jan 2014 12:01:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:01:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:01:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:01:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:01:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:01:42 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:01:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:01:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:01:43 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:01:43 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:01:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:01:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:01:43 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:01:44 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:01:44 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:01:44 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:01:44 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:01:44 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:01:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:01:48 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:01:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:01:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:01:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:01:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:01:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:01:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:01:50 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:01:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 12:01:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:01:52 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:01:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580444
Mon 20 Jan 2014 12:01:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:01:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580444
Mon 20 Jan 2014 12:01:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:01:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:01:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:01:59 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:01:59 - job_xml_thread(): Done retrieving: data size 43580444
Mon 20 Jan 2014 12:01:59 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:01:59 - XML: Start document: iteration 18
Mon 20 Jan 2014 12:02:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:02:01 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:02:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:02:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:02:01 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:02:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:02:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580444
Mon 20 Jan 2014 12:02:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:02:01 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:02:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:02:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:02:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:02:12 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:02:12 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:02:12 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:02:12 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:02:12 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:02:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:02:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:02:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:02:19 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:02:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:02:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:02:20 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:02:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:02:20 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:02:20 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:02:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:02:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:02:23 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:02:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:02:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:02:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:02:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:02:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:02:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:02:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:02:25 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:02:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:02:26 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:02:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 12:02:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 12:02:26 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:02:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 4294 values 67900 bits 8487 bytes 
Mon 20 Jan 2014 12:02:26 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:02:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583897
Mon 20 Jan 2014 12:02:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:02:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583897
Mon 20 Jan 2014 12:02:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:02:27 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:02:27 - job_xml_thread(): Done retrieving: data size 43583897
Mon 20 Jan 2014 12:02:27 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:02:27 - XML: Start document: iteration 19
Mon 20 Jan 2014 12:02:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:02:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:02:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:02:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:02:42 - XML: Processed 653353 elements - found 0 jobs
Mon 20 Jan 2014 12:02:42 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:02:42 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:02:42 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:02:42 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:02:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:02:46 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:02:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:02:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:02:47 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:02:47 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:02:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:02:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:02:47 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:02:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:02:51 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:02:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:02:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:02:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:02:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:02:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:02:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:02:54 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:02:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43591000
Mon 20 Jan 2014 12:02:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:02:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43591000
Mon 20 Jan 2014 12:02:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:02:58 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:02:58 - job_xml_thread(): Done retrieving: data size 43591000
Mon 20 Jan 2014 12:02:58 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:02:58 - XML: Start document: iteration 20
Mon 20 Jan 2014 12:03:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:03:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:03:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:03:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:03:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:03:12 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:03:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:03:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:03:13 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:03:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:03:13 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:03:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:03:13 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:03:17 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:03:17 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:03:17 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:03:17 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:03:17 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:03:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:03:18 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:03:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:03:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:03:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:03:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:03:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:03:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:03:18 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:03:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 12:03:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:03:22 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:03:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579982
Mon 20 Jan 2014 12:03:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:03:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579982
Mon 20 Jan 2014 12:03:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:03:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:03:26 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:03:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:03:26 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:03:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 12:03:26 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:03:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 12:03:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6149 values 97228 bits 12153 bytes 
Mon 20 Jan 2014 12:03:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:03:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:03:32 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:03:32 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:03:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:03:32 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:03:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:03:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:03:33 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:03:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:03:33 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:03:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:03:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:03:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:03:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:03:39 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:03:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:03:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:03:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:03:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:03:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:03:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:03:42 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:03:42 - job_xml_thread(): Done retrieving: data size 43562014
Mon 20 Jan 2014 12:03:42 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:03:42 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 12:03:43 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 12:03:43 - Housekeeping: done.
Mon 20 Jan 2014 12:03:43 - XML: Start document: iteration 0
Mon 20 Jan 2014 12:03:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562014
Mon 20 Jan 2014 12:03:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562014
Mon 20 Jan 2014 12:03:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:03:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:03:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:03:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:03:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:03:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:04:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:04:01 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:04:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:04:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:04:01 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:04:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:04:01 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:04:01 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:04:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:04:02 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:04:02 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:04:02 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:04:02 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:04:02 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:04:04 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:04:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 12:04:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:04:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:04:06 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:04:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:04:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:04:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:04:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:04:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:04:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:04:09 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 12:04:09 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 12:04:09 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:04:09 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:04:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581752
Mon 20 Jan 2014 12:04:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:04:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581752
Mon 20 Jan 2014 12:04:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:04:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:04:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:04:17 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:04:17 - job_xml_thread(): Done retrieving: data size 43581752
Mon 20 Jan 2014 12:04:17 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:04:17 - XML: Start document: iteration 1
Mon 20 Jan 2014 12:04:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:04:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:04:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:04:27 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:04:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:04:27 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:04:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 12:04:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 12:04:27 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:04:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5940 values 93710 bits 11713 bytes 
Mon 20 Jan 2014 12:04:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:04:27 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:04:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:04:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:04:28 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:04:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:04:28 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:04:28 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:04:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:04:32 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:04:32 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:04:32 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:04:32 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:04:32 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:04:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:04:33 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:04:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:04:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:04:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:04:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:04:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:04:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:04:35 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:04:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584917
Mon 20 Jan 2014 12:04:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:04:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584917
Mon 20 Jan 2014 12:04:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:04:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:04:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:04:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:04:45 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:04:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:04:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:04:45 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:04:45 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:04:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:04:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:04:45 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:04:47 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:04:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:04:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:04:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:04:49 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:04:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:04:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:04:49 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:04:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 12:04:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:04:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:04:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:04:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:04:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:04:51 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:04:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43598697
Mon 20 Jan 2014 12:04:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:04:51 - job_xml_thread(): Done retrieving: data size 43598697
Mon 20 Jan 2014 12:04:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43598697
Mon 20 Jan 2014 12:04:51 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:04:51 - XML: Start document: iteration 2
Mon 20 Jan 2014 12:04:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:05:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:05:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:05:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:05:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:05:10 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:05:10 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:05:10 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:05:10 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:05:11 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:05:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:05:13 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:05:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:05:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:05:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:05:14 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:05:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:05:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:05:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:05:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:05:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:05:14 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:05:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:05:14 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:05:14 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:05:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:05:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:05:16 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:05:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43525036
Mon 20 Jan 2014 12:05:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:05:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43525036
Mon 20 Jan 2014 12:05:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:05:26 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:05:26 - job_xml_thread(): Done retrieving: data size 43525036
Mon 20 Jan 2014 12:05:26 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:05:26 - XML: Start document: iteration 3
Mon 20 Jan 2014 12:05:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:05:27 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:05:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:05:27 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:05:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:05:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 12:05:28 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:05:28 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:05:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 12:05:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8750 values 137955 bits 17244 bytes 
Mon 20 Jan 2014 12:05:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:05:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:05:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:05:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:05:30 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:05:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:05:30 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:05:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:05:30 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:05:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:05:36 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:05:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:05:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:05:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:05:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:05:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:05:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:05:39 - XML: Processed 652608 elements - found 0 jobs
Mon 20 Jan 2014 12:05:39 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:05:39 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:05:39 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:05:39 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:05:41 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:05:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43028991
Mon 20 Jan 2014 12:05:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:05:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43028991
Mon 20 Jan 2014 12:05:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:05:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:05:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:05:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:05:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:05:54 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:05:54 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:05:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:05:55 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:05:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:05:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:05:56 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:05:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:05:56 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:05:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:05:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:05:57 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:05:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:05:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:05:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:05:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:05:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:05:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:05:58 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:05:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 12:05:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:05:59 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:05:59 - job_xml_thread(): Done retrieving: data size 42901105
Mon 20 Jan 2014 12:05:59 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:05:59 - XML: Start document: iteration 4
Mon 20 Jan 2014 12:06:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42901105
Mon 20 Jan 2014 12:06:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42901105
Mon 20 Jan 2014 12:06:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:06:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:06:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:06:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:06:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:06:12 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:06:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:06:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:06:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:06:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:06:13 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:06:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:06:13 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:06:13 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:06:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:06:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:06:22 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:06:22 - XML: Processed 645170 elements - found 0 jobs
Mon 20 Jan 2014 12:06:22 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:06:22 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:06:22 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:06:22 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:06:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:06:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:06:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:06:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:06:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:06:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:06:25 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:06:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42979793
Mon 20 Jan 2014 12:06:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:06:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42979793
Mon 20 Jan 2014 12:06:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:06:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:06:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:06:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:06:28 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:06:29 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:06:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:06:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 12:06:29 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:06:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 12:06:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8703 values 137260 bits 17157 bytes 
Mon 20 Jan 2014 12:06:37 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:06:37 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:06:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:06:38 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:06:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:06:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:06:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:06:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:06:39 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:06:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:06:39 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:06:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:06:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:06:40 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:06:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:06:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:06:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:06:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:06:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:06:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:06:42 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:06:42 - job_xml_thread(): Done retrieving: data size 43419200
Mon 20 Jan 2014 12:06:42 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:06:42 - XML: Start document: iteration 5
Mon 20 Jan 2014 12:06:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43419200
Mon 20 Jan 2014 12:06:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:06:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43419200
Mon 20 Jan 2014 12:06:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:06:51 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 12:06:51 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:06:52 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:06:52 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 12:06:52 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:06:52 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 12:06:52 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 12:06:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:06:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:06:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:06:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:06:57 - XML: Processed 651514 elements - found 0 jobs
Mon 20 Jan 2014 12:06:57 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:06:57 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:06:57 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:06:57 - job_xml_thread(): Sleeping.. (15s)
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Mon 20 Jan 2014 12:07:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:07:04 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:07:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:07:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:07:06 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:07:06 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:07:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:07:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:07:06 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:07:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:07:06 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:07:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:07:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:07:07 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:07:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 12:07:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:07:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:07:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:07:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:07:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:07:08 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:07:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43588787
Mon 20 Jan 2014 12:07:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:07:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43588787
Mon 20 Jan 2014 12:07:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:07:12 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:07:12 - job_xml_thread(): Done retrieving: data size 43588787
Mon 20 Jan 2014 12:07:12 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:07:12 - XML: Start document: iteration 6
Mon 20 Jan 2014 12:07:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:07:17 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:07:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:07:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:07:22 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:07:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:07:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:07:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:07:23 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:07:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:07:23 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:07:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:07:29 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:07:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:07:30 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:07:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:07:31 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:07:31 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:07:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 12:07:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 12:07:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:07:31 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:07:31 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:07:31 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:07:31 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:07:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:07:31 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:07:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5746 values 90590 bits 11323 bytes 
Mon 20 Jan 2014 12:07:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:07:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:07:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:07:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:07:33 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:07:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43551263
Mon 20 Jan 2014 12:07:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:07:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43551263
Mon 20 Jan 2014 12:07:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:07:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:07:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:07:46 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:07:46 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:07:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:07:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:07:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:07:46 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:07:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:07:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:07:47 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:07:47 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:07:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:07:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:07:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:07:50 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:07:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:07:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:07:50 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:07:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 12:07:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:07:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:07:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:07:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:07:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:07:52 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:07:52 - job_xml_thread(): Done retrieving: data size 43583945
Mon 20 Jan 2014 12:07:52 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:07:52 - XML: Start document: iteration 7
Mon 20 Jan 2014 12:07:52 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:07:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583945
Mon 20 Jan 2014 12:07:52 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:07:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:07:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583945
Mon 20 Jan 2014 12:07:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:07:55 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:07:55 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 12:07:55 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:07:55 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 12:07:56 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 12:08:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:08:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:08:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:08:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:08:06 - size of cluster 'LISA Cluster': 624 hosts 79466 metrics 866012 values 13683028 bits 1710378 bytes 
Mon 20 Jan 2014 12:08:10 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:08:10 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:08:10 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:08:10 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:08:10 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:08:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:08:10 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:08:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:08:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:08:11 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:08:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:08:11 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:08:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:08:11 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:08:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:08:16 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:08:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:08:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:08:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:08:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:08:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:08:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:08:19 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:08:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569309
Mon 20 Jan 2014 12:08:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:08:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569309
Mon 20 Jan 2014 12:08:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:08:26 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:08:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:08:26 - job_xml_thread(): Done retrieving: data size 43569309
Mon 20 Jan 2014 12:08:26 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:08:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:08:26 - XML: Start document: iteration 8
Mon 20 Jan 2014 12:08:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:08:31 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:08:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:08:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:08:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:08:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 12:08:32 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:08:32 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:08:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 12:08:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8854 values 139619 bits 17452 bytes 
Mon 20 Jan 2014 12:08:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:08:38 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:08:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:08:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:08:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:08:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:08:39 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:08:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:08:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:08:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:08:40 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:08:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:08:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:08:41 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:08:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:08:41 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:08:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:08:41 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:08:41 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:08:41 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:08:41 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:08:41 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:08:45 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:08:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565272
Mon 20 Jan 2014 12:08:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:08:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565272
Mon 20 Jan 2014 12:08:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:08:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:08:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:08:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:08:55 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:08:56 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:08:56 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 12:08:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:08:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:08:56 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:08:56 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:08:56 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:08:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:08:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:08:56 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:08:58 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:08:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 12:08:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:09:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:09:00 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:09:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:09:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:09:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:09:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:09:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:09:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:09:03 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:09:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564472
Mon 20 Jan 2014 12:09:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:09:03 - job_xml_thread(): Done retrieving: data size 43564472
Mon 20 Jan 2014 12:09:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564472
Mon 20 Jan 2014 12:09:04 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:09:04 - XML: Start document: iteration 9
Mon 20 Jan 2014 12:09:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:09:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:09:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:09:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:09:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:09:18 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:09:18 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:09:18 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:09:18 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:09:19 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:09:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:09:22 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:09:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:09:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:09:23 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:09:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:09:23 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:09:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:09:23 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:09:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:09:26 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:09:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:09:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:09:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:09:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:09:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:09:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:09:29 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:09:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555312
Mon 20 Jan 2014 12:09:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:09:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555312
Mon 20 Jan 2014 12:09:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:09:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:09:32 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:09:33 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:09:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 12:09:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:09:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 12:09:33 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:09:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9042 values 142584 bits 17823 bytes 
Mon 20 Jan 2014 12:09:34 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:09:34 - job_xml_thread(): Done retrieving: data size 43555312
Mon 20 Jan 2014 12:09:34 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:09:34 - XML: Start document: iteration 10
Mon 20 Jan 2014 12:09:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:09:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:09:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:09:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:09:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:09:48 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:09:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:09:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:09:48 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:09:48 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:09:48 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:09:48 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:09:48 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:09:49 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:09:49 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:09:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:09:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:09:49 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:09:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:09:54 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:09:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:09:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:09:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:09:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:09:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:09:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:09:57 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:09:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 12:09:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:09:58 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:09:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564460
Mon 20 Jan 2014 12:09:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:09:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564460
Mon 20 Jan 2014 12:09:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:10:04 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:10:04 - job_xml_thread(): Done retrieving: data size 43564460
Mon 20 Jan 2014 12:10:04 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:10:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:10:04 - XML: Start document: iteration 11
Mon 20 Jan 2014 12:10:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:10:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:10:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:10:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:10:12 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:10:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:10:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:10:13 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:10:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:10:13 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:10:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:10:13 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:10:20 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:10:20 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:10:20 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:10:20 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:10:20 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:10:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:10:22 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:10:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:10:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:10:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:10:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:10:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:10:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:10:26 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:10:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557890
Mon 20 Jan 2014 12:10:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:10:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557890
Mon 20 Jan 2014 12:10:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:10:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:10:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:10:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:10:34 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:10:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:10:34 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:10:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:10:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:10:35 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:10:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:10:35 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:10:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 12:10:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:10:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 12:10:35 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:10:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:10:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557890
Mon 20 Jan 2014 12:10:35 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:10:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:10:35 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:10:35 - job_xml_thread(): Done retrieving: data size 43557890
Mon 20 Jan 2014 12:10:35 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:10:35 - XML: Start document: iteration 12
Mon 20 Jan 2014 12:10:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99001 bits 12375 bytes 
Mon 20 Jan 2014 12:10:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:10:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:10:45 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:10:45 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:10:45 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:10:45 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:10:45 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:10:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:10:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:10:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:10:52 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:10:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:10:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:10:52 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:10:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:10:52 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:10:52 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:10:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:10:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:10:56 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:10:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:10:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:10:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:10:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:10:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:10:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:10:59 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:10:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 12:10:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:11:00 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:11:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555502
Mon 20 Jan 2014 12:11:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:11:00 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:11:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555502
Mon 20 Jan 2014 12:11:00 - job_xml_thread(): Done retrieving: data size 43555502
Mon 20 Jan 2014 12:11:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:11:01 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:11:01 - XML: Start document: iteration 13
Mon 20 Jan 2014 12:11:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:11:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:11:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:11:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:11:12 - XML: Processed 653356 elements - found 0 jobs
Mon 20 Jan 2014 12:11:12 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:11:12 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:11:12 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:11:12 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:11:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:11:21 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:11:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:11:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:11:22 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:11:22 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:11:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:11:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:11:22 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:11:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:11:23 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:11:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:11:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:11:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:11:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:11:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:11:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:11:27 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:11:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43515994
Mon 20 Jan 2014 12:11:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:11:27 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:11:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43515994
Mon 20 Jan 2014 12:11:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:11:27 - job_xml_thread(): Done retrieving: data size 43515994
Mon 20 Jan 2014 12:11:27 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:11:27 - XML: Start document: iteration 14
Mon 20 Jan 2014 12:11:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:11:35 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:11:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:11:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 12:11:35 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:11:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6298 values 99324 bits 12415 bytes 
Mon 20 Jan 2014 12:11:35 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:11:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 12:11:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:11:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:11:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:11:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:11:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:11:44 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:11:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:11:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:11:46 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:11:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:11:46 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:11:46 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:11:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:11:47 - XML: Processed 652596 elements - found 0 jobs
Mon 20 Jan 2014 12:11:47 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:11:47 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:11:47 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:11:47 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:11:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:11:51 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:11:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:11:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:11:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:11:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:11:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:11:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:11:53 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 12:11:53 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 12:11:53 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:11:55 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:11:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 12:11:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:11:55 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:11:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42924695
Mon 20 Jan 2014 12:11:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:11:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42924695
Mon 20 Jan 2014 12:11:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:12:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:12:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:12:02 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:12:02 - job_xml_thread(): Done retrieving: data size 42924695
Mon 20 Jan 2014 12:12:02 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:12:02 - XML: Start document: iteration 15
Mon 20 Jan 2014 12:12:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:12:06 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:12:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:12:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:12:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:12:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:12:09 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:12:09 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:12:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:12:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:12:10 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:12:12 - XML: Processed 645380 elements - found 0 jobs
Mon 20 Jan 2014 12:12:12 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:12:12 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:12:12 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:12:12 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:12:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:12:15 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:12:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:12:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:12:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:12:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:12:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:12:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:12:18 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:12:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42960054
Mon 20 Jan 2014 12:12:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:12:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42960054
Mon 20 Jan 2014 12:12:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:12:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:12:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:12:27 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:12:27 - job_xml_thread(): Done retrieving: data size 42960054
Mon 20 Jan 2014 12:12:27 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:12:27 - XML: Start document: iteration 16
Mon 20 Jan 2014 12:12:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:12:28 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:12:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:12:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:12:29 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:12:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:12:29 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:12:29 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:12:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:12:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:12:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:12:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:12:35 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:12:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:12:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:12:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:12:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:12:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:12:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:12:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:12:36 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:12:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:12:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 12:12:37 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:12:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 12:12:37 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:12:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99053 bits 12381 bytes 
Mon 20 Jan 2014 12:12:38 - XML: Processed 645908 elements - found 0 jobs
Mon 20 Jan 2014 12:12:38 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:12:38 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:12:38 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:12:38 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:12:41 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:12:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43352604
Mon 20 Jan 2014 12:12:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:12:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43352604
Mon 20 Jan 2014 12:12:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:12:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:12:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:12:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:12:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:12:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:12:51 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:12:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:12:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:12:52 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:12:52 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:12:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:12:52 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:12:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:12:53 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:12:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:12:56 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:12:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:12:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:12:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:12:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:12:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:12:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:12:56 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:12:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 12:12:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:12:58 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:12:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43528727
Mon 20 Jan 2014 12:12:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:12:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43528727
Mon 20 Jan 2014 12:12:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:12:59 - job_xml_thread(): Done retrieving: data size 43528727
Mon 20 Jan 2014 12:12:59 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:12:59 - XML: Start document: iteration 17
Mon 20 Jan 2014 12:13:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:13:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:13:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:13:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:13:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:13:15 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:13:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:13:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:13:15 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:13:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:13:15 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:13:15 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:13:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:13:19 - XML: Processed 652820 elements - found 0 jobs
Mon 20 Jan 2014 12:13:19 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:13:19 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:13:19 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:13:19 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:13:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:13:21 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:13:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:13:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:13:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:13:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:13:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:13:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:13:23 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:13:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563212
Mon 20 Jan 2014 12:13:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:13:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563212
Mon 20 Jan 2014 12:13:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:13:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:13:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:13:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:13:35 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:13:35 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:13:35 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:13:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:13:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:13:36 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:13:36 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:13:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:13:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:13:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:13:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:13:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:13:37 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:13:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:13:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:13:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:13:37 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:13:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:13:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:13:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:13:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:13:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:13:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 12:13:38 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:13:38 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:13:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8783 values 138490 bits 17311 bytes 
Mon 20 Jan 2014 12:13:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 12:13:39 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:13:39 - job_xml_thread(): Done retrieving: data size 43576534
Mon 20 Jan 2014 12:13:39 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:13:39 - XML: Start document: iteration 18
Mon 20 Jan 2014 12:13:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576534
Mon 20 Jan 2014 12:13:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:13:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576534
Mon 20 Jan 2014 12:13:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:13:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:13:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:13:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:13:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:13:55 - XML: Processed 653355 elements - found 0 jobs
Mon 20 Jan 2014 12:13:56 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:13:56 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:13:56 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:13:56 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:13:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:13:57 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:13:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:13:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:13:58 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:13:58 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:13:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:13:58 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:13:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:14:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:14:01 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:14:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:14:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:14:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:14:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:14:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:14:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:14:03 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:14:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 12:14:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:14:04 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:14:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566302
Mon 20 Jan 2014 12:14:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:14:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566302
Mon 20 Jan 2014 12:14:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:14:11 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:14:11 - job_xml_thread(): Done retrieving: data size 43566302
Mon 20 Jan 2014 12:14:11 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:14:11 - XML: Start document: iteration 19
Mon 20 Jan 2014 12:14:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:14:13 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:14:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:14:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:14:14 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:14:14 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:14:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:14:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:14:14 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:14:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:14:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:14:22 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:14:22 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:14:22 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:14:22 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:14:22 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:14:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:14:25 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:14:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:14:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:14:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:14:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:14:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:14:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:14:27 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:14:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561373
Mon 20 Jan 2014 12:14:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:14:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561373
Mon 20 Jan 2014 12:14:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:14:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:14:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:14:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:14:37 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:14:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:14:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:14:37 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:14:37 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:14:38 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:14:38 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:14:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:14:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:14:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:14:38 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:14:39 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:14:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:14:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 12:14:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 12:14:39 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:14:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7119 values 112182 bits 14022 bytes 
Mon 20 Jan 2014 12:14:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:14:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:14:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:14:41 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:14:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:14:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:14:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:14:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:14:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:14:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:14:44 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:14:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 12:14:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:14:44 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:14:44 - job_xml_thread(): Done retrieving: data size 43564154
Mon 20 Jan 2014 12:14:44 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:14:44 - XML: Start document: iteration 20
Mon 20 Jan 2014 12:14:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564154
Mon 20 Jan 2014 12:14:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:14:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564154
Mon 20 Jan 2014 12:14:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:14:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:14:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:14:56 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 12:14:56 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:14:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:14:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:14:59 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:14:59 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 12:14:59 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:14:59 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 12:14:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:14:59 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:14:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:14:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:14:59 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 12:15:00 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:15:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:15:00 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:15:00 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:15:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:15:06 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:15:06 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:15:06 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:15:06 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:15:06 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:15:07 - size of cluster 'LISA Cluster': 624 hosts 79477 metrics 822617 values 12979283 bits 1622410 bytes 
Mon 20 Jan 2014 12:15:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:15:09 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:15:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:15:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:15:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:15:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:15:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:15:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:15:12 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:15:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568174
Mon 20 Jan 2014 12:15:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:15:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568174
Mon 20 Jan 2014 12:15:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:15:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:15:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:15:21 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:15:21 - job_xml_thread(): Done retrieving: data size 43568174
Mon 20 Jan 2014 12:15:21 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:15:21 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 12:15:22 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 12:15:22 - Housekeeping: done.
Mon 20 Jan 2014 12:15:22 - XML: Start document: iteration 0
Mon 20 Jan 2014 12:15:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:15:22 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:15:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:15:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:15:23 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:15:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:15:23 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:15:23 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:15:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:15:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:15:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:15:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:15:35 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:15:35 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:15:35 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:15:35 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:15:35 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:15:35 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:15:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:15:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:15:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:15:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:15:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:15:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:15:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:15:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:15:39 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:15:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43551327
Mon 20 Jan 2014 12:15:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:15:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43551327
Mon 20 Jan 2014 12:15:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:15:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:15:40 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:15:40 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:15:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 12:15:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:15:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 12:15:40 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:15:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7896 values 124589 bits 15573 bytes 
Mon 20 Jan 2014 12:15:50 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:15:50 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:15:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:15:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:15:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:15:53 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:15:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:15:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:15:54 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:15:54 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:15:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:15:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:15:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:15:56 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:15:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:15:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:15:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:15:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:15:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:15:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:15:59 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:15:59 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 12:15:59 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:15:59 - job_xml_thread(): Done retrieving: data size 43561698
Mon 20 Jan 2014 12:15:59 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:15:59 - XML: Start document: iteration 1
Mon 20 Jan 2014 12:16:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561698
Mon 20 Jan 2014 12:16:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561698
Mon 20 Jan 2014 12:16:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:16:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:16:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:16:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:16:11 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:16:11 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:16:11 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:16:11 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:16:11 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:16:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:16:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:16:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:16:16 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:16:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:16:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:16:17 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:16:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:16:17 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:16:17 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:16:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:16:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:16:21 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:16:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:16:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:16:21 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:16:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 12:16:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:16:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:16:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:16:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:16:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:16:25 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:16:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578580
Mon 20 Jan 2014 12:16:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:16:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578580
Mon 20 Jan 2014 12:16:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:16:26 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:16:26 - job_xml_thread(): Done retrieving: data size 43578580
Mon 20 Jan 2014 12:16:26 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:16:26 - XML: Start document: iteration 2
Mon 20 Jan 2014 12:16:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:16:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:16:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:16:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:16:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:16:40 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:16:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:16:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:16:40 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:16:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:16:42 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:16:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:16:42 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:16:42 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:16:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:16:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 12:16:42 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:16:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 12:16:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:16:42 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:16:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5869 values 92694 bits 11586 bytes 
Mon 20 Jan 2014 12:16:45 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:16:45 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:16:45 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:16:45 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:16:45 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:16:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:16:48 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:16:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:16:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:16:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:16:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:16:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:16:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:16:52 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:16:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571073
Mon 20 Jan 2014 12:16:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:16:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571073
Mon 20 Jan 2014 12:16:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:16:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:16:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:17:00 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:17:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 12:17:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:17:00 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:17:00 - job_xml_thread(): Done retrieving: data size 43571073
Mon 20 Jan 2014 12:17:00 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:17:01 - XML: Start document: iteration 3
Mon 20 Jan 2014 12:17:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:17:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:17:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:17:04 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:17:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:17:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:17:05 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:17:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:17:05 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:17:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:17:05 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:17:12 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:17:12 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:17:12 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:17:12 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:17:12 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:17:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:17:15 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:17:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:17:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:17:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:17:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:17:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:17:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:17:18 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:17:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43478695
Mon 20 Jan 2014 12:17:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:17:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43478695
Mon 20 Jan 2014 12:17:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:17:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:17:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:17:27 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:17:27 - job_xml_thread(): Done retrieving: data size 43478695
Mon 20 Jan 2014 12:17:27 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:17:27 - XML: Start document: iteration 4
Mon 20 Jan 2014 12:17:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:17:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:17:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:17:39 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:17:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:17:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:17:40 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:17:40 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:17:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:17:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:17:40 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:17:40 - XML: Processed 652608 elements - found 0 jobs
Mon 20 Jan 2014 12:17:40 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:17:40 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:17:40 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:17:40 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:17:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:17:42 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:17:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:17:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:17:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:17:42 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:17:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:17:42 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:17:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 12:17:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:17:42 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:17:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:17:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 12:17:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:17:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:17:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6135 values 96995 bits 12124 bytes 
Mon 20 Jan 2014 12:17:45 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:17:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42976791
Mon 20 Jan 2014 12:17:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:17:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42976791
Mon 20 Jan 2014 12:17:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:17:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:17:54 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:17:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:17:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:17:55 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:17:55 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:17:56 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:17:56 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:17:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:17:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:17:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:17:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:18:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:18:00 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:18:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:18:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:18:01 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:18:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 12:18:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:18:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:18:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:18:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:18:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:18:04 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:18:04 - job_xml_thread(): Done retrieving: data size 42903676
Mon 20 Jan 2014 12:18:04 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:18:04 - XML: Start document: iteration 5
Mon 20 Jan 2014 12:18:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42903676
Mon 20 Jan 2014 12:18:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42903676
Mon 20 Jan 2014 12:18:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:18:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:18:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:18:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:18:15 - XML: Processed 645158 elements - found 0 jobs
Mon 20 Jan 2014 12:18:15 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:18:15 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:18:15 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:18:15 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:18:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:18:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:18:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:18:23 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:18:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:18:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:18:24 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:18:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:18:24 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:18:24 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:18:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:18:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:18:27 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:18:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:18:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:18:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:18:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:18:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:18:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:18:30 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:18:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43195361
Mon 20 Jan 2014 12:18:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:18:30 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:18:30 - job_xml_thread(): Done retrieving: data size 43195361
Mon 20 Jan 2014 12:18:30 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:18:30 - XML: Start document: iteration 6
Mon 20 Jan 2014 12:18:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43195361
Mon 20 Jan 2014 12:18:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:18:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:18:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:18:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:18:42 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:18:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:18:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:18:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:18:43 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:18:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 12:18:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 12:18:43 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:18:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8837 values 139704 bits 17463 bytes 
Mon 20 Jan 2014 12:18:45 - XML: Processed 648681 elements - found 0 jobs
Mon 20 Jan 2014 12:18:45 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:18:45 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:18:45 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:18:45 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:18:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:18:48 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:18:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:18:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:18:49 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:18:49 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:18:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:18:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:18:49 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:18:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:18:53 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:18:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:18:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:18:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:18:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:18:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:18:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:18:57 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:18:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43547064
Mon 20 Jan 2014 12:18:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:18:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43547064
Mon 20 Jan 2014 12:18:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:19:00 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:19:01 - job_xml_thread(): Done retrieving: data size 43547064
Mon 20 Jan 2014 12:19:01 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:19:01 - XML: Start document: iteration 7
Mon 20 Jan 2014 12:19:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:19:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:19:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:19:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:19:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:19:12 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:19:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:19:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:19:13 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:19:13 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:19:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:19:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:19:13 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:19:14 - XML: Processed 652978 elements - found 0 jobs
Mon 20 Jan 2014 12:19:14 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:19:14 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:19:14 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:19:14 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:19:17 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:19:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 12:19:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:19:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:19:19 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:19:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:19:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:19:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:19:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:19:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:19:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:19:22 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:19:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43547980
Mon 20 Jan 2014 12:19:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:19:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43547980
Mon 20 Jan 2014 12:19:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:19:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:19:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:19:30 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:19:31 - job_xml_thread(): Done retrieving: data size 43547980
Mon 20 Jan 2014 12:19:31 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:19:31 - XML: Start document: iteration 8
Mon 20 Jan 2014 12:19:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:19:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:19:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:19:35 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:19:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:19:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:19:36 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:19:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:19:36 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:19:36 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:19:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:19:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:19:43 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:19:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:19:43 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:19:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 12:19:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 12:19:43 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:19:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5803 values 91524 bits 11440 bytes 
Mon 20 Jan 2014 12:19:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:19:45 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:19:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:19:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:19:46 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:19:46 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:19:46 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:19:46 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:19:46 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:19:46 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 12:19:46 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 12:19:46 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:19:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:19:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:19:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:19:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:19:48 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:19:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43533242
Mon 20 Jan 2014 12:19:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:19:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43533242
Mon 20 Jan 2014 12:19:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:19:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:19:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:19:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:19:58 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:19:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:19:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:20:00 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:20:00 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:20:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:20:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:20:00 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:20:01 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:20:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:20:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:20:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:20:03 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:20:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:20:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:20:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:20:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:20:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:20:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:20:03 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:20:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 12:20:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:20:05 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:20:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567357
Mon 20 Jan 2014 12:20:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:20:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567357
Mon 20 Jan 2014 12:20:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:20:06 - job_xml_thread(): Done retrieving: data size 43567357
Mon 20 Jan 2014 12:20:06 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:20:06 - XML: Start document: iteration 9
Mon 20 Jan 2014 12:20:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:20:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:20:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:20:15 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:20:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:20:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:20:16 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:20:16 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:20:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:20:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:20:16 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:20:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:20:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:20:23 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:20:23 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:20:23 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:20:23 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:20:23 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:20:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:20:27 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:20:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:20:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:20:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:20:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:20:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:20:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:20:29 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:20:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558442
Mon 20 Jan 2014 12:20:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:20:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558442
Mon 20 Jan 2014 12:20:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:20:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:20:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:20:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:20:38 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:20:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:20:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:20:38 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:20:39 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:20:39 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:20:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:20:39 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:20:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:20:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:20:42 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:20:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:20:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:20:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:20:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:20:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:20:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:20:43 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:20:43 - job_xml_thread(): Done retrieving: data size 43590699
Mon 20 Jan 2014 12:20:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:20:43 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:20:43 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:20:43 - XML: Start document: iteration 10
Mon 20 Jan 2014 12:20:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43590699
Mon 20 Jan 2014 12:20:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:20:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43590699
Mon 20 Jan 2014 12:20:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:20:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:20:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 12:20:45 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:20:45 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:20:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 12:20:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8592 values 135437 bits 16929 bytes 
Mon 20 Jan 2014 12:20:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:20:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:20:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:20:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:21:00 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:21:00 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:21:00 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:21:00 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:21:00 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:21:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:21:04 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:21:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:21:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:21:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:21:05 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:21:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:21:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:21:05 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:21:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:21:05 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:21:05 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:21:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:21:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:21:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:21:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:21:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:21:07 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:21:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578043
Mon 20 Jan 2014 12:21:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:21:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578043
Mon 20 Jan 2014 12:21:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:21:16 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:21:16 - job_xml_thread(): Done retrieving: data size 43578043
Mon 20 Jan 2014 12:21:16 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:21:16 - XML: Start document: iteration 11
Mon 20 Jan 2014 12:21:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:21:17 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:21:18 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:21:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 12:21:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:21:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:21:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:21:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:21:21 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:21:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:21:21 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:21:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:21:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:21:21 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:21:25 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:21:25 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:21:25 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:21:25 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:21:25 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:21:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:21:28 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:21:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:21:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:21:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:21:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:21:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:21:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:21:30 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:21:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579172
Mon 20 Jan 2014 12:21:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:21:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579172
Mon 20 Jan 2014 12:21:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:21:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:21:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:21:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:21:40 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:21:40 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:21:40 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:21:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:21:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:21:41 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:21:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:21:41 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:21:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:21:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:21:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:21:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:21:43 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:21:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:21:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:21:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:21:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:21:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:21:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:21:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:21:45 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:21:45 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:21:45 - job_xml_thread(): Done retrieving: data size 43586167
Mon 20 Jan 2014 12:21:45 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:21:45 - XML: Start document: iteration 12
Mon 20 Jan 2014 12:21:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43586167
Mon 20 Jan 2014 12:21:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:21:46 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:21:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 12:21:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:21:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 12:21:46 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:21:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6161 values 97143 bits 12142 bytes 
Mon 20 Jan 2014 12:21:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43586167
Mon 20 Jan 2014 12:21:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:21:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:21:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:21:58 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:21:58 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:21:58 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:21:58 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:21:58 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:21:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:21:59 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 12:21:59 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:21:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:22:00 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:22:00 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 12:22:00 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:22:00 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 12:22:00 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 12:22:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:22:02 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:22:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:22:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:22:03 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:22:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:22:03 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:22:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:22:03 - XMLGatherer.retrieveData(): actually retrieving data..
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Mon 20 Jan 2014 12:22:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:22:09 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:22:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:22:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:22:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:22:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:22:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:22:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:22:11 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:22:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574525
Mon 20 Jan 2014 12:22:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:22:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574525
Mon 20 Jan 2014 12:22:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:22:13 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:22:13 - job_xml_thread(): Done retrieving: data size 43574525
Mon 20 Jan 2014 12:22:13 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:22:13 - XML: Start document: iteration 13
Mon 20 Jan 2014 12:22:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:22:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:22:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:22:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:22:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:22:24 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:22:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:22:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:22:26 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:22:26 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:22:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:22:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:22:26 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:22:27 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:22:27 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:22:27 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:22:27 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:22:27 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:22:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:22:32 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:22:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:22:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:22:32 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:22:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 12:22:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:22:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:22:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:22:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:22:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:22:34 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:22:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43550791
Mon 20 Jan 2014 12:22:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:22:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43550791
Mon 20 Jan 2014 12:22:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:22:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:22:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:22:42 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:22:42 - job_xml_thread(): Done retrieving: data size 43550791
Mon 20 Jan 2014 12:22:42 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:22:42 - XML: Start document: iteration 14
Mon 20 Jan 2014 12:22:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:22:46 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:22:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:22:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 12:22:48 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:22:48 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:22:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 12:22:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:22:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:22:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5808 values 91559 bits 11444 bytes 
Mon 20 Jan 2014 12:22:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:22:50 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:22:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:22:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:22:51 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:22:51 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:22:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:22:51 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:22:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:22:52 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:22:52 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:22:52 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:22:52 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:22:52 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:22:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:22:57 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:22:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:22:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:22:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:22:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:22:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:22:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:22:59 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:22:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584468
Mon 20 Jan 2014 12:22:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:23:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584468
Mon 20 Jan 2014 12:23:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:23:01 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:23:01 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:23:04 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:23:04 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 12:23:04 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 12:23:04 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:23:04 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 12:23:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:23:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:23:07 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:23:07 - job_xml_thread(): Done retrieving: data size 43584468
Mon 20 Jan 2014 12:23:07 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:23:07 - XML: Start document: iteration 15
Mon 20 Jan 2014 12:23:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:23:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:23:18 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:23:19 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:23:19 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:23:19 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:23:19 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:23:19 - size of cluster 'LISA Cluster': 624 hosts 79478 metrics 872892 values 13785585 bits 1723198 bytes 
Mon 20 Jan 2014 12:23:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:23:20 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:23:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:23:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:23:21 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:23:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:23:21 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:23:21 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:23:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:23:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:23:23 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:23:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:23:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:23:24 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:23:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 12:23:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:23:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:23:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:23:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:23:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:23:26 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:23:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43522850
Mon 20 Jan 2014 12:23:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:23:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43522850
Mon 20 Jan 2014 12:23:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:23:34 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:23:34 - job_xml_thread(): Done retrieving: data size 43522850
Mon 20 Jan 2014 12:23:34 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:23:34 - XML: Start document: iteration 16
Mon 20 Jan 2014 12:23:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:23:36 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:23:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:23:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:23:37 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:23:37 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:23:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:23:37 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:23:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:23:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:23:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:23:42 - XML: Processed 652596 elements - found 0 jobs
Mon 20 Jan 2014 12:23:42 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:23:42 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:23:42 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:23:42 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:23:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:23:45 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:23:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:23:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:23:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:23:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:23:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:23:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:23:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:23:48 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:23:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:23:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 12:23:48 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:23:48 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:23:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5814 values 91655 bits 11456 bytes 
Mon 20 Jan 2014 12:23:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 12:23:49 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:23:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42938374
Mon 20 Jan 2014 12:23:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:23:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42938374
Mon 20 Jan 2014 12:23:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:23:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:23:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:23:55 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:23:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:23:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:23:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:23:56 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:23:56 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:23:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:23:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:23:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42938374
Mon 20 Jan 2014 12:23:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:23:57 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:23:57 - job_xml_thread(): Done retrieving: data size 42938374
Mon 20 Jan 2014 12:23:57 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:23:57 - XML: Start document: iteration 17
Mon 20 Jan 2014 12:24:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:24:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:24:05 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:24:05 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 12:24:09 - XML: Processed 645864 elements - found 0 jobs
Mon 20 Jan 2014 12:24:09 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:24:09 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:24:09 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:24:09 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:24:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:24:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:24:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:24:14 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:24:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:24:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:24:15 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:24:15 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:24:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:24:15 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:24:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:24:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:24:18 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:24:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:24:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:24:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:24:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:24:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:24:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:24:22 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:24:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 12:24:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:24:23 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:24:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42965048
Mon 20 Jan 2014 12:24:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:24:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42965048
Mon 20 Jan 2014 12:24:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:24:24 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:24:25 - job_xml_thread(): Done retrieving: data size 42965048
Mon 20 Jan 2014 12:24:25 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:24:25 - XML: Start document: iteration 18
Mon 20 Jan 2014 12:24:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:24:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:24:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:24:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:24:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:24:34 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:24:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:24:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:24:36 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:24:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:24:36 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:24:36 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:24:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:24:43 - XML: Processed 645908 elements - found 0 jobs
Mon 20 Jan 2014 12:24:43 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:24:43 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:24:43 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:24:43 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:24:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:24:47 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:24:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:24:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:24:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:24:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:24:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:24:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:24:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:24:48 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:24:49 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:24:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 12:24:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:24:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 12:24:49 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:24:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 3544 values 55873 bits 6984 bytes 
Mon 20 Jan 2014 12:24:51 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:24:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43493391
Mon 20 Jan 2014 12:24:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:24:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:24:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:24:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43493391
Mon 20 Jan 2014 12:24:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:24:58 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:24:58 - job_xml_thread(): Done retrieving: data size 43493391
Mon 20 Jan 2014 12:24:58 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:24:59 - XML: Start document: iteration 19
Mon 20 Jan 2014 12:25:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:25:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:25:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:25:05 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:25:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:25:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:25:07 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:25:07 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:25:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:25:07 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:25:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:25:10 - XML: Processed 652860 elements - found 0 jobs
Mon 20 Jan 2014 12:25:10 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:25:10 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:25:10 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:25:10 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:25:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:25:14 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:25:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:25:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:25:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:25:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:25:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:25:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:25:16 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:25:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 12:25:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:25:17 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:25:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562685
Mon 20 Jan 2014 12:25:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:25:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562685
Mon 20 Jan 2014 12:25:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:25:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:25:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:25:25 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:25:25 - job_xml_thread(): Done retrieving: data size 43562685
Mon 20 Jan 2014 12:25:25 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:25:25 - XML: Start document: iteration 20
Mon 20 Jan 2014 12:25:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:25:29 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:25:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:25:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:25:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:25:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:25:30 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:25:30 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:25:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:25:30 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:25:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:25:36 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:25:36 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:25:36 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:25:36 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:25:36 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:25:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:25:40 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:25:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:25:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:25:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:25:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:25:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:25:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:25:43 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:25:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43551278
Mon 20 Jan 2014 12:25:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:25:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43551278
Mon 20 Jan 2014 12:25:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:25:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:25:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:25:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:25:49 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:25:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:25:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 12:25:50 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:25:50 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:25:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 12:25:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7391 values 116548 bits 14568 bytes 
Mon 20 Jan 2014 12:25:51 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:25:51 - job_xml_thread(): Done retrieving: data size 43551278
Mon 20 Jan 2014 12:25:51 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:25:51 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 12:25:51 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 12:25:51 - Housekeeping: done.
Mon 20 Jan 2014 12:25:51 - XML: Start document: iteration 0
Mon 20 Jan 2014 12:25:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:25:56 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:25:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:25:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:25:56 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:25:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:25:57 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:25:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:25:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:25:57 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:25:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:26:05 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:26:05 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:26:05 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:26:05 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:26:05 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:26:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:26:06 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:26:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:26:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:26:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:26:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:26:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:26:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:26:10 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:26:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43548538
Mon 20 Jan 2014 12:26:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:26:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43548538
Mon 20 Jan 2014 12:26:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:26:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:26:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:26:13 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 12:26:13 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 12:26:14 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:26:20 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:26:20 - job_xml_thread(): Done retrieving: data size 43548538
Mon 20 Jan 2014 12:26:20 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:26:20 - XML: Start document: iteration 1
Mon 20 Jan 2014 12:26:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:26:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:26:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:26:25 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:26:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:26:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:26:26 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:26:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:26:26 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:26:26 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:26:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:26:32 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:26:32 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:26:32 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:26:32 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:26:32 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:26:33 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:26:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 12:26:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:26:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:26:34 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:26:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:26:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:26:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:26:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:26:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:26:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:26:36 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:26:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43547140
Mon 20 Jan 2014 12:26:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:26:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43547140
Mon 20 Jan 2014 12:26:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:26:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:26:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:26:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:26:46 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:26:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:26:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:26:46 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:26:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:26:47 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:26:47 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:26:47 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:26:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:26:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:26:50 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:26:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:26:50 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:26:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:26:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:26:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:26:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:26:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:26:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:26:51 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:26:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:26:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 12:26:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 12:26:51 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:26:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5968 values 94141 bits 11767 bytes 
Mon 20 Jan 2014 12:26:52 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:26:52 - job_xml_thread(): Done retrieving: data size 43565647
Mon 20 Jan 2014 12:26:52 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:26:52 - XML: Start document: iteration 2
Mon 20 Jan 2014 12:26:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565647
Mon 20 Jan 2014 12:26:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565647
Mon 20 Jan 2014 12:26:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:26:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:27:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:27:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:27:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:27:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:27:09 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:27:09 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:27:09 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:27:09 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:27:09 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:27:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:27:11 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:27:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:27:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:27:11 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:27:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:27:11 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:27:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:27:11 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:27:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:27:16 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:27:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:27:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:27:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:27:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:27:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:27:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:27:17 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:27:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 12:27:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:27:18 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:27:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568774
Mon 20 Jan 2014 12:27:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:27:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568774
Mon 20 Jan 2014 12:27:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:27:25 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:27:25 - job_xml_thread(): Done retrieving: data size 43568774
Mon 20 Jan 2014 12:27:25 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:27:25 - XML: Start document: iteration 3
Mon 20 Jan 2014 12:27:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:27:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:27:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:27:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:27:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:27:34 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:27:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:27:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:27:35 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:27:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:27:35 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:27:35 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:27:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:27:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:27:38 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:27:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:27:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:27:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:27:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:27:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:27:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:27:40 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:27:40 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:27:40 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:27:40 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:27:40 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:27:42 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:27:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574898
Mon 20 Jan 2014 12:27:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:27:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574898
Mon 20 Jan 2014 12:27:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:27:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:27:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:27:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:27:51 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:27:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:27:52 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:27:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:27:52 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:27:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 12:27:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 12:27:52 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:27:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:27:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:27:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7882 values 124296 bits 15537 bytes 
Mon 20 Jan 2014 12:27:53 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:27:53 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:27:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:27:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:27:53 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:27:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:27:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:27:56 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:27:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:27:56 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:27:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:27:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:27:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:27:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:27:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:27:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:27:59 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:27:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43586569
Mon 20 Jan 2014 12:27:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:28:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43586569
Mon 20 Jan 2014 12:28:00 - job_xml_thread(): Done retrieving: data size 43586569
Mon 20 Jan 2014 12:28:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:28:00 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:28:00 - XML: Start document: iteration 4
Mon 20 Jan 2014 12:28:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:28:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:28:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:28:11 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:28:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:28:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:28:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:28:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:28:13 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:28:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:28:13 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:28:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:28:13 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:28:18 - XML: Processed 653356 elements - found 0 jobs
Mon 20 Jan 2014 12:28:18 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:28:18 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:28:18 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:28:18 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:28:19 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:28:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 12:28:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:28:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:28:21 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:28:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:28:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:28:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:28:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:28:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:28:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:28:23 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:28:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43548009
Mon 20 Jan 2014 12:28:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:28:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43548009
Mon 20 Jan 2014 12:28:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:28:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:28:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:28:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:28:31 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:28:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:28:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:28:33 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:28:33 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:28:33 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:28:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:28:33 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:28:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:28:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:28:36 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:28:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:28:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:28:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:28:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:28:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:28:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:28:38 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:28:38 - job_xml_thread(): Done retrieving: data size 43565628
Mon 20 Jan 2014 12:28:38 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:28:38 - XML: Start document: iteration 5
Mon 20 Jan 2014 12:28:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565628
Mon 20 Jan 2014 12:28:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:28:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565628
Mon 20 Jan 2014 12:28:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:28:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:28:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:28:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:28:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:28:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:28:52 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:28:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:28:54 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:28:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 12:28:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 12:28:54 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:28:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9169 values 144631 bits 18078 bytes 
Mon 20 Jan 2014 12:28:58 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:28:58 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:28:58 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:28:58 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:28:58 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:29:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:29:01 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:29:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:29:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:29:02 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:29:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:29:02 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:29:02 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:29:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:29:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:29:02 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:29:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:29:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:29:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:29:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:29:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:29:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:29:05 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:29:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571219
Mon 20 Jan 2014 12:29:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:29:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571219
Mon 20 Jan 2014 12:29:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:29:14 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:29:14 - job_xml_thread(): Done retrieving: data size 43571219
Mon 20 Jan 2014 12:29:14 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:29:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:29:15 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:29:15 - XML: Start document: iteration 6
Mon 20 Jan 2014 12:29:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:29:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:29:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:29:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:29:18 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:29:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:29:18 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:29:18 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:29:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:29:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:29:26 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:29:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:29:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:29:28 - XML: Processed 653332 elements - found 0 jobs
Mon 20 Jan 2014 12:29:28 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:29:28 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:29:28 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:29:28 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:29:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:29:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:29:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:29:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:29:28 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:29:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 12:29:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:29:29 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:29:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43494973
Mon 20 Jan 2014 12:29:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:29:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43494973
Mon 20 Jan 2014 12:29:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:29:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:29:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:29:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:29:40 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:29:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:29:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:29:41 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:29:41 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:29:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:29:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:29:42 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:29:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:29:43 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:29:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:29:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:29:44 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:29:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:29:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:29:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:29:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:29:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:29:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:29:46 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:29:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42988750
Mon 20 Jan 2014 12:29:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:29:46 - job_xml_thread(): Done retrieving: data size 42988750
Mon 20 Jan 2014 12:29:46 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:29:46 - XML: Start document: iteration 7
Mon 20 Jan 2014 12:29:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42988750
Mon 20 Jan 2014 12:29:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:29:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:29:54 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:29:56 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:29:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:29:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 12:29:56 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:29:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 12:29:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:29:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:29:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8802 values 138775 bits 17346 bytes 
Mon 20 Jan 2014 12:30:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:30:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:30:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:30:03 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:30:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:30:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:30:04 - XML: Processed 645850 elements - found 0 jobs
Mon 20 Jan 2014 12:30:04 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:30:04 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:30:04 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:30:04 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:30:04 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:30:04 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:30:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:30:04 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:30:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:30:05 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 12:30:05 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:30:06 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:30:06 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 12:30:06 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:30:06 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 12:30:06 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 12:30:10 - size of cluster 'LISA Cluster': 624 hosts 79482 metrics 915943 values 14456245 bits 1807030 bytes 
Mon 20 Jan 2014 12:30:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:30:11 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:30:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:30:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:30:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:30:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:30:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:30:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:30:15 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:30:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42913088
Mon 20 Jan 2014 12:30:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:30:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42913088
Mon 20 Jan 2014 12:30:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:30:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:30:19 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:30:20 - job_xml_thread(): Done retrieving: data size 42913088
Mon 20 Jan 2014 12:30:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:30:20 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:30:20 - XML: Start document: iteration 8
Mon 20 Jan 2014 12:30:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:30:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:30:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:30:31 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:30:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:30:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:30:32 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:30:32 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:30:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:30:32 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:30:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:30:33 - XML: Processed 645294 elements - found 0 jobs
Mon 20 Jan 2014 12:30:33 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:30:33 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:30:33 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:30:33 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:30:36 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:30:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 12:30:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:30:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:30:38 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:30:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:30:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:30:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:30:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:30:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:30:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:30:41 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:30:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43481971
Mon 20 Jan 2014 12:30:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:30:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43481971
Mon 20 Jan 2014 12:30:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:30:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:30:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:30:49 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:30:49 - job_xml_thread(): Done retrieving: data size 43481971
Mon 20 Jan 2014 12:30:49 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:30:49 - XML: Start document: iteration 9
Mon 20 Jan 2014 12:30:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:30:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:30:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:30:56 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:30:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:30:56 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:30:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:30:57 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:30:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:30:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 12:30:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:30:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 12:30:57 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:30:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5913 values 93281 bits 11660 bytes 
Mon 20 Jan 2014 12:30:58 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:30:58 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:30:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:30:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:30:58 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:31:03 - XML: Processed 652486 elements - found 0 jobs
Mon 20 Jan 2014 12:31:03 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:31:03 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:31:03 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:31:03 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:31:06 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:31:06 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 12:31:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:31:06 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:31:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:31:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:31:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:31:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:31:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:31:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:31:10 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:31:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43542111
Mon 20 Jan 2014 12:31:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:31:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43542111
Mon 20 Jan 2014 12:31:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:31:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:31:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:31:18 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:31:18 - job_xml_thread(): Done retrieving: data size 43542111
Mon 20 Jan 2014 12:31:18 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:31:18 - XML: Start document: iteration 10
Mon 20 Jan 2014 12:31:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:31:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:31:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:31:24 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:31:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:31:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:31:25 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:31:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:31:25 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:31:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:31:25 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:31:28 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:31:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 12:31:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:31:28 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:31:28 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:31:28 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:31:28 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:31:28 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:31:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:31:31 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:31:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:31:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:31:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:31:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:31:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:31:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:31:34 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:31:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574590
Mon 20 Jan 2014 12:31:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:31:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574590
Mon 20 Jan 2014 12:31:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:31:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:31:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:31:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:31:43 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:31:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:31:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:31:43 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:31:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:31:43 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:31:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:31:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574590
Mon 20 Jan 2014 12:31:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:31:43 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:31:43 - job_xml_thread(): Done retrieving: data size 43574590
Mon 20 Jan 2014 12:31:43 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:31:43 - XML: Start document: iteration 11
Mon 20 Jan 2014 12:31:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:31:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:31:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:31:57 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:31:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:31:57 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:31:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:31:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:31:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:31:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 12:31:58 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:31:59 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:31:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 12:31:59 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5723 values 90425 bits 11303 bytes 
Mon 20 Jan 2014 12:31:59 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:31:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:31:59 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:31:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:31:59 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:32:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:32:01 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:32:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:32:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:32:01 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:32:01 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:32:01 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:32:01 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:32:01 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:32:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:32:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:32:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:32:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:32:06 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:32:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574916
Mon 20 Jan 2014 12:32:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:32:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574916
Mon 20 Jan 2014 12:32:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:32:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:32:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:32:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:32:16 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:32:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:32:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:32:16 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:32:16 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:32:17 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:32:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:32:17 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:32:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:32:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:32:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:32:18 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:32:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 12:32:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:32:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:32:22 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:32:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:32:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:32:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:32:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:32:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:32:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:32:25 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:32:25 - job_xml_thread(): Done retrieving: data size 43552312
Mon 20 Jan 2014 12:32:25 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:32:25 - XML: Start document: iteration 12
Mon 20 Jan 2014 12:32:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43552312
Mon 20 Jan 2014 12:32:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:32:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43552312
Mon 20 Jan 2014 12:32:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:32:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:32:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:32:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:32:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:32:41 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:32:41 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:32:41 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:32:41 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:32:42 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:32:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:32:46 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:32:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:32:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:32:46 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:32:46 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:32:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:32:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:32:46 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:32:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:32:49 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:32:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:32:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:32:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:32:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:32:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:32:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:32:52 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:32:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579522
Mon 20 Jan 2014 12:32:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:32:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579522
Mon 20 Jan 2014 12:32:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:32:57 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:32:57 - job_xml_thread(): Done retrieving: data size 43579522
Mon 20 Jan 2014 12:32:57 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:32:57 - XML: Start document: iteration 13
Mon 20 Jan 2014 12:32:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:32:59 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:33:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:33:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 12:33:00 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:33:00 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:33:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 12:33:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9049 values 143114 bits 17889 bytes 
Mon 20 Jan 2014 12:33:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:33:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:33:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:33:04 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:33:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:33:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:33:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:33:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:33:05 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:33:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:33:05 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:33:05 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:33:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:33:12 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:33:12 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:33:12 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:33:12 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:33:12 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:33:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:33:14 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:33:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:33:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:33:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:33:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:33:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:33:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:33:19 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:33:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557463
Mon 20 Jan 2014 12:33:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:33:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557463
Mon 20 Jan 2014 12:33:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:33:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:33:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:33:27 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:33:27 - job_xml_thread(): Done retrieving: data size 43557463
Mon 20 Jan 2014 12:33:27 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:33:27 - XML: Start document: iteration 14
Mon 20 Jan 2014 12:33:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:33:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:33:33 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:33:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 12:33:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:33:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:33:33 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:33:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:33:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:33:34 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:33:34 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:33:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:33:34 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:33:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:33:41 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:33:41 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:33:41 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:33:41 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:33:41 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:33:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:33:42 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:33:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:33:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:33:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:33:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:33:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:33:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:33:46 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:33:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559599
Mon 20 Jan 2014 12:33:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:33:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559599
Mon 20 Jan 2014 12:33:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:33:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:33:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:33:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:33:55 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:33:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:33:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:33:56 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:33:56 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:33:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:33:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:33:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559599
Mon 20 Jan 2014 12:33:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:33:56 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:33:56 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:33:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:33:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:34:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:34:00 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:34:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:34:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 12:34:00 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:34:00 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:34:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 12:34:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6011 values 94957 bits 11869 bytes 
Mon 20 Jan 2014 12:34:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:34:09 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:34:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:34:09 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:34:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:34:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:34:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:34:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:34:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:34:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:34:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:34:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:34:11 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:34:11 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:34:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:34:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:34:12 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:34:12 - job_xml_thread(): Done retrieving: data size 43537700
Mon 20 Jan 2014 12:34:12 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:34:12 - XML: Start document: iteration 15
Mon 20 Jan 2014 12:34:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43537700
Mon 20 Jan 2014 12:34:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:34:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43537700
Mon 20 Jan 2014 12:34:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:34:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:34:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:34:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:34:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:34:27 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:34:27 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:34:27 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:34:27 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:34:27 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:34:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:34:35 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:34:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:34:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:34:35 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:34:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:34:35 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:34:35 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:34:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:34:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:34:36 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:34:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:34:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:34:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:34:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:34:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:34:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:34:37 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:34:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 12:34:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:34:40 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:34:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567428
Mon 20 Jan 2014 12:34:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:34:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567428
Mon 20 Jan 2014 12:34:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:34:42 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:34:42 - job_xml_thread(): Done retrieving: data size 43567428
Mon 20 Jan 2014 12:34:42 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:34:42 - XML: Start document: iteration 16
Mon 20 Jan 2014 12:34:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:34:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:34:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:34:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:35:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:35:01 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:35:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:35:01 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:35:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:35:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:35:02 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:35:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:35:02 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:35:02 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:35:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:35:02 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:35:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:35:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 12:35:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 12:35:02 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:35:02 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:35:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5614 values 88486 bits 11060 bytes 
Mon 20 Jan 2014 12:35:02 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:35:03 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:35:03 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:35:03 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:35:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:35:04 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:35:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:35:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:35:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:35:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:35:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:35:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:35:07 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 12:35:07 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 12:35:07 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:35:08 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:35:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566634
Mon 20 Jan 2014 12:35:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:35:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566634
Mon 20 Jan 2014 12:35:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:35:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:35:16 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:35:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:35:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:35:18 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:35:18 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:35:18 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:35:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:35:18 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:35:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:35:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:35:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:35:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:35:22 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:35:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:35:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:35:23 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:35:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 12:35:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:35:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:35:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:35:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:35:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:35:24 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:35:24 - job_xml_thread(): Done retrieving: data size 43487304
Mon 20 Jan 2014 12:35:24 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:35:24 - XML: Start document: iteration 17
Mon 20 Jan 2014 12:35:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43487304
Mon 20 Jan 2014 12:35:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:35:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43487304
Mon 20 Jan 2014 12:35:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:35:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:35:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:35:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:35:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:35:39 - XML: Processed 652604 elements - found 0 jobs
Mon 20 Jan 2014 12:35:39 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:35:39 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:35:39 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:35:39 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:35:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:35:44 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:35:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:35:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:35:44 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:35:44 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:35:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:35:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:35:44 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:35:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:35:47 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:35:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:35:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:35:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:35:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:35:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:35:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:35:49 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:35:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42951078
Mon 20 Jan 2014 12:35:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:35:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42951078
Mon 20 Jan 2014 12:35:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:35:55 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:35:55 - job_xml_thread(): Done retrieving: data size 42951078
Mon 20 Jan 2014 12:35:55 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:35:55 - XML: Start document: iteration 18
Mon 20 Jan 2014 12:36:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:36:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:36:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:36:02 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:36:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:36:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:36:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:36:02 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:36:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:36:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:36:03 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:36:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:36:03 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:36:03 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:36:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:36:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:36:03 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:36:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 12:36:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 12:36:03 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:36:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8876 values 139948 bits 17493 bytes 
Mon 20 Jan 2014 12:36:09 - XML: Processed 645506 elements - found 0 jobs
Mon 20 Jan 2014 12:36:09 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:36:09 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:36:09 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:36:09 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:36:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:36:11 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:36:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:36:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:36:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:36:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:36:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:36:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:36:14 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:36:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42946137
Mon 20 Jan 2014 12:36:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:36:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42946137
Mon 20 Jan 2014 12:36:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:36:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:36:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:36:24 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:36:24 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:36:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:36:27 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:36:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:36:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:36:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:36:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:36:28 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:36:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:36:28 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:36:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:36:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:36:28 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:36:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:36:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:36:28 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:36:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 12:36:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:36:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:36:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:36:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:36:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:36:30 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:36:30 - job_xml_thread(): Done retrieving: data size 42981874
Mon 20 Jan 2014 12:36:30 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:36:30 - XML: Start document: iteration 19
Mon 20 Jan 2014 12:36:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42981874
Mon 20 Jan 2014 12:36:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:36:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42981874
Mon 20 Jan 2014 12:36:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:36:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:36:43 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:36:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:36:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:36:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:36:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:36:45 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:36:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:36:45 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:36:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:36:45 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:36:47 - XML: Processed 645912 elements - found 0 jobs
Mon 20 Jan 2014 12:36:47 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:36:47 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:36:47 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:36:47 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:36:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:36:51 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:36:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:36:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:36:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:36:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:36:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:36:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:36:52 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:36:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43500525
Mon 20 Jan 2014 12:36:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:36:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43500525
Mon 20 Jan 2014 12:36:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:37:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:37:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:37:02 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:37:02 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:37:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:37:04 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:37:05 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:37:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:37:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 12:37:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 12:37:05 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:37:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8933 values 140940 bits 17617 bytes 
Mon 20 Jan 2014 12:37:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:37:05 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:37:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:37:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:37:06 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 12:37:06 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:37:06 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:37:06 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:37:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:37:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:37:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:37:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:37:07 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:37:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:37:07 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 12:37:07 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:37:07 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:37:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:37:07 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 12:37:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:37:07 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 12:37:08 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 787042 values 12434223 bits 1554277 bytes 
Mon 20 Jan 2014 12:37:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:37:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:37:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:37:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:37:12 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:37:12 - job_xml_thread(): Done retrieving: data size 43551906
Mon 20 Jan 2014 12:37:12 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:37:12 - XML: Start document: iteration 20
Mon 20 Jan 2014 12:37:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43551906
Mon 20 Jan 2014 12:37:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:37:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43551906
Mon 20 Jan 2014 12:37:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:37:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:37:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:37:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:37:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:37:23 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:37:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 12:37:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:37:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:37:24 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:37:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:37:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:37:25 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:37:25 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:37:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:37:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:37:25 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:37:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:37:35 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:37:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:37:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:37:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:37:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:37:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:37:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:37:36 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:37:36 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:37:36 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:37:36 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:37:36 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:37:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:37:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:37:40 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:37:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43538989
Mon 20 Jan 2014 12:37:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:37:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43538989
Mon 20 Jan 2014 12:37:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:37:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:37:49 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:37:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:37:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:37:51 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:37:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:37:51 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:37:51 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:37:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:37:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:37:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:37:52 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:37:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:37:54 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:37:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:37:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:37:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:37:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:37:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:37:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:37:57 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:37:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564631
Mon 20 Jan 2014 12:37:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564631
Mon 20 Jan 2014 12:37:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:37:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:37:58 - job_xml_thread(): Done retrieving: data size 43564631
Mon 20 Jan 2014 12:37:58 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:37:58 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 12:37:59 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 12:38:00 - Housekeeping: done.
Mon 20 Jan 2014 12:38:00 - XML: Start document: iteration 0
Mon 20 Jan 2014 12:38:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:38:05 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:38:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:38:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:38:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:38:07 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:38:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 12:38:07 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:38:07 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:38:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 12:38:08 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 12:38:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9317 values 146993 bits 18374 bytes 
Mon 20 Jan 2014 12:38:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:38:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:38:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:38:19 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:38:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:38:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:38:19 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:38:19 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:38:19 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:38:19 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:38:19 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:38:19 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:38:19 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:38:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:38:19 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:38:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:38:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:38:22 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:38:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:38:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:38:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:38:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:38:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:38:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:38:25 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:38:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561889
Mon 20 Jan 2014 12:38:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:38:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561889
Mon 20 Jan 2014 12:38:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:38:34 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:38:34 - job_xml_thread(): Done retrieving: data size 43561889
Mon 20 Jan 2014 12:38:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:38:34 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:38:34 - XML: Start document: iteration 1
Mon 20 Jan 2014 12:38:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:38:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:38:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:38:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:38:39 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:38:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:38:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:38:40 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:38:40 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:38:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:38:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:38:40 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:38:46 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:38:46 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:38:46 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:38:46 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:38:46 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:38:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:38:48 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:38:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:38:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:38:48 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:38:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 12:38:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:38:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:38:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:38:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:38:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:38:51 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:38:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570318
Mon 20 Jan 2014 12:38:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:38:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570318
Mon 20 Jan 2014 12:38:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:38:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:38:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:39:01 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:39:01 - job_xml_thread(): Done retrieving: data size 43570318
Mon 20 Jan 2014 12:39:01 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:39:01 - XML: Start document: iteration 2
Mon 20 Jan 2014 12:39:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:39:04 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:39:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:39:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:39:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:39:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:39:05 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:39:05 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:39:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:39:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:39:06 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:39:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:39:07 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:39:09 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:39:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 12:39:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:39:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 12:39:09 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:39:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5726 values 90290 bits 11286 bytes 
Mon 20 Jan 2014 12:39:13 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:39:13 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:39:13 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:39:13 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:39:13 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:39:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:39:14 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:39:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:39:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:39:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:39:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:39:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:39:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:39:18 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:39:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563394
Mon 20 Jan 2014 12:39:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:39:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563394
Mon 20 Jan 2014 12:39:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:39:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:39:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:39:28 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:39:28 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:39:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:39:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:39:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:39:29 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:39:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:39:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:39:30 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:39:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:39:30 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:39:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:39:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:39:33 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:39:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:39:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:39:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:39:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:39:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:39:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:39:33 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:39:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 12:39:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:39:36 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:39:36 - job_xml_thread(): Done retrieving: data size 43576636
Mon 20 Jan 2014 12:39:36 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:39:36 - XML: Start document: iteration 3
Mon 20 Jan 2014 12:39:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576636
Mon 20 Jan 2014 12:39:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:39:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576636
Mon 20 Jan 2014 12:39:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:39:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:39:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:39:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:39:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:39:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:39:53 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:39:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:39:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:39:54 - XML: Processed 653357 elements - found 0 jobs
Mon 20 Jan 2014 12:39:54 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:39:54 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:39:54 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:39:54 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:39:54 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:39:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:39:54 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:39:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:39:54 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:39:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:39:59 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:39:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:39:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:40:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:40:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:40:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:40:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:40:02 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:40:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577336
Mon 20 Jan 2014 12:40:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:40:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577336
Mon 20 Jan 2014 12:40:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:40:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:40:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:40:09 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:40:09 - job_xml_thread(): Done retrieving: data size 43577336
Mon 20 Jan 2014 12:40:09 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:40:09 - XML: Start document: iteration 4
Mon 20 Jan 2014 12:40:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:40:09 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:40:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:40:09 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:40:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:40:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:40:10 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:40:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:40:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577336
Mon 20 Jan 2014 12:40:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:40:10 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:40:10 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:40:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 12:40:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:40:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:40:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 12:40:11 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:40:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8915 values 140576 bits 17572 bytes 
Mon 20 Jan 2014 12:40:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:40:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:40:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:40:25 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:40:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:40:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:40:26 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:40:26 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:40:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:40:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:40:26 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:40:27 - XML: Processed 653355 elements - found 0 jobs
Mon 20 Jan 2014 12:40:27 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:40:27 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:40:27 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:40:27 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:40:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:40:32 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:40:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:40:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:40:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:40:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:40:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:40:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:40:36 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:40:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568002
Mon 20 Jan 2014 12:40:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:40:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568002
Mon 20 Jan 2014 12:40:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:40:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:40:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:40:42 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:40:42 - job_xml_thread(): Done retrieving: data size 43568002
Mon 20 Jan 2014 12:40:42 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:40:42 - XML: Start document: iteration 5
Mon 20 Jan 2014 12:40:43 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:40:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 12:40:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:40:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:40:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:40:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:40:50 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:40:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:40:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:40:52 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:40:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:40:52 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:40:52 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:40:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:40:55 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:40:55 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:40:55 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:40:55 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:40:55 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:40:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:40:58 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:40:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:40:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:40:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:40:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:40:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:40:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:41:01 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:41:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565499
Mon 20 Jan 2014 12:41:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:41:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565499
Mon 20 Jan 2014 12:41:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:41:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:41:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:41:10 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:41:10 - job_xml_thread(): Done retrieving: data size 43565499
Mon 20 Jan 2014 12:41:10 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:41:10 - XML: Start document: iteration 6
Mon 20 Jan 2014 12:41:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:41:10 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:41:12 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:41:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 12:41:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:41:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 12:41:13 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:41:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6200 values 97773 bits 12221 bytes 
Mon 20 Jan 2014 12:41:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:41:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:41:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:41:20 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:41:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:41:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:41:21 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:41:21 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:41:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:41:21 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:41:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:41:22 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:41:22 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:41:22 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:41:22 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:41:22 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:41:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:41:24 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:41:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:41:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:41:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:41:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:41:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:41:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:41:28 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:41:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43500213
Mon 20 Jan 2014 12:41:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:41:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43500213
Mon 20 Jan 2014 12:41:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:41:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:41:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:41:37 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:41:37 - job_xml_thread(): Done retrieving: data size 43500213
Mon 20 Jan 2014 12:41:37 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:41:37 - XML: Start document: iteration 7
Mon 20 Jan 2014 12:41:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:41:39 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:41:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:41:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:41:40 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:41:40 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:41:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:41:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:41:40 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:41:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:41:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:41:47 - XML: Processed 652598 elements - found 0 jobs
Mon 20 Jan 2014 12:41:47 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:41:47 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:41:47 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:41:47 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:41:50 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:41:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 12:41:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:41:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:41:51 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:41:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:41:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:41:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:41:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:41:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:41:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:41:54 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 12:41:54 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 12:41:54 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:41:54 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:41:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42953520
Mon 20 Jan 2014 12:41:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:41:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42953520
Mon 20 Jan 2014 12:41:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:41:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:41:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:42:02 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:42:02 - job_xml_thread(): Done retrieving: data size 42953520
Mon 20 Jan 2014 12:42:02 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:42:02 - XML: Start document: iteration 8
Mon 20 Jan 2014 12:42:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:42:06 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:42:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:42:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:42:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:42:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:42:08 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:42:08 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:42:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:42:08 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:42:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:42:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:42:12 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:42:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:42:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 12:42:15 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:42:15 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:42:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 12:42:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5822 values 91785 bits 11473 bytes 
Mon 20 Jan 2014 12:42:16 - XML: Processed 645946 elements - found 0 jobs
Mon 20 Jan 2014 12:42:16 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:42:16 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:42:16 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:42:16 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:42:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:42:17 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:42:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:42:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:42:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:42:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:42:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:42:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:42:20 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:42:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42954207
Mon 20 Jan 2014 12:42:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:42:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42954207
Mon 20 Jan 2014 12:42:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:42:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:42:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:42:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:42:30 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:42:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:42:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:42:31 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:42:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:42:31 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:42:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:42:31 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:42:31 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:42:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:42:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:42:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:42:34 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:42:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:42:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:42:34 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:42:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 12:42:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:42:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:42:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:42:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:42:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:42:37 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:42:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42988587
Mon 20 Jan 2014 12:42:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:42:37 - job_xml_thread(): Done retrieving: data size 42988587
Mon 20 Jan 2014 12:42:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42988587
Mon 20 Jan 2014 12:42:37 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:42:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:42:37 - XML: Start document: iteration 9
Mon 20 Jan 2014 12:42:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:42:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:42:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:42:49 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:42:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:42:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:42:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:42:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:42:52 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:42:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:42:52 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:42:52 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:42:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:42:58 - XML: Processed 645920 elements - found 0 jobs
Mon 20 Jan 2014 12:42:58 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:42:58 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:42:58 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:42:58 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:42:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:42:59 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:42:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:42:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:43:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:43:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:43:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:43:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:43:01 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:43:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560158
Mon 20 Jan 2014 12:43:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:43:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560158
Mon 20 Jan 2014 12:43:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:43:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:43:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:43:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:43:11 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:43:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:43:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:43:13 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:43:13 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:43:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:43:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:43:13 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:43:13 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:43:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:43:15 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:43:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:43:15 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:43:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:43:15 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:43:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 12:43:15 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:43:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 12:43:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9173 values 144702 bits 18087 bytes 
Mon 20 Jan 2014 12:43:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:43:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:43:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:43:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:43:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:43:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:43:17 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:43:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578731
Mon 20 Jan 2014 12:43:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:43:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578731
Mon 20 Jan 2014 12:43:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:43:18 - job_xml_thread(): Done retrieving: data size 43578731
Mon 20 Jan 2014 12:43:18 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:43:18 - XML: Start document: iteration 10
Mon 20 Jan 2014 12:43:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:43:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:43:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:43:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:43:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:43:33 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:43:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:43:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:43:34 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:43:34 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:43:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:43:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:43:35 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:43:36 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:43:36 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:43:36 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:43:36 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:43:36 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:43:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:43:40 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:43:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:43:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:43:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:43:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:43:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:43:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:43:41 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:43:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 12:43:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:43:43 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:43:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43551849
Mon 20 Jan 2014 12:43:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:43:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43551849
Mon 20 Jan 2014 12:43:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:43:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:43:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:43:51 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:43:51 - job_xml_thread(): Done retrieving: data size 43551849
Mon 20 Jan 2014 12:43:51 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:43:51 - XML: Start document: iteration 11
Mon 20 Jan 2014 12:43:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:43:54 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:43:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:43:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:43:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:43:56 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:43:56 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:43:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:43:56 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:43:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:43:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:44:05 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:44:05 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:44:05 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:44:05 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:44:05 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:44:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:44:06 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:44:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:44:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:44:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:44:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:44:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:44:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:44:08 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:44:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561810
Mon 20 Jan 2014 12:44:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:44:08 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 12:44:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561810
Mon 20 Jan 2014 12:44:08 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:44:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:44:10 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:44:10 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:44:10 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 12:44:11 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 12:44:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:44:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:44:11 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 12:44:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:44:15 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:44:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:44:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 12:44:18 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:44:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8680 values 136840 bits 17105 bytes 
Mon 20 Jan 2014 12:44:18 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:44:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 12:44:20 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:44:20 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:44:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:44:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:44:23 - size of cluster 'LISA Cluster': 624 hosts 79480 metrics 775422 values 12233294 bits 1529161 bytes 
Mon 20 Jan 2014 12:44:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:44:24 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:44:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:44:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:44:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:44:25 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:44:25 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:44:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:44:25 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:44:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:44:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:44:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:44:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:44:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:44:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:44:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:44:28 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:44:28 - job_xml_thread(): Done retrieving: data size 43558273
Mon 20 Jan 2014 12:44:28 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:44:28 - XML: Start document: iteration 12
Mon 20 Jan 2014 12:44:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558273
Mon 20 Jan 2014 12:44:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:44:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558273
Mon 20 Jan 2014 12:44:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:44:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:44:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:44:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:44:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:44:42 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:44:42 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:44:42 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:44:42 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:44:42 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:44:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:44:45 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:44:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:44:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:44:46 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:44:46 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:44:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:44:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:44:46 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:44:49 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:44:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 12:44:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:44:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:44:52 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:44:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:44:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:44:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:44:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:44:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:44:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:44:55 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:44:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580918
Mon 20 Jan 2014 12:44:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:44:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580918
Mon 20 Jan 2014 12:44:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:44:58 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:44:58 - job_xml_thread(): Done retrieving: data size 43580918
Mon 20 Jan 2014 12:44:58 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:44:58 - XML: Start document: iteration 13
Mon 20 Jan 2014 12:45:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:45:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:45:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:45:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:45:11 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:45:12 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 12:45:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:45:13 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:45:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:45:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:45:14 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:45:14 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:45:15 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:45:15 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:45:15 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:45:15 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:45:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:45:15 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:45:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:45:15 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:45:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:45:16 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:45:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:45:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:45:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:45:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:45:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:45:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:45:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:45:18 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:45:19 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:45:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 12:45:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:45:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 12:45:19 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:45:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5822 values 91776 bits 11472 bytes 
Mon 20 Jan 2014 12:45:20 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:45:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580412
Mon 20 Jan 2014 12:45:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:45:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580412
Mon 20 Jan 2014 12:45:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:45:30 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:45:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:45:30 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:45:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:45:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:45:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:45:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:45:34 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:45:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:45:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:45:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:45:35 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:45:35 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:45:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:45:35 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:45:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:45:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:45:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:45:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:45:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:45:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:45:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:45:37 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:45:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 12:45:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:45:38 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:45:38 - job_xml_thread(): Done retrieving: data size 43576294
Mon 20 Jan 2014 12:45:38 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:45:38 - XML: Start document: iteration 14
Mon 20 Jan 2014 12:45:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576294
Mon 20 Jan 2014 12:45:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:45:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576294
Mon 20 Jan 2014 12:45:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:45:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:45:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:45:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:45:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:45:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:45:53 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:45:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:45:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:45:53 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:45:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:45:53 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:45:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:45:54 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:45:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:45:59 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:46:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:46:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:46:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:46:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:46:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:46:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:46:01 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:46:01 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:46:01 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:46:01 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:46:01 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:46:04 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:46:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559624
Mon 20 Jan 2014 12:46:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:46:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559624
Mon 20 Jan 2014 12:46:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:46:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:46:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:46:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:46:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:46:16 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:46:16 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:46:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:46:16 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:46:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:46:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:46:17 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:46:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:46:17 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:46:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:46:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:46:19 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:46:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:46:19 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:46:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:46:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:46:19 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:46:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:46:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 12:46:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 12:46:20 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:46:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7005 values 110533 bits 13816 bytes 
Mon 20 Jan 2014 12:46:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:46:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:46:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:46:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:46:23 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:46:23 - job_xml_thread(): Done retrieving: data size 43576640
Mon 20 Jan 2014 12:46:23 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:46:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576640
Mon 20 Jan 2014 12:46:23 - XML: Start document: iteration 15
Mon 20 Jan 2014 12:46:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:46:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576640
Mon 20 Jan 2014 12:46:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:46:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:46:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:46:34 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:46:34 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:46:34 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:46:34 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:46:34 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:46:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:46:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:46:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:46:40 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:46:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:46:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:46:42 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:46:42 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:46:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:46:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:46:42 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:46:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:46:44 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:46:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:46:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:46:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:46:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:46:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:46:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:46:45 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:46:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 12:46:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:46:47 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:46:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574511
Mon 20 Jan 2014 12:46:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:46:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574511
Mon 20 Jan 2014 12:46:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:46:49 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:46:49 - job_xml_thread(): Done retrieving: data size 43574511
Mon 20 Jan 2014 12:46:49 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:46:49 - XML: Start document: iteration 16
Mon 20 Jan 2014 12:46:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:46:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:46:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:46:59 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:46:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:47:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:47:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:47:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:47:00 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:47:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:47:00 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:47:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:47:00 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:47:06 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:47:06 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:47:06 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:47:06 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:47:06 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:47:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:47:10 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:47:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:47:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:47:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:47:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:47:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:47:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:47:13 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:47:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43544436
Mon 20 Jan 2014 12:47:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:47:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43544436
Mon 20 Jan 2014 12:47:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:47:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:47:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:47:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:47:20 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:47:20 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:47:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:47:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 12:47:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 12:47:20 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:47:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8366 values 132290 bits 16536 bytes 
Mon 20 Jan 2014 12:47:21 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:47:21 - job_xml_thread(): Done retrieving: data size 43544436
Mon 20 Jan 2014 12:47:21 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:47:21 - XML: Start document: iteration 17
Mon 20 Jan 2014 12:47:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:47:25 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:47:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:47:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:47:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:47:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:47:26 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:47:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:47:26 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:47:26 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:47:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:47:35 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:47:35 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:47:35 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:47:35 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:47:35 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:47:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:47:36 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:47:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:47:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:47:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:47:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:47:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:47:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:47:40 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:47:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 12:47:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:47:40 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:47:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43117562
Mon 20 Jan 2014 12:47:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:47:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43117562
Mon 20 Jan 2014 12:47:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:47:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:47:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:47:50 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:47:50 - job_xml_thread(): Done retrieving: data size 43117562
Mon 20 Jan 2014 12:47:50 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:47:50 - XML: Start document: iteration 18
Mon 20 Jan 2014 12:47:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:47:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:47:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:47:56 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:47:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:47:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:47:57 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:47:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:47:57 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:47:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:47:57 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:48:03 - XML: Processed 647902 elements - found 0 jobs
Mon 20 Jan 2014 12:48:03 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:48:03 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:48:03 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:48:03 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:48:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:48:04 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:48:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:48:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:48:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:48:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:48:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:48:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:48:07 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:48:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42901532
Mon 20 Jan 2014 12:48:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:48:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42901532
Mon 20 Jan 2014 12:48:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:48:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:48:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:48:18 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:48:18 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:48:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:48:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:48:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:48:20 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:48:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:48:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 12:48:21 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:48:21 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:48:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 12:48:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99414 bits 12426 bytes 
Mon 20 Jan 2014 12:48:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:48:22 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:48:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:48:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:48:22 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:48:22 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:48:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:48:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:48:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:48:24 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:48:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:48:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:48:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:48:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:48:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:48:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:48:26 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 12:48:26 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 12:48:26 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:48:27 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:48:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 12:48:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:48:27 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:48:27 - job_xml_thread(): Done retrieving: data size 43073656
Mon 20 Jan 2014 12:48:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43073656
Mon 20 Jan 2014 12:48:27 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:48:27 - XML: Start document: iteration 19
Mon 20 Jan 2014 12:48:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:48:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43073656
Mon 20 Jan 2014 12:48:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:48:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:48:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:48:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:48:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:48:40 - XML: Processed 647388 elements - found 0 jobs
Mon 20 Jan 2014 12:48:40 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:48:40 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:48:40 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:48:40 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:48:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:48:48 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:48:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:48:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:48:49 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:48:49 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:48:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:48:49 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:48:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:48:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:48:50 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:48:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:48:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:48:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:48:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:48:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:48:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:48:52 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:48:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43521974
Mon 20 Jan 2014 12:48:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:48:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43521974
Mon 20 Jan 2014 12:48:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:48:56 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:48:56 - job_xml_thread(): Done retrieving: data size 43521974
Mon 20 Jan 2014 12:48:56 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:48:56 - XML: Start document: iteration 20
Mon 20 Jan 2014 12:49:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:49:04 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:49:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:49:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:49:05 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:49:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:49:05 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:49:05 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:49:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:49:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:49:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:49:12 - XML: Processed 652528 elements - found 0 jobs
Mon 20 Jan 2014 12:49:12 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:49:12 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:49:12 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:49:12 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:49:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:49:14 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:49:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:49:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:49:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:49:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:49:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:49:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:49:16 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:49:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43540424
Mon 20 Jan 2014 12:49:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:49:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43540424
Mon 20 Jan 2014 12:49:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:49:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:49:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:49:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:49:21 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:49:22 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:49:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:49:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 12:49:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 12:49:22 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:49:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148730 bits 18591 bytes 
Mon 20 Jan 2014 12:49:27 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:49:27 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:49:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:49:29 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:49:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:49:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:49:29 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:49:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:49:29 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:49:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:49:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:49:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:49:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:49:32 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:49:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:49:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:49:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:49:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:49:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:49:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:49:34 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:49:34 - job_xml_thread(): Done retrieving: data size 43563094
Mon 20 Jan 2014 12:49:34 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:49:34 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 12:49:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563094
Mon 20 Jan 2014 12:49:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:49:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563094
Mon 20 Jan 2014 12:49:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:49:35 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 12:49:35 - Housekeeping: done.
Mon 20 Jan 2014 12:49:35 - XML: Start document: iteration 0
Mon 20 Jan 2014 12:49:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:49:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:49:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:49:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:49:52 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:49:52 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:49:52 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:49:52 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:49:52 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:49:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:49:56 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:49:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:49:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:49:57 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:49:57 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:49:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:49:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:49:57 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:49:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:49:58 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:49:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:49:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:49:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:49:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:49:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:49:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:49:59 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:49:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 12:49:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:50:01 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:50:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569092
Mon 20 Jan 2014 12:50:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:50:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569092
Mon 20 Jan 2014 12:50:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:50:07 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:50:07 - job_xml_thread(): Done retrieving: data size 43569092
Mon 20 Jan 2014 12:50:07 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:50:07 - XML: Start document: iteration 1
Mon 20 Jan 2014 12:50:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:50:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:50:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:50:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:50:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:50:16 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:50:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:50:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:50:17 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:50:17 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:50:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:50:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:50:17 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:50:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:50:22 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:50:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:50:24 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:50:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 12:50:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 12:50:24 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:50:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:50:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5805 values 91584 bits 11448 bytes 
Mon 20 Jan 2014 12:50:24 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:50:25 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:50:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:50:25 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:50:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:50:25 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:50:25 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:50:25 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:50:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:50:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:50:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:50:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:50:27 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:50:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43546264
Mon 20 Jan 2014 12:50:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:50:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43546264
Mon 20 Jan 2014 12:50:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:50:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:50:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:50:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:50:36 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:50:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:50:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:50:38 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:50:38 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:50:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:50:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:50:38 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:50:40 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:50:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:50:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:50:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:50:41 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:50:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:50:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:50:41 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:50:41 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 12:50:41 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:50:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:50:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:50:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:50:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:50:43 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:50:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574882
Mon 20 Jan 2014 12:50:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:50:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574882
Mon 20 Jan 2014 12:50:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:50:44 - job_xml_thread(): Done retrieving: data size 43574882
Mon 20 Jan 2014 12:50:44 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:50:44 - XML: Start document: iteration 2
Mon 20 Jan 2014 12:50:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:50:53 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:50:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:50:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:50:55 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:50:55 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:50:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:50:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:50:55 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:50:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:50:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:51:00 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:51:00 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:51:00 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:51:00 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:51:00 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:51:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:51:04 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:51:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:51:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:51:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:51:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:51:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:51:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:51:06 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:51:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570539
Mon 20 Jan 2014 12:51:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:51:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570539
Mon 20 Jan 2014 12:51:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:51:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:51:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:51:13 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 12:51:13 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:51:14 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:51:14 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:51:14 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 12:51:14 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 12:51:14 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 12:51:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:51:14 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:51:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:51:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:51:15 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:51:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:51:15 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:51:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:51:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570539
Mon 20 Jan 2014 12:51:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:51:16 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:51:16 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:51:17 - size of cluster 'LISA Cluster': 624 hosts 79477 metrics 785744 values 12415915 bits 1551989 bytes 
Mon 20 Jan 2014 12:51:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:51:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:51:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:51:24 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:51:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:51:24 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:51:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:51:25 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:51:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 12:51:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 12:51:25 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:51:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9096 values 143541 bits 17942 bytes 
Mon 20 Jan 2014 12:51:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:51:28 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:51:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:51:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:51:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:51:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:51:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:51:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:51:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:51:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:51:31 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:51:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:51:31 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:51:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:51:31 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:51:31 - job_xml_thread(): Done retrieving: data size 43547842
Mon 20 Jan 2014 12:51:31 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:51:31 - XML: Start document: iteration 3
Mon 20 Jan 2014 12:51:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43547842
Mon 20 Jan 2014 12:51:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:51:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43547842
Mon 20 Jan 2014 12:51:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:51:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:51:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:51:45 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:51:45 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:51:45 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:51:45 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:51:45 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:51:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:51:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:51:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:51:50 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:51:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:51:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:51:51 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:51:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:51:51 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:51:51 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:51:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:51:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:51:55 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:51:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:51:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:51:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:51:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:51:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:51:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:51:56 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:51:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 12:51:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:51:59 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:51:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568071
Mon 20 Jan 2014 12:51:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:52:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568071
Mon 20 Jan 2014 12:52:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:52:00 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:52:01 - job_xml_thread(): Done retrieving: data size 43568071
Mon 20 Jan 2014 12:52:01 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:52:01 - XML: Start document: iteration 4
Mon 20 Jan 2014 12:52:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:52:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:52:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:52:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:52:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:52:12 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:52:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:52:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:52:13 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:52:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:52:13 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:52:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:52:13 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:52:14 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:52:15 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 12:52:20 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:52:20 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:52:20 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:52:20 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:52:20 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:52:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:52:23 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:52:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:52:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:52:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:52:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:52:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:52:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:52:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:52:25 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:52:26 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:52:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43545845
Mon 20 Jan 2014 12:52:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:52:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43545845
Mon 20 Jan 2014 12:52:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:52:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:52:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 12:52:26 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:52:26 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:52:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 12:52:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5673 values 89458 bits 11182 bytes 
Mon 20 Jan 2014 12:52:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:52:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:52:35 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:52:35 - job_xml_thread(): Done retrieving: data size 43545845
Mon 20 Jan 2014 12:52:35 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:52:35 - XML: Start document: iteration 5
Mon 20 Jan 2014 12:52:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:52:36 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:52:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:52:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:52:37 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:52:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:52:37 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:52:37 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:52:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:52:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:52:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:52:48 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:52:48 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:52:48 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:52:48 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:52:48 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:52:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:52:50 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:52:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:52:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:52:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:52:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:52:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:52:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:52:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:52:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:52:54 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:52:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556156
Mon 20 Jan 2014 12:52:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:52:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556156
Mon 20 Jan 2014 12:52:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:53:03 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:53:03 - job_xml_thread(): Done retrieving: data size 43556156
Mon 20 Jan 2014 12:53:03 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:53:03 - XML: Start document: iteration 6
Mon 20 Jan 2014 12:53:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:53:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:53:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:53:08 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:53:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:53:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:53:10 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:53:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:53:10 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:53:10 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:53:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:53:16 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:53:16 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:53:16 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:53:16 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:53:16 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:53:17 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:53:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 12:53:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:53:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:53:18 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:53:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:53:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:53:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:53:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:53:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:53:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:53:20 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:53:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43499588
Mon 20 Jan 2014 12:53:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:53:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43499588
Mon 20 Jan 2014 12:53:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:53:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:53:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:53:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:53:26 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:53:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:53:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 12:53:27 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:53:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 12:53:27 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:53:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5870 values 92589 bits 11573 bytes 
Mon 20 Jan 2014 12:53:31 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:53:31 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:53:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:53:33 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:53:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:53:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:53:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:53:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:53:33 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:53:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:53:33 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:53:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:53:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:53:36 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:53:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:53:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:53:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:53:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:53:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:53:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:53:39 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:53:39 - job_xml_thread(): Done retrieving: data size 43037124
Mon 20 Jan 2014 12:53:39 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:53:39 - XML: Start document: iteration 7
Mon 20 Jan 2014 12:53:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43037124
Mon 20 Jan 2014 12:53:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:53:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43037124
Mon 20 Jan 2014 12:53:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:53:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:53:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:53:51 - XML: Processed 646638 elements - found 0 jobs
Mon 20 Jan 2014 12:53:51 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:53:51 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:53:51 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:53:51 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:53:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:53:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:53:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:53:58 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:53:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:53:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:53:59 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:53:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:53:59 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:53:59 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:53:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:54:01 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:54:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 12:54:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:54:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:54:02 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:54:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:54:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:54:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:54:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:54:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:54:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:54:05 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:54:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42911152
Mon 20 Jan 2014 12:54:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:54:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42911152
Mon 20 Jan 2014 12:54:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:54:06 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:54:06 - job_xml_thread(): Done retrieving: data size 42911152
Mon 20 Jan 2014 12:54:06 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:54:06 - XML: Start document: iteration 8
Mon 20 Jan 2014 12:54:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:54:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:54:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:54:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:54:21 - XML: Processed 645158 elements - found 0 jobs
Mon 20 Jan 2014 12:54:21 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:54:21 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:54:21 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:54:21 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:54:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:54:25 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:54:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:54:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:54:26 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:54:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:54:26 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:54:26 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:54:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:54:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:54:27 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:54:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:54:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 12:54:28 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:54:28 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:54:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 12:54:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5933 values 93561 bits 11695 bytes 
Mon 20 Jan 2014 12:54:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:54:29 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:54:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:54:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:54:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:54:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:54:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:54:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:54:33 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:54:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43007547
Mon 20 Jan 2014 12:54:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:54:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43007547
Mon 20 Jan 2014 12:54:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:54:36 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:54:36 - job_xml_thread(): Done retrieving: data size 43007547
Mon 20 Jan 2014 12:54:36 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:54:36 - XML: Start document: iteration 9
Mon 20 Jan 2014 12:54:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:54:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:54:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:54:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:54:51 - XML: Processed 646360 elements - found 0 jobs
Mon 20 Jan 2014 12:54:51 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:54:51 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:54:51 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:54:51 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:54:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:54:52 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:54:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:54:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:54:52 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:54:52 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:54:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:54:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:54:52 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:54:55 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:54:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 12:54:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:54:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:54:57 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:54:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:54:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:54:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:54:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:54:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:54:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:55:00 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:55:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562069
Mon 20 Jan 2014 12:55:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:55:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562069
Mon 20 Jan 2014 12:55:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:55:06 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:55:06 - job_xml_thread(): Done retrieving: data size 43562069
Mon 20 Jan 2014 12:55:06 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:55:06 - XML: Start document: iteration 10
Mon 20 Jan 2014 12:55:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:55:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:55:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:55:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:55:19 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 12:55:19 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:55:19 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:55:19 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:55:19 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:55:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:55:20 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:55:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:55:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:55:21 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:55:21 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:55:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:55:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:55:21 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:55:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:55:23 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:55:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:55:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:55:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:55:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:55:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:55:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:55:25 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:55:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575441
Mon 20 Jan 2014 12:55:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:55:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575441
Mon 20 Jan 2014 12:55:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:55:27 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 12:55:27 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 12:55:27 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:55:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:55:29 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:55:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:55:30 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:55:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 12:55:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 12:55:30 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:55:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8922 values 140671 bits 17583 bytes 
Mon 20 Jan 2014 12:55:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:55:34 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:55:34 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:55:34 - job_xml_thread(): Done retrieving: data size 43575441
Mon 20 Jan 2014 12:55:34 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:55:34 - XML: Start document: iteration 11
Mon 20 Jan 2014 12:55:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:55:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:55:38 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:55:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:55:38 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:55:38 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:55:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:55:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:55:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:55:47 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:55:47 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:55:47 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:55:47 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:55:47 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:55:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:55:48 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:55:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:55:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:55:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:55:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:55:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:55:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:55:50 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:55:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43552206
Mon 20 Jan 2014 12:55:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:55:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43552206
Mon 20 Jan 2014 12:55:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:55:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:55:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:56:02 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:56:02 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:56:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:56:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:56:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:56:05 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:56:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:56:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:56:06 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:56:06 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:56:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:56:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:56:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:56:06 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:56:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:56:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:56:06 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:56:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 12:56:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:56:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:56:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:56:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:56:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:56:08 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:56:08 - job_xml_thread(): Done retrieving: data size 43582101
Mon 20 Jan 2014 12:56:08 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:56:08 - XML: Start document: iteration 12
Mon 20 Jan 2014 12:56:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582101
Mon 20 Jan 2014 12:56:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:56:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582101
Mon 20 Jan 2014 12:56:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:56:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:56:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:56:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:56:21 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:56:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:56:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:56:22 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:56:22 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:56:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:56:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:56:22 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:56:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:56:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:56:25 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:56:25 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:56:25 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:56:25 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:56:25 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:56:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:56:28 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:56:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:56:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:56:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:56:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:56:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:56:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:56:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:56:30 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:56:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:56:30 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:56:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 12:56:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 12:56:30 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:56:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6011 values 94824 bits 11853 bytes 
Mon 20 Jan 2014 12:56:30 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:56:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567147
Mon 20 Jan 2014 12:56:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:56:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567147
Mon 20 Jan 2014 12:56:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:56:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:56:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:56:40 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:56:40 - job_xml_thread(): Done retrieving: data size 43567147
Mon 20 Jan 2014 12:56:40 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:56:40 - XML: Start document: iteration 13
Mon 20 Jan 2014 12:56:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:56:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:56:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:56:46 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:56:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:56:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:56:47 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:56:47 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:56:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:56:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:56:47 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:56:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:56:50 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:56:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:56:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:56:50 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:56:50 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:56:50 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:56:50 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:56:50 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:56:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:56:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:56:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:56:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:56:53 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:56:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43597244
Mon 20 Jan 2014 12:56:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:56:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43597244
Mon 20 Jan 2014 12:56:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:57:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:57:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:57:04 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:57:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 12:57:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:57:05 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:57:05 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:57:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:57:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:57:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:57:07 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:57:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:57:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:57:08 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:57:08 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:57:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:57:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:57:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:57:09 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:57:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:57:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:57:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:57:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:57:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:57:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:57:10 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:57:10 - job_xml_thread(): Done retrieving: data size 43585651
Mon 20 Jan 2014 12:57:10 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:57:10 - XML: Start document: iteration 14
Mon 20 Jan 2014 12:57:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43585651
Mon 20 Jan 2014 12:57:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:57:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43585651
Mon 20 Jan 2014 12:57:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:57:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:57:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:57:25 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:57:25 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:57:25 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:57:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:57:25 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:57:25 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:57:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:57:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:57:30 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:57:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:57:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:57:30 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:57:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:57:30 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:57:30 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:57:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:57:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:57:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:57:30 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:57:30 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:57:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 12:57:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 12:57:30 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:57:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6393 values 100803 bits 12600 bytes 
Mon 20 Jan 2014 12:57:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:57:33 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:57:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:57:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:57:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:57:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:57:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:57:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:57:36 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:57:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583631
Mon 20 Jan 2014 12:57:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:57:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583631
Mon 20 Jan 2014 12:57:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:57:40 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:57:40 - job_xml_thread(): Done retrieving: data size 43583631
Mon 20 Jan 2014 12:57:40 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:57:40 - XML: Start document: iteration 15
Mon 20 Jan 2014 12:57:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:57:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:57:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:57:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:57:54 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:57:54 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:57:54 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:57:54 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:57:54 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:57:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:57:56 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:57:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:57:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:57:56 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:57:56 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:57:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:57:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:57:56 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:57:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:57:59 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:57:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:57:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:58:00 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:58:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 12:58:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:58:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:58:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:58:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:58:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:58:01 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:58:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43588075
Mon 20 Jan 2014 12:58:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:58:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43588075
Mon 20 Jan 2014 12:58:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:58:10 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:58:10 - job_xml_thread(): Done retrieving: data size 43588075
Mon 20 Jan 2014 12:58:11 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:58:11 - XML: Start document: iteration 16
Mon 20 Jan 2014 12:58:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:58:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:58:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:58:14 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:58:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:58:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:58:15 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 12:58:15 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:58:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:58:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:58:16 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:58:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:58:16 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:58:16 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:58:16 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:58:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:58:16 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:58:16 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 12:58:17 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 12:58:17 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 12:58:21 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:58:21 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:58:21 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:58:21 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:58:21 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:58:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:58:24 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:58:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:58:24 - size of cluster 'LISA Cluster': 624 hosts 79481 metrics 839842 values 13258668 bits 1657333 bytes 
Mon 20 Jan 2014 12:58:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:58:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:58:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:58:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:58:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:58:27 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:58:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43550113
Mon 20 Jan 2014 12:58:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:58:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43550113
Mon 20 Jan 2014 12:58:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:58:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:58:30 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:58:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:58:31 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:58:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 12:58:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 12:58:32 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:58:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8648 values 136354 bits 17044 bytes 
Mon 20 Jan 2014 12:58:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:58:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:58:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:58:35 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:58:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:58:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:58:36 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:58:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:58:36 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:58:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:58:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43550113
Mon 20 Jan 2014 12:58:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:58:36 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:58:36 - job_xml_thread(): Done retrieving: data size 43550113
Mon 20 Jan 2014 12:58:36 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:58:36 - XML: Start document: iteration 17
Mon 20 Jan 2014 12:58:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:58:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:58:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:58:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:58:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:58:52 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:58:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:58:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:58:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:58:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:58:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:58:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:58:53 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:58:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:58:57 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:58:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:58:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:58:58 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 12:58:58 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:58:58 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:58:58 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:58:58 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:58:58 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:58:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:58:58 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:58:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:59:03 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:59:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 12:59:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:59:03 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:59:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565456
Mon 20 Jan 2014 12:59:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:59:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565456
Mon 20 Jan 2014 12:59:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:59:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:59:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:59:13 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:59:13 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:59:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:59:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:59:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:59:14 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:59:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:59:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:59:15 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:59:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:59:15 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:59:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:59:17 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:59:17 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 12:59:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:59:18 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:59:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:59:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:59:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:59:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:59:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:59:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:59:21 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:59:21 - job_xml_thread(): Done retrieving: data size 43503396
Mon 20 Jan 2014 12:59:21 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:59:21 - XML: Start document: iteration 18
Mon 20 Jan 2014 12:59:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43503396
Mon 20 Jan 2014 12:59:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:59:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43503396
Mon 20 Jan 2014 12:59:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:59:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:59:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:59:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:59:32 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:59:32 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:59:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:59:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 12:59:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 12:59:32 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 12:59:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:59:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:59:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6438 values 101503 bits 12687 bytes 
Mon 20 Jan 2014 12:59:36 - XML: Processed 652608 elements - found 0 jobs
Mon 20 Jan 2014 12:59:36 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 12:59:36 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 12:59:36 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 12:59:36 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 12:59:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 12:59:39 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 12:59:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 12:59:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 12:59:40 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:59:40 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 12:59:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 12:59:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 12:59:40 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 12:59:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 12:59:43 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 12:59:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 12:59:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 12:59:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:59:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 12:59:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 12:59:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 12:59:48 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 12:59:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42950994
Mon 20 Jan 2014 12:59:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 12:59:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42950994
Mon 20 Jan 2014 12:59:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 12:59:51 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 12:59:51 - job_xml_thread(): Done retrieving: data size 42950994
Mon 20 Jan 2014 12:59:51 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 12:59:51 - XML: Start document: iteration 19
Mon 20 Jan 2014 12:59:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 12:59:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 12:59:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 12:59:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:00:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:00:02 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:00:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:00:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:00:04 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:00:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:00:04 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:00:04 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:00:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:00:06 - XML: Processed 645818 elements - found 0 jobs
Mon 20 Jan 2014 13:00:06 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:00:06 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:00:06 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:00:06 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:00:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:00:09 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:00:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:00:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:00:09 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:00:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 13:00:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:00:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:00:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:00:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:00:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:00:12 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:00:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42938783
Mon 20 Jan 2014 13:00:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:00:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42938783
Mon 20 Jan 2014 13:00:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:00:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:00:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:00:21 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:00:21 - job_xml_thread(): Done retrieving: data size 42938783
Mon 20 Jan 2014 13:00:21 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:00:21 - XML: Start document: iteration 20
Mon 20 Jan 2014 13:00:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:00:25 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:00:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:00:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:00:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:00:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:00:26 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:00:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:00:26 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:00:26 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:00:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:00:32 - XML: Processed 645585 elements - found 0 jobs
Mon 20 Jan 2014 13:00:32 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:00:32 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:00:32 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:00:32 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:00:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:00:32 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:00:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:00:33 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:00:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:00:33 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:00:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 13:00:33 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:00:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5932 values 93544 bits 11693 bytes 
Mon 20 Jan 2014 13:00:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 13:00:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:00:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:00:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:00:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:00:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:00:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:00:37 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:00:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43163407
Mon 20 Jan 2014 13:00:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:00:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43163407
Mon 20 Jan 2014 13:00:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:00:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:00:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:00:47 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:00:47 - job_xml_thread(): Done retrieving: data size 43163407
Mon 20 Jan 2014 13:00:47 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:00:47 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 13:00:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:00:47 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:00:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:00:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:00:47 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 13:00:47 - Housekeeping: done.
Mon 20 Jan 2014 13:00:47 - XML: Start document: iteration 0
Mon 20 Jan 2014 13:00:47 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:00:47 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:00:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:00:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:00:47 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:00:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:00:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:00:57 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:00:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 13:00:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:01:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:01:00 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:01:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:01:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:01:00 - XML: Processed 648456 elements - found 0 jobs
Mon 20 Jan 2014 13:01:00 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:01:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:01:00 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:01:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:01:00 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:01:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:01:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:01:00 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:01:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:01:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:01:03 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:01:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43534524
Mon 20 Jan 2014 13:01:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:01:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43534524
Mon 20 Jan 2014 13:01:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:01:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:01:12 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:01:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:01:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:01:12 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:01:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:01:13 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:01:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43534524
Mon 20 Jan 2014 13:01:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:01:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:01:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:01:15 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:01:15 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:01:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:01:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:01:24 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:01:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:01:25 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:01:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:01:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:01:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:01:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:01:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:01:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:01:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:01:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:01:28 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:01:28 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:01:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:01:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:01:29 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:01:29 - job_xml_thread(): Done retrieving: data size 43544544
Mon 20 Jan 2014 13:01:29 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:01:29 - XML: Start document: iteration 1
Mon 20 Jan 2014 13:01:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43544544
Mon 20 Jan 2014 13:01:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:01:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43544544
Mon 20 Jan 2014 13:01:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:01:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:01:33 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:01:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:01:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 13:01:33 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:01:33 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:01:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 13:01:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8698 values 137231 bits 17153 bytes 
Mon 20 Jan 2014 13:01:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:01:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:01:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:01:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:01:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:01:48 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:01:49 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 13:01:49 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:01:49 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:01:49 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:01:49 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:01:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:01:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:01:50 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:01:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:01:50 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:01:50 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:01:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:01:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:01:52 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:01:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:01:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:01:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:01:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:01:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:01:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:01:56 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:01:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43591294
Mon 20 Jan 2014 13:01:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:01:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43591294
Mon 20 Jan 2014 13:01:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:02:04 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:02:04 - job_xml_thread(): Done retrieving: data size 43591294
Mon 20 Jan 2014 13:02:04 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:02:04 - XML: Start document: iteration 2
Mon 20 Jan 2014 13:02:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:02:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:02:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:02:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:02:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:02:09 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:02:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:02:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:02:09 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:02:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:02:09 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:02:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:02:09 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:02:11 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:02:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 13:02:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:02:18 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 13:02:18 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:02:18 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:02:18 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:02:18 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:02:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:02:20 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:02:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:02:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:02:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:02:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:02:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:02:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:02:23 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:02:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558387
Mon 20 Jan 2014 13:02:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:02:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558387
Mon 20 Jan 2014 13:02:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:02:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:02:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:02:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:02:33 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:02:33 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:02:33 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:02:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:02:34 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:02:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 13:02:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 13:02:34 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:02:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5743 values 90914 bits 11364 bytes 
Mon 20 Jan 2014 13:02:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:02:35 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:02:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:02:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:02:35 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:02:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:02:35 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:02:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:02:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:02:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:02:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:02:40 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:02:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:02:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:02:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:02:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:02:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:02:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:02:44 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:02:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 13:02:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:02:44 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:02:44 - job_xml_thread(): Done retrieving: data size 43571610
Mon 20 Jan 2014 13:02:44 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:02:44 - XML: Start document: iteration 3
Mon 20 Jan 2014 13:02:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571610
Mon 20 Jan 2014 13:02:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:02:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571610
Mon 20 Jan 2014 13:02:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:02:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:02:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:02:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:02:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:03:02 - XML: Processed 653355 elements - found 0 jobs
Mon 20 Jan 2014 13:03:02 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:03:02 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:03:02 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:03:02 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:03:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:03:03 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:03:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:03:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:03:04 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:03:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:03:04 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:03:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:03:04 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:03:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:03:08 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:03:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:03:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:03:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:03:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:03:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:03:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:03:11 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:03:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43589247
Mon 20 Jan 2014 13:03:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:03:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43589247
Mon 20 Jan 2014 13:03:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:03:17 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:03:17 - job_xml_thread(): Done retrieving: data size 43589247
Mon 20 Jan 2014 13:03:17 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:03:17 - XML: Start document: iteration 4
Mon 20 Jan 2014 13:03:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:03:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:03:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:03:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:03:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:03:24 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:03:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:03:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:03:25 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:03:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:03:25 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:03:26 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:03:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:03:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:03:28 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:03:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:03:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:03:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:03:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:03:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:03:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:03:32 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 13:03:32 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:03:32 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:03:32 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:03:32 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:03:33 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 13:03:33 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 13:03:33 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:03:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:03:34 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:03:34 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:03:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565526
Mon 20 Jan 2014 13:03:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:03:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565526
Mon 20 Jan 2014 13:03:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:03:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:03:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 13:03:37 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:03:37 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:03:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148844 bits 18605 bytes 
Mon 20 Jan 2014 13:03:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 13:03:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:03:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:03:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:03:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:03:47 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:03:47 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:03:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:03:48 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:03:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:03:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:03:49 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:03:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:03:49 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:03:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:03:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:03:49 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:03:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:03:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:03:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:03:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:03:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:03:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:03:51 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:03:51 - job_xml_thread(): Done retrieving: data size 43580749
Mon 20 Jan 2014 13:03:51 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:03:51 - XML: Start document: iteration 5
Mon 20 Jan 2014 13:03:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580749
Mon 20 Jan 2014 13:03:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580749
Mon 20 Jan 2014 13:03:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:03:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:04:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:04:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:04:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:04:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:04:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:04:09 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:04:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:04:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:04:10 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:04:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:04:10 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:04:11 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:04:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:04:11 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 13:04:11 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:04:11 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:04:11 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:04:11 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:04:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:04:15 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:04:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:04:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:04:15 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:04:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 13:04:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:04:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:04:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:04:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:04:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:04:17 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:04:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574000
Mon 20 Jan 2014 13:04:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:04:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574000
Mon 20 Jan 2014 13:04:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:04:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:04:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:04:26 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:04:26 - job_xml_thread(): Done retrieving: data size 43574000
Mon 20 Jan 2014 13:04:26 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:04:26 - XML: Start document: iteration 6
Mon 20 Jan 2014 13:04:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:04:30 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:04:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:04:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:04:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:04:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:04:31 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:04:31 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:04:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:04:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:04:31 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:04:35 - XML: Processed 653357 elements - found 0 jobs
Mon 20 Jan 2014 13:04:36 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:04:36 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:04:36 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:04:36 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:04:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:04:37 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:04:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:04:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:04:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:04:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:04:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:04:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:04:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:04:38 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:04:38 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:04:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:04:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 13:04:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 13:04:38 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:04:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5767 values 90943 bits 11367 bytes 
Mon 20 Jan 2014 13:04:39 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:04:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581739
Mon 20 Jan 2014 13:04:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:04:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581739
Mon 20 Jan 2014 13:04:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:04:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:04:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:04:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:04:47 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:04:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:04:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:04:48 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:04:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:04:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581739
Mon 20 Jan 2014 13:04:48 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:04:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:04:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:04:51 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:04:51 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:04:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:04:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:04:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:04:57 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:05:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:05:01 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:05:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:05:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:05:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:05:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:05:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:05:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:05:02 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:05:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 13:05:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:05:02 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:05:02 - job_xml_thread(): Done retrieving: data size 43550834
Mon 20 Jan 2014 13:05:02 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:05:02 - XML: Start document: iteration 7
Mon 20 Jan 2014 13:05:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:05:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:05:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43550834
Mon 20 Jan 2014 13:05:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:05:04 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:05:04 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:05:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:05:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43550834
Mon 20 Jan 2014 13:05:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:05:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:05:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:05:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:05:17 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 13:05:17 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:05:17 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:05:17 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:05:17 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 13:05:17 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 13:05:17 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 13:05:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:05:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:05:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:05:22 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:05:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:05:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:05:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:05:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:05:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:05:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:05:23 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:05:23 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 13:05:23 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:05:23 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:05:23 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:05:23 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:05:25 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 791561 values 12512733 bits 1564091 bytes 
Mon 20 Jan 2014 13:05:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:05:25 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:05:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:05:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:05:26 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:05:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:05:26 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:05:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:05:28 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:05:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43518925
Mon 20 Jan 2014 13:05:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:05:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43518925
Mon 20 Jan 2014 13:05:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:05:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:05:38 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:05:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:05:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:05:38 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:05:39 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:05:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:05:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 13:05:39 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:05:39 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:05:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 13:05:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7081 values 111720 bits 13965 bytes 
Mon 20 Jan 2014 13:05:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:05:40 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:05:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:05:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:05:42 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:05:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:05:42 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:05:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:05:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:05:44 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:05:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:05:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:05:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:05:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:05:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:05:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:05:48 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:05:48 - job_xml_thread(): Done retrieving: data size 42952728
Mon 20 Jan 2014 13:05:48 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:05:48 - XML: Start document: iteration 8
Mon 20 Jan 2014 13:05:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42952728
Mon 20 Jan 2014 13:05:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:05:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42952728
Mon 20 Jan 2014 13:05:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:05:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:05:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:06:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:06:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:06:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:06:07 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:06:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:06:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:06:07 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:06:07 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:06:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:06:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:06:07 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:06:10 - XML: Processed 645922 elements - found 0 jobs
Mon 20 Jan 2014 13:06:10 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:06:10 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:06:10 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:06:10 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:06:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:06:12 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:06:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:06:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:06:12 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:06:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 13:06:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:06:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:06:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:06:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:06:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:06:16 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:06:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42955482
Mon 20 Jan 2014 13:06:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:06:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42955482
Mon 20 Jan 2014 13:06:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:06:18 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:06:19 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 13:06:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:06:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:06:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:06:24 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:06:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:06:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:06:25 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:06:25 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:06:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:06:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:06:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42955482
Mon 20 Jan 2014 13:06:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:06:25 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:06:25 - job_xml_thread(): Done retrieving: data size 42955482
Mon 20 Jan 2014 13:06:25 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:06:26 - XML: Start document: iteration 9
Mon 20 Jan 2014 13:06:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:06:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:06:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:06:36 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:06:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:06:39 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:06:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:06:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:06:40 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:06:40 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:06:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:06:40 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:06:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:06:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:06:41 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:06:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 13:06:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 13:06:41 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:06:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5947 values 93875 bits 11734 bytes 
Mon 20 Jan 2014 13:06:44 - XML: Processed 645818 elements - found 0 jobs
Mon 20 Jan 2014 13:06:44 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:06:44 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:06:44 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:06:44 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:06:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:06:46 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:06:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:06:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:06:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:06:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:06:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:06:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:06:51 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:06:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43515614
Mon 20 Jan 2014 13:06:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:06:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43515614
Mon 20 Jan 2014 13:06:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:06:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:06:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:06:59 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:06:59 - job_xml_thread(): Done retrieving: data size 43515614
Mon 20 Jan 2014 13:06:59 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:06:59 - XML: Start document: iteration 10
Mon 20 Jan 2014 13:07:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:07:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:07:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:07:13 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:07:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:07:13 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:07:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 13:07:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:07:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:07:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:07:13 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:07:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:07:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:07:14 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:07:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:07:14 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:07:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:07:14 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:07:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:07:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:07:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:07:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:07:15 - XML: Processed 652790 elements - found 0 jobs
Mon 20 Jan 2014 13:07:15 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:07:15 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:07:15 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:07:15 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:07:18 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:07:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568041
Mon 20 Jan 2014 13:07:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:07:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568041
Mon 20 Jan 2014 13:07:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:07:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:07:28 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:07:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:07:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:07:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:07:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:07:30 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:07:30 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:07:30 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:07:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:07:30 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:07:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:07:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:07:32 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:07:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:07:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:07:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:07:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:07:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:07:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:07:35 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:07:35 - job_xml_thread(): Done retrieving: data size 43568110
Mon 20 Jan 2014 13:07:35 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:07:35 - XML: Start document: iteration 11
Mon 20 Jan 2014 13:07:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568110
Mon 20 Jan 2014 13:07:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:07:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568110
Mon 20 Jan 2014 13:07:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:07:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:07:41 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:07:42 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:07:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 13:07:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:07:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 13:07:43 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:07:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9309 values 146868 bits 18358 bytes 
Mon 20 Jan 2014 13:07:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:07:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:07:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:07:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:07:55 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 13:07:56 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:07:56 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:07:56 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:07:56 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:07:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:07:56 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:07:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:07:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:07:58 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:07:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:07:58 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:07:58 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:07:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:07:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:07:59 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:08:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:08:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:08:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:08:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:08:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:08:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:08:03 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:08:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560618
Mon 20 Jan 2014 13:08:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:08:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560618
Mon 20 Jan 2014 13:08:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:08:11 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:08:11 - job_xml_thread(): Done retrieving: data size 43560618
Mon 20 Jan 2014 13:08:11 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:08:11 - XML: Start document: iteration 12
Mon 20 Jan 2014 13:08:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:08:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:08:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:08:13 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:08:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:08:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:08:14 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:08:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:08:14 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:08:14 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:08:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:08:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:08:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:08:22 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:08:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 13:08:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:08:25 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 13:08:25 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:08:25 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:08:25 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:08:25 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:08:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:08:27 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:08:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:08:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:08:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:08:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:08:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:08:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:08:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:08:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:08:30 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:08:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43539756
Mon 20 Jan 2014 13:08:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:08:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43539756
Mon 20 Jan 2014 13:08:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:08:41 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:08:41 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:08:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:08:41 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:08:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:08:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:08:42 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:08:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:08:42 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:08:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:08:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:08:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:08:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:08:42 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:08:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:08:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 13:08:43 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:08:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5853 values 92302 bits 11537 bytes 
Mon 20 Jan 2014 13:08:43 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:08:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 13:08:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:08:46 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:08:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:08:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:08:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:08:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:08:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:08:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:08:50 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:08:50 - job_xml_thread(): Done retrieving: data size 43558845
Mon 20 Jan 2014 13:08:50 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:08:50 - XML: Start document: iteration 13
Mon 20 Jan 2014 13:08:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558845
Mon 20 Jan 2014 13:08:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:08:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558845
Mon 20 Jan 2014 13:08:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:08:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:08:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:09:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:09:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:09:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:09:10 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:09:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:09:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:09:10 - XML: Processed 653356 elements - found 0 jobs
Mon 20 Jan 2014 13:09:10 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:09:10 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:09:10 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:09:10 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:09:10 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:09:10 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:09:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:09:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:09:10 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:09:11 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:09:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 13:09:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:09:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:09:14 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:09:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:09:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:09:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:09:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:09:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:09:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:09:17 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:09:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564905
Mon 20 Jan 2014 13:09:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:09:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564905
Mon 20 Jan 2014 13:09:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:09:25 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:09:25 - job_xml_thread(): Done retrieving: data size 43564905
Mon 20 Jan 2014 13:09:25 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:09:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:09:25 - XML: Start document: iteration 14
Mon 20 Jan 2014 13:09:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:09:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:09:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:09:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:09:32 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:09:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:09:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:09:33 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:09:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:09:33 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:09:33 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:09:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:09:38 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 13:09:38 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:09:38 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:09:38 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:09:38 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:09:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:09:41 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:09:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:09:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:09:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:09:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:09:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:09:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:09:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:09:43 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:09:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:09:43 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:09:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 13:09:43 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:09:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5967 values 94110 bits 11763 bytes 
Mon 20 Jan 2014 13:09:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 13:09:43 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:09:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574833
Mon 20 Jan 2014 13:09:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:09:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574833
Mon 20 Jan 2014 13:09:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:09:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:09:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:09:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:09:52 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:09:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:09:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:09:53 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:09:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:09:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574833
Mon 20 Jan 2014 13:09:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:09:53 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:09:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:09:53 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:09:53 - job_xml_thread(): Done retrieving: data size 43574833
Mon 20 Jan 2014 13:09:53 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:09:53 - XML: Start document: iteration 15
Mon 20 Jan 2014 13:09:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:09:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:10:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:10:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:10:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:10:13 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:10:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:10:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:10:14 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:10:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:10:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:10:15 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 13:10:15 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:10:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:10:15 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:10:15 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:10:15 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:10:15 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:10:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:10:15 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:10:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:10:15 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:10:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:10:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:10:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:10:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:10:18 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:10:18 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 13:10:18 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:10:19 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 13:10:19 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 13:10:19 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:10:19 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:10:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567682
Mon 20 Jan 2014 13:10:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:10:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567682
Mon 20 Jan 2014 13:10:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:10:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:10:29 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:10:30 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:10:30 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:10:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:10:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:10:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:10:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:10:31 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:10:31 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:10:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:10:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:10:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:10:33 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:10:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:10:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:10:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:10:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:10:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:10:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:10:35 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:10:35 - job_xml_thread(): Done retrieving: data size 43566243
Mon 20 Jan 2014 13:10:35 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:10:35 - XML: Start document: iteration 16
Mon 20 Jan 2014 13:10:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566243
Mon 20 Jan 2014 13:10:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:10:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566243
Mon 20 Jan 2014 13:10:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:10:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:10:43 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:10:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:10:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 13:10:44 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:10:44 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:10:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 13:10:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6833 values 107761 bits 13470 bytes 
Mon 20 Jan 2014 13:10:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:10:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:10:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:10:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:10:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:10:49 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:10:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:10:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:10:50 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:10:50 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:10:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:10:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:10:50 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:10:57 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 13:10:57 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:10:57 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:10:57 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:10:57 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:10:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:10:58 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:10:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:10:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:10:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:10:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:10:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:10:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:11:01 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:11:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571851
Mon 20 Jan 2014 13:11:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:11:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571851
Mon 20 Jan 2014 13:11:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:11:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:11:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:11:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:11:10 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:11:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:11:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:11:11 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:11:11 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:11:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:11:11 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:11:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:11:13 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:11:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:11:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:11:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:11:15 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:11:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:11:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:11:15 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:11:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 13:11:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:11:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:11:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:11:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:11:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:11:16 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:11:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43514092
Mon 20 Jan 2014 13:11:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:11:17 - job_xml_thread(): Done retrieving: data size 43514092
Mon 20 Jan 2014 13:11:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43514092
Mon 20 Jan 2014 13:11:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:11:17 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:11:18 - XML: Start document: iteration 17
Mon 20 Jan 2014 13:11:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:11:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:11:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:11:30 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:11:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:11:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:11:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:11:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:11:32 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:11:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:11:32 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:11:32 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:11:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:11:38 - XML: Processed 652600 elements - found 0 jobs
Mon 20 Jan 2014 13:11:38 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:11:38 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:11:38 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:11:38 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:11:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:11:39 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:11:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:11:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:11:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:11:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:11:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:11:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:11:41 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:11:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42991107
Mon 20 Jan 2014 13:11:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:11:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42991107
Mon 20 Jan 2014 13:11:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:11:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:11:44 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:11:46 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:11:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 13:11:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:11:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 13:11:46 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:11:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9043 values 142658 bits 17832 bytes 
Mon 20 Jan 2014 13:11:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:11:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:11:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:11:51 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:11:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:11:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:11:52 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:11:52 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:11:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:11:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:11:52 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:11:53 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:11:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:11:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:11:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:11:55 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:11:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:11:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:11:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:11:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:11:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:11:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:11:58 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:11:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42935041
Mon 20 Jan 2014 13:11:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:11:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42935041
Mon 20 Jan 2014 13:11:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:11:58 - job_xml_thread(): Done retrieving: data size 42935041
Mon 20 Jan 2014 13:11:58 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:11:58 - XML: Start document: iteration 18
Mon 20 Jan 2014 13:12:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:12:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:12:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:12:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:12:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:12:11 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:12:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:12:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:12:12 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:12:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:12:12 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:12:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:12:12 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:12:16 - XML: Processed 645182 elements - found 0 jobs
Mon 20 Jan 2014 13:12:16 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:12:16 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:12:16 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:12:16 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:12:19 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 13:12:19 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:12:19 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:12:19 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:12:19 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 13:12:19 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 13:12:19 - Entering storeMetrics(): cluster LISA Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Mon 20 Jan 2014 13:12:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:12:20 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:12:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:12:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:12:20 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:12:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 13:12:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:12:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:12:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:12:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:12:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:12:22 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:12:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42957831
Mon 20 Jan 2014 13:12:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:12:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42957831
Mon 20 Jan 2014 13:12:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:12:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:12:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:12:31 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:12:31 - job_xml_thread(): Done retrieving: data size 42957831
Mon 20 Jan 2014 13:12:31 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:12:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:12:31 - XML: Start document: iteration 19
Mon 20 Jan 2014 13:12:31 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:12:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:12:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:12:33 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:12:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:12:33 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:12:33 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:12:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:12:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:12:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:12:42 - XML: Processed 645907 elements - found 0 jobs
Mon 20 Jan 2014 13:12:42 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:12:42 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:12:42 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:12:42 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:12:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:12:44 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:12:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:12:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:12:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:12:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:12:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:12:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:12:45 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:12:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43450690
Mon 20 Jan 2014 13:12:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:12:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43450690
Mon 20 Jan 2014 13:12:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:12:46 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:12:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:12:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:12:47 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:12:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 13:12:47 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:12:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 13:12:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8825 values 139137 bits 17392 bytes 
Mon 20 Jan 2014 13:12:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:12:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:12:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:12:55 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:12:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:12:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:12:56 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:12:56 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:12:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:12:56 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:12:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:12:57 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:12:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:12:59 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:12:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:12:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:13:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:13:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:13:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:13:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:13:01 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:13:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43551975
Mon 20 Jan 2014 13:13:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:13:02 - job_xml_thread(): Done retrieving: data size 43551975
Mon 20 Jan 2014 13:13:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43551975
Mon 20 Jan 2014 13:13:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:13:02 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:13:03 - XML: Start document: iteration 20
Mon 20 Jan 2014 13:13:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:13:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:13:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:13:13 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:13:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:13:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:13:14 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:13:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:13:14 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:13:14 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:13:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:13:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:13:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:13:19 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:13:19 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:13:20 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:13:20 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 13:13:20 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:13:20 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 13:13:20 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 13:13:20 - XML: Processed 653103 elements - found 0 jobs
Mon 20 Jan 2014 13:13:20 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:13:20 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:13:20 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:13:20 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:13:23 - size of cluster 'LISA Cluster': 624 hosts 79483 metrics 825153 values 13025671 bits 1628208 bytes 
Mon 20 Jan 2014 13:13:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:13:25 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:13:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:13:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:13:25 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:13:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 13:13:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:13:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:13:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:13:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:13:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:13:27 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:13:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554363
Mon 20 Jan 2014 13:13:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:13:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554363
Mon 20 Jan 2014 13:13:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:13:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:13:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:13:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:13:35 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:13:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:13:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:13:35 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:13:35 - job_xml_thread(): Done retrieving: data size 43554363
Mon 20 Jan 2014 13:13:35 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:13:35 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 13:13:36 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 13:13:36 - Housekeeping: done.
Mon 20 Jan 2014 13:13:36 - XML: Start document: iteration 0
Mon 20 Jan 2014 13:13:36 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:13:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:13:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554363
Mon 20 Jan 2014 13:13:36 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:13:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:13:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:13:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:13:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:13:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:13:48 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:13:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:13:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 13:13:49 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:13:49 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:13:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 13:13:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5675 values 89465 bits 11183 bytes 
Mon 20 Jan 2014 13:13:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:13:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:13:53 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 13:13:53 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:13:53 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:13:53 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:13:53 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:13:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:13:55 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:13:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:13:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:13:55 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:13:55 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:13:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:13:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:13:55 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:13:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:13:57 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:13:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:13:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:13:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:13:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:13:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:13:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:14:01 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:14:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580114
Mon 20 Jan 2014 13:14:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:14:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580114
Mon 20 Jan 2014 13:14:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:14:08 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:14:08 - job_xml_thread(): Done retrieving: data size 43580114
Mon 20 Jan 2014 13:14:08 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:14:08 - XML: Start document: iteration 1
Mon 20 Jan 2014 13:14:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:14:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:14:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:14:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:14:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:14:19 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:14:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:14:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:14:20 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:14:20 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 13:14:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:14:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:14:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:14:21 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:14:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:14:21 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:14:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 13:14:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:14:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:14:24 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 13:14:24 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:14:24 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:14:24 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:14:24 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:14:24 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:14:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:14:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:14:25 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:14:25 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:14:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:14:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:14:28 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:14:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43586556
Mon 20 Jan 2014 13:14:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:14:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43586556
Mon 20 Jan 2014 13:14:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:14:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:14:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:14:39 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:14:39 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:14:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:14:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:14:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:14:42 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:14:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:14:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:14:43 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:14:43 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:14:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:14:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:14:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:14:44 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:14:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:14:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:14:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:14:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:14:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:14:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:14:47 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:14:47 - job_xml_thread(): Done retrieving: data size 43571592
Mon 20 Jan 2014 13:14:47 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:14:47 - XML: Start document: iteration 2
Mon 20 Jan 2014 13:14:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571592
Mon 20 Jan 2014 13:14:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:14:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571592
Mon 20 Jan 2014 13:14:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:14:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:14:50 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:14:51 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:14:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 13:14:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:14:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 13:14:52 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:14:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9172 values 144624 bits 18078 bytes 
Mon 20 Jan 2014 13:14:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:14:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:15:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:15:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:15:05 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 13:15:05 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:15:05 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:15:05 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:15:05 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:15:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:15:06 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:15:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:15:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:15:06 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:15:06 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:15:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:15:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:15:06 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:15:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:15:10 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:15:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:15:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:15:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:15:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:15:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:15:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:15:13 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:15:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584793
Mon 20 Jan 2014 13:15:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:15:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584793
Mon 20 Jan 2014 13:15:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:15:20 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:15:20 - job_xml_thread(): Done retrieving: data size 43584793
Mon 20 Jan 2014 13:15:20 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:15:20 - XML: Start document: iteration 3
Mon 20 Jan 2014 13:15:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:15:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:15:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:15:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:15:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:15:30 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:15:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:15:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:15:30 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:15:30 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:15:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:15:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:15:31 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:15:34 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:15:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 13:15:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:15:36 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 13:15:36 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:15:36 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:15:36 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:15:36 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:15:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:15:37 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:15:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:15:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:15:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:15:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:15:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:15:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:15:40 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:15:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568952
Mon 20 Jan 2014 13:15:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:15:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568952
Mon 20 Jan 2014 13:15:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:15:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:15:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:15:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:15:49 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:15:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:15:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:15:50 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:15:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:15:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568952
Mon 20 Jan 2014 13:15:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:15:50 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:15:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:15:51 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:15:51 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:15:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:15:51 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:15:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:15:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 13:15:52 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:15:52 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:15:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 13:15:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5840 values 92124 bits 11515 bytes 
Mon 20 Jan 2014 13:15:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:15:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:16:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:16:01 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:16:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:16:04 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:16:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:16:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:16:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:16:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:16:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:16:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:16:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:16:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:16:06 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:16:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:16:06 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:16:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:16:07 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:16:07 - job_xml_thread(): Done retrieving: data size 43547710
Mon 20 Jan 2014 13:16:07 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:16:07 - XML: Start document: iteration 4
Mon 20 Jan 2014 13:16:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43547710
Mon 20 Jan 2014 13:16:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:16:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43547710
Mon 20 Jan 2014 13:16:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:16:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:16:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:16:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:16:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:16:25 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 13:16:25 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:16:25 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:16:25 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:16:25 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:16:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:16:30 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:16:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:16:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:16:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:16:31 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:16:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:16:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:16:31 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 13:16:31 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 13:16:31 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:16:31 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:16:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 13:16:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:16:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:16:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:16:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:16:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:16:31 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:16:32 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:16:32 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:16:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:16:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:16:33 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:16:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43588532
Mon 20 Jan 2014 13:16:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:16:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43588532
Mon 20 Jan 2014 13:16:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:16:41 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:16:41 - job_xml_thread(): Done retrieving: data size 43588532
Mon 20 Jan 2014 13:16:41 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:16:41 - XML: Start document: iteration 5
Mon 20 Jan 2014 13:16:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:16:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:16:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:16:47 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:16:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:16:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:16:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:16:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:16:48 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:16:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:16:48 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:16:48 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:16:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:16:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:16:50 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:16:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:16:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:16:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:16:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:16:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:16:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:16:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:16:52 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:16:52 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 13:16:52 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:16:52 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:16:52 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:16:52 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:16:52 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:16:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:16:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 13:16:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 13:16:52 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:16:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5827 values 92047 bits 11505 bytes 
Mon 20 Jan 2014 13:16:55 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:16:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43585853
Mon 20 Jan 2014 13:16:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:16:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43585853
Mon 20 Jan 2014 13:16:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:17:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:17:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:17:04 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:17:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:17:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:17:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:17:05 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:17:05 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:17:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:17:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:17:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43585853
Mon 20 Jan 2014 13:17:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:17:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:17:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:17:08 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:17:08 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:17:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:17:14 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:17:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:17:17 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:17:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:17:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:17:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:17:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:17:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:17:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:17:17 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:17:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 13:17:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:17:19 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:17:19 - job_xml_thread(): Done retrieving: data size 43490331
Mon 20 Jan 2014 13:17:19 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:17:19 - XML: Start document: iteration 6
Mon 20 Jan 2014 13:17:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43490331
Mon 20 Jan 2014 13:17:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:17:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:17:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:17:22 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:17:22 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:17:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:17:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:17:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43490331
Mon 20 Jan 2014 13:17:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:17:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:17:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:17:35 - XML: Processed 652608 elements - found 0 jobs
Mon 20 Jan 2014 13:17:35 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:17:35 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:17:35 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:17:35 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:17:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:17:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:17:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:17:39 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:17:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:17:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:17:40 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:17:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:17:40 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:17:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:17:40 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:17:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:17:41 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:17:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:17:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:17:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:17:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:17:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:17:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:17:43 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:17:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43000631
Mon 20 Jan 2014 13:17:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:17:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43000631
Mon 20 Jan 2014 13:17:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:17:51 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:17:51 - job_xml_thread(): Done retrieving: data size 43000631
Mon 20 Jan 2014 13:17:51 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:17:51 - XML: Start document: iteration 7
Mon 20 Jan 2014 13:17:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:17:53 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:17:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:17:54 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:17:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:17:54 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:17:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 13:17:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 13:17:54 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:17:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8862 values 140088 bits 17511 bytes 
Mon 20 Jan 2014 13:17:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:17:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:17:56 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:17:56 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:17:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:17:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:17:56 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:17:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:17:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:18:02 - XML: Processed 645888 elements - found 0 jobs
Mon 20 Jan 2014 13:18:02 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:18:02 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:18:02 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:18:02 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:18:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:18:05 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:18:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:18:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:18:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:18:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:18:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:18:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:18:07 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:18:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42896112
Mon 20 Jan 2014 13:18:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:18:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42896112
Mon 20 Jan 2014 13:18:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:18:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:18:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:18:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:18:15 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:18:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:18:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:18:16 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:18:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:18:16 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:18:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:18:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42896112
Mon 20 Jan 2014 13:18:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:18:17 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:18:18 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:18:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:18:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:18:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:18:25 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:18:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:18:28 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:18:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:18:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:18:28 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:18:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 13:18:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:18:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:18:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:18:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:18:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:18:30 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:18:30 - job_xml_thread(): Done retrieving: data size 43298309
Mon 20 Jan 2014 13:18:30 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:18:30 - XML: Start document: iteration 8
Mon 20 Jan 2014 13:18:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43298309
Mon 20 Jan 2014 13:18:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:18:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:18:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:18:33 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:18:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:18:33 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:18:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43298309
Mon 20 Jan 2014 13:18:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:18:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:18:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:18:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:18:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:18:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:18:52 - XML: Processed 650286 elements - found 0 jobs
Mon 20 Jan 2014 13:18:52 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:18:52 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:18:52 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:18:52 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:18:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:18:53 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:18:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:18:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:18:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:18:54 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:18:54 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:18:54 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:18:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:18:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:18:54 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:18:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:18:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:18:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:18:54 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:18:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:18:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:18:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:18:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:18:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:18:55 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:18:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 13:18:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 13:18:55 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:18:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5845 values 92357 bits 11544 bytes 
Mon 20 Jan 2014 13:18:57 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:18:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559704
Mon 20 Jan 2014 13:18:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:18:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559704
Mon 20 Jan 2014 13:18:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:19:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:19:07 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:19:07 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:19:08 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:19:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:19:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:19:09 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:19:09 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:19:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:19:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:19:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:19:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:19:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:19:12 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:19:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:19:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:19:12 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:19:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 13:19:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:19:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:19:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:19:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:19:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:19:14 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:19:14 - job_xml_thread(): Done retrieving: data size 43588964
Mon 20 Jan 2014 13:19:14 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:19:14 - XML: Start document: iteration 9
Mon 20 Jan 2014 13:19:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43588964
Mon 20 Jan 2014 13:19:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:19:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43588964
Mon 20 Jan 2014 13:19:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:19:24 - XML: Processed 653355 elements - found 0 jobs
Mon 20 Jan 2014 13:19:24 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:19:24 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:19:24 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:19:24 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:19:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:19:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:19:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:19:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:19:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:19:32 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:19:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:19:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:19:34 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:19:34 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:19:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:19:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:19:34 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:19:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:19:35 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:19:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:19:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:19:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:19:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:19:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:19:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:19:38 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:19:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573793
Mon 20 Jan 2014 13:19:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:19:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573793
Mon 20 Jan 2014 13:19:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:19:39 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:19:39 - job_xml_thread(): Done retrieving: data size 43573793
Mon 20 Jan 2014 13:19:39 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:19:39 - XML: Start document: iteration 10
Mon 20 Jan 2014 13:19:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:19:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:19:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:19:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:19:51 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:19:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:19:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:19:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:19:52 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:19:52 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:19:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:19:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:19:52 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:19:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:19:55 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:19:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:19:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 13:19:56 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:19:56 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:19:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 13:19:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8309 values 131051 bits 16381 bytes 
Mon 20 Jan 2014 13:19:59 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 13:19:59 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:19:59 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:19:59 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:19:59 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:20:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:20:01 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:20:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:20:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:20:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:20:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:20:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:20:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:20:03 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:20:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43544890
Mon 20 Jan 2014 13:20:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:20:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43544890
Mon 20 Jan 2014 13:20:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:20:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:20:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:20:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:20:12 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:20:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:20:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:20:13 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:20:13 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:20:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:20:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:20:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43544890
Mon 20 Jan 2014 13:20:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:20:14 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:20:14 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:20:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:20:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:20:20 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 13:20:20 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:20:20 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:20:20 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 13:20:20 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 13:20:20 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:20:20 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 13:20:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:20:25 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:20:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:20:25 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:20:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:20:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:20:25 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 918627 values 14521462 bits 1815182 bytes 
Mon 20 Jan 2014 13:20:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:20:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:20:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:20:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:20:27 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:20:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 13:20:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:20:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:20:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:20:28 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:20:28 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:20:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:20:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:20:29 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:20:29 - job_xml_thread(): Done retrieving: data size 43554451
Mon 20 Jan 2014 13:20:29 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:20:29 - XML: Start document: iteration 11
Mon 20 Jan 2014 13:20:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554451
Mon 20 Jan 2014 13:20:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:20:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554451
Mon 20 Jan 2014 13:20:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:20:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:20:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:20:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:20:43 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:20:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:20:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:20:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:20:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:20:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:20:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:20:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:20:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:20:44 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:20:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:20:52 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:20:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:20:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:20:53 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:20:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:20:53 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:20:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:20:53 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 13:20:53 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:20:53 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:20:53 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:20:53 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:20:56 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:20:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563443
Mon 20 Jan 2014 13:20:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:20:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:20:56 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:20:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563443
Mon 20 Jan 2014 13:20:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:20:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 13:20:57 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:20:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:20:57 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:20:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 13:20:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5452 values 85959 bits 10744 bytes 
Mon 20 Jan 2014 13:20:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:20:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:21:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:21:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:21:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:21:08 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:21:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:21:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:21:08 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:21:08 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:21:09 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:21:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:21:09 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:21:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:21:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:21:14 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:21:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:21:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:21:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:21:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:21:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:21:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:21:17 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:21:17 - job_xml_thread(): Done retrieving: data size 43568991
Mon 20 Jan 2014 13:21:17 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:21:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568991
Mon 20 Jan 2014 13:21:17 - XML: Start document: iteration 12
Mon 20 Jan 2014 13:21:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:21:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568991
Mon 20 Jan 2014 13:21:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:21:21 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:21:21 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 13:21:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:21:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:21:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:21:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:21:33 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 13:21:33 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:21:33 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:21:33 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:21:33 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:21:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:21:37 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:21:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:21:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:21:37 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:21:37 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:21:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:21:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:21:37 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:21:39 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:21:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 13:21:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:21:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:21:42 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:21:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:21:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:21:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:21:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:21:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:21:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:21:46 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:21:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566373
Mon 20 Jan 2014 13:21:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:21:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566373
Mon 20 Jan 2014 13:21:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:21:48 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:21:48 - job_xml_thread(): Done retrieving: data size 43566373
Mon 20 Jan 2014 13:21:48 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:21:48 - XML: Start document: iteration 13
Mon 20 Jan 2014 13:21:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:21:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:21:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:21:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:21:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:21:58 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:21:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:21:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 13:21:58 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:21:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:21:58 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:21:58 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:21:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 13:21:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:21:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:22:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5726 values 90295 bits 11286 bytes 
Mon 20 Jan 2014 13:22:00 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:22:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:22:00 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:22:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:22:00 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:22:03 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 13:22:03 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:22:03 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:22:03 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:22:03 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:22:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:22:09 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:22:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:22:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:22:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:22:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:22:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:22:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:22:12 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:22:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 13:22:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:22:13 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:22:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562234
Mon 20 Jan 2014 13:22:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:22:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562234
Mon 20 Jan 2014 13:22:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:22:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:22:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:22:18 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:22:18 - job_xml_thread(): Done retrieving: data size 43562234
Mon 20 Jan 2014 13:22:18 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:22:18 - XML: Start document: iteration 14
Mon 20 Jan 2014 13:22:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:22:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:22:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:22:27 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:22:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:22:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:22:30 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:22:30 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:22:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:22:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:22:30 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:22:30 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 13:22:30 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:22:30 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:22:30 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:22:30 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:22:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:22:36 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:22:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:22:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:22:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:22:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:22:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:22:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:22:39 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:22:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565979
Mon 20 Jan 2014 13:22:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:22:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565979
Mon 20 Jan 2014 13:22:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:22:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:22:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:22:47 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:22:48 - job_xml_thread(): Done retrieving: data size 43565979
Mon 20 Jan 2014 13:22:48 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:22:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:22:48 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:22:48 - XML: Start document: iteration 15
Mon 20 Jan 2014 13:22:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:22:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:22:50 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:22:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:22:50 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:22:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:22:50 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:22:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:22:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:22:57 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 13:22:57 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:22:57 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:22:57 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:22:57 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:22:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:22:58 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:22:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:22:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 13:22:59 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:22:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 13:22:59 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:22:59 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99076 bits 12384 bytes 
Mon 20 Jan 2014 13:23:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:23:02 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:23:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:23:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:23:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:23:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:23:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:23:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:23:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:23:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:23:06 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:23:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43539317
Mon 20 Jan 2014 13:23:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:23:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43539317
Mon 20 Jan 2014 13:23:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:23:12 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:23:12 - job_xml_thread(): Done retrieving: data size 43539317
Mon 20 Jan 2014 13:23:12 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:23:12 - XML: Start document: iteration 16
Mon 20 Jan 2014 13:23:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:23:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:23:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:23:22 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:23:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:23:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:23:22 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:23:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:23:22 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:23:22 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:23:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:23:29 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 13:23:29 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:23:29 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:23:29 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:23:29 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:23:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:23:29 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:23:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:23:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:23:29 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:23:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 13:23:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:23:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:23:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:23:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:23:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:23:32 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:23:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43481292
Mon 20 Jan 2014 13:23:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:23:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43481292
Mon 20 Jan 2014 13:23:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:23:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:23:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:23:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:23:43 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:23:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:23:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:23:43 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:23:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:23:43 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:23:43 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:23:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:23:44 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:23:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:23:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:23:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:23:48 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:23:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:23:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:23:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:23:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:23:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:23:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:23:51 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:23:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42934712
Mon 20 Jan 2014 13:23:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:23:52 - job_xml_thread(): Done retrieving: data size 42934712
Mon 20 Jan 2014 13:23:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42934712
Mon 20 Jan 2014 13:23:52 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:23:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:23:52 - XML: Start document: iteration 17
Mon 20 Jan 2014 13:23:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:23:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:23:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:23:59 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:24:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:24:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 13:24:00 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:24:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 13:24:00 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:24:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9046 values 142664 bits 17833 bytes 
Mon 20 Jan 2014 13:24:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:24:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:24:12 - XML: Processed 645562 elements - found 0 jobs
Mon 20 Jan 2014 13:24:12 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:24:12 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:24:12 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:24:12 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:24:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:24:14 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:24:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:24:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:24:15 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:24:15 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:24:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:24:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:24:15 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:24:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:24:15 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:24:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:24:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:24:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:24:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:24:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:24:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:24:19 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:24:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42976677
Mon 20 Jan 2014 13:24:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:24:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42976677
Mon 20 Jan 2014 13:24:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:24:28 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:24:28 - job_xml_thread(): Done retrieving: data size 42976677
Mon 20 Jan 2014 13:24:28 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:24:28 - XML: Start document: iteration 18
Mon 20 Jan 2014 13:24:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:24:29 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:24:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:24:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:24:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:24:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:24:31 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:24:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:24:31 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:24:31 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:24:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:24:37 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:24:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 13:24:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:24:38 - XML: Processed 645838 elements - found 0 jobs
Mon 20 Jan 2014 13:24:38 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:24:38 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:24:38 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:24:38 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:24:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:24:43 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:24:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:24:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:24:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:24:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:24:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:24:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:24:45 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 13:24:45 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 13:24:45 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:24:45 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:24:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43430104
Mon 20 Jan 2014 13:24:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:24:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43430104
Mon 20 Jan 2014 13:24:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:24:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:24:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:24:53 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:24:53 - job_xml_thread(): Done retrieving: data size 43430104
Mon 20 Jan 2014 13:24:53 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:24:53 - XML: Start document: iteration 19
Mon 20 Jan 2014 13:24:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:24:56 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:24:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:24:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:24:56 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:24:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:24:57 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:24:57 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:24:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:24:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:24:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:25:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:25:00 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:25:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:25:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 13:25:01 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:25:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5630 values 88711 bits 11088 bytes 
Mon 20 Jan 2014 13:25:01 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:25:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 13:25:08 - XML: Processed 651894 elements - found 0 jobs
Mon 20 Jan 2014 13:25:08 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:25:08 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:25:08 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:25:08 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:25:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:25:08 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:25:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:25:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:25:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:25:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:25:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:25:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:25:11 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:25:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43552429
Mon 20 Jan 2014 13:25:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:25:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43552429
Mon 20 Jan 2014 13:25:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:25:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:25:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:25:22 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:25:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:25:22 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:25:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:25:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 13:25:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:25:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:25:23 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:25:23 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:25:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:25:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:25:23 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:25:23 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:25:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:25:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:25:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:25:25 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:25:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:25:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:25:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:25:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:25:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:25:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:25:28 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:25:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43585474
Mon 20 Jan 2014 13:25:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:25:29 - job_xml_thread(): Done retrieving: data size 43585474
Mon 20 Jan 2014 13:25:29 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:25:29 - XML: Start document: iteration 20
Mon 20 Jan 2014 13:25:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43585474
Mon 20 Jan 2014 13:25:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:25:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:25:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:25:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:25:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:25:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:25:41 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:25:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:25:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:25:42 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:25:42 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:25:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:25:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:25:42 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:25:50 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 13:25:50 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:25:50 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:25:50 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:25:50 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:25:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:25:51 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:25:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:25:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:25:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:25:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:25:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:25:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:25:53 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:25:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43550216
Mon 20 Jan 2014 13:25:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:25:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43550216
Mon 20 Jan 2014 13:25:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:25:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:25:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:26:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:26:02 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:26:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:26:03 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:26:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 13:26:03 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:26:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 13:26:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9360 values 147615 bits 18451 bytes 
Mon 20 Jan 2014 13:26:06 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:26:06 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:26:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:26:06 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:26:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:26:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:26:07 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:26:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:26:07 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:26:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:26:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:26:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:26:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:26:09 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:26:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:26:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:26:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:26:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:26:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:26:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:26:11 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:26:11 - job_xml_thread(): Done retrieving: data size 43579369
Mon 20 Jan 2014 13:26:11 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:26:11 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 13:26:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579369
Mon 20 Jan 2014 13:26:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:26:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579369
Mon 20 Jan 2014 13:26:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:26:13 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 13:26:13 - Housekeeping: done.
Mon 20 Jan 2014 13:26:14 - XML: Start document: iteration 0
Mon 20 Jan 2014 13:26:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:26:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:26:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:26:24 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:26:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:26:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:26:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:26:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:26:24 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:26:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:26:24 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:26:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:26:24 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:26:27 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 13:26:27 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:26:27 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:26:27 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:26:27 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:26:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:26:32 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:26:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:26:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:26:32 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:26:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 13:26:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:26:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:26:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:26:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:26:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:26:34 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:26:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553500
Mon 20 Jan 2014 13:26:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:26:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553500
Mon 20 Jan 2014 13:26:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:26:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:26:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:26:42 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:26:42 - job_xml_thread(): Done retrieving: data size 43553500
Mon 20 Jan 2014 13:26:42 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:26:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:26:42 - XML: Start document: iteration 1
Mon 20 Jan 2014 13:26:42 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:26:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:26:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:26:44 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:26:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:26:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553500
Mon 20 Jan 2014 13:26:44 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:26:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:26:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:26:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:26:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:26:54 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 13:26:54 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:26:54 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:26:54 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:26:54 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:27:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:27:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:27:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:27:01 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:27:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:27:02 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:27:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:27:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:27:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:27:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:27:02 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:27:02 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:27:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:27:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:27:02 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:27:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:27:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:27:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:27:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:27:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:27:03 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:27:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:27:03 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:27:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 13:27:03 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:27:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 13:27:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5647 values 88998 bits 11124 bytes 
Mon 20 Jan 2014 13:27:04 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:27:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584113
Mon 20 Jan 2014 13:27:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:27:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584113
Mon 20 Jan 2014 13:27:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:27:09 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:27:09 - job_xml_thread(): Done retrieving: data size 43584113
Mon 20 Jan 2014 13:27:09 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:27:09 - XML: Start document: iteration 2
Mon 20 Jan 2014 13:27:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:27:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:27:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:27:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:27:21 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 13:27:21 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:27:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:27:22 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:27:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:27:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:27:23 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:27:23 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 13:27:23 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:27:23 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 13:27:23 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 13:27:24 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:27:24 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:27:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:27:24 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:27:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:27:28 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 13:27:28 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:27:28 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:27:28 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:27:28 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:27:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:27:29 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:27:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:27:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:27:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:27:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:27:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:27:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:27:29 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 779487 values 12301769 bits 1537721 bytes 
Mon 20 Jan 2014 13:27:31 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:27:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 13:27:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:27:32 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:27:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557921
Mon 20 Jan 2014 13:27:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:27:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557921
Mon 20 Jan 2014 13:27:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:27:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:27:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:27:43 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:27:43 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:27:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:27:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:27:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:27:44 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:27:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:27:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:27:44 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:27:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:27:45 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:27:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:27:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:27:47 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:27:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:27:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:27:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:27:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:27:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:27:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:27:50 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:27:50 - job_xml_thread(): Done retrieving: data size 43564668
Mon 20 Jan 2014 13:27:50 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:27:50 - XML: Start document: iteration 3
Mon 20 Jan 2014 13:27:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564668
Mon 20 Jan 2014 13:27:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:27:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564668
Mon 20 Jan 2014 13:27:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:28:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:28:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:28:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:28:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:28:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:28:04 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:28:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:28:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 13:28:05 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:28:05 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:28:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 13:28:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7424 values 117066 bits 14633 bytes 
Mon 20 Jan 2014 13:28:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:28:06 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:28:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:28:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:28:07 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:28:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:28:07 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:28:07 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:28:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:28:09 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 13:28:09 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:28:09 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:28:09 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:28:09 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:28:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:28:13 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:28:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:28:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:28:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:28:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:28:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:28:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:28:16 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:28:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561977
Mon 20 Jan 2014 13:28:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561977
Mon 20 Jan 2014 13:28:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:28:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:28:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:28:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:28:24 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:28:24 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 13:28:25 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:28:25 - job_xml_thread(): Done retrieving: data size 43561977
Mon 20 Jan 2014 13:28:25 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:28:25 - XML: Start document: iteration 4
Mon 20 Jan 2014 13:28:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:28:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:28:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:28:30 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:28:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:28:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:28:31 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:28:31 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:28:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:28:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:28:31 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:28:39 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 13:28:39 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:28:39 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:28:39 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:28:39 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:28:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:28:40 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:28:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:28:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:28:40 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:28:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 13:28:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:28:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:28:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:28:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:28:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:28:43 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:28:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566746
Mon 20 Jan 2014 13:28:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:28:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566746
Mon 20 Jan 2014 13:28:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:28:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:28:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:28:54 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:28:54 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:28:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:28:55 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:28:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:28:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:28:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:28:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:28:56 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:28:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:28:56 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:28:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:28:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:28:59 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:28:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:28:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:28:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:28:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:28:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:28:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:29:03 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:29:03 - job_xml_thread(): Done retrieving: data size 43562242
Mon 20 Jan 2014 13:29:03 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:29:03 - XML: Start document: iteration 5
Mon 20 Jan 2014 13:29:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562242
Mon 20 Jan 2014 13:29:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:29:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562242
Mon 20 Jan 2014 13:29:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:29:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:29:05 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:29:05 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:29:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:29:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 13:29:05 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:29:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 13:29:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8824 values 139103 bits 17387 bytes 
Mon 20 Jan 2014 13:29:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:29:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:29:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:29:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:29:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:29:16 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:29:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:29:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:29:17 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:29:17 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:29:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:29:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:29:17 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:29:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:29:26 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:29:26 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 13:29:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:29:26 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:29:26 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:29:26 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:29:26 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:29:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:29:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:29:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:29:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:29:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:29:30 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:29:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43500908
Mon 20 Jan 2014 13:29:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:29:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43500908
Mon 20 Jan 2014 13:29:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:29:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:29:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:29:41 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:29:41 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:29:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:29:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:29:43 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:29:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 13:29:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:29:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:29:45 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:29:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:29:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:29:45 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:29:45 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:29:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:29:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:29:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:29:46 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:29:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:29:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:29:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:29:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:29:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:29:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:29:50 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:29:50 - job_xml_thread(): Done retrieving: data size 42955968
Mon 20 Jan 2014 13:29:50 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:29:50 - XML: Start document: iteration 6
Mon 20 Jan 2014 13:29:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42955968
Mon 20 Jan 2014 13:29:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:29:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42955968
Mon 20 Jan 2014 13:29:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:30:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:30:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:30:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:30:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:30:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:30:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:30:06 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:30:06 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:30:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:30:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:30:07 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:30:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:30:07 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:30:07 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:30:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:30:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:30:07 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:30:07 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 13:30:07 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:30:07 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 13:30:07 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5755 values 90679 bits 11334 bytes 
Mon 20 Jan 2014 13:30:08 - XML: Processed 645930 elements - found 0 jobs
Mon 20 Jan 2014 13:30:08 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:30:08 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:30:08 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:30:08 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:30:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:30:11 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:30:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:30:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:30:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:30:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:30:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:30:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:30:15 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:30:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42929945
Mon 20 Jan 2014 13:30:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:30:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42929945
Mon 20 Jan 2014 13:30:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:30:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:30:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:30:24 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:30:24 - job_xml_thread(): Done retrieving: data size 42929945
Mon 20 Jan 2014 13:30:24 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:30:24 - XML: Start document: iteration 7
Mon 20 Jan 2014 13:30:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:30:25 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:30:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:30:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:30:26 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:30:26 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:30:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:30:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:30:26 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:30:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:30:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:30:30 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:30:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 13:30:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:30:35 - XML: Processed 645430 elements - found 0 jobs
Mon 20 Jan 2014 13:30:35 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:30:35 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:30:35 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:30:35 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:30:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:30:37 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:30:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:30:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:30:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:30:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:30:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:30:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:30:39 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:30:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43393344
Mon 20 Jan 2014 13:30:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:30:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43393344
Mon 20 Jan 2014 13:30:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:30:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:30:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:30:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:30:48 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:30:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:30:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:30:49 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:30:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:30:49 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:30:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:30:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43393344
Mon 20 Jan 2014 13:30:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:30:50 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:30:50 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:30:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:30:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:30:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:30:58 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:31:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:31:00 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:31:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:31:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:31:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:31:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:31:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:31:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:31:03 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:31:03 - job_xml_thread(): Done retrieving: data size 43536288
Mon 20 Jan 2014 13:31:03 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:31:03 - XML: Start document: iteration 8
Mon 20 Jan 2014 13:31:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43536288
Mon 20 Jan 2014 13:31:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:31:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:31:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:31:05 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:31:05 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:31:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:31:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43536288
Mon 20 Jan 2014 13:31:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:31:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:31:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:31:08 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:31:09 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:31:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 13:31:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:31:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 13:31:09 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:31:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8933 values 140867 bits 17608 bytes 
Mon 20 Jan 2014 13:31:14 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 13:31:14 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:31:14 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:31:14 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:31:14 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:31:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:31:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:31:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:31:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:31:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:31:22 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:31:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:31:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:31:22 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:31:22 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:31:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:31:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:31:22 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:31:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:31:27 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:31:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:31:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:31:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:31:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:31:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:31:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:31:29 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:31:30 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 13:31:30 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 13:31:30 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:31:31 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:31:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556790
Mon 20 Jan 2014 13:31:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:31:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556790
Mon 20 Jan 2014 13:31:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:31:32 - job_xml_thread(): Done retrieving: data size 43556790
Mon 20 Jan 2014 13:31:32 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:31:32 - XML: Start document: iteration 9
Mon 20 Jan 2014 13:31:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:31:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:31:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:31:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:31:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:31:45 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:31:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:31:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:31:46 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:31:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:31:46 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:31:46 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:31:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:31:49 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 13:31:49 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:31:49 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:31:49 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:31:49 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:31:49 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:31:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 13:31:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:31:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:31:51 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:31:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:31:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:31:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:31:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:31:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:31:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:31:53 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:31:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569829
Mon 20 Jan 2014 13:31:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:31:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569829
Mon 20 Jan 2014 13:31:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:32:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:32:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:32:04 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:32:04 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:32:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:32:04 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:32:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:32:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:32:04 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:32:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:32:04 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:32:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:32:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:32:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:32:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:32:08 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:32:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:32:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:32:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:32:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:32:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:32:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:32:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:32:09 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:32:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:32:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 13:32:09 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:32:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6066 values 95926 bits 11990 bytes 
Mon 20 Jan 2014 13:32:09 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:32:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 13:32:10 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:32:10 - job_xml_thread(): Done retrieving: data size 43576882
Mon 20 Jan 2014 13:32:10 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:32:10 - XML: Start document: iteration 10
Mon 20 Jan 2014 13:32:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576882
Mon 20 Jan 2014 13:32:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:32:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576882
Mon 20 Jan 2014 13:32:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:32:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:32:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:32:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:32:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:32:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:32:30 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:32:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:32:30 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 13:32:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:32:30 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:32:30 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:32:30 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:32:30 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:32:31 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:32:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:32:31 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:32:31 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:32:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:32:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:32:33 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:32:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:32:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:32:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:32:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:32:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:32:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:32:35 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:32:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 13:32:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:32:35 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:32:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582042
Mon 20 Jan 2014 13:32:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:32:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582042
Mon 20 Jan 2014 13:32:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:32:46 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:32:46 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:32:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:32:46 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:32:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:32:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:32:47 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:32:47 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:32:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:32:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:32:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:32:49 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:32:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:32:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:32:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:32:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:32:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:32:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:32:51 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:32:51 - job_xml_thread(): Done retrieving: data size 43584586
Mon 20 Jan 2014 13:32:51 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:32:51 - XML: Start document: iteration 11
Mon 20 Jan 2014 13:32:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584586
Mon 20 Jan 2014 13:32:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:32:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584586
Mon 20 Jan 2014 13:32:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:33:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:33:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:33:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:33:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:33:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:33:09 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:33:11 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 13:33:11 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:33:11 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:33:11 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:33:11 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:33:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:33:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 13:33:11 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:33:12 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:33:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 13:33:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7288 values 115223 bits 14402 bytes 
Mon 20 Jan 2014 13:33:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:33:13 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:33:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:33:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:33:13 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:33:13 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:33:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:33:13 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:33:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:33:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:33:14 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:33:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:33:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:33:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:33:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:33:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:33:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:33:16 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:33:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571220
Mon 20 Jan 2014 13:33:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:33:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571220
Mon 20 Jan 2014 13:33:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:33:24 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:33:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 13:33:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:33:26 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:33:26 - job_xml_thread(): Done retrieving: data size 43571220
Mon 20 Jan 2014 13:33:26 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:33:26 - XML: Start document: iteration 12
Mon 20 Jan 2014 13:33:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:33:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:33:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:33:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:33:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:33:34 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:33:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:33:36 - XML: Processed 653357 elements - found 0 jobs
Mon 20 Jan 2014 13:33:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:33:36 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:33:36 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:33:36 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:33:36 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:33:36 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:33:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:33:36 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:33:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:33:36 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:33:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:33:37 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:33:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:33:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:33:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:33:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:33:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:33:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:33:39 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:33:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43587639
Mon 20 Jan 2014 13:33:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:33:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43587639
Mon 20 Jan 2014 13:33:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:33:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:33:48 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:33:51 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:33:51 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:33:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:33:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:33:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:33:52 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:33:52 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:33:52 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:33:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:33:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:33:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:33:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:33:53 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:33:53 - job_xml_thread(): Done retrieving: data size 43588531
Mon 20 Jan 2014 13:33:53 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:33:53 - XML: Start document: iteration 13
Mon 20 Jan 2014 13:33:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43588531
Mon 20 Jan 2014 13:33:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:33:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:33:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:33:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:33:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:33:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43588531
Mon 20 Jan 2014 13:33:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:34:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:34:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:34:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:34:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:34:10 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 13:34:10 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:34:10 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:34:10 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:34:10 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:34:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:34:11 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:34:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:34:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:34:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:34:12 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:34:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:34:12 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:34:12 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:34:12 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:34:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:34:13 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:34:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 13:34:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:34:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 13:34:13 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:34:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9342 values 147493 bits 18436 bytes 
Mon 20 Jan 2014 13:34:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:34:16 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:34:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:34:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:34:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:34:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:34:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:34:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:34:18 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:34:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567874
Mon 20 Jan 2014 13:34:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:34:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567874
Mon 20 Jan 2014 13:34:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:34:24 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 13:34:24 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:34:25 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:34:25 - job_xml_thread(): Done retrieving: data size 43567874
Mon 20 Jan 2014 13:34:26 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:34:26 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:34:26 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 13:34:26 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:34:26 - XML: Start document: iteration 14
Mon 20 Jan 2014 13:34:26 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 13:34:26 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 13:34:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:34:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:34:31 - size of cluster 'LISA Cluster': 624 hosts 79475 metrics 805716 values 12736347 bits 1592043 bytes 
Mon 20 Jan 2014 13:34:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:34:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:34:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:34:36 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:34:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:34:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:34:36 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:34:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:34:36 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:34:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:34:36 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:34:38 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 13:34:38 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:34:38 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:34:38 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:34:38 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:34:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:34:42 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:34:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:34:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:34:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:34:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:34:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:34:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:34:42 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:34:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 13:34:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:34:45 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:34:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553387
Mon 20 Jan 2014 13:34:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:34:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553387
Mon 20 Jan 2014 13:34:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:34:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:34:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:34:53 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:34:53 - job_xml_thread(): Done retrieving: data size 43553387
Mon 20 Jan 2014 13:34:53 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:34:53 - XML: Start document: iteration 15
Mon 20 Jan 2014 13:34:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:34:55 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:34:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:34:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:34:55 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:34:55 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:34:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:34:55 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:34:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:34:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:34:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:35:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:35:08 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:35:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:35:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:35:08 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 13:35:08 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:35:08 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:35:08 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:35:08 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:35:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:35:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:35:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:35:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:35:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:35:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:35:11 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:35:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553636
Mon 20 Jan 2014 13:35:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:35:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553636
Mon 20 Jan 2014 13:35:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:35:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:35:13 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:35:14 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:35:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:35:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 13:35:14 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:35:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 13:35:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8831 values 139244 bits 17405 bytes 
Mon 20 Jan 2014 13:35:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:35:21 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:35:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:35:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:35:22 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:35:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:35:22 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:35:22 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:35:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:35:23 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:35:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:35:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:35:26 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:35:26 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 13:35:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:35:27 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:35:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:35:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:35:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:35:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:35:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:35:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:35:31 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:35:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43487695
Mon 20 Jan 2014 13:35:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:35:31 - job_xml_thread(): Done retrieving: data size 43487695
Mon 20 Jan 2014 13:35:31 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:35:31 - XML: Start document: iteration 16
Mon 20 Jan 2014 13:35:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43487695
Mon 20 Jan 2014 13:35:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:35:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:35:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:35:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:35:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:35:44 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:35:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 13:35:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:35:47 - XML: Processed 652596 elements - found 0 jobs
Mon 20 Jan 2014 13:35:47 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:35:47 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:35:47 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:35:47 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:35:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:35:50 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:35:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:35:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:35:51 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:35:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:35:51 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:35:51 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:35:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:35:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:35:55 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:35:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:35:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:35:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:35:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:35:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:35:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:35:58 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:35:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42912302
Mon 20 Jan 2014 13:35:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:35:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42912302
Mon 20 Jan 2014 13:35:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:36:03 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:36:03 - job_xml_thread(): Done retrieving: data size 42912302
Mon 20 Jan 2014 13:36:03 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:36:03 - XML: Start document: iteration 17
Mon 20 Jan 2014 13:36:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:36:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:36:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:36:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:36:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:36:11 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:36:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:36:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:36:13 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:36:13 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:36:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:36:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:36:13 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:36:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:36:15 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:36:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:36:16 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:36:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 13:36:16 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:36:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 13:36:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5951 values 93892 bits 11736 bytes 
Mon 20 Jan 2014 13:36:19 - XML: Processed 645188 elements - found 0 jobs
Mon 20 Jan 2014 13:36:19 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:36:19 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:36:19 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:36:19 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:36:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:36:19 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:36:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:36:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:36:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:36:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:36:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:36:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:36:23 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:36:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42974441
Mon 20 Jan 2014 13:36:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:36:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42974441
Mon 20 Jan 2014 13:36:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:36:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:36:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:36:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:36:33 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:36:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:36:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:36:34 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:36:34 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:36:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:36:34 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:36:34 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:36:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:36:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:36:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:36:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:36:40 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:36:40 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:36:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 13:36:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:36:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:36:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:36:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:36:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:36:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:36:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:36:43 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:36:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43358941
Mon 20 Jan 2014 13:36:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:36:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43358941
Mon 20 Jan 2014 13:36:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:36:44 - job_xml_thread(): Done retrieving: data size 43358941
Mon 20 Jan 2014 13:36:44 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:36:44 - XML: Start document: iteration 18
Mon 20 Jan 2014 13:36:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:36:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:36:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:36:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:36:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:36:59 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:36:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:36:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:37:00 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:37:00 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:37:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:37:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:37:00 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:37:03 - XML: Processed 650646 elements - found 0 jobs
Mon 20 Jan 2014 13:37:03 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:37:03 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:37:03 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:37:03 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:37:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:37:05 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:37:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:37:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:37:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:37:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:37:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:37:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:37:08 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:37:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575425
Mon 20 Jan 2014 13:37:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:37:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575425
Mon 20 Jan 2014 13:37:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:37:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:37:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:37:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:37:16 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:37:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:37:17 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:37:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 13:37:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 13:37:17 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:37:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8849 values 139525 bits 17440 bytes 
Mon 20 Jan 2014 13:37:18 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:37:18 - job_xml_thread(): Done retrieving: data size 43575425
Mon 20 Jan 2014 13:37:18 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:37:18 - XML: Start document: iteration 19
Mon 20 Jan 2014 13:37:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:37:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:37:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:37:27 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:37:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:37:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:37:28 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:37:28 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:37:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:37:28 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:37:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:37:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:37:30 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:37:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:37:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:37:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:37:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:37:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:37:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:37:33 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 13:37:33 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:37:33 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:37:33 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:37:33 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:37:37 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:37:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568943
Mon 20 Jan 2014 13:37:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:37:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568943
Mon 20 Jan 2014 13:37:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:37:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:37:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:37:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:37:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:37:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:37:47 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:37:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:37:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:37:47 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:37:47 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:37:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:37:47 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:37:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:37:48 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:37:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 13:37:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:37:48 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:37:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:37:52 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:37:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:37:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:37:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:37:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:37:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:37:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:37:55 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:37:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579442
Mon 20 Jan 2014 13:37:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:37:56 - job_xml_thread(): Done retrieving: data size 43579442
Mon 20 Jan 2014 13:37:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579442
Mon 20 Jan 2014 13:37:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:37:56 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:37:56 - XML: Start document: iteration 20
Mon 20 Jan 2014 13:38:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:38:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:38:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:38:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:38:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:38:09 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:38:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:38:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:38:10 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:38:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:38:10 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:38:10 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:38:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:38:14 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 13:38:14 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:38:14 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:38:14 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:38:14 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:38:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:38:17 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:38:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:38:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:38:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:38:18 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:38:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:38:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:38:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:38:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:38:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:38:18 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:38:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 13:38:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 13:38:18 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:38:18 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5925 values 93438 bits 11679 bytes 
Mon 20 Jan 2014 13:38:19 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 13:38:19 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 13:38:19 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:38:21 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:38:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564176
Mon 20 Jan 2014 13:38:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:38:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564176
Mon 20 Jan 2014 13:38:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:38:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:38:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:38:29 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:38:29 - job_xml_thread(): Done retrieving: data size 43564176
Mon 20 Jan 2014 13:38:29 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:38:29 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 13:38:29 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 13:38:29 - Housekeeping: done.
Mon 20 Jan 2014 13:38:29 - XML: Start document: iteration 0
Mon 20 Jan 2014 13:38:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:38:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:38:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:38:36 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:38:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:38:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:38:36 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:38:36 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:38:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:38:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:38:37 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:38:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:38:39 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:38:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:38:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:38:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:38:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:38:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:38:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:38:43 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 13:38:43 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:38:43 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:38:43 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:38:43 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:38:43 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:38:43 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 13:38:43 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:38:45 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:38:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554395
Mon 20 Jan 2014 13:38:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:38:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554395
Mon 20 Jan 2014 13:38:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:38:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:38:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:38:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:38:54 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:38:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:38:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:38:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:38:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:38:56 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:38:56 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:38:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:38:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:38:57 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:38:58 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:38:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:38:58 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:38:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:38:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:38:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:38:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:38:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:38:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:39:01 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:39:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573902
Mon 20 Jan 2014 13:39:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:39:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573902
Mon 20 Jan 2014 13:39:01 - job_xml_thread(): Done retrieving: data size 43573902
Mon 20 Jan 2014 13:39:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:39:01 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:39:01 - XML: Start document: iteration 1
Mon 20 Jan 2014 13:39:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:39:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:39:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:39:12 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:39:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:39:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:39:13 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:39:13 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:39:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:39:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:39:13 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:39:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:39:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:39:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:39:18 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:39:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:39:19 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:39:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 13:39:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 13:39:19 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:39:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8875 values 139968 bits 17496 bytes 
Mon 20 Jan 2014 13:39:22 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 13:39:22 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:39:22 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:39:22 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:39:22 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:39:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:39:24 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:39:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:39:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:39:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:39:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:39:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:39:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:39:26 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:39:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560083
Mon 20 Jan 2014 13:39:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:39:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560083
Mon 20 Jan 2014 13:39:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:39:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:39:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:39:37 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:39:37 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:39:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:39:38 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:39:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:39:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:39:39 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:39:39 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:39:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:39:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:39:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:39:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:39:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:39:42 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:39:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:39:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:39:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:39:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:39:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:39:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:39:42 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:39:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 13:39:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:39:44 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:39:44 - job_xml_thread(): Done retrieving: data size 43558643
Mon 20 Jan 2014 13:39:44 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:39:44 - XML: Start document: iteration 2
Mon 20 Jan 2014 13:39:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558643
Mon 20 Jan 2014 13:39:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:39:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558643
Mon 20 Jan 2014 13:39:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:39:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:39:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:39:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:39:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:40:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:40:02 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:40:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:40:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:40:03 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:40:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:40:03 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:40:03 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:40:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:40:03 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 13:40:03 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:40:04 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:40:04 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:40:04 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:40:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:40:05 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:40:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:40:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:40:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:40:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:40:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:40:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:40:07 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:40:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580459
Mon 20 Jan 2014 13:40:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:40:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580459
Mon 20 Jan 2014 13:40:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:40:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:40:17 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:40:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:40:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:40:19 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:40:19 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:40:19 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:40:19 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:40:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:40:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:40:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:40:19 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:40:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:40:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:40:20 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:40:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 13:40:20 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:40:20 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:40:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 13:40:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8871 values 139857 bits 17482 bytes 
Mon 20 Jan 2014 13:40:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:40:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:40:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:40:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:40:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:40:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:40:23 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:40:23 - job_xml_thread(): Done retrieving: data size 43585327
Mon 20 Jan 2014 13:40:23 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:40:23 - XML: Start document: iteration 3
Mon 20 Jan 2014 13:40:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43585327
Mon 20 Jan 2014 13:40:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43585327
Mon 20 Jan 2014 13:40:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:40:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:40:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:40:34 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:40:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:40:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:40:35 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:40:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:40:35 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:40:35 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:40:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:40:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:40:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:40:44 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 13:40:44 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:40:44 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:40:44 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:40:45 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:40:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:40:46 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:40:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:40:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:40:46 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:40:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 13:40:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:40:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:40:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:40:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:40:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:40:48 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:40:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43539856
Mon 20 Jan 2014 13:40:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:40:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43539856
Mon 20 Jan 2014 13:40:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:40:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:40:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:40:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:40:57 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:40:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:40:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:40:58 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:40:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:40:58 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:40:59 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:40:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:41:00 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:41:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:41:02 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:41:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:41:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:41:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:41:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:41:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:41:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:41:04 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:41:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579369
Mon 20 Jan 2014 13:41:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:41:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579369
Mon 20 Jan 2014 13:41:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:41:05 - job_xml_thread(): Done retrieving: data size 43579369
Mon 20 Jan 2014 13:41:05 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:41:05 - XML: Start document: iteration 4
Mon 20 Jan 2014 13:41:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:41:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:41:15 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:41:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:41:16 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:41:16 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:41:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:41:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:41:16 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:41:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:41:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:41:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:41:20 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:41:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:41:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 13:41:21 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:41:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 13:41:21 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:41:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8792 values 138637 bits 17329 bytes 
Mon 20 Jan 2014 13:41:23 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 13:41:23 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:41:23 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:41:23 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:41:23 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:41:26 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 13:41:26 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:41:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:41:26 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:41:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:41:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:41:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:41:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:41:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:41:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:41:26 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:41:26 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 13:41:26 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:41:26 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 13:41:26 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 13:41:27 - size of cluster 'LISA Cluster': 624 hosts 79487 metrics 860375 values 13577673 bits 1697209 bytes 
Mon 20 Jan 2014 13:41:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:41:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:41:32 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:41:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43474536
Mon 20 Jan 2014 13:41:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:41:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43474536
Mon 20 Jan 2014 13:41:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:41:38 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:41:38 - job_xml_thread(): Done retrieving: data size 43474536
Mon 20 Jan 2014 13:41:38 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:41:38 - XML: Start document: iteration 5
Mon 20 Jan 2014 13:41:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:41:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:41:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:41:41 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:41:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:41:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:41:42 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:41:42 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:41:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:41:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:41:42 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:41:45 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:41:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 13:41:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:41:52 - XML: Processed 652596 elements - found 0 jobs
Mon 20 Jan 2014 13:41:52 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:41:52 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:41:52 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:41:52 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:41:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:41:54 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:41:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:41:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:41:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:41:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:41:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:41:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:41:57 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:41:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42943590
Mon 20 Jan 2014 13:41:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:41:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42943590
Mon 20 Jan 2014 13:41:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:41:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:41:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:42:07 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:42:07 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:42:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:42:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:42:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:42:10 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:42:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:42:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:42:11 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:42:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:42:11 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:42:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:42:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:42:12 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:42:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:42:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:42:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:42:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:42:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:42:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:42:16 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:42:16 - job_xml_thread(): Done retrieving: data size 42939884
Mon 20 Jan 2014 13:42:16 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:42:16 - XML: Start document: iteration 6
Mon 20 Jan 2014 13:42:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42939884
Mon 20 Jan 2014 13:42:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:42:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42939884
Mon 20 Jan 2014 13:42:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:42:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:42:21 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:42:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:42:22 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:42:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 13:42:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 13:42:22 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:42:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9189 values 144923 bits 18115 bytes 
Mon 20 Jan 2014 13:42:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:42:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:42:26 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:42:26 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 13:42:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:42:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:42:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:42:32 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:42:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:42:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:42:33 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:42:33 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:42:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:42:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:42:33 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:42:36 - XML: Processed 645606 elements - found 0 jobs
Mon 20 Jan 2014 13:42:36 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:42:36 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:42:36 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:42:37 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:42:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:42:41 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:42:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:42:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:42:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:42:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:42:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:42:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:42:44 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:42:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43443698
Mon 20 Jan 2014 13:42:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:42:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43443698
Mon 20 Jan 2014 13:42:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:42:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:42:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:42:52 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:42:52 - job_xml_thread(): Done retrieving: data size 43443698
Mon 20 Jan 2014 13:42:52 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:42:52 - XML: Start document: iteration 7
Mon 20 Jan 2014 13:42:56 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:42:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 13:42:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:42:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:42:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:43:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:43:02 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:43:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:43:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:43:03 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:43:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:43:03 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:43:03 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:43:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:43:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:43:06 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:43:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:43:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:43:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:43:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:43:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:43:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:43:08 - XML: Processed 651908 elements - found 0 jobs
Mon 20 Jan 2014 13:43:08 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:43:08 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:43:08 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:43:08 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:43:11 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:43:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579041
Mon 20 Jan 2014 13:43:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:43:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579041
Mon 20 Jan 2014 13:43:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:43:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:43:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:43:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:43:21 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:43:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:43:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:43:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:43:22 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:43:22 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:43:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:43:22 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:43:22 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:43:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:43:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:43:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:43:23 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:43:23 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:43:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 13:43:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:43:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 13:43:23 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:43:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6167 values 97253 bits 12156 bytes 
Mon 20 Jan 2014 13:43:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:43:26 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:43:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:43:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:43:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:43:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:43:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:43:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:43:30 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:43:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575355
Mon 20 Jan 2014 13:43:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:43:31 - job_xml_thread(): Done retrieving: data size 43575355
Mon 20 Jan 2014 13:43:31 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:43:31 - XML: Start document: iteration 8
Mon 20 Jan 2014 13:43:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575355
Mon 20 Jan 2014 13:43:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:43:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:43:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:43:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:43:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:43:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:43:45 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:43:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:43:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:43:46 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:43:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:43:46 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:43:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:43:46 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:43:47 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 13:43:47 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:43:47 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:43:48 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:43:48 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:43:50 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:43:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 13:43:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:43:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:43:52 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:43:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:43:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:43:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:43:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:43:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:43:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:43:56 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:43:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570036
Mon 20 Jan 2014 13:43:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:43:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570036
Mon 20 Jan 2014 13:43:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:44:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:44:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:44:03 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:44:03 - job_xml_thread(): Done retrieving: data size 43570036
Mon 20 Jan 2014 13:44:03 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:44:03 - XML: Start document: iteration 9
Mon 20 Jan 2014 13:44:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:44:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:44:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:44:11 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:44:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:44:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:44:12 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:44:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:44:12 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:44:12 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:44:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:44:14 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 13:44:14 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:44:14 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:44:14 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:44:14 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:44:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:44:17 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:44:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:44:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:44:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:44:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:44:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:44:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:44:21 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:44:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559477
Mon 20 Jan 2014 13:44:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:44:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559477
Mon 20 Jan 2014 13:44:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:44:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:44:23 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:44:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:44:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 13:44:24 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:44:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 13:44:24 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:44:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9061 values 142922 bits 17865 bytes 
Mon 20 Jan 2014 13:44:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:44:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:44:29 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:44:29 - job_xml_thread(): Done retrieving: data size 43559477
Mon 20 Jan 2014 13:44:29 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:44:29 - XML: Start document: iteration 10
Mon 20 Jan 2014 13:44:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:44:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:44:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:44:37 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:44:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:44:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:44:37 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:44:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:44:37 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:44:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:44:37 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:44:42 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 13:44:42 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:44:42 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:44:43 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:44:43 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:44:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:44:45 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:44:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:44:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:44:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:44:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:44:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:44:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:44:49 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:44:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43550528
Mon 20 Jan 2014 13:44:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:44:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43550528
Mon 20 Jan 2014 13:44:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:44:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:44:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:44:56 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:44:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 13:44:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:44:58 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:44:58 - job_xml_thread(): Done retrieving: data size 43550528
Mon 20 Jan 2014 13:44:58 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:44:58 - XML: Start document: iteration 11
Mon 20 Jan 2014 13:45:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:45:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:45:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:45:04 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:45:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:45:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:45:04 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:45:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:45:04 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:45:04 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:45:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:45:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:45:11 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:45:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:45:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:45:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:45:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:45:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:45:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:45:12 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 13:45:12 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:45:12 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:45:12 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:45:12 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:45:15 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:45:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565389
Mon 20 Jan 2014 13:45:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:45:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565389
Mon 20 Jan 2014 13:45:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:45:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:45:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:45:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:45:25 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:45:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:45:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:45:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:45:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 13:45:26 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:45:26 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:45:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 13:45:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6068 values 95681 bits 11960 bytes 
Mon 20 Jan 2014 13:45:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:45:27 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:45:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:45:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:45:27 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:45:27 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:45:28 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:45:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:45:28 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:45:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:45:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:45:29 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:45:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:45:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:45:30 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 13:45:30 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 13:45:30 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:45:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:45:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:45:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:45:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:45:32 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:45:32 - job_xml_thread(): Done retrieving: data size 43571578
Mon 20 Jan 2014 13:45:32 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:45:32 - XML: Start document: iteration 12
Mon 20 Jan 2014 13:45:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571578
Mon 20 Jan 2014 13:45:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:45:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571578
Mon 20 Jan 2014 13:45:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:45:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:45:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:45:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:45:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:45:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:45:51 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:45:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:45:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:45:51 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:45:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:45:51 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:45:51 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:45:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:45:51 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 13:45:51 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:45:51 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:45:51 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:45:51 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:45:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:45:54 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:45:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:45:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:45:54 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:45:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 13:45:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:45:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:45:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:45:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:45:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:45:56 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:45:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43590054
Mon 20 Jan 2014 13:45:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:45:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43590054
Mon 20 Jan 2014 13:45:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:46:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:46:06 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:46:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:46:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:46:06 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:46:06 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:46:07 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:46:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:46:08 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:46:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:46:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:46:10 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:46:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:46:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:46:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:46:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:46:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:46:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:46:12 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:46:12 - job_xml_thread(): Done retrieving: data size 43587546
Mon 20 Jan 2014 13:46:12 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:46:12 - XML: Start document: iteration 13
Mon 20 Jan 2014 13:46:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43587546
Mon 20 Jan 2014 13:46:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43587546
Mon 20 Jan 2014 13:46:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:46:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:46:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:46:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:46:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:46:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:46:25 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:46:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:46:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:46:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:46:26 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:46:26 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:46:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:46:26 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:46:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:46:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:46:27 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:46:28 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:46:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 13:46:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:46:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 13:46:28 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:46:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9080 values 143425 bits 17928 bytes 
Mon 20 Jan 2014 13:46:29 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 13:46:29 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:46:29 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:46:29 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:46:29 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:46:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:46:32 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:46:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:46:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:46:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:46:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:46:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:46:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:46:34 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:46:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574874
Mon 20 Jan 2014 13:46:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:46:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574874
Mon 20 Jan 2014 13:46:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:46:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:46:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:46:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:46:42 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:46:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:46:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:46:43 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:46:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:46:43 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:46:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:46:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574874
Mon 20 Jan 2014 13:46:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:46:44 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:46:45 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:46:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:46:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:46:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:46:50 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:46:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:46:54 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:46:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:46:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:46:55 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:46:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 13:46:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:46:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:46:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:46:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:46:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:46:57 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:46:57 - job_xml_thread(): Done retrieving: data size 43572837
Mon 20 Jan 2014 13:46:57 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:46:57 - XML: Start document: iteration 14
Mon 20 Jan 2014 13:46:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572837
Mon 20 Jan 2014 13:46:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:46:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:46:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:46:59 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:46:59 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:46:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:46:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:46:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572837
Mon 20 Jan 2014 13:46:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:47:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:47:08 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:47:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:47:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:47:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:47:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:47:16 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:47:16 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:47:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:47:16 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:47:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:47:17 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 13:47:17 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:47:17 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:47:17 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:47:17 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:47:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:47:19 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:47:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:47:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:47:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:47:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:47:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:47:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:47:21 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:47:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43514037
Mon 20 Jan 2014 13:47:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:47:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43514037
Mon 20 Jan 2014 13:47:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:47:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:47:28 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:47:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:47:31 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:47:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 13:47:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 13:47:31 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:47:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8670 values 137036 bits 17129 bytes 
Mon 20 Jan 2014 13:47:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:47:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:47:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:47:32 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:47:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:47:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:47:32 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:47:32 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:47:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:47:32 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:47:32 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:47:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:47:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:47:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:47:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:47:35 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:47:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:47:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:47:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:47:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:47:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:47:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:47:37 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:47:37 - job_xml_thread(): Done retrieving: data size 42989743
Mon 20 Jan 2014 13:47:37 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:47:37 - XML: Start document: iteration 15
Mon 20 Jan 2014 13:47:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42989743
Mon 20 Jan 2014 13:47:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42989743
Mon 20 Jan 2014 13:47:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:47:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:47:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:47:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:47:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:47:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:47:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:47:57 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:47:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:47:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:47:58 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:47:58 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:47:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:47:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:47:58 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:47:59 - XML: Processed 646092 elements - found 0 jobs
Mon 20 Jan 2014 13:47:59 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:47:59 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:47:59 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:47:59 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:48:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:48:00 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:48:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:48:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:48:01 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:48:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 13:48:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:48:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:48:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:48:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:48:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:48:02 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:48:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42907666
Mon 20 Jan 2014 13:48:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:48:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42907666
Mon 20 Jan 2014 13:48:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:48:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:48:11 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:48:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:48:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:48:14 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:48:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:48:14 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:48:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:48:14 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:48:15 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:48:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:48:15 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:48:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:48:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:48:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:48:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:48:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:48:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:48:17 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:48:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42987283
Mon 20 Jan 2014 13:48:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:48:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42987283
Mon 20 Jan 2014 13:48:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:48:18 - job_xml_thread(): Done retrieving: data size 42987283
Mon 20 Jan 2014 13:48:19 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:48:19 - XML: Start document: iteration 16
Mon 20 Jan 2014 13:48:27 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 13:48:27 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:48:28 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:48:28 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:48:28 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 13:48:28 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 13:48:28 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 13:48:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:48:28 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:48:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:48:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:48:29 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:48:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:48:29 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:48:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:48:29 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:48:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:48:31 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:48:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:48:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:48:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:48:32 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:48:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 13:48:32 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:48:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 13:48:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8652 values 136701 bits 17087 bytes 
Mon 20 Jan 2014 13:48:33 - size of cluster 'LISA Cluster': 624 hosts 79468 metrics 852830 values 13482681 bits 1685335 bytes 
Mon 20 Jan 2014 13:48:38 - XML: Processed 645908 elements - found 0 jobs
Mon 20 Jan 2014 13:48:38 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:48:38 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:48:38 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:48:38 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:48:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:48:41 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:48:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:48:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:48:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:48:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:48:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:48:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:48:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:48:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:48:45 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:48:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43406519
Mon 20 Jan 2014 13:48:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:48:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43406519
Mon 20 Jan 2014 13:48:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:48:53 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:48:53 - job_xml_thread(): Done retrieving: data size 43406519
Mon 20 Jan 2014 13:48:53 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:48:53 - XML: Start document: iteration 17
Mon 20 Jan 2014 13:48:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:48:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:49:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:49:01 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:49:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:49:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:49:03 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:49:03 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:49:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:49:03 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:49:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:49:07 - XML: Processed 651607 elements - found 0 jobs
Mon 20 Jan 2014 13:49:07 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:49:07 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:49:07 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:49:07 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:49:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:49:09 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:49:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:49:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:49:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:49:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:49:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:49:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:49:10 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:49:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 13:49:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:49:12 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:49:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571273
Mon 20 Jan 2014 13:49:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:49:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571273
Mon 20 Jan 2014 13:49:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:49:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:49:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:49:22 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:49:22 - job_xml_thread(): Done retrieving: data size 43571273
Mon 20 Jan 2014 13:49:22 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:49:22 - XML: Start document: iteration 18
Mon 20 Jan 2014 13:49:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:49:23 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:49:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:49:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:49:24 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:49:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:49:24 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:49:24 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:49:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:49:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:49:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:49:28 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:49:28 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 13:49:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:49:33 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:49:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:49:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 13:49:34 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:49:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 13:49:34 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:49:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5813 values 91704 bits 11463 bytes 
Mon 20 Jan 2014 13:49:35 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 13:49:35 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:49:35 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:49:35 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:49:35 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:49:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:49:36 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:49:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:49:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:49:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:49:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:49:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:49:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:49:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:49:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:49:40 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:49:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43538115
Mon 20 Jan 2014 13:49:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:49:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43538115
Mon 20 Jan 2014 13:49:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:49:50 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:49:50 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:49:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:49:50 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:49:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:49:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:49:50 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:49:50 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:49:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:49:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:49:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:49:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:49:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:49:55 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:49:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:49:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:49:55 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:49:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 13:49:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:49:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:49:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:49:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:49:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:49:58 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:49:58 - job_xml_thread(): Done retrieving: data size 43572529
Mon 20 Jan 2014 13:49:58 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:49:58 - XML: Start document: iteration 19
Mon 20 Jan 2014 13:49:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572529
Mon 20 Jan 2014 13:49:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:49:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572529
Mon 20 Jan 2014 13:49:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:50:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:50:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:50:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:50:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:50:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:50:12 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:50:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:50:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:50:13 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:50:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:50:13 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:50:13 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:50:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:50:19 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 13:50:19 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:50:19 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:50:19 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:50:19 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:50:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:50:22 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:50:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:50:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:50:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:50:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:50:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:50:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:50:25 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:50:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43552727
Mon 20 Jan 2014 13:50:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:50:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43552727
Mon 20 Jan 2014 13:50:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:50:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:50:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:50:34 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:50:34 - job_xml_thread(): Done retrieving: data size 43552727
Mon 20 Jan 2014 13:50:34 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:50:34 - XML: Start document: iteration 20
Mon 20 Jan 2014 13:50:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:50:34 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:50:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:50:35 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:50:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 13:50:35 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:50:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 13:50:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8713 values 137383 bits 17172 bytes 
Mon 20 Jan 2014 13:50:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:50:37 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:50:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:50:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:50:38 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:50:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:50:38 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:50:38 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:50:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:50:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:50:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:50:47 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 13:50:47 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:50:47 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:50:47 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:50:47 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:50:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:50:50 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:50:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:50:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:50:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:50:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:50:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:50:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:50:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:50:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:50:54 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:50:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43540387
Mon 20 Jan 2014 13:50:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:50:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43540387
Mon 20 Jan 2014 13:50:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:51:02 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:51:02 - job_xml_thread(): Done retrieving: data size 43540387
Mon 20 Jan 2014 13:51:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:51:02 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:51:02 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:51:02 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 13:51:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:51:03 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 13:51:03 - Housekeeping: done.
Mon 20 Jan 2014 13:51:03 - XML: Start document: iteration 0
Mon 20 Jan 2014 13:51:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:51:03 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:51:03 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:51:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:51:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43540387
Mon 20 Jan 2014 13:51:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:51:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:51:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:51:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:51:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:51:14 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:51:15 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:51:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 13:51:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:51:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:51:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:51:20 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:51:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:51:20 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:51:20 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:51:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:51:20 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 13:51:20 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:51:20 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:51:20 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:51:20 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:51:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:51:24 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:51:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:51:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:51:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:51:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:51:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:51:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:51:28 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:51:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578683
Mon 20 Jan 2014 13:51:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:51:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578683
Mon 20 Jan 2014 13:51:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:51:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:51:35 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:51:35 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:51:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:51:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 13:51:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 13:51:35 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:51:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6122 values 96599 bits 12074 bytes 
Mon 20 Jan 2014 13:51:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:51:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:51:36 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:51:36 - job_xml_thread(): Done retrieving: data size 43578683
Mon 20 Jan 2014 13:51:36 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:51:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:51:36 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:51:36 - XML: Start document: iteration 1
Mon 20 Jan 2014 13:51:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:51:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:51:38 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:51:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:51:38 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:51:38 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:51:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:51:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:51:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:51:49 - XML: Processed 653350 elements - found 0 jobs
Mon 20 Jan 2014 13:51:49 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:51:49 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:51:49 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:51:49 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:51:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:51:51 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:51:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:51:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:51:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:51:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:51:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:51:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:51:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:51:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:51:55 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:51:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43545702
Mon 20 Jan 2014 13:51:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:51:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43545702
Mon 20 Jan 2014 13:51:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:52:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:52:02 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:52:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:52:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:52:03 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:52:03 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:52:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:52:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43545702
Mon 20 Jan 2014 13:52:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:52:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:52:04 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:52:04 - job_xml_thread(): Done retrieving: data size 43545702
Mon 20 Jan 2014 13:52:04 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:52:04 - XML: Start document: iteration 2
Mon 20 Jan 2014 13:52:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:52:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:52:15 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 13:52:15 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:52:15 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:52:15 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:52:15 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:52:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:52:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:52:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:52:23 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:52:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:52:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:52:23 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:52:23 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:52:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:52:23 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:52:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:52:23 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:52:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 13:52:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:52:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:52:25 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:52:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:52:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:52:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:52:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:52:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:52:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:52:28 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:52:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578234
Mon 20 Jan 2014 13:52:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:52:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578234
Mon 20 Jan 2014 13:52:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:52:30 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:52:30 - job_xml_thread(): Done retrieving: data size 43578234
Mon 20 Jan 2014 13:52:30 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:52:30 - XML: Start document: iteration 3
Mon 20 Jan 2014 13:52:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:52:35 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:52:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:52:36 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:52:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 13:52:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 13:52:36 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:52:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5943 values 93746 bits 11718 bytes 
Mon 20 Jan 2014 13:52:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:52:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:52:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:52:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:52:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:52:48 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:52:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:52:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:52:51 - XML: Processed 653356 elements - found 0 jobs
Mon 20 Jan 2014 13:52:51 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:52:51 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:52:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:52:51 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:52:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:52:51 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:52:51 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:52:51 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:52:51 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:52:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:52:52 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:52:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:52:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:52:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:52:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:52:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:52:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:52:57 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:52:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43587424
Mon 20 Jan 2014 13:52:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:52:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43587424
Mon 20 Jan 2014 13:52:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:53:06 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:53:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:53:06 - job_xml_thread(): Done retrieving: data size 43587424
Mon 20 Jan 2014 13:53:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:53:06 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:53:06 - XML: Start document: iteration 4
Mon 20 Jan 2014 13:53:06 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:53:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 13:53:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:53:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:53:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:53:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:53:12 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:53:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:53:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:53:13 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:53:13 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:53:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:53:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:53:13 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:53:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:53:16 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:53:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:53:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:53:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:53:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:53:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:53:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:53:19 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 13:53:19 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:53:19 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:53:19 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:53:19 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:53:19 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 13:53:19 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 13:53:19 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:53:21 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:53:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43506624
Mon 20 Jan 2014 13:53:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:53:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43506624
Mon 20 Jan 2014 13:53:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:53:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:53:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:53:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:53:31 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:53:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:53:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:53:31 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:53:31 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:53:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:53:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:53:31 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:53:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:53:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:53:34 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:53:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:53:35 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:53:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:53:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:53:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:53:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:53:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:53:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:53:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:53:36 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:53:36 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:53:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43022927
Mon 20 Jan 2014 13:53:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:53:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43022927
Mon 20 Jan 2014 13:53:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:53:37 - job_xml_thread(): Done retrieving: data size 43022927
Mon 20 Jan 2014 13:53:37 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:53:37 - XML: Start document: iteration 5
Mon 20 Jan 2014 13:53:38 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:53:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:53:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 13:53:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 13:53:38 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:53:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7698 values 121484 bits 15185 bytes 
Mon 20 Jan 2014 13:53:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:53:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:53:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:53:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:53:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:53:52 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:53:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:53:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:53:53 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:53:53 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:53:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:53:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:53:53 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:53:57 - XML: Processed 646458 elements - found 0 jobs
Mon 20 Jan 2014 13:53:57 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:53:57 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:53:57 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:53:57 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:53:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:53:59 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:53:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:53:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:54:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:54:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:54:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:54:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:54:01 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:54:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42890994
Mon 20 Jan 2014 13:54:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:54:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42890994
Mon 20 Jan 2014 13:54:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:54:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:54:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:54:12 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:54:12 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:54:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:54:12 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:54:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:54:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:54:13 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:54:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:54:13 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:54:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:54:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:54:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:54:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:54:17 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:54:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:54:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:54:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:54:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:54:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:54:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:54:17 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:54:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 13:54:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:54:19 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:54:19 - job_xml_thread(): Done retrieving: data size 42969156
Mon 20 Jan 2014 13:54:19 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:54:19 - XML: Start document: iteration 6
Mon 20 Jan 2014 13:54:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42969156
Mon 20 Jan 2014 13:54:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42969156
Mon 20 Jan 2014 13:54:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:54:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:54:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:54:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:54:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:54:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:54:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:54:36 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:54:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:54:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:54:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:54:38 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:54:38 - XML: Processed 645908 elements - found 0 jobs
Mon 20 Jan 2014 13:54:38 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:54:38 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:54:38 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:54:38 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:54:39 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:54:39 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:54:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:54:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:54:39 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:54:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:54:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 13:54:40 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:54:40 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:54:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 13:54:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5714 values 90087 bits 11260 bytes 
Mon 20 Jan 2014 13:54:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:54:42 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:54:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:54:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:54:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:54:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:54:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:54:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:54:44 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:54:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43468107
Mon 20 Jan 2014 13:54:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:54:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43468107
Mon 20 Jan 2014 13:54:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:54:54 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:54:54 - job_xml_thread(): Done retrieving: data size 43468107
Mon 20 Jan 2014 13:54:54 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:54:54 - XML: Start document: iteration 7
Mon 20 Jan 2014 13:54:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:54:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:54:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:54:56 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:54:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:54:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:54:57 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:54:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:54:57 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:54:57 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:54:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:54:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:54:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:55:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:55:04 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:55:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:55:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:55:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:55:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:55:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:55:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:55:06 - XML: Processed 652108 elements - found 0 jobs
Mon 20 Jan 2014 13:55:06 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:55:06 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:55:06 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:55:06 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:55:06 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:55:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 13:55:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:55:07 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:55:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556814
Mon 20 Jan 2014 13:55:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:55:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556814
Mon 20 Jan 2014 13:55:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:55:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:55:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:55:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:55:16 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:55:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:55:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:55:18 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:55:18 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:55:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:55:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:55:18 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:55:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:55:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:55:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:55:21 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:55:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:55:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:55:21 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:55:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:55:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:55:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:55:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:55:23 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:55:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573140
Mon 20 Jan 2014 13:55:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:55:23 - job_xml_thread(): Done retrieving: data size 43573140
Mon 20 Jan 2014 13:55:23 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:55:23 - XML: Start document: iteration 8
Mon 20 Jan 2014 13:55:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573140
Mon 20 Jan 2014 13:55:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:55:28 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 13:55:28 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:55:30 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:55:30 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 13:55:30 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:55:30 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 13:55:30 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 13:55:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:55:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:55:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:55:36 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:55:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:55:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:55:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:55:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:55:37 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:55:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:55:37 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:55:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:55:37 - XMLGatherer.retrieveData(): actually retrieving data..
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Mon 20 Jan 2014 13:55:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:55:40 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:55:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:55:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 13:55:41 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:55:41 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:55:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 13:55:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8815 values 138966 bits 17370 bytes 
Mon 20 Jan 2014 13:55:45 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 13:55:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:55:45 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:55:45 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:55:45 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:55:45 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:55:45 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:55:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:55:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:55:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:55:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:55:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:55:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:55:47 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:55:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43543181
Mon 20 Jan 2014 13:55:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:55:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43543181
Mon 20 Jan 2014 13:55:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:55:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:55:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:55:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:55:58 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:55:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:55:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:55:59 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:55:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:55:59 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:55:59 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:56:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:56:01 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:56:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:56:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:56:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:56:02 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:56:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:56:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:56:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:56:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:56:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:56:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:56:03 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:56:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 13:56:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:56:04 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:56:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43585805
Mon 20 Jan 2014 13:56:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:56:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43585805
Mon 20 Jan 2014 13:56:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:56:05 - job_xml_thread(): Done retrieving: data size 43585805
Mon 20 Jan 2014 13:56:05 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:56:05 - XML: Start document: iteration 9
Mon 20 Jan 2014 13:56:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:56:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:56:16 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:56:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:56:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:56:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:56:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:56:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:56:18 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:56:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:56:18 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:56:18 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:56:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:56:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:56:27 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:56:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:56:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:56:27 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 13:56:27 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:56:27 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:56:27 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:56:27 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:56:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:56:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:56:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:56:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:56:29 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:56:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43545345
Mon 20 Jan 2014 13:56:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:56:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43545345
Mon 20 Jan 2014 13:56:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:56:31 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:56:31 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:56:33 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:56:33 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 13:56:33 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 13:56:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:56:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:56:33 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:56:33 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 13:56:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:56:39 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:56:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:56:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:56:39 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:56:39 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:56:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:56:39 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:56:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:56:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:56:41 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:56:41 - size of cluster 'LISA Cluster': 624 hosts 79484 metrics 873140 values 13782863 bits 1722857 bytes 
Mon 20 Jan 2014 13:56:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:56:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:56:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 13:56:43 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:56:43 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:56:43 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:56:43 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:56:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 13:56:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8725 values 137531 bits 17191 bytes 
Mon 20 Jan 2014 13:56:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:56:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:56:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:56:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:56:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:56:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:56:46 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:56:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565454
Mon 20 Jan 2014 13:56:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:56:47 - job_xml_thread(): Done retrieving: data size 43565454
Mon 20 Jan 2014 13:56:47 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:56:47 - XML: Start document: iteration 10
Mon 20 Jan 2014 13:56:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565454
Mon 20 Jan 2014 13:56:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:56:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:56:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:56:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:56:58 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:56:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:56:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:56:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:56:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:56:58 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:56:58 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:56:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:56:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:56:58 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:56:59 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:56:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 13:56:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:57:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:57:09 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:57:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:57:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:57:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:57:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:57:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:57:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:57:10 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 13:57:10 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:57:10 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:57:10 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:57:10 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:57:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:57:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:57:14 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:57:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43540274
Mon 20 Jan 2014 13:57:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:57:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43540274
Mon 20 Jan 2014 13:57:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:57:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:57:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:57:27 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:57:27 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:57:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:57:28 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:57:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:57:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:57:29 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:57:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:57:29 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:57:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:57:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:57:30 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:57:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:57:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:57:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:57:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:57:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:57:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:57:33 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:57:33 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 13:57:34 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:57:34 - job_xml_thread(): Done retrieving: data size 43581372
Mon 20 Jan 2014 13:57:34 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:57:34 - XML: Start document: iteration 11
Mon 20 Jan 2014 13:57:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581372
Mon 20 Jan 2014 13:57:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:57:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581372
Mon 20 Jan 2014 13:57:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:57:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:57:43 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:57:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:57:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 13:57:44 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:57:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 13:57:44 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:57:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9279 values 146287 bits 18285 bytes 
Mon 20 Jan 2014 13:57:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:57:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:57:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:57:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:57:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:57:51 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:57:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:57:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:57:52 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:57:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:57:52 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:57:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:57:52 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:57:56 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 13:57:56 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:57:56 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:57:56 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:57:56 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:57:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:57:58 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:57:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:57:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:57:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:57:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:57:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:57:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:58:01 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:58:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554364
Mon 20 Jan 2014 13:58:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:58:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554364
Mon 20 Jan 2014 13:58:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:58:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:58:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:58:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:58:10 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:58:11 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:58:11 - job_xml_thread(): Done retrieving: data size 43554364
Mon 20 Jan 2014 13:58:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:58:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:58:11 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:58:11 - XML: Start document: iteration 12
Mon 20 Jan 2014 13:58:12 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:58:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:58:12 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:58:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:58:12 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:58:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:58:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:58:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:58:24 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:58:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:58:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:58:25 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 13:58:25 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:58:25 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:58:25 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:58:25 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:58:25 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:58:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 13:58:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:58:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:58:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:58:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:58:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:58:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:58:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:58:27 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:58:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43550447
Mon 20 Jan 2014 13:58:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:58:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43550447
Mon 20 Jan 2014 13:58:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:58:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:58:38 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:58:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:58:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:58:39 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:58:39 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:58:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:58:39 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:58:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:58:40 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:58:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:58:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:58:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:58:43 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:58:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:58:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:58:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:58:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:58:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:58:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:58:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:58:44 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:58:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:58:45 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:58:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 13:58:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 13:58:45 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:58:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5506 values 86810 bits 10851 bytes 
Mon 20 Jan 2014 13:58:47 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:58:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568710
Mon 20 Jan 2014 13:58:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:58:47 - job_xml_thread(): Done retrieving: data size 43568710
Mon 20 Jan 2014 13:58:47 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:58:47 - XML: Start document: iteration 13
Mon 20 Jan 2014 13:58:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568710
Mon 20 Jan 2014 13:58:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:58:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:58:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:58:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:58:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:59:06 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 13:59:06 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:59:06 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:59:06 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:59:06 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:59:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:59:10 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:59:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:59:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:59:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:59:10 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:59:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:59:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:59:10 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:59:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:59:10 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:59:10 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:59:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:59:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:59:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:59:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:59:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:59:13 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:59:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 13:59:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:59:14 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:59:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43498731
Mon 20 Jan 2014 13:59:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:59:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43498731
Mon 20 Jan 2014 13:59:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:59:21 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:59:21 - job_xml_thread(): Done retrieving: data size 43498731
Mon 20 Jan 2014 13:59:21 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 13:59:21 - XML: Start document: iteration 14
Mon 20 Jan 2014 13:59:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:59:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:59:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:59:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:59:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:59:27 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:59:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:59:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:59:27 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:59:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:59:27 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:59:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:59:27 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:59:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:59:37 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:59:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:59:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:59:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:59:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:59:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:59:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 13:59:38 - XML: Processed 652608 elements - found 0 jobs
Mon 20 Jan 2014 13:59:38 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 13:59:38 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 13:59:38 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 13:59:38 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 13:59:41 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 13:59:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43044606
Mon 20 Jan 2014 13:59:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 13:59:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43044606
Mon 20 Jan 2014 13:59:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 13:59:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:59:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:59:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 13:59:45 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:59:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:59:46 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:59:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 13:59:46 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 13:59:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 13:59:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7299 values 115001 bits 14375 bytes 
Mon 20 Jan 2014 13:59:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 13:59:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 13:59:53 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 13:59:53 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 13:59:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 13:59:54 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 13:59:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 13:59:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 13:59:55 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:59:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 13:59:55 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 13:59:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 13:59:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 13:59:57 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 13:59:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 13:59:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 13:59:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:59:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 13:59:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 13:59:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:00:00 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 14:00:00 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 14:00:00 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:00:00 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:00:00 - job_xml_thread(): Done retrieving: data size 42897095
Mon 20 Jan 2014 14:00:00 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:00:00 - XML: Start document: iteration 15
Mon 20 Jan 2014 14:00:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42897095
Mon 20 Jan 2014 14:00:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:00:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42897095
Mon 20 Jan 2014 14:00:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:00:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:00:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:00:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:00:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:00:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:00:14 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:00:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:00:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:00:15 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:00:15 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:00:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:00:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:00:15 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:00:19 - XML: Processed 645168 elements - found 0 jobs
Mon 20 Jan 2014 14:00:19 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:00:19 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:00:19 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:00:19 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:00:21 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:00:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 14:00:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:00:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:00:23 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:00:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:00:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:00:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:00:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:00:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:00:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:00:25 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:00:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42955889
Mon 20 Jan 2014 14:00:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:00:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42955889
Mon 20 Jan 2014 14:00:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:00:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:00:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:00:34 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:00:34 - job_xml_thread(): Done retrieving: data size 42955889
Mon 20 Jan 2014 14:00:34 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:00:34 - XML: Start document: iteration 16
Mon 20 Jan 2014 14:00:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:00:39 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:00:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:00:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:00:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:00:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:00:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:00:41 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:00:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:00:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:00:42 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:00:42 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:00:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:00:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:00:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:00:42 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:00:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:00:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:00:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:00:44 - XML: Processed 645920 elements - found 0 jobs
Mon 20 Jan 2014 14:00:44 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:00:44 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:00:44 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:00:44 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:00:46 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:00:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43507740
Mon 20 Jan 2014 14:00:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:00:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43507740
Mon 20 Jan 2014 14:00:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:00:47 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:00:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:00:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:00:48 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:00:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 14:00:48 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:00:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 14:00:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8887 values 140182 bits 17522 bytes 
Mon 20 Jan 2014 14:00:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:00:54 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:00:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:00:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:00:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:00:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:00:58 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:00:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:00:58 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:00:58 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:00:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:00:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:00:59 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:00:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:00:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:00:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:00:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:00:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:00:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:00:59 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:01:02 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:01:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579923
Mon 20 Jan 2014 14:01:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:01:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579923
Mon 20 Jan 2014 14:01:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:01:02 - job_xml_thread(): Done retrieving: data size 43579923
Mon 20 Jan 2014 14:01:02 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:01:02 - XML: Start document: iteration 17
Mon 20 Jan 2014 14:01:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:01:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:01:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:01:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:01:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:01:20 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:01:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:01:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:01:21 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:01:21 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:01:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:01:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:01:21 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:01:23 - XML: Processed 653328 elements - found 0 jobs
Mon 20 Jan 2014 14:01:23 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:01:23 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:01:23 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:01:23 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:01:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:01:24 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:01:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:01:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:01:24 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:01:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 14:01:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:01:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:01:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:01:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:01:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:01:26 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:01:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563913
Mon 20 Jan 2014 14:01:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:01:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563913
Mon 20 Jan 2014 14:01:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:01:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:01:35 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:01:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:01:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:01:37 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:01:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:01:38 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:01:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:01:38 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:01:38 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:01:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:01:39 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:01:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:01:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:01:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:01:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:01:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:01:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:01:40 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:01:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569747
Mon 20 Jan 2014 14:01:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:01:41 - job_xml_thread(): Done retrieving: data size 43569747
Mon 20 Jan 2014 14:01:41 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:01:41 - XML: Start document: iteration 18
Mon 20 Jan 2014 14:01:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569747
Mon 20 Jan 2014 14:01:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:01:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:01:49 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:01:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:01:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 14:01:50 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:01:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 14:01:50 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:01:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8783 values 138756 bits 17344 bytes 
Mon 20 Jan 2014 14:01:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:01:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:01:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:01:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:01:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:01:57 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:01:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:01:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:01:57 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:01:57 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:01:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:01:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:01:58 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:01:59 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 14:01:59 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:01:59 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:01:59 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:01:59 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:02:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:02:03 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:02:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:02:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:02:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:02:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:02:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:02:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:02:06 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:02:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579950
Mon 20 Jan 2014 14:02:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:02:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579950
Mon 20 Jan 2014 14:02:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:02:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:02:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:02:14 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:02:14 - job_xml_thread(): Done retrieving: data size 43579950
Mon 20 Jan 2014 14:02:14 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:02:14 - XML: Start document: iteration 19
Mon 20 Jan 2014 14:02:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:02:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:02:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:02:20 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:02:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:02:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:02:21 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:02:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:02:21 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:02:21 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:02:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:02:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:02:24 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:02:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:02:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:02:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:02:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:02:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:02:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:02:27 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 14:02:27 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:02:27 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:02:27 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:02:27 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:02:27 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:02:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 14:02:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:02:29 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:02:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553797
Mon 20 Jan 2014 14:02:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:02:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553797
Mon 20 Jan 2014 14:02:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:02:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:02:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:02:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:02:38 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:02:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:02:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:02:39 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:02:39 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:02:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:02:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:02:39 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:02:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:02:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:02:42 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:02:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:02:43 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:02:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:02:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:02:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:02:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:02:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:02:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:02:44 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:02:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573946
Mon 20 Jan 2014 14:02:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:02:44 - job_xml_thread(): Done retrieving: data size 43573946
Mon 20 Jan 2014 14:02:44 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:02:44 - XML: Start document: iteration 20
Mon 20 Jan 2014 14:02:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573946
Mon 20 Jan 2014 14:02:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:02:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:02:50 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:02:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:02:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 14:02:51 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:02:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 14:02:51 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:02:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9034 values 142915 bits 17864 bytes 
Mon 20 Jan 2014 14:02:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:02:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:02:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:02:55 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:02:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:02:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:02:56 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:02:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:02:56 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:02:56 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:02:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:02:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:02:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:03:00 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 14:03:00 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:03:00 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:03:00 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:03:00 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:03:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:03:05 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:03:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:03:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:03:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:03:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:03:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:03:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:03:07 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:03:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568238
Mon 20 Jan 2014 14:03:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:03:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568238
Mon 20 Jan 2014 14:03:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:03:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:03:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:03:15 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:03:15 - job_xml_thread(): Done retrieving: data size 43568238
Mon 20 Jan 2014 14:03:16 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:03:16 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 14:03:16 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 14:03:16 - Housekeeping: done.
Mon 20 Jan 2014 14:03:16 - XML: Start document: iteration 0
Mon 20 Jan 2014 14:03:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:03:20 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:03:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:03:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:03:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:03:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:03:21 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:03:21 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:03:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:03:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:03:21 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:03:25 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:03:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 14:03:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:03:26 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 14:03:26 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:03:26 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:03:26 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:03:26 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:03:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:03:30 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:03:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:03:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:03:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:03:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:03:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:03:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:03:32 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:03:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555865
Mon 20 Jan 2014 14:03:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:03:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555865
Mon 20 Jan 2014 14:03:33 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 14:03:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:03:33 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:03:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:03:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:03:37 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:03:37 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 14:03:37 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:03:37 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 14:03:37 - Entering storeMetrics(): cluster LISA Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Mon 20 Jan 2014 14:03:41 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:03:41 - job_xml_thread(): Done retrieving: data size 43555865
Mon 20 Jan 2014 14:03:41 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:03:41 - XML: Start document: iteration 1
Mon 20 Jan 2014 14:03:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:03:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:03:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:03:49 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:03:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:03:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:03:50 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:03:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:03:50 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:03:50 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:03:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:03:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:03:51 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 14:03:51 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:03:51 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:03:51 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:03:51 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:03:51 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:03:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:03:53 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:03:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 14:03:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 14:03:53 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:03:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6027 values 95295 bits 11911 bytes 
Mon 20 Jan 2014 14:03:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:03:53 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:03:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:03:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:03:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:03:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:03:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:03:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:03:56 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:03:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567116
Mon 20 Jan 2014 14:03:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:03:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567116
Mon 20 Jan 2014 14:03:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:04:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:04:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:04:07 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:04:07 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:04:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:04:08 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:04:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:04:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:04:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:04:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:04:09 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:04:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:04:09 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:04:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:04:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:04:12 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:04:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:04:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:04:12 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:04:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 14:04:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:04:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:04:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:04:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:04:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:04:13 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:04:13 - job_xml_thread(): Done retrieving: data size 43559545
Mon 20 Jan 2014 14:04:13 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:04:13 - XML: Start document: iteration 2
Mon 20 Jan 2014 14:04:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559545
Mon 20 Jan 2014 14:04:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:04:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559545
Mon 20 Jan 2014 14:04:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:04:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:04:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:04:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:04:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:04:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:04:29 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:04:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:04:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:04:30 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:04:30 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:04:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:04:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:04:30 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:04:31 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 14:04:31 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:04:31 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:04:31 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:04:31 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:04:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:04:35 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:04:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:04:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:04:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:04:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:04:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:04:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:04:37 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:04:37 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:04:37 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:04:37 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:04:37 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 14:04:37 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 14:04:37 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 14:04:38 - size of cluster 'LISA Cluster': 624 hosts 79461 metrics 918571 values 14522769 bits 1815346 bytes 
Mon 20 Jan 2014 14:04:39 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:04:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43587145
Mon 20 Jan 2014 14:04:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:04:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43587145
Mon 20 Jan 2014 14:04:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:04:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:04:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:04:46 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:04:46 - job_xml_thread(): Done retrieving: data size 43587145
Mon 20 Jan 2014 14:04:46 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:04:46 - XML: Start document: iteration 3
Mon 20 Jan 2014 14:04:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:04:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:04:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:04:51 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:04:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:04:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:04:51 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:04:51 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:04:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:04:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:04:51 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:04:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:04:53 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:04:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:04:54 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:04:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 14:04:54 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:04:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8897 values 140276 bits 17534 bytes 
Mon 20 Jan 2014 14:04:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 14:04:58 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 14:04:58 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:04:58 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:04:58 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:04:58 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:05:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:05:02 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:05:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:05:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:05:02 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:05:02 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:05:02 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:05:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:05:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:05:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:05:06 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:05:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43551308
Mon 20 Jan 2014 14:05:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:05:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43551308
Mon 20 Jan 2014 14:05:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:05:13 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:05:14 - job_xml_thread(): Done retrieving: data size 43551308
Mon 20 Jan 2014 14:05:14 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:05:14 - XML: Start document: iteration 4
Mon 20 Jan 2014 14:05:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:05:17 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:05:23 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 14:05:23 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:05:24 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:05:24 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:05:24 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:05:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:05:24 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:05:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:05:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:05:25 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:05:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:05:25 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:05:25 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:05:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:05:27 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:05:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 14:05:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:05:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:05:28 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:05:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:05:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:05:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:05:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:05:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:05:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:05:32 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:05:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43397132
Mon 20 Jan 2014 14:05:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:05:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43397132
Mon 20 Jan 2014 14:05:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:05:37 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:05:38 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 14:05:39 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:05:39 - job_xml_thread(): Done retrieving: data size 43397132
Mon 20 Jan 2014 14:05:39 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:05:39 - XML: Start document: iteration 5
Mon 20 Jan 2014 14:05:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:05:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:05:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:05:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:05:47 - XML: Processed 651326 elements - found 0 jobs
Mon 20 Jan 2014 14:05:47 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:05:47 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:05:47 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:05:47 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:05:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:05:49 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:05:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:05:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:05:50 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:05:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:05:50 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:05:50 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:05:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:05:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:05:54 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:05:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:05:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:05:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:05:54 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:05:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:05:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:05:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:05:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:05:55 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:05:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 14:05:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:05:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 14:05:55 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:05:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5869 values 92606 bits 11575 bytes 
Mon 20 Jan 2014 14:05:58 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:05:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42909729
Mon 20 Jan 2014 14:05:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:05:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42909729
Mon 20 Jan 2014 14:05:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:06:02 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:06:02 - job_xml_thread(): Done retrieving: data size 42909729
Mon 20 Jan 2014 14:06:02 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:06:02 - XML: Start document: iteration 6
Mon 20 Jan 2014 14:06:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:06:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:06:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:06:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:06:13 - XML: Processed 645236 elements - found 0 jobs
Mon 20 Jan 2014 14:06:13 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:06:13 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:06:13 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:06:13 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:06:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:06:19 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:06:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:06:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:06:20 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:06:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:06:20 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:06:20 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:06:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:06:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:06:21 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:06:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:06:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:06:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:06:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:06:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:06:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:06:22 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:06:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 14:06:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:06:25 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:06:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42992639
Mon 20 Jan 2014 14:06:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:06:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42992639
Mon 20 Jan 2014 14:06:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:06:28 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:06:28 - job_xml_thread(): Done retrieving: data size 42992639
Mon 20 Jan 2014 14:06:28 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:06:28 - XML: Start document: iteration 7
Mon 20 Jan 2014 14:06:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:06:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:06:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:06:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:06:39 - XML: Processed 645942 elements - found 0 jobs
Mon 20 Jan 2014 14:06:39 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:06:39 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:06:39 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:06:39 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:06:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:06:43 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:06:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:06:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:06:44 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:06:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:06:44 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:06:44 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:06:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:06:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:06:47 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:06:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:06:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:06:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:06:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:06:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:06:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:06:50 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:06:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43532109
Mon 20 Jan 2014 14:06:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:06:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43532109
Mon 20 Jan 2014 14:06:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:06:54 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:06:54 - job_xml_thread(): Done retrieving: data size 43532109
Mon 20 Jan 2014 14:06:54 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:06:54 - XML: Start document: iteration 8
Mon 20 Jan 2014 14:06:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:06:55 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:06:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:06:55 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:06:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 14:06:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 14:06:56 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:06:59 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8899 values 140366 bits 17545 bytes 
Mon 20 Jan 2014 14:06:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:06:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:07:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:07:02 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:07:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:07:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:07:02 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:07:02 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:07:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:07:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:07:02 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:07:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:07:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:07:08 - XML: Processed 652924 elements - found 0 jobs
Mon 20 Jan 2014 14:07:08 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:07:08 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:07:08 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:07:08 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:07:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:07:13 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:07:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:07:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:07:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:07:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:07:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:07:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:07:16 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:07:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43533724
Mon 20 Jan 2014 14:07:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:07:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:07:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43533724
Mon 20 Jan 2014 14:07:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:07:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:07:23 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:07:23 - job_xml_thread(): Done retrieving: data size 43533724
Mon 20 Jan 2014 14:07:23 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:07:23 - XML: Start document: iteration 9
Mon 20 Jan 2014 14:07:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:07:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:07:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:07:28 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:07:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:07:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:07:30 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:07:30 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:07:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:07:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:07:30 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:07:35 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:07:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 14:07:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:07:36 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 14:07:36 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:07:36 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:07:36 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:07:36 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:07:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:07:40 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:07:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:07:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:07:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:07:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:07:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:07:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:07:41 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 14:07:41 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 14:07:41 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:07:42 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:07:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564484
Mon 20 Jan 2014 14:07:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:07:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564484
Mon 20 Jan 2014 14:07:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:07:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:07:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:07:51 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:07:51 - job_xml_thread(): Done retrieving: data size 43564484
Mon 20 Jan 2014 14:07:51 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:07:51 - XML: Start document: iteration 10
Mon 20 Jan 2014 14:07:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:07:54 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:07:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:07:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:07:55 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:07:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:07:55 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:07:55 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:07:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:07:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:07:56 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:07:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:07:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:07:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:07:56 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:07:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 14:07:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 14:07:56 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:07:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5849 values 92228 bits 11528 bytes 
Mon 20 Jan 2014 14:08:03 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 14:08:03 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:08:03 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:08:03 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:08:03 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:08:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:08:06 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:08:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:08:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:08:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:08:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:08:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:08:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:08:08 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:08:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43545000
Mon 20 Jan 2014 14:08:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:08:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43545000
Mon 20 Jan 2014 14:08:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:08:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:08:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:08:19 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:08:19 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:08:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:08:20 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:08:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:08:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:08:20 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:08:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:08:20 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:08:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:08:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:08:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:08:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:08:24 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:08:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:08:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:08:24 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:08:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 14:08:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:08:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:08:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:08:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:08:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:08:25 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:08:25 - job_xml_thread(): Done retrieving: data size 43579159
Mon 20 Jan 2014 14:08:25 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:08:25 - XML: Start document: iteration 11
Mon 20 Jan 2014 14:08:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579159
Mon 20 Jan 2014 14:08:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579159
Mon 20 Jan 2014 14:08:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:08:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:08:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:08:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:08:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:08:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:08:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:08:40 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:08:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:08:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:08:42 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:08:42 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:08:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:08:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:08:42 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:08:47 - XML: Processed 653355 elements - found 0 jobs
Mon 20 Jan 2014 14:08:47 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:08:47 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:08:47 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:08:47 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:08:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:08:48 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:08:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:08:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:08:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:08:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:08:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:08:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:08:50 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:08:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567278
Mon 20 Jan 2014 14:08:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:08:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567278
Mon 20 Jan 2014 14:08:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:08:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:08:57 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:08:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:08:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:08:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:08:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 14:08:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:08:59 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:08:59 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:08:59 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:08:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 14:08:59 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9061 values 142899 bits 17862 bytes 
Mon 20 Jan 2014 14:08:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:08:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:09:00 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:09:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:09:00 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:09:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:09:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567278
Mon 20 Jan 2014 14:09:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:09:03 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:09:03 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:09:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:09:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:09:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:09:09 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:09:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:09:10 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:09:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:09:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:09:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:09:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:09:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:09:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:09:13 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:09:13 - job_xml_thread(): Done retrieving: data size 43572482
Mon 20 Jan 2014 14:09:13 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:09:13 - XML: Start document: iteration 12
Mon 20 Jan 2014 14:09:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572482
Mon 20 Jan 2014 14:09:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:09:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:09:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:09:16 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:09:16 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:09:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:09:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:09:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572482
Mon 20 Jan 2014 14:09:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:09:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:09:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:09:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:09:30 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:09:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:09:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:09:32 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:09:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:09:32 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:09:32 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:09:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:09:35 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 14:09:35 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:09:35 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:09:35 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:09:35 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:09:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:09:36 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:09:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:09:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:09:36 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:09:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 14:09:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:09:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:09:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:09:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:09:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:09:39 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:09:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576772
Mon 20 Jan 2014 14:09:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:09:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576772
Mon 20 Jan 2014 14:09:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:09:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:09:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:09:50 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:09:50 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:09:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:09:51 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:09:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:09:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:09:52 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:09:52 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:09:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:09:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:09:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:09:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:09:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:09:53 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:09:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:09:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:09:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:09:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:09:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:09:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:09:54 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:09:54 - job_xml_thread(): Done retrieving: data size 43591387
Mon 20 Jan 2014 14:09:54 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:09:54 - XML: Start document: iteration 13
Mon 20 Jan 2014 14:09:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43591387
Mon 20 Jan 2014 14:09:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:09:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43591387
Mon 20 Jan 2014 14:09:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:09:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:09:59 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:10:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:10:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 14:10:00 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:10:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8862 values 139666 bits 17458 bytes 
Mon 20 Jan 2014 14:10:01 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:10:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 14:10:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:10:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:10:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:10:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:10:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:10:16 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:10:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:10:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:10:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:10:16 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:10:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:10:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:10:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:10:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:10:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:10:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:10:17 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:10:17 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 14:10:17 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:10:17 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:10:17 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:10:17 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:10:17 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:10:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:10:17 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:10:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:10:20 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:10:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 14:10:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:10:20 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:10:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579032
Mon 20 Jan 2014 14:10:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:10:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579032
Mon 20 Jan 2014 14:10:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:10:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:10:30 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:10:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:10:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:10:32 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:10:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:10:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:10:32 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:10:33 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:10:33 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:10:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:10:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:10:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:10:34 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:10:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:10:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:10:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:10:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:10:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:10:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:10:36 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:10:36 - job_xml_thread(): Done retrieving: data size 43582403
Mon 20 Jan 2014 14:10:36 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:10:36 - XML: Start document: iteration 14
Mon 20 Jan 2014 14:10:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582403
Mon 20 Jan 2014 14:10:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:10:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582403
Mon 20 Jan 2014 14:10:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:10:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:10:46 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:10:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:10:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:10:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:10:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:10:49 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:10:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:10:49 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:10:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:10:49 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:10:53 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 14:10:53 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:10:53 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:10:53 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:10:53 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:10:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:10:56 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:10:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:10:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:10:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:10:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:10:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:10:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:10:58 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:10:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564121
Mon 20 Jan 2014 14:10:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:10:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564121
Mon 20 Jan 2014 14:10:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:11:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:11:01 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:11:02 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:11:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 14:11:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:11:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 14:11:02 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:11:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148592 bits 18574 bytes 
Mon 20 Jan 2014 14:11:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:11:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:11:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:11:08 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:11:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:11:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:11:09 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:11:09 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:11:09 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:11:09 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:11:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:11:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:11:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:11:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:11:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:11:13 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:11:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:11:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:11:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:11:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:11:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:11:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:11:15 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:11:15 - job_xml_thread(): Done retrieving: data size 43494952
Mon 20 Jan 2014 14:11:15 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:11:15 - XML: Start document: iteration 15
Mon 20 Jan 2014 14:11:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43494952
Mon 20 Jan 2014 14:11:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:11:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43494952
Mon 20 Jan 2014 14:11:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:11:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:11:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:11:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:11:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:11:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:11:31 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:11:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:11:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:11:32 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:11:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:11:32 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:11:32 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:11:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:11:35 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:11:35 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 14:11:35 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:11:36 - XML: Processed 652608 elements - found 0 jobs
Mon 20 Jan 2014 14:11:36 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:11:36 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:11:36 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:11:36 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:11:38 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 14:11:38 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:11:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:11:38 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:11:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:11:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:11:39 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:11:39 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:11:39 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 14:11:39 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 14:11:39 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 14:11:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:11:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:11:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:11:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:11:39 - size of cluster 'LISA Cluster': 624 hosts 79483 metrics 936227 values 14776215 bits 1847026 bytes 
Mon 20 Jan 2014 14:11:41 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:11:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42984425
Mon 20 Jan 2014 14:11:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:11:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42984425
Mon 20 Jan 2014 14:11:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:11:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:11:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:11:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:11:51 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:11:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:11:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:11:51 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:11:51 - job_xml_thread(): Done retrieving: data size 42984425
Mon 20 Jan 2014 14:11:51 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:11:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:11:51 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:11:51 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:11:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42984425
Mon 20 Jan 2014 14:11:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:11:52 - XML: Start document: iteration 16
Mon 20 Jan 2014 14:11:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:11:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:11:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:12:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:12:02 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:12:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:12:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 14:12:03 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:12:03 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:12:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5778 values 91115 bits 11389 bytes 
Mon 20 Jan 2014 14:12:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 14:12:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:12:04 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:12:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:12:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:12:08 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:12:08 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:12:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:12:08 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:12:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:12:10 - XML: Processed 646058 elements - found 0 jobs
Mon 20 Jan 2014 14:12:10 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:12:10 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:12:10 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:12:10 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:12:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:12:12 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:12:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:12:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:12:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:12:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:12:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:12:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:12:15 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:12:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42950842
Mon 20 Jan 2014 14:12:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:12:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42950842
Mon 20 Jan 2014 14:12:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:12:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:12:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:12:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:12:23 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:12:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:12:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:12:24 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:12:24 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:12:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:12:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42950842
Mon 20 Jan 2014 14:12:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:12:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:12:26 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:12:26 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:12:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:12:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:12:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:12:35 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:12:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:12:37 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:12:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:12:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:12:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:12:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:12:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:12:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:12:38 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:12:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 14:12:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:12:39 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:12:39 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 14:12:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:12:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:12:40 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:12:40 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:12:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:12:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:12:41 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:12:41 - job_xml_thread(): Done retrieving: data size 43322371
Mon 20 Jan 2014 14:12:41 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:12:41 - XML: Start document: iteration 17
Mon 20 Jan 2014 14:12:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43322371
Mon 20 Jan 2014 14:12:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:12:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43322371
Mon 20 Jan 2014 14:12:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:12:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:12:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:12:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:12:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:12:55 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:12:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:12:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:12:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:12:56 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:12:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:12:56 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:12:56 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:12:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:13:03 - XML: Processed 650491 elements - found 0 jobs
Mon 20 Jan 2014 14:13:03 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:13:03 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:13:03 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:13:03 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:13:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:13:03 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:13:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:13:04 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:13:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:13:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:13:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:13:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:13:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:13:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:13:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:13:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 14:13:04 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:13:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 14:13:04 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:13:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5865 values 92517 bits 11564 bytes 
Mon 20 Jan 2014 14:13:07 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:13:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554606
Mon 20 Jan 2014 14:13:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:13:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554606
Mon 20 Jan 2014 14:13:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:13:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:13:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:13:18 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:13:18 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:13:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:13:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:13:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:13:20 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:13:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:13:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:13:20 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:13:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:13:20 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:13:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:13:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:13:24 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:13:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:13:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:13:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:13:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:13:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:13:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:13:26 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:13:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 14:13:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:13:27 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:13:27 - job_xml_thread(): Done retrieving: data size 43567096
Mon 20 Jan 2014 14:13:27 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:13:27 - XML: Start document: iteration 18
Mon 20 Jan 2014 14:13:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567096
Mon 20 Jan 2014 14:13:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:13:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567096
Mon 20 Jan 2014 14:13:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:13:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:13:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:13:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:13:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:13:42 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 14:13:42 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:13:42 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:13:42 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:13:42 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:13:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:13:47 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:13:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:13:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:13:48 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:13:48 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:13:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:13:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:13:48 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:13:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:13:52 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:13:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:13:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:13:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:13:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:13:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:13:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:13:55 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:13:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573393
Mon 20 Jan 2014 14:13:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:13:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573393
Mon 20 Jan 2014 14:13:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:13:57 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:13:57 - job_xml_thread(): Done retrieving: data size 43573393
Mon 20 Jan 2014 14:13:57 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:13:57 - XML: Start document: iteration 19
Mon 20 Jan 2014 14:14:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:14:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:14:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:14:04 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:14:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:14:06 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:14:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 14:14:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 14:14:06 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:14:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8253 values 130105 bits 16263 bytes 
Mon 20 Jan 2014 14:14:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:14:08 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:14:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:14:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:14:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:14:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:14:08 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:14:08 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:14:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:14:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:14:08 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:14:15 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 14:14:15 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:14:15 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:14:15 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:14:15 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:14:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:14:19 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:14:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:14:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:14:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:14:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:14:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:14:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:14:22 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:14:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43548742
Mon 20 Jan 2014 14:14:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:14:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43548742
Mon 20 Jan 2014 14:14:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:14:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:14:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:14:30 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:14:30 - job_xml_thread(): Done retrieving: data size 43548742
Mon 20 Jan 2014 14:14:30 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:14:30 - XML: Start document: iteration 20
Mon 20 Jan 2014 14:14:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:14:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:14:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:14:34 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:14:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:14:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:14:35 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:14:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:14:35 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:14:35 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:14:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:14:39 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:14:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 14:14:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:14:43 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 14:14:43 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:14:43 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:14:43 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:14:43 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:14:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:14:46 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:14:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:14:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:14:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:14:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:14:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:14:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:14:49 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:14:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43546444
Mon 20 Jan 2014 14:14:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:14:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:14:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:14:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43546444
Mon 20 Jan 2014 14:14:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:14:58 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:14:58 - job_xml_thread(): Done retrieving: data size 43546444
Mon 20 Jan 2014 14:14:58 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:14:58 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 14:14:59 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 14:14:59 - Housekeeping: done.
Mon 20 Jan 2014 14:14:59 - XML: Start document: iteration 0
Mon 20 Jan 2014 14:15:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:15:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:15:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:15:04 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:15:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:15:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:15:04 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:15:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:15:04 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:15:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:15:04 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:15:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:15:06 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:15:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:15:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 14:15:06 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:15:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 14:15:06 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:15:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5815 values 91661 bits 11457 bytes 
Mon 20 Jan 2014 14:15:11 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 14:15:11 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:15:11 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:15:11 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:15:11 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:15:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:15:12 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:15:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:15:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:15:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:15:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:15:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:15:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:15:16 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:15:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43539787
Mon 20 Jan 2014 14:15:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:15:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43539787
Mon 20 Jan 2014 14:15:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:15:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:15:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:15:26 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:15:26 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:15:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:15:28 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:15:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:15:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:15:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:15:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:15:29 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:15:29 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:15:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:15:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:15:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:15:31 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:15:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:15:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:15:31 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:15:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 14:15:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:15:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:15:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:15:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:15:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:15:33 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:15:33 - job_xml_thread(): Done retrieving: data size 43574365
Mon 20 Jan 2014 14:15:33 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:15:33 - XML: Start document: iteration 1
Mon 20 Jan 2014 14:15:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574365
Mon 20 Jan 2014 14:15:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574365
Mon 20 Jan 2014 14:15:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:15:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:15:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:15:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:15:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:15:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:15:52 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 14:15:52 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:15:52 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:15:52 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:15:52 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:15:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:15:52 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:15:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:15:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:15:53 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:15:53 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:15:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:15:53 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:15:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:15:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:15:57 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:15:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:15:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:15:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:15:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:15:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:15:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:16:01 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:16:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563838
Mon 20 Jan 2014 14:16:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:16:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563838
Mon 20 Jan 2014 14:16:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:16:07 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:16:07 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:16:07 - job_xml_thread(): Done retrieving: data size 43563838
Mon 20 Jan 2014 14:16:07 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:16:07 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:16:07 - XML: Start document: iteration 2
Mon 20 Jan 2014 14:16:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:16:08 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:16:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 14:16:08 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:16:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 14:16:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8804 values 138818 bits 17352 bytes 
Mon 20 Jan 2014 14:16:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:16:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:16:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:16:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:16:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:16:16 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:16:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:16:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:16:18 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:16:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:16:18 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:16:18 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:16:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:16:21 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 14:16:21 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:16:21 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:16:21 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:16:21 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:16:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:16:24 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:16:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:16:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:16:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:16:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:16:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:16:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:16:25 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 14:16:25 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 14:16:25 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:16:26 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:16:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 14:16:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:16:26 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:16:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563125
Mon 20 Jan 2014 14:16:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:16:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563125
Mon 20 Jan 2014 14:16:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:16:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:16:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:16:36 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:16:36 - job_xml_thread(): Done retrieving: data size 43563125
Mon 20 Jan 2014 14:16:36 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:16:36 - XML: Start document: iteration 3
Mon 20 Jan 2014 14:16:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:16:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:16:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:16:42 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:16:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:16:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:16:44 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:16:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:16:44 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:16:44 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:16:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:16:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:16:46 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:16:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:16:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:16:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:16:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:16:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:16:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:16:49 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 14:16:49 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:16:49 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:16:49 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:16:49 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:16:50 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:16:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582282
Mon 20 Jan 2014 14:16:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:16:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582282
Mon 20 Jan 2014 14:16:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:16:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:17:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:17:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:17:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:17:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:17:03 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:17:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:17:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:17:04 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:17:04 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:17:05 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:17:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:17:05 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:17:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:17:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:17:06 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:17:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:17:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:17:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:17:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:17:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:17:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:17:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:17:08 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:17:08 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:17:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 14:17:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:17:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 14:17:08 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:17:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99293 bits 12411 bytes 
Mon 20 Jan 2014 14:17:08 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:17:08 - job_xml_thread(): Done retrieving: data size 43526349
Mon 20 Jan 2014 14:17:08 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:17:08 - XML: Start document: iteration 4
Mon 20 Jan 2014 14:17:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43526349
Mon 20 Jan 2014 14:17:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:17:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43526349
Mon 20 Jan 2014 14:17:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:17:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:17:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:17:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:17:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:17:24 - XML: Processed 652602 elements - found 0 jobs
Mon 20 Jan 2014 14:17:24 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:17:24 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:17:24 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:17:25 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:17:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:17:30 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:17:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:17:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:17:31 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:17:31 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:17:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:17:31 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:17:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:17:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:17:32 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:17:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:17:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:17:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:17:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:17:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:17:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:17:35 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:17:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43057298
Mon 20 Jan 2014 14:17:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:17:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43057298
Mon 20 Jan 2014 14:17:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:17:40 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:17:40 - job_xml_thread(): Done retrieving: data size 43057298
Mon 20 Jan 2014 14:17:40 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:17:40 - XML: Start document: iteration 5
Mon 20 Jan 2014 14:17:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:17:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:17:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:17:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:17:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:17:49 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:17:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:17:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:17:49 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:17:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:17:49 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:17:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:17:49 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:17:52 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:17:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 14:17:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:17:56 - XML: Processed 646810 elements - found 0 jobs
Mon 20 Jan 2014 14:17:56 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:17:56 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:17:56 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:17:56 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:17:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:17:58 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:17:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:17:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:17:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:17:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:17:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:17:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:18:00 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:18:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42901537
Mon 20 Jan 2014 14:18:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:18:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42901537
Mon 20 Jan 2014 14:18:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:18:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:18:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:18:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:18:08 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:18:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:18:09 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:18:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:18:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:18:11 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:18:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:18:11 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:18:11 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:18:11 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:18:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:18:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:18:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 14:18:11 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:18:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6006 values 95049 bits 11881 bytes 
Mon 20 Jan 2014 14:18:11 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:18:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 14:18:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:18:13 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:18:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:18:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:18:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:18:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:18:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:18:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:18:16 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:18:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42986897
Mon 20 Jan 2014 14:18:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:18:16 - job_xml_thread(): Done retrieving: data size 42986897
Mon 20 Jan 2014 14:18:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42986897
Mon 20 Jan 2014 14:18:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:18:16 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:18:16 - XML: Start document: iteration 6
Mon 20 Jan 2014 14:18:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:18:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:18:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:18:26 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:18:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:18:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:18:27 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:18:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:18:27 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:18:27 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:18:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:18:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:18:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:18:34 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:18:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 14:18:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:18:35 - XML: Processed 645908 elements - found 0 jobs
Mon 20 Jan 2014 14:18:35 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:18:35 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:18:35 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:18:35 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:18:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:18:37 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:18:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:18:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:18:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:18:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:18:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:18:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:18:39 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 14:18:39 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:18:39 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:18:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43256716
Mon 20 Jan 2014 14:18:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:18:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43256716
Mon 20 Jan 2014 14:18:40 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:18:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:18:40 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:18:40 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 14:18:40 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 14:18:40 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 14:18:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:18:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:18:50 - size of cluster 'LISA Cluster': 624 hosts 79471 metrics 745875 values 11792712 bits 1474089 bytes 
Mon 20 Jan 2014 14:18:50 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:18:50 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:18:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:18:51 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:18:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:18:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:18:52 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:18:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:18:52 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:18:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:18:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:18:53 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:18:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:18:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:18:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:18:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:18:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:18:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:18:57 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:18:57 - job_xml_thread(): Done retrieving: data size 43557719
Mon 20 Jan 2014 14:18:57 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:18:57 - XML: Start document: iteration 7
Mon 20 Jan 2014 14:18:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557719
Mon 20 Jan 2014 14:18:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557719
Mon 20 Jan 2014 14:18:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:18:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:19:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:19:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:19:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:19:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:19:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:19:11 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:19:13 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:19:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:19:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 14:19:13 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:19:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 14:19:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9090 values 143560 bits 17945 bytes 
Mon 20 Jan 2014 14:19:16 - XML: Processed 653298 elements - found 0 jobs
Mon 20 Jan 2014 14:19:16 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:19:16 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:19:16 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:19:16 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:19:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:19:17 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:19:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:19:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:19:18 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:19:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:19:18 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:19:18 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:19:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:19:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:19:20 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:19:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:19:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:19:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:19:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:19:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:19:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:19:24 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:19:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569290
Mon 20 Jan 2014 14:19:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:19:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569290
Mon 20 Jan 2014 14:19:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:19:32 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:19:32 - job_xml_thread(): Done retrieving: data size 43569290
Mon 20 Jan 2014 14:19:32 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:19:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:19:32 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:19:32 - XML: Start document: iteration 8
Mon 20 Jan 2014 14:19:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:19:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:19:34 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:19:34 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:19:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:19:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:19:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569290
Mon 20 Jan 2014 14:19:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:19:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:19:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:19:40 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:19:40 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 14:19:45 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 14:19:46 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:19:46 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:19:46 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:19:46 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:19:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:19:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:19:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:19:50 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:19:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:19:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:19:51 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:19:51 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:19:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:19:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:19:51 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:19:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:19:53 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:19:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:19:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:19:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:19:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:19:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:19:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:19:54 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:19:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 14:19:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:19:57 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:19:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559508
Mon 20 Jan 2014 14:19:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:19:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559508
Mon 20 Jan 2014 14:19:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:20:01 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:20:01 - job_xml_thread(): Done retrieving: data size 43559508
Mon 20 Jan 2014 14:20:02 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:20:02 - XML: Start document: iteration 9
Mon 20 Jan 2014 14:20:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:20:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:20:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:20:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:20:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:20:14 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:20:15 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 14:20:15 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:20:15 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:20:15 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:20:15 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:20:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:20:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 14:20:16 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:20:16 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:20:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 14:20:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5679 values 89494 bits 11186 bytes 
Mon 20 Jan 2014 14:20:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:20:18 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:20:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:20:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:20:19 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:20:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:20:19 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:20:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:20:19 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:20:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:20:19 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:20:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:20:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:20:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:20:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:20:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:20:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:20:24 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:20:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577321
Mon 20 Jan 2014 14:20:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:20:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577321
Mon 20 Jan 2014 14:20:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:20:31 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:20:31 - job_xml_thread(): Done retrieving: data size 43577321
Mon 20 Jan 2014 14:20:31 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:20:31 - XML: Start document: iteration 10
Mon 20 Jan 2014 14:20:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:20:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:20:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:20:35 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:20:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:20:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:20:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:20:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:20:36 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:20:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:20:36 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:20:36 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:20:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:20:40 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:20:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 14:20:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:20:44 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 14:20:44 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:20:44 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:20:44 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:20:44 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:20:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:20:47 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:20:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:20:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:20:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:20:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:20:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:20:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:20:50 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:20:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556217
Mon 20 Jan 2014 14:20:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556217
Mon 20 Jan 2014 14:20:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:20:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:20:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:20:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:20:59 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:20:59 - job_xml_thread(): Done retrieving: data size 43556217
Mon 20 Jan 2014 14:20:59 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:20:59 - XML: Start document: iteration 11
Mon 20 Jan 2014 14:21:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:21:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:21:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:21:06 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:21:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:21:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:21:07 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:21:07 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:21:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:21:07 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:21:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:21:11 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 14:21:11 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:21:11 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:21:11 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:21:11 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:21:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:21:13 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:21:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:21:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:21:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:21:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:21:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:21:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:21:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:21:16 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:21:16 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:21:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574521
Mon 20 Jan 2014 14:21:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574521
Mon 20 Jan 2014 14:21:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:21:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:21:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:21:17 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:21:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 14:21:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 14:21:17 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:21:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6125 values 96641 bits 12080 bytes 
Mon 20 Jan 2014 14:21:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:21:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:21:26 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:21:26 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:21:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:21:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:21:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:21:30 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:21:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:21:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:21:31 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:21:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:21:31 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:21:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:21:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:21:33 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:21:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:21:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:21:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:21:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:21:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:21:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:21:36 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:21:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 14:21:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:21:37 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:21:37 - job_xml_thread(): Done retrieving: data size 43571554
Mon 20 Jan 2014 14:21:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571554
Mon 20 Jan 2014 14:21:37 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:21:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:21:37 - XML: Start document: iteration 12
Mon 20 Jan 2014 14:21:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571554
Mon 20 Jan 2014 14:21:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:21:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:21:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:21:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:21:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:21:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:21:52 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:21:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:21:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:21:53 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:21:53 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:21:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:21:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:21:53 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:21:59 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 14:21:59 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:21:59 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:21:59 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:21:59 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:22:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:22:01 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:22:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:22:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:22:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:22:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:22:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:22:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:22:04 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:22:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565951
Mon 20 Jan 2014 14:22:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:22:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565951
Mon 20 Jan 2014 14:22:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:22:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:22:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:22:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:22:14 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:22:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:22:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:22:14 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:22:14 - job_xml_thread(): Done retrieving: data size 43565951
Mon 20 Jan 2014 14:22:14 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:22:14 - XML: Start document: iteration 13
Mon 20 Jan 2014 14:22:14 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:22:14 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:22:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:22:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:22:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565951
Mon 20 Jan 2014 14:22:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:22:17 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:22:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:22:17 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:22:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:22:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:22:19 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:22:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 14:22:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 14:22:20 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:22:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6292 values 99265 bits 12408 bytes 
Mon 20 Jan 2014 14:22:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:22:26 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:22:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:22:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:22:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:22:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:22:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:22:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:22:29 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:22:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:22:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:22:34 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 14:22:34 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:22:34 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:22:34 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:22:34 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:22:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:22:36 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:22:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:22:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:22:37 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:22:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:22:37 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:22:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:22:39 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:22:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571950
Mon 20 Jan 2014 14:22:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:22:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571950
Mon 20 Jan 2014 14:22:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:22:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:22:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:22:49 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:22:49 - job_xml_thread(): Done retrieving: data size 43571950
Mon 20 Jan 2014 14:22:49 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:22:49 - XML: Start document: iteration 14
Mon 20 Jan 2014 14:22:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:22:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:22:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:22:53 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:22:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:22:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:22:54 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:22:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:22:54 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:22:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:22:54 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:22:57 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:22:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 14:22:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:22:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:22:59 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:23:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:23:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:23:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:23:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:23:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:23:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:23:02 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 14:23:02 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:23:02 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:23:02 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:23:02 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:23:04 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:23:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570046
Mon 20 Jan 2014 14:23:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:23:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570046
Mon 20 Jan 2014 14:23:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:23:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:23:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:23:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:23:13 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:23:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:23:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:23:13 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:23:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:23:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570046
Mon 20 Jan 2014 14:23:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:23:13 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:23:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:23:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:23:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:23:17 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:23:17 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:23:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:23:19 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:23:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:23:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 14:23:21 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:23:21 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:23:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 14:23:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5982 values 94363 bits 11795 bytes 
Mon 20 Jan 2014 14:23:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:23:22 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:23:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:23:27 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:23:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:23:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:23:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:23:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:23:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:23:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:23:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:23:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:23:29 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 14:23:29 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 14:23:29 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:23:30 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:23:30 - job_xml_thread(): Done retrieving: data size 43482285
Mon 20 Jan 2014 14:23:30 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:23:30 - XML: Start document: iteration 15
Mon 20 Jan 2014 14:23:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43482285
Mon 20 Jan 2014 14:23:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:23:30 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:23:30 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:23:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:23:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:23:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43482285
Mon 20 Jan 2014 14:23:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:23:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:23:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:23:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:23:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:23:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:23:46 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:23:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:23:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:23:47 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:23:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:23:47 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:23:47 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:23:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:23:52 - XML: Processed 652588 elements - found 0 jobs
Mon 20 Jan 2014 14:23:52 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:23:52 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:23:52 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:23:52 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:23:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:23:54 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:23:54 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:23:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 14:23:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:23:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:23:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:23:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:23:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:23:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:23:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:23:56 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:23:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42903789
Mon 20 Jan 2014 14:23:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:23:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42903789
Mon 20 Jan 2014 14:23:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:24:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:24:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:24:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:24:05 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:24:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:24:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:24:06 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:24:06 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:24:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:24:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:24:06 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:24:08 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:24:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:24:09 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:24:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:24:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:24:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:24:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:24:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:24:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:24:11 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:24:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42966868
Mon 20 Jan 2014 14:24:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:24:12 - job_xml_thread(): Done retrieving: data size 42966868
Mon 20 Jan 2014 14:24:12 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:24:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42966868
Mon 20 Jan 2014 14:24:12 - XML: Start document: iteration 16
Mon 20 Jan 2014 14:24:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:24:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:24:21 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:24:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:24:22 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:24:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:24:23 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:24:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:24:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:24:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:24:24 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:24:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 14:24:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 14:24:25 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:24:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8881 values 140022 bits 17502 bytes 
Mon 20 Jan 2014 14:24:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:24:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:24:25 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:24:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:24:25 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:24:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:24:25 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:24:30 - XML: Processed 645846 elements - found 0 jobs
Mon 20 Jan 2014 14:24:30 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:24:30 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:24:30 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:24:30 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:24:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:24:34 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:24:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:24:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:24:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:24:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:24:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:24:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:24:36 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:24:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42975044
Mon 20 Jan 2014 14:24:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:24:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42975044
Mon 20 Jan 2014 14:24:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:24:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:24:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:24:45 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:24:45 - job_xml_thread(): Done retrieving: data size 42975044
Mon 20 Jan 2014 14:24:45 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:24:45 - XML: Start document: iteration 17
Mon 20 Jan 2014 14:24:46 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:24:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 14:24:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:24:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:24:49 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:24:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:24:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:24:49 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:24:49 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:24:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:24:49 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:24:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:24:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:24:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:24:56 - XML: Processed 645920 elements - found 0 jobs
Mon 20 Jan 2014 14:24:56 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:24:56 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:24:56 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:24:56 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:24:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:24:58 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:24:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:24:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:24:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:24:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:24:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:24:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:24:59 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:24:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43547671
Mon 20 Jan 2014 14:24:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:25:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43547671
Mon 20 Jan 2014 14:25:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:25:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:25:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:25:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:25:11 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:25:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:25:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:25:11 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:25:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:25:11 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:25:11 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:25:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:25:11 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:25:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:25:13 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:25:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:25:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:25:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:25:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:25:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:25:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:25:15 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:25:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575504
Mon 20 Jan 2014 14:25:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:25:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575504
Mon 20 Jan 2014 14:25:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:25:16 - job_xml_thread(): Done retrieving: data size 43575504
Mon 20 Jan 2014 14:25:17 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:25:17 - XML: Start document: iteration 18
Mon 20 Jan 2014 14:25:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:25:24 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:25:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:25:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 14:25:25 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:25:25 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:25:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 14:25:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:25:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:25:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9333 values 147188 bits 18398 bytes 
Mon 20 Jan 2014 14:25:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:25:27 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:25:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:25:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:25:28 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:25:28 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:25:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:25:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:25:28 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:25:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:25:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:25:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:25:37 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:25:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:25:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:25:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:25:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:25:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:25:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:25:38 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 14:25:38 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:25:38 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:25:38 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:25:38 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:25:40 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:25:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43543759
Mon 20 Jan 2014 14:25:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:25:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43543759
Mon 20 Jan 2014 14:25:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:25:41 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 14:25:41 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:25:42 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:25:42 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:25:42 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 14:25:42 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 14:25:42 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 14:25:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:25:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:25:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:25:49 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:25:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:25:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:25:51 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:25:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:25:52 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:25:52 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:25:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:25:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:25:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:25:52 - size of cluster 'LISA Cluster': 624 hosts 79469 metrics 743760 values 11742078 bits 1467759 bytes 
Mon 20 Jan 2014 14:25:53 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:25:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:25:56 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:25:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:25:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:25:56 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:25:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 14:25:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:25:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:25:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:25:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:25:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:25:59 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:25:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561774
Mon 20 Jan 2014 14:25:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:26:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561774
Mon 20 Jan 2014 14:26:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:26:00 - job_xml_thread(): Done retrieving: data size 43561774
Mon 20 Jan 2014 14:26:00 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:26:00 - XML: Start document: iteration 19
Mon 20 Jan 2014 14:26:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:26:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:26:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:26:12 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:26:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:26:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:26:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:26:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:26:13 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:26:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:26:13 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:26:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:26:13 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:26:22 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 14:26:22 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:26:22 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:26:22 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:26:22 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:26:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:26:23 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:26:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:26:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:26:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:26:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:26:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:26:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:26:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:26:26 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:26:26 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:26:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43549467
Mon 20 Jan 2014 14:26:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:26:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43549467
Mon 20 Jan 2014 14:26:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:26:26 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:26:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:26:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 14:26:26 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:26:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 14:26:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5793 values 91303 bits 11412 bytes 
Mon 20 Jan 2014 14:26:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:26:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:26:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:26:36 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:26:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:26:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:26:36 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:26:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:26:36 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:26:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:26:36 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:26:37 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:26:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:26:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:26:42 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:26:42 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 14:26:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:26:43 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:26:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:26:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:26:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:26:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:26:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:26:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:26:45 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:26:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558759
Mon 20 Jan 2014 14:26:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:26:46 - job_xml_thread(): Done retrieving: data size 43558759
Mon 20 Jan 2014 14:26:46 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:26:46 - XML: Start document: iteration 20
Mon 20 Jan 2014 14:26:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558759
Mon 20 Jan 2014 14:26:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:26:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:26:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:26:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:26:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:27:04 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 14:27:04 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:27:04 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:27:04 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:27:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:27:04 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:27:04 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:27:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:27:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:27:05 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:27:05 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:27:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:27:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:27:05 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:27:06 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:27:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 14:27:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:27:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:27:08 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:27:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:27:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:27:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:27:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:27:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:27:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:27:11 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:27:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566767
Mon 20 Jan 2014 14:27:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:27:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566767
Mon 20 Jan 2014 14:27:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:27:19 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:27:19 - job_xml_thread(): Done retrieving: data size 43566767
Mon 20 Jan 2014 14:27:19 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:27:19 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 14:27:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:27:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:27:20 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 14:27:20 - Housekeeping: done.
Mon 20 Jan 2014 14:27:20 - XML: Start document: iteration 0
Mon 20 Jan 2014 14:27:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:27:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:27:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:27:26 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:27:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:27:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:27:26 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:27:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:27:26 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:27:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:27:26 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:27:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:27:26 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:27:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:27:27 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:27:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 14:27:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 14:27:27 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:27:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5964 values 94051 bits 11756 bytes 
Mon 20 Jan 2014 14:27:32 - XML: Processed 653357 elements - found 0 jobs
Mon 20 Jan 2014 14:27:32 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:27:32 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:27:32 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:27:32 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:27:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:27:36 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:27:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:27:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:27:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:27:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:27:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:27:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:27:39 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:27:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567322
Mon 20 Jan 2014 14:27:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:27:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567322
Mon 20 Jan 2014 14:27:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:27:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:27:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:27:47 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:27:48 - job_xml_thread(): Done retrieving: data size 43567322
Mon 20 Jan 2014 14:27:48 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:27:48 - XML: Start document: iteration 1
Mon 20 Jan 2014 14:27:48 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:27:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 14:27:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:27:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:27:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:27:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:27:54 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:27:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:27:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:27:55 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:27:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:27:55 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:27:55 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:27:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:28:00 - XML: Processed 653355 elements - found 0 jobs
Mon 20 Jan 2014 14:28:00 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:28:00 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:28:00 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:28:00 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:28:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:28:03 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:28:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:28:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:28:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:28:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:28:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:28:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:28:06 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:28:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562985
Mon 20 Jan 2014 14:28:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:28:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562985
Mon 20 Jan 2014 14:28:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:28:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:28:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:28:15 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:28:15 - job_xml_thread(): Done retrieving: data size 43562985
Mon 20 Jan 2014 14:28:15 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:28:15 - XML: Start document: iteration 2
Mon 20 Jan 2014 14:28:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:28:18 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:28:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:28:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:28:19 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:28:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:28:19 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:28:19 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:28:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:28:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:28:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:28:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:28:27 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:28:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:28:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 14:28:28 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:28:28 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:28:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 14:28:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6156 values 97108 bits 12138 bytes 
Mon 20 Jan 2014 14:28:29 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 14:28:29 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:28:29 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:28:29 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:28:29 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:28:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:28:31 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:28:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:28:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:28:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:28:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:28:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:28:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:28:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:28:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:28:35 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:28:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43543459
Mon 20 Jan 2014 14:28:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:28:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43543459
Mon 20 Jan 2014 14:28:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:28:44 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:28:44 - job_xml_thread(): Done retrieving: data size 43543459
Mon 20 Jan 2014 14:28:44 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:28:44 - XML: Start document: iteration 3
Mon 20 Jan 2014 14:28:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:28:45 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:28:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:28:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:28:46 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:28:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:28:46 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:28:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:28:46 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:28:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:28:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:28:50 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:28:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 14:28:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:28:56 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 14:28:56 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:28:56 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:28:56 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:28:56 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:28:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:28:56 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:28:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:28:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:28:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:28:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:28:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:28:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:28:59 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:28:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43547115
Mon 20 Jan 2014 14:28:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:28:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43547115
Mon 20 Jan 2014 14:28:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:29:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:29:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:29:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:29:09 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:29:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:29:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:29:10 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:29:10 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:29:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:29:10 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:29:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:29:11 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:29:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:29:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:29:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:29:13 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:29:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:29:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:29:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:29:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:29:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:29:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:29:17 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:29:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43501122
Mon 20 Jan 2014 14:29:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:29:17 - job_xml_thread(): Done retrieving: data size 43501122
Mon 20 Jan 2014 14:29:17 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:29:17 - XML: Start document: iteration 4
Mon 20 Jan 2014 14:29:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43501122
Mon 20 Jan 2014 14:29:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:29:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:29:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:29:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:29:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:29:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:29:29 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:29:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:29:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 14:29:30 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:29:30 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:29:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 14:29:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9032 values 142473 bits 17809 bytes 
Mon 20 Jan 2014 14:29:32 - XML: Processed 652608 elements - found 0 jobs
Mon 20 Jan 2014 14:29:32 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:29:32 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:29:32 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:29:32 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:29:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:29:32 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:29:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:29:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:29:33 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:29:33 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:29:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:29:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:29:34 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:29:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:29:39 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:29:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:29:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:29:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:29:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:29:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:29:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:29:42 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:29:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42998277
Mon 20 Jan 2014 14:29:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:29:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42998277
Mon 20 Jan 2014 14:29:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:29:47 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:29:47 - job_xml_thread(): Done retrieving: data size 42998277
Mon 20 Jan 2014 14:29:47 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:29:47 - XML: Start document: iteration 5
Mon 20 Jan 2014 14:29:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:29:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:29:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:29:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:29:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:29:59 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:29:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:29:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:30:02 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:30:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:30:02 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:30:02 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:30:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:30:03 - XML: Processed 646358 elements - found 0 jobs
Mon 20 Jan 2014 14:30:03 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:30:03 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:30:03 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:30:03 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:30:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:30:05 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:30:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:30:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:30:05 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:30:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 14:30:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:30:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:30:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:30:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:30:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:30:08 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:30:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42930225
Mon 20 Jan 2014 14:30:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:30:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42930225
Mon 20 Jan 2014 14:30:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:30:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:30:17 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:30:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:30:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:30:18 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:30:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:30:18 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:30:18 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:30:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:30:19 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:30:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:30:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:30:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:30:22 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:30:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:30:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:30:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:30:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:30:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:30:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:30:23 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 14:30:23 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 14:30:23 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:30:24 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:30:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42986333
Mon 20 Jan 2014 14:30:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:30:25 - job_xml_thread(): Done retrieving: data size 42986333
Mon 20 Jan 2014 14:30:25 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:30:25 - XML: Start document: iteration 6
Mon 20 Jan 2014 14:30:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42986333
Mon 20 Jan 2014 14:30:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:30:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:30:30 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:30:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:30:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 14:30:31 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:30:31 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:30:31 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 14:30:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9040 values 142588 bits 17823 bytes 
Mon 20 Jan 2014 14:30:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:30:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:30:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:30:37 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:30:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:30:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:30:37 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:30:37 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:30:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:30:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:30:37 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:30:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:30:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:30:43 - XML: Processed 645973 elements - found 0 jobs
Mon 20 Jan 2014 14:30:43 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:30:43 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:30:43 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:30:44 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:30:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:30:45 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:30:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:30:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:30:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:30:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:30:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:30:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:30:47 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:30:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43507172
Mon 20 Jan 2014 14:30:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:30:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43507172
Mon 20 Jan 2014 14:30:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:30:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:30:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:30:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:30:56 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:30:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:30:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:30:57 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:30:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:30:57 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:30:57 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:30:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:30:59 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:31:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:31:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:31:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:31:01 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:31:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:31:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:31:01 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:31:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 14:31:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:31:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:31:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:31:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:31:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:31:03 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:31:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572400
Mon 20 Jan 2014 14:31:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:31:03 - job_xml_thread(): Done retrieving: data size 43572400
Mon 20 Jan 2014 14:31:03 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:31:03 - XML: Start document: iteration 7
Mon 20 Jan 2014 14:31:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572400
Mon 20 Jan 2014 14:31:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:31:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:31:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:31:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:31:13 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:31:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:31:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:31:14 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:31:14 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:31:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:31:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:31:14 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:31:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:31:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:31:23 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 14:31:23 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:31:23 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:31:23 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:31:23 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:31:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:31:26 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:31:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:31:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:31:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:31:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:31:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:31:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:31:28 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:31:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43542972
Mon 20 Jan 2014 14:31:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:31:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43542972
Mon 20 Jan 2014 14:31:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:31:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:31:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:31:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:31:31 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:31:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:31:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 14:31:32 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:31:32 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:31:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8823 values 139297 bits 17412 bytes 
Mon 20 Jan 2014 14:31:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 14:31:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:31:37 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:31:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:31:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:31:38 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:31:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:31:38 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:31:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:31:38 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:31:38 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:31:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:31:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:31:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:31:43 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:31:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:31:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:31:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:31:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:31:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:31:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:31:45 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:31:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557367
Mon 20 Jan 2014 14:31:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:31:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557367
Mon 20 Jan 2014 14:31:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:31:46 - job_xml_thread(): Done retrieving: data size 43557367
Mon 20 Jan 2014 14:31:46 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:31:46 - XML: Start document: iteration 8
Mon 20 Jan 2014 14:31:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:31:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:31:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:31:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:32:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:32:01 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:32:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:32:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:32:02 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:32:02 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:32:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:32:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:32:02 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:32:05 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 14:32:05 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:32:05 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:32:05 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:32:05 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:32:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:32:09 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:32:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:32:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:32:09 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:32:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 14:32:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:32:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:32:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:32:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:32:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:32:10 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:32:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573764
Mon 20 Jan 2014 14:32:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:32:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573764
Mon 20 Jan 2014 14:32:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:32:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:32:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:32:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:32:20 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:32:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:32:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:32:21 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:32:21 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:32:21 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:32:21 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:32:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:32:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:32:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:32:24 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:32:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:32:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:32:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:32:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:32:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:32:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:32:26 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:32:26 - job_xml_thread(): Done retrieving: data size 43567207
Mon 20 Jan 2014 14:32:26 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:32:26 - XML: Start document: iteration 9
Mon 20 Jan 2014 14:32:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567207
Mon 20 Jan 2014 14:32:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:32:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567207
Mon 20 Jan 2014 14:32:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:32:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:32:32 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:32:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:32:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 14:32:33 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:32:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 14:32:33 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:32:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8997 values 142285 bits 17785 bytes 
Mon 20 Jan 2014 14:32:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:32:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:32:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:32:39 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:32:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:32:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:32:39 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:32:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:32:39 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:32:39 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:32:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:32:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:32:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:32:42 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 14:32:42 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:32:42 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:32:42 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 14:32:42 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:32:42 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 14:32:42 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 14:32:44 - XML: Processed 653355 elements - found 0 jobs
Mon 20 Jan 2014 14:32:44 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:32:44 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:32:44 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:32:44 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:32:44 - size of cluster 'LISA Cluster': 624 hosts 79473 metrics 772508 values 12205477 bits 1525684 bytes 
Mon 20 Jan 2014 14:32:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:32:49 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:32:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:32:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:32:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:32:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:32:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:32:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:32:53 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:32:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566546
Mon 20 Jan 2014 14:32:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:32:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566546
Mon 20 Jan 2014 14:32:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:32:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:32:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:33:00 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:33:00 - job_xml_thread(): Done retrieving: data size 43566546
Mon 20 Jan 2014 14:33:00 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:33:00 - XML: Start document: iteration 10
Mon 20 Jan 2014 14:33:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:33:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:33:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:33:08 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:33:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:33:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:33:08 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:33:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:33:08 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:33:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:33:09 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:33:16 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 14:33:16 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:33:16 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:33:16 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:33:16 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:33:17 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:33:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 14:33:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:33:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:33:17 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:33:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:33:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:33:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:33:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:33:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:33:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:33:21 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:33:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569037
Mon 20 Jan 2014 14:33:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:33:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569037
Mon 20 Jan 2014 14:33:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:33:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:33:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:33:31 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:33:31 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:33:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:33:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:33:33 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:33:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:33:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:33:33 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:33:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 14:33:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 14:33:34 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:33:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5900 values 93283 bits 11660 bytes 
Mon 20 Jan 2014 14:33:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:33:35 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:33:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:33:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:33:36 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:33:36 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:33:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:33:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:33:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:33:36 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:33:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:33:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:33:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:33:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:33:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:33:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:33:40 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:33:40 - job_xml_thread(): Done retrieving: data size 43568118
Mon 20 Jan 2014 14:33:40 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:33:40 - XML: Start document: iteration 11
Mon 20 Jan 2014 14:33:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568118
Mon 20 Jan 2014 14:33:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:33:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568118
Mon 20 Jan 2014 14:33:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:33:42 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:33:42 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 14:33:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:33:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:33:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:33:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:33:58 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:33:58 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 14:33:58 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:33:58 - XML: Processed 653355 elements - found 0 jobs
Mon 20 Jan 2014 14:33:58 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:33:58 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:33:58 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:33:58 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:34:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:34:00 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:34:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:34:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:34:01 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:34:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:34:01 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:34:01 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:34:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:34:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:34:04 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:34:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:34:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:34:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:34:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:34:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:34:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:34:07 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:34:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43590123
Mon 20 Jan 2014 14:34:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:34:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43590123
Mon 20 Jan 2014 14:34:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:34:14 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:34:14 - job_xml_thread(): Done retrieving: data size 43590123
Mon 20 Jan 2014 14:34:14 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:34:14 - XML: Start document: iteration 12
Mon 20 Jan 2014 14:34:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:34:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:34:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:34:19 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:34:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:34:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:34:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:34:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:34:20 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:34:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:34:20 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:34:20 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:34:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:34:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:34:30 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:34:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:34:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:34:31 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 14:34:31 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:34:31 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:34:31 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:34:31 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:34:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:34:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:34:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:34:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:34:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:34:34 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:34:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:34:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 14:34:34 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:34:34 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:34:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 14:34:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6129 values 96742 bits 12092 bytes 
Mon 20 Jan 2014 14:34:35 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:34:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43552529
Mon 20 Jan 2014 14:34:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:34:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43552529
Mon 20 Jan 2014 14:34:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:34:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:34:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:34:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:34:42 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:34:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:34:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:34:43 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:34:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:34:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43552529
Mon 20 Jan 2014 14:34:43 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:34:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:34:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:34:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:34:46 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:34:46 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:34:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:34:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:34:54 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:34:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:34:56 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:34:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:34:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:34:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:34:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:34:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:34:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:34:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:34:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:34:58 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:34:58 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:34:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:34:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:34:59 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:34:59 - job_xml_thread(): Done retrieving: data size 43548447
Mon 20 Jan 2014 14:34:59 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:34:59 - XML: Start document: iteration 13
Mon 20 Jan 2014 14:34:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43548447
Mon 20 Jan 2014 14:34:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:35:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43548447
Mon 20 Jan 2014 14:35:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:35:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:35:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:35:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:35:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:35:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:35:15 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:35:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:35:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:35:16 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:35:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:35:16 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:35:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:35:16 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:35:20 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 14:35:21 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:35:21 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:35:21 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:35:21 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:35:22 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:35:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 14:35:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:35:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:35:23 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:35:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:35:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:35:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:35:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:35:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:35:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:35:26 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:35:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43430446
Mon 20 Jan 2014 14:35:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:35:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43430446
Mon 20 Jan 2014 14:35:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:35:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:35:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:35:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:35:34 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:35:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:35:35 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:35:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:35:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:35:36 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:35:36 - job_xml_thread(): Done retrieving: data size 43430446
Mon 20 Jan 2014 14:35:36 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:35:36 - XML: Start document: iteration 14
Mon 20 Jan 2014 14:35:36 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:35:36 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:35:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:35:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:35:36 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:35:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:35:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 14:35:36 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:35:37 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:35:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 14:35:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6177 values 97423 bits 12177 bytes 
Mon 20 Jan 2014 14:35:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:35:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:35:47 - XML: Processed 651770 elements - found 0 jobs
Mon 20 Jan 2014 14:35:47 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:35:47 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:35:47 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:35:47 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:35:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:35:48 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:35:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:35:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:35:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:35:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:35:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:35:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:35:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:35:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:35:51 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:35:51 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 14:35:51 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:35:52 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:35:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42942843
Mon 20 Jan 2014 14:35:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:35:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42942843
Mon 20 Jan 2014 14:35:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:36:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:36:00 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:36:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:36:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:36:01 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:36:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:36:01 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:36:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42942843
Mon 20 Jan 2014 14:36:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:36:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:36:02 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:36:02 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:36:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:36:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:36:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:36:11 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:36:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:36:14 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:36:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:36:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:36:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:36:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:36:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:36:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:36:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:36:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:36:16 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:36:16 - job_xml_thread(): Done retrieving: data size 42942224
Mon 20 Jan 2014 14:36:16 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:36:16 - XML: Start document: iteration 15
Mon 20 Jan 2014 14:36:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42942224
Mon 20 Jan 2014 14:36:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:36:17 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:36:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:36:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42942224
Mon 20 Jan 2014 14:36:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:36:17 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:36:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:36:29 - XML: Processed 645834 elements - found 0 jobs
Mon 20 Jan 2014 14:36:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:36:30 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:36:30 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:36:30 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:36:30 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:36:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:36:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:36:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:36:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:36:33 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:36:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:36:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:36:33 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:36:33 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:36:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:36:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:36:33 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:36:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:36:37 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:36:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:36:37 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:36:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:36:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:36:37 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:36:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:36:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 14:36:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 14:36:37 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:36:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99103 bits 12387 bytes 
Mon 20 Jan 2014 14:36:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:36:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:36:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:36:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:36:41 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:36:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43366692
Mon 20 Jan 2014 14:36:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:36:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43366692
Mon 20 Jan 2014 14:36:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:36:46 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:36:46 - job_xml_thread(): Done retrieving: data size 43366692
Mon 20 Jan 2014 14:36:46 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:36:46 - XML: Start document: iteration 16
Mon 20 Jan 2014 14:36:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:36:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:36:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:36:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:36:58 - XML: Processed 650960 elements - found 0 jobs
Mon 20 Jan 2014 14:36:58 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:36:58 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:36:58 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:36:58 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:37:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:37:00 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:37:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:37:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:37:01 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:37:01 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:37:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:37:01 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:37:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:37:03 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:37:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 14:37:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:37:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:37:03 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:37:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:37:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:37:04 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 14:37:04 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 14:37:04 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:37:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:37:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:37:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:37:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:37:06 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:37:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43587244
Mon 20 Jan 2014 14:37:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:37:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43587244
Mon 20 Jan 2014 14:37:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:37:13 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:37:13 - job_xml_thread(): Done retrieving: data size 43587244
Mon 20 Jan 2014 14:37:13 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:37:13 - XML: Start document: iteration 17
Mon 20 Jan 2014 14:37:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:37:16 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:37:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:37:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:37:17 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:37:17 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:37:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:37:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:37:17 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:37:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:37:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:37:26 - XML: Processed 653204 elements - found 0 jobs
Mon 20 Jan 2014 14:37:26 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:37:26 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:37:26 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:37:26 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:37:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:37:27 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:37:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:37:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:37:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:37:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:37:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:37:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:37:29 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:37:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43547402
Mon 20 Jan 2014 14:37:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:37:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43547402
Mon 20 Jan 2014 14:37:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:37:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:37:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:37:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:37:38 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:37:39 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:37:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:37:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 14:37:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 14:37:39 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:37:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8775 values 138375 bits 17296 bytes 
Mon 20 Jan 2014 14:37:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:37:39 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:37:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:37:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:37:39 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:37:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:37:39 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:37:39 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:37:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:37:41 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:37:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:37:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:37:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:37:44 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:37:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:37:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:37:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:37:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:37:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:37:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:37:46 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:37:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567185
Mon 20 Jan 2014 14:37:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:37:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567185
Mon 20 Jan 2014 14:37:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:37:47 - job_xml_thread(): Done retrieving: data size 43567185
Mon 20 Jan 2014 14:37:47 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:37:47 - XML: Start document: iteration 18
Mon 20 Jan 2014 14:37:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:37:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:38:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:38:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:38:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:38:04 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:38:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:38:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:38:05 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:38:05 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:38:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:38:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:38:05 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:38:06 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:38:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 14:38:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:38:07 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 14:38:07 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:38:07 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:38:07 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:38:07 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:38:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:38:10 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:38:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:38:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:38:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:38:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:38:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:38:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:38:11 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:38:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565874
Mon 20 Jan 2014 14:38:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:38:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565874
Mon 20 Jan 2014 14:38:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:38:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:38:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:38:22 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:38:22 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:38:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:38:23 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:38:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:38:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:38:23 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:38:23 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:38:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:38:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:38:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:38:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:38:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:38:26 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:38:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:38:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:38:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:38:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:38:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:38:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:38:28 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:38:28 - job_xml_thread(): Done retrieving: data size 43566570
Mon 20 Jan 2014 14:38:28 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:38:28 - XML: Start document: iteration 19
Mon 20 Jan 2014 14:38:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566570
Mon 20 Jan 2014 14:38:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566570
Mon 20 Jan 2014 14:38:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:38:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:38:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:38:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:38:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:38:39 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:38:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:38:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 14:38:39 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:38:39 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:38:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 14:38:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8908 values 140489 bits 17561 bytes 
Mon 20 Jan 2014 14:38:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:38:41 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:38:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:38:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:38:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:38:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:38:43 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:38:43 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:38:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:38:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:38:43 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:38:47 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 14:38:47 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:38:47 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:38:47 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:38:47 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:38:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:38:50 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:38:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:38:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:38:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:38:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:38:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:38:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:38:52 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:38:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581859
Mon 20 Jan 2014 14:38:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:38:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581859
Mon 20 Jan 2014 14:38:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:38:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:38:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:39:02 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:39:02 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:39:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:39:04 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:39:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:39:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:39:05 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:39:05 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:39:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:39:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:39:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:39:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:39:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:39:08 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:39:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:39:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:39:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:39:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:39:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:39:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:39:08 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:39:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 14:39:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:39:09 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:39:09 - job_xml_thread(): Done retrieving: data size 43579136
Mon 20 Jan 2014 14:39:09 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:39:09 - XML: Start document: iteration 20
Mon 20 Jan 2014 14:39:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579136
Mon 20 Jan 2014 14:39:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579136
Mon 20 Jan 2014 14:39:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:39:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:39:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:39:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:39:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:39:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:39:25 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 14:39:25 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:39:25 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:39:25 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:39:25 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:39:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:39:26 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:39:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:39:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:39:28 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:39:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:39:28 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:39:28 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:39:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:39:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:39:31 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:39:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:39:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:39:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:39:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:39:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:39:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:39:33 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:39:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583915
Mon 20 Jan 2014 14:39:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:39:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583915
Mon 20 Jan 2014 14:39:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:39:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:39:40 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:39:40 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:39:40 - job_xml_thread(): Done retrieving: data size 43583915
Mon 20 Jan 2014 14:39:40 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:39:40 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 14:39:40 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:39:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 14:39:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:39:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 14:39:40 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:39:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8803 values 138728 bits 17341 bytes 
Mon 20 Jan 2014 14:39:41 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 14:39:41 - Housekeeping: done.
Mon 20 Jan 2014 14:39:41 - XML: Start document: iteration 0
Mon 20 Jan 2014 14:39:43 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 14:39:43 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:39:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:39:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:39:45 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:39:45 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 14:39:45 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:39:45 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 14:39:45 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 14:39:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:39:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:39:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:39:48 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:39:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:39:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:39:49 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:39:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:39:49 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:39:49 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:39:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:39:50 - size of cluster 'LISA Cluster': 624 hosts 79477 metrics 810671 values 12795336 bits 1599417 bytes 
Mon 20 Jan 2014 14:39:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:39:54 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:39:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:39:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:39:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:39:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:39:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:39:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:39:56 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 14:39:56 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:39:56 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:39:56 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:39:56 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:39:59 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:39:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 14:39:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:39:59 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:39:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554376
Mon 20 Jan 2014 14:39:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:40:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554376
Mon 20 Jan 2014 14:40:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:40:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:40:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:40:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:40:09 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:40:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:40:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:40:10 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:40:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:40:10 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:40:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:40:10 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:40:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:40:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:40:11 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:40:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:40:14 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:40:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:40:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:40:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:40:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:40:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:40:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:40:17 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:40:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566244
Mon 20 Jan 2014 14:40:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:40:17 - job_xml_thread(): Done retrieving: data size 43566244
Mon 20 Jan 2014 14:40:17 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:40:17 - XML: Start document: iteration 1
Mon 20 Jan 2014 14:40:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566244
Mon 20 Jan 2014 14:40:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:40:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:40:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:40:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:40:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:40:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:40:36 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:40:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:40:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:40:36 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:40:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:40:36 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:40:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:40:37 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:40:37 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 14:40:37 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:40:38 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:40:38 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:40:38 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:40:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:40:39 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:40:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:40:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:40:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:40:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:40:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:40:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:40:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:40:41 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:40:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:40:41 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:40:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 14:40:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 14:40:41 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:40:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99055 bits 12381 bytes 
Mon 20 Jan 2014 14:40:43 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:40:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558592
Mon 20 Jan 2014 14:40:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:40:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558592
Mon 20 Jan 2014 14:40:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:40:45 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:40:45 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 14:40:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:40:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:40:53 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:40:53 - job_xml_thread(): Done retrieving: data size 43558592
Mon 20 Jan 2014 14:40:53 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:40:54 - XML: Start document: iteration 2
Mon 20 Jan 2014 14:40:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:40:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:40:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:40:56 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:40:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:40:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:40:56 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:40:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:40:56 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:40:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:40:56 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:41:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:41:03 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:41:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:41:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:41:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:41:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:41:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:41:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:41:05 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 14:41:05 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:41:05 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:41:05 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:41:05 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:41:06 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:41:06 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 14:41:06 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:41:07 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:41:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577892
Mon 20 Jan 2014 14:41:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:41:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577892
Mon 20 Jan 2014 14:41:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:41:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:41:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:41:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:41:17 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:41:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:41:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:41:18 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:41:18 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:41:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:41:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:41:18 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:41:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:41:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:41:20 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:41:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:41:21 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:41:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:41:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:41:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:41:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:41:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:41:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:41:24 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:41:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43515908
Mon 20 Jan 2014 14:41:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:41:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43515908
Mon 20 Jan 2014 14:41:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:41:25 - job_xml_thread(): Done retrieving: data size 43515908
Mon 20 Jan 2014 14:41:25 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:41:25 - XML: Start document: iteration 3
Mon 20 Jan 2014 14:41:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:41:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:41:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:41:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:41:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:41:38 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:41:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:41:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:41:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:41:41 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:41:41 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:41:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:41:41 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:41:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:41:41 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:41:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:41:41 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:41:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 14:41:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 14:41:41 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:41:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8059 values 127111 bits 15888 bytes 
Mon 20 Jan 2014 14:41:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:41:46 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:41:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:41:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:41:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:41:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:41:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:41:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:41:47 - XML: Processed 652606 elements - found 0 jobs
Mon 20 Jan 2014 14:41:47 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:41:47 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:41:47 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:41:47 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:41:51 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:41:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42964202
Mon 20 Jan 2014 14:41:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:41:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42964202
Mon 20 Jan 2014 14:41:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:41:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:41:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:42:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:42:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:42:02 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:42:02 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:42:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:42:03 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:42:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:42:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:42:04 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:42:04 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:42:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:42:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:42:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:42:07 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:42:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:42:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:42:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:42:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:42:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:42:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:42:07 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:42:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 14:42:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:42:10 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:42:10 - job_xml_thread(): Done retrieving: data size 42947579
Mon 20 Jan 2014 14:42:10 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:42:10 - XML: Start document: iteration 4
Mon 20 Jan 2014 14:42:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42947579
Mon 20 Jan 2014 14:42:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:42:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42947579
Mon 20 Jan 2014 14:42:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:42:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:42:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:42:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:42:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:42:28 - XML: Processed 645598 elements - found 0 jobs
Mon 20 Jan 2014 14:42:28 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:42:28 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:42:29 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:42:29 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:42:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:42:30 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:42:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:42:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:42:31 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:42:31 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:42:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:42:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:42:31 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:42:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:42:34 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:42:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:42:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:42:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:42:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:42:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:42:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:42:37 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:42:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42995163
Mon 20 Jan 2014 14:42:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:42:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42995163
Mon 20 Jan 2014 14:42:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:42:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:42:42 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:42:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:42:43 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:42:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 14:42:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 14:42:43 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:42:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8642 values 136269 bits 17033 bytes 
Mon 20 Jan 2014 14:42:44 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:42:44 - job_xml_thread(): Done retrieving: data size 42995163
Mon 20 Jan 2014 14:42:44 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:42:44 - XML: Start document: iteration 5
Mon 20 Jan 2014 14:42:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:42:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:42:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:42:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:42:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:42:53 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:42:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:42:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:42:53 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:42:53 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:42:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:42:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:42:53 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:42:59 - XML: Processed 645926 elements - found 0 jobs
Mon 20 Jan 2014 14:42:59 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:42:59 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:42:59 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:42:59 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:43:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:43:01 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:43:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:43:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:43:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:43:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:43:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:43:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:43:05 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:43:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557643
Mon 20 Jan 2014 14:43:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:43:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557643
Mon 20 Jan 2014 14:43:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:43:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:43:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:43:14 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:43:14 - job_xml_thread(): Done retrieving: data size 43557643
Mon 20 Jan 2014 14:43:14 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:43:14 - XML: Start document: iteration 6
Mon 20 Jan 2014 14:43:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:43:16 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:43:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:43:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:43:16 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:43:16 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:43:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:43:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:43:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:43:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:43:17 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:43:24 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:43:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 14:43:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:43:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:43:25 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:43:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:43:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:43:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:43:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:43:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:43:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:43:26 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 14:43:26 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:43:26 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:43:26 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:43:26 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:43:29 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 14:43:29 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 14:43:29 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:43:29 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:43:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43538577
Mon 20 Jan 2014 14:43:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:43:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43538577
Mon 20 Jan 2014 14:43:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:43:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:43:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:43:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:43:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:43:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:43:41 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:43:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:43:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:43:41 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:43:41 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:43:42 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:43:42 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:43:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:43:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:43:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:43:43 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:43:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:43:43 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:43:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:43:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:43:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:43:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 14:43:44 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:43:44 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:43:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 14:43:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5661 values 89249 bits 11156 bytes 
Mon 20 Jan 2014 14:43:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:43:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:43:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:43:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:43:45 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:43:45 - job_xml_thread(): Done retrieving: data size 43564898
Mon 20 Jan 2014 14:43:45 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:43:45 - XML: Start document: iteration 7
Mon 20 Jan 2014 14:43:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564898
Mon 20 Jan 2014 14:43:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:43:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564898
Mon 20 Jan 2014 14:43:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:43:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:43:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:43:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:43:57 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:43:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:43:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:43:58 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:43:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:43:58 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:43:58 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:43:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:43:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:43:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:44:01 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 14:44:01 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:44:01 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:44:01 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:44:01 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:44:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:44:07 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:44:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:44:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:44:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:44:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:44:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:44:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:44:08 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:44:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 14:44:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:44:09 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:44:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567172
Mon 20 Jan 2014 14:44:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:44:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567172
Mon 20 Jan 2014 14:44:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:44:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:44:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:44:16 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:44:16 - job_xml_thread(): Done retrieving: data size 43567172
Mon 20 Jan 2014 14:44:16 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:44:17 - XML: Start document: iteration 8
Mon 20 Jan 2014 14:44:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:44:18 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:44:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:44:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:44:19 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:44:19 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:44:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:44:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:44:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567172
Mon 20 Jan 2014 14:44:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:44:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:44:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:44:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:44:31 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:44:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:44:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:44:34 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:44:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:44:34 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:44:34 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:44:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:44:35 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 14:44:35 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:44:36 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:44:36 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:44:36 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:44:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:44:38 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:44:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:44:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:44:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:44:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:44:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:44:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:44:40 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:44:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584840
Mon 20 Jan 2014 14:44:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:44:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584840
Mon 20 Jan 2014 14:44:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:44:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:44:45 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:44:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:44:46 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:44:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 14:44:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 14:44:46 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:44:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7965 values 125583 bits 15697 bytes 
Mon 20 Jan 2014 14:44:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:44:48 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:44:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:44:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:44:50 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:44:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:44:50 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:44:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:44:51 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:44:51 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:44:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:44:53 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:44:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:44:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:44:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:44:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:44:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:44:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:44:55 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:44:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43589635
Mon 20 Jan 2014 14:44:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:44:55 - job_xml_thread(): Done retrieving: data size 43589635
Mon 20 Jan 2014 14:44:55 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:44:55 - XML: Start document: iteration 9
Mon 20 Jan 2014 14:44:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43589635
Mon 20 Jan 2014 14:44:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:45:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:45:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:45:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:45:08 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:45:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:45:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:45:08 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:45:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:45:08 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:45:08 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:45:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:45:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:45:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:45:14 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 14:45:14 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:45:14 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:45:14 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:45:14 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:45:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:45:17 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:45:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:45:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:45:17 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:45:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 14:45:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:45:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:45:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:45:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:45:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:45:19 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:45:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557350
Mon 20 Jan 2014 14:45:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:45:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557350
Mon 20 Jan 2014 14:45:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:45:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:45:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:45:29 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:45:29 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:45:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:45:29 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:45:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:45:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:45:29 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:45:29 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:45:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:45:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:45:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:45:32 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:45:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:45:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:45:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:45:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:45:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:45:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:45:34 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:45:34 - job_xml_thread(): Done retrieving: data size 43583493
Mon 20 Jan 2014 14:45:34 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:45:34 - XML: Start document: iteration 10
Mon 20 Jan 2014 14:45:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583493
Mon 20 Jan 2014 14:45:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:45:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583493
Mon 20 Jan 2014 14:45:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:45:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:45:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:45:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:45:47 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:45:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:45:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 14:45:47 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:45:47 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:45:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8767 values 138165 bits 17270 bytes 
Mon 20 Jan 2014 14:45:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 14:45:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:45:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:45:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:45:53 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:45:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:45:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:45:54 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:45:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:45:54 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:45:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:45:54 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:45:55 - XML: Processed 653354 elements - found 0 jobs
Mon 20 Jan 2014 14:45:55 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:45:55 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:45:55 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:45:55 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:45:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:45:56 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:45:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:45:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:45:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:45:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:45:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:45:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:45:59 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:45:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562502
Mon 20 Jan 2014 14:45:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:45:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562502
Mon 20 Jan 2014 14:45:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:46:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:46:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:46:11 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:46:11 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:46:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:46:11 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:46:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:46:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:46:12 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:46:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:46:12 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:46:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:46:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:46:12 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:46:12 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:46:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 14:46:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:46:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:46:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:46:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:46:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:46:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:46:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:46:14 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:46:14 - job_xml_thread(): Done retrieving: data size 43565413
Mon 20 Jan 2014 14:46:14 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:46:14 - XML: Start document: iteration 11
Mon 20 Jan 2014 14:46:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565413
Mon 20 Jan 2014 14:46:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:46:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565413
Mon 20 Jan 2014 14:46:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:46:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:46:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:46:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:46:28 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:46:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:46:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:46:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:46:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:46:30 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:46:30 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:46:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:46:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:46:30 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:46:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:46:36 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:46:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:46:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:46:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:46:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:46:38 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 14:46:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:46:38 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:46:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:46:38 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:46:38 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:46:38 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:46:39 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:46:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578933
Mon 20 Jan 2014 14:46:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:46:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578933
Mon 20 Jan 2014 14:46:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:46:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:46:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:46:45 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 14:46:45 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:46:46 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:46:46 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 14:46:46 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:46:46 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 14:46:46 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 14:46:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:46:48 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:46:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:46:48 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:46:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 14:46:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 14:46:50 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:46:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9212 values 145436 bits 18179 bytes 
Mon 20 Jan 2014 14:46:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:46:52 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:46:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:46:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:46:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:46:53 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:46:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:46:53 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:46:53 - size of cluster 'LISA Cluster': 624 hosts 79477 metrics 855535 values 13506847 bits 1688355 bytes 
Mon 20 Jan 2014 14:46:54 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:46:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:46:54 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:46:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:46:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:46:56 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:46:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:46:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:46:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:46:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:46:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:46:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:47:00 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:47:00 - job_xml_thread(): Done retrieving: data size 43564057
Mon 20 Jan 2014 14:47:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564057
Mon 20 Jan 2014 14:47:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:47:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564057
Mon 20 Jan 2014 14:47:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:47:00 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:47:00 - XML: Start document: iteration 12
Mon 20 Jan 2014 14:47:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:47:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:47:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:47:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:47:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:47:18 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:47:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:47:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:47:18 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:47:18 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:47:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:47:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:47:18 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:47:21 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 14:47:21 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:47:21 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:47:21 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:47:21 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:47:23 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:47:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 14:47:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:47:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:47:25 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:47:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:47:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:47:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:47:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:47:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:47:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:47:28 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:47:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43256784
Mon 20 Jan 2014 14:47:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:47:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43256784
Mon 20 Jan 2014 14:47:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:47:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:47:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:47:36 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:47:36 - job_xml_thread(): Done retrieving: data size 43256784
Mon 20 Jan 2014 14:47:36 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:47:36 - XML: Start document: iteration 13
Mon 20 Jan 2014 14:47:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:47:39 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:47:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:47:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:47:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:47:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:47:40 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:47:40 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:47:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:47:40 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:47:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:47:46 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:47:46 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 14:47:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:47:49 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:47:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:47:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 14:47:49 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:47:49 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:47:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 14:47:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5973 values 94578 bits 11822 bytes 
Mon 20 Jan 2014 14:47:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:47:51 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:47:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:47:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:47:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:47:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:47:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:47:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:47:52 - XML: Processed 649718 elements - found 0 jobs
Mon 20 Jan 2014 14:47:52 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:47:52 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:47:52 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:47:52 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:47:55 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:47:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42914475
Mon 20 Jan 2014 14:47:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:47:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:47:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:47:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42914475
Mon 20 Jan 2014 14:47:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:48:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:48:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:48:07 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:48:07 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:48:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:48:08 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:48:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:48:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:48:09 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:48:09 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:48:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:48:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:48:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:48:11 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:48:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:48:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:48:12 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:48:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 14:48:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:48:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:48:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:48:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:48:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:48:15 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:48:15 - job_xml_thread(): Done retrieving: data size 42963364
Mon 20 Jan 2014 14:48:15 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:48:15 - XML: Start document: iteration 14
Mon 20 Jan 2014 14:48:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42963364
Mon 20 Jan 2014 14:48:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:48:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42963364
Mon 20 Jan 2014 14:48:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:48:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:48:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:48:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:48:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:48:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:48:32 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:48:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:48:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:48:32 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:48:32 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:48:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:48:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:48:32 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:48:36 - XML: Processed 645908 elements - found 0 jobs
Mon 20 Jan 2014 14:48:36 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:48:36 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:48:36 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:48:36 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:48:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:48:39 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:48:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:48:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:48:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:48:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:48:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:48:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:48:42 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:48:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43375480
Mon 20 Jan 2014 14:48:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:48:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43375480
Mon 20 Jan 2014 14:48:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:48:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:48:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:48:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:48:49 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:48:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:48:51 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:48:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 14:48:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 14:48:51 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:48:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8895 values 140501 bits 17562 bytes 
Mon 20 Jan 2014 14:48:51 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:48:51 - job_xml_thread(): Done retrieving: data size 43375480
Mon 20 Jan 2014 14:48:51 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:48:51 - XML: Start document: iteration 15
Mon 20 Jan 2014 14:48:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:48:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:48:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:48:59 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:48:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:48:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:49:00 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:49:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:49:00 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:49:00 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:49:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:49:04 - XML: Processed 651234 elements - found 0 jobs
Mon 20 Jan 2014 14:49:04 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:49:04 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:49:04 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:49:04 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:49:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:49:06 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:49:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:49:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:49:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:49:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:49:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:49:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:49:09 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:49:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569019
Mon 20 Jan 2014 14:49:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:49:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569019
Mon 20 Jan 2014 14:49:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:49:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:49:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:49:19 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:49:19 - job_xml_thread(): Done retrieving: data size 43569019
Mon 20 Jan 2014 14:49:19 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:49:19 - XML: Start document: iteration 16
Mon 20 Jan 2014 14:49:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:49:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:49:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:49:24 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:49:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:49:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:49:25 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:49:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:49:25 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:49:25 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:49:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:49:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:49:31 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:49:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:49:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:49:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:49:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:49:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:49:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:49:33 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 14:49:33 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:49:33 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:49:33 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:49:33 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:49:33 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:49:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 14:49:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:49:36 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:49:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557909
Mon 20 Jan 2014 14:49:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:49:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557909
Mon 20 Jan 2014 14:49:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:49:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:49:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:49:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:49:45 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:49:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:49:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:49:46 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:49:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:49:46 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:49:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:49:47 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:49:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:49:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:49:48 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:49:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:49:50 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:49:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:49:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:49:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:49:51 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:49:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:49:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:49:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:49:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:49:51 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:49:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 14:49:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:49:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 14:49:51 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:49:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5536 values 87262 bits 10907 bytes 
Mon 20 Jan 2014 14:49:54 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:49:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573043
Mon 20 Jan 2014 14:49:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:49:54 - job_xml_thread(): Done retrieving: data size 43573043
Mon 20 Jan 2014 14:49:55 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:49:55 - XML: Start document: iteration 17
Mon 20 Jan 2014 14:49:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573043
Mon 20 Jan 2014 14:49:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:50:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:50:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:50:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:50:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:50:10 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 14:50:10 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:50:10 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:50:10 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:50:10 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:50:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:50:17 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:50:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:50:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:50:18 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:50:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:50:18 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:50:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:50:19 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:50:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:50:19 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:50:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:50:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:50:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:50:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:50:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:50:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:50:20 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:50:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 14:50:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:50:22 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:50:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43588136
Mon 20 Jan 2014 14:50:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:50:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43588136
Mon 20 Jan 2014 14:50:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:50:25 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:50:25 - job_xml_thread(): Done retrieving: data size 43588136
Mon 20 Jan 2014 14:50:25 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:50:25 - XML: Start document: iteration 18
Mon 20 Jan 2014 14:50:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:50:31 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:50:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:50:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:50:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:50:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:50:34 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:50:34 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:50:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:50:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:50:34 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:50:37 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 14:50:37 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:50:37 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:50:37 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:50:37 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:50:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:50:42 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:50:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:50:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:50:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:50:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:50:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:50:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:50:44 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 14:50:44 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 14:50:44 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:50:45 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:50:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561704
Mon 20 Jan 2014 14:50:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:50:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561704
Mon 20 Jan 2014 14:50:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:50:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:50:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:50:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:50:52 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:50:52 - job_xml_thread(): Done retrieving: data size 43561704
Mon 20 Jan 2014 14:50:52 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:50:52 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:50:52 - XML: Start document: iteration 19
Mon 20 Jan 2014 14:50:53 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:50:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 14:50:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:50:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 14:50:53 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:50:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8165 values 128768 bits 16096 bytes 
Mon 20 Jan 2014 14:50:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:50:55 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:50:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:50:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:50:56 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:50:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:50:56 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:50:56 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:50:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:50:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:50:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:51:03 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 14:51:03 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:51:03 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:51:03 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:51:03 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:51:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:51:07 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:51:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:51:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:51:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:51:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:51:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:51:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:51:09 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:51:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 14:51:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:51:09 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:51:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555491
Mon 20 Jan 2014 14:51:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:51:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555491
Mon 20 Jan 2014 14:51:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:51:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:51:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:51:18 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:51:19 - job_xml_thread(): Done retrieving: data size 43555491
Mon 20 Jan 2014 14:51:19 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:51:19 - XML: Start document: iteration 20
Mon 20 Jan 2014 14:51:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:51:19 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:51:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:51:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:51:20 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:51:20 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:51:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:51:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:51:20 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:51:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:51:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:51:29 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 14:51:29 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:51:29 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:51:29 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:51:29 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:51:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:51:30 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:51:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:51:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:51:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:51:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:51:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:51:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:51:32 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:51:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43551060
Mon 20 Jan 2014 14:51:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:51:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43551060
Mon 20 Jan 2014 14:51:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:51:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:51:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:51:44 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:51:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:51:44 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:51:44 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:51:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:51:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:51:45 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:51:45 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:51:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:51:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:51:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:51:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:51:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:51:47 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:51:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:51:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:51:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:51:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:51:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:51:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:51:48 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:51:48 - job_xml_thread(): Done retrieving: data size 43581668
Mon 20 Jan 2014 14:51:48 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:51:48 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 14:51:48 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 14:51:48 - Housekeeping: done.
Mon 20 Jan 2014 14:51:48 - XML: Start document: iteration 0
Mon 20 Jan 2014 14:51:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581668
Mon 20 Jan 2014 14:51:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:51:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581668
Mon 20 Jan 2014 14:51:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:51:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:51:54 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:51:54 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:51:54 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 14:51:54 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:51:54 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:51:54 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 14:51:54 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148655 bits 18581 bytes 
Mon 20 Jan 2014 14:52:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:52:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:52:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:52:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:52:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:52:08 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:52:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:52:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:52:09 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:52:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:52:09 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:52:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:52:09 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:52:10 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 14:52:10 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:52:10 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:52:10 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:52:10 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:52:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:52:11 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:52:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:52:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:52:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:52:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:52:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:52:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:52:13 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:52:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580436
Mon 20 Jan 2014 14:52:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:52:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580436
Mon 20 Jan 2014 14:52:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:52:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:52:23 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:52:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:52:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:52:24 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:52:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:52:24 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:52:24 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:52:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:52:25 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:52:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:52:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:52:28 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:52:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 14:52:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:52:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:52:29 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:52:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:52:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:52:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:52:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:52:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:52:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:52:30 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:52:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560348
Mon 20 Jan 2014 14:52:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:52:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560348
Mon 20 Jan 2014 14:52:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:52:31 - job_xml_thread(): Done retrieving: data size 43560348
Mon 20 Jan 2014 14:52:31 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:52:31 - XML: Start document: iteration 1
Mon 20 Jan 2014 14:52:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:52:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:52:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:52:41 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:52:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:52:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:52:43 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:52:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:52:43 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:52:43 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:52:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:52:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:52:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:52:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:52:49 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:52:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:52:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:52:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:52:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:52:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:52:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:52:52 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 14:52:52 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:52:52 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:52:52 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:52:52 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:52:53 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:52:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557622
Mon 20 Jan 2014 14:52:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:52:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557622
Mon 20 Jan 2014 14:52:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:52:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:52:54 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:52:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:52:56 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:52:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 14:52:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 14:52:56 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:52:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9247 values 145921 bits 18240 bytes 
Mon 20 Jan 2014 14:52:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:52:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:53:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:53:02 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:53:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:53:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:53:03 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:53:03 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:53:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:53:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:53:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557622
Mon 20 Jan 2014 14:53:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:53:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:53:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:53:07 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:53:07 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:53:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:53:12 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:53:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:53:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:53:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:53:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:53:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:53:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:53:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:53:15 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:53:17 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:53:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 14:53:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:53:17 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:53:17 - job_xml_thread(): Done retrieving: data size 43492460
Mon 20 Jan 2014 14:53:17 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:53:17 - XML: Start document: iteration 2
Mon 20 Jan 2014 14:53:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:53:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43492460
Mon 20 Jan 2014 14:53:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:53:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:53:20 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:53:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:53:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43492460
Mon 20 Jan 2014 14:53:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:53:20 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:53:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:53:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:53:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:53:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:53:33 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:53:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:53:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:53:37 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:53:37 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:53:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:53:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:53:38 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:53:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:53:39 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:53:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:53:40 - XML: Processed 652608 elements - found 0 jobs
Mon 20 Jan 2014 14:53:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:53:40 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:53:40 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:53:40 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:53:40 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:53:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:53:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:53:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:53:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:53:41 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:53:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42977699
Mon 20 Jan 2014 14:53:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:53:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42977699
Mon 20 Jan 2014 14:53:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:53:46 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 14:53:46 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:53:47 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:53:47 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 14:53:47 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 14:53:47 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:53:47 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 14:53:51 - size of cluster 'LISA Cluster': 624 hosts 79469 metrics 802821 values 12679352 bits 1584919 bytes 
Mon 20 Jan 2014 14:53:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:53:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:53:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:53:52 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:53:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:53:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:53:53 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:53:53 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:53:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:53:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:53:53 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:53:55 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:53:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:53:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:53:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:53:56 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:53:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:53:56 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:53:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:53:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:53:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:53:56 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:53:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 14:53:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 14:53:56 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:53:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6362 values 100393 bits 12549 bytes 
Mon 20 Jan 2014 14:53:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:53:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:53:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:53:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:53:59 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:53:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 14:53:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:54:00 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:54:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42914010
Mon 20 Jan 2014 14:54:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:54:01 - job_xml_thread(): Done retrieving: data size 42914010
Mon 20 Jan 2014 14:54:01 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:54:01 - XML: Start document: iteration 3
Mon 20 Jan 2014 14:54:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42914010
Mon 20 Jan 2014 14:54:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:54:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:54:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:54:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:54:12 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:54:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:54:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:54:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:54:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:54:13 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:54:14 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:54:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:54:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:54:14 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:54:21 - XML: Processed 645158 elements - found 0 jobs
Mon 20 Jan 2014 14:54:21 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:54:21 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:54:21 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:54:21 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:54:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:54:22 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:54:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:54:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:54:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:54:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:54:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:54:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:54:25 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:54:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42945335
Mon 20 Jan 2014 14:54:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:54:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42945335
Mon 20 Jan 2014 14:54:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:54:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:54:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:54:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:54:36 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:54:36 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:54:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:54:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:54:36 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:54:36 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:54:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:54:36 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:54:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:54:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:54:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:54:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:54:40 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:54:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:54:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:54:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:54:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:54:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:54:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:54:43 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:54:43 - job_xml_thread(): Done retrieving: data size 43498097
Mon 20 Jan 2014 14:54:43 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:54:43 - XML: Start document: iteration 4
Mon 20 Jan 2014 14:54:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43498097
Mon 20 Jan 2014 14:54:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:54:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43498097
Mon 20 Jan 2014 14:54:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:54:47 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:54:47 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 14:54:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:54:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:54:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:54:54 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:54:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:54:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:54:56 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:54:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:54:56 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:54:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:54:56 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:54:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:54:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:54:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:54:56 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:54:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:54:57 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:54:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 14:54:57 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:54:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 14:54:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148623 bits 18577 bytes 
Mon 20 Jan 2014 14:54:59 - XML: Processed 652644 elements - found 0 jobs
Mon 20 Jan 2014 14:54:59 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:54:59 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:54:59 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:54:59 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:55:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:55:06 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:55:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:55:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:55:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:55:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:55:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:55:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:55:09 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:55:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 14:55:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:55:09 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:55:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43539717
Mon 20 Jan 2014 14:55:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:55:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43539717
Mon 20 Jan 2014 14:55:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:55:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:55:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:55:14 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:55:15 - job_xml_thread(): Done retrieving: data size 43539717
Mon 20 Jan 2014 14:55:15 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:55:15 - XML: Start document: iteration 5
Mon 20 Jan 2014 14:55:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:55:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:55:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:55:24 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:55:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:55:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:55:25 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:55:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:55:25 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:55:25 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:55:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:55:28 - XML: Processed 653328 elements - found 0 jobs
Mon 20 Jan 2014 14:55:28 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:55:28 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:55:28 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:55:28 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:55:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:55:33 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:55:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:55:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:55:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:55:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:55:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:55:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:55:36 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:55:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562690
Mon 20 Jan 2014 14:55:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:55:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562690
Mon 20 Jan 2014 14:55:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:55:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:55:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:55:43 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:55:43 - job_xml_thread(): Done retrieving: data size 43562690
Mon 20 Jan 2014 14:55:43 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:55:43 - XML: Start document: iteration 6
Mon 20 Jan 2014 14:55:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:55:47 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:55:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:55:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:55:48 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:55:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:55:48 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:55:48 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:55:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:55:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:55:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:55:56 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 14:55:56 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:55:56 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:55:56 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:55:56 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:55:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:55:57 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:55:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:55:57 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:55:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:55:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:55:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:55:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:55:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:55:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:55:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:55:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 14:55:58 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:55:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 14:55:58 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:55:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99092 bits 12386 bytes 
Mon 20 Jan 2014 14:56:01 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:56:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43546930
Mon 20 Jan 2014 14:56:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:56:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43546930
Mon 20 Jan 2014 14:56:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:56:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:56:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:56:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:56:11 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:56:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:56:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:56:11 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:56:11 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:56:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:56:11 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:56:11 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:56:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:56:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:56:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:56:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:56:18 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:56:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:56:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:56:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:56:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:56:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:56:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:56:19 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:56:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 14:56:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:56:21 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:56:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571207
Mon 20 Jan 2014 14:56:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:56:21 - job_xml_thread(): Done retrieving: data size 43571207
Mon 20 Jan 2014 14:56:22 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:56:22 - XML: Start document: iteration 7
Mon 20 Jan 2014 14:56:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571207
Mon 20 Jan 2014 14:56:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:56:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:56:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:56:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:56:32 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:56:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:56:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:56:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:56:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:56:33 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:56:33 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:56:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:56:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:56:33 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:56:42 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 14:56:42 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:56:42 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:56:42 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:56:42 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:56:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:56:45 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:56:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:56:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:56:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:56:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:56:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:56:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:56:47 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:56:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43549062
Mon 20 Jan 2014 14:56:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:56:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:56:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:56:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43549062
Mon 20 Jan 2014 14:56:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:56:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:56:56 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:56:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:56:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:56:57 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:56:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:56:57 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:56:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43549062
Mon 20 Jan 2014 14:56:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:56:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:56:57 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:56:58 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:56:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:56:58 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:56:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:56:59 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 14:56:59 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:56:59 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:56:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 14:56:59 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8108 values 127803 bits 15975 bytes 
Mon 20 Jan 2014 14:57:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:57:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:57:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:57:08 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:57:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:57:10 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:57:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:57:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:57:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:57:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:57:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:57:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:57:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:57:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:57:13 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:57:13 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:57:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:57:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:57:13 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:57:13 - job_xml_thread(): Done retrieving: data size 43543514
Mon 20 Jan 2014 14:57:13 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:57:13 - XML: Start document: iteration 8
Mon 20 Jan 2014 14:57:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43543514
Mon 20 Jan 2014 14:57:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:57:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43543514
Mon 20 Jan 2014 14:57:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:57:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:57:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:57:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:57:27 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:57:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:57:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:57:29 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:57:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:57:29 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:57:29 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:57:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:57:33 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 14:57:33 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:57:33 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:57:33 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:57:33 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:57:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:57:37 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:57:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:57:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:57:37 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:57:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 14:57:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:57:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:57:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:57:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:57:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:57:39 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 14:57:39 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 14:57:39 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:57:40 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:57:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562497
Mon 20 Jan 2014 14:57:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:57:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562497
Mon 20 Jan 2014 14:57:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:57:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:57:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:57:48 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:57:48 - job_xml_thread(): Done retrieving: data size 43562497
Mon 20 Jan 2014 14:57:48 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:57:48 - XML: Start document: iteration 9
Mon 20 Jan 2014 14:57:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:57:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:57:53 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:57:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:57:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:57:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:57:55 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:57:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:57:55 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:57:55 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:57:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:57:59 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:57:59 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:58:00 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:58:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 14:58:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:58:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 14:58:00 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:58:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5760 values 90796 bits 11349 bytes 
Mon 20 Jan 2014 14:58:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:58:02 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:58:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:58:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:58:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:58:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:58:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:58:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:58:03 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 14:58:03 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:58:03 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:58:03 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:58:03 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:58:05 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:58:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569525
Mon 20 Jan 2014 14:58:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:58:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569525
Mon 20 Jan 2014 14:58:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:58:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:58:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:58:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:58:16 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:58:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:58:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:58:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:58:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:58:18 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:58:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:58:18 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:58:18 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:58:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:58:18 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:58:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:58:20 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:58:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:58:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:58:20 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:58:20 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 14:58:20 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:58:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:58:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:58:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:58:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:58:22 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:58:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43588553
Mon 20 Jan 2014 14:58:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:58:23 - job_xml_thread(): Done retrieving: data size 43588553
Mon 20 Jan 2014 14:58:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43588553
Mon 20 Jan 2014 14:58:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:58:24 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:58:24 - XML: Start document: iteration 10
Mon 20 Jan 2014 14:58:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:58:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:58:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:58:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:58:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:58:37 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:58:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:58:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:58:38 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:58:38 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:58:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:58:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:58:38 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:58:40 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 14:58:40 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:58:40 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:58:40 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:58:40 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:58:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:58:44 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:58:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:58:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:58:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:58:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:58:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:58:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:58:46 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:58:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574442
Mon 20 Jan 2014 14:58:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:58:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574442
Mon 20 Jan 2014 14:58:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:58:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:58:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:58:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:58:55 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:58:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:58:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:58:56 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:58:56 - job_xml_thread(): Done retrieving: data size 43574442
Mon 20 Jan 2014 14:58:56 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:58:56 - XML: Start document: iteration 11
Mon 20 Jan 2014 14:58:56 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:58:56 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:58:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:58:56 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:58:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:59:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:59:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:59:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:59:01 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:59:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:59:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 14:59:01 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:59:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 14:59:01 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:59:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8936 values 140932 bits 17616 bytes 
Mon 20 Jan 2014 14:59:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:59:04 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:59:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:59:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:59:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:59:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:59:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:59:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:59:07 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 14:59:07 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:59:07 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:59:07 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:59:07 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:59:10 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:59:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557754
Mon 20 Jan 2014 14:59:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:59:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557754
Mon 20 Jan 2014 14:59:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:59:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:59:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:59:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:59:20 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:59:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:59:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:59:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:59:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:59:20 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:59:20 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:59:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:59:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:59:20 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:59:22 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 14:59:24 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 14:59:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 14:59:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:59:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:59:25 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:59:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:59:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:59:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:59:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:59:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:59:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:59:27 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:59:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43161363
Mon 20 Jan 2014 14:59:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:59:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43161363
Mon 20 Jan 2014 14:59:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 14:59:27 - job_xml_thread(): Done retrieving: data size 43161363
Mon 20 Jan 2014 14:59:28 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 14:59:28 - XML: Start document: iteration 12
Mon 20 Jan 2014 14:59:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 14:59:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:59:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 14:59:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 14:59:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 14:59:45 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 14:59:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 14:59:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 14:59:46 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:59:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 14:59:46 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 14:59:46 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 14:59:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 14:59:48 - XML: Processed 648464 elements - found 0 jobs
Mon 20 Jan 2014 14:59:48 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 14:59:48 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 14:59:48 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 14:59:48 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 14:59:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 14:59:50 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 14:59:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 14:59:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 14:59:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:59:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 14:59:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 14:59:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 14:59:52 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 14:59:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42938206
Mon 20 Jan 2014 14:59:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 14:59:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42938206
Mon 20 Jan 2014 14:59:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:00:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:00:00 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:00:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:00:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:00:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:00:01 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:00:02 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:00:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:00:02 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:00:02 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:00:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:00:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 15:00:02 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:00:02 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:00:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 15:00:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:00:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8967 values 141357 bits 17669 bytes 
Mon 20 Jan 2014 15:00:04 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:00:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:00:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:00:06 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:00:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:00:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:00:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:00:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:00:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:00:08 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:00:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42926934
Mon 20 Jan 2014 15:00:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:00:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42926934
Mon 20 Jan 2014 15:00:09 - job_xml_thread(): Done retrieving: data size 42926934
Mon 20 Jan 2014 15:00:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:00:09 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:00:09 - XML: Start document: iteration 13
Mon 20 Jan 2014 15:00:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:00:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:00:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:00:21 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:00:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:00:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:00:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:00:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:00:22 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:00:22 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:00:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:00:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:00:22 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:00:25 - XML: Processed 645344 elements - found 0 jobs
Mon 20 Jan 2014 15:00:25 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:00:25 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:00:25 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:00:25 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:00:28 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:00:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 15:00:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:00:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:00:29 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:00:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:00:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:00:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:00:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:00:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:00:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:00:31 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:00:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42961730
Mon 20 Jan 2014 15:00:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:00:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42961730
Mon 20 Jan 2014 15:00:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:00:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:00:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:00:40 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:00:40 - job_xml_thread(): Done retrieving: data size 42961730
Mon 20 Jan 2014 15:00:40 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:00:40 - XML: Start document: iteration 14
Mon 20 Jan 2014 15:00:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:00:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:00:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:00:45 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:00:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:00:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:00:47 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:00:47 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:00:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:00:47 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:00:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:00:48 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 15:00:48 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:00:49 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:00:49 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 15:00:49 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:00:49 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 15:00:50 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 15:00:50 - XML: Processed 645920 elements - found 0 jobs
Mon 20 Jan 2014 15:00:50 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:00:50 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:00:50 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:00:50 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:00:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:00:53 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:00:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:00:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:00:53 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 861193 values 13591316 bits 1698914 bytes 
Mon 20 Jan 2014 15:00:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:00:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:00:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:00:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:00:56 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:00:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43538078
Mon 20 Jan 2014 15:00:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:00:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43538078
Mon 20 Jan 2014 15:00:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:01:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:01:02 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:01:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:01:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:01:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:01:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 15:01:03 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:01:03 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:01:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 15:01:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9100 values 143607 bits 17950 bytes 
Mon 20 Jan 2014 15:01:05 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:01:05 - job_xml_thread(): Done retrieving: data size 43538078
Mon 20 Jan 2014 15:01:05 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:01:05 - XML: Start document: iteration 15
Mon 20 Jan 2014 15:01:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:01:08 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:01:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:01:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:01:09 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:01:09 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:01:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:01:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:01:09 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:01:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:01:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:01:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:01:17 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:01:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:01:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:01:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:01:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:01:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:01:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:01:20 - XML: Processed 653228 elements - found 0 jobs
Mon 20 Jan 2014 15:01:20 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:01:20 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:01:20 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:01:20 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:01:23 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:01:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43547050
Mon 20 Jan 2014 15:01:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:01:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43547050
Mon 20 Jan 2014 15:01:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:01:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:01:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:01:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:01:32 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:01:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:01:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:01:33 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:01:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:01:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43547050
Mon 20 Jan 2014 15:01:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:01:33 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:01:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:01:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:01:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:01:35 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:01:35 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:01:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:01:40 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:01:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:01:44 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:01:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:01:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:01:44 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:01:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 15:01:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:01:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:01:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:01:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:01:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:01:48 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:01:48 - job_xml_thread(): Done retrieving: data size 43554209
Mon 20 Jan 2014 15:01:48 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:01:48 - XML: Start document: iteration 16
Mon 20 Jan 2014 15:01:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:01:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:01:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554209
Mon 20 Jan 2014 15:01:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:01:48 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:01:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:01:48 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:01:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:01:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554209
Mon 20 Jan 2014 15:01:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:01:49 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:01:49 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 15:02:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:02:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:02:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:02:01 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:02:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:02:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:02:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:02:03 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:02:04 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:02:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:02:04 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:02:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:02:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 15:02:04 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:02:04 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:02:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5868 values 92744 bits 11593 bytes 
Mon 20 Jan 2014 15:02:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:02:04 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:02:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 15:02:08 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 15:02:08 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:02:08 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:02:08 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:02:08 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:02:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:02:12 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:02:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:02:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:02:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:02:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:02:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:02:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:02:15 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:02:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554127
Mon 20 Jan 2014 15:02:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:02:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554127
Mon 20 Jan 2014 15:02:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:02:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:02:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:02:23 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:02:23 - job_xml_thread(): Done retrieving: data size 43554127
Mon 20 Jan 2014 15:02:23 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:02:23 - XML: Start document: iteration 17
Mon 20 Jan 2014 15:02:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:02:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:02:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:02:28 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:02:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:02:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:02:28 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:02:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:02:28 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:02:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:02:28 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:02:37 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 15:02:37 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:02:37 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:02:37 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:02:37 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:02:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:02:40 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:02:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:02:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:02:40 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:02:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 15:02:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:02:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:02:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:02:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:02:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:02:43 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:02:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43542347
Mon 20 Jan 2014 15:02:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:02:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43542347
Mon 20 Jan 2014 15:02:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:02:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:02:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:02:52 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:02:53 - job_xml_thread(): Done retrieving: data size 43542347
Mon 20 Jan 2014 15:02:53 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:02:53 - XML: Start document: iteration 18
Mon 20 Jan 2014 15:02:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:02:53 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:02:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:02:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:02:54 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:02:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:02:54 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:02:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:02:54 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:02:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:02:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:03:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:03:04 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:03:05 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 15:03:05 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:03:05 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:03:05 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:03:05 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:03:05 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:03:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 15:03:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:03:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 15:03:05 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:03:05 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5750 values 90980 bits 11372 bytes 
Mon 20 Jan 2014 15:03:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:03:06 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:03:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:03:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:03:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:03:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:03:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:03:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:03:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:03:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:03:10 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:03:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43548365
Mon 20 Jan 2014 15:03:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:03:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43548365
Mon 20 Jan 2014 15:03:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:03:20 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:03:20 - job_xml_thread(): Done retrieving: data size 43548365
Mon 20 Jan 2014 15:03:20 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:03:20 - XML: Start document: iteration 19
Mon 20 Jan 2014 15:03:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:03:20 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:03:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:03:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:03:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:03:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:03:22 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:03:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:03:22 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:03:22 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:03:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:03:30 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 15:03:30 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:03:30 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:03:30 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:03:30 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:03:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:03:32 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:03:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:03:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:03:33 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:03:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 15:03:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:03:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:03:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:03:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:03:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:03:36 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:03:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557643
Mon 20 Jan 2014 15:03:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:03:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557643
Mon 20 Jan 2014 15:03:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:03:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:03:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:03:45 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:03:45 - job_xml_thread(): Done retrieving: data size 43557643
Mon 20 Jan 2014 15:03:45 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:03:46 - XML: Start document: iteration 20
Mon 20 Jan 2014 15:03:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:03:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:03:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:03:51 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:03:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:03:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:03:52 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:03:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:03:52 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:03:52 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:03:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:03:56 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 15:03:56 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:03:56 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:03:56 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:03:56 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:03:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:03:58 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:03:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:03:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:03:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:03:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:03:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:03:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:04:00 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:04:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560639
Mon 20 Jan 2014 15:04:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:04:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560639
Mon 20 Jan 2014 15:04:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:04:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:04:05 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:04:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:04:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 15:04:06 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:04:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 15:04:06 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:04:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8639 values 136344 bits 17043 bytes 
Mon 20 Jan 2014 15:04:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:04:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:04:11 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:04:11 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:04:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:04:12 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:04:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:04:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:04:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:04:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:04:13 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:04:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:04:13 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:04:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:04:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:04:18 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:04:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:04:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:04:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:04:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:04:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:04:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:04:21 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:04:21 - job_xml_thread(): Done retrieving: data size 43572491
Mon 20 Jan 2014 15:04:21 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:04:21 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 15:04:21 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 15:04:21 - Housekeeping: done.
Mon 20 Jan 2014 15:04:21 - XML: Start document: iteration 0
Mon 20 Jan 2014 15:04:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572491
Mon 20 Jan 2014 15:04:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:04:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572491
Mon 20 Jan 2014 15:04:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:04:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:04:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:04:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:04:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:04:36 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 15:04:36 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:04:36 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:04:36 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:04:36 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:04:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:04:39 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:04:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:04:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:04:39 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:04:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:04:39 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:04:39 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:04:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:04:42 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:04:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 15:04:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:04:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:04:44 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:04:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:04:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:04:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:04:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:04:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:04:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:04:47 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 15:04:47 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 15:04:47 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:04:48 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:04:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569872
Mon 20 Jan 2014 15:04:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:04:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569872
Mon 20 Jan 2014 15:04:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:04:51 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:04:52 - job_xml_thread(): Done retrieving: data size 43569872
Mon 20 Jan 2014 15:04:52 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:04:52 - XML: Start document: iteration 1
Mon 20 Jan 2014 15:04:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:04:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:05:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:05:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:05:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:05:03 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:05:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:05:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:05:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:05:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:05:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:05:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:05:05 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:05:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:05:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:05:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:05:05 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:05:06 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:05:06 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:05:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:05:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:05:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:05:06 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:05:08 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 15:05:08 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:05:08 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:05:08 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:05:08 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:05:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:05:08 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:05:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 15:05:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 15:05:08 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:05:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5863 values 92516 bits 11564 bytes 
Mon 20 Jan 2014 15:05:10 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:05:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 15:05:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:05:10 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:05:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43506976
Mon 20 Jan 2014 15:05:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:05:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43506976
Mon 20 Jan 2014 15:05:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:05:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:05:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:05:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:05:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:05:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:05:22 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:05:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:05:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:05:23 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:05:23 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:05:24 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:05:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:05:24 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:05:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:05:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:05:25 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:05:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:05:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:05:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:05:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:05:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:05:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:05:27 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:05:27 - job_xml_thread(): Done retrieving: data size 43381711
Mon 20 Jan 2014 15:05:27 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:05:27 - XML: Start document: iteration 2
Mon 20 Jan 2014 15:05:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43381711
Mon 20 Jan 2014 15:05:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:05:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43381711
Mon 20 Jan 2014 15:05:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:05:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:05:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:05:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:05:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:05:43 - XML: Processed 650978 elements - found 0 jobs
Mon 20 Jan 2014 15:05:43 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:05:43 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:05:43 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:05:43 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:05:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:05:45 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:05:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:05:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:05:47 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:05:47 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:05:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:05:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:05:47 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:05:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:05:48 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:05:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:05:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:05:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:05:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:05:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:05:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:05:50 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:05:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42940475
Mon 20 Jan 2014 15:05:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:05:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42940475
Mon 20 Jan 2014 15:05:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:05:58 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:05:59 - job_xml_thread(): Done retrieving: data size 42940475
Mon 20 Jan 2014 15:05:59 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:05:59 - XML: Start document: iteration 3
Mon 20 Jan 2014 15:05:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:05:59 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:06:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:06:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:06:02 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:06:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:06:02 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:06:02 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:06:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:06:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:06:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:06:08 - XML: Processed 645406 elements - found 0 jobs
Mon 20 Jan 2014 15:06:08 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:06:08 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:06:08 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:06:08 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:06:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:06:08 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:06:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:06:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 15:06:09 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:06:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 15:06:09 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:06:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148674 bits 18584 bytes 
Mon 20 Jan 2014 15:06:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:06:10 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:06:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:06:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:06:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:06:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:06:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:06:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:06:12 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:06:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 15:06:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:06:12 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:06:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42951094
Mon 20 Jan 2014 15:06:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:06:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42951094
Mon 20 Jan 2014 15:06:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:06:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:06:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:06:23 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:06:23 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:06:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:06:23 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:06:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:06:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:06:24 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:06:24 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:06:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:06:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:06:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:06:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:06:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:06:26 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:06:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:06:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:06:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:06:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:06:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:06:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:06:28 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:06:28 - job_xml_thread(): Done retrieving: data size 42972695
Mon 20 Jan 2014 15:06:28 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:06:28 - XML: Start document: iteration 4
Mon 20 Jan 2014 15:06:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42972695
Mon 20 Jan 2014 15:06:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:06:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42972695
Mon 20 Jan 2014 15:06:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:06:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:06:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:06:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:06:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:06:45 - XML: Processed 645918 elements - found 0 jobs
Mon 20 Jan 2014 15:06:45 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:06:45 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:06:45 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:06:45 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:06:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:06:47 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:06:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:06:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:06:48 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:06:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:06:48 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:06:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:06:48 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:06:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:06:49 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:06:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:06:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:06:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:06:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:06:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:06:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:06:51 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:06:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43539646
Mon 20 Jan 2014 15:06:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:06:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43539646
Mon 20 Jan 2014 15:06:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:07:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:07:00 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:07:01 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:07:01 - job_xml_thread(): Done retrieving: data size 43539646
Mon 20 Jan 2014 15:07:01 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:07:01 - XML: Start document: iteration 5
Mon 20 Jan 2014 15:07:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:07:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:07:04 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:07:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:07:04 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:07:04 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:07:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:07:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:07:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:07:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:07:09 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:07:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:07:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:07:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:07:09 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:07:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:07:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 15:07:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:07:10 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:07:10 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:07:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:07:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148665 bits 18583 bytes 
Mon 20 Jan 2014 15:07:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:07:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 15:07:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:07:13 - XML: Processed 652903 elements - found 0 jobs
Mon 20 Jan 2014 15:07:13 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:07:13 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:07:13 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:07:13 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:07:15 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:07:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43549050
Mon 20 Jan 2014 15:07:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:07:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43549050
Mon 20 Jan 2014 15:07:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:07:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:07:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:07:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:07:23 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:07:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:07:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:07:23 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:07:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:07:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43549050
Mon 20 Jan 2014 15:07:23 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:07:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:07:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:07:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:07:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:07:28 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:07:28 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:07:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:07:34 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:07:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:07:37 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:07:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:07:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:07:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:07:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:07:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:07:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:07:38 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:07:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 15:07:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:07:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:07:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:07:39 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:07:39 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:07:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:07:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:07:39 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:07:39 - job_xml_thread(): Done retrieving: data size 43535345
Mon 20 Jan 2014 15:07:39 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:07:39 - XML: Start document: iteration 6
Mon 20 Jan 2014 15:07:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43535345
Mon 20 Jan 2014 15:07:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43535345
Mon 20 Jan 2014 15:07:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:07:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:07:49 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 15:07:49 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:07:51 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:07:51 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 15:07:51 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:07:51 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 15:07:51 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 15:07:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:07:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:07:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:07:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:08:01 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 15:08:01 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:08:01 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:08:01 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:08:01 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:08:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:08:03 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:08:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:08:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:08:04 - size of cluster 'LISA Cluster': 624 hosts 79483 metrics 855715 values 13511571 bits 1688946 bytes 
Mon 20 Jan 2014 15:08:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:08:04 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:08:04 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:08:04 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:08:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:08:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:08:04 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:08:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:08:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:08:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:08:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:08:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:08:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:08:08 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:08:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578983
Mon 20 Jan 2014 15:08:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:08:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578983
Mon 20 Jan 2014 15:08:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:08:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:08:10 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:08:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:08:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 15:08:11 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:08:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8652 values 136450 bits 17056 bytes 
Mon 20 Jan 2014 15:08:11 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:08:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 15:08:16 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:08:16 - job_xml_thread(): Done retrieving: data size 43578983
Mon 20 Jan 2014 15:08:17 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:08:17 - XML: Start document: iteration 7
Mon 20 Jan 2014 15:08:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:08:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:08:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:08:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:08:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:08:23 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:08:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:08:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:08:23 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:08:23 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:08:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:08:23 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:08:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:08:27 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 15:08:27 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:08:27 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:08:27 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:08:27 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:08:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:08:30 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:08:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:08:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:08:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:08:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:08:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:08:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:08:34 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:08:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563637
Mon 20 Jan 2014 15:08:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:08:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563637
Mon 20 Jan 2014 15:08:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:08:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:08:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:08:42 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:08:42 - job_xml_thread(): Done retrieving: data size 43563637
Mon 20 Jan 2014 15:08:42 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:08:42 - XML: Start document: iteration 8
Mon 20 Jan 2014 15:08:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:08:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:08:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:08:48 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:08:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:08:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:08:50 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:08:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:08:50 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:08:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:08:50 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:08:51 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:08:51 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 15:08:56 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:08:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 15:08:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:08:58 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 15:08:58 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:08:58 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:08:58 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:08:58 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:08:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:08:59 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:08:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:08:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:08:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:08:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:08:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:08:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:09:02 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:09:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558041
Mon 20 Jan 2014 15:09:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:09:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558041
Mon 20 Jan 2014 15:09:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:09:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:09:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:09:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:09:12 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:09:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:09:12 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:09:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:09:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:09:13 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:09:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:09:13 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:09:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:09:13 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:09:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:09:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 15:09:13 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:09:13 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:09:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 15:09:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6008 values 94760 bits 11845 bytes 
Mon 20 Jan 2014 15:09:13 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:09:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:09:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:09:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:09:17 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:09:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:09:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:09:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:09:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:09:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:09:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:09:21 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:09:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 15:09:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:09:21 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:09:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575013
Mon 20 Jan 2014 15:09:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:09:22 - job_xml_thread(): Done retrieving: data size 43575013
Mon 20 Jan 2014 15:09:22 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:09:22 - XML: Start document: iteration 9
Mon 20 Jan 2014 15:09:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575013
Mon 20 Jan 2014 15:09:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:09:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:09:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:09:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:09:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:09:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:09:38 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:09:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:09:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:09:40 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:09:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:09:40 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:09:40 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:09:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:09:41 - XML: Processed 653355 elements - found 0 jobs
Mon 20 Jan 2014 15:09:41 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:09:41 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:09:41 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:09:41 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:09:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:09:44 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:09:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:09:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:09:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:09:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:09:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:09:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:09:47 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:09:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575481
Mon 20 Jan 2014 15:09:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:09:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575481
Mon 20 Jan 2014 15:09:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:09:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:09:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:09:56 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:09:56 - job_xml_thread(): Done retrieving: data size 43575481
Mon 20 Jan 2014 15:09:57 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:09:57 - XML: Start document: iteration 10
Mon 20 Jan 2014 15:09:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:09:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:10:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:10:04 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:10:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:10:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:10:05 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:10:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:10:05 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:10:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:10:05 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:10:09 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 15:10:09 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:10:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:10:09 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:10:09 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:10:09 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:10:09 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:10:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:10:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:10:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:10:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:10:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:10:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:10:13 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:10:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560132
Mon 20 Jan 2014 15:10:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:10:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:10:13 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:10:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:10:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 15:10:13 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:10:13 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:10:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 15:10:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6532 values 103071 bits 12883 bytes 
Mon 20 Jan 2014 15:10:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560132
Mon 20 Jan 2014 15:10:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:10:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:10:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:10:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:10:23 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:10:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:10:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:10:23 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:10:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:10:23 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:10:23 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:10:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:10:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:10:24 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:10:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:10:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:10:30 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:10:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:10:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:10:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:10:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:10:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:10:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:10:33 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:10:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568631
Mon 20 Jan 2014 15:10:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:10:34 - job_xml_thread(): Done retrieving: data size 43568631
Mon 20 Jan 2014 15:10:34 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:10:34 - XML: Start document: iteration 11
Mon 20 Jan 2014 15:10:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568631
Mon 20 Jan 2014 15:10:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:10:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:10:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:10:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:10:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:10:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:10:51 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:10:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:10:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:10:52 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:10:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:10:52 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:10:52 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:10:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:10:53 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 15:10:53 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:10:53 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:10:53 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:10:53 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:10:57 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:10:57 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 15:10:57 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:10:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:10:57 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:10:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:10:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:10:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:10:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:10:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:10:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:11:01 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:11:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567476
Mon 20 Jan 2014 15:11:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:11:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567476
Mon 20 Jan 2014 15:11:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:11:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:11:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:11:08 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:11:08 - job_xml_thread(): Done retrieving: data size 43567476
Mon 20 Jan 2014 15:11:08 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:11:08 - XML: Start document: iteration 12
Mon 20 Jan 2014 15:11:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:11:13 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:11:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:11:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:11:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:11:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:11:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:11:13 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:11:15 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:11:15 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:11:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:11:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:11:15 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:11:15 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:11:15 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:11:15 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 15:11:15 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:11:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5950 values 93887 bits 11735 bytes 
Mon 20 Jan 2014 15:11:15 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 15:11:20 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 15:11:20 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:11:20 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:11:20 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:11:20 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:11:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:11:24 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:11:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:11:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:11:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:11:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:11:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:11:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:11:28 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:11:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43346561
Mon 20 Jan 2014 15:11:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:11:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43346561
Mon 20 Jan 2014 15:11:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:11:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:11:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:11:35 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:11:35 - job_xml_thread(): Done retrieving: data size 43346561
Mon 20 Jan 2014 15:11:35 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:11:35 - XML: Start document: iteration 13
Mon 20 Jan 2014 15:11:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:11:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:11:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:11:44 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:11:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:11:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:11:45 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:11:45 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:11:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:11:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:11:45 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:11:45 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:11:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 15:11:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:11:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:11:47 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:11:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:11:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:11:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:11:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:11:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:11:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:11:48 - XML: Processed 650990 elements - found 0 jobs
Mon 20 Jan 2014 15:11:48 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:11:48 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:11:48 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:11:48 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:11:51 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:11:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42937100
Mon 20 Jan 2014 15:11:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:11:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42937100
Mon 20 Jan 2014 15:11:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:12:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:12:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:12:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:12:01 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:12:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:12:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:12:02 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:12:02 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:12:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:12:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:12:02 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:12:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:12:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:12:03 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:12:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:12:06 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:12:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:12:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:12:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:12:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:12:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:12:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:12:08 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:12:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42950913
Mon 20 Jan 2014 15:12:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:12:08 - job_xml_thread(): Done retrieving: data size 42950913
Mon 20 Jan 2014 15:12:08 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:12:08 - XML: Start document: iteration 14
Mon 20 Jan 2014 15:12:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42950913
Mon 20 Jan 2014 15:12:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:12:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:12:16 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:12:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:12:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:12:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:12:18 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:12:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 15:12:18 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:12:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 15:12:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9179 values 144785 bits 18098 bytes 
Mon 20 Jan 2014 15:12:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:12:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:12:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:12:26 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:12:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:12:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:12:27 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:12:27 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:12:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:12:27 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:12:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:12:27 - XML: Processed 645666 elements - found 0 jobs
Mon 20 Jan 2014 15:12:27 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:12:27 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:12:27 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:12:27 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:12:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:12:31 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:12:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:12:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:12:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:12:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:12:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:12:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:12:32 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 15:12:32 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 15:12:32 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:12:34 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:12:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 15:12:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:12:35 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:12:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43005862
Mon 20 Jan 2014 15:12:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:12:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43005862
Mon 20 Jan 2014 15:12:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:12:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:12:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:12:42 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:12:42 - job_xml_thread(): Done retrieving: data size 43005862
Mon 20 Jan 2014 15:12:42 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:12:42 - XML: Start document: iteration 15
Mon 20 Jan 2014 15:12:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:12:47 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:12:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:12:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:12:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:12:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:12:48 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:12:48 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:12:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:12:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:12:48 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:12:53 - XML: Processed 646188 elements - found 0 jobs
Mon 20 Jan 2014 15:12:53 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:12:53 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:12:53 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:12:53 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:12:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:12:56 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:12:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:12:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:12:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:12:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:12:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:12:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:12:58 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:12:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43540099
Mon 20 Jan 2014 15:12:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:12:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43540099
Mon 20 Jan 2014 15:12:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:13:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:13:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:13:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:13:07 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:13:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:13:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:13:08 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:13:08 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:13:09 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:13:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:13:09 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:13:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:13:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:13:12 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:13:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:13:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:13:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:13:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:13:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:13:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:13:13 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:13:13 - job_xml_thread(): Done retrieving: data size 43567645
Mon 20 Jan 2014 15:13:13 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:13:13 - XML: Start document: iteration 16
Mon 20 Jan 2014 15:13:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567645
Mon 20 Jan 2014 15:13:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:13:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567645
Mon 20 Jan 2014 15:13:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:13:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:13:19 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:13:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:13:20 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:13:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 15:13:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 15:13:20 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:13:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148548 bits 18568 bytes 
Mon 20 Jan 2014 15:13:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:13:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:13:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:13:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:13:30 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 15:13:30 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:13:30 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:13:30 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:13:30 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:13:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:13:31 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:13:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:13:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:13:32 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:13:32 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:13:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:13:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:13:32 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:13:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:13:35 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:13:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:13:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:13:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:13:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:13:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:13:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:13:37 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:13:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559325
Mon 20 Jan 2014 15:13:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:13:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559325
Mon 20 Jan 2014 15:13:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:13:45 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:13:45 - job_xml_thread(): Done retrieving: data size 43559325
Mon 20 Jan 2014 15:13:45 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:13:45 - XML: Start document: iteration 17
Mon 20 Jan 2014 15:13:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:13:46 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:13:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:13:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:13:48 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:13:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:13:48 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:13:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:13:48 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:13:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:13:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:13:59 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 15:13:59 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:13:59 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:13:59 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:13:59 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:14:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:14:00 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:14:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:14:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:14:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:14:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:14:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:14:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:14:01 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:14:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 15:14:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:14:02 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:14:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555254
Mon 20 Jan 2014 15:14:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:14:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555254
Mon 20 Jan 2014 15:14:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:14:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:14:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:14:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:14:11 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:14:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:14:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:14:12 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:14:12 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:14:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:14:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:14:13 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:14:14 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:14:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:14:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:14:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:14:16 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:14:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:14:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:14:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:14:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:14:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:14:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:14:18 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:14:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575676
Mon 20 Jan 2014 15:14:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:14:18 - job_xml_thread(): Done retrieving: data size 43575676
Mon 20 Jan 2014 15:14:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575676
Mon 20 Jan 2014 15:14:19 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:14:19 - XML: Start document: iteration 18
Mon 20 Jan 2014 15:14:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:14:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:14:20 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:14:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:14:22 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:14:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 15:14:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 15:14:23 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:14:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8741 values 137756 bits 17219 bytes 
Mon 20 Jan 2014 15:14:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:14:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:14:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:14:29 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:14:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:14:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:14:30 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:14:30 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:14:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:14:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:14:30 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:14:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:14:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:14:34 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 15:14:34 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:14:34 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:14:34 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:14:34 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:14:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:14:38 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:14:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:14:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:14:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:14:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:14:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:14:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:14:40 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:14:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563052
Mon 20 Jan 2014 15:14:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:14:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563052
Mon 20 Jan 2014 15:14:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:14:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:14:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:14:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:14:48 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:14:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:14:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:14:48 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:14:48 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:14:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:14:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:14:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563052
Mon 20 Jan 2014 15:14:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:14:49 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:14:49 - job_xml_thread(): Done retrieving: data size 43563052
Mon 20 Jan 2014 15:14:49 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:14:49 - XML: Start document: iteration 19
Mon 20 Jan 2014 15:14:52 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 15:14:52 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:14:53 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:14:53 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 15:14:53 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 15:14:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:14:54 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:14:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:14:54 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 15:15:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:15:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:15:05 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 15:15:05 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:15:05 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:15:05 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:15:05 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:15:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:15:07 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:15:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:15:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:15:07 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:15:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:15:07 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:15:07 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:15:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:15:07 - size of cluster 'LISA Cluster': 624 hosts 79482 metrics 795439 values 12551880 bits 1568985 bytes 
Mon 20 Jan 2014 15:15:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:15:09 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:15:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:15:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:15:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:15:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:15:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:15:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:15:10 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:15:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 15:15:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:15:12 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:15:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577045
Mon 20 Jan 2014 15:15:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:15:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577045
Mon 20 Jan 2014 15:15:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:15:20 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:15:20 - job_xml_thread(): Done retrieving: data size 43577045
Mon 20 Jan 2014 15:15:20 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:15:20 - XML: Start document: iteration 20
Mon 20 Jan 2014 15:15:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:15:23 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:15:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:15:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:15:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:15:23 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:15:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 15:15:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 15:15:23 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:15:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5641 values 88913 bits 11114 bytes 
Mon 20 Jan 2014 15:15:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:15:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:15:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:15:26 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:15:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:15:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:15:27 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:15:27 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:15:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:15:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:15:27 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:15:31 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 15:15:31 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:15:31 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:15:31 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:15:31 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:15:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:15:34 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:15:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:15:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:15:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:15:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:15:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:15:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:15:37 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:15:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43551079
Mon 20 Jan 2014 15:15:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:15:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43551079
Mon 20 Jan 2014 15:15:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:15:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:15:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:15:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:15:45 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:15:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:15:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:15:46 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:15:46 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:15:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:15:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43551079
Mon 20 Jan 2014 15:15:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:15:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:15:46 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:15:46 - job_xml_thread(): Done retrieving: data size 43551079
Mon 20 Jan 2014 15:15:46 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:15:46 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 15:15:46 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 15:15:46 - Housekeeping: done.
Mon 20 Jan 2014 15:15:46 - XML: Start document: iteration 0
Mon 20 Jan 2014 15:15:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:15:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:15:54 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:15:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 15:15:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:15:54 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:15:54 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 15:16:00 - XML: Processed 653356 elements - found 0 jobs
Mon 20 Jan 2014 15:16:01 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:16:01 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:16:01 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:16:01 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:16:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:16:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:16:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:16:03 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:16:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:16:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:16:04 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:16:04 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:16:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:16:04 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:16:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:16:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:16:06 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:16:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:16:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:16:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:16:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:16:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:16:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:16:09 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:16:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580389
Mon 20 Jan 2014 15:16:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:16:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580389
Mon 20 Jan 2014 15:16:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:16:16 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:16:16 - job_xml_thread(): Done retrieving: data size 43580389
Mon 20 Jan 2014 15:16:16 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:16:16 - XML: Start document: iteration 1
Mon 20 Jan 2014 15:16:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:16:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:16:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:16:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:16:22 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:16:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:16:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:16:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:16:23 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:16:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:16:23 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:16:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:16:23 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:16:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:16:23 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:16:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:16:24 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:16:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 15:16:24 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:16:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 15:16:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6189 values 97661 bits 12207 bytes 
Mon 20 Jan 2014 15:16:27 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 15:16:27 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:16:27 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:16:27 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:16:27 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:16:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:16:32 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:16:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:16:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:16:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:16:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:16:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:16:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:16:35 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:16:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562183
Mon 20 Jan 2014 15:16:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:16:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562183
Mon 20 Jan 2014 15:16:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:16:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:16:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:16:42 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:16:42 - job_xml_thread(): Done retrieving: data size 43562183
Mon 20 Jan 2014 15:16:42 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:16:42 - XML: Start document: iteration 2
Mon 20 Jan 2014 15:16:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:16:47 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:16:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:16:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:16:48 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:16:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:16:48 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:16:48 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:16:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:16:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:16:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:16:53 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 15:16:53 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:16:53 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:16:53 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:16:53 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:16:54 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:16:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 15:16:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:16:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:16:57 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:16:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:16:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:16:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:16:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:16:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:16:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:17:00 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:17:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570185
Mon 20 Jan 2014 15:17:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:17:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570185
Mon 20 Jan 2014 15:17:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:17:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:17:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:17:08 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:17:08 - job_xml_thread(): Done retrieving: data size 43570185
Mon 20 Jan 2014 15:17:08 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:17:08 - XML: Start document: iteration 3
Mon 20 Jan 2014 15:17:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:17:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:17:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:17:20 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:17:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:17:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:17:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:17:20 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:17:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:17:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:17:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:17:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:17:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:17:20 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:17:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:17:21 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:17:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:17:21 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:17:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:17:23 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 15:17:23 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:17:23 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:17:23 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:17:23 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:17:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:17:24 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:17:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:17:25 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:17:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 15:17:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 15:17:25 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:17:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5948 values 94051 bits 11756 bytes 
Mon 20 Jan 2014 15:17:26 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:17:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43508696
Mon 20 Jan 2014 15:17:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:17:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43508696
Mon 20 Jan 2014 15:17:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:17:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:17:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:17:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:17:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:17:38 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:17:38 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:17:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:17:39 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:17:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:17:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:17:40 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:17:40 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:17:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:17:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:17:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:17:43 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:17:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:17:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:17:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:17:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:17:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:17:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:17:45 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:17:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 15:17:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:17:46 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:17:46 - job_xml_thread(): Done retrieving: data size 42994364
Mon 20 Jan 2014 15:17:46 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:17:46 - XML: Start document: iteration 4
Mon 20 Jan 2014 15:17:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42994364
Mon 20 Jan 2014 15:17:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:17:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42994364
Mon 20 Jan 2014 15:17:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:17:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:17:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:17:58 - XML: Processed 646050 elements - found 0 jobs
Mon 20 Jan 2014 15:17:58 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:17:58 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:17:58 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:17:58 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:17:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:17:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:18:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:18:06 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:18:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:18:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:18:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:18:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:18:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:18:07 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:18:07 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:18:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:18:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:18:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:18:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:18:08 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:18:08 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:18:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:18:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:18:10 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:18:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42916088
Mon 20 Jan 2014 15:18:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:18:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42916088
Mon 20 Jan 2014 15:18:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:18:14 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:18:14 - job_xml_thread(): Done retrieving: data size 42916088
Mon 20 Jan 2014 15:18:14 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:18:14 - XML: Start document: iteration 5
Mon 20 Jan 2014 15:18:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:18:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:18:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:18:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:18:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:18:25 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:18:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:18:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 15:18:26 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:18:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7631 values 120791 bits 15098 bytes 
Mon 20 Jan 2014 15:18:26 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:18:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 15:18:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:18:27 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:18:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:18:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:18:28 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:18:28 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:18:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:18:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:18:28 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:18:31 - XML: Processed 645158 elements - found 0 jobs
Mon 20 Jan 2014 15:18:31 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:18:31 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:18:31 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:18:31 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:18:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:18:32 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:18:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:18:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:18:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:18:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:18:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:18:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:18:35 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:18:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43279016
Mon 20 Jan 2014 15:18:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:18:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43279016
Mon 20 Jan 2014 15:18:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:18:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:18:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:18:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:18:44 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:18:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:18:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:18:44 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:18:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:18:44 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:18:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:18:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43279016
Mon 20 Jan 2014 15:18:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:18:46 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:18:46 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:18:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:18:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:18:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:18:57 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:18:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:18:59 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:18:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:18:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:18:59 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:18:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 15:18:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:18:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:18:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:18:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:18:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:19:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:19:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:19:00 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:19:00 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:19:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:19:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:19:01 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 15:19:01 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 15:19:01 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:19:01 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:19:01 - job_xml_thread(): Done retrieving: data size 43541626
Mon 20 Jan 2014 15:19:01 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:19:01 - XML: Start document: iteration 6
Mon 20 Jan 2014 15:19:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43541626
Mon 20 Jan 2014 15:19:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43541626
Mon 20 Jan 2014 15:19:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:19:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:19:09 - XML: Processed 653228 elements - found 0 jobs
Mon 20 Jan 2014 15:19:09 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:19:09 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:19:09 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:19:09 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:19:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:19:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:19:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:19:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:19:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:19:17 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:19:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:19:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:19:17 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:19:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:19:17 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:19:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:19:17 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:19:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:19:21 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:19:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:19:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:19:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:19:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:19:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:19:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:19:23 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:19:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565911
Mon 20 Jan 2014 15:19:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:19:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565911
Mon 20 Jan 2014 15:19:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:19:24 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:19:24 - job_xml_thread(): Done retrieving: data size 43565911
Mon 20 Jan 2014 15:19:24 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:19:25 - XML: Start document: iteration 7
Mon 20 Jan 2014 15:19:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:19:26 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:19:27 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:19:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:19:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 15:19:27 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:19:27 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 15:19:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8873 values 140016 bits 17502 bytes 
Mon 20 Jan 2014 15:19:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:19:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:19:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:19:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:19:41 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 15:19:41 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:19:41 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:19:41 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:19:41 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:19:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:19:47 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:19:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:19:47 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:19:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:19:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:19:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:19:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:19:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:19:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:19:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:19:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:19:47 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:19:48 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:19:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:19:48 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:19:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:19:49 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:19:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 15:19:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:19:49 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:19:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575919
Mon 20 Jan 2014 15:19:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:19:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575919
Mon 20 Jan 2014 15:19:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:19:56 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:19:56 - job_xml_thread(): Done retrieving: data size 43575919
Mon 20 Jan 2014 15:19:56 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:19:56 - XML: Start document: iteration 8
Mon 20 Jan 2014 15:20:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:20:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:20:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:20:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:20:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:20:07 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:20:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:20:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:20:08 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:20:08 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:20:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:20:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:20:08 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:20:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:20:09 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:20:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:20:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:20:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:20:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:20:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:20:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:20:11 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 15:20:11 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:20:11 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:20:11 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:20:11 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:20:14 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:20:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573544
Mon 20 Jan 2014 15:20:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:20:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573544
Mon 20 Jan 2014 15:20:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:20:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:20:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:20:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:20:25 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:20:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:20:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:20:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:20:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:20:25 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:20:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:20:25 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:20:25 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:20:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:20:26 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:20:27 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:20:27 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:20:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:20:28 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:20:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:20:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:20:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:20:28 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:20:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 15:20:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 15:20:28 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:20:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99056 bits 12382 bytes 
Mon 20 Jan 2014 15:20:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:20:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:20:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:20:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:20:30 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:20:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584620
Mon 20 Jan 2014 15:20:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:20:31 - job_xml_thread(): Done retrieving: data size 43584620
Mon 20 Jan 2014 15:20:31 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:20:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584620
Mon 20 Jan 2014 15:20:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:20:31 - XML: Start document: iteration 9
Mon 20 Jan 2014 15:20:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:20:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:20:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:20:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:20:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:20:49 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:20:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:20:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:20:51 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:20:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:20:51 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:20:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:20:51 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:20:51 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 15:20:51 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:20:51 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:20:51 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:20:51 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:20:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:20:52 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:20:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:20:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:20:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:20:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:20:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:20:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:20:53 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:20:53 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 15:20:53 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:20:54 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:20:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584122
Mon 20 Jan 2014 15:20:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:20:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584122
Mon 20 Jan 2014 15:20:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:21:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:21:04 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:21:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:21:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:21:06 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:21:06 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:21:07 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:21:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:21:07 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:21:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:21:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:21:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:21:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:21:08 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:21:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:21:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:21:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:21:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:21:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:21:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:21:10 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:21:10 - job_xml_thread(): Done retrieving: data size 43579039
Mon 20 Jan 2014 15:21:10 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:21:10 - XML: Start document: iteration 10
Mon 20 Jan 2014 15:21:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579039
Mon 20 Jan 2014 15:21:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579039
Mon 20 Jan 2014 15:21:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:21:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:21:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:21:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:21:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:21:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:21:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:21:26 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:21:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:21:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:21:27 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:21:27 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:21:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:21:27 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:21:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:21:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:21:29 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:21:30 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 15:21:30 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:21:30 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:21:30 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:21:30 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:21:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:21:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 15:21:30 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:21:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 15:21:30 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:21:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7980 values 125916 bits 15739 bytes 
Mon 20 Jan 2014 15:21:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:21:33 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:21:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:21:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:21:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:21:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:21:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:21:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:21:36 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:21:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553395
Mon 20 Jan 2014 15:21:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:21:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553395
Mon 20 Jan 2014 15:21:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:21:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:21:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:21:45 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:21:45 - job_xml_thread(): Done retrieving: data size 43553395
Mon 20 Jan 2014 15:21:45 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:21:45 - XML: Start document: iteration 11
Mon 20 Jan 2014 15:21:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:21:45 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:21:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:21:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:21:46 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:21:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:21:46 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:21:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:21:46 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:21:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:21:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:21:54 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 15:21:54 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:21:56 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:21:56 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:21:56 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 15:21:56 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 15:21:56 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 15:21:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:21:59 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:21:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:21:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:21:59 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 15:21:59 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:21:59 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:21:59 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:21:59 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:21:59 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 820176 values 12957257 bits 1619657 bytes 
Mon 20 Jan 2014 15:22:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:22:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:22:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:22:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:22:00 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:22:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 15:22:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:22:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:22:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:22:03 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:22:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43552100
Mon 20 Jan 2014 15:22:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:22:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43552100
Mon 20 Jan 2014 15:22:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:22:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:22:12 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:22:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:22:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:22:14 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:22:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:22:14 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:22:14 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:22:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:22:14 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:22:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:22:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:22:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:22:16 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:22:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:22:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:22:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:22:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:22:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:22:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:22:19 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:22:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580726
Mon 20 Jan 2014 15:22:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:22:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580726
Mon 20 Jan 2014 15:22:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:22:21 - job_xml_thread(): Done retrieving: data size 43580726
Mon 20 Jan 2014 15:22:21 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:22:21 - XML: Start document: iteration 12
Mon 20 Jan 2014 15:22:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:22:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:22:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:22:30 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:22:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:22:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:22:31 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:22:31 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 15:22:31 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:22:32 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:22:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 15:22:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8870 values 139884 bits 17485 bytes 
Mon 20 Jan 2014 15:22:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:22:34 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:22:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:22:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:22:36 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:22:36 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:22:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:22:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:22:36 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:22:37 - XML: Processed 653356 elements - found 0 jobs
Mon 20 Jan 2014 15:22:37 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:22:37 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:22:37 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:22:37 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:22:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:22:41 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:22:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:22:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:22:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:22:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:22:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:22:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:22:44 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:22:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571973
Mon 20 Jan 2014 15:22:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:22:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571973
Mon 20 Jan 2014 15:22:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:22:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:22:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:22:52 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:22:52 - job_xml_thread(): Done retrieving: data size 43571973
Mon 20 Jan 2014 15:22:52 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:22:52 - XML: Start document: iteration 13
Mon 20 Jan 2014 15:22:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:22:53 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:22:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:22:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:22:54 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:22:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:22:54 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:22:54 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:22:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:22:56 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:22:56 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 15:22:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:22:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:23:03 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 15:23:03 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:23:03 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:23:03 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:23:03 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:23:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:23:07 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:23:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:23:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:23:07 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:23:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 15:23:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:23:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:23:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:23:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:23:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:23:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:23:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:23:10 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:23:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43540584
Mon 20 Jan 2014 15:23:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:23:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43540584
Mon 20 Jan 2014 15:23:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:23:18 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:23:18 - job_xml_thread(): Done retrieving: data size 43540584
Mon 20 Jan 2014 15:23:18 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:23:18 - XML: Start document: iteration 14
Mon 20 Jan 2014 15:23:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:23:22 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:23:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:23:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:23:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:23:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:23:23 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:23:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:23:23 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:23:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:23:23 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:23:27 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 15:23:27 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:23:27 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:23:27 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:23:27 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:23:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:23:30 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:23:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:23:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:23:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:23:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:23:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:23:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:23:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:23:32 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:23:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:23:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 15:23:33 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:23:33 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:23:33 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5599 values 88276 bits 11034 bytes 
Mon 20 Jan 2014 15:23:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 15:23:34 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:23:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43120843
Mon 20 Jan 2014 15:23:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:23:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43120843
Mon 20 Jan 2014 15:23:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:23:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:23:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:23:42 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:23:42 - job_xml_thread(): Done retrieving: data size 43120843
Mon 20 Jan 2014 15:23:42 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:23:42 - XML: Start document: iteration 15
Mon 20 Jan 2014 15:23:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:23:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:23:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:23:48 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:23:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:23:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:23:49 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:23:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:23:49 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:23:49 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:23:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:23:53 - XML: Processed 647952 elements - found 0 jobs
Mon 20 Jan 2014 15:23:53 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:23:53 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:23:53 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:23:53 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:23:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:23:57 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:23:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:23:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:23:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:23:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:23:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:23:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:24:00 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:24:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 15:24:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:24:01 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:24:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42906838
Mon 20 Jan 2014 15:24:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:24:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42906838
Mon 20 Jan 2014 15:24:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:24:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:24:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:24:08 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:24:08 - job_xml_thread(): Done retrieving: data size 42906838
Mon 20 Jan 2014 15:24:08 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:24:08 - XML: Start document: iteration 16
Mon 20 Jan 2014 15:24:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:24:11 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:24:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:24:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:24:11 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:24:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:24:12 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:24:12 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:24:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:24:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:24:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:24:20 - XML: Processed 645242 elements - found 0 jobs
Mon 20 Jan 2014 15:24:20 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:24:20 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:24:20 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:24:20 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:24:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:24:23 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:24:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:24:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:24:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:24:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:24:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:24:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:24:25 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:24:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42945764
Mon 20 Jan 2014 15:24:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:24:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42945764
Mon 20 Jan 2014 15:24:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:24:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:24:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:24:33 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:24:33 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:24:34 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:24:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 15:24:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:24:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 15:24:34 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:24:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6851 values 108030 bits 13503 bytes 
Mon 20 Jan 2014 15:24:35 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:24:35 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:24:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:24:36 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:24:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:24:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:24:37 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:24:37 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:24:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:24:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:24:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:24:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:24:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:24:42 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:24:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:24:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:24:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:24:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:24:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:24:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:24:45 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:24:45 - job_xml_thread(): Done retrieving: data size 43452622
Mon 20 Jan 2014 15:24:45 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:24:45 - XML: Start document: iteration 17
Mon 20 Jan 2014 15:24:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43452622
Mon 20 Jan 2014 15:24:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:24:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43452622
Mon 20 Jan 2014 15:24:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:24:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:24:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:24:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:24:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:25:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:25:05 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:25:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:25:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:25:05 - XML: Processed 651858 elements - found 0 jobs
Mon 20 Jan 2014 15:25:06 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:25:06 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:25:06 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:25:06 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:25:06 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:25:06 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:25:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:25:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:25:06 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:25:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:25:07 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:25:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:25:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:25:08 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:25:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 15:25:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:25:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:25:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:25:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:25:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:25:10 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:25:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574447
Mon 20 Jan 2014 15:25:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:25:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574447
Mon 20 Jan 2014 15:25:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:25:21 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:25:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:25:21 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:25:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:25:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:25:22 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:25:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:25:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:25:23 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:25:23 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:25:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:25:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:25:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:25:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:25:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:25:25 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:25:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:25:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:25:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:25:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:25:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:25:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:25:28 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:25:28 - job_xml_thread(): Done retrieving: data size 43572026
Mon 20 Jan 2014 15:25:28 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:25:28 - XML: Start document: iteration 18
Mon 20 Jan 2014 15:25:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572026
Mon 20 Jan 2014 15:25:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572026
Mon 20 Jan 2014 15:25:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:25:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:25:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:25:35 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:25:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:25:36 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:25:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 15:25:36 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:25:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Mon 20 Jan 2014 15:25:37 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 15:25:37 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:25:37 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:25:37 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:25:37 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:25:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:25:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:25:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:25:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:25:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:25:46 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:25:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:25:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:25:46 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:25:46 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:25:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:25:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:25:46 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:25:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:25:50 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:25:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:25:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:25:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:25:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:25:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:25:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:25:52 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:25:53 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 15:25:53 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 15:25:53 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:25:53 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:25:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566101
Mon 20 Jan 2014 15:25:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:25:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566101
Mon 20 Jan 2014 15:25:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:25:54 - job_xml_thread(): Done retrieving: data size 43566101
Mon 20 Jan 2014 15:25:54 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:25:54 - XML: Start document: iteration 19
Mon 20 Jan 2014 15:26:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:26:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:26:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:26:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:26:06 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 15:26:06 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:26:06 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:26:06 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:26:06 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:26:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:26:13 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:26:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:26:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:26:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:26:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:26:14 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:26:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:26:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:26:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:26:14 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:26:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:26:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:26:15 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:26:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:26:15 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:26:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:26:15 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:26:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584980
Mon 20 Jan 2014 15:26:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:26:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584980
Mon 20 Jan 2014 15:26:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:26:21 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:26:21 - job_xml_thread(): Done retrieving: data size 43584980
Mon 20 Jan 2014 15:26:21 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:26:21 - XML: Start document: iteration 20
Mon 20 Jan 2014 15:26:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:26:27 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:26:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:26:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:26:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:26:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:26:31 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:26:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:26:31 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:26:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:26:31 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:26:33 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 15:26:33 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:26:33 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:26:33 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:26:33 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:26:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:26:36 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:26:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:26:36 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:26:36 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:26:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:26:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 15:26:36 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:26:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 15:26:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 15262 values 240689 bits 30086 bytes 
Mon 20 Jan 2014 15:26:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:26:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:26:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:26:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:26:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:26:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:26:39 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:26:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569576
Mon 20 Jan 2014 15:26:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:26:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569576
Mon 20 Jan 2014 15:26:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:26:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:26:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:26:48 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:26:48 - job_xml_thread(): Done retrieving: data size 43569576
Mon 20 Jan 2014 15:26:48 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:26:48 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 15:26:48 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 15:26:48 - Housekeeping: done.
Mon 20 Jan 2014 15:26:48 - XML: Start document: iteration 0
Mon 20 Jan 2014 15:26:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:26:48 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:26:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:26:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:26:49 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:26:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:26:50 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:26:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:26:50 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:26:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:26:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:26:59 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:26:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 15:26:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:27:01 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 15:27:01 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:27:01 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:27:01 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:27:01 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:27:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:27:01 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:27:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:27:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:27:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:27:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:27:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:27:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:27:03 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:27:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43548790
Mon 20 Jan 2014 15:27:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:27:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43548790
Mon 20 Jan 2014 15:27:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:27:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:27:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:27:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:27:13 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:27:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:27:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:27:15 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:27:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:27:15 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:27:15 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:27:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:27:16 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:27:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:27:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:27:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:27:18 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:27:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:27:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:27:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:27:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:27:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:27:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:27:19 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:27:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574158
Mon 20 Jan 2014 15:27:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:27:20 - job_xml_thread(): Done retrieving: data size 43574158
Mon 20 Jan 2014 15:27:20 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:27:20 - XML: Start document: iteration 1
Mon 20 Jan 2014 15:27:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574158
Mon 20 Jan 2014 15:27:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:27:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:27:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:27:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:27:32 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:27:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:27:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:27:33 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:27:33 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:27:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:27:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:27:33 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:27:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:27:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:27:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:27:36 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:27:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:27:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 15:27:37 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:27:37 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:27:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 15:27:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8894 values 140242 bits 17530 bytes 
Mon 20 Jan 2014 15:27:42 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 15:27:42 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:27:42 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:27:42 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:27:42 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:27:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:27:44 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:27:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:27:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:27:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:27:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:27:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:27:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:27:46 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:27:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 15:27:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:27:46 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:27:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43548076
Mon 20 Jan 2014 15:27:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:27:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43548076
Mon 20 Jan 2014 15:27:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:27:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:27:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:27:57 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:27:58 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:28:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:28:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:28:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:28:01 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:28:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:28:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:28:02 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:28:02 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:28:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:28:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:28:02 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:28:02 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:28:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:28:02 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:28:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:28:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:28:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:28:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:28:04 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:28:04 - job_xml_thread(): Done retrieving: data size 43563447
Mon 20 Jan 2014 15:28:04 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:28:04 - XML: Start document: iteration 2
Mon 20 Jan 2014 15:28:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563447
Mon 20 Jan 2014 15:28:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:28:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563447
Mon 20 Jan 2014 15:28:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:28:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:28:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:28:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:28:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:28:22 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 15:28:22 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:28:22 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:28:22 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:28:22 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:28:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:28:23 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:28:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:28:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:28:25 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:28:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:28:25 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:28:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:28:25 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:28:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:28:26 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:28:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:28:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:28:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:28:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:28:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:28:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:28:28 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:28:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579516
Mon 20 Jan 2014 15:28:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:28:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579516
Mon 20 Jan 2014 15:28:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:28:37 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:28:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:28:37 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:28:37 - job_xml_thread(): Done retrieving: data size 43579516
Mon 20 Jan 2014 15:28:37 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:28:37 - XML: Start document: iteration 3
Mon 20 Jan 2014 15:28:38 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:28:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 15:28:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:28:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 15:28:38 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:28:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148606 bits 18575 bytes 
Mon 20 Jan 2014 15:28:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:28:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:28:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:28:40 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:28:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:28:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:28:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:28:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:28:42 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:28:42 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:28:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:28:42 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:28:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:28:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:28:50 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:28:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:28:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:28:51 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 15:28:51 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:28:51 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:28:51 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:28:51 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:28:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:28:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:28:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:28:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:28:53 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:28:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558722
Mon 20 Jan 2014 15:28:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:28:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558722
Mon 20 Jan 2014 15:28:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:28:56 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 15:28:56 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:28:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:28:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:28:57 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:28:57 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 15:28:57 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 15:28:57 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:28:57 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 15:29:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:29:03 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:29:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:29:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:29:04 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:29:04 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:29:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:29:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:29:04 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:29:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:29:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:29:06 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:29:06 - size of cluster 'LISA Cluster': 624 hosts 79478 metrics 750179 values 11832858 bits 1479107 bytes 
Mon 20 Jan 2014 15:29:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:29:10 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:29:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:29:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:29:11 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:29:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 15:29:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:29:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:29:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:29:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:29:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:29:13 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:29:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43509490
Mon 20 Jan 2014 15:29:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:29:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43509490
Mon 20 Jan 2014 15:29:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:29:14 - job_xml_thread(): Done retrieving: data size 43509490
Mon 20 Jan 2014 15:29:14 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:29:14 - XML: Start document: iteration 4
Mon 20 Jan 2014 15:29:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:29:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:29:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:29:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:29:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:29:26 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:29:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:29:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:29:27 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:29:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:29:27 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:29:27 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:29:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:29:34 - XML: Processed 652608 elements - found 0 jobs
Mon 20 Jan 2014 15:29:34 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:29:34 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:29:34 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:29:34 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:29:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:29:37 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:29:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:29:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:29:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:29:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:29:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:29:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:29:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:29:39 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:29:39 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:29:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43117865
Mon 20 Jan 2014 15:29:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:29:39 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:29:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:29:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 15:29:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 15:29:39 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:29:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8678 values 136795 bits 17099 bytes 
Mon 20 Jan 2014 15:29:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43117865
Mon 20 Jan 2014 15:29:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:29:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:29:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:29:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:29:48 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:29:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:29:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:29:49 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:29:49 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:29:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:29:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43117865
Mon 20 Jan 2014 15:29:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:29:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:29:49 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:29:49 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:29:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:29:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:29:57 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:29:57 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 15:29:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:29:58 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:29:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:29:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:30:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:30:00 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:30:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:30:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:30:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:30:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:30:03 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:30:03 - job_xml_thread(): Done retrieving: data size 42892371
Mon 20 Jan 2014 15:30:03 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:30:03 - XML: Start document: iteration 5
Mon 20 Jan 2014 15:30:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:30:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:30:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42892371
Mon 20 Jan 2014 15:30:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:30:06 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:30:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:30:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42892371
Mon 20 Jan 2014 15:30:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:30:06 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:30:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:30:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:30:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:30:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:30:20 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:30:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:30:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:30:23 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:30:23 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:30:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:30:23 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:30:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:30:24 - XML: Processed 645326 elements - found 0 jobs
Mon 20 Jan 2014 15:30:24 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:30:24 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:30:24 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:30:24 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:30:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:30:26 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:30:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:30:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:30:26 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:30:26 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 15:30:26 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:30:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:30:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:30:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:30:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:30:29 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:30:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43025023
Mon 20 Jan 2014 15:30:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:30:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43025023
Mon 20 Jan 2014 15:30:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:30:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:30:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:30:39 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:30:39 - job_xml_thread(): Done retrieving: data size 43025023
Mon 20 Jan 2014 15:30:39 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:30:39 - XML: Start document: iteration 6
Mon 20 Jan 2014 15:30:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:30:39 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:30:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:30:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:30:39 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:30:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:30:39 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:30:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:30:39 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:30:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:30:39 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:30:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:30:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 15:30:40 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:30:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 15:30:40 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:30:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5786 values 91212 bits 11401 bytes 
Mon 20 Jan 2014 15:30:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:30:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:30:51 - XML: Processed 646362 elements - found 0 jobs
Mon 20 Jan 2014 15:30:51 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:30:51 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:30:51 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:30:51 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:30:53 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:30:53 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:30:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:30:53 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:30:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:30:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:30:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:30:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:30:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:30:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:30:56 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:30:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43514549
Mon 20 Jan 2014 15:30:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:30:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43514549
Mon 20 Jan 2014 15:30:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:31:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:31:05 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:31:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:31:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:31:06 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:31:06 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:31:06 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:31:06 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:31:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:31:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:31:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:31:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:31:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:31:11 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:31:11 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:31:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 15:31:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:31:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:31:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:31:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:31:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:31:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:31:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:31:13 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:31:13 - job_xml_thread(): Done retrieving: data size 43582500
Mon 20 Jan 2014 15:31:13 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:31:13 - XML: Start document: iteration 7
Mon 20 Jan 2014 15:31:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582500
Mon 20 Jan 2014 15:31:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:31:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582500
Mon 20 Jan 2014 15:31:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:31:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:31:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:31:23 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 15:31:23 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:31:23 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:31:23 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:31:23 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:31:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:31:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:31:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:31:30 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:31:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:31:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:31:31 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:31:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:31:31 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:31:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:31:31 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:31:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:31:34 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:31:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:31:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:31:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:31:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:31:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:31:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:31:37 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:31:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574448
Mon 20 Jan 2014 15:31:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:31:38 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:31:38 - job_xml_thread(): Done retrieving: data size 43574448
Mon 20 Jan 2014 15:31:38 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:31:38 - XML: Start document: iteration 8
Mon 20 Jan 2014 15:31:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574448
Mon 20 Jan 2014 15:31:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:31:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:31:40 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:31:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:31:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 15:31:41 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:31:41 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:31:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 15:31:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8873 values 140126 bits 17515 bytes 
Mon 20 Jan 2014 15:31:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:31:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:31:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:31:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:31:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:31:53 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:31:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:31:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:31:53 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:31:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:31:53 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:31:53 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:31:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:31:55 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 15:31:55 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:31:55 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:31:55 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:31:55 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:31:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:31:59 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:31:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:31:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:32:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:32:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:32:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:32:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:32:02 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 15:32:02 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 15:32:02 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:32:03 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:32:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567539
Mon 20 Jan 2014 15:32:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:32:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567539
Mon 20 Jan 2014 15:32:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:32:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:32:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:32:10 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:32:10 - job_xml_thread(): Done retrieving: data size 43567539
Mon 20 Jan 2014 15:32:10 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:32:10 - XML: Start document: iteration 9
Mon 20 Jan 2014 15:32:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:32:15 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:32:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:32:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:32:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:32:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:32:15 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:32:15 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:32:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:32:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:32:15 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:32:24 - XML: Processed 653354 elements - found 0 jobs
Mon 20 Jan 2014 15:32:24 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:32:24 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:32:24 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:32:24 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:32:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:32:25 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:32:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:32:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:32:25 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:32:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 15:32:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:32:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:32:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:32:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:32:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:32:27 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:32:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567832
Mon 20 Jan 2014 15:32:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:32:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567832
Mon 20 Jan 2014 15:32:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:32:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:32:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:32:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:32:38 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:32:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:32:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:32:39 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:32:39 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:32:39 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:32:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:32:39 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:32:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:32:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:32:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:32:41 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:32:41 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:32:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:32:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:32:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:32:41 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:32:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 15:32:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 15:32:41 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:32:41 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5859 values 92713 bits 11589 bytes 
Mon 20 Jan 2014 15:32:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:32:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:32:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:32:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:32:44 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:32:44 - job_xml_thread(): Done retrieving: data size 43597024
Mon 20 Jan 2014 15:32:44 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:32:44 - XML: Start document: iteration 10
Mon 20 Jan 2014 15:32:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43597024
Mon 20 Jan 2014 15:32:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:32:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43597024
Mon 20 Jan 2014 15:32:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:32:55 - XML: Processed 653353 elements - found 0 jobs
Mon 20 Jan 2014 15:32:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:32:55 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:32:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:32:55 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:32:55 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:32:55 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:32:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:32:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:33:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:33:02 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:33:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:33:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:33:03 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:33:03 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 15:33:03 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:33:03 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:33:03 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:33:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:33:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:33:03 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:33:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:33:05 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:33:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:33:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:33:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:33:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:33:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:33:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:33:06 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:33:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43594402
Mon 20 Jan 2014 15:33:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:33:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43594402
Mon 20 Jan 2014 15:33:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:33:10 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:33:10 - job_xml_thread(): Done retrieving: data size 43594402
Mon 20 Jan 2014 15:33:11 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:33:11 - XML: Start document: iteration 11
Mon 20 Jan 2014 15:33:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:33:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:33:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:33:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:33:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:33:25 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:33:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:33:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:33:26 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:33:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:33:26 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:33:26 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:33:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:33:29 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 15:33:29 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:33:29 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:33:29 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:33:29 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:33:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:33:30 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:33:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:33:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:33:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:33:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:33:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:33:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:33:32 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:33:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565917
Mon 20 Jan 2014 15:33:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:33:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565917
Mon 20 Jan 2014 15:33:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:33:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:33:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:33:41 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:33:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:33:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:33:42 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:33:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:33:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:33:42 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:33:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:33:42 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:33:42 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:33:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:33:42 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:33:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:33:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 15:33:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 15:33:42 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:33:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9306 values 147102 bits 18387 bytes 
Mon 20 Jan 2014 15:33:44 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:33:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:33:46 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:33:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:33:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:33:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:33:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:33:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:33:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:33:49 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:33:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565890
Mon 20 Jan 2014 15:33:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:33:49 - job_xml_thread(): Done retrieving: data size 43565890
Mon 20 Jan 2014 15:33:49 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:33:49 - XML: Start document: iteration 12
Mon 20 Jan 2014 15:33:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565890
Mon 20 Jan 2014 15:33:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:33:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:33:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:34:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:34:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:34:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:34:08 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:34:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:34:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:34:08 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:34:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:34:08 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:34:08 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:34:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:34:09 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 15:34:09 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:34:09 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:34:09 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:34:09 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:34:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:34:13 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:34:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:34:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:34:13 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:34:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 15:34:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:34:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:34:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:34:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:34:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:34:15 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:34:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584275
Mon 20 Jan 2014 15:34:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:34:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584275
Mon 20 Jan 2014 15:34:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:34:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:34:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:34:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:34:24 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:34:24 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:34:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:34:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:34:24 - job_xml_thread(): Done retrieving: data size 43584275
Mon 20 Jan 2014 15:34:24 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:34:24 - XML: Start document: iteration 13
Mon 20 Jan 2014 15:34:26 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:34:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:34:26 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:34:26 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:34:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:34:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:34:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:34:32 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 15:34:32 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:34:32 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:34:32 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:34:32 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:34:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:34:35 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:34:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:34:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:34:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:34:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:34:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:34:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:34:37 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:34:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43552180
Mon 20 Jan 2014 15:34:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:34:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43552180
Mon 20 Jan 2014 15:34:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:34:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:34:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:34:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:34:43 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:34:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:34:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 15:34:43 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:34:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8956 values 141337 bits 17667 bytes 
Mon 20 Jan 2014 15:34:43 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:34:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 15:34:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:34:46 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:34:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:34:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:34:46 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:34:46 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:34:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:34:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:34:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43552180
Mon 20 Jan 2014 15:34:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:34:47 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:34:47 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:34:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:34:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:34:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:34:57 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:34:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:34:59 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:34:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:34:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:34:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:34:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:34:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:34:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:35:01 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:35:01 - job_xml_thread(): Done retrieving: data size 43557627
Mon 20 Jan 2014 15:35:01 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:35:01 - XML: Start document: iteration 14
Mon 20 Jan 2014 15:35:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:35:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:35:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557627
Mon 20 Jan 2014 15:35:02 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:35:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:35:02 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:35:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:35:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557627
Mon 20 Jan 2014 15:35:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:35:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:35:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:35:13 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:35:14 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:35:14 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:35:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:35:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:35:18 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 15:35:18 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:35:18 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:35:18 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:35:18 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:35:19 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:35:19 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:35:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:35:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:35:19 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:35:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:35:21 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:35:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:35:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:35:21 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:35:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 15:35:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:35:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:35:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:35:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:35:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:35:23 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:35:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43509255
Mon 20 Jan 2014 15:35:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:35:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43509255
Mon 20 Jan 2014 15:35:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:35:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:35:34 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:35:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:35:34 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:35:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:35:36 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:35:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:35:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:35:37 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:35:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:35:37 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:35:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:35:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:35:37 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:35:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:35:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:35:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:35:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:35:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:35:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:35:39 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:35:39 - job_xml_thread(): Done retrieving: data size 42990168
Mon 20 Jan 2014 15:35:39 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:35:39 - XML: Start document: iteration 15
Mon 20 Jan 2014 15:35:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42990168
Mon 20 Jan 2014 15:35:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:35:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42990168
Mon 20 Jan 2014 15:35:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:35:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:35:44 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:35:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:35:45 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:35:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 15:35:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 15:35:45 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:35:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9104 values 143640 bits 17955 bytes 
Mon 20 Jan 2014 15:35:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:35:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:35:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:35:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:35:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:35:54 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:35:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:35:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:35:55 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:35:55 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:35:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:35:55 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:35:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:35:57 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 15:35:57 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:35:59 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:35:59 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 15:35:59 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:35:59 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 15:35:59 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 15:35:59 - XML: Processed 646126 elements - found 0 jobs
Mon 20 Jan 2014 15:35:59 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:35:59 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:35:59 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:35:59 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:36:03 - size of cluster 'LISA Cluster': 624 hosts 79484 metrics 919549 values 14532649 bits 1816581 bytes 
Mon 20 Jan 2014 15:36:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:36:04 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:36:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:36:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:36:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:36:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:36:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:36:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:36:08 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:36:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42885658
Mon 20 Jan 2014 15:36:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:36:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42885658
Mon 20 Jan 2014 15:36:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:36:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:36:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:36:14 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:36:14 - job_xml_thread(): Done retrieving: data size 42885658
Mon 20 Jan 2014 15:36:14 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:36:14 - XML: Start document: iteration 16
Mon 20 Jan 2014 15:36:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:36:18 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:36:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:36:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:36:19 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:36:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:36:19 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:36:19 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:36:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:36:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:36:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:36:28 - XML: Processed 645158 elements - found 0 jobs
Mon 20 Jan 2014 15:36:28 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:36:28 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:36:28 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:36:28 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:36:29 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:36:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 15:36:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:36:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:36:31 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:36:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:36:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:36:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:36:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:36:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:36:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:36:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:36:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:36:35 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:36:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43331974
Mon 20 Jan 2014 15:36:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:36:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43331974
Mon 20 Jan 2014 15:36:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:36:44 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:36:44 - job_xml_thread(): Done retrieving: data size 43331974
Mon 20 Jan 2014 15:36:45 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:36:45 - XML: Start document: iteration 17
Mon 20 Jan 2014 15:36:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:36:46 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:36:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:36:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:36:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:36:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 15:36:47 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:36:47 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:36:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:36:47 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:36:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 15:36:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:36:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:36:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5713 values 90111 bits 11263 bytes 
Mon 20 Jan 2014 15:36:48 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:36:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:36:48 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:36:48 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:36:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:36:56 - XML: Processed 650772 elements - found 0 jobs
Mon 20 Jan 2014 15:36:56 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:36:56 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:36:56 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:36:56 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:36:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:36:58 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:36:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:36:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:36:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:36:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:36:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:36:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:36:59 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:36:59 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 15:37:02 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:37:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 15:37:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:37:02 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:37:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43537341
Mon 20 Jan 2014 15:37:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:37:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43537341
Mon 20 Jan 2014 15:37:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:37:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:37:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:37:13 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:37:13 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:37:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:37:13 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:37:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:37:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:37:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:37:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:37:14 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:37:14 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:37:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:37:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:37:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:37:16 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:37:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:37:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:37:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:37:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:37:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:37:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:37:19 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:37:19 - job_xml_thread(): Done retrieving: data size 43569255
Mon 20 Jan 2014 15:37:19 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:37:19 - XML: Start document: iteration 18
Mon 20 Jan 2014 15:37:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569255
Mon 20 Jan 2014 15:37:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:37:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569255
Mon 20 Jan 2014 15:37:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:37:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:37:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:37:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:37:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:37:36 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 15:37:36 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:37:36 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:37:36 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:37:36 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:37:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:37:39 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:37:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:37:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:37:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:37:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:37:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:37:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:37:40 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:37:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:37:42 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:37:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:37:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:37:43 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:37:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:37:43 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:37:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:37:45 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:37:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43590785
Mon 20 Jan 2014 15:37:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:37:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43590785
Mon 20 Jan 2014 15:37:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:37:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:37:47 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:37:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:37:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 15:37:49 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:37:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 15:37:49 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:37:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9279 values 146421 bits 18302 bytes 
Mon 20 Jan 2014 15:37:51 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:37:51 - job_xml_thread(): Done retrieving: data size 43590785
Mon 20 Jan 2014 15:37:51 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:37:51 - XML: Start document: iteration 19
Mon 20 Jan 2014 15:37:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:37:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:37:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:37:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:38:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:38:05 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:38:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:38:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:38:05 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:38:05 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:38:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:38:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:38:06 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:38:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:38:06 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:38:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:38:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:38:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:38:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:38:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:38:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:38:08 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 15:38:08 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:38:08 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:38:08 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:38:08 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:38:12 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:38:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572726
Mon 20 Jan 2014 15:38:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:38:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572726
Mon 20 Jan 2014 15:38:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:38:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:38:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:38:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:38:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:38:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:38:23 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:38:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:38:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:38:23 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:38:23 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:38:23 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:38:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:38:23 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:38:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:38:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:38:27 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:38:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:38:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:38:27 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:38:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 15:38:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:38:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:38:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:38:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:38:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:38:31 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:38:31 - job_xml_thread(): Done retrieving: data size 43579734
Mon 20 Jan 2014 15:38:31 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:38:31 - XML: Start document: iteration 20
Mon 20 Jan 2014 15:38:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579734
Mon 20 Jan 2014 15:38:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579734
Mon 20 Jan 2014 15:38:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:38:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:38:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:38:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:38:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:38:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:38:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:38:48 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:38:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:38:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:38:48 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 15:38:49 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:38:49 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:38:49 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:38:49 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:38:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:38:49 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:38:49 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:38:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:38:49 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:38:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:38:49 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:38:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:38:50 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:38:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 15:38:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 15:38:50 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:38:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5626 values 88729 bits 11091 bytes 
Mon 20 Jan 2014 15:38:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:38:54 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:38:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:38:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:38:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:38:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:38:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:38:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:38:58 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:38:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572239
Mon 20 Jan 2014 15:38:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:38:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572239
Mon 20 Jan 2014 15:38:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:39:04 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:39:04 - job_xml_thread(): Done retrieving: data size 43572239
Mon 20 Jan 2014 15:39:04 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:39:04 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 15:39:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:39:05 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 15:39:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:39:05 - Housekeeping: done.
Mon 20 Jan 2014 15:39:05 - XML: Start document: iteration 0
Mon 20 Jan 2014 15:39:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:39:09 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:39:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:39:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:39:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:39:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:39:10 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:39:10 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:39:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:39:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:39:10 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:39:13 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:39:13 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 15:39:13 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:39:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:39:20 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:39:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:39:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:39:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:39:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:39:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:39:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:39:22 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 15:39:22 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:39:22 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:39:22 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:39:22 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:39:25 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:39:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43537351
Mon 20 Jan 2014 15:39:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:39:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:39:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:39:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43537351
Mon 20 Jan 2014 15:39:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:39:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:39:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:39:37 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:39:37 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:39:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:39:40 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:39:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:39:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:39:41 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:39:41 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:39:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:39:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:39:41 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:39:41 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:39:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:39:41 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:39:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:39:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:39:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:39:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:39:45 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:39:45 - job_xml_thread(): Done retrieving: data size 43577752
Mon 20 Jan 2014 15:39:45 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:39:45 - XML: Start document: iteration 1
Mon 20 Jan 2014 15:39:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577752
Mon 20 Jan 2014 15:39:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577752
Mon 20 Jan 2014 15:39:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:39:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:39:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:39:50 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:39:51 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:39:51 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:39:51 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 15:39:51 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:39:51 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 15:39:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8334 values 131466 bits 16433 bytes 
Mon 20 Jan 2014 15:39:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:39:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:39:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:39:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:40:07 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 15:40:07 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:40:07 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:40:07 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:40:07 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:40:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:40:07 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:40:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:40:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:40:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:40:07 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:40:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:40:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:40:08 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:40:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:40:08 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:40:08 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:40:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:40:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:40:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:40:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:40:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:40:09 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 15:40:09 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 15:40:09 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:40:10 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:40:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574092
Mon 20 Jan 2014 15:40:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:40:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574092
Mon 20 Jan 2014 15:40:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:40:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:40:20 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:40:22 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:40:22 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:40:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:40:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:40:23 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:40:23 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:40:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:40:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:40:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:40:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:40:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:40:25 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:40:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:40:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:40:25 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:40:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 15:40:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:40:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:40:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:40:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:40:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:40:27 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:40:27 - job_xml_thread(): Done retrieving: data size 43573164
Mon 20 Jan 2014 15:40:27 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:40:27 - XML: Start document: iteration 2
Mon 20 Jan 2014 15:40:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573164
Mon 20 Jan 2014 15:40:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:40:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573164
Mon 20 Jan 2014 15:40:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:40:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:40:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:40:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:40:38 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:40:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:40:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:40:40 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:40:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:40:40 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:40:40 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:40:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:40:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:40:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:40:44 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 15:40:44 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:40:44 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:40:44 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:40:44 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:40:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:40:47 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:40:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:40:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:40:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:40:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:40:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:40:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:40:49 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:40:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576644
Mon 20 Jan 2014 15:40:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:40:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576644
Mon 20 Jan 2014 15:40:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:40:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:40:52 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:40:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:40:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 15:40:52 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:40:52 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:40:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 15:40:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9158 values 144436 bits 18054 bytes 
Mon 20 Jan 2014 15:40:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:40:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:40:59 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:40:59 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:41:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:41:00 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:41:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:41:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:41:01 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:41:01 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:41:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:41:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:41:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:41:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:41:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:41:04 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:41:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:41:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:41:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:41:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:41:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:41:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:41:06 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:41:06 - job_xml_thread(): Done retrieving: data size 43579532
Mon 20 Jan 2014 15:41:06 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:41:06 - XML: Start document: iteration 3
Mon 20 Jan 2014 15:41:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579532
Mon 20 Jan 2014 15:41:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:41:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579532
Mon 20 Jan 2014 15:41:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:41:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:41:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:41:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:41:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:41:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:41:22 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:41:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:41:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:41:23 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:41:23 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:41:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:41:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:41:23 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:41:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:41:23 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:41:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:41:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:41:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:41:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:41:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:41:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:41:27 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 15:41:27 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:41:27 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:41:27 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:41:27 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:41:27 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:41:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 15:41:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:41:29 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:41:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43155151
Mon 20 Jan 2014 15:41:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:41:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43155151
Mon 20 Jan 2014 15:41:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:41:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:41:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:41:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:41:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:41:42 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:41:42 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:41:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:41:43 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:41:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:41:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:41:43 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:41:43 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:41:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:41:43 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:41:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:41:45 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:41:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:41:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:41:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:41:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:41:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:41:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:41:46 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:41:46 - job_xml_thread(): Done retrieving: data size 42973272
Mon 20 Jan 2014 15:41:46 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:41:46 - XML: Start document: iteration 4
Mon 20 Jan 2014 15:41:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42973272
Mon 20 Jan 2014 15:41:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:41:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42973272
Mon 20 Jan 2014 15:41:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:41:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:41:54 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:41:55 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:41:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 15:41:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:41:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 15:41:55 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:41:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8835 values 139299 bits 17412 bytes 
Mon 20 Jan 2014 15:41:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:41:56 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:41:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:41:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:41:58 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:41:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:41:58 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:41:58 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:41:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:42:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:42:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:42:01 - XML: Processed 645838 elements - found 0 jobs
Mon 20 Jan 2014 15:42:01 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:42:01 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:42:01 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:42:01 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:42:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:42:06 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:42:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:42:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:42:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:42:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:42:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:42:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:42:08 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:42:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42931758
Mon 20 Jan 2014 15:42:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:42:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42931758
Mon 20 Jan 2014 15:42:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:42:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:42:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:42:16 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:42:17 - job_xml_thread(): Done retrieving: data size 42931758
Mon 20 Jan 2014 15:42:17 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:42:17 - XML: Start document: iteration 5
Mon 20 Jan 2014 15:42:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:42:21 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:42:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:42:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:42:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:42:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:42:22 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:42:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:42:22 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:42:22 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:42:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:42:27 - XML: Processed 645474 elements - found 0 jobs
Mon 20 Jan 2014 15:42:27 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:42:27 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:42:27 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:42:27 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:42:29 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:42:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 15:42:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:42:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:42:29 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:42:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:42:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:42:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:42:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:42:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:42:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:42:31 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:42:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42964308
Mon 20 Jan 2014 15:42:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:42:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42964308
Mon 20 Jan 2014 15:42:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:42:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:42:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:42:42 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:42:42 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:42:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:42:43 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:42:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:42:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:42:44 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:42:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:42:45 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:42:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:42:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:42:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:42:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:42:45 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:42:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:42:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:42:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:42:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:42:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:42:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:42:47 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:42:47 - job_xml_thread(): Done retrieving: data size 43512592
Mon 20 Jan 2014 15:42:47 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:42:47 - XML: Start document: iteration 6
Mon 20 Jan 2014 15:42:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43512592
Mon 20 Jan 2014 15:42:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43512592
Mon 20 Jan 2014 15:42:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:42:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:42:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:42:55 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:42:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:42:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 15:42:56 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:42:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8972 values 141555 bits 17694 bytes 
Mon 20 Jan 2014 15:42:57 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:42:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 15:42:59 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 15:42:59 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:42:59 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:42:59 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:42:59 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 15:43:00 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 15:43:00 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 15:43:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:43:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Mon 20 Jan 2014 15:43:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:43:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:43:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:43:04 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:43:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:43:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:43:06 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:43:06 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:43:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:43:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:43:06 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:43:07 - XML: Processed 652585 elements - found 0 jobs
Mon 20 Jan 2014 15:43:07 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:43:07 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:43:07 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:43:07 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:43:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:43:08 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:43:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:43:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:43:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:43:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:43:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:43:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:43:10 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:43:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562112
Mon 20 Jan 2014 15:43:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:43:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562112
Mon 20 Jan 2014 15:43:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:43:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:43:21 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:43:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:43:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:43:23 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:43:23 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:43:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:43:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:43:23 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:43:23 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:43:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:43:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:43:25 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:43:25 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:43:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:43:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:43:25 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:43:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 15:43:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:43:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:43:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:43:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:43:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:43:26 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:43:26 - job_xml_thread(): Done retrieving: data size 43561417
Mon 20 Jan 2014 15:43:26 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:43:26 - XML: Start document: iteration 7
Mon 20 Jan 2014 15:43:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561417
Mon 20 Jan 2014 15:43:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561417
Mon 20 Jan 2014 15:43:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:43:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:43:37 - XML: Processed 653346 elements - found 0 jobs
Mon 20 Jan 2014 15:43:37 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:43:37 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:43:37 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:43:38 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:43:39 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:43:39 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:43:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:43:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:43:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:43:46 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:43:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:43:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:43:47 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:43:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:43:47 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:43:47 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:43:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:43:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:43:48 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:43:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:43:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:43:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:43:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:43:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:43:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:43:50 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:43:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43592649
Mon 20 Jan 2014 15:43:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:43:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43592649
Mon 20 Jan 2014 15:43:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:43:53 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:43:54 - job_xml_thread(): Done retrieving: data size 43592649
Mon 20 Jan 2014 15:43:54 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:43:54 - XML: Start document: iteration 8
Mon 20 Jan 2014 15:43:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:43:58 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:44:00 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:44:00 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:44:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:44:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 15:44:01 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:44:01 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:44:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 15:44:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8768 values 138251 bits 17281 bytes 
Mon 20 Jan 2014 15:44:01 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:44:01 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 15:44:01 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:44:01 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 15:44:01 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 15:44:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:44:03 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:44:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:44:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:44:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:44:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:44:03 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:44:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:44:03 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:44:03 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:44:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:44:09 - size of cluster 'LISA Cluster': 624 hosts 79477 metrics 898038 values 14167316 bits 1770914 bytes 
Mon 20 Jan 2014 15:44:10 - XML: Processed 653346 elements - found 0 jobs
Mon 20 Jan 2014 15:44:10 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:44:10 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:44:10 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:44:10 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:44:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:44:12 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:44:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:44:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:44:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:44:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:44:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:44:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:44:17 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:44:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43546125
Mon 20 Jan 2014 15:44:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:44:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43546125
Mon 20 Jan 2014 15:44:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:44:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:44:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:44:25 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:44:25 - job_xml_thread(): Done retrieving: data size 43546125
Mon 20 Jan 2014 15:44:25 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:44:25 - XML: Start document: iteration 9
Mon 20 Jan 2014 15:44:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:44:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:44:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:44:35 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:44:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:44:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:44:37 - XML: Processed 653346 elements - found 0 jobs
Mon 20 Jan 2014 15:44:37 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:44:37 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:44:37 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:44:37 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:44:37 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:44:37 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:44:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:44:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:44:37 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:44:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:44:40 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:44:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:44:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:44:40 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:44:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 15:44:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:44:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:44:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:44:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:44:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:44:43 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:44:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564331
Mon 20 Jan 2014 15:44:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:44:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564331
Mon 20 Jan 2014 15:44:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:44:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:44:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:44:52 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:44:52 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:44:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:44:52 - job_xml_thread(): Done retrieving: data size 43564331
Mon 20 Jan 2014 15:44:52 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:44:52 - XML: Start document: iteration 10
Mon 20 Jan 2014 15:44:53 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:44:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:44:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564331
Mon 20 Jan 2014 15:44:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:44:53 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:44:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:44:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:44:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:45:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:45:01 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:45:01 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:45:01 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 15:45:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:45:02 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 15:45:02 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:45:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 15:45:02 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:45:02 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5821 values 91773 bits 11471 bytes 
Mon 20 Jan 2014 15:45:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:45:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:45:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:45:10 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:45:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:45:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:45:10 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:45:10 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:45:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:45:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:45:10 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:45:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:45:13 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:45:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:45:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:45:13 - XML: Processed 653346 elements - found 0 jobs
Mon 20 Jan 2014 15:45:13 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:45:13 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:45:13 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:45:13 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:45:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:45:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:45:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:45:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:45:17 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:45:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574578
Mon 20 Jan 2014 15:45:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:45:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574578
Mon 20 Jan 2014 15:45:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:45:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:45:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:45:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:45:26 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:45:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:45:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:45:27 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:45:27 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:45:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:45:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:45:27 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:45:28 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:45:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:45:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:45:31 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:45:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 15:45:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:45:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:45:33 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:45:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:45:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:45:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:45:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:45:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:45:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:45:36 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:45:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578000
Mon 20 Jan 2014 15:45:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:45:37 - job_xml_thread(): Done retrieving: data size 43578000
Mon 20 Jan 2014 15:45:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578000
Mon 20 Jan 2014 15:45:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:45:37 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:45:37 - XML: Start document: iteration 11
Mon 20 Jan 2014 15:45:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:45:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:45:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:45:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:45:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:45:55 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:45:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:45:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:45:55 - XML: Processed 653346 elements - found 0 jobs
Mon 20 Jan 2014 15:45:56 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:45:56 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:45:56 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:45:56 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:45:56 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:45:56 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:45:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:45:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:45:56 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:45:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:45:59 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:45:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:45:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:45:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:45:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:45:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:45:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:46:02 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:46:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572218
Mon 20 Jan 2014 15:46:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:46:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572218
Mon 20 Jan 2014 15:46:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:46:02 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:46:02 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:46:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:46:03 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:46:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 15:46:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 15:46:03 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:46:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5732 values 90415 bits 11301 bytes 
Mon 20 Jan 2014 15:46:11 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:46:11 - job_xml_thread(): Done retrieving: data size 43572218
Mon 20 Jan 2014 15:46:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:46:11 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:46:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:46:11 - XML: Start document: iteration 12
Mon 20 Jan 2014 15:46:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:46:13 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:46:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:46:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:46:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:46:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:46:15 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:46:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:46:15 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:46:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:46:15 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:46:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:46:24 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:46:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:46:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:46:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:46:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:46:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:46:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:46:25 - XML: Processed 653346 elements - found 0 jobs
Mon 20 Jan 2014 15:46:25 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:46:25 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:46:25 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:46:25 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:46:27 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 15:46:27 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 15:46:27 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:46:28 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:46:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43542005
Mon 20 Jan 2014 15:46:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:46:28 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43542005
Mon 20 Jan 2014 15:46:28 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:46:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:46:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:46:37 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:46:37 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:46:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:46:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:46:37 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:46:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 15:46:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:46:38 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:46:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:46:38 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:46:38 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:46:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:46:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:46:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:46:40 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:46:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:46:42 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:46:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:46:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:46:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:46:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:46:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:46:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:46:44 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:46:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566251
Mon 20 Jan 2014 15:46:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:46:45 - job_xml_thread(): Done retrieving: data size 43566251
Mon 20 Jan 2014 15:46:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566251
Mon 20 Jan 2014 15:46:45 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:46:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:46:45 - XML: Start document: iteration 13
Mon 20 Jan 2014 15:46:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:46:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:46:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:46:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:46:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:46:58 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:46:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:46:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:46:59 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:47:00 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:47:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:47:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:47:00 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:47:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:47:03 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:47:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:47:04 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:47:04 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:47:04 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:47:04 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 15:47:04 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 15:47:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:47:04 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:47:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6131 values 96903 bits 12112 bytes 
Mon 20 Jan 2014 15:47:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:47:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:47:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:47:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:47:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:47:06 - XML: Processed 653346 elements - found 0 jobs
Mon 20 Jan 2014 15:47:06 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:47:06 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:47:06 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:47:06 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:47:09 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:47:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567786
Mon 20 Jan 2014 15:47:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:47:09 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43567786
Mon 20 Jan 2014 15:47:09 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:47:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:47:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:47:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:47:17 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:47:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:47:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:47:18 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:47:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:47:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43567786
Mon 20 Jan 2014 15:47:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:47:18 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:47:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:47:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:47:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:47:21 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:47:21 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:47:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:47:26 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:47:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:47:28 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:47:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:47:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:47:29 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:47:29 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 15:47:29 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:47:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:47:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:47:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:47:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:47:30 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:47:30 - job_xml_thread(): Done retrieving: data size 43086237
Mon 20 Jan 2014 15:47:30 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:47:30 - XML: Start document: iteration 14
Mon 20 Jan 2014 15:47:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43086237
Mon 20 Jan 2014 15:47:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:47:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:47:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:47:34 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:47:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:47:35 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:47:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:47:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43086237
Mon 20 Jan 2014 15:47:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:47:40 - XML: Processed 647508 elements - found 0 jobs
Mon 20 Jan 2014 15:47:40 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:47:40 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:47:40 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:47:40 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:47:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:47:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:47:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:47:49 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:47:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:47:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:47:51 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:47:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:47:51 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:47:51 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:47:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:47:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:47:51 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:47:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:47:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:47:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:47:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:47:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:47:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:47:53 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:47:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42927447
Mon 20 Jan 2014 15:47:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:47:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42927447
Mon 20 Jan 2014 15:47:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:47:55 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:47:55 - job_xml_thread(): Done retrieving: data size 42927447
Mon 20 Jan 2014 15:47:55 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:47:56 - XML: Start document: iteration 15
Mon 20 Jan 2014 15:48:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:48:06 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:48:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:48:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:48:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:48:08 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:48:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:48:08 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:48:08 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:48:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 15:48:08 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 15:48:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:48:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:48:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:48:08 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:48:08 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8944 values 141465 bits 17683 bytes 
Mon 20 Jan 2014 15:48:09 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:48:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:48:09 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:48:09 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:48:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:48:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:48:14 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:48:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:48:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:48:15 - XML: Processed 645218 elements - found 0 jobs
Mon 20 Jan 2014 15:48:15 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:48:15 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:48:15 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:48:15 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:48:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:48:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:48:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:48:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:48:17 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:48:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42968219
Mon 20 Jan 2014 15:48:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:48:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42968219
Mon 20 Jan 2014 15:48:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:48:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:48:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:48:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:48:27 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:48:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:48:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:48:29 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:48:29 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:48:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:48:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:48:29 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:48:30 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:48:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:48:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:48:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:48:33 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:48:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:48:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:48:33 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:48:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 15:48:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:48:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:48:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:48:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:48:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:48:35 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:48:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42993598
Mon 20 Jan 2014 15:48:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:48:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42993598
Mon 20 Jan 2014 15:48:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:48:36 - job_xml_thread(): Done retrieving: data size 42993598
Mon 20 Jan 2014 15:48:36 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:48:36 - XML: Start document: iteration 16
Mon 20 Jan 2014 15:48:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:48:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:48:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:48:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:48:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:48:52 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:48:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:48:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:48:52 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:48:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:48:52 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:48:52 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:48:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:48:54 - XML: Processed 645932 elements - found 0 jobs
Mon 20 Jan 2014 15:48:54 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:48:54 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:48:54 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:48:54 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:48:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:48:58 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:48:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:48:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:48:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:48:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:48:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:48:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:48:59 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:48:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43552739
Mon 20 Jan 2014 15:48:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:49:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43552739
Mon 20 Jan 2014 15:49:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:49:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:49:06 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:49:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:49:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:49:08 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:49:08 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:49:08 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:49:08 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:49:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:49:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:49:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43552739
Mon 20 Jan 2014 15:49:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:49:09 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:49:09 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:49:09 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:49:09 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:49:09 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 15:49:09 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:49:09 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 15:49:09 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8782 values 138597 bits 17324 bytes 
Mon 20 Jan 2014 15:49:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:49:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:49:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:49:18 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:49:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:49:19 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:49:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:49:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:49:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:49:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:49:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:49:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:49:21 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:49:21 - job_xml_thread(): Done retrieving: data size 43555452
Mon 20 Jan 2014 15:49:21 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:49:21 - XML: Start document: iteration 17
Mon 20 Jan 2014 15:49:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555452
Mon 20 Jan 2014 15:49:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:49:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:49:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:49:25 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:49:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:49:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555452
Mon 20 Jan 2014 15:49:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:49:25 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:49:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:49:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:49:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:49:40 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 15:49:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:49:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:49:40 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:49:40 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:49:40 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:49:40 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:49:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:49:43 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:49:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:49:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:49:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:49:44 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:49:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:49:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:49:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:49:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:49:44 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:49:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:49:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:49:44 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:49:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 15:49:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:49:45 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:49:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:49:45 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:49:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:49:46 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:49:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43588201
Mon 20 Jan 2014 15:49:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:49:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43588201
Mon 20 Jan 2014 15:49:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:49:55 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:49:55 - job_xml_thread(): Done retrieving: data size 43588201
Mon 20 Jan 2014 15:49:55 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:49:55 - XML: Start document: iteration 18
Mon 20 Jan 2014 15:49:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:49:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:50:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:50:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:50:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:50:00 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:50:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:50:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:50:02 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:50:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:50:02 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:50:02 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:50:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:50:05 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 15:50:05 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:50:05 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:50:05 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:50:05 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:50:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:50:06 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:50:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:50:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:50:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:50:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:50:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:50:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:50:07 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:50:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565862
Mon 20 Jan 2014 15:50:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:50:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565862
Mon 20 Jan 2014 15:50:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:50:09 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:50:09 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:50:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:50:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 15:50:11 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:50:11 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:50:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8897 values 140321 bits 17540 bytes 
Mon 20 Jan 2014 15:50:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 15:50:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:50:16 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:50:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:50:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:50:18 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:50:18 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:50:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:50:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:50:18 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:50:20 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:50:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:50:21 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:50:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:50:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:50:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:50:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:50:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:50:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:50:23 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:50:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566243
Mon 20 Jan 2014 15:50:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:50:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566243
Mon 20 Jan 2014 15:50:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:50:24 - job_xml_thread(): Done retrieving: data size 43566243
Mon 20 Jan 2014 15:50:24 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:50:24 - XML: Start document: iteration 19
Mon 20 Jan 2014 15:50:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:50:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:50:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:50:36 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:50:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:50:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:50:37 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:50:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:50:37 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:50:37 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:50:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:50:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:50:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:50:40 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 15:50:40 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:50:40 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:50:40 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:50:40 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:50:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:50:45 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:50:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:50:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:50:45 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:50:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 15:50:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:50:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:50:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:50:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:50:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:50:47 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:50:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568929
Mon 20 Jan 2014 15:50:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:50:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568929
Mon 20 Jan 2014 15:50:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:50:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:50:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:50:56 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:50:56 - job_xml_thread(): Done retrieving: data size 43568929
Mon 20 Jan 2014 15:50:56 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:50:56 - XML: Start document: iteration 20
Mon 20 Jan 2014 15:51:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:51:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:51:01 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 15:51:02 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:51:02 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:51:02 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 15:51:02 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:51:02 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 15:51:02 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 15:51:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:51:04 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:51:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:51:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:51:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:51:06 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:51:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:51:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:51:06 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:51:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:51:06 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:51:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:51:06 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:51:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:51:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:51:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:51:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:51:10 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 982186 values 15521608 bits 1940201 bytes 
Mon 20 Jan 2014 15:51:10 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 15:51:10 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:51:10 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:51:10 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:51:10 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:51:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:51:11 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:51:12 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:51:12 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:51:12 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 15:51:12 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 15:51:12 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:51:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5760 values 90826 bits 11353 bytes 
Mon 20 Jan 2014 15:51:15 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:51:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569677
Mon 20 Jan 2014 15:51:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:51:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569677
Mon 20 Jan 2014 15:51:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:51:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:51:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:51:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:51:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:51:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:51:25 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:51:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:51:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:51:25 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:51:25 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:51:26 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:51:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:51:26 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:51:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:51:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:51:30 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:51:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:51:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:51:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:51:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:51:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:51:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:51:32 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:51:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 15:51:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:51:34 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:51:34 - job_xml_thread(): Done retrieving: data size 43585232
Mon 20 Jan 2014 15:51:34 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:51:34 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 15:51:34 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 15:51:34 - Housekeeping: done.
Mon 20 Jan 2014 15:51:34 - XML: Start document: iteration 0
Mon 20 Jan 2014 15:51:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43585232
Mon 20 Jan 2014 15:51:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:51:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43585232
Mon 20 Jan 2014 15:51:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:51:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:51:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:51:44 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 15:51:44 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:51:44 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:51:44 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:51:44 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:51:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:51:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:51:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:51:50 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:51:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:51:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:51:52 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:51:52 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:51:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:51:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:51:52 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:51:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:51:55 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:51:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:51:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:51:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:51:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:51:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:51:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:51:59 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:51:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568756
Mon 20 Jan 2014 15:51:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:52:00 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:52:00 - job_xml_thread(): Done retrieving: data size 43568756
Mon 20 Jan 2014 15:52:00 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:52:00 - XML: Start document: iteration 1
Mon 20 Jan 2014 15:52:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568756
Mon 20 Jan 2014 15:52:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:52:03 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:52:03 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 15:52:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:52:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:52:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:52:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:52:12 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:52:12 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:52:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:52:14 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:52:14 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:52:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:52:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 15:52:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 15:52:14 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:52:14 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7757 values 122290 bits 15286 bytes 
Mon 20 Jan 2014 15:52:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:52:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:52:15 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:52:15 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:52:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:52:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:52:15 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:52:16 - XML: Processed 653355 elements - found 0 jobs
Mon 20 Jan 2014 15:52:16 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:52:16 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:52:16 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:52:16 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:52:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:52:19 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:52:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:52:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:52:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:52:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:52:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:52:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:52:22 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:52:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560845
Mon 20 Jan 2014 15:52:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:52:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560845
Mon 20 Jan 2014 15:52:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:52:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:52:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:52:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:52:31 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:52:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:52:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:52:32 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:52:32 - job_xml_thread(): Done retrieving: data size 43560845
Mon 20 Jan 2014 15:52:32 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:52:32 - XML: Start document: iteration 2
Mon 20 Jan 2014 15:52:32 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:52:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:52:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560845
Mon 20 Jan 2014 15:52:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:52:32 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:52:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:52:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:52:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:52:45 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:52:45 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 15:52:45 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:52:45 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 15:52:46 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:52:46 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:52:46 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:52:46 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:52:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:52:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:52:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:52:49 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:52:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:52:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:52:50 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:52:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:52:50 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:52:50 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:52:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:52:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:52:52 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:52:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:52:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:52:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:52:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:52:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:52:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:52:56 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:52:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572668
Mon 20 Jan 2014 15:52:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:52:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572668
Mon 20 Jan 2014 15:52:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:53:01 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:53:01 - job_xml_thread(): Done retrieving: data size 43572668
Mon 20 Jan 2014 15:53:01 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:53:01 - XML: Start document: iteration 3
Mon 20 Jan 2014 15:53:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:53:05 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:53:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:53:06 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:53:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:53:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:53:08 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:53:08 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:53:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:53:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:53:08 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:53:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:53:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:53:12 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 15:53:12 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:53:12 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:53:12 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:53:12 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:53:15 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:53:15 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:53:16 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:53:16 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:53:16 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 15:53:16 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:53:16 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 15:53:16 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6068 values 95738 bits 11967 bytes 
Mon 20 Jan 2014 15:53:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:53:18 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:53:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:53:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:53:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:53:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:53:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:53:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:53:22 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:53:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43489524
Mon 20 Jan 2014 15:53:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:53:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43489524
Mon 20 Jan 2014 15:53:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:53:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:53:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:53:27 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:53:27 - job_xml_thread(): Done retrieving: data size 43489524
Mon 20 Jan 2014 15:53:27 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:53:27 - XML: Start document: iteration 4
Mon 20 Jan 2014 15:53:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:53:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:53:36 - XML: Processed 652608 elements - found 0 jobs
Mon 20 Jan 2014 15:53:36 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:53:36 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:53:36 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:53:36 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:53:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:53:39 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:53:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:53:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:53:39 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:53:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:53:39 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:53:39 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:53:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:53:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:53:44 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:53:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:53:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:53:44 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:53:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 15:53:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:53:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:53:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:53:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:53:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:53:48 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:53:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42976326
Mon 20 Jan 2014 15:53:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:53:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42976326
Mon 20 Jan 2014 15:53:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:53:51 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:53:51 - job_xml_thread(): Done retrieving: data size 42976326
Mon 20 Jan 2014 15:53:51 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:53:51 - XML: Start document: iteration 5
Mon 20 Jan 2014 15:53:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:53:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:54:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:54:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:54:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:54:01 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:54:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:54:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:54:02 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:54:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:54:02 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:54:02 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:54:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:54:04 - XML: Processed 646038 elements - found 0 jobs
Mon 20 Jan 2014 15:54:04 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:54:04 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:54:04 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:54:04 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:54:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:54:09 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:54:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:54:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:54:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:54:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:54:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:54:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:54:12 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:54:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42945346
Mon 20 Jan 2014 15:54:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:54:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42945346
Mon 20 Jan 2014 15:54:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:54:16 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:54:16 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:54:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:54:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:54:17 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:54:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 15:54:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:54:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 15:54:17 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:54:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8700 values 137185 bits 17148 bytes 
Mon 20 Jan 2014 15:54:19 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:54:19 - job_xml_thread(): Done retrieving: data size 42945346
Mon 20 Jan 2014 15:54:19 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:54:19 - XML: Start document: iteration 6
Mon 20 Jan 2014 15:54:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:54:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:54:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:54:35 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:54:35 - XML: Processed 645834 elements - found 0 jobs
Mon 20 Jan 2014 15:54:35 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:54:35 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:54:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:54:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:54:35 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:54:35 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:54:36 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:54:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:54:36 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:54:36 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:54:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:54:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:54:36 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:54:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:54:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:54:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:54:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:54:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:54:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:54:40 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:54:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43456548
Mon 20 Jan 2014 15:54:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:54:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43456548
Mon 20 Jan 2014 15:54:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:54:51 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:54:51 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:54:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:54:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:54:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:54:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:54:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:54:53 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:54:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:54:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:54:53 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:54:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:54:53 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:54:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:54:56 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:54:56 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 15:54:56 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:54:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:54:57 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:54:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:54:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:54:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:54:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:54:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:54:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:54:59 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 15:54:59 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 15:54:59 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:55:00 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:55:00 - job_xml_thread(): Done retrieving: data size 43550922
Mon 20 Jan 2014 15:55:00 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:55:00 - XML: Start document: iteration 7
Mon 20 Jan 2014 15:55:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43550922
Mon 20 Jan 2014 15:55:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:55:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43550922
Mon 20 Jan 2014 15:55:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:55:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:55:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:55:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:55:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:55:17 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:55:17 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:55:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:55:17 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:55:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:55:17 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:55:18 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:55:18 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:55:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:55:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:55:18 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:55:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:55:18 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:55:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 15:55:18 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:55:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 15:55:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5816 values 91693 bits 11461 bytes 
Mon 20 Jan 2014 15:55:19 - XML: Processed 653286 elements - found 0 jobs
Mon 20 Jan 2014 15:55:19 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:55:19 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:55:19 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:55:19 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:55:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:55:22 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:55:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:55:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:55:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:55:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:55:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:55:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:55:24 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:55:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 15:55:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:55:24 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:55:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560844
Mon 20 Jan 2014 15:55:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:55:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560844
Mon 20 Jan 2014 15:55:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:55:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:55:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:55:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:55:35 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:55:35 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:55:35 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:55:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:55:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:55:35 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:55:35 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:55:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:55:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:55:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:55:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:55:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:55:38 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:55:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:55:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:55:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:55:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:55:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:55:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:55:40 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:55:40 - job_xml_thread(): Done retrieving: data size 43566862
Mon 20 Jan 2014 15:55:40 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:55:40 - XML: Start document: iteration 8
Mon 20 Jan 2014 15:55:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566862
Mon 20 Jan 2014 15:55:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:55:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566862
Mon 20 Jan 2014 15:55:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:55:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:55:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:55:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:55:51 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:55:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:55:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:55:53 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:55:53 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:55:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:55:53 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:55:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:55:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:55:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:55:57 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 15:55:57 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:55:57 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:55:57 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:55:57 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:56:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:56:00 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:56:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:56:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:56:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:56:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:56:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:56:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:56:02 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:56:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564739
Mon 20 Jan 2014 15:56:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:56:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564739
Mon 20 Jan 2014 15:56:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:56:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:56:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:56:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:56:12 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:56:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:56:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:56:12 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:56:12 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:56:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:56:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:56:12 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:56:12 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:56:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:56:15 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:56:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:56:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:56:16 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:56:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581574
Mon 20 Jan 2014 15:56:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:56:17 - job_xml_thread(): Done retrieving: data size 43581574
Mon 20 Jan 2014 15:56:17 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:56:17 - XML: Start document: iteration 9
Mon 20 Jan 2014 15:56:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:56:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:56:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581574
Mon 20 Jan 2014 15:56:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:56:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:56:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:56:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:56:19 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:56:20 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:56:20 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:56:20 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 15:56:20 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 15:56:20 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:56:20 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 12560 values 198174 bits 24771 bytes 
Mon 20 Jan 2014 15:56:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:56:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:56:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:56:28 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:56:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:56:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:56:29 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:56:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:56:29 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:56:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:56:29 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:56:33 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 15:56:33 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:56:33 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:56:33 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:56:33 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:56:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:56:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:56:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:56:36 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:56:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:56:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:56:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:56:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:56:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:56:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:56:38 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:56:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554472
Mon 20 Jan 2014 15:56:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:56:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554472
Mon 20 Jan 2014 15:56:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:56:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:56:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:56:48 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:56:49 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:56:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:56:51 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:56:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:56:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:56:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:56:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:56:52 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:56:52 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:56:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:56:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:56:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:56:54 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:56:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:56:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:56:54 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:56:54 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 15:56:54 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:56:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:56:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:56:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:56:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:56:56 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:56:56 - job_xml_thread(): Done retrieving: data size 43570748
Mon 20 Jan 2014 15:56:56 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:56:56 - XML: Start document: iteration 10
Mon 20 Jan 2014 15:56:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570748
Mon 20 Jan 2014 15:56:57 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570748
Mon 20 Jan 2014 15:56:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:56:57 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:57:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:57:07 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:57:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:57:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:57:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:57:11 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:57:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:57:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:57:12 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:57:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:57:12 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:57:12 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:57:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:57:15 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 15:57:15 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:57:15 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:57:15 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:57:15 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:57:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:57:17 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:57:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:57:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:57:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:57:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:57:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:57:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:57:19 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:57:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584364
Mon 20 Jan 2014 15:57:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:57:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584364
Mon 20 Jan 2014 15:57:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:57:20 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:57:20 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:57:22 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:57:22 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:57:22 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 15:57:22 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:57:22 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8609 values 135711 bits 16963 bytes 
Mon 20 Jan 2014 15:57:22 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 15:57:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:57:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:57:30 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:57:30 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:57:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:57:31 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:57:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:57:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:57:32 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:57:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:57:32 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:57:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:57:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:57:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:57:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:57:36 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:57:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:57:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:57:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:57:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:57:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:57:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:57:37 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:57:37 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 15:57:37 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:57:37 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:57:37 - job_xml_thread(): Done retrieving: data size 43573646
Mon 20 Jan 2014 15:57:37 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:57:37 - XML: Start document: iteration 11
Mon 20 Jan 2014 15:57:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573646
Mon 20 Jan 2014 15:57:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:57:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573646
Mon 20 Jan 2014 15:57:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:57:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:57:47 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:57:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:57:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:57:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:57:52 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:57:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:57:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:57:53 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:57:53 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:57:53 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:57:53 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:57:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:57:55 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 15:57:55 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:57:55 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:57:55 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:57:55 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:57:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:57:59 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:57:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:57:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:57:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:57:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:57:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:57:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:58:01 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:58:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571400
Mon 20 Jan 2014 15:58:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:58:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571400
Mon 20 Jan 2014 15:58:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:58:03 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 15:58:03 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:58:04 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:58:04 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:58:04 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 15:58:04 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 15:58:04 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 15:58:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:58:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Mon 20 Jan 2014 15:58:10 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:58:10 - job_xml_thread(): Done retrieving: data size 43571400
Mon 20 Jan 2014 15:58:10 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:58:10 - XML: Start document: iteration 12
Mon 20 Jan 2014 15:58:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:58:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:58:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:58:15 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:58:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:58:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:58:17 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:58:17 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:58:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:58:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:58:17 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:58:19 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 15:58:19 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:58:20 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:58:20 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:58:20 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:58:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:58:21 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:58:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:58:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:58:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:58:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:58:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:58:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:58:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:58:23 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:58:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:58:23 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:58:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 15:58:23 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:58:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6128 values 96621 bits 12077 bytes 
Mon 20 Jan 2014 15:58:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 15:58:23 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:58:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568940
Mon 20 Jan 2014 15:58:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:58:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568940
Mon 20 Jan 2014 15:58:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:58:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:58:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:58:32 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:58:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:58:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:58:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:58:33 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:58:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:58:33 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:58:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:58:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568940
Mon 20 Jan 2014 15:58:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:58:35 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:58:35 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:58:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:58:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:58:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:58:44 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:58:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:58:45 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:58:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:58:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:58:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:58:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:58:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:58:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:58:47 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:58:47 - job_xml_thread(): Done retrieving: data size 43565064
Mon 20 Jan 2014 15:58:47 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:58:47 - XML: Start document: iteration 13
Mon 20 Jan 2014 15:58:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565064
Mon 20 Jan 2014 15:58:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:58:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:58:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:58:49 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:58:49 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:58:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:58:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:58:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565064
Mon 20 Jan 2014 15:58:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:59:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:59:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:59:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:59:05 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:59:05 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:59:05 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:59:05 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:59:05 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:59:05 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 15:59:05 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 15:59:05 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 15:59:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:59:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:59:05 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:59:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:59:05 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:59:05 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:59:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:59:06 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 15:59:06 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:59:06 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:59:06 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:59:06 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:59:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:59:09 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:59:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:59:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:59:10 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 909121 values 14345275 bits 1793159 bytes 
Mon 20 Jan 2014 15:59:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:59:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:59:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:59:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:59:10 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:59:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 15:59:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:59:13 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:59:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43493692
Mon 20 Jan 2014 15:59:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:59:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43493692
Mon 20 Jan 2014 15:59:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:59:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:59:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:59:21 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:59:21 - job_xml_thread(): Done retrieving: data size 43493692
Mon 20 Jan 2014 15:59:21 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 15:59:21 - XML: Start document: iteration 14
Mon 20 Jan 2014 15:59:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:59:23 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:59:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:59:24 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:59:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 15:59:24 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 15:59:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 15:59:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:59:25 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6514 values 102722 bits 12840 bytes 
Mon 20 Jan 2014 15:59:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:59:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:59:27 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:59:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:59:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:59:27 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:59:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:59:27 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:59:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:59:27 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:59:34 - XML: Processed 652608 elements - found 0 jobs
Mon 20 Jan 2014 15:59:34 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 15:59:34 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 15:59:34 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 15:59:34 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 15:59:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:59:35 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:59:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:59:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 15:59:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:59:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 15:59:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 15:59:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 15:59:39 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 15:59:39 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43036170
Mon 20 Jan 2014 15:59:39 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 15:59:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43036170
Mon 20 Jan 2014 15:59:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 15:59:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 15:59:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:59:50 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 15:59:50 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 15:59:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 15:59:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 15:59:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 15:59:55 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 15:59:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 15:59:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 15:59:57 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:59:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 15:59:57 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 15:59:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 15:59:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 15:59:59 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 15:59:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 15:59:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:00:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:00:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:00:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:00:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:00:03 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:00:03 - job_xml_thread(): Done retrieving: data size 42901672
Mon 20 Jan 2014 16:00:03 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:00:03 - XML: Start document: iteration 15
Mon 20 Jan 2014 16:00:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42901672
Mon 20 Jan 2014 16:00:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:00:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42901672
Mon 20 Jan 2014 16:00:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:00:05 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:00:05 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 16:00:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:00:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:00:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:00:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:00:16 - XML: Processed 645236 elements - found 0 jobs
Mon 20 Jan 2014 16:00:16 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:00:16 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:00:16 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:00:16 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:00:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:00:21 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:00:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:00:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:00:21 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:00:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:00:21 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:00:21 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:00:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:00:24 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:00:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 16:00:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:00:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:00:24 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:00:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:00:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:00:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:00:25 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:00:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:00:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:00:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:00:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:00:25 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:00:25 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:00:25 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 16:00:25 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 16:00:25 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:00:25 - size of cluster 'Render Cluster': 20 hosts 3138 metrics 4268 values 67268 bits 8408 bytes 
Mon 20 Jan 2014 16:00:28 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:00:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42964566
Mon 20 Jan 2014 16:00:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:00:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42964566
Mon 20 Jan 2014 16:00:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:00:31 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:00:31 - job_xml_thread(): Done retrieving: data size 42964566
Mon 20 Jan 2014 16:00:31 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:00:31 - XML: Start document: iteration 16
Mon 20 Jan 2014 16:00:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:00:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:00:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:00:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:00:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:00:41 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:00:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:00:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:00:41 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:00:41 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:00:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:00:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:00:41 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:00:45 - XML: Processed 645908 elements - found 0 jobs
Mon 20 Jan 2014 16:00:45 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:00:45 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:00:45 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:00:45 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:00:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:00:48 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:00:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:00:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:00:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:00:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:00:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:00:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:00:48 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:00:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 16:00:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:00:51 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:00:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43496437
Mon 20 Jan 2014 16:00:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:00:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43496437
Mon 20 Jan 2014 16:00:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:00:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:00:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:00:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:00:59 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:00:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:00:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:01:00 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:01:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:01:00 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:01:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43496437
Mon 20 Jan 2014 16:01:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:01:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:01:00 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:01:00 - job_xml_thread(): Done retrieving: data size 43496437
Mon 20 Jan 2014 16:01:00 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:01:00 - XML: Start document: iteration 17
Mon 20 Jan 2014 16:01:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:01:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:01:12 - XML: Processed 652638 elements - found 0 jobs
Mon 20 Jan 2014 16:01:12 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:01:12 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:01:12 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:01:12 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:01:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:01:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:01:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:01:18 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:01:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:01:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:01:18 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:01:18 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:01:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:01:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:01:18 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:01:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:01:19 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:01:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:01:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:01:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:01:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:01:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:01:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:01:23 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:01:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569366
Mon 20 Jan 2014 16:01:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:01:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569366
Mon 20 Jan 2014 16:01:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:01:25 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:01:25 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:01:26 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:01:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 16:01:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:01:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 16:01:27 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:01:27 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:01:27 - job_xml_thread(): Done retrieving: data size 43569366
Mon 20 Jan 2014 16:01:27 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:01:27 - XML: Start document: iteration 18
Mon 20 Jan 2014 16:01:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8532 values 134725 bits 16840 bytes 
Mon 20 Jan 2014 16:01:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:01:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:01:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:01:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:01:42 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:01:42 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:01:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:01:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:01:42 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:01:42 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:01:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:01:42 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:01:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:01:42 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 16:01:42 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:01:42 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:01:42 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:01:42 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:01:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:01:46 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:01:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:01:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:01:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:01:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:01:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:01:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:01:50 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:01:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570816
Mon 20 Jan 2014 16:01:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:01:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570816
Mon 20 Jan 2014 16:01:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:01:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:01:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:01:57 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:01:57 - job_xml_thread(): Done retrieving: data size 43570816
Mon 20 Jan 2014 16:01:57 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:01:57 - XML: Start document: iteration 19
Mon 20 Jan 2014 16:02:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:02:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:02:02 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:02:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 16:02:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:02:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:02:07 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:02:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:02:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:02:08 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:02:08 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:02:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:02:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:02:08 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:02:09 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 16:02:09 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:02:09 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:02:09 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:02:09 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:02:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:02:12 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:02:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:02:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:02:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:02:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:02:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:02:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:02:16 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:02:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583160
Mon 20 Jan 2014 16:02:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:02:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583160
Mon 20 Jan 2014 16:02:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:02:23 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:02:23 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:02:24 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:02:24 - job_xml_thread(): Done retrieving: data size 43583160
Mon 20 Jan 2014 16:02:24 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:02:24 - XML: Start document: iteration 20
Mon 20 Jan 2014 16:02:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:02:26 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:02:27 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:02:27 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 16:02:27 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:02:27 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6231 values 98624 bits 12328 bytes 
Mon 20 Jan 2014 16:02:28 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:02:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 16:02:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:02:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:02:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:02:32 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:02:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:02:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:02:33 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:02:33 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:02:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:02:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:02:33 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:02:34 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 16:02:34 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:02:34 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:02:34 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:02:34 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:02:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:02:38 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:02:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:02:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:02:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:02:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:02:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:02:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:02:42 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:02:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566074
Mon 20 Jan 2014 16:02:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:02:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566074
Mon 20 Jan 2014 16:02:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:02:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:02:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:02:50 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:02:50 - job_xml_thread(): Done retrieving: data size 43566074
Mon 20 Jan 2014 16:02:50 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:02:50 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 16:02:50 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 16:02:50 - Housekeeping: done.
Mon 20 Jan 2014 16:02:50 - XML: Start document: iteration 0
Mon 20 Jan 2014 16:02:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:02:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:02:55 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:02:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 16:02:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:02:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:02:55 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:02:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:02:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:02:57 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:02:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:02:57 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:02:57 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:02:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:03:02 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 16:03:02 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:03:02 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:03:02 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:03:02 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:03:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:03:04 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:03:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:03:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:03:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:03:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:03:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:03:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:03:05 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 16:03:05 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 16:03:05 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:03:07 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:03:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43547213
Mon 20 Jan 2014 16:03:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:03:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43547213
Mon 20 Jan 2014 16:03:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:03:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:03:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:03:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:03:16 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:03:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:03:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:03:17 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:03:17 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:03:18 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:03:18 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:03:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:03:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:03:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:03:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:03:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:03:21 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:03:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:03:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:03:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:03:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:03:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:03:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:03:23 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:03:23 - job_xml_thread(): Done retrieving: data size 43563167
Mon 20 Jan 2014 16:03:23 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:03:23 - XML: Start document: iteration 1
Mon 20 Jan 2014 16:03:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43563167
Mon 20 Jan 2014 16:03:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:03:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43563167
Mon 20 Jan 2014 16:03:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:03:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:03:28 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:03:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:03:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 16:03:29 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:03:29 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:03:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 16:03:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9297 values 146992 bits 18374 bytes 
Mon 20 Jan 2014 16:03:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:03:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:03:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:03:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:03:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:03:40 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:03:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:03:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:03:41 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:03:41 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:03:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:03:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:03:41 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:03:43 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 16:03:43 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:03:43 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:03:43 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:03:43 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:03:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:03:46 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:03:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:03:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:03:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:03:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:03:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:03:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:03:48 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:03:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582934
Mon 20 Jan 2014 16:03:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:03:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582934
Mon 20 Jan 2014 16:03:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:03:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:03:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:03:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:03:58 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:03:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:03:58 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:03:59 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:03:59 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:04:00 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:04:00 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:04:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:04:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:04:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:04:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:04:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:04:03 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:04:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:04:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:04:04 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:04:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 16:04:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:04:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:04:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:04:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:04:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:04:05 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:04:05 - job_xml_thread(): Done retrieving: data size 43573242
Mon 20 Jan 2014 16:04:05 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:04:05 - XML: Start document: iteration 2
Mon 20 Jan 2014 16:04:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573242
Mon 20 Jan 2014 16:04:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:04:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573242
Mon 20 Jan 2014 16:04:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:04:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:04:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:04:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:04:18 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:04:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:04:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:04:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:04:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:04:20 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:04:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:04:20 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:04:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:04:20 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:04:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:04:26 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:04:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:04:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:04:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:04:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:04:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:04:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:04:28 - XML: Processed 653355 elements - found 0 jobs
Mon 20 Jan 2014 16:04:28 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:04:28 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:04:28 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:04:28 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:04:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:04:29 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:04:29 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:04:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 16:04:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:04:29 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 16:04:29 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:04:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5874 values 92770 bits 11596 bytes 
Mon 20 Jan 2014 16:04:30 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:04:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569830
Mon 20 Jan 2014 16:04:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:04:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569830
Mon 20 Jan 2014 16:04:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:04:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:04:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:04:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:04:39 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:04:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:04:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:04:40 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:04:40 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:04:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:04:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:04:40 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:04:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:04:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:04:43 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:04:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:04:45 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:04:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:04:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:04:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:04:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:04:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:04:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:04:47 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:04:47 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 16:04:47 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:04:47 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:04:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583908
Mon 20 Jan 2014 16:04:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:04:48 - job_xml_thread(): Done retrieving: data size 43583908
Mon 20 Jan 2014 16:04:48 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:04:48 - XML: Start document: iteration 3
Mon 20 Jan 2014 16:04:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583908
Mon 20 Jan 2014 16:04:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:04:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:04:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:05:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:05:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:05:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:05:04 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:05:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:05:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:05:06 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:05:06 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:05:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:05:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:05:06 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:05:08 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 16:05:08 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:05:08 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:05:08 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:05:08 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:05:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:05:09 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:05:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:05:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:05:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:05:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:05:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:05:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:05:12 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:05:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43501678
Mon 20 Jan 2014 16:05:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:05:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43501678
Mon 20 Jan 2014 16:05:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:05:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:05:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:05:23 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:05:23 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:05:23 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:05:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:05:23 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:05:23 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:05:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:05:25 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:05:25 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:05:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:05:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:05:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:05:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:05:27 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:05:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:05:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:05:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:05:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:05:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:05:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:05:29 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:05:29 - job_xml_thread(): Done retrieving: data size 43414247
Mon 20 Jan 2014 16:05:29 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:05:29 - XML: Start document: iteration 4
Mon 20 Jan 2014 16:05:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43414247
Mon 20 Jan 2014 16:05:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:05:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:05:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43414247
Mon 20 Jan 2014 16:05:30 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:05:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:05:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:05:30 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:05:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 16:05:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 16:05:31 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:05:31 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6701 values 105718 bits 13214 bytes 
Mon 20 Jan 2014 16:05:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:05:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:05:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:05:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:05:47 - XML: Processed 651394 elements - found 0 jobs
Mon 20 Jan 2014 16:05:48 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:05:48 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:05:48 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:05:48 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:05:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:05:48 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:05:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:05:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:05:49 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:05:49 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:05:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:05:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:05:49 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:05:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:05:52 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:05:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:05:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:05:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:05:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:05:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:05:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:05:55 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:05:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 16:05:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:05:55 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:05:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42909468
Mon 20 Jan 2014 16:05:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:05:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42909468
Mon 20 Jan 2014 16:05:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:06:03 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:06:03 - job_xml_thread(): Done retrieving: data size 42909468
Mon 20 Jan 2014 16:06:03 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:06:03 - XML: Start document: iteration 5
Mon 20 Jan 2014 16:06:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:06:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:06:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:06:05 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:06:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:06:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:06:06 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 16:06:06 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:06:06 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:06:06 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:06:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:06:07 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:06:07 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 16:06:07 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:06:07 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 16:06:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:06:07 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 16:06:07 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:06:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:06:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Mon 20 Jan 2014 16:06:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:06:18 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:06:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:06:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:06:18 - XML: Processed 645312 elements - found 0 jobs
Mon 20 Jan 2014 16:06:18 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:06:18 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:06:18 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:06:18 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:06:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:06:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:06:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:06:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:06:20 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:06:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42960115
Mon 20 Jan 2014 16:06:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:06:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42960115
Mon 20 Jan 2014 16:06:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:06:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:06:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:06:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:06:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:06:31 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:06:31 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:06:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:06:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:06:32 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:06:32 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:06:32 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:06:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:06:32 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:06:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:06:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 16:06:32 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:06:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 16:06:32 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:06:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6281 values 99114 bits 12389 bytes 
Mon 20 Jan 2014 16:06:33 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:06:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:06:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:06:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:06:35 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:06:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:06:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:06:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:06:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:06:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:06:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:06:38 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:06:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43453800
Mon 20 Jan 2014 16:06:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:06:38 - job_xml_thread(): Done retrieving: data size 43453800
Mon 20 Jan 2014 16:06:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43453800
Mon 20 Jan 2014 16:06:38 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:06:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:06:39 - XML: Start document: iteration 6
Mon 20 Jan 2014 16:06:47 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:06:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:06:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:06:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:06:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:06:52 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:06:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:06:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:06:52 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:06:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:06:52 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:06:52 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:06:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:06:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:06:59 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:06:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:06:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:06:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:06:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:06:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:07:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:07:00 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:07:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 16:07:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:07:01 - XML: Processed 652016 elements - found 0 jobs
Mon 20 Jan 2014 16:07:01 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:07:01 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:07:01 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:07:01 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:07:03 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:07:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562277
Mon 20 Jan 2014 16:07:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:07:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562277
Mon 20 Jan 2014 16:07:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:07:07 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:07:07 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:07:08 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:07:08 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:07:08 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:07:08 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 16:07:08 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:07:08 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 16:07:08 - Entering storeMetrics(): cluster LISA Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Mon 20 Jan 2014 16:07:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:07:14 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:07:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:07:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:07:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:07:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:07:16 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:07:16 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:07:16 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:07:16 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:07:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:07:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:07:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:07:19 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:07:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:07:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:07:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:07:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:07:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:07:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:07:21 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:07:21 - job_xml_thread(): Done retrieving: data size 43577347
Mon 20 Jan 2014 16:07:21 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:07:21 - XML: Start document: iteration 7
Mon 20 Jan 2014 16:07:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577347
Mon 20 Jan 2014 16:07:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577347
Mon 20 Jan 2014 16:07:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:07:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:07:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:07:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:07:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:07:32 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:07:33 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:07:33 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 16:07:33 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:07:33 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 16:07:33 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:07:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:07:34 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:07:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9113 values 143737 bits 17967 bytes 
Mon 20 Jan 2014 16:07:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:07:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:07:34 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:07:34 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:07:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:07:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:07:34 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:07:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:07:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:07:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:07:44 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:07:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:07:45 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 16:07:45 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:07:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:07:45 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:07:45 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:07:45 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:07:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:07:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:07:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:07:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:07:47 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:07:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556069
Mon 20 Jan 2014 16:07:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:07:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556069
Mon 20 Jan 2014 16:07:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:07:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:07:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:07:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:07:55 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:07:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:07:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:07:56 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:07:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:07:56 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:07:56 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556069
Mon 20 Jan 2014 16:07:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:07:56 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:08:00 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:08:00 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:08:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:08:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:08:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:08:07 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:08:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:08:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:08:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:08:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:08:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:08:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:08:08 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:08:08 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:08:09 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:08:09 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 16:08:09 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:08:09 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 16:08:09 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 16:08:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:08:09 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:08:11 - size of cluster 'LISA Cluster': 624 hosts 79488 metrics 1526469 values 24117154 bits 3014644 bytes 
Mon 20 Jan 2014 16:08:11 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:08:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 16:08:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:08:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:08:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:08:12 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:08:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:08:12 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:08:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:08:15 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:08:15 - job_xml_thread(): Done retrieving: data size 43551249
Mon 20 Jan 2014 16:08:15 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:08:15 - XML: Start document: iteration 8
Mon 20 Jan 2014 16:08:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43551249
Mon 20 Jan 2014 16:08:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:08:15 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43551249
Mon 20 Jan 2014 16:08:15 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:08:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:08:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:08:27 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:08:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:08:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:08:33 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:08:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:08:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:08:33 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:08:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:08:33 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:08:33 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:08:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:08:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:08:34 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:08:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:08:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 16:08:34 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:08:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 16:08:34 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:08:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5928 values 93555 bits 11694 bytes 
Mon 20 Jan 2014 16:08:36 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 16:08:36 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:08:36 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:08:36 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:08:36 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:08:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:08:37 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:08:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:08:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:08:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:08:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:08:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:08:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:08:42 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:08:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561553
Mon 20 Jan 2014 16:08:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:08:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561553
Mon 20 Jan 2014 16:08:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:08:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:08:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:08:51 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:08:51 - job_xml_thread(): Done retrieving: data size 43561553
Mon 20 Jan 2014 16:08:51 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:08:51 - XML: Start document: iteration 9
Mon 20 Jan 2014 16:08:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:08:54 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:08:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:08:56 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:08:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:08:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:08:57 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:08:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:08:57 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:08:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:08:59 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:09:01 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 16:09:01 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:09:01 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:09:01 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:09:01 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:09:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:09:05 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:09:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:09:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:09:05 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:09:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 16:09:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:09:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:09:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:09:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:09:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:09:09 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:09:09 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 16:09:09 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:09:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560133
Mon 20 Jan 2014 16:09:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:09:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560133
Mon 20 Jan 2014 16:09:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:09:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:09:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:09:17 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:09:17 - job_xml_thread(): Done retrieving: data size 43560133
Mon 20 Jan 2014 16:09:17 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:09:17 - XML: Start document: iteration 10
Mon 20 Jan 2014 16:09:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:09:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:09:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:09:25 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:09:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:09:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:09:26 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:09:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:09:26 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:09:26 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:09:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:09:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:09:34 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:09:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:09:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:09:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:09:35 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 16:09:35 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:09:35 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:09:35 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:09:35 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:09:35 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:09:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:09:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:09:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:09:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:09:36 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:09:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 16:09:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:09:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 16:09:36 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:09:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5836 values 92054 bits 11506 bytes 
Mon 20 Jan 2014 16:09:39 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:09:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43544499
Mon 20 Jan 2014 16:09:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:09:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43544499
Mon 20 Jan 2014 16:09:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:09:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:09:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:09:50 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:09:50 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:09:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:09:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:09:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:09:55 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:09:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:09:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:09:56 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:09:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:09:56 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:09:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:09:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:09:59 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:09:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:09:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:10:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:10:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:10:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:10:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:10:00 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:10:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 16:10:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:10:03 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:10:03 - job_xml_thread(): Done retrieving: data size 43561918
Mon 20 Jan 2014 16:10:03 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:10:03 - XML: Start document: iteration 11
Mon 20 Jan 2014 16:10:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561918
Mon 20 Jan 2014 16:10:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:10:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561918
Mon 20 Jan 2014 16:10:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:10:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:10:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:10:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:10:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:10:19 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 16:10:19 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:10:19 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:10:19 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:10:19 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:10:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:10:26 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:10:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:10:27 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:10:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:10:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:10:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:10:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:10:27 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:10:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:10:27 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:10:27 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:10:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:10:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:10:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:10:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:10:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:10:31 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:10:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43590662
Mon 20 Jan 2014 16:10:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:10:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43590662
Mon 20 Jan 2014 16:10:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:10:35 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:10:35 - job_xml_thread(): Done retrieving: data size 43590662
Mon 20 Jan 2014 16:10:36 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:10:36 - XML: Start document: iteration 12
Mon 20 Jan 2014 16:10:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:10:36 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:10:37 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:10:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:10:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 16:10:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 16:10:38 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:10:38 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8367 values 131911 bits 16488 bytes 
Mon 20 Jan 2014 16:10:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:10:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:10:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:10:43 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:10:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:10:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:10:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:10:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:10:44 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:10:44 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:10:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:10:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:10:44 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:10:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:10:54 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:10:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:10:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:10:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:10:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:10:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:10:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:10:56 - XML: Processed 653356 elements - found 0 jobs
Mon 20 Jan 2014 16:10:56 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:10:56 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:10:56 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:10:56 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:10:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:10:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:11:00 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:11:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 16:11:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:11:00 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:11:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555403
Mon 20 Jan 2014 16:11:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:11:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555403
Mon 20 Jan 2014 16:11:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:11:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:11:10 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:11:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:11:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:11:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:11:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:11:11 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:11:11 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:11:11 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:11:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:11:11 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:11:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:11:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:11:14 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:11:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:11:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:11:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:11:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:11:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:11:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:11:18 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:11:18 - job_xml_thread(): Done retrieving: data size 43515089
Mon 20 Jan 2014 16:11:18 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:11:18 - XML: Start document: iteration 13
Mon 20 Jan 2014 16:11:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43515089
Mon 20 Jan 2014 16:11:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:11:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43515089
Mon 20 Jan 2014 16:11:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:11:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:11:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:11:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:11:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:11:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:11:38 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:11:39 - XML: Processed 652608 elements - found 0 jobs
Mon 20 Jan 2014 16:11:39 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:11:39 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:11:39 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:11:39 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:11:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:11:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 16:11:39 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:11:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 16:11:39 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:11:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99097 bits 12387 bytes 
Mon 20 Jan 2014 16:11:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:11:40 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:11:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:11:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:11:41 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:11:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:11:41 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:11:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:11:41 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:11:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:11:43 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:11:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:11:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:11:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:11:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:11:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:11:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:11:47 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:11:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42959729
Mon 20 Jan 2014 16:11:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:11:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42959729
Mon 20 Jan 2014 16:11:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:11:54 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:11:54 - job_xml_thread(): Done retrieving: data size 42959729
Mon 20 Jan 2014 16:11:54 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:11:54 - XML: Start document: iteration 14
Mon 20 Jan 2014 16:11:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:11:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:11:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:11:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:12:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:12:05 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:12:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:12:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:12:05 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:12:05 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:12:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:12:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:12:05 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:12:07 - XML: Processed 645532 elements - found 0 jobs
Mon 20 Jan 2014 16:12:07 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:12:07 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:12:07 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:12:07 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:12:07 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:12:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 16:12:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:12:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:12:10 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:12:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:12:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:12:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:12:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:12:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:12:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:12:14 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:12:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42912410
Mon 20 Jan 2014 16:12:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:12:14 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42912410
Mon 20 Jan 2014 16:12:14 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:12:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:12:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:12:22 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:12:22 - job_xml_thread(): Done retrieving: data size 42912410
Mon 20 Jan 2014 16:12:22 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:12:22 - XML: Start document: iteration 15
Mon 20 Jan 2014 16:12:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:12:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:12:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:12:29 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:12:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:12:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:12:29 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:12:29 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:12:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:12:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:12:29 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:12:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:12:29 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:12:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:12:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:12:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:12:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:12:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:12:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:12:33 - XML: Processed 645232 elements - found 0 jobs
Mon 20 Jan 2014 16:12:33 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:12:33 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:12:33 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:12:33 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:12:37 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:12:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43449445
Mon 20 Jan 2014 16:12:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:12:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43449445
Mon 20 Jan 2014 16:12:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:12:39 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:12:39 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:12:40 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:12:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 16:12:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:12:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 16:12:40 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:12:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9212 values 145334 bits 18166 bytes 
Mon 20 Jan 2014 16:12:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:12:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:12:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:12:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:12:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:12:47 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:12:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:12:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:12:48 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:12:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:12:48 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:12:48 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:12:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:12:49 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:12:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:12:54 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:12:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:12:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:12:54 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:12:54 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:12:54 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:12:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:12:58 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:12:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43537119
Mon 20 Jan 2014 16:12:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:12:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43537119
Mon 20 Jan 2014 16:12:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:12:58 - job_xml_thread(): Done retrieving: data size 43537119
Mon 20 Jan 2014 16:12:58 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:12:58 - XML: Start document: iteration 16
Mon 20 Jan 2014 16:13:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:13:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:13:09 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:13:09 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:13:10 - XML: Processed 653106 elements - found 0 jobs
Mon 20 Jan 2014 16:13:10 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:13:10 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:13:10 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:13:10 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:13:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:13:19 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:13:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:13:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:13:21 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:13:21 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:13:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:13:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:13:21 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:13:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:13:21 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:13:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:13:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:13:22 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:13:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 16:13:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:13:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:13:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:13:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:13:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:13:25 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:13:25 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:13:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566920
Mon 20 Jan 2014 16:13:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:13:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566920
Mon 20 Jan 2014 16:13:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:13:26 - job_xml_thread(): Done retrieving: data size 43566920
Mon 20 Jan 2014 16:13:26 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:13:26 - XML: Start document: iteration 17
Mon 20 Jan 2014 16:13:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:13:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:13:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:13:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:13:40 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 16:13:40 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:13:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:13:40 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:13:40 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:13:40 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:13:40 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:13:40 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:13:40 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:13:40 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 16:13:40 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:13:40 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 16:13:40 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5728 values 90363 bits 11295 bytes 
Mon 20 Jan 2014 16:13:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:13:46 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:13:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:13:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:13:46 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:13:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:13:46 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:13:46 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:13:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:13:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:13:49 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:13:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:13:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:13:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:13:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:13:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:13:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:13:53 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:13:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555880
Mon 20 Jan 2014 16:13:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:13:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555880
Mon 20 Jan 2014 16:13:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:13:55 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:13:55 - job_xml_thread(): Done retrieving: data size 43555880
Mon 20 Jan 2014 16:13:55 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:13:55 - XML: Start document: iteration 18
Mon 20 Jan 2014 16:14:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:14:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:14:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:14:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:14:10 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:14:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 16:14:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:14:12 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:14:12 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:14:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:14:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:14:13 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:14:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:14:13 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:14:13 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:14:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:14:13 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 16:14:13 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:14:13 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:14:13 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:14:13 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:14:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:14:17 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:14:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:14:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:14:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:14:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:14:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:14:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:14:21 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:14:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572447
Mon 20 Jan 2014 16:14:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:14:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572447
Mon 20 Jan 2014 16:14:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:14:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:14:28 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:14:28 - job_xml_thread(): Done retrieving: data size 43572447
Mon 20 Jan 2014 16:14:28 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:14:28 - XML: Start document: iteration 19
Mon 20 Jan 2014 16:14:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:14:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:14:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:14:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:14:41 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:14:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:14:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 16:14:42 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:14:42 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:14:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 16:14:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5803 values 91577 bits 11447 bytes 
Mon 20 Jan 2014 16:14:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:14:44 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:14:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:14:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:14:45 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:14:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:14:45 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:14:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:14:45 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:14:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:14:45 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:14:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:14:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:14:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:14:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:14:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:14:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:14:49 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 16:14:49 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:14:49 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:14:49 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:14:49 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:14:53 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:14:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43570355
Mon 20 Jan 2014 16:14:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:14:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43570355
Mon 20 Jan 2014 16:14:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:15:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:15:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:15:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:15:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:15:04 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:15:04 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:15:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:15:07 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:15:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:15:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:15:07 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:15:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:15:07 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:15:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:15:08 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:15:08 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 16:15:08 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:15:10 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 16:15:10 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:15:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:15:10 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:15:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:15:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:15:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:15:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:15:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:15:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:15:11 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:15:11 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 16:15:11 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:15:11 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 16:15:11 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 16:15:12 - size of cluster 'LISA Cluster': 624 hosts 79486 metrics 1193909 values 18854593 bits 2356824 bytes 
Mon 20 Jan 2014 16:15:16 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:15:16 - job_xml_thread(): Done retrieving: data size 43557936
Mon 20 Jan 2014 16:15:16 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:15:16 - XML: Start document: iteration 20
Mon 20 Jan 2014 16:15:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557936
Mon 20 Jan 2014 16:15:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557936
Mon 20 Jan 2014 16:15:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:15:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:15:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:15:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:15:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:15:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:15:32 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 16:15:32 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:15:33 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:15:33 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:15:33 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:15:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:15:34 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:15:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:15:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:15:35 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:15:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:15:35 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:15:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:15:35 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:15:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:15:40 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:15:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:15:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:15:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:15:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:15:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:15:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:15:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:15:42 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:15:43 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:15:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 16:15:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:15:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 16:15:43 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:15:43 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6112 values 96481 bits 12060 bytes 
Mon 20 Jan 2014 16:15:45 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:15:45 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559304
Mon 20 Jan 2014 16:15:45 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:15:45 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559304
Mon 20 Jan 2014 16:15:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:15:48 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:15:48 - job_xml_thread(): Done retrieving: data size 43559304
Mon 20 Jan 2014 16:15:48 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:15:48 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 16:15:48 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 16:15:48 - Housekeeping: done.
Mon 20 Jan 2014 16:15:48 - XML: Start document: iteration 0
Mon 20 Jan 2014 16:15:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:15:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:15:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:15:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:15:58 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 16:15:58 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:15:58 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:15:58 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:15:58 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:16:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:16:03 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:16:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:16:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:16:03 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:16:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:16:03 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:16:03 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:16:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:16:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:16:06 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:16:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:16:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:16:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:16:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:16:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:16:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:16:10 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:16:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 16:16:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:16:11 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:16:11 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 16:16:11 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:16:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566695
Mon 20 Jan 2014 16:16:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:16:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566695
Mon 20 Jan 2014 16:16:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:16:13 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:16:14 - job_xml_thread(): Done retrieving: data size 43566695
Mon 20 Jan 2014 16:16:14 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:16:14 - XML: Start document: iteration 1
Mon 20 Jan 2014 16:16:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:16:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:16:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:16:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:16:32 - XML: Processed 653353 elements - found 0 jobs
Mon 20 Jan 2014 16:16:33 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:16:33 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:16:33 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:16:33 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:16:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:16:34 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:16:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:16:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:16:35 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:16:35 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:16:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:16:35 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:16:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:16:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:16:35 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:16:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:16:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:16:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:16:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:16:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:16:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:16:41 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:16:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579584
Mon 20 Jan 2014 16:16:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:16:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579584
Mon 20 Jan 2014 16:16:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:16:43 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:16:43 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:16:44 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:16:44 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 16:16:44 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:16:44 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 16:16:44 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:16:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7098 values 112124 bits 14015 bytes 
Mon 20 Jan 2014 16:16:48 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:16:48 - job_xml_thread(): Done retrieving: data size 43579584
Mon 20 Jan 2014 16:16:48 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:16:48 - XML: Start document: iteration 2
Mon 20 Jan 2014 16:16:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:16:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:16:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:16:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:16:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:16:59 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:16:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:16:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:17:00 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:17:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:17:00 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:17:00 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:17:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:17:03 - XML: Processed 653355 elements - found 0 jobs
Mon 20 Jan 2014 16:17:03 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:17:03 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:17:03 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:17:03 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:17:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:17:05 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:17:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:17:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:17:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:17:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:17:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:17:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:17:12 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:17:12 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 16:17:12 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:17:13 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:17:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557123
Mon 20 Jan 2014 16:17:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:17:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557123
Mon 20 Jan 2014 16:17:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:17:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:17:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:17:18 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:17:18 - job_xml_thread(): Done retrieving: data size 43557123
Mon 20 Jan 2014 16:17:18 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:17:18 - XML: Start document: iteration 3
Mon 20 Jan 2014 16:17:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:17:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:17:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:17:25 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:17:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:17:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:17:26 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:17:26 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:17:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:17:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:17:26 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:17:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:17:37 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:17:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:17:38 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:17:38 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 16:17:38 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:17:38 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:17:38 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:17:38 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:17:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:17:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:17:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:17:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:17:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:17:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:17:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:17:44 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:17:45 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:17:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 16:17:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:17:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 16:17:45 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:17:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 3140 values 49679 bits 6209 bytes 
Mon 20 Jan 2014 16:17:49 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:17:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43022562
Mon 20 Jan 2014 16:17:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:17:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43022562
Mon 20 Jan 2014 16:17:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:17:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:17:53 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:17:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:17:53 - job_xml_thread(): Done retrieving: data size 43022562
Mon 20 Jan 2014 16:17:53 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:17:53 - XML: Start document: iteration 4
Mon 20 Jan 2014 16:18:06 - XML: Processed 646932 elements - found 0 jobs
Mon 20 Jan 2014 16:18:06 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:18:06 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:18:06 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:18:06 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:18:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:18:09 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:18:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:18:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:18:10 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:18:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:18:10 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:18:10 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:18:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:18:13 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:18:13 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:18:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:18:13 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:18:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:18:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:18:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:18:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:18:19 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:18:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 16:18:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:18:20 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:18:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42984530
Mon 20 Jan 2014 16:18:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:18:21 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:18:21 - job_xml_thread(): Done retrieving: data size 42984530
Mon 20 Jan 2014 16:18:21 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:18:21 - XML: Start document: iteration 5
Mon 20 Jan 2014 16:18:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42984530
Mon 20 Jan 2014 16:18:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:18:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:18:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:18:29 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:18:29 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:18:38 - XML: Processed 645908 elements - found 0 jobs
Mon 20 Jan 2014 16:18:38 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:18:38 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:18:38 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:18:38 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:18:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:18:40 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:18:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:18:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:18:41 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:18:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:18:41 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:18:41 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:18:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:18:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:18:45 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:18:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:18:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:18:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:18:45 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:18:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:18:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 16:18:45 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:18:45 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:18:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 16:18:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 3596 values 56858 bits 7107 bytes 
Mon 20 Jan 2014 16:18:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:18:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:18:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:18:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:18:51 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:18:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43515456
Mon 20 Jan 2014 16:18:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:18:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43515456
Mon 20 Jan 2014 16:18:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:18:53 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:18:53 - job_xml_thread(): Done retrieving: data size 43515456
Mon 20 Jan 2014 16:18:53 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:18:53 - XML: Start document: iteration 6
Mon 20 Jan 2014 16:18:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:18:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:19:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:19:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:19:03 - XML: Processed 652605 elements - found 0 jobs
Mon 20 Jan 2014 16:19:03 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:19:03 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:19:03 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:19:03 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:19:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:19:10 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:19:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:19:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:19:11 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:19:11 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:19:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:19:11 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:19:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:19:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:19:16 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:19:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:19:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:19:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:19:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:19:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:19:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:19:17 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:19:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 16:19:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:19:18 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:19:22 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:19:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566548
Mon 20 Jan 2014 16:19:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:19:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566548
Mon 20 Jan 2014 16:19:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:19:22 - job_xml_thread(): Done retrieving: data size 43566548
Mon 20 Jan 2014 16:19:22 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:19:22 - XML: Start document: iteration 7
Mon 20 Jan 2014 16:19:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:19:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:19:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:19:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:19:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:19:38 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:19:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:19:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:19:38 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:19:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:19:38 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:19:38 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:19:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:19:41 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 16:19:41 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:19:41 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:19:41 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:19:41 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:19:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:19:46 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:19:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:19:46 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:19:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:19:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:19:46 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:19:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 16:19:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:19:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 16:19:46 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:19:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5387 values 84960 bits 10620 bytes 
Mon 20 Jan 2014 16:19:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:19:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:19:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:19:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:19:52 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:19:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43554324
Mon 20 Jan 2014 16:19:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:19:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43554324
Mon 20 Jan 2014 16:19:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:19:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:19:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:19:56 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:19:56 - job_xml_thread(): Done retrieving: data size 43554324
Mon 20 Jan 2014 16:19:56 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:19:56 - XML: Start document: iteration 8
Mon 20 Jan 2014 16:20:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:20:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:20:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:20:07 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:20:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:20:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:20:08 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 16:20:08 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:20:08 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:20:08 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:20:08 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:20:09 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:20:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:20:09 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:20:09 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:20:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:20:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:20:15 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:20:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:20:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:20:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:20:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:20:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:20:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:20:15 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:20:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 16:20:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:20:15 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 16:20:15 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 16:20:15 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:20:17 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:20:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565231
Mon 20 Jan 2014 16:20:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:20:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565231
Mon 20 Jan 2014 16:20:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:20:23 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:20:23 - job_xml_thread(): Done retrieving: data size 43565231
Mon 20 Jan 2014 16:20:23 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:20:23 - XML: Start document: iteration 9
Mon 20 Jan 2014 16:20:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:20:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:20:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:20:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:20:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:20:31 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:20:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:20:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:20:33 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:20:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:20:33 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:20:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:20:33 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:20:36 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 16:20:36 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:20:36 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:20:36 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:20:36 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:20:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:20:40 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:20:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:20:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:20:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:20:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:20:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:20:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:20:43 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:20:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43548371
Mon 20 Jan 2014 16:20:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:20:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43548371
Mon 20 Jan 2014 16:20:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:20:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:20:46 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:20:47 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:20:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:20:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 16:20:47 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 16:20:47 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:20:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:20:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:20:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8743 values 137878 bits 17234 bytes 
Mon 20 Jan 2014 16:20:51 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:20:51 - job_xml_thread(): Done retrieving: data size 43548371
Mon 20 Jan 2014 16:20:51 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:20:51 - XML: Start document: iteration 10
Mon 20 Jan 2014 16:20:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:20:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:20:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:20:56 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:20:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:20:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:20:57 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:20:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:20:57 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:20:57 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:20:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:21:05 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 16:21:05 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:21:05 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:21:05 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:21:05 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:21:05 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 16:21:05 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 16:21:05 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:21:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:21:07 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:21:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:21:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:21:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:21:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:21:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:21:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:21:11 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:21:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43546702
Mon 20 Jan 2014 16:21:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:21:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43546702
Mon 20 Jan 2014 16:21:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:21:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:21:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:21:20 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:21:20 - job_xml_thread(): Done retrieving: data size 43546702
Mon 20 Jan 2014 16:21:20 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:21:20 - XML: Start document: iteration 11
Mon 20 Jan 2014 16:21:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:21:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:21:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:21:27 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:21:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:21:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:21:28 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:21:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:21:28 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:21:28 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:21:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:21:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:21:30 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:21:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:21:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:21:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:21:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:21:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:21:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:21:33 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 16:21:33 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:21:33 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:21:33 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:21:33 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:21:33 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:21:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 16:21:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:21:35 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:21:35 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43585676
Mon 20 Jan 2014 16:21:35 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:21:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43585676
Mon 20 Jan 2014 16:21:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:21:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:21:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:21:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:21:45 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:21:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:21:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:21:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:21:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:21:46 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:21:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:21:46 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:21:46 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:21:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:21:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:21:47 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:21:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:21:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 16:21:48 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:21:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 16:21:48 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:21:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5936 values 93637 bits 11704 bytes 
Mon 20 Jan 2014 16:21:48 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:21:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:21:49 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:21:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:21:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:21:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:21:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:21:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:21:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:21:52 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:21:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581743
Mon 20 Jan 2014 16:21:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:21:53 - job_xml_thread(): Done retrieving: data size 43581743
Mon 20 Jan 2014 16:21:53 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:21:53 - XML: Start document: iteration 12
Mon 20 Jan 2014 16:21:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581743
Mon 20 Jan 2014 16:21:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:22:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:22:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:22:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:22:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:22:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:22:09 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:22:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:22:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:22:09 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:22:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:22:09 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:22:09 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:22:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:22:11 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 16:22:11 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:22:11 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:22:11 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:22:11 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 16:22:11 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 16:22:11 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 16:22:14 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 16:22:14 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:22:14 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:22:14 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:22:14 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:22:17 - size of cluster 'LISA Cluster': 624 hosts 79482 metrics 677299 values 10697556 bits 1337194 bytes 
Mon 20 Jan 2014 16:22:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:22:17 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:22:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:22:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:22:17 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:22:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 16:22:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:22:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:22:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:22:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:22:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:22:22 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:22:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568767
Mon 20 Jan 2014 16:22:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:22:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568767
Mon 20 Jan 2014 16:22:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:22:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:22:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:22:29 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:22:29 - job_xml_thread(): Done retrieving: data size 43568767
Mon 20 Jan 2014 16:22:30 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:22:30 - XML: Start document: iteration 13
Mon 20 Jan 2014 16:22:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:22:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:22:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:22:36 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:22:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:22:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:22:36 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:22:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:22:36 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:22:36 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:22:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:22:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:22:44 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:22:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:22:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:22:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:22:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:22:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:22:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:22:45 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 16:22:45 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:22:45 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:22:45 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:22:45 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:22:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:22:48 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:22:48 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:22:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:22:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 16:22:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 16:22:48 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:22:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5748 values 90653 bits 11331 bytes 
Mon 20 Jan 2014 16:22:49 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:22:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562528
Mon 20 Jan 2014 16:22:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:22:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562528
Mon 20 Jan 2014 16:22:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:22:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:22:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:22:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:22:59 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:22:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:22:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:22:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:22:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:23:00 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:23:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:23:00 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:23:00 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:23:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:23:01 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:23:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:23:04 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:23:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:23:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:23:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:23:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:23:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:23:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:23:07 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:23:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43584892
Mon 20 Jan 2014 16:23:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:23:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43584892
Mon 20 Jan 2014 16:23:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:23:08 - job_xml_thread(): Done retrieving: data size 43584892
Mon 20 Jan 2014 16:23:08 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:23:08 - XML: Start document: iteration 14
Mon 20 Jan 2014 16:23:11 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:23:11 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 16:23:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:23:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:23:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:23:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:23:21 - XML: Processed 653352 elements - found 0 jobs
Mon 20 Jan 2014 16:23:21 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:23:21 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:23:21 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:23:21 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:23:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:23:26 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:23:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:23:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:23:27 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:23:27 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:23:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:23:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:23:27 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:23:30 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:23:30 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 16:23:30 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:23:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:23:31 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:23:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:23:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:23:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:23:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:23:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:23:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:23:34 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:23:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43043381
Mon 20 Jan 2014 16:23:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:23:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43043381
Mon 20 Jan 2014 16:23:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:23:36 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:23:36 - job_xml_thread(): Done retrieving: data size 43043381
Mon 20 Jan 2014 16:23:36 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:23:36 - XML: Start document: iteration 15
Mon 20 Jan 2014 16:23:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:23:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:23:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:23:45 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:23:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:23:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:23:47 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:23:47 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:23:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:23:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:23:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:23:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:23:47 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:23:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:23:49 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:23:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:23:50 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:23:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 16:23:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 16:23:51 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:23:51 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6029 values 95090 bits 11886 bytes 
Mon 20 Jan 2014 16:23:52 - XML: Processed 646704 elements - found 0 jobs
Mon 20 Jan 2014 16:23:52 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:23:52 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:23:52 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:23:52 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:23:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:23:56 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:23:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:23:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:23:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:23:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:23:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:23:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:24:01 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:24:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42889712
Mon 20 Jan 2014 16:24:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:24:02 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42889712
Mon 20 Jan 2014 16:24:02 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:24:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:24:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:24:08 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:24:08 - job_xml_thread(): Done retrieving: data size 42889712
Mon 20 Jan 2014 16:24:08 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:24:08 - XML: Start document: iteration 16
Mon 20 Jan 2014 16:24:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:24:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:24:14 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:24:14 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:24:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:24:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:24:15 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:24:15 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:24:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:24:15 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:24:15 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:24:25 - XML: Processed 645272 elements - found 0 jobs
Mon 20 Jan 2014 16:24:25 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:24:25 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:24:25 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:24:25 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:24:25 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:24:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 16:24:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:24:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:24:26 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:24:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:24:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:24:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:24:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:24:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:24:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:24:29 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:24:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42940581
Mon 20 Jan 2014 16:24:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:24:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42940581
Mon 20 Jan 2014 16:24:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:24:30 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:24:30 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:24:40 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:24:40 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:24:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:24:40 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:24:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:24:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:24:40 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:24:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:24:40 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:24:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:24:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:24:42 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:24:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:24:45 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:24:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:24:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:24:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:24:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:24:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:24:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:24:48 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:24:48 - job_xml_thread(): Done retrieving: data size 43481386
Mon 20 Jan 2014 16:24:48 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:24:48 - XML: Start document: iteration 17
Mon 20 Jan 2014 16:24:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43481386
Mon 20 Jan 2014 16:24:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43481386
Mon 20 Jan 2014 16:24:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:24:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:24:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:24:50 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:24:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:24:52 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:24:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 16:24:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 16:24:52 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:24:52 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8989 values 141745 bits 17718 bytes 
Mon 20 Jan 2014 16:24:55 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:24:55 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:25:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:25:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:25:06 - XML: Processed 652228 elements - found 0 jobs
Mon 20 Jan 2014 16:25:06 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:25:06 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:25:06 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:25:06 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:25:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:25:06 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:25:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:25:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:25:06 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:25:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:25:06 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:25:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:25:06 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:25:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:25:12 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:25:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:25:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:25:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:25:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:25:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:25:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:25:17 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:25:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555569
Mon 20 Jan 2014 16:25:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:25:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555569
Mon 20 Jan 2014 16:25:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:25:21 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:25:21 - job_xml_thread(): Done retrieving: data size 43555569
Mon 20 Jan 2014 16:25:21 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:25:21 - XML: Start document: iteration 18
Mon 20 Jan 2014 16:25:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:25:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:25:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:25:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:25:32 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 16:25:32 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:25:32 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:25:32 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:25:32 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:25:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:25:35 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:25:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:25:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:25:36 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:25:36 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:25:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:25:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:25:36 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:25:38 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:25:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 16:25:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:25:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:25:40 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:25:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:25:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:25:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:25:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:25:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:25:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:25:43 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:25:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557481
Mon 20 Jan 2014 16:25:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:25:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557481
Mon 20 Jan 2014 16:25:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:25:47 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:25:47 - job_xml_thread(): Done retrieving: data size 43557481
Mon 20 Jan 2014 16:25:47 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:25:47 - XML: Start document: iteration 19
Mon 20 Jan 2014 16:25:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:25:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:25:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:25:52 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:25:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:25:52 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:25:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 16:25:52 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:25:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 16:25:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5860 values 92422 bits 11552 bytes 
Mon 20 Jan 2014 16:25:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:25:55 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:25:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:25:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:25:56 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:25:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:25:56 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:25:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:25:56 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:25:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:25:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:26:05 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 16:26:05 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:26:05 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:26:05 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:26:05 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:26:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:26:08 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:26:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:26:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:26:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:26:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:26:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:26:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:26:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:26:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:26:11 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:26:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43543341
Mon 20 Jan 2014 16:26:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:26:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43543341
Mon 20 Jan 2014 16:26:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:26:20 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:26:20 - job_xml_thread(): Done retrieving: data size 43543341
Mon 20 Jan 2014 16:26:20 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:26:20 - XML: Start document: iteration 20
Mon 20 Jan 2014 16:26:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:26:24 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:26:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:26:25 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:26:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:26:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:26:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:26:25 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:26:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:26:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:26:30 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:26:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:26:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:26:30 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:26:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:26:30 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:26:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:26:32 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:26:32 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 16:26:32 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:26:33 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 16:26:33 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:26:33 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:26:33 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:26:33 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:26:37 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:26:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569825
Mon 20 Jan 2014 16:26:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:26:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569825
Mon 20 Jan 2014 16:26:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:26:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:26:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:26:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:26:45 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:26:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:26:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:26:46 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:26:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:26:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569825
Mon 20 Jan 2014 16:26:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:26:46 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:26:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:26:48 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:26:48 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:26:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:26:52 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:26:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:26:53 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:26:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 16:26:53 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:26:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 16:26:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5968 values 94127 bits 11765 bytes 
Mon 20 Jan 2014 16:26:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:26:54 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:26:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:26:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:26:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:26:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:26:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:26:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:26:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:26:56 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:26:59 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:26:59 - job_xml_thread(): Done retrieving: data size 43556631
Mon 20 Jan 2014 16:26:59 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:26:59 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 16:26:59 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 16:26:59 - Housekeeping: done.
Mon 20 Jan 2014 16:26:59 - XML: Start document: iteration 0
Mon 20 Jan 2014 16:26:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556631
Mon 20 Jan 2014 16:26:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:27:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:27:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:27:02 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:27:02 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:27:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:27:02 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556631
Mon 20 Jan 2014 16:27:02 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:27:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:27:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:27:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:27:17 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 16:27:17 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:27:17 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:27:17 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:27:17 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:27:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:27:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:27:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:27:20 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:27:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:27:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:27:21 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:27:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:27:21 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:27:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:27:21 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:27:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:27:24 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:27:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:27:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:27:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:27:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:27:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:27:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:27:24 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:27:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 16:27:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:27:27 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:27:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564630
Mon 20 Jan 2014 16:27:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:27:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564630
Mon 20 Jan 2014 16:27:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:27:32 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:27:32 - job_xml_thread(): Done retrieving: data size 43564630
Mon 20 Jan 2014 16:27:32 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:27:32 - XML: Start document: iteration 1
Mon 20 Jan 2014 16:27:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:27:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:27:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:27:38 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:27:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:27:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:27:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:27:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:27:39 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:27:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:27:39 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:27:39 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:27:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:27:47 - XML: Processed 653355 elements - found 0 jobs
Mon 20 Jan 2014 16:27:47 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:27:47 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:27:47 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:27:47 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:27:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:27:51 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:27:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:27:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:27:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:27:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:27:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:27:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:27:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:27:53 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:27:53 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 16:27:53 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 16:27:53 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:27:53 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:27:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562723
Mon 20 Jan 2014 16:27:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:27:53 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:27:53 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 16:27:53 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:27:53 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:27:53 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 16:27:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562723
Mon 20 Jan 2014 16:27:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:27:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:27:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Exception in thread store_metric_thread:
Traceback (most recent call last):
  File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.6/threading.py", line 484, in run
    self.__target(*self.__args, **self.__kwargs)
  File "./jobarchived.py", line 1636, in storeThread
    ret = self.myXMLHandler.storeMetrics()
  File "./jobarchived.py", line 1327, in storeMetrics
    ret = self.rrd_handler.storeMetrics()
  File "./jobarchived.py", line 1997, in storeMetrics
    for dmetric in mymetric:
RuntimeError: deque mutated during iteration

Mon 20 Jan 2014 16:28:02 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:28:02 - job_xml_thread(): Done retrieving: data size 43562723
Mon 20 Jan 2014 16:28:02 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:28:02 - XML: Start document: iteration 2
Mon 20 Jan 2014 16:28:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:28:06 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:28:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:28:06 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:28:06 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:28:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:28:06 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:28:06 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:28:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:28:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:28:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:28:14 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 16:28:14 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:28:14 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:28:14 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:28:14 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:28:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:28:17 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:28:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:28:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:28:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:28:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:28:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:28:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:28:19 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:28:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556499
Mon 20 Jan 2014 16:28:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:28:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556499
Mon 20 Jan 2014 16:28:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:28:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:28:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:28:29 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:28:29 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:28:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:28:31 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:28:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:28:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:28:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:28:33 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:28:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:28:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:28:33 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:28:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:28:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:28:34 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:28:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:28:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:28:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:28:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:28:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:28:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:28:36 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:28:36 - job_xml_thread(): Done retrieving: data size 43588386
Mon 20 Jan 2014 16:28:36 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:28:36 - XML: Start document: iteration 3
Mon 20 Jan 2014 16:28:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43588386
Mon 20 Jan 2014 16:28:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43588386
Mon 20 Jan 2014 16:28:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:28:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:28:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:28:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:28:48 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:28:48 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:28:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:28:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:28:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:28:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:28:50 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:28:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:28:50 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:28:50 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:28:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:28:53 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 16:28:53 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:28:53 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:28:53 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:28:53 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:28:54 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:28:54 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:28:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:28:55 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:28:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 16:28:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 16:28:56 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:28:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 15055 values 237366 bits 29670 bytes 
Mon 20 Jan 2014 16:28:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:28:58 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:28:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:28:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:28:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:28:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:28:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:28:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:29:00 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:29:00 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555995
Mon 20 Jan 2014 16:29:00 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:29:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555995
Mon 20 Jan 2014 16:29:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:29:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:29:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:29:08 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:29:08 - job_xml_thread(): Done retrieving: data size 43555995
Mon 20 Jan 2014 16:29:08 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:29:08 - XML: Start document: iteration 4
Mon 20 Jan 2014 16:29:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:29:11 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:29:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:29:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:29:12 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 16:29:12 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:29:12 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:29:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:29:12 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:29:12 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:29:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:29:13 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:29:13 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 16:29:13 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 16:29:13 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:29:13 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 16:29:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:29:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:29:18 - size of cluster 'LISA Cluster': 624 hosts 79474 metrics 654178 values 10320933 bits 1290116 bytes 
Mon 20 Jan 2014 16:29:19 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 16:29:19 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:29:19 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:29:19 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:29:19 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:29:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:29:23 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:29:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:29:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:29:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:29:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:29:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:29:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:29:24 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:29:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 16:29:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:29:26 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:29:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43476659
Mon 20 Jan 2014 16:29:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:29:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43476659
Mon 20 Jan 2014 16:29:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:29:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:29:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:29:34 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:29:34 - job_xml_thread(): Done retrieving: data size 43476659
Mon 20 Jan 2014 16:29:34 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:29:34 - XML: Start document: iteration 5
Mon 20 Jan 2014 16:29:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:29:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:29:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:29:41 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:29:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:29:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:29:41 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:29:41 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:29:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:29:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:29:41 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:29:46 - XML: Processed 652608 elements - found 0 jobs
Mon 20 Jan 2014 16:29:46 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:29:46 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:29:46 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:29:46 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:29:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:29:48 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:29:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:29:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:29:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:29:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:29:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:29:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:29:52 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:29:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42962673
Mon 20 Jan 2014 16:29:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:29:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42962673
Mon 20 Jan 2014 16:29:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:29:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:29:55 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:29:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:29:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 16:29:56 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:29:56 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:29:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 16:29:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:29:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:29:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8639 values 136124 bits 17015 bytes 
Mon 20 Jan 2014 16:30:01 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:30:01 - job_xml_thread(): Done retrieving: data size 42962673
Mon 20 Jan 2014 16:30:01 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:30:01 - XML: Start document: iteration 6
Mon 20 Jan 2014 16:30:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:30:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:30:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:30:04 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:30:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:30:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:30:05 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:30:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:30:05 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:30:05 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:30:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:30:13 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:30:13 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 16:30:14 - XML: Processed 645753 elements - found 0 jobs
Mon 20 Jan 2014 16:30:14 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:30:14 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:30:14 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:30:14 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:30:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:30:16 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:30:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:30:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:30:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:30:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:30:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:30:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:30:20 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:30:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42955777
Mon 20 Jan 2014 16:30:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:30:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42955777
Mon 20 Jan 2014 16:30:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:30:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:30:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:30:29 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:30:29 - job_xml_thread(): Done retrieving: data size 42955777
Mon 20 Jan 2014 16:30:29 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:30:29 - XML: Start document: iteration 7
Mon 20 Jan 2014 16:30:30 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:30:30 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:30:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:30:30 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:30:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:30:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:30:31 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:30:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:30:31 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:30:31 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:30:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:30:40 - XML: Processed 645908 elements - found 0 jobs
Mon 20 Jan 2014 16:30:40 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:30:40 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:30:40 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:30:40 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:30:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:30:44 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:30:44 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:30:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 16:30:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:30:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:30:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:30:45 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:30:45 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:30:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:30:45 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:30:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:30:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:30:47 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:30:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43487779
Mon 20 Jan 2014 16:30:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:30:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43487779
Mon 20 Jan 2014 16:30:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:30:56 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:30:56 - job_xml_thread(): Done retrieving: data size 43487779
Mon 20 Jan 2014 16:30:56 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:30:56 - XML: Start document: iteration 8
Mon 20 Jan 2014 16:30:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:30:56 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:30:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:30:57 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:30:57 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 16:30:57 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:30:57 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:30:57 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 16:30:57 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:30:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:30:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:30:57 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5710 values 89986 bits 11248 bytes 
Mon 20 Jan 2014 16:30:58 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:30:58 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:30:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:30:58 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:30:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:31:00 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:31:00 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:31:08 - XML: Processed 652724 elements - found 0 jobs
Mon 20 Jan 2014 16:31:08 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:31:08 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:31:08 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:31:08 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:31:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:31:09 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:31:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:31:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:31:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:31:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:31:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:31:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:31:13 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:31:13 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43533452
Mon 20 Jan 2014 16:31:13 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:31:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43533452
Mon 20 Jan 2014 16:31:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:31:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:31:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:31:22 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:31:22 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 16:31:22 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:31:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:31:22 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:31:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:31:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:31:23 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:31:23 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:31:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:31:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:31:23 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:31:23 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:31:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:31:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:31:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:31:27 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:31:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:31:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:31:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:31:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:31:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:31:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:31:30 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:31:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561955
Mon 20 Jan 2014 16:31:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:31:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561955
Mon 20 Jan 2014 16:31:31 - job_xml_thread(): Done retrieving: data size 43561955
Mon 20 Jan 2014 16:31:31 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:31:31 - XML: Start document: iteration 9
Mon 20 Jan 2014 16:31:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:31:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:31:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:31:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:31:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:31:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:31:45 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:31:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:31:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:31:47 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:31:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:31:47 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:31:47 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:31:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:31:51 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 16:31:51 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:31:51 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:31:51 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:31:51 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:31:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:31:54 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:31:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:31:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:31:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:31:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:31:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:31:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:31:57 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:31:57 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:31:57 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:31:57 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43548213
Mon 20 Jan 2014 16:31:57 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:31:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43548213
Mon 20 Jan 2014 16:31:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:31:58 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:31:58 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:31:58 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 16:31:58 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 16:31:58 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:31:58 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6072 values 95909 bits 11988 bytes 
Mon 20 Jan 2014 16:32:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:32:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:32:06 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:32:06 - job_xml_thread(): Done retrieving: data size 43548213
Mon 20 Jan 2014 16:32:06 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:32:06 - XML: Start document: iteration 10
Mon 20 Jan 2014 16:32:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:32:09 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:32:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:32:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:32:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:32:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:32:10 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:32:10 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:32:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:32:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:32:10 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:32:17 - XML: Processed 653351 elements - found 0 jobs
Mon 20 Jan 2014 16:32:17 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:32:17 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:32:17 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:32:17 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:32:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:32:21 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:32:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:32:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:32:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:32:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:32:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:32:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:32:25 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:32:25 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 16:32:25 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:32:25 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:32:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557280
Mon 20 Jan 2014 16:32:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:32:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:32:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:32:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557280
Mon 20 Jan 2014 16:32:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:32:33 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:32:33 - job_xml_thread(): Done retrieving: data size 43557280
Mon 20 Jan 2014 16:32:33 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:32:33 - XML: Start document: iteration 11
Mon 20 Jan 2014 16:32:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:32:35 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:32:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:32:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:32:36 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:32:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:32:36 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:32:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:32:36 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:32:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:32:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:32:45 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 16:32:45 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:32:45 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:32:45 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:32:45 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:32:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:32:48 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:32:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:32:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:32:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:32:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:32:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:32:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:32:51 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:32:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559993
Mon 20 Jan 2014 16:32:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:32:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559993
Mon 20 Jan 2014 16:32:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:32:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:32:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:32:58 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:32:58 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:32:59 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:32:59 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:32:59 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 16:33:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 16:33:00 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:33:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99413 bits 12426 bytes 
Mon 20 Jan 2014 16:33:00 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:33:00 - job_xml_thread(): Done retrieving: data size 43559993
Mon 20 Jan 2014 16:33:00 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:33:00 - XML: Start document: iteration 12
Mon 20 Jan 2014 16:33:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:33:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:33:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:33:05 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:33:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:33:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:33:06 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:33:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:33:06 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:33:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:33:06 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:33:13 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 16:33:13 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:33:13 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:33:13 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:33:13 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:33:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:33:15 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:33:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:33:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:33:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:33:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:33:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:33:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:33:18 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:33:18 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564249
Mon 20 Jan 2014 16:33:18 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:33:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564249
Mon 20 Jan 2014 16:33:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:33:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:33:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:33:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:33:27 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:33:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:33:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:33:28 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:33:28 - job_xml_thread(): Done retrieving: data size 43564249
Mon 20 Jan 2014 16:33:28 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:33:28 - XML: Start document: iteration 13
Mon 20 Jan 2014 16:33:28 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:33:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:33:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564249
Mon 20 Jan 2014 16:33:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:33:28 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:33:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:33:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:33:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:33:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:33:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:33:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:33:45 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:33:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:33:45 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:33:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:33:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:33:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:33:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:33:45 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:33:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:33:45 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:33:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:33:45 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:33:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:33:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:33:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:33:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:33:46 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:33:46 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 16:33:46 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:33:48 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 16:33:48 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:33:48 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:33:48 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:33:48 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:33:50 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 16:33:50 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 16:33:50 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:33:51 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:33:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43592759
Mon 20 Jan 2014 16:33:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:33:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43592759
Mon 20 Jan 2014 16:33:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:33:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:33:59 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:34:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:34:00 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:34:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:34:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:34:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:34:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:34:01 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:34:01 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:34:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:34:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:34:01 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:34:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:34:01 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:34:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 16:34:01 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:34:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 16:34:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5898 values 93144 bits 11643 bytes 
Mon 20 Jan 2014 16:34:03 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:34:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:34:05 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:34:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:34:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:34:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:34:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:34:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:34:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:34:07 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:34:07 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582264
Mon 20 Jan 2014 16:34:07 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:34:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582264
Mon 20 Jan 2014 16:34:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:34:08 - job_xml_thread(): Done retrieving: data size 43582264
Mon 20 Jan 2014 16:34:08 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:34:08 - XML: Start document: iteration 14
Mon 20 Jan 2014 16:34:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:34:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:34:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:34:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:34:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:34:26 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:34:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:34:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:34:26 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:34:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:34:26 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:34:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:34:27 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:34:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:34:29 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:34:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:34:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:34:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:34:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:34:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:34:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:34:31 - XML: Processed 653354 elements - found 0 jobs
Mon 20 Jan 2014 16:34:31 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:34:31 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:34:31 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:34:31 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:34:31 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:34:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 16:34:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:34:32 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:34:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582865
Mon 20 Jan 2014 16:34:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:34:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582865
Mon 20 Jan 2014 16:34:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:34:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:34:41 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:34:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:34:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:34:42 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:34:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:34:42 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:34:42 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:34:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:34:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:34:46 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:34:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:34:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:34:46 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:34:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:34:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:34:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:34:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:34:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:34:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:34:48 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:34:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43583797
Mon 20 Jan 2014 16:34:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:34:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43583797
Mon 20 Jan 2014 16:34:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:34:49 - job_xml_thread(): Done retrieving: data size 43583797
Mon 20 Jan 2014 16:34:49 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:34:50 - XML: Start document: iteration 15
Mon 20 Jan 2014 16:34:58 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:34:58 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:35:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:35:01 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:35:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:35:01 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:35:01 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:35:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:35:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:35:02 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:35:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:35:02 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 16:35:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:35:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 16:35:03 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:35:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9189 values 144986 bits 18123 bytes 
Mon 20 Jan 2014 16:35:03 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:35:03 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:35:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:35:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:35:04 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:35:06 - XML: Processed 653356 elements - found 0 jobs
Mon 20 Jan 2014 16:35:06 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:35:06 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:35:06 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:35:06 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:35:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:35:09 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:35:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:35:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:35:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:35:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:35:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:35:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:35:12 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:35:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43492994
Mon 20 Jan 2014 16:35:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:35:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43492994
Mon 20 Jan 2014 16:35:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:35:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:35:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:35:21 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:35:21 - job_xml_thread(): Done retrieving: data size 43492994
Mon 20 Jan 2014 16:35:21 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:35:21 - XML: Start document: iteration 16
Mon 20 Jan 2014 16:35:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:35:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:35:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:35:27 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:35:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:35:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:35:28 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:35:28 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:35:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:35:28 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:35:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:35:35 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:35:35 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:35:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:35:35 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:35:36 - XML: Processed 652680 elements - found 0 jobs
Mon 20 Jan 2014 16:35:36 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:35:36 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:35:36 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:35:36 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:35:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:35:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:35:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:35:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:35:36 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:35:36 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 16:35:36 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:35:38 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:35:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42987932
Mon 20 Jan 2014 16:35:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:35:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42987932
Mon 20 Jan 2014 16:35:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:35:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:35:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:35:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:35:50 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:35:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:35:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:35:51 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:35:51 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:35:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:35:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:35:51 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:35:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:35:51 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:35:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:35:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:35:52 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:35:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:35:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:35:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:35:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:35:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:35:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:35:54 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:35:54 - job_xml_thread(): Done retrieving: data size 42914368
Mon 20 Jan 2014 16:35:54 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:35:54 - XML: Start document: iteration 17
Mon 20 Jan 2014 16:35:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42914368
Mon 20 Jan 2014 16:35:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42914368
Mon 20 Jan 2014 16:35:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:35:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:36:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:36:03 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:36:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:36:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 16:36:03 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:36:03 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:36:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 16:36:04 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8758 values 138196 bits 17274 bytes 
Mon 20 Jan 2014 16:36:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:36:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:36:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:36:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:36:11 - XML: Processed 645188 elements - found 0 jobs
Mon 20 Jan 2014 16:36:11 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:36:11 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:36:11 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:36:11 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:36:14 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 16:36:14 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:36:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:36:15 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:36:15 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:36:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:36:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:36:15 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:36:15 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 16:36:15 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 16:36:15 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 16:36:15 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:36:15 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:36:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:36:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:36:16 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:36:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:36:19 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:36:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:36:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:36:19 - size of cluster 'LISA Cluster': 624 hosts 79487 metrics 779936 values 12326847 bits 1540855 bytes 
Mon 20 Jan 2014 16:36:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:36:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:36:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:36:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:36:23 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:36:23 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42985413
Mon 20 Jan 2014 16:36:23 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:36:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42985413
Mon 20 Jan 2014 16:36:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:36:26 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:36:26 - job_xml_thread(): Done retrieving: data size 42985413
Mon 20 Jan 2014 16:36:26 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:36:26 - XML: Start document: iteration 18
Mon 20 Jan 2014 16:36:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:36:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:36:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:36:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:36:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:36:38 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:36:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:36:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:36:39 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:36:39 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:36:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:36:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:36:39 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:36:42 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:36:42 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 16:36:42 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:36:42 - XML: Processed 645908 elements - found 0 jobs
Mon 20 Jan 2014 16:36:42 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:36:42 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:36:42 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:36:42 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:36:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:36:46 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:36:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:36:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:36:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:36:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:36:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:36:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:36:50 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:36:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43483571
Mon 20 Jan 2014 16:36:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:36:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43483571
Mon 20 Jan 2014 16:36:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:36:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:36:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:36:58 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:36:58 - job_xml_thread(): Done retrieving: data size 43483571
Mon 20 Jan 2014 16:36:58 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:36:58 - XML: Start document: iteration 19
Mon 20 Jan 2014 16:37:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:37:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:37:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:37:03 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:37:04 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:37:04 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:37:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:37:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:37:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:37:06 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:37:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 16:37:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 16:37:06 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:37:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5938 values 93711 bits 11713 bytes 
Mon 20 Jan 2014 16:37:07 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:37:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:37:07 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:37:07 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:37:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:37:09 - XML: Processed 652278 elements - found 0 jobs
Mon 20 Jan 2014 16:37:09 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:37:09 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:37:09 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:37:09 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:37:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:37:12 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:37:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:37:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:37:13 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:37:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:37:13 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:37:13 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:37:15 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:37:15 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 16:37:17 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:37:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564065
Mon 20 Jan 2014 16:37:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:37:18 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564065
Mon 20 Jan 2014 16:37:18 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:37:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:37:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:37:24 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:37:24 - job_xml_thread(): Done retrieving: data size 43564065
Mon 20 Jan 2014 16:37:24 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:37:24 - XML: Start document: iteration 20
Mon 20 Jan 2014 16:37:28 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:37:28 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:37:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:37:28 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:37:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:37:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:37:29 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:37:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:37:30 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:37:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:37:30 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:37:34 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:37:34 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 16:37:34 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:37:40 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 16:37:40 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:37:40 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:37:40 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:37:40 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:37:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:37:40 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:37:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:37:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:37:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:37:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:37:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:37:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:37:44 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:37:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43540701
Mon 20 Jan 2014 16:37:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:37:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43540701
Mon 20 Jan 2014 16:37:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:37:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:37:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:37:55 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:37:55 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:37:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:37:56 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:37:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:37:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:37:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:37:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:37:57 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:37:57 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:37:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:37:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:37:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:37:59 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:37:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:37:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:37:59 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:37:59 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:37:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:37:59 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:38:02 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:38:02 - job_xml_thread(): Done retrieving: data size 43574579
Mon 20 Jan 2014 16:38:02 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:38:02 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 16:38:02 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 16:38:02 - Housekeeping: done.
Mon 20 Jan 2014 16:38:02 - XML: Start document: iteration 0
Mon 20 Jan 2014 16:38:03 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574579
Mon 20 Jan 2014 16:38:03 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:38:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574579
Mon 20 Jan 2014 16:38:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:38:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:38:06 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:38:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:38:10 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:38:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 16:38:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 16:38:11 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:38:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:38:12 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:38:12 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9247 values 145945 bits 18243 bytes 
Mon 20 Jan 2014 16:38:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:38:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:38:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:38:16 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:38:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:38:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:38:17 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:38:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:38:18 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:38:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:38:19 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:38:22 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 16:38:22 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:38:22 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:38:22 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:38:22 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:38:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:38:26 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:38:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:38:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:38:27 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:38:27 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:38:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:38:27 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:38:30 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:38:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558547
Mon 20 Jan 2014 16:38:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:38:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558547
Mon 20 Jan 2014 16:38:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:38:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:38:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:38:37 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:38:37 - job_xml_thread(): Done retrieving: data size 43558547
Mon 20 Jan 2014 16:38:38 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:38:38 - XML: Start document: iteration 1
Mon 20 Jan 2014 16:38:42 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:38:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:38:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:38:45 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:38:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:38:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:38:47 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:38:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:38:47 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:38:47 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:38:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:38:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:38:52 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:38:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:38:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:38:53 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:38:53 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:38:53 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:38:53 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:38:55 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 16:38:55 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:38:55 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:38:55 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:38:55 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:38:55 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:38:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 16:38:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:38:58 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:38:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557462
Mon 20 Jan 2014 16:38:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:38:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557462
Mon 20 Jan 2014 16:38:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:39:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:39:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:39:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:39:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:39:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:39:08 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:39:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:39:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:39:10 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:39:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:39:10 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:39:10 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:39:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:39:10 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:39:10 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:39:10 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:39:10 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:39:10 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 16:39:10 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:39:10 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5588 values 88101 bits 11012 bytes 
Mon 20 Jan 2014 16:39:10 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:39:10 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 16:39:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:39:14 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:39:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:39:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:39:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:39:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:39:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:39:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:39:21 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:39:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43580290
Mon 20 Jan 2014 16:39:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:39:22 - job_xml_thread(): Done retrieving: data size 43580290
Mon 20 Jan 2014 16:39:22 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:39:22 - XML: Start document: iteration 2
Mon 20 Jan 2014 16:39:22 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43580290
Mon 20 Jan 2014 16:39:22 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:39:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:39:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:39:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:39:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:39:36 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 16:39:36 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:39:36 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:39:37 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:39:37 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:39:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:39:40 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:39:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:39:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:39:41 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:39:41 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:39:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:39:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:39:41 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:39:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:39:44 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:39:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:39:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:39:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:39:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:39:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:39:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:39:44 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:39:44 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 16:39:44 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:39:47 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:39:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43585990
Mon 20 Jan 2014 16:39:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:39:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43585990
Mon 20 Jan 2014 16:39:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:39:53 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:39:53 - job_xml_thread(): Done retrieving: data size 43585990
Mon 20 Jan 2014 16:39:53 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:39:53 - XML: Start document: iteration 3
Mon 20 Jan 2014 16:39:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:39:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:39:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:39:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:40:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:40:01 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:40:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:40:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:40:02 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:40:02 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:40:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:40:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:40:02 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:40:10 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 16:40:10 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:40:10 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:40:10 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:40:10 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:40:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:40:10 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:40:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:40:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:40:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:40:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:40:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:40:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:40:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:40:11 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:40:11 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:40:11 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 16:40:11 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:40:11 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:40:11 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 16:40:11 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5737 values 90499 bits 11312 bytes 
Mon 20 Jan 2014 16:40:14 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:40:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43548623
Mon 20 Jan 2014 16:40:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:40:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43548623
Mon 20 Jan 2014 16:40:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:40:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:40:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:40:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:40:24 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:40:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:40:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:40:25 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:40:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:40:25 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:40:25 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:40:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:40:25 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:40:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:40:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:40:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:40:29 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:40:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:40:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:40:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:40:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:40:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:40:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:40:31 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:40:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 16:40:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:40:33 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:40:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577599
Mon 20 Jan 2014 16:40:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:40:33 - job_xml_thread(): Done retrieving: data size 43577599
Mon 20 Jan 2014 16:40:33 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:40:33 - XML: Start document: iteration 4
Mon 20 Jan 2014 16:40:34 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577599
Mon 20 Jan 2014 16:40:34 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:40:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:40:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:40:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:40:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:40:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:40:47 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:40:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:40:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:40:48 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:40:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:40:48 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:40:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:40:48 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:40:58 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 16:40:58 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:40:58 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:40:58 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:40:58 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:40:58 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:40:58 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:40:58 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:40:58 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:40:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:40:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:40:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:40:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:41:01 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 16:41:01 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 16:41:01 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:41:01 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:41:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558339
Mon 20 Jan 2014 16:41:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:41:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558339
Mon 20 Jan 2014 16:41:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:41:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:41:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:41:11 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:41:11 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:41:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:41:13 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:41:13 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:41:13 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 16:41:13 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:41:13 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:41:13 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:41:13 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:41:13 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 16:41:13 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:41:13 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:41:13 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8026 values 126611 bits 15826 bytes 
Mon 20 Jan 2014 16:41:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:41:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:41:14 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:41:14 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:41:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:41:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:41:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:41:16 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:41:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:41:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:41:17 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:41:17 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:41:17 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:41:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:41:18 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:41:18 - job_xml_thread(): Done retrieving: data size 43529944
Mon 20 Jan 2014 16:41:18 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:41:18 - XML: Start document: iteration 5
Mon 20 Jan 2014 16:41:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43529944
Mon 20 Jan 2014 16:41:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:41:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43529944
Mon 20 Jan 2014 16:41:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:41:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:41:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:41:32 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:41:32 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:41:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:41:33 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:41:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:41:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:41:35 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:41:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:41:35 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:41:35 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:41:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:41:39 - XML: Processed 652608 elements - found 0 jobs
Mon 20 Jan 2014 16:41:39 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:41:39 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:41:39 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:41:39 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:41:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:41:40 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:41:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:41:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:41:40 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:41:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 16:41:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:41:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:41:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:41:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:41:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:41:42 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:41:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42997272
Mon 20 Jan 2014 16:41:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:41:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42997272
Mon 20 Jan 2014 16:41:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:41:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:41:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:41:54 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:41:54 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:41:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:41:54 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:41:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:41:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:41:55 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:41:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:41:55 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:41:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:41:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:41:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:41:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:41:57 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:41:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:41:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:41:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:41:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:41:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:41:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:41:59 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:41:59 - job_xml_thread(): Done retrieving: data size 42919343
Mon 20 Jan 2014 16:41:59 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:41:59 - XML: Start document: iteration 6
Mon 20 Jan 2014 16:41:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42919343
Mon 20 Jan 2014 16:41:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:41:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42919343
Mon 20 Jan 2014 16:42:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:42:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:42:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:42:11 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:42:11 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:42:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:42:11 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:42:12 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:42:12 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:42:12 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:42:13 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:42:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:42:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:42:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:42:13 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:42:13 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:42:14 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:42:14 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:42:14 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 16:42:14 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:42:14 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 16:42:15 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9196 values 145086 bits 18135 bytes 
Mon 20 Jan 2014 16:42:20 - XML: Processed 645158 elements - found 0 jobs
Mon 20 Jan 2014 16:42:20 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:42:20 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:42:20 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:42:20 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:42:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:42:22 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:42:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:42:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:42:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:42:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:42:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:42:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:42:24 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:42:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42950736
Mon 20 Jan 2014 16:42:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:42:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42950736
Mon 20 Jan 2014 16:42:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:42:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:42:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:42:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:42:35 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:42:36 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:42:36 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:42:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:42:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:42:37 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:42:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:42:37 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:42:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:42:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:42:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:42:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:42:39 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:42:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:42:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:42:39 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:42:39 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 16:42:39 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:42:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:42:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:42:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:42:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:42:41 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:42:41 - job_xml_thread(): Done retrieving: data size 43499193
Mon 20 Jan 2014 16:42:41 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:42:41 - XML: Start document: iteration 7
Mon 20 Jan 2014 16:42:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43499193
Mon 20 Jan 2014 16:42:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:42:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43499193
Mon 20 Jan 2014 16:42:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:42:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:42:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:42:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:42:53 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:42:53 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:42:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:42:54 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:42:54 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:42:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:42:54 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:42:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:42:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:42:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:43:03 - XML: Processed 652498 elements - found 0 jobs
Mon 20 Jan 2014 16:43:03 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:43:03 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:43:03 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:43:03 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:43:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:43:04 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:43:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:43:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:43:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:43:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:43:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:43:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:43:06 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:43:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559632
Mon 20 Jan 2014 16:43:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:43:07 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559632
Mon 20 Jan 2014 16:43:07 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:43:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:43:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:43:14 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:43:15 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:43:16 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 16:43:16 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:43:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:43:16 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:43:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:43:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:43:17 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:43:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 16:43:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:43:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 16:43:17 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:43:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9147 values 144293 bits 18036 bytes 
Mon 20 Jan 2014 16:43:18 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:43:18 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:43:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:43:18 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:43:18 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 16:43:18 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 16:43:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:43:18 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:43:18 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:43:18 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 16:43:18 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:43:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:43:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:43:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:43:20 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:43:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:43:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:43:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:43:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:43:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:43:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:43:21 - size of cluster 'LISA Cluster': 624 hosts 79489 metrics 824484 values 13013181 bits 1626647 bytes 
Mon 20 Jan 2014 16:43:24 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:43:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43557054
Mon 20 Jan 2014 16:43:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:43:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43557054
Mon 20 Jan 2014 16:43:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:43:25 - job_xml_thread(): Done retrieving: data size 43557054
Mon 20 Jan 2014 16:43:25 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:43:25 - XML: Start document: iteration 8
Mon 20 Jan 2014 16:43:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:43:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:43:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:43:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:43:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:43:41 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:43:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:43:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:43:42 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:43:42 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:43:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:43:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:43:42 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:43:44 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 16:43:44 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:43:44 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:43:44 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:43:44 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:43:49 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:43:49 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:43:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:43:49 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:43:49 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:43:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 16:43:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:43:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:43:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:43:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:43:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:43:52 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:43:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566150
Mon 20 Jan 2014 16:43:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:43:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566150
Mon 20 Jan 2014 16:43:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:43:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:43:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:43:59 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:43:59 - job_xml_thread(): Done retrieving: data size 43566150
Mon 20 Jan 2014 16:43:59 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:43:59 - XML: Start document: iteration 9
Mon 20 Jan 2014 16:44:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:44:03 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:44:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:44:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:44:04 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:44:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:44:04 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:44:04 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:44:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:44:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:44:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:44:15 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:44:15 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:44:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:44:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:44:16 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 16:44:16 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:44:16 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:44:16 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:44:16 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:44:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:44:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:44:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:44:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:44:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:44:17 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:44:17 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:44:17 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 16:44:17 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:44:17 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 16:44:17 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:44:17 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5592 values 88143 bits 11017 bytes 
Mon 20 Jan 2014 16:44:18 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:44:18 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 16:44:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:44:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:44:19 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:44:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556713
Mon 20 Jan 2014 16:44:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:44:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556713
Mon 20 Jan 2014 16:44:20 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:44:31 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:44:31 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:44:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:44:31 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:44:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:44:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:44:31 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:44:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:44:31 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:44:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:44:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:44:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:44:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:44:36 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:44:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:44:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:44:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:44:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:44:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:44:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:44:38 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:44:38 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 16:44:38 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:44:40 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:44:40 - job_xml_thread(): Done retrieving: data size 43556577
Mon 20 Jan 2014 16:44:40 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:44:40 - XML: Start document: iteration 10
Mon 20 Jan 2014 16:44:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43556577
Mon 20 Jan 2014 16:44:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:44:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43556577
Mon 20 Jan 2014 16:44:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:44:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:44:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:44:52 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:44:52 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:44:55 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 16:44:55 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:44:55 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:44:55 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:44:55 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:44:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:44:58 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:44:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:44:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:45:00 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:45:00 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:45:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:45:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:45:00 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:45:03 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:45:03 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:45:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:45:03 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:45:03 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:45:03 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:45:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:45:03 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:45:06 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:45:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43589584
Mon 20 Jan 2014 16:45:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:45:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43589584
Mon 20 Jan 2014 16:45:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:45:11 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:45:11 - job_xml_thread(): Done retrieving: data size 43589584
Mon 20 Jan 2014 16:45:11 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:45:11 - XML: Start document: iteration 11
Mon 20 Jan 2014 16:45:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:45:15 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:45:17 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:45:17 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:45:18 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:45:18 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:45:18 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 16:45:18 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 16:45:18 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:45:18 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:45:18 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:45:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 7772 values 122541 bits 15317 bytes 
Mon 20 Jan 2014 16:45:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:45:20 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:45:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:45:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:45:21 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:45:21 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:45:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:45:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:45:21 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:45:26 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 16:45:26 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:45:26 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:45:26 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:45:26 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:45:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:45:30 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:45:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:45:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:45:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:45:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:45:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:45:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:45:33 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:45:33 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564155
Mon 20 Jan 2014 16:45:33 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:45:33 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43564155
Mon 20 Jan 2014 16:45:33 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:45:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:45:36 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:45:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:45:41 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:45:41 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:45:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:45:41 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:45:41 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:45:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:45:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:45:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43564155
Mon 20 Jan 2014 16:45:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:45:41 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:45:41 - job_xml_thread(): Done retrieving: data size 43564155
Mon 20 Jan 2014 16:45:42 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:45:42 - XML: Start document: iteration 12
Mon 20 Jan 2014 16:45:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:45:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:45:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:45:51 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:45:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:45:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:45:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:45:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:45:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:45:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:45:52 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:45:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:45:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:45:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:45:57 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:45:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:45:57 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:45:58 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:45:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:45:58 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:45:58 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:45:59 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:45:59 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 16:45:59 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:46:02 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 16:46:02 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:46:02 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:46:02 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:46:02 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:46:05 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:46:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565537
Mon 20 Jan 2014 16:46:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:46:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565537
Mon 20 Jan 2014 16:46:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:46:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:46:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:46:13 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:46:13 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:46:17 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:46:17 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:46:18 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:46:18 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:46:19 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:46:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:46:19 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:46:19 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 16:46:19 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:46:19 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 16:46:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:46:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:46:19 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:46:19 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5943 values 93844 bits 11730 bytes 
Mon 20 Jan 2014 16:46:20 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:46:20 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:46:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:46:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:46:21 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:46:21 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:46:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:46:21 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:46:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:46:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:46:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:46:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:46:25 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:46:25 - job_xml_thread(): Done retrieving: data size 43561865
Mon 20 Jan 2014 16:46:25 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:46:25 - XML: Start document: iteration 13
Mon 20 Jan 2014 16:46:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561865
Mon 20 Jan 2014 16:46:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:46:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561865
Mon 20 Jan 2014 16:46:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:46:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:46:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:46:37 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:46:37 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:46:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:46:39 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:46:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:46:39 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:46:40 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:46:40 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:46:40 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:46:40 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:46:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:46:46 - XML: Processed 653357 elements - found 0 jobs
Mon 20 Jan 2014 16:46:46 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:46:46 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:46:46 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:46:46 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:46:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:46:50 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:46:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:46:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:46:50 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:46:50 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 16:46:50 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:46:50 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:46:50 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:46:50 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:46:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:46:53 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:46:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553995
Mon 20 Jan 2014 16:46:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:46:53 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553995
Mon 20 Jan 2014 16:46:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:46:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:46:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:47:01 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:47:01 - job_xml_thread(): Done retrieving: data size 43553995
Mon 20 Jan 2014 16:47:01 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:47:02 - XML: Start document: iteration 14
Mon 20 Jan 2014 16:47:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:47:04 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:47:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:47:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:47:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:47:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:47:06 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:47:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:47:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:47:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:47:10 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:47:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:47:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:47:11 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:47:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:47:11 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:47:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:47:13 - XML: Processed 653356 elements - found 0 jobs
Mon 20 Jan 2014 16:47:13 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:47:13 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:47:13 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:47:13 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:47:19 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:47:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43503748
Mon 20 Jan 2014 16:47:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:47:19 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:47:20 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:47:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43503748
Mon 20 Jan 2014 16:47:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:47:21 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:47:21 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:47:21 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 16:47:21 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:47:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:47:21 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 16:47:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:47:21 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5759 values 90964 bits 11370 bytes 
Mon 20 Jan 2014 16:47:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:47:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:47:28 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:47:28 - job_xml_thread(): Done retrieving: data size 43503748
Mon 20 Jan 2014 16:47:28 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:47:29 - XML: Start document: iteration 15
Mon 20 Jan 2014 16:47:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:47:33 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:47:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:47:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:47:35 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:47:35 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:47:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:47:35 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:47:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:47:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:47:42 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:47:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:47:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:47:43 - XML: Processed 652608 elements - found 0 jobs
Mon 20 Jan 2014 16:47:43 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:47:43 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:47:43 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:47:43 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:47:43 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:47:43 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:47:43 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:47:43 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:47:47 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:47:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42968330
Mon 20 Jan 2014 16:47:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:47:48 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42968330
Mon 20 Jan 2014 16:47:48 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:47:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:47:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:47:52 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:47:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 16:47:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:47:58 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:47:58 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:47:58 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:47:58 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:47:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:47:59 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:47:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:47:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:48:00 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:48:00 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:48:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:48:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:48:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:48:04 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:48:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:48:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:48:04 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 16:48:04 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 16:48:04 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:48:04 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:48:04 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:48:04 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:48:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:48:05 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:48:05 - job_xml_thread(): Done retrieving: data size 42924126
Mon 20 Jan 2014 16:48:05 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:48:05 - XML: Start document: iteration 16
Mon 20 Jan 2014 16:48:06 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42924126
Mon 20 Jan 2014 16:48:06 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:48:06 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42924126
Mon 20 Jan 2014 16:48:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:48:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:48:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:48:19 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:48:19 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:48:20 - XML: Processed 645319 elements - found 0 jobs
Mon 20 Jan 2014 16:48:20 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:48:20 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:48:21 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:48:21 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:48:22 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:48:22 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:48:23 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:48:23 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 16:48:23 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:48:23 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:48:23 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 16:48:23 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6255 values 98900 bits 12362 bytes 
Mon 20 Jan 2014 16:48:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:48:25 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:48:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:48:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:48:26 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:48:27 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:48:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:48:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:48:27 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:48:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:48:27 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:48:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:48:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:48:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:48:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:48:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:48:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:48:30 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:48:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42998020
Mon 20 Jan 2014 16:48:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:48:30 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42998020
Mon 20 Jan 2014 16:48:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:48:36 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:48:36 - job_xml_thread(): Done retrieving: data size 42998020
Mon 20 Jan 2014 16:48:36 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:48:36 - XML: Start document: iteration 17
Mon 20 Jan 2014 16:48:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:48:41 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:48:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:48:42 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:48:42 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:48:42 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:48:42 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:48:42 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:48:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:48:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:48:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:48:50 - XML: Processed 645908 elements - found 0 jobs
Mon 20 Jan 2014 16:48:50 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:48:50 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:48:50 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:48:50 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:48:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:48:52 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:48:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:48:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:48:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:48:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:48:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:48:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:48:52 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:48:52 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 16:48:52 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:48:54 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:48:54 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43522232
Mon 20 Jan 2014 16:48:54 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:48:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43522232
Mon 20 Jan 2014 16:48:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:48:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:48:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:49:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:49:05 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:49:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:49:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:49:06 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:49:06 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:49:06 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:49:06 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:49:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:49:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:49:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:49:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:49:08 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:49:08 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:49:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:49:08 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:49:09 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:49:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:49:09 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:49:09 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:49:10 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:49:10 - job_xml_thread(): Done retrieving: data size 43559063
Mon 20 Jan 2014 16:49:10 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:49:10 - XML: Start document: iteration 18
Mon 20 Jan 2014 16:49:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559063
Mon 20 Jan 2014 16:49:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:49:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559063
Mon 20 Jan 2014 16:49:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:49:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:49:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:49:22 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:49:22 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:49:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:49:22 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:49:23 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:49:23 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:49:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:49:23 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:49:23 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:49:23 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:49:23 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:49:24 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:49:24 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:49:24 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:49:24 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:49:24 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 16:49:24 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 16:49:24 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:49:24 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8773 values 138415 bits 17301 bytes 
Mon 20 Jan 2014 16:49:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:49:32 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:49:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:49:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:49:33 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 16:49:33 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:49:33 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:49:33 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:49:33 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:49:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:49:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:49:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:49:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:49:36 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:49:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43549296
Mon 20 Jan 2014 16:49:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:49:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43549296
Mon 20 Jan 2014 16:49:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:49:38 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:49:38 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:49:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:49:47 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:49:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:49:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:49:48 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:49:48 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:49:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:49:48 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:49:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:49:48 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:49:48 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 16:49:48 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:49:48 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:49:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:49:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:49:51 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:49:51 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:49:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:49:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:49:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:49:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:49:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:49:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:49:53 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:49:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565246
Mon 20 Jan 2014 16:49:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:49:53 - job_xml_thread(): Done retrieving: data size 43565246
Mon 20 Jan 2014 16:49:53 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:49:53 - XML: Start document: iteration 19
Mon 20 Jan 2014 16:49:54 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565246
Mon 20 Jan 2014 16:49:54 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:50:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:50:03 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:50:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:50:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:50:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:50:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:50:05 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:50:05 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:50:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:50:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:50:05 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:50:07 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:50:07 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:50:11 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 16:50:11 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:50:11 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:50:11 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:50:11 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:50:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:50:14 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:50:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:50:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:50:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:50:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:50:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:50:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:50:16 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:50:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561770
Mon 20 Jan 2014 16:50:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:50:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561770
Mon 20 Jan 2014 16:50:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:50:18 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 16:50:18 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:50:20 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:50:20 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:50:20 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 16:50:20 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 16:50:20 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 16:50:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:50:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:50:24 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:50:24 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:50:25 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:50:25 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:50:25 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:50:25 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:50:26 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:50:26 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:50:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:50:26 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:50:26 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:50:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561770
Mon 20 Jan 2014 16:50:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:50:26 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 16:50:26 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:50:26 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 16:50:26 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:50:26 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9330 values 147194 bits 18399 bytes 
Mon 20 Jan 2014 16:50:27 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:50:27 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:50:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:50:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:50:32 - size of cluster 'LISA Cluster': 624 hosts 79469 metrics 783165 values 12375219 bits 1546902 bytes 
Mon 20 Jan 2014 16:50:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:50:39 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:50:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:50:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:50:39 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:50:39 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:50:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:50:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:50:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:50:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:50:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:50:41 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:50:41 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:50:41 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:50:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:50:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:50:43 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:50:43 - job_xml_thread(): Done retrieving: data size 43542318
Mon 20 Jan 2014 16:50:43 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:50:43 - XML: Start document: iteration 20
Mon 20 Jan 2014 16:50:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43542318
Mon 20 Jan 2014 16:50:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:50:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43542318
Mon 20 Jan 2014 16:50:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:50:55 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 16:50:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:50:55 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:50:55 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:50:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:50:55 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:50:56 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:50:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:50:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:51:05 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:51:05 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:51:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:51:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:51:06 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:51:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:51:06 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:51:07 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:51:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:51:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:51:07 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:51:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:51:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:51:07 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:51:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 16:51:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:51:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:51:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:51:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:51:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:51:10 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:51:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576975
Mon 20 Jan 2014 16:51:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:51:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576975
Mon 20 Jan 2014 16:51:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:51:11 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:51:11 - job_xml_thread(): Done retrieving: data size 43576975
Mon 20 Jan 2014 16:51:11 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:51:11 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 16:51:12 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 16:51:12 - Housekeeping: done.
Mon 20 Jan 2014 16:51:12 - XML: Start document: iteration 0
Mon 20 Jan 2014 16:51:20 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:51:20 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 16:51:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:51:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:51:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:51:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:51:26 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:51:27 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:51:27 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:51:27 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:51:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:51:27 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:51:28 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:51:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:51:28 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 16:51:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 16:51:28 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:51:28 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:51:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:51:28 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:51:28 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:51:28 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5676 values 89475 bits 11184 bytes 
Mon 20 Jan 2014 16:51:28 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:51:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:51:32 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:51:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:51:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:51:33 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:51:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:51:33 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:51:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:51:33 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 16:51:33 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:51:33 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:51:33 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:51:33 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:51:37 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:51:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560706
Mon 20 Jan 2014 16:51:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:51:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560706
Mon 20 Jan 2014 16:51:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:51:43 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:51:43 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:51:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:51:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:51:48 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:51:48 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:51:50 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:51:50 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:51:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:51:50 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:51:51 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:51:51 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:51:51 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:51:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:51:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:51:54 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:51:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:51:54 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:51:55 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:51:55 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:51:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:51:55 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:51:55 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:51:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 16:51:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:51:58 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:51:58 - job_xml_thread(): Done retrieving: data size 43568801
Mon 20 Jan 2014 16:51:58 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:51:58 - XML: Start document: iteration 1
Mon 20 Jan 2014 16:51:58 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568801
Mon 20 Jan 2014 16:51:58 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:51:58 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568801
Mon 20 Jan 2014 16:51:58 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:52:06 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:52:06 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:52:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:52:08 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:52:08 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:52:08 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:52:09 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:52:09 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:52:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:52:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:52:09 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:52:10 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:52:10 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:52:15 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 16:52:15 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:52:15 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:52:16 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:52:16 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:52:19 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:52:19 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:52:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:52:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:52:20 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:52:20 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:52:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:52:20 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:52:22 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:52:22 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43548622
Mon 20 Jan 2014 16:52:22 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:52:23 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43548622
Mon 20 Jan 2014 16:52:23 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:52:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:52:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:52:28 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:52:28 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:52:28 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:52:28 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:52:28 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 16:52:29 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 16:52:29 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:52:29 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8754 values 138010 bits 17251 bytes 
Mon 20 Jan 2014 16:52:31 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:52:31 - job_xml_thread(): Done retrieving: data size 43548622
Mon 20 Jan 2014 16:52:31 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:52:31 - XML: Start document: iteration 2
Mon 20 Jan 2014 16:52:35 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:52:35 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:52:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:52:38 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:52:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:52:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:52:39 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:52:39 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:52:39 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:52:39 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:52:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:52:46 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 16:52:46 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:52:46 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:52:46 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:52:46 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:52:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:52:47 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:52:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:52:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:52:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:52:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:52:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:52:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:52:50 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:52:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43549943
Mon 20 Jan 2014 16:52:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:52:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43549943
Mon 20 Jan 2014 16:52:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:52:54 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:52:54 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:53:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:53:01 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:53:01 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:53:01 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:53:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:53:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:53:03 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:53:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:53:03 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:53:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:53:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:53:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:53:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:53:07 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:53:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:53:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:53:07 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:53:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 16:53:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:53:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:53:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:53:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:53:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:53:10 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:53:10 - job_xml_thread(): Done retrieving: data size 43571440
Mon 20 Jan 2014 16:53:10 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:53:10 - XML: Start document: iteration 3
Mon 20 Jan 2014 16:53:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43571440
Mon 20 Jan 2014 16:53:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:53:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43571440
Mon 20 Jan 2014 16:53:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:53:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:53:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:53:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:53:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:53:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:53:26 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:53:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:53:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:53:27 - XML: Processed 653346 elements - found 0 jobs
Mon 20 Jan 2014 16:53:27 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:53:27 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:53:27 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:53:27 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:53:28 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:53:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:53:28 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:53:28 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:53:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:53:29 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:53:29 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:53:29 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:53:29 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:53:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 16:53:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 16:53:30 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:53:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5818 values 91768 bits 11471 bytes 
Mon 20 Jan 2014 16:53:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:53:32 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:53:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:53:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:53:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:53:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:53:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:53:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:53:36 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:53:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43015736
Mon 20 Jan 2014 16:53:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:53:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43015736
Mon 20 Jan 2014 16:53:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:53:42 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:53:43 - job_xml_thread(): Done retrieving: data size 43015736
Mon 20 Jan 2014 16:53:43 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:53:43 - XML: Start document: iteration 4
Mon 20 Jan 2014 16:53:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:53:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:53:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:53:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:53:56 - XML: Processed 646578 elements - found 0 jobs
Mon 20 Jan 2014 16:53:56 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:53:56 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:53:56 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:53:56 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:53:58 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:53:58 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:53:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:53:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:54:00 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:54:00 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:54:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:54:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:54:00 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:54:01 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:54:01 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:54:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:54:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:54:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:54:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:54:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:54:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:54:02 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:54:02 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 16:54:02 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:54:05 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:54:05 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42917381
Mon 20 Jan 2014 16:54:05 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:54:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42917381
Mon 20 Jan 2014 16:54:06 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:54:12 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:54:12 - job_xml_thread(): Done retrieving: data size 42917381
Mon 20 Jan 2014 16:54:12 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:54:12 - XML: Start document: iteration 5
Mon 20 Jan 2014 16:54:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:54:15 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:54:15 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:54:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:54:16 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:54:16 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:54:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:54:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:54:16 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:54:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:54:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:54:24 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:54:24 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:54:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:54:24 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:54:25 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:54:25 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:54:25 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:54:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:54:26 - XML: Processed 645158 elements - found 0 jobs
Mon 20 Jan 2014 16:54:26 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:54:26 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:54:26 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:54:26 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:54:30 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:54:30 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:54:30 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:54:30 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43174574
Mon 20 Jan 2014 16:54:30 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:54:30 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:54:30 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 16:54:30 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:54:30 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:54:30 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 16:54:30 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5752 values 90674 bits 11334 bytes 
Mon 20 Jan 2014 16:54:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:54:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:54:31 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43174574
Mon 20 Jan 2014 16:54:31 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:54:40 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:54:40 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:54:41 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:54:41 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:54:43 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:54:43 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:54:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:54:43 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:54:44 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:54:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:54:44 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:54:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:54:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:54:48 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:54:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:54:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:54:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:54:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:54:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:54:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:54:52 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:54:52 - job_xml_thread(): Done retrieving: data size 43530033
Mon 20 Jan 2014 16:54:52 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:54:52 - XML: Start document: iteration 6
Mon 20 Jan 2014 16:54:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43530033
Mon 20 Jan 2014 16:54:53 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:54:53 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43530033
Mon 20 Jan 2014 16:54:53 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:54:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:54:59 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:55:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:55:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:55:09 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:55:09 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:55:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:55:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:55:10 - XML: Processed 652970 elements - found 0 jobs
Mon 20 Jan 2014 16:55:10 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:55:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:55:10 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:55:10 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:55:10 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:55:10 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:55:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:55:10 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:55:10 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:55:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:55:14 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:55:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:55:15 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:55:15 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:55:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 16:55:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:55:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:55:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:55:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:55:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:55:15 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 16:55:15 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 16:55:15 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:55:16 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:55:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43552702
Mon 20 Jan 2014 16:55:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:55:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43552702
Mon 20 Jan 2014 16:55:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:55:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:55:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:55:25 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:55:25 - job_xml_thread(): Done retrieving: data size 43552702
Mon 20 Jan 2014 16:55:25 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:55:25 - XML: Start document: iteration 7
Mon 20 Jan 2014 16:55:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:55:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:55:31 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:55:31 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:55:31 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:55:31 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:55:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:55:31 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:55:32 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:55:32 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:55:32 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 16:55:32 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 16:55:32 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:55:32 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5969 values 94116 bits 11764 bytes 
Mon 20 Jan 2014 16:55:33 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:55:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:55:33 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:55:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:55:33 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:55:38 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:55:38 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:55:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:55:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:55:40 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 16:55:40 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:55:40 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:55:40 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:55:40 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:55:40 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:55:40 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:55:40 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:55:40 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:55:42 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:55:42 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566530
Mon 20 Jan 2014 16:55:42 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:55:43 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566530
Mon 20 Jan 2014 16:55:43 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:55:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:55:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:55:51 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:55:51 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:55:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:55:51 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:55:52 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:55:52 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:55:52 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:55:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566530
Mon 20 Jan 2014 16:55:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:55:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:55:55 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:55:55 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:55:55 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:55:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:56:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:56:04 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:56:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:56:05 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:56:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:56:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:56:05 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:56:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 16:56:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:56:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:56:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:56:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:56:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:56:07 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:56:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:56:07 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:56:07 - job_xml_thread(): Done retrieving: data size 43550079
Mon 20 Jan 2014 16:56:07 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:56:07 - XML: Start document: iteration 8
Mon 20 Jan 2014 16:56:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43550079
Mon 20 Jan 2014 16:56:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:56:09 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:56:10 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:56:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:56:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43550079
Mon 20 Jan 2014 16:56:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:56:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:56:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:56:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:56:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:56:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:56:27 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 16:56:27 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:56:27 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:56:27 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:56:27 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:56:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:56:28 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:56:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:56:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:56:29 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:56:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:56:29 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:56:29 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:56:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:56:30 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:56:30 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:56:30 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:56:30 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:56:31 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:56:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:56:31 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:56:31 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:56:31 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:56:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582993
Mon 20 Jan 2014 16:56:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:56:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582993
Mon 20 Jan 2014 16:56:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:56:32 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:56:32 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:56:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:56:34 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:56:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 16:56:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 16:56:34 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:56:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9120 values 143847 bits 17980 bytes 
Mon 20 Jan 2014 16:56:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:56:41 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:56:42 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:56:42 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:56:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:56:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:56:45 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:56:45 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:56:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:56:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:56:46 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:56:46 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:56:46 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:56:46 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:56:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:56:46 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:56:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:56:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:56:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:56:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:56:48 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:56:48 - job_xml_thread(): Done retrieving: data size 43568574
Mon 20 Jan 2014 16:56:48 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:56:48 - XML: Start document: iteration 9
Mon 20 Jan 2014 16:56:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43568574
Mon 20 Jan 2014 16:56:49 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43568574
Mon 20 Jan 2014 16:56:49 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:56:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:57:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:57:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:57:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:57:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:57:02 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 16:57:02 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:57:02 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:57:02 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:57:02 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:57:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:57:07 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:57:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:57:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:57:08 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:57:08 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:57:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:57:09 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:57:09 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:57:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:57:10 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:57:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:57:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:57:10 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:57:10 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 16:57:10 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:57:11 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:57:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:57:11 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:57:11 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:57:12 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:57:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43597959
Mon 20 Jan 2014 16:57:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:57:13 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43597959
Mon 20 Jan 2014 16:57:13 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:57:17 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:57:18 - job_xml_thread(): Done retrieving: data size 43597959
Mon 20 Jan 2014 16:57:18 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:57:18 - XML: Start document: iteration 10
Mon 20 Jan 2014 16:57:20 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 16:57:20 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:57:22 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:57:22 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:57:22 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 16:57:22 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 16:57:22 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 16:57:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:57:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:57:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:57:26 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:57:26 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:57:26 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:57:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:57:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:57:27 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:57:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:57:27 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:57:27 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:57:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:57:31 - size of cluster 'LISA Cluster': 624 hosts 79476 metrics 774360 values 12221680 bits 1527710 bytes 
Mon 20 Jan 2014 16:57:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:57:34 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:57:34 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:57:34 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 16:57:34 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:57:34 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:57:34 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 16:57:34 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5781 values 91128 bits 11391 bytes 
Mon 20 Jan 2014 16:57:36 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 16:57:36 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:57:36 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:57:36 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:57:36 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:57:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:57:37 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:57:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:57:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:57:38 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:57:38 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:57:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:57:38 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:57:41 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:57:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555693
Mon 20 Jan 2014 16:57:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:57:42 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555693
Mon 20 Jan 2014 16:57:42 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:57:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:57:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:57:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:57:49 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:57:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:57:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:57:50 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:57:50 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:57:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555693
Mon 20 Jan 2014 16:57:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:57:50 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:57:50 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:57:51 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:57:51 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:57:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:57:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:58:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:58:00 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:58:04 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:58:04 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:58:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:58:04 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:58:04 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:58:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 16:58:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:58:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:58:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:58:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:58:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:58:05 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:58:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:58:06 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:58:06 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:58:06 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:58:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:58:07 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:58:07 - job_xml_thread(): Done retrieving: data size 43543273
Mon 20 Jan 2014 16:58:07 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:58:07 - XML: Start document: iteration 11
Mon 20 Jan 2014 16:58:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43543273
Mon 20 Jan 2014 16:58:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43543273
Mon 20 Jan 2014 16:58:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:58:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:58:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:58:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:58:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:58:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:58:22 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:58:22 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 16:58:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:58:24 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:58:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:58:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:58:25 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:58:25 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:58:25 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:58:25 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:58:25 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:58:30 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 16:58:30 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:58:30 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:58:30 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:58:30 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:58:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:58:31 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:58:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:58:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:58:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:58:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:58:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:58:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:58:34 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:58:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555402
Mon 20 Jan 2014 16:58:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:58:34 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:58:34 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:58:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555402
Mon 20 Jan 2014 16:58:35 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:58:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:58:35 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 16:58:35 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:58:35 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:58:35 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 16:58:35 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8982 values 141683 bits 17710 bytes 
Mon 20 Jan 2014 16:58:41 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:58:41 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:58:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:58:44 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:58:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:58:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:58:44 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:58:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:58:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555402
Mon 20 Jan 2014 16:58:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:58:44 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:58:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:58:45 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:58:46 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:58:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:58:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:58:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:58:50 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:58:50 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:58:50 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:58:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:58:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:58:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:58:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:58:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:58:54 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:58:59 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:58:59 - job_xml_thread(): Done retrieving: data size 43572841
Mon 20 Jan 2014 16:58:59 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:58:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43572841
Mon 20 Jan 2014 16:58:59 - XML: Start document: iteration 12
Mon 20 Jan 2014 16:58:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:58:59 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:59:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:59:00 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:59:00 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:59:00 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:59:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:59:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43572841
Mon 20 Jan 2014 16:59:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:59:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:59:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:59:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:59:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:59:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:59:19 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:59:19 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:59:19 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:59:20 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:59:20 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:59:20 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:59:20 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:59:20 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:59:21 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:59:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 16:59:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:59:21 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 16:59:21 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:59:21 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:59:21 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:59:21 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:59:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:59:23 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:59:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:59:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:59:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:59:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:59:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:59:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:59:27 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 16:59:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43503447
Mon 20 Jan 2014 16:59:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:59:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43503447
Mon 20 Jan 2014 16:59:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 16:59:35 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:59:35 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:59:35 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:59:35 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:59:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:59:36 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:59:36 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:59:36 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:59:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:59:36 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 16:59:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:59:36 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 16:59:36 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 16:59:36 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6037 values 95192 bits 11899 bytes 
Mon 20 Jan 2014 16:59:36 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 16:59:36 - job_xml_thread(): Done retrieving: data size 43503447
Mon 20 Jan 2014 16:59:36 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 16:59:36 - XML: Start document: iteration 13
Mon 20 Jan 2014 16:59:36 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:59:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 16:59:36 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:59:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:59:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43503447
Mon 20 Jan 2014 16:59:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 16:59:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 16:59:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:59:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 16:59:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 16:59:54 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 16:59:54 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 16:59:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 16:59:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 16:59:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:59:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 16:59:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 16:59:56 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 16:59:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 16:59:56 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 16:59:56 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 16:59:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 16:59:56 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 16:59:57 - XML: Processed 652596 elements - found 0 jobs
Mon 20 Jan 2014 16:59:57 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 16:59:57 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:59:57 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 16:59:57 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 16:59:57 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 16:59:57 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 16:59:57 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 16:59:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 17:00:01 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 17:00:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42914012
Mon 20 Jan 2014 17:00:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 17:00:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42914012
Mon 20 Jan 2014 17:00:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 17:00:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 17:00:10 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 17:00:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 17:00:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:00:12 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 17:00:12 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 17:00:12 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:00:12 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:00:13 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:00:13 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 17:00:13 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:00:13 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 17:00:16 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 17:00:16 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 17:00:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 17:00:16 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:00:16 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:00:16 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 17:00:16 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:00:16 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 17:00:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 17:00:16 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 17:00:16 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:00:19 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 17:00:19 - job_xml_thread(): Done retrieving: data size 42954873
Mon 20 Jan 2014 17:00:19 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 17:00:19 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42954873
Mon 20 Jan 2014 17:00:19 - XML: Start document: iteration 14
Mon 20 Jan 2014 17:00:19 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 17:00:19 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42954873
Mon 20 Jan 2014 17:00:19 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 17:00:28 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:00:28 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:00:31 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 17:00:31 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:00:33 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 17:00:33 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 17:00:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 17:00:33 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:00:34 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:00:34 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:00:34 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 17:00:34 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 17:00:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 17:00:36 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:00:36 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:00:37 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:00:37 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:00:37 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 17:00:37 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 17:00:37 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 17:00:37 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5783 values 91181 bits 11397 bytes 
Mon 20 Jan 2014 17:00:42 - XML: Processed 645802 elements - found 0 jobs
Mon 20 Jan 2014 17:00:42 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 17:00:42 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 17:00:42 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 17:00:42 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 17:00:43 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 17:00:43 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 17:00:43 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 17:00:43 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:00:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:00:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 17:00:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:00:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 17:00:46 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 17:00:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43440237
Mon 20 Jan 2014 17:00:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 17:00:46 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43440237
Mon 20 Jan 2014 17:00:46 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 17:00:49 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:00:49 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:00:58 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 17:00:58 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 17:00:59 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 17:00:59 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 17:00:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 17:00:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:00:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 17:00:59 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:00:59 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:00:59 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 17:00:59 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:00:59 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 17:01:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 17:01:00 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 17:01:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 17:01:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:01:01 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 17:01:01 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 17:01:01 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:01:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:01:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 17:01:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:01:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 17:01:04 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 17:01:04 - job_xml_thread(): Done retrieving: data size 43565268
Mon 20 Jan 2014 17:01:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565268
Mon 20 Jan 2014 17:01:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 17:01:04 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 17:01:04 - XML: Start document: iteration 15
Mon 20 Jan 2014 17:01:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565268
Mon 20 Jan 2014 17:01:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 17:01:14 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:01:14 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:01:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 17:01:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:01:26 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 17:01:26 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 17:01:26 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 17:01:26 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 17:01:26 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 17:01:28 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 17:01:28 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 17:01:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 17:01:28 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:01:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 17:01:28 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 17:01:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 17:01:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:01:29 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:01:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 17:01:29 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:01:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 17:01:29 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 17:01:29 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:01:29 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:01:29 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 17:01:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 17:01:32 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 17:01:32 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43575892
Mon 20 Jan 2014 17:01:32 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 17:01:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43575892
Mon 20 Jan 2014 17:01:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 17:01:37 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:01:37 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:01:38 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:01:38 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 17:01:38 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:01:38 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 17:01:38 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 17:01:39 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8887 values 140387 bits 17548 bytes 
Mon 20 Jan 2014 17:01:41 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 17:01:41 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 17:01:41 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 17:01:41 - job_xml_thread(): Done retrieving: data size 43575892
Mon 20 Jan 2014 17:01:41 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 17:01:41 - XML: Start document: iteration 16
Mon 20 Jan 2014 17:01:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:01:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:01:44 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 17:01:44 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:01:44 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:01:44 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:01:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 17:01:45 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 17:01:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 17:01:52 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 17:01:52 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 17:01:52 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 17:01:52 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 17:01:52 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 17:01:55 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 17:01:55 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 17:01:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 17:01:55 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:01:56 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:01:56 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:01:56 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 17:01:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 17:01:59 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 17:01:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43561117
Mon 20 Jan 2014 17:01:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 17:01:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43561117
Mon 20 Jan 2014 17:01:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 17:02:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:02:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:02:00 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 17:02:00 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 17:02:00 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:02:07 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 17:02:07 - job_xml_thread(): Done retrieving: data size 43561117
Mon 20 Jan 2014 17:02:07 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 17:02:07 - XML: Start document: iteration 17
Mon 20 Jan 2014 17:02:08 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 17:02:08 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 17:02:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 17:02:09 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:02:10 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:02:10 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 17:02:10 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:02:10 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 17:02:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 17:02:11 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 17:02:11 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:02:17 - XML: Processed 653353 elements - found 0 jobs
Mon 20 Jan 2014 17:02:17 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 17:02:17 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 17:02:17 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 17:02:17 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 17:02:22 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 17:02:22 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 17:02:22 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 17:02:22 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:02:22 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:02:22 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 17:02:22 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:02:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 17:02:25 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 17:02:25 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43550287
Mon 20 Jan 2014 17:02:25 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 17:02:25 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:02:25 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:02:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43550287
Mon 20 Jan 2014 17:02:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 17:02:26 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 17:02:26 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 17:02:27 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:02:33 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 17:02:33 - job_xml_thread(): Done retrieving: data size 43550287
Mon 20 Jan 2014 17:02:33 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 17:02:33 - XML: Start document: iteration 18
Mon 20 Jan 2014 17:02:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 17:02:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:02:38 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:02:38 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:02:39 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:02:39 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:02:39 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 17:02:39 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 17:02:39 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 17:02:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99321 bits 12415 bytes 
Mon 20 Jan 2014 17:02:43 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 17:02:44 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 17:02:44 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 17:02:44 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 17:02:44 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 17:02:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 17:02:45 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 17:02:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 17:02:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:02:46 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:02:47 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:02:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 17:02:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 17:02:47 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 17:02:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 17:02:47 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 17:02:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 17:02:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:02:48 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:02:48 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:02:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 17:02:48 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 17:02:50 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 17:02:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43573844
Mon 20 Jan 2014 17:02:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 17:02:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43573844
Mon 20 Jan 2014 17:02:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 17:03:00 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 17:03:00 - job_xml_thread(): Done retrieving: data size 43573844
Mon 20 Jan 2014 17:03:00 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 17:03:00 - XML: Start document: iteration 19
Mon 20 Jan 2014 17:03:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:03:02 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:03:03 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 17:03:03 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:03:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 17:03:04 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 17:03:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 17:03:05 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:03:05 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 17:03:05 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 17:03:05 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:03:05 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:03:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 17:03:05 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:03:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 17:03:06 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 17:03:11 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 17:03:11 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 17:03:11 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 17:03:11 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:03:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:03:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 17:03:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:03:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 17:03:13 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 17:03:13 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 17:03:13 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 17:03:13 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 17:03:13 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 17:03:14 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 17:03:14 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579715
Mon 20 Jan 2014 17:03:14 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 17:03:15 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579715
Mon 20 Jan 2014 17:03:15 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 17:03:20 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:03:20 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:03:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 17:03:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:03:28 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 17:03:28 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 17:03:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 17:03:28 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 17:03:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 17:03:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:03:28 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:03:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 17:03:28 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:03:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 17:03:29 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 17:03:29 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 17:03:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 17:03:29 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:03:30 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:03:30 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:03:30 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 17:03:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 17:03:31 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 17:03:31 - job_xml_thread(): Done retrieving: data size 43585790
Mon 20 Jan 2014 17:03:31 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 17:03:31 - XML: Start document: iteration 20
Mon 20 Jan 2014 17:03:31 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43585790
Mon 20 Jan 2014 17:03:31 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 17:03:32 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43585790
Mon 20 Jan 2014 17:03:32 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 17:03:40 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:03:40 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:03:41 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:03:41 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 17:03:41 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:03:41 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 17:03:41 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 17:03:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9299 values 146978 bits 18372 bytes 
Mon 20 Jan 2014 17:03:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 17:03:44 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 17:03:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:03:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:03:44 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:03:44 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:03:44 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 17:03:44 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 17:03:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 17:03:45 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 17:03:45 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:03:49 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 17:03:49 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 17:03:49 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 17:03:49 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 17:03:49 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 17:03:52 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 17:03:52 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 17:03:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 17:03:52 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:03:52 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:03:52 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:03:52 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 17:03:52 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 17:03:55 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 17:03:55 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 17:03:55 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:03:55 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 17:03:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43560619
Mon 20 Jan 2014 17:03:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 17:03:56 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43560619
Mon 20 Jan 2014 17:03:56 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 17:04:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:04:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:04:04 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 17:04:04 - job_xml_thread(): Done retrieving: data size 43560619
Mon 20 Jan 2014 17:04:04 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 17:04:04 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 17:04:05 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 17:04:05 - Housekeeping: done.
Mon 20 Jan 2014 17:04:05 - XML: Start document: iteration 0
Mon 20 Jan 2014 17:04:06 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 17:04:06 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 17:04:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 17:04:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:04:08 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 17:04:08 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:04:08 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:04:08 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 17:04:08 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 17:04:08 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:04:09 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 17:04:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 17:04:18 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 17:04:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 17:04:19 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:04:19 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 17:04:19 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 17:04:19 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 17:04:19 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 17:04:19 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 17:04:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:04:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 17:04:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:04:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 17:04:20 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 17:04:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43547547
Mon 20 Jan 2014 17:04:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 17:04:20 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43547547
Mon 20 Jan 2014 17:04:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 17:04:22 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 17:04:22 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:04:23 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:04:23 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 17:04:23 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 17:04:23 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:04:24 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 17:04:24 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:04:24 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:04:30 - size of cluster 'LISA Cluster': 624 hosts 79470 metrics 691949 values 10939520 bits 1367440 bytes 
Mon 20 Jan 2014 17:04:32 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 17:04:32 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 17:04:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 17:04:32 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:04:33 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:04:33 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 17:04:33 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:04:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 17:04:33 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 17:04:34 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 17:04:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 17:04:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:04:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 17:04:36 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 17:04:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 17:04:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:04:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:04:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 17:04:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:04:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 17:04:40 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 17:04:40 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579955
Mon 20 Jan 2014 17:04:40 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 17:04:40 - job_xml_thread(): Done retrieving: data size 43579955
Mon 20 Jan 2014 17:04:40 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 17:04:40 - XML: Start document: iteration 1
Mon 20 Jan 2014 17:04:40 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579955
Mon 20 Jan 2014 17:04:40 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 17:04:41 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:04:42 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:04:42 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:04:42 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:04:42 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 17:04:42 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 17:04:42 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 17:04:42 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9201 values 145218 bits 18152 bytes 
Mon 20 Jan 2014 17:04:48 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:04:48 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:04:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 17:04:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:04:52 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 17:04:52 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 17:04:52 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 17:04:52 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:04:54 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:04:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 17:04:54 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:04:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 17:04:54 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 17:04:59 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 17:04:59 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 17:04:59 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 17:04:59 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 17:04:59 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 17:05:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 17:05:05 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 17:05:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 17:05:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:05:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:05:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:05:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 17:05:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 17:05:07 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 17:05:07 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 17:05:07 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:05:08 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 17:05:08 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43547573
Mon 20 Jan 2014 17:05:08 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 17:05:08 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43547573
Mon 20 Jan 2014 17:05:08 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 17:05:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:05:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:05:14 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 17:05:14 - job_xml_thread(): Done retrieving: data size 43547573
Mon 20 Jan 2014 17:05:15 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 17:05:15 - XML: Start document: iteration 2
Mon 20 Jan 2014 17:05:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 17:05:18 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 17:05:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 17:05:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:05:19 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:05:19 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:05:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 17:05:19 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 17:05:19 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 17:05:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 17:05:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:05:24 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 17:05:24 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 17:05:27 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 17:05:27 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 17:05:27 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 17:05:27 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 17:05:27 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 17:05:31 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 17:05:31 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 17:05:31 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 17:05:31 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:05:32 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:05:32 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:05:32 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 17:05:32 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 17:05:34 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:05:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:05:34 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 17:05:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43012450
Mon 20 Jan 2014 17:05:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 17:05:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43012450
Mon 20 Jan 2014 17:05:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 17:05:42 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 17:05:42 - job_xml_thread(): Done retrieving: data size 43012450
Mon 20 Jan 2014 17:05:42 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 17:05:42 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:05:42 - XML: Start document: iteration 3
Mon 20 Jan 2014 17:05:42 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:05:43 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:05:43 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:05:43 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 17:05:43 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 17:05:44 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 17:05:44 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99095 bits 12386 bytes 
Mon 20 Jan 2014 17:05:47 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 17:05:47 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:05:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 17:05:47 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 17:05:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 17:05:48 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:05:48 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:05:48 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:05:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 17:05:48 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 17:05:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 17:05:55 - XML: Processed 646913 elements - found 0 jobs
Mon 20 Jan 2014 17:05:55 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 17:05:55 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 17:05:55 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 17:05:55 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 17:05:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 17:05:57 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 17:05:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 17:05:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:05:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:05:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 17:05:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:05:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 17:06:01 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 17:06:01 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42916171
Mon 20 Jan 2014 17:06:01 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 17:06:01 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42916171
Mon 20 Jan 2014 17:06:01 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 17:06:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:06:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:06:10 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 17:06:10 - job_xml_thread(): Done retrieving: data size 42916171
Mon 20 Jan 2014 17:06:10 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 17:06:10 - XML: Start document: iteration 4
Mon 20 Jan 2014 17:06:13 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 17:06:13 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:06:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 17:06:16 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 17:06:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 17:06:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:06:16 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:06:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 17:06:16 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 17:06:16 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:06:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 17:06:17 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 17:06:17 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 17:06:17 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:06:22 - XML: Processed 645442 elements - found 0 jobs
Mon 20 Jan 2014 17:06:23 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 17:06:23 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 17:06:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 17:06:23 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 17:06:23 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 17:06:23 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 17:06:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 17:06:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:06:24 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:06:24 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:06:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 17:06:24 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 17:06:26 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 17:06:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42964830
Mon 20 Jan 2014 17:06:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 17:06:27 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42964830
Mon 20 Jan 2014 17:06:27 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 17:06:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:06:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:06:36 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 17:06:37 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 17:06:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 17:06:37 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:06:38 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:06:38 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 17:06:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 17:06:38 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 17:06:38 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:06:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 17:06:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 17:06:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:06:40 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 17:06:40 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 17:06:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 17:06:40 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:06:41 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:06:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 17:06:41 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:06:41 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 17:06:43 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 17:06:43 - job_xml_thread(): Done retrieving: data size 43497521
Mon 20 Jan 2014 17:06:43 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 17:06:43 - XML: Start document: iteration 5
Mon 20 Jan 2014 17:06:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43497521
Mon 20 Jan 2014 17:06:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43497521
Mon 20 Jan 2014 17:06:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 17:06:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 17:06:44 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:06:44 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:06:45 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:06:45 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:06:45 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 17:06:45 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 17:06:45 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 17:06:45 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5843 values 92165 bits 11520 bytes 
Mon 20 Jan 2014 17:06:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:06:53 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:06:56 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 17:06:56 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:07:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 17:07:01 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 17:07:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 17:07:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:07:02 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:07:02 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:07:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 17:07:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 17:07:02 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 17:07:04 - XML: Processed 652294 elements - found 0 jobs
Mon 20 Jan 2014 17:07:04 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 17:07:04 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 17:07:04 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 17:07:04 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 17:07:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 17:07:06 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 17:07:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 17:07:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:07:06 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:07:06 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 17:07:06 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:07:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 17:07:10 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 17:07:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562120
Mon 20 Jan 2014 17:07:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 17:07:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562120
Mon 20 Jan 2014 17:07:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 17:07:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:07:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:07:19 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 17:07:19 - job_xml_thread(): Done retrieving: data size 43562120
Mon 20 Jan 2014 17:07:19 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 17:07:19 - XML: Start document: iteration 6
Mon 20 Jan 2014 17:07:21 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 17:07:21 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:07:27 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 17:07:27 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 17:07:27 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 17:07:27 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:07:27 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:07:27 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:07:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 17:07:27 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 17:07:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 17:07:29 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 17:07:29 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 17:07:29 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 17:07:29 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 17:07:29 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 17:07:32 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 17:07:32 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 17:07:32 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 17:07:32 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:07:32 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 17:07:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 17:07:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:07:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:07:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:07:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 17:07:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 17:07:36 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 17:07:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43547259
Mon 20 Jan 2014 17:07:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 17:07:36 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43547259
Mon 20 Jan 2014 17:07:36 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 17:07:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:07:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:07:44 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 17:07:44 - job_xml_thread(): Done retrieving: data size 43547259
Mon 20 Jan 2014 17:07:44 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 17:07:44 - XML: Start document: iteration 7
Mon 20 Jan 2014 17:07:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 17:07:44 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 17:07:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 17:07:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:07:45 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:07:45 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:07:45 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:07:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 17:07:45 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:07:46 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43547259
Mon 20 Jan 2014 17:07:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:07:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 17:07:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 17:07:46 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 17:07:46 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5823 values 91857 bits 11482 bytes 
Mon 20 Jan 2014 17:07:46 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:07:46 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 17:07:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 17:07:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 17:07:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:08:01 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 17:08:01 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 17:08:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:08:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:08:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 17:08:01 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:08:02 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:08:02 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 17:08:02 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 17:08:02 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:08:02 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 17:08:04 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 17:08:04 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 17:08:04 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 17:08:04 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 17:08:04 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 17:08:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 17:08:07 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 17:08:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 17:08:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:08:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:08:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 17:08:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:08:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 17:08:11 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 17:08:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43555226
Mon 20 Jan 2014 17:08:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 17:08:11 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43555226
Mon 20 Jan 2014 17:08:11 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 17:08:17 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:08:17 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:08:19 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 17:08:19 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 17:08:19 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:08:19 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 17:08:19 - job_xml_thread(): Done retrieving: data size 43555226
Mon 20 Jan 2014 17:08:19 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 17:08:19 - XML: Start document: iteration 8
Mon 20 Jan 2014 17:08:22 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 17:08:22 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:08:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 17:08:26 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 17:08:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 17:08:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:08:27 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:08:27 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:08:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 17:08:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 17:08:27 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 17:08:32 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 17:08:32 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 17:08:32 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 17:08:32 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 17:08:32 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 17:08:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 17:08:34 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 17:08:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 17:08:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:08:35 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:08:35 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:08:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 17:08:35 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 17:08:37 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 17:08:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43550533
Mon 20 Jan 2014 17:08:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 17:08:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43550533
Mon 20 Jan 2014 17:08:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 17:08:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:08:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:08:46 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:08:46 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:08:46 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:08:46 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 17:08:46 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 17:08:46 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:08:46 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 17:08:47 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6213 values 98049 bits 12256 bytes 
Mon 20 Jan 2014 17:08:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 17:08:47 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 17:08:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 17:08:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:08:47 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 17:08:47 - job_xml_thread(): Done retrieving: data size 43550533
Mon 20 Jan 2014 17:08:47 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 17:08:47 - XML: Start document: iteration 9
Mon 20 Jan 2014 17:08:48 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:08:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 17:08:48 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 17:08:48 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:08:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 17:08:50 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 17:08:50 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:08:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 17:08:59 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 17:08:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 17:08:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:09:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:09:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:09:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 17:09:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 17:09:01 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 17:09:01 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 17:09:01 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 17:09:01 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 17:09:01 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 17:09:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:09:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:09:04 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 17:09:04 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 17:09:04 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:09:04 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 17:09:04 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 17:09:04 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:09:04 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 17:09:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43547654
Mon 20 Jan 2014 17:09:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 17:09:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43547654
Mon 20 Jan 2014 17:09:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 17:09:13 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 17:09:13 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 17:09:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 17:09:14 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:09:14 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:09:14 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:09:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 17:09:14 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 17:09:14 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 17:09:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 17:09:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:09:16 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 17:09:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 17:09:18 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 17:09:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 17:09:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:09:19 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:09:19 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:09:19 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 17:09:19 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 17:09:20 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 17:09:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43559141
Mon 20 Jan 2014 17:09:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 17:09:21 - job_xml_thread(): Done retrieving: data size 43559141
Mon 20 Jan 2014 17:09:21 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 17:09:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43559141
Mon 20 Jan 2014 17:09:21 - XML: Start document: iteration 10
Mon 20 Jan 2014 17:09:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 17:09:29 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:09:29 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:09:34 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 17:09:34 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:09:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 17:09:35 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 17:09:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 17:09:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:09:36 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:09:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 17:09:36 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:09:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 17:09:36 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 17:09:38 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 17:09:38 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 17:09:38 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 17:09:38 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 17:09:38 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 17:09:42 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 17:09:42 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 17:09:42 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 17:09:42 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:09:42 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:09:42 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:09:42 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 17:09:42 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 17:09:44 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 17:09:44 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576709
Mon 20 Jan 2014 17:09:44 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 17:09:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576709
Mon 20 Jan 2014 17:09:45 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 17:09:47 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:09:47 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:09:47 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:09:47 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:09:47 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 17:09:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 17:09:48 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 17:09:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9420 values 148627 bits 18578 bytes 
Mon 20 Jan 2014 17:09:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:09:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:09:53 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 17:09:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 17:09:54 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 17:09:54 - job_xml_thread(): Done retrieving: data size 43576709
Mon 20 Jan 2014 17:09:54 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 17:09:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 17:09:54 - XML: Start document: iteration 11
Mon 20 Jan 2014 17:09:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:09:55 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:09:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 17:09:56 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:09:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 17:09:56 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 17:09:57 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 17:09:57 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:10:06 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 17:10:06 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 17:10:06 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 17:10:06 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 17:10:06 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 17:10:07 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 17:10:07 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 17:10:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 17:10:07 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:10:08 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:10:08 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:10:08 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 17:10:08 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 17:10:09 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 17:10:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43544676
Mon 20 Jan 2014 17:10:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 17:10:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43544676
Mon 20 Jan 2014 17:10:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 17:10:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:10:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:10:20 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 17:10:20 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 17:10:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 17:10:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:10:21 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 17:10:21 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 17:10:21 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:10:21 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:10:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 17:10:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 17:10:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 17:10:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:10:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 17:10:23 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 17:10:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 17:10:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:10:23 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 17:10:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 17:10:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:10:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:10:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:10:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 17:10:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 17:10:25 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 17:10:25 - job_xml_thread(): Done retrieving: data size 43576315
Mon 20 Jan 2014 17:10:25 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 17:10:25 - XML: Start document: iteration 12
Mon 20 Jan 2014 17:10:26 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43576315
Mon 20 Jan 2014 17:10:26 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 17:10:26 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43576315
Mon 20 Jan 2014 17:10:26 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 17:10:36 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:10:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:10:37 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 17:10:37 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 17:10:37 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 17:10:37 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 17:10:37 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 17:10:39 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 17:10:39 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:10:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 17:10:47 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 17:10:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 17:10:47 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:10:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:10:48 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:10:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 17:10:48 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 17:10:48 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:10:48 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:10:48 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 17:10:48 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 17:10:48 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 17:10:48 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:10:48 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:10:48 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 17:10:48 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 17:10:48 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 17:10:48 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5776 values 91081 bits 11385 bytes 
Mon 20 Jan 2014 17:10:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 17:10:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:10:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:10:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 17:10:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:10:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 17:10:50 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 17:10:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581202
Mon 20 Jan 2014 17:10:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 17:10:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581202
Mon 20 Jan 2014 17:10:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 17:10:53 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 17:10:53 - job_xml_thread(): Done retrieving: data size 43581202
Mon 20 Jan 2014 17:10:53 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 17:10:54 - XML: Start document: iteration 13
Mon 20 Jan 2014 17:11:03 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:11:03 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:11:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 17:11:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:11:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 17:11:10 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 17:11:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 17:11:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:11:11 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:11:11 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:11:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 17:11:11 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 17:11:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 17:11:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 17:11:14 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 17:11:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 17:11:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:11:14 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 17:11:14 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 17:11:14 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 17:11:14 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 17:11:14 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 17:11:15 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:11:15 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 17:11:15 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:11:15 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 17:11:15 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 17:11:15 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 17:11:15 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:11:16 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 17:11:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43531246
Mon 20 Jan 2014 17:11:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 17:11:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43531246
Mon 20 Jan 2014 17:11:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 17:11:25 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 17:11:25 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:11:26 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:11:26 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:11:26 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 17:11:26 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 17:11:26 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 17:11:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:11:27 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:11:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 17:11:28 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 17:11:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 17:11:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:11:28 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:11:28 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 17:11:28 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 17:11:28 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:11:28 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 17:11:29 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 17:11:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 17:11:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:11:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 17:11:33 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 17:11:33 - size of cluster 'LISA Cluster': 624 hosts 79483 metrics 774076 values 12216740 bits 1527092 bytes 
Mon 20 Jan 2014 17:11:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 17:11:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:11:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:11:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 17:11:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:11:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 17:11:36 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 17:11:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42983695
Mon 20 Jan 2014 17:11:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 17:11:37 - job_xml_thread(): Done retrieving: data size 42983695
Mon 20 Jan 2014 17:11:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42983695
Mon 20 Jan 2014 17:11:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 17:11:37 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 17:11:37 - XML: Start document: iteration 14
Mon 20 Jan 2014 17:11:43 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:11:43 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:11:48 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:11:48 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:11:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 17:11:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:11:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:11:49 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:11:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 17:11:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 17:11:49 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 17:11:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8576 values 135215 bits 16901 bytes 
Mon 20 Jan 2014 17:11:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 17:11:53 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 17:11:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 17:11:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:11:55 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:11:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 17:11:55 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 17:11:55 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:11:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 17:11:56 - XML: Processed 646138 elements - found 0 jobs
Mon 20 Jan 2014 17:11:56 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 17:11:56 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 17:11:56 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 17:11:56 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 17:12:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 17:12:00 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 17:12:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 17:12:00 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:12:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:12:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:12:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 17:12:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 17:12:04 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 17:12:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42914566
Mon 20 Jan 2014 17:12:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 17:12:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42914566
Mon 20 Jan 2014 17:12:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 17:12:10 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:12:10 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:12:11 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 17:12:11 - job_xml_thread(): Done retrieving: data size 42914566
Mon 20 Jan 2014 17:12:11 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 17:12:11 - XML: Start document: iteration 15
Mon 20 Jan 2014 17:12:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 17:12:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:12:18 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 17:12:18 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 17:12:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 17:12:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:12:18 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:12:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 17:12:18 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:12:18 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 17:12:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 17:12:24 - XML: Processed 645160 elements - found 0 jobs
Mon 20 Jan 2014 17:12:24 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 17:12:24 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 17:12:24 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 17:12:24 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 17:12:24 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 17:12:24 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 17:12:24 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:12:26 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 17:12:26 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 17:12:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 17:12:26 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 17:12:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 17:12:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:12:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:12:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:12:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 17:12:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 17:12:28 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 17:12:28 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42960190
Mon 20 Jan 2014 17:12:28 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 17:12:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42960190
Mon 20 Jan 2014 17:12:29 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 17:12:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:12:33 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:12:38 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 17:12:38 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 17:12:38 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 17:12:38 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:12:38 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:12:38 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:12:38 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 17:12:38 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 17:12:38 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42960190
Mon 20 Jan 2014 17:12:38 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 17:12:39 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 17:12:39 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 17:12:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 17:12:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:12:47 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 17:12:47 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 17:12:49 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:12:49 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:12:49 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:12:49 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:12:49 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 17:12:49 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 17:12:49 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 17:12:49 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5793 values 91394 bits 11424 bytes 
Mon 20 Jan 2014 17:12:50 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 17:12:50 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 17:12:51 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 17:12:51 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:12:51 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:12:51 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:12:51 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 17:12:51 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 17:12:53 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:12:53 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:12:54 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:12:54 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 17:12:54 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:12:54 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 17:12:54 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 17:12:54 - job_xml_thread(): Done retrieving: data size 43517009
Mon 20 Jan 2014 17:12:54 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 17:12:54 - XML: Start document: iteration 16
Mon 20 Jan 2014 17:12:55 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43517009
Mon 20 Jan 2014 17:12:55 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 17:12:55 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43517009
Mon 20 Jan 2014 17:12:55 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 17:13:06 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 17:13:06 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:13:09 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:13:09 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:13:11 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 17:13:11 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 17:13:11 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:13:16 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 17:13:16 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 17:13:16 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 17:13:16 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:13:17 - XML: Processed 653130 elements - found 0 jobs
Mon 20 Jan 2014 17:13:17 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 17:13:17 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 17:13:17 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 17:13:17 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 17:13:17 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:13:17 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:13:17 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 17:13:17 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 17:13:17 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 17:13:18 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 17:13:18 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 17:13:18 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 17:13:18 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:13:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:13:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:13:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 17:13:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 17:13:21 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 17:13:21 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574392
Mon 20 Jan 2014 17:13:21 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 17:13:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574392
Mon 20 Jan 2014 17:13:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 17:13:32 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:13:32 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:13:32 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 17:13:32 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 17:13:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 17:13:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:13:34 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 17:13:34 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 17:13:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 17:13:34 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:13:35 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:13:35 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:13:35 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 17:13:35 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 17:13:37 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 17:13:37 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 17:13:37 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 17:13:37 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:13:37 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:13:37 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 17:13:37 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:13:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 17:13:40 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 17:13:40 - job_xml_thread(): Done retrieving: data size 43552671
Mon 20 Jan 2014 17:13:40 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 17:13:40 - XML: Start document: iteration 17
Mon 20 Jan 2014 17:13:41 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43552671
Mon 20 Jan 2014 17:13:41 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43552671
Mon 20 Jan 2014 17:13:41 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 17:13:41 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 17:13:50 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:13:50 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:13:50 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:13:50 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:13:50 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:13:50 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 17:13:50 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 17:13:50 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:13:50 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9171 values 144690 bits 18086 bytes 
Mon 20 Jan 2014 17:13:50 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 17:13:53 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 17:13:53 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:13:55 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 17:13:55 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 17:13:55 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 17:13:55 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:13:56 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:13:56 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:13:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 17:13:56 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 17:13:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 17:14:00 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 17:14:00 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 17:14:00 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 17:14:00 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 17:14:00 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 17:14:05 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 17:14:05 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 17:14:05 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 17:14:05 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:14:05 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:14:05 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:14:05 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 17:14:05 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 17:14:09 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 17:14:09 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43546959
Mon 20 Jan 2014 17:14:09 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 17:14:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43546959
Mon 20 Jan 2014 17:14:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 17:14:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:14:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:14:15 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 17:14:15 - job_xml_thread(): Done retrieving: data size 43546959
Mon 20 Jan 2014 17:14:15 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 17:14:15 - XML: Start document: iteration 18
Mon 20 Jan 2014 17:14:20 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 17:14:20 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:14:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 17:14:29 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 17:14:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 17:14:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:14:30 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 17:14:30 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 17:14:30 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 17:14:30 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 17:14:30 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 17:14:30 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:14:30 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:14:30 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 17:14:30 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 17:14:30 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 17:14:31 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 17:14:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 17:14:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:14:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 17:14:33 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 17:14:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 17:14:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:14:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:14:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:14:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 17:14:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 17:14:36 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 17:14:36 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43581883
Mon 20 Jan 2014 17:14:36 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 17:14:37 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43581883
Mon 20 Jan 2014 17:14:37 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 17:14:45 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 17:14:45 - job_xml_thread(): Done retrieving: data size 43581883
Mon 20 Jan 2014 17:14:45 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 17:14:45 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:14:45 - XML: Start document: iteration 19
Mon 20 Jan 2014 17:14:45 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:14:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 17:14:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:14:51 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:14:51 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:14:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:14:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 17:14:52 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 17:14:52 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:14:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 17:14:53 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6058 values 95560 bits 11945 bytes 
Mon 20 Jan 2014 17:14:54 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 17:14:54 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 17:14:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 17:14:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:14:55 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:14:55 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:14:56 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 17:14:56 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 17:14:56 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 17:14:56 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 17:14:56 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 17:14:56 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 17:14:56 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 17:14:56 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 17:14:59 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 17:14:59 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 17:14:59 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 17:14:59 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:15:00 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:15:00 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:15:00 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 17:15:00 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 17:15:03 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 17:15:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43589490
Mon 20 Jan 2014 17:15:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 17:15:04 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43589490
Mon 20 Jan 2014 17:15:04 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 17:15:11 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:15:11 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:15:12 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 17:15:12 - job_xml_thread(): Done retrieving: data size 43589490
Mon 20 Jan 2014 17:15:12 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 17:15:12 - XML: Start document: iteration 20
Mon 20 Jan 2014 17:15:15 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 17:15:15 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:15:19 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 17:15:19 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 17:15:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 17:15:20 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:15:21 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:15:21 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 17:15:21 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 17:15:21 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:15:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 17:15:26 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 17:15:26 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 17:15:26 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 17:15:26 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 17:15:26 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 17:15:26 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 17:15:26 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 17:15:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 17:15:26 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:15:26 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:15:26 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 17:15:26 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:15:26 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 17:15:27 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 17:15:27 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 17:15:27 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:15:29 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 17:15:29 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43569666
Mon 20 Jan 2014 17:15:29 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 17:15:29 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43569666
Mon 20 Jan 2014 17:15:30 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 17:15:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:15:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:15:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 17:15:40 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 17:15:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 17:15:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:15:41 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:15:41 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:15:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 17:15:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 17:15:41 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 17:15:41 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 17:15:41 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 17:15:41 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:15:45 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 17:15:45 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 17:15:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 17:15:45 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:15:46 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:15:46 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:15:46 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 17:15:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 17:15:48 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 17:15:48 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43582777
Mon 20 Jan 2014 17:15:48 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 17:15:49 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43582777
Mon 20 Jan 2014 17:15:49 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 17:15:49 - job_xml_thread(): Done retrieving: data size 43582777
Mon 20 Jan 2014 17:15:49 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 17:15:49 - Housekeeping: checking database for timed out jobs..
Mon 20 Jan 2014 17:15:50 - Housekeeping: Found 0 timed out jobs in database: closing entries
Mon 20 Jan 2014 17:15:50 - Housekeeping: done.
Mon 20 Jan 2014 17:15:50 - XML: Start document: iteration 0
Mon 20 Jan 2014 17:15:52 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:15:52 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:15:52 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:15:52 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 17:15:52 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 17:15:52 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:15:52 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 17:15:56 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:15:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8809 values 138925 bits 17365 bytes 
Mon 20 Jan 2014 17:15:56 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:16:01 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 17:16:01 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:16:03 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 17:16:03 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 17:16:03 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 17:16:03 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:16:04 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:16:04 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:16:04 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 17:16:04 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 17:16:04 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 17:16:05 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 17:16:05 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 17:16:05 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 17:16:05 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 17:16:05 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 17:16:09 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 17:16:09 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 17:16:09 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 17:16:09 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:16:10 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 17:16:10 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 17:16:10 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:16:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:16:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:16:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 17:16:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 17:16:11 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 17:16:11 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43558765
Mon 20 Jan 2014 17:16:11 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 17:16:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43558765
Mon 20 Jan 2014 17:16:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 17:16:19 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:16:19 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:16:20 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 17:16:20 - job_xml_thread(): Done retrieving: data size 43558765
Mon 20 Jan 2014 17:16:20 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 17:16:20 - XML: Start document: iteration 1
Mon 20 Jan 2014 17:16:21 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 17:16:21 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 17:16:21 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 17:16:21 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:16:22 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:16:22 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:16:22 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 17:16:22 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 17:16:22 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 17:16:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 17:16:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:16:28 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 17:16:28 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 17:16:28 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:16:30 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 17:16:30 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 17:16:30 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 17:16:30 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 17:16:30 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 17:16:33 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 17:16:33 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 17:16:33 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 17:16:33 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:16:33 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:16:33 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 17:16:33 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:16:33 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 17:16:34 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 17:16:34 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43565828
Mon 20 Jan 2014 17:16:34 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 17:16:35 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43565828
Mon 20 Jan 2014 17:16:35 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 17:16:37 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:16:37 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:16:45 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 17:16:45 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 17:16:45 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 17:16:45 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 17:16:45 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 17:16:45 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:16:46 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:16:46 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:16:46 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 17:16:46 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 17:16:48 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 17:16:48 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:16:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 17:16:48 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 17:16:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 17:16:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:16:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:16:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 17:16:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:16:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 17:16:50 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 17:16:50 - job_xml_thread(): Done retrieving: data size 43595223
Mon 20 Jan 2014 17:16:50 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 17:16:50 - XML: Start document: iteration 2
Mon 20 Jan 2014 17:16:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43595223
Mon 20 Jan 2014 17:16:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 17:16:51 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43595223
Mon 20 Jan 2014 17:16:51 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 17:16:53 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:16:53 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:16:55 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:16:55 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:16:55 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 17:16:55 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 17:16:55 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 9144 values 144630 bits 18078 bytes 
Mon 20 Jan 2014 17:16:55 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 17:17:01 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:17:01 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:17:04 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 17:17:04 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 17:17:04 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 17:17:04 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:17:04 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 17:17:04 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:17:05 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:17:05 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:17:05 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 17:17:06 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 17:17:06 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 17:17:06 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 17:17:06 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 17:17:06 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 17:17:06 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 17:17:06 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 17:17:10 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 17:17:10 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 17:17:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 17:17:10 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:17:10 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:17:10 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 17:17:10 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:17:10 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 17:17:12 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 17:17:12 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43503432
Mon 20 Jan 2014 17:17:12 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 17:17:12 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43503432
Mon 20 Jan 2014 17:17:12 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 17:17:21 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:17:21 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:17:21 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 17:17:21 - job_xml_thread(): Done retrieving: data size 43503432
Mon 20 Jan 2014 17:17:21 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 17:17:21 - XML: Start document: iteration 3
Mon 20 Jan 2014 17:17:24 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 17:17:24 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 17:17:24 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 17:17:24 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:17:24 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:17:24 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 17:17:24 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:17:24 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 17:17:24 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 17:17:25 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 17:17:25 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:17:33 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 17:17:33 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 17:17:33 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:17:35 - XML: Processed 652608 elements - found 0 jobs
Mon 20 Jan 2014 17:17:35 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 17:17:35 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 17:17:35 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 17:17:35 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 17:17:36 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 17:17:36 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 17:17:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 17:17:36 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:17:36 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:17:36 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:17:36 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 17:17:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 17:17:37 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 17:17:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43001198
Mon 20 Jan 2014 17:17:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 17:17:39 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43001198
Mon 20 Jan 2014 17:17:39 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 17:17:40 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:17:40 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:17:46 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 17:17:46 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 17:17:46 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 17:17:46 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:17:47 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:17:47 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 17:17:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43001198
Mon 20 Jan 2014 17:17:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 17:17:47 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:17:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 17:17:50 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 17:17:50 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 17:17:51 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 17:17:51 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:17:55 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:17:55 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:17:56 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 17:17:56 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 17:17:56 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 17:17:56 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:17:56 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:17:56 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:17:56 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 17:17:56 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 17:17:56 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 17:17:56 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5883 values 93018 bits 11627 bytes 
Mon 20 Jan 2014 17:17:57 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 17:17:57 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 17:17:57 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:17:57 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 17:17:57 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:17:57 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 17:17:59 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 17:17:59 - job_xml_thread(): Done retrieving: data size 42908358
Mon 20 Jan 2014 17:17:59 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 17:17:59 - XML: Start document: iteration 4
Mon 20 Jan 2014 17:18:00 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42908358
Mon 20 Jan 2014 17:18:00 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 17:18:02 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:18:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:18:03 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:18:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 17:18:03 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42908358
Mon 20 Jan 2014 17:18:03 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 17:18:03 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:18:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 17:18:12 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 17:18:12 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:18:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 17:18:15 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 17:18:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:18:18 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:18:18 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:18:18 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:18:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 17:18:18 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 17:18:18 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 17:18:19 - XML: Processed 645294 elements - found 0 jobs
Mon 20 Jan 2014 17:18:19 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 17:18:19 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 17:18:19 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 17:18:19 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 17:18:23 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 17:18:23 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 17:18:23 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 17:18:23 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:18:23 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:18:23 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:18:23 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 17:18:23 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 17:18:23 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 17:18:23 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 17:18:23 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:18:24 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 17:18:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42972010
Mon 20 Jan 2014 17:18:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 17:18:25 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42972010
Mon 20 Jan 2014 17:18:25 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 17:18:26 - ganglia_store_thread(): Done waiting: storemetricthread() (cluster LISA Cluster) still running :( now what?
Mon 20 Jan 2014 17:18:26 - ganglia_store_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:18:27 - ganglia_store_metric_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:18:27 - ganglia_store_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:18:27 - ganglia_store_thread(): Sleeping.. (60s): cluster LISA Cluster
Mon 20 Jan 2014 17:18:28 - ganglia_store_metric_thread(): Storing data.. cluster LISA Cluster
Mon 20 Jan 2014 17:18:28 - Entering storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 17:18:33 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:18:34 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:18:34 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 17:18:34 - job_xml_thread(): Done retrieving: data size 42972010
Mon 20 Jan 2014 17:18:34 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 17:18:34 - XML: Start document: iteration 5
Mon 20 Jan 2014 17:18:34 - size of cluster 'LISA Cluster': 624 hosts 79473 metrics 792739 values 12532124 bits 1566515 bytes 
Mon 20 Jan 2014 17:18:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 17:18:36 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 17:18:36 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 17:18:36 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:18:36 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:18:36 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 17:18:36 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 17:18:36 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:18:36 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 17:18:38 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 17:18:38 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:18:46 - XML: Processed 645917 elements - found 0 jobs
Mon 20 Jan 2014 17:18:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 17:18:47 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 17:18:47 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 17:18:47 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 17:18:47 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 17:18:47 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 17:18:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 17:18:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:18:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:18:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:18:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 17:18:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 17:18:50 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 17:18:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43495217
Mon 20 Jan 2014 17:18:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 17:18:50 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43495217
Mon 20 Jan 2014 17:18:50 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 17:18:51 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:18:51 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:18:56 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:18:59 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:19:00 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:19:00 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:19:00 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 17:19:00 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 17:19:00 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 17:19:00 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 17:19:00 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 17:19:00 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8750 values 138295 bits 17286 bytes 
Mon 20 Jan 2014 17:19:00 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 17:19:00 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:19:01 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:19:01 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:19:01 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 17:19:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 17:19:01 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 17:19:02 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 17:19:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 17:19:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:19:06 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 17:19:06 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 17:19:06 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 17:19:06 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:19:07 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:19:07 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:19:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 17:19:07 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 17:19:09 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 17:19:09 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 17:19:09 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:19:10 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 17:19:10 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43553168
Mon 20 Jan 2014 17:19:10 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 17:19:10 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43553168
Mon 20 Jan 2014 17:19:10 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 17:19:11 - job_xml_thread(): Done retrieving: data size 43553168
Mon 20 Jan 2014 17:19:11 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 17:19:11 - XML: Start document: iteration 6
Mon 20 Jan 2014 17:19:16 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:19:16 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:19:23 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 17:19:23 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:19:27 - ganglia_store_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 17:19:27 - ganglia_store_thread(): storemetricthread() (cluster LISA Cluster) still running, waiting to finish..
Mon 20 Jan 2014 17:19:28 - XML: Processed 653340 elements - found 0 jobs
Mon 20 Jan 2014 17:19:28 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 17:19:28 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 17:19:28 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 17:19:28 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 17:19:29 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 17:19:29 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 17:19:29 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 17:19:29 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:19:31 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:19:31 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:19:31 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 17:19:31 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 17:19:31 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 17:19:34 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 17:19:34 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 17:19:34 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 17:19:34 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:19:34 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:19:34 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:19:34 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 17:19:34 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 17:19:37 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 17:19:37 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43574576
Mon 20 Jan 2014 17:19:37 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 17:19:38 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43574576
Mon 20 Jan 2014 17:19:38 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 17:19:44 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 17:19:44 - job_xml_thread(): Done retrieving: data size 43574576
Mon 20 Jan 2014 17:19:44 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 17:19:44 - XML: Start document: iteration 7
Mon 20 Jan 2014 17:19:46 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:19:46 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:19:49 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 17:19:49 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 17:19:49 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 17:19:49 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:19:49 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 17:19:49 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:19:49 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:19:49 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 17:19:49 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 17:19:49 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:19:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 17:20:00 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:20:00 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:20:00 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 17:20:00 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 17:20:01 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 17:20:01 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:20:01 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 17:20:01 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 17:20:01 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 17:20:01 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 17:20:01 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 17:20:01 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:20:01 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:20:01 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:20:01 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 17:20:01 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:20:01 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 17:20:01 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 17:20:01 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 17:20:01 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 17:20:01 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 6280 values 99095 bits 12386 bytes 
Mon 20 Jan 2014 17:20:04 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:20:04 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:20:04 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 17:20:04 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43546881
Mon 20 Jan 2014 17:20:04 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 17:20:05 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43546881
Mon 20 Jan 2014 17:20:05 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 17:20:15 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 17:20:15 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 17:20:15 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 17:20:15 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:20:16 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 17:20:16 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 17:20:16 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 17:20:16 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:20:16 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:20:16 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:20:16 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 17:20:16 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 17:20:20 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 17:20:20 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 17:20:20 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 17:20:20 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:20:21 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:20:21 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:20:21 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 17:20:21 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 17:20:21 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 17:20:21 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 17:20:21 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:20:23 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 17:20:23 - job_xml_thread(): Done retrieving: data size 43562482
Mon 20 Jan 2014 17:20:23 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 17:20:23 - XML: Start document: iteration 8
Mon 20 Jan 2014 17:20:24 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43562482
Mon 20 Jan 2014 17:20:24 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 17:20:24 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43562482
Mon 20 Jan 2014 17:20:24 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 17:20:31 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:20:31 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:20:36 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 17:20:36 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:20:40 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 17:20:40 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 17:20:40 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 17:20:40 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:20:41 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:20:41 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 17:20:41 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:20:41 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 17:20:41 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 17:20:42 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 17:20:42 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 17:20:42 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 17:20:42 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 17:20:42 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 17:20:47 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 17:20:47 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 17:20:47 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 17:20:47 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:20:47 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:20:47 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:20:47 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 17:20:47 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 17:20:50 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 17:20:50 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43579503
Mon 20 Jan 2014 17:20:50 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 17:20:51 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43579503
Mon 20 Jan 2014 17:20:51 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 17:20:57 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:20:57 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:20:58 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 17:20:58 - job_xml_thread(): Done retrieving: data size 43579503
Mon 20 Jan 2014 17:20:58 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 17:20:58 - XML: Start document: iteration 9
Mon 20 Jan 2014 17:21:01 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:21:01 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:21:02 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 17:21:02 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:21:02 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 17:21:02 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 17:21:02 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 17:21:02 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:21:03 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:21:03 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:21:03 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 17:21:03 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 17:21:03 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 17:21:03 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:21:03 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 17:21:03 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:21:03 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 17:21:03 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 17:21:03 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 8296 values 130860 bits 16357 bytes 
Mon 20 Jan 2014 17:21:11 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 17:21:11 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 17:21:11 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 17:21:11 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 17:21:11 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 17:21:14 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 17:21:14 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 17:21:14 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 17:21:14 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:21:14 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:21:14 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 17:21:14 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:21:14 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 17:21:17 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 17:21:17 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43549344
Mon 20 Jan 2014 17:21:17 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 17:21:17 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43549344
Mon 20 Jan 2014 17:21:17 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 17:21:18 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:21:18 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:21:26 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 17:21:26 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 17:21:26 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 17:21:26 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 17:21:26 - job_xml_thread(): Done retrieving: data size 43549344
Mon 20 Jan 2014 17:21:26 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:21:26 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 17:21:26 - XML: Start document: iteration 10
Mon 20 Jan 2014 17:21:27 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:21:27 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 17:21:27 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43549344
Mon 20 Jan 2014 17:21:27 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 17:21:27 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:21:27 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 17:21:30 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 17:21:30 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:21:38 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 17:21:38 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 17:21:38 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 17:21:38 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 17:21:38 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 17:21:42 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:21:42 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:21:44 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 17:21:44 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 17:21:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 17:21:44 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:21:45 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:21:45 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:21:45 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 17:21:45 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 17:21:45 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 17:21:48 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 17:21:48 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 17:21:48 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 17:21:48 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:21:49 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:21:49 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 17:21:49 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:21:49 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 17:21:49 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 17:21:49 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 17:21:49 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:21:52 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 17:21:52 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43578562
Mon 20 Jan 2014 17:21:52 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 17:21:52 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43578562
Mon 20 Jan 2014 17:21:52 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 17:21:53 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 17:21:53 - job_xml_thread(): Done retrieving: data size 43578562
Mon 20 Jan 2014 17:21:53 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 17:21:53 - XML: Start document: iteration 11
Mon 20 Jan 2014 17:22:00 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:22:00 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:22:03 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:22:03 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:22:05 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:22:05 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 17:22:05 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:22:05 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:22:05 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 17:22:05 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 17:22:05 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 17:22:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5682 values 89603 bits 11200 bytes 
Mon 20 Jan 2014 17:22:10 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 17:22:10 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 17:22:10 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 17:22:10 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 17:22:10 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 17:22:10 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 17:22:10 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 17:22:10 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 17:22:10 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:22:11 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:22:11 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:22:11 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 17:22:11 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 17:22:11 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 17:22:17 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 17:22:17 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 17:22:17 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 17:22:17 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:22:18 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:22:18 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:22:18 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 17:22:18 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 17:22:20 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 17:22:20 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43577902
Mon 20 Jan 2014 17:22:20 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 17:22:21 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43577902
Mon 20 Jan 2014 17:22:21 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 17:22:25 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 17:22:25 - job_xml_thread(): Done retrieving: data size 43577902
Mon 20 Jan 2014 17:22:25 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 17:22:25 - XML: Start document: iteration 12
Mon 20 Jan 2014 17:22:26 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:22:26 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:22:33 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 17:22:33 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:22:35 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 17:22:35 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 17:22:35 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 17:22:35 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:22:37 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:22:37 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:22:37 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 17:22:37 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 17:22:37 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 17:22:38 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 17:22:38 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 17:22:38 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 17:22:38 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 17:22:38 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 17:22:40 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 17:22:40 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 17:22:40 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:22:44 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 17:22:44 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 17:22:44 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 17:22:44 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:22:44 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:22:44 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 17:22:44 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:22:44 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 17:22:47 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 17:22:47 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43566544
Mon 20 Jan 2014 17:22:47 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 17:22:47 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43566544
Mon 20 Jan 2014 17:22:47 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 17:22:52 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:22:52 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:22:54 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 17:22:54 - job_xml_thread(): Done retrieving: data size 43566544
Mon 20 Jan 2014 17:22:54 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 17:22:54 - XML: Start document: iteration 13
Mon 20 Jan 2014 17:22:59 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 17:22:59 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:23:05 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:23:05 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:23:06 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:23:06 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:23:06 - ganglia_store_metric_thread(): Storing data.. cluster Render Cluster
Mon 20 Jan 2014 17:23:06 - Entering storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 17:23:06 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
Mon 20 Jan 2014 17:23:06 - size of cluster 'Render Cluster': 20 hosts 3140 metrics 5907 values 93213 bits 11651 bytes 
Mon 20 Jan 2014 17:23:07 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 17:23:07 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 17:23:07 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 17:23:07 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:23:07 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:23:07 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:23:07 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 17:23:07 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 17:23:07 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 17:23:10 - XML: Processed 653358 elements - found 0 jobs
Mon 20 Jan 2014 17:23:10 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 17:23:10 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 17:23:10 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 17:23:10 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 17:23:12 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 17:23:12 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 17:23:12 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 17:23:12 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:23:12 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:23:12 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 17:23:12 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:23:12 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 17:23:16 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 17:23:16 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 43499105
Mon 20 Jan 2014 17:23:16 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 17:23:16 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 43499105
Mon 20 Jan 2014 17:23:16 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 17:23:22 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:23:22 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:23:26 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 17:23:26 - job_xml_thread(): Done retrieving: data size 43499105
Mon 20 Jan 2014 17:23:26 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 17:23:26 - XML: Start document: iteration 14
Mon 20 Jan 2014 17:23:27 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 17:23:27 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:23:28 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 17:23:28 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 17:23:28 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 17:23:28 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:23:29 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:23:29 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:23:29 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 17:23:29 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 17:23:29 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 17:23:31 - Leaving storeMetrics(): cluster Render Cluster
Mon 20 Jan 2014 17:23:31 - ganglia_store_metric_thread(): Done storing: cluster Render Cluster
Mon 20 Jan 2014 17:23:31 - ganglia_store_metric_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:23:39 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 17:23:39 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 17:23:39 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 17:23:39 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:23:39 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:23:39 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:23:39 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 17:23:39 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 17:23:40 - XML: Processed 652608 elements - found 0 jobs
Mon 20 Jan 2014 17:23:40 - job_xml_thread(): Found 0 updated jobs.
Mon 20 Jan 2014 17:23:40 - job_xml_thread(): No jobs to store.
Mon 20 Jan 2014 17:23:40 - job_xml_thread(): Done parsing.
Mon 20 Jan 2014 17:23:40 - job_xml_thread(): Sleeping.. (15s)
Mon 20 Jan 2014 17:23:42 - Leaving storeMetrics(): cluster LISA Cluster
Mon 20 Jan 2014 17:23:42 - ganglia_store_metric_thread(): Done storing: cluster LISA Cluster
Mon 20 Jan 2014 17:23:42 - ganglia_store_metric_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:23:43 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 17:23:43 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42965468
Mon 20 Jan 2014 17:23:43 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 17:23:44 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42965468
Mon 20 Jan 2014 17:23:44 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 17:23:44 - ganglia_xml_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:23:44 - ganglia_xml_thread(): parsethread() (cluster Render Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:23:53 - ganglia_parse_thread(): Done parsing: cluster Render Cluster
Mon 20 Jan 2014 17:23:53 - ganglia_parse_thread(): finished: Render Cluster
Mon 20 Jan 2014 17:23:54 - ganglia_xml_thread(): Done waiting: parsethread() (cluster Render Cluster) finished
Mon 20 Jan 2014 17:23:54 - ganglia_xml_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:23:54 - ganglia_xml_thread(): Done sleeping: cluster LISA Cluster
Mon 20 Jan 2014 17:23:55 - ganglia_xml_thread(): parsethread() (cluster LISA Cluster) still running, waiting (60s) to finish..
Mon 20 Jan 2014 17:23:55 - ganglia_parse_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:23:55 - ganglia_xml_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:23:55 - ganglia_parse_thread(): Retrieving XML data.. cluster Render Cluster
Mon 20 Jan 2014 17:23:55 - ganglia_xml_thread(): Sleeping.. (15s): cluster Render Cluster
Mon 20 Jan 2014 17:23:55 - XMLGatherer.retrieveData(): actually retrieving data..
Mon 20 Jan 2014 17:23:56 - job_xml_thread(): Retrieving XML data..
Mon 20 Jan 2014 17:23:57 - ganglia_parse_thread(): Done parsing: cluster LISA Cluster
Mon 20 Jan 2014 17:23:57 - ganglia_parse_thread(): finished: LISA Cluster
Mon 20 Jan 2014 17:23:57 - ganglia_xml_thread(): Done waiting: parsethread() (cluster LISA Cluster) finished
Mon 20 Jan 2014 17:23:57 - ganglia_xml_thread(): finished: cluster LISA Cluster
Mon 20 Jan 2014 17:23:58 - ganglia_parse_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:23:58 - ganglia_xml_thread(): started: cluster LISA Cluster
Mon 20 Jan 2014 17:23:58 - ganglia_parse_thread(): Retrieving XML data.. cluster LISA Cluster
Mon 20 Jan 2014 17:23:58 - ganglia_xml_thread(): Sleeping.. (15s): cluster LISA Cluster
Mon 20 Jan 2014 17:23:59 - XMLGatherer.retrieveData(): Done retrieving data.
Mon 20 Jan 2014 17:23:59 - ganglia_parse_thread(): Done retrieving (cluster Render Cluster): data size 42914620
Mon 20 Jan 2014 17:23:59 - ganglia_parse_thread(): Parsing XML.. cluster Render Cluster
Mon 20 Jan 2014 17:23:59 - ganglia_parse_thread(): Done retrieving (cluster LISA Cluster): data size 42914620
Mon 20 Jan 2014 17:23:59 - ganglia_parse_thread(): Parsing XML.. cluster LISA Cluster
Mon 20 Jan 2014 17:23:59 - job_xml_thread(): Done retrieving: data size 42914620
Mon 20 Jan 2014 17:23:59 - job_xml_thread(): Parsing XML..
Mon 20 Jan 2014 17:23:59 - XML: Start document: iteration 15
Mon 20 Jan 2014 17:24:06 - ganglia_store_thread(): Done sleeping: cluster Render Cluster
Mon 20 Jan 2014 17:24:06 - ganglia_store_thread(): finished: cluster Render Cluster
Mon 20 Jan 2014 17:24:07 - ganglia_store_metric_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:24:08 - ganglia_store_thread(): started: cluster Render Cluster
Mon 20 Jan 2014 17:24:08 - ganglia_store_thread(): Sleeping.. (60s): cluster Render Cluster
